2024-09-10T22:04:40.971 INFO:root:teuthology version: 1.2.2.dev2+g3752d38 2024-09-10T22:04:41.000 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-10T22:04:41.096 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/hyelloji-2024-09-10_16:59:47-fs-wip-hemanth-testing-2024-09-10-0723-testing-default-smithi/7899721 branch: wip-hemanth-testing-2024-09-10-0723 description: fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mgr mon osd} mount/kclient/{base/{mount-syntax/{v2} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} ms_mode/secure wsync/yes} objectstore-ec/bluestore-bitmap omap_limit/10 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts pg_health session_timeout} ranks/multi/{balancer/automatic export-check n/3 replication/always} standby-replay tasks/{0-subvolume/{with-quota} 1-check-counter 2-scrub/yes 3-snaps/no 4-flush/yes 5-quiesce/no 6-workunit/suites/iogen}} email: hyelloji@redhat.com first_in_suite: false job_id: '7899721' kernel: client: sha1: distro flavor: default kdb: 1 sha1: 2ca44a2f35ca8f36983aaaa46d49312239ef519a ktype: distro last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi name: hyelloji-2024-09-10_16:59:47-fs-wip-hemanth-testing-2024-09-10-0723-testing-default-smithi no_nested_subset: false openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: centos os_version: 9.stream overrides: admin_socket: branch: wip-hemanth-testing-2024-09-10-0723 ceph: cephfs: max_mds: 3 session_timeout: 300 standby_replay: true cluster-conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 rados mon op timeout: 900 rados osd op timeout: 900 mds: debug mds: 20 debug mds balancer: 20 debug ms: 2 mds bal fragment size max: 10000 mds bal merge size: 5 mds bal split bits: 3 mds bal split size: 100 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mon: mon op complaint time: 120 mon warn on pool no app: false osd: osd op complaint time: 180 conf: global: ms die on skipped message: false mds: mds_bal_replicate_threshold: 1 mgr: cephsqlite lock renewal timeout: 900000 client mount timeout: 30 debug client: 20 debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon down mkfs grace: 300 osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd shutdown pgref assert: true osd_max_omap_entries_per_request: 10 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - FS_DEGRADED - fs.*is degraded - filesystem is degraded - FS_INLINE_DATA_DEPRECATED - FS_WITH_FAILED_MDS - MDS_ALL_DOWN - filesystem is offline - MDS_DAMAGE - MDS_DEGRADED - MDS_FAILED - MDS_INSUFFICIENT_STANDBY - insufficient standby MDS daemons available - MDS_UP_LESS_THAN_MAX - online, but wants - filesystem is online with fewer MDS than max_mds - POOL_APP_NOT_ENABLED - do not have an application enabled - overall HEALTH_ - Replacing daemon - deprecated feature inline_data - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - PG_AVAILABILITY - PG_DEGRADED - Reduced data availability - Degraded data redundancy - slow metadata IO - SLOW_OPS - slow request sha1: 8f219c476cb4f26fc5719c661c0323719a45cb30 subvols: create: 2 subvol_options: --size 25000000000 ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs ceph-fuse: client.0: mount_subvol_num: 0 check-counter: counters: mds: - mds.exported - mds.imported - min: 3 name: mds_cache.dir_update - min: 3 name: mds_cache.dir_update_receipt dry_run: true install: ceph: flavor: default sha1: 8f219c476cb4f26fc5719c661c0323719a45cb30 kclient: client.0: mount_subvol_num: 1 mntopts: - ms_mode=secure - wsync syntax: v2 selinux: allowlist: - scontext=system_u:system_r:logrotate_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-hemanth-testing-2024-09-10-0723 sha1: 8f219c476cb4f26fc5719c661c0323719a45cb30 owner: scheduled_hyelloji@teuthology priority: 100 repo: https://github.com/ceph/ceph-ci.git roles: - - mon.a - mgr.x - mds.a - mds.d - mds.g - mds.j - osd.0 - osd.3 - osd.6 - osd.9 - client.0 - - mon.b - mgr.y - mds.b - mds.e - mds.h - mds.k - osd.1 - osd.4 - osd.7 - osd.10 - - mon.c - mgr.z - mds.c - mds.f - mds.i - mds.l - osd.2 - osd.5 - osd.8 - osd.11 seed: 6190 sha1: 8f219c476cb4f26fc5719c661c0323719a45cb30 sleep_before_teardown: 0 subset: 479/1024 suite: fs suite_branch: wip-hemanth-testing-2024-09-10-0723 suite_path: /home/teuthworker/src/github.com_ceph_ceph-c_8f219c476cb4f26fc5719c661c0323719a45cb30/qa suite_relpath: qa suite_repo: https://github.com/ceph/ceph-ci.git suite_sha1: 8f219c476cb4f26fc5719c661c0323719a45cb30 syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi019.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBOji6xdoTb6rXHTwc/vfLCn2NfHDq/Hc9+T7BEyXPoy0X7sgmOyJ9Sl2vrwm+WXP/qlj3zh+s4fOuH15zdZ2rc8= smithi135.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLZopJSWe2cbrYxvhJ+G2gCh3cTT7hbXAYCDxMXmGk3+d56mootuZgyLXroUhMiFjNzGUINkWXp4mzwSzb8G7xE= smithi138.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBAXpz1VLIcLjQ3j4+RDF+/oz7sMYW3hxF1B81wkEsZB1mJzDceXd35ZAZm+oo+i9U5qD3n1H/2mLeWTk+4yi1ac= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - cephadm: roleless: false - cephadm.shell: mon.a: - ceph orch status - ceph orch ps - ceph orch ls - ceph orch host ls - ceph orch device ls - cephadm.shell: mon.a: - ceph fs dump - ceph osd dump - fs.ready: timeout: 300 - kclient: null - exec: mon.a: - ceph fs set cephfs balance_automate true - check-counter: {} - fwd_scrub: scrub_timeout: 900 sleep_between_iterations: 1 - background_exec: mon.a: - while sleep 13; do ceph tell mds.cephfs:0 flush journal; done - workunit: clients: all: - suites/iogen.sh teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return yaml.ktype == 'upstream' end - local function is_kdistro() return yaml.ktype == 'distro' end - local function is_fuse() return false end - local function syntax_version() return yaml.overrides.kclient.syntax end teuthology_branch: main teuthology_sha1: 3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a timestamp: 2024-09-10_16:59:47 tube: smithi user: hyelloji verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856 2024-09-10T22:04:41.096 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/github.com_ceph_ceph-c_8f219c476cb4f26fc5719c661c0323719a45cb30/qa; will attempt to use it 2024-09-10T22:04:41.097 INFO:teuthology.run:Found tasks at /home/teuthworker/src/github.com_ceph_ceph-c_8f219c476cb4f26fc5719c661c0323719a45cb30/qa/tasks 2024-09-10T22:04:41.097 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-09-10T22:04:41.099 INFO:teuthology.task.internal:Checking packages... 2024-09-10T22:04:41.120 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash '8f219c476cb4f26fc5719c661c0323719a45cb30' 2024-09-10T22:04:41.120 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-10T22:04:41.120 INFO:teuthology.packaging:ref: None 2024-09-10T22:04:41.121 INFO:teuthology.packaging:tag: None 2024-09-10T22:04:41.121 INFO:teuthology.packaging:branch: wip-hemanth-testing-2024-09-10-0723 2024-09-10T22:04:41.121 INFO:teuthology.packaging:sha1: 8f219c476cb4f26fc5719c661c0323719a45cb30 2024-09-10T22:04:41.121 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=wip-hemanth-testing-2024-09-10-0723 2024-09-10T22:04:41.285 INFO:teuthology.task.internal:Found packages for ceph version 19.3.0-4854.g8f219c47 2024-09-10T22:04:41.287 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-09-10T22:04:41.293 INFO:teuthology.task.internal:no buildpackages task found 2024-09-10T22:04:41.293 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-09-10T22:04:41.305 INFO:teuthology.task.internal:Saving configuration 2024-09-10T22:04:41.326 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-09-10T22:04:41.349 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-09-10T22:04:41.381 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi019.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/hyelloji-2024-09-10_16:59:47-fs-wip-hemanth-testing-2024-09-10-0723-testing-default-smithi/7899721', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-10 21:59:51.084158', 'locked_by': 'scheduled_hyelloji@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBOji6xdoTb6rXHTwc/vfLCn2NfHDq/Hc9+T7BEyXPoy0X7sgmOyJ9Sl2vrwm+WXP/qlj3zh+s4fOuH15zdZ2rc8='} 2024-09-10T22:04:41.412 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi135.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/hyelloji-2024-09-10_16:59:47-fs-wip-hemanth-testing-2024-09-10-0723-testing-default-smithi/7899721', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-10 21:59:51.082839', 'locked_by': 'scheduled_hyelloji@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLZopJSWe2cbrYxvhJ+G2gCh3cTT7hbXAYCDxMXmGk3+d56mootuZgyLXroUhMiFjNzGUINkWXp4mzwSzb8G7xE='} 2024-09-10T22:04:41.442 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi138.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/hyelloji-2024-09-10_16:59:47-fs-wip-hemanth-testing-2024-09-10-0723-testing-default-smithi/7899721', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-10 21:59:51.085294', 'locked_by': 'scheduled_hyelloji@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBAXpz1VLIcLjQ3j4+RDF+/oz7sMYW3hxF1B81wkEsZB1mJzDceXd35ZAZm+oo+i9U5qD3n1H/2mLeWTk+4yi1ac='} 2024-09-10T22:04:41.442 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-09-10T22:04:41.449 INFO:teuthology.task.internal:roles: ubuntu@smithi019.front.sepia.ceph.com - ['mon.a', 'mgr.x', 'mds.a', 'mds.d', 'mds.g', 'mds.j', 'osd.0', 'osd.3', 'osd.6', 'osd.9', 'client.0'] 2024-09-10T22:04:41.449 INFO:teuthology.task.internal:roles: ubuntu@smithi135.front.sepia.ceph.com - ['mon.b', 'mgr.y', 'mds.b', 'mds.e', 'mds.h', 'mds.k', 'osd.1', 'osd.4', 'osd.7', 'osd.10'] 2024-09-10T22:04:41.449 INFO:teuthology.task.internal:roles: ubuntu@smithi138.front.sepia.ceph.com - ['mon.c', 'mgr.z', 'mds.c', 'mds.f', 'mds.i', 'mds.l', 'osd.2', 'osd.5', 'osd.8', 'osd.11'] 2024-09-10T22:04:41.449 INFO:teuthology.run_tasks:Running task console_log... 2024-09-10T22:04:41.558 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fd674b14a60>, signals=[15]) 2024-09-10T22:04:41.558 INFO:teuthology.run_tasks:Running task internal.connect... 2024-09-10T22:04:41.565 INFO:teuthology.task.internal:Opening connections... 2024-09-10T22:04:41.565 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi019.front.sepia.ceph.com 2024-09-10T22:04:41.566 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi019.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-10T22:04:41.650 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi135.front.sepia.ceph.com 2024-09-10T22:04:41.651 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi135.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-10T22:04:41.734 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi138.front.sepia.ceph.com 2024-09-10T22:04:41.735 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-10T22:04:41.813 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-09-10T22:04:41.822 DEBUG:teuthology.orchestra.run.smithi019:> uname -m 2024-09-10T22:04:41.840 INFO:teuthology.orchestra.run.smithi019.stdout:x86_64 2024-09-10T22:04:41.840 DEBUG:teuthology.orchestra.run.smithi019:> cat /etc/os-release 2024-09-10T22:04:41.898 INFO:teuthology.orchestra.run.smithi019.stdout:NAME="CentOS Stream" 2024-09-10T22:04:41.898 INFO:teuthology.orchestra.run.smithi019.stdout:VERSION="9" 2024-09-10T22:04:41.898 INFO:teuthology.orchestra.run.smithi019.stdout:ID="centos" 2024-09-10T22:04:41.898 INFO:teuthology.orchestra.run.smithi019.stdout:ID_LIKE="rhel fedora" 2024-09-10T22:04:41.898 INFO:teuthology.orchestra.run.smithi019.stdout:VERSION_ID="9" 2024-09-10T22:04:41.899 INFO:teuthology.orchestra.run.smithi019.stdout:PLATFORM_ID="platform:el9" 2024-09-10T22:04:41.899 INFO:teuthology.orchestra.run.smithi019.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-10T22:04:41.899 INFO:teuthology.orchestra.run.smithi019.stdout:ANSI_COLOR="0;31" 2024-09-10T22:04:41.899 INFO:teuthology.orchestra.run.smithi019.stdout:LOGO="fedora-logo-icon" 2024-09-10T22:04:41.899 INFO:teuthology.orchestra.run.smithi019.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-10T22:04:41.899 INFO:teuthology.orchestra.run.smithi019.stdout:HOME_URL="https://centos.org/" 2024-09-10T22:04:41.899 INFO:teuthology.orchestra.run.smithi019.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-10T22:04:41.899 INFO:teuthology.orchestra.run.smithi019.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-10T22:04:41.899 INFO:teuthology.orchestra.run.smithi019.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-10T22:04:41.900 INFO:teuthology.lock.ops:Updating smithi019.front.sepia.ceph.com on lock server 2024-09-10T22:04:41.931 DEBUG:teuthology.orchestra.run.smithi135:> uname -m 2024-09-10T22:04:41.950 INFO:teuthology.orchestra.run.smithi135.stdout:x86_64 2024-09-10T22:04:41.950 DEBUG:teuthology.orchestra.run.smithi135:> cat /etc/os-release 2024-09-10T22:04:42.008 INFO:teuthology.orchestra.run.smithi135.stdout:NAME="CentOS Stream" 2024-09-10T22:04:42.008 INFO:teuthology.orchestra.run.smithi135.stdout:VERSION="9" 2024-09-10T22:04:42.008 INFO:teuthology.orchestra.run.smithi135.stdout:ID="centos" 2024-09-10T22:04:42.008 INFO:teuthology.orchestra.run.smithi135.stdout:ID_LIKE="rhel fedora" 2024-09-10T22:04:42.009 INFO:teuthology.orchestra.run.smithi135.stdout:VERSION_ID="9" 2024-09-10T22:04:42.009 INFO:teuthology.orchestra.run.smithi135.stdout:PLATFORM_ID="platform:el9" 2024-09-10T22:04:42.009 INFO:teuthology.orchestra.run.smithi135.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-10T22:04:42.009 INFO:teuthology.orchestra.run.smithi135.stdout:ANSI_COLOR="0;31" 2024-09-10T22:04:42.009 INFO:teuthology.orchestra.run.smithi135.stdout:LOGO="fedora-logo-icon" 2024-09-10T22:04:42.009 INFO:teuthology.orchestra.run.smithi135.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-10T22:04:42.009 INFO:teuthology.orchestra.run.smithi135.stdout:HOME_URL="https://centos.org/" 2024-09-10T22:04:42.009 INFO:teuthology.orchestra.run.smithi135.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-10T22:04:42.009 INFO:teuthology.orchestra.run.smithi135.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-10T22:04:42.009 INFO:teuthology.orchestra.run.smithi135.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-10T22:04:42.009 INFO:teuthology.lock.ops:Updating smithi135.front.sepia.ceph.com on lock server 2024-09-10T22:04:42.040 DEBUG:teuthology.orchestra.run.smithi138:> uname -m 2024-09-10T22:04:42.058 INFO:teuthology.orchestra.run.smithi138.stdout:x86_64 2024-09-10T22:04:42.058 DEBUG:teuthology.orchestra.run.smithi138:> cat /etc/os-release 2024-09-10T22:04:42.116 INFO:teuthology.orchestra.run.smithi138.stdout:NAME="CentOS Stream" 2024-09-10T22:04:42.116 INFO:teuthology.orchestra.run.smithi138.stdout:VERSION="9" 2024-09-10T22:04:42.116 INFO:teuthology.orchestra.run.smithi138.stdout:ID="centos" 2024-09-10T22:04:42.116 INFO:teuthology.orchestra.run.smithi138.stdout:ID_LIKE="rhel fedora" 2024-09-10T22:04:42.116 INFO:teuthology.orchestra.run.smithi138.stdout:VERSION_ID="9" 2024-09-10T22:04:42.116 INFO:teuthology.orchestra.run.smithi138.stdout:PLATFORM_ID="platform:el9" 2024-09-10T22:04:42.116 INFO:teuthology.orchestra.run.smithi138.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-10T22:04:42.117 INFO:teuthology.orchestra.run.smithi138.stdout:ANSI_COLOR="0;31" 2024-09-10T22:04:42.117 INFO:teuthology.orchestra.run.smithi138.stdout:LOGO="fedora-logo-icon" 2024-09-10T22:04:42.117 INFO:teuthology.orchestra.run.smithi138.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-10T22:04:42.117 INFO:teuthology.orchestra.run.smithi138.stdout:HOME_URL="https://centos.org/" 2024-09-10T22:04:42.117 INFO:teuthology.orchestra.run.smithi138.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-10T22:04:42.117 INFO:teuthology.orchestra.run.smithi138.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-10T22:04:42.117 INFO:teuthology.orchestra.run.smithi138.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-10T22:04:42.117 INFO:teuthology.lock.ops:Updating smithi138.front.sepia.ceph.com on lock server 2024-09-10T22:04:42.147 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-09-10T22:04:42.157 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-09-10T22:04:42.163 INFO:teuthology.task.internal:Checking for old test directory... 2024-09-10T22:04:42.163 DEBUG:teuthology.orchestra.run.smithi019:> test '!' -e /home/ubuntu/cephtest 2024-09-10T22:04:42.165 DEBUG:teuthology.orchestra.run.smithi135:> test '!' -e /home/ubuntu/cephtest 2024-09-10T22:04:42.168 DEBUG:teuthology.orchestra.run.smithi138:> test '!' -e /home/ubuntu/cephtest 2024-09-10T22:04:42.185 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-09-10T22:04:42.190 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-09-10T22:04:42.190 DEBUG:teuthology.orchestra.run.smithi019:> test -z $(ls -A /var/lib/ceph) 2024-09-10T22:04:42.222 DEBUG:teuthology.orchestra.run.smithi135:> test -z $(ls -A /var/lib/ceph) 2024-09-10T22:04:42.226 DEBUG:teuthology.orchestra.run.smithi138:> test -z $(ls -A /var/lib/ceph) 2024-09-10T22:04:42.338 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-09-10T22:04:42.438 INFO:teuthology.run_tasks:Running task kernel... 2024-09-10T22:04:42.451 INFO:teuthology.task.kernel:normalize config orig: {'client': {'sha1': 'distro'}, 'flavor': 'default', 'kdb': 1, 'sha1': '2ca44a2f35ca8f36983aaaa46d49312239ef519a'} 2024-09-10T22:04:42.451 INFO:teuthology.task.kernel:normalize config final: {'client.0': {'sha1': 'distro'}} 2024-09-10T22:04:42.451 INFO:teuthology.task.kernel:config {'client.0': {'sha1': 'distro'}}, timeout 300 2024-09-10T22:04:42.451 DEBUG:teuthology.orchestra.run.smithi019:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-10T22:04:42.468 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-10T22:04:42.469 DEBUG:teuthology.orchestra.run.smithi019:> uname -r 2024-09-10T22:04:42.526 INFO:teuthology.orchestra.run.smithi019.stdout:5.14.0-503.el9.x86_64 2024-09-10T22:04:42.527 INFO:teuthology.task.kernel:Running kernel on smithi019: 5.14.0-503.el9.x86_64 2024-09-10T22:04:42.527 DEBUG:teuthology.orchestra.run.smithi019:> sudo yum install -y kernel 2024-09-10T22:04:45.110 INFO:teuthology.orchestra.run.smithi019.stdout:CentOS Stream 9 - BaseOS 8.9 MB/s | 8.2 MB 00:00 2024-09-10T22:04:47.203 INFO:teuthology.orchestra.run.smithi019.stdout:CentOS Stream 9 - AppStream 22 MB/s | 20 MB 00:00 2024-09-10T22:04:56.870 INFO:teuthology.orchestra.run.smithi019.stdout:CentOS Stream 9 - CRB 1.1 MB/s | 6.5 MB 00:05 2024-09-10T22:04:58.396 INFO:teuthology.orchestra.run.smithi019.stdout:CentOS Stream 9 - Extras packages 66 kB/s | 19 kB 00:00 2024-09-10T22:04:59.525 INFO:teuthology.orchestra.run.smithi019.stdout:Extra Packages for Enterprise Linux 23 MB/s | 23 MB 00:00 2024-09-10T22:05:05.206 INFO:teuthology.orchestra.run.smithi019.stdout:lab-extras 47 kB/s | 1.7 kB 00:00 2024-09-10T22:05:07.337 INFO:teuthology.orchestra.run.smithi019.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-09-10T22:05:07.337 INFO:teuthology.orchestra.run.smithi019.stdout:Package kernel-5.14.0-503.el9.x86_64 is already installed. 2024-09-10T22:05:07.441 INFO:teuthology.orchestra.run.smithi019.stdout:Dependencies resolved. 2024-09-10T22:05:07.458 INFO:teuthology.orchestra.run.smithi019.stdout:================================================================================ 2024-09-10T22:05:07.458 INFO:teuthology.orchestra.run.smithi019.stdout: Package Architecture Version Repository Size 2024-09-10T22:05:07.458 INFO:teuthology.orchestra.run.smithi019.stdout:================================================================================ 2024-09-10T22:05:07.458 INFO:teuthology.orchestra.run.smithi019.stdout:Installing: 2024-09-10T22:05:07.458 INFO:teuthology.orchestra.run.smithi019.stdout: kernel x86_64 5.14.0-505.el9 baseos 23 k 2024-09-10T22:05:07.458 INFO:teuthology.orchestra.run.smithi019.stdout:Installing dependencies: 2024-09-10T22:05:07.458 INFO:teuthology.orchestra.run.smithi019.stdout: kernel-core x86_64 5.14.0-505.el9 baseos 16 M 2024-09-10T22:05:07.458 INFO:teuthology.orchestra.run.smithi019.stdout: kernel-modules x86_64 5.14.0-505.el9 baseos 35 M 2024-09-10T22:05:07.458 INFO:teuthology.orchestra.run.smithi019.stdout: kernel-modules-core x86_64 5.14.0-505.el9 baseos 29 M 2024-09-10T22:05:07.458 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-10T22:05:07.459 INFO:teuthology.orchestra.run.smithi019.stdout:Transaction Summary 2024-09-10T22:05:07.459 INFO:teuthology.orchestra.run.smithi019.stdout:================================================================================ 2024-09-10T22:05:07.459 INFO:teuthology.orchestra.run.smithi019.stdout:Install 4 Packages 2024-09-10T22:05:07.459 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-10T22:05:07.459 INFO:teuthology.orchestra.run.smithi019.stdout:Total download size: 79 M 2024-09-10T22:05:07.459 INFO:teuthology.orchestra.run.smithi019.stdout:Installed size: 126 M 2024-09-10T22:05:07.459 INFO:teuthology.orchestra.run.smithi019.stdout:Downloading Packages: 2024-09-10T22:05:08.007 INFO:teuthology.orchestra.run.smithi019.stdout:(1/4): kernel-5.14.0-505.el9.x86_64.rpm 78 kB/s | 23 kB 00:00 2024-09-10T22:05:24.698 INFO:teuthology.orchestra.run.smithi019.stdout:(2/4): kernel-core-5.14.0-505.el9.x86_64.rpm 943 kB/s | 16 MB 00:16 2024-09-10T22:05:42.180 INFO:teuthology.orchestra.run.smithi019.stdout:(3/4): kernel-modules-core-5.14.0-505.el9.x86_6 856 kB/s | 29 MB 00:34 2024-09-10T22:05:51.312 INFO:teuthology.orchestra.run.smithi019.stdout:(4/4): kernel-modules-5.14.0-505.el9.x86_64.rpm 811 kB/s | 35 MB 00:43 2024-09-10T22:05:51.313 INFO:teuthology.orchestra.run.smithi019.stdout:-------------------------------------------------------------------------------- 2024-09-10T22:05:51.313 INFO:teuthology.orchestra.run.smithi019.stdout:Total 1.8 MB/s | 79 MB 00:43 2024-09-10T22:05:52.024 INFO:teuthology.orchestra.run.smithi019.stdout:Running transaction check 2024-09-10T22:05:52.402 INFO:teuthology.orchestra.run.smithi019.stdout:Transaction check succeeded. 2024-09-10T22:05:52.403 INFO:teuthology.orchestra.run.smithi019.stdout:Running transaction test 2024-09-10T22:05:53.408 INFO:teuthology.orchestra.run.smithi019.stdout:Transaction test succeeded. 2024-09-10T22:05:53.408 INFO:teuthology.orchestra.run.smithi019.stdout:Running transaction 2024-09-10T22:05:55.998 INFO:teuthology.orchestra.run.smithi019.stdout: Preparing : 1/1 2024-09-10T22:05:56.700 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : kernel-modules-core-5.14.0-505.el9.x86_64 1/4 2024-09-10T22:05:56.780 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-10T22:05:59.599 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-10T22:05:59.724 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-10T22:06:04.851 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-10T22:06:04.891 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : kernel-5.14.0-505.el9.x86_64 4/4 2024-09-10T22:06:10.037 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: kernel-modules-core-5.14.0-505.el9.x86_64 4/4 2024-09-10T22:06:49.196 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: kernel-core-5.14.0-505.el9.x86_64 4/4 2024-09-10T22:06:49.236 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: kernel-modules-5.14.0-505.el9.x86_64 4/4 2024-09-10T22:06:49.695 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: kernel-5.14.0-505.el9.x86_64 4/4 2024-09-10T22:06:49.695 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : kernel-5.14.0-505.el9.x86_64 1/4 2024-09-10T22:06:49.695 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-10T22:06:49.695 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-10T22:06:50.539 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : kernel-modules-core-5.14.0-505.el9.x86_64 4/4 2024-09-10T22:06:50.539 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-10T22:06:50.539 INFO:teuthology.orchestra.run.smithi019.stdout:Installed: 2024-09-10T22:06:50.539 INFO:teuthology.orchestra.run.smithi019.stdout: kernel-5.14.0-505.el9.x86_64 2024-09-10T22:06:50.539 INFO:teuthology.orchestra.run.smithi019.stdout: kernel-core-5.14.0-505.el9.x86_64 2024-09-10T22:06:50.539 INFO:teuthology.orchestra.run.smithi019.stdout: kernel-modules-5.14.0-505.el9.x86_64 2024-09-10T22:06:50.539 INFO:teuthology.orchestra.run.smithi019.stdout: kernel-modules-core-5.14.0-505.el9.x86_64 2024-09-10T22:06:50.539 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-10T22:06:50.539 INFO:teuthology.orchestra.run.smithi019.stdout:Complete! 2024-09-10T22:06:50.873 DEBUG:teuthology.orchestra.run.smithi019:> rpm -q kernel | sort -rV | head -n 1 2024-09-10T22:06:50.967 INFO:teuthology.orchestra.run.smithi019.stdout:kernel-5.14.0-505.el9.x86_64 2024-09-10T22:06:50.967 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-505.el9.x86_64 2024-09-10T22:06:50.967 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-503.el9.x86_64 Expected: 5.14.0-505.el9.x86_64 2024-09-10T22:06:50.968 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-10T22:06:50.968 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-10T22:06:50.968 INFO:teuthology.task.kernel:Installing distro kernel on client.0... 2024-09-10T22:06:50.968 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi019.front.sepia.ceph.com, path=None, version=distro) 2024-09-10T22:06:50.968 DEBUG:teuthology.orchestra.run.smithi019:> rpm -q kernel | sort -rV | head -n 1 2024-09-10T22:06:51.026 INFO:teuthology.orchestra.run.smithi019.stdout:kernel-5.14.0-505.el9.x86_64 2024-09-10T22:06:51.027 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-505.el9.x86_64 2024-09-10T22:06:51.027 DEBUG:teuthology.orchestra.run.smithi019:> sudo rpm -qi grub2-tools 2024-09-10T22:06:51.058 INFO:teuthology.orchestra.run.smithi019.stdout:Name : grub2-tools 2024-09-10T22:06:51.058 INFO:teuthology.orchestra.run.smithi019.stdout:Epoch : 1 2024-09-10T22:06:51.059 INFO:teuthology.orchestra.run.smithi019.stdout:Version : 2.06 2024-09-10T22:06:51.059 INFO:teuthology.orchestra.run.smithi019.stdout:Release : 82.el9 2024-09-10T22:06:51.059 INFO:teuthology.orchestra.run.smithi019.stdout:Architecture: x86_64 2024-09-10T22:06:51.059 INFO:teuthology.orchestra.run.smithi019.stdout:Install Date: Wed 28 Aug 2024 09:06:27 PM UTC 2024-09-10T22:06:51.059 INFO:teuthology.orchestra.run.smithi019.stdout:Group : Unspecified 2024-09-10T22:06:51.059 INFO:teuthology.orchestra.run.smithi019.stdout:Size : 8274670 2024-09-10T22:06:51.059 INFO:teuthology.orchestra.run.smithi019.stdout:License : GPLv3+ 2024-09-10T22:06:51.059 INFO:teuthology.orchestra.run.smithi019.stdout:Signature : RSA/SHA256, Mon 01 Jul 2024 07:46:42 AM UTC, Key ID 05b555b38483c65d 2024-09-10T22:06:51.059 INFO:teuthology.orchestra.run.smithi019.stdout:Source RPM : grub2-2.06-82.el9.src.rpm 2024-09-10T22:06:51.059 INFO:teuthology.orchestra.run.smithi019.stdout:Build Date : Fri 28 Jun 2024 09:24:44 AM UTC 2024-09-10T22:06:51.059 INFO:teuthology.orchestra.run.smithi019.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-09-10T22:06:51.059 INFO:teuthology.orchestra.run.smithi019.stdout:Packager : builder@centos.org 2024-09-10T22:06:51.059 INFO:teuthology.orchestra.run.smithi019.stdout:Vendor : CentOS 2024-09-10T22:06:51.060 INFO:teuthology.orchestra.run.smithi019.stdout:URL : http://www.gnu.org/software/grub/ 2024-09-10T22:06:51.060 INFO:teuthology.orchestra.run.smithi019.stdout:Summary : Support tools for GRUB. 2024-09-10T22:06:51.060 INFO:teuthology.orchestra.run.smithi019.stdout:Description : 2024-09-10T22:06:51.060 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-10T22:06:51.060 INFO:teuthology.orchestra.run.smithi019.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-09-10T22:06:51.060 INFO:teuthology.orchestra.run.smithi019.stdout:customizable bootloader with modular architecture. It supports a rich 2024-09-10T22:06:51.060 INFO:teuthology.orchestra.run.smithi019.stdout:variety of kernel formats, file systems, computer architectures and 2024-09-10T22:06:51.060 INFO:teuthology.orchestra.run.smithi019.stdout:hardware devices. 2024-09-10T22:06:51.060 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-10T22:06:51.060 INFO:teuthology.orchestra.run.smithi019.stdout:This subpackage provides tools for support of all platforms. 2024-09-10T22:06:51.061 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-09-10T22:06:51.061 INFO:teuthology.task.kernel:Updating grub on smithi019 to boot 5.14.0-505.el9.x86_64 2024-09-10T22:06:51.061 DEBUG:teuthology.orchestra.run.smithi019:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-09-10T22:06:51.775 INFO:teuthology.orchestra.run.smithi019.stderr:Generating grub configuration file ... 2024-09-10T22:06:53.115 INFO:teuthology.orchestra.run.smithi019.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-09-10T22:06:53.139 INFO:teuthology.orchestra.run.smithi019.stderr:done 2024-09-10T22:06:53.141 DEBUG:teuthology.orchestra.run.smithi019:> mktemp 2024-09-10T22:06:53.157 INFO:teuthology.orchestra.run.smithi019.stdout:/tmp/tmp.Tkg617KTi3 2024-09-10T22:06:53.157 DEBUG:teuthology.orchestra.run.smithi019:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.Tkg617KTi3 2024-09-10T22:06:53.222 DEBUG:teuthology.orchestra.run.smithi019:> sudo chmod 0666 /tmp/tmp.Tkg617KTi3 2024-09-10T22:06:53.360 DEBUG:teuthology.orchestra.remote:smithi019:/tmp/tmp.Tkg617KTi3 is 6KB 2024-09-10T22:06:53.408 DEBUG:teuthology.orchestra.run.smithi019:> rm -fr /tmp/tmp.Tkg617KTi3 2024-09-10T22:06:53.423 DEBUG:teuthology.orchestra.run.smithi019:> sudo /bin/ls /boot/loader/entries || true 2024-09-10T22:06:53.492 INFO:teuthology.orchestra.run.smithi019.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-0-rescue.conf 2024-09-10T22:06:53.492 INFO:teuthology.orchestra.run.smithi019.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-239.el9.x86_64.conf 2024-09-10T22:06:53.492 INFO:teuthology.orchestra.run.smithi019.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-503.el9.x86_64.conf 2024-09-10T22:06:53.493 INFO:teuthology.orchestra.run.smithi019.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-505.el9.x86_64.conf 2024-09-10T22:06:53.494 DEBUG:teuthology.orchestra.run.smithi019:> sudo grub2-set-default fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-505.el9.x86_64 2024-09-10T22:06:53.661 DEBUG:teuthology.orchestra.run.smithi019:> sudo shutdown -r now 2024-09-10T22:07:23.664 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2024-09-10T22:07:23.665 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi019.front.sepia.ceph.com' 2024-09-10T22:07:23.666 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi019.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-10T22:07:42.141 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.19 2024-09-10T22:07:51.142 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi019.front.sepia.ceph.com' 2024-09-10T22:07:51.143 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi019.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-10T22:08:51.154 DEBUG:teuthology.orchestra.remote:timed out 2024-09-10T22:09:03.155 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi019.front.sepia.ceph.com' 2024-09-10T22:09:03.156 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi019.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-10T22:09:03.491 DEBUG:teuthology.orchestra.run.smithi019:> true 2024-09-10T22:09:03.855 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi019.front.sepia.ceph.com' 2024-09-10T22:09:03.855 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "5.14.0-505.el9.x86_64"... 2024-09-10T22:09:03.855 DEBUG:teuthology.orchestra.run.smithi019:> uname -r 2024-09-10T22:09:03.872 INFO:teuthology.orchestra.run.smithi019.stdout:5.14.0-505.el9.x86_64 2024-09-10T22:09:03.872 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-505.el9.x86_64 vs 5.14.0-505.el9.x86_64 2024-09-10T22:09:03.872 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-10T22:09:03.872 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-09-10T22:09:04.873 DEBUG:teuthology.parallel:result is None 2024-09-10T22:09:04.873 INFO:teuthology.run_tasks:Running task internal.base... 2024-09-10T22:09:04.883 INFO:teuthology.task.internal:Creating test directory... 2024-09-10T22:09:04.884 DEBUG:teuthology.orchestra.run.smithi019:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-10T22:09:04.887 DEBUG:teuthology.orchestra.run.smithi135:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-10T22:09:04.889 DEBUG:teuthology.orchestra.run.smithi138:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-10T22:09:04.908 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-09-10T22:09:04.914 INFO:teuthology.run_tasks:Running task internal.archive... 2024-09-10T22:09:04.924 INFO:teuthology.task.internal:Creating archive directory... 2024-09-10T22:09:04.924 DEBUG:teuthology.orchestra.run.smithi019:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-10T22:09:04.946 DEBUG:teuthology.orchestra.run.smithi135:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-10T22:09:04.948 DEBUG:teuthology.orchestra.run.smithi138:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-10T22:09:04.984 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-09-10T22:09:04.990 INFO:teuthology.task.internal:Enabling coredump saving... 2024-09-10T22:09:04.990 DEBUG:teuthology.orchestra.run.smithi135:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-10T22:09:05.030 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-10T22:09:05.030 DEBUG:teuthology.orchestra.run.smithi138:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-10T22:09:05.047 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-10T22:09:05.047 DEBUG:teuthology.orchestra.run.smithi019:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-10T22:09:05.049 DEBUG:teuthology.orchestra.run.smithi135:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-10T22:09:05.073 DEBUG:teuthology.orchestra.run.smithi138:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-10T22:09:05.119 INFO:teuthology.orchestra.run.smithi135.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-10T22:09:05.139 INFO:teuthology.orchestra.run.smithi135.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-10T22:09:05.142 INFO:teuthology.orchestra.run.smithi019.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-10T22:09:05.147 INFO:teuthology.orchestra.run.smithi138.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-10T22:09:05.157 INFO:teuthology.orchestra.run.smithi019.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-10T22:09:05.162 INFO:teuthology.orchestra.run.smithi138.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-10T22:09:05.164 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-09-10T22:09:05.171 INFO:teuthology.task.internal:Configuring sudo... 2024-09-10T22:09:05.171 DEBUG:teuthology.orchestra.run.smithi019:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-10T22:09:05.173 DEBUG:teuthology.orchestra.run.smithi135:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-10T22:09:05.175 DEBUG:teuthology.orchestra.run.smithi138:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-10T22:09:05.203 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-09-10T22:09:05.211 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-09-10T22:09:05.212 DEBUG:teuthology.orchestra.run.smithi019:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-10T22:09:05.243 DEBUG:teuthology.orchestra.run.smithi135:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-10T22:09:05.245 DEBUG:teuthology.orchestra.run.smithi138:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-10T22:09:05.262 DEBUG:teuthology.orchestra.run.smithi019:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-10T22:09:05.350 DEBUG:teuthology.orchestra.run.smithi019:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-10T22:09:05.392 DEBUG:teuthology.orchestra.run.smithi019:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-10T22:09:05.484 DEBUG:teuthology.orchestra.run.smithi019:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-10T22:09:05.520 DEBUG:teuthology.orchestra.run.smithi019:> set -ex 2024-09-10T22:09:05.520 DEBUG:teuthology.orchestra.run.smithi019:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-10T22:09:05.587 DEBUG:teuthology.orchestra.run.smithi135:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-10T22:09:05.639 DEBUG:teuthology.orchestra.run.smithi135:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-10T22:09:05.698 DEBUG:teuthology.orchestra.run.smithi135:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-10T22:09:05.751 DEBUG:teuthology.orchestra.run.smithi135:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-10T22:09:05.784 DEBUG:teuthology.orchestra.run.smithi135:> set -ex 2024-09-10T22:09:05.784 DEBUG:teuthology.orchestra.run.smithi135:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-10T22:09:05.851 DEBUG:teuthology.orchestra.run.smithi138:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-10T22:09:05.896 DEBUG:teuthology.orchestra.run.smithi138:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-10T22:09:05.952 DEBUG:teuthology.orchestra.run.smithi138:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-10T22:09:06.043 DEBUG:teuthology.orchestra.run.smithi138:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-10T22:09:06.079 DEBUG:teuthology.orchestra.run.smithi138:> set -ex 2024-09-10T22:09:06.080 DEBUG:teuthology.orchestra.run.smithi138:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-10T22:09:06.147 DEBUG:teuthology.orchestra.run.smithi019:> sudo service rsyslog restart 2024-09-10T22:09:06.149 DEBUG:teuthology.orchestra.run.smithi135:> sudo service rsyslog restart 2024-09-10T22:09:06.152 DEBUG:teuthology.orchestra.run.smithi138:> sudo service rsyslog restart 2024-09-10T22:09:06.186 INFO:teuthology.orchestra.run.smithi135.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-10T22:09:06.201 INFO:teuthology.orchestra.run.smithi019.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-10T22:09:06.225 INFO:teuthology.orchestra.run.smithi138.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-10T22:09:06.667 INFO:teuthology.run_tasks:Running task internal.timer... 2024-09-10T22:09:06.673 INFO:teuthology.task.internal:Starting timer... 2024-09-10T22:09:06.673 INFO:teuthology.run_tasks:Running task pcp... 2024-09-10T22:09:06.683 INFO:teuthology.run_tasks:Running task selinux... 2024-09-10T22:09:06.691 DEBUG:teuthology.task:Applying overrides for task selinux: {'allowlist': ['scontext=system_u:system_r:logrotate_t:s0']} 2024-09-10T22:09:06.691 DEBUG:teuthology.orchestra.run.smithi019:> sudo service auditd rotate 2024-09-10T22:09:06.759 INFO:teuthology.orchestra.run.smithi019.stdout:Rotating logs: 2024-09-10T22:09:06.761 DEBUG:teuthology.orchestra.run.smithi135:> sudo service auditd rotate 2024-09-10T22:09:06.831 INFO:teuthology.orchestra.run.smithi135.stdout:Rotating logs: 2024-09-10T22:09:06.833 DEBUG:teuthology.orchestra.run.smithi138:> sudo service auditd rotate 2024-09-10T22:09:06.902 INFO:teuthology.orchestra.run.smithi138.stdout:Rotating logs: 2024-09-10T22:09:06.904 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-09-10T22:09:06.904 DEBUG:teuthology.orchestra.run.smithi019:> /usr/sbin/getenforce 2024-09-10T22:09:06.931 INFO:teuthology.orchestra.run.smithi019.stdout:Permissive 2024-09-10T22:09:06.932 DEBUG:teuthology.orchestra.run.smithi135:> /usr/sbin/getenforce 2024-09-10T22:09:06.954 INFO:teuthology.orchestra.run.smithi135.stdout:Permissive 2024-09-10T22:09:06.954 DEBUG:teuthology.orchestra.run.smithi138:> /usr/sbin/getenforce 2024-09-10T22:09:06.975 INFO:teuthology.orchestra.run.smithi138.stdout:Permissive 2024-09-10T22:09:06.975 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi019.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi135.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi138.front.sepia.ceph.com': 'permissive'} 2024-09-10T22:09:06.975 DEBUG:teuthology.orchestra.run.smithi019:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 2024-09-10T22:09:07.003 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-10T22:09:07.003 DEBUG:teuthology.orchestra.run.smithi135:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 2024-09-10T22:09:07.030 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-10T22:09:07.030 DEBUG:teuthology.orchestra.run.smithi138:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 2024-09-10T22:09:07.058 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-10T22:09:07.059 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-09-10T22:09:07.059 DEBUG:teuthology.orchestra.run.smithi019:> sudo /usr/sbin/setenforce permissive 2024-09-10T22:09:07.089 DEBUG:teuthology.orchestra.run.smithi135:> sudo /usr/sbin/setenforce permissive 2024-09-10T22:09:07.122 DEBUG:teuthology.orchestra.run.smithi138:> sudo /usr/sbin/setenforce permissive 2024-09-10T22:09:07.158 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-09-10T22:09:07.170 DEBUG:teuthology.repo_utils:Setting repo remote to https://git.ceph.com/ceph-cm-ansible.git 2024-09-10T22:09:07.172 INFO:teuthology.repo_utils:Fetching git.ceph.com_ceph-cm-ansible_main from origin 2024-09-10T22:09:07.301 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-09-10T22:09:07.312 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-09-10T22:09:07.312 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi019.front.sepia.ceph.com,smithi135.front.sepia.ceph.com,smithi138.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-09-10T22:13:12.627 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi019.front.sepia.ceph.com'), Remote(name='ubuntu@smithi135.front.sepia.ceph.com'), Remote(name='ubuntu@smithi138.front.sepia.ceph.com')] 2024-09-10T22:13:12.628 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi019.front.sepia.ceph.com' 2024-09-10T22:13:12.630 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi019.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-10T22:13:12.718 DEBUG:teuthology.orchestra.run.smithi019:> true 2024-09-10T22:13:12.805 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi019.front.sepia.ceph.com' 2024-09-10T22:13:12.805 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi135.front.sepia.ceph.com' 2024-09-10T22:13:12.806 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi135.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-10T22:13:12.889 DEBUG:teuthology.orchestra.run.smithi135:> true 2024-09-10T22:13:12.964 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi135.front.sepia.ceph.com' 2024-09-10T22:13:12.965 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi138.front.sepia.ceph.com' 2024-09-10T22:13:12.965 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-10T22:13:13.047 DEBUG:teuthology.orchestra.run.smithi138:> true 2024-09-10T22:13:13.139 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi138.front.sepia.ceph.com' 2024-09-10T22:13:13.140 INFO:teuthology.run_tasks:Running task clock... 2024-09-10T22:13:13.183 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-09-10T22:13:13.183 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-10T22:13:13.184 DEBUG:teuthology.orchestra.run.smithi019:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-10T22:13:13.186 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-10T22:13:13.187 DEBUG:teuthology.orchestra.run.smithi135:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-10T22:13:13.189 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-10T22:13:13.189 DEBUG:teuthology.orchestra.run.smithi138:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-10T22:13:13.217 INFO:teuthology.orchestra.run.smithi135.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-10T22:13:13.219 INFO:teuthology.orchestra.run.smithi019.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-10T22:13:13.221 INFO:teuthology.orchestra.run.smithi138.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-10T22:13:13.232 INFO:teuthology.orchestra.run.smithi135.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-10T22:13:13.236 INFO:teuthology.orchestra.run.smithi019.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-10T22:13:13.236 INFO:teuthology.orchestra.run.smithi138.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-10T22:13:13.256 INFO:teuthology.orchestra.run.smithi135.stderr:sudo: ntpd: command not found 2024-09-10T22:13:13.262 INFO:teuthology.orchestra.run.smithi138.stderr:sudo: ntpd: command not found 2024-09-10T22:13:13.264 INFO:teuthology.orchestra.run.smithi019.stderr:sudo: ntpd: command not found 2024-09-10T22:13:13.267 INFO:teuthology.orchestra.run.smithi135.stdout:506 Cannot talk to daemon 2024-09-10T22:13:13.274 INFO:teuthology.orchestra.run.smithi138.stdout:506 Cannot talk to daemon 2024-09-10T22:13:13.276 INFO:teuthology.orchestra.run.smithi019.stdout:506 Cannot talk to daemon 2024-09-10T22:13:13.281 INFO:teuthology.orchestra.run.smithi135.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-10T22:13:13.288 INFO:teuthology.orchestra.run.smithi138.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-10T22:13:13.292 INFO:teuthology.orchestra.run.smithi019.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-10T22:13:13.295 INFO:teuthology.orchestra.run.smithi135.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-10T22:13:13.303 INFO:teuthology.orchestra.run.smithi138.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-10T22:13:13.307 INFO:teuthology.orchestra.run.smithi019.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-10T22:13:13.352 INFO:teuthology.orchestra.run.smithi135.stderr:bash: line 1: ntpq: command not found 2024-09-10T22:13:13.355 INFO:teuthology.orchestra.run.smithi135.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-10T22:13:13.355 INFO:teuthology.orchestra.run.smithi135.stdout:=============================================================================== 2024-09-10T22:13:13.355 INFO:teuthology.orchestra.run.smithi135.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-10T22:13:13.355 INFO:teuthology.orchestra.run.smithi135.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-10T22:13:13.355 INFO:teuthology.orchestra.run.smithi135.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-10T22:13:13.355 INFO:teuthology.orchestra.run.smithi135.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-10T22:13:13.366 INFO:teuthology.orchestra.run.smithi138.stderr:bash: line 1: ntpq: command not found 2024-09-10T22:13:13.369 INFO:teuthology.orchestra.run.smithi138.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-10T22:13:13.370 INFO:teuthology.orchestra.run.smithi138.stdout:=============================================================================== 2024-09-10T22:13:13.370 INFO:teuthology.orchestra.run.smithi138.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-10T22:13:13.370 INFO:teuthology.orchestra.run.smithi138.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-10T22:13:13.370 INFO:teuthology.orchestra.run.smithi138.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-10T22:13:13.370 INFO:teuthology.orchestra.run.smithi138.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-10T22:13:13.373 INFO:teuthology.orchestra.run.smithi019.stderr:bash: line 1: ntpq: command not found 2024-09-10T22:13:13.376 INFO:teuthology.orchestra.run.smithi019.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-10T22:13:13.376 INFO:teuthology.orchestra.run.smithi019.stdout:=============================================================================== 2024-09-10T22:13:13.376 INFO:teuthology.orchestra.run.smithi019.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-10T22:13:13.376 INFO:teuthology.orchestra.run.smithi019.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-10T22:13:13.376 INFO:teuthology.orchestra.run.smithi019.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-10T22:13:13.377 INFO:teuthology.orchestra.run.smithi019.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-10T22:13:13.377 INFO:teuthology.run_tasks:Running task install... 2024-09-10T22:13:13.385 DEBUG:teuthology.task.install:project ceph 2024-09-10T22:13:13.385 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '8f219c476cb4f26fc5719c661c0323719a45cb30'}} 2024-09-10T22:13:13.386 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '8f219c476cb4f26fc5719c661c0323719a45cb30'} 2024-09-10T22:13:13.386 INFO:teuthology.task.install:Using flavor: default 2024-09-10T22:13:13.391 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-09-10T22:13:13.391 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']} 2024-09-10T22:13:13.392 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '8f219c476cb4f26fc5719c661c0323719a45cb30', 'tag': None, 'wait_for_package': False} 2024-09-10T22:13:13.392 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=8f219c476cb4f26fc5719c661c0323719a45cb30 2024-09-10T22:13:13.394 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '8f219c476cb4f26fc5719c661c0323719a45cb30', 'tag': None, 'wait_for_package': False} 2024-09-10T22:13:13.394 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=8f219c476cb4f26fc5719c661c0323719a45cb30 2024-09-10T22:13:13.395 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '8f219c476cb4f26fc5719c661c0323719a45cb30', 'tag': None, 'wait_for_package': False} 2024-09-10T22:13:13.395 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=8f219c476cb4f26fc5719c661c0323719a45cb30 2024-09-10T22:13:13.550 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/wip-hemanth-testing-2024-09-10-0723/8f219c476cb4f26fc5719c661c0323719a45cb30/centos/9/flavors/default/ 2024-09-10T22:13:13.551 INFO:teuthology.task.install.rpm:Package version is 19.3.0-4854.g8f219c47 2024-09-10T22:13:13.565 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/wip-hemanth-testing-2024-09-10-0723/8f219c476cb4f26fc5719c661c0323719a45cb30/centos/9/flavors/default/ 2024-09-10T22:13:13.565 INFO:teuthology.task.install.rpm:Package version is 19.3.0-4854.g8f219c47 2024-09-10T22:13:13.566 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/wip-hemanth-testing-2024-09-10-0723/8f219c476cb4f26fc5719c661c0323719a45cb30/centos/9/flavors/default/ 2024-09-10T22:13:13.566 INFO:teuthology.task.install.rpm:Package version is 19.3.0-4854.g8f219c47 2024-09-10T22:13:13.672 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/wip-hemanth-testing-2024-09-10-0723/8f219c476cb4f26fc5719c661c0323719a45cb30/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-hemanth-testing-2024-09-10-0723/8f219c476cb4f26fc5719c661c0323719a45cb30/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-hemanth-testing-2024-09-10-0723/8f219c476cb4f26fc5719c661c0323719a45cb30/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-10T22:13:13.673 DEBUG:teuthology.orchestra.run.smithi019:> set -ex 2024-09-10T22:13:13.673 DEBUG:teuthology.orchestra.run.smithi019:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-10T22:13:13.683 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/wip-hemanth-testing-2024-09-10-0723/8f219c476cb4f26fc5719c661c0323719a45cb30/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-hemanth-testing-2024-09-10-0723/8f219c476cb4f26fc5719c661c0323719a45cb30/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-hemanth-testing-2024-09-10-0723/8f219c476cb4f26fc5719c661c0323719a45cb30/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-10T22:13:13.683 DEBUG:teuthology.orchestra.run.smithi138:> set -ex 2024-09-10T22:13:13.683 DEBUG:teuthology.orchestra.run.smithi138:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-10T22:13:13.693 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/wip-hemanth-testing-2024-09-10-0723/8f219c476cb4f26fc5719c661c0323719a45cb30/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-hemanth-testing-2024-09-10-0723/8f219c476cb4f26fc5719c661c0323719a45cb30/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-hemanth-testing-2024-09-10-0723/8f219c476cb4f26fc5719c661c0323719a45cb30/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-10T22:13:13.693 DEBUG:teuthology.orchestra.run.smithi135:> set -ex 2024-09-10T22:13:13.693 DEBUG:teuthology.orchestra.run.smithi135:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-10T22:13:13.700 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-09-10T22:13:13.701 DEBUG:teuthology.orchestra.run.smithi019:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/8f219c476cb4f26fc5719c661c0323719a45cb30/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-10T22:13:13.709 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-09-10T22:13:13.709 DEBUG:teuthology.orchestra.run.smithi138:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/8f219c476cb4f26fc5719c661c0323719a45cb30/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-10T22:13:13.719 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-09-10T22:13:13.720 DEBUG:teuthology.orchestra.run.smithi135:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/8f219c476cb4f26fc5719c661c0323719a45cb30/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-10T22:13:13.768 DEBUG:teuthology.orchestra.run.smithi019:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-10T22:13:13.775 DEBUG:teuthology.orchestra.run.smithi138:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-10T22:13:13.785 DEBUG:teuthology.orchestra.run.smithi135:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-10T22:13:13.845 DEBUG:teuthology.orchestra.run.smithi019:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-10T22:13:13.850 DEBUG:teuthology.orchestra.run.smithi138:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-10T22:13:13.860 DEBUG:teuthology.orchestra.run.smithi135:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-10T22:13:13.911 INFO:teuthology.orchestra.run.smithi019.stdout:check_obsoletes = 1 2024-09-10T22:13:13.912 DEBUG:teuthology.orchestra.run.smithi019:> sudo yum clean all 2024-09-10T22:13:13.914 INFO:teuthology.orchestra.run.smithi138.stdout:check_obsoletes = 1 2024-09-10T22:13:13.916 DEBUG:teuthology.orchestra.run.smithi138:> sudo yum clean all 2024-09-10T22:13:13.924 INFO:teuthology.orchestra.run.smithi135.stdout:check_obsoletes = 1 2024-09-10T22:13:13.926 DEBUG:teuthology.orchestra.run.smithi135:> sudo yum clean all 2024-09-10T22:13:14.140 INFO:teuthology.orchestra.run.smithi138.stdout:45 files removed 2024-09-10T22:13:14.151 INFO:teuthology.orchestra.run.smithi135.stdout:45 files removed 2024-09-10T22:13:14.159 INFO:teuthology.orchestra.run.smithi019.stdout:45 files removed 2024-09-10T22:13:14.167 DEBUG:teuthology.orchestra.run.smithi138:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-09-10T22:13:14.178 DEBUG:teuthology.orchestra.run.smithi135:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-09-10T22:13:14.187 DEBUG:teuthology.orchestra.run.smithi019:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-09-10T22:13:14.709 INFO:teuthology.orchestra.run.smithi138.stdout:ceph packages for x86_64 317 kB/s | 84 kB 00:00 2024-09-10T22:13:14.731 INFO:teuthology.orchestra.run.smithi135.stdout:ceph packages for x86_64 310 kB/s | 84 kB 00:00 2024-09-10T22:13:14.749 INFO:teuthology.orchestra.run.smithi019.stdout:ceph packages for x86_64 320 kB/s | 84 kB 00:00 2024-09-10T22:13:15.002 INFO:teuthology.orchestra.run.smithi138.stdout:ceph noarch packages 99 kB/s | 24 kB 00:00 2024-09-10T22:13:15.023 INFO:teuthology.orchestra.run.smithi135.stdout:ceph noarch packages 97 kB/s | 24 kB 00:00 2024-09-10T22:13:15.050 INFO:teuthology.orchestra.run.smithi019.stdout:ceph noarch packages 95 kB/s | 24 kB 00:00 2024-09-10T22:13:15.277 INFO:teuthology.orchestra.run.smithi138.stdout:ceph source packages 8.1 kB/s | 1.9 kB 00:00 2024-09-10T22:13:15.298 INFO:teuthology.orchestra.run.smithi135.stdout:ceph source packages 8.1 kB/s | 1.9 kB 00:00 2024-09-10T22:13:15.334 INFO:teuthology.orchestra.run.smithi019.stdout:ceph source packages 7.9 kB/s | 1.9 kB 00:00 2024-09-10T22:13:16.036 INFO:teuthology.orchestra.run.smithi138.stdout:CentOS Stream 9 - BaseOS 11 MB/s | 8.2 MB 00:00 2024-09-10T22:13:17.449 INFO:teuthology.orchestra.run.smithi135.stdout:CentOS Stream 9 - BaseOS 3.9 MB/s | 8.2 MB 00:02 2024-09-10T22:13:18.226 INFO:teuthology.orchestra.run.smithi019.stdout:CentOS Stream 9 - BaseOS 2.9 MB/s | 8.2 MB 00:02 2024-09-10T22:13:19.305 INFO:teuthology.orchestra.run.smithi138.stdout:CentOS Stream 9 - AppStream 9.5 MB/s | 20 MB 00:02 2024-09-10T22:13:19.741 INFO:teuthology.orchestra.run.smithi135.stdout:CentOS Stream 9 - AppStream 17 MB/s | 20 MB 00:01 2024-09-10T22:13:22.202 INFO:teuthology.orchestra.run.smithi019.stdout:CentOS Stream 9 - AppStream 7.3 MB/s | 20 MB 00:02 2024-09-10T22:13:24.392 INFO:teuthology.orchestra.run.smithi135.stdout:CentOS Stream 9 - CRB 8.2 MB/s | 6.5 MB 00:00 2024-09-10T22:13:24.615 INFO:teuthology.orchestra.run.smithi138.stdout:CentOS Stream 9 - CRB 4.3 MB/s | 6.5 MB 00:01 2024-09-10T22:13:26.107 INFO:teuthology.orchestra.run.smithi138.stdout:CentOS Stream 9 - Extras packages 64 kB/s | 19 kB 00:00 2024-09-10T22:13:26.134 INFO:teuthology.orchestra.run.smithi135.stdout:CentOS Stream 9 - Extras packages 36 kB/s | 19 kB 00:00 2024-09-10T22:13:27.627 INFO:teuthology.orchestra.run.smithi019.stdout:CentOS Stream 9 - CRB 4.5 MB/s | 6.5 MB 00:01 2024-09-10T22:13:27.628 INFO:teuthology.orchestra.run.smithi138.stdout:Extra Packages for Enterprise Linux 16 MB/s | 23 MB 00:01 2024-09-10T22:13:27.713 INFO:teuthology.orchestra.run.smithi135.stdout:Extra Packages for Enterprise Linux 16 MB/s | 23 MB 00:01 2024-09-10T22:13:29.112 INFO:teuthology.orchestra.run.smithi019.stdout:CentOS Stream 9 - Extras packages 88 kB/s | 19 kB 00:00 2024-09-10T22:13:30.208 INFO:teuthology.orchestra.run.smithi019.stdout:Extra Packages for Enterprise Linux 23 MB/s | 23 MB 00:00 2024-09-10T22:13:33.118 INFO:teuthology.orchestra.run.smithi138.stdout:lab-extras 48 kB/s | 1.7 kB 00:00 2024-09-10T22:13:33.328 INFO:teuthology.orchestra.run.smithi135.stdout:lab-extras 26 kB/s | 1.7 kB 00:00 2024-09-10T22:13:35.395 INFO:teuthology.orchestra.run.smithi138.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-10T22:13:35.396 INFO:teuthology.orchestra.run.smithi138.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-10T22:13:35.408 INFO:teuthology.orchestra.run.smithi138.stdout:Package NetworkManager-1:1.48.8-1.el9.x86_64 is already installed. 2024-09-10T22:13:35.408 INFO:teuthology.orchestra.run.smithi138.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-09-10T22:13:35.409 INFO:teuthology.orchestra.run.smithi138.stdout:Package util-linux-2.37.4-20.el9.x86_64 is already installed. 2024-09-10T22:13:35.410 INFO:teuthology.orchestra.run.smithi138.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-09-10T22:13:35.412 INFO:teuthology.orchestra.run.smithi138.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-09-10T22:13:35.414 INFO:teuthology.orchestra.run.smithi138.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-09-10T22:13:35.415 INFO:teuthology.orchestra.run.smithi138.stdout:Package xfsprogs-6.4.0-4.el9.x86_64 is already installed. 2024-09-10T22:13:35.478 INFO:teuthology.orchestra.run.smithi138.stdout:Dependencies resolved. 2024-09-10T22:13:35.492 INFO:teuthology.orchestra.run.smithi138.stdout:======================================================================================= 2024-09-10T22:13:35.492 INFO:teuthology.orchestra.run.smithi138.stdout: Package Arch Version Repository Size 2024-09-10T22:13:35.492 INFO:teuthology.orchestra.run.smithi138.stdout:======================================================================================= 2024-09-10T22:13:35.492 INFO:teuthology.orchestra.run.smithi138.stdout:Installing: 2024-09-10T22:13:35.492 INFO:teuthology.orchestra.run.smithi138.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-09-10T22:13:35.492 INFO:teuthology.orchestra.run.smithi138.stdout: ceph x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 6.6 k 2024-09-10T22:13:35.493 INFO:teuthology.orchestra.run.smithi138.stdout: ceph-base x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 5.5 M 2024-09-10T22:13:35.493 INFO:teuthology.orchestra.run.smithi138.stdout: ceph-fuse x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 900 k 2024-09-10T22:13:35.493 INFO:teuthology.orchestra.run.smithi138.stdout: ceph-immutable-object-cache x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 145 k 2024-09-10T22:13:35.493 INFO:teuthology.orchestra.run.smithi138.stdout: ceph-mgr x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 1.5 M 2024-09-10T22:13:35.493 INFO:teuthology.orchestra.run.smithi138.stdout: ceph-mgr-cephadm noarch 2:19.3.0-4854.g8f219c47.el9 ceph-noarch 154 k 2024-09-10T22:13:35.493 INFO:teuthology.orchestra.run.smithi138.stdout: ceph-mgr-dashboard noarch 2:19.3.0-4854.g8f219c47.el9 ceph-noarch 14 M 2024-09-10T22:13:35.493 INFO:teuthology.orchestra.run.smithi138.stdout: ceph-mgr-diskprediction-local noarch 2:19.3.0-4854.g8f219c47.el9 ceph-noarch 7.4 M 2024-09-10T22:13:35.493 INFO:teuthology.orchestra.run.smithi138.stdout: ceph-mgr-rook noarch 2:19.3.0-4854.g8f219c47.el9 ceph-noarch 49 k 2024-09-10T22:13:35.493 INFO:teuthology.orchestra.run.smithi138.stdout: ceph-radosgw x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 11 M 2024-09-10T22:13:35.493 INFO:teuthology.orchestra.run.smithi138.stdout: ceph-test x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 50 M 2024-09-10T22:13:35.493 INFO:teuthology.orchestra.run.smithi138.stdout: ceph-volume noarch 2:19.3.0-4854.g8f219c47.el9 ceph-noarch 285 k 2024-09-10T22:13:35.494 INFO:teuthology.orchestra.run.smithi138.stdout: cephadm noarch 2:19.3.0-4854.g8f219c47.el9 ceph-noarch 783 k 2024-09-10T22:13:35.494 INFO:teuthology.orchestra.run.smithi138.stdout: cephfs-mirror x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 225 k 2024-09-10T22:13:35.494 INFO:teuthology.orchestra.run.smithi138.stdout: cephfs-shell x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 27 k 2024-09-10T22:13:35.494 INFO:teuthology.orchestra.run.smithi138.stdout: cephfs-top noarch 2:19.3.0-4854.g8f219c47.el9 ceph-noarch 18 k 2024-09-10T22:13:35.494 INFO:teuthology.orchestra.run.smithi138.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-09-10T22:13:35.494 INFO:teuthology.orchestra.run.smithi138.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-09-10T22:13:35.494 INFO:teuthology.orchestra.run.smithi138.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-09-10T22:13:35.494 INFO:teuthology.orchestra.run.smithi138.stdout: libcephfs-devel x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 32 k 2024-09-10T22:13:35.494 INFO:teuthology.orchestra.run.smithi138.stdout: libcephfs2 x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 755 k 2024-09-10T22:13:35.494 INFO:teuthology.orchestra.run.smithi138.stdout: librados-devel x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 127 k 2024-09-10T22:13:35.494 INFO:teuthology.orchestra.run.smithi138.stdout: libtool x86_64 2.4.6-46.el9 appstream 581 k 2024-09-10T22:13:35.494 INFO:teuthology.orchestra.run.smithi138.stdout: libuuid-devel x86_64 2.37.4-20.el9 appstream 24 k 2024-09-10T22:13:35.495 INFO:teuthology.orchestra.run.smithi138.stdout: openssl-devel x86_64 1:3.2.2-6.el9 appstream 4.4 M 2024-09-10T22:13:35.495 INFO:teuthology.orchestra.run.smithi138.stdout: postgresql x86_64 13.16-1.el9 appstream 1.6 M 2024-09-10T22:13:35.495 INFO:teuthology.orchestra.run.smithi138.stdout: postgresql-contrib x86_64 13.16-1.el9 appstream 910 k 2024-09-10T22:13:35.495 INFO:teuthology.orchestra.run.smithi138.stdout: postgresql-server x86_64 13.16-1.el9 appstream 5.8 M 2024-09-10T22:13:35.495 INFO:teuthology.orchestra.run.smithi138.stdout: python3-cephfs x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 161 k 2024-09-10T22:13:35.495 INFO:teuthology.orchestra.run.smithi138.stdout: python3-rados x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 321 k 2024-09-10T22:13:35.495 INFO:teuthology.orchestra.run.smithi138.stdout: python3-rbd x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 306 k 2024-09-10T22:13:35.495 INFO:teuthology.orchestra.run.smithi138.stdout: python3-rgw x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 99 k 2024-09-10T22:13:35.495 INFO:teuthology.orchestra.run.smithi138.stdout: rbd-fuse x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 85 k 2024-09-10T22:13:35.495 INFO:teuthology.orchestra.run.smithi138.stdout: rbd-mirror x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 3.2 M 2024-09-10T22:13:35.495 INFO:teuthology.orchestra.run.smithi138.stdout: rbd-nbd x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 171 k 2024-09-10T22:13:35.495 INFO:teuthology.orchestra.run.smithi138.stdout: xfsprogs-devel x86_64 6.4.0-4.el9 appstream 96 k 2024-09-10T22:13:35.496 INFO:teuthology.orchestra.run.smithi138.stdout:Upgrading: 2024-09-10T22:13:35.496 INFO:teuthology.orchestra.run.smithi138.stdout: NetworkManager x86_64 1:1.49.90-1.el9 baseos 2.3 M 2024-09-10T22:13:35.496 INFO:teuthology.orchestra.run.smithi138.stdout: NetworkManager-libnm x86_64 1:1.49.90-1.el9 baseos 1.8 M 2024-09-10T22:13:35.496 INFO:teuthology.orchestra.run.smithi138.stdout: NetworkManager-team x86_64 1:1.49.90-1.el9 baseos 41 k 2024-09-10T22:13:35.496 INFO:teuthology.orchestra.run.smithi138.stdout: NetworkManager-tui x86_64 1:1.49.90-1.el9 baseos 249 k 2024-09-10T22:13:35.496 INFO:teuthology.orchestra.run.smithi138.stdout: librados2 x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 3.5 M 2024-09-10T22:13:35.496 INFO:teuthology.orchestra.run.smithi138.stdout: librbd1 x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 3.2 M 2024-09-10T22:13:35.496 INFO:teuthology.orchestra.run.smithi138.stdout: openssl x86_64 1:3.2.2-6.el9 baseos 1.4 M 2024-09-10T22:13:35.496 INFO:teuthology.orchestra.run.smithi138.stdout: openssl-libs x86_64 1:3.2.2-6.el9 baseos 2.4 M 2024-09-10T22:13:35.496 INFO:teuthology.orchestra.run.smithi138.stdout:Installing dependencies: 2024-09-10T22:13:35.496 INFO:teuthology.orchestra.run.smithi138.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-10T22:13:35.496 INFO:teuthology.orchestra.run.smithi138.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-09-10T22:13:35.497 INFO:teuthology.orchestra.run.smithi138.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-10T22:13:35.497 INFO:teuthology.orchestra.run.smithi138.stdout: ceph-common x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 22 M 2024-09-10T22:13:35.497 INFO:teuthology.orchestra.run.smithi138.stdout: ceph-grafana-dashboards noarch 2:19.3.0-4854.g8f219c47.el9 ceph-noarch 34 k 2024-09-10T22:13:35.497 INFO:teuthology.orchestra.run.smithi138.stdout: ceph-mds x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 2.4 M 2024-09-10T22:13:35.497 INFO:teuthology.orchestra.run.smithi138.stdout: ceph-mgr-modules-core noarch 2:19.3.0-4854.g8f219c47.el9 ceph-noarch 291 k 2024-09-10T22:13:35.497 INFO:teuthology.orchestra.run.smithi138.stdout: ceph-mon x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 4.8 M 2024-09-10T22:13:35.497 INFO:teuthology.orchestra.run.smithi138.stdout: ceph-osd x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 17 M 2024-09-10T22:13:35.497 INFO:teuthology.orchestra.run.smithi138.stdout: ceph-prometheus-alerts noarch 2:19.3.0-4854.g8f219c47.el9 ceph-noarch 16 k 2024-09-10T22:13:35.497 INFO:teuthology.orchestra.run.smithi138.stdout: ceph-selinux x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 25 k 2024-09-10T22:13:35.497 INFO:teuthology.orchestra.run.smithi138.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-10T22:13:35.497 INFO:teuthology.orchestra.run.smithi138.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-10T22:13:35.497 INFO:teuthology.orchestra.run.smithi138.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-10T22:13:35.497 INFO:teuthology.orchestra.run.smithi138.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-10T22:13:35.498 INFO:teuthology.orchestra.run.smithi138.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-09-10T22:13:35.498 INFO:teuthology.orchestra.run.smithi138.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-10T22:13:35.498 INFO:teuthology.orchestra.run.smithi138.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-10T22:13:35.498 INFO:teuthology.orchestra.run.smithi138.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-10T22:13:35.498 INFO:teuthology.orchestra.run.smithi138.stdout: libcephsqlite x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 162 k 2024-09-10T22:13:35.498 INFO:teuthology.orchestra.run.smithi138.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-10T22:13:35.498 INFO:teuthology.orchestra.run.smithi138.stdout: libnbd x86_64 1.20.2-2.el9 appstream 171 k 2024-09-10T22:13:35.498 INFO:teuthology.orchestra.run.smithi138.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-10T22:13:35.498 INFO:teuthology.orchestra.run.smithi138.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-10T22:13:35.498 INFO:teuthology.orchestra.run.smithi138.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-10T22:13:35.498 INFO:teuthology.orchestra.run.smithi138.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-10T22:13:35.499 INFO:teuthology.orchestra.run.smithi138.stdout: libradosstriper1 x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 507 k 2024-09-10T22:13:35.499 INFO:teuthology.orchestra.run.smithi138.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-10T22:13:35.499 INFO:teuthology.orchestra.run.smithi138.stdout: librgw2 x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 5.5 M 2024-09-10T22:13:35.499 INFO:teuthology.orchestra.run.smithi138.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-10T22:13:35.499 INFO:teuthology.orchestra.run.smithi138.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-09-10T22:13:35.499 INFO:teuthology.orchestra.run.smithi138.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-10T22:13:35.499 INFO:teuthology.orchestra.run.smithi138.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-10T22:13:35.499 INFO:teuthology.orchestra.run.smithi138.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-10T22:13:35.499 INFO:teuthology.orchestra.run.smithi138.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-10T22:13:35.499 INFO:teuthology.orchestra.run.smithi138.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-10T22:13:35.499 INFO:teuthology.orchestra.run.smithi138.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-10T22:13:35.499 INFO:teuthology.orchestra.run.smithi138.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-10T22:13:35.499 INFO:teuthology.orchestra.run.smithi138.stdout: postgresql-private-libs x86_64 13.16-1.el9 appstream 137 k 2024-09-10T22:13:35.500 INFO:teuthology.orchestra.run.smithi138.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-10T22:13:35.500 INFO:teuthology.orchestra.run.smithi138.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-10T22:13:35.500 INFO:teuthology.orchestra.run.smithi138.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-10T22:13:35.500 INFO:teuthology.orchestra.run.smithi138.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-09-10T22:13:35.500 INFO:teuthology.orchestra.run.smithi138.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-10T22:13:35.500 INFO:teuthology.orchestra.run.smithi138.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-10T22:13:35.500 INFO:teuthology.orchestra.run.smithi138.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-10T22:13:35.500 INFO:teuthology.orchestra.run.smithi138.stdout: python3-ceph-argparse x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 45 k 2024-09-10T22:13:35.500 INFO:teuthology.orchestra.run.smithi138.stdout: python3-ceph-common x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 143 k 2024-09-10T22:13:35.500 INFO:teuthology.orchestra.run.smithi138.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-10T22:13:35.500 INFO:teuthology.orchestra.run.smithi138.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-10T22:13:35.501 INFO:teuthology.orchestra.run.smithi138.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-10T22:13:35.501 INFO:teuthology.orchestra.run.smithi138.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-10T22:13:35.501 INFO:teuthology.orchestra.run.smithi138.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-09-10T22:13:35.501 INFO:teuthology.orchestra.run.smithi138.stdout: python3-colorama noarch 0.4.6-3.el9 appstream 61 k 2024-09-10T22:13:35.501 INFO:teuthology.orchestra.run.smithi138.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-10T22:13:35.501 INFO:teuthology.orchestra.run.smithi138.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-10T22:13:35.501 INFO:teuthology.orchestra.run.smithi138.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-10T22:13:35.501 INFO:teuthology.orchestra.run.smithi138.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-10T22:13:35.501 INFO:teuthology.orchestra.run.smithi138.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-10T22:13:35.501 INFO:teuthology.orchestra.run.smithi138.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-10T22:13:35.501 INFO:teuthology.orchestra.run.smithi138.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-10T22:13:35.501 INFO:teuthology.orchestra.run.smithi138.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-09-10T22:13:35.502 INFO:teuthology.orchestra.run.smithi138.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-10T22:13:35.502 INFO:teuthology.orchestra.run.smithi138.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-10T22:13:35.502 INFO:teuthology.orchestra.run.smithi138.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-10T22:13:35.502 INFO:teuthology.orchestra.run.smithi138.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-10T22:13:35.502 INFO:teuthology.orchestra.run.smithi138.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-10T22:13:35.502 INFO:teuthology.orchestra.run.smithi138.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-10T22:13:35.502 INFO:teuthology.orchestra.run.smithi138.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-10T22:13:35.502 INFO:teuthology.orchestra.run.smithi138.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-10T22:13:35.502 INFO:teuthology.orchestra.run.smithi138.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-10T22:13:35.502 INFO:teuthology.orchestra.run.smithi138.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-10T22:13:35.502 INFO:teuthology.orchestra.run.smithi138.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-10T22:13:35.502 INFO:teuthology.orchestra.run.smithi138.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-10T22:13:35.502 INFO:teuthology.orchestra.run.smithi138.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-10T22:13:35.503 INFO:teuthology.orchestra.run.smithi138.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-10T22:13:35.503 INFO:teuthology.orchestra.run.smithi138.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-10T22:13:35.503 INFO:teuthology.orchestra.run.smithi138.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-10T22:13:35.503 INFO:teuthology.orchestra.run.smithi138.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-10T22:13:35.503 INFO:teuthology.orchestra.run.smithi138.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-10T22:13:35.503 INFO:teuthology.orchestra.run.smithi138.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-10T22:13:35.503 INFO:teuthology.orchestra.run.smithi138.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-10T22:13:35.503 INFO:teuthology.orchestra.run.smithi138.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-10T22:13:35.503 INFO:teuthology.orchestra.run.smithi138.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-10T22:13:35.503 INFO:teuthology.orchestra.run.smithi138.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-10T22:13:35.503 INFO:teuthology.orchestra.run.smithi138.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-10T22:13:35.503 INFO:teuthology.orchestra.run.smithi138.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-09-10T22:13:35.503 INFO:teuthology.orchestra.run.smithi138.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-10T22:13:35.504 INFO:teuthology.orchestra.run.smithi138.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-10T22:13:35.504 INFO:teuthology.orchestra.run.smithi138.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-10T22:13:35.504 INFO:teuthology.orchestra.run.smithi138.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-10T22:13:35.504 INFO:teuthology.orchestra.run.smithi138.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-10T22:13:35.504 INFO:teuthology.orchestra.run.smithi138.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-10T22:13:35.504 INFO:teuthology.orchestra.run.smithi138.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-10T22:13:35.504 INFO:teuthology.orchestra.run.smithi138.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-10T22:13:35.504 INFO:teuthology.orchestra.run.smithi138.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-10T22:13:35.504 INFO:teuthology.orchestra.run.smithi138.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-10T22:13:35.504 INFO:teuthology.orchestra.run.smithi138.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-10T22:13:35.504 INFO:teuthology.orchestra.run.smithi138.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-09-10T22:13:35.504 INFO:teuthology.orchestra.run.smithi138.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-10T22:13:35.505 INFO:teuthology.orchestra.run.smithi138.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-10T22:13:35.505 INFO:teuthology.orchestra.run.smithi138.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-10T22:13:35.505 INFO:teuthology.orchestra.run.smithi138.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-10T22:13:35.505 INFO:teuthology.orchestra.run.smithi138.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-10T22:13:35.505 INFO:teuthology.orchestra.run.smithi138.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-10T22:13:35.505 INFO:teuthology.orchestra.run.smithi138.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-10T22:13:35.505 INFO:teuthology.orchestra.run.smithi138.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-10T22:13:35.505 INFO:teuthology.orchestra.run.smithi138.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-10T22:13:35.505 INFO:teuthology.orchestra.run.smithi138.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-09-10T22:13:35.505 INFO:teuthology.orchestra.run.smithi138.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-10T22:13:35.505 INFO:teuthology.orchestra.run.smithi138.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-09-10T22:13:35.505 INFO:teuthology.orchestra.run.smithi138.stdout:Installing weak dependencies: 2024-09-10T22:13:35.506 INFO:teuthology.orchestra.run.smithi138.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-10T22:13:35.506 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-10T22:13:35.506 INFO:teuthology.orchestra.run.smithi138.stdout:Transaction Summary 2024-09-10T22:13:35.506 INFO:teuthology.orchestra.run.smithi138.stdout:======================================================================================= 2024-09-10T22:13:35.506 INFO:teuthology.orchestra.run.smithi138.stdout:Install 149 Packages 2024-09-10T22:13:35.506 INFO:teuthology.orchestra.run.smithi138.stdout:Upgrade 8 Packages 2024-09-10T22:13:35.506 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-10T22:13:35.507 INFO:teuthology.orchestra.run.smithi138.stdout:Total download size: 240 M 2024-09-10T22:13:35.507 INFO:teuthology.orchestra.run.smithi138.stdout:Downloading Packages: 2024-09-10T22:13:35.632 INFO:teuthology.orchestra.run.smithi135.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-10T22:13:35.633 INFO:teuthology.orchestra.run.smithi135.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-10T22:13:35.646 INFO:teuthology.orchestra.run.smithi135.stdout:Package NetworkManager-1:1.48.8-1.el9.x86_64 is already installed. 2024-09-10T22:13:35.647 INFO:teuthology.orchestra.run.smithi135.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-09-10T22:13:35.648 INFO:teuthology.orchestra.run.smithi135.stdout:Package util-linux-2.37.4-20.el9.x86_64 is already installed. 2024-09-10T22:13:35.649 INFO:teuthology.orchestra.run.smithi135.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-09-10T22:13:35.651 INFO:teuthology.orchestra.run.smithi135.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-09-10T22:13:35.654 INFO:teuthology.orchestra.run.smithi135.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-09-10T22:13:35.655 INFO:teuthology.orchestra.run.smithi135.stdout:Package xfsprogs-6.4.0-4.el9.x86_64 is already installed. 2024-09-10T22:13:35.718 INFO:teuthology.orchestra.run.smithi135.stdout:Dependencies resolved. 2024-09-10T22:13:35.733 INFO:teuthology.orchestra.run.smithi135.stdout:======================================================================================= 2024-09-10T22:13:35.733 INFO:teuthology.orchestra.run.smithi135.stdout: Package Arch Version Repository Size 2024-09-10T22:13:35.733 INFO:teuthology.orchestra.run.smithi135.stdout:======================================================================================= 2024-09-10T22:13:35.733 INFO:teuthology.orchestra.run.smithi135.stdout:Installing: 2024-09-10T22:13:35.733 INFO:teuthology.orchestra.run.smithi135.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-09-10T22:13:35.734 INFO:teuthology.orchestra.run.smithi135.stdout: ceph x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 6.6 k 2024-09-10T22:13:35.734 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-base x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 5.5 M 2024-09-10T22:13:35.734 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-fuse x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 900 k 2024-09-10T22:13:35.734 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-immutable-object-cache x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 145 k 2024-09-10T22:13:35.734 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-mgr x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 1.5 M 2024-09-10T22:13:35.734 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-mgr-cephadm noarch 2:19.3.0-4854.g8f219c47.el9 ceph-noarch 154 k 2024-09-10T22:13:35.734 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-mgr-dashboard noarch 2:19.3.0-4854.g8f219c47.el9 ceph-noarch 14 M 2024-09-10T22:13:35.734 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-mgr-diskprediction-local noarch 2:19.3.0-4854.g8f219c47.el9 ceph-noarch 7.4 M 2024-09-10T22:13:35.734 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-mgr-rook noarch 2:19.3.0-4854.g8f219c47.el9 ceph-noarch 49 k 2024-09-10T22:13:35.734 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-radosgw x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 11 M 2024-09-10T22:13:35.734 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-test x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 50 M 2024-09-10T22:13:35.734 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-volume noarch 2:19.3.0-4854.g8f219c47.el9 ceph-noarch 285 k 2024-09-10T22:13:35.734 INFO:teuthology.orchestra.run.smithi135.stdout: cephadm noarch 2:19.3.0-4854.g8f219c47.el9 ceph-noarch 783 k 2024-09-10T22:13:35.735 INFO:teuthology.orchestra.run.smithi135.stdout: cephfs-mirror x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 225 k 2024-09-10T22:13:35.735 INFO:teuthology.orchestra.run.smithi135.stdout: cephfs-shell x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 27 k 2024-09-10T22:13:35.735 INFO:teuthology.orchestra.run.smithi135.stdout: cephfs-top noarch 2:19.3.0-4854.g8f219c47.el9 ceph-noarch 18 k 2024-09-10T22:13:35.735 INFO:teuthology.orchestra.run.smithi135.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-09-10T22:13:35.735 INFO:teuthology.orchestra.run.smithi135.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-09-10T22:13:35.735 INFO:teuthology.orchestra.run.smithi135.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-09-10T22:13:35.735 INFO:teuthology.orchestra.run.smithi135.stdout: libcephfs-devel x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 32 k 2024-09-10T22:13:35.735 INFO:teuthology.orchestra.run.smithi135.stdout: libcephfs2 x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 755 k 2024-09-10T22:13:35.735 INFO:teuthology.orchestra.run.smithi135.stdout: librados-devel x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 127 k 2024-09-10T22:13:35.735 INFO:teuthology.orchestra.run.smithi135.stdout: libtool x86_64 2.4.6-46.el9 appstream 581 k 2024-09-10T22:13:35.735 INFO:teuthology.orchestra.run.smithi135.stdout: libuuid-devel x86_64 2.37.4-20.el9 appstream 24 k 2024-09-10T22:13:35.735 INFO:teuthology.orchestra.run.smithi135.stdout: openssl-devel x86_64 1:3.2.2-6.el9 appstream 4.4 M 2024-09-10T22:13:35.736 INFO:teuthology.orchestra.run.smithi135.stdout: postgresql x86_64 13.16-1.el9 appstream 1.6 M 2024-09-10T22:13:35.736 INFO:teuthology.orchestra.run.smithi135.stdout: postgresql-contrib x86_64 13.16-1.el9 appstream 910 k 2024-09-10T22:13:35.736 INFO:teuthology.orchestra.run.smithi135.stdout: postgresql-server x86_64 13.16-1.el9 appstream 5.8 M 2024-09-10T22:13:35.736 INFO:teuthology.orchestra.run.smithi135.stdout: python3-cephfs x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 161 k 2024-09-10T22:13:35.736 INFO:teuthology.orchestra.run.smithi135.stdout: python3-rados x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 321 k 2024-09-10T22:13:35.736 INFO:teuthology.orchestra.run.smithi135.stdout: python3-rbd x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 306 k 2024-09-10T22:13:35.736 INFO:teuthology.orchestra.run.smithi135.stdout: python3-rgw x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 99 k 2024-09-10T22:13:35.736 INFO:teuthology.orchestra.run.smithi135.stdout: rbd-fuse x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 85 k 2024-09-10T22:13:35.736 INFO:teuthology.orchestra.run.smithi135.stdout: rbd-mirror x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 3.2 M 2024-09-10T22:13:35.736 INFO:teuthology.orchestra.run.smithi135.stdout: rbd-nbd x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 171 k 2024-09-10T22:13:35.736 INFO:teuthology.orchestra.run.smithi135.stdout: xfsprogs-devel x86_64 6.4.0-4.el9 appstream 96 k 2024-09-10T22:13:35.736 INFO:teuthology.orchestra.run.smithi135.stdout:Upgrading: 2024-09-10T22:13:35.736 INFO:teuthology.orchestra.run.smithi135.stdout: NetworkManager x86_64 1:1.49.90-1.el9 baseos 2.3 M 2024-09-10T22:13:35.736 INFO:teuthology.orchestra.run.smithi135.stdout: NetworkManager-libnm x86_64 1:1.49.90-1.el9 baseos 1.8 M 2024-09-10T22:13:35.737 INFO:teuthology.orchestra.run.smithi135.stdout: NetworkManager-team x86_64 1:1.49.90-1.el9 baseos 41 k 2024-09-10T22:13:35.737 INFO:teuthology.orchestra.run.smithi135.stdout: NetworkManager-tui x86_64 1:1.49.90-1.el9 baseos 249 k 2024-09-10T22:13:35.737 INFO:teuthology.orchestra.run.smithi135.stdout: librados2 x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 3.5 M 2024-09-10T22:13:35.737 INFO:teuthology.orchestra.run.smithi135.stdout: librbd1 x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 3.2 M 2024-09-10T22:13:35.737 INFO:teuthology.orchestra.run.smithi135.stdout: openssl x86_64 1:3.2.2-6.el9 baseos 1.4 M 2024-09-10T22:13:35.737 INFO:teuthology.orchestra.run.smithi135.stdout: openssl-libs x86_64 1:3.2.2-6.el9 baseos 2.4 M 2024-09-10T22:13:35.737 INFO:teuthology.orchestra.run.smithi135.stdout:Installing dependencies: 2024-09-10T22:13:35.737 INFO:teuthology.orchestra.run.smithi135.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-10T22:13:35.737 INFO:teuthology.orchestra.run.smithi135.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-09-10T22:13:35.737 INFO:teuthology.orchestra.run.smithi135.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-10T22:13:35.737 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-common x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 22 M 2024-09-10T22:13:35.737 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-grafana-dashboards noarch 2:19.3.0-4854.g8f219c47.el9 ceph-noarch 34 k 2024-09-10T22:13:35.738 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-mds x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 2.4 M 2024-09-10T22:13:35.738 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-mgr-modules-core noarch 2:19.3.0-4854.g8f219c47.el9 ceph-noarch 291 k 2024-09-10T22:13:35.738 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-mon x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 4.8 M 2024-09-10T22:13:35.738 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-osd x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 17 M 2024-09-10T22:13:35.738 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-prometheus-alerts noarch 2:19.3.0-4854.g8f219c47.el9 ceph-noarch 16 k 2024-09-10T22:13:35.738 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-selinux x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 25 k 2024-09-10T22:13:35.738 INFO:teuthology.orchestra.run.smithi135.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-10T22:13:35.738 INFO:teuthology.orchestra.run.smithi135.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-10T22:13:35.738 INFO:teuthology.orchestra.run.smithi135.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-10T22:13:35.738 INFO:teuthology.orchestra.run.smithi135.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-10T22:13:35.738 INFO:teuthology.orchestra.run.smithi135.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-09-10T22:13:35.738 INFO:teuthology.orchestra.run.smithi135.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-10T22:13:35.738 INFO:teuthology.orchestra.run.smithi135.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-10T22:13:35.739 INFO:teuthology.orchestra.run.smithi135.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-10T22:13:35.739 INFO:teuthology.orchestra.run.smithi135.stdout: libcephsqlite x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 162 k 2024-09-10T22:13:35.739 INFO:teuthology.orchestra.run.smithi135.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-10T22:13:35.739 INFO:teuthology.orchestra.run.smithi135.stdout: libnbd x86_64 1.20.2-2.el9 appstream 171 k 2024-09-10T22:13:35.739 INFO:teuthology.orchestra.run.smithi135.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-10T22:13:35.739 INFO:teuthology.orchestra.run.smithi135.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-10T22:13:35.739 INFO:teuthology.orchestra.run.smithi135.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-10T22:13:35.739 INFO:teuthology.orchestra.run.smithi135.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-10T22:13:35.739 INFO:teuthology.orchestra.run.smithi135.stdout: libradosstriper1 x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 507 k 2024-09-10T22:13:35.739 INFO:teuthology.orchestra.run.smithi135.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-10T22:13:35.740 INFO:teuthology.orchestra.run.smithi135.stdout: librgw2 x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 5.5 M 2024-09-10T22:13:35.740 INFO:teuthology.orchestra.run.smithi135.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-10T22:13:35.740 INFO:teuthology.orchestra.run.smithi135.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-09-10T22:13:35.740 INFO:teuthology.orchestra.run.smithi135.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-10T22:13:35.740 INFO:teuthology.orchestra.run.smithi135.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-10T22:13:35.740 INFO:teuthology.orchestra.run.smithi135.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-10T22:13:35.740 INFO:teuthology.orchestra.run.smithi135.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-10T22:13:35.740 INFO:teuthology.orchestra.run.smithi135.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-10T22:13:35.740 INFO:teuthology.orchestra.run.smithi135.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-10T22:13:35.740 INFO:teuthology.orchestra.run.smithi135.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-10T22:13:35.740 INFO:teuthology.orchestra.run.smithi135.stdout: postgresql-private-libs x86_64 13.16-1.el9 appstream 137 k 2024-09-10T22:13:35.740 INFO:teuthology.orchestra.run.smithi135.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-10T22:13:35.741 INFO:teuthology.orchestra.run.smithi135.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-10T22:13:35.741 INFO:teuthology.orchestra.run.smithi135.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-10T22:13:35.741 INFO:teuthology.orchestra.run.smithi135.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-09-10T22:13:35.741 INFO:teuthology.orchestra.run.smithi135.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-10T22:13:35.741 INFO:teuthology.orchestra.run.smithi135.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-10T22:13:35.741 INFO:teuthology.orchestra.run.smithi135.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-10T22:13:35.741 INFO:teuthology.orchestra.run.smithi135.stdout: python3-ceph-argparse x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 45 k 2024-09-10T22:13:35.741 INFO:teuthology.orchestra.run.smithi135.stdout: python3-ceph-common x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 143 k 2024-09-10T22:13:35.741 INFO:teuthology.orchestra.run.smithi135.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-10T22:13:35.741 INFO:teuthology.orchestra.run.smithi135.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-10T22:13:35.741 INFO:teuthology.orchestra.run.smithi135.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-10T22:13:35.741 INFO:teuthology.orchestra.run.smithi135.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-10T22:13:35.742 INFO:teuthology.orchestra.run.smithi135.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-09-10T22:13:35.742 INFO:teuthology.orchestra.run.smithi135.stdout: python3-colorama noarch 0.4.6-3.el9 appstream 61 k 2024-09-10T22:13:35.742 INFO:teuthology.orchestra.run.smithi135.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-10T22:13:35.742 INFO:teuthology.orchestra.run.smithi135.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-10T22:13:35.742 INFO:teuthology.orchestra.run.smithi135.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-10T22:13:35.742 INFO:teuthology.orchestra.run.smithi135.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-10T22:13:35.742 INFO:teuthology.orchestra.run.smithi135.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-10T22:13:35.742 INFO:teuthology.orchestra.run.smithi135.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-10T22:13:35.742 INFO:teuthology.orchestra.run.smithi135.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-10T22:13:35.742 INFO:teuthology.orchestra.run.smithi135.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-09-10T22:13:35.742 INFO:teuthology.orchestra.run.smithi135.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-10T22:13:35.742 INFO:teuthology.orchestra.run.smithi135.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-10T22:13:35.742 INFO:teuthology.orchestra.run.smithi135.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-10T22:13:35.743 INFO:teuthology.orchestra.run.smithi135.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-10T22:13:35.743 INFO:teuthology.orchestra.run.smithi135.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-10T22:13:35.743 INFO:teuthology.orchestra.run.smithi135.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-10T22:13:35.743 INFO:teuthology.orchestra.run.smithi135.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-10T22:13:35.743 INFO:teuthology.orchestra.run.smithi135.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-10T22:13:35.743 INFO:teuthology.orchestra.run.smithi135.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-10T22:13:35.743 INFO:teuthology.orchestra.run.smithi135.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-10T22:13:35.743 INFO:teuthology.orchestra.run.smithi135.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-10T22:13:35.743 INFO:teuthology.orchestra.run.smithi135.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-10T22:13:35.743 INFO:teuthology.orchestra.run.smithi135.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-10T22:13:35.743 INFO:teuthology.orchestra.run.smithi135.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-10T22:13:35.743 INFO:teuthology.orchestra.run.smithi135.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-10T22:13:35.743 INFO:teuthology.orchestra.run.smithi135.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-10T22:13:35.744 INFO:teuthology.orchestra.run.smithi135.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-10T22:13:35.744 INFO:teuthology.orchestra.run.smithi135.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-10T22:13:35.744 INFO:teuthology.orchestra.run.smithi135.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-10T22:13:35.744 INFO:teuthology.orchestra.run.smithi135.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-10T22:13:35.744 INFO:teuthology.orchestra.run.smithi135.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-10T22:13:35.744 INFO:teuthology.orchestra.run.smithi135.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-10T22:13:35.744 INFO:teuthology.orchestra.run.smithi135.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-10T22:13:35.744 INFO:teuthology.orchestra.run.smithi135.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-10T22:13:35.744 INFO:teuthology.orchestra.run.smithi135.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-09-10T22:13:35.744 INFO:teuthology.orchestra.run.smithi135.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-10T22:13:35.744 INFO:teuthology.orchestra.run.smithi135.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-10T22:13:35.744 INFO:teuthology.orchestra.run.smithi135.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-10T22:13:35.745 INFO:teuthology.orchestra.run.smithi135.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-10T22:13:35.745 INFO:teuthology.orchestra.run.smithi135.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-10T22:13:35.745 INFO:teuthology.orchestra.run.smithi135.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-10T22:13:35.745 INFO:teuthology.orchestra.run.smithi135.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-10T22:13:35.745 INFO:teuthology.orchestra.run.smithi135.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-10T22:13:35.745 INFO:teuthology.orchestra.run.smithi135.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-10T22:13:35.745 INFO:teuthology.orchestra.run.smithi135.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-10T22:13:35.745 INFO:teuthology.orchestra.run.smithi135.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-10T22:13:35.746 INFO:teuthology.orchestra.run.smithi135.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-09-10T22:13:35.746 INFO:teuthology.orchestra.run.smithi135.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-10T22:13:35.746 INFO:teuthology.orchestra.run.smithi135.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-10T22:13:35.746 INFO:teuthology.orchestra.run.smithi135.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-10T22:13:35.746 INFO:teuthology.orchestra.run.smithi135.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-10T22:13:35.746 INFO:teuthology.orchestra.run.smithi135.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-10T22:13:35.746 INFO:teuthology.orchestra.run.smithi135.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-10T22:13:35.746 INFO:teuthology.orchestra.run.smithi135.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-10T22:13:35.746 INFO:teuthology.orchestra.run.smithi135.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-10T22:13:35.746 INFO:teuthology.orchestra.run.smithi135.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-10T22:13:35.746 INFO:teuthology.orchestra.run.smithi135.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-09-10T22:13:35.746 INFO:teuthology.orchestra.run.smithi135.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-10T22:13:35.746 INFO:teuthology.orchestra.run.smithi135.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-09-10T22:13:35.747 INFO:teuthology.orchestra.run.smithi135.stdout:Installing weak dependencies: 2024-09-10T22:13:35.747 INFO:teuthology.orchestra.run.smithi135.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-10T22:13:35.747 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-09-10T22:13:35.747 INFO:teuthology.orchestra.run.smithi135.stdout:Transaction Summary 2024-09-10T22:13:35.747 INFO:teuthology.orchestra.run.smithi135.stdout:======================================================================================= 2024-09-10T22:13:35.747 INFO:teuthology.orchestra.run.smithi135.stdout:Install 149 Packages 2024-09-10T22:13:35.747 INFO:teuthology.orchestra.run.smithi135.stdout:Upgrade 8 Packages 2024-09-10T22:13:35.747 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-09-10T22:13:35.748 INFO:teuthology.orchestra.run.smithi135.stdout:Total download size: 240 M 2024-09-10T22:13:35.748 INFO:teuthology.orchestra.run.smithi135.stdout:Downloading Packages: 2024-09-10T22:13:35.922 INFO:teuthology.orchestra.run.smithi019.stdout:lab-extras 33 kB/s | 1.7 kB 00:00 2024-09-10T22:13:36.144 INFO:teuthology.orchestra.run.smithi138.stdout:(1/157): ceph-19.3.0-4854.g8f219c47.el9.x86_64. 50 kB/s | 6.6 kB 00:00 2024-09-10T22:13:36.336 INFO:teuthology.orchestra.run.smithi138.stdout:(2/157): ceph-fuse-19.3.0-4854.g8f219c47.el9.x8 4.6 MB/s | 900 kB 00:00 2024-09-10T22:13:36.386 INFO:teuthology.orchestra.run.smithi138.stdout:(3/157): ceph-immutable-object-cache-19.3.0-485 2.8 MB/s | 145 kB 00:00 2024-09-10T22:13:36.629 INFO:teuthology.orchestra.run.smithi138.stdout:(4/157): ceph-mds-19.3.0-4854.g8f219c47.el9.x86 9.9 MB/s | 2.4 MB 00:00 2024-09-10T22:13:36.679 INFO:teuthology.orchestra.run.smithi135.stdout:(1/157): ceph-19.3.0-4854.g8f219c47.el9.x86_64. 53 kB/s | 6.6 kB 00:00 2024-09-10T22:13:36.704 INFO:teuthology.orchestra.run.smithi138.stdout:(5/157): ceph-base-19.3.0-4854.g8f219c47.el9.x8 8.0 MB/s | 5.5 MB 00:00 2024-09-10T22:13:36.804 INFO:teuthology.orchestra.run.smithi138.stdout:(6/157): ceph-mgr-19.3.0-4854.g8f219c47.el9.x86 8.7 MB/s | 1.5 MB 00:00 2024-09-10T22:13:37.004 INFO:teuthology.orchestra.run.smithi135.stdout:(2/157): ceph-fuse-19.3.0-4854.g8f219c47.el9.x8 2.7 MB/s | 900 kB 00:00 2024-09-10T22:13:37.071 INFO:teuthology.orchestra.run.smithi135.stdout:(3/157): ceph-immutable-object-cache-19.3.0-485 2.1 MB/s | 145 kB 00:00 2024-09-10T22:13:37.088 INFO:teuthology.orchestra.run.smithi138.stdout:(7/157): ceph-mon-19.3.0-4854.g8f219c47.el9.x86 12 MB/s | 4.8 MB 00:00 2024-09-10T22:13:37.780 INFO:teuthology.orchestra.run.smithi135.stdout:(4/157): ceph-base-19.3.0-4854.g8f219c47.el9.x8 4.5 MB/s | 5.5 MB 00:01 2024-09-10T22:13:37.805 INFO:teuthology.orchestra.run.smithi138.stdout:(8/157): ceph-common-19.3.0-4854.g8f219c47.el9. 12 MB/s | 22 MB 00:01 2024-09-10T22:13:37.830 INFO:teuthology.orchestra.run.smithi135.stdout:(5/157): ceph-mds-19.3.0-4854.g8f219c47.el9.x86 3.1 MB/s | 2.4 MB 00:00 2024-09-10T22:13:37.855 INFO:teuthology.orchestra.run.smithi138.stdout:(9/157): ceph-selinux-19.3.0-4854.g8f219c47.el9 506 kB/s | 25 kB 00:00 2024-09-10T22:13:37.972 INFO:teuthology.orchestra.run.smithi135.stdout:(6/157): ceph-mgr-19.3.0-4854.g8f219c47.el9.x86 8.0 MB/s | 1.5 MB 00:00 2024-09-10T22:13:37.981 INFO:teuthology.orchestra.run.smithi138.stdout:(10/157): ceph-radosgw-19.3.0-4854.g8f219c47.el 12 MB/s | 11 MB 00:00 2024-09-10T22:13:38.198 INFO:teuthology.orchestra.run.smithi138.stdout:(11/157): ceph-osd-19.3.0-4854.g8f219c47.el9.x8 12 MB/s | 17 MB 00:01 2024-09-10T22:13:38.223 INFO:teuthology.orchestra.run.smithi138.stdout:(12/157): cephfs-mirror-19.3.0-4854.g8f219c47.e 930 kB/s | 225 kB 00:00 2024-09-10T22:13:38.332 INFO:teuthology.orchestra.run.smithi138.stdout:(13/157): cephfs-shell-19.3.0-4854.g8f219c47.el 202 kB/s | 27 kB 00:00 2024-09-10T22:13:38.366 INFO:teuthology.orchestra.run.smithi138.stdout:(14/157): libcephfs-devel-19.3.0-4854.g8f219c47 223 kB/s | 32 kB 00:00 2024-09-10T22:13:38.432 INFO:teuthology.orchestra.run.smithi138.stdout:(15/157): libcephfs2-19.3.0-4854.g8f219c47.el9. 7.4 MB/s | 755 kB 00:00 2024-09-10T22:13:38.441 INFO:teuthology.orchestra.run.smithi019.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-10T22:13:38.442 INFO:teuthology.orchestra.run.smithi019.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-10T22:13:38.453 INFO:teuthology.orchestra.run.smithi019.stdout:Package NetworkManager-1:1.48.8-1.el9.x86_64 is already installed. 2024-09-10T22:13:38.454 INFO:teuthology.orchestra.run.smithi019.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-09-10T22:13:38.455 INFO:teuthology.orchestra.run.smithi019.stdout:Package util-linux-2.37.4-20.el9.x86_64 is already installed. 2024-09-10T22:13:38.456 INFO:teuthology.orchestra.run.smithi019.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-09-10T22:13:38.457 INFO:teuthology.orchestra.run.smithi019.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-09-10T22:13:38.460 INFO:teuthology.orchestra.run.smithi019.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-09-10T22:13:38.461 INFO:teuthology.orchestra.run.smithi019.stdout:Package xfsprogs-6.4.0-4.el9.x86_64 is already installed. 2024-09-10T22:13:38.466 INFO:teuthology.orchestra.run.smithi138.stdout:(16/157): libcephsqlite-19.3.0-4854.g8f219c47.e 1.6 MB/s | 162 kB 00:00 2024-09-10T22:13:38.525 INFO:teuthology.orchestra.run.smithi138.stdout:(17/157): librados-devel-19.3.0-4854.g8f219c47. 1.3 MB/s | 127 kB 00:00 2024-09-10T22:13:38.526 INFO:teuthology.orchestra.run.smithi019.stdout:Dependencies resolved. 2024-09-10T22:13:38.543 INFO:teuthology.orchestra.run.smithi019.stdout:======================================================================================= 2024-09-10T22:13:38.543 INFO:teuthology.orchestra.run.smithi019.stdout: Package Arch Version Repository Size 2024-09-10T22:13:38.544 INFO:teuthology.orchestra.run.smithi019.stdout:======================================================================================= 2024-09-10T22:13:38.544 INFO:teuthology.orchestra.run.smithi019.stdout:Installing: 2024-09-10T22:13:38.544 INFO:teuthology.orchestra.run.smithi019.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-09-10T22:13:38.544 INFO:teuthology.orchestra.run.smithi019.stdout: ceph x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 6.6 k 2024-09-10T22:13:38.544 INFO:teuthology.orchestra.run.smithi019.stdout: ceph-base x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 5.5 M 2024-09-10T22:13:38.544 INFO:teuthology.orchestra.run.smithi019.stdout: ceph-fuse x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 900 k 2024-09-10T22:13:38.544 INFO:teuthology.orchestra.run.smithi019.stdout: ceph-immutable-object-cache x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 145 k 2024-09-10T22:13:38.544 INFO:teuthology.orchestra.run.smithi019.stdout: ceph-mgr x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 1.5 M 2024-09-10T22:13:38.544 INFO:teuthology.orchestra.run.smithi019.stdout: ceph-mgr-cephadm noarch 2:19.3.0-4854.g8f219c47.el9 ceph-noarch 154 k 2024-09-10T22:13:38.544 INFO:teuthology.orchestra.run.smithi019.stdout: ceph-mgr-dashboard noarch 2:19.3.0-4854.g8f219c47.el9 ceph-noarch 14 M 2024-09-10T22:13:38.544 INFO:teuthology.orchestra.run.smithi019.stdout: ceph-mgr-diskprediction-local noarch 2:19.3.0-4854.g8f219c47.el9 ceph-noarch 7.4 M 2024-09-10T22:13:38.544 INFO:teuthology.orchestra.run.smithi019.stdout: ceph-mgr-rook noarch 2:19.3.0-4854.g8f219c47.el9 ceph-noarch 49 k 2024-09-10T22:13:38.544 INFO:teuthology.orchestra.run.smithi019.stdout: ceph-radosgw x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 11 M 2024-09-10T22:13:38.545 INFO:teuthology.orchestra.run.smithi019.stdout: ceph-test x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 50 M 2024-09-10T22:13:38.545 INFO:teuthology.orchestra.run.smithi019.stdout: ceph-volume noarch 2:19.3.0-4854.g8f219c47.el9 ceph-noarch 285 k 2024-09-10T22:13:38.545 INFO:teuthology.orchestra.run.smithi019.stdout: cephadm noarch 2:19.3.0-4854.g8f219c47.el9 ceph-noarch 783 k 2024-09-10T22:13:38.545 INFO:teuthology.orchestra.run.smithi019.stdout: cephfs-mirror x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 225 k 2024-09-10T22:13:38.545 INFO:teuthology.orchestra.run.smithi019.stdout: cephfs-shell x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 27 k 2024-09-10T22:13:38.545 INFO:teuthology.orchestra.run.smithi019.stdout: cephfs-top noarch 2:19.3.0-4854.g8f219c47.el9 ceph-noarch 18 k 2024-09-10T22:13:38.545 INFO:teuthology.orchestra.run.smithi019.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-09-10T22:13:38.545 INFO:teuthology.orchestra.run.smithi019.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-09-10T22:13:38.545 INFO:teuthology.orchestra.run.smithi019.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-09-10T22:13:38.545 INFO:teuthology.orchestra.run.smithi019.stdout: libcephfs-devel x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 32 k 2024-09-10T22:13:38.545 INFO:teuthology.orchestra.run.smithi019.stdout: libcephfs2 x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 755 k 2024-09-10T22:13:38.545 INFO:teuthology.orchestra.run.smithi019.stdout: librados-devel x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 127 k 2024-09-10T22:13:38.546 INFO:teuthology.orchestra.run.smithi019.stdout: libtool x86_64 2.4.6-46.el9 appstream 581 k 2024-09-10T22:13:38.546 INFO:teuthology.orchestra.run.smithi019.stdout: libuuid-devel x86_64 2.37.4-20.el9 appstream 24 k 2024-09-10T22:13:38.546 INFO:teuthology.orchestra.run.smithi019.stdout: openssl-devel x86_64 1:3.2.2-6.el9 appstream 4.4 M 2024-09-10T22:13:38.546 INFO:teuthology.orchestra.run.smithi019.stdout: postgresql x86_64 13.16-1.el9 appstream 1.6 M 2024-09-10T22:13:38.546 INFO:teuthology.orchestra.run.smithi019.stdout: postgresql-contrib x86_64 13.16-1.el9 appstream 910 k 2024-09-10T22:13:38.546 INFO:teuthology.orchestra.run.smithi019.stdout: postgresql-server x86_64 13.16-1.el9 appstream 5.8 M 2024-09-10T22:13:38.546 INFO:teuthology.orchestra.run.smithi019.stdout: python3-cephfs x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 161 k 2024-09-10T22:13:38.546 INFO:teuthology.orchestra.run.smithi019.stdout: python3-rados x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 321 k 2024-09-10T22:13:38.546 INFO:teuthology.orchestra.run.smithi019.stdout: python3-rbd x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 306 k 2024-09-10T22:13:38.546 INFO:teuthology.orchestra.run.smithi019.stdout: python3-rgw x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 99 k 2024-09-10T22:13:38.546 INFO:teuthology.orchestra.run.smithi019.stdout: rbd-fuse x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 85 k 2024-09-10T22:13:38.546 INFO:teuthology.orchestra.run.smithi019.stdout: rbd-mirror x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 3.2 M 2024-09-10T22:13:38.546 INFO:teuthology.orchestra.run.smithi019.stdout: rbd-nbd x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 171 k 2024-09-10T22:13:38.547 INFO:teuthology.orchestra.run.smithi019.stdout: xfsprogs-devel x86_64 6.4.0-4.el9 appstream 96 k 2024-09-10T22:13:38.547 INFO:teuthology.orchestra.run.smithi019.stdout:Upgrading: 2024-09-10T22:13:38.547 INFO:teuthology.orchestra.run.smithi019.stdout: NetworkManager x86_64 1:1.49.90-1.el9 baseos 2.3 M 2024-09-10T22:13:38.547 INFO:teuthology.orchestra.run.smithi019.stdout: NetworkManager-libnm x86_64 1:1.49.90-1.el9 baseos 1.8 M 2024-09-10T22:13:38.547 INFO:teuthology.orchestra.run.smithi019.stdout: NetworkManager-team x86_64 1:1.49.90-1.el9 baseos 41 k 2024-09-10T22:13:38.547 INFO:teuthology.orchestra.run.smithi019.stdout: NetworkManager-tui x86_64 1:1.49.90-1.el9 baseos 249 k 2024-09-10T22:13:38.547 INFO:teuthology.orchestra.run.smithi019.stdout: librados2 x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 3.5 M 2024-09-10T22:13:38.547 INFO:teuthology.orchestra.run.smithi019.stdout: librbd1 x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 3.2 M 2024-09-10T22:13:38.547 INFO:teuthology.orchestra.run.smithi019.stdout: openssl x86_64 1:3.2.2-6.el9 baseos 1.4 M 2024-09-10T22:13:38.547 INFO:teuthology.orchestra.run.smithi019.stdout: openssl-libs x86_64 1:3.2.2-6.el9 baseos 2.4 M 2024-09-10T22:13:38.547 INFO:teuthology.orchestra.run.smithi019.stdout:Installing dependencies: 2024-09-10T22:13:38.547 INFO:teuthology.orchestra.run.smithi019.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-10T22:13:38.547 INFO:teuthology.orchestra.run.smithi019.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-09-10T22:13:38.548 INFO:teuthology.orchestra.run.smithi019.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-10T22:13:38.548 INFO:teuthology.orchestra.run.smithi019.stdout: ceph-common x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 22 M 2024-09-10T22:13:38.548 INFO:teuthology.orchestra.run.smithi019.stdout: ceph-grafana-dashboards noarch 2:19.3.0-4854.g8f219c47.el9 ceph-noarch 34 k 2024-09-10T22:13:38.548 INFO:teuthology.orchestra.run.smithi019.stdout: ceph-mds x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 2.4 M 2024-09-10T22:13:38.548 INFO:teuthology.orchestra.run.smithi019.stdout: ceph-mgr-modules-core noarch 2:19.3.0-4854.g8f219c47.el9 ceph-noarch 291 k 2024-09-10T22:13:38.548 INFO:teuthology.orchestra.run.smithi019.stdout: ceph-mon x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 4.8 M 2024-09-10T22:13:38.548 INFO:teuthology.orchestra.run.smithi019.stdout: ceph-osd x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 17 M 2024-09-10T22:13:38.548 INFO:teuthology.orchestra.run.smithi019.stdout: ceph-prometheus-alerts noarch 2:19.3.0-4854.g8f219c47.el9 ceph-noarch 16 k 2024-09-10T22:13:38.548 INFO:teuthology.orchestra.run.smithi019.stdout: ceph-selinux x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 25 k 2024-09-10T22:13:38.548 INFO:teuthology.orchestra.run.smithi019.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-10T22:13:38.548 INFO:teuthology.orchestra.run.smithi019.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-10T22:13:38.548 INFO:teuthology.orchestra.run.smithi019.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-10T22:13:38.549 INFO:teuthology.orchestra.run.smithi019.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-10T22:13:38.549 INFO:teuthology.orchestra.run.smithi019.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-09-10T22:13:38.549 INFO:teuthology.orchestra.run.smithi019.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-10T22:13:38.549 INFO:teuthology.orchestra.run.smithi019.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-10T22:13:38.549 INFO:teuthology.orchestra.run.smithi019.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-10T22:13:38.549 INFO:teuthology.orchestra.run.smithi019.stdout: libcephsqlite x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 162 k 2024-09-10T22:13:38.549 INFO:teuthology.orchestra.run.smithi019.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-10T22:13:38.549 INFO:teuthology.orchestra.run.smithi019.stdout: libnbd x86_64 1.20.2-2.el9 appstream 171 k 2024-09-10T22:13:38.549 INFO:teuthology.orchestra.run.smithi019.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-10T22:13:38.549 INFO:teuthology.orchestra.run.smithi019.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-10T22:13:38.549 INFO:teuthology.orchestra.run.smithi019.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-10T22:13:38.549 INFO:teuthology.orchestra.run.smithi019.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-10T22:13:38.549 INFO:teuthology.orchestra.run.smithi019.stdout: libradosstriper1 x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 507 k 2024-09-10T22:13:38.550 INFO:teuthology.orchestra.run.smithi019.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-10T22:13:38.550 INFO:teuthology.orchestra.run.smithi019.stdout: librgw2 x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 5.5 M 2024-09-10T22:13:38.550 INFO:teuthology.orchestra.run.smithi019.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-10T22:13:38.550 INFO:teuthology.orchestra.run.smithi019.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-09-10T22:13:38.550 INFO:teuthology.orchestra.run.smithi019.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-10T22:13:38.550 INFO:teuthology.orchestra.run.smithi019.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-10T22:13:38.550 INFO:teuthology.orchestra.run.smithi019.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-10T22:13:38.550 INFO:teuthology.orchestra.run.smithi019.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-10T22:13:38.550 INFO:teuthology.orchestra.run.smithi019.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-10T22:13:38.550 INFO:teuthology.orchestra.run.smithi019.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-10T22:13:38.550 INFO:teuthology.orchestra.run.smithi019.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-10T22:13:38.550 INFO:teuthology.orchestra.run.smithi019.stdout: postgresql-private-libs x86_64 13.16-1.el9 appstream 137 k 2024-09-10T22:13:38.551 INFO:teuthology.orchestra.run.smithi019.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-10T22:13:38.551 INFO:teuthology.orchestra.run.smithi019.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-10T22:13:38.551 INFO:teuthology.orchestra.run.smithi019.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-10T22:13:38.551 INFO:teuthology.orchestra.run.smithi019.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-09-10T22:13:38.551 INFO:teuthology.orchestra.run.smithi019.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-10T22:13:38.551 INFO:teuthology.orchestra.run.smithi019.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-10T22:13:38.551 INFO:teuthology.orchestra.run.smithi019.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-10T22:13:38.551 INFO:teuthology.orchestra.run.smithi019.stdout: python3-ceph-argparse x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 45 k 2024-09-10T22:13:38.551 INFO:teuthology.orchestra.run.smithi019.stdout: python3-ceph-common x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 143 k 2024-09-10T22:13:38.551 INFO:teuthology.orchestra.run.smithi019.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-10T22:13:38.551 INFO:teuthology.orchestra.run.smithi019.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-10T22:13:38.551 INFO:teuthology.orchestra.run.smithi019.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-10T22:13:38.552 INFO:teuthology.orchestra.run.smithi019.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-10T22:13:38.552 INFO:teuthology.orchestra.run.smithi019.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-09-10T22:13:38.552 INFO:teuthology.orchestra.run.smithi019.stdout: python3-colorama noarch 0.4.6-3.el9 appstream 61 k 2024-09-10T22:13:38.552 INFO:teuthology.orchestra.run.smithi019.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-10T22:13:38.552 INFO:teuthology.orchestra.run.smithi019.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-10T22:13:38.552 INFO:teuthology.orchestra.run.smithi019.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-10T22:13:38.552 INFO:teuthology.orchestra.run.smithi019.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-10T22:13:38.552 INFO:teuthology.orchestra.run.smithi019.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-10T22:13:38.552 INFO:teuthology.orchestra.run.smithi019.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-10T22:13:38.552 INFO:teuthology.orchestra.run.smithi019.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-10T22:13:38.552 INFO:teuthology.orchestra.run.smithi019.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-09-10T22:13:38.552 INFO:teuthology.orchestra.run.smithi019.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-10T22:13:38.553 INFO:teuthology.orchestra.run.smithi019.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-10T22:13:38.553 INFO:teuthology.orchestra.run.smithi019.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-10T22:13:38.553 INFO:teuthology.orchestra.run.smithi019.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-10T22:13:38.553 INFO:teuthology.orchestra.run.smithi019.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-10T22:13:38.553 INFO:teuthology.orchestra.run.smithi019.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-10T22:13:38.553 INFO:teuthology.orchestra.run.smithi019.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-10T22:13:38.553 INFO:teuthology.orchestra.run.smithi019.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-10T22:13:38.553 INFO:teuthology.orchestra.run.smithi019.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-10T22:13:38.553 INFO:teuthology.orchestra.run.smithi019.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-10T22:13:38.553 INFO:teuthology.orchestra.run.smithi019.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-10T22:13:38.553 INFO:teuthology.orchestra.run.smithi019.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-10T22:13:38.553 INFO:teuthology.orchestra.run.smithi019.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-10T22:13:38.553 INFO:teuthology.orchestra.run.smithi019.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-10T22:13:38.553 INFO:teuthology.orchestra.run.smithi019.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-10T22:13:38.554 INFO:teuthology.orchestra.run.smithi019.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-10T22:13:38.554 INFO:teuthology.orchestra.run.smithi019.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-10T22:13:38.554 INFO:teuthology.orchestra.run.smithi019.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-10T22:13:38.554 INFO:teuthology.orchestra.run.smithi019.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-10T22:13:38.554 INFO:teuthology.orchestra.run.smithi019.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-10T22:13:38.554 INFO:teuthology.orchestra.run.smithi019.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-10T22:13:38.554 INFO:teuthology.orchestra.run.smithi019.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-10T22:13:38.554 INFO:teuthology.orchestra.run.smithi019.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-10T22:13:38.554 INFO:teuthology.orchestra.run.smithi019.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-10T22:13:38.554 INFO:teuthology.orchestra.run.smithi019.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-09-10T22:13:38.554 INFO:teuthology.orchestra.run.smithi019.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-10T22:13:38.554 INFO:teuthology.orchestra.run.smithi019.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-10T22:13:38.554 INFO:teuthology.orchestra.run.smithi019.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-10T22:13:38.555 INFO:teuthology.orchestra.run.smithi019.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-10T22:13:38.555 INFO:teuthology.orchestra.run.smithi019.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-10T22:13:38.555 INFO:teuthology.orchestra.run.smithi019.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-10T22:13:38.555 INFO:teuthology.orchestra.run.smithi019.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-10T22:13:38.555 INFO:teuthology.orchestra.run.smithi019.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-10T22:13:38.555 INFO:teuthology.orchestra.run.smithi019.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-10T22:13:38.555 INFO:teuthology.orchestra.run.smithi019.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-10T22:13:38.555 INFO:teuthology.orchestra.run.smithi019.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-10T22:13:38.555 INFO:teuthology.orchestra.run.smithi019.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-09-10T22:13:38.555 INFO:teuthology.orchestra.run.smithi019.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-10T22:13:38.555 INFO:teuthology.orchestra.run.smithi019.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-10T22:13:38.555 INFO:teuthology.orchestra.run.smithi019.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-10T22:13:38.555 INFO:teuthology.orchestra.run.smithi019.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-10T22:13:38.556 INFO:teuthology.orchestra.run.smithi019.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-10T22:13:38.556 INFO:teuthology.orchestra.run.smithi019.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-10T22:13:38.556 INFO:teuthology.orchestra.run.smithi019.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-10T22:13:38.556 INFO:teuthology.orchestra.run.smithi019.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-10T22:13:38.556 INFO:teuthology.orchestra.run.smithi019.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-10T22:13:38.556 INFO:teuthology.orchestra.run.smithi019.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-09-10T22:13:38.556 INFO:teuthology.orchestra.run.smithi019.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-10T22:13:38.556 INFO:teuthology.orchestra.run.smithi019.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-09-10T22:13:38.556 INFO:teuthology.orchestra.run.smithi019.stdout:Installing weak dependencies: 2024-09-10T22:13:38.556 INFO:teuthology.orchestra.run.smithi019.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-10T22:13:38.556 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-10T22:13:38.556 INFO:teuthology.orchestra.run.smithi019.stdout:Transaction Summary 2024-09-10T22:13:38.556 INFO:teuthology.orchestra.run.smithi019.stdout:======================================================================================= 2024-09-10T22:13:38.557 INFO:teuthology.orchestra.run.smithi019.stdout:Install 149 Packages 2024-09-10T22:13:38.557 INFO:teuthology.orchestra.run.smithi019.stdout:Upgrade 8 Packages 2024-09-10T22:13:38.557 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-10T22:13:38.557 INFO:teuthology.orchestra.run.smithi019.stdout:Total download size: 240 M 2024-09-10T22:13:38.557 INFO:teuthology.orchestra.run.smithi019.stdout:Downloading Packages: 2024-09-10T22:13:38.567 INFO:teuthology.orchestra.run.smithi138.stdout:(18/157): libradosstriper1-19.3.0-4854.g8f219c4 4.9 MB/s | 507 kB 00:00 2024-09-10T22:13:38.586 INFO:teuthology.orchestra.run.smithi135.stdout:(7/157): ceph-mon-19.3.0-4854.g8f219c47.el9.x86 6.3 MB/s | 4.8 MB 00:00 2024-09-10T22:13:38.642 INFO:teuthology.orchestra.run.smithi138.stdout:(19/157): python3-ceph-argparse-19.3.0-4854.g8f 600 kB/s | 45 kB 00:00 2024-09-10T22:13:38.734 INFO:teuthology.orchestra.run.smithi138.stdout:(20/157): python3-ceph-common-19.3.0-4854.g8f21 1.5 MB/s | 143 kB 00:00 2024-09-10T22:13:38.797 INFO:teuthology.orchestra.run.smithi135.stdout:(8/157): ceph-common-19.3.0-4854.g8f219c47.el9. 9.7 MB/s | 22 MB 00:02 2024-09-10T22:13:38.826 INFO:teuthology.orchestra.run.smithi138.stdout:(21/157): python3-cephfs-19.3.0-4854.g8f219c47. 1.7 MB/s | 161 kB 00:00 2024-09-10T22:13:38.889 INFO:teuthology.orchestra.run.smithi135.stdout:(9/157): ceph-selinux-19.3.0-4854.g8f219c47.el9 275 kB/s | 25 kB 00:00 2024-09-10T22:13:38.927 INFO:teuthology.orchestra.run.smithi138.stdout:(22/157): librgw2-19.3.0-4854.g8f219c47.el9.x86 14 MB/s | 5.5 MB 00:00 2024-09-10T22:13:38.952 INFO:teuthology.orchestra.run.smithi138.stdout:(23/157): python3-rados-19.3.0-4854.g8f219c47.e 2.5 MB/s | 321 kB 00:00 2024-09-10T22:13:39.027 INFO:teuthology.orchestra.run.smithi138.stdout:(24/157): python3-rbd-19.3.0-4854.g8f219c47.el9 3.0 MB/s | 306 kB 00:00 2024-09-10T22:13:39.052 INFO:teuthology.orchestra.run.smithi138.stdout:(25/157): python3-rgw-19.3.0-4854.g8f219c47.el9 991 kB/s | 99 kB 00:00 2024-09-10T22:13:39.128 INFO:teuthology.orchestra.run.smithi138.stdout:(26/157): rbd-fuse-19.3.0-4854.g8f219c47.el9.x8 850 kB/s | 85 kB 00:00 2024-09-10T22:13:39.220 INFO:teuthology.orchestra.run.smithi138.stdout:(27/157): rbd-nbd-19.3.0-4854.g8f219c47.el9.x86 1.8 MB/s | 171 kB 00:00 2024-09-10T22:13:39.304 INFO:teuthology.orchestra.run.smithi138.stdout:(28/157): ceph-grafana-dashboards-19.3.0-4854.g 410 kB/s | 34 kB 00:00 2024-09-10T22:13:39.387 INFO:teuthology.orchestra.run.smithi138.stdout:(29/157): ceph-mgr-cephadm-19.3.0-4854.g8f219c4 1.8 MB/s | 154 kB 00:00 2024-09-10T22:13:39.432 INFO:teuthology.orchestra.run.smithi019.stdout:(1/157): ceph-19.3.0-4854.g8f219c47.el9.x86_64. 22 kB/s | 6.6 kB 00:00 2024-09-10T22:13:39.455 INFO:teuthology.orchestra.run.smithi138.stdout:(30/157): rbd-mirror-19.3.0-4854.g8f219c47.el9. 7.9 MB/s | 3.2 MB 00:00 2024-09-10T22:13:39.648 INFO:teuthology.orchestra.run.smithi135.stdout:(10/157): ceph-osd-19.3.0-4854.g8f219c47.el9.x8 10 MB/s | 17 MB 00:01 2024-09-10T22:13:39.807 INFO:teuthology.orchestra.run.smithi135.stdout:(11/157): ceph-radosgw-19.3.0-4854.g8f219c47.el 9.0 MB/s | 11 MB 00:01 2024-09-10T22:13:39.832 INFO:teuthology.orchestra.run.smithi135.stdout:(12/157): cephfs-mirror-19.3.0-4854.g8f219c47.e 1.2 MB/s | 225 kB 00:00 2024-09-10T22:13:39.882 INFO:teuthology.orchestra.run.smithi135.stdout:(13/157): cephfs-shell-19.3.0-4854.g8f219c47.el 361 kB/s | 27 kB 00:00 2024-09-10T22:13:39.907 INFO:teuthology.orchestra.run.smithi135.stdout:(14/157): libcephfs-devel-19.3.0-4854.g8f219c47 422 kB/s | 32 kB 00:00 2024-09-10T22:13:39.982 INFO:teuthology.orchestra.run.smithi135.stdout:(15/157): libcephfs2-19.3.0-4854.g8f219c47.el9. 7.4 MB/s | 755 kB 00:00 2024-09-10T22:13:40.008 INFO:teuthology.orchestra.run.smithi135.stdout:(16/157): libcephsqlite-19.3.0-4854.g8f219c47.e 1.6 MB/s | 162 kB 00:00 2024-09-10T22:13:40.066 INFO:teuthology.orchestra.run.smithi135.stdout:(17/157): librados-devel-19.3.0-4854.g8f219c47. 1.5 MB/s | 127 kB 00:00 2024-09-10T22:13:40.100 INFO:teuthology.orchestra.run.smithi135.stdout:(18/157): libradosstriper1-19.3.0-4854.g8f219c4 5.4 MB/s | 507 kB 00:00 2024-09-10T22:13:40.159 INFO:teuthology.orchestra.run.smithi135.stdout:(19/157): python3-ceph-argparse-19.3.0-4854.g8f 774 kB/s | 45 kB 00:00 2024-09-10T22:13:40.182 INFO:teuthology.orchestra.run.smithi019.stdout:(2/157): ceph-fuse-19.3.0-4854.g8f219c47.el9.x8 1.2 MB/s | 900 kB 00:00 2024-09-10T22:13:40.238 INFO:teuthology.orchestra.run.smithi138.stdout:(31/157): ceph-mgr-dashboard-19.3.0-4854.g8f219 17 MB/s | 14 MB 00:00 2024-09-10T22:13:40.242 INFO:teuthology.orchestra.run.smithi135.stdout:(20/157): python3-ceph-common-19.3.0-4854.g8f21 1.7 MB/s | 143 kB 00:00 2024-09-10T22:13:40.290 INFO:teuthology.orchestra.run.smithi019.stdout:(3/157): ceph-immutable-object-cache-19.3.0-485 1.3 MB/s | 145 kB 00:00 2024-09-10T22:13:40.314 INFO:teuthology.orchestra.run.smithi138.stdout:(32/157): ceph-mgr-modules-core-19.3.0-4854.g8f 3.8 MB/s | 291 kB 00:00 2024-09-10T22:13:40.334 INFO:teuthology.orchestra.run.smithi135.stdout:(21/157): python3-cephfs-19.3.0-4854.g8f219c47. 1.7 MB/s | 161 kB 00:00 2024-09-10T22:13:40.410 INFO:teuthology.orchestra.run.smithi135.stdout:(22/157): librgw2-19.3.0-4854.g8f219c47.el9.x86 16 MB/s | 5.5 MB 00:00 2024-09-10T22:13:40.430 INFO:teuthology.orchestra.run.smithi138.stdout:(33/157): ceph-mgr-diskprediction-local-19.3.0- 7.6 MB/s | 7.4 MB 00:00 2024-09-10T22:13:40.435 INFO:teuthology.orchestra.run.smithi135.stdout:(23/157): python3-rados-19.3.0-4854.g8f219c47.e 3.1 MB/s | 321 kB 00:00 2024-09-10T22:13:40.456 INFO:teuthology.orchestra.run.smithi138.stdout:(34/157): ceph-mgr-rook-19.3.0-4854.g8f219c47.e 347 kB/s | 49 kB 00:00 2024-09-10T22:13:40.469 INFO:teuthology.orchestra.run.smithi135.stdout:(24/157): python3-rbd-19.3.0-4854.g8f219c47.el9 5.1 MB/s | 306 kB 00:00 2024-09-10T22:13:40.481 INFO:teuthology.orchestra.run.smithi138.stdout:(35/157): ceph-prometheus-alerts-19.3.0-4854.g8 327 kB/s | 16 kB 00:00 2024-09-10T22:13:40.494 INFO:teuthology.orchestra.run.smithi135.stdout:(25/157): python3-rgw-19.3.0-4854.g8f219c47.el9 1.7 MB/s | 99 kB 00:00 2024-09-10T22:13:40.515 INFO:teuthology.orchestra.run.smithi138.stdout:(36/157): ceph-volume-19.3.0-4854.g8f219c47.el9 4.8 MB/s | 285 kB 00:00 2024-09-10T22:13:40.528 INFO:teuthology.orchestra.run.smithi135.stdout:(26/157): rbd-fuse-19.3.0-4854.g8f219c47.el9.x8 1.4 MB/s | 85 kB 00:00 2024-09-10T22:13:40.590 INFO:teuthology.orchestra.run.smithi138.stdout:(37/157): cephfs-top-19.3.0-4854.g8f219c47.el9. 242 kB/s | 18 kB 00:00 2024-09-10T22:13:40.603 INFO:teuthology.orchestra.run.smithi135.stdout:(27/157): rbd-nbd-19.3.0-4854.g8f219c47.el9.x86 2.2 MB/s | 171 kB 00:00 2024-09-10T22:13:40.624 INFO:teuthology.orchestra.run.smithi138.stdout:(38/157): cephadm-19.3.0-4854.g8f219c47.el9.noa 5.4 MB/s | 783 kB 00:00 2024-09-10T22:13:40.670 INFO:teuthology.orchestra.run.smithi135.stdout:(28/157): ceph-grafana-dashboards-19.3.0-4854.g 514 kB/s | 34 kB 00:00 2024-09-10T22:13:40.724 INFO:teuthology.orchestra.run.smithi138.stdout:(39/157): fuse-2.9.9-16.el9.x86_64.rpm 597 kB/s | 80 kB 00:00 2024-09-10T22:13:40.745 INFO:teuthology.orchestra.run.smithi135.stdout:(29/157): ceph-mgr-cephadm-19.3.0-4854.g8f219c4 2.0 MB/s | 154 kB 00:00 2024-09-10T22:13:40.795 INFO:teuthology.orchestra.run.smithi135.stdout:(30/157): rbd-mirror-19.3.0-4854.g8f219c47.el9. 11 MB/s | 3.2 MB 00:00 2024-09-10T22:13:40.808 INFO:teuthology.orchestra.run.smithi138.stdout:(40/157): libquadmath-11.5.0-2.el9.x86_64.rpm 2.2 MB/s | 191 kB 00:00 2024-09-10T22:13:40.841 INFO:teuthology.orchestra.run.smithi138.stdout:(41/157): libgfortran-11.5.0-2.el9.x86_64.rpm 3.6 MB/s | 801 kB 00:00 2024-09-10T22:13:40.849 INFO:teuthology.orchestra.run.smithi019.stdout:(4/157): ceph-mds-19.3.0-4854.g8f219c47.el9.x86 4.3 MB/s | 2.4 MB 00:00 2024-09-10T22:13:40.875 INFO:teuthology.orchestra.run.smithi138.stdout:(42/157): python3-cffi-1.14.5-5.el9.x86_64.rpm 3.7 MB/s | 253 kB 00:00 2024-09-10T22:13:40.934 INFO:teuthology.orchestra.run.smithi138.stdout:(43/157): python3-ply-3.11-14.el9.noarch.rpm 1.8 MB/s | 106 kB 00:00 2024-09-10T22:13:40.992 INFO:teuthology.orchestra.run.smithi138.stdout:(44/157): python3-cryptography-36.0.1-4.el9.x86 8.1 MB/s | 1.2 MB 00:00 2024-09-10T22:13:41.018 INFO:teuthology.orchestra.run.smithi138.stdout:(45/157): python3-pycparser-2.20-6.el9.noarch.r 1.6 MB/s | 135 kB 00:00 2024-09-10T22:13:41.068 INFO:teuthology.orchestra.run.smithi138.stdout:(46/157): python3-requests-2.25.1-8.el9.noarch. 1.6 MB/s | 125 kB 00:00 2024-09-10T22:13:41.094 INFO:teuthology.orchestra.run.smithi138.stdout:(47/157): python3-urllib3-1.26.5-6.el9.noarch.r 2.8 MB/s | 215 kB 00:00 2024-09-10T22:13:41.169 INFO:teuthology.orchestra.run.smithi138.stdout:(48/157): automake-1.16.2-8.el9.noarch.rpm 6.7 MB/s | 689 kB 00:00 2024-09-10T22:13:41.211 INFO:teuthology.orchestra.run.smithi138.stdout:(49/157): bison-3.7.4-5.el9.x86_64.rpm 7.9 MB/s | 943 kB 00:00 2024-09-10T22:13:41.253 INFO:teuthology.orchestra.run.smithi138.stdout:(50/157): boost-program-options-1.75.0-8.el9.x8 1.2 MB/s | 107 kB 00:00 2024-09-10T22:13:41.278 INFO:teuthology.orchestra.run.smithi138.stdout:(51/157): elfutils-libelf-devel-0.191-4.el9.x86 323 kB/s | 22 kB 00:00 2024-09-10T22:13:41.333 INFO:teuthology.orchestra.run.smithi019.stdout:(5/157): ceph-mgr-19.3.0-4854.g8f219c47.el9.x86 3.2 MB/s | 1.5 MB 00:00 2024-09-10T22:13:41.337 INFO:teuthology.orchestra.run.smithi138.stdout:(52/157): flexiblas-3.0.4-8.el9.x86_64.rpm 559 kB/s | 33 kB 00:00 2024-09-10T22:13:41.371 INFO:teuthology.orchestra.run.smithi138.stdout:(53/157): flex-2.6.4-9.el9.x86_64.rpm 2.6 MB/s | 313 kB 00:00 2024-09-10T22:13:41.425 INFO:teuthology.orchestra.run.smithi019.stdout:(6/157): ceph-base-19.3.0-4854.g8f219c47.el9.x8 2.4 MB/s | 5.5 MB 00:02 2024-09-10T22:13:41.438 INFO:teuthology.orchestra.run.smithi138.stdout:(54/157): flexiblas-netlib-3.0.4-8.el9.x86_64.r 30 MB/s | 3.0 MB 00:00 2024-09-10T22:13:41.463 INFO:teuthology.orchestra.run.smithi138.stdout:(55/157): flexiblas-openblas-openmp-3.0.4-8.el9 198 kB/s | 18 kB 00:00 2024-09-10T22:13:41.505 INFO:teuthology.orchestra.run.smithi138.stdout:(56/157): libaio-devel-0.3.111-13.el9.x86_64.rp 167 kB/s | 11 kB 00:00 2024-09-10T22:13:41.531 INFO:teuthology.orchestra.run.smithi138.stdout:(57/157): libnbd-1.20.2-2.el9.x86_64.rpm 2.5 MB/s | 171 kB 00:00 2024-09-10T22:13:41.546 INFO:teuthology.orchestra.run.smithi135.stdout:(31/157): ceph-mgr-dashboard-19.3.0-4854.g8f219 18 MB/s | 14 MB 00:00 2024-09-10T22:13:41.573 INFO:teuthology.orchestra.run.smithi138.stdout:(58/157): libpmemobj-1.12.1-1.el9.x86_64.rpm 2.3 MB/s | 160 kB 00:00 2024-09-10T22:13:41.623 INFO:teuthology.orchestra.run.smithi138.stdout:(59/157): librabbitmq-0.11.0-7.el9.x86_64.rpm 492 kB/s | 45 kB 00:00 2024-09-10T22:13:41.638 INFO:teuthology.orchestra.run.smithi135.stdout:(32/157): ceph-mgr-diskprediction-local-19.3.0- 8.8 MB/s | 7.4 MB 00:00 2024-09-10T22:13:41.663 INFO:teuthology.orchestra.run.smithi135.stdout:(33/157): ceph-mgr-modules-core-19.3.0-4854.g8f 2.4 MB/s | 291 kB 00:00 2024-09-10T22:13:41.688 INFO:teuthology.orchestra.run.smithi135.stdout:(34/157): ceph-mgr-rook-19.3.0-4854.g8f219c47.e 986 kB/s | 49 kB 00:00 2024-09-10T22:13:41.689 INFO:teuthology.orchestra.run.smithi138.stdout:(60/157): librdkafka-1.6.1-102.el9.x86_64.rpm 5.6 MB/s | 662 kB 00:00 2024-09-10T22:13:41.713 INFO:teuthology.orchestra.run.smithi135.stdout:(35/157): ceph-prometheus-alerts-19.3.0-4854.g8 326 kB/s | 16 kB 00:00 2024-09-10T22:13:41.724 INFO:teuthology.orchestra.run.smithi138.stdout:(61/157): libtool-2.4.6-46.el9.x86_64.rpm 5.6 MB/s | 581 kB 00:00 2024-09-10T22:13:41.749 INFO:teuthology.orchestra.run.smithi138.stdout:(62/157): libuuid-devel-2.37.4-20.el9.x86_64.rp 404 kB/s | 24 kB 00:00 2024-09-10T22:13:41.755 INFO:teuthology.orchestra.run.smithi135.stdout:(36/157): ceph-volume-19.3.0-4854.g8f219c47.el9 4.2 MB/s | 285 kB 00:00 2024-09-10T22:13:41.791 INFO:teuthology.orchestra.run.smithi138.stdout:(63/157): libzstd-devel-1.5.1-2.el9.x86_64.rpm 711 kB/s | 47 kB 00:00 2024-09-10T22:13:41.801 INFO:teuthology.orchestra.run.smithi135.stdout:(37/157): cephadm-19.3.0-4854.g8f219c47.el9.noa 9.1 MB/s | 783 kB 00:00 2024-09-10T22:13:41.814 INFO:teuthology.orchestra.run.smithi135.stdout:(38/157): cephfs-top-19.3.0-4854.g8f219c47.el9. 311 kB/s | 18 kB 00:00 2024-09-10T22:13:41.817 INFO:teuthology.orchestra.run.smithi138.stdout:(64/157): lttng-ust-2.12.0-6.el9.x86_64.rpm 4.3 MB/s | 292 kB 00:00 2024-09-10T22:13:41.825 INFO:teuthology.orchestra.run.smithi019.stdout:(7/157): ceph-mon-19.3.0-4854.g8f219c47.el9.x86 9.7 MB/s | 4.8 MB 00:00 2024-09-10T22:13:41.875 INFO:teuthology.orchestra.run.smithi138.stdout:(65/157): lua-5.4.4-4.el9.x86_64.rpm 2.2 MB/s | 188 kB 00:00 2024-09-10T22:13:41.901 INFO:teuthology.orchestra.run.smithi138.stdout:(66/157): openblas-0.3.26-2.el9.x86_64.rpm 459 kB/s | 38 kB 00:00 2024-09-10T22:13:41.931 INFO:teuthology.orchestra.run.smithi135.stdout:(39/157): fuse-2.9.9-16.el9.x86_64.rpm 597 kB/s | 80 kB 00:00 2024-09-10T22:13:41.973 INFO:teuthology.orchestra.run.smithi135.stdout:(40/157): libgfortran-11.5.0-2.el9.x86_64.rpm 4.9 MB/s | 801 kB 00:00 2024-09-10T22:13:42.007 INFO:teuthology.orchestra.run.smithi135.stdout:(41/157): libquadmath-11.5.0-2.el9.x86_64.rpm 2.5 MB/s | 191 kB 00:00 2024-09-10T22:13:42.034 INFO:teuthology.orchestra.run.smithi138.stdout:(67/157): openssl-devel-3.2.2-6.el9.x86_64.rpm 33 MB/s | 4.4 MB 00:00 2024-09-10T22:13:42.049 INFO:teuthology.orchestra.run.smithi135.stdout:(42/157): python3-cffi-1.14.5-5.el9.x86_64.rpm 3.3 MB/s | 253 kB 00:00 2024-09-10T22:13:42.108 INFO:teuthology.orchestra.run.smithi135.stdout:(43/157): python3-cryptography-36.0.1-4.el9.x86 12 MB/s | 1.2 MB 00:00 2024-09-10T22:13:42.118 INFO:teuthology.orchestra.run.smithi138.stdout:(68/157): postgresql-13.16-1.el9.x86_64.rpm 19 MB/s | 1.6 MB 00:00 2024-09-10T22:13:42.132 INFO:teuthology.orchestra.run.smithi135.stdout:(44/157): python3-ply-3.11-14.el9.noarch.rpm 1.2 MB/s | 106 kB 00:00 2024-09-10T22:13:42.183 INFO:teuthology.orchestra.run.smithi135.stdout:(45/157): python3-pycparser-2.20-6.el9.noarch.r 1.8 MB/s | 135 kB 00:00 2024-09-10T22:13:42.202 INFO:teuthology.orchestra.run.smithi138.stdout:(69/157): openblas-openmp-0.3.26-2.el9.x86_64.r 15 MB/s | 4.9 MB 00:00 2024-09-10T22:13:42.208 INFO:teuthology.orchestra.run.smithi135.stdout:(46/157): python3-requests-2.25.1-8.el9.noarch. 1.6 MB/s | 125 kB 00:00 2024-09-10T22:13:42.236 INFO:teuthology.orchestra.run.smithi138.stdout:(70/157): postgresql-contrib-13.16-1.el9.x86_64 7.6 MB/s | 910 kB 00:00 2024-09-10T22:13:42.275 INFO:teuthology.orchestra.run.smithi135.stdout:(47/157): python3-urllib3-1.26.5-6.el9.noarch.r 2.3 MB/s | 215 kB 00:00 2024-09-10T22:13:42.459 INFO:teuthology.orchestra.run.smithi135.stdout:(48/157): automake-1.16.2-8.el9.noarch.rpm 2.7 MB/s | 689 kB 00:00 2024-09-10T22:13:42.467 INFO:teuthology.orchestra.run.smithi019.stdout:(8/157): ceph-radosgw-19.3.0-4854.g8f219c47.el9 17 MB/s | 11 MB 00:00 2024-09-10T22:13:42.517 INFO:teuthology.orchestra.run.smithi019.stdout:(9/157): ceph-selinux-19.3.0-4854.g8f219c47.el9 505 kB/s | 25 kB 00:00 2024-09-10T22:13:42.517 INFO:teuthology.orchestra.run.smithi135.stdout:(49/157): boost-program-options-1.75.0-8.el9.x8 1.8 MB/s | 107 kB 00:00 2024-09-10T22:13:42.568 INFO:teuthology.orchestra.run.smithi135.stdout:(50/157): elfutils-libelf-devel-0.191-4.el9.x86 434 kB/s | 22 kB 00:00 2024-09-10T22:13:42.610 INFO:teuthology.orchestra.run.smithi135.stdout:(51/157): bison-3.7.4-5.el9.x86_64.rpm 2.8 MB/s | 943 kB 00:00 2024-09-10T22:13:42.677 INFO:teuthology.orchestra.run.smithi135.stdout:(52/157): flex-2.6.4-9.el9.x86_64.rpm 2.8 MB/s | 313 kB 00:00 2024-09-10T22:13:42.686 INFO:teuthology.orchestra.run.smithi138.stdout:(71/157): ceph-test-19.3.0-4854.g8f219c47.el9.x 10 MB/s | 50 MB 00:04 2024-09-10T22:13:42.702 INFO:teuthology.orchestra.run.smithi135.stdout:(53/157): flexiblas-3.0.4-8.el9.x86_64.rpm 355 kB/s | 33 kB 00:00 2024-09-10T22:13:42.711 INFO:teuthology.orchestra.run.smithi138.stdout:(72/157): postgresql-private-libs-13.16-1.el9.x 270 kB/s | 137 kB 00:00 2024-09-10T22:13:42.753 INFO:teuthology.orchestra.run.smithi135.stdout:(54/157): flexiblas-openblas-openmp-3.0.4-8.el9 365 kB/s | 18 kB 00:00 2024-09-10T22:13:42.811 INFO:teuthology.orchestra.run.smithi135.stdout:(55/157): libaio-devel-0.3.111-13.el9.x86_64.rp 192 kB/s | 11 kB 00:00 2024-09-10T22:13:42.812 INFO:teuthology.orchestra.run.smithi138.stdout:(73/157): postgresql-server-13.16-1.el9.x86_64. 10 MB/s | 5.8 MB 00:00 2024-09-10T22:13:42.828 INFO:teuthology.orchestra.run.smithi138.stdout:(74/157): python3-attrs-20.3.0-7.el9.noarch.rpm 748 kB/s | 87 kB 00:00 2024-09-10T22:13:42.870 INFO:teuthology.orchestra.run.smithi135.stdout:(56/157): libnbd-1.20.2-2.el9.x86_64.rpm 2.9 MB/s | 171 kB 00:00 2024-09-10T22:13:42.892 INFO:teuthology.orchestra.run.smithi019.stdout:(10/157): ceph-common-19.3.0-4854.g8f219c47.el9 5.8 MB/s | 22 MB 00:03 2024-09-10T22:13:42.895 INFO:teuthology.orchestra.run.smithi138.stdout:(75/157): python3-colorama-0.4.6-3.el9.noarch.r 914 kB/s | 61 kB 00:00 2024-09-10T22:13:42.928 INFO:teuthology.orchestra.run.smithi135.stdout:(57/157): libpmemobj-1.12.1-1.el9.x86_64.rpm 2.7 MB/s | 160 kB 00:00 2024-09-10T22:13:42.967 INFO:teuthology.orchestra.run.smithi019.stdout:(11/157): cephfs-mirror-19.3.0-4854.g8f219c47.e 2.9 MB/s | 225 kB 00:00 2024-09-10T22:13:42.971 INFO:teuthology.orchestra.run.smithi138.stdout:(76/157): python3-babel-2.9.1-2.el9.noarch.rpm 37 MB/s | 6.0 MB 00:00 2024-09-10T22:13:42.996 INFO:teuthology.orchestra.run.smithi138.stdout:(77/157): python3-devel-3.9.19-8.el9.x86_64.rpm 2.4 MB/s | 245 kB 00:00 2024-09-10T22:13:43.029 INFO:teuthology.orchestra.run.smithi019.stdout:(12/157): cephfs-shell-19.3.0-4854.g8f219c47.el 463 kB/s | 27 kB 00:00 2024-09-10T22:13:43.046 INFO:teuthology.orchestra.run.smithi138.stdout:(78/157): python3-jinja2-2.11.3-6.el9.noarch.rp 3.2 MB/s | 248 kB 00:00 2024-09-10T22:13:43.072 INFO:teuthology.orchestra.run.smithi138.stdout:(79/157): python3-jsonpatch-1.21-16.el9.noarch. 340 kB/s | 26 kB 00:00 2024-09-10T22:13:43.084 INFO:teuthology.orchestra.run.smithi019.stdout:(13/157): libcephfs-devel-19.3.0-4854.g8f219c47 546 kB/s | 32 kB 00:00 2024-09-10T22:13:43.106 INFO:teuthology.orchestra.run.smithi138.stdout:(80/157): python3-jsonpointer-2.0-4.el9.noarch. 325 kB/s | 19 kB 00:00 2024-09-10T22:13:43.148 INFO:teuthology.orchestra.run.smithi138.stdout:(81/157): protobuf-3.14.0-13.el9.x86_64.rpm 2.2 MB/s | 1.0 MB 00:00 2024-09-10T22:13:43.173 INFO:teuthology.orchestra.run.smithi138.stdout:(82/157): python3-markupsafe-1.1.1-12.el9.x86_6 519 kB/s | 35 kB 00:00 2024-09-10T22:13:43.198 INFO:teuthology.orchestra.run.smithi138.stdout:(83/157): python3-mako-1.1.4-6.el9.noarch.rpm 1.3 MB/s | 172 kB 00:00 2024-09-10T22:13:43.233 INFO:teuthology.orchestra.run.smithi138.stdout:(84/157): python3-numpy-f2py-1.20.1-5.el9.x86_6 4.2 MB/s | 250 kB 00:00 2024-09-10T22:13:43.252 INFO:teuthology.orchestra.run.smithi019.stdout:(14/157): libcephfs2-19.3.0-4854.g8f219c47.el9. 4.4 MB/s | 755 kB 00:00 2024-09-10T22:13:43.286 INFO:teuthology.orchestra.run.smithi138.stdout:(85/157): python3-oauthlib-3.1.1-5.el9.noarch.r 2.5 MB/s | 222 kB 00:00 2024-09-10T22:13:43.310 INFO:teuthology.orchestra.run.smithi019.stdout:(15/157): libcephsqlite-19.3.0-4854.g8f219c47.e 2.7 MB/s | 162 kB 00:00 2024-09-10T22:13:43.311 INFO:teuthology.orchestra.run.smithi138.stdout:(86/157): python3-packaging-20.9-5.el9.noarch.r 975 kB/s | 77 kB 00:00 2024-09-10T22:13:43.369 INFO:teuthology.orchestra.run.smithi019.stdout:(16/157): librados-devel-19.3.0-4854.g8f219c47. 2.1 MB/s | 127 kB 00:00 2024-09-10T22:13:43.378 INFO:teuthology.orchestra.run.smithi138.stdout:(87/157): python3-protobuf-3.14.0-13.el9.noarch 3.9 MB/s | 269 kB 00:00 2024-09-10T22:13:43.395 INFO:teuthology.orchestra.run.smithi135.stdout:(58/157): ceph-test-19.3.0-4854.g8f219c47.el9.x 11 MB/s | 50 MB 00:04 2024-09-10T22:13:43.421 INFO:teuthology.orchestra.run.smithi135.stdout:(59/157): librabbitmq-0.11.0-7.el9.x86_64.rpm 92 kB/s | 45 kB 00:00 2024-09-10T22:13:43.429 INFO:teuthology.orchestra.run.smithi138.stdout:(88/157): python3-prettytable-0.7.2-27.el9.noar 297 kB/s | 42 kB 00:00 2024-09-10T22:13:43.454 INFO:teuthology.orchestra.run.smithi138.stdout:(89/157): python3-pyasn1-0.4.8-6.el9.noarch.rpm 2.1 MB/s | 159 kB 00:00 2024-09-10T22:13:43.487 INFO:teuthology.orchestra.run.smithi135.stdout:(60/157): flexiblas-netlib-3.0.4-8.el9.x86_64.r 3.7 MB/s | 3.0 MB 00:00 2024-09-10T22:13:43.494 INFO:teuthology.orchestra.run.smithi019.stdout:(17/157): libradosstriper1-19.3.0-4854.g8f219c4 4.0 MB/s | 507 kB 00:00 2024-09-10T22:13:43.513 INFO:teuthology.orchestra.run.smithi138.stdout:(90/157): python3-pytz-2021.1-5.el9.noarch.rpm 874 kB/s | 51 kB 00:00 2024-09-10T22:13:43.538 INFO:teuthology.orchestra.run.smithi135.stdout:(61/157): libuuid-devel-2.37.4-20.el9.x86_64.rp 490 kB/s | 24 kB 00:00 2024-09-10T22:13:43.571 INFO:teuthology.orchestra.run.smithi135.stdout:(62/157): libtool-2.4.6-46.el9.x86_64.rpm 3.8 MB/s | 581 kB 00:00 2024-09-10T22:13:43.580 INFO:teuthology.orchestra.run.smithi138.stdout:(91/157): python3-numpy-1.20.1-5.el9.x86_64.rpm 12 MB/s | 5.1 MB 00:00 2024-09-10T22:13:43.596 INFO:teuthology.orchestra.run.smithi135.stdout:(63/157): libzstd-devel-1.5.1-2.el9.x86_64.rpm 810 kB/s | 47 kB 00:00 2024-09-10T22:13:43.605 INFO:teuthology.orchestra.run.smithi138.stdout:(92/157): python3-pyasn1-modules-0.4.8-6.el9.no 1.5 MB/s | 279 kB 00:00 2024-09-10T22:13:43.640 INFO:teuthology.orchestra.run.smithi138.stdout:(93/157): python3-requests-oauthlib-1.3.0-12.el 426 kB/s | 54 kB 00:00 2024-09-10T22:13:43.690 INFO:teuthology.orchestra.run.smithi138.stdout:(94/157): python3-toml-0.10.2-6.el9.noarch.rpm 496 kB/s | 42 kB 00:00 2024-09-10T22:13:43.712 INFO:teuthology.orchestra.run.smithi135.stdout:(64/157): lttng-ust-2.12.0-6.el9.x86_64.rpm 2.0 MB/s | 292 kB 00:00 2024-09-10T22:13:43.715 INFO:teuthology.orchestra.run.smithi138.stdout:(95/157): python3-wcwidth-0.2.5-8.el9.noarch.rp 585 kB/s | 44 kB 00:00 2024-09-10T22:13:43.748 INFO:teuthology.orchestra.run.smithi135.stdout:(65/157): lua-5.4.4-4.el9.x86_64.rpm 1.2 MB/s | 188 kB 00:00 2024-09-10T22:13:43.773 INFO:teuthology.orchestra.run.smithi135.stdout:(66/157): openblas-0.3.26-2.el9.x86_64.rpm 629 kB/s | 38 kB 00:00 2024-09-10T22:13:43.782 INFO:teuthology.orchestra.run.smithi138.stdout:(96/157): qatlib-24.02.0-1.el9.x86_64.rpm 2.3 MB/s | 221 kB 00:00 2024-09-10T22:13:43.807 INFO:teuthology.orchestra.run.smithi135.stdout:(67/157): librdkafka-1.6.1-102.el9.x86_64.rpm 1.6 MB/s | 662 kB 00:00 2024-09-10T22:13:43.807 INFO:teuthology.orchestra.run.smithi138.stdout:(97/157): qatlib-service-24.02.0-1.el9.x86_64.r 390 kB/s | 36 kB 00:00 2024-09-10T22:13:43.874 INFO:teuthology.orchestra.run.smithi138.stdout:(98/157): qatzip-libs-1.2.0-1.el9.x86_64.rpm 516 kB/s | 47 kB 00:00 2024-09-10T22:13:43.899 INFO:teuthology.orchestra.run.smithi138.stdout:(99/157): socat-1.7.4.1-6.el9.x86_64.rpm 3.2 MB/s | 304 kB 00:00 2024-09-10T22:13:43.942 INFO:teuthology.orchestra.run.smithi138.stdout:(100/157): uuid-1.6.2-55.el9.x86_64.rpm 863 kB/s | 58 kB 00:00 2024-09-10T22:13:43.967 INFO:teuthology.orchestra.run.smithi138.stdout:(101/157): xfsprogs-devel-6.4.0-4.el9.x86_64.rp 1.4 MB/s | 96 kB 00:00 2024-09-10T22:13:43.999 INFO:teuthology.orchestra.run.smithi135.stdout:(68/157): postgresql-13.16-1.el9.x86_64.rpm 8.3 MB/s | 1.6 MB 00:00 2024-09-10T22:13:44.017 INFO:teuthology.orchestra.run.smithi138.stdout:(102/157): xmlstarlet-1.6.1-20.el9.x86_64.rpm 848 kB/s | 64 kB 00:00 2024-09-10T22:13:44.042 INFO:teuthology.orchestra.run.smithi138.stdout:(103/157): zlib-devel-1.2.11-41.el9.x86_64.rpm 594 kB/s | 45 kB 00:00 2024-09-10T22:13:44.109 INFO:teuthology.orchestra.run.smithi138.stdout:(104/157): lua-devel-5.4.4-4.el9.x86_64.rpm 243 kB/s | 22 kB 00:00 2024-09-10T22:13:44.124 INFO:teuthology.orchestra.run.smithi135.stdout:(69/157): postgresql-contrib-13.16-1.el9.x86_64 7.1 MB/s | 910 kB 00:00 2024-09-10T22:13:44.168 INFO:teuthology.orchestra.run.smithi138.stdout:(105/157): abseil-cpp-20211102.0-3.el9.x86_64.r 9.2 MB/s | 548 kB 00:00 2024-09-10T22:13:44.182 INFO:teuthology.orchestra.run.smithi135.stdout:(70/157): openblas-openmp-0.3.26-2.el9.x86_64.r 11 MB/s | 4.9 MB 00:00 2024-09-10T22:13:44.202 INFO:teuthology.orchestra.run.smithi138.stdout:(106/157): gperftools-libs-2.9.1-2.el9.x86_64.r 9.0 MB/s | 309 kB 00:00 2024-09-10T22:13:44.208 INFO:teuthology.orchestra.run.smithi135.stdout:(71/157): postgresql-private-libs-13.16-1.el9.x 1.6 MB/s | 137 kB 00:00 2024-09-10T22:13:44.227 INFO:teuthology.orchestra.run.smithi138.stdout:(107/157): grpc-data-1.46.7-10.el9.noarch.rpm 779 kB/s | 19 kB 00:00 2024-09-10T22:13:44.245 INFO:teuthology.orchestra.run.smithi019.stdout:(18/157): ceph-test-19.3.0-4854.g8f219c47.el9.x 29 MB/s | 50 MB 00:01 2024-09-10T22:13:44.267 INFO:teuthology.orchestra.run.smithi135.stdout:(72/157): openssl-devel-3.2.2-6.el9.x86_64.rpm 9.0 MB/s | 4.4 MB 00:00 2024-09-10T22:13:44.277 INFO:teuthology.orchestra.run.smithi138.stdout:(108/157): protobuf-compiler-3.14.0-13.el9.x86_ 3.6 MB/s | 863 kB 00:00 2024-09-10T22:13:44.325 INFO:teuthology.orchestra.run.smithi135.stdout:(73/157): python3-attrs-20.3.0-7.el9.noarch.rpm 1.5 MB/s | 87 kB 00:00 2024-09-10T22:13:44.328 INFO:teuthology.orchestra.run.smithi138.stdout:(109/157): libarrow-doc-9.0.0-11.el9.noarch.rpm 520 kB/s | 26 kB 00:00 2024-09-10T22:13:44.362 INFO:teuthology.orchestra.run.smithi138.stdout:(110/157): liboath-2.6.7-2.el9.x86_64.rpm 1.4 MB/s | 49 kB 00:00 2024-09-10T22:13:44.367 INFO:teuthology.orchestra.run.smithi135.stdout:(74/157): protobuf-3.14.0-13.el9.x86_64.rpm 6.4 MB/s | 1.0 MB 00:00 2024-09-10T22:13:44.395 INFO:teuthology.orchestra.run.smithi138.stdout:(111/157): libunwind-1.6.2-1.el9.x86_64.rpm 2.0 MB/s | 67 kB 00:00 2024-09-10T22:13:44.426 INFO:teuthology.orchestra.run.smithi135.stdout:(75/157): python3-colorama-0.4.6-3.el9.noarch.r 1.0 MB/s | 61 kB 00:00 2024-09-10T22:13:44.428 INFO:teuthology.orchestra.run.smithi019.stdout:(19/157): ceph-osd-19.3.0-4854.g8f219c47.el9.x8 5.7 MB/s | 17 MB 00:03 2024-09-10T22:13:44.437 INFO:teuthology.orchestra.run.smithi138.stdout:(112/157): luarocks-3.9.2-5.el9.noarch.rpm 3.5 MB/s | 151 kB 00:00 2024-09-10T22:13:44.462 INFO:teuthology.orchestra.run.smithi019.stdout:(20/157): python3-ceph-argparse-19.3.0-4854.g8f 208 kB/s | 45 kB 00:00 2024-09-10T22:13:44.487 INFO:teuthology.orchestra.run.smithi019.stdout:(21/157): python3-ceph-common-19.3.0-4854.g8f21 2.4 MB/s | 143 kB 00:00 2024-09-10T22:13:44.492 INFO:teuthology.orchestra.run.smithi135.stdout:(76/157): python3-devel-3.9.19-8.el9.x86_64.rpm 3.6 MB/s | 245 kB 00:00 2024-09-10T22:13:44.521 INFO:teuthology.orchestra.run.smithi019.stdout:(22/157): python3-cephfs-19.3.0-4854.g8f219c47. 2.7 MB/s | 161 kB 00:00 2024-09-10T22:13:44.521 INFO:teuthology.orchestra.run.smithi138.stdout:(113/157): libarrow-9.0.0-11.el9.x86_64.rpm 15 MB/s | 4.4 MB 00:00 2024-09-10T22:13:44.559 INFO:teuthology.orchestra.run.smithi135.stdout:(77/157): python3-jinja2-2.11.3-6.el9.noarch.rp 3.6 MB/s | 248 kB 00:00 2024-09-10T22:13:44.571 INFO:teuthology.orchestra.run.smithi138.stdout:(114/157): python3-asyncssh-2.13.2-5.el9.noarch 11 MB/s | 548 kB 00:00 2024-09-10T22:13:44.605 INFO:teuthology.orchestra.run.smithi138.stdout:(115/157): parquet-libs-9.0.0-11.el9.x86_64.rpm 4.9 MB/s | 839 kB 00:00 2024-09-10T22:13:44.630 INFO:teuthology.orchestra.run.smithi138.stdout:(116/157): python3-bcrypt-3.2.2-1.el9.x86_64.rp 742 kB/s | 43 kB 00:00 2024-09-10T22:13:44.638 INFO:teuthology.orchestra.run.smithi019.stdout:(23/157): librgw2-19.3.0-4854.g8f219c47.el9.x86 4.8 MB/s | 5.5 MB 00:01 2024-09-10T22:13:44.656 INFO:teuthology.orchestra.run.smithi138.stdout:(117/157): python3-cachetools-4.2.4-1.el9.noarc 641 kB/s | 32 kB 00:00 2024-09-10T22:13:44.660 INFO:teuthology.orchestra.run.smithi135.stdout:(78/157): postgresql-server-13.16-1.el9.x86_64. 12 MB/s | 5.8 MB 00:00 2024-09-10T22:13:44.665 INFO:teuthology.orchestra.run.smithi019.stdout:(24/157): python3-rados-19.3.0-4854.g8f219c47.e 1.8 MB/s | 321 kB 00:00 2024-09-10T22:13:44.685 INFO:teuthology.orchestra.run.smithi135.stdout:(79/157): python3-jsonpatch-1.21-16.el9.noarch. 204 kB/s | 26 kB 00:00 2024-09-10T22:13:44.688 INFO:teuthology.orchestra.run.smithi019.stdout:(25/157): python3-rgw-19.3.0-4854.g8f219c47.el9 1.9 MB/s | 99 kB 00:00 2024-09-10T22:13:44.690 INFO:teuthology.orchestra.run.smithi138.stdout:(118/157): python3-certifi-2023.05.07-4.el9.noa 239 kB/s | 14 kB 00:00 2024-09-10T22:13:44.713 INFO:teuthology.orchestra.run.smithi019.stdout:(26/157): python3-rbd-19.3.0-4854.g8f219c47.el9 1.6 MB/s | 306 kB 00:00 2024-09-10T22:13:44.717 INFO:teuthology.orchestra.run.smithi138.stdout:(119/157): python3-cheroot-8.6.0-4.el9.noarch.r 2.8 MB/s | 172 kB 00:00 2024-09-10T22:13:44.719 INFO:teuthology.orchestra.run.smithi135.stdout:(80/157): python3-jsonpointer-2.0-4.el9.noarch. 327 kB/s | 19 kB 00:00 2024-09-10T22:13:44.739 INFO:teuthology.orchestra.run.smithi019.stdout:(27/157): rbd-fuse-19.3.0-4854.g8f219c47.el9.x8 1.1 MB/s | 85 kB 00:00 2024-09-10T22:13:44.744 INFO:teuthology.orchestra.run.smithi135.stdout:(81/157): python3-mako-1.1.4-6.el9.noarch.rpm 2.9 MB/s | 172 kB 00:00 2024-09-10T22:13:44.749 INFO:teuthology.orchestra.run.smithi138.stdout:(120/157): python3-cherrypy-18.6.1-2.el9.noarch 6.0 MB/s | 358 kB 00:00 2024-09-10T22:13:44.782 INFO:teuthology.orchestra.run.smithi138.stdout:(121/157): python3-cmd2-2.4.2-2.el9.noarch.rpm 4.4 MB/s | 303 kB 00:00 2024-09-10T22:13:44.789 INFO:teuthology.orchestra.run.smithi019.stdout:(28/157): ceph-grafana-dashboards-19.3.0-4854.g 688 kB/s | 34 kB 00:00 2024-09-10T22:13:44.808 INFO:teuthology.orchestra.run.smithi138.stdout:(122/157): python3-google-auth-2.34.0-1.el9.noa 3.7 MB/s | 220 kB 00:00 2024-09-10T22:13:44.819 INFO:teuthology.orchestra.run.smithi135.stdout:(82/157): python3-babel-2.9.1-2.el9.noarch.rpm 12 MB/s | 6.0 MB 00:00 2024-09-10T22:13:44.823 INFO:teuthology.orchestra.run.smithi019.stdout:(29/157): rbd-nbd-19.3.0-4854.g8f219c47.el9.x86 2.0 MB/s | 171 kB 00:00 2024-09-10T22:13:44.841 INFO:teuthology.orchestra.run.smithi138.stdout:(123/157): python3-grpcio-tools-1.46.7-10.el9.x 4.2 MB/s | 144 kB 00:00 2024-09-10T22:13:44.845 INFO:teuthology.orchestra.run.smithi135.stdout:(83/157): python3-markupsafe-1.1.1-12.el9.x86_6 277 kB/s | 35 kB 00:00 2024-09-10T22:13:44.848 INFO:teuthology.orchestra.run.smithi019.stdout:(30/157): ceph-mgr-cephadm-19.3.0-4854.g8f219c4 2.6 MB/s | 154 kB 00:00 2024-09-10T22:13:44.858 INFO:teuthology.orchestra.run.smithi138.stdout:(124/157): python3-jaraco-8.2.1-3.el9.noarch.rp 646 kB/s | 11 kB 00:00 2024-09-10T22:13:44.876 INFO:teuthology.orchestra.run.smithi138.stdout:(125/157): python3-jaraco-classes-3.2.1-5.el9.n 1.0 MB/s | 18 kB 00:00 2024-09-10T22:13:44.878 INFO:teuthology.orchestra.run.smithi135.stdout:(84/157): python3-numpy-f2py-1.20.1-5.el9.x86_6 4.2 MB/s | 250 kB 00:00 2024-09-10T22:13:44.893 INFO:teuthology.orchestra.run.smithi138.stdout:(126/157): python3-jaraco-collections-3.0.0-8.e 1.4 MB/s | 23 kB 00:00 2024-09-10T22:13:44.903 INFO:teuthology.orchestra.run.smithi135.stdout:(85/157): python3-oauthlib-3.1.1-5.el9.noarch.r 3.7 MB/s | 222 kB 00:00 2024-09-10T22:13:44.910 INFO:teuthology.orchestra.run.smithi138.stdout:(127/157): python3-jaraco-functools-3.5.0-2.el9 1.2 MB/s | 19 kB 00:00 2024-09-10T22:13:44.935 INFO:teuthology.orchestra.run.smithi138.stdout:(128/157): python3-jaraco-text-3.2.0-6.el9.noar 785 kB/s | 20 kB 00:00 2024-09-10T22:13:44.937 INFO:teuthology.orchestra.run.smithi135.stdout:(86/157): python3-packaging-20.9-5.el9.noarch.r 1.3 MB/s | 77 kB 00:00 2024-09-10T22:13:44.963 INFO:teuthology.orchestra.run.smithi135.stdout:(87/157): python3-prettytable-0.7.2-27.el9.noar 721 kB/s | 42 kB 00:00 2024-09-10T22:13:44.985 INFO:teuthology.orchestra.run.smithi138.stdout:(129/157): python3-grpcio-1.46.7-10.el9.x86_64. 10 MB/s | 2.0 MB 00:00 2024-09-10T22:13:44.996 INFO:teuthology.orchestra.run.smithi135.stdout:(88/157): python3-protobuf-3.14.0-13.el9.noarch 4.5 MB/s | 269 kB 00:00 2024-09-10T22:13:45.011 INFO:teuthology.orchestra.run.smithi138.stdout:(130/157): python3-logutils-0.3.5-21.el9.noarch 1.8 MB/s | 46 kB 00:00 2024-09-10T22:13:45.030 INFO:teuthology.orchestra.run.smithi135.stdout:(89/157): python3-pyasn1-0.4.8-6.el9.noarch.rpm 2.3 MB/s | 159 kB 00:00 2024-09-10T22:13:45.044 INFO:teuthology.orchestra.run.smithi138.stdout:(131/157): python3-kubernetes-26.1.0-2.el9.noar 9.4 MB/s | 1.0 MB 00:00 2024-09-10T22:13:45.055 INFO:teuthology.orchestra.run.smithi135.stdout:(90/157): python3-pyasn1-modules-0.4.8-6.el9.no 4.7 MB/s | 279 kB 00:00 2024-09-10T22:13:45.073 INFO:teuthology.orchestra.run.smithi138.stdout:(132/157): python3-more-itertools-8.12.0-2.el9. 1.3 MB/s | 79 kB 00:00 2024-09-10T22:13:45.081 INFO:teuthology.orchestra.run.smithi019.stdout:(31/157): rbd-mirror-19.3.0-4854.g8f219c47.el9. 8.1 MB/s | 3.2 MB 00:00 2024-09-10T22:13:45.088 INFO:teuthology.orchestra.run.smithi135.stdout:(91/157): python3-pytz-2021.1-5.el9.noarch.rpm 874 kB/s | 51 kB 00:00 2024-09-10T22:13:45.095 INFO:teuthology.orchestra.run.smithi138.stdout:(133/157): python3-natsort-7.1.1-5.el9.noarch.r 1.1 MB/s | 58 kB 00:00 2024-09-10T22:13:45.114 INFO:teuthology.orchestra.run.smithi135.stdout:(92/157): python3-requests-oauthlib-1.3.0-12.el 915 kB/s | 54 kB 00:00 2024-09-10T22:13:45.120 INFO:teuthology.orchestra.run.smithi138.stdout:(134/157): python3-portend-3.1.0-2.el9.noarch.r 657 kB/s | 16 kB 00:00 2024-09-10T22:13:45.132 INFO:teuthology.orchestra.run.smithi019.stdout:(32/157): ceph-mgr-modules-core-19.3.0-4854.g8f 5.7 MB/s | 291 kB 00:00 2024-09-10T22:13:45.154 INFO:teuthology.orchestra.run.smithi138.stdout:(135/157): python3-pecan-1.4.2-3.el9.noarch.rpm 3.2 MB/s | 272 kB 00:00 2024-09-10T22:13:45.179 INFO:teuthology.orchestra.run.smithi138.stdout:(136/157): python3-pyOpenSSL-21.0.0-1.el9.noarc 1.5 MB/s | 90 kB 00:00 2024-09-10T22:13:45.189 INFO:teuthology.orchestra.run.smithi135.stdout:(93/157): python3-numpy-1.20.1-5.el9.x86_64.rpm 11 MB/s | 5.1 MB 00:00 2024-09-10T22:13:45.205 INFO:teuthology.orchestra.run.smithi138.stdout:(137/157): python3-pyperclip-1.8.2-2.el9.noarch 560 kB/s | 28 kB 00:00 2024-09-10T22:13:45.215 INFO:teuthology.orchestra.run.smithi135.stdout:(94/157): python3-toml-0.10.2-6.el9.noarch.rpm 415 kB/s | 42 kB 00:00 2024-09-10T22:13:45.230 INFO:teuthology.orchestra.run.smithi138.stdout:(138/157): python3-repoze-lru-0.7-16.el9.noarch 611 kB/s | 31 kB 00:00 2024-09-10T22:13:45.240 INFO:teuthology.orchestra.run.smithi135.stdout:(95/157): python3-wcwidth-0.2.5-8.el9.noarch.rp 879 kB/s | 44 kB 00:00 2024-09-10T22:13:45.256 INFO:teuthology.orchestra.run.smithi138.stdout:(139/157): python3-routes-2.5.1-5.el9.noarch.rp 3.7 MB/s | 188 kB 00:00 2024-09-10T22:13:45.281 INFO:teuthology.orchestra.run.smithi138.stdout:(140/157): python3-rsa-4.9-2.el9.noarch.rpm 1.1 MB/s | 59 kB 00:00 2024-09-10T22:13:45.282 INFO:teuthology.orchestra.run.smithi135.stdout:(96/157): qatlib-24.02.0-1.el9.x86_64.rpm 3.2 MB/s | 221 kB 00:00 2024-09-10T22:13:45.290 INFO:teuthology.orchestra.run.smithi019.stdout:(33/157): ceph-mgr-dashboard-19.3.0-4854.g8f219 30 MB/s | 14 MB 00:00 2024-09-10T22:13:45.307 INFO:teuthology.orchestra.run.smithi138.stdout:(141/157): python3-tempora-5.0.0-2.el9.noarch.r 707 kB/s | 36 kB 00:00 2024-09-10T22:13:45.307 INFO:teuthology.orchestra.run.smithi135.stdout:(97/157): qatlib-service-24.02.0-1.el9.x86_64.r 537 kB/s | 36 kB 00:00 2024-09-10T22:13:45.315 INFO:teuthology.orchestra.run.smithi019.stdout:(34/157): ceph-mgr-rook-19.3.0-4854.g8f219c47.e 269 kB/s | 49 kB 00:00 2024-09-10T22:13:45.332 INFO:teuthology.orchestra.run.smithi138.stdout:(142/157): python3-typing-extensions-4.12.2-2.e 1.4 MB/s | 74 kB 00:00 2024-09-10T22:13:45.340 INFO:teuthology.orchestra.run.smithi135.stdout:(98/157): qatzip-libs-1.2.0-1.el9.x86_64.rpm 811 kB/s | 47 kB 00:00 2024-09-10T22:13:45.341 INFO:teuthology.orchestra.run.smithi019.stdout:(35/157): ceph-prometheus-alerts-19.3.0-4854.g8 329 kB/s | 16 kB 00:00 2024-09-10T22:13:45.357 INFO:teuthology.orchestra.run.smithi138.stdout:(143/157): python3-webob-1.8.8-2.el9.noarch.rpm 4.5 MB/s | 230 kB 00:00 2024-09-10T22:13:45.366 INFO:teuthology.orchestra.run.smithi135.stdout:(99/157): socat-1.7.4.1-6.el9.x86_64.rpm 5.1 MB/s | 304 kB 00:00 2024-09-10T22:13:45.366 INFO:teuthology.orchestra.run.smithi019.stdout:(36/157): ceph-volume-19.3.0-4854.g8f219c47.el9 5.6 MB/s | 285 kB 00:00 2024-09-10T22:13:45.382 INFO:teuthology.orchestra.run.smithi138.stdout:(144/157): python3-websocket-client-1.2.3-2.el9 1.7 MB/s | 90 kB 00:00 2024-09-10T22:13:45.399 INFO:teuthology.orchestra.run.smithi135.stdout:(100/157): uuid-1.6.2-55.el9.x86_64.rpm 989 kB/s | 58 kB 00:00 2024-09-10T22:13:45.400 INFO:teuthology.orchestra.run.smithi019.stdout:(37/157): cephadm-19.3.0-4854.g8f219c47.el9.noa 13 MB/s | 783 kB 00:00 2024-09-10T22:13:45.408 INFO:teuthology.orchestra.run.smithi138.stdout:(145/157): python3-zc-lockfile-2.0-10.el9.noarc 797 kB/s | 20 kB 00:00 2024-09-10T22:13:45.425 INFO:teuthology.orchestra.run.smithi135.stdout:(101/157): xfsprogs-devel-6.4.0-4.el9.x86_64.rp 1.6 MB/s | 96 kB 00:00 2024-09-10T22:13:45.425 INFO:teuthology.orchestra.run.smithi019.stdout:(38/157): cephfs-top-19.3.0-4854.g8f219c47.el9. 311 kB/s | 18 kB 00:00 2024-09-10T22:13:45.433 INFO:teuthology.orchestra.run.smithi138.stdout:(146/157): python3-werkzeug-2.0.3-3.el9.1.noarc 5.5 MB/s | 427 kB 00:00 2024-09-10T22:13:45.458 INFO:teuthology.orchestra.run.smithi135.stdout:(102/157): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.1 MB/s | 64 kB 00:00 2024-09-10T22:13:45.483 INFO:teuthology.orchestra.run.smithi135.stdout:(103/157): zlib-devel-1.2.11-41.el9.x86_64.rpm 766 kB/s | 45 kB 00:00 2024-09-10T22:13:45.534 INFO:teuthology.orchestra.run.smithi019.stdout:(39/157): fuse-2.9.9-16.el9.x86_64.rpm 597 kB/s | 80 kB 00:00 2024-09-10T22:13:45.600 INFO:teuthology.orchestra.run.smithi135.stdout:(104/157): lua-devel-5.4.4-4.el9.x86_64.rpm 157 kB/s | 22 kB 00:00 2024-09-10T22:13:45.617 INFO:teuthology.orchestra.run.smithi138.stdout:(147/157): python3-scipy-1.6.2-8.el9.x86_64.rpm 8.0 MB/s | 16 MB 00:02 2024-09-10T22:13:45.618 INFO:teuthology.orchestra.run.smithi019.stdout:(40/157): libgfortran-11.5.0-2.el9.x86_64.rpm 4.1 MB/s | 801 kB 00:00 2024-09-10T22:13:45.643 INFO:teuthology.orchestra.run.smithi138.stdout:(148/157): re2-20211101-20.el9.x86_64.rpm 818 kB/s | 191 kB 00:00 2024-09-10T22:13:45.651 INFO:teuthology.orchestra.run.smithi019.stdout:(41/157): libquadmath-11.5.0-2.el9.x86_64.rpm 1.6 MB/s | 191 kB 00:00 2024-09-10T22:13:45.676 INFO:teuthology.orchestra.run.smithi019.stdout:(42/157): python3-cffi-1.14.5-5.el9.x86_64.rpm 4.2 MB/s | 253 kB 00:00 2024-09-10T22:13:45.693 INFO:teuthology.orchestra.run.smithi138.stdout:(149/157): thrift-0.15.0-2.el9.x86_64.rpm 6.1 MB/s | 1.6 MB 00:00 2024-09-10T22:13:45.701 INFO:teuthology.orchestra.run.smithi135.stdout:(105/157): abseil-cpp-20211102.0-3.el9.x86_64.r 5.4 MB/s | 548 kB 00:00 2024-09-10T22:13:45.751 INFO:teuthology.orchestra.run.smithi135.stdout:(106/157): gperftools-libs-2.9.1-2.el9.x86_64.r 6.1 MB/s | 309 kB 00:00 2024-09-10T22:13:45.768 INFO:teuthology.orchestra.run.smithi019.stdout:(43/157): ceph-mgr-diskprediction-local-19.3.0- 8.0 MB/s | 7.4 MB 00:00 2024-09-10T22:13:45.793 INFO:teuthology.orchestra.run.smithi138.stdout:(150/157): NetworkManager-1.49.90-1.el9.x86_64. 23 MB/s | 2.3 MB 00:00 2024-09-10T22:13:45.794 INFO:teuthology.orchestra.run.smithi019.stdout:(44/157): python3-ply-3.11-14.el9.noarch.rpm 908 kB/s | 106 kB 00:00 2024-09-10T22:13:45.828 INFO:teuthology.orchestra.run.smithi019.stdout:(45/157): python3-cryptography-36.0.1-4.el9.x86 7.0 MB/s | 1.2 MB 00:00 2024-09-10T22:13:45.853 INFO:teuthology.orchestra.run.smithi019.stdout:(46/157): python3-requests-2.25.1-8.el9.noarch. 2.1 MB/s | 125 kB 00:00 2024-09-10T22:13:45.878 INFO:teuthology.orchestra.run.smithi019.stdout:(47/157): python3-urllib3-1.26.5-6.el9.noarch.r 4.2 MB/s | 215 kB 00:00 2024-09-10T22:13:45.893 INFO:teuthology.orchestra.run.smithi138.stdout:(151/157): NetworkManager-libnm-1.49.90-1.el9.x 18 MB/s | 1.8 MB 00:00 2024-09-10T22:13:45.901 INFO:teuthology.orchestra.run.smithi135.stdout:(107/157): python3-scipy-1.6.2-8.el9.x86_64.rpm 20 MB/s | 16 MB 00:00 2024-09-10T22:13:45.903 INFO:teuthology.orchestra.run.smithi019.stdout:(48/157): python3-pycparser-2.20-6.el9.noarch.r 1.0 MB/s | 135 kB 00:00 2024-09-10T22:13:45.918 INFO:teuthology.orchestra.run.smithi135.stdout:(108/157): grpc-data-1.46.7-10.el9.noarch.rpm 116 kB/s | 19 kB 00:00 2024-09-10T22:13:45.960 INFO:teuthology.orchestra.run.smithi135.stdout:(109/157): protobuf-compiler-3.14.0-13.el9.x86_ 1.8 MB/s | 863 kB 00:00 2024-09-10T22:13:45.977 INFO:teuthology.orchestra.run.smithi138.stdout:(152/157): librados2-19.3.0-4854.g8f219c47.el9. 9.6 MB/s | 3.5 MB 00:00 2024-09-10T22:13:45.977 INFO:teuthology.orchestra.run.smithi135.stdout:(110/157): libarrow-doc-9.0.0-11.el9.noarch.rpm 501 kB/s | 26 kB 00:00 2024-09-10T22:13:45.994 INFO:teuthology.orchestra.run.smithi138.stdout:(153/157): NetworkManager-team-1.49.90-1.el9.x8 406 kB/s | 41 kB 00:00 2024-09-10T22:13:46.019 INFO:teuthology.orchestra.run.smithi135.stdout:(111/157): libunwind-1.6.2-1.el9.x86_64.rpm 1.9 MB/s | 67 kB 00:00 2024-09-10T22:13:46.053 INFO:teuthology.orchestra.run.smithi135.stdout:(112/157): liboath-2.6.7-2.el9.x86_64.rpm 538 kB/s | 49 kB 00:00 2024-09-10T22:13:46.069 INFO:teuthology.orchestra.run.smithi138.stdout:(154/157): openssl-3.2.2-6.el9.x86_64.rpm 18 MB/s | 1.4 MB 00:00 2024-09-10T22:13:46.103 INFO:teuthology.orchestra.run.smithi135.stdout:(113/157): luarocks-3.9.2-5.el9.noarch.rpm 1.8 MB/s | 151 kB 00:00 2024-09-10T22:13:46.128 INFO:teuthology.orchestra.run.smithi138.stdout:(155/157): librbd1-19.3.0-4854.g8f219c47.el9.x8 6.7 MB/s | 3.2 MB 00:00 2024-09-10T22:13:46.153 INFO:teuthology.orchestra.run.smithi138.stdout:(156/157): NetworkManager-tui-1.49.90-1.el9.x86 1.4 MB/s | 249 kB 00:00 2024-09-10T22:13:46.187 INFO:teuthology.orchestra.run.smithi135.stdout:(114/157): python3-asyncssh-2.13.2-5.el9.noarch 6.4 MB/s | 548 kB 00:00 2024-09-10T22:13:46.203 INFO:teuthology.orchestra.run.smithi138.stdout:(157/157): openssl-libs-3.2.2-6.el9.x86_64.rpm 18 MB/s | 2.4 MB 00:00 2024-09-10T22:13:46.209 INFO:teuthology.orchestra.run.smithi138.stdout:-------------------------------------------------------------------------------- 2024-09-10T22:13:46.209 INFO:teuthology.orchestra.run.smithi138.stdout:Total 22 MB/s | 240 MB 00:10 2024-09-10T22:13:46.229 INFO:teuthology.orchestra.run.smithi135.stdout:(115/157): parquet-libs-9.0.0-11.el9.x86_64.rpm 4.7 MB/s | 839 kB 00:00 2024-09-10T22:13:46.254 INFO:teuthology.orchestra.run.smithi135.stdout:(116/157): python3-bcrypt-3.2.2-1.el9.x86_64.rp 650 kB/s | 43 kB 00:00 2024-09-10T22:13:46.279 INFO:teuthology.orchestra.run.smithi135.stdout:(117/157): python3-cachetools-4.2.4-1.el9.noarc 641 kB/s | 32 kB 00:00 2024-09-10T22:13:46.304 INFO:teuthology.orchestra.run.smithi135.stdout:(118/157): python3-certifi-2023.05.07-4.el9.noa 281 kB/s | 14 kB 00:00 2024-09-10T22:13:46.320 INFO:teuthology.orchestra.run.smithi019.stdout:(49/157): boost-program-options-1.75.0-8.el9.x8 256 kB/s | 107 kB 00:00 2024-09-10T22:13:46.330 INFO:teuthology.orchestra.run.smithi135.stdout:(119/157): python3-cheroot-8.6.0-4.el9.noarch.r 3.3 MB/s | 172 kB 00:00 2024-09-10T22:13:46.380 INFO:teuthology.orchestra.run.smithi135.stdout:(120/157): python3-cherrypy-18.6.1-2.el9.noarch 4.6 MB/s | 358 kB 00:00 2024-09-10T22:13:46.405 INFO:teuthology.orchestra.run.smithi135.stdout:(121/157): python3-cmd2-2.4.2-2.el9.noarch.rpm 3.9 MB/s | 303 kB 00:00 2024-09-10T22:13:46.431 INFO:teuthology.orchestra.run.smithi135.stdout:(122/157): python3-google-auth-2.34.0-1.el9.noa 4.3 MB/s | 220 kB 00:00 2024-09-10T22:13:46.445 INFO:teuthology.orchestra.run.smithi019.stdout:(50/157): automake-1.16.2-8.el9.noarch.rpm 1.1 MB/s | 689 kB 00:00 2024-09-10T22:13:46.489 INFO:teuthology.orchestra.run.smithi135.stdout:(123/157): libarrow-9.0.0-11.el9.x86_64.rpm 7.5 MB/s | 4.4 MB 00:00 2024-09-10T22:13:46.514 INFO:teuthology.orchestra.run.smithi135.stdout:(124/157): python3-jaraco-8.2.1-3.el9.noarch.rp 429 kB/s | 11 kB 00:00 2024-09-10T22:13:46.540 INFO:teuthology.orchestra.run.smithi135.stdout:(125/157): python3-grpcio-tools-1.46.7-10.el9.x 1.3 MB/s | 144 kB 00:00 2024-09-10T22:13:46.565 INFO:teuthology.orchestra.run.smithi135.stdout:(126/157): python3-jaraco-classes-3.2.1-5.el9.n 351 kB/s | 18 kB 00:00 2024-09-10T22:13:46.587 INFO:teuthology.orchestra.run.smithi019.stdout:(51/157): elfutils-libelf-devel-0.191-4.el9.x86 81 kB/s | 22 kB 00:00 2024-09-10T22:13:46.598 INFO:teuthology.orchestra.run.smithi135.stdout:(127/157): python3-jaraco-collections-3.0.0-8.e 395 kB/s | 23 kB 00:00 2024-09-10T22:13:46.624 INFO:teuthology.orchestra.run.smithi135.stdout:(128/157): python3-jaraco-functools-3.5.0-2.el9 331 kB/s | 19 kB 00:00 2024-09-10T22:13:46.629 INFO:teuthology.orchestra.run.smithi019.stdout:(52/157): bison-3.7.4-5.el9.x86_64.rpm 1.2 MB/s | 943 kB 00:00 2024-09-10T22:13:46.649 INFO:teuthology.orchestra.run.smithi135.stdout:(129/157): python3-jaraco-text-3.2.0-6.el9.noar 390 kB/s | 20 kB 00:00 2024-09-10T22:13:46.674 INFO:teuthology.orchestra.run.smithi135.stdout:(130/157): python3-logutils-0.3.5-21.el9.noarch 1.8 MB/s | 46 kB 00:00 2024-09-10T22:13:46.708 INFO:teuthology.orchestra.run.smithi135.stdout:(131/157): python3-more-itertools-8.12.0-2.el9. 2.3 MB/s | 79 kB 00:00 2024-09-10T22:13:46.758 INFO:teuthology.orchestra.run.smithi135.stdout:(132/157): python3-grpcio-1.46.7-10.el9.x86_64. 5.8 MB/s | 2.0 MB 00:00 2024-09-10T22:13:46.783 INFO:teuthology.orchestra.run.smithi135.stdout:(133/157): python3-natsort-7.1.1-5.el9.noarch.r 767 kB/s | 58 kB 00:00 2024-09-10T22:13:46.809 INFO:teuthology.orchestra.run.smithi135.stdout:(134/157): python3-portend-3.1.0-2.el9.noarch.r 655 kB/s | 16 kB 00:00 2024-09-10T22:13:46.851 INFO:teuthology.orchestra.run.smithi135.stdout:(135/157): python3-kubernetes-26.1.0-2.el9.noar 4.5 MB/s | 1.0 MB 00:00 2024-09-10T22:13:46.876 INFO:teuthology.orchestra.run.smithi135.stdout:(136/157): python3-pyOpenSSL-21.0.0-1.el9.noarc 1.3 MB/s | 90 kB 00:00 2024-09-10T22:13:46.901 INFO:teuthology.orchestra.run.smithi135.stdout:(137/157): python3-pyperclip-1.8.2-2.el9.noarch 562 kB/s | 28 kB 00:00 2024-09-10T22:13:46.913 INFO:teuthology.orchestra.run.smithi019.stdout:(53/157): flexiblas-3.0.4-8.el9.x86_64.rpm 100 kB/s | 33 kB 00:00 2024-09-10T22:13:46.926 INFO:teuthology.orchestra.run.smithi135.stdout:(138/157): python3-pecan-1.4.2-3.el9.noarch.rpm 1.6 MB/s | 272 kB 00:00 2024-09-10T22:13:46.952 INFO:teuthology.orchestra.run.smithi135.stdout:(139/157): python3-repoze-lru-0.7-16.el9.noarch 405 kB/s | 31 kB 00:00 2024-09-10T22:13:46.977 INFO:teuthology.orchestra.run.smithi135.stdout:(140/157): python3-rsa-4.9-2.el9.noarch.rpm 1.1 MB/s | 59 kB 00:00 2024-09-10T22:13:47.003 INFO:teuthology.orchestra.run.smithi135.stdout:(141/157): python3-tempora-5.0.0-2.el9.noarch.r 713 kB/s | 36 kB 00:00 2024-09-10T22:13:47.013 INFO:teuthology.orchestra.run.smithi019.stdout:(54/157): flex-2.6.4-9.el9.x86_64.rpm 553 kB/s | 313 kB 00:00 2024-09-10T22:13:47.028 INFO:teuthology.orchestra.run.smithi135.stdout:(142/157): python3-routes-2.5.1-5.el9.noarch.rp 1.5 MB/s | 188 kB 00:00 2024-09-10T22:13:47.054 INFO:teuthology.orchestra.run.smithi135.stdout:(143/157): python3-typing-extensions-4.12.2-2.e 986 kB/s | 74 kB 00:00 2024-09-10T22:13:47.079 INFO:teuthology.orchestra.run.smithi135.stdout:(144/157): python3-websocket-client-1.2.3-2.el9 1.7 MB/s | 90 kB 00:00 2024-09-10T22:13:47.112 INFO:teuthology.orchestra.run.smithi135.stdout:(145/157): python3-webob-1.8.8-2.el9.noarch.rpm 2.1 MB/s | 230 kB 00:00 2024-09-10T22:13:47.129 INFO:teuthology.orchestra.run.smithi135.stdout:(146/157): python3-zc-lockfile-2.0-10.el9.noarc 397 kB/s | 20 kB 00:00 2024-09-10T22:13:47.154 INFO:teuthology.orchestra.run.smithi135.stdout:(147/157): re2-20211101-20.el9.x86_64.rpm 4.5 MB/s | 191 kB 00:00 2024-09-10T22:13:47.188 INFO:teuthology.orchestra.run.smithi135.stdout:(148/157): python3-werkzeug-2.0.3-3.el9.1.noarc 3.1 MB/s | 427 kB 00:00 2024-09-10T22:13:47.197 INFO:teuthology.orchestra.run.smithi019.stdout:(55/157): libaio-devel-0.3.111-13.el9.x86_64.rp 61 kB/s | 11 kB 00:00 2024-09-10T22:13:47.222 INFO:teuthology.orchestra.run.smithi019.stdout:(56/157): flexiblas-openblas-openmp-3.0.4-8.el9 59 kB/s | 18 kB 00:00 2024-09-10T22:13:47.305 INFO:teuthology.orchestra.run.smithi135.stdout:(149/157): thrift-0.15.0-2.el9.x86_64.rpm 9.0 MB/s | 1.6 MB 00:00 2024-09-10T22:13:47.406 INFO:teuthology.orchestra.run.smithi135.stdout:(150/157): NetworkManager-1.49.90-1.el9.x86_64. 23 MB/s | 2.3 MB 00:00 2024-09-10T22:13:47.462 INFO:teuthology.orchestra.run.smithi138.stdout:Running transaction check 2024-09-10T22:13:47.543 INFO:teuthology.orchestra.run.smithi019.stdout:(57/157): flexiblas-netlib-3.0.4-8.el9.x86_64.r 3.3 MB/s | 3.0 MB 00:00 2024-09-10T22:13:47.543 INFO:teuthology.orchestra.run.smithi135.stdout:(151/157): librados2-19.3.0-4854.g8f219c47.el9. 9.9 MB/s | 3.5 MB 00:00 2024-09-10T22:13:47.556 INFO:teuthology.orchestra.run.smithi135.stdout:(152/157): librbd1-19.3.0-4854.g8f219c47.el9.x8 8.8 MB/s | 3.2 MB 00:00 2024-09-10T22:13:47.598 INFO:teuthology.orchestra.run.smithi135.stdout:(153/157): NetworkManager-libnm-1.49.90-1.el9.x 9.4 MB/s | 1.8 MB 00:00 2024-09-10T22:13:47.615 INFO:teuthology.orchestra.run.smithi138.stdout:Transaction check succeeded. 2024-09-10T22:13:47.615 INFO:teuthology.orchestra.run.smithi138.stdout:Running transaction test 2024-09-10T22:13:47.623 INFO:teuthology.orchestra.run.smithi135.stdout:(154/157): NetworkManager-team-1.49.90-1.el9.x8 348 kB/s | 41 kB 00:00 2024-09-10T22:13:47.631 INFO:teuthology.orchestra.run.smithi019.stdout:(58/157): libnbd-1.20.2-2.el9.x86_64.rpm 393 kB/s | 171 kB 00:00 2024-09-10T22:13:47.656 INFO:teuthology.orchestra.run.smithi019.stdout:(59/157): libpmemobj-1.12.1-1.el9.x86_64.rpm 369 kB/s | 160 kB 00:00 2024-09-10T22:13:47.707 INFO:teuthology.orchestra.run.smithi135.stdout:(155/157): openssl-3.2.2-6.el9.x86_64.rpm 12 MB/s | 1.4 MB 00:00 2024-09-10T22:13:47.732 INFO:teuthology.orchestra.run.smithi135.stdout:(156/157): NetworkManager-tui-1.49.90-1.el9.x86 1.4 MB/s | 249 kB 00:00 2024-09-10T22:13:47.782 INFO:teuthology.orchestra.run.smithi135.stdout:(157/157): openssl-libs-3.2.2-6.el9.x86_64.rpm 15 MB/s | 2.4 MB 00:00 2024-09-10T22:13:47.787 INFO:teuthology.orchestra.run.smithi135.stdout:-------------------------------------------------------------------------------- 2024-09-10T22:13:47.787 INFO:teuthology.orchestra.run.smithi135.stdout:Total 20 MB/s | 240 MB 00:12 2024-09-10T22:13:47.906 INFO:teuthology.orchestra.run.smithi019.stdout:(60/157): librabbitmq-0.11.0-7.el9.x86_64.rpm 123 kB/s | 45 kB 00:00 2024-09-10T22:13:48.207 INFO:teuthology.orchestra.run.smithi019.stdout:(61/157): libuuid-devel-2.37.4-20.el9.x86_64.rp 82 kB/s | 24 kB 00:00 2024-09-10T22:13:48.249 INFO:teuthology.orchestra.run.smithi019.stdout:(62/157): libtool-2.4.6-46.el9.x86_64.rpm 981 kB/s | 581 kB 00:00 2024-09-10T22:13:48.299 INFO:teuthology.orchestra.run.smithi019.stdout:(63/157): librdkafka-1.6.1-102.el9.x86_64.rpm 992 kB/s | 662 kB 00:00 2024-09-10T22:13:48.674 INFO:teuthology.orchestra.run.smithi019.stdout:(64/157): libzstd-devel-1.5.1-2.el9.x86_64.rpm 102 kB/s | 47 kB 00:00 2024-09-10T22:13:48.724 INFO:teuthology.orchestra.run.smithi019.stdout:(65/157): lua-5.4.4-4.el9.x86_64.rpm 443 kB/s | 188 kB 00:00 2024-09-10T22:13:48.841 INFO:teuthology.orchestra.run.smithi019.stdout:(66/157): lttng-ust-2.12.0-6.el9.x86_64.rpm 493 kB/s | 292 kB 00:00 2024-09-10T22:13:48.950 INFO:teuthology.orchestra.run.smithi019.stdout:(67/157): openblas-0.3.26-2.el9.x86_64.rpm 140 kB/s | 38 kB 00:00 2024-09-10T22:13:49.024 INFO:teuthology.orchestra.run.smithi135.stdout:Running transaction check 2024-09-10T22:13:49.174 INFO:teuthology.orchestra.run.smithi135.stdout:Transaction check succeeded. 2024-09-10T22:13:49.174 INFO:teuthology.orchestra.run.smithi135.stdout:Running transaction test 2024-09-10T22:13:49.514 INFO:teuthology.orchestra.run.smithi138.stdout:Transaction test succeeded. 2024-09-10T22:13:49.515 INFO:teuthology.orchestra.run.smithi138.stdout:Running transaction 2024-09-10T22:13:49.684 INFO:teuthology.orchestra.run.smithi019.stdout:(68/157): openblas-openmp-0.3.26-2.el9.x86_64.r 5.2 MB/s | 4.9 MB 00:00 2024-09-10T22:13:50.417 INFO:teuthology.orchestra.run.smithi019.stdout:(69/157): postgresql-contrib-13.16-1.el9.x86_64 1.2 MB/s | 910 kB 00:00 2024-09-10T22:13:50.509 INFO:teuthology.orchestra.run.smithi019.stdout:(70/157): openssl-devel-3.2.2-6.el9.x86_64.rpm 2.7 MB/s | 4.4 MB 00:01 2024-09-10T22:13:50.651 INFO:teuthology.orchestra.run.smithi019.stdout:(71/157): postgresql-13.16-1.el9.x86_64.rpm 954 kB/s | 1.6 MB 00:01 2024-09-10T22:13:50.885 INFO:teuthology.orchestra.run.smithi019.stdout:(72/157): postgresql-private-libs-13.16-1.el9.x 294 kB/s | 137 kB 00:00 2024-09-10T22:13:51.059 INFO:teuthology.orchestra.run.smithi135.stdout:Transaction test succeeded. 2024-09-10T22:13:51.060 INFO:teuthology.orchestra.run.smithi135.stdout:Running transaction 2024-09-10T22:13:51.227 INFO:teuthology.orchestra.run.smithi019.stdout:(73/157): python3-attrs-20.3.0-7.el9.noarch.rpm 256 kB/s | 87 kB 00:00 2024-09-10T22:13:51.427 INFO:teuthology.orchestra.run.smithi019.stdout:(74/157): protobuf-3.14.0-13.el9.x86_64.rpm 1.3 MB/s | 1.0 MB 00:00 2024-09-10T22:13:51.502 INFO:teuthology.orchestra.run.smithi019.stdout:(75/157): postgresql-server-13.16-1.el9.x86_64. 5.8 MB/s | 5.8 MB 00:00 2024-09-10T22:13:51.786 INFO:teuthology.orchestra.run.smithi019.stdout:(76/157): python3-colorama-0.4.6-3.el9.noarch.r 171 kB/s | 61 kB 00:00 2024-09-10T22:13:52.011 INFO:teuthology.orchestra.run.smithi019.stdout:(77/157): python3-devel-3.9.19-8.el9.x86_64.rpm 481 kB/s | 245 kB 00:00 2024-09-10T22:13:52.228 INFO:teuthology.orchestra.run.smithi019.stdout:(78/157): python3-babel-2.9.1-2.el9.noarch.rpm 6.0 MB/s | 6.0 MB 00:01 2024-09-10T22:13:52.278 INFO:teuthology.orchestra.run.smithi019.stdout:(79/157): python3-jsonpatch-1.21-16.el9.noarch. 96 kB/s | 26 kB 00:00 2024-09-10T22:13:52.312 INFO:teuthology.orchestra.run.smithi019.stdout:(80/157): python3-jinja2-2.11.3-6.el9.noarch.rp 472 kB/s | 248 kB 00:00 2024-09-10T22:13:52.487 INFO:teuthology.orchestra.run.smithi019.stdout:(81/157): python3-jsonpointer-2.0-4.el9.noarch. 74 kB/s | 19 kB 00:00 2024-09-10T22:13:52.571 INFO:teuthology.orchestra.run.smithi019.stdout:(82/157): python3-markupsafe-1.1.1-12.el9.x86_6 134 kB/s | 35 kB 00:00 2024-09-10T22:13:52.856 INFO:teuthology.orchestra.run.smithi019.stdout:(83/157): python3-mako-1.1.4-6.el9.noarch.rpm 299 kB/s | 172 kB 00:00 2024-09-10T22:13:53.138 INFO:teuthology.orchestra.run.smithi019.stdout:(84/157): python3-numpy-f2py-1.20.1-5.el9.x86_6 442 kB/s | 250 kB 00:00 2024-09-10T22:13:53.347 INFO:teuthology.orchestra.run.smithi019.stdout:(85/157): python3-oauthlib-3.1.1-5.el9.noarch.r 452 kB/s | 222 kB 00:00 2024-09-10T22:13:53.480 INFO:teuthology.orchestra.run.smithi019.stdout:(86/157): python3-packaging-20.9-5.el9.noarch.r 226 kB/s | 77 kB 00:00 2024-09-10T22:13:53.680 INFO:teuthology.orchestra.run.smithi019.stdout:(87/157): python3-prettytable-0.7.2-27.el9.noar 127 kB/s | 42 kB 00:00 2024-09-10T22:13:53.972 INFO:teuthology.orchestra.run.smithi019.stdout:(88/157): python3-protobuf-3.14.0-13.el9.noarch 547 kB/s | 269 kB 00:00 2024-09-10T22:13:54.189 INFO:teuthology.orchestra.run.smithi019.stdout:(89/157): python3-pyasn1-0.4.8-6.el9.noarch.rpm 312 kB/s | 159 kB 00:00 2024-09-10T22:13:54.398 INFO:teuthology.orchestra.run.smithi019.stdout:(90/157): python3-numpy-1.20.1-5.el9.x86_64.rpm 2.7 MB/s | 5.1 MB 00:01 2024-09-10T22:13:54.498 INFO:teuthology.orchestra.run.smithi019.stdout:(91/157): python3-pyasn1-modules-0.4.8-6.el9.no 530 kB/s | 279 kB 00:00 2024-09-10T22:13:54.540 INFO:teuthology.orchestra.run.smithi019.stdout:(92/157): python3-pytz-2021.1-5.el9.noarch.rpm 145 kB/s | 51 kB 00:00 2024-09-10T22:13:54.765 INFO:teuthology.orchestra.run.smithi019.stdout:(93/157): python3-requests-oauthlib-1.3.0-12.el 146 kB/s | 54 kB 00:00 2024-09-10T22:13:54.807 INFO:teuthology.orchestra.run.smithi019.stdout:(94/157): python3-toml-0.10.2-6.el9.noarch.rpm 156 kB/s | 42 kB 00:00 2024-09-10T22:13:55.108 INFO:teuthology.orchestra.run.smithi019.stdout:(95/157): python3-wcwidth-0.2.5-8.el9.noarch.rp 129 kB/s | 44 kB 00:00 2024-09-10T22:13:55.308 INFO:teuthology.orchestra.run.smithi019.stdout:(96/157): qatlib-24.02.0-1.el9.x86_64.rpm 441 kB/s | 221 kB 00:00 2024-09-10T22:13:55.366 INFO:teuthology.orchestra.run.smithi019.stdout:(97/157): qatlib-service-24.02.0-1.el9.x86_64.r 139 kB/s | 36 kB 00:00 2024-09-10T22:13:55.650 INFO:teuthology.orchestra.run.smithi019.stdout:(98/157): qatzip-libs-1.2.0-1.el9.x86_64.rpm 139 kB/s | 47 kB 00:00 2024-09-10T22:13:55.942 INFO:teuthology.orchestra.run.smithi138.stdout: Preparing : 1/1 2024-09-10T22:13:55.950 INFO:teuthology.orchestra.run.smithi019.stdout:(99/157): socat-1.7.4.1-6.el9.x86_64.rpm 521 kB/s | 304 kB 00:00 2024-09-10T22:13:55.992 INFO:teuthology.orchestra.run.smithi019.stdout:(100/157): uuid-1.6.2-55.el9.x86_64.rpm 169 kB/s | 58 kB 00:00 2024-09-10T22:13:56.025 INFO:teuthology.orchestra.run.smithi138.stdout: Upgrading : openssl-libs-1:3.2.2-6.el9.x86_64 1/165 2024-09-10T22:13:56.063 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/165 2024-09-10T22:13:56.117 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/165 2024-09-10T22:13:56.151 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/165 2024-09-10T22:13:56.176 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/165 2024-09-10T22:13:56.219 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/165 2024-09-10T22:13:56.334 INFO:teuthology.orchestra.run.smithi019.stdout:(101/157): xmlstarlet-1.6.1-20.el9.x86_64.rpm 186 kB/s | 64 kB 00:00 2024-09-10T22:13:56.376 INFO:teuthology.orchestra.run.smithi019.stdout:(102/157): xfsprogs-devel-6.4.0-4.el9.x86_64.rp 225 kB/s | 96 kB 00:00 2024-09-10T22:13:56.636 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/165 2024-09-10T22:13:56.719 INFO:teuthology.orchestra.run.smithi019.stdout:(103/157): python3-scipy-1.6.2-8.el9.x86_64.rpm 7.3 MB/s | 16 MB 00:02 2024-09-10T22:13:56.744 INFO:teuthology.orchestra.run.smithi138.stdout: Upgrading : librados2-2:19.3.0-4854.g8f219c47.el9.x86_64 8/165 2024-09-10T22:13:56.781 INFO:teuthology.orchestra.run.smithi019.stdout:(104/157): lua-devel-5.4.4-4.el9.x86_64.rpm 55 kB/s | 22 kB 00:00 2024-09-10T22:13:56.802 INFO:teuthology.orchestra.run.smithi019.stdout:(105/157): zlib-devel-1.2.11-41.el9.x86_64.rpm 96 kB/s | 45 kB 00:00 2024-09-10T22:13:56.851 INFO:teuthology.orchestra.run.smithi138.stdout: Running scriptlet: librados2-2:19.3.0-4854.g8f219c47.el9.x86_64 8/165 2024-09-10T22:13:56.879 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : libcephfs2-2:19.3.0-4854.g8f219c47.el9.x86_64 9/165 2024-09-10T22:13:56.886 INFO:teuthology.orchestra.run.smithi019.stdout:(106/157): gperftools-libs-2.9.1-2.el9.x86_64.r 3.6 MB/s | 309 kB 00:00 2024-09-10T22:13:56.911 INFO:teuthology.orchestra.run.smithi019.stdout:(107/157): grpc-data-1.46.7-10.el9.noarch.rpm 783 kB/s | 19 kB 00:00 2024-09-10T22:13:56.945 INFO:teuthology.orchestra.run.smithi019.stdout:(108/157): abseil-cpp-20211102.0-3.el9.x86_64.r 3.3 MB/s | 548 kB 00:00 2024-09-10T22:13:56.970 INFO:teuthology.orchestra.run.smithi019.stdout:(109/157): libarrow-doc-9.0.0-11.el9.noarch.rpm 1.0 MB/s | 26 kB 00:00 2024-09-10T22:13:56.971 INFO:teuthology.orchestra.run.smithi138.stdout: Running scriptlet: libcephfs2-2:19.3.0-4854.g8f219c47.el9.x86_64 9/165 2024-09-10T22:13:56.995 INFO:teuthology.orchestra.run.smithi019.stdout:(110/157): liboath-2.6.7-2.el9.x86_64.rpm 1.9 MB/s | 49 kB 00:00 2024-09-10T22:13:57.001 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : python3-rados-2:19.3.0-4854.g8f219c47.el9.x86_64 10/165 2024-09-10T22:13:57.029 INFO:teuthology.orchestra.run.smithi019.stdout:(111/157): libunwind-1.6.2-1.el9.x86_64.rpm 2.0 MB/s | 67 kB 00:00 2024-09-10T22:13:57.030 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : postgresql-private-libs-13.16-1.el9.x86_64 11/165 2024-09-10T22:13:57.071 INFO:teuthology.orchestra.run.smithi019.stdout:(112/157): luarocks-3.9.2-5.el9.noarch.rpm 3.5 MB/s | 151 kB 00:00 2024-09-10T22:13:57.172 INFO:teuthology.orchestra.run.smithi019.stdout:(113/157): parquet-libs-9.0.0-11.el9.x86_64.rpm 8.2 MB/s | 839 kB 00:00 2024-09-10T22:13:57.183 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : libnbd-1.20.2-2.el9.x86_64 12/165 2024-09-10T22:13:57.241 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : postgresql-13.16-1.el9.x86_64 13/165 2024-09-10T22:13:57.255 INFO:teuthology.orchestra.run.smithi019.stdout:(114/157): python3-asyncssh-2.13.2-5.el9.noarch 6.4 MB/s | 548 kB 00:00 2024-09-10T22:13:57.269 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : libcephsqlite-2:19.3.0-4854.g8f219c47.el9.x86_64 14/165 2024-09-10T22:13:57.289 INFO:teuthology.orchestra.run.smithi019.stdout:(115/157): python3-bcrypt-3.2.2-1.el9.x86_64.rp 1.3 MB/s | 43 kB 00:00 2024-09-10T22:13:57.314 INFO:teuthology.orchestra.run.smithi019.stdout:(116/157): python3-cachetools-4.2.4-1.el9.noarc 1.3 MB/s | 32 kB 00:00 2024-09-10T22:13:57.339 INFO:teuthology.orchestra.run.smithi019.stdout:(117/157): python3-certifi-2023.05.07-4.el9.noa 565 kB/s | 14 kB 00:00 2024-09-10T22:13:57.357 INFO:teuthology.orchestra.run.smithi138.stdout: Running scriptlet: libcephsqlite-2:19.3.0-4854.g8f219c47.el9.x86_64 14/165 2024-09-10T22:13:57.364 INFO:teuthology.orchestra.run.smithi019.stdout:(118/157): protobuf-compiler-3.14.0-13.el9.x86_ 1.3 MB/s | 863 kB 00:00 2024-09-10T22:13:57.387 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : libradosstriper1-2:19.3.0-4854.g8f219c47.el9.x86 15/165 2024-09-10T22:13:57.398 INFO:teuthology.orchestra.run.smithi019.stdout:(119/157): python3-cheroot-8.6.0-4.el9.noarch.r 2.9 MB/s | 172 kB 00:00 2024-09-10T22:13:57.433 INFO:teuthology.orchestra.run.smithi138.stdout: Running scriptlet: libradosstriper1-2:19.3.0-4854.g8f219c47.el9.x86 15/165 2024-09-10T22:13:57.455 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 16/165 2024-09-10T22:13:57.456 INFO:teuthology.orchestra.run.smithi019.stdout:(120/157): python3-cmd2-2.4.2-2.el9.noarch.rpm 5.3 MB/s | 303 kB 00:00 2024-09-10T22:13:57.478 INFO:teuthology.orchestra.run.smithi138.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 16/165 2024-09-10T22:13:57.490 INFO:teuthology.orchestra.run.smithi019.stdout:(121/157): python3-cherrypy-18.6.1-2.el9.noarch 2.8 MB/s | 358 kB 00:00 2024-09-10T22:13:57.557 INFO:teuthology.orchestra.run.smithi019.stdout:(122/157): libarrow-9.0.0-11.el9.x86_64.rpm 6.8 MB/s | 4.4 MB 00:00 2024-09-10T22:13:57.582 INFO:teuthology.orchestra.run.smithi019.stdout:(123/157): python3-google-auth-2.34.0-1.el9.noa 1.7 MB/s | 220 kB 00:00 2024-09-10T22:13:57.608 INFO:teuthology.orchestra.run.smithi019.stdout:(124/157): python3-grpcio-tools-1.46.7-10.el9.x 2.8 MB/s | 144 kB 00:00 2024-09-10T22:13:57.616 INFO:teuthology.orchestra.run.smithi135.stdout: Preparing : 1/1 2024-09-10T22:13:57.633 INFO:teuthology.orchestra.run.smithi019.stdout:(125/157): python3-jaraco-8.2.1-3.el9.noarch.rp 212 kB/s | 11 kB 00:00 2024-09-10T22:13:57.658 INFO:teuthology.orchestra.run.smithi019.stdout:(126/157): python3-jaraco-classes-3.2.1-5.el9.n 353 kB/s | 18 kB 00:00 2024-09-10T22:13:57.675 INFO:teuthology.orchestra.run.smithi138.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 17/165 2024-09-10T22:13:57.692 INFO:teuthology.orchestra.run.smithi019.stdout:(127/157): python3-jaraco-collections-3.0.0-8.e 395 kB/s | 23 kB 00:00 2024-09-10T22:13:57.717 INFO:teuthology.orchestra.run.smithi019.stdout:(128/157): python3-jaraco-functools-3.5.0-2.el9 332 kB/s | 19 kB 00:00 2024-09-10T22:13:57.736 INFO:teuthology.orchestra.run.smithi135.stdout: Upgrading : openssl-libs-1:3.2.2-6.el9.x86_64 1/165 2024-09-10T22:13:57.743 INFO:teuthology.orchestra.run.smithi019.stdout:(129/157): python3-jaraco-text-3.2.0-6.el9.noar 390 kB/s | 20 kB 00:00 2024-09-10T22:13:57.777 INFO:teuthology.orchestra.run.smithi019.stdout:(130/157): python3-logutils-0.3.5-21.el9.noarch 1.4 MB/s | 46 kB 00:00 2024-09-10T22:13:57.783 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/165 2024-09-10T22:13:57.801 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 17/165 2024-09-10T22:13:57.810 INFO:teuthology.orchestra.run.smithi019.stdout:(131/157): python3-more-itertools-8.12.0-2.el9. 2.3 MB/s | 79 kB 00:00 2024-09-10T22:13:57.845 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/165 2024-09-10T22:13:57.852 INFO:teuthology.orchestra.run.smithi019.stdout:(132/157): python3-kubernetes-26.1.0-2.el9.noar 7.6 MB/s | 1.0 MB 00:00 2024-09-10T22:13:57.877 INFO:teuthology.orchestra.run.smithi019.stdout:(133/157): python3-natsort-7.1.1-5.el9.noarch.r 865 kB/s | 58 kB 00:00 2024-09-10T22:13:57.878 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/165 2024-09-10T22:13:57.903 INFO:teuthology.orchestra.run.smithi019.stdout:(134/157): python3-portend-3.1.0-2.el9.noarch.r 656 kB/s | 16 kB 00:00 2024-09-10T22:13:57.912 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/165 2024-09-10T22:13:57.928 INFO:teuthology.orchestra.run.smithi019.stdout:(135/157): python3-pyOpenSSL-21.0.0-1.el9.noarc 3.5 MB/s | 90 kB 00:00 2024-09-10T22:13:57.929 INFO:teuthology.orchestra.run.smithi138.stdout: Upgrading : NetworkManager-libnm-1:1.49.90-1.el9.x86_64 18/165 2024-09-10T22:13:57.953 INFO:teuthology.orchestra.run.smithi019.stdout:(136/157): python3-pecan-1.4.2-3.el9.noarch.rpm 2.6 MB/s | 272 kB 00:00 2024-09-10T22:13:57.963 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/165 2024-09-10T22:13:57.980 INFO:teuthology.orchestra.run.smithi019.stdout:(137/157): python3-pyperclip-1.8.2-2.el9.noarch 563 kB/s | 28 kB 00:00 2024-09-10T22:13:58.004 INFO:teuthology.orchestra.run.smithi019.stdout:(138/157): python3-repoze-lru-0.7-16.el9.noarch 615 kB/s | 31 kB 00:00 2024-09-10T22:13:58.029 INFO:teuthology.orchestra.run.smithi019.stdout:(139/157): python3-rsa-4.9-2.el9.noarch.rpm 2.3 MB/s | 59 kB 00:00 2024-09-10T22:13:58.049 INFO:teuthology.orchestra.run.smithi138.stdout: Running scriptlet: NetworkManager-1:1.49.90-1.el9.x86_64 19/165 2024-09-10T22:13:58.054 INFO:teuthology.orchestra.run.smithi019.stdout:(140/157): python3-tempora-5.0.0-2.el9.noarch.r 1.4 MB/s | 36 kB 00:00 2024-09-10T22:13:58.080 INFO:teuthology.orchestra.run.smithi019.stdout:(141/157): python3-routes-2.5.1-5.el9.noarch.rp 1.8 MB/s | 188 kB 00:00 2024-09-10T22:13:58.130 INFO:teuthology.orchestra.run.smithi019.stdout:(142/157): python3-grpcio-1.46.7-10.el9.x86_64. 3.2 MB/s | 2.0 MB 00:00 2024-09-10T22:13:58.140 INFO:teuthology.orchestra.run.smithi138.stdout: Upgrading : NetworkManager-1:1.49.90-1.el9.x86_64 19/165 2024-09-10T22:13:58.155 INFO:teuthology.orchestra.run.smithi019.stdout:(143/157): python3-typing-extensions-4.12.2-2.e 740 kB/s | 74 kB 00:00 2024-09-10T22:13:58.180 INFO:teuthology.orchestra.run.smithi019.stdout:(144/157): python3-websocket-client-1.2.3-2.el9 1.7 MB/s | 90 kB 00:00 2024-09-10T22:13:58.206 INFO:teuthology.orchestra.run.smithi019.stdout:(145/157): python3-zc-lockfile-2.0-10.el9.noarc 807 kB/s | 20 kB 00:00 2024-09-10T22:13:58.231 INFO:teuthology.orchestra.run.smithi019.stdout:(146/157): python3-webob-1.8.8-2.el9.noarch.rpm 1.5 MB/s | 230 kB 00:00 2024-09-10T22:13:58.256 INFO:teuthology.orchestra.run.smithi019.stdout:(147/157): re2-20211101-20.el9.x86_64.rpm 3.7 MB/s | 191 kB 00:00 2024-09-10T22:13:58.282 INFO:teuthology.orchestra.run.smithi019.stdout:(148/157): python3-werkzeug-2.0.3-3.el9.1.noarc 3.3 MB/s | 427 kB 00:00 2024-09-10T22:13:58.290 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/165 2024-09-10T22:13:58.349 INFO:teuthology.orchestra.run.smithi019.stdout:(149/157): thrift-0.15.0-2.el9.x86_64.rpm 14 MB/s | 1.6 MB 00:00 2024-09-10T22:13:58.382 INFO:teuthology.orchestra.run.smithi138.stdout: Running scriptlet: NetworkManager-1:1.49.90-1.el9.x86_64 19/165 2024-09-10T22:13:58.405 INFO:teuthology.orchestra.run.smithi135.stdout: Upgrading : librados2-2:19.3.0-4854.g8f219c47.el9.x86_64 8/165 2024-09-10T22:13:58.491 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : re2-1:20211101-20.el9.x86_64 20/165 2024-09-10T22:13:58.520 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 21/165 2024-09-10T22:13:58.524 INFO:teuthology.orchestra.run.smithi019.stdout:(150/157): librados2-19.3.0-4854.g8f219c47.el9. 13 MB/s | 3.5 MB 00:00 2024-09-10T22:13:58.527 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: librados2-2:19.3.0-4854.g8f219c47.el9.x86_64 8/165 2024-09-10T22:13:58.555 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : liboath-2.6.7-2.el9.x86_64 22/165 2024-09-10T22:13:58.556 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : libcephfs2-2:19.3.0-4854.g8f219c47.el9.x86_64 9/165 2024-09-10T22:13:58.574 INFO:teuthology.orchestra.run.smithi019.stdout:(151/157): NetworkManager-1.49.90-1.el9.x86_64. 10 MB/s | 2.3 MB 00:00 2024-09-10T22:13:58.616 INFO:teuthology.orchestra.run.smithi019.stdout:(152/157): NetworkManager-team-1.49.90-1.el9.x8 982 kB/s | 41 kB 00:00 2024-09-10T22:13:58.628 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 23/165 2024-09-10T22:13:58.646 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: libcephfs2-2:19.3.0-4854.g8f219c47.el9.x86_64 9/165 2024-09-10T22:13:58.658 INFO:teuthology.orchestra.run.smithi019.stdout:(153/157): NetworkManager-tui-1.49.90-1.el9.x86 5.9 MB/s | 249 kB 00:00 2024-09-10T22:13:58.673 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 24/165 2024-09-10T22:13:58.677 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-rados-2:19.3.0-4854.g8f219c47.el9.x86_64 10/165 2024-09-10T22:13:58.706 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : postgresql-private-libs-13.16-1.el9.x86_64 11/165 2024-09-10T22:13:58.713 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : python3-packaging-20.9-5.el9.noarch 25/165 2024-09-10T22:13:58.716 INFO:teuthology.orchestra.run.smithi019.stdout:(154/157): openssl-3.2.2-6.el9.x86_64.rpm 23 MB/s | 1.4 MB 00:00 2024-09-10T22:13:58.757 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 26/165 2024-09-10T22:13:58.775 INFO:teuthology.orchestra.run.smithi019.stdout:(155/157): librbd1-19.3.0-4854.g8f219c47.el9.x8 6.6 MB/s | 3.2 MB 00:00 2024-09-10T22:13:58.789 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 27/165 2024-09-10T22:13:58.817 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : lua-5.4.4-4.el9.x86_64 28/165 2024-09-10T22:13:58.825 INFO:teuthology.orchestra.run.smithi019.stdout:(156/157): NetworkManager-libnm-1.49.90-1.el9.x 6.0 MB/s | 1.8 MB 00:00 2024-09-10T22:13:58.857 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : libnbd-1.20.2-2.el9.x86_64 12/165 2024-09-10T22:13:58.875 INFO:teuthology.orchestra.run.smithi019.stdout:(157/157): openssl-libs-3.2.2-6.el9.x86_64.rpm 15 MB/s | 2.4 MB 00:00 2024-09-10T22:13:58.882 INFO:teuthology.orchestra.run.smithi019.stdout:-------------------------------------------------------------------------------- 2024-09-10T22:13:58.882 INFO:teuthology.orchestra.run.smithi019.stdout:Total 12 MB/s | 240 MB 00:20 2024-09-10T22:13:58.887 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 29/165 2024-09-10T22:13:58.908 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : postgresql-13.16-1.el9.x86_64 13/165 2024-09-10T22:13:58.936 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : libcephsqlite-2:19.3.0-4854.g8f219c47.el9.x86_64 14/165 2024-09-10T22:13:58.940 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 30/165 2024-09-10T22:13:58.971 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 31/165 2024-09-10T22:13:59.008 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 32/165 2024-09-10T22:13:59.048 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: libcephsqlite-2:19.3.0-4854.g8f219c47.el9.x86_64 14/165 2024-09-10T22:13:59.079 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : libradosstriper1-2:19.3.0-4854.g8f219c47.el9.x86 15/165 2024-09-10T22:13:59.085 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 33/165 2024-09-10T22:13:59.117 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : python3-ceph-common-2:19.3.0-4854.g8f219c47.el9. 34/165 2024-09-10T22:13:59.141 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: libradosstriper1-2:19.3.0-4854.g8f219c47.el9.x86 15/165 2024-09-10T22:13:59.160 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : python3-ceph-argparse-2:19.3.0-4854.g8f219c47.el 35/165 2024-09-10T22:13:59.163 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 16/165 2024-09-10T22:13:59.183 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 16/165 2024-09-10T22:13:59.190 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : python3-cephfs-2:19.3.0-4854.g8f219c47.el9.x86_6 36/165 2024-09-10T22:13:59.259 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 37/165 2024-09-10T22:13:59.313 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : luarocks-3.9.2-5.el9.noarch 38/165 2024-09-10T22:13:59.382 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 17/165 2024-09-10T22:13:59.389 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 39/165 2024-09-10T22:13:59.514 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 17/165 2024-09-10T22:13:59.520 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 40/165 2024-09-10T22:13:59.574 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 41/165 2024-09-10T22:13:59.645 INFO:teuthology.orchestra.run.smithi135.stdout: Upgrading : NetworkManager-libnm-1:1.49.90-1.el9.x86_64 18/165 2024-09-10T22:13:59.746 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: NetworkManager-1:1.49.90-1.el9.x86_64 19/165 2024-09-10T22:13:59.830 INFO:teuthology.orchestra.run.smithi135.stdout: Upgrading : NetworkManager-1:1.49.90-1.el9.x86_64 19/165 2024-09-10T22:14:00.090 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: NetworkManager-1:1.49.90-1.el9.x86_64 19/165 2024-09-10T22:14:00.101 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : python3-rsa-4.9-2.el9.noarch 42/165 2024-09-10T22:14:00.124 INFO:teuthology.orchestra.run.smithi019.stdout:Running transaction check 2024-09-10T22:14:00.187 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 43/165 2024-09-10T22:14:00.205 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : re2-1:20211101-20.el9.x86_64 20/165 2024-09-10T22:14:00.221 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 44/165 2024-09-10T22:14:00.234 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 21/165 2024-09-10T22:14:00.264 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 45/165 2024-09-10T22:14:00.269 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : liboath-2.6.7-2.el9.x86_64 22/165 2024-09-10T22:14:00.295 INFO:teuthology.orchestra.run.smithi019.stdout:Transaction check succeeded. 2024-09-10T22:14:00.295 INFO:teuthology.orchestra.run.smithi019.stdout:Running transaction test 2024-09-10T22:14:00.302 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : librados-devel-2:19.3.0-4854.g8f219c47.el9.x86_6 46/165 2024-09-10T22:14:00.344 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 47/165 2024-09-10T22:14:00.351 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 23/165 2024-09-10T22:14:00.403 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 24/165 2024-09-10T22:14:00.443 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-packaging-20.9-5.el9.noarch 25/165 2024-09-10T22:14:00.496 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 26/165 2024-09-10T22:14:00.509 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 48/165 2024-09-10T22:14:00.527 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 27/165 2024-09-10T22:14:00.555 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : lua-5.4.4-4.el9.x86_64 28/165 2024-09-10T22:14:00.565 INFO:teuthology.orchestra.run.smithi138.stdout: Upgrading : openssl-1:3.2.2-6.el9.x86_64 49/165 2024-09-10T22:14:00.625 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 29/165 2024-09-10T22:14:00.657 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 50/165 2024-09-10T22:14:00.678 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 30/165 2024-09-10T22:14:00.708 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 31/165 2024-09-10T22:14:00.721 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 51/165 2024-09-10T22:14:00.744 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 32/165 2024-09-10T22:14:00.793 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 52/165 2024-09-10T22:14:00.822 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 33/165 2024-09-10T22:14:00.826 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 53/165 2024-09-10T22:14:00.863 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-ceph-common-2:19.3.0-4854.g8f219c47.el9. 34/165 2024-09-10T22:14:00.870 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 54/165 2024-09-10T22:14:00.906 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-ceph-argparse-2:19.3.0-4854.g8f219c47.el 35/165 2024-09-10T22:14:00.917 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 55/165 2024-09-10T22:14:00.935 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-cephfs-2:19.3.0-4854.g8f219c47.el9.x86_6 36/165 2024-09-10T22:14:00.953 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 56/165 2024-09-10T22:14:01.007 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 37/165 2024-09-10T22:14:01.021 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 57/165 2024-09-10T22:14:01.061 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : luarocks-3.9.2-5.el9.noarch 38/165 2024-09-10T22:14:01.071 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 58/165 2024-09-10T22:14:01.136 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 39/165 2024-09-10T22:14:01.218 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 59/165 2024-09-10T22:14:01.258 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 60/165 2024-09-10T22:14:01.267 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 40/165 2024-09-10T22:14:01.299 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 61/165 2024-09-10T22:14:01.330 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 41/165 2024-09-10T22:14:01.403 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 62/165 2024-09-10T22:14:01.442 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 63/165 2024-09-10T22:14:01.482 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 64/165 2024-09-10T22:14:01.508 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 65/165 2024-09-10T22:14:01.532 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 66/165 2024-09-10T22:14:01.607 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 67/165 2024-09-10T22:14:01.740 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 68/165 2024-09-10T22:14:01.781 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 69/165 2024-09-10T22:14:01.808 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 70/165 2024-09-10T22:14:01.859 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-rsa-4.9-2.el9.noarch 42/165 2024-09-10T22:14:01.951 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 43/165 2024-09-10T22:14:01.980 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 44/165 2024-09-10T22:14:02.011 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 71/165 2024-09-10T22:14:02.023 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 45/165 2024-09-10T22:14:02.050 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : uuid-1.6.2-55.el9.x86_64 72/165 2024-09-10T22:14:02.069 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : librados-devel-2:19.3.0-4854.g8f219c47.el9.x86_6 46/165 2024-09-10T22:14:02.090 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 73/165 2024-09-10T22:14:02.119 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 47/165 2024-09-10T22:14:02.120 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 74/165 2024-09-10T22:14:02.154 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 75/165 2024-09-10T22:14:02.187 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 76/165 2024-09-10T22:14:02.229 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 77/165 2024-09-10T22:14:02.264 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 78/165 2024-09-10T22:14:02.312 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 48/165 2024-09-10T22:14:02.352 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 79/165 2024-09-10T22:14:02.381 INFO:teuthology.orchestra.run.smithi135.stdout: Upgrading : openssl-1:3.2.2-6.el9.x86_64 49/165 2024-09-10T22:14:02.403 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 80/165 2024-09-10T22:14:02.434 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 81/165 2024-09-10T22:14:02.471 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 50/165 2024-09-10T22:14:02.536 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 51/165 2024-09-10T22:14:02.537 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 82/165 2024-09-10T22:14:02.586 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 83/165 2024-09-10T22:14:02.608 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 52/165 2024-09-10T22:14:02.649 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 53/165 2024-09-10T22:14:02.685 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 54/165 2024-09-10T22:14:02.732 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 55/165 2024-09-10T22:14:02.743 INFO:teuthology.orchestra.run.smithi019.stdout:Transaction test succeeded. 2024-09-10T22:14:02.743 INFO:teuthology.orchestra.run.smithi019.stdout:Running transaction 2024-09-10T22:14:02.768 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 56/165 2024-09-10T22:14:02.811 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 57/165 2024-09-10T22:14:02.853 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 58/165 2024-09-10T22:14:02.989 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 59/165 2024-09-10T22:14:03.039 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 60/165 2024-09-10T22:14:03.080 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 61/165 2024-09-10T22:14:03.249 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 62/165 2024-09-10T22:14:03.304 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 84/165 2024-09-10T22:14:03.351 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 85/165 2024-09-10T22:14:03.385 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 86/165 2024-09-10T22:14:03.486 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 87/165 2024-09-10T22:14:03.512 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 63/165 2024-09-10T22:14:03.548 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 88/165 2024-09-10T22:14:03.555 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 64/165 2024-09-10T22:14:03.588 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 65/165 2024-09-10T22:14:03.593 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : python3-colorama-0.4.6-3.el9.noarch 89/165 2024-09-10T22:14:03.613 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 66/165 2024-09-10T22:14:03.681 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 90/165 2024-09-10T22:14:03.693 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 67/165 2024-09-10T22:14:03.713 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 91/165 2024-09-10T22:14:03.815 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 68/165 2024-09-10T22:14:03.862 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 69/165 2024-09-10T22:14:03.889 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 70/165 2024-09-10T22:14:03.896 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : openblas-0.3.26-2.el9.x86_64 92/165 2024-09-10T22:14:03.924 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 71/165 2024-09-10T22:14:03.928 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 93/165 2024-09-10T22:14:03.963 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : uuid-1.6.2-55.el9.x86_64 72/165 2024-09-10T22:14:03.994 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 73/165 2024-09-10T22:14:04.004 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 94/165 2024-09-10T22:14:04.024 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 74/165 2024-09-10T22:14:04.059 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 75/165 2024-09-10T22:14:04.092 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 76/165 2024-09-10T22:14:04.134 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 77/165 2024-09-10T22:14:04.176 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 78/165 2024-09-10T22:14:04.271 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 79/165 2024-09-10T22:14:04.323 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 80/165 2024-09-10T22:14:04.355 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 81/165 2024-09-10T22:14:04.457 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 82/165 2024-09-10T22:14:04.506 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 83/165 2024-09-10T22:14:04.649 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 95/165 2024-09-10T22:14:04.769 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 96/165 2024-09-10T22:14:05.215 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 84/165 2024-09-10T22:14:05.263 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 85/165 2024-09-10T22:14:05.305 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 86/165 2024-09-10T22:14:05.410 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 87/165 2024-09-10T22:14:05.460 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 88/165 2024-09-10T22:14:05.538 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-colorama-0.4.6-3.el9.noarch 89/165 2024-09-10T22:14:05.619 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 90/165 2024-09-10T22:14:05.658 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 91/165 2024-09-10T22:14:05.840 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : openblas-0.3.26-2.el9.x86_64 92/165 2024-09-10T22:14:05.889 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 93/165 2024-09-10T22:14:05.974 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 94/165 2024-09-10T22:14:06.002 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 97/165 2024-09-10T22:14:06.079 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 98/165 2024-09-10T22:14:06.106 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 99/165 2024-09-10T22:14:06.140 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : libuuid-devel-2.37.4-20.el9.x86_64 100/165 2024-09-10T22:14:06.459 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 101/165 2024-09-10T22:14:06.503 INFO:teuthology.orchestra.run.smithi138.stdout: Upgrading : librbd1-2:19.3.0-4854.g8f219c47.el9.x86_64 102/165 2024-09-10T22:14:06.595 INFO:teuthology.orchestra.run.smithi138.stdout: Running scriptlet: librbd1-2:19.3.0-4854.g8f219c47.el9.x86_64 102/165 2024-09-10T22:14:06.611 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 95/165 2024-09-10T22:14:06.625 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : python3-rbd-2:19.3.0-4854.g8f219c47.el9.x86_64 103/165 2024-09-10T22:14:06.669 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 104/165 2024-09-10T22:14:06.727 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 96/165 2024-09-10T22:14:07.162 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 105/165 2024-09-10T22:14:07.190 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : librgw2-2:19.3.0-4854.g8f219c47.el9.x86_64 106/165 2024-09-10T22:14:07.244 INFO:teuthology.orchestra.run.smithi138.stdout: Running scriptlet: librgw2-2:19.3.0-4854.g8f219c47.el9.x86_64 106/165 2024-09-10T22:14:07.275 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : python3-rgw-2:19.3.0-4854.g8f219c47.el9.x86_64 107/165 2024-09-10T22:14:07.925 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 97/165 2024-09-10T22:14:08.009 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 98/165 2024-09-10T22:14:08.045 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 99/165 2024-09-10T22:14:08.078 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : libuuid-devel-2.37.4-20.el9.x86_64 100/165 2024-09-10T22:14:08.396 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 101/165 2024-09-10T22:14:08.433 INFO:teuthology.orchestra.run.smithi135.stdout: Upgrading : librbd1-2:19.3.0-4854.g8f219c47.el9.x86_64 102/165 2024-09-10T22:14:08.524 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: librbd1-2:19.3.0-4854.g8f219c47.el9.x86_64 102/165 2024-09-10T22:14:08.555 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-rbd-2:19.3.0-4854.g8f219c47.el9.x86_64 103/165 2024-09-10T22:14:08.590 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 104/165 2024-09-10T22:14:09.080 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 105/165 2024-09-10T22:14:09.102 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : librgw2-2:19.3.0-4854.g8f219c47.el9.x86_64 106/165 2024-09-10T22:14:09.174 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: librgw2-2:19.3.0-4854.g8f219c47.el9.x86_64 106/165 2024-09-10T22:14:09.204 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-rgw-2:19.3.0-4854.g8f219c47.el9.x86_64 107/165 2024-09-10T22:14:09.490 INFO:teuthology.orchestra.run.smithi019.stdout: Preparing : 1/1 2024-09-10T22:14:09.733 INFO:teuthology.orchestra.run.smithi138.stdout: Running scriptlet: ceph-common-2:19.3.0-4854.g8f219c47.el9.x86_64 108/165 2024-09-10T22:14:09.739 INFO:teuthology.orchestra.run.smithi019.stdout: Upgrading : openssl-libs-1:3.2.2-6.el9.x86_64 1/165 2024-09-10T22:14:09.773 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : ceph-common-2:19.3.0-4854.g8f219c47.el9.x86_64 108/165 2024-09-10T22:14:09.778 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/165 2024-09-10T22:14:09.840 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/165 2024-09-10T22:14:09.881 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/165 2024-09-10T22:14:09.906 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/165 2024-09-10T22:14:09.964 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/165 2024-09-10T22:14:10.319 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/165 2024-09-10T22:14:10.323 INFO:teuthology.orchestra.run.smithi138.stdout: Running scriptlet: ceph-common-2:19.3.0-4854.g8f219c47.el9.x86_64 108/165 2024-09-10T22:14:10.360 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : ceph-base-2:19.3.0-4854.g8f219c47.el9.x86_64 109/165 2024-09-10T22:14:10.432 INFO:teuthology.orchestra.run.smithi019.stdout: Upgrading : librados2-2:19.3.0-4854.g8f219c47.el9.x86_64 8/165 2024-09-10T22:14:10.436 INFO:teuthology.orchestra.run.smithi138.stdout: Running scriptlet: ceph-base-2:19.3.0-4854.g8f219c47.el9.x86_64 109/165 2024-09-10T22:14:10.436 INFO:teuthology.orchestra.run.smithi138.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-10T22:14:10.437 INFO:teuthology.orchestra.run.smithi138.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-10T22:14:10.437 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-10T22:14:10.470 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : ceph-selinux-2:19.3.0-4854.g8f219c47.el9.x86_64 110/165 2024-09-10T22:14:10.557 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: librados2-2:19.3.0-4854.g8f219c47.el9.x86_64 8/165 2024-09-10T22:14:10.591 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : libcephfs2-2:19.3.0-4854.g8f219c47.el9.x86_64 9/165 2024-09-10T22:14:10.685 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: libcephfs2-2:19.3.0-4854.g8f219c47.el9.x86_64 9/165 2024-09-10T22:14:10.715 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-rados-2:19.3.0-4854.g8f219c47.el9.x86_64 10/165 2024-09-10T22:14:10.760 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : postgresql-private-libs-13.16-1.el9.x86_64 11/165 2024-09-10T22:14:10.953 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : libnbd-1.20.2-2.el9.x86_64 12/165 2024-09-10T22:14:11.020 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : postgresql-13.16-1.el9.x86_64 13/165 2024-09-10T22:14:11.047 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : libcephsqlite-2:19.3.0-4854.g8f219c47.el9.x86_64 14/165 2024-09-10T22:14:11.154 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: libcephsqlite-2:19.3.0-4854.g8f219c47.el9.x86_64 14/165 2024-09-10T22:14:11.181 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : libradosstriper1-2:19.3.0-4854.g8f219c47.el9.x86 15/165 2024-09-10T22:14:11.244 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: libradosstriper1-2:19.3.0-4854.g8f219c47.el9.x86 15/165 2024-09-10T22:14:11.274 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 16/165 2024-09-10T22:14:11.296 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 16/165 2024-09-10T22:14:11.496 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 17/165 2024-09-10T22:14:11.680 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 17/165 2024-09-10T22:14:11.797 INFO:teuthology.orchestra.run.smithi019.stdout: Upgrading : NetworkManager-libnm-1:1.49.90-1.el9.x86_64 18/165 2024-09-10T22:14:11.864 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: ceph-common-2:19.3.0-4854.g8f219c47.el9.x86_64 108/165 2024-09-10T22:14:11.900 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : ceph-common-2:19.3.0-4854.g8f219c47.el9.x86_64 108/165 2024-09-10T22:14:11.908 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: NetworkManager-1:1.49.90-1.el9.x86_64 19/165 2024-09-10T22:14:11.999 INFO:teuthology.orchestra.run.smithi019.stdout: Upgrading : NetworkManager-1:1.49.90-1.el9.x86_64 19/165 2024-09-10T22:14:12.250 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: NetworkManager-1:1.49.90-1.el9.x86_64 19/165 2024-09-10T22:14:12.367 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : re2-1:20211101-20.el9.x86_64 20/165 2024-09-10T22:14:12.403 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 21/165 2024-09-10T22:14:12.438 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : liboath-2.6.7-2.el9.x86_64 22/165 2024-09-10T22:14:12.455 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: ceph-common-2:19.3.0-4854.g8f219c47.el9.x86_64 108/165 2024-09-10T22:14:12.487 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : ceph-base-2:19.3.0-4854.g8f219c47.el9.x86_64 109/165 2024-09-10T22:14:12.521 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 23/165 2024-09-10T22:14:12.581 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 24/165 2024-09-10T22:14:12.589 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: ceph-base-2:19.3.0-4854.g8f219c47.el9.x86_64 109/165 2024-09-10T22:14:12.589 INFO:teuthology.orchestra.run.smithi135.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-10T22:14:12.589 INFO:teuthology.orchestra.run.smithi135.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-10T22:14:12.589 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-09-10T22:14:12.621 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-packaging-20.9-5.el9.noarch 25/165 2024-09-10T22:14:12.630 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : ceph-selinux-2:19.3.0-4854.g8f219c47.el9.x86_64 110/165 2024-09-10T22:14:12.665 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 26/165 2024-09-10T22:14:12.697 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 27/165 2024-09-10T22:14:12.728 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : lua-5.4.4-4.el9.x86_64 28/165 2024-09-10T22:14:12.795 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 29/165 2024-09-10T22:14:12.856 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 30/165 2024-09-10T22:14:12.886 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 31/165 2024-09-10T22:14:12.930 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 32/165 2024-09-10T22:14:13.009 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 33/165 2024-09-10T22:14:13.041 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-ceph-common-2:19.3.0-4854.g8f219c47.el9. 34/165 2024-09-10T22:14:13.084 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-ceph-argparse-2:19.3.0-4854.g8f219c47.el 35/165 2024-09-10T22:14:13.113 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-cephfs-2:19.3.0-4854.g8f219c47.el9.x86_6 36/165 2024-09-10T22:14:13.185 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 37/165 2024-09-10T22:14:13.236 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : luarocks-3.9.2-5.el9.noarch 38/165 2024-09-10T22:14:13.344 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 39/165 2024-09-10T22:14:13.490 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 40/165 2024-09-10T22:14:13.556 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 41/165 2024-09-10T22:14:14.107 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-rsa-4.9-2.el9.noarch 42/165 2024-09-10T22:14:14.194 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 43/165 2024-09-10T22:14:14.229 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 44/165 2024-09-10T22:14:14.273 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 45/165 2024-09-10T22:14:14.310 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : librados-devel-2:19.3.0-4854.g8f219c47.el9.x86_6 46/165 2024-09-10T22:14:14.368 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 47/165 2024-09-10T22:14:14.526 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 48/165 2024-09-10T22:14:14.572 INFO:teuthology.orchestra.run.smithi019.stdout: Upgrading : openssl-1:3.2.2-6.el9.x86_64 49/165 2024-09-10T22:14:14.666 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 50/165 2024-09-10T22:14:14.728 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 51/165 2024-09-10T22:14:14.803 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 52/165 2024-09-10T22:14:14.840 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 53/165 2024-09-10T22:14:14.876 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 54/165 2024-09-10T22:14:14.924 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 55/165 2024-09-10T22:14:14.959 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 56/165 2024-09-10T22:14:14.994 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 57/165 2024-09-10T22:14:15.036 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 58/165 2024-09-10T22:14:15.179 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 59/165 2024-09-10T22:14:15.304 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 60/165 2024-09-10T22:14:15.346 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 61/165 2024-09-10T22:14:15.453 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 62/165 2024-09-10T22:14:15.488 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 63/165 2024-09-10T22:14:15.528 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 64/165 2024-09-10T22:14:15.561 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 65/165 2024-09-10T22:14:15.585 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 66/165 2024-09-10T22:14:15.686 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 67/165 2024-09-10T22:14:15.817 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 68/165 2024-09-10T22:14:15.851 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 69/165 2024-09-10T22:14:15.879 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 70/165 2024-09-10T22:14:15.920 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 71/165 2024-09-10T22:14:15.961 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : uuid-1.6.2-55.el9.x86_64 72/165 2024-09-10T22:14:16.001 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 73/165 2024-09-10T22:14:16.030 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 74/165 2024-09-10T22:14:16.065 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 75/165 2024-09-10T22:14:16.098 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 76/165 2024-09-10T22:14:16.140 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 77/165 2024-09-10T22:14:16.175 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 78/165 2024-09-10T22:14:16.265 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 79/165 2024-09-10T22:14:16.313 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 80/165 2024-09-10T22:14:16.345 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 81/165 2024-09-10T22:14:16.455 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 82/165 2024-09-10T22:14:16.508 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 83/165 2024-09-10T22:14:17.266 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 84/165 2024-09-10T22:14:17.312 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 85/165 2024-09-10T22:14:17.346 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 86/165 2024-09-10T22:14:17.448 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 87/165 2024-09-10T22:14:17.493 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 88/165 2024-09-10T22:14:17.538 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-colorama-0.4.6-3.el9.noarch 89/165 2024-09-10T22:14:17.629 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 90/165 2024-09-10T22:14:17.665 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 91/165 2024-09-10T22:14:17.848 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : openblas-0.3.26-2.el9.x86_64 92/165 2024-09-10T22:14:17.887 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 93/165 2024-09-10T22:14:17.967 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 94/165 2024-09-10T22:14:18.654 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 95/165 2024-09-10T22:14:18.781 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 96/165 2024-09-10T22:14:20.101 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 97/165 2024-09-10T22:14:20.177 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 98/165 2024-09-10T22:14:20.213 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 99/165 2024-09-10T22:14:20.246 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : libuuid-devel-2.37.4-20.el9.x86_64 100/165 2024-09-10T22:14:20.585 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 101/165 2024-09-10T22:14:20.626 INFO:teuthology.orchestra.run.smithi019.stdout: Upgrading : librbd1-2:19.3.0-4854.g8f219c47.el9.x86_64 102/165 2024-09-10T22:14:20.718 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: librbd1-2:19.3.0-4854.g8f219c47.el9.x86_64 102/165 2024-09-10T22:14:20.747 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-rbd-2:19.3.0-4854.g8f219c47.el9.x86_64 103/165 2024-09-10T22:14:20.784 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 104/165 2024-09-10T22:14:21.315 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 105/165 2024-09-10T22:14:21.345 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : librgw2-2:19.3.0-4854.g8f219c47.el9.x86_64 106/165 2024-09-10T22:14:21.400 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: librgw2-2:19.3.0-4854.g8f219c47.el9.x86_64 106/165 2024-09-10T22:14:21.430 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-rgw-2:19.3.0-4854.g8f219c47.el9.x86_64 107/165 2024-09-10T22:14:22.514 INFO:teuthology.orchestra.run.smithi138.stdout: Running scriptlet: ceph-selinux-2:19.3.0-4854.g8f219c47.el9.x86_64 110/165 2024-09-10T22:14:22.514 INFO:teuthology.orchestra.run.smithi138.stdout:skipping the directory /sys 2024-09-10T22:14:22.515 INFO:teuthology.orchestra.run.smithi138.stdout:skipping the directory /proc 2024-09-10T22:14:22.515 INFO:teuthology.orchestra.run.smithi138.stdout:skipping the directory /mnt 2024-09-10T22:14:22.515 INFO:teuthology.orchestra.run.smithi138.stdout:skipping the directory /var/tmp 2024-09-10T22:14:22.515 INFO:teuthology.orchestra.run.smithi138.stdout:skipping the directory /home 2024-09-10T22:14:22.515 INFO:teuthology.orchestra.run.smithi138.stdout:skipping the directory /root 2024-09-10T22:14:22.515 INFO:teuthology.orchestra.run.smithi138.stdout:skipping the directory /tmp 2024-09-10T22:14:22.515 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-10T22:14:22.701 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : ceph-volume-2:19.3.0-4854.g8f219c47.el9.noarch 111/165 2024-09-10T22:14:22.716 INFO:teuthology.orchestra.run.smithi138.stdout: Running scriptlet: ceph-volume-2:19.3.0-4854.g8f219c47.el9.noarch 111/165 2024-09-10T22:14:22.716 INFO:teuthology.orchestra.run.smithi138.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T22:14:22.717 INFO:teuthology.orchestra.run.smithi138.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-10T22:14:22.717 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-10T22:14:23.893 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: ceph-common-2:19.3.0-4854.g8f219c47.el9.x86_64 108/165 2024-09-10T22:14:23.927 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : ceph-common-2:19.3.0-4854.g8f219c47.el9.x86_64 108/165 2024-09-10T22:14:24.213 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : ceph-osd-2:19.3.0-4854.g8f219c47.el9.x86_64 112/165 2024-09-10T22:14:24.239 INFO:teuthology.orchestra.run.smithi138.stdout: Running scriptlet: ceph-osd-2:19.3.0-4854.g8f219c47.el9.x86_64 112/165 2024-09-10T22:14:24.240 INFO:teuthology.orchestra.run.smithi138.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T22:14:24.240 INFO:teuthology.orchestra.run.smithi138.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-10T22:14:24.240 INFO:teuthology.orchestra.run.smithi138.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-10T22:14:24.240 INFO:teuthology.orchestra.run.smithi138.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-10T22:14:24.240 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-10T22:14:24.472 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : ceph-mds-2:19.3.0-4854.g8f219c47.el9.x86_64 113/165 2024-09-10T22:14:24.496 INFO:teuthology.orchestra.run.smithi138.stdout: Running scriptlet: ceph-mds-2:19.3.0-4854.g8f219c47.el9.x86_64 113/165 2024-09-10T22:14:24.496 INFO:teuthology.orchestra.run.smithi138.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T22:14:24.496 INFO:teuthology.orchestra.run.smithi138.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-10T22:14:24.496 INFO:teuthology.orchestra.run.smithi138.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-10T22:14:24.496 INFO:teuthology.orchestra.run.smithi138.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-10T22:14:24.496 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-10T22:14:24.515 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: ceph-common-2:19.3.0-4854.g8f219c47.el9.x86_64 108/165 2024-09-10T22:14:24.555 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : ceph-base-2:19.3.0-4854.g8f219c47.el9.x86_64 109/165 2024-09-10T22:14:24.639 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: ceph-base-2:19.3.0-4854.g8f219c47.el9.x86_64 109/165 2024-09-10T22:14:24.639 INFO:teuthology.orchestra.run.smithi019.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-10T22:14:24.639 INFO:teuthology.orchestra.run.smithi019.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-10T22:14:24.639 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-10T22:14:24.690 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : ceph-selinux-2:19.3.0-4854.g8f219c47.el9.x86_64 110/165 2024-09-10T22:14:24.742 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: ceph-selinux-2:19.3.0-4854.g8f219c47.el9.x86_64 110/165 2024-09-10T22:14:24.742 INFO:teuthology.orchestra.run.smithi135.stdout:skipping the directory /sys 2024-09-10T22:14:24.742 INFO:teuthology.orchestra.run.smithi135.stdout:skipping the directory /proc 2024-09-10T22:14:24.742 INFO:teuthology.orchestra.run.smithi135.stdout:skipping the directory /mnt 2024-09-10T22:14:24.743 INFO:teuthology.orchestra.run.smithi135.stdout:skipping the directory /var/tmp 2024-09-10T22:14:24.743 INFO:teuthology.orchestra.run.smithi135.stdout:skipping the directory /home 2024-09-10T22:14:24.743 INFO:teuthology.orchestra.run.smithi135.stdout:skipping the directory /root 2024-09-10T22:14:24.743 INFO:teuthology.orchestra.run.smithi135.stdout:skipping the directory /tmp 2024-09-10T22:14:24.743 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-09-10T22:14:24.916 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : ceph-volume-2:19.3.0-4854.g8f219c47.el9.noarch 111/165 2024-09-10T22:14:24.933 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: ceph-volume-2:19.3.0-4854.g8f219c47.el9.noarch 111/165 2024-09-10T22:14:24.933 INFO:teuthology.orchestra.run.smithi135.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T22:14:24.933 INFO:teuthology.orchestra.run.smithi135.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-10T22:14:24.933 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-09-10T22:14:24.948 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : ceph-mon-2:19.3.0-4854.g8f219c47.el9.x86_64 114/165 2024-09-10T22:14:24.972 INFO:teuthology.orchestra.run.smithi138.stdout: Running scriptlet: ceph-mon-2:19.3.0-4854.g8f219c47.el9.x86_64 114/165 2024-09-10T22:14:24.972 INFO:teuthology.orchestra.run.smithi138.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T22:14:24.972 INFO:teuthology.orchestra.run.smithi138.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-10T22:14:24.972 INFO:teuthology.orchestra.run.smithi138.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-10T22:14:24.972 INFO:teuthology.orchestra.run.smithi138.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-10T22:14:24.972 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-10T22:14:25.078 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : automake-1.16.2-8.el9.noarch 115/165 2024-09-10T22:14:25.127 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : python3-ply-3.11-14.el9.noarch 116/165 2024-09-10T22:14:25.182 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 117/165 2024-09-10T22:14:25.367 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 118/165 2024-09-10T22:14:25.425 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 119/165 2024-09-10T22:14:25.495 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 120/165 2024-09-10T22:14:25.583 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 121/165 2024-09-10T22:14:25.723 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 122/165 2024-09-10T22:14:25.759 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 123/165 2024-09-10T22:14:25.799 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 124/165 2024-09-10T22:14:25.827 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : fuse-2.9.9-16.el9.x86_64 125/165 2024-09-10T22:14:26.259 INFO:teuthology.orchestra.run.smithi138.stdout: Running scriptlet: cephadm-2:19.3.0-4854.g8f219c47.el9.noarch 126/165 2024-09-10T22:14:26.285 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : cephadm-2:19.3.0-4854.g8f219c47.el9.noarch 126/165 2024-09-10T22:14:26.318 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : ceph-prometheus-alerts-2:19.3.0-4854.g8f219c47.e 127/165 2024-09-10T22:14:26.384 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : ceph-grafana-dashboards-2:19.3.0-4854.g8f219c47. 128/165 2024-09-10T22:14:26.409 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : ceph-mgr-cephadm-2:19.3.0-4854.g8f219c47.el9.noa 129/165 2024-09-10T22:14:26.419 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : ceph-osd-2:19.3.0-4854.g8f219c47.el9.x86_64 112/165 2024-09-10T22:14:26.445 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: ceph-osd-2:19.3.0-4854.g8f219c47.el9.x86_64 112/165 2024-09-10T22:14:26.446 INFO:teuthology.orchestra.run.smithi135.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T22:14:26.446 INFO:teuthology.orchestra.run.smithi135.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-10T22:14:26.446 INFO:teuthology.orchestra.run.smithi135.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-10T22:14:26.446 INFO:teuthology.orchestra.run.smithi135.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-10T22:14:26.446 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-09-10T22:14:26.669 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : ceph-mds-2:19.3.0-4854.g8f219c47.el9.x86_64 113/165 2024-09-10T22:14:26.693 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: ceph-mds-2:19.3.0-4854.g8f219c47.el9.x86_64 113/165 2024-09-10T22:14:26.693 INFO:teuthology.orchestra.run.smithi135.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T22:14:26.693 INFO:teuthology.orchestra.run.smithi135.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-10T22:14:26.693 INFO:teuthology.orchestra.run.smithi135.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-10T22:14:26.693 INFO:teuthology.orchestra.run.smithi135.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-10T22:14:26.693 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-09-10T22:14:27.145 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : ceph-mon-2:19.3.0-4854.g8f219c47.el9.x86_64 114/165 2024-09-10T22:14:27.169 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: ceph-mon-2:19.3.0-4854.g8f219c47.el9.x86_64 114/165 2024-09-10T22:14:27.169 INFO:teuthology.orchestra.run.smithi135.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T22:14:27.169 INFO:teuthology.orchestra.run.smithi135.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-10T22:14:27.169 INFO:teuthology.orchestra.run.smithi135.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-10T22:14:27.169 INFO:teuthology.orchestra.run.smithi135.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-10T22:14:27.169 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-09-10T22:14:27.283 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : automake-1.16.2-8.el9.noarch 115/165 2024-09-10T22:14:27.332 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-ply-3.11-14.el9.noarch 116/165 2024-09-10T22:14:27.387 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 117/165 2024-09-10T22:14:27.570 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 118/165 2024-09-10T22:14:27.621 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 119/165 2024-09-10T22:14:27.706 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 120/165 2024-09-10T22:14:27.803 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 121/165 2024-09-10T22:14:27.941 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 122/165 2024-09-10T22:14:27.979 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 123/165 2024-09-10T22:14:28.012 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 124/165 2024-09-10T22:14:28.039 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : fuse-2.9.9-16.el9.x86_64 125/165 2024-09-10T22:14:28.437 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: cephadm-2:19.3.0-4854.g8f219c47.el9.noarch 126/165 2024-09-10T22:14:28.463 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : cephadm-2:19.3.0-4854.g8f219c47.el9.noarch 126/165 2024-09-10T22:14:28.495 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : ceph-prometheus-alerts-2:19.3.0-4854.g8f219c47.e 127/165 2024-09-10T22:14:28.570 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : ceph-grafana-dashboards-2:19.3.0-4854.g8f219c47. 128/165 2024-09-10T22:14:28.603 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : ceph-mgr-cephadm-2:19.3.0-4854.g8f219c47.el9.noa 129/165 2024-09-10T22:14:29.595 INFO:teuthology.orchestra.run.smithi138.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.3.0-4854.g8f219c47.el9.noa 129/165 2024-09-10T22:14:29.650 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : ceph-mgr-dashboard-2:19.3.0-4854.g8f219c47.el9.n 130/165 2024-09-10T22:14:30.614 INFO:teuthology.orchestra.run.smithi138.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.3.0-4854.g8f219c47.el9.n 130/165 2024-09-10T22:14:30.642 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : ceph-mgr-diskprediction-local-2:19.3.0-4854.g8f2 131/165 2024-09-10T22:14:30.756 INFO:teuthology.orchestra.run.smithi138.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.3.0-4854.g8f2 131/165 2024-09-10T22:14:30.913 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : ceph-mgr-modules-core-2:19.3.0-4854.g8f219c47.el 132/165 2024-09-10T22:14:30.944 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : ceph-mgr-2:19.3.0-4854.g8f219c47.el9.x86_64 133/165 2024-09-10T22:14:30.968 INFO:teuthology.orchestra.run.smithi138.stdout: Running scriptlet: ceph-mgr-2:19.3.0-4854.g8f219c47.el9.x86_64 133/165 2024-09-10T22:14:30.968 INFO:teuthology.orchestra.run.smithi138.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T22:14:30.968 INFO:teuthology.orchestra.run.smithi138.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-10T22:14:30.968 INFO:teuthology.orchestra.run.smithi138.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-10T22:14:30.969 INFO:teuthology.orchestra.run.smithi138.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-10T22:14:30.969 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-10T22:14:31.020 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : ceph-mgr-rook-2:19.3.0-4854.g8f219c47.el9.noarch 134/165 2024-09-10T22:14:31.032 INFO:teuthology.orchestra.run.smithi138.stdout: Running scriptlet: ceph-mgr-rook-2:19.3.0-4854.g8f219c47.el9.noarch 134/165 2024-09-10T22:14:31.129 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : ceph-2:19.3.0-4854.g8f219c47.el9.x86_64 135/165 2024-09-10T22:14:31.177 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : ceph-fuse-2:19.3.0-4854.g8f219c47.el9.x86_64 136/165 2024-09-10T22:14:31.750 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.3.0-4854.g8f219c47.el9.noa 129/165 2024-09-10T22:14:31.817 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : ceph-mgr-dashboard-2:19.3.0-4854.g8f219c47.el9.n 130/165 2024-09-10T22:14:32.128 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : libtool-2.4.6-46.el9.x86_64 137/165 2024-09-10T22:14:32.165 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : ceph-radosgw-2:19.3.0-4854.g8f219c47.el9.x86_64 138/165 2024-09-10T22:14:32.189 INFO:teuthology.orchestra.run.smithi138.stdout: Running scriptlet: ceph-radosgw-2:19.3.0-4854.g8f219c47.el9.x86_64 138/165 2024-09-10T22:14:32.189 INFO:teuthology.orchestra.run.smithi138.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T22:14:32.189 INFO:teuthology.orchestra.run.smithi138.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-10T22:14:32.189 INFO:teuthology.orchestra.run.smithi138.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-10T22:14:32.189 INFO:teuthology.orchestra.run.smithi138.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-10T22:14:32.189 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-10T22:14:32.232 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : ceph-immutable-object-cache-2:19.3.0-4854.g8f219 139/165 2024-09-10T22:14:32.255 INFO:teuthology.orchestra.run.smithi138.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.3.0-4854.g8f219 139/165 2024-09-10T22:14:32.256 INFO:teuthology.orchestra.run.smithi138.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T22:14:32.256 INFO:teuthology.orchestra.run.smithi138.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-10T22:14:32.256 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-10T22:14:32.300 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : cephfs-mirror-2:19.3.0-4854.g8f219c47.el9.x86_64 140/165 2024-09-10T22:14:32.323 INFO:teuthology.orchestra.run.smithi138.stdout: Running scriptlet: cephfs-mirror-2:19.3.0-4854.g8f219c47.el9.x86_64 140/165 2024-09-10T22:14:32.323 INFO:teuthology.orchestra.run.smithi138.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T22:14:32.323 INFO:teuthology.orchestra.run.smithi138.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-09-10T22:14:32.323 INFO:teuthology.orchestra.run.smithi138.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-10T22:14:32.323 INFO:teuthology.orchestra.run.smithi138.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-10T22:14:32.323 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-10T22:14:32.651 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : rbd-mirror-2:19.3.0-4854.g8f219c47.el9.x86_64 141/165 2024-09-10T22:14:32.675 INFO:teuthology.orchestra.run.smithi138.stdout: Running scriptlet: rbd-mirror-2:19.3.0-4854.g8f219c47.el9.x86_64 141/165 2024-09-10T22:14:32.675 INFO:teuthology.orchestra.run.smithi138.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T22:14:32.675 INFO:teuthology.orchestra.run.smithi138.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-10T22:14:32.675 INFO:teuthology.orchestra.run.smithi138.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-10T22:14:32.675 INFO:teuthology.orchestra.run.smithi138.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-10T22:14:32.675 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-10T22:14:32.777 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.3.0-4854.g8f219c47.el9.n 130/165 2024-09-10T22:14:32.817 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : ceph-mgr-diskprediction-local-2:19.3.0-4854.g8f2 131/165 2024-09-10T22:14:32.930 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.3.0-4854.g8f2 131/165 2024-09-10T22:14:33.104 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : ceph-mgr-modules-core-2:19.3.0-4854.g8f219c47.el 132/165 2024-09-10T22:14:33.136 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : ceph-mgr-2:19.3.0-4854.g8f219c47.el9.x86_64 133/165 2024-09-10T22:14:33.160 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: ceph-mgr-2:19.3.0-4854.g8f219c47.el9.x86_64 133/165 2024-09-10T22:14:33.160 INFO:teuthology.orchestra.run.smithi135.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T22:14:33.160 INFO:teuthology.orchestra.run.smithi135.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-10T22:14:33.160 INFO:teuthology.orchestra.run.smithi135.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-10T22:14:33.160 INFO:teuthology.orchestra.run.smithi135.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-10T22:14:33.160 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-09-10T22:14:33.203 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : ceph-mgr-rook-2:19.3.0-4854.g8f219c47.el9.noarch 134/165 2024-09-10T22:14:33.215 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: ceph-mgr-rook-2:19.3.0-4854.g8f219c47.el9.noarch 134/165 2024-09-10T22:14:33.314 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : ceph-2:19.3.0-4854.g8f219c47.el9.x86_64 135/165 2024-09-10T22:14:33.368 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : ceph-fuse-2:19.3.0-4854.g8f219c47.el9.x86_64 136/165 2024-09-10T22:14:34.320 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : libtool-2.4.6-46.el9.x86_64 137/165 2024-09-10T22:14:34.348 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : ceph-radosgw-2:19.3.0-4854.g8f219c47.el9.x86_64 138/165 2024-09-10T22:14:34.371 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: ceph-radosgw-2:19.3.0-4854.g8f219c47.el9.x86_64 138/165 2024-09-10T22:14:34.371 INFO:teuthology.orchestra.run.smithi135.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T22:14:34.371 INFO:teuthology.orchestra.run.smithi135.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-10T22:14:34.371 INFO:teuthology.orchestra.run.smithi135.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-10T22:14:34.372 INFO:teuthology.orchestra.run.smithi135.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-10T22:14:34.372 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-09-10T22:14:34.423 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : ceph-immutable-object-cache-2:19.3.0-4854.g8f219 139/165 2024-09-10T22:14:34.446 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.3.0-4854.g8f219 139/165 2024-09-10T22:14:34.447 INFO:teuthology.orchestra.run.smithi135.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T22:14:34.447 INFO:teuthology.orchestra.run.smithi135.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-10T22:14:34.447 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-09-10T22:14:34.499 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : cephfs-mirror-2:19.3.0-4854.g8f219c47.el9.x86_64 140/165 2024-09-10T22:14:34.523 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: cephfs-mirror-2:19.3.0-4854.g8f219c47.el9.x86_64 140/165 2024-09-10T22:14:34.523 INFO:teuthology.orchestra.run.smithi135.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T22:14:34.523 INFO:teuthology.orchestra.run.smithi135.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-09-10T22:14:34.523 INFO:teuthology.orchestra.run.smithi135.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-10T22:14:34.523 INFO:teuthology.orchestra.run.smithi135.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-10T22:14:34.523 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-09-10T22:14:34.833 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : rbd-mirror-2:19.3.0-4854.g8f219c47.el9.x86_64 141/165 2024-09-10T22:14:34.856 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: rbd-mirror-2:19.3.0-4854.g8f219c47.el9.x86_64 141/165 2024-09-10T22:14:34.856 INFO:teuthology.orchestra.run.smithi135.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T22:14:34.856 INFO:teuthology.orchestra.run.smithi135.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-10T22:14:34.856 INFO:teuthology.orchestra.run.smithi135.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-10T22:14:34.857 INFO:teuthology.orchestra.run.smithi135.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-10T22:14:34.857 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-09-10T22:14:37.039 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: ceph-selinux-2:19.3.0-4854.g8f219c47.el9.x86_64 110/165 2024-09-10T22:14:37.039 INFO:teuthology.orchestra.run.smithi019.stdout:skipping the directory /sys 2024-09-10T22:14:37.039 INFO:teuthology.orchestra.run.smithi019.stdout:skipping the directory /proc 2024-09-10T22:14:37.040 INFO:teuthology.orchestra.run.smithi019.stdout:skipping the directory /mnt 2024-09-10T22:14:37.040 INFO:teuthology.orchestra.run.smithi019.stdout:skipping the directory /var/tmp 2024-09-10T22:14:37.040 INFO:teuthology.orchestra.run.smithi019.stdout:skipping the directory /home 2024-09-10T22:14:37.040 INFO:teuthology.orchestra.run.smithi019.stdout:skipping the directory /root 2024-09-10T22:14:37.040 INFO:teuthology.orchestra.run.smithi019.stdout:skipping the directory /tmp 2024-09-10T22:14:37.040 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-10T22:14:37.226 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : ceph-volume-2:19.3.0-4854.g8f219c47.el9.noarch 111/165 2024-09-10T22:14:37.243 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: ceph-volume-2:19.3.0-4854.g8f219c47.el9.noarch 111/165 2024-09-10T22:14:37.243 INFO:teuthology.orchestra.run.smithi019.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T22:14:37.243 INFO:teuthology.orchestra.run.smithi019.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-10T22:14:37.243 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-10T22:14:37.364 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : ceph-test-2:19.3.0-4854.g8f219c47.el9.x86_64 142/165 2024-09-10T22:14:37.406 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : rbd-fuse-2:19.3.0-4854.g8f219c47.el9.x86_64 143/165 2024-09-10T22:14:37.446 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : rbd-nbd-2:19.3.0-4854.g8f219c47.el9.x86_64 144/165 2024-09-10T22:14:37.479 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : xfsprogs-devel-6.4.0-4.el9.x86_64 145/165 2024-09-10T22:14:37.506 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 146/165 2024-09-10T22:14:37.698 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : cephfs-shell-2:19.3.0-4854.g8f219c47.el9.x86_64 147/165 2024-09-10T22:14:37.746 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : postgresql-contrib-13.16-1.el9.x86_64 148/165 2024-09-10T22:14:37.776 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : libcephfs-devel-2:19.3.0-4854.g8f219c47.el9.x86_ 149/165 2024-09-10T22:14:37.806 INFO:teuthology.orchestra.run.smithi138.stdout: Upgrading : NetworkManager-team-1:1.49.90-1.el9.x86_64 150/165 2024-09-10T22:14:37.853 INFO:teuthology.orchestra.run.smithi138.stdout: Upgrading : NetworkManager-tui-1:1.49.90-1.el9.x86_64 151/165 2024-09-10T22:14:38.435 INFO:teuthology.orchestra.run.smithi138.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 152/165 2024-09-10T22:14:38.477 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : postgresql-server-13.16-1.el9.x86_64 152/165 2024-09-10T22:14:38.498 INFO:teuthology.orchestra.run.smithi138.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 152/165 2024-09-10T22:14:38.812 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : ceph-osd-2:19.3.0-4854.g8f219c47.el9.x86_64 112/165 2024-09-10T22:14:38.841 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: ceph-osd-2:19.3.0-4854.g8f219c47.el9.x86_64 112/165 2024-09-10T22:14:38.841 INFO:teuthology.orchestra.run.smithi019.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T22:14:38.841 INFO:teuthology.orchestra.run.smithi019.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-10T22:14:38.841 INFO:teuthology.orchestra.run.smithi019.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-10T22:14:38.841 INFO:teuthology.orchestra.run.smithi019.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-10T22:14:38.841 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-10T22:14:39.080 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : ceph-mds-2:19.3.0-4854.g8f219c47.el9.x86_64 113/165 2024-09-10T22:14:39.105 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: ceph-mds-2:19.3.0-4854.g8f219c47.el9.x86_64 113/165 2024-09-10T22:14:39.105 INFO:teuthology.orchestra.run.smithi019.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T22:14:39.105 INFO:teuthology.orchestra.run.smithi019.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-10T22:14:39.105 INFO:teuthology.orchestra.run.smithi019.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-10T22:14:39.105 INFO:teuthology.orchestra.run.smithi019.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-10T22:14:39.105 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-10T22:14:39.337 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : cephfs-top-2:19.3.0-4854.g8f219c47.el9.noarch 153/165 2024-09-10T22:14:39.418 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : openssl-devel-1:3.2.2-6.el9.x86_64 154/165 2024-09-10T22:14:39.460 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 155/165 2024-09-10T22:14:39.549 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : flex-2.6.4-9.el9.x86_64 156/165 2024-09-10T22:14:39.562 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : ceph-test-2:19.3.0-4854.g8f219c47.el9.x86_64 142/165 2024-09-10T22:14:39.589 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : ceph-mon-2:19.3.0-4854.g8f219c47.el9.x86_64 114/165 2024-09-10T22:14:39.589 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : bison-3.7.4-5.el9.x86_64 157/165 2024-09-10T22:14:39.603 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : rbd-fuse-2:19.3.0-4854.g8f219c47.el9.x86_64 143/165 2024-09-10T22:14:39.614 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: ceph-mon-2:19.3.0-4854.g8f219c47.el9.x86_64 114/165 2024-09-10T22:14:39.614 INFO:teuthology.orchestra.run.smithi019.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T22:14:39.614 INFO:teuthology.orchestra.run.smithi019.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-10T22:14:39.614 INFO:teuthology.orchestra.run.smithi019.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-10T22:14:39.614 INFO:teuthology.orchestra.run.smithi019.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-10T22:14:39.614 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-10T22:14:39.615 INFO:teuthology.orchestra.run.smithi138.stdout: Cleanup : NetworkManager-tui-1:1.48.8-1.el9.x86_64 158/165 2024-09-10T22:14:39.641 INFO:teuthology.orchestra.run.smithi138.stdout: Cleanup : openssl-1:3.2.2-4.el9.x86_64 159/165 2024-09-10T22:14:39.641 INFO:teuthology.orchestra.run.smithi138.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 160/165 2024-09-10T22:14:39.643 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : rbd-nbd-2:19.3.0-4854.g8f219c47.el9.x86_64 144/165 2024-09-10T22:14:39.676 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : xfsprogs-devel-6.4.0-4.el9.x86_64 145/165 2024-09-10T22:14:39.703 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 146/165 2024-09-10T22:14:39.728 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : automake-1.16.2-8.el9.noarch 115/165 2024-09-10T22:14:39.733 INFO:teuthology.orchestra.run.smithi138.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 160/165 2024-09-10T22:14:39.734 INFO:teuthology.orchestra.run.smithi138.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 161/165 2024-09-10T22:14:39.786 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-ply-3.11-14.el9.noarch 116/165 2024-09-10T22:14:39.826 INFO:teuthology.orchestra.run.smithi138.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 161/165 2024-09-10T22:14:39.850 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 117/165 2024-09-10T22:14:39.851 INFO:teuthology.orchestra.run.smithi138.stdout: Cleanup : NetworkManager-team-1:1.48.8-1.el9.x86_64 162/165 2024-09-10T22:14:39.857 INFO:teuthology.orchestra.run.smithi138.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 163/165 2024-09-10T22:14:39.857 INFO:teuthology.orchestra.run.smithi138.stdout: Cleanup : NetworkManager-1:1.48.8-1.el9.x86_64 163/165 2024-09-10T22:14:39.883 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : cephfs-shell-2:19.3.0-4854.g8f219c47.el9.x86_64 147/165 2024-09-10T22:14:39.933 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : postgresql-contrib-13.16-1.el9.x86_64 148/165 2024-09-10T22:14:39.963 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : libcephfs-devel-2:19.3.0-4854.g8f219c47.el9.x86_ 149/165 2024-09-10T22:14:39.993 INFO:teuthology.orchestra.run.smithi135.stdout: Upgrading : NetworkManager-team-1:1.49.90-1.el9.x86_64 150/165 2024-09-10T22:14:40.040 INFO:teuthology.orchestra.run.smithi135.stdout: Upgrading : NetworkManager-tui-1:1.49.90-1.el9.x86_64 151/165 2024-09-10T22:14:40.042 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 118/165 2024-09-10T22:14:40.044 INFO:teuthology.orchestra.run.smithi138.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 163/165 2024-09-10T22:14:40.044 INFO:teuthology.orchestra.run.smithi138.stdout: Cleanup : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 164/165 2024-09-10T22:14:40.090 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 119/165 2024-09-10T22:14:40.129 INFO:teuthology.orchestra.run.smithi138.stdout: Running scriptlet: NetworkManager-libnm-1:1.48.8-1.el9.x86_64 164/165 2024-09-10T22:14:40.171 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 120/165 2024-09-10T22:14:40.192 INFO:teuthology.orchestra.run.smithi138.stdout: Cleanup : openssl-libs-1:3.2.2-4.el9.x86_64 165/165 2024-09-10T22:14:40.261 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 121/165 2024-09-10T22:14:40.411 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 122/165 2024-09-10T22:14:40.459 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 123/165 2024-09-10T22:14:40.489 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 124/165 2024-09-10T22:14:40.524 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : fuse-2.9.9-16.el9.x86_64 125/165 2024-09-10T22:14:40.674 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 152/165 2024-09-10T22:14:40.720 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : postgresql-server-13.16-1.el9.x86_64 152/165 2024-09-10T22:14:40.741 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 152/165 2024-09-10T22:14:40.973 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: cephadm-2:19.3.0-4854.g8f219c47.el9.noarch 126/165 2024-09-10T22:14:40.998 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : cephadm-2:19.3.0-4854.g8f219c47.el9.noarch 126/165 2024-09-10T22:14:41.030 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : ceph-prometheus-alerts-2:19.3.0-4854.g8f219c47.e 127/165 2024-09-10T22:14:41.099 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : ceph-grafana-dashboards-2:19.3.0-4854.g8f219c47. 128/165 2024-09-10T22:14:41.129 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : ceph-mgr-cephadm-2:19.3.0-4854.g8f219c47.el9.noa 129/165 2024-09-10T22:14:41.574 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : cephfs-top-2:19.3.0-4854.g8f219c47.el9.noarch 153/165 2024-09-10T22:14:41.667 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : openssl-devel-1:3.2.2-6.el9.x86_64 154/165 2024-09-10T22:14:41.708 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 155/165 2024-09-10T22:14:41.797 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : flex-2.6.4-9.el9.x86_64 156/165 2024-09-10T22:14:41.845 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : bison-3.7.4-5.el9.x86_64 157/165 2024-09-10T22:14:41.870 INFO:teuthology.orchestra.run.smithi135.stdout: Cleanup : NetworkManager-tui-1:1.48.8-1.el9.x86_64 158/165 2024-09-10T22:14:41.896 INFO:teuthology.orchestra.run.smithi135.stdout: Cleanup : openssl-1:3.2.2-4.el9.x86_64 159/165 2024-09-10T22:14:41.896 INFO:teuthology.orchestra.run.smithi135.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 160/165 2024-09-10T22:14:41.980 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 160/165 2024-09-10T22:14:41.981 INFO:teuthology.orchestra.run.smithi135.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 161/165 2024-09-10T22:14:42.064 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 161/165 2024-09-10T22:14:42.089 INFO:teuthology.orchestra.run.smithi135.stdout: Cleanup : NetworkManager-team-1:1.48.8-1.el9.x86_64 162/165 2024-09-10T22:14:42.095 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 163/165 2024-09-10T22:14:42.095 INFO:teuthology.orchestra.run.smithi135.stdout: Cleanup : NetworkManager-1:1.48.8-1.el9.x86_64 163/165 2024-09-10T22:14:42.274 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 163/165 2024-09-10T22:14:42.275 INFO:teuthology.orchestra.run.smithi135.stdout: Cleanup : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 164/165 2024-09-10T22:14:42.359 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: NetworkManager-libnm-1:1.48.8-1.el9.x86_64 164/165 2024-09-10T22:14:42.421 INFO:teuthology.orchestra.run.smithi135.stdout: Cleanup : openssl-libs-1:3.2.2-4.el9.x86_64 165/165 2024-09-10T22:14:44.494 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.3.0-4854.g8f219c47.el9.noa 129/165 2024-09-10T22:14:44.553 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : ceph-mgr-dashboard-2:19.3.0-4854.g8f219c47.el9.n 130/165 2024-09-10T22:14:45.572 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.3.0-4854.g8f219c47.el9.n 130/165 2024-09-10T22:14:45.603 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : ceph-mgr-diskprediction-local-2:19.3.0-4854.g8f2 131/165 2024-09-10T22:14:45.723 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.3.0-4854.g8f2 131/165 2024-09-10T22:14:45.897 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : ceph-mgr-modules-core-2:19.3.0-4854.g8f219c47.el 132/165 2024-09-10T22:14:45.929 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : ceph-mgr-2:19.3.0-4854.g8f219c47.el9.x86_64 133/165 2024-09-10T22:14:45.954 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: ceph-mgr-2:19.3.0-4854.g8f219c47.el9.x86_64 133/165 2024-09-10T22:14:45.954 INFO:teuthology.orchestra.run.smithi019.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T22:14:45.955 INFO:teuthology.orchestra.run.smithi019.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-10T22:14:45.955 INFO:teuthology.orchestra.run.smithi019.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-10T22:14:45.955 INFO:teuthology.orchestra.run.smithi019.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-10T22:14:45.955 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-10T22:14:46.005 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : ceph-mgr-rook-2:19.3.0-4854.g8f219c47.el9.noarch 134/165 2024-09-10T22:14:46.017 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: ceph-mgr-rook-2:19.3.0-4854.g8f219c47.el9.noarch 134/165 2024-09-10T22:14:46.120 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : ceph-2:19.3.0-4854.g8f219c47.el9.x86_64 135/165 2024-09-10T22:14:46.174 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : ceph-fuse-2:19.3.0-4854.g8f219c47.el9.x86_64 136/165 2024-09-10T22:14:46.561 INFO:teuthology.orchestra.run.smithi138.stdout: Running scriptlet: openssl-libs-1:3.2.2-4.el9.x86_64 165/165 2024-09-10T22:14:46.561 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : ceph-2:19.3.0-4854.g8f219c47.el9.x86_64 1/165 2024-09-10T22:14:46.561 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : ceph-base-2:19.3.0-4854.g8f219c47.el9.x86_64 2/165 2024-09-10T22:14:46.561 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : ceph-common-2:19.3.0-4854.g8f219c47.el9.x86_64 3/165 2024-09-10T22:14:46.561 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : ceph-fuse-2:19.3.0-4854.g8f219c47.el9.x86_64 4/165 2024-09-10T22:14:46.561 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : ceph-immutable-object-cache-2:19.3.0-4854.g8f219 5/165 2024-09-10T22:14:46.561 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : ceph-mds-2:19.3.0-4854.g8f219c47.el9.x86_64 6/165 2024-09-10T22:14:46.562 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : ceph-mgr-2:19.3.0-4854.g8f219c47.el9.x86_64 7/165 2024-09-10T22:14:46.562 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : ceph-mon-2:19.3.0-4854.g8f219c47.el9.x86_64 8/165 2024-09-10T22:14:46.562 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : ceph-osd-2:19.3.0-4854.g8f219c47.el9.x86_64 9/165 2024-09-10T22:14:46.562 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : ceph-radosgw-2:19.3.0-4854.g8f219c47.el9.x86_64 10/165 2024-09-10T22:14:46.562 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : ceph-selinux-2:19.3.0-4854.g8f219c47.el9.x86_64 11/165 2024-09-10T22:14:46.562 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : ceph-test-2:19.3.0-4854.g8f219c47.el9.x86_64 12/165 2024-09-10T22:14:46.562 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : cephfs-mirror-2:19.3.0-4854.g8f219c47.el9.x86_64 13/165 2024-09-10T22:14:46.562 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : cephfs-shell-2:19.3.0-4854.g8f219c47.el9.x86_64 14/165 2024-09-10T22:14:46.562 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : libcephfs-devel-2:19.3.0-4854.g8f219c47.el9.x86_ 15/165 2024-09-10T22:14:46.562 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : libcephfs2-2:19.3.0-4854.g8f219c47.el9.x86_64 16/165 2024-09-10T22:14:46.562 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : libcephsqlite-2:19.3.0-4854.g8f219c47.el9.x86_64 17/165 2024-09-10T22:14:46.562 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : librados-devel-2:19.3.0-4854.g8f219c47.el9.x86_6 18/165 2024-09-10T22:14:46.563 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : libradosstriper1-2:19.3.0-4854.g8f219c47.el9.x86 19/165 2024-09-10T22:14:46.563 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : librgw2-2:19.3.0-4854.g8f219c47.el9.x86_64 20/165 2024-09-10T22:14:46.563 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : python3-ceph-argparse-2:19.3.0-4854.g8f219c47.el 21/165 2024-09-10T22:14:46.563 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : python3-ceph-common-2:19.3.0-4854.g8f219c47.el9. 22/165 2024-09-10T22:14:46.563 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : python3-cephfs-2:19.3.0-4854.g8f219c47.el9.x86_6 23/165 2024-09-10T22:14:46.563 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : python3-rados-2:19.3.0-4854.g8f219c47.el9.x86_64 24/165 2024-09-10T22:14:46.563 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : python3-rbd-2:19.3.0-4854.g8f219c47.el9.x86_64 25/165 2024-09-10T22:14:46.563 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : python3-rgw-2:19.3.0-4854.g8f219c47.el9.x86_64 26/165 2024-09-10T22:14:46.563 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : rbd-fuse-2:19.3.0-4854.g8f219c47.el9.x86_64 27/165 2024-09-10T22:14:46.564 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : rbd-mirror-2:19.3.0-4854.g8f219c47.el9.x86_64 28/165 2024-09-10T22:14:46.564 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : rbd-nbd-2:19.3.0-4854.g8f219c47.el9.x86_64 29/165 2024-09-10T22:14:46.564 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : ceph-grafana-dashboards-2:19.3.0-4854.g8f219c47. 30/165 2024-09-10T22:14:46.575 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : ceph-mgr-cephadm-2:19.3.0-4854.g8f219c47.el9.noa 31/165 2024-09-10T22:14:46.575 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : ceph-mgr-dashboard-2:19.3.0-4854.g8f219c47.el9.n 32/165 2024-09-10T22:14:46.576 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.3.0-4854.g8f2 33/165 2024-09-10T22:14:46.576 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : ceph-mgr-modules-core-2:19.3.0-4854.g8f219c47.el 34/165 2024-09-10T22:14:46.576 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : ceph-mgr-rook-2:19.3.0-4854.g8f219c47.el9.noarch 35/165 2024-09-10T22:14:46.576 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : ceph-prometheus-alerts-2:19.3.0-4854.g8f219c47.e 36/165 2024-09-10T22:14:46.576 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : ceph-volume-2:19.3.0-4854.g8f219c47.el9.noarch 37/165 2024-09-10T22:14:46.576 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : cephadm-2:19.3.0-4854.g8f219c47.el9.noarch 38/165 2024-09-10T22:14:46.576 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : cephfs-top-2:19.3.0-4854.g8f219c47.el9.noarch 39/165 2024-09-10T22:14:46.576 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 40/165 2024-09-10T22:14:46.577 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 41/165 2024-09-10T22:14:46.577 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 42/165 2024-09-10T22:14:46.577 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/165 2024-09-10T22:14:46.577 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/165 2024-09-10T22:14:46.577 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/165 2024-09-10T22:14:46.577 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/165 2024-09-10T22:14:46.577 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/165 2024-09-10T22:14:46.577 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 48/165 2024-09-10T22:14:46.577 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/165 2024-09-10T22:14:46.577 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/165 2024-09-10T22:14:46.577 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/165 2024-09-10T22:14:46.578 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 52/165 2024-09-10T22:14:46.578 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/165 2024-09-10T22:14:46.578 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/165 2024-09-10T22:14:46.578 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/165 2024-09-10T22:14:46.578 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/165 2024-09-10T22:14:46.578 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/165 2024-09-10T22:14:46.578 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : libnbd-1.20.2-2.el9.x86_64 58/165 2024-09-10T22:14:46.578 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 59/165 2024-09-10T22:14:46.578 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 60/165 2024-09-10T22:14:46.578 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 61/165 2024-09-10T22:14:46.578 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : libtool-2.4.6-46.el9.x86_64 62/165 2024-09-10T22:14:46.578 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : libuuid-devel-2.37.4-20.el9.x86_64 63/165 2024-09-10T22:14:46.579 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 64/165 2024-09-10T22:14:46.579 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 65/165 2024-09-10T22:14:46.579 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : lua-5.4.4-4.el9.x86_64 66/165 2024-09-10T22:14:46.579 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 67/165 2024-09-10T22:14:46.579 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 68/165 2024-09-10T22:14:46.579 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : openssl-devel-1:3.2.2-6.el9.x86_64 69/165 2024-09-10T22:14:46.579 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : postgresql-13.16-1.el9.x86_64 70/165 2024-09-10T22:14:46.579 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : postgresql-contrib-13.16-1.el9.x86_64 71/165 2024-09-10T22:14:46.579 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : postgresql-private-libs-13.16-1.el9.x86_64 72/165 2024-09-10T22:14:46.579 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : postgresql-server-13.16-1.el9.x86_64 73/165 2024-09-10T22:14:46.579 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 74/165 2024-09-10T22:14:46.579 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 75/165 2024-09-10T22:14:46.579 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 76/165 2024-09-10T22:14:46.580 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : python3-colorama-0.4.6-3.el9.noarch 77/165 2024-09-10T22:14:46.580 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 78/165 2024-09-10T22:14:46.580 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 79/165 2024-09-10T22:14:46.580 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 80/165 2024-09-10T22:14:46.580 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 81/165 2024-09-10T22:14:46.580 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 82/165 2024-09-10T22:14:46.580 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 83/165 2024-09-10T22:14:46.580 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 84/165 2024-09-10T22:14:46.580 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 85/165 2024-09-10T22:14:46.580 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 86/165 2024-09-10T22:14:46.580 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 87/165 2024-09-10T22:14:46.580 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 88/165 2024-09-10T22:14:46.581 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 89/165 2024-09-10T22:14:46.581 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 90/165 2024-09-10T22:14:46.581 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 91/165 2024-09-10T22:14:46.581 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 92/165 2024-09-10T22:14:46.581 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 93/165 2024-09-10T22:14:46.581 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 94/165 2024-09-10T22:14:46.581 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 95/165 2024-09-10T22:14:46.581 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 96/165 2024-09-10T22:14:46.581 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 97/165 2024-09-10T22:14:46.581 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 98/165 2024-09-10T22:14:46.581 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 99/165 2024-09-10T22:14:46.581 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 100/165 2024-09-10T22:14:46.581 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 101/165 2024-09-10T22:14:46.582 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : xfsprogs-devel-6.4.0-4.el9.x86_64 102/165 2024-09-10T22:14:46.582 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 103/165 2024-09-10T22:14:46.582 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 104/165 2024-09-10T22:14:46.582 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 105/165 2024-09-10T22:14:46.582 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 106/165 2024-09-10T22:14:46.582 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 107/165 2024-09-10T22:14:46.582 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 108/165 2024-09-10T22:14:46.582 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 109/165 2024-09-10T22:14:46.582 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 110/165 2024-09-10T22:14:46.582 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 111/165 2024-09-10T22:14:46.582 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 112/165 2024-09-10T22:14:46.582 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 113/165 2024-09-10T22:14:46.582 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 114/165 2024-09-10T22:14:46.582 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 115/165 2024-09-10T22:14:46.583 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 116/165 2024-09-10T22:14:46.583 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 117/165 2024-09-10T22:14:46.583 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 118/165 2024-09-10T22:14:46.583 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 119/165 2024-09-10T22:14:46.583 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 120/165 2024-09-10T22:14:46.583 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 121/165 2024-09-10T22:14:46.583 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 122/165 2024-09-10T22:14:46.583 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 123/165 2024-09-10T22:14:46.583 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 124/165 2024-09-10T22:14:46.583 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 125/165 2024-09-10T22:14:46.583 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 126/165 2024-09-10T22:14:46.583 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 127/165 2024-09-10T22:14:46.583 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 128/165 2024-09-10T22:14:46.583 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 129/165 2024-09-10T22:14:46.584 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 130/165 2024-09-10T22:14:46.584 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 131/165 2024-09-10T22:14:46.584 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 132/165 2024-09-10T22:14:46.584 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 133/165 2024-09-10T22:14:46.584 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 134/165 2024-09-10T22:14:46.584 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 135/165 2024-09-10T22:14:46.584 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 136/165 2024-09-10T22:14:46.584 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 137/165 2024-09-10T22:14:46.584 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 138/165 2024-09-10T22:14:46.585 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 139/165 2024-09-10T22:14:46.585 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 140/165 2024-09-10T22:14:46.585 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 141/165 2024-09-10T22:14:46.585 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 142/165 2024-09-10T22:14:46.585 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 143/165 2024-09-10T22:14:46.585 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 144/165 2024-09-10T22:14:46.585 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 145/165 2024-09-10T22:14:46.585 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 146/165 2024-09-10T22:14:46.585 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 147/165 2024-09-10T22:14:46.585 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : re2-1:20211101-20.el9.x86_64 148/165 2024-09-10T22:14:46.585 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 149/165 2024-09-10T22:14:46.585 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : librados2-2:19.3.0-4854.g8f219c47.el9.x86_64 150/165 2024-09-10T22:14:46.585 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 151/165 2024-09-10T22:14:46.586 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : librbd1-2:19.3.0-4854.g8f219c47.el9.x86_64 152/165 2024-09-10T22:14:46.586 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 153/165 2024-09-10T22:14:46.586 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : NetworkManager-1:1.49.90-1.el9.x86_64 154/165 2024-09-10T22:14:46.586 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : NetworkManager-1:1.48.8-1.el9.x86_64 155/165 2024-09-10T22:14:46.586 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : NetworkManager-libnm-1:1.49.90-1.el9.x86_64 156/165 2024-09-10T22:14:46.586 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 157/165 2024-09-10T22:14:46.586 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : NetworkManager-team-1:1.49.90-1.el9.x86_64 158/165 2024-09-10T22:14:46.586 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : NetworkManager-team-1:1.48.8-1.el9.x86_64 159/165 2024-09-10T22:14:46.586 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : NetworkManager-tui-1:1.49.90-1.el9.x86_64 160/165 2024-09-10T22:14:46.586 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : NetworkManager-tui-1:1.48.8-1.el9.x86_64 161/165 2024-09-10T22:14:46.587 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : openssl-1:3.2.2-6.el9.x86_64 162/165 2024-09-10T22:14:46.587 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : openssl-1:3.2.2-4.el9.x86_64 163/165 2024-09-10T22:14:46.587 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : openssl-libs-1:3.2.2-6.el9.x86_64 164/165 2024-09-10T22:14:47.181 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : libtool-2.4.6-46.el9.x86_64 137/165 2024-09-10T22:14:47.208 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : ceph-radosgw-2:19.3.0-4854.g8f219c47.el9.x86_64 138/165 2024-09-10T22:14:47.233 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: ceph-radosgw-2:19.3.0-4854.g8f219c47.el9.x86_64 138/165 2024-09-10T22:14:47.233 INFO:teuthology.orchestra.run.smithi019.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T22:14:47.233 INFO:teuthology.orchestra.run.smithi019.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-10T22:14:47.233 INFO:teuthology.orchestra.run.smithi019.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-10T22:14:47.233 INFO:teuthology.orchestra.run.smithi019.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-10T22:14:47.233 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-10T22:14:47.275 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : ceph-immutable-object-cache-2:19.3.0-4854.g8f219 139/165 2024-09-10T22:14:47.299 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.3.0-4854.g8f219 139/165 2024-09-10T22:14:47.299 INFO:teuthology.orchestra.run.smithi019.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T22:14:47.299 INFO:teuthology.orchestra.run.smithi019.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-10T22:14:47.299 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-10T22:14:47.351 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : cephfs-mirror-2:19.3.0-4854.g8f219c47.el9.x86_64 140/165 2024-09-10T22:14:47.375 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: cephfs-mirror-2:19.3.0-4854.g8f219c47.el9.x86_64 140/165 2024-09-10T22:14:47.375 INFO:teuthology.orchestra.run.smithi019.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T22:14:47.375 INFO:teuthology.orchestra.run.smithi019.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-09-10T22:14:47.375 INFO:teuthology.orchestra.run.smithi019.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-10T22:14:47.375 INFO:teuthology.orchestra.run.smithi019.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-10T22:14:47.375 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-10T22:14:47.718 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : rbd-mirror-2:19.3.0-4854.g8f219c47.el9.x86_64 141/165 2024-09-10T22:14:47.743 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: rbd-mirror-2:19.3.0-4854.g8f219c47.el9.x86_64 141/165 2024-09-10T22:14:47.743 INFO:teuthology.orchestra.run.smithi019.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T22:14:47.743 INFO:teuthology.orchestra.run.smithi019.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-10T22:14:47.743 INFO:teuthology.orchestra.run.smithi019.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-10T22:14:47.743 INFO:teuthology.orchestra.run.smithi019.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-10T22:14:47.744 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-10T22:14:49.164 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: openssl-libs-1:3.2.2-4.el9.x86_64 165/165 2024-09-10T22:14:49.164 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : ceph-2:19.3.0-4854.g8f219c47.el9.x86_64 1/165 2024-09-10T22:14:49.164 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : ceph-base-2:19.3.0-4854.g8f219c47.el9.x86_64 2/165 2024-09-10T22:14:49.164 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : ceph-common-2:19.3.0-4854.g8f219c47.el9.x86_64 3/165 2024-09-10T22:14:49.164 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : ceph-fuse-2:19.3.0-4854.g8f219c47.el9.x86_64 4/165 2024-09-10T22:14:49.164 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : ceph-immutable-object-cache-2:19.3.0-4854.g8f219 5/165 2024-09-10T22:14:49.164 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : ceph-mds-2:19.3.0-4854.g8f219c47.el9.x86_64 6/165 2024-09-10T22:14:49.165 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : ceph-mgr-2:19.3.0-4854.g8f219c47.el9.x86_64 7/165 2024-09-10T22:14:49.165 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : ceph-mon-2:19.3.0-4854.g8f219c47.el9.x86_64 8/165 2024-09-10T22:14:49.165 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : ceph-osd-2:19.3.0-4854.g8f219c47.el9.x86_64 9/165 2024-09-10T22:14:49.165 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : ceph-radosgw-2:19.3.0-4854.g8f219c47.el9.x86_64 10/165 2024-09-10T22:14:49.165 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : ceph-selinux-2:19.3.0-4854.g8f219c47.el9.x86_64 11/165 2024-09-10T22:14:49.165 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : ceph-test-2:19.3.0-4854.g8f219c47.el9.x86_64 12/165 2024-09-10T22:14:49.165 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : cephfs-mirror-2:19.3.0-4854.g8f219c47.el9.x86_64 13/165 2024-09-10T22:14:49.165 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : cephfs-shell-2:19.3.0-4854.g8f219c47.el9.x86_64 14/165 2024-09-10T22:14:49.165 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : libcephfs-devel-2:19.3.0-4854.g8f219c47.el9.x86_ 15/165 2024-09-10T22:14:49.165 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : libcephfs2-2:19.3.0-4854.g8f219c47.el9.x86_64 16/165 2024-09-10T22:14:49.165 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : libcephsqlite-2:19.3.0-4854.g8f219c47.el9.x86_64 17/165 2024-09-10T22:14:49.165 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : librados-devel-2:19.3.0-4854.g8f219c47.el9.x86_6 18/165 2024-09-10T22:14:49.165 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : libradosstriper1-2:19.3.0-4854.g8f219c47.el9.x86 19/165 2024-09-10T22:14:49.166 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : librgw2-2:19.3.0-4854.g8f219c47.el9.x86_64 20/165 2024-09-10T22:14:49.166 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-ceph-argparse-2:19.3.0-4854.g8f219c47.el 21/165 2024-09-10T22:14:49.166 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-ceph-common-2:19.3.0-4854.g8f219c47.el9. 22/165 2024-09-10T22:14:49.166 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-cephfs-2:19.3.0-4854.g8f219c47.el9.x86_6 23/165 2024-09-10T22:14:49.166 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-rados-2:19.3.0-4854.g8f219c47.el9.x86_64 24/165 2024-09-10T22:14:49.166 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-rbd-2:19.3.0-4854.g8f219c47.el9.x86_64 25/165 2024-09-10T22:14:49.166 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-rgw-2:19.3.0-4854.g8f219c47.el9.x86_64 26/165 2024-09-10T22:14:49.166 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : rbd-fuse-2:19.3.0-4854.g8f219c47.el9.x86_64 27/165 2024-09-10T22:14:49.166 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : rbd-mirror-2:19.3.0-4854.g8f219c47.el9.x86_64 28/165 2024-09-10T22:14:49.166 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : rbd-nbd-2:19.3.0-4854.g8f219c47.el9.x86_64 29/165 2024-09-10T22:14:49.166 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : ceph-grafana-dashboards-2:19.3.0-4854.g8f219c47. 30/165 2024-09-10T22:14:49.178 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : ceph-mgr-cephadm-2:19.3.0-4854.g8f219c47.el9.noa 31/165 2024-09-10T22:14:49.178 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : ceph-mgr-dashboard-2:19.3.0-4854.g8f219c47.el9.n 32/165 2024-09-10T22:14:49.178 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.3.0-4854.g8f2 33/165 2024-09-10T22:14:49.178 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : ceph-mgr-modules-core-2:19.3.0-4854.g8f219c47.el 34/165 2024-09-10T22:14:49.178 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : ceph-mgr-rook-2:19.3.0-4854.g8f219c47.el9.noarch 35/165 2024-09-10T22:14:49.178 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : ceph-prometheus-alerts-2:19.3.0-4854.g8f219c47.e 36/165 2024-09-10T22:14:49.178 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : ceph-volume-2:19.3.0-4854.g8f219c47.el9.noarch 37/165 2024-09-10T22:14:49.178 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : cephadm-2:19.3.0-4854.g8f219c47.el9.noarch 38/165 2024-09-10T22:14:49.179 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : cephfs-top-2:19.3.0-4854.g8f219c47.el9.noarch 39/165 2024-09-10T22:14:49.179 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 40/165 2024-09-10T22:14:49.179 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 41/165 2024-09-10T22:14:49.179 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 42/165 2024-09-10T22:14:49.179 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/165 2024-09-10T22:14:49.179 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/165 2024-09-10T22:14:49.179 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/165 2024-09-10T22:14:49.179 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/165 2024-09-10T22:14:49.179 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/165 2024-09-10T22:14:49.179 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 48/165 2024-09-10T22:14:49.179 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/165 2024-09-10T22:14:49.180 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/165 2024-09-10T22:14:49.180 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/165 2024-09-10T22:14:49.180 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 52/165 2024-09-10T22:14:49.180 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/165 2024-09-10T22:14:49.180 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/165 2024-09-10T22:14:49.180 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/165 2024-09-10T22:14:49.180 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/165 2024-09-10T22:14:49.180 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/165 2024-09-10T22:14:49.180 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : libnbd-1.20.2-2.el9.x86_64 58/165 2024-09-10T22:14:49.180 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 59/165 2024-09-10T22:14:49.180 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 60/165 2024-09-10T22:14:49.180 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 61/165 2024-09-10T22:14:49.180 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : libtool-2.4.6-46.el9.x86_64 62/165 2024-09-10T22:14:49.181 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : libuuid-devel-2.37.4-20.el9.x86_64 63/165 2024-09-10T22:14:49.181 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 64/165 2024-09-10T22:14:49.181 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 65/165 2024-09-10T22:14:49.181 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : lua-5.4.4-4.el9.x86_64 66/165 2024-09-10T22:14:49.181 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 67/165 2024-09-10T22:14:49.181 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 68/165 2024-09-10T22:14:49.181 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : openssl-devel-1:3.2.2-6.el9.x86_64 69/165 2024-09-10T22:14:49.181 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : postgresql-13.16-1.el9.x86_64 70/165 2024-09-10T22:14:49.181 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : postgresql-contrib-13.16-1.el9.x86_64 71/165 2024-09-10T22:14:49.181 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : postgresql-private-libs-13.16-1.el9.x86_64 72/165 2024-09-10T22:14:49.181 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : postgresql-server-13.16-1.el9.x86_64 73/165 2024-09-10T22:14:49.181 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 74/165 2024-09-10T22:14:49.182 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 75/165 2024-09-10T22:14:49.182 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 76/165 2024-09-10T22:14:49.182 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-colorama-0.4.6-3.el9.noarch 77/165 2024-09-10T22:14:49.182 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 78/165 2024-09-10T22:14:49.182 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 79/165 2024-09-10T22:14:49.182 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 80/165 2024-09-10T22:14:49.182 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 81/165 2024-09-10T22:14:49.182 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 82/165 2024-09-10T22:14:49.182 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 83/165 2024-09-10T22:14:49.182 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 84/165 2024-09-10T22:14:49.182 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 85/165 2024-09-10T22:14:49.182 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 86/165 2024-09-10T22:14:49.183 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 87/165 2024-09-10T22:14:49.183 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 88/165 2024-09-10T22:14:49.183 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 89/165 2024-09-10T22:14:49.183 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 90/165 2024-09-10T22:14:49.183 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 91/165 2024-09-10T22:14:49.183 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 92/165 2024-09-10T22:14:49.183 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 93/165 2024-09-10T22:14:49.183 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 94/165 2024-09-10T22:14:49.183 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 95/165 2024-09-10T22:14:49.183 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 96/165 2024-09-10T22:14:49.183 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 97/165 2024-09-10T22:14:49.183 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 98/165 2024-09-10T22:14:49.183 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 99/165 2024-09-10T22:14:49.184 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 100/165 2024-09-10T22:14:49.184 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 101/165 2024-09-10T22:14:49.184 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : xfsprogs-devel-6.4.0-4.el9.x86_64 102/165 2024-09-10T22:14:49.184 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 103/165 2024-09-10T22:14:49.184 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 104/165 2024-09-10T22:14:49.184 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 105/165 2024-09-10T22:14:49.184 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 106/165 2024-09-10T22:14:49.184 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 107/165 2024-09-10T22:14:49.184 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 108/165 2024-09-10T22:14:49.184 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 109/165 2024-09-10T22:14:49.184 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 110/165 2024-09-10T22:14:49.184 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 111/165 2024-09-10T22:14:49.184 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 112/165 2024-09-10T22:14:49.185 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 113/165 2024-09-10T22:14:49.185 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 114/165 2024-09-10T22:14:49.185 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 115/165 2024-09-10T22:14:49.185 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 116/165 2024-09-10T22:14:49.185 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 117/165 2024-09-10T22:14:49.185 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 118/165 2024-09-10T22:14:49.185 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 119/165 2024-09-10T22:14:49.185 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 120/165 2024-09-10T22:14:49.185 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 121/165 2024-09-10T22:14:49.185 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 122/165 2024-09-10T22:14:49.185 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 123/165 2024-09-10T22:14:49.185 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 124/165 2024-09-10T22:14:49.186 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 125/165 2024-09-10T22:14:49.186 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 126/165 2024-09-10T22:14:49.186 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 127/165 2024-09-10T22:14:49.186 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 128/165 2024-09-10T22:14:49.186 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 129/165 2024-09-10T22:14:49.186 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 130/165 2024-09-10T22:14:49.186 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 131/165 2024-09-10T22:14:49.186 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 132/165 2024-09-10T22:14:49.186 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 133/165 2024-09-10T22:14:49.186 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 134/165 2024-09-10T22:14:49.186 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 135/165 2024-09-10T22:14:49.186 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 136/165 2024-09-10T22:14:49.186 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 137/165 2024-09-10T22:14:49.187 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 138/165 2024-09-10T22:14:49.187 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 139/165 2024-09-10T22:14:49.187 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 140/165 2024-09-10T22:14:49.187 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 141/165 2024-09-10T22:14:49.187 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 142/165 2024-09-10T22:14:49.187 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 143/165 2024-09-10T22:14:49.187 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 144/165 2024-09-10T22:14:49.187 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 145/165 2024-09-10T22:14:49.187 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 146/165 2024-09-10T22:14:49.187 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 147/165 2024-09-10T22:14:49.187 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : re2-1:20211101-20.el9.x86_64 148/165 2024-09-10T22:14:49.187 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 149/165 2024-09-10T22:14:49.187 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : librados2-2:19.3.0-4854.g8f219c47.el9.x86_64 150/165 2024-09-10T22:14:49.188 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 151/165 2024-09-10T22:14:49.188 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : librbd1-2:19.3.0-4854.g8f219c47.el9.x86_64 152/165 2024-09-10T22:14:49.188 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 153/165 2024-09-10T22:14:49.188 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : NetworkManager-1:1.49.90-1.el9.x86_64 154/165 2024-09-10T22:14:49.188 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : NetworkManager-1:1.48.8-1.el9.x86_64 155/165 2024-09-10T22:14:49.188 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : NetworkManager-libnm-1:1.49.90-1.el9.x86_64 156/165 2024-09-10T22:14:49.188 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 157/165 2024-09-10T22:14:49.188 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : NetworkManager-team-1:1.49.90-1.el9.x86_64 158/165 2024-09-10T22:14:49.188 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : NetworkManager-team-1:1.48.8-1.el9.x86_64 159/165 2024-09-10T22:14:49.188 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : NetworkManager-tui-1:1.49.90-1.el9.x86_64 160/165 2024-09-10T22:14:49.188 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : NetworkManager-tui-1:1.48.8-1.el9.x86_64 161/165 2024-09-10T22:14:49.188 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : openssl-1:3.2.2-6.el9.x86_64 162/165 2024-09-10T22:14:49.189 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : openssl-1:3.2.2-4.el9.x86_64 163/165 2024-09-10T22:14:49.189 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : openssl-libs-1:3.2.2-6.el9.x86_64 164/165 2024-09-10T22:14:49.349 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : openssl-libs-1:3.2.2-4.el9.x86_64 165/165 2024-09-10T22:14:49.349 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-10T22:14:49.349 INFO:teuthology.orchestra.run.smithi138.stdout:Upgraded: 2024-09-10T22:14:49.349 INFO:teuthology.orchestra.run.smithi138.stdout: NetworkManager-1:1.49.90-1.el9.x86_64 2024-09-10T22:14:49.349 INFO:teuthology.orchestra.run.smithi138.stdout: NetworkManager-libnm-1:1.49.90-1.el9.x86_64 2024-09-10T22:14:49.349 INFO:teuthology.orchestra.run.smithi138.stdout: NetworkManager-team-1:1.49.90-1.el9.x86_64 2024-09-10T22:14:49.349 INFO:teuthology.orchestra.run.smithi138.stdout: NetworkManager-tui-1:1.49.90-1.el9.x86_64 2024-09-10T22:14:49.349 INFO:teuthology.orchestra.run.smithi138.stdout: librados2-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T22:14:49.349 INFO:teuthology.orchestra.run.smithi138.stdout: librbd1-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T22:14:49.350 INFO:teuthology.orchestra.run.smithi138.stdout: openssl-1:3.2.2-6.el9.x86_64 2024-09-10T22:14:49.350 INFO:teuthology.orchestra.run.smithi138.stdout: openssl-libs-1:3.2.2-6.el9.x86_64 2024-09-10T22:14:49.350 INFO:teuthology.orchestra.run.smithi138.stdout:Installed: 2024-09-10T22:14:49.350 INFO:teuthology.orchestra.run.smithi138.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-10T22:14:49.350 INFO:teuthology.orchestra.run.smithi138.stdout: automake-1.16.2-8.el9.noarch 2024-09-10T22:14:49.350 INFO:teuthology.orchestra.run.smithi138.stdout: bison-3.7.4-5.el9.x86_64 2024-09-10T22:14:49.350 INFO:teuthology.orchestra.run.smithi138.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-10T22:14:49.350 INFO:teuthology.orchestra.run.smithi138.stdout: ceph-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T22:14:49.350 INFO:teuthology.orchestra.run.smithi138.stdout: ceph-base-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T22:14:49.350 INFO:teuthology.orchestra.run.smithi138.stdout: ceph-common-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T22:14:49.350 INFO:teuthology.orchestra.run.smithi138.stdout: ceph-fuse-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T22:14:49.350 INFO:teuthology.orchestra.run.smithi138.stdout: ceph-grafana-dashboards-2:19.3.0-4854.g8f219c47.el9.noarch 2024-09-10T22:14:49.351 INFO:teuthology.orchestra.run.smithi138.stdout: ceph-immutable-object-cache-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T22:14:49.351 INFO:teuthology.orchestra.run.smithi138.stdout: ceph-mds-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T22:14:49.351 INFO:teuthology.orchestra.run.smithi138.stdout: ceph-mgr-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T22:14:49.351 INFO:teuthology.orchestra.run.smithi138.stdout: ceph-mgr-cephadm-2:19.3.0-4854.g8f219c47.el9.noarch 2024-09-10T22:14:49.351 INFO:teuthology.orchestra.run.smithi138.stdout: ceph-mgr-dashboard-2:19.3.0-4854.g8f219c47.el9.noarch 2024-09-10T22:14:49.351 INFO:teuthology.orchestra.run.smithi138.stdout: ceph-mgr-diskprediction-local-2:19.3.0-4854.g8f219c47.el9.noarch 2024-09-10T22:14:49.351 INFO:teuthology.orchestra.run.smithi138.stdout: ceph-mgr-modules-core-2:19.3.0-4854.g8f219c47.el9.noarch 2024-09-10T22:14:49.351 INFO:teuthology.orchestra.run.smithi138.stdout: ceph-mgr-rook-2:19.3.0-4854.g8f219c47.el9.noarch 2024-09-10T22:14:49.351 INFO:teuthology.orchestra.run.smithi138.stdout: ceph-mon-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T22:14:49.352 INFO:teuthology.orchestra.run.smithi138.stdout: ceph-osd-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T22:14:49.352 INFO:teuthology.orchestra.run.smithi138.stdout: ceph-prometheus-alerts-2:19.3.0-4854.g8f219c47.el9.noarch 2024-09-10T22:14:49.352 INFO:teuthology.orchestra.run.smithi138.stdout: ceph-radosgw-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T22:14:49.352 INFO:teuthology.orchestra.run.smithi138.stdout: ceph-selinux-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T22:14:49.352 INFO:teuthology.orchestra.run.smithi138.stdout: ceph-test-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T22:14:49.352 INFO:teuthology.orchestra.run.smithi138.stdout: ceph-volume-2:19.3.0-4854.g8f219c47.el9.noarch 2024-09-10T22:14:49.352 INFO:teuthology.orchestra.run.smithi138.stdout: cephadm-2:19.3.0-4854.g8f219c47.el9.noarch 2024-09-10T22:14:49.352 INFO:teuthology.orchestra.run.smithi138.stdout: cephfs-mirror-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T22:14:49.352 INFO:teuthology.orchestra.run.smithi138.stdout: cephfs-shell-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T22:14:49.352 INFO:teuthology.orchestra.run.smithi138.stdout: cephfs-top-2:19.3.0-4854.g8f219c47.el9.noarch 2024-09-10T22:14:49.352 INFO:teuthology.orchestra.run.smithi138.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-09-10T22:14:49.352 INFO:teuthology.orchestra.run.smithi138.stdout: flex-2.6.4-9.el9.x86_64 2024-09-10T22:14:49.352 INFO:teuthology.orchestra.run.smithi138.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-10T22:14:49.353 INFO:teuthology.orchestra.run.smithi138.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-10T22:14:49.353 INFO:teuthology.orchestra.run.smithi138.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-10T22:14:49.353 INFO:teuthology.orchestra.run.smithi138.stdout: fuse-2.9.9-16.el9.x86_64 2024-09-10T22:14:49.353 INFO:teuthology.orchestra.run.smithi138.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-09-10T22:14:49.353 INFO:teuthology.orchestra.run.smithi138.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-10T22:14:49.353 INFO:teuthology.orchestra.run.smithi138.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-09-10T22:14:49.353 INFO:teuthology.orchestra.run.smithi138.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-10T22:14:49.353 INFO:teuthology.orchestra.run.smithi138.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-10T22:14:49.353 INFO:teuthology.orchestra.run.smithi138.stdout: libcephfs-devel-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T22:14:49.353 INFO:teuthology.orchestra.run.smithi138.stdout: libcephfs2-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T22:14:49.353 INFO:teuthology.orchestra.run.smithi138.stdout: libcephsqlite-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T22:14:49.353 INFO:teuthology.orchestra.run.smithi138.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-10T22:14:49.353 INFO:teuthology.orchestra.run.smithi138.stdout: libnbd-1.20.2-2.el9.x86_64 2024-09-10T22:14:49.354 INFO:teuthology.orchestra.run.smithi138.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-10T22:14:49.354 INFO:teuthology.orchestra.run.smithi138.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-10T22:14:49.354 INFO:teuthology.orchestra.run.smithi138.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-10T22:14:49.354 INFO:teuthology.orchestra.run.smithi138.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-10T22:14:49.354 INFO:teuthology.orchestra.run.smithi138.stdout: librados-devel-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T22:14:49.354 INFO:teuthology.orchestra.run.smithi138.stdout: libradosstriper1-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T22:14:49.354 INFO:teuthology.orchestra.run.smithi138.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-10T22:14:49.354 INFO:teuthology.orchestra.run.smithi138.stdout: librgw2-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T22:14:49.354 INFO:teuthology.orchestra.run.smithi138.stdout: libtool-2.4.6-46.el9.x86_64 2024-09-10T22:14:49.354 INFO:teuthology.orchestra.run.smithi138.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-10T22:14:49.354 INFO:teuthology.orchestra.run.smithi138.stdout: libuuid-devel-2.37.4-20.el9.x86_64 2024-09-10T22:14:49.354 INFO:teuthology.orchestra.run.smithi138.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-09-10T22:14:49.354 INFO:teuthology.orchestra.run.smithi138.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-10T22:14:49.354 INFO:teuthology.orchestra.run.smithi138.stdout: lua-5.4.4-4.el9.x86_64 2024-09-10T22:14:49.355 INFO:teuthology.orchestra.run.smithi138.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-10T22:14:49.355 INFO:teuthology.orchestra.run.smithi138.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-10T22:14:49.355 INFO:teuthology.orchestra.run.smithi138.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-10T22:14:49.355 INFO:teuthology.orchestra.run.smithi138.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-10T22:14:49.355 INFO:teuthology.orchestra.run.smithi138.stdout: openssl-devel-1:3.2.2-6.el9.x86_64 2024-09-10T22:14:49.355 INFO:teuthology.orchestra.run.smithi138.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-10T22:14:49.355 INFO:teuthology.orchestra.run.smithi138.stdout: postgresql-13.16-1.el9.x86_64 2024-09-10T22:14:49.355 INFO:teuthology.orchestra.run.smithi138.stdout: postgresql-contrib-13.16-1.el9.x86_64 2024-09-10T22:14:49.355 INFO:teuthology.orchestra.run.smithi138.stdout: postgresql-private-libs-13.16-1.el9.x86_64 2024-09-10T22:14:49.355 INFO:teuthology.orchestra.run.smithi138.stdout: postgresql-server-13.16-1.el9.x86_64 2024-09-10T22:14:49.355 INFO:teuthology.orchestra.run.smithi138.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-10T22:14:49.355 INFO:teuthology.orchestra.run.smithi138.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-10T22:14:49.355 INFO:teuthology.orchestra.run.smithi138.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-10T22:14:49.356 INFO:teuthology.orchestra.run.smithi138.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-09-10T22:14:49.356 INFO:teuthology.orchestra.run.smithi138.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-10T22:14:49.356 INFO:teuthology.orchestra.run.smithi138.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-10T22:14:49.356 INFO:teuthology.orchestra.run.smithi138.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-10T22:14:49.356 INFO:teuthology.orchestra.run.smithi138.stdout: python3-ceph-argparse-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T22:14:49.356 INFO:teuthology.orchestra.run.smithi138.stdout: python3-ceph-common-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T22:14:49.356 INFO:teuthology.orchestra.run.smithi138.stdout: python3-cephfs-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T22:14:49.356 INFO:teuthology.orchestra.run.smithi138.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-10T22:14:49.356 INFO:teuthology.orchestra.run.smithi138.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-10T22:14:49.356 INFO:teuthology.orchestra.run.smithi138.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-10T22:14:49.356 INFO:teuthology.orchestra.run.smithi138.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-10T22:14:49.356 INFO:teuthology.orchestra.run.smithi138.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-09-10T22:14:49.356 INFO:teuthology.orchestra.run.smithi138.stdout: python3-colorama-0.4.6-3.el9.noarch 2024-09-10T22:14:49.357 INFO:teuthology.orchestra.run.smithi138.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-10T22:14:49.357 INFO:teuthology.orchestra.run.smithi138.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-10T22:14:49.357 INFO:teuthology.orchestra.run.smithi138.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-10T22:14:49.357 INFO:teuthology.orchestra.run.smithi138.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-10T22:14:49.357 INFO:teuthology.orchestra.run.smithi138.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-10T22:14:49.357 INFO:teuthology.orchestra.run.smithi138.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-10T22:14:49.357 INFO:teuthology.orchestra.run.smithi138.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-10T22:14:49.357 INFO:teuthology.orchestra.run.smithi138.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-10T22:14:49.357 INFO:teuthology.orchestra.run.smithi138.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-10T22:14:49.357 INFO:teuthology.orchestra.run.smithi138.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-10T22:14:49.357 INFO:teuthology.orchestra.run.smithi138.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-10T22:14:49.357 INFO:teuthology.orchestra.run.smithi138.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-10T22:14:49.357 INFO:teuthology.orchestra.run.smithi138.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-10T22:14:49.357 INFO:teuthology.orchestra.run.smithi138.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-10T22:14:49.358 INFO:teuthology.orchestra.run.smithi138.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-10T22:14:49.358 INFO:teuthology.orchestra.run.smithi138.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-10T22:14:49.358 INFO:teuthology.orchestra.run.smithi138.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-10T22:14:49.358 INFO:teuthology.orchestra.run.smithi138.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-10T22:14:49.358 INFO:teuthology.orchestra.run.smithi138.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-10T22:14:49.358 INFO:teuthology.orchestra.run.smithi138.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-10T22:14:49.358 INFO:teuthology.orchestra.run.smithi138.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-10T22:14:49.358 INFO:teuthology.orchestra.run.smithi138.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-10T22:14:49.358 INFO:teuthology.orchestra.run.smithi138.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-10T22:14:49.358 INFO:teuthology.orchestra.run.smithi138.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-10T22:14:49.358 INFO:teuthology.orchestra.run.smithi138.stdout: python3-ply-3.11-14.el9.noarch 2024-09-10T22:14:49.358 INFO:teuthology.orchestra.run.smithi138.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-10T22:14:49.358 INFO:teuthology.orchestra.run.smithi138.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-10T22:14:49.359 INFO:teuthology.orchestra.run.smithi138.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-10T22:14:49.359 INFO:teuthology.orchestra.run.smithi138.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-10T22:14:49.359 INFO:teuthology.orchestra.run.smithi138.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-10T22:14:49.359 INFO:teuthology.orchestra.run.smithi138.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-10T22:14:49.359 INFO:teuthology.orchestra.run.smithi138.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-10T22:14:49.359 INFO:teuthology.orchestra.run.smithi138.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-09-10T22:14:49.359 INFO:teuthology.orchestra.run.smithi138.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-10T22:14:49.359 INFO:teuthology.orchestra.run.smithi138.stdout: python3-rados-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T22:14:49.359 INFO:teuthology.orchestra.run.smithi138.stdout: python3-rbd-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T22:14:49.359 INFO:teuthology.orchestra.run.smithi138.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-10T22:14:49.359 INFO:teuthology.orchestra.run.smithi138.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-10T22:14:49.359 INFO:teuthology.orchestra.run.smithi138.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-10T22:14:49.359 INFO:teuthology.orchestra.run.smithi138.stdout: python3-rgw-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T22:14:49.360 INFO:teuthology.orchestra.run.smithi138.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-10T22:14:49.360 INFO:teuthology.orchestra.run.smithi138.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-10T22:14:49.360 INFO:teuthology.orchestra.run.smithi138.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-10T22:14:49.360 INFO:teuthology.orchestra.run.smithi138.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-10T22:14:49.360 INFO:teuthology.orchestra.run.smithi138.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-10T22:14:49.360 INFO:teuthology.orchestra.run.smithi138.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-10T22:14:49.360 INFO:teuthology.orchestra.run.smithi138.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-10T22:14:49.360 INFO:teuthology.orchestra.run.smithi138.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-09-10T22:14:49.360 INFO:teuthology.orchestra.run.smithi138.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-10T22:14:49.360 INFO:teuthology.orchestra.run.smithi138.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-10T22:14:49.360 INFO:teuthology.orchestra.run.smithi138.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-10T22:14:49.360 INFO:teuthology.orchestra.run.smithi138.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-10T22:14:49.360 INFO:teuthology.orchestra.run.smithi138.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-10T22:14:49.361 INFO:teuthology.orchestra.run.smithi138.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-10T22:14:49.361 INFO:teuthology.orchestra.run.smithi138.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-10T22:14:49.361 INFO:teuthology.orchestra.run.smithi138.stdout: rbd-fuse-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T22:14:49.361 INFO:teuthology.orchestra.run.smithi138.stdout: rbd-mirror-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T22:14:49.361 INFO:teuthology.orchestra.run.smithi138.stdout: rbd-nbd-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T22:14:49.361 INFO:teuthology.orchestra.run.smithi138.stdout: re2-1:20211101-20.el9.x86_64 2024-09-10T22:14:49.361 INFO:teuthology.orchestra.run.smithi138.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-10T22:14:49.361 INFO:teuthology.orchestra.run.smithi138.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-10T22:14:49.361 INFO:teuthology.orchestra.run.smithi138.stdout: uuid-1.6.2-55.el9.x86_64 2024-09-10T22:14:49.361 INFO:teuthology.orchestra.run.smithi138.stdout: xfsprogs-devel-6.4.0-4.el9.x86_64 2024-09-10T22:14:49.361 INFO:teuthology.orchestra.run.smithi138.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-10T22:14:49.362 INFO:teuthology.orchestra.run.smithi138.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-09-10T22:14:49.362 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-10T22:14:49.362 INFO:teuthology.orchestra.run.smithi138.stdout:Complete! 2024-09-10T22:14:49.790 DEBUG:teuthology.parallel:result is None 2024-09-10T22:14:51.799 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : openssl-libs-1:3.2.2-4.el9.x86_64 165/165 2024-09-10T22:14:51.799 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-09-10T22:14:51.799 INFO:teuthology.orchestra.run.smithi135.stdout:Upgraded: 2024-09-10T22:14:51.800 INFO:teuthology.orchestra.run.smithi135.stdout: NetworkManager-1:1.49.90-1.el9.x86_64 2024-09-10T22:14:51.800 INFO:teuthology.orchestra.run.smithi135.stdout: NetworkManager-libnm-1:1.49.90-1.el9.x86_64 2024-09-10T22:14:51.800 INFO:teuthology.orchestra.run.smithi135.stdout: NetworkManager-team-1:1.49.90-1.el9.x86_64 2024-09-10T22:14:51.800 INFO:teuthology.orchestra.run.smithi135.stdout: NetworkManager-tui-1:1.49.90-1.el9.x86_64 2024-09-10T22:14:51.800 INFO:teuthology.orchestra.run.smithi135.stdout: librados2-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T22:14:51.800 INFO:teuthology.orchestra.run.smithi135.stdout: librbd1-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T22:14:51.800 INFO:teuthology.orchestra.run.smithi135.stdout: openssl-1:3.2.2-6.el9.x86_64 2024-09-10T22:14:51.800 INFO:teuthology.orchestra.run.smithi135.stdout: openssl-libs-1:3.2.2-6.el9.x86_64 2024-09-10T22:14:51.800 INFO:teuthology.orchestra.run.smithi135.stdout:Installed: 2024-09-10T22:14:51.800 INFO:teuthology.orchestra.run.smithi135.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-10T22:14:51.800 INFO:teuthology.orchestra.run.smithi135.stdout: automake-1.16.2-8.el9.noarch 2024-09-10T22:14:51.800 INFO:teuthology.orchestra.run.smithi135.stdout: bison-3.7.4-5.el9.x86_64 2024-09-10T22:14:51.801 INFO:teuthology.orchestra.run.smithi135.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-10T22:14:51.801 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T22:14:51.801 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-base-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T22:14:51.801 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-common-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T22:14:51.801 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-fuse-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T22:14:51.801 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-grafana-dashboards-2:19.3.0-4854.g8f219c47.el9.noarch 2024-09-10T22:14:51.801 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-immutable-object-cache-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T22:14:51.801 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-mds-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T22:14:51.801 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-mgr-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T22:14:51.801 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-mgr-cephadm-2:19.3.0-4854.g8f219c47.el9.noarch 2024-09-10T22:14:51.801 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-mgr-dashboard-2:19.3.0-4854.g8f219c47.el9.noarch 2024-09-10T22:14:51.801 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-mgr-diskprediction-local-2:19.3.0-4854.g8f219c47.el9.noarch 2024-09-10T22:14:51.802 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-mgr-modules-core-2:19.3.0-4854.g8f219c47.el9.noarch 2024-09-10T22:14:51.802 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-mgr-rook-2:19.3.0-4854.g8f219c47.el9.noarch 2024-09-10T22:14:51.802 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-mon-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T22:14:51.802 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-osd-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T22:14:51.802 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-prometheus-alerts-2:19.3.0-4854.g8f219c47.el9.noarch 2024-09-10T22:14:51.802 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-radosgw-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T22:14:51.802 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-selinux-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T22:14:51.802 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-test-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T22:14:51.802 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-volume-2:19.3.0-4854.g8f219c47.el9.noarch 2024-09-10T22:14:51.802 INFO:teuthology.orchestra.run.smithi135.stdout: cephadm-2:19.3.0-4854.g8f219c47.el9.noarch 2024-09-10T22:14:51.802 INFO:teuthology.orchestra.run.smithi135.stdout: cephfs-mirror-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T22:14:51.802 INFO:teuthology.orchestra.run.smithi135.stdout: cephfs-shell-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T22:14:51.802 INFO:teuthology.orchestra.run.smithi135.stdout: cephfs-top-2:19.3.0-4854.g8f219c47.el9.noarch 2024-09-10T22:14:51.803 INFO:teuthology.orchestra.run.smithi135.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-09-10T22:14:51.803 INFO:teuthology.orchestra.run.smithi135.stdout: flex-2.6.4-9.el9.x86_64 2024-09-10T22:14:51.803 INFO:teuthology.orchestra.run.smithi135.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-10T22:14:51.803 INFO:teuthology.orchestra.run.smithi135.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-10T22:14:51.803 INFO:teuthology.orchestra.run.smithi135.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-10T22:14:51.803 INFO:teuthology.orchestra.run.smithi135.stdout: fuse-2.9.9-16.el9.x86_64 2024-09-10T22:14:51.803 INFO:teuthology.orchestra.run.smithi135.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-09-10T22:14:51.803 INFO:teuthology.orchestra.run.smithi135.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-10T22:14:51.803 INFO:teuthology.orchestra.run.smithi135.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-09-10T22:14:51.803 INFO:teuthology.orchestra.run.smithi135.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-10T22:14:51.803 INFO:teuthology.orchestra.run.smithi135.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-10T22:14:51.803 INFO:teuthology.orchestra.run.smithi135.stdout: libcephfs-devel-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T22:14:51.803 INFO:teuthology.orchestra.run.smithi135.stdout: libcephfs2-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T22:14:51.804 INFO:teuthology.orchestra.run.smithi135.stdout: libcephsqlite-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T22:14:51.804 INFO:teuthology.orchestra.run.smithi135.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-10T22:14:51.804 INFO:teuthology.orchestra.run.smithi135.stdout: libnbd-1.20.2-2.el9.x86_64 2024-09-10T22:14:51.804 INFO:teuthology.orchestra.run.smithi135.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-10T22:14:51.804 INFO:teuthology.orchestra.run.smithi135.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-10T22:14:51.804 INFO:teuthology.orchestra.run.smithi135.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-10T22:14:51.804 INFO:teuthology.orchestra.run.smithi135.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-10T22:14:51.804 INFO:teuthology.orchestra.run.smithi135.stdout: librados-devel-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T22:14:51.804 INFO:teuthology.orchestra.run.smithi135.stdout: libradosstriper1-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T22:14:51.804 INFO:teuthology.orchestra.run.smithi135.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-10T22:14:51.804 INFO:teuthology.orchestra.run.smithi135.stdout: librgw2-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T22:14:51.804 INFO:teuthology.orchestra.run.smithi135.stdout: libtool-2.4.6-46.el9.x86_64 2024-09-10T22:14:51.804 INFO:teuthology.orchestra.run.smithi135.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-10T22:14:51.805 INFO:teuthology.orchestra.run.smithi135.stdout: libuuid-devel-2.37.4-20.el9.x86_64 2024-09-10T22:14:51.805 INFO:teuthology.orchestra.run.smithi135.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-09-10T22:14:51.805 INFO:teuthology.orchestra.run.smithi135.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-10T22:14:51.805 INFO:teuthology.orchestra.run.smithi135.stdout: lua-5.4.4-4.el9.x86_64 2024-09-10T22:14:51.805 INFO:teuthology.orchestra.run.smithi135.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-10T22:14:51.805 INFO:teuthology.orchestra.run.smithi135.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-10T22:14:51.805 INFO:teuthology.orchestra.run.smithi135.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-10T22:14:51.805 INFO:teuthology.orchestra.run.smithi135.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-10T22:14:51.805 INFO:teuthology.orchestra.run.smithi135.stdout: openssl-devel-1:3.2.2-6.el9.x86_64 2024-09-10T22:14:51.805 INFO:teuthology.orchestra.run.smithi135.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-10T22:14:51.805 INFO:teuthology.orchestra.run.smithi135.stdout: postgresql-13.16-1.el9.x86_64 2024-09-10T22:14:51.805 INFO:teuthology.orchestra.run.smithi135.stdout: postgresql-contrib-13.16-1.el9.x86_64 2024-09-10T22:14:51.806 INFO:teuthology.orchestra.run.smithi135.stdout: postgresql-private-libs-13.16-1.el9.x86_64 2024-09-10T22:14:51.806 INFO:teuthology.orchestra.run.smithi135.stdout: postgresql-server-13.16-1.el9.x86_64 2024-09-10T22:14:51.806 INFO:teuthology.orchestra.run.smithi135.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-10T22:14:51.806 INFO:teuthology.orchestra.run.smithi135.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-10T22:14:51.806 INFO:teuthology.orchestra.run.smithi135.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-10T22:14:51.806 INFO:teuthology.orchestra.run.smithi135.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-09-10T22:14:51.806 INFO:teuthology.orchestra.run.smithi135.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-10T22:14:51.806 INFO:teuthology.orchestra.run.smithi135.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-10T22:14:51.806 INFO:teuthology.orchestra.run.smithi135.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-10T22:14:51.806 INFO:teuthology.orchestra.run.smithi135.stdout: python3-ceph-argparse-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T22:14:51.806 INFO:teuthology.orchestra.run.smithi135.stdout: python3-ceph-common-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T22:14:51.806 INFO:teuthology.orchestra.run.smithi135.stdout: python3-cephfs-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T22:14:51.806 INFO:teuthology.orchestra.run.smithi135.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-10T22:14:51.807 INFO:teuthology.orchestra.run.smithi135.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-10T22:14:51.807 INFO:teuthology.orchestra.run.smithi135.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-10T22:14:51.807 INFO:teuthology.orchestra.run.smithi135.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-10T22:14:51.807 INFO:teuthology.orchestra.run.smithi135.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-09-10T22:14:51.807 INFO:teuthology.orchestra.run.smithi135.stdout: python3-colorama-0.4.6-3.el9.noarch 2024-09-10T22:14:51.807 INFO:teuthology.orchestra.run.smithi135.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-10T22:14:51.807 INFO:teuthology.orchestra.run.smithi135.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-10T22:14:51.807 INFO:teuthology.orchestra.run.smithi135.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-10T22:14:51.807 INFO:teuthology.orchestra.run.smithi135.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-10T22:14:51.807 INFO:teuthology.orchestra.run.smithi135.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-10T22:14:51.807 INFO:teuthology.orchestra.run.smithi135.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-10T22:14:51.807 INFO:teuthology.orchestra.run.smithi135.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-10T22:14:51.807 INFO:teuthology.orchestra.run.smithi135.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-10T22:14:51.808 INFO:teuthology.orchestra.run.smithi135.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-10T22:14:51.808 INFO:teuthology.orchestra.run.smithi135.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-10T22:14:51.808 INFO:teuthology.orchestra.run.smithi135.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-10T22:14:51.808 INFO:teuthology.orchestra.run.smithi135.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-10T22:14:51.808 INFO:teuthology.orchestra.run.smithi135.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-10T22:14:51.808 INFO:teuthology.orchestra.run.smithi135.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-10T22:14:51.808 INFO:teuthology.orchestra.run.smithi135.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-10T22:14:51.808 INFO:teuthology.orchestra.run.smithi135.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-10T22:14:51.808 INFO:teuthology.orchestra.run.smithi135.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-10T22:14:51.808 INFO:teuthology.orchestra.run.smithi135.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-10T22:14:51.808 INFO:teuthology.orchestra.run.smithi135.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-10T22:14:51.808 INFO:teuthology.orchestra.run.smithi135.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-10T22:14:51.809 INFO:teuthology.orchestra.run.smithi135.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-10T22:14:51.809 INFO:teuthology.orchestra.run.smithi135.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-10T22:14:51.809 INFO:teuthology.orchestra.run.smithi135.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-10T22:14:51.809 INFO:teuthology.orchestra.run.smithi135.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-10T22:14:51.809 INFO:teuthology.orchestra.run.smithi135.stdout: python3-ply-3.11-14.el9.noarch 2024-09-10T22:14:51.809 INFO:teuthology.orchestra.run.smithi135.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-10T22:14:51.809 INFO:teuthology.orchestra.run.smithi135.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-10T22:14:51.809 INFO:teuthology.orchestra.run.smithi135.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-10T22:14:51.809 INFO:teuthology.orchestra.run.smithi135.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-10T22:14:51.809 INFO:teuthology.orchestra.run.smithi135.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-10T22:14:51.809 INFO:teuthology.orchestra.run.smithi135.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-10T22:14:51.809 INFO:teuthology.orchestra.run.smithi135.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-10T22:14:51.810 INFO:teuthology.orchestra.run.smithi135.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-09-10T22:14:51.810 INFO:teuthology.orchestra.run.smithi135.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-10T22:14:51.810 INFO:teuthology.orchestra.run.smithi135.stdout: python3-rados-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T22:14:51.810 INFO:teuthology.orchestra.run.smithi135.stdout: python3-rbd-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T22:14:51.810 INFO:teuthology.orchestra.run.smithi135.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-10T22:14:51.810 INFO:teuthology.orchestra.run.smithi135.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-10T22:14:51.810 INFO:teuthology.orchestra.run.smithi135.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-10T22:14:51.810 INFO:teuthology.orchestra.run.smithi135.stdout: python3-rgw-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T22:14:51.810 INFO:teuthology.orchestra.run.smithi135.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-10T22:14:51.810 INFO:teuthology.orchestra.run.smithi135.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-10T22:14:51.810 INFO:teuthology.orchestra.run.smithi135.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-10T22:14:51.810 INFO:teuthology.orchestra.run.smithi135.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-10T22:14:51.810 INFO:teuthology.orchestra.run.smithi135.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-10T22:14:51.810 INFO:teuthology.orchestra.run.smithi135.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-10T22:14:51.811 INFO:teuthology.orchestra.run.smithi135.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-10T22:14:51.811 INFO:teuthology.orchestra.run.smithi135.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-09-10T22:14:51.811 INFO:teuthology.orchestra.run.smithi135.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-10T22:14:51.811 INFO:teuthology.orchestra.run.smithi135.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-10T22:14:51.811 INFO:teuthology.orchestra.run.smithi135.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-10T22:14:51.811 INFO:teuthology.orchestra.run.smithi135.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-10T22:14:51.811 INFO:teuthology.orchestra.run.smithi135.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-10T22:14:51.811 INFO:teuthology.orchestra.run.smithi135.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-10T22:14:51.811 INFO:teuthology.orchestra.run.smithi135.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-10T22:14:51.811 INFO:teuthology.orchestra.run.smithi135.stdout: rbd-fuse-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T22:14:51.811 INFO:teuthology.orchestra.run.smithi135.stdout: rbd-mirror-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T22:14:51.811 INFO:teuthology.orchestra.run.smithi135.stdout: rbd-nbd-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T22:14:51.811 INFO:teuthology.orchestra.run.smithi135.stdout: re2-1:20211101-20.el9.x86_64 2024-09-10T22:14:51.811 INFO:teuthology.orchestra.run.smithi135.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-10T22:14:51.812 INFO:teuthology.orchestra.run.smithi135.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-10T22:14:51.812 INFO:teuthology.orchestra.run.smithi135.stdout: uuid-1.6.2-55.el9.x86_64 2024-09-10T22:14:51.812 INFO:teuthology.orchestra.run.smithi135.stdout: xfsprogs-devel-6.4.0-4.el9.x86_64 2024-09-10T22:14:51.812 INFO:teuthology.orchestra.run.smithi135.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-10T22:14:51.812 INFO:teuthology.orchestra.run.smithi135.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-09-10T22:14:51.812 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-09-10T22:14:51.812 INFO:teuthology.orchestra.run.smithi135.stdout:Complete! 2024-09-10T22:14:52.236 DEBUG:teuthology.parallel:result is None 2024-09-10T22:14:52.740 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : ceph-test-2:19.3.0-4854.g8f219c47.el9.x86_64 142/165 2024-09-10T22:14:52.781 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : rbd-fuse-2:19.3.0-4854.g8f219c47.el9.x86_64 143/165 2024-09-10T22:14:52.847 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : rbd-nbd-2:19.3.0-4854.g8f219c47.el9.x86_64 144/165 2024-09-10T22:14:52.878 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : xfsprogs-devel-6.4.0-4.el9.x86_64 145/165 2024-09-10T22:14:52.906 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 146/165 2024-09-10T22:14:53.101 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : cephfs-shell-2:19.3.0-4854.g8f219c47.el9.x86_64 147/165 2024-09-10T22:14:53.144 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : postgresql-contrib-13.16-1.el9.x86_64 148/165 2024-09-10T22:14:53.174 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : libcephfs-devel-2:19.3.0-4854.g8f219c47.el9.x86_ 149/165 2024-09-10T22:14:53.204 INFO:teuthology.orchestra.run.smithi019.stdout: Upgrading : NetworkManager-team-1:1.49.90-1.el9.x86_64 150/165 2024-09-10T22:14:53.241 INFO:teuthology.orchestra.run.smithi019.stdout: Upgrading : NetworkManager-tui-1:1.49.90-1.el9.x86_64 151/165 2024-09-10T22:14:53.759 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 152/165 2024-09-10T22:14:53.797 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : postgresql-server-13.16-1.el9.x86_64 152/165 2024-09-10T22:14:53.819 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 152/165 2024-09-10T22:14:54.721 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : cephfs-top-2:19.3.0-4854.g8f219c47.el9.noarch 153/165 2024-09-10T22:14:54.810 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : openssl-devel-1:3.2.2-6.el9.x86_64 154/165 2024-09-10T22:14:54.860 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 155/165 2024-09-10T22:14:54.959 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : flex-2.6.4-9.el9.x86_64 156/165 2024-09-10T22:14:54.988 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : bison-3.7.4-5.el9.x86_64 157/165 2024-09-10T22:14:55.013 INFO:teuthology.orchestra.run.smithi019.stdout: Cleanup : NetworkManager-tui-1:1.48.8-1.el9.x86_64 158/165 2024-09-10T22:14:55.040 INFO:teuthology.orchestra.run.smithi019.stdout: Cleanup : openssl-1:3.2.2-4.el9.x86_64 159/165 2024-09-10T22:14:55.040 INFO:teuthology.orchestra.run.smithi019.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 160/165 2024-09-10T22:14:55.141 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 160/165 2024-09-10T22:14:55.141 INFO:teuthology.orchestra.run.smithi019.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 161/165 2024-09-10T22:14:55.225 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 161/165 2024-09-10T22:14:55.249 INFO:teuthology.orchestra.run.smithi019.stdout: Cleanup : NetworkManager-team-1:1.48.8-1.el9.x86_64 162/165 2024-09-10T22:14:55.255 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 163/165 2024-09-10T22:14:55.255 INFO:teuthology.orchestra.run.smithi019.stdout: Cleanup : NetworkManager-1:1.48.8-1.el9.x86_64 163/165 2024-09-10T22:14:55.443 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 163/165 2024-09-10T22:14:55.443 INFO:teuthology.orchestra.run.smithi019.stdout: Cleanup : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 164/165 2024-09-10T22:14:55.519 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: NetworkManager-libnm-1:1.48.8-1.el9.x86_64 164/165 2024-09-10T22:14:55.587 INFO:teuthology.orchestra.run.smithi019.stdout: Cleanup : openssl-libs-1:3.2.2-4.el9.x86_64 165/165 2024-09-10T22:15:02.187 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: openssl-libs-1:3.2.2-4.el9.x86_64 165/165 2024-09-10T22:15:02.187 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : ceph-2:19.3.0-4854.g8f219c47.el9.x86_64 1/165 2024-09-10T22:15:02.187 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : ceph-base-2:19.3.0-4854.g8f219c47.el9.x86_64 2/165 2024-09-10T22:15:02.187 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : ceph-common-2:19.3.0-4854.g8f219c47.el9.x86_64 3/165 2024-09-10T22:15:02.187 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : ceph-fuse-2:19.3.0-4854.g8f219c47.el9.x86_64 4/165 2024-09-10T22:15:02.187 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : ceph-immutable-object-cache-2:19.3.0-4854.g8f219 5/165 2024-09-10T22:15:02.188 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : ceph-mds-2:19.3.0-4854.g8f219c47.el9.x86_64 6/165 2024-09-10T22:15:02.188 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : ceph-mgr-2:19.3.0-4854.g8f219c47.el9.x86_64 7/165 2024-09-10T22:15:02.188 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : ceph-mon-2:19.3.0-4854.g8f219c47.el9.x86_64 8/165 2024-09-10T22:15:02.188 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : ceph-osd-2:19.3.0-4854.g8f219c47.el9.x86_64 9/165 2024-09-10T22:15:02.188 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : ceph-radosgw-2:19.3.0-4854.g8f219c47.el9.x86_64 10/165 2024-09-10T22:15:02.188 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : ceph-selinux-2:19.3.0-4854.g8f219c47.el9.x86_64 11/165 2024-09-10T22:15:02.188 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : ceph-test-2:19.3.0-4854.g8f219c47.el9.x86_64 12/165 2024-09-10T22:15:02.188 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : cephfs-mirror-2:19.3.0-4854.g8f219c47.el9.x86_64 13/165 2024-09-10T22:15:02.188 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : cephfs-shell-2:19.3.0-4854.g8f219c47.el9.x86_64 14/165 2024-09-10T22:15:02.188 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : libcephfs-devel-2:19.3.0-4854.g8f219c47.el9.x86_ 15/165 2024-09-10T22:15:02.188 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : libcephfs2-2:19.3.0-4854.g8f219c47.el9.x86_64 16/165 2024-09-10T22:15:02.188 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : libcephsqlite-2:19.3.0-4854.g8f219c47.el9.x86_64 17/165 2024-09-10T22:15:02.189 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : librados-devel-2:19.3.0-4854.g8f219c47.el9.x86_6 18/165 2024-09-10T22:15:02.189 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : libradosstriper1-2:19.3.0-4854.g8f219c47.el9.x86 19/165 2024-09-10T22:15:02.189 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : librgw2-2:19.3.0-4854.g8f219c47.el9.x86_64 20/165 2024-09-10T22:15:02.189 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-ceph-argparse-2:19.3.0-4854.g8f219c47.el 21/165 2024-09-10T22:15:02.189 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-ceph-common-2:19.3.0-4854.g8f219c47.el9. 22/165 2024-09-10T22:15:02.189 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-cephfs-2:19.3.0-4854.g8f219c47.el9.x86_6 23/165 2024-09-10T22:15:02.189 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-rados-2:19.3.0-4854.g8f219c47.el9.x86_64 24/165 2024-09-10T22:15:02.189 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-rbd-2:19.3.0-4854.g8f219c47.el9.x86_64 25/165 2024-09-10T22:15:02.189 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-rgw-2:19.3.0-4854.g8f219c47.el9.x86_64 26/165 2024-09-10T22:15:02.189 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : rbd-fuse-2:19.3.0-4854.g8f219c47.el9.x86_64 27/165 2024-09-10T22:15:02.189 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : rbd-mirror-2:19.3.0-4854.g8f219c47.el9.x86_64 28/165 2024-09-10T22:15:02.189 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : rbd-nbd-2:19.3.0-4854.g8f219c47.el9.x86_64 29/165 2024-09-10T22:15:02.201 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : ceph-grafana-dashboards-2:19.3.0-4854.g8f219c47. 30/165 2024-09-10T22:15:02.201 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : ceph-mgr-cephadm-2:19.3.0-4854.g8f219c47.el9.noa 31/165 2024-09-10T22:15:02.201 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : ceph-mgr-dashboard-2:19.3.0-4854.g8f219c47.el9.n 32/165 2024-09-10T22:15:02.201 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.3.0-4854.g8f2 33/165 2024-09-10T22:15:02.201 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : ceph-mgr-modules-core-2:19.3.0-4854.g8f219c47.el 34/165 2024-09-10T22:15:02.201 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : ceph-mgr-rook-2:19.3.0-4854.g8f219c47.el9.noarch 35/165 2024-09-10T22:15:02.201 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : ceph-prometheus-alerts-2:19.3.0-4854.g8f219c47.e 36/165 2024-09-10T22:15:02.201 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : ceph-volume-2:19.3.0-4854.g8f219c47.el9.noarch 37/165 2024-09-10T22:15:02.202 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : cephadm-2:19.3.0-4854.g8f219c47.el9.noarch 38/165 2024-09-10T22:15:02.202 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : cephfs-top-2:19.3.0-4854.g8f219c47.el9.noarch 39/165 2024-09-10T22:15:02.202 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 40/165 2024-09-10T22:15:02.202 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 41/165 2024-09-10T22:15:02.202 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 42/165 2024-09-10T22:15:02.202 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/165 2024-09-10T22:15:02.202 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/165 2024-09-10T22:15:02.202 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/165 2024-09-10T22:15:02.202 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/165 2024-09-10T22:15:02.202 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/165 2024-09-10T22:15:02.202 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 48/165 2024-09-10T22:15:02.202 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/165 2024-09-10T22:15:02.202 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/165 2024-09-10T22:15:02.203 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/165 2024-09-10T22:15:02.203 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 52/165 2024-09-10T22:15:02.203 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/165 2024-09-10T22:15:02.203 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/165 2024-09-10T22:15:02.203 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/165 2024-09-10T22:15:02.203 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/165 2024-09-10T22:15:02.203 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/165 2024-09-10T22:15:02.203 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : libnbd-1.20.2-2.el9.x86_64 58/165 2024-09-10T22:15:02.203 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 59/165 2024-09-10T22:15:02.203 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 60/165 2024-09-10T22:15:02.203 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 61/165 2024-09-10T22:15:02.203 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : libtool-2.4.6-46.el9.x86_64 62/165 2024-09-10T22:15:02.204 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : libuuid-devel-2.37.4-20.el9.x86_64 63/165 2024-09-10T22:15:02.204 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 64/165 2024-09-10T22:15:02.204 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 65/165 2024-09-10T22:15:02.204 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : lua-5.4.4-4.el9.x86_64 66/165 2024-09-10T22:15:02.204 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 67/165 2024-09-10T22:15:02.204 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 68/165 2024-09-10T22:15:02.204 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : openssl-devel-1:3.2.2-6.el9.x86_64 69/165 2024-09-10T22:15:02.204 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : postgresql-13.16-1.el9.x86_64 70/165 2024-09-10T22:15:02.204 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : postgresql-contrib-13.16-1.el9.x86_64 71/165 2024-09-10T22:15:02.204 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : postgresql-private-libs-13.16-1.el9.x86_64 72/165 2024-09-10T22:15:02.204 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : postgresql-server-13.16-1.el9.x86_64 73/165 2024-09-10T22:15:02.204 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 74/165 2024-09-10T22:15:02.204 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 75/165 2024-09-10T22:15:02.204 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 76/165 2024-09-10T22:15:02.205 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-colorama-0.4.6-3.el9.noarch 77/165 2024-09-10T22:15:02.205 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 78/165 2024-09-10T22:15:02.205 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 79/165 2024-09-10T22:15:02.205 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 80/165 2024-09-10T22:15:02.205 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 81/165 2024-09-10T22:15:02.205 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 82/165 2024-09-10T22:15:02.205 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 83/165 2024-09-10T22:15:02.205 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 84/165 2024-09-10T22:15:02.205 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 85/165 2024-09-10T22:15:02.205 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 86/165 2024-09-10T22:15:02.206 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 87/165 2024-09-10T22:15:02.206 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 88/165 2024-09-10T22:15:02.206 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 89/165 2024-09-10T22:15:02.207 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 90/165 2024-09-10T22:15:02.207 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 91/165 2024-09-10T22:15:02.207 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 92/165 2024-09-10T22:15:02.207 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 93/165 2024-09-10T22:15:02.207 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 94/165 2024-09-10T22:15:02.207 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 95/165 2024-09-10T22:15:02.207 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 96/165 2024-09-10T22:15:02.207 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 97/165 2024-09-10T22:15:02.207 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 98/165 2024-09-10T22:15:02.207 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 99/165 2024-09-10T22:15:02.207 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 100/165 2024-09-10T22:15:02.207 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 101/165 2024-09-10T22:15:02.207 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : xfsprogs-devel-6.4.0-4.el9.x86_64 102/165 2024-09-10T22:15:02.207 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 103/165 2024-09-10T22:15:02.208 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 104/165 2024-09-10T22:15:02.208 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 105/165 2024-09-10T22:15:02.208 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 106/165 2024-09-10T22:15:02.208 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 107/165 2024-09-10T22:15:02.208 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 108/165 2024-09-10T22:15:02.208 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 109/165 2024-09-10T22:15:02.208 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 110/165 2024-09-10T22:15:02.208 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 111/165 2024-09-10T22:15:02.208 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 112/165 2024-09-10T22:15:02.208 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 113/165 2024-09-10T22:15:02.208 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 114/165 2024-09-10T22:15:02.208 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 115/165 2024-09-10T22:15:02.208 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 116/165 2024-09-10T22:15:02.209 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 117/165 2024-09-10T22:15:02.209 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 118/165 2024-09-10T22:15:02.209 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 119/165 2024-09-10T22:15:02.209 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 120/165 2024-09-10T22:15:02.209 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 121/165 2024-09-10T22:15:02.209 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 122/165 2024-09-10T22:15:02.209 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 123/165 2024-09-10T22:15:02.209 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 124/165 2024-09-10T22:15:02.209 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 125/165 2024-09-10T22:15:02.209 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 126/165 2024-09-10T22:15:02.209 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 127/165 2024-09-10T22:15:02.209 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 128/165 2024-09-10T22:15:02.209 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 129/165 2024-09-10T22:15:02.209 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 130/165 2024-09-10T22:15:02.210 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 131/165 2024-09-10T22:15:02.210 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 132/165 2024-09-10T22:15:02.210 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 133/165 2024-09-10T22:15:02.210 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 134/165 2024-09-10T22:15:02.210 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 135/165 2024-09-10T22:15:02.210 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 136/165 2024-09-10T22:15:02.210 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 137/165 2024-09-10T22:15:02.210 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 138/165 2024-09-10T22:15:02.210 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 139/165 2024-09-10T22:15:02.210 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 140/165 2024-09-10T22:15:02.210 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 141/165 2024-09-10T22:15:02.210 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 142/165 2024-09-10T22:15:02.210 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 143/165 2024-09-10T22:15:02.211 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 144/165 2024-09-10T22:15:02.211 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 145/165 2024-09-10T22:15:02.211 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 146/165 2024-09-10T22:15:02.211 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 147/165 2024-09-10T22:15:02.211 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : re2-1:20211101-20.el9.x86_64 148/165 2024-09-10T22:15:02.211 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 149/165 2024-09-10T22:15:02.211 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : librados2-2:19.3.0-4854.g8f219c47.el9.x86_64 150/165 2024-09-10T22:15:02.211 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 151/165 2024-09-10T22:15:02.211 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : librbd1-2:19.3.0-4854.g8f219c47.el9.x86_64 152/165 2024-09-10T22:15:02.211 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 153/165 2024-09-10T22:15:02.211 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : NetworkManager-1:1.49.90-1.el9.x86_64 154/165 2024-09-10T22:15:02.211 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : NetworkManager-1:1.48.8-1.el9.x86_64 155/165 2024-09-10T22:15:02.211 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : NetworkManager-libnm-1:1.49.90-1.el9.x86_64 156/165 2024-09-10T22:15:02.211 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 157/165 2024-09-10T22:15:02.211 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : NetworkManager-team-1:1.49.90-1.el9.x86_64 158/165 2024-09-10T22:15:02.212 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : NetworkManager-team-1:1.48.8-1.el9.x86_64 159/165 2024-09-10T22:15:02.212 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : NetworkManager-tui-1:1.49.90-1.el9.x86_64 160/165 2024-09-10T22:15:02.212 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : NetworkManager-tui-1:1.48.8-1.el9.x86_64 161/165 2024-09-10T22:15:02.212 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : openssl-1:3.2.2-6.el9.x86_64 162/165 2024-09-10T22:15:02.212 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : openssl-1:3.2.2-4.el9.x86_64 163/165 2024-09-10T22:15:02.212 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : openssl-libs-1:3.2.2-6.el9.x86_64 164/165 2024-09-10T22:15:04.642 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : openssl-libs-1:3.2.2-4.el9.x86_64 165/165 2024-09-10T22:15:04.642 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-10T22:15:04.642 INFO:teuthology.orchestra.run.smithi019.stdout:Upgraded: 2024-09-10T22:15:04.642 INFO:teuthology.orchestra.run.smithi019.stdout: NetworkManager-1:1.49.90-1.el9.x86_64 2024-09-10T22:15:04.642 INFO:teuthology.orchestra.run.smithi019.stdout: NetworkManager-libnm-1:1.49.90-1.el9.x86_64 2024-09-10T22:15:04.642 INFO:teuthology.orchestra.run.smithi019.stdout: NetworkManager-team-1:1.49.90-1.el9.x86_64 2024-09-10T22:15:04.642 INFO:teuthology.orchestra.run.smithi019.stdout: NetworkManager-tui-1:1.49.90-1.el9.x86_64 2024-09-10T22:15:04.642 INFO:teuthology.orchestra.run.smithi019.stdout: librados2-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T22:15:04.642 INFO:teuthology.orchestra.run.smithi019.stdout: librbd1-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T22:15:04.642 INFO:teuthology.orchestra.run.smithi019.stdout: openssl-1:3.2.2-6.el9.x86_64 2024-09-10T22:15:04.643 INFO:teuthology.orchestra.run.smithi019.stdout: openssl-libs-1:3.2.2-6.el9.x86_64 2024-09-10T22:15:04.643 INFO:teuthology.orchestra.run.smithi019.stdout:Installed: 2024-09-10T22:15:04.643 INFO:teuthology.orchestra.run.smithi019.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-10T22:15:04.643 INFO:teuthology.orchestra.run.smithi019.stdout: automake-1.16.2-8.el9.noarch 2024-09-10T22:15:04.643 INFO:teuthology.orchestra.run.smithi019.stdout: bison-3.7.4-5.el9.x86_64 2024-09-10T22:15:04.643 INFO:teuthology.orchestra.run.smithi019.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-10T22:15:04.643 INFO:teuthology.orchestra.run.smithi019.stdout: ceph-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T22:15:04.643 INFO:teuthology.orchestra.run.smithi019.stdout: ceph-base-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T22:15:04.643 INFO:teuthology.orchestra.run.smithi019.stdout: ceph-common-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T22:15:04.643 INFO:teuthology.orchestra.run.smithi019.stdout: ceph-fuse-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T22:15:04.643 INFO:teuthology.orchestra.run.smithi019.stdout: ceph-grafana-dashboards-2:19.3.0-4854.g8f219c47.el9.noarch 2024-09-10T22:15:04.643 INFO:teuthology.orchestra.run.smithi019.stdout: ceph-immutable-object-cache-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T22:15:04.643 INFO:teuthology.orchestra.run.smithi019.stdout: ceph-mds-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T22:15:04.644 INFO:teuthology.orchestra.run.smithi019.stdout: ceph-mgr-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T22:15:04.644 INFO:teuthology.orchestra.run.smithi019.stdout: ceph-mgr-cephadm-2:19.3.0-4854.g8f219c47.el9.noarch 2024-09-10T22:15:04.644 INFO:teuthology.orchestra.run.smithi019.stdout: ceph-mgr-dashboard-2:19.3.0-4854.g8f219c47.el9.noarch 2024-09-10T22:15:04.644 INFO:teuthology.orchestra.run.smithi019.stdout: ceph-mgr-diskprediction-local-2:19.3.0-4854.g8f219c47.el9.noarch 2024-09-10T22:15:04.644 INFO:teuthology.orchestra.run.smithi019.stdout: ceph-mgr-modules-core-2:19.3.0-4854.g8f219c47.el9.noarch 2024-09-10T22:15:04.644 INFO:teuthology.orchestra.run.smithi019.stdout: ceph-mgr-rook-2:19.3.0-4854.g8f219c47.el9.noarch 2024-09-10T22:15:04.644 INFO:teuthology.orchestra.run.smithi019.stdout: ceph-mon-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T22:15:04.644 INFO:teuthology.orchestra.run.smithi019.stdout: ceph-osd-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T22:15:04.644 INFO:teuthology.orchestra.run.smithi019.stdout: ceph-prometheus-alerts-2:19.3.0-4854.g8f219c47.el9.noarch 2024-09-10T22:15:04.644 INFO:teuthology.orchestra.run.smithi019.stdout: ceph-radosgw-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T22:15:04.644 INFO:teuthology.orchestra.run.smithi019.stdout: ceph-selinux-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T22:15:04.644 INFO:teuthology.orchestra.run.smithi019.stdout: ceph-test-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T22:15:04.644 INFO:teuthology.orchestra.run.smithi019.stdout: ceph-volume-2:19.3.0-4854.g8f219c47.el9.noarch 2024-09-10T22:15:04.645 INFO:teuthology.orchestra.run.smithi019.stdout: cephadm-2:19.3.0-4854.g8f219c47.el9.noarch 2024-09-10T22:15:04.645 INFO:teuthology.orchestra.run.smithi019.stdout: cephfs-mirror-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T22:15:04.645 INFO:teuthology.orchestra.run.smithi019.stdout: cephfs-shell-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T22:15:04.645 INFO:teuthology.orchestra.run.smithi019.stdout: cephfs-top-2:19.3.0-4854.g8f219c47.el9.noarch 2024-09-10T22:15:04.645 INFO:teuthology.orchestra.run.smithi019.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-09-10T22:15:04.645 INFO:teuthology.orchestra.run.smithi019.stdout: flex-2.6.4-9.el9.x86_64 2024-09-10T22:15:04.645 INFO:teuthology.orchestra.run.smithi019.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-10T22:15:04.645 INFO:teuthology.orchestra.run.smithi019.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-10T22:15:04.645 INFO:teuthology.orchestra.run.smithi019.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-10T22:15:04.645 INFO:teuthology.orchestra.run.smithi019.stdout: fuse-2.9.9-16.el9.x86_64 2024-09-10T22:15:04.645 INFO:teuthology.orchestra.run.smithi019.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-09-10T22:15:04.645 INFO:teuthology.orchestra.run.smithi019.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-10T22:15:04.646 INFO:teuthology.orchestra.run.smithi019.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-09-10T22:15:04.646 INFO:teuthology.orchestra.run.smithi019.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-10T22:15:04.646 INFO:teuthology.orchestra.run.smithi019.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-10T22:15:04.646 INFO:teuthology.orchestra.run.smithi019.stdout: libcephfs-devel-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T22:15:04.646 INFO:teuthology.orchestra.run.smithi019.stdout: libcephfs2-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T22:15:04.646 INFO:teuthology.orchestra.run.smithi019.stdout: libcephsqlite-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T22:15:04.646 INFO:teuthology.orchestra.run.smithi019.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-10T22:15:04.646 INFO:teuthology.orchestra.run.smithi019.stdout: libnbd-1.20.2-2.el9.x86_64 2024-09-10T22:15:04.646 INFO:teuthology.orchestra.run.smithi019.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-10T22:15:04.646 INFO:teuthology.orchestra.run.smithi019.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-10T22:15:04.646 INFO:teuthology.orchestra.run.smithi019.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-10T22:15:04.646 INFO:teuthology.orchestra.run.smithi019.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-10T22:15:04.646 INFO:teuthology.orchestra.run.smithi019.stdout: librados-devel-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T22:15:04.647 INFO:teuthology.orchestra.run.smithi019.stdout: libradosstriper1-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T22:15:04.647 INFO:teuthology.orchestra.run.smithi019.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-10T22:15:04.647 INFO:teuthology.orchestra.run.smithi019.stdout: librgw2-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T22:15:04.647 INFO:teuthology.orchestra.run.smithi019.stdout: libtool-2.4.6-46.el9.x86_64 2024-09-10T22:15:04.647 INFO:teuthology.orchestra.run.smithi019.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-10T22:15:04.647 INFO:teuthology.orchestra.run.smithi019.stdout: libuuid-devel-2.37.4-20.el9.x86_64 2024-09-10T22:15:04.647 INFO:teuthology.orchestra.run.smithi019.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-09-10T22:15:04.647 INFO:teuthology.orchestra.run.smithi019.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-10T22:15:04.647 INFO:teuthology.orchestra.run.smithi019.stdout: lua-5.4.4-4.el9.x86_64 2024-09-10T22:15:04.647 INFO:teuthology.orchestra.run.smithi019.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-10T22:15:04.647 INFO:teuthology.orchestra.run.smithi019.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-10T22:15:04.647 INFO:teuthology.orchestra.run.smithi019.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-10T22:15:04.647 INFO:teuthology.orchestra.run.smithi019.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-10T22:15:04.648 INFO:teuthology.orchestra.run.smithi019.stdout: openssl-devel-1:3.2.2-6.el9.x86_64 2024-09-10T22:15:04.648 INFO:teuthology.orchestra.run.smithi019.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-10T22:15:04.648 INFO:teuthology.orchestra.run.smithi019.stdout: postgresql-13.16-1.el9.x86_64 2024-09-10T22:15:04.648 INFO:teuthology.orchestra.run.smithi019.stdout: postgresql-contrib-13.16-1.el9.x86_64 2024-09-10T22:15:04.648 INFO:teuthology.orchestra.run.smithi019.stdout: postgresql-private-libs-13.16-1.el9.x86_64 2024-09-10T22:15:04.648 INFO:teuthology.orchestra.run.smithi019.stdout: postgresql-server-13.16-1.el9.x86_64 2024-09-10T22:15:04.648 INFO:teuthology.orchestra.run.smithi019.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-10T22:15:04.648 INFO:teuthology.orchestra.run.smithi019.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-10T22:15:04.648 INFO:teuthology.orchestra.run.smithi019.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-10T22:15:04.648 INFO:teuthology.orchestra.run.smithi019.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-09-10T22:15:04.648 INFO:teuthology.orchestra.run.smithi019.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-10T22:15:04.648 INFO:teuthology.orchestra.run.smithi019.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-10T22:15:04.648 INFO:teuthology.orchestra.run.smithi019.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-10T22:15:04.649 INFO:teuthology.orchestra.run.smithi019.stdout: python3-ceph-argparse-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T22:15:04.649 INFO:teuthology.orchestra.run.smithi019.stdout: python3-ceph-common-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T22:15:04.649 INFO:teuthology.orchestra.run.smithi019.stdout: python3-cephfs-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T22:15:04.649 INFO:teuthology.orchestra.run.smithi019.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-10T22:15:04.649 INFO:teuthology.orchestra.run.smithi019.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-10T22:15:04.649 INFO:teuthology.orchestra.run.smithi019.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-10T22:15:04.649 INFO:teuthology.orchestra.run.smithi019.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-10T22:15:04.649 INFO:teuthology.orchestra.run.smithi019.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-09-10T22:15:04.649 INFO:teuthology.orchestra.run.smithi019.stdout: python3-colorama-0.4.6-3.el9.noarch 2024-09-10T22:15:04.649 INFO:teuthology.orchestra.run.smithi019.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-10T22:15:04.649 INFO:teuthology.orchestra.run.smithi019.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-10T22:15:04.649 INFO:teuthology.orchestra.run.smithi019.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-10T22:15:04.649 INFO:teuthology.orchestra.run.smithi019.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-10T22:15:04.650 INFO:teuthology.orchestra.run.smithi019.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-10T22:15:04.650 INFO:teuthology.orchestra.run.smithi019.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-10T22:15:04.650 INFO:teuthology.orchestra.run.smithi019.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-10T22:15:04.650 INFO:teuthology.orchestra.run.smithi019.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-10T22:15:04.650 INFO:teuthology.orchestra.run.smithi019.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-10T22:15:04.650 INFO:teuthology.orchestra.run.smithi019.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-10T22:15:04.650 INFO:teuthology.orchestra.run.smithi019.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-10T22:15:04.650 INFO:teuthology.orchestra.run.smithi019.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-10T22:15:04.650 INFO:teuthology.orchestra.run.smithi019.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-10T22:15:04.650 INFO:teuthology.orchestra.run.smithi019.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-10T22:15:04.650 INFO:teuthology.orchestra.run.smithi019.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-10T22:15:04.650 INFO:teuthology.orchestra.run.smithi019.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-10T22:15:04.650 INFO:teuthology.orchestra.run.smithi019.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-10T22:15:04.651 INFO:teuthology.orchestra.run.smithi019.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-10T22:15:04.651 INFO:teuthology.orchestra.run.smithi019.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-10T22:15:04.651 INFO:teuthology.orchestra.run.smithi019.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-10T22:15:04.651 INFO:teuthology.orchestra.run.smithi019.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-10T22:15:04.651 INFO:teuthology.orchestra.run.smithi019.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-10T22:15:04.651 INFO:teuthology.orchestra.run.smithi019.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-10T22:15:04.651 INFO:teuthology.orchestra.run.smithi019.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-10T22:15:04.651 INFO:teuthology.orchestra.run.smithi019.stdout: python3-ply-3.11-14.el9.noarch 2024-09-10T22:15:04.651 INFO:teuthology.orchestra.run.smithi019.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-10T22:15:04.651 INFO:teuthology.orchestra.run.smithi019.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-10T22:15:04.651 INFO:teuthology.orchestra.run.smithi019.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-10T22:15:04.651 INFO:teuthology.orchestra.run.smithi019.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-10T22:15:04.651 INFO:teuthology.orchestra.run.smithi019.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-10T22:15:04.651 INFO:teuthology.orchestra.run.smithi019.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-10T22:15:04.652 INFO:teuthology.orchestra.run.smithi019.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-10T22:15:04.652 INFO:teuthology.orchestra.run.smithi019.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-09-10T22:15:04.652 INFO:teuthology.orchestra.run.smithi019.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-10T22:15:04.652 INFO:teuthology.orchestra.run.smithi019.stdout: python3-rados-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T22:15:04.652 INFO:teuthology.orchestra.run.smithi019.stdout: python3-rbd-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T22:15:04.652 INFO:teuthology.orchestra.run.smithi019.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-10T22:15:04.652 INFO:teuthology.orchestra.run.smithi019.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-10T22:15:04.652 INFO:teuthology.orchestra.run.smithi019.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-10T22:15:04.652 INFO:teuthology.orchestra.run.smithi019.stdout: python3-rgw-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T22:15:04.652 INFO:teuthology.orchestra.run.smithi019.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-10T22:15:04.652 INFO:teuthology.orchestra.run.smithi019.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-10T22:15:04.652 INFO:teuthology.orchestra.run.smithi019.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-10T22:15:04.652 INFO:teuthology.orchestra.run.smithi019.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-10T22:15:04.652 INFO:teuthology.orchestra.run.smithi019.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-10T22:15:04.653 INFO:teuthology.orchestra.run.smithi019.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-10T22:15:04.653 INFO:teuthology.orchestra.run.smithi019.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-10T22:15:04.653 INFO:teuthology.orchestra.run.smithi019.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-09-10T22:15:04.653 INFO:teuthology.orchestra.run.smithi019.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-10T22:15:04.653 INFO:teuthology.orchestra.run.smithi019.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-10T22:15:04.653 INFO:teuthology.orchestra.run.smithi019.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-10T22:15:04.653 INFO:teuthology.orchestra.run.smithi019.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-10T22:15:04.653 INFO:teuthology.orchestra.run.smithi019.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-10T22:15:04.653 INFO:teuthology.orchestra.run.smithi019.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-10T22:15:04.653 INFO:teuthology.orchestra.run.smithi019.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-10T22:15:04.653 INFO:teuthology.orchestra.run.smithi019.stdout: rbd-fuse-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T22:15:04.653 INFO:teuthology.orchestra.run.smithi019.stdout: rbd-mirror-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T22:15:04.654 INFO:teuthology.orchestra.run.smithi019.stdout: rbd-nbd-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T22:15:04.654 INFO:teuthology.orchestra.run.smithi019.stdout: re2-1:20211101-20.el9.x86_64 2024-09-10T22:15:04.654 INFO:teuthology.orchestra.run.smithi019.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-10T22:15:04.654 INFO:teuthology.orchestra.run.smithi019.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-10T22:15:04.654 INFO:teuthology.orchestra.run.smithi019.stdout: uuid-1.6.2-55.el9.x86_64 2024-09-10T22:15:04.654 INFO:teuthology.orchestra.run.smithi019.stdout: xfsprogs-devel-6.4.0-4.el9.x86_64 2024-09-10T22:15:04.654 INFO:teuthology.orchestra.run.smithi019.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-10T22:15:04.654 INFO:teuthology.orchestra.run.smithi019.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-09-10T22:15:04.654 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-10T22:15:04.655 INFO:teuthology.orchestra.run.smithi019.stdout:Complete! 2024-09-10T22:15:05.074 DEBUG:teuthology.parallel:result is None 2024-09-10T22:15:05.075 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=8f219c476cb4f26fc5719c661c0323719a45cb30 2024-09-10T22:15:05.229 DEBUG:teuthology.orchestra.run.smithi019:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-10T22:15:05.252 INFO:teuthology.orchestra.run.smithi019.stdout:19.3.0-4854.g8f219c47.el9 2024-09-10T22:15:05.253 INFO:teuthology.packaging:The installed version of ceph is 19.3.0-4854.g8f219c47.el9 2024-09-10T22:15:05.253 INFO:teuthology.task.install:The correct ceph version 19.3.0-4854.g8f219c47 is installed. 2024-09-10T22:15:05.255 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=8f219c476cb4f26fc5719c661c0323719a45cb30 2024-09-10T22:15:05.400 DEBUG:teuthology.orchestra.run.smithi135:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-10T22:15:05.427 INFO:teuthology.orchestra.run.smithi135.stdout:19.3.0-4854.g8f219c47.el9 2024-09-10T22:15:05.427 INFO:teuthology.packaging:The installed version of ceph is 19.3.0-4854.g8f219c47.el9 2024-09-10T22:15:05.428 INFO:teuthology.task.install:The correct ceph version 19.3.0-4854.g8f219c47 is installed. 2024-09-10T22:15:05.429 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=8f219c476cb4f26fc5719c661c0323719a45cb30 2024-09-10T22:15:05.573 DEBUG:teuthology.orchestra.run.smithi138:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-10T22:15:05.600 INFO:teuthology.orchestra.run.smithi138.stdout:19.3.0-4854.g8f219c47.el9 2024-09-10T22:15:05.600 INFO:teuthology.packaging:The installed version of ceph is 19.3.0-4854.g8f219c47.el9 2024-09-10T22:15:05.600 INFO:teuthology.task.install:The correct ceph version 19.3.0-4854.g8f219c47 is installed. 2024-09-10T22:15:05.602 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-09-10T22:15:05.602 DEBUG:teuthology.orchestra.run.smithi019:> set -ex 2024-09-10T22:15:05.602 DEBUG:teuthology.orchestra.run.smithi019:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-10T22:15:05.633 DEBUG:teuthology.orchestra.run.smithi135:> set -ex 2024-09-10T22:15:05.633 DEBUG:teuthology.orchestra.run.smithi135:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-10T22:15:05.666 DEBUG:teuthology.orchestra.run.smithi138:> set -ex 2024-09-10T22:15:05.666 DEBUG:teuthology.orchestra.run.smithi138:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-10T22:15:05.699 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-09-10T22:15:05.699 DEBUG:teuthology.orchestra.run.smithi019:> set -ex 2024-09-10T22:15:05.699 DEBUG:teuthology.orchestra.run.smithi019:> sudo dd of=/usr/bin/daemon-helper 2024-09-10T22:15:05.727 DEBUG:teuthology.orchestra.run.smithi019:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-10T22:15:05.794 DEBUG:teuthology.orchestra.run.smithi135:> set -ex 2024-09-10T22:15:05.794 DEBUG:teuthology.orchestra.run.smithi135:> sudo dd of=/usr/bin/daemon-helper 2024-09-10T22:15:05.825 DEBUG:teuthology.orchestra.run.smithi135:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-10T22:15:05.894 DEBUG:teuthology.orchestra.run.smithi138:> set -ex 2024-09-10T22:15:05.894 DEBUG:teuthology.orchestra.run.smithi138:> sudo dd of=/usr/bin/daemon-helper 2024-09-10T22:15:05.924 DEBUG:teuthology.orchestra.run.smithi138:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-10T22:15:05.994 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-09-10T22:15:05.995 DEBUG:teuthology.orchestra.run.smithi019:> set -ex 2024-09-10T22:15:05.995 DEBUG:teuthology.orchestra.run.smithi019:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-10T22:15:06.022 DEBUG:teuthology.orchestra.run.smithi019:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-10T22:15:06.089 DEBUG:teuthology.orchestra.run.smithi135:> set -ex 2024-09-10T22:15:06.089 DEBUG:teuthology.orchestra.run.smithi135:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-10T22:15:06.128 DEBUG:teuthology.orchestra.run.smithi135:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-10T22:15:06.196 DEBUG:teuthology.orchestra.run.smithi138:> set -ex 2024-09-10T22:15:06.196 DEBUG:teuthology.orchestra.run.smithi138:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-10T22:15:06.221 DEBUG:teuthology.orchestra.run.smithi138:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-10T22:15:06.286 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-09-10T22:15:06.286 DEBUG:teuthology.orchestra.run.smithi019:> set -ex 2024-09-10T22:15:06.286 DEBUG:teuthology.orchestra.run.smithi019:> sudo dd of=/usr/bin/stdin-killer 2024-09-10T22:15:06.313 DEBUG:teuthology.orchestra.run.smithi019:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-10T22:15:06.380 DEBUG:teuthology.orchestra.run.smithi135:> set -ex 2024-09-10T22:15:06.380 DEBUG:teuthology.orchestra.run.smithi135:> sudo dd of=/usr/bin/stdin-killer 2024-09-10T22:15:06.406 DEBUG:teuthology.orchestra.run.smithi135:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-10T22:15:06.471 DEBUG:teuthology.orchestra.run.smithi138:> set -ex 2024-09-10T22:15:06.471 DEBUG:teuthology.orchestra.run.smithi138:> sudo dd of=/usr/bin/stdin-killer 2024-09-10T22:15:06.496 DEBUG:teuthology.orchestra.run.smithi138:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-10T22:15:06.561 INFO:teuthology.run_tasks:Running task cephadm... 2024-09-10T22:15:06.658 INFO:tasks.cephadm:Config: {'roleless': False, 'cephfs': {'max_mds': 3, 'session_timeout': 300, 'standby_replay': True}, 'cluster-conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 2, 'mds bal fragment size max': 10000, 'mds bal merge size': 5, 'mds bal split bits': 3, 'mds bal split size': 100, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon': {'mon op complaint time': 120, 'mon warn on pool no app': False}, 'osd': {'osd op complaint time': 180}}, 'conf': {'global': {'ms die on skipped message': False}, 'mds': {'mds_bal_replicate_threshold': 1}, 'mgr': {'cephsqlite lock renewal timeout': 900000, 'client mount timeout': 30, 'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd shutdown pgref assert': True, 'osd_max_omap_entries_per_request': 10}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'fs.*is degraded', 'filesystem is degraded', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'filesystem is offline', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'insufficient standby MDS daemons available', 'MDS_UP_LESS_THAN_MAX', 'online, but wants', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'Degraded data redundancy', 'slow metadata IO', 'SLOW_OPS', 'slow request'], 'sha1': '8f219c476cb4f26fc5719c661c0323719a45cb30', 'subvols': {'create': 2, 'subvol_options': '--size 25000000000'}} 2024-09-10T22:15:06.659 INFO:tasks.cephadm:Cluster image is quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 2024-09-10T22:15:06.659 INFO:tasks.cephadm:Cluster fsid is 22997a4c-6fc2-11ef-bcea-c7b262605968 2024-09-10T22:15:06.659 INFO:tasks.cephadm:Choosing monitor IPs and ports... 2024-09-10T22:15:06.660 INFO:tasks.cephadm:Monitor IPs: {'mon.a': '172.21.15.19', 'mon.b': '172.21.15.135', 'mon.c': '172.21.15.138'} 2024-09-10T22:15:06.660 INFO:tasks.cephadm:First mon is mon.a on smithi019 2024-09-10T22:15:06.660 INFO:tasks.cephadm:First mgr is x 2024-09-10T22:15:06.660 INFO:tasks.cephadm:Normalizing hostnames... 2024-09-10T22:15:06.660 DEBUG:teuthology.orchestra.run.smithi019:> sudo hostname $(hostname -s) 2024-09-10T22:15:06.689 DEBUG:teuthology.orchestra.run.smithi135:> sudo hostname $(hostname -s) 2024-09-10T22:15:06.715 DEBUG:teuthology.orchestra.run.smithi138:> sudo hostname $(hostname -s) 2024-09-10T22:15:06.739 INFO:tasks.cephadm:Downloading "compiled" cephadm from cachra 2024-09-10T22:15:06.740 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=8f219c476cb4f26fc5719c661c0323719a45cb30 2024-09-10T22:15:06.885 INFO:tasks.cephadm:builder_project result: [{'status': 'ready', 'sha1': '8f219c476cb4f26fc5719c661c0323719a45cb30', 'extra': {'build_url': 'https://jenkins.ceph.com/job/ceph-dev-new-build/ARCH=x86_64,AVAILABLE_ARCH=x86_64,AVAILABLE_DIST=centos9,DIST=centos9,MACHINE_SIZE=gigantic/82938/', 'root_build_cause': 'SCMTRIGGER', 'version': '19.3.0-4854-g8f219c47', 'node_name': '172.21.2.8+braggi08', 'job_name': 'ceph-dev-new-build/ARCH=x86_64,AVAILABLE_ARCH=x86_64,AVAILABLE_DIST=centos9,DIST=centos9,MACHINE_SIZE=gigantic', 'package_manager_version': '19.3.0-4854.g8f219c47'}, 'url': 'https://3.chacra.ceph.com/r/ceph/wip-hemanth-testing-2024-09-10-0723/8f219c476cb4f26fc5719c661c0323719a45cb30/centos/9/flavors/default/', 'distro_codename': None, 'modified': '2024-09-10 09:27:13.215997', 'distro_version': '9', 'project': 'ceph', 'flavor': 'default', 'ref': 'wip-hemanth-testing-2024-09-10-0723', 'chacra_url': 'https://3.chacra.ceph.com/repos/ceph/wip-hemanth-testing-2024-09-10-0723/8f219c476cb4f26fc5719c661c0323719a45cb30/centos/9/flavors/default/', 'archs': ['source', 'x86_64'], 'distro': 'centos'}] 2024-09-10T22:15:07.034 INFO:tasks.util.chacra:got chacra host 3.chacra.ceph.com, ref wip-hemanth-testing-2024-09-10-0723, sha1 8f219c476cb4f26fc5719c661c0323719a45cb30 from https://shaman.ceph.com/api/search/?project=ceph&distros=centos%2F9%2Fx86_64&flavor=default&sha1=8f219c476cb4f26fc5719c661c0323719a45cb30 2024-09-10T22:15:07.035 INFO:tasks.cephadm:Discovered cachra url: https://3.chacra.ceph.com/binaries/ceph/wip-hemanth-testing-2024-09-10-0723/8f219c476cb4f26fc5719c661c0323719a45cb30/centos/9/x86_64/flavors/default/cephadm 2024-09-10T22:15:07.035 INFO:tasks.cephadm:Downloading cephadm from url: https://3.chacra.ceph.com/binaries/ceph/wip-hemanth-testing-2024-09-10-0723/8f219c476cb4f26fc5719c661c0323719a45cb30/centos/9/x86_64/flavors/default/cephadm 2024-09-10T22:15:07.035 DEBUG:teuthology.orchestra.run.smithi019:> curl --silent -L https://3.chacra.ceph.com/binaries/ceph/wip-hemanth-testing-2024-09-10-0723/8f219c476cb4f26fc5719c661c0323719a45cb30/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-09-10T22:15:07.394 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r--. 1 ubuntu ubuntu 803561 Sep 10 22:15 /home/ubuntu/cephtest/cephadm 2024-09-10T22:15:07.395 DEBUG:teuthology.orchestra.run.smithi135:> curl --silent -L https://3.chacra.ceph.com/binaries/ceph/wip-hemanth-testing-2024-09-10-0723/8f219c476cb4f26fc5719c661c0323719a45cb30/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-09-10T22:15:07.773 INFO:teuthology.orchestra.run.smithi135.stdout:-rw-r--r--. 1 ubuntu ubuntu 803561 Sep 10 22:15 /home/ubuntu/cephtest/cephadm 2024-09-10T22:15:07.774 DEBUG:teuthology.orchestra.run.smithi138:> curl --silent -L https://3.chacra.ceph.com/binaries/ceph/wip-hemanth-testing-2024-09-10-0723/8f219c476cb4f26fc5719c661c0323719a45cb30/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-09-10T22:15:08.131 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r--. 1 ubuntu ubuntu 803561 Sep 10 22:15 /home/ubuntu/cephtest/cephadm 2024-09-10T22:15:08.132 DEBUG:teuthology.orchestra.run.smithi019:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-09-10T22:15:08.152 DEBUG:teuthology.orchestra.run.smithi135:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-09-10T22:15:08.169 DEBUG:teuthology.orchestra.run.smithi138:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-09-10T22:15:08.201 INFO:tasks.cephadm:Pulling image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 on all hosts... 2024-09-10T22:15:08.201 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 pull 2024-09-10T22:15:08.204 DEBUG:teuthology.orchestra.run.smithi135:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 pull 2024-09-10T22:15:08.211 DEBUG:teuthology.orchestra.run.smithi138:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 pull 2024-09-10T22:15:09.839 INFO:teuthology.orchestra.run.smithi138.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30... 2024-09-10T22:15:09.975 INFO:teuthology.orchestra.run.smithi135.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30... 2024-09-10T22:15:09.987 INFO:teuthology.orchestra.run.smithi019.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30... 2024-09-10T22:15:45.344 INFO:teuthology.orchestra.run.smithi019.stdout:{ 2024-09-10T22:15:45.345 INFO:teuthology.orchestra.run.smithi019.stdout: "ceph_version": "ceph version 19.3.0-4854-g8f219c47 (8f219c476cb4f26fc5719c661c0323719a45cb30) squid (dev)", 2024-09-10T22:15:45.345 INFO:teuthology.orchestra.run.smithi019.stdout: "image_id": "589dd18248e494ba411dc838aa4ae0e5e569213f08fcd7a2cf22cd3ef7e3c480", 2024-09-10T22:15:45.345 INFO:teuthology.orchestra.run.smithi019.stdout: "repo_digests": [ 2024-09-10T22:15:45.345 INFO:teuthology.orchestra.run.smithi019.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e" 2024-09-10T22:15:45.345 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-10T22:15:45.345 INFO:teuthology.orchestra.run.smithi019.stdout:} 2024-09-10T22:15:57.242 INFO:teuthology.orchestra.run.smithi138.stdout:{ 2024-09-10T22:15:57.242 INFO:teuthology.orchestra.run.smithi138.stdout: "ceph_version": "ceph version 19.3.0-4854-g8f219c47 (8f219c476cb4f26fc5719c661c0323719a45cb30) squid (dev)", 2024-09-10T22:15:57.242 INFO:teuthology.orchestra.run.smithi138.stdout: "image_id": "589dd18248e494ba411dc838aa4ae0e5e569213f08fcd7a2cf22cd3ef7e3c480", 2024-09-10T22:15:57.242 INFO:teuthology.orchestra.run.smithi138.stdout: "repo_digests": [ 2024-09-10T22:15:57.242 INFO:teuthology.orchestra.run.smithi138.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e" 2024-09-10T22:15:57.242 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-09-10T22:15:57.242 INFO:teuthology.orchestra.run.smithi138.stdout:} 2024-09-10T22:16:03.695 INFO:teuthology.orchestra.run.smithi135.stdout:{ 2024-09-10T22:16:03.695 INFO:teuthology.orchestra.run.smithi135.stdout: "ceph_version": "ceph version 19.3.0-4854-g8f219c47 (8f219c476cb4f26fc5719c661c0323719a45cb30) squid (dev)", 2024-09-10T22:16:03.695 INFO:teuthology.orchestra.run.smithi135.stdout: "image_id": "589dd18248e494ba411dc838aa4ae0e5e569213f08fcd7a2cf22cd3ef7e3c480", 2024-09-10T22:16:03.695 INFO:teuthology.orchestra.run.smithi135.stdout: "repo_digests": [ 2024-09-10T22:16:03.695 INFO:teuthology.orchestra.run.smithi135.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e" 2024-09-10T22:16:03.695 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-09-10T22:16:03.695 INFO:teuthology.orchestra.run.smithi135.stdout:} 2024-09-10T22:16:03.720 DEBUG:teuthology.orchestra.run.smithi019:> sudo mkdir -p /etc/ceph 2024-09-10T22:16:03.756 DEBUG:teuthology.orchestra.run.smithi135:> sudo mkdir -p /etc/ceph 2024-09-10T22:16:03.783 DEBUG:teuthology.orchestra.run.smithi138:> sudo mkdir -p /etc/ceph 2024-09-10T22:16:03.817 DEBUG:teuthology.orchestra.run.smithi019:> sudo chmod 777 /etc/ceph 2024-09-10T22:16:03.848 DEBUG:teuthology.orchestra.run.smithi135:> sudo chmod 777 /etc/ceph 2024-09-10T22:16:03.873 DEBUG:teuthology.orchestra.run.smithi138:> sudo chmod 777 /etc/ceph 2024-09-10T22:16:03.902 INFO:tasks.cephadm:Writing seed config... 2024-09-10T22:16:03.903 INFO:tasks.cephadm: override: [global] ms die on skipped message = False 2024-09-10T22:16:03.904 INFO:tasks.cephadm: override: [mds] mds_bal_replicate_threshold = 1 2024-09-10T22:16:03.904 INFO:tasks.cephadm: override: [mgr] cephsqlite lock renewal timeout = 900000 2024-09-10T22:16:03.904 INFO:tasks.cephadm: override: [mgr] client mount timeout = 30 2024-09-10T22:16:03.904 INFO:tasks.cephadm: override: [mgr] debug client = 20 2024-09-10T22:16:03.904 INFO:tasks.cephadm: override: [mgr] debug mgr = 20 2024-09-10T22:16:03.904 INFO:tasks.cephadm: override: [mgr] debug ms = 1 2024-09-10T22:16:03.904 INFO:tasks.cephadm: override: [mon] debug mon = 20 2024-09-10T22:16:03.904 INFO:tasks.cephadm: override: [mon] debug ms = 1 2024-09-10T22:16:03.904 INFO:tasks.cephadm: override: [mon] debug paxos = 20 2024-09-10T22:16:03.904 INFO:tasks.cephadm: override: [mon] mon down mkfs grace = 300 2024-09-10T22:16:03.904 INFO:tasks.cephadm: override: [osd] bdev async discard = True 2024-09-10T22:16:03.904 INFO:tasks.cephadm: override: [osd] bdev enable discard = True 2024-09-10T22:16:03.904 INFO:tasks.cephadm: override: [osd] bluestore allocator = bitmap 2024-09-10T22:16:03.905 INFO:tasks.cephadm: override: [osd] bluestore block size = 96636764160 2024-09-10T22:16:03.905 INFO:tasks.cephadm: override: [osd] bluestore fsck on mount = True 2024-09-10T22:16:03.905 INFO:tasks.cephadm: override: [osd] debug bluefs = 1/20 2024-09-10T22:16:03.905 INFO:tasks.cephadm: override: [osd] debug bluestore = 1/20 2024-09-10T22:16:03.905 INFO:tasks.cephadm: override: [osd] debug ms = 1 2024-09-10T22:16:03.905 INFO:tasks.cephadm: override: [osd] debug osd = 20 2024-09-10T22:16:03.905 INFO:tasks.cephadm: override: [osd] debug rocksdb = 4/10 2024-09-10T22:16:03.905 INFO:tasks.cephadm: override: [osd] mon osd backfillfull_ratio = 0.85 2024-09-10T22:16:03.905 INFO:tasks.cephadm: override: [osd] mon osd full ratio = 0.9 2024-09-10T22:16:03.905 INFO:tasks.cephadm: override: [osd] mon osd nearfull ratio = 0.8 2024-09-10T22:16:03.905 INFO:tasks.cephadm: override: [osd] osd failsafe full ratio = 0.95 2024-09-10T22:16:03.905 INFO:tasks.cephadm: override: [osd] osd objectstore = bluestore 2024-09-10T22:16:03.905 INFO:tasks.cephadm: override: [osd] osd shutdown pgref assert = True 2024-09-10T22:16:03.905 INFO:tasks.cephadm: override: [osd] osd_max_omap_entries_per_request = 10 2024-09-10T22:16:03.906 DEBUG:teuthology.orchestra.run.smithi019:> set -ex 2024-09-10T22:16:03.906 DEBUG:teuthology.orchestra.run.smithi019:> dd of=/home/ubuntu/cephtest/seed.ceph.conf 2024-09-10T22:16:03.925 DEBUG:tasks.cephadm:Final config: [global] # make logging friendly to teuthology log_to_file = true log_to_stderr = false log to journald = false mon cluster log to file = true mon cluster log file level = debug mon clock drift allowed = 1.000 # replicate across OSDs, not hosts osd crush chooseleaf type = 0 #osd pool default size = 2 osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd # enable some debugging auth debug = true ms die on old message = true ms die on bug = true debug asserts on shutdown = true # adjust warnings mon max pg per osd = 10000# >= luminous mon pg warn max object skew = 0 mon osd allow primary affinity = true mon osd allow pg remap = true mon warn on legacy crush tunables = false mon warn on crush straw calc version zero = false mon warn on no sortbitwise = false mon warn on osd down out interval zero = false mon warn on too few osds = false mon_warn_on_pool_pg_num_not_power_of_two = false # disable pg_autoscaler by default for new pools osd_pool_default_pg_autoscale_mode = off # tests delete pools mon allow pool delete = true fsid = 22997a4c-6fc2-11ef-bcea-c7b262605968 ms die on skipped message = False [osd] osd scrub load threshold = 5.0 osd scrub max interval = 600 osd mclock profile = high_recovery_ops osd recover clone overlap = true osd recovery max chunk = 1048576 osd deep scrub update digest min age = 30 osd map max advance = 10 osd memory target autotune = true # debugging osd debug shutdown = true osd debug op order = true osd debug verify stray on activate = true osd debug pg log writeout = true osd debug verify cached snaps = true osd debug verify missing on start = true osd debug misdirected ops = true osd op queue = debug_random osd op queue cut off = debug_random osd shutdown pgref assert = True bdev debug aio = true osd sloppy crc = true bdev async discard = True bdev enable discard = True bluestore allocator = bitmap bluestore block size = 96636764160 bluestore fsck on mount = True debug bluefs = 1/20 debug bluestore = 1/20 debug ms = 1 debug osd = 20 debug rocksdb = 4/10 mon osd backfillfull_ratio = 0.85 mon osd full ratio = 0.9 mon osd nearfull ratio = 0.8 osd failsafe full ratio = 0.95 osd objectstore = bluestore osd_max_omap_entries_per_request = 10 [mgr] mon reweight min pgs per osd = 4 mon reweight min bytes per osd = 10 mgr/telemetry/nag = false cephsqlite lock renewal timeout = 900000 client mount timeout = 30 debug client = 20 debug mgr = 20 debug ms = 1 [mon] mon data avail warn = 5 mon mgr mkfs grace = 240 mon reweight min pgs per osd = 4 mon osd reporter subtree level = osd mon osd prime pg temp = true mon reweight min bytes per osd = 10 # rotate auth tickets quickly to exercise renewal paths auth mon ticket ttl = 660# 11m auth service ticket ttl = 240# 4m # don't complain about global id reclaim mon_warn_on_insecure_global_id_reclaim = false mon_warn_on_insecure_global_id_reclaim_allowed = false debug mon = 20 debug ms = 1 debug paxos = 20 mon down mkfs grace = 300 [client.rgw] rgw cache enabled = true rgw enable ops log = true rgw enable usage log = true [mds] mds_bal_replicate_threshold = 1 2024-09-10T22:16:03.926 DEBUG:teuthology.orchestra.run.smithi019:mon.a> sudo journalctl -f -n 0 -u ceph-22997a4c-6fc2-11ef-bcea-c7b262605968@mon.a.service 2024-09-10T22:16:03.970 DEBUG:teuthology.orchestra.run.smithi019:mgr.x> sudo journalctl -f -n 0 -u ceph-22997a4c-6fc2-11ef-bcea-c7b262605968@mgr.x.service 2024-09-10T22:16:04.014 INFO:tasks.cephadm:Bootstrapping... 2024-09-10T22:16:04.014 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 -v bootstrap --fsid 22997a4c-6fc2-11ef-bcea-c7b262605968 --config /home/ubuntu/cephtest/seed.ceph.conf --output-config /etc/ceph/ceph.conf --output-keyring /etc/ceph/ceph.client.admin.keyring --output-pub-ssh-key /home/ubuntu/cephtest/ceph.pub --mon-id a --mgr-id x --orphan-initial-daemons --skip-monitoring-stack --mon-ip 172.21.15.19 --skip-admin-label && sudo chmod +r /etc/ceph/ceph.client.admin.keyring 2024-09-10T22:16:04.235 INFO:teuthology.orchestra.run.smithi019.stdout:-------------------------------------------------------------------------------- 2024-09-10T22:16:04.235 INFO:teuthology.orchestra.run.smithi019.stdout:cephadm ['--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30', '-v', 'bootstrap', '--fsid', '22997a4c-6fc2-11ef-bcea-c7b262605968', '--config', '/home/ubuntu/cephtest/seed.ceph.conf', '--output-config', '/etc/ceph/ceph.conf', '--output-keyring', '/etc/ceph/ceph.client.admin.keyring', '--output-pub-ssh-key', '/home/ubuntu/cephtest/ceph.pub', '--mon-id', 'a', '--mgr-id', 'x', '--orphan-initial-daemons', '--skip-monitoring-stack', '--mon-ip', '172.21.15.19', '--skip-admin-label'] 2024-09-10T22:16:04.235 INFO:teuthology.orchestra.run.smithi019.stderr:Specifying an fsid for your cluster offers no advantages and may increase the likelihood of fsid conflicts. 2024-09-10T22:16:04.235 INFO:teuthology.orchestra.run.smithi019.stdout:Verifying podman|docker is present... 2024-09-10T22:16:04.260 INFO:teuthology.orchestra.run.smithi019.stdout:/bin/podman: stdout 5.2.2 2024-09-10T22:16:04.260 INFO:teuthology.orchestra.run.smithi019.stdout:Verifying lvm2 is present... 2024-09-10T22:16:04.261 INFO:teuthology.orchestra.run.smithi019.stdout:Verifying time synchronization is in place... 2024-09-10T22:16:04.269 INFO:teuthology.orchestra.run.smithi019.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2024-09-10T22:16:04.269 INFO:teuthology.orchestra.run.smithi019.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2024-09-10T22:16:04.276 INFO:teuthology.orchestra.run.smithi019.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2024-09-10T22:16:04.276 INFO:teuthology.orchestra.run.smithi019.stdout:systemctl: stdout inactive 2024-09-10T22:16:04.283 INFO:teuthology.orchestra.run.smithi019.stdout:systemctl: stdout enabled 2024-09-10T22:16:04.290 INFO:teuthology.orchestra.run.smithi019.stdout:systemctl: stdout active 2024-09-10T22:16:04.291 INFO:teuthology.orchestra.run.smithi019.stdout:Unit chronyd.service is enabled and running 2024-09-10T22:16:04.291 INFO:teuthology.orchestra.run.smithi019.stdout:Repeating the final host check... 2024-09-10T22:16:04.315 INFO:teuthology.orchestra.run.smithi019.stdout:/bin/podman: stdout 5.2.2 2024-09-10T22:16:04.316 INFO:teuthology.orchestra.run.smithi019.stdout:podman (/bin/podman) version 5.2.2 is present 2024-09-10T22:16:04.316 INFO:teuthology.orchestra.run.smithi019.stdout:systemctl is present 2024-09-10T22:16:04.316 INFO:teuthology.orchestra.run.smithi019.stdout:lvcreate is present 2024-09-10T22:16:04.323 INFO:teuthology.orchestra.run.smithi019.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2024-09-10T22:16:04.323 INFO:teuthology.orchestra.run.smithi019.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2024-09-10T22:16:04.330 INFO:teuthology.orchestra.run.smithi019.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2024-09-10T22:16:04.330 INFO:teuthology.orchestra.run.smithi019.stdout:systemctl: stdout inactive 2024-09-10T22:16:04.338 INFO:teuthology.orchestra.run.smithi019.stdout:systemctl: stdout enabled 2024-09-10T22:16:04.345 INFO:teuthology.orchestra.run.smithi019.stdout:systemctl: stdout active 2024-09-10T22:16:04.346 INFO:teuthology.orchestra.run.smithi019.stdout:Unit chronyd.service is enabled and running 2024-09-10T22:16:04.346 INFO:teuthology.orchestra.run.smithi019.stdout:Host looks OK 2024-09-10T22:16:04.346 INFO:teuthology.orchestra.run.smithi019.stdout:Cluster fsid: 22997a4c-6fc2-11ef-bcea-c7b262605968 2024-09-10T22:16:04.346 INFO:teuthology.orchestra.run.smithi019.stdout:Acquiring lock 140392676688752 on /run/cephadm/22997a4c-6fc2-11ef-bcea-c7b262605968.lock 2024-09-10T22:16:04.346 INFO:teuthology.orchestra.run.smithi019.stdout:Lock 140392676688752 acquired on /run/cephadm/22997a4c-6fc2-11ef-bcea-c7b262605968.lock 2024-09-10T22:16:04.346 INFO:teuthology.orchestra.run.smithi019.stdout:Verifying IP 172.21.15.19 port 3300 ... 2024-09-10T22:16:04.347 INFO:teuthology.orchestra.run.smithi019.stdout:Verifying IP 172.21.15.19 port 6789 ... 2024-09-10T22:16:04.347 INFO:teuthology.orchestra.run.smithi019.stdout:Base mon IP(s) is [172.21.15.19:3300, 172.21.15.19:6789], mon addrv is [v2:172.21.15.19:3300,v1:172.21.15.19:6789] 2024-09-10T22:16:04.350 INFO:teuthology.orchestra.run.smithi019.stdout:/sbin/ip: stdout default via 172.21.15.254 dev ens1f0 proto dhcp src 172.21.15.19 metric 100 2024-09-10T22:16:04.350 INFO:teuthology.orchestra.run.smithi019.stdout:/sbin/ip: stdout 172.21.0.0/20 dev ens1f0 proto kernel scope link src 172.21.15.19 metric 100 2024-09-10T22:16:04.353 INFO:teuthology.orchestra.run.smithi019.stdout:/sbin/ip: stdout ::1 dev lo proto kernel metric 256 pref medium 2024-09-10T22:16:04.353 INFO:teuthology.orchestra.run.smithi019.stdout:/sbin/ip: stdout fe80::/64 dev ens1f0 proto kernel metric 256 pref medium 2024-09-10T22:16:04.353 INFO:teuthology.orchestra.run.smithi019.stdout:/sbin/ip: stdout default via fe80::327c:5e00:6487:71e0 dev ens1f0 proto ra metric 1024 expires 1794sec hoplimit 64 pref medium 2024-09-10T22:16:04.356 INFO:teuthology.orchestra.run.smithi019.stdout:/sbin/ip: stdout 1: lo: mtu 65536 state UNKNOWN qlen 1000 2024-09-10T22:16:04.356 INFO:teuthology.orchestra.run.smithi019.stdout:/sbin/ip: stdout inet6 ::1/128 scope host 2024-09-10T22:16:04.356 INFO:teuthology.orchestra.run.smithi019.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2024-09-10T22:16:04.356 INFO:teuthology.orchestra.run.smithi019.stdout:/sbin/ip: stdout 4: ens1f0: mtu 1500 state UP qlen 1000 2024-09-10T22:16:04.356 INFO:teuthology.orchestra.run.smithi019.stdout:/sbin/ip: stdout inet6 fe80::ec4:7aff:febd:161e/64 scope link 2024-09-10T22:16:04.356 INFO:teuthology.orchestra.run.smithi019.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2024-09-10T22:16:04.357 INFO:teuthology.orchestra.run.smithi019.stdout:Mon IP `172.21.15.19` is in CIDR network `172.21.0.0/20` 2024-09-10T22:16:04.357 INFO:teuthology.orchestra.run.smithi019.stdout:Mon IP `172.21.15.19` is in CIDR network `172.21.0.0/20` 2024-09-10T22:16:04.357 INFO:teuthology.orchestra.run.smithi019.stdout:Inferred mon public CIDR from local network configuration ['172.21.0.0/20', '172.21.0.0/20'] 2024-09-10T22:16:04.357 INFO:teuthology.orchestra.run.smithi019.stdout:Internal network (--cluster-network) has not been provided, OSD replication will default to the public_network 2024-09-10T22:16:04.358 INFO:teuthology.orchestra.run.smithi019.stdout:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30... 2024-09-10T22:16:08.012 INFO:teuthology.orchestra.run.smithi019.stdout:/bin/podman: stdout 589dd18248e494ba411dc838aa4ae0e5e569213f08fcd7a2cf22cd3ef7e3c480 2024-09-10T22:16:08.012 INFO:teuthology.orchestra.run.smithi019.stdout:/bin/podman: stderr Trying to pull quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30... 2024-09-10T22:16:08.012 INFO:teuthology.orchestra.run.smithi019.stdout:/bin/podman: stderr Getting image source signatures 2024-09-10T22:16:08.012 INFO:teuthology.orchestra.run.smithi019.stdout:/bin/podman: stderr Copying blob sha256:edd8cbe4deb828f809e8d76f308301dd93e971948e909d25cc03015fed1fd796 2024-09-10T22:16:08.012 INFO:teuthology.orchestra.run.smithi019.stdout:/bin/podman: stderr Copying blob sha256:e8b54c863393b7a8216a71737771b73b16a8e43ec7acf927c7faa175c255e551 2024-09-10T22:16:08.012 INFO:teuthology.orchestra.run.smithi019.stdout:/bin/podman: stderr Copying config sha256:589dd18248e494ba411dc838aa4ae0e5e569213f08fcd7a2cf22cd3ef7e3c480 2024-09-10T22:16:08.012 INFO:teuthology.orchestra.run.smithi019.stdout:/bin/podman: stderr Writing manifest to image destination 2024-09-10T22:16:09.273 INFO:teuthology.orchestra.run.smithi019.stdout:ceph: stdout ceph version 19.3.0-4854-g8f219c47 (8f219c476cb4f26fc5719c661c0323719a45cb30) squid (dev) 2024-09-10T22:16:09.273 INFO:teuthology.orchestra.run.smithi019.stdout:Ceph version: ceph version 19.3.0-4854-g8f219c47 (8f219c476cb4f26fc5719c661c0323719a45cb30) squid (dev) 2024-09-10T22:16:09.273 INFO:teuthology.orchestra.run.smithi019.stdout:Extracting ceph user uid/gid from container image... 2024-09-10T22:16:10.295 INFO:teuthology.orchestra.run.smithi019.stdout:stat: stdout 167 167 2024-09-10T22:16:10.295 INFO:teuthology.orchestra.run.smithi019.stdout:Creating initial keys... 2024-09-10T22:16:11.292 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph-authtool: stdout AQAqxeBm02HnIxAA1DYgv086dwnwYrvAGoO0ww== 2024-09-10T22:16:12.174 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph-authtool: stdout AQArxeBmOtM+IhAAHFPMn6CPbT5qxYnLsSt+ig== 2024-09-10T22:16:13.123 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph-authtool: stdout AQAsxeBmXBtUHxAAXKV3q9Ak+1gAp/8NAkYQYQ== 2024-09-10T22:16:13.124 INFO:teuthology.orchestra.run.smithi019.stdout:Creating initial monmap... 2024-09-10T22:16:14.205 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: monmap file /tmp/monmap 2024-09-10T22:16:14.205 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/monmaptool: stdout setting min_mon_release = quincy 2024-09-10T22:16:14.205 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: set fsid to 22997a4c-6fc2-11ef-bcea-c7b262605968 2024-09-10T22:16:14.205 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2024-09-10T22:16:14.205 INFO:teuthology.orchestra.run.smithi019.stdout:monmaptool for a [v2:172.21.15.19:3300,v1:172.21.15.19:6789] on /usr/bin/monmaptool: monmap file /tmp/monmap 2024-09-10T22:16:14.206 INFO:teuthology.orchestra.run.smithi019.stdout:setting min_mon_release = quincy 2024-09-10T22:16:14.206 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/monmaptool: set fsid to 22997a4c-6fc2-11ef-bcea-c7b262605968 2024-09-10T22:16:14.206 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2024-09-10T22:16:14.206 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-10T22:16:14.206 INFO:teuthology.orchestra.run.smithi019.stdout:Creating mon... 2024-09-10T22:16:15.278 INFO:teuthology.orchestra.run.smithi019.stdout:create mon.a on 2024-09-10T22:16:15.486 INFO:teuthology.orchestra.run.smithi019.stdout:systemctl: stderr Removed "/etc/systemd/system/multi-user.target.wants/ceph.target". 2024-09-10T22:16:15.633 INFO:teuthology.orchestra.run.smithi019.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /etc/systemd/system/ceph.target. 2024-09-10T22:16:15.821 INFO:teuthology.orchestra.run.smithi019.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph-22997a4c-6fc2-11ef-bcea-c7b262605968.target → /etc/systemd/system/ceph-22997a4c-6fc2-11ef-bcea-c7b262605968.target. 2024-09-10T22:16:15.821 INFO:teuthology.orchestra.run.smithi019.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph.target.wants/ceph-22997a4c-6fc2-11ef-bcea-c7b262605968.target → /etc/systemd/system/ceph-22997a4c-6fc2-11ef-bcea-c7b262605968.target. 2024-09-10T22:16:16.083 INFO:teuthology.orchestra.run.smithi019.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-22997a4c-6fc2-11ef-bcea-c7b262605968@mon.a 2024-09-10T22:16:16.083 INFO:teuthology.orchestra.run.smithi019.stdout:systemctl: stderr Failed to reset failed state of unit ceph-22997a4c-6fc2-11ef-bcea-c7b262605968@mon.a.service: Unit ceph-22997a4c-6fc2-11ef-bcea-c7b262605968@mon.a.service not loaded. 2024-09-10T22:16:16.252 INFO:teuthology.orchestra.run.smithi019.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-22997a4c-6fc2-11ef-bcea-c7b262605968.target.wants/ceph-22997a4c-6fc2-11ef-bcea-c7b262605968@mon.a.service → /etc/systemd/system/ceph-22997a4c-6fc2-11ef-bcea-c7b262605968@.service. 2024-09-10T22:16:16.804 INFO:teuthology.orchestra.run.smithi019.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-10T22:16:16.804 INFO:teuthology.orchestra.run.smithi019.stdout:systemctl: stdout disabled 2024-09-10T22:16:16.812 INFO:teuthology.orchestra.run.smithi019.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-10T22:16:16.812 INFO:teuthology.orchestra.run.smithi019.stdout:systemctl: stdout inactive 2024-09-10T22:16:16.812 INFO:teuthology.orchestra.run.smithi019.stdout:firewalld.service is not enabled 2024-09-10T22:16:16.812 INFO:teuthology.orchestra.run.smithi019.stdout:Not possible to enable service . firewalld.service is not available 2024-09-10T22:16:16.813 INFO:teuthology.orchestra.run.smithi019.stdout:Waiting for mon to start... 2024-09-10T22:16:16.813 INFO:teuthology.orchestra.run.smithi019.stdout:Waiting for mon... 2024-09-10T22:16:17.888 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:16:17 smithi019 ceph-mon[31009]: from='client.? 172.21.15.19:0/3863316027' entity='client.admin' cmd={"prefix": "status"} : dispatch 2024-09-10T22:16:17.892 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout cluster: 2024-09-10T22:16:17.892 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout id: 22997a4c-6fc2-11ef-bcea-c7b262605968 2024-09-10T22:16:17.892 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout health: HEALTH_OK 2024-09-10T22:16:17.892 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout 2024-09-10T22:16:17.892 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout services: 2024-09-10T22:16:17.892 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout mon: 1 daemons, quorum a (age 0.567594s) 2024-09-10T22:16:17.892 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout mgr: no daemons active 2024-09-10T22:16:17.893 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout osd: 0 osds: 0 up, 0 in 2024-09-10T22:16:17.893 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout 2024-09-10T22:16:17.893 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout data: 2024-09-10T22:16:17.893 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout pools: 0 pools, 0 pgs 2024-09-10T22:16:17.893 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout objects: 0 objects, 0 B 2024-09-10T22:16:17.893 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout usage: 0 B used, 0 B / 0 B avail 2024-09-10T22:16:17.893 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout pgs: 2024-09-10T22:16:17.893 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout 2024-09-10T22:16:17.893 INFO:teuthology.orchestra.run.smithi019.stdout:mon is available 2024-09-10T22:16:17.893 INFO:teuthology.orchestra.run.smithi019.stdout:Assimilating anything we can from ceph.conf... 2024-09-10T22:16:18.880 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout 2024-09-10T22:16:18.882 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout [global] 2024-09-10T22:16:18.882 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout fsid = 22997a4c-6fc2-11ef-bcea-c7b262605968 2024-09-10T22:16:18.882 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout mon_cluster_log_file_level = debug 2024-09-10T22:16:18.882 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout mon_host = [v2:172.21.15.19:3300,v1:172.21.15.19:6789] 2024-09-10T22:16:18.882 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2024-09-10T22:16:18.882 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2024-09-10T22:16:18.882 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2024-09-10T22:16:18.882 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2024-09-10T22:16:18.883 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout 2024-09-10T22:16:18.883 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout [mgr] 2024-09-10T22:16:18.883 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2024-09-10T22:16:18.883 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout 2024-09-10T22:16:18.883 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout [osd] 2024-09-10T22:16:18.883 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout bdev_async_discard = True 2024-09-10T22:16:18.883 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2024-09-10T22:16:18.883 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2024-09-10T22:16:18.883 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2024-09-10T22:16:18.883 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2024-09-10T22:16:18.883 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2024-09-10T22:16:18.883 INFO:teuthology.orchestra.run.smithi019.stdout:Generating new minimal ceph.conf... 2024-09-10T22:16:18.959 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:16:18 smithi019 ceph-mon[31009]: from='client.? 172.21.15.19:0/1727019231' entity='client.admin' cmd={"prefix": "config assimilate-conf"} : dispatch 2024-09-10T22:16:18.959 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:16:18 smithi019 ceph-mon[31009]: from='client.? 172.21.15.19:0/1727019231' entity='client.admin' cmd='[{"prefix": "config assimilate-conf"}]': finished 2024-09-10T22:16:19.951 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:16:19 smithi019 ceph-mon[31009]: from='client.? 172.21.15.19:0/1682774207' entity='client.admin' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T22:16:19.954 INFO:teuthology.orchestra.run.smithi019.stdout:Restarting the monitor... 2024-09-10T22:16:20.208 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:16:19 smithi019 systemd[1]: Stopping Ceph mon.a for 22997a4c-6fc2-11ef-bcea-c7b262605968... 2024-09-10T22:16:20.588 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:16:20 smithi019 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-mon-a[31005]: 2024-09-10T22:16:20.328+0000 7f2e679ea640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-10T22:16:20.588 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:16:20 smithi019 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-mon-a[31005]: 2024-09-10T22:16:20.328+0000 7f2e679ea640 -1 mon.a@0(leader) e1 *** Got Signal Terminated *** 2024-09-10T22:16:20.588 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:16:20 smithi019 podman[31254]: 2024-09-10 22:16:20.359319394 +0000 UTC m=+0.227745592 container died c819ea37c85cbefc7a9a64d707497892a54ae31f0f4e07868d1650993ee140c6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30, name=ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-mon-a, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, ceph=True, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731) 2024-09-10T22:16:20.896 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:16:20 smithi019 podman[31254]: 2024-09-10 22:16:20.686336033 +0000 UTC m=+0.554762230 container cleanup c819ea37c85cbefc7a9a64d707497892a54ae31f0f4e07868d1650993ee140c6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30, name=ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-mon-a, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, ceph=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4) 2024-09-10T22:16:20.897 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:16:20 smithi019 bash[31254]: ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-mon-a 2024-09-10T22:16:21.208 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:16:20 smithi019 podman[31267]: 2024-09-10 22:16:20.895736257 +0000 UTC m=+0.533063873 container remove c819ea37c85cbefc7a9a64d707497892a54ae31f0f4e07868d1650993ee140c6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30, name=ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-mon-a, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, ceph=True, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.build-date=20240731) 2024-09-10T22:16:21.208 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:16:21 smithi019 systemd[1]: ceph-22997a4c-6fc2-11ef-bcea-c7b262605968@mon.a.service: Deactivated successfully. 2024-09-10T22:16:21.209 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:16:21 smithi019 systemd[1]: Stopped Ceph mon.a for 22997a4c-6fc2-11ef-bcea-c7b262605968. 2024-09-10T22:16:21.209 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:16:21 smithi019 systemd[1]: Starting Ceph mon.a for 22997a4c-6fc2-11ef-bcea-c7b262605968... 2024-09-10T22:16:21.600 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:16:21 smithi019 podman[31357]: 2024-09-10 22:16:21.338040356 +0000 UTC m=+0.111456454 container create 9dcddfe60fd2ae97d906c75a6684f6eda330616bd158b47b7bb428d7d7a7afcc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30, name=ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-mon-a, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD) 2024-09-10T22:16:21.600 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:16:21 smithi019 podman[31357]: 2024-09-10 22:16:21.24700125 +0000 UTC m=+0.020417361 image pull 589dd18248e494ba411dc838aa4ae0e5e569213f08fcd7a2cf22cd3ef7e3c480 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 2024-09-10T22:16:21.600 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:16:21 smithi019 podman[31357]: 2024-09-10 22:16:21.532652315 +0000 UTC m=+0.306068414 container init 9dcddfe60fd2ae97d906c75a6684f6eda330616bd158b47b7bb428d7d7a7afcc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30, name=ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-mon-a, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-10T22:16:21.600 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:16:21 smithi019 podman[31357]: 2024-09-10 22:16:21.535891898 +0000 UTC m=+0.309307999 container start 9dcddfe60fd2ae97d906c75a6684f6eda330616bd158b47b7bb428d7d7a7afcc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30, name=ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-mon-a, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, io.buildah.version=1.37.2, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_CLEAN=True, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS) 2024-09-10T22:16:21.601 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:16:21 smithi019 ceph-mon[31375]: set uid:gid to 167:167 (ceph:ceph) 2024-09-10T22:16:21.601 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:16:21 smithi019 ceph-mon[31375]: ceph version 19.3.0-4854-g8f219c47 (8f219c476cb4f26fc5719c661c0323719a45cb30) squid (dev), process ceph-mon, pid 2 2024-09-10T22:16:21.601 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:16:21 smithi019 ceph-mon[31375]: pidfile_write: ignore empty --pid-file 2024-09-10T22:16:21.601 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:16:21 smithi019 ceph-mon[31375]: load: jerasure load: lrc 2024-09-10T22:16:21.601 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:16:21 smithi019 ceph-mon[31375]: rocksdb: RocksDB version: 7.9.2 2024-09-10T22:16:21.601 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:16:21 smithi019 ceph-mon[31375]: rocksdb: Git sha 0 2024-09-10T22:16:21.601 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:16:21 smithi019 ceph-mon[31375]: rocksdb: Compile date 2024-09-10 08:02:51 2024-09-10T22:16:21.601 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:16:21 smithi019 ceph-mon[31375]: rocksdb: DB SUMMARY 2024-09-10T22:16:21.601 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:16:21 smithi019 ceph-mon[31375]: rocksdb: DB Session ID: F281JKUZTT6VTZEU9BZO 2024-09-10T22:16:21.601 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:16:21 smithi019 ceph-mon[31375]: rocksdb: CURRENT file: CURRENT 2024-09-10T22:16:21.601 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:16:21 smithi019 ceph-mon[31375]: rocksdb: IDENTITY file: IDENTITY 2024-09-10T22:16:21.601 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:16:21 smithi019 ceph-mon[31375]: rocksdb: MANIFEST file: MANIFEST-000010 size: 179 Bytes 2024-09-10T22:16:21.602 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:16:21 smithi019 ceph-mon[31375]: rocksdb: SST files in /var/lib/ceph/mon/ceph-a/store.db dir, Total Num: 1, files: 000008.sst 2024-09-10T22:16:21.602 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:16:21 smithi019 ceph-mon[31375]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-a/store.db: 000009.log size: 96034 ; 2024-09-10T22:16:21.603 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:16:21 smithi019 ceph-mon[31375]: rocksdb: Options.error_if_exists: 0 2024-09-10T22:16:21.604 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:16:21 smithi019 ceph-mon[31375]: rocksdb: Options.create_if_missing: 0 2024-09-10T22:16:21.604 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:16:21 smithi019 ceph-mon[31375]: rocksdb: Options.paranoid_checks: 1 2024-09-10T22:16:21.604 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:16:21 smithi019 ceph-mon[31375]: rocksdb: Options.flush_verify_memtable_count: 1 2024-09-10T22:16:21.604 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:16:21 smithi019 ceph-mon[31375]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-09-10T22:16:21.604 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:16:21 smithi019 ceph-mon[31375]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-09-10T22:16:21.604 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:16:21 smithi019 ceph-mon[31375]: rocksdb: Options.env: 0x561032a8b180 2024-09-10T22:16:21.604 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:16:21 smithi019 ceph-mon[31375]: rocksdb: Options.fs: PosixFileSystem 2024-09-10T22:16:21.604 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:16:21 smithi019 ceph-mon[31375]: rocksdb: Options.info_log: 0x5610351e7700 2024-09-10T22:16:21.604 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:16:21 smithi019 ceph-mon[31375]: rocksdb: Options.max_file_opening_threads: 16 2024-09-10T22:16:21.604 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:16:21 smithi019 ceph-mon[31375]: rocksdb: Options.statistics: (nil) 2024-09-10T22:16:21.604 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:16:21 smithi019 ceph-mon[31375]: rocksdb: Options.use_fsync: 0 2024-09-10T22:16:21.604 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:16:21 smithi019 ceph-mon[31375]: rocksdb: Options.max_log_file_size: 0 2024-09-10T22:16:21.604 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:16:21 smithi019 ceph-mon[31375]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-09-10T22:16:21.605 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:16:21 smithi019 ceph-mon[31375]: rocksdb: Options.log_file_time_to_roll: 0 2024-09-10T22:16:21.605 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:16:21 smithi019 ceph-mon[31375]: rocksdb: Options.keep_log_file_num: 1000 2024-09-10T22:16:21.605 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:16:21 smithi019 ceph-mon[31375]: rocksdb: Options.recycle_log_file_num: 0 2024-09-10T22:16:21.605 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:16:21 smithi019 ceph-mon[31375]: rocksdb: Options.allow_fallocate: 1 2024-09-10T22:16:21.605 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:16:21 smithi019 ceph-mon[31375]: rocksdb: Options.allow_mmap_reads: 0 2024-09-10T22:16:21.605 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:16:21 smithi019 ceph-mon[31375]: rocksdb: Options.allow_mmap_writes: 0 2024-09-10T22:16:21.605 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:16:21 smithi019 ceph-mon[31375]: rocksdb: Options.use_direct_reads: 0 2024-09-10T22:16:21.605 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:16:21 smithi019 ceph-mon[31375]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-09-10T22:16:21.605 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:16:21 smithi019 ceph-mon[31375]: rocksdb: Options.create_missing_column_families: 0 2024-09-10T22:16:21.605 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:16:21 smithi019 ceph-mon[31375]: rocksdb: Options.db_log_dir: 2024-09-10T22:16:21.605 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:16:21 smithi019 ceph-mon[31375]: rocksdb: Options.wal_dir: 2024-09-10T22:16:21.606 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:16:21 smithi019 ceph-mon[31375]: rocksdb: Options.table_cache_numshardbits: 6 2024-09-10T22:16:21.606 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:16:21 smithi019 ceph-mon[31375]: rocksdb: Options.WAL_ttl_seconds: 0 2024-09-10T22:16:21.606 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:16:21 smithi019 ceph-mon[31375]: rocksdb: Options.WAL_size_limit_MB: 0 2024-09-10T22:16:21.606 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:16:21 smithi019 ceph-mon[31375]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-09-10T22:16:21.606 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:16:21 smithi019 ceph-mon[31375]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-09-10T22:16:21.606 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:16:21 smithi019 ceph-mon[31375]: rocksdb: Options.is_fd_close_on_exec: 1 2024-09-10T22:16:21.606 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:16:21 smithi019 ceph-mon[31375]: rocksdb: Options.advise_random_on_open: 1 2024-09-10T22:16:21.606 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:16:21 smithi019 ceph-mon[31375]: rocksdb: Options.db_write_buffer_size: 0 2024-09-10T22:16:21.606 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:16:21 smithi019 ceph-mon[31375]: rocksdb: Options.write_buffer_manager: 0x5610351ebb80 2024-09-10T22:16:21.606 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:16:21 smithi019 ceph-mon[31375]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-09-10T22:16:21.606 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:16:21 smithi019 ceph-mon[31375]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-09-10T22:16:21.606 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:16:21 smithi019 ceph-mon[31375]: rocksdb: Options.use_adaptive_mutex: 0 2024-09-10T22:16:21.606 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:16:21 smithi019 ceph-mon[31375]: rocksdb: Options.rate_limiter: (nil) 2024-09-10T22:16:21.607 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:16:21 smithi019 ceph-mon[31375]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-09-10T22:16:21.607 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:16:21 smithi019 ceph-mon[31375]: rocksdb: Options.wal_recovery_mode: 2 2024-09-10T22:16:21.607 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:16:21 smithi019 ceph-mon[31375]: rocksdb: Options.enable_thread_tracking: 0 2024-09-10T22:16:21.607 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:16:21 smithi019 ceph-mon[31375]: rocksdb: Options.enable_pipelined_write: 0 2024-09-10T22:16:21.607 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:16:21 smithi019 ceph-mon[31375]: rocksdb: Options.unordered_write: 0 2024-09-10T22:16:21.607 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:16:21 smithi019 ceph-mon[31375]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-09-10T22:16:21.607 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:16:21 smithi019 ceph-mon[31375]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-09-10T22:16:21.607 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:16:21 smithi019 ceph-mon[31375]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-09-10T22:16:21.607 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:16:21 smithi019 ceph-mon[31375]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-09-10T22:16:21.607 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:16:21 smithi019 ceph-mon[31375]: rocksdb: Options.row_cache: None 2024-09-10T22:16:21.607 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:16:21 smithi019 ceph-mon[31375]: rocksdb: Options.wal_filter: None 2024-09-10T22:16:21.607 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:16:21 smithi019 ceph-mon[31375]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-09-10T22:16:21.608 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:16:21 smithi019 ceph-mon[31375]: rocksdb: Options.allow_ingest_behind: 0 2024-09-10T22:16:21.608 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:16:21 smithi019 ceph-mon[31375]: rocksdb: Options.two_write_queues: 0 2024-09-10T22:16:21.608 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:16:21 smithi019 ceph-mon[31375]: rocksdb: Options.manual_wal_flush: 0 2024-09-10T22:16:21.608 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:16:21 smithi019 ceph-mon[31375]: rocksdb: Options.wal_compression: 0 2024-09-10T22:16:21.608 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:16:21 smithi019 ceph-mon[31375]: rocksdb: Options.atomic_flush: 0 2024-09-10T22:16:21.609 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:16:21 smithi019 ceph-mon[31375]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-09-10T22:16:21.609 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:16:21 smithi019 ceph-mon[31375]: rocksdb: Options.persist_stats_to_disk: 0 2024-09-10T22:16:21.609 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:16:21 smithi019 ceph-mon[31375]: rocksdb: Options.write_dbid_to_manifest: 0 2024-09-10T22:16:21.609 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:16:21 smithi019 ceph-mon[31375]: rocksdb: Options.log_readahead_size: 0 2024-09-10T22:16:21.609 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:16:21 smithi019 ceph-mon[31375]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-09-10T22:16:21.609 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:16:21 smithi019 ceph-mon[31375]: rocksdb: Options.best_efforts_recovery: 0 2024-09-10T22:16:21.609 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:16:21 smithi019 ceph-mon[31375]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-09-10T22:16:21.609 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:16:21 smithi019 ceph-mon[31375]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-09-10T22:16:21.609 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:16:21 smithi019 ceph-mon[31375]: rocksdb: Options.allow_data_in_errors: 0 2024-09-10T22:16:21.609 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:16:21 smithi019 ceph-mon[31375]: rocksdb: Options.db_host_id: __hostname__ 2024-09-10T22:16:21.610 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:16:21 smithi019 ceph-mon[31375]: rocksdb: Options.enforce_single_del_contracts: true 2024-09-10T22:16:21.610 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:16:21 smithi019 ceph-mon[31375]: rocksdb: Options.max_background_jobs: 2 2024-09-10T22:16:21.610 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:16:21 smithi019 ceph-mon[31375]: rocksdb: Options.max_background_compactions: -1 2024-09-10T22:16:21.610 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:16:21 smithi019 ceph-mon[31375]: rocksdb: Options.max_subcompactions: 1 2024-09-10T22:16:21.610 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:16:21 smithi019 ceph-mon[31375]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-09-10T22:16:21.610 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:16:21 smithi019 ceph-mon[31375]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-09-10T22:16:21.610 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:16:21 smithi019 ceph-mon[31375]: rocksdb: Options.delayed_write_rate : 16777216 2024-09-10T22:16:21.610 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:16:21 smithi019 ceph-mon[31375]: rocksdb: Options.max_total_wal_size: 0 2024-09-10T22:16:21.610 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:16:21 smithi019 ceph-mon[31375]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-09-10T22:16:21.610 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:16:21 smithi019 ceph-mon[31375]: rocksdb: Options.stats_dump_period_sec: 600 2024-09-10T22:16:21.610 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:16:21 smithi019 ceph-mon[31375]: rocksdb: Options.stats_persist_period_sec: 600 2024-09-10T22:16:21.610 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:16:21 smithi019 ceph-mon[31375]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-09-10T22:16:21.611 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:16:21 smithi019 ceph-mon[31375]: rocksdb: Options.max_open_files: -1 2024-09-10T22:16:21.611 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:16:21 smithi019 ceph-mon[31375]: rocksdb: Options.bytes_per_sync: 0 2024-09-10T22:16:21.611 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:16:21 smithi019 ceph-mon[31375]: rocksdb: Options.wal_bytes_per_sync: 0 2024-09-10T22:16:21.611 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:16:21 smithi019 ceph-mon[31375]: rocksdb: Options.strict_bytes_per_sync: 0 2024-09-10T22:16:21.611 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:16:21 smithi019 ceph-mon[31375]: rocksdb: Options.compaction_readahead_size: 0 2024-09-10T22:16:21.611 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:16:21 smithi019 ceph-mon[31375]: rocksdb: Options.max_background_flushes: -1 2024-09-10T22:16:21.611 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:16:21 smithi019 ceph-mon[31375]: rocksdb: Compression algorithms supported: 2024-09-10T22:16:21.611 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:16:21 smithi019 ceph-mon[31375]: rocksdb: kZSTD supported: 0 2024-09-10T22:16:21.611 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:16:21 smithi019 ceph-mon[31375]: rocksdb: kXpressCompression supported: 0 2024-09-10T22:16:21.611 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:16:21 smithi019 ceph-mon[31375]: rocksdb: kBZip2Compression supported: 0 2024-09-10T22:16:21.611 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:16:21 smithi019 ceph-mon[31375]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-09-10T22:16:21.611 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:16:21 smithi019 ceph-mon[31375]: rocksdb: kLZ4Compression supported: 1 2024-09-10T22:16:21.611 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:16:21 smithi019 ceph-mon[31375]: rocksdb: kZlibCompression supported: 1 2024-09-10T22:16:21.612 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:16:21 smithi019 ceph-mon[31375]: rocksdb: kLZ4HCCompression supported: 1 2024-09-10T22:16:21.612 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:16:21 smithi019 ceph-mon[31375]: rocksdb: kSnappyCompression supported: 1 2024-09-10T22:16:21.612 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:16:21 smithi019 ceph-mon[31375]: rocksdb: Fast CRC32 supported: Supported on x86 2024-09-10T22:16:21.612 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:16:21 smithi019 ceph-mon[31375]: rocksdb: DMutex implementation: pthread_mutex_t 2024-09-10T22:16:21.612 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:16:21 smithi019 ceph-mon[31375]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 2024-09-10T22:16:21.612 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:16:21 smithi019 ceph-mon[31375]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-09-10T22:16:21.612 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:16:21 smithi019 ceph-mon[31375]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-09-10T22:16:21.612 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:16:21 smithi019 ceph-mon[31375]: rocksdb: Options.merge_operator: 2024-09-10T22:16:21.612 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:16:21 smithi019 ceph-mon[31375]: rocksdb: Options.compaction_filter: None 2024-09-10T22:16:21.612 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:16:21 smithi019 ceph-mon[31375]: rocksdb: Options.compaction_filter_factory: None 2024-09-10T22:16:21.612 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:16:21 smithi019 ceph-mon[31375]: rocksdb: Options.sst_partitioner_factory: None 2024-09-10T22:16:21.612 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:16:21 smithi019 ceph-mon[31375]: rocksdb: Options.memtable_factory: SkipListFactory 2024-09-10T22:16:21.612 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:16:21 smithi019 ceph-mon[31375]: rocksdb: Options.table_factory: BlockBasedTable 2024-09-10T22:16:21.613 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:16:21 smithi019 ceph-mon[31375]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x5610351e7320) 2024-09-10T22:16:21.613 INFO:journalctl@ceph.mon.a.smithi019.stdout: cache_index_and_filter_blocks: 1 2024-09-10T22:16:21.613 INFO:journalctl@ceph.mon.a.smithi019.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-09-10T22:16:21.613 INFO:journalctl@ceph.mon.a.smithi019.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-09-10T22:16:21.613 INFO:journalctl@ceph.mon.a.smithi019.stdout: pin_top_level_index_and_filter: 1 2024-09-10T22:16:21.613 INFO:journalctl@ceph.mon.a.smithi019.stdout: index_type: 0 2024-09-10T22:16:21.613 INFO:journalctl@ceph.mon.a.smithi019.stdout: data_block_index_type: 0 2024-09-10T22:16:21.613 INFO:journalctl@ceph.mon.a.smithi019.stdout: index_shortening: 1 2024-09-10T22:16:21.613 INFO:journalctl@ceph.mon.a.smithi019.stdout: data_block_hash_table_util_ratio: 0.750000 2024-09-10T22:16:21.613 INFO:journalctl@ceph.mon.a.smithi019.stdout: checksum: 4 2024-09-10T22:16:21.613 INFO:journalctl@ceph.mon.a.smithi019.stdout: no_block_cache: 0 2024-09-10T22:16:21.614 INFO:journalctl@ceph.mon.a.smithi019.stdout: block_cache: 0x5610351db610 2024-09-10T22:16:21.614 INFO:journalctl@ceph.mon.a.smithi019.stdout: block_cache_name: BinnedLRUCache 2024-09-10T22:16:21.614 INFO:journalctl@ceph.mon.a.smithi019.stdout: block_cache_options: 2024-09-10T22:16:21.614 INFO:journalctl@ceph.mon.a.smithi019.stdout: capacity : 536870912 2024-09-10T22:16:21.614 INFO:journalctl@ceph.mon.a.smithi019.stdout: num_shard_bits : 4 2024-09-10T22:16:21.614 INFO:journalctl@ceph.mon.a.smithi019.stdout: strict_capacity_limit : 0 2024-09-10T22:16:21.614 INFO:journalctl@ceph.mon.a.smithi019.stdout: high_pri_pool_ratio: 0.000 2024-09-10T22:16:21.614 INFO:journalctl@ceph.mon.a.smithi019.stdout: block_cache_compressed: (nil) 2024-09-10T22:16:21.614 INFO:journalctl@ceph.mon.a.smithi019.stdout: persistent_cache: (nil) 2024-09-10T22:16:21.614 INFO:journalctl@ceph.mon.a.smithi019.stdout: block_size: 4096 2024-09-10T22:16:21.614 INFO:journalctl@ceph.mon.a.smithi019.stdout: block_size_deviation: 10 2024-09-10T22:16:21.614 INFO:journalctl@ceph.mon.a.smithi019.stdout: block_restart_interval: 16 2024-09-10T22:16:21.615 INFO:journalctl@ceph.mon.a.smithi019.stdout: index_block_restart_interval: 1 2024-09-10T22:16:21.615 INFO:journalctl@ceph.mon.a.smithi019.stdout: metadata_block_size: 4096 2024-09-10T22:16:21.615 INFO:journalctl@ceph.mon.a.smithi019.stdout: partition_filters: 0 2024-09-10T22:16:21.615 INFO:journalctl@ceph.mon.a.smithi019.stdout: use_delta_encoding: 1 2024-09-10T22:16:21.615 INFO:journalctl@ceph.mon.a.smithi019.stdout: filter_policy: bloomfilter 2024-09-10T22:16:21.615 INFO:journalctl@ceph.mon.a.smithi019.stdout: whole_key_filtering: 1 2024-09-10T22:16:21.615 INFO:journalctl@ceph.mon.a.smithi019.stdout: verify_compression: 0 2024-09-10T22:16:21.615 INFO:journalctl@ceph.mon.a.smithi019.stdout: read_amp_bytes_per_bit: 0 2024-09-10T22:16:21.615 INFO:journalctl@ceph.mon.a.smithi019.stdout: format_version: 5 2024-09-10T22:16:21.615 INFO:journalctl@ceph.mon.a.smithi019.stdout: enable_index_compression: 1 2024-09-10T22:16:21.615 INFO:journalctl@ceph.mon.a.smithi019.stdout: block_align: 0 2024-09-10T22:16:21.615 INFO:journalctl@ceph.mon.a.smithi019.stdout: max_auto_readahead_size: 262144 2024-09-10T22:16:21.615 INFO:journalctl@ceph.mon.a.smithi019.stdout: prepopulate_block_cache: 0 2024-09-10T22:16:21.616 INFO:journalctl@ceph.mon.a.smithi019.stdout: initial_auto_readahead_size: 8192 2024-09-10T22:16:21.616 INFO:journalctl@ceph.mon.a.smithi019.stdout: num_file_reads_for_auto_readahead: 2 2024-09-10T22:16:21.616 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:16:21 smithi019 ceph-mon[31375]: rocksdb: Options.write_buffer_size: 33554432 2024-09-10T22:16:21.616 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:16:21 smithi019 ceph-mon[31375]: rocksdb: Options.max_write_buffer_number: 2 2024-09-10T22:16:21.616 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:16:21 smithi019 ceph-mon[31375]: rocksdb: Options.compression: NoCompression 2024-09-10T22:16:21.616 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:16:21 smithi019 ceph-mon[31375]: rocksdb: Options.bottommost_compression: Disabled 2024-09-10T22:16:21.616 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:16:21 smithi019 ceph-mon[31375]: rocksdb: Options.prefix_extractor: nullptr 2024-09-10T22:16:21.616 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:16:21 smithi019 ceph-mon[31375]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-09-10T22:16:21.616 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:16:21 smithi019 ceph-mon[31375]: rocksdb: Options.num_levels: 7 2024-09-10T22:16:21.616 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:16:21 smithi019 ceph-mon[31375]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-09-10T22:16:21.616 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:16:21 smithi019 ceph-mon[31375]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-09-10T22:16:21.616 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:16:21 smithi019 ceph-mon[31375]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-09-10T22:16:21.616 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:16:21 smithi019 ceph-mon[31375]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-09-10T22:16:21.617 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:16:21 smithi019 ceph-mon[31375]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-09-10T22:16:21.617 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:16:21 smithi019 ceph-mon[31375]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-09-10T22:16:21.617 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:16:21 smithi019 ceph-mon[31375]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-09-10T22:16:21.617 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:16:21 smithi019 ceph-mon[31375]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-09-10T22:16:21.617 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:16:21 smithi019 ceph-mon[31375]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-09-10T22:16:21.617 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:16:21 smithi019 ceph-mon[31375]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-09-10T22:16:21.617 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:16:21 smithi019 ceph-mon[31375]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-09-10T22:16:21.617 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:16:21 smithi019 ceph-mon[31375]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-09-10T22:16:21.617 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:16:21 smithi019 ceph-mon[31375]: rocksdb: Options.compression_opts.window_bits: -14 2024-09-10T22:16:21.617 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:16:21 smithi019 ceph-mon[31375]: rocksdb: Options.compression_opts.level: 32767 2024-09-10T22:16:21.617 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:16:21 smithi019 ceph-mon[31375]: rocksdb: Options.compression_opts.strategy: 0 2024-09-10T22:16:21.617 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:16:21 smithi019 ceph-mon[31375]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-09-10T22:16:21.617 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:16:21 smithi019 ceph-mon[31375]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-09-10T22:16:21.617 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:16:21 smithi019 ceph-mon[31375]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-09-10T22:16:21.618 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:16:21 smithi019 ceph-mon[31375]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-09-10T22:16:21.618 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:16:21 smithi019 ceph-mon[31375]: rocksdb: Options.compression_opts.enabled: false 2024-09-10T22:16:21.618 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:16:21 smithi019 ceph-mon[31375]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-09-10T22:16:21.618 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:16:21 smithi019 ceph-mon[31375]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-09-10T22:16:21.618 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:16:21 smithi019 ceph-mon[31375]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-09-10T22:16:21.618 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:16:21 smithi019 ceph-mon[31375]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-09-10T22:16:21.618 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:16:21 smithi019 ceph-mon[31375]: rocksdb: Options.target_file_size_base: 67108864 2024-09-10T22:16:21.618 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:16:21 smithi019 ceph-mon[31375]: rocksdb: Options.target_file_size_multiplier: 1 2024-09-10T22:16:21.618 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:16:21 smithi019 ceph-mon[31375]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-09-10T22:16:21.618 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:16:21 smithi019 ceph-mon[31375]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-09-10T22:16:21.618 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:16:21 smithi019 ceph-mon[31375]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-09-10T22:16:21.618 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:16:21 smithi019 ceph-mon[31375]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-09-10T22:16:21.618 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:16:21 smithi019 ceph-mon[31375]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-09-10T22:16:21.619 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:16:21 smithi019 ceph-mon[31375]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-09-10T22:16:21.619 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:16:21 smithi019 ceph-mon[31375]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-09-10T22:16:21.619 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:16:21 smithi019 ceph-mon[31375]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-09-10T22:16:21.619 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:16:21 smithi019 ceph-mon[31375]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-09-10T22:16:21.619 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:16:21 smithi019 ceph-mon[31375]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-09-10T22:16:21.619 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:16:21 smithi019 ceph-mon[31375]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-09-10T22:16:21.619 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:16:21 smithi019 ceph-mon[31375]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-09-10T22:16:21.619 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:16:21 smithi019 ceph-mon[31375]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-09-10T22:16:21.619 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:16:21 smithi019 ceph-mon[31375]: rocksdb: Options.arena_block_size: 1048576 2024-09-10T22:16:21.619 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:16:21 smithi019 ceph-mon[31375]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-09-10T22:16:21.619 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:16:21 smithi019 ceph-mon[31375]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-09-10T22:16:21.619 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:16:21 smithi019 ceph-mon[31375]: rocksdb: Options.disable_auto_compactions: 0 2024-09-10T22:16:21.619 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:16:21 smithi019 ceph-mon[31375]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-09-10T22:16:21.619 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:16:21 smithi019 ceph-mon[31375]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-09-10T22:16:21.620 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:16:21 smithi019 ceph-mon[31375]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-09-10T22:16:21.620 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:16:21 smithi019 ceph-mon[31375]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-09-10T22:16:21.620 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:16:21 smithi019 ceph-mon[31375]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-09-10T22:16:21.620 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:16:21 smithi019 ceph-mon[31375]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-09-10T22:16:21.620 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:16:21 smithi019 ceph-mon[31375]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-09-10T22:16:21.620 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:16:21 smithi019 ceph-mon[31375]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-09-10T22:16:21.620 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:16:21 smithi019 ceph-mon[31375]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-09-10T22:16:21.620 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:16:21 smithi019 ceph-mon[31375]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-09-10T22:16:21.620 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:16:21 smithi019 ceph-mon[31375]: rocksdb: Options.table_properties_collectors: CompactOnDeletionCollector (Sliding window size = 32768 Deletion trigger = 16384 Deletion ratio = 0); 2024-09-10T22:16:21.620 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:16:21 smithi019 ceph-mon[31375]: rocksdb: Options.inplace_update_support: 0 2024-09-10T22:16:21.620 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:16:21 smithi019 ceph-mon[31375]: rocksdb: Options.inplace_update_num_locks: 10000 2024-09-10T22:16:21.620 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:16:21 smithi019 ceph-mon[31375]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-09-10T22:16:21.620 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:16:21 smithi019 ceph-mon[31375]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-09-10T22:16:21.621 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:16:21 smithi019 ceph-mon[31375]: rocksdb: Options.memtable_huge_page_size: 0 2024-09-10T22:16:21.621 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:16:21 smithi019 ceph-mon[31375]: rocksdb: Options.bloom_locality: 0 2024-09-10T22:16:21.621 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:16:21 smithi019 ceph-mon[31375]: rocksdb: Options.max_successive_merges: 0 2024-09-10T22:16:21.621 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:16:21 smithi019 ceph-mon[31375]: rocksdb: Options.optimize_filters_for_hits: 0 2024-09-10T22:16:21.621 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:16:21 smithi019 ceph-mon[31375]: rocksdb: Options.paranoid_file_checks: 0 2024-09-10T22:16:21.621 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:16:21 smithi019 ceph-mon[31375]: rocksdb: Options.force_consistency_checks: 1 2024-09-10T22:16:21.621 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:16:21 smithi019 ceph-mon[31375]: rocksdb: Options.report_bg_io_stats: 0 2024-09-10T22:16:21.621 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:16:21 smithi019 ceph-mon[31375]: rocksdb: Options.ttl: 2592000 2024-09-10T22:16:21.621 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:16:21 smithi019 ceph-mon[31375]: rocksdb: Options.periodic_compaction_seconds: 0 2024-09-10T22:16:21.621 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:16:21 smithi019 ceph-mon[31375]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-09-10T22:16:21.621 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:16:21 smithi019 ceph-mon[31375]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-09-10T22:16:21.621 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:16:21 smithi019 ceph-mon[31375]: rocksdb: Options.enable_blob_files: false 2024-09-10T22:16:21.621 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:16:21 smithi019 ceph-mon[31375]: rocksdb: Options.min_blob_size: 0 2024-09-10T22:16:21.622 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:16:21 smithi019 ceph-mon[31375]: rocksdb: Options.blob_file_size: 268435456 2024-09-10T22:16:21.622 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:16:21 smithi019 ceph-mon[31375]: rocksdb: Options.blob_compression_type: NoCompression 2024-09-10T22:16:21.622 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:16:21 smithi019 ceph-mon[31375]: rocksdb: Options.enable_blob_garbage_collection: false 2024-09-10T22:16:21.622 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:16:21 smithi019 ceph-mon[31375]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-09-10T22:16:21.622 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:16:21 smithi019 ceph-mon[31375]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-09-10T22:16:21.622 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:16:21 smithi019 ceph-mon[31375]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-09-10T22:16:21.622 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:16:21 smithi019 ceph-mon[31375]: rocksdb: Options.blob_file_starting_level: 0 2024-09-10T22:16:21.622 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:16:21 smithi019 ceph-mon[31375]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-09-10T22:16:21.622 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:16:21 smithi019 ceph-mon[31375]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 succeeded,manifest_file_number is 10, next_file_number is 12, last_sequence is 5, log_number is 5,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 5 2024-09-10T22:16:21.622 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:16:21 smithi019 ceph-mon[31375]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 5 2024-09-10T22:16:21.622 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:16:21 smithi019 ceph-mon[31375]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: 92ff0871-ef60-4d00-b587-0df113b5305c 2024-09-10T22:16:21.622 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:16:21 smithi019 ceph-mon[31375]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726006581562940, "job": 1, "event": "recovery_started", "wal_files": [9]} 2024-09-10T22:16:21.622 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:16:21 smithi019 ceph-mon[31375]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #9 mode 2 2024-09-10T22:16:21.622 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:16:21 smithi019 ceph-mon[31375]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726006581563896, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 13, "file_size": 92097, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 8, "largest_seqno": 289, "table_properties": {"data_size": 90138, "index_size": 279, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 645, "raw_key_size": 11922, "raw_average_key_size": 48, "raw_value_size": 83439, "raw_average_value_size": 336, "num_data_blocks": 12, "num_entries": 248, "num_filter_entries": 248, "num_deletions": 3, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[CompactOnDeletionCollector]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1726006581, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "92ff0871-ef60-4d00-b587-0df113b5305c", "db_session_id": "F281JKUZTT6VTZEU9BZO", "orig_file_number": 13, "seqno_to_time_mapping": "N/A"}} 2024-09-10T22:16:21.623 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:16:21 smithi019 ceph-mon[31375]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726006581563994, "job": 1, "event": "recovery_finished"} 2024-09-10T22:16:21.623 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:16:21 smithi019 ceph-mon[31375]: rocksdb: [db/version_set.cc:5047] Creating manifest 15 2024-09-10T22:16:21.623 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:16:21 smithi019 ceph-mon[31375]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-a/store.db/000009.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-09-10T22:16:21.623 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:16:21 smithi019 ceph-mon[31375]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x56103520ae00 2024-09-10T22:16:21.623 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:16:21 smithi019 ceph-mon[31375]: rocksdb: DB pointer 0x56103530c000 2024-09-10T22:16:21.623 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:16:21 smithi019 ceph-mon[31375]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-09-10T22:16:21.623 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:16:21 smithi019 ceph-mon[31375]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-09-10T22:16:21.623 INFO:journalctl@ceph.mon.a.smithi019.stdout: ** DB Stats ** 2024-09-10T22:16:21.623 INFO:journalctl@ceph.mon.a.smithi019.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-10T22:16:21.623 INFO:journalctl@ceph.mon.a.smithi019.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-09-10T22:16:21.623 INFO:journalctl@ceph.mon.a.smithi019.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-10T22:16:21.623 INFO:journalctl@ceph.mon.a.smithi019.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-10T22:16:21.623 INFO:journalctl@ceph.mon.a.smithi019.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-09-10T22:16:21.624 INFO:journalctl@ceph.mon.a.smithi019.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-10T22:16:21.624 INFO:journalctl@ceph.mon.a.smithi019.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-10T22:16:21.624 INFO:journalctl@ceph.mon.a.smithi019.stdout: 2024-09-10T22:16:21.624 INFO:journalctl@ceph.mon.a.smithi019.stdout: ** Compaction Stats [default] ** 2024-09-10T22:16:21.624 INFO:journalctl@ceph.mon.a.smithi019.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-10T22:16:21.624 INFO:journalctl@ceph.mon.a.smithi019.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-09-10T22:16:21.624 INFO:journalctl@ceph.mon.a.smithi019.stdout: L0 2/0 91.80 KB 0.5 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 147.1 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-10T22:16:21.624 INFO:journalctl@ceph.mon.a.smithi019.stdout: Sum 2/0 91.80 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 147.1 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-10T22:16:21.624 INFO:journalctl@ceph.mon.a.smithi019.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 147.1 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-10T22:16:21.624 INFO:journalctl@ceph.mon.a.smithi019.stdout: 2024-09-10T22:16:21.624 INFO:journalctl@ceph.mon.a.smithi019.stdout: ** Compaction Stats [default] ** 2024-09-10T22:16:21.624 INFO:journalctl@ceph.mon.a.smithi019.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-10T22:16:21.624 INFO:journalctl@ceph.mon.a.smithi019.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-09-10T22:16:21.625 INFO:journalctl@ceph.mon.a.smithi019.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 147.1 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-10T22:16:21.625 INFO:journalctl@ceph.mon.a.smithi019.stdout: 2024-09-10T22:16:21.625 INFO:journalctl@ceph.mon.a.smithi019.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-09-10T22:16:21.625 INFO:journalctl@ceph.mon.a.smithi019.stdout: 2024-09-10T22:16:21.625 INFO:journalctl@ceph.mon.a.smithi019.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-10T22:16:21.625 INFO:journalctl@ceph.mon.a.smithi019.stdout: Flush(GB): cumulative 0.000, interval 0.000 2024-09-10T22:16:21.625 INFO:journalctl@ceph.mon.a.smithi019.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-09-10T22:16:21.625 INFO:journalctl@ceph.mon.a.smithi019.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-09-10T22:16:21.625 INFO:journalctl@ceph.mon.a.smithi019.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-09-10T22:16:21.625 INFO:journalctl@ceph.mon.a.smithi019.stdout: AddFile(Keys): cumulative 0, interval 0 2024-09-10T22:16:21.625 INFO:journalctl@ceph.mon.a.smithi019.stdout: Cumulative compaction: 0.00 GB write, 27.74 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-10T22:16:21.625 INFO:journalctl@ceph.mon.a.smithi019.stdout: Interval compaction: 0.00 GB write, 27.74 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-10T22:16:21.625 INFO:journalctl@ceph.mon.a.smithi019.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-09-10T22:16:21.625 INFO:journalctl@ceph.mon.a.smithi019.stdout: Block cache BinnedLRUCache@0x5610351db610#2 capacity: 512.00 MB usage: 1.30 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 9e-06 secs_since: 0 2024-09-10T22:16:21.626 INFO:journalctl@ceph.mon.a.smithi019.stdout: Block cache entry stats(count,size,portion): FilterBlock(2,0.83 KB,0.000157952%) IndexBlock(2,0.47 KB,8.9407e-05%) Misc(1,0.00 KB,0%) 2024-09-10T22:16:21.626 INFO:journalctl@ceph.mon.a.smithi019.stdout: 2024-09-10T22:16:21.626 INFO:journalctl@ceph.mon.a.smithi019.stdout: ** File Read Latency Histogram By Level [default] ** 2024-09-10T22:16:21.626 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:16:21 smithi019 ceph-mon[31375]: starting mon.a rank 0 at public addrs [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] at bind addrs [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon_data /var/lib/ceph/mon/ceph-a fsid 22997a4c-6fc2-11ef-bcea-c7b262605968 2024-09-10T22:16:21.626 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:16:21 smithi019 ceph-mon[31375]: mon.a@-1(???) e1 preinit fsid 22997a4c-6fc2-11ef-bcea-c7b262605968 2024-09-10T22:16:21.626 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:16:21 smithi019 ceph-mon[31375]: mon.a@-1(???).mds e1 new map 2024-09-10T22:16:21.626 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:16:21 smithi019 ceph-mon[31375]: mon.a@-1(???).mds e1 print_map 2024-09-10T22:16:21.626 INFO:journalctl@ceph.mon.a.smithi019.stdout: e1 2024-09-10T22:16:21.626 INFO:journalctl@ceph.mon.a.smithi019.stdout: btime 2024-09-10T22:16:16:754503+0000 2024-09-10T22:16:21.626 INFO:journalctl@ceph.mon.a.smithi019.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-09-10T22:16:21.626 INFO:journalctl@ceph.mon.a.smithi019.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-10T22:16:21.626 INFO:journalctl@ceph.mon.a.smithi019.stdout: legacy client fscid: -1 2024-09-10T22:16:21.626 INFO:journalctl@ceph.mon.a.smithi019.stdout: 2024-09-10T22:16:21.627 INFO:journalctl@ceph.mon.a.smithi019.stdout: No filesystems configured 2024-09-10T22:16:21.627 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:16:21 smithi019 ceph-mon[31375]: mon.a@-1(???).osd e1 crush map has features 3314932999778484224, adjusting msgr requires 2024-09-10T22:16:21.627 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:16:21 smithi019 ceph-mon[31375]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-09-10T22:16:21.627 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:16:21 smithi019 ceph-mon[31375]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-09-10T22:16:21.627 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:16:21 smithi019 ceph-mon[31375]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-09-10T22:16:21.627 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:16:21 smithi019 ceph-mon[31375]: mon.a@-1(???).paxosservice(auth 1..2) refresh upgraded, format 0 -> 3 2024-09-10T22:16:21.627 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:16:21 smithi019 bash[31357]: 9dcddfe60fd2ae97d906c75a6684f6eda330616bd158b47b7bb428d7d7a7afcc 2024-09-10T22:16:21.627 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:16:21 smithi019 systemd[1]: Started Ceph mon.a for 22997a4c-6fc2-11ef-bcea-c7b262605968. 2024-09-10T22:16:21.627 INFO:teuthology.orchestra.run.smithi019.stdout:Setting public_network to 172.21.0.0/20 in mon config section 2024-09-10T22:16:21.851 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:16:21 smithi019 ceph-mon[31375]: mon.a is new leader, mons a in quorum (ranks 0) 2024-09-10T22:16:21.852 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:16:21 smithi019 ceph-mon[31375]: monmap epoch 1 2024-09-10T22:16:21.852 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:16:21 smithi019 ceph-mon[31375]: fsid 22997a4c-6fc2-11ef-bcea-c7b262605968 2024-09-10T22:16:21.852 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:16:21 smithi019 ceph-mon[31375]: last_changed 2024-09-10T22:16:13.471813+0000 2024-09-10T22:16:21.852 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:16:21 smithi019 ceph-mon[31375]: created 2024-09-10T22:16:13.471813+0000 2024-09-10T22:16:21.852 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:16:21 smithi019 ceph-mon[31375]: min_mon_release 19 (squid) 2024-09-10T22:16:21.852 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:16:21 smithi019 ceph-mon[31375]: election_strategy: 1 2024-09-10T22:16:21.852 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:16:21 smithi019 ceph-mon[31375]: 0: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.a 2024-09-10T22:16:21.852 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:16:21 smithi019 ceph-mon[31375]: fsmap 2024-09-10T22:16:21.852 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:16:21 smithi019 ceph-mon[31375]: osdmap e1: 0 total, 0 up, 0 in 2024-09-10T22:16:21.852 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:16:21 smithi019 ceph-mon[31375]: mgrmap e1: no daemons active 2024-09-10T22:16:22.651 INFO:teuthology.orchestra.run.smithi019.stdout:Wrote config to /etc/ceph/ceph.conf 2024-09-10T22:16:22.673 INFO:teuthology.orchestra.run.smithi019.stdout:Wrote keyring to /etc/ceph/ceph.client.admin.keyring 2024-09-10T22:16:22.673 INFO:teuthology.orchestra.run.smithi019.stdout:Creating mgr... 2024-09-10T22:16:22.673 INFO:teuthology.orchestra.run.smithi019.stdout:Verifying port 0.0.0.0:9283 ... 2024-09-10T22:16:22.674 INFO:teuthology.orchestra.run.smithi019.stdout:Verifying port 0.0.0.0:8765 ... 2024-09-10T22:16:22.932 INFO:teuthology.orchestra.run.smithi019.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-22997a4c-6fc2-11ef-bcea-c7b262605968@mgr.x 2024-09-10T22:16:22.932 INFO:teuthology.orchestra.run.smithi019.stdout:systemctl: stderr Failed to reset failed state of unit ceph-22997a4c-6fc2-11ef-bcea-c7b262605968@mgr.x.service: Unit ceph-22997a4c-6fc2-11ef-bcea-c7b262605968@mgr.x.service not loaded. 2024-09-10T22:16:23.086 INFO:teuthology.orchestra.run.smithi019.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-22997a4c-6fc2-11ef-bcea-c7b262605968.target.wants/ceph-22997a4c-6fc2-11ef-bcea-c7b262605968@mgr.x.service → /etc/systemd/system/ceph-22997a4c-6fc2-11ef-bcea-c7b262605968@.service. 2024-09-10T22:16:23.208 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:16:23 smithi019 ceph-mon[31375]: from='client.? 172.21.15.19:0/2164571406' entity='client.admin' 2024-09-10T22:16:23.619 INFO:journalctl@ceph.mgr.x.smithi019.stdout:Sep 10 22:16:23 smithi019 podman[31590]: 2024-09-10 22:16:23.538361306 +0000 UTC m=+0.333142753 container start abb4423f855be20dd77bddf004023fce22ddbc300d018aba55323646f389334c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30, name=ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-mgr-x, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4) 2024-09-10T22:16:23.634 INFO:teuthology.orchestra.run.smithi019.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-10T22:16:23.634 INFO:teuthology.orchestra.run.smithi019.stdout:systemctl: stdout disabled 2024-09-10T22:16:23.642 INFO:teuthology.orchestra.run.smithi019.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-10T22:16:23.642 INFO:teuthology.orchestra.run.smithi019.stdout:systemctl: stdout inactive 2024-09-10T22:16:23.642 INFO:teuthology.orchestra.run.smithi019.stdout:firewalld.service is not enabled 2024-09-10T22:16:23.642 INFO:teuthology.orchestra.run.smithi019.stdout:Not possible to enable service . firewalld.service is not available 2024-09-10T22:16:23.651 INFO:teuthology.orchestra.run.smithi019.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-10T22:16:23.651 INFO:teuthology.orchestra.run.smithi019.stdout:systemctl: stdout disabled 2024-09-10T22:16:23.659 INFO:teuthology.orchestra.run.smithi019.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-10T22:16:23.659 INFO:teuthology.orchestra.run.smithi019.stdout:systemctl: stdout inactive 2024-09-10T22:16:23.659 INFO:teuthology.orchestra.run.smithi019.stdout:firewalld.service is not enabled 2024-09-10T22:16:23.659 INFO:teuthology.orchestra.run.smithi019.stdout:Not possible to open ports <[9283, 8765]>. firewalld.service is not available 2024-09-10T22:16:23.659 INFO:teuthology.orchestra.run.smithi019.stdout:Waiting for mgr to start... 2024-09-10T22:16:23.659 INFO:teuthology.orchestra.run.smithi019.stdout:Waiting for mgr... 2024-09-10T22:16:23.920 INFO:journalctl@ceph.mgr.x.smithi019.stdout:Sep 10 22:16:23 smithi019 bash[31590]: abb4423f855be20dd77bddf004023fce22ddbc300d018aba55323646f389334c 2024-09-10T22:16:23.921 INFO:journalctl@ceph.mgr.x.smithi019.stdout:Sep 10 22:16:23 smithi019 systemd[1]: Started Ceph mgr.x for 22997a4c-6fc2-11ef-bcea-c7b262605968. 2024-09-10T22:16:24.458 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:16:24 smithi019 ceph-mon[31375]: from='client.? 172.21.15.19:0/3539897031' entity='client.admin' cmd={"prefix": "status", "format": "json-pretty"} : dispatch 2024-09-10T22:16:24.790 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout 2024-09-10T22:16:24.790 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout { 2024-09-10T22:16:24.790 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "fsid": "22997a4c-6fc2-11ef-bcea-c7b262605968", 2024-09-10T22:16:24.790 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "health": { 2024-09-10T22:16:24.790 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-09-10T22:16:24.790 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-09-10T22:16:24.790 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-09-10T22:16:24.790 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout }, 2024-09-10T22:16:24.790 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-09-10T22:16:24.790 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-09-10T22:16:24.791 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout 0 2024-09-10T22:16:24.791 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout ], 2024-09-10T22:16:24.791 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-09-10T22:16:24.791 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "a" 2024-09-10T22:16:24.791 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout ], 2024-09-10T22:16:24.791 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "quorum_age": 2, 2024-09-10T22:16:24.791 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "monmap": { 2024-09-10T22:16:24.791 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-10T22:16:24.791 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-09-10T22:16:24.791 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-09-10T22:16:24.791 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout }, 2024-09-10T22:16:24.791 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-09-10T22:16:24.791 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-10T22:16:24.792 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-09-10T22:16:24.792 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-09-10T22:16:24.792 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-09-10T22:16:24.795 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-09-10T22:16:24.795 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-09-10T22:16:24.796 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-09-10T22:16:24.796 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout }, 2024-09-10T22:16:24.796 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-09-10T22:16:24.796 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-09-10T22:16:24.796 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-09-10T22:16:24.796 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-09-10T22:16:24.796 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-09-10T22:16:24.796 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-09-10T22:16:24.796 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-09-10T22:16:24.796 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-09-10T22:16:24.796 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-09-10T22:16:24.796 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout }, 2024-09-10T22:16:24.796 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-09-10T22:16:24.797 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-10T22:16:24.797 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "btime": "2024-09-10T22:16:16:754503+0000", 2024-09-10T22:16:24.797 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-09-10T22:16:24.797 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-09-10T22:16:24.797 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout }, 2024-09-10T22:16:24.797 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-09-10T22:16:24.797 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "available": false, 2024-09-10T22:16:24.797 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-09-10T22:16:24.797 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "modules": [ 2024-09-10T22:16:24.797 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "iostat", 2024-09-10T22:16:24.797 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "nfs", 2024-09-10T22:16:24.797 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "restful" 2024-09-10T22:16:24.797 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout ], 2024-09-10T22:16:24.798 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-10T22:16:24.798 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout }, 2024-09-10T22:16:24.798 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-09-10T22:16:24.798 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-10T22:16:24.798 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "modified": "2024-09-10T22:16:16.755198+0000", 2024-09-10T22:16:24.798 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-10T22:16:24.798 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout }, 2024-09-10T22:16:24.798 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-09-10T22:16:24.798 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout } 2024-09-10T22:16:24.798 INFO:teuthology.orchestra.run.smithi019.stdout:mgr not available, waiting (1/15)... 2024-09-10T22:16:27.438 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:16:27 smithi019 ceph-mon[31375]: from='client.? 172.21.15.19:0/3618480976' entity='client.admin' cmd={"prefix": "status", "format": "json-pretty"} : dispatch 2024-09-10T22:16:27.947 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout 2024-09-10T22:16:27.947 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout { 2024-09-10T22:16:27.948 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "fsid": "22997a4c-6fc2-11ef-bcea-c7b262605968", 2024-09-10T22:16:27.948 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "health": { 2024-09-10T22:16:27.948 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-09-10T22:16:27.948 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-09-10T22:16:27.948 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-09-10T22:16:27.948 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout }, 2024-09-10T22:16:27.948 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-09-10T22:16:27.948 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-09-10T22:16:27.948 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout 0 2024-09-10T22:16:27.948 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout ], 2024-09-10T22:16:27.948 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-09-10T22:16:27.948 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "a" 2024-09-10T22:16:27.949 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout ], 2024-09-10T22:16:27.949 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "quorum_age": 5, 2024-09-10T22:16:27.949 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "monmap": { 2024-09-10T22:16:27.949 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-10T22:16:27.949 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-09-10T22:16:27.949 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-09-10T22:16:27.949 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout }, 2024-09-10T22:16:27.949 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-09-10T22:16:27.949 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-10T22:16:27.949 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-09-10T22:16:27.950 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-09-10T22:16:27.950 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-09-10T22:16:27.950 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-09-10T22:16:27.950 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-09-10T22:16:27.950 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-09-10T22:16:27.950 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout }, 2024-09-10T22:16:27.950 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-09-10T22:16:27.950 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-09-10T22:16:27.950 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-09-10T22:16:27.950 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-09-10T22:16:27.950 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-09-10T22:16:27.950 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-09-10T22:16:27.950 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-09-10T22:16:27.950 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-09-10T22:16:27.951 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-09-10T22:16:27.951 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout }, 2024-09-10T22:16:27.951 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-09-10T22:16:27.951 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-10T22:16:27.951 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "btime": "2024-09-10T22:16:16:754503+0000", 2024-09-10T22:16:27.951 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-09-10T22:16:27.951 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-09-10T22:16:27.951 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout }, 2024-09-10T22:16:27.951 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-09-10T22:16:27.951 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "available": false, 2024-09-10T22:16:27.951 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-09-10T22:16:27.951 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "modules": [ 2024-09-10T22:16:27.951 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "iostat", 2024-09-10T22:16:27.951 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "nfs", 2024-09-10T22:16:27.952 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "restful" 2024-09-10T22:16:27.952 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout ], 2024-09-10T22:16:27.952 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-10T22:16:27.952 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout }, 2024-09-10T22:16:27.952 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-09-10T22:16:27.952 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-10T22:16:27.952 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "modified": "2024-09-10T22:16:16.755198+0000", 2024-09-10T22:16:27.952 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-10T22:16:27.952 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout }, 2024-09-10T22:16:27.952 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-09-10T22:16:27.952 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout } 2024-09-10T22:16:27.952 INFO:teuthology.orchestra.run.smithi019.stdout:mgr not available, waiting (2/15)... 2024-09-10T22:16:29.208 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:16:28 smithi019 ceph-mon[31375]: Activating manager daemon x 2024-09-10T22:16:29.209 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:16:28 smithi019 ceph-mon[31375]: mgrmap e2: x(active, starting, since 0.00327437s) 2024-09-10T22:16:29.209 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:16:28 smithi019 ceph-mon[31375]: from='mgr.14100 172.21.15.19:0/1424942427' entity='mgr.x' cmd={"prefix": "mds metadata"} : dispatch 2024-09-10T22:16:29.209 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:16:28 smithi019 ceph-mon[31375]: from='mgr.14100 172.21.15.19:0/1424942427' entity='mgr.x' cmd={"prefix": "osd metadata"} : dispatch 2024-09-10T22:16:29.209 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:16:28 smithi019 ceph-mon[31375]: from='mgr.14100 172.21.15.19:0/1424942427' entity='mgr.x' cmd={"prefix": "mon metadata"} : dispatch 2024-09-10T22:16:29.209 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:16:28 smithi019 ceph-mon[31375]: from='mgr.14100 172.21.15.19:0/1424942427' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-10T22:16:29.209 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:16:28 smithi019 ceph-mon[31375]: from='mgr.14100 172.21.15.19:0/1424942427' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "x", "id": "x"} : dispatch 2024-09-10T22:16:29.209 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:16:28 smithi019 ceph-mon[31375]: Manager daemon x is now available 2024-09-10T22:16:29.209 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:16:28 smithi019 ceph-mon[31375]: from='mgr.14100 172.21.15.19:0/1424942427' entity='mgr.x' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"} : dispatch 2024-09-10T22:16:29.209 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:16:28 smithi019 ceph-mon[31375]: from='mgr.14100 172.21.15.19:0/1424942427' entity='mgr.x' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"} : dispatch 2024-09-10T22:16:29.209 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:16:28 smithi019 ceph-mon[31375]: from='mgr.14100 172.21.15.19:0/1424942427' entity='mgr.x' 2024-09-10T22:16:29.209 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:16:28 smithi019 ceph-mon[31375]: from='mgr.14100 172.21.15.19:0/1424942427' entity='mgr.x' 2024-09-10T22:16:29.209 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:16:28 smithi019 ceph-mon[31375]: from='mgr.14100 172.21.15.19:0/1424942427' entity='mgr.x' 2024-09-10T22:16:30.958 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:16:30 smithi019 ceph-mon[31375]: mgrmap e3: x(active, since 1.00774s) 2024-09-10T22:16:30.959 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:16:30 smithi019 ceph-mon[31375]: from='client.? 172.21.15.19:0/1835492214' entity='client.admin' cmd={"prefix": "status", "format": "json-pretty"} : dispatch 2024-09-10T22:16:31.286 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout 2024-09-10T22:16:31.287 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout { 2024-09-10T22:16:31.287 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "fsid": "22997a4c-6fc2-11ef-bcea-c7b262605968", 2024-09-10T22:16:31.287 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "health": { 2024-09-10T22:16:31.287 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-09-10T22:16:31.287 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-09-10T22:16:31.287 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-09-10T22:16:31.287 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout }, 2024-09-10T22:16:31.287 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-09-10T22:16:31.287 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-09-10T22:16:31.287 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout 0 2024-09-10T22:16:31.287 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout ], 2024-09-10T22:16:31.288 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-09-10T22:16:31.288 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "a" 2024-09-10T22:16:31.288 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout ], 2024-09-10T22:16:31.288 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "quorum_age": 9, 2024-09-10T22:16:31.288 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "monmap": { 2024-09-10T22:16:31.288 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-10T22:16:31.288 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-09-10T22:16:31.288 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-09-10T22:16:31.288 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout }, 2024-09-10T22:16:31.288 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-09-10T22:16:31.288 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-10T22:16:31.288 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-09-10T22:16:31.288 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-09-10T22:16:31.289 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-09-10T22:16:31.292 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-09-10T22:16:31.292 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-09-10T22:16:31.292 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-09-10T22:16:31.292 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout }, 2024-09-10T22:16:31.292 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-09-10T22:16:31.292 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-09-10T22:16:31.292 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-09-10T22:16:31.293 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-09-10T22:16:31.293 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-09-10T22:16:31.293 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-09-10T22:16:31.293 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-09-10T22:16:31.293 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-09-10T22:16:31.293 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-09-10T22:16:31.293 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout }, 2024-09-10T22:16:31.293 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-09-10T22:16:31.293 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-10T22:16:31.293 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "btime": "2024-09-10T22:16:16:754503+0000", 2024-09-10T22:16:31.293 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-09-10T22:16:31.293 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-09-10T22:16:31.293 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout }, 2024-09-10T22:16:31.294 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-09-10T22:16:31.294 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "available": true, 2024-09-10T22:16:31.294 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-09-10T22:16:31.294 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "modules": [ 2024-09-10T22:16:31.294 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "iostat", 2024-09-10T22:16:31.294 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "nfs", 2024-09-10T22:16:31.294 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "restful" 2024-09-10T22:16:31.294 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout ], 2024-09-10T22:16:31.294 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-10T22:16:31.294 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout }, 2024-09-10T22:16:31.294 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-09-10T22:16:31.294 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-10T22:16:31.294 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "modified": "2024-09-10T22:16:16.755198+0000", 2024-09-10T22:16:31.294 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-10T22:16:31.295 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout }, 2024-09-10T22:16:31.295 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-09-10T22:16:31.295 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout } 2024-09-10T22:16:31.295 INFO:teuthology.orchestra.run.smithi019.stdout:mgr is available 2024-09-10T22:16:31.871 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:16:31 smithi019 ceph-mon[31375]: mgrmap e4: x(active, since 2s) 2024-09-10T22:16:32.442 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout 2024-09-10T22:16:32.442 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout [global] 2024-09-10T22:16:32.443 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout fsid = 22997a4c-6fc2-11ef-bcea-c7b262605968 2024-09-10T22:16:32.443 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout mon_cluster_log_file_level = debug 2024-09-10T22:16:32.443 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout mon_host = [v2:172.21.15.19:3300,v1:172.21.15.19:6789] 2024-09-10T22:16:32.443 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2024-09-10T22:16:32.443 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2024-09-10T22:16:32.443 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2024-09-10T22:16:32.443 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2024-09-10T22:16:32.443 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout 2024-09-10T22:16:32.443 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout [mgr] 2024-09-10T22:16:32.443 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2024-09-10T22:16:32.443 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout 2024-09-10T22:16:32.443 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout [osd] 2024-09-10T22:16:32.444 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout bdev_async_discard = True 2024-09-10T22:16:32.444 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2024-09-10T22:16:32.444 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2024-09-10T22:16:32.444 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2024-09-10T22:16:32.444 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2024-09-10T22:16:32.444 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2024-09-10T22:16:32.444 INFO:teuthology.orchestra.run.smithi019.stdout:Enabling cephadm module... 2024-09-10T22:16:33.208 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:16:32 smithi019 ceph-mon[31375]: from='client.? 172.21.15.19:0/724418563' entity='client.admin' cmd={"prefix": "config assimilate-conf"} : dispatch 2024-09-10T22:16:34.109 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:16:33 smithi019 ceph-mon[31375]: from='client.? 172.21.15.19:0/3859452999' entity='client.admin' cmd={"prefix": "mgr module enable", "module": "cephadm"} : dispatch 2024-09-10T22:16:34.110 INFO:journalctl@ceph.mgr.x.smithi019.stdout:Sep 10 22:16:33 smithi019 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-mgr-x[31605]: ignoring --setuser ceph since I am not root 2024-09-10T22:16:34.110 INFO:journalctl@ceph.mgr.x.smithi019.stdout:Sep 10 22:16:33 smithi019 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-mgr-x[31605]: ignoring --setgroup ceph since I am not root 2024-09-10T22:16:35.065 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:16:34 smithi019 ceph-mon[31375]: from='client.? 172.21.15.19:0/3859452999' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "cephadm"}]': finished 2024-09-10T22:16:35.065 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:16:34 smithi019 ceph-mon[31375]: mgrmap e5: x(active, since 5s) 2024-09-10T22:16:35.683 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout { 2024-09-10T22:16:35.684 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "epoch": 5, 2024-09-10T22:16:35.684 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "available": true, 2024-09-10T22:16:35.684 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "active_name": "x", 2024-09-10T22:16:35.684 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "num_standby": 0 2024-09-10T22:16:35.684 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout } 2024-09-10T22:16:35.684 INFO:teuthology.orchestra.run.smithi019.stdout:Waiting for the mgr to restart... 2024-09-10T22:16:35.684 INFO:teuthology.orchestra.run.smithi019.stdout:Waiting for mgr epoch 5... 2024-09-10T22:16:35.958 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:16:35 smithi019 ceph-mon[31375]: from='client.? 172.21.15.19:0/1085681158' entity='client.admin' cmd={"prefix": "mgr stat"} : dispatch 2024-09-10T22:16:39.458 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:16:39 smithi019 ceph-mon[31375]: Active manager daemon x restarted 2024-09-10T22:16:39.458 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:16:39 smithi019 ceph-mon[31375]: Activating manager daemon x 2024-09-10T22:16:39.459 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:16:39 smithi019 ceph-mon[31375]: osdmap e2: 0 total, 0 up, 0 in 2024-09-10T22:16:39.459 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:16:39 smithi019 ceph-mon[31375]: mgrmap e6: x(active, starting, since 0.00339497s) 2024-09-10T22:16:39.459 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:16:39 smithi019 ceph-mon[31375]: from='mgr.14118 172.21.15.19:0/3805210816' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-10T22:16:39.459 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:16:39 smithi019 ceph-mon[31375]: from='mgr.14118 172.21.15.19:0/3805210816' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "x", "id": "x"} : dispatch 2024-09-10T22:16:39.459 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:16:39 smithi019 ceph-mon[31375]: from='mgr.14118 172.21.15.19:0/3805210816' entity='mgr.x' cmd={"prefix": "mds metadata"} : dispatch 2024-09-10T22:16:39.459 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:16:39 smithi019 ceph-mon[31375]: from='mgr.14118 172.21.15.19:0/3805210816' entity='mgr.x' cmd={"prefix": "osd metadata"} : dispatch 2024-09-10T22:16:39.459 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:16:39 smithi019 ceph-mon[31375]: from='mgr.14118 172.21.15.19:0/3805210816' entity='mgr.x' cmd={"prefix": "mon metadata"} : dispatch 2024-09-10T22:16:39.459 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:16:39 smithi019 ceph-mon[31375]: Manager daemon x is now available 2024-09-10T22:16:40.729 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout { 2024-09-10T22:16:40.729 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 7, 2024-09-10T22:16:40.729 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "initialized": true 2024-09-10T22:16:40.729 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout } 2024-09-10T22:16:40.730 INFO:teuthology.orchestra.run.smithi019.stdout:mgr epoch 5 is available 2024-09-10T22:16:40.730 INFO:teuthology.orchestra.run.smithi019.stdout:Setting orchestrator backend to cephadm... 2024-09-10T22:16:41.390 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:16:41 smithi019 ceph-mon[31375]: mgrmap e7: x(active, since 1.00534s) 2024-09-10T22:16:41.390 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:16:41 smithi019 ceph-mon[31375]: from='mgr.14118 172.21.15.19:0/3805210816' entity='mgr.x' 2024-09-10T22:16:41.391 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:16:41 smithi019 ceph-mon[31375]: from='mgr.14118 172.21.15.19:0/3805210816' entity='mgr.x' 2024-09-10T22:16:41.391 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:16:41 smithi019 ceph-mon[31375]: Found migration_current of "None". Setting to last migration. 2024-09-10T22:16:41.391 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:16:41 smithi019 ceph-mon[31375]: from='mgr.14118 172.21.15.19:0/3805210816' entity='mgr.x' 2024-09-10T22:16:41.391 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:16:41 smithi019 ceph-mon[31375]: from='mgr.14118 172.21.15.19:0/3805210816' entity='mgr.x' 2024-09-10T22:16:41.391 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:16:41 smithi019 ceph-mon[31375]: from='mgr.14118 172.21.15.19:0/3805210816' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T22:16:41.391 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:16:41 smithi019 ceph-mon[31375]: from='mgr.14118 172.21.15.19:0/3805210816' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T22:16:41.391 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:16:41 smithi019 ceph-mon[31375]: from='mgr.14118 172.21.15.19:0/3805210816' entity='mgr.x' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"} : dispatch 2024-09-10T22:16:41.391 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:16:41 smithi019 ceph-mon[31375]: from='mgr.14118 172.21.15.19:0/3805210816' entity='mgr.x' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"} : dispatch 2024-09-10T22:16:41.707 INFO:journalctl@ceph.mgr.x.smithi019.stdout:Sep 10 22:16:41 smithi019 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-mgr-x[31605]: 2024-09-10T22:16:41.589+0000 7f5cdb842640 -1 log_channel(cephadm) log [ERR] : [10/Sep/2024:22:16:41] ENGINE Error in HTTPServer.serve 2024-09-10T22:16:41.707 INFO:journalctl@ceph.mgr.x.smithi019.stdout:Sep 10 22:16:41 smithi019 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-mgr-x[31605]: Traceback (most recent call last): 2024-09-10T22:16:41.707 INFO:journalctl@ceph.mgr.x.smithi019.stdout:Sep 10 22:16:41 smithi019 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-mgr-x[31605]: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-10T22:16:41.708 INFO:journalctl@ceph.mgr.x.smithi019.stdout:Sep 10 22:16:41 smithi019 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-mgr-x[31605]: self._connections.run(self.expiration_interval) 2024-09-10T22:16:41.708 INFO:journalctl@ceph.mgr.x.smithi019.stdout:Sep 10 22:16:41 smithi019 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-mgr-x[31605]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-10T22:16:41.708 INFO:journalctl@ceph.mgr.x.smithi019.stdout:Sep 10 22:16:41 smithi019 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-mgr-x[31605]: self._run(expiration_interval) 2024-09-10T22:16:41.708 INFO:journalctl@ceph.mgr.x.smithi019.stdout:Sep 10 22:16:41 smithi019 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-mgr-x[31605]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-10T22:16:41.708 INFO:journalctl@ceph.mgr.x.smithi019.stdout:Sep 10 22:16:41 smithi019 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-mgr-x[31605]: new_conn = self._from_server_socket(self.server.socket) 2024-09-10T22:16:41.708 INFO:journalctl@ceph.mgr.x.smithi019.stdout:Sep 10 22:16:41 smithi019 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-mgr-x[31605]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-10T22:16:41.708 INFO:journalctl@ceph.mgr.x.smithi019.stdout:Sep 10 22:16:41 smithi019 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-mgr-x[31605]: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-10T22:16:41.708 INFO:journalctl@ceph.mgr.x.smithi019.stdout:Sep 10 22:16:41 smithi019 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-mgr-x[31605]: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-10T22:16:41.708 INFO:journalctl@ceph.mgr.x.smithi019.stdout:Sep 10 22:16:41 smithi019 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-mgr-x[31605]: s = self.context.wrap_socket( 2024-09-10T22:16:41.708 INFO:journalctl@ceph.mgr.x.smithi019.stdout:Sep 10 22:16:41 smithi019 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-mgr-x[31605]: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-10T22:16:41.708 INFO:journalctl@ceph.mgr.x.smithi019.stdout:Sep 10 22:16:41 smithi019 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-mgr-x[31605]: return self.sslsocket_class._create( 2024-09-10T22:16:41.708 INFO:journalctl@ceph.mgr.x.smithi019.stdout:Sep 10 22:16:41 smithi019 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-mgr-x[31605]: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-10T22:16:41.709 INFO:journalctl@ceph.mgr.x.smithi019.stdout:Sep 10 22:16:41 smithi019 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-mgr-x[31605]: self.do_handshake() 2024-09-10T22:16:41.709 INFO:journalctl@ceph.mgr.x.smithi019.stdout:Sep 10 22:16:41 smithi019 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-mgr-x[31605]: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-10T22:16:41.709 INFO:journalctl@ceph.mgr.x.smithi019.stdout:Sep 10 22:16:41 smithi019 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-mgr-x[31605]: self._sslobj.do_handshake() 2024-09-10T22:16:41.709 INFO:journalctl@ceph.mgr.x.smithi019.stdout:Sep 10 22:16:41 smithi019 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-mgr-x[31605]: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-10T22:16:41.709 INFO:journalctl@ceph.mgr.x.smithi019.stdout:Sep 10 22:16:41 smithi019 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-mgr-x[31605]: 2024-09-10T22:16:42.319 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:16:42 smithi019 ceph-mon[31375]: mgrmap e8: x(active, since 2s) 2024-09-10T22:16:42.319 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:16:42 smithi019 ceph-mon[31375]: [10/Sep/2024:22:16:41] ENGINE Bus STARTING 2024-09-10T22:16:42.319 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:16:42 smithi019 ceph-mon[31375]: from='client.14130 -' entity='client.admin' cmd=[{"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T22:16:42.319 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:16:42 smithi019 ceph-mon[31375]: from='mgr.14118 172.21.15.19:0/3805210816' entity='mgr.x' 2024-09-10T22:16:42.319 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:16:42 smithi019 ceph-mon[31375]: from='mgr.14118 172.21.15.19:0/3805210816' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T22:16:42.319 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:16:42 smithi019 ceph-mon[31375]: [10/Sep/2024:22:16:41] ENGINE Serving on http://172.21.15.19:8765 2024-09-10T22:16:42.319 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:16:42 smithi019 ceph-mon[31375]: [10/Sep/2024:22:16:41] ENGINE Serving on https://172.21.15.19:7150 2024-09-10T22:16:42.319 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:16:42 smithi019 ceph-mon[31375]: [10/Sep/2024:22:16:41] ENGINE Bus STARTED 2024-09-10T22:16:42.319 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:16:42 smithi019 ceph-mon[31375]: from='mgr.14118 172.21.15.19:0/3805210816' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T22:16:42.320 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:16:42 smithi019 ceph-mon[31375]: [10/Sep/2024:22:16:41] ENGINE Error in HTTPServer.serve 2024-09-10T22:16:42.320 INFO:journalctl@ceph.mon.a.smithi019.stdout: Traceback (most recent call last): 2024-09-10T22:16:42.320 INFO:journalctl@ceph.mon.a.smithi019.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-10T22:16:42.320 INFO:journalctl@ceph.mon.a.smithi019.stdout: self._connections.run(self.expiration_interval) 2024-09-10T22:16:42.320 INFO:journalctl@ceph.mon.a.smithi019.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-10T22:16:42.320 INFO:journalctl@ceph.mon.a.smithi019.stdout: self._run(expiration_interval) 2024-09-10T22:16:42.320 INFO:journalctl@ceph.mon.a.smithi019.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-10T22:16:42.320 INFO:journalctl@ceph.mon.a.smithi019.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-10T22:16:42.320 INFO:journalctl@ceph.mon.a.smithi019.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-10T22:16:42.320 INFO:journalctl@ceph.mon.a.smithi019.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-10T22:16:42.320 INFO:journalctl@ceph.mon.a.smithi019.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-10T22:16:42.320 INFO:journalctl@ceph.mon.a.smithi019.stdout: s = self.context.wrap_socket( 2024-09-10T22:16:42.320 INFO:journalctl@ceph.mon.a.smithi019.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-10T22:16:42.321 INFO:journalctl@ceph.mon.a.smithi019.stdout: return self.sslsocket_class._create( 2024-09-10T22:16:42.321 INFO:journalctl@ceph.mon.a.smithi019.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-10T22:16:42.321 INFO:journalctl@ceph.mon.a.smithi019.stdout: self.do_handshake() 2024-09-10T22:16:42.321 INFO:journalctl@ceph.mon.a.smithi019.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-10T22:16:42.321 INFO:journalctl@ceph.mon.a.smithi019.stdout: self._sslobj.do_handshake() 2024-09-10T22:16:42.321 INFO:journalctl@ceph.mon.a.smithi019.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-10T22:16:43.180 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:16:43 smithi019 ceph-mon[31375]: from='client.14132 -' entity='client.admin' cmd=[{"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T22:16:43.183 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout value unchanged 2024-09-10T22:16:43.183 INFO:teuthology.orchestra.run.smithi019.stdout:Generating ssh key... 2024-09-10T22:16:44.412 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:16:44 smithi019 ceph-mon[31375]: from='client.14134 -' entity='client.admin' cmd=[{"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T22:16:44.413 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:16:44 smithi019 ceph-mon[31375]: Generating ssh key... 2024-09-10T22:16:44.413 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:16:44 smithi019 ceph-mon[31375]: from='mgr.14118 172.21.15.19:0/3805210816' entity='mgr.x' 2024-09-10T22:16:44.413 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:16:44 smithi019 ceph-mon[31375]: from='mgr.14118 172.21.15.19:0/3805210816' entity='mgr.x' 2024-09-10T22:16:44.413 INFO:journalctl@ceph.mgr.x.smithi019.stdout:Sep 10 22:16:44 smithi019 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-mgr-x[31605]: Generating public/private rsa key pair. 2024-09-10T22:16:44.413 INFO:journalctl@ceph.mgr.x.smithi019.stdout:Sep 10 22:16:44 smithi019 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-mgr-x[31605]: Your identification has been saved in /tmp/tmppb4zhve6/key 2024-09-10T22:16:44.413 INFO:journalctl@ceph.mgr.x.smithi019.stdout:Sep 10 22:16:44 smithi019 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-mgr-x[31605]: Your public key has been saved in /tmp/tmppb4zhve6/key.pub 2024-09-10T22:16:44.414 INFO:journalctl@ceph.mgr.x.smithi019.stdout:Sep 10 22:16:44 smithi019 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-mgr-x[31605]: The key fingerprint is: 2024-09-10T22:16:44.414 INFO:journalctl@ceph.mgr.x.smithi019.stdout:Sep 10 22:16:44 smithi019 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-mgr-x[31605]: SHA256:hXv5Y07ZUwPz7GURJ16K0+VvkSOg/W8KhQfRT9WBhWE ceph-22997a4c-6fc2-11ef-bcea-c7b262605968 2024-09-10T22:16:44.414 INFO:journalctl@ceph.mgr.x.smithi019.stdout:Sep 10 22:16:44 smithi019 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-mgr-x[31605]: The key's randomart image is: 2024-09-10T22:16:44.414 INFO:journalctl@ceph.mgr.x.smithi019.stdout:Sep 10 22:16:44 smithi019 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-mgr-x[31605]: +---[RSA 3072]----+ 2024-09-10T22:16:44.414 INFO:journalctl@ceph.mgr.x.smithi019.stdout:Sep 10 22:16:44 smithi019 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-mgr-x[31605]: | o.E*+O| 2024-09-10T22:16:44.414 INFO:journalctl@ceph.mgr.x.smithi019.stdout:Sep 10 22:16:44 smithi019 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-mgr-x[31605]: | .o +B B=| 2024-09-10T22:16:44.414 INFO:journalctl@ceph.mgr.x.smithi019.stdout:Sep 10 22:16:44 smithi019 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-mgr-x[31605]: | ...oo+*=.| 2024-09-10T22:16:44.414 INFO:journalctl@ceph.mgr.x.smithi019.stdout:Sep 10 22:16:44 smithi019 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-mgr-x[31605]: | o .+.*.=| 2024-09-10T22:16:44.414 INFO:journalctl@ceph.mgr.x.smithi019.stdout:Sep 10 22:16:44 smithi019 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-mgr-x[31605]: | S o. + +*| 2024-09-10T22:16:44.414 INFO:journalctl@ceph.mgr.x.smithi019.stdout:Sep 10 22:16:44 smithi019 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-mgr-x[31605]: | . .ooo+o| 2024-09-10T22:16:44.414 INFO:journalctl@ceph.mgr.x.smithi019.stdout:Sep 10 22:16:44 smithi019 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-mgr-x[31605]: | .* o+ | 2024-09-10T22:16:44.414 INFO:journalctl@ceph.mgr.x.smithi019.stdout:Sep 10 22:16:44 smithi019 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-mgr-x[31605]: | +..o. | 2024-09-10T22:16:44.414 INFO:journalctl@ceph.mgr.x.smithi019.stdout:Sep 10 22:16:44 smithi019 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-mgr-x[31605]: | .. | 2024-09-10T22:16:44.415 INFO:journalctl@ceph.mgr.x.smithi019.stdout:Sep 10 22:16:44 smithi019 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-mgr-x[31605]: +----[SHA256]-----+ 2024-09-10T22:16:45.879 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCt8Z2NhxQg6nivMj19od0Z+pcUbiFrL5TILAd7GMs/2xLx8MHDtEWISTYptEvF8UXfNZDos28jh8udgcNRFNBvginafZMyk6Q31Msn4FCo7AZ6BweJDdWVPFcPA7qFK95I85ojVQ9DPGw/q6uFI0UOiNJoWTZhRen5z5OdwpR8ctwOMsZNLUsNryZlQo6RtieF/8bK79iQws6QUvdB/bk2KZfm+jSiLBf0Hw4CAPlHAIDbuaQCzxE6JGyuhSitqMaWnmWy0DTcYZy25YiZ2GKWSGiY0SFe545t87vpwsHrZ38yYmfrftXy8+eDZLbREh9Q+XR7Bo1/9EzBT+mHwftLBaWQwMSKYe22xIqJ8VAjDPxzGGhzZB11wm0jJ1hT0o+ORouJ21UJ1DhvFeC4xlzs4K1qTWA0YJDjCqTI7Z7loDbrhwfa7feXVDNkQM1Rvy8ypL4Qrb5kjEzAYNz1uSiMCb/T6sHXtZgLyC/NfVJCRi9jpFWQNNbJrkWiEgSM9u0= ceph-22997a4c-6fc2-11ef-bcea-c7b262605968 2024-09-10T22:16:45.879 INFO:teuthology.orchestra.run.smithi019.stdout:Wrote public SSH key to /home/ubuntu/cephtest/ceph.pub 2024-09-10T22:16:45.879 INFO:teuthology.orchestra.run.smithi019.stdout:Adding key to root@localhost authorized_keys... 2024-09-10T22:16:45.887 INFO:teuthology.orchestra.run.smithi019.stdout:Adding host smithi019... 2024-09-10T22:16:46.179 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:16:45 smithi019 ceph-mon[31375]: from='client.14136 -' entity='client.admin' cmd=[{"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T22:16:47.164 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:16:46 smithi019 ceph-mon[31375]: from='client.14138 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi019", "addr": "172.21.15.19", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T22:16:48.084 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:16:47 smithi019 ceph-mon[31375]: Deploying cephadm binary to smithi019 2024-09-10T22:16:50.954 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout Added host 'smithi019' with addr '172.21.15.19' 2024-09-10T22:16:50.954 INFO:teuthology.orchestra.run.smithi019.stdout:Deploying unmanaged mon service... 2024-09-10T22:16:51.458 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:16:51 smithi019 ceph-mon[31375]: from='mgr.14118 172.21.15.19:0/3805210816' entity='mgr.x' 2024-09-10T22:16:51.458 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:16:51 smithi019 ceph-mon[31375]: Added host smithi019 2024-09-10T22:16:51.458 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:16:51 smithi019 ceph-mon[31375]: from='mgr.14118 172.21.15.19:0/3805210816' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T22:16:52.463 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout Scheduled mon update... 2024-09-10T22:16:52.463 INFO:teuthology.orchestra.run.smithi019.stdout:Deploying unmanaged mgr service... 2024-09-10T22:16:52.711 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:16:52 smithi019 ceph-mon[31375]: from='client.14140 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "unmanaged": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T22:16:52.712 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:16:52 smithi019 ceph-mon[31375]: Saving service mon spec with placement count:5 2024-09-10T22:16:52.712 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:16:52 smithi019 ceph-mon[31375]: from='mgr.14118 172.21.15.19:0/3805210816' entity='mgr.x' 2024-09-10T22:16:54.458 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:16:54 smithi019 ceph-mon[31375]: from='client.14142 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "unmanaged": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T22:16:54.459 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:16:54 smithi019 ceph-mon[31375]: Saving service mgr spec with placement count:2 2024-09-10T22:16:54.459 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:16:54 smithi019 ceph-mon[31375]: from='mgr.14118 172.21.15.19:0/3805210816' entity='mgr.x' 2024-09-10T22:16:54.516 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout Scheduled mgr update... 2024-09-10T22:16:55.458 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:16:55 smithi019 ceph-mon[31375]: from='mgr.14118 172.21.15.19:0/3805210816' entity='mgr.x' 2024-09-10T22:16:55.458 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:16:55 smithi019 ceph-mon[31375]: from='mgr.14118 172.21.15.19:0/3805210816' entity='mgr.x' 2024-09-10T22:16:56.458 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:16:56 smithi019 ceph-mon[31375]: from='client.? 172.21.15.19:0/2688029019' entity='client.admin' 2024-09-10T22:16:56.459 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:16:56 smithi019 ceph-mon[31375]: from='mgr.14118 172.21.15.19:0/3805210816' entity='mgr.x' 2024-09-10T22:16:57.733 INFO:teuthology.orchestra.run.smithi019.stdout:Enabling the dashboard module... 2024-09-10T22:16:58.074 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:16:57 smithi019 ceph-mon[31375]: from='mgr.14118 172.21.15.19:0/3805210816' entity='mgr.x' 2024-09-10T22:16:58.074 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:16:57 smithi019 ceph-mon[31375]: from='client.? 172.21.15.19:0/3627627798' entity='client.admin' 2024-09-10T22:16:59.322 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:16:58 smithi019 ceph-mon[31375]: from='client.? 172.21.15.19:0/1910590381' entity='client.admin' cmd={"prefix": "mgr module enable", "module": "dashboard"} : dispatch 2024-09-10T22:16:59.322 INFO:journalctl@ceph.mgr.x.smithi019.stdout:Sep 10 22:16:59 smithi019 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-mgr-x[31605]: ignoring --setuser ceph since I am not root 2024-09-10T22:16:59.323 INFO:journalctl@ceph.mgr.x.smithi019.stdout:Sep 10 22:16:59 smithi019 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-mgr-x[31605]: ignoring --setgroup ceph since I am not root 2024-09-10T22:17:00.187 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:16:59 smithi019 ceph-mon[31375]: from='client.? 172.21.15.19:0/1910590381' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "dashboard"}]': finished 2024-09-10T22:17:00.187 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:16:59 smithi019 ceph-mon[31375]: mgrmap e9: x(active, since 19s) 2024-09-10T22:17:01.174 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:17:00 smithi019 ceph-mon[31375]: from='client.? 172.21.15.19:0/4007705244' entity='client.admin' cmd={"prefix": "mgr stat"} : dispatch 2024-09-10T22:17:01.177 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout { 2024-09-10T22:17:01.177 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "epoch": 9, 2024-09-10T22:17:01.177 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "available": true, 2024-09-10T22:17:01.177 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "active_name": "x", 2024-09-10T22:17:01.178 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "num_standby": 0 2024-09-10T22:17:01.178 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout } 2024-09-10T22:17:01.178 INFO:teuthology.orchestra.run.smithi019.stdout:Waiting for the mgr to restart... 2024-09-10T22:17:01.178 INFO:teuthology.orchestra.run.smithi019.stdout:Waiting for mgr epoch 9... 2024-09-10T22:17:04.664 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:17:04 smithi019 ceph-mon[31375]: Active manager daemon x restarted 2024-09-10T22:17:04.664 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:17:04 smithi019 ceph-mon[31375]: Activating manager daemon x 2024-09-10T22:17:04.664 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:17:04 smithi019 ceph-mon[31375]: osdmap e3: 0 total, 0 up, 0 in 2024-09-10T22:17:04.664 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:17:04 smithi019 ceph-mon[31375]: mgrmap e10: x(active, starting, since 0.00391197s) 2024-09-10T22:17:04.664 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:17:04 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-10T22:17:04.664 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:17:04 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "x", "id": "x"} : dispatch 2024-09-10T22:17:04.664 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:17:04 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "mds metadata"} : dispatch 2024-09-10T22:17:04.664 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:17:04 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "osd metadata"} : dispatch 2024-09-10T22:17:04.665 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:17:04 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "mon metadata"} : dispatch 2024-09-10T22:17:04.665 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:17:04 smithi019 ceph-mon[31375]: Manager daemon x is now available 2024-09-10T22:17:05.605 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:17:05 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T22:17:05.606 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:17:05 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"} : dispatch 2024-09-10T22:17:05.606 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:17:05 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"} : dispatch 2024-09-10T22:17:05.606 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:17:05 smithi019 ceph-mon[31375]: mgrmap e11: x(active, since 1.00682s) 2024-09-10T22:17:05.933 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout { 2024-09-10T22:17:05.933 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 11, 2024-09-10T22:17:05.933 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "initialized": true 2024-09-10T22:17:05.934 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout } 2024-09-10T22:17:05.934 INFO:teuthology.orchestra.run.smithi019.stdout:mgr epoch 9 is available 2024-09-10T22:17:05.934 INFO:teuthology.orchestra.run.smithi019.stdout:Using certmgr to generate dashboard self-signed certificate... 2024-09-10T22:17:06.459 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:17:06 smithi019 ceph-mon[31375]: from='client.14154 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2024-09-10T22:17:06.459 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:17:06 smithi019 ceph-mon[31375]: from='client.14154 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2024-09-10T22:17:06.459 INFO:journalctl@ceph.mgr.x.smithi019.stdout:Sep 10 22:17:06 smithi019 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-mgr-x[31605]: 2024-09-10T22:17:06.230+0000 7f171490c640 -1 log_channel(cephadm) log [ERR] : [10/Sep/2024:22:17:06] ENGINE Error in HTTPServer.serve 2024-09-10T22:17:06.459 INFO:journalctl@ceph.mgr.x.smithi019.stdout:Sep 10 22:17:06 smithi019 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-mgr-x[31605]: Traceback (most recent call last): 2024-09-10T22:17:06.459 INFO:journalctl@ceph.mgr.x.smithi019.stdout:Sep 10 22:17:06 smithi019 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-mgr-x[31605]: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-10T22:17:06.459 INFO:journalctl@ceph.mgr.x.smithi019.stdout:Sep 10 22:17:06 smithi019 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-mgr-x[31605]: self._connections.run(self.expiration_interval) 2024-09-10T22:17:06.459 INFO:journalctl@ceph.mgr.x.smithi019.stdout:Sep 10 22:17:06 smithi019 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-mgr-x[31605]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-10T22:17:06.459 INFO:journalctl@ceph.mgr.x.smithi019.stdout:Sep 10 22:17:06 smithi019 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-mgr-x[31605]: self._run(expiration_interval) 2024-09-10T22:17:06.460 INFO:journalctl@ceph.mgr.x.smithi019.stdout:Sep 10 22:17:06 smithi019 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-mgr-x[31605]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-10T22:17:06.460 INFO:journalctl@ceph.mgr.x.smithi019.stdout:Sep 10 22:17:06 smithi019 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-mgr-x[31605]: new_conn = self._from_server_socket(self.server.socket) 2024-09-10T22:17:06.460 INFO:journalctl@ceph.mgr.x.smithi019.stdout:Sep 10 22:17:06 smithi019 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-mgr-x[31605]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-10T22:17:06.460 INFO:journalctl@ceph.mgr.x.smithi019.stdout:Sep 10 22:17:06 smithi019 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-mgr-x[31605]: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-10T22:17:06.460 INFO:journalctl@ceph.mgr.x.smithi019.stdout:Sep 10 22:17:06 smithi019 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-mgr-x[31605]: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-10T22:17:06.460 INFO:journalctl@ceph.mgr.x.smithi019.stdout:Sep 10 22:17:06 smithi019 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-mgr-x[31605]: s = self.context.wrap_socket( 2024-09-10T22:17:06.460 INFO:journalctl@ceph.mgr.x.smithi019.stdout:Sep 10 22:17:06 smithi019 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-mgr-x[31605]: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-10T22:17:06.460 INFO:journalctl@ceph.mgr.x.smithi019.stdout:Sep 10 22:17:06 smithi019 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-mgr-x[31605]: return self.sslsocket_class._create( 2024-09-10T22:17:06.460 INFO:journalctl@ceph.mgr.x.smithi019.stdout:Sep 10 22:17:06 smithi019 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-mgr-x[31605]: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-10T22:17:06.460 INFO:journalctl@ceph.mgr.x.smithi019.stdout:Sep 10 22:17:06 smithi019 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-mgr-x[31605]: self.do_handshake() 2024-09-10T22:17:06.460 INFO:journalctl@ceph.mgr.x.smithi019.stdout:Sep 10 22:17:06 smithi019 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-mgr-x[31605]: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-10T22:17:06.460 INFO:journalctl@ceph.mgr.x.smithi019.stdout:Sep 10 22:17:06 smithi019 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-mgr-x[31605]: self._sslobj.do_handshake() 2024-09-10T22:17:06.460 INFO:journalctl@ceph.mgr.x.smithi019.stdout:Sep 10 22:17:06 smithi019 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-mgr-x[31605]: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-10T22:17:06.461 INFO:journalctl@ceph.mgr.x.smithi019.stdout:Sep 10 22:17:06 smithi019 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-mgr-x[31605]: 2024-09-10T22:17:07.708 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:17:07 smithi019 ceph-mon[31375]: [10/Sep/2024:22:17:06] ENGINE Bus STARTING 2024-09-10T22:17:07.709 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:17:07 smithi019 ceph-mon[31375]: [10/Sep/2024:22:17:06] ENGINE Serving on https://172.21.15.19:7150 2024-09-10T22:17:07.709 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:17:07 smithi019 ceph-mon[31375]: [10/Sep/2024:22:17:06] ENGINE Error in HTTPServer.serve 2024-09-10T22:17:07.709 INFO:journalctl@ceph.mon.a.smithi019.stdout: Traceback (most recent call last): 2024-09-10T22:17:07.709 INFO:journalctl@ceph.mon.a.smithi019.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-10T22:17:07.709 INFO:journalctl@ceph.mon.a.smithi019.stdout: self._connections.run(self.expiration_interval) 2024-09-10T22:17:07.709 INFO:journalctl@ceph.mon.a.smithi019.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-10T22:17:07.709 INFO:journalctl@ceph.mon.a.smithi019.stdout: self._run(expiration_interval) 2024-09-10T22:17:07.709 INFO:journalctl@ceph.mon.a.smithi019.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-10T22:17:07.709 INFO:journalctl@ceph.mon.a.smithi019.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-10T22:17:07.709 INFO:journalctl@ceph.mon.a.smithi019.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-10T22:17:07.709 INFO:journalctl@ceph.mon.a.smithi019.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-10T22:17:07.709 INFO:journalctl@ceph.mon.a.smithi019.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-10T22:17:07.710 INFO:journalctl@ceph.mon.a.smithi019.stdout: s = self.context.wrap_socket( 2024-09-10T22:17:07.710 INFO:journalctl@ceph.mon.a.smithi019.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-10T22:17:07.710 INFO:journalctl@ceph.mon.a.smithi019.stdout: return self.sslsocket_class._create( 2024-09-10T22:17:07.710 INFO:journalctl@ceph.mon.a.smithi019.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-10T22:17:07.710 INFO:journalctl@ceph.mon.a.smithi019.stdout: self.do_handshake() 2024-09-10T22:17:07.710 INFO:journalctl@ceph.mon.a.smithi019.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-10T22:17:07.710 INFO:journalctl@ceph.mon.a.smithi019.stdout: self._sslobj.do_handshake() 2024-09-10T22:17:07.710 INFO:journalctl@ceph.mon.a.smithi019.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-10T22:17:07.710 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:17:07 smithi019 ceph-mon[31375]: mgrmap e12: x(active, since 2s) 2024-09-10T22:17:07.710 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:17:07 smithi019 ceph-mon[31375]: [10/Sep/2024:22:17:06] ENGINE Serving on http://172.21.15.19:8765 2024-09-10T22:17:07.710 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:17:07 smithi019 ceph-mon[31375]: [10/Sep/2024:22:17:06] ENGINE Bus STARTED 2024-09-10T22:17:07.710 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:17:07 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:17:08.949 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:17:08 smithi019 ceph-mon[31375]: from='client.14162 -' entity='client.admin' cmd=[{"prefix": "orch certmgr generate-certificates", "module_name": "dashboard", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T22:17:08.949 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:17:08 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:17:08.963 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout {"cert": "-----BEGIN CERTIFICATE-----\nMIIFEDCCAvigAwIBAgIUYlClCUoMkLTfvDOK4ZOdECmdX8kwDQYJKoZIhvcNAQEL\nBQAwFzEVMBMGA1UEAwwMY2VwaGFkbS1yb290MB4XDTI0MDkxMDIyMTcwOFoXDTM0\nMDkxMTIyMTcwOFowFzEVMBMGA1UEAwwMMTcyLjIxLjE1LjE5MIICIjANBgkqhkiG\n9w0BAQEFAAOCAg8AMIICCgKCAgEAx7C8NlFpdMZy2zHjGeYf2Fy9XbNO8dNEPcCd\n10sAvE1qF7KBClJjtBPfN3XVRNmR1xxvVbzl0ggGXL8MhauvbCo1/YmomORb5rHM\nwv9SOOSJCdzEoZPnguzhUPykEIatd8509H3olW/FFQuB01+zdBXuxWtQHD9Ivilj\njsD7IzuRU1Q7XdC1WiFvYdyAQombvLX2+iswftfpOuJhOHFR/uEGNkUadTYbMHj5\ntYOcrc69EY0Mho05aHQhDmhPs6FYxhK9u8/Nncfg/kz+Ld2OThY8Gp/HLlXrremq\nbZzoM+t5J3TGPkxAlDH+1buVg2l7lAs8zNnvPwHjyB2rrGRfAbMvki7KFxo1Qlk/\njcUGyT/pouq0SvuhqzW2raucIK+MQS8IWxFX+V8RIz0TQ/INKyjzD24Mguu7Lk8p\nNSbYCG5V5pJUDWZvncHd31z2wx7LDq2ilOqhsyJuTEwF7epbwNhC4yffQRQdeDjm\nt1M4vX/JpmbjfQ3q8oi0A8S2SL7cZYTgBYnAqrCANegVGZPuVppd43U8J4zpzcs/\nQUYOwO5Dbsk5UOVa9Osi/E3tlNn1nkdu4MKSOlJWfSyUHmHJ/OePAelsLi85EK/A\n/5C67OIUtKdNK6u+gtYDkxyHiYy5CvuKENFbvJ7tUYEzF1Ir0yEdrK68PclER1QD\nBauhsHECAwEAAaNUMFIwQgYDVR0RBDswOYIec21pdGhpMDE5LmZyb250LnNlcGlh\nLmNlcGguY29tghFkYXNoYm9hcmRfc2VydmVyc4cErBUPEzAMBgNVHRMBAf8EAjAA\nMA0GCSqGSIb3DQEBCwUAA4ICAQACLjbqDVaQjN5CeB20o9oHXLm/fhDCfHFQGzGi\nhL8PQof4jxXLkhabJA1ibVmcWw33yem+IWsjy5CqQAF05k86U7yidQpPs2ngoNqz\na99ErKjHcUifA89a7833alUaSCmYXPYX1/59YxapLg5ba09AzdNIyby0sqQ+QFnq\nECVGAIcLyrCeCsoBHA8Xr2P2u3rH96CPasLnka9zHxezAA7Of00sxlAsHnhv8oQh\n+OHRlwFC7jGgafZEZpUGdzt87XLjwrtNDLNsFRu0T6tCM7mDMeuNAu/fjO9b8CK2\nFdHoCwvgsaXC3k77jcupbq56hU1BaWH+jr8tBpgws9vki4kMWAUJV5rGT0+iJuwR\nNokh6r64ux8FYJzZDBjOsID4feiSDi2SYqxTNJOtal6O1+IzL403aEKdtZEemm77\nmS9gqULB7NkEDjyDAKHpi3Idf14QXJM3x3CyOqJMDIG2bbvmZkRHoRKsNA/Bb01+\nrO8X3qNQTso765MkfxvclTNPTnvIV70X+VyjWp18bt/oaxp/vP26MXdjFZ3c9xw0\nen1F1altc0nubLBcAKkMK7sbhAcdjHc/hP0eTPWScIv4LSvb3Vvnb+1PpM0+mHRT\nT0t9gSPbVO0iEMSQzheKMh027zRydQuhPMSHps3/E8nfYPXkOxCBN8QDU/TLg/2u\nmylRdg==\n-----END CERTIFICATE-----\n", "key": "-----BEGIN RSA PRIVATE KEY-----\nMIIJKQIBAAKCAgEAx7C8NlFpdMZy2zHjGeYf2Fy9XbNO8dNEPcCd10sAvE1qF7KB\nClJjtBPfN3XVRNmR1xxvVbzl0ggGXL8MhauvbCo1/YmomORb5rHMwv9SOOSJCdzE\noZPnguzhUPykEIatd8509H3olW/FFQuB01+zdBXuxWtQHD9IviljjsD7IzuRU1Q7\nXdC1WiFvYdyAQombvLX2+iswftfpOuJhOHFR/uEGNkUadTYbMHj5tYOcrc69EY0M\nho05aHQhDmhPs6FYxhK9u8/Nncfg/kz+Ld2OThY8Gp/HLlXrremqbZzoM+t5J3TG\nPkxAlDH+1buVg2l7lAs8zNnvPwHjyB2rrGRfAbMvki7KFxo1Qlk/jcUGyT/pouq0\nSvuhqzW2raucIK+MQS8IWxFX+V8RIz0TQ/INKyjzD24Mguu7Lk8pNSbYCG5V5pJU\nDWZvncHd31z2wx7LDq2ilOqhsyJuTEwF7epbwNhC4yffQRQdeDjmt1M4vX/Jpmbj\nfQ3q8oi0A8S2SL7cZYTgBYnAqrCANegVGZPuVppd43U8J4zpzcs/QUYOwO5Dbsk5\nUOVa9Osi/E3tlNn1nkdu4MKSOlJWfSyUHmHJ/OePAelsLi85EK/A/5C67OIUtKdN\nK6u+gtYDkxyHiYy5CvuKENFbvJ7tUYEzF1Ir0yEdrK68PclER1QDBauhsHECAwEA\nAQKCAgABQmltePCj/pHANX2r2XpfRaEhc31j+Q53ypHe8bzSHeA1a2LKSzVlxVpQ\nYeXecUuCLSO79Ae0XhNBh9LvD44jrdXOq4zsqe61HcSfgOIRNHUeIs5QATwh5Jc8\niNtgCfloxVySI4PRWCBzaYcqwMfDoP/IhEy/tjEh7JDm2EC9OtBH05gsQfdi13h5\nstz8ORyfrBDKsyBd1xluzaQJ/xeioTiwzu7DySY9arCTJylYefKnUa8VNNQlMdZO\nM5+ND89yMFwR+yreJoySDgTsX8wDTLtET7hUinuEtUc7Ob9yfwxckK1PZ0Zg/jpl\nOVxQCoeaVMJ6vZp3WJkJ12YQcvGbxkgOStrpisEdrhCw4o86EKq9DDG/eLopxksc\n8wRGd3WYEqfyJlrWQkM3oF5t7bTwgDWh8TM5Xng5ISaT0Gm9856d/avgoEGQ2SyD\n4E49Ih4vxTyyCkc/P7UWt/0mo52iEPFt/wXm44q8E8Fo9OvrbI3OeXTqb4edyn+A\nlWbGklv8oNWr6AsLWy8uxiXIiXuDmAKFsqfm2i8gO+sd7h57BiujKAySWlCABczJ\nYa8gFix92+CPNu8N0mkP6Zmpn3+qUQMgJCrEVq9DC15qnUkIy6wqT5cuxgQjkDSZ\nrnclnahFhpq40Ns/p4JowroO3YXjRVuSVgst4oi8Pndrc7DgIQKCAQEA7Dw34n95\nWzmEPAKLuvOCD7B5n+oJDj7ODV+TvOdrY3FI5+XSLOc4X5f6ghgRX6l8tqRpsDGK\nuaagYofYDwe0z/rVRNybnl/lxJla/MlrRX6FtWpy8gj8J0N80m9O8obMhjfkxa9h\nkvLGjLcMdPmmx6Dq6nytmTUuFx9Tur0QzE5jldaeLYa+h9iEKJAB5w8z9XtZ7ii2\nEI9YSuxd4uvCZlkDM01PHwCmQ4raUYAfOesxMoHXfvgu5bHF0RMCXt/jeFzVNnMl\nc1jg2fxrJyXh0Ned1ymHNqbHMssnCbWJt0PdW5utCVYUQRDnOsnvzYW02gRJG/fl\nBeYoCqrG4SDALwKCAQEA2GXIzgXUCvaE0J8ac7WTOnYI674TzP43tqesbsX1DHsN\nmA1j9SvU9k0MFV9ZTOWeC2lkZmxfMr7rNyJq7mKucJWHNtakEq2W6W37m/oT6WkY\nMOlNjHHIJRMC1VVn/XGkRffU0BUWw+CbfDG0KNogVfOoH3aRPpZk/f4iRC1CzklE\nULWJztZfN5lEvllQSOrbGANWbHw2Yy4E9Soaxs4N0WpsmwuNMz5vFpOvUf9bOHTv\nVKq1WH5TMDmTBkvpvmZ/aiyBXpdGmJ0NLGYJCS4uI6MWI3JIDOOOAULQkyINX9mb\nU823cuyRL/1HtqBSuDVRHoaVxdqwEDJJEjlT/KzRXwKCAQEAlmUkAvu6y/wLFpVc\nVfIPHGPymn9JspsDXXo6uSnvsUh+7LvgmZu+xQUhg89EyE1Dy5dSfcycj+Ln+rKX\nN8JlN39uZT+5hxNwWUB0r7ifpYeOIlgZw8M6nNiXT/VzIm31KYHOEJi+Guqawx0K\nPjJuHmtxA0XK014K8MeN67XQSvGg7tTKsRs2k4+hW52KyIpiPud/8mJSvqozwMdI\nYl5LzhLfObr/IzKrpxZwNTDHMH1uPcRx6DCi0rLhyGA8wx/wVkFrsBWQgyXTSJQt\nt6ejYuzSXRfgMEfvS4QQX1sGyPjYpSiv+eCmVmIng8Lp+0MjRyUxUi/4y0+isF/W\n656JGwKCAQBRuO7Cz3SqxzqVRuDIffQiCd2ImfoEWqVTt7LpCp1mnzodCEGNn4YH\nlkVP9PhWkAjFqoGeJKM3GN7frYHQkTfrkKzFyv2fiCsL8NsqpqDKb0QRhKoitf2t\n8qYJRv3EuxwcyGF4S96TDsnpdyPgoa/AhgoiB7cGeemd+lGaibVHDmhcSpLGqDLB\nXoKVmEk3oGopgWksAyTPA9wfck02cy7IvXZSf2RNy/BMCG4Xe2ZJxe90fBuMVfi4\np6WcpSKbIz5PLIuW225vyC/naolTDDukfbyomkoXhABm/YKjbiK65gVA+tmi7zBN\nfUuN7rIOmyQNcSoy1EnVdAggd8H+FI3lAoIBAQDKXEdjBKp8+l2h/1Ai4gK0x3Bj\npOKZIOmgNwBxoabBjQD1wSuD/cAhyKohh4ojNwK8C3W7M8fDfBG4IHcnc+fZZfXn\nRIFgErplimnkashABz5JV9HxDugmOwSk9pm9l6D0eUe4Yjire27aShKFpS54Vi5b\na6HIsnKWUaNXEOTveOubktd47n9ckc3L/sdpIuKxphRj6Hiez4XkvHNgIFg31SwZ\ncU0BqeK0KlNcs2aIiEkG7tcc547UTFP8u8YMotBqT2fq8XuaGT7JkH5JEgtqMUeP\nqD2JwCAsPWhw59qlZPesHyiLHxgSbiODjShZNQ9PLRUj3D2UdQ9VybRnivBd\n-----END RSA PRIVATE KEY-----\n"} 2024-09-10T22:17:10.381 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout SSL certificate updated 2024-09-10T22:17:10.705 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:17:10 smithi019 ceph-mon[31375]: from='client.14164 -' entity='client.admin' cmd=[{"prefix": "dashboard set-ssl-certificate", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T22:17:10.705 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:17:10 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:17:11.630 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout SSL certificate key updated 2024-09-10T22:17:11.630 INFO:teuthology.orchestra.run.smithi019.stdout:Creating initial admin user... 2024-09-10T22:17:12.208 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:17:12 smithi019 ceph-mon[31375]: from='client.14166 -' entity='client.admin' cmd=[{"prefix": "dashboard set-ssl-certificate-key", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T22:17:12.208 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:17:12 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:17:13.085 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout {"username": "admin", "password": "$2b$12$adt2vL2NJhE1fTnJ2omhpuDJYaG7K.HGvJvCPH92gXSFh4M9vrETa", "roles": ["administrator"], "name": null, "email": null, "lastUpdate": 1726006632, "enabled": true, "pwdExpirationDate": null, "pwdUpdateRequired": true} 2024-09-10T22:17:13.085 INFO:teuthology.orchestra.run.smithi019.stdout:Fetching dashboard port number... 2024-09-10T22:17:13.689 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:17:13 smithi019 ceph-mon[31375]: from='client.14168 -' entity='client.admin' cmd=[{"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T22:17:13.689 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:17:13 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:17:14.258 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout 8443 2024-09-10T22:17:14.270 INFO:teuthology.orchestra.run.smithi019.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-10T22:17:14.270 INFO:teuthology.orchestra.run.smithi019.stdout:systemctl: stdout disabled 2024-09-10T22:17:14.279 INFO:teuthology.orchestra.run.smithi019.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-10T22:17:14.279 INFO:teuthology.orchestra.run.smithi019.stdout:systemctl: stdout inactive 2024-09-10T22:17:14.279 INFO:teuthology.orchestra.run.smithi019.stdout:firewalld.service is not enabled 2024-09-10T22:17:14.279 INFO:teuthology.orchestra.run.smithi019.stdout:Not possible to open ports <[8443]>. firewalld.service is not available 2024-09-10T22:17:14.281 INFO:teuthology.orchestra.run.smithi019.stdout:Ceph Dashboard is now available at: 2024-09-10T22:17:14.282 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-10T22:17:14.282 INFO:teuthology.orchestra.run.smithi019.stdout: URL: https://smithi019.front.sepia.ceph.com:8443/ 2024-09-10T22:17:14.282 INFO:teuthology.orchestra.run.smithi019.stdout: User: admin 2024-09-10T22:17:14.282 INFO:teuthology.orchestra.run.smithi019.stdout: Password: qb60ybub3k 2024-09-10T22:17:14.282 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-10T22:17:14.282 INFO:teuthology.orchestra.run.smithi019.stdout:Saving cluster configuration to /var/lib/ceph/22997a4c-6fc2-11ef-bcea-c7b262605968/config directory 2024-09-10T22:17:14.959 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:17:14 smithi019 ceph-mon[31375]: from='client.? 172.21.15.19:0/2930845236' entity='client.admin' cmd={"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"} : dispatch 2024-09-10T22:17:15.605 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr set mgr/dashboard/cluster/status 2024-09-10T22:17:15.606 INFO:teuthology.orchestra.run.smithi019.stdout:You can access the Ceph CLI as following in case of multi-cluster or non-default config: 2024-09-10T22:17:15.606 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-10T22:17:15.606 INFO:teuthology.orchestra.run.smithi019.stdout: sudo /home/ubuntu/cephtest/cephadm shell --fsid 22997a4c-6fc2-11ef-bcea-c7b262605968 -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring 2024-09-10T22:17:15.606 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-10T22:17:15.606 INFO:teuthology.orchestra.run.smithi019.stdout:Or, if you are only running a single cluster on this host: 2024-09-10T22:17:15.606 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-10T22:17:15.606 INFO:teuthology.orchestra.run.smithi019.stdout: sudo /home/ubuntu/cephtest/cephadm shell 2024-09-10T22:17:15.606 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-10T22:17:15.606 INFO:teuthology.orchestra.run.smithi019.stdout:Please consider enabling telemetry to help improve Ceph: 2024-09-10T22:17:15.606 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-10T22:17:15.607 INFO:teuthology.orchestra.run.smithi019.stdout: ceph telemetry on 2024-09-10T22:17:15.607 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-10T22:17:15.607 INFO:teuthology.orchestra.run.smithi019.stdout:For more information see: 2024-09-10T22:17:15.607 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-10T22:17:15.607 INFO:teuthology.orchestra.run.smithi019.stdout: https://docs.ceph.com/en/latest/mgr/telemetry/ 2024-09-10T22:17:15.607 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-10T22:17:15.607 INFO:teuthology.orchestra.run.smithi019.stdout:Bootstrap complete. 2024-09-10T22:17:15.655 INFO:tasks.cephadm:Fetching config... 2024-09-10T22:17:15.655 DEBUG:teuthology.orchestra.run.smithi019:> set -ex 2024-09-10T22:17:15.656 DEBUG:teuthology.orchestra.run.smithi019:> dd if=/etc/ceph/ceph.conf of=/dev/stdout 2024-09-10T22:17:15.673 INFO:tasks.cephadm:Fetching client.admin keyring... 2024-09-10T22:17:15.673 DEBUG:teuthology.orchestra.run.smithi019:> set -ex 2024-09-10T22:17:15.673 DEBUG:teuthology.orchestra.run.smithi019:> dd if=/etc/ceph/ceph.client.admin.keyring of=/dev/stdout 2024-09-10T22:17:15.729 INFO:tasks.cephadm:Fetching mon keyring... 2024-09-10T22:17:15.730 DEBUG:teuthology.orchestra.run.smithi019:> set -ex 2024-09-10T22:17:15.730 DEBUG:teuthology.orchestra.run.smithi019:> sudo dd if=/var/lib/ceph/22997a4c-6fc2-11ef-bcea-c7b262605968/mon.a/keyring of=/dev/stdout 2024-09-10T22:17:15.796 INFO:tasks.cephadm:Fetching pub ssh key... 2024-09-10T22:17:15.796 DEBUG:teuthology.orchestra.run.smithi019:> set -ex 2024-09-10T22:17:15.797 DEBUG:teuthology.orchestra.run.smithi019:> dd if=/home/ubuntu/cephtest/ceph.pub of=/dev/stdout 2024-09-10T22:17:15.852 INFO:tasks.cephadm:Installing pub ssh key for root users... 2024-09-10T22:17:15.852 DEBUG:teuthology.orchestra.run.smithi019:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCt8Z2NhxQg6nivMj19od0Z+pcUbiFrL5TILAd7GMs/2xLx8MHDtEWISTYptEvF8UXfNZDos28jh8udgcNRFNBvginafZMyk6Q31Msn4FCo7AZ6BweJDdWVPFcPA7qFK95I85ojVQ9DPGw/q6uFI0UOiNJoWTZhRen5z5OdwpR8ctwOMsZNLUsNryZlQo6RtieF/8bK79iQws6QUvdB/bk2KZfm+jSiLBf0Hw4CAPlHAIDbuaQCzxE6JGyuhSitqMaWnmWy0DTcYZy25YiZ2GKWSGiY0SFe545t87vpwsHrZ38yYmfrftXy8+eDZLbREh9Q+XR7Bo1/9EzBT+mHwftLBaWQwMSKYe22xIqJ8VAjDPxzGGhzZB11wm0jJ1hT0o+ORouJ21UJ1DhvFeC4xlzs4K1qTWA0YJDjCqTI7Z7loDbrhwfa7feXVDNkQM1Rvy8ypL4Qrb5kjEzAYNz1uSiMCb/T6sHXtZgLyC/NfVJCRi9jpFWQNNbJrkWiEgSM9u0= ceph-22997a4c-6fc2-11ef-bcea-c7b262605968' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-09-10T22:17:15.941 INFO:teuthology.orchestra.run.smithi019.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCt8Z2NhxQg6nivMj19od0Z+pcUbiFrL5TILAd7GMs/2xLx8MHDtEWISTYptEvF8UXfNZDos28jh8udgcNRFNBvginafZMyk6Q31Msn4FCo7AZ6BweJDdWVPFcPA7qFK95I85ojVQ9DPGw/q6uFI0UOiNJoWTZhRen5z5OdwpR8ctwOMsZNLUsNryZlQo6RtieF/8bK79iQws6QUvdB/bk2KZfm+jSiLBf0Hw4CAPlHAIDbuaQCzxE6JGyuhSitqMaWnmWy0DTcYZy25YiZ2GKWSGiY0SFe545t87vpwsHrZ38yYmfrftXy8+eDZLbREh9Q+XR7Bo1/9EzBT+mHwftLBaWQwMSKYe22xIqJ8VAjDPxzGGhzZB11wm0jJ1hT0o+ORouJ21UJ1DhvFeC4xlzs4K1qTWA0YJDjCqTI7Z7loDbrhwfa7feXVDNkQM1Rvy8ypL4Qrb5kjEzAYNz1uSiMCb/T6sHXtZgLyC/NfVJCRi9jpFWQNNbJrkWiEgSM9u0= ceph-22997a4c-6fc2-11ef-bcea-c7b262605968 2024-09-10T22:17:15.953 DEBUG:teuthology.orchestra.run.smithi135:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCt8Z2NhxQg6nivMj19od0Z+pcUbiFrL5TILAd7GMs/2xLx8MHDtEWISTYptEvF8UXfNZDos28jh8udgcNRFNBvginafZMyk6Q31Msn4FCo7AZ6BweJDdWVPFcPA7qFK95I85ojVQ9DPGw/q6uFI0UOiNJoWTZhRen5z5OdwpR8ctwOMsZNLUsNryZlQo6RtieF/8bK79iQws6QUvdB/bk2KZfm+jSiLBf0Hw4CAPlHAIDbuaQCzxE6JGyuhSitqMaWnmWy0DTcYZy25YiZ2GKWSGiY0SFe545t87vpwsHrZ38yYmfrftXy8+eDZLbREh9Q+XR7Bo1/9EzBT+mHwftLBaWQwMSKYe22xIqJ8VAjDPxzGGhzZB11wm0jJ1hT0o+ORouJ21UJ1DhvFeC4xlzs4K1qTWA0YJDjCqTI7Z7loDbrhwfa7feXVDNkQM1Rvy8ypL4Qrb5kjEzAYNz1uSiMCb/T6sHXtZgLyC/NfVJCRi9jpFWQNNbJrkWiEgSM9u0= ceph-22997a4c-6fc2-11ef-bcea-c7b262605968' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-09-10T22:17:15.992 INFO:teuthology.orchestra.run.smithi135.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCt8Z2NhxQg6nivMj19od0Z+pcUbiFrL5TILAd7GMs/2xLx8MHDtEWISTYptEvF8UXfNZDos28jh8udgcNRFNBvginafZMyk6Q31Msn4FCo7AZ6BweJDdWVPFcPA7qFK95I85ojVQ9DPGw/q6uFI0UOiNJoWTZhRen5z5OdwpR8ctwOMsZNLUsNryZlQo6RtieF/8bK79iQws6QUvdB/bk2KZfm+jSiLBf0Hw4CAPlHAIDbuaQCzxE6JGyuhSitqMaWnmWy0DTcYZy25YiZ2GKWSGiY0SFe545t87vpwsHrZ38yYmfrftXy8+eDZLbREh9Q+XR7Bo1/9EzBT+mHwftLBaWQwMSKYe22xIqJ8VAjDPxzGGhzZB11wm0jJ1hT0o+ORouJ21UJ1DhvFeC4xlzs4K1qTWA0YJDjCqTI7Z7loDbrhwfa7feXVDNkQM1Rvy8ypL4Qrb5kjEzAYNz1uSiMCb/T6sHXtZgLyC/NfVJCRi9jpFWQNNbJrkWiEgSM9u0= ceph-22997a4c-6fc2-11ef-bcea-c7b262605968 2024-09-10T22:17:16.004 DEBUG:teuthology.orchestra.run.smithi138:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCt8Z2NhxQg6nivMj19od0Z+pcUbiFrL5TILAd7GMs/2xLx8MHDtEWISTYptEvF8UXfNZDos28jh8udgcNRFNBvginafZMyk6Q31Msn4FCo7AZ6BweJDdWVPFcPA7qFK95I85ojVQ9DPGw/q6uFI0UOiNJoWTZhRen5z5OdwpR8ctwOMsZNLUsNryZlQo6RtieF/8bK79iQws6QUvdB/bk2KZfm+jSiLBf0Hw4CAPlHAIDbuaQCzxE6JGyuhSitqMaWnmWy0DTcYZy25YiZ2GKWSGiY0SFe545t87vpwsHrZ38yYmfrftXy8+eDZLbREh9Q+XR7Bo1/9EzBT+mHwftLBaWQwMSKYe22xIqJ8VAjDPxzGGhzZB11wm0jJ1hT0o+ORouJ21UJ1DhvFeC4xlzs4K1qTWA0YJDjCqTI7Z7loDbrhwfa7feXVDNkQM1Rvy8ypL4Qrb5kjEzAYNz1uSiMCb/T6sHXtZgLyC/NfVJCRi9jpFWQNNbJrkWiEgSM9u0= ceph-22997a4c-6fc2-11ef-bcea-c7b262605968' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-09-10T22:17:16.044 INFO:teuthology.orchestra.run.smithi138.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCt8Z2NhxQg6nivMj19od0Z+pcUbiFrL5TILAd7GMs/2xLx8MHDtEWISTYptEvF8UXfNZDos28jh8udgcNRFNBvginafZMyk6Q31Msn4FCo7AZ6BweJDdWVPFcPA7qFK95I85ojVQ9DPGw/q6uFI0UOiNJoWTZhRen5z5OdwpR8ctwOMsZNLUsNryZlQo6RtieF/8bK79iQws6QUvdB/bk2KZfm+jSiLBf0Hw4CAPlHAIDbuaQCzxE6JGyuhSitqMaWnmWy0DTcYZy25YiZ2GKWSGiY0SFe545t87vpwsHrZ38yYmfrftXy8+eDZLbREh9Q+XR7Bo1/9EzBT+mHwftLBaWQwMSKYe22xIqJ8VAjDPxzGGhzZB11wm0jJ1hT0o+ORouJ21UJ1DhvFeC4xlzs4K1qTWA0YJDjCqTI7Z7loDbrhwfa7feXVDNkQM1Rvy8ypL4Qrb5kjEzAYNz1uSiMCb/T6sHXtZgLyC/NfVJCRi9jpFWQNNbJrkWiEgSM9u0= ceph-22997a4c-6fc2-11ef-bcea-c7b262605968 2024-09-10T22:17:16.057 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 22997a4c-6fc2-11ef-bcea-c7b262605968 -- ceph config set mgr mgr/cephadm/allow_ptrace true 2024-09-10T22:17:16.208 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:17:16 smithi019 ceph-mon[31375]: from='client.? 172.21.15.19:0/1879379133' entity='client.admin' 2024-09-10T22:17:16.319 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/22997a4c-6fc2-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T22:17:18.069 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:17:18 smithi019 ceph-mon[31375]: mgrmap e13: x(active, since 12s) 2024-09-10T22:17:18.069 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:17:18 smithi019 ceph-mon[31375]: from='client.? 172.21.15.19:0/3443206252' entity='client.admin' 2024-09-10T22:17:18.069 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:17:18 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:17:18.069 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:17:18 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:17:18.070 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:17:18 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:smithi019", "name": "osd_memory_target"} : dispatch 2024-09-10T22:17:18.070 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:17:18 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:17:18.070 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:17:18 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T22:17:18.070 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:17:18 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:17:18.094 INFO:tasks.cephadm:Distributing conf and client.admin keyring to all hosts + 0755 2024-09-10T22:17:18.094 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 22997a4c-6fc2-11ef-bcea-c7b262605968 -- ceph orch client-keyring set client.admin '*' --mode 0755 2024-09-10T22:17:18.630 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/22997a4c-6fc2-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T22:17:20.114 INFO:tasks.cephadm:Writing (initial) conf and keyring to smithi135 2024-09-10T22:17:20.114 DEBUG:teuthology.orchestra.run.smithi135:> set -ex 2024-09-10T22:17:20.114 DEBUG:teuthology.orchestra.run.smithi135:> dd of=/etc/ceph/ceph.conf 2024-09-10T22:17:20.134 DEBUG:teuthology.orchestra.run.smithi135:> set -ex 2024-09-10T22:17:20.134 DEBUG:teuthology.orchestra.run.smithi135:> dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-10T22:17:20.192 INFO:tasks.cephadm:Adding host smithi135 to orchestrator... 2024-09-10T22:17:20.192 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 22997a4c-6fc2-11ef-bcea-c7b262605968 -- ceph orch host add smithi135 2024-09-10T22:17:20.629 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/22997a4c-6fc2-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T22:17:20.708 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:17:20 smithi019 ceph-mon[31375]: from='client.14176 -' entity='client.admin' cmd=[{"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T22:17:20.709 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:17:20 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:17:20.709 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:17:20 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T22:17:20.709 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:17:20 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T22:17:20.709 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:17:20 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T22:17:20.709 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:17:20 smithi019 ceph-mon[31375]: Updating smithi019:/etc/ceph/ceph.conf 2024-09-10T22:17:20.709 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:17:20 smithi019 ceph-mon[31375]: Updating smithi019:/var/lib/ceph/22997a4c-6fc2-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-10T22:17:20.709 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:17:20 smithi019 ceph-mon[31375]: Updating smithi019:/etc/ceph/ceph.client.admin.keyring 2024-09-10T22:17:20.709 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:17:20 smithi019 ceph-mon[31375]: Updating smithi019:/var/lib/ceph/22997a4c-6fc2-11ef-bcea-c7b262605968/config/ceph.client.admin.keyring 2024-09-10T22:17:20.709 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:17:20 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:17:20.709 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:17:20 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:17:20.709 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:17:20 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:17:22.458 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:17:22 smithi019 ceph-mon[31375]: from='client.14178 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi135", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T22:17:23.458 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:17:23 smithi019 ceph-mon[31375]: Deploying cephadm binary to smithi135 2024-09-10T22:17:25.156 INFO:teuthology.orchestra.run.smithi019.stdout:Added host 'smithi135' with addr '172.21.15.135' 2024-09-10T22:17:25.458 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:17:25 smithi019 ceph-mon[31375]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T22:17:25.458 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:17:25 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:17:25.458 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:17:25 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T22:17:25.882 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 22997a4c-6fc2-11ef-bcea-c7b262605968 -- ceph orch host ls --format=json 2024-09-10T22:17:26.137 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/22997a4c-6fc2-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T22:17:26.520 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:17:26 smithi019 ceph-mon[31375]: Added host smithi135 2024-09-10T22:17:26.520 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:17:26 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:17:26.520 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:17:26 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:17:26.805 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-10T22:17:26.806 INFO:teuthology.orchestra.run.smithi019.stdout:[{"addr": "172.21.15.19", "hostname": "smithi019", "labels": [], "status": ""}, {"addr": "172.21.15.135", "hostname": "smithi135", "labels": [], "status": ""}] 2024-09-10T22:17:27.437 INFO:tasks.cephadm:Writing (initial) conf and keyring to smithi138 2024-09-10T22:17:27.438 DEBUG:teuthology.orchestra.run.smithi138:> set -ex 2024-09-10T22:17:27.438 DEBUG:teuthology.orchestra.run.smithi138:> dd of=/etc/ceph/ceph.conf 2024-09-10T22:17:27.457 DEBUG:teuthology.orchestra.run.smithi138:> set -ex 2024-09-10T22:17:27.457 DEBUG:teuthology.orchestra.run.smithi138:> dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-10T22:17:27.513 INFO:tasks.cephadm:Adding host smithi138 to orchestrator... 2024-09-10T22:17:27.514 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 22997a4c-6fc2-11ef-bcea-c7b262605968 -- ceph orch host add smithi138 2024-09-10T22:17:27.708 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:17:27 smithi019 ceph-mon[31375]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T22:17:27.708 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:17:27 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:17:27.708 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:17:27 smithi019 ceph-mon[31375]: from='client.14180 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-10T22:17:27.766 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/22997a4c-6fc2-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T22:17:29.958 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:17:29 smithi019 ceph-mon[31375]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T22:17:29.959 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:17:29 smithi019 ceph-mon[31375]: from='client.14182 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi138", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T22:17:29.959 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:17:29 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:17:29.959 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:17:29 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:17:29.959 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:17:29 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:17:29.959 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:17:29 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:17:29.959 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:17:29 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:smithi135", "name": "osd_memory_target"} : dispatch 2024-09-10T22:17:29.959 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:17:29 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T22:17:29.959 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:17:29 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T22:17:31.458 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:17:31 smithi019 ceph-mon[31375]: Updating smithi135:/etc/ceph/ceph.conf 2024-09-10T22:17:31.458 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:17:31 smithi019 ceph-mon[31375]: Updating smithi135:/var/lib/ceph/22997a4c-6fc2-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-10T22:17:31.458 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:17:31 smithi019 ceph-mon[31375]: Deploying cephadm binary to smithi138 2024-09-10T22:17:31.458 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:17:31 smithi019 ceph-mon[31375]: Updating smithi135:/etc/ceph/ceph.client.admin.keyring 2024-09-10T22:17:31.459 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:17:31 smithi019 ceph-mon[31375]: Updating smithi135:/var/lib/ceph/22997a4c-6fc2-11ef-bcea-c7b262605968/config/ceph.client.admin.keyring 2024-09-10T22:17:31.459 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:17:31 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:17:31.459 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:17:31 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:17:31.459 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:17:31 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:17:32.291 INFO:teuthology.orchestra.run.smithi019.stdout:Added host 'smithi138' with addr '172.21.15.138' 2024-09-10T22:17:32.304 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:17:32 smithi019 ceph-mon[31375]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T22:17:32.922 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 22997a4c-6fc2-11ef-bcea-c7b262605968 -- ceph orch host ls --format=json 2024-09-10T22:17:33.176 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/22997a4c-6fc2-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T22:17:33.616 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:17:33 smithi019 ceph-mon[31375]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T22:17:33.616 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:17:33 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:17:33.616 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:17:33 smithi019 ceph-mon[31375]: Added host smithi138 2024-09-10T22:17:33.616 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:17:33 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T22:17:33.616 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:17:33 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:17:33.616 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:17:33 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:17:33.818 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-10T22:17:33.818 INFO:teuthology.orchestra.run.smithi019.stdout:[{"addr": "172.21.15.19", "hostname": "smithi019", "labels": [], "status": ""}, {"addr": "172.21.15.135", "hostname": "smithi135", "labels": [], "status": ""}, {"addr": "172.21.15.138", "hostname": "smithi138", "labels": [], "status": ""}] 2024-09-10T22:17:34.425 INFO:tasks.cephadm:Setting crush tunables to default 2024-09-10T22:17:34.426 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 22997a4c-6fc2-11ef-bcea-c7b262605968 -- ceph osd crush tunables default 2024-09-10T22:17:34.671 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:17:34 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:17:34.671 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:17:34 smithi019 ceph-mon[31375]: from='client.14184 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-10T22:17:34.680 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/22997a4c-6fc2-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T22:17:35.675 INFO:teuthology.orchestra.run.smithi019.stderr:adjusted tunables profile to default 2024-09-10T22:17:35.959 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:17:35 smithi019 ceph-mon[31375]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T22:17:35.959 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:17:35 smithi019 ceph-mon[31375]: from='client.? 172.21.15.19:0/157858144' entity='client.admin' cmd={"prefix": "osd crush tunables", "profile": "default"} : dispatch 2024-09-10T22:17:36.307 INFO:tasks.cephadm:Adding mon.a on smithi019 2024-09-10T22:17:36.308 INFO:tasks.cephadm:Adding mon.b on smithi135 2024-09-10T22:17:36.308 INFO:tasks.cephadm:Adding mon.c on smithi138 2024-09-10T22:17:36.308 DEBUG:teuthology.orchestra.run.smithi138:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 22997a4c-6fc2-11ef-bcea-c7b262605968 -- ceph orch apply mon '3;smithi019:172.21.15.19=a;smithi135:172.21.15.135=b;smithi138:172.21.15.138=c' 2024-09-10T22:17:36.549 INFO:teuthology.orchestra.run.smithi138.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-10T22:17:36.595 INFO:teuthology.orchestra.run.smithi138.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-10T22:17:36.958 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:17:36 smithi019 ceph-mon[31375]: from='client.? 172.21.15.19:0/157858144' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2024-09-10T22:17:36.958 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:17:36 smithi019 ceph-mon[31375]: osdmap e4: 0 total, 0 up, 0 in 2024-09-10T22:17:36.959 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:17:36 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:17:36.959 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:17:36 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:17:36.959 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:17:36 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:17:36.959 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:17:36 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:17:36.959 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:17:36 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:smithi138", "name": "osd_memory_target"} : dispatch 2024-09-10T22:17:36.959 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:17:36 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T22:17:36.959 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:17:36 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T22:17:37.307 INFO:teuthology.orchestra.run.smithi138.stdout:Scheduled mon update... 2024-09-10T22:17:37.958 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:17:37 smithi019 ceph-mon[31375]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T22:17:37.959 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:17:37 smithi019 ceph-mon[31375]: Updating smithi138:/etc/ceph/ceph.conf 2024-09-10T22:17:37.959 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:17:37 smithi019 ceph-mon[31375]: Updating smithi138:/var/lib/ceph/22997a4c-6fc2-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-10T22:17:37.959 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:17:37 smithi019 ceph-mon[31375]: Updating smithi138:/etc/ceph/ceph.client.admin.keyring 2024-09-10T22:17:37.959 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:17:37 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:17:37.959 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:17:37 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:17:37.959 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:17:37 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:17:37.959 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:17:37 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:17:37.959 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:17:37 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-10T22:17:37.959 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:17:37 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T22:17:38.020 DEBUG:teuthology.orchestra.run.smithi135:mon.b> sudo journalctl -f -n 0 -u ceph-22997a4c-6fc2-11ef-bcea-c7b262605968@mon.b.service 2024-09-10T22:17:38.023 DEBUG:teuthology.orchestra.run.smithi138:mon.c> sudo journalctl -f -n 0 -u ceph-22997a4c-6fc2-11ef-bcea-c7b262605968@mon.c.service 2024-09-10T22:17:38.025 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-09-10T22:17:38.025 DEBUG:teuthology.orchestra.run.smithi138:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 22997a4c-6fc2-11ef-bcea-c7b262605968 -- ceph mon dump -f json 2024-09-10T22:17:38.958 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:17:38 smithi019 ceph-mon[31375]: Updating smithi138:/var/lib/ceph/22997a4c-6fc2-11ef-bcea-c7b262605968/config/ceph.client.admin.keyring 2024-09-10T22:17:38.959 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:17:38 smithi019 ceph-mon[31375]: from='client.14188 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi019:172.21.15.19=a;smithi135:172.21.15.135=b;smithi138:172.21.15.138=c", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T22:17:38.959 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:17:38 smithi019 ceph-mon[31375]: Saving service mon spec with placement smithi019:172.21.15.19=a;smithi135:172.21.15.135=b;smithi138:172.21.15.138=c;count:3 2024-09-10T22:17:38.959 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:17:38 smithi019 ceph-mon[31375]: Deploying daemon mon.c on smithi138 2024-09-10T22:17:39.163 INFO:teuthology.orchestra.run.smithi138.stderr:Inferring config /var/lib/ceph/22997a4c-6fc2-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-10T22:17:39.958 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:17:39 smithi019 ceph-mon[31375]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T22:17:40.315 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-10T22:17:40.315 INFO:teuthology.orchestra.run.smithi138.stdout:{"epoch":1,"fsid":"22997a4c-6fc2-11ef-bcea-c7b262605968","modified":"2024-09-10T22:16:13.471813Z","created":"2024-09-10T22:16:13.471813Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:3300","nonce":0},{"type":"v1","addr":"172.21.15.19:6789","nonce":0}]},"addr":"172.21.15.19:6789/0","public_addr":"172.21.15.19:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-10T22:17:40.315 INFO:teuthology.orchestra.run.smithi138.stderr:dumped monmap epoch 1 2024-09-10T22:17:40.958 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:17:40 smithi019 ceph-mon[31375]: from='client.? 172.21.15.138:0/810989887' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2024-09-10T22:17:41.958 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:17:41 smithi019 ceph-mon[31375]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T22:17:42.165 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:17:42 smithi138 ceph-mon[35236]: mon.c@-1(synchronizing).mds e1 new map 2024-09-10T22:17:42.165 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:17:42 smithi138 ceph-mon[35236]: mon.c@-1(synchronizing).mds e1 print_map 2024-09-10T22:17:42.165 INFO:journalctl@ceph.mon.c.smithi138.stdout: e1 2024-09-10T22:17:42.165 INFO:journalctl@ceph.mon.c.smithi138.stdout: btime 2024-09-10T22:16:16:754503+0000 2024-09-10T22:17:42.165 INFO:journalctl@ceph.mon.c.smithi138.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-09-10T22:17:42.165 INFO:journalctl@ceph.mon.c.smithi138.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-10T22:17:42.165 INFO:journalctl@ceph.mon.c.smithi138.stdout: legacy client fscid: -1 2024-09-10T22:17:42.165 INFO:journalctl@ceph.mon.c.smithi138.stdout: 2024-09-10T22:17:42.166 INFO:journalctl@ceph.mon.c.smithi138.stdout: No filesystems configured 2024-09-10T22:17:42.166 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:17:42 smithi138 ceph-mon[35236]: mon.c@-1(synchronizing).osd e0 _set_cache_ratios kv ratio 0.25 inc ratio 0.375 full ratio 0.375 2024-09-10T22:17:42.166 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:17:42 smithi138 ceph-mon[35236]: mon.c@-1(synchronizing).osd e0 register_cache_with_pcm pcm target: 2147483648 pcm max: 1020054732 pcm min: 134217728 inc_osd_cache size: 1 2024-09-10T22:17:42.166 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:17:42 smithi138 ceph-mon[35236]: mon.c@-1(synchronizing).osd e1 e1: 0 total, 0 up, 0 in 2024-09-10T22:17:42.166 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:17:42 smithi138 ceph-mon[35236]: mon.c@-1(synchronizing).osd e2 e2: 0 total, 0 up, 0 in 2024-09-10T22:17:42.166 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:17:42 smithi138 ceph-mon[35236]: mon.c@-1(synchronizing).osd e3 e3: 0 total, 0 up, 0 in 2024-09-10T22:17:42.166 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:17:42 smithi138 ceph-mon[35236]: mon.c@-1(synchronizing).osd e4 e4: 0 total, 0 up, 0 in 2024-09-10T22:17:42.166 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:17:42 smithi138 ceph-mon[35236]: mon.c@-1(synchronizing).osd e4 crush map has features 3314932999778484224, adjusting msgr requires 2024-09-10T22:17:42.166 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:17:42 smithi138 ceph-mon[35236]: mon.c@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-09-10T22:17:42.166 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:17:42 smithi138 ceph-mon[35236]: mon.c@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-09-10T22:17:42.166 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:17:42 smithi138 ceph-mon[35236]: mon.c@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-09-10T22:17:42.166 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:17:42 smithi138 ceph-mon[35236]: Updating smithi135:/etc/ceph/ceph.conf 2024-09-10T22:17:42.166 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:17:42 smithi138 ceph-mon[35236]: Updating smithi135:/var/lib/ceph/22997a4c-6fc2-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-10T22:17:42.167 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:17:42 smithi138 ceph-mon[35236]: Deploying cephadm binary to smithi138 2024-09-10T22:17:42.167 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:17:42 smithi138 ceph-mon[35236]: Updating smithi135:/etc/ceph/ceph.client.admin.keyring 2024-09-10T22:17:42.167 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:17:42 smithi138 ceph-mon[35236]: Updating smithi135:/var/lib/ceph/22997a4c-6fc2-11ef-bcea-c7b262605968/config/ceph.client.admin.keyring 2024-09-10T22:17:42.167 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:17:42 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:17:42.167 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:17:42 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:17:42.167 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:17:42 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:17:42.167 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:17:42 smithi138 ceph-mon[35236]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T22:17:42.167 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:17:42 smithi138 ceph-mon[35236]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T22:17:42.167 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:17:42 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:17:42.385 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-09-10T22:17:42.385 DEBUG:teuthology.orchestra.run.smithi138:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 22997a4c-6fc2-11ef-bcea-c7b262605968 -- ceph mon dump -f json 2024-09-10T22:17:42.626 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:17:42 smithi138 ceph-mon[35236]: Added host smithi138 2024-09-10T22:17:42.626 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:17:42 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T22:17:42.626 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:17:42 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:17:42.626 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:17:42 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:17:42.626 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:17:42 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:17:42.626 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:17:42 smithi138 ceph-mon[35236]: from='client.14184 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-10T22:17:42.626 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:17:42 smithi138 ceph-mon[35236]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T22:17:42.626 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:17:42 smithi138 ceph-mon[35236]: from='client.? 172.21.15.19:0/157858144' entity='client.admin' cmd={"prefix": "osd crush tunables", "profile": "default"} : dispatch 2024-09-10T22:17:42.626 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:17:42 smithi138 ceph-mon[35236]: from='client.? 172.21.15.19:0/157858144' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2024-09-10T22:17:42.626 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:17:42 smithi138 ceph-mon[35236]: osdmap e4: 0 total, 0 up, 0 in 2024-09-10T22:17:42.627 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:17:42 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:17:42.627 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:17:42 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:17:42.627 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:17:42 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:17:42.627 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:17:42 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:17:42.627 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:17:42 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:smithi138", "name": "osd_memory_target"} : dispatch 2024-09-10T22:17:42.627 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:17:42 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T22:17:42.627 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:17:42 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T22:17:42.627 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:17:42 smithi138 ceph-mon[35236]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T22:17:42.627 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:17:42 smithi138 ceph-mon[35236]: Updating smithi138:/etc/ceph/ceph.conf 2024-09-10T22:17:42.627 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:17:42 smithi138 ceph-mon[35236]: Updating smithi138:/var/lib/ceph/22997a4c-6fc2-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-10T22:17:42.627 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:17:42 smithi138 ceph-mon[35236]: Updating smithi138:/etc/ceph/ceph.client.admin.keyring 2024-09-10T22:17:42.627 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:17:42 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:17:42.627 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:17:42 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:17:42.628 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:17:42 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:17:42.628 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:17:42 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:17:42.628 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:17:42 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-10T22:17:42.628 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:17:42 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T22:17:42.628 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:17:42 smithi138 ceph-mon[35236]: Updating smithi138:/var/lib/ceph/22997a4c-6fc2-11ef-bcea-c7b262605968/config/ceph.client.admin.keyring 2024-09-10T22:17:42.628 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:17:42 smithi138 ceph-mon[35236]: from='client.14188 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi019:172.21.15.19=a;smithi135:172.21.15.135=b;smithi138:172.21.15.138=c", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T22:17:42.628 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:17:42 smithi138 ceph-mon[35236]: Saving service mon spec with placement smithi019:172.21.15.19=a;smithi135:172.21.15.135=b;smithi138:172.21.15.138=c;count:3 2024-09-10T22:17:42.628 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:17:42 smithi138 ceph-mon[35236]: Deploying daemon mon.c on smithi138 2024-09-10T22:17:42.628 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:17:42 smithi138 ceph-mon[35236]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T22:17:42.628 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:17:42 smithi138 ceph-mon[35236]: from='client.? 172.21.15.138:0/810989887' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2024-09-10T22:17:42.628 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:17:42 smithi138 ceph-mon[35236]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T22:17:42.628 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:17:42 smithi138 ceph-mon[35236]: mon.c@-1(synchronizing).paxosservice(auth 1..3) refresh upgraded, format 0 -> 3 2024-09-10T22:17:42.628 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:17:42 smithi138 bash[35216]: 79446bdec6a90b8868648193835cae55ae7bb238b695f6f28725e75e7e0278ed 2024-09-10T22:17:42.629 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:17:42 smithi138 systemd[1]: Started Ceph mon.c for 22997a4c-6fc2-11ef-bcea-c7b262605968. 2024-09-10T22:17:42.630 INFO:teuthology.orchestra.run.smithi138.stderr:Inferring config /var/lib/ceph/22997a4c-6fc2-11ef-bcea-c7b262605968/mon.c/config 2024-09-10T22:17:47.459 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:17:47 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-10T22:17:47.459 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:17:47 smithi019 ceph-mon[31375]: mon.a calling monitor election 2024-09-10T22:17:47.459 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:17:47 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-10T22:17:47.459 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:17:47 smithi019 ceph-mon[31375]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T22:17:47.459 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:17:47 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-10T22:17:47.459 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:17:47 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-10T22:17:47.459 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:17:47 smithi019 ceph-mon[31375]: mon.c calling monitor election 2024-09-10T22:17:47.460 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:17:47 smithi019 ceph-mon[31375]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T22:17:47.460 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:17:47 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-10T22:17:47.460 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:17:47 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-10T22:17:47.460 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:17:47 smithi019 ceph-mon[31375]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T22:17:47.460 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:17:47 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-10T22:17:47.460 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:17:47 smithi019 ceph-mon[31375]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-09-10T22:17:47.460 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:17:47 smithi019 ceph-mon[31375]: monmap epoch 2 2024-09-10T22:17:47.460 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:17:47 smithi019 ceph-mon[31375]: fsid 22997a4c-6fc2-11ef-bcea-c7b262605968 2024-09-10T22:17:47.460 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:17:47 smithi019 ceph-mon[31375]: last_changed 2024-09-10T22:17:42.168945+0000 2024-09-10T22:17:47.460 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:17:47 smithi019 ceph-mon[31375]: created 2024-09-10T22:16:13.471813+0000 2024-09-10T22:17:47.460 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:17:47 smithi019 ceph-mon[31375]: min_mon_release 19 (squid) 2024-09-10T22:17:47.460 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:17:47 smithi019 ceph-mon[31375]: election_strategy: 1 2024-09-10T22:17:47.461 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:17:47 smithi019 ceph-mon[31375]: 0: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.a 2024-09-10T22:17:47.461 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:17:47 smithi019 ceph-mon[31375]: 1: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.c 2024-09-10T22:17:47.461 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:17:47 smithi019 ceph-mon[31375]: fsmap 2024-09-10T22:17:47.461 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:17:47 smithi019 ceph-mon[31375]: osdmap e4: 0 total, 0 up, 0 in 2024-09-10T22:17:47.461 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:17:47 smithi019 ceph-mon[31375]: mgrmap e13: x(active, since 42s) 2024-09-10T22:17:47.461 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:17:47 smithi019 ceph-mon[31375]: overall HEALTH_OK 2024-09-10T22:17:47.461 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:17:47 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:17:47.461 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:17:47 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:17:47.461 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:17:47 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:17:47.461 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:17:47 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-10T22:17:47.461 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:17:47 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T22:17:47.492 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:17:47 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-10T22:17:47.492 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:17:47 smithi138 ceph-mon[35236]: mon.a calling monitor election 2024-09-10T22:17:47.492 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:17:47 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-10T22:17:47.492 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:17:47 smithi138 ceph-mon[35236]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T22:17:47.492 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:17:47 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-10T22:17:47.492 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:17:47 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-10T22:17:47.492 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:17:47 smithi138 ceph-mon[35236]: mon.c calling monitor election 2024-09-10T22:17:47.492 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:17:47 smithi138 ceph-mon[35236]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T22:17:47.493 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:17:47 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-10T22:17:47.493 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:17:47 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-10T22:17:47.493 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:17:47 smithi138 ceph-mon[35236]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T22:17:47.493 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:17:47 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-10T22:17:47.493 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:17:47 smithi138 ceph-mon[35236]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-09-10T22:17:47.493 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:17:47 smithi138 ceph-mon[35236]: monmap epoch 2 2024-09-10T22:17:47.493 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:17:47 smithi138 ceph-mon[35236]: fsid 22997a4c-6fc2-11ef-bcea-c7b262605968 2024-09-10T22:17:47.493 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:17:47 smithi138 ceph-mon[35236]: last_changed 2024-09-10T22:17:42.168945+0000 2024-09-10T22:17:47.493 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:17:47 smithi138 ceph-mon[35236]: created 2024-09-10T22:16:13.471813+0000 2024-09-10T22:17:47.493 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:17:47 smithi138 ceph-mon[35236]: min_mon_release 19 (squid) 2024-09-10T22:17:47.493 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:17:47 smithi138 ceph-mon[35236]: election_strategy: 1 2024-09-10T22:17:47.494 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:17:47 smithi138 ceph-mon[35236]: 0: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.a 2024-09-10T22:17:47.494 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:17:47 smithi138 ceph-mon[35236]: 1: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.c 2024-09-10T22:17:47.494 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:17:47 smithi138 ceph-mon[35236]: fsmap 2024-09-10T22:17:47.494 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:17:47 smithi138 ceph-mon[35236]: osdmap e4: 0 total, 0 up, 0 in 2024-09-10T22:17:47.494 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:17:47 smithi138 ceph-mon[35236]: mgrmap e13: x(active, since 42s) 2024-09-10T22:17:47.494 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:17:47 smithi138 ceph-mon[35236]: overall HEALTH_OK 2024-09-10T22:17:47.494 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:17:47 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:17:47.494 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:17:47 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:17:47.494 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:17:47 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:17:47.494 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:17:47 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-10T22:17:47.494 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:17:47 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T22:17:47.703 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-10T22:17:47.703 INFO:teuthology.orchestra.run.smithi138.stdout:{"epoch":2,"fsid":"22997a4c-6fc2-11ef-bcea-c7b262605968","modified":"2024-09-10T22:17:42.168945Z","created":"2024-09-10T22:16:13.471813Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:3300","nonce":0},{"type":"v1","addr":"172.21.15.19:6789","nonce":0}]},"addr":"172.21.15.19:6789/0","public_addr":"172.21.15.19:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:3300","nonce":0},{"type":"v1","addr":"172.21.15.138:6789","nonce":0}]},"addr":"172.21.15.138:6789/0","public_addr":"172.21.15.138:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2024-09-10T22:17:47.703 INFO:teuthology.orchestra.run.smithi138.stderr:dumped monmap epoch 2 2024-09-10T22:17:48.261 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:17:48 smithi138 ceph-mon[35236]: Deploying daemon mon.b on smithi135 2024-09-10T22:17:48.261 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:17:48 smithi138 ceph-mon[35236]: from='client.? 172.21.15.138:0/2719083019' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2024-09-10T22:17:48.261 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:17:48 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-10T22:17:48.708 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:17:48 smithi019 ceph-mon[31375]: Deploying daemon mon.b on smithi135 2024-09-10T22:17:48.708 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:17:48 smithi019 ceph-mon[31375]: from='client.? 172.21.15.138:0/2719083019' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2024-09-10T22:17:48.709 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:17:48 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-10T22:17:49.294 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-09-10T22:17:49.295 DEBUG:teuthology.orchestra.run.smithi138:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 22997a4c-6fc2-11ef-bcea-c7b262605968 -- ceph mon dump -f json 2024-09-10T22:17:49.547 INFO:teuthology.orchestra.run.smithi138.stderr:Inferring config /var/lib/ceph/22997a4c-6fc2-11ef-bcea-c7b262605968/mon.c/config 2024-09-10T22:17:49.625 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:17:49 smithi138 ceph-mon[35236]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T22:17:49.708 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:17:49 smithi019 ceph-mon[31375]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T22:17:50.219 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-10T22:17:50.219 INFO:teuthology.orchestra.run.smithi138.stdout:{"epoch":2,"fsid":"22997a4c-6fc2-11ef-bcea-c7b262605968","modified":"2024-09-10T22:17:42.168945Z","created":"2024-09-10T22:16:13.471813Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:3300","nonce":0},{"type":"v1","addr":"172.21.15.19:6789","nonce":0}]},"addr":"172.21.15.19:6789/0","public_addr":"172.21.15.19:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:3300","nonce":0},{"type":"v1","addr":"172.21.15.138:6789","nonce":0}]},"addr":"172.21.15.138:6789/0","public_addr":"172.21.15.138:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2024-09-10T22:17:50.219 INFO:teuthology.orchestra.run.smithi138.stderr:dumped monmap epoch 2 2024-09-10T22:17:50.625 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:17:50 smithi138 ceph-mon[35236]: from='client.? 172.21.15.138:0/3019757109' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2024-09-10T22:17:50.708 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:17:50 smithi019 ceph-mon[31375]: from='client.? 172.21.15.138:0/3019757109' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2024-09-10T22:17:51.194 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:17:51 smithi135 podman[34770]: 2024-09-10 22:17:51.171740311 +0000 UTC m=+0.354885570 container start b8f7a223e8ed8c8196684e732e2178476905cf697d319725b981304214965ade (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-mon-b, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-10T22:17:51.610 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:17:51 smithi135 ceph-mon[34789]: set uid:gid to 167:167 (ceph:ceph) 2024-09-10T22:17:51.611 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:17:51 smithi135 ceph-mon[34789]: ceph version 19.3.0-4854-g8f219c47 (8f219c476cb4f26fc5719c661c0323719a45cb30) squid (dev), process ceph-mon, pid 2 2024-09-10T22:17:51.611 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:17:51 smithi135 ceph-mon[34789]: pidfile_write: ignore empty --pid-file 2024-09-10T22:17:51.611 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:17:51 smithi135 ceph-mon[34789]: load: jerasure load: lrc 2024-09-10T22:17:51.611 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:17:51 smithi135 ceph-mon[34789]: rocksdb: RocksDB version: 7.9.2 2024-09-10T22:17:51.611 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:17:51 smithi135 ceph-mon[34789]: rocksdb: Git sha 0 2024-09-10T22:17:51.611 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:17:51 smithi135 ceph-mon[34789]: rocksdb: Compile date 2024-09-10 08:02:51 2024-09-10T22:17:51.611 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:17:51 smithi135 ceph-mon[34789]: rocksdb: DB SUMMARY 2024-09-10T22:17:51.612 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:17:51 smithi135 ceph-mon[34789]: rocksdb: DB Session ID: N1MF74TDKLYJTMEYM3IV 2024-09-10T22:17:51.612 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:17:51 smithi135 ceph-mon[34789]: rocksdb: CURRENT file: CURRENT 2024-09-10T22:17:51.612 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:17:51 smithi135 ceph-mon[34789]: rocksdb: IDENTITY file: IDENTITY 2024-09-10T22:17:51.612 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:17:51 smithi135 ceph-mon[34789]: rocksdb: MANIFEST file: MANIFEST-000005 size: 59 Bytes 2024-09-10T22:17:51.612 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:17:51 smithi135 ceph-mon[34789]: rocksdb: SST files in /var/lib/ceph/mon/ceph-b/store.db dir, Total Num: 0, files: 2024-09-10T22:17:51.612 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:17:51 smithi135 ceph-mon[34789]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-b/store.db: 000004.log size: 636 ; 2024-09-10T22:17:51.612 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:17:51 smithi135 ceph-mon[34789]: rocksdb: Options.error_if_exists: 0 2024-09-10T22:17:51.612 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:17:51 smithi135 ceph-mon[34789]: rocksdb: Options.create_if_missing: 0 2024-09-10T22:17:51.612 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:17:51 smithi135 ceph-mon[34789]: rocksdb: Options.paranoid_checks: 1 2024-09-10T22:17:51.613 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:17:51 smithi135 ceph-mon[34789]: rocksdb: Options.flush_verify_memtable_count: 1 2024-09-10T22:17:51.613 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:17:51 smithi135 ceph-mon[34789]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-09-10T22:17:51.613 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:17:51 smithi135 ceph-mon[34789]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-09-10T22:17:51.613 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:17:51 smithi135 ceph-mon[34789]: rocksdb: Options.env: 0x5630c3bfd180 2024-09-10T22:17:51.613 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:17:51 smithi135 ceph-mon[34789]: rocksdb: Options.fs: PosixFileSystem 2024-09-10T22:17:51.613 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:17:51 smithi135 ceph-mon[34789]: rocksdb: Options.info_log: 0x5630c5c59700 2024-09-10T22:17:51.613 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:17:51 smithi135 ceph-mon[34789]: rocksdb: Options.max_file_opening_threads: 16 2024-09-10T22:17:51.613 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:17:51 smithi135 ceph-mon[34789]: rocksdb: Options.statistics: (nil) 2024-09-10T22:17:51.613 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:17:51 smithi135 ceph-mon[34789]: rocksdb: Options.use_fsync: 0 2024-09-10T22:17:51.613 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:17:51 smithi135 ceph-mon[34789]: rocksdb: Options.max_log_file_size: 0 2024-09-10T22:17:51.614 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:17:51 smithi135 ceph-mon[34789]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-09-10T22:17:51.614 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:17:51 smithi135 ceph-mon[34789]: rocksdb: Options.log_file_time_to_roll: 0 2024-09-10T22:17:51.614 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:17:51 smithi135 ceph-mon[34789]: rocksdb: Options.keep_log_file_num: 1000 2024-09-10T22:17:51.614 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:17:51 smithi135 ceph-mon[34789]: rocksdb: Options.recycle_log_file_num: 0 2024-09-10T22:17:51.614 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:17:51 smithi135 ceph-mon[34789]: rocksdb: Options.allow_fallocate: 1 2024-09-10T22:17:51.614 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:17:51 smithi135 ceph-mon[34789]: rocksdb: Options.allow_mmap_reads: 0 2024-09-10T22:17:51.615 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:17:51 smithi135 ceph-mon[34789]: rocksdb: Options.allow_mmap_writes: 0 2024-09-10T22:17:51.615 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:17:51 smithi135 ceph-mon[34789]: rocksdb: Options.use_direct_reads: 0 2024-09-10T22:17:51.615 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:17:51 smithi135 ceph-mon[34789]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-09-10T22:17:51.615 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:17:51 smithi135 ceph-mon[34789]: rocksdb: Options.create_missing_column_families: 0 2024-09-10T22:17:51.615 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:17:51 smithi135 ceph-mon[34789]: rocksdb: Options.db_log_dir: 2024-09-10T22:17:51.615 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:17:51 smithi135 ceph-mon[34789]: rocksdb: Options.wal_dir: 2024-09-10T22:17:51.616 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:17:51 smithi135 ceph-mon[34789]: rocksdb: Options.table_cache_numshardbits: 6 2024-09-10T22:17:51.616 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:17:51 smithi135 ceph-mon[34789]: rocksdb: Options.WAL_ttl_seconds: 0 2024-09-10T22:17:51.616 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:17:51 smithi135 ceph-mon[34789]: rocksdb: Options.WAL_size_limit_MB: 0 2024-09-10T22:17:51.616 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:17:51 smithi135 ceph-mon[34789]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-09-10T22:17:51.616 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:17:51 smithi135 ceph-mon[34789]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-09-10T22:17:51.616 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:17:51 smithi135 ceph-mon[34789]: rocksdb: Options.is_fd_close_on_exec: 1 2024-09-10T22:17:51.616 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:17:51 smithi135 ceph-mon[34789]: rocksdb: Options.advise_random_on_open: 1 2024-09-10T22:17:51.616 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:17:51 smithi135 ceph-mon[34789]: rocksdb: Options.db_write_buffer_size: 0 2024-09-10T22:17:51.616 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:17:51 smithi135 ceph-mon[34789]: rocksdb: Options.write_buffer_manager: 0x5630c5c5db80 2024-09-10T22:17:51.616 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:17:51 smithi135 ceph-mon[34789]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-09-10T22:17:51.616 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:17:51 smithi135 ceph-mon[34789]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-09-10T22:17:51.617 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:17:51 smithi135 ceph-mon[34789]: rocksdb: Options.use_adaptive_mutex: 0 2024-09-10T22:17:51.617 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:17:51 smithi135 ceph-mon[34789]: rocksdb: Options.rate_limiter: (nil) 2024-09-10T22:17:51.617 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:17:51 smithi135 ceph-mon[34789]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-09-10T22:17:51.617 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:17:51 smithi135 ceph-mon[34789]: rocksdb: Options.wal_recovery_mode: 2 2024-09-10T22:17:51.617 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:17:51 smithi135 ceph-mon[34789]: rocksdb: Options.enable_thread_tracking: 0 2024-09-10T22:17:51.617 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:17:51 smithi135 ceph-mon[34789]: rocksdb: Options.enable_pipelined_write: 0 2024-09-10T22:17:51.617 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:17:51 smithi135 ceph-mon[34789]: rocksdb: Options.unordered_write: 0 2024-09-10T22:17:51.618 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:17:51 smithi135 ceph-mon[34789]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-09-10T22:17:51.618 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:17:51 smithi135 ceph-mon[34789]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-09-10T22:17:51.618 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:17:51 smithi135 ceph-mon[34789]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-09-10T22:17:51.618 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:17:51 smithi135 ceph-mon[34789]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-09-10T22:17:51.618 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:17:51 smithi135 ceph-mon[34789]: rocksdb: Options.row_cache: None 2024-09-10T22:17:51.618 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:17:51 smithi135 ceph-mon[34789]: rocksdb: Options.wal_filter: None 2024-09-10T22:17:51.618 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:17:51 smithi135 ceph-mon[34789]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-09-10T22:17:51.618 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:17:51 smithi135 ceph-mon[34789]: rocksdb: Options.allow_ingest_behind: 0 2024-09-10T22:17:51.618 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:17:51 smithi135 ceph-mon[34789]: rocksdb: Options.two_write_queues: 0 2024-09-10T22:17:51.619 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:17:51 smithi135 ceph-mon[34789]: rocksdb: Options.manual_wal_flush: 0 2024-09-10T22:17:51.619 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:17:51 smithi135 ceph-mon[34789]: rocksdb: Options.wal_compression: 0 2024-09-10T22:17:51.619 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:17:51 smithi135 ceph-mon[34789]: rocksdb: Options.atomic_flush: 0 2024-09-10T22:17:51.619 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:17:51 smithi135 ceph-mon[34789]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-09-10T22:17:51.619 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:17:51 smithi135 ceph-mon[34789]: rocksdb: Options.persist_stats_to_disk: 0 2024-09-10T22:17:51.619 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:17:51 smithi135 ceph-mon[34789]: rocksdb: Options.write_dbid_to_manifest: 0 2024-09-10T22:17:51.619 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:17:51 smithi135 ceph-mon[34789]: rocksdb: Options.log_readahead_size: 0 2024-09-10T22:17:51.619 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:17:51 smithi135 ceph-mon[34789]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-09-10T22:17:51.619 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:17:51 smithi135 ceph-mon[34789]: rocksdb: Options.best_efforts_recovery: 0 2024-09-10T22:17:51.619 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:17:51 smithi135 ceph-mon[34789]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-09-10T22:17:51.619 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:17:51 smithi135 ceph-mon[34789]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-09-10T22:17:51.619 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:17:51 smithi135 ceph-mon[34789]: rocksdb: Options.allow_data_in_errors: 0 2024-09-10T22:17:51.619 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:17:51 smithi135 ceph-mon[34789]: rocksdb: Options.db_host_id: __hostname__ 2024-09-10T22:17:51.619 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:17:51 smithi135 ceph-mon[34789]: rocksdb: Options.enforce_single_del_contracts: true 2024-09-10T22:17:51.621 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:17:51 smithi135 ceph-mon[34789]: rocksdb: Options.max_background_jobs: 2 2024-09-10T22:17:51.621 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:17:51 smithi135 ceph-mon[34789]: rocksdb: Options.max_background_compactions: -1 2024-09-10T22:17:51.621 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:17:51 smithi135 ceph-mon[34789]: rocksdb: Options.max_subcompactions: 1 2024-09-10T22:17:51.621 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:17:51 smithi135 ceph-mon[34789]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-09-10T22:17:51.622 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:17:51 smithi135 ceph-mon[34789]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-09-10T22:17:51.622 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:17:51 smithi135 ceph-mon[34789]: rocksdb: Options.delayed_write_rate : 16777216 2024-09-10T22:17:51.622 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:17:51 smithi135 ceph-mon[34789]: rocksdb: Options.max_total_wal_size: 0 2024-09-10T22:17:51.622 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:17:51 smithi135 ceph-mon[34789]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-09-10T22:17:51.622 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:17:51 smithi135 ceph-mon[34789]: rocksdb: Options.stats_dump_period_sec: 600 2024-09-10T22:17:51.622 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:17:51 smithi135 ceph-mon[34789]: rocksdb: Options.stats_persist_period_sec: 600 2024-09-10T22:17:51.622 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:17:51 smithi135 ceph-mon[34789]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-09-10T22:17:51.622 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:17:51 smithi135 ceph-mon[34789]: rocksdb: Options.max_open_files: -1 2024-09-10T22:17:51.622 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:17:51 smithi135 ceph-mon[34789]: rocksdb: Options.bytes_per_sync: 0 2024-09-10T22:17:51.622 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:17:51 smithi135 ceph-mon[34789]: rocksdb: Options.wal_bytes_per_sync: 0 2024-09-10T22:17:51.622 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:17:51 smithi135 ceph-mon[34789]: rocksdb: Options.strict_bytes_per_sync: 0 2024-09-10T22:17:51.622 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:17:51 smithi135 ceph-mon[34789]: rocksdb: Options.compaction_readahead_size: 0 2024-09-10T22:17:51.622 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:17:51 smithi135 ceph-mon[34789]: rocksdb: Options.max_background_flushes: -1 2024-09-10T22:17:51.623 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:17:51 smithi135 ceph-mon[34789]: rocksdb: Compression algorithms supported: 2024-09-10T22:17:51.623 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:17:51 smithi135 ceph-mon[34789]: rocksdb: kZSTD supported: 0 2024-09-10T22:17:51.623 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:17:51 smithi135 ceph-mon[34789]: rocksdb: kXpressCompression supported: 0 2024-09-10T22:17:51.623 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:17:51 smithi135 ceph-mon[34789]: rocksdb: kBZip2Compression supported: 0 2024-09-10T22:17:51.623 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:17:51 smithi135 ceph-mon[34789]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-09-10T22:17:51.623 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:17:51 smithi135 ceph-mon[34789]: rocksdb: kLZ4Compression supported: 1 2024-09-10T22:17:51.623 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:17:51 smithi135 ceph-mon[34789]: rocksdb: kZlibCompression supported: 1 2024-09-10T22:17:51.623 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:17:51 smithi135 ceph-mon[34789]: rocksdb: kLZ4HCCompression supported: 1 2024-09-10T22:17:51.623 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:17:51 smithi135 ceph-mon[34789]: rocksdb: kSnappyCompression supported: 1 2024-09-10T22:17:51.623 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:17:51 smithi135 ceph-mon[34789]: rocksdb: Fast CRC32 supported: Supported on x86 2024-09-10T22:17:51.624 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:17:51 smithi135 ceph-mon[34789]: rocksdb: DMutex implementation: pthread_mutex_t 2024-09-10T22:17:51.624 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:17:51 smithi135 ceph-mon[34789]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-b/store.db/MANIFEST-000005 2024-09-10T22:17:51.624 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:17:51 smithi135 ceph-mon[34789]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-09-10T22:17:51.624 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:17:51 smithi135 ceph-mon[34789]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-09-10T22:17:51.624 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:17:51 smithi135 ceph-mon[34789]: rocksdb: Options.merge_operator: 2024-09-10T22:17:51.624 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:17:51 smithi135 ceph-mon[34789]: rocksdb: Options.compaction_filter: None 2024-09-10T22:17:51.624 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:17:51 smithi135 ceph-mon[34789]: rocksdb: Options.compaction_filter_factory: None 2024-09-10T22:17:51.624 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:17:51 smithi135 ceph-mon[34789]: rocksdb: Options.sst_partitioner_factory: None 2024-09-10T22:17:51.624 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:17:51 smithi135 ceph-mon[34789]: rocksdb: Options.memtable_factory: SkipListFactory 2024-09-10T22:17:51.624 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:17:51 smithi135 ceph-mon[34789]: rocksdb: Options.table_factory: BlockBasedTable 2024-09-10T22:17:51.625 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:17:51 smithi135 ceph-mon[34789]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x5630c5c59320) 2024-09-10T22:17:51.625 INFO:journalctl@ceph.mon.b.smithi135.stdout: cache_index_and_filter_blocks: 1 2024-09-10T22:17:51.625 INFO:journalctl@ceph.mon.b.smithi135.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-09-10T22:17:51.625 INFO:journalctl@ceph.mon.b.smithi135.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-09-10T22:17:51.625 INFO:journalctl@ceph.mon.b.smithi135.stdout: pin_top_level_index_and_filter: 1 2024-09-10T22:17:51.625 INFO:journalctl@ceph.mon.b.smithi135.stdout: index_type: 0 2024-09-10T22:17:51.625 INFO:journalctl@ceph.mon.b.smithi135.stdout: data_block_index_type: 0 2024-09-10T22:17:51.625 INFO:journalctl@ceph.mon.b.smithi135.stdout: index_shortening: 1 2024-09-10T22:17:51.625 INFO:journalctl@ceph.mon.b.smithi135.stdout: data_block_hash_table_util_ratio: 0.750000 2024-09-10T22:17:51.625 INFO:journalctl@ceph.mon.b.smithi135.stdout: checksum: 4 2024-09-10T22:17:51.625 INFO:journalctl@ceph.mon.b.smithi135.stdout: no_block_cache: 0 2024-09-10T22:17:51.625 INFO:journalctl@ceph.mon.b.smithi135.stdout: block_cache: 0x5630c5c4d610 2024-09-10T22:17:51.625 INFO:journalctl@ceph.mon.b.smithi135.stdout: block_cache_name: BinnedLRUCache 2024-09-10T22:17:51.625 INFO:journalctl@ceph.mon.b.smithi135.stdout: block_cache_options: 2024-09-10T22:17:51.626 INFO:journalctl@ceph.mon.b.smithi135.stdout: capacity : 536870912 2024-09-10T22:17:51.626 INFO:journalctl@ceph.mon.b.smithi135.stdout: num_shard_bits : 4 2024-09-10T22:17:51.626 INFO:journalctl@ceph.mon.b.smithi135.stdout: strict_capacity_limit : 0 2024-09-10T22:17:51.626 INFO:journalctl@ceph.mon.b.smithi135.stdout: high_pri_pool_ratio: 0.000 2024-09-10T22:17:51.626 INFO:journalctl@ceph.mon.b.smithi135.stdout: block_cache_compressed: (nil) 2024-09-10T22:17:51.626 INFO:journalctl@ceph.mon.b.smithi135.stdout: persistent_cache: (nil) 2024-09-10T22:17:51.626 INFO:journalctl@ceph.mon.b.smithi135.stdout: block_size: 4096 2024-09-10T22:17:51.626 INFO:journalctl@ceph.mon.b.smithi135.stdout: block_size_deviation: 10 2024-09-10T22:17:51.626 INFO:journalctl@ceph.mon.b.smithi135.stdout: block_restart_interval: 16 2024-09-10T22:17:51.627 INFO:journalctl@ceph.mon.b.smithi135.stdout: index_block_restart_interval: 1 2024-09-10T22:17:51.627 INFO:journalctl@ceph.mon.b.smithi135.stdout: metadata_block_size: 4096 2024-09-10T22:17:51.627 INFO:journalctl@ceph.mon.b.smithi135.stdout: partition_filters: 0 2024-09-10T22:17:51.627 INFO:journalctl@ceph.mon.b.smithi135.stdout: use_delta_encoding: 1 2024-09-10T22:17:51.627 INFO:journalctl@ceph.mon.b.smithi135.stdout: filter_policy: bloomfilter 2024-09-10T22:17:51.627 INFO:journalctl@ceph.mon.b.smithi135.stdout: whole_key_filtering: 1 2024-09-10T22:17:51.627 INFO:journalctl@ceph.mon.b.smithi135.stdout: verify_compression: 0 2024-09-10T22:17:51.627 INFO:journalctl@ceph.mon.b.smithi135.stdout: read_amp_bytes_per_bit: 0 2024-09-10T22:17:51.627 INFO:journalctl@ceph.mon.b.smithi135.stdout: format_version: 5 2024-09-10T22:17:51.627 INFO:journalctl@ceph.mon.b.smithi135.stdout: enable_index_compression: 1 2024-09-10T22:17:51.627 INFO:journalctl@ceph.mon.b.smithi135.stdout: block_align: 0 2024-09-10T22:17:51.627 INFO:journalctl@ceph.mon.b.smithi135.stdout: max_auto_readahead_size: 262144 2024-09-10T22:17:51.628 INFO:journalctl@ceph.mon.b.smithi135.stdout: prepopulate_block_cache: 0 2024-09-10T22:17:51.628 INFO:journalctl@ceph.mon.b.smithi135.stdout: initial_auto_readahead_size: 8192 2024-09-10T22:17:51.628 INFO:journalctl@ceph.mon.b.smithi135.stdout: num_file_reads_for_auto_readahead: 2 2024-09-10T22:17:51.628 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:17:51 smithi135 ceph-mon[34789]: rocksdb: Options.write_buffer_size: 33554432 2024-09-10T22:17:51.628 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:17:51 smithi135 ceph-mon[34789]: rocksdb: Options.max_write_buffer_number: 2 2024-09-10T22:17:51.628 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:17:51 smithi135 ceph-mon[34789]: rocksdb: Options.compression: NoCompression 2024-09-10T22:17:51.628 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:17:51 smithi135 ceph-mon[34789]: rocksdb: Options.bottommost_compression: Disabled 2024-09-10T22:17:51.628 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:17:51 smithi135 ceph-mon[34789]: rocksdb: Options.prefix_extractor: nullptr 2024-09-10T22:17:51.629 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:17:51 smithi135 ceph-mon[34789]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-09-10T22:17:51.629 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:17:51 smithi135 ceph-mon[34789]: rocksdb: Options.num_levels: 7 2024-09-10T22:17:51.629 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:17:51 smithi135 ceph-mon[34789]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-09-10T22:17:51.629 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:17:51 smithi135 ceph-mon[34789]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-09-10T22:17:51.629 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:17:51 smithi135 ceph-mon[34789]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-09-10T22:17:51.629 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:17:51 smithi135 ceph-mon[34789]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-09-10T22:17:51.629 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:17:51 smithi135 ceph-mon[34789]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-09-10T22:17:51.629 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:17:51 smithi135 ceph-mon[34789]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-09-10T22:17:51.629 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:17:51 smithi135 ceph-mon[34789]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-09-10T22:17:51.629 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:17:51 smithi135 ceph-mon[34789]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-09-10T22:17:51.629 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:17:51 smithi135 ceph-mon[34789]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-09-10T22:17:51.629 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:17:51 smithi135 ceph-mon[34789]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-09-10T22:17:51.629 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:17:51 smithi135 ceph-mon[34789]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-09-10T22:17:51.629 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:17:51 smithi135 ceph-mon[34789]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-09-10T22:17:51.630 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:17:51 smithi135 ceph-mon[34789]: rocksdb: Options.compression_opts.window_bits: -14 2024-09-10T22:17:51.630 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:17:51 smithi135 ceph-mon[34789]: rocksdb: Options.compression_opts.level: 32767 2024-09-10T22:17:51.630 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:17:51 smithi135 ceph-mon[34789]: rocksdb: Options.compression_opts.strategy: 0 2024-09-10T22:17:51.630 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:17:51 smithi135 ceph-mon[34789]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-09-10T22:17:51.630 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:17:51 smithi135 ceph-mon[34789]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-09-10T22:17:51.630 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:17:51 smithi135 ceph-mon[34789]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-09-10T22:17:51.630 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:17:51 smithi135 ceph-mon[34789]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-09-10T22:17:51.630 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:17:51 smithi135 ceph-mon[34789]: rocksdb: Options.compression_opts.enabled: false 2024-09-10T22:17:51.630 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:17:51 smithi135 ceph-mon[34789]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-09-10T22:17:51.631 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:17:51 smithi135 ceph-mon[34789]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-09-10T22:17:51.631 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:17:51 smithi135 ceph-mon[34789]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-09-10T22:17:51.631 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:17:51 smithi135 ceph-mon[34789]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-09-10T22:17:51.631 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:17:51 smithi135 ceph-mon[34789]: rocksdb: Options.target_file_size_base: 67108864 2024-09-10T22:17:51.631 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:17:51 smithi135 ceph-mon[34789]: rocksdb: Options.target_file_size_multiplier: 1 2024-09-10T22:17:51.631 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:17:51 smithi135 ceph-mon[34789]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-09-10T22:17:51.631 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:17:51 smithi135 ceph-mon[34789]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-09-10T22:17:51.631 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:17:51 smithi135 ceph-mon[34789]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-09-10T22:17:51.631 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:17:51 smithi135 ceph-mon[34789]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-09-10T22:17:51.631 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:17:51 smithi135 ceph-mon[34789]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-09-10T22:17:51.631 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:17:51 smithi135 ceph-mon[34789]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-09-10T22:17:51.632 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:17:51 smithi135 ceph-mon[34789]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-09-10T22:17:51.632 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:17:51 smithi135 ceph-mon[34789]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-09-10T22:17:51.632 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:17:51 smithi135 ceph-mon[34789]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-09-10T22:17:51.632 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:17:51 smithi135 ceph-mon[34789]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-09-10T22:17:51.632 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:17:51 smithi135 ceph-mon[34789]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-09-10T22:17:51.632 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:17:51 smithi135 ceph-mon[34789]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-09-10T22:17:51.632 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:17:51 smithi135 ceph-mon[34789]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-09-10T22:17:51.632 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:17:51 smithi135 ceph-mon[34789]: rocksdb: Options.arena_block_size: 1048576 2024-09-10T22:17:51.632 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:17:51 smithi135 ceph-mon[34789]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-09-10T22:17:51.632 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:17:51 smithi135 ceph-mon[34789]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-09-10T22:17:51.633 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:17:51 smithi135 ceph-mon[34789]: rocksdb: Options.disable_auto_compactions: 0 2024-09-10T22:17:51.633 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:17:51 smithi135 ceph-mon[34789]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-09-10T22:17:51.633 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:17:51 smithi135 ceph-mon[34789]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-09-10T22:17:51.633 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:17:51 smithi135 ceph-mon[34789]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-09-10T22:17:51.633 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:17:51 smithi135 ceph-mon[34789]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-09-10T22:17:51.633 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:17:51 smithi135 ceph-mon[34789]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-09-10T22:17:51.633 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:17:51 smithi135 ceph-mon[34789]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-09-10T22:17:51.633 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:17:51 smithi135 ceph-mon[34789]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-09-10T22:17:51.633 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:17:51 smithi135 ceph-mon[34789]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-09-10T22:17:51.634 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:17:51 smithi135 ceph-mon[34789]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-09-10T22:17:51.634 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:17:51 smithi135 ceph-mon[34789]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-09-10T22:17:51.634 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:17:51 smithi135 ceph-mon[34789]: rocksdb: Options.table_properties_collectors: CompactOnDeletionCollector (Sliding window size = 32768 Deletion trigger = 16384 Deletion ratio = 0); 2024-09-10T22:17:51.634 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:17:51 smithi135 ceph-mon[34789]: rocksdb: Options.inplace_update_support: 0 2024-09-10T22:17:51.634 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:17:51 smithi135 ceph-mon[34789]: rocksdb: Options.inplace_update_num_locks: 10000 2024-09-10T22:17:51.634 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:17:51 smithi135 ceph-mon[34789]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-09-10T22:17:51.635 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:17:51 smithi135 ceph-mon[34789]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-09-10T22:17:51.635 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:17:51 smithi135 ceph-mon[34789]: rocksdb: Options.memtable_huge_page_size: 0 2024-09-10T22:17:51.635 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:17:51 smithi135 ceph-mon[34789]: rocksdb: Options.bloom_locality: 0 2024-09-10T22:17:51.635 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:17:51 smithi135 ceph-mon[34789]: rocksdb: Options.max_successive_merges: 0 2024-09-10T22:17:51.635 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:17:51 smithi135 ceph-mon[34789]: rocksdb: Options.optimize_filters_for_hits: 0 2024-09-10T22:17:51.635 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:17:51 smithi135 ceph-mon[34789]: rocksdb: Options.paranoid_file_checks: 0 2024-09-10T22:17:51.635 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:17:51 smithi135 ceph-mon[34789]: rocksdb: Options.force_consistency_checks: 1 2024-09-10T22:17:51.635 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:17:51 smithi135 ceph-mon[34789]: rocksdb: Options.report_bg_io_stats: 0 2024-09-10T22:17:51.635 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:17:51 smithi135 ceph-mon[34789]: rocksdb: Options.ttl: 2592000 2024-09-10T22:17:51.635 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:17:51 smithi135 ceph-mon[34789]: rocksdb: Options.periodic_compaction_seconds: 0 2024-09-10T22:17:51.635 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:17:51 smithi135 ceph-mon[34789]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-09-10T22:17:51.635 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:17:51 smithi135 ceph-mon[34789]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-09-10T22:17:51.635 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:17:51 smithi135 ceph-mon[34789]: rocksdb: Options.enable_blob_files: false 2024-09-10T22:17:51.636 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:17:51 smithi135 ceph-mon[34789]: rocksdb: Options.min_blob_size: 0 2024-09-10T22:17:51.637 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:17:51 smithi135 ceph-mon[34789]: rocksdb: Options.blob_file_size: 268435456 2024-09-10T22:17:51.637 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:17:51 smithi135 ceph-mon[34789]: rocksdb: Options.blob_compression_type: NoCompression 2024-09-10T22:17:51.637 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:17:51 smithi135 ceph-mon[34789]: rocksdb: Options.enable_blob_garbage_collection: false 2024-09-10T22:17:51.637 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:17:51 smithi135 ceph-mon[34789]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-09-10T22:17:51.637 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:17:51 smithi135 ceph-mon[34789]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-09-10T22:17:51.637 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:17:51 smithi135 ceph-mon[34789]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-09-10T22:17:51.637 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:17:51 smithi135 ceph-mon[34789]: rocksdb: Options.blob_file_starting_level: 0 2024-09-10T22:17:51.637 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:17:51 smithi135 ceph-mon[34789]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-09-10T22:17:51.637 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:17:51 smithi135 ceph-mon[34789]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-b/store.db/MANIFEST-000005 succeeded,manifest_file_number is 5, next_file_number is 7, last_sequence is 0, log_number is 0,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2024-09-10T22:17:51.637 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:17:51 smithi135 ceph-mon[34789]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 0 2024-09-10T22:17:51.637 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:17:51 smithi135 ceph-mon[34789]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: 3e204adb-9be2-4c39-91aa-cdba6b8e8d7f 2024-09-10T22:17:51.637 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:17:51 smithi135 ceph-mon[34789]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726006671199187, "job": 1, "event": "recovery_started", "wal_files": [4]} 2024-09-10T22:17:51.638 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:17:51 smithi135 ceph-mon[34789]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #4 mode 2 2024-09-10T22:17:51.638 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:17:51 smithi135 ceph-mon[34789]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726006671199581, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 8, "file_size": 1773, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 1, "largest_seqno": 5, "table_properties": {"data_size": 648, "index_size": 31, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 69, "raw_key_size": 115, "raw_average_key_size": 23, "raw_value_size": 526, "raw_average_value_size": 105, "num_data_blocks": 1, "num_entries": 5, "num_filter_entries": 5, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[CompactOnDeletionCollector]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1726006671, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "3e204adb-9be2-4c39-91aa-cdba6b8e8d7f", "db_session_id": "N1MF74TDKLYJTMEYM3IV", "orig_file_number": 8, "seqno_to_time_mapping": "N/A"}} 2024-09-10T22:17:51.638 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:17:51 smithi135 ceph-mon[34789]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726006671199674, "job": 1, "event": "recovery_finished"} 2024-09-10T22:17:51.638 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:17:51 smithi135 ceph-mon[34789]: rocksdb: [db/version_set.cc:5047] Creating manifest 10 2024-09-10T22:17:51.638 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:17:51 smithi135 ceph-mon[34789]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-b/store.db/000004.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-09-10T22:17:51.638 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:17:51 smithi135 ceph-mon[34789]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x5630c5c7ce00 2024-09-10T22:17:51.638 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:17:51 smithi135 ceph-mon[34789]: rocksdb: DB pointer 0x5630c5d7e000 2024-09-10T22:17:51.638 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:17:51 smithi135 ceph-mon[34789]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-09-10T22:17:51.638 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:17:51 smithi135 ceph-mon[34789]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-09-10T22:17:51.638 INFO:journalctl@ceph.mon.b.smithi135.stdout: ** DB Stats ** 2024-09-10T22:17:51.638 INFO:journalctl@ceph.mon.b.smithi135.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-10T22:17:51.638 INFO:journalctl@ceph.mon.b.smithi135.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-09-10T22:17:51.638 INFO:journalctl@ceph.mon.b.smithi135.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-10T22:17:51.639 INFO:journalctl@ceph.mon.b.smithi135.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-10T22:17:51.639 INFO:journalctl@ceph.mon.b.smithi135.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-09-10T22:17:51.639 INFO:journalctl@ceph.mon.b.smithi135.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-10T22:17:51.639 INFO:journalctl@ceph.mon.b.smithi135.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-10T22:17:51.639 INFO:journalctl@ceph.mon.b.smithi135.stdout: 2024-09-10T22:17:51.639 INFO:journalctl@ceph.mon.b.smithi135.stdout: ** Compaction Stats [default] ** 2024-09-10T22:17:51.639 INFO:journalctl@ceph.mon.b.smithi135.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-10T22:17:51.639 INFO:journalctl@ceph.mon.b.smithi135.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-09-10T22:17:51.639 INFO:journalctl@ceph.mon.b.smithi135.stdout: L0 1/0 1.73 KB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 4.4 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-09-10T22:17:51.639 INFO:journalctl@ceph.mon.b.smithi135.stdout: Sum 1/0 1.73 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 4.4 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-09-10T22:17:51.639 INFO:journalctl@ceph.mon.b.smithi135.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 4.4 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-09-10T22:17:51.639 INFO:journalctl@ceph.mon.b.smithi135.stdout: 2024-09-10T22:17:51.639 INFO:journalctl@ceph.mon.b.smithi135.stdout: ** Compaction Stats [default] ** 2024-09-10T22:17:51.639 INFO:journalctl@ceph.mon.b.smithi135.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-10T22:17:51.640 INFO:journalctl@ceph.mon.b.smithi135.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-09-10T22:17:51.640 INFO:journalctl@ceph.mon.b.smithi135.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 4.4 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-09-10T22:17:51.640 INFO:journalctl@ceph.mon.b.smithi135.stdout: 2024-09-10T22:17:51.640 INFO:journalctl@ceph.mon.b.smithi135.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-09-10T22:17:51.640 INFO:journalctl@ceph.mon.b.smithi135.stdout: 2024-09-10T22:17:51.640 INFO:journalctl@ceph.mon.b.smithi135.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-10T22:17:51.640 INFO:journalctl@ceph.mon.b.smithi135.stdout: Flush(GB): cumulative 0.000, interval 0.000 2024-09-10T22:17:51.640 INFO:journalctl@ceph.mon.b.smithi135.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-09-10T22:17:51.640 INFO:journalctl@ceph.mon.b.smithi135.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-09-10T22:17:51.640 INFO:journalctl@ceph.mon.b.smithi135.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-09-10T22:17:51.640 INFO:journalctl@ceph.mon.b.smithi135.stdout: AddFile(Keys): cumulative 0, interval 0 2024-09-10T22:17:51.640 INFO:journalctl@ceph.mon.b.smithi135.stdout: Cumulative compaction: 0.00 GB write, 0.63 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-10T22:17:51.640 INFO:journalctl@ceph.mon.b.smithi135.stdout: Interval compaction: 0.00 GB write, 0.63 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-10T22:17:51.641 INFO:journalctl@ceph.mon.b.smithi135.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-09-10T22:17:51.641 INFO:journalctl@ceph.mon.b.smithi135.stdout: Block cache BinnedLRUCache@0x5630c5c4d610#2 capacity: 512.00 MB usage: 0.22 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 9e-06 secs_since: 0 2024-09-10T22:17:51.641 INFO:journalctl@ceph.mon.b.smithi135.stdout: Block cache entry stats(count,size,portion): FilterBlock(1,0.11 KB,2.08616e-05%) IndexBlock(1,0.11 KB,2.08616e-05%) Misc(1,0.00 KB,0%) 2024-09-10T22:17:51.641 INFO:journalctl@ceph.mon.b.smithi135.stdout: 2024-09-10T22:17:51.641 INFO:journalctl@ceph.mon.b.smithi135.stdout: ** File Read Latency Histogram By Level [default] ** 2024-09-10T22:17:51.641 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:17:51 smithi135 ceph-mon[34789]: mon.b does not exist in monmap, will attempt to join an existing cluster 2024-09-10T22:17:51.641 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:17:51 smithi135 ceph-mon[34789]: using public_addr v2:172.21.15.135:0/0 -> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] 2024-09-10T22:17:51.641 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:17:51 smithi135 ceph-mon[34789]: starting mon.b rank -1 at public addrs [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] at bind addrs [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon_data /var/lib/ceph/mon/ceph-b fsid 22997a4c-6fc2-11ef-bcea-c7b262605968 2024-09-10T22:17:51.641 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:17:51 smithi135 ceph-mon[34789]: mon.b@-1(???) e0 preinit fsid 22997a4c-6fc2-11ef-bcea-c7b262605968 2024-09-10T22:17:51.641 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:17:51 smithi135 ceph-mon[34789]: mon.b@-1(synchronizing).mds e1 new map 2024-09-10T22:17:51.641 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:17:51 smithi135 ceph-mon[34789]: mon.b@-1(synchronizing).mds e1 print_map 2024-09-10T22:17:51.641 INFO:journalctl@ceph.mon.b.smithi135.stdout: e1 2024-09-10T22:17:51.641 INFO:journalctl@ceph.mon.b.smithi135.stdout: btime 2024-09-10T22:16:16:754503+0000 2024-09-10T22:17:51.641 INFO:journalctl@ceph.mon.b.smithi135.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-09-10T22:17:51.642 INFO:journalctl@ceph.mon.b.smithi135.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-10T22:17:51.642 INFO:journalctl@ceph.mon.b.smithi135.stdout: legacy client fscid: -1 2024-09-10T22:17:51.642 INFO:journalctl@ceph.mon.b.smithi135.stdout: 2024-09-10T22:17:51.642 INFO:journalctl@ceph.mon.b.smithi135.stdout: No filesystems configured 2024-09-10T22:17:51.642 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:17:51 smithi135 ceph-mon[34789]: mon.b@-1(synchronizing).osd e0 _set_cache_ratios kv ratio 0.25 inc ratio 0.375 full ratio 0.375 2024-09-10T22:17:51.642 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:17:51 smithi135 ceph-mon[34789]: mon.b@-1(synchronizing).osd e0 register_cache_with_pcm pcm target: 2147483648 pcm max: 1020054732 pcm min: 134217728 inc_osd_cache size: 1 2024-09-10T22:17:51.642 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:17:51 smithi135 ceph-mon[34789]: mon.b@-1(synchronizing).osd e1 e1: 0 total, 0 up, 0 in 2024-09-10T22:17:51.642 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:17:51 smithi135 ceph-mon[34789]: mon.b@-1(synchronizing).osd e2 e2: 0 total, 0 up, 0 in 2024-09-10T22:17:51.642 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:17:51 smithi135 ceph-mon[34789]: mon.b@-1(synchronizing).osd e3 e3: 0 total, 0 up, 0 in 2024-09-10T22:17:51.642 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:17:51 smithi135 ceph-mon[34789]: mon.b@-1(synchronizing).osd e4 e4: 0 total, 0 up, 0 in 2024-09-10T22:17:51.642 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:17:51 smithi135 ceph-mon[34789]: mon.b@-1(synchronizing).osd e4 crush map has features 3314932999778484224, adjusting msgr requires 2024-09-10T22:17:51.642 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:17:51 smithi135 ceph-mon[34789]: mon.b@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-09-10T22:17:51.642 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:17:51 smithi135 ceph-mon[34789]: mon.b@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-09-10T22:17:51.642 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:17:51 smithi135 ceph-mon[34789]: mon.b@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-09-10T22:17:51.643 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:17:51 smithi135 ceph-mon[34789]: Updating smithi135:/etc/ceph/ceph.conf 2024-09-10T22:17:51.643 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:17:51 smithi135 ceph-mon[34789]: Updating smithi135:/var/lib/ceph/22997a4c-6fc2-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-10T22:17:51.643 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:17:51 smithi135 ceph-mon[34789]: Deploying cephadm binary to smithi138 2024-09-10T22:17:51.643 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:17:51 smithi135 ceph-mon[34789]: Updating smithi135:/etc/ceph/ceph.client.admin.keyring 2024-09-10T22:17:51.643 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:17:51 smithi135 ceph-mon[34789]: Updating smithi135:/var/lib/ceph/22997a4c-6fc2-11ef-bcea-c7b262605968/config/ceph.client.admin.keyring 2024-09-10T22:17:51.643 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:17:51 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:17:51.643 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:17:51 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:17:51.643 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:17:51 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:17:51.643 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:17:51 smithi135 ceph-mon[34789]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T22:17:51.643 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:17:51 smithi135 ceph-mon[34789]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T22:17:51.643 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:17:51 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:17:51.643 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:17:51 smithi135 ceph-mon[34789]: Added host smithi138 2024-09-10T22:17:51.643 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:17:51 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T22:17:51.643 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:17:51 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:17:51.644 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:17:51 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:17:51.644 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:17:51 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:17:51.644 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:17:51 smithi135 ceph-mon[34789]: from='client.14184 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-10T22:17:51.644 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:17:51 smithi135 ceph-mon[34789]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T22:17:51.644 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:17:51 smithi135 ceph-mon[34789]: from='client.? 172.21.15.19:0/157858144' entity='client.admin' cmd={"prefix": "osd crush tunables", "profile": "default"} : dispatch 2024-09-10T22:17:51.644 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:17:51 smithi135 ceph-mon[34789]: from='client.? 172.21.15.19:0/157858144' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2024-09-10T22:17:51.644 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:17:51 smithi135 ceph-mon[34789]: osdmap e4: 0 total, 0 up, 0 in 2024-09-10T22:17:51.644 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:17:51 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:17:51.644 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:17:51 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:17:51.644 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:17:51 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:17:51.644 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:17:51 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:17:51.644 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:17:51 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:smithi138", "name": "osd_memory_target"} : dispatch 2024-09-10T22:17:51.644 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:17:51 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T22:17:51.645 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:17:51 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T22:17:51.645 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:17:51 smithi135 ceph-mon[34789]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T22:17:51.645 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:17:51 smithi135 ceph-mon[34789]: Updating smithi138:/etc/ceph/ceph.conf 2024-09-10T22:17:51.645 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:17:51 smithi135 ceph-mon[34789]: Updating smithi138:/var/lib/ceph/22997a4c-6fc2-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-10T22:17:51.645 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:17:51 smithi135 ceph-mon[34789]: Updating smithi138:/etc/ceph/ceph.client.admin.keyring 2024-09-10T22:17:51.645 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:17:51 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:17:51.645 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:17:51 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:17:51.645 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:17:51 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:17:51.645 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:17:51 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:17:51.645 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:17:51 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-10T22:17:51.645 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:17:51 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T22:17:51.645 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:17:51 smithi135 ceph-mon[34789]: Updating smithi138:/var/lib/ceph/22997a4c-6fc2-11ef-bcea-c7b262605968/config/ceph.client.admin.keyring 2024-09-10T22:17:51.645 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:17:51 smithi135 ceph-mon[34789]: from='client.14188 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi019:172.21.15.19=a;smithi135:172.21.15.135=b;smithi138:172.21.15.138=c", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T22:17:51.645 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:17:51 smithi135 ceph-mon[34789]: Saving service mon spec with placement smithi019:172.21.15.19=a;smithi135:172.21.15.135=b;smithi138:172.21.15.138=c;count:3 2024-09-10T22:17:51.646 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:17:51 smithi135 ceph-mon[34789]: Deploying daemon mon.c on smithi138 2024-09-10T22:17:51.646 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:17:51 smithi135 ceph-mon[34789]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T22:17:51.646 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:17:51 smithi135 ceph-mon[34789]: from='client.? 172.21.15.138:0/810989887' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2024-09-10T22:17:51.646 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:17:51 smithi135 ceph-mon[34789]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T22:17:51.646 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:17:51 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-10T22:17:51.646 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:17:51 smithi135 ceph-mon[34789]: mon.a calling monitor election 2024-09-10T22:17:51.646 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:17:51 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-10T22:17:51.646 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:17:51 smithi135 ceph-mon[34789]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T22:17:51.646 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:17:51 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-10T22:17:51.646 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:17:51 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-10T22:17:51.646 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:17:51 smithi135 ceph-mon[34789]: mon.c calling monitor election 2024-09-10T22:17:51.646 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:17:51 smithi135 ceph-mon[34789]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T22:17:51.646 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:17:51 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-10T22:17:51.646 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:17:51 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-10T22:17:51.647 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:17:51 smithi135 ceph-mon[34789]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T22:17:51.647 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:17:51 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-10T22:17:51.647 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:17:51 smithi135 ceph-mon[34789]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-09-10T22:17:51.647 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:17:51 smithi135 ceph-mon[34789]: monmap epoch 2 2024-09-10T22:17:51.647 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:17:51 smithi135 ceph-mon[34789]: fsid 22997a4c-6fc2-11ef-bcea-c7b262605968 2024-09-10T22:17:51.647 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:17:51 smithi135 ceph-mon[34789]: last_changed 2024-09-10T22:17:42.168945+0000 2024-09-10T22:17:51.647 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:17:51 smithi135 ceph-mon[34789]: created 2024-09-10T22:16:13.471813+0000 2024-09-10T22:17:51.647 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:17:51 smithi135 ceph-mon[34789]: min_mon_release 19 (squid) 2024-09-10T22:17:51.647 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:17:51 smithi135 ceph-mon[34789]: election_strategy: 1 2024-09-10T22:17:51.647 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:17:51 smithi135 ceph-mon[34789]: 0: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.a 2024-09-10T22:17:51.647 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:17:51 smithi135 ceph-mon[34789]: 1: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.c 2024-09-10T22:17:51.647 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:17:51 smithi135 ceph-mon[34789]: fsmap 2024-09-10T22:17:51.647 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:17:51 smithi135 ceph-mon[34789]: osdmap e4: 0 total, 0 up, 0 in 2024-09-10T22:17:51.647 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:17:51 smithi135 ceph-mon[34789]: mgrmap e13: x(active, since 42s) 2024-09-10T22:17:51.648 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:17:51 smithi135 ceph-mon[34789]: overall HEALTH_OK 2024-09-10T22:17:51.648 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:17:51 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:17:51.648 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:17:51 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:17:51.648 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:17:51 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:17:51.648 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:17:51 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-10T22:17:51.648 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:17:51 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T22:17:51.648 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:17:51 smithi135 ceph-mon[34789]: Deploying daemon mon.b on smithi135 2024-09-10T22:17:51.648 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:17:51 smithi135 ceph-mon[34789]: from='client.? 172.21.15.138:0/2719083019' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2024-09-10T22:17:51.648 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:17:51 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-10T22:17:51.648 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:17:51 smithi135 ceph-mon[34789]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T22:17:51.648 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:17:51 smithi135 ceph-mon[34789]: from='client.? 172.21.15.138:0/3019757109' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2024-09-10T22:17:51.649 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:17:51 smithi135 ceph-mon[34789]: mon.b@-1(synchronizing).paxosservice(auth 1..3) refresh upgraded, format 0 -> 3 2024-09-10T22:17:51.649 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:17:51 smithi135 bash[34770]: b8f7a223e8ed8c8196684e732e2178476905cf697d319725b981304214965ade 2024-09-10T22:17:51.649 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:17:51 smithi135 systemd[1]: Started Ceph mon.b for 22997a4c-6fc2-11ef-bcea-c7b262605968. 2024-09-10T22:17:51.784 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-09-10T22:17:51.785 DEBUG:teuthology.orchestra.run.smithi138:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 22997a4c-6fc2-11ef-bcea-c7b262605968 -- ceph mon dump -f json 2024-09-10T22:17:52.034 INFO:teuthology.orchestra.run.smithi138.stderr:Inferring config /var/lib/ceph/22997a4c-6fc2-11ef-bcea-c7b262605968/mon.c/config 2024-09-10T22:17:56.610 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:17:56 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-10T22:17:56.610 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:17:56 smithi135 ceph-mon[34789]: mon.a calling monitor election 2024-09-10T22:17:56.610 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:17:56 smithi135 ceph-mon[34789]: mon.c calling monitor election 2024-09-10T22:17:56.610 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:17:56 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-10T22:17:56.610 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:17:56 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-10T22:17:56.610 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:17:56 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-10T22:17:56.611 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:17:56 smithi135 ceph-mon[34789]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T22:17:56.611 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:17:56 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-10T22:17:56.611 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:17:56 smithi135 ceph-mon[34789]: mon.b calling monitor election 2024-09-10T22:17:56.611 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:17:56 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-10T22:17:56.611 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:17:56 smithi135 ceph-mon[34789]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T22:17:56.611 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:17:56 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-10T22:17:56.611 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:17:56 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-10T22:17:56.611 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:17:56 smithi135 ceph-mon[34789]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-09-10T22:17:56.611 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:17:56 smithi135 ceph-mon[34789]: monmap epoch 3 2024-09-10T22:17:56.611 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:17:56 smithi135 ceph-mon[34789]: fsid 22997a4c-6fc2-11ef-bcea-c7b262605968 2024-09-10T22:17:56.611 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:17:56 smithi135 ceph-mon[34789]: last_changed 2024-09-10T22:17:51.224606+0000 2024-09-10T22:17:56.611 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:17:56 smithi135 ceph-mon[34789]: created 2024-09-10T22:16:13.471813+0000 2024-09-10T22:17:56.611 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:17:56 smithi135 ceph-mon[34789]: min_mon_release 19 (squid) 2024-09-10T22:17:56.612 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:17:56 smithi135 ceph-mon[34789]: election_strategy: 1 2024-09-10T22:17:56.612 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:17:56 smithi135 ceph-mon[34789]: 0: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.a 2024-09-10T22:17:56.612 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:17:56 smithi135 ceph-mon[34789]: 1: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.c 2024-09-10T22:17:56.612 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:17:56 smithi135 ceph-mon[34789]: 2: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.b 2024-09-10T22:17:56.612 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:17:56 smithi135 ceph-mon[34789]: fsmap 2024-09-10T22:17:56.612 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:17:56 smithi135 ceph-mon[34789]: osdmap e4: 0 total, 0 up, 0 in 2024-09-10T22:17:56.612 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:17:56 smithi135 ceph-mon[34789]: mgrmap e13: x(active, since 51s) 2024-09-10T22:17:56.612 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:17:56 smithi135 ceph-mon[34789]: overall HEALTH_OK 2024-09-10T22:17:56.612 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:17:56 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:17:56.612 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:17:56 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:17:56.612 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:17:56 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:17:56.612 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:17:56 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:17:56.625 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:17:56 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-10T22:17:56.625 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:17:56 smithi138 ceph-mon[35236]: mon.a calling monitor election 2024-09-10T22:17:56.626 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:17:56 smithi138 ceph-mon[35236]: mon.c calling monitor election 2024-09-10T22:17:56.626 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:17:56 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-10T22:17:56.626 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:17:56 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-10T22:17:56.626 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:17:56 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-10T22:17:56.626 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:17:56 smithi138 ceph-mon[35236]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T22:17:56.626 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:17:56 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-10T22:17:56.626 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:17:56 smithi138 ceph-mon[35236]: mon.b calling monitor election 2024-09-10T22:17:56.626 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:17:56 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-10T22:17:56.626 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:17:56 smithi138 ceph-mon[35236]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T22:17:56.626 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:17:56 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-10T22:17:56.626 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:17:56 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-10T22:17:56.626 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:17:56 smithi138 ceph-mon[35236]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-09-10T22:17:56.626 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:17:56 smithi138 ceph-mon[35236]: monmap epoch 3 2024-09-10T22:17:56.627 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:17:56 smithi138 ceph-mon[35236]: fsid 22997a4c-6fc2-11ef-bcea-c7b262605968 2024-09-10T22:17:56.627 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:17:56 smithi138 ceph-mon[35236]: last_changed 2024-09-10T22:17:51.224606+0000 2024-09-10T22:17:56.627 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:17:56 smithi138 ceph-mon[35236]: created 2024-09-10T22:16:13.471813+0000 2024-09-10T22:17:56.627 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:17:56 smithi138 ceph-mon[35236]: min_mon_release 19 (squid) 2024-09-10T22:17:56.627 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:17:56 smithi138 ceph-mon[35236]: election_strategy: 1 2024-09-10T22:17:56.627 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:17:56 smithi138 ceph-mon[35236]: 0: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.a 2024-09-10T22:17:56.627 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:17:56 smithi138 ceph-mon[35236]: 1: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.c 2024-09-10T22:17:56.627 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:17:56 smithi138 ceph-mon[35236]: 2: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.b 2024-09-10T22:17:56.627 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:17:56 smithi138 ceph-mon[35236]: fsmap 2024-09-10T22:17:56.627 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:17:56 smithi138 ceph-mon[35236]: osdmap e4: 0 total, 0 up, 0 in 2024-09-10T22:17:56.628 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:17:56 smithi138 ceph-mon[35236]: mgrmap e13: x(active, since 51s) 2024-09-10T22:17:56.628 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:17:56 smithi138 ceph-mon[35236]: overall HEALTH_OK 2024-09-10T22:17:56.628 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:17:56 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:17:56.628 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:17:56 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:17:56.628 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:17:56 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:17:56.628 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:17:56 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:17:56.709 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:17:56 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-10T22:17:56.709 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:17:56 smithi019 ceph-mon[31375]: mon.a calling monitor election 2024-09-10T22:17:56.709 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:17:56 smithi019 ceph-mon[31375]: mon.c calling monitor election 2024-09-10T22:17:56.709 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:17:56 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-10T22:17:56.709 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:17:56 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-10T22:17:56.709 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:17:56 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-10T22:17:56.710 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:17:56 smithi019 ceph-mon[31375]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T22:17:56.710 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:17:56 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-10T22:17:56.710 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:17:56 smithi019 ceph-mon[31375]: mon.b calling monitor election 2024-09-10T22:17:56.710 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:17:56 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-10T22:17:56.710 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:17:56 smithi019 ceph-mon[31375]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T22:17:56.710 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:17:56 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-10T22:17:56.710 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:17:56 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-10T22:17:56.710 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:17:56 smithi019 ceph-mon[31375]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-09-10T22:17:56.710 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:17:56 smithi019 ceph-mon[31375]: monmap epoch 3 2024-09-10T22:17:56.710 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:17:56 smithi019 ceph-mon[31375]: fsid 22997a4c-6fc2-11ef-bcea-c7b262605968 2024-09-10T22:17:56.710 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:17:56 smithi019 ceph-mon[31375]: last_changed 2024-09-10T22:17:51.224606+0000 2024-09-10T22:17:56.711 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:17:56 smithi019 ceph-mon[31375]: created 2024-09-10T22:16:13.471813+0000 2024-09-10T22:17:56.711 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:17:56 smithi019 ceph-mon[31375]: min_mon_release 19 (squid) 2024-09-10T22:17:56.711 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:17:56 smithi019 ceph-mon[31375]: election_strategy: 1 2024-09-10T22:17:56.711 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:17:56 smithi019 ceph-mon[31375]: 0: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.a 2024-09-10T22:17:56.711 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:17:56 smithi019 ceph-mon[31375]: 1: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.c 2024-09-10T22:17:56.711 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:17:56 smithi019 ceph-mon[31375]: 2: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.b 2024-09-10T22:17:56.711 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:17:56 smithi019 ceph-mon[31375]: fsmap 2024-09-10T22:17:56.711 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:17:56 smithi019 ceph-mon[31375]: osdmap e4: 0 total, 0 up, 0 in 2024-09-10T22:17:56.711 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:17:56 smithi019 ceph-mon[31375]: mgrmap e13: x(active, since 51s) 2024-09-10T22:17:56.711 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:17:56 smithi019 ceph-mon[31375]: overall HEALTH_OK 2024-09-10T22:17:56.711 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:17:56 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:17:56.711 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:17:56 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:17:56.711 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:17:56 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:17:56.711 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:17:56 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:17:57.144 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-10T22:17:57.144 INFO:teuthology.orchestra.run.smithi138.stdout:{"epoch":3,"fsid":"22997a4c-6fc2-11ef-bcea-c7b262605968","modified":"2024-09-10T22:17:51.224606Z","created":"2024-09-10T22:16:13.471813Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:3300","nonce":0},{"type":"v1","addr":"172.21.15.19:6789","nonce":0}]},"addr":"172.21.15.19:6789/0","public_addr":"172.21.15.19:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:3300","nonce":0},{"type":"v1","addr":"172.21.15.138:6789","nonce":0}]},"addr":"172.21.15.138:6789/0","public_addr":"172.21.15.138:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:3300","nonce":0},{"type":"v1","addr":"172.21.15.135:6789","nonce":0}]},"addr":"172.21.15.135:6789/0","public_addr":"172.21.15.135:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1,2]} 2024-09-10T22:17:57.145 INFO:teuthology.orchestra.run.smithi138.stderr:dumped monmap epoch 3 2024-09-10T22:17:57.610 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:17:57 smithi135 ceph-mon[34789]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T22:17:57.610 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:17:57 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T22:17:57.610 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:17:57 smithi135 ceph-mon[34789]: from='client.? 172.21.15.138:0/100149629' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2024-09-10T22:17:57.610 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:17:57 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-10T22:17:57.625 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:17:57 smithi138 ceph-mon[35236]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T22:17:57.625 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:17:57 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T22:17:57.625 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:17:57 smithi138 ceph-mon[35236]: from='client.? 172.21.15.138:0/100149629' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2024-09-10T22:17:57.625 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:17:57 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-10T22:17:57.709 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:17:57 smithi019 ceph-mon[31375]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T22:17:57.709 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:17:57 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T22:17:57.709 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:17:57 smithi019 ceph-mon[31375]: from='client.? 172.21.15.138:0/100149629' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2024-09-10T22:17:57.709 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:17:57 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-10T22:17:58.024 INFO:tasks.cephadm:Generating final ceph.conf file... 2024-09-10T22:17:58.024 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 22997a4c-6fc2-11ef-bcea-c7b262605968 -- ceph config generate-minimal-conf 2024-09-10T22:17:58.282 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/22997a4c-6fc2-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T22:17:58.584 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:17:58 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:17:58.584 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:17:58 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:17:58.584 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:17:58 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:17:58.584 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:17:58 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:17:58.584 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:17:58 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T22:17:58.584 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:17:58 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T22:17:58.584 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:17:58 smithi019 ceph-mon[31375]: Updating smithi019:/etc/ceph/ceph.conf 2024-09-10T22:17:58.584 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:17:58 smithi019 ceph-mon[31375]: Updating smithi135:/etc/ceph/ceph.conf 2024-09-10T22:17:58.584 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:17:58 smithi019 ceph-mon[31375]: Updating smithi138:/etc/ceph/ceph.conf 2024-09-10T22:17:58.585 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:17:58 smithi019 ceph-mon[31375]: Updating smithi135:/var/lib/ceph/22997a4c-6fc2-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-10T22:17:58.585 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:17:58 smithi019 ceph-mon[31375]: Updating smithi138:/var/lib/ceph/22997a4c-6fc2-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-10T22:17:58.585 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:17:58 smithi019 ceph-mon[31375]: Updating smithi019:/var/lib/ceph/22997a4c-6fc2-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-10T22:17:58.585 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:17:58 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:17:58.585 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:17:58 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:17:58.585 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:17:58 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:17:58.585 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:17:58 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:17:58.585 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:17:58 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:17:58.585 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:17:58 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:17:58.585 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:17:58 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:17:58.585 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:17:58 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:17:58.585 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:17:58 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:17:58.585 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:17:58 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:17:58.586 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:17:58 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:17:58.586 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:17:58 smithi019 ceph-mon[31375]: Reconfiguring mon.a (unknown last config time)... 2024-09-10T22:17:58.586 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:17:58 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-10T22:17:58.586 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:17:58 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2024-09-10T22:17:58.586 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:17:58 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T22:17:58.586 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:17:58 smithi019 ceph-mon[31375]: Reconfiguring daemon mon.a on smithi019 2024-09-10T22:17:58.610 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:17:58 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:17:58.610 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:17:58 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:17:58.610 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:17:58 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:17:58.610 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:17:58 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:17:58.610 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:17:58 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T22:17:58.610 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:17:58 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T22:17:58.611 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:17:58 smithi135 ceph-mon[34789]: Updating smithi019:/etc/ceph/ceph.conf 2024-09-10T22:17:58.611 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:17:58 smithi135 ceph-mon[34789]: Updating smithi135:/etc/ceph/ceph.conf 2024-09-10T22:17:58.611 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:17:58 smithi135 ceph-mon[34789]: Updating smithi138:/etc/ceph/ceph.conf 2024-09-10T22:17:58.611 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:17:58 smithi135 ceph-mon[34789]: Updating smithi135:/var/lib/ceph/22997a4c-6fc2-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-10T22:17:58.611 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:17:58 smithi135 ceph-mon[34789]: Updating smithi138:/var/lib/ceph/22997a4c-6fc2-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-10T22:17:58.611 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:17:58 smithi135 ceph-mon[34789]: Updating smithi019:/var/lib/ceph/22997a4c-6fc2-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-10T22:17:58.611 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:17:58 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:17:58.611 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:17:58 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:17:58.611 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:17:58 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:17:58.611 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:17:58 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:17:58.611 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:17:58 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:17:58.612 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:17:58 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:17:58.612 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:17:58 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:17:58.612 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:17:58 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:17:58.612 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:17:58 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:17:58.612 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:17:58 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:17:58.612 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:17:58 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:17:58.612 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:17:58 smithi135 ceph-mon[34789]: Reconfiguring mon.a (unknown last config time)... 2024-09-10T22:17:58.612 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:17:58 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-10T22:17:58.612 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:17:58 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2024-09-10T22:17:58.612 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:17:58 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T22:17:58.612 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:17:58 smithi135 ceph-mon[34789]: Reconfiguring daemon mon.a on smithi019 2024-09-10T22:17:58.625 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:17:58 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:17:58.625 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:17:58 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:17:58.625 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:17:58 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:17:58.625 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:17:58 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:17:58.625 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:17:58 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T22:17:58.625 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:17:58 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T22:17:58.626 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:17:58 smithi138 ceph-mon[35236]: Updating smithi019:/etc/ceph/ceph.conf 2024-09-10T22:17:58.626 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:17:58 smithi138 ceph-mon[35236]: Updating smithi135:/etc/ceph/ceph.conf 2024-09-10T22:17:58.626 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:17:58 smithi138 ceph-mon[35236]: Updating smithi138:/etc/ceph/ceph.conf 2024-09-10T22:17:58.626 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:17:58 smithi138 ceph-mon[35236]: Updating smithi135:/var/lib/ceph/22997a4c-6fc2-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-10T22:17:58.626 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:17:58 smithi138 ceph-mon[35236]: Updating smithi138:/var/lib/ceph/22997a4c-6fc2-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-10T22:17:58.626 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:17:58 smithi138 ceph-mon[35236]: Updating smithi019:/var/lib/ceph/22997a4c-6fc2-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-10T22:17:58.626 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:17:58 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:17:58.626 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:17:58 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:17:58.626 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:17:58 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:17:58.626 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:17:58 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:17:58.626 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:17:58 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:17:58.626 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:17:58 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:17:58.627 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:17:58 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:17:58.627 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:17:58 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:17:58.627 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:17:58 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:17:58.627 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:17:58 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:17:58.627 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:17:58 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:17:58.627 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:17:58 smithi138 ceph-mon[35236]: Reconfiguring mon.a (unknown last config time)... 2024-09-10T22:17:58.627 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:17:58 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-10T22:17:58.627 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:17:58 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2024-09-10T22:17:58.627 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:17:58 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T22:17:58.627 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:17:58 smithi138 ceph-mon[35236]: Reconfiguring daemon mon.a on smithi019 2024-09-10T22:17:59.536 INFO:teuthology.orchestra.run.smithi019.stdout:# minimal ceph.conf for 22997a4c-6fc2-11ef-bcea-c7b262605968 2024-09-10T22:17:59.536 INFO:teuthology.orchestra.run.smithi019.stdout:[global] 2024-09-10T22:17:59.536 INFO:teuthology.orchestra.run.smithi019.stdout: fsid = 22997a4c-6fc2-11ef-bcea-c7b262605968 2024-09-10T22:17:59.536 INFO:teuthology.orchestra.run.smithi019.stdout: mon_host = [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] 2024-09-10T22:18:00.351 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:18:00 smithi135 ceph-mon[34789]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T22:18:00.351 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:18:00 smithi135 ceph-mon[34789]: from='client.? 172.21.15.19:0/1467579380' entity='client.admin' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T22:18:00.351 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:18:00 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:18:00.351 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:18:00 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:18:00.351 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:18:00 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:18:00.351 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:18:00 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-10T22:18:00.351 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:18:00 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2024-09-10T22:18:00.351 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:18:00 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T22:18:00.357 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:18:00 smithi019 ceph-mon[31375]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T22:18:00.357 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:18:00 smithi019 ceph-mon[31375]: from='client.? 172.21.15.19:0/1467579380' entity='client.admin' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T22:18:00.357 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:18:00 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:18:00.357 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:18:00 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:18:00.357 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:18:00 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:18:00.357 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:18:00 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-10T22:18:00.358 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:18:00 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2024-09-10T22:18:00.358 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:18:00 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T22:18:00.375 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:18:00 smithi138 ceph-mon[35236]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T22:18:00.375 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:18:00 smithi138 ceph-mon[35236]: from='client.? 172.21.15.19:0/1467579380' entity='client.admin' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T22:18:00.375 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:18:00 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:18:00.375 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:18:00 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:18:00.375 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:18:00 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:18:00.376 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:18:00 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-10T22:18:00.376 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:18:00 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2024-09-10T22:18:00.376 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:18:00 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T22:18:00.386 INFO:tasks.cephadm:Distributing (final) config and client.admin keyring... 2024-09-10T22:18:00.386 DEBUG:teuthology.orchestra.run.smithi019:> set -ex 2024-09-10T22:18:00.386 DEBUG:teuthology.orchestra.run.smithi019:> sudo dd of=/etc/ceph/ceph.conf 2024-09-10T22:18:00.415 DEBUG:teuthology.orchestra.run.smithi019:> set -ex 2024-09-10T22:18:00.415 DEBUG:teuthology.orchestra.run.smithi019:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-10T22:18:00.481 DEBUG:teuthology.orchestra.run.smithi135:> set -ex 2024-09-10T22:18:00.481 DEBUG:teuthology.orchestra.run.smithi135:> sudo dd of=/etc/ceph/ceph.conf 2024-09-10T22:18:00.509 DEBUG:teuthology.orchestra.run.smithi135:> set -ex 2024-09-10T22:18:00.510 DEBUG:teuthology.orchestra.run.smithi135:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-10T22:18:00.575 DEBUG:teuthology.orchestra.run.smithi138:> set -ex 2024-09-10T22:18:00.575 DEBUG:teuthology.orchestra.run.smithi138:> sudo dd of=/etc/ceph/ceph.conf 2024-09-10T22:18:00.606 DEBUG:teuthology.orchestra.run.smithi138:> set -ex 2024-09-10T22:18:00.607 DEBUG:teuthology.orchestra.run.smithi138:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-10T22:18:00.674 INFO:tasks.cephadm:Adding mgr.x on smithi019 2024-09-10T22:18:00.674 INFO:tasks.cephadm:Adding mgr.y on smithi135 2024-09-10T22:18:00.675 INFO:tasks.cephadm:Adding mgr.z on smithi138 2024-09-10T22:18:00.675 DEBUG:teuthology.orchestra.run.smithi138:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 22997a4c-6fc2-11ef-bcea-c7b262605968 -- ceph orch apply mgr '3;smithi019=x;smithi135=y;smithi138=z' 2024-09-10T22:18:00.957 INFO:teuthology.orchestra.run.smithi138.stderr:Inferring config /var/lib/ceph/22997a4c-6fc2-11ef-bcea-c7b262605968/mon.c/config 2024-09-10T22:18:01.308 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:18:01 smithi138 ceph-mon[35236]: Reconfiguring mon.b (monmap changed)... 2024-09-10T22:18:01.308 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:18:01 smithi138 ceph-mon[35236]: Reconfiguring daemon mon.b on smithi135 2024-09-10T22:18:01.308 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:18:01 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:18:01.308 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:18:01 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:18:01.308 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:18:01 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-10T22:18:01.309 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:18:01 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2024-09-10T22:18:01.309 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:18:01 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T22:18:01.360 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:18:01 smithi135 ceph-mon[34789]: Reconfiguring mon.b (monmap changed)... 2024-09-10T22:18:01.360 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:18:01 smithi135 ceph-mon[34789]: Reconfiguring daemon mon.b on smithi135 2024-09-10T22:18:01.360 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:18:01 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:18:01.360 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:18:01 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:18:01.360 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:18:01 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-10T22:18:01.360 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:18:01 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2024-09-10T22:18:01.360 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:18:01 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T22:18:01.458 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:18:01 smithi019 ceph-mon[31375]: Reconfiguring mon.b (monmap changed)... 2024-09-10T22:18:01.458 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:18:01 smithi019 ceph-mon[31375]: Reconfiguring daemon mon.b on smithi135 2024-09-10T22:18:01.459 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:18:01 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:18:01.459 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:18:01 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:18:01.459 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:18:01 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-10T22:18:01.459 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:18:01 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2024-09-10T22:18:01.459 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:18:01 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T22:18:01.600 INFO:teuthology.orchestra.run.smithi138.stdout:Scheduled mgr update... 2024-09-10T22:18:02.265 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:18:02 smithi138 ceph-mon[35236]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T22:18:02.265 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:18:02 smithi138 ceph-mon[35236]: Reconfiguring mon.c (monmap changed)... 2024-09-10T22:18:02.265 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:18:02 smithi138 ceph-mon[35236]: Reconfiguring daemon mon.c on smithi138 2024-09-10T22:18:02.265 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:18:02 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:18:02.360 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:18:02 smithi135 ceph-mon[34789]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T22:18:02.360 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:18:02 smithi135 ceph-mon[34789]: Reconfiguring mon.c (monmap changed)... 2024-09-10T22:18:02.360 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:18:02 smithi135 ceph-mon[34789]: Reconfiguring daemon mon.c on smithi138 2024-09-10T22:18:02.360 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:18:02 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:18:02.459 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:18:02 smithi019 ceph-mon[31375]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T22:18:02.459 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:18:02 smithi019 ceph-mon[31375]: Reconfiguring mon.c (monmap changed)... 2024-09-10T22:18:02.459 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:18:02 smithi019 ceph-mon[31375]: Reconfiguring daemon mon.c on smithi138 2024-09-10T22:18:02.459 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:18:02 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:18:02.552 DEBUG:teuthology.orchestra.run.smithi135:mgr.y> sudo journalctl -f -n 0 -u ceph-22997a4c-6fc2-11ef-bcea-c7b262605968@mgr.y.service 2024-09-10T22:18:02.555 DEBUG:teuthology.orchestra.run.smithi138:mgr.z> sudo journalctl -f -n 0 -u ceph-22997a4c-6fc2-11ef-bcea-c7b262605968@mgr.z.service 2024-09-10T22:18:02.557 INFO:tasks.cephadm:setting config [client] client_mount_timeout = 600 2024-09-10T22:18:02.558 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 22997a4c-6fc2-11ef-bcea-c7b262605968 -- ceph config set client client_mount_timeout 600 2024-09-10T22:18:02.560 INFO:tasks.cephadm:setting config [client] debug_client = 20 2024-09-10T22:18:02.561 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 22997a4c-6fc2-11ef-bcea-c7b262605968 -- ceph config set client debug_client 20 2024-09-10T22:18:02.603 INFO:tasks.cephadm:setting config [client] debug_ms = 1 2024-09-10T22:18:02.603 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 22997a4c-6fc2-11ef-bcea-c7b262605968 -- ceph config set client debug_ms 1 2024-09-10T22:18:02.646 INFO:tasks.cephadm:setting config [client] rados_mon_op_timeout = 900 2024-09-10T22:18:02.646 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 22997a4c-6fc2-11ef-bcea-c7b262605968 -- ceph config set client rados_mon_op_timeout 900 2024-09-10T22:18:02.690 INFO:tasks.cephadm:setting config [client] rados_osd_op_timeout = 900 2024-09-10T22:18:02.690 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 22997a4c-6fc2-11ef-bcea-c7b262605968 -- ceph config set client rados_osd_op_timeout 900 2024-09-10T22:18:02.733 INFO:tasks.cephadm:setting config [mds] debug_mds = 20 2024-09-10T22:18:02.734 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 22997a4c-6fc2-11ef-bcea-c7b262605968 -- ceph config set mds debug_mds 20 2024-09-10T22:18:02.777 INFO:tasks.cephadm:setting config [mds] debug_mds_balancer = 20 2024-09-10T22:18:02.778 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 22997a4c-6fc2-11ef-bcea-c7b262605968 -- ceph config set mds debug_mds_balancer 20 2024-09-10T22:18:02.821 INFO:tasks.cephadm:setting config [mds] debug_ms = 2 2024-09-10T22:18:02.822 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 22997a4c-6fc2-11ef-bcea-c7b262605968 -- ceph config set mds debug_ms 2 2024-09-10T22:18:02.865 INFO:tasks.cephadm:setting config [mds] mds_bal_fragment_size_max = 10000 2024-09-10T22:18:02.866 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 22997a4c-6fc2-11ef-bcea-c7b262605968 -- ceph config set mds mds_bal_fragment_size_max 10000 2024-09-10T22:18:02.871 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/22997a4c-6fc2-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T22:18:02.874 INFO:tasks.cephadm:setting config [mds] mds_bal_merge_size = 5 2024-09-10T22:18:02.874 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 22997a4c-6fc2-11ef-bcea-c7b262605968 -- ceph config set mds mds_bal_merge_size 5 2024-09-10T22:18:02.925 INFO:tasks.cephadm:setting config [mds] mds_bal_split_bits = 3 2024-09-10T22:18:02.925 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 22997a4c-6fc2-11ef-bcea-c7b262605968 -- ceph config set mds mds_bal_split_bits 3 2024-09-10T22:18:02.970 INFO:tasks.cephadm:setting config [mds] mds_bal_split_size = 100 2024-09-10T22:18:02.970 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 22997a4c-6fc2-11ef-bcea-c7b262605968 -- ceph config set mds mds_bal_split_size 100 2024-09-10T22:18:03.014 INFO:tasks.cephadm:setting config [mds] mds_debug_frag = True 2024-09-10T22:18:03.015 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 22997a4c-6fc2-11ef-bcea-c7b262605968 -- ceph config set mds mds_debug_frag True 2024-09-10T22:18:03.061 INFO:tasks.cephadm:setting config [mds] mds_debug_scatterstat = True 2024-09-10T22:18:03.061 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 22997a4c-6fc2-11ef-bcea-c7b262605968 -- ceph config set mds mds_debug_scatterstat True 2024-09-10T22:18:03.105 INFO:tasks.cephadm:setting config [mds] mds_op_complaint_time = 180 2024-09-10T22:18:03.105 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 22997a4c-6fc2-11ef-bcea-c7b262605968 -- ceph config set mds mds_op_complaint_time 180 2024-09-10T22:18:03.137 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:18:03 smithi019 ceph-mon[31375]: from='client.24100 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi019=x;smithi135=y;smithi138=z", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T22:18:03.137 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:18:03 smithi019 ceph-mon[31375]: Saving service mgr spec with placement smithi019=x;smithi135=y;smithi138=z;count:3 2024-09-10T22:18:03.137 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:18:03 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:18:03.137 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:18:03 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:18:03.137 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:18:03 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T22:18:03.137 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:18:03 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T22:18:03.138 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:18:03 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T22:18:03.138 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:18:03 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:18:03.138 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:18:03 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2024-09-10T22:18:03.138 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:18:03 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-10T22:18:03.138 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:18:03 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "mgr services"} : dispatch 2024-09-10T22:18:03.138 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:18:03 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T22:18:03.140 INFO:tasks.cephadm:setting config [mds] mds_verify_scatter = True 2024-09-10T22:18:03.140 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 22997a4c-6fc2-11ef-bcea-c7b262605968 -- ceph config set mds mds_verify_scatter True 2024-09-10T22:18:03.185 INFO:tasks.cephadm:setting config [mds] osd_op_complaint_time = 180 2024-09-10T22:18:03.185 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 22997a4c-6fc2-11ef-bcea-c7b262605968 -- ceph config set mds osd_op_complaint_time 180 2024-09-10T22:18:03.238 INFO:tasks.cephadm:setting config [mds] rados_mon_op_timeout = 900 2024-09-10T22:18:03.239 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 22997a4c-6fc2-11ef-bcea-c7b262605968 -- ceph config set mds rados_mon_op_timeout 900 2024-09-10T22:18:03.316 INFO:tasks.cephadm:setting config [mds] rados_osd_op_timeout = 900 2024-09-10T22:18:03.316 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 22997a4c-6fc2-11ef-bcea-c7b262605968 -- ceph config set mds rados_osd_op_timeout 900 2024-09-10T22:18:03.316 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/22997a4c-6fc2-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T22:18:03.360 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:18:03 smithi135 ceph-mon[34789]: from='client.24100 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi019=x;smithi135=y;smithi138=z", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T22:18:03.360 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:18:03 smithi135 ceph-mon[34789]: Saving service mgr spec with placement smithi019=x;smithi135=y;smithi138=z;count:3 2024-09-10T22:18:03.360 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:18:03 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:18:03.360 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:18:03 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:18:03.360 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:18:03 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T22:18:03.360 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:18:03 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T22:18:03.360 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:18:03 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T22:18:03.360 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:18:03 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:18:03.361 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:18:03 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2024-09-10T22:18:03.361 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:18:03 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-10T22:18:03.361 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:18:03 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "mgr services"} : dispatch 2024-09-10T22:18:03.361 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:18:03 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T22:18:03.361 INFO:tasks.cephadm:setting config [mon] mon_op_complaint_time = 120 2024-09-10T22:18:03.361 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 22997a4c-6fc2-11ef-bcea-c7b262605968 -- ceph config set mon mon_op_complaint_time 120 2024-09-10T22:18:03.375 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:18:03 smithi138 ceph-mon[35236]: from='client.24100 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi019=x;smithi135=y;smithi138=z", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T22:18:03.375 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:18:03 smithi138 ceph-mon[35236]: Saving service mgr spec with placement smithi019=x;smithi135=y;smithi138=z;count:3 2024-09-10T22:18:03.375 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:18:03 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:18:03.375 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:18:03 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:18:03.375 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:18:03 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T22:18:03.376 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:18:03 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T22:18:03.376 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:18:03 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T22:18:03.376 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:18:03 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:18:03.376 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:18:03 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2024-09-10T22:18:03.376 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:18:03 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-10T22:18:03.376 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:18:03 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "mgr services"} : dispatch 2024-09-10T22:18:03.376 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:18:03 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T22:18:03.406 INFO:tasks.cephadm:setting config [mon] mon_warn_on_pool_no_app = False 2024-09-10T22:18:03.406 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 22997a4c-6fc2-11ef-bcea-c7b262605968 -- ceph config set mon mon_warn_on_pool_no_app False 2024-09-10T22:18:03.451 INFO:tasks.cephadm:setting config [osd] osd_op_complaint_time = 180 2024-09-10T22:18:03.452 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 22997a4c-6fc2-11ef-bcea-c7b262605968 -- ceph config set osd osd_op_complaint_time 180 2024-09-10T22:18:03.495 DEBUG:tasks.cephadm:set 22 configs 2024-09-10T22:18:03.495 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '22997a4c-6fc2-11ef-bcea-c7b262605968', '--', 'ceph', 'config', 'set', 'client', 'client_mount_timeout', '600'], check_status=True, hostname='smithi019') 2024-09-10T22:18:04.360 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:18:04 smithi135 ceph-mon[34789]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T22:18:04.360 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:18:04 smithi135 ceph-mon[34789]: Deploying daemon mgr.z on smithi138 2024-09-10T22:18:04.360 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:18:04 smithi135 ceph-mon[34789]: from='client.? 172.21.15.19:0/1968992559' entity='client.admin' 2024-09-10T22:18:04.366 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:18:04 smithi138 ceph-mon[35236]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T22:18:04.366 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:18:04 smithi138 ceph-mon[35236]: Deploying daemon mgr.z on smithi138 2024-09-10T22:18:04.366 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:18:04 smithi138 ceph-mon[35236]: from='client.? 172.21.15.19:0/1968992559' entity='client.admin' 2024-09-10T22:18:04.458 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:18:04 smithi019 ceph-mon[31375]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T22:18:04.458 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:18:04 smithi019 ceph-mon[31375]: Deploying daemon mgr.z on smithi138 2024-09-10T22:18:04.459 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:18:04 smithi019 ceph-mon[31375]: from='client.? 172.21.15.19:0/1968992559' entity='client.admin' 2024-09-10T22:18:05.010 INFO:journalctl@ceph.mgr.z.smithi138.stdout:Sep 10 22:18:04 smithi138 systemd[1]: Starting Ceph mgr.z for 22997a4c-6fc2-11ef-bcea-c7b262605968... 2024-09-10T22:18:05.072 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '22997a4c-6fc2-11ef-bcea-c7b262605968', '--', 'ceph', 'config', 'set', 'client', 'debug_client', '20'], check_status=True, hostname='smithi019') 2024-09-10T22:18:05.271 INFO:journalctl@ceph.mgr.z.smithi138.stdout:Sep 10 22:18:05 smithi138 podman[36804]: 2024-09-10 22:18:05.009365772 +0000 UTC m=+0.093351430 container create ecaaea115c2f2e3fe11342b12f5b022e493281ddbbb8da45d48cee5dec81c4db (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-mgr-z, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.schema-version=1.0, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, io.buildah.version=1.37.2) 2024-09-10T22:18:05.271 INFO:journalctl@ceph.mgr.z.smithi138.stdout:Sep 10 22:18:05 smithi138 podman[36804]: 2024-09-10 22:18:04.931766948 +0000 UTC m=+0.015752577 image pull 589dd18248e494ba411dc838aa4ae0e5e569213f08fcd7a2cf22cd3ef7e3c480 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e 2024-09-10T22:18:05.271 INFO:journalctl@ceph.mgr.z.smithi138.stdout:Sep 10 22:18:05 smithi138 podman[36804]: 2024-09-10 22:18:05.270255 +0000 UTC m=+0.354240616 container init ecaaea115c2f2e3fe11342b12f5b022e493281ddbbb8da45d48cee5dec81c4db (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-mgr-z, io.buildah.version=1.37.2, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD) 2024-09-10T22:18:05.625 INFO:journalctl@ceph.mgr.z.smithi138.stdout:Sep 10 22:18:05 smithi138 podman[36804]: 2024-09-10 22:18:05.273096865 +0000 UTC m=+0.357082481 container start ecaaea115c2f2e3fe11342b12f5b022e493281ddbbb8da45d48cee5dec81c4db (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-mgr-z, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux ) 2024-09-10T22:18:05.625 INFO:journalctl@ceph.mgr.z.smithi138.stdout:Sep 10 22:18:05 smithi138 ceph-mgr[36824]: -- 172.21.15.138:0/1475922933 <== mon.1 v2:172.21.15.138:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x560836df70e0 con 0x560836dd5400 2024-09-10T22:18:05.625 INFO:journalctl@ceph.mgr.z.smithi138.stdout:Sep 10 22:18:05 smithi138 bash[36804]: ecaaea115c2f2e3fe11342b12f5b022e493281ddbbb8da45d48cee5dec81c4db 2024-09-10T22:18:05.625 INFO:journalctl@ceph.mgr.z.smithi138.stdout:Sep 10 22:18:05 smithi138 systemd[1]: Started Ceph mgr.z for 22997a4c-6fc2-11ef-bcea-c7b262605968. 2024-09-10T22:18:05.683 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '22997a4c-6fc2-11ef-bcea-c7b262605968', '--', 'ceph', 'config', 'set', 'client', 'debug_ms', '1'], check_status=True, hostname='smithi019') 2024-09-10T22:18:05.732 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/22997a4c-6fc2-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T22:18:05.742 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/22997a4c-6fc2-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T22:18:05.755 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/22997a4c-6fc2-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T22:18:05.929 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:18:05 smithi019 ceph-mon[31375]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T22:18:05.929 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:18:05 smithi019 ceph-mon[31375]: from='client.? 172.21.15.19:0/3614658127' entity='client.admin' 2024-09-10T22:18:05.929 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:18:05 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:18:05.930 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:18:05 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:18:05.930 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:18:05 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:18:05.930 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:18:05 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2024-09-10T22:18:05.930 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:18:05 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-10T22:18:05.930 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:18:05 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "mgr services"} : dispatch 2024-09-10T22:18:05.930 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:18:05 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T22:18:06.087 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:18:05 smithi135 ceph-mon[34789]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T22:18:06.087 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:18:05 smithi135 ceph-mon[34789]: from='client.? 172.21.15.19:0/3614658127' entity='client.admin' 2024-09-10T22:18:06.087 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:18:05 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:18:06.088 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:18:05 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:18:06.088 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:18:05 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:18:06.088 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:18:05 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2024-09-10T22:18:06.088 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:18:05 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-10T22:18:06.088 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:18:05 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "mgr services"} : dispatch 2024-09-10T22:18:06.088 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:18:05 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T22:18:06.125 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:18:05 smithi138 ceph-mon[35236]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T22:18:06.125 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:18:05 smithi138 ceph-mon[35236]: from='client.? 172.21.15.19:0/3614658127' entity='client.admin' 2024-09-10T22:18:06.125 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:18:05 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:18:06.125 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:18:05 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:18:06.125 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:18:05 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:18:06.125 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:18:05 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2024-09-10T22:18:06.125 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:18:05 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-10T22:18:06.125 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:18:05 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "mgr services"} : dispatch 2024-09-10T22:18:06.125 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:18:05 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T22:18:06.856 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:06.854+0000 7fd079fe7640 1 -- 172.21.15.19:0/3110217805 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7fd05c03f510 msgr2=0x7fd05c0419d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:18:06.856 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:06.854+0000 7fd079fe7640 1 --2- 172.21.15.19:0/3110217805 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7fd05c03f510 0x7fd05c0419d0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fd064005d00 tx=0x7fd06400b410 comp rx=0 tx=0).stop 2024-09-10T22:18:06.856 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:06.854+0000 7fd079fe7640 1 -- 172.21.15.19:0/3110217805 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd074107fb0 msgr2=0x7fd07419b320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:18:06.857 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:06.854+0000 7fd079fe7640 1 --2- 172.21.15.19:0/3110217805 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd074107fb0 0x7fd07419b320 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fd06800d770 tx=0x7fd06800dc30 comp rx=0 tx=0).stop 2024-09-10T22:18:06.857 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:06.854+0000 7fd079fe7640 1 -- 172.21.15.19:0/3110217805 shutdown_connections 2024-09-10T22:18:06.857 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:06.854+0000 7fd079fe7640 1 --2- 172.21.15.19:0/3110217805 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7fd05c03f510 0x7fd05c0419d0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:06.857 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:06.854+0000 7fd079fe7640 1 --2- 172.21.15.19:0/3110217805 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd07410a960 0x7fd07419bf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:06.857 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:06.854+0000 7fd079fe7640 1 --2- 172.21.15.19:0/3110217805 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd074107fb0 0x7fd07419b320 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:06.857 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:06.854+0000 7fd079fe7640 1 --2- 172.21.15.19:0/3110217805 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd07406b550 0x7fd07419acd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:06.857 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:06.854+0000 7fd079fe7640 1 -- 172.21.15.19:0/3110217805 >> 172.21.15.19:0/3110217805 conn(0x7fd0740fd1e0 msgr2=0x7fd074108cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:18:06.857 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:06.855+0000 7fd079fe7640 1 -- 172.21.15.19:0/3110217805 shutdown_connections 2024-09-10T22:18:06.857 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:06.855+0000 7fd079fe7640 1 -- 172.21.15.19:0/3110217805 wait complete. 2024-09-10T22:18:07.067 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:18:06 smithi135 ceph-mon[34789]: Deploying daemon mgr.y on smithi135 2024-09-10T22:18:07.067 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:18:06 smithi135 ceph-mon[34789]: from='client.? 172.21.15.19:0/257078762' entity='client.admin' 2024-09-10T22:18:07.125 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:18:06 smithi138 ceph-mon[35236]: Deploying daemon mgr.y on smithi135 2024-09-10T22:18:07.125 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:18:06 smithi138 ceph-mon[35236]: from='client.? 172.21.15.19:0/257078762' entity='client.admin' 2024-09-10T22:18:07.183 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:18:06 smithi019 ceph-mon[31375]: Deploying daemon mgr.y on smithi135 2024-09-10T22:18:07.183 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:18:06 smithi019 ceph-mon[31375]: from='client.? 172.21.15.19:0/257078762' entity='client.admin' 2024-09-10T22:18:07.360 INFO:journalctl@ceph.mgr.y.smithi135.stdout:Sep 10 22:18:07 smithi135 systemd[1]: Starting Ceph mgr.y for 22997a4c-6fc2-11ef-bcea-c7b262605968... 2024-09-10T22:18:07.482 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '22997a4c-6fc2-11ef-bcea-c7b262605968', '--', 'ceph', 'config', 'set', 'client', 'rados_mon_op_timeout', '900'], check_status=True, hostname='smithi019') 2024-09-10T22:18:07.697 INFO:journalctl@ceph.mgr.y.smithi135.stdout:Sep 10 22:18:07 smithi135 podman[35907]: 2024-09-10 22:18:07.341555885 +0000 UTC m=+0.015843983 image pull 589dd18248e494ba411dc838aa4ae0e5e569213f08fcd7a2cf22cd3ef7e3c480 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e 2024-09-10T22:18:07.697 INFO:journalctl@ceph.mgr.y.smithi135.stdout:Sep 10 22:18:07 smithi135 podman[35907]: 2024-09-10 22:18:07.46118554 +0000 UTC m=+0.135473673 container create 8155995dafc3bcc1e30e6fccc43c323869ac2534e1b1a00bf57e90d504fa3eb3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-mgr-y, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, ceph=True, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_CLEAN=True) 2024-09-10T22:18:07.697 INFO:journalctl@ceph.mgr.y.smithi135.stdout:Sep 10 22:18:07 smithi135 podman[35907]: 2024-09-10 22:18:07.6965487 +0000 UTC m=+0.370836802 container init 8155995dafc3bcc1e30e6fccc43c323869ac2534e1b1a00bf57e90d504fa3eb3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-mgr-y, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-10T22:18:08.110 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:18:07 smithi135 ceph-mon[34789]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T22:18:08.110 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:18:07 smithi135 ceph-mon[34789]: from='client.? 172.21.15.19:0/3110217805' entity='client.admin' 2024-09-10T22:18:08.110 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:18:07 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:18:08.110 INFO:journalctl@ceph.mgr.y.smithi135.stdout:Sep 10 22:18:07 smithi135 podman[35907]: 2024-09-10 22:18:07.699359166 +0000 UTC m=+0.373647256 container start 8155995dafc3bcc1e30e6fccc43c323869ac2534e1b1a00bf57e90d504fa3eb3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-mgr-y, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_CLEAN=True, CEPH_POINT_RELEASE=, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4) 2024-09-10T22:18:08.110 INFO:journalctl@ceph.mgr.y.smithi135.stdout:Sep 10 22:18:07 smithi135 ceph-mgr[35926]: -- 172.21.15.135:0/1268231857 <== mon.2 v2:172.21.15.135:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55aa6b5c50e0 con 0x55aa6b5a2800 2024-09-10T22:18:08.110 INFO:journalctl@ceph.mgr.y.smithi135.stdout:Sep 10 22:18:07 smithi135 bash[35907]: 8155995dafc3bcc1e30e6fccc43c323869ac2534e1b1a00bf57e90d504fa3eb3 2024-09-10T22:18:08.110 INFO:journalctl@ceph.mgr.y.smithi135.stdout:Sep 10 22:18:07 smithi135 systemd[1]: Started Ceph mgr.y for 22997a4c-6fc2-11ef-bcea-c7b262605968. 2024-09-10T22:18:08.125 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:18:07 smithi138 ceph-mon[35236]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T22:18:08.125 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:18:07 smithi138 ceph-mon[35236]: from='client.? 172.21.15.19:0/3110217805' entity='client.admin' 2024-09-10T22:18:08.125 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:18:07 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:18:08.153 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:18:07 smithi019 ceph-mon[31375]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T22:18:08.153 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:18:07 smithi019 ceph-mon[31375]: from='client.? 172.21.15.19:0/3110217805' entity='client.admin' 2024-09-10T22:18:08.153 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:18:07 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:18:08.389 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:07.949+0000 7f8cbccbc640 1 -- 172.21.15.19:0/1231433061 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8cb8101910 msgr2=0x7f8cb8101d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:18:08.389 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:07.949+0000 7f8cbccbc640 1 --2- 172.21.15.19:0/1231433061 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8cb8101910 0x7f8cb8101d10 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f8ca8009930 tx=0x7f8ca802a420 comp rx=0 tx=0).stop 2024-09-10T22:18:08.389 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:07.949+0000 7f8cbccbc640 1 -- 172.21.15.19:0/1231433061 shutdown_connections 2024-09-10T22:18:08.389 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:07.949+0000 7f8cbccbc640 1 --2- 172.21.15.19:0/1231433061 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f8cb8103430 0x7f8cb8109db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:08.389 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:07.949+0000 7f8cbccbc640 1 --2- 172.21.15.19:0/1231433061 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8cb8102a70 0x7f8cb8102ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:08.389 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:07.949+0000 7f8cbccbc640 1 --2- 172.21.15.19:0/1231433061 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8cb8101910 0x7f8cb8101d10 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:08.389 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:07.949+0000 7f8cbccbc640 1 -- 172.21.15.19:0/1231433061 >> 172.21.15.19:0/1231433061 conn(0x7f8cb80fd1e0 msgr2=0x7f8cb80ff620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:18:08.389 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:07.949+0000 7f8cbccbc640 1 -- 172.21.15.19:0/1231433061 shutdown_connections 2024-09-10T22:18:08.390 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:07.949+0000 7f8cbccbc640 1 -- 172.21.15.19:0/1231433061 wait complete. 2024-09-10T22:18:08.390 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:07.950+0000 7f8cbccbc640 1 Processor -- start 2024-09-10T22:18:08.390 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:07.950+0000 7f8cbccbc640 1 -- start start 2024-09-10T22:18:08.390 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:07.950+0000 7f8cbccbc640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8cb8101910 0x7f8cb8198d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:18:08.390 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:07.950+0000 7f8cbccbc640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8cb8102a70 0x7f8cb8199390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:18:08.390 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:07.950+0000 7f8cbccbc640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f8cb8103430 0x7f8cb8199fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:18:08.390 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:07.950+0000 7f8cbccbc640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f8cb810d480 con 0x7f8cb8102a70 2024-09-10T22:18:08.390 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:07.950+0000 7f8cbccbc640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f8cb810d300 con 0x7f8cb8101910 2024-09-10T22:18:08.390 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:07.950+0000 7f8cbccbc640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f8cb810d600 con 0x7f8cb8103430 2024-09-10T22:18:08.390 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:07.950+0000 7f8cb5d9b640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8cb8102a70 0x7f8cb8199390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:18:08.390 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:07.950+0000 7f8cb5d9b640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8cb8102a70 0x7f8cb8199390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:33828/0 (socket says 172.21.15.19:33828) 2024-09-10T22:18:08.391 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:07.950+0000 7f8cb5d9b640 1 -- 172.21.15.19:0/1088478861 learned_addr learned my addr 172.21.15.19:0/1088478861 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:18:08.391 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:07.950+0000 7f8cb659c640 1 --2- 172.21.15.19:0/1088478861 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8cb8101910 0x7f8cb8198d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:18:08.391 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:07.951+0000 7f8cb6d9d640 1 --2- 172.21.15.19:0/1088478861 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f8cb8103430 0x7f8cb8199fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:18:08.391 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:07.951+0000 7f8cb5d9b640 1 -- 172.21.15.19:0/1088478861 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f8cb8103430 msgr2=0x7f8cb8199fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:18:08.391 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:07.951+0000 7f8cb5d9b640 1 --2- 172.21.15.19:0/1088478861 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f8cb8103430 0x7f8cb8199fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:08.391 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:07.951+0000 7f8cb5d9b640 1 -- 172.21.15.19:0/1088478861 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8cb8101910 msgr2=0x7f8cb8198d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:18:08.391 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:07.951+0000 7f8cb5d9b640 1 --2- 172.21.15.19:0/1088478861 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8cb8101910 0x7f8cb8198d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:08.391 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:07.951+0000 7f8cb5d9b640 1 -- 172.21.15.19:0/1088478861 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8cb819a870 con 0x7f8cb8102a70 2024-09-10T22:18:08.391 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:07.951+0000 7f8cb5d9b640 1 --2- 172.21.15.19:0/1088478861 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8cb8102a70 0x7f8cb8199390 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f8cac00e9f0 tx=0x7f8cac00eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:18:08.391 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:07.951+0000 7f8ca77fe640 1 -- 172.21.15.19:0/1088478861 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8cac00cd80 con 0x7f8cb8102a70 2024-09-10T22:18:08.391 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:07.951+0000 7f8ca77fe640 1 -- 172.21.15.19:0/1088478861 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(25 keys) ==== 1070+0+0 (secure 0 0 0) 0x7f8cac0108c0 con 0x7f8cb8102a70 2024-09-10T22:18:08.391 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:07.951+0000 7f8cbccbc640 1 -- 172.21.15.19:0/1088478861 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8cb819ab60 con 0x7f8cb8102a70 2024-09-10T22:18:08.392 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:07.951+0000 7f8ca77fe640 1 -- 172.21.15.19:0/1088478861 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8cac0187d0 con 0x7f8cb8102a70 2024-09-10T22:18:08.392 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:07.951+0000 7f8cbccbc640 1 -- 172.21.15.19:0/1088478861 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8cb81a1240 con 0x7f8cb8102a70 2024-09-10T22:18:08.392 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:07.952+0000 7f8ca77fe640 1 -- 172.21.15.19:0/1088478861 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 13) ==== 51480+0+0 (secure 0 0 0) 0x7f8cac0189b0 con 0x7f8cb8102a70 2024-09-10T22:18:08.392 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:07.952+0000 7f8cbccbc640 1 -- 172.21.15.19:0/1088478861 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8cb8101d10 con 0x7f8cb8102a70 2024-09-10T22:18:08.392 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:07.952+0000 7f8ca77fe640 1 --2- 172.21.15.19:0/1088478861 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f8ca003f510 0x7f8ca00419d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:18:08.392 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:07.952+0000 7f8ca77fe640 1 -- 172.21.15.19:0/1088478861 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f8cac054270 con 0x7f8cb8102a70 2024-09-10T22:18:08.392 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:07.952+0000 7f8cb659c640 1 --2- 172.21.15.19:0/1088478861 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f8ca003f510 0x7f8ca00419d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:18:08.392 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:07.953+0000 7f8cb659c640 1 --2- 172.21.15.19:0/1088478861 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f8ca003f510 0x7f8ca00419d0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f8ca8005ab0 tx=0x7f8ca8005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:18:08.392 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:07.957+0000 7f8ca77fe640 1 -- 172.21.15.19:0/1088478861 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f8cac01fe30 con 0x7f8cb8102a70 2024-09-10T22:18:08.392 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:08.151+0000 7f8cbccbc640 1 -- 172.21.15.19:0/1088478861 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command([{prefix=config set, name=debug_mds}] v 0) -- 0x7f8cb81a1530 con 0x7f8cb8102a70 2024-09-10T22:18:08.393 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:08.156+0000 7f8ca77fe640 1 -- 172.21.15.19:0/1088478861 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{prefix=config set, name=debug_mds}]=0 v14)=0 v14) ==== 108+0+0 (secure 0 0 0) 0x7f8cac0071c0 con 0x7f8cb8102a70 2024-09-10T22:18:08.393 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:08.159+0000 7f8cbccbc640 1 -- 172.21.15.19:0/1088478861 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f8ca003f510 msgr2=0x7f8ca00419d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:18:08.393 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:08.159+0000 7f8cbccbc640 1 --2- 172.21.15.19:0/1088478861 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f8ca003f510 0x7f8ca00419d0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f8ca8005ab0 tx=0x7f8ca8005a20 comp rx=0 tx=0).stop 2024-09-10T22:18:08.393 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:08.159+0000 7f8cbccbc640 1 -- 172.21.15.19:0/1088478861 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8cb8102a70 msgr2=0x7f8cb8199390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:18:08.393 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:08.159+0000 7f8cbccbc640 1 --2- 172.21.15.19:0/1088478861 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8cb8102a70 0x7f8cb8199390 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f8cac00e9f0 tx=0x7f8cac00eeb0 comp rx=0 tx=0).stop 2024-09-10T22:18:08.393 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:08.159+0000 7f8cbccbc640 1 -- 172.21.15.19:0/1088478861 shutdown_connections 2024-09-10T22:18:08.393 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:08.159+0000 7f8cbccbc640 1 --2- 172.21.15.19:0/1088478861 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f8ca003f510 0x7f8ca00419d0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:08.393 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:08.159+0000 7f8cbccbc640 1 --2- 172.21.15.19:0/1088478861 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f8cb8103430 0x7f8cb8199fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:08.393 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:08.159+0000 7f8cbccbc640 1 --2- 172.21.15.19:0/1088478861 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8cb8102a70 0x7f8cb8199390 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:08.393 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:08.159+0000 7f8cbccbc640 1 --2- 172.21.15.19:0/1088478861 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8cb8101910 0x7f8cb8198d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:08.393 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:08.159+0000 7f8cbccbc640 1 -- 172.21.15.19:0/1088478861 >> 172.21.15.19:0/1088478861 conn(0x7f8cb80fd1e0 msgr2=0x7f8cb80fecb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:18:08.393 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:08.159+0000 7f8cbccbc640 1 -- 172.21.15.19:0/1088478861 shutdown_connections 2024-09-10T22:18:08.394 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:08.159+0000 7f8cbccbc640 1 -- 172.21.15.19:0/1088478861 wait complete. 2024-09-10T22:18:08.992 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:18:08 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:18:08.992 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:18:08 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:18:08.992 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:18:08 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:18:08.992 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:18:08 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T22:18:08.992 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:18:08 smithi019 ceph-mon[31375]: from='client.? 172.21.15.19:0/1088478861' entity='client.admin' 2024-09-10T22:18:09.075 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/22997a4c-6fc2-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T22:18:09.075 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/22997a4c-6fc2-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T22:18:09.077 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/22997a4c-6fc2-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T22:18:09.077 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/22997a4c-6fc2-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T22:18:09.077 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/22997a4c-6fc2-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T22:18:09.081 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/22997a4c-6fc2-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T22:18:09.084 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/22997a4c-6fc2-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T22:18:09.084 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/22997a4c-6fc2-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T22:18:09.085 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/22997a4c-6fc2-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T22:18:09.085 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/22997a4c-6fc2-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T22:18:09.099 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/22997a4c-6fc2-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T22:18:09.099 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/22997a4c-6fc2-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T22:18:09.104 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/22997a4c-6fc2-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T22:18:09.104 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/22997a4c-6fc2-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T22:18:09.104 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/22997a4c-6fc2-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T22:18:09.105 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/22997a4c-6fc2-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T22:18:09.110 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/22997a4c-6fc2-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T22:18:09.125 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:18:08 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:18:09.125 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:18:08 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:18:09.125 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:18:08 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:18:09.125 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:18:08 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T22:18:09.125 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:18:08 smithi138 ceph-mon[35236]: from='client.? 172.21.15.19:0/1088478861' entity='client.admin' 2024-09-10T22:18:09.359 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:18:08 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:18:09.360 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:18:08 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:18:09.360 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:18:08 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:18:09.360 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:18:08 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T22:18:09.360 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:18:08 smithi135 ceph-mon[34789]: from='client.? 172.21.15.19:0/1088478861' entity='client.admin' 2024-09-10T22:18:10.162 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:18:10 smithi019 ceph-mon[31375]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T22:18:10.162 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:18:10 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:18:10.162 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:18:10 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:18:10.162 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:18:10 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:18:10.162 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:18:10 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:18:10.163 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:18:10 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T22:18:10.163 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:18:10 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T22:18:10.163 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:18:10 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:18:10.163 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:18:10 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2024-09-10T22:18:10.163 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:18:10 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "mgr services"} : dispatch 2024-09-10T22:18:10.163 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:18:10 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T22:18:10.163 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:18:10 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:18:10.359 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:18:10 smithi135 ceph-mon[34789]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T22:18:10.360 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:18:10 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:18:10.360 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:18:10 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:18:10.360 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:18:10 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:18:10.360 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:18:10 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:18:10.360 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:18:10 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T22:18:10.360 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:18:10 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T22:18:10.360 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:18:10 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:18:10.360 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:18:10 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2024-09-10T22:18:10.360 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:18:10 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "mgr services"} : dispatch 2024-09-10T22:18:10.360 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:18:10 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T22:18:10.360 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:18:10 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:18:10.375 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:18:10 smithi138 ceph-mon[35236]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T22:18:10.375 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:18:10 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:18:10.375 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:18:10 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:18:10.375 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:18:10 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:18:10.375 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:18:10 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:18:10.375 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:18:10 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T22:18:10.375 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:18:10 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T22:18:10.375 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:18:10 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:18:10.375 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:18:10 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2024-09-10T22:18:10.376 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:18:10 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "mgr services"} : dispatch 2024-09-10T22:18:10.376 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:18:10 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T22:18:10.376 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:18:10 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:18:10.489 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:10.481+0000 7fe828175640 1 -- 172.21.15.19:0/3331925239 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe820103430 msgr2=0x7fe820109db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:18:10.489 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:10.481+0000 7fe828175640 1 --2- 172.21.15.19:0/3331925239 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe820103430 0x7fe820109db0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fe818009930 tx=0x7fe81802a420 comp rx=0 tx=0).stop 2024-09-10T22:18:10.489 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:10.481+0000 7fe828175640 1 -- 172.21.15.19:0/3331925239 shutdown_connections 2024-09-10T22:18:10.489 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:10.482+0000 7fe828175640 1 --2- 172.21.15.19:0/3331925239 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe820103430 0x7fe820109db0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:10.489 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:10.482+0000 7fe828175640 1 --2- 172.21.15.19:0/3331925239 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe820102a70 0x7fe820102ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:10.490 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:10.482+0000 7fe828175640 1 --2- 172.21.15.19:0/3331925239 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe820101910 0x7fe820101d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:10.490 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:10.482+0000 7fe828175640 1 -- 172.21.15.19:0/3331925239 >> 172.21.15.19:0/3331925239 conn(0x7fe8200fd1e0 msgr2=0x7fe8200ff620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:18:10.490 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:10.482+0000 7fe828175640 1 -- 172.21.15.19:0/3331925239 shutdown_connections 2024-09-10T22:18:10.490 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:10.482+0000 7fe828175640 1 -- 172.21.15.19:0/3331925239 wait complete. 2024-09-10T22:18:10.490 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:10.482+0000 7fe828175640 1 Processor -- start 2024-09-10T22:18:10.490 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:10.482+0000 7fe828175640 1 -- start start 2024-09-10T22:18:10.490 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:10.483+0000 7fe828175640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe820101910 0x7fe82006b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:18:10.490 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:10.483+0000 7fe828175640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe820102a70 0x7fe82019d9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:18:10.490 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:10.483+0000 7fe828175640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe820103430 0x7fe82019ffd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:18:10.490 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:10.483+0000 7fe828175640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fe82010d450 con 0x7fe820103430 2024-09-10T22:18:10.490 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:10.483+0000 7fe828175640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fe82010d2d0 con 0x7fe820102a70 2024-09-10T22:18:10.490 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:10.483+0000 7fe828175640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7fe82010d5d0 con 0x7fe820101910 2024-09-10T22:18:10.491 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:10.483+0000 7fe826712640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe820103430 0x7fe82019ffd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:18:10.491 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:10.483+0000 7fe826712640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe820103430 0x7fe82019ffd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:33846/0 (socket says 172.21.15.19:33846) 2024-09-10T22:18:10.491 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:10.483+0000 7fe826712640 1 -- 172.21.15.19:0/3028549506 learned_addr learned my addr 172.21.15.19:0/3028549506 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:18:10.491 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:10.483+0000 7fe825f11640 1 --2- 172.21.15.19:0/3028549506 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe820101910 0x7fe82006b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:18:10.491 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:10.483+0000 7fe825710640 1 --2- 172.21.15.19:0/3028549506 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe820102a70 0x7fe82019d9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:18:10.491 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:10.483+0000 7fe826712640 1 -- 172.21.15.19:0/3028549506 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe820101910 msgr2=0x7fe82006b410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:18:10.491 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:10.483+0000 7fe826712640 1 --2- 172.21.15.19:0/3028549506 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe820101910 0x7fe82006b410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:10.491 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:10.483+0000 7fe826712640 1 -- 172.21.15.19:0/3028549506 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe820102a70 msgr2=0x7fe82019d9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:18:10.491 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:10.483+0000 7fe826712640 1 --2- 172.21.15.19:0/3028549506 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe820102a70 0x7fe82019d9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:10.491 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:10.483+0000 7fe826712640 1 -- 172.21.15.19:0/3028549506 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe8201a0890 con 0x7fe820103430 2024-09-10T22:18:10.491 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:10.483+0000 7fe825f11640 1 --2- 172.21.15.19:0/3028549506 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe820101910 0x7fe82006b410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T22:18:10.491 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:10.483+0000 7fe826712640 1 --2- 172.21.15.19:0/3028549506 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe820103430 0x7fe82019ffd0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fe818005940 tx=0x7fe8180040c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:18:10.492 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:10.484+0000 7fe81effd640 1 -- 172.21.15.19:0/3028549506 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe81803f030 con 0x7fe820103430 2024-09-10T22:18:10.492 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:10.484+0000 7fe81effd640 1 -- 172.21.15.19:0/3028549506 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(25 keys) ==== 1070+0+0 (secure 0 0 0) 0x7fe8180044c0 con 0x7fe820103430 2024-09-10T22:18:10.492 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:10.484+0000 7fe828175640 1 -- 172.21.15.19:0/3028549506 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe8201a0b20 con 0x7fe820103430 2024-09-10T22:18:10.492 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:10.484+0000 7fe81effd640 1 -- 172.21.15.19:0/3028549506 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe818035070 con 0x7fe820103430 2024-09-10T22:18:10.492 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:10.484+0000 7fe828175640 1 -- 172.21.15.19:0/3028549506 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe8201a1000 con 0x7fe820103430 2024-09-10T22:18:10.492 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:10.484+0000 7fe81effd640 1 -- 172.21.15.19:0/3028549506 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 13) ==== 51480+0+0 (secure 0 0 0) 0x7fe81803b950 con 0x7fe820103430 2024-09-10T22:18:10.492 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:10.484+0000 7fe828175640 1 -- 172.21.15.19:0/3028549506 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe820101d10 con 0x7fe820103430 2024-09-10T22:18:10.492 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:10.485+0000 7fe81effd640 1 --2- 172.21.15.19:0/3028549506 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7fe80803f510 0x7fe8080419d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:18:10.492 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:10.485+0000 7fe81effd640 1 -- 172.21.15.19:0/3028549506 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7fe818074680 con 0x7fe820103430 2024-09-10T22:18:10.492 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:10.485+0000 7fe825f11640 1 --2- 172.21.15.19:0/3028549506 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7fe80803f510 0x7fe8080419d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:18:10.492 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:10.485+0000 7fe825f11640 1 --2- 172.21.15.19:0/3028549506 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7fe80803f510 0x7fe8080419d0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fe810009fd0 tx=0x7fe810009680 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:18:10.493 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:10.489+0000 7fe81effd640 1 -- 172.21.15.19:0/3028549506 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7fe818043c70 con 0x7fe820103430 2024-09-10T22:18:10.667 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:10.665+0000 7f51b43f8640 1 -- 172.21.15.19:0/3325621864 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f51ac103430 msgr2=0x7f51ac109db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:18:10.668 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:10.665+0000 7f51b43f8640 1 --2- 172.21.15.19:0/3325621864 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f51ac103430 0x7f51ac109db0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f51a4009cd0 tx=0x7f51a402a8e0 comp rx=0 tx=0).stop 2024-09-10T22:18:10.668 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:10.666+0000 7f51b43f8640 1 -- 172.21.15.19:0/3325621864 shutdown_connections 2024-09-10T22:18:10.668 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:10.666+0000 7f51b43f8640 1 --2- 172.21.15.19:0/3325621864 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f51ac103430 0x7f51ac109db0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:10.668 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:10.666+0000 7f51b43f8640 1 --2- 172.21.15.19:0/3325621864 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f51ac102a70 0x7f51ac102ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:10.668 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:10.666+0000 7f51b43f8640 1 --2- 172.21.15.19:0/3325621864 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f51ac101910 0x7f51ac101d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:10.668 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:10.666+0000 7f51b43f8640 1 -- 172.21.15.19:0/3325621864 >> 172.21.15.19:0/3325621864 conn(0x7f51ac0fd1e0 msgr2=0x7f51ac0ff620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:18:10.668 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:10.666+0000 7f51b43f8640 1 -- 172.21.15.19:0/3325621864 shutdown_connections 2024-09-10T22:18:10.668 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:10.666+0000 7f51b43f8640 1 -- 172.21.15.19:0/3325621864 wait complete. 2024-09-10T22:18:10.668 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:10.666+0000 7f51b43f8640 1 Processor -- start 2024-09-10T22:18:10.668 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:10.666+0000 7f51b43f8640 1 -- start start 2024-09-10T22:18:10.670 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:10.666+0000 7f51b43f8640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f51ac101910 0x7f51ac19ae80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:18:10.670 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:10.666+0000 7f51b43f8640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f51ac102a70 0x7f51ac19b4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:18:10.670 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:10.666+0000 7f51b43f8640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f51ac103430 0x7f51ac19c110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:18:10.671 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:10.666+0000 7f51b43f8640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f51ac10d430 con 0x7f51ac103430 2024-09-10T22:18:10.671 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:10.666+0000 7f51b43f8640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f51ac10d2b0 con 0x7f51ac102a70 2024-09-10T22:18:10.671 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:10.666+0000 7f51b43f8640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f51ac10d5b0 con 0x7f51ac101910 2024-09-10T22:18:10.671 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:10.667+0000 7f51b2995640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f51ac103430 0x7f51ac19c110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:18:10.671 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:10.667+0000 7f51b1993640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f51ac102a70 0x7f51ac19b4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:18:10.672 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:10.667+0000 7f51b2995640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f51ac103430 0x7f51ac19c110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:33852/0 (socket says 172.21.15.19:33852) 2024-09-10T22:18:10.672 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:10.667+0000 7f51b2995640 1 -- 172.21.15.19:0/3821986188 learned_addr learned my addr 172.21.15.19:0/3821986188 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:18:10.672 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:10.667+0000 7f51b2194640 1 --2- 172.21.15.19:0/3821986188 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f51ac101910 0x7f51ac19ae80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:18:10.672 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:10.667+0000 7f51b2995640 1 -- 172.21.15.19:0/3821986188 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f51ac101910 msgr2=0x7f51ac19ae80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:18:10.672 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:10.667+0000 7f51b2995640 1 --2- 172.21.15.19:0/3821986188 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f51ac101910 0x7f51ac19ae80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:10.672 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:10.667+0000 7f51b2995640 1 -- 172.21.15.19:0/3821986188 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f51ac102a70 msgr2=0x7f51ac19b4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:18:10.673 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:10.667+0000 7f51b2995640 1 --2- 172.21.15.19:0/3821986188 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f51ac102a70 0x7f51ac19b4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:10.673 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:10.667+0000 7f51b2995640 1 -- 172.21.15.19:0/3821986188 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f51ac19c9b0 con 0x7f51ac103430 2024-09-10T22:18:10.673 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:10.667+0000 7f51b1993640 1 --2- 172.21.15.19:0/3821986188 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f51ac102a70 0x7f51ac19b4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T22:18:10.673 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:10.667+0000 7f51b2995640 1 --2- 172.21.15.19:0/3821986188 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f51ac103430 0x7f51ac19c110 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f51a40097b0 tx=0x7f51a4003b80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:18:10.673 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:10.667+0000 7f51a37fe640 1 -- 172.21.15.19:0/3821986188 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51a4004040 con 0x7f51ac103430 2024-09-10T22:18:10.673 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:10.667+0000 7f51a37fe640 1 -- 172.21.15.19:0/3821986188 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(25 keys) ==== 1070+0+0 (secure 0 0 0) 0x7f51a4004670 con 0x7f51ac103430 2024-09-10T22:18:10.673 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:10.667+0000 7f51b43f8640 1 -- 172.21.15.19:0/3821986188 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f51ac19cc40 con 0x7f51ac103430 2024-09-10T22:18:10.673 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:10.667+0000 7f51a37fe640 1 -- 172.21.15.19:0/3821986188 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51a403b400 con 0x7f51ac103430 2024-09-10T22:18:10.673 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:10.668+0000 7f51b43f8640 1 -- 172.21.15.19:0/3821986188 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f51ac1a3380 con 0x7f51ac103430 2024-09-10T22:18:10.674 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:10.668+0000 7f51a37fe640 1 -- 172.21.15.19:0/3821986188 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 13) ==== 51480+0+0 (secure 0 0 0) 0x7f51a4030070 con 0x7f51ac103430 2024-09-10T22:18:10.674 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:10.669+0000 7f51a37fe640 1 --2- 172.21.15.19:0/3821986188 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f519803f510 0x7f51980419d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:18:10.674 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:10.669+0000 7f51b43f8640 1 -- 172.21.15.19:0/3821986188 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f51ac101d10 con 0x7f51ac103430 2024-09-10T22:18:10.674 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:10.669+0000 7f51a37fe640 1 -- 172.21.15.19:0/3821986188 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f51a402e030 con 0x7f51ac103430 2024-09-10T22:18:10.674 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:10.669+0000 7f51b2194640 1 --2- 172.21.15.19:0/3821986188 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f519803f510 0x7f51980419d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:18:10.674 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:10.669+0000 7f51b2194640 1 --2- 172.21.15.19:0/3821986188 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f519803f510 0x7f51980419d0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f51a8009bd0 tx=0x7f51a8005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:18:10.675 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:10.674+0000 7f51a37fe640 1 -- 172.21.15.19:0/3821986188 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f51a40412e0 con 0x7f51ac103430 2024-09-10T22:18:10.683 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:10.681+0000 7fe828175640 1 -- 172.21.15.19:0/3028549506 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command([{prefix=config set, name=mon_warn_on_pool_no_app}] v 0) -- 0x7fe820063d50 con 0x7fe820103430 2024-09-10T22:18:10.686 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:10.685+0000 7fe81effd640 1 -- 172.21.15.19:0/3028549506 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_warn_on_pool_no_app}]=0 v15)=0 v15) ==== 125+0+0 (secure 0 0 0) 0x7fe818045d30 con 0x7fe820103430 2024-09-10T22:18:10.689 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:10.688+0000 7fe828175640 1 -- 172.21.15.19:0/3028549506 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7fe80803f510 msgr2=0x7fe8080419d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:18:10.689 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:10.688+0000 7fe828175640 1 --2- 172.21.15.19:0/3028549506 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7fe80803f510 0x7fe8080419d0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fe810009fd0 tx=0x7fe810009680 comp rx=0 tx=0).stop 2024-09-10T22:18:10.689 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:10.688+0000 7fe828175640 1 -- 172.21.15.19:0/3028549506 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe820103430 msgr2=0x7fe82019ffd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:18:10.689 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:10.688+0000 7fe828175640 1 --2- 172.21.15.19:0/3028549506 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe820103430 0x7fe82019ffd0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fe818005940 tx=0x7fe8180040c0 comp rx=0 tx=0).stop 2024-09-10T22:18:10.690 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:10.688+0000 7fe828175640 1 -- 172.21.15.19:0/3028549506 shutdown_connections 2024-09-10T22:18:10.690 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:10.688+0000 7fe828175640 1 --2- 172.21.15.19:0/3028549506 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7fe80803f510 0x7fe8080419d0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:10.690 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:10.688+0000 7fe828175640 1 --2- 172.21.15.19:0/3028549506 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe820103430 0x7fe82019ffd0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:10.690 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:10.688+0000 7fe828175640 1 --2- 172.21.15.19:0/3028549506 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe820102a70 0x7fe82019d9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:10.690 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:10.688+0000 7fe828175640 1 --2- 172.21.15.19:0/3028549506 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe820101910 0x7fe82006b410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:10.690 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:10.688+0000 7fe828175640 1 -- 172.21.15.19:0/3028549506 >> 172.21.15.19:0/3028549506 conn(0x7fe8200fd1e0 msgr2=0x7fe820105e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:18:10.690 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:10.688+0000 7fe828175640 1 -- 172.21.15.19:0/3028549506 shutdown_connections 2024-09-10T22:18:10.690 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:10.688+0000 7fe828175640 1 -- 172.21.15.19:0/3028549506 wait complete. 2024-09-10T22:18:10.871 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:10.868+0000 7f51b43f8640 1 -- 172.21.15.19:0/3821986188 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command([{prefix=config set, name=rados_mon_op_timeout}] v 0) -- 0x7f51ac1a3550 con 0x7f51ac103430 2024-09-10T22:18:10.873 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:10.872+0000 7f51a37fe640 1 -- 172.21.15.19:0/3821986188 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{prefix=config set, name=rados_mon_op_timeout}]=0 v16)=0 v16) ==== 120+0+0 (secure 0 0 0) 0x7f51a4039e70 con 0x7f51ac103430 2024-09-10T22:18:10.875 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:10.874+0000 7f51b43f8640 1 -- 172.21.15.19:0/3821986188 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f519803f510 msgr2=0x7f51980419d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:18:10.875 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:10.874+0000 7f51b43f8640 1 --2- 172.21.15.19:0/3821986188 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f519803f510 0x7f51980419d0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f51a8009bd0 tx=0x7f51a8005f90 comp rx=0 tx=0).stop 2024-09-10T22:18:10.876 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:10.874+0000 7f51b43f8640 1 -- 172.21.15.19:0/3821986188 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f51ac103430 msgr2=0x7f51ac19c110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:18:10.876 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:10.874+0000 7f51b43f8640 1 --2- 172.21.15.19:0/3821986188 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f51ac103430 0x7f51ac19c110 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f51a40097b0 tx=0x7f51a4003b80 comp rx=0 tx=0).stop 2024-09-10T22:18:10.876 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:10.874+0000 7f51b43f8640 1 -- 172.21.15.19:0/3821986188 shutdown_connections 2024-09-10T22:18:10.876 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:10.874+0000 7f51b43f8640 1 --2- 172.21.15.19:0/3821986188 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f519803f510 0x7f51980419d0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:10.876 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:10.874+0000 7f51b43f8640 1 --2- 172.21.15.19:0/3821986188 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f51ac103430 0x7f51ac19c110 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:10.876 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:10.874+0000 7f51b43f8640 1 --2- 172.21.15.19:0/3821986188 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f51ac102a70 0x7f51ac19b4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:10.876 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:10.874+0000 7f51b43f8640 1 --2- 172.21.15.19:0/3821986188 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f51ac101910 0x7f51ac19ae80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:10.876 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:10.874+0000 7f51b43f8640 1 -- 172.21.15.19:0/3821986188 >> 172.21.15.19:0/3821986188 conn(0x7f51ac0fd1e0 msgr2=0x7f51ac0fec60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:18:10.876 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:10.874+0000 7f51b43f8640 1 -- 172.21.15.19:0/3821986188 shutdown_connections 2024-09-10T22:18:10.877 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:10.874+0000 7f51b43f8640 1 -- 172.21.15.19:0/3821986188 wait complete. 2024-09-10T22:18:11.208 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:18:11 smithi019 ceph-mon[31375]: Reconfiguring mgr.x (unknown last config time)... 2024-09-10T22:18:11.209 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:18:11 smithi019 ceph-mon[31375]: Reconfiguring daemon mgr.x on smithi019 2024-09-10T22:18:11.209 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:18:11 smithi019 ceph-mon[31375]: from='mgr.? 172.21.15.138:0/2553218055' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/z/crt"} : dispatch 2024-09-10T22:18:11.209 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:18:11 smithi019 ceph-mon[31375]: from='mgr.? 172.21.15.138:0/2553218055' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/crt"} : dispatch 2024-09-10T22:18:11.209 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:18:11 smithi019 ceph-mon[31375]: from='mgr.? 172.21.15.138:0/2553218055' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/z/key"} : dispatch 2024-09-10T22:18:11.209 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:18:11 smithi019 ceph-mon[31375]: from='mgr.? 172.21.15.138:0/2553218055' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/key"} : dispatch 2024-09-10T22:18:11.209 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:18:11 smithi019 ceph-mon[31375]: Standby manager daemon z started 2024-09-10T22:18:11.209 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:18:11 smithi019 ceph-mon[31375]: from='client.? 172.21.15.19:0/3028549506' entity='client.admin' 2024-09-10T22:18:11.209 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:18:11 smithi019 ceph-mon[31375]: from='client.? 172.21.15.19:0/3821986188' entity='client.admin' 2024-09-10T22:18:11.350 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:11.349+0000 7f0c3d7f6640 1 -- 172.21.15.19:0/1741827051 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f0c38104990 msgr2=0x7f0c38100ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:18:11.351 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:11.349+0000 7f0c3d7f6640 1 --2- 172.21.15.19:0/1741827051 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f0c38104990 0x7f0c38100ad0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f0c20009930 tx=0x7f0c2002a420 comp rx=0 tx=0).stop 2024-09-10T22:18:11.351 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:11.349+0000 7f0c3d7f6640 1 -- 172.21.15.19:0/1741827051 shutdown_connections 2024-09-10T22:18:11.351 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:11.349+0000 7f0c3d7f6640 1 --2- 172.21.15.19:0/1741827051 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0c381011f0 0x7f0c3810b040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:11.351 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:11.349+0000 7f0c3d7f6640 1 --2- 172.21.15.19:0/1741827051 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f0c38104990 0x7f0c38100ad0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:11.351 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:11.349+0000 7f0c3d7f6640 1 --2- 172.21.15.19:0/1741827051 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0c38104050 0x7f0c38104450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:11.351 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:11.349+0000 7f0c3d7f6640 1 -- 172.21.15.19:0/1741827051 >> 172.21.15.19:0/1741827051 conn(0x7f0c380fc960 msgr2=0x7f0c380feda0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:18:11.351 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:11.349+0000 7f0c3d7f6640 1 -- 172.21.15.19:0/1741827051 shutdown_connections 2024-09-10T22:18:11.351 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:11.349+0000 7f0c3d7f6640 1 -- 172.21.15.19:0/1741827051 wait complete. 2024-09-10T22:18:11.353 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:11.350+0000 7f0c3d7f6640 1 Processor -- start 2024-09-10T22:18:11.353 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:11.350+0000 7f0c3d7f6640 1 -- start start 2024-09-10T22:18:11.353 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:11.350+0000 7f0c3d7f6640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0c381011f0 0x7f0c38198d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:18:11.353 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:11.350+0000 7f0c3d7f6640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f0c38104050 0x7f0c381993b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:18:11.353 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:11.350+0000 7f0c3d7f6640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0c38104990 0x7f0c38199ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:18:11.353 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:11.350+0000 7f0c3d7f6640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f0c3810e590 con 0x7f0c381011f0 2024-09-10T22:18:11.354 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:11.350+0000 7f0c3d7f6640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f0c3810e410 con 0x7f0c38104990 2024-09-10T22:18:11.354 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:11.350+0000 7f0c3d7f6640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f0c3810e710 con 0x7f0c38104050 2024-09-10T22:18:11.354 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:11.350+0000 7f0c36ffd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0c381011f0 0x7f0c38198d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:18:11.354 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:11.350+0000 7f0c36ffd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0c381011f0 0x7f0c38198d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:33876/0 (socket says 172.21.15.19:33876) 2024-09-10T22:18:11.354 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:11.350+0000 7f0c36ffd640 1 -- 172.21.15.19:0/1170910396 learned_addr learned my addr 172.21.15.19:0/1170910396 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:18:11.354 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:11.350+0000 7f0c377fe640 1 --2- 172.21.15.19:0/1170910396 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0c38104990 0x7f0c38199ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:18:11.354 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:11.350+0000 7f0c367fc640 1 --2- 172.21.15.19:0/1170910396 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f0c38104050 0x7f0c381993b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:18:11.354 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:11.351+0000 7f0c377fe640 1 -- 172.21.15.19:0/1170910396 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f0c38104050 msgr2=0x7f0c381993b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:18:11.354 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:11.351+0000 7f0c377fe640 1 --2- 172.21.15.19:0/1170910396 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f0c38104050 0x7f0c381993b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:11.354 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:11.351+0000 7f0c377fe640 1 -- 172.21.15.19:0/1170910396 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0c381011f0 msgr2=0x7f0c38198d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:18:11.354 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:11.351+0000 7f0c377fe640 1 --2- 172.21.15.19:0/1170910396 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0c381011f0 0x7f0c38198d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:11.354 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:11.351+0000 7f0c377fe640 1 -- 172.21.15.19:0/1170910396 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0c3819a890 con 0x7f0c38104990 2024-09-10T22:18:11.355 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:11.351+0000 7f0c36ffd640 1 --2- 172.21.15.19:0/1170910396 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0c381011f0 0x7f0c38198d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T22:18:11.355 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:11.351+0000 7f0c377fe640 1 --2- 172.21.15.19:0/1170910396 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0c38104990 0x7f0c38199ff0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f0c2800e970 tx=0x7f0c2800ee30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:18:11.355 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:11.351+0000 7f0c2ffff640 1 -- 172.21.15.19:0/1170910396 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c2800ccc0 con 0x7f0c38104990 2024-09-10T22:18:11.355 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:11.351+0000 7f0c2ffff640 1 -- 172.21.15.19:0/1170910396 <== mon.2 v2:172.21.15.135:3300/0 2 ==== config(25 keys) ==== 1070+0+0 (secure 0 0 0) 0x7f0c28005020 con 0x7f0c38104990 2024-09-10T22:18:11.355 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:11.351+0000 7f0c2ffff640 1 -- 172.21.15.19:0/1170910396 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c2800ce60 con 0x7f0c38104990 2024-09-10T22:18:11.355 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:11.351+0000 7f0c3d7f6640 1 -- 172.21.15.19:0/1170910396 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0c3819ab80 con 0x7f0c38104990 2024-09-10T22:18:11.355 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:11.351+0000 7f0c3d7f6640 1 -- 172.21.15.19:0/1170910396 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0c381a1260 con 0x7f0c38104990 2024-09-10T22:18:11.356 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:11.352+0000 7f0c3d7f6640 1 -- 172.21.15.19:0/1170910396 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0c38104450 con 0x7f0c38104990 2024-09-10T22:18:11.356 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:11.353+0000 7f0c2ffff640 1 -- 172.21.15.19:0/1170910396 <== mon.2 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 14) ==== 102337+0+0 (secure 0 0 0) 0x7f0c28004a00 con 0x7f0c38104990 2024-09-10T22:18:11.356 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:11.353+0000 7f0c2ffff640 1 --2- 172.21.15.19:0/1170910396 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f0c2407a3b0 0x7f0c2407c870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:18:11.356 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:11.353+0000 7f0c36ffd640 1 --2- 172.21.15.19:0/1170910396 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f0c2407a3b0 0x7f0c2407c870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:18:11.356 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:11.354+0000 7f0c2ffff640 1 -- 172.21.15.19:0/1170910396 <== mon.2 v2:172.21.15.135:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f0c2809bc70 con 0x7f0c38104990 2024-09-10T22:18:11.356 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:11.354+0000 7f0c36ffd640 1 --2- 172.21.15.19:0/1170910396 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f0c2407a3b0 0x7f0c2407c870 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f0c3000f7d0 tx=0x7f0c30009500 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:18:11.359 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:11.358+0000 7f0c2ffff640 1 -- 172.21.15.19:0/1170910396 <== mon.2 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f0c280051d0 con 0x7f0c38104990 2024-09-10T22:18:11.360 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:18:11 smithi135 ceph-mon[34789]: Reconfiguring mgr.x (unknown last config time)... 2024-09-10T22:18:11.360 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:18:11 smithi135 ceph-mon[34789]: Reconfiguring daemon mgr.x on smithi019 2024-09-10T22:18:11.360 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:18:11 smithi135 ceph-mon[34789]: from='mgr.? 172.21.15.138:0/2553218055' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/z/crt"} : dispatch 2024-09-10T22:18:11.360 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:18:11 smithi135 ceph-mon[34789]: from='mgr.? 172.21.15.138:0/2553218055' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/crt"} : dispatch 2024-09-10T22:18:11.360 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:18:11 smithi135 ceph-mon[34789]: from='mgr.? 172.21.15.138:0/2553218055' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/z/key"} : dispatch 2024-09-10T22:18:11.360 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:18:11 smithi135 ceph-mon[34789]: from='mgr.? 172.21.15.138:0/2553218055' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/key"} : dispatch 2024-09-10T22:18:11.360 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:18:11 smithi135 ceph-mon[34789]: Standby manager daemon z started 2024-09-10T22:18:11.360 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:18:11 smithi135 ceph-mon[34789]: from='client.? 172.21.15.19:0/3028549506' entity='client.admin' 2024-09-10T22:18:11.360 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:18:11 smithi135 ceph-mon[34789]: from='client.? 172.21.15.19:0/3821986188' entity='client.admin' 2024-09-10T22:18:11.375 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:18:11 smithi138 ceph-mon[35236]: Reconfiguring mgr.x (unknown last config time)... 2024-09-10T22:18:11.375 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:18:11 smithi138 ceph-mon[35236]: Reconfiguring daemon mgr.x on smithi019 2024-09-10T22:18:11.375 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:18:11 smithi138 ceph-mon[35236]: from='mgr.? 172.21.15.138:0/2553218055' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/z/crt"} : dispatch 2024-09-10T22:18:11.375 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:18:11 smithi138 ceph-mon[35236]: from='mgr.? 172.21.15.138:0/2553218055' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/crt"} : dispatch 2024-09-10T22:18:11.375 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:18:11 smithi138 ceph-mon[35236]: from='mgr.? 172.21.15.138:0/2553218055' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/z/key"} : dispatch 2024-09-10T22:18:11.375 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:18:11 smithi138 ceph-mon[35236]: from='mgr.? 172.21.15.138:0/2553218055' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/key"} : dispatch 2024-09-10T22:18:11.376 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:18:11 smithi138 ceph-mon[35236]: Standby manager daemon z started 2024-09-10T22:18:11.376 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:18:11 smithi138 ceph-mon[35236]: from='client.? 172.21.15.19:0/3028549506' entity='client.admin' 2024-09-10T22:18:11.376 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:18:11 smithi138 ceph-mon[35236]: from='client.? 172.21.15.19:0/3821986188' entity='client.admin' 2024-09-10T22:18:11.556 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:11.554+0000 7f0c3d7f6640 1 -- 172.21.15.19:0/1170910396 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command([{prefix=config set, name=mds_op_complaint_time}] v 0) -- 0x7f0c381a1550 con 0x7f0c38104990 2024-09-10T22:18:11.560 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:11.559+0000 7f0c2ffff640 1 -- 172.21.15.19:0/1170910396 <== mon.2 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_op_complaint_time}]=0 v17)=0 v17) ==== 121+0+0 (secure 0 0 0) 0x7f0c28064350 con 0x7f0c38104990 2024-09-10T22:18:11.563 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:11.561+0000 7f0c3d7f6640 1 -- 172.21.15.19:0/1170910396 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f0c2407a3b0 msgr2=0x7f0c2407c870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:18:11.563 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:11.561+0000 7f0c3d7f6640 1 --2- 172.21.15.19:0/1170910396 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f0c2407a3b0 0x7f0c2407c870 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f0c3000f7d0 tx=0x7f0c30009500 comp rx=0 tx=0).stop 2024-09-10T22:18:11.563 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:11.561+0000 7f0c3d7f6640 1 -- 172.21.15.19:0/1170910396 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0c38104990 msgr2=0x7f0c38199ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:18:11.563 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:11.561+0000 7f0c3d7f6640 1 --2- 172.21.15.19:0/1170910396 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0c38104990 0x7f0c38199ff0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f0c2800e970 tx=0x7f0c2800ee30 comp rx=0 tx=0).stop 2024-09-10T22:18:11.563 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:11.561+0000 7f0c3d7f6640 1 -- 172.21.15.19:0/1170910396 shutdown_connections 2024-09-10T22:18:11.563 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:11.561+0000 7f0c3d7f6640 1 --2- 172.21.15.19:0/1170910396 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f0c2407a3b0 0x7f0c2407c870 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:11.564 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:11.561+0000 7f0c3d7f6640 1 --2- 172.21.15.19:0/1170910396 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0c38104990 0x7f0c38199ff0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:11.564 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:11.561+0000 7f0c3d7f6640 1 --2- 172.21.15.19:0/1170910396 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f0c38104050 0x7f0c381993b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:11.564 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:11.561+0000 7f0c3d7f6640 1 --2- 172.21.15.19:0/1170910396 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0c381011f0 0x7f0c38198d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:11.564 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:11.561+0000 7f0c3d7f6640 1 -- 172.21.15.19:0/1170910396 >> 172.21.15.19:0/1170910396 conn(0x7f0c380fc960 msgr2=0x7f0c381050e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:18:11.564 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:11.562+0000 7f0c3d7f6640 1 -- 172.21.15.19:0/1170910396 shutdown_connections 2024-09-10T22:18:11.564 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:11.562+0000 7f0c3d7f6640 1 -- 172.21.15.19:0/1170910396 wait complete. 2024-09-10T22:18:12.304 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:18:12 smithi019 ceph-mon[31375]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T22:18:12.304 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:18:12 smithi019 ceph-mon[31375]: mgrmap e14: x(active, since 66s), standbys: z 2024-09-10T22:18:12.304 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:18:12 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "z", "id": "z"} : dispatch 2024-09-10T22:18:12.304 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:18:12 smithi019 ceph-mon[31375]: from='client.? ' entity='client.admin' 2024-09-10T22:18:12.360 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:18:12 smithi135 ceph-mon[34789]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T22:18:12.360 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:18:12 smithi135 ceph-mon[34789]: mgrmap e14: x(active, since 66s), standbys: z 2024-09-10T22:18:12.360 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:18:12 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "z", "id": "z"} : dispatch 2024-09-10T22:18:12.360 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:18:12 smithi135 ceph-mon[34789]: from='client.? ' entity='client.admin' 2024-09-10T22:18:12.376 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:18:12 smithi138 ceph-mon[35236]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T22:18:12.376 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:18:12 smithi138 ceph-mon[35236]: mgrmap e14: x(active, since 66s), standbys: z 2024-09-10T22:18:12.376 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:18:12 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "z", "id": "z"} : dispatch 2024-09-10T22:18:12.376 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:18:12 smithi138 ceph-mon[35236]: from='client.? ' entity='client.admin' 2024-09-10T22:18:13.185 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:18:13 smithi019 ceph-mon[31375]: Standby manager daemon y started 2024-09-10T22:18:13.185 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:18:13 smithi019 ceph-mon[31375]: from='mgr.? 172.21.15.135:0/795507581' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/y/crt"} : dispatch 2024-09-10T22:18:13.185 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:18:13 smithi019 ceph-mon[31375]: from='mgr.? 172.21.15.135:0/795507581' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/crt"} : dispatch 2024-09-10T22:18:13.185 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:18:13 smithi019 ceph-mon[31375]: from='mgr.? 172.21.15.135:0/795507581' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/y/key"} : dispatch 2024-09-10T22:18:13.185 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:18:13 smithi019 ceph-mon[31375]: from='mgr.? 172.21.15.135:0/795507581' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/key"} : dispatch 2024-09-10T22:18:13.360 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:18:13 smithi135 ceph-mon[34789]: Standby manager daemon y started 2024-09-10T22:18:13.360 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:18:13 smithi135 ceph-mon[34789]: from='mgr.? 172.21.15.135:0/795507581' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/y/crt"} : dispatch 2024-09-10T22:18:13.360 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:18:13 smithi135 ceph-mon[34789]: from='mgr.? 172.21.15.135:0/795507581' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/crt"} : dispatch 2024-09-10T22:18:13.360 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:18:13 smithi135 ceph-mon[34789]: from='mgr.? 172.21.15.135:0/795507581' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/y/key"} : dispatch 2024-09-10T22:18:13.360 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:18:13 smithi135 ceph-mon[34789]: from='mgr.? 172.21.15.135:0/795507581' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/key"} : dispatch 2024-09-10T22:18:13.375 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:18:13 smithi138 ceph-mon[35236]: Standby manager daemon y started 2024-09-10T22:18:13.375 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:18:13 smithi138 ceph-mon[35236]: from='mgr.? 172.21.15.135:0/795507581' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/y/crt"} : dispatch 2024-09-10T22:18:13.375 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:18:13 smithi138 ceph-mon[35236]: from='mgr.? 172.21.15.135:0/795507581' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/crt"} : dispatch 2024-09-10T22:18:13.375 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:18:13 smithi138 ceph-mon[35236]: from='mgr.? 172.21.15.135:0/795507581' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/y/key"} : dispatch 2024-09-10T22:18:13.376 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:18:13 smithi138 ceph-mon[35236]: from='mgr.? 172.21.15.135:0/795507581' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/key"} : dispatch 2024-09-10T22:18:14.090 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:18:14 smithi019 ceph-mon[31375]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T22:18:14.091 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:18:14 smithi019 ceph-mon[31375]: mgrmap e15: x(active, since 68s), standbys: z, y 2024-09-10T22:18:14.091 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:18:14 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "y", "id": "y"} : dispatch 2024-09-10T22:18:14.091 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:18:14 smithi019 ceph-mon[31375]: from='client.? 172.21.15.19:0/1778901359' entity='client.admin' 2024-09-10T22:18:14.359 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:18:14 smithi135 ceph-mon[34789]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T22:18:14.360 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:18:14 smithi135 ceph-mon[34789]: mgrmap e15: x(active, since 68s), standbys: z, y 2024-09-10T22:18:14.360 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:18:14 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "y", "id": "y"} : dispatch 2024-09-10T22:18:14.360 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:18:14 smithi135 ceph-mon[34789]: from='client.? 172.21.15.19:0/1778901359' entity='client.admin' 2024-09-10T22:18:14.375 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:18:14 smithi138 ceph-mon[35236]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T22:18:14.375 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:18:14 smithi138 ceph-mon[35236]: mgrmap e15: x(active, since 68s), standbys: z, y 2024-09-10T22:18:14.375 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:18:14 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "y", "id": "y"} : dispatch 2024-09-10T22:18:14.375 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:18:14 smithi138 ceph-mon[35236]: from='client.? 172.21.15.19:0/1778901359' entity='client.admin' 2024-09-10T22:18:14.869 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:14.867+0000 7fd49b783640 1 -- 172.21.15.19:0/1182866180 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd494104540 msgr2=0x7fd49410aec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:18:14.869 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:14.867+0000 7fd49b783640 1 --2- 172.21.15.19:0/1182866180 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd494104540 0x7fd49410aec0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fd48c009cd0 tx=0x7fd48c02a8e0 comp rx=0 tx=0).stop 2024-09-10T22:18:14.869 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:14.867+0000 7fd49b783640 1 -- 172.21.15.19:0/1182866180 shutdown_connections 2024-09-10T22:18:14.869 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:14.867+0000 7fd49b783640 1 --2- 172.21.15.19:0/1182866180 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd494104540 0x7fd49410aec0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:14.869 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:14.867+0000 7fd49b783640 1 --2- 172.21.15.19:0/1182866180 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd494103b80 0x7fd494104000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:14.869 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:14.867+0000 7fd49b783640 1 --2- 172.21.15.19:0/1182866180 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd494102a20 0x7fd494102e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:14.870 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:14.867+0000 7fd49b783640 1 -- 172.21.15.19:0/1182866180 >> 172.21.15.19:0/1182866180 conn(0x7fd4940fe2f0 msgr2=0x7fd494100730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:18:14.870 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:14.868+0000 7fd49b783640 1 -- 172.21.15.19:0/1182866180 shutdown_connections 2024-09-10T22:18:14.870 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:14.868+0000 7fd49b783640 1 -- 172.21.15.19:0/1182866180 wait complete. 2024-09-10T22:18:14.871 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:14.868+0000 7fd49b783640 1 Processor -- start 2024-09-10T22:18:14.871 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:14.868+0000 7fd49b783640 1 -- start start 2024-09-10T22:18:14.871 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:14.869+0000 7fd49b783640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd494102a20 0x7fd494076cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:18:14.871 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:14.869+0000 7fd49b783640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd494103b80 0x7fd494075540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:18:14.872 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:14.869+0000 7fd49b783640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd494104540 0x7fd494075a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:18:14.872 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:14.869+0000 7fd49951f640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd494102a20 0x7fd494076cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:18:14.872 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:14.869+0000 7fd49b783640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fd49410e590 con 0x7fd494102a20 2024-09-10T22:18:14.872 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:14.869+0000 7fd49b783640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fd49410e410 con 0x7fd494103b80 2024-09-10T22:18:14.872 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:14.869+0000 7fd49b783640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7fd49410e710 con 0x7fd494104540 2024-09-10T22:18:14.872 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:14.869+0000 7fd49951f640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd494102a20 0x7fd494076cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:35132/0 (socket says 172.21.15.19:35132) 2024-09-10T22:18:14.872 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:14.869+0000 7fd49951f640 1 -- 172.21.15.19:0/1542813111 learned_addr learned my addr 172.21.15.19:0/1542813111 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:18:14.872 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:14.869+0000 7fd498d1e640 1 --2- 172.21.15.19:0/1542813111 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd494103b80 0x7fd494075540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:18:14.872 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:14.869+0000 7fd499d20640 1 --2- 172.21.15.19:0/1542813111 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd494104540 0x7fd494075a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:18:14.872 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:14.869+0000 7fd49951f640 1 -- 172.21.15.19:0/1542813111 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd494104540 msgr2=0x7fd494075a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:18:14.872 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:14.869+0000 7fd49951f640 1 --2- 172.21.15.19:0/1542813111 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd494104540 0x7fd494075a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:14.872 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:14.869+0000 7fd49951f640 1 -- 172.21.15.19:0/1542813111 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd494103b80 msgr2=0x7fd494075540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:18:14.873 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:14.869+0000 7fd49951f640 1 --2- 172.21.15.19:0/1542813111 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd494103b80 0x7fd494075540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:14.873 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:14.869+0000 7fd49951f640 1 -- 172.21.15.19:0/1542813111 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd494076340 con 0x7fd494102a20 2024-09-10T22:18:14.873 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:14.870+0000 7fd49951f640 1 --2- 172.21.15.19:0/1542813111 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd494102a20 0x7fd494076cd0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fd49000c920 tx=0x7fd49000cd20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:18:14.873 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:14.870+0000 7fd48a7fc640 1 -- 172.21.15.19:0/1542813111 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd490007bb0 con 0x7fd494102a20 2024-09-10T22:18:14.873 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:14.870+0000 7fd48a7fc640 1 -- 172.21.15.19:0/1542813111 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(25 keys) ==== 1070+0+0 (secure 0 0 0) 0x7fd490007d50 con 0x7fd494102a20 2024-09-10T22:18:14.873 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:14.870+0000 7fd49b783640 1 -- 172.21.15.19:0/1542813111 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd4941a2c40 con 0x7fd494102a20 2024-09-10T22:18:14.873 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:14.870+0000 7fd48a7fc640 1 -- 172.21.15.19:0/1542813111 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd490018660 con 0x7fd494102a20 2024-09-10T22:18:14.873 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:14.871+0000 7fd49b783640 1 -- 172.21.15.19:0/1542813111 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd4941a3150 con 0x7fd494102a20 2024-09-10T22:18:14.874 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:14.872+0000 7fd49b783640 1 -- 172.21.15.19:0/1542813111 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd494102e20 con 0x7fd494102a20 2024-09-10T22:18:14.874 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:14.873+0000 7fd48a7fc640 1 -- 172.21.15.19:0/1542813111 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 15) ==== 153194+0+0 (secure 0 0 0) 0x7fd49000f450 con 0x7fd494102a20 2024-09-10T22:18:14.875 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:14.874+0000 7fd48a7fc640 1 --2- 172.21.15.19:0/1542813111 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7fd4800b5250 0x7fd4800b7710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:18:14.875 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:14.874+0000 7fd48a7fc640 1 -- 172.21.15.19:0/1542813111 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7fd4900e4000 con 0x7fd494102a20 2024-09-10T22:18:14.875 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:14.874+0000 7fd498d1e640 1 --2- 172.21.15.19:0/1542813111 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7fd4800b5250 0x7fd4800b7710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:18:14.876 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:14.875+0000 7fd498d1e640 1 --2- 172.21.15.19:0/1542813111 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7fd4800b5250 0x7fd4800b7710 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fd48400ac30 tx=0x7fd48400a2d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:18:14.880 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:14.879+0000 7fd48a7fc640 1 -- 172.21.15.19:0/1542813111 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7fd490014030 con 0x7fd494102a20 2024-09-10T22:18:14.957 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:14.955+0000 7fd48a7fc640 1 -- 172.21.15.19:0/1542813111 <== mon.0 v2:172.21.15.19:3300/0 7 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd4900abfa0 con 0x7fd494102a20 2024-09-10T22:18:15.075 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:15.073+0000 7fd49b783640 1 -- 172.21.15.19:0/1542813111 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command([{prefix=config set, name=mds_debug_scatterstat}] v 0) -- 0x7fd494109cd0 con 0x7fd494102a20 2024-09-10T22:18:15.078 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:15.077+0000 7fd48a7fc640 1 -- 172.21.15.19:0/1542813111 <== mon.0 v2:172.21.15.19:3300/0 8 ==== mon_command_ack([{prefix=config set, name=mds_debug_scatterstat}]=0 v22)=0 v22) ==== 122+0+0 (secure 0 0 0) 0x7fd4900acb90 con 0x7fd494102a20 2024-09-10T22:18:15.081 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:15.079+0000 7fd49b783640 1 -- 172.21.15.19:0/1542813111 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7fd4800b5250 msgr2=0x7fd4800b7710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:18:15.081 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:15.079+0000 7fd49b783640 1 --2- 172.21.15.19:0/1542813111 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7fd4800b5250 0x7fd4800b7710 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fd48400ac30 tx=0x7fd48400a2d0 comp rx=0 tx=0).stop 2024-09-10T22:18:15.081 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:15.079+0000 7fd49b783640 1 -- 172.21.15.19:0/1542813111 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd494102a20 msgr2=0x7fd494076cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:18:15.081 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:15.079+0000 7fd49b783640 1 --2- 172.21.15.19:0/1542813111 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd494102a20 0x7fd494076cd0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fd49000c920 tx=0x7fd49000cd20 comp rx=0 tx=0).stop 2024-09-10T22:18:15.081 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:15.079+0000 7fd49b783640 1 -- 172.21.15.19:0/1542813111 shutdown_connections 2024-09-10T22:18:15.081 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:15.079+0000 7fd49b783640 1 --2- 172.21.15.19:0/1542813111 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7fd4800b5250 0x7fd4800b7710 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:15.081 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:15.079+0000 7fd49b783640 1 --2- 172.21.15.19:0/1542813111 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd494104540 0x7fd494075a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:15.082 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:15.079+0000 7fd49b783640 1 --2- 172.21.15.19:0/1542813111 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd494103b80 0x7fd494075540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:15.082 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:15.079+0000 7fd49b783640 1 --2- 172.21.15.19:0/1542813111 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd494102a20 0x7fd494076cd0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:15.082 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:15.079+0000 7fd49b783640 1 -- 172.21.15.19:0/1542813111 >> 172.21.15.19:0/1542813111 conn(0x7fd4940fe2f0 msgr2=0x7fd494106ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:18:15.082 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:15.079+0000 7fd49b783640 1 -- 172.21.15.19:0/1542813111 shutdown_connections 2024-09-10T22:18:15.082 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:15.079+0000 7fd49b783640 1 -- 172.21.15.19:0/1542813111 wait complete. 2024-09-10T22:18:15.369 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:14.640+0000 7fcbf75a7640 1 -- 172.21.15.19:0/163491664 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fcbf0102a70 msgr2=0x7fcbf0102ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:18:15.369 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:14.640+0000 7fcbf75a7640 1 --2- 172.21.15.19:0/163491664 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fcbf0102a70 0x7fcbf0102ef0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fcbe0009930 tx=0x7fcbe002a420 comp rx=0 tx=0).stop 2024-09-10T22:18:15.369 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:14.641+0000 7fcbf75a7640 1 -- 172.21.15.19:0/163491664 shutdown_connections 2024-09-10T22:18:15.369 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:14.641+0000 7fcbf75a7640 1 --2- 172.21.15.19:0/163491664 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fcbf0103430 0x7fcbf0109db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:15.369 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:14.641+0000 7fcbf75a7640 1 --2- 172.21.15.19:0/163491664 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fcbf0102a70 0x7fcbf0102ef0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:15.370 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:14.641+0000 7fcbf75a7640 1 --2- 172.21.15.19:0/163491664 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcbf0101910 0x7fcbf0101d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:15.370 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:14.641+0000 7fcbf75a7640 1 -- 172.21.15.19:0/163491664 >> 172.21.15.19:0/163491664 conn(0x7fcbf00fd1e0 msgr2=0x7fcbf00ff620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:18:15.370 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:14.641+0000 7fcbf75a7640 1 -- 172.21.15.19:0/163491664 shutdown_connections 2024-09-10T22:18:15.370 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:14.641+0000 7fcbf75a7640 1 -- 172.21.15.19:0/163491664 wait complete. 2024-09-10T22:18:15.370 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:14.641+0000 7fcbf75a7640 1 Processor -- start 2024-09-10T22:18:15.370 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:14.641+0000 7fcbf75a7640 1 -- start start 2024-09-10T22:18:15.370 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:14.642+0000 7fcbf75a7640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcbf0101910 0x7fcbf0198d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:18:15.370 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:14.642+0000 7fcbf75a7640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fcbf0102a70 0x7fcbf0199390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:18:15.370 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:14.642+0000 7fcbf75a7640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fcbf0103430 0x7fcbf0199fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:18:15.370 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:14.642+0000 7fcbf75a7640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fcbf010d480 con 0x7fcbf0103430 2024-09-10T22:18:15.371 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:14.642+0000 7fcbf75a7640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fcbf010d300 con 0x7fcbf0101910 2024-09-10T22:18:15.371 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:14.642+0000 7fcbf75a7640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7fcbf010d600 con 0x7fcbf0102a70 2024-09-10T22:18:15.371 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:14.642+0000 7fcbf5b44640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fcbf0103430 0x7fcbf0199fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:18:15.371 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:14.642+0000 7fcbf5b44640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fcbf0103430 0x7fcbf0199fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:35090/0 (socket says 172.21.15.19:35090) 2024-09-10T22:18:15.371 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:14.642+0000 7fcbf5343640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcbf0101910 0x7fcbf0198d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:18:15.371 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:14.642+0000 7fcbf5b44640 1 -- 172.21.15.19:0/1366725957 learned_addr learned my addr 172.21.15.19:0/1366725957 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:18:15.371 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:14.642+0000 7fcbf4b42640 1 --2- 172.21.15.19:0/1366725957 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fcbf0102a70 0x7fcbf0199390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:18:15.371 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:14.642+0000 7fcbf5b44640 1 -- 172.21.15.19:0/1366725957 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fcbf0102a70 msgr2=0x7fcbf0199390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:18:15.371 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:14.642+0000 7fcbf5b44640 1 --2- 172.21.15.19:0/1366725957 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fcbf0102a70 0x7fcbf0199390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:15.372 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:14.642+0000 7fcbf5b44640 1 -- 172.21.15.19:0/1366725957 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcbf0101910 msgr2=0x7fcbf0198d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:18:15.372 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:14.642+0000 7fcbf5b44640 1 --2- 172.21.15.19:0/1366725957 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcbf0101910 0x7fcbf0198d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:15.372 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:14.642+0000 7fcbf5b44640 1 -- 172.21.15.19:0/1366725957 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcbf019a870 con 0x7fcbf0103430 2024-09-10T22:18:15.372 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:14.642+0000 7fcbf5b44640 1 --2- 172.21.15.19:0/1366725957 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fcbf0103430 0x7fcbf0199fd0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fcbe800eaa0 tx=0x7fcbe800ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:18:15.372 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:14.642+0000 7fcbe67fc640 1 -- 172.21.15.19:0/1366725957 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcbe800cdb0 con 0x7fcbf0103430 2024-09-10T22:18:15.372 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:14.643+0000 7fcbe67fc640 1 -- 172.21.15.19:0/1366725957 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(25 keys) ==== 1070+0+0 (secure 0 0 0) 0x7fcbe8005020 con 0x7fcbf0103430 2024-09-10T22:18:15.372 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:14.643+0000 7fcbf75a7640 1 -- 172.21.15.19:0/1366725957 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcbf019ab60 con 0x7fcbf0103430 2024-09-10T22:18:15.372 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:14.643+0000 7fcbe67fc640 1 -- 172.21.15.19:0/1366725957 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcbe80116d0 con 0x7fcbf0103430 2024-09-10T22:18:15.372 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:14.643+0000 7fcbf75a7640 1 -- 172.21.15.19:0/1366725957 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcbf01a1240 con 0x7fcbf0103430 2024-09-10T22:18:15.373 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:14.644+0000 7fcbf75a7640 1 -- 172.21.15.19:0/1366725957 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcbf0101d10 con 0x7fcbf0103430 2024-09-10T22:18:15.373 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:14.645+0000 7fcbe67fc640 1 -- 172.21.15.19:0/1366725957 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 15) ==== 153194+0+0 (secure 0 0 0) 0x7fcbe800f040 con 0x7fcbf0103430 2024-09-10T22:18:15.373 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:14.646+0000 7fcbe67fc640 1 --2- 172.21.15.19:0/1366725957 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7fcbdc0b52d0 0x7fcbdc0b7790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:18:15.373 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:14.646+0000 7fcbf5343640 1 --2- 172.21.15.19:0/1366725957 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7fcbdc0b52d0 0x7fcbdc0b7790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:18:15.373 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:14.647+0000 7fcbe67fc640 1 -- 172.21.15.19:0/1366725957 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7fcbe80e3c40 con 0x7fcbf0103430 2024-09-10T22:18:15.373 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:14.647+0000 7fcbf5343640 1 --2- 172.21.15.19:0/1366725957 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7fcbdc0b52d0 0x7fcbdc0b7790 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fcbec00bbe0 tx=0x7fcbec00b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:18:15.373 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:14.650+0000 7fcbe67fc640 1 -- 172.21.15.19:0/1366725957 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7fcbe80ea080 con 0x7fcbf0103430 2024-09-10T22:18:15.373 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:14.842+0000 7fcbf75a7640 1 -- 172.21.15.19:0/1366725957 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command([{prefix=config set, name=osd_op_complaint_time}] v 0) -- 0x7fcbf01a1870 con 0x7fcbf0103430 2024-09-10T22:18:15.373 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:14.846+0000 7fcbe67fc640 1 -- 172.21.15.19:0/1366725957 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{prefix=config set, name=osd_op_complaint_time}]=0 v20)=0 v20) ==== 121+0+0 (secure 0 0 0) 0x7fcbe8016030 con 0x7fcbf0103430 2024-09-10T22:18:15.373 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:14.849+0000 7fcbf75a7640 1 -- 172.21.15.19:0/1366725957 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7fcbdc0b52d0 msgr2=0x7fcbdc0b7790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:18:15.374 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:14.849+0000 7fcbf75a7640 1 --2- 172.21.15.19:0/1366725957 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7fcbdc0b52d0 0x7fcbdc0b7790 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fcbec00bbe0 tx=0x7fcbec00b390 comp rx=0 tx=0).stop 2024-09-10T22:18:15.374 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:14.849+0000 7fcbf75a7640 1 -- 172.21.15.19:0/1366725957 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fcbf0103430 msgr2=0x7fcbf0199fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:18:15.374 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:14.849+0000 7fcbf75a7640 1 --2- 172.21.15.19:0/1366725957 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fcbf0103430 0x7fcbf0199fd0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fcbe800eaa0 tx=0x7fcbe800ef60 comp rx=0 tx=0).stop 2024-09-10T22:18:15.374 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:14.849+0000 7fcbf75a7640 1 -- 172.21.15.19:0/1366725957 shutdown_connections 2024-09-10T22:18:15.374 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:14.849+0000 7fcbf75a7640 1 --2- 172.21.15.19:0/1366725957 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7fcbdc0b52d0 0x7fcbdc0b7790 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:15.374 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:14.849+0000 7fcbf75a7640 1 --2- 172.21.15.19:0/1366725957 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fcbf0103430 0x7fcbf0199fd0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:15.374 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:14.849+0000 7fcbf75a7640 1 --2- 172.21.15.19:0/1366725957 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fcbf0102a70 0x7fcbf0199390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:15.374 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:14.849+0000 7fcbf75a7640 1 --2- 172.21.15.19:0/1366725957 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcbf0101910 0x7fcbf0198d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:15.375 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:14.849+0000 7fcbf75a7640 1 -- 172.21.15.19:0/1366725957 >> 172.21.15.19:0/1366725957 conn(0x7fcbf00fd1e0 msgr2=0x7fcbf00fec90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:18:15.375 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:14.849+0000 7fcbf75a7640 1 -- 172.21.15.19:0/1366725957 shutdown_connections 2024-09-10T22:18:15.375 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:14.849+0000 7fcbf75a7640 1 -- 172.21.15.19:0/1366725957 wait complete. 2024-09-10T22:18:15.728 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:15.727+0000 7f503b892640 1 -- 172.21.15.19:0/3119771913 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f503406b620 msgr2=0x7f50341056b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:18:15.729 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:15.727+0000 7f503b892640 1 --2- 172.21.15.19:0/3119771913 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f503406b620 0x7f50341056b0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f5030009900 tx=0x7f503002a410 comp rx=0 tx=0).stop 2024-09-10T22:18:15.729 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:15.727+0000 7f503b892640 1 -- 172.21.15.19:0/3119771913 shutdown_connections 2024-09-10T22:18:15.729 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:15.727+0000 7f503b892640 1 --2- 172.21.15.19:0/3119771913 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5034108720 0x7f503410abe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:15.729 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:15.727+0000 7f503b892640 1 --2- 172.21.15.19:0/3119771913 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5034105bf0 0x7f5034107fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:15.729 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:15.727+0000 7f503b892640 1 --2- 172.21.15.19:0/3119771913 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f503406b620 0x7f50341056b0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:15.729 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:15.727+0000 7f503b892640 1 -- 172.21.15.19:0/3119771913 >> 172.21.15.19:0/3119771913 conn(0x7f50340fd1e0 msgr2=0x7f50340ff620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:18:15.731 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:15.728+0000 7f503b892640 1 -- 172.21.15.19:0/3119771913 shutdown_connections 2024-09-10T22:18:15.732 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:15.728+0000 7f503b892640 1 -- 172.21.15.19:0/3119771913 wait complete. 2024-09-10T22:18:15.732 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:15.728+0000 7f503b892640 1 Processor -- start 2024-09-10T22:18:15.732 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:15.728+0000 7f503b892640 1 -- start start 2024-09-10T22:18:15.732 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:15.728+0000 7f503b892640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f503406b620 0x7f503419b010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:18:15.732 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:15.728+0000 7f503b892640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5034105bf0 0x7f503419b660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:18:15.732 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:15.728+0000 7f503b892640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5034108720 0x7f503419c2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:18:15.732 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:15.728+0000 7f503b892640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f503410e6a0 con 0x7f5034105bf0 2024-09-10T22:18:15.732 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:15.728+0000 7f503b892640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f503410e520 con 0x7f503406b620 2024-09-10T22:18:15.732 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:15.728+0000 7f503b892640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f503410e820 con 0x7f5034108720 2024-09-10T22:18:15.732 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:15.728+0000 7f5038e2d640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5034105bf0 0x7f503419b660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:18:15.732 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:15.729+0000 7f5038e2d640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5034105bf0 0x7f503419b660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:35164/0 (socket says 172.21.15.19:35164) 2024-09-10T22:18:15.732 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:15.729+0000 7f5038e2d640 1 -- 172.21.15.19:0/350684815 learned_addr learned my addr 172.21.15.19:0/350684815 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:18:15.733 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:15.729+0000 7f503962e640 1 --2- 172.21.15.19:0/350684815 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f503406b620 0x7f503419b010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:18:15.733 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:15.729+0000 7f5039e2f640 1 --2- 172.21.15.19:0/350684815 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5034108720 0x7f503419c2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:18:15.733 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:15.729+0000 7f5038e2d640 1 -- 172.21.15.19:0/350684815 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5034108720 msgr2=0x7f503419c2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:18:15.733 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:15.729+0000 7f5038e2d640 1 --2- 172.21.15.19:0/350684815 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5034108720 0x7f503419c2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:15.733 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:15.729+0000 7f5038e2d640 1 -- 172.21.15.19:0/350684815 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f503406b620 msgr2=0x7f503419b010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:18:15.733 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:15.729+0000 7f5038e2d640 1 --2- 172.21.15.19:0/350684815 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f503406b620 0x7f503419b010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:15.733 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:15.729+0000 7f5038e2d640 1 -- 172.21.15.19:0/350684815 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f503419cb40 con 0x7f5034105bf0 2024-09-10T22:18:15.733 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:15.729+0000 7f5039e2f640 1 --2- 172.21.15.19:0/350684815 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5034108720 0x7f503419c2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T22:18:15.733 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:15.729+0000 7f5038e2d640 1 --2- 172.21.15.19:0/350684815 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5034105bf0 0x7f503419b660 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f502400e9f0 tx=0x7f502400eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:18:15.733 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:15.729+0000 7f502a7fc640 1 -- 172.21.15.19:0/350684815 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f502400cd80 con 0x7f5034105bf0 2024-09-10T22:18:15.733 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:15.729+0000 7f503b892640 1 -- 172.21.15.19:0/350684815 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f503419ce30 con 0x7f5034105bf0 2024-09-10T22:18:15.733 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:15.729+0000 7f502a7fc640 1 -- 172.21.15.19:0/350684815 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f50240108e0 con 0x7f5034105bf0 2024-09-10T22:18:15.734 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:15.729+0000 7f502a7fc640 1 -- 172.21.15.19:0/350684815 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5024018980 con 0x7f5034105bf0 2024-09-10T22:18:15.734 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:15.729+0000 7f503b892640 1 -- 172.21.15.19:0/350684815 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f50341a3510 con 0x7f5034105bf0 2024-09-10T22:18:15.734 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:15.730+0000 7f503b892640 1 -- 172.21.15.19:0/350684815 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f50341a3740 con 0x7f5034105bf0 2024-09-10T22:18:15.735 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:15.732+0000 7f502a7fc640 1 -- 172.21.15.19:0/350684815 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 15) ==== 153194+0+0 (secure 0 0 0) 0x7f5024010430 con 0x7f5034105bf0 2024-09-10T22:18:15.735 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:15.732+0000 7f502a7fc640 1 --2- 172.21.15.19:0/350684815 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f50200b5250 0x7f50200b7710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:18:15.735 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:15.733+0000 7f503962e640 1 --2- 172.21.15.19:0/350684815 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f50200b5250 0x7f50200b7710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:18:15.735 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:15.733+0000 7f502a7fc640 1 -- 172.21.15.19:0/350684815 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f50240e4740 con 0x7f5034105bf0 2024-09-10T22:18:15.735 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:15.733+0000 7f503962e640 1 --2- 172.21.15.19:0/350684815 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f50200b5250 0x7f50200b7710 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f5030031500 tx=0x7f5030005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:18:15.737 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:15.735+0000 7f502a7fc640 1 -- 172.21.15.19:0/350684815 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f50240ad2d0 con 0x7f5034105bf0 2024-09-10T22:18:15.924 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:15.923+0000 7f503b892640 1 -- 172.21.15.19:0/350684815 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command([{prefix=config set, name=mds_debug_frag}] v 0) -- 0x7f50341a3910 con 0x7f5034105bf0 2024-09-10T22:18:15.925 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:18:15 smithi019 ceph-mon[31375]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T22:18:15.925 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:18:15 smithi019 ceph-mon[31375]: from='client.? 172.21.15.19:0/1005644586' entity='client.admin' 2024-09-10T22:18:15.925 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:18:15 smithi019 ceph-mon[31375]: from='client.? 172.21.15.19:0/1366725957' entity='client.admin' 2024-09-10T22:18:15.925 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:18:15 smithi019 ceph-mon[31375]: from='client.? 172.21.15.19:0/2565127232' entity='client.admin' 2024-09-10T22:18:15.925 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:18:15 smithi019 ceph-mon[31375]: from='client.? 172.21.15.19:0/1542813111' entity='client.admin' 2024-09-10T22:18:15.930 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:15.928+0000 7f502a7fc640 1 -- 172.21.15.19:0/350684815 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_debug_frag}]=0 v23)=0 v23) ==== 115+0+0 (secure 0 0 0) 0x7f50240acbd0 con 0x7f5034105bf0 2024-09-10T22:18:15.932 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:15.931+0000 7f503b892640 1 -- 172.21.15.19:0/350684815 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f50200b5250 msgr2=0x7f50200b7710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:18:15.932 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:15.931+0000 7f503b892640 1 --2- 172.21.15.19:0/350684815 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f50200b5250 0x7f50200b7710 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f5030031500 tx=0x7f5030005a20 comp rx=0 tx=0).stop 2024-09-10T22:18:15.932 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:15.931+0000 7f503b892640 1 -- 172.21.15.19:0/350684815 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5034105bf0 msgr2=0x7f503419b660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:18:15.933 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:15.931+0000 7f503b892640 1 --2- 172.21.15.19:0/350684815 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5034105bf0 0x7f503419b660 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f502400e9f0 tx=0x7f502400eeb0 comp rx=0 tx=0).stop 2024-09-10T22:18:15.933 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:15.931+0000 7f503b892640 1 -- 172.21.15.19:0/350684815 shutdown_connections 2024-09-10T22:18:15.933 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:15.931+0000 7f503b892640 1 --2- 172.21.15.19:0/350684815 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f50200b5250 0x7f50200b7710 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:15.933 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:15.931+0000 7f503b892640 1 --2- 172.21.15.19:0/350684815 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5034108720 0x7f503419c2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:15.933 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:15.931+0000 7f503b892640 1 --2- 172.21.15.19:0/350684815 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5034105bf0 0x7f503419b660 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:15.933 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:15.931+0000 7f503b892640 1 --2- 172.21.15.19:0/350684815 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f503406b620 0x7f503419b010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:15.933 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:15.931+0000 7f503b892640 1 -- 172.21.15.19:0/350684815 >> 172.21.15.19:0/350684815 conn(0x7f50340fd1e0 msgr2=0x7f50340ff5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:18:15.933 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:15.931+0000 7f503b892640 1 -- 172.21.15.19:0/350684815 shutdown_connections 2024-09-10T22:18:15.933 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:15.931+0000 7f503b892640 1 -- 172.21.15.19:0/350684815 wait complete. 2024-09-10T22:18:16.110 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:18:15 smithi135 ceph-mon[34789]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T22:18:16.110 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:18:15 smithi135 ceph-mon[34789]: from='client.? 172.21.15.19:0/1005644586' entity='client.admin' 2024-09-10T22:18:16.110 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:18:15 smithi135 ceph-mon[34789]: from='client.? 172.21.15.19:0/1366725957' entity='client.admin' 2024-09-10T22:18:16.110 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:18:15 smithi135 ceph-mon[34789]: from='client.? 172.21.15.19:0/2565127232' entity='client.admin' 2024-09-10T22:18:16.110 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:18:15 smithi135 ceph-mon[34789]: from='client.? 172.21.15.19:0/1542813111' entity='client.admin' 2024-09-10T22:18:16.125 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:18:15 smithi138 ceph-mon[35236]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T22:18:16.125 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:18:15 smithi138 ceph-mon[35236]: from='client.? 172.21.15.19:0/1005644586' entity='client.admin' 2024-09-10T22:18:16.125 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:18:15 smithi138 ceph-mon[35236]: from='client.? 172.21.15.19:0/1366725957' entity='client.admin' 2024-09-10T22:18:16.125 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:18:15 smithi138 ceph-mon[35236]: from='client.? 172.21.15.19:0/2565127232' entity='client.admin' 2024-09-10T22:18:16.125 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:18:15 smithi138 ceph-mon[35236]: from='client.? 172.21.15.19:0/1542813111' entity='client.admin' 2024-09-10T22:18:16.534 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:16.427+0000 7fc875971640 1 -- 172.21.15.19:0/3200643865 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc870102a40 msgr2=0x7fc870102e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:18:16.534 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:16.427+0000 7fc875971640 1 --2- 172.21.15.19:0/3200643865 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc870102a40 0x7fc870102e40 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fc860009cd0 tx=0x7fc86002a8e0 comp rx=0 tx=0).stop 2024-09-10T22:18:16.535 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:16.427+0000 7fc875971640 1 -- 172.21.15.19:0/3200643865 shutdown_connections 2024-09-10T22:18:16.535 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:16.427+0000 7fc875971640 1 --2- 172.21.15.19:0/3200643865 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc870104560 0x7fc87010aee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:16.535 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:16.427+0000 7fc875971640 1 --2- 172.21.15.19:0/3200643865 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc870103ba0 0x7fc870104020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:16.535 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:16.427+0000 7fc875971640 1 --2- 172.21.15.19:0/3200643865 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc870102a40 0x7fc870102e40 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:16.535 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:16.427+0000 7fc875971640 1 -- 172.21.15.19:0/3200643865 >> 172.21.15.19:0/3200643865 conn(0x7fc8700fe2f0 msgr2=0x7fc870100750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:18:16.535 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:16.427+0000 7fc875971640 1 -- 172.21.15.19:0/3200643865 shutdown_connections 2024-09-10T22:18:16.535 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:16.428+0000 7fc875971640 1 -- 172.21.15.19:0/3200643865 wait complete. 2024-09-10T22:18:16.535 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:16.428+0000 7fc875971640 1 Processor -- start 2024-09-10T22:18:16.535 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:16.428+0000 7fc875971640 1 -- start start 2024-09-10T22:18:16.535 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:16.428+0000 7fc875971640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc870102a40 0x7fc870198f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:18:16.535 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:16.428+0000 7fc875971640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc870103ba0 0x7fc870199570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:18:16.536 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:16.428+0000 7fc875971640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc870104560 0x7fc87019a140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:18:16.536 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:16.428+0000 7fc875971640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fc87010e6a0 con 0x7fc870103ba0 2024-09-10T22:18:16.536 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:16.428+0000 7fc875971640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fc87010e520 con 0x7fc870104560 2024-09-10T22:18:16.536 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:16.428+0000 7fc875971640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7fc87010e820 con 0x7fc870102a40 2024-09-10T22:18:16.536 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:16.428+0000 7fc86e7fc640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc870103ba0 0x7fc870199570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:18:16.536 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:16.429+0000 7fc86e7fc640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc870103ba0 0x7fc870199570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:35178/0 (socket says 172.21.15.19:35178) 2024-09-10T22:18:16.536 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:16.429+0000 7fc86e7fc640 1 -- 172.21.15.19:0/2505871247 learned_addr learned my addr 172.21.15.19:0/2505871247 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:18:16.536 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:16.429+0000 7fc86f7fe640 1 --2- 172.21.15.19:0/2505871247 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc870104560 0x7fc87019a140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:18:16.536 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:16.429+0000 7fc86effd640 1 --2- 172.21.15.19:0/2505871247 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc870102a40 0x7fc870198f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:18:16.536 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:16.429+0000 7fc86e7fc640 1 -- 172.21.15.19:0/2505871247 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc870102a40 msgr2=0x7fc870198f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:18:16.536 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:16.429+0000 7fc86e7fc640 1 --2- 172.21.15.19:0/2505871247 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc870102a40 0x7fc870198f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:16.536 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:16.429+0000 7fc86e7fc640 1 -- 172.21.15.19:0/2505871247 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc870104560 msgr2=0x7fc87019a140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:18:16.537 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:16.429+0000 7fc86e7fc640 1 --2- 172.21.15.19:0/2505871247 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc870104560 0x7fc87019a140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:16.537 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:16.429+0000 7fc86e7fc640 1 -- 172.21.15.19:0/2505871247 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc87019a9e0 con 0x7fc870103ba0 2024-09-10T22:18:16.537 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:16.429+0000 7fc86e7fc640 1 --2- 172.21.15.19:0/2505871247 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc870103ba0 0x7fc870199570 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fc85800d950 tx=0x7fc85800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:18:16.537 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:16.429+0000 7fc87496f640 1 -- 172.21.15.19:0/2505871247 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc858017070 con 0x7fc870103ba0 2024-09-10T22:18:16.537 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:16.429+0000 7fc875971640 1 -- 172.21.15.19:0/2505871247 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc87019acd0 con 0x7fc870103ba0 2024-09-10T22:18:16.537 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:16.429+0000 7fc87496f640 1 -- 172.21.15.19:0/2505871247 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc858009c30 con 0x7fc870103ba0 2024-09-10T22:18:16.537 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:16.429+0000 7fc87496f640 1 -- 172.21.15.19:0/2505871247 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc85800f620 con 0x7fc870103ba0 2024-09-10T22:18:16.537 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:16.429+0000 7fc875971640 1 -- 172.21.15.19:0/2505871247 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc8701a13b0 con 0x7fc870103ba0 2024-09-10T22:18:16.537 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:16.430+0000 7fc875971640 1 -- 172.21.15.19:0/2505871247 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc870109dc0 con 0x7fc870103ba0 2024-09-10T22:18:16.537 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:16.432+0000 7fc87496f640 1 -- 172.21.15.19:0/2505871247 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 15) ==== 153194+0+0 (secure 0 0 0) 0x7fc858010460 con 0x7fc870103ba0 2024-09-10T22:18:16.537 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:16.432+0000 7fc87496f640 1 --2- 172.21.15.19:0/2505871247 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7fc85c0b5250 0x7fc85c0b7710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:18:16.537 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:16.433+0000 7fc86effd640 1 --2- 172.21.15.19:0/2505871247 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7fc85c0b5250 0x7fc85c0b7710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:18:16.537 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:16.433+0000 7fc87496f640 1 -- 172.21.15.19:0/2505871247 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7fc8580e3bb0 con 0x7fc870103ba0 2024-09-10T22:18:16.538 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:16.433+0000 7fc86effd640 1 --2- 172.21.15.19:0/2505871247 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7fc85c0b5250 0x7fc85c0b7710 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fc860006010 tx=0x7fc860000f40 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:18:16.538 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:16.435+0000 7fc87496f640 1 -- 172.21.15.19:0/2505871247 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7fc8580ac740 con 0x7fc870103ba0 2024-09-10T22:18:16.624 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:16.623+0000 7fc875971640 1 -- 172.21.15.19:0/2505871247 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command([{prefix=config set, name=debug_mds_balancer}] v 0) -- 0x7fc87002e790 con 0x7fc870103ba0 2024-09-10T22:18:16.630 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:16.628+0000 7fc87496f640 1 -- 172.21.15.19:0/2505871247 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{prefix=config set, name=debug_mds_balancer}]=0 v24)=0 v24) ==== 117+0+0 (secure 0 0 0) 0x7fc858009de0 con 0x7fc870103ba0 2024-09-10T22:18:16.632 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:16.630+0000 7fc875971640 1 -- 172.21.15.19:0/2505871247 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7fc85c0b5250 msgr2=0x7fc85c0b7710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:18:16.632 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:16.630+0000 7fc875971640 1 --2- 172.21.15.19:0/2505871247 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7fc85c0b5250 0x7fc85c0b7710 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fc860006010 tx=0x7fc860000f40 comp rx=0 tx=0).stop 2024-09-10T22:18:16.632 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:16.631+0000 7fc875971640 1 -- 172.21.15.19:0/2505871247 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc870103ba0 msgr2=0x7fc870199570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:18:16.632 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:16.631+0000 7fc875971640 1 --2- 172.21.15.19:0/2505871247 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc870103ba0 0x7fc870199570 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fc85800d950 tx=0x7fc85800de10 comp rx=0 tx=0).stop 2024-09-10T22:18:16.632 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:16.631+0000 7fc875971640 1 -- 172.21.15.19:0/2505871247 shutdown_connections 2024-09-10T22:18:16.632 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:16.631+0000 7fc875971640 1 --2- 172.21.15.19:0/2505871247 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7fc85c0b5250 0x7fc85c0b7710 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:16.633 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:16.631+0000 7fc875971640 1 --2- 172.21.15.19:0/2505871247 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc870104560 0x7fc87019a140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:16.633 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:16.631+0000 7fc875971640 1 --2- 172.21.15.19:0/2505871247 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc870103ba0 0x7fc870199570 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:16.633 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:16.631+0000 7fc875971640 1 --2- 172.21.15.19:0/2505871247 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc870102a40 0x7fc870198f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:16.633 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:16.631+0000 7fc875971640 1 -- 172.21.15.19:0/2505871247 >> 172.21.15.19:0/2505871247 conn(0x7fc8700fe2f0 msgr2=0x7fc870106f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:18:16.633 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:16.631+0000 7fc875971640 1 -- 172.21.15.19:0/2505871247 shutdown_connections 2024-09-10T22:18:16.633 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:16.631+0000 7fc875971640 1 -- 172.21.15.19:0/2505871247 wait complete. 2024-09-10T22:18:17.029 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:13.061+0000 7f53268b5640 1 -- 172.21.15.19:0/4268031044 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5320105bb0 msgr2=0x7f5320107fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:18:17.029 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:13.061+0000 7f53268b5640 1 --2- 172.21.15.19:0/4268031044 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5320105bb0 0x7f5320107fe0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f5314009900 tx=0x7f531402a410 comp rx=0 tx=0).stop 2024-09-10T22:18:17.030 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:13.062+0000 7f53268b5640 1 -- 172.21.15.19:0/4268031044 shutdown_connections 2024-09-10T22:18:17.030 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:13.062+0000 7f53268b5640 1 --2- 172.21.15.19:0/4268031044 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5320108720 0x7f532010abe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:17.030 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:13.062+0000 7f53268b5640 1 --2- 172.21.15.19:0/4268031044 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5320105bb0 0x7f5320107fe0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:17.030 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:13.062+0000 7f53268b5640 1 --2- 172.21.15.19:0/4268031044 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f532006b660 0x7f5320105670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:17.030 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:13.062+0000 7f53268b5640 1 -- 172.21.15.19:0/4268031044 >> 172.21.15.19:0/4268031044 conn(0x7f53200fd1e0 msgr2=0x7f53200ff620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:18:17.030 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:13.062+0000 7f53268b5640 1 -- 172.21.15.19:0/4268031044 shutdown_connections 2024-09-10T22:18:17.030 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:13.062+0000 7f53268b5640 1 -- 172.21.15.19:0/4268031044 wait complete. 2024-09-10T22:18:17.030 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:13.062+0000 7f53268b5640 1 Processor -- start 2024-09-10T22:18:17.030 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:13.062+0000 7f53268b5640 1 -- start start 2024-09-10T22:18:17.030 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:13.063+0000 7f53268b5640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f532006b660 0x7f5320198d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:18:17.030 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:13.063+0000 7f53268b5640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5320105bb0 0x7f5320199370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:18:17.030 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:13.063+0000 7f53268b5640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5320108720 0x7f5320199fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:18:17.031 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:13.063+0000 7f53268b5640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f532010e510 con 0x7f5320105bb0 2024-09-10T22:18:17.031 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:13.063+0000 7f53268b5640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f532010e390 con 0x7f5320108720 2024-09-10T22:18:17.031 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:13.063+0000 7f53268b5640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f532010e690 con 0x7f532006b660 2024-09-10T22:18:17.031 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:13.063+0000 7f531f7fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5320105bb0 0x7f5320199370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:18:17.031 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:13.063+0000 7f531f7fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5320105bb0 0x7f5320199370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:33886/0 (socket says 172.21.15.19:33886) 2024-09-10T22:18:17.031 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:13.063+0000 7f531f7fe640 1 -- 172.21.15.19:0/1778901359 learned_addr learned my addr 172.21.15.19:0/1778901359 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:18:17.031 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:13.063+0000 7f5324e52640 1 --2- 172.21.15.19:0/1778901359 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5320108720 0x7f5320199fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:18:17.031 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:13.063+0000 7f531ffff640 1 --2- 172.21.15.19:0/1778901359 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f532006b660 0x7f5320198d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:18:17.031 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:13.063+0000 7f531f7fe640 1 -- 172.21.15.19:0/1778901359 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f532006b660 msgr2=0x7f5320198d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:18:17.031 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:13.063+0000 7f531f7fe640 1 --2- 172.21.15.19:0/1778901359 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f532006b660 0x7f5320198d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:17.031 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:13.063+0000 7f531f7fe640 1 -- 172.21.15.19:0/1778901359 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5320108720 msgr2=0x7f5320199fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:18:17.031 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:13.063+0000 7f531f7fe640 1 --2- 172.21.15.19:0/1778901359 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5320108720 0x7f5320199fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:17.032 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:13.063+0000 7f531f7fe640 1 -- 172.21.15.19:0/1778901359 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f532019a850 con 0x7f5320105bb0 2024-09-10T22:18:17.032 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:13.063+0000 7f531f7fe640 1 --2- 172.21.15.19:0/1778901359 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5320105bb0 0x7f5320199370 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f5314005940 tx=0x7f53140042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:18:17.032 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:13.063+0000 7f531d7fa640 1 -- 172.21.15.19:0/1778901359 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f531403f030 con 0x7f5320105bb0 2024-09-10T22:18:17.032 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:13.063+0000 7f531d7fa640 1 -- 172.21.15.19:0/1778901359 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(25 keys) ==== 1070+0+0 (secure 0 0 0) 0x7f5314003c90 con 0x7f5320105bb0 2024-09-10T22:18:17.032 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:13.063+0000 7f53268b5640 1 -- 172.21.15.19:0/1778901359 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f532019aae0 con 0x7f5320105bb0 2024-09-10T22:18:17.032 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:13.063+0000 7f531d7fa640 1 -- 172.21.15.19:0/1778901359 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5314035070 con 0x7f5320105bb0 2024-09-10T22:18:17.032 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:13.063+0000 7f53268b5640 1 -- 172.21.15.19:0/1778901359 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f53201a1050 con 0x7f5320105bb0 2024-09-10T22:18:17.032 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:13.065+0000 7f53268b5640 1 -- 172.21.15.19:0/1778901359 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5320105fd0 con 0x7f5320105bb0 2024-09-10T22:18:17.032 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:13.066+0000 7f531d7fa640 1 -- 172.21.15.19:0/1778901359 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 15) ==== 153194+0+0 (secure 0 0 0) 0x7f5314003800 con 0x7f5320105bb0 2024-09-10T22:18:17.032 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:13.067+0000 7f531d7fa640 1 --2- 172.21.15.19:0/1778901359 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f53080b5250 0x7f53080b7710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:18:17.032 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:13.067+0000 7f531ffff640 1 --2- 172.21.15.19:0/1778901359 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f53080b5250 0x7f53080b7710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:18:17.032 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:13.067+0000 7f531d7fa640 1 -- 172.21.15.19:0/1778901359 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f5314104d40 con 0x7f5320105bb0 2024-09-10T22:18:17.033 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:13.067+0000 7f531ffff640 1 --2- 172.21.15.19:0/1778901359 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f53080b5250 0x7f53080b7710 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f531000bbe0 tx=0x7f531000b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:18:17.033 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:13.069+0000 7f531d7fa640 1 -- 172.21.15.19:0/1778901359 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f53140cd280 con 0x7f5320105bb0 2024-09-10T22:18:17.033 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:13.260+0000 7f53268b5640 1 -- 172.21.15.19:0/1778901359 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command([{prefix=config set, name=mds_bal_fragment_size_max}] v 0) -- 0x7f532002e5c0 con 0x7f5320105bb0 2024-09-10T22:18:17.033 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:13.264+0000 7f531d7fa640 1 -- 172.21.15.19:0/1778901359 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_bal_fragment_size_max}]=0 v18)=0 v18) ==== 127+0+0 (secure 0 0 0) 0x7f53140d6080 con 0x7f5320105bb0 2024-09-10T22:18:17.033 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:13.266+0000 7f53268b5640 1 -- 172.21.15.19:0/1778901359 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f53080b5250 msgr2=0x7f53080b7710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:18:17.033 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:13.266+0000 7f53268b5640 1 --2- 172.21.15.19:0/1778901359 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f53080b5250 0x7f53080b7710 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f531000bbe0 tx=0x7f531000b390 comp rx=0 tx=0).stop 2024-09-10T22:18:17.033 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:13.266+0000 7f53268b5640 1 -- 172.21.15.19:0/1778901359 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5320105bb0 msgr2=0x7f5320199370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:18:17.033 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:13.266+0000 7f53268b5640 1 --2- 172.21.15.19:0/1778901359 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5320105bb0 0x7f5320199370 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f5314005940 tx=0x7f53140042f0 comp rx=0 tx=0).stop 2024-09-10T22:18:17.033 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:13.266+0000 7f53268b5640 1 -- 172.21.15.19:0/1778901359 shutdown_connections 2024-09-10T22:18:17.033 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:13.266+0000 7f53268b5640 1 --2- 172.21.15.19:0/1778901359 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f53080b5250 0x7f53080b7710 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:17.033 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:13.266+0000 7f53268b5640 1 --2- 172.21.15.19:0/1778901359 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5320108720 0x7f5320199fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:17.033 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:13.266+0000 7f53268b5640 1 --2- 172.21.15.19:0/1778901359 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5320105bb0 0x7f5320199370 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:17.033 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:13.266+0000 7f53268b5640 1 --2- 172.21.15.19:0/1778901359 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f532006b660 0x7f5320198d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:17.034 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:13.266+0000 7f53268b5640 1 -- 172.21.15.19:0/1778901359 >> 172.21.15.19:0/1778901359 conn(0x7f53200fd1e0 msgr2=0x7f5320103f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:18:17.034 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:13.266+0000 7f53268b5640 1 -- 172.21.15.19:0/1778901359 shutdown_connections 2024-09-10T22:18:17.034 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:13.266+0000 7f53268b5640 1 -- 172.21.15.19:0/1778901359 wait complete. 2024-09-10T22:18:17.208 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:18:16 smithi019 ceph-mon[31375]: from='client.? 172.21.15.19:0/350684815' entity='client.admin' 2024-09-10T22:18:17.208 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:18:16 smithi019 ceph-mon[31375]: from='client.? 172.21.15.19:0/2505871247' entity='client.admin' 2024-09-10T22:18:17.279 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:18:16 smithi135 ceph-mon[34789]: from='client.? 172.21.15.19:0/350684815' entity='client.admin' 2024-09-10T22:18:17.280 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:18:16 smithi135 ceph-mon[34789]: from='client.? 172.21.15.19:0/2505871247' entity='client.admin' 2024-09-10T22:18:17.293 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:18:16 smithi138 ceph-mon[35236]: from='client.? 172.21.15.19:0/350684815' entity='client.admin' 2024-09-10T22:18:17.294 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:18:16 smithi138 ceph-mon[35236]: from='client.? 172.21.15.19:0/2505871247' entity='client.admin' 2024-09-10T22:18:18.208 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:18:17 smithi019 ceph-mon[31375]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T22:18:18.208 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:18:17 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:18:18.208 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:18:17 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:18:18.208 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:18:17 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T22:18:18.209 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:18:17 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T22:18:18.209 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:18:17 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T22:18:18.209 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:18:17 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:18:18.242 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:18:17 smithi135 ceph-mon[34789]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T22:18:18.243 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:18:17 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:18:18.243 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:18:17 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:18:18.243 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:18:17 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T22:18:18.243 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:18:17 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T22:18:18.243 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:18:17 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T22:18:18.243 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:18:17 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:18:18.257 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:18:17 smithi138 ceph-mon[35236]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T22:18:18.257 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:18:17 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:18:18.257 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:18:17 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:18:18.257 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:18:17 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T22:18:18.257 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:18:17 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T22:18:18.257 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:18:17 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T22:18:18.257 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:18:17 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:18:19.208 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:18:18 smithi019 ceph-mon[31375]: from='client.? ' entity='client.admin' 2024-09-10T22:18:19.208 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:18:18 smithi019 ceph-mon[31375]: from='client.? 172.21.15.19:0/2511176045' entity='client.admin' 2024-09-10T22:18:19.260 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:19.236+0000 7fb00ce73640 1 -- 172.21.15.19:0/1693703428 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb00806b680 msgr2=0x7fb008105650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:18:19.260 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:19.236+0000 7fb00ce73640 1 --2- 172.21.15.19:0/1693703428 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb00806b680 0x7fb008105650 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7faff8009900 tx=0x7faff802a410 comp rx=0 tx=0).stop 2024-09-10T22:18:19.260 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:19.236+0000 7fb00ce73640 1 -- 172.21.15.19:0/1693703428 shutdown_connections 2024-09-10T22:18:19.260 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:19.236+0000 7fb00ce73640 1 --2- 172.21.15.19:0/1693703428 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb008108720 0x7fb00810abe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:19.260 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:19.237+0000 7fb00ce73640 1 --2- 172.21.15.19:0/1693703428 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb008105b90 0x7fb008107fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:19.260 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:19.237+0000 7fb00ce73640 1 --2- 172.21.15.19:0/1693703428 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb00806b680 0x7fb008105650 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:19.260 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:19.237+0000 7fb00ce73640 1 -- 172.21.15.19:0/1693703428 >> 172.21.15.19:0/1693703428 conn(0x7fb0080fd1e0 msgr2=0x7fb0080ff620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:18:19.260 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:19.237+0000 7fb00ce73640 1 -- 172.21.15.19:0/1693703428 shutdown_connections 2024-09-10T22:18:19.260 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:19.237+0000 7fb00ce73640 1 -- 172.21.15.19:0/1693703428 wait complete. 2024-09-10T22:18:19.261 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:19.237+0000 7fb00ce73640 1 Processor -- start 2024-09-10T22:18:19.261 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:19.238+0000 7fb00ce73640 1 -- start start 2024-09-10T22:18:19.261 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:19.238+0000 7fb00ce73640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb00806b680 0x7fb008198e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:18:19.261 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:19.238+0000 7fb00ce73640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb008105b90 0x7fb008199480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:18:19.261 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:19.238+0000 7fb00ce73640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb008108720 0x7fb00819a0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:18:19.261 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:19.238+0000 7fb00ce73640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fb00810e660 con 0x7fb008108720 2024-09-10T22:18:19.261 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:19.238+0000 7fb00ce73640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fb00810e4e0 con 0x7fb008105b90 2024-09-10T22:18:19.261 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:19.238+0000 7fb00ce73640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7fb00810e7e0 con 0x7fb00806b680 2024-09-10T22:18:19.261 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:19.238+0000 7fb006d9d640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb008108720 0x7fb00819a0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:18:19.261 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:19.238+0000 7fb006d9d640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb008108720 0x7fb00819a0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:35236/0 (socket says 172.21.15.19:35236) 2024-09-10T22:18:19.261 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:19.238+0000 7fb006d9d640 1 -- 172.21.15.19:0/2421362998 learned_addr learned my addr 172.21.15.19:0/2421362998 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:18:19.261 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:19.238+0000 7fb00659c640 1 --2- 172.21.15.19:0/2421362998 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb00806b680 0x7fb008198e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:18:19.262 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:19.238+0000 7fb005d9b640 1 --2- 172.21.15.19:0/2421362998 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb008105b90 0x7fb008199480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:18:19.262 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:19.238+0000 7fb006d9d640 1 -- 172.21.15.19:0/2421362998 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb00806b680 msgr2=0x7fb008198e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:18:19.262 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:19.238+0000 7fb006d9d640 1 --2- 172.21.15.19:0/2421362998 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb00806b680 0x7fb008198e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:19.262 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:19.238+0000 7fb006d9d640 1 -- 172.21.15.19:0/2421362998 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb008105b90 msgr2=0x7fb008199480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:18:19.262 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:19.238+0000 7fb006d9d640 1 --2- 172.21.15.19:0/2421362998 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb008105b90 0x7fb008199480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:19.262 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:19.238+0000 7fb006d9d640 1 -- 172.21.15.19:0/2421362998 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb00819a960 con 0x7fb008108720 2024-09-10T22:18:19.262 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:19.239+0000 7fb006d9d640 1 --2- 172.21.15.19:0/2421362998 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb008108720 0x7fb00819a0c0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fb00000eaa0 tx=0x7fb00000ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:18:19.262 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:19.239+0000 7faff77fe640 1 -- 172.21.15.19:0/2421362998 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb00000cdb0 con 0x7fb008108720 2024-09-10T22:18:19.262 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:19.239+0000 7fb00ce73640 1 -- 172.21.15.19:0/2421362998 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb00819ac50 con 0x7fb008108720 2024-09-10T22:18:19.262 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:19.239+0000 7faff77fe640 1 -- 172.21.15.19:0/2421362998 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb000005020 con 0x7fb008108720 2024-09-10T22:18:19.262 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:19.239+0000 7faff77fe640 1 -- 172.21.15.19:0/2421362998 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0000116d0 con 0x7fb008108720 2024-09-10T22:18:19.263 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:19.239+0000 7fb00ce73640 1 -- 172.21.15.19:0/2421362998 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb0081a1330 con 0x7fb008108720 2024-09-10T22:18:19.263 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:19.240+0000 7fb00ce73640 1 -- 172.21.15.19:0/2421362998 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb0080fecd0 con 0x7fb008108720 2024-09-10T22:18:19.263 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:19.242+0000 7faff77fe640 1 -- 172.21.15.19:0/2421362998 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 15) ==== 153194+0+0 (secure 0 0 0) 0x7fb00000f040 con 0x7fb008108720 2024-09-10T22:18:19.263 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:19.243+0000 7faff77fe640 1 --2- 172.21.15.19:0/2421362998 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7faff00b5250 0x7faff00b7710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:18:19.263 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:19.243+0000 7fb00659c640 1 --2- 172.21.15.19:0/2421362998 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7faff00b5250 0x7faff00b7710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:18:19.263 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:19.243+0000 7faff77fe640 1 -- 172.21.15.19:0/2421362998 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7fb0000e4040 con 0x7fb008108720 2024-09-10T22:18:19.263 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:19.243+0000 7fb00659c640 1 --2- 172.21.15.19:0/2421362998 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7faff00b5250 0x7faff00b7710 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7faff8000c00 tx=0x7faff80314a0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:18:19.263 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:19.245+0000 7faff77fe640 1 -- 172.21.15.19:0/2421362998 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7fb000016030 con 0x7fb008108720 2024-09-10T22:18:19.359 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:18:18 smithi135 ceph-mon[34789]: from='client.? ' entity='client.admin' 2024-09-10T22:18:19.360 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:18:18 smithi135 ceph-mon[34789]: from='client.? 172.21.15.19:0/2511176045' entity='client.admin' 2024-09-10T22:18:19.360 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:14.530+0000 7fe68211f640 1 -- 172.21.15.19:0/3913352475 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe67c104560 msgr2=0x7fe67c10aee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:18:19.361 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:14.530+0000 7fe68211f640 1 --2- 172.21.15.19:0/3913352475 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe67c104560 0x7fe67c10aee0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fe674009cd0 tx=0x7fe67402a8e0 comp rx=0 tx=0).stop 2024-09-10T22:18:19.361 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:14.530+0000 7fe68211f640 1 -- 172.21.15.19:0/3913352475 shutdown_connections 2024-09-10T22:18:19.361 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:14.530+0000 7fe68211f640 1 --2- 172.21.15.19:0/3913352475 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe67c104560 0x7fe67c10aee0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:19.361 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:14.530+0000 7fe68211f640 1 --2- 172.21.15.19:0/3913352475 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe67c103ba0 0x7fe67c104020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:19.361 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:14.530+0000 7fe68211f640 1 --2- 172.21.15.19:0/3913352475 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe67c102a40 0x7fe67c102e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:19.361 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:14.530+0000 7fe68211f640 1 -- 172.21.15.19:0/3913352475 >> 172.21.15.19:0/3913352475 conn(0x7fe67c0fe2f0 msgr2=0x7fe67c100750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:18:19.361 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:14.530+0000 7fe68211f640 1 -- 172.21.15.19:0/3913352475 shutdown_connections 2024-09-10T22:18:19.361 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:14.530+0000 7fe68211f640 1 -- 172.21.15.19:0/3913352475 wait complete. 2024-09-10T22:18:19.361 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:14.530+0000 7fe68211f640 1 Processor -- start 2024-09-10T22:18:19.361 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:14.531+0000 7fe68211f640 1 -- start start 2024-09-10T22:18:19.361 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:14.531+0000 7fe68211f640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe67c102a40 0x7fe67c198d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:18:19.361 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:14.531+0000 7fe68211f640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe67c103ba0 0x7fe67c199350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:18:19.362 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:14.531+0000 7fe68211f640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe67c104560 0x7fe67c199f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:18:19.362 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:14.531+0000 7fe68211f640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fe67c10e580 con 0x7fe67c104560 2024-09-10T22:18:19.362 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:14.531+0000 7fe68211f640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fe67c10e400 con 0x7fe67c103ba0 2024-09-10T22:18:19.362 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:14.531+0000 7fe68211f640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7fe67c10e700 con 0x7fe67c102a40 2024-09-10T22:18:19.362 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:14.531+0000 7fe67bfff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe67c104560 0x7fe67c199f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:18:19.362 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:14.531+0000 7fe67bfff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe67c104560 0x7fe67c199f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:35060/0 (socket says 172.21.15.19:35060) 2024-09-10T22:18:19.362 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:14.531+0000 7fe67bfff640 1 -- 172.21.15.19:0/1005644586 learned_addr learned my addr 172.21.15.19:0/1005644586 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:18:19.362 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:14.531+0000 7fe673fff640 1 --2- 172.21.15.19:0/1005644586 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe67c103ba0 0x7fe67c199350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:18:19.362 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:14.531+0000 7fe67b7fe640 1 --2- 172.21.15.19:0/1005644586 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe67c102a40 0x7fe67c198d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:18:19.362 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:14.531+0000 7fe67bfff640 1 -- 172.21.15.19:0/1005644586 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe67c102a40 msgr2=0x7fe67c198d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:18:19.362 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:14.531+0000 7fe67bfff640 1 --2- 172.21.15.19:0/1005644586 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe67c102a40 0x7fe67c198d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:19.362 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:14.531+0000 7fe67bfff640 1 -- 172.21.15.19:0/1005644586 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe67c103ba0 msgr2=0x7fe67c199350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:18:19.363 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:14.531+0000 7fe67bfff640 1 --2- 172.21.15.19:0/1005644586 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe67c103ba0 0x7fe67c199350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:19.363 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:14.531+0000 7fe67bfff640 1 -- 172.21.15.19:0/1005644586 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe67c19a830 con 0x7fe67c104560 2024-09-10T22:18:19.363 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:14.531+0000 7fe67b7fe640 1 --2- 172.21.15.19:0/1005644586 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe67c102a40 0x7fe67c198d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T22:18:19.363 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:14.531+0000 7fe67bfff640 1 --2- 172.21.15.19:0/1005644586 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe67c104560 0x7fe67c199f90 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fe6740097b0 tx=0x7fe674003ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:18:19.363 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:14.532+0000 7fe6797fa640 1 -- 172.21.15.19:0/1005644586 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe674004240 con 0x7fe67c104560 2024-09-10T22:18:19.363 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:14.532+0000 7fe68211f640 1 -- 172.21.15.19:0/1005644586 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe67c19aac0 con 0x7fe67c104560 2024-09-10T22:18:19.363 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:14.532+0000 7fe6797fa640 1 -- 172.21.15.19:0/1005644586 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(25 keys) ==== 1070+0+0 (secure 0 0 0) 0x7fe6740305a0 con 0x7fe67c104560 2024-09-10T22:18:19.363 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:14.532+0000 7fe6797fa640 1 -- 172.21.15.19:0/1005644586 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe67403b660 con 0x7fe67c104560 2024-09-10T22:18:19.363 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:14.532+0000 7fe68211f640 1 -- 172.21.15.19:0/1005644586 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe67c1a1200 con 0x7fe67c104560 2024-09-10T22:18:19.363 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:14.533+0000 7fe68211f640 1 -- 172.21.15.19:0/1005644586 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe67c102e40 con 0x7fe67c104560 2024-09-10T22:18:19.363 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:14.534+0000 7fe6797fa640 1 -- 172.21.15.19:0/1005644586 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 15) ==== 153194+0+0 (secure 0 0 0) 0x7fe674030070 con 0x7fe67c104560 2024-09-10T22:18:19.363 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:14.535+0000 7fe6797fa640 1 --2- 172.21.15.19:0/1005644586 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7fe6680b5250 0x7fe6680b7710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:18:19.363 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:14.535+0000 7fe67b7fe640 1 --2- 172.21.15.19:0/1005644586 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7fe6680b5250 0x7fe6680b7710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:18:19.364 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:14.535+0000 7fe6797fa640 1 -- 172.21.15.19:0/1005644586 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7fe67402e030 con 0x7fe67c104560 2024-09-10T22:18:19.364 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:14.536+0000 7fe67b7fe640 1 --2- 172.21.15.19:0/1005644586 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7fe6680b5250 0x7fe6680b7710 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fe66c005d00 tx=0x7fe66c005c70 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:18:19.364 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:14.538+0000 7fe6797fa640 1 -- 172.21.15.19:0/1005644586 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7fe6740cdb60 con 0x7fe67c104560 2024-09-10T22:18:19.364 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:14.734+0000 7fe68211f640 1 -- 172.21.15.19:0/1005644586 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command([{prefix=config set, name=mon_op_complaint_time}] v 0) -- 0x7fe67c109dc0 con 0x7fe67c104560 2024-09-10T22:18:19.364 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:14.737+0000 7fe6797fa640 1 -- 172.21.15.19:0/1005644586 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_op_complaint_time}]=0 v19)=0 v19) ==== 121+0+0 (secure 0 0 0) 0x7fe6740cd460 con 0x7fe67c104560 2024-09-10T22:18:19.364 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:14.740+0000 7fe68211f640 1 -- 172.21.15.19:0/1005644586 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7fe6680b5250 msgr2=0x7fe6680b7710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:18:19.364 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:14.740+0000 7fe68211f640 1 --2- 172.21.15.19:0/1005644586 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7fe6680b5250 0x7fe6680b7710 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fe66c005d00 tx=0x7fe66c005c70 comp rx=0 tx=0).stop 2024-09-10T22:18:19.364 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:14.740+0000 7fe68211f640 1 -- 172.21.15.19:0/1005644586 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe67c104560 msgr2=0x7fe67c199f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:18:19.364 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:14.740+0000 7fe68211f640 1 --2- 172.21.15.19:0/1005644586 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe67c104560 0x7fe67c199f90 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fe6740097b0 tx=0x7fe674003ba0 comp rx=0 tx=0).stop 2024-09-10T22:18:19.364 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:14.740+0000 7fe68211f640 1 -- 172.21.15.19:0/1005644586 shutdown_connections 2024-09-10T22:18:19.364 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:14.740+0000 7fe68211f640 1 --2- 172.21.15.19:0/1005644586 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7fe6680b5250 0x7fe6680b7710 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:19.364 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:14.740+0000 7fe68211f640 1 --2- 172.21.15.19:0/1005644586 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe67c104560 0x7fe67c199f90 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:19.365 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:14.740+0000 7fe68211f640 1 --2- 172.21.15.19:0/1005644586 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe67c103ba0 0x7fe67c199350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:19.365 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:14.740+0000 7fe68211f640 1 --2- 172.21.15.19:0/1005644586 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe67c102a40 0x7fe67c198d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:19.365 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:14.740+0000 7fe68211f640 1 -- 172.21.15.19:0/1005644586 >> 172.21.15.19:0/1005644586 conn(0x7fe67c0fe2f0 msgr2=0x7fe67c106f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:18:19.365 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:14.740+0000 7fe68211f640 1 -- 172.21.15.19:0/1005644586 shutdown_connections 2024-09-10T22:18:19.365 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:14.740+0000 7fe68211f640 1 -- 172.21.15.19:0/1005644586 wait complete. 2024-09-10T22:18:19.375 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:18:18 smithi138 ceph-mon[35236]: from='client.? ' entity='client.admin' 2024-09-10T22:18:19.375 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:18:18 smithi138 ceph-mon[35236]: from='client.? 172.21.15.19:0/2511176045' entity='client.admin' 2024-09-10T22:18:19.435 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:19.433+0000 7fb00ce73640 1 -- 172.21.15.19:0/2421362998 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command([{prefix=config set, name=mds_bal_split_bits}] v 0) -- 0x7fb00802e5c0 con 0x7fb008108720 2024-09-10T22:18:19.439 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:19.438+0000 7faff77fe640 1 -- 172.21.15.19:0/2421362998 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_bal_split_bits}]=0 v28)=0 v28) ==== 116+0+0 (secure 0 0 0) 0x7fb0000ac580 con 0x7fb008108720 2024-09-10T22:18:19.442 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:19.440+0000 7fb00ce73640 1 -- 172.21.15.19:0/2421362998 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7faff00b5250 msgr2=0x7faff00b7710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:18:19.442 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:19.440+0000 7fb00ce73640 1 --2- 172.21.15.19:0/2421362998 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7faff00b5250 0x7faff00b7710 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7faff8000c00 tx=0x7faff80314a0 comp rx=0 tx=0).stop 2024-09-10T22:18:19.442 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:19.440+0000 7fb00ce73640 1 -- 172.21.15.19:0/2421362998 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb008108720 msgr2=0x7fb00819a0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:18:19.442 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:19.440+0000 7fb00ce73640 1 --2- 172.21.15.19:0/2421362998 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb008108720 0x7fb00819a0c0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fb00000eaa0 tx=0x7fb00000ef60 comp rx=0 tx=0).stop 2024-09-10T22:18:19.442 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:19.440+0000 7fb00ce73640 1 -- 172.21.15.19:0/2421362998 shutdown_connections 2024-09-10T22:18:19.442 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:19.440+0000 7fb00ce73640 1 --2- 172.21.15.19:0/2421362998 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7faff00b5250 0x7faff00b7710 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:19.442 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:19.440+0000 7fb00ce73640 1 --2- 172.21.15.19:0/2421362998 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb008108720 0x7fb00819a0c0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:19.443 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:19.441+0000 7fb00ce73640 1 --2- 172.21.15.19:0/2421362998 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb008105b90 0x7fb008199480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:19.443 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:19.441+0000 7fb00ce73640 1 --2- 172.21.15.19:0/2421362998 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb00806b680 0x7fb008198e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:19.443 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:19.441+0000 7fb00ce73640 1 -- 172.21.15.19:0/2421362998 >> 172.21.15.19:0/2421362998 conn(0x7fb0080fd1e0 msgr2=0x7fb008103ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:18:19.443 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:19.441+0000 7fb00ce73640 1 -- 172.21.15.19:0/2421362998 shutdown_connections 2024-09-10T22:18:19.443 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:19.441+0000 7fb00ce73640 1 -- 172.21.15.19:0/2421362998 wait complete. 2024-09-10T22:18:19.729 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:18.490+0000 7fc6bda44640 1 -- 172.21.15.19:0/2138528351 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc6b810a150 msgr2=0x7fc6b810a5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:18:19.729 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:18.490+0000 7fc6bda44640 1 --2- 172.21.15.19:0/2138528351 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc6b810a150 0x7fc6b810a5d0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fc6a8009930 tx=0x7fc6a802a420 comp rx=0 tx=0).stop 2024-09-10T22:18:19.730 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:18.490+0000 7fc6bda44640 1 -- 172.21.15.19:0/2138528351 shutdown_connections 2024-09-10T22:18:19.730 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:18.490+0000 7fc6bda44640 1 --2- 172.21.15.19:0/2138528351 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc6b810ab10 0x7fc6b8113710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:19.730 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:18.490+0000 7fc6bda44640 1 --2- 172.21.15.19:0/2138528351 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc6b810a150 0x7fc6b810a5d0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:19.730 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:18.490+0000 7fc6bda44640 1 --2- 172.21.15.19:0/2138528351 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc6b8074540 0x7fc6b8074940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:19.730 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:18.490+0000 7fc6bda44640 1 -- 172.21.15.19:0/2138528351 >> 172.21.15.19:0/2138528351 conn(0x7fc6b806fcb0 msgr2=0x7fc6b80720f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:18:19.730 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:18.490+0000 7fc6bda44640 1 -- 172.21.15.19:0/2138528351 shutdown_connections 2024-09-10T22:18:19.730 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:18.490+0000 7fc6bda44640 1 -- 172.21.15.19:0/2138528351 wait complete. 2024-09-10T22:18:19.730 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:18.490+0000 7fc6bda44640 1 Processor -- start 2024-09-10T22:18:19.730 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:18.491+0000 7fc6bda44640 1 -- start start 2024-09-10T22:18:19.730 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:18.491+0000 7fc6bda44640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc6b8074540 0x7fc6b81a37c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:18:19.730 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:18.491+0000 7fc6bda44640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc6b810a150 0x7fc6b81a3e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:18:19.730 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:18.491+0000 7fc6bda44640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc6b810ab10 0x7fc6b81a4a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:18:19.730 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:18.491+0000 7fc6bda44640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fc6b810c2b0 con 0x7fc6b810ab10 2024-09-10T22:18:19.731 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:18.491+0000 7fc6bda44640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fc6b810c130 con 0x7fc6b8074540 2024-09-10T22:18:19.731 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:18.491+0000 7fc6bda44640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7fc6b810c430 con 0x7fc6b810a150 2024-09-10T22:18:19.731 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:18.491+0000 7fc6b77fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc6b810ab10 0x7fc6b81a4a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:18:19.731 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:18.491+0000 7fc6b77fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc6b810ab10 0x7fc6b81a4a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:35214/0 (socket says 172.21.15.19:35214) 2024-09-10T22:18:19.731 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:18.491+0000 7fc6b77fe640 1 -- 172.21.15.19:0/2511176045 learned_addr learned my addr 172.21.15.19:0/2511176045 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:18:19.731 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:18.491+0000 7fc6b6ffd640 1 --2- 172.21.15.19:0/2511176045 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc6b8074540 0x7fc6b81a37c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:18:19.731 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:18.491+0000 7fc6b67fc640 1 --2- 172.21.15.19:0/2511176045 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc6b810a150 0x7fc6b81a3e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:18:19.731 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:18.491+0000 7fc6b77fe640 1 -- 172.21.15.19:0/2511176045 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc6b810a150 msgr2=0x7fc6b81a3e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:18:19.731 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:18.491+0000 7fc6b77fe640 1 --2- 172.21.15.19:0/2511176045 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc6b810a150 0x7fc6b81a3e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:19.731 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:18.491+0000 7fc6b77fe640 1 -- 172.21.15.19:0/2511176045 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc6b8074540 msgr2=0x7fc6b81a37c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:18:19.731 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:18.491+0000 7fc6b77fe640 1 --2- 172.21.15.19:0/2511176045 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc6b8074540 0x7fc6b81a37c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:19.731 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:18.491+0000 7fc6b77fe640 1 -- 172.21.15.19:0/2511176045 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc6b81a52f0 con 0x7fc6b810ab10 2024-09-10T22:18:19.731 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:18.491+0000 7fc6b6ffd640 1 --2- 172.21.15.19:0/2511176045 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc6b8074540 0x7fc6b81a37c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T22:18:19.732 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:18.492+0000 7fc6b77fe640 1 --2- 172.21.15.19:0/2511176045 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc6b810ab10 0x7fc6b81a4a50 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fc6b000cce0 tx=0x7fc6b000a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:18:19.732 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:18.492+0000 7fc6bca42640 1 -- 172.21.15.19:0/2511176045 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6b000f450 con 0x7fc6b810ab10 2024-09-10T22:18:19.732 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:18.492+0000 7fc6bca42640 1 -- 172.21.15.19:0/2511176045 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc6b000faa0 con 0x7fc6b810ab10 2024-09-10T22:18:19.732 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:18.492+0000 7fc6bda44640 1 -- 172.21.15.19:0/2511176045 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc6b81a55e0 con 0x7fc6b810ab10 2024-09-10T22:18:19.732 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:18.492+0000 7fc6bca42640 1 -- 172.21.15.19:0/2511176045 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6b0018b70 con 0x7fc6b810ab10 2024-09-10T22:18:19.732 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:18.492+0000 7fc6bda44640 1 -- 172.21.15.19:0/2511176045 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc6b81abcc0 con 0x7fc6b810ab10 2024-09-10T22:18:19.732 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:18.493+0000 7fc6bda44640 1 -- 172.21.15.19:0/2511176045 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc6b8111df0 con 0x7fc6b810ab10 2024-09-10T22:18:19.732 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:18.494+0000 7fc6bca42640 1 -- 172.21.15.19:0/2511176045 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 15) ==== 153194+0+0 (secure 0 0 0) 0x7fc6b000f5f0 con 0x7fc6b810ab10 2024-09-10T22:18:19.732 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:18.495+0000 7fc6bca42640 1 --2- 172.21.15.19:0/2511176045 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7fc6a00b52d0 0x7fc6a00b7790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:18:19.732 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:18.495+0000 7fc6b6ffd640 1 --2- 172.21.15.19:0/2511176045 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7fc6a00b52d0 0x7fc6a00b7790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:18:19.732 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:18.495+0000 7fc6bca42640 1 -- 172.21.15.19:0/2511176045 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7fc6b00e4520 con 0x7fc6b810ab10 2024-09-10T22:18:19.732 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:18.495+0000 7fc6b6ffd640 1 --2- 172.21.15.19:0/2511176045 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7fc6a00b52d0 0x7fc6a00b7790 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fc6ac00bfd0 tx=0x7fc6ac00b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:18:19.733 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:18.499+0000 7fc6bca42640 1 -- 172.21.15.19:0/2511176045 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7fc6b0014030 con 0x7fc6b810ab10 2024-09-10T22:18:19.733 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:18.685+0000 7fc6bda44640 1 -- 172.21.15.19:0/2511176045 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command([{prefix=config set, name=rados_osd_op_timeout}] v 0) -- 0x7fc6b8063d50 con 0x7fc6b810ab10 2024-09-10T22:18:19.733 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:18.689+0000 7fc6bca42640 1 -- 172.21.15.19:0/2511176045 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{prefix=config set, name=rados_osd_op_timeout}]=0 v26)=0 v26) ==== 120+0+0 (secure 0 0 0) 0x7fc6b00ad0b0 con 0x7fc6b810ab10 2024-09-10T22:18:19.733 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:18.691+0000 7fc6bda44640 1 -- 172.21.15.19:0/2511176045 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7fc6a00b52d0 msgr2=0x7fc6a00b7790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:18:19.733 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:18.691+0000 7fc6bda44640 1 --2- 172.21.15.19:0/2511176045 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7fc6a00b52d0 0x7fc6a00b7790 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fc6ac00bfd0 tx=0x7fc6ac00b390 comp rx=0 tx=0).stop 2024-09-10T22:18:19.733 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:18.691+0000 7fc6bda44640 1 -- 172.21.15.19:0/2511176045 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc6b810ab10 msgr2=0x7fc6b81a4a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:18:19.733 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:18.691+0000 7fc6bda44640 1 --2- 172.21.15.19:0/2511176045 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc6b810ab10 0x7fc6b81a4a50 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fc6b000cce0 tx=0x7fc6b000a620 comp rx=0 tx=0).stop 2024-09-10T22:18:19.733 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:18.691+0000 7fc6bda44640 1 -- 172.21.15.19:0/2511176045 shutdown_connections 2024-09-10T22:18:19.733 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:18.691+0000 7fc6bda44640 1 --2- 172.21.15.19:0/2511176045 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7fc6a00b52d0 0x7fc6a00b7790 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:19.733 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:18.691+0000 7fc6bda44640 1 --2- 172.21.15.19:0/2511176045 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc6b810ab10 0x7fc6b81a4a50 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:19.733 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:18.691+0000 7fc6bda44640 1 --2- 172.21.15.19:0/2511176045 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc6b810a150 0x7fc6b81a3e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:19.733 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:18.691+0000 7fc6bda44640 1 --2- 172.21.15.19:0/2511176045 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc6b8074540 0x7fc6b81a37c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:19.733 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:18.691+0000 7fc6bda44640 1 -- 172.21.15.19:0/2511176045 >> 172.21.15.19:0/2511176045 conn(0x7fc6b806fcb0 msgr2=0x7fc6b8073040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:18:19.734 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:18.692+0000 7fc6bda44640 1 -- 172.21.15.19:0/2511176045 shutdown_connections 2024-09-10T22:18:19.734 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:18.692+0000 7fc6bda44640 1 -- 172.21.15.19:0/2511176045 wait complete. 2024-09-10T22:18:19.972 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:19.143+0000 7f62e0785640 1 -- 172.21.15.19:0/2734839656 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f62d8104560 msgr2=0x7f62d810aee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:18:19.972 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:19.143+0000 7f62e0785640 1 --2- 172.21.15.19:0/2734839656 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f62d8104560 0x7f62d810aee0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f62d0009cd0 tx=0x7f62d002a8e0 comp rx=0 tx=0).stop 2024-09-10T22:18:19.972 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:19.143+0000 7f62e0785640 1 -- 172.21.15.19:0/2734839656 shutdown_connections 2024-09-10T22:18:19.972 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:19.143+0000 7f62e0785640 1 --2- 172.21.15.19:0/2734839656 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f62d8104560 0x7f62d810aee0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:19.972 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:19.143+0000 7f62e0785640 1 --2- 172.21.15.19:0/2734839656 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f62d8103ba0 0x7f62d8104020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:19.972 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:19.143+0000 7f62e0785640 1 --2- 172.21.15.19:0/2734839656 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f62d8102a40 0x7f62d8102e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:19.972 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:19.143+0000 7f62e0785640 1 -- 172.21.15.19:0/2734839656 >> 172.21.15.19:0/2734839656 conn(0x7f62d80fe2f0 msgr2=0x7f62d8100750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:18:19.973 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:19.143+0000 7f62e0785640 1 -- 172.21.15.19:0/2734839656 shutdown_connections 2024-09-10T22:18:19.973 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:19.143+0000 7f62e0785640 1 -- 172.21.15.19:0/2734839656 wait complete. 2024-09-10T22:18:19.973 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:19.143+0000 7f62e0785640 1 Processor -- start 2024-09-10T22:18:19.973 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:19.144+0000 7f62e0785640 1 -- start start 2024-09-10T22:18:19.973 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:19.144+0000 7f62e0785640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f62d8102a40 0x7f62d8076cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:18:19.973 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:19.144+0000 7f62e0785640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f62d8103ba0 0x7f62d8075540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:18:19.973 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:19.144+0000 7f62e0785640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f62d8104560 0x7f62d8075a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:18:19.973 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:19.144+0000 7f62e0785640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f62d810e6c0 con 0x7f62d8102a40 2024-09-10T22:18:19.973 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:19.144+0000 7f62e0785640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f62d810e540 con 0x7f62d8104560 2024-09-10T22:18:19.973 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:19.144+0000 7f62e0785640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f62d810e840 con 0x7f62d8103ba0 2024-09-10T22:18:19.973 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:19.144+0000 7f62de521640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f62d8102a40 0x7f62d8076cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:18:19.973 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:19.144+0000 7f62de521640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f62d8102a40 0x7f62d8076cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:35228/0 (socket says 172.21.15.19:35228) 2024-09-10T22:18:19.974 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:19.144+0000 7f62de521640 1 -- 172.21.15.19:0/1490494291 learned_addr learned my addr 172.21.15.19:0/1490494291 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:18:19.974 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:19.144+0000 7f62ded22640 1 --2- 172.21.15.19:0/1490494291 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f62d8104560 0x7f62d8075a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:18:19.974 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:19.144+0000 7f62ddd20640 1 --2- 172.21.15.19:0/1490494291 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f62d8103ba0 0x7f62d8075540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:18:19.974 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:19.144+0000 7f62de521640 1 -- 172.21.15.19:0/1490494291 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f62d8103ba0 msgr2=0x7f62d8075540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:18:19.974 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:19.144+0000 7f62de521640 1 --2- 172.21.15.19:0/1490494291 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f62d8103ba0 0x7f62d8075540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:19.974 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:19.144+0000 7f62de521640 1 -- 172.21.15.19:0/1490494291 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f62d8104560 msgr2=0x7f62d8075a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:18:19.974 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:19.144+0000 7f62de521640 1 --2- 172.21.15.19:0/1490494291 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f62d8104560 0x7f62d8075a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:19.974 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:19.144+0000 7f62de521640 1 -- 172.21.15.19:0/1490494291 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f62d8076340 con 0x7f62d8102a40 2024-09-10T22:18:19.974 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:19.144+0000 7f62ded22640 1 --2- 172.21.15.19:0/1490494291 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f62d8104560 0x7f62d8075a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T22:18:19.974 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:19.144+0000 7f62ddd20640 1 --2- 172.21.15.19:0/1490494291 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f62d8103ba0 0x7f62d8075540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T22:18:19.974 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:19.144+0000 7f62de521640 1 --2- 172.21.15.19:0/1490494291 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f62d8102a40 0x7f62d8076cd0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f62d400d950 tx=0x7f62d400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:18:19.974 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:19.144+0000 7f62cf7fe640 1 -- 172.21.15.19:0/1490494291 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62d4017070 con 0x7f62d8102a40 2024-09-10T22:18:19.975 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:19.144+0000 7f62cf7fe640 1 -- 172.21.15.19:0/1490494291 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f62d4009c30 con 0x7f62d8102a40 2024-09-10T22:18:19.975 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:19.145+0000 7f62e0785640 1 -- 172.21.15.19:0/1490494291 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f62d81a2ef0 con 0x7f62d8102a40 2024-09-10T22:18:19.975 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:19.145+0000 7f62cf7fe640 1 -- 172.21.15.19:0/1490494291 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62d400f620 con 0x7f62d8102a40 2024-09-10T22:18:19.975 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:19.145+0000 7f62e0785640 1 -- 172.21.15.19:0/1490494291 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f62d81a3350 con 0x7f62d8102a40 2024-09-10T22:18:19.975 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:19.146+0000 7f62e0785640 1 -- 172.21.15.19:0/1490494291 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f62d8109d60 con 0x7f62d8102a40 2024-09-10T22:18:19.975 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:19.147+0000 7f62cf7fe640 1 -- 172.21.15.19:0/1490494291 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 15) ==== 153194+0+0 (secure 0 0 0) 0x7f62d4005030 con 0x7f62d8102a40 2024-09-10T22:18:19.975 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:19.148+0000 7f62cf7fe640 1 --2- 172.21.15.19:0/1490494291 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f62c40b52d0 0x7f62c40b7790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:18:19.975 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:19.148+0000 7f62cf7fe640 1 -- 172.21.15.19:0/1490494291 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f62d40e3ad0 con 0x7f62d8102a40 2024-09-10T22:18:19.975 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:19.148+0000 7f62ddd20640 1 --2- 172.21.15.19:0/1490494291 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f62c40b52d0 0x7f62c40b7790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:18:19.975 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:19.148+0000 7f62ddd20640 1 --2- 172.21.15.19:0/1490494291 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f62c40b52d0 0x7f62c40b7790 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f62c8009b50 tx=0x7f62c8005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:18:19.975 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:19.151+0000 7f62cf7fe640 1 -- 172.21.15.19:0/1490494291 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f62d40ac6e0 con 0x7f62d8102a40 2024-09-10T22:18:19.975 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:19.344+0000 7f62e0785640 1 -- 172.21.15.19:0/1490494291 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command([{prefix=config set, name=mds_bal_split_size}] v 0) -- 0x7f62d802e5c0 con 0x7f62d8102a40 2024-09-10T22:18:19.976 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:19.349+0000 7f62cf7fe640 1 -- 172.21.15.19:0/1490494291 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_bal_split_size}]=0 v27)=0 v27) ==== 118+0+0 (secure 0 0 0) 0x7f62d4009de0 con 0x7f62d8102a40 2024-09-10T22:18:19.976 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:19.351+0000 7f62e0785640 1 -- 172.21.15.19:0/1490494291 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f62c40b52d0 msgr2=0x7f62c40b7790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:18:19.976 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:19.351+0000 7f62e0785640 1 --2- 172.21.15.19:0/1490494291 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f62c40b52d0 0x7f62c40b7790 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f62c8009b50 tx=0x7f62c8005f90 comp rx=0 tx=0).stop 2024-09-10T22:18:19.976 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:19.351+0000 7f62e0785640 1 -- 172.21.15.19:0/1490494291 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f62d8102a40 msgr2=0x7f62d8076cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:18:19.976 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:19.351+0000 7f62e0785640 1 --2- 172.21.15.19:0/1490494291 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f62d8102a40 0x7f62d8076cd0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f62d400d950 tx=0x7f62d400de10 comp rx=0 tx=0).stop 2024-09-10T22:18:19.976 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:19.351+0000 7f62e0785640 1 -- 172.21.15.19:0/1490494291 shutdown_connections 2024-09-10T22:18:19.976 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:19.351+0000 7f62e0785640 1 --2- 172.21.15.19:0/1490494291 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f62c40b52d0 0x7f62c40b7790 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:19.976 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:19.351+0000 7f62e0785640 1 --2- 172.21.15.19:0/1490494291 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f62d8104560 0x7f62d8075a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:19.976 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:19.351+0000 7f62e0785640 1 --2- 172.21.15.19:0/1490494291 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f62d8103ba0 0x7f62d8075540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:19.976 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:19.351+0000 7f62e0785640 1 --2- 172.21.15.19:0/1490494291 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f62d8102a40 0x7f62d8076cd0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:19.976 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:19.351+0000 7f62e0785640 1 -- 172.21.15.19:0/1490494291 >> 172.21.15.19:0/1490494291 conn(0x7f62d80fe2f0 msgr2=0x7f62d8106f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:18:19.976 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:19.351+0000 7f62e0785640 1 -- 172.21.15.19:0/1490494291 shutdown_connections 2024-09-10T22:18:19.976 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:19.351+0000 7f62e0785640 1 -- 172.21.15.19:0/1490494291 wait complete. 2024-09-10T22:18:20.359 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:18:19 smithi135 ceph-mon[34789]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T22:18:20.360 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:18:19 smithi135 ceph-mon[34789]: from='client.? 172.21.15.19:0/1490494291' entity='client.admin' 2024-09-10T22:18:20.360 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:18:19 smithi135 ceph-mon[34789]: from='client.? 172.21.15.19:0/2421362998' entity='client.admin' 2024-09-10T22:18:20.375 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:18:19 smithi138 ceph-mon[35236]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T22:18:20.375 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:18:19 smithi138 ceph-mon[35236]: from='client.? 172.21.15.19:0/1490494291' entity='client.admin' 2024-09-10T22:18:20.375 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:18:19 smithi138 ceph-mon[35236]: from='client.? 172.21.15.19:0/2421362998' entity='client.admin' 2024-09-10T22:18:20.450 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:18:19 smithi019 ceph-mon[31375]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T22:18:20.450 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:18:19 smithi019 ceph-mon[31375]: from='client.? 172.21.15.19:0/1490494291' entity='client.admin' 2024-09-10T22:18:20.450 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:18:19 smithi019 ceph-mon[31375]: from='client.? 172.21.15.19:0/2421362998' entity='client.admin' 2024-09-10T22:18:21.186 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:14.739+0000 7ff44c342640 1 -- 172.21.15.19:0/232553192 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff444105bf0 msgr2=0x7ff444107fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:18:21.187 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:14.739+0000 7ff44c342640 1 --2- 172.21.15.19:0/232553192 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff444105bf0 0x7ff444107fe0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7ff434009900 tx=0x7ff43402a410 comp rx=0 tx=0).stop 2024-09-10T22:18:21.187 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:14.739+0000 7ff44c342640 1 -- 172.21.15.19:0/232553192 shutdown_connections 2024-09-10T22:18:21.187 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:14.739+0000 7ff44c342640 1 --2- 172.21.15.19:0/232553192 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff444108720 0x7ff44410abe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:21.187 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:14.739+0000 7ff44c342640 1 --2- 172.21.15.19:0/232553192 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff444105bf0 0x7ff444107fe0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:21.187 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:14.739+0000 7ff44c342640 1 --2- 172.21.15.19:0/232553192 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff44406b620 0x7ff4441056b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:21.187 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:14.739+0000 7ff44c342640 1 -- 172.21.15.19:0/232553192 >> 172.21.15.19:0/232553192 conn(0x7ff4440fd1e0 msgr2=0x7ff4440ff620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:18:21.187 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:14.739+0000 7ff44c342640 1 -- 172.21.15.19:0/232553192 shutdown_connections 2024-09-10T22:18:21.187 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:14.740+0000 7ff44c342640 1 -- 172.21.15.19:0/232553192 wait complete. 2024-09-10T22:18:21.187 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:14.740+0000 7ff44c342640 1 Processor -- start 2024-09-10T22:18:21.187 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:14.740+0000 7ff44c342640 1 -- start start 2024-09-10T22:18:21.187 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:14.740+0000 7ff44c342640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff44406b620 0x7ff444102de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:18:21.188 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:14.740+0000 7ff44c342640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff444105bf0 0x7ff444101650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:18:21.188 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:14.741+0000 7ff44c342640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff444108720 0x7ff444101b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:18:21.188 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:14.741+0000 7ff44c342640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7ff44410e510 con 0x7ff444108720 2024-09-10T22:18:21.188 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:14.741+0000 7ff44c342640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7ff44410e390 con 0x7ff444105bf0 2024-09-10T22:18:21.188 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:14.741+0000 7ff44c342640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7ff44410e690 con 0x7ff44406b620 2024-09-10T22:18:21.188 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:14.741+0000 7ff44a8df640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff444108720 0x7ff444101b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:18:21.188 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:14.741+0000 7ff44a8df640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff444108720 0x7ff444101b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:35112/0 (socket says 172.21.15.19:35112) 2024-09-10T22:18:21.188 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:14.741+0000 7ff44a8df640 1 -- 172.21.15.19:0/2565127232 learned_addr learned my addr 172.21.15.19:0/2565127232 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:18:21.188 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:14.741+0000 7ff4498dd640 1 --2- 172.21.15.19:0/2565127232 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff444105bf0 0x7ff444101650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:18:21.188 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:14.741+0000 7ff44a0de640 1 --2- 172.21.15.19:0/2565127232 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff44406b620 0x7ff444102de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:18:21.188 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:14.741+0000 7ff44a8df640 1 -- 172.21.15.19:0/2565127232 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff44406b620 msgr2=0x7ff444102de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:18:21.188 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:14.741+0000 7ff44a8df640 1 --2- 172.21.15.19:0/2565127232 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff44406b620 0x7ff444102de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:21.189 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:14.741+0000 7ff44a8df640 1 -- 172.21.15.19:0/2565127232 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff444105bf0 msgr2=0x7ff444101650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:18:21.189 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:14.741+0000 7ff44a8df640 1 --2- 172.21.15.19:0/2565127232 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff444105bf0 0x7ff444101650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:21.189 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:14.741+0000 7ff44a8df640 1 -- 172.21.15.19:0/2565127232 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff444102450 con 0x7ff444108720 2024-09-10T22:18:21.189 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:14.741+0000 7ff4498dd640 1 --2- 172.21.15.19:0/2565127232 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff444105bf0 0x7ff444101650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T22:18:21.189 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:14.741+0000 7ff44a0de640 1 --2- 172.21.15.19:0/2565127232 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff44406b620 0x7ff444102de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T22:18:21.189 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:14.741+0000 7ff44a8df640 1 --2- 172.21.15.19:0/2565127232 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff444108720 0x7ff444101b90 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7ff43c00eb10 tx=0x7ff43c00c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:18:21.189 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:14.741+0000 7ff43b7fe640 1 -- 172.21.15.19:0/2565127232 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff43c004b20 con 0x7ff444108720 2024-09-10T22:18:21.189 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:14.741+0000 7ff44c342640 1 -- 172.21.15.19:0/2565127232 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff4441a2df0 con 0x7ff444108720 2024-09-10T22:18:21.189 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:14.742+0000 7ff43b7fe640 1 -- 172.21.15.19:0/2565127232 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(25 keys) ==== 1070+0+0 (secure 0 0 0) 0x7ff43c004cc0 con 0x7ff444108720 2024-09-10T22:18:21.189 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:14.742+0000 7ff43b7fe640 1 -- 172.21.15.19:0/2565127232 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff43c010690 con 0x7ff444108720 2024-09-10T22:18:21.189 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:14.742+0000 7ff44c342640 1 -- 172.21.15.19:0/2565127232 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff4441a32a0 con 0x7ff444108720 2024-09-10T22:18:21.189 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:14.743+0000 7ff44c342640 1 -- 172.21.15.19:0/2565127232 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff444105fd0 con 0x7ff444108720 2024-09-10T22:18:21.189 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:14.744+0000 7ff43b7fe640 1 -- 172.21.15.19:0/2565127232 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 15) ==== 153194+0+0 (secure 0 0 0) 0x7ff43c005000 con 0x7ff444108720 2024-09-10T22:18:21.190 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:14.745+0000 7ff43b7fe640 1 --2- 172.21.15.19:0/2565127232 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7ff4300b5250 0x7ff4300b7710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:18:21.190 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:14.745+0000 7ff43b7fe640 1 -- 172.21.15.19:0/2565127232 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7ff43c0e46d0 con 0x7ff444108720 2024-09-10T22:18:21.190 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:14.745+0000 7ff44a0de640 1 --2- 172.21.15.19:0/2565127232 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7ff4300b5250 0x7ff4300b7710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:18:21.190 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:14.746+0000 7ff44a0de640 1 --2- 172.21.15.19:0/2565127232 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7ff4300b5250 0x7ff4300b7710 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7ff440005d00 tx=0x7ff440005c70 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:18:21.190 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:14.748+0000 7ff43b7fe640 1 -- 172.21.15.19:0/2565127232 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7ff43c056220 con 0x7ff444108720 2024-09-10T22:18:21.190 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:14.950+0000 7ff44c342640 1 -- 172.21.15.19:0/2565127232 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command([{prefix=config set, name=rados_mon_op_timeout}] v 0) -- 0x7ff444063d50 con 0x7ff444108720 2024-09-10T22:18:21.190 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:14.954+0000 7ff43b7fe640 1 -- 172.21.15.19:0/2565127232 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{prefix=config set, name=rados_mon_op_timeout}]=0 v21)=0 v21) ==== 123+0+0 (secure 0 0 0) 0x7ff43c0ad260 con 0x7ff444108720 2024-09-10T22:18:21.190 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:14.955+0000 7ff43b7fe640 1 -- 172.21.15.19:0/2565127232 <== mon.0 v2:172.21.15.19:3300/0 8 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff43c0a82b0 con 0x7ff444108720 2024-09-10T22:18:21.190 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:14.957+0000 7ff44c342640 1 -- 172.21.15.19:0/2565127232 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7ff4300b5250 msgr2=0x7ff4300b7710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:18:21.190 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:14.957+0000 7ff44c342640 1 --2- 172.21.15.19:0/2565127232 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7ff4300b5250 0x7ff4300b7710 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7ff440005d00 tx=0x7ff440005c70 comp rx=0 tx=0).stop 2024-09-10T22:18:21.190 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:14.957+0000 7ff44c342640 1 -- 172.21.15.19:0/2565127232 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff444108720 msgr2=0x7ff444101b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:18:21.190 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:14.957+0000 7ff44c342640 1 --2- 172.21.15.19:0/2565127232 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff444108720 0x7ff444101b90 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7ff43c00eb10 tx=0x7ff43c00c2d0 comp rx=0 tx=0).stop 2024-09-10T22:18:21.191 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:14.957+0000 7ff44c342640 1 -- 172.21.15.19:0/2565127232 shutdown_connections 2024-09-10T22:18:21.191 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:14.957+0000 7ff44c342640 1 --2- 172.21.15.19:0/2565127232 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7ff4300b5250 0x7ff4300b7710 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:21.191 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:14.957+0000 7ff44c342640 1 --2- 172.21.15.19:0/2565127232 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff444108720 0x7ff444101b90 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:21.191 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:14.957+0000 7ff44c342640 1 --2- 172.21.15.19:0/2565127232 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff444105bf0 0x7ff444101650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:21.191 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:14.957+0000 7ff44c342640 1 --2- 172.21.15.19:0/2565127232 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff44406b620 0x7ff444102de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:21.191 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:14.957+0000 7ff44c342640 1 -- 172.21.15.19:0/2565127232 >> 172.21.15.19:0/2565127232 conn(0x7ff4440fd1e0 msgr2=0x7ff444103f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:18:21.191 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:14.957+0000 7ff44c342640 1 -- 172.21.15.19:0/2565127232 shutdown_connections 2024-09-10T22:18:21.191 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:14.957+0000 7ff44c342640 1 -- 172.21.15.19:0/2565127232 wait complete. 2024-09-10T22:18:22.292 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:18:21 smithi019 ceph-mon[31375]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T22:18:22.359 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:18:21 smithi135 ceph-mon[34789]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T22:18:22.375 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:18:21 smithi138 ceph-mon[35236]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T22:18:22.526 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:17.753+0000 7f432c1a1640 1 -- 172.21.15.19:0/3171951828 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4324108770 msgr2=0x7f432410ac30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:18:22.527 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:17.753+0000 7f432c1a1640 1 --2- 172.21.15.19:0/3171951828 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4324108770 0x7f432410ac30 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f431c009ca0 tx=0x7f431c02a8c0 comp rx=0 tx=0).stop 2024-09-10T22:18:22.527 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:17.753+0000 7f432c1a1640 1 -- 172.21.15.19:0/3171951828 shutdown_connections 2024-09-10T22:18:22.527 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:17.753+0000 7f432c1a1640 1 --2- 172.21.15.19:0/3171951828 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4324108770 0x7f432410ac30 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:22.527 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:17.753+0000 7f432c1a1640 1 --2- 172.21.15.19:0/3171951828 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4324105bc0 0x7f4324108030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:22.527 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:17.753+0000 7f432c1a1640 1 --2- 172.21.15.19:0/3171951828 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f432406c0c0 0x7f4324105630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:22.527 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:17.753+0000 7f432c1a1640 1 -- 172.21.15.19:0/3171951828 >> 172.21.15.19:0/3171951828 conn(0x7f43240fd200 msgr2=0x7f43240ff660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:18:22.527 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:17.753+0000 7f432c1a1640 1 -- 172.21.15.19:0/3171951828 shutdown_connections 2024-09-10T22:18:22.527 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:17.753+0000 7f432c1a1640 1 -- 172.21.15.19:0/3171951828 wait complete. 2024-09-10T22:18:22.527 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:17.754+0000 7f432c1a1640 1 Processor -- start 2024-09-10T22:18:22.527 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:17.754+0000 7f432c1a1640 1 -- start start 2024-09-10T22:18:22.527 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:17.754+0000 7f432c1a1640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f432406c0c0 0x7f4324198df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:18:22.527 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:17.754+0000 7f432c1a1640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4324105bc0 0x7f4324199440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:18:22.528 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:17.754+0000 7f432c1a1640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4324108770 0x7f432419a080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:18:22.528 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:17.754+0000 7f432c1a1640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f432410e730 con 0x7f4324108770 2024-09-10T22:18:22.528 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:17.754+0000 7f432c1a1640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f432410e5b0 con 0x7f4324105bc0 2024-09-10T22:18:22.528 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:17.754+0000 7f432c1a1640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f432410e8b0 con 0x7f432406c0c0 2024-09-10T22:18:22.528 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:17.754+0000 7f432a73e640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4324108770 0x7f432419a080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:18:22.528 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:17.754+0000 7f4329f3d640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f432406c0c0 0x7f4324198df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:18:22.528 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:17.754+0000 7f432a73e640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4324108770 0x7f432419a080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:35202/0 (socket says 172.21.15.19:35202) 2024-09-10T22:18:22.528 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:17.754+0000 7f432a73e640 1 -- 172.21.15.19:0/1441833564 learned_addr learned my addr 172.21.15.19:0/1441833564 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:18:22.528 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:17.754+0000 7f432973c640 1 --2- 172.21.15.19:0/1441833564 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4324105bc0 0x7f4324199440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:18:22.528 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:17.755+0000 7f4329f3d640 1 -- 172.21.15.19:0/1441833564 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4324105bc0 msgr2=0x7f4324199440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:18:22.528 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:17.755+0000 7f4329f3d640 1 --2- 172.21.15.19:0/1441833564 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4324105bc0 0x7f4324199440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:22.528 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:17.755+0000 7f4329f3d640 1 -- 172.21.15.19:0/1441833564 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4324108770 msgr2=0x7f432419a080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:18:22.529 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:17.755+0000 7f4329f3d640 1 --2- 172.21.15.19:0/1441833564 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4324108770 0x7f432419a080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:22.529 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:17.755+0000 7f4329f3d640 1 -- 172.21.15.19:0/1441833564 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f432419a920 con 0x7f432406c0c0 2024-09-10T22:18:22.529 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:17.755+0000 7f432973c640 1 --2- 172.21.15.19:0/1441833564 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4324105bc0 0x7f4324199440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T22:18:22.529 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:17.755+0000 7f4329f3d640 1 --2- 172.21.15.19:0/1441833564 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f432406c0c0 0x7f4324198df0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f431400e9f0 tx=0x7f431400eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:18:22.529 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:17.755+0000 7f4322ffd640 1 -- 172.21.15.19:0/1441833564 <== mon.1 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f431400ccc0 con 0x7f432406c0c0 2024-09-10T22:18:22.529 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:17.755+0000 7f432c1a1640 1 -- 172.21.15.19:0/1441833564 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f432419ac10 con 0x7f432406c0c0 2024-09-10T22:18:22.529 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:17.755+0000 7f4322ffd640 1 -- 172.21.15.19:0/1441833564 <== mon.1 v2:172.21.15.138:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4314005020 con 0x7f432406c0c0 2024-09-10T22:18:22.529 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:17.755+0000 7f4322ffd640 1 -- 172.21.15.19:0/1441833564 <== mon.1 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4314004a00 con 0x7f432406c0c0 2024-09-10T22:18:22.529 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:17.755+0000 7f432c1a1640 1 -- 172.21.15.19:0/1441833564 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f43241a12f0 con 0x7f432406c0c0 2024-09-10T22:18:22.529 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:17.756+0000 7f432c1a1640 1 -- 172.21.15.19:0/1441833564 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4324106020 con 0x7f432406c0c0 2024-09-10T22:18:22.529 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:17.758+0000 7f4322ffd640 1 -- 172.21.15.19:0/1441833564 <== mon.1 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 15) ==== 153194+0+0 (secure 0 0 0) 0x7f4314004ba0 con 0x7f432406c0c0 2024-09-10T22:18:22.529 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:17.759+0000 7f4322ffd640 1 --2- 172.21.15.19:0/1441833564 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f430c0b5250 0x7f430c0b7710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:18:22.529 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:17.759+0000 7f432973c640 1 --2- 172.21.15.19:0/1441833564 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f430c0b5250 0x7f430c0b7710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:18:22.530 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:17.759+0000 7f4322ffd640 1 -- 172.21.15.19:0/1441833564 <== mon.1 v2:172.21.15.138:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f43140e3f90 con 0x7f432406c0c0 2024-09-10T22:18:22.530 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:17.759+0000 7f432973c640 1 --2- 172.21.15.19:0/1441833564 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f430c0b5250 0x7f430c0b7710 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f432406c570 tx=0x7f4318005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:18:22.530 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:17.766+0000 7f4322ffd640 1 -- 172.21.15.19:0/1441833564 <== mon.1 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f43140acb10 con 0x7f432406c0c0 2024-09-10T22:18:22.530 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:17.954+0000 7f432c1a1640 1 -- 172.21.15.19:0/1441833564 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command([{prefix=config set, name=debug_ms}] v 0) -- 0x7f43240fecf0 con 0x7f432406c0c0 2024-09-10T22:18:22.530 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:17.961+0000 7f4322ffd640 1 -- 172.21.15.19:0/1441833564 <== mon.1 v2:172.21.15.138:3300/0 7 ==== mon_command_ack([{prefix=config set, name=debug_ms}]=0 v25)=0 v25) ==== 106+0+0 (secure 0 0 0) 0x7f43140ac410 con 0x7f432406c0c0 2024-09-10T22:18:22.530 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:17.963+0000 7f432c1a1640 1 -- 172.21.15.19:0/1441833564 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f430c0b5250 msgr2=0x7f430c0b7710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:18:22.530 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:17.963+0000 7f432c1a1640 1 --2- 172.21.15.19:0/1441833564 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f430c0b5250 0x7f430c0b7710 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f432406c570 tx=0x7f4318005f90 comp rx=0 tx=0).stop 2024-09-10T22:18:22.530 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:17.963+0000 7f432c1a1640 1 -- 172.21.15.19:0/1441833564 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f432406c0c0 msgr2=0x7f4324198df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:18:22.530 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:17.963+0000 7f432c1a1640 1 --2- 172.21.15.19:0/1441833564 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f432406c0c0 0x7f4324198df0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f431400e9f0 tx=0x7f431400eeb0 comp rx=0 tx=0).stop 2024-09-10T22:18:22.530 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:17.963+0000 7f432c1a1640 1 -- 172.21.15.19:0/1441833564 shutdown_connections 2024-09-10T22:18:22.530 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:17.963+0000 7f432c1a1640 1 --2- 172.21.15.19:0/1441833564 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f430c0b5250 0x7f430c0b7710 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:22.530 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:17.963+0000 7f432c1a1640 1 --2- 172.21.15.19:0/1441833564 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4324108770 0x7f432419a080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:22.530 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:17.963+0000 7f432c1a1640 1 --2- 172.21.15.19:0/1441833564 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4324105bc0 0x7f4324199440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:22.530 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:17.963+0000 7f432c1a1640 1 --2- 172.21.15.19:0/1441833564 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f432406c0c0 0x7f4324198df0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:22.531 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:17.963+0000 7f432c1a1640 1 -- 172.21.15.19:0/1441833564 >> 172.21.15.19:0/1441833564 conn(0x7f43240fd200 msgr2=0x7f4324103e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:18:22.531 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:17.964+0000 7f432c1a1640 1 -- 172.21.15.19:0/1441833564 shutdown_connections 2024-09-10T22:18:22.531 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:17.964+0000 7f432c1a1640 1 -- 172.21.15.19:0/1441833564 wait complete. 2024-09-10T22:18:23.329 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:23.327+0000 7fb2cea8f640 1 -- 172.21.15.19:0/2550034421 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb2c8106760 msgr2=0x7fb2c810d0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:18:23.329 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:23.327+0000 7fb2cea8f640 1 --2- 172.21.15.19:0/2550034421 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb2c8106760 0x7fb2c810d0e0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fb2c0009cd0 tx=0x7fb2c002a8e0 comp rx=0 tx=0).stop 2024-09-10T22:18:23.329 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:23.327+0000 7fb2cea8f640 1 -- 172.21.15.19:0/2550034421 shutdown_connections 2024-09-10T22:18:23.329 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:23.327+0000 7fb2cea8f640 1 --2- 172.21.15.19:0/2550034421 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb2c8106760 0x7fb2c810d0e0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:23.329 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:23.327+0000 7fb2cea8f640 1 --2- 172.21.15.19:0/2550034421 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb2c8105da0 0x7fb2c8106220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:23.330 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:23.327+0000 7fb2cea8f640 1 --2- 172.21.15.19:0/2550034421 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb2c8104c40 0x7fb2c8105040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:23.330 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:23.327+0000 7fb2cea8f640 1 -- 172.21.15.19:0/2550034421 >> 172.21.15.19:0/2550034421 conn(0x7fb2c8100510 msgr2=0x7fb2c8102950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:18:23.330 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:23.327+0000 7fb2cea8f640 1 -- 172.21.15.19:0/2550034421 shutdown_connections 2024-09-10T22:18:23.330 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:23.327+0000 7fb2cea8f640 1 -- 172.21.15.19:0/2550034421 wait complete. 2024-09-10T22:18:23.330 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:23.328+0000 7fb2cea8f640 1 Processor -- start 2024-09-10T22:18:23.330 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:23.328+0000 7fb2cea8f640 1 -- start start 2024-09-10T22:18:23.331 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:23.328+0000 7fb2cea8f640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb2c8104c40 0x7fb2c819b000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:18:23.331 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:23.328+0000 7fb2cea8f640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb2c8105da0 0x7fb2c819b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:18:23.332 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:23.328+0000 7fb2cea8f640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb2c8106760 0x7fb2c819c220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:18:23.332 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:23.328+0000 7fb2cea8f640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fb2c8110910 con 0x7fb2c8106760 2024-09-10T22:18:23.332 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:23.328+0000 7fb2cea8f640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fb2c8110790 con 0x7fb2c8104c40 2024-09-10T22:18:23.332 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:23.328+0000 7fb2cea8f640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7fb2c8110a90 con 0x7fb2c8105da0 2024-09-10T22:18:23.332 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:23.328+0000 7fb2cd02c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb2c8106760 0x7fb2c819c220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:18:23.332 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:23.328+0000 7fb2cc82b640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb2c8104c40 0x7fb2c819b000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:18:23.332 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:23.328+0000 7fb2cd02c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb2c8106760 0x7fb2c819c220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:35268/0 (socket says 172.21.15.19:35268) 2024-09-10T22:18:23.332 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:23.328+0000 7fb2cd02c640 1 -- 172.21.15.19:0/3671457219 learned_addr learned my addr 172.21.15.19:0/3671457219 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:18:23.332 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:23.328+0000 7fb2cc82b640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb2c8104c40 0x7fb2c819b000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.19:37800/0 (socket says 172.21.15.19:37800) 2024-09-10T22:18:23.332 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:23.328+0000 7fb2c7fff640 1 --2- 172.21.15.19:0/3671457219 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb2c8105da0 0x7fb2c819b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:18:23.332 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:23.329+0000 7fb2cd02c640 1 -- 172.21.15.19:0/3671457219 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb2c8105da0 msgr2=0x7fb2c819b650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:18:23.332 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:23.329+0000 7fb2cd02c640 1 --2- 172.21.15.19:0/3671457219 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb2c8105da0 0x7fb2c819b650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:23.333 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:23.329+0000 7fb2cd02c640 1 -- 172.21.15.19:0/3671457219 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb2c8104c40 msgr2=0x7fb2c819b000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:18:23.333 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:23.329+0000 7fb2cd02c640 1 --2- 172.21.15.19:0/3671457219 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb2c8104c40 0x7fb2c819b000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:23.333 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:23.329+0000 7fb2cd02c640 1 -- 172.21.15.19:0/3671457219 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb2c819cac0 con 0x7fb2c8106760 2024-09-10T22:18:23.333 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:23.329+0000 7fb2c7fff640 1 --2- 172.21.15.19:0/3671457219 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb2c8105da0 0x7fb2c819b650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T22:18:23.333 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:23.329+0000 7fb2cd02c640 1 --2- 172.21.15.19:0/3671457219 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb2c8106760 0x7fb2c819c220 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fb2c0004af0 tx=0x7fb2c0003ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:18:23.333 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:23.329+0000 7fb2c5ffb640 1 -- 172.21.15.19:0/3671457219 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2c0004240 con 0x7fb2c8106760 2024-09-10T22:18:23.333 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:23.329+0000 7fb2c5ffb640 1 -- 172.21.15.19:0/3671457219 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb2c00305a0 con 0x7fb2c8106760 2024-09-10T22:18:23.333 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:23.329+0000 7fb2c5ffb640 1 -- 172.21.15.19:0/3671457219 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2c00466e0 con 0x7fb2c8106760 2024-09-10T22:18:23.333 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:23.329+0000 7fb2cea8f640 1 -- 172.21.15.19:0/3671457219 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb2c819cd50 con 0x7fb2c8106760 2024-09-10T22:18:23.333 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:23.330+0000 7fb2cea8f640 1 -- 172.21.15.19:0/3671457219 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb2c81a3490 con 0x7fb2c8106760 2024-09-10T22:18:23.334 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:23.331+0000 7fb2cea8f640 1 -- 172.21.15.19:0/3671457219 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb2c810bf60 con 0x7fb2c8106760 2024-09-10T22:18:23.334 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:23.333+0000 7fb2c5ffb640 1 -- 172.21.15.19:0/3671457219 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 15) ==== 153194+0+0 (secure 0 0 0) 0x7fb2c004e070 con 0x7fb2c8106760 2024-09-10T22:18:23.334 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:23.333+0000 7fb2c5ffb640 1 --2- 172.21.15.19:0/3671457219 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7fb2b80b52d0 0x7fb2b80b7790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:18:23.335 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:23.333+0000 7fb2cc82b640 1 --2- 172.21.15.19:0/3671457219 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7fb2b80b52d0 0x7fb2b80b7790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:18:23.335 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:23.334+0000 7fb2c5ffb640 1 -- 172.21.15.19:0/3671457219 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7fb2c002e030 con 0x7fb2c8106760 2024-09-10T22:18:23.335 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:23.334+0000 7fb2cc82b640 1 --2- 172.21.15.19:0/3671457219 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7fb2b80b52d0 0x7fb2b80b7790 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fb2bc00bbe0 tx=0x7fb2bc00b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:18:23.339 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:23.338+0000 7fb2c5ffb640 1 -- 172.21.15.19:0/3671457219 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7fb2c004b060 con 0x7fb2c8106760 2024-09-10T22:18:23.526 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:23.524+0000 7fb2cea8f640 1 -- 172.21.15.19:0/3671457219 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command([{prefix=config set, name=mds_verify_scatter}] v 0) -- 0x7fb2c802e810 con 0x7fb2c8106760 2024-09-10T22:18:23.530 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:23.528+0000 7fb2c5ffb640 1 -- 172.21.15.19:0/3671457219 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_verify_scatter}]=0 v29)=0 v29) ==== 119+0+0 (secure 0 0 0) 0x7fb2c00cdf50 con 0x7fb2c8106760 2024-09-10T22:18:23.533 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:23.531+0000 7fb2cea8f640 1 -- 172.21.15.19:0/3671457219 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7fb2b80b52d0 msgr2=0x7fb2b80b7790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:18:23.533 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:23.531+0000 7fb2cea8f640 1 --2- 172.21.15.19:0/3671457219 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7fb2b80b52d0 0x7fb2b80b7790 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fb2bc00bbe0 tx=0x7fb2bc00b390 comp rx=0 tx=0).stop 2024-09-10T22:18:23.533 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:23.531+0000 7fb2cea8f640 1 -- 172.21.15.19:0/3671457219 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb2c8106760 msgr2=0x7fb2c819c220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:18:23.533 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:23.531+0000 7fb2cea8f640 1 --2- 172.21.15.19:0/3671457219 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb2c8106760 0x7fb2c819c220 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fb2c0004af0 tx=0x7fb2c0003ba0 comp rx=0 tx=0).stop 2024-09-10T22:18:23.533 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:23.531+0000 7fb2cea8f640 1 -- 172.21.15.19:0/3671457219 shutdown_connections 2024-09-10T22:18:23.533 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:23.531+0000 7fb2cea8f640 1 --2- 172.21.15.19:0/3671457219 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7fb2b80b52d0 0x7fb2b80b7790 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:23.533 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:23.531+0000 7fb2cea8f640 1 --2- 172.21.15.19:0/3671457219 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb2c8106760 0x7fb2c819c220 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:23.533 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:23.531+0000 7fb2cea8f640 1 --2- 172.21.15.19:0/3671457219 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb2c8105da0 0x7fb2c819b650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:23.533 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:23.531+0000 7fb2cea8f640 1 --2- 172.21.15.19:0/3671457219 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb2c8104c40 0x7fb2c819b000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:23.533 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:23.531+0000 7fb2cea8f640 1 -- 172.21.15.19:0/3671457219 >> 172.21.15.19:0/3671457219 conn(0x7fb2c8100510 msgr2=0x7fb2c8109130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:18:23.534 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:23.531+0000 7fb2cea8f640 1 -- 172.21.15.19:0/3671457219 shutdown_connections 2024-09-10T22:18:23.534 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:23.532+0000 7fb2cea8f640 1 -- 172.21.15.19:0/3671457219 wait complete. 2024-09-10T22:18:24.010 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:18:23 smithi019 ceph-mon[31375]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T22:18:24.010 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:18:23 smithi019 ceph-mon[31375]: from='client.? 172.21.15.19:0/3671457219' entity='client.admin' 2024-09-10T22:18:24.010 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:18:23 smithi019 ceph-mon[31375]: from='client.? 172.21.15.19:0/2253982218' entity='client.admin' 2024-09-10T22:18:24.012 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:24.010+0000 7fd4b19a1640 1 -- 172.21.15.19:0/1111470129 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd4ac1028f0 msgr2=0x7fd4ac102d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:18:24.012 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:24.010+0000 7fd4b19a1640 1 --2- 172.21.15.19:0/1111470129 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd4ac1028f0 0x7fd4ac102d70 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fd49c009cd0 tx=0x7fd49c02a8e0 comp rx=0 tx=0).stop 2024-09-10T22:18:24.012 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:24.010+0000 7fd4b19a1640 1 -- 172.21.15.19:0/1111470129 shutdown_connections 2024-09-10T22:18:24.012 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:24.010+0000 7fd4b19a1640 1 --2- 172.21.15.19:0/1111470129 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd4ac1032b0 0x7fd4ac109c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:24.012 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:24.010+0000 7fd4b19a1640 1 --2- 172.21.15.19:0/1111470129 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd4ac1028f0 0x7fd4ac102d70 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:24.012 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:24.010+0000 7fd4b19a1640 1 --2- 172.21.15.19:0/1111470129 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd4ac101790 0x7fd4ac101b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:24.012 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:24.010+0000 7fd4b19a1640 1 -- 172.21.15.19:0/1111470129 >> 172.21.15.19:0/1111470129 conn(0x7fd4ac0fd080 msgr2=0x7fd4ac0ff4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:18:24.012 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:24.010+0000 7fd4b19a1640 1 -- 172.21.15.19:0/1111470129 shutdown_connections 2024-09-10T22:18:24.012 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:24.010+0000 7fd4b19a1640 1 -- 172.21.15.19:0/1111470129 wait complete. 2024-09-10T22:18:24.014 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:24.011+0000 7fd4b19a1640 1 Processor -- start 2024-09-10T22:18:24.014 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:24.011+0000 7fd4b19a1640 1 -- start start 2024-09-10T22:18:24.014 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:24.011+0000 7fd4b19a1640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd4ac101790 0x7fd4ac198be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:18:24.014 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:24.011+0000 7fd4b19a1640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd4ac1028f0 0x7fd4ac199230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:18:24.014 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:24.011+0000 7fd4b19a1640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd4ac1032b0 0x7fd4ac199e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:18:24.014 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:24.011+0000 7fd4b19a1640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fd4ac10d3f0 con 0x7fd4ac1032b0 2024-09-10T22:18:24.015 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:24.011+0000 7fd4b19a1640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fd4ac10d270 con 0x7fd4ac1028f0 2024-09-10T22:18:24.015 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:24.011+0000 7fd4b19a1640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7fd4ac10d570 con 0x7fd4ac101790 2024-09-10T22:18:24.015 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:24.011+0000 7fd4b11a0640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd4ac1032b0 0x7fd4ac199e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:18:24.015 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:24.011+0000 7fd4b11a0640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd4ac1032b0 0x7fd4ac199e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:52512/0 (socket says 172.21.15.19:52512) 2024-09-10T22:18:24.015 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:24.011+0000 7fd4b11a0640 1 -- 172.21.15.19:0/2134697014 learned_addr learned my addr 172.21.15.19:0/2134697014 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:18:24.015 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:24.011+0000 7fd4abfff640 1 --2- 172.21.15.19:0/2134697014 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd4ac1028f0 0x7fd4ac199230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:18:24.015 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:24.011+0000 7fd4b099f640 1 --2- 172.21.15.19:0/2134697014 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd4ac101790 0x7fd4ac198be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:18:24.015 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:24.012+0000 7fd4b11a0640 1 -- 172.21.15.19:0/2134697014 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd4ac101790 msgr2=0x7fd4ac198be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:18:24.015 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:24.012+0000 7fd4b11a0640 1 --2- 172.21.15.19:0/2134697014 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd4ac101790 0x7fd4ac198be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:24.015 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:24.012+0000 7fd4b11a0640 1 -- 172.21.15.19:0/2134697014 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd4ac1028f0 msgr2=0x7fd4ac199230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:18:24.015 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:24.012+0000 7fd4b11a0640 1 --2- 172.21.15.19:0/2134697014 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd4ac1028f0 0x7fd4ac199230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:24.015 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:24.012+0000 7fd4b11a0640 1 -- 172.21.15.19:0/2134697014 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd4ac19a710 con 0x7fd4ac1032b0 2024-09-10T22:18:24.015 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:24.012+0000 7fd4b11a0640 1 --2- 172.21.15.19:0/2134697014 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd4ac1032b0 0x7fd4ac199e70 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fd4a400e990 tx=0x7fd4a400ed90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:18:24.016 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:24.012+0000 7fd4a9ffb640 1 -- 172.21.15.19:0/2134697014 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4a400cc60 con 0x7fd4ac1032b0 2024-09-10T22:18:24.016 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:24.012+0000 7fd4b19a1640 1 -- 172.21.15.19:0/2134697014 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd4ac19aa00 con 0x7fd4ac1032b0 2024-09-10T22:18:24.016 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:24.012+0000 7fd4a9ffb640 1 -- 172.21.15.19:0/2134697014 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd4a400ce00 con 0x7fd4ac1032b0 2024-09-10T22:18:24.016 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:24.012+0000 7fd4a9ffb640 1 -- 172.21.15.19:0/2134697014 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4a401a960 con 0x7fd4ac1032b0 2024-09-10T22:18:24.016 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:24.012+0000 7fd4b19a1640 1 -- 172.21.15.19:0/2134697014 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd4ac1a10e0 con 0x7fd4ac1032b0 2024-09-10T22:18:24.016 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:24.013+0000 7fd4b19a1640 1 -- 172.21.15.19:0/2134697014 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd4ac101b90 con 0x7fd4ac1032b0 2024-09-10T22:18:24.016 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:24.015+0000 7fd4a9ffb640 1 -- 172.21.15.19:0/2134697014 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 15) ==== 153194+0+0 (secure 0 0 0) 0x7fd4a4022030 con 0x7fd4ac1032b0 2024-09-10T22:18:24.017 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:24.016+0000 7fd4a9ffb640 1 --2- 172.21.15.19:0/2134697014 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7fd4980b52f0 0x7fd4980b77b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:18:24.017 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:24.016+0000 7fd4b099f640 1 --2- 172.21.15.19:0/2134697014 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7fd4980b52f0 0x7fd4980b77b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:18:24.017 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:24.016+0000 7fd4a9ffb640 1 -- 172.21.15.19:0/2134697014 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7fd4a40e4130 con 0x7fd4ac1032b0 2024-09-10T22:18:24.018 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:24.016+0000 7fd4b099f640 1 --2- 172.21.15.19:0/2134697014 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7fd4980b52f0 0x7fd4980b77b0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fd494005fd0 tx=0x7fd494005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:18:24.020 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:24.019+0000 7fd4a9ffb640 1 -- 172.21.15.19:0/2134697014 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7fd4a4016030 con 0x7fd4ac1032b0 2024-09-10T22:18:24.206 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:24.205+0000 7fd4b19a1640 1 -- 172.21.15.19:0/2134697014 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command([{prefix=config set, name=osd_op_complaint_time}] v 0) -- 0x7fd4ac1a1420 con 0x7fd4ac1032b0 2024-09-10T22:18:24.209 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:24.208+0000 7fd4a9ffb640 1 -- 172.21.15.19:0/2134697014 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{prefix=config set, name=osd_op_complaint_time}]=0 v31)=0 v31) ==== 121+0+0 (secure 0 0 0) 0x7fd4a40acc20 con 0x7fd4ac1032b0 2024-09-10T22:18:24.212 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:24.210+0000 7fd4b19a1640 1 -- 172.21.15.19:0/2134697014 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7fd4980b52f0 msgr2=0x7fd4980b77b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:18:24.212 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:24.210+0000 7fd4b19a1640 1 --2- 172.21.15.19:0/2134697014 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7fd4980b52f0 0x7fd4980b77b0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fd494005fd0 tx=0x7fd494005850 comp rx=0 tx=0).stop 2024-09-10T22:18:24.212 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:24.210+0000 7fd4b19a1640 1 -- 172.21.15.19:0/2134697014 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd4ac1032b0 msgr2=0x7fd4ac199e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:18:24.212 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:24.210+0000 7fd4b19a1640 1 --2- 172.21.15.19:0/2134697014 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd4ac1032b0 0x7fd4ac199e70 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fd4a400e990 tx=0x7fd4a400ed90 comp rx=0 tx=0).stop 2024-09-10T22:18:24.212 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:24.211+0000 7fd4b19a1640 1 -- 172.21.15.19:0/2134697014 shutdown_connections 2024-09-10T22:18:24.212 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:24.211+0000 7fd4b19a1640 1 --2- 172.21.15.19:0/2134697014 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7fd4980b52f0 0x7fd4980b77b0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:24.212 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:24.211+0000 7fd4b19a1640 1 --2- 172.21.15.19:0/2134697014 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd4ac1032b0 0x7fd4ac199e70 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:24.213 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:24.211+0000 7fd4b19a1640 1 --2- 172.21.15.19:0/2134697014 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd4ac1028f0 0x7fd4ac199230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:24.213 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:24.211+0000 7fd4b19a1640 1 --2- 172.21.15.19:0/2134697014 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd4ac101790 0x7fd4ac198be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:24.213 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:24.211+0000 7fd4b19a1640 1 -- 172.21.15.19:0/2134697014 >> 172.21.15.19:0/2134697014 conn(0x7fd4ac0fd080 msgr2=0x7fd4ac0fe9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:18:24.213 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:24.211+0000 7fd4b19a1640 1 -- 172.21.15.19:0/2134697014 shutdown_connections 2024-09-10T22:18:24.213 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:24.211+0000 7fd4b19a1640 1 -- 172.21.15.19:0/2134697014 wait complete. 2024-09-10T22:18:24.360 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:18:23 smithi135 ceph-mon[34789]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T22:18:24.360 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:18:23 smithi135 ceph-mon[34789]: from='client.? 172.21.15.19:0/3671457219' entity='client.admin' 2024-09-10T22:18:24.360 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:18:23 smithi135 ceph-mon[34789]: from='client.? 172.21.15.19:0/2253982218' entity='client.admin' 2024-09-10T22:18:24.375 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:18:23 smithi138 ceph-mon[35236]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T22:18:24.375 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:18:23 smithi138 ceph-mon[35236]: from='client.? 172.21.15.19:0/3671457219' entity='client.admin' 2024-09-10T22:18:24.375 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:18:23 smithi138 ceph-mon[35236]: from='client.? 172.21.15.19:0/2253982218' entity='client.admin' 2024-09-10T22:18:24.599 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '22997a4c-6fc2-11ef-bcea-c7b262605968', '--', 'ceph', 'config', 'set', 'client', 'rados_osd_op_timeout', '900'], check_status=True, hostname='smithi019') 2024-09-10T22:18:24.599 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '22997a4c-6fc2-11ef-bcea-c7b262605968', '--', 'ceph', 'config', 'set', 'mds', 'debug_mds', '20'], check_status=True, hostname='smithi019') 2024-09-10T22:18:24.599 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '22997a4c-6fc2-11ef-bcea-c7b262605968', '--', 'ceph', 'config', 'set', 'mds', 'debug_mds_balancer', '20'], check_status=True, hostname='smithi019') 2024-09-10T22:18:24.656 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:23.524+0000 7f5db2fc8640 1 -- 172.21.15.19:0/2512027824 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5dac107f30 msgr2=0x7f5dac10a320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:18:24.656 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:23.524+0000 7f5db2fc8640 1 --2- 172.21.15.19:0/2512027824 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5dac107f30 0x7f5dac10a320 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f5d9c009900 tx=0x7f5d9c02a410 comp rx=0 tx=0).stop 2024-09-10T22:18:24.656 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:23.524+0000 7f5db2fc8640 1 -- 172.21.15.19:0/2512027824 shutdown_connections 2024-09-10T22:18:24.656 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:23.524+0000 7f5db2fc8640 1 --2- 172.21.15.19:0/2512027824 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5dac10a940 0x7f5dac10ce00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:24.656 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:23.524+0000 7f5db2fc8640 1 --2- 172.21.15.19:0/2512027824 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5dac107f30 0x7f5dac10a320 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:24.656 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:23.524+0000 7f5db2fc8640 1 --2- 172.21.15.19:0/2512027824 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5dac06b5d0 0x7f5dac1079f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:24.656 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:23.524+0000 7f5db2fc8640 1 -- 172.21.15.19:0/2512027824 >> 172.21.15.19:0/2512027824 conn(0x7f5dac0fd1e0 msgr2=0x7f5dac0ff620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:18:24.656 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:23.524+0000 7f5db2fc8640 1 -- 172.21.15.19:0/2512027824 shutdown_connections 2024-09-10T22:18:24.657 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:23.524+0000 7f5db2fc8640 1 -- 172.21.15.19:0/2512027824 wait complete. 2024-09-10T22:18:24.657 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:23.525+0000 7f5db2fc8640 1 Processor -- start 2024-09-10T22:18:24.657 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:23.525+0000 7f5db2fc8640 1 -- start start 2024-09-10T22:18:24.657 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:23.525+0000 7f5db2fc8640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5dac06b5d0 0x7f5dac19b060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:18:24.657 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:23.525+0000 7f5db2fc8640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5dac107f30 0x7f5dac19b6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:18:24.657 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:23.525+0000 7f5db2fc8640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5dac10a940 0x7f5dac19c2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:18:24.657 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:23.525+0000 7f5db2fc8640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f5dac110940 con 0x7f5dac06b5d0 2024-09-10T22:18:24.657 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:23.525+0000 7f5db2fc8640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f5dac1107c0 con 0x7f5dac10a940 2024-09-10T22:18:24.657 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:23.525+0000 7f5db2fc8640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f5dac110ac0 con 0x7f5dac107f30 2024-09-10T22:18:24.657 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:23.525+0000 7f5db0d64640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5dac06b5d0 0x7f5dac19b060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:18:24.657 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:23.525+0000 7f5db0d64640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5dac06b5d0 0x7f5dac19b060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:52494/0 (socket says 172.21.15.19:52494) 2024-09-10T22:18:24.657 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:23.525+0000 7f5db0d64640 1 -- 172.21.15.19:0/2253982218 learned_addr learned my addr 172.21.15.19:0/2253982218 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:18:24.657 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:23.525+0000 7f5da3fff640 1 --2- 172.21.15.19:0/2253982218 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5dac107f30 0x7f5dac19b6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:18:24.658 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:23.525+0000 7f5db1565640 1 --2- 172.21.15.19:0/2253982218 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5dac10a940 0x7f5dac19c2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:18:24.658 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:23.525+0000 7f5db0d64640 1 -- 172.21.15.19:0/2253982218 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5dac107f30 msgr2=0x7f5dac19b6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:18:24.658 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:23.525+0000 7f5db0d64640 1 --2- 172.21.15.19:0/2253982218 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5dac107f30 0x7f5dac19b6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:24.658 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:23.525+0000 7f5db0d64640 1 -- 172.21.15.19:0/2253982218 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5dac10a940 msgr2=0x7f5dac19c2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:18:24.658 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:23.525+0000 7f5db0d64640 1 --2- 172.21.15.19:0/2253982218 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5dac10a940 0x7f5dac19c2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:24.658 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:23.525+0000 7f5db0d64640 1 -- 172.21.15.19:0/2253982218 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5dac19cb90 con 0x7f5dac06b5d0 2024-09-10T22:18:24.658 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:23.525+0000 7f5db1565640 1 --2- 172.21.15.19:0/2253982218 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5dac10a940 0x7f5dac19c2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T22:18:24.658 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:23.526+0000 7f5db0d64640 1 --2- 172.21.15.19:0/2253982218 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5dac06b5d0 0x7f5dac19b060 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f5da800d950 tx=0x7f5da800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:18:24.658 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:23.526+0000 7f5da1ffb640 1 -- 172.21.15.19:0/2253982218 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5da8017030 con 0x7f5dac06b5d0 2024-09-10T22:18:24.658 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:23.526+0000 7f5da1ffb640 1 -- 172.21.15.19:0/2253982218 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5da8004020 con 0x7f5dac06b5d0 2024-09-10T22:18:24.658 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:23.526+0000 7f5db2fc8640 1 -- 172.21.15.19:0/2253982218 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5dac19ce80 con 0x7f5dac06b5d0 2024-09-10T22:18:24.658 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:23.526+0000 7f5da1ffb640 1 -- 172.21.15.19:0/2253982218 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5da80047a0 con 0x7f5dac06b5d0 2024-09-10T22:18:24.658 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:23.526+0000 7f5db2fc8640 1 -- 172.21.15.19:0/2253982218 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5dac1a3560 con 0x7f5dac06b5d0 2024-09-10T22:18:24.659 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:23.527+0000 7f5db2fc8640 1 -- 172.21.15.19:0/2253982218 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5dac0fecd0 con 0x7f5dac06b5d0 2024-09-10T22:18:24.659 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:23.532+0000 7f5da1ffb640 1 -- 172.21.15.19:0/2253982218 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 15) ==== 153194+0+0 (secure 0 0 0) 0x7f5da8009a30 con 0x7f5dac06b5d0 2024-09-10T22:18:24.659 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:23.533+0000 7f5da1ffb640 1 --2- 172.21.15.19:0/2253982218 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f5d940b52d0 0x7f5d940b7790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:18:24.659 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:23.533+0000 7f5da3fff640 1 --2- 172.21.15.19:0/2253982218 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f5d940b52d0 0x7f5d940b7790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:18:24.659 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:23.533+0000 7f5da1ffb640 1 -- 172.21.15.19:0/2253982218 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f5da80e4010 con 0x7f5dac06b5d0 2024-09-10T22:18:24.659 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:23.533+0000 7f5da3fff640 1 --2- 172.21.15.19:0/2253982218 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f5d940b52d0 0x7f5d940b7790 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f5d9c006010 tx=0x7f5d9c0314a0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:18:24.659 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:23.538+0000 7f5da1ffb640 1 -- 172.21.15.19:0/2253982218 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f5da80acc20 con 0x7f5dac06b5d0 2024-09-10T22:18:24.659 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:23.725+0000 7f5db2fc8640 1 -- 172.21.15.19:0/2253982218 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command([{prefix=config set, name=mds_bal_merge_size}] v 0) -- 0x7f5dac02e850 con 0x7f5dac06b5d0 2024-09-10T22:18:24.659 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:23.729+0000 7f5da1ffb640 1 -- 172.21.15.19:0/2253982218 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_bal_merge_size}]=0 v30)=0 v30) ==== 116+0+0 (secure 0 0 0) 0x7f5da80ac520 con 0x7f5dac06b5d0 2024-09-10T22:18:24.659 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:23.731+0000 7f5db2fc8640 1 -- 172.21.15.19:0/2253982218 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f5d940b52d0 msgr2=0x7f5d940b7790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:18:24.659 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:23.731+0000 7f5db2fc8640 1 --2- 172.21.15.19:0/2253982218 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f5d940b52d0 0x7f5d940b7790 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f5d9c006010 tx=0x7f5d9c0314a0 comp rx=0 tx=0).stop 2024-09-10T22:18:24.659 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:23.731+0000 7f5db2fc8640 1 -- 172.21.15.19:0/2253982218 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5dac06b5d0 msgr2=0x7f5dac19b060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:18:24.660 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:23.731+0000 7f5db2fc8640 1 --2- 172.21.15.19:0/2253982218 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5dac06b5d0 0x7f5dac19b060 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f5da800d950 tx=0x7f5da800de10 comp rx=0 tx=0).stop 2024-09-10T22:18:24.660 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:23.731+0000 7f5db2fc8640 1 -- 172.21.15.19:0/2253982218 shutdown_connections 2024-09-10T22:18:24.660 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:23.731+0000 7f5db2fc8640 1 --2- 172.21.15.19:0/2253982218 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f5d940b52d0 0x7f5d940b7790 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:24.660 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:23.731+0000 7f5db2fc8640 1 --2- 172.21.15.19:0/2253982218 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5dac10a940 0x7f5dac19c2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:24.660 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:23.731+0000 7f5db2fc8640 1 --2- 172.21.15.19:0/2253982218 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5dac107f30 0x7f5dac19b6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:24.660 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:23.731+0000 7f5db2fc8640 1 --2- 172.21.15.19:0/2253982218 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5dac06b5d0 0x7f5dac19b060 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:24.660 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:23.731+0000 7f5db2fc8640 1 -- 172.21.15.19:0/2253982218 >> 172.21.15.19:0/2253982218 conn(0x7f5dac0fd1e0 msgr2=0x7f5dac108b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:18:24.660 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:23.731+0000 7f5db2fc8640 1 -- 172.21.15.19:0/2253982218 shutdown_connections 2024-09-10T22:18:24.660 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:23.731+0000 7f5db2fc8640 1 -- 172.21.15.19:0/2253982218 wait complete. 2024-09-10T22:18:25.410 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:18:25 smithi019 ceph-mon[31375]: from='client.? 172.21.15.19:0/2134697014' entity='client.admin' 2024-09-10T22:18:25.410 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:18:25 smithi019 ceph-mon[31375]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T22:18:25.610 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:18:25 smithi135 ceph-mon[34789]: from='client.? 172.21.15.19:0/2134697014' entity='client.admin' 2024-09-10T22:18:25.610 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:18:25 smithi135 ceph-mon[34789]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T22:18:25.625 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:18:25 smithi138 ceph-mon[35236]: from='client.? 172.21.15.19:0/2134697014' entity='client.admin' 2024-09-10T22:18:25.625 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:18:25 smithi138 ceph-mon[35236]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T22:18:26.046 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '22997a4c-6fc2-11ef-bcea-c7b262605968', '--', 'ceph', 'config', 'set', 'mds', 'debug_ms', '2'], check_status=True, hostname='smithi019') 2024-09-10T22:18:26.046 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '22997a4c-6fc2-11ef-bcea-c7b262605968', '--', 'ceph', 'config', 'set', 'mds', 'mds_bal_fragment_size_max', '10000'], check_status=True, hostname='smithi019') 2024-09-10T22:18:26.046 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '22997a4c-6fc2-11ef-bcea-c7b262605968', '--', 'ceph', 'config', 'set', 'mds', 'mds_bal_merge_size', '5'], check_status=True, hostname='smithi019') 2024-09-10T22:18:27.609 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:18:27 smithi135 ceph-mon[34789]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T22:18:27.625 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:18:27 smithi138 ceph-mon[35236]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T22:18:27.673 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:18:27 smithi019 ceph-mon[31375]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T22:18:27.709 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '22997a4c-6fc2-11ef-bcea-c7b262605968', '--', 'ceph', 'config', 'set', 'mds', 'mds_bal_split_bits', '3'], check_status=True, hostname='smithi019') 2024-09-10T22:18:27.709 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '22997a4c-6fc2-11ef-bcea-c7b262605968', '--', 'ceph', 'config', 'set', 'mds', 'mds_bal_split_size', '100'], check_status=True, hostname='smithi019') 2024-09-10T22:18:27.709 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '22997a4c-6fc2-11ef-bcea-c7b262605968', '--', 'ceph', 'config', 'set', 'mds', 'mds_debug_frag', 'True'], check_status=True, hostname='smithi019') 2024-09-10T22:18:27.709 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '22997a4c-6fc2-11ef-bcea-c7b262605968', '--', 'ceph', 'config', 'set', 'mds', 'mds_debug_scatterstat', 'True'], check_status=True, hostname='smithi019') 2024-09-10T22:18:27.710 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '22997a4c-6fc2-11ef-bcea-c7b262605968', '--', 'ceph', 'config', 'set', 'mds', 'mds_op_complaint_time', '180'], check_status=True, hostname='smithi019') 2024-09-10T22:18:27.710 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '22997a4c-6fc2-11ef-bcea-c7b262605968', '--', 'ceph', 'config', 'set', 'mds', 'mds_verify_scatter', 'True'], check_status=True, hostname='smithi019') 2024-09-10T22:18:27.710 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '22997a4c-6fc2-11ef-bcea-c7b262605968', '--', 'ceph', 'config', 'set', 'mds', 'osd_op_complaint_time', '180'], check_status=True, hostname='smithi019') 2024-09-10T22:18:27.710 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '22997a4c-6fc2-11ef-bcea-c7b262605968', '--', 'ceph', 'config', 'set', 'mds', 'rados_mon_op_timeout', '900'], check_status=True, hostname='smithi019') 2024-09-10T22:18:27.710 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '22997a4c-6fc2-11ef-bcea-c7b262605968', '--', 'ceph', 'config', 'set', 'mds', 'rados_osd_op_timeout', '900'], check_status=True, hostname='smithi019') 2024-09-10T22:18:27.710 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '22997a4c-6fc2-11ef-bcea-c7b262605968', '--', 'ceph', 'config', 'set', 'mon', 'mon_op_complaint_time', '120'], check_status=True, hostname='smithi019') 2024-09-10T22:18:27.710 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '22997a4c-6fc2-11ef-bcea-c7b262605968', '--', 'ceph', 'config', 'set', 'mon', 'mon_warn_on_pool_no_app', 'False'], check_status=True, hostname='smithi019') 2024-09-10T22:18:27.710 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '22997a4c-6fc2-11ef-bcea-c7b262605968', '--', 'ceph', 'config', 'set', 'osd', 'osd_op_complaint_time', '180'], check_status=True, hostname='smithi019') 2024-09-10T22:18:27.711 INFO:tasks.cephadm:Deploying OSDs... 2024-09-10T22:18:27.711 DEBUG:teuthology.orchestra.run.smithi019:> set -ex 2024-09-10T22:18:27.711 DEBUG:teuthology.orchestra.run.smithi019:> dd if=/scratch_devs of=/dev/stdout 2024-09-10T22:18:27.730 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-10T22:18:27.730 DEBUG:teuthology.orchestra.run.smithi019:> stat /dev/vg_nvme/lv_1 2024-09-10T22:18:27.788 INFO:teuthology.orchestra.run.smithi019.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-10T22:18:27.788 INFO:teuthology.orchestra.run.smithi019.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-10T22:18:27.789 INFO:teuthology.orchestra.run.smithi019.stdout:Device: 5h/5d Inode: 666 Links: 1 2024-09-10T22:18:27.789 INFO:teuthology.orchestra.run.smithi019.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-10T22:18:27.789 INFO:teuthology.orchestra.run.smithi019.stdout:Context: system_u:object_r:device_t:s0 2024-09-10T22:18:27.789 INFO:teuthology.orchestra.run.smithi019.stdout:Access: 2024-09-10 22:17:18.957571859 +0000 2024-09-10T22:18:27.789 INFO:teuthology.orchestra.run.smithi019.stdout:Modify: 2024-09-10 22:12:36.310238737 +0000 2024-09-10T22:18:27.789 INFO:teuthology.orchestra.run.smithi019.stdout:Change: 2024-09-10 22:12:36.310238737 +0000 2024-09-10T22:18:27.789 INFO:teuthology.orchestra.run.smithi019.stdout: Birth: 2024-09-10 22:12:36.310238737 +0000 2024-09-10T22:18:27.789 DEBUG:teuthology.orchestra.run.smithi019:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-10T22:18:27.860 INFO:teuthology.orchestra.run.smithi019.stderr:1+0 records in 2024-09-10T22:18:27.860 INFO:teuthology.orchestra.run.smithi019.stderr:1+0 records out 2024-09-10T22:18:27.860 INFO:teuthology.orchestra.run.smithi019.stderr:512 bytes copied, 0.00023012 s, 2.2 MB/s 2024-09-10T22:18:27.861 DEBUG:teuthology.orchestra.run.smithi019:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-10T22:18:27.922 DEBUG:teuthology.orchestra.run.smithi019:> stat /dev/vg_nvme/lv_2 2024-09-10T22:18:27.981 INFO:teuthology.orchestra.run.smithi019.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-10T22:18:27.981 INFO:teuthology.orchestra.run.smithi019.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-10T22:18:27.981 INFO:teuthology.orchestra.run.smithi019.stdout:Device: 5h/5d Inode: 686 Links: 1 2024-09-10T22:18:27.982 INFO:teuthology.orchestra.run.smithi019.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-10T22:18:27.982 INFO:teuthology.orchestra.run.smithi019.stdout:Context: system_u:object_r:device_t:s0 2024-09-10T22:18:27.982 INFO:teuthology.orchestra.run.smithi019.stdout:Access: 2024-09-10 22:17:18.992571558 +0000 2024-09-10T22:18:27.982 INFO:teuthology.orchestra.run.smithi019.stdout:Modify: 2024-09-10 22:12:36.667235623 +0000 2024-09-10T22:18:27.982 INFO:teuthology.orchestra.run.smithi019.stdout:Change: 2024-09-10 22:12:36.667235623 +0000 2024-09-10T22:18:27.982 INFO:teuthology.orchestra.run.smithi019.stdout: Birth: 2024-09-10 22:12:36.667235623 +0000 2024-09-10T22:18:27.983 DEBUG:teuthology.orchestra.run.smithi019:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-10T22:18:28.049 INFO:teuthology.orchestra.run.smithi019.stderr:1+0 records in 2024-09-10T22:18:28.049 INFO:teuthology.orchestra.run.smithi019.stderr:1+0 records out 2024-09-10T22:18:28.049 INFO:teuthology.orchestra.run.smithi019.stderr:512 bytes copied, 0.000263212 s, 1.9 MB/s 2024-09-10T22:18:28.050 DEBUG:teuthology.orchestra.run.smithi019:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-10T22:18:28.110 DEBUG:teuthology.orchestra.run.smithi019:> stat /dev/vg_nvme/lv_3 2024-09-10T22:18:28.169 INFO:teuthology.orchestra.run.smithi019.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-10T22:18:28.169 INFO:teuthology.orchestra.run.smithi019.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-10T22:18:28.169 INFO:teuthology.orchestra.run.smithi019.stdout:Device: 5h/5d Inode: 703 Links: 1 2024-09-10T22:18:28.169 INFO:teuthology.orchestra.run.smithi019.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-10T22:18:28.169 INFO:teuthology.orchestra.run.smithi019.stdout:Context: system_u:object_r:device_t:s0 2024-09-10T22:18:28.169 INFO:teuthology.orchestra.run.smithi019.stdout:Access: 2024-09-10 22:17:19.030571232 +0000 2024-09-10T22:18:28.169 INFO:teuthology.orchestra.run.smithi019.stdout:Modify: 2024-09-10 22:12:36.992232788 +0000 2024-09-10T22:18:28.169 INFO:teuthology.orchestra.run.smithi019.stdout:Change: 2024-09-10 22:12:36.992232788 +0000 2024-09-10T22:18:28.169 INFO:teuthology.orchestra.run.smithi019.stdout: Birth: 2024-09-10 22:12:36.992232788 +0000 2024-09-10T22:18:28.170 DEBUG:teuthology.orchestra.run.smithi019:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-10T22:18:28.237 INFO:teuthology.orchestra.run.smithi019.stderr:1+0 records in 2024-09-10T22:18:28.237 INFO:teuthology.orchestra.run.smithi019.stderr:1+0 records out 2024-09-10T22:18:28.237 INFO:teuthology.orchestra.run.smithi019.stderr:512 bytes copied, 0.000197355 s, 2.6 MB/s 2024-09-10T22:18:28.238 DEBUG:teuthology.orchestra.run.smithi019:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-10T22:18:28.298 DEBUG:teuthology.orchestra.run.smithi019:> stat /dev/vg_nvme/lv_4 2024-09-10T22:18:28.357 INFO:teuthology.orchestra.run.smithi019.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-10T22:18:28.357 INFO:teuthology.orchestra.run.smithi019.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-10T22:18:28.357 INFO:teuthology.orchestra.run.smithi019.stdout:Device: 5h/5d Inode: 722 Links: 1 2024-09-10T22:18:28.357 INFO:teuthology.orchestra.run.smithi019.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-10T22:18:28.357 INFO:teuthology.orchestra.run.smithi019.stdout:Context: system_u:object_r:device_t:s0 2024-09-10T22:18:28.357 INFO:teuthology.orchestra.run.smithi019.stdout:Access: 2024-09-10 22:17:19.066570922 +0000 2024-09-10T22:18:28.357 INFO:teuthology.orchestra.run.smithi019.stdout:Modify: 2024-09-10 22:12:37.341229744 +0000 2024-09-10T22:18:28.357 INFO:teuthology.orchestra.run.smithi019.stdout:Change: 2024-09-10 22:12:37.341229744 +0000 2024-09-10T22:18:28.357 INFO:teuthology.orchestra.run.smithi019.stdout: Birth: 2024-09-10 22:12:37.341229744 +0000 2024-09-10T22:18:28.358 DEBUG:teuthology.orchestra.run.smithi019:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-10T22:18:28.425 INFO:teuthology.orchestra.run.smithi019.stderr:1+0 records in 2024-09-10T22:18:28.425 INFO:teuthology.orchestra.run.smithi019.stderr:1+0 records out 2024-09-10T22:18:28.425 INFO:teuthology.orchestra.run.smithi019.stderr:512 bytes copied, 0.00026349 s, 1.9 MB/s 2024-09-10T22:18:28.427 DEBUG:teuthology.orchestra.run.smithi019:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-10T22:18:28.486 DEBUG:teuthology.orchestra.run.smithi135:> set -ex 2024-09-10T22:18:28.486 DEBUG:teuthology.orchestra.run.smithi135:> dd if=/scratch_devs of=/dev/stdout 2024-09-10T22:18:28.503 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-10T22:18:28.503 DEBUG:teuthology.orchestra.run.smithi135:> stat /dev/vg_nvme/lv_1 2024-09-10T22:18:28.558 INFO:teuthology.orchestra.run.smithi135.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-10T22:18:28.559 INFO:teuthology.orchestra.run.smithi135.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-10T22:18:28.559 INFO:teuthology.orchestra.run.smithi135.stdout:Device: 5h/5d Inode: 663 Links: 1 2024-09-10T22:18:28.559 INFO:teuthology.orchestra.run.smithi135.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-10T22:18:28.559 INFO:teuthology.orchestra.run.smithi135.stdout:Context: system_u:object_r:device_t:s0 2024-09-10T22:18:28.559 INFO:teuthology.orchestra.run.smithi135.stdout:Access: 2024-09-10 22:18:07.166833937 +0000 2024-09-10T22:18:28.559 INFO:teuthology.orchestra.run.smithi135.stdout:Modify: 2024-09-10 22:12:46.258665924 +0000 2024-09-10T22:18:28.559 INFO:teuthology.orchestra.run.smithi135.stdout:Change: 2024-09-10 22:12:46.258665924 +0000 2024-09-10T22:18:28.559 INFO:teuthology.orchestra.run.smithi135.stdout: Birth: 2024-09-10 22:12:46.258665924 +0000 2024-09-10T22:18:28.559 DEBUG:teuthology.orchestra.run.smithi135:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-10T22:18:28.625 INFO:teuthology.orchestra.run.smithi135.stderr:1+0 records in 2024-09-10T22:18:28.625 INFO:teuthology.orchestra.run.smithi135.stderr:1+0 records out 2024-09-10T22:18:28.625 INFO:teuthology.orchestra.run.smithi135.stderr:512 bytes copied, 0.000275232 s, 1.9 MB/s 2024-09-10T22:18:28.627 DEBUG:teuthology.orchestra.run.smithi135:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-10T22:18:28.684 DEBUG:teuthology.orchestra.run.smithi135:> stat /dev/vg_nvme/lv_2 2024-09-10T22:18:28.740 INFO:teuthology.orchestra.run.smithi135.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-10T22:18:28.740 INFO:teuthology.orchestra.run.smithi135.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-10T22:18:28.740 INFO:teuthology.orchestra.run.smithi135.stdout:Device: 5h/5d Inode: 685 Links: 1 2024-09-10T22:18:28.740 INFO:teuthology.orchestra.run.smithi135.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-10T22:18:28.740 INFO:teuthology.orchestra.run.smithi135.stdout:Context: system_u:object_r:device_t:s0 2024-09-10T22:18:28.740 INFO:teuthology.orchestra.run.smithi135.stdout:Access: 2024-09-10 22:18:07.166833937 +0000 2024-09-10T22:18:28.740 INFO:teuthology.orchestra.run.smithi135.stdout:Modify: 2024-09-10 22:12:46.586659407 +0000 2024-09-10T22:18:28.740 INFO:teuthology.orchestra.run.smithi135.stdout:Change: 2024-09-10 22:12:46.586659407 +0000 2024-09-10T22:18:28.740 INFO:teuthology.orchestra.run.smithi135.stdout: Birth: 2024-09-10 22:12:46.586659407 +0000 2024-09-10T22:18:28.741 DEBUG:teuthology.orchestra.run.smithi135:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-10T22:18:28.804 INFO:teuthology.orchestra.run.smithi135.stderr:1+0 records in 2024-09-10T22:18:28.804 INFO:teuthology.orchestra.run.smithi135.stderr:1+0 records out 2024-09-10T22:18:28.804 INFO:teuthology.orchestra.run.smithi135.stderr:512 bytes copied, 0.000202921 s, 2.5 MB/s 2024-09-10T22:18:28.805 DEBUG:teuthology.orchestra.run.smithi135:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-10T22:18:28.861 DEBUG:teuthology.orchestra.run.smithi135:> stat /dev/vg_nvme/lv_3 2024-09-10T22:18:28.916 INFO:teuthology.orchestra.run.smithi135.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-10T22:18:28.917 INFO:teuthology.orchestra.run.smithi135.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-10T22:18:28.917 INFO:teuthology.orchestra.run.smithi135.stdout:Device: 5h/5d Inode: 702 Links: 1 2024-09-10T22:18:28.917 INFO:teuthology.orchestra.run.smithi135.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-10T22:18:28.917 INFO:teuthology.orchestra.run.smithi135.stdout:Context: system_u:object_r:device_t:s0 2024-09-10T22:18:28.917 INFO:teuthology.orchestra.run.smithi135.stdout:Access: 2024-09-10 22:18:07.167833917 +0000 2024-09-10T22:18:28.917 INFO:teuthology.orchestra.run.smithi135.stdout:Modify: 2024-09-10 22:12:46.917652831 +0000 2024-09-10T22:18:28.917 INFO:teuthology.orchestra.run.smithi135.stdout:Change: 2024-09-10 22:12:46.917652831 +0000 2024-09-10T22:18:28.917 INFO:teuthology.orchestra.run.smithi135.stdout: Birth: 2024-09-10 22:12:46.917652831 +0000 2024-09-10T22:18:28.917 DEBUG:teuthology.orchestra.run.smithi135:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-10T22:18:28.980 INFO:teuthology.orchestra.run.smithi135.stderr:1+0 records in 2024-09-10T22:18:28.980 INFO:teuthology.orchestra.run.smithi135.stderr:1+0 records out 2024-09-10T22:18:28.981 INFO:teuthology.orchestra.run.smithi135.stderr:512 bytes copied, 0.000206793 s, 2.5 MB/s 2024-09-10T22:18:28.982 DEBUG:teuthology.orchestra.run.smithi135:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-10T22:18:29.038 DEBUG:teuthology.orchestra.run.smithi135:> stat /dev/vg_nvme/lv_4 2024-09-10T22:18:29.093 INFO:teuthology.orchestra.run.smithi135.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-10T22:18:29.093 INFO:teuthology.orchestra.run.smithi135.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-10T22:18:29.093 INFO:teuthology.orchestra.run.smithi135.stdout:Device: 5h/5d Inode: 723 Links: 1 2024-09-10T22:18:29.094 INFO:teuthology.orchestra.run.smithi135.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-10T22:18:29.094 INFO:teuthology.orchestra.run.smithi135.stdout:Context: system_u:object_r:device_t:s0 2024-09-10T22:18:29.094 INFO:teuthology.orchestra.run.smithi135.stdout:Access: 2024-09-10 22:18:07.167833917 +0000 2024-09-10T22:18:29.094 INFO:teuthology.orchestra.run.smithi135.stdout:Modify: 2024-09-10 22:12:47.256646095 +0000 2024-09-10T22:18:29.094 INFO:teuthology.orchestra.run.smithi135.stdout:Change: 2024-09-10 22:12:47.256646095 +0000 2024-09-10T22:18:29.094 INFO:teuthology.orchestra.run.smithi135.stdout: Birth: 2024-09-10 22:12:47.256646095 +0000 2024-09-10T22:18:29.094 DEBUG:teuthology.orchestra.run.smithi135:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-10T22:18:29.156 INFO:teuthology.orchestra.run.smithi135.stderr:1+0 records in 2024-09-10T22:18:29.156 INFO:teuthology.orchestra.run.smithi135.stderr:1+0 records out 2024-09-10T22:18:29.157 INFO:teuthology.orchestra.run.smithi135.stderr:512 bytes copied, 0.000207716 s, 2.5 MB/s 2024-09-10T22:18:29.158 DEBUG:teuthology.orchestra.run.smithi135:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-10T22:18:29.215 DEBUG:teuthology.orchestra.run.smithi138:> set -ex 2024-09-10T22:18:29.215 DEBUG:teuthology.orchestra.run.smithi138:> dd if=/scratch_devs of=/dev/stdout 2024-09-10T22:18:29.235 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-10T22:18:29.235 DEBUG:teuthology.orchestra.run.smithi138:> stat /dev/vg_nvme/lv_1 2024-09-10T22:18:29.294 INFO:teuthology.orchestra.run.smithi138.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-10T22:18:29.294 INFO:teuthology.orchestra.run.smithi138.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-10T22:18:29.294 INFO:teuthology.orchestra.run.smithi138.stdout:Device: 5h/5d Inode: 667 Links: 1 2024-09-10T22:18:29.294 INFO:teuthology.orchestra.run.smithi138.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-10T22:18:29.295 INFO:teuthology.orchestra.run.smithi138.stdout:Context: system_u:object_r:device_t:s0 2024-09-10T22:18:29.295 INFO:teuthology.orchestra.run.smithi138.stdout:Access: 2024-09-10 22:18:04.753247297 +0000 2024-09-10T22:18:29.295 INFO:teuthology.orchestra.run.smithi138.stdout:Modify: 2024-09-10 22:12:52.344950880 +0000 2024-09-10T22:18:29.295 INFO:teuthology.orchestra.run.smithi138.stdout:Change: 2024-09-10 22:12:52.344950880 +0000 2024-09-10T22:18:29.295 INFO:teuthology.orchestra.run.smithi138.stdout: Birth: 2024-09-10 22:12:52.344950880 +0000 2024-09-10T22:18:29.295 DEBUG:teuthology.orchestra.run.smithi138:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-10T22:18:29.365 INFO:teuthology.orchestra.run.smithi138.stderr:1+0 records in 2024-09-10T22:18:29.365 INFO:teuthology.orchestra.run.smithi138.stderr:1+0 records out 2024-09-10T22:18:29.365 INFO:teuthology.orchestra.run.smithi138.stderr:512 bytes copied, 0.000267298 s, 1.9 MB/s 2024-09-10T22:18:29.366 DEBUG:teuthology.orchestra.run.smithi138:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-10T22:18:29.425 DEBUG:teuthology.orchestra.run.smithi138:> stat /dev/vg_nvme/lv_2 2024-09-10T22:18:29.483 INFO:teuthology.orchestra.run.smithi138.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-10T22:18:29.483 INFO:teuthology.orchestra.run.smithi138.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-10T22:18:29.483 INFO:teuthology.orchestra.run.smithi138.stdout:Device: 5h/5d Inode: 686 Links: 1 2024-09-10T22:18:29.483 INFO:teuthology.orchestra.run.smithi138.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-10T22:18:29.484 INFO:teuthology.orchestra.run.smithi138.stdout:Context: system_u:object_r:device_t:s0 2024-09-10T22:18:29.484 INFO:teuthology.orchestra.run.smithi138.stdout:Access: 2024-09-10 22:18:04.753247297 +0000 2024-09-10T22:18:29.484 INFO:teuthology.orchestra.run.smithi138.stdout:Modify: 2024-09-10 22:12:52.673943998 +0000 2024-09-10T22:18:29.484 INFO:teuthology.orchestra.run.smithi138.stdout:Change: 2024-09-10 22:12:52.673943998 +0000 2024-09-10T22:18:29.484 INFO:teuthology.orchestra.run.smithi138.stdout: Birth: 2024-09-10 22:12:52.673943998 +0000 2024-09-10T22:18:29.484 DEBUG:teuthology.orchestra.run.smithi138:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-10T22:18:29.549 INFO:teuthology.orchestra.run.smithi138.stderr:1+0 records in 2024-09-10T22:18:29.549 INFO:teuthology.orchestra.run.smithi138.stderr:1+0 records out 2024-09-10T22:18:29.549 INFO:teuthology.orchestra.run.smithi138.stderr:512 bytes copied, 0.000234824 s, 2.2 MB/s 2024-09-10T22:18:29.551 DEBUG:teuthology.orchestra.run.smithi138:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-10T22:18:29.608 DEBUG:teuthology.orchestra.run.smithi138:> stat /dev/vg_nvme/lv_3 2024-09-10T22:18:29.609 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:18:29 smithi135 ceph-mon[34789]: pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T22:18:29.625 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:18:29 smithi138 ceph-mon[35236]: pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T22:18:29.641 INFO:teuthology.orchestra.run.smithi138.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-10T22:18:29.641 INFO:teuthology.orchestra.run.smithi138.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-10T22:18:29.641 INFO:teuthology.orchestra.run.smithi138.stdout:Device: 5h/5d Inode: 704 Links: 1 2024-09-10T22:18:29.641 INFO:teuthology.orchestra.run.smithi138.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-10T22:18:29.641 INFO:teuthology.orchestra.run.smithi138.stdout:Context: system_u:object_r:device_t:s0 2024-09-10T22:18:29.641 INFO:teuthology.orchestra.run.smithi138.stdout:Access: 2024-09-10 22:18:04.753247297 +0000 2024-09-10T22:18:29.641 INFO:teuthology.orchestra.run.smithi138.stdout:Modify: 2024-09-10 22:12:52.989937390 +0000 2024-09-10T22:18:29.641 INFO:teuthology.orchestra.run.smithi138.stdout:Change: 2024-09-10 22:12:52.989937390 +0000 2024-09-10T22:18:29.641 INFO:teuthology.orchestra.run.smithi138.stdout: Birth: 2024-09-10 22:12:52.989937390 +0000 2024-09-10T22:18:29.642 DEBUG:teuthology.orchestra.run.smithi138:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-10T22:18:29.706 INFO:teuthology.orchestra.run.smithi138.stderr:1+0 records in 2024-09-10T22:18:29.706 INFO:teuthology.orchestra.run.smithi138.stderr:1+0 records out 2024-09-10T22:18:29.706 INFO:teuthology.orchestra.run.smithi138.stderr:512 bytes copied, 0.000237274 s, 2.2 MB/s 2024-09-10T22:18:29.707 DEBUG:teuthology.orchestra.run.smithi138:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-10T22:18:29.708 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:18:29 smithi019 ceph-mon[31375]: pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T22:18:29.764 DEBUG:teuthology.orchestra.run.smithi138:> stat /dev/vg_nvme/lv_4 2024-09-10T22:18:29.820 INFO:teuthology.orchestra.run.smithi138.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-10T22:18:29.820 INFO:teuthology.orchestra.run.smithi138.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-10T22:18:29.820 INFO:teuthology.orchestra.run.smithi138.stdout:Device: 5h/5d Inode: 724 Links: 1 2024-09-10T22:18:29.820 INFO:teuthology.orchestra.run.smithi138.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-10T22:18:29.820 INFO:teuthology.orchestra.run.smithi138.stdout:Context: system_u:object_r:device_t:s0 2024-09-10T22:18:29.820 INFO:teuthology.orchestra.run.smithi138.stdout:Access: 2024-09-10 22:18:04.753247297 +0000 2024-09-10T22:18:29.820 INFO:teuthology.orchestra.run.smithi138.stdout:Modify: 2024-09-10 22:12:53.320930467 +0000 2024-09-10T22:18:29.821 INFO:teuthology.orchestra.run.smithi138.stdout:Change: 2024-09-10 22:12:53.320930467 +0000 2024-09-10T22:18:29.821 INFO:teuthology.orchestra.run.smithi138.stdout: Birth: 2024-09-10 22:12:53.320930467 +0000 2024-09-10T22:18:29.821 DEBUG:teuthology.orchestra.run.smithi138:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-10T22:18:29.885 INFO:teuthology.orchestra.run.smithi138.stderr:1+0 records in 2024-09-10T22:18:29.885 INFO:teuthology.orchestra.run.smithi138.stderr:1+0 records out 2024-09-10T22:18:29.885 INFO:teuthology.orchestra.run.smithi138.stderr:512 bytes copied, 0.000218948 s, 2.3 MB/s 2024-09-10T22:18:29.886 DEBUG:teuthology.orchestra.run.smithi138:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-10T22:18:29.943 INFO:tasks.cephadm:Deploying osd.0 on smithi019 with /dev/vg_nvme/lv_4... 2024-09-10T22:18:29.943 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 22997a4c-6fc2-11ef-bcea-c7b262605968 -- lvm zap /dev/vg_nvme/lv_4 2024-09-10T22:18:30.208 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/22997a4c-6fc2-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T22:18:31.535 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:18:31 smithi019 ceph-mon[31375]: pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T22:18:31.610 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:18:31 smithi135 ceph-mon[34789]: pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T22:18:31.625 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:18:31 smithi138 ceph-mon[35236]: pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T22:18:32.706 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-10T22:18:32.732 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 22997a4c-6fc2-11ef-bcea-c7b262605968 -- ceph orch daemon add osd smithi019:vg_nvme/lv_4 2024-09-10T22:18:32.998 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/22997a4c-6fc2-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T22:18:33.390 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:18:33 smithi019 ceph-mon[31375]: pgmap v38: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T22:18:33.481 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:33.475+0000 7fcdc09e6640 1 -- 172.21.15.19:0/582625882 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fcdbc103430 msgr2=0x7fcdbc109db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:18:33.481 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:33.475+0000 7fcdc09e6640 1 --2- 172.21.15.19:0/582625882 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fcdbc103430 0x7fcdbc109db0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fcdb4009cd0 tx=0x7fcdb402a8e0 comp rx=0 tx=0).stop 2024-09-10T22:18:33.481 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:33.475+0000 7fcdc09e6640 1 -- 172.21.15.19:0/582625882 shutdown_connections 2024-09-10T22:18:33.481 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:33.475+0000 7fcdc09e6640 1 --2- 172.21.15.19:0/582625882 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fcdbc103430 0x7fcdbc109db0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:33.481 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:33.475+0000 7fcdc09e6640 1 --2- 172.21.15.19:0/582625882 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fcdbc102a70 0x7fcdbc102ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:33.481 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:33.475+0000 7fcdc09e6640 1 --2- 172.21.15.19:0/582625882 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcdbc101910 0x7fcdbc101d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:33.481 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:33.475+0000 7fcdc09e6640 1 -- 172.21.15.19:0/582625882 >> 172.21.15.19:0/582625882 conn(0x7fcdbc0fd1e0 msgr2=0x7fcdbc0ff620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:18:33.481 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:33.475+0000 7fcdc09e6640 1 -- 172.21.15.19:0/582625882 shutdown_connections 2024-09-10T22:18:33.482 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:33.475+0000 7fcdc09e6640 1 -- 172.21.15.19:0/582625882 wait complete. 2024-09-10T22:18:33.482 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:33.476+0000 7fcdc09e6640 1 Processor -- start 2024-09-10T22:18:33.482 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:33.476+0000 7fcdc09e6640 1 -- start start 2024-09-10T22:18:33.482 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:33.476+0000 7fcdc09e6640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fcdbc101910 0x7fcdbc198cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:18:33.482 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:33.476+0000 7fcdc09e6640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcdbc102a70 0x7fcdbc199340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:18:33.482 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:33.476+0000 7fcdc09e6640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fcdbc103430 0x7fcdbc199f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:18:33.482 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:33.476+0000 7fcdc09e6640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fcdbc10d570 con 0x7fcdbc103430 2024-09-10T22:18:33.482 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:33.476+0000 7fcdc09e6640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fcdbc10d3f0 con 0x7fcdbc102a70 2024-09-10T22:18:33.482 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:33.476+0000 7fcdc09e6640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7fcdbc10d6f0 con 0x7fcdbc101910 2024-09-10T22:18:33.482 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:33.476+0000 7fcdbad9d640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fcdbc103430 0x7fcdbc199f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:18:33.482 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:33.476+0000 7fcdbad9d640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fcdbc103430 0x7fcdbc199f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:47618/0 (socket says 172.21.15.19:47618) 2024-09-10T22:18:33.482 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:33.476+0000 7fcdbad9d640 1 -- 172.21.15.19:0/1523212088 learned_addr learned my addr 172.21.15.19:0/1523212088 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:18:33.483 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:33.476+0000 7fcdba59c640 1 --2- 172.21.15.19:0/1523212088 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fcdbc101910 0x7fcdbc198cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:18:33.483 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:33.476+0000 7fcdb9d9b640 1 --2- 172.21.15.19:0/1523212088 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcdbc102a70 0x7fcdbc199340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:18:33.483 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:33.476+0000 7fcdbad9d640 1 -- 172.21.15.19:0/1523212088 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fcdbc101910 msgr2=0x7fcdbc198cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:18:33.483 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:33.476+0000 7fcdbad9d640 1 --2- 172.21.15.19:0/1523212088 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fcdbc101910 0x7fcdbc198cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:33.483 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:33.476+0000 7fcdbad9d640 1 -- 172.21.15.19:0/1523212088 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcdbc102a70 msgr2=0x7fcdbc199340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:18:33.483 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:33.476+0000 7fcdbad9d640 1 --2- 172.21.15.19:0/1523212088 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcdbc102a70 0x7fcdbc199340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:33.483 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:33.476+0000 7fcdbad9d640 1 -- 172.21.15.19:0/1523212088 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcdbc19a820 con 0x7fcdbc103430 2024-09-10T22:18:33.483 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:33.476+0000 7fcdb9d9b640 1 --2- 172.21.15.19:0/1523212088 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcdbc102a70 0x7fcdbc199340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T22:18:33.483 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:33.476+0000 7fcdbad9d640 1 --2- 172.21.15.19:0/1523212088 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fcdbc103430 0x7fcdbc199f80 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fcdb40317d0 tx=0x7fcdb4003f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:18:33.483 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:33.477+0000 7fcdab7fe640 1 -- 172.21.15.19:0/1523212088 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcdb4004510 con 0x7fcdbc103430 2024-09-10T22:18:33.483 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:33.477+0000 7fcdc09e6640 1 -- 172.21.15.19:0/1523212088 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcdbc19aab0 con 0x7fcdbc103430 2024-09-10T22:18:33.483 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:33.477+0000 7fcdab7fe640 1 -- 172.21.15.19:0/1523212088 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fcdb40046b0 con 0x7fcdbc103430 2024-09-10T22:18:33.484 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:33.477+0000 7fcdab7fe640 1 -- 172.21.15.19:0/1523212088 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcdb403b770 con 0x7fcdbc103430 2024-09-10T22:18:33.484 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:33.477+0000 7fcdc09e6640 1 -- 172.21.15.19:0/1523212088 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcdbc1a11f0 con 0x7fcdbc103430 2024-09-10T22:18:33.484 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:33.478+0000 7fcdc09e6640 1 -- 172.21.15.19:0/1523212088 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcdbc101d10 con 0x7fcdbc103430 2024-09-10T22:18:33.484 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:33.479+0000 7fcdab7fe640 1 -- 172.21.15.19:0/1523212088 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 15) ==== 153194+0+0 (secure 0 0 0) 0x7fcdb404c020 con 0x7fcdbc103430 2024-09-10T22:18:33.484 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:33.480+0000 7fcdab7fe640 1 --2- 172.21.15.19:0/1523212088 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7fcda40b52d0 0x7fcda40b7790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:18:33.485 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:33.480+0000 7fcdba59c640 1 --2- 172.21.15.19:0/1523212088 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7fcda40b52d0 0x7fcda40b7790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:18:33.485 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:33.480+0000 7fcdab7fe640 1 -- 172.21.15.19:0/1523212088 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7fcdb402e030 con 0x7fcdbc103430 2024-09-10T22:18:33.485 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:33.480+0000 7fcdba59c640 1 --2- 172.21.15.19:0/1523212088 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7fcda40b52d0 0x7fcda40b7790 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fcdac005e10 tx=0x7fcdac005da0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:18:33.485 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:33.483+0000 7fcdab7fe640 1 -- 172.21.15.19:0/1523212088 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7fcdb40cde70 con 0x7fcdbc103430 2024-09-10T22:18:33.609 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:18:33 smithi135 ceph-mon[34789]: pgmap v38: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T22:18:33.625 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:18:33 smithi138 ceph-mon[35236]: pgmap v38: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T22:18:33.681 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:33.678+0000 7fcdc09e6640 1 -- 172.21.15.19:0/1523212088 --> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi019:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) -- 0x7fcdbc1a13c0 con 0x7fcda40b52d0 2024-09-10T22:18:34.409 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:18:34 smithi019 ceph-mon[31375]: from='client.14364 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi019:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T22:18:34.409 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:18:34 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-10T22:18:34.409 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:18:34 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-10T22:18:34.409 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:18:34 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T22:18:34.610 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:18:34 smithi135 ceph-mon[34789]: from='client.14364 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi019:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T22:18:34.610 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:18:34 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-10T22:18:34.610 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:18:34 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-10T22:18:34.610 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:18:34 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T22:18:34.625 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:18:34 smithi138 ceph-mon[35236]: from='client.14364 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi019:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T22:18:34.625 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:18:34 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-10T22:18:34.625 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:18:34 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-10T22:18:34.625 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:18:34 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T22:18:35.432 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:18:35 smithi019 ceph-mon[31375]: pgmap v39: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T22:18:35.609 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:18:35 smithi135 ceph-mon[34789]: pgmap v39: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T22:18:35.625 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:18:35 smithi138 ceph-mon[35236]: pgmap v39: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T22:18:36.610 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:18:36 smithi135 ceph-mon[34789]: from='client.? 172.21.15.19:0/993175565' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "783d96cb-0a8a-47f3-8eab-77cd731a64bd"} : dispatch 2024-09-10T22:18:36.610 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:18:36 smithi135 ceph-mon[34789]: from='client.? 172.21.15.19:0/993175565' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "783d96cb-0a8a-47f3-8eab-77cd731a64bd"}]': finished 2024-09-10T22:18:36.610 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:18:36 smithi135 ceph-mon[34789]: osdmap e5: 1 total, 0 up, 1 in 2024-09-10T22:18:36.610 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:18:36 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-10T22:18:36.625 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:18:36 smithi138 ceph-mon[35236]: from='client.? 172.21.15.19:0/993175565' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "783d96cb-0a8a-47f3-8eab-77cd731a64bd"} : dispatch 2024-09-10T22:18:36.625 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:18:36 smithi138 ceph-mon[35236]: from='client.? 172.21.15.19:0/993175565' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "783d96cb-0a8a-47f3-8eab-77cd731a64bd"}]': finished 2024-09-10T22:18:36.625 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:18:36 smithi138 ceph-mon[35236]: osdmap e5: 1 total, 0 up, 1 in 2024-09-10T22:18:36.625 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:18:36 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-10T22:18:36.628 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:18:36 smithi019 ceph-mon[31375]: from='client.? 172.21.15.19:0/993175565' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "783d96cb-0a8a-47f3-8eab-77cd731a64bd"} : dispatch 2024-09-10T22:18:36.628 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:18:36 smithi019 ceph-mon[31375]: from='client.? 172.21.15.19:0/993175565' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "783d96cb-0a8a-47f3-8eab-77cd731a64bd"}]': finished 2024-09-10T22:18:36.628 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:18:36 smithi019 ceph-mon[31375]: osdmap e5: 1 total, 0 up, 1 in 2024-09-10T22:18:36.628 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:18:36 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-10T22:18:37.610 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:18:37 smithi135 ceph-mon[34789]: pgmap v41: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T22:18:37.610 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:18:37 smithi135 ceph-mon[34789]: from='client.? 172.21.15.19:0/3826184137' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-10T22:18:37.625 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:18:37 smithi138 ceph-mon[35236]: pgmap v41: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T22:18:37.625 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:18:37 smithi138 ceph-mon[35236]: from='client.? 172.21.15.19:0/3826184137' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-10T22:18:37.708 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:18:37 smithi019 ceph-mon[31375]: pgmap v41: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T22:18:37.708 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:18:37 smithi019 ceph-mon[31375]: from='client.? 172.21.15.19:0/3826184137' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-10T22:18:39.610 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:18:39 smithi135 ceph-mon[34789]: pgmap v42: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T22:18:39.625 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:18:39 smithi138 ceph-mon[35236]: pgmap v42: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T22:18:39.708 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:18:39 smithi019 ceph-mon[31375]: pgmap v42: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T22:18:41.604 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:18:41 smithi019 ceph-mon[31375]: pgmap v43: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T22:18:41.609 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:18:41 smithi135 ceph-mon[34789]: pgmap v43: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T22:18:41.625 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:18:41 smithi138 ceph-mon[35236]: pgmap v43: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T22:18:43.562 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:18:43 smithi019 ceph-mon[31375]: pgmap v44: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T22:18:43.625 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:18:43 smithi138 ceph-mon[35236]: pgmap v44: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T22:18:43.859 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:18:43 smithi135 ceph-mon[34789]: pgmap v44: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T22:18:45.625 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:18:45 smithi138 ceph-mon[35236]: pgmap v45: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T22:18:45.625 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:18:45 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.0"} : dispatch 2024-09-10T22:18:45.625 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:18:45 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T22:18:45.625 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:18:45 smithi138 ceph-mon[35236]: Deploying daemon osd.0 on smithi019 2024-09-10T22:18:45.708 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:18:45 smithi019 ceph-mon[31375]: pgmap v45: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T22:18:45.708 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:18:45 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.0"} : dispatch 2024-09-10T22:18:45.708 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:18:45 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T22:18:45.709 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:18:45 smithi019 ceph-mon[31375]: Deploying daemon osd.0 on smithi019 2024-09-10T22:18:45.860 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:18:45 smithi135 ceph-mon[34789]: pgmap v45: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T22:18:45.860 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:18:45 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.0"} : dispatch 2024-09-10T22:18:45.860 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:18:45 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T22:18:45.860 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:18:45 smithi135 ceph-mon[34789]: Deploying daemon osd.0 on smithi019 2024-09-10T22:18:47.625 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:18:47 smithi138 ceph-mon[35236]: pgmap v46: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T22:18:47.662 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:18:47 smithi135 ceph-mon[34789]: pgmap v46: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T22:18:47.708 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:18:47 smithi019 ceph-mon[31375]: pgmap v46: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T22:18:49.625 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:18:49 smithi138 ceph-mon[35236]: pgmap v47: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T22:18:49.708 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:18:49 smithi019 ceph-mon[31375]: pgmap v47: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T22:18:49.860 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:18:49 smithi135 ceph-mon[34789]: pgmap v47: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T22:18:51.625 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:18:51 smithi138 ceph-mon[35236]: pgmap v48: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T22:18:51.625 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:18:51 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T22:18:51.625 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:18:51 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:18:51.625 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:18:51 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:18:51.702 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:18:51 smithi019 ceph-mon[31375]: pgmap v48: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T22:18:51.702 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:18:51 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T22:18:51.702 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:18:51 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:18:51.702 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:18:51 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:18:51.860 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:18:51 smithi135 ceph-mon[34789]: pgmap v48: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T22:18:51.860 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:18:51 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T22:18:51.860 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:18:51 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:18:51.860 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:18:51 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:18:53.625 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:18:53 smithi138 ceph-mon[35236]: pgmap v49: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T22:18:53.708 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:18:53 smithi019 ceph-mon[31375]: pgmap v49: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T22:18:53.860 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:18:53 smithi135 ceph-mon[34789]: pgmap v49: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T22:18:54.825 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:18:54 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:18:54.825 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:18:54 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:18:54.825 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:18:54 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T22:18:54.825 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:18:54 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T22:18:54.825 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:18:54 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:18:54.860 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:18:54 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:18:54.860 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:18:54 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:18:54.860 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:18:54 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T22:18:54.860 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:18:54 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T22:18:54.860 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:18:54 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:18:54.875 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:18:54 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:18:54.875 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:18:54 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:18:54.875 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:18:54 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T22:18:54.875 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:18:54 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T22:18:54.875 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:18:54 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:18:55.133 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:55.131+0000 7fcdab7fe640 1 -- 172.21.15.19:0/1523212088 <== mgr.14150 v2:172.21.15.19:6800/2119495487 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7fcdbc1a13c0 con 0x7fcda40b52d0 2024-09-10T22:18:55.133 INFO:teuthology.orchestra.run.smithi019.stdout:Created osd(s) 0 on host 'smithi019' 2024-09-10T22:18:55.137 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:55.135+0000 7fcdc09e6640 1 -- 172.21.15.19:0/1523212088 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7fcda40b52d0 msgr2=0x7fcda40b7790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:18:55.137 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:55.135+0000 7fcdc09e6640 1 --2- 172.21.15.19:0/1523212088 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7fcda40b52d0 0x7fcda40b7790 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fcdac005e10 tx=0x7fcdac005da0 comp rx=0 tx=0).stop 2024-09-10T22:18:55.137 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:55.135+0000 7fcdc09e6640 1 -- 172.21.15.19:0/1523212088 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fcdbc103430 msgr2=0x7fcdbc199f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:18:55.138 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:55.135+0000 7fcdc09e6640 1 --2- 172.21.15.19:0/1523212088 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fcdbc103430 0x7fcdbc199f80 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fcdb40317d0 tx=0x7fcdb4003f10 comp rx=0 tx=0).stop 2024-09-10T22:18:55.138 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:55.135+0000 7fcdc09e6640 1 -- 172.21.15.19:0/1523212088 shutdown_connections 2024-09-10T22:18:55.138 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:55.135+0000 7fcdc09e6640 1 --2- 172.21.15.19:0/1523212088 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7fcda40b52d0 0x7fcda40b7790 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:55.138 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:55.135+0000 7fcdc09e6640 1 --2- 172.21.15.19:0/1523212088 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fcdbc103430 0x7fcdbc199f80 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:55.138 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:55.135+0000 7fcdc09e6640 1 --2- 172.21.15.19:0/1523212088 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcdbc102a70 0x7fcdbc199340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:55.138 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:55.135+0000 7fcdc09e6640 1 --2- 172.21.15.19:0/1523212088 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fcdbc101910 0x7fcdbc198cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:55.138 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:55.135+0000 7fcdc09e6640 1 -- 172.21.15.19:0/1523212088 >> 172.21.15.19:0/1523212088 conn(0x7fcdbc0fd1e0 msgr2=0x7fcdbc0feaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:18:55.138 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:55.136+0000 7fcdc09e6640 1 -- 172.21.15.19:0/1523212088 shutdown_connections 2024-09-10T22:18:55.138 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:18:55.136+0000 7fcdc09e6640 1 -- 172.21.15.19:0/1523212088 wait complete. 2024-09-10T22:18:55.754 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:18:55 smithi019 ceph-mon[31375]: pgmap v50: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T22:18:55.755 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:18:55 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T22:18:55.755 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:18:55 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:18:55.755 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:18:55 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:18:55.756 DEBUG:teuthology.orchestra.run.smithi019:osd.0> sudo journalctl -f -n 0 -u ceph-22997a4c-6fc2-11ef-bcea-c7b262605968@osd.0.service 2024-09-10T22:18:55.759 INFO:tasks.cephadm:Deploying osd.1 on smithi135 with /dev/vg_nvme/lv_4... 2024-09-10T22:18:55.759 DEBUG:teuthology.orchestra.run.smithi135:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 22997a4c-6fc2-11ef-bcea-c7b262605968 -- lvm zap /dev/vg_nvme/lv_4 2024-09-10T22:18:55.786 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:18:55 smithi135 ceph-mon[34789]: pgmap v50: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T22:18:55.786 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:18:55 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T22:18:55.787 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:18:55 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:18:55.787 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:18:55 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:18:55.875 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:18:55 smithi138 ceph-mon[35236]: pgmap v50: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T22:18:55.875 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:18:55 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T22:18:55.875 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:18:55 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:18:55.875 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:18:55 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:18:56.009 INFO:teuthology.orchestra.run.smithi135.stderr:Inferring config /var/lib/ceph/22997a4c-6fc2-11ef-bcea-c7b262605968/mon.b/config 2024-09-10T22:18:57.105 INFO:journalctl@ceph.osd.0.smithi019.stdout:Sep 10 22:18:56 smithi019 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-0[48194]: 2024-09-10T22:18:56.990+0000 7f6c53c9c640 -1 osd.0 0 log_to_monitors true 2024-09-10T22:18:57.860 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:18:57 smithi135 ceph-mon[34789]: pgmap v51: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T22:18:57.860 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:18:57 smithi135 ceph-mon[34789]: from='osd.0 [v2:172.21.15.19:6802/234761879,v1:172.21.15.19:6803/234761879]' entity='osd.0' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]} : dispatch 2024-09-10T22:18:57.862 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:18:57 smithi019 ceph-mon[31375]: pgmap v51: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T22:18:57.862 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:18:57 smithi019 ceph-mon[31375]: from='osd.0 [v2:172.21.15.19:6802/234761879,v1:172.21.15.19:6803/234761879]' entity='osd.0' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]} : dispatch 2024-09-10T22:18:57.875 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:18:57 smithi138 ceph-mon[35236]: pgmap v51: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T22:18:57.875 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:18:57 smithi138 ceph-mon[35236]: from='osd.0 [v2:172.21.15.19:6802/234761879,v1:172.21.15.19:6803/234761879]' entity='osd.0' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]} : dispatch 2024-09-10T22:18:58.263 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-09-10T22:18:58.289 DEBUG:teuthology.orchestra.run.smithi135:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 22997a4c-6fc2-11ef-bcea-c7b262605968 -- ceph orch daemon add osd smithi135:vg_nvme/lv_4 2024-09-10T22:18:58.574 INFO:teuthology.orchestra.run.smithi135.stderr:Inferring config /var/lib/ceph/22997a4c-6fc2-11ef-bcea-c7b262605968/mon.b/config 2024-09-10T22:18:58.708 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:18:58 smithi019 ceph-mon[31375]: from='osd.0 [v2:172.21.15.19:6802/234761879,v1:172.21.15.19:6803/234761879]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-09-10T22:18:58.708 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:18:58 smithi019 ceph-mon[31375]: osdmap e6: 1 total, 0 up, 1 in 2024-09-10T22:18:58.708 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:18:58 smithi019 ceph-mon[31375]: from='osd.0 [v2:172.21.15.19:6802/234761879,v1:172.21.15.19:6803/234761879]' entity='osd.0' cmd={"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi019", "root=default"]} : dispatch 2024-09-10T22:18:58.708 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:18:58 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-10T22:18:58.825 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:18:58 smithi135 ceph-mon[34789]: from='osd.0 [v2:172.21.15.19:6802/234761879,v1:172.21.15.19:6803/234761879]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-09-10T22:18:58.825 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:18:58 smithi135 ceph-mon[34789]: osdmap e6: 1 total, 0 up, 1 in 2024-09-10T22:18:58.825 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:18:58 smithi135 ceph-mon[34789]: from='osd.0 [v2:172.21.15.19:6802/234761879,v1:172.21.15.19:6803/234761879]' entity='osd.0' cmd={"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi019", "root=default"]} : dispatch 2024-09-10T22:18:58.826 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:18:58 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-10T22:18:58.875 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:18:58 smithi138 ceph-mon[35236]: from='osd.0 [v2:172.21.15.19:6802/234761879,v1:172.21.15.19:6803/234761879]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-09-10T22:18:58.875 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:18:58 smithi138 ceph-mon[35236]: osdmap e6: 1 total, 0 up, 1 in 2024-09-10T22:18:58.875 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:18:58 smithi138 ceph-mon[35236]: from='osd.0 [v2:172.21.15.19:6802/234761879,v1:172.21.15.19:6803/234761879]' entity='osd.0' cmd={"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi019", "root=default"]} : dispatch 2024-09-10T22:18:58.875 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:18:58 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-10T22:18:59.063 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T22:18:59.044+0000 7f5bba514640 1 -- 172.21.15.135:0/804305940 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5bb4104550 msgr2=0x7f5bb410aed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:18:59.063 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T22:18:59.044+0000 7f5bba514640 1 --2- 172.21.15.135:0/804305940 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5bb4104550 0x7f5bb410aed0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f5bac009cd0 tx=0x7f5bac02a8e0 comp rx=0 tx=0).stop 2024-09-10T22:18:59.063 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T22:18:59.044+0000 7f5bba514640 1 -- 172.21.15.135:0/804305940 shutdown_connections 2024-09-10T22:18:59.064 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T22:18:59.044+0000 7f5bba514640 1 --2- 172.21.15.135:0/804305940 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5bb4104550 0x7f5bb410aed0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:59.064 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T22:18:59.044+0000 7f5bba514640 1 --2- 172.21.15.135:0/804305940 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5bb4103b90 0x7f5bb4104010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:59.064 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T22:18:59.044+0000 7f5bba514640 1 --2- 172.21.15.135:0/804305940 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5bb4102a30 0x7f5bb4102e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:59.064 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T22:18:59.044+0000 7f5bba514640 1 -- 172.21.15.135:0/804305940 >> 172.21.15.135:0/804305940 conn(0x7f5bb40fe320 msgr2=0x7f5bb4100740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:18:59.064 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T22:18:59.044+0000 7f5bba514640 1 -- 172.21.15.135:0/804305940 shutdown_connections 2024-09-10T22:18:59.064 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T22:18:59.044+0000 7f5bba514640 1 -- 172.21.15.135:0/804305940 wait complete. 2024-09-10T22:18:59.064 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T22:18:59.045+0000 7f5bba514640 1 Processor -- start 2024-09-10T22:18:59.064 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T22:18:59.045+0000 7f5bba514640 1 -- start start 2024-09-10T22:18:59.064 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T22:18:59.045+0000 7f5bba514640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5bb4102a30 0x7f5bb4198d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:18:59.064 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T22:18:59.045+0000 7f5bba514640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5bb4103b90 0x7f5bb41993c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:18:59.064 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T22:18:59.045+0000 7f5bba514640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5bb4104550 0x7f5bb419a000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:18:59.065 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T22:18:59.045+0000 7f5bba514640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f5bb410e6e0 con 0x7f5bb4104550 2024-09-10T22:18:59.065 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T22:18:59.045+0000 7f5bba514640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f5bb410e560 con 0x7f5bb4103b90 2024-09-10T22:18:59.065 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T22:18:59.045+0000 7f5bba514640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f5bb410e860 con 0x7f5bb4102a30 2024-09-10T22:18:59.065 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T22:18:59.045+0000 7f5bb37fe640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5bb4103b90 0x7f5bb41993c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:18:59.065 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T22:18:59.045+0000 7f5bb37fe640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5bb4103b90 0x7f5bb41993c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:53114/0 (socket says 172.21.15.135:53114) 2024-09-10T22:18:59.065 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T22:18:59.045+0000 7f5bb37fe640 1 -- 172.21.15.135:0/1636433761 learned_addr learned my addr 172.21.15.135:0/1636433761 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-09-10T22:18:59.065 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T22:18:59.045+0000 7f5bb8ab1640 1 --2- 172.21.15.135:0/1636433761 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5bb4104550 0x7f5bb419a000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:18:59.065 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T22:18:59.046+0000 7f5bb3fff640 1 --2- 172.21.15.135:0/1636433761 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5bb4102a30 0x7f5bb4198d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:18:59.065 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T22:18:59.046+0000 7f5bb37fe640 1 -- 172.21.15.135:0/1636433761 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5bb4102a30 msgr2=0x7f5bb4198d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:18:59.065 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T22:18:59.046+0000 7f5bb37fe640 1 --2- 172.21.15.135:0/1636433761 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5bb4102a30 0x7f5bb4198d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:59.065 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T22:18:59.046+0000 7f5bb37fe640 1 -- 172.21.15.135:0/1636433761 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5bb4104550 msgr2=0x7f5bb419a000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:18:59.065 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T22:18:59.046+0000 7f5bb37fe640 1 --2- 172.21.15.135:0/1636433761 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5bb4104550 0x7f5bb419a000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:59.065 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T22:18:59.046+0000 7f5bb37fe640 1 -- 172.21.15.135:0/1636433761 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5bb419a8a0 con 0x7f5bb4103b90 2024-09-10T22:18:59.066 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T22:18:59.046+0000 7f5bb37fe640 1 --2- 172.21.15.135:0/1636433761 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5bb4103b90 0x7f5bb41993c0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f5b9c00d950 tx=0x7f5b9c00de10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:18:59.066 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T22:18:59.046+0000 7f5bb17fa640 1 -- 172.21.15.135:0/1636433761 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b9c017030 con 0x7f5bb4103b90 2024-09-10T22:18:59.066 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T22:18:59.046+0000 7f5bb17fa640 1 -- 172.21.15.135:0/1636433761 <== mon.2 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5b9c004020 con 0x7f5bb4103b90 2024-09-10T22:18:59.066 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T22:18:59.046+0000 7f5bba514640 1 -- 172.21.15.135:0/1636433761 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5bb419ab90 con 0x7f5bb4103b90 2024-09-10T22:18:59.066 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T22:18:59.046+0000 7f5bb17fa640 1 -- 172.21.15.135:0/1636433761 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b9c0047a0 con 0x7f5bb4103b90 2024-09-10T22:18:59.066 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T22:18:59.046+0000 7f5bba514640 1 -- 172.21.15.135:0/1636433761 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5bb41a1270 con 0x7f5bb4103b90 2024-09-10T22:18:59.066 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T22:18:59.047+0000 7f5bba514640 1 -- 172.21.15.135:0/1636433761 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5bb4109ce0 con 0x7f5bb4103b90 2024-09-10T22:18:59.066 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T22:18:59.049+0000 7f5bb17fa640 1 -- 172.21.15.135:0/1636433761 <== mon.2 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 15) ==== 153194+0+0 (secure 0 0 0) 0x7f5b9c009a30 con 0x7f5bb4103b90 2024-09-10T22:18:59.066 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T22:18:59.050+0000 7f5bb17fa640 1 --2- 172.21.15.135:0/1636433761 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f5ba00b52d0 0x7f5ba00b7790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:18:59.066 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T22:18:59.050+0000 7f5bb17fa640 1 -- 172.21.15.135:0/1636433761 <== mon.2 v2:172.21.15.135:3300/0 5 ==== osd_map(7..7 src has 1..7) ==== 1487+0+0 (secure 0 0 0) 0x7f5b9c0e3fa0 con 0x7f5bb4103b90 2024-09-10T22:18:59.066 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T22:18:59.050+0000 7f5bb3fff640 1 --2- 172.21.15.135:0/1636433761 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f5ba00b52d0 0x7f5ba00b7790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:18:59.066 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T22:18:59.051+0000 7f5bb3fff640 1 --2- 172.21.15.135:0/1636433761 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f5ba00b52d0 0x7f5ba00b7790 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f5ba4005d00 tx=0x7f5ba4005c50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:18:59.067 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T22:18:59.053+0000 7f5bb17fa640 1 -- 172.21.15.135:0/1636433761 <== mon.2 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f5b9c0aca70 con 0x7f5bb4103b90 2024-09-10T22:18:59.242 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T22:18:59.241+0000 7f5bba514640 1 -- 172.21.15.135:0/1636433761 --> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi135:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) -- 0x7f5bb4063590 con 0x7f5ba00b52d0 2024-09-10T22:18:59.832 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:18:59 smithi135 ceph-mon[34789]: pgmap v53: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T22:18:59.832 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:18:59 smithi135 ceph-mon[34789]: from='osd.0 [v2:172.21.15.19:6802/234761879,v1:172.21.15.19:6803/234761879]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi019", "root=default"]}]': finished 2024-09-10T22:18:59.832 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:18:59 smithi135 ceph-mon[34789]: osdmap e7: 1 total, 0 up, 1 in 2024-09-10T22:18:59.832 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:18:59 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-10T22:18:59.832 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:18:59 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-10T22:18:59.832 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:18:59 smithi135 ceph-mon[34789]: Detected new or changed devices on smithi019 2024-09-10T22:18:59.832 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:18:59 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:18:59.832 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:18:59 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:18:59.833 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:18:59 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-10T22:18:59.833 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:18:59 smithi135 ceph-mon[34789]: Adjusting osd_memory_target on smithi019 to 17092M 2024-09-10T22:18:59.833 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:18:59 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:18:59.833 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:18:59 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T22:18:59.833 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:18:59 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T22:18:59.833 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:18:59 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:18:59.833 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:18:59 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-10T22:18:59.833 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:18:59 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-10T22:18:59.833 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:18:59 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T22:18:59.833 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:18:59 smithi135 ceph-mon[34789]: from='osd.0 [v2:172.21.15.19:6802/234761879,v1:172.21.15.19:6803/234761879]' entity='osd.0' 2024-09-10T22:18:59.875 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:18:59 smithi138 ceph-mon[35236]: pgmap v53: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T22:18:59.875 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:18:59 smithi138 ceph-mon[35236]: from='osd.0 [v2:172.21.15.19:6802/234761879,v1:172.21.15.19:6803/234761879]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi019", "root=default"]}]': finished 2024-09-10T22:18:59.875 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:18:59 smithi138 ceph-mon[35236]: osdmap e7: 1 total, 0 up, 1 in 2024-09-10T22:18:59.875 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:18:59 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-10T22:18:59.875 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:18:59 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-10T22:18:59.875 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:18:59 smithi138 ceph-mon[35236]: Detected new or changed devices on smithi019 2024-09-10T22:18:59.875 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:18:59 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:18:59.876 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:18:59 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:18:59.876 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:18:59 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-10T22:18:59.876 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:18:59 smithi138 ceph-mon[35236]: Adjusting osd_memory_target on smithi019 to 17092M 2024-09-10T22:18:59.876 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:18:59 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:18:59.876 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:18:59 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T22:18:59.876 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:18:59 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T22:18:59.876 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:18:59 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:18:59.876 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:18:59 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-10T22:18:59.876 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:18:59 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-10T22:18:59.876 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:18:59 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T22:18:59.876 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:18:59 smithi138 ceph-mon[35236]: from='osd.0 [v2:172.21.15.19:6802/234761879,v1:172.21.15.19:6803/234761879]' entity='osd.0' 2024-09-10T22:18:59.958 INFO:journalctl@ceph.osd.0.smithi019.stdout:Sep 10 22:18:59 smithi019 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-0[48194]: 2024-09-10T22:18:59.483+0000 7f6c50433640 -1 osd.0 0 waiting for initial osdmap 2024-09-10T22:18:59.958 INFO:journalctl@ceph.osd.0.smithi019.stdout:Sep 10 22:18:59 smithi019 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-0[48194]: 2024-09-10T22:18:59.599+0000 7f6c47a3e640 -1 osd.0 7 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-10T22:18:59.959 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:18:59 smithi019 ceph-mon[31375]: pgmap v53: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T22:18:59.959 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:18:59 smithi019 ceph-mon[31375]: from='osd.0 [v2:172.21.15.19:6802/234761879,v1:172.21.15.19:6803/234761879]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi019", "root=default"]}]': finished 2024-09-10T22:18:59.959 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:18:59 smithi019 ceph-mon[31375]: osdmap e7: 1 total, 0 up, 1 in 2024-09-10T22:18:59.959 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:18:59 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-10T22:18:59.959 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:18:59 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-10T22:18:59.960 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:18:59 smithi019 ceph-mon[31375]: Detected new or changed devices on smithi019 2024-09-10T22:18:59.960 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:18:59 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:18:59.960 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:18:59 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:18:59.960 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:18:59 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-10T22:18:59.960 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:18:59 smithi019 ceph-mon[31375]: Adjusting osd_memory_target on smithi019 to 17092M 2024-09-10T22:18:59.960 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:18:59 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:18:59.960 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:18:59 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T22:18:59.960 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:18:59 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T22:18:59.960 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:18:59 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:18:59.961 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:18:59 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-10T22:18:59.961 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:18:59 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-10T22:18:59.961 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:18:59 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T22:18:59.961 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:18:59 smithi019 ceph-mon[31375]: from='osd.0 [v2:172.21.15.19:6802/234761879,v1:172.21.15.19:6803/234761879]' entity='osd.0' 2024-09-10T22:19:00.808 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:19:00 smithi135 ceph-mon[34789]: purged_snaps scrub starts 2024-09-10T22:19:00.808 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:19:00 smithi135 ceph-mon[34789]: purged_snaps scrub ok 2024-09-10T22:19:00.808 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:19:00 smithi135 ceph-mon[34789]: from='client.24248 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi135:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T22:19:00.808 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:19:00 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-10T22:19:00.875 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:19:00 smithi138 ceph-mon[35236]: purged_snaps scrub starts 2024-09-10T22:19:00.875 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:19:00 smithi138 ceph-mon[35236]: purged_snaps scrub ok 2024-09-10T22:19:00.875 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:19:00 smithi138 ceph-mon[35236]: from='client.24248 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi135:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T22:19:00.875 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:19:00 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-10T22:19:00.958 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:19:00 smithi019 ceph-mon[31375]: purged_snaps scrub starts 2024-09-10T22:19:00.958 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:19:00 smithi019 ceph-mon[31375]: purged_snaps scrub ok 2024-09-10T22:19:00.958 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:19:00 smithi019 ceph-mon[31375]: from='client.24248 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi135:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T22:19:00.958 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:19:00 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-10T22:19:01.799 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:19:01 smithi135 ceph-mon[34789]: pgmap v55: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T22:19:01.799 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:19:01 smithi135 ceph-mon[34789]: osd.0 [v2:172.21.15.19:6802/234761879,v1:172.21.15.19:6803/234761879] boot 2024-09-10T22:19:01.799 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:19:01 smithi135 ceph-mon[34789]: osdmap e8: 1 total, 1 up, 1 in 2024-09-10T22:19:01.799 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:19:01 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-10T22:19:01.799 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:19:01 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-10T22:19:01.799 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:19:01 smithi135 ceph-mon[34789]: from='client.? 172.21.15.135:0/4089438721' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "41043581-e0cf-43b5-bae0-0d95e2ef8156"} : dispatch 2024-09-10T22:19:01.799 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:19:01 smithi135 ceph-mon[34789]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "41043581-e0cf-43b5-bae0-0d95e2ef8156"} : dispatch 2024-09-10T22:19:01.799 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:19:01 smithi135 ceph-mon[34789]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "41043581-e0cf-43b5-bae0-0d95e2ef8156"}]': finished 2024-09-10T22:19:01.799 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:19:01 smithi135 ceph-mon[34789]: osdmap e9: 2 total, 1 up, 2 in 2024-09-10T22:19:01.799 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:19:01 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-10T22:19:01.875 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:19:01 smithi138 ceph-mon[35236]: pgmap v55: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T22:19:01.875 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:19:01 smithi138 ceph-mon[35236]: osd.0 [v2:172.21.15.19:6802/234761879,v1:172.21.15.19:6803/234761879] boot 2024-09-10T22:19:01.875 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:19:01 smithi138 ceph-mon[35236]: osdmap e8: 1 total, 1 up, 1 in 2024-09-10T22:19:01.875 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:19:01 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-10T22:19:01.875 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:19:01 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-10T22:19:01.875 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:19:01 smithi138 ceph-mon[35236]: from='client.? 172.21.15.135:0/4089438721' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "41043581-e0cf-43b5-bae0-0d95e2ef8156"} : dispatch 2024-09-10T22:19:01.875 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:19:01 smithi138 ceph-mon[35236]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "41043581-e0cf-43b5-bae0-0d95e2ef8156"} : dispatch 2024-09-10T22:19:01.875 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:19:01 smithi138 ceph-mon[35236]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "41043581-e0cf-43b5-bae0-0d95e2ef8156"}]': finished 2024-09-10T22:19:01.875 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:19:01 smithi138 ceph-mon[35236]: osdmap e9: 2 total, 1 up, 2 in 2024-09-10T22:19:01.875 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:19:01 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-10T22:19:01.958 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:19:01 smithi019 ceph-mon[31375]: pgmap v55: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T22:19:01.958 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:19:01 smithi019 ceph-mon[31375]: osd.0 [v2:172.21.15.19:6802/234761879,v1:172.21.15.19:6803/234761879] boot 2024-09-10T22:19:01.959 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:19:01 smithi019 ceph-mon[31375]: osdmap e8: 1 total, 1 up, 1 in 2024-09-10T22:19:01.959 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:19:01 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-10T22:19:01.959 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:19:01 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-10T22:19:01.959 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:19:01 smithi019 ceph-mon[31375]: from='client.? 172.21.15.135:0/4089438721' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "41043581-e0cf-43b5-bae0-0d95e2ef8156"} : dispatch 2024-09-10T22:19:01.959 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:19:01 smithi019 ceph-mon[31375]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "41043581-e0cf-43b5-bae0-0d95e2ef8156"} : dispatch 2024-09-10T22:19:01.959 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:19:01 smithi019 ceph-mon[31375]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "41043581-e0cf-43b5-bae0-0d95e2ef8156"}]': finished 2024-09-10T22:19:01.959 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:19:01 smithi019 ceph-mon[31375]: osdmap e9: 2 total, 1 up, 2 in 2024-09-10T22:19:01.959 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:19:01 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-10T22:19:02.958 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:19:02 smithi019 ceph-mon[31375]: from='client.? 172.21.15.135:0/1555265382' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-10T22:19:03.110 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:19:02 smithi135 ceph-mon[34789]: from='client.? 172.21.15.135:0/1555265382' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-10T22:19:03.125 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:19:02 smithi138 ceph-mon[35236]: from='client.? 172.21.15.135:0/1555265382' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-10T22:19:03.958 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:19:03 smithi019 ceph-mon[31375]: pgmap v58: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-10T22:19:04.109 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:19:03 smithi135 ceph-mon[34789]: pgmap v58: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-10T22:19:04.125 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:19:03 smithi138 ceph-mon[35236]: pgmap v58: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-10T22:19:05.958 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:19:05 smithi019 ceph-mon[31375]: pgmap v59: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-10T22:19:06.040 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:19:05 smithi135 ceph-mon[34789]: pgmap v59: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-10T22:19:06.125 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:19:05 smithi138 ceph-mon[35236]: pgmap v59: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-10T22:19:07.958 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:19:07 smithi019 ceph-mon[31375]: pgmap v60: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-10T22:19:07.990 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:19:07 smithi135 ceph-mon[34789]: pgmap v60: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-10T22:19:08.125 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:19:07 smithi138 ceph-mon[35236]: pgmap v60: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-10T22:19:09.860 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:19:09 smithi135 ceph-mon[34789]: pgmap v61: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-10T22:19:09.860 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:19:09 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.1"} : dispatch 2024-09-10T22:19:09.860 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:19:09 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T22:19:09.958 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:19:09 smithi019 ceph-mon[31375]: pgmap v61: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-10T22:19:09.958 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:19:09 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.1"} : dispatch 2024-09-10T22:19:09.958 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:19:09 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T22:19:10.125 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:19:09 smithi138 ceph-mon[35236]: pgmap v61: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-10T22:19:10.125 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:19:09 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.1"} : dispatch 2024-09-10T22:19:10.125 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:19:09 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T22:19:10.953 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:19:10 smithi135 ceph-mon[34789]: Deploying daemon osd.1 on smithi135 2024-09-10T22:19:10.958 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:19:10 smithi019 ceph-mon[31375]: Deploying daemon osd.1 on smithi135 2024-09-10T22:19:11.125 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:19:10 smithi138 ceph-mon[35236]: Deploying daemon osd.1 on smithi135 2024-09-10T22:19:11.932 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:19:11 smithi135 ceph-mon[34789]: pgmap v62: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-10T22:19:11.958 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:19:11 smithi019 ceph-mon[31375]: pgmap v62: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-10T22:19:12.125 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:19:11 smithi138 ceph-mon[35236]: pgmap v62: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-10T22:19:13.958 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:19:13 smithi019 ceph-mon[31375]: pgmap v63: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-10T22:19:14.110 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:19:13 smithi135 ceph-mon[34789]: pgmap v63: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-10T22:19:14.125 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:19:13 smithi138 ceph-mon[35236]: pgmap v63: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-10T22:19:15.859 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:19:15 smithi135 ceph-mon[34789]: pgmap v64: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-10T22:19:15.958 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:19:15 smithi019 ceph-mon[31375]: pgmap v64: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-10T22:19:16.125 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:19:15 smithi138 ceph-mon[35236]: pgmap v64: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-10T22:19:16.816 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:19:16 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T22:19:16.816 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:19:16 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:19:16.816 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:19:16 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:19:16.958 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:19:16 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T22:19:16.958 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:19:16 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:19:16.959 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:19:16 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:19:17.026 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:19:16 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T22:19:17.026 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:19:16 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:19:17.026 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:19:16 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:19:17.958 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:19:17 smithi019 ceph-mon[31375]: pgmap v65: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-10T22:19:17.960 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:19:17 smithi135 ceph-mon[34789]: pgmap v65: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-10T22:19:18.125 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:19:17 smithi138 ceph-mon[35236]: pgmap v65: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-10T22:19:19.272 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:19:19 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:19:19.272 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:19:19 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:19:19.272 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:19:19 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T22:19:19.272 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:19:19 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T22:19:19.272 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:19:19 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:19:19.375 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:19:19 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:19:19.375 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:19:19 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:19:19.375 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:19:19 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T22:19:19.375 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:19:19 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T22:19:19.375 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:19:19 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:19:19.458 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:19:19 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:19:19.458 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:19:19 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:19:19.459 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:19:19 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T22:19:19.459 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:19:19 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T22:19:19.459 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:19:19 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:19:19.815 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T22:19:19.813+0000 7f5bb17fa640 1 -- 172.21.15.135:0/1636433761 <== mgr.14150 v2:172.21.15.19:6800/2119495487 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f5bb4063590 con 0x7f5ba00b52d0 2024-09-10T22:19:19.816 INFO:teuthology.orchestra.run.smithi135.stdout:Created osd(s) 1 on host 'smithi135' 2024-09-10T22:19:19.818 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T22:19:19.816+0000 7f5bba514640 1 -- 172.21.15.135:0/1636433761 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f5ba00b52d0 msgr2=0x7f5ba00b7790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:19:19.818 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T22:19:19.816+0000 7f5bba514640 1 --2- 172.21.15.135:0/1636433761 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f5ba00b52d0 0x7f5ba00b7790 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f5ba4005d00 tx=0x7f5ba4005c50 comp rx=0 tx=0).stop 2024-09-10T22:19:19.818 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T22:19:19.816+0000 7f5bba514640 1 -- 172.21.15.135:0/1636433761 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5bb4103b90 msgr2=0x7f5bb41993c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:19:19.818 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T22:19:19.816+0000 7f5bba514640 1 --2- 172.21.15.135:0/1636433761 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5bb4103b90 0x7f5bb41993c0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f5b9c00d950 tx=0x7f5b9c00de10 comp rx=0 tx=0).stop 2024-09-10T22:19:19.818 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T22:19:19.816+0000 7f5bba514640 1 -- 172.21.15.135:0/1636433761 shutdown_connections 2024-09-10T22:19:19.818 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T22:19:19.816+0000 7f5bba514640 1 --2- 172.21.15.135:0/1636433761 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f5ba00b52d0 0x7f5ba00b7790 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:19:19.818 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T22:19:19.816+0000 7f5bba514640 1 --2- 172.21.15.135:0/1636433761 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5bb4104550 0x7f5bb419a000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:19:19.818 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T22:19:19.816+0000 7f5bba514640 1 --2- 172.21.15.135:0/1636433761 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5bb4103b90 0x7f5bb41993c0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:19:19.819 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T22:19:19.816+0000 7f5bba514640 1 --2- 172.21.15.135:0/1636433761 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5bb4102a30 0x7f5bb4198d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:19:19.819 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T22:19:19.816+0000 7f5bba514640 1 -- 172.21.15.135:0/1636433761 >> 172.21.15.135:0/1636433761 conn(0x7f5bb40fe320 msgr2=0x7f5bb4106eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:19:19.819 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T22:19:19.816+0000 7f5bba514640 1 -- 172.21.15.135:0/1636433761 shutdown_connections 2024-09-10T22:19:19.819 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T22:19:19.817+0000 7f5bba514640 1 -- 172.21.15.135:0/1636433761 wait complete. 2024-09-10T22:19:20.110 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:19:20 smithi135 ceph-mon[34789]: pgmap v66: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-10T22:19:20.110 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:19:20 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T22:19:20.110 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:19:20 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:19:20.110 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:19:20 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:19:20.375 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:19:20 smithi138 ceph-mon[35236]: pgmap v66: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-10T22:19:20.375 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:19:20 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T22:19:20.375 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:19:20 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:19:20.375 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:19:20 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:19:20.396 DEBUG:teuthology.orchestra.run.smithi135:osd.1> sudo journalctl -f -n 0 -u ceph-22997a4c-6fc2-11ef-bcea-c7b262605968@osd.1.service 2024-09-10T22:19:20.399 INFO:tasks.cephadm:Deploying osd.2 on smithi138 with /dev/vg_nvme/lv_4... 2024-09-10T22:19:20.399 DEBUG:teuthology.orchestra.run.smithi138:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 22997a4c-6fc2-11ef-bcea-c7b262605968 -- lvm zap /dev/vg_nvme/lv_4 2024-09-10T22:19:20.458 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:19:20 smithi019 ceph-mon[31375]: pgmap v66: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-10T22:19:20.458 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:19:20 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T22:19:20.458 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:19:20 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:19:20.458 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:19:20 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:19:20.650 INFO:teuthology.orchestra.run.smithi138.stderr:Inferring config /var/lib/ceph/22997a4c-6fc2-11ef-bcea-c7b262605968/mon.c/config 2024-09-10T22:19:21.715 INFO:journalctl@ceph.osd.1.smithi135.stdout:Sep 10 22:19:21 smithi135 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-1[39276]: 2024-09-10T22:19:21.465+0000 7f84f9c26640 -1 osd.1 0 log_to_monitors true 2024-09-10T22:19:22.294 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:19:22 smithi138 ceph-mon[35236]: pgmap v67: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-10T22:19:22.295 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:19:22 smithi138 ceph-mon[35236]: from='osd.1 [v2:172.21.15.135:6800/1803526886,v1:172.21.15.135:6801/1803526886]' entity='osd.1' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]} : dispatch 2024-09-10T22:19:22.295 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:19:22 smithi138 ceph-mon[35236]: from='osd.1 ' entity='osd.1' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]} : dispatch 2024-09-10T22:19:22.360 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:19:22 smithi135 ceph-mon[34789]: pgmap v67: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-10T22:19:22.360 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:19:22 smithi135 ceph-mon[34789]: from='osd.1 [v2:172.21.15.135:6800/1803526886,v1:172.21.15.135:6801/1803526886]' entity='osd.1' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]} : dispatch 2024-09-10T22:19:22.360 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:19:22 smithi135 ceph-mon[34789]: from='osd.1 ' entity='osd.1' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]} : dispatch 2024-09-10T22:19:22.458 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:19:22 smithi019 ceph-mon[31375]: pgmap v67: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-10T22:19:22.458 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:19:22 smithi019 ceph-mon[31375]: from='osd.1 [v2:172.21.15.135:6800/1803526886,v1:172.21.15.135:6801/1803526886]' entity='osd.1' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]} : dispatch 2024-09-10T22:19:22.459 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:19:22 smithi019 ceph-mon[31375]: from='osd.1 ' entity='osd.1' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]} : dispatch 2024-09-10T22:19:22.944 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-10T22:19:22.973 DEBUG:teuthology.orchestra.run.smithi138:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 22997a4c-6fc2-11ef-bcea-c7b262605968 -- ceph orch daemon add osd smithi138:vg_nvme/lv_4 2024-09-10T22:19:23.232 INFO:teuthology.orchestra.run.smithi138.stderr:Inferring config /var/lib/ceph/22997a4c-6fc2-11ef-bcea-c7b262605968/mon.c/config 2024-09-10T22:19:23.324 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:19:23 smithi138 ceph-mon[35236]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-09-10T22:19:23.324 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:19:23 smithi138 ceph-mon[35236]: osdmap e10: 2 total, 1 up, 2 in 2024-09-10T22:19:23.324 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:19:23 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-10T22:19:23.324 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:19:23 smithi138 ceph-mon[35236]: from='osd.1 [v2:172.21.15.135:6800/1803526886,v1:172.21.15.135:6801/1803526886]' entity='osd.1' cmd={"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi135", "root=default"]} : dispatch 2024-09-10T22:19:23.324 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:19:23 smithi138 ceph-mon[35236]: from='osd.1 ' entity='osd.1' cmd={"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi135", "root=default"]} : dispatch 2024-09-10T22:19:23.359 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:19:23 smithi135 ceph-mon[34789]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-09-10T22:19:23.359 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:19:23 smithi135 ceph-mon[34789]: osdmap e10: 2 total, 1 up, 2 in 2024-09-10T22:19:23.360 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:19:23 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-10T22:19:23.360 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:19:23 smithi135 ceph-mon[34789]: from='osd.1 [v2:172.21.15.135:6800/1803526886,v1:172.21.15.135:6801/1803526886]' entity='osd.1' cmd={"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi135", "root=default"]} : dispatch 2024-09-10T22:19:23.360 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:19:23 smithi135 ceph-mon[34789]: from='osd.1 ' entity='osd.1' cmd={"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi135", "root=default"]} : dispatch 2024-09-10T22:19:23.458 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:19:23 smithi019 ceph-mon[31375]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-09-10T22:19:23.458 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:19:23 smithi019 ceph-mon[31375]: osdmap e10: 2 total, 1 up, 2 in 2024-09-10T22:19:23.458 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:19:23 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-10T22:19:23.459 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:19:23 smithi019 ceph-mon[31375]: from='osd.1 [v2:172.21.15.135:6800/1803526886,v1:172.21.15.135:6801/1803526886]' entity='osd.1' cmd={"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi135", "root=default"]} : dispatch 2024-09-10T22:19:23.459 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:19:23 smithi019 ceph-mon[31375]: from='osd.1 ' entity='osd.1' cmd={"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi135", "root=default"]} : dispatch 2024-09-10T22:19:23.668 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-10T22:19:23.660+0000 7f434e97e640 1 -- 172.21.15.138:0/3550849074 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f4348103430 msgr2=0x7f4348109db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:19:23.668 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-10T22:19:23.660+0000 7f434e97e640 1 --2- 172.21.15.138:0/3550849074 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f4348103430 0x7f4348109db0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f4340009d00 tx=0x7f434002a910 comp rx=0 tx=0).stop 2024-09-10T22:19:23.668 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-10T22:19:23.660+0000 7f434e97e640 1 -- 172.21.15.138:0/3550849074 shutdown_connections 2024-09-10T22:19:23.669 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-10T22:19:23.660+0000 7f434e97e640 1 --2- 172.21.15.138:0/3550849074 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f4348103430 0x7f4348109db0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:19:23.669 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-10T22:19:23.660+0000 7f434e97e640 1 --2- 172.21.15.138:0/3550849074 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4348102a70 0x7f4348102ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:19:23.669 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-10T22:19:23.660+0000 7f434e97e640 1 --2- 172.21.15.138:0/3550849074 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4348101910 0x7f4348101d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:19:23.669 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-10T22:19:23.660+0000 7f434e97e640 1 -- 172.21.15.138:0/3550849074 >> 172.21.15.138:0/3550849074 conn(0x7f43480fd1e0 msgr2=0x7f43480ff620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:19:23.669 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-10T22:19:23.660+0000 7f434e97e640 1 -- 172.21.15.138:0/3550849074 shutdown_connections 2024-09-10T22:19:23.669 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-10T22:19:23.660+0000 7f434e97e640 1 -- 172.21.15.138:0/3550849074 wait complete. 2024-09-10T22:19:23.669 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-10T22:19:23.661+0000 7f434e97e640 1 Processor -- start 2024-09-10T22:19:23.669 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-10T22:19:23.661+0000 7f434e97e640 1 -- start start 2024-09-10T22:19:23.669 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-10T22:19:23.661+0000 7f434e97e640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4348101910 0x7f434806b350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:19:23.669 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-10T22:19:23.661+0000 7f434e97e640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4348102a70 0x7f434819ff40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:19:23.669 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-10T22:19:23.661+0000 7f434e97e640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f4348103430 0x7f43481a2490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:19:23.669 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-10T22:19:23.661+0000 7f434e97e640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f434810d660 con 0x7f4348102a70 2024-09-10T22:19:23.670 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-10T22:19:23.661+0000 7f434e97e640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f434810d4e0 con 0x7f4348101910 2024-09-10T22:19:23.670 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-10T22:19:23.661+0000 7f434e97e640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f434810d7e0 con 0x7f4348103430 2024-09-10T22:19:23.670 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-10T22:19:23.661+0000 7f434cf1b640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f4348103430 0x7f43481a2490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:19:23.670 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-10T22:19:23.661+0000 7f4347fff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4348101910 0x7f434806b350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:19:23.670 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-10T22:19:23.661+0000 7f434cf1b640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f4348103430 0x7f43481a2490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:52762/0 (socket says 172.21.15.138:52762) 2024-09-10T22:19:23.670 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-10T22:19:23.661+0000 7f434cf1b640 1 -- 172.21.15.138:0/3298578329 learned_addr learned my addr 172.21.15.138:0/3298578329 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-09-10T22:19:23.670 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-10T22:19:23.661+0000 7f43477fe640 1 --2- 172.21.15.138:0/3298578329 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4348102a70 0x7f434819ff40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:19:23.670 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-10T22:19:23.661+0000 7f434cf1b640 1 -- 172.21.15.138:0/3298578329 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4348101910 msgr2=0x7f434806b350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:19:23.670 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-10T22:19:23.661+0000 7f434cf1b640 1 --2- 172.21.15.138:0/3298578329 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4348101910 0x7f434806b350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:19:23.670 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-10T22:19:23.661+0000 7f434cf1b640 1 -- 172.21.15.138:0/3298578329 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4348102a70 msgr2=0x7f434819ff40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:19:23.670 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-10T22:19:23.661+0000 7f434cf1b640 1 --2- 172.21.15.138:0/3298578329 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4348102a70 0x7f434819ff40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:19:23.670 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-10T22:19:23.661+0000 7f434cf1b640 1 -- 172.21.15.138:0/3298578329 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f43481a2c10 con 0x7f4348103430 2024-09-10T22:19:23.670 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-10T22:19:23.661+0000 7f4347fff640 1 --2- 172.21.15.138:0/3298578329 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4348101910 0x7f434806b350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T22:19:23.671 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-10T22:19:23.662+0000 7f434cf1b640 1 --2- 172.21.15.138:0/3298578329 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f4348103430 0x7f43481a2490 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f4340006010 tx=0x7f4340003ba0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:19:23.671 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-10T22:19:23.662+0000 7f43457fa640 1 -- 172.21.15.138:0/3298578329 <== mon.1 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43400317b0 con 0x7f4348103430 2024-09-10T22:19:23.671 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-10T22:19:23.662+0000 7f434e97e640 1 -- 172.21.15.138:0/3298578329 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f43481a2ea0 con 0x7f4348103430 2024-09-10T22:19:23.671 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-10T22:19:23.662+0000 7f43457fa640 1 -- 172.21.15.138:0/3298578329 <== mon.1 v2:172.21.15.138:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f434002fad0 con 0x7f4348103430 2024-09-10T22:19:23.671 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-10T22:19:23.662+0000 7f43457fa640 1 -- 172.21.15.138:0/3298578329 <== mon.1 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4340030bb0 con 0x7f4348103430 2024-09-10T22:19:23.671 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-10T22:19:23.662+0000 7f434e97e640 1 -- 172.21.15.138:0/3298578329 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f43481a33d0 con 0x7f4348103430 2024-09-10T22:19:23.671 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-10T22:19:23.663+0000 7f434e97e640 1 -- 172.21.15.138:0/3298578329 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4348108bc0 con 0x7f4348103430 2024-09-10T22:19:23.671 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-10T22:19:23.664+0000 7f43457fa640 1 -- 172.21.15.138:0/3298578329 <== mon.1 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 15) ==== 153194+0+0 (secure 0 0 0) 0x7f4340030d50 con 0x7f4348103430 2024-09-10T22:19:23.671 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-10T22:19:23.665+0000 7f43457fa640 1 --2- 172.21.15.138:0/3298578329 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f43300b5250 0x7f43300b7710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:19:23.671 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-10T22:19:23.665+0000 7f43457fa640 1 -- 172.21.15.138:0/3298578329 <== mon.1 v2:172.21.15.138:3300/0 5 ==== osd_map(11..11 src has 1..11) ==== 2029+0+0 (secure 0 0 0) 0x7f4340105650 con 0x7f4348103430 2024-09-10T22:19:23.671 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-10T22:19:23.665+0000 7f4347fff640 1 --2- 172.21.15.138:0/3298578329 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f43300b5250 0x7f43300b7710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:19:23.671 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-10T22:19:23.666+0000 7f4347fff640 1 --2- 172.21.15.138:0/3298578329 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f43300b5250 0x7f43300b7710 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f4338009d60 tx=0x7f4338009110 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:19:23.673 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-10T22:19:23.672+0000 7f43457fa640 1 -- 172.21.15.138:0/3298578329 <== mon.1 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f43400cde80 con 0x7f4348103430 2024-09-10T22:19:23.863 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-10T22:19:23.862+0000 7f434e97e640 1 -- 172.21.15.138:0/3298578329 --> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi138:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) -- 0x7f4348063590 con 0x7f43300b5250 2024-09-10T22:19:24.125 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:19:24 smithi138 ceph-mon[35236]: pgmap v69: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-10T22:19:24.125 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:19:24 smithi138 ceph-mon[35236]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi135", "root=default"]}]': finished 2024-09-10T22:19:24.125 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:19:24 smithi138 ceph-mon[35236]: osdmap e11: 2 total, 1 up, 2 in 2024-09-10T22:19:24.125 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:19:24 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-10T22:19:24.126 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:19:24 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-10T22:19:24.126 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:19:24 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:19:24.126 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:19:24 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:19:24.126 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:19:24 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-10T22:19:24.126 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:19:24 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:19:24.126 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:19:24 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T22:19:24.126 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:19:24 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T22:19:24.126 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:19:24 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:19:24.126 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:19:24 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-10T22:19:24.126 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:19:24 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-10T22:19:24.126 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:19:24 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T22:19:24.126 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:19:24 smithi138 ceph-mon[35236]: from='osd.1 ' entity='osd.1' 2024-09-10T22:19:24.359 INFO:journalctl@ceph.osd.1.smithi135.stdout:Sep 10 22:19:23 smithi135 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-1[39276]: 2024-09-10T22:19:23.969+0000 7f84f5ba9640 -1 osd.1 0 waiting for initial osdmap 2024-09-10T22:19:24.360 INFO:journalctl@ceph.osd.1.smithi135.stdout:Sep 10 22:19:24 smithi135 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-1[39276]: 2024-09-10T22:19:24.119+0000 7f84ed9c8640 -1 osd.1 11 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-10T22:19:24.360 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:19:24 smithi135 ceph-mon[34789]: pgmap v69: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-10T22:19:24.360 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:19:24 smithi135 ceph-mon[34789]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi135", "root=default"]}]': finished 2024-09-10T22:19:24.360 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:19:24 smithi135 ceph-mon[34789]: osdmap e11: 2 total, 1 up, 2 in 2024-09-10T22:19:24.360 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:19:24 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-10T22:19:24.360 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:19:24 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-10T22:19:24.360 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:19:24 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:19:24.360 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:19:24 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:19:24.360 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:19:24 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-10T22:19:24.361 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:19:24 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:19:24.361 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:19:24 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T22:19:24.361 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:19:24 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T22:19:24.361 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:19:24 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:19:24.361 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:19:24 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-10T22:19:24.361 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:19:24 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-10T22:19:24.361 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:19:24 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T22:19:24.361 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:19:24 smithi135 ceph-mon[34789]: from='osd.1 ' entity='osd.1' 2024-09-10T22:19:24.458 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:19:24 smithi019 ceph-mon[31375]: pgmap v69: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-10T22:19:24.459 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:19:24 smithi019 ceph-mon[31375]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi135", "root=default"]}]': finished 2024-09-10T22:19:24.459 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:19:24 smithi019 ceph-mon[31375]: osdmap e11: 2 total, 1 up, 2 in 2024-09-10T22:19:24.459 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:19:24 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-10T22:19:24.459 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:19:24 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-10T22:19:24.459 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:19:24 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:19:24.459 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:19:24 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:19:24.459 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:19:24 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-10T22:19:24.459 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:19:24 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:19:24.459 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:19:24 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T22:19:24.459 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:19:24 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T22:19:24.459 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:19:24 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:19:24.459 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:19:24 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-10T22:19:24.460 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:19:24 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-10T22:19:24.460 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:19:24 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T22:19:24.460 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:19:24 smithi019 ceph-mon[31375]: from='osd.1 ' entity='osd.1' 2024-09-10T22:19:25.360 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:19:25 smithi135 ceph-mon[34789]: purged_snaps scrub starts 2024-09-10T22:19:25.360 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:19:25 smithi135 ceph-mon[34789]: purged_snaps scrub ok 2024-09-10T22:19:25.360 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:19:25 smithi135 ceph-mon[34789]: Detected new or changed devices on smithi135 2024-09-10T22:19:25.360 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:19:25 smithi135 ceph-mon[34789]: Adjusting osd_memory_target on smithi135 to 5815M 2024-09-10T22:19:25.360 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:19:25 smithi135 ceph-mon[34789]: from='client.24262 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi138:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T22:19:25.360 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:19:25 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-10T22:19:25.375 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:19:25 smithi138 ceph-mon[35236]: purged_snaps scrub starts 2024-09-10T22:19:25.375 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:19:25 smithi138 ceph-mon[35236]: purged_snaps scrub ok 2024-09-10T22:19:25.375 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:19:25 smithi138 ceph-mon[35236]: Detected new or changed devices on smithi135 2024-09-10T22:19:25.375 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:19:25 smithi138 ceph-mon[35236]: Adjusting osd_memory_target on smithi135 to 5815M 2024-09-10T22:19:25.375 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:19:25 smithi138 ceph-mon[35236]: from='client.24262 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi138:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T22:19:25.375 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:19:25 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-10T22:19:25.458 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:19:25 smithi019 ceph-mon[31375]: purged_snaps scrub starts 2024-09-10T22:19:25.458 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:19:25 smithi019 ceph-mon[31375]: purged_snaps scrub ok 2024-09-10T22:19:25.459 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:19:25 smithi019 ceph-mon[31375]: Detected new or changed devices on smithi135 2024-09-10T22:19:25.459 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:19:25 smithi019 ceph-mon[31375]: Adjusting osd_memory_target on smithi135 to 5815M 2024-09-10T22:19:25.459 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:19:25 smithi019 ceph-mon[31375]: from='client.24262 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi138:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T22:19:25.459 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:19:25 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-10T22:19:26.359 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:19:26 smithi135 ceph-mon[34789]: pgmap v71: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-10T22:19:26.360 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:19:26 smithi135 ceph-mon[34789]: osd.1 [v2:172.21.15.135:6800/1803526886,v1:172.21.15.135:6801/1803526886] boot 2024-09-10T22:19:26.360 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:19:26 smithi135 ceph-mon[34789]: osdmap e12: 2 total, 2 up, 2 in 2024-09-10T22:19:26.360 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:19:26 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-10T22:19:26.375 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:19:26 smithi138 ceph-mon[35236]: pgmap v71: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-10T22:19:26.375 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:19:26 smithi138 ceph-mon[35236]: osd.1 [v2:172.21.15.135:6800/1803526886,v1:172.21.15.135:6801/1803526886] boot 2024-09-10T22:19:26.375 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:19:26 smithi138 ceph-mon[35236]: osdmap e12: 2 total, 2 up, 2 in 2024-09-10T22:19:26.376 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:19:26 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-10T22:19:26.458 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:19:26 smithi019 ceph-mon[31375]: pgmap v71: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-10T22:19:26.458 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:19:26 smithi019 ceph-mon[31375]: osd.1 [v2:172.21.15.135:6800/1803526886,v1:172.21.15.135:6801/1803526886] boot 2024-09-10T22:19:26.458 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:19:26 smithi019 ceph-mon[31375]: osdmap e12: 2 total, 2 up, 2 in 2024-09-10T22:19:26.459 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:19:26 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-10T22:19:27.360 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:19:27 smithi135 ceph-mon[34789]: osdmap e13: 2 total, 2 up, 2 in 2024-09-10T22:19:27.360 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:19:27 smithi135 ceph-mon[34789]: from='client.? 172.21.15.138:0/2251734711' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "a9b14a06-bbdc-4501-96e2-fb5f7127ca16"} : dispatch 2024-09-10T22:19:27.360 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:19:27 smithi135 ceph-mon[34789]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "a9b14a06-bbdc-4501-96e2-fb5f7127ca16"} : dispatch 2024-09-10T22:19:27.360 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:19:27 smithi135 ceph-mon[34789]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "a9b14a06-bbdc-4501-96e2-fb5f7127ca16"}]': finished 2024-09-10T22:19:27.360 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:19:27 smithi135 ceph-mon[34789]: osdmap e14: 3 total, 2 up, 3 in 2024-09-10T22:19:27.360 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:19:27 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-10T22:19:27.360 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:19:27 smithi135 ceph-mon[34789]: pgmap v75: 0 pgs: ; 0 B data, 69 MiB used, 179 GiB / 179 GiB avail 2024-09-10T22:19:27.360 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:19:27 smithi135 ceph-mon[34789]: from='client.? 172.21.15.138:0/4283996296' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-10T22:19:27.375 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:19:27 smithi138 ceph-mon[35236]: osdmap e13: 2 total, 2 up, 2 in 2024-09-10T22:19:27.375 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:19:27 smithi138 ceph-mon[35236]: from='client.? 172.21.15.138:0/2251734711' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "a9b14a06-bbdc-4501-96e2-fb5f7127ca16"} : dispatch 2024-09-10T22:19:27.375 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:19:27 smithi138 ceph-mon[35236]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "a9b14a06-bbdc-4501-96e2-fb5f7127ca16"} : dispatch 2024-09-10T22:19:27.375 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:19:27 smithi138 ceph-mon[35236]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "a9b14a06-bbdc-4501-96e2-fb5f7127ca16"}]': finished 2024-09-10T22:19:27.375 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:19:27 smithi138 ceph-mon[35236]: osdmap e14: 3 total, 2 up, 3 in 2024-09-10T22:19:27.375 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:19:27 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-10T22:19:27.376 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:19:27 smithi138 ceph-mon[35236]: pgmap v75: 0 pgs: ; 0 B data, 69 MiB used, 179 GiB / 179 GiB avail 2024-09-10T22:19:27.376 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:19:27 smithi138 ceph-mon[35236]: from='client.? 172.21.15.138:0/4283996296' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-10T22:19:27.458 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:19:27 smithi019 ceph-mon[31375]: osdmap e13: 2 total, 2 up, 2 in 2024-09-10T22:19:27.459 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:19:27 smithi019 ceph-mon[31375]: from='client.? 172.21.15.138:0/2251734711' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "a9b14a06-bbdc-4501-96e2-fb5f7127ca16"} : dispatch 2024-09-10T22:19:27.459 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:19:27 smithi019 ceph-mon[31375]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "a9b14a06-bbdc-4501-96e2-fb5f7127ca16"} : dispatch 2024-09-10T22:19:27.459 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:19:27 smithi019 ceph-mon[31375]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "a9b14a06-bbdc-4501-96e2-fb5f7127ca16"}]': finished 2024-09-10T22:19:27.459 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:19:27 smithi019 ceph-mon[31375]: osdmap e14: 3 total, 2 up, 3 in 2024-09-10T22:19:27.459 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:19:27 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-10T22:19:27.459 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:19:27 smithi019 ceph-mon[31375]: pgmap v75: 0 pgs: ; 0 B data, 69 MiB used, 179 GiB / 179 GiB avail 2024-09-10T22:19:27.459 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:19:27 smithi019 ceph-mon[31375]: from='client.? 172.21.15.138:0/4283996296' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-10T22:19:29.610 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:19:29 smithi135 ceph-mon[34789]: pgmap v76: 0 pgs: ; 0 B data, 69 MiB used, 179 GiB / 179 GiB avail 2024-09-10T22:19:29.625 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:19:29 smithi138 ceph-mon[35236]: pgmap v76: 0 pgs: ; 0 B data, 69 MiB used, 179 GiB / 179 GiB avail 2024-09-10T22:19:29.708 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:19:29 smithi019 ceph-mon[31375]: pgmap v76: 0 pgs: ; 0 B data, 69 MiB used, 179 GiB / 179 GiB avail 2024-09-10T22:19:31.567 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:19:31 smithi138 ceph-mon[35236]: pgmap v77: 0 pgs: ; 0 B data, 69 MiB used, 179 GiB / 179 GiB avail 2024-09-10T22:19:31.708 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:19:31 smithi019 ceph-mon[31375]: pgmap v77: 0 pgs: ; 0 B data, 69 MiB used, 179 GiB / 179 GiB avail 2024-09-10T22:19:31.860 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:19:31 smithi135 ceph-mon[34789]: pgmap v77: 0 pgs: ; 0 B data, 69 MiB used, 179 GiB / 179 GiB avail 2024-09-10T22:19:33.559 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:19:33 smithi138 ceph-mon[35236]: pgmap v78: 0 pgs: ; 0 B data, 69 MiB used, 179 GiB / 179 GiB avail 2024-09-10T22:19:33.708 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:19:33 smithi019 ceph-mon[31375]: pgmap v78: 0 pgs: ; 0 B data, 69 MiB used, 179 GiB / 179 GiB avail 2024-09-10T22:19:33.859 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:19:33 smithi135 ceph-mon[34789]: pgmap v78: 0 pgs: ; 0 B data, 69 MiB used, 179 GiB / 179 GiB avail 2024-09-10T22:19:34.625 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:19:34 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.2"} : dispatch 2024-09-10T22:19:34.625 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:19:34 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T22:19:34.708 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:19:34 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.2"} : dispatch 2024-09-10T22:19:34.709 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:19:34 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T22:19:34.860 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:19:34 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.2"} : dispatch 2024-09-10T22:19:34.860 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:19:34 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T22:19:35.536 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:19:35 smithi138 ceph-mon[35236]: Deploying daemon osd.2 on smithi138 2024-09-10T22:19:35.536 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:19:35 smithi138 ceph-mon[35236]: pgmap v79: 0 pgs: ; 0 B data, 69 MiB used, 179 GiB / 179 GiB avail 2024-09-10T22:19:35.708 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:19:35 smithi019 ceph-mon[31375]: Deploying daemon osd.2 on smithi138 2024-09-10T22:19:35.709 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:19:35 smithi019 ceph-mon[31375]: pgmap v79: 0 pgs: ; 0 B data, 69 MiB used, 179 GiB / 179 GiB avail 2024-09-10T22:19:35.859 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:19:35 smithi135 ceph-mon[34789]: Deploying daemon osd.2 on smithi138 2024-09-10T22:19:35.860 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:19:35 smithi135 ceph-mon[34789]: pgmap v79: 0 pgs: ; 0 B data, 69 MiB used, 179 GiB / 179 GiB avail 2024-09-10T22:19:37.480 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:19:37 smithi138 ceph-mon[35236]: pgmap v80: 0 pgs: ; 0 B data, 69 MiB used, 179 GiB / 179 GiB avail 2024-09-10T22:19:37.708 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:19:37 smithi019 ceph-mon[31375]: pgmap v80: 0 pgs: ; 0 B data, 69 MiB used, 179 GiB / 179 GiB avail 2024-09-10T22:19:37.859 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:19:37 smithi135 ceph-mon[34789]: pgmap v80: 0 pgs: ; 0 B data, 69 MiB used, 179 GiB / 179 GiB avail 2024-09-10T22:19:39.483 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:19:39 smithi138 ceph-mon[35236]: pgmap v81: 0 pgs: ; 0 B data, 69 MiB used, 179 GiB / 179 GiB avail 2024-09-10T22:19:39.708 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:19:39 smithi019 ceph-mon[31375]: pgmap v81: 0 pgs: ; 0 B data, 69 MiB used, 179 GiB / 179 GiB avail 2024-09-10T22:19:39.860 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:19:39 smithi135 ceph-mon[34789]: pgmap v81: 0 pgs: ; 0 B data, 69 MiB used, 179 GiB / 179 GiB avail 2024-09-10T22:19:40.625 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:19:40 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T22:19:40.708 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:19:40 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T22:19:40.859 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:19:40 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T22:19:41.708 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:19:41 smithi019 ceph-mon[31375]: pgmap v82: 0 pgs: ; 0 B data, 69 MiB used, 179 GiB / 179 GiB avail 2024-09-10T22:19:41.708 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:19:41 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:19:41.709 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:19:41 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:19:41.710 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:19:41 smithi138 ceph-mon[35236]: pgmap v82: 0 pgs: ; 0 B data, 69 MiB used, 179 GiB / 179 GiB avail 2024-09-10T22:19:41.710 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:19:41 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:19:41.710 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:19:41 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:19:41.860 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:19:41 smithi135 ceph-mon[34789]: pgmap v82: 0 pgs: ; 0 B data, 69 MiB used, 179 GiB / 179 GiB avail 2024-09-10T22:19:41.860 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:19:41 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:19:41.860 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:19:41 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:19:44.125 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:19:43 smithi138 ceph-mon[35236]: pgmap v83: 0 pgs: ; 0 B data, 69 MiB used, 179 GiB / 179 GiB avail 2024-09-10T22:19:44.125 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:19:43 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:19:44.125 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:19:43 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:19:44.125 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:19:43 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T22:19:44.125 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:19:43 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T22:19:44.125 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:19:43 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:19:44.208 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:19:43 smithi019 ceph-mon[31375]: pgmap v83: 0 pgs: ; 0 B data, 69 MiB used, 179 GiB / 179 GiB avail 2024-09-10T22:19:44.208 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:19:43 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:19:44.209 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:19:43 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:19:44.209 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:19:43 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T22:19:44.209 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:19:43 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T22:19:44.209 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:19:43 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:19:44.359 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:19:43 smithi135 ceph-mon[34789]: pgmap v83: 0 pgs: ; 0 B data, 69 MiB used, 179 GiB / 179 GiB avail 2024-09-10T22:19:44.360 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:19:43 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:19:44.360 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:19:43 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:19:44.360 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:19:43 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T22:19:44.360 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:19:43 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T22:19:44.360 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:19:43 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:19:44.452 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-10T22:19:44.451+0000 7f43457fa640 1 -- 172.21.15.138:0/3298578329 <== mgr.14150 v2:172.21.15.19:6800/2119495487 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f4348063590 con 0x7f43300b5250 2024-09-10T22:19:44.453 INFO:teuthology.orchestra.run.smithi138.stdout:Created osd(s) 2 on host 'smithi138' 2024-09-10T22:19:44.455 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-10T22:19:44.453+0000 7f434e97e640 1 -- 172.21.15.138:0/3298578329 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f43300b5250 msgr2=0x7f43300b7710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:19:44.455 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-10T22:19:44.453+0000 7f434e97e640 1 --2- 172.21.15.138:0/3298578329 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f43300b5250 0x7f43300b7710 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f4338009d60 tx=0x7f4338009110 comp rx=0 tx=0).stop 2024-09-10T22:19:44.455 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-10T22:19:44.453+0000 7f434e97e640 1 -- 172.21.15.138:0/3298578329 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f4348103430 msgr2=0x7f43481a2490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:19:44.455 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-10T22:19:44.453+0000 7f434e97e640 1 --2- 172.21.15.138:0/3298578329 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f4348103430 0x7f43481a2490 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f4340006010 tx=0x7f4340003ba0 comp rx=0 tx=0).stop 2024-09-10T22:19:44.455 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-10T22:19:44.454+0000 7f434e97e640 1 -- 172.21.15.138:0/3298578329 shutdown_connections 2024-09-10T22:19:44.455 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-10T22:19:44.454+0000 7f434e97e640 1 --2- 172.21.15.138:0/3298578329 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f43300b5250 0x7f43300b7710 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:19:44.455 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-10T22:19:44.454+0000 7f434e97e640 1 --2- 172.21.15.138:0/3298578329 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f4348103430 0x7f43481a2490 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:19:44.456 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-10T22:19:44.454+0000 7f434e97e640 1 --2- 172.21.15.138:0/3298578329 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4348102a70 0x7f434819ff40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:19:44.456 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-10T22:19:44.454+0000 7f434e97e640 1 --2- 172.21.15.138:0/3298578329 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4348101910 0x7f434806b350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:19:44.456 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-10T22:19:44.454+0000 7f434e97e640 1 -- 172.21.15.138:0/3298578329 >> 172.21.15.138:0/3298578329 conn(0x7f43480fd1e0 msgr2=0x7f4348105d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:19:44.456 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-10T22:19:44.454+0000 7f434e97e640 1 -- 172.21.15.138:0/3298578329 shutdown_connections 2024-09-10T22:19:44.456 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-10T22:19:44.454+0000 7f434e97e640 1 -- 172.21.15.138:0/3298578329 wait complete. 2024-09-10T22:19:45.058 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:19:44 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T22:19:45.058 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:19:44 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:19:45.058 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:19:44 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:19:45.091 DEBUG:teuthology.orchestra.run.smithi138:osd.2> sudo journalctl -f -n 0 -u ceph-22997a4c-6fc2-11ef-bcea-c7b262605968@osd.2.service 2024-09-10T22:19:45.094 INFO:tasks.cephadm:Deploying osd.3 on smithi019 with /dev/vg_nvme/lv_3... 2024-09-10T22:19:45.094 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 22997a4c-6fc2-11ef-bcea-c7b262605968 -- lvm zap /dev/vg_nvme/lv_3 2024-09-10T22:19:45.208 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:19:44 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T22:19:45.208 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:19:44 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:19:45.208 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:19:44 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:19:45.360 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:19:44 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T22:19:45.360 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:19:44 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:19:45.360 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:19:44 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:19:45.362 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/22997a4c-6fc2-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T22:19:46.208 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:19:45 smithi019 ceph-mon[31375]: pgmap v84: 0 pgs: ; 0 B data, 69 MiB used, 179 GiB / 179 GiB avail 2024-09-10T22:19:46.298 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:19:45 smithi138 ceph-mon[35236]: pgmap v84: 0 pgs: ; 0 B data, 69 MiB used, 179 GiB / 179 GiB avail 2024-09-10T22:19:46.298 INFO:journalctl@ceph.osd.2.smithi138.stdout:Sep 10 22:19:46 smithi138 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-2[40248]: 2024-09-10T22:19:46.106+0000 7f03b2a6a640 -1 osd.2 0 log_to_monitors true 2024-09-10T22:19:46.359 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:19:45 smithi135 ceph-mon[34789]: pgmap v84: 0 pgs: ; 0 B data, 69 MiB used, 179 GiB / 179 GiB avail 2024-09-10T22:19:47.208 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:19:46 smithi019 ceph-mon[31375]: from='osd.2 [v2:172.21.15.138:6800/2747418770,v1:172.21.15.138:6801/2747418770]' entity='osd.2' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]} : dispatch 2024-09-10T22:19:47.209 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:19:46 smithi019 ceph-mon[31375]: from='osd.2 ' entity='osd.2' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]} : dispatch 2024-09-10T22:19:47.261 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:19:46 smithi135 ceph-mon[34789]: from='osd.2 [v2:172.21.15.138:6800/2747418770,v1:172.21.15.138:6801/2747418770]' entity='osd.2' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]} : dispatch 2024-09-10T22:19:47.261 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:19:46 smithi135 ceph-mon[34789]: from='osd.2 ' entity='osd.2' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]} : dispatch 2024-09-10T22:19:47.276 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:19:46 smithi138 ceph-mon[35236]: from='osd.2 [v2:172.21.15.138:6800/2747418770,v1:172.21.15.138:6801/2747418770]' entity='osd.2' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]} : dispatch 2024-09-10T22:19:47.277 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:19:46 smithi138 ceph-mon[35236]: from='osd.2 ' entity='osd.2' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]} : dispatch 2024-09-10T22:19:47.692 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-10T22:19:47.719 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 22997a4c-6fc2-11ef-bcea-c7b262605968 -- ceph orch daemon add osd smithi019:vg_nvme/lv_3 2024-09-10T22:19:47.950 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:19:47 smithi019 ceph-mon[31375]: pgmap v85: 0 pgs: ; 0 B data, 69 MiB used, 179 GiB / 179 GiB avail 2024-09-10T22:19:47.950 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:19:47 smithi019 ceph-mon[31375]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-09-10T22:19:47.950 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:19:47 smithi019 ceph-mon[31375]: osdmap e15: 3 total, 2 up, 3 in 2024-09-10T22:19:47.950 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:19:47 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-10T22:19:47.950 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:19:47 smithi019 ceph-mon[31375]: from='osd.2 [v2:172.21.15.138:6800/2747418770,v1:172.21.15.138:6801/2747418770]' entity='osd.2' cmd={"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi138", "root=default"]} : dispatch 2024-09-10T22:19:47.950 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:19:47 smithi019 ceph-mon[31375]: from='osd.2 ' entity='osd.2' cmd={"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi138", "root=default"]} : dispatch 2024-09-10T22:19:47.951 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:19:47 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:19:47.951 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:19:47 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:19:47.951 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:19:47 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-10T22:19:47.951 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:19:47 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:19:47.951 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:19:47 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T22:19:47.951 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:19:47 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T22:19:47.951 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:19:47 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:19:47.996 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/22997a4c-6fc2-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T22:19:48.125 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:19:47 smithi138 ceph-mon[35236]: pgmap v85: 0 pgs: ; 0 B data, 69 MiB used, 179 GiB / 179 GiB avail 2024-09-10T22:19:48.125 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:19:47 smithi138 ceph-mon[35236]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-09-10T22:19:48.125 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:19:47 smithi138 ceph-mon[35236]: osdmap e15: 3 total, 2 up, 3 in 2024-09-10T22:19:48.125 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:19:47 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-10T22:19:48.125 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:19:47 smithi138 ceph-mon[35236]: from='osd.2 [v2:172.21.15.138:6800/2747418770,v1:172.21.15.138:6801/2747418770]' entity='osd.2' cmd={"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi138", "root=default"]} : dispatch 2024-09-10T22:19:48.126 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:19:47 smithi138 ceph-mon[35236]: from='osd.2 ' entity='osd.2' cmd={"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi138", "root=default"]} : dispatch 2024-09-10T22:19:48.126 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:19:47 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:19:48.126 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:19:47 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:19:48.126 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:19:47 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-10T22:19:48.126 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:19:47 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:19:48.126 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:19:47 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T22:19:48.126 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:19:47 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T22:19:48.126 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:19:47 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:19:48.360 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:19:47 smithi135 ceph-mon[34789]: pgmap v85: 0 pgs: ; 0 B data, 69 MiB used, 179 GiB / 179 GiB avail 2024-09-10T22:19:48.360 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:19:47 smithi135 ceph-mon[34789]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-09-10T22:19:48.360 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:19:47 smithi135 ceph-mon[34789]: osdmap e15: 3 total, 2 up, 3 in 2024-09-10T22:19:48.360 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:19:47 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-10T22:19:48.360 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:19:47 smithi135 ceph-mon[34789]: from='osd.2 [v2:172.21.15.138:6800/2747418770,v1:172.21.15.138:6801/2747418770]' entity='osd.2' cmd={"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi138", "root=default"]} : dispatch 2024-09-10T22:19:48.360 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:19:47 smithi135 ceph-mon[34789]: from='osd.2 ' entity='osd.2' cmd={"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi138", "root=default"]} : dispatch 2024-09-10T22:19:48.360 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:19:47 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:19:48.360 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:19:47 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:19:48.361 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:19:47 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-10T22:19:48.361 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:19:47 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:19:48.361 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:19:47 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T22:19:48.361 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:19:47 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T22:19:48.361 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:19:47 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:19:48.437 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:19:48.435+0000 7fd7a70bc640 1 -- 172.21.15.19:0/438667862 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd7a0104560 msgr2=0x7fd7a010aee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:19:48.438 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:19:48.435+0000 7fd7a70bc640 1 --2- 172.21.15.19:0/438667862 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd7a0104560 0x7fd7a010aee0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fd798009cd0 tx=0x7fd79802a8e0 comp rx=0 tx=0).stop 2024-09-10T22:19:48.438 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:19:48.436+0000 7fd7a70bc640 1 -- 172.21.15.19:0/438667862 shutdown_connections 2024-09-10T22:19:48.438 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:19:48.436+0000 7fd7a70bc640 1 --2- 172.21.15.19:0/438667862 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd7a0104560 0x7fd7a010aee0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:19:48.438 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:19:48.436+0000 7fd7a70bc640 1 --2- 172.21.15.19:0/438667862 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd7a0103ba0 0x7fd7a0104020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:19:48.438 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:19:48.436+0000 7fd7a70bc640 1 --2- 172.21.15.19:0/438667862 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd7a0102a40 0x7fd7a0102e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:19:48.438 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:19:48.436+0000 7fd7a70bc640 1 -- 172.21.15.19:0/438667862 >> 172.21.15.19:0/438667862 conn(0x7fd7a00fe2f0 msgr2=0x7fd7a0100750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:19:48.438 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:19:48.436+0000 7fd7a70bc640 1 -- 172.21.15.19:0/438667862 shutdown_connections 2024-09-10T22:19:48.438 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:19:48.436+0000 7fd7a70bc640 1 -- 172.21.15.19:0/438667862 wait complete. 2024-09-10T22:19:48.438 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:19:48.436+0000 7fd7a70bc640 1 Processor -- start 2024-09-10T22:19:48.439 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:19:48.436+0000 7fd7a70bc640 1 -- start start 2024-09-10T22:19:48.440 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:19:48.437+0000 7fd7a70bc640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd7a0102a40 0x7fd7a0198de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:19:48.441 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:19:48.437+0000 7fd7a70bc640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd7a0103ba0 0x7fd7a0199430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:19:48.441 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:19:48.437+0000 7fd7a70bc640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd7a0104560 0x7fd7a019a070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:19:48.441 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:19:48.437+0000 7fd7a4e58640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd7a0102a40 0x7fd7a0198de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:19:48.441 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:19:48.437+0000 7fd7a70bc640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fd7a010e6a0 con 0x7fd7a0102a40 2024-09-10T22:19:48.441 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:19:48.437+0000 7fd7a4e58640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd7a0102a40 0x7fd7a0198de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:52470/0 (socket says 172.21.15.19:52470) 2024-09-10T22:19:48.441 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:19:48.437+0000 7fd7a4e58640 1 -- 172.21.15.19:0/3060356970 learned_addr learned my addr 172.21.15.19:0/3060356970 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:19:48.441 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:19:48.437+0000 7fd7a70bc640 1 -- 172.21.15.19:0/3060356970 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fd7a010e520 con 0x7fd7a0104560 2024-09-10T22:19:48.441 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:19:48.437+0000 7fd7a70bc640 1 -- 172.21.15.19:0/3060356970 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7fd7a010e820 con 0x7fd7a0103ba0 2024-09-10T22:19:48.441 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:19:48.437+0000 7fd79ffff640 1 --2- 172.21.15.19:0/3060356970 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd7a0103ba0 0x7fd7a0199430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:19:48.441 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:19:48.437+0000 7fd7a5659640 1 --2- 172.21.15.19:0/3060356970 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd7a0104560 0x7fd7a019a070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:19:48.441 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:19:48.437+0000 7fd7a4e58640 1 -- 172.21.15.19:0/3060356970 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd7a0103ba0 msgr2=0x7fd7a0199430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:19:48.441 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:19:48.437+0000 7fd7a4e58640 1 --2- 172.21.15.19:0/3060356970 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd7a0103ba0 0x7fd7a0199430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:19:48.442 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:19:48.437+0000 7fd7a4e58640 1 -- 172.21.15.19:0/3060356970 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd7a0104560 msgr2=0x7fd7a019a070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:19:48.442 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:19:48.437+0000 7fd7a4e58640 1 --2- 172.21.15.19:0/3060356970 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd7a0104560 0x7fd7a019a070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:19:48.442 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:19:48.437+0000 7fd7a4e58640 1 -- 172.21.15.19:0/3060356970 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd7a019a910 con 0x7fd7a0102a40 2024-09-10T22:19:48.442 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:19:48.437+0000 7fd7a4e58640 1 --2- 172.21.15.19:0/3060356970 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd7a0102a40 0x7fd7a0198de0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fd79400e9f0 tx=0x7fd79400eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:19:48.442 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:19:48.437+0000 7fd79dffb640 1 -- 172.21.15.19:0/3060356970 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd79400cd80 con 0x7fd7a0102a40 2024-09-10T22:19:48.442 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:19:48.437+0000 7fd79dffb640 1 -- 172.21.15.19:0/3060356970 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd7940108e0 con 0x7fd7a0102a40 2024-09-10T22:19:48.442 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:19:48.438+0000 7fd7a70bc640 1 -- 172.21.15.19:0/3060356970 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd7a019ac00 con 0x7fd7a0102a40 2024-09-10T22:19:48.442 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:19:48.438+0000 7fd79dffb640 1 -- 172.21.15.19:0/3060356970 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd794018980 con 0x7fd7a0102a40 2024-09-10T22:19:48.442 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:19:48.438+0000 7fd7a70bc640 1 -- 172.21.15.19:0/3060356970 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd7a01a12e0 con 0x7fd7a0102a40 2024-09-10T22:19:48.442 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:19:48.439+0000 7fd7a70bc640 1 -- 172.21.15.19:0/3060356970 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd7a0109d60 con 0x7fd7a0102a40 2024-09-10T22:19:48.443 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:19:48.440+0000 7fd79dffb640 1 -- 172.21.15.19:0/3060356970 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 15) ==== 153194+0+0 (secure 0 0 0) 0x7fd794010430 con 0x7fd7a0102a40 2024-09-10T22:19:48.443 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:19:48.441+0000 7fd79dffb640 1 --2- 172.21.15.19:0/3060356970 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7fd7900b5250 0x7fd7900b7710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:19:48.443 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:19:48.442+0000 7fd79ffff640 1 --2- 172.21.15.19:0/3060356970 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7fd7900b5250 0x7fd7900b7710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:19:48.443 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:19:48.442+0000 7fd79dffb640 1 -- 172.21.15.19:0/3060356970 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 2571+0+0 (secure 0 0 0) 0x7fd7940e4c60 con 0x7fd7a0102a40 2024-09-10T22:19:48.443 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:19:48.442+0000 7fd79ffff640 1 --2- 172.21.15.19:0/3060356970 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7fd7900b5250 0x7fd7900b7710 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fd78c005d00 tx=0x7fd78c00b410 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:19:48.446 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:19:48.445+0000 7fd79dffb640 1 -- 172.21.15.19:0/3060356970 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7fd7940acc00 con 0x7fd7a0102a40 2024-09-10T22:19:48.645 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:19:48.643+0000 7fd7a70bc640 1 -- 172.21.15.19:0/3060356970 --> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi019:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) -- 0x7fd7a0063590 con 0x7fd7900b5250 2024-09-10T22:19:48.960 INFO:journalctl@ceph.osd.2.smithi138.stdout:Sep 10 22:19:48 smithi138 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-2[40248]: 2024-09-10T22:19:48.831+0000 7f03af201640 -1 osd.2 0 waiting for initial osdmap 2024-09-10T22:19:49.208 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:19:48 smithi019 ceph-mon[31375]: Detected new or changed devices on smithi138 2024-09-10T22:19:49.209 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:19:48 smithi019 ceph-mon[31375]: Adjusting osd_memory_target on smithi138 to 17088M 2024-09-10T22:19:49.209 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:19:48 smithi019 ceph-mon[31375]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi138", "root=default"]}]': finished 2024-09-10T22:19:49.209 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:19:48 smithi019 ceph-mon[31375]: osdmap e16: 3 total, 2 up, 3 in 2024-09-10T22:19:49.209 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:19:48 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-10T22:19:49.209 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:19:48 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-10T22:19:49.209 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:19:48 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-10T22:19:49.209 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:19:48 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-10T22:19:49.209 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:19:48 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T22:19:49.209 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:19:48 smithi019 ceph-mon[31375]: from='osd.2 ' entity='osd.2' 2024-09-10T22:19:49.360 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:19:48 smithi135 ceph-mon[34789]: Detected new or changed devices on smithi138 2024-09-10T22:19:49.360 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:19:48 smithi135 ceph-mon[34789]: Adjusting osd_memory_target on smithi138 to 17088M 2024-09-10T22:19:49.360 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:19:48 smithi135 ceph-mon[34789]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi138", "root=default"]}]': finished 2024-09-10T22:19:49.360 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:19:48 smithi135 ceph-mon[34789]: osdmap e16: 3 total, 2 up, 3 in 2024-09-10T22:19:49.360 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:19:48 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-10T22:19:49.360 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:19:48 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-10T22:19:49.360 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:19:48 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-10T22:19:49.360 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:19:48 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-10T22:19:49.361 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:19:48 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T22:19:49.361 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:19:48 smithi135 ceph-mon[34789]: from='osd.2 ' entity='osd.2' 2024-09-10T22:19:49.375 INFO:journalctl@ceph.osd.2.smithi138.stdout:Sep 10 22:19:49 smithi138 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-2[40248]: 2024-09-10T22:19:49.060+0000 7f03a680c640 -1 osd.2 16 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-10T22:19:49.375 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:19:48 smithi138 ceph-mon[35236]: Detected new or changed devices on smithi138 2024-09-10T22:19:49.375 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:19:48 smithi138 ceph-mon[35236]: Adjusting osd_memory_target on smithi138 to 17088M 2024-09-10T22:19:49.375 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:19:48 smithi138 ceph-mon[35236]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi138", "root=default"]}]': finished 2024-09-10T22:19:49.375 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:19:48 smithi138 ceph-mon[35236]: osdmap e16: 3 total, 2 up, 3 in 2024-09-10T22:19:49.376 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:19:48 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-10T22:19:49.376 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:19:48 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-10T22:19:49.376 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:19:48 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-10T22:19:49.376 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:19:48 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-10T22:19:49.376 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:19:48 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T22:19:49.376 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:19:48 smithi138 ceph-mon[35236]: from='osd.2 ' entity='osd.2' 2024-09-10T22:19:50.180 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:19:49 smithi019 ceph-mon[31375]: purged_snaps scrub starts 2024-09-10T22:19:50.180 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:19:49 smithi019 ceph-mon[31375]: purged_snaps scrub ok 2024-09-10T22:19:50.180 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:19:49 smithi019 ceph-mon[31375]: pgmap v88: 0 pgs: ; 0 B data, 69 MiB used, 179 GiB / 179 GiB avail 2024-09-10T22:19:50.181 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:19:49 smithi019 ceph-mon[31375]: from='client.14421 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi019:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T22:19:50.181 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:19:49 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-10T22:19:50.181 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:19:49 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-10T22:19:50.359 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:19:49 smithi135 ceph-mon[34789]: purged_snaps scrub starts 2024-09-10T22:19:50.360 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:19:49 smithi135 ceph-mon[34789]: purged_snaps scrub ok 2024-09-10T22:19:50.360 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:19:49 smithi135 ceph-mon[34789]: pgmap v88: 0 pgs: ; 0 B data, 69 MiB used, 179 GiB / 179 GiB avail 2024-09-10T22:19:50.360 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:19:49 smithi135 ceph-mon[34789]: from='client.14421 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi019:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T22:19:50.360 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:19:49 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-10T22:19:50.360 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:19:49 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-10T22:19:50.375 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:19:49 smithi138 ceph-mon[35236]: purged_snaps scrub starts 2024-09-10T22:19:50.375 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:19:49 smithi138 ceph-mon[35236]: purged_snaps scrub ok 2024-09-10T22:19:50.375 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:19:49 smithi138 ceph-mon[35236]: pgmap v88: 0 pgs: ; 0 B data, 69 MiB used, 179 GiB / 179 GiB avail 2024-09-10T22:19:50.375 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:19:49 smithi138 ceph-mon[35236]: from='client.14421 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi019:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T22:19:50.375 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:19:49 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-10T22:19:50.375 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:19:49 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-10T22:19:51.221 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:19:50 smithi019 ceph-mon[31375]: osd.2 [v2:172.21.15.138:6800/2747418770,v1:172.21.15.138:6801/2747418770] boot 2024-09-10T22:19:51.221 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:19:50 smithi019 ceph-mon[31375]: osdmap e17: 3 total, 3 up, 3 in 2024-09-10T22:19:51.221 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:19:50 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-10T22:19:51.221 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:19:50 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true} : dispatch 2024-09-10T22:19:51.221 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:19:50 smithi019 ceph-mon[31375]: from='client.? 172.21.15.19:0/304812399' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "a46268da-8666-4cfa-b11a-30eb12e271be"} : dispatch 2024-09-10T22:19:51.221 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:19:50 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-09-10T22:19:51.221 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:19:50 smithi019 ceph-mon[31375]: from='client.? 172.21.15.19:0/304812399' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "a46268da-8666-4cfa-b11a-30eb12e271be"}]': finished 2024-09-10T22:19:51.222 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:19:50 smithi019 ceph-mon[31375]: osdmap e18: 4 total, 3 up, 4 in 2024-09-10T22:19:51.222 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:19:50 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-10T22:19:51.222 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:19:50 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true} : dispatch 2024-09-10T22:19:51.360 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:19:50 smithi135 ceph-mon[34789]: osd.2 [v2:172.21.15.138:6800/2747418770,v1:172.21.15.138:6801/2747418770] boot 2024-09-10T22:19:51.360 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:19:50 smithi135 ceph-mon[34789]: osdmap e17: 3 total, 3 up, 3 in 2024-09-10T22:19:51.360 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:19:50 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-10T22:19:51.360 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:19:50 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true} : dispatch 2024-09-10T22:19:51.360 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:19:50 smithi135 ceph-mon[34789]: from='client.? 172.21.15.19:0/304812399' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "a46268da-8666-4cfa-b11a-30eb12e271be"} : dispatch 2024-09-10T22:19:51.360 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:19:50 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-09-10T22:19:51.360 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:19:50 smithi135 ceph-mon[34789]: from='client.? 172.21.15.19:0/304812399' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "a46268da-8666-4cfa-b11a-30eb12e271be"}]': finished 2024-09-10T22:19:51.360 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:19:50 smithi135 ceph-mon[34789]: osdmap e18: 4 total, 3 up, 4 in 2024-09-10T22:19:51.360 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:19:50 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-10T22:19:51.360 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:19:50 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true} : dispatch 2024-09-10T22:19:51.375 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:19:50 smithi138 ceph-mon[35236]: osd.2 [v2:172.21.15.138:6800/2747418770,v1:172.21.15.138:6801/2747418770] boot 2024-09-10T22:19:51.375 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:19:50 smithi138 ceph-mon[35236]: osdmap e17: 3 total, 3 up, 3 in 2024-09-10T22:19:51.375 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:19:50 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-10T22:19:51.375 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:19:50 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true} : dispatch 2024-09-10T22:19:51.375 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:19:50 smithi138 ceph-mon[35236]: from='client.? 172.21.15.19:0/304812399' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "a46268da-8666-4cfa-b11a-30eb12e271be"} : dispatch 2024-09-10T22:19:51.375 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:19:50 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-09-10T22:19:51.375 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:19:50 smithi138 ceph-mon[35236]: from='client.? 172.21.15.19:0/304812399' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "a46268da-8666-4cfa-b11a-30eb12e271be"}]': finished 2024-09-10T22:19:51.375 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:19:50 smithi138 ceph-mon[35236]: osdmap e18: 4 total, 3 up, 4 in 2024-09-10T22:19:51.375 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:19:50 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-10T22:19:51.376 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:19:50 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true} : dispatch 2024-09-10T22:19:52.255 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:19:52 smithi019 ceph-mon[31375]: pgmap v90: 0 pgs: ; 0 B data, 69 MiB used, 179 GiB / 179 GiB avail 2024-09-10T22:19:52.255 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:19:52 smithi019 ceph-mon[31375]: from='client.? 172.21.15.19:0/2150265126' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-10T22:19:52.255 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:19:52 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-09-10T22:19:52.255 INFO:journalctl@ceph.osd.0.smithi019.stdout:Sep 10 22:19:52 smithi019 sudo[53109]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-10T22:19:52.255 INFO:journalctl@ceph.osd.0.smithi019.stdout:Sep 10 22:19:52 smithi019 sudo[53109]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-10T22:19:52.255 INFO:journalctl@ceph.osd.0.smithi019.stdout:Sep 10 22:19:52 smithi019 sudo[53109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-10T22:19:52.255 INFO:journalctl@ceph.osd.0.smithi019.stdout:Sep 10 22:19:52 smithi019 sudo[53109]: pam_unix(sudo:session): session closed for user root 2024-09-10T22:19:52.255 INFO:journalctl@ceph.osd.0.smithi019.stdout:Sep 10 22:19:52 smithi019 sudo[53112]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-10T22:19:52.256 INFO:journalctl@ceph.osd.0.smithi019.stdout:Sep 10 22:19:52 smithi019 sudo[53112]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-10T22:19:52.256 INFO:journalctl@ceph.osd.0.smithi019.stdout:Sep 10 22:19:52 smithi019 sudo[53112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-10T22:19:52.256 INFO:journalctl@ceph.osd.0.smithi019.stdout:Sep 10 22:19:52 smithi019 sudo[53112]: pam_unix(sudo:session): session closed for user root 2024-09-10T22:19:52.297 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:19:52 smithi135 ceph-mon[34789]: pgmap v90: 0 pgs: ; 0 B data, 69 MiB used, 179 GiB / 179 GiB avail 2024-09-10T22:19:52.298 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:19:52 smithi135 ceph-mon[34789]: from='client.? 172.21.15.19:0/2150265126' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-10T22:19:52.298 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:19:52 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-09-10T22:19:52.369 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:19:52 smithi138 ceph-mon[35236]: pgmap v90: 0 pgs: ; 0 B data, 69 MiB used, 179 GiB / 179 GiB avail 2024-09-10T22:19:52.369 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:19:52 smithi138 ceph-mon[35236]: from='client.? 172.21.15.19:0/2150265126' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-10T22:19:52.369 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:19:52 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-09-10T22:19:52.549 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:19:52 smithi135 sudo[43434]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-10T22:19:52.549 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:19:52 smithi135 sudo[43434]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-10T22:19:52.549 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:19:52 smithi135 sudo[43434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-10T22:19:52.549 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:19:52 smithi135 sudo[43434]: pam_unix(sudo:session): session closed for user root 2024-09-10T22:19:52.549 INFO:journalctl@ceph.osd.1.smithi135.stdout:Sep 10 22:19:52 smithi135 sudo[43428]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-10T22:19:52.549 INFO:journalctl@ceph.osd.1.smithi135.stdout:Sep 10 22:19:52 smithi135 sudo[43428]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-10T22:19:52.549 INFO:journalctl@ceph.osd.1.smithi135.stdout:Sep 10 22:19:52 smithi135 sudo[43428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-10T22:19:52.549 INFO:journalctl@ceph.osd.1.smithi135.stdout:Sep 10 22:19:52 smithi135 sudo[43428]: pam_unix(sudo:session): session closed for user root 2024-09-10T22:19:52.550 INFO:journalctl@ceph.osd.1.smithi135.stdout:Sep 10 22:19:52 smithi135 sudo[43431]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-10T22:19:52.550 INFO:journalctl@ceph.osd.1.smithi135.stdout:Sep 10 22:19:52 smithi135 sudo[43431]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-10T22:19:52.550 INFO:journalctl@ceph.osd.1.smithi135.stdout:Sep 10 22:19:52 smithi135 sudo[43431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-10T22:19:52.550 INFO:journalctl@ceph.osd.1.smithi135.stdout:Sep 10 22:19:52 smithi135 sudo[43431]: pam_unix(sudo:session): session closed for user root 2024-09-10T22:19:52.625 INFO:journalctl@ceph.osd.2.smithi138.stdout:Sep 10 22:19:52 smithi138 sudo[44161]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-10T22:19:52.625 INFO:journalctl@ceph.osd.2.smithi138.stdout:Sep 10 22:19:52 smithi138 sudo[44161]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-10T22:19:52.625 INFO:journalctl@ceph.osd.2.smithi138.stdout:Sep 10 22:19:52 smithi138 sudo[44161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-10T22:19:52.625 INFO:journalctl@ceph.osd.2.smithi138.stdout:Sep 10 22:19:52 smithi138 sudo[44161]: pam_unix(sudo:session): session closed for user root 2024-09-10T22:19:52.625 INFO:journalctl@ceph.osd.2.smithi138.stdout:Sep 10 22:19:52 smithi138 sudo[44164]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-10T22:19:52.625 INFO:journalctl@ceph.osd.2.smithi138.stdout:Sep 10 22:19:52 smithi138 sudo[44164]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-10T22:19:52.625 INFO:journalctl@ceph.osd.2.smithi138.stdout:Sep 10 22:19:52 smithi138 sudo[44164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-10T22:19:52.626 INFO:journalctl@ceph.osd.2.smithi138.stdout:Sep 10 22:19:52 smithi138 sudo[44164]: pam_unix(sudo:session): session closed for user root 2024-09-10T22:19:52.626 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:19:52 smithi138 sudo[44167]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-10T22:19:52.626 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:19:52 smithi138 sudo[44167]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-10T22:19:52.626 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:19:52 smithi138 sudo[44167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-10T22:19:52.626 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:19:52 smithi138 sudo[44167]: pam_unix(sudo:session): session closed for user root 2024-09-10T22:19:52.626 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:19:52 smithi138 sudo[44170]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-10T22:19:52.626 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:19:52 smithi138 sudo[44170]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-10T22:19:52.626 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:19:52 smithi138 sudo[44170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-10T22:19:52.626 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:19:52 smithi138 sudo[44170]: pam_unix(sudo:session): session closed for user root 2024-09-10T22:19:52.708 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:19:52 smithi019 sudo[53115]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-10T22:19:52.709 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:19:52 smithi019 sudo[53115]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-10T22:19:52.709 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:19:52 smithi019 sudo[53115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-10T22:19:52.709 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:19:52 smithi019 sudo[53115]: pam_unix(sudo:session): session closed for user root 2024-09-10T22:19:52.709 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:19:52 smithi019 sudo[53118]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-10T22:19:52.709 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:19:52 smithi019 sudo[53118]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-10T22:19:52.709 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:19:52 smithi019 sudo[53118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-10T22:19:52.709 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:19:52 smithi019 sudo[53118]: pam_unix(sudo:session): session closed for user root 2024-09-10T22:19:52.860 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:19:52 smithi135 sudo[43437]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-10T22:19:52.860 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:19:52 smithi135 sudo[43437]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-10T22:19:52.860 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:19:52 smithi135 sudo[43437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-10T22:19:52.860 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:19:52 smithi135 sudo[43437]: pam_unix(sudo:session): session closed for user root 2024-09-10T22:19:53.294 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:19:53.293+0000 7fd79dffb640 1 -- 172.21.15.19:0/3060356970 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mgrmap(e 16) ==== 153250+0+0 (secure 0 0 0) 0x7fd7940a8e70 con 0x7fd7a0102a40 2024-09-10T22:19:53.295 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:19:53 smithi019 ceph-mon[31375]: osdmap e19: 4 total, 3 up, 4 in 2024-09-10T22:19:53.295 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:19:53 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-10T22:19:53.295 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:19:53 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:19:53.295 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:19:53 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:19:53.295 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:19:53 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:19:53.295 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:19:53 smithi019 ceph-mon[31375]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-10T22:19:53.295 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:19:53 smithi019 ceph-mon[31375]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-10T22:19:53.295 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:19:53 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-10T22:19:53.295 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:19:53 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-10T22:19:53.295 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:19:53 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-10T22:19:53.295 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:19:53 smithi019 ceph-mon[31375]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-10T22:19:53.296 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:19:53 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-10T22:19:53.296 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:19:53 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-10T22:19:53.296 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:19:53 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-10T22:19:53.296 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:19:53 smithi019 ceph-mon[31375]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-10T22:19:53.296 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:19:53 smithi019 ceph-mon[31375]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-10T22:19:53.296 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:19:53 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-10T22:19:53.296 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:19:53 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-10T22:19:53.296 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:19:53 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-10T22:19:53.296 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:19:53 smithi019 ceph-mon[31375]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-10T22:19:53.360 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:19:53 smithi135 ceph-mon[34789]: osdmap e19: 4 total, 3 up, 4 in 2024-09-10T22:19:53.360 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:19:53 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-10T22:19:53.360 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:19:53 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:19:53.360 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:19:53 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:19:53.360 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:19:53 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:19:53.360 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:19:53 smithi135 ceph-mon[34789]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-10T22:19:53.360 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:19:53 smithi135 ceph-mon[34789]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-10T22:19:53.361 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:19:53 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-10T22:19:53.361 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:19:53 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-10T22:19:53.361 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:19:53 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-10T22:19:53.361 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:19:53 smithi135 ceph-mon[34789]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-10T22:19:53.361 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:19:53 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-10T22:19:53.361 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:19:53 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-10T22:19:53.361 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:19:53 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-10T22:19:53.361 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:19:53 smithi135 ceph-mon[34789]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-10T22:19:53.361 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:19:53 smithi135 ceph-mon[34789]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-10T22:19:53.361 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:19:53 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-10T22:19:53.361 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:19:53 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-10T22:19:53.361 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:19:53 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-10T22:19:53.361 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:19:53 smithi135 ceph-mon[34789]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-10T22:19:53.375 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:19:53 smithi138 ceph-mon[35236]: osdmap e19: 4 total, 3 up, 4 in 2024-09-10T22:19:53.375 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:19:53 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-10T22:19:53.375 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:19:53 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:19:53.376 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:19:53 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:19:53.376 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:19:53 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:19:53.376 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:19:53 smithi138 ceph-mon[35236]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-10T22:19:53.376 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:19:53 smithi138 ceph-mon[35236]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-10T22:19:53.376 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:19:53 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-10T22:19:53.376 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:19:53 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-10T22:19:53.376 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:19:53 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-10T22:19:53.376 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:19:53 smithi138 ceph-mon[35236]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-10T22:19:53.376 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:19:53 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-10T22:19:53.376 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:19:53 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-10T22:19:53.376 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:19:53 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-10T22:19:53.376 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:19:53 smithi138 ceph-mon[35236]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-10T22:19:53.377 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:19:53 smithi138 ceph-mon[35236]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-10T22:19:53.377 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:19:53 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-10T22:19:53.377 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:19:53 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-10T22:19:53.377 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:19:53 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-10T22:19:53.377 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:19:53 smithi138 ceph-mon[35236]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-10T22:19:54.359 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:19:54 smithi135 ceph-mon[34789]: pgmap v93: 1 pgs: 1 creating+peering; 0 B data, 100 MiB used, 268 GiB / 268 GiB avail 2024-09-10T22:19:54.360 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:19:54 smithi135 ceph-mon[34789]: osdmap e20: 4 total, 3 up, 4 in 2024-09-10T22:19:54.360 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:19:54 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-10T22:19:54.360 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:19:54 smithi135 ceph-mon[34789]: mgrmap e16: x(active, since 2m), standbys: z, y 2024-09-10T22:19:54.375 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:19:54 smithi138 ceph-mon[35236]: pgmap v93: 1 pgs: 1 creating+peering; 0 B data, 100 MiB used, 268 GiB / 268 GiB avail 2024-09-10T22:19:54.375 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:19:54 smithi138 ceph-mon[35236]: osdmap e20: 4 total, 3 up, 4 in 2024-09-10T22:19:54.375 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:19:54 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-10T22:19:54.375 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:19:54 smithi138 ceph-mon[35236]: mgrmap e16: x(active, since 2m), standbys: z, y 2024-09-10T22:19:54.459 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:19:54 smithi019 ceph-mon[31375]: pgmap v93: 1 pgs: 1 creating+peering; 0 B data, 100 MiB used, 268 GiB / 268 GiB avail 2024-09-10T22:19:54.459 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:19:54 smithi019 ceph-mon[31375]: osdmap e20: 4 total, 3 up, 4 in 2024-09-10T22:19:54.459 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:19:54 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-10T22:19:54.459 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:19:54 smithi019 ceph-mon[31375]: mgrmap e16: x(active, since 2m), standbys: z, y 2024-09-10T22:19:56.359 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:19:56 smithi135 ceph-mon[34789]: pgmap v95: 1 pgs: 1 creating+peering; 0 B data, 100 MiB used, 268 GiB / 268 GiB avail 2024-09-10T22:19:56.375 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:19:56 smithi138 ceph-mon[35236]: pgmap v95: 1 pgs: 1 creating+peering; 0 B data, 100 MiB used, 268 GiB / 268 GiB avail 2024-09-10T22:19:56.441 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:19:56 smithi019 ceph-mon[31375]: pgmap v95: 1 pgs: 1 creating+peering; 0 B data, 100 MiB used, 268 GiB / 268 GiB avail 2024-09-10T22:19:58.320 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:19:58 smithi019 ceph-mon[31375]: pgmap v96: 1 pgs: 1 active+clean; 577 KiB data, 101 MiB used, 268 GiB / 268 GiB avail 2024-09-10T22:19:58.359 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:19:58 smithi135 ceph-mon[34789]: pgmap v96: 1 pgs: 1 active+clean; 577 KiB data, 101 MiB used, 268 GiB / 268 GiB avail 2024-09-10T22:19:58.375 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:19:58 smithi138 ceph-mon[35236]: pgmap v96: 1 pgs: 1 active+clean; 577 KiB data, 101 MiB used, 268 GiB / 268 GiB avail 2024-09-10T22:20:00.082 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:20:00 smithi019 ceph-mon[31375]: pgmap v97: 1 pgs: 1 active+clean; 577 KiB data, 102 MiB used, 268 GiB / 268 GiB avail 2024-09-10T22:20:00.082 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:20:00 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.3"} : dispatch 2024-09-10T22:20:00.082 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:20:00 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T22:20:00.082 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:20:00 smithi019 ceph-mon[31375]: overall HEALTH_OK 2024-09-10T22:20:00.360 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:20:00 smithi135 ceph-mon[34789]: pgmap v97: 1 pgs: 1 active+clean; 577 KiB data, 102 MiB used, 268 GiB / 268 GiB avail 2024-09-10T22:20:00.360 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:20:00 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.3"} : dispatch 2024-09-10T22:20:00.360 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:20:00 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T22:20:00.360 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:20:00 smithi135 ceph-mon[34789]: overall HEALTH_OK 2024-09-10T22:20:00.375 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:20:00 smithi138 ceph-mon[35236]: pgmap v97: 1 pgs: 1 active+clean; 577 KiB data, 102 MiB used, 268 GiB / 268 GiB avail 2024-09-10T22:20:00.375 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:20:00 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.3"} : dispatch 2024-09-10T22:20:00.375 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:20:00 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T22:20:00.375 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:20:00 smithi138 ceph-mon[35236]: overall HEALTH_OK 2024-09-10T22:20:01.170 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:20:01 smithi019 ceph-mon[31375]: Deploying daemon osd.3 on smithi019 2024-09-10T22:20:01.359 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:20:01 smithi135 ceph-mon[34789]: Deploying daemon osd.3 on smithi019 2024-09-10T22:20:01.375 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:20:01 smithi138 ceph-mon[35236]: Deploying daemon osd.3 on smithi019 2024-09-10T22:20:02.329 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:20:02 smithi019 ceph-mon[31375]: pgmap v98: 1 pgs: 1 active+clean; 577 KiB data, 102 MiB used, 268 GiB / 268 GiB avail 2024-09-10T22:20:02.359 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:20:02 smithi135 ceph-mon[34789]: pgmap v98: 1 pgs: 1 active+clean; 577 KiB data, 102 MiB used, 268 GiB / 268 GiB avail 2024-09-10T22:20:02.375 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:20:02 smithi138 ceph-mon[35236]: pgmap v98: 1 pgs: 1 active+clean; 577 KiB data, 102 MiB used, 268 GiB / 268 GiB avail 2024-09-10T22:20:04.359 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:20:04 smithi135 ceph-mon[34789]: pgmap v99: 1 pgs: 1 active+clean; 577 KiB data, 102 MiB used, 268 GiB / 268 GiB avail 2024-09-10T22:20:04.375 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:20:04 smithi138 ceph-mon[35236]: pgmap v99: 1 pgs: 1 active+clean; 577 KiB data, 102 MiB used, 268 GiB / 268 GiB avail 2024-09-10T22:20:04.401 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:20:04 smithi019 ceph-mon[31375]: pgmap v99: 1 pgs: 1 active+clean; 577 KiB data, 102 MiB used, 268 GiB / 268 GiB avail 2024-09-10T22:20:06.359 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:20:06 smithi135 ceph-mon[34789]: pgmap v100: 1 pgs: 1 active+clean; 577 KiB data, 102 MiB used, 268 GiB / 268 GiB avail 2024-09-10T22:20:06.360 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:20:06 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T22:20:06.360 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:20:06 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:20:06.360 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:20:06 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:20:06.366 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:20:06 smithi019 ceph-mon[31375]: pgmap v100: 1 pgs: 1 active+clean; 577 KiB data, 102 MiB used, 268 GiB / 268 GiB avail 2024-09-10T22:20:06.366 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:20:06 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T22:20:06.366 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:20:06 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:20:06.366 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:20:06 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:20:06.375 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:20:06 smithi138 ceph-mon[35236]: pgmap v100: 1 pgs: 1 active+clean; 577 KiB data, 102 MiB used, 268 GiB / 268 GiB avail 2024-09-10T22:20:06.375 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:20:06 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T22:20:06.375 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:20:06 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:20:06.375 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:20:06 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:20:08.359 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:20:08 smithi135 ceph-mon[34789]: pgmap v101: 1 pgs: 1 active+clean; 577 KiB data, 102 MiB used, 268 GiB / 268 GiB avail 2024-09-10T22:20:08.375 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:20:08 smithi138 ceph-mon[35236]: pgmap v101: 1 pgs: 1 active+clean; 577 KiB data, 102 MiB used, 268 GiB / 268 GiB avail 2024-09-10T22:20:08.458 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:20:08 smithi019 ceph-mon[31375]: pgmap v101: 1 pgs: 1 active+clean; 577 KiB data, 102 MiB used, 268 GiB / 268 GiB avail 2024-09-10T22:20:09.612 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:20:09.610+0000 7fd79dffb640 1 -- 172.21.15.19:0/3060356970 <== mgr.14150 v2:172.21.15.19:6800/2119495487 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7fd7a0063590 con 0x7fd7900b5250 2024-09-10T22:20:09.612 INFO:teuthology.orchestra.run.smithi019.stdout:Created osd(s) 3 on host 'smithi019' 2024-09-10T22:20:09.612 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:20:09 smithi019 ceph-mon[31375]: pgmap v102: 1 pgs: 1 active+clean; 577 KiB data, 102 MiB used, 268 GiB / 268 GiB avail 2024-09-10T22:20:09.612 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:20:09 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:20:09.612 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:20:09 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:20:09.613 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:20:09 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T22:20:09.613 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:20:09 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T22:20:09.613 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:20:09 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:20:09.614 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:20:09.613+0000 7fd7a70bc640 1 -- 172.21.15.19:0/3060356970 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7fd7900b5250 msgr2=0x7fd7900b7710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:20:09.614 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:20:09.613+0000 7fd7a70bc640 1 --2- 172.21.15.19:0/3060356970 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7fd7900b5250 0x7fd7900b7710 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fd78c005d00 tx=0x7fd78c00b410 comp rx=0 tx=0).stop 2024-09-10T22:20:09.614 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:20:09.613+0000 7fd7a70bc640 1 -- 172.21.15.19:0/3060356970 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd7a0102a40 msgr2=0x7fd7a0198de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:20:09.615 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:20:09.613+0000 7fd7a70bc640 1 --2- 172.21.15.19:0/3060356970 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd7a0102a40 0x7fd7a0198de0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fd79400e9f0 tx=0x7fd79400eeb0 comp rx=0 tx=0).stop 2024-09-10T22:20:09.615 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:20:09.613+0000 7fd7a70bc640 1 -- 172.21.15.19:0/3060356970 shutdown_connections 2024-09-10T22:20:09.615 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:20:09.613+0000 7fd7a70bc640 1 --2- 172.21.15.19:0/3060356970 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7fd7900b5250 0x7fd7900b7710 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:20:09.615 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:20:09.613+0000 7fd7a70bc640 1 --2- 172.21.15.19:0/3060356970 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd7a0104560 0x7fd7a019a070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:20:09.615 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:20:09.613+0000 7fd7a70bc640 1 --2- 172.21.15.19:0/3060356970 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd7a0103ba0 0x7fd7a0199430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:20:09.615 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:20:09.613+0000 7fd7a70bc640 1 --2- 172.21.15.19:0/3060356970 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd7a0102a40 0x7fd7a0198de0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:20:09.615 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:20:09.613+0000 7fd7a70bc640 1 -- 172.21.15.19:0/3060356970 >> 172.21.15.19:0/3060356970 conn(0x7fd7a00fe2f0 msgr2=0x7fd7a0106f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:20:09.615 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:20:09.613+0000 7fd7a70bc640 1 -- 172.21.15.19:0/3060356970 shutdown_connections 2024-09-10T22:20:09.615 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:20:09.613+0000 7fd7a70bc640 1 -- 172.21.15.19:0/3060356970 wait complete. 2024-09-10T22:20:09.860 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:20:09 smithi135 ceph-mon[34789]: pgmap v102: 1 pgs: 1 active+clean; 577 KiB data, 102 MiB used, 268 GiB / 268 GiB avail 2024-09-10T22:20:09.860 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:20:09 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:20:09.860 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:20:09 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:20:09.860 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:20:09 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T22:20:09.860 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:20:09 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T22:20:09.860 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:20:09 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:20:09.875 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:20:09 smithi138 ceph-mon[35236]: pgmap v102: 1 pgs: 1 active+clean; 577 KiB data, 102 MiB used, 268 GiB / 268 GiB avail 2024-09-10T22:20:09.875 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:20:09 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:20:09.875 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:20:09 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:20:09.875 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:20:09 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T22:20:09.875 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:20:09 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T22:20:09.875 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:20:09 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:20:10.250 DEBUG:teuthology.orchestra.run.smithi019:osd.3> sudo journalctl -f -n 0 -u ceph-22997a4c-6fc2-11ef-bcea-c7b262605968@osd.3.service 2024-09-10T22:20:10.253 INFO:tasks.cephadm:Deploying osd.4 on smithi135 with /dev/vg_nvme/lv_3... 2024-09-10T22:20:10.253 DEBUG:teuthology.orchestra.run.smithi135:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 22997a4c-6fc2-11ef-bcea-c7b262605968 -- lvm zap /dev/vg_nvme/lv_3 2024-09-10T22:20:10.482 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:20:10 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T22:20:10.482 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:20:10 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:20:10.482 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:20:10 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:20:10.507 INFO:teuthology.orchestra.run.smithi135.stderr:Inferring config /var/lib/ceph/22997a4c-6fc2-11ef-bcea-c7b262605968/mon.b/config 2024-09-10T22:20:10.610 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:20:10 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T22:20:10.610 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:20:10 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:20:10.610 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:20:10 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:20:10.875 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:20:10 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T22:20:10.875 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:20:10 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:20:10.875 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:20:10 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:20:11.541 INFO:journalctl@ceph.osd.3.smithi019.stdout:Sep 10 22:20:11 smithi019 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-3[55077]: 2024-09-10T22:20:11.402+0000 7f09f7812640 -1 osd.3 0 log_to_monitors true 2024-09-10T22:20:11.860 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:20:11 smithi135 ceph-mon[34789]: pgmap v103: 1 pgs: 1 active+clean; 577 KiB data, 102 MiB used, 268 GiB / 268 GiB avail 2024-09-10T22:20:11.860 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:20:11 smithi135 ceph-mon[34789]: from='osd.3 [v2:172.21.15.19:6810/1889857224,v1:172.21.15.19:6811/1889857224]' entity='osd.3' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]} : dispatch 2024-09-10T22:20:11.875 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:20:11 smithi138 ceph-mon[35236]: pgmap v103: 1 pgs: 1 active+clean; 577 KiB data, 102 MiB used, 268 GiB / 268 GiB avail 2024-09-10T22:20:11.875 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:20:11 smithi138 ceph-mon[35236]: from='osd.3 [v2:172.21.15.19:6810/1889857224,v1:172.21.15.19:6811/1889857224]' entity='osd.3' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]} : dispatch 2024-09-10T22:20:11.958 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:20:11 smithi019 ceph-mon[31375]: pgmap v103: 1 pgs: 1 active+clean; 577 KiB data, 102 MiB used, 268 GiB / 268 GiB avail 2024-09-10T22:20:11.958 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:20:11 smithi019 ceph-mon[31375]: from='osd.3 [v2:172.21.15.19:6810/1889857224,v1:172.21.15.19:6811/1889857224]' entity='osd.3' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]} : dispatch 2024-09-10T22:20:12.815 INFO:journalctl@ceph.osd.3.smithi019.stdout:Sep 10 22:20:12 smithi019 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-3[55077]: 2024-09-10T22:20:12.621+0000 7f09f3795640 -1 osd.3 0 waiting for initial osdmap 2024-09-10T22:20:12.815 INFO:journalctl@ceph.osd.3.smithi019.stdout:Sep 10 22:20:12 smithi019 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-3[55077]: 2024-09-10T22:20:12.630+0000 7f09ef5bc640 -1 osd.3 22 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-10T22:20:12.816 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:20:12 smithi019 ceph-mon[31375]: from='osd.3 [v2:172.21.15.19:6810/1889857224,v1:172.21.15.19:6811/1889857224]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-09-10T22:20:12.816 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:20:12 smithi019 ceph-mon[31375]: osdmap e21: 4 total, 3 up, 4 in 2024-09-10T22:20:12.816 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:20:12 smithi019 ceph-mon[31375]: from='osd.3 [v2:172.21.15.19:6810/1889857224,v1:172.21.15.19:6811/1889857224]' entity='osd.3' cmd={"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi019", "root=default"]} : dispatch 2024-09-10T22:20:12.816 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:20:12 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-10T22:20:12.816 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:20:12 smithi019 ceph-mon[31375]: from='osd.3 [v2:172.21.15.19:6810/1889857224,v1:172.21.15.19:6811/1889857224]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi019", "root=default"]}]': finished 2024-09-10T22:20:12.875 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:20:12 smithi138 ceph-mon[35236]: from='osd.3 [v2:172.21.15.19:6810/1889857224,v1:172.21.15.19:6811/1889857224]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-09-10T22:20:12.875 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:20:12 smithi138 ceph-mon[35236]: osdmap e21: 4 total, 3 up, 4 in 2024-09-10T22:20:12.875 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:20:12 smithi138 ceph-mon[35236]: from='osd.3 [v2:172.21.15.19:6810/1889857224,v1:172.21.15.19:6811/1889857224]' entity='osd.3' cmd={"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi019", "root=default"]} : dispatch 2024-09-10T22:20:12.875 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:20:12 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-10T22:20:12.876 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:20:12 smithi138 ceph-mon[35236]: from='osd.3 [v2:172.21.15.19:6810/1889857224,v1:172.21.15.19:6811/1889857224]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi019", "root=default"]}]': finished 2024-09-10T22:20:12.929 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:20:12 smithi135 ceph-mon[34789]: from='osd.3 [v2:172.21.15.19:6810/1889857224,v1:172.21.15.19:6811/1889857224]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-09-10T22:20:12.929 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:20:12 smithi135 ceph-mon[34789]: osdmap e21: 4 total, 3 up, 4 in 2024-09-10T22:20:12.930 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:20:12 smithi135 ceph-mon[34789]: from='osd.3 [v2:172.21.15.19:6810/1889857224,v1:172.21.15.19:6811/1889857224]' entity='osd.3' cmd={"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi019", "root=default"]} : dispatch 2024-09-10T22:20:12.930 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:20:12 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-10T22:20:12.930 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:20:12 smithi135 ceph-mon[34789]: from='osd.3 [v2:172.21.15.19:6810/1889857224,v1:172.21.15.19:6811/1889857224]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi019", "root=default"]}]': finished 2024-09-10T22:20:12.933 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-09-10T22:20:12.960 DEBUG:teuthology.orchestra.run.smithi135:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 22997a4c-6fc2-11ef-bcea-c7b262605968 -- ceph orch daemon add osd smithi135:vg_nvme/lv_3 2024-09-10T22:20:13.204 INFO:teuthology.orchestra.run.smithi135.stderr:Inferring config /var/lib/ceph/22997a4c-6fc2-11ef-bcea-c7b262605968/mon.b/config 2024-09-10T22:20:13.602 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T22:20:13.598+0000 7f3cb144b640 1 -- 172.21.15.135:0/3196234613 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3cac103470 msgr2=0x7f3cac109df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:20:13.602 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T22:20:13.598+0000 7f3cb144b640 1 --2- 172.21.15.135:0/3196234613 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3cac103470 0x7f3cac109df0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f3ca4009cd0 tx=0x7f3ca402a8e0 comp rx=0 tx=0).stop 2024-09-10T22:20:13.602 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T22:20:13.598+0000 7f3cb144b640 1 -- 172.21.15.135:0/3196234613 shutdown_connections 2024-09-10T22:20:13.602 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T22:20:13.598+0000 7f3cb144b640 1 --2- 172.21.15.135:0/3196234613 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3cac103470 0x7f3cac109df0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:20:13.602 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T22:20:13.598+0000 7f3cb144b640 1 --2- 172.21.15.135:0/3196234613 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3cac102ab0 0x7f3cac102f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:20:13.602 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T22:20:13.598+0000 7f3cb144b640 1 --2- 172.21.15.135:0/3196234613 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3cac101950 0x7f3cac101d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:20:13.602 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T22:20:13.598+0000 7f3cb144b640 1 -- 172.21.15.135:0/3196234613 >> 172.21.15.135:0/3196234613 conn(0x7f3cac0fd220 msgr2=0x7f3cac0ff660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:20:13.602 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T22:20:13.598+0000 7f3cb144b640 1 -- 172.21.15.135:0/3196234613 shutdown_connections 2024-09-10T22:20:13.602 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T22:20:13.598+0000 7f3cb144b640 1 -- 172.21.15.135:0/3196234613 wait complete. 2024-09-10T22:20:13.602 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T22:20:13.599+0000 7f3cb144b640 1 Processor -- start 2024-09-10T22:20:13.602 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T22:20:13.599+0000 7f3cb144b640 1 -- start start 2024-09-10T22:20:13.603 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T22:20:13.599+0000 7f3cb144b640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3cac101950 0x7f3cac10c1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:20:13.603 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T22:20:13.599+0000 7f3cb144b640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3cac102ab0 0x7f3cac10aa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:20:13.603 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T22:20:13.599+0000 7f3cb144b640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3cac103470 0x7f3cac10af80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:20:13.603 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T22:20:13.599+0000 7f3cb144b640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f3cac10e760 con 0x7f3cac103470 2024-09-10T22:20:13.603 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T22:20:13.599+0000 7f3cb144b640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f3cac10e5e0 con 0x7f3cac102ab0 2024-09-10T22:20:13.603 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T22:20:13.599+0000 7f3cb144b640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f3cac10e8e0 con 0x7f3cac101950 2024-09-10T22:20:13.603 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T22:20:13.599+0000 7f3ca27fc640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3cac102ab0 0x7f3cac10aa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:20:13.603 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T22:20:13.600+0000 7f3ca27fc640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3cac102ab0 0x7f3cac10aa40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:54458/0 (socket says 172.21.15.135:54458) 2024-09-10T22:20:13.603 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T22:20:13.600+0000 7f3caaffd640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3cac101950 0x7f3cac10c1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:20:13.603 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T22:20:13.600+0000 7f3ca27fc640 1 -- 172.21.15.135:0/1072707759 learned_addr learned my addr 172.21.15.135:0/1072707759 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-09-10T22:20:13.603 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T22:20:13.600+0000 7f3cab7fe640 1 --2- 172.21.15.135:0/1072707759 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3cac103470 0x7f3cac10af80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:20:13.603 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T22:20:13.600+0000 7f3ca27fc640 1 -- 172.21.15.135:0/1072707759 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3cac101950 msgr2=0x7f3cac10c1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:20:13.603 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T22:20:13.600+0000 7f3ca27fc640 1 --2- 172.21.15.135:0/1072707759 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3cac101950 0x7f3cac10c1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:20:13.604 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T22:20:13.600+0000 7f3ca27fc640 1 -- 172.21.15.135:0/1072707759 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3cac103470 msgr2=0x7f3cac10af80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:20:13.604 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T22:20:13.600+0000 7f3ca27fc640 1 --2- 172.21.15.135:0/1072707759 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3cac103470 0x7f3cac10af80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:20:13.604 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T22:20:13.600+0000 7f3ca27fc640 1 -- 172.21.15.135:0/1072707759 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3cac10b840 con 0x7f3cac102ab0 2024-09-10T22:20:13.604 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T22:20:13.600+0000 7f3ca27fc640 1 --2- 172.21.15.135:0/1072707759 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3cac102ab0 0x7f3cac10aa40 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f3c9400c890 tx=0x7f3c9400cd50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:20:13.604 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T22:20:13.600+0000 7f3ca8ff9640 1 -- 172.21.15.135:0/1072707759 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c94004220 con 0x7f3cac102ab0 2024-09-10T22:20:13.604 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T22:20:13.600+0000 7f3cb144b640 1 -- 172.21.15.135:0/1072707759 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3cac1a2ec0 con 0x7f3cac102ab0 2024-09-10T22:20:13.604 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T22:20:13.600+0000 7f3ca8ff9640 1 -- 172.21.15.135:0/1072707759 <== mon.2 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3c940043c0 con 0x7f3cac102ab0 2024-09-10T22:20:13.604 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T22:20:13.600+0000 7f3ca8ff9640 1 -- 172.21.15.135:0/1072707759 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c94004a00 con 0x7f3cac102ab0 2024-09-10T22:20:13.604 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T22:20:13.600+0000 7f3cb144b640 1 -- 172.21.15.135:0/1072707759 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3cac1a33c0 con 0x7f3cac102ab0 2024-09-10T22:20:13.605 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T22:20:13.601+0000 7f3cb144b640 1 -- 172.21.15.135:0/1072707759 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3cac108c50 con 0x7f3cac102ab0 2024-09-10T22:20:13.606 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T22:20:13.603+0000 7f3ca8ff9640 1 -- 172.21.15.135:0/1072707759 <== mon.2 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 16) ==== 153250+0+0 (secure 0 0 0) 0x7f3c940079b0 con 0x7f3cac102ab0 2024-09-10T22:20:13.606 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T22:20:13.603+0000 7f3ca8ff9640 1 --2- 172.21.15.135:0/1072707759 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f3c980b5360 0x7f3c980b7820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:20:13.606 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T22:20:13.604+0000 7f3ca8ff9640 1 -- 172.21.15.135:0/1072707759 <== mon.2 v2:172.21.15.135:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 3389+0+0 (secure 0 0 0) 0x7f3c940e4a30 con 0x7f3cac102ab0 2024-09-10T22:20:13.606 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T22:20:13.604+0000 7f3caaffd640 1 --2- 172.21.15.135:0/1072707759 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f3c980b5360 0x7f3c980b7820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:20:13.606 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T22:20:13.604+0000 7f3caaffd640 1 --2- 172.21.15.135:0/1072707759 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f3c980b5360 0x7f3c980b7820 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f3c9c0058c0 tx=0x7f3c9c00a250 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:20:13.608 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T22:20:13.607+0000 7f3ca8ff9640 1 -- 172.21.15.135:0/1072707759 <== mon.2 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f3c94014030 con 0x7f3cac102ab0 2024-09-10T22:20:13.797 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T22:20:13.795+0000 7f3cb144b640 1 -- 172.21.15.135:0/1072707759 --> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi135:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) -- 0x7f3cac063590 con 0x7f3c980b5360 2024-09-10T22:20:13.860 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:20:13 smithi135 ceph-mon[34789]: pgmap v105: 1 pgs: 1 active+clean; 577 KiB data, 102 MiB used, 268 GiB / 268 GiB avail 2024-09-10T22:20:13.860 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:20:13 smithi135 ceph-mon[34789]: osdmap e22: 4 total, 3 up, 4 in 2024-09-10T22:20:13.860 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:20:13 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-10T22:20:13.860 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:20:13 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-10T22:20:13.861 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:20:13 smithi135 ceph-mon[34789]: Detected new or changed devices on smithi019 2024-09-10T22:20:13.861 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:20:13 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:20:13.861 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:20:13 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:20:13.861 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:20:13 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-10T22:20:13.861 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:20:13 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-09-10T22:20:13.861 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:20:13 smithi135 ceph-mon[34789]: Adjusting osd_memory_target on smithi019 to 8546M 2024-09-10T22:20:13.861 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:20:13 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:20:13.861 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:20:13 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T22:20:13.861 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:20:13 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T22:20:13.861 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:20:13 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:20:13.861 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:20:13 smithi135 ceph-mon[34789]: osd.3 [v2:172.21.15.19:6810/1889857224,v1:172.21.15.19:6811/1889857224] boot 2024-09-10T22:20:13.862 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:20:13 smithi135 ceph-mon[34789]: osdmap e23: 4 total, 4 up, 4 in 2024-09-10T22:20:13.862 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:20:13 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-10T22:20:13.875 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:20:13 smithi138 ceph-mon[35236]: pgmap v105: 1 pgs: 1 active+clean; 577 KiB data, 102 MiB used, 268 GiB / 268 GiB avail 2024-09-10T22:20:13.875 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:20:13 smithi138 ceph-mon[35236]: osdmap e22: 4 total, 3 up, 4 in 2024-09-10T22:20:13.875 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:20:13 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-10T22:20:13.876 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:20:13 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-10T22:20:13.876 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:20:13 smithi138 ceph-mon[35236]: Detected new or changed devices on smithi019 2024-09-10T22:20:13.876 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:20:13 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:20:13.876 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:20:13 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:20:13.876 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:20:13 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-10T22:20:13.876 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:20:13 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-09-10T22:20:13.876 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:20:13 smithi138 ceph-mon[35236]: Adjusting osd_memory_target on smithi019 to 8546M 2024-09-10T22:20:13.876 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:20:13 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:20:13.876 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:20:13 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T22:20:13.876 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:20:13 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T22:20:13.876 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:20:13 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:20:13.876 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:20:13 smithi138 ceph-mon[35236]: osd.3 [v2:172.21.15.19:6810/1889857224,v1:172.21.15.19:6811/1889857224] boot 2024-09-10T22:20:13.876 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:20:13 smithi138 ceph-mon[35236]: osdmap e23: 4 total, 4 up, 4 in 2024-09-10T22:20:13.877 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:20:13 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-10T22:20:13.958 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:20:13 smithi019 ceph-mon[31375]: pgmap v105: 1 pgs: 1 active+clean; 577 KiB data, 102 MiB used, 268 GiB / 268 GiB avail 2024-09-10T22:20:13.959 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:20:13 smithi019 ceph-mon[31375]: osdmap e22: 4 total, 3 up, 4 in 2024-09-10T22:20:13.959 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:20:13 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-10T22:20:13.959 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:20:13 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-10T22:20:13.959 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:20:13 smithi019 ceph-mon[31375]: Detected new or changed devices on smithi019 2024-09-10T22:20:13.959 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:20:13 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:20:13.959 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:20:13 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:20:13.959 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:20:13 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-10T22:20:13.959 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:20:13 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-09-10T22:20:13.959 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:20:13 smithi019 ceph-mon[31375]: Adjusting osd_memory_target on smithi019 to 8546M 2024-09-10T22:20:13.959 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:20:13 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:20:13.959 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:20:13 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T22:20:13.959 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:20:13 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T22:20:13.960 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:20:13 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:20:13.960 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:20:13 smithi019 ceph-mon[31375]: osd.3 [v2:172.21.15.19:6810/1889857224,v1:172.21.15.19:6811/1889857224] boot 2024-09-10T22:20:13.960 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:20:13 smithi019 ceph-mon[31375]: osdmap e23: 4 total, 4 up, 4 in 2024-09-10T22:20:13.960 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:20:13 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-10T22:20:14.857 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:20:14 smithi135 ceph-mon[34789]: purged_snaps scrub starts 2024-09-10T22:20:14.858 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:20:14 smithi135 ceph-mon[34789]: purged_snaps scrub ok 2024-09-10T22:20:14.858 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:20:14 smithi135 ceph-mon[34789]: from='client.24320 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi135:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T22:20:14.858 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:20:14 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-10T22:20:14.858 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:20:14 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-10T22:20:14.858 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:20:14 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T22:20:14.858 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:20:14 smithi135 ceph-mon[34789]: osdmap e24: 4 total, 4 up, 4 in 2024-09-10T22:20:14.958 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:20:14 smithi019 ceph-mon[31375]: purged_snaps scrub starts 2024-09-10T22:20:14.958 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:20:14 smithi019 ceph-mon[31375]: purged_snaps scrub ok 2024-09-10T22:20:14.959 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:20:14 smithi019 ceph-mon[31375]: from='client.24320 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi135:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T22:20:14.959 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:20:14 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-10T22:20:14.959 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:20:14 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-10T22:20:14.959 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:20:14 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T22:20:14.959 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:20:14 smithi019 ceph-mon[31375]: osdmap e24: 4 total, 4 up, 4 in 2024-09-10T22:20:15.125 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:20:14 smithi138 ceph-mon[35236]: purged_snaps scrub starts 2024-09-10T22:20:15.125 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:20:14 smithi138 ceph-mon[35236]: purged_snaps scrub ok 2024-09-10T22:20:15.125 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:20:14 smithi138 ceph-mon[35236]: from='client.24320 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi135:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T22:20:15.125 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:20:14 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-10T22:20:15.125 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:20:14 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-10T22:20:15.125 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:20:14 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T22:20:15.126 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:20:14 smithi138 ceph-mon[35236]: osdmap e24: 4 total, 4 up, 4 in 2024-09-10T22:20:15.629 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:20:15 smithi135 ceph-mon[34789]: pgmap v108: 1 pgs: 1 active+clean; 577 KiB data, 129 MiB used, 357 GiB / 358 GiB avail 2024-09-10T22:20:15.630 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:20:15 smithi135 ceph-mon[34789]: osdmap e25: 4 total, 4 up, 4 in 2024-09-10T22:20:15.958 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:20:15 smithi019 ceph-mon[31375]: pgmap v108: 1 pgs: 1 active+clean; 577 KiB data, 129 MiB used, 357 GiB / 358 GiB avail 2024-09-10T22:20:15.958 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:20:15 smithi019 ceph-mon[31375]: osdmap e25: 4 total, 4 up, 4 in 2024-09-10T22:20:16.125 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:20:15 smithi138 ceph-mon[35236]: pgmap v108: 1 pgs: 1 active+clean; 577 KiB data, 129 MiB used, 357 GiB / 358 GiB avail 2024-09-10T22:20:16.125 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:20:15 smithi138 ceph-mon[35236]: osdmap e25: 4 total, 4 up, 4 in 2024-09-10T22:20:16.958 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:20:16 smithi019 ceph-mon[31375]: from='client.? 172.21.15.135:0/37116553' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "c58df06f-2de2-4655-88e7-ac6a3531839a"} : dispatch 2024-09-10T22:20:16.958 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:20:16 smithi019 ceph-mon[31375]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "c58df06f-2de2-4655-88e7-ac6a3531839a"} : dispatch 2024-09-10T22:20:16.959 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:20:16 smithi019 ceph-mon[31375]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "c58df06f-2de2-4655-88e7-ac6a3531839a"}]': finished 2024-09-10T22:20:16.959 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:20:16 smithi019 ceph-mon[31375]: osdmap e26: 5 total, 4 up, 5 in 2024-09-10T22:20:16.959 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:20:16 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-10T22:20:17.026 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:20:16 smithi138 ceph-mon[35236]: from='client.? 172.21.15.135:0/37116553' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "c58df06f-2de2-4655-88e7-ac6a3531839a"} : dispatch 2024-09-10T22:20:17.026 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:20:16 smithi138 ceph-mon[35236]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "c58df06f-2de2-4655-88e7-ac6a3531839a"} : dispatch 2024-09-10T22:20:17.026 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:20:16 smithi138 ceph-mon[35236]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "c58df06f-2de2-4655-88e7-ac6a3531839a"}]': finished 2024-09-10T22:20:17.026 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:20:16 smithi138 ceph-mon[35236]: osdmap e26: 5 total, 4 up, 5 in 2024-09-10T22:20:17.027 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:20:16 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-10T22:20:17.110 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:20:16 smithi135 ceph-mon[34789]: from='client.? 172.21.15.135:0/37116553' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "c58df06f-2de2-4655-88e7-ac6a3531839a"} : dispatch 2024-09-10T22:20:17.110 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:20:16 smithi135 ceph-mon[34789]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "c58df06f-2de2-4655-88e7-ac6a3531839a"} : dispatch 2024-09-10T22:20:17.110 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:20:16 smithi135 ceph-mon[34789]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "c58df06f-2de2-4655-88e7-ac6a3531839a"}]': finished 2024-09-10T22:20:17.110 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:20:16 smithi135 ceph-mon[34789]: osdmap e26: 5 total, 4 up, 5 in 2024-09-10T22:20:17.110 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:20:16 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-10T22:20:17.958 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:20:17 smithi019 ceph-mon[31375]: pgmap v112: 1 pgs: 1 active+clean; 577 KiB data, 129 MiB used, 357 GiB / 358 GiB avail; 156 KiB/s, 0 objects/s recovering 2024-09-10T22:20:17.958 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:20:17 smithi019 ceph-mon[31375]: from='client.? 172.21.15.135:0/2848439046' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-10T22:20:18.045 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:20:17 smithi138 ceph-mon[35236]: pgmap v112: 1 pgs: 1 active+clean; 577 KiB data, 129 MiB used, 357 GiB / 358 GiB avail; 156 KiB/s, 0 objects/s recovering 2024-09-10T22:20:18.046 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:20:17 smithi138 ceph-mon[35236]: from='client.? 172.21.15.135:0/2848439046' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-10T22:20:18.109 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:20:17 smithi135 ceph-mon[34789]: pgmap v112: 1 pgs: 1 active+clean; 577 KiB data, 129 MiB used, 357 GiB / 358 GiB avail; 156 KiB/s, 0 objects/s recovering 2024-09-10T22:20:18.110 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:20:17 smithi135 ceph-mon[34789]: from='client.? 172.21.15.135:0/2848439046' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-10T22:20:19.958 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:20:19 smithi019 ceph-mon[31375]: pgmap v113: 1 pgs: 1 active+clean; 577 KiB data, 128 MiB used, 357 GiB / 358 GiB avail; 123 KiB/s, 0 objects/s recovering 2024-09-10T22:20:20.109 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:20:19 smithi135 ceph-mon[34789]: pgmap v113: 1 pgs: 1 active+clean; 577 KiB data, 128 MiB used, 357 GiB / 358 GiB avail; 123 KiB/s, 0 objects/s recovering 2024-09-10T22:20:20.125 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:20:19 smithi138 ceph-mon[35236]: pgmap v113: 1 pgs: 1 active+clean; 577 KiB data, 128 MiB used, 357 GiB / 358 GiB avail; 123 KiB/s, 0 objects/s recovering 2024-09-10T22:20:21.810 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:20:21 smithi135 ceph-mon[34789]: pgmap v114: 1 pgs: 1 active+clean; 577 KiB data, 128 MiB used, 357 GiB / 358 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-10T22:20:21.958 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:20:21 smithi019 ceph-mon[31375]: pgmap v114: 1 pgs: 1 active+clean; 577 KiB data, 128 MiB used, 357 GiB / 358 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-10T22:20:22.125 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:20:21 smithi138 ceph-mon[35236]: pgmap v114: 1 pgs: 1 active+clean; 577 KiB data, 128 MiB used, 357 GiB / 358 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-10T22:20:23.756 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:20:23 smithi135 ceph-mon[34789]: pgmap v115: 1 pgs: 1 active+clean; 577 KiB data, 128 MiB used, 357 GiB / 358 GiB avail; 75 KiB/s, 0 objects/s recovering 2024-09-10T22:20:23.958 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:20:23 smithi019 ceph-mon[31375]: pgmap v115: 1 pgs: 1 active+clean; 577 KiB data, 128 MiB used, 357 GiB / 358 GiB avail; 75 KiB/s, 0 objects/s recovering 2024-09-10T22:20:24.125 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:20:23 smithi138 ceph-mon[35236]: pgmap v115: 1 pgs: 1 active+clean; 577 KiB data, 128 MiB used, 357 GiB / 358 GiB avail; 75 KiB/s, 0 objects/s recovering 2024-09-10T22:20:25.860 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:20:25 smithi135 ceph-mon[34789]: pgmap v116: 1 pgs: 1 active+clean; 577 KiB data, 128 MiB used, 357 GiB / 358 GiB avail; 66 KiB/s, 0 objects/s recovering 2024-09-10T22:20:25.860 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:20:25 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.4"} : dispatch 2024-09-10T22:20:25.860 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:20:25 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T22:20:25.860 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:20:25 smithi135 ceph-mon[34789]: Deploying daemon osd.4 on smithi135 2024-09-10T22:20:25.958 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:20:25 smithi019 ceph-mon[31375]: pgmap v116: 1 pgs: 1 active+clean; 577 KiB data, 128 MiB used, 357 GiB / 358 GiB avail; 66 KiB/s, 0 objects/s recovering 2024-09-10T22:20:25.958 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:20:25 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.4"} : dispatch 2024-09-10T22:20:25.959 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:20:25 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T22:20:25.959 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:20:25 smithi019 ceph-mon[31375]: Deploying daemon osd.4 on smithi135 2024-09-10T22:20:26.125 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:20:25 smithi138 ceph-mon[35236]: pgmap v116: 1 pgs: 1 active+clean; 577 KiB data, 128 MiB used, 357 GiB / 358 GiB avail; 66 KiB/s, 0 objects/s recovering 2024-09-10T22:20:26.125 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:20:25 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.4"} : dispatch 2024-09-10T22:20:26.125 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:20:25 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T22:20:26.125 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:20:25 smithi138 ceph-mon[35236]: Deploying daemon osd.4 on smithi135 2024-09-10T22:20:27.842 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:20:27 smithi135 ceph-mon[34789]: pgmap v117: 1 pgs: 1 active+clean; 577 KiB data, 128 MiB used, 357 GiB / 358 GiB avail 2024-09-10T22:20:27.958 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:20:27 smithi019 ceph-mon[31375]: pgmap v117: 1 pgs: 1 active+clean; 577 KiB data, 128 MiB used, 357 GiB / 358 GiB avail 2024-09-10T22:20:28.125 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:20:27 smithi138 ceph-mon[35236]: pgmap v117: 1 pgs: 1 active+clean; 577 KiB data, 128 MiB used, 357 GiB / 358 GiB avail 2024-09-10T22:20:29.787 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:20:29 smithi135 ceph-mon[34789]: pgmap v118: 1 pgs: 1 active+clean; 577 KiB data, 128 MiB used, 357 GiB / 358 GiB avail 2024-09-10T22:20:29.958 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:20:29 smithi019 ceph-mon[31375]: pgmap v118: 1 pgs: 1 active+clean; 577 KiB data, 128 MiB used, 357 GiB / 358 GiB avail 2024-09-10T22:20:30.125 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:20:29 smithi138 ceph-mon[35236]: pgmap v118: 1 pgs: 1 active+clean; 577 KiB data, 128 MiB used, 357 GiB / 358 GiB avail 2024-09-10T22:20:30.958 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:20:30 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T22:20:30.958 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:20:30 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:20:30.958 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:20:30 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:20:31.089 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:20:30 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T22:20:31.089 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:20:30 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:20:31.089 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:20:30 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:20:31.125 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:20:30 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T22:20:31.125 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:20:30 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:20:31.125 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:20:30 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:20:31.859 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:20:31 smithi135 ceph-mon[34789]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 128 MiB used, 357 GiB / 358 GiB avail 2024-09-10T22:20:31.958 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:20:31 smithi019 ceph-mon[31375]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 128 MiB used, 357 GiB / 358 GiB avail 2024-09-10T22:20:32.125 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:20:31 smithi138 ceph-mon[35236]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 128 MiB used, 357 GiB / 358 GiB avail 2024-09-10T22:20:33.958 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:20:33 smithi019 ceph-mon[31375]: pgmap v120: 1 pgs: 1 active+clean; 577 KiB data, 128 MiB used, 357 GiB / 358 GiB avail 2024-09-10T22:20:33.958 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:20:33 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:20:33.958 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:20:33 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:20:33.959 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:20:33 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T22:20:33.959 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:20:33 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T22:20:33.959 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:20:33 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:20:34.110 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:20:33 smithi135 ceph-mon[34789]: pgmap v120: 1 pgs: 1 active+clean; 577 KiB data, 128 MiB used, 357 GiB / 358 GiB avail 2024-09-10T22:20:34.110 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:20:33 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:20:34.110 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:20:33 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:20:34.110 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:20:33 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T22:20:34.110 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:20:33 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T22:20:34.110 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:20:33 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:20:34.125 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:20:33 smithi138 ceph-mon[35236]: pgmap v120: 1 pgs: 1 active+clean; 577 KiB data, 128 MiB used, 357 GiB / 358 GiB avail 2024-09-10T22:20:34.125 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:20:33 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:20:34.125 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:20:33 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:20:34.125 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:20:33 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T22:20:34.125 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:20:33 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T22:20:34.125 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:20:33 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:20:34.455 INFO:teuthology.orchestra.run.smithi135.stdout:Created osd(s) 4 on host 'smithi135' 2024-09-10T22:20:34.456 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T22:20:34.454+0000 7f3ca8ff9640 1 -- 172.21.15.135:0/1072707759 <== mgr.14150 v2:172.21.15.19:6800/2119495487 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f3cac063590 con 0x7f3c980b5360 2024-09-10T22:20:34.458 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T22:20:34.457+0000 7f3cb144b640 1 -- 172.21.15.135:0/1072707759 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f3c980b5360 msgr2=0x7f3c980b7820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:20:34.459 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T22:20:34.457+0000 7f3cb144b640 1 --2- 172.21.15.135:0/1072707759 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f3c980b5360 0x7f3c980b7820 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f3c9c0058c0 tx=0x7f3c9c00a250 comp rx=0 tx=0).stop 2024-09-10T22:20:34.459 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T22:20:34.457+0000 7f3cb144b640 1 -- 172.21.15.135:0/1072707759 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3cac102ab0 msgr2=0x7f3cac10aa40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:20:34.459 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T22:20:34.457+0000 7f3cb144b640 1 --2- 172.21.15.135:0/1072707759 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3cac102ab0 0x7f3cac10aa40 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f3c9400c890 tx=0x7f3c9400cd50 comp rx=0 tx=0).stop 2024-09-10T22:20:34.459 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T22:20:34.457+0000 7f3cb144b640 1 -- 172.21.15.135:0/1072707759 shutdown_connections 2024-09-10T22:20:34.459 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T22:20:34.457+0000 7f3cb144b640 1 --2- 172.21.15.135:0/1072707759 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f3c980b5360 0x7f3c980b7820 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:20:34.459 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T22:20:34.457+0000 7f3cb144b640 1 --2- 172.21.15.135:0/1072707759 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3cac103470 0x7f3cac10af80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:20:34.459 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T22:20:34.457+0000 7f3cb144b640 1 --2- 172.21.15.135:0/1072707759 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3cac102ab0 0x7f3cac10aa40 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:20:34.459 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T22:20:34.457+0000 7f3cb144b640 1 --2- 172.21.15.135:0/1072707759 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3cac101950 0x7f3cac10c1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:20:34.459 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T22:20:34.457+0000 7f3cb144b640 1 -- 172.21.15.135:0/1072707759 >> 172.21.15.135:0/1072707759 conn(0x7f3cac0fd220 msgr2=0x7f3cac105e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:20:34.459 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T22:20:34.457+0000 7f3cb144b640 1 -- 172.21.15.135:0/1072707759 shutdown_connections 2024-09-10T22:20:34.459 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T22:20:34.457+0000 7f3cb144b640 1 -- 172.21.15.135:0/1072707759 wait complete. 2024-09-10T22:20:34.958 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:20:34 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T22:20:34.959 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:20:34 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:20:34.959 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:20:34 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:20:35.075 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:20:34 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T22:20:35.075 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:20:34 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:20:35.075 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:20:34 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:20:35.102 DEBUG:teuthology.orchestra.run.smithi135:osd.4> sudo journalctl -f -n 0 -u ceph-22997a4c-6fc2-11ef-bcea-c7b262605968@osd.4.service 2024-09-10T22:20:35.105 INFO:tasks.cephadm:Deploying osd.5 on smithi138 with /dev/vg_nvme/lv_3... 2024-09-10T22:20:35.106 DEBUG:teuthology.orchestra.run.smithi138:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 22997a4c-6fc2-11ef-bcea-c7b262605968 -- lvm zap /dev/vg_nvme/lv_3 2024-09-10T22:20:35.125 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:20:34 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T22:20:35.125 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:20:34 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:20:35.125 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:20:34 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:20:35.360 INFO:teuthology.orchestra.run.smithi138.stderr:Inferring config /var/lib/ceph/22997a4c-6fc2-11ef-bcea-c7b262605968/mon.c/config 2024-09-10T22:20:35.787 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:20:35 smithi138 ceph-mon[35236]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 128 MiB used, 357 GiB / 358 GiB avail 2024-09-10T22:20:35.958 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:20:35 smithi019 ceph-mon[31375]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 128 MiB used, 357 GiB / 358 GiB avail 2024-09-10T22:20:36.100 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:20:35 smithi135 ceph-mon[34789]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 128 MiB used, 357 GiB / 358 GiB avail 2024-09-10T22:20:36.360 INFO:journalctl@ceph.osd.4.smithi135.stdout:Sep 10 22:20:36 smithi135 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-4[46199]: 2024-09-10T22:20:36.219+0000 7fdc2ac40640 -1 osd.4 0 log_to_monitors true 2024-09-10T22:20:36.875 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:20:36 smithi138 ceph-mon[35236]: from='osd.4 [v2:172.21.15.135:6808/436311825,v1:172.21.15.135:6809/436311825]' entity='osd.4' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]} : dispatch 2024-09-10T22:20:36.875 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:20:36 smithi138 ceph-mon[35236]: from='osd.4 ' entity='osd.4' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]} : dispatch 2024-09-10T22:20:36.958 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:20:36 smithi019 ceph-mon[31375]: from='osd.4 [v2:172.21.15.135:6808/436311825,v1:172.21.15.135:6809/436311825]' entity='osd.4' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]} : dispatch 2024-09-10T22:20:36.958 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:20:36 smithi019 ceph-mon[31375]: from='osd.4 ' entity='osd.4' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]} : dispatch 2024-09-10T22:20:37.101 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:20:36 smithi135 ceph-mon[34789]: from='osd.4 [v2:172.21.15.135:6808/436311825,v1:172.21.15.135:6809/436311825]' entity='osd.4' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]} : dispatch 2024-09-10T22:20:37.101 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:20:36 smithi135 ceph-mon[34789]: from='osd.4 ' entity='osd.4' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]} : dispatch 2024-09-10T22:20:37.693 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-10T22:20:37.720 DEBUG:teuthology.orchestra.run.smithi138:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 22997a4c-6fc2-11ef-bcea-c7b262605968 -- ceph orch daemon add osd smithi138:vg_nvme/lv_3 2024-09-10T22:20:37.734 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:20:37 smithi135 ceph-mon[34789]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 128 MiB used, 357 GiB / 358 GiB avail 2024-09-10T22:20:37.735 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:20:37 smithi135 ceph-mon[34789]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-09-10T22:20:37.735 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:20:37 smithi135 ceph-mon[34789]: from='osd.4 [v2:172.21.15.135:6808/436311825,v1:172.21.15.135:6809/436311825]' entity='osd.4' cmd={"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi135", "root=default"]} : dispatch 2024-09-10T22:20:37.735 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:20:37 smithi135 ceph-mon[34789]: osdmap e27: 5 total, 4 up, 5 in 2024-09-10T22:20:37.735 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:20:37 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-10T22:20:37.735 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:20:37 smithi135 ceph-mon[34789]: from='osd.4 ' entity='osd.4' cmd={"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi135", "root=default"]} : dispatch 2024-09-10T22:20:37.735 INFO:journalctl@ceph.osd.4.smithi135.stdout:Sep 10 22:20:37 smithi135 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-4[46199]: 2024-09-10T22:20:37.695+0000 7fdc26bc3640 -1 osd.4 0 waiting for initial osdmap 2024-09-10T22:20:37.735 INFO:journalctl@ceph.osd.4.smithi135.stdout:Sep 10 22:20:37 smithi135 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-4[46199]: 2024-09-10T22:20:37.700+0000 7fdc229ea640 -1 osd.4 28 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-10T22:20:37.958 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:20:37 smithi019 ceph-mon[31375]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 128 MiB used, 357 GiB / 358 GiB avail 2024-09-10T22:20:37.958 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:20:37 smithi019 ceph-mon[31375]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-09-10T22:20:37.958 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:20:37 smithi019 ceph-mon[31375]: from='osd.4 [v2:172.21.15.135:6808/436311825,v1:172.21.15.135:6809/436311825]' entity='osd.4' cmd={"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi135", "root=default"]} : dispatch 2024-09-10T22:20:37.958 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:20:37 smithi019 ceph-mon[31375]: osdmap e27: 5 total, 4 up, 5 in 2024-09-10T22:20:37.958 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:20:37 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-10T22:20:37.959 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:20:37 smithi019 ceph-mon[31375]: from='osd.4 ' entity='osd.4' cmd={"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi135", "root=default"]} : dispatch 2024-09-10T22:20:38.009 INFO:teuthology.orchestra.run.smithi138.stderr:Inferring config /var/lib/ceph/22997a4c-6fc2-11ef-bcea-c7b262605968/mon.c/config 2024-09-10T22:20:38.125 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:20:37 smithi138 ceph-mon[35236]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 128 MiB used, 357 GiB / 358 GiB avail 2024-09-10T22:20:38.125 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:20:37 smithi138 ceph-mon[35236]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-09-10T22:20:38.125 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:20:37 smithi138 ceph-mon[35236]: from='osd.4 [v2:172.21.15.135:6808/436311825,v1:172.21.15.135:6809/436311825]' entity='osd.4' cmd={"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi135", "root=default"]} : dispatch 2024-09-10T22:20:38.125 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:20:37 smithi138 ceph-mon[35236]: osdmap e27: 5 total, 4 up, 5 in 2024-09-10T22:20:38.125 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:20:37 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-10T22:20:38.125 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:20:37 smithi138 ceph-mon[35236]: from='osd.4 ' entity='osd.4' cmd={"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi135", "root=default"]} : dispatch 2024-09-10T22:20:38.494 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-10T22:20:38.475+0000 7fdae282c640 1 -- 172.21.15.138:0/1172718480 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fdadc06c0c0 msgr2=0x7fdadc105620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:20:38.494 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-10T22:20:38.475+0000 7fdae282c640 1 --2- 172.21.15.138:0/1172718480 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fdadc06c0c0 0x7fdadc105620 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fdacc009900 tx=0x7fdacc02a410 comp rx=0 tx=0).stop 2024-09-10T22:20:38.494 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-10T22:20:38.475+0000 7fdae282c640 1 -- 172.21.15.138:0/1172718480 shutdown_connections 2024-09-10T22:20:38.494 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-10T22:20:38.475+0000 7fdae282c640 1 --2- 172.21.15.138:0/1172718480 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdadc108760 0x7fdadc10ac20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:20:38.494 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-10T22:20:38.476+0000 7fdae282c640 1 --2- 172.21.15.138:0/1172718480 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdadc105bb0 0x7fdadc108020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:20:38.494 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-10T22:20:38.476+0000 7fdae282c640 1 --2- 172.21.15.138:0/1172718480 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fdadc06c0c0 0x7fdadc105620 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:20:38.494 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-10T22:20:38.476+0000 7fdae282c640 1 -- 172.21.15.138:0/1172718480 >> 172.21.15.138:0/1172718480 conn(0x7fdadc0fd210 msgr2=0x7fdadc0ff650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:20:38.495 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-10T22:20:38.476+0000 7fdae282c640 1 -- 172.21.15.138:0/1172718480 shutdown_connections 2024-09-10T22:20:38.495 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-10T22:20:38.476+0000 7fdae282c640 1 -- 172.21.15.138:0/1172718480 wait complete. 2024-09-10T22:20:38.495 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-10T22:20:38.476+0000 7fdae282c640 1 Processor -- start 2024-09-10T22:20:38.495 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-10T22:20:38.476+0000 7fdae282c640 1 -- start start 2024-09-10T22:20:38.495 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-10T22:20:38.476+0000 7fdae282c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdadc06c0c0 0x7fdadc102d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:20:38.495 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-10T22:20:38.476+0000 7fdae282c640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdadc105bb0 0x7fdadc1015c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:20:38.495 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-10T22:20:38.476+0000 7fdae282c640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fdadc108760 0x7fdadc101b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:20:38.495 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-10T22:20:38.476+0000 7fdae282c640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fdadc10e6e0 con 0x7fdadc06c0c0 2024-09-10T22:20:38.495 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-10T22:20:38.476+0000 7fdae282c640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fdadc10e560 con 0x7fdadc105bb0 2024-09-10T22:20:38.495 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-10T22:20:38.476+0000 7fdae282c640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7fdadc10e860 con 0x7fdadc108760 2024-09-10T22:20:38.496 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-10T22:20:38.477+0000 7fdae0dc9640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fdadc108760 0x7fdadc101b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:20:38.496 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-10T22:20:38.477+0000 7fdae0dc9640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fdadc108760 0x7fdadc101b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:44352/0 (socket says 172.21.15.138:44352) 2024-09-10T22:20:38.496 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-10T22:20:38.477+0000 7fdae0dc9640 1 -- 172.21.15.138:0/1316001800 learned_addr learned my addr 172.21.15.138:0/1316001800 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-09-10T22:20:38.496 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-10T22:20:38.477+0000 7fdadbfff640 1 --2- 172.21.15.138:0/1316001800 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdadc06c0c0 0x7fdadc102d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:20:38.496 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-10T22:20:38.477+0000 7fdadb7fe640 1 --2- 172.21.15.138:0/1316001800 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdadc105bb0 0x7fdadc1015c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:20:38.496 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-10T22:20:38.477+0000 7fdae0dc9640 1 -- 172.21.15.138:0/1316001800 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdadc105bb0 msgr2=0x7fdadc1015c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:20:38.496 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-10T22:20:38.477+0000 7fdae0dc9640 1 --2- 172.21.15.138:0/1316001800 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdadc105bb0 0x7fdadc1015c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:20:38.496 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-10T22:20:38.477+0000 7fdae0dc9640 1 -- 172.21.15.138:0/1316001800 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdadc06c0c0 msgr2=0x7fdadc102d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:20:38.496 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-10T22:20:38.477+0000 7fdae0dc9640 1 --2- 172.21.15.138:0/1316001800 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdadc06c0c0 0x7fdadc102d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:20:38.496 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-10T22:20:38.477+0000 7fdae0dc9640 1 -- 172.21.15.138:0/1316001800 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdadc1023c0 con 0x7fdadc108760 2024-09-10T22:20:38.496 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-10T22:20:38.477+0000 7fdae0dc9640 1 --2- 172.21.15.138:0/1316001800 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fdadc108760 0x7fdadc101b00 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fdad400eaa0 tx=0x7fdad400ef60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:20:38.496 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-10T22:20:38.477+0000 7fdad97fa640 1 -- 172.21.15.138:0/1316001800 <== mon.1 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdad400cdb0 con 0x7fdadc108760 2024-09-10T22:20:38.497 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-10T22:20:38.477+0000 7fdad97fa640 1 -- 172.21.15.138:0/1316001800 <== mon.1 v2:172.21.15.138:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fdad4005020 con 0x7fdadc108760 2024-09-10T22:20:38.497 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-10T22:20:38.477+0000 7fdae282c640 1 -- 172.21.15.138:0/1316001800 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdadc1a2f80 con 0x7fdadc108760 2024-09-10T22:20:38.497 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-10T22:20:38.477+0000 7fdad97fa640 1 -- 172.21.15.138:0/1316001800 <== mon.1 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdad40116d0 con 0x7fdadc108760 2024-09-10T22:20:38.497 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-10T22:20:38.477+0000 7fdae282c640 1 -- 172.21.15.138:0/1316001800 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdadc1a3430 con 0x7fdadc108760 2024-09-10T22:20:38.497 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-10T22:20:38.478+0000 7fdae282c640 1 -- 172.21.15.138:0/1316001800 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdadc0fed00 con 0x7fdadc108760 2024-09-10T22:20:38.497 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-10T22:20:38.480+0000 7fdad97fa640 1 -- 172.21.15.138:0/1316001800 <== mon.1 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 16) ==== 153250+0+0 (secure 0 0 0) 0x7fdad400f040 con 0x7fdadc108760 2024-09-10T22:20:38.497 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-10T22:20:38.480+0000 7fdad97fa640 1 --2- 172.21.15.138:0/1316001800 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7fdac40b52e0 0x7fdac40b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:20:38.497 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-10T22:20:38.480+0000 7fdad97fa640 1 -- 172.21.15.138:0/1316001800 <== mon.1 v2:172.21.15.138:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 3821+0+0 (secure 0 0 0) 0x7fdad40e4b80 con 0x7fdadc108760 2024-09-10T22:20:38.497 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-10T22:20:38.481+0000 7fdadbfff640 1 --2- 172.21.15.138:0/1316001800 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7fdac40b52e0 0x7fdac40b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:20:38.497 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-10T22:20:38.481+0000 7fdadbfff640 1 --2- 172.21.15.138:0/1316001800 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7fdac40b52e0 0x7fdac40b77a0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fdacc000c00 tx=0x7fdacc0314a0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:20:38.497 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-10T22:20:38.483+0000 7fdad97fa640 1 -- 172.21.15.138:0/1316001800 <== mon.1 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7fdad4016030 con 0x7fdadc108760 2024-09-10T22:20:38.669 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-10T22:20:38.668+0000 7fdae282c640 1 -- 172.21.15.138:0/1316001800 --> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi138:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) -- 0x7fdadc063590 con 0x7fdac40b52e0 2024-09-10T22:20:38.959 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:20:38 smithi019 ceph-mon[31375]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi135", "root=default"]}]': finished 2024-09-10T22:20:38.959 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:20:38 smithi019 ceph-mon[31375]: osdmap e28: 5 total, 4 up, 5 in 2024-09-10T22:20:38.959 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:20:38 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-10T22:20:38.959 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:20:38 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-10T22:20:38.959 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:20:38 smithi019 ceph-mon[31375]: Detected new or changed devices on smithi135 2024-09-10T22:20:38.959 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:20:38 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:20:38.959 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:20:38 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:20:38.960 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:20:38 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-10T22:20:38.960 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:20:38 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-09-10T22:20:38.960 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:20:38 smithi019 ceph-mon[31375]: Adjusting osd_memory_target on smithi135 to 2907M 2024-09-10T22:20:38.960 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:20:38 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:20:38.960 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:20:38 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T22:20:38.960 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:20:38 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T22:20:38.960 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:20:38 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:20:38.960 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:20:38 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-10T22:20:38.960 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:20:38 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-10T22:20:38.960 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:20:38 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T22:20:39.075 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:20:38 smithi138 ceph-mon[35236]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi135", "root=default"]}]': finished 2024-09-10T22:20:39.075 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:20:38 smithi138 ceph-mon[35236]: osdmap e28: 5 total, 4 up, 5 in 2024-09-10T22:20:39.075 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:20:38 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-10T22:20:39.075 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:20:38 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-10T22:20:39.075 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:20:38 smithi138 ceph-mon[35236]: Detected new or changed devices on smithi135 2024-09-10T22:20:39.076 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:20:38 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:20:39.076 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:20:38 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:20:39.076 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:20:38 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-10T22:20:39.076 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:20:38 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-09-10T22:20:39.076 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:20:38 smithi138 ceph-mon[35236]: Adjusting osd_memory_target on smithi135 to 2907M 2024-09-10T22:20:39.076 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:20:38 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:20:39.076 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:20:38 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T22:20:39.076 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:20:38 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T22:20:39.076 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:20:38 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:20:39.076 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:20:38 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-10T22:20:39.076 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:20:38 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-10T22:20:39.076 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:20:38 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T22:20:39.110 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:20:38 smithi135 ceph-mon[34789]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi135", "root=default"]}]': finished 2024-09-10T22:20:39.110 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:20:38 smithi135 ceph-mon[34789]: osdmap e28: 5 total, 4 up, 5 in 2024-09-10T22:20:39.110 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:20:38 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-10T22:20:39.110 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:20:38 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-10T22:20:39.110 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:20:38 smithi135 ceph-mon[34789]: Detected new or changed devices on smithi135 2024-09-10T22:20:39.110 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:20:38 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:20:39.110 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:20:38 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:20:39.110 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:20:38 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-10T22:20:39.111 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:20:38 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-09-10T22:20:39.111 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:20:38 smithi135 ceph-mon[34789]: Adjusting osd_memory_target on smithi135 to 2907M 2024-09-10T22:20:39.111 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:20:38 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:20:39.111 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:20:38 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T22:20:39.111 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:20:38 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T22:20:39.111 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:20:38 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:20:39.111 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:20:38 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-10T22:20:39.111 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:20:38 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-10T22:20:39.111 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:20:38 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T22:20:39.950 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:20:39 smithi138 ceph-mon[35236]: purged_snaps scrub starts 2024-09-10T22:20:39.950 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:20:39 smithi138 ceph-mon[35236]: purged_snaps scrub ok 2024-09-10T22:20:39.950 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:20:39 smithi138 ceph-mon[35236]: pgmap v125: 1 pgs: 1 active+clean; 577 KiB data, 128 MiB used, 357 GiB / 358 GiB avail 2024-09-10T22:20:39.950 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:20:39 smithi138 ceph-mon[35236]: from='client.24337 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi138:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T22:20:39.950 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:20:39 smithi138 ceph-mon[35236]: osd.4 [v2:172.21.15.135:6808/436311825,v1:172.21.15.135:6809/436311825] boot 2024-09-10T22:20:39.950 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:20:39 smithi138 ceph-mon[35236]: osdmap e29: 5 total, 5 up, 5 in 2024-09-10T22:20:39.950 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:20:39 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-10T22:20:39.958 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:20:39 smithi019 ceph-mon[31375]: purged_snaps scrub starts 2024-09-10T22:20:39.958 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:20:39 smithi019 ceph-mon[31375]: purged_snaps scrub ok 2024-09-10T22:20:39.958 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:20:39 smithi019 ceph-mon[31375]: pgmap v125: 1 pgs: 1 active+clean; 577 KiB data, 128 MiB used, 357 GiB / 358 GiB avail 2024-09-10T22:20:39.958 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:20:39 smithi019 ceph-mon[31375]: from='client.24337 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi138:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T22:20:39.958 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:20:39 smithi019 ceph-mon[31375]: osd.4 [v2:172.21.15.135:6808/436311825,v1:172.21.15.135:6809/436311825] boot 2024-09-10T22:20:39.959 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:20:39 smithi019 ceph-mon[31375]: osdmap e29: 5 total, 5 up, 5 in 2024-09-10T22:20:39.959 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:20:39 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-10T22:20:40.110 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:20:39 smithi135 ceph-mon[34789]: purged_snaps scrub starts 2024-09-10T22:20:40.110 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:20:39 smithi135 ceph-mon[34789]: purged_snaps scrub ok 2024-09-10T22:20:40.110 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:20:39 smithi135 ceph-mon[34789]: pgmap v125: 1 pgs: 1 active+clean; 577 KiB data, 128 MiB used, 357 GiB / 358 GiB avail 2024-09-10T22:20:40.110 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:20:39 smithi135 ceph-mon[34789]: from='client.24337 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi138:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T22:20:40.110 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:20:39 smithi135 ceph-mon[34789]: osd.4 [v2:172.21.15.135:6808/436311825,v1:172.21.15.135:6809/436311825] boot 2024-09-10T22:20:40.110 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:20:39 smithi135 ceph-mon[34789]: osdmap e29: 5 total, 5 up, 5 in 2024-09-10T22:20:40.110 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:20:39 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-10T22:20:41.110 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:20:40 smithi135 ceph-mon[34789]: osdmap e30: 5 total, 5 up, 5 in 2024-09-10T22:20:41.125 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:20:40 smithi138 ceph-mon[35236]: osdmap e30: 5 total, 5 up, 5 in 2024-09-10T22:20:41.208 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:20:40 smithi019 ceph-mon[31375]: osdmap e30: 5 total, 5 up, 5 in 2024-09-10T22:20:41.875 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:20:41 smithi138 ceph-mon[35236]: pgmap v128: 1 pgs: 1 active+clean; 577 KiB data, 155 MiB used, 447 GiB / 447 GiB avail 2024-09-10T22:20:41.875 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:20:41 smithi138 ceph-mon[35236]: from='client.? 172.21.15.138:0/2026727626' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "c0900b0c-aef4-498d-a01b-a891bdb51122"} : dispatch 2024-09-10T22:20:41.875 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:20:41 smithi138 ceph-mon[35236]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "c0900b0c-aef4-498d-a01b-a891bdb51122"} : dispatch 2024-09-10T22:20:41.875 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:20:41 smithi138 ceph-mon[35236]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "c0900b0c-aef4-498d-a01b-a891bdb51122"}]': finished 2024-09-10T22:20:41.875 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:20:41 smithi138 ceph-mon[35236]: osdmap e31: 6 total, 5 up, 6 in 2024-09-10T22:20:41.875 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:20:41 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-10T22:20:41.875 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:20:41 smithi138 ceph-mon[35236]: from='client.? 172.21.15.138:0/4225485423' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-10T22:20:42.110 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:20:41 smithi135 ceph-mon[34789]: pgmap v128: 1 pgs: 1 active+clean; 577 KiB data, 155 MiB used, 447 GiB / 447 GiB avail 2024-09-10T22:20:42.110 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:20:41 smithi135 ceph-mon[34789]: from='client.? 172.21.15.138:0/2026727626' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "c0900b0c-aef4-498d-a01b-a891bdb51122"} : dispatch 2024-09-10T22:20:42.110 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:20:41 smithi135 ceph-mon[34789]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "c0900b0c-aef4-498d-a01b-a891bdb51122"} : dispatch 2024-09-10T22:20:42.110 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:20:41 smithi135 ceph-mon[34789]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "c0900b0c-aef4-498d-a01b-a891bdb51122"}]': finished 2024-09-10T22:20:42.110 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:20:41 smithi135 ceph-mon[34789]: osdmap e31: 6 total, 5 up, 6 in 2024-09-10T22:20:42.110 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:20:41 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-10T22:20:42.110 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:20:41 smithi135 ceph-mon[34789]: from='client.? 172.21.15.138:0/4225485423' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-10T22:20:42.211 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:20:41 smithi019 ceph-mon[31375]: pgmap v128: 1 pgs: 1 active+clean; 577 KiB data, 155 MiB used, 447 GiB / 447 GiB avail 2024-09-10T22:20:42.212 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:20:41 smithi019 ceph-mon[31375]: from='client.? 172.21.15.138:0/2026727626' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "c0900b0c-aef4-498d-a01b-a891bdb51122"} : dispatch 2024-09-10T22:20:42.212 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:20:41 smithi019 ceph-mon[31375]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "c0900b0c-aef4-498d-a01b-a891bdb51122"} : dispatch 2024-09-10T22:20:42.212 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:20:41 smithi019 ceph-mon[31375]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "c0900b0c-aef4-498d-a01b-a891bdb51122"}]': finished 2024-09-10T22:20:42.212 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:20:41 smithi019 ceph-mon[31375]: osdmap e31: 6 total, 5 up, 6 in 2024-09-10T22:20:42.212 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:20:41 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-10T22:20:42.212 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:20:41 smithi019 ceph-mon[31375]: from='client.? 172.21.15.138:0/4225485423' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-10T22:20:44.109 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:20:43 smithi135 ceph-mon[34789]: pgmap v130: 1 pgs: 1 active+clean; 577 KiB data, 155 MiB used, 447 GiB / 447 GiB avail 2024-09-10T22:20:44.125 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:20:43 smithi138 ceph-mon[35236]: pgmap v130: 1 pgs: 1 active+clean; 577 KiB data, 155 MiB used, 447 GiB / 447 GiB avail 2024-09-10T22:20:44.208 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:20:43 smithi019 ceph-mon[31375]: pgmap v130: 1 pgs: 1 active+clean; 577 KiB data, 155 MiB used, 447 GiB / 447 GiB avail 2024-09-10T22:20:46.109 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:20:45 smithi135 ceph-mon[34789]: pgmap v131: 1 pgs: 1 active+clean; 577 KiB data, 155 MiB used, 447 GiB / 447 GiB avail 2024-09-10T22:20:46.125 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:20:45 smithi138 ceph-mon[35236]: pgmap v131: 1 pgs: 1 active+clean; 577 KiB data, 155 MiB used, 447 GiB / 447 GiB avail 2024-09-10T22:20:46.208 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:20:45 smithi019 ceph-mon[31375]: pgmap v131: 1 pgs: 1 active+clean; 577 KiB data, 155 MiB used, 447 GiB / 447 GiB avail 2024-09-10T22:20:47.958 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:20:47 smithi019 ceph-mon[31375]: pgmap v132: 1 pgs: 1 active+clean; 577 KiB data, 155 MiB used, 447 GiB / 447 GiB avail 2024-09-10T22:20:48.064 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:20:47 smithi138 ceph-mon[35236]: pgmap v132: 1 pgs: 1 active+clean; 577 KiB data, 155 MiB used, 447 GiB / 447 GiB avail 2024-09-10T22:20:48.109 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:20:47 smithi135 ceph-mon[34789]: pgmap v132: 1 pgs: 1 active+clean; 577 KiB data, 155 MiB used, 447 GiB / 447 GiB avail 2024-09-10T22:20:50.033 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:20:49 smithi138 ceph-mon[35236]: pgmap v133: 1 pgs: 1 active+clean; 577 KiB data, 155 MiB used, 447 GiB / 447 GiB avail 2024-09-10T22:20:50.033 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:20:49 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.5"} : dispatch 2024-09-10T22:20:50.033 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:20:49 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T22:20:50.110 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:20:49 smithi135 ceph-mon[34789]: pgmap v133: 1 pgs: 1 active+clean; 577 KiB data, 155 MiB used, 447 GiB / 447 GiB avail 2024-09-10T22:20:50.110 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:20:49 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.5"} : dispatch 2024-09-10T22:20:50.110 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:20:49 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T22:20:50.208 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:20:49 smithi019 ceph-mon[31375]: pgmap v133: 1 pgs: 1 active+clean; 577 KiB data, 155 MiB used, 447 GiB / 447 GiB avail 2024-09-10T22:20:50.208 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:20:49 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.5"} : dispatch 2024-09-10T22:20:50.208 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:20:49 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T22:20:50.930 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:20:50 smithi138 ceph-mon[35236]: Deploying daemon osd.5 on smithi138 2024-09-10T22:20:51.109 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:20:50 smithi135 ceph-mon[34789]: Deploying daemon osd.5 on smithi138 2024-09-10T22:20:51.208 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:20:50 smithi019 ceph-mon[31375]: Deploying daemon osd.5 on smithi138 2024-09-10T22:20:52.110 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:20:51 smithi135 ceph-mon[34789]: pgmap v134: 1 pgs: 1 active+clean; 577 KiB data, 155 MiB used, 447 GiB / 447 GiB avail 2024-09-10T22:20:52.125 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:20:51 smithi138 ceph-mon[35236]: pgmap v134: 1 pgs: 1 active+clean; 577 KiB data, 155 MiB used, 447 GiB / 447 GiB avail 2024-09-10T22:20:52.208 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:20:51 smithi019 ceph-mon[31375]: pgmap v134: 1 pgs: 1 active+clean; 577 KiB data, 155 MiB used, 447 GiB / 447 GiB avail 2024-09-10T22:20:54.109 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:20:53 smithi135 ceph-mon[34789]: pgmap v135: 1 pgs: 1 active+clean; 577 KiB data, 155 MiB used, 447 GiB / 447 GiB avail 2024-09-10T22:20:54.125 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:20:53 smithi138 ceph-mon[35236]: pgmap v135: 1 pgs: 1 active+clean; 577 KiB data, 155 MiB used, 447 GiB / 447 GiB avail 2024-09-10T22:20:54.208 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:20:53 smithi019 ceph-mon[31375]: pgmap v135: 1 pgs: 1 active+clean; 577 KiB data, 155 MiB used, 447 GiB / 447 GiB avail 2024-09-10T22:20:56.110 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:20:55 smithi135 ceph-mon[34789]: pgmap v136: 1 pgs: 1 active+clean; 577 KiB data, 155 MiB used, 447 GiB / 447 GiB avail 2024-09-10T22:20:56.110 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:20:55 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T22:20:56.110 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:20:55 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:20:56.110 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:20:55 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:20:56.124 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:20:55 smithi138 ceph-mon[35236]: pgmap v136: 1 pgs: 1 active+clean; 577 KiB data, 155 MiB used, 447 GiB / 447 GiB avail 2024-09-10T22:20:56.124 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:20:55 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T22:20:56.124 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:20:55 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:20:56.125 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:20:55 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:20:56.208 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:20:55 smithi019 ceph-mon[31375]: pgmap v136: 1 pgs: 1 active+clean; 577 KiB data, 155 MiB used, 447 GiB / 447 GiB avail 2024-09-10T22:20:56.208 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:20:55 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T22:20:56.208 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:20:55 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:20:56.208 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:20:55 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:20:58.110 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:20:57 smithi135 ceph-mon[34789]: pgmap v137: 1 pgs: 1 active+clean; 577 KiB data, 155 MiB used, 447 GiB / 447 GiB avail 2024-09-10T22:20:58.125 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:20:57 smithi138 ceph-mon[35236]: pgmap v137: 1 pgs: 1 active+clean; 577 KiB data, 155 MiB used, 447 GiB / 447 GiB avail 2024-09-10T22:20:58.208 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:20:57 smithi019 ceph-mon[31375]: pgmap v137: 1 pgs: 1 active+clean; 577 KiB data, 155 MiB used, 447 GiB / 447 GiB avail 2024-09-10T22:20:59.038 INFO:teuthology.orchestra.run.smithi138.stdout:Created osd(s) 5 on host 'smithi138' 2024-09-10T22:20:59.038 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-10T22:20:59.036+0000 7fdad97fa640 1 -- 172.21.15.138:0/1316001800 <== mgr.14150 v2:172.21.15.19:6800/2119495487 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7fdadc063590 con 0x7fdac40b52e0 2024-09-10T22:20:59.039 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:20:58 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:20:59.039 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:20:58 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:20:59.039 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:20:58 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T22:20:59.039 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:20:58 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T22:20:59.039 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:20:58 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:20:59.041 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-10T22:20:59.039+0000 7fdae282c640 1 -- 172.21.15.138:0/1316001800 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7fdac40b52e0 msgr2=0x7fdac40b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:20:59.041 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-10T22:20:59.039+0000 7fdae282c640 1 --2- 172.21.15.138:0/1316001800 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7fdac40b52e0 0x7fdac40b77a0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fdacc000c00 tx=0x7fdacc0314a0 comp rx=0 tx=0).stop 2024-09-10T22:20:59.041 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-10T22:20:59.039+0000 7fdae282c640 1 -- 172.21.15.138:0/1316001800 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fdadc108760 msgr2=0x7fdadc101b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:20:59.041 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-10T22:20:59.039+0000 7fdae282c640 1 --2- 172.21.15.138:0/1316001800 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fdadc108760 0x7fdadc101b00 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fdad400eaa0 tx=0x7fdad400ef60 comp rx=0 tx=0).stop 2024-09-10T22:20:59.041 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-10T22:20:59.039+0000 7fdae282c640 1 -- 172.21.15.138:0/1316001800 shutdown_connections 2024-09-10T22:20:59.041 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-10T22:20:59.039+0000 7fdae282c640 1 --2- 172.21.15.138:0/1316001800 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7fdac40b52e0 0x7fdac40b77a0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:20:59.041 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-10T22:20:59.039+0000 7fdae282c640 1 --2- 172.21.15.138:0/1316001800 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fdadc108760 0x7fdadc101b00 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:20:59.041 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-10T22:20:59.039+0000 7fdae282c640 1 --2- 172.21.15.138:0/1316001800 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdadc105bb0 0x7fdadc1015c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:20:59.041 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-10T22:20:59.039+0000 7fdae282c640 1 --2- 172.21.15.138:0/1316001800 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdadc06c0c0 0x7fdadc102d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:20:59.041 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-10T22:20:59.039+0000 7fdae282c640 1 -- 172.21.15.138:0/1316001800 >> 172.21.15.138:0/1316001800 conn(0x7fdadc0fd210 msgr2=0x7fdadc103f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:20:59.041 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-10T22:20:59.039+0000 7fdae282c640 1 -- 172.21.15.138:0/1316001800 shutdown_connections 2024-09-10T22:20:59.042 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-10T22:20:59.039+0000 7fdae282c640 1 -- 172.21.15.138:0/1316001800 wait complete. 2024-09-10T22:20:59.110 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:20:58 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:20:59.110 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:20:58 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:20:59.110 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:20:58 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T22:20:59.110 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:20:58 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T22:20:59.110 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:20:58 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:20:59.208 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:20:58 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:20:59.208 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:20:58 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:20:59.208 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:20:58 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T22:20:59.208 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:20:58 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T22:20:59.209 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:20:58 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:20:59.701 DEBUG:teuthology.orchestra.run.smithi138:osd.5> sudo journalctl -f -n 0 -u ceph-22997a4c-6fc2-11ef-bcea-c7b262605968@osd.5.service 2024-09-10T22:20:59.703 INFO:tasks.cephadm:Deploying osd.6 on smithi019 with /dev/vg_nvme/lv_2... 2024-09-10T22:20:59.704 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 22997a4c-6fc2-11ef-bcea-c7b262605968 -- lvm zap /dev/vg_nvme/lv_2 2024-09-10T22:20:59.918 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:20:59 smithi138 ceph-mon[35236]: pgmap v138: 1 pgs: 1 active+clean; 577 KiB data, 155 MiB used, 447 GiB / 447 GiB avail 2024-09-10T22:20:59.918 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:20:59 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T22:20:59.918 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:20:59 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:20:59.918 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:20:59 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:20:59.972 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/22997a4c-6fc2-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T22:21:00.094 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:20:59 smithi019 ceph-mon[31375]: pgmap v138: 1 pgs: 1 active+clean; 577 KiB data, 155 MiB used, 447 GiB / 447 GiB avail 2024-09-10T22:21:00.094 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:20:59 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T22:21:00.094 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:20:59 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:21:00.094 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:20:59 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:21:00.360 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:20:59 smithi135 ceph-mon[34789]: pgmap v138: 1 pgs: 1 active+clean; 577 KiB data, 155 MiB used, 447 GiB / 447 GiB avail 2024-09-10T22:21:00.360 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:20:59 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T22:21:00.360 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:20:59 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:21:00.360 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:20:59 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:21:01.821 INFO:journalctl@ceph.osd.5.smithi138.stdout:Sep 10 22:21:01 smithi138 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-5[46984]: 2024-09-10T22:21:01.445+0000 7fa87ca2b640 -1 osd.5 0 log_to_monitors true 2024-09-10T22:21:01.952 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:21:01 smithi019 ceph-mon[31375]: pgmap v139: 1 pgs: 1 active+clean; 577 KiB data, 155 MiB used, 447 GiB / 447 GiB avail 2024-09-10T22:21:01.953 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:21:01 smithi019 ceph-mon[31375]: from='osd.5 [v2:172.21.15.138:6808/1086764290,v1:172.21.15.138:6809/1086764290]' entity='osd.5' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]} : dispatch 2024-09-10T22:21:01.953 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:21:01 smithi019 ceph-mon[31375]: from='osd.5 ' entity='osd.5' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]} : dispatch 2024-09-10T22:21:02.097 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:21:01 smithi138 ceph-mon[35236]: pgmap v139: 1 pgs: 1 active+clean; 577 KiB data, 155 MiB used, 447 GiB / 447 GiB avail 2024-09-10T22:21:02.097 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:21:01 smithi138 ceph-mon[35236]: from='osd.5 [v2:172.21.15.138:6808/1086764290,v1:172.21.15.138:6809/1086764290]' entity='osd.5' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]} : dispatch 2024-09-10T22:21:02.097 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:21:01 smithi138 ceph-mon[35236]: from='osd.5 ' entity='osd.5' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]} : dispatch 2024-09-10T22:21:02.360 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:21:01 smithi135 ceph-mon[34789]: pgmap v139: 1 pgs: 1 active+clean; 577 KiB data, 155 MiB used, 447 GiB / 447 GiB avail 2024-09-10T22:21:02.360 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:21:01 smithi135 ceph-mon[34789]: from='osd.5 [v2:172.21.15.138:6808/1086764290,v1:172.21.15.138:6809/1086764290]' entity='osd.5' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]} : dispatch 2024-09-10T22:21:02.360 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:21:01 smithi135 ceph-mon[34789]: from='osd.5 ' entity='osd.5' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]} : dispatch 2024-09-10T22:21:02.697 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-10T22:21:02.725 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 22997a4c-6fc2-11ef-bcea-c7b262605968 -- ceph orch daemon add osd smithi019:vg_nvme/lv_2 2024-09-10T22:21:02.958 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:21:02 smithi019 ceph-mon[31375]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-09-10T22:21:02.958 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:21:02 smithi019 ceph-mon[31375]: from='osd.5 [v2:172.21.15.138:6808/1086764290,v1:172.21.15.138:6809/1086764290]' entity='osd.5' cmd={"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi138", "root=default"]} : dispatch 2024-09-10T22:21:02.959 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:21:02 smithi019 ceph-mon[31375]: osdmap e32: 6 total, 5 up, 6 in 2024-09-10T22:21:02.959 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:21:02 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-10T22:21:02.959 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:21:02 smithi019 ceph-mon[31375]: from='osd.5 ' entity='osd.5' cmd={"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi138", "root=default"]} : dispatch 2024-09-10T22:21:02.959 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:21:02 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:21:02.959 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:21:02 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:21:02.959 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:21:02 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-10T22:21:02.959 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:21:02 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-09-10T22:21:02.959 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:21:02 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:21:02.959 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:21:02 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T22:21:02.959 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:21:02 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T22:21:02.959 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:21:02 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:21:03.011 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/22997a4c-6fc2-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T22:21:03.359 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:21:02 smithi135 ceph-mon[34789]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-09-10T22:21:03.360 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:21:02 smithi135 ceph-mon[34789]: from='osd.5 [v2:172.21.15.138:6808/1086764290,v1:172.21.15.138:6809/1086764290]' entity='osd.5' cmd={"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi138", "root=default"]} : dispatch 2024-09-10T22:21:03.360 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:21:02 smithi135 ceph-mon[34789]: osdmap e32: 6 total, 5 up, 6 in 2024-09-10T22:21:03.360 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:21:02 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-10T22:21:03.360 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:21:02 smithi135 ceph-mon[34789]: from='osd.5 ' entity='osd.5' cmd={"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi138", "root=default"]} : dispatch 2024-09-10T22:21:03.360 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:21:02 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:21:03.360 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:21:02 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:21:03.360 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:21:02 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-10T22:21:03.360 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:21:02 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-09-10T22:21:03.360 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:21:02 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:21:03.360 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:21:02 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T22:21:03.360 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:21:02 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T22:21:03.361 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:21:02 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:21:03.375 INFO:journalctl@ceph.osd.5.smithi138.stdout:Sep 10 22:21:02 smithi138 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-5[46984]: 2024-09-10T22:21:02.909+0000 7fa8789ae640 -1 osd.5 0 waiting for initial osdmap 2024-09-10T22:21:03.375 INFO:journalctl@ceph.osd.5.smithi138.stdout:Sep 10 22:21:02 smithi138 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-5[46984]: 2024-09-10T22:21:02.918+0000 7fa8747d5640 -1 osd.5 33 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-10T22:21:03.375 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:21:02 smithi138 ceph-mon[35236]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-09-10T22:21:03.375 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:21:02 smithi138 ceph-mon[35236]: from='osd.5 [v2:172.21.15.138:6808/1086764290,v1:172.21.15.138:6809/1086764290]' entity='osd.5' cmd={"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi138", "root=default"]} : dispatch 2024-09-10T22:21:03.375 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:21:02 smithi138 ceph-mon[35236]: osdmap e32: 6 total, 5 up, 6 in 2024-09-10T22:21:03.375 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:21:02 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-10T22:21:03.375 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:21:02 smithi138 ceph-mon[35236]: from='osd.5 ' entity='osd.5' cmd={"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi138", "root=default"]} : dispatch 2024-09-10T22:21:03.376 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:21:02 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:21:03.376 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:21:02 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:21:03.376 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:21:02 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-10T22:21:03.376 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:21:02 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-09-10T22:21:03.376 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:21:02 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:21:03.376 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:21:02 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T22:21:03.376 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:21:02 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T22:21:03.376 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:21:02 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:21:03.451 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:21:03.449+0000 7f4c34eed640 1 -- 172.21.15.19:0/2404585002 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4c30103430 msgr2=0x7f4c30109db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:21:03.451 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:21:03.449+0000 7f4c34eed640 1 --2- 172.21.15.19:0/2404585002 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4c30103430 0x7f4c30109db0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f4c28009cd0 tx=0x7f4c2802a8e0 comp rx=0 tx=0).stop 2024-09-10T22:21:03.451 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:21:03.449+0000 7f4c34eed640 1 -- 172.21.15.19:0/2404585002 shutdown_connections 2024-09-10T22:21:03.451 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:21:03.449+0000 7f4c34eed640 1 --2- 172.21.15.19:0/2404585002 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4c30103430 0x7f4c30109db0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:21:03.451 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:21:03.449+0000 7f4c34eed640 1 --2- 172.21.15.19:0/2404585002 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4c30102a70 0x7f4c30102ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:21:03.451 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:21:03.449+0000 7f4c34eed640 1 --2- 172.21.15.19:0/2404585002 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f4c30101910 0x7f4c30101d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:21:03.452 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:21:03.449+0000 7f4c34eed640 1 -- 172.21.15.19:0/2404585002 >> 172.21.15.19:0/2404585002 conn(0x7f4c300fd1e0 msgr2=0x7f4c300ff620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:21:03.452 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:21:03.449+0000 7f4c34eed640 1 -- 172.21.15.19:0/2404585002 shutdown_connections 2024-09-10T22:21:03.452 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:21:03.450+0000 7f4c34eed640 1 -- 172.21.15.19:0/2404585002 wait complete. 2024-09-10T22:21:03.453 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:21:03.450+0000 7f4c34eed640 1 Processor -- start 2024-09-10T22:21:03.453 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:21:03.450+0000 7f4c34eed640 1 -- start start 2024-09-10T22:21:03.454 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:21:03.451+0000 7f4c34eed640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4c30101910 0x7f4c30198db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:21:03.454 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:21:03.451+0000 7f4c34eed640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4c30102a70 0x7f4c30199400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:21:03.454 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:21:03.451+0000 7f4c34eed640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f4c30103430 0x7f4c3019a040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:21:03.454 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:21:03.451+0000 7f4c34eed640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f4c3010e680 con 0x7f4c30101910 2024-09-10T22:21:03.454 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:21:03.451+0000 7f4c34eed640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f4c3010e500 con 0x7f4c30102a70 2024-09-10T22:21:03.454 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:21:03.451+0000 7f4c34eed640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f4c3010e800 con 0x7f4c30103430 2024-09-10T22:21:03.454 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:21:03.451+0000 7f4c2e59c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4c30101910 0x7f4c30198db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:21:03.454 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:21:03.451+0000 7f4c2e59c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4c30101910 0x7f4c30198db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:43772/0 (socket says 172.21.15.19:43772) 2024-09-10T22:21:03.454 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:21:03.451+0000 7f4c2e59c640 1 -- 172.21.15.19:0/3967421899 learned_addr learned my addr 172.21.15.19:0/3967421899 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:21:03.454 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:21:03.451+0000 7f4c2dd9b640 1 --2- 172.21.15.19:0/3967421899 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4c30102a70 0x7f4c30199400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:21:03.454 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:21:03.451+0000 7f4c2ed9d640 1 --2- 172.21.15.19:0/3967421899 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f4c30103430 0x7f4c3019a040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:21:03.454 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:21:03.451+0000 7f4c2e59c640 1 -- 172.21.15.19:0/3967421899 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f4c30103430 msgr2=0x7f4c3019a040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:21:03.455 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:21:03.451+0000 7f4c2e59c640 1 --2- 172.21.15.19:0/3967421899 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f4c30103430 0x7f4c3019a040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:21:03.455 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:21:03.451+0000 7f4c2e59c640 1 -- 172.21.15.19:0/3967421899 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4c30102a70 msgr2=0x7f4c30199400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:21:03.455 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:21:03.451+0000 7f4c2e59c640 1 --2- 172.21.15.19:0/3967421899 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4c30102a70 0x7f4c30199400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:21:03.455 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:21:03.451+0000 7f4c2e59c640 1 -- 172.21.15.19:0/3967421899 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4c3019a8e0 con 0x7f4c30101910 2024-09-10T22:21:03.455 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:21:03.451+0000 7f4c2e59c640 1 --2- 172.21.15.19:0/3967421899 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4c30101910 0x7f4c30198db0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f4c2000c920 tx=0x7f4c2000cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:21:03.455 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:21:03.452+0000 7f4c1f7fe640 1 -- 172.21.15.19:0/3967421899 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c20007c70 con 0x7f4c30101910 2024-09-10T22:21:03.455 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:21:03.452+0000 7f4c34eed640 1 -- 172.21.15.19:0/3967421899 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4c3019abd0 con 0x7f4c30101910 2024-09-10T22:21:03.455 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:21:03.452+0000 7f4c1f7fe640 1 -- 172.21.15.19:0/3967421899 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4c20007e10 con 0x7f4c30101910 2024-09-10T22:21:03.455 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:21:03.452+0000 7f4c1f7fe640 1 -- 172.21.15.19:0/3967421899 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c20018820 con 0x7f4c30101910 2024-09-10T22:21:03.455 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:21:03.452+0000 7f4c34eed640 1 -- 172.21.15.19:0/3967421899 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4c3010aa10 con 0x7f4c30101910 2024-09-10T22:21:03.456 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:21:03.453+0000 7f4c34eed640 1 -- 172.21.15.19:0/3967421899 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4c30108bc0 con 0x7f4c30101910 2024-09-10T22:21:03.456 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:21:03.454+0000 7f4c1f7fe640 1 -- 172.21.15.19:0/3967421899 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 16) ==== 153250+0+0 (secure 0 0 0) 0x7f4c2000f450 con 0x7f4c30101910 2024-09-10T22:21:03.456 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:21:03.455+0000 7f4c1f7fe640 1 --2- 172.21.15.19:0/3967421899 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f4c180b52e0 0x7f4c180b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:21:03.457 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:21:03.455+0000 7f4c2dd9b640 1 --2- 172.21.15.19:0/3967421899 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f4c180b52e0 0x7f4c180b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:21:03.457 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:21:03.455+0000 7f4c1f7fe640 1 -- 172.21.15.19:0/3967421899 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 4253+0+0 (secure 0 0 0) 0x7f4c200e4ee0 con 0x7f4c30101910 2024-09-10T22:21:03.457 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:21:03.456+0000 7f4c2dd9b640 1 --2- 172.21.15.19:0/3967421899 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f4c180b52e0 0x7f4c180b77a0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f4c2400bbe0 tx=0x7f4c2400b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:21:03.460 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:21:03.459+0000 7f4c1f7fe640 1 -- 172.21.15.19:0/3967421899 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f4c20014030 con 0x7f4c30101910 2024-09-10T22:21:03.657 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:21:03.655+0000 7f4c34eed640 1 -- 172.21.15.19:0/3967421899 --> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi019:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) -- 0x7f4c30063590 con 0x7f4c180b52e0 2024-09-10T22:21:04.173 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:21:03 smithi019 ceph-mon[31375]: Detected new or changed devices on smithi138 2024-09-10T22:21:04.173 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:21:03 smithi019 ceph-mon[31375]: Adjusting osd_memory_target on smithi138 to 8544M 2024-09-10T22:21:04.173 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:21:03 smithi019 ceph-mon[31375]: pgmap v141: 1 pgs: 1 active+clean; 577 KiB data, 155 MiB used, 447 GiB / 447 GiB avail 2024-09-10T22:21:04.173 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:21:03 smithi019 ceph-mon[31375]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi138", "root=default"]}]': finished 2024-09-10T22:21:04.173 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:21:03 smithi019 ceph-mon[31375]: osdmap e33: 6 total, 5 up, 6 in 2024-09-10T22:21:04.173 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:21:03 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-10T22:21:04.173 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:21:03 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-10T22:21:04.173 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:21:03 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-10T22:21:04.173 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:21:03 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-10T22:21:04.173 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:21:03 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T22:21:04.359 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:21:03 smithi135 ceph-mon[34789]: Detected new or changed devices on smithi138 2024-09-10T22:21:04.360 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:21:03 smithi135 ceph-mon[34789]: Adjusting osd_memory_target on smithi138 to 8544M 2024-09-10T22:21:04.360 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:21:03 smithi135 ceph-mon[34789]: pgmap v141: 1 pgs: 1 active+clean; 577 KiB data, 155 MiB used, 447 GiB / 447 GiB avail 2024-09-10T22:21:04.360 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:21:03 smithi135 ceph-mon[34789]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi138", "root=default"]}]': finished 2024-09-10T22:21:04.360 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:21:03 smithi135 ceph-mon[34789]: osdmap e33: 6 total, 5 up, 6 in 2024-09-10T22:21:04.360 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:21:03 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-10T22:21:04.360 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:21:03 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-10T22:21:04.360 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:21:03 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-10T22:21:04.360 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:21:03 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-10T22:21:04.360 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:21:03 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T22:21:04.375 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:21:03 smithi138 ceph-mon[35236]: Detected new or changed devices on smithi138 2024-09-10T22:21:04.375 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:21:03 smithi138 ceph-mon[35236]: Adjusting osd_memory_target on smithi138 to 8544M 2024-09-10T22:21:04.375 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:21:03 smithi138 ceph-mon[35236]: pgmap v141: 1 pgs: 1 active+clean; 577 KiB data, 155 MiB used, 447 GiB / 447 GiB avail 2024-09-10T22:21:04.375 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:21:03 smithi138 ceph-mon[35236]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi138", "root=default"]}]': finished 2024-09-10T22:21:04.375 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:21:03 smithi138 ceph-mon[35236]: osdmap e33: 6 total, 5 up, 6 in 2024-09-10T22:21:04.375 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:21:03 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-10T22:21:04.375 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:21:03 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-10T22:21:04.376 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:21:03 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-10T22:21:04.376 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:21:03 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-10T22:21:04.376 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:21:03 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T22:21:05.105 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:21:04 smithi019 ceph-mon[31375]: purged_snaps scrub starts 2024-09-10T22:21:05.105 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:21:04 smithi019 ceph-mon[31375]: purged_snaps scrub ok 2024-09-10T22:21:05.105 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:21:04 smithi019 ceph-mon[31375]: from='client.14499 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi019:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T22:21:05.105 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:21:04 smithi019 ceph-mon[31375]: osd.5 [v2:172.21.15.138:6808/1086764290,v1:172.21.15.138:6809/1086764290] boot 2024-09-10T22:21:05.105 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:21:04 smithi019 ceph-mon[31375]: osdmap e34: 6 total, 6 up, 6 in 2024-09-10T22:21:05.105 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:21:04 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-10T22:21:05.359 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:21:04 smithi135 ceph-mon[34789]: purged_snaps scrub starts 2024-09-10T22:21:05.360 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:21:04 smithi135 ceph-mon[34789]: purged_snaps scrub ok 2024-09-10T22:21:05.360 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:21:04 smithi135 ceph-mon[34789]: from='client.14499 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi019:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T22:21:05.360 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:21:04 smithi135 ceph-mon[34789]: osd.5 [v2:172.21.15.138:6808/1086764290,v1:172.21.15.138:6809/1086764290] boot 2024-09-10T22:21:05.360 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:21:04 smithi135 ceph-mon[34789]: osdmap e34: 6 total, 6 up, 6 in 2024-09-10T22:21:05.360 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:21:04 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-10T22:21:05.375 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:21:04 smithi138 ceph-mon[35236]: purged_snaps scrub starts 2024-09-10T22:21:05.375 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:21:04 smithi138 ceph-mon[35236]: purged_snaps scrub ok 2024-09-10T22:21:05.375 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:21:04 smithi138 ceph-mon[35236]: from='client.14499 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi019:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T22:21:05.375 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:21:04 smithi138 ceph-mon[35236]: osd.5 [v2:172.21.15.138:6808/1086764290,v1:172.21.15.138:6809/1086764290] boot 2024-09-10T22:21:05.375 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:21:04 smithi138 ceph-mon[35236]: osdmap e34: 6 total, 6 up, 6 in 2024-09-10T22:21:05.375 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:21:04 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-10T22:21:06.208 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:21:05 smithi019 ceph-mon[31375]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 155 MiB used, 447 GiB / 447 GiB avail 2024-09-10T22:21:06.208 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:21:05 smithi019 ceph-mon[31375]: osdmap e35: 6 total, 6 up, 6 in 2024-09-10T22:21:06.360 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:21:05 smithi135 ceph-mon[34789]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 155 MiB used, 447 GiB / 447 GiB avail 2024-09-10T22:21:06.360 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:21:05 smithi135 ceph-mon[34789]: osdmap e35: 6 total, 6 up, 6 in 2024-09-10T22:21:06.375 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:21:05 smithi138 ceph-mon[35236]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 155 MiB used, 447 GiB / 447 GiB avail 2024-09-10T22:21:06.375 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:21:05 smithi138 ceph-mon[35236]: osdmap e35: 6 total, 6 up, 6 in 2024-09-10T22:21:07.208 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:21:06 smithi019 ceph-mon[31375]: osdmap e36: 6 total, 6 up, 6 in 2024-09-10T22:21:07.209 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:21:06 smithi019 ceph-mon[31375]: from='client.? 172.21.15.19:0/3792416694' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "f79cb310-8073-4ee5-80a6-87a290600321"} : dispatch 2024-09-10T22:21:07.209 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:21:06 smithi019 ceph-mon[31375]: from='client.? 172.21.15.19:0/3792416694' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "f79cb310-8073-4ee5-80a6-87a290600321"}]': finished 2024-09-10T22:21:07.209 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:21:06 smithi019 ceph-mon[31375]: osdmap e37: 7 total, 6 up, 7 in 2024-09-10T22:21:07.209 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:21:06 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-10T22:21:07.209 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:21:06 smithi019 ceph-mon[31375]: from='client.? 172.21.15.19:0/3224530993' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-10T22:21:07.360 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:21:06 smithi135 ceph-mon[34789]: osdmap e36: 6 total, 6 up, 6 in 2024-09-10T22:21:07.360 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:21:06 smithi135 ceph-mon[34789]: from='client.? 172.21.15.19:0/3792416694' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "f79cb310-8073-4ee5-80a6-87a290600321"} : dispatch 2024-09-10T22:21:07.360 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:21:06 smithi135 ceph-mon[34789]: from='client.? 172.21.15.19:0/3792416694' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "f79cb310-8073-4ee5-80a6-87a290600321"}]': finished 2024-09-10T22:21:07.360 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:21:06 smithi135 ceph-mon[34789]: osdmap e37: 7 total, 6 up, 7 in 2024-09-10T22:21:07.360 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:21:06 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-10T22:21:07.360 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:21:06 smithi135 ceph-mon[34789]: from='client.? 172.21.15.19:0/3224530993' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-10T22:21:07.375 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:21:06 smithi138 ceph-mon[35236]: osdmap e36: 6 total, 6 up, 6 in 2024-09-10T22:21:07.375 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:21:06 smithi138 ceph-mon[35236]: from='client.? 172.21.15.19:0/3792416694' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "f79cb310-8073-4ee5-80a6-87a290600321"} : dispatch 2024-09-10T22:21:07.375 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:21:06 smithi138 ceph-mon[35236]: from='client.? 172.21.15.19:0/3792416694' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "f79cb310-8073-4ee5-80a6-87a290600321"}]': finished 2024-09-10T22:21:07.375 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:21:06 smithi138 ceph-mon[35236]: osdmap e37: 7 total, 6 up, 7 in 2024-09-10T22:21:07.375 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:21:06 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-10T22:21:07.375 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:21:06 smithi138 ceph-mon[35236]: from='client.? 172.21.15.19:0/3224530993' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-10T22:21:08.208 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:21:07 smithi019 ceph-mon[31375]: pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail; 169 KiB/s, 0 objects/s recovering 2024-09-10T22:21:08.359 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:21:07 smithi135 ceph-mon[34789]: pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail; 169 KiB/s, 0 objects/s recovering 2024-09-10T22:21:08.375 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:21:07 smithi138 ceph-mon[35236]: pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail; 169 KiB/s, 0 objects/s recovering 2024-09-10T22:21:10.208 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:21:09 smithi019 ceph-mon[31375]: pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail; 131 KiB/s, 0 objects/s recovering 2024-09-10T22:21:10.359 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:21:09 smithi135 ceph-mon[34789]: pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail; 131 KiB/s, 0 objects/s recovering 2024-09-10T22:21:10.375 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:21:09 smithi138 ceph-mon[35236]: pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail; 131 KiB/s, 0 objects/s recovering 2024-09-10T22:21:12.208 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:21:11 smithi019 ceph-mon[31375]: pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-10T22:21:12.359 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:21:11 smithi135 ceph-mon[34789]: pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-10T22:21:12.375 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:21:11 smithi138 ceph-mon[35236]: pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-10T22:21:14.195 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:21:13 smithi019 ceph-mon[31375]: pgmap v151: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail; 78 KiB/s, 0 objects/s recovering 2024-09-10T22:21:14.360 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:21:13 smithi135 ceph-mon[34789]: pgmap v151: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail; 78 KiB/s, 0 objects/s recovering 2024-09-10T22:21:14.375 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:21:13 smithi138 ceph-mon[35236]: pgmap v151: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail; 78 KiB/s, 0 objects/s recovering 2024-09-10T22:21:15.208 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:21:14 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.6"} : dispatch 2024-09-10T22:21:15.208 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:21:14 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T22:21:15.359 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:21:14 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.6"} : dispatch 2024-09-10T22:21:15.360 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:21:14 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T22:21:15.375 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:21:14 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.6"} : dispatch 2024-09-10T22:21:15.375 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:21:14 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T22:21:16.208 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:21:15 smithi019 ceph-mon[31375]: Deploying daemon osd.6 on smithi019 2024-09-10T22:21:16.208 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:21:15 smithi019 ceph-mon[31375]: pgmap v152: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail; 69 KiB/s, 0 objects/s recovering 2024-09-10T22:21:16.360 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:21:15 smithi135 ceph-mon[34789]: Deploying daemon osd.6 on smithi019 2024-09-10T22:21:16.360 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:21:15 smithi135 ceph-mon[34789]: pgmap v152: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail; 69 KiB/s, 0 objects/s recovering 2024-09-10T22:21:16.375 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:21:15 smithi138 ceph-mon[35236]: Deploying daemon osd.6 on smithi019 2024-09-10T22:21:16.375 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:21:15 smithi138 ceph-mon[35236]: pgmap v152: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail; 69 KiB/s, 0 objects/s recovering 2024-09-10T22:21:18.208 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:21:17 smithi019 ceph-mon[31375]: pgmap v153: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail 2024-09-10T22:21:18.359 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:21:17 smithi135 ceph-mon[34789]: pgmap v153: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail 2024-09-10T22:21:18.375 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:21:17 smithi138 ceph-mon[35236]: pgmap v153: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail 2024-09-10T22:21:20.208 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:21:19 smithi019 ceph-mon[31375]: pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail 2024-09-10T22:21:20.359 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:21:19 smithi135 ceph-mon[34789]: pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail 2024-09-10T22:21:20.374 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:21:19 smithi138 ceph-mon[35236]: pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail 2024-09-10T22:21:21.208 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:21:20 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T22:21:21.208 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:21:20 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:21:21.208 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:21:20 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:21:21.359 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:21:20 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T22:21:21.360 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:21:20 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:21:21.360 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:21:20 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:21:21.375 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:21:20 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T22:21:21.375 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:21:20 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:21:21.375 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:21:20 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:21:22.110 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:21:21 smithi019 ceph-mon[31375]: pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail 2024-09-10T22:21:22.359 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:21:21 smithi135 ceph-mon[34789]: pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail 2024-09-10T22:21:22.375 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:21:21 smithi138 ceph-mon[35236]: pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail 2024-09-10T22:21:24.025 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:21:24.024+0000 7f4c1f7fe640 1 -- 172.21.15.19:0/3967421899 <== mgr.14150 v2:172.21.15.19:6800/2119495487 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f4c30063590 con 0x7f4c180b52e0 2024-09-10T22:21:24.026 INFO:teuthology.orchestra.run.smithi019.stdout:Created osd(s) 6 on host 'smithi019' 2024-09-10T22:21:24.028 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:21:24.026+0000 7f4c34eed640 1 -- 172.21.15.19:0/3967421899 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f4c180b52e0 msgr2=0x7f4c180b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:21:24.028 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:21:24.026+0000 7f4c34eed640 1 --2- 172.21.15.19:0/3967421899 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f4c180b52e0 0x7f4c180b77a0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f4c2400bbe0 tx=0x7f4c2400b390 comp rx=0 tx=0).stop 2024-09-10T22:21:24.028 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:21:24.026+0000 7f4c34eed640 1 -- 172.21.15.19:0/3967421899 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4c30101910 msgr2=0x7f4c30198db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:21:24.028 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:21:24.026+0000 7f4c34eed640 1 --2- 172.21.15.19:0/3967421899 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4c30101910 0x7f4c30198db0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f4c2000c920 tx=0x7f4c2000cde0 comp rx=0 tx=0).stop 2024-09-10T22:21:24.028 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:21:24.026+0000 7f4c34eed640 1 -- 172.21.15.19:0/3967421899 shutdown_connections 2024-09-10T22:21:24.028 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:21:24.026+0000 7f4c34eed640 1 --2- 172.21.15.19:0/3967421899 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f4c180b52e0 0x7f4c180b77a0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:21:24.028 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:21:24.026+0000 7f4c34eed640 1 --2- 172.21.15.19:0/3967421899 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f4c30103430 0x7f4c3019a040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:21:24.028 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:21:24.026+0000 7f4c34eed640 1 --2- 172.21.15.19:0/3967421899 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4c30102a70 0x7f4c30199400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:21:24.028 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:21:24.026+0000 7f4c34eed640 1 --2- 172.21.15.19:0/3967421899 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4c30101910 0x7f4c30198db0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:21:24.028 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:21:24.026+0000 7f4c34eed640 1 -- 172.21.15.19:0/3967421899 >> 172.21.15.19:0/3967421899 conn(0x7f4c300fd1e0 msgr2=0x7f4c30105d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:21:24.028 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:21:24.026+0000 7f4c34eed640 1 -- 172.21.15.19:0/3967421899 shutdown_connections 2024-09-10T22:21:24.028 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:21:24.026+0000 7f4c34eed640 1 -- 172.21.15.19:0/3967421899 wait complete. 2024-09-10T22:21:24.343 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:21:23 smithi019 ceph-mon[31375]: pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail 2024-09-10T22:21:24.343 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:21:23 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:21:24.343 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:21:23 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:21:24.343 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:21:23 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T22:21:24.344 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:21:23 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T22:21:24.344 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:21:23 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:21:24.360 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:21:23 smithi135 ceph-mon[34789]: pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail 2024-09-10T22:21:24.360 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:21:23 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:21:24.360 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:21:23 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:21:24.360 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:21:23 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T22:21:24.360 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:21:23 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T22:21:24.360 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:21:23 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:21:24.375 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:21:23 smithi138 ceph-mon[35236]: pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail 2024-09-10T22:21:24.375 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:21:23 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:21:24.375 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:21:23 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:21:24.375 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:21:23 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T22:21:24.375 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:21:23 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T22:21:24.375 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:21:23 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:21:24.804 DEBUG:teuthology.orchestra.run.smithi019:osd.6> sudo journalctl -f -n 0 -u ceph-22997a4c-6fc2-11ef-bcea-c7b262605968@osd.6.service 2024-09-10T22:21:24.806 INFO:tasks.cephadm:Deploying osd.7 on smithi135 with /dev/vg_nvme/lv_2... 2024-09-10T22:21:24.807 DEBUG:teuthology.orchestra.run.smithi135:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 22997a4c-6fc2-11ef-bcea-c7b262605968 -- lvm zap /dev/vg_nvme/lv_2 2024-09-10T22:21:25.022 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:21:24 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T22:21:25.022 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:21:24 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:21:25.022 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:21:24 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:21:25.062 INFO:teuthology.orchestra.run.smithi135.stderr:Inferring config /var/lib/ceph/22997a4c-6fc2-11ef-bcea-c7b262605968/mon.b/config 2024-09-10T22:21:25.109 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:21:24 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T22:21:25.110 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:21:24 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:21:25.110 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:21:24 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:21:25.375 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:21:24 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T22:21:25.375 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:21:24 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:21:25.375 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:21:24 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:21:26.185 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:21:26 smithi019 ceph-mon[31375]: pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail 2024-09-10T22:21:26.186 INFO:journalctl@ceph.osd.6.smithi019.stdout:Sep 10 22:21:26 smithi019 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-6[61536]: 2024-09-10T22:21:26.074+0000 7fbed6606640 -1 osd.6 0 log_to_monitors true 2024-09-10T22:21:26.290 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:21:26 smithi135 ceph-mon[34789]: pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail 2024-09-10T22:21:26.375 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:21:26 smithi138 ceph-mon[35236]: pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail 2024-09-10T22:21:27.208 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:21:27 smithi019 ceph-mon[31375]: from='osd.6 [v2:172.21.15.19:6818/406328354,v1:172.21.15.19:6819/406328354]' entity='osd.6' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]} : dispatch 2024-09-10T22:21:27.315 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:21:27 smithi135 ceph-mon[34789]: from='osd.6 [v2:172.21.15.19:6818/406328354,v1:172.21.15.19:6819/406328354]' entity='osd.6' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]} : dispatch 2024-09-10T22:21:27.375 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:21:27 smithi138 ceph-mon[35236]: from='osd.6 [v2:172.21.15.19:6818/406328354,v1:172.21.15.19:6819/406328354]' entity='osd.6' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]} : dispatch 2024-09-10T22:21:27.644 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-09-10T22:21:27.674 DEBUG:teuthology.orchestra.run.smithi135:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 22997a4c-6fc2-11ef-bcea-c7b262605968 -- ceph orch daemon add osd smithi135:vg_nvme/lv_2 2024-09-10T22:21:27.928 INFO:teuthology.orchestra.run.smithi135.stderr:Inferring config /var/lib/ceph/22997a4c-6fc2-11ef-bcea-c7b262605968/mon.b/config 2024-09-10T22:21:28.304 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:21:28 smithi135 ceph-mon[34789]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail 2024-09-10T22:21:28.304 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:21:28 smithi135 ceph-mon[34789]: from='osd.6 [v2:172.21.15.19:6818/406328354,v1:172.21.15.19:6819/406328354]' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-09-10T22:21:28.304 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:21:28 smithi135 ceph-mon[34789]: osdmap e38: 7 total, 6 up, 7 in 2024-09-10T22:21:28.304 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:21:28 smithi135 ceph-mon[34789]: from='osd.6 [v2:172.21.15.19:6818/406328354,v1:172.21.15.19:6819/406328354]' entity='osd.6' cmd={"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi019", "root=default"]} : dispatch 2024-09-10T22:21:28.304 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:21:28 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-10T22:21:28.304 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:21:28 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:21:28.305 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:21:28 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:21:28.305 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:21:28 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-10T22:21:28.305 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:21:28 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-09-10T22:21:28.305 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:21:28 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2024-09-10T22:21:28.305 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:21:28 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:21:28.305 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:21:28 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T22:21:28.305 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:21:28 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T22:21:28.305 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:21:28 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:21:28.375 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:21:28 smithi138 ceph-mon[35236]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail 2024-09-10T22:21:28.375 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:21:28 smithi138 ceph-mon[35236]: from='osd.6 [v2:172.21.15.19:6818/406328354,v1:172.21.15.19:6819/406328354]' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-09-10T22:21:28.375 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:21:28 smithi138 ceph-mon[35236]: osdmap e38: 7 total, 6 up, 7 in 2024-09-10T22:21:28.375 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:21:28 smithi138 ceph-mon[35236]: from='osd.6 [v2:172.21.15.19:6818/406328354,v1:172.21.15.19:6819/406328354]' entity='osd.6' cmd={"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi019", "root=default"]} : dispatch 2024-09-10T22:21:28.375 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:21:28 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-10T22:21:28.376 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:21:28 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:21:28.376 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:21:28 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:21:28.376 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:21:28 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-10T22:21:28.376 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:21:28 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-09-10T22:21:28.376 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:21:28 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2024-09-10T22:21:28.376 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:21:28 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:21:28.376 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:21:28 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T22:21:28.376 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:21:28 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T22:21:28.376 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:21:28 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:21:28.398 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T22:21:28.396+0000 7f47e259d640 1 -- 172.21.15.135:0/2330128110 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f47dc102a20 msgr2=0x7f47dc102e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:21:28.399 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T22:21:28.396+0000 7f47e259d640 1 --2- 172.21.15.135:0/2330128110 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f47dc102a20 0x7f47dc102e20 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f47cc009930 tx=0x7f47cc02a420 comp rx=0 tx=0).stop 2024-09-10T22:21:28.399 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T22:21:28.397+0000 7f47e259d640 1 -- 172.21.15.135:0/2330128110 shutdown_connections 2024-09-10T22:21:28.399 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T22:21:28.397+0000 7f47e259d640 1 --2- 172.21.15.135:0/2330128110 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f47dc104540 0x7f47dc10aec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:21:28.399 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T22:21:28.397+0000 7f47e259d640 1 --2- 172.21.15.135:0/2330128110 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f47dc103b80 0x7f47dc104000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:21:28.399 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T22:21:28.397+0000 7f47e259d640 1 --2- 172.21.15.135:0/2330128110 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f47dc102a20 0x7f47dc102e20 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:21:28.399 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T22:21:28.397+0000 7f47e259d640 1 -- 172.21.15.135:0/2330128110 >> 172.21.15.135:0/2330128110 conn(0x7f47dc0fe2f0 msgr2=0x7f47dc100730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:21:28.399 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T22:21:28.397+0000 7f47e259d640 1 -- 172.21.15.135:0/2330128110 shutdown_connections 2024-09-10T22:21:28.399 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T22:21:28.397+0000 7f47e259d640 1 -- 172.21.15.135:0/2330128110 wait complete. 2024-09-10T22:21:28.399 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T22:21:28.397+0000 7f47e259d640 1 Processor -- start 2024-09-10T22:21:28.400 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T22:21:28.397+0000 7f47e259d640 1 -- start start 2024-09-10T22:21:28.401 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T22:21:28.398+0000 7f47e259d640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f47dc102a20 0x7f47dc076cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:21:28.401 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T22:21:28.398+0000 7f47e259d640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f47dc103b80 0x7f47dc075540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:21:28.402 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T22:21:28.398+0000 7f47e259d640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f47dc104540 0x7f47dc075a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:21:28.402 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T22:21:28.398+0000 7f47e259d640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f47dc10e6a0 con 0x7f47dc102a20 2024-09-10T22:21:28.402 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T22:21:28.398+0000 7f47e259d640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f47dc10e520 con 0x7f47dc104540 2024-09-10T22:21:28.402 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T22:21:28.398+0000 7f47e259d640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f47dc10e820 con 0x7f47dc103b80 2024-09-10T22:21:28.402 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T22:21:28.398+0000 7f47e0b3a640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f47dc104540 0x7f47dc075a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:21:28.402 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T22:21:28.398+0000 7f47e0b3a640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f47dc104540 0x7f47dc075a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:44652/0 (socket says 172.21.15.135:44652) 2024-09-10T22:21:28.402 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T22:21:28.398+0000 7f47e0b3a640 1 -- 172.21.15.135:0/4248096306 learned_addr learned my addr 172.21.15.135:0/4248096306 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-09-10T22:21:28.402 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T22:21:28.398+0000 7f47db7fe640 1 --2- 172.21.15.135:0/4248096306 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f47dc103b80 0x7f47dc075540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:21:28.402 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T22:21:28.398+0000 7f47dbfff640 1 --2- 172.21.15.135:0/4248096306 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f47dc102a20 0x7f47dc076cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:21:28.402 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T22:21:28.398+0000 7f47e0b3a640 1 -- 172.21.15.135:0/4248096306 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f47dc103b80 msgr2=0x7f47dc075540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:21:28.402 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T22:21:28.398+0000 7f47e0b3a640 1 --2- 172.21.15.135:0/4248096306 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f47dc103b80 0x7f47dc075540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:21:28.402 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T22:21:28.398+0000 7f47e0b3a640 1 -- 172.21.15.135:0/4248096306 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f47dc102a20 msgr2=0x7f47dc076cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:21:28.403 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T22:21:28.398+0000 7f47e0b3a640 1 --2- 172.21.15.135:0/4248096306 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f47dc102a20 0x7f47dc076cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:21:28.403 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T22:21:28.398+0000 7f47e0b3a640 1 -- 172.21.15.135:0/4248096306 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f47dc076340 con 0x7f47dc104540 2024-09-10T22:21:28.403 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T22:21:28.398+0000 7f47e0b3a640 1 --2- 172.21.15.135:0/4248096306 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f47dc104540 0x7f47dc075a80 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f47d400eaa0 tx=0x7f47d400ef60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:21:28.403 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T22:21:28.398+0000 7f47d97fa640 1 -- 172.21.15.135:0/4248096306 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47d400cdb0 con 0x7f47dc104540 2024-09-10T22:21:28.403 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T22:21:28.398+0000 7f47d97fa640 1 -- 172.21.15.135:0/4248096306 <== mon.2 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f47d4005020 con 0x7f47dc104540 2024-09-10T22:21:28.403 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T22:21:28.398+0000 7f47d97fa640 1 -- 172.21.15.135:0/4248096306 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47d40116d0 con 0x7f47dc104540 2024-09-10T22:21:28.403 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T22:21:28.398+0000 7f47e259d640 1 -- 172.21.15.135:0/4248096306 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f47dc1a2f40 con 0x7f47dc104540 2024-09-10T22:21:28.403 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T22:21:28.398+0000 7f47e259d640 1 -- 172.21.15.135:0/4248096306 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f47dc1a33a0 con 0x7f47dc104540 2024-09-10T22:21:28.403 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T22:21:28.400+0000 7f47e259d640 1 -- 172.21.15.135:0/4248096306 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f47dc109da0 con 0x7f47dc104540 2024-09-10T22:21:28.404 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T22:21:28.401+0000 7f47d97fa640 1 -- 172.21.15.135:0/4248096306 <== mon.2 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 16) ==== 153250+0+0 (secure 0 0 0) 0x7f47d400f040 con 0x7f47dc104540 2024-09-10T22:21:28.404 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T22:21:28.402+0000 7f47d97fa640 1 --2- 172.21.15.135:0/4248096306 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f47c40b52e0 0x7f47c40b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:21:28.404 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T22:21:28.402+0000 7f47d97fa640 1 -- 172.21.15.135:0/4248096306 <== mon.2 v2:172.21.15.135:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 4685+0+0 (secure 0 0 0) 0x7f47d40e4fc0 con 0x7f47dc104540 2024-09-10T22:21:28.404 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T22:21:28.402+0000 7f47dbfff640 1 --2- 172.21.15.135:0/4248096306 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f47c40b52e0 0x7f47c40b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:21:28.405 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T22:21:28.402+0000 7f47dbfff640 1 --2- 172.21.15.135:0/4248096306 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f47c40b52e0 0x7f47c40b77a0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f47cc006010 tx=0x7f47cc031430 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:21:28.406 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T22:21:28.405+0000 7f47d97fa640 1 -- 172.21.15.135:0/4248096306 <== mon.2 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f47d4016030 con 0x7f47dc104540 2024-09-10T22:21:28.458 INFO:journalctl@ceph.osd.6.smithi019.stdout:Sep 10 22:21:28 smithi019 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-6[61536]: 2024-09-10T22:21:28.038+0000 7fbed2589640 -1 osd.6 0 waiting for initial osdmap 2024-09-10T22:21:28.458 INFO:journalctl@ceph.osd.6.smithi019.stdout:Sep 10 22:21:28 smithi019 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-6[61536]: 2024-09-10T22:21:28.049+0000 7fbece3b0640 -1 osd.6 39 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-10T22:21:28.459 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:21:28 smithi019 ceph-mon[31375]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail 2024-09-10T22:21:28.459 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:21:28 smithi019 ceph-mon[31375]: from='osd.6 [v2:172.21.15.19:6818/406328354,v1:172.21.15.19:6819/406328354]' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-09-10T22:21:28.459 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:21:28 smithi019 ceph-mon[31375]: osdmap e38: 7 total, 6 up, 7 in 2024-09-10T22:21:28.459 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:21:28 smithi019 ceph-mon[31375]: from='osd.6 [v2:172.21.15.19:6818/406328354,v1:172.21.15.19:6819/406328354]' entity='osd.6' cmd={"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi019", "root=default"]} : dispatch 2024-09-10T22:21:28.459 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:21:28 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-10T22:21:28.459 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:21:28 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:21:28.459 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:21:28 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:21:28.459 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:21:28 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-10T22:21:28.459 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:21:28 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-09-10T22:21:28.460 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:21:28 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2024-09-10T22:21:28.460 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:21:28 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:21:28.460 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:21:28 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T22:21:28.460 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:21:28 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T22:21:28.460 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:21:28 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:21:28.593 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T22:21:28.591+0000 7f47e259d640 1 -- 172.21.15.135:0/4248096306 --> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi135:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) -- 0x7f47dc063590 con 0x7f47c40b52e0 2024-09-10T22:21:29.291 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:21:29 smithi135 ceph-mon[34789]: Detected new or changed devices on smithi019 2024-09-10T22:21:29.291 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:21:29 smithi135 ceph-mon[34789]: Adjusting osd_memory_target on smithi019 to 5697M 2024-09-10T22:21:29.292 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:21:29 smithi135 ceph-mon[34789]: from='osd.6 [v2:172.21.15.19:6818/406328354,v1:172.21.15.19:6819/406328354]' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi019", "root=default"]}]': finished 2024-09-10T22:21:29.292 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:21:29 smithi135 ceph-mon[34789]: osdmap e39: 7 total, 6 up, 7 in 2024-09-10T22:21:29.292 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:21:29 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-10T22:21:29.292 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:21:29 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-10T22:21:29.292 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:21:29 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-10T22:21:29.292 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:21:29 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-10T22:21:29.292 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:21:29 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T22:21:29.292 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:21:29 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-10T22:21:29.375 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:21:29 smithi138 ceph-mon[35236]: Detected new or changed devices on smithi019 2024-09-10T22:21:29.375 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:21:29 smithi138 ceph-mon[35236]: Adjusting osd_memory_target on smithi019 to 5697M 2024-09-10T22:21:29.375 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:21:29 smithi138 ceph-mon[35236]: from='osd.6 [v2:172.21.15.19:6818/406328354,v1:172.21.15.19:6819/406328354]' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi019", "root=default"]}]': finished 2024-09-10T22:21:29.375 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:21:29 smithi138 ceph-mon[35236]: osdmap e39: 7 total, 6 up, 7 in 2024-09-10T22:21:29.375 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:21:29 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-10T22:21:29.375 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:21:29 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-10T22:21:29.375 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:21:29 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-10T22:21:29.375 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:21:29 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-10T22:21:29.376 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:21:29 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T22:21:29.376 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:21:29 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-10T22:21:29.458 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:21:29 smithi019 ceph-mon[31375]: Detected new or changed devices on smithi019 2024-09-10T22:21:29.458 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:21:29 smithi019 ceph-mon[31375]: Adjusting osd_memory_target on smithi019 to 5697M 2024-09-10T22:21:29.458 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:21:29 smithi019 ceph-mon[31375]: from='osd.6 [v2:172.21.15.19:6818/406328354,v1:172.21.15.19:6819/406328354]' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi019", "root=default"]}]': finished 2024-09-10T22:21:29.459 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:21:29 smithi019 ceph-mon[31375]: osdmap e39: 7 total, 6 up, 7 in 2024-09-10T22:21:29.459 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:21:29 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-10T22:21:29.459 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:21:29 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-10T22:21:29.459 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:21:29 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-10T22:21:29.459 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:21:29 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-10T22:21:29.459 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:21:29 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T22:21:29.459 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:21:29 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-10T22:21:30.220 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:21:30 smithi135 ceph-mon[34789]: purged_snaps scrub starts 2024-09-10T22:21:30.221 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:21:30 smithi135 ceph-mon[34789]: purged_snaps scrub ok 2024-09-10T22:21:30.221 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:21:30 smithi135 ceph-mon[34789]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail 2024-09-10T22:21:30.221 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:21:30 smithi135 ceph-mon[34789]: from='client.24377 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi135:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T22:21:30.221 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:21:30 smithi135 ceph-mon[34789]: osd.6 [v2:172.21.15.19:6818/406328354,v1:172.21.15.19:6819/406328354] boot 2024-09-10T22:21:30.221 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:21:30 smithi135 ceph-mon[34789]: osdmap e40: 7 total, 7 up, 7 in 2024-09-10T22:21:30.221 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:21:30 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-10T22:21:30.375 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:21:30 smithi138 ceph-mon[35236]: purged_snaps scrub starts 2024-09-10T22:21:30.375 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:21:30 smithi138 ceph-mon[35236]: purged_snaps scrub ok 2024-09-10T22:21:30.375 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:21:30 smithi138 ceph-mon[35236]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail 2024-09-10T22:21:30.375 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:21:30 smithi138 ceph-mon[35236]: from='client.24377 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi135:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T22:21:30.376 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:21:30 smithi138 ceph-mon[35236]: osd.6 [v2:172.21.15.19:6818/406328354,v1:172.21.15.19:6819/406328354] boot 2024-09-10T22:21:30.376 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:21:30 smithi138 ceph-mon[35236]: osdmap e40: 7 total, 7 up, 7 in 2024-09-10T22:21:30.376 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:21:30 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-10T22:21:30.458 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:21:30 smithi019 ceph-mon[31375]: purged_snaps scrub starts 2024-09-10T22:21:30.458 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:21:30 smithi019 ceph-mon[31375]: purged_snaps scrub ok 2024-09-10T22:21:30.458 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:21:30 smithi019 ceph-mon[31375]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail 2024-09-10T22:21:30.458 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:21:30 smithi019 ceph-mon[31375]: from='client.24377 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi135:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T22:21:30.459 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:21:30 smithi019 ceph-mon[31375]: osd.6 [v2:172.21.15.19:6818/406328354,v1:172.21.15.19:6819/406328354] boot 2024-09-10T22:21:30.459 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:21:30 smithi019 ceph-mon[31375]: osdmap e40: 7 total, 7 up, 7 in 2024-09-10T22:21:30.459 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:21:30 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-10T22:21:31.360 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:21:31 smithi135 ceph-mon[34789]: osdmap e41: 7 total, 7 up, 7 in 2024-09-10T22:21:31.360 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:21:31 smithi135 ceph-mon[34789]: from='client.? 172.21.15.135:0/3091584378' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "cc76476a-92f3-489c-be9e-29cbbf39539e"} : dispatch 2024-09-10T22:21:31.360 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:21:31 smithi135 ceph-mon[34789]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "cc76476a-92f3-489c-be9e-29cbbf39539e"} : dispatch 2024-09-10T22:21:31.360 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:21:31 smithi135 ceph-mon[34789]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "cc76476a-92f3-489c-be9e-29cbbf39539e"}]': finished 2024-09-10T22:21:31.360 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:21:31 smithi135 ceph-mon[34789]: osdmap e42: 8 total, 7 up, 8 in 2024-09-10T22:21:31.360 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:21:31 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-10T22:21:31.375 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:21:31 smithi138 ceph-mon[35236]: osdmap e41: 7 total, 7 up, 7 in 2024-09-10T22:21:31.375 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:21:31 smithi138 ceph-mon[35236]: from='client.? 172.21.15.135:0/3091584378' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "cc76476a-92f3-489c-be9e-29cbbf39539e"} : dispatch 2024-09-10T22:21:31.375 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:21:31 smithi138 ceph-mon[35236]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "cc76476a-92f3-489c-be9e-29cbbf39539e"} : dispatch 2024-09-10T22:21:31.375 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:21:31 smithi138 ceph-mon[35236]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "cc76476a-92f3-489c-be9e-29cbbf39539e"}]': finished 2024-09-10T22:21:31.375 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:21:31 smithi138 ceph-mon[35236]: osdmap e42: 8 total, 7 up, 8 in 2024-09-10T22:21:31.375 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:21:31 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-10T22:21:31.458 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:21:31 smithi019 ceph-mon[31375]: osdmap e41: 7 total, 7 up, 7 in 2024-09-10T22:21:31.458 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:21:31 smithi019 ceph-mon[31375]: from='client.? 172.21.15.135:0/3091584378' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "cc76476a-92f3-489c-be9e-29cbbf39539e"} : dispatch 2024-09-10T22:21:31.459 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:21:31 smithi019 ceph-mon[31375]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "cc76476a-92f3-489c-be9e-29cbbf39539e"} : dispatch 2024-09-10T22:21:31.459 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:21:31 smithi019 ceph-mon[31375]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "cc76476a-92f3-489c-be9e-29cbbf39539e"}]': finished 2024-09-10T22:21:31.459 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:21:31 smithi019 ceph-mon[31375]: osdmap e42: 8 total, 7 up, 8 in 2024-09-10T22:21:31.459 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:21:31 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-10T22:21:32.360 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:21:32 smithi135 ceph-mon[34789]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 209 MiB used, 626 GiB / 626 GiB avail 2024-09-10T22:21:32.360 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:21:32 smithi135 ceph-mon[34789]: from='client.? 172.21.15.135:0/7881618' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-10T22:21:32.375 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:21:32 smithi138 ceph-mon[35236]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 209 MiB used, 626 GiB / 626 GiB avail 2024-09-10T22:21:32.375 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:21:32 smithi138 ceph-mon[35236]: from='client.? 172.21.15.135:0/7881618' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-10T22:21:32.458 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:21:32 smithi019 ceph-mon[31375]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 209 MiB used, 626 GiB / 626 GiB avail 2024-09-10T22:21:32.458 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:21:32 smithi019 ceph-mon[31375]: from='client.? 172.21.15.135:0/7881618' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-10T22:21:34.359 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:21:34 smithi135 ceph-mon[34789]: pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 209 MiB used, 626 GiB / 626 GiB avail 2024-09-10T22:21:34.407 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:21:34 smithi138 ceph-mon[35236]: pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 209 MiB used, 626 GiB / 626 GiB avail 2024-09-10T22:21:34.458 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:21:34 smithi019 ceph-mon[31375]: pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 209 MiB used, 626 GiB / 626 GiB avail 2024-09-10T22:21:36.339 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:21:36 smithi135 ceph-mon[34789]: pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 209 MiB used, 626 GiB / 626 GiB avail 2024-09-10T22:21:36.374 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:21:36 smithi138 ceph-mon[35236]: pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 209 MiB used, 626 GiB / 626 GiB avail 2024-09-10T22:21:36.458 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:21:36 smithi019 ceph-mon[31375]: pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 209 MiB used, 626 GiB / 626 GiB avail 2024-09-10T22:21:38.360 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:21:38 smithi135 ceph-mon[34789]: pgmap v168: 1 pgs: 1 active+clean; 577 KiB data, 209 MiB used, 626 GiB / 626 GiB avail 2024-09-10T22:21:38.374 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:21:38 smithi138 ceph-mon[35236]: pgmap v168: 1 pgs: 1 active+clean; 577 KiB data, 209 MiB used, 626 GiB / 626 GiB avail 2024-09-10T22:21:38.458 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:21:38 smithi019 ceph-mon[31375]: pgmap v168: 1 pgs: 1 active+clean; 577 KiB data, 209 MiB used, 626 GiB / 626 GiB avail 2024-09-10T22:21:40.294 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:21:40 smithi135 ceph-mon[34789]: pgmap v169: 1 pgs: 1 active+clean; 577 KiB data, 209 MiB used, 626 GiB / 626 GiB avail 2024-09-10T22:21:40.294 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:21:40 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.7"} : dispatch 2024-09-10T22:21:40.294 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:21:40 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T22:21:40.375 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:21:40 smithi138 ceph-mon[35236]: pgmap v169: 1 pgs: 1 active+clean; 577 KiB data, 209 MiB used, 626 GiB / 626 GiB avail 2024-09-10T22:21:40.375 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:21:40 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.7"} : dispatch 2024-09-10T22:21:40.375 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:21:40 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T22:21:40.458 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:21:40 smithi019 ceph-mon[31375]: pgmap v169: 1 pgs: 1 active+clean; 577 KiB data, 209 MiB used, 626 GiB / 626 GiB avail 2024-09-10T22:21:40.458 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:21:40 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.7"} : dispatch 2024-09-10T22:21:40.458 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:21:40 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T22:21:41.360 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:21:41 smithi135 ceph-mon[34789]: Deploying daemon osd.7 on smithi135 2024-09-10T22:21:41.374 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:21:41 smithi138 ceph-mon[35236]: Deploying daemon osd.7 on smithi135 2024-09-10T22:21:41.458 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:21:41 smithi019 ceph-mon[31375]: Deploying daemon osd.7 on smithi135 2024-09-10T22:21:42.310 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:21:42 smithi135 ceph-mon[34789]: pgmap v170: 1 pgs: 1 active+clean; 577 KiB data, 209 MiB used, 626 GiB / 626 GiB avail 2024-09-10T22:21:42.374 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:21:42 smithi138 ceph-mon[35236]: pgmap v170: 1 pgs: 1 active+clean; 577 KiB data, 209 MiB used, 626 GiB / 626 GiB avail 2024-09-10T22:21:42.458 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:21:42 smithi019 ceph-mon[31375]: pgmap v170: 1 pgs: 1 active+clean; 577 KiB data, 209 MiB used, 626 GiB / 626 GiB avail 2024-09-10T22:21:43.359 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:21:43 smithi135 ceph-mon[34789]: pgmap v171: 1 pgs: 1 active+clean; 577 KiB data, 209 MiB used, 626 GiB / 626 GiB avail 2024-09-10T22:21:43.375 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:21:43 smithi138 ceph-mon[35236]: pgmap v171: 1 pgs: 1 active+clean; 577 KiB data, 209 MiB used, 626 GiB / 626 GiB avail 2024-09-10T22:21:43.458 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:21:43 smithi019 ceph-mon[31375]: pgmap v171: 1 pgs: 1 active+clean; 577 KiB data, 209 MiB used, 626 GiB / 626 GiB avail 2024-09-10T22:21:45.680 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:21:45 smithi135 ceph-mon[34789]: pgmap v172: 1 pgs: 1 active+clean; 577 KiB data, 209 MiB used, 626 GiB / 626 GiB avail 2024-09-10T22:21:45.680 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:21:45 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T22:21:45.680 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:21:45 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:21:45.680 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:21:45 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:21:45.708 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:21:45 smithi019 ceph-mon[31375]: pgmap v172: 1 pgs: 1 active+clean; 577 KiB data, 209 MiB used, 626 GiB / 626 GiB avail 2024-09-10T22:21:45.708 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:21:45 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T22:21:45.708 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:21:45 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:21:45.708 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:21:45 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:21:45.875 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:21:45 smithi138 ceph-mon[35236]: pgmap v172: 1 pgs: 1 active+clean; 577 KiB data, 209 MiB used, 626 GiB / 626 GiB avail 2024-09-10T22:21:45.875 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:21:45 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T22:21:45.875 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:21:45 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:21:45.875 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:21:45 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:21:47.645 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:21:47 smithi019 ceph-mon[31375]: pgmap v173: 1 pgs: 1 active+clean; 577 KiB data, 209 MiB used, 626 GiB / 626 GiB avail 2024-09-10T22:21:47.646 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:21:47 smithi135 ceph-mon[34789]: pgmap v173: 1 pgs: 1 active+clean; 577 KiB data, 209 MiB used, 626 GiB / 626 GiB avail 2024-09-10T22:21:47.875 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:21:47 smithi138 ceph-mon[35236]: pgmap v173: 1 pgs: 1 active+clean; 577 KiB data, 209 MiB used, 626 GiB / 626 GiB avail 2024-09-10T22:21:48.883 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T22:21:48.882+0000 7f47d97fa640 1 -- 172.21.15.135:0/4248096306 <== mgr.14150 v2:172.21.15.19:6800/2119495487 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f47dc063590 con 0x7f47c40b52e0 2024-09-10T22:21:48.884 INFO:teuthology.orchestra.run.smithi135.stdout:Created osd(s) 7 on host 'smithi135' 2024-09-10T22:21:48.886 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T22:21:48.884+0000 7f47e259d640 1 -- 172.21.15.135:0/4248096306 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f47c40b52e0 msgr2=0x7f47c40b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:21:48.886 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T22:21:48.884+0000 7f47e259d640 1 --2- 172.21.15.135:0/4248096306 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f47c40b52e0 0x7f47c40b77a0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f47cc006010 tx=0x7f47cc031430 comp rx=0 tx=0).stop 2024-09-10T22:21:48.886 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T22:21:48.885+0000 7f47e259d640 1 -- 172.21.15.135:0/4248096306 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f47dc104540 msgr2=0x7f47dc075a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:21:48.886 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T22:21:48.885+0000 7f47e259d640 1 --2- 172.21.15.135:0/4248096306 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f47dc104540 0x7f47dc075a80 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f47d400eaa0 tx=0x7f47d400ef60 comp rx=0 tx=0).stop 2024-09-10T22:21:48.886 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T22:21:48.885+0000 7f47e259d640 1 -- 172.21.15.135:0/4248096306 shutdown_connections 2024-09-10T22:21:48.886 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T22:21:48.885+0000 7f47e259d640 1 --2- 172.21.15.135:0/4248096306 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f47c40b52e0 0x7f47c40b77a0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:21:48.886 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T22:21:48.885+0000 7f47e259d640 1 --2- 172.21.15.135:0/4248096306 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f47dc104540 0x7f47dc075a80 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:21:48.887 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T22:21:48.885+0000 7f47e259d640 1 --2- 172.21.15.135:0/4248096306 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f47dc103b80 0x7f47dc075540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:21:48.887 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T22:21:48.885+0000 7f47e259d640 1 --2- 172.21.15.135:0/4248096306 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f47dc102a20 0x7f47dc076cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:21:48.887 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T22:21:48.885+0000 7f47e259d640 1 -- 172.21.15.135:0/4248096306 >> 172.21.15.135:0/4248096306 conn(0x7f47dc0fe2f0 msgr2=0x7f47dc106f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:21:48.887 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T22:21:48.885+0000 7f47e259d640 1 -- 172.21.15.135:0/4248096306 shutdown_connections 2024-09-10T22:21:48.887 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T22:21:48.885+0000 7f47e259d640 1 -- 172.21.15.135:0/4248096306 wait complete. 2024-09-10T22:21:49.109 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:21:48 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:21:49.110 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:21:48 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:21:49.110 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:21:48 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T22:21:49.110 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:21:48 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T22:21:49.110 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:21:48 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:21:49.125 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:21:48 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:21:49.125 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:21:48 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:21:49.125 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:21:48 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T22:21:49.125 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:21:48 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T22:21:49.125 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:21:48 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:21:49.208 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:21:48 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:21:49.209 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:21:48 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:21:49.209 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:21:48 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T22:21:49.209 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:21:48 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T22:21:49.209 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:21:48 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:21:49.591 DEBUG:teuthology.orchestra.run.smithi135:osd.7> sudo journalctl -f -n 0 -u ceph-22997a4c-6fc2-11ef-bcea-c7b262605968@osd.7.service 2024-09-10T22:21:49.594 INFO:tasks.cephadm:Deploying osd.8 on smithi138 with /dev/vg_nvme/lv_2... 2024-09-10T22:21:49.594 DEBUG:teuthology.orchestra.run.smithi138:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 22997a4c-6fc2-11ef-bcea-c7b262605968 -- lvm zap /dev/vg_nvme/lv_2 2024-09-10T22:21:49.850 INFO:teuthology.orchestra.run.smithi138.stderr:Inferring config /var/lib/ceph/22997a4c-6fc2-11ef-bcea-c7b262605968/mon.c/config 2024-09-10T22:21:49.875 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:21:49 smithi138 ceph-mon[35236]: pgmap v174: 1 pgs: 1 active+clean; 577 KiB data, 209 MiB used, 626 GiB / 626 GiB avail 2024-09-10T22:21:49.875 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:21:49 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T22:21:49.875 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:21:49 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:21:49.875 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:21:49 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:21:50.110 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:21:49 smithi135 ceph-mon[34789]: pgmap v174: 1 pgs: 1 active+clean; 577 KiB data, 209 MiB used, 626 GiB / 626 GiB avail 2024-09-10T22:21:50.110 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:21:49 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T22:21:50.110 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:21:49 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:21:50.110 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:21:49 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:21:50.208 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:21:49 smithi019 ceph-mon[31375]: pgmap v174: 1 pgs: 1 active+clean; 577 KiB data, 209 MiB used, 626 GiB / 626 GiB avail 2024-09-10T22:21:50.208 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:21:49 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T22:21:50.208 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:21:49 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:21:50.209 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:21:49 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:21:51.285 INFO:journalctl@ceph.osd.7.smithi135.stdout:Sep 10 22:21:51 smithi135 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-7[53144]: 2024-09-10T22:21:51.138+0000 7ff63bb23640 -1 osd.7 0 log_to_monitors true 2024-09-10T22:21:52.014 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:21:51 smithi135 ceph-mon[34789]: pgmap v175: 1 pgs: 1 active+clean; 577 KiB data, 209 MiB used, 626 GiB / 626 GiB avail 2024-09-10T22:21:52.014 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:21:51 smithi135 ceph-mon[34789]: from='osd.7 [v2:172.21.15.135:6816/1096613674,v1:172.21.15.135:6817/1096613674]' entity='osd.7' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]} : dispatch 2024-09-10T22:21:52.014 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:21:51 smithi135 ceph-mon[34789]: from='osd.7 ' entity='osd.7' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]} : dispatch 2024-09-10T22:21:52.125 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:21:51 smithi138 ceph-mon[35236]: pgmap v175: 1 pgs: 1 active+clean; 577 KiB data, 209 MiB used, 626 GiB / 626 GiB avail 2024-09-10T22:21:52.125 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:21:51 smithi138 ceph-mon[35236]: from='osd.7 [v2:172.21.15.135:6816/1096613674,v1:172.21.15.135:6817/1096613674]' entity='osd.7' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]} : dispatch 2024-09-10T22:21:52.125 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:21:51 smithi138 ceph-mon[35236]: from='osd.7 ' entity='osd.7' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]} : dispatch 2024-09-10T22:21:52.168 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-10T22:21:52.193 DEBUG:teuthology.orchestra.run.smithi138:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 22997a4c-6fc2-11ef-bcea-c7b262605968 -- ceph orch daemon add osd smithi138:vg_nvme/lv_2 2024-09-10T22:21:52.208 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:21:51 smithi019 ceph-mon[31375]: pgmap v175: 1 pgs: 1 active+clean; 577 KiB data, 209 MiB used, 626 GiB / 626 GiB avail 2024-09-10T22:21:52.208 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:21:51 smithi019 ceph-mon[31375]: from='osd.7 [v2:172.21.15.135:6816/1096613674,v1:172.21.15.135:6817/1096613674]' entity='osd.7' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]} : dispatch 2024-09-10T22:21:52.208 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:21:51 smithi019 ceph-mon[31375]: from='osd.7 ' entity='osd.7' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]} : dispatch 2024-09-10T22:21:52.448 INFO:teuthology.orchestra.run.smithi138.stderr:Inferring config /var/lib/ceph/22997a4c-6fc2-11ef-bcea-c7b262605968/mon.c/config 2024-09-10T22:21:52.876 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-10T22:21:52.872+0000 7f8691c71640 1 -- 172.21.15.138:0/855002412 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f868c108760 msgr2=0x7f868c10ac20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:21:52.876 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-10T22:21:52.872+0000 7f8691c71640 1 --2- 172.21.15.138:0/855002412 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f868c108760 0x7f868c10ac20 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f8684009ca0 tx=0x7f868402a8c0 comp rx=0 tx=0).stop 2024-09-10T22:21:52.876 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-10T22:21:52.873+0000 7f8691c71640 1 -- 172.21.15.138:0/855002412 shutdown_connections 2024-09-10T22:21:52.877 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-10T22:21:52.873+0000 7f8691c71640 1 --2- 172.21.15.138:0/855002412 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f868c108760 0x7f868c10ac20 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:21:52.877 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-10T22:21:52.873+0000 7f8691c71640 1 --2- 172.21.15.138:0/855002412 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f868c105bb0 0x7f868c108020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:21:52.877 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-10T22:21:52.873+0000 7f8691c71640 1 --2- 172.21.15.138:0/855002412 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f868c06bf00 0x7f868c105620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:21:52.877 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-10T22:21:52.873+0000 7f8691c71640 1 -- 172.21.15.138:0/855002412 >> 172.21.15.138:0/855002412 conn(0x7f868c0fd210 msgr2=0x7f868c0ff650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:21:52.877 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-10T22:21:52.873+0000 7f8691c71640 1 -- 172.21.15.138:0/855002412 shutdown_connections 2024-09-10T22:21:52.877 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-10T22:21:52.873+0000 7f8691c71640 1 -- 172.21.15.138:0/855002412 wait complete. 2024-09-10T22:21:52.877 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-10T22:21:52.873+0000 7f8691c71640 1 Processor -- start 2024-09-10T22:21:52.877 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-10T22:21:52.873+0000 7f8691c71640 1 -- start start 2024-09-10T22:21:52.877 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-10T22:21:52.874+0000 7f8691c71640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f868c06bf00 0x7f868c198d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:21:52.877 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-10T22:21:52.874+0000 7f8691c71640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f868c105bb0 0x7f868c199390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:21:52.877 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-10T22:21:52.874+0000 7f8691c71640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f868c108760 0x7f868c199fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:21:52.878 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-10T22:21:52.874+0000 7f8691c71640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f868c10e6b0 con 0x7f868c06bf00 2024-09-10T22:21:52.878 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-10T22:21:52.874+0000 7f8691c71640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f868c10e530 con 0x7f868c105bb0 2024-09-10T22:21:52.878 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-10T22:21:52.874+0000 7f8691c71640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f868c10e830 con 0x7f868c108760 2024-09-10T22:21:52.878 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-10T22:21:52.874+0000 7f868bfff640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f868c108760 0x7f868c199fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:21:52.878 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-10T22:21:52.874+0000 7f868bfff640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f868c108760 0x7f868c199fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:59388/0 (socket says 172.21.15.138:59388) 2024-09-10T22:21:52.878 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-10T22:21:52.874+0000 7f868affd640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f868c105bb0 0x7f868c199390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:21:52.878 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-10T22:21:52.874+0000 7f868bfff640 1 -- 172.21.15.138:0/3093959842 learned_addr learned my addr 172.21.15.138:0/3093959842 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-09-10T22:21:52.878 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-10T22:21:52.874+0000 7f868b7fe640 1 --2- 172.21.15.138:0/3093959842 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f868c06bf00 0x7f868c198d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:21:52.878 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-10T22:21:52.874+0000 7f868bfff640 1 -- 172.21.15.138:0/3093959842 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f868c105bb0 msgr2=0x7f868c199390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:21:52.878 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-10T22:21:52.874+0000 7f868bfff640 1 --2- 172.21.15.138:0/3093959842 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f868c105bb0 0x7f868c199390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:21:52.878 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-10T22:21:52.874+0000 7f868bfff640 1 -- 172.21.15.138:0/3093959842 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f868c06bf00 msgr2=0x7f868c198d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:21:52.878 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-10T22:21:52.874+0000 7f868bfff640 1 --2- 172.21.15.138:0/3093959842 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f868c06bf00 0x7f868c198d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:21:52.879 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-10T22:21:52.874+0000 7f868bfff640 1 -- 172.21.15.138:0/3093959842 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f868c19a870 con 0x7f868c108760 2024-09-10T22:21:52.879 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-10T22:21:52.874+0000 7f868affd640 1 --2- 172.21.15.138:0/3093959842 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f868c105bb0 0x7f868c199390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T22:21:52.879 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-10T22:21:52.874+0000 7f868bfff640 1 --2- 172.21.15.138:0/3093959842 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f868c108760 0x7f868c199fd0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f86840097b0 tx=0x7f8684031770 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:21:52.879 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-10T22:21:52.874+0000 7f8688ff9640 1 -- 172.21.15.138:0/3093959842 <== mon.1 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8684003b70 con 0x7f868c108760 2024-09-10T22:21:52.879 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-10T22:21:52.874+0000 7f8688ff9640 1 -- 172.21.15.138:0/3093959842 <== mon.1 v2:172.21.15.138:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8684003d10 con 0x7f868c108760 2024-09-10T22:21:52.879 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-10T22:21:52.875+0000 7f8691c71640 1 -- 172.21.15.138:0/3093959842 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f868c19ab00 con 0x7f868c108760 2024-09-10T22:21:52.879 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-10T22:21:52.875+0000 7f8688ff9640 1 -- 172.21.15.138:0/3093959842 <== mon.1 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f868402fc10 con 0x7f868c108760 2024-09-10T22:21:52.879 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-10T22:21:52.875+0000 7f8691c71640 1 -- 172.21.15.138:0/3093959842 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f868c1a1240 con 0x7f868c108760 2024-09-10T22:21:52.880 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-10T22:21:52.876+0000 7f8691c71640 1 -- 172.21.15.138:0/3093959842 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f868c106010 con 0x7f868c108760 2024-09-10T22:21:52.880 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-10T22:21:52.877+0000 7f8688ff9640 1 -- 172.21.15.138:0/3093959842 <== mon.1 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 16) ==== 153250+0+0 (secure 0 0 0) 0x7f8684004040 con 0x7f868c108760 2024-09-10T22:21:52.880 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-10T22:21:52.878+0000 7f8688ff9640 1 --2- 172.21.15.138:0/3093959842 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f86740b52e0 0x7f86740b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:21:52.880 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-10T22:21:52.878+0000 7f8688ff9640 1 -- 172.21.15.138:0/3093959842 <== mon.1 v2:172.21.15.138:3300/0 5 ==== osd_map(44..44 src has 1..44) ==== 5117+0+0 (secure 0 0 0) 0x7f8684106420 con 0x7f868c108760 2024-09-10T22:21:52.880 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-10T22:21:52.878+0000 7f868b7fe640 1 --2- 172.21.15.138:0/3093959842 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f86740b52e0 0x7f86740b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:21:52.880 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-10T22:21:52.879+0000 7f868b7fe640 1 --2- 172.21.15.138:0/3093959842 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f86740b52e0 0x7f86740b77a0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f867c009bd0 tx=0x7f867c005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:21:52.882 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-10T22:21:52.881+0000 7f8688ff9640 1 -- 172.21.15.138:0/3093959842 <== mon.1 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f86840cdff0 con 0x7f868c108760 2024-09-10T22:21:53.074 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-10T22:21:53.073+0000 7f8691c71640 1 -- 172.21.15.138:0/3093959842 --> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi138:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) -- 0x7f868c063590 con 0x7f86740b52e0 2024-09-10T22:21:53.075 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:21:52 smithi138 ceph-mon[35236]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-09-10T22:21:53.075 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:21:52 smithi138 ceph-mon[35236]: from='osd.7 [v2:172.21.15.135:6816/1096613674,v1:172.21.15.135:6817/1096613674]' entity='osd.7' cmd={"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi135", "root=default"]} : dispatch 2024-09-10T22:21:53.075 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:21:52 smithi138 ceph-mon[35236]: osdmap e43: 8 total, 7 up, 8 in 2024-09-10T22:21:53.075 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:21:52 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-10T22:21:53.075 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:21:52 smithi138 ceph-mon[35236]: from='osd.7 ' entity='osd.7' cmd={"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi135", "root=default"]} : dispatch 2024-09-10T22:21:53.075 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:21:52 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:21:53.075 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:21:52 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:21:53.075 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:21:52 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-10T22:21:53.075 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:21:52 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-09-10T22:21:53.075 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:21:52 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"} : dispatch 2024-09-10T22:21:53.075 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:21:52 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:21:53.075 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:21:52 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T22:21:53.075 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:21:52 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T22:21:53.076 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:21:52 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:21:53.076 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:21:52 smithi138 ceph-mon[35236]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi135", "root=default"]}]': finished 2024-09-10T22:21:53.209 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:21:52 smithi019 ceph-mon[31375]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-09-10T22:21:53.209 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:21:52 smithi019 ceph-mon[31375]: from='osd.7 [v2:172.21.15.135:6816/1096613674,v1:172.21.15.135:6817/1096613674]' entity='osd.7' cmd={"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi135", "root=default"]} : dispatch 2024-09-10T22:21:53.209 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:21:52 smithi019 ceph-mon[31375]: osdmap e43: 8 total, 7 up, 8 in 2024-09-10T22:21:53.209 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:21:52 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-10T22:21:53.209 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:21:52 smithi019 ceph-mon[31375]: from='osd.7 ' entity='osd.7' cmd={"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi135", "root=default"]} : dispatch 2024-09-10T22:21:53.209 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:21:52 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:21:53.209 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:21:52 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:21:53.209 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:21:52 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-10T22:21:53.209 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:21:52 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-09-10T22:21:53.209 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:21:52 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"} : dispatch 2024-09-10T22:21:53.209 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:21:52 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:21:53.210 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:21:52 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T22:21:53.210 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:21:52 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T22:21:53.210 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:21:52 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:21:53.210 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:21:52 smithi019 ceph-mon[31375]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi135", "root=default"]}]': finished 2024-09-10T22:21:53.360 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:21:52 smithi135 ceph-mon[34789]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-09-10T22:21:53.360 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:21:52 smithi135 ceph-mon[34789]: from='osd.7 [v2:172.21.15.135:6816/1096613674,v1:172.21.15.135:6817/1096613674]' entity='osd.7' cmd={"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi135", "root=default"]} : dispatch 2024-09-10T22:21:53.360 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:21:52 smithi135 ceph-mon[34789]: osdmap e43: 8 total, 7 up, 8 in 2024-09-10T22:21:53.360 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:21:52 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-10T22:21:53.360 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:21:52 smithi135 ceph-mon[34789]: from='osd.7 ' entity='osd.7' cmd={"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi135", "root=default"]} : dispatch 2024-09-10T22:21:53.360 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:21:52 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:21:53.360 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:21:52 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:21:53.360 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:21:52 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-10T22:21:53.360 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:21:52 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-09-10T22:21:53.360 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:21:52 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"} : dispatch 2024-09-10T22:21:53.361 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:21:52 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:21:53.361 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:21:52 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T22:21:53.361 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:21:52 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T22:21:53.361 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:21:52 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:21:53.361 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:21:52 smithi135 ceph-mon[34789]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi135", "root=default"]}]': finished 2024-09-10T22:21:54.110 INFO:journalctl@ceph.osd.7.smithi135.stdout:Sep 10 22:21:53 smithi135 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-7[53144]: 2024-09-10T22:21:53.754+0000 7ff637aa6640 -1 osd.7 0 waiting for initial osdmap 2024-09-10T22:21:54.110 INFO:journalctl@ceph.osd.7.smithi135.stdout:Sep 10 22:21:53 smithi135 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-7[53144]: 2024-09-10T22:21:53.887+0000 7ff62f8c5640 -1 osd.7 45 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-10T22:21:54.110 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:21:53 smithi135 ceph-mon[34789]: pgmap v177: 1 pgs: 1 active+clean; 577 KiB data, 209 MiB used, 626 GiB / 626 GiB avail 2024-09-10T22:21:54.110 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:21:53 smithi135 ceph-mon[34789]: Detected new or changed devices on smithi135 2024-09-10T22:21:54.110 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:21:53 smithi135 ceph-mon[34789]: Adjusting osd_memory_target on smithi135 to 1938M 2024-09-10T22:21:54.110 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:21:53 smithi135 ceph-mon[34789]: osdmap e44: 8 total, 7 up, 8 in 2024-09-10T22:21:54.110 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:21:53 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-10T22:21:54.110 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:21:53 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-10T22:21:54.110 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:21:53 smithi135 ceph-mon[34789]: from='client.24391 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi138:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T22:21:54.111 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:21:53 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-10T22:21:54.111 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:21:53 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-10T22:21:54.111 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:21:53 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T22:21:54.111 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:21:53 smithi135 ceph-mon[34789]: from='osd.7 ' entity='osd.7' 2024-09-10T22:21:54.111 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:21:53 smithi135 ceph-mon[34789]: osdmap e45: 8 total, 7 up, 8 in 2024-09-10T22:21:54.111 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:21:53 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-10T22:21:54.111 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:21:53 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-10T22:21:54.125 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:21:53 smithi138 ceph-mon[35236]: pgmap v177: 1 pgs: 1 active+clean; 577 KiB data, 209 MiB used, 626 GiB / 626 GiB avail 2024-09-10T22:21:54.125 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:21:53 smithi138 ceph-mon[35236]: Detected new or changed devices on smithi135 2024-09-10T22:21:54.125 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:21:53 smithi138 ceph-mon[35236]: Adjusting osd_memory_target on smithi135 to 1938M 2024-09-10T22:21:54.125 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:21:53 smithi138 ceph-mon[35236]: osdmap e44: 8 total, 7 up, 8 in 2024-09-10T22:21:54.125 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:21:53 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-10T22:21:54.125 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:21:53 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-10T22:21:54.126 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:21:53 smithi138 ceph-mon[35236]: from='client.24391 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi138:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T22:21:54.126 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:21:53 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-10T22:21:54.126 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:21:53 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-10T22:21:54.126 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:21:53 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T22:21:54.126 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:21:53 smithi138 ceph-mon[35236]: from='osd.7 ' entity='osd.7' 2024-09-10T22:21:54.126 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:21:53 smithi138 ceph-mon[35236]: osdmap e45: 8 total, 7 up, 8 in 2024-09-10T22:21:54.126 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:21:53 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-10T22:21:54.126 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:21:53 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-10T22:21:54.208 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:21:53 smithi019 ceph-mon[31375]: pgmap v177: 1 pgs: 1 active+clean; 577 KiB data, 209 MiB used, 626 GiB / 626 GiB avail 2024-09-10T22:21:54.208 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:21:53 smithi019 ceph-mon[31375]: Detected new or changed devices on smithi135 2024-09-10T22:21:54.209 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:21:53 smithi019 ceph-mon[31375]: Adjusting osd_memory_target on smithi135 to 1938M 2024-09-10T22:21:54.209 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:21:53 smithi019 ceph-mon[31375]: osdmap e44: 8 total, 7 up, 8 in 2024-09-10T22:21:54.209 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:21:53 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-10T22:21:54.209 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:21:53 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-10T22:21:54.209 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:21:53 smithi019 ceph-mon[31375]: from='client.24391 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi138:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T22:21:54.209 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:21:53 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-10T22:21:54.209 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:21:53 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-10T22:21:54.209 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:21:53 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T22:21:54.209 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:21:53 smithi019 ceph-mon[31375]: from='osd.7 ' entity='osd.7' 2024-09-10T22:21:54.209 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:21:53 smithi019 ceph-mon[31375]: osdmap e45: 8 total, 7 up, 8 in 2024-09-10T22:21:54.209 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:21:53 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-10T22:21:54.209 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:21:53 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-10T22:21:55.125 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:21:54 smithi138 ceph-mon[35236]: purged_snaps scrub starts 2024-09-10T22:21:55.125 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:21:54 smithi138 ceph-mon[35236]: purged_snaps scrub ok 2024-09-10T22:21:55.125 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:21:54 smithi138 ceph-mon[35236]: osd.7 [v2:172.21.15.135:6816/1096613674,v1:172.21.15.135:6817/1096613674] boot 2024-09-10T22:21:55.125 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:21:54 smithi138 ceph-mon[35236]: osdmap e46: 8 total, 8 up, 8 in 2024-09-10T22:21:55.125 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:21:54 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-10T22:21:55.213 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:21:54 smithi019 ceph-mon[31375]: purged_snaps scrub starts 2024-09-10T22:21:55.213 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:21:54 smithi019 ceph-mon[31375]: purged_snaps scrub ok 2024-09-10T22:21:55.213 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:21:54 smithi019 ceph-mon[31375]: osd.7 [v2:172.21.15.135:6816/1096613674,v1:172.21.15.135:6817/1096613674] boot 2024-09-10T22:21:55.213 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:21:54 smithi019 ceph-mon[31375]: osdmap e46: 8 total, 8 up, 8 in 2024-09-10T22:21:55.213 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:21:54 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-10T22:21:55.360 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:21:54 smithi135 ceph-mon[34789]: purged_snaps scrub starts 2024-09-10T22:21:55.360 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:21:54 smithi135 ceph-mon[34789]: purged_snaps scrub ok 2024-09-10T22:21:55.360 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:21:54 smithi135 ceph-mon[34789]: osd.7 [v2:172.21.15.135:6816/1096613674,v1:172.21.15.135:6817/1096613674] boot 2024-09-10T22:21:55.360 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:21:54 smithi135 ceph-mon[34789]: osdmap e46: 8 total, 8 up, 8 in 2024-09-10T22:21:55.360 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:21:54 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-10T22:21:56.125 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:21:55 smithi138 ceph-mon[35236]: pgmap v180: 1 pgs: 1 active+clean; 577 KiB data, 209 MiB used, 626 GiB / 626 GiB avail 2024-09-10T22:21:56.125 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:21:55 smithi138 ceph-mon[35236]: from='client.? 172.21.15.138:0/1372316889' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "5323a006-a6e8-4403-9c51-65f46298d5c4"} : dispatch 2024-09-10T22:21:56.125 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:21:55 smithi138 ceph-mon[35236]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "5323a006-a6e8-4403-9c51-65f46298d5c4"} : dispatch 2024-09-10T22:21:56.125 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:21:55 smithi138 ceph-mon[35236]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "5323a006-a6e8-4403-9c51-65f46298d5c4"}]': finished 2024-09-10T22:21:56.126 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:21:55 smithi138 ceph-mon[35236]: osdmap e47: 9 total, 8 up, 9 in 2024-09-10T22:21:56.126 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:21:55 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-10T22:21:56.126 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:21:55 smithi138 ceph-mon[35236]: from='client.? 172.21.15.138:0/4257034209' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-10T22:21:56.208 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:21:55 smithi019 ceph-mon[31375]: pgmap v180: 1 pgs: 1 active+clean; 577 KiB data, 209 MiB used, 626 GiB / 626 GiB avail 2024-09-10T22:21:56.208 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:21:55 smithi019 ceph-mon[31375]: from='client.? 172.21.15.138:0/1372316889' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "5323a006-a6e8-4403-9c51-65f46298d5c4"} : dispatch 2024-09-10T22:21:56.209 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:21:55 smithi019 ceph-mon[31375]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "5323a006-a6e8-4403-9c51-65f46298d5c4"} : dispatch 2024-09-10T22:21:56.209 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:21:55 smithi019 ceph-mon[31375]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "5323a006-a6e8-4403-9c51-65f46298d5c4"}]': finished 2024-09-10T22:21:56.209 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:21:55 smithi019 ceph-mon[31375]: osdmap e47: 9 total, 8 up, 9 in 2024-09-10T22:21:56.209 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:21:55 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-10T22:21:56.209 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:21:55 smithi019 ceph-mon[31375]: from='client.? 172.21.15.138:0/4257034209' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-10T22:21:56.360 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:21:55 smithi135 ceph-mon[34789]: pgmap v180: 1 pgs: 1 active+clean; 577 KiB data, 209 MiB used, 626 GiB / 626 GiB avail 2024-09-10T22:21:56.360 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:21:55 smithi135 ceph-mon[34789]: from='client.? 172.21.15.138:0/1372316889' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "5323a006-a6e8-4403-9c51-65f46298d5c4"} : dispatch 2024-09-10T22:21:56.360 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:21:55 smithi135 ceph-mon[34789]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "5323a006-a6e8-4403-9c51-65f46298d5c4"} : dispatch 2024-09-10T22:21:56.360 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:21:55 smithi135 ceph-mon[34789]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "5323a006-a6e8-4403-9c51-65f46298d5c4"}]': finished 2024-09-10T22:21:56.360 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:21:55 smithi135 ceph-mon[34789]: osdmap e47: 9 total, 8 up, 9 in 2024-09-10T22:21:56.360 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:21:55 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-10T22:21:56.360 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:21:55 smithi135 ceph-mon[34789]: from='client.? 172.21.15.138:0/4257034209' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-10T22:21:57.609 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:21:57 smithi135 ceph-mon[34789]: osdmap e48: 9 total, 8 up, 9 in 2024-09-10T22:21:57.610 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:21:57 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-10T22:21:57.610 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:21:57 smithi135 ceph-mon[34789]: pgmap v184: 1 pgs: 1 remapped; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-09-10T22:21:57.625 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:21:57 smithi138 ceph-mon[35236]: osdmap e48: 9 total, 8 up, 9 in 2024-09-10T22:21:57.625 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:21:57 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-10T22:21:57.625 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:21:57 smithi138 ceph-mon[35236]: pgmap v184: 1 pgs: 1 remapped; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-09-10T22:21:57.708 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:21:57 smithi019 ceph-mon[31375]: osdmap e48: 9 total, 8 up, 9 in 2024-09-10T22:21:57.708 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:21:57 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-10T22:21:57.708 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:21:57 smithi019 ceph-mon[31375]: pgmap v184: 1 pgs: 1 remapped; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-09-10T22:21:59.708 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:21:59 smithi019 ceph-mon[31375]: pgmap v185: 1 pgs: 1 remapped; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-09-10T22:21:59.859 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:21:59 smithi135 ceph-mon[34789]: pgmap v185: 1 pgs: 1 remapped; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-09-10T22:21:59.875 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:21:59 smithi138 ceph-mon[35236]: pgmap v185: 1 pgs: 1 remapped; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-09-10T22:22:01.625 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:22:01 smithi138 ceph-mon[35236]: pgmap v186: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-10T22:22:01.708 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:22:01 smithi019 ceph-mon[31375]: pgmap v186: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-10T22:22:01.860 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:22:01 smithi135 ceph-mon[34789]: pgmap v186: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-10T22:22:03.534 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:22:03 smithi138 ceph-mon[35236]: pgmap v187: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail; 77 KiB/s, 0 objects/s recovering 2024-09-10T22:22:03.708 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:22:03 smithi019 ceph-mon[31375]: pgmap v187: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail; 77 KiB/s, 0 objects/s recovering 2024-09-10T22:22:03.859 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:22:03 smithi135 ceph-mon[34789]: pgmap v187: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail; 77 KiB/s, 0 objects/s recovering 2024-09-10T22:22:04.560 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:22:04 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.8"} : dispatch 2024-09-10T22:22:04.560 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:22:04 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T22:22:04.560 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:22:04 smithi138 ceph-mon[35236]: Deploying daemon osd.8 on smithi138 2024-09-10T22:22:04.708 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:22:04 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.8"} : dispatch 2024-09-10T22:22:04.708 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:22:04 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T22:22:04.708 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:22:04 smithi019 ceph-mon[31375]: Deploying daemon osd.8 on smithi138 2024-09-10T22:22:04.859 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:22:04 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.8"} : dispatch 2024-09-10T22:22:04.860 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:22:04 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T22:22:04.860 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:22:04 smithi135 ceph-mon[34789]: Deploying daemon osd.8 on smithi138 2024-09-10T22:22:05.699 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:22:05 smithi138 ceph-mon[35236]: pgmap v188: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail; 127 KiB/s, 0 objects/s recovering 2024-09-10T22:22:05.708 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:22:05 smithi019 ceph-mon[31375]: pgmap v188: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail; 127 KiB/s, 0 objects/s recovering 2024-09-10T22:22:05.859 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:22:05 smithi135 ceph-mon[34789]: pgmap v188: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail; 127 KiB/s, 0 objects/s recovering 2024-09-10T22:22:07.625 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:22:07 smithi138 ceph-mon[35236]: pgmap v189: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail; 115 KiB/s, 0 objects/s recovering 2024-09-10T22:22:07.708 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:22:07 smithi019 ceph-mon[31375]: pgmap v189: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail; 115 KiB/s, 0 objects/s recovering 2024-09-10T22:22:07.860 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:22:07 smithi135 ceph-mon[34789]: pgmap v189: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail; 115 KiB/s, 0 objects/s recovering 2024-09-10T22:22:09.708 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:22:09 smithi019 ceph-mon[31375]: pgmap v190: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-10T22:22:09.859 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:22:09 smithi135 ceph-mon[34789]: pgmap v190: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-10T22:22:09.875 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:22:09 smithi138 ceph-mon[35236]: pgmap v190: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-10T22:22:10.613 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:22:10 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T22:22:10.613 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:22:10 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:22:10.613 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:22:10 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:22:10.708 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:22:10 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T22:22:10.708 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:22:10 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:22:10.708 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:22:10 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:22:10.859 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:22:10 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T22:22:10.860 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:22:10 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:22:10.860 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:22:10 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:22:11.744 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:22:11 smithi138 ceph-mon[35236]: pgmap v191: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-10T22:22:11.859 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:22:11 smithi135 ceph-mon[34789]: pgmap v191: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-10T22:22:11.958 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:22:11 smithi019 ceph-mon[31375]: pgmap v191: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-10T22:22:12.890 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:22:12 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:22:12.890 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:22:12 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:22:12.890 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:22:12 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T22:22:12.890 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:22:12 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T22:22:12.890 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:22:12 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:22:12.931 INFO:teuthology.orchestra.run.smithi138.stdout:Created osd(s) 8 on host 'smithi138' 2024-09-10T22:22:12.931 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-10T22:22:12.930+0000 7f8688ff9640 1 -- 172.21.15.138:0/3093959842 <== mgr.14150 v2:172.21.15.19:6800/2119495487 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f868c063590 con 0x7f86740b52e0 2024-09-10T22:22:12.934 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-10T22:22:12.932+0000 7f8691c71640 1 -- 172.21.15.138:0/3093959842 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f86740b52e0 msgr2=0x7f86740b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:22:12.934 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-10T22:22:12.932+0000 7f8691c71640 1 --2- 172.21.15.138:0/3093959842 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f86740b52e0 0x7f86740b77a0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f867c009bd0 tx=0x7f867c005f90 comp rx=0 tx=0).stop 2024-09-10T22:22:12.934 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-10T22:22:12.932+0000 7f8691c71640 1 -- 172.21.15.138:0/3093959842 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f868c108760 msgr2=0x7f868c199fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:22:12.934 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-10T22:22:12.932+0000 7f8691c71640 1 --2- 172.21.15.138:0/3093959842 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f868c108760 0x7f868c199fd0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f86840097b0 tx=0x7f8684031770 comp rx=0 tx=0).stop 2024-09-10T22:22:12.934 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-10T22:22:12.932+0000 7f8691c71640 1 -- 172.21.15.138:0/3093959842 shutdown_connections 2024-09-10T22:22:12.934 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-10T22:22:12.932+0000 7f8691c71640 1 --2- 172.21.15.138:0/3093959842 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f86740b52e0 0x7f86740b77a0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:22:12.934 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-10T22:22:12.933+0000 7f8691c71640 1 --2- 172.21.15.138:0/3093959842 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f868c108760 0x7f868c199fd0 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:22:12.934 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-10T22:22:12.933+0000 7f8691c71640 1 --2- 172.21.15.138:0/3093959842 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f868c105bb0 0x7f868c199390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:22:12.934 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-10T22:22:12.933+0000 7f8691c71640 1 --2- 172.21.15.138:0/3093959842 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f868c06bf00 0x7f868c198d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:22:12.935 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-10T22:22:12.933+0000 7f8691c71640 1 -- 172.21.15.138:0/3093959842 >> 172.21.15.138:0/3093959842 conn(0x7f868c0fd210 msgr2=0x7f868c103e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:22:12.935 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-10T22:22:12.933+0000 7f8691c71640 1 -- 172.21.15.138:0/3093959842 shutdown_connections 2024-09-10T22:22:12.935 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-10T22:22:12.933+0000 7f8691c71640 1 -- 172.21.15.138:0/3093959842 wait complete. 2024-09-10T22:22:13.208 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:22:12 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:22:13.208 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:22:12 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:22:13.208 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:22:12 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T22:22:13.208 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:22:12 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T22:22:13.208 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:22:12 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:22:13.360 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:22:12 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:22:13.360 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:22:12 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:22:13.360 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:22:12 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T22:22:13.360 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:22:12 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T22:22:13.360 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:22:12 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:22:13.564 DEBUG:teuthology.orchestra.run.smithi138:osd.8> sudo journalctl -f -n 0 -u ceph-22997a4c-6fc2-11ef-bcea-c7b262605968@osd.8.service 2024-09-10T22:22:13.566 INFO:tasks.cephadm:Deploying osd.9 on smithi019 with /dev/vg_nvme/lv_1... 2024-09-10T22:22:13.566 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 22997a4c-6fc2-11ef-bcea-c7b262605968 -- lvm zap /dev/vg_nvme/lv_1 2024-09-10T22:22:13.835 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/22997a4c-6fc2-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T22:22:14.125 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:22:13 smithi138 ceph-mon[35236]: pgmap v192: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-09-10T22:22:14.125 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:22:13 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T22:22:14.125 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:22:13 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:22:14.125 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:22:13 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:22:14.170 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:22:13 smithi019 ceph-mon[31375]: pgmap v192: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-09-10T22:22:14.171 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:22:13 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T22:22:14.171 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:22:13 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:22:14.171 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:22:13 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:22:14.359 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:22:13 smithi135 ceph-mon[34789]: pgmap v192: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-09-10T22:22:14.360 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:22:13 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T22:22:14.360 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:22:13 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:22:14.360 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:22:13 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:22:15.875 INFO:journalctl@ceph.osd.8.smithi138.stdout:Sep 10 22:22:15 smithi138 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-8[53775]: 2024-09-10T22:22:15.529+0000 7f88019a6640 -1 osd.8 0 log_to_monitors true 2024-09-10T22:22:15.959 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:22:15 smithi019 ceph-mon[31375]: pgmap v193: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-09-10T22:22:15.959 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:22:15 smithi019 ceph-mon[31375]: from='osd.8 [v2:172.21.15.138:6816/3020394729,v1:172.21.15.138:6817/3020394729]' entity='osd.8' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]} : dispatch 2024-09-10T22:22:15.959 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:22:15 smithi019 ceph-mon[31375]: from='osd.8 ' entity='osd.8' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]} : dispatch 2024-09-10T22:22:16.298 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:22:15 smithi138 ceph-mon[35236]: pgmap v193: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-09-10T22:22:16.298 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:22:15 smithi138 ceph-mon[35236]: from='osd.8 [v2:172.21.15.138:6816/3020394729,v1:172.21.15.138:6817/3020394729]' entity='osd.8' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]} : dispatch 2024-09-10T22:22:16.299 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:22:15 smithi138 ceph-mon[35236]: from='osd.8 ' entity='osd.8' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]} : dispatch 2024-09-10T22:22:16.359 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:22:15 smithi135 ceph-mon[34789]: pgmap v193: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-09-10T22:22:16.360 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:22:15 smithi135 ceph-mon[34789]: from='osd.8 [v2:172.21.15.138:6816/3020394729,v1:172.21.15.138:6817/3020394729]' entity='osd.8' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]} : dispatch 2024-09-10T22:22:16.360 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:22:15 smithi135 ceph-mon[34789]: from='osd.8 ' entity='osd.8' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]} : dispatch 2024-09-10T22:22:16.511 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-10T22:22:16.537 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 22997a4c-6fc2-11ef-bcea-c7b262605968 -- ceph orch daemon add osd smithi019:vg_nvme/lv_1 2024-09-10T22:22:16.790 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/22997a4c-6fc2-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T22:22:17.208 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:22:16 smithi019 ceph-mon[31375]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2024-09-10T22:22:17.209 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:22:16 smithi019 ceph-mon[31375]: osdmap e49: 9 total, 8 up, 9 in 2024-09-10T22:22:17.209 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:22:16 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-10T22:22:17.209 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:22:16 smithi019 ceph-mon[31375]: from='osd.8 [v2:172.21.15.138:6816/3020394729,v1:172.21.15.138:6817/3020394729]' entity='osd.8' cmd={"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi138", "root=default"]} : dispatch 2024-09-10T22:22:17.209 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:22:16 smithi019 ceph-mon[31375]: from='osd.8 ' entity='osd.8' cmd={"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi138", "root=default"]} : dispatch 2024-09-10T22:22:17.209 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:22:16 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:22:17.209 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:22:16 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:22:17.209 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:22:16 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-10T22:22:17.209 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:22:16 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-09-10T22:22:17.209 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:22:16 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"} : dispatch 2024-09-10T22:22:17.209 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:22:16 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:22:17.209 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:22:16 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T22:22:17.210 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:22:16 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T22:22:17.210 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:22:16 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:22:17.223 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:22:17.220+0000 7f3a08d6a640 1 -- 172.21.15.19:0/1494093488 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3a04104c40 msgr2=0x7f3a04105040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:22:17.223 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:22:17.220+0000 7f3a08d6a640 1 --2- 172.21.15.19:0/1494093488 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3a04104c40 0x7f3a04105040 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f39f4009930 tx=0x7f39f402a420 comp rx=0 tx=0).stop 2024-09-10T22:22:17.223 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:22:17.220+0000 7f3a08d6a640 1 -- 172.21.15.19:0/1494093488 shutdown_connections 2024-09-10T22:22:17.223 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:22:17.220+0000 7f3a08d6a640 1 --2- 172.21.15.19:0/1494093488 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3a04106760 0x7f3a0410d0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:22:17.223 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:22:17.220+0000 7f3a08d6a640 1 --2- 172.21.15.19:0/1494093488 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3a04105da0 0x7f3a04106220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:22:17.223 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:22:17.220+0000 7f3a08d6a640 1 --2- 172.21.15.19:0/1494093488 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3a04104c40 0x7f3a04105040 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:22:17.223 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:22:17.220+0000 7f3a08d6a640 1 -- 172.21.15.19:0/1494093488 >> 172.21.15.19:0/1494093488 conn(0x7f3a04100510 msgr2=0x7f3a04102950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:22:17.223 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:22:17.220+0000 7f3a08d6a640 1 -- 172.21.15.19:0/1494093488 shutdown_connections 2024-09-10T22:22:17.223 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:22:17.220+0000 7f3a08d6a640 1 -- 172.21.15.19:0/1494093488 wait complete. 2024-09-10T22:22:17.226 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:22:17.221+0000 7f3a08d6a640 1 Processor -- start 2024-09-10T22:22:17.226 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:22:17.221+0000 7f3a08d6a640 1 -- start start 2024-09-10T22:22:17.226 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:22:17.221+0000 7f3a08d6a640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3a04104c40 0x7f3a0419b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:22:17.226 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:22:17.222+0000 7f3a08d6a640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3a04105da0 0x7f3a0419b6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:22:17.226 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:22:17.222+0000 7f3a08d6a640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3a04106760 0x7f3a0419c330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:22:17.226 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:22:17.222+0000 7f3a08d6a640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f3a04110940 con 0x7f3a04105da0 2024-09-10T22:22:17.226 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:22:17.222+0000 7f3a08d6a640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f3a041107c0 con 0x7f3a04106760 2024-09-10T22:22:17.226 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:22:17.222+0000 7f3a08d6a640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f3a04110ac0 con 0x7f3a04104c40 2024-09-10T22:22:17.226 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:22:17.222+0000 7f3a01d9b640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3a04105da0 0x7f3a0419b6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:22:17.226 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:22:17.222+0000 7f3a01d9b640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3a04105da0 0x7f3a0419b6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:51332/0 (socket says 172.21.15.19:51332) 2024-09-10T22:22:17.227 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:22:17.222+0000 7f3a01d9b640 1 -- 172.21.15.19:0/2411463179 learned_addr learned my addr 172.21.15.19:0/2411463179 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:22:17.227 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:22:17.222+0000 7f3a0259c640 1 --2- 172.21.15.19:0/2411463179 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3a04104c40 0x7f3a0419b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:22:17.227 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:22:17.222+0000 7f3a02d9d640 1 --2- 172.21.15.19:0/2411463179 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3a04106760 0x7f3a0419c330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:22:17.227 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:22:17.222+0000 7f3a01d9b640 1 -- 172.21.15.19:0/2411463179 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3a04104c40 msgr2=0x7f3a0419b0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:22:17.227 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:22:17.222+0000 7f3a01d9b640 1 --2- 172.21.15.19:0/2411463179 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3a04104c40 0x7f3a0419b0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:22:17.227 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:22:17.222+0000 7f3a01d9b640 1 -- 172.21.15.19:0/2411463179 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3a04106760 msgr2=0x7f3a0419c330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:22:17.227 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:22:17.222+0000 7f3a01d9b640 1 --2- 172.21.15.19:0/2411463179 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3a04106760 0x7f3a0419c330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:22:17.227 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:22:17.222+0000 7f3a01d9b640 1 -- 172.21.15.19:0/2411463179 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3a0419cbd0 con 0x7f3a04105da0 2024-09-10T22:22:17.227 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:22:17.222+0000 7f3a0259c640 1 --2- 172.21.15.19:0/2411463179 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3a04104c40 0x7f3a0419b0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T22:22:17.227 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:22:17.222+0000 7f3a02d9d640 1 --2- 172.21.15.19:0/2411463179 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3a04106760 0x7f3a0419c330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T22:22:17.227 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:22:17.222+0000 7f3a01d9b640 1 --2- 172.21.15.19:0/2411463179 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3a04105da0 0x7f3a0419b6f0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f39f800e9f0 tx=0x7f39f800edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:22:17.227 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:22:17.222+0000 7f39f37fe640 1 -- 172.21.15.19:0/2411463179 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39f800cd80 con 0x7f3a04105da0 2024-09-10T22:22:17.228 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:22:17.222+0000 7f39f37fe640 1 -- 172.21.15.19:0/2411463179 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f39f80054d0 con 0x7f3a04105da0 2024-09-10T22:22:17.228 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:22:17.222+0000 7f3a08d6a640 1 -- 172.21.15.19:0/2411463179 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3a0419cec0 con 0x7f3a04105da0 2024-09-10T22:22:17.228 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:22:17.222+0000 7f39f37fe640 1 -- 172.21.15.19:0/2411463179 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39f8010690 con 0x7f3a04105da0 2024-09-10T22:22:17.228 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:22:17.223+0000 7f3a08d6a640 1 -- 172.21.15.19:0/2411463179 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3a041a35a0 con 0x7f3a04105da0 2024-09-10T22:22:17.228 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:22:17.223+0000 7f3a08d6a640 1 -- 172.21.15.19:0/2411463179 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3a0410c040 con 0x7f3a04105da0 2024-09-10T22:22:17.229 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:22:17.225+0000 7f39f37fe640 1 -- 172.21.15.19:0/2411463179 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 16) ==== 153250+0+0 (secure 0 0 0) 0x7f39f8004e30 con 0x7f3a04105da0 2024-09-10T22:22:17.229 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:22:17.226+0000 7f39f37fe640 1 --2- 172.21.15.19:0/2411463179 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f39ec0b5360 0x7f39ec0b7820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:22:17.229 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:22:17.226+0000 7f3a0259c640 1 --2- 172.21.15.19:0/2411463179 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f39ec0b5360 0x7f39ec0b7820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:22:17.229 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:22:17.226+0000 7f39f37fe640 1 -- 172.21.15.19:0/2411463179 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(50..50 src has 1..50) ==== 5549+0+0 (secure 0 0 0) 0x7f39f80e57f0 con 0x7f3a04105da0 2024-09-10T22:22:17.229 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:22:17.226+0000 7f3a0259c640 1 --2- 172.21.15.19:0/2411463179 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f39ec0b5360 0x7f39ec0b7820 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f39f4006010 tx=0x7f39f4031430 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:22:17.231 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:22:17.229+0000 7f39f37fe640 1 -- 172.21.15.19:0/2411463179 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f39f8056220 con 0x7f3a04105da0 2024-09-10T22:22:17.360 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:22:16 smithi135 ceph-mon[34789]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2024-09-10T22:22:17.360 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:22:16 smithi135 ceph-mon[34789]: osdmap e49: 9 total, 8 up, 9 in 2024-09-10T22:22:17.360 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:22:16 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-10T22:22:17.360 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:22:16 smithi135 ceph-mon[34789]: from='osd.8 [v2:172.21.15.138:6816/3020394729,v1:172.21.15.138:6817/3020394729]' entity='osd.8' cmd={"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi138", "root=default"]} : dispatch 2024-09-10T22:22:17.360 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:22:16 smithi135 ceph-mon[34789]: from='osd.8 ' entity='osd.8' cmd={"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi138", "root=default"]} : dispatch 2024-09-10T22:22:17.360 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:22:16 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:22:17.361 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:22:16 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:22:17.361 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:22:16 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-10T22:22:17.361 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:22:16 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-09-10T22:22:17.361 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:22:16 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"} : dispatch 2024-09-10T22:22:17.361 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:22:16 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:22:17.361 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:22:16 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T22:22:17.361 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:22:16 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T22:22:17.361 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:22:16 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:22:17.375 INFO:journalctl@ceph.osd.8.smithi138.stdout:Sep 10 22:22:16 smithi138 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-8[53775]: 2024-09-10T22:22:16.905+0000 7f87fd929640 -1 osd.8 0 waiting for initial osdmap 2024-09-10T22:22:17.375 INFO:journalctl@ceph.osd.8.smithi138.stdout:Sep 10 22:22:16 smithi138 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-8[53775]: 2024-09-10T22:22:16.914+0000 7f87f9750640 -1 osd.8 50 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-10T22:22:17.375 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:22:16 smithi138 ceph-mon[35236]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2024-09-10T22:22:17.375 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:22:16 smithi138 ceph-mon[35236]: osdmap e49: 9 total, 8 up, 9 in 2024-09-10T22:22:17.375 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:22:16 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-10T22:22:17.375 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:22:16 smithi138 ceph-mon[35236]: from='osd.8 [v2:172.21.15.138:6816/3020394729,v1:172.21.15.138:6817/3020394729]' entity='osd.8' cmd={"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi138", "root=default"]} : dispatch 2024-09-10T22:22:17.375 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:22:16 smithi138 ceph-mon[35236]: from='osd.8 ' entity='osd.8' cmd={"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi138", "root=default"]} : dispatch 2024-09-10T22:22:17.376 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:22:16 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:22:17.376 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:22:16 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:22:17.376 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:22:16 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-10T22:22:17.376 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:22:16 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-09-10T22:22:17.376 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:22:16 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"} : dispatch 2024-09-10T22:22:17.376 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:22:16 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:22:17.376 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:22:16 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T22:22:17.376 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:22:16 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T22:22:17.376 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:22:16 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:22:17.431 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:22:17.428+0000 7f3a08d6a640 1 -- 172.21.15.19:0/2411463179 --> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi019:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) -- 0x7f3a04063590 con 0x7f39ec0b5360 2024-09-10T22:22:18.114 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:22:17 smithi019 ceph-mon[31375]: Detected new or changed devices on smithi138 2024-09-10T22:22:18.114 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:22:17 smithi019 ceph-mon[31375]: pgmap v195: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-09-10T22:22:18.114 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:22:17 smithi019 ceph-mon[31375]: Adjusting osd_memory_target on smithi138 to 5696M 2024-09-10T22:22:18.114 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:22:17 smithi019 ceph-mon[31375]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi138", "root=default"]}]': finished 2024-09-10T22:22:18.114 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:22:17 smithi019 ceph-mon[31375]: osdmap e50: 9 total, 8 up, 9 in 2024-09-10T22:22:18.115 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:22:17 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-10T22:22:18.115 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:22:17 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-10T22:22:18.115 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:22:17 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-10T22:22:18.115 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:22:17 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-10T22:22:18.115 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:22:17 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T22:22:18.261 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:22:17 smithi135 ceph-mon[34789]: Detected new or changed devices on smithi138 2024-09-10T22:22:18.261 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:22:17 smithi135 ceph-mon[34789]: pgmap v195: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-09-10T22:22:18.261 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:22:17 smithi135 ceph-mon[34789]: Adjusting osd_memory_target on smithi138 to 5696M 2024-09-10T22:22:18.261 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:22:17 smithi135 ceph-mon[34789]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi138", "root=default"]}]': finished 2024-09-10T22:22:18.262 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:22:17 smithi135 ceph-mon[34789]: osdmap e50: 9 total, 8 up, 9 in 2024-09-10T22:22:18.262 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:22:17 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-10T22:22:18.262 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:22:17 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-10T22:22:18.262 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:22:17 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-10T22:22:18.262 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:22:17 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-10T22:22:18.262 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:22:17 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T22:22:18.375 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:22:17 smithi138 ceph-mon[35236]: Detected new or changed devices on smithi138 2024-09-10T22:22:18.375 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:22:17 smithi138 ceph-mon[35236]: pgmap v195: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-09-10T22:22:18.375 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:22:17 smithi138 ceph-mon[35236]: Adjusting osd_memory_target on smithi138 to 5696M 2024-09-10T22:22:18.375 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:22:17 smithi138 ceph-mon[35236]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi138", "root=default"]}]': finished 2024-09-10T22:22:18.375 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:22:17 smithi138 ceph-mon[35236]: osdmap e50: 9 total, 8 up, 9 in 2024-09-10T22:22:18.375 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:22:17 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-10T22:22:18.375 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:22:17 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-10T22:22:18.375 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:22:17 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-10T22:22:18.376 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:22:17 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-10T22:22:18.376 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:22:17 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T22:22:19.173 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:22:18 smithi019 ceph-mon[31375]: purged_snaps scrub starts 2024-09-10T22:22:19.173 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:22:18 smithi019 ceph-mon[31375]: purged_snaps scrub ok 2024-09-10T22:22:19.173 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:22:18 smithi019 ceph-mon[31375]: from='client.14559 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi019:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T22:22:19.173 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:22:18 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-10T22:22:19.173 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:22:18 smithi019 ceph-mon[31375]: osd.8 [v2:172.21.15.138:6816/3020394729,v1:172.21.15.138:6817/3020394729] boot 2024-09-10T22:22:19.173 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:22:18 smithi019 ceph-mon[31375]: osdmap e51: 9 total, 9 up, 9 in 2024-09-10T22:22:19.173 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:22:18 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-10T22:22:19.276 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:22:18 smithi138 ceph-mon[35236]: purged_snaps scrub starts 2024-09-10T22:22:19.277 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:22:18 smithi138 ceph-mon[35236]: purged_snaps scrub ok 2024-09-10T22:22:19.277 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:22:18 smithi138 ceph-mon[35236]: from='client.14559 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi019:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T22:22:19.277 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:22:18 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-10T22:22:19.277 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:22:18 smithi138 ceph-mon[35236]: osd.8 [v2:172.21.15.138:6816/3020394729,v1:172.21.15.138:6817/3020394729] boot 2024-09-10T22:22:19.277 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:22:18 smithi138 ceph-mon[35236]: osdmap e51: 9 total, 9 up, 9 in 2024-09-10T22:22:19.277 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:22:18 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-10T22:22:19.360 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:22:18 smithi135 ceph-mon[34789]: purged_snaps scrub starts 2024-09-10T22:22:19.360 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:22:18 smithi135 ceph-mon[34789]: purged_snaps scrub ok 2024-09-10T22:22:19.360 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:22:18 smithi135 ceph-mon[34789]: from='client.14559 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi019:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T22:22:19.360 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:22:18 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-10T22:22:19.360 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:22:18 smithi135 ceph-mon[34789]: osd.8 [v2:172.21.15.138:6816/3020394729,v1:172.21.15.138:6817/3020394729] boot 2024-09-10T22:22:19.361 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:22:18 smithi135 ceph-mon[34789]: osdmap e51: 9 total, 9 up, 9 in 2024-09-10T22:22:19.361 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:22:18 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-10T22:22:19.958 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:22:19 smithi019 ceph-mon[31375]: pgmap v198: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-09-10T22:22:19.958 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:22:19 smithi019 ceph-mon[31375]: osdmap e52: 9 total, 9 up, 9 in 2024-09-10T22:22:20.288 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:22:19 smithi138 ceph-mon[35236]: pgmap v198: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-09-10T22:22:20.288 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:22:19 smithi138 ceph-mon[35236]: osdmap e52: 9 total, 9 up, 9 in 2024-09-10T22:22:20.360 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:22:19 smithi135 ceph-mon[34789]: pgmap v198: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-09-10T22:22:20.360 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:22:19 smithi135 ceph-mon[34789]: osdmap e52: 9 total, 9 up, 9 in 2024-09-10T22:22:21.208 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:22:20 smithi019 ceph-mon[31375]: osdmap e53: 9 total, 9 up, 9 in 2024-09-10T22:22:21.208 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:22:20 smithi019 ceph-mon[31375]: from='client.? 172.21.15.19:0/3063080015' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "b869ac42-c46e-442c-8b5b-f81c018e663c"} : dispatch 2024-09-10T22:22:21.208 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:22:20 smithi019 ceph-mon[31375]: from='client.? 172.21.15.19:0/3063080015' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "b869ac42-c46e-442c-8b5b-f81c018e663c"}]': finished 2024-09-10T22:22:21.209 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:22:20 smithi019 ceph-mon[31375]: osdmap e54: 10 total, 9 up, 10 in 2024-09-10T22:22:21.209 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:22:20 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-10T22:22:21.209 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:22:20 smithi019 ceph-mon[31375]: from='client.? 172.21.15.19:0/4162995035' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-10T22:22:21.359 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:22:20 smithi135 ceph-mon[34789]: osdmap e53: 9 total, 9 up, 9 in 2024-09-10T22:22:21.360 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:22:20 smithi135 ceph-mon[34789]: from='client.? 172.21.15.19:0/3063080015' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "b869ac42-c46e-442c-8b5b-f81c018e663c"} : dispatch 2024-09-10T22:22:21.360 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:22:20 smithi135 ceph-mon[34789]: from='client.? 172.21.15.19:0/3063080015' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "b869ac42-c46e-442c-8b5b-f81c018e663c"}]': finished 2024-09-10T22:22:21.360 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:22:20 smithi135 ceph-mon[34789]: osdmap e54: 10 total, 9 up, 10 in 2024-09-10T22:22:21.360 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:22:20 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-10T22:22:21.360 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:22:20 smithi135 ceph-mon[34789]: from='client.? 172.21.15.19:0/4162995035' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-10T22:22:21.375 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:22:20 smithi138 ceph-mon[35236]: osdmap e53: 9 total, 9 up, 9 in 2024-09-10T22:22:21.375 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:22:20 smithi138 ceph-mon[35236]: from='client.? 172.21.15.19:0/3063080015' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "b869ac42-c46e-442c-8b5b-f81c018e663c"} : dispatch 2024-09-10T22:22:21.375 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:22:20 smithi138 ceph-mon[35236]: from='client.? 172.21.15.19:0/3063080015' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "b869ac42-c46e-442c-8b5b-f81c018e663c"}]': finished 2024-09-10T22:22:21.375 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:22:20 smithi138 ceph-mon[35236]: osdmap e54: 10 total, 9 up, 10 in 2024-09-10T22:22:21.375 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:22:20 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-10T22:22:21.375 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:22:20 smithi138 ceph-mon[35236]: from='client.? 172.21.15.19:0/4162995035' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-10T22:22:22.359 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:22:22 smithi135 ceph-mon[34789]: pgmap v202: 1 pgs: 1 peering; 577 KiB data, 268 MiB used, 804 GiB / 805 GiB avail 2024-09-10T22:22:22.374 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:22:22 smithi138 ceph-mon[35236]: pgmap v202: 1 pgs: 1 peering; 577 KiB data, 268 MiB used, 804 GiB / 805 GiB avail 2024-09-10T22:22:22.458 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:22:22 smithi019 ceph-mon[31375]: pgmap v202: 1 pgs: 1 peering; 577 KiB data, 268 MiB used, 804 GiB / 805 GiB avail 2024-09-10T22:22:24.360 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:22:24 smithi135 ceph-mon[34789]: pgmap v203: 1 pgs: 1 peering; 577 KiB data, 268 MiB used, 804 GiB / 805 GiB avail 2024-09-10T22:22:24.375 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:22:24 smithi138 ceph-mon[35236]: pgmap v203: 1 pgs: 1 peering; 577 KiB data, 268 MiB used, 804 GiB / 805 GiB avail 2024-09-10T22:22:24.458 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:22:24 smithi019 ceph-mon[31375]: pgmap v203: 1 pgs: 1 peering; 577 KiB data, 268 MiB used, 804 GiB / 805 GiB avail 2024-09-10T22:22:26.360 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:22:26 smithi135 ceph-mon[34789]: pgmap v204: 1 pgs: 1 peering; 577 KiB data, 268 MiB used, 804 GiB / 805 GiB avail 2024-09-10T22:22:26.375 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:22:26 smithi138 ceph-mon[35236]: pgmap v204: 1 pgs: 1 peering; 577 KiB data, 268 MiB used, 804 GiB / 805 GiB avail 2024-09-10T22:22:26.458 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:22:26 smithi019 ceph-mon[31375]: pgmap v204: 1 pgs: 1 peering; 577 KiB data, 268 MiB used, 804 GiB / 805 GiB avail 2024-09-10T22:22:28.179 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:22:28 smithi019 ceph-mon[31375]: pgmap v205: 1 pgs: 1 active+clean; 577 KiB data, 272 MiB used, 804 GiB / 805 GiB avail; 78 KiB/s, 0 objects/s recovering 2024-09-10T22:22:28.359 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:22:28 smithi135 ceph-mon[34789]: pgmap v205: 1 pgs: 1 active+clean; 577 KiB data, 272 MiB used, 804 GiB / 805 GiB avail; 78 KiB/s, 0 objects/s recovering 2024-09-10T22:22:28.375 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:22:28 smithi138 ceph-mon[35236]: pgmap v205: 1 pgs: 1 active+clean; 577 KiB data, 272 MiB used, 804 GiB / 805 GiB avail; 78 KiB/s, 0 objects/s recovering 2024-09-10T22:22:29.208 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:22:29 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.9"} : dispatch 2024-09-10T22:22:29.208 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:22:29 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T22:22:29.359 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:22:29 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.9"} : dispatch 2024-09-10T22:22:29.360 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:22:29 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T22:22:29.375 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:22:29 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.9"} : dispatch 2024-09-10T22:22:29.375 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:22:29 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T22:22:30.360 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:22:30 smithi135 ceph-mon[34789]: pgmap v206: 1 pgs: 1 active+clean; 577 KiB data, 272 MiB used, 804 GiB / 805 GiB avail; 68 KiB/s, 0 objects/s recovering 2024-09-10T22:22:30.360 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:22:30 smithi135 ceph-mon[34789]: Deploying daemon osd.9 on smithi019 2024-09-10T22:22:30.375 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:22:30 smithi138 ceph-mon[35236]: pgmap v206: 1 pgs: 1 active+clean; 577 KiB data, 272 MiB used, 804 GiB / 805 GiB avail; 68 KiB/s, 0 objects/s recovering 2024-09-10T22:22:30.375 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:22:30 smithi138 ceph-mon[35236]: Deploying daemon osd.9 on smithi019 2024-09-10T22:22:30.458 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:22:30 smithi019 ceph-mon[31375]: pgmap v206: 1 pgs: 1 active+clean; 577 KiB data, 272 MiB used, 804 GiB / 805 GiB avail; 68 KiB/s, 0 objects/s recovering 2024-09-10T22:22:30.458 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:22:30 smithi019 ceph-mon[31375]: Deploying daemon osd.9 on smithi019 2024-09-10T22:22:32.330 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:22:32 smithi019 ceph-mon[31375]: pgmap v207: 1 pgs: 1 active+clean; 577 KiB data, 272 MiB used, 804 GiB / 805 GiB avail; 56 KiB/s, 0 objects/s recovering 2024-09-10T22:22:32.359 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:22:32 smithi135 ceph-mon[34789]: pgmap v207: 1 pgs: 1 active+clean; 577 KiB data, 272 MiB used, 804 GiB / 805 GiB avail; 56 KiB/s, 0 objects/s recovering 2024-09-10T22:22:32.375 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:22:32 smithi138 ceph-mon[35236]: pgmap v207: 1 pgs: 1 active+clean; 577 KiB data, 272 MiB used, 804 GiB / 805 GiB avail; 56 KiB/s, 0 objects/s recovering 2024-09-10T22:22:34.359 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:22:34 smithi135 ceph-mon[34789]: pgmap v208: 1 pgs: 1 active+clean; 577 KiB data, 272 MiB used, 804 GiB / 805 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-10T22:22:34.375 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:22:34 smithi138 ceph-mon[35236]: pgmap v208: 1 pgs: 1 active+clean; 577 KiB data, 272 MiB used, 804 GiB / 805 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-10T22:22:34.421 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:22:34 smithi019 ceph-mon[31375]: pgmap v208: 1 pgs: 1 active+clean; 577 KiB data, 272 MiB used, 804 GiB / 805 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-10T22:22:35.359 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:22:35 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T22:22:35.360 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:22:35 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:22:35.360 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:22:35 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:22:35.370 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:22:35 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T22:22:35.370 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:22:35 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:22:35.370 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:22:35 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:22:35.375 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:22:35 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T22:22:35.375 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:22:35 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:22:35.375 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:22:35 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:22:36.159 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:22:36 smithi019 ceph-mon[31375]: pgmap v209: 1 pgs: 1 active+clean; 577 KiB data, 272 MiB used, 804 GiB / 805 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-10T22:22:36.359 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:22:36 smithi135 ceph-mon[34789]: pgmap v209: 1 pgs: 1 active+clean; 577 KiB data, 272 MiB used, 804 GiB / 805 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-10T22:22:36.375 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:22:36 smithi138 ceph-mon[35236]: pgmap v209: 1 pgs: 1 active+clean; 577 KiB data, 272 MiB used, 804 GiB / 805 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-10T22:22:38.360 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:22:38 smithi135 ceph-mon[34789]: pgmap v210: 1 pgs: 1 active+clean; 577 KiB data, 272 MiB used, 804 GiB / 805 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-10T22:22:38.360 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:22:38 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:22:38.360 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:22:38 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:22:38.360 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:22:38 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T22:22:38.360 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:22:38 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T22:22:38.360 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:22:38 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:22:38.375 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:22:38 smithi138 ceph-mon[35236]: pgmap v210: 1 pgs: 1 active+clean; 577 KiB data, 272 MiB used, 804 GiB / 805 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-10T22:22:38.375 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:22:38 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:22:38.375 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:22:38 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:22:38.375 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:22:38 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T22:22:38.375 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:22:38 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T22:22:38.375 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:22:38 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:22:38.401 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:22:38 smithi019 ceph-mon[31375]: pgmap v210: 1 pgs: 1 active+clean; 577 KiB data, 272 MiB used, 804 GiB / 805 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-10T22:22:38.401 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:22:38 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:22:38.402 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:22:38 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:22:38.402 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:22:38 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T22:22:38.402 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:22:38 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T22:22:38.402 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:22:38 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:22:38.449 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:22:38.447+0000 7f39f37fe640 1 -- 172.21.15.19:0/2411463179 <== mgr.14150 v2:172.21.15.19:6800/2119495487 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f3a04063590 con 0x7f39ec0b5360 2024-09-10T22:22:38.450 INFO:teuthology.orchestra.run.smithi019.stdout:Created osd(s) 9 on host 'smithi019' 2024-09-10T22:22:38.452 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:22:38.450+0000 7f3a08d6a640 1 -- 172.21.15.19:0/2411463179 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f39ec0b5360 msgr2=0x7f39ec0b7820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:22:38.452 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:22:38.450+0000 7f3a08d6a640 1 --2- 172.21.15.19:0/2411463179 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f39ec0b5360 0x7f39ec0b7820 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f39f4006010 tx=0x7f39f4031430 comp rx=0 tx=0).stop 2024-09-10T22:22:38.452 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:22:38.450+0000 7f3a08d6a640 1 -- 172.21.15.19:0/2411463179 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3a04105da0 msgr2=0x7f3a0419b6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:22:38.452 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:22:38.450+0000 7f3a08d6a640 1 --2- 172.21.15.19:0/2411463179 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3a04105da0 0x7f3a0419b6f0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f39f800e9f0 tx=0x7f39f800edf0 comp rx=0 tx=0).stop 2024-09-10T22:22:38.452 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:22:38.450+0000 7f3a08d6a640 1 -- 172.21.15.19:0/2411463179 shutdown_connections 2024-09-10T22:22:38.452 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:22:38.450+0000 7f3a08d6a640 1 --2- 172.21.15.19:0/2411463179 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f39ec0b5360 0x7f39ec0b7820 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:22:38.452 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:22:38.450+0000 7f3a08d6a640 1 --2- 172.21.15.19:0/2411463179 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3a04106760 0x7f3a0419c330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:22:38.452 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:22:38.450+0000 7f3a08d6a640 1 --2- 172.21.15.19:0/2411463179 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3a04105da0 0x7f3a0419b6f0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:22:38.452 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:22:38.450+0000 7f3a08d6a640 1 --2- 172.21.15.19:0/2411463179 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3a04104c40 0x7f3a0419b0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:22:38.452 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:22:38.450+0000 7f3a08d6a640 1 -- 172.21.15.19:0/2411463179 >> 172.21.15.19:0/2411463179 conn(0x7f3a04100510 msgr2=0x7f3a04109210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:22:38.452 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:22:38.450+0000 7f3a08d6a640 1 -- 172.21.15.19:0/2411463179 shutdown_connections 2024-09-10T22:22:38.453 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:22:38.450+0000 7f3a08d6a640 1 -- 172.21.15.19:0/2411463179 wait complete. 2024-09-10T22:22:39.048 DEBUG:teuthology.orchestra.run.smithi019:osd.9> sudo journalctl -f -n 0 -u ceph-22997a4c-6fc2-11ef-bcea-c7b262605968@osd.9.service 2024-09-10T22:22:39.051 INFO:tasks.cephadm:Deploying osd.10 on smithi135 with /dev/vg_nvme/lv_1... 2024-09-10T22:22:39.051 DEBUG:teuthology.orchestra.run.smithi135:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 22997a4c-6fc2-11ef-bcea-c7b262605968 -- lvm zap /dev/vg_nvme/lv_1 2024-09-10T22:22:39.301 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:22:39 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T22:22:39.302 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:22:39 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:22:39.302 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:22:39 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:22:39.309 INFO:teuthology.orchestra.run.smithi135.stderr:Inferring config /var/lib/ceph/22997a4c-6fc2-11ef-bcea-c7b262605968/mon.b/config 2024-09-10T22:22:39.359 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:22:39 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T22:22:39.359 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:22:39 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:22:39.360 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:22:39 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:22:39.375 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:22:39 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T22:22:39.375 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:22:39 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:22:39.375 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:22:39 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:22:40.359 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:22:40 smithi135 ceph-mon[34789]: pgmap v211: 1 pgs: 1 active+clean; 577 KiB data, 272 MiB used, 804 GiB / 805 GiB avail 2024-09-10T22:22:40.374 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:22:40 smithi138 ceph-mon[35236]: pgmap v211: 1 pgs: 1 active+clean; 577 KiB data, 272 MiB used, 804 GiB / 805 GiB avail 2024-09-10T22:22:40.426 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:22:40 smithi019 ceph-mon[31375]: pgmap v211: 1 pgs: 1 active+clean; 577 KiB data, 272 MiB used, 804 GiB / 805 GiB avail 2024-09-10T22:22:40.958 INFO:journalctl@ceph.osd.9.smithi019.stdout:Sep 10 22:22:40 smithi019 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-9[68022]: 2024-09-10T22:22:40.710+0000 7fa3fcc27640 -1 osd.9 0 log_to_monitors true 2024-09-10T22:22:41.365 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:22:41 smithi135 ceph-mon[34789]: pgmap v212: 1 pgs: 1 active+clean; 577 KiB data, 272 MiB used, 804 GiB / 805 GiB avail 2024-09-10T22:22:41.365 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:22:41 smithi135 ceph-mon[34789]: from='osd.9 [v2:172.21.15.19:6826/1488680899,v1:172.21.15.19:6827/1488680899]' entity='osd.9' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]} : dispatch 2024-09-10T22:22:41.375 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:22:41 smithi138 ceph-mon[35236]: pgmap v212: 1 pgs: 1 active+clean; 577 KiB data, 272 MiB used, 804 GiB / 805 GiB avail 2024-09-10T22:22:41.375 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:22:41 smithi138 ceph-mon[35236]: from='osd.9 [v2:172.21.15.19:6826/1488680899,v1:172.21.15.19:6827/1488680899]' entity='osd.9' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]} : dispatch 2024-09-10T22:22:41.473 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:22:41 smithi019 ceph-mon[31375]: pgmap v212: 1 pgs: 1 active+clean; 577 KiB data, 272 MiB used, 804 GiB / 805 GiB avail 2024-09-10T22:22:41.473 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:22:41 smithi019 ceph-mon[31375]: from='osd.9 [v2:172.21.15.19:6826/1488680899,v1:172.21.15.19:6827/1488680899]' entity='osd.9' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]} : dispatch 2024-09-10T22:22:42.112 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-09-10T22:22:42.140 DEBUG:teuthology.orchestra.run.smithi135:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 22997a4c-6fc2-11ef-bcea-c7b262605968 -- ceph orch daemon add osd smithi135:vg_nvme/lv_1 2024-09-10T22:22:42.360 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:22:42 smithi135 ceph-mon[34789]: from='osd.9 [v2:172.21.15.19:6826/1488680899,v1:172.21.15.19:6827/1488680899]' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2024-09-10T22:22:42.360 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:22:42 smithi135 ceph-mon[34789]: osdmap e55: 10 total, 9 up, 10 in 2024-09-10T22:22:42.360 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:22:42 smithi135 ceph-mon[34789]: from='osd.9 [v2:172.21.15.19:6826/1488680899,v1:172.21.15.19:6827/1488680899]' entity='osd.9' cmd={"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi019", "root=default"]} : dispatch 2024-09-10T22:22:42.360 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:22:42 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-10T22:22:42.360 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:22:42 smithi135 ceph-mon[34789]: Detected new or changed devices on smithi019 2024-09-10T22:22:42.360 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:22:42 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:22:42.360 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:22:42 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:22:42.360 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:22:42 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-10T22:22:42.360 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:22:42 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-09-10T22:22:42.360 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:22:42 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2024-09-10T22:22:42.360 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:22:42 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"} : dispatch 2024-09-10T22:22:42.360 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:22:42 smithi135 ceph-mon[34789]: Adjusting osd_memory_target on smithi019 to 4273M 2024-09-10T22:22:42.361 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:22:42 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:22:42.361 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:22:42 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T22:22:42.361 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:22:42 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T22:22:42.361 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:22:42 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:22:42.375 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:22:42 smithi138 ceph-mon[35236]: from='osd.9 [v2:172.21.15.19:6826/1488680899,v1:172.21.15.19:6827/1488680899]' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2024-09-10T22:22:42.375 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:22:42 smithi138 ceph-mon[35236]: osdmap e55: 10 total, 9 up, 10 in 2024-09-10T22:22:42.375 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:22:42 smithi138 ceph-mon[35236]: from='osd.9 [v2:172.21.15.19:6826/1488680899,v1:172.21.15.19:6827/1488680899]' entity='osd.9' cmd={"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi019", "root=default"]} : dispatch 2024-09-10T22:22:42.375 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:22:42 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-10T22:22:42.375 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:22:42 smithi138 ceph-mon[35236]: Detected new or changed devices on smithi019 2024-09-10T22:22:42.375 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:22:42 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:22:42.376 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:22:42 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:22:42.376 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:22:42 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-10T22:22:42.376 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:22:42 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-09-10T22:22:42.376 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:22:42 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2024-09-10T22:22:42.376 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:22:42 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"} : dispatch 2024-09-10T22:22:42.376 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:22:42 smithi138 ceph-mon[35236]: Adjusting osd_memory_target on smithi019 to 4273M 2024-09-10T22:22:42.376 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:22:42 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:22:42.376 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:22:42 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T22:22:42.376 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:22:42 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T22:22:42.376 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:22:42 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:22:42.386 INFO:teuthology.orchestra.run.smithi135.stderr:Inferring config /var/lib/ceph/22997a4c-6fc2-11ef-bcea-c7b262605968/mon.b/config 2024-09-10T22:22:42.458 INFO:journalctl@ceph.osd.9.smithi019.stdout:Sep 10 22:22:42 smithi019 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-9[68022]: 2024-09-10T22:22:42.110+0000 7fa3f8baa640 -1 osd.9 0 waiting for initial osdmap 2024-09-10T22:22:42.459 INFO:journalctl@ceph.osd.9.smithi019.stdout:Sep 10 22:22:42 smithi019 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-9[68022]: 2024-09-10T22:22:42.122+0000 7fa3f49d1640 -1 osd.9 56 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-10T22:22:42.459 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:22:42 smithi019 ceph-mon[31375]: from='osd.9 [v2:172.21.15.19:6826/1488680899,v1:172.21.15.19:6827/1488680899]' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2024-09-10T22:22:42.459 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:22:42 smithi019 ceph-mon[31375]: osdmap e55: 10 total, 9 up, 10 in 2024-09-10T22:22:42.459 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:22:42 smithi019 ceph-mon[31375]: from='osd.9 [v2:172.21.15.19:6826/1488680899,v1:172.21.15.19:6827/1488680899]' entity='osd.9' cmd={"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi019", "root=default"]} : dispatch 2024-09-10T22:22:42.459 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:22:42 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-10T22:22:42.459 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:22:42 smithi019 ceph-mon[31375]: Detected new or changed devices on smithi019 2024-09-10T22:22:42.459 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:22:42 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:22:42.459 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:22:42 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:22:42.459 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:22:42 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-10T22:22:42.459 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:22:42 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-09-10T22:22:42.460 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:22:42 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2024-09-10T22:22:42.460 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:22:42 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"} : dispatch 2024-09-10T22:22:42.460 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:22:42 smithi019 ceph-mon[31375]: Adjusting osd_memory_target on smithi019 to 4273M 2024-09-10T22:22:42.460 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:22:42 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:22:42.460 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:22:42 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T22:22:42.460 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:22:42 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T22:22:42.460 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:22:42 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:22:42.797 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T22:22:42.794+0000 7ff4d06e5640 1 -- 172.21.15.135:0/1916870572 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff4c8108730 msgr2=0x7ff4c810abf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:22:42.798 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T22:22:42.794+0000 7ff4d06e5640 1 --2- 172.21.15.135:0/1916870572 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff4c8108730 0x7ff4c810abf0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7ff4b8009ca0 tx=0x7ff4b802a8c0 comp rx=0 tx=0).stop 2024-09-10T22:22:42.798 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T22:22:42.794+0000 7ff4d06e5640 1 -- 172.21.15.135:0/1916870572 shutdown_connections 2024-09-10T22:22:42.798 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T22:22:42.794+0000 7ff4d06e5640 1 --2- 172.21.15.135:0/1916870572 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff4c8108730 0x7ff4c810abf0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:22:42.798 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T22:22:42.794+0000 7ff4d06e5640 1 --2- 172.21.15.135:0/1916870572 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff4c8105b80 0x7ff4c8107ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:22:42.798 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T22:22:42.794+0000 7ff4d06e5640 1 --2- 172.21.15.135:0/1916870572 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff4c806b6e0 0x7ff4c81055f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:22:42.798 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T22:22:42.794+0000 7ff4d06e5640 1 -- 172.21.15.135:0/1916870572 >> 172.21.15.135:0/1916870572 conn(0x7ff4c80fd1e0 msgr2=0x7ff4c80ff620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:22:42.798 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T22:22:42.794+0000 7ff4d06e5640 1 -- 172.21.15.135:0/1916870572 shutdown_connections 2024-09-10T22:22:42.798 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T22:22:42.794+0000 7ff4d06e5640 1 -- 172.21.15.135:0/1916870572 wait complete. 2024-09-10T22:22:42.798 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T22:22:42.794+0000 7ff4d06e5640 1 Processor -- start 2024-09-10T22:22:42.799 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T22:22:42.795+0000 7ff4d06e5640 1 -- start start 2024-09-10T22:22:42.799 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T22:22:42.795+0000 7ff4d06e5640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff4c806b6e0 0x7ff4c8198ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:22:42.799 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T22:22:42.795+0000 7ff4d06e5640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff4c8105b80 0x7ff4c8199330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:22:42.799 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T22:22:42.795+0000 7ff4d06e5640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff4c8108730 0x7ff4c8199f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:22:42.799 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T22:22:42.795+0000 7ff4d06e5640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7ff4c810e680 con 0x7ff4c806b6e0 2024-09-10T22:22:42.799 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T22:22:42.795+0000 7ff4d06e5640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7ff4c810e500 con 0x7ff4c8105b80 2024-09-10T22:22:42.799 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T22:22:42.795+0000 7ff4d06e5640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7ff4c810e800 con 0x7ff4c8108730 2024-09-10T22:22:42.799 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T22:22:42.795+0000 7ff4cdc80640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff4c8105b80 0x7ff4c8199330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:22:42.799 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T22:22:42.795+0000 7ff4cdc80640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff4c8105b80 0x7ff4c8199330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:44786/0 (socket says 172.21.15.135:44786) 2024-09-10T22:22:42.799 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T22:22:42.795+0000 7ff4cdc80640 1 -- 172.21.15.135:0/1922903402 learned_addr learned my addr 172.21.15.135:0/1922903402 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-09-10T22:22:42.799 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T22:22:42.795+0000 7ff4cec82640 1 --2- 172.21.15.135:0/1922903402 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff4c8108730 0x7ff4c8199f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:22:42.800 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T22:22:42.795+0000 7ff4ce481640 1 --2- 172.21.15.135:0/1922903402 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff4c806b6e0 0x7ff4c8198ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:22:42.800 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T22:22:42.795+0000 7ff4cdc80640 1 -- 172.21.15.135:0/1922903402 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff4c8108730 msgr2=0x7ff4c8199f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:22:42.800 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T22:22:42.795+0000 7ff4cdc80640 1 --2- 172.21.15.135:0/1922903402 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff4c8108730 0x7ff4c8199f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:22:42.800 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T22:22:42.795+0000 7ff4cdc80640 1 -- 172.21.15.135:0/1922903402 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff4c806b6e0 msgr2=0x7ff4c8198ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:22:42.800 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T22:22:42.795+0000 7ff4cdc80640 1 --2- 172.21.15.135:0/1922903402 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff4c806b6e0 0x7ff4c8198ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:22:42.800 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T22:22:42.795+0000 7ff4cdc80640 1 -- 172.21.15.135:0/1922903402 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff4c819a810 con 0x7ff4c8105b80 2024-09-10T22:22:42.800 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T22:22:42.795+0000 7ff4ce481640 1 --2- 172.21.15.135:0/1922903402 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff4c806b6e0 0x7ff4c8198ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T22:22:42.800 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T22:22:42.795+0000 7ff4cec82640 1 --2- 172.21.15.135:0/1922903402 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff4c8108730 0x7ff4c8199f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T22:22:42.800 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T22:22:42.795+0000 7ff4cdc80640 1 --2- 172.21.15.135:0/1922903402 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff4c8105b80 0x7ff4c8199330 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7ff4bc00c970 tx=0x7ff4bc00ce30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:22:42.800 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T22:22:42.795+0000 7ff4c77fe640 1 -- 172.21.15.135:0/1922903402 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4bc014070 con 0x7ff4c8105b80 2024-09-10T22:22:42.800 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T22:22:42.795+0000 7ff4c77fe640 1 -- 172.21.15.135:0/1922903402 <== mon.2 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff4bc004440 con 0x7ff4c8105b80 2024-09-10T22:22:42.801 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T22:22:42.796+0000 7ff4d06e5640 1 -- 172.21.15.135:0/1922903402 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff4c819ab00 con 0x7ff4c8105b80 2024-09-10T22:22:42.801 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T22:22:42.796+0000 7ff4c77fe640 1 -- 172.21.15.135:0/1922903402 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4bc003e50 con 0x7ff4c8105b80 2024-09-10T22:22:42.801 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T22:22:42.796+0000 7ff4d06e5640 1 -- 172.21.15.135:0/1922903402 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff4c81a11e0 con 0x7ff4c8105b80 2024-09-10T22:22:42.801 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T22:22:42.797+0000 7ff4d06e5640 1 -- 172.21.15.135:0/1922903402 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff4c80fecd0 con 0x7ff4c8105b80 2024-09-10T22:22:42.802 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T22:22:42.798+0000 7ff4c77fe640 1 -- 172.21.15.135:0/1922903402 <== mon.2 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 16) ==== 153250+0+0 (secure 0 0 0) 0x7ff4bc007860 con 0x7ff4c8105b80 2024-09-10T22:22:42.802 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T22:22:42.798+0000 7ff4c77fe640 1 --2- 172.21.15.135:0/1922903402 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7ff4b00b5480 0x7ff4b00b7940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:22:42.802 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T22:22:42.799+0000 7ff4c77fe640 1 -- 172.21.15.135:0/1922903402 <== mon.2 v2:172.21.15.135:3300/0 5 ==== osd_map(56..56 src has 1..56) ==== 5981+0+0 (secure 0 0 0) 0x7ff4bc0e5920 con 0x7ff4c8105b80 2024-09-10T22:22:42.802 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T22:22:42.799+0000 7ff4ce481640 1 --2- 172.21.15.135:0/1922903402 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7ff4b00b5480 0x7ff4b00b7940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:22:42.802 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T22:22:42.799+0000 7ff4ce481640 1 --2- 172.21.15.135:0/1922903402 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7ff4b00b5480 0x7ff4b00b7940 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7ff4c00058c0 tx=0x7ff4c0005ec0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:22:42.803 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T22:22:42.802+0000 7ff4c77fe640 1 -- 172.21.15.135:0/1922903402 <== mon.2 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7ff4bc01e030 con 0x7ff4c8105b80 2024-09-10T22:22:42.991 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T22:22:42.989+0000 7ff4d06e5640 1 -- 172.21.15.135:0/1922903402 --> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi135:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) -- 0x7ff4c8063590 con 0x7ff4b00b5480 2024-09-10T22:22:43.375 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:22:43 smithi138 ceph-mon[35236]: from='osd.9 [v2:172.21.15.19:6826/1488680899,v1:172.21.15.19:6827/1488680899]' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi019", "root=default"]}]': finished 2024-09-10T22:22:43.375 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:22:43 smithi138 ceph-mon[35236]: osdmap e56: 10 total, 9 up, 10 in 2024-09-10T22:22:43.375 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:22:43 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-10T22:22:43.375 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:22:43 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-10T22:22:43.375 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:22:43 smithi138 ceph-mon[35236]: pgmap v215: 1 pgs: 1 active+clean; 577 KiB data, 272 MiB used, 804 GiB / 805 GiB avail 2024-09-10T22:22:43.376 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:22:43 smithi138 ceph-mon[35236]: from='client.24443 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi135:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T22:22:43.376 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:22:43 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-10T22:22:43.376 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:22:43 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-10T22:22:43.376 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:22:43 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T22:22:43.406 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:22:43 smithi135 ceph-mon[34789]: from='osd.9 [v2:172.21.15.19:6826/1488680899,v1:172.21.15.19:6827/1488680899]' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi019", "root=default"]}]': finished 2024-09-10T22:22:43.406 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:22:43 smithi135 ceph-mon[34789]: osdmap e56: 10 total, 9 up, 10 in 2024-09-10T22:22:43.406 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:22:43 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-10T22:22:43.406 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:22:43 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-10T22:22:43.407 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:22:43 smithi135 ceph-mon[34789]: pgmap v215: 1 pgs: 1 active+clean; 577 KiB data, 272 MiB used, 804 GiB / 805 GiB avail 2024-09-10T22:22:43.407 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:22:43 smithi135 ceph-mon[34789]: from='client.24443 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi135:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T22:22:43.407 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:22:43 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-10T22:22:43.407 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:22:43 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-10T22:22:43.407 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:22:43 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T22:22:43.458 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:22:43 smithi019 ceph-mon[31375]: from='osd.9 [v2:172.21.15.19:6826/1488680899,v1:172.21.15.19:6827/1488680899]' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi019", "root=default"]}]': finished 2024-09-10T22:22:43.458 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:22:43 smithi019 ceph-mon[31375]: osdmap e56: 10 total, 9 up, 10 in 2024-09-10T22:22:43.458 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:22:43 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-10T22:22:43.458 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:22:43 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-10T22:22:43.459 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:22:43 smithi019 ceph-mon[31375]: pgmap v215: 1 pgs: 1 active+clean; 577 KiB data, 272 MiB used, 804 GiB / 805 GiB avail 2024-09-10T22:22:43.459 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:22:43 smithi019 ceph-mon[31375]: from='client.24443 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi135:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T22:22:43.459 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:22:43 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-10T22:22:43.459 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:22:43 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-10T22:22:43.459 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:22:43 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T22:22:44.375 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:22:44 smithi138 ceph-mon[35236]: purged_snaps scrub starts 2024-09-10T22:22:44.375 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:22:44 smithi138 ceph-mon[35236]: purged_snaps scrub ok 2024-09-10T22:22:44.375 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:22:44 smithi138 ceph-mon[35236]: osd.9 [v2:172.21.15.19:6826/1488680899,v1:172.21.15.19:6827/1488680899] boot 2024-09-10T22:22:44.375 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:22:44 smithi138 ceph-mon[35236]: osdmap e57: 10 total, 10 up, 10 in 2024-09-10T22:22:44.375 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:22:44 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-10T22:22:44.378 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:22:44 smithi135 ceph-mon[34789]: purged_snaps scrub starts 2024-09-10T22:22:44.379 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:22:44 smithi135 ceph-mon[34789]: purged_snaps scrub ok 2024-09-10T22:22:44.379 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:22:44 smithi135 ceph-mon[34789]: osd.9 [v2:172.21.15.19:6826/1488680899,v1:172.21.15.19:6827/1488680899] boot 2024-09-10T22:22:44.379 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:22:44 smithi135 ceph-mon[34789]: osdmap e57: 10 total, 10 up, 10 in 2024-09-10T22:22:44.379 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:22:44 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-10T22:22:44.458 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:22:44 smithi019 ceph-mon[31375]: purged_snaps scrub starts 2024-09-10T22:22:44.458 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:22:44 smithi019 ceph-mon[31375]: purged_snaps scrub ok 2024-09-10T22:22:44.458 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:22:44 smithi019 ceph-mon[31375]: osd.9 [v2:172.21.15.19:6826/1488680899,v1:172.21.15.19:6827/1488680899] boot 2024-09-10T22:22:44.459 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:22:44 smithi019 ceph-mon[31375]: osdmap e57: 10 total, 10 up, 10 in 2024-09-10T22:22:44.459 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:22:44 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-10T22:22:45.359 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:22:45 smithi135 ceph-mon[34789]: osdmap e58: 10 total, 10 up, 10 in 2024-09-10T22:22:45.359 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:22:45 smithi135 ceph-mon[34789]: pgmap v218: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 894 GiB / 894 GiB avail 2024-09-10T22:22:45.375 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:22:45 smithi138 ceph-mon[35236]: osdmap e58: 10 total, 10 up, 10 in 2024-09-10T22:22:45.375 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:22:45 smithi138 ceph-mon[35236]: pgmap v218: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 894 GiB / 894 GiB avail 2024-09-10T22:22:45.458 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:22:45 smithi019 ceph-mon[31375]: osdmap e58: 10 total, 10 up, 10 in 2024-09-10T22:22:45.458 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:22:45 smithi019 ceph-mon[31375]: pgmap v218: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 894 GiB / 894 GiB avail 2024-09-10T22:22:46.360 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:22:46 smithi135 ceph-mon[34789]: from='client.? 172.21.15.135:0/2793807555' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "b8a2d69a-6821-4c69-b7eb-c0cfc8164614"} : dispatch 2024-09-10T22:22:46.360 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:22:46 smithi135 ceph-mon[34789]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "b8a2d69a-6821-4c69-b7eb-c0cfc8164614"} : dispatch 2024-09-10T22:22:46.360 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:22:46 smithi135 ceph-mon[34789]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "b8a2d69a-6821-4c69-b7eb-c0cfc8164614"}]': finished 2024-09-10T22:22:46.360 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:22:46 smithi135 ceph-mon[34789]: osdmap e59: 11 total, 10 up, 11 in 2024-09-10T22:22:46.360 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:22:46 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-10T22:22:46.360 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:22:46 smithi135 ceph-mon[34789]: from='client.? 172.21.15.135:0/137832417' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-10T22:22:46.458 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:22:46 smithi019 ceph-mon[31375]: from='client.? 172.21.15.135:0/2793807555' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "b8a2d69a-6821-4c69-b7eb-c0cfc8164614"} : dispatch 2024-09-10T22:22:46.458 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:22:46 smithi019 ceph-mon[31375]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "b8a2d69a-6821-4c69-b7eb-c0cfc8164614"} : dispatch 2024-09-10T22:22:46.458 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:22:46 smithi019 ceph-mon[31375]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "b8a2d69a-6821-4c69-b7eb-c0cfc8164614"}]': finished 2024-09-10T22:22:46.458 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:22:46 smithi019 ceph-mon[31375]: osdmap e59: 11 total, 10 up, 11 in 2024-09-10T22:22:46.458 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:22:46 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-10T22:22:46.458 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:22:46 smithi019 ceph-mon[31375]: from='client.? 172.21.15.135:0/137832417' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-10T22:22:46.625 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:22:46 smithi138 ceph-mon[35236]: from='client.? 172.21.15.135:0/2793807555' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "b8a2d69a-6821-4c69-b7eb-c0cfc8164614"} : dispatch 2024-09-10T22:22:46.625 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:22:46 smithi138 ceph-mon[35236]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "b8a2d69a-6821-4c69-b7eb-c0cfc8164614"} : dispatch 2024-09-10T22:22:46.625 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:22:46 smithi138 ceph-mon[35236]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "b8a2d69a-6821-4c69-b7eb-c0cfc8164614"}]': finished 2024-09-10T22:22:46.625 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:22:46 smithi138 ceph-mon[35236]: osdmap e59: 11 total, 10 up, 11 in 2024-09-10T22:22:46.625 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:22:46 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-10T22:22:46.625 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:22:46 smithi138 ceph-mon[35236]: from='client.? 172.21.15.135:0/137832417' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-10T22:22:47.458 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:22:47 smithi019 ceph-mon[31375]: pgmap v220: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 894 GiB / 894 GiB avail 2024-09-10T22:22:47.609 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:22:47 smithi135 ceph-mon[34789]: pgmap v220: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 894 GiB / 894 GiB avail 2024-09-10T22:22:47.625 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:22:47 smithi138 ceph-mon[35236]: pgmap v220: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 894 GiB / 894 GiB avail 2024-09-10T22:22:49.664 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:22:49 smithi135 ceph-mon[34789]: pgmap v221: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 894 GiB / 894 GiB avail 2024-09-10T22:22:49.702 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:22:49 smithi138 ceph-mon[35236]: pgmap v221: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 894 GiB / 894 GiB avail 2024-09-10T22:22:49.708 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:22:49 smithi019 ceph-mon[31375]: pgmap v221: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 894 GiB / 894 GiB avail 2024-09-10T22:22:51.609 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:22:51 smithi135 ceph-mon[34789]: pgmap v222: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 894 GiB / 894 GiB avail 2024-09-10T22:22:51.708 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:22:51 smithi019 ceph-mon[31375]: pgmap v222: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 894 GiB / 894 GiB avail 2024-09-10T22:22:51.875 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:22:51 smithi138 ceph-mon[35236]: pgmap v222: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 894 GiB / 894 GiB avail 2024-09-10T22:22:53.553 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:22:53 smithi135 ceph-mon[34789]: pgmap v223: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 894 GiB / 894 GiB avail 2024-09-10T22:22:53.708 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:22:53 smithi019 ceph-mon[31375]: pgmap v223: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 894 GiB / 894 GiB avail 2024-09-10T22:22:53.875 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:22:53 smithi138 ceph-mon[35236]: pgmap v223: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 894 GiB / 894 GiB avail 2024-09-10T22:22:54.519 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:22:54 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.10"} : dispatch 2024-09-10T22:22:54.519 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:22:54 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T22:22:54.520 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:22:54 smithi135 ceph-mon[34789]: Deploying daemon osd.10 on smithi135 2024-09-10T22:22:54.708 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:22:54 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.10"} : dispatch 2024-09-10T22:22:54.708 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:22:54 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T22:22:54.708 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:22:54 smithi019 ceph-mon[31375]: Deploying daemon osd.10 on smithi135 2024-09-10T22:22:54.875 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:22:54 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.10"} : dispatch 2024-09-10T22:22:54.875 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:22:54 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T22:22:54.875 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:22:54 smithi138 ceph-mon[35236]: Deploying daemon osd.10 on smithi135 2024-09-10T22:22:55.485 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:22:55 smithi135 ceph-mon[34789]: pgmap v224: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 894 GiB / 894 GiB avail 2024-09-10T22:22:55.708 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:22:55 smithi019 ceph-mon[31375]: pgmap v224: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 894 GiB / 894 GiB avail 2024-09-10T22:22:55.875 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:22:55 smithi138 ceph-mon[35236]: pgmap v224: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 894 GiB / 894 GiB avail 2024-09-10T22:22:57.708 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:22:57 smithi019 ceph-mon[31375]: pgmap v225: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 894 GiB / 894 GiB avail 2024-09-10T22:22:57.860 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:22:57 smithi135 ceph-mon[34789]: pgmap v225: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 894 GiB / 894 GiB avail 2024-09-10T22:22:57.875 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:22:57 smithi138 ceph-mon[35236]: pgmap v225: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 894 GiB / 894 GiB avail 2024-09-10T22:22:59.708 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:22:59 smithi019 ceph-mon[31375]: pgmap v226: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 894 GiB / 894 GiB avail 2024-09-10T22:22:59.708 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:22:59 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T22:22:59.709 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:22:59 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:22:59.709 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:22:59 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:22:59.817 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:22:59 smithi135 ceph-mon[34789]: pgmap v226: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 894 GiB / 894 GiB avail 2024-09-10T22:22:59.817 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:22:59 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T22:22:59.817 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:22:59 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:22:59.818 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:22:59 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:22:59.875 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:22:59 smithi138 ceph-mon[35236]: pgmap v226: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 894 GiB / 894 GiB avail 2024-09-10T22:22:59.875 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:22:59 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T22:22:59.875 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:22:59 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:22:59.875 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:22:59 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:23:01.708 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:23:01 smithi019 ceph-mon[31375]: pgmap v227: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 894 GiB / 894 GiB avail 2024-09-10T22:23:01.757 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:23:01 smithi135 ceph-mon[34789]: pgmap v227: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 894 GiB / 894 GiB avail 2024-09-10T22:23:01.875 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:23:01 smithi138 ceph-mon[35236]: pgmap v227: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 894 GiB / 894 GiB avail 2024-09-10T22:23:02.903 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T22:23:02.901+0000 7ff4c77fe640 1 -- 172.21.15.135:0/1922903402 <== mgr.14150 v2:172.21.15.19:6800/2119495487 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+38 (secure 0 0 0) 0x7ff4c8063590 con 0x7ff4b00b5480 2024-09-10T22:23:02.904 INFO:teuthology.orchestra.run.smithi135.stdout:Created osd(s) 10 on host 'smithi135' 2024-09-10T22:23:02.905 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T22:23:02.904+0000 7ff4d06e5640 1 -- 172.21.15.135:0/1922903402 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7ff4b00b5480 msgr2=0x7ff4b00b7940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:23:02.906 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T22:23:02.904+0000 7ff4d06e5640 1 --2- 172.21.15.135:0/1922903402 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7ff4b00b5480 0x7ff4b00b7940 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7ff4c00058c0 tx=0x7ff4c0005ec0 comp rx=0 tx=0).stop 2024-09-10T22:23:02.906 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T22:23:02.904+0000 7ff4d06e5640 1 -- 172.21.15.135:0/1922903402 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff4c8105b80 msgr2=0x7ff4c8199330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:23:02.906 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T22:23:02.904+0000 7ff4d06e5640 1 --2- 172.21.15.135:0/1922903402 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff4c8105b80 0x7ff4c8199330 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7ff4bc00c970 tx=0x7ff4bc00ce30 comp rx=0 tx=0).stop 2024-09-10T22:23:02.906 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T22:23:02.904+0000 7ff4d06e5640 1 -- 172.21.15.135:0/1922903402 shutdown_connections 2024-09-10T22:23:02.906 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T22:23:02.904+0000 7ff4d06e5640 1 --2- 172.21.15.135:0/1922903402 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7ff4b00b5480 0x7ff4b00b7940 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:23:02.906 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T22:23:02.904+0000 7ff4d06e5640 1 --2- 172.21.15.135:0/1922903402 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff4c8108730 0x7ff4c8199f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:23:02.906 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T22:23:02.904+0000 7ff4d06e5640 1 --2- 172.21.15.135:0/1922903402 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff4c8105b80 0x7ff4c8199330 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:23:02.906 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T22:23:02.904+0000 7ff4d06e5640 1 --2- 172.21.15.135:0/1922903402 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff4c806b6e0 0x7ff4c8198ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:23:02.906 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T22:23:02.904+0000 7ff4d06e5640 1 -- 172.21.15.135:0/1922903402 >> 172.21.15.135:0/1922903402 conn(0x7ff4c80fd1e0 msgr2=0x7ff4c8103e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:23:02.906 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T22:23:02.904+0000 7ff4d06e5640 1 -- 172.21.15.135:0/1922903402 shutdown_connections 2024-09-10T22:23:02.906 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-10T22:23:02.904+0000 7ff4d06e5640 1 -- 172.21.15.135:0/1922903402 wait complete. 2024-09-10T22:23:03.458 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:23:03 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:23:03.458 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:23:03 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:23:03.458 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:23:03 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T22:23:03.459 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:23:03 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T22:23:03.459 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:23:03 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:23:03.459 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:23:03 smithi135 ceph-mon[34789]: pgmap v228: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 894 GiB / 894 GiB avail 2024-09-10T22:23:03.459 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:23:03 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T22:23:03.459 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:23:03 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:23:03.459 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:23:03 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:23:03.494 DEBUG:teuthology.orchestra.run.smithi135:osd.10> sudo journalctl -f -n 0 -u ceph-22997a4c-6fc2-11ef-bcea-c7b262605968@osd.10.service 2024-09-10T22:23:03.496 INFO:tasks.cephadm:Deploying osd.11 on smithi138 with /dev/vg_nvme/lv_1... 2024-09-10T22:23:03.496 DEBUG:teuthology.orchestra.run.smithi138:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 22997a4c-6fc2-11ef-bcea-c7b262605968 -- lvm zap /dev/vg_nvme/lv_1 2024-09-10T22:23:03.525 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:23:03 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:23:03.525 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:23:03 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:23:03.525 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:23:03 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T22:23:03.525 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:23:03 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T22:23:03.525 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:23:03 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:23:03.526 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:23:03 smithi138 ceph-mon[35236]: pgmap v228: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 894 GiB / 894 GiB avail 2024-09-10T22:23:03.526 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:23:03 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T22:23:03.526 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:23:03 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:23:03.526 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:23:03 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:23:03.708 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:23:03 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:23:03.708 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:23:03 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:23:03.708 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:23:03 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T22:23:03.708 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:23:03 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T22:23:03.708 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:23:03 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:23:03.709 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:23:03 smithi019 ceph-mon[31375]: pgmap v228: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 894 GiB / 894 GiB avail 2024-09-10T22:23:03.709 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:23:03 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T22:23:03.709 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:23:03 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:23:03.709 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:23:03 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:23:03.755 INFO:teuthology.orchestra.run.smithi138.stderr:Inferring config /var/lib/ceph/22997a4c-6fc2-11ef-bcea-c7b262605968/mon.c/config 2024-09-10T22:23:05.652 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:23:05 smithi138 ceph-mon[35236]: pgmap v229: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 894 GiB / 894 GiB avail 2024-09-10T22:23:05.708 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:23:05 smithi019 ceph-mon[31375]: pgmap v229: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 894 GiB / 894 GiB avail 2024-09-10T22:23:05.860 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:23:05 smithi135 ceph-mon[34789]: pgmap v229: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 894 GiB / 894 GiB avail 2024-09-10T22:23:05.860 INFO:journalctl@ceph.osd.10.smithi135.stdout:Sep 10 22:23:05 smithi135 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-10[59985]: 2024-09-10T22:23:05.413+0000 7f3bfc4c4640 -1 osd.10 0 log_to_monitors true 2024-09-10T22:23:06.179 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-10T22:23:06.207 DEBUG:teuthology.orchestra.run.smithi138:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 22997a4c-6fc2-11ef-bcea-c7b262605968 -- ceph orch daemon add osd smithi138:vg_nvme/lv_1 2024-09-10T22:23:06.487 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:23:06 smithi138 ceph-mon[35236]: from='osd.10 [v2:172.21.15.135:6824/3812626754,v1:172.21.15.135:6825/3812626754]' entity='osd.10' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]} : dispatch 2024-09-10T22:23:06.487 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:23:06 smithi138 ceph-mon[35236]: from='osd.10 ' entity='osd.10' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]} : dispatch 2024-09-10T22:23:06.487 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:23:06 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:23:06.487 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:23:06 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:23:06.487 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:23:06 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-10T22:23:06.487 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:23:06 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-09-10T22:23:06.487 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:23:06 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"} : dispatch 2024-09-10T22:23:06.487 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:23:06 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"} : dispatch 2024-09-10T22:23:06.487 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:23:06 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:23:06.487 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:23:06 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T22:23:06.487 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:23:06 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T22:23:06.487 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:23:06 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:23:06.503 INFO:teuthology.orchestra.run.smithi138.stderr:Inferring config /var/lib/ceph/22997a4c-6fc2-11ef-bcea-c7b262605968/mon.c/config 2024-09-10T22:23:06.609 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:23:06 smithi135 ceph-mon[34789]: from='osd.10 [v2:172.21.15.135:6824/3812626754,v1:172.21.15.135:6825/3812626754]' entity='osd.10' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]} : dispatch 2024-09-10T22:23:06.610 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:23:06 smithi135 ceph-mon[34789]: from='osd.10 ' entity='osd.10' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]} : dispatch 2024-09-10T22:23:06.610 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:23:06 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:23:06.610 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:23:06 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:23:06.610 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:23:06 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-10T22:23:06.610 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:23:06 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-09-10T22:23:06.610 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:23:06 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"} : dispatch 2024-09-10T22:23:06.610 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:23:06 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"} : dispatch 2024-09-10T22:23:06.610 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:23:06 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:23:06.610 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:23:06 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T22:23:06.610 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:23:06 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T22:23:06.610 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:23:06 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:23:06.708 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:23:06 smithi019 ceph-mon[31375]: from='osd.10 [v2:172.21.15.135:6824/3812626754,v1:172.21.15.135:6825/3812626754]' entity='osd.10' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]} : dispatch 2024-09-10T22:23:06.708 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:23:06 smithi019 ceph-mon[31375]: from='osd.10 ' entity='osd.10' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]} : dispatch 2024-09-10T22:23:06.709 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:23:06 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:23:06.709 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:23:06 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:23:06.709 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:23:06 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-10T22:23:06.709 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:23:06 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-09-10T22:23:06.709 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:23:06 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"} : dispatch 2024-09-10T22:23:06.709 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:23:06 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"} : dispatch 2024-09-10T22:23:06.709 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:23:06 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:23:06.709 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:23:06 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T22:23:06.709 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:23:06 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T22:23:06.709 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:23:06 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:23:06.953 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-10T22:23:06.949+0000 7ff61e02d640 1 -- 172.21.15.138:0/3331247320 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff618102a70 msgr2=0x7ff618102ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:23:06.953 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-10T22:23:06.949+0000 7ff61e02d640 1 --2- 172.21.15.138:0/3331247320 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff618102a70 0x7ff618102ef0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7ff600009960 tx=0x7ff60002a460 comp rx=0 tx=0).stop 2024-09-10T22:23:06.953 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-10T22:23:06.949+0000 7ff61e02d640 1 -- 172.21.15.138:0/3331247320 shutdown_connections 2024-09-10T22:23:06.953 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-10T22:23:06.949+0000 7ff61e02d640 1 --2- 172.21.15.138:0/3331247320 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff618103430 0x7ff618109db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:23:06.954 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-10T22:23:06.949+0000 7ff61e02d640 1 --2- 172.21.15.138:0/3331247320 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff618102a70 0x7ff618102ef0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:23:06.954 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-10T22:23:06.949+0000 7ff61e02d640 1 --2- 172.21.15.138:0/3331247320 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff618101910 0x7ff618101d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:23:06.954 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-10T22:23:06.949+0000 7ff61e02d640 1 -- 172.21.15.138:0/3331247320 >> 172.21.15.138:0/3331247320 conn(0x7ff6180fd1e0 msgr2=0x7ff6180ff620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:23:06.954 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-10T22:23:06.949+0000 7ff61e02d640 1 -- 172.21.15.138:0/3331247320 shutdown_connections 2024-09-10T22:23:06.954 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-10T22:23:06.949+0000 7ff61e02d640 1 -- 172.21.15.138:0/3331247320 wait complete. 2024-09-10T22:23:06.954 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-10T22:23:06.950+0000 7ff61e02d640 1 Processor -- start 2024-09-10T22:23:06.954 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-10T22:23:06.950+0000 7ff61e02d640 1 -- start start 2024-09-10T22:23:06.954 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-10T22:23:06.950+0000 7ff61e02d640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff618101910 0x7ff61806b450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:23:06.954 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-10T22:23:06.950+0000 7ff61e02d640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff618102a70 0x7ff61819db20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:23:06.954 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-10T22:23:06.950+0000 7ff61e02d640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff618103430 0x7ff6181a0160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:23:06.954 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-10T22:23:06.950+0000 7ff61e02d640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7ff61810d590 con 0x7ff618103430 2024-09-10T22:23:06.954 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-10T22:23:06.950+0000 7ff61e02d640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7ff61810d410 con 0x7ff618101910 2024-09-10T22:23:06.955 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-10T22:23:06.950+0000 7ff61e02d640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7ff61810d710 con 0x7ff618102a70 2024-09-10T22:23:06.955 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-10T22:23:06.950+0000 7ff616ffd640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff618102a70 0x7ff61819db20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:23:06.955 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-10T22:23:06.950+0000 7ff616ffd640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff618102a70 0x7ff61819db20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:37520/0 (socket says 172.21.15.138:37520) 2024-09-10T22:23:06.955 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-10T22:23:06.950+0000 7ff616ffd640 1 -- 172.21.15.138:0/2637716404 learned_addr learned my addr 172.21.15.138:0/2637716404 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-09-10T22:23:06.955 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-10T22:23:06.950+0000 7ff6177fe640 1 --2- 172.21.15.138:0/2637716404 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff618101910 0x7ff61806b450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:23:06.955 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-10T22:23:06.950+0000 7ff617fff640 1 --2- 172.21.15.138:0/2637716404 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff618103430 0x7ff6181a0160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:23:06.955 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-10T22:23:06.951+0000 7ff616ffd640 1 -- 172.21.15.138:0/2637716404 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff618101910 msgr2=0x7ff61806b450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:23:06.955 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-10T22:23:06.951+0000 7ff616ffd640 1 --2- 172.21.15.138:0/2637716404 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff618101910 0x7ff61806b450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:23:06.955 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-10T22:23:06.951+0000 7ff616ffd640 1 -- 172.21.15.138:0/2637716404 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff618103430 msgr2=0x7ff6181a0160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:23:06.955 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-10T22:23:06.951+0000 7ff616ffd640 1 --2- 172.21.15.138:0/2637716404 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff618103430 0x7ff6181a0160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:23:06.955 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-10T22:23:06.951+0000 7ff616ffd640 1 -- 172.21.15.138:0/2637716404 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff6181a0a20 con 0x7ff618102a70 2024-09-10T22:23:06.955 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-10T22:23:06.951+0000 7ff617fff640 1 --2- 172.21.15.138:0/2637716404 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff618103430 0x7ff6181a0160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T22:23:06.955 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-10T22:23:06.951+0000 7ff6177fe640 1 --2- 172.21.15.138:0/2637716404 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff618101910 0x7ff61806b450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T22:23:06.956 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-10T22:23:06.951+0000 7ff616ffd640 1 --2- 172.21.15.138:0/2637716404 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff618102a70 0x7ff61819db20 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7ff600006010 tx=0x7ff600004270 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:23:06.956 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-10T22:23:06.951+0000 7ff614ff9640 1 -- 172.21.15.138:0/2637716404 <== mon.1 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff60003f030 con 0x7ff618102a70 2024-09-10T22:23:06.956 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-10T22:23:06.951+0000 7ff61e02d640 1 -- 172.21.15.138:0/2637716404 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff6181a0cb0 con 0x7ff618102a70 2024-09-10T22:23:06.956 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-10T22:23:06.951+0000 7ff614ff9640 1 -- 172.21.15.138:0/2637716404 <== mon.1 v2:172.21.15.138:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff600003aa0 con 0x7ff618102a70 2024-09-10T22:23:06.956 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-10T22:23:06.951+0000 7ff614ff9640 1 -- 172.21.15.138:0/2637716404 <== mon.1 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff600035070 con 0x7ff618102a70 2024-09-10T22:23:06.956 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-10T22:23:06.951+0000 7ff61e02d640 1 -- 172.21.15.138:0/2637716404 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff6181a1190 con 0x7ff618102a70 2024-09-10T22:23:06.957 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-10T22:23:06.952+0000 7ff61e02d640 1 -- 172.21.15.138:0/2637716404 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff6181a13c0 con 0x7ff618102a70 2024-09-10T22:23:06.957 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-10T22:23:06.953+0000 7ff614ff9640 1 -- 172.21.15.138:0/2637716404 <== mon.1 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 16) ==== 153250+0+0 (secure 0 0 0) 0x7ff600003c50 con 0x7ff618102a70 2024-09-10T22:23:06.957 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-10T22:23:06.954+0000 7ff614ff9640 1 --2- 172.21.15.138:0/2637716404 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7ff6040b52e0 0x7ff6040b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:23:06.957 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-10T22:23:06.954+0000 7ff614ff9640 1 -- 172.21.15.138:0/2637716404 <== mon.1 v2:172.21.15.138:3300/0 5 ==== osd_map(60..60 src has 1..60) ==== 6398+0+0 (secure 0 0 0) 0x7ff600105bd0 con 0x7ff618102a70 2024-09-10T22:23:06.957 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-10T22:23:06.955+0000 7ff6177fe640 1 --2- 172.21.15.138:0/2637716404 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7ff6040b52e0 0x7ff6040b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:23:06.957 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-10T22:23:06.955+0000 7ff6177fe640 1 --2- 172.21.15.138:0/2637716404 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7ff6040b52e0 0x7ff6040b77a0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7ff610005fd0 tx=0x7ff61000b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:23:06.959 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-10T22:23:06.958+0000 7ff614ff9640 1 -- 172.21.15.138:0/2637716404 <== mon.1 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7ff6000cd210 con 0x7ff618102a70 2024-09-10T22:23:07.203 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-10T22:23:07.202+0000 7ff61e02d640 1 -- 172.21.15.138:0/2637716404 --> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi138:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) -- 0x7ff618104540 con 0x7ff6040b52e0 2024-09-10T22:23:07.529 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:23:07 smithi138 ceph-mon[35236]: Detected new or changed devices on smithi135 2024-09-10T22:23:07.529 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:23:07 smithi138 ceph-mon[35236]: Adjusting osd_memory_target on smithi135 to 1453M 2024-09-10T22:23:07.529 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:23:07 smithi138 ceph-mon[35236]: pgmap v230: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 894 GiB / 894 GiB avail 2024-09-10T22:23:07.529 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:23:07 smithi138 ceph-mon[35236]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2024-09-10T22:23:07.529 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:23:07 smithi138 ceph-mon[35236]: osdmap e60: 11 total, 10 up, 11 in 2024-09-10T22:23:07.529 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:23:07 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-10T22:23:07.529 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:23:07 smithi138 ceph-mon[35236]: from='osd.10 [v2:172.21.15.135:6824/3812626754,v1:172.21.15.135:6825/3812626754]' entity='osd.10' cmd={"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi135", "root=default"]} : dispatch 2024-09-10T22:23:07.529 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:23:07 smithi138 ceph-mon[35236]: from='osd.10 ' entity='osd.10' cmd={"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi135", "root=default"]} : dispatch 2024-09-10T22:23:07.529 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:23:07 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-10T22:23:07.530 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:23:07 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-10T22:23:07.530 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:23:07 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T22:23:07.708 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:23:07 smithi019 ceph-mon[31375]: Detected new or changed devices on smithi135 2024-09-10T22:23:07.709 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:23:07 smithi019 ceph-mon[31375]: Adjusting osd_memory_target on smithi135 to 1453M 2024-09-10T22:23:07.709 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:23:07 smithi019 ceph-mon[31375]: pgmap v230: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 894 GiB / 894 GiB avail 2024-09-10T22:23:07.709 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:23:07 smithi019 ceph-mon[31375]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2024-09-10T22:23:07.709 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:23:07 smithi019 ceph-mon[31375]: osdmap e60: 11 total, 10 up, 11 in 2024-09-10T22:23:07.709 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:23:07 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-10T22:23:07.709 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:23:07 smithi019 ceph-mon[31375]: from='osd.10 [v2:172.21.15.135:6824/3812626754,v1:172.21.15.135:6825/3812626754]' entity='osd.10' cmd={"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi135", "root=default"]} : dispatch 2024-09-10T22:23:07.709 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:23:07 smithi019 ceph-mon[31375]: from='osd.10 ' entity='osd.10' cmd={"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi135", "root=default"]} : dispatch 2024-09-10T22:23:07.709 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:23:07 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-10T22:23:07.709 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:23:07 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-10T22:23:07.710 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:23:07 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T22:23:07.860 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:23:07 smithi135 ceph-mon[34789]: Detected new or changed devices on smithi135 2024-09-10T22:23:07.860 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:23:07 smithi135 ceph-mon[34789]: Adjusting osd_memory_target on smithi135 to 1453M 2024-09-10T22:23:07.860 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:23:07 smithi135 ceph-mon[34789]: pgmap v230: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 894 GiB / 894 GiB avail 2024-09-10T22:23:07.860 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:23:07 smithi135 ceph-mon[34789]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2024-09-10T22:23:07.860 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:23:07 smithi135 ceph-mon[34789]: osdmap e60: 11 total, 10 up, 11 in 2024-09-10T22:23:07.860 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:23:07 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-10T22:23:07.860 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:23:07 smithi135 ceph-mon[34789]: from='osd.10 [v2:172.21.15.135:6824/3812626754,v1:172.21.15.135:6825/3812626754]' entity='osd.10' cmd={"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi135", "root=default"]} : dispatch 2024-09-10T22:23:07.860 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:23:07 smithi135 ceph-mon[34789]: from='osd.10 ' entity='osd.10' cmd={"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi135", "root=default"]} : dispatch 2024-09-10T22:23:07.860 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:23:07 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-10T22:23:07.860 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:23:07 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-10T22:23:07.860 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:23:07 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T22:23:08.610 INFO:journalctl@ceph.osd.10.smithi135.stdout:Sep 10 22:23:08 smithi135 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-10[59985]: 2024-09-10T22:23:08.324+0000 7f3bf8447640 -1 osd.10 0 waiting for initial osdmap 2024-09-10T22:23:08.610 INFO:journalctl@ceph.osd.10.smithi135.stdout:Sep 10 22:23:08 smithi135 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-10[59985]: 2024-09-10T22:23:08.470+0000 7f3bf0266640 -1 osd.10 61 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-10T22:23:08.610 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:23:08 smithi135 ceph-mon[34789]: from='client.24457 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi138:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T22:23:08.610 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:23:08 smithi135 ceph-mon[34789]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi135", "root=default"]}]': finished 2024-09-10T22:23:08.610 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:23:08 smithi135 ceph-mon[34789]: osdmap e61: 11 total, 10 up, 11 in 2024-09-10T22:23:08.610 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:23:08 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-10T22:23:08.610 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:23:08 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-10T22:23:08.611 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:23:08 smithi135 ceph-mon[34789]: from='osd.10 ' entity='osd.10' 2024-09-10T22:23:08.625 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:23:08 smithi138 ceph-mon[35236]: from='client.24457 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi138:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T22:23:08.625 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:23:08 smithi138 ceph-mon[35236]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi135", "root=default"]}]': finished 2024-09-10T22:23:08.625 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:23:08 smithi138 ceph-mon[35236]: osdmap e61: 11 total, 10 up, 11 in 2024-09-10T22:23:08.625 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:23:08 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-10T22:23:08.625 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:23:08 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-10T22:23:08.625 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:23:08 smithi138 ceph-mon[35236]: from='osd.10 ' entity='osd.10' 2024-09-10T22:23:08.708 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:23:08 smithi019 ceph-mon[31375]: from='client.24457 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi138:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T22:23:08.708 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:23:08 smithi019 ceph-mon[31375]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi135", "root=default"]}]': finished 2024-09-10T22:23:08.709 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:23:08 smithi019 ceph-mon[31375]: osdmap e61: 11 total, 10 up, 11 in 2024-09-10T22:23:08.709 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:23:08 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-10T22:23:08.709 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:23:08 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-10T22:23:08.709 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:23:08 smithi019 ceph-mon[31375]: from='osd.10 ' entity='osd.10' 2024-09-10T22:23:09.625 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:23:09 smithi138 ceph-mon[35236]: purged_snaps scrub starts 2024-09-10T22:23:09.625 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:23:09 smithi138 ceph-mon[35236]: purged_snaps scrub ok 2024-09-10T22:23:09.625 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:23:09 smithi138 ceph-mon[35236]: pgmap v233: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 894 GiB / 894 GiB avail 2024-09-10T22:23:09.625 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:23:09 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-10T22:23:09.708 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:23:09 smithi019 ceph-mon[31375]: purged_snaps scrub starts 2024-09-10T22:23:09.708 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:23:09 smithi019 ceph-mon[31375]: purged_snaps scrub ok 2024-09-10T22:23:09.708 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:23:09 smithi019 ceph-mon[31375]: pgmap v233: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 894 GiB / 894 GiB avail 2024-09-10T22:23:09.708 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:23:09 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-10T22:23:09.859 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:23:09 smithi135 ceph-mon[34789]: purged_snaps scrub starts 2024-09-10T22:23:09.859 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:23:09 smithi135 ceph-mon[34789]: purged_snaps scrub ok 2024-09-10T22:23:09.860 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:23:09 smithi135 ceph-mon[34789]: pgmap v233: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 894 GiB / 894 GiB avail 2024-09-10T22:23:09.860 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:23:09 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-10T22:23:10.625 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:23:10 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-10T22:23:10.625 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:23:10 smithi138 ceph-mon[35236]: osd.10 [v2:172.21.15.135:6824/3812626754,v1:172.21.15.135:6825/3812626754] boot 2024-09-10T22:23:10.625 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:23:10 smithi138 ceph-mon[35236]: osdmap e62: 11 total, 11 up, 11 in 2024-09-10T22:23:10.625 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:23:10 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-10T22:23:10.625 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:23:10 smithi138 ceph-mon[35236]: from='client.? 172.21.15.138:0/1626066361' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "a9264ab2-5843-44d2-aba8-1e12708e99d6"} : dispatch 2024-09-10T22:23:10.625 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:23:10 smithi138 ceph-mon[35236]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "a9264ab2-5843-44d2-aba8-1e12708e99d6"} : dispatch 2024-09-10T22:23:10.626 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:23:10 smithi138 ceph-mon[35236]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "a9264ab2-5843-44d2-aba8-1e12708e99d6"}]': finished 2024-09-10T22:23:10.626 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:23:10 smithi138 ceph-mon[35236]: osdmap e63: 12 total, 11 up, 12 in 2024-09-10T22:23:10.626 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:23:10 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-10T22:23:10.626 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:23:10 smithi138 ceph-mon[35236]: from='client.? 172.21.15.138:0/2721231136' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-10T22:23:10.708 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:23:10 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-10T22:23:10.709 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:23:10 smithi019 ceph-mon[31375]: osd.10 [v2:172.21.15.135:6824/3812626754,v1:172.21.15.135:6825/3812626754] boot 2024-09-10T22:23:10.709 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:23:10 smithi019 ceph-mon[31375]: osdmap e62: 11 total, 11 up, 11 in 2024-09-10T22:23:10.709 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:23:10 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-10T22:23:10.709 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:23:10 smithi019 ceph-mon[31375]: from='client.? 172.21.15.138:0/1626066361' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "a9264ab2-5843-44d2-aba8-1e12708e99d6"} : dispatch 2024-09-10T22:23:10.709 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:23:10 smithi019 ceph-mon[31375]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "a9264ab2-5843-44d2-aba8-1e12708e99d6"} : dispatch 2024-09-10T22:23:10.709 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:23:10 smithi019 ceph-mon[31375]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "a9264ab2-5843-44d2-aba8-1e12708e99d6"}]': finished 2024-09-10T22:23:10.709 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:23:10 smithi019 ceph-mon[31375]: osdmap e63: 12 total, 11 up, 12 in 2024-09-10T22:23:10.709 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:23:10 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-10T22:23:10.709 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:23:10 smithi019 ceph-mon[31375]: from='client.? 172.21.15.138:0/2721231136' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-10T22:23:10.860 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:23:10 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-10T22:23:10.860 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:23:10 smithi135 ceph-mon[34789]: osd.10 [v2:172.21.15.135:6824/3812626754,v1:172.21.15.135:6825/3812626754] boot 2024-09-10T22:23:10.860 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:23:10 smithi135 ceph-mon[34789]: osdmap e62: 11 total, 11 up, 11 in 2024-09-10T22:23:10.860 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:23:10 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-10T22:23:10.860 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:23:10 smithi135 ceph-mon[34789]: from='client.? 172.21.15.138:0/1626066361' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "a9264ab2-5843-44d2-aba8-1e12708e99d6"} : dispatch 2024-09-10T22:23:10.860 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:23:10 smithi135 ceph-mon[34789]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "a9264ab2-5843-44d2-aba8-1e12708e99d6"} : dispatch 2024-09-10T22:23:10.860 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:23:10 smithi135 ceph-mon[34789]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "a9264ab2-5843-44d2-aba8-1e12708e99d6"}]': finished 2024-09-10T22:23:10.860 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:23:10 smithi135 ceph-mon[34789]: osdmap e63: 12 total, 11 up, 12 in 2024-09-10T22:23:10.860 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:23:10 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-10T22:23:10.860 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:23:10 smithi135 ceph-mon[34789]: from='client.? 172.21.15.138:0/2721231136' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-10T22:23:11.958 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:23:11 smithi019 ceph-mon[31375]: pgmap v236: 1 pgs: 1 peering; 577 KiB data, 300 MiB used, 894 GiB / 894 GiB avail 2024-09-10T22:23:11.958 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:23:11 smithi019 ceph-mon[31375]: osdmap e64: 12 total, 11 up, 12 in 2024-09-10T22:23:11.958 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:23:11 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-10T22:23:12.109 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:23:11 smithi135 ceph-mon[34789]: pgmap v236: 1 pgs: 1 peering; 577 KiB data, 300 MiB used, 894 GiB / 894 GiB avail 2024-09-10T22:23:12.110 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:23:11 smithi135 ceph-mon[34789]: osdmap e64: 12 total, 11 up, 12 in 2024-09-10T22:23:12.110 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:23:11 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-10T22:23:12.124 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:23:11 smithi138 ceph-mon[35236]: pgmap v236: 1 pgs: 1 peering; 577 KiB data, 300 MiB used, 894 GiB / 894 GiB avail 2024-09-10T22:23:12.125 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:23:11 smithi138 ceph-mon[35236]: osdmap e64: 12 total, 11 up, 12 in 2024-09-10T22:23:12.125 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:23:11 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-10T22:23:13.958 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:23:13 smithi019 ceph-mon[31375]: pgmap v238: 1 pgs: 1 peering; 577 KiB data, 335 MiB used, 983 GiB / 983 GiB avail 2024-09-10T22:23:14.109 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:23:13 smithi135 ceph-mon[34789]: pgmap v238: 1 pgs: 1 peering; 577 KiB data, 335 MiB used, 983 GiB / 983 GiB avail 2024-09-10T22:23:14.125 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:23:13 smithi138 ceph-mon[35236]: pgmap v238: 1 pgs: 1 peering; 577 KiB data, 335 MiB used, 983 GiB / 983 GiB avail 2024-09-10T22:23:15.954 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:23:15 smithi138 ceph-mon[35236]: pgmap v239: 1 pgs: 1 peering; 577 KiB data, 335 MiB used, 983 GiB / 983 GiB avail 2024-09-10T22:23:15.958 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:23:15 smithi019 ceph-mon[31375]: pgmap v239: 1 pgs: 1 peering; 577 KiB data, 335 MiB used, 983 GiB / 983 GiB avail 2024-09-10T22:23:16.109 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:23:15 smithi135 ceph-mon[34789]: pgmap v239: 1 pgs: 1 peering; 577 KiB data, 335 MiB used, 983 GiB / 983 GiB avail 2024-09-10T22:23:17.875 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:23:17 smithi138 ceph-mon[35236]: pgmap v240: 1 pgs: 1 active+clean; 577 KiB data, 336 MiB used, 983 GiB / 983 GiB avail; 83 KiB/s, 0 objects/s recovering 2024-09-10T22:23:17.958 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:23:17 smithi019 ceph-mon[31375]: pgmap v240: 1 pgs: 1 active+clean; 577 KiB data, 336 MiB used, 983 GiB / 983 GiB avail; 83 KiB/s, 0 objects/s recovering 2024-09-10T22:23:18.109 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:23:17 smithi135 ceph-mon[34789]: pgmap v240: 1 pgs: 1 active+clean; 577 KiB data, 336 MiB used, 983 GiB / 983 GiB avail; 83 KiB/s, 0 objects/s recovering 2024-09-10T22:23:18.958 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:23:18 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.11"} : dispatch 2024-09-10T22:23:18.958 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:23:18 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T22:23:18.958 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:23:18 smithi019 ceph-mon[31375]: Deploying daemon osd.11 on smithi138 2024-09-10T22:23:19.011 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:23:18 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.11"} : dispatch 2024-09-10T22:23:19.011 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:23:18 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T22:23:19.011 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:23:18 smithi135 ceph-mon[34789]: Deploying daemon osd.11 on smithi138 2024-09-10T22:23:19.069 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:23:18 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.11"} : dispatch 2024-09-10T22:23:19.069 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:23:18 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T22:23:19.069 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:23:18 smithi138 ceph-mon[35236]: Deploying daemon osd.11 on smithi138 2024-09-10T22:23:19.760 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:23:19 smithi138 ceph-mon[35236]: pgmap v241: 1 pgs: 1 active+clean; 577 KiB data, 336 MiB used, 983 GiB / 983 GiB avail; 66 KiB/s, 0 objects/s recovering 2024-09-10T22:23:19.958 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:23:19 smithi019 ceph-mon[31375]: pgmap v241: 1 pgs: 1 active+clean; 577 KiB data, 336 MiB used, 983 GiB / 983 GiB avail; 66 KiB/s, 0 objects/s recovering 2024-09-10T22:23:20.030 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:23:19 smithi135 ceph-mon[34789]: pgmap v241: 1 pgs: 1 active+clean; 577 KiB data, 336 MiB used, 983 GiB / 983 GiB avail; 66 KiB/s, 0 objects/s recovering 2024-09-10T22:23:21.698 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:23:21 smithi138 ceph-mon[35236]: pgmap v242: 1 pgs: 1 active+clean; 577 KiB data, 336 MiB used, 983 GiB / 983 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-10T22:23:21.958 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:23:21 smithi019 ceph-mon[31375]: pgmap v242: 1 pgs: 1 active+clean; 577 KiB data, 336 MiB used, 983 GiB / 983 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-10T22:23:22.110 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:23:21 smithi135 ceph-mon[34789]: pgmap v242: 1 pgs: 1 active+clean; 577 KiB data, 336 MiB used, 983 GiB / 983 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-10T22:23:23.958 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:23:23 smithi019 ceph-mon[31375]: pgmap v243: 1 pgs: 1 active+clean; 577 KiB data, 336 MiB used, 983 GiB / 983 GiB avail; 49 KiB/s, 0 objects/s recovering 2024-09-10T22:23:23.959 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:23:23 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T22:23:23.959 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:23:23 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:23:24.109 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:23:23 smithi135 ceph-mon[34789]: pgmap v243: 1 pgs: 1 active+clean; 577 KiB data, 336 MiB used, 983 GiB / 983 GiB avail; 49 KiB/s, 0 objects/s recovering 2024-09-10T22:23:24.110 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:23:23 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T22:23:24.110 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:23:23 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:23:24.111 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:23:23 smithi138 ceph-mon[35236]: pgmap v243: 1 pgs: 1 active+clean; 577 KiB data, 336 MiB used, 983 GiB / 983 GiB avail; 49 KiB/s, 0 objects/s recovering 2024-09-10T22:23:24.111 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:23:23 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T22:23:24.111 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:23:23 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:23:24.958 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:23:24 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:23:25.109 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:23:24 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:23:25.114 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:23:24 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:23:25.940 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:23:25 smithi138 ceph-mon[35236]: pgmap v244: 1 pgs: 1 active+clean; 577 KiB data, 336 MiB used, 983 GiB / 983 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-10T22:23:25.958 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:23:25 smithi019 ceph-mon[31375]: pgmap v244: 1 pgs: 1 active+clean; 577 KiB data, 336 MiB used, 983 GiB / 983 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-10T22:23:26.109 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:23:25 smithi135 ceph-mon[34789]: pgmap v244: 1 pgs: 1 active+clean; 577 KiB data, 336 MiB used, 983 GiB / 983 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-10T22:23:26.886 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-10T22:23:26.884+0000 7ff614ff9640 1 -- 172.21.15.138:0/2637716404 <== mgr.14150 v2:172.21.15.19:6800/2119495487 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+38 (secure 0 0 0) 0x7ff618104540 con 0x7ff6040b52e0 2024-09-10T22:23:26.886 INFO:teuthology.orchestra.run.smithi138.stdout:Created osd(s) 11 on host 'smithi138' 2024-09-10T22:23:26.888 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-10T22:23:26.886+0000 7ff61e02d640 1 -- 172.21.15.138:0/2637716404 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7ff6040b52e0 msgr2=0x7ff6040b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:23:26.888 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-10T22:23:26.886+0000 7ff61e02d640 1 --2- 172.21.15.138:0/2637716404 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7ff6040b52e0 0x7ff6040b77a0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7ff610005fd0 tx=0x7ff61000b390 comp rx=0 tx=0).stop 2024-09-10T22:23:26.888 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-10T22:23:26.886+0000 7ff61e02d640 1 -- 172.21.15.138:0/2637716404 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff618102a70 msgr2=0x7ff61819db20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:23:26.888 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-10T22:23:26.886+0000 7ff61e02d640 1 --2- 172.21.15.138:0/2637716404 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff618102a70 0x7ff61819db20 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7ff600006010 tx=0x7ff600004270 comp rx=0 tx=0).stop 2024-09-10T22:23:26.888 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-10T22:23:26.886+0000 7ff61e02d640 1 -- 172.21.15.138:0/2637716404 shutdown_connections 2024-09-10T22:23:26.888 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-10T22:23:26.886+0000 7ff61e02d640 1 --2- 172.21.15.138:0/2637716404 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7ff6040b52e0 0x7ff6040b77a0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:23:26.888 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-10T22:23:26.886+0000 7ff61e02d640 1 --2- 172.21.15.138:0/2637716404 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff618103430 0x7ff6181a0160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:23:26.888 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-10T22:23:26.886+0000 7ff61e02d640 1 --2- 172.21.15.138:0/2637716404 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff618102a70 0x7ff61819db20 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:23:26.888 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-10T22:23:26.886+0000 7ff61e02d640 1 --2- 172.21.15.138:0/2637716404 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff618101910 0x7ff61806b450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:23:26.889 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-10T22:23:26.886+0000 7ff61e02d640 1 -- 172.21.15.138:0/2637716404 >> 172.21.15.138:0/2637716404 conn(0x7ff6180fd1e0 msgr2=0x7ff618103e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:23:26.889 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-10T22:23:26.887+0000 7ff61e02d640 1 -- 172.21.15.138:0/2637716404 shutdown_connections 2024-09-10T22:23:26.889 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-10T22:23:26.887+0000 7ff61e02d640 1 -- 172.21.15.138:0/2637716404 wait complete. 2024-09-10T22:23:27.532 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:23:27 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:23:27.532 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:23:27 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:23:27.532 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:23:27 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T22:23:27.532 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:23:27 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T22:23:27.532 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:23:27 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:23:27.532 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:23:27 smithi138 ceph-mon[35236]: pgmap v245: 1 pgs: 1 active+clean; 577 KiB data, 336 MiB used, 983 GiB / 983 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-10T22:23:27.532 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:23:27 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T22:23:27.532 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:23:27 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:23:27.533 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:23:27 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:23:27.562 DEBUG:teuthology.orchestra.run.smithi138:osd.11> sudo journalctl -f -n 0 -u ceph-22997a4c-6fc2-11ef-bcea-c7b262605968@osd.11.service 2024-09-10T22:23:27.565 INFO:tasks.cephadm:Waiting for 12 OSDs to come up... 2024-09-10T22:23:27.565 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 22997a4c-6fc2-11ef-bcea-c7b262605968 -- ceph osd stat -f json 2024-09-10T22:23:27.595 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:23:27 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:23:27.595 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:23:27 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:23:27.595 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:23:27 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T22:23:27.595 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:23:27 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T22:23:27.595 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:23:27 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:23:27.595 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:23:27 smithi019 ceph-mon[31375]: pgmap v245: 1 pgs: 1 active+clean; 577 KiB data, 336 MiB used, 983 GiB / 983 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-10T22:23:27.595 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:23:27 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T22:23:27.595 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:23:27 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:23:27.596 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:23:27 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:23:27.609 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:23:27 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:23:27.609 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:23:27 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:23:27.610 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:23:27 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T22:23:27.610 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:23:27 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T22:23:27.610 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:23:27 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:23:27.610 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:23:27 smithi135 ceph-mon[34789]: pgmap v245: 1 pgs: 1 active+clean; 577 KiB data, 336 MiB used, 983 GiB / 983 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-10T22:23:27.610 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:23:27 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T22:23:27.610 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:23:27 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:23:27.610 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:23:27 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:23:27.837 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/22997a4c-6fc2-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T22:23:28.264 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:23:28.260+0000 7f0e92a53640 1 -- 172.21.15.19:0/451031448 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0e8c103450 msgr2=0x7f0e8c109dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:23:28.264 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:23:28.260+0000 7f0e92a53640 1 --2- 172.21.15.19:0/451031448 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0e8c103450 0x7f0e8c109dd0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f0e84009cd0 tx=0x7f0e8402a8e0 comp rx=0 tx=0).stop 2024-09-10T22:23:28.265 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:23:28.260+0000 7f0e92a53640 1 -- 172.21.15.19:0/451031448 shutdown_connections 2024-09-10T22:23:28.265 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:23:28.260+0000 7f0e92a53640 1 --2- 172.21.15.19:0/451031448 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0e8c103450 0x7f0e8c109dd0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:23:28.265 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:23:28.260+0000 7f0e92a53640 1 --2- 172.21.15.19:0/451031448 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0e8c102a90 0x7f0e8c102f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:23:28.265 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:23:28.260+0000 7f0e92a53640 1 --2- 172.21.15.19:0/451031448 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f0e8c101930 0x7f0e8c101d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:23:28.265 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:23:28.260+0000 7f0e92a53640 1 -- 172.21.15.19:0/451031448 >> 172.21.15.19:0/451031448 conn(0x7f0e8c0fd200 msgr2=0x7f0e8c0ff640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:23:28.265 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:23:28.260+0000 7f0e92a53640 1 -- 172.21.15.19:0/451031448 shutdown_connections 2024-09-10T22:23:28.265 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:23:28.260+0000 7f0e92a53640 1 -- 172.21.15.19:0/451031448 wait complete. 2024-09-10T22:23:28.265 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:23:28.261+0000 7f0e92a53640 1 Processor -- start 2024-09-10T22:23:28.265 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:23:28.261+0000 7f0e92a53640 1 -- start start 2024-09-10T22:23:28.265 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:23:28.261+0000 7f0e92a53640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0e8c101930 0x7f0e8c198e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:23:28.265 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:23:28.261+0000 7f0e92a53640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f0e8c102a90 0x7f0e8c199480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:23:28.265 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:23:28.261+0000 7f0e92a53640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0e8c103450 0x7f0e8c19a0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:23:28.266 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:23:28.261+0000 7f0e92a53640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f0e8c10d5b0 con 0x7f0e8c103450 2024-09-10T22:23:28.266 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:23:28.261+0000 7f0e92a53640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f0e8c10d430 con 0x7f0e8c101930 2024-09-10T22:23:28.266 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:23:28.261+0000 7f0e92a53640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f0e8c10d730 con 0x7f0e8c102a90 2024-09-10T22:23:28.266 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:23:28.261+0000 7f0e90ff0640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0e8c103450 0x7f0e8c19a0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:23:28.266 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:23:28.261+0000 7f0e90ff0640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0e8c103450 0x7f0e8c19a0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:57616/0 (socket says 172.21.15.19:57616) 2024-09-10T22:23:28.266 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:23:28.261+0000 7f0e90ff0640 1 -- 172.21.15.19:0/2163928795 learned_addr learned my addr 172.21.15.19:0/2163928795 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:23:28.266 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:23:28.261+0000 7f0e8b7fe640 1 --2- 172.21.15.19:0/2163928795 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f0e8c102a90 0x7f0e8c199480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:23:28.266 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:23:28.261+0000 7f0e8bfff640 1 --2- 172.21.15.19:0/2163928795 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0e8c101930 0x7f0e8c198e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:23:28.266 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:23:28.261+0000 7f0e90ff0640 1 -- 172.21.15.19:0/2163928795 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f0e8c102a90 msgr2=0x7f0e8c199480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:23:28.266 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:23:28.261+0000 7f0e90ff0640 1 --2- 172.21.15.19:0/2163928795 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f0e8c102a90 0x7f0e8c199480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:23:28.266 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:23:28.261+0000 7f0e90ff0640 1 -- 172.21.15.19:0/2163928795 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0e8c101930 msgr2=0x7f0e8c198e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:23:28.267 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:23:28.261+0000 7f0e90ff0640 1 --2- 172.21.15.19:0/2163928795 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0e8c101930 0x7f0e8c198e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:23:28.267 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:23:28.261+0000 7f0e90ff0640 1 -- 172.21.15.19:0/2163928795 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0e8c19a960 con 0x7f0e8c103450 2024-09-10T22:23:28.267 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:23:28.261+0000 7f0e8b7fe640 1 --2- 172.21.15.19:0/2163928795 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f0e8c102a90 0x7f0e8c199480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T22:23:28.267 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:23:28.262+0000 7f0e90ff0640 1 --2- 172.21.15.19:0/2163928795 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0e8c103450 0x7f0e8c19a0c0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f0e840097b0 tx=0x7f0e84003ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:23:28.267 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:23:28.262+0000 7f0e897fa640 1 -- 172.21.15.19:0/2163928795 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e84004240 con 0x7f0e8c103450 2024-09-10T22:23:28.267 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:23:28.262+0000 7f0e897fa640 1 -- 172.21.15.19:0/2163928795 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0e840305a0 con 0x7f0e8c103450 2024-09-10T22:23:28.267 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:23:28.262+0000 7f0e92a53640 1 -- 172.21.15.19:0/2163928795 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0e8c19abf0 con 0x7f0e8c103450 2024-09-10T22:23:28.267 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:23:28.262+0000 7f0e897fa640 1 -- 172.21.15.19:0/2163928795 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e84045630 con 0x7f0e8c103450 2024-09-10T22:23:28.267 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:23:28.262+0000 7f0e92a53640 1 -- 172.21.15.19:0/2163928795 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0e8c1a1330 con 0x7f0e8c103450 2024-09-10T22:23:28.267 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:23:28.263+0000 7f0e92a53640 1 -- 172.21.15.19:0/2163928795 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0e8c1a1500 con 0x7f0e8c103450 2024-09-10T22:23:28.268 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:23:28.264+0000 7f0e897fa640 1 -- 172.21.15.19:0/2163928795 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 16) ==== 153250+0+0 (secure 0 0 0) 0x7f0e84030070 con 0x7f0e8c103450 2024-09-10T22:23:28.268 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:23:28.265+0000 7f0e897fa640 1 --2- 172.21.15.19:0/2163928795 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f0e740b5360 0x7f0e740b7820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:23:28.268 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:23:28.265+0000 7f0e8bfff640 1 --2- 172.21.15.19:0/2163928795 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f0e740b5360 0x7f0e740b7820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:23:28.269 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:23:28.265+0000 7f0e897fa640 1 -- 172.21.15.19:0/2163928795 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(64..64 src has 1..64) ==== 6809+0+0 (secure 0 0 0) 0x7f0e8402e030 con 0x7f0e8c103450 2024-09-10T22:23:28.269 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:23:28.266+0000 7f0e8bfff640 1 --2- 172.21.15.19:0/2163928795 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f0e740b5360 0x7f0e740b7820 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f0e7c009b60 tx=0x7f0e7c005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:23:28.272 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:23:28.269+0000 7f0e897fa640 1 -- 172.21.15.19:0/2163928795 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f0e8404a060 con 0x7f0e8c103450 2024-09-10T22:23:28.457 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:23:28.456+0000 7f0e92a53640 1 -- 172.21.15.19:0/2163928795 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) -- 0x7f0e8c1a16d0 con 0x7f0e8c103450 2024-09-10T22:23:28.458 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:23:28.457+0000 7f0e897fa640 1 -- 172.21.15.19:0/2163928795 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v64) ==== 74+0+133 (secure 0 0 0) 0x7f0e840cd8b0 con 0x7f0e8c103450 2024-09-10T22:23:28.458 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-10T22:23:28.460 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:23:28.459+0000 7f0e92a53640 1 -- 172.21.15.19:0/2163928795 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f0e740b5360 msgr2=0x7f0e740b7820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:23:28.460 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:23:28.459+0000 7f0e92a53640 1 --2- 172.21.15.19:0/2163928795 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f0e740b5360 0x7f0e740b7820 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f0e7c009b60 tx=0x7f0e7c005f90 comp rx=0 tx=0).stop 2024-09-10T22:23:28.460 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:23:28.459+0000 7f0e92a53640 1 -- 172.21.15.19:0/2163928795 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0e8c103450 msgr2=0x7f0e8c19a0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:23:28.460 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:23:28.459+0000 7f0e92a53640 1 --2- 172.21.15.19:0/2163928795 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0e8c103450 0x7f0e8c19a0c0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f0e840097b0 tx=0x7f0e84003ba0 comp rx=0 tx=0).stop 2024-09-10T22:23:28.461 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:23:28.459+0000 7f0e92a53640 1 -- 172.21.15.19:0/2163928795 shutdown_connections 2024-09-10T22:23:28.461 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:23:28.459+0000 7f0e92a53640 1 --2- 172.21.15.19:0/2163928795 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f0e740b5360 0x7f0e740b7820 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:23:28.461 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:23:28.459+0000 7f0e92a53640 1 --2- 172.21.15.19:0/2163928795 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0e8c103450 0x7f0e8c19a0c0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:23:28.461 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:23:28.459+0000 7f0e92a53640 1 --2- 172.21.15.19:0/2163928795 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f0e8c102a90 0x7f0e8c199480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:23:28.461 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:23:28.459+0000 7f0e92a53640 1 --2- 172.21.15.19:0/2163928795 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0e8c101930 0x7f0e8c198e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:23:28.461 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:23:28.459+0000 7f0e92a53640 1 -- 172.21.15.19:0/2163928795 >> 172.21.15.19:0/2163928795 conn(0x7f0e8c0fd200 msgr2=0x7f0e8c0fec10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:23:28.461 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:23:28.459+0000 7f0e92a53640 1 -- 172.21.15.19:0/2163928795 shutdown_connections 2024-09-10T22:23:28.461 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:23:28.459+0000 7f0e92a53640 1 -- 172.21.15.19:0/2163928795 wait complete. 2024-09-10T22:23:29.402 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":64,"num_osds":12,"num_up_osds":11,"osd_up_since":1726006989,"num_in_osds":12,"osd_in_since":1726006989,"num_remapped_pgs":0} 2024-09-10T22:23:29.657 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:23:29 smithi138 ceph-mon[35236]: pgmap v246: 1 pgs: 1 active+clean; 577 KiB data, 336 MiB used, 983 GiB / 983 GiB avail 2024-09-10T22:23:29.657 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:23:29 smithi138 ceph-mon[35236]: from='client.? 172.21.15.19:0/2163928795' entity='client.admin' cmd={"prefix": "osd stat", "format": "json"} : dispatch 2024-09-10T22:23:29.708 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:23:29 smithi019 ceph-mon[31375]: pgmap v246: 1 pgs: 1 active+clean; 577 KiB data, 336 MiB used, 983 GiB / 983 GiB avail 2024-09-10T22:23:29.708 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:23:29 smithi019 ceph-mon[31375]: from='client.? 172.21.15.19:0/2163928795' entity='client.admin' cmd={"prefix": "osd stat", "format": "json"} : dispatch 2024-09-10T22:23:29.859 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:23:29 smithi135 ceph-mon[34789]: pgmap v246: 1 pgs: 1 active+clean; 577 KiB data, 336 MiB used, 983 GiB / 983 GiB avail 2024-09-10T22:23:29.859 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:23:29 smithi135 ceph-mon[34789]: from='client.? 172.21.15.19:0/2163928795' entity='client.admin' cmd={"prefix": "osd stat", "format": "json"} : dispatch 2024-09-10T22:23:29.961 INFO:journalctl@ceph.osd.11.smithi138.stdout:Sep 10 22:23:29 smithi138 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-11[60796]: 2024-09-10T22:23:29.704+0000 7ffb073eb640 -1 osd.11 0 log_to_monitors true 2024-09-10T22:23:30.404 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 22997a4c-6fc2-11ef-bcea-c7b262605968 -- ceph osd stat -f json 2024-09-10T22:23:30.625 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:23:30 smithi138 ceph-mon[35236]: from='osd.11 [v2:172.21.15.138:6824/1098434807,v1:172.21.15.138:6825/1098434807]' entity='osd.11' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]} : dispatch 2024-09-10T22:23:30.625 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:23:30 smithi138 ceph-mon[35236]: from='osd.11 ' entity='osd.11' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]} : dispatch 2024-09-10T22:23:30.625 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:23:30 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:23:30.625 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:23:30 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:23:30.625 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:23:30 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-10T22:23:30.625 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:23:30 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-09-10T22:23:30.625 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:23:30 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"} : dispatch 2024-09-10T22:23:30.625 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:23:30 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"} : dispatch 2024-09-10T22:23:30.625 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:23:30 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:23:30.626 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:23:30 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T22:23:30.626 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:23:30 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T22:23:30.626 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:23:30 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:23:30.666 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/22997a4c-6fc2-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T22:23:30.708 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:23:30 smithi019 ceph-mon[31375]: from='osd.11 [v2:172.21.15.138:6824/1098434807,v1:172.21.15.138:6825/1098434807]' entity='osd.11' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]} : dispatch 2024-09-10T22:23:30.709 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:23:30 smithi019 ceph-mon[31375]: from='osd.11 ' entity='osd.11' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]} : dispatch 2024-09-10T22:23:30.709 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:23:30 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:23:30.709 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:23:30 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:23:30.709 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:23:30 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-10T22:23:30.709 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:23:30 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-09-10T22:23:30.709 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:23:30 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"} : dispatch 2024-09-10T22:23:30.709 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:23:30 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"} : dispatch 2024-09-10T22:23:30.709 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:23:30 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:23:30.709 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:23:30 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T22:23:30.709 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:23:30 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T22:23:30.709 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:23:30 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:23:30.747 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:23:30 smithi135 ceph-mon[34789]: from='osd.11 [v2:172.21.15.138:6824/1098434807,v1:172.21.15.138:6825/1098434807]' entity='osd.11' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]} : dispatch 2024-09-10T22:23:30.747 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:23:30 smithi135 ceph-mon[34789]: from='osd.11 ' entity='osd.11' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]} : dispatch 2024-09-10T22:23:30.747 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:23:30 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:23:30.747 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:23:30 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:23:30.748 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:23:30 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-10T22:23:30.748 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:23:30 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-09-10T22:23:30.748 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:23:30 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"} : dispatch 2024-09-10T22:23:30.748 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:23:30 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"} : dispatch 2024-09-10T22:23:30.748 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:23:30 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:23:30.748 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:23:30 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T22:23:30.748 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:23:30 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T22:23:30.748 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:23:30 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:23:31.218 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:23:31.100+0000 7fb17d82e640 1 -- 172.21.15.19:0/2520564105 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb178103470 msgr2=0x7fb178109df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:23:31.218 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:23:31.100+0000 7fb17d82e640 1 --2- 172.21.15.19:0/2520564105 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb178103470 0x7fb178109df0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fb170009cd0 tx=0x7fb17002a8e0 comp rx=0 tx=0).stop 2024-09-10T22:23:31.219 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:23:31.100+0000 7fb17d82e640 1 -- 172.21.15.19:0/2520564105 shutdown_connections 2024-09-10T22:23:31.219 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:23:31.100+0000 7fb17d82e640 1 --2- 172.21.15.19:0/2520564105 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb178103470 0x7fb178109df0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:23:31.219 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:23:31.100+0000 7fb17d82e640 1 --2- 172.21.15.19:0/2520564105 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb178102ab0 0x7fb178102f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:23:31.219 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:23:31.100+0000 7fb17d82e640 1 --2- 172.21.15.19:0/2520564105 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb178101950 0x7fb178101d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:23:31.219 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:23:31.100+0000 7fb17d82e640 1 -- 172.21.15.19:0/2520564105 >> 172.21.15.19:0/2520564105 conn(0x7fb1780fd200 msgr2=0x7fb1780ff660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:23:31.219 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:23:31.100+0000 7fb17d82e640 1 -- 172.21.15.19:0/2520564105 shutdown_connections 2024-09-10T22:23:31.219 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:23:31.100+0000 7fb17d82e640 1 -- 172.21.15.19:0/2520564105 wait complete. 2024-09-10T22:23:31.219 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:23:31.101+0000 7fb17d82e640 1 Processor -- start 2024-09-10T22:23:31.219 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:23:31.101+0000 7fb17d82e640 1 -- start start 2024-09-10T22:23:31.219 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:23:31.101+0000 7fb17d82e640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb178101950 0x7fb17806be30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:23:31.220 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:23:31.101+0000 7fb17d82e640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb178102ab0 0x7fb17819db00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:23:31.220 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:23:31.101+0000 7fb17d82e640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb178103470 0x7fb1781a0140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:23:31.220 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:23:31.101+0000 7fb17d82e640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fb17810d630 con 0x7fb178102ab0 2024-09-10T22:23:31.220 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:23:31.101+0000 7fb17d82e640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fb17810d4b0 con 0x7fb178101950 2024-09-10T22:23:31.220 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:23:31.101+0000 7fb17d82e640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7fb17810d7b0 con 0x7fb178103470 2024-09-10T22:23:31.220 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:23:31.101+0000 7fb1767fc640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb178102ab0 0x7fb17819db00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:23:31.220 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:23:31.101+0000 7fb1767fc640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb178102ab0 0x7fb17819db00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:57634/0 (socket says 172.21.15.19:57634) 2024-09-10T22:23:31.220 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:23:31.101+0000 7fb1767fc640 1 -- 172.21.15.19:0/2444112621 learned_addr learned my addr 172.21.15.19:0/2444112621 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:23:31.220 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:23:31.101+0000 7fb176ffd640 1 --2- 172.21.15.19:0/2444112621 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb178101950 0x7fb17806be30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:23:31.220 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:23:31.101+0000 7fb1777fe640 1 --2- 172.21.15.19:0/2444112621 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb178103470 0x7fb1781a0140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:23:31.221 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:23:31.102+0000 7fb1767fc640 1 -- 172.21.15.19:0/2444112621 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb178103470 msgr2=0x7fb1781a0140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:23:31.221 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:23:31.102+0000 7fb1767fc640 1 --2- 172.21.15.19:0/2444112621 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb178103470 0x7fb1781a0140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:23:31.221 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:23:31.102+0000 7fb1767fc640 1 -- 172.21.15.19:0/2444112621 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb178101950 msgr2=0x7fb17806be30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:23:31.221 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:23:31.102+0000 7fb1767fc640 1 --2- 172.21.15.19:0/2444112621 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb178101950 0x7fb17806be30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:23:31.221 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:23:31.102+0000 7fb1767fc640 1 -- 172.21.15.19:0/2444112621 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb1781a0a00 con 0x7fb178102ab0 2024-09-10T22:23:31.221 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:23:31.102+0000 7fb1767fc640 1 --2- 172.21.15.19:0/2444112621 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb178102ab0 0x7fb17819db00 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fb16c00b4a0 tx=0x7fb16c00b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:23:31.221 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:23:31.102+0000 7fb17c82c640 1 -- 172.21.15.19:0/2444112621 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb16c014070 con 0x7fb178102ab0 2024-09-10T22:23:31.221 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:23:31.102+0000 7fb17c82c640 1 -- 172.21.15.19:0/2444112621 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb16c010ac0 con 0x7fb178102ab0 2024-09-10T22:23:31.221 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:23:31.102+0000 7fb17d82e640 1 -- 172.21.15.19:0/2444112621 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb1781a0cf0 con 0x7fb178102ab0 2024-09-10T22:23:31.221 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:23:31.102+0000 7fb17c82c640 1 -- 172.21.15.19:0/2444112621 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb16c017c30 con 0x7fb178102ab0 2024-09-10T22:23:31.221 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:23:31.102+0000 7fb17d82e640 1 -- 172.21.15.19:0/2444112621 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb1781a1250 con 0x7fb178102ab0 2024-09-10T22:23:31.222 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:23:31.103+0000 7fb17d82e640 1 -- 172.21.15.19:0/2444112621 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb178108c00 con 0x7fb178102ab0 2024-09-10T22:23:31.222 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:23:31.105+0000 7fb17c82c640 1 -- 172.21.15.19:0/2444112621 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 16) ==== 153250+0+0 (secure 0 0 0) 0x7fb16c010610 con 0x7fb178102ab0 2024-09-10T22:23:31.222 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:23:31.105+0000 7fb17c82c640 1 --2- 172.21.15.19:0/2444112621 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7fb1600b5360 0x7fb1600b7820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:23:31.222 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:23:31.105+0000 7fb176ffd640 1 --2- 172.21.15.19:0/2444112621 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7fb1600b5360 0x7fb1600b7820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:23:31.222 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:23:31.106+0000 7fb17c82c640 1 -- 172.21.15.19:0/2444112621 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(65..65 src has 1..65) ==== 6831+0+0 (secure 0 0 0) 0x7fb16c0e4c90 con 0x7fb178102ab0 2024-09-10T22:23:31.222 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:23:31.106+0000 7fb176ffd640 1 --2- 172.21.15.19:0/2444112621 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7fb1600b5360 0x7fb1600b7820 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fb168005e10 tx=0x7fb168005da0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:23:31.222 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:23:31.109+0000 7fb17c82c640 1 -- 172.21.15.19:0/2444112621 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7fb16c0ac080 con 0x7fb178102ab0 2024-09-10T22:23:31.300 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:23:31.298+0000 7fb17d82e640 1 -- 172.21.15.19:0/2444112621 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) -- 0x7fb178063df0 con 0x7fb178102ab0 2024-09-10T22:23:31.300 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:23:31.298+0000 7fb17c82c640 1 -- 172.21.15.19:0/2444112621 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v65) ==== 74+0+133 (secure 0 0 0) 0x7fb16c0ab980 con 0x7fb178102ab0 2024-09-10T22:23:31.300 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-10T22:23:31.302 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:23:31.300+0000 7fb17d82e640 1 -- 172.21.15.19:0/2444112621 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7fb1600b5360 msgr2=0x7fb1600b7820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:23:31.302 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:23:31.300+0000 7fb17d82e640 1 --2- 172.21.15.19:0/2444112621 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7fb1600b5360 0x7fb1600b7820 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fb168005e10 tx=0x7fb168005da0 comp rx=0 tx=0).stop 2024-09-10T22:23:31.302 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:23:31.300+0000 7fb17d82e640 1 -- 172.21.15.19:0/2444112621 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb178102ab0 msgr2=0x7fb17819db00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:23:31.302 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:23:31.300+0000 7fb17d82e640 1 --2- 172.21.15.19:0/2444112621 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb178102ab0 0x7fb17819db00 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fb16c00b4a0 tx=0x7fb16c00b960 comp rx=0 tx=0).stop 2024-09-10T22:23:31.302 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:23:31.300+0000 7fb17d82e640 1 -- 172.21.15.19:0/2444112621 shutdown_connections 2024-09-10T22:23:31.303 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:23:31.300+0000 7fb17d82e640 1 --2- 172.21.15.19:0/2444112621 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7fb1600b5360 0x7fb1600b7820 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:23:31.303 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:23:31.300+0000 7fb17d82e640 1 --2- 172.21.15.19:0/2444112621 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb178103470 0x7fb1781a0140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:23:31.303 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:23:31.300+0000 7fb17d82e640 1 --2- 172.21.15.19:0/2444112621 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb178102ab0 0x7fb17819db00 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:23:31.303 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:23:31.300+0000 7fb17d82e640 1 --2- 172.21.15.19:0/2444112621 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb178101950 0x7fb17806be30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:23:31.303 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:23:31.300+0000 7fb17d82e640 1 -- 172.21.15.19:0/2444112621 >> 172.21.15.19:0/2444112621 conn(0x7fb1780fd200 msgr2=0x7fb178105dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:23:31.303 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:23:31.301+0000 7fb17d82e640 1 -- 172.21.15.19:0/2444112621 shutdown_connections 2024-09-10T22:23:31.303 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:23:31.301+0000 7fb17d82e640 1 -- 172.21.15.19:0/2444112621 wait complete. 2024-09-10T22:23:31.609 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:23:31 smithi135 ceph-mon[34789]: Detected new or changed devices on smithi138 2024-09-10T22:23:31.610 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:23:31 smithi135 ceph-mon[34789]: Adjusting osd_memory_target on smithi138 to 4272M 2024-09-10T22:23:31.610 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:23:31 smithi135 ceph-mon[34789]: pgmap v247: 1 pgs: 1 active+clean; 577 KiB data, 336 MiB used, 983 GiB / 983 GiB avail 2024-09-10T22:23:31.610 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:23:31 smithi135 ceph-mon[34789]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2024-09-10T22:23:31.610 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:23:31 smithi135 ceph-mon[34789]: from='osd.11 [v2:172.21.15.138:6824/1098434807,v1:172.21.15.138:6825/1098434807]' entity='osd.11' cmd={"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi138", "root=default"]} : dispatch 2024-09-10T22:23:31.610 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:23:31 smithi135 ceph-mon[34789]: osdmap e65: 12 total, 11 up, 12 in 2024-09-10T22:23:31.610 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:23:31 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-10T22:23:31.610 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:23:31 smithi135 ceph-mon[34789]: from='osd.11 ' entity='osd.11' cmd={"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi138", "root=default"]} : dispatch 2024-09-10T22:23:31.610 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:23:31 smithi135 ceph-mon[34789]: from='client.? 172.21.15.19:0/2444112621' entity='client.admin' cmd={"prefix": "osd stat", "format": "json"} : dispatch 2024-09-10T22:23:31.708 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:23:31 smithi019 ceph-mon[31375]: Detected new or changed devices on smithi138 2024-09-10T22:23:31.708 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:23:31 smithi019 ceph-mon[31375]: Adjusting osd_memory_target on smithi138 to 4272M 2024-09-10T22:23:31.708 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:23:31 smithi019 ceph-mon[31375]: pgmap v247: 1 pgs: 1 active+clean; 577 KiB data, 336 MiB used, 983 GiB / 983 GiB avail 2024-09-10T22:23:31.708 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:23:31 smithi019 ceph-mon[31375]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2024-09-10T22:23:31.708 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:23:31 smithi019 ceph-mon[31375]: from='osd.11 [v2:172.21.15.138:6824/1098434807,v1:172.21.15.138:6825/1098434807]' entity='osd.11' cmd={"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi138", "root=default"]} : dispatch 2024-09-10T22:23:31.709 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:23:31 smithi019 ceph-mon[31375]: osdmap e65: 12 total, 11 up, 12 in 2024-09-10T22:23:31.709 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:23:31 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-10T22:23:31.709 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:23:31 smithi019 ceph-mon[31375]: from='osd.11 ' entity='osd.11' cmd={"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi138", "root=default"]} : dispatch 2024-09-10T22:23:31.709 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:23:31 smithi019 ceph-mon[31375]: from='client.? 172.21.15.19:0/2444112621' entity='client.admin' cmd={"prefix": "osd stat", "format": "json"} : dispatch 2024-09-10T22:23:31.875 INFO:journalctl@ceph.osd.11.smithi138.stdout:Sep 10 22:23:31 smithi138 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-11[60796]: 2024-09-10T22:23:31.419+0000 7ffb0336e640 -1 osd.11 0 waiting for initial osdmap 2024-09-10T22:23:31.875 INFO:journalctl@ceph.osd.11.smithi138.stdout:Sep 10 22:23:31 smithi138 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-11[60796]: 2024-09-10T22:23:31.435+0000 7ffaff195640 -1 osd.11 66 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-10T22:23:31.875 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:23:31 smithi138 ceph-mon[35236]: Detected new or changed devices on smithi138 2024-09-10T22:23:31.875 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:23:31 smithi138 ceph-mon[35236]: Adjusting osd_memory_target on smithi138 to 4272M 2024-09-10T22:23:31.876 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:23:31 smithi138 ceph-mon[35236]: pgmap v247: 1 pgs: 1 active+clean; 577 KiB data, 336 MiB used, 983 GiB / 983 GiB avail 2024-09-10T22:23:31.876 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:23:31 smithi138 ceph-mon[35236]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2024-09-10T22:23:31.876 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:23:31 smithi138 ceph-mon[35236]: from='osd.11 [v2:172.21.15.138:6824/1098434807,v1:172.21.15.138:6825/1098434807]' entity='osd.11' cmd={"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi138", "root=default"]} : dispatch 2024-09-10T22:23:31.876 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:23:31 smithi138 ceph-mon[35236]: osdmap e65: 12 total, 11 up, 12 in 2024-09-10T22:23:31.876 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:23:31 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-10T22:23:31.876 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:23:31 smithi138 ceph-mon[35236]: from='osd.11 ' entity='osd.11' cmd={"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi138", "root=default"]} : dispatch 2024-09-10T22:23:31.876 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:23:31 smithi138 ceph-mon[35236]: from='client.? 172.21.15.19:0/2444112621' entity='client.admin' cmd={"prefix": "osd stat", "format": "json"} : dispatch 2024-09-10T22:23:32.086 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":65,"num_osds":12,"num_up_osds":11,"osd_up_since":1726006989,"num_in_osds":12,"osd_in_since":1726006989,"num_remapped_pgs":0} 2024-09-10T22:23:32.625 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:23:32 smithi138 ceph-mon[35236]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi138", "root=default"]}]': finished 2024-09-10T22:23:32.625 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:23:32 smithi138 ceph-mon[35236]: osdmap e66: 12 total, 11 up, 12 in 2024-09-10T22:23:32.625 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:23:32 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-10T22:23:32.625 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:23:32 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-10T22:23:32.709 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:23:32 smithi019 ceph-mon[31375]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi138", "root=default"]}]': finished 2024-09-10T22:23:32.709 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:23:32 smithi019 ceph-mon[31375]: osdmap e66: 12 total, 11 up, 12 in 2024-09-10T22:23:32.709 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:23:32 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-10T22:23:32.709 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:23:32 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-10T22:23:32.860 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:23:32 smithi135 ceph-mon[34789]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi138", "root=default"]}]': finished 2024-09-10T22:23:32.860 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:23:32 smithi135 ceph-mon[34789]: osdmap e66: 12 total, 11 up, 12 in 2024-09-10T22:23:32.860 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:23:32 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-10T22:23:32.860 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:23:32 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-10T22:23:33.087 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 22997a4c-6fc2-11ef-bcea-c7b262605968 -- ceph osd stat -f json 2024-09-10T22:23:33.361 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/22997a4c-6fc2-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T22:23:33.708 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:23:33 smithi019 ceph-mon[31375]: purged_snaps scrub starts 2024-09-10T22:23:33.708 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:23:33 smithi019 ceph-mon[31375]: purged_snaps scrub ok 2024-09-10T22:23:33.708 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:23:33 smithi019 ceph-mon[31375]: pgmap v250: 1 pgs: 1 active+clean; 577 KiB data, 336 MiB used, 983 GiB / 983 GiB avail 2024-09-10T22:23:33.708 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:23:33 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-10T22:23:33.709 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:23:33 smithi019 ceph-mon[31375]: osd.11 [v2:172.21.15.138:6824/1098434807,v1:172.21.15.138:6825/1098434807] boot 2024-09-10T22:23:33.709 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:23:33 smithi019 ceph-mon[31375]: osdmap e67: 12 total, 12 up, 12 in 2024-09-10T22:23:33.709 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:23:33 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-10T22:23:33.834 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:23:33.814+0000 7fae024ed640 1 -- 172.21.15.19:0/2433664635 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fadfc102a70 msgr2=0x7fadfc102ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:23:33.834 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:23:33.814+0000 7fae024ed640 1 --2- 172.21.15.19:0/2433664635 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fadfc102a70 0x7fadfc102ef0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fadf0009930 tx=0x7fadf002a420 comp rx=0 tx=0).stop 2024-09-10T22:23:33.835 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:23:33.814+0000 7fae024ed640 1 -- 172.21.15.19:0/2433664635 shutdown_connections 2024-09-10T22:23:33.835 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:23:33.814+0000 7fae024ed640 1 --2- 172.21.15.19:0/2433664635 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fadfc103430 0x7fadfc109db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:23:33.835 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:23:33.814+0000 7fae024ed640 1 --2- 172.21.15.19:0/2433664635 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fadfc102a70 0x7fadfc102ef0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:23:33.835 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:23:33.814+0000 7fae024ed640 1 --2- 172.21.15.19:0/2433664635 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fadfc101910 0x7fadfc101d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:23:33.835 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:23:33.814+0000 7fae024ed640 1 -- 172.21.15.19:0/2433664635 >> 172.21.15.19:0/2433664635 conn(0x7fadfc0fd1e0 msgr2=0x7fadfc0ff620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:23:33.835 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:23:33.814+0000 7fae024ed640 1 -- 172.21.15.19:0/2433664635 shutdown_connections 2024-09-10T22:23:33.835 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:23:33.814+0000 7fae024ed640 1 -- 172.21.15.19:0/2433664635 wait complete. 2024-09-10T22:23:33.835 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:23:33.815+0000 7fae024ed640 1 Processor -- start 2024-09-10T22:23:33.836 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:23:33.815+0000 7fae024ed640 1 -- start start 2024-09-10T22:23:33.836 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:23:33.815+0000 7fae024ed640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fadfc101910 0x7fadfc06b450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:23:33.836 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:23:33.815+0000 7fae024ed640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fadfc102a70 0x7fadfc19db80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:23:33.836 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:23:33.815+0000 7fae024ed640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fadfc103430 0x7fadfc1a01c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:23:33.836 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:23:33.815+0000 7fae024ed640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fadfc10d670 con 0x7fadfc103430 2024-09-10T22:23:33.836 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:23:33.815+0000 7fae024ed640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fadfc10d4f0 con 0x7fadfc102a70 2024-09-10T22:23:33.836 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:23:33.815+0000 7fae024ed640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7fadfc10d7f0 con 0x7fadfc101910 2024-09-10T22:23:33.836 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:23:33.815+0000 7fae00a8a640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fadfc103430 0x7fadfc1a01c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:23:33.836 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:23:33.815+0000 7fae00a8a640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fadfc103430 0x7fadfc1a01c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:48232/0 (socket says 172.21.15.19:48232) 2024-09-10T22:23:33.836 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:23:33.815+0000 7fae00a8a640 1 -- 172.21.15.19:0/2384138509 learned_addr learned my addr 172.21.15.19:0/2384138509 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:23:33.837 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:23:33.816+0000 7fadfb7fe640 1 --2- 172.21.15.19:0/2384138509 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fadfc102a70 0x7fadfc19db80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:23:33.837 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:23:33.816+0000 7fadfbfff640 1 --2- 172.21.15.19:0/2384138509 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fadfc101910 0x7fadfc06b450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:23:33.837 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:23:33.816+0000 7fae00a8a640 1 -- 172.21.15.19:0/2384138509 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fadfc101910 msgr2=0x7fadfc06b450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:23:33.837 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:23:33.816+0000 7fae00a8a640 1 --2- 172.21.15.19:0/2384138509 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fadfc101910 0x7fadfc06b450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:23:33.837 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:23:33.816+0000 7fae00a8a640 1 -- 172.21.15.19:0/2384138509 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fadfc102a70 msgr2=0x7fadfc19db80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:23:33.837 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:23:33.816+0000 7fae00a8a640 1 --2- 172.21.15.19:0/2384138509 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fadfc102a70 0x7fadfc19db80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:23:33.837 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:23:33.816+0000 7fae00a8a640 1 -- 172.21.15.19:0/2384138509 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fadfc1a0a80 con 0x7fadfc103430 2024-09-10T22:23:33.837 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:23:33.816+0000 7fadfb7fe640 1 --2- 172.21.15.19:0/2384138509 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fadfc102a70 0x7fadfc19db80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T22:23:33.837 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:23:33.816+0000 7fadfbfff640 1 --2- 172.21.15.19:0/2384138509 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fadfc101910 0x7fadfc06b450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T22:23:33.837 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:23:33.816+0000 7fae00a8a640 1 --2- 172.21.15.19:0/2384138509 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fadfc103430 0x7fadfc1a01c0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fadf400b970 tx=0x7fadf400be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:23:33.837 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:23:33.816+0000 7fadf97fa640 1 -- 172.21.15.19:0/2384138509 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fadf4019070 con 0x7fadfc103430 2024-09-10T22:23:33.838 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:23:33.816+0000 7fadf97fa640 1 -- 172.21.15.19:0/2384138509 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fadf4014440 con 0x7fadfc103430 2024-09-10T22:23:33.838 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:23:33.816+0000 7fae024ed640 1 -- 172.21.15.19:0/2384138509 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fadfc1a0d70 con 0x7fadfc103430 2024-09-10T22:23:33.838 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:23:33.816+0000 7fadf97fa640 1 -- 172.21.15.19:0/2384138509 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fadf40075d0 con 0x7fadfc103430 2024-09-10T22:23:33.838 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:23:33.816+0000 7fae024ed640 1 -- 172.21.15.19:0/2384138509 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fadfc1a1280 con 0x7fadfc103430 2024-09-10T22:23:33.838 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:23:33.817+0000 7fae024ed640 1 -- 172.21.15.19:0/2384138509 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fadfc108c90 con 0x7fadfc103430 2024-09-10T22:23:33.838 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:23:33.819+0000 7fadf97fa640 1 -- 172.21.15.19:0/2384138509 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 16) ==== 153250+0+0 (secure 0 0 0) 0x7fadf400cb40 con 0x7fadfc103430 2024-09-10T22:23:33.838 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:23:33.819+0000 7fadf97fa640 1 --2- 172.21.15.19:0/2384138509 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7fade40b52e0 0x7fade40b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:23:33.838 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:23:33.819+0000 7fadfbfff640 1 --2- 172.21.15.19:0/2384138509 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7fade40b52e0 0x7fade40b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:23:33.839 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:23:33.819+0000 7fadf97fa640 1 -- 172.21.15.19:0/2384138509 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(68..68 src has 1..68) ==== 7127+0+0 (secure 0 0 0) 0x7fadf40e5410 con 0x7fadfc103430 2024-09-10T22:23:33.839 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:23:33.820+0000 7fadfbfff640 1 --2- 172.21.15.19:0/2384138509 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7fade40b52e0 0x7fade40b77a0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fadec009930 tx=0x7fadec008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:23:33.839 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:23:33.822+0000 7fadf97fa640 1 -- 172.21.15.19:0/2384138509 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7fadf40ac770 con 0x7fadfc103430 2024-09-10T22:23:33.860 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:23:33 smithi135 ceph-mon[34789]: purged_snaps scrub starts 2024-09-10T22:23:33.860 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:23:33 smithi135 ceph-mon[34789]: purged_snaps scrub ok 2024-09-10T22:23:33.860 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:23:33 smithi135 ceph-mon[34789]: pgmap v250: 1 pgs: 1 active+clean; 577 KiB data, 336 MiB used, 983 GiB / 983 GiB avail 2024-09-10T22:23:33.860 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:23:33 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-10T22:23:33.860 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:23:33 smithi135 ceph-mon[34789]: osd.11 [v2:172.21.15.138:6824/1098434807,v1:172.21.15.138:6825/1098434807] boot 2024-09-10T22:23:33.860 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:23:33 smithi135 ceph-mon[34789]: osdmap e67: 12 total, 12 up, 12 in 2024-09-10T22:23:33.860 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:23:33 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-10T22:23:33.875 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:23:33 smithi138 ceph-mon[35236]: purged_snaps scrub starts 2024-09-10T22:23:33.875 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:23:33 smithi138 ceph-mon[35236]: purged_snaps scrub ok 2024-09-10T22:23:33.875 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:23:33 smithi138 ceph-mon[35236]: pgmap v250: 1 pgs: 1 active+clean; 577 KiB data, 336 MiB used, 983 GiB / 983 GiB avail 2024-09-10T22:23:33.875 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:23:33 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-10T22:23:33.875 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:23:33 smithi138 ceph-mon[35236]: osd.11 [v2:172.21.15.138:6824/1098434807,v1:172.21.15.138:6825/1098434807] boot 2024-09-10T22:23:33.875 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:23:33 smithi138 ceph-mon[35236]: osdmap e67: 12 total, 12 up, 12 in 2024-09-10T22:23:33.875 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:23:33 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-10T22:23:34.011 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:23:34.009+0000 7fae024ed640 1 -- 172.21.15.19:0/2384138509 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) -- 0x7fadfc02e830 con 0x7fadfc103430 2024-09-10T22:23:34.011 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:23:34.009+0000 7fadf97fa640 1 -- 172.21.15.19:0/2384138509 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v68) ==== 74+0+133 (secure 0 0 0) 0x7fadf40ac070 con 0x7fadfc103430 2024-09-10T22:23:34.011 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-10T22:23:34.013 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:23:34.012+0000 7fae024ed640 1 -- 172.21.15.19:0/2384138509 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7fade40b52e0 msgr2=0x7fade40b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:23:34.013 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:23:34.012+0000 7fae024ed640 1 --2- 172.21.15.19:0/2384138509 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7fade40b52e0 0x7fade40b77a0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fadec009930 tx=0x7fadec008040 comp rx=0 tx=0).stop 2024-09-10T22:23:34.013 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:23:34.012+0000 7fae024ed640 1 -- 172.21.15.19:0/2384138509 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fadfc103430 msgr2=0x7fadfc1a01c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:23:34.013 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:23:34.012+0000 7fae024ed640 1 --2- 172.21.15.19:0/2384138509 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fadfc103430 0x7fadfc1a01c0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fadf400b970 tx=0x7fadf400be30 comp rx=0 tx=0).stop 2024-09-10T22:23:34.013 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:23:34.012+0000 7fae024ed640 1 -- 172.21.15.19:0/2384138509 shutdown_connections 2024-09-10T22:23:34.014 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:23:34.012+0000 7fae024ed640 1 --2- 172.21.15.19:0/2384138509 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7fade40b52e0 0x7fade40b77a0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:23:34.014 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:23:34.012+0000 7fae024ed640 1 --2- 172.21.15.19:0/2384138509 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fadfc103430 0x7fadfc1a01c0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:23:34.014 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:23:34.012+0000 7fae024ed640 1 --2- 172.21.15.19:0/2384138509 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fadfc102a70 0x7fadfc19db80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:23:34.014 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:23:34.012+0000 7fae024ed640 1 --2- 172.21.15.19:0/2384138509 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fadfc101910 0x7fadfc06b450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:23:34.014 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:23:34.012+0000 7fae024ed640 1 -- 172.21.15.19:0/2384138509 >> 172.21.15.19:0/2384138509 conn(0x7fadfc0fd1e0 msgr2=0x7fadfc105e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:23:34.014 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:23:34.012+0000 7fae024ed640 1 -- 172.21.15.19:0/2384138509 shutdown_connections 2024-09-10T22:23:34.014 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:23:34.012+0000 7fae024ed640 1 -- 172.21.15.19:0/2384138509 wait complete. 2024-09-10T22:23:34.708 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:23:34 smithi019 ceph-mon[31375]: osdmap e68: 12 total, 12 up, 12 in 2024-09-10T22:23:34.708 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:23:34 smithi019 ceph-mon[31375]: from='client.? 172.21.15.19:0/2384138509' entity='client.admin' cmd={"prefix": "osd stat", "format": "json"} : dispatch 2024-09-10T22:23:34.791 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":68,"num_osds":12,"num_up_osds":12,"osd_up_since":1726007012,"num_in_osds":12,"osd_in_since":1726006989,"num_remapped_pgs":0} 2024-09-10T22:23:34.792 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 22997a4c-6fc2-11ef-bcea-c7b262605968 -- ceph osd dump --format=json 2024-09-10T22:23:34.860 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:23:34 smithi135 ceph-mon[34789]: osdmap e68: 12 total, 12 up, 12 in 2024-09-10T22:23:34.860 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:23:34 smithi135 ceph-mon[34789]: from='client.? 172.21.15.19:0/2384138509' entity='client.admin' cmd={"prefix": "osd stat", "format": "json"} : dispatch 2024-09-10T22:23:34.875 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:23:34 smithi138 ceph-mon[35236]: osdmap e68: 12 total, 12 up, 12 in 2024-09-10T22:23:34.875 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:23:34 smithi138 ceph-mon[35236]: from='client.? 172.21.15.19:0/2384138509' entity='client.admin' cmd={"prefix": "osd stat", "format": "json"} : dispatch 2024-09-10T22:23:35.054 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/22997a4c-6fc2-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T22:23:35.525 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:23:35.497+0000 7fea0f48f640 1 -- 172.21.15.19:0/2936964171 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fea08102dc0 msgr2=0x7fea081031a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:23:35.525 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:23:35.497+0000 7fea0f48f640 1 --2- 172.21.15.19:0/2936964171 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fea08102dc0 0x7fea081031a0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fea04009900 tx=0x7fea0402a410 comp rx=0 tx=0).stop 2024-09-10T22:23:35.525 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:23:35.497+0000 7fea0f48f640 1 -- 172.21.15.19:0/2936964171 shutdown_connections 2024-09-10T22:23:35.525 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:23:35.497+0000 7fea0f48f640 1 --2- 172.21.15.19:0/2936964171 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fea08109150 0x7fea0810f950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:23:35.525 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:23:35.497+0000 7fea0f48f640 1 --2- 172.21.15.19:0/2936964171 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fea081087d0 0x7fea08108c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:23:35.525 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:23:35.497+0000 7fea0f48f640 1 --2- 172.21.15.19:0/2936964171 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fea08102dc0 0x7fea081031a0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:23:35.525 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:23:35.497+0000 7fea0f48f640 1 -- 172.21.15.19:0/2936964171 >> 172.21.15.19:0/2936964171 conn(0x7fea080fe830 msgr2=0x7fea08100c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:23:35.525 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:23:35.497+0000 7fea0f48f640 1 -- 172.21.15.19:0/2936964171 shutdown_connections 2024-09-10T22:23:35.526 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:23:35.497+0000 7fea0f48f640 1 -- 172.21.15.19:0/2936964171 wait complete. 2024-09-10T22:23:35.526 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:23:35.498+0000 7fea0f48f640 1 Processor -- start 2024-09-10T22:23:35.526 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:23:35.498+0000 7fea0f48f640 1 -- start start 2024-09-10T22:23:35.526 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:23:35.498+0000 7fea0f48f640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fea08102dc0 0x7fea0819b620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:23:35.526 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:23:35.498+0000 7fea0f48f640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fea081087d0 0x7fea0819bb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:23:35.526 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:23:35.498+0000 7fea0f48f640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fea08109150 0x7fea081a0f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:23:35.526 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:23:35.498+0000 7fea0f48f640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fea08112ea0 con 0x7fea08109150 2024-09-10T22:23:35.526 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:23:35.498+0000 7fea0f48f640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fea08112d20 con 0x7fea08102dc0 2024-09-10T22:23:35.526 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:23:35.498+0000 7fea0f48f640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7fea08113020 con 0x7fea081087d0 2024-09-10T22:23:35.526 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:23:35.498+0000 7fea0da2c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fea08109150 0x7fea081a0f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:23:35.526 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:23:35.498+0000 7fea0da2c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fea08109150 0x7fea081a0f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:48262/0 (socket says 172.21.15.19:48262) 2024-09-10T22:23:35.526 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:23:35.498+0000 7fea0da2c640 1 -- 172.21.15.19:0/933123278 learned_addr learned my addr 172.21.15.19:0/933123278 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:23:35.527 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:23:35.498+0000 7fea0d22b640 1 --2- 172.21.15.19:0/933123278 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fea08102dc0 0x7fea0819b620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:23:35.527 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:23:35.498+0000 7fea0ca2a640 1 --2- 172.21.15.19:0/933123278 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fea081087d0 0x7fea0819bb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:23:35.527 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:23:35.498+0000 7fea0da2c640 1 -- 172.21.15.19:0/933123278 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fea081087d0 msgr2=0x7fea0819bb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:23:35.527 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:23:35.498+0000 7fea0da2c640 1 --2- 172.21.15.19:0/933123278 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fea081087d0 0x7fea0819bb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:23:35.527 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:23:35.498+0000 7fea0da2c640 1 -- 172.21.15.19:0/933123278 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fea08102dc0 msgr2=0x7fea0819b620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:23:35.527 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:23:35.498+0000 7fea0da2c640 1 --2- 172.21.15.19:0/933123278 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fea08102dc0 0x7fea0819b620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:23:35.527 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:23:35.498+0000 7fea0da2c640 1 -- 172.21.15.19:0/933123278 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fea081a16d0 con 0x7fea08109150 2024-09-10T22:23:35.527 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:23:35.499+0000 7fea0ca2a640 1 --2- 172.21.15.19:0/933123278 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fea081087d0 0x7fea0819bb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T22:23:35.527 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:23:35.499+0000 7fea0da2c640 1 --2- 172.21.15.19:0/933123278 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fea08109150 0x7fea081a0f00 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fea0000b970 tx=0x7fea0000be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:23:35.527 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:23:35.499+0000 7fe9fe7fc640 1 -- 172.21.15.19:0/933123278 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea00019070 con 0x7fea08109150 2024-09-10T22:23:35.527 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:23:35.499+0000 7fe9fe7fc640 1 -- 172.21.15.19:0/933123278 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fea00014440 con 0x7fea08109150 2024-09-10T22:23:35.527 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:23:35.499+0000 7fe9fe7fc640 1 -- 172.21.15.19:0/933123278 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea000075d0 con 0x7fea08109150 2024-09-10T22:23:35.527 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:23:35.499+0000 7fea0f48f640 1 -- 172.21.15.19:0/933123278 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fea081a19c0 con 0x7fea08109150 2024-09-10T22:23:35.527 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:23:35.499+0000 7fea0f48f640 1 -- 172.21.15.19:0/933123278 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fea081a8100 con 0x7fea08109150 2024-09-10T22:23:35.528 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:23:35.500+0000 7fea0f48f640 1 -- 172.21.15.19:0/933123278 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fea08103220 con 0x7fea08109150 2024-09-10T22:23:35.528 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:23:35.501+0000 7fe9fe7fc640 1 -- 172.21.15.19:0/933123278 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 16) ==== 153250+0+0 (secure 0 0 0) 0x7fea0000cb40 con 0x7fea08109150 2024-09-10T22:23:35.528 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:23:35.502+0000 7fe9fe7fc640 1 --2- 172.21.15.19:0/933123278 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7fe9f40b5360 0x7fe9f40b7820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:23:35.528 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:23:35.502+0000 7fea0d22b640 1 --2- 172.21.15.19:0/933123278 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7fe9f40b5360 0x7fe9f40b7820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:23:35.528 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:23:35.502+0000 7fe9fe7fc640 1 -- 172.21.15.19:0/933123278 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(68..68 src has 1..68) ==== 7127+0+0 (secure 0 0 0) 0x7fea000e5390 con 0x7fea08109150 2024-09-10T22:23:35.528 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:23:35.503+0000 7fea0d22b640 1 --2- 172.21.15.19:0/933123278 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7fe9f40b5360 0x7fe9f40b7820 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fea0402a930 tx=0x7fea04005fd0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:23:35.528 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:23:35.505+0000 7fe9fe7fc640 1 -- 172.21.15.19:0/933123278 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7fea000ac6f0 con 0x7fea08109150 2024-09-10T22:23:35.692 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:23:35.691+0000 7fea0f48f640 1 -- 172.21.15.19:0/933123278 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fea0819c750 con 0x7fea08109150 2024-09-10T22:23:35.692 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:23:35 smithi019 ceph-mon[31375]: pgmap v253: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T22:23:35.693 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:23:35.692+0000 7fe9fe7fc640 1 -- 172.21.15.19:0/933123278 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v68) ==== 74+0+18478 (secure 0 0 0) 0x7fea0819c750 con 0x7fea08109150 2024-09-10T22:23:35.693 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-10T22:23:35.693 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":68,"fsid":"22997a4c-6fc2-11ef-bcea-c7b262605968","created":"2024-09-10T22:16:16.754696+0000","modified":"2024-09-10T22:23:33.425017+0000","last_up_change":"2024-09-10T22:23:32.417392+0000","last_in_change":"2024-09-10T22:23:09.614371+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T22:19:50.731662+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"783d96cb-0a8a-47f3-8eab-77cd731a64bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6802","nonce":234761879},{"type":"v1","addr":"172.21.15.19:6803","nonce":234761879}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6804","nonce":234761879},{"type":"v1","addr":"172.21.15.19:6805","nonce":234761879}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6808","nonce":234761879},{"type":"v1","addr":"172.21.15.19:6809","nonce":234761879}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6806","nonce":234761879},{"type":"v1","addr":"172.21.15.19:6807","nonce":234761879}]},"public_addr":"172.21.15.19:6803/234761879","cluster_addr":"172.21.15.19:6805/234761879","heartbeat_back_addr":"172.21.15.19:6809/234761879","heartbeat_front_addr":"172.21.15.19:6807/234761879","state":["exists","up"]},{"osd":1,"uuid":"41043581-e0cf-43b5-bae0-0d95e2ef8156","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6800","nonce":1803526886},{"type":"v1","addr":"172.21.15.135:6801","nonce":1803526886}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6802","nonce":1803526886},{"type":"v1","addr":"172.21.15.135:6803","nonce":1803526886}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6806","nonce":1803526886},{"type":"v1","addr":"172.21.15.135:6807","nonce":1803526886}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6804","nonce":1803526886},{"type":"v1","addr":"172.21.15.135:6805","nonce":1803526886}]},"public_addr":"172.21.15.135:6801/1803526886","cluster_addr":"172.21.15.135:6803/1803526886","heartbeat_back_addr":"172.21.15.135:6807/1803526886","heartbeat_front_addr":"172.21.15.135:6805/1803526886","state":["exists","up"]},{"osd":2,"uuid":"a9b14a06-bbdc-4501-96e2-fb5f7127ca16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6800","nonce":2747418770},{"type":"v1","addr":"172.21.15.138:6801","nonce":2747418770}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6802","nonce":2747418770},{"type":"v1","addr":"172.21.15.138:6803","nonce":2747418770}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6806","nonce":2747418770},{"type":"v1","addr":"172.21.15.138:6807","nonce":2747418770}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6804","nonce":2747418770},{"type":"v1","addr":"172.21.15.138:6805","nonce":2747418770}]},"public_addr":"172.21.15.138:6801/2747418770","cluster_addr":"172.21.15.138:6803/2747418770","heartbeat_back_addr":"172.21.15.138:6807/2747418770","heartbeat_front_addr":"172.21.15.138:6805/2747418770","state":["exists","up"]},{"osd":3,"uuid":"a46268da-8666-4cfa-b11a-30eb12e271be","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":23,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6810","nonce":1889857224},{"type":"v1","addr":"172.21.15.19:6811","nonce":1889857224}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6812","nonce":1889857224},{"type":"v1","addr":"172.21.15.19:6813","nonce":1889857224}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6816","nonce":1889857224},{"type":"v1","addr":"172.21.15.19:6817","nonce":1889857224}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6814","nonce":1889857224},{"type":"v1","addr":"172.21.15.19:6815","nonce":1889857224}]},"public_addr":"172.21.15.19:6811/1889857224","cluster_addr":"172.21.15.19:6813/1889857224","heartbeat_back_addr":"172.21.15.19:6817/1889857224","heartbeat_front_addr":"172.21.15.19:6815/1889857224","state":["exists","up"]},{"osd":4,"uuid":"c58df06f-2de2-4655-88e7-ac6a3531839a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":29,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6808","nonce":436311825},{"type":"v1","addr":"172.21.15.135:6809","nonce":436311825}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6810","nonce":436311825},{"type":"v1","addr":"172.21.15.135:6811","nonce":436311825}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6814","nonce":436311825},{"type":"v1","addr":"172.21.15.135:6815","nonce":436311825}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6812","nonce":436311825},{"type":"v1","addr":"172.21.15.135:6813","nonce":436311825}]},"public_addr":"172.21.15.135:6809/436311825","cluster_addr":"172.21.15.135:6811/436311825","heartbeat_back_addr":"172.21.15.135:6815/436311825","heartbeat_front_addr":"172.21.15.135:6813/436311825","state":["exists","up"]},{"osd":5,"uuid":"c0900b0c-aef4-498d-a01b-a891bdb51122","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6808","nonce":1086764290},{"type":"v1","addr":"172.21.15.138:6809","nonce":1086764290}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6810","nonce":1086764290},{"type":"v1","addr":"172.21.15.138:6811","nonce":1086764290}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6814","nonce":1086764290},{"type":"v1","addr":"172.21.15.138:6815","nonce":1086764290}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6812","nonce":1086764290},{"type":"v1","addr":"172.21.15.138:6813","nonce":1086764290}]},"public_addr":"172.21.15.138:6809/1086764290","cluster_addr":"172.21.15.138:6811/1086764290","heartbeat_back_addr":"172.21.15.138:6815/1086764290","heartbeat_front_addr":"172.21.15.138:6813/1086764290","state":["exists","up"]},{"osd":6,"uuid":"f79cb310-8073-4ee5-80a6-87a290600321","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":40,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6818","nonce":406328354},{"type":"v1","addr":"172.21.15.19:6819","nonce":406328354}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6820","nonce":406328354},{"type":"v1","addr":"172.21.15.19:6821","nonce":406328354}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6824","nonce":406328354},{"type":"v1","addr":"172.21.15.19:6825","nonce":406328354}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6822","nonce":406328354},{"type":"v1","addr":"172.21.15.19:6823","nonce":406328354}]},"public_addr":"172.21.15.19:6819/406328354","cluster_addr":"172.21.15.19:6821/406328354","heartbeat_back_addr":"172.21.15.19:6825/406328354","heartbeat_front_addr":"172.21.15.19:6823/406328354","state":["exists","up"]},{"osd":7,"uuid":"cc76476a-92f3-489c-be9e-29cbbf39539e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6816","nonce":1096613674},{"type":"v1","addr":"172.21.15.135:6817","nonce":1096613674}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6818","nonce":1096613674},{"type":"v1","addr":"172.21.15.135:6819","nonce":1096613674}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6822","nonce":1096613674},{"type":"v1","addr":"172.21.15.135:6823","nonce":1096613674}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6820","nonce":1096613674},{"type":"v1","addr":"172.21.15.135:6821","nonce":1096613674}]},"public_addr":"172.21.15.135:6817/1096613674","cluster_addr":"172.21.15.135:6819/1096613674","heartbeat_back_addr":"172.21.15.135:6823/1096613674","heartbeat_front_addr":"172.21.15.135:6821/1096613674","state":["exists","up"]},{"osd":8,"uuid":"5323a006-a6e8-4403-9c51-65f46298d5c4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6816","nonce":3020394729},{"type":"v1","addr":"172.21.15.138:6817","nonce":3020394729}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6818","nonce":3020394729},{"type":"v1","addr":"172.21.15.138:6819","nonce":3020394729}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6822","nonce":3020394729},{"type":"v1","addr":"172.21.15.138:6823","nonce":3020394729}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6820","nonce":3020394729},{"type":"v1","addr":"172.21.15.138:6821","nonce":3020394729}]},"public_addr":"172.21.15.138:6817/3020394729","cluster_addr":"172.21.15.138:6819/3020394729","heartbeat_back_addr":"172.21.15.138:6823/3020394729","heartbeat_front_addr":"172.21.15.138:6821/3020394729","state":["exists","up"]},{"osd":9,"uuid":"b869ac42-c46e-442c-8b5b-f81c018e663c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":57,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6826","nonce":1488680899},{"type":"v1","addr":"172.21.15.19:6827","nonce":1488680899}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6828","nonce":1488680899},{"type":"v1","addr":"172.21.15.19:6829","nonce":1488680899}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6832","nonce":1488680899},{"type":"v1","addr":"172.21.15.19:6833","nonce":1488680899}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6830","nonce":1488680899},{"type":"v1","addr":"172.21.15.19:6831","nonce":1488680899}]},"public_addr":"172.21.15.19:6827/1488680899","cluster_addr":"172.21.15.19:6829/1488680899","heartbeat_back_addr":"172.21.15.19:6833/1488680899","heartbeat_front_addr":"172.21.15.19:6831/1488680899","state":["exists","up"]},{"osd":10,"uuid":"b8a2d69a-6821-4c69-b7eb-c0cfc8164614","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":62,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6824","nonce":3812626754},{"type":"v1","addr":"172.21.15.135:6825","nonce":3812626754}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6826","nonce":3812626754},{"type":"v1","addr":"172.21.15.135:6827","nonce":3812626754}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6830","nonce":3812626754},{"type":"v1","addr":"172.21.15.135:6831","nonce":3812626754}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6828","nonce":3812626754},{"type":"v1","addr":"172.21.15.135:6829","nonce":3812626754}]},"public_addr":"172.21.15.135:6825/3812626754","cluster_addr":"172.21.15.135:6827/3812626754","heartbeat_back_addr":"172.21.15.135:6831/3812626754","heartbeat_front_addr":"172.21.15.135:6829/3812626754","state":["exists","up"]},{"osd":11,"uuid":"a9264ab2-5843-44d2-aba8-1e12708e99d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6824","nonce":1098434807},{"type":"v1","addr":"172.21.15.138:6825","nonce":1098434807}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6826","nonce":1098434807},{"type":"v1","addr":"172.21.15.138:6827","nonce":1098434807}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6830","nonce":1098434807},{"type":"v1","addr":"172.21.15.138:6831","nonce":1098434807}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6828","nonce":1098434807},{"type":"v1","addr":"172.21.15.138:6829","nonce":1098434807}]},"public_addr":"172.21.15.138:6825/1098434807","cluster_addr":"172.21.15.138:6827/1098434807","heartbeat_back_addr":"172.21.15.138:6831/1098434807","heartbeat_front_addr":"172.21.15.138:6829/1098434807","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:18:58.008025+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:19:22.475890+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:19:47.124147+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:20:12.438853+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:20:37.195177+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:21:02.474248+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:21:27.087207+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:21:52.119211+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:22:16.569989+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:22:41.680986+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:23:06.391885+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:23:30.695460+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.19:0/2099468127":"2024-09-11T22:17:04.260826+0000","172.21.15.19:0/538724915":"2024-09-11T22:17:04.260826+0000","172.21.15.19:0/3504695777":"2024-09-11T22:17:04.260826+0000","172.21.15.19:0/1401613792":"2024-09-11T22:16:39.069638+0000","172.21.15.19:6801/3005924425":"2024-09-11T22:17:04.260826+0000","172.21.15.19:6800/3005924425":"2024-09-11T22:17:04.260826+0000","172.21.15.19:0/104917892":"2024-09-11T22:16:39.069638+0000","172.21.15.19:0/1778305990":"2024-09-11T22:16:39.069638+0000","172.21.15.19:6801/535670059":"2024-09-11T22:16:39.069638+0000","172.21.15.19:6800/535670059":"2024-09-11T22:16:39.069638+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T22:23:35.696 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:23:35.694+0000 7fea0f48f640 1 -- 172.21.15.19:0/933123278 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7fe9f40b5360 msgr2=0x7fe9f40b7820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:23:35.696 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:23:35.694+0000 7fea0f48f640 1 --2- 172.21.15.19:0/933123278 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7fe9f40b5360 0x7fe9f40b7820 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fea0402a930 tx=0x7fea04005fd0 comp rx=0 tx=0).stop 2024-09-10T22:23:35.696 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:23:35.694+0000 7fea0f48f640 1 -- 172.21.15.19:0/933123278 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fea08109150 msgr2=0x7fea081a0f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:23:35.696 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:23:35.694+0000 7fea0f48f640 1 --2- 172.21.15.19:0/933123278 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fea08109150 0x7fea081a0f00 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fea0000b970 tx=0x7fea0000be30 comp rx=0 tx=0).stop 2024-09-10T22:23:35.696 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:23:35.694+0000 7fea0f48f640 1 -- 172.21.15.19:0/933123278 shutdown_connections 2024-09-10T22:23:35.696 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:23:35.694+0000 7fea0f48f640 1 --2- 172.21.15.19:0/933123278 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7fe9f40b5360 0x7fe9f40b7820 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:23:35.696 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:23:35.694+0000 7fea0f48f640 1 --2- 172.21.15.19:0/933123278 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fea08109150 0x7fea081a0f00 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:23:35.696 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:23:35.694+0000 7fea0f48f640 1 --2- 172.21.15.19:0/933123278 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fea081087d0 0x7fea0819bb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:23:35.696 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:23:35.694+0000 7fea0f48f640 1 --2- 172.21.15.19:0/933123278 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fea08102dc0 0x7fea0819b620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:23:35.696 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:23:35.694+0000 7fea0f48f640 1 -- 172.21.15.19:0/933123278 >> 172.21.15.19:0/933123278 conn(0x7fea080fe830 msgr2=0x7fea08104d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:23:35.697 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:23:35.695+0000 7fea0f48f640 1 -- 172.21.15.19:0/933123278 shutdown_connections 2024-09-10T22:23:35.697 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:23:35.695+0000 7fea0f48f640 1 -- 172.21.15.19:0/933123278 wait complete. 2024-09-10T22:23:35.859 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:23:35 smithi135 ceph-mon[34789]: pgmap v253: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T22:23:35.875 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:23:35 smithi138 ceph-mon[35236]: pgmap v253: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T22:23:36.388 INFO:tasks.cephadm.ceph_manager.ceph:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-10T22:19:50.731662+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-10T22:23:36.388 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 22997a4c-6fc2-11ef-bcea-c7b262605968 -- ceph osd pool get .mgr pg_num 2024-09-10T22:23:36.648 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/22997a4c-6fc2-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T22:23:36.708 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:23:36 smithi019 ceph-mon[31375]: from='client.? 172.21.15.19:0/933123278' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-10T22:23:36.859 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:23:36 smithi135 ceph-mon[34789]: from='client.? 172.21.15.19:0/933123278' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-10T22:23:36.875 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:23:36 smithi138 ceph-mon[35236]: from='client.? 172.21.15.19:0/933123278' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-10T22:23:37.124 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:23:37.098+0000 7fe2402e7640 1 -- 172.21.15.19:0/1299431047 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe2381087d0 msgr2=0x7fe238108c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:23:37.124 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:23:37.098+0000 7fe2402e7640 1 --2- 172.21.15.19:0/1299431047 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe2381087d0 0x7fe238108c10 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fe228009900 tx=0x7fe22802a410 comp rx=0 tx=0).stop 2024-09-10T22:23:37.124 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:23:37.098+0000 7fe2402e7640 1 -- 172.21.15.19:0/1299431047 shutdown_connections 2024-09-10T22:23:37.124 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:23:37.098+0000 7fe2402e7640 1 --2- 172.21.15.19:0/1299431047 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe238109150 0x7fe23810f950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:23:37.124 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:23:37.098+0000 7fe2402e7640 1 --2- 172.21.15.19:0/1299431047 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe2381087d0 0x7fe238108c10 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:23:37.124 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:23:37.098+0000 7fe2402e7640 1 --2- 172.21.15.19:0/1299431047 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe238102dc0 0x7fe2381031a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:23:37.125 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:23:37.098+0000 7fe2402e7640 1 -- 172.21.15.19:0/1299431047 >> 172.21.15.19:0/1299431047 conn(0x7fe2380fe830 msgr2=0x7fe238100c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:23:37.125 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:23:37.098+0000 7fe2402e7640 1 -- 172.21.15.19:0/1299431047 shutdown_connections 2024-09-10T22:23:37.125 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:23:37.098+0000 7fe2402e7640 1 -- 172.21.15.19:0/1299431047 wait complete. 2024-09-10T22:23:37.125 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:23:37.099+0000 7fe2402e7640 1 Processor -- start 2024-09-10T22:23:37.125 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:23:37.099+0000 7fe2402e7640 1 -- start start 2024-09-10T22:23:37.125 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:23:37.099+0000 7fe2402e7640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe238102dc0 0x7fe23819b500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:23:37.125 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:23:37.099+0000 7fe2402e7640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe2381087d0 0x7fe23819ba40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:23:37.125 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:23:37.099+0000 7fe2402e7640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe238109150 0x7fe2381a0de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:23:37.125 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:23:37.099+0000 7fe2402e7640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fe238112e10 con 0x7fe2381087d0 2024-09-10T22:23:37.125 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:23:37.099+0000 7fe2402e7640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fe238112c90 con 0x7fe238109150 2024-09-10T22:23:37.125 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:23:37.099+0000 7fe2402e7640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7fe238112f90 con 0x7fe238102dc0 2024-09-10T22:23:37.125 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:23:37.099+0000 7fe23d882640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe2381087d0 0x7fe23819ba40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:23:37.125 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:23:37.099+0000 7fe23d882640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe2381087d0 0x7fe23819ba40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:48280/0 (socket says 172.21.15.19:48280) 2024-09-10T22:23:37.126 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:23:37.099+0000 7fe23d882640 1 -- 172.21.15.19:0/3445819054 learned_addr learned my addr 172.21.15.19:0/3445819054 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:23:37.126 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:23:37.100+0000 7fe23e083640 1 --2- 172.21.15.19:0/3445819054 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe238102dc0 0x7fe23819b500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:23:37.126 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:23:37.100+0000 7fe23e884640 1 --2- 172.21.15.19:0/3445819054 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe238109150 0x7fe2381a0de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:23:37.126 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:23:37.100+0000 7fe23d882640 1 -- 172.21.15.19:0/3445819054 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe238102dc0 msgr2=0x7fe23819b500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:23:37.126 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:23:37.100+0000 7fe23d882640 1 --2- 172.21.15.19:0/3445819054 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe238102dc0 0x7fe23819b500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:23:37.126 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:23:37.100+0000 7fe23d882640 1 -- 172.21.15.19:0/3445819054 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe238109150 msgr2=0x7fe2381a0de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:23:37.126 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:23:37.100+0000 7fe23d882640 1 --2- 172.21.15.19:0/3445819054 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe238109150 0x7fe2381a0de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:23:37.126 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:23:37.100+0000 7fe23d882640 1 -- 172.21.15.19:0/3445819054 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe2381a15b0 con 0x7fe2381087d0 2024-09-10T22:23:37.126 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:23:37.100+0000 7fe23e884640 1 --2- 172.21.15.19:0/3445819054 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe238109150 0x7fe2381a0de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T22:23:37.126 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:23:37.100+0000 7fe23d882640 1 --2- 172.21.15.19:0/3445819054 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe2381087d0 0x7fe23819ba40 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fe228005940 tx=0x7fe2280042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:23:37.126 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:23:37.100+0000 7fe22f7fe640 1 -- 172.21.15.19:0/3445819054 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe22803f030 con 0x7fe2381087d0 2024-09-10T22:23:37.127 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:23:37.100+0000 7fe22f7fe640 1 -- 172.21.15.19:0/3445819054 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe228003cb0 con 0x7fe2381087d0 2024-09-10T22:23:37.127 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:23:37.100+0000 7fe2402e7640 1 -- 172.21.15.19:0/3445819054 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe2381a1840 con 0x7fe2381087d0 2024-09-10T22:23:37.127 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:23:37.100+0000 7fe22f7fe640 1 -- 172.21.15.19:0/3445819054 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe228035070 con 0x7fe2381087d0 2024-09-10T22:23:37.127 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:23:37.100+0000 7fe2402e7640 1 -- 172.21.15.19:0/3445819054 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe2381a7f60 con 0x7fe2381087d0 2024-09-10T22:23:37.127 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:23:37.101+0000 7fe2402e7640 1 -- 172.21.15.19:0/3445819054 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe2381031a0 con 0x7fe2381087d0 2024-09-10T22:23:37.127 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:23:37.103+0000 7fe22f7fe640 1 -- 172.21.15.19:0/3445819054 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 16) ==== 153250+0+0 (secure 0 0 0) 0x7fe22803bbf0 con 0x7fe2381087d0 2024-09-10T22:23:37.127 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:23:37.103+0000 7fe22f7fe640 1 --2- 172.21.15.19:0/3445819054 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7fe2240b52e0 0x7fe2240b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:23:37.127 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:23:37.104+0000 7fe23e083640 1 --2- 172.21.15.19:0/3445819054 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7fe2240b52e0 0x7fe2240b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:23:37.127 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:23:37.104+0000 7fe22f7fe640 1 -- 172.21.15.19:0/3445819054 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(68..68 src has 1..68) ==== 7127+0+0 (secure 0 0 0) 0x7fe2281065e0 con 0x7fe2381087d0 2024-09-10T22:23:37.127 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:23:37.104+0000 7fe23e083640 1 --2- 172.21.15.19:0/3445819054 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7fe2240b52e0 0x7fe2240b77a0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fe234005fd0 tx=0x7fe234005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:23:37.127 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:23:37.106+0000 7fe22f7fe640 1 -- 172.21.15.19:0/3445819054 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7fe2280cd940 con 0x7fe2381087d0 2024-09-10T22:23:37.294 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:23:37.292+0000 7fe2402e7640 1 -- 172.21.15.19:0/3445819054 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fe23802e5c0 con 0x7fe2381087d0 2024-09-10T22:23:37.294 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:23:37.292+0000 7fe22f7fe640 1 -- 172.21.15.19:0/3445819054 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v68) ==== 93+0+10 (secure 0 0 0) 0x7fe2280cd240 con 0x7fe2381087d0 2024-09-10T22:23:37.294 INFO:teuthology.orchestra.run.smithi019.stdout:pg_num: 1 2024-09-10T22:23:37.296 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:23:37.294+0000 7fe2402e7640 1 -- 172.21.15.19:0/3445819054 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7fe2240b52e0 msgr2=0x7fe2240b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:23:37.296 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:23:37.294+0000 7fe2402e7640 1 --2- 172.21.15.19:0/3445819054 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7fe2240b52e0 0x7fe2240b77a0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fe234005fd0 tx=0x7fe234005850 comp rx=0 tx=0).stop 2024-09-10T22:23:37.296 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:23:37.294+0000 7fe2402e7640 1 -- 172.21.15.19:0/3445819054 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe2381087d0 msgr2=0x7fe23819ba40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:23:37.296 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:23:37.294+0000 7fe2402e7640 1 --2- 172.21.15.19:0/3445819054 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe2381087d0 0x7fe23819ba40 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fe228005940 tx=0x7fe2280042f0 comp rx=0 tx=0).stop 2024-09-10T22:23:37.296 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:23:37.295+0000 7fe2402e7640 1 -- 172.21.15.19:0/3445819054 shutdown_connections 2024-09-10T22:23:37.296 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:23:37.295+0000 7fe2402e7640 1 --2- 172.21.15.19:0/3445819054 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7fe2240b52e0 0x7fe2240b77a0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:23:37.296 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:23:37.295+0000 7fe2402e7640 1 --2- 172.21.15.19:0/3445819054 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe238109150 0x7fe2381a0de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:23:37.297 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:23:37.295+0000 7fe2402e7640 1 --2- 172.21.15.19:0/3445819054 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe2381087d0 0x7fe23819ba40 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:23:37.297 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:23:37.295+0000 7fe2402e7640 1 --2- 172.21.15.19:0/3445819054 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe238102dc0 0x7fe23819b500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:23:37.297 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:23:37.295+0000 7fe2402e7640 1 -- 172.21.15.19:0/3445819054 >> 172.21.15.19:0/3445819054 conn(0x7fe2380fe830 msgr2=0x7fe238105db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:23:37.297 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:23:37.295+0000 7fe2402e7640 1 -- 172.21.15.19:0/3445819054 shutdown_connections 2024-09-10T22:23:37.297 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:23:37.295+0000 7fe2402e7640 1 -- 172.21.15.19:0/3445819054 wait complete. 2024-09-10T22:23:37.643 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:23:37 smithi019 ceph-mon[31375]: pgmap v254: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T22:23:37.644 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:23:37 smithi019 ceph-mon[31375]: from='client.? 172.21.15.19:0/3445819054' entity='client.admin' cmd={"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} : dispatch 2024-09-10T22:23:37.859 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:23:37 smithi135 ceph-mon[34789]: pgmap v254: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T22:23:37.859 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:23:37 smithi135 ceph-mon[34789]: from='client.? 172.21.15.19:0/3445819054' entity='client.admin' cmd={"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} : dispatch 2024-09-10T22:23:37.874 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:23:37 smithi138 ceph-mon[35236]: pgmap v254: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T22:23:37.875 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:23:37 smithi138 ceph-mon[35236]: from='client.? 172.21.15.19:0/3445819054' entity='client.admin' cmd={"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} : dispatch 2024-09-10T22:23:37.990 INFO:tasks.cephadm:Adding mds.a on smithi019 2024-09-10T22:23:37.991 INFO:tasks.cephadm:Adding mds.d on smithi019 2024-09-10T22:23:37.991 INFO:tasks.cephadm:Adding mds.g on smithi019 2024-09-10T22:23:37.991 INFO:tasks.cephadm:Adding mds.j on smithi019 2024-09-10T22:23:37.991 INFO:tasks.cephadm:Adding mds.b on smithi135 2024-09-10T22:23:37.991 INFO:tasks.cephadm:Adding mds.e on smithi135 2024-09-10T22:23:37.991 INFO:tasks.cephadm:Adding mds.h on smithi135 2024-09-10T22:23:37.991 INFO:tasks.cephadm:Adding mds.k on smithi135 2024-09-10T22:23:37.991 INFO:tasks.cephadm:Adding mds.c on smithi138 2024-09-10T22:23:37.991 INFO:tasks.cephadm:Adding mds.f on smithi138 2024-09-10T22:23:37.991 INFO:tasks.cephadm:Adding mds.i on smithi138 2024-09-10T22:23:37.991 INFO:tasks.cephadm:Adding mds.l on smithi138 2024-09-10T22:23:37.992 DEBUG:teuthology.orchestra.run.smithi138:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 22997a4c-6fc2-11ef-bcea-c7b262605968 -- ceph orch apply mds all '12;smithi019=a;smithi019=d;smithi019=g;smithi019=j;smithi135=b;smithi135=e;smithi135=h;smithi135=k;smithi138=c;smithi138=f;smithi138=i;smithi138=l' 2024-09-10T22:23:38.250 INFO:teuthology.orchestra.run.smithi138.stderr:Inferring config /var/lib/ceph/22997a4c-6fc2-11ef-bcea-c7b262605968/mon.c/config 2024-09-10T22:23:38.791 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-10T22:23:38.766+0000 7f2b66006640 1 -- 172.21.15.138:0/4160540984 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f2b60101920 msgr2=0x7f2b60101d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:23:38.792 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-10T22:23:38.766+0000 7f2b66006640 1 --2- 172.21.15.138:0/4160540984 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f2b60101920 0x7f2b60101d20 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f2b50009960 tx=0x7f2b5002a460 comp rx=0 tx=0).stop 2024-09-10T22:23:38.792 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-10T22:23:38.766+0000 7f2b66006640 1 -- 172.21.15.138:0/4160540984 shutdown_connections 2024-09-10T22:23:38.792 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-10T22:23:38.766+0000 7f2b66006640 1 --2- 172.21.15.138:0/4160540984 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2b60103440 0x7f2b60109dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:23:38.792 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-10T22:23:38.766+0000 7f2b66006640 1 --2- 172.21.15.138:0/4160540984 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2b60102a80 0x7f2b60102f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:23:38.792 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-10T22:23:38.766+0000 7f2b66006640 1 --2- 172.21.15.138:0/4160540984 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f2b60101920 0x7f2b60101d20 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:23:38.792 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-10T22:23:38.766+0000 7f2b66006640 1 -- 172.21.15.138:0/4160540984 >> 172.21.15.138:0/4160540984 conn(0x7f2b600fd210 msgr2=0x7f2b600ff630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:23:38.792 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-10T22:23:38.766+0000 7f2b66006640 1 -- 172.21.15.138:0/4160540984 shutdown_connections 2024-09-10T22:23:38.792 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-10T22:23:38.766+0000 7f2b66006640 1 -- 172.21.15.138:0/4160540984 wait complete. 2024-09-10T22:23:38.792 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-10T22:23:38.767+0000 7f2b66006640 1 Processor -- start 2024-09-10T22:23:38.792 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-10T22:23:38.767+0000 7f2b66006640 1 -- start start 2024-09-10T22:23:38.792 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-10T22:23:38.768+0000 7f2b66006640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2b60101920 0x7f2b60197e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:23:38.792 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-10T22:23:38.768+0000 7f2b66006640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f2b60102a80 0x7f2b601984e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:23:38.793 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-10T22:23:38.768+0000 7f2b66006640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2b60103440 0x7f2b60199120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:23:38.793 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-10T22:23:38.768+0000 7f2b66006640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f2b6010d6d0 con 0x7f2b60101920 2024-09-10T22:23:38.793 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-10T22:23:38.768+0000 7f2b66006640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f2b6010d550 con 0x7f2b60103440 2024-09-10T22:23:38.793 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-10T22:23:38.768+0000 7f2b66006640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f2b6010d850 con 0x7f2b60102a80 2024-09-10T22:23:38.793 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-10T22:23:38.768+0000 7f2b5effd640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f2b60102a80 0x7f2b601984e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:23:38.793 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-10T22:23:38.768+0000 7f2b5effd640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f2b60102a80 0x7f2b601984e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:46182/0 (socket says 172.21.15.138:46182) 2024-09-10T22:23:38.793 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-10T22:23:38.768+0000 7f2b5effd640 1 -- 172.21.15.138:0/3503137313 learned_addr learned my addr 172.21.15.138:0/3503137313 (peer_addr_for_me v2:172.21.15.138:0/0) 2024-09-10T22:23:38.793 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-10T22:23:38.768+0000 7f2b5f7fe640 1 --2- 172.21.15.138:0/3503137313 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2b60101920 0x7f2b60197e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:23:38.793 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-10T22:23:38.768+0000 7f2b5ffff640 1 --2- 172.21.15.138:0/3503137313 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2b60103440 0x7f2b60199120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:23:38.793 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-10T22:23:38.768+0000 7f2b5effd640 1 -- 172.21.15.138:0/3503137313 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2b60103440 msgr2=0x7f2b60199120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:23:38.793 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-10T22:23:38.768+0000 7f2b5effd640 1 --2- 172.21.15.138:0/3503137313 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2b60103440 0x7f2b60199120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:23:38.793 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-10T22:23:38.768+0000 7f2b5effd640 1 -- 172.21.15.138:0/3503137313 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2b60101920 msgr2=0x7f2b60197e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:23:38.794 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-10T22:23:38.768+0000 7f2b5effd640 1 --2- 172.21.15.138:0/3503137313 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2b60101920 0x7f2b60197e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:23:38.794 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-10T22:23:38.768+0000 7f2b5effd640 1 -- 172.21.15.138:0/3503137313 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2b601999c0 con 0x7f2b60102a80 2024-09-10T22:23:38.794 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-10T22:23:38.768+0000 7f2b5effd640 1 --2- 172.21.15.138:0/3503137313 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f2b60102a80 0x7f2b601984e0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f2b5400b4a0 tx=0x7f2b5400b960 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:23:38.794 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-10T22:23:38.768+0000 7f2b5cff9640 1 -- 172.21.15.138:0/3503137313 <== mon.1 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b54014070 con 0x7f2b60102a80 2024-09-10T22:23:38.794 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-10T22:23:38.769+0000 7f2b5cff9640 1 -- 172.21.15.138:0/3503137313 <== mon.1 v2:172.21.15.138:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2b54010ac0 con 0x7f2b60102a80 2024-09-10T22:23:38.794 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-10T22:23:38.769+0000 7f2b66006640 1 -- 172.21.15.138:0/3503137313 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2b60199cb0 con 0x7f2b60102a80 2024-09-10T22:23:38.794 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-10T22:23:38.769+0000 7f2b5cff9640 1 -- 172.21.15.138:0/3503137313 <== mon.1 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b54017c30 con 0x7f2b60102a80 2024-09-10T22:23:38.794 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-10T22:23:38.769+0000 7f2b66006640 1 -- 172.21.15.138:0/3503137313 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2b601a0390 con 0x7f2b60102a80 2024-09-10T22:23:38.794 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-10T22:23:38.770+0000 7f2b66006640 1 -- 172.21.15.138:0/3503137313 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2b60108cf0 con 0x7f2b60102a80 2024-09-10T22:23:38.794 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-10T22:23:38.771+0000 7f2b5cff9640 1 -- 172.21.15.138:0/3503137313 <== mon.1 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 16) ==== 153250+0+0 (secure 0 0 0) 0x7f2b54010610 con 0x7f2b60102a80 2024-09-10T22:23:38.794 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-10T22:23:38.772+0000 7f2b5cff9640 1 --2- 172.21.15.138:0/3503137313 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f2b480b5360 0x7f2b480b7820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:23:38.794 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-10T22:23:38.772+0000 7f2b5cff9640 1 -- 172.21.15.138:0/3503137313 <== mon.1 v2:172.21.15.138:3300/0 5 ==== osd_map(68..68 src has 1..68) ==== 7127+0+0 (secure 0 0 0) 0x7f2b540e4fe0 con 0x7f2b60102a80 2024-09-10T22:23:38.794 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-10T22:23:38.772+0000 7f2b5f7fe640 1 --2- 172.21.15.138:0/3503137313 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f2b480b5360 0x7f2b480b7820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:23:38.795 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-10T22:23:38.773+0000 7f2b5f7fe640 1 --2- 172.21.15.138:0/3503137313 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f2b480b5360 0x7f2b480b7820 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f2b50005ab0 tx=0x7f2b50005d50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:23:38.795 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-10T22:23:38.776+0000 7f2b5cff9640 1 -- 172.21.15.138:0/3503137313 <== mon.1 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f2b540ac2c0 con 0x7f2b60102a80 2024-09-10T22:23:38.967 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-10T22:23:38.965+0000 7f2b66006640 1 -- 172.21.15.138:0/3503137313 --> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] -- mgr_command(tid 0: {"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi019=a;smithi019=d;smithi019=g;smithi019=j;smithi135=b;smithi135=e;smithi135=h;smithi135=k;smithi138=c;smithi138=f;smithi138=i;smithi138=l", "target": ["mon-mgr", ""]}) -- 0x7f2b60063790 con 0x7f2b480b5360 2024-09-10T22:23:38.975 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-10T22:23:38.974+0000 7f2b5cff9640 1 -- 172.21.15.138:0/3503137313 <== mgr.14150 v2:172.21.15.19:6800/2119495487 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+28 (secure 0 0 0) 0x7f2b60063790 con 0x7f2b480b5360 2024-09-10T22:23:38.975 INFO:teuthology.orchestra.run.smithi138.stdout:Scheduled mds.all update... 2024-09-10T22:23:38.978 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-10T22:23:38.977+0000 7f2b66006640 1 -- 172.21.15.138:0/3503137313 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f2b480b5360 msgr2=0x7f2b480b7820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:23:38.978 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-10T22:23:38.977+0000 7f2b66006640 1 --2- 172.21.15.138:0/3503137313 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f2b480b5360 0x7f2b480b7820 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f2b50005ab0 tx=0x7f2b50005d50 comp rx=0 tx=0).stop 2024-09-10T22:23:38.979 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-10T22:23:38.977+0000 7f2b66006640 1 -- 172.21.15.138:0/3503137313 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f2b60102a80 msgr2=0x7f2b601984e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:23:38.979 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-10T22:23:38.977+0000 7f2b66006640 1 --2- 172.21.15.138:0/3503137313 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f2b60102a80 0x7f2b601984e0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f2b5400b4a0 tx=0x7f2b5400b960 comp rx=0 tx=0).stop 2024-09-10T22:23:38.979 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-10T22:23:38.977+0000 7f2b66006640 1 -- 172.21.15.138:0/3503137313 shutdown_connections 2024-09-10T22:23:38.979 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-10T22:23:38.977+0000 7f2b66006640 1 --2- 172.21.15.138:0/3503137313 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f2b480b5360 0x7f2b480b7820 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:23:38.979 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-10T22:23:38.977+0000 7f2b66006640 1 --2- 172.21.15.138:0/3503137313 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2b60103440 0x7f2b60199120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:23:38.979 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-10T22:23:38.977+0000 7f2b66006640 1 --2- 172.21.15.138:0/3503137313 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f2b60102a80 0x7f2b601984e0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:23:38.979 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-10T22:23:38.977+0000 7f2b66006640 1 --2- 172.21.15.138:0/3503137313 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2b60101920 0x7f2b60197e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:23:38.979 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-10T22:23:38.977+0000 7f2b66006640 1 -- 172.21.15.138:0/3503137313 >> 172.21.15.138:0/3503137313 conn(0x7f2b600fd210 msgr2=0x7f2b60105ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:23:38.979 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-10T22:23:38.977+0000 7f2b66006640 1 -- 172.21.15.138:0/3503137313 shutdown_connections 2024-09-10T22:23:38.979 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-10T22:23:38.977+0000 7f2b66006640 1 -- 172.21.15.138:0/3503137313 wait complete. 2024-09-10T22:23:39.582 DEBUG:teuthology.orchestra.run.smithi019:mds.a> sudo journalctl -f -n 0 -u ceph-22997a4c-6fc2-11ef-bcea-c7b262605968@mds.a.service 2024-09-10T22:23:39.585 DEBUG:teuthology.orchestra.run.smithi019:mds.d> sudo journalctl -f -n 0 -u ceph-22997a4c-6fc2-11ef-bcea-c7b262605968@mds.d.service 2024-09-10T22:23:39.628 DEBUG:teuthology.orchestra.run.smithi019:mds.g> sudo journalctl -f -n 0 -u ceph-22997a4c-6fc2-11ef-bcea-c7b262605968@mds.g.service 2024-09-10T22:23:39.671 DEBUG:teuthology.orchestra.run.smithi019:mds.j> sudo journalctl -f -n 0 -u ceph-22997a4c-6fc2-11ef-bcea-c7b262605968@mds.j.service 2024-09-10T22:23:39.714 DEBUG:teuthology.orchestra.run.smithi135:mds.b> sudo journalctl -f -n 0 -u ceph-22997a4c-6fc2-11ef-bcea-c7b262605968@mds.b.service 2024-09-10T22:23:39.718 DEBUG:teuthology.orchestra.run.smithi135:mds.e> sudo journalctl -f -n 0 -u ceph-22997a4c-6fc2-11ef-bcea-c7b262605968@mds.e.service 2024-09-10T22:23:39.761 DEBUG:teuthology.orchestra.run.smithi135:mds.h> sudo journalctl -f -n 0 -u ceph-22997a4c-6fc2-11ef-bcea-c7b262605968@mds.h.service 2024-09-10T22:23:39.804 DEBUG:teuthology.orchestra.run.smithi135:mds.k> sudo journalctl -f -n 0 -u ceph-22997a4c-6fc2-11ef-bcea-c7b262605968@mds.k.service 2024-09-10T22:23:39.847 DEBUG:teuthology.orchestra.run.smithi138:mds.c> sudo journalctl -f -n 0 -u ceph-22997a4c-6fc2-11ef-bcea-c7b262605968@mds.c.service 2024-09-10T22:23:39.849 DEBUG:teuthology.orchestra.run.smithi138:mds.f> sudo journalctl -f -n 0 -u ceph-22997a4c-6fc2-11ef-bcea-c7b262605968@mds.f.service 2024-09-10T22:23:39.892 DEBUG:teuthology.orchestra.run.smithi138:mds.i> sudo journalctl -f -n 0 -u ceph-22997a4c-6fc2-11ef-bcea-c7b262605968@mds.i.service 2024-09-10T22:23:39.935 DEBUG:teuthology.orchestra.run.smithi138:mds.l> sudo journalctl -f -n 0 -u ceph-22997a4c-6fc2-11ef-bcea-c7b262605968@mds.l.service 2024-09-10T22:23:39.980 INFO:tasks.cephadm:Setting up CephFS filesystem(s)... 2024-09-10T22:23:39.981 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 22997a4c-6fc2-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-10T22:23:40.110 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:23:39 smithi135 ceph-mon[34789]: pgmap v255: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T22:23:40.110 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:23:39 smithi135 ceph-mon[34789]: from='client.24499 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi019=a;smithi019=d;smithi019=g;smithi019=j;smithi135=b;smithi135=e;smithi135=h;smithi135=k;smithi138=c;smithi138=f;smithi138=i;smithi138=l", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T22:23:40.110 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:23:39 smithi135 ceph-mon[34789]: Saving service mds.all spec with placement smithi019=a;smithi019=d;smithi019=g;smithi019=j;smithi135=b;smithi135=e;smithi135=h;smithi135=k;smithi138=c;smithi138=f;smithi138=i;smithi138=l;count:12 2024-09-10T22:23:40.110 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:23:39 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:23:40.110 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:23:39 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T22:23:40.110 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:23:39 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T22:23:40.110 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:23:39 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T22:23:40.110 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:23:39 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:23:40.110 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:23:39 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-10T22:23:40.110 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:23:39 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-10T22:23:40.110 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:23:39 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T22:23:40.125 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:23:39 smithi138 ceph-mon[35236]: pgmap v255: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T22:23:40.125 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:23:39 smithi138 ceph-mon[35236]: from='client.24499 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi019=a;smithi019=d;smithi019=g;smithi019=j;smithi135=b;smithi135=e;smithi135=h;smithi135=k;smithi138=c;smithi138=f;smithi138=i;smithi138=l", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T22:23:40.125 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:23:39 smithi138 ceph-mon[35236]: Saving service mds.all spec with placement smithi019=a;smithi019=d;smithi019=g;smithi019=j;smithi135=b;smithi135=e;smithi135=h;smithi135=k;smithi138=c;smithi138=f;smithi138=i;smithi138=l;count:12 2024-09-10T22:23:40.125 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:23:39 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:23:40.125 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:23:39 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T22:23:40.125 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:23:39 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T22:23:40.125 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:23:39 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T22:23:40.125 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:23:39 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:23:40.125 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:23:39 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-10T22:23:40.126 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:23:39 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-10T22:23:40.126 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:23:39 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T22:23:40.237 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/22997a4c-6fc2-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T22:23:40.359 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:23:39 smithi019 ceph-mon[31375]: pgmap v255: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T22:23:40.359 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:23:39 smithi019 ceph-mon[31375]: from='client.24499 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi019=a;smithi019=d;smithi019=g;smithi019=j;smithi135=b;smithi135=e;smithi135=h;smithi135=k;smithi138=c;smithi138=f;smithi138=i;smithi138=l", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T22:23:40.359 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:23:39 smithi019 ceph-mon[31375]: Saving service mds.all spec with placement smithi019=a;smithi019=d;smithi019=g;smithi019=j;smithi135=b;smithi135=e;smithi135=h;smithi135=k;smithi138=c;smithi138=f;smithi138=i;smithi138=l;count:12 2024-09-10T22:23:40.359 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:23:39 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:23:40.359 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:23:39 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T22:23:40.359 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:23:39 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T22:23:40.359 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:23:39 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T22:23:40.359 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:23:39 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:23:40.359 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:23:39 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-10T22:23:40.359 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:23:39 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-10T22:23:40.360 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:23:39 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T22:23:40.698 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:23:40.688+0000 7f8a022ed640 1 -- 172.21.15.19:0/1842062151 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f89fc10d0e0 msgr2=0x7f89fc10f550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:23:40.698 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:23:40.688+0000 7f8a022ed640 1 --2- 172.21.15.19:0/1842062151 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f89fc10d0e0 0x7f89fc10f550 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f89f4009ca0 tx=0x7f89f402a8c0 comp rx=0 tx=0).stop 2024-09-10T22:23:40.698 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:23:40.688+0000 7f8a022ed640 1 -- 172.21.15.19:0/1842062151 shutdown_connections 2024-09-10T22:23:40.698 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:23:40.688+0000 7f8a022ed640 1 --2- 172.21.15.19:0/1842062151 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f89fc10d0e0 0x7f89fc10f550 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:23:40.698 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:23:40.688+0000 7f8a022ed640 1 --2- 172.21.15.19:0/1842062151 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f89fc104530 0x7f89fc10cb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:23:40.698 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:23:40.688+0000 7f8a022ed640 1 --2- 172.21.15.19:0/1842062151 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f89fc103b30 0x7f89fc103f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:23:40.698 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:23:40.688+0000 7f8a022ed640 1 -- 172.21.15.19:0/1842062151 >> 172.21.15.19:0/1842062151 conn(0x7f89fc0fd700 msgr2=0x7f89fc0ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:23:40.699 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:23:40.688+0000 7f8a022ed640 1 -- 172.21.15.19:0/1842062151 shutdown_connections 2024-09-10T22:23:40.699 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:23:40.688+0000 7f8a022ed640 1 -- 172.21.15.19:0/1842062151 wait complete. 2024-09-10T22:23:40.699 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:23:40.688+0000 7f8a022ed640 1 Processor -- start 2024-09-10T22:23:40.699 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:23:40.688+0000 7f8a022ed640 1 -- start start 2024-09-10T22:23:40.699 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:23:40.689+0000 7f8a022ed640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f89fc103b30 0x7f89fc199210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:23:40.699 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:23:40.689+0000 7f8a022ed640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f89fc104530 0x7f89fc199750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:23:40.699 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:23:40.689+0000 7f8a022ed640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f89fc10d0e0 0x7f89fc19eaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:23:40.699 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:23:40.689+0000 7f8a022ed640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f89fc112d60 con 0x7f89fc10d0e0 2024-09-10T22:23:40.699 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:23:40.689+0000 7f8a022ed640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f89fc112be0 con 0x7f89fc103b30 2024-09-10T22:23:40.699 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:23:40.689+0000 7f8a022ed640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f89fc112ee0 con 0x7f89fc104530 2024-09-10T22:23:40.699 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:23:40.689+0000 7f8a0088a640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f89fc10d0e0 0x7f89fc19eaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:23:40.700 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:23:40.689+0000 7f8a0088a640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f89fc10d0e0 0x7f89fc19eaf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:48294/0 (socket says 172.21.15.19:48294) 2024-09-10T22:23:40.700 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:23:40.689+0000 7f8a0088a640 1 -- 172.21.15.19:0/1140649765 learned_addr learned my addr 172.21.15.19:0/1140649765 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:23:40.700 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:23:40.689+0000 7f89fb7fe640 1 --2- 172.21.15.19:0/1140649765 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f89fc104530 0x7f89fc199750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:23:40.700 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:23:40.689+0000 7f89fbfff640 1 --2- 172.21.15.19:0/1140649765 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f89fc103b30 0x7f89fc199210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:23:40.700 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:23:40.689+0000 7f8a0088a640 1 -- 172.21.15.19:0/1140649765 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f89fc104530 msgr2=0x7f89fc199750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:23:40.700 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:23:40.689+0000 7f8a0088a640 1 --2- 172.21.15.19:0/1140649765 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f89fc104530 0x7f89fc199750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:23:40.700 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:23:40.689+0000 7f8a0088a640 1 -- 172.21.15.19:0/1140649765 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f89fc103b30 msgr2=0x7f89fc199210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:23:40.700 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:23:40.689+0000 7f8a0088a640 1 --2- 172.21.15.19:0/1140649765 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f89fc103b30 0x7f89fc199210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:23:40.700 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:23:40.689+0000 7f8a0088a640 1 -- 172.21.15.19:0/1140649765 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f89fc19f2c0 con 0x7f89fc10d0e0 2024-09-10T22:23:40.700 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:23:40.689+0000 7f8a0088a640 1 --2- 172.21.15.19:0/1140649765 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f89fc10d0e0 0x7f89fc19eaf0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f89f4005cc0 tx=0x7f89f402f380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:23:40.700 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:23:40.689+0000 7f89f97fa640 1 -- 172.21.15.19:0/1140649765 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89f4003bf0 con 0x7f89fc10d0e0 2024-09-10T22:23:40.700 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:23:40.689+0000 7f89f97fa640 1 -- 172.21.15.19:0/1140649765 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f89f4003d90 con 0x7f89fc10d0e0 2024-09-10T22:23:40.701 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:23:40.689+0000 7f8a022ed640 1 -- 172.21.15.19:0/1140649765 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f89fc19f550 con 0x7f89fc10d0e0 2024-09-10T22:23:40.701 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:23:40.689+0000 7f89f97fa640 1 -- 172.21.15.19:0/1140649765 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89f402fbc0 con 0x7f89fc10d0e0 2024-09-10T22:23:40.701 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:23:40.690+0000 7f8a022ed640 1 -- 172.21.15.19:0/1140649765 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f89fc1a5c70 con 0x7f89fc10d0e0 2024-09-10T22:23:40.701 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:23:40.690+0000 7f8a022ed640 1 -- 172.21.15.19:0/1140649765 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f89fc103f10 con 0x7f89fc10d0e0 2024-09-10T22:23:40.701 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:23:40.692+0000 7f89f97fa640 1 -- 172.21.15.19:0/1140649765 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 16) ==== 153250+0+0 (secure 0 0 0) 0x7f89f4004610 con 0x7f89fc10d0e0 2024-09-10T22:23:40.701 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:23:40.693+0000 7f89f97fa640 1 --2- 172.21.15.19:0/1140649765 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f89e40b5360 0x7f89e40b7820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:23:40.701 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:23:40.693+0000 7f89fbfff640 1 --2- 172.21.15.19:0/1140649765 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f89e40b5360 0x7f89e40b7820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:23:40.701 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:23:40.693+0000 7f89f97fa640 1 -- 172.21.15.19:0/1140649765 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(68..68 src has 1..68) ==== 7127+0+0 (secure 0 0 0) 0x7f89f4106c70 con 0x7f89fc10d0e0 2024-09-10T22:23:40.701 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:23:40.693+0000 7f89fbfff640 1 --2- 172.21.15.19:0/1140649765 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f89e40b5360 0x7f89e40b7820 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f89ec0058c0 tx=0x7f89ec00a2d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:23:40.701 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:23:40.696+0000 7f89f97fa640 1 -- 172.21.15.19:0/1140649765 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f89f40cdfd0 con 0x7f89fc10d0e0 2024-09-10T22:23:40.923 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:23:40.922+0000 7f8a022ed640 1 -- 172.21.15.19:0/1140649765 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f89fc19a340 con 0x7f89fc10d0e0 2024-09-10T22:23:40.924 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:23:40.922+0000 7f89f97fa640 1 -- 172.21.15.19:0/1140649765 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 1 v1) ==== 93+0+611 (secure 0 0 0) 0x7f89fc19a340 con 0x7f89fc10d0e0 2024-09-10T22:23:40.924 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-10T22:23:40.924 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":1,"btime":"2024-09-10T22:16:16:754503+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[]} 2024-09-10T22:23:40.924 INFO:teuthology.orchestra.run.smithi019.stderr:dumped fsmap epoch 1 2024-09-10T22:23:40.926 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:23:40.925+0000 7f8a022ed640 1 -- 172.21.15.19:0/1140649765 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f89e40b5360 msgr2=0x7f89e40b7820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:23:40.926 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:23:40.925+0000 7f8a022ed640 1 --2- 172.21.15.19:0/1140649765 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f89e40b5360 0x7f89e40b7820 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f89ec0058c0 tx=0x7f89ec00a2d0 comp rx=0 tx=0).stop 2024-09-10T22:23:40.926 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:23:40.925+0000 7f8a022ed640 1 -- 172.21.15.19:0/1140649765 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f89fc10d0e0 msgr2=0x7f89fc19eaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:23:40.926 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:23:40.925+0000 7f8a022ed640 1 --2- 172.21.15.19:0/1140649765 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f89fc10d0e0 0x7f89fc19eaf0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f89f4005cc0 tx=0x7f89f402f380 comp rx=0 tx=0).stop 2024-09-10T22:23:40.926 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:23:40.925+0000 7f8a022ed640 1 -- 172.21.15.19:0/1140649765 shutdown_connections 2024-09-10T22:23:40.927 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:23:40.925+0000 7f8a022ed640 1 --2- 172.21.15.19:0/1140649765 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f89e40b5360 0x7f89e40b7820 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:23:40.927 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:23:40.925+0000 7f8a022ed640 1 --2- 172.21.15.19:0/1140649765 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f89fc10d0e0 0x7f89fc19eaf0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:23:40.927 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:23:40.925+0000 7f8a022ed640 1 --2- 172.21.15.19:0/1140649765 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f89fc104530 0x7f89fc199750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:23:40.927 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:23:40.925+0000 7f8a022ed640 1 --2- 172.21.15.19:0/1140649765 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f89fc103b30 0x7f89fc199210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:23:40.927 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:23:40.925+0000 7f8a022ed640 1 -- 172.21.15.19:0/1140649765 >> 172.21.15.19:0/1140649765 conn(0x7f89fc0fd700 msgr2=0x7f89fc0fe300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:23:40.927 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:23:40.925+0000 7f8a022ed640 1 -- 172.21.15.19:0/1140649765 shutdown_connections 2024-09-10T22:23:40.927 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:23:40.925+0000 7f8a022ed640 1 -- 172.21.15.19:0/1140649765 wait complete. 2024-09-10T22:23:41.042 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:23:40 smithi138 ceph-mon[35236]: Deploying daemon mds.l on smithi138 2024-09-10T22:23:41.042 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:23:40 smithi138 ceph-mon[35236]: from='client.? 172.21.15.19:0/1140649765' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T22:23:41.208 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:23:40 smithi019 ceph-mon[31375]: Deploying daemon mds.l on smithi138 2024-09-10T22:23:41.209 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:23:40 smithi019 ceph-mon[31375]: from='client.? 172.21.15.19:0/1140649765' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T22:23:41.359 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:23:40 smithi135 ceph-mon[34789]: Deploying daemon mds.l on smithi138 2024-09-10T22:23:41.360 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:23:40 smithi135 ceph-mon[34789]: from='client.? 172.21.15.19:0/1140649765' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T22:23:42.125 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:23:41 smithi138 ceph-mon[35236]: pgmap v256: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T22:23:42.125 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:23:41 smithi138 ceph-mon[35236]: mds.? [v2:172.21.15.138:6832/2524811494,v1:172.21.15.138:6833/2524811494] up:boot 2024-09-10T22:23:42.125 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:23:41 smithi138 ceph-mon[35236]: fsmap 1 up:standby 2024-09-10T22:23:42.125 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:23:41 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "l"} : dispatch 2024-09-10T22:23:42.359 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:23:41 smithi135 ceph-mon[34789]: pgmap v256: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T22:23:42.360 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:23:41 smithi135 ceph-mon[34789]: mds.? [v2:172.21.15.138:6832/2524811494,v1:172.21.15.138:6833/2524811494] up:boot 2024-09-10T22:23:42.360 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:23:41 smithi135 ceph-mon[34789]: fsmap 1 up:standby 2024-09-10T22:23:42.360 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:23:41 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "l"} : dispatch 2024-09-10T22:23:42.458 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:23:41 smithi019 ceph-mon[31375]: pgmap v256: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T22:23:42.458 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:23:41 smithi019 ceph-mon[31375]: mds.? [v2:172.21.15.138:6832/2524811494,v1:172.21.15.138:6833/2524811494] up:boot 2024-09-10T22:23:42.458 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:23:41 smithi019 ceph-mon[31375]: fsmap 1 up:standby 2024-09-10T22:23:42.458 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:23:41 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "l"} : dispatch 2024-09-10T22:23:43.360 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:23:43 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:23:43.360 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:23:43 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:23:43.360 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:23:43 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:23:43.360 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:23:43 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-10T22:23:43.360 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:23:43 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-10T22:23:43.360 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:23:43 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T22:23:43.360 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:23:43 smithi135 ceph-mon[34789]: Deploying daemon mds.k on smithi135 2024-09-10T22:23:43.375 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:23:43 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:23:43.375 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:23:43 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:23:43.375 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:23:43 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:23:43.375 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:23:43 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-10T22:23:43.375 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:23:43 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-10T22:23:43.375 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:23:43 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T22:23:43.375 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:23:43 smithi138 ceph-mon[35236]: Deploying daemon mds.k on smithi135 2024-09-10T22:23:43.458 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:23:43 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:23:43.458 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:23:43 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:23:43.458 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:23:43 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:23:43.459 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:23:43 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-10T22:23:43.459 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:23:43 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-10T22:23:43.459 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:23:43 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T22:23:43.459 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:23:43 smithi019 ceph-mon[31375]: Deploying daemon mds.k on smithi135 2024-09-10T22:23:43.634 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 22997a4c-6fc2-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-10T22:23:43.904 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/22997a4c-6fc2-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T22:23:44.043 INFO:journalctl@ceph.mds.k.smithi135.stdout:Sep 10 22:23:43 smithi135 systemd[1]: Starting Ceph mds.k for 22997a4c-6fc2-11ef-bcea-c7b262605968... 2024-09-10T22:23:44.280 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:23:44 smithi019 ceph-mon[31375]: pgmap v257: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T22:23:44.359 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:23:44 smithi135 ceph-mon[34789]: pgmap v257: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T22:23:44.360 INFO:journalctl@ceph.mds.k.smithi135.stdout:Sep 10 22:23:44 smithi135 podman[64251]: 2024-09-10 22:23:44.01372715 +0000 UTC m=+0.016137893 image pull 589dd18248e494ba411dc838aa4ae0e5e569213f08fcd7a2cf22cd3ef7e3c480 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e 2024-09-10T22:23:44.360 INFO:journalctl@ceph.mds.k.smithi135.stdout:Sep 10 22:23:44 smithi135 podman[64251]: 2024-09-10 22:23:44.1188072 +0000 UTC m=+0.121217977 container create 3acd4fb17fd4a2d2fddb22ed7ba5a866c4ba3a3650e4d4249eeb67537582b17e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-mds-k, ceph=True, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0) 2024-09-10T22:23:44.371 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:23:44.361+0000 7f944c074640 1 -- 172.21.15.19:0/230378691 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9444101870 msgr2=0x7f9444101c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:23:44.371 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:23:44.361+0000 7f944c074640 1 --2- 172.21.15.19:0/230378691 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9444101870 0x7f9444101c50 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f9440009900 tx=0x7f944002a410 comp rx=0 tx=0).stop 2024-09-10T22:23:44.371 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:23:44.361+0000 7f944c074640 1 -- 172.21.15.19:0/230378691 shutdown_connections 2024-09-10T22:23:44.372 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:23:44.361+0000 7f944c074640 1 --2- 172.21.15.19:0/230378691 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f944410f420 0x7f9444111810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:23:44.372 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:23:44.361+0000 7f944c074640 1 --2- 172.21.15.19:0/230378691 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f9444102190 0x7f944410eee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:23:44.372 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:23:44.361+0000 7f944c074640 1 --2- 172.21.15.19:0/230378691 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9444101870 0x7f9444101c50 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:23:44.372 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:23:44.361+0000 7f944c074640 1 -- 172.21.15.19:0/230378691 >> 172.21.15.19:0/230378691 conn(0x7f94440fd700 msgr2=0x7f94440ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:23:44.372 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:23:44.361+0000 7f944c074640 1 -- 172.21.15.19:0/230378691 shutdown_connections 2024-09-10T22:23:44.372 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:23:44.361+0000 7f944c074640 1 -- 172.21.15.19:0/230378691 wait complete. 2024-09-10T22:23:44.372 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:23:44.362+0000 7f944c074640 1 Processor -- start 2024-09-10T22:23:44.372 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:23:44.362+0000 7f944c074640 1 -- start start 2024-09-10T22:23:44.372 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:23:44.362+0000 7f944c074640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f9444101870 0x7f944419b540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:23:44.372 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:23:44.362+0000 7f944c074640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9444102190 0x7f944419ba80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:23:44.372 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:23:44.362+0000 7f944c074640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f944410f420 0x7f94441a0e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:23:44.373 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:23:44.362+0000 7f944c074640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f9444114ff0 con 0x7f944410f420 2024-09-10T22:23:44.373 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:23:44.362+0000 7f944c074640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f9444114e70 con 0x7f9444102190 2024-09-10T22:23:44.373 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:23:44.362+0000 7f944c074640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f9444115170 con 0x7f9444101870 2024-09-10T22:23:44.373 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:23:44.362+0000 7f944a611640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f944410f420 0x7f94441a0e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:23:44.373 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:23:44.363+0000 7f944a611640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f944410f420 0x7f94441a0e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:55102/0 (socket says 172.21.15.19:55102) 2024-09-10T22:23:44.373 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:23:44.363+0000 7f944a611640 1 -- 172.21.15.19:0/3282889098 learned_addr learned my addr 172.21.15.19:0/3282889098 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:23:44.373 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:23:44.363+0000 7f9449e10640 1 --2- 172.21.15.19:0/3282889098 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f9444101870 0x7f944419b540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:23:44.373 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:23:44.363+0000 7f944960f640 1 --2- 172.21.15.19:0/3282889098 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9444102190 0x7f944419ba80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:23:44.373 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:23:44.363+0000 7f944a611640 1 -- 172.21.15.19:0/3282889098 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f9444101870 msgr2=0x7f944419b540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:23:44.373 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:23:44.363+0000 7f944a611640 1 --2- 172.21.15.19:0/3282889098 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f9444101870 0x7f944419b540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:23:44.373 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:23:44.363+0000 7f944a611640 1 -- 172.21.15.19:0/3282889098 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9444102190 msgr2=0x7f944419ba80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:23:44.374 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:23:44.363+0000 7f944a611640 1 --2- 172.21.15.19:0/3282889098 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9444102190 0x7f944419ba80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:23:44.374 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:23:44.363+0000 7f944a611640 1 -- 172.21.15.19:0/3282889098 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f94441a15f0 con 0x7f944410f420 2024-09-10T22:23:44.374 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:23:44.363+0000 7f944960f640 1 --2- 172.21.15.19:0/3282889098 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9444102190 0x7f944419ba80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T22:23:44.374 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:23:44.363+0000 7f944a611640 1 --2- 172.21.15.19:0/3282889098 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f944410f420 0x7f94441a0e20 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f943c00eb40 tx=0x7f943c00c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:23:44.374 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:23:44.363+0000 7f943affd640 1 -- 172.21.15.19:0/3282889098 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f943c004b20 con 0x7f944410f420 2024-09-10T22:23:44.374 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:23:44.363+0000 7f943affd640 1 -- 172.21.15.19:0/3282889098 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f943c004cc0 con 0x7f944410f420 2024-09-10T22:23:44.374 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:23:44.363+0000 7f943affd640 1 -- 172.21.15.19:0/3282889098 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f943c010720 con 0x7f944410f420 2024-09-10T22:23:44.374 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:23:44.363+0000 7f944c074640 1 -- 172.21.15.19:0/3282889098 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f94441a18e0 con 0x7f944410f420 2024-09-10T22:23:44.374 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:23:44.363+0000 7f944c074640 1 -- 172.21.15.19:0/3282889098 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f94441a8020 con 0x7f944410f420 2024-09-10T22:23:44.374 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:23:44.364+0000 7f944c074640 1 -- 172.21.15.19:0/3282889098 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9444101c50 con 0x7f944410f420 2024-09-10T22:23:44.374 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:23:44.366+0000 7f943affd640 1 -- 172.21.15.19:0/3282889098 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 16) ==== 153250+0+0 (secure 0 0 0) 0x7f943c005560 con 0x7f944410f420 2024-09-10T22:23:44.374 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:23:44.366+0000 7f943affd640 1 --2- 172.21.15.19:0/3282889098 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f94300b5360 0x7f94300b7820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:23:44.374 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:23:44.366+0000 7f9449e10640 1 --2- 172.21.15.19:0/3282889098 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f94300b5360 0x7f94300b7820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:23:44.375 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:23:44.367+0000 7f943affd640 1 -- 172.21.15.19:0/3282889098 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(68..68 src has 1..68) ==== 7127+0+0 (secure 0 0 0) 0x7f943c0e5f80 con 0x7f944410f420 2024-09-10T22:23:44.375 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:23:44.367+0000 7f9449e10640 1 --2- 172.21.15.19:0/3282889098 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f94300b5360 0x7f94300b7820 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f9440031440 tx=0x7f94400095f0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:23:44.375 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:23:44.369+0000 7f943affd640 1 -- 172.21.15.19:0/3282889098 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f943c0ad2e0 con 0x7f944410f420 2024-09-10T22:23:44.375 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:23:44 smithi138 ceph-mon[35236]: pgmap v257: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T22:23:44.609 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:23:44.608+0000 7f944c074640 1 -- 172.21.15.19:0/3282889098 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f944419c670 con 0x7f944410f420 2024-09-10T22:23:44.610 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:23:44.608+0000 7f943affd640 1 -- 172.21.15.19:0/3282889098 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 2 v2) ==== 93+0+1438 (secure 0 0 0) 0x7f944419c670 con 0x7f944410f420 2024-09-10T22:23:44.610 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-10T22:23:44.610 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":2,"btime":"2024-09-10T22:23:41:903432+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24511,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.138:6833/2524811494","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6832","nonce":2524811494},{"type":"v1","addr":"172.21.15.138:6833","nonce":2524811494}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[]} 2024-09-10T22:23:44.610 INFO:teuthology.orchestra.run.smithi019.stderr:dumped fsmap epoch 2 2024-09-10T22:23:44.612 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:23:44.610+0000 7f944c074640 1 -- 172.21.15.19:0/3282889098 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f94300b5360 msgr2=0x7f94300b7820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:23:44.612 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:23:44.610+0000 7f944c074640 1 --2- 172.21.15.19:0/3282889098 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f94300b5360 0x7f94300b7820 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f9440031440 tx=0x7f94400095f0 comp rx=0 tx=0).stop 2024-09-10T22:23:44.612 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:23:44.610+0000 7f944c074640 1 -- 172.21.15.19:0/3282889098 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f944410f420 msgr2=0x7f94441a0e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:23:44.612 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:23:44.610+0000 7f944c074640 1 --2- 172.21.15.19:0/3282889098 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f944410f420 0x7f94441a0e20 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f943c00eb40 tx=0x7f943c00c2d0 comp rx=0 tx=0).stop 2024-09-10T22:23:44.612 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:23:44.610+0000 7f944c074640 1 -- 172.21.15.19:0/3282889098 shutdown_connections 2024-09-10T22:23:44.612 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:23:44.610+0000 7f944c074640 1 --2- 172.21.15.19:0/3282889098 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f94300b5360 0x7f94300b7820 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:23:44.612 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:23:44.610+0000 7f944c074640 1 --2- 172.21.15.19:0/3282889098 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f944410f420 0x7f94441a0e20 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:23:44.612 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:23:44.610+0000 7f944c074640 1 --2- 172.21.15.19:0/3282889098 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9444102190 0x7f944419ba80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:23:44.612 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:23:44.610+0000 7f944c074640 1 --2- 172.21.15.19:0/3282889098 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f9444101870 0x7f944419b540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:23:44.613 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:23:44.610+0000 7f944c074640 1 -- 172.21.15.19:0/3282889098 >> 172.21.15.19:0/3282889098 conn(0x7f94440fd700 msgr2=0x7f94440ffaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:23:44.613 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:23:44.611+0000 7f944c074640 1 -- 172.21.15.19:0/3282889098 shutdown_connections 2024-09-10T22:23:44.613 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:23:44.611+0000 7f944c074640 1 -- 172.21.15.19:0/3282889098 wait complete. 2024-09-10T22:23:44.860 INFO:journalctl@ceph.mds.k.smithi135.stdout:Sep 10 22:23:44 smithi135 podman[64251]: 2024-09-10 22:23:44.40537232 +0000 UTC m=+0.407783051 container init 3acd4fb17fd4a2d2fddb22ed7ba5a866c4ba3a3650e4d4249eeb67537582b17e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-mds-k, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_BRANCH=HEAD, GIT_CLEAN=True, maintainer=Guillaume Abrioux ) 2024-09-10T22:23:44.860 INFO:journalctl@ceph.mds.k.smithi135.stdout:Sep 10 22:23:44 smithi135 podman[64251]: 2024-09-10 22:23:44.408823557 +0000 UTC m=+0.411234289 container start 3acd4fb17fd4a2d2fddb22ed7ba5a866c4ba3a3650e4d4249eeb67537582b17e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-mds-k, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, maintainer=Guillaume Abrioux , ceph=True, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-10T22:23:44.860 INFO:journalctl@ceph.mds.k.smithi135.stdout:Sep 10 22:23:44 smithi135 ceph-mds[64270]: -- 172.21.15.135:0/1177134460 <== mon.2 v2:172.21.15.135:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x559fae8d3860 con 0x559fae8b0800 2024-09-10T22:23:44.860 INFO:journalctl@ceph.mds.k.smithi135.stdout:Sep 10 22:23:44 smithi135 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-mds-k[64266]: starting mds.k at 2024-09-10T22:23:44.860 INFO:journalctl@ceph.mds.k.smithi135.stdout:Sep 10 22:23:44 smithi135 bash[64251]: 3acd4fb17fd4a2d2fddb22ed7ba5a866c4ba3a3650e4d4249eeb67537582b17e 2024-09-10T22:23:44.860 INFO:journalctl@ceph.mds.k.smithi135.stdout:Sep 10 22:23:44 smithi135 systemd[1]: Started Ceph mds.k for 22997a4c-6fc2-11ef-bcea-c7b262605968. 2024-09-10T22:23:45.585 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:23:45 smithi019 ceph-mon[31375]: pgmap v258: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T22:23:45.585 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:23:45 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:23:45.585 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:23:45 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:23:45.586 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:23:45 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:23:45.586 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:23:45 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-10T22:23:45.586 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:23:45 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-10T22:23:45.586 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:23:45 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T22:23:45.586 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:23:45 smithi019 ceph-mon[31375]: Deploying daemon mds.j on smithi019 2024-09-10T22:23:45.586 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:23:45 smithi019 ceph-mon[31375]: from='client.? 172.21.15.19:0/3282889098' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T22:23:45.586 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:23:45 smithi019 ceph-mon[31375]: mds.? [v2:172.21.15.135:6832/3014993624,v1:172.21.15.135:6833/3014993624] up:boot 2024-09-10T22:23:45.586 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:23:45 smithi019 ceph-mon[31375]: fsmap 2 up:standby 2024-09-10T22:23:45.586 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:23:45 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "k"} : dispatch 2024-09-10T22:23:45.795 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:23:45 smithi135 ceph-mon[34789]: pgmap v258: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T22:23:45.795 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:23:45 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:23:45.795 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:23:45 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:23:45.795 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:23:45 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:23:45.795 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:23:45 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-10T22:23:45.795 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:23:45 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-10T22:23:45.795 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:23:45 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T22:23:45.795 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:23:45 smithi135 ceph-mon[34789]: Deploying daemon mds.j on smithi019 2024-09-10T22:23:45.796 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:23:45 smithi135 ceph-mon[34789]: from='client.? 172.21.15.19:0/3282889098' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T22:23:45.796 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:23:45 smithi135 ceph-mon[34789]: mds.? [v2:172.21.15.135:6832/3014993624,v1:172.21.15.135:6833/3014993624] up:boot 2024-09-10T22:23:45.796 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:23:45 smithi135 ceph-mon[34789]: fsmap 2 up:standby 2024-09-10T22:23:45.796 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:23:45 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "k"} : dispatch 2024-09-10T22:23:45.875 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:23:45 smithi138 ceph-mon[35236]: pgmap v258: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T22:23:45.875 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:23:45 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:23:45.875 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:23:45 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:23:45.875 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:23:45 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:23:45.875 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:23:45 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-10T22:23:45.875 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:23:45 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-10T22:23:45.875 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:23:45 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T22:23:45.876 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:23:45 smithi138 ceph-mon[35236]: Deploying daemon mds.j on smithi019 2024-09-10T22:23:45.876 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:23:45 smithi138 ceph-mon[35236]: from='client.? 172.21.15.19:0/3282889098' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T22:23:45.876 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:23:45 smithi138 ceph-mon[35236]: mds.? [v2:172.21.15.135:6832/3014993624,v1:172.21.15.135:6833/3014993624] up:boot 2024-09-10T22:23:45.876 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:23:45 smithi138 ceph-mon[35236]: fsmap 2 up:standby 2024-09-10T22:23:45.876 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:23:45 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "k"} : dispatch 2024-09-10T22:23:47.208 INFO:journalctl@ceph.mds.j.smithi019.stdout:Sep 10 22:23:47 smithi019 systemd[1]: Starting Ceph mds.j for 22997a4c-6fc2-11ef-bcea-c7b262605968... 2024-09-10T22:23:47.356 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 22997a4c-6fc2-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-10T22:23:47.558 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:23:47 smithi019 ceph-mon[31375]: pgmap v259: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T22:23:47.558 INFO:journalctl@ceph.mds.j.smithi019.stdout:Sep 10 22:23:47 smithi019 podman[73142]: 2024-09-10 22:23:47.192907502 +0000 UTC m=+0.016386935 image pull 589dd18248e494ba411dc838aa4ae0e5e569213f08fcd7a2cf22cd3ef7e3c480 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e 2024-09-10T22:23:47.558 INFO:journalctl@ceph.mds.j.smithi019.stdout:Sep 10 22:23:47 smithi019 podman[73142]: 2024-09-10 22:23:47.301118588 +0000 UTC m=+0.124598082 container create 297f16ebdbc69c7a928584b855364d0269365ed719b4902bc9311f14fdf11004 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-mds-j, ceph=True, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS) 2024-09-10T22:23:47.558 INFO:journalctl@ceph.mds.j.smithi019.stdout:Sep 10 22:23:47 smithi019 podman[73142]: 2024-09-10 22:23:47.52931482 +0000 UTC m=+0.352794269 container init 297f16ebdbc69c7a928584b855364d0269365ed719b4902bc9311f14fdf11004 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-mds-j, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, ceph=True, GIT_CLEAN=True, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-10T22:23:47.558 INFO:journalctl@ceph.mds.j.smithi019.stdout:Sep 10 22:23:47 smithi019 podman[73142]: 2024-09-10 22:23:47.532664087 +0000 UTC m=+0.356143525 container start 297f16ebdbc69c7a928584b855364d0269365ed719b4902bc9311f14fdf11004 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-mds-j, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_BRANCH=HEAD) 2024-09-10T22:23:47.558 INFO:journalctl@ceph.mds.j.smithi019.stdout:Sep 10 22:23:47 smithi019 ceph-mds[73179]: -- 172.21.15.19:0/3611599417 <== mon.0 v2:172.21.15.19:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55691b577860 con 0x55691b555000 2024-09-10T22:23:47.710 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/22997a4c-6fc2-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T22:23:47.833 INFO:journalctl@ceph.mds.j.smithi019.stdout:Sep 10 22:23:47 smithi019 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-mds-j[73175]: starting mds.j at 2024-09-10T22:23:47.833 INFO:journalctl@ceph.mds.j.smithi019.stdout:Sep 10 22:23:47 smithi019 bash[73142]: 297f16ebdbc69c7a928584b855364d0269365ed719b4902bc9311f14fdf11004 2024-09-10T22:23:47.833 INFO:journalctl@ceph.mds.j.smithi019.stdout:Sep 10 22:23:47 smithi019 systemd[1]: Started Ceph mds.j for 22997a4c-6fc2-11ef-bcea-c7b262605968. 2024-09-10T22:23:47.859 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:23:47 smithi135 ceph-mon[34789]: pgmap v259: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T22:23:47.875 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:23:47 smithi138 ceph-mon[35236]: pgmap v259: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T22:23:48.191 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:23:48.173+0000 7fb841b4e640 1 -- 172.21.15.19:0/4027119551 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb83c102dc0 msgr2=0x7fb83c1031a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:23:48.191 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:23:48.173+0000 7fb841b4e640 1 --2- 172.21.15.19:0/4027119551 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb83c102dc0 0x7fb83c1031a0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fb82c009ca0 tx=0x7fb82c02a8c0 comp rx=0 tx=0).stop 2024-09-10T22:23:48.192 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:23:48.173+0000 7fb841b4e640 1 -- 172.21.15.19:0/4027119551 shutdown_connections 2024-09-10T22:23:48.192 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:23:48.173+0000 7fb841b4e640 1 --2- 172.21.15.19:0/4027119551 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb83c109150 0x7fb83c10f950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:23:48.192 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:23:48.173+0000 7fb841b4e640 1 --2- 172.21.15.19:0/4027119551 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb83c1087d0 0x7fb83c108c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:23:48.192 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:23:48.173+0000 7fb841b4e640 1 --2- 172.21.15.19:0/4027119551 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb83c102dc0 0x7fb83c1031a0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:23:48.192 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:23:48.173+0000 7fb841b4e640 1 -- 172.21.15.19:0/4027119551 >> 172.21.15.19:0/4027119551 conn(0x7fb83c0fe830 msgr2=0x7fb83c100c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:23:48.192 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:23:48.174+0000 7fb841b4e640 1 -- 172.21.15.19:0/4027119551 shutdown_connections 2024-09-10T22:23:48.192 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:23:48.174+0000 7fb841b4e640 1 -- 172.21.15.19:0/4027119551 wait complete. 2024-09-10T22:23:48.192 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:23:48.174+0000 7fb841b4e640 1 Processor -- start 2024-09-10T22:23:48.192 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:23:48.174+0000 7fb841b4e640 1 -- start start 2024-09-10T22:23:48.192 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:23:48.174+0000 7fb841b4e640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb83c102dc0 0x7fb83c199440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:23:48.192 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:23:48.174+0000 7fb841b4e640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb83c1087d0 0x7fb83c199980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:23:48.192 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:23:48.175+0000 7fb841b4e640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb83c109150 0x7fb83c19ed20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:23:48.193 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:23:48.175+0000 7fb841b4e640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fb83c112e50 con 0x7fb83c109150 2024-09-10T22:23:48.193 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:23:48.175+0000 7fb841b4e640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fb83c112cd0 con 0x7fb83c102dc0 2024-09-10T22:23:48.193 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:23:48.175+0000 7fb841b4e640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7fb83c112fd0 con 0x7fb83c1087d0 2024-09-10T22:23:48.193 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:23:48.175+0000 7fb83bfff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb83c109150 0x7fb83c19ed20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:23:48.193 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:23:48.175+0000 7fb83bfff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb83c109150 0x7fb83c19ed20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:55140/0 (socket says 172.21.15.19:55140) 2024-09-10T22:23:48.193 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:23:48.175+0000 7fb83bfff640 1 -- 172.21.15.19:0/1779944528 learned_addr learned my addr 172.21.15.19:0/1779944528 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:23:48.193 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:23:48.175+0000 7fb83affd640 1 --2- 172.21.15.19:0/1779944528 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb83c1087d0 0x7fb83c199980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:23:48.193 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:23:48.175+0000 7fb83b7fe640 1 --2- 172.21.15.19:0/1779944528 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb83c102dc0 0x7fb83c199440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:23:48.193 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:23:48.175+0000 7fb83bfff640 1 -- 172.21.15.19:0/1779944528 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb83c1087d0 msgr2=0x7fb83c199980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:23:48.193 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:23:48.175+0000 7fb83bfff640 1 --2- 172.21.15.19:0/1779944528 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb83c1087d0 0x7fb83c199980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:23:48.193 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:23:48.175+0000 7fb83bfff640 1 -- 172.21.15.19:0/1779944528 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb83c102dc0 msgr2=0x7fb83c199440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:23:48.193 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:23:48.175+0000 7fb83bfff640 1 --2- 172.21.15.19:0/1779944528 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb83c102dc0 0x7fb83c199440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:23:48.194 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:23:48.175+0000 7fb83bfff640 1 -- 172.21.15.19:0/1779944528 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb83c19f4f0 con 0x7fb83c109150 2024-09-10T22:23:48.194 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:23:48.175+0000 7fb83bfff640 1 --2- 172.21.15.19:0/1779944528 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb83c109150 0x7fb83c19ed20 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fb834009fd0 tx=0x7fb83400b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:23:48.194 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:23:48.175+0000 7fb838ff9640 1 -- 172.21.15.19:0/1779944528 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb834011830 con 0x7fb83c109150 2024-09-10T22:23:48.194 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:23:48.175+0000 7fb838ff9640 1 -- 172.21.15.19:0/1779944528 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb834016070 con 0x7fb83c109150 2024-09-10T22:23:48.194 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:23:48.175+0000 7fb841b4e640 1 -- 172.21.15.19:0/1779944528 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb83c19f7e0 con 0x7fb83c109150 2024-09-10T22:23:48.194 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:23:48.175+0000 7fb838ff9640 1 -- 172.21.15.19:0/1779944528 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb834010de0 con 0x7fb83c109150 2024-09-10T22:23:48.194 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:23:48.175+0000 7fb841b4e640 1 -- 172.21.15.19:0/1779944528 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb83c1a5ea0 con 0x7fb83c109150 2024-09-10T22:23:48.194 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:23:48.176+0000 7fb841b4e640 1 -- 172.21.15.19:0/1779944528 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb83c103220 con 0x7fb83c109150 2024-09-10T22:23:48.194 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:23:48.179+0000 7fb838ff9640 1 -- 172.21.15.19:0/1779944528 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 16) ==== 153250+0+0 (secure 0 0 0) 0x7fb8340119d0 con 0x7fb83c109150 2024-09-10T22:23:48.194 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:23:48.179+0000 7fb838ff9640 1 --2- 172.21.15.19:0/1779944528 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7fb8240b5360 0x7fb8240b7820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:23:48.194 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:23:48.180+0000 7fb83b7fe640 1 --2- 172.21.15.19:0/1779944528 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7fb8240b5360 0x7fb8240b7820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:23:48.194 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:23:48.180+0000 7fb838ff9640 1 -- 172.21.15.19:0/1779944528 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(68..68 src has 1..68) ==== 7127+0+0 (secure 0 0 0) 0x7fb8340e53a0 con 0x7fb83c109150 2024-09-10T22:23:48.194 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:23:48.180+0000 7fb83b7fe640 1 --2- 172.21.15.19:0/1779944528 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7fb8240b5360 0x7fb8240b7820 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fb82c006010 tx=0x7fb82c000f40 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:23:48.195 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:23:48.182+0000 7fb838ff9640 1 -- 172.21.15.19:0/1779944528 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7fb8340ac700 con 0x7fb83c109150 2024-09-10T22:23:48.413 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:23:48.411+0000 7fb841b4e640 1 -- 172.21.15.19:0/1779944528 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fb83c19a570 con 0x7fb83c109150 2024-09-10T22:23:48.413 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:23:48.411+0000 7fb838ff9640 1 -- 172.21.15.19:0/1779944528 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) ==== 93+0+2266 (secure 0 0 0) 0x7fb83c19a570 con 0x7fb83c109150 2024-09-10T22:23:48.413 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-10T22:23:48.414 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":3,"btime":"2024-09-10T22:23:45:042331+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24511,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.138:6833/2524811494","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6832","nonce":2524811494},{"type":"v1","addr":"172.21.15.138:6833","nonce":2524811494}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24512,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6833/3014993624","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6832","nonce":3014993624},{"type":"v1","addr":"172.21.15.135:6833","nonce":3014993624}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[]} 2024-09-10T22:23:48.414 INFO:teuthology.orchestra.run.smithi019.stderr:dumped fsmap epoch 3 2024-09-10T22:23:48.415 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:23:48.413+0000 7fb841b4e640 1 -- 172.21.15.19:0/1779944528 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7fb8240b5360 msgr2=0x7fb8240b7820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:23:48.415 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:23:48.413+0000 7fb841b4e640 1 --2- 172.21.15.19:0/1779944528 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7fb8240b5360 0x7fb8240b7820 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fb82c006010 tx=0x7fb82c000f40 comp rx=0 tx=0).stop 2024-09-10T22:23:48.415 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:23:48.413+0000 7fb841b4e640 1 -- 172.21.15.19:0/1779944528 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb83c109150 msgr2=0x7fb83c19ed20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:23:48.415 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:23:48.413+0000 7fb841b4e640 1 --2- 172.21.15.19:0/1779944528 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb83c109150 0x7fb83c19ed20 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fb834009fd0 tx=0x7fb83400b8e0 comp rx=0 tx=0).stop 2024-09-10T22:23:48.416 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:23:48.413+0000 7fb841b4e640 1 -- 172.21.15.19:0/1779944528 shutdown_connections 2024-09-10T22:23:48.416 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:23:48.413+0000 7fb841b4e640 1 --2- 172.21.15.19:0/1779944528 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7fb8240b5360 0x7fb8240b7820 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:23:48.416 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:23:48.413+0000 7fb841b4e640 1 --2- 172.21.15.19:0/1779944528 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb83c109150 0x7fb83c19ed20 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:23:48.416 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:23:48.413+0000 7fb841b4e640 1 --2- 172.21.15.19:0/1779944528 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb83c1087d0 0x7fb83c199980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:23:48.416 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:23:48.413+0000 7fb841b4e640 1 --2- 172.21.15.19:0/1779944528 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb83c102dc0 0x7fb83c199440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:23:48.416 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:23:48.413+0000 7fb841b4e640 1 -- 172.21.15.19:0/1779944528 >> 172.21.15.19:0/1779944528 conn(0x7fb83c0fe830 msgr2=0x7fb83c100c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:23:48.416 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:23:48.414+0000 7fb841b4e640 1 -- 172.21.15.19:0/1779944528 shutdown_connections 2024-09-10T22:23:48.416 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:23:48.414+0000 7fb841b4e640 1 -- 172.21.15.19:0/1779944528 wait complete. 2024-09-10T22:23:48.958 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:23:48 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:23:48.958 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:23:48 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:23:48.958 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:23:48 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:23:48.959 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:23:48 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-10T22:23:48.959 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:23:48 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-10T22:23:48.959 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:23:48 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T22:23:48.959 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:23:48 smithi019 ceph-mon[31375]: Deploying daemon mds.d on smithi019 2024-09-10T22:23:48.959 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:23:48 smithi019 ceph-mon[31375]: from='client.? 172.21.15.19:0/1779944528' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T22:23:48.959 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:23:48 smithi019 ceph-mon[31375]: mds.? [v2:172.21.15.19:6834/1835804747,v1:172.21.15.19:6835/1835804747] up:boot 2024-09-10T22:23:48.959 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:23:48 smithi019 ceph-mon[31375]: fsmap 3 up:standby 2024-09-10T22:23:48.959 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:23:48 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "j"} : dispatch 2024-09-10T22:23:49.113 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:23:48 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:23:49.113 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:23:48 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:23:49.113 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:23:48 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:23:49.113 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:23:48 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-10T22:23:49.113 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:23:48 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-10T22:23:49.113 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:23:48 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T22:23:49.114 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:23:48 smithi135 ceph-mon[34789]: Deploying daemon mds.d on smithi019 2024-09-10T22:23:49.114 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:23:48 smithi135 ceph-mon[34789]: from='client.? 172.21.15.19:0/1779944528' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T22:23:49.114 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:23:48 smithi135 ceph-mon[34789]: mds.? [v2:172.21.15.19:6834/1835804747,v1:172.21.15.19:6835/1835804747] up:boot 2024-09-10T22:23:49.114 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:23:48 smithi135 ceph-mon[34789]: fsmap 3 up:standby 2024-09-10T22:23:49.114 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:23:48 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "j"} : dispatch 2024-09-10T22:23:49.125 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:23:48 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:23:49.125 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:23:48 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:23:49.125 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:23:48 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:23:49.125 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:23:48 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-10T22:23:49.125 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:23:48 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-10T22:23:49.126 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:23:48 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T22:23:49.126 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:23:48 smithi138 ceph-mon[35236]: Deploying daemon mds.d on smithi019 2024-09-10T22:23:49.126 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:23:48 smithi138 ceph-mon[35236]: from='client.? 172.21.15.19:0/1779944528' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T22:23:49.126 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:23:48 smithi138 ceph-mon[35236]: mds.? [v2:172.21.15.19:6834/1835804747,v1:172.21.15.19:6835/1835804747] up:boot 2024-09-10T22:23:49.126 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:23:48 smithi138 ceph-mon[35236]: fsmap 3 up:standby 2024-09-10T22:23:49.126 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:23:48 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "j"} : dispatch 2024-09-10T22:23:49.958 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:23:49 smithi019 ceph-mon[31375]: pgmap v260: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T22:23:50.011 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:23:49 smithi135 ceph-mon[34789]: pgmap v260: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T22:23:50.125 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:23:49 smithi138 ceph-mon[35236]: pgmap v260: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T22:23:50.654 INFO:journalctl@ceph.mds.d.smithi019.stdout:Sep 10 22:23:50 smithi019 systemd[1]: Starting Ceph mds.d for 22997a4c-6fc2-11ef-bcea-c7b262605968... 2024-09-10T22:23:50.931 INFO:journalctl@ceph.mds.d.smithi019.stdout:Sep 10 22:23:50 smithi019 podman[73559]: 2024-09-10 22:23:50.653313184 +0000 UTC m=+0.102538876 container create 9c8759d92dcf04bc47d495f4980bc609dc584f7d9c3046971f57961ac6347ce3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-mds-d, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-10T22:23:50.931 INFO:journalctl@ceph.mds.d.smithi019.stdout:Sep 10 22:23:50 smithi019 podman[73559]: 2024-09-10 22:23:50.567279721 +0000 UTC m=+0.016505428 image pull 589dd18248e494ba411dc838aa4ae0e5e569213f08fcd7a2cf22cd3ef7e3c480 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e 2024-09-10T22:23:50.932 INFO:journalctl@ceph.mds.d.smithi019.stdout:Sep 10 22:23:50 smithi019 podman[73559]: 2024-09-10 22:23:50.839091862 +0000 UTC m=+0.288317557 container init 9c8759d92dcf04bc47d495f4980bc609dc584f7d9c3046971f57961ac6347ce3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-mds-d, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS) 2024-09-10T22:23:50.932 INFO:journalctl@ceph.mds.d.smithi019.stdout:Sep 10 22:23:50 smithi019 podman[73559]: 2024-09-10 22:23:50.842267143 +0000 UTC m=+0.291492836 container start 9c8759d92dcf04bc47d495f4980bc609dc584f7d9c3046971f57961ac6347ce3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-mds-d, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, ceph=True, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2) 2024-09-10T22:23:50.932 INFO:journalctl@ceph.mds.d.smithi019.stdout:Sep 10 22:23:50 smithi019 ceph-mds[73578]: -- 172.21.15.19:0/351980863 <== mon.0 v2:172.21.15.19:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55fc2723fc20 con 0x55fc2721c800 2024-09-10T22:23:50.932 INFO:journalctl@ceph.mds.d.smithi019.stdout:Sep 10 22:23:50 smithi019 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-mds-d[73574]: starting mds.d at 2024-09-10T22:23:50.932 INFO:journalctl@ceph.mds.d.smithi019.stdout:Sep 10 22:23:50 smithi019 bash[73559]: 9c8759d92dcf04bc47d495f4980bc609dc584f7d9c3046971f57961ac6347ce3 2024-09-10T22:23:51.208 INFO:journalctl@ceph.mds.d.smithi019.stdout:Sep 10 22:23:50 smithi019 systemd[1]: Started Ceph mds.d for 22997a4c-6fc2-11ef-bcea-c7b262605968. 2024-09-10T22:23:51.567 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 22997a4c-6fc2-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-10T22:23:51.839 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/22997a4c-6fc2-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T22:23:52.260 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:23:51 smithi019 ceph-mon[31375]: pgmap v261: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T22:23:52.260 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:23:51 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:23:52.260 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:23:51 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:23:52.261 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:23:51 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:23:52.261 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:23:51 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-10T22:23:52.261 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:23:51 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-10T22:23:52.261 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:23:51 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T22:23:52.261 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:23:51 smithi019 ceph-mon[31375]: Deploying daemon mds.e on smithi135 2024-09-10T22:23:52.261 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:23:51 smithi019 ceph-mon[31375]: mds.? [v2:172.21.15.19:6836/1750470490,v1:172.21.15.19:6837/1750470490] up:boot 2024-09-10T22:23:52.261 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:23:51 smithi019 ceph-mon[31375]: fsmap 4 up:standby 2024-09-10T22:23:52.261 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:23:51 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "d"} : dispatch 2024-09-10T22:23:52.304 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:23:52.258+0000 7f4754a09640 1 -- 172.21.15.19:0/3695721619 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4750102dc0 msgr2=0x7f47501031a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:23:52.304 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:23:52.258+0000 7f4754a09640 1 --2- 172.21.15.19:0/3695721619 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4750102dc0 0x7f47501031a0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f4740009900 tx=0x7f474002a410 comp rx=0 tx=0).stop 2024-09-10T22:23:52.305 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:23:52.258+0000 7f4754a09640 1 -- 172.21.15.19:0/3695721619 shutdown_connections 2024-09-10T22:23:52.305 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:23:52.258+0000 7f4754a09640 1 --2- 172.21.15.19:0/3695721619 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4750109150 0x7f475010f950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:23:52.305 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:23:52.258+0000 7f4754a09640 1 --2- 172.21.15.19:0/3695721619 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f47501087d0 0x7f4750108c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:23:52.305 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:23:52.258+0000 7f4754a09640 1 --2- 172.21.15.19:0/3695721619 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4750102dc0 0x7f47501031a0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:23:52.305 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:23:52.258+0000 7f4754a09640 1 -- 172.21.15.19:0/3695721619 >> 172.21.15.19:0/3695721619 conn(0x7f47500fe830 msgr2=0x7f4750100c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:23:52.305 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:23:52.258+0000 7f4754a09640 1 -- 172.21.15.19:0/3695721619 shutdown_connections 2024-09-10T22:23:52.305 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:23:52.258+0000 7f4754a09640 1 -- 172.21.15.19:0/3695721619 wait complete. 2024-09-10T22:23:52.305 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:23:52.259+0000 7f4754a09640 1 Processor -- start 2024-09-10T22:23:52.305 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:23:52.259+0000 7f4754a09640 1 -- start start 2024-09-10T22:23:52.305 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:23:52.259+0000 7f4754a09640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4750102dc0 0x7f47500754a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:23:52.305 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:23:52.259+0000 7f4754a09640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f47501087d0 0x7f47500759e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:23:52.305 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:23:52.259+0000 7f4754a09640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f4750109150 0x7f4750075f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:23:52.306 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:23:52.259+0000 7f4754a09640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f4750112e10 con 0x7f4750102dc0 2024-09-10T22:23:52.306 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:23:52.259+0000 7f4754a09640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f4750112c90 con 0x7f47501087d0 2024-09-10T22:23:52.306 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:23:52.259+0000 7f4754a09640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f4750112f90 con 0x7f4750109150 2024-09-10T22:23:52.306 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:23:52.259+0000 7f474e59c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4750102dc0 0x7f47500754a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:23:52.306 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:23:52.259+0000 7f474e59c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4750102dc0 0x7f47500754a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:55176/0 (socket says 172.21.15.19:55176) 2024-09-10T22:23:52.306 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:23:52.259+0000 7f474e59c640 1 -- 172.21.15.19:0/1241158957 learned_addr learned my addr 172.21.15.19:0/1241158957 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:23:52.306 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:23:52.259+0000 7f474dd9b640 1 --2- 172.21.15.19:0/1241158957 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f47501087d0 0x7f47500759e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:23:52.306 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:23:52.260+0000 7f474ed9d640 1 --2- 172.21.15.19:0/1241158957 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f4750109150 0x7f4750075f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:23:52.306 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:23:52.260+0000 7f474e59c640 1 -- 172.21.15.19:0/1241158957 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f4750109150 msgr2=0x7f4750075f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:23:52.306 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:23:52.260+0000 7f474e59c640 1 --2- 172.21.15.19:0/1241158957 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f4750109150 0x7f4750075f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:23:52.306 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:23:52.260+0000 7f474e59c640 1 -- 172.21.15.19:0/1241158957 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f47501087d0 msgr2=0x7f47500759e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:23:52.306 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:23:52.260+0000 7f474e59c640 1 --2- 172.21.15.19:0/1241158957 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f47501087d0 0x7f47500759e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:23:52.307 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:23:52.260+0000 7f474e59c640 1 -- 172.21.15.19:0/1241158957 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f47501a76c0 con 0x7f4750102dc0 2024-09-10T22:23:52.307 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:23:52.260+0000 7f474e59c640 1 --2- 172.21.15.19:0/1241158957 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4750102dc0 0x7f47500754a0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f4740006010 tx=0x7f47400042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:23:52.307 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:23:52.260+0000 7f473f7fe640 1 -- 172.21.15.19:0/1241158957 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f474003f030 con 0x7f4750102dc0 2024-09-10T22:23:52.307 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:23:52.260+0000 7f473f7fe640 1 -- 172.21.15.19:0/1241158957 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4740003800 con 0x7f4750102dc0 2024-09-10T22:23:52.307 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:23:52.260+0000 7f4754a09640 1 -- 172.21.15.19:0/1241158957 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f47501a7950 con 0x7f4750102dc0 2024-09-10T22:23:52.307 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:23:52.260+0000 7f473f7fe640 1 -- 172.21.15.19:0/1241158957 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4740035070 con 0x7f4750102dc0 2024-09-10T22:23:52.307 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:23:52.260+0000 7f4754a09640 1 -- 172.21.15.19:0/1241158957 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f47501a7eb0 con 0x7f4750102dc0 2024-09-10T22:23:52.307 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:23:52.261+0000 7f4754a09640 1 -- 172.21.15.19:0/1241158957 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f47501031a0 con 0x7f4750102dc0 2024-09-10T22:23:52.307 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:23:52.263+0000 7f473f7fe640 1 -- 172.21.15.19:0/1241158957 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 16) ==== 153250+0+0 (secure 0 0 0) 0x7f4740031b10 con 0x7f4750102dc0 2024-09-10T22:23:52.307 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:23:52.264+0000 7f473f7fe640 1 --2- 172.21.15.19:0/1241158957 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f47380b52e0 0x7f47380b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:23:52.307 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:23:52.264+0000 7f474dd9b640 1 --2- 172.21.15.19:0/1241158957 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f47380b52e0 0x7f47380b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:23:52.307 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:23:52.264+0000 7f473f7fe640 1 -- 172.21.15.19:0/1241158957 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(68..68 src has 1..68) ==== 7127+0+0 (secure 0 0 0) 0x7f4740106340 con 0x7f4750102dc0 2024-09-10T22:23:52.307 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:23:52.264+0000 7f474dd9b640 1 --2- 172.21.15.19:0/1241158957 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f47380b52e0 0x7f47380b77a0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f4750076f90 tx=0x7f474400a2d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:23:52.308 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:23:52.267+0000 7f473f7fe640 1 -- 172.21.15.19:0/1241158957 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f47400cd600 con 0x7f4750102dc0 2024-09-10T22:23:52.348 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:23:51 smithi135 ceph-mon[34789]: pgmap v261: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T22:23:52.348 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:23:51 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:23:52.348 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:23:51 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:23:52.348 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:23:51 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:23:52.348 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:23:51 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-10T22:23:52.348 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:23:51 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-10T22:23:52.348 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:23:51 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T22:23:52.349 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:23:51 smithi135 ceph-mon[34789]: Deploying daemon mds.e on smithi135 2024-09-10T22:23:52.349 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:23:51 smithi135 ceph-mon[34789]: mds.? [v2:172.21.15.19:6836/1750470490,v1:172.21.15.19:6837/1750470490] up:boot 2024-09-10T22:23:52.349 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:23:51 smithi135 ceph-mon[34789]: fsmap 4 up:standby 2024-09-10T22:23:52.349 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:23:51 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "d"} : dispatch 2024-09-10T22:23:52.375 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:23:51 smithi138 ceph-mon[35236]: pgmap v261: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T22:23:52.375 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:23:51 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:23:52.375 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:23:51 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:23:52.375 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:23:51 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:23:52.375 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:23:51 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-10T22:23:52.375 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:23:51 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-10T22:23:52.375 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:23:51 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T22:23:52.375 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:23:51 smithi138 ceph-mon[35236]: Deploying daemon mds.e on smithi135 2024-09-10T22:23:52.375 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:23:51 smithi138 ceph-mon[35236]: mds.? [v2:172.21.15.19:6836/1750470490,v1:172.21.15.19:6837/1750470490] up:boot 2024-09-10T22:23:52.376 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:23:51 smithi138 ceph-mon[35236]: fsmap 4 up:standby 2024-09-10T22:23:52.376 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:23:51 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "d"} : dispatch 2024-09-10T22:23:52.491 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:23:52.490+0000 7f4754a09640 1 -- 172.21.15.19:0/1241158957 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f475002e5c0 con 0x7f4750102dc0 2024-09-10T22:23:52.491 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:23:52.490+0000 7f473f7fe640 1 -- 172.21.15.19:0/1241158957 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 5 v5) ==== 93+0+3916 (secure 0 0 0) 0x7f47400ccf00 con 0x7f4750102dc0 2024-09-10T22:23:52.492 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-10T22:23:52.492 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":5,"btime":"2024-09-10T22:23:51:715744+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14673,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6835/1835804747","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6834","nonce":1835804747},{"type":"v1","addr":"172.21.15.19:6835","nonce":1835804747}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14685,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6837/1750470490","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6836","nonce":1750470490},{"type":"v1","addr":"172.21.15.19:6837","nonce":1750470490}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24511,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.138:6833/2524811494","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6832","nonce":2524811494},{"type":"v1","addr":"172.21.15.138:6833","nonce":2524811494}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24512,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6833/3014993624","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6832","nonce":3014993624},{"type":"v1","addr":"172.21.15.135:6833","nonce":3014993624}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[]} 2024-09-10T22:23:52.492 INFO:teuthology.orchestra.run.smithi019.stderr:dumped fsmap epoch 5 2024-09-10T22:23:52.494 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:23:52.492+0000 7f4754a09640 1 -- 172.21.15.19:0/1241158957 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f47380b52e0 msgr2=0x7f47380b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:23:52.494 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:23:52.492+0000 7f4754a09640 1 --2- 172.21.15.19:0/1241158957 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f47380b52e0 0x7f47380b77a0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f4750076f90 tx=0x7f474400a2d0 comp rx=0 tx=0).stop 2024-09-10T22:23:52.494 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:23:52.492+0000 7f4754a09640 1 -- 172.21.15.19:0/1241158957 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4750102dc0 msgr2=0x7f47500754a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:23:52.494 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:23:52.492+0000 7f4754a09640 1 --2- 172.21.15.19:0/1241158957 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4750102dc0 0x7f47500754a0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f4740006010 tx=0x7f47400042f0 comp rx=0 tx=0).stop 2024-09-10T22:23:52.494 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:23:52.492+0000 7f4754a09640 1 -- 172.21.15.19:0/1241158957 shutdown_connections 2024-09-10T22:23:52.494 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:23:52.492+0000 7f4754a09640 1 --2- 172.21.15.19:0/1241158957 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f47380b52e0 0x7f47380b77a0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:23:52.494 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:23:52.492+0000 7f4754a09640 1 --2- 172.21.15.19:0/1241158957 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f4750109150 0x7f4750075f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:23:52.494 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:23:52.492+0000 7f4754a09640 1 --2- 172.21.15.19:0/1241158957 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f47501087d0 0x7f47500759e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:23:52.494 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:23:52.492+0000 7f4754a09640 1 --2- 172.21.15.19:0/1241158957 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4750102dc0 0x7f47500754a0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:23:52.494 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:23:52.492+0000 7f4754a09640 1 -- 172.21.15.19:0/1241158957 >> 172.21.15.19:0/1241158957 conn(0x7f47500fe830 msgr2=0x7f4750100c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:23:52.495 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:23:52.493+0000 7f4754a09640 1 -- 172.21.15.19:0/1241158957 shutdown_connections 2024-09-10T22:23:52.495 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:23:52.493+0000 7f4754a09640 1 -- 172.21.15.19:0/1241158957 wait complete. 2024-09-10T22:23:52.990 INFO:journalctl@ceph.mds.e.smithi135.stdout:Sep 10 22:23:52 smithi135 systemd[1]: Starting Ceph mds.e for 22997a4c-6fc2-11ef-bcea-c7b262605968... 2024-09-10T22:23:53.262 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:23:52 smithi135 ceph-mon[34789]: from='client.? 172.21.15.19:0/1241158957' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T22:23:53.262 INFO:journalctl@ceph.mds.e.smithi135.stdout:Sep 10 22:23:53 smithi135 podman[64565]: 2024-09-10 22:23:52.939316817 +0000 UTC m=+0.015585120 image pull 589dd18248e494ba411dc838aa4ae0e5e569213f08fcd7a2cf22cd3ef7e3c480 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e 2024-09-10T22:23:53.262 INFO:journalctl@ceph.mds.e.smithi135.stdout:Sep 10 22:23:53 smithi135 podman[64565]: 2024-09-10 22:23:53.050406809 +0000 UTC m=+0.126675101 container create 2fa618a33836e72a3c849e36dd849a14ca74d5ca573b90288f95cdcf4bf09251 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-mds-e, GIT_CLEAN=True, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, ceph=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731) 2024-09-10T22:23:53.262 INFO:journalctl@ceph.mds.e.smithi135.stdout:Sep 10 22:23:53 smithi135 podman[64565]: 2024-09-10 22:23:53.261560122 +0000 UTC m=+0.337828415 container init 2fa618a33836e72a3c849e36dd849a14ca74d5ca573b90288f95cdcf4bf09251 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-mds-e, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, maintainer=Guillaume Abrioux ) 2024-09-10T22:23:53.375 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:23:52 smithi138 ceph-mon[35236]: from='client.? 172.21.15.19:0/1241158957' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T22:23:53.458 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:23:52 smithi019 ceph-mon[31375]: from='client.? 172.21.15.19:0/1241158957' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T22:23:53.611 INFO:journalctl@ceph.mds.e.smithi135.stdout:Sep 10 22:23:53 smithi135 podman[64565]: 2024-09-10 22:23:53.264614202 +0000 UTC m=+0.340882503 container start 2fa618a33836e72a3c849e36dd849a14ca74d5ca573b90288f95cdcf4bf09251 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-mds-e, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, io.buildah.version=1.37.2) 2024-09-10T22:23:53.611 INFO:journalctl@ceph.mds.e.smithi135.stdout:Sep 10 22:23:53 smithi135 ceph-mds[64584]: -- 172.21.15.135:0/669452876 <== mon.2 v2:172.21.15.135:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5581e7987860 con 0x5581e7965400 2024-09-10T22:23:53.611 INFO:journalctl@ceph.mds.e.smithi135.stdout:Sep 10 22:23:53 smithi135 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-mds-e[64580]: starting mds.e at 2024-09-10T22:23:53.611 INFO:journalctl@ceph.mds.e.smithi135.stdout:Sep 10 22:23:53 smithi135 bash[64565]: 2fa618a33836e72a3c849e36dd849a14ca74d5ca573b90288f95cdcf4bf09251 2024-09-10T22:23:53.612 INFO:journalctl@ceph.mds.e.smithi135.stdout:Sep 10 22:23:53 smithi135 systemd[1]: Started Ceph mds.e for 22997a4c-6fc2-11ef-bcea-c7b262605968. 2024-09-10T22:23:54.109 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:23:53 smithi138 ceph-mon[35236]: pgmap v262: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T22:23:54.109 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:23:53 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:23:54.109 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:23:53 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:23:54.109 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:23:53 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:23:54.110 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:23:53 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-10T22:23:54.110 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:23:53 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-10T22:23:54.110 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:23:53 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T22:23:54.360 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:23:53 smithi135 ceph-mon[34789]: pgmap v262: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T22:23:54.360 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:23:53 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:23:54.360 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:23:53 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:23:54.360 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:23:53 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:23:54.360 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:23:53 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-10T22:23:54.360 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:23:53 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-10T22:23:54.360 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:23:53 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T22:23:54.458 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:23:53 smithi019 ceph-mon[31375]: pgmap v262: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T22:23:54.458 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:23:53 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:23:54.459 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:23:53 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:23:54.459 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:23:53 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:23:54.459 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:23:53 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-10T22:23:54.459 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:23:53 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-10T22:23:54.459 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:23:53 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T22:23:55.171 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:23:55 smithi138 ceph-mon[35236]: Deploying daemon mds.f on smithi138 2024-09-10T22:23:55.171 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:23:55 smithi138 ceph-mon[35236]: mds.? [v2:172.21.15.135:6834/3715773348,v1:172.21.15.135:6835/3715773348] up:boot 2024-09-10T22:23:55.171 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:23:55 smithi138 ceph-mon[35236]: fsmap 5 up:standby 2024-09-10T22:23:55.171 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:23:55 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "e"} : dispatch 2024-09-10T22:23:55.187 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 22997a4c-6fc2-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-10T22:23:55.360 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:23:55 smithi135 ceph-mon[34789]: Deploying daemon mds.f on smithi138 2024-09-10T22:23:55.360 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:23:55 smithi135 ceph-mon[34789]: mds.? [v2:172.21.15.135:6834/3715773348,v1:172.21.15.135:6835/3715773348] up:boot 2024-09-10T22:23:55.360 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:23:55 smithi135 ceph-mon[34789]: fsmap 5 up:standby 2024-09-10T22:23:55.360 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:23:55 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "e"} : dispatch 2024-09-10T22:23:55.458 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:23:55 smithi019 ceph-mon[31375]: Deploying daemon mds.f on smithi138 2024-09-10T22:23:55.458 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:23:55 smithi019 ceph-mon[31375]: mds.? [v2:172.21.15.135:6834/3715773348,v1:172.21.15.135:6835/3715773348] up:boot 2024-09-10T22:23:55.458 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:23:55 smithi019 ceph-mon[31375]: fsmap 5 up:standby 2024-09-10T22:23:55.458 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:23:55 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "e"} : dispatch 2024-09-10T22:23:55.460 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/22997a4c-6fc2-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T22:23:55.564 INFO:journalctl@ceph.mds.f.smithi138.stdout:Sep 10 22:23:55 smithi138 systemd[1]: Starting Ceph mds.f for 22997a4c-6fc2-11ef-bcea-c7b262605968... 2024-09-10T22:23:55.860 INFO:journalctl@ceph.mds.f.smithi138.stdout:Sep 10 22:23:55 smithi138 podman[65847]: 2024-09-10 22:23:55.466010694 +0000 UTC m=+0.015670562 image pull 589dd18248e494ba411dc838aa4ae0e5e569213f08fcd7a2cf22cd3ef7e3c480 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e 2024-09-10T22:23:55.860 INFO:journalctl@ceph.mds.f.smithi138.stdout:Sep 10 22:23:55 smithi138 podman[65847]: 2024-09-10 22:23:55.564559948 +0000 UTC m=+0.114219815 container create e5b74373683a3c9ada1d04982e032c1c57024e5bd13be727a5676ea26ee29fe6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-mds-f, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_CLEAN=True, ceph=True, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=) 2024-09-10T22:23:55.860 INFO:journalctl@ceph.mds.f.smithi138.stdout:Sep 10 22:23:55 smithi138 podman[65847]: 2024-09-10 22:23:55.758792378 +0000 UTC m=+0.308452244 container init e5b74373683a3c9ada1d04982e032c1c57024e5bd13be727a5676ea26ee29fe6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-mds-f, GIT_BRANCH=HEAD, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True) 2024-09-10T22:23:55.860 INFO:journalctl@ceph.mds.f.smithi138.stdout:Sep 10 22:23:55 smithi138 podman[65847]: 2024-09-10 22:23:55.761493969 +0000 UTC m=+0.311153839 container start e5b74373683a3c9ada1d04982e032c1c57024e5bd13be727a5676ea26ee29fe6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-mds-f, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, ceph=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=) 2024-09-10T22:23:55.860 INFO:journalctl@ceph.mds.f.smithi138.stdout:Sep 10 22:23:55 smithi138 ceph-mds[65866]: -- 172.21.15.138:0/1167716017 <== mon.1 v2:172.21.15.138:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55bf14023860 con 0x55bf14001000 2024-09-10T22:23:55.860 INFO:journalctl@ceph.mds.f.smithi138.stdout:Sep 10 22:23:55 smithi138 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-mds-f[65862]: starting mds.f at 2024-09-10T22:23:55.860 INFO:journalctl@ceph.mds.f.smithi138.stdout:Sep 10 22:23:55 smithi138 bash[65847]: e5b74373683a3c9ada1d04982e032c1c57024e5bd13be727a5676ea26ee29fe6 2024-09-10T22:23:55.953 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:23:55.951+0000 7fdb55566640 1 -- 172.21.15.19:0/2544556971 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fdb5010d100 msgr2=0x7fdb5010f560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:23:55.954 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:23:55.951+0000 7fdb55566640 1 --2- 172.21.15.19:0/2544556971 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fdb5010d100 0x7fdb5010f560 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fdb48009900 tx=0x7fdb4802a410 comp rx=0 tx=0).stop 2024-09-10T22:23:55.954 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:23:55.951+0000 7fdb55566640 1 -- 172.21.15.19:0/2544556971 shutdown_connections 2024-09-10T22:23:55.954 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:23:55.951+0000 7fdb55566640 1 --2- 172.21.15.19:0/2544556971 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fdb5010d100 0x7fdb5010f560 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:23:55.954 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:23:55.951+0000 7fdb55566640 1 --2- 172.21.15.19:0/2544556971 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdb501045c0 0x7fdb5010cab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:23:55.954 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:23:55.951+0000 7fdb55566640 1 --2- 172.21.15.19:0/2544556971 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdb50103ca0 0x7fdb50104080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:23:55.954 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:23:55.951+0000 7fdb55566640 1 -- 172.21.15.19:0/2544556971 >> 172.21.15.19:0/2544556971 conn(0x7fdb500fd700 msgr2=0x7fdb500ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:23:55.954 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:23:55.951+0000 7fdb55566640 1 -- 172.21.15.19:0/2544556971 shutdown_connections 2024-09-10T22:23:55.954 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:23:55.951+0000 7fdb55566640 1 -- 172.21.15.19:0/2544556971 wait complete. 2024-09-10T22:23:55.954 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:23:55.952+0000 7fdb55566640 1 Processor -- start 2024-09-10T22:23:55.954 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:23:55.952+0000 7fdb55566640 1 -- start start 2024-09-10T22:23:55.954 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:23:55.952+0000 7fdb55566640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdb50103ca0 0x7fdb50199260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:23:55.955 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:23:55.952+0000 7fdb55566640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdb501045c0 0x7fdb501997a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:23:55.956 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:23:55.952+0000 7fdb55566640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fdb5010d100 0x7fdb5019eb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:23:55.956 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:23:55.953+0000 7fdb55566640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fdb50112d70 con 0x7fdb501045c0 2024-09-10T22:23:55.956 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:23:55.953+0000 7fdb55566640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fdb50112bf0 con 0x7fdb50103ca0 2024-09-10T22:23:55.956 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:23:55.953+0000 7fdb55566640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7fdb50112ef0 con 0x7fdb5010d100 2024-09-10T22:23:55.956 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:23:55.953+0000 7fdb4e7fc640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdb501045c0 0x7fdb501997a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:23:55.956 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:23:55.953+0000 7fdb4e7fc640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdb501045c0 0x7fdb501997a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:50022/0 (socket says 172.21.15.19:50022) 2024-09-10T22:23:55.956 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:23:55.953+0000 7fdb4e7fc640 1 -- 172.21.15.19:0/2920619849 learned_addr learned my addr 172.21.15.19:0/2920619849 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:23:55.957 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:23:55.953+0000 7fdb4f7fe640 1 --2- 172.21.15.19:0/2920619849 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fdb5010d100 0x7fdb5019eb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:23:55.957 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:23:55.953+0000 7fdb4effd640 1 --2- 172.21.15.19:0/2920619849 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdb50103ca0 0x7fdb50199260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:23:55.957 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:23:55.953+0000 7fdb4e7fc640 1 -- 172.21.15.19:0/2920619849 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fdb5010d100 msgr2=0x7fdb5019eb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:23:55.957 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:23:55.953+0000 7fdb4e7fc640 1 --2- 172.21.15.19:0/2920619849 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fdb5010d100 0x7fdb5019eb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:23:55.957 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:23:55.953+0000 7fdb4e7fc640 1 -- 172.21.15.19:0/2920619849 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdb50103ca0 msgr2=0x7fdb50199260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:23:55.957 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:23:55.953+0000 7fdb4e7fc640 1 --2- 172.21.15.19:0/2920619849 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdb50103ca0 0x7fdb50199260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:23:55.957 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:23:55.953+0000 7fdb4e7fc640 1 -- 172.21.15.19:0/2920619849 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdb5019f310 con 0x7fdb501045c0 2024-09-10T22:23:55.957 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:23:55.953+0000 7fdb4e7fc640 1 --2- 172.21.15.19:0/2920619849 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdb501045c0 0x7fdb501997a0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fdb3800e9c0 tx=0x7fdb3800ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:23:55.957 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:23:55.953+0000 7fdb47fff640 1 -- 172.21.15.19:0/2920619849 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb3800ccc0 con 0x7fdb501045c0 2024-09-10T22:23:55.957 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:23:55.953+0000 7fdb55566640 1 -- 172.21.15.19:0/2920619849 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdb5019f600 con 0x7fdb501045c0 2024-09-10T22:23:55.957 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:23:55.953+0000 7fdb47fff640 1 -- 172.21.15.19:0/2920619849 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fdb380035f0 con 0x7fdb501045c0 2024-09-10T22:23:55.957 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:23:55.953+0000 7fdb47fff640 1 -- 172.21.15.19:0/2920619849 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb3800ce60 con 0x7fdb501045c0 2024-09-10T22:23:55.958 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:23:55.953+0000 7fdb55566640 1 -- 172.21.15.19:0/2920619849 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdb501a5cc0 con 0x7fdb501045c0 2024-09-10T22:23:55.958 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:23:55.955+0000 7fdb55566640 1 -- 172.21.15.19:0/2920619849 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdb50104080 con 0x7fdb501045c0 2024-09-10T22:23:55.958 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:23:55.956+0000 7fdb47fff640 1 -- 172.21.15.19:0/2920619849 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 16) ==== 153250+0+0 (secure 0 0 0) 0x7fdb38004000 con 0x7fdb501045c0 2024-09-10T22:23:55.959 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:23:55.957+0000 7fdb47fff640 1 --2- 172.21.15.19:0/2920619849 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7fdb3c0b52e0 0x7fdb3c0b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:23:55.959 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:23:55.957+0000 7fdb4effd640 1 --2- 172.21.15.19:0/2920619849 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7fdb3c0b52e0 0x7fdb3c0b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:23:55.959 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:23:55.957+0000 7fdb47fff640 1 -- 172.21.15.19:0/2920619849 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(68..68 src has 1..68) ==== 7127+0+0 (secure 0 0 0) 0x7fdb380e5bb0 con 0x7fdb501045c0 2024-09-10T22:23:55.959 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:23:55.957+0000 7fdb4effd640 1 --2- 172.21.15.19:0/2920619849 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7fdb3c0b52e0 0x7fdb3c0b77a0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fdb40005fd0 tx=0x7fdb40009500 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:23:55.962 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:23:55.961+0000 7fdb47fff640 1 -- 172.21.15.19:0/2920619849 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7fdb380acf10 con 0x7fdb501045c0 2024-09-10T22:23:56.125 INFO:journalctl@ceph.mds.f.smithi138.stdout:Sep 10 22:23:55 smithi138 systemd[1]: Started Ceph mds.f for 22997a4c-6fc2-11ef-bcea-c7b262605968. 2024-09-10T22:23:56.125 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:23:56 smithi138 ceph-mon[35236]: pgmap v263: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T22:23:56.125 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:23:56 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:23:56.125 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:23:56 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:23:56.125 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:23:56 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:23:56.125 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:23:56 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-10T22:23:56.125 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:23:56 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-10T22:23:56.126 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:23:56 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T22:23:56.189 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:23:56.187+0000 7fdb55566640 1 -- 172.21.15.19:0/2920619849 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fdb501a60b0 con 0x7fdb501045c0 2024-09-10T22:23:56.189 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:23:56 smithi019 ceph-mon[31375]: pgmap v263: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T22:23:56.189 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:23:56 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:23:56.189 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:23:56 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:23:56.189 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:23:56 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:23:56.189 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:23:56 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-10T22:23:56.189 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:23:56 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-10T22:23:56.190 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:23:56 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T22:23:56.190 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:23:56.188+0000 7fdb47fff640 1 -- 172.21.15.19:0/2920619849 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) ==== 93+0+5569 (secure 0 0 0) 0x7fdb380ac810 con 0x7fdb501045c0 2024-09-10T22:23:56.190 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-10T22:23:56.190 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":7,"btime":"2024-09-10T22:23:56:005349+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14673,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6835/1835804747","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6834","nonce":1835804747},{"type":"v1","addr":"172.21.15.19:6835","nonce":1835804747}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14685,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6837/1750470490","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6836","nonce":1750470490},{"type":"v1","addr":"172.21.15.19:6837","nonce":1750470490}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24511,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.138:6833/2524811494","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6832","nonce":2524811494},{"type":"v1","addr":"172.21.15.138:6833","nonce":2524811494}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24512,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6833/3014993624","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6832","nonce":3014993624},{"type":"v1","addr":"172.21.15.135:6833","nonce":3014993624}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24527,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6835/3715773348","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6834","nonce":3715773348},{"type":"v1","addr":"172.21.15.135:6835","nonce":3715773348}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24541,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.138:6835/933547028","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6834","nonce":933547028},{"type":"v1","addr":"172.21.15.138:6835","nonce":933547028}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7}],"filesystems":[]} 2024-09-10T22:23:56.191 INFO:teuthology.orchestra.run.smithi019.stderr:dumped fsmap epoch 7 2024-09-10T22:23:56.192 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:23:56.190+0000 7fdb55566640 1 -- 172.21.15.19:0/2920619849 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7fdb3c0b52e0 msgr2=0x7fdb3c0b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:23:56.192 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:23:56.190+0000 7fdb55566640 1 --2- 172.21.15.19:0/2920619849 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7fdb3c0b52e0 0x7fdb3c0b77a0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fdb40005fd0 tx=0x7fdb40009500 comp rx=0 tx=0).stop 2024-09-10T22:23:56.192 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:23:56.190+0000 7fdb55566640 1 -- 172.21.15.19:0/2920619849 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdb501045c0 msgr2=0x7fdb501997a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:23:56.192 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:23:56.190+0000 7fdb55566640 1 --2- 172.21.15.19:0/2920619849 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdb501045c0 0x7fdb501997a0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fdb3800e9c0 tx=0x7fdb3800ee80 comp rx=0 tx=0).stop 2024-09-10T22:23:56.192 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:23:56.190+0000 7fdb55566640 1 -- 172.21.15.19:0/2920619849 shutdown_connections 2024-09-10T22:23:56.192 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:23:56.190+0000 7fdb55566640 1 --2- 172.21.15.19:0/2920619849 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7fdb3c0b52e0 0x7fdb3c0b77a0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:23:56.192 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:23:56.190+0000 7fdb55566640 1 --2- 172.21.15.19:0/2920619849 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fdb5010d100 0x7fdb5019eb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:23:56.192 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:23:56.190+0000 7fdb55566640 1 --2- 172.21.15.19:0/2920619849 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdb501045c0 0x7fdb501997a0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:23:56.192 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:23:56.190+0000 7fdb55566640 1 --2- 172.21.15.19:0/2920619849 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdb50103ca0 0x7fdb50199260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:23:56.192 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:23:56.190+0000 7fdb55566640 1 -- 172.21.15.19:0/2920619849 >> 172.21.15.19:0/2920619849 conn(0x7fdb500fd700 msgr2=0x7fdb500fe300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:23:56.192 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:23:56.190+0000 7fdb55566640 1 -- 172.21.15.19:0/2920619849 shutdown_connections 2024-09-10T22:23:56.192 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:23:56.190+0000 7fdb55566640 1 -- 172.21.15.19:0/2920619849 wait complete. 2024-09-10T22:23:56.360 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:23:56 smithi135 ceph-mon[34789]: pgmap v263: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T22:23:56.360 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:23:56 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:23:56.360 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:23:56 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:23:56.360 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:23:56 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:23:56.360 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:23:56 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-10T22:23:56.360 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:23:56 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-10T22:23:56.360 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:23:56 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T22:23:57.109 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:23:57 smithi135 ceph-mon[34789]: Deploying daemon mds.c on smithi138 2024-09-10T22:23:57.110 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:23:57 smithi135 ceph-mon[34789]: mds.? [v2:172.21.15.138:6834/933547028,v1:172.21.15.138:6835/933547028] up:boot 2024-09-10T22:23:57.110 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:23:57 smithi135 ceph-mon[34789]: fsmap 6 up:standby 2024-09-10T22:23:57.110 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:23:57 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "f"} : dispatch 2024-09-10T22:23:57.110 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:23:57 smithi135 ceph-mon[34789]: from='client.? 172.21.15.19:0/2920619849' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T22:23:57.208 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:23:57 smithi019 ceph-mon[31375]: Deploying daemon mds.c on smithi138 2024-09-10T22:23:57.208 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:23:57 smithi019 ceph-mon[31375]: mds.? [v2:172.21.15.138:6834/933547028,v1:172.21.15.138:6835/933547028] up:boot 2024-09-10T22:23:57.209 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:23:57 smithi019 ceph-mon[31375]: fsmap 6 up:standby 2024-09-10T22:23:57.209 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:23:57 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "f"} : dispatch 2024-09-10T22:23:57.209 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:23:57 smithi019 ceph-mon[31375]: from='client.? 172.21.15.19:0/2920619849' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T22:23:57.333 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:23:57 smithi138 ceph-mon[35236]: Deploying daemon mds.c on smithi138 2024-09-10T22:23:57.333 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:23:57 smithi138 ceph-mon[35236]: mds.? [v2:172.21.15.138:6834/933547028,v1:172.21.15.138:6835/933547028] up:boot 2024-09-10T22:23:57.333 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:23:57 smithi138 ceph-mon[35236]: fsmap 6 up:standby 2024-09-10T22:23:57.334 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:23:57 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "f"} : dispatch 2024-09-10T22:23:57.334 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:23:57 smithi138 ceph-mon[35236]: from='client.? 172.21.15.19:0/2920619849' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T22:23:57.875 INFO:journalctl@ceph.mds.c.smithi138.stdout:Sep 10 22:23:57 smithi138 systemd[1]: Starting Ceph mds.c for 22997a4c-6fc2-11ef-bcea-c7b262605968... 2024-09-10T22:23:58.274 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:23:58 smithi138 ceph-mon[35236]: pgmap v264: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T22:23:58.274 INFO:journalctl@ceph.mds.c.smithi138.stdout:Sep 10 22:23:58 smithi138 podman[66145]: 2024-09-10 22:23:57.924750557 +0000 UTC m=+0.015708199 image pull 589dd18248e494ba411dc838aa4ae0e5e569213f08fcd7a2cf22cd3ef7e3c480 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e 2024-09-10T22:23:58.274 INFO:journalctl@ceph.mds.c.smithi138.stdout:Sep 10 22:23:58 smithi138 podman[66145]: 2024-09-10 22:23:58.051278442 +0000 UTC m=+0.142236085 container create 74c18554cfd29bead63d158d7bf711e1f0c46ff5655db0fed3b5dee4583c553e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-mds-c, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, ceph=True, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux ) 2024-09-10T22:23:58.274 INFO:journalctl@ceph.mds.c.smithi138.stdout:Sep 10 22:23:58 smithi138 podman[66145]: 2024-09-10 22:23:58.270593049 +0000 UTC m=+0.361550690 container init 74c18554cfd29bead63d158d7bf711e1f0c46ff5655db0fed3b5dee4583c553e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-mds-c, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, ceph=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-10T22:23:58.274 INFO:journalctl@ceph.mds.c.smithi138.stdout:Sep 10 22:23:58 smithi138 podman[66145]: 2024-09-10 22:23:58.273520083 +0000 UTC m=+0.364477735 container start 74c18554cfd29bead63d158d7bf711e1f0c46ff5655db0fed3b5dee4583c553e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-mds-c, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, ceph=True, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731) 2024-09-10T22:23:58.359 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:23:58 smithi135 ceph-mon[34789]: pgmap v264: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T22:23:58.458 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:23:58 smithi019 ceph-mon[31375]: pgmap v264: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T22:23:58.625 INFO:journalctl@ceph.mds.c.smithi138.stdout:Sep 10 22:23:58 smithi138 ceph-mds[66164]: -- 172.21.15.138:0/2389435242 <== mon.1 v2:172.21.15.138:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x556af73d1860 con 0x556af73af000 2024-09-10T22:23:58.625 INFO:journalctl@ceph.mds.c.smithi138.stdout:Sep 10 22:23:58 smithi138 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-mds-c[66160]: starting mds.c at 2024-09-10T22:23:58.625 INFO:journalctl@ceph.mds.c.smithi138.stdout:Sep 10 22:23:58 smithi138 bash[66145]: 74c18554cfd29bead63d158d7bf711e1f0c46ff5655db0fed3b5dee4583c553e 2024-09-10T22:23:58.625 INFO:journalctl@ceph.mds.c.smithi138.stdout:Sep 10 22:23:58 smithi138 systemd[1]: Started Ceph mds.c for 22997a4c-6fc2-11ef-bcea-c7b262605968. 2024-09-10T22:23:58.936 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 22997a4c-6fc2-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-10T22:23:59.208 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/22997a4c-6fc2-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T22:23:59.610 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:23:59 smithi135 ceph-mon[34789]: pgmap v265: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T22:23:59.610 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:23:59 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:23:59.610 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:23:59 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:23:59.610 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:23:59 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:23:59.610 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:23:59 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-10T22:23:59.610 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:23:59 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-10T22:23:59.610 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:23:59 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T22:23:59.610 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:23:59 smithi135 ceph-mon[34789]: Deploying daemon mds.h on smithi135 2024-09-10T22:23:59.611 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:23:59 smithi135 ceph-mon[34789]: mds.? [v2:172.21.15.138:6836/3353290042,v1:172.21.15.138:6837/3353290042] up:boot 2024-09-10T22:23:59.611 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:23:59 smithi135 ceph-mon[34789]: fsmap 7 up:standby 2024-09-10T22:23:59.611 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:23:59 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "c"} : dispatch 2024-09-10T22:23:59.623 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:23:59 smithi019 ceph-mon[31375]: pgmap v265: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T22:23:59.624 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:23:59 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:23:59.624 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:23:59 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:23:59.624 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:23:59 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:23:59.624 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:23:59 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-10T22:23:59.624 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:23:59 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-10T22:23:59.624 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:23:59 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T22:23:59.624 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:23:59 smithi019 ceph-mon[31375]: Deploying daemon mds.h on smithi135 2024-09-10T22:23:59.624 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:23:59 smithi019 ceph-mon[31375]: mds.? [v2:172.21.15.138:6836/3353290042,v1:172.21.15.138:6837/3353290042] up:boot 2024-09-10T22:23:59.624 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:23:59 smithi019 ceph-mon[31375]: fsmap 7 up:standby 2024-09-10T22:23:59.624 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:23:59 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "c"} : dispatch 2024-09-10T22:23:59.709 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:23:59.706+0000 7f07666ef640 1 -- 172.21.15.19:0/2922987420 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0760108020 msgr2=0x7f076010e820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:23:59.709 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:23:59.706+0000 7f07666ef640 1 --2- 172.21.15.19:0/2922987420 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0760108020 0x7f076010e820 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f0758009ca0 tx=0x7f075802a8c0 comp rx=0 tx=0).stop 2024-09-10T22:23:59.709 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:23:59.706+0000 7f07666ef640 1 -- 172.21.15.19:0/2922987420 shutdown_connections 2024-09-10T22:23:59.709 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:23:59.706+0000 7f07666ef640 1 --2- 172.21.15.19:0/2922987420 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0760108020 0x7f076010e820 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:23:59.709 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:23:59.706+0000 7f07666ef640 1 --2- 172.21.15.19:0/2922987420 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f07601076a0 0x7f0760107ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:23:59.709 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:23:59.706+0000 7f07666ef640 1 --2- 172.21.15.19:0/2922987420 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f0760101c90 0x7f0760102070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:23:59.709 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:23:59.706+0000 7f07666ef640 1 -- 172.21.15.19:0/2922987420 >> 172.21.15.19:0/2922987420 conn(0x7f07600fd700 msgr2=0x7f07600ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:23:59.710 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:23:59.706+0000 7f07666ef640 1 -- 172.21.15.19:0/2922987420 shutdown_connections 2024-09-10T22:23:59.710 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:23:59.706+0000 7f07666ef640 1 -- 172.21.15.19:0/2922987420 wait complete. 2024-09-10T22:23:59.710 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:23:59.707+0000 7f07666ef640 1 Processor -- start 2024-09-10T22:23:59.710 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:23:59.707+0000 7f07666ef640 1 -- start start 2024-09-10T22:23:59.710 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:23:59.707+0000 7f07666ef640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0760101c90 0x7f0760198150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:23:59.710 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:23:59.707+0000 7f07666ef640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f07601076a0 0x7f0760198690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:23:59.710 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:23:59.707+0000 7f07666ef640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f0760108020 0x7f076019da30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:23:59.710 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:23:59.707+0000 7f07666ef640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f0760111ca0 con 0x7f0760101c90 2024-09-10T22:23:59.710 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:23:59.707+0000 7f07666ef640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f0760111b20 con 0x7f07601076a0 2024-09-10T22:23:59.710 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:23:59.707+0000 7f07666ef640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f0760111e20 con 0x7f0760108020 2024-09-10T22:23:59.710 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:23:59.707+0000 7f075ffff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0760101c90 0x7f0760198150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:23:59.710 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:23:59.707+0000 7f075ffff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0760101c90 0x7f0760198150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:50040/0 (socket says 172.21.15.19:50040) 2024-09-10T22:23:59.710 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:23:59.707+0000 7f075ffff640 1 -- 172.21.15.19:0/2087121449 learned_addr learned my addr 172.21.15.19:0/2087121449 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:23:59.711 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:23:59.707+0000 7f0757fff640 1 --2- 172.21.15.19:0/2087121449 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f07601076a0 0x7f0760198690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:23:59.711 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:23:59.707+0000 7f075ffff640 1 -- 172.21.15.19:0/2087121449 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f0760108020 msgr2=0x7f076019da30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:23:59.711 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:23:59.707+0000 7f075ffff640 1 --2- 172.21.15.19:0/2087121449 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f0760108020 0x7f076019da30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:23:59.711 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:23:59.707+0000 7f075ffff640 1 -- 172.21.15.19:0/2087121449 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f07601076a0 msgr2=0x7f0760198690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:23:59.711 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:23:59.707+0000 7f075ffff640 1 --2- 172.21.15.19:0/2087121449 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f07601076a0 0x7f0760198690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:23:59.711 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:23:59.707+0000 7f075ffff640 1 -- 172.21.15.19:0/2087121449 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f076019e200 con 0x7f0760101c90 2024-09-10T22:23:59.711 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:23:59.708+0000 7f075ffff640 1 --2- 172.21.15.19:0/2087121449 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0760101c90 0x7f0760198150 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f075000e9f0 tx=0x7f075000edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:23:59.711 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:23:59.708+0000 7f075dffb640 1 -- 172.21.15.19:0/2087121449 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f075000cd80 con 0x7f0760101c90 2024-09-10T22:23:59.711 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:23:59.708+0000 7f07666ef640 1 -- 172.21.15.19:0/2087121449 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f076019e4f0 con 0x7f0760101c90 2024-09-10T22:23:59.711 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:23:59.708+0000 7f075dffb640 1 -- 172.21.15.19:0/2087121449 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f07500054d0 con 0x7f0760101c90 2024-09-10T22:23:59.711 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:23:59.708+0000 7f07666ef640 1 -- 172.21.15.19:0/2087121449 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f07601a4bb0 con 0x7f0760101c90 2024-09-10T22:23:59.711 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:23:59.708+0000 7f075dffb640 1 -- 172.21.15.19:0/2087121449 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0750010690 con 0x7f0760101c90 2024-09-10T22:23:59.712 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:23:59.709+0000 7f07666ef640 1 -- 172.21.15.19:0/2087121449 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0760102070 con 0x7f0760101c90 2024-09-10T22:23:59.712 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:23:59.710+0000 7f075dffb640 1 -- 172.21.15.19:0/2087121449 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 16) ==== 153250+0+0 (secure 0 0 0) 0x7f0750004e50 con 0x7f0760101c90 2024-09-10T22:23:59.713 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:23:59.711+0000 7f075dffb640 1 --2- 172.21.15.19:0/2087121449 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f074c0b52e0 0x7f074c0b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:23:59.713 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:23:59.711+0000 7f0757fff640 1 --2- 172.21.15.19:0/2087121449 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f074c0b52e0 0x7f074c0b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:23:59.713 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:23:59.711+0000 7f075dffb640 1 -- 172.21.15.19:0/2087121449 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(68..68 src has 1..68) ==== 7127+0+0 (secure 0 0 0) 0x7f07500e5e70 con 0x7f0760101c90 2024-09-10T22:23:59.713 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:23:59.712+0000 7f0757fff640 1 --2- 172.21.15.19:0/2087121449 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f074c0b52e0 0x7f074c0b77a0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f0748005fd0 tx=0x7f0748005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:23:59.715 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:23:59.714+0000 7f075dffb640 1 -- 172.21.15.19:0/2087121449 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f0750056220 con 0x7f0760101c90 2024-09-10T22:23:59.875 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:23:59 smithi138 ceph-mon[35236]: pgmap v265: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T22:23:59.875 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:23:59 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:23:59.875 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:23:59 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:23:59.875 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:23:59 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:23:59.875 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:23:59 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-10T22:23:59.875 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:23:59 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-10T22:23:59.875 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:23:59 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T22:23:59.876 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:23:59 smithi138 ceph-mon[35236]: Deploying daemon mds.h on smithi135 2024-09-10T22:23:59.876 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:23:59 smithi138 ceph-mon[35236]: mds.? [v2:172.21.15.138:6836/3353290042,v1:172.21.15.138:6837/3353290042] up:boot 2024-09-10T22:23:59.876 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:23:59 smithi138 ceph-mon[35236]: fsmap 7 up:standby 2024-09-10T22:23:59.876 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:23:59 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "c"} : dispatch 2024-09-10T22:23:59.944 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:23:59.943+0000 7f07666ef640 1 -- 172.21.15.19:0/2087121449 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f0760199280 con 0x7f0760101c90 2024-09-10T22:23:59.945 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:23:59.943+0000 7f075dffb640 1 -- 172.21.15.19:0/2087121449 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+6397 (secure 0 0 0) 0x7f07500ad1d0 con 0x7f0760101c90 2024-09-10T22:23:59.945 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-10T22:23:59.945 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":8,"btime":"2024-09-10T22:23:59:020333+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14673,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6835/1835804747","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6834","nonce":1835804747},{"type":"v1","addr":"172.21.15.19:6835","nonce":1835804747}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14685,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6837/1750470490","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6836","nonce":1750470490},{"type":"v1","addr":"172.21.15.19:6837","nonce":1750470490}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24511,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.138:6833/2524811494","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6832","nonce":2524811494},{"type":"v1","addr":"172.21.15.138:6833","nonce":2524811494}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24512,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6833/3014993624","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6832","nonce":3014993624},{"type":"v1","addr":"172.21.15.135:6833","nonce":3014993624}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24527,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6835/3715773348","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6834","nonce":3715773348},{"type":"v1","addr":"172.21.15.135:6835","nonce":3715773348}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24541,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.138:6835/933547028","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6834","nonce":933547028},{"type":"v1","addr":"172.21.15.138:6835","nonce":933547028}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24553,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.138:6837/3353290042","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6836","nonce":3353290042},{"type":"v1","addr":"172.21.15.138:6837","nonce":3353290042}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8}],"filesystems":[]} 2024-09-10T22:23:59.945 INFO:teuthology.orchestra.run.smithi019.stderr:dumped fsmap epoch 8 2024-09-10T22:23:59.947 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:23:59.946+0000 7f07666ef640 1 -- 172.21.15.19:0/2087121449 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f074c0b52e0 msgr2=0x7f074c0b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:23:59.947 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:23:59.946+0000 7f07666ef640 1 --2- 172.21.15.19:0/2087121449 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f074c0b52e0 0x7f074c0b77a0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f0748005fd0 tx=0x7f0748005850 comp rx=0 tx=0).stop 2024-09-10T22:23:59.948 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:23:59.946+0000 7f07666ef640 1 -- 172.21.15.19:0/2087121449 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0760101c90 msgr2=0x7f0760198150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:23:59.948 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:23:59.946+0000 7f07666ef640 1 --2- 172.21.15.19:0/2087121449 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0760101c90 0x7f0760198150 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f075000e9f0 tx=0x7f075000edf0 comp rx=0 tx=0).stop 2024-09-10T22:23:59.948 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:23:59.946+0000 7f07666ef640 1 -- 172.21.15.19:0/2087121449 shutdown_connections 2024-09-10T22:23:59.948 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:23:59.946+0000 7f07666ef640 1 --2- 172.21.15.19:0/2087121449 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f074c0b52e0 0x7f074c0b77a0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:23:59.948 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:23:59.946+0000 7f07666ef640 1 --2- 172.21.15.19:0/2087121449 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f0760108020 0x7f076019da30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:23:59.948 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:23:59.946+0000 7f07666ef640 1 --2- 172.21.15.19:0/2087121449 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f07601076a0 0x7f0760198690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:23:59.948 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:23:59.946+0000 7f07666ef640 1 --2- 172.21.15.19:0/2087121449 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0760101c90 0x7f0760198150 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:23:59.948 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:23:59.946+0000 7f07666ef640 1 -- 172.21.15.19:0/2087121449 >> 172.21.15.19:0/2087121449 conn(0x7f07600fd700 msgr2=0x7f07600fe020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:23:59.949 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:23:59.946+0000 7f07666ef640 1 -- 172.21.15.19:0/2087121449 shutdown_connections 2024-09-10T22:23:59.949 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:23:59.946+0000 7f07666ef640 1 -- 172.21.15.19:0/2087121449 wait complete. 2024-09-10T22:24:00.593 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:24:00 smithi135 ceph-mon[34789]: from='client.? 172.21.15.19:0/2087121449' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T22:24:00.619 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:24:00 smithi019 ceph-mon[31375]: from='client.? 172.21.15.19:0/2087121449' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T22:24:00.875 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:24:00 smithi138 ceph-mon[35236]: from='client.? 172.21.15.19:0/2087121449' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T22:24:01.110 INFO:journalctl@ceph.mds.h.smithi135.stdout:Sep 10 22:24:00 smithi135 systemd[1]: Started Ceph mds.h for 22997a4c-6fc2-11ef-bcea-c7b262605968. 2024-09-10T22:24:02.360 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:24:02 smithi135 ceph-mon[34789]: pgmap v266: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T22:24:02.360 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:24:02 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:24:02.360 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:24:02 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:24:02.360 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:24:02 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:24:02.360 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:24:02 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-10T22:24:02.360 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:24:02 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-10T22:24:02.360 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:24:02 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T22:24:02.360 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:24:02 smithi135 ceph-mon[34789]: Deploying daemon mds.i on smithi138 2024-09-10T22:24:02.360 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:24:02 smithi135 ceph-mon[34789]: mds.? [v2:172.21.15.135:6836/3495029135,v1:172.21.15.135:6837/3495029135] up:boot 2024-09-10T22:24:02.360 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:24:02 smithi135 ceph-mon[34789]: fsmap 8 up:standby 2024-09-10T22:24:02.361 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:24:02 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "h"} : dispatch 2024-09-10T22:24:02.375 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:24:02 smithi138 ceph-mon[35236]: pgmap v266: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T22:24:02.375 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:24:02 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:24:02.375 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:24:02 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:24:02.375 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:24:02 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:24:02.375 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:24:02 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-10T22:24:02.375 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:24:02 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-10T22:24:02.376 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:24:02 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T22:24:02.376 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:24:02 smithi138 ceph-mon[35236]: Deploying daemon mds.i on smithi138 2024-09-10T22:24:02.376 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:24:02 smithi138 ceph-mon[35236]: mds.? [v2:172.21.15.135:6836/3495029135,v1:172.21.15.135:6837/3495029135] up:boot 2024-09-10T22:24:02.376 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:24:02 smithi138 ceph-mon[35236]: fsmap 8 up:standby 2024-09-10T22:24:02.376 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:24:02 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "h"} : dispatch 2024-09-10T22:24:02.458 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:24:02 smithi019 ceph-mon[31375]: pgmap v266: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T22:24:02.459 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:24:02 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:24:02.459 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:24:02 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:24:02.459 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:24:02 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:24:02.459 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:24:02 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-10T22:24:02.459 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:24:02 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-10T22:24:02.459 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:24:02 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T22:24:02.459 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:24:02 smithi019 ceph-mon[31375]: Deploying daemon mds.i on smithi138 2024-09-10T22:24:02.459 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:24:02 smithi019 ceph-mon[31375]: mds.? [v2:172.21.15.135:6836/3495029135,v1:172.21.15.135:6837/3495029135] up:boot 2024-09-10T22:24:02.459 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:24:02 smithi019 ceph-mon[31375]: fsmap 8 up:standby 2024-09-10T22:24:02.459 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:24:02 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "h"} : dispatch 2024-09-10T22:24:02.650 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 22997a4c-6fc2-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-10T22:24:02.923 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/22997a4c-6fc2-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T22:24:03.125 INFO:journalctl@ceph.mds.i.smithi138.stdout:Sep 10 22:24:03 smithi138 systemd[1]: Starting Ceph mds.i for 22997a4c-6fc2-11ef-bcea-c7b262605968... 2024-09-10T22:24:03.398 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:03.379+0000 7fb5366c6640 1 -- 172.21.15.19:0/3343764601 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb530109150 msgr2=0x7fb53010f950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:24:03.398 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:03.379+0000 7fb5366c6640 1 --2- 172.21.15.19:0/3343764601 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb530109150 0x7fb53010f950 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fb528009ca0 tx=0x7fb52802a8c0 comp rx=0 tx=0).stop 2024-09-10T22:24:03.398 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:03.379+0000 7fb5366c6640 1 -- 172.21.15.19:0/3343764601 shutdown_connections 2024-09-10T22:24:03.398 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:03.379+0000 7fb5366c6640 1 --2- 172.21.15.19:0/3343764601 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb530109150 0x7fb53010f950 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:24:03.398 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:03.379+0000 7fb5366c6640 1 --2- 172.21.15.19:0/3343764601 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb5301087d0 0x7fb530108c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:24:03.398 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:03.379+0000 7fb5366c6640 1 --2- 172.21.15.19:0/3343764601 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb530102dc0 0x7fb5301031a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:24:03.398 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:03.379+0000 7fb5366c6640 1 -- 172.21.15.19:0/3343764601 >> 172.21.15.19:0/3343764601 conn(0x7fb5300fe830 msgr2=0x7fb530100c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:24:03.398 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:03.379+0000 7fb5366c6640 1 -- 172.21.15.19:0/3343764601 shutdown_connections 2024-09-10T22:24:03.399 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:03.379+0000 7fb5366c6640 1 -- 172.21.15.19:0/3343764601 wait complete. 2024-09-10T22:24:03.399 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:03.380+0000 7fb5366c6640 1 Processor -- start 2024-09-10T22:24:03.399 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:03.380+0000 7fb5366c6640 1 -- start start 2024-09-10T22:24:03.399 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:03.380+0000 7fb5366c6640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb530102dc0 0x7fb5300754a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:24:03.399 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:03.380+0000 7fb5366c6640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb5301087d0 0x7fb5300759e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:24:03.399 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:03.380+0000 7fb5366c6640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb530109150 0x7fb530075f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:24:03.399 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:03.380+0000 7fb5366c6640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fb530112e10 con 0x7fb530109150 2024-09-10T22:24:03.399 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:03.380+0000 7fb5366c6640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fb530112c90 con 0x7fb530102dc0 2024-09-10T22:24:03.399 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:03.380+0000 7fb5366c6640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7fb530112f90 con 0x7fb5301087d0 2024-09-10T22:24:03.399 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:03.380+0000 7fb534c63640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb530109150 0x7fb530075f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:24:03.399 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:03.380+0000 7fb534c63640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb530109150 0x7fb530075f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:38824/0 (socket says 172.21.15.19:38824) 2024-09-10T22:24:03.399 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:03.380+0000 7fb534c63640 1 -- 172.21.15.19:0/1322179611 learned_addr learned my addr 172.21.15.19:0/1322179611 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:24:03.400 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:03.380+0000 7fb527fff640 1 --2- 172.21.15.19:0/1322179611 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb5301087d0 0x7fb5300759e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:24:03.400 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:03.380+0000 7fb52ffff640 1 --2- 172.21.15.19:0/1322179611 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb530102dc0 0x7fb5300754a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:24:03.400 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:03.380+0000 7fb534c63640 1 -- 172.21.15.19:0/1322179611 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb5301087d0 msgr2=0x7fb5300759e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:24:03.400 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:03.380+0000 7fb534c63640 1 --2- 172.21.15.19:0/1322179611 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb5301087d0 0x7fb5300759e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:24:03.400 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:03.380+0000 7fb534c63640 1 -- 172.21.15.19:0/1322179611 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb530102dc0 msgr2=0x7fb5300754a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:24:03.400 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:03.380+0000 7fb534c63640 1 --2- 172.21.15.19:0/1322179611 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb530102dc0 0x7fb5300754a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:24:03.400 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:03.380+0000 7fb534c63640 1 -- 172.21.15.19:0/1322179611 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb5301a7600 con 0x7fb530109150 2024-09-10T22:24:03.400 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:03.381+0000 7fb534c63640 1 --2- 172.21.15.19:0/1322179611 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb530109150 0x7fb530075f20 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fb528005cc0 tx=0x7fb52802f380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:24:03.400 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:03.381+0000 7fb52dffb640 1 -- 172.21.15.19:0/1322179611 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb528003bf0 con 0x7fb530109150 2024-09-10T22:24:03.400 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:03.381+0000 7fb52dffb640 1 -- 172.21.15.19:0/1322179611 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb528003d90 con 0x7fb530109150 2024-09-10T22:24:03.400 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:03.381+0000 7fb5366c6640 1 -- 172.21.15.19:0/1322179611 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb5301a7890 con 0x7fb530109150 2024-09-10T22:24:03.400 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:03.381+0000 7fb52dffb640 1 -- 172.21.15.19:0/1322179611 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb52802fbc0 con 0x7fb530109150 2024-09-10T22:24:03.401 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:03.381+0000 7fb5366c6640 1 -- 172.21.15.19:0/1322179611 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb5301a7e20 con 0x7fb530109150 2024-09-10T22:24:03.401 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:03.382+0000 7fb5366c6640 1 -- 172.21.15.19:0/1322179611 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb5301031a0 con 0x7fb530109150 2024-09-10T22:24:03.401 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:03.383+0000 7fb52dffb640 1 -- 172.21.15.19:0/1322179611 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 16) ==== 153250+0+0 (secure 0 0 0) 0x7fb528004610 con 0x7fb530109150 2024-09-10T22:24:03.401 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:03.384+0000 7fb52dffb640 1 --2- 172.21.15.19:0/1322179611 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7fb51c0b5360 0x7fb51c0b7820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:24:03.401 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:03.384+0000 7fb52ffff640 1 --2- 172.21.15.19:0/1322179611 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7fb51c0b5360 0x7fb51c0b7820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:24:03.401 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:03.384+0000 7fb52dffb640 1 -- 172.21.15.19:0/1322179611 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(68..68 src has 1..68) ==== 7127+0+0 (secure 0 0 0) 0x7fb528106c70 con 0x7fb530109150 2024-09-10T22:24:03.401 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:03.385+0000 7fb52ffff640 1 --2- 172.21.15.19:0/1322179611 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7fb51c0b5360 0x7fb51c0b7820 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fb520005fd0 tx=0x7fb520005c70 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:24:03.401 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:03.389+0000 7fb52dffb640 1 -- 172.21.15.19:0/1322179611 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7fb5280cdfd0 con 0x7fb530109150 2024-09-10T22:24:03.492 INFO:journalctl@ceph.mds.i.smithi138.stdout:Sep 10 22:24:03 smithi138 podman[66446]: 2024-09-10 22:24:03.238679185 +0000 UTC m=+0.103042324 container create 5bf363fdcbbad4ecb90c5732349d78d8ebb391ec054eedc7c5ab0791df8af65d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-mds-i, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS) 2024-09-10T22:24:03.492 INFO:journalctl@ceph.mds.i.smithi138.stdout:Sep 10 22:24:03 smithi138 podman[66446]: 2024-09-10 22:24:03.151362346 +0000 UTC m=+0.015725490 image pull 589dd18248e494ba411dc838aa4ae0e5e569213f08fcd7a2cf22cd3ef7e3c480 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e 2024-09-10T22:24:03.492 INFO:journalctl@ceph.mds.i.smithi138.stdout:Sep 10 22:24:03 smithi138 podman[66446]: 2024-09-10 22:24:03.491522203 +0000 UTC m=+0.355885351 container init 5bf363fdcbbad4ecb90c5732349d78d8ebb391ec054eedc7c5ab0791df8af65d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-mds-i, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_CLEAN=True, org.label-schema.schema-version=1.0, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-10T22:24:03.610 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:03.609+0000 7fb5366c6640 1 -- 172.21.15.19:0/1322179611 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fb5301a8200 con 0x7fb530109150 2024-09-10T22:24:03.611 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:03.610+0000 7fb52dffb640 1 -- 172.21.15.19:0/1322179611 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+7225 (secure 0 0 0) 0x7fb5280098b0 con 0x7fb530109150 2024-09-10T22:24:03.611 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-10T22:24:03.611 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":9,"btime":"2024-09-10T22:24:01:435188+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14673,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6835/1835804747","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6834","nonce":1835804747},{"type":"v1","addr":"172.21.15.19:6835","nonce":1835804747}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14685,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6837/1750470490","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6836","nonce":1750470490},{"type":"v1","addr":"172.21.15.19:6837","nonce":1750470490}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24511,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.138:6833/2524811494","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6832","nonce":2524811494},{"type":"v1","addr":"172.21.15.138:6833","nonce":2524811494}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24512,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6833/3014993624","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6832","nonce":3014993624},{"type":"v1","addr":"172.21.15.135:6833","nonce":3014993624}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24527,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6835/3715773348","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6834","nonce":3715773348},{"type":"v1","addr":"172.21.15.135:6835","nonce":3715773348}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24541,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.138:6835/933547028","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6834","nonce":933547028},{"type":"v1","addr":"172.21.15.138:6835","nonce":933547028}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24551,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6837/3495029135","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6836","nonce":3495029135},{"type":"v1","addr":"172.21.15.135:6837","nonce":3495029135}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24553,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.138:6837/3353290042","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6836","nonce":3353290042},{"type":"v1","addr":"172.21.15.138:6837","nonce":3353290042}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8}],"filesystems":[]} 2024-09-10T22:24:03.612 INFO:teuthology.orchestra.run.smithi019.stderr:dumped fsmap epoch 9 2024-09-10T22:24:03.616 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:03.612+0000 7fb5366c6640 1 -- 172.21.15.19:0/1322179611 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7fb51c0b5360 msgr2=0x7fb51c0b7820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:24:03.616 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:03.612+0000 7fb5366c6640 1 --2- 172.21.15.19:0/1322179611 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7fb51c0b5360 0x7fb51c0b7820 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fb520005fd0 tx=0x7fb520005c70 comp rx=0 tx=0).stop 2024-09-10T22:24:03.616 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:03.612+0000 7fb5366c6640 1 -- 172.21.15.19:0/1322179611 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb530109150 msgr2=0x7fb530075f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:24:03.616 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:03.612+0000 7fb5366c6640 1 --2- 172.21.15.19:0/1322179611 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb530109150 0x7fb530075f20 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fb528005cc0 tx=0x7fb52802f380 comp rx=0 tx=0).stop 2024-09-10T22:24:03.617 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:03.612+0000 7fb5366c6640 1 -- 172.21.15.19:0/1322179611 shutdown_connections 2024-09-10T22:24:03.617 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:03.612+0000 7fb5366c6640 1 --2- 172.21.15.19:0/1322179611 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7fb51c0b5360 0x7fb51c0b7820 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:24:03.617 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:03.612+0000 7fb5366c6640 1 --2- 172.21.15.19:0/1322179611 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb530109150 0x7fb530075f20 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:24:03.617 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:03.612+0000 7fb5366c6640 1 --2- 172.21.15.19:0/1322179611 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb5301087d0 0x7fb5300759e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:24:03.617 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:03.612+0000 7fb5366c6640 1 --2- 172.21.15.19:0/1322179611 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb530102dc0 0x7fb5300754a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:24:03.617 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:03.612+0000 7fb5366c6640 1 -- 172.21.15.19:0/1322179611 >> 172.21.15.19:0/1322179611 conn(0x7fb5300fe830 msgr2=0x7fb530101d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:24:03.617 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:03.612+0000 7fb5366c6640 1 -- 172.21.15.19:0/1322179611 shutdown_connections 2024-09-10T22:24:03.617 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:03.612+0000 7fb5366c6640 1 -- 172.21.15.19:0/1322179611 wait complete. 2024-09-10T22:24:03.877 INFO:journalctl@ceph.mds.i.smithi138.stdout:Sep 10 22:24:03 smithi138 podman[66446]: 2024-09-10 22:24:03.494349439 +0000 UTC m=+0.358712578 container start 5bf363fdcbbad4ecb90c5732349d78d8ebb391ec054eedc7c5ab0791df8af65d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-mds-i, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731) 2024-09-10T22:24:03.877 INFO:journalctl@ceph.mds.i.smithi138.stdout:Sep 10 22:24:03 smithi138 ceph-mds[66465]: -- 172.21.15.138:0/1197790334 <== mon.1 v2:172.21.15.138:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5560c0db1c20 con 0x5560c0d8f400 2024-09-10T22:24:03.877 INFO:journalctl@ceph.mds.i.smithi138.stdout:Sep 10 22:24:03 smithi138 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-mds-i[66461]: starting mds.i at 2024-09-10T22:24:03.877 INFO:journalctl@ceph.mds.i.smithi138.stdout:Sep 10 22:24:03 smithi138 bash[66446]: 5bf363fdcbbad4ecb90c5732349d78d8ebb391ec054eedc7c5ab0791df8af65d 2024-09-10T22:24:03.877 INFO:journalctl@ceph.mds.i.smithi138.stdout:Sep 10 22:24:03 smithi138 systemd[1]: Started Ceph mds.i for 22997a4c-6fc2-11ef-bcea-c7b262605968. 2024-09-10T22:24:04.285 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:24:04 smithi019 ceph-mon[31375]: pgmap v267: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T22:24:04.286 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:24:04 smithi019 ceph-mon[31375]: from='client.? 172.21.15.19:0/1322179611' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T22:24:04.286 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:24:04 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:24:04.286 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:24:04 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:24:04.286 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:24:04 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:24:04.286 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:24:04 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-10T22:24:04.286 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:24:04 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-10T22:24:04.286 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:24:04 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T22:24:04.359 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:24:04 smithi135 ceph-mon[34789]: pgmap v267: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T22:24:04.360 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:24:04 smithi135 ceph-mon[34789]: from='client.? 172.21.15.19:0/1322179611' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T22:24:04.360 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:24:04 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:24:04.360 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:24:04 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:24:04.360 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:24:04 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:24:04.360 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:24:04 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-10T22:24:04.360 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:24:04 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-10T22:24:04.360 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:24:04 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T22:24:04.375 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:24:04 smithi138 ceph-mon[35236]: pgmap v267: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T22:24:04.375 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:24:04 smithi138 ceph-mon[35236]: from='client.? 172.21.15.19:0/1322179611' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T22:24:04.375 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:24:04 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:24:04.375 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:24:04 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:24:04.375 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:24:04 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:24:04.375 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:24:04 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-10T22:24:04.375 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:24:04 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-10T22:24:04.375 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:24:04 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T22:24:05.208 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:24:05 smithi019 ceph-mon[31375]: Deploying daemon mds.g on smithi019 2024-09-10T22:24:05.208 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:24:05 smithi019 ceph-mon[31375]: mds.? [v2:172.21.15.138:6838/383637208,v1:172.21.15.138:6839/383637208] up:boot 2024-09-10T22:24:05.208 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:24:05 smithi019 ceph-mon[31375]: fsmap 9 up:standby 2024-09-10T22:24:05.209 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:24:05 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "i"} : dispatch 2024-09-10T22:24:05.360 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:24:05 smithi135 ceph-mon[34789]: Deploying daemon mds.g on smithi019 2024-09-10T22:24:05.360 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:24:05 smithi135 ceph-mon[34789]: mds.? [v2:172.21.15.138:6838/383637208,v1:172.21.15.138:6839/383637208] up:boot 2024-09-10T22:24:05.360 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:24:05 smithi135 ceph-mon[34789]: fsmap 9 up:standby 2024-09-10T22:24:05.360 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:24:05 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "i"} : dispatch 2024-09-10T22:24:05.375 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:24:05 smithi138 ceph-mon[35236]: Deploying daemon mds.g on smithi019 2024-09-10T22:24:05.375 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:24:05 smithi138 ceph-mon[35236]: mds.? [v2:172.21.15.138:6838/383637208,v1:172.21.15.138:6839/383637208] up:boot 2024-09-10T22:24:05.375 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:24:05 smithi138 ceph-mon[35236]: fsmap 9 up:standby 2024-09-10T22:24:05.375 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:24:05 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "i"} : dispatch 2024-09-10T22:24:06.169 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:24:06 smithi019 ceph-mon[31375]: pgmap v268: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T22:24:06.315 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 22997a4c-6fc2-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-10T22:24:06.359 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:24:06 smithi135 ceph-mon[34789]: pgmap v268: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T22:24:06.375 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:24:06 smithi138 ceph-mon[35236]: pgmap v268: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T22:24:06.458 INFO:journalctl@ceph.mds.g.smithi019.stdout:Sep 10 22:24:06 smithi019 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-mds-g[74349]: starting mds.g at 2024-09-10T22:24:06.589 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/22997a4c-6fc2-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T22:24:06.763 INFO:journalctl@ceph.mds.g.smithi019.stdout:Sep 10 22:24:06 smithi019 bash[74334]: d78254ae03bc4af18c1d218b78558069cec3abf229bcddfa25115058bd5dfba7 2024-09-10T22:24:06.764 INFO:journalctl@ceph.mds.g.smithi019.stdout:Sep 10 22:24:06 smithi019 systemd[1]: Started Ceph mds.g for 22997a4c-6fc2-11ef-bcea-c7b262605968. 2024-09-10T22:24:07.108 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:07.083+0000 7f6708d09640 1 -- 172.21.15.19:0/2588669712 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6704101cd0 msgr2=0x7f67041020b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:24:07.108 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:07.083+0000 7f6708d09640 1 --2- 172.21.15.19:0/2588669712 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6704101cd0 0x7f67041020b0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f66f4009900 tx=0x7f66f402a410 comp rx=0 tx=0).stop 2024-09-10T22:24:07.108 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:07.083+0000 7f6708d09640 1 -- 172.21.15.19:0/2588669712 shutdown_connections 2024-09-10T22:24:07.108 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:07.083+0000 7f6708d09640 1 --2- 172.21.15.19:0/2588669712 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6704108060 0x7f670410e860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:24:07.108 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:07.083+0000 7f6708d09640 1 --2- 172.21.15.19:0/2588669712 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f67041076e0 0x7f6704107b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:24:07.108 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:07.083+0000 7f6708d09640 1 --2- 172.21.15.19:0/2588669712 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6704101cd0 0x7f67041020b0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:24:07.108 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:07.083+0000 7f6708d09640 1 -- 172.21.15.19:0/2588669712 >> 172.21.15.19:0/2588669712 conn(0x7f67040fd700 msgr2=0x7f67040ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:24:07.109 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:07.083+0000 7f6708d09640 1 -- 172.21.15.19:0/2588669712 shutdown_connections 2024-09-10T22:24:07.109 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:07.083+0000 7f6708d09640 1 -- 172.21.15.19:0/2588669712 wait complete. 2024-09-10T22:24:07.109 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:07.084+0000 7f6708d09640 1 Processor -- start 2024-09-10T22:24:07.109 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:07.084+0000 7f6708d09640 1 -- start start 2024-09-10T22:24:07.109 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:07.084+0000 7f6708d09640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f6704101cd0 0x7f67041992e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:24:07.109 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:07.085+0000 7f6708d09640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f67041076e0 0x7f6704199820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:24:07.109 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:07.085+0000 7f6708d09640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6704108060 0x7f670419ebc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:24:07.109 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:07.085+0000 7f6708d09640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f6704111d20 con 0x7f67041076e0 2024-09-10T22:24:07.109 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:07.085+0000 7f6708d09640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f6704111ba0 con 0x7f6704108060 2024-09-10T22:24:07.109 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:07.085+0000 7f6708d09640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f6704111ea0 con 0x7f6704101cd0 2024-09-10T22:24:07.109 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:07.085+0000 7f6701d9b640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f67041076e0 0x7f6704199820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:24:07.109 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:07.085+0000 7f6701d9b640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f67041076e0 0x7f6704199820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:38868/0 (socket says 172.21.15.19:38868) 2024-09-10T22:24:07.110 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:07.085+0000 7f6701d9b640 1 -- 172.21.15.19:0/1128433745 learned_addr learned my addr 172.21.15.19:0/1128433745 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:24:07.110 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:07.085+0000 7f670259c640 1 --2- 172.21.15.19:0/1128433745 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f6704101cd0 0x7f67041992e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:24:07.110 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:07.085+0000 7f6702d9d640 1 --2- 172.21.15.19:0/1128433745 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6704108060 0x7f670419ebc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:24:07.110 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:07.085+0000 7f6701d9b640 1 -- 172.21.15.19:0/1128433745 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f6704101cd0 msgr2=0x7f67041992e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:24:07.110 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:07.085+0000 7f6701d9b640 1 --2- 172.21.15.19:0/1128433745 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f6704101cd0 0x7f67041992e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:24:07.110 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:07.085+0000 7f6701d9b640 1 -- 172.21.15.19:0/1128433745 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6704108060 msgr2=0x7f670419ebc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:24:07.110 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:07.085+0000 7f6701d9b640 1 --2- 172.21.15.19:0/1128433745 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6704108060 0x7f670419ebc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:24:07.110 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:07.085+0000 7f6701d9b640 1 -- 172.21.15.19:0/1128433745 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f670419f390 con 0x7f67041076e0 2024-09-10T22:24:07.110 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:07.085+0000 7f6701d9b640 1 --2- 172.21.15.19:0/1128433745 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f67041076e0 0x7f6704199820 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f66f800cce0 tx=0x7f66f800a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:24:07.110 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:07.085+0000 7f66f37fe640 1 -- 172.21.15.19:0/1128433745 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66f8004b20 con 0x7f67041076e0 2024-09-10T22:24:07.110 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:07.085+0000 7f66f37fe640 1 -- 172.21.15.19:0/1128433745 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f66f8004cc0 con 0x7f67041076e0 2024-09-10T22:24:07.111 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:07.085+0000 7f66f37fe640 1 -- 172.21.15.19:0/1128433745 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66f800f6b0 con 0x7f67041076e0 2024-09-10T22:24:07.111 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:07.085+0000 7f6708d09640 1 -- 172.21.15.19:0/1128433745 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f670419f680 con 0x7f67041076e0 2024-09-10T22:24:07.111 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:07.086+0000 7f6708d09640 1 -- 172.21.15.19:0/1128433745 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f67041a5d40 con 0x7f67041076e0 2024-09-10T22:24:07.111 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:07.087+0000 7f6708d09640 1 -- 172.21.15.19:0/1128433745 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f67041020b0 con 0x7f67041076e0 2024-09-10T22:24:07.111 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:07.088+0000 7f66f37fe640 1 -- 172.21.15.19:0/1128433745 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 16) ==== 153250+0+0 (secure 0 0 0) 0x7f66f800f850 con 0x7f67041076e0 2024-09-10T22:24:07.111 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:07.089+0000 7f66f37fe640 1 --2- 172.21.15.19:0/1128433745 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f66ec0b52e0 0x7f66ec0b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:24:07.111 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:07.089+0000 7f670259c640 1 --2- 172.21.15.19:0/1128433745 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f66ec0b52e0 0x7f66ec0b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:24:07.111 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:07.089+0000 7f66f37fe640 1 -- 172.21.15.19:0/1128433745 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(68..68 src has 1..68) ==== 7127+0+0 (secure 0 0 0) 0x7f66f80e57b0 con 0x7f67041076e0 2024-09-10T22:24:07.111 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:07.089+0000 7f670259c640 1 --2- 172.21.15.19:0/1128433745 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f66ec0b52e0 0x7f66ec0b77a0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f66f4031440 tx=0x7f66f4005b50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:24:07.111 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:07.093+0000 7f66f37fe640 1 -- 172.21.15.19:0/1128433745 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f66f8014030 con 0x7f67041076e0 2024-09-10T22:24:07.324 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:07.322+0000 7f6708d09640 1 -- 172.21.15.19:0/1128433745 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f67041a6140 con 0x7f67041076e0 2024-09-10T22:24:07.324 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:07.323+0000 7f66f37fe640 1 -- 172.21.15.19:0/1128433745 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 11 v11) ==== 94+0+8878 (secure 0 0 0) 0x7f66f80ac420 con 0x7f67041076e0 2024-09-10T22:24:07.325 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-10T22:24:07.325 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":11,"btime":"2024-09-10T22:24:07:019828+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14673,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6835/1835804747","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6834","nonce":1835804747},{"type":"v1","addr":"172.21.15.19:6835","nonce":1835804747}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14685,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6837/1750470490","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6836","nonce":1750470490},{"type":"v1","addr":"172.21.15.19:6837","nonce":1750470490}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14733,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6839/2642941149","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6838","nonce":2642941149},{"type":"v1","addr":"172.21.15.19:6839","nonce":2642941149}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":24511,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.138:6833/2524811494","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6832","nonce":2524811494},{"type":"v1","addr":"172.21.15.138:6833","nonce":2524811494}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24512,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6833/3014993624","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6832","nonce":3014993624},{"type":"v1","addr":"172.21.15.135:6833","nonce":3014993624}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24527,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6835/3715773348","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6834","nonce":3715773348},{"type":"v1","addr":"172.21.15.135:6835","nonce":3715773348}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24541,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.138:6835/933547028","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6834","nonce":933547028},{"type":"v1","addr":"172.21.15.138:6835","nonce":933547028}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24551,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6837/3495029135","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6836","nonce":3495029135},{"type":"v1","addr":"172.21.15.135:6837","nonce":3495029135}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24553,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.138:6837/3353290042","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6836","nonce":3353290042},{"type":"v1","addr":"172.21.15.138:6837","nonce":3353290042}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24568,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.138:6839/383637208","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6838","nonce":383637208},{"type":"v1","addr":"172.21.15.138:6839","nonce":383637208}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10}],"filesystems":[]} 2024-09-10T22:24:07.325 INFO:teuthology.orchestra.run.smithi019.stderr:dumped fsmap epoch 11 2024-09-10T22:24:07.326 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:07.325+0000 7f6708d09640 1 -- 172.21.15.19:0/1128433745 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f66ec0b52e0 msgr2=0x7f66ec0b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:24:07.326 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:07.325+0000 7f6708d09640 1 --2- 172.21.15.19:0/1128433745 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f66ec0b52e0 0x7f66ec0b77a0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f66f4031440 tx=0x7f66f4005b50 comp rx=0 tx=0).stop 2024-09-10T22:24:07.326 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:07.325+0000 7f6708d09640 1 -- 172.21.15.19:0/1128433745 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f67041076e0 msgr2=0x7f6704199820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:24:07.327 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:07.325+0000 7f6708d09640 1 --2- 172.21.15.19:0/1128433745 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f67041076e0 0x7f6704199820 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f66f800cce0 tx=0x7f66f800a620 comp rx=0 tx=0).stop 2024-09-10T22:24:07.327 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:07.325+0000 7f6708d09640 1 -- 172.21.15.19:0/1128433745 shutdown_connections 2024-09-10T22:24:07.327 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:07.325+0000 7f6708d09640 1 --2- 172.21.15.19:0/1128433745 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f66ec0b52e0 0x7f66ec0b77a0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:24:07.327 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:07.325+0000 7f6708d09640 1 --2- 172.21.15.19:0/1128433745 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6704108060 0x7f670419ebc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:24:07.327 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:07.325+0000 7f6708d09640 1 --2- 172.21.15.19:0/1128433745 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f67041076e0 0x7f6704199820 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:24:07.327 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:07.325+0000 7f6708d09640 1 --2- 172.21.15.19:0/1128433745 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f6704101cd0 0x7f67041992e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:24:07.327 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:07.325+0000 7f6708d09640 1 -- 172.21.15.19:0/1128433745 >> 172.21.15.19:0/1128433745 conn(0x7f67040fd700 msgr2=0x7f670406b6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:24:07.327 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:07.325+0000 7f6708d09640 1 -- 172.21.15.19:0/1128433745 shutdown_connections 2024-09-10T22:24:07.327 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:07.325+0000 7f6708d09640 1 -- 172.21.15.19:0/1128433745 wait complete. 2024-09-10T22:24:07.708 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:24:07 smithi019 ceph-mon[31375]: pgmap v269: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T22:24:07.709 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:24:07 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:24:07.709 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:24:07 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:24:07.709 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:24:07 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:24:07.709 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:24:07 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-10T22:24:07.709 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:24:07 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-10T22:24:07.709 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:24:07 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T22:24:07.709 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:24:07 smithi019 ceph-mon[31375]: Deploying daemon mds.a on smithi019 2024-09-10T22:24:07.709 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:24:07 smithi019 ceph-mon[31375]: mds.? [v2:172.21.15.19:6838/2642941149,v1:172.21.15.19:6839/2642941149] up:boot 2024-09-10T22:24:07.709 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:24:07 smithi019 ceph-mon[31375]: fsmap 10 up:standby 2024-09-10T22:24:07.709 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:24:07 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "g"} : dispatch 2024-09-10T22:24:07.709 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:24:07 smithi019 ceph-mon[31375]: from='client.? 172.21.15.19:0/1128433745' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T22:24:07.860 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:24:07 smithi135 ceph-mon[34789]: pgmap v269: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T22:24:07.860 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:24:07 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:24:07.860 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:24:07 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:24:07.860 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:24:07 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:24:07.860 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:24:07 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-10T22:24:07.860 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:24:07 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-10T22:24:07.860 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:24:07 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T22:24:07.860 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:24:07 smithi135 ceph-mon[34789]: Deploying daemon mds.a on smithi019 2024-09-10T22:24:07.860 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:24:07 smithi135 ceph-mon[34789]: mds.? [v2:172.21.15.19:6838/2642941149,v1:172.21.15.19:6839/2642941149] up:boot 2024-09-10T22:24:07.860 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:24:07 smithi135 ceph-mon[34789]: fsmap 10 up:standby 2024-09-10T22:24:07.861 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:24:07 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "g"} : dispatch 2024-09-10T22:24:07.861 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:24:07 smithi135 ceph-mon[34789]: from='client.? 172.21.15.19:0/1128433745' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T22:24:07.875 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:24:07 smithi138 ceph-mon[35236]: pgmap v269: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T22:24:07.875 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:24:07 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:24:07.875 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:24:07 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:24:07.875 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:24:07 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:24:07.875 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:24:07 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-10T22:24:07.875 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:24:07 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-10T22:24:07.875 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:24:07 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T22:24:07.875 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:24:07 smithi138 ceph-mon[35236]: Deploying daemon mds.a on smithi019 2024-09-10T22:24:07.875 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:24:07 smithi138 ceph-mon[35236]: mds.? [v2:172.21.15.19:6838/2642941149,v1:172.21.15.19:6839/2642941149] up:boot 2024-09-10T22:24:07.876 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:24:07 smithi138 ceph-mon[35236]: fsmap 10 up:standby 2024-09-10T22:24:07.876 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:24:07 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "g"} : dispatch 2024-09-10T22:24:07.876 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:24:07 smithi138 ceph-mon[35236]: from='client.? 172.21.15.19:0/1128433745' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T22:24:09.561 INFO:journalctl@ceph.mds.a.smithi019.stdout:Sep 10 22:24:09 smithi019 podman[74750]: 2024-09-10 22:24:09.487500583 +0000 UTC m=+0.128615305 container create 16d7ea2bbef2bcdaee4f5156f3ca55de12c41c631fc2ee8754c4bdd81ac1b42b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-mds-a, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, ceph=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-10T22:24:09.816 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:24:09 smithi019 ceph-mon[31375]: pgmap v270: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T22:24:09.816 INFO:journalctl@ceph.mds.a.smithi019.stdout:Sep 10 22:24:09 smithi019 podman[74750]: 2024-09-10 22:24:09.706764738 +0000 UTC m=+0.347879462 container init 16d7ea2bbef2bcdaee4f5156f3ca55de12c41c631fc2ee8754c4bdd81ac1b42b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-mds-a, ceph=True, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux ) 2024-09-10T22:24:09.816 INFO:journalctl@ceph.mds.a.smithi019.stdout:Sep 10 22:24:09 smithi019 podman[74750]: 2024-09-10 22:24:09.709652213 +0000 UTC m=+0.350766944 container start 16d7ea2bbef2bcdaee4f5156f3ca55de12c41c631fc2ee8754c4bdd81ac1b42b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-mds-a, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, ceph=True, org.label-schema.vendor=CentOS, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True) 2024-09-10T22:24:09.816 INFO:journalctl@ceph.mds.a.smithi019.stdout:Sep 10 22:24:09 smithi019 ceph-mds[74769]: -- 172.21.15.19:0/3503864098 <== mon.0 v2:172.21.15.19:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x560d5084b860 con 0x560d50828800 2024-09-10T22:24:09.816 INFO:journalctl@ceph.mds.a.smithi019.stdout:Sep 10 22:24:09 smithi019 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-mds-a[74765]: starting mds.a at 2024-09-10T22:24:09.816 INFO:journalctl@ceph.mds.a.smithi019.stdout:Sep 10 22:24:09 smithi019 bash[74750]: 16d7ea2bbef2bcdaee4f5156f3ca55de12c41c631fc2ee8754c4bdd81ac1b42b 2024-09-10T22:24:09.859 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:24:09 smithi135 ceph-mon[34789]: pgmap v270: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T22:24:09.875 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:24:09 smithi138 ceph-mon[35236]: pgmap v270: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T22:24:09.958 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 22997a4c-6fc2-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-10T22:24:10.208 INFO:journalctl@ceph.mds.a.smithi019.stdout:Sep 10 22:24:09 smithi019 systemd[1]: Started Ceph mds.a for 22997a4c-6fc2-11ef-bcea-c7b262605968. 2024-09-10T22:24:10.223 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/22997a4c-6fc2-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T22:24:10.694 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:10.684+0000 7f96930dd640 1 -- 172.21.15.19:0/636573807 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f968c109150 msgr2=0x7f968c10f950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:24:10.694 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:10.684+0000 7f96930dd640 1 --2- 172.21.15.19:0/636573807 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f968c109150 0x7f968c10f950 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f9684009ca0 tx=0x7f968402a8c0 comp rx=0 tx=0).stop 2024-09-10T22:24:10.694 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:10.684+0000 7f96930dd640 1 -- 172.21.15.19:0/636573807 shutdown_connections 2024-09-10T22:24:10.694 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:10.684+0000 7f96930dd640 1 --2- 172.21.15.19:0/636573807 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f968c109150 0x7f968c10f950 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:24:10.694 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:10.684+0000 7f96930dd640 1 --2- 172.21.15.19:0/636573807 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f968c1087d0 0x7f968c108c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:24:10.694 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:10.684+0000 7f96930dd640 1 --2- 172.21.15.19:0/636573807 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f968c102dc0 0x7f968c1031a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:24:10.695 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:10.684+0000 7f96930dd640 1 -- 172.21.15.19:0/636573807 >> 172.21.15.19:0/636573807 conn(0x7f968c0fe830 msgr2=0x7f968c100c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:24:10.695 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:10.684+0000 7f96930dd640 1 -- 172.21.15.19:0/636573807 shutdown_connections 2024-09-10T22:24:10.695 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:10.684+0000 7f96930dd640 1 -- 172.21.15.19:0/636573807 wait complete. 2024-09-10T22:24:10.695 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:10.685+0000 7f96930dd640 1 Processor -- start 2024-09-10T22:24:10.695 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:10.685+0000 7f96930dd640 1 -- start start 2024-09-10T22:24:10.695 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:10.685+0000 7f96930dd640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f968c102dc0 0x7f968c199260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:24:10.695 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:10.685+0000 7f96930dd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f968c1087d0 0x7f968c1997a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:24:10.695 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:10.685+0000 7f96930dd640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f968c109150 0x7f968c19eb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:24:10.695 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:10.685+0000 7f96930dd640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f968c112dd0 con 0x7f968c1087d0 2024-09-10T22:24:10.695 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:10.685+0000 7f96930dd640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f968c112c50 con 0x7f968c109150 2024-09-10T22:24:10.696 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:10.685+0000 7f96930dd640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f968c112f50 con 0x7f968c102dc0 2024-09-10T22:24:10.696 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:10.685+0000 7f968bfff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f968c1087d0 0x7f968c1997a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:24:10.696 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:10.685+0000 7f968bfff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f968c1087d0 0x7f968c1997a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:38908/0 (socket says 172.21.15.19:38908) 2024-09-10T22:24:10.696 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:10.685+0000 7f968bfff640 1 -- 172.21.15.19:0/3733842714 learned_addr learned my addr 172.21.15.19:0/3733842714 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:24:10.696 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:10.685+0000 7f969167a640 1 --2- 172.21.15.19:0/3733842714 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f968c109150 0x7f968c19eb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:24:10.696 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:10.685+0000 7f9690e79640 1 --2- 172.21.15.19:0/3733842714 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f968c102dc0 0x7f968c199260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:24:10.696 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:10.685+0000 7f968bfff640 1 -- 172.21.15.19:0/3733842714 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f968c102dc0 msgr2=0x7f968c199260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:24:10.696 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:10.685+0000 7f968bfff640 1 --2- 172.21.15.19:0/3733842714 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f968c102dc0 0x7f968c199260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:24:10.696 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:10.685+0000 7f968bfff640 1 -- 172.21.15.19:0/3733842714 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f968c109150 msgr2=0x7f968c19eb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:24:10.696 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:10.685+0000 7f968bfff640 1 --2- 172.21.15.19:0/3733842714 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f968c109150 0x7f968c19eb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:24:10.697 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:10.686+0000 7f968bfff640 1 -- 172.21.15.19:0/3733842714 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f968c19f310 con 0x7f968c1087d0 2024-09-10T22:24:10.697 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:10.686+0000 7f968bfff640 1 --2- 172.21.15.19:0/3733842714 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f968c1087d0 0x7f968c1997a0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f967400e9f0 tx=0x7f967400eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:24:10.697 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:10.686+0000 7f9689ffb640 1 -- 172.21.15.19:0/3733842714 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f967400cd80 con 0x7f968c1087d0 2024-09-10T22:24:10.697 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:10.686+0000 7f9689ffb640 1 -- 172.21.15.19:0/3733842714 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f96740108e0 con 0x7f968c1087d0 2024-09-10T22:24:10.697 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:10.686+0000 7f96930dd640 1 -- 172.21.15.19:0/3733842714 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f968c19f600 con 0x7f968c1087d0 2024-09-10T22:24:10.697 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:10.686+0000 7f9689ffb640 1 -- 172.21.15.19:0/3733842714 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9674018980 con 0x7f968c1087d0 2024-09-10T22:24:10.697 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:10.686+0000 7f96930dd640 1 -- 172.21.15.19:0/3733842714 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f968c1a5cc0 con 0x7f968c1087d0 2024-09-10T22:24:10.697 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:10.687+0000 7f96930dd640 1 -- 172.21.15.19:0/3733842714 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f968c1031a0 con 0x7f968c1087d0 2024-09-10T22:24:10.697 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:10.689+0000 7f9689ffb640 1 -- 172.21.15.19:0/3733842714 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 16) ==== 153250+0+0 (secure 0 0 0) 0x7f9674010430 con 0x7f968c1087d0 2024-09-10T22:24:10.697 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:10.690+0000 7f9689ffb640 1 --2- 172.21.15.19:0/3733842714 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f96780b52e0 0x7f96780b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:24:10.698 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:10.690+0000 7f9690e79640 1 --2- 172.21.15.19:0/3733842714 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f96780b52e0 0x7f96780b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:24:10.698 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:10.690+0000 7f9689ffb640 1 -- 172.21.15.19:0/3733842714 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(68..68 src has 1..68) ==== 7127+0+0 (secure 0 0 0) 0x7f96740e5fe0 con 0x7f968c1087d0 2024-09-10T22:24:10.698 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:10.690+0000 7f9690e79640 1 --2- 172.21.15.19:0/3733842714 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f96780b52e0 0x7f96780b77a0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f967c005fd0 tx=0x7f967c005e20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:24:10.698 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:10.693+0000 7f9689ffb640 1 -- 172.21.15.19:0/3733842714 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f96740ad340 con 0x7f968c1087d0 2024-09-10T22:24:10.917 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:10.915+0000 7f96930dd640 1 -- 172.21.15.19:0/3733842714 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f968c19a390 con 0x7f968c1087d0 2024-09-10T22:24:10.917 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:10.916+0000 7f9689ffb640 1 -- 172.21.15.19:0/3733842714 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 12 v12) ==== 94+0+9704 (secure 0 0 0) 0x7f96740acc40 con 0x7f968c1087d0 2024-09-10T22:24:10.918 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-10T22:24:10.918 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":12,"btime":"2024-09-10T22:24:10:560342+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14673,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6835/1835804747","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6834","nonce":1835804747},{"type":"v1","addr":"172.21.15.19:6835","nonce":1835804747}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14685,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6837/1750470490","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6836","nonce":1750470490},{"type":"v1","addr":"172.21.15.19:6837","nonce":1750470490}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14733,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6839/2642941149","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6838","nonce":2642941149},{"type":"v1","addr":"172.21.15.19:6839","nonce":2642941149}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14745,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6841/2449948682","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6840","nonce":2449948682},{"type":"v1","addr":"172.21.15.19:6841","nonce":2449948682}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24511,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.138:6833/2524811494","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6832","nonce":2524811494},{"type":"v1","addr":"172.21.15.138:6833","nonce":2524811494}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24512,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6833/3014993624","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6832","nonce":3014993624},{"type":"v1","addr":"172.21.15.135:6833","nonce":3014993624}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24527,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6835/3715773348","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6834","nonce":3715773348},{"type":"v1","addr":"172.21.15.135:6835","nonce":3715773348}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24541,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.138:6835/933547028","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6834","nonce":933547028},{"type":"v1","addr":"172.21.15.138:6835","nonce":933547028}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24551,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6837/3495029135","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6836","nonce":3495029135},{"type":"v1","addr":"172.21.15.135:6837","nonce":3495029135}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24553,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.138:6837/3353290042","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6836","nonce":3353290042},{"type":"v1","addr":"172.21.15.138:6837","nonce":3353290042}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24568,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.138:6839/383637208","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6838","nonce":383637208},{"type":"v1","addr":"172.21.15.138:6839","nonce":383637208}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10}],"filesystems":[]} 2024-09-10T22:24:10.918 INFO:teuthology.orchestra.run.smithi019.stderr:dumped fsmap epoch 12 2024-09-10T22:24:10.920 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:10.918+0000 7f96930dd640 1 -- 172.21.15.19:0/3733842714 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f96780b52e0 msgr2=0x7f96780b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:24:10.920 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:10.919+0000 7f96930dd640 1 --2- 172.21.15.19:0/3733842714 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f96780b52e0 0x7f96780b77a0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f967c005fd0 tx=0x7f967c005e20 comp rx=0 tx=0).stop 2024-09-10T22:24:10.920 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:10.919+0000 7f96930dd640 1 -- 172.21.15.19:0/3733842714 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f968c1087d0 msgr2=0x7f968c1997a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:24:10.920 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:10.919+0000 7f96930dd640 1 --2- 172.21.15.19:0/3733842714 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f968c1087d0 0x7f968c1997a0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f967400e9f0 tx=0x7f967400eeb0 comp rx=0 tx=0).stop 2024-09-10T22:24:10.920 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:10.919+0000 7f96930dd640 1 -- 172.21.15.19:0/3733842714 shutdown_connections 2024-09-10T22:24:10.920 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:10.919+0000 7f96930dd640 1 --2- 172.21.15.19:0/3733842714 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f96780b52e0 0x7f96780b77a0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:24:10.920 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:10.919+0000 7f96930dd640 1 --2- 172.21.15.19:0/3733842714 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f968c109150 0x7f968c19eb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:24:10.921 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:10.919+0000 7f96930dd640 1 --2- 172.21.15.19:0/3733842714 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f968c1087d0 0x7f968c1997a0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:24:10.921 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:10.919+0000 7f96930dd640 1 --2- 172.21.15.19:0/3733842714 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f968c102dc0 0x7f968c199260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:24:10.921 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:10.919+0000 7f96930dd640 1 -- 172.21.15.19:0/3733842714 >> 172.21.15.19:0/3733842714 conn(0x7f968c0fe830 msgr2=0x7f968c0ff0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:24:10.921 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:10.919+0000 7f96930dd640 1 -- 172.21.15.19:0/3733842714 shutdown_connections 2024-09-10T22:24:10.921 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:10.919+0000 7f96930dd640 1 -- 172.21.15.19:0/3733842714 wait complete. 2024-09-10T22:24:11.125 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:24:10 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:24:11.125 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:24:10 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:24:11.125 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:24:10 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:24:11.125 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:24:10 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-10T22:24:11.125 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:24:10 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-10T22:24:11.126 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:24:10 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T22:24:11.126 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:24:10 smithi138 ceph-mon[35236]: Deploying daemon mds.b on smithi135 2024-09-10T22:24:11.126 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:24:10 smithi138 ceph-mon[35236]: mds.? [v2:172.21.15.19:6840/2449948682,v1:172.21.15.19:6841/2449948682] up:boot 2024-09-10T22:24:11.126 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:24:10 smithi138 ceph-mon[35236]: fsmap 11 up:standby 2024-09-10T22:24:11.126 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:24:10 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "a"} : dispatch 2024-09-10T22:24:11.209 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:24:10 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:24:11.209 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:24:10 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:24:11.209 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:24:10 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:24:11.209 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:24:10 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-10T22:24:11.209 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:24:10 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-10T22:24:11.209 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:24:10 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T22:24:11.209 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:24:10 smithi019 ceph-mon[31375]: Deploying daemon mds.b on smithi135 2024-09-10T22:24:11.209 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:24:10 smithi019 ceph-mon[31375]: mds.? [v2:172.21.15.19:6840/2449948682,v1:172.21.15.19:6841/2449948682] up:boot 2024-09-10T22:24:11.209 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:24:10 smithi019 ceph-mon[31375]: fsmap 11 up:standby 2024-09-10T22:24:11.209 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:24:10 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "a"} : dispatch 2024-09-10T22:24:11.306 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:24:10 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:24:11.307 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:24:10 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:24:11.307 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:24:10 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:24:11.307 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:24:10 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-10T22:24:11.307 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:24:10 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-10T22:24:11.307 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:24:10 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T22:24:11.307 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:24:10 smithi135 ceph-mon[34789]: Deploying daemon mds.b on smithi135 2024-09-10T22:24:11.307 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:24:10 smithi135 ceph-mon[34789]: mds.? [v2:172.21.15.19:6840/2449948682,v1:172.21.15.19:6841/2449948682] up:boot 2024-09-10T22:24:11.307 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:24:10 smithi135 ceph-mon[34789]: fsmap 11 up:standby 2024-09-10T22:24:11.307 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:24:10 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "a"} : dispatch 2024-09-10T22:24:12.100 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:24:11 smithi135 ceph-mon[34789]: pgmap v271: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T22:24:12.100 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:24:11 smithi135 ceph-mon[34789]: from='client.? 172.21.15.19:0/3733842714' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T22:24:12.101 INFO:journalctl@ceph.mds.b.smithi135.stdout:Sep 10 22:24:11 smithi135 systemd[1]: Starting Ceph mds.b for 22997a4c-6fc2-11ef-bcea-c7b262605968... 2024-09-10T22:24:12.209 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:24:11 smithi019 ceph-mon[31375]: pgmap v271: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T22:24:12.209 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:24:11 smithi019 ceph-mon[31375]: from='client.? 172.21.15.19:0/3733842714' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T22:24:12.359 INFO:journalctl@ceph.mds.b.smithi135.stdout:Sep 10 22:24:12 smithi135 podman[65164]: 2024-09-10 22:24:12.001572915 +0000 UTC m=+0.016403960 image pull 589dd18248e494ba411dc838aa4ae0e5e569213f08fcd7a2cf22cd3ef7e3c480 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e 2024-09-10T22:24:12.360 INFO:journalctl@ceph.mds.b.smithi135.stdout:Sep 10 22:24:12 smithi135 podman[65164]: 2024-09-10 22:24:12.13031016 +0000 UTC m=+0.145141194 container create 6fb2e6fcd715f519b8092a026d9591e37a7e6e3153a402fc52d06b1e98c36ba3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-mds-b, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, io.buildah.version=1.37.2, ceph=True, org.label-schema.vendor=CentOS) 2024-09-10T22:24:12.374 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:24:11 smithi138 ceph-mon[35236]: pgmap v271: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T22:24:12.375 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:24:11 smithi138 ceph-mon[35236]: from='client.? 172.21.15.19:0/3733842714' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T22:24:12.860 INFO:journalctl@ceph.mds.b.smithi135.stdout:Sep 10 22:24:12 smithi135 podman[65164]: 2024-09-10 22:24:12.38336088 +0000 UTC m=+0.398191910 container init 6fb2e6fcd715f519b8092a026d9591e37a7e6e3153a402fc52d06b1e98c36ba3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-mds-b, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, GIT_BRANCH=HEAD, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux ) 2024-09-10T22:24:12.860 INFO:journalctl@ceph.mds.b.smithi135.stdout:Sep 10 22:24:12 smithi135 podman[65164]: 2024-09-10 22:24:12.386426936 +0000 UTC m=+0.401257968 container start 6fb2e6fcd715f519b8092a026d9591e37a7e6e3153a402fc52d06b1e98c36ba3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-mds-b, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_BRANCH=HEAD, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.build-date=20240731) 2024-09-10T22:24:12.860 INFO:journalctl@ceph.mds.b.smithi135.stdout:Sep 10 22:24:12 smithi135 ceph-mds[65183]: -- 172.21.15.135:0/1320648775 <== mon.2 v2:172.21.15.135:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55952bdd9860 con 0x55952bdb6800 2024-09-10T22:24:12.860 INFO:journalctl@ceph.mds.b.smithi135.stdout:Sep 10 22:24:12 smithi135 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-mds-b[65179]: starting mds.b at 2024-09-10T22:24:12.860 INFO:journalctl@ceph.mds.b.smithi135.stdout:Sep 10 22:24:12 smithi135 bash[65164]: 6fb2e6fcd715f519b8092a026d9591e37a7e6e3153a402fc52d06b1e98c36ba3 2024-09-10T22:24:12.860 INFO:journalctl@ceph.mds.b.smithi135.stdout:Sep 10 22:24:12 smithi135 systemd[1]: Started Ceph mds.b for 22997a4c-6fc2-11ef-bcea-c7b262605968. 2024-09-10T22:24:13.504 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 22997a4c-6fc2-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-10T22:24:13.625 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:24:13 smithi138 ceph-mon[35236]: pgmap v272: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T22:24:13.625 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:24:13 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:24:13.625 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:24:13 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:24:13.625 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:24:13 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:24:13.625 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:24:13 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:24:13.625 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:24:13 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:24:13.625 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:24:13 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T22:24:13.626 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:24:13 smithi138 ceph-mon[35236]: mds.? [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] up:boot 2024-09-10T22:24:13.626 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:24:13 smithi138 ceph-mon[35236]: fsmap 12 up:standby 2024-09-10T22:24:13.626 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:24:13 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "b"} : dispatch 2024-09-10T22:24:13.776 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/22997a4c-6fc2-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T22:24:13.860 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:24:13 smithi135 ceph-mon[34789]: pgmap v272: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T22:24:13.860 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:24:13 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:24:13.860 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:24:13 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:24:13.860 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:24:13 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:24:13.860 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:24:13 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:24:13.860 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:24:13 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:24:13.860 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:24:13 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T22:24:13.860 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:24:13 smithi135 ceph-mon[34789]: mds.? [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] up:boot 2024-09-10T22:24:13.861 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:24:13 smithi135 ceph-mon[34789]: fsmap 12 up:standby 2024-09-10T22:24:13.861 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:24:13 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "b"} : dispatch 2024-09-10T22:24:13.900 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:24:13 smithi019 ceph-mon[31375]: pgmap v272: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T22:24:13.900 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:24:13 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:24:13.900 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:24:13 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:24:13.900 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:24:13 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:24:13.900 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:24:13 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:24:13.900 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:24:13 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:24:13.900 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:24:13 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T22:24:13.901 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:24:13 smithi019 ceph-mon[31375]: mds.? [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] up:boot 2024-09-10T22:24:13.901 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:24:13 smithi019 ceph-mon[31375]: fsmap 12 up:standby 2024-09-10T22:24:13.901 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:24:13 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "b"} : dispatch 2024-09-10T22:24:14.363 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:14.336+0000 7f70f12b1640 1 -- 172.21.15.19:0/54673124 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f70ec109150 msgr2=0x7f70ec10f950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:24:14.363 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:14.336+0000 7f70f12b1640 1 --2- 172.21.15.19:0/54673124 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f70ec109150 0x7f70ec10f950 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f70e4009ca0 tx=0x7f70e402a8c0 comp rx=0 tx=0).stop 2024-09-10T22:24:14.363 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:14.336+0000 7f70f12b1640 1 -- 172.21.15.19:0/54673124 shutdown_connections 2024-09-10T22:24:14.363 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:14.336+0000 7f70f12b1640 1 --2- 172.21.15.19:0/54673124 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f70ec109150 0x7f70ec10f950 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:24:14.363 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:14.336+0000 7f70f12b1640 1 --2- 172.21.15.19:0/54673124 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f70ec1087d0 0x7f70ec108c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:24:14.363 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:14.336+0000 7f70f12b1640 1 --2- 172.21.15.19:0/54673124 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f70ec102dc0 0x7f70ec1031a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:24:14.363 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:14.336+0000 7f70f12b1640 1 -- 172.21.15.19:0/54673124 >> 172.21.15.19:0/54673124 conn(0x7f70ec0fe830 msgr2=0x7f70ec100c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:24:14.364 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:14.337+0000 7f70f12b1640 1 -- 172.21.15.19:0/54673124 shutdown_connections 2024-09-10T22:24:14.364 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:14.337+0000 7f70f12b1640 1 -- 172.21.15.19:0/54673124 wait complete. 2024-09-10T22:24:14.364 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:14.337+0000 7f70f12b1640 1 Processor -- start 2024-09-10T22:24:14.364 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:14.337+0000 7f70f12b1640 1 -- start start 2024-09-10T22:24:14.364 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:14.338+0000 7f70f12b1640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f70ec102dc0 0x7f70ec199260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:24:14.364 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:14.338+0000 7f70f12b1640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f70ec1087d0 0x7f70ec1997a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:24:14.364 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:14.338+0000 7f70f12b1640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f70ec109150 0x7f70ec19eb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:24:14.364 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:14.338+0000 7f70f12b1640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f70ec112dd0 con 0x7f70ec109150 2024-09-10T22:24:14.364 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:14.338+0000 7f70f12b1640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f70ec112c50 con 0x7f70ec102dc0 2024-09-10T22:24:14.364 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:14.338+0000 7f70f12b1640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f70ec112f50 con 0x7f70ec1087d0 2024-09-10T22:24:14.364 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:14.338+0000 7f70eb7fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f70ec109150 0x7f70ec19eb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:24:14.364 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:14.338+0000 7f70eb7fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f70ec109150 0x7f70ec19eb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:47878/0 (socket says 172.21.15.19:47878) 2024-09-10T22:24:14.365 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:14.338+0000 7f70eb7fe640 1 -- 172.21.15.19:0/1974344468 learned_addr learned my addr 172.21.15.19:0/1974344468 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:24:14.365 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:14.338+0000 7f70ea7fc640 1 --2- 172.21.15.19:0/1974344468 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f70ec1087d0 0x7f70ec1997a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:24:14.365 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:14.338+0000 7f70eaffd640 1 --2- 172.21.15.19:0/1974344468 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f70ec102dc0 0x7f70ec199260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:24:14.365 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:14.338+0000 7f70eb7fe640 1 -- 172.21.15.19:0/1974344468 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f70ec1087d0 msgr2=0x7f70ec1997a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:24:14.365 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:14.338+0000 7f70eb7fe640 1 --2- 172.21.15.19:0/1974344468 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f70ec1087d0 0x7f70ec1997a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:24:14.365 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:14.338+0000 7f70eb7fe640 1 -- 172.21.15.19:0/1974344468 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f70ec102dc0 msgr2=0x7f70ec199260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:24:14.365 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:14.338+0000 7f70eb7fe640 1 --2- 172.21.15.19:0/1974344468 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f70ec102dc0 0x7f70ec199260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:24:14.365 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:14.338+0000 7f70eb7fe640 1 -- 172.21.15.19:0/1974344468 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f70ec19f310 con 0x7f70ec109150 2024-09-10T22:24:14.365 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:14.338+0000 7f70eb7fe640 1 --2- 172.21.15.19:0/1974344468 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f70ec109150 0x7f70ec19eb40 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f70e4005cc0 tx=0x7f70e402f380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:24:14.365 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:14.339+0000 7f70d3fff640 1 -- 172.21.15.19:0/1974344468 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70e4003bf0 con 0x7f70ec109150 2024-09-10T22:24:14.365 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:14.339+0000 7f70f12b1640 1 -- 172.21.15.19:0/1974344468 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f70ec19f5a0 con 0x7f70ec109150 2024-09-10T22:24:14.365 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:14.339+0000 7f70d3fff640 1 -- 172.21.15.19:0/1974344468 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f70e4003d90 con 0x7f70ec109150 2024-09-10T22:24:14.365 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:14.339+0000 7f70d3fff640 1 -- 172.21.15.19:0/1974344468 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70e402fbc0 con 0x7f70ec109150 2024-09-10T22:24:14.366 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:14.339+0000 7f70f12b1640 1 -- 172.21.15.19:0/1974344468 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f70ec1a5cc0 con 0x7f70ec109150 2024-09-10T22:24:14.366 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:14.340+0000 7f70f12b1640 1 -- 172.21.15.19:0/1974344468 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f70ec1031a0 con 0x7f70ec109150 2024-09-10T22:24:14.366 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:14.342+0000 7f70d3fff640 1 -- 172.21.15.19:0/1974344468 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 16) ==== 153250+0+0 (secure 0 0 0) 0x7f70e4004610 con 0x7f70ec109150 2024-09-10T22:24:14.366 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:14.343+0000 7f70d3fff640 1 --2- 172.21.15.19:0/1974344468 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f70d40b52e0 0x7f70d40b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:24:14.366 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:14.343+0000 7f70eaffd640 1 --2- 172.21.15.19:0/1974344468 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f70d40b52e0 0x7f70d40b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:24:14.366 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:14.343+0000 7f70d3fff640 1 -- 172.21.15.19:0/1974344468 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(68..68 src has 1..68) ==== 7127+0+0 (secure 0 0 0) 0x7f70e4106da0 con 0x7f70ec109150 2024-09-10T22:24:14.366 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:14.343+0000 7f70eaffd640 1 --2- 172.21.15.19:0/1974344468 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f70d40b52e0 0x7f70d40b77a0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f70dc005fd0 tx=0x7f70dc005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:24:14.366 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:14.346+0000 7f70d3fff640 1 -- 172.21.15.19:0/1974344468 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f70e40ce100 con 0x7f70ec109150 2024-09-10T22:24:14.585 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:14.582+0000 7f70f12b1640 1 -- 172.21.15.19:0/1974344468 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f70ec02e5c0 con 0x7f70ec109150 2024-09-10T22:24:14.585 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:14.583+0000 7f70d3fff640 1 -- 172.21.15.19:0/1974344468 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 13 v13) ==== 94+0+10533 (secure 0 0 0) 0x7f70e40cda00 con 0x7f70ec109150 2024-09-10T22:24:14.586 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-10T22:24:14.586 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":13,"btime":"2024-09-10T22:24:12:879344+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14673,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6835/1835804747","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6834","nonce":1835804747},{"type":"v1","addr":"172.21.15.19:6835","nonce":1835804747}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14685,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6837/1750470490","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6836","nonce":1750470490},{"type":"v1","addr":"172.21.15.19:6837","nonce":1750470490}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14733,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6839/2642941149","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6838","nonce":2642941149},{"type":"v1","addr":"172.21.15.19:6839","nonce":2642941149}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14745,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6841/2449948682","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6840","nonce":2449948682},{"type":"v1","addr":"172.21.15.19:6841","nonce":2449948682}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24511,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.138:6833/2524811494","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6832","nonce":2524811494},{"type":"v1","addr":"172.21.15.138:6833","nonce":2524811494}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24512,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6833/3014993624","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6832","nonce":3014993624},{"type":"v1","addr":"172.21.15.135:6833","nonce":3014993624}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24527,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6835/3715773348","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6834","nonce":3715773348},{"type":"v1","addr":"172.21.15.135:6835","nonce":3715773348}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24541,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.138:6835/933547028","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6834","nonce":933547028},{"type":"v1","addr":"172.21.15.138:6835","nonce":933547028}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24551,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6837/3495029135","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6836","nonce":3495029135},{"type":"v1","addr":"172.21.15.135:6837","nonce":3495029135}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24553,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.138:6837/3353290042","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6836","nonce":3353290042},{"type":"v1","addr":"172.21.15.138:6837","nonce":3353290042}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24568,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.138:6839/383637208","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6838","nonce":383637208},{"type":"v1","addr":"172.21.15.138:6839","nonce":383637208}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":24581,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6839/1254769802","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6838","nonce":1254769802},{"type":"v1","addr":"172.21.15.135:6839","nonce":1254769802}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13}],"filesystems":[]} 2024-09-10T22:24:14.586 INFO:teuthology.orchestra.run.smithi019.stderr:dumped fsmap epoch 13 2024-09-10T22:24:14.589 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:14.586+0000 7f70f12b1640 1 -- 172.21.15.19:0/1974344468 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f70d40b52e0 msgr2=0x7f70d40b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:24:14.589 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:14.586+0000 7f70f12b1640 1 --2- 172.21.15.19:0/1974344468 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f70d40b52e0 0x7f70d40b77a0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f70dc005fd0 tx=0x7f70dc005850 comp rx=0 tx=0).stop 2024-09-10T22:24:14.589 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:14.586+0000 7f70f12b1640 1 -- 172.21.15.19:0/1974344468 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f70ec109150 msgr2=0x7f70ec19eb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:24:14.589 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:14.586+0000 7f70f12b1640 1 --2- 172.21.15.19:0/1974344468 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f70ec109150 0x7f70ec19eb40 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f70e4005cc0 tx=0x7f70e402f380 comp rx=0 tx=0).stop 2024-09-10T22:24:14.589 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:14.586+0000 7f70f12b1640 1 -- 172.21.15.19:0/1974344468 shutdown_connections 2024-09-10T22:24:14.589 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:14.586+0000 7f70f12b1640 1 --2- 172.21.15.19:0/1974344468 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f70d40b52e0 0x7f70d40b77a0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:24:14.589 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:14.586+0000 7f70f12b1640 1 --2- 172.21.15.19:0/1974344468 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f70ec109150 0x7f70ec19eb40 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:24:14.589 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:14.586+0000 7f70f12b1640 1 --2- 172.21.15.19:0/1974344468 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f70ec1087d0 0x7f70ec1997a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:24:14.589 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:14.586+0000 7f70f12b1640 1 --2- 172.21.15.19:0/1974344468 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f70ec102dc0 0x7f70ec199260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:24:14.589 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:14.586+0000 7f70f12b1640 1 -- 172.21.15.19:0/1974344468 >> 172.21.15.19:0/1974344468 conn(0x7f70ec0fe830 msgr2=0x7f70ec100c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:24:14.589 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:14.587+0000 7f70f12b1640 1 -- 172.21.15.19:0/1974344468 shutdown_connections 2024-09-10T22:24:14.590 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:14.587+0000 7f70f12b1640 1 -- 172.21.15.19:0/1974344468 wait complete. 2024-09-10T22:24:15.360 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:24:15 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:24:15.360 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:24:15 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:24:15.360 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:24:15 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:24:15.360 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:24:15 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:24:15.360 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:24:15 smithi135 ceph-mon[34789]: from='client.? 172.21.15.19:0/1974344468' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T22:24:15.360 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:24:15 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:24:15.375 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:24:15 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:24:15.375 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:24:15 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:24:15.375 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:24:15 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:24:15.375 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:24:15 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:24:15.375 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:24:15 smithi138 ceph-mon[35236]: from='client.? 172.21.15.19:0/1974344468' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T22:24:15.375 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:24:15 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:24:15.458 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:24:15 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:24:15.458 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:24:15 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:24:15.458 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:24:15 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:24:15.459 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:24:15 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:24:15.459 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:24:15 smithi019 ceph-mon[31375]: from='client.? 172.21.15.19:0/1974344468' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T22:24:15.459 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:24:15 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:24:15.520 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 22997a4c-6fc2-11ef-bcea-c7b262605968 -- ceph --format=json-pretty osd lspools 2024-09-10T22:24:15.796 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/22997a4c-6fc2-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T22:24:16.171 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:24:16 smithi019 ceph-mon[31375]: pgmap v273: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T22:24:16.171 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:24:16 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:24:16.171 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:24:16 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:24:16.289 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:16.257+0000 7f5114d21640 1 -- 172.21.15.19:0/4213188102 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5110101cb0 msgr2=0x7f5110102090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:24:16.289 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:16.257+0000 7f5114d21640 1 --2- 172.21.15.19:0/4213188102 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5110101cb0 0x7f5110102090 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f5100009ca0 tx=0x7f510002a8c0 comp rx=0 tx=0).stop 2024-09-10T22:24:16.289 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:16.258+0000 7f5114d21640 1 -- 172.21.15.19:0/4213188102 shutdown_connections 2024-09-10T22:24:16.289 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:16.258+0000 7f5114d21640 1 --2- 172.21.15.19:0/4213188102 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5110108040 0x7f511010e840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:24:16.289 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:16.258+0000 7f5114d21640 1 --2- 172.21.15.19:0/4213188102 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f51101076c0 0x7f5110107b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:24:16.290 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:16.258+0000 7f5114d21640 1 --2- 172.21.15.19:0/4213188102 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5110101cb0 0x7f5110102090 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:24:16.290 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:16.258+0000 7f5114d21640 1 -- 172.21.15.19:0/4213188102 >> 172.21.15.19:0/4213188102 conn(0x7f51100fd700 msgr2=0x7f51100ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:24:16.290 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:16.258+0000 7f5114d21640 1 -- 172.21.15.19:0/4213188102 shutdown_connections 2024-09-10T22:24:16.290 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:16.258+0000 7f5114d21640 1 -- 172.21.15.19:0/4213188102 wait complete. 2024-09-10T22:24:16.290 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:16.258+0000 7f5114d21640 1 Processor -- start 2024-09-10T22:24:16.290 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:16.258+0000 7f5114d21640 1 -- start start 2024-09-10T22:24:16.290 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:16.259+0000 7f5114d21640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5110101cb0 0x7f5110199200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:24:16.290 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:16.259+0000 7f5114d21640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f51101076c0 0x7f5110199740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:24:16.290 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:16.259+0000 7f5114d21640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5110108040 0x7f511019eae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:24:16.290 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:16.259+0000 7f5114d21640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f5110112e10 con 0x7f5110101cb0 2024-09-10T22:24:16.290 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:16.259+0000 7f5114d21640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f5110112c90 con 0x7f5110108040 2024-09-10T22:24:16.290 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:16.259+0000 7f5114d21640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f5110112f90 con 0x7f51101076c0 2024-09-10T22:24:16.290 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:16.259+0000 7f510e59c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5110101cb0 0x7f5110199200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:24:16.291 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:16.259+0000 7f510e59c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5110101cb0 0x7f5110199200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:47902/0 (socket says 172.21.15.19:47902) 2024-09-10T22:24:16.291 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:16.259+0000 7f510e59c640 1 -- 172.21.15.19:0/2604310664 learned_addr learned my addr 172.21.15.19:0/2604310664 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:24:16.291 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:16.259+0000 7f510dd9b640 1 --2- 172.21.15.19:0/2604310664 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f51101076c0 0x7f5110199740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:24:16.291 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:16.259+0000 7f510ed9d640 1 --2- 172.21.15.19:0/2604310664 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5110108040 0x7f511019eae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:24:16.291 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:16.259+0000 7f510e59c640 1 -- 172.21.15.19:0/2604310664 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f51101076c0 msgr2=0x7f5110199740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:24:16.291 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:16.259+0000 7f510e59c640 1 --2- 172.21.15.19:0/2604310664 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f51101076c0 0x7f5110199740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:24:16.291 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:16.259+0000 7f510e59c640 1 -- 172.21.15.19:0/2604310664 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5110108040 msgr2=0x7f511019eae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:24:16.291 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:16.259+0000 7f510e59c640 1 --2- 172.21.15.19:0/2604310664 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5110108040 0x7f511019eae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:24:16.291 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:16.259+0000 7f510e59c640 1 -- 172.21.15.19:0/2604310664 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f511019f2b0 con 0x7f5110101cb0 2024-09-10T22:24:16.291 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:16.259+0000 7f510dd9b640 1 --2- 172.21.15.19:0/2604310664 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f51101076c0 0x7f5110199740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T22:24:16.291 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:16.259+0000 7f510e59c640 1 --2- 172.21.15.19:0/2604310664 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5110101cb0 0x7f5110199200 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f5100005e30 tx=0x7f510002f3e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:24:16.291 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:16.259+0000 7f51077fe640 1 -- 172.21.15.19:0/2604310664 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5100003bf0 con 0x7f5110101cb0 2024-09-10T22:24:16.291 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:16.260+0000 7f5114d21640 1 -- 172.21.15.19:0/2604310664 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f511019f540 con 0x7f5110101cb0 2024-09-10T22:24:16.292 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:16.260+0000 7f51077fe640 1 -- 172.21.15.19:0/2604310664 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5100003d90 con 0x7f5110101cb0 2024-09-10T22:24:16.292 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:16.260+0000 7f51077fe640 1 -- 172.21.15.19:0/2604310664 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f510002fb10 con 0x7f5110101cb0 2024-09-10T22:24:16.292 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:16.260+0000 7f5114d21640 1 -- 172.21.15.19:0/2604310664 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f51101a5c60 con 0x7f5110101cb0 2024-09-10T22:24:16.292 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:16.261+0000 7f5114d21640 1 -- 172.21.15.19:0/2604310664 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5110102090 con 0x7f5110101cb0 2024-09-10T22:24:16.292 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:16.263+0000 7f51077fe640 1 -- 172.21.15.19:0/2604310664 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 16) ==== 153250+0+0 (secure 0 0 0) 0x7f5100004680 con 0x7f5110101cb0 2024-09-10T22:24:16.292 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:16.264+0000 7f51077fe640 1 --2- 172.21.15.19:0/2604310664 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f50fc0b52e0 0x7f50fc0b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:24:16.292 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:16.264+0000 7f510dd9b640 1 --2- 172.21.15.19:0/2604310664 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f50fc0b52e0 0x7f50fc0b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:24:16.292 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:16.264+0000 7f51077fe640 1 -- 172.21.15.19:0/2604310664 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(68..68 src has 1..68) ==== 7127+0+0 (secure 0 0 0) 0x7f5100106d00 con 0x7f5110101cb0 2024-09-10T22:24:16.292 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:16.264+0000 7f510dd9b640 1 --2- 172.21.15.19:0/2604310664 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f50fc0b52e0 0x7f50fc0b77a0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f51101072e0 tx=0x7f50f800a5c0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:24:16.292 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:16.267+0000 7f51077fe640 1 -- 172.21.15.19:0/2604310664 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f51000cdfc0 con 0x7f5110101cb0 2024-09-10T22:24:16.359 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:24:16 smithi135 ceph-mon[34789]: pgmap v273: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T22:24:16.360 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:24:16 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:24:16.360 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:24:16 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:24:16.374 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:24:16 smithi138 ceph-mon[35236]: pgmap v273: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T22:24:16.375 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:24:16 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:24:16.375 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:24:16 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:24:16.470 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:16.468+0000 7f5114d21640 1 -- 172.21.15.19:0/2604310664 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7f511019a330 con 0x7f5110101cb0 2024-09-10T22:24:16.471 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:16.468+0000 7f51077fe640 1 -- 172.21.15.19:0/2604310664 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v68) ==== 84+0+65 (secure 0 0 0) 0x7f51000cd8c0 con 0x7f5110101cb0 2024-09-10T22:24:16.471 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-10T22:24:16.471 INFO:teuthology.orchestra.run.smithi019.stdout:[ 2024-09-10T22:24:16.471 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-10T22:24:16.471 INFO:teuthology.orchestra.run.smithi019.stdout: "poolnum": 1, 2024-09-10T22:24:16.471 INFO:teuthology.orchestra.run.smithi019.stdout: "poolname": ".mgr" 2024-09-10T22:24:16.471 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-10T22:24:16.471 INFO:teuthology.orchestra.run.smithi019.stdout:] 2024-09-10T22:24:16.474 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:16.471+0000 7f5114d21640 1 -- 172.21.15.19:0/2604310664 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f50fc0b52e0 msgr2=0x7f50fc0b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:24:16.474 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:16.471+0000 7f5114d21640 1 --2- 172.21.15.19:0/2604310664 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f50fc0b52e0 0x7f50fc0b77a0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f51101072e0 tx=0x7f50f800a5c0 comp rx=0 tx=0).stop 2024-09-10T22:24:16.474 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:16.471+0000 7f5114d21640 1 -- 172.21.15.19:0/2604310664 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5110101cb0 msgr2=0x7f5110199200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:24:16.474 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:16.471+0000 7f5114d21640 1 --2- 172.21.15.19:0/2604310664 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5110101cb0 0x7f5110199200 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f5100005e30 tx=0x7f510002f3e0 comp rx=0 tx=0).stop 2024-09-10T22:24:16.474 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:16.471+0000 7f5114d21640 1 -- 172.21.15.19:0/2604310664 shutdown_connections 2024-09-10T22:24:16.474 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:16.471+0000 7f5114d21640 1 --2- 172.21.15.19:0/2604310664 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f50fc0b52e0 0x7f50fc0b77a0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:24:16.474 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:16.471+0000 7f5114d21640 1 --2- 172.21.15.19:0/2604310664 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5110108040 0x7f511019eae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:24:16.474 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:16.471+0000 7f5114d21640 1 --2- 172.21.15.19:0/2604310664 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f51101076c0 0x7f5110199740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:24:16.474 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:16.471+0000 7f5114d21640 1 --2- 172.21.15.19:0/2604310664 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5110101cb0 0x7f5110199200 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:24:16.474 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:16.471+0000 7f5114d21640 1 -- 172.21.15.19:0/2604310664 >> 172.21.15.19:0/2604310664 conn(0x7f51100fd700 msgr2=0x7f51100ffaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:24:16.475 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:16.471+0000 7f5114d21640 1 -- 172.21.15.19:0/2604310664 shutdown_connections 2024-09-10T22:24:16.475 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:16.471+0000 7f5114d21640 1 -- 172.21.15.19:0/2604310664 wait complete. 2024-09-10T22:24:17.140 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:24:17 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T22:24:17.140 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:24:17 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T22:24:17.140 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:24:17 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:24:17.140 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:24:17 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T22:24:17.140 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:24:17 smithi138 ceph-mon[35236]: from='client.? 172.21.15.19:0/2604310664' entity='client.admin' cmd={"prefix": "osd lspools", "format": "json-pretty"} : dispatch 2024-09-10T22:24:17.171 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-10T22:24:17.171 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 22997a4c-6fc2-11ef-bcea-c7b262605968 -- ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-10T22:24:17.197 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:24:17 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T22:24:17.197 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:24:17 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T22:24:17.197 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:24:17 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:24:17.197 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:24:17 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T22:24:17.197 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:24:17 smithi019 ceph-mon[31375]: from='client.? 172.21.15.19:0/2604310664' entity='client.admin' cmd={"prefix": "osd lspools", "format": "json-pretty"} : dispatch 2024-09-10T22:24:17.360 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:24:17 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T22:24:17.360 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:24:17 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T22:24:17.360 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:24:17 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:24:17.360 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:24:17 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T22:24:17.360 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:24:17 smithi135 ceph-mon[34789]: from='client.? 172.21.15.19:0/2604310664' entity='client.admin' cmd={"prefix": "osd lspools", "format": "json-pretty"} : dispatch 2024-09-10T22:24:18.081 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/22997a4c-6fc2-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T22:24:18.359 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:24:18 smithi135 ceph-mon[34789]: pgmap v274: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T22:24:18.360 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:24:18 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:24:18.360 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:24:18 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:24:18.360 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:24:18 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:24:18.360 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:24:18 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:24:18.375 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:24:18 smithi138 ceph-mon[35236]: pgmap v274: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T22:24:18.375 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:24:18 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:24:18.375 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:24:18 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:24:18.375 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:24:18 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:24:18.375 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:24:18 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:24:18.448 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:24:18 smithi019 ceph-mon[31375]: pgmap v274: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T22:24:18.448 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:24:18 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:24:18.448 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:24:18 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:24:18.449 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:24:18 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:24:18.449 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:24:18 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:24:18.535 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:18.532+0000 7f5e957dc640 1 -- 172.21.15.19:0/4040738308 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5e901023f0 msgr2=0x7f5e901068c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:24:18.536 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:18.532+0000 7f5e957dc640 1 --2- 172.21.15.19:0/4040738308 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5e901023f0 0x7f5e901068c0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f5e78009900 tx=0x7f5e7802a410 comp rx=0 tx=0).stop 2024-09-10T22:24:18.536 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:18.532+0000 7f5e957dc640 1 -- 172.21.15.19:0/4040738308 shutdown_connections 2024-09-10T22:24:18.536 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:18.532+0000 7f5e957dc640 1 --2- 172.21.15.19:0/4040738308 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5e90106f10 0x7f5e90107360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:24:18.536 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:18.532+0000 7f5e957dc640 1 --2- 172.21.15.19:0/4040738308 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5e901023f0 0x7f5e901068c0 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:24:18.536 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:18.532+0000 7f5e957dc640 1 --2- 172.21.15.19:0/4040738308 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5e90101ad0 0x7f5e90101eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:24:18.536 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:18.532+0000 7f5e957dc640 1 -- 172.21.15.19:0/4040738308 >> 172.21.15.19:0/4040738308 conn(0x7f5e900fd700 msgr2=0x7f5e900ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:24:18.536 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:18.532+0000 7f5e957dc640 1 -- 172.21.15.19:0/4040738308 shutdown_connections 2024-09-10T22:24:18.536 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:18.532+0000 7f5e957dc640 1 -- 172.21.15.19:0/4040738308 wait complete. 2024-09-10T22:24:18.536 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:18.532+0000 7f5e957dc640 1 Processor -- start 2024-09-10T22:24:18.536 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:18.533+0000 7f5e957dc640 1 -- start start 2024-09-10T22:24:18.536 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:18.533+0000 7f5e957dc640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5e90101ad0 0x7f5e9019f890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:24:18.537 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:18.533+0000 7f5e957dc640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5e901023f0 0x7f5e9019fdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:24:18.537 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:18.533+0000 7f5e957dc640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5e90106f10 0x7f5e901a5170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:24:18.537 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:18.533+0000 7f5e957dc640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f5e90119380 con 0x7f5e90106f10 2024-09-10T22:24:18.537 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:18.533+0000 7f5e957dc640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f5e90119200 con 0x7f5e90101ad0 2024-09-10T22:24:18.537 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:18.533+0000 7f5e957dc640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f5e90119500 con 0x7f5e901023f0 2024-09-10T22:24:18.537 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:18.533+0000 7f5e8f7fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5e90106f10 0x7f5e901a5170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:24:18.537 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:18.533+0000 7f5e8f7fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5e90106f10 0x7f5e901a5170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:47912/0 (socket says 172.21.15.19:47912) 2024-09-10T22:24:18.537 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:18.533+0000 7f5e8f7fe640 1 -- 172.21.15.19:0/117874407 learned_addr learned my addr 172.21.15.19:0/117874407 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:24:18.537 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:18.533+0000 7f5e8effd640 1 --2- 172.21.15.19:0/117874407 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5e90101ad0 0x7f5e9019f890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:24:18.537 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:18.533+0000 7f5e8e7fc640 1 --2- 172.21.15.19:0/117874407 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5e901023f0 0x7f5e9019fdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:24:18.537 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:18.533+0000 7f5e8f7fe640 1 -- 172.21.15.19:0/117874407 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5e901023f0 msgr2=0x7f5e9019fdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:24:18.537 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:18.533+0000 7f5e8f7fe640 1 --2- 172.21.15.19:0/117874407 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5e901023f0 0x7f5e9019fdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:24:18.537 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:18.533+0000 7f5e8f7fe640 1 -- 172.21.15.19:0/117874407 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5e90101ad0 msgr2=0x7f5e9019f890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:24:18.538 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:18.533+0000 7f5e8f7fe640 1 --2- 172.21.15.19:0/117874407 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5e90101ad0 0x7f5e9019f890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:24:18.538 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:18.533+0000 7f5e8f7fe640 1 -- 172.21.15.19:0/117874407 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5e901a5940 con 0x7f5e90106f10 2024-09-10T22:24:18.540 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:18.534+0000 7f5e8f7fe640 1 --2- 172.21.15.19:0/117874407 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5e90106f10 0x7f5e901a5170 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f5e8800e970 tx=0x7f5e8800ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:24:18.540 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:18.534+0000 7f5e87fff640 1 -- 172.21.15.19:0/117874407 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e8800ccc0 con 0x7f5e90106f10 2024-09-10T22:24:18.540 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:18.534+0000 7f5e957dc640 1 -- 172.21.15.19:0/117874407 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5e901a5c30 con 0x7f5e90106f10 2024-09-10T22:24:18.540 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:18.534+0000 7f5e87fff640 1 -- 172.21.15.19:0/117874407 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5e8800ce60 con 0x7f5e90106f10 2024-09-10T22:24:18.540 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:18.534+0000 7f5e87fff640 1 -- 172.21.15.19:0/117874407 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e88010430 con 0x7f5e90106f10 2024-09-10T22:24:18.540 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:18.534+0000 7f5e957dc640 1 -- 172.21.15.19:0/117874407 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5e901ac2f0 con 0x7f5e90106f10 2024-09-10T22:24:18.540 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:18.535+0000 7f5e957dc640 1 -- 172.21.15.19:0/117874407 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5e901068c0 con 0x7f5e90106f10 2024-09-10T22:24:18.540 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:18.536+0000 7f5e87fff640 1 -- 172.21.15.19:0/117874407 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 16) ==== 153250+0+0 (secure 0 0 0) 0x7f5e88004fb0 con 0x7f5e90106f10 2024-09-10T22:24:18.540 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:18.537+0000 7f5e87fff640 1 --2- 172.21.15.19:0/117874407 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f5e7c0b52e0 0x7f5e7c0b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:24:18.540 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:18.537+0000 7f5e8effd640 1 --2- 172.21.15.19:0/117874407 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f5e7c0b52e0 0x7f5e7c0b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:24:18.540 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:18.537+0000 7f5e87fff640 1 -- 172.21.15.19:0/117874407 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(68..68 src has 1..68) ==== 7127+0+0 (secure 0 0 0) 0x7f5e880e5d80 con 0x7f5e90106f10 2024-09-10T22:24:18.541 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:18.538+0000 7f5e8effd640 1 --2- 172.21.15.19:0/117874407 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f5e7c0b52e0 0x7f5e7c0b77a0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f5e80005fd0 tx=0x7f5e80009500 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:24:18.542 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:18.540+0000 7f5e87fff640 1 -- 172.21.15.19:0/117874407 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f5e88056220 con 0x7f5e90106f10 2024-09-10T22:24:18.736 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:18.734+0000 7f5e957dc640 1 -- 172.21.15.19:0/117874407 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7f5e901ac610 con 0x7f5e90106f10 2024-09-10T22:24:19.107 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:19.105+0000 7f5e87fff640 1 -- 172.21.15.19:0/117874407 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v69) ==== 138+0+0 (secure 0 0 0) 0x7f5e880ad040 con 0x7f5e90106f10 2024-09-10T22:24:19.107 INFO:teuthology.orchestra.run.smithi019.stderr:pool 'cephfs_metadata' created 2024-09-10T22:24:19.110 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:19.107+0000 7f5e957dc640 1 -- 172.21.15.19:0/117874407 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f5e7c0b52e0 msgr2=0x7f5e7c0b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:24:19.110 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:19.107+0000 7f5e957dc640 1 --2- 172.21.15.19:0/117874407 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f5e7c0b52e0 0x7f5e7c0b77a0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f5e80005fd0 tx=0x7f5e80009500 comp rx=0 tx=0).stop 2024-09-10T22:24:19.110 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:19.107+0000 7f5e957dc640 1 -- 172.21.15.19:0/117874407 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5e90106f10 msgr2=0x7f5e901a5170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:24:19.110 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:19.107+0000 7f5e957dc640 1 --2- 172.21.15.19:0/117874407 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5e90106f10 0x7f5e901a5170 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f5e8800e970 tx=0x7f5e8800ed70 comp rx=0 tx=0).stop 2024-09-10T22:24:19.110 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:19.107+0000 7f5e957dc640 1 -- 172.21.15.19:0/117874407 shutdown_connections 2024-09-10T22:24:19.110 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:19.107+0000 7f5e957dc640 1 --2- 172.21.15.19:0/117874407 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f5e7c0b52e0 0x7f5e7c0b77a0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:24:19.110 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:19.107+0000 7f5e957dc640 1 --2- 172.21.15.19:0/117874407 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5e90106f10 0x7f5e901a5170 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:24:19.110 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:19.107+0000 7f5e957dc640 1 --2- 172.21.15.19:0/117874407 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5e901023f0 0x7f5e9019fdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:24:19.110 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:19.107+0000 7f5e957dc640 1 --2- 172.21.15.19:0/117874407 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5e90101ad0 0x7f5e9019f890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:24:19.110 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:19.107+0000 7f5e957dc640 1 -- 172.21.15.19:0/117874407 >> 172.21.15.19:0/117874407 conn(0x7f5e900fd700 msgr2=0x7f5e90104800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:24:19.110 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:19.107+0000 7f5e957dc640 1 -- 172.21.15.19:0/117874407 shutdown_connections 2024-09-10T22:24:19.110 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:19.107+0000 7f5e957dc640 1 -- 172.21.15.19:0/117874407 wait complete. 2024-09-10T22:24:19.360 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:24:19 smithi135 ceph-mon[34789]: from='client.? 172.21.15.19:0/117874407' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} : dispatch 2024-09-10T22:24:19.360 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:24:19 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:24:19.360 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:24:19 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:24:19.360 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:24:19 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T22:24:19.360 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:24:19 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T22:24:19.360 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:24:19 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:24:19.375 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:24:19 smithi138 ceph-mon[35236]: from='client.? 172.21.15.19:0/117874407' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} : dispatch 2024-09-10T22:24:19.375 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:24:19 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:24:19.375 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:24:19 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:24:19.375 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:24:19 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T22:24:19.375 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:24:19 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T22:24:19.375 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:24:19 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:24:19.458 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:24:19 smithi019 ceph-mon[31375]: from='client.? 172.21.15.19:0/117874407' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} : dispatch 2024-09-10T22:24:19.458 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:24:19 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:24:19.459 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:24:19 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:24:19.459 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:24:19 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T22:24:19.459 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:24:19 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T22:24:19.459 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:24:19 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:24:19.803 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 22997a4c-6fc2-11ef-bcea-c7b262605968 -- ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-09-10T22:24:20.109 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/22997a4c-6fc2-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T22:24:20.360 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:24:20 smithi135 ceph-mon[34789]: pgmap v275: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T22:24:20.360 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:24:20 smithi135 ceph-mon[34789]: from='client.? 172.21.15.19:0/117874407' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2024-09-10T22:24:20.360 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:24:20 smithi135 ceph-mon[34789]: osdmap e69: 12 total, 12 up, 12 in 2024-09-10T22:24:20.366 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:24:20 smithi019 ceph-mon[31375]: pgmap v275: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T22:24:20.366 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:24:20 smithi019 ceph-mon[31375]: from='client.? 172.21.15.19:0/117874407' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2024-09-10T22:24:20.366 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:24:20 smithi019 ceph-mon[31375]: osdmap e69: 12 total, 12 up, 12 in 2024-09-10T22:24:20.374 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:24:20 smithi138 ceph-mon[35236]: pgmap v275: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T22:24:20.375 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:24:20 smithi138 ceph-mon[35236]: from='client.? 172.21.15.19:0/117874407' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2024-09-10T22:24:20.375 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:24:20 smithi138 ceph-mon[35236]: osdmap e69: 12 total, 12 up, 12 in 2024-09-10T22:24:20.595 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:20.593+0000 7f13755c1640 1 -- 172.21.15.19:0/2907991017 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f13701055a0 msgr2=0x7f1370105a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:24:20.595 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:20.593+0000 7f13755c1640 1 --2- 172.21.15.19:0/2907991017 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f13701055a0 0x7f1370105a00 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f1358009900 tx=0x7f135802a410 comp rx=0 tx=0).stop 2024-09-10T22:24:20.595 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:20.593+0000 7f13755c1640 1 -- 172.21.15.19:0/2907991017 shutdown_connections 2024-09-10T22:24:20.596 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:20.593+0000 7f13755c1640 1 --2- 172.21.15.19:0/2907991017 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f1370105f40 0x7f137010f960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:24:20.596 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:20.593+0000 7f13755c1640 1 --2- 172.21.15.19:0/2907991017 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f13701055a0 0x7f1370105a00 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:24:20.596 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:20.593+0000 7f13755c1640 1 --2- 172.21.15.19:0/2907991017 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1370101250 0x7f1370101630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:24:20.596 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:20.593+0000 7f13755c1640 1 -- 172.21.15.19:0/2907991017 >> 172.21.15.19:0/2907991017 conn(0x7f1370078140 msgr2=0x7f13700ff530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:24:20.596 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:20.593+0000 7f13755c1640 1 -- 172.21.15.19:0/2907991017 shutdown_connections 2024-09-10T22:24:20.596 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:20.593+0000 7f13755c1640 1 -- 172.21.15.19:0/2907991017 wait complete. 2024-09-10T22:24:20.596 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:20.593+0000 7f13755c1640 1 Processor -- start 2024-09-10T22:24:20.597 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:20.593+0000 7f13755c1640 1 -- start start 2024-09-10T22:24:20.597 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:20.594+0000 7f13755c1640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1370101250 0x7f13701992c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:24:20.598 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:20.594+0000 7f13755c1640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f13701055a0 0x7f1370199800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:24:20.598 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:20.594+0000 7f13755c1640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1370105f40 0x7f137019eba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:24:20.598 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:20.594+0000 7f13755c1640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f1370112db0 con 0x7f1370101250 2024-09-10T22:24:20.598 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:20.594+0000 7f13755c1640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f1370112c30 con 0x7f1370105f40 2024-09-10T22:24:20.598 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:20.594+0000 7f13755c1640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f1370112f30 con 0x7f13701055a0 2024-09-10T22:24:20.598 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:20.594+0000 7f136effd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1370101250 0x7f13701992c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:24:20.598 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:20.594+0000 7f136effd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1370101250 0x7f13701992c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:47922/0 (socket says 172.21.15.19:47922) 2024-09-10T22:24:20.598 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:20.594+0000 7f136effd640 1 -- 172.21.15.19:0/158336942 learned_addr learned my addr 172.21.15.19:0/158336942 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:24:20.598 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:20.594+0000 7f136e7fc640 1 --2- 172.21.15.19:0/158336942 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f13701055a0 0x7f1370199800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:24:20.598 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:20.594+0000 7f136f7fe640 1 --2- 172.21.15.19:0/158336942 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1370105f40 0x7f137019eba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:24:20.598 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:20.594+0000 7f136effd640 1 -- 172.21.15.19:0/158336942 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f13701055a0 msgr2=0x7f1370199800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:24:20.598 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:20.594+0000 7f136effd640 1 --2- 172.21.15.19:0/158336942 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f13701055a0 0x7f1370199800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:24:20.598 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:20.594+0000 7f136effd640 1 -- 172.21.15.19:0/158336942 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1370105f40 msgr2=0x7f137019eba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:24:20.599 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:20.594+0000 7f136effd640 1 --2- 172.21.15.19:0/158336942 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1370105f40 0x7f137019eba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:24:20.599 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:20.594+0000 7f136effd640 1 -- 172.21.15.19:0/158336942 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f137019f370 con 0x7f1370101250 2024-09-10T22:24:20.599 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:20.594+0000 7f136f7fe640 1 --2- 172.21.15.19:0/158336942 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1370105f40 0x7f137019eba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T22:24:20.599 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:20.594+0000 7f136e7fc640 1 --2- 172.21.15.19:0/158336942 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f13701055a0 0x7f1370199800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T22:24:20.599 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:20.594+0000 7f136effd640 1 --2- 172.21.15.19:0/158336942 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1370101250 0x7f13701992c0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f136000d950 tx=0x7f136000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:24:20.599 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:20.594+0000 7f1367fff640 1 -- 172.21.15.19:0/158336942 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1360017030 con 0x7f1370101250 2024-09-10T22:24:20.599 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:20.595+0000 7f13755c1640 1 -- 172.21.15.19:0/158336942 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f137019f660 con 0x7f1370101250 2024-09-10T22:24:20.599 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:20.595+0000 7f1367fff640 1 -- 172.21.15.19:0/158336942 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1360004020 con 0x7f1370101250 2024-09-10T22:24:20.599 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:20.595+0000 7f1367fff640 1 -- 172.21.15.19:0/158336942 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13600047a0 con 0x7f1370101250 2024-09-10T22:24:20.599 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:20.595+0000 7f13755c1640 1 -- 172.21.15.19:0/158336942 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f13701a5d20 con 0x7f1370101250 2024-09-10T22:24:20.600 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:20.596+0000 7f13755c1640 1 -- 172.21.15.19:0/158336942 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1370101630 con 0x7f1370101250 2024-09-10T22:24:20.600 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:20.597+0000 7f1367fff640 1 -- 172.21.15.19:0/158336942 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 16) ==== 153250+0+0 (secure 0 0 0) 0x7f1360009a30 con 0x7f1370101250 2024-09-10T22:24:20.600 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:20.598+0000 7f1367fff640 1 --2- 172.21.15.19:0/158336942 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f135c0b52e0 0x7f135c0b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:24:20.600 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:20.598+0000 7f136e7fc640 1 --2- 172.21.15.19:0/158336942 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f135c0b52e0 0x7f135c0b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:24:20.600 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:20.598+0000 7f1367fff640 1 -- 172.21.15.19:0/158336942 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(70..70 src has 1..70) ==== 7497+0+0 (secure 0 0 0) 0x7f13600e5a70 con 0x7f1370101250 2024-09-10T22:24:20.601 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:20.598+0000 7f136e7fc640 1 --2- 172.21.15.19:0/158336942 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f135c0b52e0 0x7f135c0b77a0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f1358031440 tx=0x7f1358005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:24:20.604 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:20.601+0000 7f1367fff640 1 -- 172.21.15.19:0/158336942 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f13600acc60 con 0x7f1370101250 2024-09-10T22:24:20.791 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:20.789+0000 7f13755c1640 1 -- 172.21.15.19:0/158336942 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7f137019a3f0 con 0x7f1370101250 2024-09-10T22:24:21.122 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:21.119+0000 7f1367fff640 1 -- 172.21.15.19:0/158336942 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v71) ==== 170+0+0 (secure 0 0 0) 0x7f13600ac560 con 0x7f1370101250 2024-09-10T22:24:21.122 INFO:teuthology.orchestra.run.smithi019.stderr:pool 'cephfs_data' created 2024-09-10T22:24:21.126 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:21.123+0000 7f13755c1640 1 -- 172.21.15.19:0/158336942 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f135c0b52e0 msgr2=0x7f135c0b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:24:21.126 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:21.123+0000 7f13755c1640 1 --2- 172.21.15.19:0/158336942 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f135c0b52e0 0x7f135c0b77a0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f1358031440 tx=0x7f1358005a20 comp rx=0 tx=0).stop 2024-09-10T22:24:21.126 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:21.123+0000 7f13755c1640 1 -- 172.21.15.19:0/158336942 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1370101250 msgr2=0x7f13701992c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:24:21.126 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:21.123+0000 7f13755c1640 1 --2- 172.21.15.19:0/158336942 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1370101250 0x7f13701992c0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f136000d950 tx=0x7f136000de10 comp rx=0 tx=0).stop 2024-09-10T22:24:21.127 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:21.124+0000 7f13755c1640 1 -- 172.21.15.19:0/158336942 shutdown_connections 2024-09-10T22:24:21.127 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:21.124+0000 7f13755c1640 1 --2- 172.21.15.19:0/158336942 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f135c0b52e0 0x7f135c0b77a0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:24:21.127 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:21.124+0000 7f13755c1640 1 --2- 172.21.15.19:0/158336942 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1370105f40 0x7f137019eba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:24:21.127 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:21.124+0000 7f13755c1640 1 --2- 172.21.15.19:0/158336942 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f13701055a0 0x7f1370199800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:24:21.127 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:21.124+0000 7f13755c1640 1 --2- 172.21.15.19:0/158336942 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1370101250 0x7f13701992c0 secure :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f136000d950 tx=0x7f136000de10 comp rx=0 tx=0).stop 2024-09-10T22:24:21.127 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:21.124+0000 7f13755c1640 1 -- 172.21.15.19:0/158336942 >> 172.21.15.19:0/158336942 conn(0x7f1370078140 msgr2=0x7f1370108f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:24:21.127 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:21.125+0000 7f13755c1640 1 -- 172.21.15.19:0/158336942 shutdown_connections 2024-09-10T22:24:21.128 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:21.125+0000 7f13755c1640 1 -- 172.21.15.19:0/158336942 wait complete. 2024-09-10T22:24:21.375 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:24:21 smithi138 ceph-mon[35236]: osdmap e70: 12 total, 12 up, 12 in 2024-09-10T22:24:21.375 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:24:21 smithi138 ceph-mon[35236]: from='client.? 172.21.15.19:0/158336942' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} : dispatch 2024-09-10T22:24:21.441 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:24:21 smithi019 ceph-mon[31375]: osdmap e70: 12 total, 12 up, 12 in 2024-09-10T22:24:21.441 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:24:21 smithi019 ceph-mon[31375]: from='client.? 172.21.15.19:0/158336942' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} : dispatch 2024-09-10T22:24:21.482 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:24:21 smithi135 ceph-mon[34789]: osdmap e70: 12 total, 12 up, 12 in 2024-09-10T22:24:21.482 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:24:21 smithi135 ceph-mon[34789]: from='client.? 172.21.15.19:0/158336942' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} : dispatch 2024-09-10T22:24:21.795 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 22997a4c-6fc2-11ef-bcea-c7b262605968 -- ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-10T22:24:22.060 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/22997a4c-6fc2-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T22:24:22.416 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:24:22 smithi019 ceph-mon[31375]: pgmap v278: 33 pgs: 17 creating+peering, 1 active+clean, 15 unknown; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T22:24:22.417 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:24:22 smithi019 ceph-mon[31375]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-10T22:24:22.417 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:24:22 smithi019 ceph-mon[31375]: from='client.? 172.21.15.19:0/158336942' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2024-09-10T22:24:22.417 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:24:22 smithi019 ceph-mon[31375]: osdmap e71: 12 total, 12 up, 12 in 2024-09-10T22:24:22.528 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:22.499+0000 7ff6890d0640 1 -- 172.21.15.19:0/3011459401 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff68410d0e0 msgr2=0x7ff68410f550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:24:22.528 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:22.499+0000 7ff6890d0640 1 --2- 172.21.15.19:0/3011459401 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff68410d0e0 0x7ff68410f550 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7ff67c009ca0 tx=0x7ff67c02a8c0 comp rx=0 tx=0).stop 2024-09-10T22:24:22.528 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:22.499+0000 7ff6890d0640 1 -- 172.21.15.19:0/3011459401 shutdown_connections 2024-09-10T22:24:22.528 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:22.499+0000 7ff6890d0640 1 --2- 172.21.15.19:0/3011459401 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff68410d0e0 0x7ff68410f550 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:24:22.528 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:22.499+0000 7ff6890d0640 1 --2- 172.21.15.19:0/3011459401 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff684104530 0x7ff68410cb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:24:22.528 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:22.499+0000 7ff6890d0640 1 --2- 172.21.15.19:0/3011459401 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff684103b30 0x7ff684103f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:24:22.528 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:22.499+0000 7ff6890d0640 1 -- 172.21.15.19:0/3011459401 >> 172.21.15.19:0/3011459401 conn(0x7ff6840fd700 msgr2=0x7ff6840ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:24:22.528 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:22.499+0000 7ff6890d0640 1 -- 172.21.15.19:0/3011459401 shutdown_connections 2024-09-10T22:24:22.529 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:22.499+0000 7ff6890d0640 1 -- 172.21.15.19:0/3011459401 wait complete. 2024-09-10T22:24:22.529 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:22.499+0000 7ff6890d0640 1 Processor -- start 2024-09-10T22:24:22.529 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:22.500+0000 7ff6890d0640 1 -- start start 2024-09-10T22:24:22.529 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:22.500+0000 7ff6890d0640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff684103b30 0x7ff6841992d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:24:22.529 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:22.500+0000 7ff6890d0640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff684104530 0x7ff684199810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:24:22.529 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:22.500+0000 7ff6890d0640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff68410d0e0 0x7ff68419ebb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:24:22.529 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:22.500+0000 7ff6890d0640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7ff684112d60 con 0x7ff684104530 2024-09-10T22:24:22.529 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:22.500+0000 7ff6890d0640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7ff684112be0 con 0x7ff68410d0e0 2024-09-10T22:24:22.529 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:22.500+0000 7ff6890d0640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7ff684112ee0 con 0x7ff684103b30 2024-09-10T22:24:22.529 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:22.500+0000 7ff68259c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff684104530 0x7ff684199810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:24:22.529 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:22.500+0000 7ff68259c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff684104530 0x7ff684199810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:47944/0 (socket says 172.21.15.19:47944) 2024-09-10T22:24:22.529 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:22.500+0000 7ff68259c640 1 -- 172.21.15.19:0/1890175622 learned_addr learned my addr 172.21.15.19:0/1890175622 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:24:22.529 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:22.500+0000 7ff68359e640 1 --2- 172.21.15.19:0/1890175622 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff68410d0e0 0x7ff68419ebb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:24:22.530 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:22.500+0000 7ff682d9d640 1 --2- 172.21.15.19:0/1890175622 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff684103b30 0x7ff6841992d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:24:22.530 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:22.500+0000 7ff68259c640 1 -- 172.21.15.19:0/1890175622 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff684103b30 msgr2=0x7ff6841992d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:24:22.530 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:22.500+0000 7ff68259c640 1 --2- 172.21.15.19:0/1890175622 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff684103b30 0x7ff6841992d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:24:22.530 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:22.500+0000 7ff68259c640 1 -- 172.21.15.19:0/1890175622 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff68410d0e0 msgr2=0x7ff68419ebb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:24:22.530 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:22.500+0000 7ff68259c640 1 --2- 172.21.15.19:0/1890175622 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff68410d0e0 0x7ff68419ebb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:24:22.530 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:22.500+0000 7ff68259c640 1 -- 172.21.15.19:0/1890175622 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff68419f380 con 0x7ff684104530 2024-09-10T22:24:22.530 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:22.500+0000 7ff682d9d640 1 --2- 172.21.15.19:0/1890175622 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff684103b30 0x7ff6841992d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T22:24:22.530 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:22.500+0000 7ff68359e640 1 --2- 172.21.15.19:0/1890175622 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff68410d0e0 0x7ff68419ebb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T22:24:22.530 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:22.501+0000 7ff68259c640 1 --2- 172.21.15.19:0/1890175622 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff684104530 0x7ff684199810 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7ff67800d950 tx=0x7ff67800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:24:22.530 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:22.501+0000 7ff66bfff640 1 -- 172.21.15.19:0/1890175622 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff678017070 con 0x7ff684104530 2024-09-10T22:24:22.530 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:22.501+0000 7ff66bfff640 1 -- 172.21.15.19:0/1890175622 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff678009c30 con 0x7ff684104530 2024-09-10T22:24:22.530 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:22.501+0000 7ff66bfff640 1 -- 172.21.15.19:0/1890175622 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff67800f620 con 0x7ff684104530 2024-09-10T22:24:22.530 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:22.501+0000 7ff6890d0640 1 -- 172.21.15.19:0/1890175622 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff68419f670 con 0x7ff684104530 2024-09-10T22:24:22.531 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:22.501+0000 7ff6890d0640 1 -- 172.21.15.19:0/1890175622 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff6841a5d30 con 0x7ff684104530 2024-09-10T22:24:22.531 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:22.502+0000 7ff6890d0640 1 -- 172.21.15.19:0/1890175622 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff684103f10 con 0x7ff684104530 2024-09-10T22:24:22.531 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:22.503+0000 7ff66bfff640 1 -- 172.21.15.19:0/1890175622 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 16) ==== 153250+0+0 (secure 0 0 0) 0x7ff678010460 con 0x7ff684104530 2024-09-10T22:24:22.531 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:22.504+0000 7ff66bfff640 1 --2- 172.21.15.19:0/1890175622 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7ff66c0b5360 0x7ff66c0b7820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:24:22.531 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:22.505+0000 7ff682d9d640 1 --2- 172.21.15.19:0/1890175622 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7ff66c0b5360 0x7ff66c0b7820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:24:22.531 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:22.505+0000 7ff66bfff640 1 -- 172.21.15.19:0/1890175622 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 7879+0+0 (secure 0 0 0) 0x7ff6780e5610 con 0x7ff684104530 2024-09-10T22:24:22.531 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:22.505+0000 7ff682d9d640 1 --2- 172.21.15.19:0/1890175622 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7ff66c0b5360 0x7ff66c0b7820 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7ff674005d00 tx=0x7ff674009550 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:24:22.531 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:22.508+0000 7ff66bfff640 1 -- 172.21.15.19:0/1890175622 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7ff6780ac6e0 con 0x7ff684104530 2024-09-10T22:24:22.609 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:24:22 smithi135 ceph-mon[34789]: pgmap v278: 33 pgs: 17 creating+peering, 1 active+clean, 15 unknown; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T22:24:22.610 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:24:22 smithi135 ceph-mon[34789]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-10T22:24:22.610 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:24:22 smithi135 ceph-mon[34789]: from='client.? 172.21.15.19:0/158336942' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2024-09-10T22:24:22.610 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:24:22 smithi135 ceph-mon[34789]: osdmap e71: 12 total, 12 up, 12 in 2024-09-10T22:24:22.625 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:24:22 smithi138 ceph-mon[35236]: pgmap v278: 33 pgs: 17 creating+peering, 1 active+clean, 15 unknown; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T22:24:22.625 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:24:22 smithi138 ceph-mon[35236]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-10T22:24:22.625 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:24:22 smithi138 ceph-mon[35236]: from='client.? 172.21.15.19:0/158336942' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2024-09-10T22:24:22.625 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:24:22 smithi138 ceph-mon[35236]: osdmap e71: 12 total, 12 up, 12 in 2024-09-10T22:24:22.733 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:22.731+0000 7ff6890d0640 1 -- 172.21.15.19:0/1890175622 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7ff68419a400 con 0x7ff684104530 2024-09-10T22:24:23.138 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:23.136+0000 7ff66bfff640 1 -- 172.21.15.19:0/1890175622 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v14) ==== 172+0+0 (secure 0 0 0) 0x7ff678009de0 con 0x7ff684104530 2024-09-10T22:24:23.138 INFO:teuthology.orchestra.run.smithi019.stderr:new fs with metadata pool 2 and data pool 3 2024-09-10T22:24:23.141 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:23.138+0000 7ff6890d0640 1 -- 172.21.15.19:0/1890175622 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7ff66c0b5360 msgr2=0x7ff66c0b7820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:24:23.141 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:23.138+0000 7ff6890d0640 1 --2- 172.21.15.19:0/1890175622 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7ff66c0b5360 0x7ff66c0b7820 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7ff674005d00 tx=0x7ff674009550 comp rx=0 tx=0).stop 2024-09-10T22:24:23.141 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:23.138+0000 7ff6890d0640 1 -- 172.21.15.19:0/1890175622 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff684104530 msgr2=0x7ff684199810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:24:23.141 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:23.138+0000 7ff6890d0640 1 --2- 172.21.15.19:0/1890175622 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff684104530 0x7ff684199810 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7ff67800d950 tx=0x7ff67800de10 comp rx=0 tx=0).stop 2024-09-10T22:24:23.141 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:23.139+0000 7ff6890d0640 1 -- 172.21.15.19:0/1890175622 shutdown_connections 2024-09-10T22:24:23.141 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:23.139+0000 7ff6890d0640 1 --2- 172.21.15.19:0/1890175622 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7ff66c0b5360 0x7ff66c0b7820 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:24:23.142 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:23.139+0000 7ff6890d0640 1 --2- 172.21.15.19:0/1890175622 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff68410d0e0 0x7ff68419ebb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:24:23.142 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:23.139+0000 7ff6890d0640 1 --2- 172.21.15.19:0/1890175622 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff684104530 0x7ff684199810 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:24:23.142 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:23.139+0000 7ff6890d0640 1 --2- 172.21.15.19:0/1890175622 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff684103b30 0x7ff6841992d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:24:23.142 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:23.139+0000 7ff6890d0640 1 -- 172.21.15.19:0/1890175622 >> 172.21.15.19:0/1890175622 conn(0x7ff6840fd700 msgr2=0x7ff6840fe400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:24:23.142 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:23.139+0000 7ff6890d0640 1 -- 172.21.15.19:0/1890175622 shutdown_connections 2024-09-10T22:24:23.142 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:23.139+0000 7ff6890d0640 1 -- 172.21.15.19:0/1890175622 wait complete. 2024-09-10T22:24:23.458 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:24:23 smithi019 ceph-mon[31375]: osdmap e72: 12 total, 12 up, 12 in 2024-09-10T22:24:23.458 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:24:23 smithi019 ceph-mon[31375]: pgmap v281: 97 pgs: 25 creating+peering, 8 active+clean, 64 unknown; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T22:24:23.458 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:24:23 smithi019 ceph-mon[31375]: from='client.? 172.21.15.19:0/1890175622' entity='client.admin' cmd={"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} : dispatch 2024-09-10T22:24:23.458 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:24:23 smithi019 ceph-mon[31375]: daemon mds.b assigned to filesystem cephfs as rank 0 2024-09-10T22:24:23.609 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:24:23 smithi135 ceph-mon[34789]: osdmap e72: 12 total, 12 up, 12 in 2024-09-10T22:24:23.610 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:24:23 smithi135 ceph-mon[34789]: pgmap v281: 97 pgs: 25 creating+peering, 8 active+clean, 64 unknown; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T22:24:23.610 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:24:23 smithi135 ceph-mon[34789]: from='client.? 172.21.15.19:0/1890175622' entity='client.admin' cmd={"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} : dispatch 2024-09-10T22:24:23.610 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:24:23 smithi135 ceph-mon[34789]: daemon mds.b assigned to filesystem cephfs as rank 0 2024-09-10T22:24:23.625 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:24:23 smithi138 ceph-mon[35236]: osdmap e72: 12 total, 12 up, 12 in 2024-09-10T22:24:23.625 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:24:23 smithi138 ceph-mon[35236]: pgmap v281: 97 pgs: 25 creating+peering, 8 active+clean, 64 unknown; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T22:24:23.625 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:24:23 smithi138 ceph-mon[35236]: from='client.? 172.21.15.19:0/1890175622' entity='client.admin' cmd={"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} : dispatch 2024-09-10T22:24:23.625 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:24:23 smithi138 ceph-mon[35236]: daemon mds.b assigned to filesystem cephfs as rank 0 2024-09-10T22:24:23.802 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 22997a4c-6fc2-11ef-bcea-c7b262605968 -- ceph osd dump --format=json 2024-09-10T22:24:24.067 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/22997a4c-6fc2-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T22:24:24.452 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:24:24 smithi019 ceph-mon[31375]: osdmap e73: 12 total, 12 up, 12 in 2024-09-10T22:24:24.452 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:24:24 smithi019 ceph-mon[31375]: from='client.? 172.21.15.19:0/1890175622' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2024-09-10T22:24:24.453 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:24:24 smithi019 ceph-mon[31375]: fsmap cephfs:1 {0=b=up:creating} 11 up:standby 2024-09-10T22:24:24.453 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:24:24 smithi019 ceph-mon[31375]: daemon mds.b is now active in filesystem cephfs as rank 0 2024-09-10T22:24:24.536 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:24.531+0000 7fd4d8ea6640 1 -- 172.21.15.19:0/1094628898 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd4d4109150 msgr2=0x7fd4d410f950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:24:24.536 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:24.531+0000 7fd4d8ea6640 1 --2- 172.21.15.19:0/1094628898 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd4d4109150 0x7fd4d410f950 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fd4cc009ca0 tx=0x7fd4cc02a8c0 comp rx=0 tx=0).stop 2024-09-10T22:24:24.536 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:24.531+0000 7fd4d8ea6640 1 -- 172.21.15.19:0/1094628898 shutdown_connections 2024-09-10T22:24:24.536 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:24.531+0000 7fd4d8ea6640 1 --2- 172.21.15.19:0/1094628898 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd4d4109150 0x7fd4d410f950 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:24:24.536 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:24.531+0000 7fd4d8ea6640 1 --2- 172.21.15.19:0/1094628898 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd4d41087d0 0x7fd4d4108c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:24:24.536 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:24.531+0000 7fd4d8ea6640 1 --2- 172.21.15.19:0/1094628898 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd4d4102dc0 0x7fd4d41031a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:24:24.536 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:24.531+0000 7fd4d8ea6640 1 -- 172.21.15.19:0/1094628898 >> 172.21.15.19:0/1094628898 conn(0x7fd4d40fe830 msgr2=0x7fd4d4100c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:24:24.536 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:24.531+0000 7fd4d8ea6640 1 -- 172.21.15.19:0/1094628898 shutdown_connections 2024-09-10T22:24:24.537 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:24.531+0000 7fd4d8ea6640 1 -- 172.21.15.19:0/1094628898 wait complete. 2024-09-10T22:24:24.537 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:24.531+0000 7fd4d8ea6640 1 Processor -- start 2024-09-10T22:24:24.537 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:24.531+0000 7fd4d8ea6640 1 -- start start 2024-09-10T22:24:24.537 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:24.532+0000 7fd4d8ea6640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd4d4102dc0 0x7fd4d40754a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:24:24.537 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:24.532+0000 7fd4d8ea6640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd4d41087d0 0x7fd4d40759e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:24:24.537 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:24.532+0000 7fd4d8ea6640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd4d4109150 0x7fd4d4075f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:24:24.537 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:24.532+0000 7fd4d8ea6640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fd4d4112e10 con 0x7fd4d41087d0 2024-09-10T22:24:24.537 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:24.532+0000 7fd4d8ea6640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fd4d4112c90 con 0x7fd4d4109150 2024-09-10T22:24:24.537 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:24.532+0000 7fd4d8ea6640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7fd4d4112f90 con 0x7fd4d4102dc0 2024-09-10T22:24:24.537 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:24.532+0000 7fd4d1d9b640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd4d41087d0 0x7fd4d40759e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:24:24.537 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:24.532+0000 7fd4d1d9b640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd4d41087d0 0x7fd4d40759e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:45076/0 (socket says 172.21.15.19:45076) 2024-09-10T22:24:24.537 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:24.532+0000 7fd4d1d9b640 1 -- 172.21.15.19:0/4109108379 learned_addr learned my addr 172.21.15.19:0/4109108379 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:24:24.538 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:24.532+0000 7fd4d259c640 1 --2- 172.21.15.19:0/4109108379 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd4d4102dc0 0x7fd4d40754a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:24:24.538 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:24.532+0000 7fd4d2d9d640 1 --2- 172.21.15.19:0/4109108379 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd4d4109150 0x7fd4d4075f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:24:24.538 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:24.532+0000 7fd4d1d9b640 1 -- 172.21.15.19:0/4109108379 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd4d4102dc0 msgr2=0x7fd4d40754a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:24:24.538 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:24.532+0000 7fd4d1d9b640 1 --2- 172.21.15.19:0/4109108379 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd4d4102dc0 0x7fd4d40754a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:24:24.538 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:24.532+0000 7fd4d1d9b640 1 -- 172.21.15.19:0/4109108379 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd4d4109150 msgr2=0x7fd4d4075f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:24:24.538 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:24.532+0000 7fd4d1d9b640 1 --2- 172.21.15.19:0/4109108379 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd4d4109150 0x7fd4d4075f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:24:24.538 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:24.532+0000 7fd4d1d9b640 1 -- 172.21.15.19:0/4109108379 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd4d41a7720 con 0x7fd4d41087d0 2024-09-10T22:24:24.538 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:24.532+0000 7fd4d1d9b640 1 --2- 172.21.15.19:0/4109108379 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd4d41087d0 0x7fd4d40759e0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fd4c800c890 tx=0x7fd4c800cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:24:24.538 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:24.532+0000 7fd4c37fe640 1 -- 172.21.15.19:0/4109108379 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4c8004220 con 0x7fd4d41087d0 2024-09-10T22:24:24.538 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:24.532+0000 7fd4c37fe640 1 -- 172.21.15.19:0/4109108379 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd4c80043c0 con 0x7fd4d41087d0 2024-09-10T22:24:24.538 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:24.532+0000 7fd4d8ea6640 1 -- 172.21.15.19:0/4109108379 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd4d41a7a10 con 0x7fd4d41087d0 2024-09-10T22:24:24.538 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:24.532+0000 7fd4c37fe640 1 -- 172.21.15.19:0/4109108379 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4c8004a00 con 0x7fd4d41087d0 2024-09-10T22:24:24.538 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:24.532+0000 7fd4d8ea6640 1 -- 172.21.15.19:0/4109108379 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd4d41a7f50 con 0x7fd4d41087d0 2024-09-10T22:24:24.539 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:24.534+0000 7fd4d8ea6640 1 -- 172.21.15.19:0/4109108379 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd4d41031a0 con 0x7fd4d41087d0 2024-09-10T22:24:24.539 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:24.535+0000 7fd4c37fe640 1 -- 172.21.15.19:0/4109108379 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 16) ==== 153250+0+0 (secure 0 0 0) 0x7fd4c80079b0 con 0x7fd4d41087d0 2024-09-10T22:24:24.540 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:24.536+0000 7fd4c37fe640 1 --2- 172.21.15.19:0/4109108379 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7fd4bc0b52e0 0x7fd4bc0b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:24:24.540 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:24.536+0000 7fd4d259c640 1 --2- 172.21.15.19:0/4109108379 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7fd4bc0b52e0 0x7fd4bc0b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:24:24.540 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:24.536+0000 7fd4c37fe640 1 -- 172.21.15.19:0/4109108379 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 7979+0+0 (secure 0 0 0) 0x7fd4c80e5a80 con 0x7fd4d41087d0 2024-09-10T22:24:24.540 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:24.536+0000 7fd4d259c640 1 --2- 172.21.15.19:0/4109108379 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7fd4bc0b52e0 0x7fd4bc0b77a0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fd4c4009bd0 tx=0x7fd4c4005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:24:24.541 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:24.539+0000 7fd4c37fe640 1 -- 172.21.15.19:0/4109108379 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7fd4c8014030 con 0x7fd4d41087d0 2024-09-10T22:24:24.610 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:24:24 smithi135 ceph-mon[34789]: osdmap e73: 12 total, 12 up, 12 in 2024-09-10T22:24:24.610 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:24:24 smithi135 ceph-mon[34789]: from='client.? 172.21.15.19:0/1890175622' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2024-09-10T22:24:24.610 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:24:24 smithi135 ceph-mon[34789]: fsmap cephfs:1 {0=b=up:creating} 11 up:standby 2024-09-10T22:24:24.610 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:24:24 smithi135 ceph-mon[34789]: daemon mds.b is now active in filesystem cephfs as rank 0 2024-09-10T22:24:24.625 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:24:24 smithi138 ceph-mon[35236]: osdmap e73: 12 total, 12 up, 12 in 2024-09-10T22:24:24.625 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:24:24 smithi138 ceph-mon[35236]: from='client.? 172.21.15.19:0/1890175622' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2024-09-10T22:24:24.625 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:24:24 smithi138 ceph-mon[35236]: fsmap cephfs:1 {0=b=up:creating} 11 up:standby 2024-09-10T22:24:24.625 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:24:24 smithi138 ceph-mon[35236]: daemon mds.b is now active in filesystem cephfs as rank 0 2024-09-10T22:24:24.725 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:24.722+0000 7fd4d8ea6640 1 -- 172.21.15.19:0/4109108379 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fd4d402e5c0 con 0x7fd4d41087d0 2024-09-10T22:24:24.726 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:24.725+0000 7fd4c37fe640 1 -- 172.21.15.19:0/4109108379 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v73) ==== 74+0+22289 (secure 0 0 0) 0x7fd4c80cdb10 con 0x7fd4d41087d0 2024-09-10T22:24:24.727 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-10T22:24:24.727 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":73,"fsid":"22997a4c-6fc2-11ef-bcea-c7b262605968","created":"2024-09-10T22:16:16.754696+0000","modified":"2024-09-10T22:24:22.733974+0000","last_up_change":"2024-09-10T22:23:32.417392+0000","last_in_change":"2024-09-10T22:23:09.614371+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T22:19:50.731662+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-10T22:24:18.740121+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"73","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-10T22:24:20.795178+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"73","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"783d96cb-0a8a-47f3-8eab-77cd731a64bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6802","nonce":234761879},{"type":"v1","addr":"172.21.15.19:6803","nonce":234761879}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6804","nonce":234761879},{"type":"v1","addr":"172.21.15.19:6805","nonce":234761879}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6808","nonce":234761879},{"type":"v1","addr":"172.21.15.19:6809","nonce":234761879}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6806","nonce":234761879},{"type":"v1","addr":"172.21.15.19:6807","nonce":234761879}]},"public_addr":"172.21.15.19:6803/234761879","cluster_addr":"172.21.15.19:6805/234761879","heartbeat_back_addr":"172.21.15.19:6809/234761879","heartbeat_front_addr":"172.21.15.19:6807/234761879","state":["exists","up"]},{"osd":1,"uuid":"41043581-e0cf-43b5-bae0-0d95e2ef8156","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6800","nonce":1803526886},{"type":"v1","addr":"172.21.15.135:6801","nonce":1803526886}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6802","nonce":1803526886},{"type":"v1","addr":"172.21.15.135:6803","nonce":1803526886}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6806","nonce":1803526886},{"type":"v1","addr":"172.21.15.135:6807","nonce":1803526886}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6804","nonce":1803526886},{"type":"v1","addr":"172.21.15.135:6805","nonce":1803526886}]},"public_addr":"172.21.15.135:6801/1803526886","cluster_addr":"172.21.15.135:6803/1803526886","heartbeat_back_addr":"172.21.15.135:6807/1803526886","heartbeat_front_addr":"172.21.15.135:6805/1803526886","state":["exists","up"]},{"osd":2,"uuid":"a9b14a06-bbdc-4501-96e2-fb5f7127ca16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6800","nonce":2747418770},{"type":"v1","addr":"172.21.15.138:6801","nonce":2747418770}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6802","nonce":2747418770},{"type":"v1","addr":"172.21.15.138:6803","nonce":2747418770}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6806","nonce":2747418770},{"type":"v1","addr":"172.21.15.138:6807","nonce":2747418770}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6804","nonce":2747418770},{"type":"v1","addr":"172.21.15.138:6805","nonce":2747418770}]},"public_addr":"172.21.15.138:6801/2747418770","cluster_addr":"172.21.15.138:6803/2747418770","heartbeat_back_addr":"172.21.15.138:6807/2747418770","heartbeat_front_addr":"172.21.15.138:6805/2747418770","state":["exists","up"]},{"osd":3,"uuid":"a46268da-8666-4cfa-b11a-30eb12e271be","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":23,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6810","nonce":1889857224},{"type":"v1","addr":"172.21.15.19:6811","nonce":1889857224}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6812","nonce":1889857224},{"type":"v1","addr":"172.21.15.19:6813","nonce":1889857224}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6816","nonce":1889857224},{"type":"v1","addr":"172.21.15.19:6817","nonce":1889857224}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6814","nonce":1889857224},{"type":"v1","addr":"172.21.15.19:6815","nonce":1889857224}]},"public_addr":"172.21.15.19:6811/1889857224","cluster_addr":"172.21.15.19:6813/1889857224","heartbeat_back_addr":"172.21.15.19:6817/1889857224","heartbeat_front_addr":"172.21.15.19:6815/1889857224","state":["exists","up"]},{"osd":4,"uuid":"c58df06f-2de2-4655-88e7-ac6a3531839a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":29,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6808","nonce":436311825},{"type":"v1","addr":"172.21.15.135:6809","nonce":436311825}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6810","nonce":436311825},{"type":"v1","addr":"172.21.15.135:6811","nonce":436311825}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6814","nonce":436311825},{"type":"v1","addr":"172.21.15.135:6815","nonce":436311825}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6812","nonce":436311825},{"type":"v1","addr":"172.21.15.135:6813","nonce":436311825}]},"public_addr":"172.21.15.135:6809/436311825","cluster_addr":"172.21.15.135:6811/436311825","heartbeat_back_addr":"172.21.15.135:6815/436311825","heartbeat_front_addr":"172.21.15.135:6813/436311825","state":["exists","up"]},{"osd":5,"uuid":"c0900b0c-aef4-498d-a01b-a891bdb51122","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6808","nonce":1086764290},{"type":"v1","addr":"172.21.15.138:6809","nonce":1086764290}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6810","nonce":1086764290},{"type":"v1","addr":"172.21.15.138:6811","nonce":1086764290}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6814","nonce":1086764290},{"type":"v1","addr":"172.21.15.138:6815","nonce":1086764290}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6812","nonce":1086764290},{"type":"v1","addr":"172.21.15.138:6813","nonce":1086764290}]},"public_addr":"172.21.15.138:6809/1086764290","cluster_addr":"172.21.15.138:6811/1086764290","heartbeat_back_addr":"172.21.15.138:6815/1086764290","heartbeat_front_addr":"172.21.15.138:6813/1086764290","state":["exists","up"]},{"osd":6,"uuid":"f79cb310-8073-4ee5-80a6-87a290600321","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":40,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6818","nonce":406328354},{"type":"v1","addr":"172.21.15.19:6819","nonce":406328354}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6820","nonce":406328354},{"type":"v1","addr":"172.21.15.19:6821","nonce":406328354}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6824","nonce":406328354},{"type":"v1","addr":"172.21.15.19:6825","nonce":406328354}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6822","nonce":406328354},{"type":"v1","addr":"172.21.15.19:6823","nonce":406328354}]},"public_addr":"172.21.15.19:6819/406328354","cluster_addr":"172.21.15.19:6821/406328354","heartbeat_back_addr":"172.21.15.19:6825/406328354","heartbeat_front_addr":"172.21.15.19:6823/406328354","state":["exists","up"]},{"osd":7,"uuid":"cc76476a-92f3-489c-be9e-29cbbf39539e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6816","nonce":1096613674},{"type":"v1","addr":"172.21.15.135:6817","nonce":1096613674}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6818","nonce":1096613674},{"type":"v1","addr":"172.21.15.135:6819","nonce":1096613674}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6822","nonce":1096613674},{"type":"v1","addr":"172.21.15.135:6823","nonce":1096613674}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6820","nonce":1096613674},{"type":"v1","addr":"172.21.15.135:6821","nonce":1096613674}]},"public_addr":"172.21.15.135:6817/1096613674","cluster_addr":"172.21.15.135:6819/1096613674","heartbeat_back_addr":"172.21.15.135:6823/1096613674","heartbeat_front_addr":"172.21.15.135:6821/1096613674","state":["exists","up"]},{"osd":8,"uuid":"5323a006-a6e8-4403-9c51-65f46298d5c4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6816","nonce":3020394729},{"type":"v1","addr":"172.21.15.138:6817","nonce":3020394729}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6818","nonce":3020394729},{"type":"v1","addr":"172.21.15.138:6819","nonce":3020394729}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6822","nonce":3020394729},{"type":"v1","addr":"172.21.15.138:6823","nonce":3020394729}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6820","nonce":3020394729},{"type":"v1","addr":"172.21.15.138:6821","nonce":3020394729}]},"public_addr":"172.21.15.138:6817/3020394729","cluster_addr":"172.21.15.138:6819/3020394729","heartbeat_back_addr":"172.21.15.138:6823/3020394729","heartbeat_front_addr":"172.21.15.138:6821/3020394729","state":["exists","up"]},{"osd":9,"uuid":"b869ac42-c46e-442c-8b5b-f81c018e663c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":57,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6826","nonce":1488680899},{"type":"v1","addr":"172.21.15.19:6827","nonce":1488680899}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6828","nonce":1488680899},{"type":"v1","addr":"172.21.15.19:6829","nonce":1488680899}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6832","nonce":1488680899},{"type":"v1","addr":"172.21.15.19:6833","nonce":1488680899}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6830","nonce":1488680899},{"type":"v1","addr":"172.21.15.19:6831","nonce":1488680899}]},"public_addr":"172.21.15.19:6827/1488680899","cluster_addr":"172.21.15.19:6829/1488680899","heartbeat_back_addr":"172.21.15.19:6833/1488680899","heartbeat_front_addr":"172.21.15.19:6831/1488680899","state":["exists","up"]},{"osd":10,"uuid":"b8a2d69a-6821-4c69-b7eb-c0cfc8164614","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":62,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6824","nonce":3812626754},{"type":"v1","addr":"172.21.15.135:6825","nonce":3812626754}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6826","nonce":3812626754},{"type":"v1","addr":"172.21.15.135:6827","nonce":3812626754}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6830","nonce":3812626754},{"type":"v1","addr":"172.21.15.135:6831","nonce":3812626754}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6828","nonce":3812626754},{"type":"v1","addr":"172.21.15.135:6829","nonce":3812626754}]},"public_addr":"172.21.15.135:6825/3812626754","cluster_addr":"172.21.15.135:6827/3812626754","heartbeat_back_addr":"172.21.15.135:6831/3812626754","heartbeat_front_addr":"172.21.15.135:6829/3812626754","state":["exists","up"]},{"osd":11,"uuid":"a9264ab2-5843-44d2-aba8-1e12708e99d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6824","nonce":1098434807},{"type":"v1","addr":"172.21.15.138:6825","nonce":1098434807}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6826","nonce":1098434807},{"type":"v1","addr":"172.21.15.138:6827","nonce":1098434807}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6830","nonce":1098434807},{"type":"v1","addr":"172.21.15.138:6831","nonce":1098434807}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6828","nonce":1098434807},{"type":"v1","addr":"172.21.15.138:6829","nonce":1098434807}]},"public_addr":"172.21.15.138:6825/1098434807","cluster_addr":"172.21.15.138:6827/1098434807","heartbeat_back_addr":"172.21.15.138:6831/1098434807","heartbeat_front_addr":"172.21.15.138:6829/1098434807","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:18:58.008025+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:19:22.475890+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:19:47.124147+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:20:12.438853+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:20:37.195177+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:21:02.474248+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:21:27.087207+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:21:52.119211+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:22:16.569989+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:22:41.680986+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:23:06.391885+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:23:30.695460+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.19:0/2099468127":"2024-09-11T22:17:04.260826+0000","172.21.15.19:0/538724915":"2024-09-11T22:17:04.260826+0000","172.21.15.19:0/3504695777":"2024-09-11T22:17:04.260826+0000","172.21.15.19:0/1401613792":"2024-09-11T22:16:39.069638+0000","172.21.15.19:6801/3005924425":"2024-09-11T22:17:04.260826+0000","172.21.15.19:6800/3005924425":"2024-09-11T22:17:04.260826+0000","172.21.15.19:0/104917892":"2024-09-11T22:16:39.069638+0000","172.21.15.19:0/1778305990":"2024-09-11T22:16:39.069638+0000","172.21.15.19:6801/535670059":"2024-09-11T22:16:39.069638+0000","172.21.15.19:6800/535670059":"2024-09-11T22:16:39.069638+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T22:24:24.728 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:24.726+0000 7fd4d8ea6640 1 -- 172.21.15.19:0/4109108379 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7fd4bc0b52e0 msgr2=0x7fd4bc0b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:24:24.728 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:24.726+0000 7fd4d8ea6640 1 --2- 172.21.15.19:0/4109108379 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7fd4bc0b52e0 0x7fd4bc0b77a0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fd4c4009bd0 tx=0x7fd4c4005f90 comp rx=0 tx=0).stop 2024-09-10T22:24:24.728 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:24.726+0000 7fd4d8ea6640 1 -- 172.21.15.19:0/4109108379 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd4d41087d0 msgr2=0x7fd4d40759e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:24:24.729 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:24.726+0000 7fd4d8ea6640 1 --2- 172.21.15.19:0/4109108379 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd4d41087d0 0x7fd4d40759e0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fd4c800c890 tx=0x7fd4c800cd50 comp rx=0 tx=0).stop 2024-09-10T22:24:24.729 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:24.726+0000 7fd4d8ea6640 1 -- 172.21.15.19:0/4109108379 shutdown_connections 2024-09-10T22:24:24.729 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:24.726+0000 7fd4d8ea6640 1 --2- 172.21.15.19:0/4109108379 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7fd4bc0b52e0 0x7fd4bc0b77a0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:24:24.729 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:24.726+0000 7fd4d8ea6640 1 --2- 172.21.15.19:0/4109108379 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd4d4109150 0x7fd4d4075f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:24:24.729 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:24.726+0000 7fd4d8ea6640 1 --2- 172.21.15.19:0/4109108379 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd4d41087d0 0x7fd4d40759e0 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:24:24.730 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:24.726+0000 7fd4d8ea6640 1 --2- 172.21.15.19:0/4109108379 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd4d4102dc0 0x7fd4d40754a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:24:24.730 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:24.726+0000 7fd4d8ea6640 1 -- 172.21.15.19:0/4109108379 >> 172.21.15.19:0/4109108379 conn(0x7fd4d40fe830 msgr2=0x7fd4d40ff180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:24:24.730 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:24.726+0000 7fd4d8ea6640 1 -- 172.21.15.19:0/4109108379 shutdown_connections 2024-09-10T22:24:24.730 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:24.726+0000 7fd4d8ea6640 1 -- 172.21.15.19:0/4109108379 wait complete. 2024-09-10T22:24:25.381 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:24:25 smithi019 ceph-mon[31375]: mds.? [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] up:active 2024-09-10T22:24:25.381 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:24:25 smithi019 ceph-mon[31375]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-10T22:24:25.381 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:24:25 smithi019 ceph-mon[31375]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-10T22:24:25.382 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:24:25 smithi019 ceph-mon[31375]: pgmap v283: 97 pgs: 22 creating+peering, 40 active+clean, 35 unknown; 577 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 482 B/s wr, 5 op/s 2024-09-10T22:24:25.382 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:24:25 smithi019 ceph-mon[31375]: from='client.? 172.21.15.19:0/4109108379' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-10T22:24:25.413 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 22997a4c-6fc2-11ef-bcea-c7b262605968 -- ceph osd dump --format=json 2024-09-10T22:24:25.610 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:24:25 smithi135 ceph-mon[34789]: mds.? [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] up:active 2024-09-10T22:24:25.610 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:24:25 smithi135 ceph-mon[34789]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-10T22:24:25.610 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:24:25 smithi135 ceph-mon[34789]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-10T22:24:25.610 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:24:25 smithi135 ceph-mon[34789]: pgmap v283: 97 pgs: 22 creating+peering, 40 active+clean, 35 unknown; 577 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 482 B/s wr, 5 op/s 2024-09-10T22:24:25.610 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:24:25 smithi135 ceph-mon[34789]: from='client.? 172.21.15.19:0/4109108379' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-10T22:24:25.625 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:24:25 smithi138 ceph-mon[35236]: mds.? [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] up:active 2024-09-10T22:24:25.625 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:24:25 smithi138 ceph-mon[35236]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-10T22:24:25.625 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:24:25 smithi138 ceph-mon[35236]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-10T22:24:25.625 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:24:25 smithi138 ceph-mon[35236]: pgmap v283: 97 pgs: 22 creating+peering, 40 active+clean, 35 unknown; 577 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 482 B/s wr, 5 op/s 2024-09-10T22:24:25.625 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:24:25 smithi138 ceph-mon[35236]: from='client.? 172.21.15.19:0/4109108379' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-10T22:24:25.671 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/22997a4c-6fc2-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T22:24:26.159 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:26.141+0000 7f9125589640 1 -- 172.21.15.19:0/2096523916 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f912010d140 msgr2=0x7f912010f5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:24:26.160 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:26.141+0000 7f9125589640 1 --2- 172.21.15.19:0/2096523916 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f912010d140 0x7f912010f5a0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f9118009ca0 tx=0x7f911802a8c0 comp rx=0 tx=0).stop 2024-09-10T22:24:26.160 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:26.141+0000 7f9125589640 1 -- 172.21.15.19:0/2096523916 shutdown_connections 2024-09-10T22:24:26.160 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:26.141+0000 7f9125589640 1 --2- 172.21.15.19:0/2096523916 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f912010d140 0x7f912010f5a0 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:24:26.160 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:26.141+0000 7f9125589640 1 --2- 172.21.15.19:0/2096523916 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f9120104600 0x7f912010caf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:24:26.160 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:26.141+0000 7f9125589640 1 --2- 172.21.15.19:0/2096523916 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9120103ce0 0x7f91201040c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:24:26.160 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:26.141+0000 7f9125589640 1 -- 172.21.15.19:0/2096523916 >> 172.21.15.19:0/2096523916 conn(0x7f91200fd700 msgr2=0x7f91200ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:24:26.160 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:26.141+0000 7f9125589640 1 -- 172.21.15.19:0/2096523916 shutdown_connections 2024-09-10T22:24:26.160 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:26.141+0000 7f9125589640 1 -- 172.21.15.19:0/2096523916 wait complete. 2024-09-10T22:24:26.160 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:26.141+0000 7f9125589640 1 Processor -- start 2024-09-10T22:24:26.160 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:26.142+0000 7f9125589640 1 -- start start 2024-09-10T22:24:26.161 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:26.142+0000 7f9125589640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f9120103ce0 0x7f9120199340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:24:26.161 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:26.142+0000 7f9125589640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9120104600 0x7f9120199880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:24:26.161 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:26.142+0000 7f9125589640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f912010d140 0x7f912019ec20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:24:26.161 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:26.142+0000 7f9125589640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f9120112e10 con 0x7f9120104600 2024-09-10T22:24:26.161 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:26.142+0000 7f9125589640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f9120112c90 con 0x7f912010d140 2024-09-10T22:24:26.161 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:26.142+0000 7f9125589640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f9120112f90 con 0x7f9120103ce0 2024-09-10T22:24:26.161 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:26.142+0000 7f911e7fc640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9120104600 0x7f9120199880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:24:26.161 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:26.142+0000 7f911e7fc640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9120104600 0x7f9120199880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:45104/0 (socket says 172.21.15.19:45104) 2024-09-10T22:24:26.161 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:26.142+0000 7f911e7fc640 1 -- 172.21.15.19:0/1609615287 learned_addr learned my addr 172.21.15.19:0/1609615287 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:24:26.161 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:26.142+0000 7f911f7fe640 1 --2- 172.21.15.19:0/1609615287 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f912010d140 0x7f912019ec20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:24:26.161 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:26.142+0000 7f911effd640 1 --2- 172.21.15.19:0/1609615287 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f9120103ce0 0x7f9120199340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:24:26.161 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:26.142+0000 7f911e7fc640 1 -- 172.21.15.19:0/1609615287 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f9120103ce0 msgr2=0x7f9120199340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:24:26.162 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:26.142+0000 7f911e7fc640 1 --2- 172.21.15.19:0/1609615287 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f9120103ce0 0x7f9120199340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:24:26.162 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:26.142+0000 7f911e7fc640 1 -- 172.21.15.19:0/1609615287 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f912010d140 msgr2=0x7f912019ec20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:24:26.162 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:26.142+0000 7f911e7fc640 1 --2- 172.21.15.19:0/1609615287 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f912010d140 0x7f912019ec20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:24:26.162 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:26.142+0000 7f911e7fc640 1 -- 172.21.15.19:0/1609615287 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f912019f3f0 con 0x7f9120104600 2024-09-10T22:24:26.162 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:26.142+0000 7f911f7fe640 1 --2- 172.21.15.19:0/1609615287 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f912010d140 0x7f912019ec20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T22:24:26.162 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:26.143+0000 7f911e7fc640 1 --2- 172.21.15.19:0/1609615287 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9120104600 0x7f9120199880 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f910800b3c0 tx=0x7f910800b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:24:26.162 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:26.143+0000 7f9117fff640 1 -- 172.21.15.19:0/1609615287 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9108011830 con 0x7f9120104600 2024-09-10T22:24:26.162 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:26.143+0000 7f9117fff640 1 -- 172.21.15.19:0/1609615287 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9108016070 con 0x7f9120104600 2024-09-10T22:24:26.162 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:26.143+0000 7f9125589640 1 -- 172.21.15.19:0/1609615287 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f912019f6e0 con 0x7f9120104600 2024-09-10T22:24:26.162 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:26.143+0000 7f9117fff640 1 -- 172.21.15.19:0/1609615287 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9108010de0 con 0x7f9120104600 2024-09-10T22:24:26.162 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:26.143+0000 7f9125589640 1 -- 172.21.15.19:0/1609615287 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f91201a5da0 con 0x7f9120104600 2024-09-10T22:24:26.162 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:26.144+0000 7f9125589640 1 -- 172.21.15.19:0/1609615287 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f91201040c0 con 0x7f9120104600 2024-09-10T22:24:26.162 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:26.146+0000 7f9117fff640 1 -- 172.21.15.19:0/1609615287 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 16) ==== 153250+0+0 (secure 0 0 0) 0x7f91080119d0 con 0x7f9120104600 2024-09-10T22:24:26.163 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:26.146+0000 7f9117fff640 1 --2- 172.21.15.19:0/1609615287 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f910c0b52e0 0x7f910c0b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:24:26.163 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:26.146+0000 7f911effd640 1 --2- 172.21.15.19:0/1609615287 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f910c0b52e0 0x7f910c0b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:24:26.163 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:26.146+0000 7f9117fff640 1 -- 172.21.15.19:0/1609615287 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 7979+0+0 (secure 0 0 0) 0x7f91080e5740 con 0x7f9120104600 2024-09-10T22:24:26.163 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:26.147+0000 7f911effd640 1 --2- 172.21.15.19:0/1609615287 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f910c0b52e0 0x7f910c0b77a0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f91100058c0 tx=0x7f911000a4c0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:24:26.163 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:26.149+0000 7f9117fff640 1 -- 172.21.15.19:0/1609615287 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f91080ac750 con 0x7f9120104600 2024-09-10T22:24:26.337 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:26.335+0000 7f9125589640 1 -- 172.21.15.19:0/1609615287 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f91201a6160 con 0x7f9120104600 2024-09-10T22:24:26.337 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:24:26 smithi019 ceph-mon[31375]: Health check cleared: POOL_APP_NOT_ENABLED (was: 2 pool(s) do not have an application enabled) 2024-09-10T22:24:26.337 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:24:26 smithi019 ceph-mon[31375]: Cluster is now healthy 2024-09-10T22:24:26.338 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:26.337+0000 7f9117fff640 1 -- 172.21.15.19:0/1609615287 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v73) ==== 74+0+22289 (secure 0 0 0) 0x7f91080cd7d0 con 0x7f9120104600 2024-09-10T22:24:26.339 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-10T22:24:26.339 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":73,"fsid":"22997a4c-6fc2-11ef-bcea-c7b262605968","created":"2024-09-10T22:16:16.754696+0000","modified":"2024-09-10T22:24:22.733974+0000","last_up_change":"2024-09-10T22:23:32.417392+0000","last_in_change":"2024-09-10T22:23:09.614371+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T22:19:50.731662+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-10T22:24:18.740121+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"73","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-10T22:24:20.795178+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"73","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"783d96cb-0a8a-47f3-8eab-77cd731a64bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6802","nonce":234761879},{"type":"v1","addr":"172.21.15.19:6803","nonce":234761879}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6804","nonce":234761879},{"type":"v1","addr":"172.21.15.19:6805","nonce":234761879}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6808","nonce":234761879},{"type":"v1","addr":"172.21.15.19:6809","nonce":234761879}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6806","nonce":234761879},{"type":"v1","addr":"172.21.15.19:6807","nonce":234761879}]},"public_addr":"172.21.15.19:6803/234761879","cluster_addr":"172.21.15.19:6805/234761879","heartbeat_back_addr":"172.21.15.19:6809/234761879","heartbeat_front_addr":"172.21.15.19:6807/234761879","state":["exists","up"]},{"osd":1,"uuid":"41043581-e0cf-43b5-bae0-0d95e2ef8156","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6800","nonce":1803526886},{"type":"v1","addr":"172.21.15.135:6801","nonce":1803526886}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6802","nonce":1803526886},{"type":"v1","addr":"172.21.15.135:6803","nonce":1803526886}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6806","nonce":1803526886},{"type":"v1","addr":"172.21.15.135:6807","nonce":1803526886}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6804","nonce":1803526886},{"type":"v1","addr":"172.21.15.135:6805","nonce":1803526886}]},"public_addr":"172.21.15.135:6801/1803526886","cluster_addr":"172.21.15.135:6803/1803526886","heartbeat_back_addr":"172.21.15.135:6807/1803526886","heartbeat_front_addr":"172.21.15.135:6805/1803526886","state":["exists","up"]},{"osd":2,"uuid":"a9b14a06-bbdc-4501-96e2-fb5f7127ca16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6800","nonce":2747418770},{"type":"v1","addr":"172.21.15.138:6801","nonce":2747418770}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6802","nonce":2747418770},{"type":"v1","addr":"172.21.15.138:6803","nonce":2747418770}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6806","nonce":2747418770},{"type":"v1","addr":"172.21.15.138:6807","nonce":2747418770}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6804","nonce":2747418770},{"type":"v1","addr":"172.21.15.138:6805","nonce":2747418770}]},"public_addr":"172.21.15.138:6801/2747418770","cluster_addr":"172.21.15.138:6803/2747418770","heartbeat_back_addr":"172.21.15.138:6807/2747418770","heartbeat_front_addr":"172.21.15.138:6805/2747418770","state":["exists","up"]},{"osd":3,"uuid":"a46268da-8666-4cfa-b11a-30eb12e271be","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":23,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6810","nonce":1889857224},{"type":"v1","addr":"172.21.15.19:6811","nonce":1889857224}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6812","nonce":1889857224},{"type":"v1","addr":"172.21.15.19:6813","nonce":1889857224}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6816","nonce":1889857224},{"type":"v1","addr":"172.21.15.19:6817","nonce":1889857224}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6814","nonce":1889857224},{"type":"v1","addr":"172.21.15.19:6815","nonce":1889857224}]},"public_addr":"172.21.15.19:6811/1889857224","cluster_addr":"172.21.15.19:6813/1889857224","heartbeat_back_addr":"172.21.15.19:6817/1889857224","heartbeat_front_addr":"172.21.15.19:6815/1889857224","state":["exists","up"]},{"osd":4,"uuid":"c58df06f-2de2-4655-88e7-ac6a3531839a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":29,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6808","nonce":436311825},{"type":"v1","addr":"172.21.15.135:6809","nonce":436311825}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6810","nonce":436311825},{"type":"v1","addr":"172.21.15.135:6811","nonce":436311825}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6814","nonce":436311825},{"type":"v1","addr":"172.21.15.135:6815","nonce":436311825}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6812","nonce":436311825},{"type":"v1","addr":"172.21.15.135:6813","nonce":436311825}]},"public_addr":"172.21.15.135:6809/436311825","cluster_addr":"172.21.15.135:6811/436311825","heartbeat_back_addr":"172.21.15.135:6815/436311825","heartbeat_front_addr":"172.21.15.135:6813/436311825","state":["exists","up"]},{"osd":5,"uuid":"c0900b0c-aef4-498d-a01b-a891bdb51122","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6808","nonce":1086764290},{"type":"v1","addr":"172.21.15.138:6809","nonce":1086764290}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6810","nonce":1086764290},{"type":"v1","addr":"172.21.15.138:6811","nonce":1086764290}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6814","nonce":1086764290},{"type":"v1","addr":"172.21.15.138:6815","nonce":1086764290}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6812","nonce":1086764290},{"type":"v1","addr":"172.21.15.138:6813","nonce":1086764290}]},"public_addr":"172.21.15.138:6809/1086764290","cluster_addr":"172.21.15.138:6811/1086764290","heartbeat_back_addr":"172.21.15.138:6815/1086764290","heartbeat_front_addr":"172.21.15.138:6813/1086764290","state":["exists","up"]},{"osd":6,"uuid":"f79cb310-8073-4ee5-80a6-87a290600321","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":40,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6818","nonce":406328354},{"type":"v1","addr":"172.21.15.19:6819","nonce":406328354}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6820","nonce":406328354},{"type":"v1","addr":"172.21.15.19:6821","nonce":406328354}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6824","nonce":406328354},{"type":"v1","addr":"172.21.15.19:6825","nonce":406328354}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6822","nonce":406328354},{"type":"v1","addr":"172.21.15.19:6823","nonce":406328354}]},"public_addr":"172.21.15.19:6819/406328354","cluster_addr":"172.21.15.19:6821/406328354","heartbeat_back_addr":"172.21.15.19:6825/406328354","heartbeat_front_addr":"172.21.15.19:6823/406328354","state":["exists","up"]},{"osd":7,"uuid":"cc76476a-92f3-489c-be9e-29cbbf39539e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6816","nonce":1096613674},{"type":"v1","addr":"172.21.15.135:6817","nonce":1096613674}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6818","nonce":1096613674},{"type":"v1","addr":"172.21.15.135:6819","nonce":1096613674}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6822","nonce":1096613674},{"type":"v1","addr":"172.21.15.135:6823","nonce":1096613674}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6820","nonce":1096613674},{"type":"v1","addr":"172.21.15.135:6821","nonce":1096613674}]},"public_addr":"172.21.15.135:6817/1096613674","cluster_addr":"172.21.15.135:6819/1096613674","heartbeat_back_addr":"172.21.15.135:6823/1096613674","heartbeat_front_addr":"172.21.15.135:6821/1096613674","state":["exists","up"]},{"osd":8,"uuid":"5323a006-a6e8-4403-9c51-65f46298d5c4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6816","nonce":3020394729},{"type":"v1","addr":"172.21.15.138:6817","nonce":3020394729}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6818","nonce":3020394729},{"type":"v1","addr":"172.21.15.138:6819","nonce":3020394729}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6822","nonce":3020394729},{"type":"v1","addr":"172.21.15.138:6823","nonce":3020394729}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6820","nonce":3020394729},{"type":"v1","addr":"172.21.15.138:6821","nonce":3020394729}]},"public_addr":"172.21.15.138:6817/3020394729","cluster_addr":"172.21.15.138:6819/3020394729","heartbeat_back_addr":"172.21.15.138:6823/3020394729","heartbeat_front_addr":"172.21.15.138:6821/3020394729","state":["exists","up"]},{"osd":9,"uuid":"b869ac42-c46e-442c-8b5b-f81c018e663c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":57,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6826","nonce":1488680899},{"type":"v1","addr":"172.21.15.19:6827","nonce":1488680899}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6828","nonce":1488680899},{"type":"v1","addr":"172.21.15.19:6829","nonce":1488680899}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6832","nonce":1488680899},{"type":"v1","addr":"172.21.15.19:6833","nonce":1488680899}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6830","nonce":1488680899},{"type":"v1","addr":"172.21.15.19:6831","nonce":1488680899}]},"public_addr":"172.21.15.19:6827/1488680899","cluster_addr":"172.21.15.19:6829/1488680899","heartbeat_back_addr":"172.21.15.19:6833/1488680899","heartbeat_front_addr":"172.21.15.19:6831/1488680899","state":["exists","up"]},{"osd":10,"uuid":"b8a2d69a-6821-4c69-b7eb-c0cfc8164614","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":62,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6824","nonce":3812626754},{"type":"v1","addr":"172.21.15.135:6825","nonce":3812626754}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6826","nonce":3812626754},{"type":"v1","addr":"172.21.15.135:6827","nonce":3812626754}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6830","nonce":3812626754},{"type":"v1","addr":"172.21.15.135:6831","nonce":3812626754}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6828","nonce":3812626754},{"type":"v1","addr":"172.21.15.135:6829","nonce":3812626754}]},"public_addr":"172.21.15.135:6825/3812626754","cluster_addr":"172.21.15.135:6827/3812626754","heartbeat_back_addr":"172.21.15.135:6831/3812626754","heartbeat_front_addr":"172.21.15.135:6829/3812626754","state":["exists","up"]},{"osd":11,"uuid":"a9264ab2-5843-44d2-aba8-1e12708e99d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6824","nonce":1098434807},{"type":"v1","addr":"172.21.15.138:6825","nonce":1098434807}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6826","nonce":1098434807},{"type":"v1","addr":"172.21.15.138:6827","nonce":1098434807}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6830","nonce":1098434807},{"type":"v1","addr":"172.21.15.138:6831","nonce":1098434807}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6828","nonce":1098434807},{"type":"v1","addr":"172.21.15.138:6829","nonce":1098434807}]},"public_addr":"172.21.15.138:6825/1098434807","cluster_addr":"172.21.15.138:6827/1098434807","heartbeat_back_addr":"172.21.15.138:6831/1098434807","heartbeat_front_addr":"172.21.15.138:6829/1098434807","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:18:58.008025+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:19:22.475890+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:19:47.124147+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:20:12.438853+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:20:37.195177+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:21:02.474248+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:21:27.087207+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:21:52.119211+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:22:16.569989+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:22:41.680986+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:23:06.391885+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:23:30.695460+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.19:0/2099468127":"2024-09-11T22:17:04.260826+0000","172.21.15.19:0/538724915":"2024-09-11T22:17:04.260826+0000","172.21.15.19:0/3504695777":"2024-09-11T22:17:04.260826+0000","172.21.15.19:0/1401613792":"2024-09-11T22:16:39.069638+0000","172.21.15.19:6801/3005924425":"2024-09-11T22:17:04.260826+0000","172.21.15.19:6800/3005924425":"2024-09-11T22:17:04.260826+0000","172.21.15.19:0/104917892":"2024-09-11T22:16:39.069638+0000","172.21.15.19:0/1778305990":"2024-09-11T22:16:39.069638+0000","172.21.15.19:6801/535670059":"2024-09-11T22:16:39.069638+0000","172.21.15.19:6800/535670059":"2024-09-11T22:16:39.069638+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T22:24:26.341 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:26.340+0000 7f9125589640 1 -- 172.21.15.19:0/1609615287 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f910c0b52e0 msgr2=0x7f910c0b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:24:26.341 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:26.340+0000 7f9125589640 1 --2- 172.21.15.19:0/1609615287 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f910c0b52e0 0x7f910c0b77a0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f91100058c0 tx=0x7f911000a4c0 comp rx=0 tx=0).stop 2024-09-10T22:24:26.341 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:26.340+0000 7f9125589640 1 -- 172.21.15.19:0/1609615287 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9120104600 msgr2=0x7f9120199880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:24:26.341 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:26.340+0000 7f9125589640 1 --2- 172.21.15.19:0/1609615287 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9120104600 0x7f9120199880 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f910800b3c0 tx=0x7f910800b880 comp rx=0 tx=0).stop 2024-09-10T22:24:26.341 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:26.340+0000 7f9125589640 1 -- 172.21.15.19:0/1609615287 shutdown_connections 2024-09-10T22:24:26.341 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:26.340+0000 7f9125589640 1 --2- 172.21.15.19:0/1609615287 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f910c0b52e0 0x7f910c0b77a0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:24:26.341 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:26.340+0000 7f9125589640 1 --2- 172.21.15.19:0/1609615287 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f912010d140 0x7f912019ec20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:24:26.342 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:26.340+0000 7f9125589640 1 --2- 172.21.15.19:0/1609615287 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9120104600 0x7f9120199880 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:24:26.342 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:26.340+0000 7f9125589640 1 --2- 172.21.15.19:0/1609615287 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f9120103ce0 0x7f9120199340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:24:26.342 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:26.340+0000 7f9125589640 1 -- 172.21.15.19:0/1609615287 >> 172.21.15.19:0/1609615287 conn(0x7f91200fd700 msgr2=0x7f91200fe300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:24:26.342 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:26.340+0000 7f9125589640 1 -- 172.21.15.19:0/1609615287 shutdown_connections 2024-09-10T22:24:26.342 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:26.340+0000 7f9125589640 1 -- 172.21.15.19:0/1609615287 wait complete. 2024-09-10T22:24:26.610 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:24:26 smithi135 ceph-mon[34789]: Health check cleared: POOL_APP_NOT_ENABLED (was: 2 pool(s) do not have an application enabled) 2024-09-10T22:24:26.610 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:24:26 smithi135 ceph-mon[34789]: Cluster is now healthy 2024-09-10T22:24:26.625 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:24:26 smithi138 ceph-mon[35236]: Health check cleared: POOL_APP_NOT_ENABLED (was: 2 pool(s) do not have an application enabled) 2024-09-10T22:24:26.625 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:24:26 smithi138 ceph-mon[35236]: Cluster is now healthy 2024-09-10T22:24:26.992 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 22997a4c-6fc2-11ef-bcea-c7b262605968 -- ceph fs set cephfs standby_count_wanted 0 2024-09-10T22:24:27.260 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/22997a4c-6fc2-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T22:24:27.458 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:24:27 smithi019 ceph-mon[31375]: from='client.? 172.21.15.19:0/1609615287' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-10T22:24:27.458 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:24:27 smithi019 ceph-mon[31375]: pgmap v284: 97 pgs: 8 creating+peering, 89 active+clean; 579 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s wr, 7 op/s 2024-09-10T22:24:27.610 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:24:27 smithi135 ceph-mon[34789]: from='client.? 172.21.15.19:0/1609615287' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-10T22:24:27.610 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:24:27 smithi135 ceph-mon[34789]: pgmap v284: 97 pgs: 8 creating+peering, 89 active+clean; 579 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s wr, 7 op/s 2024-09-10T22:24:27.625 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:24:27 smithi138 ceph-mon[35236]: from='client.? 172.21.15.19:0/1609615287' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-10T22:24:27.625 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:24:27 smithi138 ceph-mon[35236]: pgmap v284: 97 pgs: 8 creating+peering, 89 active+clean; 579 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s wr, 7 op/s 2024-09-10T22:24:27.744 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:27.742+0000 7fec50585640 1 -- 172.21.15.19:0/1118718048 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fec48103ce0 msgr2=0x7fec481040c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:24:27.744 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:27.742+0000 7fec50585640 1 --2- 172.21.15.19:0/1118718048 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fec48103ce0 0x7fec481040c0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fec44009900 tx=0x7fec4402a410 comp rx=0 tx=0).stop 2024-09-10T22:24:27.744 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:27.742+0000 7fec50585640 1 -- 172.21.15.19:0/1118718048 shutdown_connections 2024-09-10T22:24:27.744 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:27.742+0000 7fec50585640 1 --2- 172.21.15.19:0/1118718048 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fec4810d140 0x7fec4810f5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:24:27.744 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:27.742+0000 7fec50585640 1 --2- 172.21.15.19:0/1118718048 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fec48104600 0x7fec4810caf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:24:27.744 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:27.742+0000 7fec50585640 1 --2- 172.21.15.19:0/1118718048 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fec48103ce0 0x7fec481040c0 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:24:27.744 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:27.742+0000 7fec50585640 1 -- 172.21.15.19:0/1118718048 >> 172.21.15.19:0/1118718048 conn(0x7fec480fd700 msgr2=0x7fec480ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:24:27.744 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:27.742+0000 7fec50585640 1 -- 172.21.15.19:0/1118718048 shutdown_connections 2024-09-10T22:24:27.745 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:27.742+0000 7fec50585640 1 -- 172.21.15.19:0/1118718048 wait complete. 2024-09-10T22:24:27.749 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:27.743+0000 7fec50585640 1 Processor -- start 2024-09-10T22:24:27.749 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:27.743+0000 7fec50585640 1 -- start start 2024-09-10T22:24:27.751 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:27.743+0000 7fec50585640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fec48103ce0 0x7fec48199220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:24:27.751 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:27.743+0000 7fec50585640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fec48104600 0x7fec48199760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:24:27.752 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:27.743+0000 7fec50585640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fec4810d140 0x7fec4819eb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:24:27.752 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:27.743+0000 7fec50585640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fec48112db0 con 0x7fec48104600 2024-09-10T22:24:27.752 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:27.743+0000 7fec50585640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fec48112c30 con 0x7fec48103ce0 2024-09-10T22:24:27.752 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:27.743+0000 7fec50585640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7fec48112f30 con 0x7fec4810d140 2024-09-10T22:24:27.752 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:27.743+0000 7fec4db20640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fec48104600 0x7fec48199760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:24:27.752 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:27.743+0000 7fec4db20640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fec48104600 0x7fec48199760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:45120/0 (socket says 172.21.15.19:45120) 2024-09-10T22:24:27.752 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:27.743+0000 7fec4db20640 1 -- 172.21.15.19:0/315087101 learned_addr learned my addr 172.21.15.19:0/315087101 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:24:27.752 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:27.743+0000 7fec4eb22640 1 --2- 172.21.15.19:0/315087101 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fec4810d140 0x7fec4819eb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:24:27.752 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:27.743+0000 7fec4e321640 1 --2- 172.21.15.19:0/315087101 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fec48103ce0 0x7fec48199220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:24:27.752 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:27.743+0000 7fec4db20640 1 -- 172.21.15.19:0/315087101 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fec4810d140 msgr2=0x7fec4819eb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:24:27.752 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:27.744+0000 7fec4db20640 1 --2- 172.21.15.19:0/315087101 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fec4810d140 0x7fec4819eb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:24:27.752 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:27.744+0000 7fec4db20640 1 -- 172.21.15.19:0/315087101 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fec48103ce0 msgr2=0x7fec48199220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:24:27.752 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:27.744+0000 7fec4db20640 1 --2- 172.21.15.19:0/315087101 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fec48103ce0 0x7fec48199220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:24:27.753 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:27.744+0000 7fec4db20640 1 -- 172.21.15.19:0/315087101 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fec4819f2d0 con 0x7fec48104600 2024-09-10T22:24:27.753 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:27.744+0000 7fec4db20640 1 --2- 172.21.15.19:0/315087101 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fec48104600 0x7fec48199760 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fec3800c970 tx=0x7fec3800ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:24:27.753 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:27.744+0000 7fec3f7fe640 1 -- 172.21.15.19:0/315087101 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec38007bb0 con 0x7fec48104600 2024-09-10T22:24:27.753 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:27.744+0000 7fec3f7fe640 1 -- 172.21.15.19:0/315087101 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fec38007d50 con 0x7fec48104600 2024-09-10T22:24:27.753 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:27.744+0000 7fec3f7fe640 1 -- 172.21.15.19:0/315087101 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec3800f7b0 con 0x7fec48104600 2024-09-10T22:24:27.753 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:27.744+0000 7fec50585640 1 -- 172.21.15.19:0/315087101 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fec4819f5c0 con 0x7fec48104600 2024-09-10T22:24:27.753 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:27.744+0000 7fec50585640 1 -- 172.21.15.19:0/315087101 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fec481a5e50 con 0x7fec48104600 2024-09-10T22:24:27.753 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:27.745+0000 7fec50585640 1 -- 172.21.15.19:0/315087101 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fec4806bb90 con 0x7fec48104600 2024-09-10T22:24:27.753 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:27.746+0000 7fec3f7fe640 1 -- 172.21.15.19:0/315087101 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 16) ==== 153250+0+0 (secure 0 0 0) 0x7fec38020030 con 0x7fec48104600 2024-09-10T22:24:27.753 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:27.747+0000 7fec3f7fe640 1 --2- 172.21.15.19:0/315087101 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7fec340b5360 0x7fec340b7820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:24:27.753 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:27.747+0000 7fec4e321640 1 --2- 172.21.15.19:0/315087101 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7fec340b5360 0x7fec340b7820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:24:27.753 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:27.747+0000 7fec3f7fe640 1 -- 172.21.15.19:0/315087101 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 7979+0+0 (secure 0 0 0) 0x7fec380e5db0 con 0x7fec48104600 2024-09-10T22:24:27.753 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:27.748+0000 7fec4e321640 1 --2- 172.21.15.19:0/315087101 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7fec340b5360 0x7fec340b7820 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fec44031440 tx=0x7fec440095f0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:24:27.754 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:27.750+0000 7fec3f7fe640 1 -- 172.21.15.19:0/315087101 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7fec38026080 con 0x7fec48104600 2024-09-10T22:24:27.977 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:27.975+0000 7fec50585640 1 -- 172.21.15.19:0/315087101 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7fec4819a350 con 0x7fec48104600 2024-09-10T22:24:28.162 INFO:journalctl@ceph.mds.b.smithi135.stdout:Sep 10 22:24:27 smithi135 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-mds-b[65179]: 2024-09-10T22:24:27.894+0000 7fce051a8640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-10T22:24:28.169 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:28.168+0000 7fec3f7fe640 1 -- 172.21.15.19:0/315087101 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v17) ==== 118+0+0 (secure 0 0 0) 0x7fec380acdb0 con 0x7fec48104600 2024-09-10T22:24:28.172 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:28.170+0000 7fec50585640 1 -- 172.21.15.19:0/315087101 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7fec340b5360 msgr2=0x7fec340b7820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:24:28.172 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:28.170+0000 7fec50585640 1 --2- 172.21.15.19:0/315087101 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7fec340b5360 0x7fec340b7820 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fec44031440 tx=0x7fec440095f0 comp rx=0 tx=0).stop 2024-09-10T22:24:28.172 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:28.170+0000 7fec50585640 1 -- 172.21.15.19:0/315087101 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fec48104600 msgr2=0x7fec48199760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:24:28.172 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:28.170+0000 7fec50585640 1 --2- 172.21.15.19:0/315087101 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fec48104600 0x7fec48199760 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fec3800c970 tx=0x7fec3800ce30 comp rx=0 tx=0).stop 2024-09-10T22:24:28.172 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:28.170+0000 7fec50585640 1 -- 172.21.15.19:0/315087101 shutdown_connections 2024-09-10T22:24:28.172 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:28.170+0000 7fec50585640 1 --2- 172.21.15.19:0/315087101 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7fec340b5360 0x7fec340b7820 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:24:28.172 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:28.170+0000 7fec50585640 1 --2- 172.21.15.19:0/315087101 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fec4810d140 0x7fec4819eb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:24:28.172 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:28.170+0000 7fec50585640 1 --2- 172.21.15.19:0/315087101 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fec48104600 0x7fec48199760 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:24:28.172 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:28.170+0000 7fec50585640 1 --2- 172.21.15.19:0/315087101 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fec48103ce0 0x7fec48199220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:24:28.172 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:28.170+0000 7fec50585640 1 -- 172.21.15.19:0/315087101 >> 172.21.15.19:0/315087101 conn(0x7fec480fd700 msgr2=0x7fec4810f3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:24:28.172 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:28.170+0000 7fec50585640 1 -- 172.21.15.19:0/315087101 shutdown_connections 2024-09-10T22:24:28.172 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:28.170+0000 7fec50585640 1 -- 172.21.15.19:0/315087101 wait complete. 2024-09-10T22:24:28.458 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:24:28 smithi019 ceph-mon[31375]: from='client.? 172.21.15.19:0/315087101' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} : dispatch 2024-09-10T22:24:28.609 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:24:28 smithi135 ceph-mon[34789]: from='client.? 172.21.15.19:0/315087101' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} : dispatch 2024-09-10T22:24:28.625 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:24:28 smithi138 ceph-mon[35236]: from='client.? 172.21.15.19:0/315087101' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} : dispatch 2024-09-10T22:24:28.869 DEBUG:tasks.cephfs.filesystem:fs_config: {'max_mds': 3, 'session_timeout': 300, 'standby_replay': True, 'subvols': {'create': 2, 'subvol_options': '--size 25000000000'}} 2024-09-10T22:24:28.870 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 22997a4c-6fc2-11ef-bcea-c7b262605968 -- ceph fs set cephfs max_mds 3 2024-09-10T22:24:29.130 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/22997a4c-6fc2-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T22:24:29.428 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:24:29 smithi019 ceph-mon[31375]: from='client.? 172.21.15.19:0/315087101' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2024-09-10T22:24:29.428 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:24:29 smithi019 ceph-mon[31375]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-10T22:24:29.428 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:24:29 smithi019 ceph-mon[31375]: pgmap v285: 97 pgs: 97 active+clean; 579 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s wr, 6 op/s 2024-09-10T22:24:29.609 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:24:29 smithi135 ceph-mon[34789]: from='client.? 172.21.15.19:0/315087101' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2024-09-10T22:24:29.610 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:24:29 smithi135 ceph-mon[34789]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-10T22:24:29.610 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:24:29 smithi135 ceph-mon[34789]: pgmap v285: 97 pgs: 97 active+clean; 579 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s wr, 6 op/s 2024-09-10T22:24:29.624 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:24:29 smithi138 ceph-mon[35236]: from='client.? 172.21.15.19:0/315087101' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2024-09-10T22:24:29.625 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:24:29 smithi138 ceph-mon[35236]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-10T22:24:29.625 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:24:29 smithi138 ceph-mon[35236]: pgmap v285: 97 pgs: 97 active+clean; 579 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s wr, 6 op/s 2024-09-10T22:24:29.691 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:29.641+0000 7f8255158640 1 -- 172.21.15.19:0/1905992295 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f82501087d0 msgr2=0x7f8250108c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:24:29.691 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:29.641+0000 7f8255158640 1 --2- 172.21.15.19:0/1905992295 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f82501087d0 0x7f8250108c10 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f8244009900 tx=0x7f824402a410 comp rx=0 tx=0).stop 2024-09-10T22:24:29.691 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:29.641+0000 7f8255158640 1 -- 172.21.15.19:0/1905992295 shutdown_connections 2024-09-10T22:24:29.691 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:29.641+0000 7f8255158640 1 --2- 172.21.15.19:0/1905992295 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8250109150 0x7f825010f950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:24:29.691 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:29.641+0000 7f8255158640 1 --2- 172.21.15.19:0/1905992295 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f82501087d0 0x7f8250108c10 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:24:29.691 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:29.641+0000 7f8255158640 1 --2- 172.21.15.19:0/1905992295 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f8250102dc0 0x7f82501031a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:24:29.691 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:29.641+0000 7f8255158640 1 -- 172.21.15.19:0/1905992295 >> 172.21.15.19:0/1905992295 conn(0x7f82500fe830 msgr2=0x7f8250100c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:24:29.692 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:29.641+0000 7f8255158640 1 -- 172.21.15.19:0/1905992295 shutdown_connections 2024-09-10T22:24:29.692 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:29.641+0000 7f8255158640 1 -- 172.21.15.19:0/1905992295 wait complete. 2024-09-10T22:24:29.692 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:29.642+0000 7f8255158640 1 Processor -- start 2024-09-10T22:24:29.692 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:29.642+0000 7f8255158640 1 -- start start 2024-09-10T22:24:29.692 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:29.642+0000 7f8255158640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f8250102dc0 0x7f8250199340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:24:29.692 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:29.642+0000 7f8255158640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f82501087d0 0x7f8250199880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:24:29.692 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:29.642+0000 7f8255158640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8250109150 0x7f825019ec20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:24:29.692 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:29.642+0000 7f8255158640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f8250112e10 con 0x7f82501087d0 2024-09-10T22:24:29.692 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:29.642+0000 7f8255158640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f8250112c90 con 0x7f8250109150 2024-09-10T22:24:29.692 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:29.642+0000 7f8255158640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f8250112f90 con 0x7f8250102dc0 2024-09-10T22:24:29.692 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:29.642+0000 7f824e59c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f82501087d0 0x7f8250199880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:24:29.692 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:29.642+0000 7f824e59c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f82501087d0 0x7f8250199880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:45130/0 (socket says 172.21.15.19:45130) 2024-09-10T22:24:29.693 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:29.642+0000 7f824e59c640 1 -- 172.21.15.19:0/3502747452 learned_addr learned my addr 172.21.15.19:0/3502747452 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:24:29.693 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:29.642+0000 7f824ed9d640 1 --2- 172.21.15.19:0/3502747452 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f8250102dc0 0x7f8250199340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:24:29.693 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:29.643+0000 7f824f59e640 1 --2- 172.21.15.19:0/3502747452 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8250109150 0x7f825019ec20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:24:29.693 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:29.643+0000 7f824e59c640 1 -- 172.21.15.19:0/3502747452 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f8250102dc0 msgr2=0x7f8250199340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:24:29.693 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:29.643+0000 7f824e59c640 1 --2- 172.21.15.19:0/3502747452 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f8250102dc0 0x7f8250199340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:24:29.693 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:29.643+0000 7f824e59c640 1 -- 172.21.15.19:0/3502747452 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8250109150 msgr2=0x7f825019ec20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:24:29.693 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:29.643+0000 7f824e59c640 1 --2- 172.21.15.19:0/3502747452 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8250109150 0x7f825019ec20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:24:29.693 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:29.643+0000 7f824e59c640 1 -- 172.21.15.19:0/3502747452 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f825019f3f0 con 0x7f82501087d0 2024-09-10T22:24:29.693 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:29.643+0000 7f824f59e640 1 --2- 172.21.15.19:0/3502747452 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8250109150 0x7f825019ec20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T22:24:29.693 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:29.643+0000 7f824e59c640 1 --2- 172.21.15.19:0/3502747452 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f82501087d0 0x7f8250199880 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f8244005940 tx=0x7f82440042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:24:29.693 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:29.643+0000 7f8237fff640 1 -- 172.21.15.19:0/3502747452 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f824403f030 con 0x7f82501087d0 2024-09-10T22:24:29.693 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:29.643+0000 7f8237fff640 1 -- 172.21.15.19:0/3502747452 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8244003cb0 con 0x7f82501087d0 2024-09-10T22:24:29.694 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:29.643+0000 7f8255158640 1 -- 172.21.15.19:0/3502747452 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f825019f680 con 0x7f82501087d0 2024-09-10T22:24:29.694 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:29.643+0000 7f8237fff640 1 -- 172.21.15.19:0/3502747452 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8244035070 con 0x7f82501087d0 2024-09-10T22:24:29.694 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:29.643+0000 7f8255158640 1 -- 172.21.15.19:0/3502747452 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f82501a5da0 con 0x7f82501087d0 2024-09-10T22:24:29.694 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:29.644+0000 7f8255158640 1 -- 172.21.15.19:0/3502747452 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f82501031a0 con 0x7f82501087d0 2024-09-10T22:24:29.694 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:29.646+0000 7f8237fff640 1 -- 172.21.15.19:0/3502747452 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 16) ==== 153250+0+0 (secure 0 0 0) 0x7f824403bbf0 con 0x7f82501087d0 2024-09-10T22:24:29.694 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:29.646+0000 7f8237fff640 1 --2- 172.21.15.19:0/3502747452 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f82380b52e0 0x7f82380b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:24:29.694 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:29.646+0000 7f824ed9d640 1 --2- 172.21.15.19:0/3502747452 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f82380b52e0 0x7f82380b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:24:29.694 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:29.646+0000 7f8237fff640 1 -- 172.21.15.19:0/3502747452 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 7979+0+0 (secure 0 0 0) 0x7f82441062a0 con 0x7f82501087d0 2024-09-10T22:24:29.694 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:29.647+0000 7f824ed9d640 1 --2- 172.21.15.19:0/3502747452 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f82380b52e0 0x7f82380b77a0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f8240005fd0 tx=0x7f824000b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:24:29.694 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:29.650+0000 7f8237fff640 1 -- 172.21.15.19:0/3502747452 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f82440cd2b0 con 0x7f82501087d0 2024-09-10T22:24:29.877 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:29.876+0000 7f8255158640 1 -- 172.21.15.19:0/3502747452 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"} v 0) -- 0x7f825010af30 con 0x7f82501087d0 2024-09-10T22:24:30.182 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:30.181+0000 7f8237fff640 1 -- 172.21.15.19:0/3502747452 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]=0 v18) ==== 105+0+0 (secure 0 0 0) 0x7f82440ccbb0 con 0x7f82501087d0 2024-09-10T22:24:30.185 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:30.183+0000 7f8255158640 1 -- 172.21.15.19:0/3502747452 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f82380b52e0 msgr2=0x7f82380b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:24:30.185 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:30.183+0000 7f8255158640 1 --2- 172.21.15.19:0/3502747452 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f82380b52e0 0x7f82380b77a0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f8240005fd0 tx=0x7f824000b390 comp rx=0 tx=0).stop 2024-09-10T22:24:30.185 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:30.183+0000 7f8255158640 1 -- 172.21.15.19:0/3502747452 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f82501087d0 msgr2=0x7f8250199880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:24:30.185 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:30.183+0000 7f8255158640 1 --2- 172.21.15.19:0/3502747452 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f82501087d0 0x7f8250199880 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f8244005940 tx=0x7f82440042f0 comp rx=0 tx=0).stop 2024-09-10T22:24:30.185 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:30.184+0000 7f8255158640 1 -- 172.21.15.19:0/3502747452 shutdown_connections 2024-09-10T22:24:30.185 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:30.184+0000 7f8255158640 1 --2- 172.21.15.19:0/3502747452 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f82380b52e0 0x7f82380b77a0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:24:30.185 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:30.184+0000 7f8255158640 1 --2- 172.21.15.19:0/3502747452 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8250109150 0x7f825019ec20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:24:30.185 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:30.184+0000 7f8255158640 1 --2- 172.21.15.19:0/3502747452 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f82501087d0 0x7f8250199880 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:24:30.185 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:30.184+0000 7f8255158640 1 --2- 172.21.15.19:0/3502747452 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f8250102dc0 0x7f8250199340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:24:30.186 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:30.184+0000 7f8255158640 1 -- 172.21.15.19:0/3502747452 >> 172.21.15.19:0/3502747452 conn(0x7f82500fe830 msgr2=0x7f8250100c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:24:30.186 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:30.184+0000 7f8255158640 1 -- 172.21.15.19:0/3502747452 shutdown_connections 2024-09-10T22:24:30.186 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:30.184+0000 7f8255158640 1 -- 172.21.15.19:0/3502747452 wait complete. 2024-09-10T22:24:30.458 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:24:30 smithi019 ceph-mon[31375]: from='client.? 172.21.15.19:0/3502747452' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"} : dispatch 2024-09-10T22:24:30.609 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:24:30 smithi135 ceph-mon[34789]: from='client.? 172.21.15.19:0/3502747452' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"} : dispatch 2024-09-10T22:24:30.625 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:24:30 smithi138 ceph-mon[35236]: from='client.? 172.21.15.19:0/3502747452' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"} : dispatch 2024-09-10T22:24:30.903 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 22997a4c-6fc2-11ef-bcea-c7b262605968 -- ceph fs set cephfs allow_standby_replay true 2024-09-10T22:24:31.168 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/22997a4c-6fc2-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T22:24:31.360 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:24:31 smithi135 ceph-mon[34789]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-09-10T22:24:31.360 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:24:31 smithi135 ceph-mon[34789]: from='client.? 172.21.15.19:0/3502747452' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]': finished 2024-09-10T22:24:31.360 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:24:31 smithi135 ceph-mon[34789]: daemon mds.i assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2024-09-10T22:24:31.360 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:24:31 smithi135 ceph-mon[34789]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-10T22:24:31.360 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:24:31 smithi135 ceph-mon[34789]: fsmap cephfs:2 {0=b=up:active,1=i=up:creating} 10 up:standby 2024-09-10T22:24:31.360 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:24:31 smithi135 ceph-mon[34789]: daemon mds.i is now active in filesystem cephfs as rank 1 2024-09-10T22:24:31.360 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:24:31 smithi135 ceph-mon[34789]: pgmap v286: 97 pgs: 97 active+clean; 579 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s wr, 5 op/s 2024-09-10T22:24:31.375 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:24:31 smithi138 ceph-mon[35236]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-09-10T22:24:31.375 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:24:31 smithi138 ceph-mon[35236]: from='client.? 172.21.15.19:0/3502747452' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]': finished 2024-09-10T22:24:31.375 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:24:31 smithi138 ceph-mon[35236]: daemon mds.i assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2024-09-10T22:24:31.375 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:24:31 smithi138 ceph-mon[35236]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-10T22:24:31.375 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:24:31 smithi138 ceph-mon[35236]: fsmap cephfs:2 {0=b=up:active,1=i=up:creating} 10 up:standby 2024-09-10T22:24:31.375 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:24:31 smithi138 ceph-mon[35236]: daemon mds.i is now active in filesystem cephfs as rank 1 2024-09-10T22:24:31.375 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:24:31 smithi138 ceph-mon[35236]: pgmap v286: 97 pgs: 97 active+clean; 579 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s wr, 5 op/s 2024-09-10T22:24:31.441 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:24:31 smithi019 ceph-mon[31375]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-09-10T22:24:31.442 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:24:31 smithi019 ceph-mon[31375]: from='client.? 172.21.15.19:0/3502747452' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]': finished 2024-09-10T22:24:31.442 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:24:31 smithi019 ceph-mon[31375]: daemon mds.i assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2024-09-10T22:24:31.442 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:24:31 smithi019 ceph-mon[31375]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-10T22:24:31.442 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:24:31 smithi019 ceph-mon[31375]: fsmap cephfs:2 {0=b=up:active,1=i=up:creating} 10 up:standby 2024-09-10T22:24:31.442 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:24:31 smithi019 ceph-mon[31375]: daemon mds.i is now active in filesystem cephfs as rank 1 2024-09-10T22:24:31.442 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:24:31 smithi019 ceph-mon[31375]: pgmap v286: 97 pgs: 97 active+clean; 579 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s wr, 5 op/s 2024-09-10T22:24:31.665 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:31.658+0000 7f678a078640 1 -- 172.21.15.19:0/2082361371 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f67841076a0 msgr2=0x7f6784107ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:24:31.665 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:31.658+0000 7f678a078640 1 --2- 172.21.15.19:0/2082361371 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f67841076a0 0x7f6784107ae0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f676c009900 tx=0x7f676c02a410 comp rx=0 tx=0).stop 2024-09-10T22:24:31.666 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:31.658+0000 7f678a078640 1 -- 172.21.15.19:0/2082361371 shutdown_connections 2024-09-10T22:24:31.666 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:31.658+0000 7f678a078640 1 --2- 172.21.15.19:0/2082361371 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f6784108020 0x7f678410e820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:24:31.666 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:31.658+0000 7f678a078640 1 --2- 172.21.15.19:0/2082361371 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f67841076a0 0x7f6784107ae0 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:24:31.666 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:31.658+0000 7f678a078640 1 --2- 172.21.15.19:0/2082361371 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6784101c90 0x7f6784102070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:24:31.666 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:31.658+0000 7f678a078640 1 -- 172.21.15.19:0/2082361371 >> 172.21.15.19:0/2082361371 conn(0x7f67840fd700 msgr2=0x7f67840ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:24:31.666 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:31.658+0000 7f678a078640 1 -- 172.21.15.19:0/2082361371 shutdown_connections 2024-09-10T22:24:31.666 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:31.658+0000 7f678a078640 1 -- 172.21.15.19:0/2082361371 wait complete. 2024-09-10T22:24:31.666 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:31.659+0000 7f678a078640 1 Processor -- start 2024-09-10T22:24:31.666 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:31.659+0000 7f678a078640 1 -- start start 2024-09-10T22:24:31.666 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:31.659+0000 7f678a078640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f6784101c90 0x7f67840fdc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:24:31.666 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:31.659+0000 7f678a078640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f67841076a0 0x7f67840fe140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:24:31.666 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:31.659+0000 7f678a078640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6784108020 0x7f67840fe680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:24:31.666 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:31.659+0000 7f678a078640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f6784111ca0 con 0x7f67841076a0 2024-09-10T22:24:31.666 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:31.659+0000 7f678a078640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f6784111b20 con 0x7f6784108020 2024-09-10T22:24:31.667 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:31.659+0000 7f678a078640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f6784111e20 con 0x7f6784101c90 2024-09-10T22:24:31.667 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:31.659+0000 7f6782ffd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f67841076a0 0x7f67840fe140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:24:31.667 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:31.659+0000 7f6782ffd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f67841076a0 0x7f67840fe140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:45138/0 (socket says 172.21.15.19:45138) 2024-09-10T22:24:31.667 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:31.659+0000 7f6782ffd640 1 -- 172.21.15.19:0/2945722358 learned_addr learned my addr 172.21.15.19:0/2945722358 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:24:31.667 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:31.659+0000 7f67837fe640 1 --2- 172.21.15.19:0/2945722358 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f6784101c90 0x7f67840fdc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:24:31.667 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:31.660+0000 7f6783fff640 1 --2- 172.21.15.19:0/2945722358 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6784108020 0x7f67840fe680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:24:31.667 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:31.660+0000 7f6782ffd640 1 -- 172.21.15.19:0/2945722358 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f6784101c90 msgr2=0x7f67840fdc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:24:31.667 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:31.660+0000 7f6782ffd640 1 --2- 172.21.15.19:0/2945722358 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f6784101c90 0x7f67840fdc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:24:31.667 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:31.660+0000 7f6782ffd640 1 -- 172.21.15.19:0/2945722358 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6784108020 msgr2=0x7f67840fe680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:24:31.667 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:31.660+0000 7f6782ffd640 1 --2- 172.21.15.19:0/2945722358 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6784108020 0x7f67840fe680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:24:31.667 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:31.660+0000 7f6782ffd640 1 -- 172.21.15.19:0/2945722358 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f67841a7660 con 0x7f67841076a0 2024-09-10T22:24:31.667 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:31.660+0000 7f6782ffd640 1 --2- 172.21.15.19:0/2945722358 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f67841076a0 0x7f67840fe140 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f676c005940 tx=0x7f676c0042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:24:31.667 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:31.660+0000 7f6780ff9640 1 -- 172.21.15.19:0/2945722358 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f676c03f030 con 0x7f67841076a0 2024-09-10T22:24:31.668 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:31.660+0000 7f678a078640 1 -- 172.21.15.19:0/2945722358 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f67841a78f0 con 0x7f67841076a0 2024-09-10T22:24:31.668 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:31.660+0000 7f6780ff9640 1 -- 172.21.15.19:0/2945722358 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f676c003cb0 con 0x7f67841076a0 2024-09-10T22:24:31.668 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:31.660+0000 7f6780ff9640 1 -- 172.21.15.19:0/2945722358 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f676c035070 con 0x7f67841076a0 2024-09-10T22:24:31.668 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:31.660+0000 7f678a078640 1 -- 172.21.15.19:0/2945722358 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f67841a7e20 con 0x7f67841076a0 2024-09-10T22:24:31.668 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:31.661+0000 7f678a078640 1 -- 172.21.15.19:0/2945722358 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6784102070 con 0x7f67841076a0 2024-09-10T22:24:31.668 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:31.663+0000 7f6780ff9640 1 -- 172.21.15.19:0/2945722358 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 16) ==== 153250+0+0 (secure 0 0 0) 0x7f676c003800 con 0x7f67841076a0 2024-09-10T22:24:31.668 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:31.664+0000 7f6780ff9640 1 --2- 172.21.15.19:0/2945722358 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f67700b52e0 0x7f67700b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:24:31.668 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:31.664+0000 7f67837fe640 1 --2- 172.21.15.19:0/2945722358 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f67700b52e0 0x7f67700b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:24:31.668 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:31.664+0000 7f6780ff9640 1 -- 172.21.15.19:0/2945722358 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 7979+0+0 (secure 0 0 0) 0x7f676c106940 con 0x7f67841076a0 2024-09-10T22:24:31.668 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:31.664+0000 7f67837fe640 1 --2- 172.21.15.19:0/2945722358 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f67700b52e0 0x7f67700b77a0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f677400abe0 tx=0x7f677400a2d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:24:31.669 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:31.667+0000 7f6780ff9640 1 -- 172.21.15.19:0/2945722358 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f676c0cd8b0 con 0x7f67841076a0 2024-09-10T22:24:31.895 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:31.893+0000 7f678a078640 1 -- 172.21.15.19:0/2945722358 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"} v 0) -- 0x7f67840fef00 con 0x7f67841076a0 2024-09-10T22:24:32.206 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:32.205+0000 7f6780ff9640 1 -- 172.21.15.19:0/2945722358 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]=0 v22) ==== 121+0+0 (secure 0 0 0) 0x7f676c0cd1b0 con 0x7f67841076a0 2024-09-10T22:24:32.209 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:32.208+0000 7f678a078640 1 -- 172.21.15.19:0/2945722358 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f67700b52e0 msgr2=0x7f67700b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:24:32.209 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:32.208+0000 7f678a078640 1 --2- 172.21.15.19:0/2945722358 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f67700b52e0 0x7f67700b77a0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f677400abe0 tx=0x7f677400a2d0 comp rx=0 tx=0).stop 2024-09-10T22:24:32.210 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:32.208+0000 7f678a078640 1 -- 172.21.15.19:0/2945722358 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f67841076a0 msgr2=0x7f67840fe140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:24:32.210 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:32.208+0000 7f678a078640 1 --2- 172.21.15.19:0/2945722358 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f67841076a0 0x7f67840fe140 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f676c005940 tx=0x7f676c0042f0 comp rx=0 tx=0).stop 2024-09-10T22:24:32.210 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:32.208+0000 7f678a078640 1 -- 172.21.15.19:0/2945722358 shutdown_connections 2024-09-10T22:24:32.210 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:32.208+0000 7f678a078640 1 --2- 172.21.15.19:0/2945722358 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f67700b52e0 0x7f67700b77a0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:24:32.210 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:32.208+0000 7f678a078640 1 --2- 172.21.15.19:0/2945722358 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6784108020 0x7f67840fe680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:24:32.210 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:32.208+0000 7f678a078640 1 --2- 172.21.15.19:0/2945722358 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f67841076a0 0x7f67840fe140 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:24:32.210 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:32.208+0000 7f678a078640 1 --2- 172.21.15.19:0/2945722358 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f6784101c90 0x7f67840fdc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:24:32.210 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:32.208+0000 7f678a078640 1 -- 172.21.15.19:0/2945722358 >> 172.21.15.19:0/2945722358 conn(0x7f67840fd700 msgr2=0x7f6784104c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:24:32.210 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:32.208+0000 7f678a078640 1 -- 172.21.15.19:0/2945722358 shutdown_connections 2024-09-10T22:24:32.210 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:32.208+0000 7f678a078640 1 -- 172.21.15.19:0/2945722358 wait complete. 2024-09-10T22:24:32.458 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:24:32 smithi019 ceph-mon[31375]: mds.? [v2:172.21.15.138:6838/383637208,v1:172.21.15.138:6839/383637208] up:active 2024-09-10T22:24:32.458 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:24:32 smithi019 ceph-mon[31375]: daemon mds.c assigned to filesystem cephfs as rank 2 (now has 3 ranks) 2024-09-10T22:24:32.458 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:24:32 smithi019 ceph-mon[31375]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-09-10T22:24:32.458 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:24:32 smithi019 ceph-mon[31375]: Cluster is now healthy 2024-09-10T22:24:32.459 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:24:32 smithi019 ceph-mon[31375]: fsmap cephfs:2 {0=b=up:active,1=i=up:active} 10 up:standby 2024-09-10T22:24:32.459 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:24:32 smithi019 ceph-mon[31375]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:creating} 9 up:standby 2024-09-10T22:24:32.459 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:24:32 smithi019 ceph-mon[31375]: daemon mds.c is now active in filesystem cephfs as rank 2 2024-09-10T22:24:32.459 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:24:32 smithi019 ceph-mon[31375]: from='client.? 172.21.15.19:0/2945722358' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"} : dispatch 2024-09-10T22:24:32.610 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:24:32 smithi135 ceph-mon[34789]: mds.? [v2:172.21.15.138:6838/383637208,v1:172.21.15.138:6839/383637208] up:active 2024-09-10T22:24:32.610 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:24:32 smithi135 ceph-mon[34789]: daemon mds.c assigned to filesystem cephfs as rank 2 (now has 3 ranks) 2024-09-10T22:24:32.610 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:24:32 smithi135 ceph-mon[34789]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-09-10T22:24:32.610 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:24:32 smithi135 ceph-mon[34789]: Cluster is now healthy 2024-09-10T22:24:32.610 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:24:32 smithi135 ceph-mon[34789]: fsmap cephfs:2 {0=b=up:active,1=i=up:active} 10 up:standby 2024-09-10T22:24:32.610 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:24:32 smithi135 ceph-mon[34789]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:creating} 9 up:standby 2024-09-10T22:24:32.610 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:24:32 smithi135 ceph-mon[34789]: daemon mds.c is now active in filesystem cephfs as rank 2 2024-09-10T22:24:32.610 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:24:32 smithi135 ceph-mon[34789]: from='client.? 172.21.15.19:0/2945722358' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"} : dispatch 2024-09-10T22:24:32.625 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:24:32 smithi138 ceph-mon[35236]: mds.? [v2:172.21.15.138:6838/383637208,v1:172.21.15.138:6839/383637208] up:active 2024-09-10T22:24:32.625 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:24:32 smithi138 ceph-mon[35236]: daemon mds.c assigned to filesystem cephfs as rank 2 (now has 3 ranks) 2024-09-10T22:24:32.625 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:24:32 smithi138 ceph-mon[35236]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-09-10T22:24:32.625 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:24:32 smithi138 ceph-mon[35236]: Cluster is now healthy 2024-09-10T22:24:32.625 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:24:32 smithi138 ceph-mon[35236]: fsmap cephfs:2 {0=b=up:active,1=i=up:active} 10 up:standby 2024-09-10T22:24:32.625 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:24:32 smithi138 ceph-mon[35236]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:creating} 9 up:standby 2024-09-10T22:24:32.625 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:24:32 smithi138 ceph-mon[35236]: daemon mds.c is now active in filesystem cephfs as rank 2 2024-09-10T22:24:32.625 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:24:32 smithi138 ceph-mon[35236]: from='client.? 172.21.15.19:0/2945722358' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"} : dispatch 2024-09-10T22:24:32.852 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 22997a4c-6fc2-11ef-bcea-c7b262605968 -- ceph fs set cephfs session_timeout 300 2024-09-10T22:24:33.115 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/22997a4c-6fc2-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T22:24:33.209 INFO:journalctl@ceph.mds.b.smithi135.stdout:Sep 10 22:24:32 smithi135 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-mds-b[65179]: 2024-09-10T22:24:32.894+0000 7fce051a8640 -1 mds.pinger is_rank_lagging: rank=1 was never sent ping request. 2024-09-10T22:24:33.209 INFO:journalctl@ceph.mds.b.smithi135.stdout:Sep 10 22:24:32 smithi135 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-mds-b[65179]: 2024-09-10T22:24:32.894+0000 7fce051a8640 -1 mds.pinger is_rank_lagging: rank=2 was never sent ping request. 2024-09-10T22:24:33.481 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:24:33 smithi019 ceph-mon[31375]: from='client.? 172.21.15.19:0/2945722358' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-09-10T22:24:33.481 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:24:33 smithi019 ceph-mon[31375]: mds.? [v2:172.21.15.138:6836/3353290042,v1:172.21.15.138:6837/3353290042] up:active 2024-09-10T22:24:33.481 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:24:33 smithi019 ceph-mon[31375]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 9 up:standby 2024-09-10T22:24:33.481 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:24:33 smithi019 ceph-mon[31375]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-09-10T22:24:33.481 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:24:33 smithi019 ceph-mon[31375]: pgmap v287: 97 pgs: 97 active+clean; 579 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s wr, 5 op/s 2024-09-10T22:24:33.590 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:33.563+0000 7f44bc37a640 1 -- 172.21.15.19:0/959475420 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f44b41076e0 msgr2=0x7f44b4107b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:24:33.590 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:33.563+0000 7f44bc37a640 1 --2- 172.21.15.19:0/959475420 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f44b41076e0 0x7f44b4107b20 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f44a4009900 tx=0x7f44a402a410 comp rx=0 tx=0).stop 2024-09-10T22:24:33.591 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:33.563+0000 7f44bc37a640 1 -- 172.21.15.19:0/959475420 shutdown_connections 2024-09-10T22:24:33.591 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:33.563+0000 7f44bc37a640 1 --2- 172.21.15.19:0/959475420 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f44b4108060 0x7f44b410e860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:24:33.591 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:33.563+0000 7f44bc37a640 1 --2- 172.21.15.19:0/959475420 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f44b41076e0 0x7f44b4107b20 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:24:33.591 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:33.563+0000 7f44bc37a640 1 --2- 172.21.15.19:0/959475420 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f44b4101cd0 0x7f44b41020b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:24:33.591 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:33.563+0000 7f44bc37a640 1 -- 172.21.15.19:0/959475420 >> 172.21.15.19:0/959475420 conn(0x7f44b40fd700 msgr2=0x7f44b40ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:24:33.591 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:33.564+0000 7f44bc37a640 1 -- 172.21.15.19:0/959475420 shutdown_connections 2024-09-10T22:24:33.591 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:33.564+0000 7f44bc37a640 1 -- 172.21.15.19:0/959475420 wait complete. 2024-09-10T22:24:33.591 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:33.564+0000 7f44bc37a640 1 Processor -- start 2024-09-10T22:24:33.591 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:33.564+0000 7f44bc37a640 1 -- start start 2024-09-10T22:24:33.591 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:33.564+0000 7f44bc37a640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f44b4101cd0 0x7f44b41982d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:24:33.591 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:33.564+0000 7f44bc37a640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f44b41076e0 0x7f44b4198810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:24:33.591 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:33.564+0000 7f44bc37a640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f44b4108060 0x7f44b419dbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:24:33.591 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:33.564+0000 7f44bc37a640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f44b4111d60 con 0x7f44b41076e0 2024-09-10T22:24:33.592 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:33.564+0000 7f44bc37a640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f44b4111be0 con 0x7f44b4101cd0 2024-09-10T22:24:33.592 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:33.564+0000 7f44bc37a640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f44b4111ee0 con 0x7f44b4108060 2024-09-10T22:24:33.592 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:33.565+0000 7f44b9915640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f44b41076e0 0x7f44b4198810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:24:33.592 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:33.565+0000 7f44b9915640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f44b41076e0 0x7f44b4198810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:49648/0 (socket says 172.21.15.19:49648) 2024-09-10T22:24:33.592 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:33.565+0000 7f44b9915640 1 -- 172.21.15.19:0/2815912858 learned_addr learned my addr 172.21.15.19:0/2815912858 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:24:33.592 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:33.565+0000 7f44ba917640 1 --2- 172.21.15.19:0/2815912858 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f44b4108060 0x7f44b419dbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:24:33.592 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:33.565+0000 7f44ba116640 1 --2- 172.21.15.19:0/2815912858 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f44b4101cd0 0x7f44b41982d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:24:33.592 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:33.565+0000 7f44b9915640 1 -- 172.21.15.19:0/2815912858 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f44b4108060 msgr2=0x7f44b419dbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:24:33.592 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:33.565+0000 7f44b9915640 1 --2- 172.21.15.19:0/2815912858 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f44b4108060 0x7f44b419dbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:24:33.592 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:33.565+0000 7f44b9915640 1 -- 172.21.15.19:0/2815912858 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f44b4101cd0 msgr2=0x7f44b41982d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:24:33.592 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:33.565+0000 7f44b9915640 1 --2- 172.21.15.19:0/2815912858 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f44b4101cd0 0x7f44b41982d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:24:33.592 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:33.565+0000 7f44b9915640 1 -- 172.21.15.19:0/2815912858 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f44b419e380 con 0x7f44b41076e0 2024-09-10T22:24:33.593 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:33.565+0000 7f44ba917640 1 --2- 172.21.15.19:0/2815912858 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f44b4108060 0x7f44b419dbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T22:24:33.593 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:33.565+0000 7f44b9915640 1 --2- 172.21.15.19:0/2815912858 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f44b41076e0 0x7f44b4198810 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f44a4006010 tx=0x7f44a4004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:24:33.593 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:33.565+0000 7f44ab7fe640 1 -- 172.21.15.19:0/2815912858 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44a4035050 con 0x7f44b41076e0 2024-09-10T22:24:33.593 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:33.565+0000 7f44ab7fe640 1 -- 172.21.15.19:0/2815912858 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f44a40035f0 con 0x7f44b41076e0 2024-09-10T22:24:33.593 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:33.565+0000 7f44ab7fe640 1 -- 172.21.15.19:0/2815912858 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44a4032260 con 0x7f44b41076e0 2024-09-10T22:24:33.593 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:33.565+0000 7f44bc37a640 1 -- 172.21.15.19:0/2815912858 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f44b419e610 con 0x7f44b41076e0 2024-09-10T22:24:33.593 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:33.565+0000 7f44bc37a640 1 -- 172.21.15.19:0/2815912858 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f44b406b490 con 0x7f44b41076e0 2024-09-10T22:24:33.593 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:33.566+0000 7f44bc37a640 1 -- 172.21.15.19:0/2815912858 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f44b4102130 con 0x7f44b41076e0 2024-09-10T22:24:33.593 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:33.568+0000 7f44ab7fe640 1 -- 172.21.15.19:0/2815912858 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 16) ==== 153250+0+0 (secure 0 0 0) 0x7f44a4003aa0 con 0x7f44b41076e0 2024-09-10T22:24:33.593 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:33.569+0000 7f44ab7fe640 1 --2- 172.21.15.19:0/2815912858 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f44a00b52e0 0x7f44a00b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:24:33.593 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:33.569+0000 7f44ba116640 1 --2- 172.21.15.19:0/2815912858 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f44a00b52e0 0x7f44a00b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:24:33.593 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:33.569+0000 7f44ab7fe640 1 -- 172.21.15.19:0/2815912858 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 7979+0+0 (secure 0 0 0) 0x7f44a4107ce0 con 0x7f44b41076e0 2024-09-10T22:24:33.593 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:33.570+0000 7f44ba116640 1 --2- 172.21.15.19:0/2815912858 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f44a00b52e0 0x7f44a00b77a0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f44b0009890 tx=0x7f44b0008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:24:33.594 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:33.572+0000 7f44ab7fe640 1 -- 172.21.15.19:0/2815912858 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f44a40cecf0 con 0x7f44b41076e0 2024-09-10T22:24:33.609 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:24:33 smithi135 ceph-mon[34789]: from='client.? 172.21.15.19:0/2945722358' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-09-10T22:24:33.610 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:24:33 smithi135 ceph-mon[34789]: mds.? [v2:172.21.15.138:6836/3353290042,v1:172.21.15.138:6837/3353290042] up:active 2024-09-10T22:24:33.610 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:24:33 smithi135 ceph-mon[34789]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 9 up:standby 2024-09-10T22:24:33.610 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:24:33 smithi135 ceph-mon[34789]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-09-10T22:24:33.610 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:24:33 smithi135 ceph-mon[34789]: pgmap v287: 97 pgs: 97 active+clean; 579 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s wr, 5 op/s 2024-09-10T22:24:33.625 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:24:33 smithi138 ceph-mon[35236]: from='client.? 172.21.15.19:0/2945722358' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-09-10T22:24:33.625 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:24:33 smithi138 ceph-mon[35236]: mds.? [v2:172.21.15.138:6836/3353290042,v1:172.21.15.138:6837/3353290042] up:active 2024-09-10T22:24:33.625 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:24:33 smithi138 ceph-mon[35236]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 9 up:standby 2024-09-10T22:24:33.625 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:24:33 smithi138 ceph-mon[35236]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-09-10T22:24:33.625 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:24:33 smithi138 ceph-mon[35236]: pgmap v287: 97 pgs: 97 active+clean; 579 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s wr, 5 op/s 2024-09-10T22:24:33.797 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:33.796+0000 7f44bc37a640 1 -- 172.21.15.19:0/2815912858 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"} v 0) -- 0x7f44b406bfe0 con 0x7f44b41076e0 2024-09-10T22:24:34.227 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:34.225+0000 7f44ab7fe640 1 -- 172.21.15.19:0/2815912858 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]=0 v24) ==== 115+0+0 (secure 0 0 0) 0x7f44a40ce5f0 con 0x7f44b41076e0 2024-09-10T22:24:34.229 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:34.228+0000 7f44bc37a640 1 -- 172.21.15.19:0/2815912858 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f44a00b52e0 msgr2=0x7f44a00b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:24:34.230 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:34.228+0000 7f44bc37a640 1 --2- 172.21.15.19:0/2815912858 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f44a00b52e0 0x7f44a00b77a0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f44b0009890 tx=0x7f44b0008040 comp rx=0 tx=0).stop 2024-09-10T22:24:34.230 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:34.228+0000 7f44bc37a640 1 -- 172.21.15.19:0/2815912858 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f44b41076e0 msgr2=0x7f44b4198810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:24:34.230 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:34.228+0000 7f44bc37a640 1 --2- 172.21.15.19:0/2815912858 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f44b41076e0 0x7f44b4198810 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f44a4006010 tx=0x7f44a4004270 comp rx=0 tx=0).stop 2024-09-10T22:24:34.230 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:34.228+0000 7f44bc37a640 1 -- 172.21.15.19:0/2815912858 shutdown_connections 2024-09-10T22:24:34.230 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:34.228+0000 7f44bc37a640 1 --2- 172.21.15.19:0/2815912858 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f44a00b52e0 0x7f44a00b77a0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:24:34.230 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:34.228+0000 7f44bc37a640 1 --2- 172.21.15.19:0/2815912858 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f44b4108060 0x7f44b419dbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:24:34.230 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:34.228+0000 7f44bc37a640 1 --2- 172.21.15.19:0/2815912858 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f44b41076e0 0x7f44b4198810 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:24:34.230 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:34.228+0000 7f44bc37a640 1 --2- 172.21.15.19:0/2815912858 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f44b4101cd0 0x7f44b41982d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:24:34.230 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:34.228+0000 7f44bc37a640 1 -- 172.21.15.19:0/2815912858 >> 172.21.15.19:0/2815912858 conn(0x7f44b40fd700 msgr2=0x7f44b40ffaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:24:34.230 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:34.228+0000 7f44bc37a640 1 -- 172.21.15.19:0/2815912858 shutdown_connections 2024-09-10T22:24:34.230 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:34.228+0000 7f44bc37a640 1 -- 172.21.15.19:0/2815912858 wait complete. 2024-09-10T22:24:34.593 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:24:34 smithi019 ceph-mon[31375]: from='client.? 172.21.15.19:0/2815912858' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"} : dispatch 2024-09-10T22:24:34.609 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:24:34 smithi135 ceph-mon[34789]: from='client.? 172.21.15.19:0/2815912858' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"} : dispatch 2024-09-10T22:24:34.625 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:24:34 smithi138 ceph-mon[35236]: from='client.? 172.21.15.19:0/2815912858' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"} : dispatch 2024-09-10T22:24:35.016 DEBUG:tasks.cephfs.filesystem:Creating {'create': 2, 'subvol_options': '--size 25000000000'} subvols for filesystem 'cephfs' 2024-09-10T22:24:35.016 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 22997a4c-6fc2-11ef-bcea-c7b262605968 -- ceph fs subvolumegroup create cephfs qa 2024-09-10T22:24:35.283 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/22997a4c-6fc2-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T22:24:35.540 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:24:35 smithi019 ceph-mon[31375]: from='client.? 172.21.15.19:0/2815912858' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2024-09-10T22:24:35.540 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:24:35 smithi019 ceph-mon[31375]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-09-10T22:24:35.541 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:24:35 smithi019 ceph-mon[31375]: pgmap v288: 97 pgs: 97 active+clean; 579 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 546 B/s rd, 2.2 KiB/s wr, 8 op/s 2024-09-10T22:24:35.610 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:24:35 smithi135 ceph-mon[34789]: from='client.? 172.21.15.19:0/2815912858' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2024-09-10T22:24:35.610 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:24:35 smithi135 ceph-mon[34789]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-09-10T22:24:35.610 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:24:35 smithi135 ceph-mon[34789]: pgmap v288: 97 pgs: 97 active+clean; 579 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 546 B/s rd, 2.2 KiB/s wr, 8 op/s 2024-09-10T22:24:35.624 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:24:35 smithi138 ceph-mon[35236]: from='client.? 172.21.15.19:0/2815912858' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2024-09-10T22:24:35.625 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:24:35 smithi138 ceph-mon[35236]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-09-10T22:24:35.625 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:24:35 smithi138 ceph-mon[35236]: pgmap v288: 97 pgs: 97 active+clean; 579 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 546 B/s rd, 2.2 KiB/s wr, 8 op/s 2024-09-10T22:24:35.800 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:35.768+0000 7fafe45d4640 1 -- 172.21.15.19:0/414064736 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fafdc1045c0 msgr2=0x7fafdc10cab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:24:35.800 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:35.768+0000 7fafe45d4640 1 --2- 172.21.15.19:0/414064736 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fafdc1045c0 0x7fafdc10cab0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fafcc009900 tx=0x7fafcc02a410 comp rx=0 tx=0).stop 2024-09-10T22:24:35.800 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:35.768+0000 7fafe45d4640 1 -- 172.21.15.19:0/414064736 shutdown_connections 2024-09-10T22:24:35.800 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:35.768+0000 7fafe45d4640 1 --2- 172.21.15.19:0/414064736 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fafdc10d100 0x7fafdc10f560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:24:35.800 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:35.768+0000 7fafe45d4640 1 --2- 172.21.15.19:0/414064736 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fafdc1045c0 0x7fafdc10cab0 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:24:35.800 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:35.768+0000 7fafe45d4640 1 --2- 172.21.15.19:0/414064736 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fafdc103ca0 0x7fafdc104080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:24:35.800 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:35.768+0000 7fafe45d4640 1 -- 172.21.15.19:0/414064736 >> 172.21.15.19:0/414064736 conn(0x7fafdc0fd700 msgr2=0x7fafdc0ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:24:35.800 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:35.768+0000 7fafe45d4640 1 -- 172.21.15.19:0/414064736 shutdown_connections 2024-09-10T22:24:35.801 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:35.768+0000 7fafe45d4640 1 -- 172.21.15.19:0/414064736 wait complete. 2024-09-10T22:24:35.801 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:35.768+0000 7fafe45d4640 1 Processor -- start 2024-09-10T22:24:35.801 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:35.768+0000 7fafe45d4640 1 -- start start 2024-09-10T22:24:35.801 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:35.769+0000 7fafe45d4640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fafdc103ca0 0x7fafdc199250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:24:35.801 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:35.769+0000 7fafe45d4640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fafdc1045c0 0x7fafdc199790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:24:35.801 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:35.769+0000 7fafe45d4640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fafdc10d100 0x7fafdc19eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:24:35.801 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:35.769+0000 7fafe45d4640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fafdc112dc0 con 0x7fafdc10d100 2024-09-10T22:24:35.801 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:35.769+0000 7fafe45d4640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fafdc112c40 con 0x7fafdc103ca0 2024-09-10T22:24:35.801 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:35.769+0000 7fafe45d4640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7fafdc112f40 con 0x7fafdc1045c0 2024-09-10T22:24:35.801 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:35.769+0000 7fafe2b71640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fafdc10d100 0x7fafdc19eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:24:35.801 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:35.769+0000 7fafe2b71640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fafdc10d100 0x7fafdc19eb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:49664/0 (socket says 172.21.15.19:49664) 2024-09-10T22:24:35.802 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:35.769+0000 7fafe2b71640 1 -- 172.21.15.19:0/3171521454 learned_addr learned my addr 172.21.15.19:0/3171521454 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:24:35.802 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:35.769+0000 7fafe2370640 1 --2- 172.21.15.19:0/3171521454 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fafdc103ca0 0x7fafdc199250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:24:35.802 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:35.769+0000 7fafe1b6f640 1 --2- 172.21.15.19:0/3171521454 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fafdc1045c0 0x7fafdc199790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:24:35.802 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:35.769+0000 7fafe2b71640 1 -- 172.21.15.19:0/3171521454 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fafdc1045c0 msgr2=0x7fafdc199790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:24:35.802 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:35.769+0000 7fafe2b71640 1 --2- 172.21.15.19:0/3171521454 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fafdc1045c0 0x7fafdc199790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:24:35.802 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:35.769+0000 7fafe2b71640 1 -- 172.21.15.19:0/3171521454 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fafdc103ca0 msgr2=0x7fafdc199250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:24:35.802 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:35.769+0000 7fafe2b71640 1 --2- 172.21.15.19:0/3171521454 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fafdc103ca0 0x7fafdc199250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:24:35.802 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:35.769+0000 7fafe2b71640 1 -- 172.21.15.19:0/3171521454 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fafdc19f300 con 0x7fafdc10d100 2024-09-10T22:24:35.802 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:35.769+0000 7fafe1b6f640 1 --2- 172.21.15.19:0/3171521454 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fafdc1045c0 0x7fafdc199790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T22:24:35.802 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:35.769+0000 7fafe2b71640 1 --2- 172.21.15.19:0/3171521454 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fafdc10d100 0x7fafdc19eb30 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fafd400cce0 tx=0x7fafd400a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:24:35.802 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:35.769+0000 7fafd37fe640 1 -- 172.21.15.19:0/3171521454 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fafd400f450 con 0x7fafdc10d100 2024-09-10T22:24:35.802 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:35.769+0000 7fafd37fe640 1 -- 172.21.15.19:0/3171521454 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fafd400faa0 con 0x7fafdc10d100 2024-09-10T22:24:35.802 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:35.769+0000 7fafe45d4640 1 -- 172.21.15.19:0/3171521454 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fafdc19f5f0 con 0x7fafdc10d100 2024-09-10T22:24:35.803 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:35.770+0000 7fafd37fe640 1 -- 172.21.15.19:0/3171521454 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fafd4018b70 con 0x7fafdc10d100 2024-09-10T22:24:35.803 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:35.770+0000 7fafe45d4640 1 -- 172.21.15.19:0/3171521454 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fafdc1a5cb0 con 0x7fafdc10d100 2024-09-10T22:24:35.803 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:35.771+0000 7fafe45d4640 1 -- 172.21.15.19:0/3171521454 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fafdc06b1b0 con 0x7fafdc10d100 2024-09-10T22:24:35.803 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:35.772+0000 7fafd37fe640 1 -- 172.21.15.19:0/3171521454 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 16) ==== 153250+0+0 (secure 0 0 0) 0x7fafd400f5f0 con 0x7fafdc10d100 2024-09-10T22:24:35.803 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:35.773+0000 7fafd37fe640 1 --2- 172.21.15.19:0/3171521454 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7fafc80b5360 0x7fafc80b7820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:24:35.803 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:35.773+0000 7fafe2370640 1 --2- 172.21.15.19:0/3171521454 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7fafc80b5360 0x7fafc80b7820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:24:35.803 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:35.773+0000 7fafd37fe640 1 -- 172.21.15.19:0/3171521454 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 7979+0+0 (secure 0 0 0) 0x7fafd40e6190 con 0x7fafdc10d100 2024-09-10T22:24:35.803 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:35.773+0000 7fafe2370640 1 --2- 172.21.15.19:0/3171521454 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7fafc80b5360 0x7fafc80b7820 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fafd800bbe0 tx=0x7fafd800b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:24:35.803 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:35.777+0000 7fafd37fe640 1 -- 172.21.15.19:0/3171521454 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7fafd4014030 con 0x7fafdc10d100 2024-09-10T22:24:35.992 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:35.990+0000 7fafe45d4640 1 -- 172.21.15.19:0/3171521454 --> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] -- mgr_command(tid 0: {"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}) -- 0x7fafdc0ff310 con 0x7fafc80b5360 2024-09-10T22:24:36.018 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:36.017+0000 7fafd37fe640 1 -- 172.21.15.19:0/3171521454 <== mgr.14150 v2:172.21.15.19:6800/2119495487 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7fafdc0ff310 con 0x7fafc80b5360 2024-09-10T22:24:36.021 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:36.019+0000 7fafe45d4640 1 -- 172.21.15.19:0/3171521454 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7fafc80b5360 msgr2=0x7fafc80b7820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:24:36.021 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:36.019+0000 7fafe45d4640 1 --2- 172.21.15.19:0/3171521454 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7fafc80b5360 0x7fafc80b7820 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fafd800bbe0 tx=0x7fafd800b390 comp rx=0 tx=0).stop 2024-09-10T22:24:36.021 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:36.019+0000 7fafe45d4640 1 -- 172.21.15.19:0/3171521454 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fafdc10d100 msgr2=0x7fafdc19eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:24:36.021 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:36.019+0000 7fafe45d4640 1 --2- 172.21.15.19:0/3171521454 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fafdc10d100 0x7fafdc19eb30 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fafd400cce0 tx=0x7fafd400a620 comp rx=0 tx=0).stop 2024-09-10T22:24:36.021 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:36.019+0000 7fafe45d4640 1 -- 172.21.15.19:0/3171521454 shutdown_connections 2024-09-10T22:24:36.021 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:36.019+0000 7fafe45d4640 1 --2- 172.21.15.19:0/3171521454 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7fafc80b5360 0x7fafc80b7820 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:24:36.021 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:36.019+0000 7fafe45d4640 1 --2- 172.21.15.19:0/3171521454 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fafdc10d100 0x7fafdc19eb30 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:24:36.021 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:36.019+0000 7fafe45d4640 1 --2- 172.21.15.19:0/3171521454 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fafdc1045c0 0x7fafdc199790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:24:36.021 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:36.019+0000 7fafe45d4640 1 --2- 172.21.15.19:0/3171521454 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fafdc103ca0 0x7fafdc199250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:24:36.021 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:36.019+0000 7fafe45d4640 1 -- 172.21.15.19:0/3171521454 >> 172.21.15.19:0/3171521454 conn(0x7fafdc0fd700 msgr2=0x7fafdc10f350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:24:36.022 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:36.019+0000 7fafe45d4640 1 -- 172.21.15.19:0/3171521454 shutdown_connections 2024-09-10T22:24:36.022 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:36.019+0000 7fafe45d4640 1 -- 172.21.15.19:0/3171521454 wait complete. 2024-09-10T22:24:36.208 INFO:journalctl@ceph.mgr.x.smithi019.stdout:Sep 10 22:24:35 smithi019 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-mgr-x[31605]: 2024-09-10T22:24:35.995+0000 7f171518d640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-10T22:24:36.208 INFO:journalctl@ceph.mgr.x.smithi019.stdout:Sep 10 22:24:35 smithi019 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-mgr-x[31605]: 2024-09-10T22:24:35.995+0000 7f171518d640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-10T22:24:36.209 INFO:journalctl@ceph.mgr.x.smithi019.stdout:Sep 10 22:24:35 smithi019 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-mgr-x[31605]: 2024-09-10T22:24:35.995+0000 7f171518d640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-10T22:24:36.209 INFO:journalctl@ceph.mgr.x.smithi019.stdout:Sep 10 22:24:35 smithi019 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-mgr-x[31605]: 2024-09-10T22:24:35.995+0000 7f171518d640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-10T22:24:36.209 INFO:journalctl@ceph.mgr.x.smithi019.stdout:Sep 10 22:24:35 smithi019 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-mgr-x[31605]: 2024-09-10T22:24:35.995+0000 7f171518d640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-10T22:24:36.610 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:24:36 smithi135 ceph-mon[34789]: from='client.14829 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T22:24:36.625 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:24:36 smithi138 ceph-mon[35236]: from='client.14829 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T22:24:36.679 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:24:36 smithi019 ceph-mon[31375]: from='client.14829 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T22:24:36.707 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 22997a4c-6fc2-11ef-bcea-c7b262605968 -- ceph fs subvolume create cephfs sv_0 --group_name qa 2024-09-10T22:24:36.964 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/22997a4c-6fc2-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T22:24:37.363 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:24:37 smithi019 ceph-mon[31375]: pgmap v289: 97 pgs: 97 active+clean; 582 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 3.0 KiB/s wr, 11 op/s 2024-09-10T22:24:37.455 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:37.448+0000 7fc7208c9640 1 -- 172.21.15.19:0/1541386766 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc71c109130 msgr2=0x7fc71c10f930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:24:37.455 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:37.448+0000 7fc7208c9640 1 --2- 172.21.15.19:0/1541386766 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc71c109130 0x7fc71c10f930 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fc714009ca0 tx=0x7fc71402a8c0 comp rx=0 tx=0).stop 2024-09-10T22:24:37.455 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:37.448+0000 7fc7208c9640 1 -- 172.21.15.19:0/1541386766 shutdown_connections 2024-09-10T22:24:37.455 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:37.448+0000 7fc7208c9640 1 --2- 172.21.15.19:0/1541386766 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc71c109130 0x7fc71c10f930 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:24:37.455 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:37.448+0000 7fc7208c9640 1 --2- 172.21.15.19:0/1541386766 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc71c1087b0 0x7fc71c108bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:24:37.456 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:37.448+0000 7fc7208c9640 1 --2- 172.21.15.19:0/1541386766 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc71c102da0 0x7fc71c103180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:24:37.456 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:37.448+0000 7fc7208c9640 1 -- 172.21.15.19:0/1541386766 >> 172.21.15.19:0/1541386766 conn(0x7fc71c0fe810 msgr2=0x7fc71c100c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:24:37.456 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:37.449+0000 7fc7208c9640 1 -- 172.21.15.19:0/1541386766 shutdown_connections 2024-09-10T22:24:37.456 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:37.449+0000 7fc7208c9640 1 -- 172.21.15.19:0/1541386766 wait complete. 2024-09-10T22:24:37.456 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:37.449+0000 7fc7208c9640 1 Processor -- start 2024-09-10T22:24:37.456 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:37.449+0000 7fc7208c9640 1 -- start start 2024-09-10T22:24:37.456 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:37.450+0000 7fc7208c9640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc71c102da0 0x7fc71c0754a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:24:37.456 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:37.450+0000 7fc7208c9640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc71c1087b0 0x7fc71c0759e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:24:37.456 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:37.450+0000 7fc7208c9640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc71c109130 0x7fc71c075f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:24:37.456 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:37.450+0000 7fc7208c9640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fc71c112db0 con 0x7fc71c102da0 2024-09-10T22:24:37.456 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:37.450+0000 7fc7208c9640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fc71c112c30 con 0x7fc71c109130 2024-09-10T22:24:37.457 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:37.450+0000 7fc7208c9640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7fc71c112f30 con 0x7fc71c1087b0 2024-09-10T22:24:37.457 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:37.450+0000 7fc71a59c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc71c102da0 0x7fc71c0754a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:24:37.457 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:37.450+0000 7fc71a59c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc71c102da0 0x7fc71c0754a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:49688/0 (socket says 172.21.15.19:49688) 2024-09-10T22:24:37.457 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:37.450+0000 7fc71a59c640 1 -- 172.21.15.19:0/3042894901 learned_addr learned my addr 172.21.15.19:0/3042894901 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:24:37.457 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:37.450+0000 7fc71ad9d640 1 --2- 172.21.15.19:0/3042894901 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc71c109130 0x7fc71c075f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:24:37.457 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:37.450+0000 7fc713fff640 1 --2- 172.21.15.19:0/3042894901 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc71c1087b0 0x7fc71c0759e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:24:37.457 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:37.450+0000 7fc71a59c640 1 -- 172.21.15.19:0/3042894901 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc71c1087b0 msgr2=0x7fc71c0759e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:24:37.457 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:37.450+0000 7fc71a59c640 1 --2- 172.21.15.19:0/3042894901 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc71c1087b0 0x7fc71c0759e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:24:37.457 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:37.450+0000 7fc71a59c640 1 -- 172.21.15.19:0/3042894901 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc71c109130 msgr2=0x7fc71c075f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:24:37.457 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:37.450+0000 7fc71a59c640 1 --2- 172.21.15.19:0/3042894901 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc71c109130 0x7fc71c075f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:24:37.457 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:37.450+0000 7fc71a59c640 1 -- 172.21.15.19:0/3042894901 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc71c1a7680 con 0x7fc71c102da0 2024-09-10T22:24:37.457 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:37.450+0000 7fc71a59c640 1 --2- 172.21.15.19:0/3042894901 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc71c102da0 0x7fc71c0754a0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fc70c00c890 tx=0x7fc70c00cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:24:37.457 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:37.451+0000 7fc7137fe640 1 -- 172.21.15.19:0/3042894901 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc70c004220 con 0x7fc71c102da0 2024-09-10T22:24:37.458 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:37.451+0000 7fc7208c9640 1 -- 172.21.15.19:0/3042894901 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc71c1a7970 con 0x7fc71c102da0 2024-09-10T22:24:37.458 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:37.451+0000 7fc7137fe640 1 -- 172.21.15.19:0/3042894901 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc70c0043c0 con 0x7fc71c102da0 2024-09-10T22:24:37.458 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:37.451+0000 7fc7137fe640 1 -- 172.21.15.19:0/3042894901 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc70c004a00 con 0x7fc71c102da0 2024-09-10T22:24:37.458 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:37.451+0000 7fc7208c9640 1 -- 172.21.15.19:0/3042894901 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc71c1a7eb0 con 0x7fc71c102da0 2024-09-10T22:24:37.458 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:37.452+0000 7fc7208c9640 1 -- 172.21.15.19:0/3042894901 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc71c103180 con 0x7fc71c102da0 2024-09-10T22:24:37.458 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:37.453+0000 7fc7137fe640 1 -- 172.21.15.19:0/3042894901 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 17) ==== 153301+0+0 (secure 0 0 0) 0x7fc70c0079b0 con 0x7fc71c102da0 2024-09-10T22:24:37.459 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:37.454+0000 7fc7137fe640 1 --2- 172.21.15.19:0/3042894901 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7fc7080b5370 0x7fc7080b7830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:24:37.459 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:37.454+0000 7fc7137fe640 1 -- 172.21.15.19:0/3042894901 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 7979+0+0 (secure 0 0 0) 0x7fc70c0e5d80 con 0x7fc71c102da0 2024-09-10T22:24:37.459 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:37.455+0000 7fc713fff640 1 --2- 172.21.15.19:0/3042894901 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7fc7080b5370 0x7fc7080b7830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:24:37.459 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:37.455+0000 7fc713fff640 1 --2- 172.21.15.19:0/3042894901 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7fc7080b5370 0x7fc7080b7830 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fc704005fd0 tx=0x7fc704005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:24:37.459 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:37.458+0000 7fc7137fe640 1 -- 172.21.15.19:0/3042894901 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7fc70c014030 con 0x7fc71c102da0 2024-09-10T22:24:37.609 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:24:37 smithi135 ceph-mon[34789]: pgmap v289: 97 pgs: 97 active+clean; 582 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 3.0 KiB/s wr, 11 op/s 2024-09-10T22:24:37.625 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:24:37 smithi138 ceph-mon[35236]: pgmap v289: 97 pgs: 97 active+clean; 582 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 3.0 KiB/s wr, 11 op/s 2024-09-10T22:24:37.670 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:37.669+0000 7fc7208c9640 1 -- 172.21.15.19:0/3042894901 --> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}) -- 0x7fc71c063590 con 0x7fc7080b5370 2024-09-10T22:24:37.695 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:37.694+0000 7fc7137fe640 1 -- 172.21.15.19:0/3042894901 <== mgr.14150 v2:172.21.15.19:6800/2119495487 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7fc71c063590 con 0x7fc7080b5370 2024-09-10T22:24:37.697 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:37.696+0000 7fc7208c9640 1 -- 172.21.15.19:0/3042894901 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7fc7080b5370 msgr2=0x7fc7080b7830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:24:37.697 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:37.696+0000 7fc7208c9640 1 --2- 172.21.15.19:0/3042894901 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7fc7080b5370 0x7fc7080b7830 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fc704005fd0 tx=0x7fc704005850 comp rx=0 tx=0).stop 2024-09-10T22:24:37.697 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:37.696+0000 7fc7208c9640 1 -- 172.21.15.19:0/3042894901 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc71c102da0 msgr2=0x7fc71c0754a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:24:37.698 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:37.696+0000 7fc7208c9640 1 --2- 172.21.15.19:0/3042894901 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc71c102da0 0x7fc71c0754a0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fc70c00c890 tx=0x7fc70c00cd50 comp rx=0 tx=0).stop 2024-09-10T22:24:37.698 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:37.696+0000 7fc7208c9640 1 -- 172.21.15.19:0/3042894901 shutdown_connections 2024-09-10T22:24:37.698 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:37.696+0000 7fc7208c9640 1 --2- 172.21.15.19:0/3042894901 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7fc7080b5370 0x7fc7080b7830 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:24:37.698 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:37.696+0000 7fc7208c9640 1 --2- 172.21.15.19:0/3042894901 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc71c109130 0x7fc71c075f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:24:37.698 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:37.696+0000 7fc7208c9640 1 --2- 172.21.15.19:0/3042894901 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc71c1087b0 0x7fc71c0759e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:24:37.698 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:37.696+0000 7fc7208c9640 1 --2- 172.21.15.19:0/3042894901 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc71c102da0 0x7fc71c0754a0 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:24:37.698 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:37.696+0000 7fc7208c9640 1 -- 172.21.15.19:0/3042894901 >> 172.21.15.19:0/3042894901 conn(0x7fc71c0fe810 msgr2=0x7fc71c100c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:24:37.698 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:37.696+0000 7fc7208c9640 1 -- 172.21.15.19:0/3042894901 shutdown_connections 2024-09-10T22:24:37.698 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:37.696+0000 7fc7208c9640 1 -- 172.21.15.19:0/3042894901 wait complete. 2024-09-10T22:24:38.318 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:24:38 smithi019 ceph-mon[31375]: mgrmap e17: x(active, since 7m), standbys: z, y 2024-09-10T22:24:38.318 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:24:38 smithi019 ceph-mon[31375]: from='client.14841 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T22:24:38.348 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 22997a4c-6fc2-11ef-bcea-c7b262605968 -- ceph fs subvolume getpath cephfs --group_name qa sv_0 2024-09-10T22:24:38.606 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/22997a4c-6fc2-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T22:24:38.609 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:24:38 smithi135 ceph-mon[34789]: mgrmap e17: x(active, since 7m), standbys: z, y 2024-09-10T22:24:38.609 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:24:38 smithi135 ceph-mon[34789]: from='client.14841 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T22:24:38.625 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:24:38 smithi138 ceph-mon[35236]: mgrmap e17: x(active, since 7m), standbys: z, y 2024-09-10T22:24:38.625 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:24:38 smithi138 ceph-mon[35236]: from='client.14841 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T22:24:39.152 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:39.105+0000 7f3724aca640 1 -- 172.21.15.19:0/199471071 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3720101cd0 msgr2=0x7f37201020b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:24:39.152 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:39.105+0000 7f3724aca640 1 --2- 172.21.15.19:0/199471071 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3720101cd0 0x7f37201020b0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f3710009900 tx=0x7f371002a410 comp rx=0 tx=0).stop 2024-09-10T22:24:39.152 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:39.105+0000 7f3724aca640 1 -- 172.21.15.19:0/199471071 shutdown_connections 2024-09-10T22:24:39.152 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:39.105+0000 7f3724aca640 1 --2- 172.21.15.19:0/199471071 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3720108060 0x7f372010e860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:24:39.152 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:39.105+0000 7f3724aca640 1 --2- 172.21.15.19:0/199471071 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f37201076e0 0x7f3720107b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:24:39.152 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:39.105+0000 7f3724aca640 1 --2- 172.21.15.19:0/199471071 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3720101cd0 0x7f37201020b0 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:24:39.152 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:39.105+0000 7f3724aca640 1 -- 172.21.15.19:0/199471071 >> 172.21.15.19:0/199471071 conn(0x7f37200fd700 msgr2=0x7f37200ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:24:39.152 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:39.105+0000 7f3724aca640 1 -- 172.21.15.19:0/199471071 shutdown_connections 2024-09-10T22:24:39.152 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:39.105+0000 7f3724aca640 1 -- 172.21.15.19:0/199471071 wait complete. 2024-09-10T22:24:39.152 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:39.106+0000 7f3724aca640 1 Processor -- start 2024-09-10T22:24:39.153 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:39.106+0000 7f3724aca640 1 -- start start 2024-09-10T22:24:39.153 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:39.106+0000 7f3724aca640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3720101cd0 0x7f37201993b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:24:39.153 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:39.106+0000 7f3724aca640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f37201076e0 0x7f37201998f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:24:39.153 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:39.106+0000 7f3724aca640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3720108060 0x7f372019ec90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:24:39.153 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:39.106+0000 7f3724aca640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f3720111d20 con 0x7f37201076e0 2024-09-10T22:24:39.153 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:39.106+0000 7f3724aca640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f3720111ba0 con 0x7f3720108060 2024-09-10T22:24:39.153 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:39.106+0000 7f3724aca640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f3720111ea0 con 0x7f3720101cd0 2024-09-10T22:24:39.153 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:39.106+0000 7f371dd9b640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f37201076e0 0x7f37201998f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:24:39.153 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:39.106+0000 7f371dd9b640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f37201076e0 0x7f37201998f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:49706/0 (socket says 172.21.15.19:49706) 2024-09-10T22:24:39.153 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:39.106+0000 7f371dd9b640 1 -- 172.21.15.19:0/248975030 learned_addr learned my addr 172.21.15.19:0/248975030 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:24:39.153 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:39.107+0000 7f371e59c640 1 --2- 172.21.15.19:0/248975030 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3720101cd0 0x7f37201993b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:24:39.153 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:39.107+0000 7f371ed9d640 1 --2- 172.21.15.19:0/248975030 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3720108060 0x7f372019ec90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:24:39.154 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:39.107+0000 7f371dd9b640 1 -- 172.21.15.19:0/248975030 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3720101cd0 msgr2=0x7f37201993b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:24:39.154 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:39.107+0000 7f371dd9b640 1 --2- 172.21.15.19:0/248975030 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3720101cd0 0x7f37201993b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:24:39.154 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:39.107+0000 7f371dd9b640 1 -- 172.21.15.19:0/248975030 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3720108060 msgr2=0x7f372019ec90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:24:39.154 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:39.107+0000 7f371dd9b640 1 --2- 172.21.15.19:0/248975030 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3720108060 0x7f372019ec90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:24:39.154 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:39.107+0000 7f371dd9b640 1 -- 172.21.15.19:0/248975030 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f372019f460 con 0x7f37201076e0 2024-09-10T22:24:39.154 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:39.107+0000 7f371ed9d640 1 --2- 172.21.15.19:0/248975030 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3720108060 0x7f372019ec90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T22:24:39.154 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:39.107+0000 7f371dd9b640 1 --2- 172.21.15.19:0/248975030 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f37201076e0 0x7f37201998f0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f370800b4a0 tx=0x7f370800b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:24:39.154 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:39.107+0000 7f37177fe640 1 -- 172.21.15.19:0/248975030 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3708014070 con 0x7f37201076e0 2024-09-10T22:24:39.154 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:39.107+0000 7f37177fe640 1 -- 172.21.15.19:0/248975030 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3708010ac0 con 0x7f37201076e0 2024-09-10T22:24:39.154 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:39.107+0000 7f3724aca640 1 -- 172.21.15.19:0/248975030 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f372019f750 con 0x7f37201076e0 2024-09-10T22:24:39.154 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:39.107+0000 7f37177fe640 1 -- 172.21.15.19:0/248975030 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3708017c30 con 0x7f37201076e0 2024-09-10T22:24:39.154 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:39.107+0000 7f3724aca640 1 -- 172.21.15.19:0/248975030 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f37201a5e10 con 0x7f37201076e0 2024-09-10T22:24:39.154 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:39.108+0000 7f3724aca640 1 -- 172.21.15.19:0/248975030 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f37201020b0 con 0x7f37201076e0 2024-09-10T22:24:39.154 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:39.109+0000 7f37177fe640 1 -- 172.21.15.19:0/248975030 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 17) ==== 153301+0+0 (secure 0 0 0) 0x7f3708010610 con 0x7f37201076e0 2024-09-10T22:24:39.155 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:39.110+0000 7f37177fe640 1 --2- 172.21.15.19:0/248975030 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f370c0b5370 0x7f370c0b7830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:24:39.155 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:39.110+0000 7f371e59c640 1 --2- 172.21.15.19:0/248975030 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f370c0b5370 0x7f370c0b7830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:24:39.155 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:39.110+0000 7f37177fe640 1 -- 172.21.15.19:0/248975030 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 7979+0+0 (secure 0 0 0) 0x7f37080e5650 con 0x7f37201076e0 2024-09-10T22:24:39.155 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:39.111+0000 7f371e59c640 1 --2- 172.21.15.19:0/248975030 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f370c0b5370 0x7f370c0b7830 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f3710031440 tx=0x7f37100095f0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:24:39.155 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:39.114+0000 7f37177fe640 1 -- 172.21.15.19:0/248975030 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f37080ac460 con 0x7f37201076e0 2024-09-10T22:24:39.331 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:39.329+0000 7f3724aca640 1 -- 172.21.15.19:0/248975030 --> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}) -- 0x7f3720104ca0 con 0x7f370c0b5370 2024-09-10T22:24:39.331 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:24:39 smithi019 ceph-mon[31375]: pgmap v290: 97 pgs: 97 active+clean; 582 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 2.0 KiB/s wr, 10 op/s 2024-09-10T22:24:39.337 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:39.335+0000 7f37177fe640 1 -- 172.21.15.19:0/248975030 <== mgr.14150 v2:172.21.15.19:6800/2119495487 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+54 (secure 0 0 0) 0x7f3720104ca0 con 0x7f370c0b5370 2024-09-10T22:24:39.337 INFO:teuthology.orchestra.run.smithi019.stdout:/volumes/qa/sv_0/8bda09d0-418c-4e8f-8f64-68b06d5f8663 2024-09-10T22:24:39.339 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:39.338+0000 7f3724aca640 1 -- 172.21.15.19:0/248975030 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f370c0b5370 msgr2=0x7f370c0b7830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:24:39.339 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:39.338+0000 7f3724aca640 1 --2- 172.21.15.19:0/248975030 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f370c0b5370 0x7f370c0b7830 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f3710031440 tx=0x7f37100095f0 comp rx=0 tx=0).stop 2024-09-10T22:24:39.339 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:39.338+0000 7f3724aca640 1 -- 172.21.15.19:0/248975030 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f37201076e0 msgr2=0x7f37201998f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:24:39.339 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:39.338+0000 7f3724aca640 1 --2- 172.21.15.19:0/248975030 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f37201076e0 0x7f37201998f0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f370800b4a0 tx=0x7f370800b960 comp rx=0 tx=0).stop 2024-09-10T22:24:39.339 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:39.338+0000 7f3724aca640 1 -- 172.21.15.19:0/248975030 shutdown_connections 2024-09-10T22:24:39.340 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:39.338+0000 7f3724aca640 1 --2- 172.21.15.19:0/248975030 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f370c0b5370 0x7f370c0b7830 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:24:39.340 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:39.338+0000 7f3724aca640 1 --2- 172.21.15.19:0/248975030 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3720108060 0x7f372019ec90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:24:39.340 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:39.338+0000 7f3724aca640 1 --2- 172.21.15.19:0/248975030 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f37201076e0 0x7f37201998f0 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:24:39.340 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:39.338+0000 7f3724aca640 1 --2- 172.21.15.19:0/248975030 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3720101cd0 0x7f37201993b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:24:39.340 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:39.338+0000 7f3724aca640 1 -- 172.21.15.19:0/248975030 >> 172.21.15.19:0/248975030 conn(0x7f37200fd700 msgr2=0x7f372006b490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:24:39.340 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:39.338+0000 7f3724aca640 1 -- 172.21.15.19:0/248975030 shutdown_connections 2024-09-10T22:24:39.340 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:39.338+0000 7f3724aca640 1 -- 172.21.15.19:0/248975030 wait complete. 2024-09-10T22:24:39.610 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:24:39 smithi135 ceph-mon[34789]: pgmap v290: 97 pgs: 97 active+clean; 582 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 2.0 KiB/s wr, 10 op/s 2024-09-10T22:24:39.625 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:24:39 smithi138 ceph-mon[35236]: pgmap v290: 97 pgs: 97 active+clean; 582 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 2.0 KiB/s wr, 10 op/s 2024-09-10T22:24:39.944 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 22997a4c-6fc2-11ef-bcea-c7b262605968 -- ceph fs subvolume create cephfs sv_1 --group_name qa 2024-09-10T22:24:40.201 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/22997a4c-6fc2-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T22:24:40.501 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:24:40 smithi019 ceph-mon[31375]: from='client.14847 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T22:24:40.609 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:24:40 smithi135 ceph-mon[34789]: from='client.14847 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T22:24:40.625 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:24:40 smithi138 ceph-mon[35236]: from='client.14847 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T22:24:40.698 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:40.696+0000 7f6cd73f1640 1 -- 172.21.15.19:0/721446320 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6cd0103ca0 msgr2=0x7f6cd0104080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:24:40.698 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:40.696+0000 7f6cd73f1640 1 --2- 172.21.15.19:0/721446320 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6cd0103ca0 0x7f6cd0104080 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f6ccc009900 tx=0x7f6ccc02a410 comp rx=0 tx=0).stop 2024-09-10T22:24:40.698 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:40.696+0000 7f6cd73f1640 1 -- 172.21.15.19:0/721446320 shutdown_connections 2024-09-10T22:24:40.698 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:40.696+0000 7f6cd73f1640 1 --2- 172.21.15.19:0/721446320 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6cd010d100 0x7f6cd010f560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:24:40.698 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:40.696+0000 7f6cd73f1640 1 --2- 172.21.15.19:0/721446320 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f6cd01045c0 0x7f6cd010cab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:24:40.698 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:40.696+0000 7f6cd73f1640 1 --2- 172.21.15.19:0/721446320 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6cd0103ca0 0x7f6cd0104080 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:24:40.698 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:40.696+0000 7f6cd73f1640 1 -- 172.21.15.19:0/721446320 >> 172.21.15.19:0/721446320 conn(0x7f6cd00fd700 msgr2=0x7f6cd00ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:24:40.698 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:40.696+0000 7f6cd73f1640 1 -- 172.21.15.19:0/721446320 shutdown_connections 2024-09-10T22:24:40.698 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:40.696+0000 7f6cd73f1640 1 -- 172.21.15.19:0/721446320 wait complete. 2024-09-10T22:24:40.700 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:40.697+0000 7f6cd73f1640 1 Processor -- start 2024-09-10T22:24:40.700 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:40.697+0000 7f6cd73f1640 1 -- start start 2024-09-10T22:24:40.700 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:40.697+0000 7f6cd73f1640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6cd0103ca0 0x7f6cd0101950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:24:40.700 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:40.697+0000 7f6cd73f1640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6cd01045c0 0x7f6cd0101e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:24:40.700 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:40.697+0000 7f6cd73f1640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f6cd010d100 0x7f6cd01023d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:24:40.700 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:40.697+0000 7f6cd73f1640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f6cd0112d70 con 0x7f6cd0103ca0 2024-09-10T22:24:40.700 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:40.697+0000 7f6cd73f1640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f6cd0112bf0 con 0x7f6cd01045c0 2024-09-10T22:24:40.701 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:40.697+0000 7f6cd73f1640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f6cd0112ef0 con 0x7f6cd010d100 2024-09-10T22:24:40.701 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:40.697+0000 7f6cd518d640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6cd0103ca0 0x7f6cd0101950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:24:40.701 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:40.697+0000 7f6cd518d640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6cd0103ca0 0x7f6cd0101950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:49720/0 (socket says 172.21.15.19:49720) 2024-09-10T22:24:40.701 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:40.697+0000 7f6cd518d640 1 -- 172.21.15.19:0/530754570 learned_addr learned my addr 172.21.15.19:0/530754570 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:24:40.701 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:40.697+0000 7f6cd598e640 1 --2- 172.21.15.19:0/530754570 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f6cd010d100 0x7f6cd01023d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:24:40.701 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:40.697+0000 7f6cd518d640 1 -- 172.21.15.19:0/530754570 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f6cd010d100 msgr2=0x7f6cd01023d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:24:40.701 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:40.697+0000 7f6cd498c640 1 --2- 172.21.15.19:0/530754570 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6cd01045c0 0x7f6cd0101e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:24:40.701 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:40.697+0000 7f6cd518d640 1 --2- 172.21.15.19:0/530754570 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f6cd010d100 0x7f6cd01023d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:24:40.701 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:40.697+0000 7f6cd518d640 1 -- 172.21.15.19:0/530754570 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6cd01045c0 msgr2=0x7f6cd0101e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:24:40.701 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:40.698+0000 7f6cd518d640 1 --2- 172.21.15.19:0/530754570 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6cd01045c0 0x7f6cd0101e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:24:40.701 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:40.698+0000 7f6cd518d640 1 -- 172.21.15.19:0/530754570 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6cd01a76c0 con 0x7f6cd0103ca0 2024-09-10T22:24:40.701 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:40.698+0000 7f6cd518d640 1 --2- 172.21.15.19:0/530754570 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6cd0103ca0 0x7f6cd0101950 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f6ccc005940 tx=0x7f6ccc0042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:24:40.702 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:40.698+0000 7f6cc67fc640 1 -- 172.21.15.19:0/530754570 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ccc03f030 con 0x7f6cd0103ca0 2024-09-10T22:24:40.702 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:40.698+0000 7f6cc67fc640 1 -- 172.21.15.19:0/530754570 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6ccc003cb0 con 0x7f6cd0103ca0 2024-09-10T22:24:40.702 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:40.698+0000 7f6cd73f1640 1 -- 172.21.15.19:0/530754570 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6cd01a7950 con 0x7f6cd0103ca0 2024-09-10T22:24:40.702 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:40.698+0000 7f6cc67fc640 1 -- 172.21.15.19:0/530754570 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ccc035070 con 0x7f6cd0103ca0 2024-09-10T22:24:40.702 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:40.698+0000 7f6cd73f1640 1 -- 172.21.15.19:0/530754570 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6cd01a7e80 con 0x7f6cd0103ca0 2024-09-10T22:24:40.702 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:40.699+0000 7f6cd73f1640 1 -- 172.21.15.19:0/530754570 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6cd0104080 con 0x7f6cd0103ca0 2024-09-10T22:24:40.702 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:40.701+0000 7f6cc67fc640 1 -- 172.21.15.19:0/530754570 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 17) ==== 153301+0+0 (secure 0 0 0) 0x7f6ccc03bbf0 con 0x7f6cd0103ca0 2024-09-10T22:24:40.703 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:40.701+0000 7f6cc67fc640 1 --2- 172.21.15.19:0/530754570 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f6cbc0b53f0 0x7f6cbc0b78b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:24:40.703 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:40.701+0000 7f6cd498c640 1 --2- 172.21.15.19:0/530754570 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f6cbc0b53f0 0x7f6cbc0b78b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:24:40.703 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:40.701+0000 7f6cc67fc640 1 -- 172.21.15.19:0/530754570 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 7979+0+0 (secure 0 0 0) 0x7f6ccc106a30 con 0x7f6cd0103ca0 2024-09-10T22:24:40.703 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:40.702+0000 7f6cd498c640 1 --2- 172.21.15.19:0/530754570 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f6cbc0b53f0 0x7f6cbc0b78b0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f6cd0103440 tx=0x7f6cc0005ed0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:24:40.705 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:40.704+0000 7f6cc67fc640 1 -- 172.21.15.19:0/530754570 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f6ccc0cd940 con 0x7f6cd0103ca0 2024-09-10T22:24:40.922 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:40.921+0000 7f6cd73f1640 1 -- 172.21.15.19:0/530754570 --> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}) -- 0x7f6cd00ffa20 con 0x7f6cbc0b53f0 2024-09-10T22:24:40.948 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:40.947+0000 7f6cc67fc640 1 -- 172.21.15.19:0/530754570 <== mgr.14150 v2:172.21.15.19:6800/2119495487 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f6cd00ffa20 con 0x7f6cbc0b53f0 2024-09-10T22:24:40.950 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:40.949+0000 7f6cd73f1640 1 -- 172.21.15.19:0/530754570 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f6cbc0b53f0 msgr2=0x7f6cbc0b78b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:24:40.950 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:40.949+0000 7f6cd73f1640 1 --2- 172.21.15.19:0/530754570 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f6cbc0b53f0 0x7f6cbc0b78b0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f6cd0103440 tx=0x7f6cc0005ed0 comp rx=0 tx=0).stop 2024-09-10T22:24:40.951 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:40.949+0000 7f6cd73f1640 1 -- 172.21.15.19:0/530754570 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6cd0103ca0 msgr2=0x7f6cd0101950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:24:40.951 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:40.949+0000 7f6cd73f1640 1 --2- 172.21.15.19:0/530754570 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6cd0103ca0 0x7f6cd0101950 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f6ccc005940 tx=0x7f6ccc0042f0 comp rx=0 tx=0).stop 2024-09-10T22:24:40.951 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:40.949+0000 7f6cd73f1640 1 -- 172.21.15.19:0/530754570 shutdown_connections 2024-09-10T22:24:40.951 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:40.949+0000 7f6cd73f1640 1 --2- 172.21.15.19:0/530754570 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f6cbc0b53f0 0x7f6cbc0b78b0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:24:40.951 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:40.949+0000 7f6cd73f1640 1 --2- 172.21.15.19:0/530754570 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f6cd010d100 0x7f6cd01023d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:24:40.951 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:40.949+0000 7f6cd73f1640 1 --2- 172.21.15.19:0/530754570 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6cd01045c0 0x7f6cd0101e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:24:40.951 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:40.949+0000 7f6cd73f1640 1 --2- 172.21.15.19:0/530754570 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6cd0103ca0 0x7f6cd0101950 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:24:40.951 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:40.949+0000 7f6cd73f1640 1 -- 172.21.15.19:0/530754570 >> 172.21.15.19:0/530754570 conn(0x7f6cd00fd700 msgr2=0x7f6cd00fe300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:24:40.951 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:40.949+0000 7f6cd73f1640 1 -- 172.21.15.19:0/530754570 shutdown_connections 2024-09-10T22:24:40.951 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:40.949+0000 7f6cd73f1640 1 -- 172.21.15.19:0/530754570 wait complete. 2024-09-10T22:24:41.538 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:24:41 smithi019 ceph-mon[31375]: pgmap v291: 97 pgs: 97 active+clean; 582 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 2.2 KiB/s wr, 11 op/s 2024-09-10T22:24:41.539 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:24:41 smithi019 ceph-mon[31375]: from='client.14853 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T22:24:41.568 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 22997a4c-6fc2-11ef-bcea-c7b262605968 -- ceph fs subvolume getpath cephfs --group_name qa sv_1 2024-09-10T22:24:41.609 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:24:41 smithi135 ceph-mon[34789]: pgmap v291: 97 pgs: 97 active+clean; 582 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 2.2 KiB/s wr, 11 op/s 2024-09-10T22:24:41.609 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:24:41 smithi135 ceph-mon[34789]: from='client.14853 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T22:24:41.625 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:24:41 smithi138 ceph-mon[35236]: pgmap v291: 97 pgs: 97 active+clean; 582 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 2.2 KiB/s wr, 11 op/s 2024-09-10T22:24:41.625 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:24:41 smithi138 ceph-mon[35236]: from='client.14853 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T22:24:41.830 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/22997a4c-6fc2-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T22:24:42.326 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:42.311+0000 7fed31284640 1 -- 172.21.15.19:0/162332239 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fed2c104600 msgr2=0x7fed2c10caf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:24:42.326 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:42.311+0000 7fed31284640 1 --2- 172.21.15.19:0/162332239 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fed2c104600 0x7fed2c10caf0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fed14009900 tx=0x7fed1402a410 comp rx=0 tx=0).stop 2024-09-10T22:24:42.327 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:42.311+0000 7fed31284640 1 -- 172.21.15.19:0/162332239 shutdown_connections 2024-09-10T22:24:42.327 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:42.311+0000 7fed31284640 1 --2- 172.21.15.19:0/162332239 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fed2c10d140 0x7fed2c10f5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:24:42.327 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:42.311+0000 7fed31284640 1 --2- 172.21.15.19:0/162332239 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fed2c104600 0x7fed2c10caf0 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:24:42.327 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:42.311+0000 7fed31284640 1 --2- 172.21.15.19:0/162332239 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fed2c103ce0 0x7fed2c1040c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:24:42.327 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:42.311+0000 7fed31284640 1 -- 172.21.15.19:0/162332239 >> 172.21.15.19:0/162332239 conn(0x7fed2c0fd720 msgr2=0x7fed2c0ffb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:24:42.327 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:42.311+0000 7fed31284640 1 -- 172.21.15.19:0/162332239 shutdown_connections 2024-09-10T22:24:42.327 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:42.311+0000 7fed31284640 1 -- 172.21.15.19:0/162332239 wait complete. 2024-09-10T22:24:42.327 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:42.312+0000 7fed31284640 1 Processor -- start 2024-09-10T22:24:42.327 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:42.312+0000 7fed31284640 1 -- start start 2024-09-10T22:24:42.327 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:42.312+0000 7fed31284640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fed2c103ce0 0x7fed2c1992c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:24:42.327 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:42.312+0000 7fed31284640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fed2c104600 0x7fed2c199800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:24:42.327 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:42.312+0000 7fed31284640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fed2c10d140 0x7fed2c19eba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:24:42.328 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:42.312+0000 7fed31284640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fed2c112e00 con 0x7fed2c103ce0 2024-09-10T22:24:42.328 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:42.312+0000 7fed31284640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fed2c112c80 con 0x7fed2c104600 2024-09-10T22:24:42.328 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:42.312+0000 7fed31284640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7fed2c112f80 con 0x7fed2c10d140 2024-09-10T22:24:42.328 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:42.312+0000 7fed2affd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fed2c103ce0 0x7fed2c1992c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:24:42.328 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:42.312+0000 7fed2affd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fed2c103ce0 0x7fed2c1992c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:49734/0 (socket says 172.21.15.19:49734) 2024-09-10T22:24:42.328 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:42.312+0000 7fed2affd640 1 -- 172.21.15.19:0/2140248383 learned_addr learned my addr 172.21.15.19:0/2140248383 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:24:42.328 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:42.312+0000 7fed2b7fe640 1 --2- 172.21.15.19:0/2140248383 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fed2c10d140 0x7fed2c19eba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:24:42.328 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:42.313+0000 7fed2affd640 1 -- 172.21.15.19:0/2140248383 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fed2c10d140 msgr2=0x7fed2c19eba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:24:42.328 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:42.313+0000 7fed23fff640 1 --2- 172.21.15.19:0/2140248383 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fed2c104600 0x7fed2c199800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:24:42.328 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:42.313+0000 7fed2affd640 1 --2- 172.21.15.19:0/2140248383 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fed2c10d140 0x7fed2c19eba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:24:42.328 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:42.313+0000 7fed2affd640 1 -- 172.21.15.19:0/2140248383 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fed2c104600 msgr2=0x7fed2c199800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:24:42.328 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:42.313+0000 7fed2affd640 1 --2- 172.21.15.19:0/2140248383 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fed2c104600 0x7fed2c199800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:24:42.329 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:42.313+0000 7fed2affd640 1 -- 172.21.15.19:0/2140248383 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fed2c19f370 con 0x7fed2c103ce0 2024-09-10T22:24:42.329 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:42.313+0000 7fed2affd640 1 --2- 172.21.15.19:0/2140248383 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fed2c103ce0 0x7fed2c1992c0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fed1c00e9f0 tx=0x7fed1c00eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:24:42.329 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:42.313+0000 7fed28ff9640 1 -- 172.21.15.19:0/2140248383 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed1c00cd80 con 0x7fed2c103ce0 2024-09-10T22:24:42.329 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:42.313+0000 7fed28ff9640 1 -- 172.21.15.19:0/2140248383 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fed1c0108e0 con 0x7fed2c103ce0 2024-09-10T22:24:42.329 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:42.313+0000 7fed31284640 1 -- 172.21.15.19:0/2140248383 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fed2c19f660 con 0x7fed2c103ce0 2024-09-10T22:24:42.329 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:42.313+0000 7fed28ff9640 1 -- 172.21.15.19:0/2140248383 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed1c018980 con 0x7fed2c103ce0 2024-09-10T22:24:42.329 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:42.313+0000 7fed31284640 1 -- 172.21.15.19:0/2140248383 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fed2c1a5ef0 con 0x7fed2c103ce0 2024-09-10T22:24:42.329 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:42.314+0000 7fed31284640 1 -- 172.21.15.19:0/2140248383 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fed2c06bb90 con 0x7fed2c103ce0 2024-09-10T22:24:42.329 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:42.316+0000 7fed28ff9640 1 -- 172.21.15.19:0/2140248383 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 17) ==== 153301+0+0 (secure 0 0 0) 0x7fed1c010430 con 0x7fed2c103ce0 2024-09-10T22:24:42.329 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:42.316+0000 7fed28ff9640 1 --2- 172.21.15.19:0/2140248383 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7fed180b53f0 0x7fed180b78b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:24:42.329 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:42.316+0000 7fed23fff640 1 --2- 172.21.15.19:0/2140248383 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7fed180b53f0 0x7fed180b78b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:24:42.329 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:42.316+0000 7fed28ff9640 1 -- 172.21.15.19:0/2140248383 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 7979+0+0 (secure 0 0 0) 0x7fed1c0e6560 con 0x7fed2c103ce0 2024-09-10T22:24:42.329 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:42.317+0000 7fed23fff640 1 --2- 172.21.15.19:0/2140248383 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7fed180b53f0 0x7fed180b78b0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fed2c10f980 tx=0x7fed14005fd0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:24:42.330 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:42.319+0000 7fed28ff9640 1 -- 172.21.15.19:0/2140248383 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7fed1c0ad370 con 0x7fed2c103ce0 2024-09-10T22:24:42.537 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:42.536+0000 7fed31284640 1 -- 172.21.15.19:0/2140248383 --> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}) -- 0x7fed2c063590 con 0x7fed180b53f0 2024-09-10T22:24:42.542 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:42.541+0000 7fed28ff9640 1 -- 172.21.15.19:0/2140248383 <== mgr.14150 v2:172.21.15.19:6800/2119495487 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+54 (secure 0 0 0) 0x7fed2c063590 con 0x7fed180b53f0 2024-09-10T22:24:42.542 INFO:teuthology.orchestra.run.smithi019.stdout:/volumes/qa/sv_1/45bb5791-2315-449d-a832-cd11716fd37f 2024-09-10T22:24:42.545 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:42.543+0000 7fed31284640 1 -- 172.21.15.19:0/2140248383 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7fed180b53f0 msgr2=0x7fed180b78b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:24:42.545 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:42.543+0000 7fed31284640 1 --2- 172.21.15.19:0/2140248383 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7fed180b53f0 0x7fed180b78b0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fed2c10f980 tx=0x7fed14005fd0 comp rx=0 tx=0).stop 2024-09-10T22:24:42.545 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:42.543+0000 7fed31284640 1 -- 172.21.15.19:0/2140248383 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fed2c103ce0 msgr2=0x7fed2c1992c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:24:42.545 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:42.543+0000 7fed31284640 1 --2- 172.21.15.19:0/2140248383 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fed2c103ce0 0x7fed2c1992c0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fed1c00e9f0 tx=0x7fed1c00eeb0 comp rx=0 tx=0).stop 2024-09-10T22:24:42.545 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:42.543+0000 7fed31284640 1 -- 172.21.15.19:0/2140248383 shutdown_connections 2024-09-10T22:24:42.545 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:42.543+0000 7fed31284640 1 --2- 172.21.15.19:0/2140248383 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7fed180b53f0 0x7fed180b78b0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:24:42.545 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:42.543+0000 7fed31284640 1 --2- 172.21.15.19:0/2140248383 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fed2c10d140 0x7fed2c19eba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:24:42.545 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:42.543+0000 7fed31284640 1 --2- 172.21.15.19:0/2140248383 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fed2c104600 0x7fed2c199800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:24:42.545 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:42.543+0000 7fed31284640 1 --2- 172.21.15.19:0/2140248383 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fed2c103ce0 0x7fed2c1992c0 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:24:42.545 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:42.543+0000 7fed31284640 1 -- 172.21.15.19:0/2140248383 >> 172.21.15.19:0/2140248383 conn(0x7fed2c0fd720 msgr2=0x7fed2c0fe460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:24:42.545 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:42.543+0000 7fed31284640 1 -- 172.21.15.19:0/2140248383 shutdown_connections 2024-09-10T22:24:42.545 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:42.543+0000 7fed31284640 1 -- 172.21.15.19:0/2140248383 wait complete. 2024-09-10T22:24:43.118 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 22997a4c-6fc2-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-10T22:24:43.378 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/22997a4c-6fc2-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T22:24:43.708 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:24:43 smithi019 ceph-mon[31375]: pgmap v292: 97 pgs: 97 active+clean; 602 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 4.2 KiB/s wr, 13 op/s 2024-09-10T22:24:43.708 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:24:43 smithi019 ceph-mon[31375]: from='client.14859 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T22:24:43.817 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:43.814+0000 7f320765e640 1 -- 172.21.15.19:0/361477280 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3200102dc0 msgr2=0x7f32001031a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:24:43.817 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:43.814+0000 7f320765e640 1 --2- 172.21.15.19:0/361477280 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3200102dc0 0x7f32001031a0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f31fc009ca0 tx=0x7f31fc02a8c0 comp rx=0 tx=0).stop 2024-09-10T22:24:43.818 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:43.814+0000 7f320765e640 1 -- 172.21.15.19:0/361477280 shutdown_connections 2024-09-10T22:24:43.818 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:43.814+0000 7f320765e640 1 --2- 172.21.15.19:0/361477280 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3200109150 0x7f320010f950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:24:43.818 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:43.814+0000 7f320765e640 1 --2- 172.21.15.19:0/361477280 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f32001087d0 0x7f3200108c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:24:43.818 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:43.814+0000 7f320765e640 1 --2- 172.21.15.19:0/361477280 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3200102dc0 0x7f32001031a0 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:24:43.818 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:43.814+0000 7f320765e640 1 -- 172.21.15.19:0/361477280 >> 172.21.15.19:0/361477280 conn(0x7f32000fe830 msgr2=0x7f3200100c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:24:43.818 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:43.814+0000 7f320765e640 1 -- 172.21.15.19:0/361477280 shutdown_connections 2024-09-10T22:24:43.818 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:43.814+0000 7f320765e640 1 -- 172.21.15.19:0/361477280 wait complete. 2024-09-10T22:24:43.818 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:43.815+0000 7f320765e640 1 Processor -- start 2024-09-10T22:24:43.818 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:43.815+0000 7f320765e640 1 -- start start 2024-09-10T22:24:43.818 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:43.815+0000 7f320765e640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3200102dc0 0x7f32000754a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:24:43.818 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:43.815+0000 7f320765e640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f32001087d0 0x7f32000759e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:24:43.819 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:43.815+0000 7f320765e640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3200109150 0x7f3200075f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:24:43.819 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:43.815+0000 7f320765e640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f3200112e50 con 0x7f32001087d0 2024-09-10T22:24:43.819 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:43.815+0000 7f320765e640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f3200112cd0 con 0x7f3200109150 2024-09-10T22:24:43.819 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:43.815+0000 7f320765e640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f3200112fd0 con 0x7f3200102dc0 2024-09-10T22:24:43.819 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:43.815+0000 7f3204bf9640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f32001087d0 0x7f32000759e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:24:43.819 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:43.815+0000 7f3204bf9640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f32001087d0 0x7f32000759e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:51544/0 (socket says 172.21.15.19:51544) 2024-09-10T22:24:43.819 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:43.815+0000 7f3204bf9640 1 -- 172.21.15.19:0/1127842948 learned_addr learned my addr 172.21.15.19:0/1127842948 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:24:43.819 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:43.815+0000 7f3205bfb640 1 --2- 172.21.15.19:0/1127842948 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3200109150 0x7f3200075f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:24:43.819 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:43.815+0000 7f32053fa640 1 --2- 172.21.15.19:0/1127842948 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3200102dc0 0x7f32000754a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:24:43.819 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:43.815+0000 7f3204bf9640 1 -- 172.21.15.19:0/1127842948 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3200102dc0 msgr2=0x7f32000754a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:24:43.819 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:43.816+0000 7f3204bf9640 1 --2- 172.21.15.19:0/1127842948 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3200102dc0 0x7f32000754a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:24:43.819 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:43.816+0000 7f3204bf9640 1 -- 172.21.15.19:0/1127842948 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3200109150 msgr2=0x7f3200075f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:24:43.819 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:43.816+0000 7f3204bf9640 1 --2- 172.21.15.19:0/1127842948 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3200109150 0x7f3200075f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:24:43.820 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:43.816+0000 7f3204bf9640 1 -- 172.21.15.19:0/1127842948 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f32001a7860 con 0x7f32001087d0 2024-09-10T22:24:43.820 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:43.816+0000 7f3204bf9640 1 --2- 172.21.15.19:0/1127842948 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f32001087d0 0x7f32000759e0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f31f000b4a0 tx=0x7f31f000b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:24:43.820 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:43.816+0000 7f31f67fc640 1 -- 172.21.15.19:0/1127842948 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31f0014070 con 0x7f32001087d0 2024-09-10T22:24:43.820 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:43.816+0000 7f320765e640 1 -- 172.21.15.19:0/1127842948 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f32001a7b50 con 0x7f32001087d0 2024-09-10T22:24:43.820 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:43.816+0000 7f31f67fc640 1 -- 172.21.15.19:0/1127842948 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f31f0010ac0 con 0x7f32001087d0 2024-09-10T22:24:43.820 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:43.816+0000 7f31f67fc640 1 -- 172.21.15.19:0/1127842948 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31f0017c30 con 0x7f32001087d0 2024-09-10T22:24:43.820 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:43.816+0000 7f320765e640 1 -- 172.21.15.19:0/1127842948 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f32001a80e0 con 0x7f32001087d0 2024-09-10T22:24:43.821 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:43.817+0000 7f320765e640 1 -- 172.21.15.19:0/1127842948 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3200103220 con 0x7f32001087d0 2024-09-10T22:24:43.821 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:43.819+0000 7f31f67fc640 1 -- 172.21.15.19:0/1127842948 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 17) ==== 153301+0+0 (secure 0 0 0) 0x7f31f0010610 con 0x7f32001087d0 2024-09-10T22:24:43.821 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:43.819+0000 7f31f67fc640 1 --2- 172.21.15.19:0/1127842948 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f31ec0b53f0 0x7f31ec0b78b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:24:43.821 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:43.819+0000 7f32053fa640 1 --2- 172.21.15.19:0/1127842948 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f31ec0b53f0 0x7f31ec0b78b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:24:43.821 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:43.819+0000 7f31f67fc640 1 -- 172.21.15.19:0/1127842948 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 7979+0+0 (secure 0 0 0) 0x7f31f00e5390 con 0x7f32001087d0 2024-09-10T22:24:43.821 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:43.820+0000 7f32053fa640 1 --2- 172.21.15.19:0/1127842948 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f31ec0b53f0 0x7f31ec0b78b0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f31fc02f500 tx=0x7f31fc02f310 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:24:43.823 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:43.822+0000 7f31f67fc640 1 -- 172.21.15.19:0/1127842948 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f31f00ac2a0 con 0x7f32001087d0 2024-09-10T22:24:43.860 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:24:43 smithi135 ceph-mon[34789]: pgmap v292: 97 pgs: 97 active+clean; 602 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 4.2 KiB/s wr, 13 op/s 2024-09-10T22:24:43.860 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:24:43 smithi135 ceph-mon[34789]: from='client.14859 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T22:24:43.875 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:24:43 smithi138 ceph-mon[35236]: pgmap v292: 97 pgs: 97 active+clean; 602 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 4.2 KiB/s wr, 13 op/s 2024-09-10T22:24:43.875 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:24:43 smithi138 ceph-mon[35236]: from='client.14859 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T22:24:44.045 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:44.043+0000 7f320765e640 1 -- 172.21.15.19:0/1127842948 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f32000767a0 con 0x7f32001087d0 2024-09-10T22:24:44.045 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:44.044+0000 7f31f67fc640 1 -- 172.21.15.19:0/1127842948 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) ==== 94+0+11921 (secure 0 0 0) 0x7f32000767a0 con 0x7f32001087d0 2024-09-10T22:24:44.046 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-10T22:24:44.046 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":24,"btime":"2024-09-10T22:24:34:220851+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14673,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6835/1835804747","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6834","nonce":1835804747},{"type":"v1","addr":"172.21.15.19:6835","nonce":1835804747}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14685,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6837/1750470490","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6836","nonce":1750470490},{"type":"v1","addr":"172.21.15.19:6837","nonce":1750470490}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14733,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6839/2642941149","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6838","nonce":2642941149},{"type":"v1","addr":"172.21.15.19:6839","nonce":2642941149}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14745,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6841/2449948682","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6840","nonce":2449948682},{"type":"v1","addr":"172.21.15.19:6841","nonce":2449948682}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24511,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.138:6833/2524811494","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6832","nonce":2524811494},{"type":"v1","addr":"172.21.15.138:6833","nonce":2524811494}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24512,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6833/3014993624","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6832","nonce":3014993624},{"type":"v1","addr":"172.21.15.135:6833","nonce":3014993624}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":24,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-10T22:24:22.733925+0000","modified":"2024-09-10T22:24:33.797491+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24581,"mds_1":24568,"mds_2":24553},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24527":{"gid":24527,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.135:6835/3715773348","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6834","nonce":3715773348},{"type":"v1","addr":"172.21.15.135:6835","nonce":3715773348}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24541":{"gid":24541,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.138:6835/933547028","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6834","nonce":933547028},{"type":"v1","addr":"172.21.15.138:6835","nonce":933547028}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24551":{"gid":24551,"name":"h","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.135:6837/3495029135","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6836","nonce":3495029135},{"type":"v1","addr":"172.21.15.135:6837","nonce":3495029135}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24553":{"gid":24553,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":10,"addr":"172.21.15.138:6837/3353290042","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6836","nonce":3353290042},{"type":"v1","addr":"172.21.15.138:6837","nonce":3353290042}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24568":{"gid":24568,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.138:6839/383637208","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6838","nonce":383637208},{"type":"v1","addr":"172.21.15.138:6839","nonce":383637208}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24581":{"gid":24581,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.135:6839/1254769802","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6838","nonce":1254769802},{"type":"v1","addr":"172.21.15.135:6839","nonce":1254769802}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24581,"qdb_cluster":[24553,24568,24581]},"id":1}]} 2024-09-10T22:24:44.046 INFO:teuthology.orchestra.run.smithi019.stderr:dumped fsmap epoch 24 2024-09-10T22:24:44.048 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:44.046+0000 7f320765e640 1 -- 172.21.15.19:0/1127842948 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f31ec0b53f0 msgr2=0x7f31ec0b78b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:24:44.048 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:44.046+0000 7f320765e640 1 --2- 172.21.15.19:0/1127842948 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f31ec0b53f0 0x7f31ec0b78b0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f31fc02f500 tx=0x7f31fc02f310 comp rx=0 tx=0).stop 2024-09-10T22:24:44.048 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:44.046+0000 7f320765e640 1 -- 172.21.15.19:0/1127842948 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f32001087d0 msgr2=0x7f32000759e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:24:44.048 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:44.046+0000 7f320765e640 1 --2- 172.21.15.19:0/1127842948 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f32001087d0 0x7f32000759e0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f31f000b4a0 tx=0x7f31f000b960 comp rx=0 tx=0).stop 2024-09-10T22:24:44.048 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:44.047+0000 7f320765e640 1 -- 172.21.15.19:0/1127842948 shutdown_connections 2024-09-10T22:24:44.048 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:44.047+0000 7f320765e640 1 --2- 172.21.15.19:0/1127842948 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f31ec0b53f0 0x7f31ec0b78b0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:24:44.048 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:44.047+0000 7f320765e640 1 --2- 172.21.15.19:0/1127842948 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3200109150 0x7f3200075f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:24:44.048 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:44.047+0000 7f320765e640 1 --2- 172.21.15.19:0/1127842948 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f32001087d0 0x7f32000759e0 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:24:44.048 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:44.047+0000 7f320765e640 1 --2- 172.21.15.19:0/1127842948 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3200102dc0 0x7f32000754a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:24:44.049 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:44.047+0000 7f320765e640 1 -- 172.21.15.19:0/1127842948 >> 172.21.15.19:0/1127842948 conn(0x7f32000fe830 msgr2=0x7f3200100c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:24:44.049 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:44.047+0000 7f320765e640 1 -- 172.21.15.19:0/1127842948 shutdown_connections 2024-09-10T22:24:44.049 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:44.047+0000 7f320765e640 1 -- 172.21.15.19:0/1127842948 wait complete. 2024-09-10T22:24:44.649 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 22997a4c-6fc2-11ef-bcea-c7b262605968 -- ceph osd dump --format=json 2024-09-10T22:24:44.708 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:24:44 smithi019 ceph-mon[31375]: from='client.? 172.21.15.19:0/1127842948' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T22:24:44.859 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:24:44 smithi135 ceph-mon[34789]: from='client.? 172.21.15.19:0/1127842948' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T22:24:44.875 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:24:44 smithi138 ceph-mon[35236]: from='client.? 172.21.15.19:0/1127842948' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T22:24:44.906 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/22997a4c-6fc2-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T22:24:45.350 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:45.347+0000 7f39f2d28640 1 -- 172.21.15.19:0/2741645943 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f39ec103ce0 msgr2=0x7f39ec1040c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:24:45.350 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:45.347+0000 7f39f2d28640 1 --2- 172.21.15.19:0/2741645943 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f39ec103ce0 0x7f39ec1040c0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f39e8009900 tx=0x7f39e802a410 comp rx=0 tx=0).stop 2024-09-10T22:24:45.350 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:45.347+0000 7f39f2d28640 1 -- 172.21.15.19:0/2741645943 shutdown_connections 2024-09-10T22:24:45.351 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:45.347+0000 7f39f2d28640 1 --2- 172.21.15.19:0/2741645943 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f39ec10d140 0x7f39ec10f5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:24:45.351 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:45.347+0000 7f39f2d28640 1 --2- 172.21.15.19:0/2741645943 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f39ec104600 0x7f39ec10caf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:24:45.351 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:45.347+0000 7f39f2d28640 1 --2- 172.21.15.19:0/2741645943 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f39ec103ce0 0x7f39ec1040c0 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:24:45.351 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:45.347+0000 7f39f2d28640 1 -- 172.21.15.19:0/2741645943 >> 172.21.15.19:0/2741645943 conn(0x7f39ec0fd700 msgr2=0x7f39ec0ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:24:45.351 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:45.347+0000 7f39f2d28640 1 -- 172.21.15.19:0/2741645943 shutdown_connections 2024-09-10T22:24:45.351 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:45.347+0000 7f39f2d28640 1 -- 172.21.15.19:0/2741645943 wait complete. 2024-09-10T22:24:45.351 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:45.348+0000 7f39f2d28640 1 Processor -- start 2024-09-10T22:24:45.351 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:45.348+0000 7f39f2d28640 1 -- start start 2024-09-10T22:24:45.351 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:45.348+0000 7f39f2d28640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f39ec103ce0 0x7f39ec19b680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:24:45.351 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:45.348+0000 7f39f2d28640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f39ec104600 0x7f39ec19bbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:24:45.351 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:45.348+0000 7f39f2d28640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f39ec10d140 0x7f39ec1a0f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:24:45.351 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:45.349+0000 7f39f2d28640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f39ec112e90 con 0x7f39ec10d140 2024-09-10T22:24:45.352 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:45.349+0000 7f39f2d28640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f39ec112d10 con 0x7f39ec103ce0 2024-09-10T22:24:45.352 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:45.349+0000 7f39f2d28640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f39ec113010 con 0x7f39ec104600 2024-09-10T22:24:45.352 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:45.349+0000 7f39f0ac4640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f39ec103ce0 0x7f39ec19b680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:24:45.352 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:45.349+0000 7f39f12c5640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f39ec10d140 0x7f39ec1a0f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:24:45.352 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:45.349+0000 7f39f0ac4640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f39ec103ce0 0x7f39ec19b680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.19:57904/0 (socket says 172.21.15.19:57904) 2024-09-10T22:24:45.352 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:45.349+0000 7f39f0ac4640 1 -- 172.21.15.19:0/1752311110 learned_addr learned my addr 172.21.15.19:0/1752311110 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:24:45.353 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:45.349+0000 7f39f12c5640 1 -- 172.21.15.19:0/1752311110 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f39ec104600 msgr2=0x7f39ec19bbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:24:45.353 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:45.349+0000 7f39f12c5640 1 --2- 172.21.15.19:0/1752311110 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f39ec104600 0x7f39ec19bbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:24:45.353 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:45.349+0000 7f39f12c5640 1 -- 172.21.15.19:0/1752311110 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f39ec103ce0 msgr2=0x7f39ec19b680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:24:45.353 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:45.349+0000 7f39f12c5640 1 --2- 172.21.15.19:0/1752311110 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f39ec103ce0 0x7f39ec19b680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:24:45.353 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:45.349+0000 7f39f12c5640 1 -- 172.21.15.19:0/1752311110 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f39ec1a1730 con 0x7f39ec10d140 2024-09-10T22:24:45.354 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:45.350+0000 7f39f12c5640 1 --2- 172.21.15.19:0/1752311110 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f39ec10d140 0x7f39ec1a0f60 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f39e400be20 tx=0x7f39e400bf10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:24:45.354 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:45.350+0000 7f39e1ffb640 1 -- 172.21.15.19:0/1752311110 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39e4019070 con 0x7f39ec10d140 2024-09-10T22:24:45.354 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:45.350+0000 7f39e1ffb640 1 -- 172.21.15.19:0/1752311110 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f39e40148f0 con 0x7f39ec10d140 2024-09-10T22:24:45.354 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:45.350+0000 7f39f2d28640 1 -- 172.21.15.19:0/1752311110 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f39ec1a1a20 con 0x7f39ec10d140 2024-09-10T22:24:45.354 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:45.350+0000 7f39e1ffb640 1 -- 172.21.15.19:0/1752311110 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39e4012840 con 0x7f39ec10d140 2024-09-10T22:24:45.354 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:45.350+0000 7f39f2d28640 1 -- 172.21.15.19:0/1752311110 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f39ec1a8160 con 0x7f39ec10d140 2024-09-10T22:24:45.354 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:45.351+0000 7f39f2d28640 1 -- 172.21.15.19:0/1752311110 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f39ec104140 con 0x7f39ec10d140 2024-09-10T22:24:45.355 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:45.353+0000 7f39e1ffb640 1 -- 172.21.15.19:0/1752311110 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 17) ==== 153301+0+0 (secure 0 0 0) 0x7f39e4014440 con 0x7f39ec10d140 2024-09-10T22:24:45.355 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:45.353+0000 7f39e1ffb640 1 --2- 172.21.15.19:0/1752311110 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f39d40b53f0 0x7f39d40b78b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:24:45.355 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:45.354+0000 7f39f0ac4640 1 --2- 172.21.15.19:0/1752311110 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f39d40b53f0 0x7f39d40b78b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:24:45.355 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:45.354+0000 7f39e1ffb640 1 -- 172.21.15.19:0/1752311110 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 7979+0+0 (secure 0 0 0) 0x7f39e40e5560 con 0x7f39ec10d140 2024-09-10T22:24:45.355 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:45.354+0000 7f39f0ac4640 1 --2- 172.21.15.19:0/1752311110 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f39d40b53f0 0x7f39d40b78b0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f39e8005ec0 tx=0x7f39e80058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:24:45.360 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:45.358+0000 7f39e1ffb640 1 -- 172.21.15.19:0/1752311110 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f39e40abe20 con 0x7f39ec10d140 2024-09-10T22:24:45.547 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:45.546+0000 7f39f2d28640 1 -- 172.21.15.19:0/1752311110 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f39ec1a84f0 con 0x7f39ec10d140 2024-09-10T22:24:45.549 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:45.547+0000 7f39e1ffb640 1 -- 172.21.15.19:0/1752311110 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v73) ==== 74+0+22289 (secure 0 0 0) 0x7f39e40b0850 con 0x7f39ec10d140 2024-09-10T22:24:45.549 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-10T22:24:45.549 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":73,"fsid":"22997a4c-6fc2-11ef-bcea-c7b262605968","created":"2024-09-10T22:16:16.754696+0000","modified":"2024-09-10T22:24:22.733974+0000","last_up_change":"2024-09-10T22:23:32.417392+0000","last_in_change":"2024-09-10T22:23:09.614371+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T22:19:50.731662+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-10T22:24:18.740121+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"73","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-10T22:24:20.795178+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"73","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"783d96cb-0a8a-47f3-8eab-77cd731a64bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6802","nonce":234761879},{"type":"v1","addr":"172.21.15.19:6803","nonce":234761879}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6804","nonce":234761879},{"type":"v1","addr":"172.21.15.19:6805","nonce":234761879}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6808","nonce":234761879},{"type":"v1","addr":"172.21.15.19:6809","nonce":234761879}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6806","nonce":234761879},{"type":"v1","addr":"172.21.15.19:6807","nonce":234761879}]},"public_addr":"172.21.15.19:6803/234761879","cluster_addr":"172.21.15.19:6805/234761879","heartbeat_back_addr":"172.21.15.19:6809/234761879","heartbeat_front_addr":"172.21.15.19:6807/234761879","state":["exists","up"]},{"osd":1,"uuid":"41043581-e0cf-43b5-bae0-0d95e2ef8156","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6800","nonce":1803526886},{"type":"v1","addr":"172.21.15.135:6801","nonce":1803526886}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6802","nonce":1803526886},{"type":"v1","addr":"172.21.15.135:6803","nonce":1803526886}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6806","nonce":1803526886},{"type":"v1","addr":"172.21.15.135:6807","nonce":1803526886}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6804","nonce":1803526886},{"type":"v1","addr":"172.21.15.135:6805","nonce":1803526886}]},"public_addr":"172.21.15.135:6801/1803526886","cluster_addr":"172.21.15.135:6803/1803526886","heartbeat_back_addr":"172.21.15.135:6807/1803526886","heartbeat_front_addr":"172.21.15.135:6805/1803526886","state":["exists","up"]},{"osd":2,"uuid":"a9b14a06-bbdc-4501-96e2-fb5f7127ca16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6800","nonce":2747418770},{"type":"v1","addr":"172.21.15.138:6801","nonce":2747418770}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6802","nonce":2747418770},{"type":"v1","addr":"172.21.15.138:6803","nonce":2747418770}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6806","nonce":2747418770},{"type":"v1","addr":"172.21.15.138:6807","nonce":2747418770}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6804","nonce":2747418770},{"type":"v1","addr":"172.21.15.138:6805","nonce":2747418770}]},"public_addr":"172.21.15.138:6801/2747418770","cluster_addr":"172.21.15.138:6803/2747418770","heartbeat_back_addr":"172.21.15.138:6807/2747418770","heartbeat_front_addr":"172.21.15.138:6805/2747418770","state":["exists","up"]},{"osd":3,"uuid":"a46268da-8666-4cfa-b11a-30eb12e271be","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":23,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6810","nonce":1889857224},{"type":"v1","addr":"172.21.15.19:6811","nonce":1889857224}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6812","nonce":1889857224},{"type":"v1","addr":"172.21.15.19:6813","nonce":1889857224}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6816","nonce":1889857224},{"type":"v1","addr":"172.21.15.19:6817","nonce":1889857224}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6814","nonce":1889857224},{"type":"v1","addr":"172.21.15.19:6815","nonce":1889857224}]},"public_addr":"172.21.15.19:6811/1889857224","cluster_addr":"172.21.15.19:6813/1889857224","heartbeat_back_addr":"172.21.15.19:6817/1889857224","heartbeat_front_addr":"172.21.15.19:6815/1889857224","state":["exists","up"]},{"osd":4,"uuid":"c58df06f-2de2-4655-88e7-ac6a3531839a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":29,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6808","nonce":436311825},{"type":"v1","addr":"172.21.15.135:6809","nonce":436311825}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6810","nonce":436311825},{"type":"v1","addr":"172.21.15.135:6811","nonce":436311825}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6814","nonce":436311825},{"type":"v1","addr":"172.21.15.135:6815","nonce":436311825}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6812","nonce":436311825},{"type":"v1","addr":"172.21.15.135:6813","nonce":436311825}]},"public_addr":"172.21.15.135:6809/436311825","cluster_addr":"172.21.15.135:6811/436311825","heartbeat_back_addr":"172.21.15.135:6815/436311825","heartbeat_front_addr":"172.21.15.135:6813/436311825","state":["exists","up"]},{"osd":5,"uuid":"c0900b0c-aef4-498d-a01b-a891bdb51122","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6808","nonce":1086764290},{"type":"v1","addr":"172.21.15.138:6809","nonce":1086764290}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6810","nonce":1086764290},{"type":"v1","addr":"172.21.15.138:6811","nonce":1086764290}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6814","nonce":1086764290},{"type":"v1","addr":"172.21.15.138:6815","nonce":1086764290}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6812","nonce":1086764290},{"type":"v1","addr":"172.21.15.138:6813","nonce":1086764290}]},"public_addr":"172.21.15.138:6809/1086764290","cluster_addr":"172.21.15.138:6811/1086764290","heartbeat_back_addr":"172.21.15.138:6815/1086764290","heartbeat_front_addr":"172.21.15.138:6813/1086764290","state":["exists","up"]},{"osd":6,"uuid":"f79cb310-8073-4ee5-80a6-87a290600321","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":40,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6818","nonce":406328354},{"type":"v1","addr":"172.21.15.19:6819","nonce":406328354}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6820","nonce":406328354},{"type":"v1","addr":"172.21.15.19:6821","nonce":406328354}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6824","nonce":406328354},{"type":"v1","addr":"172.21.15.19:6825","nonce":406328354}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6822","nonce":406328354},{"type":"v1","addr":"172.21.15.19:6823","nonce":406328354}]},"public_addr":"172.21.15.19:6819/406328354","cluster_addr":"172.21.15.19:6821/406328354","heartbeat_back_addr":"172.21.15.19:6825/406328354","heartbeat_front_addr":"172.21.15.19:6823/406328354","state":["exists","up"]},{"osd":7,"uuid":"cc76476a-92f3-489c-be9e-29cbbf39539e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6816","nonce":1096613674},{"type":"v1","addr":"172.21.15.135:6817","nonce":1096613674}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6818","nonce":1096613674},{"type":"v1","addr":"172.21.15.135:6819","nonce":1096613674}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6822","nonce":1096613674},{"type":"v1","addr":"172.21.15.135:6823","nonce":1096613674}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6820","nonce":1096613674},{"type":"v1","addr":"172.21.15.135:6821","nonce":1096613674}]},"public_addr":"172.21.15.135:6817/1096613674","cluster_addr":"172.21.15.135:6819/1096613674","heartbeat_back_addr":"172.21.15.135:6823/1096613674","heartbeat_front_addr":"172.21.15.135:6821/1096613674","state":["exists","up"]},{"osd":8,"uuid":"5323a006-a6e8-4403-9c51-65f46298d5c4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6816","nonce":3020394729},{"type":"v1","addr":"172.21.15.138:6817","nonce":3020394729}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6818","nonce":3020394729},{"type":"v1","addr":"172.21.15.138:6819","nonce":3020394729}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6822","nonce":3020394729},{"type":"v1","addr":"172.21.15.138:6823","nonce":3020394729}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6820","nonce":3020394729},{"type":"v1","addr":"172.21.15.138:6821","nonce":3020394729}]},"public_addr":"172.21.15.138:6817/3020394729","cluster_addr":"172.21.15.138:6819/3020394729","heartbeat_back_addr":"172.21.15.138:6823/3020394729","heartbeat_front_addr":"172.21.15.138:6821/3020394729","state":["exists","up"]},{"osd":9,"uuid":"b869ac42-c46e-442c-8b5b-f81c018e663c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":57,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6826","nonce":1488680899},{"type":"v1","addr":"172.21.15.19:6827","nonce":1488680899}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6828","nonce":1488680899},{"type":"v1","addr":"172.21.15.19:6829","nonce":1488680899}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6832","nonce":1488680899},{"type":"v1","addr":"172.21.15.19:6833","nonce":1488680899}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6830","nonce":1488680899},{"type":"v1","addr":"172.21.15.19:6831","nonce":1488680899}]},"public_addr":"172.21.15.19:6827/1488680899","cluster_addr":"172.21.15.19:6829/1488680899","heartbeat_back_addr":"172.21.15.19:6833/1488680899","heartbeat_front_addr":"172.21.15.19:6831/1488680899","state":["exists","up"]},{"osd":10,"uuid":"b8a2d69a-6821-4c69-b7eb-c0cfc8164614","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":62,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6824","nonce":3812626754},{"type":"v1","addr":"172.21.15.135:6825","nonce":3812626754}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6826","nonce":3812626754},{"type":"v1","addr":"172.21.15.135:6827","nonce":3812626754}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6830","nonce":3812626754},{"type":"v1","addr":"172.21.15.135:6831","nonce":3812626754}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6828","nonce":3812626754},{"type":"v1","addr":"172.21.15.135:6829","nonce":3812626754}]},"public_addr":"172.21.15.135:6825/3812626754","cluster_addr":"172.21.15.135:6827/3812626754","heartbeat_back_addr":"172.21.15.135:6831/3812626754","heartbeat_front_addr":"172.21.15.135:6829/3812626754","state":["exists","up"]},{"osd":11,"uuid":"a9264ab2-5843-44d2-aba8-1e12708e99d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6824","nonce":1098434807},{"type":"v1","addr":"172.21.15.138:6825","nonce":1098434807}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6826","nonce":1098434807},{"type":"v1","addr":"172.21.15.138:6827","nonce":1098434807}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6830","nonce":1098434807},{"type":"v1","addr":"172.21.15.138:6831","nonce":1098434807}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6828","nonce":1098434807},{"type":"v1","addr":"172.21.15.138:6829","nonce":1098434807}]},"public_addr":"172.21.15.138:6825/1098434807","cluster_addr":"172.21.15.138:6827/1098434807","heartbeat_back_addr":"172.21.15.138:6831/1098434807","heartbeat_front_addr":"172.21.15.138:6829/1098434807","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:18:58.008025+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:19:22.475890+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:19:47.124147+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:20:12.438853+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:20:37.195177+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:21:02.474248+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:21:27.087207+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:21:52.119211+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:22:16.569989+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:22:41.680986+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:23:06.391885+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:23:30.695460+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.19:0/2099468127":"2024-09-11T22:17:04.260826+0000","172.21.15.19:0/538724915":"2024-09-11T22:17:04.260826+0000","172.21.15.19:0/3504695777":"2024-09-11T22:17:04.260826+0000","172.21.15.19:0/1401613792":"2024-09-11T22:16:39.069638+0000","172.21.15.19:6801/3005924425":"2024-09-11T22:17:04.260826+0000","172.21.15.19:6800/3005924425":"2024-09-11T22:17:04.260826+0000","172.21.15.19:0/104917892":"2024-09-11T22:16:39.069638+0000","172.21.15.19:0/1778305990":"2024-09-11T22:16:39.069638+0000","172.21.15.19:6801/535670059":"2024-09-11T22:16:39.069638+0000","172.21.15.19:6800/535670059":"2024-09-11T22:16:39.069638+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T22:24:45.551 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:45.550+0000 7f39f2d28640 1 -- 172.21.15.19:0/1752311110 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f39d40b53f0 msgr2=0x7f39d40b78b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:24:45.551 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:45.550+0000 7f39f2d28640 1 --2- 172.21.15.19:0/1752311110 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f39d40b53f0 0x7f39d40b78b0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f39e8005ec0 tx=0x7f39e80058d0 comp rx=0 tx=0).stop 2024-09-10T22:24:45.551 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:45.550+0000 7f39f2d28640 1 -- 172.21.15.19:0/1752311110 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f39ec10d140 msgr2=0x7f39ec1a0f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:24:45.552 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:45.550+0000 7f39f2d28640 1 --2- 172.21.15.19:0/1752311110 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f39ec10d140 0x7f39ec1a0f60 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f39e400be20 tx=0x7f39e400bf10 comp rx=0 tx=0).stop 2024-09-10T22:24:45.552 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:45.550+0000 7f39f2d28640 1 -- 172.21.15.19:0/1752311110 shutdown_connections 2024-09-10T22:24:45.552 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:45.550+0000 7f39f2d28640 1 --2- 172.21.15.19:0/1752311110 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f39d40b53f0 0x7f39d40b78b0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:24:45.552 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:45.550+0000 7f39f2d28640 1 --2- 172.21.15.19:0/1752311110 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f39ec10d140 0x7f39ec1a0f60 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:24:45.552 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:45.550+0000 7f39f2d28640 1 --2- 172.21.15.19:0/1752311110 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f39ec104600 0x7f39ec19bbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:24:45.552 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:45.550+0000 7f39f2d28640 1 --2- 172.21.15.19:0/1752311110 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f39ec103ce0 0x7f39ec19b680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:24:45.552 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:45.550+0000 7f39f2d28640 1 -- 172.21.15.19:0/1752311110 >> 172.21.15.19:0/1752311110 conn(0x7f39ec0fd700 msgr2=0x7f39ec0ffaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:24:45.552 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:45.550+0000 7f39f2d28640 1 -- 172.21.15.19:0/1752311110 shutdown_connections 2024-09-10T22:24:45.552 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:45.550+0000 7f39f2d28640 1 -- 172.21.15.19:0/1752311110 wait complete. 2024-09-10T22:24:45.708 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:24:45 smithi019 ceph-mon[31375]: pgmap v293: 97 pgs: 97 active+clean; 602 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 4.2 KiB/s wr, 13 op/s 2024-09-10T22:24:45.859 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:24:45 smithi135 ceph-mon[34789]: pgmap v293: 97 pgs: 97 active+clean; 602 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 4.2 KiB/s wr, 13 op/s 2024-09-10T22:24:45.874 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:24:45 smithi138 ceph-mon[35236]: pgmap v293: 97 pgs: 97 active+clean; 602 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 4.2 KiB/s wr, 13 op/s 2024-09-10T22:24:46.318 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2024-09-10T22:24:46.318 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 22997a4c-6fc2-11ef-bcea-c7b262605968 -- ceph pg dump --format=json 2024-09-10T22:24:46.585 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/22997a4c-6fc2-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T22:24:46.705 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:24:46 smithi019 ceph-mon[31375]: from='client.? 172.21.15.19:0/1752311110' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-10T22:24:46.860 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:24:46 smithi135 ceph-mon[34789]: from='client.? 172.21.15.19:0/1752311110' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-10T22:24:46.875 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:24:46 smithi138 ceph-mon[35236]: from='client.? 172.21.15.19:0/1752311110' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-10T22:24:47.058 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:47.048+0000 7fe54e411640 1 -- 172.21.15.19:0/1925815625 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe548108020 msgr2=0x7fe54810e820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:24:47.059 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:47.048+0000 7fe54e411640 1 --2- 172.21.15.19:0/1925815625 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe548108020 0x7fe54810e820 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fe540009ca0 tx=0x7fe54002a8c0 comp rx=0 tx=0).stop 2024-09-10T22:24:47.059 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:47.048+0000 7fe54e411640 1 -- 172.21.15.19:0/1925815625 shutdown_connections 2024-09-10T22:24:47.059 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:47.048+0000 7fe54e411640 1 --2- 172.21.15.19:0/1925815625 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe548108020 0x7fe54810e820 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:24:47.059 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:47.048+0000 7fe54e411640 1 --2- 172.21.15.19:0/1925815625 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe5481076a0 0x7fe548107ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:24:47.059 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:47.048+0000 7fe54e411640 1 --2- 172.21.15.19:0/1925815625 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe548101c90 0x7fe548102070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:24:47.059 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:47.048+0000 7fe54e411640 1 -- 172.21.15.19:0/1925815625 >> 172.21.15.19:0/1925815625 conn(0x7fe5480fd700 msgr2=0x7fe5480ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:24:47.059 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:47.048+0000 7fe54e411640 1 -- 172.21.15.19:0/1925815625 shutdown_connections 2024-09-10T22:24:47.059 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:47.048+0000 7fe54e411640 1 -- 172.21.15.19:0/1925815625 wait complete. 2024-09-10T22:24:47.059 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:47.049+0000 7fe54e411640 1 Processor -- start 2024-09-10T22:24:47.059 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:47.049+0000 7fe54e411640 1 -- start start 2024-09-10T22:24:47.059 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:47.049+0000 7fe54e411640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe548101c90 0x7fe548198150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:24:47.059 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:47.049+0000 7fe54e411640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe5481076a0 0x7fe548198690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:24:47.059 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:47.049+0000 7fe54e411640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe548108020 0x7fe54819da30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:24:47.060 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:47.049+0000 7fe54e411640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fe548111ca0 con 0x7fe548108020 2024-09-10T22:24:47.060 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:47.049+0000 7fe54e411640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fe548111b20 con 0x7fe5481076a0 2024-09-10T22:24:47.060 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:47.049+0000 7fe54e411640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7fe548111e20 con 0x7fe548101c90 2024-09-10T22:24:47.060 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:47.049+0000 7fe54c9ae640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe548108020 0x7fe54819da30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:24:47.060 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:47.049+0000 7fe54c9ae640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe548108020 0x7fe54819da30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:51584/0 (socket says 172.21.15.19:51584) 2024-09-10T22:24:47.060 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:47.049+0000 7fe54c9ae640 1 -- 172.21.15.19:0/2658326586 learned_addr learned my addr 172.21.15.19:0/2658326586 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:24:47.060 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:47.050+0000 7fe547fff640 1 --2- 172.21.15.19:0/2658326586 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe548101c90 0x7fe548198150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:24:47.060 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:47.050+0000 7fe53ffff640 1 --2- 172.21.15.19:0/2658326586 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe5481076a0 0x7fe548198690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:24:47.060 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:47.050+0000 7fe54c9ae640 1 -- 172.21.15.19:0/2658326586 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe548101c90 msgr2=0x7fe548198150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:24:47.060 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:47.050+0000 7fe54c9ae640 1 --2- 172.21.15.19:0/2658326586 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe548101c90 0x7fe548198150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:24:47.060 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:47.050+0000 7fe54c9ae640 1 -- 172.21.15.19:0/2658326586 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe5481076a0 msgr2=0x7fe548198690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:24:47.060 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:47.050+0000 7fe54c9ae640 1 --2- 172.21.15.19:0/2658326586 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe5481076a0 0x7fe548198690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:24:47.060 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:47.050+0000 7fe54c9ae640 1 -- 172.21.15.19:0/2658326586 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe54819e200 con 0x7fe548108020 2024-09-10T22:24:47.061 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:47.050+0000 7fe54c9ae640 1 --2- 172.21.15.19:0/2658326586 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe548108020 0x7fe54819da30 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fe540005cc0 tx=0x7fe54002f380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:24:47.061 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:47.050+0000 7fe545ffb640 1 -- 172.21.15.19:0/2658326586 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe540003bf0 con 0x7fe548108020 2024-09-10T22:24:47.061 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:47.050+0000 7fe545ffb640 1 -- 172.21.15.19:0/2658326586 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe540003d90 con 0x7fe548108020 2024-09-10T22:24:47.061 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:47.050+0000 7fe54e411640 1 -- 172.21.15.19:0/2658326586 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe54819e490 con 0x7fe548108020 2024-09-10T22:24:47.061 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:47.050+0000 7fe545ffb640 1 -- 172.21.15.19:0/2658326586 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe54002fbc0 con 0x7fe548108020 2024-09-10T22:24:47.061 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:47.050+0000 7fe54e411640 1 -- 172.21.15.19:0/2658326586 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe5481a4bb0 con 0x7fe548108020 2024-09-10T22:24:47.061 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:47.051+0000 7fe54e411640 1 -- 172.21.15.19:0/2658326586 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe548102070 con 0x7fe548108020 2024-09-10T22:24:47.061 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:47.053+0000 7fe545ffb640 1 -- 172.21.15.19:0/2658326586 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 17) ==== 153301+0+0 (secure 0 0 0) 0x7fe540004610 con 0x7fe548108020 2024-09-10T22:24:47.061 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:47.053+0000 7fe545ffb640 1 --2- 172.21.15.19:0/2658326586 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7fe5340b53f0 0x7fe5340b78b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:24:47.061 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:47.054+0000 7fe547fff640 1 --2- 172.21.15.19:0/2658326586 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7fe5340b53f0 0x7fe5340b78b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:24:47.061 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:47.054+0000 7fe545ffb640 1 -- 172.21.15.19:0/2658326586 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 7979+0+0 (secure 0 0 0) 0x7fe540107280 con 0x7fe548108020 2024-09-10T22:24:47.061 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:47.054+0000 7fe547fff640 1 --2- 172.21.15.19:0/2658326586 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7fe5340b53f0 0x7fe5340b78b0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fe538005e10 tx=0x7fe538005da0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:24:47.061 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:47.056+0000 7fe545ffb640 1 -- 172.21.15.19:0/2658326586 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7fe5400ce190 con 0x7fe548108020 2024-09-10T22:24:47.239 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:47.238+0000 7fe54e411640 1 -- 172.21.15.19:0/2658326586 --> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fe548063590 con 0x7fe5340b53f0 2024-09-10T22:24:47.244 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:47.243+0000 7fe545ffb640 1 -- 172.21.15.19:0/2658326586 <== mgr.14150 v2:172.21.15.19:6800/2119495487 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258696 (secure 0 0 0) 0x7fe548063590 con 0x7fe5340b53f0 2024-09-10T22:24:47.247 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-10T22:24:47.248 INFO:teuthology.orchestra.run.smithi019.stderr:dumped all 2024-09-10T22:24:47.251 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:47.247+0000 7fe54e411640 1 -- 172.21.15.19:0/2658326586 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7fe5340b53f0 msgr2=0x7fe5340b78b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:24:47.251 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:47.247+0000 7fe54e411640 1 --2- 172.21.15.19:0/2658326586 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7fe5340b53f0 0x7fe5340b78b0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fe538005e10 tx=0x7fe538005da0 comp rx=0 tx=0).stop 2024-09-10T22:24:47.251 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:47.247+0000 7fe54e411640 1 -- 172.21.15.19:0/2658326586 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe548108020 msgr2=0x7fe54819da30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:24:47.251 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:47.247+0000 7fe54e411640 1 --2- 172.21.15.19:0/2658326586 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe548108020 0x7fe54819da30 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fe540005cc0 tx=0x7fe54002f380 comp rx=0 tx=0).stop 2024-09-10T22:24:47.251 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:47.247+0000 7fe54e411640 1 -- 172.21.15.19:0/2658326586 shutdown_connections 2024-09-10T22:24:47.251 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:47.247+0000 7fe54e411640 1 --2- 172.21.15.19:0/2658326586 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7fe5340b53f0 0x7fe5340b78b0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:24:47.251 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:47.247+0000 7fe54e411640 1 --2- 172.21.15.19:0/2658326586 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe548108020 0x7fe54819da30 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:24:47.251 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:47.247+0000 7fe54e411640 1 --2- 172.21.15.19:0/2658326586 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe5481076a0 0x7fe548198690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:24:47.251 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:47.247+0000 7fe54e411640 1 --2- 172.21.15.19:0/2658326586 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe548101c90 0x7fe548198150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:24:47.251 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:47.247+0000 7fe54e411640 1 -- 172.21.15.19:0/2658326586 >> 172.21.15.19:0/2658326586 conn(0x7fe5480fd700 msgr2=0x7fe5480ffaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:24:47.252 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:47.247+0000 7fe54e411640 1 -- 172.21.15.19:0/2658326586 shutdown_connections 2024-09-10T22:24:47.252 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:47.247+0000 7fe54e411640 1 -- 172.21.15.19:0/2658326586 wait complete. 2024-09-10T22:24:47.708 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:24:47 smithi019 ceph-mon[31375]: pgmap v294: 97 pgs: 97 active+clean; 626 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 8.5 KiB/s rd, 5.7 KiB/s wr, 13 op/s 2024-09-10T22:24:47.859 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:24:47 smithi135 ceph-mon[34789]: pgmap v294: 97 pgs: 97 active+clean; 626 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 8.5 KiB/s rd, 5.7 KiB/s wr, 13 op/s 2024-09-10T22:24:47.875 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:24:47 smithi138 ceph-mon[35236]: pgmap v294: 97 pgs: 97 active+clean; 626 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 8.5 KiB/s rd, 5.7 KiB/s wr, 13 op/s 2024-09-10T22:24:48.016 INFO:teuthology.orchestra.run.smithi019.stdout:{"pg_ready":true,"pg_map":{"version":294,"stamp":"2024-09-10T22:24:46.367574+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":641403,"num_objects":64,"num_object_clones":0,"num_object_copies":192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":182,"num_read_kb":172,"num_write":274,"num_write_kb":2244,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":222,"ondisk_log_size":222,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":377192,"kb_used_data":11304,"kb_used_omap":18,"kb_used_meta":365677,"kb_avail":1124564632,"statfs":{"total":1151940427776,"available":1151554183168,"internally_reserved":0,"allocated":11575296,"data_stored":6475017,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19142,"internal_metadata":374453562},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":48311,"num_objects":22,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":100,"num_read_kb":102,"num_write":65,"num_write_kb":69,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003391"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T22:24:23.150882+0000","last_change":"2024-09-10T22:24:22.139905+0000","last_active":"2024-09-10T22:24:23.150882+0000","last_peered":"2024-09-10T22:24:23.150882+0000","last_clean":"2024-09-10T22:24:23.150882+0000","last_became_active":"2024-09-10T22:24:22.139558+0000","last_became_peered":"2024-09-10T22:24:22.139558+0000","last_unstale":"2024-09-10T22:24:23.150882+0000","last_undegraded":"2024-09-10T22:24:23.150882+0000","last_fullsized":"2024-09-10T22:24:23.150882+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_clean_scrub_stamp":"2024-09-10T22:24:21.113844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:44:10.434972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T22:24:23.151866+0000","last_change":"2024-09-10T22:24:22.136722+0000","last_active":"2024-09-10T22:24:23.151866+0000","last_peered":"2024-09-10T22:24:23.151866+0000","last_clean":"2024-09-10T22:24:23.151866+0000","last_became_active":"2024-09-10T22:24:22.136080+0000","last_became_peered":"2024-09-10T22:24:22.136080+0000","last_unstale":"2024-09-10T22:24:23.151866+0000","last_undegraded":"2024-09-10T22:24:23.151866+0000","last_fullsized":"2024-09-10T22:24:23.151866+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_clean_scrub_stamp":"2024-09-10T22:24:21.113844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:52:50.562031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T22:24:23.151124+0000","last_change":"2024-09-10T22:24:22.141323+0000","last_active":"2024-09-10T22:24:23.151124+0000","last_peered":"2024-09-10T22:24:23.151124+0000","last_clean":"2024-09-10T22:24:23.151124+0000","last_became_active":"2024-09-10T22:24:22.140895+0000","last_became_peered":"2024-09-10T22:24:22.140895+0000","last_unstale":"2024-09-10T22:24:23.151124+0000","last_undegraded":"2024-09-10T22:24:23.151124+0000","last_fullsized":"2024-09-10T22:24:23.151124+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_clean_scrub_stamp":"2024-09-10T22:24:21.113844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:46:22.604672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T22:24:23.146229+0000","last_change":"2024-09-10T22:24:22.138806+0000","last_active":"2024-09-10T22:24:23.146229+0000","last_peered":"2024-09-10T22:24:23.146229+0000","last_clean":"2024-09-10T22:24:23.146229+0000","last_became_active":"2024-09-10T22:24:22.138502+0000","last_became_peered":"2024-09-10T22:24:22.138502+0000","last_unstale":"2024-09-10T22:24:23.146229+0000","last_undegraded":"2024-09-10T22:24:23.146229+0000","last_fullsized":"2024-09-10T22:24:23.146229+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_clean_scrub_stamp":"2024-09-10T22:24:21.113844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:45:01.626820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T22:24:23.149005+0000","last_change":"2024-09-10T22:24:22.141233+0000","last_active":"2024-09-10T22:24:23.149005+0000","last_peered":"2024-09-10T22:24:23.149005+0000","last_clean":"2024-09-10T22:24:23.149005+0000","last_became_active":"2024-09-10T22:24:22.140944+0000","last_became_peered":"2024-09-10T22:24:22.140944+0000","last_unstale":"2024-09-10T22:24:23.149005+0000","last_undegraded":"2024-09-10T22:24:23.149005+0000","last_fullsized":"2024-09-10T22:24:23.149005+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_clean_scrub_stamp":"2024-09-10T22:24:21.113844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:09:29.615658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T22:24:23.145392+0000","last_change":"2024-09-10T22:24:22.137990+0000","last_active":"2024-09-10T22:24:23.145392+0000","last_peered":"2024-09-10T22:24:23.145392+0000","last_clean":"2024-09-10T22:24:23.145392+0000","last_became_active":"2024-09-10T22:24:22.137685+0000","last_became_peered":"2024-09-10T22:24:22.137685+0000","last_unstale":"2024-09-10T22:24:23.145392+0000","last_undegraded":"2024-09-10T22:24:23.145392+0000","last_fullsized":"2024-09-10T22:24:23.145392+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_clean_scrub_stamp":"2024-09-10T22:24:21.113844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:32:23.891069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T22:24:23.133816+0000","last_change":"2024-09-10T22:24:22.148073+0000","last_active":"2024-09-10T22:24:23.133816+0000","last_peered":"2024-09-10T22:24:23.133816+0000","last_clean":"2024-09-10T22:24:23.133816+0000","last_became_active":"2024-09-10T22:24:22.147785+0000","last_became_peered":"2024-09-10T22:24:22.147785+0000","last_unstale":"2024-09-10T22:24:23.133816+0000","last_undegraded":"2024-09-10T22:24:23.133816+0000","last_fullsized":"2024-09-10T22:24:23.133816+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_clean_scrub_stamp":"2024-09-10T22:24:21.113844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:39:48.847949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T22:24:23.147754+0000","last_change":"2024-09-10T22:24:22.145949+0000","last_active":"2024-09-10T22:24:23.147754+0000","last_peered":"2024-09-10T22:24:23.147754+0000","last_clean":"2024-09-10T22:24:23.147754+0000","last_became_active":"2024-09-10T22:24:22.145587+0000","last_became_peered":"2024-09-10T22:24:22.145587+0000","last_unstale":"2024-09-10T22:24:23.147754+0000","last_undegraded":"2024-09-10T22:24:23.147754+0000","last_fullsized":"2024-09-10T22:24:23.147754+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_clean_scrub_stamp":"2024-09-10T22:24:21.113844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:16:24.323551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T22:24:23.149901+0000","last_change":"2024-09-10T22:24:22.148042+0000","last_active":"2024-09-10T22:24:23.149901+0000","last_peered":"2024-09-10T22:24:23.149901+0000","last_clean":"2024-09-10T22:24:23.149901+0000","last_became_active":"2024-09-10T22:24:22.147722+0000","last_became_peered":"2024-09-10T22:24:22.147722+0000","last_unstale":"2024-09-10T22:24:23.149901+0000","last_undegraded":"2024-09-10T22:24:23.149901+0000","last_fullsized":"2024-09-10T22:24:23.149901+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_clean_scrub_stamp":"2024-09-10T22:24:21.113844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:42:42.383957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T22:24:23.146449+0000","last_change":"2024-09-10T22:24:22.138956+0000","last_active":"2024-09-10T22:24:23.146449+0000","last_peered":"2024-09-10T22:24:23.146449+0000","last_clean":"2024-09-10T22:24:23.146449+0000","last_became_active":"2024-09-10T22:24:22.138530+0000","last_became_peered":"2024-09-10T22:24:22.138530+0000","last_unstale":"2024-09-10T22:24:23.146449+0000","last_undegraded":"2024-09-10T22:24:23.146449+0000","last_fullsized":"2024-09-10T22:24:23.146449+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_clean_scrub_stamp":"2024-09-10T22:24:21.113844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:37:55.316556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T22:24:23.134440+0000","last_change":"2024-09-10T22:24:22.143435+0000","last_active":"2024-09-10T22:24:23.134440+0000","last_peered":"2024-09-10T22:24:23.134440+0000","last_clean":"2024-09-10T22:24:23.134440+0000","last_became_active":"2024-09-10T22:24:22.143100+0000","last_became_peered":"2024-09-10T22:24:22.143100+0000","last_unstale":"2024-09-10T22:24:23.134440+0000","last_undegraded":"2024-09-10T22:24:23.134440+0000","last_fullsized":"2024-09-10T22:24:23.134440+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_clean_scrub_stamp":"2024-09-10T22:24:21.113844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:24:14.344203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T22:24:23.146577+0000","last_change":"2024-09-10T22:24:22.138101+0000","last_active":"2024-09-10T22:24:23.146577+0000","last_peered":"2024-09-10T22:24:23.146577+0000","last_clean":"2024-09-10T22:24:23.146577+0000","last_became_active":"2024-09-10T22:24:22.137479+0000","last_became_peered":"2024-09-10T22:24:22.137479+0000","last_unstale":"2024-09-10T22:24:23.146577+0000","last_undegraded":"2024-09-10T22:24:23.146577+0000","last_fullsized":"2024-09-10T22:24:23.146577+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_clean_scrub_stamp":"2024-09-10T22:24:21.113844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:48:09.423136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T22:24:23.133174+0000","last_change":"2024-09-10T22:24:22.137157+0000","last_active":"2024-09-10T22:24:23.133174+0000","last_peered":"2024-09-10T22:24:23.133174+0000","last_clean":"2024-09-10T22:24:23.133174+0000","last_became_active":"2024-09-10T22:24:22.136817+0000","last_became_peered":"2024-09-10T22:24:22.136817+0000","last_unstale":"2024-09-10T22:24:23.133174+0000","last_undegraded":"2024-09-10T22:24:23.133174+0000","last_fullsized":"2024-09-10T22:24:23.133174+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_clean_scrub_stamp":"2024-09-10T22:24:21.113844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:54:32.922776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T22:24:23.150962+0000","last_change":"2024-09-10T22:24:22.138828+0000","last_active":"2024-09-10T22:24:23.150962+0000","last_peered":"2024-09-10T22:24:23.150962+0000","last_clean":"2024-09-10T22:24:23.150962+0000","last_became_active":"2024-09-10T22:24:22.138509+0000","last_became_peered":"2024-09-10T22:24:22.138509+0000","last_unstale":"2024-09-10T22:24:23.150962+0000","last_undegraded":"2024-09-10T22:24:23.150962+0000","last_fullsized":"2024-09-10T22:24:23.150962+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_clean_scrub_stamp":"2024-09-10T22:24:21.113844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:14:19.492298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T22:24:23.150798+0000","last_change":"2024-09-10T22:24:22.139317+0000","last_active":"2024-09-10T22:24:23.150798+0000","last_peered":"2024-09-10T22:24:23.150798+0000","last_clean":"2024-09-10T22:24:23.150798+0000","last_became_active":"2024-09-10T22:24:22.138949+0000","last_became_peered":"2024-09-10T22:24:22.138949+0000","last_unstale":"2024-09-10T22:24:23.150798+0000","last_undegraded":"2024-09-10T22:24:23.150798+0000","last_fullsized":"2024-09-10T22:24:23.150798+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_clean_scrub_stamp":"2024-09-10T22:24:21.113844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:34:56.412955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T22:24:23.148869+0000","last_change":"2024-09-10T22:24:22.147283+0000","last_active":"2024-09-10T22:24:23.148869+0000","last_peered":"2024-09-10T22:24:23.148869+0000","last_clean":"2024-09-10T22:24:23.148869+0000","last_became_active":"2024-09-10T22:24:22.146954+0000","last_became_peered":"2024-09-10T22:24:22.146954+0000","last_unstale":"2024-09-10T22:24:23.148869+0000","last_undegraded":"2024-09-10T22:24:23.148869+0000","last_fullsized":"2024-09-10T22:24:23.148869+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_clean_scrub_stamp":"2024-09-10T22:24:21.113844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:22:21.772747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T22:24:23.150964+0000","last_change":"2024-09-10T22:24:22.139482+0000","last_active":"2024-09-10T22:24:23.150964+0000","last_peered":"2024-09-10T22:24:23.150964+0000","last_clean":"2024-09-10T22:24:23.150964+0000","last_became_active":"2024-09-10T22:24:22.139135+0000","last_became_peered":"2024-09-10T22:24:22.139135+0000","last_unstale":"2024-09-10T22:24:23.150964+0000","last_undegraded":"2024-09-10T22:24:23.150964+0000","last_fullsized":"2024-09-10T22:24:23.150964+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_clean_scrub_stamp":"2024-09-10T22:24:21.113844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:25:31.639392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T22:24:23.147221+0000","last_change":"2024-09-10T22:24:22.142465+0000","last_active":"2024-09-10T22:24:23.147221+0000","last_peered":"2024-09-10T22:24:23.147221+0000","last_clean":"2024-09-10T22:24:23.147221+0000","last_became_active":"2024-09-10T22:24:22.142110+0000","last_became_peered":"2024-09-10T22:24:22.142110+0000","last_unstale":"2024-09-10T22:24:23.147221+0000","last_undegraded":"2024-09-10T22:24:23.147221+0000","last_fullsized":"2024-09-10T22:24:23.147221+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_clean_scrub_stamp":"2024-09-10T22:24:21.113844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:16:20.476055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T22:24:23.136219+0000","last_change":"2024-09-10T22:24:22.147942+0000","last_active":"2024-09-10T22:24:23.136219+0000","last_peered":"2024-09-10T22:24:23.136219+0000","last_clean":"2024-09-10T22:24:23.136219+0000","last_became_active":"2024-09-10T22:24:22.147637+0000","last_became_peered":"2024-09-10T22:24:22.147637+0000","last_unstale":"2024-09-10T22:24:23.136219+0000","last_undegraded":"2024-09-10T22:24:23.136219+0000","last_fullsized":"2024-09-10T22:24:23.136219+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_clean_scrub_stamp":"2024-09-10T22:24:21.113844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:46:36.831534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T22:24:23.149776+0000","last_change":"2024-09-10T22:24:22.138032+0000","last_active":"2024-09-10T22:24:23.149776+0000","last_peered":"2024-09-10T22:24:23.149776+0000","last_clean":"2024-09-10T22:24:23.149776+0000","last_became_active":"2024-09-10T22:24:22.137657+0000","last_became_peered":"2024-09-10T22:24:22.137657+0000","last_unstale":"2024-09-10T22:24:23.149776+0000","last_undegraded":"2024-09-10T22:24:23.149776+0000","last_fullsized":"2024-09-10T22:24:23.149776+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_clean_scrub_stamp":"2024-09-10T22:24:21.113844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:06:51.479298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T22:24:23.133217+0000","last_change":"2024-09-10T22:24:22.141106+0000","last_active":"2024-09-10T22:24:23.133217+0000","last_peered":"2024-09-10T22:24:23.133217+0000","last_clean":"2024-09-10T22:24:23.133217+0000","last_became_active":"2024-09-10T22:24:22.140780+0000","last_became_peered":"2024-09-10T22:24:22.140780+0000","last_unstale":"2024-09-10T22:24:23.133217+0000","last_undegraded":"2024-09-10T22:24:23.133217+0000","last_fullsized":"2024-09-10T22:24:23.133217+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_clean_scrub_stamp":"2024-09-10T22:24:21.113844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:25:21.302463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T22:24:23.150586+0000","last_change":"2024-09-10T22:24:22.146772+0000","last_active":"2024-09-10T22:24:23.150586+0000","last_peered":"2024-09-10T22:24:23.150586+0000","last_clean":"2024-09-10T22:24:23.150586+0000","last_became_active":"2024-09-10T22:24:22.146317+0000","last_became_peered":"2024-09-10T22:24:22.146317+0000","last_unstale":"2024-09-10T22:24:23.150586+0000","last_undegraded":"2024-09-10T22:24:23.150586+0000","last_fullsized":"2024-09-10T22:24:23.150586+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_clean_scrub_stamp":"2024-09-10T22:24:21.113844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:13:55.706482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T22:24:23.147957+0000","last_change":"2024-09-10T22:24:22.139791+0000","last_active":"2024-09-10T22:24:23.147957+0000","last_peered":"2024-09-10T22:24:23.147957+0000","last_clean":"2024-09-10T22:24:23.147957+0000","last_became_active":"2024-09-10T22:24:22.139491+0000","last_became_peered":"2024-09-10T22:24:22.139491+0000","last_unstale":"2024-09-10T22:24:23.147957+0000","last_undegraded":"2024-09-10T22:24:23.147957+0000","last_fullsized":"2024-09-10T22:24:23.147957+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_clean_scrub_stamp":"2024-09-10T22:24:21.113844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:18:29.412412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T22:24:23.149665+0000","last_change":"2024-09-10T22:24:22.143383+0000","last_active":"2024-09-10T22:24:23.149665+0000","last_peered":"2024-09-10T22:24:23.149665+0000","last_clean":"2024-09-10T22:24:23.149665+0000","last_became_active":"2024-09-10T22:24:22.143045+0000","last_became_peered":"2024-09-10T22:24:22.143045+0000","last_unstale":"2024-09-10T22:24:23.149665+0000","last_undegraded":"2024-09-10T22:24:23.149665+0000","last_fullsized":"2024-09-10T22:24:23.149665+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_clean_scrub_stamp":"2024-09-10T22:24:21.113844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:37:10.135448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T22:24:23.148838+0000","last_change":"2024-09-10T22:24:22.141851+0000","last_active":"2024-09-10T22:24:23.148838+0000","last_peered":"2024-09-10T22:24:23.148838+0000","last_clean":"2024-09-10T22:24:23.148838+0000","last_became_active":"2024-09-10T22:24:22.141469+0000","last_became_peered":"2024-09-10T22:24:22.141469+0000","last_unstale":"2024-09-10T22:24:23.148838+0000","last_undegraded":"2024-09-10T22:24:23.148838+0000","last_fullsized":"2024-09-10T22:24:23.148838+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_clean_scrub_stamp":"2024-09-10T22:24:21.113844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:03:59.805704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T22:24:23.136351+0000","last_change":"2024-09-10T22:24:22.139821+0000","last_active":"2024-09-10T22:24:23.136351+0000","last_peered":"2024-09-10T22:24:23.136351+0000","last_clean":"2024-09-10T22:24:23.136351+0000","last_became_active":"2024-09-10T22:24:22.139398+0000","last_became_peered":"2024-09-10T22:24:22.139398+0000","last_unstale":"2024-09-10T22:24:23.136351+0000","last_undegraded":"2024-09-10T22:24:23.136351+0000","last_fullsized":"2024-09-10T22:24:23.136351+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_clean_scrub_stamp":"2024-09-10T22:24:21.113844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:18:22.160919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T22:24:23.150147+0000","last_change":"2024-09-10T22:24:22.141219+0000","last_active":"2024-09-10T22:24:23.150147+0000","last_peered":"2024-09-10T22:24:23.150147+0000","last_clean":"2024-09-10T22:24:23.150147+0000","last_became_active":"2024-09-10T22:24:22.140900+0000","last_became_peered":"2024-09-10T22:24:22.140900+0000","last_unstale":"2024-09-10T22:24:23.150147+0000","last_undegraded":"2024-09-10T22:24:23.150147+0000","last_fullsized":"2024-09-10T22:24:23.150147+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_clean_scrub_stamp":"2024-09-10T22:24:21.113844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:27:59.115533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T22:24:23.133152+0000","last_change":"2024-09-10T22:24:22.139738+0000","last_active":"2024-09-10T22:24:23.133152+0000","last_peered":"2024-09-10T22:24:23.133152+0000","last_clean":"2024-09-10T22:24:23.133152+0000","last_became_active":"2024-09-10T22:24:22.139096+0000","last_became_peered":"2024-09-10T22:24:22.139096+0000","last_unstale":"2024-09-10T22:24:23.133152+0000","last_undegraded":"2024-09-10T22:24:23.133152+0000","last_fullsized":"2024-09-10T22:24:23.133152+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_clean_scrub_stamp":"2024-09-10T22:24:21.113844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:16:39.110610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T22:24:23.151587+0000","last_change":"2024-09-10T22:24:22.144896+0000","last_active":"2024-09-10T22:24:23.151587+0000","last_peered":"2024-09-10T22:24:23.151587+0000","last_clean":"2024-09-10T22:24:23.151587+0000","last_became_active":"2024-09-10T22:24:22.144622+0000","last_became_peered":"2024-09-10T22:24:22.144622+0000","last_unstale":"2024-09-10T22:24:23.151587+0000","last_undegraded":"2024-09-10T22:24:23.151587+0000","last_fullsized":"2024-09-10T22:24:23.151587+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_clean_scrub_stamp":"2024-09-10T22:24:21.113844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:32:44.648993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T22:24:23.135925+0000","last_change":"2024-09-10T22:24:22.148082+0000","last_active":"2024-09-10T22:24:23.135925+0000","last_peered":"2024-09-10T22:24:23.135925+0000","last_clean":"2024-09-10T22:24:23.135925+0000","last_became_active":"2024-09-10T22:24:22.147664+0000","last_became_peered":"2024-09-10T22:24:22.147664+0000","last_unstale":"2024-09-10T22:24:23.135925+0000","last_undegraded":"2024-09-10T22:24:23.135925+0000","last_fullsized":"2024-09-10T22:24:23.135925+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_clean_scrub_stamp":"2024-09-10T22:24:21.113844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:12:40.154756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T22:24:23.135961+0000","last_change":"2024-09-10T22:24:22.145166+0000","last_active":"2024-09-10T22:24:23.135961+0000","last_peered":"2024-09-10T22:24:23.135961+0000","last_clean":"2024-09-10T22:24:23.135961+0000","last_became_active":"2024-09-10T22:24:22.144857+0000","last_became_peered":"2024-09-10T22:24:22.144857+0000","last_unstale":"2024-09-10T22:24:23.135961+0000","last_undegraded":"2024-09-10T22:24:23.135961+0000","last_fullsized":"2024-09-10T22:24:23.135961+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_clean_scrub_stamp":"2024-09-10T22:24:21.113844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:05:03.284376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T22:24:23.150292+0000","last_change":"2024-09-10T22:24:22.141534+0000","last_active":"2024-09-10T22:24:23.150292+0000","last_peered":"2024-09-10T22:24:23.150292+0000","last_clean":"2024-09-10T22:24:23.150292+0000","last_became_active":"2024-09-10T22:24:22.141243+0000","last_became_peered":"2024-09-10T22:24:22.141243+0000","last_unstale":"2024-09-10T22:24:23.150292+0000","last_undegraded":"2024-09-10T22:24:23.150292+0000","last_fullsized":"2024-09-10T22:24:23.150292+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_clean_scrub_stamp":"2024-09-10T22:24:21.113844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:26:23.559943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T22:24:23.147558+0000","last_change":"2024-09-10T22:24:22.144951+0000","last_active":"2024-09-10T22:24:23.147558+0000","last_peered":"2024-09-10T22:24:23.147558+0000","last_clean":"2024-09-10T22:24:23.147558+0000","last_became_active":"2024-09-10T22:24:22.144634+0000","last_became_peered":"2024-09-10T22:24:22.144634+0000","last_unstale":"2024-09-10T22:24:23.147558+0000","last_undegraded":"2024-09-10T22:24:23.147558+0000","last_fullsized":"2024-09-10T22:24:23.147558+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_clean_scrub_stamp":"2024-09-10T22:24:21.113844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:04:19.350081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"73'5","reported_seq":39,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T22:24:43.237523+0000","last_change":"2024-09-10T22:24:20.128083+0000","last_active":"2024-09-10T22:24:43.237523+0000","last_peered":"2024-09-10T22:24:43.237523+0000","last_clean":"2024-09-10T22:24:43.237523+0000","last_became_active":"2024-09-10T22:24:20.127676+0000","last_became_peered":"2024-09-10T22:24:20.127676+0000","last_unstale":"2024-09-10T22:24:43.237523+0000","last_undegraded":"2024-09-10T22:24:43.237523+0000","last_fullsized":"2024-09-10T22:24:43.237523+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:19.099039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:19.099039+0000","last_clean_scrub_stamp":"2024-09-10T22:24:19.099039+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:37:51.745817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":15,"num_read_kb":2,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T22:24:23.147760+0000","last_change":"2024-09-10T22:24:22.140193+0000","last_active":"2024-09-10T22:24:23.147760+0000","last_peered":"2024-09-10T22:24:23.147760+0000","last_clean":"2024-09-10T22:24:23.147760+0000","last_became_active":"2024-09-10T22:24:22.139897+0000","last_became_peered":"2024-09-10T22:24:22.139897+0000","last_unstale":"2024-09-10T22:24:23.147760+0000","last_undegraded":"2024-09-10T22:24:23.147760+0000","last_fullsized":"2024-09-10T22:24:23.147760+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_clean_scrub_stamp":"2024-09-10T22:24:21.113844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:13:54.235941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"73'3","reported_seq":22,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T22:24:31.212890+0000","last_change":"2024-09-10T22:24:20.124447+0000","last_active":"2024-09-10T22:24:31.212890+0000","last_peered":"2024-09-10T22:24:31.212890+0000","last_clean":"2024-09-10T22:24:31.212890+0000","last_became_active":"2024-09-10T22:24:20.124044+0000","last_became_peered":"2024-09-10T22:24:20.124044+0000","last_unstale":"2024-09-10T22:24:31.212890+0000","last_undegraded":"2024-09-10T22:24:31.212890+0000","last_fullsized":"2024-09-10T22:24:31.212890+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:19.099039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:19.099039+0000","last_clean_scrub_stamp":"2024-09-10T22:24:19.099039+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:07:27.533774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"73'2","reported_seq":21,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T22:24:31.211987+0000","last_change":"2024-09-10T22:24:20.122635+0000","last_active":"2024-09-10T22:24:31.211987+0000","last_peered":"2024-09-10T22:24:31.211987+0000","last_clean":"2024-09-10T22:24:31.211987+0000","last_became_active":"2024-09-10T22:24:20.122289+0000","last_became_peered":"2024-09-10T22:24:20.122289+0000","last_unstale":"2024-09-10T22:24:31.211987+0000","last_undegraded":"2024-09-10T22:24:31.211987+0000","last_fullsized":"2024-09-10T22:24:31.211987+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:19.099039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:19.099039+0000","last_clean_scrub_stamp":"2024-09-10T22:24:19.099039+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:30:40.779513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T22:24:23.147723+0000","last_change":"2024-09-10T22:24:22.137417+0000","last_active":"2024-09-10T22:24:23.147723+0000","last_peered":"2024-09-10T22:24:23.147723+0000","last_clean":"2024-09-10T22:24:23.147723+0000","last_became_active":"2024-09-10T22:24:22.136913+0000","last_became_peered":"2024-09-10T22:24:22.136913+0000","last_unstale":"2024-09-10T22:24:23.147723+0000","last_undegraded":"2024-09-10T22:24:23.147723+0000","last_fullsized":"2024-09-10T22:24:23.147723+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_clean_scrub_stamp":"2024-09-10T22:24:21.113844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:23:39.551056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"73'1","reported_seq":20,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T22:24:23.154070+0000","last_change":"2024-09-10T22:24:20.128416+0000","last_active":"2024-09-10T22:24:23.154070+0000","last_peered":"2024-09-10T22:24:23.154070+0000","last_clean":"2024-09-10T22:24:23.154070+0000","last_became_active":"2024-09-10T22:24:20.127998+0000","last_became_peered":"2024-09-10T22:24:20.127998+0000","last_unstale":"2024-09-10T22:24:23.154070+0000","last_undegraded":"2024-09-10T22:24:23.154070+0000","last_fullsized":"2024-09-10T22:24:23.154070+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:19.099039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:19.099039+0000","last_clean_scrub_stamp":"2024-09-10T22:24:19.099039+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:44:39.871564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T22:24:23.145910+0000","last_change":"2024-09-10T22:24:22.136355+0000","last_active":"2024-09-10T22:24:23.145910+0000","last_peered":"2024-09-10T22:24:23.145910+0000","last_clean":"2024-09-10T22:24:23.145910+0000","last_became_active":"2024-09-10T22:24:22.136047+0000","last_became_peered":"2024-09-10T22:24:22.136047+0000","last_unstale":"2024-09-10T22:24:23.145910+0000","last_undegraded":"2024-09-10T22:24:23.145910+0000","last_fullsized":"2024-09-10T22:24:23.145910+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_clean_scrub_stamp":"2024-09-10T22:24:21.113844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:56:14.739365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"73'3","reported_seq":36,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T22:24:44.238419+0000","last_change":"2024-09-10T22:24:20.125203+0000","last_active":"2024-09-10T22:24:44.238419+0000","last_peered":"2024-09-10T22:24:44.238419+0000","last_clean":"2024-09-10T22:24:44.238419+0000","last_became_active":"2024-09-10T22:24:20.124860+0000","last_became_peered":"2024-09-10T22:24:20.124860+0000","last_unstale":"2024-09-10T22:24:44.238419+0000","last_undegraded":"2024-09-10T22:24:44.238419+0000","last_fullsized":"2024-09-10T22:24:44.238419+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:19.099039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:19.099039+0000","last_clean_scrub_stamp":"2024-09-10T22:24:19.099039+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:20:03.886334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T22:24:23.150257+0000","last_change":"2024-09-10T22:24:22.143321+0000","last_active":"2024-09-10T22:24:23.150257+0000","last_peered":"2024-09-10T22:24:23.150257+0000","last_clean":"2024-09-10T22:24:23.150257+0000","last_became_active":"2024-09-10T22:24:22.143036+0000","last_became_peered":"2024-09-10T22:24:22.143036+0000","last_unstale":"2024-09-10T22:24:23.150257+0000","last_undegraded":"2024-09-10T22:24:23.150257+0000","last_fullsized":"2024-09-10T22:24:23.150257+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_clean_scrub_stamp":"2024-09-10T22:24:21.113844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:51:42.473300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"73'2","reported_seq":21,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T22:24:30.195657+0000","last_change":"2024-09-10T22:24:20.128026+0000","last_active":"2024-09-10T22:24:30.195657+0000","last_peered":"2024-09-10T22:24:30.195657+0000","last_clean":"2024-09-10T22:24:30.195657+0000","last_became_active":"2024-09-10T22:24:20.127445+0000","last_became_peered":"2024-09-10T22:24:20.127445+0000","last_unstale":"2024-09-10T22:24:30.195657+0000","last_undegraded":"2024-09-10T22:24:30.195657+0000","last_fullsized":"2024-09-10T22:24:30.195657+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:19.099039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:19.099039+0000","last_clean_scrub_stamp":"2024-09-10T22:24:19.099039+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:59:15.265157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T22:24:23.151321+0000","last_change":"2024-09-10T22:24:22.144830+0000","last_active":"2024-09-10T22:24:23.151321+0000","last_peered":"2024-09-10T22:24:23.151321+0000","last_clean":"2024-09-10T22:24:23.151321+0000","last_became_active":"2024-09-10T22:24:22.144358+0000","last_became_peered":"2024-09-10T22:24:22.144358+0000","last_unstale":"2024-09-10T22:24:23.151321+0000","last_undegraded":"2024-09-10T22:24:23.151321+0000","last_fullsized":"2024-09-10T22:24:23.151321+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_clean_scrub_stamp":"2024-09-10T22:24:21.113844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:28:14.398474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"73'4","reported_seq":24,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T22:24:30.197894+0000","last_change":"2024-09-10T22:24:20.383555+0000","last_active":"2024-09-10T22:24:30.197894+0000","last_peered":"2024-09-10T22:24:30.197894+0000","last_clean":"2024-09-10T22:24:30.197894+0000","last_became_active":"2024-09-10T22:24:20.383163+0000","last_became_peered":"2024-09-10T22:24:20.383163+0000","last_unstale":"2024-09-10T22:24:30.197894+0000","last_undegraded":"2024-09-10T22:24:30.197894+0000","last_fullsized":"2024-09-10T22:24:30.197894+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:19.099039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:19.099039+0000","last_clean_scrub_stamp":"2024-09-10T22:24:19.099039+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:14:03.052220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T22:24:23.149237+0000","last_change":"2024-09-10T22:24:22.144562+0000","last_active":"2024-09-10T22:24:23.149237+0000","last_peered":"2024-09-10T22:24:23.149237+0000","last_clean":"2024-09-10T22:24:23.149237+0000","last_became_active":"2024-09-10T22:24:22.144146+0000","last_became_peered":"2024-09-10T22:24:22.144146+0000","last_unstale":"2024-09-10T22:24:23.149237+0000","last_undegraded":"2024-09-10T22:24:23.149237+0000","last_fullsized":"2024-09-10T22:24:23.149237+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_clean_scrub_stamp":"2024-09-10T22:24:21.113844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:57:36.070289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"73'22","reported_seq":75,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T22:24:45.240027+0000","last_change":"2024-09-10T22:24:20.126245+0000","last_active":"2024-09-10T22:24:45.240027+0000","last_peered":"2024-09-10T22:24:45.240027+0000","last_clean":"2024-09-10T22:24:45.240027+0000","last_became_active":"2024-09-10T22:24:20.125839+0000","last_became_peered":"2024-09-10T22:24:20.125839+0000","last_unstale":"2024-09-10T22:24:45.240027+0000","last_undegraded":"2024-09-10T22:24:45.240027+0000","last_fullsized":"2024-09-10T22:24:45.240027+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:19.099039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:19.099039+0000","last_clean_scrub_stamp":"2024-09-10T22:24:19.099039+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:45:05.155436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46800,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":34,"num_read_kb":62,"num_write":23,"num_write_kb":52,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T22:24:23.147488+0000","last_change":"2024-09-10T22:24:22.142178+0000","last_active":"2024-09-10T22:24:23.147488+0000","last_peered":"2024-09-10T22:24:23.147488+0000","last_clean":"2024-09-10T22:24:23.147488+0000","last_became_active":"2024-09-10T22:24:22.141883+0000","last_became_peered":"2024-09-10T22:24:22.141883+0000","last_unstale":"2024-09-10T22:24:23.147488+0000","last_undegraded":"2024-09-10T22:24:23.147488+0000","last_fullsized":"2024-09-10T22:24:23.147488+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_clean_scrub_stamp":"2024-09-10T22:24:21.113844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:24:50.996273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"73'6","reported_seq":26,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T22:24:31.212406+0000","last_change":"2024-09-10T22:24:20.126129+0000","last_active":"2024-09-10T22:24:31.212406+0000","last_peered":"2024-09-10T22:24:31.212406+0000","last_clean":"2024-09-10T22:24:31.212406+0000","last_became_active":"2024-09-10T22:24:20.125749+0000","last_became_peered":"2024-09-10T22:24:20.125749+0000","last_unstale":"2024-09-10T22:24:31.212406+0000","last_undegraded":"2024-09-10T22:24:31.212406+0000","last_fullsized":"2024-09-10T22:24:31.212406+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:19.099039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:19.099039+0000","last_clean_scrub_stamp":"2024-09-10T22:24:19.099039+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:58:35.224036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T22:24:23.132892+0000","last_change":"2024-09-10T22:24:22.143964+0000","last_active":"2024-09-10T22:24:23.132892+0000","last_peered":"2024-09-10T22:24:23.132892+0000","last_clean":"2024-09-10T22:24:23.132892+0000","last_became_active":"2024-09-10T22:24:22.143589+0000","last_became_peered":"2024-09-10T22:24:22.143589+0000","last_unstale":"2024-09-10T22:24:23.132892+0000","last_undegraded":"2024-09-10T22:24:23.132892+0000","last_fullsized":"2024-09-10T22:24:23.132892+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_clean_scrub_stamp":"2024-09-10T22:24:21.113844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:41:41.737627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"73'3","reported_seq":22,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T22:24:30.197907+0000","last_change":"2024-09-10T22:24:20.128012+0000","last_active":"2024-09-10T22:24:30.197907+0000","last_peered":"2024-09-10T22:24:30.197907+0000","last_clean":"2024-09-10T22:24:30.197907+0000","last_became_active":"2024-09-10T22:24:20.127335+0000","last_became_peered":"2024-09-10T22:24:20.127335+0000","last_unstale":"2024-09-10T22:24:30.197907+0000","last_undegraded":"2024-09-10T22:24:30.197907+0000","last_fullsized":"2024-09-10T22:24:30.197907+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:19.099039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:19.099039+0000","last_clean_scrub_stamp":"2024-09-10T22:24:19.099039+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:20:27.017032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T22:24:23.133928+0000","last_change":"2024-09-10T22:24:22.145283+0000","last_active":"2024-09-10T22:24:23.133928+0000","last_peered":"2024-09-10T22:24:23.133928+0000","last_clean":"2024-09-10T22:24:23.133928+0000","last_became_active":"2024-09-10T22:24:22.142751+0000","last_became_peered":"2024-09-10T22:24:22.142751+0000","last_unstale":"2024-09-10T22:24:23.133928+0000","last_undegraded":"2024-09-10T22:24:23.133928+0000","last_fullsized":"2024-09-10T22:24:23.133928+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_clean_scrub_stamp":"2024-09-10T22:24:21.113844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:46:08.257983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"73'4","reported_seq":39,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T22:24:43.237007+0000","last_change":"2024-09-10T22:24:20.124069+0000","last_active":"2024-09-10T22:24:43.237007+0000","last_peered":"2024-09-10T22:24:43.237007+0000","last_clean":"2024-09-10T22:24:43.237007+0000","last_became_active":"2024-09-10T22:24:20.123675+0000","last_became_peered":"2024-09-10T22:24:20.123675+0000","last_unstale":"2024-09-10T22:24:43.237007+0000","last_undegraded":"2024-09-10T22:24:43.237007+0000","last_fullsized":"2024-09-10T22:24:43.237007+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:19.099039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:19.099039+0000","last_clean_scrub_stamp":"2024-09-10T22:24:19.099039+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:32:50.287012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":979,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":17,"num_read_kb":4,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T22:24:23.133812+0000","last_change":"2024-09-10T22:24:22.146870+0000","last_active":"2024-09-10T22:24:23.133812+0000","last_peered":"2024-09-10T22:24:23.133812+0000","last_clean":"2024-09-10T22:24:23.133812+0000","last_became_active":"2024-09-10T22:24:22.146615+0000","last_became_peered":"2024-09-10T22:24:22.146615+0000","last_unstale":"2024-09-10T22:24:23.133812+0000","last_undegraded":"2024-09-10T22:24:23.133812+0000","last_fullsized":"2024-09-10T22:24:23.133812+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_clean_scrub_stamp":"2024-09-10T22:24:21.113844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:00:05.579248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"73'15","reported_seq":35,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T22:24:31.214077+0000","last_change":"2024-09-10T22:24:20.383675+0000","last_active":"2024-09-10T22:24:31.214077+0000","last_peered":"2024-09-10T22:24:31.214077+0000","last_clean":"2024-09-10T22:24:31.214077+0000","last_became_active":"2024-09-10T22:24:20.383317+0000","last_became_peered":"2024-09-10T22:24:20.383317+0000","last_unstale":"2024-09-10T22:24:31.214077+0000","last_undegraded":"2024-09-10T22:24:31.214077+0000","last_fullsized":"2024-09-10T22:24:31.214077+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:19.099039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:19.099039+0000","last_clean_scrub_stamp":"2024-09-10T22:24:19.099039+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:43:24.989851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T22:24:23.149274+0000","last_change":"2024-09-10T22:24:22.144872+0000","last_active":"2024-09-10T22:24:23.149274+0000","last_peered":"2024-09-10T22:24:23.149274+0000","last_clean":"2024-09-10T22:24:23.149274+0000","last_became_active":"2024-09-10T22:24:22.144570+0000","last_became_peered":"2024-09-10T22:24:22.144570+0000","last_unstale":"2024-09-10T22:24:23.149274+0000","last_undegraded":"2024-09-10T22:24:23.149274+0000","last_fullsized":"2024-09-10T22:24:23.149274+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_clean_scrub_stamp":"2024-09-10T22:24:21.113844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:20:17.937544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"73'2","reported_seq":22,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T22:24:32.218581+0000","last_change":"2024-09-10T22:24:20.125849+0000","last_active":"2024-09-10T22:24:32.218581+0000","last_peered":"2024-09-10T22:24:32.218581+0000","last_clean":"2024-09-10T22:24:32.218581+0000","last_became_active":"2024-09-10T22:24:20.125042+0000","last_became_peered":"2024-09-10T22:24:20.125042+0000","last_unstale":"2024-09-10T22:24:32.218581+0000","last_undegraded":"2024-09-10T22:24:32.218581+0000","last_fullsized":"2024-09-10T22:24:32.218581+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:19.099039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:19.099039+0000","last_clean_scrub_stamp":"2024-09-10T22:24:19.099039+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:36:28.249115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T22:24:23.150301+0000","last_change":"2024-09-10T22:24:22.141232+0000","last_active":"2024-09-10T22:24:23.150301+0000","last_peered":"2024-09-10T22:24:23.150301+0000","last_clean":"2024-09-10T22:24:23.150301+0000","last_became_active":"2024-09-10T22:24:22.140903+0000","last_became_peered":"2024-09-10T22:24:22.140903+0000","last_unstale":"2024-09-10T22:24:23.150301+0000","last_undegraded":"2024-09-10T22:24:23.150301+0000","last_fullsized":"2024-09-10T22:24:23.150301+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_clean_scrub_stamp":"2024-09-10T22:24:21.113844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:15:11.627126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"73'2","reported_seq":21,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T22:24:23.146355+0000","last_change":"2024-09-10T22:24:20.122829+0000","last_active":"2024-09-10T22:24:23.146355+0000","last_peered":"2024-09-10T22:24:23.146355+0000","last_clean":"2024-09-10T22:24:23.146355+0000","last_became_active":"2024-09-10T22:24:20.122545+0000","last_became_peered":"2024-09-10T22:24:20.122545+0000","last_unstale":"2024-09-10T22:24:23.146355+0000","last_undegraded":"2024-09-10T22:24:23.146355+0000","last_fullsized":"2024-09-10T22:24:23.146355+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:19.099039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:19.099039+0000","last_clean_scrub_stamp":"2024-09-10T22:24:19.099039+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:18:27.758029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T22:24:23.134360+0000","last_change":"2024-09-10T22:24:22.139725+0000","last_active":"2024-09-10T22:24:23.134360+0000","last_peered":"2024-09-10T22:24:23.134360+0000","last_clean":"2024-09-10T22:24:23.134360+0000","last_became_active":"2024-09-10T22:24:22.139293+0000","last_became_peered":"2024-09-10T22:24:22.139293+0000","last_unstale":"2024-09-10T22:24:23.134360+0000","last_undegraded":"2024-09-10T22:24:23.134360+0000","last_fullsized":"2024-09-10T22:24:23.134360+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_clean_scrub_stamp":"2024-09-10T22:24:21.113844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:43:14.424880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"73'1","reported_seq":21,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T22:24:23.154966+0000","last_change":"2024-09-10T22:24:20.125371+0000","last_active":"2024-09-10T22:24:23.154966+0000","last_peered":"2024-09-10T22:24:23.154966+0000","last_clean":"2024-09-10T22:24:23.154966+0000","last_became_active":"2024-09-10T22:24:20.125033+0000","last_became_peered":"2024-09-10T22:24:20.125033+0000","last_unstale":"2024-09-10T22:24:23.154966+0000","last_undegraded":"2024-09-10T22:24:23.154966+0000","last_fullsized":"2024-09-10T22:24:23.154966+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:19.099039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:19.099039+0000","last_clean_scrub_stamp":"2024-09-10T22:24:19.099039+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:22:22.751778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"73'1","reported_seq":15,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T22:24:24.868932+0000","last_change":"2024-09-10T22:24:22.149522+0000","last_active":"2024-09-10T22:24:24.868932+0000","last_peered":"2024-09-10T22:24:24.868932+0000","last_clean":"2024-09-10T22:24:24.868932+0000","last_became_active":"2024-09-10T22:24:22.148710+0000","last_became_peered":"2024-09-10T22:24:22.148710+0000","last_unstale":"2024-09-10T22:24:24.868932+0000","last_undegraded":"2024-09-10T22:24:24.868932+0000","last_fullsized":"2024-09-10T22:24:24.868932+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_clean_scrub_stamp":"2024-09-10T22:24:21.113844+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:44:32.020949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"73'3","reported_seq":23,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T22:24:31.213032+0000","last_change":"2024-09-10T22:24:20.406792+0000","last_active":"2024-09-10T22:24:31.213032+0000","last_peered":"2024-09-10T22:24:31.213032+0000","last_clean":"2024-09-10T22:24:31.213032+0000","last_became_active":"2024-09-10T22:24:20.406437+0000","last_became_peered":"2024-09-10T22:24:20.406437+0000","last_unstale":"2024-09-10T22:24:31.213032+0000","last_undegraded":"2024-09-10T22:24:31.213032+0000","last_fullsized":"2024-09-10T22:24:31.213032+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:19.099039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:19.099039+0000","last_clean_scrub_stamp":"2024-09-10T22:24:19.099039+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:00:16.436165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T22:24:23.134366+0000","last_change":"2024-09-10T22:24:22.142335+0000","last_active":"2024-09-10T22:24:23.134366+0000","last_peered":"2024-09-10T22:24:23.134366+0000","last_clean":"2024-09-10T22:24:23.134366+0000","last_became_active":"2024-09-10T22:24:22.142001+0000","last_became_peered":"2024-09-10T22:24:22.142001+0000","last_unstale":"2024-09-10T22:24:23.134366+0000","last_undegraded":"2024-09-10T22:24:23.134366+0000","last_fullsized":"2024-09-10T22:24:23.134366+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_clean_scrub_stamp":"2024-09-10T22:24:21.113844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:46:20.043915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"19'92","reported_seq":91,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T22:24:23.133935+0000","last_change":"2024-09-10T22:23:11.163678+0000","last_active":"2024-09-10T22:24:23.133935+0000","last_peered":"2024-09-10T22:24:23.133935+0000","last_clean":"2024-09-10T22:24:23.133935+0000","last_became_active":"2024-09-10T22:23:11.158387+0000","last_became_peered":"2024-09-10T22:23:11.158387+0000","last_unstale":"2024-09-10T22:24:23.133935+0000","last_undegraded":"2024-09-10T22:24:23.133935+0000","last_fullsized":"2024-09-10T22:24:23.133935+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:19:50.906986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:19:50.906986+0000","last_clean_scrub_stamp":"2024-09-10T22:19:50.906986+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:11:31.570355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"73'3","reported_seq":24,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T22:24:32.217425+0000","last_change":"2024-09-10T22:24:20.123048+0000","last_active":"2024-09-10T22:24:32.217425+0000","last_peered":"2024-09-10T22:24:32.217425+0000","last_clean":"2024-09-10T22:24:32.217425+0000","last_became_active":"2024-09-10T22:24:20.121906+0000","last_became_peered":"2024-09-10T22:24:20.121906+0000","last_unstale":"2024-09-10T22:24:32.217425+0000","last_undegraded":"2024-09-10T22:24:32.217425+0000","last_fullsized":"2024-09-10T22:24:32.217425+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:19.099039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:19.099039+0000","last_clean_scrub_stamp":"2024-09-10T22:24:19.099039+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:11:00.293820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T22:24:23.148433+0000","last_change":"2024-09-10T22:24:22.146378+0000","last_active":"2024-09-10T22:24:23.148433+0000","last_peered":"2024-09-10T22:24:23.148433+0000","last_clean":"2024-09-10T22:24:23.148433+0000","last_became_active":"2024-09-10T22:24:22.145841+0000","last_became_peered":"2024-09-10T22:24:22.145841+0000","last_unstale":"2024-09-10T22:24:23.148433+0000","last_undegraded":"2024-09-10T22:24:23.148433+0000","last_fullsized":"2024-09-10T22:24:23.148433+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_clean_scrub_stamp":"2024-09-10T22:24:21.113844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:20:31.785243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"73'3","reported_seq":22,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T22:24:31.213604+0000","last_change":"2024-09-10T22:24:20.127483+0000","last_active":"2024-09-10T22:24:31.213604+0000","last_peered":"2024-09-10T22:24:31.213604+0000","last_clean":"2024-09-10T22:24:31.213604+0000","last_became_active":"2024-09-10T22:24:20.127149+0000","last_became_peered":"2024-09-10T22:24:20.127149+0000","last_unstale":"2024-09-10T22:24:31.213604+0000","last_undegraded":"2024-09-10T22:24:31.213604+0000","last_fullsized":"2024-09-10T22:24:31.213604+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:19.099039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:19.099039+0000","last_clean_scrub_stamp":"2024-09-10T22:24:19.099039+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:49:22.022872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T22:24:23.132688+0000","last_change":"2024-09-10T22:24:22.139850+0000","last_active":"2024-09-10T22:24:23.132688+0000","last_peered":"2024-09-10T22:24:23.132688+0000","last_clean":"2024-09-10T22:24:23.132688+0000","last_became_active":"2024-09-10T22:24:22.137885+0000","last_became_peered":"2024-09-10T22:24:22.137885+0000","last_unstale":"2024-09-10T22:24:23.132688+0000","last_undegraded":"2024-09-10T22:24:23.132688+0000","last_fullsized":"2024-09-10T22:24:23.132688+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_clean_scrub_stamp":"2024-09-10T22:24:21.113844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:52:55.988247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"73'4","reported_seq":36,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T22:24:43.236288+0000","last_change":"2024-09-10T22:24:20.383650+0000","last_active":"2024-09-10T22:24:43.236288+0000","last_peered":"2024-09-10T22:24:43.236288+0000","last_clean":"2024-09-10T22:24:43.236288+0000","last_became_active":"2024-09-10T22:24:20.383286+0000","last_became_peered":"2024-09-10T22:24:20.383286+0000","last_unstale":"2024-09-10T22:24:43.236288+0000","last_undegraded":"2024-09-10T22:24:43.236288+0000","last_fullsized":"2024-09-10T22:24:43.236288+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:19.099039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:19.099039+0000","last_clean_scrub_stamp":"2024-09-10T22:24:19.099039+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:38:04.467105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":13,"num_read_kb":13,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T22:24:23.152595+0000","last_change":"2024-09-10T22:24:22.141717+0000","last_active":"2024-09-10T22:24:23.152595+0000","last_peered":"2024-09-10T22:24:23.152595+0000","last_clean":"2024-09-10T22:24:23.152595+0000","last_became_active":"2024-09-10T22:24:22.141426+0000","last_became_peered":"2024-09-10T22:24:22.141426+0000","last_unstale":"2024-09-10T22:24:23.152595+0000","last_undegraded":"2024-09-10T22:24:23.152595+0000","last_fullsized":"2024-09-10T22:24:23.152595+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_clean_scrub_stamp":"2024-09-10T22:24:21.113844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:13:58.341345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"73'1","reported_seq":20,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T22:24:23.134397+0000","last_change":"2024-09-10T22:24:20.127658+0000","last_active":"2024-09-10T22:24:23.134397+0000","last_peered":"2024-09-10T22:24:23.134397+0000","last_clean":"2024-09-10T22:24:23.134397+0000","last_became_active":"2024-09-10T22:24:20.127366+0000","last_became_peered":"2024-09-10T22:24:20.127366+0000","last_unstale":"2024-09-10T22:24:23.134397+0000","last_undegraded":"2024-09-10T22:24:23.134397+0000","last_fullsized":"2024-09-10T22:24:23.134397+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:19.099039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:19.099039+0000","last_clean_scrub_stamp":"2024-09-10T22:24:19.099039+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:36:05.439417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T22:24:23.146268+0000","last_change":"2024-09-10T22:24:22.144799+0000","last_active":"2024-09-10T22:24:23.146268+0000","last_peered":"2024-09-10T22:24:23.146268+0000","last_clean":"2024-09-10T22:24:23.146268+0000","last_became_active":"2024-09-10T22:24:22.144543+0000","last_became_peered":"2024-09-10T22:24:22.144543+0000","last_unstale":"2024-09-10T22:24:23.146268+0000","last_undegraded":"2024-09-10T22:24:23.146268+0000","last_fullsized":"2024-09-10T22:24:23.146268+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_clean_scrub_stamp":"2024-09-10T22:24:21.113844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:45:46.193108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":19,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T22:24:23.145653+0000","last_change":"2024-09-10T22:24:20.383345+0000","last_active":"2024-09-10T22:24:23.145653+0000","last_peered":"2024-09-10T22:24:23.145653+0000","last_clean":"2024-09-10T22:24:23.145653+0000","last_became_active":"2024-09-10T22:24:20.383023+0000","last_became_peered":"2024-09-10T22:24:20.383023+0000","last_unstale":"2024-09-10T22:24:23.145653+0000","last_undegraded":"2024-09-10T22:24:23.145653+0000","last_fullsized":"2024-09-10T22:24:23.145653+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:19.099039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:19.099039+0000","last_clean_scrub_stamp":"2024-09-10T22:24:19.099039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:27:31.771060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"73'1","reported_seq":15,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T22:24:25.428471+0000","last_change":"2024-09-10T22:24:22.143130+0000","last_active":"2024-09-10T22:24:25.428471+0000","last_peered":"2024-09-10T22:24:25.428471+0000","last_clean":"2024-09-10T22:24:25.428471+0000","last_became_active":"2024-09-10T22:24:22.142664+0000","last_became_peered":"2024-09-10T22:24:22.142664+0000","last_unstale":"2024-09-10T22:24:25.428471+0000","last_undegraded":"2024-09-10T22:24:25.428471+0000","last_fullsized":"2024-09-10T22:24:25.428471+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_clean_scrub_stamp":"2024-09-10T22:24:21.113844+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:49:53.325307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"73'1","reported_seq":21,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T22:24:30.196224+0000","last_change":"2024-09-10T22:24:20.383795+0000","last_active":"2024-09-10T22:24:30.196224+0000","last_peered":"2024-09-10T22:24:30.196224+0000","last_clean":"2024-09-10T22:24:30.196224+0000","last_became_active":"2024-09-10T22:24:20.383418+0000","last_became_peered":"2024-09-10T22:24:20.383418+0000","last_unstale":"2024-09-10T22:24:30.196224+0000","last_undegraded":"2024-09-10T22:24:30.196224+0000","last_fullsized":"2024-09-10T22:24:30.196224+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:19.099039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:19.099039+0000","last_clean_scrub_stamp":"2024-09-10T22:24:19.099039+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:52:26.602544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T22:24:23.133146+0000","last_change":"2024-09-10T22:24:22.139416+0000","last_active":"2024-09-10T22:24:23.133146+0000","last_peered":"2024-09-10T22:24:23.133146+0000","last_clean":"2024-09-10T22:24:23.133146+0000","last_became_active":"2024-09-10T22:24:22.138648+0000","last_became_peered":"2024-09-10T22:24:22.138648+0000","last_unstale":"2024-09-10T22:24:23.133146+0000","last_undegraded":"2024-09-10T22:24:23.133146+0000","last_fullsized":"2024-09-10T22:24:23.133146+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_clean_scrub_stamp":"2024-09-10T22:24:21.113844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:12:20.064134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"73'7","reported_seq":26,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T22:24:41.146402+0000","last_change":"2024-09-10T22:24:20.124001+0000","last_active":"2024-09-10T22:24:41.146402+0000","last_peered":"2024-09-10T22:24:41.146402+0000","last_clean":"2024-09-10T22:24:41.146402+0000","last_became_active":"2024-09-10T22:24:20.123616+0000","last_became_peered":"2024-09-10T22:24:20.123616+0000","last_unstale":"2024-09-10T22:24:41.146402+0000","last_undegraded":"2024-09-10T22:24:41.146402+0000","last_fullsized":"2024-09-10T22:24:41.146402+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:19.099039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:19.099039+0000","last_clean_scrub_stamp":"2024-09-10T22:24:19.099039+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:12:47.003561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T22:24:23.149127+0000","last_change":"2024-09-10T22:24:22.146936+0000","last_active":"2024-09-10T22:24:23.149127+0000","last_peered":"2024-09-10T22:24:23.149127+0000","last_clean":"2024-09-10T22:24:23.149127+0000","last_became_active":"2024-09-10T22:24:22.146578+0000","last_became_peered":"2024-09-10T22:24:22.146578+0000","last_unstale":"2024-09-10T22:24:23.149127+0000","last_undegraded":"2024-09-10T22:24:23.149127+0000","last_fullsized":"2024-09-10T22:24:23.149127+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_clean_scrub_stamp":"2024-09-10T22:24:21.113844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:44:20.229747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"73'4","reported_seq":23,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T22:24:30.197681+0000","last_change":"2024-09-10T22:24:20.406642+0000","last_active":"2024-09-10T22:24:30.197681+0000","last_peered":"2024-09-10T22:24:30.197681+0000","last_clean":"2024-09-10T22:24:30.197681+0000","last_became_active":"2024-09-10T22:24:20.406288+0000","last_became_peered":"2024-09-10T22:24:20.406288+0000","last_unstale":"2024-09-10T22:24:30.197681+0000","last_undegraded":"2024-09-10T22:24:30.197681+0000","last_fullsized":"2024-09-10T22:24:30.197681+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:19.099039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:19.099039+0000","last_clean_scrub_stamp":"2024-09-10T22:24:19.099039+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:10:48.558751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T22:24:23.151867+0000","last_change":"2024-09-10T22:24:22.142511+0000","last_active":"2024-09-10T22:24:23.151867+0000","last_peered":"2024-09-10T22:24:23.151867+0000","last_clean":"2024-09-10T22:24:23.151867+0000","last_became_active":"2024-09-10T22:24:22.142200+0000","last_became_peered":"2024-09-10T22:24:22.142200+0000","last_unstale":"2024-09-10T22:24:23.151867+0000","last_undegraded":"2024-09-10T22:24:23.151867+0000","last_fullsized":"2024-09-10T22:24:23.151867+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_clean_scrub_stamp":"2024-09-10T22:24:21.113844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:09:46.928679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"73'2","reported_seq":21,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T22:24:30.195765+0000","last_change":"2024-09-10T22:24:20.383403+0000","last_active":"2024-09-10T22:24:30.195765+0000","last_peered":"2024-09-10T22:24:30.195765+0000","last_clean":"2024-09-10T22:24:30.195765+0000","last_became_active":"2024-09-10T22:24:20.383143+0000","last_became_peered":"2024-09-10T22:24:20.383143+0000","last_unstale":"2024-09-10T22:24:30.195765+0000","last_undegraded":"2024-09-10T22:24:30.195765+0000","last_fullsized":"2024-09-10T22:24:30.195765+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:19.099039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:19.099039+0000","last_clean_scrub_stamp":"2024-09-10T22:24:19.099039+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:54:07.338628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T22:24:23.148484+0000","last_change":"2024-09-10T22:24:22.136604+0000","last_active":"2024-09-10T22:24:23.148484+0000","last_peered":"2024-09-10T22:24:23.148484+0000","last_clean":"2024-09-10T22:24:23.148484+0000","last_became_active":"2024-09-10T22:24:22.136298+0000","last_became_peered":"2024-09-10T22:24:22.136298+0000","last_unstale":"2024-09-10T22:24:23.148484+0000","last_undegraded":"2024-09-10T22:24:23.148484+0000","last_fullsized":"2024-09-10T22:24:23.148484+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_clean_scrub_stamp":"2024-09-10T22:24:21.113844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:39:11.777729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"73'3","reported_seq":22,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T22:24:30.196571+0000","last_change":"2024-09-10T22:24:20.124911+0000","last_active":"2024-09-10T22:24:30.196571+0000","last_peered":"2024-09-10T22:24:30.196571+0000","last_clean":"2024-09-10T22:24:30.196571+0000","last_became_active":"2024-09-10T22:24:20.124152+0000","last_became_peered":"2024-09-10T22:24:20.124152+0000","last_unstale":"2024-09-10T22:24:30.196571+0000","last_undegraded":"2024-09-10T22:24:30.196571+0000","last_fullsized":"2024-09-10T22:24:30.196571+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:19.099039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:19.099039+0000","last_clean_scrub_stamp":"2024-09-10T22:24:19.099039+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:32:30.837104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T22:24:23.150504+0000","last_change":"2024-09-10T22:24:22.138080+0000","last_active":"2024-09-10T22:24:23.150504+0000","last_peered":"2024-09-10T22:24:23.150504+0000","last_clean":"2024-09-10T22:24:23.150504+0000","last_became_active":"2024-09-10T22:24:22.137775+0000","last_became_peered":"2024-09-10T22:24:22.137775+0000","last_unstale":"2024-09-10T22:24:23.150504+0000","last_undegraded":"2024-09-10T22:24:23.150504+0000","last_fullsized":"2024-09-10T22:24:23.150504+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_clean_scrub_stamp":"2024-09-10T22:24:21.113844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:10:48.320495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"73'1","reported_seq":20,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T22:24:23.135992+0000","last_change":"2024-09-10T22:24:20.125551+0000","last_active":"2024-09-10T22:24:23.135992+0000","last_peered":"2024-09-10T22:24:23.135992+0000","last_clean":"2024-09-10T22:24:23.135992+0000","last_became_active":"2024-09-10T22:24:20.125064+0000","last_became_peered":"2024-09-10T22:24:20.125064+0000","last_unstale":"2024-09-10T22:24:23.135992+0000","last_undegraded":"2024-09-10T22:24:23.135992+0000","last_fullsized":"2024-09-10T22:24:23.135992+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:19.099039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:19.099039+0000","last_clean_scrub_stamp":"2024-09-10T22:24:19.099039+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:29:48.598158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T22:24:23.148300+0000","last_change":"2024-09-10T22:24:22.142894+0000","last_active":"2024-09-10T22:24:23.148300+0000","last_peered":"2024-09-10T22:24:23.148300+0000","last_clean":"2024-09-10T22:24:23.148300+0000","last_became_active":"2024-09-10T22:24:22.142554+0000","last_became_peered":"2024-09-10T22:24:22.142554+0000","last_unstale":"2024-09-10T22:24:23.148300+0000","last_undegraded":"2024-09-10T22:24:23.148300+0000","last_fullsized":"2024-09-10T22:24:23.148300+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_clean_scrub_stamp":"2024-09-10T22:24:21.113844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:11:11.457622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"73'4","reported_seq":24,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T22:24:30.197958+0000","last_change":"2024-09-10T22:24:20.128212+0000","last_active":"2024-09-10T22:24:30.197958+0000","last_peered":"2024-09-10T22:24:30.197958+0000","last_clean":"2024-09-10T22:24:30.197958+0000","last_became_active":"2024-09-10T22:24:20.127597+0000","last_became_peered":"2024-09-10T22:24:20.127597+0000","last_unstale":"2024-09-10T22:24:30.197958+0000","last_undegraded":"2024-09-10T22:24:30.197958+0000","last_fullsized":"2024-09-10T22:24:30.197958+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:19.099039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:19.099039+0000","last_clean_scrub_stamp":"2024-09-10T22:24:19.099039+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:48:28.543222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T22:24:23.134526+0000","last_change":"2024-09-10T22:24:22.144321+0000","last_active":"2024-09-10T22:24:23.134526+0000","last_peered":"2024-09-10T22:24:23.134526+0000","last_clean":"2024-09-10T22:24:23.134526+0000","last_became_active":"2024-09-10T22:24:22.144037+0000","last_became_peered":"2024-09-10T22:24:22.144037+0000","last_unstale":"2024-09-10T22:24:23.134526+0000","last_undegraded":"2024-09-10T22:24:23.134526+0000","last_fullsized":"2024-09-10T22:24:23.134526+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_clean_scrub_stamp":"2024-09-10T22:24:21.113844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:28:00.600758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T22:24:23.149693+0000","last_change":"2024-09-10T22:24:22.145574+0000","last_active":"2024-09-10T22:24:23.149693+0000","last_peered":"2024-09-10T22:24:23.149693+0000","last_clean":"2024-09-10T22:24:23.149693+0000","last_became_active":"2024-09-10T22:24:22.144425+0000","last_became_peered":"2024-09-10T22:24:22.144425+0000","last_unstale":"2024-09-10T22:24:23.149693+0000","last_undegraded":"2024-09-10T22:24:23.149693+0000","last_fullsized":"2024-09-10T22:24:23.149693+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_clean_scrub_stamp":"2024-09-10T22:24:21.113844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:41:10.177782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"73'2","reported_seq":21,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T22:24:23.155618+0000","last_change":"2024-09-10T22:24:20.124627+0000","last_active":"2024-09-10T22:24:23.155618+0000","last_peered":"2024-09-10T22:24:23.155618+0000","last_clean":"2024-09-10T22:24:23.155618+0000","last_became_active":"2024-09-10T22:24:20.124174+0000","last_became_peered":"2024-09-10T22:24:20.124174+0000","last_unstale":"2024-09-10T22:24:23.155618+0000","last_undegraded":"2024-09-10T22:24:23.155618+0000","last_fullsized":"2024-09-10T22:24:23.155618+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:19.099039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:19.099039+0000","last_clean_scrub_stamp":"2024-09-10T22:24:19.099039+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:35:26.871316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T22:24:23.149018+0000","last_change":"2024-09-10T22:24:22.142531+0000","last_active":"2024-09-10T22:24:23.149018+0000","last_peered":"2024-09-10T22:24:23.149018+0000","last_clean":"2024-09-10T22:24:23.149018+0000","last_became_active":"2024-09-10T22:24:22.142240+0000","last_became_peered":"2024-09-10T22:24:22.142240+0000","last_unstale":"2024-09-10T22:24:23.149018+0000","last_undegraded":"2024-09-10T22:24:23.149018+0000","last_fullsized":"2024-09-10T22:24:23.149018+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_clean_scrub_stamp":"2024-09-10T22:24:21.113844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:30:56.868586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"73'4","reported_seq":23,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T22:24:31.212105+0000","last_change":"2024-09-10T22:24:20.129745+0000","last_active":"2024-09-10T22:24:31.212105+0000","last_peered":"2024-09-10T22:24:31.212105+0000","last_clean":"2024-09-10T22:24:31.212105+0000","last_became_active":"2024-09-10T22:24:20.129397+0000","last_became_peered":"2024-09-10T22:24:20.129397+0000","last_unstale":"2024-09-10T22:24:31.212105+0000","last_undegraded":"2024-09-10T22:24:31.212105+0000","last_fullsized":"2024-09-10T22:24:31.212105+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:19.099039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:19.099039+0000","last_clean_scrub_stamp":"2024-09-10T22:24:19.099039+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:16:15.263977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T22:24:23.151265+0000","last_change":"2024-09-10T22:24:22.141121+0000","last_active":"2024-09-10T22:24:23.151265+0000","last_peered":"2024-09-10T22:24:23.151265+0000","last_clean":"2024-09-10T22:24:23.151265+0000","last_became_active":"2024-09-10T22:24:22.140490+0000","last_became_peered":"2024-09-10T22:24:22.140490+0000","last_unstale":"2024-09-10T22:24:23.151265+0000","last_undegraded":"2024-09-10T22:24:23.151265+0000","last_fullsized":"2024-09-10T22:24:23.151265+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_clean_scrub_stamp":"2024-09-10T22:24:21.113844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:52:22.840740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"73'2","reported_seq":21,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T22:24:23.644041+0000","last_change":"2024-09-10T22:24:20.385053+0000","last_active":"2024-09-10T22:24:23.644041+0000","last_peered":"2024-09-10T22:24:23.644041+0000","last_clean":"2024-09-10T22:24:23.644041+0000","last_became_active":"2024-09-10T22:24:20.384432+0000","last_became_peered":"2024-09-10T22:24:20.384432+0000","last_unstale":"2024-09-10T22:24:23.644041+0000","last_undegraded":"2024-09-10T22:24:23.644041+0000","last_fullsized":"2024-09-10T22:24:23.644041+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:19.099039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:19.099039+0000","last_clean_scrub_stamp":"2024-09-10T22:24:19.099039+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:18:15.685331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T22:24:23.149036+0000","last_change":"2024-09-10T22:24:22.143884+0000","last_active":"2024-09-10T22:24:23.149036+0000","last_peered":"2024-09-10T22:24:23.149036+0000","last_clean":"2024-09-10T22:24:23.149036+0000","last_became_active":"2024-09-10T22:24:22.143446+0000","last_became_peered":"2024-09-10T22:24:22.143446+0000","last_unstale":"2024-09-10T22:24:23.149036+0000","last_undegraded":"2024-09-10T22:24:23.149036+0000","last_fullsized":"2024-09-10T22:24:23.149036+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_clean_scrub_stamp":"2024-09-10T22:24:21.113844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:28:32.453668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"73'9","reported_seq":29,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T22:24:31.214189+0000","last_change":"2024-09-10T22:24:20.126454+0000","last_active":"2024-09-10T22:24:31.214189+0000","last_peered":"2024-09-10T22:24:31.214189+0000","last_clean":"2024-09-10T22:24:31.214189+0000","last_became_active":"2024-09-10T22:24:20.126120+0000","last_became_peered":"2024-09-10T22:24:20.126120+0000","last_unstale":"2024-09-10T22:24:31.214189+0000","last_undegraded":"2024-09-10T22:24:31.214189+0000","last_fullsized":"2024-09-10T22:24:31.214189+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:19.099039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:19.099039+0000","last_clean_scrub_stamp":"2024-09-10T22:24:19.099039+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:26:04.013260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":50801,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":106,"num_read_kb":108,"num_write":149,"num_write_kb":92,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":380928,"data_stored":152403,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":128,"ondisk_log_size":128,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4751360,"data_stored":4722944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":92,"ondisk_log_size":92,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":67,"seq":287762808849,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27792,"kb_used_data":768,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717360,"statfs":{"total":95995035648,"available":95966576640,"internally_reserved":0,"allocated":786432,"data_stored":379816,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":62,"seq":266287972374,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36780,"kb_used_data":1436,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708372,"statfs":{"total":95995035648,"available":95957372928,"internally_reserved":0,"allocated":1470464,"data_stored":1018488,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":36174272},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":57,"seq":244813135898,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27808,"kb_used_data":784,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717344,"statfs":{"total":95995035648,"available":95966560256,"internally_reserved":0,"allocated":802816,"data_stored":380052,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":51,"seq":219043332127,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27808,"kb_used_data":784,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717344,"statfs":{"total":95995035648,"available":95966560256,"internally_reserved":0,"allocated":802816,"data_stored":379972,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":46,"seq":197568495653,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36708,"kb_used_data":1364,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708444,"statfs":{"total":95995035648,"available":95957446656,"internally_reserved":0,"allocated":1396736,"data_stored":971902,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":36174282},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":40,"seq":171798691882,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27796,"kb_used_data":772,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717356,"statfs":{"total":95995035648,"available":95966572544,"internally_reserved":0,"allocated":790528,"data_stored":379441,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":34,"seq":146028888110,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28400,"kb_used_data":1376,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716752,"statfs":{"total":95995035648,"available":95965954048,"internally_reserved":0,"allocated":1409024,"data_stored":971195,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":29,"seq":124554051635,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27800,"kb_used_data":776,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717352,"statfs":{"total":95995035648,"available":95966568448,"internally_reserved":0,"allocated":794624,"data_stored":380269,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":23,"seq":98784247864,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27812,"kb_used_data":788,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717340,"statfs":{"total":95995035648,"available":95966556160,"internally_reserved":0,"allocated":806912,"data_stored":379752,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444095,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36188,"kb_used_data":844,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708964,"statfs":{"total":95995035648,"available":95957979136,"internally_reserved":0,"allocated":864256,"data_stored":427384,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":12,"seq":51539607619,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36164,"kb_used_data":820,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708988,"statfs":{"total":95995035648,"available":95958003712,"internally_reserved":0,"allocated":839680,"data_stored":426034,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738440,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36136,"kb_used_data":792,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93709016,"statfs":{"total":95995035648,"available":95958032384,"internally_reserved":0,"allocated":811008,"data_stored":380712,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":46800,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":48150,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1035,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1476,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2183,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":48769,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-10T22:24:48.021 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 22997a4c-6fc2-11ef-bcea-c7b262605968 -- ceph pg dump --format=json 2024-09-10T22:24:48.285 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/22997a4c-6fc2-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T22:24:48.658 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:24:48 smithi019 ceph-mon[31375]: from='client.14877 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-10T22:24:48.758 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:48.738+0000 7ff06f320640 1 -- 172.21.15.19:0/541151573 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff0681023f0 msgr2=0x7ff0681068c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:24:48.758 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:48.738+0000 7ff06f320640 1 --2- 172.21.15.19:0/541151573 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff0681023f0 0x7ff0681068c0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7ff05c009900 tx=0x7ff05c02a410 comp rx=0 tx=0).stop 2024-09-10T22:24:48.758 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:48.738+0000 7ff06f320640 1 -- 172.21.15.19:0/541151573 shutdown_connections 2024-09-10T22:24:48.758 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:48.738+0000 7ff06f320640 1 --2- 172.21.15.19:0/541151573 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff068106f10 0x7ff068107360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:24:48.758 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:48.738+0000 7ff06f320640 1 --2- 172.21.15.19:0/541151573 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff0681023f0 0x7ff0681068c0 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:24:48.758 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:48.738+0000 7ff06f320640 1 --2- 172.21.15.19:0/541151573 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff068101ad0 0x7ff068101eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:24:48.759 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:48.738+0000 7ff06f320640 1 -- 172.21.15.19:0/541151573 >> 172.21.15.19:0/541151573 conn(0x7ff0680fd700 msgr2=0x7ff0680ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:24:48.759 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:48.738+0000 7ff06f320640 1 -- 172.21.15.19:0/541151573 shutdown_connections 2024-09-10T22:24:48.759 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:48.738+0000 7ff06f320640 1 -- 172.21.15.19:0/541151573 wait complete. 2024-09-10T22:24:48.759 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:48.739+0000 7ff06f320640 1 Processor -- start 2024-09-10T22:24:48.759 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:48.739+0000 7ff06f320640 1 -- start start 2024-09-10T22:24:48.759 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:48.739+0000 7ff06f320640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff068101ad0 0x7ff06819f8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:24:48.759 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:48.739+0000 7ff06f320640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff0681023f0 0x7ff06819fde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:24:48.759 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:48.739+0000 7ff06f320640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff068106f10 0x7ff0681a5180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:24:48.759 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:48.739+0000 7ff06f320640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7ff068119390 con 0x7ff068101ad0 2024-09-10T22:24:48.759 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:48.739+0000 7ff06f320640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7ff068119210 con 0x7ff0681023f0 2024-09-10T22:24:48.759 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:48.739+0000 7ff06f320640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7ff068119510 con 0x7ff068106f10 2024-09-10T22:24:48.759 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:48.739+0000 7ff06d0bc640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff068101ad0 0x7ff06819f8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:24:48.759 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:48.739+0000 7ff06d0bc640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff068101ad0 0x7ff06819f8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:51608/0 (socket says 172.21.15.19:51608) 2024-09-10T22:24:48.759 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:48.739+0000 7ff06d0bc640 1 -- 172.21.15.19:0/2398655113 learned_addr learned my addr 172.21.15.19:0/2398655113 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:24:48.760 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:48.739+0000 7ff06c8bb640 1 --2- 172.21.15.19:0/2398655113 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff0681023f0 0x7ff06819fde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:24:48.760 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:48.739+0000 7ff06d8bd640 1 --2- 172.21.15.19:0/2398655113 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff068106f10 0x7ff0681a5180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:24:48.760 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:48.739+0000 7ff06d0bc640 1 -- 172.21.15.19:0/2398655113 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff068106f10 msgr2=0x7ff0681a5180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:24:48.760 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:48.739+0000 7ff06d0bc640 1 --2- 172.21.15.19:0/2398655113 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff068106f10 0x7ff0681a5180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:24:48.760 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:48.739+0000 7ff06d0bc640 1 -- 172.21.15.19:0/2398655113 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff0681023f0 msgr2=0x7ff06819fde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:24:48.760 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:48.739+0000 7ff06d0bc640 1 --2- 172.21.15.19:0/2398655113 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff0681023f0 0x7ff06819fde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:24:48.760 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:48.739+0000 7ff06d0bc640 1 -- 172.21.15.19:0/2398655113 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff0681a5950 con 0x7ff068101ad0 2024-09-10T22:24:48.760 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:48.739+0000 7ff06c8bb640 1 --2- 172.21.15.19:0/2398655113 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff0681023f0 0x7ff06819fde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T22:24:48.760 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:48.739+0000 7ff06d8bd640 1 --2- 172.21.15.19:0/2398655113 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff068106f10 0x7ff0681a5180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T22:24:48.760 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:48.740+0000 7ff06d0bc640 1 --2- 172.21.15.19:0/2398655113 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff068101ad0 0x7ff06819f8a0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7ff05800ea80 tx=0x7ff05800ef40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:24:48.760 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:48.740+0000 7ff0667fc640 1 -- 172.21.15.19:0/2398655113 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff05800ce40 con 0x7ff068101ad0 2024-09-10T22:24:48.760 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:48.740+0000 7ff0667fc640 1 -- 172.21.15.19:0/2398655113 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff058005020 con 0x7ff068101ad0 2024-09-10T22:24:48.761 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:48.740+0000 7ff06f320640 1 -- 172.21.15.19:0/2398655113 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff0681a5c40 con 0x7ff068101ad0 2024-09-10T22:24:48.761 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:48.740+0000 7ff0667fc640 1 -- 172.21.15.19:0/2398655113 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0580116d0 con 0x7ff068101ad0 2024-09-10T22:24:48.761 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:48.740+0000 7ff06f320640 1 -- 172.21.15.19:0/2398655113 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff0681ac300 con 0x7ff068101ad0 2024-09-10T22:24:48.761 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:48.741+0000 7ff06f320640 1 -- 172.21.15.19:0/2398655113 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff0681068c0 con 0x7ff068101ad0 2024-09-10T22:24:48.761 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:48.742+0000 7ff0667fc640 1 -- 172.21.15.19:0/2398655113 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 17) ==== 153301+0+0 (secure 0 0 0) 0x7ff05800f040 con 0x7ff068101ad0 2024-09-10T22:24:48.761 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:48.743+0000 7ff0667fc640 1 --2- 172.21.15.19:0/2398655113 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7ff0500b53f0 0x7ff0500b78b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:24:48.761 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:48.744+0000 7ff06c8bb640 1 --2- 172.21.15.19:0/2398655113 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7ff0500b53f0 0x7ff0500b78b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:24:48.761 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:48.744+0000 7ff0667fc640 1 -- 172.21.15.19:0/2398655113 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 7979+0+0 (secure 0 0 0) 0x7ff0580e5f50 con 0x7ff068101ad0 2024-09-10T22:24:48.761 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:48.744+0000 7ff06c8bb640 1 --2- 172.21.15.19:0/2398655113 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7ff0500b53f0 0x7ff0500b78b0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7ff05c000c00 tx=0x7ff05c032e00 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:24:48.761 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:48.746+0000 7ff0667fc640 1 -- 172.21.15.19:0/2398655113 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7ff058016030 con 0x7ff068101ad0 2024-09-10T22:24:48.859 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:24:48 smithi135 ceph-mon[34789]: from='client.14877 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-10T22:24:48.874 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:24:48 smithi138 ceph-mon[35236]: from='client.14877 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-10T22:24:48.932 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:48.930+0000 7ff06f320640 1 -- 172.21.15.19:0/2398655113 --> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7ff068105fb0 con 0x7ff0500b53f0 2024-09-10T22:24:48.936 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:48.934+0000 7ff0667fc640 1 -- 172.21.15.19:0/2398655113 <== mgr.14150 v2:172.21.15.19:6800/2119495487 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258690 (secure 0 0 0) 0x7ff068105fb0 con 0x7ff0500b53f0 2024-09-10T22:24:48.938 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-10T22:24:48.939 INFO:teuthology.orchestra.run.smithi019.stderr:dumped all 2024-09-10T22:24:48.941 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:48.937+0000 7ff06f320640 1 -- 172.21.15.19:0/2398655113 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7ff0500b53f0 msgr2=0x7ff0500b78b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:24:48.941 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:48.937+0000 7ff06f320640 1 --2- 172.21.15.19:0/2398655113 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7ff0500b53f0 0x7ff0500b78b0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7ff05c000c00 tx=0x7ff05c032e00 comp rx=0 tx=0).stop 2024-09-10T22:24:48.941 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:48.937+0000 7ff06f320640 1 -- 172.21.15.19:0/2398655113 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff068101ad0 msgr2=0x7ff06819f8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:24:48.941 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:48.937+0000 7ff06f320640 1 --2- 172.21.15.19:0/2398655113 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff068101ad0 0x7ff06819f8a0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7ff05800ea80 tx=0x7ff05800ef40 comp rx=0 tx=0).stop 2024-09-10T22:24:48.941 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:48.937+0000 7ff06f320640 1 -- 172.21.15.19:0/2398655113 shutdown_connections 2024-09-10T22:24:48.942 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:48.937+0000 7ff06f320640 1 --2- 172.21.15.19:0/2398655113 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7ff0500b53f0 0x7ff0500b78b0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:24:48.942 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:48.937+0000 7ff06f320640 1 --2- 172.21.15.19:0/2398655113 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff068106f10 0x7ff0681a5180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:24:48.942 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:48.937+0000 7ff06f320640 1 --2- 172.21.15.19:0/2398655113 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff0681023f0 0x7ff06819fde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:24:48.942 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:48.937+0000 7ff06f320640 1 --2- 172.21.15.19:0/2398655113 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff068101ad0 0x7ff06819f8a0 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:24:48.942 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:48.937+0000 7ff06f320640 1 -- 172.21.15.19:0/2398655113 >> 172.21.15.19:0/2398655113 conn(0x7ff0680fd700 msgr2=0x7ff068104890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:24:48.942 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:48.938+0000 7ff06f320640 1 -- 172.21.15.19:0/2398655113 shutdown_connections 2024-09-10T22:24:48.942 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:48.938+0000 7ff06f320640 1 -- 172.21.15.19:0/2398655113 wait complete. 2024-09-10T22:24:49.647 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:24:49 smithi019 ceph-mon[31375]: pgmap v295: 97 pgs: 97 active+clean; 626 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 4.7 KiB/s wr, 7 op/s 2024-09-10T22:24:49.647 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:24:49 smithi019 ceph-mon[31375]: from='client.14883 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-10T22:24:49.675 INFO:teuthology.orchestra.run.smithi019.stdout:{"pg_ready":true,"pg_map":{"version":295,"stamp":"2024-09-10T22:24:48.368116+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":641403,"num_objects":64,"num_object_clones":0,"num_object_copies":192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":182,"num_read_kb":172,"num_write":274,"num_write_kb":2244,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":222,"ondisk_log_size":222,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":377192,"kb_used_data":11304,"kb_used_omap":18,"kb_used_meta":365677,"kb_avail":1124564632,"statfs":{"total":1151940427776,"available":1151554183168,"internally_reserved":0,"allocated":11575296,"data_stored":6475017,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19142,"internal_metadata":374453562},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":45813,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":65,"num_read_kb":77,"num_write":26,"num_write_kb":56,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003410"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T22:24:23.150882+0000","last_change":"2024-09-10T22:24:22.139905+0000","last_active":"2024-09-10T22:24:23.150882+0000","last_peered":"2024-09-10T22:24:23.150882+0000","last_clean":"2024-09-10T22:24:23.150882+0000","last_became_active":"2024-09-10T22:24:22.139558+0000","last_became_peered":"2024-09-10T22:24:22.139558+0000","last_unstale":"2024-09-10T22:24:23.150882+0000","last_undegraded":"2024-09-10T22:24:23.150882+0000","last_fullsized":"2024-09-10T22:24:23.150882+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_clean_scrub_stamp":"2024-09-10T22:24:21.113844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:44:10.434972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T22:24:23.151866+0000","last_change":"2024-09-10T22:24:22.136722+0000","last_active":"2024-09-10T22:24:23.151866+0000","last_peered":"2024-09-10T22:24:23.151866+0000","last_clean":"2024-09-10T22:24:23.151866+0000","last_became_active":"2024-09-10T22:24:22.136080+0000","last_became_peered":"2024-09-10T22:24:22.136080+0000","last_unstale":"2024-09-10T22:24:23.151866+0000","last_undegraded":"2024-09-10T22:24:23.151866+0000","last_fullsized":"2024-09-10T22:24:23.151866+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_clean_scrub_stamp":"2024-09-10T22:24:21.113844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:52:50.562031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T22:24:23.151124+0000","last_change":"2024-09-10T22:24:22.141323+0000","last_active":"2024-09-10T22:24:23.151124+0000","last_peered":"2024-09-10T22:24:23.151124+0000","last_clean":"2024-09-10T22:24:23.151124+0000","last_became_active":"2024-09-10T22:24:22.140895+0000","last_became_peered":"2024-09-10T22:24:22.140895+0000","last_unstale":"2024-09-10T22:24:23.151124+0000","last_undegraded":"2024-09-10T22:24:23.151124+0000","last_fullsized":"2024-09-10T22:24:23.151124+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_clean_scrub_stamp":"2024-09-10T22:24:21.113844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:46:22.604672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T22:24:23.146229+0000","last_change":"2024-09-10T22:24:22.138806+0000","last_active":"2024-09-10T22:24:23.146229+0000","last_peered":"2024-09-10T22:24:23.146229+0000","last_clean":"2024-09-10T22:24:23.146229+0000","last_became_active":"2024-09-10T22:24:22.138502+0000","last_became_peered":"2024-09-10T22:24:22.138502+0000","last_unstale":"2024-09-10T22:24:23.146229+0000","last_undegraded":"2024-09-10T22:24:23.146229+0000","last_fullsized":"2024-09-10T22:24:23.146229+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_clean_scrub_stamp":"2024-09-10T22:24:21.113844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:45:01.626820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T22:24:23.149005+0000","last_change":"2024-09-10T22:24:22.141233+0000","last_active":"2024-09-10T22:24:23.149005+0000","last_peered":"2024-09-10T22:24:23.149005+0000","last_clean":"2024-09-10T22:24:23.149005+0000","last_became_active":"2024-09-10T22:24:22.140944+0000","last_became_peered":"2024-09-10T22:24:22.140944+0000","last_unstale":"2024-09-10T22:24:23.149005+0000","last_undegraded":"2024-09-10T22:24:23.149005+0000","last_fullsized":"2024-09-10T22:24:23.149005+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_clean_scrub_stamp":"2024-09-10T22:24:21.113844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:09:29.615658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T22:24:23.145392+0000","last_change":"2024-09-10T22:24:22.137990+0000","last_active":"2024-09-10T22:24:23.145392+0000","last_peered":"2024-09-10T22:24:23.145392+0000","last_clean":"2024-09-10T22:24:23.145392+0000","last_became_active":"2024-09-10T22:24:22.137685+0000","last_became_peered":"2024-09-10T22:24:22.137685+0000","last_unstale":"2024-09-10T22:24:23.145392+0000","last_undegraded":"2024-09-10T22:24:23.145392+0000","last_fullsized":"2024-09-10T22:24:23.145392+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_clean_scrub_stamp":"2024-09-10T22:24:21.113844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:32:23.891069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T22:24:23.133816+0000","last_change":"2024-09-10T22:24:22.148073+0000","last_active":"2024-09-10T22:24:23.133816+0000","last_peered":"2024-09-10T22:24:23.133816+0000","last_clean":"2024-09-10T22:24:23.133816+0000","last_became_active":"2024-09-10T22:24:22.147785+0000","last_became_peered":"2024-09-10T22:24:22.147785+0000","last_unstale":"2024-09-10T22:24:23.133816+0000","last_undegraded":"2024-09-10T22:24:23.133816+0000","last_fullsized":"2024-09-10T22:24:23.133816+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_clean_scrub_stamp":"2024-09-10T22:24:21.113844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:39:48.847949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T22:24:23.147754+0000","last_change":"2024-09-10T22:24:22.145949+0000","last_active":"2024-09-10T22:24:23.147754+0000","last_peered":"2024-09-10T22:24:23.147754+0000","last_clean":"2024-09-10T22:24:23.147754+0000","last_became_active":"2024-09-10T22:24:22.145587+0000","last_became_peered":"2024-09-10T22:24:22.145587+0000","last_unstale":"2024-09-10T22:24:23.147754+0000","last_undegraded":"2024-09-10T22:24:23.147754+0000","last_fullsized":"2024-09-10T22:24:23.147754+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_clean_scrub_stamp":"2024-09-10T22:24:21.113844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:16:24.323551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T22:24:23.149901+0000","last_change":"2024-09-10T22:24:22.148042+0000","last_active":"2024-09-10T22:24:23.149901+0000","last_peered":"2024-09-10T22:24:23.149901+0000","last_clean":"2024-09-10T22:24:23.149901+0000","last_became_active":"2024-09-10T22:24:22.147722+0000","last_became_peered":"2024-09-10T22:24:22.147722+0000","last_unstale":"2024-09-10T22:24:23.149901+0000","last_undegraded":"2024-09-10T22:24:23.149901+0000","last_fullsized":"2024-09-10T22:24:23.149901+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_clean_scrub_stamp":"2024-09-10T22:24:21.113844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:42:42.383957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T22:24:23.146449+0000","last_change":"2024-09-10T22:24:22.138956+0000","last_active":"2024-09-10T22:24:23.146449+0000","last_peered":"2024-09-10T22:24:23.146449+0000","last_clean":"2024-09-10T22:24:23.146449+0000","last_became_active":"2024-09-10T22:24:22.138530+0000","last_became_peered":"2024-09-10T22:24:22.138530+0000","last_unstale":"2024-09-10T22:24:23.146449+0000","last_undegraded":"2024-09-10T22:24:23.146449+0000","last_fullsized":"2024-09-10T22:24:23.146449+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_clean_scrub_stamp":"2024-09-10T22:24:21.113844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:37:55.316556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T22:24:23.134440+0000","last_change":"2024-09-10T22:24:22.143435+0000","last_active":"2024-09-10T22:24:23.134440+0000","last_peered":"2024-09-10T22:24:23.134440+0000","last_clean":"2024-09-10T22:24:23.134440+0000","last_became_active":"2024-09-10T22:24:22.143100+0000","last_became_peered":"2024-09-10T22:24:22.143100+0000","last_unstale":"2024-09-10T22:24:23.134440+0000","last_undegraded":"2024-09-10T22:24:23.134440+0000","last_fullsized":"2024-09-10T22:24:23.134440+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_clean_scrub_stamp":"2024-09-10T22:24:21.113844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:24:14.344203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T22:24:23.146577+0000","last_change":"2024-09-10T22:24:22.138101+0000","last_active":"2024-09-10T22:24:23.146577+0000","last_peered":"2024-09-10T22:24:23.146577+0000","last_clean":"2024-09-10T22:24:23.146577+0000","last_became_active":"2024-09-10T22:24:22.137479+0000","last_became_peered":"2024-09-10T22:24:22.137479+0000","last_unstale":"2024-09-10T22:24:23.146577+0000","last_undegraded":"2024-09-10T22:24:23.146577+0000","last_fullsized":"2024-09-10T22:24:23.146577+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_clean_scrub_stamp":"2024-09-10T22:24:21.113844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:48:09.423136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T22:24:23.133174+0000","last_change":"2024-09-10T22:24:22.137157+0000","last_active":"2024-09-10T22:24:23.133174+0000","last_peered":"2024-09-10T22:24:23.133174+0000","last_clean":"2024-09-10T22:24:23.133174+0000","last_became_active":"2024-09-10T22:24:22.136817+0000","last_became_peered":"2024-09-10T22:24:22.136817+0000","last_unstale":"2024-09-10T22:24:23.133174+0000","last_undegraded":"2024-09-10T22:24:23.133174+0000","last_fullsized":"2024-09-10T22:24:23.133174+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_clean_scrub_stamp":"2024-09-10T22:24:21.113844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:54:32.922776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T22:24:23.150962+0000","last_change":"2024-09-10T22:24:22.138828+0000","last_active":"2024-09-10T22:24:23.150962+0000","last_peered":"2024-09-10T22:24:23.150962+0000","last_clean":"2024-09-10T22:24:23.150962+0000","last_became_active":"2024-09-10T22:24:22.138509+0000","last_became_peered":"2024-09-10T22:24:22.138509+0000","last_unstale":"2024-09-10T22:24:23.150962+0000","last_undegraded":"2024-09-10T22:24:23.150962+0000","last_fullsized":"2024-09-10T22:24:23.150962+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_clean_scrub_stamp":"2024-09-10T22:24:21.113844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:14:19.492298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T22:24:23.150798+0000","last_change":"2024-09-10T22:24:22.139317+0000","last_active":"2024-09-10T22:24:23.150798+0000","last_peered":"2024-09-10T22:24:23.150798+0000","last_clean":"2024-09-10T22:24:23.150798+0000","last_became_active":"2024-09-10T22:24:22.138949+0000","last_became_peered":"2024-09-10T22:24:22.138949+0000","last_unstale":"2024-09-10T22:24:23.150798+0000","last_undegraded":"2024-09-10T22:24:23.150798+0000","last_fullsized":"2024-09-10T22:24:23.150798+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_clean_scrub_stamp":"2024-09-10T22:24:21.113844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:34:56.412955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T22:24:23.148869+0000","last_change":"2024-09-10T22:24:22.147283+0000","last_active":"2024-09-10T22:24:23.148869+0000","last_peered":"2024-09-10T22:24:23.148869+0000","last_clean":"2024-09-10T22:24:23.148869+0000","last_became_active":"2024-09-10T22:24:22.146954+0000","last_became_peered":"2024-09-10T22:24:22.146954+0000","last_unstale":"2024-09-10T22:24:23.148869+0000","last_undegraded":"2024-09-10T22:24:23.148869+0000","last_fullsized":"2024-09-10T22:24:23.148869+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_clean_scrub_stamp":"2024-09-10T22:24:21.113844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:22:21.772747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T22:24:23.150964+0000","last_change":"2024-09-10T22:24:22.139482+0000","last_active":"2024-09-10T22:24:23.150964+0000","last_peered":"2024-09-10T22:24:23.150964+0000","last_clean":"2024-09-10T22:24:23.150964+0000","last_became_active":"2024-09-10T22:24:22.139135+0000","last_became_peered":"2024-09-10T22:24:22.139135+0000","last_unstale":"2024-09-10T22:24:23.150964+0000","last_undegraded":"2024-09-10T22:24:23.150964+0000","last_fullsized":"2024-09-10T22:24:23.150964+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_clean_scrub_stamp":"2024-09-10T22:24:21.113844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:25:31.639392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T22:24:23.147221+0000","last_change":"2024-09-10T22:24:22.142465+0000","last_active":"2024-09-10T22:24:23.147221+0000","last_peered":"2024-09-10T22:24:23.147221+0000","last_clean":"2024-09-10T22:24:23.147221+0000","last_became_active":"2024-09-10T22:24:22.142110+0000","last_became_peered":"2024-09-10T22:24:22.142110+0000","last_unstale":"2024-09-10T22:24:23.147221+0000","last_undegraded":"2024-09-10T22:24:23.147221+0000","last_fullsized":"2024-09-10T22:24:23.147221+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_clean_scrub_stamp":"2024-09-10T22:24:21.113844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:16:20.476055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T22:24:23.136219+0000","last_change":"2024-09-10T22:24:22.147942+0000","last_active":"2024-09-10T22:24:23.136219+0000","last_peered":"2024-09-10T22:24:23.136219+0000","last_clean":"2024-09-10T22:24:23.136219+0000","last_became_active":"2024-09-10T22:24:22.147637+0000","last_became_peered":"2024-09-10T22:24:22.147637+0000","last_unstale":"2024-09-10T22:24:23.136219+0000","last_undegraded":"2024-09-10T22:24:23.136219+0000","last_fullsized":"2024-09-10T22:24:23.136219+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_clean_scrub_stamp":"2024-09-10T22:24:21.113844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:46:36.831534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T22:24:23.149776+0000","last_change":"2024-09-10T22:24:22.138032+0000","last_active":"2024-09-10T22:24:23.149776+0000","last_peered":"2024-09-10T22:24:23.149776+0000","last_clean":"2024-09-10T22:24:23.149776+0000","last_became_active":"2024-09-10T22:24:22.137657+0000","last_became_peered":"2024-09-10T22:24:22.137657+0000","last_unstale":"2024-09-10T22:24:23.149776+0000","last_undegraded":"2024-09-10T22:24:23.149776+0000","last_fullsized":"2024-09-10T22:24:23.149776+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_clean_scrub_stamp":"2024-09-10T22:24:21.113844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:06:51.479298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T22:24:23.133217+0000","last_change":"2024-09-10T22:24:22.141106+0000","last_active":"2024-09-10T22:24:23.133217+0000","last_peered":"2024-09-10T22:24:23.133217+0000","last_clean":"2024-09-10T22:24:23.133217+0000","last_became_active":"2024-09-10T22:24:22.140780+0000","last_became_peered":"2024-09-10T22:24:22.140780+0000","last_unstale":"2024-09-10T22:24:23.133217+0000","last_undegraded":"2024-09-10T22:24:23.133217+0000","last_fullsized":"2024-09-10T22:24:23.133217+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_clean_scrub_stamp":"2024-09-10T22:24:21.113844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:25:21.302463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T22:24:23.150586+0000","last_change":"2024-09-10T22:24:22.146772+0000","last_active":"2024-09-10T22:24:23.150586+0000","last_peered":"2024-09-10T22:24:23.150586+0000","last_clean":"2024-09-10T22:24:23.150586+0000","last_became_active":"2024-09-10T22:24:22.146317+0000","last_became_peered":"2024-09-10T22:24:22.146317+0000","last_unstale":"2024-09-10T22:24:23.150586+0000","last_undegraded":"2024-09-10T22:24:23.150586+0000","last_fullsized":"2024-09-10T22:24:23.150586+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_clean_scrub_stamp":"2024-09-10T22:24:21.113844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:13:55.706482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T22:24:23.147957+0000","last_change":"2024-09-10T22:24:22.139791+0000","last_active":"2024-09-10T22:24:23.147957+0000","last_peered":"2024-09-10T22:24:23.147957+0000","last_clean":"2024-09-10T22:24:23.147957+0000","last_became_active":"2024-09-10T22:24:22.139491+0000","last_became_peered":"2024-09-10T22:24:22.139491+0000","last_unstale":"2024-09-10T22:24:23.147957+0000","last_undegraded":"2024-09-10T22:24:23.147957+0000","last_fullsized":"2024-09-10T22:24:23.147957+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_clean_scrub_stamp":"2024-09-10T22:24:21.113844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:18:29.412412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T22:24:23.149665+0000","last_change":"2024-09-10T22:24:22.143383+0000","last_active":"2024-09-10T22:24:23.149665+0000","last_peered":"2024-09-10T22:24:23.149665+0000","last_clean":"2024-09-10T22:24:23.149665+0000","last_became_active":"2024-09-10T22:24:22.143045+0000","last_became_peered":"2024-09-10T22:24:22.143045+0000","last_unstale":"2024-09-10T22:24:23.149665+0000","last_undegraded":"2024-09-10T22:24:23.149665+0000","last_fullsized":"2024-09-10T22:24:23.149665+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_clean_scrub_stamp":"2024-09-10T22:24:21.113844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:37:10.135448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T22:24:23.148838+0000","last_change":"2024-09-10T22:24:22.141851+0000","last_active":"2024-09-10T22:24:23.148838+0000","last_peered":"2024-09-10T22:24:23.148838+0000","last_clean":"2024-09-10T22:24:23.148838+0000","last_became_active":"2024-09-10T22:24:22.141469+0000","last_became_peered":"2024-09-10T22:24:22.141469+0000","last_unstale":"2024-09-10T22:24:23.148838+0000","last_undegraded":"2024-09-10T22:24:23.148838+0000","last_fullsized":"2024-09-10T22:24:23.148838+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_clean_scrub_stamp":"2024-09-10T22:24:21.113844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:03:59.805704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T22:24:23.136351+0000","last_change":"2024-09-10T22:24:22.139821+0000","last_active":"2024-09-10T22:24:23.136351+0000","last_peered":"2024-09-10T22:24:23.136351+0000","last_clean":"2024-09-10T22:24:23.136351+0000","last_became_active":"2024-09-10T22:24:22.139398+0000","last_became_peered":"2024-09-10T22:24:22.139398+0000","last_unstale":"2024-09-10T22:24:23.136351+0000","last_undegraded":"2024-09-10T22:24:23.136351+0000","last_fullsized":"2024-09-10T22:24:23.136351+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_clean_scrub_stamp":"2024-09-10T22:24:21.113844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:18:22.160919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T22:24:23.150147+0000","last_change":"2024-09-10T22:24:22.141219+0000","last_active":"2024-09-10T22:24:23.150147+0000","last_peered":"2024-09-10T22:24:23.150147+0000","last_clean":"2024-09-10T22:24:23.150147+0000","last_became_active":"2024-09-10T22:24:22.140900+0000","last_became_peered":"2024-09-10T22:24:22.140900+0000","last_unstale":"2024-09-10T22:24:23.150147+0000","last_undegraded":"2024-09-10T22:24:23.150147+0000","last_fullsized":"2024-09-10T22:24:23.150147+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_clean_scrub_stamp":"2024-09-10T22:24:21.113844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:27:59.115533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T22:24:23.133152+0000","last_change":"2024-09-10T22:24:22.139738+0000","last_active":"2024-09-10T22:24:23.133152+0000","last_peered":"2024-09-10T22:24:23.133152+0000","last_clean":"2024-09-10T22:24:23.133152+0000","last_became_active":"2024-09-10T22:24:22.139096+0000","last_became_peered":"2024-09-10T22:24:22.139096+0000","last_unstale":"2024-09-10T22:24:23.133152+0000","last_undegraded":"2024-09-10T22:24:23.133152+0000","last_fullsized":"2024-09-10T22:24:23.133152+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_clean_scrub_stamp":"2024-09-10T22:24:21.113844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:16:39.110610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T22:24:23.151587+0000","last_change":"2024-09-10T22:24:22.144896+0000","last_active":"2024-09-10T22:24:23.151587+0000","last_peered":"2024-09-10T22:24:23.151587+0000","last_clean":"2024-09-10T22:24:23.151587+0000","last_became_active":"2024-09-10T22:24:22.144622+0000","last_became_peered":"2024-09-10T22:24:22.144622+0000","last_unstale":"2024-09-10T22:24:23.151587+0000","last_undegraded":"2024-09-10T22:24:23.151587+0000","last_fullsized":"2024-09-10T22:24:23.151587+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_clean_scrub_stamp":"2024-09-10T22:24:21.113844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:32:44.648993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T22:24:23.135925+0000","last_change":"2024-09-10T22:24:22.148082+0000","last_active":"2024-09-10T22:24:23.135925+0000","last_peered":"2024-09-10T22:24:23.135925+0000","last_clean":"2024-09-10T22:24:23.135925+0000","last_became_active":"2024-09-10T22:24:22.147664+0000","last_became_peered":"2024-09-10T22:24:22.147664+0000","last_unstale":"2024-09-10T22:24:23.135925+0000","last_undegraded":"2024-09-10T22:24:23.135925+0000","last_fullsized":"2024-09-10T22:24:23.135925+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_clean_scrub_stamp":"2024-09-10T22:24:21.113844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:12:40.154756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T22:24:23.135961+0000","last_change":"2024-09-10T22:24:22.145166+0000","last_active":"2024-09-10T22:24:23.135961+0000","last_peered":"2024-09-10T22:24:23.135961+0000","last_clean":"2024-09-10T22:24:23.135961+0000","last_became_active":"2024-09-10T22:24:22.144857+0000","last_became_peered":"2024-09-10T22:24:22.144857+0000","last_unstale":"2024-09-10T22:24:23.135961+0000","last_undegraded":"2024-09-10T22:24:23.135961+0000","last_fullsized":"2024-09-10T22:24:23.135961+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_clean_scrub_stamp":"2024-09-10T22:24:21.113844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:05:03.284376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T22:24:23.150292+0000","last_change":"2024-09-10T22:24:22.141534+0000","last_active":"2024-09-10T22:24:23.150292+0000","last_peered":"2024-09-10T22:24:23.150292+0000","last_clean":"2024-09-10T22:24:23.150292+0000","last_became_active":"2024-09-10T22:24:22.141243+0000","last_became_peered":"2024-09-10T22:24:22.141243+0000","last_unstale":"2024-09-10T22:24:23.150292+0000","last_undegraded":"2024-09-10T22:24:23.150292+0000","last_fullsized":"2024-09-10T22:24:23.150292+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_clean_scrub_stamp":"2024-09-10T22:24:21.113844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:26:23.559943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T22:24:23.147558+0000","last_change":"2024-09-10T22:24:22.144951+0000","last_active":"2024-09-10T22:24:23.147558+0000","last_peered":"2024-09-10T22:24:23.147558+0000","last_clean":"2024-09-10T22:24:23.147558+0000","last_became_active":"2024-09-10T22:24:22.144634+0000","last_became_peered":"2024-09-10T22:24:22.144634+0000","last_unstale":"2024-09-10T22:24:23.147558+0000","last_undegraded":"2024-09-10T22:24:23.147558+0000","last_fullsized":"2024-09-10T22:24:23.147558+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_clean_scrub_stamp":"2024-09-10T22:24:21.113844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:04:19.350081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"73'5","reported_seq":39,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T22:24:43.237523+0000","last_change":"2024-09-10T22:24:20.128083+0000","last_active":"2024-09-10T22:24:43.237523+0000","last_peered":"2024-09-10T22:24:43.237523+0000","last_clean":"2024-09-10T22:24:43.237523+0000","last_became_active":"2024-09-10T22:24:20.127676+0000","last_became_peered":"2024-09-10T22:24:20.127676+0000","last_unstale":"2024-09-10T22:24:43.237523+0000","last_undegraded":"2024-09-10T22:24:43.237523+0000","last_fullsized":"2024-09-10T22:24:43.237523+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:19.099039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:19.099039+0000","last_clean_scrub_stamp":"2024-09-10T22:24:19.099039+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:37:51.745817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":15,"num_read_kb":2,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T22:24:23.147760+0000","last_change":"2024-09-10T22:24:22.140193+0000","last_active":"2024-09-10T22:24:23.147760+0000","last_peered":"2024-09-10T22:24:23.147760+0000","last_clean":"2024-09-10T22:24:23.147760+0000","last_became_active":"2024-09-10T22:24:22.139897+0000","last_became_peered":"2024-09-10T22:24:22.139897+0000","last_unstale":"2024-09-10T22:24:23.147760+0000","last_undegraded":"2024-09-10T22:24:23.147760+0000","last_fullsized":"2024-09-10T22:24:23.147760+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_clean_scrub_stamp":"2024-09-10T22:24:21.113844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:13:54.235941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"73'3","reported_seq":22,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T22:24:31.212890+0000","last_change":"2024-09-10T22:24:20.124447+0000","last_active":"2024-09-10T22:24:31.212890+0000","last_peered":"2024-09-10T22:24:31.212890+0000","last_clean":"2024-09-10T22:24:31.212890+0000","last_became_active":"2024-09-10T22:24:20.124044+0000","last_became_peered":"2024-09-10T22:24:20.124044+0000","last_unstale":"2024-09-10T22:24:31.212890+0000","last_undegraded":"2024-09-10T22:24:31.212890+0000","last_fullsized":"2024-09-10T22:24:31.212890+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:19.099039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:19.099039+0000","last_clean_scrub_stamp":"2024-09-10T22:24:19.099039+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:07:27.533774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"73'2","reported_seq":21,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T22:24:31.211987+0000","last_change":"2024-09-10T22:24:20.122635+0000","last_active":"2024-09-10T22:24:31.211987+0000","last_peered":"2024-09-10T22:24:31.211987+0000","last_clean":"2024-09-10T22:24:31.211987+0000","last_became_active":"2024-09-10T22:24:20.122289+0000","last_became_peered":"2024-09-10T22:24:20.122289+0000","last_unstale":"2024-09-10T22:24:31.211987+0000","last_undegraded":"2024-09-10T22:24:31.211987+0000","last_fullsized":"2024-09-10T22:24:31.211987+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:19.099039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:19.099039+0000","last_clean_scrub_stamp":"2024-09-10T22:24:19.099039+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:30:40.779513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T22:24:23.147723+0000","last_change":"2024-09-10T22:24:22.137417+0000","last_active":"2024-09-10T22:24:23.147723+0000","last_peered":"2024-09-10T22:24:23.147723+0000","last_clean":"2024-09-10T22:24:23.147723+0000","last_became_active":"2024-09-10T22:24:22.136913+0000","last_became_peered":"2024-09-10T22:24:22.136913+0000","last_unstale":"2024-09-10T22:24:23.147723+0000","last_undegraded":"2024-09-10T22:24:23.147723+0000","last_fullsized":"2024-09-10T22:24:23.147723+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_clean_scrub_stamp":"2024-09-10T22:24:21.113844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:23:39.551056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"73'1","reported_seq":20,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T22:24:23.154070+0000","last_change":"2024-09-10T22:24:20.128416+0000","last_active":"2024-09-10T22:24:23.154070+0000","last_peered":"2024-09-10T22:24:23.154070+0000","last_clean":"2024-09-10T22:24:23.154070+0000","last_became_active":"2024-09-10T22:24:20.127998+0000","last_became_peered":"2024-09-10T22:24:20.127998+0000","last_unstale":"2024-09-10T22:24:23.154070+0000","last_undegraded":"2024-09-10T22:24:23.154070+0000","last_fullsized":"2024-09-10T22:24:23.154070+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:19.099039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:19.099039+0000","last_clean_scrub_stamp":"2024-09-10T22:24:19.099039+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:44:39.871564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T22:24:23.145910+0000","last_change":"2024-09-10T22:24:22.136355+0000","last_active":"2024-09-10T22:24:23.145910+0000","last_peered":"2024-09-10T22:24:23.145910+0000","last_clean":"2024-09-10T22:24:23.145910+0000","last_became_active":"2024-09-10T22:24:22.136047+0000","last_became_peered":"2024-09-10T22:24:22.136047+0000","last_unstale":"2024-09-10T22:24:23.145910+0000","last_undegraded":"2024-09-10T22:24:23.145910+0000","last_fullsized":"2024-09-10T22:24:23.145910+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_clean_scrub_stamp":"2024-09-10T22:24:21.113844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:56:14.739365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"73'3","reported_seq":36,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T22:24:44.238419+0000","last_change":"2024-09-10T22:24:20.125203+0000","last_active":"2024-09-10T22:24:44.238419+0000","last_peered":"2024-09-10T22:24:44.238419+0000","last_clean":"2024-09-10T22:24:44.238419+0000","last_became_active":"2024-09-10T22:24:20.124860+0000","last_became_peered":"2024-09-10T22:24:20.124860+0000","last_unstale":"2024-09-10T22:24:44.238419+0000","last_undegraded":"2024-09-10T22:24:44.238419+0000","last_fullsized":"2024-09-10T22:24:44.238419+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:19.099039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:19.099039+0000","last_clean_scrub_stamp":"2024-09-10T22:24:19.099039+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:20:03.886334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T22:24:23.150257+0000","last_change":"2024-09-10T22:24:22.143321+0000","last_active":"2024-09-10T22:24:23.150257+0000","last_peered":"2024-09-10T22:24:23.150257+0000","last_clean":"2024-09-10T22:24:23.150257+0000","last_became_active":"2024-09-10T22:24:22.143036+0000","last_became_peered":"2024-09-10T22:24:22.143036+0000","last_unstale":"2024-09-10T22:24:23.150257+0000","last_undegraded":"2024-09-10T22:24:23.150257+0000","last_fullsized":"2024-09-10T22:24:23.150257+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_clean_scrub_stamp":"2024-09-10T22:24:21.113844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:51:42.473300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"73'2","reported_seq":21,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T22:24:30.195657+0000","last_change":"2024-09-10T22:24:20.128026+0000","last_active":"2024-09-10T22:24:30.195657+0000","last_peered":"2024-09-10T22:24:30.195657+0000","last_clean":"2024-09-10T22:24:30.195657+0000","last_became_active":"2024-09-10T22:24:20.127445+0000","last_became_peered":"2024-09-10T22:24:20.127445+0000","last_unstale":"2024-09-10T22:24:30.195657+0000","last_undegraded":"2024-09-10T22:24:30.195657+0000","last_fullsized":"2024-09-10T22:24:30.195657+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:19.099039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:19.099039+0000","last_clean_scrub_stamp":"2024-09-10T22:24:19.099039+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:59:15.265157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T22:24:23.151321+0000","last_change":"2024-09-10T22:24:22.144830+0000","last_active":"2024-09-10T22:24:23.151321+0000","last_peered":"2024-09-10T22:24:23.151321+0000","last_clean":"2024-09-10T22:24:23.151321+0000","last_became_active":"2024-09-10T22:24:22.144358+0000","last_became_peered":"2024-09-10T22:24:22.144358+0000","last_unstale":"2024-09-10T22:24:23.151321+0000","last_undegraded":"2024-09-10T22:24:23.151321+0000","last_fullsized":"2024-09-10T22:24:23.151321+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_clean_scrub_stamp":"2024-09-10T22:24:21.113844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:28:14.398474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"73'4","reported_seq":24,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T22:24:30.197894+0000","last_change":"2024-09-10T22:24:20.383555+0000","last_active":"2024-09-10T22:24:30.197894+0000","last_peered":"2024-09-10T22:24:30.197894+0000","last_clean":"2024-09-10T22:24:30.197894+0000","last_became_active":"2024-09-10T22:24:20.383163+0000","last_became_peered":"2024-09-10T22:24:20.383163+0000","last_unstale":"2024-09-10T22:24:30.197894+0000","last_undegraded":"2024-09-10T22:24:30.197894+0000","last_fullsized":"2024-09-10T22:24:30.197894+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:19.099039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:19.099039+0000","last_clean_scrub_stamp":"2024-09-10T22:24:19.099039+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:14:03.052220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T22:24:23.149237+0000","last_change":"2024-09-10T22:24:22.144562+0000","last_active":"2024-09-10T22:24:23.149237+0000","last_peered":"2024-09-10T22:24:23.149237+0000","last_clean":"2024-09-10T22:24:23.149237+0000","last_became_active":"2024-09-10T22:24:22.144146+0000","last_became_peered":"2024-09-10T22:24:22.144146+0000","last_unstale":"2024-09-10T22:24:23.149237+0000","last_undegraded":"2024-09-10T22:24:23.149237+0000","last_fullsized":"2024-09-10T22:24:23.149237+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_clean_scrub_stamp":"2024-09-10T22:24:21.113844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:57:36.070289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"73'22","reported_seq":75,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T22:24:45.240027+0000","last_change":"2024-09-10T22:24:20.126245+0000","last_active":"2024-09-10T22:24:45.240027+0000","last_peered":"2024-09-10T22:24:45.240027+0000","last_clean":"2024-09-10T22:24:45.240027+0000","last_became_active":"2024-09-10T22:24:20.125839+0000","last_became_peered":"2024-09-10T22:24:20.125839+0000","last_unstale":"2024-09-10T22:24:45.240027+0000","last_undegraded":"2024-09-10T22:24:45.240027+0000","last_fullsized":"2024-09-10T22:24:45.240027+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:19.099039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:19.099039+0000","last_clean_scrub_stamp":"2024-09-10T22:24:19.099039+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:45:05.155436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46800,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":34,"num_read_kb":62,"num_write":23,"num_write_kb":52,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T22:24:23.147488+0000","last_change":"2024-09-10T22:24:22.142178+0000","last_active":"2024-09-10T22:24:23.147488+0000","last_peered":"2024-09-10T22:24:23.147488+0000","last_clean":"2024-09-10T22:24:23.147488+0000","last_became_active":"2024-09-10T22:24:22.141883+0000","last_became_peered":"2024-09-10T22:24:22.141883+0000","last_unstale":"2024-09-10T22:24:23.147488+0000","last_undegraded":"2024-09-10T22:24:23.147488+0000","last_fullsized":"2024-09-10T22:24:23.147488+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_clean_scrub_stamp":"2024-09-10T22:24:21.113844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:24:50.996273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"73'6","reported_seq":26,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T22:24:31.212406+0000","last_change":"2024-09-10T22:24:20.126129+0000","last_active":"2024-09-10T22:24:31.212406+0000","last_peered":"2024-09-10T22:24:31.212406+0000","last_clean":"2024-09-10T22:24:31.212406+0000","last_became_active":"2024-09-10T22:24:20.125749+0000","last_became_peered":"2024-09-10T22:24:20.125749+0000","last_unstale":"2024-09-10T22:24:31.212406+0000","last_undegraded":"2024-09-10T22:24:31.212406+0000","last_fullsized":"2024-09-10T22:24:31.212406+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:19.099039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:19.099039+0000","last_clean_scrub_stamp":"2024-09-10T22:24:19.099039+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:58:35.224036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T22:24:23.132892+0000","last_change":"2024-09-10T22:24:22.143964+0000","last_active":"2024-09-10T22:24:23.132892+0000","last_peered":"2024-09-10T22:24:23.132892+0000","last_clean":"2024-09-10T22:24:23.132892+0000","last_became_active":"2024-09-10T22:24:22.143589+0000","last_became_peered":"2024-09-10T22:24:22.143589+0000","last_unstale":"2024-09-10T22:24:23.132892+0000","last_undegraded":"2024-09-10T22:24:23.132892+0000","last_fullsized":"2024-09-10T22:24:23.132892+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_clean_scrub_stamp":"2024-09-10T22:24:21.113844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:41:41.737627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"73'3","reported_seq":22,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T22:24:30.197907+0000","last_change":"2024-09-10T22:24:20.128012+0000","last_active":"2024-09-10T22:24:30.197907+0000","last_peered":"2024-09-10T22:24:30.197907+0000","last_clean":"2024-09-10T22:24:30.197907+0000","last_became_active":"2024-09-10T22:24:20.127335+0000","last_became_peered":"2024-09-10T22:24:20.127335+0000","last_unstale":"2024-09-10T22:24:30.197907+0000","last_undegraded":"2024-09-10T22:24:30.197907+0000","last_fullsized":"2024-09-10T22:24:30.197907+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:19.099039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:19.099039+0000","last_clean_scrub_stamp":"2024-09-10T22:24:19.099039+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:20:27.017032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T22:24:23.133928+0000","last_change":"2024-09-10T22:24:22.145283+0000","last_active":"2024-09-10T22:24:23.133928+0000","last_peered":"2024-09-10T22:24:23.133928+0000","last_clean":"2024-09-10T22:24:23.133928+0000","last_became_active":"2024-09-10T22:24:22.142751+0000","last_became_peered":"2024-09-10T22:24:22.142751+0000","last_unstale":"2024-09-10T22:24:23.133928+0000","last_undegraded":"2024-09-10T22:24:23.133928+0000","last_fullsized":"2024-09-10T22:24:23.133928+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_clean_scrub_stamp":"2024-09-10T22:24:21.113844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:46:08.257983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"73'4","reported_seq":39,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T22:24:43.237007+0000","last_change":"2024-09-10T22:24:20.124069+0000","last_active":"2024-09-10T22:24:43.237007+0000","last_peered":"2024-09-10T22:24:43.237007+0000","last_clean":"2024-09-10T22:24:43.237007+0000","last_became_active":"2024-09-10T22:24:20.123675+0000","last_became_peered":"2024-09-10T22:24:20.123675+0000","last_unstale":"2024-09-10T22:24:43.237007+0000","last_undegraded":"2024-09-10T22:24:43.237007+0000","last_fullsized":"2024-09-10T22:24:43.237007+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:19.099039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:19.099039+0000","last_clean_scrub_stamp":"2024-09-10T22:24:19.099039+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:32:50.287012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":979,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":17,"num_read_kb":4,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T22:24:23.133812+0000","last_change":"2024-09-10T22:24:22.146870+0000","last_active":"2024-09-10T22:24:23.133812+0000","last_peered":"2024-09-10T22:24:23.133812+0000","last_clean":"2024-09-10T22:24:23.133812+0000","last_became_active":"2024-09-10T22:24:22.146615+0000","last_became_peered":"2024-09-10T22:24:22.146615+0000","last_unstale":"2024-09-10T22:24:23.133812+0000","last_undegraded":"2024-09-10T22:24:23.133812+0000","last_fullsized":"2024-09-10T22:24:23.133812+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_clean_scrub_stamp":"2024-09-10T22:24:21.113844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:00:05.579248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"73'15","reported_seq":35,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T22:24:31.214077+0000","last_change":"2024-09-10T22:24:20.383675+0000","last_active":"2024-09-10T22:24:31.214077+0000","last_peered":"2024-09-10T22:24:31.214077+0000","last_clean":"2024-09-10T22:24:31.214077+0000","last_became_active":"2024-09-10T22:24:20.383317+0000","last_became_peered":"2024-09-10T22:24:20.383317+0000","last_unstale":"2024-09-10T22:24:31.214077+0000","last_undegraded":"2024-09-10T22:24:31.214077+0000","last_fullsized":"2024-09-10T22:24:31.214077+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:19.099039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:19.099039+0000","last_clean_scrub_stamp":"2024-09-10T22:24:19.099039+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:43:24.989851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T22:24:23.149274+0000","last_change":"2024-09-10T22:24:22.144872+0000","last_active":"2024-09-10T22:24:23.149274+0000","last_peered":"2024-09-10T22:24:23.149274+0000","last_clean":"2024-09-10T22:24:23.149274+0000","last_became_active":"2024-09-10T22:24:22.144570+0000","last_became_peered":"2024-09-10T22:24:22.144570+0000","last_unstale":"2024-09-10T22:24:23.149274+0000","last_undegraded":"2024-09-10T22:24:23.149274+0000","last_fullsized":"2024-09-10T22:24:23.149274+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_clean_scrub_stamp":"2024-09-10T22:24:21.113844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:20:17.937544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"73'2","reported_seq":22,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T22:24:32.218581+0000","last_change":"2024-09-10T22:24:20.125849+0000","last_active":"2024-09-10T22:24:32.218581+0000","last_peered":"2024-09-10T22:24:32.218581+0000","last_clean":"2024-09-10T22:24:32.218581+0000","last_became_active":"2024-09-10T22:24:20.125042+0000","last_became_peered":"2024-09-10T22:24:20.125042+0000","last_unstale":"2024-09-10T22:24:32.218581+0000","last_undegraded":"2024-09-10T22:24:32.218581+0000","last_fullsized":"2024-09-10T22:24:32.218581+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:19.099039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:19.099039+0000","last_clean_scrub_stamp":"2024-09-10T22:24:19.099039+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:36:28.249115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T22:24:23.150301+0000","last_change":"2024-09-10T22:24:22.141232+0000","last_active":"2024-09-10T22:24:23.150301+0000","last_peered":"2024-09-10T22:24:23.150301+0000","last_clean":"2024-09-10T22:24:23.150301+0000","last_became_active":"2024-09-10T22:24:22.140903+0000","last_became_peered":"2024-09-10T22:24:22.140903+0000","last_unstale":"2024-09-10T22:24:23.150301+0000","last_undegraded":"2024-09-10T22:24:23.150301+0000","last_fullsized":"2024-09-10T22:24:23.150301+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_clean_scrub_stamp":"2024-09-10T22:24:21.113844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:15:11.627126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"73'2","reported_seq":21,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T22:24:23.146355+0000","last_change":"2024-09-10T22:24:20.122829+0000","last_active":"2024-09-10T22:24:23.146355+0000","last_peered":"2024-09-10T22:24:23.146355+0000","last_clean":"2024-09-10T22:24:23.146355+0000","last_became_active":"2024-09-10T22:24:20.122545+0000","last_became_peered":"2024-09-10T22:24:20.122545+0000","last_unstale":"2024-09-10T22:24:23.146355+0000","last_undegraded":"2024-09-10T22:24:23.146355+0000","last_fullsized":"2024-09-10T22:24:23.146355+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:19.099039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:19.099039+0000","last_clean_scrub_stamp":"2024-09-10T22:24:19.099039+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:18:27.758029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T22:24:23.134360+0000","last_change":"2024-09-10T22:24:22.139725+0000","last_active":"2024-09-10T22:24:23.134360+0000","last_peered":"2024-09-10T22:24:23.134360+0000","last_clean":"2024-09-10T22:24:23.134360+0000","last_became_active":"2024-09-10T22:24:22.139293+0000","last_became_peered":"2024-09-10T22:24:22.139293+0000","last_unstale":"2024-09-10T22:24:23.134360+0000","last_undegraded":"2024-09-10T22:24:23.134360+0000","last_fullsized":"2024-09-10T22:24:23.134360+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_clean_scrub_stamp":"2024-09-10T22:24:21.113844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:43:14.424880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"73'1","reported_seq":21,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T22:24:23.154966+0000","last_change":"2024-09-10T22:24:20.125371+0000","last_active":"2024-09-10T22:24:23.154966+0000","last_peered":"2024-09-10T22:24:23.154966+0000","last_clean":"2024-09-10T22:24:23.154966+0000","last_became_active":"2024-09-10T22:24:20.125033+0000","last_became_peered":"2024-09-10T22:24:20.125033+0000","last_unstale":"2024-09-10T22:24:23.154966+0000","last_undegraded":"2024-09-10T22:24:23.154966+0000","last_fullsized":"2024-09-10T22:24:23.154966+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:19.099039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:19.099039+0000","last_clean_scrub_stamp":"2024-09-10T22:24:19.099039+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:22:22.751778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"73'1","reported_seq":15,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T22:24:24.868932+0000","last_change":"2024-09-10T22:24:22.149522+0000","last_active":"2024-09-10T22:24:24.868932+0000","last_peered":"2024-09-10T22:24:24.868932+0000","last_clean":"2024-09-10T22:24:24.868932+0000","last_became_active":"2024-09-10T22:24:22.148710+0000","last_became_peered":"2024-09-10T22:24:22.148710+0000","last_unstale":"2024-09-10T22:24:24.868932+0000","last_undegraded":"2024-09-10T22:24:24.868932+0000","last_fullsized":"2024-09-10T22:24:24.868932+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_clean_scrub_stamp":"2024-09-10T22:24:21.113844+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:44:32.020949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"73'3","reported_seq":23,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T22:24:31.213032+0000","last_change":"2024-09-10T22:24:20.406792+0000","last_active":"2024-09-10T22:24:31.213032+0000","last_peered":"2024-09-10T22:24:31.213032+0000","last_clean":"2024-09-10T22:24:31.213032+0000","last_became_active":"2024-09-10T22:24:20.406437+0000","last_became_peered":"2024-09-10T22:24:20.406437+0000","last_unstale":"2024-09-10T22:24:31.213032+0000","last_undegraded":"2024-09-10T22:24:31.213032+0000","last_fullsized":"2024-09-10T22:24:31.213032+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:19.099039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:19.099039+0000","last_clean_scrub_stamp":"2024-09-10T22:24:19.099039+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:00:16.436165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T22:24:23.134366+0000","last_change":"2024-09-10T22:24:22.142335+0000","last_active":"2024-09-10T22:24:23.134366+0000","last_peered":"2024-09-10T22:24:23.134366+0000","last_clean":"2024-09-10T22:24:23.134366+0000","last_became_active":"2024-09-10T22:24:22.142001+0000","last_became_peered":"2024-09-10T22:24:22.142001+0000","last_unstale":"2024-09-10T22:24:23.134366+0000","last_undegraded":"2024-09-10T22:24:23.134366+0000","last_fullsized":"2024-09-10T22:24:23.134366+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_clean_scrub_stamp":"2024-09-10T22:24:21.113844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:46:20.043915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"19'92","reported_seq":91,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T22:24:23.133935+0000","last_change":"2024-09-10T22:23:11.163678+0000","last_active":"2024-09-10T22:24:23.133935+0000","last_peered":"2024-09-10T22:24:23.133935+0000","last_clean":"2024-09-10T22:24:23.133935+0000","last_became_active":"2024-09-10T22:23:11.158387+0000","last_became_peered":"2024-09-10T22:23:11.158387+0000","last_unstale":"2024-09-10T22:24:23.133935+0000","last_undegraded":"2024-09-10T22:24:23.133935+0000","last_fullsized":"2024-09-10T22:24:23.133935+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:19:50.906986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:19:50.906986+0000","last_clean_scrub_stamp":"2024-09-10T22:19:50.906986+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:11:31.570355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"73'3","reported_seq":24,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T22:24:32.217425+0000","last_change":"2024-09-10T22:24:20.123048+0000","last_active":"2024-09-10T22:24:32.217425+0000","last_peered":"2024-09-10T22:24:32.217425+0000","last_clean":"2024-09-10T22:24:32.217425+0000","last_became_active":"2024-09-10T22:24:20.121906+0000","last_became_peered":"2024-09-10T22:24:20.121906+0000","last_unstale":"2024-09-10T22:24:32.217425+0000","last_undegraded":"2024-09-10T22:24:32.217425+0000","last_fullsized":"2024-09-10T22:24:32.217425+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:19.099039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:19.099039+0000","last_clean_scrub_stamp":"2024-09-10T22:24:19.099039+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:11:00.293820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T22:24:23.148433+0000","last_change":"2024-09-10T22:24:22.146378+0000","last_active":"2024-09-10T22:24:23.148433+0000","last_peered":"2024-09-10T22:24:23.148433+0000","last_clean":"2024-09-10T22:24:23.148433+0000","last_became_active":"2024-09-10T22:24:22.145841+0000","last_became_peered":"2024-09-10T22:24:22.145841+0000","last_unstale":"2024-09-10T22:24:23.148433+0000","last_undegraded":"2024-09-10T22:24:23.148433+0000","last_fullsized":"2024-09-10T22:24:23.148433+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_clean_scrub_stamp":"2024-09-10T22:24:21.113844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:20:31.785243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"73'3","reported_seq":22,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T22:24:31.213604+0000","last_change":"2024-09-10T22:24:20.127483+0000","last_active":"2024-09-10T22:24:31.213604+0000","last_peered":"2024-09-10T22:24:31.213604+0000","last_clean":"2024-09-10T22:24:31.213604+0000","last_became_active":"2024-09-10T22:24:20.127149+0000","last_became_peered":"2024-09-10T22:24:20.127149+0000","last_unstale":"2024-09-10T22:24:31.213604+0000","last_undegraded":"2024-09-10T22:24:31.213604+0000","last_fullsized":"2024-09-10T22:24:31.213604+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:19.099039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:19.099039+0000","last_clean_scrub_stamp":"2024-09-10T22:24:19.099039+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:49:22.022872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T22:24:23.132688+0000","last_change":"2024-09-10T22:24:22.139850+0000","last_active":"2024-09-10T22:24:23.132688+0000","last_peered":"2024-09-10T22:24:23.132688+0000","last_clean":"2024-09-10T22:24:23.132688+0000","last_became_active":"2024-09-10T22:24:22.137885+0000","last_became_peered":"2024-09-10T22:24:22.137885+0000","last_unstale":"2024-09-10T22:24:23.132688+0000","last_undegraded":"2024-09-10T22:24:23.132688+0000","last_fullsized":"2024-09-10T22:24:23.132688+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_clean_scrub_stamp":"2024-09-10T22:24:21.113844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:52:55.988247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"73'4","reported_seq":36,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T22:24:43.236288+0000","last_change":"2024-09-10T22:24:20.383650+0000","last_active":"2024-09-10T22:24:43.236288+0000","last_peered":"2024-09-10T22:24:43.236288+0000","last_clean":"2024-09-10T22:24:43.236288+0000","last_became_active":"2024-09-10T22:24:20.383286+0000","last_became_peered":"2024-09-10T22:24:20.383286+0000","last_unstale":"2024-09-10T22:24:43.236288+0000","last_undegraded":"2024-09-10T22:24:43.236288+0000","last_fullsized":"2024-09-10T22:24:43.236288+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:19.099039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:19.099039+0000","last_clean_scrub_stamp":"2024-09-10T22:24:19.099039+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:38:04.467105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":13,"num_read_kb":13,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T22:24:23.152595+0000","last_change":"2024-09-10T22:24:22.141717+0000","last_active":"2024-09-10T22:24:23.152595+0000","last_peered":"2024-09-10T22:24:23.152595+0000","last_clean":"2024-09-10T22:24:23.152595+0000","last_became_active":"2024-09-10T22:24:22.141426+0000","last_became_peered":"2024-09-10T22:24:22.141426+0000","last_unstale":"2024-09-10T22:24:23.152595+0000","last_undegraded":"2024-09-10T22:24:23.152595+0000","last_fullsized":"2024-09-10T22:24:23.152595+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_clean_scrub_stamp":"2024-09-10T22:24:21.113844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:13:58.341345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"73'1","reported_seq":20,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T22:24:23.134397+0000","last_change":"2024-09-10T22:24:20.127658+0000","last_active":"2024-09-10T22:24:23.134397+0000","last_peered":"2024-09-10T22:24:23.134397+0000","last_clean":"2024-09-10T22:24:23.134397+0000","last_became_active":"2024-09-10T22:24:20.127366+0000","last_became_peered":"2024-09-10T22:24:20.127366+0000","last_unstale":"2024-09-10T22:24:23.134397+0000","last_undegraded":"2024-09-10T22:24:23.134397+0000","last_fullsized":"2024-09-10T22:24:23.134397+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:19.099039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:19.099039+0000","last_clean_scrub_stamp":"2024-09-10T22:24:19.099039+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:36:05.439417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T22:24:23.146268+0000","last_change":"2024-09-10T22:24:22.144799+0000","last_active":"2024-09-10T22:24:23.146268+0000","last_peered":"2024-09-10T22:24:23.146268+0000","last_clean":"2024-09-10T22:24:23.146268+0000","last_became_active":"2024-09-10T22:24:22.144543+0000","last_became_peered":"2024-09-10T22:24:22.144543+0000","last_unstale":"2024-09-10T22:24:23.146268+0000","last_undegraded":"2024-09-10T22:24:23.146268+0000","last_fullsized":"2024-09-10T22:24:23.146268+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_clean_scrub_stamp":"2024-09-10T22:24:21.113844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:45:46.193108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":19,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T22:24:23.145653+0000","last_change":"2024-09-10T22:24:20.383345+0000","last_active":"2024-09-10T22:24:23.145653+0000","last_peered":"2024-09-10T22:24:23.145653+0000","last_clean":"2024-09-10T22:24:23.145653+0000","last_became_active":"2024-09-10T22:24:20.383023+0000","last_became_peered":"2024-09-10T22:24:20.383023+0000","last_unstale":"2024-09-10T22:24:23.145653+0000","last_undegraded":"2024-09-10T22:24:23.145653+0000","last_fullsized":"2024-09-10T22:24:23.145653+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:19.099039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:19.099039+0000","last_clean_scrub_stamp":"2024-09-10T22:24:19.099039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:27:31.771060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"73'1","reported_seq":15,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T22:24:25.428471+0000","last_change":"2024-09-10T22:24:22.143130+0000","last_active":"2024-09-10T22:24:25.428471+0000","last_peered":"2024-09-10T22:24:25.428471+0000","last_clean":"2024-09-10T22:24:25.428471+0000","last_became_active":"2024-09-10T22:24:22.142664+0000","last_became_peered":"2024-09-10T22:24:22.142664+0000","last_unstale":"2024-09-10T22:24:25.428471+0000","last_undegraded":"2024-09-10T22:24:25.428471+0000","last_fullsized":"2024-09-10T22:24:25.428471+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_clean_scrub_stamp":"2024-09-10T22:24:21.113844+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:49:53.325307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"73'1","reported_seq":21,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T22:24:30.196224+0000","last_change":"2024-09-10T22:24:20.383795+0000","last_active":"2024-09-10T22:24:30.196224+0000","last_peered":"2024-09-10T22:24:30.196224+0000","last_clean":"2024-09-10T22:24:30.196224+0000","last_became_active":"2024-09-10T22:24:20.383418+0000","last_became_peered":"2024-09-10T22:24:20.383418+0000","last_unstale":"2024-09-10T22:24:30.196224+0000","last_undegraded":"2024-09-10T22:24:30.196224+0000","last_fullsized":"2024-09-10T22:24:30.196224+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:19.099039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:19.099039+0000","last_clean_scrub_stamp":"2024-09-10T22:24:19.099039+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:52:26.602544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T22:24:23.133146+0000","last_change":"2024-09-10T22:24:22.139416+0000","last_active":"2024-09-10T22:24:23.133146+0000","last_peered":"2024-09-10T22:24:23.133146+0000","last_clean":"2024-09-10T22:24:23.133146+0000","last_became_active":"2024-09-10T22:24:22.138648+0000","last_became_peered":"2024-09-10T22:24:22.138648+0000","last_unstale":"2024-09-10T22:24:23.133146+0000","last_undegraded":"2024-09-10T22:24:23.133146+0000","last_fullsized":"2024-09-10T22:24:23.133146+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_clean_scrub_stamp":"2024-09-10T22:24:21.113844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:12:20.064134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"73'7","reported_seq":26,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T22:24:41.146402+0000","last_change":"2024-09-10T22:24:20.124001+0000","last_active":"2024-09-10T22:24:41.146402+0000","last_peered":"2024-09-10T22:24:41.146402+0000","last_clean":"2024-09-10T22:24:41.146402+0000","last_became_active":"2024-09-10T22:24:20.123616+0000","last_became_peered":"2024-09-10T22:24:20.123616+0000","last_unstale":"2024-09-10T22:24:41.146402+0000","last_undegraded":"2024-09-10T22:24:41.146402+0000","last_fullsized":"2024-09-10T22:24:41.146402+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:19.099039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:19.099039+0000","last_clean_scrub_stamp":"2024-09-10T22:24:19.099039+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:12:47.003561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T22:24:23.149127+0000","last_change":"2024-09-10T22:24:22.146936+0000","last_active":"2024-09-10T22:24:23.149127+0000","last_peered":"2024-09-10T22:24:23.149127+0000","last_clean":"2024-09-10T22:24:23.149127+0000","last_became_active":"2024-09-10T22:24:22.146578+0000","last_became_peered":"2024-09-10T22:24:22.146578+0000","last_unstale":"2024-09-10T22:24:23.149127+0000","last_undegraded":"2024-09-10T22:24:23.149127+0000","last_fullsized":"2024-09-10T22:24:23.149127+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_clean_scrub_stamp":"2024-09-10T22:24:21.113844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:44:20.229747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"73'4","reported_seq":23,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T22:24:30.197681+0000","last_change":"2024-09-10T22:24:20.406642+0000","last_active":"2024-09-10T22:24:30.197681+0000","last_peered":"2024-09-10T22:24:30.197681+0000","last_clean":"2024-09-10T22:24:30.197681+0000","last_became_active":"2024-09-10T22:24:20.406288+0000","last_became_peered":"2024-09-10T22:24:20.406288+0000","last_unstale":"2024-09-10T22:24:30.197681+0000","last_undegraded":"2024-09-10T22:24:30.197681+0000","last_fullsized":"2024-09-10T22:24:30.197681+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:19.099039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:19.099039+0000","last_clean_scrub_stamp":"2024-09-10T22:24:19.099039+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:10:48.558751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T22:24:23.151867+0000","last_change":"2024-09-10T22:24:22.142511+0000","last_active":"2024-09-10T22:24:23.151867+0000","last_peered":"2024-09-10T22:24:23.151867+0000","last_clean":"2024-09-10T22:24:23.151867+0000","last_became_active":"2024-09-10T22:24:22.142200+0000","last_became_peered":"2024-09-10T22:24:22.142200+0000","last_unstale":"2024-09-10T22:24:23.151867+0000","last_undegraded":"2024-09-10T22:24:23.151867+0000","last_fullsized":"2024-09-10T22:24:23.151867+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_clean_scrub_stamp":"2024-09-10T22:24:21.113844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:09:46.928679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"73'2","reported_seq":21,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T22:24:30.195765+0000","last_change":"2024-09-10T22:24:20.383403+0000","last_active":"2024-09-10T22:24:30.195765+0000","last_peered":"2024-09-10T22:24:30.195765+0000","last_clean":"2024-09-10T22:24:30.195765+0000","last_became_active":"2024-09-10T22:24:20.383143+0000","last_became_peered":"2024-09-10T22:24:20.383143+0000","last_unstale":"2024-09-10T22:24:30.195765+0000","last_undegraded":"2024-09-10T22:24:30.195765+0000","last_fullsized":"2024-09-10T22:24:30.195765+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:19.099039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:19.099039+0000","last_clean_scrub_stamp":"2024-09-10T22:24:19.099039+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:54:07.338628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T22:24:23.148484+0000","last_change":"2024-09-10T22:24:22.136604+0000","last_active":"2024-09-10T22:24:23.148484+0000","last_peered":"2024-09-10T22:24:23.148484+0000","last_clean":"2024-09-10T22:24:23.148484+0000","last_became_active":"2024-09-10T22:24:22.136298+0000","last_became_peered":"2024-09-10T22:24:22.136298+0000","last_unstale":"2024-09-10T22:24:23.148484+0000","last_undegraded":"2024-09-10T22:24:23.148484+0000","last_fullsized":"2024-09-10T22:24:23.148484+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_clean_scrub_stamp":"2024-09-10T22:24:21.113844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:39:11.777729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"73'3","reported_seq":22,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T22:24:30.196571+0000","last_change":"2024-09-10T22:24:20.124911+0000","last_active":"2024-09-10T22:24:30.196571+0000","last_peered":"2024-09-10T22:24:30.196571+0000","last_clean":"2024-09-10T22:24:30.196571+0000","last_became_active":"2024-09-10T22:24:20.124152+0000","last_became_peered":"2024-09-10T22:24:20.124152+0000","last_unstale":"2024-09-10T22:24:30.196571+0000","last_undegraded":"2024-09-10T22:24:30.196571+0000","last_fullsized":"2024-09-10T22:24:30.196571+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:19.099039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:19.099039+0000","last_clean_scrub_stamp":"2024-09-10T22:24:19.099039+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:32:30.837104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T22:24:23.150504+0000","last_change":"2024-09-10T22:24:22.138080+0000","last_active":"2024-09-10T22:24:23.150504+0000","last_peered":"2024-09-10T22:24:23.150504+0000","last_clean":"2024-09-10T22:24:23.150504+0000","last_became_active":"2024-09-10T22:24:22.137775+0000","last_became_peered":"2024-09-10T22:24:22.137775+0000","last_unstale":"2024-09-10T22:24:23.150504+0000","last_undegraded":"2024-09-10T22:24:23.150504+0000","last_fullsized":"2024-09-10T22:24:23.150504+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_clean_scrub_stamp":"2024-09-10T22:24:21.113844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:10:48.320495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"73'1","reported_seq":20,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T22:24:23.135992+0000","last_change":"2024-09-10T22:24:20.125551+0000","last_active":"2024-09-10T22:24:23.135992+0000","last_peered":"2024-09-10T22:24:23.135992+0000","last_clean":"2024-09-10T22:24:23.135992+0000","last_became_active":"2024-09-10T22:24:20.125064+0000","last_became_peered":"2024-09-10T22:24:20.125064+0000","last_unstale":"2024-09-10T22:24:23.135992+0000","last_undegraded":"2024-09-10T22:24:23.135992+0000","last_fullsized":"2024-09-10T22:24:23.135992+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:19.099039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:19.099039+0000","last_clean_scrub_stamp":"2024-09-10T22:24:19.099039+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:29:48.598158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T22:24:23.148300+0000","last_change":"2024-09-10T22:24:22.142894+0000","last_active":"2024-09-10T22:24:23.148300+0000","last_peered":"2024-09-10T22:24:23.148300+0000","last_clean":"2024-09-10T22:24:23.148300+0000","last_became_active":"2024-09-10T22:24:22.142554+0000","last_became_peered":"2024-09-10T22:24:22.142554+0000","last_unstale":"2024-09-10T22:24:23.148300+0000","last_undegraded":"2024-09-10T22:24:23.148300+0000","last_fullsized":"2024-09-10T22:24:23.148300+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_clean_scrub_stamp":"2024-09-10T22:24:21.113844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:11:11.457622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"73'4","reported_seq":24,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T22:24:30.197958+0000","last_change":"2024-09-10T22:24:20.128212+0000","last_active":"2024-09-10T22:24:30.197958+0000","last_peered":"2024-09-10T22:24:30.197958+0000","last_clean":"2024-09-10T22:24:30.197958+0000","last_became_active":"2024-09-10T22:24:20.127597+0000","last_became_peered":"2024-09-10T22:24:20.127597+0000","last_unstale":"2024-09-10T22:24:30.197958+0000","last_undegraded":"2024-09-10T22:24:30.197958+0000","last_fullsized":"2024-09-10T22:24:30.197958+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:19.099039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:19.099039+0000","last_clean_scrub_stamp":"2024-09-10T22:24:19.099039+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:48:28.543222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T22:24:23.134526+0000","last_change":"2024-09-10T22:24:22.144321+0000","last_active":"2024-09-10T22:24:23.134526+0000","last_peered":"2024-09-10T22:24:23.134526+0000","last_clean":"2024-09-10T22:24:23.134526+0000","last_became_active":"2024-09-10T22:24:22.144037+0000","last_became_peered":"2024-09-10T22:24:22.144037+0000","last_unstale":"2024-09-10T22:24:23.134526+0000","last_undegraded":"2024-09-10T22:24:23.134526+0000","last_fullsized":"2024-09-10T22:24:23.134526+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_clean_scrub_stamp":"2024-09-10T22:24:21.113844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:28:00.600758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T22:24:23.149693+0000","last_change":"2024-09-10T22:24:22.145574+0000","last_active":"2024-09-10T22:24:23.149693+0000","last_peered":"2024-09-10T22:24:23.149693+0000","last_clean":"2024-09-10T22:24:23.149693+0000","last_became_active":"2024-09-10T22:24:22.144425+0000","last_became_peered":"2024-09-10T22:24:22.144425+0000","last_unstale":"2024-09-10T22:24:23.149693+0000","last_undegraded":"2024-09-10T22:24:23.149693+0000","last_fullsized":"2024-09-10T22:24:23.149693+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_clean_scrub_stamp":"2024-09-10T22:24:21.113844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:41:10.177782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"73'2","reported_seq":21,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T22:24:23.155618+0000","last_change":"2024-09-10T22:24:20.124627+0000","last_active":"2024-09-10T22:24:23.155618+0000","last_peered":"2024-09-10T22:24:23.155618+0000","last_clean":"2024-09-10T22:24:23.155618+0000","last_became_active":"2024-09-10T22:24:20.124174+0000","last_became_peered":"2024-09-10T22:24:20.124174+0000","last_unstale":"2024-09-10T22:24:23.155618+0000","last_undegraded":"2024-09-10T22:24:23.155618+0000","last_fullsized":"2024-09-10T22:24:23.155618+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:19.099039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:19.099039+0000","last_clean_scrub_stamp":"2024-09-10T22:24:19.099039+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:35:26.871316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T22:24:23.149018+0000","last_change":"2024-09-10T22:24:22.142531+0000","last_active":"2024-09-10T22:24:23.149018+0000","last_peered":"2024-09-10T22:24:23.149018+0000","last_clean":"2024-09-10T22:24:23.149018+0000","last_became_active":"2024-09-10T22:24:22.142240+0000","last_became_peered":"2024-09-10T22:24:22.142240+0000","last_unstale":"2024-09-10T22:24:23.149018+0000","last_undegraded":"2024-09-10T22:24:23.149018+0000","last_fullsized":"2024-09-10T22:24:23.149018+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_clean_scrub_stamp":"2024-09-10T22:24:21.113844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:30:56.868586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"73'4","reported_seq":23,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T22:24:31.212105+0000","last_change":"2024-09-10T22:24:20.129745+0000","last_active":"2024-09-10T22:24:31.212105+0000","last_peered":"2024-09-10T22:24:31.212105+0000","last_clean":"2024-09-10T22:24:31.212105+0000","last_became_active":"2024-09-10T22:24:20.129397+0000","last_became_peered":"2024-09-10T22:24:20.129397+0000","last_unstale":"2024-09-10T22:24:31.212105+0000","last_undegraded":"2024-09-10T22:24:31.212105+0000","last_fullsized":"2024-09-10T22:24:31.212105+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:19.099039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:19.099039+0000","last_clean_scrub_stamp":"2024-09-10T22:24:19.099039+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:16:15.263977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T22:24:23.151265+0000","last_change":"2024-09-10T22:24:22.141121+0000","last_active":"2024-09-10T22:24:23.151265+0000","last_peered":"2024-09-10T22:24:23.151265+0000","last_clean":"2024-09-10T22:24:23.151265+0000","last_became_active":"2024-09-10T22:24:22.140490+0000","last_became_peered":"2024-09-10T22:24:22.140490+0000","last_unstale":"2024-09-10T22:24:23.151265+0000","last_undegraded":"2024-09-10T22:24:23.151265+0000","last_fullsized":"2024-09-10T22:24:23.151265+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_clean_scrub_stamp":"2024-09-10T22:24:21.113844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:52:22.840740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"73'2","reported_seq":21,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T22:24:23.644041+0000","last_change":"2024-09-10T22:24:20.385053+0000","last_active":"2024-09-10T22:24:23.644041+0000","last_peered":"2024-09-10T22:24:23.644041+0000","last_clean":"2024-09-10T22:24:23.644041+0000","last_became_active":"2024-09-10T22:24:20.384432+0000","last_became_peered":"2024-09-10T22:24:20.384432+0000","last_unstale":"2024-09-10T22:24:23.644041+0000","last_undegraded":"2024-09-10T22:24:23.644041+0000","last_fullsized":"2024-09-10T22:24:23.644041+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:19.099039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:19.099039+0000","last_clean_scrub_stamp":"2024-09-10T22:24:19.099039+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:18:15.685331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T22:24:23.149036+0000","last_change":"2024-09-10T22:24:22.143884+0000","last_active":"2024-09-10T22:24:23.149036+0000","last_peered":"2024-09-10T22:24:23.149036+0000","last_clean":"2024-09-10T22:24:23.149036+0000","last_became_active":"2024-09-10T22:24:22.143446+0000","last_became_peered":"2024-09-10T22:24:22.143446+0000","last_unstale":"2024-09-10T22:24:23.149036+0000","last_undegraded":"2024-09-10T22:24:23.149036+0000","last_fullsized":"2024-09-10T22:24:23.149036+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_clean_scrub_stamp":"2024-09-10T22:24:21.113844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:28:32.453668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"73'9","reported_seq":29,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T22:24:31.214189+0000","last_change":"2024-09-10T22:24:20.126454+0000","last_active":"2024-09-10T22:24:31.214189+0000","last_peered":"2024-09-10T22:24:31.214189+0000","last_clean":"2024-09-10T22:24:31.214189+0000","last_became_active":"2024-09-10T22:24:20.126120+0000","last_became_peered":"2024-09-10T22:24:20.126120+0000","last_unstale":"2024-09-10T22:24:31.214189+0000","last_undegraded":"2024-09-10T22:24:31.214189+0000","last_fullsized":"2024-09-10T22:24:31.214189+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:19.099039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:19.099039+0000","last_clean_scrub_stamp":"2024-09-10T22:24:19.099039+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:26:04.013260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":50801,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":106,"num_read_kb":108,"num_write":149,"num_write_kb":92,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":380928,"data_stored":152403,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":128,"ondisk_log_size":128,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4751360,"data_stored":4722944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":92,"ondisk_log_size":92,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":67,"seq":287762808849,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27792,"kb_used_data":768,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717360,"statfs":{"total":95995035648,"available":95966576640,"internally_reserved":0,"allocated":786432,"data_stored":379816,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":62,"seq":266287972374,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36780,"kb_used_data":1436,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708372,"statfs":{"total":95995035648,"available":95957372928,"internally_reserved":0,"allocated":1470464,"data_stored":1018488,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":36174272},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":57,"seq":244813135898,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27808,"kb_used_data":784,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717344,"statfs":{"total":95995035648,"available":95966560256,"internally_reserved":0,"allocated":802816,"data_stored":380052,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":51,"seq":219043332127,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27808,"kb_used_data":784,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717344,"statfs":{"total":95995035648,"available":95966560256,"internally_reserved":0,"allocated":802816,"data_stored":379972,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":46,"seq":197568495653,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36708,"kb_used_data":1364,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708444,"statfs":{"total":95995035648,"available":95957446656,"internally_reserved":0,"allocated":1396736,"data_stored":971902,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":36174282},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":40,"seq":171798691882,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27796,"kb_used_data":772,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717356,"statfs":{"total":95995035648,"available":95966572544,"internally_reserved":0,"allocated":790528,"data_stored":379441,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":34,"seq":146028888110,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28400,"kb_used_data":1376,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716752,"statfs":{"total":95995035648,"available":95965954048,"internally_reserved":0,"allocated":1409024,"data_stored":971195,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":29,"seq":124554051635,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27800,"kb_used_data":776,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717352,"statfs":{"total":95995035648,"available":95966568448,"internally_reserved":0,"allocated":794624,"data_stored":380269,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":23,"seq":98784247864,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27812,"kb_used_data":788,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717340,"statfs":{"total":95995035648,"available":95966556160,"internally_reserved":0,"allocated":806912,"data_stored":379752,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444095,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36188,"kb_used_data":844,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708964,"statfs":{"total":95995035648,"available":95957979136,"internally_reserved":0,"allocated":864256,"data_stored":427384,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":12,"seq":51539607619,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36164,"kb_used_data":820,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708988,"statfs":{"total":95995035648,"available":95958003712,"internally_reserved":0,"allocated":839680,"data_stored":426034,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738441,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36136,"kb_used_data":792,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93709016,"statfs":{"total":95995035648,"available":95958032384,"internally_reserved":0,"allocated":811008,"data_stored":380712,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":46800,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":48150,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1035,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1476,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2183,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":48769,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-10T22:24:49.679 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2024-09-10T22:24:49.680 INFO:tasks.cephadm:Setting up client nodes... 2024-09-10T22:24:49.680 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 22997a4c-6fc2-11ef-bcea-c7b262605968 -- ceph auth get-or-create client.0 mon 'allow *' osd 'allow *' mds 'allow *' mgr 'allow *' 2024-09-10T22:24:49.776 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:24:49 smithi138 ceph-mon[35236]: pgmap v295: 97 pgs: 97 active+clean; 626 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 4.7 KiB/s wr, 7 op/s 2024-09-10T22:24:49.776 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:24:49 smithi138 ceph-mon[35236]: from='client.14883 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-10T22:24:49.859 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:24:49 smithi135 ceph-mon[34789]: pgmap v295: 97 pgs: 97 active+clean; 626 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 4.7 KiB/s wr, 7 op/s 2024-09-10T22:24:49.860 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:24:49 smithi135 ceph-mon[34789]: from='client.14883 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-10T22:24:49.939 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/22997a4c-6fc2-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T22:24:50.469 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:50.446+0000 7f11764a2640 1 -- 172.21.15.19:0/1474743052 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1170102a20 msgr2=0x7f1170102e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:24:50.469 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:50.446+0000 7f11764a2640 1 --2- 172.21.15.19:0/1474743052 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1170102a20 0x7f1170102e20 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f1160009930 tx=0x7f116002a420 comp rx=0 tx=0).stop 2024-09-10T22:24:50.469 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:50.446+0000 7f11764a2640 1 -- 172.21.15.19:0/1474743052 shutdown_connections 2024-09-10T22:24:50.469 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:50.446+0000 7f11764a2640 1 --2- 172.21.15.19:0/1474743052 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1170104540 0x7f117010aec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:24:50.469 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:50.446+0000 7f11764a2640 1 --2- 172.21.15.19:0/1474743052 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f1170103b80 0x7f1170104000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:24:50.470 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:50.446+0000 7f11764a2640 1 --2- 172.21.15.19:0/1474743052 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1170102a20 0x7f1170102e20 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:24:50.470 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:50.446+0000 7f11764a2640 1 -- 172.21.15.19:0/1474743052 >> 172.21.15.19:0/1474743052 conn(0x7f11700fe2f0 msgr2=0x7f1170100730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:24:50.470 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:50.446+0000 7f11764a2640 1 -- 172.21.15.19:0/1474743052 shutdown_connections 2024-09-10T22:24:50.470 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:50.446+0000 7f11764a2640 1 -- 172.21.15.19:0/1474743052 wait complete. 2024-09-10T22:24:50.470 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:50.446+0000 7f11764a2640 1 Processor -- start 2024-09-10T22:24:50.470 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:50.446+0000 7f11764a2640 1 -- start start 2024-09-10T22:24:50.470 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:50.447+0000 7f11764a2640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1170102a20 0x7f1170076cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:24:50.470 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:50.447+0000 7f11764a2640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1170103b80 0x7f1170075540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:24:50.470 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:50.447+0000 7f11764a2640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f1170104540 0x7f1170075a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:24:50.470 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:50.447+0000 7f11764a2640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f117010e680 con 0x7f1170103b80 2024-09-10T22:24:50.470 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:50.447+0000 7f11764a2640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f117010e500 con 0x7f1170102a20 2024-09-10T22:24:50.470 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:50.447+0000 7f11764a2640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f117010e800 con 0x7f1170104540 2024-09-10T22:24:50.471 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:50.447+0000 7f116f7fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1170103b80 0x7f1170075540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:24:50.471 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:50.447+0000 7f116f7fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1170103b80 0x7f1170075540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:51628/0 (socket says 172.21.15.19:51628) 2024-09-10T22:24:50.471 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:50.447+0000 7f116f7fe640 1 -- 172.21.15.19:0/441826130 learned_addr learned my addr 172.21.15.19:0/441826130 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:24:50.471 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:50.447+0000 7f116ffff640 1 --2- 172.21.15.19:0/441826130 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1170102a20 0x7f1170076cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:24:50.471 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:50.447+0000 7f1174a3f640 1 --2- 172.21.15.19:0/441826130 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f1170104540 0x7f1170075a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:24:50.471 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:50.447+0000 7f116f7fe640 1 -- 172.21.15.19:0/441826130 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f1170104540 msgr2=0x7f1170075a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:24:50.471 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:50.447+0000 7f116f7fe640 1 --2- 172.21.15.19:0/441826130 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f1170104540 0x7f1170075a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:24:50.471 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:50.447+0000 7f116f7fe640 1 -- 172.21.15.19:0/441826130 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1170102a20 msgr2=0x7f1170076cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:24:50.471 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:50.447+0000 7f116f7fe640 1 --2- 172.21.15.19:0/441826130 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1170102a20 0x7f1170076cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:24:50.471 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:50.447+0000 7f116f7fe640 1 -- 172.21.15.19:0/441826130 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1170076340 con 0x7f1170103b80 2024-09-10T22:24:50.471 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:50.447+0000 7f116f7fe640 1 --2- 172.21.15.19:0/441826130 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1170103b80 0x7f1170075540 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f116400c920 tx=0x7f116400cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:24:50.472 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:50.447+0000 7f116d7fa640 1 -- 172.21.15.19:0/441826130 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1164007c70 con 0x7f1170103b80 2024-09-10T22:24:50.472 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:50.447+0000 7f11764a2640 1 -- 172.21.15.19:0/441826130 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f11701a2e10 con 0x7f1170103b80 2024-09-10T22:24:50.472 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:50.447+0000 7f116d7fa640 1 -- 172.21.15.19:0/441826130 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1164007e10 con 0x7f1170103b80 2024-09-10T22:24:50.472 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:50.447+0000 7f116d7fa640 1 -- 172.21.15.19:0/441826130 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1164018820 con 0x7f1170103b80 2024-09-10T22:24:50.472 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:50.448+0000 7f11764a2640 1 -- 172.21.15.19:0/441826130 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f11701a32c0 con 0x7f1170103b80 2024-09-10T22:24:50.472 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:50.448+0000 7f11764a2640 1 -- 172.21.15.19:0/441826130 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1170109d40 con 0x7f1170103b80 2024-09-10T22:24:50.472 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:50.450+0000 7f116d7fa640 1 -- 172.21.15.19:0/441826130 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 17) ==== 153301+0+0 (secure 0 0 0) 0x7f116400f450 con 0x7f1170103b80 2024-09-10T22:24:50.472 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:50.451+0000 7f116d7fa640 1 --2- 172.21.15.19:0/441826130 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f11580b5370 0x7f11580b7830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:24:50.472 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:50.451+0000 7f116ffff640 1 --2- 172.21.15.19:0/441826130 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f11580b5370 0x7f11580b7830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:24:50.472 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:50.451+0000 7f116d7fa640 1 -- 172.21.15.19:0/441826130 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 7979+0+0 (secure 0 0 0) 0x7f11640e5c10 con 0x7f1170103b80 2024-09-10T22:24:50.472 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:50.451+0000 7f116ffff640 1 --2- 172.21.15.19:0/441826130 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f11580b5370 0x7f11580b7830 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f1160009900 tx=0x7f1160031430 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:24:50.472 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:50.455+0000 7f116d7fa640 1 -- 172.21.15.19:0/441826130 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f1164014030 con 0x7f1170103b80 2024-09-10T22:24:50.713 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:50.711+0000 7f11764a2640 1 -- 172.21.15.19:0/441826130 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} v 0) -- 0x7f117002e5c0 con 0x7f1170103b80 2024-09-10T22:24:50.715 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:50.713+0000 7f116d7fa640 1 -- 172.21.15.19:0/441826130 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]=0 v32) ==== 170+0+59 (secure 0 0 0) 0x7f11640acb20 con 0x7f1170103b80 2024-09-10T22:24:50.715 INFO:teuthology.orchestra.run.smithi019.stdout:[client.0] 2024-09-10T22:24:50.715 INFO:teuthology.orchestra.run.smithi019.stdout: key = AQAyx+Bm0x1/KhAATx6c4vwBRLxhb6rfH95GxA== 2024-09-10T22:24:50.717 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:50.716+0000 7f11764a2640 1 -- 172.21.15.19:0/441826130 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f11580b5370 msgr2=0x7f11580b7830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:24:50.717 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:50.716+0000 7f11764a2640 1 --2- 172.21.15.19:0/441826130 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f11580b5370 0x7f11580b7830 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f1160009900 tx=0x7f1160031430 comp rx=0 tx=0).stop 2024-09-10T22:24:50.717 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:50.716+0000 7f11764a2640 1 -- 172.21.15.19:0/441826130 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1170103b80 msgr2=0x7f1170075540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:24:50.717 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:50.716+0000 7f11764a2640 1 --2- 172.21.15.19:0/441826130 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1170103b80 0x7f1170075540 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f116400c920 tx=0x7f116400cde0 comp rx=0 tx=0).stop 2024-09-10T22:24:50.717 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:50.716+0000 7f11764a2640 1 -- 172.21.15.19:0/441826130 shutdown_connections 2024-09-10T22:24:50.718 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:50.716+0000 7f11764a2640 1 --2- 172.21.15.19:0/441826130 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f11580b5370 0x7f11580b7830 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:24:50.718 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:50.716+0000 7f11764a2640 1 --2- 172.21.15.19:0/441826130 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f1170104540 0x7f1170075a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:24:50.718 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:50.716+0000 7f11764a2640 1 --2- 172.21.15.19:0/441826130 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1170103b80 0x7f1170075540 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:24:50.718 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:50.716+0000 7f11764a2640 1 --2- 172.21.15.19:0/441826130 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1170102a20 0x7f1170076cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:24:50.718 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:50.716+0000 7f11764a2640 1 -- 172.21.15.19:0/441826130 >> 172.21.15.19:0/441826130 conn(0x7f11700fe2f0 msgr2=0x7f1170106f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:24:50.718 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:50.716+0000 7f11764a2640 1 -- 172.21.15.19:0/441826130 shutdown_connections 2024-09-10T22:24:50.718 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:50.716+0000 7f11764a2640 1 -- 172.21.15.19:0/441826130 wait complete. 2024-09-10T22:24:51.384 DEBUG:teuthology.orchestra.run.smithi019:> set -ex 2024-09-10T22:24:51.384 DEBUG:teuthology.orchestra.run.smithi019:> sudo dd of=/etc/ceph/ceph.client.0.keyring 2024-09-10T22:24:51.384 DEBUG:teuthology.orchestra.run.smithi019:> sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-09-10T22:24:51.426 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 22997a4c-6fc2-11ef-bcea-c7b262605968 -- ceph config log 1 --format=json 2024-09-10T22:24:51.490 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:24:51 smithi019 ceph-mon[31375]: pgmap v296: 97 pgs: 97 active+clean; 626 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 4.7 KiB/s wr, 9 op/s 2024-09-10T22:24:51.490 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:24:51 smithi019 ceph-mon[31375]: from='client.? 172.21.15.19:0/441826130' entity='client.admin' cmd={"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} : dispatch 2024-09-10T22:24:51.490 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:24:51 smithi019 ceph-mon[31375]: from='client.? 172.21.15.19:0/441826130' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-09-10T22:24:51.727 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/22997a4c-6fc2-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T22:24:51.859 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:24:51 smithi135 ceph-mon[34789]: pgmap v296: 97 pgs: 97 active+clean; 626 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 4.7 KiB/s wr, 9 op/s 2024-09-10T22:24:51.860 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:24:51 smithi135 ceph-mon[34789]: from='client.? 172.21.15.19:0/441826130' entity='client.admin' cmd={"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} : dispatch 2024-09-10T22:24:51.860 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:24:51 smithi135 ceph-mon[34789]: from='client.? 172.21.15.19:0/441826130' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-09-10T22:24:51.875 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:24:51 smithi138 ceph-mon[35236]: pgmap v296: 97 pgs: 97 active+clean; 626 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 4.7 KiB/s wr, 9 op/s 2024-09-10T22:24:51.875 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:24:51 smithi138 ceph-mon[35236]: from='client.? 172.21.15.19:0/441826130' entity='client.admin' cmd={"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} : dispatch 2024-09-10T22:24:51.875 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:24:51 smithi138 ceph-mon[35236]: from='client.? 172.21.15.19:0/441826130' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-09-10T22:24:52.153 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:52.145+0000 7fd35fa62640 1 -- 172.21.15.19:0/569606094 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd3581131c0 msgr2=0x7fd358113600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:24:52.153 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:52.145+0000 7fd35fa62640 1 --2- 172.21.15.19:0/569606094 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd3581131c0 0x7fd358113600 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fd348009900 tx=0x7fd34802a410 comp rx=0 tx=0).stop 2024-09-10T22:24:52.153 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:52.145+0000 7fd35fa62640 1 -- 172.21.15.19:0/569606094 shutdown_connections 2024-09-10T22:24:52.153 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:52.145+0000 7fd35fa62640 1 --2- 172.21.15.19:0/569606094 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd358113b40 0x7fd35811a340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:24:52.153 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:52.145+0000 7fd35fa62640 1 --2- 172.21.15.19:0/569606094 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd3581131c0 0x7fd358113600 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:24:52.154 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:52.145+0000 7fd35fa62640 1 --2- 172.21.15.19:0/569606094 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd35810d800 0x7fd35810dbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:24:52.154 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:52.145+0000 7fd35fa62640 1 -- 172.21.15.19:0/569606094 >> 172.21.15.19:0/569606094 conn(0x7fd35806dce0 msgr2=0x7fd35806e0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:24:52.154 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:52.145+0000 7fd35fa62640 1 -- 172.21.15.19:0/569606094 shutdown_connections 2024-09-10T22:24:52.154 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:52.145+0000 7fd35fa62640 1 -- 172.21.15.19:0/569606094 wait complete. 2024-09-10T22:24:52.154 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:52.146+0000 7fd35fa62640 1 Processor -- start 2024-09-10T22:24:52.154 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:52.146+0000 7fd35fa62640 1 -- start start 2024-09-10T22:24:52.154 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:52.146+0000 7fd35fa62640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd35810d800 0x7fd3581a3e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:24:52.154 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:52.146+0000 7fd35fa62640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd3581131c0 0x7fd3581a4380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:24:52.154 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:52.146+0000 7fd35fa62640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd358113b40 0x7fd3581a9720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:24:52.154 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:52.146+0000 7fd35fa62640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fd35811d890 con 0x7fd3581131c0 2024-09-10T22:24:52.154 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:52.146+0000 7fd35fa62640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fd35811d710 con 0x7fd35810d800 2024-09-10T22:24:52.154 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:52.146+0000 7fd35fa62640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7fd35811da10 con 0x7fd358113b40 2024-09-10T22:24:52.155 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:52.146+0000 7fd35cffd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd3581131c0 0x7fd3581a4380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:24:52.155 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:52.146+0000 7fd35cffd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd3581131c0 0x7fd3581a4380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:51642/0 (socket says 172.21.15.19:51642) 2024-09-10T22:24:52.155 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:52.146+0000 7fd35cffd640 1 -- 172.21.15.19:0/1687587153 learned_addr learned my addr 172.21.15.19:0/1687587153 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:24:52.155 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:52.146+0000 7fd35d7fe640 1 --2- 172.21.15.19:0/1687587153 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd35810d800 0x7fd3581a3e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:24:52.155 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:52.146+0000 7fd35cffd640 1 -- 172.21.15.19:0/1687587153 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd358113b40 msgr2=0x7fd3581a9720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:24:52.155 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:52.147+0000 7fd35cffd640 1 --2- 172.21.15.19:0/1687587153 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd358113b40 0x7fd3581a9720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:24:52.155 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:52.147+0000 7fd35cffd640 1 -- 172.21.15.19:0/1687587153 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd35810d800 msgr2=0x7fd3581a3e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:24:52.155 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:52.147+0000 7fd35cffd640 1 --2- 172.21.15.19:0/1687587153 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd35810d800 0x7fd3581a3e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:24:52.155 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:52.147+0000 7fd35cffd640 1 -- 172.21.15.19:0/1687587153 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd3581a9ef0 con 0x7fd3581131c0 2024-09-10T22:24:52.155 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:52.147+0000 7fd35d7fe640 1 --2- 172.21.15.19:0/1687587153 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd35810d800 0x7fd3581a3e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T22:24:52.155 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:52.147+0000 7fd35cffd640 1 --2- 172.21.15.19:0/1687587153 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd3581131c0 0x7fd3581a4380 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fd348005ab0 tx=0x7fd348003d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:24:52.155 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:52.147+0000 7fd34e7fc640 1 -- 172.21.15.19:0/1687587153 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd34803f070 con 0x7fd3581131c0 2024-09-10T22:24:52.155 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:52.147+0000 7fd35fa62640 1 -- 172.21.15.19:0/1687587153 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd3581aa180 con 0x7fd3581131c0 2024-09-10T22:24:52.155 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:52.147+0000 7fd34e7fc640 1 -- 172.21.15.19:0/1687587153 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd348031d60 con 0x7fd3581131c0 2024-09-10T22:24:52.156 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:52.147+0000 7fd34e7fc640 1 -- 172.21.15.19:0/1687587153 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd348035030 con 0x7fd3581131c0 2024-09-10T22:24:52.156 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:52.147+0000 7fd35fa62640 1 -- 172.21.15.19:0/1687587153 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd3581b08a0 con 0x7fd3581131c0 2024-09-10T22:24:52.156 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:52.148+0000 7fd35fa62640 1 -- 172.21.15.19:0/1687587153 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd35810dc60 con 0x7fd3581131c0 2024-09-10T22:24:52.156 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:52.149+0000 7fd34e7fc640 1 -- 172.21.15.19:0/1687587153 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 17) ==== 153301+0+0 (secure 0 0 0) 0x7fd34803b560 con 0x7fd3581131c0 2024-09-10T22:24:52.156 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:52.150+0000 7fd34e7fc640 1 --2- 172.21.15.19:0/1687587153 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7fd3440b5370 0x7fd3440b7830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:24:52.156 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:52.150+0000 7fd35d7fe640 1 --2- 172.21.15.19:0/1687587153 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7fd3440b5370 0x7fd3440b7830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:24:52.156 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:52.150+0000 7fd34e7fc640 1 -- 172.21.15.19:0/1687587153 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 7979+0+0 (secure 0 0 0) 0x7fd3481069c0 con 0x7fd3581131c0 2024-09-10T22:24:52.156 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:52.151+0000 7fd35d7fe640 1 --2- 172.21.15.19:0/1687587153 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7fd3440b5370 0x7fd3440b7830 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fd354009930 tx=0x7fd354008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:24:52.157 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:52.156+0000 7fd34e7fc640 1 -- 172.21.15.19:0/1687587153 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7fd3480cd8d0 con 0x7fd3581131c0 2024-09-10T22:24:52.343 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:52.342+0000 7fd35fa62640 1 -- 172.21.15.19:0/1687587153 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "config log", "num": 1, "format": "json"} v 0) -- 0x7fd358115390 con 0x7fd3581131c0 2024-09-10T22:24:52.343 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:52.342+0000 7fd34e7fc640 1 -- 172.21.15.19:0/1687587153 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "config log", "num": 1, "format": "json"}]=0 v49) ==== 86+0+133 (secure 0 0 0) 0x7fd3480cd1d0 con 0x7fd3581131c0 2024-09-10T22:24:52.344 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-10T22:24:52.345 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:52.344+0000 7fd35fa62640 1 -- 172.21.15.19:0/1687587153 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7fd3440b5370 msgr2=0x7fd3440b7830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:24:52.345 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:52.344+0000 7fd35fa62640 1 --2- 172.21.15.19:0/1687587153 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7fd3440b5370 0x7fd3440b7830 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fd354009930 tx=0x7fd354008040 comp rx=0 tx=0).stop 2024-09-10T22:24:52.346 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:52.344+0000 7fd35fa62640 1 -- 172.21.15.19:0/1687587153 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd3581131c0 msgr2=0x7fd3581a4380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:24:52.346 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:52.344+0000 7fd35fa62640 1 --2- 172.21.15.19:0/1687587153 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd3581131c0 0x7fd3581a4380 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fd348005ab0 tx=0x7fd348003d50 comp rx=0 tx=0).stop 2024-09-10T22:24:52.346 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:52.344+0000 7fd35fa62640 1 -- 172.21.15.19:0/1687587153 shutdown_connections 2024-09-10T22:24:52.346 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:52.344+0000 7fd35fa62640 1 --2- 172.21.15.19:0/1687587153 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7fd3440b5370 0x7fd3440b7830 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:24:52.346 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:52.344+0000 7fd35fa62640 1 --2- 172.21.15.19:0/1687587153 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd358113b40 0x7fd3581a9720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:24:52.346 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:52.344+0000 7fd35fa62640 1 --2- 172.21.15.19:0/1687587153 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd3581131c0 0x7fd3581a4380 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:24:52.346 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:52.344+0000 7fd35fa62640 1 --2- 172.21.15.19:0/1687587153 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd35810d800 0x7fd3581a3e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:24:52.346 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:52.344+0000 7fd35fa62640 1 -- 172.21.15.19:0/1687587153 >> 172.21.15.19:0/1687587153 conn(0x7fd35806dce0 msgr2=0x7fd3581111b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:24:52.346 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:52.344+0000 7fd35fa62640 1 -- 172.21.15.19:0/1687587153 shutdown_connections 2024-09-10T22:24:52.346 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:52.344+0000 7fd35fa62640 1 -- 172.21.15.19:0/1687587153 wait complete. 2024-09-10T22:24:52.708 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:24:52 smithi019 ceph-mon[31375]: from='client.? 172.21.15.19:0/1687587153' entity='client.admin' cmd={"prefix": "config log", "num": 1, "format": "json"} : dispatch 2024-09-10T22:24:52.859 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:24:52 smithi135 ceph-mon[34789]: from='client.? 172.21.15.19:0/1687587153' entity='client.admin' cmd={"prefix": "config log", "num": 1, "format": "json"} : dispatch 2024-09-10T22:24:52.875 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:24:52 smithi138 ceph-mon[35236]: from='client.? 172.21.15.19:0/1687587153' entity='client.admin' cmd={"prefix": "config log", "num": 1, "format": "json"} : dispatch 2024-09-10T22:24:53.004 INFO:teuthology.orchestra.run.smithi019.stdout:[{"version":49,"timestamp":"2024-09-10T22:24:12.537124+0000","name":"","changes":[{"name":"mds.all/mds_join_fs","new_value":"all"}]}] 2024-09-10T22:24:53.005 INFO:tasks.ceph_manager:config epoch is 49 2024-09-10T22:24:53.005 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-09-10T22:24:53.005 INFO:tasks.cephadm.ceph_manager.ceph:waiting for mgr available 2024-09-10T22:24:53.005 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 22997a4c-6fc2-11ef-bcea-c7b262605968 -- ceph mgr dump --format=json 2024-09-10T22:24:53.306 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/22997a4c-6fc2-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T22:24:53.708 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:24:53 smithi019 ceph-mon[31375]: pgmap v297: 97 pgs: 97 active+clean; 634 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 7.8 KiB/s rd, 5.2 KiB/s wr, 9 op/s 2024-09-10T22:24:53.734 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:53.733+0000 7f2415e75640 1 -- 172.21.15.19:0/3714225269 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2410101c90 msgr2=0x7f2410102070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:24:53.734 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:53.733+0000 7f2415e75640 1 --2- 172.21.15.19:0/3714225269 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2410101c90 0x7f2410102070 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f2400009ca0 tx=0x7f240002a8c0 comp rx=0 tx=0).stop 2024-09-10T22:24:53.734 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:53.733+0000 7f2415e75640 1 -- 172.21.15.19:0/3714225269 shutdown_connections 2024-09-10T22:24:53.734 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:53.733+0000 7f2415e75640 1 --2- 172.21.15.19:0/3714225269 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f2410108020 0x7f241010e820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:24:53.735 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:53.733+0000 7f2415e75640 1 --2- 172.21.15.19:0/3714225269 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f24101076a0 0x7f2410107ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:24:53.735 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:53.733+0000 7f2415e75640 1 --2- 172.21.15.19:0/3714225269 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2410101c90 0x7f2410102070 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:24:53.735 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:53.733+0000 7f2415e75640 1 -- 172.21.15.19:0/3714225269 >> 172.21.15.19:0/3714225269 conn(0x7f24100fd700 msgr2=0x7f24100ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:24:53.735 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:53.733+0000 7f2415e75640 1 -- 172.21.15.19:0/3714225269 shutdown_connections 2024-09-10T22:24:53.735 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:53.733+0000 7f2415e75640 1 -- 172.21.15.19:0/3714225269 wait complete. 2024-09-10T22:24:53.737 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:53.733+0000 7f2415e75640 1 Processor -- start 2024-09-10T22:24:53.737 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:53.734+0000 7f2415e75640 1 -- start start 2024-09-10T22:24:53.737 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:53.734+0000 7f2415e75640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2410101c90 0x7f2410199270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:24:53.737 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:53.734+0000 7f2415e75640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f24101076a0 0x7f24101997b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:24:53.737 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:53.734+0000 7f2415e75640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f2410108020 0x7f241019eb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:24:53.737 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:53.734+0000 7f2415e75640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f2410111ce0 con 0x7f24101076a0 2024-09-10T22:24:53.737 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:53.734+0000 7f2415e75640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f2410111b60 con 0x7f2410101c90 2024-09-10T22:24:53.737 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:53.734+0000 7f2415e75640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f2410111e60 con 0x7f2410108020 2024-09-10T22:24:53.738 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:53.734+0000 7f240effd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f24101076a0 0x7f24101997b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:24:53.738 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:53.734+0000 7f240effd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f24101076a0 0x7f24101997b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:41432/0 (socket says 172.21.15.19:41432) 2024-09-10T22:24:53.738 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:53.734+0000 7f240effd640 1 -- 172.21.15.19:0/3337290585 learned_addr learned my addr 172.21.15.19:0/3337290585 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:24:53.738 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:53.734+0000 7f240f7fe640 1 --2- 172.21.15.19:0/3337290585 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2410101c90 0x7f2410199270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:24:53.738 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:53.734+0000 7f240ffff640 1 --2- 172.21.15.19:0/3337290585 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f2410108020 0x7f241019eb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:24:53.738 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:53.734+0000 7f240effd640 1 -- 172.21.15.19:0/3337290585 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f2410108020 msgr2=0x7f241019eb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:24:53.738 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:53.734+0000 7f240effd640 1 --2- 172.21.15.19:0/3337290585 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f2410108020 0x7f241019eb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:24:53.738 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:53.734+0000 7f240effd640 1 -- 172.21.15.19:0/3337290585 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2410101c90 msgr2=0x7f2410199270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:24:53.738 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:53.734+0000 7f240effd640 1 --2- 172.21.15.19:0/3337290585 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2410101c90 0x7f2410199270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:24:53.738 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:53.734+0000 7f240effd640 1 -- 172.21.15.19:0/3337290585 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f241019f320 con 0x7f24101076a0 2024-09-10T22:24:53.738 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:53.734+0000 7f240ffff640 1 --2- 172.21.15.19:0/3337290585 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f2410108020 0x7f241019eb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T22:24:53.739 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:53.735+0000 7f240effd640 1 --2- 172.21.15.19:0/3337290585 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f24101076a0 0x7f24101997b0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f23f800c920 tx=0x7f23f800cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:24:53.739 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:53.735+0000 7f240cff9640 1 -- 172.21.15.19:0/3337290585 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23f8007c70 con 0x7f24101076a0 2024-09-10T22:24:53.739 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:53.735+0000 7f2415e75640 1 -- 172.21.15.19:0/3337290585 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f241019f610 con 0x7f24101076a0 2024-09-10T22:24:53.739 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:53.735+0000 7f240cff9640 1 -- 172.21.15.19:0/3337290585 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f23f8007e10 con 0x7f24101076a0 2024-09-10T22:24:53.739 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:53.735+0000 7f240cff9640 1 -- 172.21.15.19:0/3337290585 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23f8018820 con 0x7f24101076a0 2024-09-10T22:24:53.739 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:53.735+0000 7f2415e75640 1 -- 172.21.15.19:0/3337290585 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f24101a5ea0 con 0x7f24101076a0 2024-09-10T22:24:53.739 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:53.736+0000 7f2415e75640 1 -- 172.21.15.19:0/3337290585 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2410102070 con 0x7f24101076a0 2024-09-10T22:24:53.740 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:53.737+0000 7f240cff9640 1 -- 172.21.15.19:0/3337290585 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 17) ==== 153301+0+0 (secure 0 0 0) 0x7f23f800f450 con 0x7f24101076a0 2024-09-10T22:24:53.740 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:53.738+0000 7f240cff9640 1 --2- 172.21.15.19:0/3337290585 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f23fc0b5370 0x7f23fc0b7830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:24:53.740 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:53.738+0000 7f240f7fe640 1 --2- 172.21.15.19:0/3337290585 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f23fc0b5370 0x7f23fc0b7830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:24:53.740 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:53.738+0000 7f240cff9640 1 -- 172.21.15.19:0/3337290585 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 7979+0+0 (secure 0 0 0) 0x7f23f80e6130 con 0x7f24101076a0 2024-09-10T22:24:53.740 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:53.739+0000 7f240f7fe640 1 --2- 172.21.15.19:0/3337290585 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f23fc0b5370 0x7f23fc0b7830 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f2400000f80 tx=0x7f2400005ef0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:24:53.742 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:53.741+0000 7f240cff9640 1 -- 172.21.15.19:0/3337290585 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f23f8014030 con 0x7f24101076a0 2024-09-10T22:24:53.860 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:24:53 smithi135 ceph-mon[34789]: pgmap v297: 97 pgs: 97 active+clean; 634 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 7.8 KiB/s rd, 5.2 KiB/s wr, 9 op/s 2024-09-10T22:24:53.875 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:24:53 smithi138 ceph-mon[35236]: pgmap v297: 97 pgs: 97 active+clean; 634 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 7.8 KiB/s rd, 5.2 KiB/s wr, 9 op/s 2024-09-10T22:24:53.977 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:53.975+0000 7f2415e75640 1 -- 172.21.15.19:0/3337290585 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) -- 0x7f241019a3a0 con 0x7f24101076a0 2024-09-10T22:24:53.981 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:53.980+0000 7f240cff9640 1 -- 172.21.15.19:0/3337290585 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v17) ==== 74+0+294216 (secure 0 0 0) 0x7f23f80acfd0 con 0x7f24101076a0 2024-09-10T22:24:53.988 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-10T22:24:53.991 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:53.983+0000 7f2415e75640 1 -- 172.21.15.19:0/3337290585 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f23fc0b5370 msgr2=0x7f23fc0b7830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:24:53.991 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:53.983+0000 7f2415e75640 1 --2- 172.21.15.19:0/3337290585 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f23fc0b5370 0x7f23fc0b7830 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f2400000f80 tx=0x7f2400005ef0 comp rx=0 tx=0).stop 2024-09-10T22:24:53.992 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:53.983+0000 7f2415e75640 1 -- 172.21.15.19:0/3337290585 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f24101076a0 msgr2=0x7f24101997b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:24:53.992 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:53.983+0000 7f2415e75640 1 --2- 172.21.15.19:0/3337290585 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f24101076a0 0x7f24101997b0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f23f800c920 tx=0x7f23f800cde0 comp rx=0 tx=0).stop 2024-09-10T22:24:53.992 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:53.983+0000 7f2415e75640 1 -- 172.21.15.19:0/3337290585 shutdown_connections 2024-09-10T22:24:53.992 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:53.983+0000 7f2415e75640 1 --2- 172.21.15.19:0/3337290585 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f23fc0b5370 0x7f23fc0b7830 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:24:53.992 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:53.983+0000 7f2415e75640 1 --2- 172.21.15.19:0/3337290585 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f2410108020 0x7f241019eb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:24:53.992 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:53.983+0000 7f2415e75640 1 --2- 172.21.15.19:0/3337290585 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f24101076a0 0x7f24101997b0 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:24:53.992 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:53.983+0000 7f2415e75640 1 --2- 172.21.15.19:0/3337290585 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2410101c90 0x7f2410199270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:24:53.992 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:53.983+0000 7f2415e75640 1 -- 172.21.15.19:0/3337290585 >> 172.21.15.19:0/3337290585 conn(0x7f24100fd700 msgr2=0x7f241006ad50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:24:53.992 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:53.983+0000 7f2415e75640 1 -- 172.21.15.19:0/3337290585 shutdown_connections 2024-09-10T22:24:53.992 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:53.983+0000 7f2415e75640 1 -- 172.21.15.19:0/3337290585 wait complete. 2024-09-10T22:24:54.607 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:24:54 smithi019 ceph-mon[31375]: from='client.? 172.21.15.19:0/3337290585' entity='client.admin' cmd={"prefix": "mgr dump", "format": "json"} : dispatch 2024-09-10T22:24:54.638 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":17,"flags":0,"active_gid":14150,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6800","nonce":2119495487},{"type":"v1","addr":"172.21.15.19:6801","nonce":2119495487}]},"active_addr":"172.21.15.19:6801/2119495487","active_change":"2024-09-10T22:17:04.260933+0000","active_mgr_features":4540719139924082687,"available":true,"standbys":[{"gid":24112,"name":"z","mgr_features":4540719139924082687,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to, use commas to separate multiple","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.27.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:10.4.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_nginx":{"name":"container_image_nginx","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nginx:1.26.1","min":"","max":"","enum_allowed":[],"desc":"Nginx container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.7.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.17","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_oauth2_proxy":{"name":"container_image_oauth2_proxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/oauth2-proxy/oauth2-proxy:v7.6.0","min":"","max":"","enum_allowed":[],"desc":"oauth2-proxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.51.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba_metrics":{"name":"container_image_samba_metrics","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-metrics:latest","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB metrics exporter container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_requests":{"name":"max_requests","type":"int","level":"advanced","flags":0,"default_value":"500","min":"","max":"","enum_allowed":[],"desc":"Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number.if un-finished request is removed, error message will be logged in the ceph-mgr log.","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"smb","can_run":true,"error_string":"","module_options":{"internal_store_backend":{"name":"internal_store_backend","type":"str","level":"dev","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"set internal store backend. for develoment and testing only","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_orchestration":{"name":"update_orchestration","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically update orchestration when smb resources are changed","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]},{"gid":24125,"name":"y","mgr_features":4540719139924082687,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to, use commas to separate multiple","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.27.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:10.4.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_nginx":{"name":"container_image_nginx","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nginx:1.26.1","min":"","max":"","enum_allowed":[],"desc":"Nginx container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.7.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.17","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_oauth2_proxy":{"name":"container_image_oauth2_proxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/oauth2-proxy/oauth2-proxy:v7.6.0","min":"","max":"","enum_allowed":[],"desc":"oauth2-proxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.51.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba_metrics":{"name":"container_image_samba_metrics","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-metrics:latest","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB metrics exporter container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_requests":{"name":"max_requests","type":"int","level":"advanced","flags":0,"default_value":"500","min":"","max":"","enum_allowed":[],"desc":"Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number.if un-finished request is removed, error message will be logged in the ceph-mgr log.","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"smb","can_run":true,"error_string":"","module_options":{"internal_store_backend":{"name":"internal_store_backend","type":"str","level":"dev","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"set internal store backend. for develoment and testing only","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_orchestration":{"name":"update_orchestration","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically update orchestration when smb resources are changed","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["cephadm","dashboard","iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to, use commas to separate multiple","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.27.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:10.4.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_nginx":{"name":"container_image_nginx","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nginx:1.26.1","min":"","max":"","enum_allowed":[],"desc":"Nginx container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.7.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.17","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_oauth2_proxy":{"name":"container_image_oauth2_proxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/oauth2-proxy/oauth2-proxy:v7.6.0","min":"","max":"","enum_allowed":[],"desc":"oauth2-proxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.51.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba_metrics":{"name":"container_image_samba_metrics","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-metrics:latest","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB metrics exporter container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_requests":{"name":"max_requests","type":"int","level":"advanced","flags":0,"default_value":"500","min":"","max":"","enum_allowed":[],"desc":"Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number.if un-finished request is removed, error message will be logged in the ceph-mgr log.","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"smb","can_run":true,"error_string":"","module_options":{"internal_store_backend":{"name":"internal_store_backend","type":"str","level":"dev","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"set internal store backend. for develoment and testing only","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_orchestration":{"name":"update_orchestration","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically update orchestration when smb resources are changed","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{"dashboard":"https://172.21.15.19:8443/"},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"force_disabled_modules":{},"last_failure_osd_epoch":3,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.19:0","nonce":1451695278}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.19:0","nonce":1827569890}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.19:0","nonce":2750748567}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.19:0","nonce":3734673187}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.19:0","nonce":1704692936}]}]} 2024-09-10T22:24:54.643 INFO:tasks.cephadm.ceph_manager.ceph:mgr available! 2024-09-10T22:24:54.643 INFO:tasks.cephadm.ceph_manager.ceph:waiting for all up 2024-09-10T22:24:54.643 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 22997a4c-6fc2-11ef-bcea-c7b262605968 -- ceph osd dump --format=json 2024-09-10T22:24:54.859 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:24:54 smithi135 ceph-mon[34789]: from='client.? 172.21.15.19:0/3337290585' entity='client.admin' cmd={"prefix": "mgr dump", "format": "json"} : dispatch 2024-09-10T22:24:54.875 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:24:54 smithi138 ceph-mon[35236]: from='client.? 172.21.15.19:0/3337290585' entity='client.admin' cmd={"prefix": "mgr dump", "format": "json"} : dispatch 2024-09-10T22:24:54.902 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/22997a4c-6fc2-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T22:24:55.404 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:55.384+0000 7eff771a7640 1 -- 172.21.15.19:0/1676941297 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7eff70102dc0 msgr2=0x7eff701031a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:24:55.404 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:55.384+0000 7eff771a7640 1 --2- 172.21.15.19:0/1676941297 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7eff70102dc0 0x7eff701031a0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7eff58009900 tx=0x7eff5802a410 comp rx=0 tx=0).stop 2024-09-10T22:24:55.404 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:55.384+0000 7eff771a7640 1 -- 172.21.15.19:0/1676941297 shutdown_connections 2024-09-10T22:24:55.405 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:55.384+0000 7eff771a7640 1 --2- 172.21.15.19:0/1676941297 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7eff70109150 0x7eff7010f950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:24:55.405 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:55.384+0000 7eff771a7640 1 --2- 172.21.15.19:0/1676941297 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7eff701087d0 0x7eff70108c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:24:55.405 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:55.384+0000 7eff771a7640 1 --2- 172.21.15.19:0/1676941297 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7eff70102dc0 0x7eff701031a0 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:24:55.405 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:55.384+0000 7eff771a7640 1 -- 172.21.15.19:0/1676941297 >> 172.21.15.19:0/1676941297 conn(0x7eff700fe830 msgr2=0x7eff70100c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:24:55.405 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:55.384+0000 7eff771a7640 1 -- 172.21.15.19:0/1676941297 shutdown_connections 2024-09-10T22:24:55.405 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:55.384+0000 7eff771a7640 1 -- 172.21.15.19:0/1676941297 wait complete. 2024-09-10T22:24:55.405 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:55.385+0000 7eff771a7640 1 Processor -- start 2024-09-10T22:24:55.405 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:55.385+0000 7eff771a7640 1 -- start start 2024-09-10T22:24:55.405 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:55.385+0000 7eff771a7640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7eff70102dc0 0x7eff70199440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:24:55.405 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:55.385+0000 7eff771a7640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7eff701087d0 0x7eff70199980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:24:55.405 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:55.385+0000 7eff771a7640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7eff70109150 0x7eff7019ed20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:24:55.406 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:55.385+0000 7eff771a7640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7eff70112e50 con 0x7eff70109150 2024-09-10T22:24:55.406 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:55.385+0000 7eff771a7640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7eff70112cd0 con 0x7eff701087d0 2024-09-10T22:24:55.406 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:55.385+0000 7eff771a7640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7eff70112fd0 con 0x7eff70102dc0 2024-09-10T22:24:55.406 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:55.385+0000 7eff75744640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7eff70109150 0x7eff7019ed20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:24:55.406 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:55.385+0000 7eff75744640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7eff70109150 0x7eff7019ed20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:41442/0 (socket says 172.21.15.19:41442) 2024-09-10T22:24:55.406 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:55.385+0000 7eff75744640 1 -- 172.21.15.19:0/1573256511 learned_addr learned my addr 172.21.15.19:0/1573256511 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:24:55.406 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:55.385+0000 7eff74f43640 1 --2- 172.21.15.19:0/1573256511 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7eff70102dc0 0x7eff70199440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:24:55.406 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:55.385+0000 7eff6ffff640 1 --2- 172.21.15.19:0/1573256511 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7eff701087d0 0x7eff70199980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:24:55.406 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:55.385+0000 7eff75744640 1 -- 172.21.15.19:0/1573256511 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7eff70102dc0 msgr2=0x7eff70199440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:24:55.406 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:55.385+0000 7eff75744640 1 --2- 172.21.15.19:0/1573256511 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7eff70102dc0 0x7eff70199440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:24:55.406 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:55.385+0000 7eff75744640 1 -- 172.21.15.19:0/1573256511 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7eff701087d0 msgr2=0x7eff70199980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:24:55.406 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:55.385+0000 7eff75744640 1 --2- 172.21.15.19:0/1573256511 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7eff701087d0 0x7eff70199980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:24:55.407 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:55.385+0000 7eff75744640 1 -- 172.21.15.19:0/1573256511 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7eff7019f4f0 con 0x7eff70109150 2024-09-10T22:24:55.407 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:55.385+0000 7eff74f43640 1 --2- 172.21.15.19:0/1573256511 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7eff70102dc0 0x7eff70199440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T22:24:55.407 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:55.385+0000 7eff6ffff640 1 --2- 172.21.15.19:0/1573256511 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7eff701087d0 0x7eff70199980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T22:24:55.407 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:55.386+0000 7eff75744640 1 --2- 172.21.15.19:0/1573256511 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7eff70109150 0x7eff7019ed20 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7eff68009fd0 tx=0x7eff6800b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:24:55.407 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:55.386+0000 7eff6dffb640 1 -- 172.21.15.19:0/1573256511 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff68011830 con 0x7eff70109150 2024-09-10T22:24:55.407 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:55.386+0000 7eff6dffb640 1 -- 172.21.15.19:0/1573256511 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7eff68016070 con 0x7eff70109150 2024-09-10T22:24:55.407 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:55.386+0000 7eff771a7640 1 -- 172.21.15.19:0/1573256511 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7eff7019f7e0 con 0x7eff70109150 2024-09-10T22:24:55.407 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:55.386+0000 7eff6dffb640 1 -- 172.21.15.19:0/1573256511 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff68010de0 con 0x7eff70109150 2024-09-10T22:24:55.407 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:55.386+0000 7eff771a7640 1 -- 172.21.15.19:0/1573256511 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7eff701a5ea0 con 0x7eff70109150 2024-09-10T22:24:55.407 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:55.387+0000 7eff771a7640 1 -- 172.21.15.19:0/1573256511 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7eff70103220 con 0x7eff70109150 2024-09-10T22:24:55.407 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:55.388+0000 7eff6dffb640 1 -- 172.21.15.19:0/1573256511 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 17) ==== 153301+0+0 (secure 0 0 0) 0x7eff680119d0 con 0x7eff70109150 2024-09-10T22:24:55.407 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:55.389+0000 7eff6dffb640 1 --2- 172.21.15.19:0/1573256511 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7eff5c0b53f0 0x7eff5c0b78b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:24:55.408 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:55.389+0000 7eff74f43640 1 --2- 172.21.15.19:0/1573256511 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7eff5c0b53f0 0x7eff5c0b78b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:24:55.408 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:55.389+0000 7eff6dffb640 1 -- 172.21.15.19:0/1573256511 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 7979+0+0 (secure 0 0 0) 0x7eff680e5280 con 0x7eff70109150 2024-09-10T22:24:55.408 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:55.389+0000 7eff74f43640 1 --2- 172.21.15.19:0/1573256511 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7eff5c0b53f0 0x7eff5c0b78b0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7eff58000c00 tx=0x7eff58031400 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:24:55.408 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:55.393+0000 7eff6dffb640 1 -- 172.21.15.19:0/1573256511 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7eff680ac090 con 0x7eff70109150 2024-09-10T22:24:55.580 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:55.578+0000 7eff771a7640 1 -- 172.21.15.19:0/1573256511 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7eff7010a9a0 con 0x7eff70109150 2024-09-10T22:24:55.580 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:24:55 smithi019 ceph-mon[31375]: pgmap v298: 97 pgs: 97 active+clean; 634 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 3.3 KiB/s wr, 7 op/s 2024-09-10T22:24:55.581 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:55.580+0000 7eff6dffb640 1 -- 172.21.15.19:0/1573256511 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v73) ==== 74+0+22289 (secure 0 0 0) 0x7eff680ab990 con 0x7eff70109150 2024-09-10T22:24:55.581 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-10T22:24:55.581 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":73,"fsid":"22997a4c-6fc2-11ef-bcea-c7b262605968","created":"2024-09-10T22:16:16.754696+0000","modified":"2024-09-10T22:24:22.733974+0000","last_up_change":"2024-09-10T22:23:32.417392+0000","last_in_change":"2024-09-10T22:23:09.614371+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T22:19:50.731662+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-10T22:24:18.740121+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"73","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-10T22:24:20.795178+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"73","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"783d96cb-0a8a-47f3-8eab-77cd731a64bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6802","nonce":234761879},{"type":"v1","addr":"172.21.15.19:6803","nonce":234761879}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6804","nonce":234761879},{"type":"v1","addr":"172.21.15.19:6805","nonce":234761879}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6808","nonce":234761879},{"type":"v1","addr":"172.21.15.19:6809","nonce":234761879}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6806","nonce":234761879},{"type":"v1","addr":"172.21.15.19:6807","nonce":234761879}]},"public_addr":"172.21.15.19:6803/234761879","cluster_addr":"172.21.15.19:6805/234761879","heartbeat_back_addr":"172.21.15.19:6809/234761879","heartbeat_front_addr":"172.21.15.19:6807/234761879","state":["exists","up"]},{"osd":1,"uuid":"41043581-e0cf-43b5-bae0-0d95e2ef8156","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6800","nonce":1803526886},{"type":"v1","addr":"172.21.15.135:6801","nonce":1803526886}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6802","nonce":1803526886},{"type":"v1","addr":"172.21.15.135:6803","nonce":1803526886}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6806","nonce":1803526886},{"type":"v1","addr":"172.21.15.135:6807","nonce":1803526886}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6804","nonce":1803526886},{"type":"v1","addr":"172.21.15.135:6805","nonce":1803526886}]},"public_addr":"172.21.15.135:6801/1803526886","cluster_addr":"172.21.15.135:6803/1803526886","heartbeat_back_addr":"172.21.15.135:6807/1803526886","heartbeat_front_addr":"172.21.15.135:6805/1803526886","state":["exists","up"]},{"osd":2,"uuid":"a9b14a06-bbdc-4501-96e2-fb5f7127ca16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6800","nonce":2747418770},{"type":"v1","addr":"172.21.15.138:6801","nonce":2747418770}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6802","nonce":2747418770},{"type":"v1","addr":"172.21.15.138:6803","nonce":2747418770}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6806","nonce":2747418770},{"type":"v1","addr":"172.21.15.138:6807","nonce":2747418770}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6804","nonce":2747418770},{"type":"v1","addr":"172.21.15.138:6805","nonce":2747418770}]},"public_addr":"172.21.15.138:6801/2747418770","cluster_addr":"172.21.15.138:6803/2747418770","heartbeat_back_addr":"172.21.15.138:6807/2747418770","heartbeat_front_addr":"172.21.15.138:6805/2747418770","state":["exists","up"]},{"osd":3,"uuid":"a46268da-8666-4cfa-b11a-30eb12e271be","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":23,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6810","nonce":1889857224},{"type":"v1","addr":"172.21.15.19:6811","nonce":1889857224}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6812","nonce":1889857224},{"type":"v1","addr":"172.21.15.19:6813","nonce":1889857224}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6816","nonce":1889857224},{"type":"v1","addr":"172.21.15.19:6817","nonce":1889857224}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6814","nonce":1889857224},{"type":"v1","addr":"172.21.15.19:6815","nonce":1889857224}]},"public_addr":"172.21.15.19:6811/1889857224","cluster_addr":"172.21.15.19:6813/1889857224","heartbeat_back_addr":"172.21.15.19:6817/1889857224","heartbeat_front_addr":"172.21.15.19:6815/1889857224","state":["exists","up"]},{"osd":4,"uuid":"c58df06f-2de2-4655-88e7-ac6a3531839a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":29,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6808","nonce":436311825},{"type":"v1","addr":"172.21.15.135:6809","nonce":436311825}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6810","nonce":436311825},{"type":"v1","addr":"172.21.15.135:6811","nonce":436311825}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6814","nonce":436311825},{"type":"v1","addr":"172.21.15.135:6815","nonce":436311825}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6812","nonce":436311825},{"type":"v1","addr":"172.21.15.135:6813","nonce":436311825}]},"public_addr":"172.21.15.135:6809/436311825","cluster_addr":"172.21.15.135:6811/436311825","heartbeat_back_addr":"172.21.15.135:6815/436311825","heartbeat_front_addr":"172.21.15.135:6813/436311825","state":["exists","up"]},{"osd":5,"uuid":"c0900b0c-aef4-498d-a01b-a891bdb51122","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6808","nonce":1086764290},{"type":"v1","addr":"172.21.15.138:6809","nonce":1086764290}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6810","nonce":1086764290},{"type":"v1","addr":"172.21.15.138:6811","nonce":1086764290}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6814","nonce":1086764290},{"type":"v1","addr":"172.21.15.138:6815","nonce":1086764290}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6812","nonce":1086764290},{"type":"v1","addr":"172.21.15.138:6813","nonce":1086764290}]},"public_addr":"172.21.15.138:6809/1086764290","cluster_addr":"172.21.15.138:6811/1086764290","heartbeat_back_addr":"172.21.15.138:6815/1086764290","heartbeat_front_addr":"172.21.15.138:6813/1086764290","state":["exists","up"]},{"osd":6,"uuid":"f79cb310-8073-4ee5-80a6-87a290600321","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":40,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6818","nonce":406328354},{"type":"v1","addr":"172.21.15.19:6819","nonce":406328354}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6820","nonce":406328354},{"type":"v1","addr":"172.21.15.19:6821","nonce":406328354}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6824","nonce":406328354},{"type":"v1","addr":"172.21.15.19:6825","nonce":406328354}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6822","nonce":406328354},{"type":"v1","addr":"172.21.15.19:6823","nonce":406328354}]},"public_addr":"172.21.15.19:6819/406328354","cluster_addr":"172.21.15.19:6821/406328354","heartbeat_back_addr":"172.21.15.19:6825/406328354","heartbeat_front_addr":"172.21.15.19:6823/406328354","state":["exists","up"]},{"osd":7,"uuid":"cc76476a-92f3-489c-be9e-29cbbf39539e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6816","nonce":1096613674},{"type":"v1","addr":"172.21.15.135:6817","nonce":1096613674}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6818","nonce":1096613674},{"type":"v1","addr":"172.21.15.135:6819","nonce":1096613674}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6822","nonce":1096613674},{"type":"v1","addr":"172.21.15.135:6823","nonce":1096613674}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6820","nonce":1096613674},{"type":"v1","addr":"172.21.15.135:6821","nonce":1096613674}]},"public_addr":"172.21.15.135:6817/1096613674","cluster_addr":"172.21.15.135:6819/1096613674","heartbeat_back_addr":"172.21.15.135:6823/1096613674","heartbeat_front_addr":"172.21.15.135:6821/1096613674","state":["exists","up"]},{"osd":8,"uuid":"5323a006-a6e8-4403-9c51-65f46298d5c4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6816","nonce":3020394729},{"type":"v1","addr":"172.21.15.138:6817","nonce":3020394729}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6818","nonce":3020394729},{"type":"v1","addr":"172.21.15.138:6819","nonce":3020394729}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6822","nonce":3020394729},{"type":"v1","addr":"172.21.15.138:6823","nonce":3020394729}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6820","nonce":3020394729},{"type":"v1","addr":"172.21.15.138:6821","nonce":3020394729}]},"public_addr":"172.21.15.138:6817/3020394729","cluster_addr":"172.21.15.138:6819/3020394729","heartbeat_back_addr":"172.21.15.138:6823/3020394729","heartbeat_front_addr":"172.21.15.138:6821/3020394729","state":["exists","up"]},{"osd":9,"uuid":"b869ac42-c46e-442c-8b5b-f81c018e663c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":57,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6826","nonce":1488680899},{"type":"v1","addr":"172.21.15.19:6827","nonce":1488680899}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6828","nonce":1488680899},{"type":"v1","addr":"172.21.15.19:6829","nonce":1488680899}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6832","nonce":1488680899},{"type":"v1","addr":"172.21.15.19:6833","nonce":1488680899}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6830","nonce":1488680899},{"type":"v1","addr":"172.21.15.19:6831","nonce":1488680899}]},"public_addr":"172.21.15.19:6827/1488680899","cluster_addr":"172.21.15.19:6829/1488680899","heartbeat_back_addr":"172.21.15.19:6833/1488680899","heartbeat_front_addr":"172.21.15.19:6831/1488680899","state":["exists","up"]},{"osd":10,"uuid":"b8a2d69a-6821-4c69-b7eb-c0cfc8164614","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":62,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6824","nonce":3812626754},{"type":"v1","addr":"172.21.15.135:6825","nonce":3812626754}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6826","nonce":3812626754},{"type":"v1","addr":"172.21.15.135:6827","nonce":3812626754}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6830","nonce":3812626754},{"type":"v1","addr":"172.21.15.135:6831","nonce":3812626754}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6828","nonce":3812626754},{"type":"v1","addr":"172.21.15.135:6829","nonce":3812626754}]},"public_addr":"172.21.15.135:6825/3812626754","cluster_addr":"172.21.15.135:6827/3812626754","heartbeat_back_addr":"172.21.15.135:6831/3812626754","heartbeat_front_addr":"172.21.15.135:6829/3812626754","state":["exists","up"]},{"osd":11,"uuid":"a9264ab2-5843-44d2-aba8-1e12708e99d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6824","nonce":1098434807},{"type":"v1","addr":"172.21.15.138:6825","nonce":1098434807}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6826","nonce":1098434807},{"type":"v1","addr":"172.21.15.138:6827","nonce":1098434807}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6830","nonce":1098434807},{"type":"v1","addr":"172.21.15.138:6831","nonce":1098434807}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6828","nonce":1098434807},{"type":"v1","addr":"172.21.15.138:6829","nonce":1098434807}]},"public_addr":"172.21.15.138:6825/1098434807","cluster_addr":"172.21.15.138:6827/1098434807","heartbeat_back_addr":"172.21.15.138:6831/1098434807","heartbeat_front_addr":"172.21.15.138:6829/1098434807","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:18:58.008025+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:19:22.475890+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:19:47.124147+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:20:12.438853+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:20:37.195177+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:21:02.474248+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:21:27.087207+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:21:52.119211+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:22:16.569989+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:22:41.680986+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:23:06.391885+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:23:30.695460+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.19:0/2099468127":"2024-09-11T22:17:04.260826+0000","172.21.15.19:0/538724915":"2024-09-11T22:17:04.260826+0000","172.21.15.19:0/3504695777":"2024-09-11T22:17:04.260826+0000","172.21.15.19:0/1401613792":"2024-09-11T22:16:39.069638+0000","172.21.15.19:6801/3005924425":"2024-09-11T22:17:04.260826+0000","172.21.15.19:6800/3005924425":"2024-09-11T22:17:04.260826+0000","172.21.15.19:0/104917892":"2024-09-11T22:16:39.069638+0000","172.21.15.19:0/1778305990":"2024-09-11T22:16:39.069638+0000","172.21.15.19:6801/535670059":"2024-09-11T22:16:39.069638+0000","172.21.15.19:6800/535670059":"2024-09-11T22:16:39.069638+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T22:24:55.584 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:55.582+0000 7eff771a7640 1 -- 172.21.15.19:0/1573256511 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7eff5c0b53f0 msgr2=0x7eff5c0b78b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:24:55.584 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:55.582+0000 7eff771a7640 1 --2- 172.21.15.19:0/1573256511 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7eff5c0b53f0 0x7eff5c0b78b0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7eff58000c00 tx=0x7eff58031400 comp rx=0 tx=0).stop 2024-09-10T22:24:55.584 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:55.582+0000 7eff771a7640 1 -- 172.21.15.19:0/1573256511 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7eff70109150 msgr2=0x7eff7019ed20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:24:55.584 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:55.582+0000 7eff771a7640 1 --2- 172.21.15.19:0/1573256511 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7eff70109150 0x7eff7019ed20 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7eff68009fd0 tx=0x7eff6800b8e0 comp rx=0 tx=0).stop 2024-09-10T22:24:55.584 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:55.582+0000 7eff771a7640 1 -- 172.21.15.19:0/1573256511 shutdown_connections 2024-09-10T22:24:55.584 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:55.582+0000 7eff771a7640 1 --2- 172.21.15.19:0/1573256511 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7eff5c0b53f0 0x7eff5c0b78b0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:24:55.584 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:55.582+0000 7eff771a7640 1 --2- 172.21.15.19:0/1573256511 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7eff70109150 0x7eff7019ed20 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:24:55.584 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:55.582+0000 7eff771a7640 1 --2- 172.21.15.19:0/1573256511 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7eff701087d0 0x7eff70199980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:24:55.584 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:55.582+0000 7eff771a7640 1 --2- 172.21.15.19:0/1573256511 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7eff70102dc0 0x7eff70199440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:24:55.584 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:55.582+0000 7eff771a7640 1 -- 172.21.15.19:0/1573256511 >> 172.21.15.19:0/1573256511 conn(0x7eff700fe830 msgr2=0x7eff70100c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:24:55.584 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:55.582+0000 7eff771a7640 1 -- 172.21.15.19:0/1573256511 shutdown_connections 2024-09-10T22:24:55.585 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:55.582+0000 7eff771a7640 1 -- 172.21.15.19:0/1573256511 wait complete. 2024-09-10T22:24:55.860 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:24:55 smithi135 ceph-mon[34789]: pgmap v298: 97 pgs: 97 active+clean; 634 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 3.3 KiB/s wr, 7 op/s 2024-09-10T22:24:55.875 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:24:55 smithi138 ceph-mon[35236]: pgmap v298: 97 pgs: 97 active+clean; 634 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 3.3 KiB/s wr, 7 op/s 2024-09-10T22:24:56.198 INFO:tasks.cephadm.ceph_manager.ceph:all up! 2024-09-10T22:24:56.198 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 22997a4c-6fc2-11ef-bcea-c7b262605968 -- ceph osd dump --format=json 2024-09-10T22:24:56.459 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/22997a4c-6fc2-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T22:24:56.812 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:24:56 smithi019 ceph-mon[31375]: from='client.? 172.21.15.19:0/1573256511' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-10T22:24:56.859 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:24:56 smithi135 ceph-mon[34789]: from='client.? 172.21.15.19:0/1573256511' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-10T22:24:56.874 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:24:56 smithi138 ceph-mon[35236]: from='client.? 172.21.15.19:0/1573256511' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-10T22:24:56.895 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:56.893+0000 7f279f512640 1 -- 172.21.15.19:0/181856384 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2798104550 msgr2=0x7f279810cb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:24:56.895 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:56.893+0000 7f279f512640 1 --2- 172.21.15.19:0/181856384 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2798104550 0x7f279810cb30 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f2788009900 tx=0x7f278802a410 comp rx=0 tx=0).stop 2024-09-10T22:24:56.895 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:56.894+0000 7f279f512640 1 -- 172.21.15.19:0/181856384 shutdown_connections 2024-09-10T22:24:56.895 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:56.894+0000 7f279f512640 1 --2- 172.21.15.19:0/181856384 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f279810d100 0x7f279810f550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:24:56.895 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:56.894+0000 7f279f512640 1 --2- 172.21.15.19:0/181856384 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2798104550 0x7f279810cb30 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:24:56.895 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:56.894+0000 7f279f512640 1 --2- 172.21.15.19:0/181856384 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f2798103b50 0x7f2798103f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:24:56.896 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:56.894+0000 7f279f512640 1 -- 172.21.15.19:0/181856384 >> 172.21.15.19:0/181856384 conn(0x7f27980fd700 msgr2=0x7f27980ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:24:56.896 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:56.894+0000 7f279f512640 1 -- 172.21.15.19:0/181856384 shutdown_connections 2024-09-10T22:24:56.896 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:56.894+0000 7f279f512640 1 -- 172.21.15.19:0/181856384 wait complete. 2024-09-10T22:24:56.898 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:56.894+0000 7f279f512640 1 Processor -- start 2024-09-10T22:24:56.898 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:56.895+0000 7f279f512640 1 -- start start 2024-09-10T22:24:56.898 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:56.895+0000 7f279f512640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f2798103b50 0x7f27981992d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:24:56.898 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:56.895+0000 7f279f512640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2798104550 0x7f2798199810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:24:56.898 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:56.895+0000 7f279f512640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f279810d100 0x7f279819ebb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:24:56.898 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:56.895+0000 7f279f512640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f2798112da0 con 0x7f2798104550 2024-09-10T22:24:56.898 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:56.895+0000 7f279f512640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f2798112c20 con 0x7f279810d100 2024-09-10T22:24:56.898 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:56.895+0000 7f279f512640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f2798112f20 con 0x7f2798103b50 2024-09-10T22:24:56.898 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:56.895+0000 7f279caad640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2798104550 0x7f2798199810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:24:56.898 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:56.895+0000 7f279caad640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2798104550 0x7f2798199810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:41446/0 (socket says 172.21.15.19:41446) 2024-09-10T22:24:56.898 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:56.895+0000 7f279caad640 1 -- 172.21.15.19:0/1771879722 learned_addr learned my addr 172.21.15.19:0/1771879722 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:24:56.898 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:56.895+0000 7f279d2ae640 1 --2- 172.21.15.19:0/1771879722 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f2798103b50 0x7f27981992d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:24:56.898 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:56.895+0000 7f279daaf640 1 --2- 172.21.15.19:0/1771879722 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f279810d100 0x7f279819ebb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:24:56.899 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:56.895+0000 7f279caad640 1 -- 172.21.15.19:0/1771879722 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f2798103b50 msgr2=0x7f27981992d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:24:56.899 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:56.895+0000 7f279caad640 1 --2- 172.21.15.19:0/1771879722 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f2798103b50 0x7f27981992d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:24:56.899 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:56.895+0000 7f279caad640 1 -- 172.21.15.19:0/1771879722 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f279810d100 msgr2=0x7f279819ebb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:24:56.899 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:56.895+0000 7f279caad640 1 --2- 172.21.15.19:0/1771879722 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f279810d100 0x7f279819ebb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:24:56.899 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:56.895+0000 7f279caad640 1 -- 172.21.15.19:0/1771879722 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f279819f380 con 0x7f2798104550 2024-09-10T22:24:56.899 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:56.896+0000 7f279caad640 1 --2- 172.21.15.19:0/1771879722 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2798104550 0x7f2798199810 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f2788005940 tx=0x7f27880042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:24:56.899 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:56.896+0000 7f278e7fc640 1 -- 172.21.15.19:0/1771879722 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f278803f030 con 0x7f2798104550 2024-09-10T22:24:56.899 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:56.896+0000 7f278e7fc640 1 -- 172.21.15.19:0/1771879722 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2788003cb0 con 0x7f2798104550 2024-09-10T22:24:56.899 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:56.896+0000 7f279f512640 1 -- 172.21.15.19:0/1771879722 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f279819f610 con 0x7f2798104550 2024-09-10T22:24:56.899 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:56.896+0000 7f278e7fc640 1 -- 172.21.15.19:0/1771879722 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2788035070 con 0x7f2798104550 2024-09-10T22:24:56.899 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:56.896+0000 7f279f512640 1 -- 172.21.15.19:0/1771879722 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f27981a5d30 con 0x7f2798104550 2024-09-10T22:24:56.900 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:56.897+0000 7f279f512640 1 -- 172.21.15.19:0/1771879722 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2798103f30 con 0x7f2798104550 2024-09-10T22:24:56.900 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:56.898+0000 7f278e7fc640 1 -- 172.21.15.19:0/1771879722 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 17) ==== 153301+0+0 (secure 0 0 0) 0x7f278803bbf0 con 0x7f2798104550 2024-09-10T22:24:56.900 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:56.899+0000 7f278e7fc640 1 --2- 172.21.15.19:0/1771879722 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f27840b5370 0x7f27840b7830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:24:56.900 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:56.899+0000 7f279d2ae640 1 --2- 172.21.15.19:0/1771879722 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f27840b5370 0x7f27840b7830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:24:56.900 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:56.899+0000 7f278e7fc640 1 -- 172.21.15.19:0/1771879722 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 7979+0+0 (secure 0 0 0) 0x7f2788106aa0 con 0x7f2798104550 2024-09-10T22:24:56.901 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:56.899+0000 7f279d2ae640 1 --2- 172.21.15.19:0/1771879722 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f27840b5370 0x7f27840b7830 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f279400bbe0 tx=0x7f279400b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:24:56.903 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:56.902+0000 7f278e7fc640 1 -- 172.21.15.19:0/1771879722 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f27880cd8b0 con 0x7f2798104550 2024-09-10T22:24:57.092 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:57.091+0000 7f279f512640 1 -- 172.21.15.19:0/1771879722 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f279819a400 con 0x7f2798104550 2024-09-10T22:24:57.093 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:57.092+0000 7f278e7fc640 1 -- 172.21.15.19:0/1771879722 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v73) ==== 74+0+22289 (secure 0 0 0) 0x7f279819a400 con 0x7f2798104550 2024-09-10T22:24:57.094 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-10T22:24:57.094 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":73,"fsid":"22997a4c-6fc2-11ef-bcea-c7b262605968","created":"2024-09-10T22:16:16.754696+0000","modified":"2024-09-10T22:24:22.733974+0000","last_up_change":"2024-09-10T22:23:32.417392+0000","last_in_change":"2024-09-10T22:23:09.614371+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T22:19:50.731662+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-10T22:24:18.740121+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"73","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-10T22:24:20.795178+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"73","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"783d96cb-0a8a-47f3-8eab-77cd731a64bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6802","nonce":234761879},{"type":"v1","addr":"172.21.15.19:6803","nonce":234761879}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6804","nonce":234761879},{"type":"v1","addr":"172.21.15.19:6805","nonce":234761879}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6808","nonce":234761879},{"type":"v1","addr":"172.21.15.19:6809","nonce":234761879}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6806","nonce":234761879},{"type":"v1","addr":"172.21.15.19:6807","nonce":234761879}]},"public_addr":"172.21.15.19:6803/234761879","cluster_addr":"172.21.15.19:6805/234761879","heartbeat_back_addr":"172.21.15.19:6809/234761879","heartbeat_front_addr":"172.21.15.19:6807/234761879","state":["exists","up"]},{"osd":1,"uuid":"41043581-e0cf-43b5-bae0-0d95e2ef8156","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6800","nonce":1803526886},{"type":"v1","addr":"172.21.15.135:6801","nonce":1803526886}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6802","nonce":1803526886},{"type":"v1","addr":"172.21.15.135:6803","nonce":1803526886}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6806","nonce":1803526886},{"type":"v1","addr":"172.21.15.135:6807","nonce":1803526886}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6804","nonce":1803526886},{"type":"v1","addr":"172.21.15.135:6805","nonce":1803526886}]},"public_addr":"172.21.15.135:6801/1803526886","cluster_addr":"172.21.15.135:6803/1803526886","heartbeat_back_addr":"172.21.15.135:6807/1803526886","heartbeat_front_addr":"172.21.15.135:6805/1803526886","state":["exists","up"]},{"osd":2,"uuid":"a9b14a06-bbdc-4501-96e2-fb5f7127ca16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6800","nonce":2747418770},{"type":"v1","addr":"172.21.15.138:6801","nonce":2747418770}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6802","nonce":2747418770},{"type":"v1","addr":"172.21.15.138:6803","nonce":2747418770}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6806","nonce":2747418770},{"type":"v1","addr":"172.21.15.138:6807","nonce":2747418770}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6804","nonce":2747418770},{"type":"v1","addr":"172.21.15.138:6805","nonce":2747418770}]},"public_addr":"172.21.15.138:6801/2747418770","cluster_addr":"172.21.15.138:6803/2747418770","heartbeat_back_addr":"172.21.15.138:6807/2747418770","heartbeat_front_addr":"172.21.15.138:6805/2747418770","state":["exists","up"]},{"osd":3,"uuid":"a46268da-8666-4cfa-b11a-30eb12e271be","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":23,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6810","nonce":1889857224},{"type":"v1","addr":"172.21.15.19:6811","nonce":1889857224}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6812","nonce":1889857224},{"type":"v1","addr":"172.21.15.19:6813","nonce":1889857224}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6816","nonce":1889857224},{"type":"v1","addr":"172.21.15.19:6817","nonce":1889857224}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6814","nonce":1889857224},{"type":"v1","addr":"172.21.15.19:6815","nonce":1889857224}]},"public_addr":"172.21.15.19:6811/1889857224","cluster_addr":"172.21.15.19:6813/1889857224","heartbeat_back_addr":"172.21.15.19:6817/1889857224","heartbeat_front_addr":"172.21.15.19:6815/1889857224","state":["exists","up"]},{"osd":4,"uuid":"c58df06f-2de2-4655-88e7-ac6a3531839a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":29,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6808","nonce":436311825},{"type":"v1","addr":"172.21.15.135:6809","nonce":436311825}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6810","nonce":436311825},{"type":"v1","addr":"172.21.15.135:6811","nonce":436311825}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6814","nonce":436311825},{"type":"v1","addr":"172.21.15.135:6815","nonce":436311825}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6812","nonce":436311825},{"type":"v1","addr":"172.21.15.135:6813","nonce":436311825}]},"public_addr":"172.21.15.135:6809/436311825","cluster_addr":"172.21.15.135:6811/436311825","heartbeat_back_addr":"172.21.15.135:6815/436311825","heartbeat_front_addr":"172.21.15.135:6813/436311825","state":["exists","up"]},{"osd":5,"uuid":"c0900b0c-aef4-498d-a01b-a891bdb51122","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6808","nonce":1086764290},{"type":"v1","addr":"172.21.15.138:6809","nonce":1086764290}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6810","nonce":1086764290},{"type":"v1","addr":"172.21.15.138:6811","nonce":1086764290}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6814","nonce":1086764290},{"type":"v1","addr":"172.21.15.138:6815","nonce":1086764290}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6812","nonce":1086764290},{"type":"v1","addr":"172.21.15.138:6813","nonce":1086764290}]},"public_addr":"172.21.15.138:6809/1086764290","cluster_addr":"172.21.15.138:6811/1086764290","heartbeat_back_addr":"172.21.15.138:6815/1086764290","heartbeat_front_addr":"172.21.15.138:6813/1086764290","state":["exists","up"]},{"osd":6,"uuid":"f79cb310-8073-4ee5-80a6-87a290600321","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":40,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6818","nonce":406328354},{"type":"v1","addr":"172.21.15.19:6819","nonce":406328354}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6820","nonce":406328354},{"type":"v1","addr":"172.21.15.19:6821","nonce":406328354}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6824","nonce":406328354},{"type":"v1","addr":"172.21.15.19:6825","nonce":406328354}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6822","nonce":406328354},{"type":"v1","addr":"172.21.15.19:6823","nonce":406328354}]},"public_addr":"172.21.15.19:6819/406328354","cluster_addr":"172.21.15.19:6821/406328354","heartbeat_back_addr":"172.21.15.19:6825/406328354","heartbeat_front_addr":"172.21.15.19:6823/406328354","state":["exists","up"]},{"osd":7,"uuid":"cc76476a-92f3-489c-be9e-29cbbf39539e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6816","nonce":1096613674},{"type":"v1","addr":"172.21.15.135:6817","nonce":1096613674}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6818","nonce":1096613674},{"type":"v1","addr":"172.21.15.135:6819","nonce":1096613674}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6822","nonce":1096613674},{"type":"v1","addr":"172.21.15.135:6823","nonce":1096613674}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6820","nonce":1096613674},{"type":"v1","addr":"172.21.15.135:6821","nonce":1096613674}]},"public_addr":"172.21.15.135:6817/1096613674","cluster_addr":"172.21.15.135:6819/1096613674","heartbeat_back_addr":"172.21.15.135:6823/1096613674","heartbeat_front_addr":"172.21.15.135:6821/1096613674","state":["exists","up"]},{"osd":8,"uuid":"5323a006-a6e8-4403-9c51-65f46298d5c4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6816","nonce":3020394729},{"type":"v1","addr":"172.21.15.138:6817","nonce":3020394729}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6818","nonce":3020394729},{"type":"v1","addr":"172.21.15.138:6819","nonce":3020394729}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6822","nonce":3020394729},{"type":"v1","addr":"172.21.15.138:6823","nonce":3020394729}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6820","nonce":3020394729},{"type":"v1","addr":"172.21.15.138:6821","nonce":3020394729}]},"public_addr":"172.21.15.138:6817/3020394729","cluster_addr":"172.21.15.138:6819/3020394729","heartbeat_back_addr":"172.21.15.138:6823/3020394729","heartbeat_front_addr":"172.21.15.138:6821/3020394729","state":["exists","up"]},{"osd":9,"uuid":"b869ac42-c46e-442c-8b5b-f81c018e663c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":57,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6826","nonce":1488680899},{"type":"v1","addr":"172.21.15.19:6827","nonce":1488680899}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6828","nonce":1488680899},{"type":"v1","addr":"172.21.15.19:6829","nonce":1488680899}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6832","nonce":1488680899},{"type":"v1","addr":"172.21.15.19:6833","nonce":1488680899}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6830","nonce":1488680899},{"type":"v1","addr":"172.21.15.19:6831","nonce":1488680899}]},"public_addr":"172.21.15.19:6827/1488680899","cluster_addr":"172.21.15.19:6829/1488680899","heartbeat_back_addr":"172.21.15.19:6833/1488680899","heartbeat_front_addr":"172.21.15.19:6831/1488680899","state":["exists","up"]},{"osd":10,"uuid":"b8a2d69a-6821-4c69-b7eb-c0cfc8164614","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":62,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6824","nonce":3812626754},{"type":"v1","addr":"172.21.15.135:6825","nonce":3812626754}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6826","nonce":3812626754},{"type":"v1","addr":"172.21.15.135:6827","nonce":3812626754}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6830","nonce":3812626754},{"type":"v1","addr":"172.21.15.135:6831","nonce":3812626754}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6828","nonce":3812626754},{"type":"v1","addr":"172.21.15.135:6829","nonce":3812626754}]},"public_addr":"172.21.15.135:6825/3812626754","cluster_addr":"172.21.15.135:6827/3812626754","heartbeat_back_addr":"172.21.15.135:6831/3812626754","heartbeat_front_addr":"172.21.15.135:6829/3812626754","state":["exists","up"]},{"osd":11,"uuid":"a9264ab2-5843-44d2-aba8-1e12708e99d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6824","nonce":1098434807},{"type":"v1","addr":"172.21.15.138:6825","nonce":1098434807}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6826","nonce":1098434807},{"type":"v1","addr":"172.21.15.138:6827","nonce":1098434807}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6830","nonce":1098434807},{"type":"v1","addr":"172.21.15.138:6831","nonce":1098434807}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6828","nonce":1098434807},{"type":"v1","addr":"172.21.15.138:6829","nonce":1098434807}]},"public_addr":"172.21.15.138:6825/1098434807","cluster_addr":"172.21.15.138:6827/1098434807","heartbeat_back_addr":"172.21.15.138:6831/1098434807","heartbeat_front_addr":"172.21.15.138:6829/1098434807","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:18:58.008025+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:19:22.475890+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:19:47.124147+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:20:12.438853+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:20:37.195177+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:21:02.474248+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:21:27.087207+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:21:52.119211+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:22:16.569989+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:22:41.680986+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:23:06.391885+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:23:30.695460+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.19:0/2099468127":"2024-09-11T22:17:04.260826+0000","172.21.15.19:0/538724915":"2024-09-11T22:17:04.260826+0000","172.21.15.19:0/3504695777":"2024-09-11T22:17:04.260826+0000","172.21.15.19:0/1401613792":"2024-09-11T22:16:39.069638+0000","172.21.15.19:6801/3005924425":"2024-09-11T22:17:04.260826+0000","172.21.15.19:6800/3005924425":"2024-09-11T22:17:04.260826+0000","172.21.15.19:0/104917892":"2024-09-11T22:16:39.069638+0000","172.21.15.19:0/1778305990":"2024-09-11T22:16:39.069638+0000","172.21.15.19:6801/535670059":"2024-09-11T22:16:39.069638+0000","172.21.15.19:6800/535670059":"2024-09-11T22:16:39.069638+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T22:24:57.096 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:57.095+0000 7f279f512640 1 -- 172.21.15.19:0/1771879722 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f27840b5370 msgr2=0x7f27840b7830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:24:57.096 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:57.095+0000 7f279f512640 1 --2- 172.21.15.19:0/1771879722 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f27840b5370 0x7f27840b7830 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f279400bbe0 tx=0x7f279400b390 comp rx=0 tx=0).stop 2024-09-10T22:24:57.097 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:57.095+0000 7f279f512640 1 -- 172.21.15.19:0/1771879722 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2798104550 msgr2=0x7f2798199810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:24:57.097 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:57.095+0000 7f279f512640 1 --2- 172.21.15.19:0/1771879722 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2798104550 0x7f2798199810 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f2788005940 tx=0x7f27880042f0 comp rx=0 tx=0).stop 2024-09-10T22:24:57.097 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:57.095+0000 7f279f512640 1 -- 172.21.15.19:0/1771879722 shutdown_connections 2024-09-10T22:24:57.097 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:57.095+0000 7f279f512640 1 --2- 172.21.15.19:0/1771879722 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f27840b5370 0x7f27840b7830 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:24:57.097 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:57.095+0000 7f279f512640 1 --2- 172.21.15.19:0/1771879722 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f279810d100 0x7f279819ebb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:24:57.097 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:57.095+0000 7f279f512640 1 --2- 172.21.15.19:0/1771879722 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2798104550 0x7f2798199810 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:24:57.097 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:57.095+0000 7f279f512640 1 --2- 172.21.15.19:0/1771879722 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f2798103b50 0x7f27981992d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:24:57.097 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:57.095+0000 7f279f512640 1 -- 172.21.15.19:0/1771879722 >> 172.21.15.19:0/1771879722 conn(0x7f27980fd700 msgr2=0x7f27980fe3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:24:57.097 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:57.095+0000 7f279f512640 1 -- 172.21.15.19:0/1771879722 shutdown_connections 2024-09-10T22:24:57.097 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:57.095+0000 7f279f512640 1 -- 172.21.15.19:0/1771879722 wait complete. 2024-09-10T22:24:57.708 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:24:57 smithi019 ceph-mon[31375]: pgmap v299: 97 pgs: 97 active+clean; 638 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 3.5 KiB/s wr, 9 op/s 2024-09-10T22:24:57.708 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:24:57 smithi019 ceph-mon[31375]: from='client.? 172.21.15.19:0/1771879722' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-10T22:24:57.807 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 22997a4c-6fc2-11ef-bcea-c7b262605968 -- ceph tell osd.0 flush_pg_stats 2024-09-10T22:24:57.808 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 22997a4c-6fc2-11ef-bcea-c7b262605968 -- ceph tell osd.1 flush_pg_stats 2024-09-10T22:24:57.808 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 22997a4c-6fc2-11ef-bcea-c7b262605968 -- ceph tell osd.2 flush_pg_stats 2024-09-10T22:24:57.809 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 22997a4c-6fc2-11ef-bcea-c7b262605968 -- ceph tell osd.3 flush_pg_stats 2024-09-10T22:24:57.809 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 22997a4c-6fc2-11ef-bcea-c7b262605968 -- ceph tell osd.4 flush_pg_stats 2024-09-10T22:24:57.810 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 22997a4c-6fc2-11ef-bcea-c7b262605968 -- ceph tell osd.5 flush_pg_stats 2024-09-10T22:24:57.810 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 22997a4c-6fc2-11ef-bcea-c7b262605968 -- ceph tell osd.6 flush_pg_stats 2024-09-10T22:24:57.810 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 22997a4c-6fc2-11ef-bcea-c7b262605968 -- ceph tell osd.7 flush_pg_stats 2024-09-10T22:24:57.811 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 22997a4c-6fc2-11ef-bcea-c7b262605968 -- ceph tell osd.8 flush_pg_stats 2024-09-10T22:24:57.811 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 22997a4c-6fc2-11ef-bcea-c7b262605968 -- ceph tell osd.9 flush_pg_stats 2024-09-10T22:24:57.812 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 22997a4c-6fc2-11ef-bcea-c7b262605968 -- ceph tell osd.10 flush_pg_stats 2024-09-10T22:24:57.812 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 22997a4c-6fc2-11ef-bcea-c7b262605968 -- ceph tell osd.11 flush_pg_stats 2024-09-10T22:24:57.859 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:24:57 smithi135 ceph-mon[34789]: pgmap v299: 97 pgs: 97 active+clean; 638 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 3.5 KiB/s wr, 9 op/s 2024-09-10T22:24:57.860 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:24:57 smithi135 ceph-mon[34789]: from='client.? 172.21.15.19:0/1771879722' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-10T22:24:57.875 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:24:57 smithi138 ceph-mon[35236]: pgmap v299: 97 pgs: 97 active+clean; 638 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 3.5 KiB/s wr, 9 op/s 2024-09-10T22:24:57.875 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:24:57 smithi138 ceph-mon[35236]: from='client.? 172.21.15.19:0/1771879722' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-10T22:24:58.500 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/22997a4c-6fc2-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T22:24:58.517 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/22997a4c-6fc2-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T22:24:58.520 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/22997a4c-6fc2-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T22:24:58.523 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/22997a4c-6fc2-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T22:24:58.528 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/22997a4c-6fc2-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T22:24:58.528 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/22997a4c-6fc2-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T22:24:58.532 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/22997a4c-6fc2-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T22:24:59.115 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:59.096+0000 7fbfc72be640 1 -- 172.21.15.19:0/3248962969 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbfc0103b10 msgr2=0x7fbfc0103ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:24:59.115 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:59.096+0000 7fbfc72be640 1 --2- 172.21.15.19:0/3248962969 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbfc0103b10 0x7fbfc0103ef0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fbfb8009900 tx=0x7fbfb802a410 comp rx=0 tx=0).stop 2024-09-10T22:24:59.115 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:59.096+0000 7fbfc72be640 1 -- 172.21.15.19:0/3248962969 shutdown_connections 2024-09-10T22:24:59.115 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:59.096+0000 7fbfc72be640 1 --2- 172.21.15.19:0/3248962969 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fbfc010d0c0 0x7fbfc010f540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:24:59.115 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:59.096+0000 7fbfc72be640 1 --2- 172.21.15.19:0/3248962969 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbfc0104510 0x7fbfc010caf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:24:59.115 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:59.096+0000 7fbfc72be640 1 --2- 172.21.15.19:0/3248962969 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbfc0103b10 0x7fbfc0103ef0 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:24:59.115 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:59.096+0000 7fbfc72be640 1 -- 172.21.15.19:0/3248962969 >> 172.21.15.19:0/3248962969 conn(0x7fbfc00fd700 msgr2=0x7fbfc00ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:24:59.115 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:59.096+0000 7fbfc72be640 1 -- 172.21.15.19:0/3248962969 shutdown_connections 2024-09-10T22:24:59.115 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:59.096+0000 7fbfc72be640 1 -- 172.21.15.19:0/3248962969 wait complete. 2024-09-10T22:24:59.116 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:59.096+0000 7fbfc72be640 1 Processor -- start 2024-09-10T22:24:59.116 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:59.096+0000 7fbfc72be640 1 -- start start 2024-09-10T22:24:59.116 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:59.097+0000 7fbfc72be640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbfc0103b10 0x7fbfc01991e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:24:59.116 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:59.097+0000 7fbfc72be640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbfc0104510 0x7fbfc0199720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:24:59.116 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:59.097+0000 7fbfc72be640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fbfc010d0c0 0x7fbfc019eac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:24:59.116 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:59.097+0000 7fbfc72be640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fbfc0112d50 con 0x7fbfc0103b10 2024-09-10T22:24:59.116 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:59.097+0000 7fbfc72be640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fbfc0112bd0 con 0x7fbfc0104510 2024-09-10T22:24:59.116 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:59.097+0000 7fbfc72be640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7fbfc0112ed0 con 0x7fbfc010d0c0 2024-09-10T22:24:59.116 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:59.097+0000 7fbfc505a640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbfc0103b10 0x7fbfc01991e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:24:59.116 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:59.097+0000 7fbfc505a640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbfc0103b10 0x7fbfc01991e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:41478/0 (socket says 172.21.15.19:41478) 2024-09-10T22:24:59.116 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:59.097+0000 7fbfc505a640 1 -- 172.21.15.19:0/681826571 learned_addr learned my addr 172.21.15.19:0/681826571 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:24:59.117 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:59.097+0000 7fbfc4859640 1 --2- 172.21.15.19:0/681826571 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbfc0104510 0x7fbfc0199720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:24:59.117 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:59.097+0000 7fbfc505a640 1 -- 172.21.15.19:0/681826571 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fbfc010d0c0 msgr2=0x7fbfc019eac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:24:59.117 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:59.097+0000 7fbfc505a640 1 --2- 172.21.15.19:0/681826571 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fbfc010d0c0 0x7fbfc019eac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:24:59.117 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:59.097+0000 7fbfc505a640 1 -- 172.21.15.19:0/681826571 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbfc0104510 msgr2=0x7fbfc0199720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:24:59.117 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:59.097+0000 7fbfc505a640 1 --2- 172.21.15.19:0/681826571 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbfc0104510 0x7fbfc0199720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:24:59.117 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:59.097+0000 7fbfc505a640 1 -- 172.21.15.19:0/681826571 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbfc019f290 con 0x7fbfc0103b10 2024-09-10T22:24:59.117 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:59.097+0000 7fbfc505a640 1 --2- 172.21.15.19:0/681826571 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbfc0103b10 0x7fbfc01991e0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fbfb8005940 tx=0x7fbfb80042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:24:59.117 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:59.097+0000 7fbfbe7fc640 1 -- 172.21.15.19:0/681826571 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbfb803f030 con 0x7fbfc0103b10 2024-09-10T22:24:59.117 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:59.097+0000 7fbfbe7fc640 1 -- 172.21.15.19:0/681826571 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbfb8003cb0 con 0x7fbfc0103b10 2024-09-10T22:24:59.117 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:59.097+0000 7fbfc72be640 1 -- 172.21.15.19:0/681826571 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbfc019f520 con 0x7fbfc0103b10 2024-09-10T22:24:59.117 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:59.097+0000 7fbfbe7fc640 1 -- 172.21.15.19:0/681826571 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbfb8035070 con 0x7fbfc0103b10 2024-09-10T22:24:59.118 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:59.097+0000 7fbfc72be640 1 -- 172.21.15.19:0/681826571 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbfc01a5c40 con 0x7fbfc0103b10 2024-09-10T22:24:59.118 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:59.098+0000 7fbfc72be640 1 -- 172.21.15.19:0/681826571 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fbfc00ff620 con 0x7fbfc0103b10 2024-09-10T22:24:59.118 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:59.100+0000 7fbfbe7fc640 1 -- 172.21.15.19:0/681826571 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 17) ==== 153301+0+0 (secure 0 0 0) 0x7fbfb803bbf0 con 0x7fbfc0103b10 2024-09-10T22:24:59.118 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:59.100+0000 7fbfbe7fc640 1 --2- 172.21.15.19:0/681826571 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7fbfa80b5370 0x7fbfa80b7830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:24:59.118 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:59.101+0000 7fbfc4859640 1 --2- 172.21.15.19:0/681826571 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7fbfa80b5370 0x7fbfa80b7830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:24:59.118 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:59.101+0000 7fbfbe7fc640 1 -- 172.21.15.19:0/681826571 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 7979+0+0 (secure 0 0 0) 0x7fbfb8106aa0 con 0x7fbfc0103b10 2024-09-10T22:24:59.118 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:59.101+0000 7fbfbe7fc640 1 --2- 172.21.15.19:0/681826571 >> [v2:172.21.15.19:6826/1488680899,v1:172.21.15.19:6827/1488680899] conn(0x7fbfa80beab0 0x7fbfa80c0ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:24:59.118 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:59.101+0000 7fbfbe7fc640 1 -- 172.21.15.19:0/681826571 --> [v2:172.21.15.19:6826/1488680899,v1:172.21.15.19:6827/1488680899] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fbfb8030e80 con 0x7fbfa80beab0 2024-09-10T22:24:59.118 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:59.101+0000 7fbfbe7fc640 1 -- 172.21.15.19:0/681826571 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_get_version_reply(handle=1 version=73) ==== 24+0+0 (secure 0 0 0) 0x7fbfb8106f80 con 0x7fbfc0103b10 2024-09-10T22:24:59.118 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:59.101+0000 7fbfc585b640 1 --2- 172.21.15.19:0/681826571 >> [v2:172.21.15.19:6826/1488680899,v1:172.21.15.19:6827/1488680899] conn(0x7fbfa80beab0 0x7fbfa80c0ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:24:59.118 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:59.101+0000 7fbfc4859640 1 --2- 172.21.15.19:0/681826571 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7fbfa80b5370 0x7fbfa80b7830 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fbfc00fff10 tx=0x7fbfb400b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:24:59.118 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:59.101+0000 7fbfc585b640 1 --2- 172.21.15.19:0/681826571 >> [v2:172.21.15.19:6826/1488680899,v1:172.21.15.19:6827/1488680899] conn(0x7fbfa80beab0 0x7fbfa80c0ed0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.9 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:24:59.119 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:59.102+0000 7fbfbe7fc640 1 -- 172.21.15.19:0/681826571 <== osd.9 v2:172.21.15.19:6826/1488680899 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fbfb8030e80 con 0x7fbfa80beab0 2024-09-10T22:24:59.119 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:59.115+0000 7fbfc72be640 1 -- 172.21.15.19:0/681826571 --> [v2:172.21.15.19:6826/1488680899,v1:172.21.15.19:6827/1488680899] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fbfc006b170 con 0x7fbfa80beab0 2024-09-10T22:24:59.119 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:59.116+0000 7fbfbe7fc640 1 -- 172.21.15.19:0/681826571 <== osd.9 v2:172.21.15.19:6826/1488680899 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7fbfc006b170 con 0x7fbfa80beab0 2024-09-10T22:24:59.120 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:59.116+0000 7fbfc72be640 1 -- 172.21.15.19:0/681826571 >> [v2:172.21.15.19:6826/1488680899,v1:172.21.15.19:6827/1488680899] conn(0x7fbfa80beab0 msgr2=0x7fbfa80c0ed0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:24:59.120 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:59.116+0000 7fbfc72be640 1 --2- 172.21.15.19:0/681826571 >> [v2:172.21.15.19:6826/1488680899,v1:172.21.15.19:6827/1488680899] conn(0x7fbfa80beab0 0x7fbfa80c0ed0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:24:59.120 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:59.116+0000 7fbfc72be640 1 -- 172.21.15.19:0/681826571 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7fbfa80b5370 msgr2=0x7fbfa80b7830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:24:59.120 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:59.116+0000 7fbfc72be640 1 --2- 172.21.15.19:0/681826571 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7fbfa80b5370 0x7fbfa80b7830 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fbfc00fff10 tx=0x7fbfb400b390 comp rx=0 tx=0).stop 2024-09-10T22:24:59.120 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:59.116+0000 7fbfc72be640 1 -- 172.21.15.19:0/681826571 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbfc0103b10 msgr2=0x7fbfc01991e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:24:59.121 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:59.116+0000 7fbfc72be640 1 --2- 172.21.15.19:0/681826571 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbfc0103b10 0x7fbfc01991e0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fbfb8005940 tx=0x7fbfb80042f0 comp rx=0 tx=0).stop 2024-09-10T22:24:59.121 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:59.116+0000 7fbfc585b640 1 -- 172.21.15.19:0/681826571 reap_dead start 2024-09-10T22:24:59.121 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:59.116+0000 7fbfc72be640 1 -- 172.21.15.19:0/681826571 shutdown_connections 2024-09-10T22:24:59.121 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:59.116+0000 7fbfc72be640 1 -- 172.21.15.19:0/681826571 >> 172.21.15.19:0/681826571 conn(0x7fbfc00fd700 msgr2=0x7fbfc010f2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:24:59.121 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:59.116+0000 7fbfc72be640 1 -- 172.21.15.19:0/681826571 shutdown_connections 2024-09-10T22:24:59.121 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:24:59.116+0000 7fbfc72be640 1 -- 172.21.15.19:0/681826571 wait complete. 2024-09-10T22:24:59.748 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:24:59 smithi019 ceph-mon[31375]: pgmap v300: 97 pgs: 97 active+clean; 638 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 1.2 KiB/s wr, 5 op/s 2024-09-10T22:24:59.836 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/22997a4c-6fc2-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T22:24:59.840 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/22997a4c-6fc2-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T22:24:59.841 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/22997a4c-6fc2-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T22:24:59.841 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/22997a4c-6fc2-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T22:24:59.842 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/22997a4c-6fc2-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T22:24:59.859 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:24:59 smithi135 ceph-mon[34789]: pgmap v300: 97 pgs: 97 active+clean; 638 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 1.2 KiB/s wr, 5 op/s 2024-09-10T22:24:59.874 INFO:teuthology.orchestra.run.smithi019.stdout:244813135901 2024-09-10T22:24:59.874 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 22997a4c-6fc2-11ef-bcea-c7b262605968 -- ceph osd last-stat-seq osd.9 2024-09-10T22:24:59.875 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:24:59 smithi138 ceph-mon[35236]: pgmap v300: 97 pgs: 97 active+clean; 638 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 1.2 KiB/s wr, 5 op/s 2024-09-10T22:25:00.854 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:00.830+0000 7fe41b64e640 1 -- 172.21.15.19:0/3292198287 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe414104600 msgr2=0x7fe41410caf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:25:00.855 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:00.830+0000 7fe41b64e640 1 --2- 172.21.15.19:0/3292198287 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe414104600 0x7fe41410caf0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fe404009900 tx=0x7fe40402a410 comp rx=0 tx=0).stop 2024-09-10T22:25:00.855 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:00.830+0000 7fe41b64e640 1 -- 172.21.15.19:0/3292198287 shutdown_connections 2024-09-10T22:25:00.855 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:00.830+0000 7fe41b64e640 1 --2- 172.21.15.19:0/3292198287 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe41410d140 0x7fe41410f5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:25:00.855 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:00.830+0000 7fe41b64e640 1 --2- 172.21.15.19:0/3292198287 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe414104600 0x7fe41410caf0 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:25:00.855 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:00.830+0000 7fe41b64e640 1 --2- 172.21.15.19:0/3292198287 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe414103ce0 0x7fe4141040c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:25:00.855 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:00.830+0000 7fe41b64e640 1 -- 172.21.15.19:0/3292198287 >> 172.21.15.19:0/3292198287 conn(0x7fe4140fd700 msgr2=0x7fe4140ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:25:00.855 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:00.830+0000 7fe41b64e640 1 -- 172.21.15.19:0/3292198287 shutdown_connections 2024-09-10T22:25:00.855 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:00.830+0000 7fe41b64e640 1 -- 172.21.15.19:0/3292198287 wait complete. 2024-09-10T22:25:00.855 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:00.831+0000 7fe41b64e640 1 Processor -- start 2024-09-10T22:25:00.855 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:00.831+0000 7fe41b64e640 1 -- start start 2024-09-10T22:25:00.855 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:00.831+0000 7fe41b64e640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe414103ce0 0x7fe41419b520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:25:00.856 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:00.831+0000 7fe41b64e640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe414104600 0x7fe41419ba60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:25:00.856 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:00.831+0000 7fe41b64e640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe41410d140 0x7fe4141a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:25:00.856 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:00.831+0000 7fe41b64e640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fe414112db0 con 0x7fe41410d140 2024-09-10T22:25:00.856 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:00.831+0000 7fe41b64e640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fe414112c30 con 0x7fe414103ce0 2024-09-10T22:25:00.856 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:00.831+0000 7fe41b64e640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7fe414112f30 con 0x7fe414104600 2024-09-10T22:25:00.856 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:00.831+0000 7fe419beb640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe41410d140 0x7fe4141a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:25:00.856 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:00.831+0000 7fe419beb640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe41410d140 0x7fe4141a0e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:41534/0 (socket says 172.21.15.19:41534) 2024-09-10T22:25:00.856 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:00.831+0000 7fe419beb640 1 -- 172.21.15.19:0/95545065 learned_addr learned my addr 172.21.15.19:0/95545065 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:25:00.856 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:00.831+0000 7fe4193ea640 1 --2- 172.21.15.19:0/95545065 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe414103ce0 0x7fe41419b520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:25:00.856 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:00.832+0000 7fe418be9640 1 --2- 172.21.15.19:0/95545065 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe414104600 0x7fe41419ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:25:00.856 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:00.832+0000 7fe419beb640 1 -- 172.21.15.19:0/95545065 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe414104600 msgr2=0x7fe41419ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:25:00.856 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:00.832+0000 7fe419beb640 1 --2- 172.21.15.19:0/95545065 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe414104600 0x7fe41419ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:25:00.857 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:00.832+0000 7fe419beb640 1 -- 172.21.15.19:0/95545065 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe414103ce0 msgr2=0x7fe41419b520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:25:00.857 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:00.832+0000 7fe419beb640 1 --2- 172.21.15.19:0/95545065 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe414103ce0 0x7fe41419b520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:25:00.857 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:00.832+0000 7fe419beb640 1 -- 172.21.15.19:0/95545065 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe4141a15d0 con 0x7fe41410d140 2024-09-10T22:25:00.857 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:00.832+0000 7fe419beb640 1 --2- 172.21.15.19:0/95545065 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe41410d140 0x7fe4141a0e00 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fe40c00cad0 tx=0x7fe40c00cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:25:00.857 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:00.832+0000 7fe40a7fc640 1 -- 172.21.15.19:0/95545065 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe40c00ae20 con 0x7fe41410d140 2024-09-10T22:25:00.857 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:00.832+0000 7fe40a7fc640 1 -- 172.21.15.19:0/95545065 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe40c005020 con 0x7fe41410d140 2024-09-10T22:25:00.857 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:00.832+0000 7fe41b64e640 1 -- 172.21.15.19:0/95545065 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe4141a18c0 con 0x7fe41410d140 2024-09-10T22:25:00.857 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:00.832+0000 7fe40a7fc640 1 -- 172.21.15.19:0/95545065 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe40c00f6b0 con 0x7fe41410d140 2024-09-10T22:25:00.858 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:00.832+0000 7fe41b64e640 1 -- 172.21.15.19:0/95545065 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe4141a7f80 con 0x7fe41410d140 2024-09-10T22:25:00.858 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:00.833+0000 7fe41b64e640 1 -- 172.21.15.19:0/95545065 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fe414103390 con 0x7fe41410d140 2024-09-10T22:25:00.858 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:00.834+0000 7fe40a7fc640 1 -- 172.21.15.19:0/95545065 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 17) ==== 153301+0+0 (secure 0 0 0) 0x7fe40c0054f0 con 0x7fe41410d140 2024-09-10T22:25:00.858 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:00.835+0000 7fe40a7fc640 1 --2- 172.21.15.19:0/95545065 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7fe4000b5370 0x7fe4000b7830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:25:00.858 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:00.835+0000 7fe4193ea640 1 --2- 172.21.15.19:0/95545065 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7fe4000b5370 0x7fe4000b7830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:25:00.858 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:00.835+0000 7fe40a7fc640 1 -- 172.21.15.19:0/95545065 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 7979+0+0 (secure 0 0 0) 0x7fe40c0e5fb0 con 0x7fe41410d140 2024-09-10T22:25:00.858 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:00.836+0000 7fe40a7fc640 1 --2- 172.21.15.19:0/95545065 >> [v2:172.21.15.135:6824/3812626754,v1:172.21.15.135:6825/3812626754] conn(0x7fe4000beab0 0x7fe4000c0ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:25:00.858 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:00.836+0000 7fe40a7fc640 1 -- 172.21.15.19:0/95545065 --> [v2:172.21.15.135:6824/3812626754,v1:172.21.15.135:6825/3812626754] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fe4000c1580 con 0x7fe4000beab0 2024-09-10T22:25:00.858 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:00.836+0000 7fe40a7fc640 1 -- 172.21.15.19:0/95545065 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_get_version_reply(handle=1 version=73) ==== 24+0+0 (secure 0 0 0) 0x7fe40c0e6490 con 0x7fe41410d140 2024-09-10T22:25:00.858 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:00.836+0000 7fe4193ea640 1 --2- 172.21.15.19:0/95545065 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7fe4000b5370 0x7fe4000b7830 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fe41000bbe0 tx=0x7fe41000b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:25:00.858 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:00.836+0000 7fe418be9640 1 --2- 172.21.15.19:0/95545065 >> [v2:172.21.15.135:6824/3812626754,v1:172.21.15.135:6825/3812626754] conn(0x7fe4000beab0 0x7fe4000c0ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:25:00.859 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:00.836+0000 7fe418be9640 1 --2- 172.21.15.19:0/95545065 >> [v2:172.21.15.135:6824/3812626754,v1:172.21.15.135:6825/3812626754] conn(0x7fe4000beab0 0x7fe4000c0ed0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.10 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:25:00.859 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:00.837+0000 7fe40a7fc640 1 -- 172.21.15.19:0/95545065 <== osd.10 v2:172.21.15.135:6824/3812626754 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fe4000c1580 con 0x7fe4000beab0 2024-09-10T22:25:00.859 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:00.851+0000 7fe41b64e640 1 -- 172.21.15.19:0/95545065 --> [v2:172.21.15.135:6824/3812626754,v1:172.21.15.135:6825/3812626754] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fe41406bb90 con 0x7fe4000beab0 2024-09-10T22:25:00.859 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:00.851+0000 7fe40a7fc640 1 -- 172.21.15.19:0/95545065 <== osd.10 v2:172.21.15.135:6824/3812626754 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7fe41406bb90 con 0x7fe4000beab0 2024-09-10T22:25:00.859 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:00.851+0000 7fe41b64e640 1 -- 172.21.15.19:0/95545065 >> [v2:172.21.15.135:6824/3812626754,v1:172.21.15.135:6825/3812626754] conn(0x7fe4000beab0 msgr2=0x7fe4000c0ed0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:25:00.859 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:00.851+0000 7fe41b64e640 1 --2- 172.21.15.19:0/95545065 >> [v2:172.21.15.135:6824/3812626754,v1:172.21.15.135:6825/3812626754] conn(0x7fe4000beab0 0x7fe4000c0ed0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:25:00.859 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:00.852+0000 7fe41b64e640 1 -- 172.21.15.19:0/95545065 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7fe4000b5370 msgr2=0x7fe4000b7830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:25:00.859 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:00.852+0000 7fe41b64e640 1 --2- 172.21.15.19:0/95545065 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7fe4000b5370 0x7fe4000b7830 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fe41000bbe0 tx=0x7fe41000b390 comp rx=0 tx=0).stop 2024-09-10T22:25:00.859 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:00.852+0000 7fe41b64e640 1 -- 172.21.15.19:0/95545065 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe41410d140 msgr2=0x7fe4141a0e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:25:00.859 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:00.852+0000 7fe41b64e640 1 --2- 172.21.15.19:0/95545065 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe41410d140 0x7fe4141a0e00 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fe40c00cad0 tx=0x7fe40c00cf90 comp rx=0 tx=0).stop 2024-09-10T22:25:00.859 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:00.852+0000 7fe419beb640 1 -- 172.21.15.19:0/95545065 reap_dead start 2024-09-10T22:25:00.859 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:00.852+0000 7fe41b64e640 1 -- 172.21.15.19:0/95545065 shutdown_connections 2024-09-10T22:25:00.859 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:00.852+0000 7fe41b64e640 1 -- 172.21.15.19:0/95545065 >> 172.21.15.19:0/95545065 conn(0x7fe4140fd700 msgr2=0x7fe4140ffaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:25:00.860 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:00.852+0000 7fe41b64e640 1 -- 172.21.15.19:0/95545065 shutdown_connections 2024-09-10T22:25:00.860 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:00.852+0000 7fe41b64e640 1 -- 172.21.15.19:0/95545065 wait complete. 2024-09-10T22:25:01.504 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:25:01 smithi019 ceph-mon[31375]: pgmap v301: 97 pgs: 97 active+clean; 638 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 1.2 KiB/s wr, 7 op/s 2024-09-10T22:25:01.859 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:25:01 smithi135 ceph-mon[34789]: pgmap v301: 97 pgs: 97 active+clean; 638 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 1.2 KiB/s wr, 7 op/s 2024-09-10T22:25:01.875 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:25:01 smithi138 ceph-mon[35236]: pgmap v301: 97 pgs: 97 active+clean; 638 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 1.2 KiB/s wr, 7 op/s 2024-09-10T22:25:02.132 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:02.006+0000 7fb135e58640 1 -- 172.21.15.19:0/1193391742 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb130102dc0 msgr2=0x7fb1301031a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:25:02.132 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:02.006+0000 7fb135e58640 1 --2- 172.21.15.19:0/1193391742 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb130102dc0 0x7fb1301031a0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fb120009ca0 tx=0x7fb12002a8c0 comp rx=0 tx=0).stop 2024-09-10T22:25:02.132 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:02.006+0000 7fb135e58640 1 -- 172.21.15.19:0/1193391742 shutdown_connections 2024-09-10T22:25:02.132 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:02.006+0000 7fb135e58640 1 --2- 172.21.15.19:0/1193391742 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb130109150 0x7fb13010f950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:25:02.132 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:02.006+0000 7fb135e58640 1 --2- 172.21.15.19:0/1193391742 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb1301087d0 0x7fb130108c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:25:02.132 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:02.007+0000 7fb135e58640 1 --2- 172.21.15.19:0/1193391742 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb130102dc0 0x7fb1301031a0 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:25:02.132 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:02.007+0000 7fb135e58640 1 -- 172.21.15.19:0/1193391742 >> 172.21.15.19:0/1193391742 conn(0x7fb1300fe870 msgr2=0x7fb130100c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:25:02.132 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:02.007+0000 7fb135e58640 1 -- 172.21.15.19:0/1193391742 shutdown_connections 2024-09-10T22:25:02.132 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:02.007+0000 7fb135e58640 1 -- 172.21.15.19:0/1193391742 wait complete. 2024-09-10T22:25:02.133 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:02.007+0000 7fb135e58640 1 Processor -- start 2024-09-10T22:25:02.133 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:02.007+0000 7fb135e58640 1 -- start start 2024-09-10T22:25:02.133 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:02.007+0000 7fb135e58640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb130102dc0 0x7fb1301992c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:25:02.133 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:02.007+0000 7fb135e58640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb1301087d0 0x7fb130199800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:25:02.133 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:02.007+0000 7fb135e58640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb130109150 0x7fb13019eba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:25:02.133 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:02.007+0000 7fb135e58640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fb130112dd0 con 0x7fb130109150 2024-09-10T22:25:02.133 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:02.007+0000 7fb135e58640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fb130112c50 con 0x7fb1301087d0 2024-09-10T22:25:02.133 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:02.007+0000 7fb135e58640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7fb130112f50 con 0x7fb130102dc0 2024-09-10T22:25:02.133 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:02.008+0000 7fb12ffff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb130109150 0x7fb13019eba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:25:02.133 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:02.008+0000 7fb12ffff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb130109150 0x7fb13019eba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:41542/0 (socket says 172.21.15.19:41542) 2024-09-10T22:25:02.133 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:02.008+0000 7fb12ffff640 1 -- 172.21.15.19:0/2068449057 learned_addr learned my addr 172.21.15.19:0/2068449057 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:25:02.134 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:02.008+0000 7fb12f7fe640 1 --2- 172.21.15.19:0/2068449057 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb130102dc0 0x7fb1301992c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:25:02.134 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:02.008+0000 7fb127fff640 1 --2- 172.21.15.19:0/2068449057 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb1301087d0 0x7fb130199800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:25:02.134 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:02.008+0000 7fb12ffff640 1 -- 172.21.15.19:0/2068449057 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb130102dc0 msgr2=0x7fb1301992c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:25:02.134 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:02.008+0000 7fb12ffff640 1 --2- 172.21.15.19:0/2068449057 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb130102dc0 0x7fb1301992c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:25:02.134 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:02.008+0000 7fb12ffff640 1 -- 172.21.15.19:0/2068449057 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb1301087d0 msgr2=0x7fb130199800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:25:02.134 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:02.008+0000 7fb12ffff640 1 --2- 172.21.15.19:0/2068449057 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb1301087d0 0x7fb130199800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:25:02.134 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:02.008+0000 7fb12ffff640 1 -- 172.21.15.19:0/2068449057 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb13019f370 con 0x7fb130109150 2024-09-10T22:25:02.134 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:02.008+0000 7fb12ffff640 1 --2- 172.21.15.19:0/2068449057 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb130109150 0x7fb13019eba0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fb12800d750 tx=0x7fb12800dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:25:02.134 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:02.008+0000 7fb12d7fa640 1 -- 172.21.15.19:0/2068449057 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb128017070 con 0x7fb130109150 2024-09-10T22:25:02.134 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:02.008+0000 7fb135e58640 1 -- 172.21.15.19:0/2068449057 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb13019f660 con 0x7fb130109150 2024-09-10T22:25:02.134 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:02.008+0000 7fb12d7fa640 1 -- 172.21.15.19:0/2068449057 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb1280054d0 con 0x7fb130109150 2024-09-10T22:25:02.134 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:02.008+0000 7fb12d7fa640 1 -- 172.21.15.19:0/2068449057 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb128004c60 con 0x7fb130109150 2024-09-10T22:25:02.134 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:02.008+0000 7fb135e58640 1 -- 172.21.15.19:0/2068449057 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb1301a5d20 con 0x7fb130109150 2024-09-10T22:25:02.135 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:02.009+0000 7fb135e58640 1 -- 172.21.15.19:0/2068449057 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fb1300638e0 con 0x7fb130109150 2024-09-10T22:25:02.135 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:02.011+0000 7fb12d7fa640 1 -- 172.21.15.19:0/2068449057 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 17) ==== 153301+0+0 (secure 0 0 0) 0x7fb128004e00 con 0x7fb130109150 2024-09-10T22:25:02.135 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:02.012+0000 7fb12d7fa640 1 --2- 172.21.15.19:0/2068449057 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7fb11c0b5370 0x7fb11c0b7830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:25:02.135 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:02.012+0000 7fb12d7fa640 1 -- 172.21.15.19:0/2068449057 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 7979+0+0 (secure 0 0 0) 0x7fb1280e55d0 con 0x7fb130109150 2024-09-10T22:25:02.135 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:02.012+0000 7fb12f7fe640 1 --2- 172.21.15.19:0/2068449057 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7fb11c0b5370 0x7fb11c0b7830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:25:02.135 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:02.012+0000 7fb12d7fa640 1 --2- 172.21.15.19:0/2068449057 >> [v2:172.21.15.135:6808/436311825,v1:172.21.15.135:6809/436311825] conn(0x7fb11c0beab0 0x7fb11c0c0ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:25:02.135 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:02.012+0000 7fb12d7fa640 1 -- 172.21.15.19:0/2068449057 --> [v2:172.21.15.135:6808/436311825,v1:172.21.15.135:6809/436311825] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fb11c0c1580 con 0x7fb11c0beab0 2024-09-10T22:25:02.135 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:02.012+0000 7fb12d7fa640 1 -- 172.21.15.19:0/2068449057 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_get_version_reply(handle=1 version=73) ==== 24+0+0 (secure 0 0 0) 0x7fb1280ec050 con 0x7fb130109150 2024-09-10T22:25:02.135 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:02.012+0000 7fb12f7fe640 1 --2- 172.21.15.19:0/2068449057 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7fb11c0b5370 0x7fb11c0b7830 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fb120009430 tx=0x7fb120009360 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:25:02.136 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:02.012+0000 7fb127fff640 1 --2- 172.21.15.19:0/2068449057 >> [v2:172.21.15.135:6808/436311825,v1:172.21.15.135:6809/436311825] conn(0x7fb11c0beab0 0x7fb11c0c0ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:25:02.136 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:02.013+0000 7fb127fff640 1 --2- 172.21.15.19:0/2068449057 >> [v2:172.21.15.135:6808/436311825,v1:172.21.15.135:6809/436311825] conn(0x7fb11c0beab0 0x7fb11c0c0ed0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:25:02.136 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:02.014+0000 7fb12d7fa640 1 -- 172.21.15.19:0/2068449057 <== osd.4 v2:172.21.15.135:6808/436311825 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fb11c0c1580 con 0x7fb11c0beab0 2024-09-10T22:25:02.136 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:02.027+0000 7fb135e58640 1 -- 172.21.15.19:0/2068449057 --> [v2:172.21.15.135:6808/436311825,v1:172.21.15.135:6809/436311825] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fb130063d60 con 0x7fb11c0beab0 2024-09-10T22:25:02.136 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:02.028+0000 7fb12d7fa640 1 -- 172.21.15.19:0/2068449057 <== osd.4 v2:172.21.15.135:6808/436311825 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7fb130063d60 con 0x7fb11c0beab0 2024-09-10T22:25:02.136 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:02.028+0000 7fb135e58640 1 -- 172.21.15.19:0/2068449057 >> [v2:172.21.15.135:6808/436311825,v1:172.21.15.135:6809/436311825] conn(0x7fb11c0beab0 msgr2=0x7fb11c0c0ed0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:25:02.136 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:02.028+0000 7fb135e58640 1 --2- 172.21.15.19:0/2068449057 >> [v2:172.21.15.135:6808/436311825,v1:172.21.15.135:6809/436311825] conn(0x7fb11c0beab0 0x7fb11c0c0ed0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:25:02.136 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:02.028+0000 7fb135e58640 1 -- 172.21.15.19:0/2068449057 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7fb11c0b5370 msgr2=0x7fb11c0b7830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:25:02.136 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:02.028+0000 7fb135e58640 1 --2- 172.21.15.19:0/2068449057 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7fb11c0b5370 0x7fb11c0b7830 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fb120009430 tx=0x7fb120009360 comp rx=0 tx=0).stop 2024-09-10T22:25:02.136 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:02.028+0000 7fb135e58640 1 -- 172.21.15.19:0/2068449057 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb130109150 msgr2=0x7fb13019eba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:25:02.137 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:02.028+0000 7fb135e58640 1 --2- 172.21.15.19:0/2068449057 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb130109150 0x7fb13019eba0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fb12800d750 tx=0x7fb12800dc10 comp rx=0 tx=0).stop 2024-09-10T22:25:02.137 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:02.028+0000 7fb12ffff640 1 -- 172.21.15.19:0/2068449057 reap_dead start 2024-09-10T22:25:02.137 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:02.028+0000 7fb135e58640 1 -- 172.21.15.19:0/2068449057 shutdown_connections 2024-09-10T22:25:02.137 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:02.028+0000 7fb135e58640 1 -- 172.21.15.19:0/2068449057 >> 172.21.15.19:0/2068449057 conn(0x7fb1300fe870 msgr2=0x7fb130100c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:25:02.137 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:02.029+0000 7fb135e58640 1 -- 172.21.15.19:0/2068449057 shutdown_connections 2024-09-10T22:25:02.137 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:02.029+0000 7fb135e58640 1 -- 172.21.15.19:0/2068449057 wait complete. 2024-09-10T22:25:03.312 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:03.310+0000 7f8526c05640 1 -- 172.21.15.19:0/3660451059 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8520108020 msgr2=0x7f852010e820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:25:03.312 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:03.310+0000 7f8526c05640 1 --2- 172.21.15.19:0/3660451059 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8520108020 0x7f852010e820 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f8518009ca0 tx=0x7f851802a8c0 comp rx=0 tx=0).stop 2024-09-10T22:25:03.312 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:03.311+0000 7f8526c05640 1 -- 172.21.15.19:0/3660451059 shutdown_connections 2024-09-10T22:25:03.312 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:03.311+0000 7f8526c05640 1 --2- 172.21.15.19:0/3660451059 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8520108020 0x7f852010e820 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:25:03.312 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:03.311+0000 7f8526c05640 1 --2- 172.21.15.19:0/3660451059 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f85201076a0 0x7f8520107ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:25:03.313 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:03.311+0000 7f8526c05640 1 --2- 172.21.15.19:0/3660451059 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f8520101c90 0x7f8520102070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:25:03.313 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:03.311+0000 7f8526c05640 1 -- 172.21.15.19:0/3660451059 >> 172.21.15.19:0/3660451059 conn(0x7f85200fd700 msgr2=0x7f85200ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:25:03.313 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:03.311+0000 7f8526c05640 1 -- 172.21.15.19:0/3660451059 shutdown_connections 2024-09-10T22:25:03.313 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:03.311+0000 7f8526c05640 1 -- 172.21.15.19:0/3660451059 wait complete. 2024-09-10T22:25:03.314 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:03.311+0000 7f8526c05640 1 Processor -- start 2024-09-10T22:25:03.315 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:03.311+0000 7f8526c05640 1 -- start start 2024-09-10T22:25:03.315 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:03.311+0000 7f8526c05640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f8520101c90 0x7f85201992b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:25:03.315 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:03.312+0000 7f8526c05640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f85201076a0 0x7f85201997f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:25:03.315 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:03.312+0000 7f8526c05640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8520108020 0x7f852019eb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:25:03.315 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:03.312+0000 7f8526c05640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f8520112dc0 con 0x7f85201076a0 2024-09-10T22:25:03.315 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:03.312+0000 7f8526c05640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f8520112c40 con 0x7f8520108020 2024-09-10T22:25:03.315 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:03.312+0000 7f8526c05640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f8520112f40 con 0x7f8520101c90 2024-09-10T22:25:03.315 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:03.312+0000 7f851ffff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f85201076a0 0x7f85201997f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:25:03.315 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:03.312+0000 7f851ffff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f85201076a0 0x7f85201997f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:41594/0 (socket says 172.21.15.19:41594) 2024-09-10T22:25:03.315 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:03.312+0000 7f851ffff640 1 -- 172.21.15.19:0/1605419517 learned_addr learned my addr 172.21.15.19:0/1605419517 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:25:03.316 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:03.312+0000 7f85251a2640 1 --2- 172.21.15.19:0/1605419517 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8520108020 0x7f852019eb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:25:03.316 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:03.312+0000 7f85249a1640 1 --2- 172.21.15.19:0/1605419517 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f8520101c90 0x7f85201992b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:25:03.316 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:03.312+0000 7f851ffff640 1 -- 172.21.15.19:0/1605419517 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f8520101c90 msgr2=0x7f85201992b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:25:03.316 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:03.312+0000 7f851ffff640 1 --2- 172.21.15.19:0/1605419517 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f8520101c90 0x7f85201992b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:25:03.316 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:03.312+0000 7f851ffff640 1 -- 172.21.15.19:0/1605419517 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8520108020 msgr2=0x7f852019eb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:25:03.316 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:03.312+0000 7f851ffff640 1 --2- 172.21.15.19:0/1605419517 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8520108020 0x7f852019eb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:25:03.316 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:03.312+0000 7f851ffff640 1 -- 172.21.15.19:0/1605419517 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f852019f360 con 0x7f85201076a0 2024-09-10T22:25:03.316 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:03.312+0000 7f851ffff640 1 --2- 172.21.15.19:0/1605419517 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f85201076a0 0x7f85201997f0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f850c00d950 tx=0x7f850c00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:25:03.316 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:03.312+0000 7f851dffb640 1 -- 172.21.15.19:0/1605419517 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f850c017070 con 0x7f85201076a0 2024-09-10T22:25:03.316 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:03.313+0000 7f851dffb640 1 -- 172.21.15.19:0/1605419517 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f850c009c30 con 0x7f85201076a0 2024-09-10T22:25:03.316 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:03.313+0000 7f8526c05640 1 -- 172.21.15.19:0/1605419517 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f852019f650 con 0x7f85201076a0 2024-09-10T22:25:03.317 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:03.313+0000 7f851dffb640 1 -- 172.21.15.19:0/1605419517 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f850c00f620 con 0x7f85201076a0 2024-09-10T22:25:03.317 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:03.313+0000 7f8526c05640 1 -- 172.21.15.19:0/1605419517 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f85201a5ee0 con 0x7f85201076a0 2024-09-10T22:25:03.317 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:03.314+0000 7f8526c05640 1 -- 172.21.15.19:0/1605419517 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f85200638e0 con 0x7f85201076a0 2024-09-10T22:25:03.317 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:03.315+0000 7f851dffb640 1 -- 172.21.15.19:0/1605419517 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 17) ==== 153301+0+0 (secure 0 0 0) 0x7f850c010460 con 0x7f85201076a0 2024-09-10T22:25:03.318 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:03.317+0000 7f851dffb640 1 --2- 172.21.15.19:0/1605419517 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f85100b53f0 0x7f85100b78b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:25:03.318 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:03.317+0000 7f85249a1640 1 --2- 172.21.15.19:0/1605419517 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f85100b53f0 0x7f85100b78b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:25:03.318 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:03.317+0000 7f851dffb640 1 -- 172.21.15.19:0/1605419517 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 7979+0+0 (secure 0 0 0) 0x7f850c0e5b90 con 0x7f85201076a0 2024-09-10T22:25:03.319 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:03.317+0000 7f851dffb640 1 --2- 172.21.15.19:0/1605419517 >> [v2:172.21.15.19:6810/1889857224,v1:172.21.15.19:6811/1889857224] conn(0x7f85100beb30 0x7f85100c0f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:25:03.319 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:03.317+0000 7f851dffb640 1 -- 172.21.15.19:0/1605419517 --> [v2:172.21.15.19:6810/1889857224,v1:172.21.15.19:6811/1889857224] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f850c012e50 con 0x7f85100beb30 2024-09-10T22:25:03.319 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:03.317+0000 7f851dffb640 1 -- 172.21.15.19:0/1605419517 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_get_version_reply(handle=1 version=73) ==== 24+0+0 (secure 0 0 0) 0x7f850c0e5f40 con 0x7f85201076a0 2024-09-10T22:25:03.319 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:03.317+0000 7f85251a2640 1 --2- 172.21.15.19:0/1605419517 >> [v2:172.21.15.19:6810/1889857224,v1:172.21.15.19:6811/1889857224] conn(0x7f85100beb30 0x7f85100c0f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:25:03.319 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:03.317+0000 7f85249a1640 1 --2- 172.21.15.19:0/1605419517 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f85100b53f0 0x7f85100b78b0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f8514005d00 tx=0x7f851400b410 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:25:03.319 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:03.318+0000 7f85251a2640 1 --2- 172.21.15.19:0/1605419517 >> [v2:172.21.15.19:6810/1889857224,v1:172.21.15.19:6811/1889857224] conn(0x7f85100beb30 0x7f85100c0f50 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:25:03.320 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:03.319+0000 7f851dffb640 1 -- 172.21.15.19:0/1605419517 <== osd.3 v2:172.21.15.19:6810/1889857224 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f850c012e50 con 0x7f85100beb30 2024-09-10T22:25:03.334 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:03.333+0000 7f8526c05640 1 -- 172.21.15.19:0/1605419517 --> [v2:172.21.15.19:6810/1889857224,v1:172.21.15.19:6811/1889857224] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f8520063ce0 con 0x7f85100beb30 2024-09-10T22:25:03.334 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:03.333+0000 7f851dffb640 1 -- 172.21.15.19:0/1605419517 <== osd.3 v2:172.21.15.19:6810/1889857224 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f8520063ce0 con 0x7f85100beb30 2024-09-10T22:25:03.335 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:03.333+0000 7f8526c05640 1 -- 172.21.15.19:0/1605419517 >> [v2:172.21.15.19:6810/1889857224,v1:172.21.15.19:6811/1889857224] conn(0x7f85100beb30 msgr2=0x7f85100c0f50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:25:03.336 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:03.333+0000 7f8526c05640 1 --2- 172.21.15.19:0/1605419517 >> [v2:172.21.15.19:6810/1889857224,v1:172.21.15.19:6811/1889857224] conn(0x7f85100beb30 0x7f85100c0f50 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:25:03.336 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:03.334+0000 7f8526c05640 1 -- 172.21.15.19:0/1605419517 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f85100b53f0 msgr2=0x7f85100b78b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:25:03.336 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:03.334+0000 7f8526c05640 1 --2- 172.21.15.19:0/1605419517 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f85100b53f0 0x7f85100b78b0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f8514005d00 tx=0x7f851400b410 comp rx=0 tx=0).stop 2024-09-10T22:25:03.336 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:03.334+0000 7f8526c05640 1 -- 172.21.15.19:0/1605419517 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f85201076a0 msgr2=0x7f85201997f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:25:03.336 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:03.334+0000 7f8526c05640 1 --2- 172.21.15.19:0/1605419517 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f85201076a0 0x7f85201997f0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f850c00d950 tx=0x7f850c00de10 comp rx=0 tx=0).stop 2024-09-10T22:25:03.337 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:03.334+0000 7f85251a2640 1 -- 172.21.15.19:0/1605419517 reap_dead start 2024-09-10T22:25:03.337 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:03.334+0000 7f8526c05640 1 -- 172.21.15.19:0/1605419517 shutdown_connections 2024-09-10T22:25:03.337 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:03.334+0000 7f8526c05640 1 -- 172.21.15.19:0/1605419517 >> 172.21.15.19:0/1605419517 conn(0x7f85200fd700 msgr2=0x7f85200fe080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:25:03.337 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:03.334+0000 7f8526c05640 1 -- 172.21.15.19:0/1605419517 shutdown_connections 2024-09-10T22:25:03.337 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:03.334+0000 7f8526c05640 1 -- 172.21.15.19:0/1605419517 wait complete. 2024-09-10T22:25:03.450 INFO:teuthology.orchestra.run.smithi019.stdout:266287972378 2024-09-10T22:25:03.450 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 22997a4c-6fc2-11ef-bcea-c7b262605968 -- ceph osd last-stat-seq osd.10 2024-09-10T22:25:03.749 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:02.115+0000 7f05d9895640 1 -- 172.21.15.19:0/3533054713 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f05d41076a0 msgr2=0x7f05d4107ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:25:03.750 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:02.115+0000 7f05d9895640 1 --2- 172.21.15.19:0/3533054713 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f05d41076a0 0x7f05d4107ae0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f05bc009900 tx=0x7f05bc02a410 comp rx=0 tx=0).stop 2024-09-10T22:25:03.750 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:02.115+0000 7f05d9895640 1 -- 172.21.15.19:0/3533054713 shutdown_connections 2024-09-10T22:25:03.750 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:02.115+0000 7f05d9895640 1 --2- 172.21.15.19:0/3533054713 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f05d4108020 0x7f05d410e820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:25:03.750 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:02.115+0000 7f05d9895640 1 --2- 172.21.15.19:0/3533054713 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f05d41076a0 0x7f05d4107ae0 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:25:03.750 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:02.115+0000 7f05d9895640 1 --2- 172.21.15.19:0/3533054713 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f05d4101c90 0x7f05d4102070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:25:03.750 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:02.115+0000 7f05d9895640 1 -- 172.21.15.19:0/3533054713 >> 172.21.15.19:0/3533054713 conn(0x7f05d40fd700 msgr2=0x7f05d40ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:25:03.750 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:02.115+0000 7f05d9895640 1 -- 172.21.15.19:0/3533054713 shutdown_connections 2024-09-10T22:25:03.750 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:02.115+0000 7f05d9895640 1 -- 172.21.15.19:0/3533054713 wait complete. 2024-09-10T22:25:03.750 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:02.116+0000 7f05d9895640 1 Processor -- start 2024-09-10T22:25:03.750 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:02.116+0000 7f05d9895640 1 -- start start 2024-09-10T22:25:03.750 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:02.116+0000 7f05d9895640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f05d4101c90 0x7f05d419a150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:25:03.750 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:02.116+0000 7f05d9895640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f05d41076a0 0x7f05d419a690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:25:03.751 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:02.116+0000 7f05d9895640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f05d4108020 0x7f05d419ac10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:25:03.751 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:02.116+0000 7f05d9895640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f05d4111ca0 con 0x7f05d4101c90 2024-09-10T22:25:03.751 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:02.116+0000 7f05d9895640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f05d4111b20 con 0x7f05d4108020 2024-09-10T22:25:03.751 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:02.116+0000 7f05d9895640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f05d4111e20 con 0x7f05d41076a0 2024-09-10T22:25:03.751 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:02.116+0000 7f05d2ffd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f05d4101c90 0x7f05d419a150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:25:03.751 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:02.116+0000 7f05d2ffd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f05d4101c90 0x7f05d419a150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:41562/0 (socket says 172.21.15.19:41562) 2024-09-10T22:25:03.751 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:02.116+0000 7f05d2ffd640 1 -- 172.21.15.19:0/1415965891 learned_addr learned my addr 172.21.15.19:0/1415965891 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:25:03.751 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:02.116+0000 7f05cbfff640 1 --2- 172.21.15.19:0/1415965891 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f05d41076a0 0x7f05d419a690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:25:03.751 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:02.116+0000 7f05d37fe640 1 --2- 172.21.15.19:0/1415965891 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f05d4108020 0x7f05d419ac10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:25:03.751 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:02.116+0000 7f05d2ffd640 1 -- 172.21.15.19:0/1415965891 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f05d41076a0 msgr2=0x7f05d419a690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:25:03.751 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:02.116+0000 7f05d2ffd640 1 --2- 172.21.15.19:0/1415965891 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f05d41076a0 0x7f05d419a690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:25:03.751 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:02.116+0000 7f05d2ffd640 1 -- 172.21.15.19:0/1415965891 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f05d4108020 msgr2=0x7f05d419ac10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:25:03.752 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:02.116+0000 7f05d2ffd640 1 --2- 172.21.15.19:0/1415965891 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f05d4108020 0x7f05d419ac10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:25:03.752 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:02.116+0000 7f05d2ffd640 1 -- 172.21.15.19:0/1415965891 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f05d41a5550 con 0x7f05d4101c90 2024-09-10T22:25:03.752 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:02.116+0000 7f05d2ffd640 1 --2- 172.21.15.19:0/1415965891 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f05d4101c90 0x7f05d419a150 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f05c400d770 tx=0x7f05c400dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:25:03.752 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:02.117+0000 7f05d8893640 1 -- 172.21.15.19:0/1415965891 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05c4017070 con 0x7f05d4101c90 2024-09-10T22:25:03.752 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:02.117+0000 7f05d9895640 1 -- 172.21.15.19:0/1415965891 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f05d41a5840 con 0x7f05d4101c90 2024-09-10T22:25:03.752 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:02.117+0000 7f05d8893640 1 -- 172.21.15.19:0/1415965891 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f05c40054d0 con 0x7f05d4101c90 2024-09-10T22:25:03.752 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:02.117+0000 7f05d8893640 1 -- 172.21.15.19:0/1415965891 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05c4004d00 con 0x7f05d4101c90 2024-09-10T22:25:03.752 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:02.117+0000 7f05d9895640 1 -- 172.21.15.19:0/1415965891 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f05d41a5d50 con 0x7f05d4101c90 2024-09-10T22:25:03.752 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:02.118+0000 7f05d9895640 1 -- 172.21.15.19:0/1415965891 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f05d40638a0 con 0x7f05d4101c90 2024-09-10T22:25:03.752 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:02.120+0000 7f05d8893640 1 -- 172.21.15.19:0/1415965891 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 17) ==== 153301+0+0 (secure 0 0 0) 0x7f05c4004ea0 con 0x7f05d4101c90 2024-09-10T22:25:03.752 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:02.120+0000 7f05d8893640 1 --2- 172.21.15.19:0/1415965891 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f05c00b5370 0x7f05c00b7830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:25:03.752 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:02.120+0000 7f05cbfff640 1 --2- 172.21.15.19:0/1415965891 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f05c00b5370 0x7f05c00b7830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:25:03.753 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:02.120+0000 7f05d8893640 1 -- 172.21.15.19:0/1415965891 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 7979+0+0 (secure 0 0 0) 0x7f05c40e59a0 con 0x7f05d4101c90 2024-09-10T22:25:03.753 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:02.121+0000 7f05d8893640 1 --2- 172.21.15.19:0/1415965891 >> [v2:172.21.15.19:6818/406328354,v1:172.21.15.19:6819/406328354] conn(0x7f05c00beab0 0x7f05c00c0ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:25:03.753 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:02.121+0000 7f05d8893640 1 -- 172.21.15.19:0/1415965891 --> [v2:172.21.15.19:6818/406328354,v1:172.21.15.19:6819/406328354] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f05c4021e50 con 0x7f05c00beab0 2024-09-10T22:25:03.753 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:02.121+0000 7f05d8893640 1 -- 172.21.15.19:0/1415965891 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_get_version_reply(handle=1 version=73) ==== 24+0+0 (secure 0 0 0) 0x7f05c40e5e80 con 0x7f05d4101c90 2024-09-10T22:25:03.753 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:02.121+0000 7f05d37fe640 1 --2- 172.21.15.19:0/1415965891 >> [v2:172.21.15.19:6818/406328354,v1:172.21.15.19:6819/406328354] conn(0x7f05c00beab0 0x7f05c00c0ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:25:03.753 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:02.121+0000 7f05cbfff640 1 --2- 172.21.15.19:0/1415965891 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f05c00b5370 0x7f05c00b7830 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f05bc031440 tx=0x7f05bc005b50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:25:03.753 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:02.121+0000 7f05d37fe640 1 --2- 172.21.15.19:0/1415965891 >> [v2:172.21.15.19:6818/406328354,v1:172.21.15.19:6819/406328354] conn(0x7f05c00beab0 0x7f05c00c0ed0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:25:03.753 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:02.122+0000 7f05d8893640 1 -- 172.21.15.19:0/1415965891 <== osd.6 v2:172.21.15.19:6818/406328354 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f05c4021e50 con 0x7f05c00beab0 2024-09-10T22:25:03.753 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:02.135+0000 7f05d9895640 1 -- 172.21.15.19:0/1415965891 --> [v2:172.21.15.19:6818/406328354,v1:172.21.15.19:6819/406328354] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f05d4063d20 con 0x7f05c00beab0 2024-09-10T22:25:03.753 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:02.136+0000 7f05d8893640 1 -- 172.21.15.19:0/1415965891 <== osd.6 v2:172.21.15.19:6818/406328354 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f05d4063d20 con 0x7f05c00beab0 2024-09-10T22:25:03.754 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:02.136+0000 7f05d9895640 1 -- 172.21.15.19:0/1415965891 >> [v2:172.21.15.19:6818/406328354,v1:172.21.15.19:6819/406328354] conn(0x7f05c00beab0 msgr2=0x7f05c00c0ed0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:25:03.754 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:02.136+0000 7f05d9895640 1 --2- 172.21.15.19:0/1415965891 >> [v2:172.21.15.19:6818/406328354,v1:172.21.15.19:6819/406328354] conn(0x7f05c00beab0 0x7f05c00c0ed0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:25:03.754 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:02.136+0000 7f05d9895640 1 -- 172.21.15.19:0/1415965891 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f05c00b5370 msgr2=0x7f05c00b7830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:25:03.754 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:02.136+0000 7f05d9895640 1 --2- 172.21.15.19:0/1415965891 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f05c00b5370 0x7f05c00b7830 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f05bc031440 tx=0x7f05bc005b50 comp rx=0 tx=0).stop 2024-09-10T22:25:03.754 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:02.136+0000 7f05d9895640 1 -- 172.21.15.19:0/1415965891 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f05d4101c90 msgr2=0x7f05d419a150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:25:03.754 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:02.136+0000 7f05d9895640 1 --2- 172.21.15.19:0/1415965891 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f05d4101c90 0x7f05d419a150 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f05c400d770 tx=0x7f05c400dc30 comp rx=0 tx=0).stop 2024-09-10T22:25:03.754 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:02.136+0000 7f05d37fe640 1 -- 172.21.15.19:0/1415965891 reap_dead start 2024-09-10T22:25:03.755 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:02.136+0000 7f05d9895640 1 -- 172.21.15.19:0/1415965891 shutdown_connections 2024-09-10T22:25:03.755 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:02.136+0000 7f05d9895640 1 -- 172.21.15.19:0/1415965891 >> 172.21.15.19:0/1415965891 conn(0x7f05d40fd700 msgr2=0x7f05d40ffaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:25:03.755 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:02.137+0000 7f05d9895640 1 -- 172.21.15.19:0/1415965891 shutdown_connections 2024-09-10T22:25:03.755 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:02.137+0000 7f05d9895640 1 -- 172.21.15.19:0/1415965891 wait complete. 2024-09-10T22:25:03.755 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:25:03 smithi019 ceph-mon[31375]: pgmap v302: 97 pgs: 97 active+clean; 639 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 1.4 KiB/s wr, 7 op/s 2024-09-10T22:25:03.859 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:25:03 smithi135 ceph-mon[34789]: pgmap v302: 97 pgs: 97 active+clean; 639 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 1.4 KiB/s wr, 7 op/s 2024-09-10T22:25:03.875 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:25:03 smithi138 ceph-mon[35236]: pgmap v302: 97 pgs: 97 active+clean; 639 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 1.4 KiB/s wr, 7 op/s 2024-09-10T22:25:04.573 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:25:04 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.0", "id": [8, 4]} : dispatch 2024-09-10T22:25:04.573 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:25:04 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.16", "id": [2, 6]} : dispatch 2024-09-10T22:25:04.573 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:25:04 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.17", "id": [5, 1]} : dispatch 2024-09-10T22:25:04.573 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:25:04 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1a", "id": [8, 1]} : dispatch 2024-09-10T22:25:04.573 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:25:04 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [2, 4]} : dispatch 2024-09-10T22:25:04.573 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:25:04 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1f", "id": [7, 11]} : dispatch 2024-09-10T22:25:04.573 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:25:04 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.13", "id": [4, 9]} : dispatch 2024-09-10T22:25:04.573 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:25:04 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1b", "id": [4, 8]} : dispatch 2024-09-10T22:25:04.573 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:25:04 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.21", "id": [5, 9]} : dispatch 2024-09-10T22:25:04.573 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:25:04 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.38", "id": [3, 9]} : dispatch 2024-09-10T22:25:04.657 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:04.654+0000 7f64bef92640 1 -- 172.21.15.19:0/1075070060 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f64b81076c0 msgr2=0x7f64b8107b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:25:04.657 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:04.654+0000 7f64bef92640 1 --2- 172.21.15.19:0/1075070060 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f64b81076c0 0x7f64b8107b00 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f64a0009900 tx=0x7f64a002a410 comp rx=0 tx=0).stop 2024-09-10T22:25:04.657 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:04.654+0000 7f64bef92640 1 -- 172.21.15.19:0/1075070060 shutdown_connections 2024-09-10T22:25:04.657 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:04.654+0000 7f64bef92640 1 --2- 172.21.15.19:0/1075070060 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f64b8108040 0x7f64b810e840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:25:04.658 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:04.654+0000 7f64bef92640 1 --2- 172.21.15.19:0/1075070060 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f64b81076c0 0x7f64b8107b00 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:25:04.658 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:04.654+0000 7f64bef92640 1 --2- 172.21.15.19:0/1075070060 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f64b8101cb0 0x7f64b8102090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:25:04.658 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:04.654+0000 7f64bef92640 1 -- 172.21.15.19:0/1075070060 >> 172.21.15.19:0/1075070060 conn(0x7f64b80fd700 msgr2=0x7f64b80ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:25:04.658 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:04.654+0000 7f64bef92640 1 -- 172.21.15.19:0/1075070060 shutdown_connections 2024-09-10T22:25:04.658 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:04.654+0000 7f64bef92640 1 -- 172.21.15.19:0/1075070060 wait complete. 2024-09-10T22:25:04.658 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:04.655+0000 7f64bef92640 1 Processor -- start 2024-09-10T22:25:04.658 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:04.655+0000 7f64bef92640 1 -- start start 2024-09-10T22:25:04.658 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:04.655+0000 7f64bef92640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f64b8101cb0 0x7f64b819a090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:25:04.658 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:04.655+0000 7f64bef92640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f64b81076c0 0x7f64b819a5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:25:04.658 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:04.655+0000 7f64bef92640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f64b8108040 0x7f64b819ab50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:25:04.658 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:04.655+0000 7f64bef92640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f64b8111d00 con 0x7f64b81076c0 2024-09-10T22:25:04.658 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:04.655+0000 7f64bef92640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f64b8111b80 con 0x7f64b8108040 2024-09-10T22:25:04.659 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:04.655+0000 7f64bef92640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f64b8111e80 con 0x7f64b8101cb0 2024-09-10T22:25:04.659 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:04.655+0000 7f64b7fff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f64b81076c0 0x7f64b819a5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:25:04.659 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:04.655+0000 7f64b7fff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f64b81076c0 0x7f64b819a5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:54176/0 (socket says 172.21.15.19:54176) 2024-09-10T22:25:04.659 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:04.655+0000 7f64b7fff640 1 -- 172.21.15.19:0/3638119875 learned_addr learned my addr 172.21.15.19:0/3638119875 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:25:04.659 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:04.655+0000 7f64bd52f640 1 --2- 172.21.15.19:0/3638119875 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f64b8108040 0x7f64b819ab50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:25:04.659 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:04.655+0000 7f64bcd2e640 1 --2- 172.21.15.19:0/3638119875 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f64b8101cb0 0x7f64b819a090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:25:04.659 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:04.655+0000 7f64b7fff640 1 -- 172.21.15.19:0/3638119875 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f64b8101cb0 msgr2=0x7f64b819a090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:25:04.659 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:04.655+0000 7f64b7fff640 1 --2- 172.21.15.19:0/3638119875 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f64b8101cb0 0x7f64b819a090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:25:04.659 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:04.655+0000 7f64b7fff640 1 -- 172.21.15.19:0/3638119875 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f64b8108040 msgr2=0x7f64b819ab50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:25:04.659 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:04.655+0000 7f64b7fff640 1 --2- 172.21.15.19:0/3638119875 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f64b8108040 0x7f64b819ab50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:25:04.659 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:04.655+0000 7f64b7fff640 1 -- 172.21.15.19:0/3638119875 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f64b81a5490 con 0x7f64b81076c0 2024-09-10T22:25:04.659 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:04.655+0000 7f64bcd2e640 1 --2- 172.21.15.19:0/3638119875 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f64b8101cb0 0x7f64b819a090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T22:25:04.659 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:04.656+0000 7f64b7fff640 1 --2- 172.21.15.19:0/3638119875 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f64b81076c0 0x7f64b819a5d0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f64a0006010 tx=0x7f64a00042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:25:04.660 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:04.656+0000 7f64b5ffb640 1 -- 172.21.15.19:0/3638119875 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64a003f030 con 0x7f64b81076c0 2024-09-10T22:25:04.660 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:04.656+0000 7f64b5ffb640 1 -- 172.21.15.19:0/3638119875 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f64a0003800 con 0x7f64b81076c0 2024-09-10T22:25:04.660 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:04.656+0000 7f64b5ffb640 1 -- 172.21.15.19:0/3638119875 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64a0035070 con 0x7f64b81076c0 2024-09-10T22:25:04.660 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:04.656+0000 7f64bef92640 1 -- 172.21.15.19:0/3638119875 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f64b81a5720 con 0x7f64b81076c0 2024-09-10T22:25:04.660 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:04.656+0000 7f64bef92640 1 -- 172.21.15.19:0/3638119875 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f64b81a5cd0 con 0x7f64b81076c0 2024-09-10T22:25:04.661 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:04.657+0000 7f64bef92640 1 -- 172.21.15.19:0/3638119875 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f64b80638e0 con 0x7f64b81076c0 2024-09-10T22:25:04.661 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:04.659+0000 7f64b5ffb640 1 -- 172.21.15.19:0/3638119875 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 17) ==== 153301+0+0 (secure 0 0 0) 0x7f64a0031b10 con 0x7f64b81076c0 2024-09-10T22:25:04.661 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:04.659+0000 7f64b5ffb640 1 --2- 172.21.15.19:0/3638119875 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f64a40b53f0 0x7f64a40b78b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:25:04.661 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:04.659+0000 7f64b5ffb640 1 -- 172.21.15.19:0/3638119875 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 8269+0+0 (secure 0 0 0) 0x7f64a0106da0 con 0x7f64b81076c0 2024-09-10T22:25:04.662 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:04.659+0000 7f64bcd2e640 1 --2- 172.21.15.19:0/3638119875 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f64a40b53f0 0x7f64a40b78b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:25:04.662 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:04.660+0000 7f64b5ffb640 1 --2- 172.21.15.19:0/3638119875 >> [v2:172.21.15.19:6802/234761879,v1:172.21.15.19:6803/234761879] conn(0x7f64a40bef90 0x7f64a40c1430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:25:04.662 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:04.660+0000 7f64b5ffb640 1 -- 172.21.15.19:0/3638119875 --> [v2:172.21.15.19:6802/234761879,v1:172.21.15.19:6803/234761879] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f64a40c1b00 con 0x7f64a40bef90 2024-09-10T22:25:04.662 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:04.660+0000 7f64b5ffb640 1 -- 172.21.15.19:0/3638119875 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_get_version_reply(handle=1 version=74) ==== 24+0+0 (secure 0 0 0) 0x7f64a01071f0 con 0x7f64b81076c0 2024-09-10T22:25:04.662 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:04.660+0000 7f64bd52f640 1 --2- 172.21.15.19:0/3638119875 >> [v2:172.21.15.19:6802/234761879,v1:172.21.15.19:6803/234761879] conn(0x7f64a40bef90 0x7f64a40c1430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:25:04.662 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:04.660+0000 7f64bcd2e640 1 --2- 172.21.15.19:0/3638119875 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f64a40b53f0 0x7f64a40b78b0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f64a8006fd0 tx=0x7f64a8008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:25:04.662 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:04.660+0000 7f64bd52f640 1 --2- 172.21.15.19:0/3638119875 >> [v2:172.21.15.19:6802/234761879,v1:172.21.15.19:6803/234761879] conn(0x7f64a40bef90 0x7f64a40c1430 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:25:04.663 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:04.661+0000 7f64b5ffb640 1 -- 172.21.15.19:0/3638119875 <== osd.0 v2:172.21.15.19:6802/234761879 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f64a40c1b00 con 0x7f64a40bef90 2024-09-10T22:25:04.675 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:04.674+0000 7f64bef92640 1 -- 172.21.15.19:0/3638119875 --> [v2:172.21.15.19:6802/234761879,v1:172.21.15.19:6803/234761879] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f64b8063ce0 con 0x7f64a40bef90 2024-09-10T22:25:04.676 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:04.675+0000 7f64b5ffb640 1 -- 172.21.15.19:0/3638119875 <== osd.0 v2:172.21.15.19:6802/234761879 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f64b8063ce0 con 0x7f64a40bef90 2024-09-10T22:25:04.677 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:04.675+0000 7f64bef92640 1 -- 172.21.15.19:0/3638119875 >> [v2:172.21.15.19:6802/234761879,v1:172.21.15.19:6803/234761879] conn(0x7f64a40bef90 msgr2=0x7f64a40c1430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:25:04.677 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:04.675+0000 7f64bef92640 1 --2- 172.21.15.19:0/3638119875 >> [v2:172.21.15.19:6802/234761879,v1:172.21.15.19:6803/234761879] conn(0x7f64a40bef90 0x7f64a40c1430 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:25:04.677 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:04.675+0000 7f64bef92640 1 -- 172.21.15.19:0/3638119875 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f64a40b53f0 msgr2=0x7f64a40b78b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:25:04.677 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:04.675+0000 7f64bef92640 1 --2- 172.21.15.19:0/3638119875 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f64a40b53f0 0x7f64a40b78b0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f64a8006fd0 tx=0x7f64a8008040 comp rx=0 tx=0).stop 2024-09-10T22:25:04.677 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:04.675+0000 7f64bef92640 1 -- 172.21.15.19:0/3638119875 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f64b81076c0 msgr2=0x7f64b819a5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:25:04.677 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:04.675+0000 7f64bef92640 1 --2- 172.21.15.19:0/3638119875 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f64b81076c0 0x7f64b819a5d0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f64a0006010 tx=0x7f64a00042f0 comp rx=0 tx=0).stop 2024-09-10T22:25:04.677 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:04.675+0000 7f64bd52f640 1 -- 172.21.15.19:0/3638119875 reap_dead start 2024-09-10T22:25:04.678 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:04.675+0000 7f64bef92640 1 -- 172.21.15.19:0/3638119875 shutdown_connections 2024-09-10T22:25:04.678 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:04.675+0000 7f64bef92640 1 -- 172.21.15.19:0/3638119875 >> 172.21.15.19:0/3638119875 conn(0x7f64b80fd700 msgr2=0x7f64b80ffaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:25:04.678 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:04.675+0000 7f64bef92640 1 -- 172.21.15.19:0/3638119875 shutdown_connections 2024-09-10T22:25:04.678 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:04.675+0000 7f64bef92640 1 -- 172.21.15.19:0/3638119875 wait complete. 2024-09-10T22:25:04.859 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:25:04 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.0", "id": [8, 4]} : dispatch 2024-09-10T22:25:04.860 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:25:04 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.16", "id": [2, 6]} : dispatch 2024-09-10T22:25:04.860 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:25:04 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.17", "id": [5, 1]} : dispatch 2024-09-10T22:25:04.860 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:25:04 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1a", "id": [8, 1]} : dispatch 2024-09-10T22:25:04.860 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:25:04 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [2, 4]} : dispatch 2024-09-10T22:25:04.860 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:25:04 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1f", "id": [7, 11]} : dispatch 2024-09-10T22:25:04.860 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:25:04 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.13", "id": [4, 9]} : dispatch 2024-09-10T22:25:04.860 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:25:04 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1b", "id": [4, 8]} : dispatch 2024-09-10T22:25:04.860 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:25:04 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.21", "id": [5, 9]} : dispatch 2024-09-10T22:25:04.860 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:25:04 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.38", "id": [3, 9]} : dispatch 2024-09-10T22:25:04.875 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:25:04 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.0", "id": [8, 4]} : dispatch 2024-09-10T22:25:04.875 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:25:04 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.16", "id": [2, 6]} : dispatch 2024-09-10T22:25:04.875 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:25:04 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.17", "id": [5, 1]} : dispatch 2024-09-10T22:25:04.875 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:25:04 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1a", "id": [8, 1]} : dispatch 2024-09-10T22:25:04.875 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:25:04 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [2, 4]} : dispatch 2024-09-10T22:25:04.875 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:25:04 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1f", "id": [7, 11]} : dispatch 2024-09-10T22:25:04.875 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:25:04 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.13", "id": [4, 9]} : dispatch 2024-09-10T22:25:04.875 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:25:04 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1b", "id": [4, 8]} : dispatch 2024-09-10T22:25:04.875 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:25:04 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.21", "id": [5, 9]} : dispatch 2024-09-10T22:25:04.875 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:25:04 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.38", "id": [3, 9]} : dispatch 2024-09-10T22:25:04.941 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:00.753+0000 7fd65ec2f640 1 -- 172.21.15.19:0/177109298 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd65810d140 msgr2=0x7fd65810f5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:25:04.941 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:00.753+0000 7fd65ec2f640 1 --2- 172.21.15.19:0/177109298 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd65810d140 0x7fd65810f5a0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fd650009ca0 tx=0x7fd65002a8c0 comp rx=0 tx=0).stop 2024-09-10T22:25:04.942 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:00.753+0000 7fd65ec2f640 1 -- 172.21.15.19:0/177109298 shutdown_connections 2024-09-10T22:25:04.942 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:00.753+0000 7fd65ec2f640 1 --2- 172.21.15.19:0/177109298 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd65810d140 0x7fd65810f5a0 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:25:04.942 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:00.753+0000 7fd65ec2f640 1 --2- 172.21.15.19:0/177109298 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd658104600 0x7fd65810caf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:25:04.942 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:00.753+0000 7fd65ec2f640 1 --2- 172.21.15.19:0/177109298 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd658103ce0 0x7fd6581040c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:25:04.942 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:00.753+0000 7fd65ec2f640 1 -- 172.21.15.19:0/177109298 >> 172.21.15.19:0/177109298 conn(0x7fd6580fd740 msgr2=0x7fd6580ffb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:25:04.942 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:00.753+0000 7fd65ec2f640 1 -- 172.21.15.19:0/177109298 shutdown_connections 2024-09-10T22:25:04.942 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:00.753+0000 7fd65ec2f640 1 -- 172.21.15.19:0/177109298 wait complete. 2024-09-10T22:25:04.942 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:00.754+0000 7fd65ec2f640 1 Processor -- start 2024-09-10T22:25:04.942 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:00.754+0000 7fd65ec2f640 1 -- start start 2024-09-10T22:25:04.942 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:00.754+0000 7fd65ec2f640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd658103ce0 0x7fd658199340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:25:04.942 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:00.754+0000 7fd65ec2f640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd658104600 0x7fd658199880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:25:04.942 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:00.754+0000 7fd65ec2f640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd65810d140 0x7fd65819ec20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:25:04.943 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:00.754+0000 7fd65ec2f640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fd658112db0 con 0x7fd658103ce0 2024-09-10T22:25:04.943 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:00.754+0000 7fd65ec2f640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fd658112c30 con 0x7fd65810d140 2024-09-10T22:25:04.943 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:00.754+0000 7fd65ec2f640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7fd658112f30 con 0x7fd658104600 2024-09-10T22:25:04.943 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:00.754+0000 7fd65c9cb640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd658103ce0 0x7fd658199340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:25:04.943 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:00.754+0000 7fd65c9cb640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd658103ce0 0x7fd658199340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:41506/0 (socket says 172.21.15.19:41506) 2024-09-10T22:25:04.943 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:00.754+0000 7fd65c9cb640 1 -- 172.21.15.19:0/3008623610 learned_addr learned my addr 172.21.15.19:0/3008623610 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:25:04.943 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:00.754+0000 7fd65d1cc640 1 --2- 172.21.15.19:0/3008623610 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd65810d140 0x7fd65819ec20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:25:04.943 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:00.754+0000 7fd657fff640 1 --2- 172.21.15.19:0/3008623610 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd658104600 0x7fd658199880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:25:04.943 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:00.754+0000 7fd65c9cb640 1 -- 172.21.15.19:0/3008623610 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd658104600 msgr2=0x7fd658199880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:25:04.943 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:00.754+0000 7fd65c9cb640 1 --2- 172.21.15.19:0/3008623610 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd658104600 0x7fd658199880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:25:04.943 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:00.754+0000 7fd65c9cb640 1 -- 172.21.15.19:0/3008623610 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd65810d140 msgr2=0x7fd65819ec20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:25:04.943 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:00.754+0000 7fd65c9cb640 1 --2- 172.21.15.19:0/3008623610 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd65810d140 0x7fd65819ec20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:25:04.943 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:00.754+0000 7fd65c9cb640 1 -- 172.21.15.19:0/3008623610 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd65819f3f0 con 0x7fd658103ce0 2024-09-10T22:25:04.943 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:00.754+0000 7fd657fff640 1 --2- 172.21.15.19:0/3008623610 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd658104600 0x7fd658199880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T22:25:04.944 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:00.754+0000 7fd65c9cb640 1 --2- 172.21.15.19:0/3008623610 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd658103ce0 0x7fd658199340 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fd64c00d950 tx=0x7fd64c00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:25:04.944 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:00.755+0000 7fd655ffb640 1 -- 172.21.15.19:0/3008623610 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd64c017070 con 0x7fd658103ce0 2024-09-10T22:25:04.944 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:00.755+0000 7fd655ffb640 1 -- 172.21.15.19:0/3008623610 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd64c009c30 con 0x7fd658103ce0 2024-09-10T22:25:04.944 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:00.755+0000 7fd65ec2f640 1 -- 172.21.15.19:0/3008623610 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd65819f6e0 con 0x7fd658103ce0 2024-09-10T22:25:04.944 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:00.755+0000 7fd655ffb640 1 -- 172.21.15.19:0/3008623610 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd64c00f620 con 0x7fd658103ce0 2024-09-10T22:25:04.944 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:00.755+0000 7fd65ec2f640 1 -- 172.21.15.19:0/3008623610 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd6581a5da0 con 0x7fd658103ce0 2024-09-10T22:25:04.944 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:00.756+0000 7fd65ec2f640 1 -- 172.21.15.19:0/3008623610 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fd6580638e0 con 0x7fd658103ce0 2024-09-10T22:25:04.945 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:00.757+0000 7fd655ffb640 1 -- 172.21.15.19:0/3008623610 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 17) ==== 153301+0+0 (secure 0 0 0) 0x7fd64c010460 con 0x7fd658103ce0 2024-09-10T22:25:04.945 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:00.758+0000 7fd655ffb640 1 --2- 172.21.15.19:0/3008623610 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7fd6480b5370 0x7fd6480b7830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:25:04.945 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:00.758+0000 7fd657fff640 1 --2- 172.21.15.19:0/3008623610 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7fd6480b5370 0x7fd6480b7830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:25:04.945 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:00.758+0000 7fd655ffb640 1 -- 172.21.15.19:0/3008623610 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 7979+0+0 (secure 0 0 0) 0x7fd64c0e5d50 con 0x7fd658103ce0 2024-09-10T22:25:04.945 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:00.758+0000 7fd655ffb640 1 --2- 172.21.15.19:0/3008623610 >> [v2:172.21.15.138:6824/1098434807,v1:172.21.15.138:6825/1098434807] conn(0x7fd6480beab0 0x7fd6480c0ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:25:04.945 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:00.758+0000 7fd655ffb640 1 -- 172.21.15.19:0/3008623610 --> [v2:172.21.15.138:6824/1098434807,v1:172.21.15.138:6825/1098434807] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fd64c022e70 con 0x7fd6480beab0 2024-09-10T22:25:04.945 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:00.758+0000 7fd655ffb640 1 -- 172.21.15.19:0/3008623610 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_get_version_reply(handle=1 version=73) ==== 24+0+0 (secure 0 0 0) 0x7fd64c0e6230 con 0x7fd658103ce0 2024-09-10T22:25:04.945 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:00.758+0000 7fd657fff640 1 --2- 172.21.15.19:0/3008623610 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7fd6480b5370 0x7fd6480b7830 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fd65810f850 tx=0x7fd644005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:25:04.945 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:00.759+0000 7fd65d1cc640 1 --2- 172.21.15.19:0/3008623610 >> [v2:172.21.15.138:6824/1098434807,v1:172.21.15.138:6825/1098434807] conn(0x7fd6480beab0 0x7fd6480c0ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:25:04.945 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:00.759+0000 7fd65d1cc640 1 --2- 172.21.15.19:0/3008623610 >> [v2:172.21.15.138:6824/1098434807,v1:172.21.15.138:6825/1098434807] conn(0x7fd6480beab0 0x7fd6480c0ed0 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.11 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:25:04.945 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:00.760+0000 7fd655ffb640 1 -- 172.21.15.19:0/3008623610 <== osd.11 v2:172.21.15.138:6824/1098434807 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fd64c022e70 con 0x7fd6480beab0 2024-09-10T22:25:04.945 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:00.774+0000 7fd65ec2f640 1 -- 172.21.15.19:0/3008623610 --> [v2:172.21.15.138:6824/1098434807,v1:172.21.15.138:6825/1098434807] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fd658063d60 con 0x7fd6480beab0 2024-09-10T22:25:04.946 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:00.774+0000 7fd655ffb640 1 -- 172.21.15.19:0/3008623610 <== osd.11 v2:172.21.15.138:6824/1098434807 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7fd658063d60 con 0x7fd6480beab0 2024-09-10T22:25:04.946 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:00.775+0000 7fd65ec2f640 1 -- 172.21.15.19:0/3008623610 >> [v2:172.21.15.138:6824/1098434807,v1:172.21.15.138:6825/1098434807] conn(0x7fd6480beab0 msgr2=0x7fd6480c0ed0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:25:04.946 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:00.775+0000 7fd65ec2f640 1 --2- 172.21.15.19:0/3008623610 >> [v2:172.21.15.138:6824/1098434807,v1:172.21.15.138:6825/1098434807] conn(0x7fd6480beab0 0x7fd6480c0ed0 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:25:04.946 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:00.775+0000 7fd65ec2f640 1 -- 172.21.15.19:0/3008623610 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7fd6480b5370 msgr2=0x7fd6480b7830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:25:04.946 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:00.775+0000 7fd65ec2f640 1 --2- 172.21.15.19:0/3008623610 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7fd6480b5370 0x7fd6480b7830 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fd65810f850 tx=0x7fd644005f90 comp rx=0 tx=0).stop 2024-09-10T22:25:04.946 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:00.775+0000 7fd65ec2f640 1 -- 172.21.15.19:0/3008623610 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd658103ce0 msgr2=0x7fd658199340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:25:04.946 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:00.775+0000 7fd65ec2f640 1 --2- 172.21.15.19:0/3008623610 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd658103ce0 0x7fd658199340 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fd64c00d950 tx=0x7fd64c00de10 comp rx=0 tx=0).stop 2024-09-10T22:25:04.946 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:00.775+0000 7fd65d1cc640 1 -- 172.21.15.19:0/3008623610 reap_dead start 2024-09-10T22:25:04.946 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:00.775+0000 7fd65ec2f640 1 -- 172.21.15.19:0/3008623610 shutdown_connections 2024-09-10T22:25:04.946 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:00.775+0000 7fd65ec2f640 1 -- 172.21.15.19:0/3008623610 >> 172.21.15.19:0/3008623610 conn(0x7fd6580fd740 msgr2=0x7fd6580fe440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:25:04.946 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:00.775+0000 7fd65ec2f640 1 -- 172.21.15.19:0/3008623610 shutdown_connections 2024-09-10T22:25:04.946 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:00.775+0000 7fd65ec2f640 1 -- 172.21.15.19:0/3008623610 wait complete. 2024-09-10T22:25:05.459 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:05.408+0000 7f3b4743f640 1 -- 172.21.15.19:0/2735282233 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3b40103ce0 msgr2=0x7f3b401040c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:25:05.460 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:05.408+0000 7f3b4743f640 1 --2- 172.21.15.19:0/2735282233 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3b40103ce0 0x7f3b401040c0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f3b3c009900 tx=0x7f3b3c02a410 comp rx=0 tx=0).stop 2024-09-10T22:25:05.460 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:05.408+0000 7f3b4743f640 1 -- 172.21.15.19:0/2735282233 shutdown_connections 2024-09-10T22:25:05.460 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:05.408+0000 7f3b4743f640 1 --2- 172.21.15.19:0/2735282233 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3b4010d140 0x7f3b4010f5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:25:05.460 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:05.408+0000 7f3b4743f640 1 --2- 172.21.15.19:0/2735282233 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3b40104600 0x7f3b4010caf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:25:05.460 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:05.408+0000 7f3b4743f640 1 --2- 172.21.15.19:0/2735282233 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3b40103ce0 0x7f3b401040c0 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:25:05.460 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:05.408+0000 7f3b4743f640 1 -- 172.21.15.19:0/2735282233 >> 172.21.15.19:0/2735282233 conn(0x7f3b400fd700 msgr2=0x7f3b400ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:25:05.460 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:05.408+0000 7f3b4743f640 1 -- 172.21.15.19:0/2735282233 shutdown_connections 2024-09-10T22:25:05.460 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:05.408+0000 7f3b4743f640 1 -- 172.21.15.19:0/2735282233 wait complete. 2024-09-10T22:25:05.460 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:05.409+0000 7f3b4743f640 1 Processor -- start 2024-09-10T22:25:05.460 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:05.409+0000 7f3b4743f640 1 -- start start 2024-09-10T22:25:05.461 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:05.410+0000 7f3b4743f640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3b40103ce0 0x7f3b40199360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:25:05.461 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:05.410+0000 7f3b4743f640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3b40104600 0x7f3b401998a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:25:05.461 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:05.410+0000 7f3b4743f640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3b4010d140 0x7f3b4019ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:25:05.461 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:05.410+0000 7f3b4743f640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f3b40112e10 con 0x7f3b4010d140 2024-09-10T22:25:05.461 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:05.410+0000 7f3b4743f640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f3b40112c90 con 0x7f3b40103ce0 2024-09-10T22:25:05.461 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:05.410+0000 7f3b4743f640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f3b40112f90 con 0x7f3b40104600 2024-09-10T22:25:05.461 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:05.410+0000 7f3b459dc640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3b4010d140 0x7f3b4019ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:25:05.461 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:05.410+0000 7f3b459dc640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3b4010d140 0x7f3b4019ec40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:54218/0 (socket says 172.21.15.19:54218) 2024-09-10T22:25:05.461 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:05.410+0000 7f3b459dc640 1 -- 172.21.15.19:0/1489277725 learned_addr learned my addr 172.21.15.19:0/1489277725 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:25:05.461 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:05.410+0000 7f3b451db640 1 --2- 172.21.15.19:0/1489277725 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3b40103ce0 0x7f3b40199360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:25:05.461 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:05.410+0000 7f3b449da640 1 --2- 172.21.15.19:0/1489277725 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3b40104600 0x7f3b401998a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:25:05.461 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:05.410+0000 7f3b459dc640 1 -- 172.21.15.19:0/1489277725 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3b40104600 msgr2=0x7f3b401998a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:25:05.462 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:05.410+0000 7f3b459dc640 1 --2- 172.21.15.19:0/1489277725 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3b40104600 0x7f3b401998a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:25:05.462 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:05.410+0000 7f3b459dc640 1 -- 172.21.15.19:0/1489277725 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3b40103ce0 msgr2=0x7f3b40199360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:25:05.462 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:05.410+0000 7f3b459dc640 1 --2- 172.21.15.19:0/1489277725 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3b40103ce0 0x7f3b40199360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:25:05.462 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:05.410+0000 7f3b459dc640 1 -- 172.21.15.19:0/1489277725 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3b4019f410 con 0x7f3b4010d140 2024-09-10T22:25:05.462 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:05.410+0000 7f3b459dc640 1 --2- 172.21.15.19:0/1489277725 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3b4010d140 0x7f3b4019ec40 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f3b3800cad0 tx=0x7f3b3800cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:25:05.462 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:05.410+0000 7f3b367fc640 1 -- 172.21.15.19:0/1489277725 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b3800ae20 con 0x7f3b4010d140 2024-09-10T22:25:05.462 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:05.410+0000 7f3b367fc640 1 -- 172.21.15.19:0/1489277725 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3b38005020 con 0x7f3b4010d140 2024-09-10T22:25:05.462 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:05.410+0000 7f3b4743f640 1 -- 172.21.15.19:0/1489277725 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3b4019f700 con 0x7f3b4010d140 2024-09-10T22:25:05.462 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:05.410+0000 7f3b367fc640 1 -- 172.21.15.19:0/1489277725 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b3800f6b0 con 0x7f3b4010d140 2024-09-10T22:25:05.462 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:05.410+0000 7f3b4743f640 1 -- 172.21.15.19:0/1489277725 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3b401a5e40 con 0x7f3b4010d140 2024-09-10T22:25:05.462 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:05.411+0000 7f3b4743f640 1 -- 172.21.15.19:0/1489277725 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f3b400ffcf0 con 0x7f3b4010d140 2024-09-10T22:25:05.462 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:05.413+0000 7f3b367fc640 1 -- 172.21.15.19:0/1489277725 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 17) ==== 153301+0+0 (secure 0 0 0) 0x7f3b380054f0 con 0x7f3b4010d140 2024-09-10T22:25:05.462 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:05.414+0000 7f3b367fc640 1 --2- 172.21.15.19:0/1489277725 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f3b2c0b5370 0x7f3b2c0b7830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:25:05.463 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:05.414+0000 7f3b451db640 1 --2- 172.21.15.19:0/1489277725 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f3b2c0b5370 0x7f3b2c0b7830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:25:05.463 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:05.414+0000 7f3b367fc640 1 -- 172.21.15.19:0/1489277725 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 8269+0+0 (secure 0 0 0) 0x7f3b380e6230 con 0x7f3b4010d140 2024-09-10T22:25:05.463 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:05.414+0000 7f3b367fc640 1 --2- 172.21.15.19:0/1489277725 >> [v2:172.21.15.135:6800/1803526886,v1:172.21.15.135:6801/1803526886] conn(0x7f3b2c0bef10 0x7f3b2c0c13b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:25:05.463 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:05.414+0000 7f3b367fc640 1 -- 172.21.15.19:0/1489277725 --> [v2:172.21.15.135:6800/1803526886,v1:172.21.15.135:6801/1803526886] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f3b38016ec0 con 0x7f3b2c0bef10 2024-09-10T22:25:05.463 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:05.414+0000 7f3b367fc640 1 -- 172.21.15.19:0/1489277725 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_get_version_reply(handle=1 version=74) ==== 24+0+0 (secure 0 0 0) 0x7f3b380e6680 con 0x7f3b4010d140 2024-09-10T22:25:05.463 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:05.414+0000 7f3b451db640 1 --2- 172.21.15.19:0/1489277725 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f3b2c0b5370 0x7f3b2c0b7830 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f3b3c031440 tx=0x7f3b3c005e80 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:25:05.463 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:05.414+0000 7f3b449da640 1 --2- 172.21.15.19:0/1489277725 >> [v2:172.21.15.135:6800/1803526886,v1:172.21.15.135:6801/1803526886] conn(0x7f3b2c0bef10 0x7f3b2c0c13b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:25:05.463 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:05.415+0000 7f3b449da640 1 --2- 172.21.15.19:0/1489277725 >> [v2:172.21.15.135:6800/1803526886,v1:172.21.15.135:6801/1803526886] conn(0x7f3b2c0bef10 0x7f3b2c0c13b0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:25:05.463 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:05.416+0000 7f3b367fc640 1 -- 172.21.15.19:0/1489277725 <== osd.1 v2:172.21.15.135:6800/1803526886 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f3b38016ec0 con 0x7f3b2c0bef10 2024-09-10T22:25:05.464 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:05.429+0000 7f3b4743f640 1 -- 172.21.15.19:0/1489277725 --> [v2:172.21.15.135:6800/1803526886,v1:172.21.15.135:6801/1803526886] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f3b4006bb90 con 0x7f3b2c0bef10 2024-09-10T22:25:05.464 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:05.430+0000 7f3b367fc640 1 -- 172.21.15.19:0/1489277725 <== osd.1 v2:172.21.15.135:6800/1803526886 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f3b4006bb90 con 0x7f3b2c0bef10 2024-09-10T22:25:05.464 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:05.430+0000 7f3b4743f640 1 -- 172.21.15.19:0/1489277725 >> [v2:172.21.15.135:6800/1803526886,v1:172.21.15.135:6801/1803526886] conn(0x7f3b2c0bef10 msgr2=0x7f3b2c0c13b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:25:05.464 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:05.430+0000 7f3b4743f640 1 --2- 172.21.15.19:0/1489277725 >> [v2:172.21.15.135:6800/1803526886,v1:172.21.15.135:6801/1803526886] conn(0x7f3b2c0bef10 0x7f3b2c0c13b0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:25:05.464 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:05.430+0000 7f3b4743f640 1 -- 172.21.15.19:0/1489277725 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f3b2c0b5370 msgr2=0x7f3b2c0b7830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:25:05.464 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:05.430+0000 7f3b4743f640 1 --2- 172.21.15.19:0/1489277725 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f3b2c0b5370 0x7f3b2c0b7830 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f3b3c031440 tx=0x7f3b3c005e80 comp rx=0 tx=0).stop 2024-09-10T22:25:05.464 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:05.430+0000 7f3b4743f640 1 -- 172.21.15.19:0/1489277725 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3b4010d140 msgr2=0x7f3b4019ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:25:05.464 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:05.430+0000 7f3b4743f640 1 --2- 172.21.15.19:0/1489277725 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3b4010d140 0x7f3b4019ec40 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f3b3800cad0 tx=0x7f3b3800cf90 comp rx=0 tx=0).stop 2024-09-10T22:25:05.464 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:05.431+0000 7f3b459dc640 1 -- 172.21.15.19:0/1489277725 reap_dead start 2024-09-10T22:25:05.464 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:05.431+0000 7f3b4743f640 1 -- 172.21.15.19:0/1489277725 shutdown_connections 2024-09-10T22:25:05.464 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:05.431+0000 7f3b4743f640 1 -- 172.21.15.19:0/1489277725 >> 172.21.15.19:0/1489277725 conn(0x7f3b400fd700 msgr2=0x7f3b400fe300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:25:05.465 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:05.431+0000 7f3b4743f640 1 -- 172.21.15.19:0/1489277725 shutdown_connections 2024-09-10T22:25:05.465 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:05.431+0000 7f3b4743f640 1 -- 172.21.15.19:0/1489277725 wait complete. 2024-09-10T22:25:05.797 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:25:05 smithi019 ceph-mon[31375]: pgmap v303: 97 pgs: 97 active+clean; 639 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 597 B/s wr, 5 op/s 2024-09-10T22:25:05.797 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:25:05 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.0", "id": [8, 4]}]': finished 2024-09-10T22:25:05.797 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:25:05 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.16", "id": [2, 6]}]': finished 2024-09-10T22:25:05.797 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:25:05 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.17", "id": [5, 1]}]': finished 2024-09-10T22:25:05.798 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:25:05 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1a", "id": [8, 1]}]': finished 2024-09-10T22:25:05.798 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:25:05 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [2, 4]}]': finished 2024-09-10T22:25:05.798 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:25:05 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1f", "id": [7, 11]}]': finished 2024-09-10T22:25:05.798 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:25:05 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.13", "id": [4, 9]}]': finished 2024-09-10T22:25:05.798 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:25:05 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1b", "id": [4, 8]}]': finished 2024-09-10T22:25:05.798 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:25:05 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.21", "id": [5, 9]}]': finished 2024-09-10T22:25:05.799 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:25:05 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.38", "id": [3, 9]}]': finished 2024-09-10T22:25:05.799 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:25:05 smithi019 ceph-mon[31375]: osdmap e74: 12 total, 12 up, 12 in 2024-09-10T22:25:05.860 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:25:05 smithi135 ceph-mon[34789]: pgmap v303: 97 pgs: 97 active+clean; 639 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 597 B/s wr, 5 op/s 2024-09-10T22:25:05.860 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:25:05 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.0", "id": [8, 4]}]': finished 2024-09-10T22:25:05.860 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:25:05 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.16", "id": [2, 6]}]': finished 2024-09-10T22:25:05.860 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:25:05 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.17", "id": [5, 1]}]': finished 2024-09-10T22:25:05.860 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:25:05 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1a", "id": [8, 1]}]': finished 2024-09-10T22:25:05.860 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:25:05 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [2, 4]}]': finished 2024-09-10T22:25:05.860 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:25:05 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1f", "id": [7, 11]}]': finished 2024-09-10T22:25:05.860 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:25:05 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.13", "id": [4, 9]}]': finished 2024-09-10T22:25:05.860 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:25:05 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1b", "id": [4, 8]}]': finished 2024-09-10T22:25:05.860 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:25:05 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.21", "id": [5, 9]}]': finished 2024-09-10T22:25:05.861 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:25:05 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.38", "id": [3, 9]}]': finished 2024-09-10T22:25:05.861 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:25:05 smithi135 ceph-mon[34789]: osdmap e74: 12 total, 12 up, 12 in 2024-09-10T22:25:05.875 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:25:05 smithi138 ceph-mon[35236]: pgmap v303: 97 pgs: 97 active+clean; 639 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 597 B/s wr, 5 op/s 2024-09-10T22:25:05.875 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:25:05 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.0", "id": [8, 4]}]': finished 2024-09-10T22:25:05.875 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:25:05 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.16", "id": [2, 6]}]': finished 2024-09-10T22:25:05.875 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:25:05 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.17", "id": [5, 1]}]': finished 2024-09-10T22:25:05.875 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:25:05 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1a", "id": [8, 1]}]': finished 2024-09-10T22:25:05.875 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:25:05 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [2, 4]}]': finished 2024-09-10T22:25:05.875 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:25:05 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1f", "id": [7, 11]}]': finished 2024-09-10T22:25:05.875 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:25:05 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.13", "id": [4, 9]}]': finished 2024-09-10T22:25:05.876 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:25:05 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1b", "id": [4, 8]}]': finished 2024-09-10T22:25:05.876 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:25:05 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.21", "id": [5, 9]}]': finished 2024-09-10T22:25:05.876 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:25:05 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.38", "id": [3, 9]}]': finished 2024-09-10T22:25:05.876 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:25:05 smithi138 ceph-mon[35236]: osdmap e74: 12 total, 12 up, 12 in 2024-09-10T22:25:06.822 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:25:06 smithi019 ceph-mon[31375]: osdmap e75: 12 total, 12 up, 12 in 2024-09-10T22:25:06.854 INFO:teuthology.orchestra.run.smithi019.stdout:34359738445 2024-09-10T22:25:06.855 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 22997a4c-6fc2-11ef-bcea-c7b262605968 -- ceph osd last-stat-seq osd.0 2024-09-10T22:25:06.859 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:25:06 smithi135 ceph-mon[34789]: osdmap e75: 12 total, 12 up, 12 in 2024-09-10T22:25:06.875 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:25:06 smithi138 ceph-mon[35236]: osdmap e75: 12 total, 12 up, 12 in 2024-09-10T22:25:07.286 INFO:teuthology.orchestra.run.smithi019.stdout:51539607623 2024-09-10T22:25:07.286 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 22997a4c-6fc2-11ef-bcea-c7b262605968 -- ceph osd last-stat-seq osd.1 2024-09-10T22:25:07.447 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:07.444+0000 7fd9efcae640 1 -- 172.21.15.19:0/209756834 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd9e8103ca0 msgr2=0x7fd9e8104080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:25:07.447 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:07.444+0000 7fd9efcae640 1 --2- 172.21.15.19:0/209756834 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd9e8103ca0 0x7fd9e8104080 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fd9e4009900 tx=0x7fd9e402a410 comp rx=0 tx=0).stop 2024-09-10T22:25:07.447 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:07.444+0000 7fd9efcae640 1 -- 172.21.15.19:0/209756834 shutdown_connections 2024-09-10T22:25:07.448 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:07.444+0000 7fd9efcae640 1 --2- 172.21.15.19:0/209756834 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd9e810d100 0x7fd9e810f560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:25:07.448 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:07.444+0000 7fd9efcae640 1 --2- 172.21.15.19:0/209756834 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd9e81045c0 0x7fd9e810cab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:25:07.448 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:07.444+0000 7fd9efcae640 1 --2- 172.21.15.19:0/209756834 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd9e8103ca0 0x7fd9e8104080 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:25:07.448 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:07.444+0000 7fd9efcae640 1 -- 172.21.15.19:0/209756834 >> 172.21.15.19:0/209756834 conn(0x7fd9e80fd700 msgr2=0x7fd9e80ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:25:07.448 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:07.445+0000 7fd9efcae640 1 -- 172.21.15.19:0/209756834 shutdown_connections 2024-09-10T22:25:07.448 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:07.445+0000 7fd9efcae640 1 -- 172.21.15.19:0/209756834 wait complete. 2024-09-10T22:25:07.448 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:07.445+0000 7fd9efcae640 1 Processor -- start 2024-09-10T22:25:07.448 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:07.445+0000 7fd9efcae640 1 -- start start 2024-09-10T22:25:07.448 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:07.445+0000 7fd9efcae640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd9e8103ca0 0x7fd9e8101950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:25:07.448 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:07.445+0000 7fd9efcae640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd9e81045c0 0x7fd9e8101e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:25:07.448 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:07.445+0000 7fd9efcae640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd9e810d100 0x7fd9e81023d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:25:07.448 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:07.445+0000 7fd9efcae640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fd9e8112e50 con 0x7fd9e810d100 2024-09-10T22:25:07.448 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:07.445+0000 7fd9efcae640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fd9e8112cd0 con 0x7fd9e8103ca0 2024-09-10T22:25:07.449 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:07.445+0000 7fd9efcae640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7fd9e8112fd0 con 0x7fd9e81045c0 2024-09-10T22:25:07.449 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:07.446+0000 7fd9ee24b640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd9e810d100 0x7fd9e81023d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:25:07.449 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:07.446+0000 7fd9ee24b640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd9e810d100 0x7fd9e81023d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:54240/0 (socket says 172.21.15.19:54240) 2024-09-10T22:25:07.449 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:07.446+0000 7fd9ee24b640 1 -- 172.21.15.19:0/2870610543 learned_addr learned my addr 172.21.15.19:0/2870610543 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:25:07.449 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:07.446+0000 7fd9ed249640 1 --2- 172.21.15.19:0/2870610543 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd9e81045c0 0x7fd9e8101e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:25:07.449 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:07.446+0000 7fd9eda4a640 1 --2- 172.21.15.19:0/2870610543 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd9e8103ca0 0x7fd9e8101950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:25:07.449 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:07.446+0000 7fd9ee24b640 1 -- 172.21.15.19:0/2870610543 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd9e81045c0 msgr2=0x7fd9e8101e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:25:07.449 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:07.446+0000 7fd9ee24b640 1 --2- 172.21.15.19:0/2870610543 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd9e81045c0 0x7fd9e8101e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:25:07.449 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:07.446+0000 7fd9ee24b640 1 -- 172.21.15.19:0/2870610543 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd9e8103ca0 msgr2=0x7fd9e8101950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:25:07.449 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:07.446+0000 7fd9ee24b640 1 --2- 172.21.15.19:0/2870610543 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd9e8103ca0 0x7fd9e8101950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:25:07.449 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:07.446+0000 7fd9ee24b640 1 -- 172.21.15.19:0/2870610543 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd9e81a7880 con 0x7fd9e810d100 2024-09-10T22:25:07.449 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:07.446+0000 7fd9ee24b640 1 --2- 172.21.15.19:0/2870610543 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd9e810d100 0x7fd9e81023d0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fd9e000b970 tx=0x7fd9e000be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:25:07.450 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:07.446+0000 7fd9deffd640 1 -- 172.21.15.19:0/2870610543 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9e0019070 con 0x7fd9e810d100 2024-09-10T22:25:07.450 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:07.446+0000 7fd9deffd640 1 -- 172.21.15.19:0/2870610543 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd9e0014440 con 0x7fd9e810d100 2024-09-10T22:25:07.450 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:07.446+0000 7fd9efcae640 1 -- 172.21.15.19:0/2870610543 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd9e81a7b70 con 0x7fd9e810d100 2024-09-10T22:25:07.450 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:07.447+0000 7fd9deffd640 1 -- 172.21.15.19:0/2870610543 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9e00075d0 con 0x7fd9e810d100 2024-09-10T22:25:07.450 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:07.447+0000 7fd9efcae640 1 -- 172.21.15.19:0/2870610543 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd9e81a8000 con 0x7fd9e810d100 2024-09-10T22:25:07.451 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:07.448+0000 7fd9efcae640 1 -- 172.21.15.19:0/2870610543 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fd9e80ffd30 con 0x7fd9e810d100 2024-09-10T22:25:07.451 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:07.450+0000 7fd9deffd640 1 -- 172.21.15.19:0/2870610543 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 17) ==== 153301+0+0 (secure 0 0 0) 0x7fd9e0026050 con 0x7fd9e810d100 2024-09-10T22:25:07.452 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:07.450+0000 7fd9deffd640 1 --2- 172.21.15.19:0/2870610543 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7fd9d40b5370 0x7fd9d40b7830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:25:07.452 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:07.450+0000 7fd9eda4a640 1 --2- 172.21.15.19:0/2870610543 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7fd9d40b5370 0x7fd9d40b7830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:25:07.452 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:07.450+0000 7fd9deffd640 1 -- 172.21.15.19:0/2870610543 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8269+0+0 (secure 0 0 0) 0x7fd9e00e5ad0 con 0x7fd9e810d100 2024-09-10T22:25:07.452 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:07.451+0000 7fd9deffd640 1 --2- 172.21.15.19:0/2870610543 >> [v2:172.21.15.138:6800/2747418770,v1:172.21.15.138:6801/2747418770] conn(0x7fd9d40bef10 0x7fd9d40c13b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:25:07.452 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:07.451+0000 7fd9deffd640 1 -- 172.21.15.19:0/2870610543 --> [v2:172.21.15.138:6800/2747418770,v1:172.21.15.138:6801/2747418770] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fd9e00047d0 con 0x7fd9d40bef10 2024-09-10T22:25:07.452 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:07.451+0000 7fd9deffd640 1 -- 172.21.15.19:0/2870610543 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_get_version_reply(handle=1 version=75) ==== 24+0+0 (secure 0 0 0) 0x7fd9e00e5e80 con 0x7fd9e810d100 2024-09-10T22:25:07.453 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:07.451+0000 7fd9eda4a640 1 --2- 172.21.15.19:0/2870610543 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7fd9d40b5370 0x7fd9d40b7830 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fd9e4031440 tx=0x7fd9e40095f0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:25:07.453 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:07.451+0000 7fd9ed249640 1 --2- 172.21.15.19:0/2870610543 >> [v2:172.21.15.138:6800/2747418770,v1:172.21.15.138:6801/2747418770] conn(0x7fd9d40bef10 0x7fd9d40c13b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:25:07.453 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:07.451+0000 7fd9ed249640 1 --2- 172.21.15.19:0/2870610543 >> [v2:172.21.15.138:6800/2747418770,v1:172.21.15.138:6801/2747418770] conn(0x7fd9d40bef10 0x7fd9d40c13b0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:25:07.453 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:07.452+0000 7fd9deffd640 1 -- 172.21.15.19:0/2870610543 <== osd.2 v2:172.21.15.138:6800/2747418770 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fd9e00047d0 con 0x7fd9d40bef10 2024-09-10T22:25:07.467 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:07.466+0000 7fd9efcae640 1 -- 172.21.15.19:0/2870610543 --> [v2:172.21.15.138:6800/2747418770,v1:172.21.15.138:6801/2747418770] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fd9e806b1b0 con 0x7fd9d40bef10 2024-09-10T22:25:07.467 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:07.466+0000 7fd9deffd640 1 -- 172.21.15.19:0/2870610543 <== osd.2 v2:172.21.15.138:6800/2747418770 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fd9e806b1b0 con 0x7fd9d40bef10 2024-09-10T22:25:07.468 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:07.467+0000 7fd9efcae640 1 -- 172.21.15.19:0/2870610543 >> [v2:172.21.15.138:6800/2747418770,v1:172.21.15.138:6801/2747418770] conn(0x7fd9d40bef10 msgr2=0x7fd9d40c13b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:25:07.469 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:07.467+0000 7fd9efcae640 1 --2- 172.21.15.19:0/2870610543 >> [v2:172.21.15.138:6800/2747418770,v1:172.21.15.138:6801/2747418770] conn(0x7fd9d40bef10 0x7fd9d40c13b0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:25:07.469 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:07.467+0000 7fd9efcae640 1 -- 172.21.15.19:0/2870610543 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7fd9d40b5370 msgr2=0x7fd9d40b7830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:25:07.469 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:07.467+0000 7fd9efcae640 1 --2- 172.21.15.19:0/2870610543 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7fd9d40b5370 0x7fd9d40b7830 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fd9e4031440 tx=0x7fd9e40095f0 comp rx=0 tx=0).stop 2024-09-10T22:25:07.469 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:07.467+0000 7fd9efcae640 1 -- 172.21.15.19:0/2870610543 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd9e810d100 msgr2=0x7fd9e81023d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:25:07.469 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:07.467+0000 7fd9efcae640 1 --2- 172.21.15.19:0/2870610543 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd9e810d100 0x7fd9e81023d0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fd9e000b970 tx=0x7fd9e000be30 comp rx=0 tx=0).stop 2024-09-10T22:25:07.469 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:07.467+0000 7fd9ee24b640 1 -- 172.21.15.19:0/2870610543 reap_dead start 2024-09-10T22:25:07.469 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:07.467+0000 7fd9efcae640 1 -- 172.21.15.19:0/2870610543 shutdown_connections 2024-09-10T22:25:07.469 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:07.467+0000 7fd9efcae640 1 -- 172.21.15.19:0/2870610543 >> 172.21.15.19:0/2870610543 conn(0x7fd9e80fd700 msgr2=0x7fd9e80fe300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:25:07.469 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:07.467+0000 7fd9efcae640 1 -- 172.21.15.19:0/2870610543 shutdown_connections 2024-09-10T22:25:07.469 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:07.467+0000 7fd9efcae640 1 -- 172.21.15.19:0/2870610543 wait complete. 2024-09-10T22:25:07.586 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:05.294+0000 7f06b4262640 1 -- 172.21.15.19:0/961577672 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f06ac06f4a0 msgr2=0x7f06ac11bcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:25:07.586 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:05.294+0000 7f06b4262640 1 --2- 172.21.15.19:0/961577672 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f06ac06f4a0 0x7f06ac11bcb0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f069c009900 tx=0x7f069c02a410 comp rx=0 tx=0).stop 2024-09-10T22:25:07.586 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:05.294+0000 7f06b4262640 1 -- 172.21.15.19:0/961577672 shutdown_connections 2024-09-10T22:25:07.586 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:05.294+0000 7f06b4262640 1 --2- 172.21.15.19:0/961577672 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f06ac11c1f0 0x7f06ac11e5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:25:07.586 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:05.294+0000 7f06b4262640 1 --2- 172.21.15.19:0/961577672 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f06ac06f4a0 0x7f06ac11bcb0 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:25:07.587 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:05.295+0000 7f06b4262640 1 --2- 172.21.15.19:0/961577672 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f06ac06eb80 0x7f06ac06ef60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:25:07.587 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:05.295+0000 7f06b4262640 1 -- 172.21.15.19:0/961577672 >> 172.21.15.19:0/961577672 conn(0x7f06ac06dce0 msgr2=0x7f06ac06e0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:25:07.587 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:05.295+0000 7f06b4262640 1 -- 172.21.15.19:0/961577672 shutdown_connections 2024-09-10T22:25:07.587 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:05.295+0000 7f06b4262640 1 -- 172.21.15.19:0/961577672 wait complete. 2024-09-10T22:25:07.587 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:05.295+0000 7f06b4262640 1 Processor -- start 2024-09-10T22:25:07.587 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:05.295+0000 7f06b4262640 1 -- start start 2024-09-10T22:25:07.587 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:05.295+0000 7f06b4262640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f06ac06eb80 0x7f06ac1a8010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:25:07.587 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:05.295+0000 7f06b4262640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f06ac06f4a0 0x7f06ac1a8550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:25:07.587 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:05.295+0000 7f06b4262640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f06ac11c1f0 0x7f06ac1ad8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:25:07.587 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:05.296+0000 7f06b4262640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f06ac121ba0 con 0x7f06ac11c1f0 2024-09-10T22:25:07.587 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:05.296+0000 7f06b4262640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f06ac121a20 con 0x7f06ac06eb80 2024-09-10T22:25:07.587 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:05.296+0000 7f06b4262640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f06ac121d20 con 0x7f06ac06f4a0 2024-09-10T22:25:07.587 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:05.296+0000 7f06b27ff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f06ac11c1f0 0x7f06ac1ad8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:25:07.588 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:05.296+0000 7f06b27ff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f06ac11c1f0 0x7f06ac1ad8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:54194/0 (socket says 172.21.15.19:54194) 2024-09-10T22:25:07.588 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:05.296+0000 7f06b27ff640 1 -- 172.21.15.19:0/2434125578 learned_addr learned my addr 172.21.15.19:0/2434125578 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:25:07.588 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:05.296+0000 7f06b1ffe640 1 --2- 172.21.15.19:0/2434125578 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f06ac06eb80 0x7f06ac1a8010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:25:07.588 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:05.296+0000 7f06b17fd640 1 --2- 172.21.15.19:0/2434125578 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f06ac06f4a0 0x7f06ac1a8550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:25:07.589 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:05.296+0000 7f06b27ff640 1 -- 172.21.15.19:0/2434125578 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f06ac06f4a0 msgr2=0x7f06ac1a8550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:25:07.589 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:05.296+0000 7f06b27ff640 1 --2- 172.21.15.19:0/2434125578 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f06ac06f4a0 0x7f06ac1a8550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:25:07.589 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:05.296+0000 7f06b27ff640 1 -- 172.21.15.19:0/2434125578 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f06ac06eb80 msgr2=0x7f06ac1a8010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:25:07.589 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:05.296+0000 7f06b27ff640 1 --2- 172.21.15.19:0/2434125578 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f06ac06eb80 0x7f06ac1a8010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:25:07.589 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:05.296+0000 7f06b27ff640 1 -- 172.21.15.19:0/2434125578 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f06ac1ae0c0 con 0x7f06ac11c1f0 2024-09-10T22:25:07.589 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:05.296+0000 7f06b17fd640 1 --2- 172.21.15.19:0/2434125578 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f06ac06f4a0 0x7f06ac1a8550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T22:25:07.589 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:05.296+0000 7f06b27ff640 1 --2- 172.21.15.19:0/2434125578 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f06ac11c1f0 0x7f06ac1ad8f0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f06a400eaa0 tx=0x7f06a400eea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:25:07.589 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:05.296+0000 7f06a2ffd640 1 -- 172.21.15.19:0/2434125578 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06a4004d20 con 0x7f06ac11c1f0 2024-09-10T22:25:07.589 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:05.296+0000 7f06b4262640 1 -- 172.21.15.19:0/2434125578 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f06ac1ae3b0 con 0x7f06ac11c1f0 2024-09-10T22:25:07.589 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:05.296+0000 7f06a2ffd640 1 -- 172.21.15.19:0/2434125578 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f06a4005020 con 0x7f06ac11c1f0 2024-09-10T22:25:07.590 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:05.296+0000 7f06a2ffd640 1 -- 172.21.15.19:0/2434125578 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06a40116b0 con 0x7f06ac11c1f0 2024-09-10T22:25:07.590 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:05.296+0000 7f06b4262640 1 -- 172.21.15.19:0/2434125578 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f06ac1b4a70 con 0x7f06ac11c1f0 2024-09-10T22:25:07.590 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:05.297+0000 7f06b4262640 1 -- 172.21.15.19:0/2434125578 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f06ac11d0d0 con 0x7f06ac11c1f0 2024-09-10T22:25:07.590 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:05.299+0000 7f06a2ffd640 1 -- 172.21.15.19:0/2434125578 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 17) ==== 153301+0+0 (secure 0 0 0) 0x7f06a400f040 con 0x7f06ac11c1f0 2024-09-10T22:25:07.590 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:05.300+0000 7f06a2ffd640 1 --2- 172.21.15.19:0/2434125578 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f06980b5370 0x7f06980b7830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:25:07.590 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:05.300+0000 7f06b1ffe640 1 --2- 172.21.15.19:0/2434125578 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f06980b5370 0x7f06980b7830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:25:07.590 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:05.300+0000 7f06a2ffd640 1 -- 172.21.15.19:0/2434125578 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 8269+0+0 (secure 0 0 0) 0x7f06a40e60f0 con 0x7f06ac11c1f0 2024-09-10T22:25:07.590 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:05.300+0000 7f06a2ffd640 1 --2- 172.21.15.19:0/2434125578 >> [v2:172.21.15.138:6816/3020394729,v1:172.21.15.138:6817/3020394729] conn(0x7f06980bef10 0x7f06980c13b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:25:07.591 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:05.300+0000 7f06a2ffd640 1 -- 172.21.15.19:0/2434125578 --> [v2:172.21.15.138:6816/3020394729,v1:172.21.15.138:6817/3020394729] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f06a4014ec0 con 0x7f06980bef10 2024-09-10T22:25:07.591 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:05.300+0000 7f06a2ffd640 1 -- 172.21.15.19:0/2434125578 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_get_version_reply(handle=1 version=74) ==== 24+0+0 (secure 0 0 0) 0x7f06a40e64a0 con 0x7f06ac11c1f0 2024-09-10T22:25:07.591 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:05.300+0000 7f06b1ffe640 1 --2- 172.21.15.19:0/2434125578 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f06980b5370 0x7f06980b7830 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f06a800abe0 tx=0x7f06a800a2d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:25:07.591 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:05.300+0000 7f06b17fd640 1 --2- 172.21.15.19:0/2434125578 >> [v2:172.21.15.138:6816/3020394729,v1:172.21.15.138:6817/3020394729] conn(0x7f06980bef10 0x7f06980c13b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:25:07.591 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:05.301+0000 7f06b17fd640 1 --2- 172.21.15.19:0/2434125578 >> [v2:172.21.15.138:6816/3020394729,v1:172.21.15.138:6817/3020394729] conn(0x7f06980bef10 0x7f06980c13b0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.8 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:25:07.591 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:05.302+0000 7f06a2ffd640 1 -- 172.21.15.19:0/2434125578 <== osd.8 v2:172.21.15.138:6816/3020394729 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f06a4014ec0 con 0x7f06980bef10 2024-09-10T22:25:07.591 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:05.315+0000 7f06b4262640 1 -- 172.21.15.19:0/2434125578 --> [v2:172.21.15.138:6816/3020394729,v1:172.21.15.138:6817/3020394729] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f06ac070040 con 0x7f06980bef10 2024-09-10T22:25:07.591 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:05.316+0000 7f06a2ffd640 1 -- 172.21.15.19:0/2434125578 <== osd.8 v2:172.21.15.138:6816/3020394729 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f06ac070040 con 0x7f06980bef10 2024-09-10T22:25:07.591 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:05.316+0000 7f06b4262640 1 -- 172.21.15.19:0/2434125578 >> [v2:172.21.15.138:6816/3020394729,v1:172.21.15.138:6817/3020394729] conn(0x7f06980bef10 msgr2=0x7f06980c13b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:25:07.592 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:05.316+0000 7f06b4262640 1 --2- 172.21.15.19:0/2434125578 >> [v2:172.21.15.138:6816/3020394729,v1:172.21.15.138:6817/3020394729] conn(0x7f06980bef10 0x7f06980c13b0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:25:07.592 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:05.316+0000 7f06b4262640 1 -- 172.21.15.19:0/2434125578 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f06980b5370 msgr2=0x7f06980b7830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:25:07.592 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:05.316+0000 7f06b4262640 1 --2- 172.21.15.19:0/2434125578 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f06980b5370 0x7f06980b7830 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f06a800abe0 tx=0x7f06a800a2d0 comp rx=0 tx=0).stop 2024-09-10T22:25:07.592 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:05.316+0000 7f06b4262640 1 -- 172.21.15.19:0/2434125578 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f06ac11c1f0 msgr2=0x7f06ac1ad8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:25:07.592 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:05.316+0000 7f06b4262640 1 --2- 172.21.15.19:0/2434125578 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f06ac11c1f0 0x7f06ac1ad8f0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f06a400eaa0 tx=0x7f06a400eea0 comp rx=0 tx=0).stop 2024-09-10T22:25:07.592 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:05.316+0000 7f06b27ff640 1 -- 172.21.15.19:0/2434125578 reap_dead start 2024-09-10T22:25:07.592 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:05.316+0000 7f06b4262640 1 -- 172.21.15.19:0/2434125578 shutdown_connections 2024-09-10T22:25:07.592 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:05.316+0000 7f06b4262640 1 -- 172.21.15.19:0/2434125578 >> 172.21.15.19:0/2434125578 conn(0x7f06ac06dce0 msgr2=0x7f06ac11c670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:25:07.592 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:05.316+0000 7f06b4262640 1 -- 172.21.15.19:0/2434125578 shutdown_connections 2024-09-10T22:25:07.592 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:05.316+0000 7f06b4262640 1 -- 172.21.15.19:0/2434125578 wait complete. 2024-09-10T22:25:07.860 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:25:07 smithi135 ceph-mon[34789]: pgmap v306: 97 pgs: 7 peering, 90 active+clean; 639 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 383 B/s wr, 7 op/s 2024-09-10T22:25:07.875 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:25:07 smithi138 ceph-mon[35236]: pgmap v306: 97 pgs: 7 peering, 90 active+clean; 639 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 383 B/s wr, 7 op/s 2024-09-10T22:25:07.881 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:25:07 smithi019 ceph-mon[31375]: pgmap v306: 97 pgs: 7 peering, 90 active+clean; 639 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 383 B/s wr, 7 op/s 2024-09-10T22:25:08.601 INFO:teuthology.orchestra.run.smithi019.stdout:171798691886 2024-09-10T22:25:08.602 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 22997a4c-6fc2-11ef-bcea-c7b262605968 -- ceph osd last-stat-seq osd.6 2024-09-10T22:25:08.944 INFO:teuthology.orchestra.run.smithi019.stdout:98784247868 2024-09-10T22:25:08.944 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 22997a4c-6fc2-11ef-bcea-c7b262605968 -- ceph osd last-stat-seq osd.3 2024-09-10T22:25:09.075 INFO:teuthology.orchestra.run.smithi019.stdout:219043332132 2024-09-10T22:25:09.075 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 22997a4c-6fc2-11ef-bcea-c7b262605968 -- ceph osd last-stat-seq osd.8 2024-09-10T22:25:09.546 INFO:teuthology.orchestra.run.smithi019.stdout:287762808853 2024-09-10T22:25:09.546 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 22997a4c-6fc2-11ef-bcea-c7b262605968 -- ceph osd last-stat-seq osd.11 2024-09-10T22:25:09.777 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:09.776+0000 7f7bb15a6640 1 -- 172.21.15.19:0/311332176 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7bac1076e0 msgr2=0x7f7bac107b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:25:09.778 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:09.776+0000 7f7bb15a6640 1 --2- 172.21.15.19:0/311332176 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7bac1076e0 0x7f7bac107b40 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f7ba0009900 tx=0x7f7ba002a410 comp rx=0 tx=0).stop 2024-09-10T22:25:09.778 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:09.776+0000 7f7bb15a6640 1 -- 172.21.15.19:0/311332176 shutdown_connections 2024-09-10T22:25:09.778 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:09.776+0000 7f7bb15a6640 1 --2- 172.21.15.19:0/311332176 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7bac108080 0x7f7bac10e860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:25:09.778 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:09.776+0000 7f7bb15a6640 1 --2- 172.21.15.19:0/311332176 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7bac1076e0 0x7f7bac107b40 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:25:09.778 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:09.776+0000 7f7bb15a6640 1 --2- 172.21.15.19:0/311332176 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7bac1023a0 0x7f7bac102780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:25:09.778 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:09.776+0000 7f7bb15a6640 1 -- 172.21.15.19:0/311332176 >> 172.21.15.19:0/311332176 conn(0x7f7bac078140 msgr2=0x7f7bac0ff530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:25:09.778 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:09.776+0000 7f7bb15a6640 1 -- 172.21.15.19:0/311332176 shutdown_connections 2024-09-10T22:25:09.778 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:09.776+0000 7f7bb15a6640 1 -- 172.21.15.19:0/311332176 wait complete. 2024-09-10T22:25:09.779 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:25:09 smithi019 ceph-mon[31375]: pgmap v307: 97 pgs: 7 peering, 90 active+clean; 639 KiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 383 B/s wr, 5 op/s 2024-09-10T22:25:09.780 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:09.777+0000 7f7bb15a6640 1 Processor -- start 2024-09-10T22:25:09.780 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:09.777+0000 7f7bb15a6640 1 -- start start 2024-09-10T22:25:09.780 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:09.777+0000 7f7bb15a6640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7bac1023a0 0x7f7bac19b5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:25:09.780 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:09.777+0000 7f7bb15a6640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7bac1076e0 0x7f7bac19bb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:25:09.780 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:09.777+0000 7f7bb15a6640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7bac108080 0x7f7bac1a0ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:25:09.780 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:09.777+0000 7f7bb15a6640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f7bac111d20 con 0x7f7bac1076e0 2024-09-10T22:25:09.780 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:09.777+0000 7f7bb15a6640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f7bac111ba0 con 0x7f7bac1023a0 2024-09-10T22:25:09.781 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:09.777+0000 7f7bb15a6640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f7bac111ea0 con 0x7f7bac108080 2024-09-10T22:25:09.781 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:09.777+0000 7f7bab7fe640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7bac108080 0x7f7bac1a0ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:25:09.781 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:09.777+0000 7f7bab7fe640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7bac108080 0x7f7bac1a0ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.19:45036/0 (socket says 172.21.15.19:45036) 2024-09-10T22:25:09.781 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:09.777+0000 7f7bab7fe640 1 -- 172.21.15.19:0/3388055489 learned_addr learned my addr 172.21.15.19:0/3388055489 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:25:09.781 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:09.778+0000 7f7baa7fc640 1 --2- 172.21.15.19:0/3388055489 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7bac1076e0 0x7f7bac19bb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:25:09.781 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:09.778+0000 7f7baaffd640 1 --2- 172.21.15.19:0/3388055489 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7bac1023a0 0x7f7bac19b5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:25:09.781 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:09.778+0000 7f7baa7fc640 1 -- 172.21.15.19:0/3388055489 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7bac108080 msgr2=0x7f7bac1a0ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:25:09.781 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:09.778+0000 7f7baa7fc640 1 --2- 172.21.15.19:0/3388055489 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7bac108080 0x7f7bac1a0ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:25:09.781 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:09.778+0000 7f7baa7fc640 1 -- 172.21.15.19:0/3388055489 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7bac1023a0 msgr2=0x7f7bac19b5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:25:09.781 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:09.778+0000 7f7baa7fc640 1 --2- 172.21.15.19:0/3388055489 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7bac1023a0 0x7f7bac19b5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:25:09.781 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:09.778+0000 7f7baa7fc640 1 -- 172.21.15.19:0/3388055489 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7bac1a16a0 con 0x7f7bac1076e0 2024-09-10T22:25:09.782 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:09.778+0000 7f7baaffd640 1 --2- 172.21.15.19:0/3388055489 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7bac1023a0 0x7f7bac19b5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T22:25:09.782 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:09.778+0000 7f7baa7fc640 1 --2- 172.21.15.19:0/3388055489 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7bac1076e0 0x7f7bac19bb30 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f7ba002aa00 tx=0x7f7ba0003cd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:25:09.782 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:09.779+0000 7f7b93fff640 1 -- 172.21.15.19:0/3388055489 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ba003f070 con 0x7f7bac1076e0 2024-09-10T22:25:09.782 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:09.779+0000 7f7b93fff640 1 -- 172.21.15.19:0/3388055489 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7ba0003e40 con 0x7f7bac1076e0 2024-09-10T22:25:09.782 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:09.779+0000 7f7b93fff640 1 -- 172.21.15.19:0/3388055489 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ba0035030 con 0x7f7bac1076e0 2024-09-10T22:25:09.782 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:09.779+0000 7f7bb15a6640 1 -- 172.21.15.19:0/3388055489 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7bac1a1930 con 0x7f7bac1076e0 2024-09-10T22:25:09.782 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:09.779+0000 7f7bb15a6640 1 -- 172.21.15.19:0/3388055489 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7bac1a8050 con 0x7f7bac1076e0 2024-09-10T22:25:09.783 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:09.781+0000 7f7bb15a6640 1 -- 172.21.15.19:0/3388055489 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f7bac0638e0 con 0x7f7bac1076e0 2024-09-10T22:25:09.783 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:09.782+0000 7f7b93fff640 1 -- 172.21.15.19:0/3388055489 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 17) ==== 153301+0+0 (secure 0 0 0) 0x7f7ba004c070 con 0x7f7bac1076e0 2024-09-10T22:25:09.784 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:09.783+0000 7f7b93fff640 1 --2- 172.21.15.19:0/3388055489 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f7b940b5500 0x7f7b940b79c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:25:09.785 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:09.783+0000 7f7baaffd640 1 --2- 172.21.15.19:0/3388055489 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f7b940b5500 0x7f7b940b79c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:25:09.785 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:09.783+0000 7f7b93fff640 1 -- 172.21.15.19:0/3388055489 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8269+0+0 (secure 0 0 0) 0x7f7ba0106e60 con 0x7f7bac1076e0 2024-09-10T22:25:09.785 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:09.784+0000 7f7b93fff640 1 --2- 172.21.15.19:0/3388055489 >> [v2:172.21.15.138:6808/1086764290,v1:172.21.15.138:6809/1086764290] conn(0x7f7b940bf0a0 0x7f7b940c1540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:25:09.785 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:09.784+0000 7f7b93fff640 1 -- 172.21.15.19:0/3388055489 --> [v2:172.21.15.138:6808/1086764290,v1:172.21.15.138:6809/1086764290] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f7b940c1c10 con 0x7f7b940bf0a0 2024-09-10T22:25:09.785 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:09.784+0000 7f7b93fff640 1 -- 172.21.15.19:0/3388055489 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_get_version_reply(handle=1 version=75) ==== 24+0+0 (secure 0 0 0) 0x7f7ba01072b0 con 0x7f7bac1076e0 2024-09-10T22:25:09.786 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:09.784+0000 7f7bab7fe640 1 --2- 172.21.15.19:0/3388055489 >> [v2:172.21.15.138:6808/1086764290,v1:172.21.15.138:6809/1086764290] conn(0x7f7b940bf0a0 0x7f7b940c1540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:25:09.786 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:09.784+0000 7f7baaffd640 1 --2- 172.21.15.19:0/3388055489 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f7b940b5500 0x7f7b940b79c0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f7b9c009930 tx=0x7f7b9c008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:25:09.786 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:09.784+0000 7f7bab7fe640 1 --2- 172.21.15.19:0/3388055489 >> [v2:172.21.15.138:6808/1086764290,v1:172.21.15.138:6809/1086764290] conn(0x7f7b940bf0a0 0x7f7b940c1540 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:25:09.786 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:09.785+0000 7f7b93fff640 1 -- 172.21.15.19:0/3388055489 <== osd.5 v2:172.21.15.138:6808/1086764290 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f7b940c1c10 con 0x7f7b940bf0a0 2024-09-10T22:25:09.801 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:09.800+0000 7f7bb15a6640 1 -- 172.21.15.19:0/3388055489 --> [v2:172.21.15.138:6808/1086764290,v1:172.21.15.138:6809/1086764290] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f7bac063d30 con 0x7f7b940bf0a0 2024-09-10T22:25:09.802 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:09.800+0000 7f7b93fff640 1 -- 172.21.15.19:0/3388055489 <== osd.5 v2:172.21.15.138:6808/1086764290 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f7bac063d30 con 0x7f7b940bf0a0 2024-09-10T22:25:09.803 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:09.801+0000 7f7bb15a6640 1 -- 172.21.15.19:0/3388055489 >> [v2:172.21.15.138:6808/1086764290,v1:172.21.15.138:6809/1086764290] conn(0x7f7b940bf0a0 msgr2=0x7f7b940c1540 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:25:09.803 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:09.801+0000 7f7bb15a6640 1 --2- 172.21.15.19:0/3388055489 >> [v2:172.21.15.138:6808/1086764290,v1:172.21.15.138:6809/1086764290] conn(0x7f7b940bf0a0 0x7f7b940c1540 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:25:09.803 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:09.801+0000 7f7bb15a6640 1 -- 172.21.15.19:0/3388055489 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f7b940b5500 msgr2=0x7f7b940b79c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:25:09.803 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:09.801+0000 7f7bb15a6640 1 --2- 172.21.15.19:0/3388055489 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f7b940b5500 0x7f7b940b79c0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f7b9c009930 tx=0x7f7b9c008040 comp rx=0 tx=0).stop 2024-09-10T22:25:09.803 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:09.801+0000 7f7bb15a6640 1 -- 172.21.15.19:0/3388055489 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7bac1076e0 msgr2=0x7f7bac19bb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:25:09.803 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:09.801+0000 7f7bb15a6640 1 --2- 172.21.15.19:0/3388055489 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7bac1076e0 0x7f7bac19bb30 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f7ba002aa00 tx=0x7f7ba0003cd0 comp rx=0 tx=0).stop 2024-09-10T22:25:09.803 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:09.801+0000 7f7bab7fe640 1 -- 172.21.15.19:0/3388055489 reap_dead start 2024-09-10T22:25:09.803 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:09.801+0000 7f7bb15a6640 1 -- 172.21.15.19:0/3388055489 shutdown_connections 2024-09-10T22:25:09.803 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:09.801+0000 7f7bb15a6640 1 -- 172.21.15.19:0/3388055489 >> 172.21.15.19:0/3388055489 conn(0x7f7bac078140 msgr2=0x7f7bac104cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:25:09.803 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:09.801+0000 7f7bb15a6640 1 -- 172.21.15.19:0/3388055489 shutdown_connections 2024-09-10T22:25:09.803 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:09.801+0000 7f7bb15a6640 1 -- 172.21.15.19:0/3388055489 wait complete. 2024-09-10T22:25:09.859 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:25:09 smithi135 ceph-mon[34789]: pgmap v307: 97 pgs: 7 peering, 90 active+clean; 639 KiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 383 B/s wr, 5 op/s 2024-09-10T22:25:09.875 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:25:09 smithi138 ceph-mon[35236]: pgmap v307: 97 pgs: 7 peering, 90 active+clean; 639 KiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 383 B/s wr, 5 op/s 2024-09-10T22:25:10.062 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:10.059+0000 7f3adf92e640 1 -- 172.21.15.19:0/3364004934 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3ad810d140 msgr2=0x7f3ad810f5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:25:10.063 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:10.059+0000 7f3adf92e640 1 --2- 172.21.15.19:0/3364004934 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3ad810d140 0x7f3ad810f5a0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f3ad0009900 tx=0x7f3ad002a410 comp rx=0 tx=0).stop 2024-09-10T22:25:10.063 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:10.059+0000 7f3adf92e640 1 -- 172.21.15.19:0/3364004934 shutdown_connections 2024-09-10T22:25:10.063 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:10.059+0000 7f3adf92e640 1 --2- 172.21.15.19:0/3364004934 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3ad810d140 0x7f3ad810f5a0 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:25:10.063 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:10.059+0000 7f3adf92e640 1 --2- 172.21.15.19:0/3364004934 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3ad8104600 0x7f3ad810caf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:25:10.063 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:10.059+0000 7f3adf92e640 1 --2- 172.21.15.19:0/3364004934 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3ad8103ce0 0x7f3ad81040c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:25:10.064 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:10.059+0000 7f3adf92e640 1 -- 172.21.15.19:0/3364004934 >> 172.21.15.19:0/3364004934 conn(0x7f3ad80fd700 msgr2=0x7f3ad80ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:25:10.064 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:10.060+0000 7f3adf92e640 1 -- 172.21.15.19:0/3364004934 shutdown_connections 2024-09-10T22:25:10.064 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:10.060+0000 7f3adf92e640 1 -- 172.21.15.19:0/3364004934 wait complete. 2024-09-10T22:25:10.064 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:10.060+0000 7f3adf92e640 1 Processor -- start 2024-09-10T22:25:10.064 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:10.060+0000 7f3adf92e640 1 -- start start 2024-09-10T22:25:10.064 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:10.060+0000 7f3adf92e640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3ad8103ce0 0x7f3ad8199280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:25:10.065 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:10.060+0000 7f3adf92e640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3ad8104600 0x7f3ad81997c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:25:10.065 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:10.060+0000 7f3adf92e640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3ad810d140 0x7f3ad819eb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:25:10.065 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:10.060+0000 7f3adf92e640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f3ad8112db0 con 0x7f3ad810d140 2024-09-10T22:25:10.065 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:10.060+0000 7f3adf92e640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f3ad8112c30 con 0x7f3ad8104600 2024-09-10T22:25:10.065 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:10.060+0000 7f3adf92e640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f3ad8112f30 con 0x7f3ad8103ce0 2024-09-10T22:25:10.065 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:10.061+0000 7f3addecb640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3ad810d140 0x7f3ad819eb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:25:10.065 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:10.061+0000 7f3addecb640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3ad810d140 0x7f3ad819eb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:54268/0 (socket says 172.21.15.19:54268) 2024-09-10T22:25:10.066 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:10.061+0000 7f3addecb640 1 -- 172.21.15.19:0/4146933376 learned_addr learned my addr 172.21.15.19:0/4146933376 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:25:10.066 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:10.061+0000 7f3adcec9640 1 --2- 172.21.15.19:0/4146933376 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3ad8104600 0x7f3ad81997c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:25:10.066 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:10.061+0000 7f3add6ca640 1 --2- 172.21.15.19:0/4146933376 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3ad8103ce0 0x7f3ad8199280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:25:10.066 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:10.061+0000 7f3addecb640 1 -- 172.21.15.19:0/4146933376 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3ad8103ce0 msgr2=0x7f3ad8199280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:25:10.066 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:10.061+0000 7f3addecb640 1 --2- 172.21.15.19:0/4146933376 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3ad8103ce0 0x7f3ad8199280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:25:10.067 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:10.061+0000 7f3addecb640 1 -- 172.21.15.19:0/4146933376 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3ad8104600 msgr2=0x7f3ad81997c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:25:10.067 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:10.061+0000 7f3addecb640 1 --2- 172.21.15.19:0/4146933376 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3ad8104600 0x7f3ad81997c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:25:10.067 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:10.061+0000 7f3addecb640 1 -- 172.21.15.19:0/4146933376 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3ad819f330 con 0x7f3ad810d140 2024-09-10T22:25:10.067 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:10.061+0000 7f3addecb640 1 --2- 172.21.15.19:0/4146933376 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3ad810d140 0x7f3ad819eb60 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f3ad0004770 tx=0x7f3ad0004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:25:10.067 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:10.061+0000 7f3ace7fc640 1 -- 172.21.15.19:0/4146933376 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ad003f030 con 0x7f3ad810d140 2024-09-10T22:25:10.067 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:10.061+0000 7f3adf92e640 1 -- 172.21.15.19:0/4146933376 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3ad819f5c0 con 0x7f3ad810d140 2024-09-10T22:25:10.068 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:10.061+0000 7f3ace7fc640 1 -- 172.21.15.19:0/4146933376 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3ad0003aa0 con 0x7f3ad810d140 2024-09-10T22:25:10.068 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:10.061+0000 7f3ace7fc640 1 -- 172.21.15.19:0/4146933376 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ad0035070 con 0x7f3ad810d140 2024-09-10T22:25:10.068 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:10.061+0000 7f3adf92e640 1 -- 172.21.15.19:0/4146933376 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3ad81a5ce0 con 0x7f3ad810d140 2024-09-10T22:25:10.070 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:10.062+0000 7f3adf92e640 1 -- 172.21.15.19:0/4146933376 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f3ad80ffd30 con 0x7f3ad810d140 2024-09-10T22:25:10.070 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:10.064+0000 7f3ace7fc640 1 -- 172.21.15.19:0/4146933376 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 17) ==== 153301+0+0 (secure 0 0 0) 0x7f3ad00035f0 con 0x7f3ad810d140 2024-09-10T22:25:10.070 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:10.065+0000 7f3ace7fc640 1 --2- 172.21.15.19:0/4146933376 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f3ac40b5370 0x7f3ac40b7830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:25:10.070 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:10.065+0000 7f3ace7fc640 1 -- 172.21.15.19:0/4146933376 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8269+0+0 (secure 0 0 0) 0x7f3ad0106e20 con 0x7f3ad810d140 2024-09-10T22:25:10.071 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:10.065+0000 7f3add6ca640 1 --2- 172.21.15.19:0/4146933376 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f3ac40b5370 0x7f3ac40b7830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:25:10.071 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:10.065+0000 7f3ace7fc640 1 --2- 172.21.15.19:0/4146933376 >> [v2:172.21.15.135:6816/1096613674,v1:172.21.15.135:6817/1096613674] conn(0x7f3ac40bef10 0x7f3ac40c13b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:25:10.071 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:10.065+0000 7f3ace7fc640 1 -- 172.21.15.19:0/4146933376 --> [v2:172.21.15.135:6816/1096613674,v1:172.21.15.135:6817/1096613674] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f3ac40c1a80 con 0x7f3ac40bef10 2024-09-10T22:25:10.071 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:10.065+0000 7f3ace7fc640 1 -- 172.21.15.19:0/4146933376 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_get_version_reply(handle=1 version=75) ==== 24+0+0 (secure 0 0 0) 0x7f3ad0107270 con 0x7f3ad810d140 2024-09-10T22:25:10.071 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:10.065+0000 7f3adcec9640 1 --2- 172.21.15.19:0/4146933376 >> [v2:172.21.15.135:6816/1096613674,v1:172.21.15.135:6817/1096613674] conn(0x7f3ac40bef10 0x7f3ac40c13b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:25:10.071 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:10.065+0000 7f3add6ca640 1 --2- 172.21.15.19:0/4146933376 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f3ac40b5370 0x7f3ac40b7830 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f3ad4005fd0 tx=0x7f3ad4009680 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:25:10.072 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:10.066+0000 7f3adcec9640 1 --2- 172.21.15.19:0/4146933376 >> [v2:172.21.15.135:6816/1096613674,v1:172.21.15.135:6817/1096613674] conn(0x7f3ac40bef10 0x7f3ac40c13b0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:25:10.072 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:10.066+0000 7f3ace7fc640 1 -- 172.21.15.19:0/4146933376 <== osd.7 v2:172.21.15.135:6816/1096613674 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f3ac40c1a80 con 0x7f3ac40bef10 2024-09-10T22:25:10.081 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:10.080+0000 7f3adf92e640 1 -- 172.21.15.19:0/4146933376 --> [v2:172.21.15.135:6816/1096613674,v1:172.21.15.135:6817/1096613674] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f3ad806bb90 con 0x7f3ac40bef10 2024-09-10T22:25:10.082 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:10.081+0000 7f3ace7fc640 1 -- 172.21.15.19:0/4146933376 <== osd.7 v2:172.21.15.135:6816/1096613674 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f3ad806bb90 con 0x7f3ac40bef10 2024-09-10T22:25:10.083 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:10.081+0000 7f3adf92e640 1 -- 172.21.15.19:0/4146933376 >> [v2:172.21.15.135:6816/1096613674,v1:172.21.15.135:6817/1096613674] conn(0x7f3ac40bef10 msgr2=0x7f3ac40c13b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:25:10.083 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:10.081+0000 7f3adf92e640 1 --2- 172.21.15.19:0/4146933376 >> [v2:172.21.15.135:6816/1096613674,v1:172.21.15.135:6817/1096613674] conn(0x7f3ac40bef10 0x7f3ac40c13b0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:25:10.083 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:10.081+0000 7f3adf92e640 1 -- 172.21.15.19:0/4146933376 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f3ac40b5370 msgr2=0x7f3ac40b7830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:25:10.083 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:10.081+0000 7f3adf92e640 1 --2- 172.21.15.19:0/4146933376 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f3ac40b5370 0x7f3ac40b7830 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f3ad4005fd0 tx=0x7f3ad4009680 comp rx=0 tx=0).stop 2024-09-10T22:25:10.083 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:10.081+0000 7f3adf92e640 1 -- 172.21.15.19:0/4146933376 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3ad810d140 msgr2=0x7f3ad819eb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:25:10.083 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:10.081+0000 7f3adf92e640 1 --2- 172.21.15.19:0/4146933376 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3ad810d140 0x7f3ad819eb60 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f3ad0004770 tx=0x7f3ad0004270 comp rx=0 tx=0).stop 2024-09-10T22:25:10.083 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:10.081+0000 7f3addecb640 1 -- 172.21.15.19:0/4146933376 reap_dead start 2024-09-10T22:25:10.083 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:10.081+0000 7f3adf92e640 1 -- 172.21.15.19:0/4146933376 shutdown_connections 2024-09-10T22:25:10.084 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:10.081+0000 7f3adf92e640 1 -- 172.21.15.19:0/4146933376 >> 172.21.15.19:0/4146933376 conn(0x7f3ad80fd700 msgr2=0x7f3ad80fe300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:25:10.084 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:10.081+0000 7f3adf92e640 1 -- 172.21.15.19:0/4146933376 shutdown_connections 2024-09-10T22:25:10.084 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:10.081+0000 7f3adf92e640 1 -- 172.21.15.19:0/4146933376 wait complete. 2024-09-10T22:25:10.854 INFO:teuthology.orchestra.run.smithi019.stdout:124554051639 2024-09-10T22:25:10.855 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 22997a4c-6fc2-11ef-bcea-c7b262605968 -- ceph osd last-stat-seq osd.4 2024-09-10T22:25:11.255 INFO:teuthology.orchestra.run.smithi019.stdout:197568495659 2024-09-10T22:25:11.255 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 22997a4c-6fc2-11ef-bcea-c7b262605968 -- ceph osd last-stat-seq osd.7 2024-09-10T22:25:11.821 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:25:11 smithi019 ceph-mon[31375]: pgmap v308: 97 pgs: 2 peering, 95 active+clean; 639 KiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 4 op/s; 72 B/s, 1 keys/s, 0 objects/s recovering 2024-09-10T22:25:11.849 INFO:teuthology.orchestra.run.smithi019.stdout:146028888115 2024-09-10T22:25:11.849 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 22997a4c-6fc2-11ef-bcea-c7b262605968 -- ceph osd last-stat-seq osd.5 2024-09-10T22:25:11.859 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:25:11 smithi135 ceph-mon[34789]: pgmap v308: 97 pgs: 2 peering, 95 active+clean; 639 KiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 4 op/s; 72 B/s, 1 keys/s, 0 objects/s recovering 2024-09-10T22:25:11.875 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:25:11 smithi138 ceph-mon[35236]: pgmap v308: 97 pgs: 2 peering, 95 active+clean; 639 KiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 4 op/s; 72 B/s, 1 keys/s, 0 objects/s recovering 2024-09-10T22:25:12.738 INFO:teuthology.orchestra.run.smithi019.stdout:73014444100 2024-09-10T22:25:12.738 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 22997a4c-6fc2-11ef-bcea-c7b262605968 -- ceph osd last-stat-seq osd.2 2024-09-10T22:25:12.902 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/22997a4c-6fc2-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T22:25:12.903 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/22997a4c-6fc2-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T22:25:12.904 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/22997a4c-6fc2-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T22:25:12.963 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/22997a4c-6fc2-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T22:25:13.406 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/22997a4c-6fc2-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T22:25:13.406 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/22997a4c-6fc2-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T22:25:13.407 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/22997a4c-6fc2-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T22:25:13.410 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/22997a4c-6fc2-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T22:25:13.410 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/22997a4c-6fc2-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T22:25:13.421 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/22997a4c-6fc2-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T22:25:13.629 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:13.614+0000 7f5bdcf9e640 1 -- 172.21.15.19:0/2389689432 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5bd810cf60 msgr2=0x7f5bd810f3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:25:13.629 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:13.614+0000 7f5bdcf9e640 1 --2- 172.21.15.19:0/2389689432 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5bd810cf60 0x7f5bd810f3c0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f5bd0009ca0 tx=0x7f5bd002a8c0 comp rx=0 tx=0).stop 2024-09-10T22:25:13.629 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:13.614+0000 7f5bdcf9e640 1 -- 172.21.15.19:0/2389689432 shutdown_connections 2024-09-10T22:25:13.630 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:13.614+0000 7f5bdcf9e640 1 --2- 172.21.15.19:0/2389689432 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5bd810cf60 0x7f5bd810f3c0 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:25:13.630 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:13.614+0000 7f5bdcf9e640 1 --2- 172.21.15.19:0/2389689432 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5bd8104420 0x7f5bd810c910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:25:13.630 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:13.614+0000 7f5bdcf9e640 1 --2- 172.21.15.19:0/2389689432 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5bd8103b00 0x7f5bd8103ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:25:13.630 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:13.614+0000 7f5bdcf9e640 1 -- 172.21.15.19:0/2389689432 >> 172.21.15.19:0/2389689432 conn(0x7f5bd80fd560 msgr2=0x7f5bd80ff980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:25:13.630 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:13.614+0000 7f5bdcf9e640 1 -- 172.21.15.19:0/2389689432 shutdown_connections 2024-09-10T22:25:13.630 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:13.614+0000 7f5bdcf9e640 1 -- 172.21.15.19:0/2389689432 wait complete. 2024-09-10T22:25:13.630 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:13.615+0000 7f5bdcf9e640 1 Processor -- start 2024-09-10T22:25:13.630 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:13.615+0000 7f5bdcf9e640 1 -- start start 2024-09-10T22:25:13.630 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:13.616+0000 7f5bdcf9e640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5bd8103b00 0x7f5bd8198fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:25:13.630 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:13.616+0000 7f5bdcf9e640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5bd8104420 0x7f5bd8199520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:25:13.630 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:13.616+0000 7f5bdcf9e640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5bd810cf60 0x7f5bd819e8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:25:13.630 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:13.616+0000 7f5bdcf9e640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f5bd8112c30 con 0x7f5bd8103b00 2024-09-10T22:25:13.631 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:13.616+0000 7f5bdcf9e640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f5bd8112ab0 con 0x7f5bd8104420 2024-09-10T22:25:13.631 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:13.616+0000 7f5bdcf9e640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f5bd8112db0 con 0x7f5bd810cf60 2024-09-10T22:25:13.631 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:13.616+0000 7f5bd77fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5bd8103b00 0x7f5bd8198fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:25:13.631 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:13.616+0000 7f5bd77fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5bd8103b00 0x7f5bd8198fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:54302/0 (socket says 172.21.15.19:54302) 2024-09-10T22:25:13.631 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:13.616+0000 7f5bd77fe640 1 -- 172.21.15.19:0/1457699045 learned_addr learned my addr 172.21.15.19:0/1457699045 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:25:13.631 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:13.616+0000 7f5bd6ffd640 1 --2- 172.21.15.19:0/1457699045 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5bd8104420 0x7f5bd8199520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:25:13.631 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:13.616+0000 7f5bd7fff640 1 --2- 172.21.15.19:0/1457699045 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5bd810cf60 0x7f5bd819e8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:25:13.631 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:13.616+0000 7f5bd77fe640 1 -- 172.21.15.19:0/1457699045 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5bd810cf60 msgr2=0x7f5bd819e8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:25:13.631 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:13.616+0000 7f5bd77fe640 1 --2- 172.21.15.19:0/1457699045 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5bd810cf60 0x7f5bd819e8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:25:13.631 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:13.616+0000 7f5bd77fe640 1 -- 172.21.15.19:0/1457699045 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5bd8104420 msgr2=0x7f5bd8199520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:25:13.631 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:13.616+0000 7f5bd77fe640 1 --2- 172.21.15.19:0/1457699045 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5bd8104420 0x7f5bd8199520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:25:13.631 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:13.616+0000 7f5bd77fe640 1 -- 172.21.15.19:0/1457699045 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5bd819f090 con 0x7f5bd8103b00 2024-09-10T22:25:13.632 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:13.616+0000 7f5bd7fff640 1 --2- 172.21.15.19:0/1457699045 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5bd810cf60 0x7f5bd819e8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T22:25:13.632 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:13.616+0000 7f5bd77fe640 1 --2- 172.21.15.19:0/1457699045 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5bd8103b00 0x7f5bd8198fe0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f5bc800c920 tx=0x7f5bc800cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:25:13.632 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:13.617+0000 7f5bd4ff9640 1 -- 172.21.15.19:0/1457699045 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5bc8007c70 con 0x7f5bd8103b00 2024-09-10T22:25:13.632 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:13.617+0000 7f5bd4ff9640 1 -- 172.21.15.19:0/1457699045 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5bc8007e10 con 0x7f5bd8103b00 2024-09-10T22:25:13.632 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:13.617+0000 7f5bdcf9e640 1 -- 172.21.15.19:0/1457699045 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5bd819f380 con 0x7f5bd8103b00 2024-09-10T22:25:13.632 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:13.617+0000 7f5bd4ff9640 1 -- 172.21.15.19:0/1457699045 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5bc8018820 con 0x7f5bd8103b00 2024-09-10T22:25:13.632 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:13.617+0000 7f5bdcf9e640 1 -- 172.21.15.19:0/1457699045 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5bd81a5c10 con 0x7f5bd8103b00 2024-09-10T22:25:13.632 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:13.618+0000 7f5bdcf9e640 1 -- 172.21.15.19:0/1457699045 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5bd8103ee0 con 0x7f5bd8103b00 2024-09-10T22:25:13.632 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:13.619+0000 7f5bd4ff9640 1 -- 172.21.15.19:0/1457699045 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 17) ==== 153301+0+0 (secure 0 0 0) 0x7f5bc800f450 con 0x7f5bd8103b00 2024-09-10T22:25:13.632 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:13.620+0000 7f5bd4ff9640 1 --2- 172.21.15.19:0/1457699045 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f5bc00b5490 0x7f5bc00b7950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:25:13.632 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:13.620+0000 7f5bd6ffd640 1 --2- 172.21.15.19:0/1457699045 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f5bc00b5490 0x7f5bc00b7950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:25:13.632 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:13.620+0000 7f5bd4ff9640 1 -- 172.21.15.19:0/1457699045 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8269+0+0 (secure 0 0 0) 0x7f5bc80e5e40 con 0x7f5bd8103b00 2024-09-10T22:25:13.633 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:13.621+0000 7f5bd6ffd640 1 --2- 172.21.15.19:0/1457699045 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f5bc00b5490 0x7f5bc00b7950 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f5bd80ffdb0 tx=0x7f5bcc009060 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:25:13.633 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:13.625+0000 7f5bd4ff9640 1 -- 172.21.15.19:0/1457699045 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f5bc8014030 con 0x7f5bd8103b00 2024-09-10T22:25:13.636 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/22997a4c-6fc2-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T22:25:13.708 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:25:13 smithi019 ceph-mon[31375]: pgmap v309: 97 pgs: 97 active+clean; 639 KiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 6 op/s; 83 B/s, 1 keys/s, 1 objects/s recovering 2024-09-10T22:25:13.820 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:13.819+0000 7f5bdcf9e640 1 -- 172.21.15.19:0/1457699045 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 10} v 0) -- 0x7f5bd8107100 con 0x7f5bd8103b00 2024-09-10T22:25:13.820 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:13.819+0000 7f5bd4ff9640 1 -- 172.21.15.19:0/1457699045 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 10}]=0 v0) ==== 75+0+13 (secure 0 0 0) 0x7f5bc80acb80 con 0x7f5bd8103b00 2024-09-10T22:25:13.821 INFO:teuthology.orchestra.run.smithi019.stdout:266287972380 2024-09-10T22:25:13.823 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:13.822+0000 7f5bdcf9e640 1 -- 172.21.15.19:0/1457699045 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f5bc00b5490 msgr2=0x7f5bc00b7950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:25:13.823 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:13.822+0000 7f5bdcf9e640 1 --2- 172.21.15.19:0/1457699045 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f5bc00b5490 0x7f5bc00b7950 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f5bd80ffdb0 tx=0x7f5bcc009060 comp rx=0 tx=0).stop 2024-09-10T22:25:13.823 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:13.822+0000 7f5bdcf9e640 1 -- 172.21.15.19:0/1457699045 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5bd8103b00 msgr2=0x7f5bd8198fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:25:13.823 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:13.822+0000 7f5bdcf9e640 1 --2- 172.21.15.19:0/1457699045 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5bd8103b00 0x7f5bd8198fe0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f5bc800c920 tx=0x7f5bc800cde0 comp rx=0 tx=0).stop 2024-09-10T22:25:13.823 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:13.822+0000 7f5bdcf9e640 1 -- 172.21.15.19:0/1457699045 shutdown_connections 2024-09-10T22:25:13.823 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:13.822+0000 7f5bdcf9e640 1 --2- 172.21.15.19:0/1457699045 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f5bc00b5490 0x7f5bc00b7950 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:25:13.823 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:13.822+0000 7f5bdcf9e640 1 --2- 172.21.15.19:0/1457699045 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5bd810cf60 0x7f5bd819e8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:25:13.823 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:13.822+0000 7f5bdcf9e640 1 --2- 172.21.15.19:0/1457699045 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5bd8104420 0x7f5bd8199520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:25:13.823 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:13.822+0000 7f5bdcf9e640 1 --2- 172.21.15.19:0/1457699045 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5bd8103b00 0x7f5bd8198fe0 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:25:13.823 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:13.822+0000 7f5bdcf9e640 1 -- 172.21.15.19:0/1457699045 >> 172.21.15.19:0/1457699045 conn(0x7f5bd80fd560 msgr2=0x7f5bd8104860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:25:13.824 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:13.822+0000 7f5bdcf9e640 1 -- 172.21.15.19:0/1457699045 shutdown_connections 2024-09-10T22:25:13.824 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:13.822+0000 7f5bdcf9e640 1 -- 172.21.15.19:0/1457699045 wait complete. 2024-09-10T22:25:13.859 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:25:13 smithi135 ceph-mon[34789]: pgmap v309: 97 pgs: 97 active+clean; 639 KiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 6 op/s; 83 B/s, 1 keys/s, 1 objects/s recovering 2024-09-10T22:25:13.875 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:25:13 smithi138 ceph-mon[35236]: pgmap v309: 97 pgs: 97 active+clean; 639 KiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 6 op/s; 83 B/s, 1 keys/s, 1 objects/s recovering 2024-09-10T22:25:14.336 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:14.335+0000 7f000a7eb640 1 -- 172.21.15.19:0/214756441 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f00041045c0 msgr2=0x7f000410cab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:25:14.337 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:14.335+0000 7f000a7eb640 1 --2- 172.21.15.19:0/214756441 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f00041045c0 0x7f000410cab0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7effec009900 tx=0x7effec02a410 comp rx=0 tx=0).stop 2024-09-10T22:25:14.337 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:14.335+0000 7f000a7eb640 1 -- 172.21.15.19:0/214756441 shutdown_connections 2024-09-10T22:25:14.337 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:14.335+0000 7f000a7eb640 1 --2- 172.21.15.19:0/214756441 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f000410d100 0x7f000410f560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:25:14.337 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:14.335+0000 7f000a7eb640 1 --2- 172.21.15.19:0/214756441 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f00041045c0 0x7f000410cab0 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:25:14.337 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:14.335+0000 7f000a7eb640 1 --2- 172.21.15.19:0/214756441 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f0004103ca0 0x7f0004104080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:25:14.337 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:14.335+0000 7f000a7eb640 1 -- 172.21.15.19:0/214756441 >> 172.21.15.19:0/214756441 conn(0x7f00040fd700 msgr2=0x7f00040ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:25:14.337 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:14.335+0000 7f000a7eb640 1 -- 172.21.15.19:0/214756441 shutdown_connections 2024-09-10T22:25:14.337 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:14.335+0000 7f000a7eb640 1 -- 172.21.15.19:0/214756441 wait complete. 2024-09-10T22:25:14.337 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:14.335+0000 7f000a7eb640 1 Processor -- start 2024-09-10T22:25:14.337 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:14.336+0000 7f000a7eb640 1 -- start start 2024-09-10T22:25:14.339 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:14.336+0000 7f000a7eb640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0004103ca0 0x7f00041992c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:25:14.339 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:14.336+0000 7f000a7eb640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f00041045c0 0x7f0004199800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:25:14.339 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:14.336+0000 7f000a7eb640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f000410d100 0x7f000419eba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:25:14.339 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:14.336+0000 7f000a7eb640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f0004112db0 con 0x7f000410d100 2024-09-10T22:25:14.339 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:14.336+0000 7f000a7eb640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f0004112c30 con 0x7f0004103ca0 2024-09-10T22:25:14.339 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:14.336+0000 7f000a7eb640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f0004112f30 con 0x7f00041045c0 2024-09-10T22:25:14.339 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:14.336+0000 7f0008d88640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f000410d100 0x7f000419eba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:25:14.339 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:14.336+0000 7f0008d88640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f000410d100 0x7f000419eba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:54324/0 (socket says 172.21.15.19:54324) 2024-09-10T22:25:14.340 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:14.336+0000 7f0008d88640 1 -- 172.21.15.19:0/2273474057 learned_addr learned my addr 172.21.15.19:0/2273474057 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:25:14.340 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:14.336+0000 7f0003fff640 1 --2- 172.21.15.19:0/2273474057 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0004103ca0 0x7f00041992c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:25:14.340 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:14.336+0000 7efffbfff640 1 --2- 172.21.15.19:0/2273474057 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f00041045c0 0x7f0004199800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:25:14.340 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:14.336+0000 7f0008d88640 1 -- 172.21.15.19:0/2273474057 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f00041045c0 msgr2=0x7f0004199800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:25:14.340 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:14.336+0000 7f0008d88640 1 --2- 172.21.15.19:0/2273474057 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f00041045c0 0x7f0004199800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:25:14.340 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:14.336+0000 7f0008d88640 1 -- 172.21.15.19:0/2273474057 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0004103ca0 msgr2=0x7f00041992c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:25:14.340 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:14.336+0000 7f0008d88640 1 --2- 172.21.15.19:0/2273474057 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0004103ca0 0x7f00041992c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:25:14.340 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:14.336+0000 7f0008d88640 1 -- 172.21.15.19:0/2273474057 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f000419f370 con 0x7f000410d100 2024-09-10T22:25:14.340 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:14.337+0000 7f0008d88640 1 --2- 172.21.15.19:0/2273474057 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f000410d100 0x7f000419eba0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7efffc00cce0 tx=0x7efffc00a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:25:14.341 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:14.337+0000 7f0001ffb640 1 -- 172.21.15.19:0/2273474057 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efffc00f450 con 0x7f000410d100 2024-09-10T22:25:14.341 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:14.337+0000 7f0001ffb640 1 -- 172.21.15.19:0/2273474057 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7efffc00faa0 con 0x7f000410d100 2024-09-10T22:25:14.341 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:14.337+0000 7f000a7eb640 1 -- 172.21.15.19:0/2273474057 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f000419f660 con 0x7f000410d100 2024-09-10T22:25:14.341 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:14.337+0000 7f0001ffb640 1 -- 172.21.15.19:0/2273474057 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efffc018a80 con 0x7f000410d100 2024-09-10T22:25:14.341 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:14.337+0000 7f000a7eb640 1 -- 172.21.15.19:0/2273474057 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f00041a5da0 con 0x7f000410d100 2024-09-10T22:25:14.341 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:14.339+0000 7f000a7eb640 1 -- 172.21.15.19:0/2273474057 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f000406b1b0 con 0x7f000410d100 2024-09-10T22:25:14.342 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:14.340+0000 7f0001ffb640 1 -- 172.21.15.19:0/2273474057 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 17) ==== 153301+0+0 (secure 0 0 0) 0x7efffc020030 con 0x7f000410d100 2024-09-10T22:25:14.342 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:14.341+0000 7f0001ffb640 1 --2- 172.21.15.19:0/2273474057 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7efff00b53f0 0x7efff00b78b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:25:14.342 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:14.341+0000 7f0003fff640 1 --2- 172.21.15.19:0/2273474057 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7efff00b53f0 0x7efff00b78b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:25:14.343 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:14.341+0000 7f0001ffb640 1 -- 172.21.15.19:0/2273474057 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8269+0+0 (secure 0 0 0) 0x7efffc0e5fc0 con 0x7f000410d100 2024-09-10T22:25:14.343 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:14.342+0000 7f0003fff640 1 --2- 172.21.15.19:0/2273474057 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7efff00b53f0 0x7efff00b78b0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7efff4009990 tx=0x7efff4009110 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:25:14.348 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:14.346+0000 7f0001ffb640 1 -- 172.21.15.19:0/2273474057 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7efffc056220 con 0x7f000410d100 2024-09-10T22:25:14.539 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:14.538+0000 7f000a7eb640 1 -- 172.21.15.19:0/2273474057 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7f00041a6100 con 0x7f000410d100 2024-09-10T22:25:14.539 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:14.538+0000 7f0001ffb640 1 -- 172.21.15.19:0/2273474057 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7efffc0a6e20 con 0x7f000410d100 2024-09-10T22:25:14.540 INFO:teuthology.orchestra.run.smithi019.stdout:51539607625 2024-09-10T22:25:14.542 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:14.540+0000 7f000a7eb640 1 -- 172.21.15.19:0/2273474057 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7efff00b53f0 msgr2=0x7efff00b78b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:25:14.542 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:14.540+0000 7f000a7eb640 1 --2- 172.21.15.19:0/2273474057 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7efff00b53f0 0x7efff00b78b0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7efff4009990 tx=0x7efff4009110 comp rx=0 tx=0).stop 2024-09-10T22:25:14.542 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:14.540+0000 7f000a7eb640 1 -- 172.21.15.19:0/2273474057 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f000410d100 msgr2=0x7f000419eba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:25:14.542 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:14.540+0000 7f000a7eb640 1 --2- 172.21.15.19:0/2273474057 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f000410d100 0x7f000419eba0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7efffc00cce0 tx=0x7efffc00a620 comp rx=0 tx=0).stop 2024-09-10T22:25:14.542 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:14.540+0000 7f000a7eb640 1 -- 172.21.15.19:0/2273474057 shutdown_connections 2024-09-10T22:25:14.542 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:14.540+0000 7f000a7eb640 1 --2- 172.21.15.19:0/2273474057 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7efff00b53f0 0x7efff00b78b0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:25:14.542 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:14.540+0000 7f000a7eb640 1 --2- 172.21.15.19:0/2273474057 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f000410d100 0x7f000419eba0 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:25:14.542 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:14.540+0000 7f000a7eb640 1 --2- 172.21.15.19:0/2273474057 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f00041045c0 0x7f0004199800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:25:14.542 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:14.540+0000 7f000a7eb640 1 --2- 172.21.15.19:0/2273474057 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0004103ca0 0x7f00041992c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:25:14.542 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:14.540+0000 7f000a7eb640 1 -- 172.21.15.19:0/2273474057 >> 172.21.15.19:0/2273474057 conn(0x7f00040fd700 msgr2=0x7f000410f340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:25:14.542 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:14.540+0000 7f000a7eb640 1 -- 172.21.15.19:0/2273474057 shutdown_connections 2024-09-10T22:25:14.543 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:14.540+0000 7f000a7eb640 1 -- 172.21.15.19:0/2273474057 wait complete. 2024-09-10T22:25:14.589 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:25:14 smithi019 ceph-mon[31375]: from='client.? 172.21.15.19:0/1457699045' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 10} : dispatch 2024-09-10T22:25:14.589 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:25:14 smithi019 ceph-mon[31375]: from='client.? 172.21.15.19:0/2273474057' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 1} : dispatch 2024-09-10T22:25:14.860 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:25:14 smithi135 ceph-mon[34789]: from='client.? 172.21.15.19:0/1457699045' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 10} : dispatch 2024-09-10T22:25:14.860 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:25:14 smithi135 ceph-mon[34789]: from='client.? 172.21.15.19:0/2273474057' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 1} : dispatch 2024-09-10T22:25:14.875 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:25:14 smithi138 ceph-mon[35236]: from='client.? 172.21.15.19:0/1457699045' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 10} : dispatch 2024-09-10T22:25:14.875 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:25:14 smithi138 ceph-mon[35236]: from='client.? 172.21.15.19:0/2273474057' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 1} : dispatch 2024-09-10T22:25:15.052 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:15.022+0000 7feffef7f640 1 -- 172.21.15.19:0/2974939564 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7feff81076e0 msgr2=0x7feff8107b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:25:15.052 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:15.022+0000 7feffef7f640 1 --2- 172.21.15.19:0/2974939564 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7feff81076e0 0x7feff8107b20 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fefec009900 tx=0x7fefec02a410 comp rx=0 tx=0).stop 2024-09-10T22:25:15.052 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:15.022+0000 7feffef7f640 1 -- 172.21.15.19:0/2974939564 shutdown_connections 2024-09-10T22:25:15.053 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:15.022+0000 7feffef7f640 1 --2- 172.21.15.19:0/2974939564 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7feff8108060 0x7feff810e860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:25:15.053 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:15.022+0000 7feffef7f640 1 --2- 172.21.15.19:0/2974939564 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7feff81076e0 0x7feff8107b20 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:25:15.053 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:15.022+0000 7feffef7f640 1 --2- 172.21.15.19:0/2974939564 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7feff8101cd0 0x7feff81020b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:25:15.053 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:15.022+0000 7feffef7f640 1 -- 172.21.15.19:0/2974939564 >> 172.21.15.19:0/2974939564 conn(0x7feff80fd700 msgr2=0x7feff80ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:25:15.053 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:15.022+0000 7feffef7f640 1 -- 172.21.15.19:0/2974939564 shutdown_connections 2024-09-10T22:25:15.053 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:15.022+0000 7feffef7f640 1 -- 172.21.15.19:0/2974939564 wait complete. 2024-09-10T22:25:15.053 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:15.023+0000 7feffef7f640 1 Processor -- start 2024-09-10T22:25:15.053 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:15.023+0000 7feffef7f640 1 -- start start 2024-09-10T22:25:15.053 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:15.023+0000 7feffef7f640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7feff8101cd0 0x7feff819a050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:25:15.053 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:15.023+0000 7feffef7f640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7feff81076e0 0x7feff819a590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:25:15.053 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:15.023+0000 7feffef7f640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7feff8108060 0x7feff819aaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:25:15.053 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:15.023+0000 7feffef7f640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7feff8111ce0 con 0x7feff8108060 2024-09-10T22:25:15.054 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:15.023+0000 7feffef7f640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7feff8111b60 con 0x7feff81076e0 2024-09-10T22:25:15.054 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:15.023+0000 7feffef7f640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7feff8111e60 con 0x7feff8101cd0 2024-09-10T22:25:15.054 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:15.023+0000 7feffd51c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7feff8108060 0x7feff819aaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:25:15.054 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:15.023+0000 7feffd51c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7feff8108060 0x7feff819aaf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:54336/0 (socket says 172.21.15.19:54336) 2024-09-10T22:25:15.054 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:15.023+0000 7feffd51c640 1 -- 172.21.15.19:0/404794580 learned_addr learned my addr 172.21.15.19:0/404794580 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:25:15.054 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:15.023+0000 7feff7fff640 1 --2- 172.21.15.19:0/404794580 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7feff81076e0 0x7feff819a590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:25:15.054 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:15.023+0000 7feffcd1b640 1 --2- 172.21.15.19:0/404794580 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7feff8101cd0 0x7feff819a050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:25:15.054 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:15.023+0000 7feffd51c640 1 -- 172.21.15.19:0/404794580 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7feff8101cd0 msgr2=0x7feff819a050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:25:15.054 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:15.023+0000 7feffd51c640 1 --2- 172.21.15.19:0/404794580 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7feff8101cd0 0x7feff819a050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:25:15.054 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:15.023+0000 7feffd51c640 1 -- 172.21.15.19:0/404794580 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7feff81076e0 msgr2=0x7feff819a590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:25:15.054 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:15.023+0000 7feffd51c640 1 --2- 172.21.15.19:0/404794580 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7feff81076e0 0x7feff819a590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:25:15.055 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:15.023+0000 7feffd51c640 1 -- 172.21.15.19:0/404794580 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feff81a5430 con 0x7feff8108060 2024-09-10T22:25:15.055 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:15.024+0000 7feffd51c640 1 --2- 172.21.15.19:0/404794580 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7feff8108060 0x7feff819aaf0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7feff000cad0 tx=0x7feff000cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:25:15.055 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:15.024+0000 7feff5ffb640 1 -- 172.21.15.19:0/404794580 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feff000ae20 con 0x7feff8108060 2024-09-10T22:25:15.055 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:15.024+0000 7feff5ffb640 1 -- 172.21.15.19:0/404794580 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7feff0005020 con 0x7feff8108060 2024-09-10T22:25:15.055 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:15.024+0000 7feff5ffb640 1 -- 172.21.15.19:0/404794580 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feff000f6b0 con 0x7feff8108060 2024-09-10T22:25:15.055 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:15.024+0000 7feffef7f640 1 -- 172.21.15.19:0/404794580 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feff81a5720 con 0x7feff8108060 2024-09-10T22:25:15.055 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:15.024+0000 7feffef7f640 1 -- 172.21.15.19:0/404794580 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feff81a5c80 con 0x7feff8108060 2024-09-10T22:25:15.055 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:15.025+0000 7feffef7f640 1 -- 172.21.15.19:0/404794580 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feff81020b0 con 0x7feff8108060 2024-09-10T22:25:15.055 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:15.026+0000 7feff5ffb640 1 -- 172.21.15.19:0/404794580 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 17) ==== 153301+0+0 (secure 0 0 0) 0x7feff00054f0 con 0x7feff8108060 2024-09-10T22:25:15.055 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:15.027+0000 7feff5ffb640 1 --2- 172.21.15.19:0/404794580 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7fefe00b53f0 0x7fefe00b78b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:25:15.055 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:15.027+0000 7feffcd1b640 1 --2- 172.21.15.19:0/404794580 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7fefe00b53f0 0x7fefe00b78b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:25:15.055 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:15.027+0000 7feff5ffb640 1 -- 172.21.15.19:0/404794580 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8269+0+0 (secure 0 0 0) 0x7feff00e5d40 con 0x7feff8108060 2024-09-10T22:25:15.055 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:15.028+0000 7feffcd1b640 1 --2- 172.21.15.19:0/404794580 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7fefe00b53f0 0x7fefe00b78b0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fefe8005e10 tx=0x7fefe8005da0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:25:15.056 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:15.031+0000 7feff5ffb640 1 -- 172.21.15.19:0/404794580 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7feff0014030 con 0x7feff8108060 2024-09-10T22:25:15.222 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:15.220+0000 7feffef7f640 1 -- 172.21.15.19:0/404794580 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7feff81098b0 con 0x7feff8108060 2024-09-10T22:25:15.222 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:15.220+0000 7feff5ffb640 1 -- 172.21.15.19:0/404794580 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7feff00aca20 con 0x7feff8108060 2024-09-10T22:25:15.222 INFO:teuthology.orchestra.run.smithi019.stdout:146028888116 2024-09-10T22:25:15.224 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:15.223+0000 7feffef7f640 1 -- 172.21.15.19:0/404794580 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7fefe00b53f0 msgr2=0x7fefe00b78b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:25:15.224 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:15.223+0000 7feffef7f640 1 --2- 172.21.15.19:0/404794580 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7fefe00b53f0 0x7fefe00b78b0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fefe8005e10 tx=0x7fefe8005da0 comp rx=0 tx=0).stop 2024-09-10T22:25:15.224 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:15.223+0000 7feffef7f640 1 -- 172.21.15.19:0/404794580 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7feff8108060 msgr2=0x7feff819aaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:25:15.224 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:15.223+0000 7feffef7f640 1 --2- 172.21.15.19:0/404794580 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7feff8108060 0x7feff819aaf0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7feff000cad0 tx=0x7feff000cf90 comp rx=0 tx=0).stop 2024-09-10T22:25:15.225 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:15.223+0000 7feffef7f640 1 -- 172.21.15.19:0/404794580 shutdown_connections 2024-09-10T22:25:15.225 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:15.223+0000 7feffef7f640 1 --2- 172.21.15.19:0/404794580 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7fefe00b53f0 0x7fefe00b78b0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:25:15.225 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:15.223+0000 7feffef7f640 1 --2- 172.21.15.19:0/404794580 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7feff8108060 0x7feff819aaf0 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:25:15.225 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:15.223+0000 7feffef7f640 1 --2- 172.21.15.19:0/404794580 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7feff81076e0 0x7feff819a590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:25:15.225 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:15.223+0000 7feffef7f640 1 --2- 172.21.15.19:0/404794580 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7feff8101cd0 0x7feff819a050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:25:15.225 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:15.223+0000 7feffef7f640 1 -- 172.21.15.19:0/404794580 >> 172.21.15.19:0/404794580 conn(0x7feff80fd700 msgr2=0x7feff80ffaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:25:15.225 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:15.223+0000 7feffef7f640 1 -- 172.21.15.19:0/404794580 shutdown_connections 2024-09-10T22:25:15.225 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:15.223+0000 7feffef7f640 1 -- 172.21.15.19:0/404794580 wait complete. 2024-09-10T22:25:15.861 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:25:15 smithi135 ceph-mon[34789]: pgmap v310: 97 pgs: 97 active+clean; 639 KiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 5 op/s; 68 B/s, 1 keys/s, 1 objects/s recovering 2024-09-10T22:25:15.861 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:25:15 smithi135 ceph-mon[34789]: from='client.? 172.21.15.19:0/404794580' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 5} : dispatch 2024-09-10T22:25:15.874 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:25:15 smithi138 ceph-mon[35236]: pgmap v310: 97 pgs: 97 active+clean; 639 KiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 5 op/s; 68 B/s, 1 keys/s, 1 objects/s recovering 2024-09-10T22:25:15.875 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:25:15 smithi138 ceph-mon[35236]: from='client.? 172.21.15.19:0/404794580' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 5} : dispatch 2024-09-10T22:25:15.958 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:25:15 smithi019 ceph-mon[31375]: pgmap v310: 97 pgs: 97 active+clean; 639 KiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 5 op/s; 68 B/s, 1 keys/s, 1 objects/s recovering 2024-09-10T22:25:15.958 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:25:15 smithi019 ceph-mon[31375]: from='client.? 172.21.15.19:0/404794580' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 5} : dispatch 2024-09-10T22:25:16.405 INFO:tasks.cephadm.ceph_manager.ceph:need seq 51539607623 got 51539607625 for osd.1 2024-09-10T22:25:16.406 DEBUG:teuthology.parallel:result is None 2024-09-10T22:25:16.594 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:16.592+0000 7fa7654cc640 1 -- 172.21.15.19:0/1424924783 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa760109150 msgr2=0x7fa76010f950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:25:16.594 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:16.592+0000 7fa7654cc640 1 --2- 172.21.15.19:0/1424924783 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa760109150 0x7fa76010f950 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fa758009ca0 tx=0x7fa75802a8c0 comp rx=0 tx=0).stop 2024-09-10T22:25:16.594 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:16.592+0000 7fa7654cc640 1 -- 172.21.15.19:0/1424924783 shutdown_connections 2024-09-10T22:25:16.594 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:16.592+0000 7fa7654cc640 1 --2- 172.21.15.19:0/1424924783 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa760109150 0x7fa76010f950 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:25:16.594 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:16.592+0000 7fa7654cc640 1 --2- 172.21.15.19:0/1424924783 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa7601087d0 0x7fa760108c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:25:16.594 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:16.592+0000 7fa7654cc640 1 --2- 172.21.15.19:0/1424924783 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa760102dc0 0x7fa7601031a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:25:16.594 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:16.592+0000 7fa7654cc640 1 -- 172.21.15.19:0/1424924783 >> 172.21.15.19:0/1424924783 conn(0x7fa7600fe830 msgr2=0x7fa760100c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:25:16.595 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:16.592+0000 7fa7654cc640 1 -- 172.21.15.19:0/1424924783 shutdown_connections 2024-09-10T22:25:16.595 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:16.592+0000 7fa7654cc640 1 -- 172.21.15.19:0/1424924783 wait complete. 2024-09-10T22:25:16.596 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:16.593+0000 7fa7654cc640 1 Processor -- start 2024-09-10T22:25:16.597 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:16.593+0000 7fa7654cc640 1 -- start start 2024-09-10T22:25:16.597 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:16.594+0000 7fa7654cc640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa760102dc0 0x7fa7600754a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:25:16.597 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:16.594+0000 7fa7654cc640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa7601087d0 0x7fa7600759e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:25:16.597 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:16.594+0000 7fa7654cc640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa760109150 0x7fa760075f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:25:16.597 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:16.594+0000 7fa7654cc640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fa760112e60 con 0x7fa760102dc0 2024-09-10T22:25:16.597 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:16.594+0000 7fa7654cc640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fa760112ce0 con 0x7fa7601087d0 2024-09-10T22:25:16.597 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:16.594+0000 7fa7654cc640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7fa760112fe0 con 0x7fa760109150 2024-09-10T22:25:16.597 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:16.594+0000 7fa75effd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa760102dc0 0x7fa7600754a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:25:16.597 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:16.594+0000 7fa75effd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa760102dc0 0x7fa7600754a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:54350/0 (socket says 172.21.15.19:54350) 2024-09-10T22:25:16.597 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:16.594+0000 7fa75effd640 1 -- 172.21.15.19:0/172440293 learned_addr learned my addr 172.21.15.19:0/172440293 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:25:16.597 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:16.594+0000 7fa7567fc640 1 --2- 172.21.15.19:0/172440293 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa7601087d0 0x7fa7600759e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:25:16.598 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:16.594+0000 7fa75f7fe640 1 --2- 172.21.15.19:0/172440293 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa760109150 0x7fa760075f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:25:16.598 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:16.594+0000 7fa75effd640 1 -- 172.21.15.19:0/172440293 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa760109150 msgr2=0x7fa760075f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:25:16.598 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:16.594+0000 7fa75effd640 1 --2- 172.21.15.19:0/172440293 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa760109150 0x7fa760075f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:25:16.598 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:16.594+0000 7fa75effd640 1 -- 172.21.15.19:0/172440293 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa7601087d0 msgr2=0x7fa7600759e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:25:16.598 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:16.594+0000 7fa75effd640 1 --2- 172.21.15.19:0/172440293 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa7601087d0 0x7fa7600759e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:25:16.598 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:16.594+0000 7fa75effd640 1 -- 172.21.15.19:0/172440293 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa7601a76a0 con 0x7fa760102dc0 2024-09-10T22:25:16.598 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:16.594+0000 7fa75effd640 1 --2- 172.21.15.19:0/172440293 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa760102dc0 0x7fa7600754a0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fa75000d950 tx=0x7fa75000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:25:16.598 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:16.595+0000 7fa75cff9640 1 -- 172.21.15.19:0/172440293 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa750017070 con 0x7fa760102dc0 2024-09-10T22:25:16.598 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:16.595+0000 7fa75cff9640 1 -- 172.21.15.19:0/172440293 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa750009c30 con 0x7fa760102dc0 2024-09-10T22:25:16.598 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:16.595+0000 7fa75cff9640 1 -- 172.21.15.19:0/172440293 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa75000f620 con 0x7fa760102dc0 2024-09-10T22:25:16.598 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:16.595+0000 7fa7654cc640 1 -- 172.21.15.19:0/172440293 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa7601a7990 con 0x7fa760102dc0 2024-09-10T22:25:16.598 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:16.595+0000 7fa7654cc640 1 -- 172.21.15.19:0/172440293 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa7601a7dc0 con 0x7fa760102dc0 2024-09-10T22:25:16.599 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:16.596+0000 7fa7654cc640 1 -- 172.21.15.19:0/172440293 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa7601031a0 con 0x7fa760102dc0 2024-09-10T22:25:16.599 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:16.597+0000 7fa75cff9640 1 -- 172.21.15.19:0/172440293 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 17) ==== 153301+0+0 (secure 0 0 0) 0x7fa750010460 con 0x7fa760102dc0 2024-09-10T22:25:16.600 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:16.598+0000 7fa75cff9640 1 --2- 172.21.15.19:0/172440293 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7fa74c0b5370 0x7fa74c0b7830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:25:16.600 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:16.598+0000 7fa7567fc640 1 --2- 172.21.15.19:0/172440293 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7fa74c0b5370 0x7fa74c0b7830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:25:16.600 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:16.599+0000 7fa75cff9640 1 -- 172.21.15.19:0/172440293 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8269+0+0 (secure 0 0 0) 0x7fa7500e5a20 con 0x7fa760102dc0 2024-09-10T22:25:16.600 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:16.599+0000 7fa7567fc640 1 --2- 172.21.15.19:0/172440293 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7fa74c0b5370 0x7fa74c0b7830 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fa760076f90 tx=0x7fa74800a2d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:25:16.603 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:16.602+0000 7fa75cff9640 1 -- 172.21.15.19:0/172440293 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7fa7500ac760 con 0x7fa760102dc0 2024-09-10T22:25:16.766 INFO:tasks.cephadm.ceph_manager.ceph:need seq 266287972378 got 266287972380 for osd.10 2024-09-10T22:25:16.766 DEBUG:teuthology.parallel:result is None 2024-09-10T22:25:16.792 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:16.791+0000 7fa7654cc640 1 -- 172.21.15.19:0/172440293 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 9} v 0) -- 0x7fa76002e5c0 con 0x7fa760102dc0 2024-09-10T22:25:16.792 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:16.791+0000 7fa75cff9640 1 -- 172.21.15.19:0/172440293 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 9}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7fa750009de0 con 0x7fa760102dc0 2024-09-10T22:25:16.793 INFO:teuthology.orchestra.run.smithi019.stdout:244813135905 2024-09-10T22:25:16.795 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:16.794+0000 7fa7654cc640 1 -- 172.21.15.19:0/172440293 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7fa74c0b5370 msgr2=0x7fa74c0b7830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:25:16.795 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:16.794+0000 7fa7654cc640 1 --2- 172.21.15.19:0/172440293 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7fa74c0b5370 0x7fa74c0b7830 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fa760076f90 tx=0x7fa74800a2d0 comp rx=0 tx=0).stop 2024-09-10T22:25:16.795 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:16.794+0000 7fa7654cc640 1 -- 172.21.15.19:0/172440293 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa760102dc0 msgr2=0x7fa7600754a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:25:16.795 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:16.794+0000 7fa7654cc640 1 --2- 172.21.15.19:0/172440293 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa760102dc0 0x7fa7600754a0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fa75000d950 tx=0x7fa75000de10 comp rx=0 tx=0).stop 2024-09-10T22:25:16.796 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:16.794+0000 7fa7654cc640 1 -- 172.21.15.19:0/172440293 shutdown_connections 2024-09-10T22:25:16.796 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:16.794+0000 7fa7654cc640 1 --2- 172.21.15.19:0/172440293 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7fa74c0b5370 0x7fa74c0b7830 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:25:16.796 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:16.794+0000 7fa7654cc640 1 --2- 172.21.15.19:0/172440293 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa760109150 0x7fa760075f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:25:16.796 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:16.794+0000 7fa7654cc640 1 --2- 172.21.15.19:0/172440293 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa7601087d0 0x7fa7600759e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:25:16.796 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:16.794+0000 7fa7654cc640 1 --2- 172.21.15.19:0/172440293 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa760102dc0 0x7fa7600754a0 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:25:16.796 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:16.794+0000 7fa7654cc640 1 -- 172.21.15.19:0/172440293 >> 172.21.15.19:0/172440293 conn(0x7fa7600fe830 msgr2=0x7fa760100c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:25:16.796 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:16.794+0000 7fa7654cc640 1 -- 172.21.15.19:0/172440293 shutdown_connections 2024-09-10T22:25:16.796 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:16.794+0000 7fa7654cc640 1 -- 172.21.15.19:0/172440293 wait complete. 2024-09-10T22:25:16.966 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:16.942+0000 7f8a0e51e640 1 -- 172.21.15.19:0/3417130404 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8a08103ca0 msgr2=0x7f8a08104080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:25:16.966 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:16.943+0000 7f8a0e51e640 1 --2- 172.21.15.19:0/3417130404 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8a08103ca0 0x7f8a08104080 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f89f8009900 tx=0x7f89f802a410 comp rx=0 tx=0).stop 2024-09-10T22:25:16.966 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:16.943+0000 7f8a0e51e640 1 -- 172.21.15.19:0/3417130404 shutdown_connections 2024-09-10T22:25:16.966 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:16.943+0000 7f8a0e51e640 1 --2- 172.21.15.19:0/3417130404 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f8a0810d100 0x7f8a0810f560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:25:16.966 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:16.943+0000 7f8a0e51e640 1 --2- 172.21.15.19:0/3417130404 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8a081045c0 0x7f8a0810cab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:25:16.966 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:16.943+0000 7f8a0e51e640 1 --2- 172.21.15.19:0/3417130404 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8a08103ca0 0x7f8a08104080 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:25:16.966 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:16.943+0000 7f8a0e51e640 1 -- 172.21.15.19:0/3417130404 >> 172.21.15.19:0/3417130404 conn(0x7f8a080fd700 msgr2=0x7f8a080ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:25:16.966 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:16.943+0000 7f8a0e51e640 1 -- 172.21.15.19:0/3417130404 shutdown_connections 2024-09-10T22:25:16.966 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:16.943+0000 7f8a0e51e640 1 -- 172.21.15.19:0/3417130404 wait complete. 2024-09-10T22:25:16.966 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:16.943+0000 7f8a0e51e640 1 Processor -- start 2024-09-10T22:25:16.967 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:16.943+0000 7f8a0e51e640 1 -- start start 2024-09-10T22:25:16.967 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:16.944+0000 7f8a0e51e640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f8a08103ca0 0x7f8a0819b370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:25:16.967 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:16.944+0000 7f8a0e51e640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8a081045c0 0x7f8a0819b8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:25:16.967 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:16.944+0000 7f8a0e51e640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8a0810d100 0x7f8a081a0c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:25:16.967 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:16.944+0000 7f8a0e51e640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f8a08112d70 con 0x7f8a081045c0 2024-09-10T22:25:16.967 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:16.944+0000 7f8a0e51e640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f8a08112bf0 con 0x7f8a0810d100 2024-09-10T22:25:16.967 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:16.944+0000 7f8a0e51e640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f8a08112ef0 con 0x7f8a08103ca0 2024-09-10T22:25:16.967 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:16.944+0000 7f8a07fff640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f8a08103ca0 0x7f8a0819b370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:25:16.967 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:16.944+0000 7f8a07fff640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f8a08103ca0 0x7f8a0819b370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.19:37702/0 (socket says 172.21.15.19:37702) 2024-09-10T22:25:16.967 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:16.944+0000 7f8a07fff640 1 -- 172.21.15.19:0/1208569936 learned_addr learned my addr 172.21.15.19:0/1208569936 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:25:16.967 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:16.944+0000 7f8a0cabb640 1 --2- 172.21.15.19:0/1208569936 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8a0810d100 0x7f8a081a0c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:25:16.967 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:16.944+0000 7f89fffff640 1 --2- 172.21.15.19:0/1208569936 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8a081045c0 0x7f8a0819b8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:25:16.968 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:16.944+0000 7f8a07fff640 1 -- 172.21.15.19:0/1208569936 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8a0810d100 msgr2=0x7f8a081a0c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:25:16.968 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:16.944+0000 7f8a07fff640 1 --2- 172.21.15.19:0/1208569936 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8a0810d100 0x7f8a081a0c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:25:16.968 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:16.944+0000 7f8a07fff640 1 -- 172.21.15.19:0/1208569936 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8a081045c0 msgr2=0x7f8a0819b8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:25:16.968 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:16.944+0000 7f8a07fff640 1 --2- 172.21.15.19:0/1208569936 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8a081045c0 0x7f8a0819b8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:25:16.968 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:16.944+0000 7f8a07fff640 1 -- 172.21.15.19:0/1208569936 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8a081a1420 con 0x7f8a08103ca0 2024-09-10T22:25:16.968 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:16.944+0000 7f8a07fff640 1 --2- 172.21.15.19:0/1208569936 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f8a08103ca0 0x7f8a0819b370 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f89f8006010 tx=0x7f89f80042f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:25:16.968 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:16.945+0000 7f8a05ffb640 1 -- 172.21.15.19:0/1208569936 <== mon.1 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89f803f030 con 0x7f8a08103ca0 2024-09-10T22:25:16.968 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:16.945+0000 7f8a05ffb640 1 -- 172.21.15.19:0/1208569936 <== mon.1 v2:172.21.15.138:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f89f8003800 con 0x7f8a08103ca0 2024-09-10T22:25:16.968 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:16.945+0000 7f8a0e51e640 1 -- 172.21.15.19:0/1208569936 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8a081a16b0 con 0x7f8a08103ca0 2024-09-10T22:25:16.968 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:16.945+0000 7f8a05ffb640 1 -- 172.21.15.19:0/1208569936 <== mon.1 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89f8035070 con 0x7f8a08103ca0 2024-09-10T22:25:16.968 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:16.945+0000 7f8a0e51e640 1 -- 172.21.15.19:0/1208569936 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8a081a7dd0 con 0x7f8a08103ca0 2024-09-10T22:25:16.968 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:16.946+0000 7f8a0e51e640 1 -- 172.21.15.19:0/1208569936 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8a08104080 con 0x7f8a08103ca0 2024-09-10T22:25:16.969 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:16.947+0000 7f8a05ffb640 1 -- 172.21.15.19:0/1208569936 <== mon.1 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 17) ==== 153301+0+0 (secure 0 0 0) 0x7f89f8031b10 con 0x7f8a08103ca0 2024-09-10T22:25:16.969 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:16.948+0000 7f8a05ffb640 1 --2- 172.21.15.19:0/1208569936 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f89f40b5370 0x7f89f40b7830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:25:16.969 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:16.948+0000 7f89fffff640 1 --2- 172.21.15.19:0/1208569936 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f89f40b5370 0x7f89f40b7830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:25:16.969 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:16.948+0000 7f8a05ffb640 1 -- 172.21.15.19:0/1208569936 <== mon.1 v2:172.21.15.138:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8269+0+0 (secure 0 0 0) 0x7f89f8106900 con 0x7f8a08103ca0 2024-09-10T22:25:16.969 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:16.948+0000 7f89fffff640 1 --2- 172.21.15.19:0/1208569936 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f89f40b5370 0x7f89f40b7830 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f8a0810e730 tx=0x7f89f0005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:25:16.969 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:16.951+0000 7f8a05ffb640 1 -- 172.21.15.19:0/1208569936 <== mon.1 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f89f80ccf90 con 0x7f8a08103ca0 2024-09-10T22:25:17.139 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:17.138+0000 7f8a0e51e640 1 -- 172.21.15.19:0/1208569936 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7f8a081a8030 con 0x7f8a08103ca0 2024-09-10T22:25:17.140 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:17.139+0000 7f8a05ffb640 1 -- 172.21.15.19:0/1208569936 <== mon.1 v2:172.21.15.138:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f89f80d19c0 con 0x7f8a08103ca0 2024-09-10T22:25:17.140 INFO:teuthology.orchestra.run.smithi019.stdout:171798691889 2024-09-10T22:25:17.142 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:17.141+0000 7f8a0e51e640 1 -- 172.21.15.19:0/1208569936 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f89f40b5370 msgr2=0x7f89f40b7830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:25:17.142 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:17.141+0000 7f8a0e51e640 1 --2- 172.21.15.19:0/1208569936 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f89f40b5370 0x7f89f40b7830 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f8a0810e730 tx=0x7f89f0005f90 comp rx=0 tx=0).stop 2024-09-10T22:25:17.142 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:17.141+0000 7f8a0e51e640 1 -- 172.21.15.19:0/1208569936 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f8a08103ca0 msgr2=0x7f8a0819b370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:25:17.142 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:17.141+0000 7f8a0e51e640 1 --2- 172.21.15.19:0/1208569936 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f8a08103ca0 0x7f8a0819b370 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f89f8006010 tx=0x7f89f80042f0 comp rx=0 tx=0).stop 2024-09-10T22:25:17.142 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:17.141+0000 7f8a0e51e640 1 -- 172.21.15.19:0/1208569936 shutdown_connections 2024-09-10T22:25:17.143 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:17.141+0000 7f8a0e51e640 1 --2- 172.21.15.19:0/1208569936 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f89f40b5370 0x7f89f40b7830 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:25:17.143 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:17.141+0000 7f8a0e51e640 1 --2- 172.21.15.19:0/1208569936 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8a0810d100 0x7f8a081a0c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:25:17.143 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:17.141+0000 7f8a0e51e640 1 --2- 172.21.15.19:0/1208569936 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8a081045c0 0x7f8a0819b8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:25:17.143 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:17.141+0000 7f8a0e51e640 1 --2- 172.21.15.19:0/1208569936 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f8a08103ca0 0x7f8a0819b370 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:25:17.143 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:17.141+0000 7f8a0e51e640 1 -- 172.21.15.19:0/1208569936 >> 172.21.15.19:0/1208569936 conn(0x7f8a080fd700 msgr2=0x7f8a08101830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:25:17.143 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:17.141+0000 7f8a0e51e640 1 -- 172.21.15.19:0/1208569936 shutdown_connections 2024-09-10T22:25:17.143 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:17.141+0000 7f8a0e51e640 1 -- 172.21.15.19:0/1208569936 wait complete. 2024-09-10T22:25:17.648 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:25:17 smithi019 ceph-mon[31375]: pgmap v311: 97 pgs: 97 active+clean; 639 KiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s; 61 B/s, 0 keys/s, 1 objects/s recovering 2024-09-10T22:25:17.649 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:25:17 smithi019 ceph-mon[31375]: from='client.? 172.21.15.19:0/172440293' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 9} : dispatch 2024-09-10T22:25:17.649 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:25:17 smithi019 ceph-mon[31375]: from='client.? 172.21.15.19:0/1208569936' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 6} : dispatch 2024-09-10T22:25:17.859 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:25:17 smithi135 ceph-mon[34789]: pgmap v311: 97 pgs: 97 active+clean; 639 KiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s; 61 B/s, 0 keys/s, 1 objects/s recovering 2024-09-10T22:25:17.860 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:25:17 smithi135 ceph-mon[34789]: from='client.? 172.21.15.19:0/172440293' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 9} : dispatch 2024-09-10T22:25:17.860 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:25:17 smithi135 ceph-mon[34789]: from='client.? 172.21.15.19:0/1208569936' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 6} : dispatch 2024-09-10T22:25:17.875 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:25:17 smithi138 ceph-mon[35236]: pgmap v311: 97 pgs: 97 active+clean; 639 KiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s; 61 B/s, 0 keys/s, 1 objects/s recovering 2024-09-10T22:25:17.875 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:25:17 smithi138 ceph-mon[35236]: from='client.? 172.21.15.19:0/172440293' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 9} : dispatch 2024-09-10T22:25:17.875 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:25:17 smithi138 ceph-mon[35236]: from='client.? 172.21.15.19:0/1208569936' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 6} : dispatch 2024-09-10T22:25:18.289 INFO:tasks.cephadm.ceph_manager.ceph:need seq 171798691886 got 171798691889 for osd.6 2024-09-10T22:25:18.289 DEBUG:teuthology.parallel:result is None 2024-09-10T22:25:18.720 INFO:tasks.cephadm.ceph_manager.ceph:need seq 146028888115 got 146028888116 for osd.5 2024-09-10T22:25:18.721 DEBUG:teuthology.parallel:result is None 2024-09-10T22:25:19.127 INFO:tasks.cephadm.ceph_manager.ceph:need seq 244813135901 got 244813135905 for osd.9 2024-09-10T22:25:19.127 DEBUG:teuthology.parallel:result is None 2024-09-10T22:25:19.701 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:25:19 smithi019 ceph-mon[31375]: pgmap v312: 97 pgs: 97 active+clean; 639 KiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s; 55 B/s, 0 keys/s, 0 objects/s recovering 2024-09-10T22:25:19.701 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:25:19 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T22:25:19.809 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:25:19 smithi138 ceph-mon[35236]: pgmap v312: 97 pgs: 97 active+clean; 639 KiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s; 55 B/s, 0 keys/s, 0 objects/s recovering 2024-09-10T22:25:19.809 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:25:19 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T22:25:19.818 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:19.783+0000 7f613f484640 1 -- 172.21.15.19:0/2230425503 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6138075f40 msgr2=0x7f613810ee10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:25:19.818 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:19.783+0000 7f613f484640 1 --2- 172.21.15.19:0/2230425503 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6138075f40 0x7f613810ee10 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f612c009900 tx=0x7f612c02a410 comp rx=0 tx=0).stop 2024-09-10T22:25:19.818 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:19.784+0000 7f613f484640 1 -- 172.21.15.19:0/2230425503 shutdown_connections 2024-09-10T22:25:19.818 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:19.784+0000 7f613f484640 1 --2- 172.21.15.19:0/2230425503 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f613810f3e0 0x7f61381117d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:25:19.818 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:19.784+0000 7f613f484640 1 --2- 172.21.15.19:0/2230425503 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6138075f40 0x7f613810ee10 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:25:19.818 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:19.784+0000 7f613f484640 1 --2- 172.21.15.19:0/2230425503 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6138075540 0x7f6138075920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:25:19.818 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:19.784+0000 7f613f484640 1 -- 172.21.15.19:0/2230425503 >> 172.21.15.19:0/2230425503 conn(0x7f61380fe830 msgr2=0x7f6138100c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:25:19.818 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:19.784+0000 7f613f484640 1 -- 172.21.15.19:0/2230425503 shutdown_connections 2024-09-10T22:25:19.818 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:19.784+0000 7f613f484640 1 -- 172.21.15.19:0/2230425503 wait complete. 2024-09-10T22:25:19.819 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:19.784+0000 7f613f484640 1 Processor -- start 2024-09-10T22:25:19.819 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:19.785+0000 7f613f484640 1 -- start start 2024-09-10T22:25:19.819 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:19.785+0000 7f613f484640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6138075540 0x7f613819b430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:25:19.819 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:19.785+0000 7f613f484640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6138075f40 0x7f613819b970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:25:19.819 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:19.785+0000 7f613f484640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f613810f3e0 0x7f61381a0d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:25:19.819 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:19.785+0000 7f613f484640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f6138114fa0 con 0x7f6138075f40 2024-09-10T22:25:19.819 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:19.785+0000 7f613f484640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f6138114e20 con 0x7f6138075540 2024-09-10T22:25:19.819 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:19.785+0000 7f613f484640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f6138115120 con 0x7f613810f3e0 2024-09-10T22:25:19.819 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:19.785+0000 7f613ca1f640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6138075f40 0x7f613819b970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:25:19.819 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:19.785+0000 7f613ca1f640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6138075f40 0x7f613819b970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:54380/0 (socket says 172.21.15.19:54380) 2024-09-10T22:25:19.819 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:19.785+0000 7f613ca1f640 1 -- 172.21.15.19:0/3349039588 learned_addr learned my addr 172.21.15.19:0/3349039588 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:25:19.819 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:19.785+0000 7f613d220640 1 --2- 172.21.15.19:0/3349039588 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6138075540 0x7f613819b430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:25:19.819 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:19.785+0000 7f613da21640 1 --2- 172.21.15.19:0/3349039588 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f613810f3e0 0x7f61381a0d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:25:19.820 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:19.785+0000 7f613ca1f640 1 -- 172.21.15.19:0/3349039588 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f613810f3e0 msgr2=0x7f61381a0d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:25:19.820 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:19.785+0000 7f613ca1f640 1 --2- 172.21.15.19:0/3349039588 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f613810f3e0 0x7f61381a0d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:25:19.820 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:19.785+0000 7f613ca1f640 1 -- 172.21.15.19:0/3349039588 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6138075540 msgr2=0x7f613819b430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:25:19.820 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:19.785+0000 7f613ca1f640 1 --2- 172.21.15.19:0/3349039588 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6138075540 0x7f613819b430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:25:19.820 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:19.785+0000 7f613ca1f640 1 -- 172.21.15.19:0/3349039588 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f61381a14e0 con 0x7f6138075f40 2024-09-10T22:25:19.820 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:19.785+0000 7f613d220640 1 --2- 172.21.15.19:0/3349039588 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6138075540 0x7f613819b430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T22:25:19.820 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:19.785+0000 7f613ca1f640 1 --2- 172.21.15.19:0/3349039588 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6138075f40 0x7f613819b970 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f612c006010 tx=0x7f612c0042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:25:19.820 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:19.786+0000 7f61367fc640 1 -- 172.21.15.19:0/3349039588 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f612c03f030 con 0x7f6138075f40 2024-09-10T22:25:19.820 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:19.786+0000 7f613f484640 1 -- 172.21.15.19:0/3349039588 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f61381a1770 con 0x7f6138075f40 2024-09-10T22:25:19.820 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:19.786+0000 7f61367fc640 1 -- 172.21.15.19:0/3349039588 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f612c003800 con 0x7f6138075f40 2024-09-10T22:25:19.820 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:19.786+0000 7f61367fc640 1 -- 172.21.15.19:0/3349039588 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f612c035070 con 0x7f6138075f40 2024-09-10T22:25:19.820 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:19.786+0000 7f613f484640 1 -- 172.21.15.19:0/3349039588 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f61381a7e90 con 0x7f6138075f40 2024-09-10T22:25:19.820 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:19.787+0000 7f613f484640 1 -- 172.21.15.19:0/3349039588 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6138075920 con 0x7f6138075f40 2024-09-10T22:25:19.821 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:19.788+0000 7f61367fc640 1 -- 172.21.15.19:0/3349039588 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 17) ==== 153301+0+0 (secure 0 0 0) 0x7f612c031b10 con 0x7f6138075f40 2024-09-10T22:25:19.821 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:19.789+0000 7f61367fc640 1 --2- 172.21.15.19:0/3349039588 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f61200b5370 0x7f61200b7830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:25:19.821 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:19.789+0000 7f613d220640 1 --2- 172.21.15.19:0/3349039588 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f61200b5370 0x7f61200b7830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:25:19.821 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:19.789+0000 7f61367fc640 1 -- 172.21.15.19:0/3349039588 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8269+0+0 (secure 0 0 0) 0x7f612c106a00 con 0x7f6138075f40 2024-09-10T22:25:19.821 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:19.789+0000 7f613d220640 1 --2- 172.21.15.19:0/3349039588 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f61200b5370 0x7f61200b7830 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f613000abe0 tx=0x7f613000a5c0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:25:19.821 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:19.792+0000 7f61367fc640 1 -- 172.21.15.19:0/3349039588 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f612c0cd740 con 0x7f6138075f40 2024-09-10T22:25:19.859 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:25:19 smithi135 ceph-mon[34789]: pgmap v312: 97 pgs: 97 active+clean; 639 KiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s; 55 B/s, 0 keys/s, 0 objects/s recovering 2024-09-10T22:25:19.860 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:25:19 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T22:25:19.980 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:19.979+0000 7f613f484640 1 -- 172.21.15.19:0/3349039588 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7f61381a8090 con 0x7f6138075f40 2024-09-10T22:25:19.981 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:19.979+0000 7f61367fc640 1 -- 172.21.15.19:0/3349039588 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f612c0cd040 con 0x7f6138075f40 2024-09-10T22:25:19.981 INFO:teuthology.orchestra.run.smithi019.stdout:34359738448 2024-09-10T22:25:19.983 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:19.982+0000 7f613f484640 1 -- 172.21.15.19:0/3349039588 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f61200b5370 msgr2=0x7f61200b7830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:25:19.983 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:19.982+0000 7f613f484640 1 --2- 172.21.15.19:0/3349039588 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f61200b5370 0x7f61200b7830 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f613000abe0 tx=0x7f613000a5c0 comp rx=0 tx=0).stop 2024-09-10T22:25:19.983 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:19.982+0000 7f613f484640 1 -- 172.21.15.19:0/3349039588 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6138075f40 msgr2=0x7f613819b970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:25:19.983 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:19.982+0000 7f613f484640 1 --2- 172.21.15.19:0/3349039588 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6138075f40 0x7f613819b970 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f612c006010 tx=0x7f612c0042f0 comp rx=0 tx=0).stop 2024-09-10T22:25:19.983 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:19.982+0000 7f613f484640 1 -- 172.21.15.19:0/3349039588 shutdown_connections 2024-09-10T22:25:19.983 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:19.982+0000 7f613f484640 1 --2- 172.21.15.19:0/3349039588 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f61200b5370 0x7f61200b7830 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:25:19.983 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:19.982+0000 7f613f484640 1 --2- 172.21.15.19:0/3349039588 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f613810f3e0 0x7f61381a0d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:25:19.983 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:19.982+0000 7f613f484640 1 --2- 172.21.15.19:0/3349039588 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6138075f40 0x7f613819b970 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:25:19.984 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:19.982+0000 7f613f484640 1 --2- 172.21.15.19:0/3349039588 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6138075540 0x7f613819b430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:25:19.984 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:19.982+0000 7f613f484640 1 -- 172.21.15.19:0/3349039588 >> 172.21.15.19:0/3349039588 conn(0x7f61380fe830 msgr2=0x7f6138111500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:25:19.984 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:19.982+0000 7f613f484640 1 -- 172.21.15.19:0/3349039588 shutdown_connections 2024-09-10T22:25:19.984 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:19.982+0000 7f613f484640 1 -- 172.21.15.19:0/3349039588 wait complete. 2024-09-10T22:25:20.023 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:19.992+0000 7f6e16275640 1 -- 172.21.15.19:0/1066962667 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6e10104590 msgr2=0x7f6e1010cb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:25:20.023 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:19.992+0000 7f6e16275640 1 --2- 172.21.15.19:0/1066962667 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6e10104590 0x7f6e1010cb70 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f6df8009900 tx=0x7f6df802a410 comp rx=0 tx=0).stop 2024-09-10T22:25:20.023 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:19.992+0000 7f6e16275640 1 -- 172.21.15.19:0/1066962667 shutdown_connections 2024-09-10T22:25:20.024 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:19.992+0000 7f6e16275640 1 --2- 172.21.15.19:0/1066962667 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f6e1010d140 0x7f6e1010f550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:25:20.024 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:19.992+0000 7f6e16275640 1 --2- 172.21.15.19:0/1066962667 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6e10104590 0x7f6e1010cb70 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:25:20.024 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:19.992+0000 7f6e16275640 1 --2- 172.21.15.19:0/1066962667 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6e10103b90 0x7f6e10103f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:25:20.024 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:19.992+0000 7f6e16275640 1 -- 172.21.15.19:0/1066962667 >> 172.21.15.19:0/1066962667 conn(0x7f6e100fd700 msgr2=0x7f6e100ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:25:20.024 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:19.992+0000 7f6e16275640 1 -- 172.21.15.19:0/1066962667 shutdown_connections 2024-09-10T22:25:20.024 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:19.992+0000 7f6e16275640 1 -- 172.21.15.19:0/1066962667 wait complete. 2024-09-10T22:25:20.024 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:19.993+0000 7f6e16275640 1 Processor -- start 2024-09-10T22:25:20.024 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:19.993+0000 7f6e16275640 1 -- start start 2024-09-10T22:25:20.024 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:19.993+0000 7f6e16275640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f6e10103b90 0x7f6e10199330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:25:20.024 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:19.993+0000 7f6e16275640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6e10104590 0x7f6e10199870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:25:20.024 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:19.993+0000 7f6e16275640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6e1010d140 0x7f6e1019ec10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:25:20.025 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:19.993+0000 7f6e16275640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f6e10112d60 con 0x7f6e10104590 2024-09-10T22:25:20.025 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:19.993+0000 7f6e16275640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f6e10112be0 con 0x7f6e1010d140 2024-09-10T22:25:20.025 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:19.993+0000 7f6e16275640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f6e10112ee0 con 0x7f6e10103b90 2024-09-10T22:25:20.025 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:19.993+0000 7f6e07fff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6e10104590 0x7f6e10199870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:25:20.025 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:19.993+0000 7f6e07fff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6e10104590 0x7f6e10199870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:54394/0 (socket says 172.21.15.19:54394) 2024-09-10T22:25:20.025 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:19.993+0000 7f6e07fff640 1 -- 172.21.15.19:0/456455648 learned_addr learned my addr 172.21.15.19:0/456455648 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:25:20.025 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:19.993+0000 7f6e0ffff640 1 --2- 172.21.15.19:0/456455648 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f6e10103b90 0x7f6e10199330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:25:20.025 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:19.993+0000 7f6e14812640 1 --2- 172.21.15.19:0/456455648 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6e1010d140 0x7f6e1019ec10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:25:20.025 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:19.994+0000 7f6e07fff640 1 -- 172.21.15.19:0/456455648 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f6e10103b90 msgr2=0x7f6e10199330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:25:20.025 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:19.994+0000 7f6e07fff640 1 --2- 172.21.15.19:0/456455648 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f6e10103b90 0x7f6e10199330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:25:20.025 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:19.994+0000 7f6e07fff640 1 -- 172.21.15.19:0/456455648 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6e1010d140 msgr2=0x7f6e1019ec10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:25:20.025 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:19.994+0000 7f6e07fff640 1 --2- 172.21.15.19:0/456455648 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6e1010d140 0x7f6e1019ec10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:25:20.026 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:19.994+0000 7f6e07fff640 1 -- 172.21.15.19:0/456455648 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6e1019f3e0 con 0x7f6e10104590 2024-09-10T22:25:20.026 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:19.994+0000 7f6e07fff640 1 --2- 172.21.15.19:0/456455648 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6e10104590 0x7f6e10199870 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f6df8005940 tx=0x7f6df80040c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:25:20.026 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:19.994+0000 7f6e0dffb640 1 -- 172.21.15.19:0/456455648 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6df803f030 con 0x7f6e10104590 2024-09-10T22:25:20.026 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:19.994+0000 7f6e16275640 1 -- 172.21.15.19:0/456455648 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6e1019f670 con 0x7f6e10104590 2024-09-10T22:25:20.026 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:19.994+0000 7f6e0dffb640 1 -- 172.21.15.19:0/456455648 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6df80044c0 con 0x7f6e10104590 2024-09-10T22:25:20.026 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:19.994+0000 7f6e0dffb640 1 -- 172.21.15.19:0/456455648 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6df8035070 con 0x7f6e10104590 2024-09-10T22:25:20.026 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:19.994+0000 7f6e16275640 1 -- 172.21.15.19:0/456455648 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6e101a5d90 con 0x7f6e10104590 2024-09-10T22:25:20.026 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:19.995+0000 7f6e16275640 1 -- 172.21.15.19:0/456455648 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6e10103f70 con 0x7f6e10104590 2024-09-10T22:25:20.026 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:19.997+0000 7f6e0dffb640 1 -- 172.21.15.19:0/456455648 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 17) ==== 153301+0+0 (secure 0 0 0) 0x7f6df803ba20 con 0x7f6e10104590 2024-09-10T22:25:20.026 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:19.998+0000 7f6e0dffb640 1 --2- 172.21.15.19:0/456455648 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f6dfc0b5370 0x7f6dfc0b7830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:25:20.026 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:19.998+0000 7f6e0ffff640 1 --2- 172.21.15.19:0/456455648 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f6dfc0b5370 0x7f6dfc0b7830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:25:20.026 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:19.998+0000 7f6e0dffb640 1 -- 172.21.15.19:0/456455648 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8269+0+0 (secure 0 0 0) 0x7f6df81066b0 con 0x7f6e10104590 2024-09-10T22:25:20.027 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:19.998+0000 7f6e0ffff640 1 --2- 172.21.15.19:0/456455648 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f6dfc0b5370 0x7f6dfc0b7830 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f6e00009bd0 tx=0x7f6e00005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:25:20.027 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:20.001+0000 7f6e0dffb640 1 -- 172.21.15.19:0/456455648 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f6df80ccd40 con 0x7f6e10104590 2024-09-10T22:25:20.199 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:20.198+0000 7f6e16275640 1 -- 172.21.15.19:0/456455648 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 11} v 0) -- 0x7f6e1019a460 con 0x7f6e10104590 2024-09-10T22:25:20.199 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:20.198+0000 7f6e0dffb640 1 -- 172.21.15.19:0/456455648 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 11}]=0 v0) ==== 75+0+13 (secure 0 0 0) 0x7f6df80d1770 con 0x7f6e10104590 2024-09-10T22:25:20.199 INFO:teuthology.orchestra.run.smithi019.stdout:287762808856 2024-09-10T22:25:20.201 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:20.200+0000 7f6e16275640 1 -- 172.21.15.19:0/456455648 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f6dfc0b5370 msgr2=0x7f6dfc0b7830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:25:20.201 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:20.200+0000 7f6e16275640 1 --2- 172.21.15.19:0/456455648 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f6dfc0b5370 0x7f6dfc0b7830 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f6e00009bd0 tx=0x7f6e00005f90 comp rx=0 tx=0).stop 2024-09-10T22:25:20.201 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:20.200+0000 7f6e16275640 1 -- 172.21.15.19:0/456455648 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6e10104590 msgr2=0x7f6e10199870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:25:20.202 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:20.200+0000 7f6e16275640 1 --2- 172.21.15.19:0/456455648 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6e10104590 0x7f6e10199870 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f6df8005940 tx=0x7f6df80040c0 comp rx=0 tx=0).stop 2024-09-10T22:25:20.202 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:20.200+0000 7f6e16275640 1 -- 172.21.15.19:0/456455648 shutdown_connections 2024-09-10T22:25:20.202 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:20.200+0000 7f6e16275640 1 --2- 172.21.15.19:0/456455648 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f6dfc0b5370 0x7f6dfc0b7830 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:25:20.202 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:20.200+0000 7f6e16275640 1 --2- 172.21.15.19:0/456455648 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6e1010d140 0x7f6e1019ec10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:25:20.202 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:20.200+0000 7f6e16275640 1 --2- 172.21.15.19:0/456455648 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6e10104590 0x7f6e10199870 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:25:20.202 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:20.200+0000 7f6e16275640 1 --2- 172.21.15.19:0/456455648 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f6e10103b90 0x7f6e10199330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:25:20.202 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:20.200+0000 7f6e16275640 1 -- 172.21.15.19:0/456455648 >> 172.21.15.19:0/456455648 conn(0x7f6e100fd700 msgr2=0x7f6e100fe440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:25:20.202 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:20.200+0000 7f6e16275640 1 -- 172.21.15.19:0/456455648 shutdown_connections 2024-09-10T22:25:20.202 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:20.200+0000 7f6e16275640 1 -- 172.21.15.19:0/456455648 wait complete. 2024-09-10T22:25:20.859 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:25:20 smithi135 ceph-mon[34789]: from='client.? 172.21.15.19:0/3349039588' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 0} : dispatch 2024-09-10T22:25:20.860 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:25:20 smithi135 ceph-mon[34789]: from='client.? 172.21.15.19:0/456455648' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 11} : dispatch 2024-09-10T22:25:20.860 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:25:20 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:25:20.860 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:25:20 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:25:20.860 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:25:20 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:25:20.860 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:25:20 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:25:20.874 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:25:20 smithi138 ceph-mon[35236]: from='client.? 172.21.15.19:0/3349039588' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 0} : dispatch 2024-09-10T22:25:20.875 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:25:20 smithi138 ceph-mon[35236]: from='client.? 172.21.15.19:0/456455648' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 11} : dispatch 2024-09-10T22:25:20.875 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:25:20 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:25:20.875 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:25:20 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:25:20.875 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:25:20 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:25:20.875 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:25:20 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:25:20.900 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:25:20 smithi019 ceph-mon[31375]: from='client.? 172.21.15.19:0/3349039588' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 0} : dispatch 2024-09-10T22:25:20.900 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:25:20 smithi019 ceph-mon[31375]: from='client.? 172.21.15.19:0/456455648' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 11} : dispatch 2024-09-10T22:25:20.900 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:25:20 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:25:20.900 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:25:20 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:25:20.900 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:25:20 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:25:20.900 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:25:20 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:25:21.283 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/22997a4c-6fc2-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T22:25:21.318 INFO:tasks.cephadm.ceph_manager.ceph:need seq 287762808853 got 287762808856 for osd.11 2024-09-10T22:25:21.318 DEBUG:teuthology.parallel:result is None 2024-09-10T22:25:21.464 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:21.461+0000 7fc6a1a09640 1 -- 172.21.15.19:0/4089433539 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc69c104600 msgr2=0x7fc69c10caf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:25:21.464 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:21.461+0000 7fc6a1a09640 1 --2- 172.21.15.19:0/4089433539 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc69c104600 0x7fc69c10caf0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fc690009900 tx=0x7fc69002a410 comp rx=0 tx=0).stop 2024-09-10T22:25:21.464 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:21.461+0000 7fc6a1a09640 1 -- 172.21.15.19:0/4089433539 shutdown_connections 2024-09-10T22:25:21.464 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:21.461+0000 7fc6a1a09640 1 --2- 172.21.15.19:0/4089433539 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc69c10d140 0x7fc69c10f5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:25:21.464 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:21.461+0000 7fc6a1a09640 1 --2- 172.21.15.19:0/4089433539 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc69c104600 0x7fc69c10caf0 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:25:21.465 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:21.461+0000 7fc6a1a09640 1 --2- 172.21.15.19:0/4089433539 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc69c103ce0 0x7fc69c1040c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:25:21.465 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:21.461+0000 7fc6a1a09640 1 -- 172.21.15.19:0/4089433539 >> 172.21.15.19:0/4089433539 conn(0x7fc69c0fd700 msgr2=0x7fc69c0ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:25:21.465 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:21.461+0000 7fc6a1a09640 1 -- 172.21.15.19:0/4089433539 shutdown_connections 2024-09-10T22:25:21.465 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:21.461+0000 7fc6a1a09640 1 -- 172.21.15.19:0/4089433539 wait complete. 2024-09-10T22:25:21.465 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:21.461+0000 7fc6a1a09640 1 Processor -- start 2024-09-10T22:25:21.465 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:21.462+0000 7fc6a1a09640 1 -- start start 2024-09-10T22:25:21.465 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:21.462+0000 7fc6a1a09640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc69c103ce0 0x7fc69c199280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:25:21.465 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:21.462+0000 7fc6a1a09640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc69c104600 0x7fc69c1997c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:25:21.465 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:21.462+0000 7fc6a1a09640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc69c10d140 0x7fc69c19eb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:25:21.465 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:21.462+0000 7fc6a1a09640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fc69c112db0 con 0x7fc69c10d140 2024-09-10T22:25:21.465 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:21.462+0000 7fc6a1a09640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fc69c112c30 con 0x7fc69c103ce0 2024-09-10T22:25:21.466 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:21.462+0000 7fc6a1a09640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7fc69c112f30 con 0x7fc69c104600 2024-09-10T22:25:21.466 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:21.462+0000 7fc69b7fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc69c10d140 0x7fc69c19eb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:25:21.466 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:21.462+0000 7fc69b7fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc69c10d140 0x7fc69c19eb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:54418/0 (socket says 172.21.15.19:54418) 2024-09-10T22:25:21.466 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:21.462+0000 7fc69b7fe640 1 -- 172.21.15.19:0/48600623 learned_addr learned my addr 172.21.15.19:0/48600623 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:25:21.466 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:21.462+0000 7fc69a7fc640 1 --2- 172.21.15.19:0/48600623 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc69c104600 0x7fc69c1997c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:25:21.466 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:21.462+0000 7fc69affd640 1 --2- 172.21.15.19:0/48600623 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc69c103ce0 0x7fc69c199280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:25:21.466 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:21.462+0000 7fc69b7fe640 1 -- 172.21.15.19:0/48600623 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc69c104600 msgr2=0x7fc69c1997c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:25:21.466 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:21.462+0000 7fc69b7fe640 1 --2- 172.21.15.19:0/48600623 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc69c104600 0x7fc69c1997c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:25:21.466 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:21.462+0000 7fc69b7fe640 1 -- 172.21.15.19:0/48600623 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc69c103ce0 msgr2=0x7fc69c199280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:25:21.466 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:21.462+0000 7fc69b7fe640 1 --2- 172.21.15.19:0/48600623 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc69c103ce0 0x7fc69c199280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:25:21.466 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:21.462+0000 7fc69b7fe640 1 -- 172.21.15.19:0/48600623 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc69c19f330 con 0x7fc69c10d140 2024-09-10T22:25:21.466 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:21.463+0000 7fc69b7fe640 1 --2- 172.21.15.19:0/48600623 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc69c10d140 0x7fc69c19eb60 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fc69400cad0 tx=0x7fc69400ced0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:25:21.466 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:21.463+0000 7fc6a0a07640 1 -- 172.21.15.19:0/48600623 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc69400ad60 con 0x7fc69c10d140 2024-09-10T22:25:21.467 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:21.463+0000 7fc6a1a09640 1 -- 172.21.15.19:0/48600623 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc69c19f620 con 0x7fc69c10d140 2024-09-10T22:25:21.467 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:21.463+0000 7fc6a0a07640 1 -- 172.21.15.19:0/48600623 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc694005020 con 0x7fc69c10d140 2024-09-10T22:25:21.467 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:21.463+0000 7fc6a0a07640 1 -- 172.21.15.19:0/48600623 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc69400f6b0 con 0x7fc69c10d140 2024-09-10T22:25:21.467 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:21.463+0000 7fc6a1a09640 1 -- 172.21.15.19:0/48600623 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc69c101870 con 0x7fc69c10d140 2024-09-10T22:25:21.468 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:21.464+0000 7fc6a1a09640 1 -- 172.21.15.19:0/48600623 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc69c06bb90 con 0x7fc69c10d140 2024-09-10T22:25:21.468 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:21.465+0000 7fc6a0a07640 1 -- 172.21.15.19:0/48600623 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 17) ==== 153301+0+0 (secure 0 0 0) 0x7fc6940054f0 con 0x7fc69c10d140 2024-09-10T22:25:21.468 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:21.466+0000 7fc6a0a07640 1 --2- 172.21.15.19:0/48600623 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7fc6840b5370 0x7fc6840b7830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:25:21.468 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:21.466+0000 7fc69affd640 1 --2- 172.21.15.19:0/48600623 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7fc6840b5370 0x7fc6840b7830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:25:21.468 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:21.466+0000 7fc6a0a07640 1 -- 172.21.15.19:0/48600623 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8269+0+0 (secure 0 0 0) 0x7fc6940e6150 con 0x7fc69c10d140 2024-09-10T22:25:21.468 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:21.467+0000 7fc69affd640 1 --2- 172.21.15.19:0/48600623 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7fc6840b5370 0x7fc6840b7830 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fc68c0071c0 tx=0x7fc68c010040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:25:21.470 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:21.469+0000 7fc6a0a07640 1 -- 172.21.15.19:0/48600623 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7fc694014030 con 0x7fc69c10d140 2024-09-10T22:25:21.665 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:21.663+0000 7fc6a1a09640 1 -- 172.21.15.19:0/48600623 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7fc69c101b90 con 0x7fc69c10d140 2024-09-10T22:25:21.665 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:21.664+0000 7fc6a0a07640 1 -- 172.21.15.19:0/48600623 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7fc6940ace30 con 0x7fc69c10d140 2024-09-10T22:25:21.665 INFO:teuthology.orchestra.run.smithi019.stdout:197568495661 2024-09-10T22:25:21.668 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:21.666+0000 7fc6a1a09640 1 -- 172.21.15.19:0/48600623 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7fc6840b5370 msgr2=0x7fc6840b7830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:25:21.668 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:21.666+0000 7fc6a1a09640 1 --2- 172.21.15.19:0/48600623 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7fc6840b5370 0x7fc6840b7830 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fc68c0071c0 tx=0x7fc68c010040 comp rx=0 tx=0).stop 2024-09-10T22:25:21.668 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:21.666+0000 7fc6a1a09640 1 -- 172.21.15.19:0/48600623 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc69c10d140 msgr2=0x7fc69c19eb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:25:21.668 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:21.666+0000 7fc6a1a09640 1 --2- 172.21.15.19:0/48600623 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc69c10d140 0x7fc69c19eb60 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fc69400cad0 tx=0x7fc69400ced0 comp rx=0 tx=0).stop 2024-09-10T22:25:21.668 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:21.666+0000 7fc6a1a09640 1 -- 172.21.15.19:0/48600623 shutdown_connections 2024-09-10T22:25:21.668 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:21.666+0000 7fc6a1a09640 1 --2- 172.21.15.19:0/48600623 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7fc6840b5370 0x7fc6840b7830 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:25:21.668 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:21.666+0000 7fc6a1a09640 1 --2- 172.21.15.19:0/48600623 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc69c10d140 0x7fc69c19eb60 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:25:21.668 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:21.666+0000 7fc6a1a09640 1 --2- 172.21.15.19:0/48600623 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc69c104600 0x7fc69c1997c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:25:21.668 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:21.666+0000 7fc6a1a09640 1 --2- 172.21.15.19:0/48600623 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc69c103ce0 0x7fc69c199280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:25:21.668 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:21.666+0000 7fc6a1a09640 1 -- 172.21.15.19:0/48600623 >> 172.21.15.19:0/48600623 conn(0x7fc69c0fd700 msgr2=0x7fc69c0fe300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:25:21.668 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:21.666+0000 7fc6a1a09640 1 -- 172.21.15.19:0/48600623 shutdown_connections 2024-09-10T22:25:21.669 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:21.666+0000 7fc6a1a09640 1 -- 172.21.15.19:0/48600623 wait complete. 2024-09-10T22:25:21.860 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:25:21 smithi135 ceph-mon[34789]: pgmap v313: 97 pgs: 97 active+clean; 639 KiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s; 55 B/s, 0 keys/s, 0 objects/s recovering 2024-09-10T22:25:21.875 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:25:21 smithi138 ceph-mon[35236]: pgmap v313: 97 pgs: 97 active+clean; 639 KiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s; 55 B/s, 0 keys/s, 0 objects/s recovering 2024-09-10T22:25:21.958 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:25:21 smithi019 ceph-mon[31375]: pgmap v313: 97 pgs: 97 active+clean; 639 KiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s; 55 B/s, 0 keys/s, 0 objects/s recovering 2024-09-10T22:25:22.401 INFO:tasks.cephadm.ceph_manager.ceph:need seq 197568495659 got 197568495661 for osd.7 2024-09-10T22:25:22.402 DEBUG:teuthology.parallel:result is None 2024-09-10T22:25:22.707 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:25:22 smithi019 ceph-mon[31375]: from='client.? 172.21.15.19:0/48600623' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 7} : dispatch 2024-09-10T22:25:22.792 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:22.790+0000 7fdf2e11f640 1 -- 172.21.15.19:0/2702505664 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdf28109150 msgr2=0x7fdf2810f950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:25:22.792 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:22.790+0000 7fdf2e11f640 1 --2- 172.21.15.19:0/2702505664 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdf28109150 0x7fdf2810f950 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7fdf20009ca0 tx=0x7fdf2002a8c0 comp rx=0 tx=0).stop 2024-09-10T22:25:22.792 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:22.791+0000 7fdf2e11f640 1 -- 172.21.15.19:0/2702505664 shutdown_connections 2024-09-10T22:25:22.792 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:22.791+0000 7fdf2e11f640 1 --2- 172.21.15.19:0/2702505664 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdf28109150 0x7fdf2810f950 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:25:22.793 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:22.791+0000 7fdf2e11f640 1 --2- 172.21.15.19:0/2702505664 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fdf281087d0 0x7fdf28108c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:25:22.793 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:22.791+0000 7fdf2e11f640 1 --2- 172.21.15.19:0/2702505664 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdf28102dc0 0x7fdf281031a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:25:22.793 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:22.791+0000 7fdf2e11f640 1 -- 172.21.15.19:0/2702505664 >> 172.21.15.19:0/2702505664 conn(0x7fdf280fe830 msgr2=0x7fdf28100c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:25:22.793 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:22.791+0000 7fdf2e11f640 1 -- 172.21.15.19:0/2702505664 shutdown_connections 2024-09-10T22:25:22.793 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:22.791+0000 7fdf2e11f640 1 -- 172.21.15.19:0/2702505664 wait complete. 2024-09-10T22:25:22.795 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:22.791+0000 7fdf2e11f640 1 Processor -- start 2024-09-10T22:25:22.795 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:22.791+0000 7fdf2e11f640 1 -- start start 2024-09-10T22:25:22.795 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:22.791+0000 7fdf2e11f640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdf28102dc0 0x7fdf28199240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:25:22.795 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:22.791+0000 7fdf2e11f640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdf281087d0 0x7fdf28199780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:25:22.795 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:22.791+0000 7fdf2e11f640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fdf28109150 0x7fdf2819eb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:25:22.795 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:22.791+0000 7fdf2e11f640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fdf28112e10 con 0x7fdf281087d0 2024-09-10T22:25:22.795 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:22.792+0000 7fdf2e11f640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fdf28112c90 con 0x7fdf28102dc0 2024-09-10T22:25:22.795 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:22.792+0000 7fdf2e11f640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7fdf28112f90 con 0x7fdf28109150 2024-09-10T22:25:22.795 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:22.792+0000 7fdf1ffff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdf281087d0 0x7fdf28199780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:25:22.796 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:22.792+0000 7fdf1ffff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdf281087d0 0x7fdf28199780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:54432/0 (socket says 172.21.15.19:54432) 2024-09-10T22:25:22.796 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:22.792+0000 7fdf1ffff640 1 -- 172.21.15.19:0/3011089259 learned_addr learned my addr 172.21.15.19:0/3011089259 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:25:22.796 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:22.792+0000 7fdf277fe640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdf28102dc0 0x7fdf28199240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:25:22.796 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:22.792+0000 7fdf27fff640 1 --2- 172.21.15.19:0/3011089259 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fdf28109150 0x7fdf2819eb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:25:22.796 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:22.792+0000 7fdf277fe640 1 -- 172.21.15.19:0/3011089259 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fdf28109150 msgr2=0x7fdf2819eb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:25:22.796 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:22.792+0000 7fdf277fe640 1 --2- 172.21.15.19:0/3011089259 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fdf28109150 0x7fdf2819eb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:25:22.796 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:22.792+0000 7fdf277fe640 1 -- 172.21.15.19:0/3011089259 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdf281087d0 msgr2=0x7fdf28199780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:25:22.796 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:22.792+0000 7fdf277fe640 1 --2- 172.21.15.19:0/3011089259 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdf281087d0 0x7fdf28199780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:25:22.796 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:22.792+0000 7fdf277fe640 1 -- 172.21.15.19:0/3011089259 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdf2819f2f0 con 0x7fdf28102dc0 2024-09-10T22:25:22.796 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:22.792+0000 7fdf1ffff640 1 --2- 172.21.15.19:0/3011089259 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdf281087d0 0x7fdf28199780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T22:25:22.796 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:22.792+0000 7fdf277fe640 1 --2- 172.21.15.19:0/3011089259 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdf28102dc0 0x7fdf28199240 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fdf1800e9f0 tx=0x7fdf1800eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:25:22.797 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:22.792+0000 7fdf257fa640 1 -- 172.21.15.19:0/3011089259 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf1800ccc0 con 0x7fdf28102dc0 2024-09-10T22:25:22.797 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:22.793+0000 7fdf2e11f640 1 -- 172.21.15.19:0/3011089259 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdf2819f5e0 con 0x7fdf28102dc0 2024-09-10T22:25:22.797 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:22.793+0000 7fdf257fa640 1 -- 172.21.15.19:0/3011089259 <== mon.2 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fdf180108e0 con 0x7fdf28102dc0 2024-09-10T22:25:22.797 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:22.793+0000 7fdf257fa640 1 -- 172.21.15.19:0/3011089259 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf18018880 con 0x7fdf28102dc0 2024-09-10T22:25:22.797 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:22.793+0000 7fdf2e11f640 1 -- 172.21.15.19:0/3011089259 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdf281a5e70 con 0x7fdf28102dc0 2024-09-10T22:25:22.797 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:22.794+0000 7fdf2e11f640 1 -- 172.21.15.19:0/3011089259 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdf28104070 con 0x7fdf28102dc0 2024-09-10T22:25:22.798 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:22.795+0000 7fdf257fa640 1 -- 172.21.15.19:0/3011089259 <== mon.2 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 17) ==== 153301+0+0 (secure 0 0 0) 0x7fdf18010430 con 0x7fdf28102dc0 2024-09-10T22:25:22.798 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:22.796+0000 7fdf257fa640 1 --2- 172.21.15.19:0/3011089259 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7fdf140b5370 0x7fdf140b7830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:25:22.798 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:22.796+0000 7fdf1ffff640 1 --2- 172.21.15.19:0/3011089259 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7fdf140b5370 0x7fdf140b7830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:25:22.798 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:22.796+0000 7fdf257fa640 1 -- 172.21.15.19:0/3011089259 <== mon.2 v2:172.21.15.135:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8269+0+0 (secure 0 0 0) 0x7fdf180e6560 con 0x7fdf28102dc0 2024-09-10T22:25:22.798 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:22.797+0000 7fdf1ffff640 1 --2- 172.21.15.19:0/3011089259 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7fdf140b5370 0x7fdf140b7830 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fdf28108300 tx=0x7fdf1000b4a0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:25:22.800 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:22.799+0000 7fdf257fa640 1 -- 172.21.15.19:0/3011089259 <== mon.2 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7fdf180acbf0 con 0x7fdf28102dc0 2024-09-10T22:25:22.859 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:25:22 smithi135 ceph-mon[34789]: from='client.? 172.21.15.19:0/48600623' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 7} : dispatch 2024-09-10T22:25:22.874 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:25:22 smithi138 ceph-mon[35236]: from='client.? 172.21.15.19:0/48600623' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 7} : dispatch 2024-09-10T22:25:22.991 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:22.990+0000 7fdf2e11f640 1 -- 172.21.15.19:0/3011089259 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7fdf281a60a0 con 0x7fdf28102dc0 2024-09-10T22:25:22.991 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:22.990+0000 7fdf257fa640 1 -- 172.21.15.19:0/3011089259 <== mon.2 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fdf180b1620 con 0x7fdf28102dc0 2024-09-10T22:25:22.992 INFO:teuthology.orchestra.run.smithi019.stdout:73014444103 2024-09-10T22:25:22.994 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:22.993+0000 7fdf2e11f640 1 -- 172.21.15.19:0/3011089259 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7fdf140b5370 msgr2=0x7fdf140b7830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:25:22.994 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:22.993+0000 7fdf2e11f640 1 --2- 172.21.15.19:0/3011089259 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7fdf140b5370 0x7fdf140b7830 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fdf28108300 tx=0x7fdf1000b4a0 comp rx=0 tx=0).stop 2024-09-10T22:25:22.994 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:22.993+0000 7fdf2e11f640 1 -- 172.21.15.19:0/3011089259 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdf28102dc0 msgr2=0x7fdf28199240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:25:22.995 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:22.993+0000 7fdf2e11f640 1 --2- 172.21.15.19:0/3011089259 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdf28102dc0 0x7fdf28199240 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fdf1800e9f0 tx=0x7fdf1800eeb0 comp rx=0 tx=0).stop 2024-09-10T22:25:22.995 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:22.993+0000 7fdf2e11f640 1 -- 172.21.15.19:0/3011089259 shutdown_connections 2024-09-10T22:25:22.995 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:22.993+0000 7fdf2e11f640 1 --2- 172.21.15.19:0/3011089259 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7fdf140b5370 0x7fdf140b7830 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:25:22.995 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:22.993+0000 7fdf2e11f640 1 --2- 172.21.15.19:0/3011089259 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fdf28109150 0x7fdf2819eb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:25:22.995 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:22.993+0000 7fdf2e11f640 1 --2- 172.21.15.19:0/3011089259 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdf281087d0 0x7fdf28199780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:25:22.995 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:22.993+0000 7fdf2e11f640 1 --2- 172.21.15.19:0/3011089259 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdf28102dc0 0x7fdf28199240 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:25:22.995 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:22.993+0000 7fdf2e11f640 1 -- 172.21.15.19:0/3011089259 >> 172.21.15.19:0/3011089259 conn(0x7fdf280fe830 msgr2=0x7fdf28100c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:25:22.995 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:22.993+0000 7fdf2e11f640 1 -- 172.21.15.19:0/3011089259 shutdown_connections 2024-09-10T22:25:22.995 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:22.993+0000 7fdf2e11f640 1 -- 172.21.15.19:0/3011089259 wait complete. 2024-09-10T22:25:23.001 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:22.990+0000 7f4f37b98640 1 -- 172.21.15.19:0/783594535 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4f30101c90 msgr2=0x7f4f30102070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:25:23.001 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:22.990+0000 7f4f37b98640 1 --2- 172.21.15.19:0/783594535 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4f30101c90 0x7f4f30102070 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f4f2c009900 tx=0x7f4f2c02a410 comp rx=0 tx=0).stop 2024-09-10T22:25:23.001 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:22.990+0000 7f4f37b98640 1 -- 172.21.15.19:0/783594535 shutdown_connections 2024-09-10T22:25:23.001 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:22.990+0000 7f4f37b98640 1 --2- 172.21.15.19:0/783594535 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f4f30108020 0x7f4f3010e820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:25:23.001 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:22.990+0000 7f4f37b98640 1 --2- 172.21.15.19:0/783594535 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4f301076a0 0x7f4f30107ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:25:23.001 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:22.990+0000 7f4f37b98640 1 --2- 172.21.15.19:0/783594535 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4f30101c90 0x7f4f30102070 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:25:23.001 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:22.990+0000 7f4f37b98640 1 -- 172.21.15.19:0/783594535 >> 172.21.15.19:0/783594535 conn(0x7f4f300fd700 msgr2=0x7f4f300ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:25:23.001 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:22.991+0000 7f4f37b98640 1 -- 172.21.15.19:0/783594535 shutdown_connections 2024-09-10T22:25:23.001 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:22.991+0000 7f4f37b98640 1 -- 172.21.15.19:0/783594535 wait complete. 2024-09-10T22:25:23.001 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:22.991+0000 7f4f37b98640 1 Processor -- start 2024-09-10T22:25:23.002 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:22.991+0000 7f4f37b98640 1 -- start start 2024-09-10T22:25:23.002 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:22.991+0000 7f4f37b98640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4f30101c90 0x7f4f301992b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:25:23.002 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:22.991+0000 7f4f37b98640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f4f301076a0 0x7f4f301997f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:25:23.002 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:22.991+0000 7f4f37b98640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4f30108020 0x7f4f3019eb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:25:23.002 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:22.991+0000 7f4f37b98640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f4f30111ce0 con 0x7f4f30108020 2024-09-10T22:25:23.002 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:22.991+0000 7f4f37b98640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f4f30111b60 con 0x7f4f30101c90 2024-09-10T22:25:23.002 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:22.991+0000 7f4f37b98640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f4f30111e60 con 0x7f4f301076a0 2024-09-10T22:25:23.002 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:22.992+0000 7f4f36135640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4f30108020 0x7f4f3019eb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:25:23.002 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:22.992+0000 7f4f36135640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4f30108020 0x7f4f3019eb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:54438/0 (socket says 172.21.15.19:54438) 2024-09-10T22:25:23.002 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:22.992+0000 7f4f35934640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4f30101c90 0x7f4f301992b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:25:23.002 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:22.992+0000 7f4f36135640 1 -- 172.21.15.19:0/4152917022 learned_addr learned my addr 172.21.15.19:0/4152917022 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:25:23.002 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:22.992+0000 7f4f35133640 1 --2- 172.21.15.19:0/4152917022 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f4f301076a0 0x7f4f301997f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:25:23.002 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:22.992+0000 7f4f36135640 1 -- 172.21.15.19:0/4152917022 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f4f301076a0 msgr2=0x7f4f301997f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:25:23.003 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:22.992+0000 7f4f36135640 1 --2- 172.21.15.19:0/4152917022 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f4f301076a0 0x7f4f301997f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:25:23.003 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:22.992+0000 7f4f36135640 1 -- 172.21.15.19:0/4152917022 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4f30101c90 msgr2=0x7f4f301992b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:25:23.003 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:22.992+0000 7f4f36135640 1 --2- 172.21.15.19:0/4152917022 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4f30101c90 0x7f4f301992b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:25:23.003 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:22.992+0000 7f4f36135640 1 -- 172.21.15.19:0/4152917022 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4f3019f360 con 0x7f4f30108020 2024-09-10T22:25:23.003 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:22.992+0000 7f4f35934640 1 --2- 172.21.15.19:0/4152917022 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4f30101c90 0x7f4f301992b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T22:25:23.003 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:22.992+0000 7f4f36135640 1 --2- 172.21.15.19:0/4152917022 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4f30108020 0x7f4f3019eb90 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f4f2800eaa0 tx=0x7f4f2800ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:25:23.003 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:22.992+0000 7f4f26ffd640 1 -- 172.21.15.19:0/4152917022 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f2800cdb0 con 0x7f4f30108020 2024-09-10T22:25:23.003 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:22.992+0000 7f4f37b98640 1 -- 172.21.15.19:0/4152917022 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4f3019f650 con 0x7f4f30108020 2024-09-10T22:25:23.003 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:22.992+0000 7f4f26ffd640 1 -- 172.21.15.19:0/4152917022 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4f28005020 con 0x7f4f30108020 2024-09-10T22:25:23.003 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:22.992+0000 7f4f26ffd640 1 -- 172.21.15.19:0/4152917022 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f280116d0 con 0x7f4f30108020 2024-09-10T22:25:23.003 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:22.993+0000 7f4f37b98640 1 -- 172.21.15.19:0/4152917022 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4f301a5ee0 con 0x7f4f30108020 2024-09-10T22:25:23.003 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:22.994+0000 7f4f37b98640 1 -- 172.21.15.19:0/4152917022 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4f30102f40 con 0x7f4f30108020 2024-09-10T22:25:23.003 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:22.995+0000 7f4f26ffd640 1 -- 172.21.15.19:0/4152917022 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 17) ==== 153301+0+0 (secure 0 0 0) 0x7f4f2800f040 con 0x7f4f30108020 2024-09-10T22:25:23.003 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:22.996+0000 7f4f26ffd640 1 --2- 172.21.15.19:0/4152917022 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f4f1c0b5370 0x7f4f1c0b7830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:25:23.004 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:22.996+0000 7f4f35934640 1 --2- 172.21.15.19:0/4152917022 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f4f1c0b5370 0x7f4f1c0b7830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:25:23.004 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:22.996+0000 7f4f26ffd640 1 -- 172.21.15.19:0/4152917022 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8269+0+0 (secure 0 0 0) 0x7f4f280e5b30 con 0x7f4f30108020 2024-09-10T22:25:23.004 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:22.997+0000 7f4f35934640 1 --2- 172.21.15.19:0/4152917022 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f4f1c0b5370 0x7f4f1c0b7830 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f4f2c031440 tx=0x7f4f2c005b50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:25:23.004 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:23.000+0000 7f4f26ffd640 1 -- 172.21.15.19:0/4152917022 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f4f28016030 con 0x7f4f30108020 2024-09-10T22:25:23.198 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:23.197+0000 7f4f37b98640 1 -- 172.21.15.19:0/4152917022 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7f4f3010ae10 con 0x7f4f30108020 2024-09-10T22:25:23.199 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:23.197+0000 7f4f26ffd640 1 -- 172.21.15.19:0/4152917022 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f4f280ac220 con 0x7f4f30108020 2024-09-10T22:25:23.199 INFO:teuthology.orchestra.run.smithi019.stdout:124554051643 2024-09-10T22:25:23.201 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:23.199+0000 7f4f37b98640 1 -- 172.21.15.19:0/4152917022 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f4f1c0b5370 msgr2=0x7f4f1c0b7830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:25:23.201 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:23.199+0000 7f4f37b98640 1 --2- 172.21.15.19:0/4152917022 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f4f1c0b5370 0x7f4f1c0b7830 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f4f2c031440 tx=0x7f4f2c005b50 comp rx=0 tx=0).stop 2024-09-10T22:25:23.201 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:23.199+0000 7f4f37b98640 1 -- 172.21.15.19:0/4152917022 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4f30108020 msgr2=0x7f4f3019eb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:25:23.201 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:23.199+0000 7f4f37b98640 1 --2- 172.21.15.19:0/4152917022 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4f30108020 0x7f4f3019eb90 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f4f2800eaa0 tx=0x7f4f2800ef60 comp rx=0 tx=0).stop 2024-09-10T22:25:23.201 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:23.199+0000 7f4f37b98640 1 -- 172.21.15.19:0/4152917022 shutdown_connections 2024-09-10T22:25:23.201 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:23.199+0000 7f4f37b98640 1 --2- 172.21.15.19:0/4152917022 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f4f1c0b5370 0x7f4f1c0b7830 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:25:23.201 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:23.199+0000 7f4f37b98640 1 --2- 172.21.15.19:0/4152917022 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4f30108020 0x7f4f3019eb90 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:25:23.201 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:23.199+0000 7f4f37b98640 1 --2- 172.21.15.19:0/4152917022 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f4f301076a0 0x7f4f301997f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:25:23.201 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:23.199+0000 7f4f37b98640 1 --2- 172.21.15.19:0/4152917022 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4f30101c90 0x7f4f301992b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:25:23.202 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:23.199+0000 7f4f37b98640 1 -- 172.21.15.19:0/4152917022 >> 172.21.15.19:0/4152917022 conn(0x7f4f300fd700 msgr2=0x7f4f3006ad90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:25:23.202 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:23.200+0000 7f4f37b98640 1 -- 172.21.15.19:0/4152917022 shutdown_connections 2024-09-10T22:25:23.202 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:23.200+0000 7f4f37b98640 1 -- 172.21.15.19:0/4152917022 wait complete. 2024-09-10T22:25:23.818 INFO:tasks.cephadm.ceph_manager.ceph:need seq 124554051639 got 124554051643 for osd.4 2024-09-10T22:25:23.818 DEBUG:teuthology.parallel:result is None 2024-09-10T22:25:23.859 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:25:23 smithi135 ceph-mon[34789]: pgmap v314: 97 pgs: 97 active+clean; 639 KiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s; 7 B/s, 0 objects/s recovering 2024-09-10T22:25:23.859 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:25:23 smithi135 ceph-mon[34789]: from='client.? 172.21.15.19:0/3011089259' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 2} : dispatch 2024-09-10T22:25:23.859 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:25:23 smithi135 ceph-mon[34789]: from='client.? 172.21.15.19:0/4152917022' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 4} : dispatch 2024-09-10T22:25:23.875 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:25:23 smithi138 ceph-mon[35236]: pgmap v314: 97 pgs: 97 active+clean; 639 KiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s; 7 B/s, 0 objects/s recovering 2024-09-10T22:25:23.875 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:25:23 smithi138 ceph-mon[35236]: from='client.? 172.21.15.19:0/3011089259' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 2} : dispatch 2024-09-10T22:25:23.875 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:25:23 smithi138 ceph-mon[35236]: from='client.? 172.21.15.19:0/4152917022' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 4} : dispatch 2024-09-10T22:25:23.932 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:25:23 smithi019 ceph-mon[31375]: pgmap v314: 97 pgs: 97 active+clean; 639 KiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s; 7 B/s, 0 objects/s recovering 2024-09-10T22:25:23.932 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:25:23 smithi019 ceph-mon[31375]: from='client.? 172.21.15.19:0/3011089259' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 2} : dispatch 2024-09-10T22:25:23.932 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:25:23 smithi019 ceph-mon[31375]: from='client.? 172.21.15.19:0/4152917022' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 4} : dispatch 2024-09-10T22:25:24.024 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:24.015+0000 7fb8e7235640 1 -- 172.21.15.19:0/1262869812 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb8e0101cb0 msgr2=0x7fb8e0102090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:25:24.024 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:24.015+0000 7fb8e7235640 1 --2- 172.21.15.19:0/1262869812 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb8e0101cb0 0x7fb8e0102090 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7fb8d0009900 tx=0x7fb8d002a3f0 comp rx=0 tx=0).stop 2024-09-10T22:25:24.024 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:24.015+0000 7fb8e7235640 1 -- 172.21.15.19:0/1262869812 shutdown_connections 2024-09-10T22:25:24.024 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:24.015+0000 7fb8e7235640 1 --2- 172.21.15.19:0/1262869812 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb8e0108040 0x7fb8e010e840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:25:24.024 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:24.015+0000 7fb8e7235640 1 --2- 172.21.15.19:0/1262869812 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb8e01076c0 0x7fb8e0107b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:25:24.024 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:24.015+0000 7fb8e7235640 1 --2- 172.21.15.19:0/1262869812 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb8e0101cb0 0x7fb8e0102090 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:25:24.024 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:24.015+0000 7fb8e7235640 1 -- 172.21.15.19:0/1262869812 >> 172.21.15.19:0/1262869812 conn(0x7fb8e00fd700 msgr2=0x7fb8e00ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:25:24.025 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:24.015+0000 7fb8e7235640 1 -- 172.21.15.19:0/1262869812 shutdown_connections 2024-09-10T22:25:24.025 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:24.015+0000 7fb8e7235640 1 -- 172.21.15.19:0/1262869812 wait complete. 2024-09-10T22:25:24.025 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:24.016+0000 7fb8e7235640 1 Processor -- start 2024-09-10T22:25:24.025 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:24.016+0000 7fb8e7235640 1 -- start start 2024-09-10T22:25:24.025 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:24.016+0000 7fb8e7235640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb8e0101cb0 0x7fb8e0199340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:25:24.025 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:24.016+0000 7fb8e7235640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb8e01076c0 0x7fb8e0199880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:25:24.025 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:24.016+0000 7fb8e7235640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb8e0108040 0x7fb8e019ec20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:25:24.025 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:24.016+0000 7fb8e7235640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fb8e0111d00 con 0x7fb8e01076c0 2024-09-10T22:25:24.025 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:24.016+0000 7fb8e7235640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fb8e0111b80 con 0x7fb8e0101cb0 2024-09-10T22:25:24.025 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:24.016+0000 7fb8e7235640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7fb8e0111e80 con 0x7fb8e0108040 2024-09-10T22:25:24.025 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:24.016+0000 7fb8dffff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb8e01076c0 0x7fb8e0199880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:25:24.025 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:24.016+0000 7fb8dffff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb8e01076c0 0x7fb8e0199880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:60460/0 (socket says 172.21.15.19:60460) 2024-09-10T22:25:24.026 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:24.016+0000 7fb8dffff640 1 -- 172.21.15.19:0/1927159953 learned_addr learned my addr 172.21.15.19:0/1927159953 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:25:24.026 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:24.017+0000 7fb8e4fd1640 1 --2- 172.21.15.19:0/1927159953 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb8e0101cb0 0x7fb8e0199340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:25:24.026 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:24.017+0000 7fb8e57d2640 1 --2- 172.21.15.19:0/1927159953 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb8e0108040 0x7fb8e019ec20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:25:24.026 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:24.017+0000 7fb8dffff640 1 -- 172.21.15.19:0/1927159953 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb8e0108040 msgr2=0x7fb8e019ec20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:25:24.026 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:24.017+0000 7fb8dffff640 1 --2- 172.21.15.19:0/1927159953 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb8e0108040 0x7fb8e019ec20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:25:24.026 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:24.017+0000 7fb8dffff640 1 -- 172.21.15.19:0/1927159953 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb8e0101cb0 msgr2=0x7fb8e0199340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:25:24.026 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:24.017+0000 7fb8dffff640 1 --2- 172.21.15.19:0/1927159953 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb8e0101cb0 0x7fb8e0199340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:25:24.026 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:24.017+0000 7fb8dffff640 1 -- 172.21.15.19:0/1927159953 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb8e019f3f0 con 0x7fb8e01076c0 2024-09-10T22:25:24.026 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:24.017+0000 7fb8dffff640 1 --2- 172.21.15.19:0/1927159953 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb8e01076c0 0x7fb8e0199880 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fb8c800eab0 tx=0x7fb8c800ef70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:25:24.026 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:24.017+0000 7fb8ddffb640 1 -- 172.21.15.19:0/1927159953 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8c800ce40 con 0x7fb8e01076c0 2024-09-10T22:25:24.026 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:24.017+0000 7fb8ddffb640 1 -- 172.21.15.19:0/1927159953 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb8c8011920 con 0x7fb8e01076c0 2024-09-10T22:25:24.026 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:24.017+0000 7fb8ddffb640 1 -- 172.21.15.19:0/1927159953 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8c8010a30 con 0x7fb8e01076c0 2024-09-10T22:25:24.027 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:24.017+0000 7fb8e7235640 1 -- 172.21.15.19:0/1927159953 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb8e019f6e0 con 0x7fb8e01076c0 2024-09-10T22:25:24.027 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:24.017+0000 7fb8e7235640 1 -- 172.21.15.19:0/1927159953 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb8e01a5f70 con 0x7fb8e01076c0 2024-09-10T22:25:24.027 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:24.018+0000 7fb8e7235640 1 -- 172.21.15.19:0/1927159953 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb8e0102090 con 0x7fb8e01076c0 2024-09-10T22:25:24.027 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:24.020+0000 7fb8ddffb640 1 -- 172.21.15.19:0/1927159953 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 17) ==== 153301+0+0 (secure 0 0 0) 0x7fb8c800f040 con 0x7fb8e01076c0 2024-09-10T22:25:24.027 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:24.021+0000 7fb8ddffb640 1 --2- 172.21.15.19:0/1927159953 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7fb8cc0b53f0 0x7fb8cc0b78b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:25:24.027 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:24.021+0000 7fb8e4fd1640 1 --2- 172.21.15.19:0/1927159953 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7fb8cc0b53f0 0x7fb8cc0b78b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:25:24.027 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:24.021+0000 7fb8ddffb640 1 -- 172.21.15.19:0/1927159953 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8269+0+0 (secure 0 0 0) 0x7fb8c80e6070 con 0x7fb8e01076c0 2024-09-10T22:25:24.027 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:24.021+0000 7fb8e4fd1640 1 --2- 172.21.15.19:0/1927159953 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7fb8cc0b53f0 0x7fb8cc0b78b0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fb8d0031440 tx=0x7fb8d0005b50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:25:24.027 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:24.024+0000 7fb8ddffb640 1 -- 172.21.15.19:0/1927159953 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7fb8c8016030 con 0x7fb8e01076c0 2024-09-10T22:25:24.215 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:24.213+0000 7fb8e7235640 1 -- 172.21.15.19:0/1927159953 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7fb8e01a6140 con 0x7fb8e01076c0 2024-09-10T22:25:24.215 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:24.214+0000 7fb8ddffb640 1 -- 172.21.15.19:0/1927159953 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fb8c80acdd0 con 0x7fb8e01076c0 2024-09-10T22:25:24.215 INFO:teuthology.orchestra.run.smithi019.stdout:98784247872 2024-09-10T22:25:24.217 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:24.216+0000 7fb8e7235640 1 -- 172.21.15.19:0/1927159953 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7fb8cc0b53f0 msgr2=0x7fb8cc0b78b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:25:24.217 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:24.216+0000 7fb8e7235640 1 --2- 172.21.15.19:0/1927159953 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7fb8cc0b53f0 0x7fb8cc0b78b0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fb8d0031440 tx=0x7fb8d0005b50 comp rx=0 tx=0).stop 2024-09-10T22:25:24.217 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:24.216+0000 7fb8e7235640 1 -- 172.21.15.19:0/1927159953 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb8e01076c0 msgr2=0x7fb8e0199880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:25:24.218 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:24.216+0000 7fb8e7235640 1 --2- 172.21.15.19:0/1927159953 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb8e01076c0 0x7fb8e0199880 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fb8c800eab0 tx=0x7fb8c800ef70 comp rx=0 tx=0).stop 2024-09-10T22:25:24.218 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:24.216+0000 7fb8e7235640 1 -- 172.21.15.19:0/1927159953 shutdown_connections 2024-09-10T22:25:24.218 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:24.216+0000 7fb8e7235640 1 --2- 172.21.15.19:0/1927159953 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7fb8cc0b53f0 0x7fb8cc0b78b0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:25:24.218 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:24.216+0000 7fb8e7235640 1 --2- 172.21.15.19:0/1927159953 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb8e0108040 0x7fb8e019ec20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:25:24.218 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:24.216+0000 7fb8e7235640 1 --2- 172.21.15.19:0/1927159953 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb8e01076c0 0x7fb8e0199880 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:25:24.218 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:24.216+0000 7fb8e7235640 1 --2- 172.21.15.19:0/1927159953 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb8e0101cb0 0x7fb8e0199340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:25:24.218 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:24.216+0000 7fb8e7235640 1 -- 172.21.15.19:0/1927159953 >> 172.21.15.19:0/1927159953 conn(0x7fb8e00fd700 msgr2=0x7fb8e0105a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:25:24.218 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:24.216+0000 7fb8e7235640 1 -- 172.21.15.19:0/1927159953 shutdown_connections 2024-09-10T22:25:24.218 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:24.216+0000 7fb8e7235640 1 -- 172.21.15.19:0/1927159953 wait complete. 2024-09-10T22:25:24.467 INFO:tasks.cephadm.ceph_manager.ceph:need seq 73014444100 got 73014444103 for osd.2 2024-09-10T22:25:24.467 DEBUG:teuthology.parallel:result is None 2024-09-10T22:25:24.758 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:25:24 smithi019 ceph-mon[31375]: from='client.? 172.21.15.19:0/1927159953' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 3} : dispatch 2024-09-10T22:25:24.843 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:24.839+0000 7f7653a5e640 1 -- 172.21.15.19:0/2695998330 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f764c1087d0 msgr2=0x7f764c108c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:25:24.843 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:24.839+0000 7f7653a5e640 1 --2- 172.21.15.19:0/2695998330 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f764c1087d0 0x7f764c108c10 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f763c009900 tx=0x7f763c02a410 comp rx=0 tx=0).stop 2024-09-10T22:25:24.843 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:24.839+0000 7f7653a5e640 1 -- 172.21.15.19:0/2695998330 shutdown_connections 2024-09-10T22:25:24.843 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:24.839+0000 7f7653a5e640 1 --2- 172.21.15.19:0/2695998330 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f764c109150 0x7f764c10f950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:25:24.843 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:24.839+0000 7f7653a5e640 1 --2- 172.21.15.19:0/2695998330 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f764c1087d0 0x7f764c108c10 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:25:24.844 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:24.839+0000 7f7653a5e640 1 --2- 172.21.15.19:0/2695998330 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f764c102dc0 0x7f764c1031a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:25:24.844 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:24.839+0000 7f7653a5e640 1 -- 172.21.15.19:0/2695998330 >> 172.21.15.19:0/2695998330 conn(0x7f764c0fe830 msgr2=0x7f764c100c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:25:24.844 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:24.839+0000 7f7653a5e640 1 -- 172.21.15.19:0/2695998330 shutdown_connections 2024-09-10T22:25:24.844 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:24.839+0000 7f7653a5e640 1 -- 172.21.15.19:0/2695998330 wait complete. 2024-09-10T22:25:24.844 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:24.840+0000 7f7653a5e640 1 Processor -- start 2024-09-10T22:25:24.844 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:24.840+0000 7f7653a5e640 1 -- start start 2024-09-10T22:25:24.844 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:24.840+0000 7f7653a5e640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f764c102dc0 0x7f764c0754a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:25:24.844 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:24.840+0000 7f7653a5e640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f764c1087d0 0x7f764c0759e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:25:24.844 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:24.840+0000 7f7653a5e640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f764c109150 0x7f764c075f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:25:24.844 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:24.840+0000 7f7653a5e640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f764c112e60 con 0x7f764c109150 2024-09-10T22:25:24.844 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:24.840+0000 7f7653a5e640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f764c112ce0 con 0x7f764c102dc0 2024-09-10T22:25:24.844 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:24.840+0000 7f7653a5e640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f764c112fe0 con 0x7f764c1087d0 2024-09-10T22:25:24.844 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:24.840+0000 7f7651ffb640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f764c109150 0x7f764c075f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:25:24.845 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:24.840+0000 7f7651ffb640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f764c109150 0x7f764c075f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:60488/0 (socket says 172.21.15.19:60488) 2024-09-10T22:25:24.845 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:24.840+0000 7f7651ffb640 1 -- 172.21.15.19:0/3098478932 learned_addr learned my addr 172.21.15.19:0/3098478932 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:25:24.845 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:24.840+0000 7f76517fa640 1 --2- 172.21.15.19:0/3098478932 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f764c102dc0 0x7f764c0754a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:25:24.845 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:24.840+0000 7f7651ffb640 1 -- 172.21.15.19:0/3098478932 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f764c1087d0 msgr2=0x7f764c0759e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:25:24.845 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:24.840+0000 7f7651ffb640 1 --2- 172.21.15.19:0/3098478932 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f764c1087d0 0x7f764c0759e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:25:24.845 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:24.840+0000 7f7651ffb640 1 -- 172.21.15.19:0/3098478932 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f764c102dc0 msgr2=0x7f764c0754a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:25:24.845 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:24.840+0000 7f7651ffb640 1 --2- 172.21.15.19:0/3098478932 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f764c102dc0 0x7f764c0754a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:25:24.845 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:24.840+0000 7f7651ffb640 1 -- 172.21.15.19:0/3098478932 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f764c1a7730 con 0x7f764c109150 2024-09-10T22:25:24.845 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:24.841+0000 7f7651ffb640 1 --2- 172.21.15.19:0/3098478932 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f764c109150 0x7f764c075f20 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f764400eaa0 tx=0x7f764400ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:25:24.845 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:24.841+0000 7f76427fc640 1 -- 172.21.15.19:0/3098478932 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f764400cdb0 con 0x7f764c109150 2024-09-10T22:25:24.845 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:24.841+0000 7f76427fc640 1 -- 172.21.15.19:0/3098478932 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7644005020 con 0x7f764c109150 2024-09-10T22:25:24.846 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:24.841+0000 7f7653a5e640 1 -- 172.21.15.19:0/3098478932 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f764c1a7a20 con 0x7f764c109150 2024-09-10T22:25:24.846 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:24.841+0000 7f76427fc640 1 -- 172.21.15.19:0/3098478932 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76440116d0 con 0x7f764c109150 2024-09-10T22:25:24.846 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:24.841+0000 7f7653a5e640 1 -- 172.21.15.19:0/3098478932 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f764c1a7f90 con 0x7f764c109150 2024-09-10T22:25:24.847 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:24.842+0000 7f7653a5e640 1 -- 172.21.15.19:0/3098478932 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f764c1031a0 con 0x7f764c109150 2024-09-10T22:25:24.847 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:24.844+0000 7f76427fc640 1 -- 172.21.15.19:0/3098478932 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 17) ==== 153301+0+0 (secure 0 0 0) 0x7f764400f040 con 0x7f764c109150 2024-09-10T22:25:24.847 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:24.845+0000 7f76427fc640 1 --2- 172.21.15.19:0/3098478932 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f76380b5370 0x7f76380b7830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:25:24.847 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:24.845+0000 7f76517fa640 1 --2- 172.21.15.19:0/3098478932 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f76380b5370 0x7f76380b7830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:25:24.847 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:24.845+0000 7f76427fc640 1 -- 172.21.15.19:0/3098478932 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8269+0+0 (secure 0 0 0) 0x7f76440e5ff0 con 0x7f764c109150 2024-09-10T22:25:24.847 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:24.845+0000 7f76517fa640 1 --2- 172.21.15.19:0/3098478932 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f76380b5370 0x7f76380b7830 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f7648009890 tx=0x7f7648008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:25:24.850 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:24.849+0000 7f76427fc640 1 -- 172.21.15.19:0/3098478932 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f7644016030 con 0x7f764c109150 2024-09-10T22:25:24.859 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:25:24 smithi135 ceph-mon[34789]: from='client.? 172.21.15.19:0/1927159953' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 3} : dispatch 2024-09-10T22:25:24.874 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:25:24 smithi138 ceph-mon[35236]: from='client.? 172.21.15.19:0/1927159953' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 3} : dispatch 2024-09-10T22:25:25.041 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:25.039+0000 7f7653a5e640 1 -- 172.21.15.19:0/3098478932 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 8} v 0) -- 0x7f764c10a9a0 con 0x7f764c109150 2024-09-10T22:25:25.041 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:25.040+0000 7f76427fc640 1 -- 172.21.15.19:0/3098478932 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 8}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f76440acdd0 con 0x7f764c109150 2024-09-10T22:25:25.041 INFO:teuthology.orchestra.run.smithi019.stdout:219043332136 2024-09-10T22:25:25.043 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:25.042+0000 7f7653a5e640 1 -- 172.21.15.19:0/3098478932 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f76380b5370 msgr2=0x7f76380b7830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:25:25.044 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:25.042+0000 7f7653a5e640 1 --2- 172.21.15.19:0/3098478932 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f76380b5370 0x7f76380b7830 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f7648009890 tx=0x7f7648008040 comp rx=0 tx=0).stop 2024-09-10T22:25:25.044 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:25.042+0000 7f7653a5e640 1 -- 172.21.15.19:0/3098478932 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f764c109150 msgr2=0x7f764c075f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:25:25.044 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:25.042+0000 7f7653a5e640 1 --2- 172.21.15.19:0/3098478932 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f764c109150 0x7f764c075f20 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f764400eaa0 tx=0x7f764400ef60 comp rx=0 tx=0).stop 2024-09-10T22:25:25.044 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:25.042+0000 7f7653a5e640 1 -- 172.21.15.19:0/3098478932 shutdown_connections 2024-09-10T22:25:25.044 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:25.042+0000 7f7653a5e640 1 --2- 172.21.15.19:0/3098478932 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f76380b5370 0x7f76380b7830 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:25:25.044 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:25.042+0000 7f7653a5e640 1 --2- 172.21.15.19:0/3098478932 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f764c109150 0x7f764c075f20 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:25:25.044 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:25.042+0000 7f7653a5e640 1 --2- 172.21.15.19:0/3098478932 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f764c1087d0 0x7f764c0759e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:25:25.044 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:25.042+0000 7f7653a5e640 1 --2- 172.21.15.19:0/3098478932 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f764c102dc0 0x7f764c0754a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:25:25.044 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:25.042+0000 7f7653a5e640 1 -- 172.21.15.19:0/3098478932 >> 172.21.15.19:0/3098478932 conn(0x7f764c0fe830 msgr2=0x7f764c100c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:25:25.044 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:25.042+0000 7f7653a5e640 1 -- 172.21.15.19:0/3098478932 shutdown_connections 2024-09-10T22:25:25.044 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:25.042+0000 7f7653a5e640 1 -- 172.21.15.19:0/3098478932 wait complete. 2024-09-10T22:25:25.351 INFO:tasks.cephadm.ceph_manager.ceph:need seq 34359738445 got 34359738448 for osd.0 2024-09-10T22:25:25.351 DEBUG:teuthology.parallel:result is None 2024-09-10T22:25:25.859 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:25:25 smithi135 ceph-mon[34789]: pgmap v315: 97 pgs: 97 active+clean; 639 KiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-10T22:25:25.860 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:25:25 smithi135 ceph-mon[34789]: from='client.? 172.21.15.19:0/3098478932' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 8} : dispatch 2024-09-10T22:25:25.875 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:25:25 smithi138 ceph-mon[35236]: pgmap v315: 97 pgs: 97 active+clean; 639 KiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-10T22:25:25.875 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:25:25 smithi138 ceph-mon[35236]: from='client.? 172.21.15.19:0/3098478932' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 8} : dispatch 2024-09-10T22:25:25.958 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:25:25 smithi019 ceph-mon[31375]: pgmap v315: 97 pgs: 97 active+clean; 639 KiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-10T22:25:25.958 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:25:25 smithi019 ceph-mon[31375]: from='client.? 172.21.15.19:0/3098478932' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 8} : dispatch 2024-09-10T22:25:26.190 INFO:tasks.cephadm.ceph_manager.ceph:need seq 219043332132 got 219043332136 for osd.8 2024-09-10T22:25:26.190 DEBUG:teuthology.parallel:result is None 2024-09-10T22:25:26.603 INFO:tasks.cephadm.ceph_manager.ceph:need seq 98784247868 got 98784247872 for osd.3 2024-09-10T22:25:26.603 DEBUG:teuthology.parallel:result is None 2024-09-10T22:25:26.603 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2024-09-10T22:25:26.604 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 22997a4c-6fc2-11ef-bcea-c7b262605968 -- ceph pg dump --format=json 2024-09-10T22:25:27.453 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/22997a4c-6fc2-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T22:25:27.856 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:25:27 smithi019 ceph-mon[31375]: pgmap v316: 97 pgs: 97 active+clean; 639 KiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-10T22:25:27.859 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:25:27 smithi135 ceph-mon[34789]: pgmap v316: 97 pgs: 97 active+clean; 639 KiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-10T22:25:27.875 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:25:27 smithi138 ceph-mon[35236]: pgmap v316: 97 pgs: 97 active+clean; 639 KiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-10T22:25:27.978 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:27.938+0000 7f3e73033640 1 -- 172.21.15.19:0/258500347 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3e6c1076a0 msgr2=0x7f3e6c107ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:25:27.979 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:27.938+0000 7f3e73033640 1 --2- 172.21.15.19:0/258500347 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3e6c1076a0 0x7f3e6c107ae0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f3e60009900 tx=0x7f3e6002a410 comp rx=0 tx=0).stop 2024-09-10T22:25:27.979 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:27.938+0000 7f3e73033640 1 -- 172.21.15.19:0/258500347 shutdown_connections 2024-09-10T22:25:27.979 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:27.938+0000 7f3e73033640 1 --2- 172.21.15.19:0/258500347 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3e6c108020 0x7f3e6c10e820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:25:27.979 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:27.938+0000 7f3e73033640 1 --2- 172.21.15.19:0/258500347 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3e6c1076a0 0x7f3e6c107ae0 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:25:27.979 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:27.938+0000 7f3e73033640 1 --2- 172.21.15.19:0/258500347 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3e6c101c90 0x7f3e6c102070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:25:27.979 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:27.938+0000 7f3e73033640 1 -- 172.21.15.19:0/258500347 >> 172.21.15.19:0/258500347 conn(0x7f3e6c0fd700 msgr2=0x7f3e6c0ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:25:27.979 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:27.938+0000 7f3e73033640 1 -- 172.21.15.19:0/258500347 shutdown_connections 2024-09-10T22:25:27.979 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:27.938+0000 7f3e73033640 1 -- 172.21.15.19:0/258500347 wait complete. 2024-09-10T22:25:27.979 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:27.938+0000 7f3e73033640 1 Processor -- start 2024-09-10T22:25:27.979 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:27.938+0000 7f3e73033640 1 -- start start 2024-09-10T22:25:27.979 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:27.938+0000 7f3e73033640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3e6c101c90 0x7f3e6c199330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:25:27.980 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:27.938+0000 7f3e73033640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3e6c1076a0 0x7f3e6c199870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:25:27.980 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:27.938+0000 7f3e73033640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3e6c108020 0x7f3e6c19ec10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:25:27.980 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:27.938+0000 7f3e73033640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f3e6c06b080 con 0x7f3e6c108020 2024-09-10T22:25:27.980 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:27.938+0000 7f3e73033640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f3e6c06af00 con 0x7f3e6c101c90 2024-09-10T22:25:27.980 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:27.938+0000 7f3e73033640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f3e6c06b200 con 0x7f3e6c1076a0 2024-09-10T22:25:27.980 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:27.939+0000 7f3e715d0640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3e6c108020 0x7f3e6c19ec10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:25:27.980 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:27.939+0000 7f3e715d0640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3e6c108020 0x7f3e6c19ec10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:60514/0 (socket says 172.21.15.19:60514) 2024-09-10T22:25:27.980 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:27.939+0000 7f3e715d0640 1 -- 172.21.15.19:0/3015042094 learned_addr learned my addr 172.21.15.19:0/3015042094 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:25:27.980 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:27.939+0000 7f3e6bfff640 1 --2- 172.21.15.19:0/3015042094 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3e6c1076a0 0x7f3e6c199870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:25:27.980 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:27.939+0000 7f3e70dcf640 1 --2- 172.21.15.19:0/3015042094 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3e6c101c90 0x7f3e6c199330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:25:27.980 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:27.939+0000 7f3e715d0640 1 -- 172.21.15.19:0/3015042094 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3e6c1076a0 msgr2=0x7f3e6c199870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:25:27.980 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:27.939+0000 7f3e715d0640 1 --2- 172.21.15.19:0/3015042094 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3e6c1076a0 0x7f3e6c199870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:25:27.980 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:27.939+0000 7f3e715d0640 1 -- 172.21.15.19:0/3015042094 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3e6c101c90 msgr2=0x7f3e6c199330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:25:27.981 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:27.939+0000 7f3e715d0640 1 --2- 172.21.15.19:0/3015042094 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3e6c101c90 0x7f3e6c199330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:25:27.981 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:27.939+0000 7f3e715d0640 1 -- 172.21.15.19:0/3015042094 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3e6c19f3e0 con 0x7f3e6c108020 2024-09-10T22:25:27.981 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:27.939+0000 7f3e70dcf640 1 --2- 172.21.15.19:0/3015042094 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3e6c101c90 0x7f3e6c199330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T22:25:27.981 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:27.939+0000 7f3e6bfff640 1 --2- 172.21.15.19:0/3015042094 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3e6c1076a0 0x7f3e6c199870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T22:25:27.981 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:27.939+0000 7f3e715d0640 1 --2- 172.21.15.19:0/3015042094 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3e6c108020 0x7f3e6c19ec10 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f3e6400cad0 tx=0x7f3e6400cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:25:27.981 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:27.939+0000 7f3e69ffb640 1 -- 172.21.15.19:0/3015042094 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e6400ae20 con 0x7f3e6c108020 2024-09-10T22:25:27.981 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:27.939+0000 7f3e69ffb640 1 -- 172.21.15.19:0/3015042094 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3e64005020 con 0x7f3e6c108020 2024-09-10T22:25:27.981 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:27.939+0000 7f3e73033640 1 -- 172.21.15.19:0/3015042094 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3e6c19f6d0 con 0x7f3e6c108020 2024-09-10T22:25:27.981 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:27.939+0000 7f3e69ffb640 1 -- 172.21.15.19:0/3015042094 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e6400f6b0 con 0x7f3e6c108020 2024-09-10T22:25:27.981 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:27.940+0000 7f3e73033640 1 -- 172.21.15.19:0/3015042094 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3e6c1a5e10 con 0x7f3e6c108020 2024-09-10T22:25:27.981 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:27.940+0000 7f3e73033640 1 -- 172.21.15.19:0/3015042094 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3e6c102070 con 0x7f3e6c108020 2024-09-10T22:25:27.981 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:27.942+0000 7f3e69ffb640 1 -- 172.21.15.19:0/3015042094 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 17) ==== 153301+0+0 (secure 0 0 0) 0x7f3e640054f0 con 0x7f3e6c108020 2024-09-10T22:25:27.981 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:27.942+0000 7f3e69ffb640 1 --2- 172.21.15.19:0/3015042094 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f3e540b53f0 0x7f3e540b78b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:25:27.982 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:27.943+0000 7f3e70dcf640 1 --2- 172.21.15.19:0/3015042094 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f3e540b53f0 0x7f3e540b78b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:25:27.982 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:27.943+0000 7f3e69ffb640 1 -- 172.21.15.19:0/3015042094 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8269+0+0 (secure 0 0 0) 0x7f3e640e5dc0 con 0x7f3e6c108020 2024-09-10T22:25:27.982 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:27.943+0000 7f3e70dcf640 1 --2- 172.21.15.19:0/3015042094 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f3e540b53f0 0x7f3e540b78b0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f3e5c006fd0 tx=0x7f3e5c008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:25:27.982 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:27.947+0000 7f3e69ffb640 1 -- 172.21.15.19:0/3015042094 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f3e64014030 con 0x7f3e6c108020 2024-09-10T22:25:28.148 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:28.145+0000 7f3e73033640 1 -- 172.21.15.19:0/3015042094 --> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f3e6c105bc0 con 0x7f3e540b53f0 2024-09-10T22:25:28.151 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:28.150+0000 7f3e69ffb640 1 -- 172.21.15.19:0/3015042094 <== mgr.14150 v2:172.21.15.19:6800/2119495487 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258705 (secure 0 0 0) 0x7f3e6c105bc0 con 0x7f3e540b53f0 2024-09-10T22:25:28.154 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-10T22:25:28.156 INFO:teuthology.orchestra.run.smithi019.stderr:dumped all 2024-09-10T22:25:28.158 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:28.154+0000 7f3e73033640 1 -- 172.21.15.19:0/3015042094 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f3e540b53f0 msgr2=0x7f3e540b78b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:25:28.158 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:28.154+0000 7f3e73033640 1 --2- 172.21.15.19:0/3015042094 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f3e540b53f0 0x7f3e540b78b0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f3e5c006fd0 tx=0x7f3e5c008040 comp rx=0 tx=0).stop 2024-09-10T22:25:28.158 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:28.154+0000 7f3e73033640 1 -- 172.21.15.19:0/3015042094 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3e6c108020 msgr2=0x7f3e6c19ec10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:25:28.158 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:28.154+0000 7f3e73033640 1 --2- 172.21.15.19:0/3015042094 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3e6c108020 0x7f3e6c19ec10 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f3e6400cad0 tx=0x7f3e6400cf90 comp rx=0 tx=0).stop 2024-09-10T22:25:28.158 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:28.154+0000 7f3e73033640 1 -- 172.21.15.19:0/3015042094 shutdown_connections 2024-09-10T22:25:28.159 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:28.154+0000 7f3e73033640 1 --2- 172.21.15.19:0/3015042094 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f3e540b53f0 0x7f3e540b78b0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:25:28.159 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:28.154+0000 7f3e73033640 1 --2- 172.21.15.19:0/3015042094 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3e6c108020 0x7f3e6c19ec10 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:25:28.159 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:28.154+0000 7f3e73033640 1 --2- 172.21.15.19:0/3015042094 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3e6c1076a0 0x7f3e6c199870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:25:28.159 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:28.154+0000 7f3e73033640 1 --2- 172.21.15.19:0/3015042094 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3e6c101c90 0x7f3e6c199330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:25:28.159 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:28.155+0000 7f3e73033640 1 -- 172.21.15.19:0/3015042094 >> 172.21.15.19:0/3015042094 conn(0x7f3e6c0fd700 msgr2=0x7f3e6c1054b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:25:28.159 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:28.155+0000 7f3e73033640 1 -- 172.21.15.19:0/3015042094 shutdown_connections 2024-09-10T22:25:28.159 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:28.155+0000 7f3e73033640 1 -- 172.21.15.19:0/3015042094 wait complete. 2024-09-10T22:25:28.808 INFO:teuthology.orchestra.run.smithi019.stdout:{"pg_ready":true,"pg_map":{"version":316,"stamp":"2024-09-10T22:25:26.377641+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":654365,"num_objects":64,"num_object_clones":0,"num_object_copies":192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":419,"num_read_kb":300,"num_write":286,"num_write_kb":2261,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":21,"num_bytes_recovered":2952512,"num_keys_recovered":10,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":231,"ondisk_log_size":231,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":377700,"kb_used_data":11724,"kb_used_omap":18,"kb_used_meta":365677,"kb_avail":1124564124,"statfs":{"total":1151940427776,"available":1151553662976,"internally_reserved":0,"allocated":12005376,"data_stored":6721215,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19142,"internal_metadata":374453562},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":90,"num_read_kb":45,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003108"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T22:25:05.517979+0000","last_change":"2024-09-10T22:24:22.139905+0000","last_active":"2024-09-10T22:25:05.517979+0000","last_peered":"2024-09-10T22:25:05.517979+0000","last_clean":"2024-09-10T22:25:05.517979+0000","last_became_active":"2024-09-10T22:24:22.139558+0000","last_became_peered":"2024-09-10T22:24:22.139558+0000","last_unstale":"2024-09-10T22:25:05.517979+0000","last_undegraded":"2024-09-10T22:25:05.517979+0000","last_fullsized":"2024-09-10T22:25:05.517979+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_clean_scrub_stamp":"2024-09-10T22:24:21.113844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:44:10.434972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T22:25:05.636515+0000","last_change":"2024-09-10T22:24:22.136722+0000","last_active":"2024-09-10T22:25:05.636515+0000","last_peered":"2024-09-10T22:25:05.636515+0000","last_clean":"2024-09-10T22:25:05.636515+0000","last_became_active":"2024-09-10T22:24:22.136080+0000","last_became_peered":"2024-09-10T22:24:22.136080+0000","last_unstale":"2024-09-10T22:25:05.636515+0000","last_undegraded":"2024-09-10T22:25:05.636515+0000","last_fullsized":"2024-09-10T22:25:05.636515+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_clean_scrub_stamp":"2024-09-10T22:24:21.113844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:52:50.562031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T22:25:05.636795+0000","last_change":"2024-09-10T22:24:22.141323+0000","last_active":"2024-09-10T22:25:05.636795+0000","last_peered":"2024-09-10T22:25:05.636795+0000","last_clean":"2024-09-10T22:25:05.636795+0000","last_became_active":"2024-09-10T22:24:22.140895+0000","last_became_peered":"2024-09-10T22:24:22.140895+0000","last_unstale":"2024-09-10T22:25:05.636795+0000","last_undegraded":"2024-09-10T22:25:05.636795+0000","last_fullsized":"2024-09-10T22:25:05.636795+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_clean_scrub_stamp":"2024-09-10T22:24:21.113844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:46:22.604672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T22:25:05.636797+0000","last_change":"2024-09-10T22:24:22.138806+0000","last_active":"2024-09-10T22:25:05.636797+0000","last_peered":"2024-09-10T22:25:05.636797+0000","last_clean":"2024-09-10T22:25:05.636797+0000","last_became_active":"2024-09-10T22:24:22.138502+0000","last_became_peered":"2024-09-10T22:24:22.138502+0000","last_unstale":"2024-09-10T22:25:05.636797+0000","last_undegraded":"2024-09-10T22:25:05.636797+0000","last_fullsized":"2024-09-10T22:25:05.636797+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_clean_scrub_stamp":"2024-09-10T22:24:21.113844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:45:01.626820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T22:25:05.519397+0000","last_change":"2024-09-10T22:24:22.141233+0000","last_active":"2024-09-10T22:25:05.519397+0000","last_peered":"2024-09-10T22:25:05.519397+0000","last_clean":"2024-09-10T22:25:05.519397+0000","last_became_active":"2024-09-10T22:24:22.140944+0000","last_became_peered":"2024-09-10T22:24:22.140944+0000","last_unstale":"2024-09-10T22:25:05.519397+0000","last_undegraded":"2024-09-10T22:25:05.519397+0000","last_fullsized":"2024-09-10T22:25:05.519397+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_clean_scrub_stamp":"2024-09-10T22:24:21.113844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:09:29.615658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T22:25:05.523201+0000","last_change":"2024-09-10T22:24:22.137990+0000","last_active":"2024-09-10T22:25:05.523201+0000","last_peered":"2024-09-10T22:25:05.523201+0000","last_clean":"2024-09-10T22:25:05.523201+0000","last_became_active":"2024-09-10T22:24:22.137685+0000","last_became_peered":"2024-09-10T22:24:22.137685+0000","last_unstale":"2024-09-10T22:25:05.523201+0000","last_undegraded":"2024-09-10T22:25:05.523201+0000","last_fullsized":"2024-09-10T22:25:05.523201+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_clean_scrub_stamp":"2024-09-10T22:24:21.113844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:32:23.891069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T22:25:05.520753+0000","last_change":"2024-09-10T22:24:22.148073+0000","last_active":"2024-09-10T22:25:05.520753+0000","last_peered":"2024-09-10T22:25:05.520753+0000","last_clean":"2024-09-10T22:25:05.520753+0000","last_became_active":"2024-09-10T22:24:22.147785+0000","last_became_peered":"2024-09-10T22:24:22.147785+0000","last_unstale":"2024-09-10T22:25:05.520753+0000","last_undegraded":"2024-09-10T22:25:05.520753+0000","last_fullsized":"2024-09-10T22:25:05.520753+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_clean_scrub_stamp":"2024-09-10T22:24:21.113844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:39:48.847949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T22:25:05.525206+0000","last_change":"2024-09-10T22:25:05.524455+0000","last_active":"2024-09-10T22:25:05.525206+0000","last_peered":"2024-09-10T22:25:05.525206+0000","last_clean":"2024-09-10T22:25:05.525206+0000","last_became_active":"2024-09-10T22:25:05.523985+0000","last_became_peered":"2024-09-10T22:25:05.523985+0000","last_unstale":"2024-09-10T22:25:05.525206+0000","last_undegraded":"2024-09-10T22:25:05.525206+0000","last_fullsized":"2024-09-10T22:25:05.525206+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_clean_scrub_stamp":"2024-09-10T22:24:21.113844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:20:33.302885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,5,10],"acting":[9,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T22:25:05.527646+0000","last_change":"2024-09-10T22:24:22.148042+0000","last_active":"2024-09-10T22:25:05.527646+0000","last_peered":"2024-09-10T22:25:05.527646+0000","last_clean":"2024-09-10T22:25:05.527646+0000","last_became_active":"2024-09-10T22:24:22.147722+0000","last_became_peered":"2024-09-10T22:24:22.147722+0000","last_unstale":"2024-09-10T22:25:05.527646+0000","last_undegraded":"2024-09-10T22:25:05.527646+0000","last_fullsized":"2024-09-10T22:25:05.527646+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_clean_scrub_stamp":"2024-09-10T22:24:21.113844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:42:42.383957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T22:25:05.521993+0000","last_change":"2024-09-10T22:24:22.138956+0000","last_active":"2024-09-10T22:25:05.521993+0000","last_peered":"2024-09-10T22:25:05.521993+0000","last_clean":"2024-09-10T22:25:05.521993+0000","last_became_active":"2024-09-10T22:24:22.138530+0000","last_became_peered":"2024-09-10T22:24:22.138530+0000","last_unstale":"2024-09-10T22:25:05.521993+0000","last_undegraded":"2024-09-10T22:25:05.521993+0000","last_fullsized":"2024-09-10T22:25:05.521993+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_clean_scrub_stamp":"2024-09-10T22:24:21.113844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:37:55.316556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T22:25:05.521015+0000","last_change":"2024-09-10T22:24:22.143435+0000","last_active":"2024-09-10T22:25:05.521015+0000","last_peered":"2024-09-10T22:25:05.521015+0000","last_clean":"2024-09-10T22:25:05.521015+0000","last_became_active":"2024-09-10T22:24:22.143100+0000","last_became_peered":"2024-09-10T22:24:22.143100+0000","last_unstale":"2024-09-10T22:25:05.521015+0000","last_undegraded":"2024-09-10T22:25:05.521015+0000","last_fullsized":"2024-09-10T22:25:05.521015+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_clean_scrub_stamp":"2024-09-10T22:24:21.113844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:24:14.344203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T22:25:05.636893+0000","last_change":"2024-09-10T22:24:22.138101+0000","last_active":"2024-09-10T22:25:05.636893+0000","last_peered":"2024-09-10T22:25:05.636893+0000","last_clean":"2024-09-10T22:25:05.636893+0000","last_became_active":"2024-09-10T22:24:22.137479+0000","last_became_peered":"2024-09-10T22:24:22.137479+0000","last_unstale":"2024-09-10T22:25:05.636893+0000","last_undegraded":"2024-09-10T22:25:05.636893+0000","last_fullsized":"2024-09-10T22:25:05.636893+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_clean_scrub_stamp":"2024-09-10T22:24:21.113844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:48:09.423136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T22:25:05.525498+0000","last_change":"2024-09-10T22:24:22.137157+0000","last_active":"2024-09-10T22:25:05.525498+0000","last_peered":"2024-09-10T22:25:05.525498+0000","last_clean":"2024-09-10T22:25:05.525498+0000","last_became_active":"2024-09-10T22:24:22.136817+0000","last_became_peered":"2024-09-10T22:24:22.136817+0000","last_unstale":"2024-09-10T22:25:05.525498+0000","last_undegraded":"2024-09-10T22:25:05.525498+0000","last_fullsized":"2024-09-10T22:25:05.525498+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_clean_scrub_stamp":"2024-09-10T22:24:21.113844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:54:32.922776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T22:25:05.636306+0000","last_change":"2024-09-10T22:24:22.138828+0000","last_active":"2024-09-10T22:25:05.636306+0000","last_peered":"2024-09-10T22:25:05.636306+0000","last_clean":"2024-09-10T22:25:05.636306+0000","last_became_active":"2024-09-10T22:24:22.138509+0000","last_became_peered":"2024-09-10T22:24:22.138509+0000","last_unstale":"2024-09-10T22:25:05.636306+0000","last_undegraded":"2024-09-10T22:25:05.636306+0000","last_fullsized":"2024-09-10T22:25:05.636306+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_clean_scrub_stamp":"2024-09-10T22:24:21.113844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:14:19.492298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T22:25:05.636106+0000","last_change":"2024-09-10T22:24:22.139317+0000","last_active":"2024-09-10T22:25:05.636106+0000","last_peered":"2024-09-10T22:25:05.636106+0000","last_clean":"2024-09-10T22:25:05.636106+0000","last_became_active":"2024-09-10T22:24:22.138949+0000","last_became_peered":"2024-09-10T22:24:22.138949+0000","last_unstale":"2024-09-10T22:25:05.636106+0000","last_undegraded":"2024-09-10T22:25:05.636106+0000","last_fullsized":"2024-09-10T22:25:05.636106+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_clean_scrub_stamp":"2024-09-10T22:24:21.113844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:34:56.412955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T22:25:05.524502+0000","last_change":"2024-09-10T22:24:22.147283+0000","last_active":"2024-09-10T22:25:05.524502+0000","last_peered":"2024-09-10T22:25:05.524502+0000","last_clean":"2024-09-10T22:25:05.524502+0000","last_became_active":"2024-09-10T22:24:22.146954+0000","last_became_peered":"2024-09-10T22:24:22.146954+0000","last_unstale":"2024-09-10T22:25:05.524502+0000","last_undegraded":"2024-09-10T22:25:05.524502+0000","last_fullsized":"2024-09-10T22:25:05.524502+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_clean_scrub_stamp":"2024-09-10T22:24:21.113844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:22:21.772747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T22:25:05.518007+0000","last_change":"2024-09-10T22:24:22.139482+0000","last_active":"2024-09-10T22:25:05.518007+0000","last_peered":"2024-09-10T22:25:05.518007+0000","last_clean":"2024-09-10T22:25:05.518007+0000","last_became_active":"2024-09-10T22:24:22.139135+0000","last_became_peered":"2024-09-10T22:24:22.139135+0000","last_unstale":"2024-09-10T22:25:05.518007+0000","last_undegraded":"2024-09-10T22:25:05.518007+0000","last_fullsized":"2024-09-10T22:25:05.518007+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_clean_scrub_stamp":"2024-09-10T22:24:21.113844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:25:31.639392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T22:25:05.517378+0000","last_change":"2024-09-10T22:24:22.142465+0000","last_active":"2024-09-10T22:25:05.517378+0000","last_peered":"2024-09-10T22:25:05.517378+0000","last_clean":"2024-09-10T22:25:05.517378+0000","last_became_active":"2024-09-10T22:24:22.142110+0000","last_became_peered":"2024-09-10T22:24:22.142110+0000","last_unstale":"2024-09-10T22:25:05.517378+0000","last_undegraded":"2024-09-10T22:25:05.517378+0000","last_fullsized":"2024-09-10T22:25:05.517378+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_clean_scrub_stamp":"2024-09-10T22:24:21.113844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:16:20.476055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T22:25:05.523411+0000","last_change":"2024-09-10T22:24:22.147942+0000","last_active":"2024-09-10T22:25:05.523411+0000","last_peered":"2024-09-10T22:25:05.523411+0000","last_clean":"2024-09-10T22:25:05.523411+0000","last_became_active":"2024-09-10T22:24:22.147637+0000","last_became_peered":"2024-09-10T22:24:22.147637+0000","last_unstale":"2024-09-10T22:25:05.523411+0000","last_undegraded":"2024-09-10T22:25:05.523411+0000","last_fullsized":"2024-09-10T22:25:05.523411+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_clean_scrub_stamp":"2024-09-10T22:24:21.113844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:46:36.831534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T22:25:05.517703+0000","last_change":"2024-09-10T22:24:22.138032+0000","last_active":"2024-09-10T22:25:05.517703+0000","last_peered":"2024-09-10T22:25:05.517703+0000","last_clean":"2024-09-10T22:25:05.517703+0000","last_became_active":"2024-09-10T22:24:22.137657+0000","last_became_peered":"2024-09-10T22:24:22.137657+0000","last_unstale":"2024-09-10T22:25:05.517703+0000","last_undegraded":"2024-09-10T22:25:05.517703+0000","last_fullsized":"2024-09-10T22:25:05.517703+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_clean_scrub_stamp":"2024-09-10T22:24:21.113844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:06:51.479298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T22:25:05.525119+0000","last_change":"2024-09-10T22:24:22.141106+0000","last_active":"2024-09-10T22:25:05.525119+0000","last_peered":"2024-09-10T22:25:05.525119+0000","last_clean":"2024-09-10T22:25:05.525119+0000","last_became_active":"2024-09-10T22:24:22.140780+0000","last_became_peered":"2024-09-10T22:24:22.140780+0000","last_unstale":"2024-09-10T22:25:05.525119+0000","last_undegraded":"2024-09-10T22:25:05.525119+0000","last_fullsized":"2024-09-10T22:25:05.525119+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_clean_scrub_stamp":"2024-09-10T22:24:21.113844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:25:21.302463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T22:25:05.525644+0000","last_change":"2024-09-10T22:24:22.146772+0000","last_active":"2024-09-10T22:25:05.525644+0000","last_peered":"2024-09-10T22:25:05.525644+0000","last_clean":"2024-09-10T22:25:05.525644+0000","last_became_active":"2024-09-10T22:24:22.146317+0000","last_became_peered":"2024-09-10T22:24:22.146317+0000","last_unstale":"2024-09-10T22:25:05.525644+0000","last_undegraded":"2024-09-10T22:25:05.525644+0000","last_fullsized":"2024-09-10T22:25:05.525644+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_clean_scrub_stamp":"2024-09-10T22:24:21.113844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:13:55.706482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T22:25:05.636747+0000","last_change":"2024-09-10T22:24:22.139791+0000","last_active":"2024-09-10T22:25:05.636747+0000","last_peered":"2024-09-10T22:25:05.636747+0000","last_clean":"2024-09-10T22:25:05.636747+0000","last_became_active":"2024-09-10T22:24:22.139491+0000","last_became_peered":"2024-09-10T22:24:22.139491+0000","last_unstale":"2024-09-10T22:25:05.636747+0000","last_undegraded":"2024-09-10T22:25:05.636747+0000","last_fullsized":"2024-09-10T22:25:05.636747+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_clean_scrub_stamp":"2024-09-10T22:24:21.113844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:18:29.412412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T22:25:05.522054+0000","last_change":"2024-09-10T22:24:22.143383+0000","last_active":"2024-09-10T22:25:05.522054+0000","last_peered":"2024-09-10T22:25:05.522054+0000","last_clean":"2024-09-10T22:25:05.522054+0000","last_became_active":"2024-09-10T22:24:22.143045+0000","last_became_peered":"2024-09-10T22:24:22.143045+0000","last_unstale":"2024-09-10T22:25:05.522054+0000","last_undegraded":"2024-09-10T22:25:05.522054+0000","last_fullsized":"2024-09-10T22:25:05.522054+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_clean_scrub_stamp":"2024-09-10T22:24:21.113844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:37:10.135448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T22:25:05.636397+0000","last_change":"2024-09-10T22:24:22.141851+0000","last_active":"2024-09-10T22:25:05.636397+0000","last_peered":"2024-09-10T22:25:05.636397+0000","last_clean":"2024-09-10T22:25:05.636397+0000","last_became_active":"2024-09-10T22:24:22.141469+0000","last_became_peered":"2024-09-10T22:24:22.141469+0000","last_unstale":"2024-09-10T22:25:05.636397+0000","last_undegraded":"2024-09-10T22:25:05.636397+0000","last_fullsized":"2024-09-10T22:25:05.636397+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_clean_scrub_stamp":"2024-09-10T22:24:21.113844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:03:59.805704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T22:25:05.523045+0000","last_change":"2024-09-10T22:24:22.139821+0000","last_active":"2024-09-10T22:25:05.523045+0000","last_peered":"2024-09-10T22:25:05.523045+0000","last_clean":"2024-09-10T22:25:05.523045+0000","last_became_active":"2024-09-10T22:24:22.139398+0000","last_became_peered":"2024-09-10T22:24:22.139398+0000","last_unstale":"2024-09-10T22:25:05.523045+0000","last_undegraded":"2024-09-10T22:25:05.523045+0000","last_fullsized":"2024-09-10T22:25:05.523045+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_clean_scrub_stamp":"2024-09-10T22:24:21.113844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:18:22.160919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T22:25:05.517798+0000","last_change":"2024-09-10T22:24:22.141219+0000","last_active":"2024-09-10T22:25:05.517798+0000","last_peered":"2024-09-10T22:25:05.517798+0000","last_clean":"2024-09-10T22:25:05.517798+0000","last_became_active":"2024-09-10T22:24:22.140900+0000","last_became_peered":"2024-09-10T22:24:22.140900+0000","last_unstale":"2024-09-10T22:25:05.517798+0000","last_undegraded":"2024-09-10T22:25:05.517798+0000","last_fullsized":"2024-09-10T22:25:05.517798+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_clean_scrub_stamp":"2024-09-10T22:24:21.113844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:27:59.115533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T22:25:05.524856+0000","last_change":"2024-09-10T22:24:22.139738+0000","last_active":"2024-09-10T22:25:05.524856+0000","last_peered":"2024-09-10T22:25:05.524856+0000","last_clean":"2024-09-10T22:25:05.524856+0000","last_became_active":"2024-09-10T22:24:22.139096+0000","last_became_peered":"2024-09-10T22:24:22.139096+0000","last_unstale":"2024-09-10T22:25:05.524856+0000","last_undegraded":"2024-09-10T22:25:05.524856+0000","last_fullsized":"2024-09-10T22:25:05.524856+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_clean_scrub_stamp":"2024-09-10T22:24:21.113844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:16:39.110610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T22:25:05.636592+0000","last_change":"2024-09-10T22:24:22.144896+0000","last_active":"2024-09-10T22:25:05.636592+0000","last_peered":"2024-09-10T22:25:05.636592+0000","last_clean":"2024-09-10T22:25:05.636592+0000","last_became_active":"2024-09-10T22:24:22.144622+0000","last_became_peered":"2024-09-10T22:24:22.144622+0000","last_unstale":"2024-09-10T22:25:05.636592+0000","last_undegraded":"2024-09-10T22:25:05.636592+0000","last_fullsized":"2024-09-10T22:25:05.636592+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_clean_scrub_stamp":"2024-09-10T22:24:21.113844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:32:44.648993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T22:25:05.522332+0000","last_change":"2024-09-10T22:24:22.148082+0000","last_active":"2024-09-10T22:25:05.522332+0000","last_peered":"2024-09-10T22:25:05.522332+0000","last_clean":"2024-09-10T22:25:05.522332+0000","last_became_active":"2024-09-10T22:24:22.147664+0000","last_became_peered":"2024-09-10T22:24:22.147664+0000","last_unstale":"2024-09-10T22:25:05.522332+0000","last_undegraded":"2024-09-10T22:25:05.522332+0000","last_fullsized":"2024-09-10T22:25:05.522332+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_clean_scrub_stamp":"2024-09-10T22:24:21.113844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:12:40.154756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":25,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T22:25:05.638449+0000","last_change":"2024-09-10T22:25:05.638351+0000","last_active":"2024-09-10T22:25:05.638449+0000","last_peered":"2024-09-10T22:25:05.638449+0000","last_clean":"2024-09-10T22:25:05.638449+0000","last_became_active":"2024-09-10T22:25:05.637523+0000","last_became_peered":"2024-09-10T22:25:05.637523+0000","last_unstale":"2024-09-10T22:25:05.638449+0000","last_undegraded":"2024-09-10T22:25:05.638449+0000","last_fullsized":"2024-09-10T22:25:05.638449+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_clean_scrub_stamp":"2024-09-10T22:24:21.113844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:09:37.231420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,9,4],"acting":[2,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T22:25:05.517607+0000","last_change":"2024-09-10T22:24:22.141534+0000","last_active":"2024-09-10T22:25:05.517607+0000","last_peered":"2024-09-10T22:25:05.517607+0000","last_clean":"2024-09-10T22:25:05.517607+0000","last_became_active":"2024-09-10T22:24:22.141243+0000","last_became_peered":"2024-09-10T22:24:22.141243+0000","last_unstale":"2024-09-10T22:25:05.517607+0000","last_undegraded":"2024-09-10T22:25:05.517607+0000","last_fullsized":"2024-09-10T22:25:05.517607+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_clean_scrub_stamp":"2024-09-10T22:24:21.113844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:26:23.559943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T22:25:05.519259+0000","last_change":"2024-09-10T22:24:22.144951+0000","last_active":"2024-09-10T22:25:05.519259+0000","last_peered":"2024-09-10T22:25:05.519259+0000","last_clean":"2024-09-10T22:25:05.519259+0000","last_became_active":"2024-09-10T22:24:22.144634+0000","last_became_peered":"2024-09-10T22:24:22.144634+0000","last_unstale":"2024-09-10T22:25:05.519259+0000","last_undegraded":"2024-09-10T22:25:05.519259+0000","last_fullsized":"2024-09-10T22:25:05.519259+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_clean_scrub_stamp":"2024-09-10T22:24:21.113844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:04:19.350081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"73'5","reported_seq":83,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T22:25:23.553398+0000","last_change":"2024-09-10T22:24:20.128083+0000","last_active":"2024-09-10T22:25:23.553398+0000","last_peered":"2024-09-10T22:25:23.553398+0000","last_clean":"2024-09-10T22:25:23.553398+0000","last_became_active":"2024-09-10T22:24:20.127676+0000","last_became_peered":"2024-09-10T22:24:20.127676+0000","last_unstale":"2024-09-10T22:25:23.553398+0000","last_undegraded":"2024-09-10T22:25:23.553398+0000","last_fullsized":"2024-09-10T22:25:23.553398+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:19.099039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:19.099039+0000","last_clean_scrub_stamp":"2024-09-10T22:24:19.099039+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:37:51.745817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":55,"num_read_kb":2,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":25,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T22:25:05.638403+0000","last_change":"2024-09-10T22:25:05.638296+0000","last_active":"2024-09-10T22:25:05.638403+0000","last_peered":"2024-09-10T22:25:05.638403+0000","last_clean":"2024-09-10T22:25:05.638403+0000","last_became_active":"2024-09-10T22:25:05.637649+0000","last_became_peered":"2024-09-10T22:25:05.637649+0000","last_unstale":"2024-09-10T22:25:05.638403+0000","last_undegraded":"2024-09-10T22:25:05.638403+0000","last_fullsized":"2024-09-10T22:25:05.638403+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_clean_scrub_stamp":"2024-09-10T22:24:21.113844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:07:42.674144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3],"acting":[5,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"73'3","reported_seq":37,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T22:25:05.532624+0000","last_change":"2024-09-10T22:25:05.532533+0000","last_active":"2024-09-10T22:25:05.532624+0000","last_peered":"2024-09-10T22:25:05.532624+0000","last_clean":"2024-09-10T22:25:05.532624+0000","last_became_active":"2024-09-10T22:25:05.526228+0000","last_became_peered":"2024-09-10T22:25:05.526228+0000","last_unstale":"2024-09-10T22:25:05.532624+0000","last_undegraded":"2024-09-10T22:25:05.532624+0000","last_fullsized":"2024-09-10T22:25:05.532624+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:19.099039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:19.099039+0000","last_clean_scrub_stamp":"2024-09-10T22:24:19.099039+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:53:36.903083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,6],"acting":[10,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"73'2","reported_seq":25,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T22:25:05.524519+0000","last_change":"2024-09-10T22:24:20.122635+0000","last_active":"2024-09-10T22:25:05.524519+0000","last_peered":"2024-09-10T22:25:05.524519+0000","last_clean":"2024-09-10T22:25:05.524519+0000","last_became_active":"2024-09-10T22:24:20.122289+0000","last_became_peered":"2024-09-10T22:24:20.122289+0000","last_unstale":"2024-09-10T22:25:05.524519+0000","last_undegraded":"2024-09-10T22:25:05.524519+0000","last_fullsized":"2024-09-10T22:25:05.524519+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:19.099039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:19.099039+0000","last_clean_scrub_stamp":"2024-09-10T22:24:19.099039+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:30:40.779513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T22:25:05.636342+0000","last_change":"2024-09-10T22:24:22.137417+0000","last_active":"2024-09-10T22:25:05.636342+0000","last_peered":"2024-09-10T22:25:05.636342+0000","last_clean":"2024-09-10T22:25:05.636342+0000","last_became_active":"2024-09-10T22:24:22.136913+0000","last_became_peered":"2024-09-10T22:24:22.136913+0000","last_unstale":"2024-09-10T22:25:05.636342+0000","last_undegraded":"2024-09-10T22:25:05.636342+0000","last_fullsized":"2024-09-10T22:25:05.636342+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_clean_scrub_stamp":"2024-09-10T22:24:21.113844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:23:39.551056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"73'1","reported_seq":24,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T22:25:05.522414+0000","last_change":"2024-09-10T22:24:20.128416+0000","last_active":"2024-09-10T22:25:05.522414+0000","last_peered":"2024-09-10T22:25:05.522414+0000","last_clean":"2024-09-10T22:25:05.522414+0000","last_became_active":"2024-09-10T22:24:20.127998+0000","last_became_peered":"2024-09-10T22:24:20.127998+0000","last_unstale":"2024-09-10T22:25:05.522414+0000","last_undegraded":"2024-09-10T22:25:05.522414+0000","last_fullsized":"2024-09-10T22:25:05.522414+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:19.099039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:19.099039+0000","last_clean_scrub_stamp":"2024-09-10T22:24:19.099039+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:44:39.871564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T22:25:05.517035+0000","last_change":"2024-09-10T22:24:22.136355+0000","last_active":"2024-09-10T22:25:05.517035+0000","last_peered":"2024-09-10T22:25:05.517035+0000","last_clean":"2024-09-10T22:25:05.517035+0000","last_became_active":"2024-09-10T22:24:22.136047+0000","last_became_peered":"2024-09-10T22:24:22.136047+0000","last_unstale":"2024-09-10T22:25:05.517035+0000","last_undegraded":"2024-09-10T22:25:05.517035+0000","last_fullsized":"2024-09-10T22:25:05.517035+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_clean_scrub_stamp":"2024-09-10T22:24:21.113844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:56:14.739365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"73'3","reported_seq":92,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T22:25:23.552760+0000","last_change":"2024-09-10T22:25:05.537891+0000","last_active":"2024-09-10T22:25:23.552760+0000","last_peered":"2024-09-10T22:25:23.552760+0000","last_clean":"2024-09-10T22:25:23.552760+0000","last_became_active":"2024-09-10T22:25:05.526085+0000","last_became_peered":"2024-09-10T22:25:05.526085+0000","last_unstale":"2024-09-10T22:25:23.552760+0000","last_undegraded":"2024-09-10T22:25:23.552760+0000","last_fullsized":"2024-09-10T22:25:23.552760+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:19.099039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:19.099039+0000","last_clean_scrub_stamp":"2024-09-10T22:24:19.099039+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:57:02.158783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":48,"num_read_kb":48,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":90,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,9],"acting":[10,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T22:25:05.526673+0000","last_change":"2024-09-10T22:24:22.143321+0000","last_active":"2024-09-10T22:25:05.526673+0000","last_peered":"2024-09-10T22:25:05.526673+0000","last_clean":"2024-09-10T22:25:05.526673+0000","last_became_active":"2024-09-10T22:24:22.143036+0000","last_became_peered":"2024-09-10T22:24:22.143036+0000","last_unstale":"2024-09-10T22:25:05.526673+0000","last_undegraded":"2024-09-10T22:25:05.526673+0000","last_fullsized":"2024-09-10T22:25:05.526673+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_clean_scrub_stamp":"2024-09-10T22:24:21.113844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:51:42.473300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"73'2","reported_seq":36,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T22:25:05.534768+0000","last_change":"2024-09-10T22:25:05.534611+0000","last_active":"2024-09-10T22:25:05.534768+0000","last_peered":"2024-09-10T22:25:05.534768+0000","last_clean":"2024-09-10T22:25:05.534768+0000","last_became_active":"2024-09-10T22:25:05.526934+0000","last_became_peered":"2024-09-10T22:25:05.526934+0000","last_unstale":"2024-09-10T22:25:05.534768+0000","last_undegraded":"2024-09-10T22:25:05.534768+0000","last_fullsized":"2024-09-10T22:25:05.534768+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:19.099039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:19.099039+0000","last_clean_scrub_stamp":"2024-09-10T22:24:19.099039+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:39:20.317571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T22:25:05.636959+0000","last_change":"2024-09-10T22:24:22.144830+0000","last_active":"2024-09-10T22:25:05.636959+0000","last_peered":"2024-09-10T22:25:05.636959+0000","last_clean":"2024-09-10T22:25:05.636959+0000","last_became_active":"2024-09-10T22:24:22.144358+0000","last_became_peered":"2024-09-10T22:24:22.144358+0000","last_unstale":"2024-09-10T22:25:05.636959+0000","last_undegraded":"2024-09-10T22:25:05.636959+0000","last_fullsized":"2024-09-10T22:25:05.636959+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_clean_scrub_stamp":"2024-09-10T22:24:21.113844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:28:14.398474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"73'4","reported_seq":28,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T22:25:05.523011+0000","last_change":"2024-09-10T22:24:20.383555+0000","last_active":"2024-09-10T22:25:05.523011+0000","last_peered":"2024-09-10T22:25:05.523011+0000","last_clean":"2024-09-10T22:25:05.523011+0000","last_became_active":"2024-09-10T22:24:20.383163+0000","last_became_peered":"2024-09-10T22:24:20.383163+0000","last_unstale":"2024-09-10T22:25:05.523011+0000","last_undegraded":"2024-09-10T22:25:05.523011+0000","last_fullsized":"2024-09-10T22:25:05.523011+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:19.099039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:19.099039+0000","last_clean_scrub_stamp":"2024-09-10T22:24:19.099039+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:14:03.052220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T22:25:05.525324+0000","last_change":"2024-09-10T22:24:22.144562+0000","last_active":"2024-09-10T22:25:05.525324+0000","last_peered":"2024-09-10T22:25:05.525324+0000","last_clean":"2024-09-10T22:25:05.525324+0000","last_became_active":"2024-09-10T22:24:22.144146+0000","last_became_peered":"2024-09-10T22:24:22.144146+0000","last_unstale":"2024-09-10T22:25:05.525324+0000","last_undegraded":"2024-09-10T22:25:05.525324+0000","last_fullsized":"2024-09-10T22:25:05.525324+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_clean_scrub_stamp":"2024-09-10T22:24:21.113844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:57:36.070289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"73'28","reported_seq":168,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T22:25:25.298152+0000","last_change":"2024-09-10T22:24:20.126245+0000","last_active":"2024-09-10T22:25:25.298152+0000","last_peered":"2024-09-10T22:25:25.298152+0000","last_clean":"2024-09-10T22:25:25.298152+0000","last_became_active":"2024-09-10T22:24:20.125839+0000","last_became_peered":"2024-09-10T22:24:20.125839+0000","last_unstale":"2024-09-10T22:25:25.298152+0000","last_undegraded":"2024-09-10T22:25:25.298152+0000","last_fullsized":"2024-09-10T22:25:25.298152+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:19.099039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:19.099039+0000","last_clean_scrub_stamp":"2024-09-10T22:24:19.099039+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:45:05.155436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":59762,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":117,"num_read_kb":116,"num_write":29,"num_write_kb":69,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T22:25:05.519956+0000","last_change":"2024-09-10T22:24:22.142178+0000","last_active":"2024-09-10T22:25:05.519956+0000","last_peered":"2024-09-10T22:25:05.519956+0000","last_clean":"2024-09-10T22:25:05.519956+0000","last_became_active":"2024-09-10T22:24:22.141883+0000","last_became_peered":"2024-09-10T22:24:22.141883+0000","last_unstale":"2024-09-10T22:25:05.519956+0000","last_undegraded":"2024-09-10T22:25:05.519956+0000","last_fullsized":"2024-09-10T22:25:05.519956+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_clean_scrub_stamp":"2024-09-10T22:24:21.113844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:24:50.996273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"73'6","reported_seq":30,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T22:25:05.522352+0000","last_change":"2024-09-10T22:24:20.126129+0000","last_active":"2024-09-10T22:25:05.522352+0000","last_peered":"2024-09-10T22:25:05.522352+0000","last_clean":"2024-09-10T22:25:05.522352+0000","last_became_active":"2024-09-10T22:24:20.125749+0000","last_became_peered":"2024-09-10T22:24:20.125749+0000","last_unstale":"2024-09-10T22:25:05.522352+0000","last_undegraded":"2024-09-10T22:25:05.522352+0000","last_fullsized":"2024-09-10T22:25:05.522352+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:19.099039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:19.099039+0000","last_clean_scrub_stamp":"2024-09-10T22:24:19.099039+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:58:35.224036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T22:25:05.524400+0000","last_change":"2024-09-10T22:24:22.143964+0000","last_active":"2024-09-10T22:25:05.524400+0000","last_peered":"2024-09-10T22:25:05.524400+0000","last_clean":"2024-09-10T22:25:05.524400+0000","last_became_active":"2024-09-10T22:24:22.143589+0000","last_became_peered":"2024-09-10T22:24:22.143589+0000","last_unstale":"2024-09-10T22:25:05.524400+0000","last_undegraded":"2024-09-10T22:25:05.524400+0000","last_fullsized":"2024-09-10T22:25:05.524400+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_clean_scrub_stamp":"2024-09-10T22:24:21.113844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:41:41.737627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"73'3","reported_seq":26,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T22:25:05.522689+0000","last_change":"2024-09-10T22:24:20.128012+0000","last_active":"2024-09-10T22:25:05.522689+0000","last_peered":"2024-09-10T22:25:05.522689+0000","last_clean":"2024-09-10T22:25:05.522689+0000","last_became_active":"2024-09-10T22:24:20.127335+0000","last_became_peered":"2024-09-10T22:24:20.127335+0000","last_unstale":"2024-09-10T22:25:05.522689+0000","last_undegraded":"2024-09-10T22:25:05.522689+0000","last_fullsized":"2024-09-10T22:25:05.522689+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:19.099039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:19.099039+0000","last_clean_scrub_stamp":"2024-09-10T22:24:19.099039+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:20:27.017032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":25,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T22:25:05.526480+0000","last_change":"2024-09-10T22:25:05.526382+0000","last_active":"2024-09-10T22:25:05.526480+0000","last_peered":"2024-09-10T22:25:05.526480+0000","last_clean":"2024-09-10T22:25:05.526480+0000","last_became_active":"2024-09-10T22:25:05.526037+0000","last_became_peered":"2024-09-10T22:25:05.526037+0000","last_unstale":"2024-09-10T22:25:05.526480+0000","last_undegraded":"2024-09-10T22:25:05.526480+0000","last_fullsized":"2024-09-10T22:25:05.526480+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_clean_scrub_stamp":"2024-09-10T22:24:21.113844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:15:12.891318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,6],"acting":[7,9,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"73'4","reported_seq":83,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T22:25:23.306691+0000","last_change":"2024-09-10T22:24:20.124069+0000","last_active":"2024-09-10T22:25:23.306691+0000","last_peered":"2024-09-10T22:25:23.306691+0000","last_clean":"2024-09-10T22:25:23.306691+0000","last_became_active":"2024-09-10T22:24:20.123675+0000","last_became_peered":"2024-09-10T22:24:20.123675+0000","last_unstale":"2024-09-10T22:25:23.306691+0000","last_undegraded":"2024-09-10T22:25:23.306691+0000","last_fullsized":"2024-09-10T22:25:23.306691+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:19.099039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:19.099039+0000","last_clean_scrub_stamp":"2024-09-10T22:24:19.099039+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:32:50.287012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":979,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":57,"num_read_kb":4,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T22:25:05.522302+0000","last_change":"2024-09-10T22:24:22.146870+0000","last_active":"2024-09-10T22:25:05.522302+0000","last_peered":"2024-09-10T22:25:05.522302+0000","last_clean":"2024-09-10T22:25:05.522302+0000","last_became_active":"2024-09-10T22:24:22.146615+0000","last_became_peered":"2024-09-10T22:24:22.146615+0000","last_unstale":"2024-09-10T22:25:05.522302+0000","last_undegraded":"2024-09-10T22:25:05.522302+0000","last_fullsized":"2024-09-10T22:25:05.522302+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_clean_scrub_stamp":"2024-09-10T22:24:21.113844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:00:05.579248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"73'15","reported_seq":39,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T22:25:05.519217+0000","last_change":"2024-09-10T22:24:20.383675+0000","last_active":"2024-09-10T22:25:05.519217+0000","last_peered":"2024-09-10T22:25:05.519217+0000","last_clean":"2024-09-10T22:25:05.519217+0000","last_became_active":"2024-09-10T22:24:20.383317+0000","last_became_peered":"2024-09-10T22:24:20.383317+0000","last_unstale":"2024-09-10T22:25:05.519217+0000","last_undegraded":"2024-09-10T22:25:05.519217+0000","last_fullsized":"2024-09-10T22:25:05.519217+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:19.099039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:19.099039+0000","last_clean_scrub_stamp":"2024-09-10T22:24:19.099039+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:43:24.989851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T22:25:05.522054+0000","last_change":"2024-09-10T22:24:22.144872+0000","last_active":"2024-09-10T22:25:05.522054+0000","last_peered":"2024-09-10T22:25:05.522054+0000","last_clean":"2024-09-10T22:25:05.522054+0000","last_became_active":"2024-09-10T22:24:22.144570+0000","last_became_peered":"2024-09-10T22:24:22.144570+0000","last_unstale":"2024-09-10T22:25:05.522054+0000","last_undegraded":"2024-09-10T22:25:05.522054+0000","last_fullsized":"2024-09-10T22:25:05.522054+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_clean_scrub_stamp":"2024-09-10T22:24:21.113844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:20:17.937544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"73'2","reported_seq":26,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T22:25:05.520112+0000","last_change":"2024-09-10T22:24:20.125849+0000","last_active":"2024-09-10T22:25:05.520112+0000","last_peered":"2024-09-10T22:25:05.520112+0000","last_clean":"2024-09-10T22:25:05.520112+0000","last_became_active":"2024-09-10T22:24:20.125042+0000","last_became_peered":"2024-09-10T22:24:20.125042+0000","last_unstale":"2024-09-10T22:25:05.520112+0000","last_undegraded":"2024-09-10T22:25:05.520112+0000","last_fullsized":"2024-09-10T22:25:05.520112+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:19.099039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:19.099039+0000","last_clean_scrub_stamp":"2024-09-10T22:24:19.099039+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:36:28.249115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T22:25:05.518400+0000","last_change":"2024-09-10T22:24:22.141232+0000","last_active":"2024-09-10T22:25:05.518400+0000","last_peered":"2024-09-10T22:25:05.518400+0000","last_clean":"2024-09-10T22:25:05.518400+0000","last_became_active":"2024-09-10T22:24:22.140903+0000","last_became_peered":"2024-09-10T22:24:22.140903+0000","last_unstale":"2024-09-10T22:25:05.518400+0000","last_undegraded":"2024-09-10T22:25:05.518400+0000","last_fullsized":"2024-09-10T22:25:05.518400+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_clean_scrub_stamp":"2024-09-10T22:24:21.113844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:15:11.627126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"73'2","reported_seq":25,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T22:25:05.525583+0000","last_change":"2024-09-10T22:24:20.122829+0000","last_active":"2024-09-10T22:25:05.525583+0000","last_peered":"2024-09-10T22:25:05.525583+0000","last_clean":"2024-09-10T22:25:05.525583+0000","last_became_active":"2024-09-10T22:24:20.122545+0000","last_became_peered":"2024-09-10T22:24:20.122545+0000","last_unstale":"2024-09-10T22:25:05.525583+0000","last_undegraded":"2024-09-10T22:25:05.525583+0000","last_fullsized":"2024-09-10T22:25:05.525583+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:19.099039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:19.099039+0000","last_clean_scrub_stamp":"2024-09-10T22:24:19.099039+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:18:27.758029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T22:25:05.521480+0000","last_change":"2024-09-10T22:24:22.139725+0000","last_active":"2024-09-10T22:25:05.521480+0000","last_peered":"2024-09-10T22:25:05.521480+0000","last_clean":"2024-09-10T22:25:05.521480+0000","last_became_active":"2024-09-10T22:24:22.139293+0000","last_became_peered":"2024-09-10T22:24:22.139293+0000","last_unstale":"2024-09-10T22:25:05.521480+0000","last_undegraded":"2024-09-10T22:25:05.521480+0000","last_fullsized":"2024-09-10T22:25:05.521480+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_clean_scrub_stamp":"2024-09-10T22:24:21.113844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:43:14.424880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"73'1","reported_seq":25,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T22:25:05.522177+0000","last_change":"2024-09-10T22:24:20.125371+0000","last_active":"2024-09-10T22:25:05.522177+0000","last_peered":"2024-09-10T22:25:05.522177+0000","last_clean":"2024-09-10T22:25:05.522177+0000","last_became_active":"2024-09-10T22:24:20.125033+0000","last_became_peered":"2024-09-10T22:24:20.125033+0000","last_unstale":"2024-09-10T22:25:05.522177+0000","last_undegraded":"2024-09-10T22:25:05.522177+0000","last_fullsized":"2024-09-10T22:25:05.522177+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:19.099039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:19.099039+0000","last_clean_scrub_stamp":"2024-09-10T22:24:19.099039+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:22:22.751778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"73'1","reported_seq":19,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T22:25:05.520858+0000","last_change":"2024-09-10T22:24:22.149522+0000","last_active":"2024-09-10T22:25:05.520858+0000","last_peered":"2024-09-10T22:25:05.520858+0000","last_clean":"2024-09-10T22:25:05.520858+0000","last_became_active":"2024-09-10T22:24:22.148710+0000","last_became_peered":"2024-09-10T22:24:22.148710+0000","last_unstale":"2024-09-10T22:25:05.520858+0000","last_undegraded":"2024-09-10T22:25:05.520858+0000","last_fullsized":"2024-09-10T22:25:05.520858+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_clean_scrub_stamp":"2024-09-10T22:24:21.113844+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:44:32.020949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"73'3","reported_seq":27,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T22:25:05.522717+0000","last_change":"2024-09-10T22:24:20.406792+0000","last_active":"2024-09-10T22:25:05.522717+0000","last_peered":"2024-09-10T22:25:05.522717+0000","last_clean":"2024-09-10T22:25:05.522717+0000","last_became_active":"2024-09-10T22:24:20.406437+0000","last_became_peered":"2024-09-10T22:24:20.406437+0000","last_unstale":"2024-09-10T22:25:05.522717+0000","last_undegraded":"2024-09-10T22:25:05.522717+0000","last_fullsized":"2024-09-10T22:25:05.522717+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:19.099039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:19.099039+0000","last_clean_scrub_stamp":"2024-09-10T22:24:19.099039+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:00:16.436165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T22:25:05.521064+0000","last_change":"2024-09-10T22:24:22.142335+0000","last_active":"2024-09-10T22:25:05.521064+0000","last_peered":"2024-09-10T22:25:05.521064+0000","last_clean":"2024-09-10T22:25:05.521064+0000","last_became_active":"2024-09-10T22:24:22.142001+0000","last_became_peered":"2024-09-10T22:24:22.142001+0000","last_unstale":"2024-09-10T22:25:05.521064+0000","last_undegraded":"2024-09-10T22:25:05.521064+0000","last_fullsized":"2024-09-10T22:25:05.521064+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_clean_scrub_stamp":"2024-09-10T22:24:21.113844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:46:20.043915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"19'92","reported_seq":95,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T22:25:05.522482+0000","last_change":"2024-09-10T22:23:11.163678+0000","last_active":"2024-09-10T22:25:05.522482+0000","last_peered":"2024-09-10T22:25:05.522482+0000","last_clean":"2024-09-10T22:25:05.522482+0000","last_became_active":"2024-09-10T22:23:11.158387+0000","last_became_peered":"2024-09-10T22:23:11.158387+0000","last_unstale":"2024-09-10T22:25:05.522482+0000","last_undegraded":"2024-09-10T22:25:05.522482+0000","last_fullsized":"2024-09-10T22:25:05.522482+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:19:50.906986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:19:50.906986+0000","last_clean_scrub_stamp":"2024-09-10T22:19:50.906986+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:11:31.570355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"73'3","reported_seq":28,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T22:25:05.636850+0000","last_change":"2024-09-10T22:24:20.123048+0000","last_active":"2024-09-10T22:25:05.636850+0000","last_peered":"2024-09-10T22:25:05.636850+0000","last_clean":"2024-09-10T22:25:05.636850+0000","last_became_active":"2024-09-10T22:24:20.121906+0000","last_became_peered":"2024-09-10T22:24:20.121906+0000","last_unstale":"2024-09-10T22:25:05.636850+0000","last_undegraded":"2024-09-10T22:25:05.636850+0000","last_fullsized":"2024-09-10T22:25:05.636850+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:19.099039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:19.099039+0000","last_clean_scrub_stamp":"2024-09-10T22:24:19.099039+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:11:00.293820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T22:25:05.636560+0000","last_change":"2024-09-10T22:24:22.146378+0000","last_active":"2024-09-10T22:25:05.636560+0000","last_peered":"2024-09-10T22:25:05.636560+0000","last_clean":"2024-09-10T22:25:05.636560+0000","last_became_active":"2024-09-10T22:24:22.145841+0000","last_became_peered":"2024-09-10T22:24:22.145841+0000","last_unstale":"2024-09-10T22:25:05.636560+0000","last_undegraded":"2024-09-10T22:25:05.636560+0000","last_fullsized":"2024-09-10T22:25:05.636560+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_clean_scrub_stamp":"2024-09-10T22:24:21.113844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:20:31.785243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"73'3","reported_seq":37,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T22:25:05.640772+0000","last_change":"2024-09-10T22:25:05.640672+0000","last_active":"2024-09-10T22:25:05.640772+0000","last_peered":"2024-09-10T22:25:05.640772+0000","last_clean":"2024-09-10T22:25:05.640772+0000","last_became_active":"2024-09-10T22:25:05.637774+0000","last_became_peered":"2024-09-10T22:25:05.637774+0000","last_unstale":"2024-09-10T22:25:05.640772+0000","last_undegraded":"2024-09-10T22:25:05.640772+0000","last_fullsized":"2024-09-10T22:25:05.640772+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:19.099039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:19.099039+0000","last_clean_scrub_stamp":"2024-09-10T22:24:19.099039+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:33:20.970862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,4],"acting":[7,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T22:25:05.524419+0000","last_change":"2024-09-10T22:24:22.139850+0000","last_active":"2024-09-10T22:25:05.524419+0000","last_peered":"2024-09-10T22:25:05.524419+0000","last_clean":"2024-09-10T22:25:05.524419+0000","last_became_active":"2024-09-10T22:24:22.137885+0000","last_became_peered":"2024-09-10T22:24:22.137885+0000","last_unstale":"2024-09-10T22:25:05.524419+0000","last_undegraded":"2024-09-10T22:25:05.524419+0000","last_fullsized":"2024-09-10T22:25:05.524419+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_clean_scrub_stamp":"2024-09-10T22:24:21.113844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:52:55.988247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"73'4","reported_seq":80,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T22:25:23.306240+0000","last_change":"2024-09-10T22:24:20.383650+0000","last_active":"2024-09-10T22:25:23.306240+0000","last_peered":"2024-09-10T22:25:23.306240+0000","last_clean":"2024-09-10T22:25:23.306240+0000","last_became_active":"2024-09-10T22:24:20.383286+0000","last_became_peered":"2024-09-10T22:24:20.383286+0000","last_unstale":"2024-09-10T22:25:23.306240+0000","last_undegraded":"2024-09-10T22:25:23.306240+0000","last_fullsized":"2024-09-10T22:25:23.306240+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:19.099039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:19.099039+0000","last_clean_scrub_stamp":"2024-09-10T22:24:19.099039+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:38:04.467105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":53,"num_read_kb":53,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T22:25:05.522170+0000","last_change":"2024-09-10T22:24:22.141717+0000","last_active":"2024-09-10T22:25:05.522170+0000","last_peered":"2024-09-10T22:25:05.522170+0000","last_clean":"2024-09-10T22:25:05.522170+0000","last_became_active":"2024-09-10T22:24:22.141426+0000","last_became_peered":"2024-09-10T22:24:22.141426+0000","last_unstale":"2024-09-10T22:25:05.522170+0000","last_undegraded":"2024-09-10T22:25:05.522170+0000","last_fullsized":"2024-09-10T22:25:05.522170+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_clean_scrub_stamp":"2024-09-10T22:24:21.113844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:13:58.341345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"73'1","reported_seq":24,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T22:25:05.521671+0000","last_change":"2024-09-10T22:24:20.127658+0000","last_active":"2024-09-10T22:25:05.521671+0000","last_peered":"2024-09-10T22:25:05.521671+0000","last_clean":"2024-09-10T22:25:05.521671+0000","last_became_active":"2024-09-10T22:24:20.127366+0000","last_became_peered":"2024-09-10T22:24:20.127366+0000","last_unstale":"2024-09-10T22:25:05.521671+0000","last_undegraded":"2024-09-10T22:25:05.521671+0000","last_fullsized":"2024-09-10T22:25:05.521671+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:19.099039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:19.099039+0000","last_clean_scrub_stamp":"2024-09-10T22:24:19.099039+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:36:05.439417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T22:25:05.521293+0000","last_change":"2024-09-10T22:24:22.144799+0000","last_active":"2024-09-10T22:25:05.521293+0000","last_peered":"2024-09-10T22:25:05.521293+0000","last_clean":"2024-09-10T22:25:05.521293+0000","last_became_active":"2024-09-10T22:24:22.144543+0000","last_became_peered":"2024-09-10T22:24:22.144543+0000","last_unstale":"2024-09-10T22:25:05.521293+0000","last_undegraded":"2024-09-10T22:25:05.521293+0000","last_fullsized":"2024-09-10T22:25:05.521293+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_clean_scrub_stamp":"2024-09-10T22:24:21.113844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:45:46.193108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":23,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T22:25:05.517294+0000","last_change":"2024-09-10T22:24:20.383345+0000","last_active":"2024-09-10T22:25:05.517294+0000","last_peered":"2024-09-10T22:25:05.517294+0000","last_clean":"2024-09-10T22:25:05.517294+0000","last_became_active":"2024-09-10T22:24:20.383023+0000","last_became_peered":"2024-09-10T22:24:20.383023+0000","last_unstale":"2024-09-10T22:25:05.517294+0000","last_undegraded":"2024-09-10T22:25:05.517294+0000","last_fullsized":"2024-09-10T22:25:05.517294+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:19.099039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:19.099039+0000","last_clean_scrub_stamp":"2024-09-10T22:24:19.099039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:27:31.771060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"73'1","reported_seq":19,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T22:25:05.521535+0000","last_change":"2024-09-10T22:24:22.143130+0000","last_active":"2024-09-10T22:25:05.521535+0000","last_peered":"2024-09-10T22:25:05.521535+0000","last_clean":"2024-09-10T22:25:05.521535+0000","last_became_active":"2024-09-10T22:24:22.142664+0000","last_became_peered":"2024-09-10T22:24:22.142664+0000","last_unstale":"2024-09-10T22:25:05.521535+0000","last_undegraded":"2024-09-10T22:25:05.521535+0000","last_fullsized":"2024-09-10T22:25:05.521535+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_clean_scrub_stamp":"2024-09-10T22:24:21.113844+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:49:53.325307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"73'1","reported_seq":25,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T22:25:05.520063+0000","last_change":"2024-09-10T22:24:20.383795+0000","last_active":"2024-09-10T22:25:05.520063+0000","last_peered":"2024-09-10T22:25:05.520063+0000","last_clean":"2024-09-10T22:25:05.520063+0000","last_became_active":"2024-09-10T22:24:20.383418+0000","last_became_peered":"2024-09-10T22:24:20.383418+0000","last_unstale":"2024-09-10T22:25:05.520063+0000","last_undegraded":"2024-09-10T22:25:05.520063+0000","last_fullsized":"2024-09-10T22:25:05.520063+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:19.099039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:19.099039+0000","last_clean_scrub_stamp":"2024-09-10T22:24:19.099039+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:52:26.602544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T22:25:05.524907+0000","last_change":"2024-09-10T22:24:22.139416+0000","last_active":"2024-09-10T22:25:05.524907+0000","last_peered":"2024-09-10T22:25:05.524907+0000","last_clean":"2024-09-10T22:25:05.524907+0000","last_became_active":"2024-09-10T22:24:22.138648+0000","last_became_peered":"2024-09-10T22:24:22.138648+0000","last_unstale":"2024-09-10T22:25:05.524907+0000","last_undegraded":"2024-09-10T22:25:05.524907+0000","last_fullsized":"2024-09-10T22:25:05.524907+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_clean_scrub_stamp":"2024-09-10T22:24:21.113844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:12:20.064134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"73'10","reported_seq":33,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T22:25:05.517416+0000","last_change":"2024-09-10T22:24:20.124001+0000","last_active":"2024-09-10T22:25:05.517416+0000","last_peered":"2024-09-10T22:25:05.517416+0000","last_clean":"2024-09-10T22:25:05.517416+0000","last_became_active":"2024-09-10T22:24:20.123616+0000","last_became_peered":"2024-09-10T22:24:20.123616+0000","last_unstale":"2024-09-10T22:25:05.517416+0000","last_undegraded":"2024-09-10T22:25:05.517416+0000","last_fullsized":"2024-09-10T22:25:05.517416+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:19.099039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:19.099039+0000","last_clean_scrub_stamp":"2024-09-10T22:24:19.099039+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:12:47.003561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T22:25:05.636476+0000","last_change":"2024-09-10T22:24:22.146936+0000","last_active":"2024-09-10T22:25:05.636476+0000","last_peered":"2024-09-10T22:25:05.636476+0000","last_clean":"2024-09-10T22:25:05.636476+0000","last_became_active":"2024-09-10T22:24:22.146578+0000","last_became_peered":"2024-09-10T22:24:22.146578+0000","last_unstale":"2024-09-10T22:25:05.636476+0000","last_undegraded":"2024-09-10T22:25:05.636476+0000","last_fullsized":"2024-09-10T22:25:05.636476+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_clean_scrub_stamp":"2024-09-10T22:24:21.113844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:44:20.229747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"73'4","reported_seq":27,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T22:25:05.636970+0000","last_change":"2024-09-10T22:24:20.406642+0000","last_active":"2024-09-10T22:25:05.636970+0000","last_peered":"2024-09-10T22:25:05.636970+0000","last_clean":"2024-09-10T22:25:05.636970+0000","last_became_active":"2024-09-10T22:24:20.406288+0000","last_became_peered":"2024-09-10T22:24:20.406288+0000","last_unstale":"2024-09-10T22:25:05.636970+0000","last_undegraded":"2024-09-10T22:25:05.636970+0000","last_fullsized":"2024-09-10T22:25:05.636970+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:19.099039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:19.099039+0000","last_clean_scrub_stamp":"2024-09-10T22:24:19.099039+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:10:48.558751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T22:25:05.636612+0000","last_change":"2024-09-10T22:24:22.142511+0000","last_active":"2024-09-10T22:25:05.636612+0000","last_peered":"2024-09-10T22:25:05.636612+0000","last_clean":"2024-09-10T22:25:05.636612+0000","last_became_active":"2024-09-10T22:24:22.142200+0000","last_became_peered":"2024-09-10T22:24:22.142200+0000","last_unstale":"2024-09-10T22:25:05.636612+0000","last_undegraded":"2024-09-10T22:25:05.636612+0000","last_fullsized":"2024-09-10T22:25:05.636612+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_clean_scrub_stamp":"2024-09-10T22:24:21.113844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:09:46.928679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"73'2","reported_seq":25,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T22:25:05.524848+0000","last_change":"2024-09-10T22:24:20.383403+0000","last_active":"2024-09-10T22:25:05.524848+0000","last_peered":"2024-09-10T22:25:05.524848+0000","last_clean":"2024-09-10T22:25:05.524848+0000","last_became_active":"2024-09-10T22:24:20.383143+0000","last_became_peered":"2024-09-10T22:24:20.383143+0000","last_unstale":"2024-09-10T22:25:05.524848+0000","last_undegraded":"2024-09-10T22:25:05.524848+0000","last_fullsized":"2024-09-10T22:25:05.524848+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:19.099039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:19.099039+0000","last_clean_scrub_stamp":"2024-09-10T22:24:19.099039+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:54:07.338628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T22:25:05.519205+0000","last_change":"2024-09-10T22:24:22.136604+0000","last_active":"2024-09-10T22:25:05.519205+0000","last_peered":"2024-09-10T22:25:05.519205+0000","last_clean":"2024-09-10T22:25:05.519205+0000","last_became_active":"2024-09-10T22:24:22.136298+0000","last_became_peered":"2024-09-10T22:24:22.136298+0000","last_unstale":"2024-09-10T22:25:05.519205+0000","last_undegraded":"2024-09-10T22:25:05.519205+0000","last_fullsized":"2024-09-10T22:25:05.519205+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_clean_scrub_stamp":"2024-09-10T22:24:21.113844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:39:11.777729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"73'3","reported_seq":26,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T22:25:05.636399+0000","last_change":"2024-09-10T22:24:20.124911+0000","last_active":"2024-09-10T22:25:05.636399+0000","last_peered":"2024-09-10T22:25:05.636399+0000","last_clean":"2024-09-10T22:25:05.636399+0000","last_became_active":"2024-09-10T22:24:20.124152+0000","last_became_peered":"2024-09-10T22:24:20.124152+0000","last_unstale":"2024-09-10T22:25:05.636399+0000","last_undegraded":"2024-09-10T22:25:05.636399+0000","last_fullsized":"2024-09-10T22:25:05.636399+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:19.099039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:19.099039+0000","last_clean_scrub_stamp":"2024-09-10T22:24:19.099039+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:32:30.837104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T22:25:05.517688+0000","last_change":"2024-09-10T22:24:22.138080+0000","last_active":"2024-09-10T22:25:05.517688+0000","last_peered":"2024-09-10T22:25:05.517688+0000","last_clean":"2024-09-10T22:25:05.517688+0000","last_became_active":"2024-09-10T22:24:22.137775+0000","last_became_peered":"2024-09-10T22:24:22.137775+0000","last_unstale":"2024-09-10T22:25:05.517688+0000","last_undegraded":"2024-09-10T22:25:05.517688+0000","last_fullsized":"2024-09-10T22:25:05.517688+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_clean_scrub_stamp":"2024-09-10T22:24:21.113844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:10:48.320495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"73'1","reported_seq":24,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T22:25:05.522456+0000","last_change":"2024-09-10T22:24:20.125551+0000","last_active":"2024-09-10T22:25:05.522456+0000","last_peered":"2024-09-10T22:25:05.522456+0000","last_clean":"2024-09-10T22:25:05.522456+0000","last_became_active":"2024-09-10T22:24:20.125064+0000","last_became_peered":"2024-09-10T22:24:20.125064+0000","last_unstale":"2024-09-10T22:25:05.522456+0000","last_undegraded":"2024-09-10T22:25:05.522456+0000","last_fullsized":"2024-09-10T22:25:05.522456+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:19.099039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:19.099039+0000","last_clean_scrub_stamp":"2024-09-10T22:24:19.099039+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:29:48.598158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T22:25:05.636972+0000","last_change":"2024-09-10T22:24:22.142894+0000","last_active":"2024-09-10T22:25:05.636972+0000","last_peered":"2024-09-10T22:25:05.636972+0000","last_clean":"2024-09-10T22:25:05.636972+0000","last_became_active":"2024-09-10T22:24:22.142554+0000","last_became_peered":"2024-09-10T22:24:22.142554+0000","last_unstale":"2024-09-10T22:25:05.636972+0000","last_undegraded":"2024-09-10T22:25:05.636972+0000","last_fullsized":"2024-09-10T22:25:05.636972+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_clean_scrub_stamp":"2024-09-10T22:24:21.113844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:11:11.457622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"73'4","reported_seq":28,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T22:25:05.519653+0000","last_change":"2024-09-10T22:24:20.128212+0000","last_active":"2024-09-10T22:25:05.519653+0000","last_peered":"2024-09-10T22:25:05.519653+0000","last_clean":"2024-09-10T22:25:05.519653+0000","last_became_active":"2024-09-10T22:24:20.127597+0000","last_became_peered":"2024-09-10T22:24:20.127597+0000","last_unstale":"2024-09-10T22:25:05.519653+0000","last_undegraded":"2024-09-10T22:25:05.519653+0000","last_fullsized":"2024-09-10T22:25:05.519653+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:19.099039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:19.099039+0000","last_clean_scrub_stamp":"2024-09-10T22:24:19.099039+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:48:28.543222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T22:25:05.521128+0000","last_change":"2024-09-10T22:24:22.144321+0000","last_active":"2024-09-10T22:25:05.521128+0000","last_peered":"2024-09-10T22:25:05.521128+0000","last_clean":"2024-09-10T22:25:05.521128+0000","last_became_active":"2024-09-10T22:24:22.144037+0000","last_became_peered":"2024-09-10T22:24:22.144037+0000","last_unstale":"2024-09-10T22:25:05.521128+0000","last_undegraded":"2024-09-10T22:25:05.521128+0000","last_fullsized":"2024-09-10T22:25:05.521128+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_clean_scrub_stamp":"2024-09-10T22:24:21.113844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:28:00.600758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T22:25:05.522021+0000","last_change":"2024-09-10T22:24:22.145574+0000","last_active":"2024-09-10T22:25:05.522021+0000","last_peered":"2024-09-10T22:25:05.522021+0000","last_clean":"2024-09-10T22:25:05.522021+0000","last_became_active":"2024-09-10T22:24:22.144425+0000","last_became_peered":"2024-09-10T22:24:22.144425+0000","last_unstale":"2024-09-10T22:25:05.522021+0000","last_undegraded":"2024-09-10T22:25:05.522021+0000","last_fullsized":"2024-09-10T22:25:05.522021+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_clean_scrub_stamp":"2024-09-10T22:24:21.113844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:41:10.177782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"73'2","reported_seq":25,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T22:25:05.519940+0000","last_change":"2024-09-10T22:24:20.124627+0000","last_active":"2024-09-10T22:25:05.519940+0000","last_peered":"2024-09-10T22:25:05.519940+0000","last_clean":"2024-09-10T22:25:05.519940+0000","last_became_active":"2024-09-10T22:24:20.124174+0000","last_became_peered":"2024-09-10T22:24:20.124174+0000","last_unstale":"2024-09-10T22:25:05.519940+0000","last_undegraded":"2024-09-10T22:25:05.519940+0000","last_fullsized":"2024-09-10T22:25:05.519940+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:19.099039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:19.099039+0000","last_clean_scrub_stamp":"2024-09-10T22:24:19.099039+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:35:26.871316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T22:25:05.525253+0000","last_change":"2024-09-10T22:24:22.142531+0000","last_active":"2024-09-10T22:25:05.525253+0000","last_peered":"2024-09-10T22:25:05.525253+0000","last_clean":"2024-09-10T22:25:05.525253+0000","last_became_active":"2024-09-10T22:24:22.142240+0000","last_became_peered":"2024-09-10T22:24:22.142240+0000","last_unstale":"2024-09-10T22:25:05.525253+0000","last_undegraded":"2024-09-10T22:25:05.525253+0000","last_fullsized":"2024-09-10T22:25:05.525253+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_clean_scrub_stamp":"2024-09-10T22:24:21.113844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:30:56.868586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"73'4","reported_seq":40,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T22:25:05.644250+0000","last_change":"2024-09-10T22:25:05.644160+0000","last_active":"2024-09-10T22:25:05.644250+0000","last_peered":"2024-09-10T22:25:05.644250+0000","last_clean":"2024-09-10T22:25:05.644250+0000","last_became_active":"2024-09-10T22:25:05.638026+0000","last_became_peered":"2024-09-10T22:25:05.638026+0000","last_unstale":"2024-09-10T22:25:05.644250+0000","last_undegraded":"2024-09-10T22:25:05.644250+0000","last_fullsized":"2024-09-10T22:25:05.644250+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:19.099039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:19.099039+0000","last_clean_scrub_stamp":"2024-09-10T22:24:19.099039+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:58:18.112018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":10,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,4,7],"acting":[8,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T22:25:05.636813+0000","last_change":"2024-09-10T22:24:22.141121+0000","last_active":"2024-09-10T22:25:05.636813+0000","last_peered":"2024-09-10T22:25:05.636813+0000","last_clean":"2024-09-10T22:25:05.636813+0000","last_became_active":"2024-09-10T22:24:22.140490+0000","last_became_peered":"2024-09-10T22:24:22.140490+0000","last_unstale":"2024-09-10T22:25:05.636813+0000","last_undegraded":"2024-09-10T22:25:05.636813+0000","last_fullsized":"2024-09-10T22:25:05.636813+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_clean_scrub_stamp":"2024-09-10T22:24:21.113844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:52:22.840740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"73'2","reported_seq":25,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T22:25:05.636729+0000","last_change":"2024-09-10T22:24:20.385053+0000","last_active":"2024-09-10T22:25:05.636729+0000","last_peered":"2024-09-10T22:25:05.636729+0000","last_clean":"2024-09-10T22:25:05.636729+0000","last_became_active":"2024-09-10T22:24:20.384432+0000","last_became_peered":"2024-09-10T22:24:20.384432+0000","last_unstale":"2024-09-10T22:25:05.636729+0000","last_undegraded":"2024-09-10T22:25:05.636729+0000","last_fullsized":"2024-09-10T22:25:05.636729+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:19.099039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:19.099039+0000","last_clean_scrub_stamp":"2024-09-10T22:24:19.099039+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:18:15.685331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T22:25:05.636603+0000","last_change":"2024-09-10T22:24:22.143884+0000","last_active":"2024-09-10T22:25:05.636603+0000","last_peered":"2024-09-10T22:25:05.636603+0000","last_clean":"2024-09-10T22:25:05.636603+0000","last_became_active":"2024-09-10T22:24:22.143446+0000","last_became_peered":"2024-09-10T22:24:22.143446+0000","last_unstale":"2024-09-10T22:25:05.636603+0000","last_undegraded":"2024-09-10T22:25:05.636603+0000","last_fullsized":"2024-09-10T22:25:05.636603+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_clean_scrub_stamp":"2024-09-10T22:24:21.113844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:28:32.453668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"73'9","reported_seq":50,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T22:25:05.528312+0000","last_change":"2024-09-10T22:25:05.528200+0000","last_active":"2024-09-10T22:25:05.528312+0000","last_peered":"2024-09-10T22:25:05.528312+0000","last_clean":"2024-09-10T22:25:05.528312+0000","last_became_active":"2024-09-10T22:25:05.520346+0000","last_became_peered":"2024-09-10T22:25:05.520346+0000","last_unstale":"2024-09-10T22:25:05.528312+0000","last_undegraded":"2024-09-10T22:25:05.528312+0000","last_fullsized":"2024-09-10T22:25:05.528312+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:19.099039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:19.099039+0000","last_clean_scrub_stamp":"2024-09-10T22:24:19.099039+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:38:21.050372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":582,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,11,8],"acting":[9,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":63763,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":343,"num_read_kb":236,"num_write":161,"num_write_kb":109,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":11,"num_bytes_recovered":672,"num_keys_recovered":10,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":417792,"data_stored":191289,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4751360,"data_stored":4722944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":92,"ondisk_log_size":92,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":67,"seq":287762808858,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27836,"kb_used_data":804,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717316,"statfs":{"total":95995035648,"available":95966531584,"internally_reserved":0,"allocated":823296,"data_stored":397674,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":62,"seq":266287972383,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36832,"kb_used_data":1480,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708320,"statfs":{"total":95995035648,"available":95957319680,"internally_reserved":0,"allocated":1515520,"data_stored":1048726,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":36174272},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":57,"seq":244813135907,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27844,"kb_used_data":816,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717308,"statfs":{"total":95995035648,"available":95966523392,"internally_reserved":0,"allocated":835584,"data_stored":397328,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,5,6,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":51,"seq":219043332136,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27848,"kb_used_data":816,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717304,"statfs":{"total":95995035648,"available":95966519296,"internally_reserved":0,"allocated":835584,"data_stored":397248,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":46,"seq":197568495662,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36744,"kb_used_data":1392,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708408,"statfs":{"total":95995035648,"available":95957409792,"internally_reserved":0,"allocated":1425408,"data_stored":988596,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":36174282},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":40,"seq":171798691891,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27836,"kb_used_data":804,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717316,"statfs":{"total":95995035648,"available":95966531584,"internally_reserved":0,"allocated":823296,"data_stored":396717,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":34,"seq":146028888119,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28432,"kb_used_data":1404,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716720,"statfs":{"total":95995035648,"available":95965921280,"internally_reserved":0,"allocated":1437696,"data_stored":988381,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":29,"seq":124554051644,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27840,"kb_used_data":808,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717312,"statfs":{"total":95995035648,"available":95966527488,"internally_reserved":0,"allocated":827392,"data_stored":397545,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":23,"seq":98784247873,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27852,"kb_used_data":820,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717300,"statfs":{"total":95995035648,"available":95966515200,"internally_reserved":0,"allocated":839680,"data_stored":397028,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444104,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36240,"kb_used_data":888,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708912,"statfs":{"total":95995035648,"available":95957925888,"internally_reserved":0,"allocated":909312,"data_stored":457622,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":12,"seq":51539607628,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36220,"kb_used_data":868,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708932,"statfs":{"total":95995035648,"available":95957946368,"internally_reserved":0,"allocated":888832,"data_stored":456362,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738449,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36176,"kb_used_data":824,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708976,"statfs":{"total":95995035648,"available":95957991424,"internally_reserved":0,"allocated":843776,"data_stored":397988,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":59852,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":94208,"data_stored":61112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1035,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1386,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1601,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":61731,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1164,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-10T22:25:28.813 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 22997a4c-6fc2-11ef-bcea-c7b262605968 -- ceph pg dump --format=json 2024-09-10T22:25:29.083 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/22997a4c-6fc2-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T22:25:29.616 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:29.614+0000 7fbd6f149640 1 -- 172.21.15.19:0/3414958802 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbd68109150 msgr2=0x7fbd6810f950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:25:29.617 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:29.614+0000 7fbd6f149640 1 --2- 172.21.15.19:0/3414958802 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbd68109150 0x7fbd6810f950 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7fbd60009ca0 tx=0x7fbd6002a8c0 comp rx=0 tx=0).stop 2024-09-10T22:25:29.617 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:29.614+0000 7fbd6f149640 1 -- 172.21.15.19:0/3414958802 shutdown_connections 2024-09-10T22:25:29.617 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:29.614+0000 7fbd6f149640 1 --2- 172.21.15.19:0/3414958802 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbd68109150 0x7fbd6810f950 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:25:29.617 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:29.614+0000 7fbd6f149640 1 --2- 172.21.15.19:0/3414958802 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fbd681087d0 0x7fbd68108c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:25:29.617 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:29.614+0000 7fbd6f149640 1 --2- 172.21.15.19:0/3414958802 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbd68102dc0 0x7fbd681031a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:25:29.617 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:29.614+0000 7fbd6f149640 1 -- 172.21.15.19:0/3414958802 >> 172.21.15.19:0/3414958802 conn(0x7fbd680fe830 msgr2=0x7fbd68100c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:25:29.617 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:29.614+0000 7fbd6f149640 1 -- 172.21.15.19:0/3414958802 shutdown_connections 2024-09-10T22:25:29.617 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:29.614+0000 7fbd6f149640 1 -- 172.21.15.19:0/3414958802 wait complete. 2024-09-10T22:25:29.617 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:29.615+0000 7fbd6f149640 1 Processor -- start 2024-09-10T22:25:29.617 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:29.615+0000 7fbd6f149640 1 -- start start 2024-09-10T22:25:29.619 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:29.616+0000 7fbd6f149640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fbd68102dc0 0x7fbd68199220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:25:29.619 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:29.616+0000 7fbd6f149640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbd681087d0 0x7fbd68199760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:25:29.619 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:29.616+0000 7fbd6f149640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbd68109150 0x7fbd6819eb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:25:29.619 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:29.616+0000 7fbd6f149640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fbd68112e10 con 0x7fbd681087d0 2024-09-10T22:25:29.619 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:29.616+0000 7fbd6f149640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fbd68112c90 con 0x7fbd68109150 2024-09-10T22:25:29.620 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:29.616+0000 7fbd6f149640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7fbd68112f90 con 0x7fbd68102dc0 2024-09-10T22:25:29.620 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:29.616+0000 7fbd67fff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbd681087d0 0x7fbd68199760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:25:29.620 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:29.616+0000 7fbd67fff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbd681087d0 0x7fbd68199760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:60530/0 (socket says 172.21.15.19:60530) 2024-09-10T22:25:29.620 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:29.616+0000 7fbd67fff640 1 -- 172.21.15.19:0/1242829165 learned_addr learned my addr 172.21.15.19:0/1242829165 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:25:29.620 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:29.616+0000 7fbd6cee5640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fbd68102dc0 0x7fbd68199220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:25:29.620 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:29.616+0000 7fbd6d6e6640 1 --2- 172.21.15.19:0/1242829165 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbd68109150 0x7fbd6819eb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:25:29.620 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:29.616+0000 7fbd67fff640 1 -- 172.21.15.19:0/1242829165 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fbd68102dc0 msgr2=0x7fbd68199220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:25:29.620 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:29.616+0000 7fbd67fff640 1 --2- 172.21.15.19:0/1242829165 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fbd68102dc0 0x7fbd68199220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:25:29.620 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:29.616+0000 7fbd67fff640 1 -- 172.21.15.19:0/1242829165 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbd68109150 msgr2=0x7fbd6819eb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:25:29.620 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:29.616+0000 7fbd67fff640 1 --2- 172.21.15.19:0/1242829165 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbd68109150 0x7fbd6819eb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:25:29.620 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:29.616+0000 7fbd67fff640 1 -- 172.21.15.19:0/1242829165 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbd6819f2d0 con 0x7fbd681087d0 2024-09-10T22:25:29.621 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:29.616+0000 7fbd67fff640 1 --2- 172.21.15.19:0/1242829165 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbd681087d0 0x7fbd68199760 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7fbd5400d950 tx=0x7fbd5400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:25:29.621 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:29.616+0000 7fbd65ffb640 1 -- 172.21.15.19:0/1242829165 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd54017070 con 0x7fbd681087d0 2024-09-10T22:25:29.621 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:29.616+0000 7fbd6f149640 1 -- 172.21.15.19:0/1242829165 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbd6819f5c0 con 0x7fbd681087d0 2024-09-10T22:25:29.621 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:29.616+0000 7fbd65ffb640 1 -- 172.21.15.19:0/1242829165 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbd54009c30 con 0x7fbd681087d0 2024-09-10T22:25:29.621 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:29.617+0000 7fbd65ffb640 1 -- 172.21.15.19:0/1242829165 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd5400f620 con 0x7fbd681087d0 2024-09-10T22:25:29.621 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:29.617+0000 7fbd6f149640 1 -- 172.21.15.19:0/1242829165 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbd681a5e50 con 0x7fbd681087d0 2024-09-10T22:25:29.621 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:29.618+0000 7fbd6f149640 1 -- 172.21.15.19:0/1242829165 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbd681031a0 con 0x7fbd681087d0 2024-09-10T22:25:29.622 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:29.619+0000 7fbd65ffb640 1 -- 172.21.15.19:0/1242829165 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 17) ==== 153301+0+0 (secure 0 0 0) 0x7fbd54010460 con 0x7fbd681087d0 2024-09-10T22:25:29.622 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:29.620+0000 7fbd65ffb640 1 --2- 172.21.15.19:0/1242829165 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7fbd580b5370 0x7fbd580b7830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:25:29.622 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:29.620+0000 7fbd6cee5640 1 --2- 172.21.15.19:0/1242829165 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7fbd580b5370 0x7fbd580b7830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:25:29.622 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:29.620+0000 7fbd65ffb640 1 -- 172.21.15.19:0/1242829165 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8269+0+0 (secure 0 0 0) 0x7fbd540e5970 con 0x7fbd681087d0 2024-09-10T22:25:29.622 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:29.620+0000 7fbd6cee5640 1 --2- 172.21.15.19:0/1242829165 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7fbd580b5370 0x7fbd580b7830 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fbd5c00bbe0 tx=0x7fbd5c00b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:25:29.625 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:29.624+0000 7fbd65ffb640 1 -- 172.21.15.19:0/1242829165 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7fbd54009de0 con 0x7fbd681087d0 2024-09-10T22:25:29.807 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:29.805+0000 7fbd6f149640 1 -- 172.21.15.19:0/1242829165 --> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fbd68105d90 con 0x7fbd580b5370 2024-09-10T22:25:29.811 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:29.810+0000 7fbd65ffb640 1 -- 172.21.15.19:0/1242829165 <== mgr.14150 v2:172.21.15.19:6800/2119495487 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258705 (secure 0 0 0) 0x7fbd68105d90 con 0x7fbd580b5370 2024-09-10T22:25:29.813 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-10T22:25:29.814 INFO:teuthology.orchestra.run.smithi019.stderr:dumped all 2024-09-10T22:25:29.817 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:29.812+0000 7fbd6f149640 1 -- 172.21.15.19:0/1242829165 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7fbd580b5370 msgr2=0x7fbd580b7830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:25:29.817 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:29.812+0000 7fbd6f149640 1 --2- 172.21.15.19:0/1242829165 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7fbd580b5370 0x7fbd580b7830 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fbd5c00bbe0 tx=0x7fbd5c00b390 comp rx=0 tx=0).stop 2024-09-10T22:25:29.817 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:29.812+0000 7fbd6f149640 1 -- 172.21.15.19:0/1242829165 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbd681087d0 msgr2=0x7fbd68199760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:25:29.817 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:29.812+0000 7fbd6f149640 1 --2- 172.21.15.19:0/1242829165 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbd681087d0 0x7fbd68199760 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7fbd5400d950 tx=0x7fbd5400de10 comp rx=0 tx=0).stop 2024-09-10T22:25:29.817 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:29.813+0000 7fbd6f149640 1 -- 172.21.15.19:0/1242829165 shutdown_connections 2024-09-10T22:25:29.817 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:29.813+0000 7fbd6f149640 1 --2- 172.21.15.19:0/1242829165 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7fbd580b5370 0x7fbd580b7830 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:25:29.817 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:29.813+0000 7fbd6f149640 1 --2- 172.21.15.19:0/1242829165 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbd68109150 0x7fbd6819eb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:25:29.817 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:29.813+0000 7fbd6f149640 1 --2- 172.21.15.19:0/1242829165 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbd681087d0 0x7fbd68199760 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:25:29.817 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:29.813+0000 7fbd6f149640 1 --2- 172.21.15.19:0/1242829165 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fbd68102dc0 0x7fbd68199220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:25:29.817 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:29.813+0000 7fbd6f149640 1 -- 172.21.15.19:0/1242829165 >> 172.21.15.19:0/1242829165 conn(0x7fbd680fe830 msgr2=0x7fbd68100c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:25:29.817 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:29.813+0000 7fbd6f149640 1 -- 172.21.15.19:0/1242829165 shutdown_connections 2024-09-10T22:25:29.817 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:29.813+0000 7fbd6f149640 1 -- 172.21.15.19:0/1242829165 wait complete. 2024-09-10T22:25:30.110 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:25:29 smithi135 ceph-mon[34789]: from='client.15063 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-10T22:25:30.110 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:25:29 smithi135 ceph-mon[34789]: pgmap v317: 97 pgs: 97 active+clean; 639 KiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-10T22:25:30.110 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:25:29 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:25:30.110 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:25:29 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:25:30.110 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:25:29 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T22:25:30.110 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:25:29 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T22:25:30.110 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:25:29 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:25:30.125 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:25:29 smithi138 ceph-mon[35236]: from='client.15063 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-10T22:25:30.125 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:25:29 smithi138 ceph-mon[35236]: pgmap v317: 97 pgs: 97 active+clean; 639 KiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-10T22:25:30.125 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:25:29 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:25:30.125 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:25:29 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:25:30.125 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:25:29 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T22:25:30.125 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:25:29 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T22:25:30.125 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:25:29 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:25:30.136 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:25:29 smithi019 ceph-mon[31375]: from='client.15063 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-10T22:25:30.136 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:25:29 smithi019 ceph-mon[31375]: pgmap v317: 97 pgs: 97 active+clean; 639 KiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-10T22:25:30.136 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:25:29 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:25:30.136 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:25:29 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:25:30.136 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:25:29 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T22:25:30.136 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:25:29 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T22:25:30.137 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:25:29 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:25:30.492 INFO:teuthology.orchestra.run.smithi019.stdout:{"pg_ready":true,"pg_map":{"version":317,"stamp":"2024-09-10T22:25:28.378282+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":654365,"num_objects":64,"num_object_clones":0,"num_object_copies":192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":419,"num_read_kb":300,"num_write":286,"num_write_kb":2261,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":21,"num_bytes_recovered":2952512,"num_keys_recovered":10,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":231,"ondisk_log_size":231,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":377700,"kb_used_data":11724,"kb_used_omap":18,"kb_used_meta":365677,"kb_avail":1124564124,"statfs":{"total":1151940427776,"available":1151553662976,"internally_reserved":0,"allocated":12005376,"data_stored":6721215,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19142,"internal_metadata":374453562},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":60,"num_read_kb":30,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003311"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T22:25:05.517979+0000","last_change":"2024-09-10T22:24:22.139905+0000","last_active":"2024-09-10T22:25:05.517979+0000","last_peered":"2024-09-10T22:25:05.517979+0000","last_clean":"2024-09-10T22:25:05.517979+0000","last_became_active":"2024-09-10T22:24:22.139558+0000","last_became_peered":"2024-09-10T22:24:22.139558+0000","last_unstale":"2024-09-10T22:25:05.517979+0000","last_undegraded":"2024-09-10T22:25:05.517979+0000","last_fullsized":"2024-09-10T22:25:05.517979+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_clean_scrub_stamp":"2024-09-10T22:24:21.113844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:44:10.434972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T22:25:05.636515+0000","last_change":"2024-09-10T22:24:22.136722+0000","last_active":"2024-09-10T22:25:05.636515+0000","last_peered":"2024-09-10T22:25:05.636515+0000","last_clean":"2024-09-10T22:25:05.636515+0000","last_became_active":"2024-09-10T22:24:22.136080+0000","last_became_peered":"2024-09-10T22:24:22.136080+0000","last_unstale":"2024-09-10T22:25:05.636515+0000","last_undegraded":"2024-09-10T22:25:05.636515+0000","last_fullsized":"2024-09-10T22:25:05.636515+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_clean_scrub_stamp":"2024-09-10T22:24:21.113844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:52:50.562031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T22:25:05.636795+0000","last_change":"2024-09-10T22:24:22.141323+0000","last_active":"2024-09-10T22:25:05.636795+0000","last_peered":"2024-09-10T22:25:05.636795+0000","last_clean":"2024-09-10T22:25:05.636795+0000","last_became_active":"2024-09-10T22:24:22.140895+0000","last_became_peered":"2024-09-10T22:24:22.140895+0000","last_unstale":"2024-09-10T22:25:05.636795+0000","last_undegraded":"2024-09-10T22:25:05.636795+0000","last_fullsized":"2024-09-10T22:25:05.636795+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_clean_scrub_stamp":"2024-09-10T22:24:21.113844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:46:22.604672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T22:25:05.636797+0000","last_change":"2024-09-10T22:24:22.138806+0000","last_active":"2024-09-10T22:25:05.636797+0000","last_peered":"2024-09-10T22:25:05.636797+0000","last_clean":"2024-09-10T22:25:05.636797+0000","last_became_active":"2024-09-10T22:24:22.138502+0000","last_became_peered":"2024-09-10T22:24:22.138502+0000","last_unstale":"2024-09-10T22:25:05.636797+0000","last_undegraded":"2024-09-10T22:25:05.636797+0000","last_fullsized":"2024-09-10T22:25:05.636797+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_clean_scrub_stamp":"2024-09-10T22:24:21.113844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:45:01.626820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T22:25:05.519397+0000","last_change":"2024-09-10T22:24:22.141233+0000","last_active":"2024-09-10T22:25:05.519397+0000","last_peered":"2024-09-10T22:25:05.519397+0000","last_clean":"2024-09-10T22:25:05.519397+0000","last_became_active":"2024-09-10T22:24:22.140944+0000","last_became_peered":"2024-09-10T22:24:22.140944+0000","last_unstale":"2024-09-10T22:25:05.519397+0000","last_undegraded":"2024-09-10T22:25:05.519397+0000","last_fullsized":"2024-09-10T22:25:05.519397+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_clean_scrub_stamp":"2024-09-10T22:24:21.113844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:09:29.615658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T22:25:05.523201+0000","last_change":"2024-09-10T22:24:22.137990+0000","last_active":"2024-09-10T22:25:05.523201+0000","last_peered":"2024-09-10T22:25:05.523201+0000","last_clean":"2024-09-10T22:25:05.523201+0000","last_became_active":"2024-09-10T22:24:22.137685+0000","last_became_peered":"2024-09-10T22:24:22.137685+0000","last_unstale":"2024-09-10T22:25:05.523201+0000","last_undegraded":"2024-09-10T22:25:05.523201+0000","last_fullsized":"2024-09-10T22:25:05.523201+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_clean_scrub_stamp":"2024-09-10T22:24:21.113844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:32:23.891069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T22:25:05.520753+0000","last_change":"2024-09-10T22:24:22.148073+0000","last_active":"2024-09-10T22:25:05.520753+0000","last_peered":"2024-09-10T22:25:05.520753+0000","last_clean":"2024-09-10T22:25:05.520753+0000","last_became_active":"2024-09-10T22:24:22.147785+0000","last_became_peered":"2024-09-10T22:24:22.147785+0000","last_unstale":"2024-09-10T22:25:05.520753+0000","last_undegraded":"2024-09-10T22:25:05.520753+0000","last_fullsized":"2024-09-10T22:25:05.520753+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_clean_scrub_stamp":"2024-09-10T22:24:21.113844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:39:48.847949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T22:25:05.525206+0000","last_change":"2024-09-10T22:25:05.524455+0000","last_active":"2024-09-10T22:25:05.525206+0000","last_peered":"2024-09-10T22:25:05.525206+0000","last_clean":"2024-09-10T22:25:05.525206+0000","last_became_active":"2024-09-10T22:25:05.523985+0000","last_became_peered":"2024-09-10T22:25:05.523985+0000","last_unstale":"2024-09-10T22:25:05.525206+0000","last_undegraded":"2024-09-10T22:25:05.525206+0000","last_fullsized":"2024-09-10T22:25:05.525206+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_clean_scrub_stamp":"2024-09-10T22:24:21.113844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:20:33.302885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,5,10],"acting":[9,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T22:25:05.527646+0000","last_change":"2024-09-10T22:24:22.148042+0000","last_active":"2024-09-10T22:25:05.527646+0000","last_peered":"2024-09-10T22:25:05.527646+0000","last_clean":"2024-09-10T22:25:05.527646+0000","last_became_active":"2024-09-10T22:24:22.147722+0000","last_became_peered":"2024-09-10T22:24:22.147722+0000","last_unstale":"2024-09-10T22:25:05.527646+0000","last_undegraded":"2024-09-10T22:25:05.527646+0000","last_fullsized":"2024-09-10T22:25:05.527646+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_clean_scrub_stamp":"2024-09-10T22:24:21.113844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:42:42.383957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T22:25:05.521993+0000","last_change":"2024-09-10T22:24:22.138956+0000","last_active":"2024-09-10T22:25:05.521993+0000","last_peered":"2024-09-10T22:25:05.521993+0000","last_clean":"2024-09-10T22:25:05.521993+0000","last_became_active":"2024-09-10T22:24:22.138530+0000","last_became_peered":"2024-09-10T22:24:22.138530+0000","last_unstale":"2024-09-10T22:25:05.521993+0000","last_undegraded":"2024-09-10T22:25:05.521993+0000","last_fullsized":"2024-09-10T22:25:05.521993+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_clean_scrub_stamp":"2024-09-10T22:24:21.113844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:37:55.316556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T22:25:05.521015+0000","last_change":"2024-09-10T22:24:22.143435+0000","last_active":"2024-09-10T22:25:05.521015+0000","last_peered":"2024-09-10T22:25:05.521015+0000","last_clean":"2024-09-10T22:25:05.521015+0000","last_became_active":"2024-09-10T22:24:22.143100+0000","last_became_peered":"2024-09-10T22:24:22.143100+0000","last_unstale":"2024-09-10T22:25:05.521015+0000","last_undegraded":"2024-09-10T22:25:05.521015+0000","last_fullsized":"2024-09-10T22:25:05.521015+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_clean_scrub_stamp":"2024-09-10T22:24:21.113844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:24:14.344203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T22:25:05.636893+0000","last_change":"2024-09-10T22:24:22.138101+0000","last_active":"2024-09-10T22:25:05.636893+0000","last_peered":"2024-09-10T22:25:05.636893+0000","last_clean":"2024-09-10T22:25:05.636893+0000","last_became_active":"2024-09-10T22:24:22.137479+0000","last_became_peered":"2024-09-10T22:24:22.137479+0000","last_unstale":"2024-09-10T22:25:05.636893+0000","last_undegraded":"2024-09-10T22:25:05.636893+0000","last_fullsized":"2024-09-10T22:25:05.636893+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_clean_scrub_stamp":"2024-09-10T22:24:21.113844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:48:09.423136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T22:25:05.525498+0000","last_change":"2024-09-10T22:24:22.137157+0000","last_active":"2024-09-10T22:25:05.525498+0000","last_peered":"2024-09-10T22:25:05.525498+0000","last_clean":"2024-09-10T22:25:05.525498+0000","last_became_active":"2024-09-10T22:24:22.136817+0000","last_became_peered":"2024-09-10T22:24:22.136817+0000","last_unstale":"2024-09-10T22:25:05.525498+0000","last_undegraded":"2024-09-10T22:25:05.525498+0000","last_fullsized":"2024-09-10T22:25:05.525498+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_clean_scrub_stamp":"2024-09-10T22:24:21.113844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:54:32.922776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T22:25:05.636306+0000","last_change":"2024-09-10T22:24:22.138828+0000","last_active":"2024-09-10T22:25:05.636306+0000","last_peered":"2024-09-10T22:25:05.636306+0000","last_clean":"2024-09-10T22:25:05.636306+0000","last_became_active":"2024-09-10T22:24:22.138509+0000","last_became_peered":"2024-09-10T22:24:22.138509+0000","last_unstale":"2024-09-10T22:25:05.636306+0000","last_undegraded":"2024-09-10T22:25:05.636306+0000","last_fullsized":"2024-09-10T22:25:05.636306+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_clean_scrub_stamp":"2024-09-10T22:24:21.113844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:14:19.492298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T22:25:05.636106+0000","last_change":"2024-09-10T22:24:22.139317+0000","last_active":"2024-09-10T22:25:05.636106+0000","last_peered":"2024-09-10T22:25:05.636106+0000","last_clean":"2024-09-10T22:25:05.636106+0000","last_became_active":"2024-09-10T22:24:22.138949+0000","last_became_peered":"2024-09-10T22:24:22.138949+0000","last_unstale":"2024-09-10T22:25:05.636106+0000","last_undegraded":"2024-09-10T22:25:05.636106+0000","last_fullsized":"2024-09-10T22:25:05.636106+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_clean_scrub_stamp":"2024-09-10T22:24:21.113844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:34:56.412955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T22:25:05.524502+0000","last_change":"2024-09-10T22:24:22.147283+0000","last_active":"2024-09-10T22:25:05.524502+0000","last_peered":"2024-09-10T22:25:05.524502+0000","last_clean":"2024-09-10T22:25:05.524502+0000","last_became_active":"2024-09-10T22:24:22.146954+0000","last_became_peered":"2024-09-10T22:24:22.146954+0000","last_unstale":"2024-09-10T22:25:05.524502+0000","last_undegraded":"2024-09-10T22:25:05.524502+0000","last_fullsized":"2024-09-10T22:25:05.524502+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_clean_scrub_stamp":"2024-09-10T22:24:21.113844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:22:21.772747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T22:25:05.518007+0000","last_change":"2024-09-10T22:24:22.139482+0000","last_active":"2024-09-10T22:25:05.518007+0000","last_peered":"2024-09-10T22:25:05.518007+0000","last_clean":"2024-09-10T22:25:05.518007+0000","last_became_active":"2024-09-10T22:24:22.139135+0000","last_became_peered":"2024-09-10T22:24:22.139135+0000","last_unstale":"2024-09-10T22:25:05.518007+0000","last_undegraded":"2024-09-10T22:25:05.518007+0000","last_fullsized":"2024-09-10T22:25:05.518007+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_clean_scrub_stamp":"2024-09-10T22:24:21.113844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:25:31.639392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T22:25:05.517378+0000","last_change":"2024-09-10T22:24:22.142465+0000","last_active":"2024-09-10T22:25:05.517378+0000","last_peered":"2024-09-10T22:25:05.517378+0000","last_clean":"2024-09-10T22:25:05.517378+0000","last_became_active":"2024-09-10T22:24:22.142110+0000","last_became_peered":"2024-09-10T22:24:22.142110+0000","last_unstale":"2024-09-10T22:25:05.517378+0000","last_undegraded":"2024-09-10T22:25:05.517378+0000","last_fullsized":"2024-09-10T22:25:05.517378+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_clean_scrub_stamp":"2024-09-10T22:24:21.113844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:16:20.476055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T22:25:05.523411+0000","last_change":"2024-09-10T22:24:22.147942+0000","last_active":"2024-09-10T22:25:05.523411+0000","last_peered":"2024-09-10T22:25:05.523411+0000","last_clean":"2024-09-10T22:25:05.523411+0000","last_became_active":"2024-09-10T22:24:22.147637+0000","last_became_peered":"2024-09-10T22:24:22.147637+0000","last_unstale":"2024-09-10T22:25:05.523411+0000","last_undegraded":"2024-09-10T22:25:05.523411+0000","last_fullsized":"2024-09-10T22:25:05.523411+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_clean_scrub_stamp":"2024-09-10T22:24:21.113844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:46:36.831534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T22:25:05.517703+0000","last_change":"2024-09-10T22:24:22.138032+0000","last_active":"2024-09-10T22:25:05.517703+0000","last_peered":"2024-09-10T22:25:05.517703+0000","last_clean":"2024-09-10T22:25:05.517703+0000","last_became_active":"2024-09-10T22:24:22.137657+0000","last_became_peered":"2024-09-10T22:24:22.137657+0000","last_unstale":"2024-09-10T22:25:05.517703+0000","last_undegraded":"2024-09-10T22:25:05.517703+0000","last_fullsized":"2024-09-10T22:25:05.517703+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_clean_scrub_stamp":"2024-09-10T22:24:21.113844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:06:51.479298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T22:25:05.525119+0000","last_change":"2024-09-10T22:24:22.141106+0000","last_active":"2024-09-10T22:25:05.525119+0000","last_peered":"2024-09-10T22:25:05.525119+0000","last_clean":"2024-09-10T22:25:05.525119+0000","last_became_active":"2024-09-10T22:24:22.140780+0000","last_became_peered":"2024-09-10T22:24:22.140780+0000","last_unstale":"2024-09-10T22:25:05.525119+0000","last_undegraded":"2024-09-10T22:25:05.525119+0000","last_fullsized":"2024-09-10T22:25:05.525119+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_clean_scrub_stamp":"2024-09-10T22:24:21.113844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:25:21.302463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T22:25:05.525644+0000","last_change":"2024-09-10T22:24:22.146772+0000","last_active":"2024-09-10T22:25:05.525644+0000","last_peered":"2024-09-10T22:25:05.525644+0000","last_clean":"2024-09-10T22:25:05.525644+0000","last_became_active":"2024-09-10T22:24:22.146317+0000","last_became_peered":"2024-09-10T22:24:22.146317+0000","last_unstale":"2024-09-10T22:25:05.525644+0000","last_undegraded":"2024-09-10T22:25:05.525644+0000","last_fullsized":"2024-09-10T22:25:05.525644+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_clean_scrub_stamp":"2024-09-10T22:24:21.113844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:13:55.706482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T22:25:05.636747+0000","last_change":"2024-09-10T22:24:22.139791+0000","last_active":"2024-09-10T22:25:05.636747+0000","last_peered":"2024-09-10T22:25:05.636747+0000","last_clean":"2024-09-10T22:25:05.636747+0000","last_became_active":"2024-09-10T22:24:22.139491+0000","last_became_peered":"2024-09-10T22:24:22.139491+0000","last_unstale":"2024-09-10T22:25:05.636747+0000","last_undegraded":"2024-09-10T22:25:05.636747+0000","last_fullsized":"2024-09-10T22:25:05.636747+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_clean_scrub_stamp":"2024-09-10T22:24:21.113844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:18:29.412412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T22:25:05.522054+0000","last_change":"2024-09-10T22:24:22.143383+0000","last_active":"2024-09-10T22:25:05.522054+0000","last_peered":"2024-09-10T22:25:05.522054+0000","last_clean":"2024-09-10T22:25:05.522054+0000","last_became_active":"2024-09-10T22:24:22.143045+0000","last_became_peered":"2024-09-10T22:24:22.143045+0000","last_unstale":"2024-09-10T22:25:05.522054+0000","last_undegraded":"2024-09-10T22:25:05.522054+0000","last_fullsized":"2024-09-10T22:25:05.522054+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_clean_scrub_stamp":"2024-09-10T22:24:21.113844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:37:10.135448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T22:25:05.636397+0000","last_change":"2024-09-10T22:24:22.141851+0000","last_active":"2024-09-10T22:25:05.636397+0000","last_peered":"2024-09-10T22:25:05.636397+0000","last_clean":"2024-09-10T22:25:05.636397+0000","last_became_active":"2024-09-10T22:24:22.141469+0000","last_became_peered":"2024-09-10T22:24:22.141469+0000","last_unstale":"2024-09-10T22:25:05.636397+0000","last_undegraded":"2024-09-10T22:25:05.636397+0000","last_fullsized":"2024-09-10T22:25:05.636397+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_clean_scrub_stamp":"2024-09-10T22:24:21.113844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:03:59.805704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T22:25:05.523045+0000","last_change":"2024-09-10T22:24:22.139821+0000","last_active":"2024-09-10T22:25:05.523045+0000","last_peered":"2024-09-10T22:25:05.523045+0000","last_clean":"2024-09-10T22:25:05.523045+0000","last_became_active":"2024-09-10T22:24:22.139398+0000","last_became_peered":"2024-09-10T22:24:22.139398+0000","last_unstale":"2024-09-10T22:25:05.523045+0000","last_undegraded":"2024-09-10T22:25:05.523045+0000","last_fullsized":"2024-09-10T22:25:05.523045+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_clean_scrub_stamp":"2024-09-10T22:24:21.113844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:18:22.160919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T22:25:05.517798+0000","last_change":"2024-09-10T22:24:22.141219+0000","last_active":"2024-09-10T22:25:05.517798+0000","last_peered":"2024-09-10T22:25:05.517798+0000","last_clean":"2024-09-10T22:25:05.517798+0000","last_became_active":"2024-09-10T22:24:22.140900+0000","last_became_peered":"2024-09-10T22:24:22.140900+0000","last_unstale":"2024-09-10T22:25:05.517798+0000","last_undegraded":"2024-09-10T22:25:05.517798+0000","last_fullsized":"2024-09-10T22:25:05.517798+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_clean_scrub_stamp":"2024-09-10T22:24:21.113844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:27:59.115533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T22:25:05.524856+0000","last_change":"2024-09-10T22:24:22.139738+0000","last_active":"2024-09-10T22:25:05.524856+0000","last_peered":"2024-09-10T22:25:05.524856+0000","last_clean":"2024-09-10T22:25:05.524856+0000","last_became_active":"2024-09-10T22:24:22.139096+0000","last_became_peered":"2024-09-10T22:24:22.139096+0000","last_unstale":"2024-09-10T22:25:05.524856+0000","last_undegraded":"2024-09-10T22:25:05.524856+0000","last_fullsized":"2024-09-10T22:25:05.524856+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_clean_scrub_stamp":"2024-09-10T22:24:21.113844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:16:39.110610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T22:25:05.636592+0000","last_change":"2024-09-10T22:24:22.144896+0000","last_active":"2024-09-10T22:25:05.636592+0000","last_peered":"2024-09-10T22:25:05.636592+0000","last_clean":"2024-09-10T22:25:05.636592+0000","last_became_active":"2024-09-10T22:24:22.144622+0000","last_became_peered":"2024-09-10T22:24:22.144622+0000","last_unstale":"2024-09-10T22:25:05.636592+0000","last_undegraded":"2024-09-10T22:25:05.636592+0000","last_fullsized":"2024-09-10T22:25:05.636592+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_clean_scrub_stamp":"2024-09-10T22:24:21.113844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:32:44.648993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T22:25:05.522332+0000","last_change":"2024-09-10T22:24:22.148082+0000","last_active":"2024-09-10T22:25:05.522332+0000","last_peered":"2024-09-10T22:25:05.522332+0000","last_clean":"2024-09-10T22:25:05.522332+0000","last_became_active":"2024-09-10T22:24:22.147664+0000","last_became_peered":"2024-09-10T22:24:22.147664+0000","last_unstale":"2024-09-10T22:25:05.522332+0000","last_undegraded":"2024-09-10T22:25:05.522332+0000","last_fullsized":"2024-09-10T22:25:05.522332+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_clean_scrub_stamp":"2024-09-10T22:24:21.113844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:12:40.154756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":25,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T22:25:05.638449+0000","last_change":"2024-09-10T22:25:05.638351+0000","last_active":"2024-09-10T22:25:05.638449+0000","last_peered":"2024-09-10T22:25:05.638449+0000","last_clean":"2024-09-10T22:25:05.638449+0000","last_became_active":"2024-09-10T22:25:05.637523+0000","last_became_peered":"2024-09-10T22:25:05.637523+0000","last_unstale":"2024-09-10T22:25:05.638449+0000","last_undegraded":"2024-09-10T22:25:05.638449+0000","last_fullsized":"2024-09-10T22:25:05.638449+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_clean_scrub_stamp":"2024-09-10T22:24:21.113844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:09:37.231420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,9,4],"acting":[2,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T22:25:05.517607+0000","last_change":"2024-09-10T22:24:22.141534+0000","last_active":"2024-09-10T22:25:05.517607+0000","last_peered":"2024-09-10T22:25:05.517607+0000","last_clean":"2024-09-10T22:25:05.517607+0000","last_became_active":"2024-09-10T22:24:22.141243+0000","last_became_peered":"2024-09-10T22:24:22.141243+0000","last_unstale":"2024-09-10T22:25:05.517607+0000","last_undegraded":"2024-09-10T22:25:05.517607+0000","last_fullsized":"2024-09-10T22:25:05.517607+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_clean_scrub_stamp":"2024-09-10T22:24:21.113844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:26:23.559943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T22:25:05.519259+0000","last_change":"2024-09-10T22:24:22.144951+0000","last_active":"2024-09-10T22:25:05.519259+0000","last_peered":"2024-09-10T22:25:05.519259+0000","last_clean":"2024-09-10T22:25:05.519259+0000","last_became_active":"2024-09-10T22:24:22.144634+0000","last_became_peered":"2024-09-10T22:24:22.144634+0000","last_unstale":"2024-09-10T22:25:05.519259+0000","last_undegraded":"2024-09-10T22:25:05.519259+0000","last_fullsized":"2024-09-10T22:25:05.519259+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_clean_scrub_stamp":"2024-09-10T22:24:21.113844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:04:19.350081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"73'5","reported_seq":83,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T22:25:23.553398+0000","last_change":"2024-09-10T22:24:20.128083+0000","last_active":"2024-09-10T22:25:23.553398+0000","last_peered":"2024-09-10T22:25:23.553398+0000","last_clean":"2024-09-10T22:25:23.553398+0000","last_became_active":"2024-09-10T22:24:20.127676+0000","last_became_peered":"2024-09-10T22:24:20.127676+0000","last_unstale":"2024-09-10T22:25:23.553398+0000","last_undegraded":"2024-09-10T22:25:23.553398+0000","last_fullsized":"2024-09-10T22:25:23.553398+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:19.099039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:19.099039+0000","last_clean_scrub_stamp":"2024-09-10T22:24:19.099039+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:37:51.745817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":55,"num_read_kb":2,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":25,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T22:25:05.638403+0000","last_change":"2024-09-10T22:25:05.638296+0000","last_active":"2024-09-10T22:25:05.638403+0000","last_peered":"2024-09-10T22:25:05.638403+0000","last_clean":"2024-09-10T22:25:05.638403+0000","last_became_active":"2024-09-10T22:25:05.637649+0000","last_became_peered":"2024-09-10T22:25:05.637649+0000","last_unstale":"2024-09-10T22:25:05.638403+0000","last_undegraded":"2024-09-10T22:25:05.638403+0000","last_fullsized":"2024-09-10T22:25:05.638403+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_clean_scrub_stamp":"2024-09-10T22:24:21.113844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:07:42.674144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3],"acting":[5,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"73'3","reported_seq":37,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T22:25:05.532624+0000","last_change":"2024-09-10T22:25:05.532533+0000","last_active":"2024-09-10T22:25:05.532624+0000","last_peered":"2024-09-10T22:25:05.532624+0000","last_clean":"2024-09-10T22:25:05.532624+0000","last_became_active":"2024-09-10T22:25:05.526228+0000","last_became_peered":"2024-09-10T22:25:05.526228+0000","last_unstale":"2024-09-10T22:25:05.532624+0000","last_undegraded":"2024-09-10T22:25:05.532624+0000","last_fullsized":"2024-09-10T22:25:05.532624+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:19.099039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:19.099039+0000","last_clean_scrub_stamp":"2024-09-10T22:24:19.099039+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:53:36.903083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,6],"acting":[10,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"73'2","reported_seq":25,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T22:25:05.524519+0000","last_change":"2024-09-10T22:24:20.122635+0000","last_active":"2024-09-10T22:25:05.524519+0000","last_peered":"2024-09-10T22:25:05.524519+0000","last_clean":"2024-09-10T22:25:05.524519+0000","last_became_active":"2024-09-10T22:24:20.122289+0000","last_became_peered":"2024-09-10T22:24:20.122289+0000","last_unstale":"2024-09-10T22:25:05.524519+0000","last_undegraded":"2024-09-10T22:25:05.524519+0000","last_fullsized":"2024-09-10T22:25:05.524519+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:19.099039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:19.099039+0000","last_clean_scrub_stamp":"2024-09-10T22:24:19.099039+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:30:40.779513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T22:25:05.636342+0000","last_change":"2024-09-10T22:24:22.137417+0000","last_active":"2024-09-10T22:25:05.636342+0000","last_peered":"2024-09-10T22:25:05.636342+0000","last_clean":"2024-09-10T22:25:05.636342+0000","last_became_active":"2024-09-10T22:24:22.136913+0000","last_became_peered":"2024-09-10T22:24:22.136913+0000","last_unstale":"2024-09-10T22:25:05.636342+0000","last_undegraded":"2024-09-10T22:25:05.636342+0000","last_fullsized":"2024-09-10T22:25:05.636342+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_clean_scrub_stamp":"2024-09-10T22:24:21.113844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:23:39.551056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"73'1","reported_seq":24,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T22:25:05.522414+0000","last_change":"2024-09-10T22:24:20.128416+0000","last_active":"2024-09-10T22:25:05.522414+0000","last_peered":"2024-09-10T22:25:05.522414+0000","last_clean":"2024-09-10T22:25:05.522414+0000","last_became_active":"2024-09-10T22:24:20.127998+0000","last_became_peered":"2024-09-10T22:24:20.127998+0000","last_unstale":"2024-09-10T22:25:05.522414+0000","last_undegraded":"2024-09-10T22:25:05.522414+0000","last_fullsized":"2024-09-10T22:25:05.522414+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:19.099039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:19.099039+0000","last_clean_scrub_stamp":"2024-09-10T22:24:19.099039+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:44:39.871564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T22:25:05.517035+0000","last_change":"2024-09-10T22:24:22.136355+0000","last_active":"2024-09-10T22:25:05.517035+0000","last_peered":"2024-09-10T22:25:05.517035+0000","last_clean":"2024-09-10T22:25:05.517035+0000","last_became_active":"2024-09-10T22:24:22.136047+0000","last_became_peered":"2024-09-10T22:24:22.136047+0000","last_unstale":"2024-09-10T22:25:05.517035+0000","last_undegraded":"2024-09-10T22:25:05.517035+0000","last_fullsized":"2024-09-10T22:25:05.517035+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_clean_scrub_stamp":"2024-09-10T22:24:21.113844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:56:14.739365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"73'3","reported_seq":92,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T22:25:23.552760+0000","last_change":"2024-09-10T22:25:05.537891+0000","last_active":"2024-09-10T22:25:23.552760+0000","last_peered":"2024-09-10T22:25:23.552760+0000","last_clean":"2024-09-10T22:25:23.552760+0000","last_became_active":"2024-09-10T22:25:05.526085+0000","last_became_peered":"2024-09-10T22:25:05.526085+0000","last_unstale":"2024-09-10T22:25:23.552760+0000","last_undegraded":"2024-09-10T22:25:23.552760+0000","last_fullsized":"2024-09-10T22:25:23.552760+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:19.099039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:19.099039+0000","last_clean_scrub_stamp":"2024-09-10T22:24:19.099039+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:57:02.158783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":48,"num_read_kb":48,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":90,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,9],"acting":[10,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T22:25:05.526673+0000","last_change":"2024-09-10T22:24:22.143321+0000","last_active":"2024-09-10T22:25:05.526673+0000","last_peered":"2024-09-10T22:25:05.526673+0000","last_clean":"2024-09-10T22:25:05.526673+0000","last_became_active":"2024-09-10T22:24:22.143036+0000","last_became_peered":"2024-09-10T22:24:22.143036+0000","last_unstale":"2024-09-10T22:25:05.526673+0000","last_undegraded":"2024-09-10T22:25:05.526673+0000","last_fullsized":"2024-09-10T22:25:05.526673+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_clean_scrub_stamp":"2024-09-10T22:24:21.113844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:51:42.473300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"73'2","reported_seq":36,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T22:25:05.534768+0000","last_change":"2024-09-10T22:25:05.534611+0000","last_active":"2024-09-10T22:25:05.534768+0000","last_peered":"2024-09-10T22:25:05.534768+0000","last_clean":"2024-09-10T22:25:05.534768+0000","last_became_active":"2024-09-10T22:25:05.526934+0000","last_became_peered":"2024-09-10T22:25:05.526934+0000","last_unstale":"2024-09-10T22:25:05.534768+0000","last_undegraded":"2024-09-10T22:25:05.534768+0000","last_fullsized":"2024-09-10T22:25:05.534768+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:19.099039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:19.099039+0000","last_clean_scrub_stamp":"2024-09-10T22:24:19.099039+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:39:20.317571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T22:25:05.636959+0000","last_change":"2024-09-10T22:24:22.144830+0000","last_active":"2024-09-10T22:25:05.636959+0000","last_peered":"2024-09-10T22:25:05.636959+0000","last_clean":"2024-09-10T22:25:05.636959+0000","last_became_active":"2024-09-10T22:24:22.144358+0000","last_became_peered":"2024-09-10T22:24:22.144358+0000","last_unstale":"2024-09-10T22:25:05.636959+0000","last_undegraded":"2024-09-10T22:25:05.636959+0000","last_fullsized":"2024-09-10T22:25:05.636959+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_clean_scrub_stamp":"2024-09-10T22:24:21.113844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:28:14.398474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"73'4","reported_seq":28,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T22:25:05.523011+0000","last_change":"2024-09-10T22:24:20.383555+0000","last_active":"2024-09-10T22:25:05.523011+0000","last_peered":"2024-09-10T22:25:05.523011+0000","last_clean":"2024-09-10T22:25:05.523011+0000","last_became_active":"2024-09-10T22:24:20.383163+0000","last_became_peered":"2024-09-10T22:24:20.383163+0000","last_unstale":"2024-09-10T22:25:05.523011+0000","last_undegraded":"2024-09-10T22:25:05.523011+0000","last_fullsized":"2024-09-10T22:25:05.523011+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:19.099039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:19.099039+0000","last_clean_scrub_stamp":"2024-09-10T22:24:19.099039+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:14:03.052220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T22:25:05.525324+0000","last_change":"2024-09-10T22:24:22.144562+0000","last_active":"2024-09-10T22:25:05.525324+0000","last_peered":"2024-09-10T22:25:05.525324+0000","last_clean":"2024-09-10T22:25:05.525324+0000","last_became_active":"2024-09-10T22:24:22.144146+0000","last_became_peered":"2024-09-10T22:24:22.144146+0000","last_unstale":"2024-09-10T22:25:05.525324+0000","last_undegraded":"2024-09-10T22:25:05.525324+0000","last_fullsized":"2024-09-10T22:25:05.525324+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_clean_scrub_stamp":"2024-09-10T22:24:21.113844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:57:36.070289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"73'28","reported_seq":168,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T22:25:25.298152+0000","last_change":"2024-09-10T22:24:20.126245+0000","last_active":"2024-09-10T22:25:25.298152+0000","last_peered":"2024-09-10T22:25:25.298152+0000","last_clean":"2024-09-10T22:25:25.298152+0000","last_became_active":"2024-09-10T22:24:20.125839+0000","last_became_peered":"2024-09-10T22:24:20.125839+0000","last_unstale":"2024-09-10T22:25:25.298152+0000","last_undegraded":"2024-09-10T22:25:25.298152+0000","last_fullsized":"2024-09-10T22:25:25.298152+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:19.099039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:19.099039+0000","last_clean_scrub_stamp":"2024-09-10T22:24:19.099039+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:45:05.155436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":59762,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":117,"num_read_kb":116,"num_write":29,"num_write_kb":69,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T22:25:05.519956+0000","last_change":"2024-09-10T22:24:22.142178+0000","last_active":"2024-09-10T22:25:05.519956+0000","last_peered":"2024-09-10T22:25:05.519956+0000","last_clean":"2024-09-10T22:25:05.519956+0000","last_became_active":"2024-09-10T22:24:22.141883+0000","last_became_peered":"2024-09-10T22:24:22.141883+0000","last_unstale":"2024-09-10T22:25:05.519956+0000","last_undegraded":"2024-09-10T22:25:05.519956+0000","last_fullsized":"2024-09-10T22:25:05.519956+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_clean_scrub_stamp":"2024-09-10T22:24:21.113844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:24:50.996273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"73'6","reported_seq":30,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T22:25:05.522352+0000","last_change":"2024-09-10T22:24:20.126129+0000","last_active":"2024-09-10T22:25:05.522352+0000","last_peered":"2024-09-10T22:25:05.522352+0000","last_clean":"2024-09-10T22:25:05.522352+0000","last_became_active":"2024-09-10T22:24:20.125749+0000","last_became_peered":"2024-09-10T22:24:20.125749+0000","last_unstale":"2024-09-10T22:25:05.522352+0000","last_undegraded":"2024-09-10T22:25:05.522352+0000","last_fullsized":"2024-09-10T22:25:05.522352+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:19.099039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:19.099039+0000","last_clean_scrub_stamp":"2024-09-10T22:24:19.099039+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:58:35.224036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T22:25:05.524400+0000","last_change":"2024-09-10T22:24:22.143964+0000","last_active":"2024-09-10T22:25:05.524400+0000","last_peered":"2024-09-10T22:25:05.524400+0000","last_clean":"2024-09-10T22:25:05.524400+0000","last_became_active":"2024-09-10T22:24:22.143589+0000","last_became_peered":"2024-09-10T22:24:22.143589+0000","last_unstale":"2024-09-10T22:25:05.524400+0000","last_undegraded":"2024-09-10T22:25:05.524400+0000","last_fullsized":"2024-09-10T22:25:05.524400+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_clean_scrub_stamp":"2024-09-10T22:24:21.113844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:41:41.737627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"73'3","reported_seq":26,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T22:25:05.522689+0000","last_change":"2024-09-10T22:24:20.128012+0000","last_active":"2024-09-10T22:25:05.522689+0000","last_peered":"2024-09-10T22:25:05.522689+0000","last_clean":"2024-09-10T22:25:05.522689+0000","last_became_active":"2024-09-10T22:24:20.127335+0000","last_became_peered":"2024-09-10T22:24:20.127335+0000","last_unstale":"2024-09-10T22:25:05.522689+0000","last_undegraded":"2024-09-10T22:25:05.522689+0000","last_fullsized":"2024-09-10T22:25:05.522689+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:19.099039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:19.099039+0000","last_clean_scrub_stamp":"2024-09-10T22:24:19.099039+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:20:27.017032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":25,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T22:25:05.526480+0000","last_change":"2024-09-10T22:25:05.526382+0000","last_active":"2024-09-10T22:25:05.526480+0000","last_peered":"2024-09-10T22:25:05.526480+0000","last_clean":"2024-09-10T22:25:05.526480+0000","last_became_active":"2024-09-10T22:25:05.526037+0000","last_became_peered":"2024-09-10T22:25:05.526037+0000","last_unstale":"2024-09-10T22:25:05.526480+0000","last_undegraded":"2024-09-10T22:25:05.526480+0000","last_fullsized":"2024-09-10T22:25:05.526480+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_clean_scrub_stamp":"2024-09-10T22:24:21.113844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:15:12.891318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,6],"acting":[7,9,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"73'4","reported_seq":83,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T22:25:23.306691+0000","last_change":"2024-09-10T22:24:20.124069+0000","last_active":"2024-09-10T22:25:23.306691+0000","last_peered":"2024-09-10T22:25:23.306691+0000","last_clean":"2024-09-10T22:25:23.306691+0000","last_became_active":"2024-09-10T22:24:20.123675+0000","last_became_peered":"2024-09-10T22:24:20.123675+0000","last_unstale":"2024-09-10T22:25:23.306691+0000","last_undegraded":"2024-09-10T22:25:23.306691+0000","last_fullsized":"2024-09-10T22:25:23.306691+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:19.099039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:19.099039+0000","last_clean_scrub_stamp":"2024-09-10T22:24:19.099039+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:32:50.287012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":979,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":57,"num_read_kb":4,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T22:25:05.522302+0000","last_change":"2024-09-10T22:24:22.146870+0000","last_active":"2024-09-10T22:25:05.522302+0000","last_peered":"2024-09-10T22:25:05.522302+0000","last_clean":"2024-09-10T22:25:05.522302+0000","last_became_active":"2024-09-10T22:24:22.146615+0000","last_became_peered":"2024-09-10T22:24:22.146615+0000","last_unstale":"2024-09-10T22:25:05.522302+0000","last_undegraded":"2024-09-10T22:25:05.522302+0000","last_fullsized":"2024-09-10T22:25:05.522302+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_clean_scrub_stamp":"2024-09-10T22:24:21.113844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:00:05.579248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"73'15","reported_seq":39,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T22:25:05.519217+0000","last_change":"2024-09-10T22:24:20.383675+0000","last_active":"2024-09-10T22:25:05.519217+0000","last_peered":"2024-09-10T22:25:05.519217+0000","last_clean":"2024-09-10T22:25:05.519217+0000","last_became_active":"2024-09-10T22:24:20.383317+0000","last_became_peered":"2024-09-10T22:24:20.383317+0000","last_unstale":"2024-09-10T22:25:05.519217+0000","last_undegraded":"2024-09-10T22:25:05.519217+0000","last_fullsized":"2024-09-10T22:25:05.519217+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:19.099039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:19.099039+0000","last_clean_scrub_stamp":"2024-09-10T22:24:19.099039+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:43:24.989851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T22:25:05.522054+0000","last_change":"2024-09-10T22:24:22.144872+0000","last_active":"2024-09-10T22:25:05.522054+0000","last_peered":"2024-09-10T22:25:05.522054+0000","last_clean":"2024-09-10T22:25:05.522054+0000","last_became_active":"2024-09-10T22:24:22.144570+0000","last_became_peered":"2024-09-10T22:24:22.144570+0000","last_unstale":"2024-09-10T22:25:05.522054+0000","last_undegraded":"2024-09-10T22:25:05.522054+0000","last_fullsized":"2024-09-10T22:25:05.522054+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_clean_scrub_stamp":"2024-09-10T22:24:21.113844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:20:17.937544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"73'2","reported_seq":26,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T22:25:05.520112+0000","last_change":"2024-09-10T22:24:20.125849+0000","last_active":"2024-09-10T22:25:05.520112+0000","last_peered":"2024-09-10T22:25:05.520112+0000","last_clean":"2024-09-10T22:25:05.520112+0000","last_became_active":"2024-09-10T22:24:20.125042+0000","last_became_peered":"2024-09-10T22:24:20.125042+0000","last_unstale":"2024-09-10T22:25:05.520112+0000","last_undegraded":"2024-09-10T22:25:05.520112+0000","last_fullsized":"2024-09-10T22:25:05.520112+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:19.099039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:19.099039+0000","last_clean_scrub_stamp":"2024-09-10T22:24:19.099039+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:36:28.249115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T22:25:05.518400+0000","last_change":"2024-09-10T22:24:22.141232+0000","last_active":"2024-09-10T22:25:05.518400+0000","last_peered":"2024-09-10T22:25:05.518400+0000","last_clean":"2024-09-10T22:25:05.518400+0000","last_became_active":"2024-09-10T22:24:22.140903+0000","last_became_peered":"2024-09-10T22:24:22.140903+0000","last_unstale":"2024-09-10T22:25:05.518400+0000","last_undegraded":"2024-09-10T22:25:05.518400+0000","last_fullsized":"2024-09-10T22:25:05.518400+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_clean_scrub_stamp":"2024-09-10T22:24:21.113844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:15:11.627126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"73'2","reported_seq":25,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T22:25:05.525583+0000","last_change":"2024-09-10T22:24:20.122829+0000","last_active":"2024-09-10T22:25:05.525583+0000","last_peered":"2024-09-10T22:25:05.525583+0000","last_clean":"2024-09-10T22:25:05.525583+0000","last_became_active":"2024-09-10T22:24:20.122545+0000","last_became_peered":"2024-09-10T22:24:20.122545+0000","last_unstale":"2024-09-10T22:25:05.525583+0000","last_undegraded":"2024-09-10T22:25:05.525583+0000","last_fullsized":"2024-09-10T22:25:05.525583+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:19.099039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:19.099039+0000","last_clean_scrub_stamp":"2024-09-10T22:24:19.099039+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:18:27.758029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T22:25:05.521480+0000","last_change":"2024-09-10T22:24:22.139725+0000","last_active":"2024-09-10T22:25:05.521480+0000","last_peered":"2024-09-10T22:25:05.521480+0000","last_clean":"2024-09-10T22:25:05.521480+0000","last_became_active":"2024-09-10T22:24:22.139293+0000","last_became_peered":"2024-09-10T22:24:22.139293+0000","last_unstale":"2024-09-10T22:25:05.521480+0000","last_undegraded":"2024-09-10T22:25:05.521480+0000","last_fullsized":"2024-09-10T22:25:05.521480+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_clean_scrub_stamp":"2024-09-10T22:24:21.113844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:43:14.424880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"73'1","reported_seq":25,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T22:25:05.522177+0000","last_change":"2024-09-10T22:24:20.125371+0000","last_active":"2024-09-10T22:25:05.522177+0000","last_peered":"2024-09-10T22:25:05.522177+0000","last_clean":"2024-09-10T22:25:05.522177+0000","last_became_active":"2024-09-10T22:24:20.125033+0000","last_became_peered":"2024-09-10T22:24:20.125033+0000","last_unstale":"2024-09-10T22:25:05.522177+0000","last_undegraded":"2024-09-10T22:25:05.522177+0000","last_fullsized":"2024-09-10T22:25:05.522177+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:19.099039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:19.099039+0000","last_clean_scrub_stamp":"2024-09-10T22:24:19.099039+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:22:22.751778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"73'1","reported_seq":19,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T22:25:05.520858+0000","last_change":"2024-09-10T22:24:22.149522+0000","last_active":"2024-09-10T22:25:05.520858+0000","last_peered":"2024-09-10T22:25:05.520858+0000","last_clean":"2024-09-10T22:25:05.520858+0000","last_became_active":"2024-09-10T22:24:22.148710+0000","last_became_peered":"2024-09-10T22:24:22.148710+0000","last_unstale":"2024-09-10T22:25:05.520858+0000","last_undegraded":"2024-09-10T22:25:05.520858+0000","last_fullsized":"2024-09-10T22:25:05.520858+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_clean_scrub_stamp":"2024-09-10T22:24:21.113844+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:44:32.020949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"73'3","reported_seq":27,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T22:25:05.522717+0000","last_change":"2024-09-10T22:24:20.406792+0000","last_active":"2024-09-10T22:25:05.522717+0000","last_peered":"2024-09-10T22:25:05.522717+0000","last_clean":"2024-09-10T22:25:05.522717+0000","last_became_active":"2024-09-10T22:24:20.406437+0000","last_became_peered":"2024-09-10T22:24:20.406437+0000","last_unstale":"2024-09-10T22:25:05.522717+0000","last_undegraded":"2024-09-10T22:25:05.522717+0000","last_fullsized":"2024-09-10T22:25:05.522717+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:19.099039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:19.099039+0000","last_clean_scrub_stamp":"2024-09-10T22:24:19.099039+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:00:16.436165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T22:25:05.521064+0000","last_change":"2024-09-10T22:24:22.142335+0000","last_active":"2024-09-10T22:25:05.521064+0000","last_peered":"2024-09-10T22:25:05.521064+0000","last_clean":"2024-09-10T22:25:05.521064+0000","last_became_active":"2024-09-10T22:24:22.142001+0000","last_became_peered":"2024-09-10T22:24:22.142001+0000","last_unstale":"2024-09-10T22:25:05.521064+0000","last_undegraded":"2024-09-10T22:25:05.521064+0000","last_fullsized":"2024-09-10T22:25:05.521064+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_clean_scrub_stamp":"2024-09-10T22:24:21.113844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:46:20.043915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"19'92","reported_seq":95,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T22:25:05.522482+0000","last_change":"2024-09-10T22:23:11.163678+0000","last_active":"2024-09-10T22:25:05.522482+0000","last_peered":"2024-09-10T22:25:05.522482+0000","last_clean":"2024-09-10T22:25:05.522482+0000","last_became_active":"2024-09-10T22:23:11.158387+0000","last_became_peered":"2024-09-10T22:23:11.158387+0000","last_unstale":"2024-09-10T22:25:05.522482+0000","last_undegraded":"2024-09-10T22:25:05.522482+0000","last_fullsized":"2024-09-10T22:25:05.522482+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:19:50.906986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:19:50.906986+0000","last_clean_scrub_stamp":"2024-09-10T22:19:50.906986+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:11:31.570355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"73'3","reported_seq":28,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T22:25:05.636850+0000","last_change":"2024-09-10T22:24:20.123048+0000","last_active":"2024-09-10T22:25:05.636850+0000","last_peered":"2024-09-10T22:25:05.636850+0000","last_clean":"2024-09-10T22:25:05.636850+0000","last_became_active":"2024-09-10T22:24:20.121906+0000","last_became_peered":"2024-09-10T22:24:20.121906+0000","last_unstale":"2024-09-10T22:25:05.636850+0000","last_undegraded":"2024-09-10T22:25:05.636850+0000","last_fullsized":"2024-09-10T22:25:05.636850+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:19.099039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:19.099039+0000","last_clean_scrub_stamp":"2024-09-10T22:24:19.099039+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:11:00.293820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T22:25:05.636560+0000","last_change":"2024-09-10T22:24:22.146378+0000","last_active":"2024-09-10T22:25:05.636560+0000","last_peered":"2024-09-10T22:25:05.636560+0000","last_clean":"2024-09-10T22:25:05.636560+0000","last_became_active":"2024-09-10T22:24:22.145841+0000","last_became_peered":"2024-09-10T22:24:22.145841+0000","last_unstale":"2024-09-10T22:25:05.636560+0000","last_undegraded":"2024-09-10T22:25:05.636560+0000","last_fullsized":"2024-09-10T22:25:05.636560+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_clean_scrub_stamp":"2024-09-10T22:24:21.113844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:20:31.785243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"73'3","reported_seq":37,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T22:25:05.640772+0000","last_change":"2024-09-10T22:25:05.640672+0000","last_active":"2024-09-10T22:25:05.640772+0000","last_peered":"2024-09-10T22:25:05.640772+0000","last_clean":"2024-09-10T22:25:05.640772+0000","last_became_active":"2024-09-10T22:25:05.637774+0000","last_became_peered":"2024-09-10T22:25:05.637774+0000","last_unstale":"2024-09-10T22:25:05.640772+0000","last_undegraded":"2024-09-10T22:25:05.640772+0000","last_fullsized":"2024-09-10T22:25:05.640772+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:19.099039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:19.099039+0000","last_clean_scrub_stamp":"2024-09-10T22:24:19.099039+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:33:20.970862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,4],"acting":[7,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T22:25:05.524419+0000","last_change":"2024-09-10T22:24:22.139850+0000","last_active":"2024-09-10T22:25:05.524419+0000","last_peered":"2024-09-10T22:25:05.524419+0000","last_clean":"2024-09-10T22:25:05.524419+0000","last_became_active":"2024-09-10T22:24:22.137885+0000","last_became_peered":"2024-09-10T22:24:22.137885+0000","last_unstale":"2024-09-10T22:25:05.524419+0000","last_undegraded":"2024-09-10T22:25:05.524419+0000","last_fullsized":"2024-09-10T22:25:05.524419+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_clean_scrub_stamp":"2024-09-10T22:24:21.113844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:52:55.988247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"73'4","reported_seq":80,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T22:25:23.306240+0000","last_change":"2024-09-10T22:24:20.383650+0000","last_active":"2024-09-10T22:25:23.306240+0000","last_peered":"2024-09-10T22:25:23.306240+0000","last_clean":"2024-09-10T22:25:23.306240+0000","last_became_active":"2024-09-10T22:24:20.383286+0000","last_became_peered":"2024-09-10T22:24:20.383286+0000","last_unstale":"2024-09-10T22:25:23.306240+0000","last_undegraded":"2024-09-10T22:25:23.306240+0000","last_fullsized":"2024-09-10T22:25:23.306240+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:19.099039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:19.099039+0000","last_clean_scrub_stamp":"2024-09-10T22:24:19.099039+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:38:04.467105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":53,"num_read_kb":53,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T22:25:05.522170+0000","last_change":"2024-09-10T22:24:22.141717+0000","last_active":"2024-09-10T22:25:05.522170+0000","last_peered":"2024-09-10T22:25:05.522170+0000","last_clean":"2024-09-10T22:25:05.522170+0000","last_became_active":"2024-09-10T22:24:22.141426+0000","last_became_peered":"2024-09-10T22:24:22.141426+0000","last_unstale":"2024-09-10T22:25:05.522170+0000","last_undegraded":"2024-09-10T22:25:05.522170+0000","last_fullsized":"2024-09-10T22:25:05.522170+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_clean_scrub_stamp":"2024-09-10T22:24:21.113844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:13:58.341345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"73'1","reported_seq":24,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T22:25:05.521671+0000","last_change":"2024-09-10T22:24:20.127658+0000","last_active":"2024-09-10T22:25:05.521671+0000","last_peered":"2024-09-10T22:25:05.521671+0000","last_clean":"2024-09-10T22:25:05.521671+0000","last_became_active":"2024-09-10T22:24:20.127366+0000","last_became_peered":"2024-09-10T22:24:20.127366+0000","last_unstale":"2024-09-10T22:25:05.521671+0000","last_undegraded":"2024-09-10T22:25:05.521671+0000","last_fullsized":"2024-09-10T22:25:05.521671+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:19.099039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:19.099039+0000","last_clean_scrub_stamp":"2024-09-10T22:24:19.099039+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:36:05.439417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T22:25:05.521293+0000","last_change":"2024-09-10T22:24:22.144799+0000","last_active":"2024-09-10T22:25:05.521293+0000","last_peered":"2024-09-10T22:25:05.521293+0000","last_clean":"2024-09-10T22:25:05.521293+0000","last_became_active":"2024-09-10T22:24:22.144543+0000","last_became_peered":"2024-09-10T22:24:22.144543+0000","last_unstale":"2024-09-10T22:25:05.521293+0000","last_undegraded":"2024-09-10T22:25:05.521293+0000","last_fullsized":"2024-09-10T22:25:05.521293+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_clean_scrub_stamp":"2024-09-10T22:24:21.113844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:45:46.193108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":23,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T22:25:05.517294+0000","last_change":"2024-09-10T22:24:20.383345+0000","last_active":"2024-09-10T22:25:05.517294+0000","last_peered":"2024-09-10T22:25:05.517294+0000","last_clean":"2024-09-10T22:25:05.517294+0000","last_became_active":"2024-09-10T22:24:20.383023+0000","last_became_peered":"2024-09-10T22:24:20.383023+0000","last_unstale":"2024-09-10T22:25:05.517294+0000","last_undegraded":"2024-09-10T22:25:05.517294+0000","last_fullsized":"2024-09-10T22:25:05.517294+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:19.099039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:19.099039+0000","last_clean_scrub_stamp":"2024-09-10T22:24:19.099039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:27:31.771060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"73'1","reported_seq":19,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T22:25:05.521535+0000","last_change":"2024-09-10T22:24:22.143130+0000","last_active":"2024-09-10T22:25:05.521535+0000","last_peered":"2024-09-10T22:25:05.521535+0000","last_clean":"2024-09-10T22:25:05.521535+0000","last_became_active":"2024-09-10T22:24:22.142664+0000","last_became_peered":"2024-09-10T22:24:22.142664+0000","last_unstale":"2024-09-10T22:25:05.521535+0000","last_undegraded":"2024-09-10T22:25:05.521535+0000","last_fullsized":"2024-09-10T22:25:05.521535+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_clean_scrub_stamp":"2024-09-10T22:24:21.113844+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:49:53.325307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"73'1","reported_seq":25,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T22:25:05.520063+0000","last_change":"2024-09-10T22:24:20.383795+0000","last_active":"2024-09-10T22:25:05.520063+0000","last_peered":"2024-09-10T22:25:05.520063+0000","last_clean":"2024-09-10T22:25:05.520063+0000","last_became_active":"2024-09-10T22:24:20.383418+0000","last_became_peered":"2024-09-10T22:24:20.383418+0000","last_unstale":"2024-09-10T22:25:05.520063+0000","last_undegraded":"2024-09-10T22:25:05.520063+0000","last_fullsized":"2024-09-10T22:25:05.520063+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:19.099039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:19.099039+0000","last_clean_scrub_stamp":"2024-09-10T22:24:19.099039+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:52:26.602544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T22:25:05.524907+0000","last_change":"2024-09-10T22:24:22.139416+0000","last_active":"2024-09-10T22:25:05.524907+0000","last_peered":"2024-09-10T22:25:05.524907+0000","last_clean":"2024-09-10T22:25:05.524907+0000","last_became_active":"2024-09-10T22:24:22.138648+0000","last_became_peered":"2024-09-10T22:24:22.138648+0000","last_unstale":"2024-09-10T22:25:05.524907+0000","last_undegraded":"2024-09-10T22:25:05.524907+0000","last_fullsized":"2024-09-10T22:25:05.524907+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_clean_scrub_stamp":"2024-09-10T22:24:21.113844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:12:20.064134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"73'10","reported_seq":33,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T22:25:05.517416+0000","last_change":"2024-09-10T22:24:20.124001+0000","last_active":"2024-09-10T22:25:05.517416+0000","last_peered":"2024-09-10T22:25:05.517416+0000","last_clean":"2024-09-10T22:25:05.517416+0000","last_became_active":"2024-09-10T22:24:20.123616+0000","last_became_peered":"2024-09-10T22:24:20.123616+0000","last_unstale":"2024-09-10T22:25:05.517416+0000","last_undegraded":"2024-09-10T22:25:05.517416+0000","last_fullsized":"2024-09-10T22:25:05.517416+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:19.099039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:19.099039+0000","last_clean_scrub_stamp":"2024-09-10T22:24:19.099039+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:12:47.003561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T22:25:05.636476+0000","last_change":"2024-09-10T22:24:22.146936+0000","last_active":"2024-09-10T22:25:05.636476+0000","last_peered":"2024-09-10T22:25:05.636476+0000","last_clean":"2024-09-10T22:25:05.636476+0000","last_became_active":"2024-09-10T22:24:22.146578+0000","last_became_peered":"2024-09-10T22:24:22.146578+0000","last_unstale":"2024-09-10T22:25:05.636476+0000","last_undegraded":"2024-09-10T22:25:05.636476+0000","last_fullsized":"2024-09-10T22:25:05.636476+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_clean_scrub_stamp":"2024-09-10T22:24:21.113844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:44:20.229747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"73'4","reported_seq":27,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T22:25:05.636970+0000","last_change":"2024-09-10T22:24:20.406642+0000","last_active":"2024-09-10T22:25:05.636970+0000","last_peered":"2024-09-10T22:25:05.636970+0000","last_clean":"2024-09-10T22:25:05.636970+0000","last_became_active":"2024-09-10T22:24:20.406288+0000","last_became_peered":"2024-09-10T22:24:20.406288+0000","last_unstale":"2024-09-10T22:25:05.636970+0000","last_undegraded":"2024-09-10T22:25:05.636970+0000","last_fullsized":"2024-09-10T22:25:05.636970+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:19.099039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:19.099039+0000","last_clean_scrub_stamp":"2024-09-10T22:24:19.099039+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:10:48.558751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T22:25:05.636612+0000","last_change":"2024-09-10T22:24:22.142511+0000","last_active":"2024-09-10T22:25:05.636612+0000","last_peered":"2024-09-10T22:25:05.636612+0000","last_clean":"2024-09-10T22:25:05.636612+0000","last_became_active":"2024-09-10T22:24:22.142200+0000","last_became_peered":"2024-09-10T22:24:22.142200+0000","last_unstale":"2024-09-10T22:25:05.636612+0000","last_undegraded":"2024-09-10T22:25:05.636612+0000","last_fullsized":"2024-09-10T22:25:05.636612+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_clean_scrub_stamp":"2024-09-10T22:24:21.113844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:09:46.928679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"73'2","reported_seq":25,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T22:25:05.524848+0000","last_change":"2024-09-10T22:24:20.383403+0000","last_active":"2024-09-10T22:25:05.524848+0000","last_peered":"2024-09-10T22:25:05.524848+0000","last_clean":"2024-09-10T22:25:05.524848+0000","last_became_active":"2024-09-10T22:24:20.383143+0000","last_became_peered":"2024-09-10T22:24:20.383143+0000","last_unstale":"2024-09-10T22:25:05.524848+0000","last_undegraded":"2024-09-10T22:25:05.524848+0000","last_fullsized":"2024-09-10T22:25:05.524848+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:19.099039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:19.099039+0000","last_clean_scrub_stamp":"2024-09-10T22:24:19.099039+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:54:07.338628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T22:25:05.519205+0000","last_change":"2024-09-10T22:24:22.136604+0000","last_active":"2024-09-10T22:25:05.519205+0000","last_peered":"2024-09-10T22:25:05.519205+0000","last_clean":"2024-09-10T22:25:05.519205+0000","last_became_active":"2024-09-10T22:24:22.136298+0000","last_became_peered":"2024-09-10T22:24:22.136298+0000","last_unstale":"2024-09-10T22:25:05.519205+0000","last_undegraded":"2024-09-10T22:25:05.519205+0000","last_fullsized":"2024-09-10T22:25:05.519205+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_clean_scrub_stamp":"2024-09-10T22:24:21.113844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:39:11.777729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"73'3","reported_seq":26,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T22:25:05.636399+0000","last_change":"2024-09-10T22:24:20.124911+0000","last_active":"2024-09-10T22:25:05.636399+0000","last_peered":"2024-09-10T22:25:05.636399+0000","last_clean":"2024-09-10T22:25:05.636399+0000","last_became_active":"2024-09-10T22:24:20.124152+0000","last_became_peered":"2024-09-10T22:24:20.124152+0000","last_unstale":"2024-09-10T22:25:05.636399+0000","last_undegraded":"2024-09-10T22:25:05.636399+0000","last_fullsized":"2024-09-10T22:25:05.636399+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:19.099039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:19.099039+0000","last_clean_scrub_stamp":"2024-09-10T22:24:19.099039+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:32:30.837104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T22:25:05.517688+0000","last_change":"2024-09-10T22:24:22.138080+0000","last_active":"2024-09-10T22:25:05.517688+0000","last_peered":"2024-09-10T22:25:05.517688+0000","last_clean":"2024-09-10T22:25:05.517688+0000","last_became_active":"2024-09-10T22:24:22.137775+0000","last_became_peered":"2024-09-10T22:24:22.137775+0000","last_unstale":"2024-09-10T22:25:05.517688+0000","last_undegraded":"2024-09-10T22:25:05.517688+0000","last_fullsized":"2024-09-10T22:25:05.517688+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_clean_scrub_stamp":"2024-09-10T22:24:21.113844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:10:48.320495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"73'1","reported_seq":24,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T22:25:05.522456+0000","last_change":"2024-09-10T22:24:20.125551+0000","last_active":"2024-09-10T22:25:05.522456+0000","last_peered":"2024-09-10T22:25:05.522456+0000","last_clean":"2024-09-10T22:25:05.522456+0000","last_became_active":"2024-09-10T22:24:20.125064+0000","last_became_peered":"2024-09-10T22:24:20.125064+0000","last_unstale":"2024-09-10T22:25:05.522456+0000","last_undegraded":"2024-09-10T22:25:05.522456+0000","last_fullsized":"2024-09-10T22:25:05.522456+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:19.099039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:19.099039+0000","last_clean_scrub_stamp":"2024-09-10T22:24:19.099039+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:29:48.598158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T22:25:05.636972+0000","last_change":"2024-09-10T22:24:22.142894+0000","last_active":"2024-09-10T22:25:05.636972+0000","last_peered":"2024-09-10T22:25:05.636972+0000","last_clean":"2024-09-10T22:25:05.636972+0000","last_became_active":"2024-09-10T22:24:22.142554+0000","last_became_peered":"2024-09-10T22:24:22.142554+0000","last_unstale":"2024-09-10T22:25:05.636972+0000","last_undegraded":"2024-09-10T22:25:05.636972+0000","last_fullsized":"2024-09-10T22:25:05.636972+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_clean_scrub_stamp":"2024-09-10T22:24:21.113844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:11:11.457622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"73'4","reported_seq":28,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T22:25:05.519653+0000","last_change":"2024-09-10T22:24:20.128212+0000","last_active":"2024-09-10T22:25:05.519653+0000","last_peered":"2024-09-10T22:25:05.519653+0000","last_clean":"2024-09-10T22:25:05.519653+0000","last_became_active":"2024-09-10T22:24:20.127597+0000","last_became_peered":"2024-09-10T22:24:20.127597+0000","last_unstale":"2024-09-10T22:25:05.519653+0000","last_undegraded":"2024-09-10T22:25:05.519653+0000","last_fullsized":"2024-09-10T22:25:05.519653+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:19.099039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:19.099039+0000","last_clean_scrub_stamp":"2024-09-10T22:24:19.099039+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:48:28.543222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T22:25:05.521128+0000","last_change":"2024-09-10T22:24:22.144321+0000","last_active":"2024-09-10T22:25:05.521128+0000","last_peered":"2024-09-10T22:25:05.521128+0000","last_clean":"2024-09-10T22:25:05.521128+0000","last_became_active":"2024-09-10T22:24:22.144037+0000","last_became_peered":"2024-09-10T22:24:22.144037+0000","last_unstale":"2024-09-10T22:25:05.521128+0000","last_undegraded":"2024-09-10T22:25:05.521128+0000","last_fullsized":"2024-09-10T22:25:05.521128+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_clean_scrub_stamp":"2024-09-10T22:24:21.113844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:28:00.600758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T22:25:05.522021+0000","last_change":"2024-09-10T22:24:22.145574+0000","last_active":"2024-09-10T22:25:05.522021+0000","last_peered":"2024-09-10T22:25:05.522021+0000","last_clean":"2024-09-10T22:25:05.522021+0000","last_became_active":"2024-09-10T22:24:22.144425+0000","last_became_peered":"2024-09-10T22:24:22.144425+0000","last_unstale":"2024-09-10T22:25:05.522021+0000","last_undegraded":"2024-09-10T22:25:05.522021+0000","last_fullsized":"2024-09-10T22:25:05.522021+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_clean_scrub_stamp":"2024-09-10T22:24:21.113844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:41:10.177782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"73'2","reported_seq":25,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T22:25:05.519940+0000","last_change":"2024-09-10T22:24:20.124627+0000","last_active":"2024-09-10T22:25:05.519940+0000","last_peered":"2024-09-10T22:25:05.519940+0000","last_clean":"2024-09-10T22:25:05.519940+0000","last_became_active":"2024-09-10T22:24:20.124174+0000","last_became_peered":"2024-09-10T22:24:20.124174+0000","last_unstale":"2024-09-10T22:25:05.519940+0000","last_undegraded":"2024-09-10T22:25:05.519940+0000","last_fullsized":"2024-09-10T22:25:05.519940+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:19.099039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:19.099039+0000","last_clean_scrub_stamp":"2024-09-10T22:24:19.099039+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:35:26.871316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T22:25:05.525253+0000","last_change":"2024-09-10T22:24:22.142531+0000","last_active":"2024-09-10T22:25:05.525253+0000","last_peered":"2024-09-10T22:25:05.525253+0000","last_clean":"2024-09-10T22:25:05.525253+0000","last_became_active":"2024-09-10T22:24:22.142240+0000","last_became_peered":"2024-09-10T22:24:22.142240+0000","last_unstale":"2024-09-10T22:25:05.525253+0000","last_undegraded":"2024-09-10T22:25:05.525253+0000","last_fullsized":"2024-09-10T22:25:05.525253+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_clean_scrub_stamp":"2024-09-10T22:24:21.113844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:30:56.868586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"73'4","reported_seq":40,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T22:25:05.644250+0000","last_change":"2024-09-10T22:25:05.644160+0000","last_active":"2024-09-10T22:25:05.644250+0000","last_peered":"2024-09-10T22:25:05.644250+0000","last_clean":"2024-09-10T22:25:05.644250+0000","last_became_active":"2024-09-10T22:25:05.638026+0000","last_became_peered":"2024-09-10T22:25:05.638026+0000","last_unstale":"2024-09-10T22:25:05.644250+0000","last_undegraded":"2024-09-10T22:25:05.644250+0000","last_fullsized":"2024-09-10T22:25:05.644250+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:19.099039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:19.099039+0000","last_clean_scrub_stamp":"2024-09-10T22:24:19.099039+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:58:18.112018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":10,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,4,7],"acting":[8,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T22:25:05.636813+0000","last_change":"2024-09-10T22:24:22.141121+0000","last_active":"2024-09-10T22:25:05.636813+0000","last_peered":"2024-09-10T22:25:05.636813+0000","last_clean":"2024-09-10T22:25:05.636813+0000","last_became_active":"2024-09-10T22:24:22.140490+0000","last_became_peered":"2024-09-10T22:24:22.140490+0000","last_unstale":"2024-09-10T22:25:05.636813+0000","last_undegraded":"2024-09-10T22:25:05.636813+0000","last_fullsized":"2024-09-10T22:25:05.636813+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_clean_scrub_stamp":"2024-09-10T22:24:21.113844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:52:22.840740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"73'2","reported_seq":25,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T22:25:05.636729+0000","last_change":"2024-09-10T22:24:20.385053+0000","last_active":"2024-09-10T22:25:05.636729+0000","last_peered":"2024-09-10T22:25:05.636729+0000","last_clean":"2024-09-10T22:25:05.636729+0000","last_became_active":"2024-09-10T22:24:20.384432+0000","last_became_peered":"2024-09-10T22:24:20.384432+0000","last_unstale":"2024-09-10T22:25:05.636729+0000","last_undegraded":"2024-09-10T22:25:05.636729+0000","last_fullsized":"2024-09-10T22:25:05.636729+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:19.099039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:19.099039+0000","last_clean_scrub_stamp":"2024-09-10T22:24:19.099039+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:18:15.685331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T22:25:05.636603+0000","last_change":"2024-09-10T22:24:22.143884+0000","last_active":"2024-09-10T22:25:05.636603+0000","last_peered":"2024-09-10T22:25:05.636603+0000","last_clean":"2024-09-10T22:25:05.636603+0000","last_became_active":"2024-09-10T22:24:22.143446+0000","last_became_peered":"2024-09-10T22:24:22.143446+0000","last_unstale":"2024-09-10T22:25:05.636603+0000","last_undegraded":"2024-09-10T22:25:05.636603+0000","last_fullsized":"2024-09-10T22:25:05.636603+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_clean_scrub_stamp":"2024-09-10T22:24:21.113844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:28:32.453668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"73'9","reported_seq":50,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T22:25:05.528312+0000","last_change":"2024-09-10T22:25:05.528200+0000","last_active":"2024-09-10T22:25:05.528312+0000","last_peered":"2024-09-10T22:25:05.528312+0000","last_clean":"2024-09-10T22:25:05.528312+0000","last_became_active":"2024-09-10T22:25:05.520346+0000","last_became_peered":"2024-09-10T22:25:05.520346+0000","last_unstale":"2024-09-10T22:25:05.528312+0000","last_undegraded":"2024-09-10T22:25:05.528312+0000","last_fullsized":"2024-09-10T22:25:05.528312+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:19.099039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:19.099039+0000","last_clean_scrub_stamp":"2024-09-10T22:24:19.099039+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:38:21.050372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":582,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,11,8],"acting":[9,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":63763,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":343,"num_read_kb":236,"num_write":161,"num_write_kb":109,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":11,"num_bytes_recovered":672,"num_keys_recovered":10,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":417792,"data_stored":191289,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4751360,"data_stored":4722944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":92,"ondisk_log_size":92,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":67,"seq":287762808858,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27836,"kb_used_data":804,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717316,"statfs":{"total":95995035648,"available":95966531584,"internally_reserved":0,"allocated":823296,"data_stored":397674,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":62,"seq":266287972383,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36832,"kb_used_data":1480,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708320,"statfs":{"total":95995035648,"available":95957319680,"internally_reserved":0,"allocated":1515520,"data_stored":1048726,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":36174272},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":57,"seq":244813135907,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27844,"kb_used_data":816,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717308,"statfs":{"total":95995035648,"available":95966523392,"internally_reserved":0,"allocated":835584,"data_stored":397328,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,5,6,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":51,"seq":219043332136,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27848,"kb_used_data":816,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717304,"statfs":{"total":95995035648,"available":95966519296,"internally_reserved":0,"allocated":835584,"data_stored":397248,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":46,"seq":197568495662,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36744,"kb_used_data":1392,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708408,"statfs":{"total":95995035648,"available":95957409792,"internally_reserved":0,"allocated":1425408,"data_stored":988596,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":36174282},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":40,"seq":171798691891,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27836,"kb_used_data":804,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717316,"statfs":{"total":95995035648,"available":95966531584,"internally_reserved":0,"allocated":823296,"data_stored":396717,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":34,"seq":146028888119,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28432,"kb_used_data":1404,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716720,"statfs":{"total":95995035648,"available":95965921280,"internally_reserved":0,"allocated":1437696,"data_stored":988381,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":29,"seq":124554051644,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27840,"kb_used_data":808,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717312,"statfs":{"total":95995035648,"available":95966527488,"internally_reserved":0,"allocated":827392,"data_stored":397545,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":23,"seq":98784247873,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27852,"kb_used_data":820,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717300,"statfs":{"total":95995035648,"available":95966515200,"internally_reserved":0,"allocated":839680,"data_stored":397028,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444104,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36240,"kb_used_data":888,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708912,"statfs":{"total":95995035648,"available":95957925888,"internally_reserved":0,"allocated":909312,"data_stored":457622,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":12,"seq":51539607628,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36220,"kb_used_data":868,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708932,"statfs":{"total":95995035648,"available":95957946368,"internally_reserved":0,"allocated":888832,"data_stored":456362,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738450,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36176,"kb_used_data":824,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708976,"statfs":{"total":95995035648,"available":95957991424,"internally_reserved":0,"allocated":843776,"data_stored":397988,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":59852,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":94208,"data_stored":61112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1035,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1386,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1601,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":61731,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1164,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-10T22:25:30.549 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2024-09-10T22:25:30.549 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-09-10T22:25:30.549 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy 2024-09-10T22:25:30.549 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 22997a4c-6fc2-11ef-bcea-c7b262605968 -- ceph health --format=json 2024-09-10T22:25:30.812 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/22997a4c-6fc2-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T22:25:31.112 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:25:30 smithi019 ceph-mon[31375]: from='client.15069 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-10T22:25:31.124 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:25:30 smithi138 ceph-mon[35236]: from='client.15069 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-10T22:25:31.343 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:31.342+0000 7fce0fb01640 1 -- 172.21.15.19:0/290951389 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fce081076a0 msgr2=0x7fce08107ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:25:31.344 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:31.342+0000 7fce0fb01640 1 --2- 172.21.15.19:0/290951389 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fce081076a0 0x7fce08107ae0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7fce04009900 tx=0x7fce0402a410 comp rx=0 tx=0).stop 2024-09-10T22:25:31.344 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:31.342+0000 7fce0fb01640 1 -- 172.21.15.19:0/290951389 shutdown_connections 2024-09-10T22:25:31.344 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:31.342+0000 7fce0fb01640 1 --2- 172.21.15.19:0/290951389 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fce08108020 0x7fce0810e820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:25:31.344 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:31.342+0000 7fce0fb01640 1 --2- 172.21.15.19:0/290951389 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fce081076a0 0x7fce08107ae0 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:25:31.344 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:31.342+0000 7fce0fb01640 1 --2- 172.21.15.19:0/290951389 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fce08101c90 0x7fce08102070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:25:31.344 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:31.342+0000 7fce0fb01640 1 -- 172.21.15.19:0/290951389 >> 172.21.15.19:0/290951389 conn(0x7fce080fd700 msgr2=0x7fce080ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:25:31.344 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:31.342+0000 7fce0fb01640 1 -- 172.21.15.19:0/290951389 shutdown_connections 2024-09-10T22:25:31.344 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:31.342+0000 7fce0fb01640 1 -- 172.21.15.19:0/290951389 wait complete. 2024-09-10T22:25:31.344 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:31.342+0000 7fce0fb01640 1 Processor -- start 2024-09-10T22:25:31.344 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:31.343+0000 7fce0fb01640 1 -- start start 2024-09-10T22:25:31.346 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:31.343+0000 7fce0fb01640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fce08101c90 0x7fce0819a070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:25:31.346 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:31.343+0000 7fce0fb01640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fce081076a0 0x7fce0819a5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:25:31.346 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:31.343+0000 7fce0fb01640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fce08108020 0x7fce0819ab30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:25:31.346 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:31.343+0000 7fce0fb01640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fce08111ce0 con 0x7fce08101c90 2024-09-10T22:25:31.347 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:31.343+0000 7fce0fb01640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fce08111b60 con 0x7fce081076a0 2024-09-10T22:25:31.347 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:31.343+0000 7fce0fb01640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7fce08111e60 con 0x7fce08108020 2024-09-10T22:25:31.347 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:31.343+0000 7fce0d89d640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fce08101c90 0x7fce0819a070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:25:31.347 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:31.343+0000 7fce0d89d640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fce08101c90 0x7fce0819a070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:60548/0 (socket says 172.21.15.19:60548) 2024-09-10T22:25:31.347 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:31.343+0000 7fce0d89d640 1 -- 172.21.15.19:0/966288056 learned_addr learned my addr 172.21.15.19:0/966288056 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:25:31.347 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:31.343+0000 7fce0e09e640 1 --2- 172.21.15.19:0/966288056 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fce08108020 0x7fce0819ab30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:25:31.347 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:31.343+0000 7fce0d09c640 1 --2- 172.21.15.19:0/966288056 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fce081076a0 0x7fce0819a5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:25:31.347 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:31.343+0000 7fce0d89d640 1 -- 172.21.15.19:0/966288056 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fce08108020 msgr2=0x7fce0819ab30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:25:31.347 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:31.343+0000 7fce0d89d640 1 --2- 172.21.15.19:0/966288056 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fce08108020 0x7fce0819ab30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:25:31.347 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:31.343+0000 7fce0d89d640 1 -- 172.21.15.19:0/966288056 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fce081076a0 msgr2=0x7fce0819a5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:25:31.347 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:31.343+0000 7fce0d89d640 1 --2- 172.21.15.19:0/966288056 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fce081076a0 0x7fce0819a5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:25:31.347 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:31.343+0000 7fce0d89d640 1 -- 172.21.15.19:0/966288056 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fce081a5470 con 0x7fce08101c90 2024-09-10T22:25:31.347 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:31.343+0000 7fce0e09e640 1 --2- 172.21.15.19:0/966288056 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fce08108020 0x7fce0819ab30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T22:25:31.348 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:31.343+0000 7fce0d09c640 1 --2- 172.21.15.19:0/966288056 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fce081076a0 0x7fce0819a5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T22:25:31.348 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:31.344+0000 7fce0d89d640 1 --2- 172.21.15.19:0/966288056 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fce08101c90 0x7fce0819a070 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7fcdfc00d770 tx=0x7fcdfc00dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:25:31.348 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:31.344+0000 7fcdfaffd640 1 -- 172.21.15.19:0/966288056 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcdfc017070 con 0x7fce08101c90 2024-09-10T22:25:31.348 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:31.344+0000 7fce0fb01640 1 -- 172.21.15.19:0/966288056 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fce081a5760 con 0x7fce08101c90 2024-09-10T22:25:31.348 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:31.344+0000 7fcdfaffd640 1 -- 172.21.15.19:0/966288056 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fcdfc0054d0 con 0x7fce08101c90 2024-09-10T22:25:31.348 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:31.344+0000 7fcdfaffd640 1 -- 172.21.15.19:0/966288056 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcdfc004c30 con 0x7fce08101c90 2024-09-10T22:25:31.348 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:31.344+0000 7fce0fb01640 1 -- 172.21.15.19:0/966288056 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fce081a5c50 con 0x7fce08101c90 2024-09-10T22:25:31.348 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:31.345+0000 7fce0fb01640 1 -- 172.21.15.19:0/966288056 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fce08102070 con 0x7fce08101c90 2024-09-10T22:25:31.349 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:31.347+0000 7fcdfaffd640 1 -- 172.21.15.19:0/966288056 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 17) ==== 153301+0+0 (secure 0 0 0) 0x7fcdfc004dd0 con 0x7fce08101c90 2024-09-10T22:25:31.349 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:31.348+0000 7fcdfaffd640 1 --2- 172.21.15.19:0/966288056 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7fcdf40b5370 0x7fcdf40b7830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:25:31.349 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:31.348+0000 7fce0d09c640 1 --2- 172.21.15.19:0/966288056 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7fcdf40b5370 0x7fcdf40b7830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:25:31.349 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:31.348+0000 7fcdfaffd640 1 -- 172.21.15.19:0/966288056 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8269+0+0 (secure 0 0 0) 0x7fcdfc0e5d70 con 0x7fce08101c90 2024-09-10T22:25:31.349 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:31.348+0000 7fce0d09c640 1 --2- 172.21.15.19:0/966288056 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7fcdf40b5370 0x7fcdf40b7830 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fce04000c00 tx=0x7fce04031400 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:25:31.351 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:31.350+0000 7fcdfaffd640 1 -- 172.21.15.19:0/966288056 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7fcdfc0aca50 con 0x7fce08101c90 2024-09-10T22:25:31.359 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:25:30 smithi135 ceph-mon[34789]: from='client.15069 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-10T22:25:31.574 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:31.572+0000 7fce0fb01640 1 -- 172.21.15.19:0/966288056 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fce0806aee0 con 0x7fce08101c90 2024-09-10T22:25:31.574 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:31.573+0000 7fcdfaffd640 1 -- 172.21.15.19:0/966288056 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+46 (secure 0 0 0) 0x7fce0806aee0 con 0x7fce08101c90 2024-09-10T22:25:31.574 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-10T22:25:31.575 INFO:teuthology.orchestra.run.smithi019.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-09-10T22:25:31.577 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:31.576+0000 7fce0fb01640 1 -- 172.21.15.19:0/966288056 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7fcdf40b5370 msgr2=0x7fcdf40b7830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:25:31.578 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:31.576+0000 7fce0fb01640 1 --2- 172.21.15.19:0/966288056 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7fcdf40b5370 0x7fcdf40b7830 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fce04000c00 tx=0x7fce04031400 comp rx=0 tx=0).stop 2024-09-10T22:25:31.578 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:31.576+0000 7fce0fb01640 1 -- 172.21.15.19:0/966288056 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fce08101c90 msgr2=0x7fce0819a070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:25:31.578 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:31.576+0000 7fce0fb01640 1 --2- 172.21.15.19:0/966288056 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fce08101c90 0x7fce0819a070 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7fcdfc00d770 tx=0x7fcdfc00dc30 comp rx=0 tx=0).stop 2024-09-10T22:25:31.578 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:31.576+0000 7fce0fb01640 1 -- 172.21.15.19:0/966288056 shutdown_connections 2024-09-10T22:25:31.578 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:31.576+0000 7fce0fb01640 1 --2- 172.21.15.19:0/966288056 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7fcdf40b5370 0x7fcdf40b7830 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:25:31.578 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:31.576+0000 7fce0fb01640 1 --2- 172.21.15.19:0/966288056 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fce08108020 0x7fce0819ab30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:25:31.578 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:31.576+0000 7fce0fb01640 1 --2- 172.21.15.19:0/966288056 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fce081076a0 0x7fce0819a5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:25:31.578 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:31.576+0000 7fce0fb01640 1 --2- 172.21.15.19:0/966288056 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fce08101c90 0x7fce0819a070 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:25:31.578 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:31.576+0000 7fce0fb01640 1 -- 172.21.15.19:0/966288056 >> 172.21.15.19:0/966288056 conn(0x7fce080fd700 msgr2=0x7fce080ffaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:25:31.578 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:31.576+0000 7fce0fb01640 1 -- 172.21.15.19:0/966288056 shutdown_connections 2024-09-10T22:25:31.578 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:31.576+0000 7fce0fb01640 1 -- 172.21.15.19:0/966288056 wait complete. 2024-09-10T22:25:32.125 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:25:31 smithi138 ceph-mon[35236]: pgmap v318: 97 pgs: 97 active+clean; 639 KiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-09-10T22:25:32.125 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:25:31 smithi138 ceph-mon[35236]: from='client.? 172.21.15.19:0/966288056' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2024-09-10T22:25:32.199 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:25:31 smithi019 ceph-mon[31375]: pgmap v318: 97 pgs: 97 active+clean; 639 KiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-09-10T22:25:32.199 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:25:31 smithi019 ceph-mon[31375]: from='client.? 172.21.15.19:0/966288056' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2024-09-10T22:25:32.228 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy done 2024-09-10T22:25:32.228 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 22997a4c-6fc2-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-10T22:25:32.360 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:25:31 smithi135 ceph-mon[34789]: pgmap v318: 97 pgs: 97 active+clean; 639 KiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-09-10T22:25:32.360 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:25:31 smithi135 ceph-mon[34789]: from='client.? 172.21.15.19:0/966288056' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2024-09-10T22:25:32.490 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/22997a4c-6fc2-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T22:25:32.914 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:32.910+0000 7f4f70149640 1 -- 172.21.15.19:0/1603181298 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4f681076e0 msgr2=0x7f4f68107b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:25:32.914 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:32.910+0000 7f4f70149640 1 --2- 172.21.15.19:0/1603181298 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4f681076e0 0x7f4f68107b20 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f4f58009900 tx=0x7f4f5802a410 comp rx=0 tx=0).stop 2024-09-10T22:25:32.914 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:32.910+0000 7f4f70149640 1 -- 172.21.15.19:0/1603181298 shutdown_connections 2024-09-10T22:25:32.914 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:32.910+0000 7f4f70149640 1 --2- 172.21.15.19:0/1603181298 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4f68108060 0x7f4f6810e860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:25:32.914 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:32.910+0000 7f4f70149640 1 --2- 172.21.15.19:0/1603181298 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4f681076e0 0x7f4f68107b20 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:25:32.914 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:32.910+0000 7f4f70149640 1 --2- 172.21.15.19:0/1603181298 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f4f68101cd0 0x7f4f681020b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:25:32.914 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:32.910+0000 7f4f70149640 1 -- 172.21.15.19:0/1603181298 >> 172.21.15.19:0/1603181298 conn(0x7f4f680fd720 msgr2=0x7f4f680ffb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:25:32.914 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:32.910+0000 7f4f70149640 1 -- 172.21.15.19:0/1603181298 shutdown_connections 2024-09-10T22:25:32.914 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:32.910+0000 7f4f70149640 1 -- 172.21.15.19:0/1603181298 wait complete. 2024-09-10T22:25:32.915 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:32.911+0000 7f4f70149640 1 Processor -- start 2024-09-10T22:25:32.915 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:32.911+0000 7f4f70149640 1 -- start start 2024-09-10T22:25:32.915 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:32.911+0000 7f4f70149640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4f68101cd0 0x7f4f68199350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:25:32.915 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:32.911+0000 7f4f70149640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4f681076e0 0x7f4f68199890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:25:32.915 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:32.911+0000 7f4f70149640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f4f68108060 0x7f4f6819ec30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:25:32.915 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:32.911+0000 7f4f70149640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f4f68111d70 con 0x7f4f681076e0 2024-09-10T22:25:32.915 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:32.911+0000 7f4f70149640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f4f68111bf0 con 0x7f4f68101cd0 2024-09-10T22:25:32.915 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:32.911+0000 7f4f70149640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f4f68111ef0 con 0x7f4f68108060 2024-09-10T22:25:32.915 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:32.911+0000 7f4f6d6e4640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4f681076e0 0x7f4f68199890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:25:32.915 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:32.911+0000 7f4f6d6e4640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4f681076e0 0x7f4f68199890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:60564/0 (socket says 172.21.15.19:60564) 2024-09-10T22:25:32.916 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:32.911+0000 7f4f6d6e4640 1 -- 172.21.15.19:0/3171715135 learned_addr learned my addr 172.21.15.19:0/3171715135 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:25:32.916 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:32.911+0000 7f4f6dee5640 1 --2- 172.21.15.19:0/3171715135 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4f68101cd0 0x7f4f68199350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:25:32.916 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:32.912+0000 7f4f6e6e6640 1 --2- 172.21.15.19:0/3171715135 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f4f68108060 0x7f4f6819ec30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:25:32.916 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:32.912+0000 7f4f6d6e4640 1 -- 172.21.15.19:0/3171715135 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f4f68108060 msgr2=0x7f4f6819ec30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:25:32.916 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:32.912+0000 7f4f6d6e4640 1 --2- 172.21.15.19:0/3171715135 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f4f68108060 0x7f4f6819ec30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:25:32.916 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:32.912+0000 7f4f6d6e4640 1 -- 172.21.15.19:0/3171715135 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4f68101cd0 msgr2=0x7f4f68199350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:25:32.916 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:32.912+0000 7f4f6d6e4640 1 --2- 172.21.15.19:0/3171715135 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4f68101cd0 0x7f4f68199350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:25:32.916 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:32.912+0000 7f4f6d6e4640 1 -- 172.21.15.19:0/3171715135 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4f6819f400 con 0x7f4f681076e0 2024-09-10T22:25:32.916 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:32.912+0000 7f4f6d6e4640 1 --2- 172.21.15.19:0/3171715135 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4f681076e0 0x7f4f68199890 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f4f58005ab0 tx=0x7f4f58003cd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:25:32.916 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:32.912+0000 7f4f5effd640 1 -- 172.21.15.19:0/3171715135 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f5803f070 con 0x7f4f681076e0 2024-09-10T22:25:32.916 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:32.912+0000 7f4f70149640 1 -- 172.21.15.19:0/3171715135 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4f6819f690 con 0x7f4f681076e0 2024-09-10T22:25:32.916 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:32.912+0000 7f4f5effd640 1 -- 172.21.15.19:0/3171715135 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4f58031d60 con 0x7f4f681076e0 2024-09-10T22:25:32.917 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:32.912+0000 7f4f5effd640 1 -- 172.21.15.19:0/3171715135 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f58035030 con 0x7f4f681076e0 2024-09-10T22:25:32.917 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:32.912+0000 7f4f70149640 1 -- 172.21.15.19:0/3171715135 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4f681a5db0 con 0x7f4f681076e0 2024-09-10T22:25:32.918 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:32.913+0000 7f4f70149640 1 -- 172.21.15.19:0/3171715135 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4f681020b0 con 0x7f4f681076e0 2024-09-10T22:25:32.918 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:32.915+0000 7f4f5effd640 1 -- 172.21.15.19:0/3171715135 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 17) ==== 153301+0+0 (secure 0 0 0) 0x7f4f5803b560 con 0x7f4f681076e0 2024-09-10T22:25:32.918 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:32.915+0000 7f4f5effd640 1 --2- 172.21.15.19:0/3171715135 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f4f540b5370 0x7f4f540b7830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:25:32.918 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:32.916+0000 7f4f6dee5640 1 --2- 172.21.15.19:0/3171715135 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f4f540b5370 0x7f4f540b7830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:25:32.918 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:32.916+0000 7f4f5effd640 1 -- 172.21.15.19:0/3171715135 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8269+0+0 (secure 0 0 0) 0x7f4f58106f20 con 0x7f4f681076e0 2024-09-10T22:25:32.918 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:32.916+0000 7f4f6dee5640 1 --2- 172.21.15.19:0/3171715135 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f4f540b5370 0x7f4f540b7830 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f4f64005fd0 tx=0x7f4f64009680 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:25:32.920 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:32.919+0000 7f4f5effd640 1 -- 172.21.15.19:0/3171715135 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f4f580cdc60 con 0x7f4f681076e0 2024-09-10T22:25:33.149 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:33.147+0000 7f4f70149640 1 -- 172.21.15.19:0/3171715135 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f4f6819a480 con 0x7f4f681076e0 2024-09-10T22:25:33.149 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:33.148+0000 7f4f5effd640 1 -- 172.21.15.19:0/3171715135 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) ==== 94+0+11921 (secure 0 0 0) 0x7f4f6819a480 con 0x7f4f681076e0 2024-09-10T22:25:33.150 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-10T22:25:33.150 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":24,"btime":"2024-09-10T22:24:34:220851+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14673,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6835/1835804747","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6834","nonce":1835804747},{"type":"v1","addr":"172.21.15.19:6835","nonce":1835804747}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14685,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6837/1750470490","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6836","nonce":1750470490},{"type":"v1","addr":"172.21.15.19:6837","nonce":1750470490}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14733,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6839/2642941149","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6838","nonce":2642941149},{"type":"v1","addr":"172.21.15.19:6839","nonce":2642941149}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14745,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6841/2449948682","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6840","nonce":2449948682},{"type":"v1","addr":"172.21.15.19:6841","nonce":2449948682}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24511,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.138:6833/2524811494","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6832","nonce":2524811494},{"type":"v1","addr":"172.21.15.138:6833","nonce":2524811494}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24512,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6833/3014993624","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6832","nonce":3014993624},{"type":"v1","addr":"172.21.15.135:6833","nonce":3014993624}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":24,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-10T22:24:22.733925+0000","modified":"2024-09-10T22:24:33.797491+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24581,"mds_1":24568,"mds_2":24553},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24527":{"gid":24527,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.135:6835/3715773348","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6834","nonce":3715773348},{"type":"v1","addr":"172.21.15.135:6835","nonce":3715773348}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24541":{"gid":24541,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.138:6835/933547028","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6834","nonce":933547028},{"type":"v1","addr":"172.21.15.138:6835","nonce":933547028}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24551":{"gid":24551,"name":"h","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.135:6837/3495029135","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6836","nonce":3495029135},{"type":"v1","addr":"172.21.15.135:6837","nonce":3495029135}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24553":{"gid":24553,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":10,"addr":"172.21.15.138:6837/3353290042","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6836","nonce":3353290042},{"type":"v1","addr":"172.21.15.138:6837","nonce":3353290042}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24568":{"gid":24568,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.138:6839/383637208","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6838","nonce":383637208},{"type":"v1","addr":"172.21.15.138:6839","nonce":383637208}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24581":{"gid":24581,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.135:6839/1254769802","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6838","nonce":1254769802},{"type":"v1","addr":"172.21.15.135:6839","nonce":1254769802}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24581,"qdb_cluster":[24553,24568,24581]},"id":1}]} 2024-09-10T22:25:33.150 INFO:teuthology.orchestra.run.smithi019.stderr:dumped fsmap epoch 24 2024-09-10T22:25:33.152 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:33.150+0000 7f4f70149640 1 -- 172.21.15.19:0/3171715135 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f4f540b5370 msgr2=0x7f4f540b7830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:25:33.152 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:33.150+0000 7f4f70149640 1 --2- 172.21.15.19:0/3171715135 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f4f540b5370 0x7f4f540b7830 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f4f64005fd0 tx=0x7f4f64009680 comp rx=0 tx=0).stop 2024-09-10T22:25:33.152 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:33.150+0000 7f4f70149640 1 -- 172.21.15.19:0/3171715135 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4f681076e0 msgr2=0x7f4f68199890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:25:33.152 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:33.150+0000 7f4f70149640 1 --2- 172.21.15.19:0/3171715135 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4f681076e0 0x7f4f68199890 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f4f58005ab0 tx=0x7f4f58003cd0 comp rx=0 tx=0).stop 2024-09-10T22:25:33.152 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:33.151+0000 7f4f70149640 1 -- 172.21.15.19:0/3171715135 shutdown_connections 2024-09-10T22:25:33.152 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:33.151+0000 7f4f70149640 1 --2- 172.21.15.19:0/3171715135 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f4f540b5370 0x7f4f540b7830 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:25:33.152 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:33.151+0000 7f4f70149640 1 --2- 172.21.15.19:0/3171715135 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f4f68108060 0x7f4f6819ec30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:25:33.152 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:33.151+0000 7f4f70149640 1 --2- 172.21.15.19:0/3171715135 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4f681076e0 0x7f4f68199890 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:25:33.153 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:33.151+0000 7f4f70149640 1 --2- 172.21.15.19:0/3171715135 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4f68101cd0 0x7f4f68199350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:25:33.153 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:33.151+0000 7f4f70149640 1 -- 172.21.15.19:0/3171715135 >> 172.21.15.19:0/3171715135 conn(0x7f4f680fd720 msgr2=0x7f4f6806b770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:25:33.153 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:33.151+0000 7f4f70149640 1 -- 172.21.15.19:0/3171715135 shutdown_connections 2024-09-10T22:25:33.153 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:33.151+0000 7f4f70149640 1 -- 172.21.15.19:0/3171715135 wait complete. 2024-09-10T22:25:33.936 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 22997a4c-6fc2-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-10T22:25:34.125 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:25:33 smithi138 ceph-mon[35236]: pgmap v319: 97 pgs: 97 active+clean; 639 KiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-10T22:25:34.125 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:25:33 smithi138 ceph-mon[35236]: from='client.? 172.21.15.19:0/3171715135' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T22:25:34.205 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/22997a4c-6fc2-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T22:25:34.208 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:25:33 smithi019 ceph-mon[31375]: pgmap v319: 97 pgs: 97 active+clean; 639 KiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-10T22:25:34.208 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:25:33 smithi019 ceph-mon[31375]: from='client.? 172.21.15.19:0/3171715135' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T22:25:34.359 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:25:33 smithi135 ceph-mon[34789]: pgmap v319: 97 pgs: 97 active+clean; 639 KiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-10T22:25:34.360 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:25:33 smithi135 ceph-mon[34789]: from='client.? 172.21.15.19:0/3171715135' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T22:25:34.729 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:34.725+0000 7fd51167a640 1 -- 172.21.15.19:0/1282835497 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd50c103ce0 msgr2=0x7fd50c1040c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:25:34.729 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:34.725+0000 7fd51167a640 1 --2- 172.21.15.19:0/1282835497 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd50c103ce0 0x7fd50c1040c0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7fd4fc009900 tx=0x7fd4fc02a410 comp rx=0 tx=0).stop 2024-09-10T22:25:34.729 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:34.725+0000 7fd51167a640 1 -- 172.21.15.19:0/1282835497 shutdown_connections 2024-09-10T22:25:34.729 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:34.725+0000 7fd51167a640 1 --2- 172.21.15.19:0/1282835497 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd50c10d140 0x7fd50c10f5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:25:34.729 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:34.725+0000 7fd51167a640 1 --2- 172.21.15.19:0/1282835497 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd50c104600 0x7fd50c10caf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:25:34.729 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:34.725+0000 7fd51167a640 1 --2- 172.21.15.19:0/1282835497 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd50c103ce0 0x7fd50c1040c0 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:25:34.729 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:34.725+0000 7fd51167a640 1 -- 172.21.15.19:0/1282835497 >> 172.21.15.19:0/1282835497 conn(0x7fd50c0fd700 msgr2=0x7fd50c0ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:25:34.729 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:34.725+0000 7fd51167a640 1 -- 172.21.15.19:0/1282835497 shutdown_connections 2024-09-10T22:25:34.729 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:34.725+0000 7fd51167a640 1 -- 172.21.15.19:0/1282835497 wait complete. 2024-09-10T22:25:34.730 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:34.726+0000 7fd51167a640 1 Processor -- start 2024-09-10T22:25:34.730 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:34.726+0000 7fd51167a640 1 -- start start 2024-09-10T22:25:34.730 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:34.726+0000 7fd51167a640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd50c103ce0 0x7fd50c101990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:25:34.730 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:34.726+0000 7fd51167a640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd50c104600 0x7fd50c101ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:25:34.730 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:34.726+0000 7fd51167a640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd50c10d140 0x7fd50c102410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:25:34.730 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:34.726+0000 7fd51167a640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fd50c112e00 con 0x7fd50c104600 2024-09-10T22:25:34.730 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:34.726+0000 7fd51167a640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fd50c112c80 con 0x7fd50c10d140 2024-09-10T22:25:34.730 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:34.726+0000 7fd51167a640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7fd50c112f80 con 0x7fd50c103ce0 2024-09-10T22:25:34.730 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:34.727+0000 7fd50a7fc640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd50c104600 0x7fd50c101ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:25:34.730 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:34.727+0000 7fd50a7fc640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd50c104600 0x7fd50c101ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:38826/0 (socket says 172.21.15.19:38826) 2024-09-10T22:25:34.730 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:34.727+0000 7fd50a7fc640 1 -- 172.21.15.19:0/1026190874 learned_addr learned my addr 172.21.15.19:0/1026190874 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:25:34.731 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:34.727+0000 7fd50affd640 1 --2- 172.21.15.19:0/1026190874 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd50c103ce0 0x7fd50c101990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:25:34.731 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:34.727+0000 7fd50b7fe640 1 --2- 172.21.15.19:0/1026190874 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd50c10d140 0x7fd50c102410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:25:34.731 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:34.727+0000 7fd50a7fc640 1 -- 172.21.15.19:0/1026190874 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd50c103ce0 msgr2=0x7fd50c101990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:25:34.731 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:34.727+0000 7fd50a7fc640 1 --2- 172.21.15.19:0/1026190874 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd50c103ce0 0x7fd50c101990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:25:34.731 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:34.727+0000 7fd50a7fc640 1 -- 172.21.15.19:0/1026190874 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd50c10d140 msgr2=0x7fd50c102410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:25:34.731 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:34.727+0000 7fd50a7fc640 1 --2- 172.21.15.19:0/1026190874 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd50c10d140 0x7fd50c102410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:25:34.731 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:34.727+0000 7fd50a7fc640 1 -- 172.21.15.19:0/1026190874 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd50c1a76e0 con 0x7fd50c104600 2024-09-10T22:25:34.731 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:34.727+0000 7fd50a7fc640 1 --2- 172.21.15.19:0/1026190874 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd50c104600 0x7fd50c101ed0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fd50000c970 tx=0x7fd50000ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:25:34.731 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:34.727+0000 7fd4f3fff640 1 -- 172.21.15.19:0/1026190874 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd500004220 con 0x7fd50c104600 2024-09-10T22:25:34.731 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:34.727+0000 7fd51167a640 1 -- 172.21.15.19:0/1026190874 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd50c1a79d0 con 0x7fd50c104600 2024-09-10T22:25:34.731 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:34.727+0000 7fd4f3fff640 1 -- 172.21.15.19:0/1026190874 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd5000043c0 con 0x7fd50c104600 2024-09-10T22:25:34.732 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:34.727+0000 7fd4f3fff640 1 -- 172.21.15.19:0/1026190874 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd500003e30 con 0x7fd50c104600 2024-09-10T22:25:34.732 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:34.727+0000 7fd51167a640 1 -- 172.21.15.19:0/1026190874 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd50c1a7f60 con 0x7fd50c104600 2024-09-10T22:25:34.733 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:34.728+0000 7fd51167a640 1 -- 172.21.15.19:0/1026190874 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd50c1040c0 con 0x7fd50c104600 2024-09-10T22:25:34.733 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:34.730+0000 7fd4f3fff640 1 -- 172.21.15.19:0/1026190874 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 17) ==== 153301+0+0 (secure 0 0 0) 0x7fd5000079b0 con 0x7fd50c104600 2024-09-10T22:25:34.733 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:34.731+0000 7fd4f3fff640 1 --2- 172.21.15.19:0/1026190874 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7fd4f40b5370 0x7fd4f40b7830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:25:34.733 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:34.731+0000 7fd50affd640 1 --2- 172.21.15.19:0/1026190874 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7fd4f40b5370 0x7fd4f40b7830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:25:34.733 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:34.731+0000 7fd4f3fff640 1 -- 172.21.15.19:0/1026190874 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8269+0+0 (secure 0 0 0) 0x7fd5000e5ce0 con 0x7fd50c104600 2024-09-10T22:25:34.733 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:34.731+0000 7fd50affd640 1 --2- 172.21.15.19:0/1026190874 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7fd4f40b5370 0x7fd4f40b7830 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fd4fc005ab0 tx=0x7fd4fc005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:25:34.735 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:34.734+0000 7fd4f3fff640 1 -- 172.21.15.19:0/1026190874 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7fd500014030 con 0x7fd50c104600 2024-09-10T22:25:34.957 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:34.956+0000 7fd51167a640 1 -- 172.21.15.19:0/1026190874 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd50c102c90 con 0x7fd50c104600 2024-09-10T22:25:34.958 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:34.957+0000 7fd4f3fff640 1 -- 172.21.15.19:0/1026190874 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) ==== 94+0+11921 (secure 0 0 0) 0x7fd5000ac3d0 con 0x7fd50c104600 2024-09-10T22:25:34.958 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-10T22:25:34.958 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":24,"btime":"2024-09-10T22:24:34:220851+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14673,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6835/1835804747","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6834","nonce":1835804747},{"type":"v1","addr":"172.21.15.19:6835","nonce":1835804747}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14685,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6837/1750470490","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6836","nonce":1750470490},{"type":"v1","addr":"172.21.15.19:6837","nonce":1750470490}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14733,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6839/2642941149","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6838","nonce":2642941149},{"type":"v1","addr":"172.21.15.19:6839","nonce":2642941149}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14745,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6841/2449948682","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6840","nonce":2449948682},{"type":"v1","addr":"172.21.15.19:6841","nonce":2449948682}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24511,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.138:6833/2524811494","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6832","nonce":2524811494},{"type":"v1","addr":"172.21.15.138:6833","nonce":2524811494}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24512,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6833/3014993624","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6832","nonce":3014993624},{"type":"v1","addr":"172.21.15.135:6833","nonce":3014993624}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":24,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-10T22:24:22.733925+0000","modified":"2024-09-10T22:24:33.797491+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24581,"mds_1":24568,"mds_2":24553},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24527":{"gid":24527,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.135:6835/3715773348","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6834","nonce":3715773348},{"type":"v1","addr":"172.21.15.135:6835","nonce":3715773348}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24541":{"gid":24541,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.138:6835/933547028","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6834","nonce":933547028},{"type":"v1","addr":"172.21.15.138:6835","nonce":933547028}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24551":{"gid":24551,"name":"h","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.135:6837/3495029135","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6836","nonce":3495029135},{"type":"v1","addr":"172.21.15.135:6837","nonce":3495029135}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24553":{"gid":24553,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":10,"addr":"172.21.15.138:6837/3353290042","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6836","nonce":3353290042},{"type":"v1","addr":"172.21.15.138:6837","nonce":3353290042}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24568":{"gid":24568,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.138:6839/383637208","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6838","nonce":383637208},{"type":"v1","addr":"172.21.15.138:6839","nonce":383637208}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24581":{"gid":24581,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.135:6839/1254769802","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6838","nonce":1254769802},{"type":"v1","addr":"172.21.15.135:6839","nonce":1254769802}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24581,"qdb_cluster":[24553,24568,24581]},"id":1}]} 2024-09-10T22:25:34.959 INFO:teuthology.orchestra.run.smithi019.stderr:dumped fsmap epoch 24 2024-09-10T22:25:34.960 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:34.959+0000 7fd51167a640 1 -- 172.21.15.19:0/1026190874 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7fd4f40b5370 msgr2=0x7fd4f40b7830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:25:34.961 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:34.959+0000 7fd51167a640 1 --2- 172.21.15.19:0/1026190874 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7fd4f40b5370 0x7fd4f40b7830 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fd4fc005ab0 tx=0x7fd4fc005a20 comp rx=0 tx=0).stop 2024-09-10T22:25:34.961 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:34.959+0000 7fd51167a640 1 -- 172.21.15.19:0/1026190874 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd50c104600 msgr2=0x7fd50c101ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:25:34.961 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:34.959+0000 7fd51167a640 1 --2- 172.21.15.19:0/1026190874 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd50c104600 0x7fd50c101ed0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fd50000c970 tx=0x7fd50000ce30 comp rx=0 tx=0).stop 2024-09-10T22:25:34.961 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:34.959+0000 7fd51167a640 1 -- 172.21.15.19:0/1026190874 shutdown_connections 2024-09-10T22:25:34.961 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:34.959+0000 7fd51167a640 1 --2- 172.21.15.19:0/1026190874 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7fd4f40b5370 0x7fd4f40b7830 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:25:34.961 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:34.959+0000 7fd51167a640 1 --2- 172.21.15.19:0/1026190874 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd50c10d140 0x7fd50c102410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:25:34.961 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:34.959+0000 7fd51167a640 1 --2- 172.21.15.19:0/1026190874 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd50c104600 0x7fd50c101ed0 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:25:34.961 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:34.959+0000 7fd51167a640 1 --2- 172.21.15.19:0/1026190874 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd50c103ce0 0x7fd50c101990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:25:34.961 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:34.959+0000 7fd51167a640 1 -- 172.21.15.19:0/1026190874 >> 172.21.15.19:0/1026190874 conn(0x7fd50c0fd700 msgr2=0x7fd50c0fe3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:25:34.962 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:34.959+0000 7fd51167a640 1 -- 172.21.15.19:0/1026190874 shutdown_connections 2024-09-10T22:25:34.962 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:34.959+0000 7fd51167a640 1 -- 172.21.15.19:0/1026190874 wait complete. 2024-09-10T22:25:35.597 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 22997a4c-6fc2-11ef-bcea-c7b262605968 -- ceph osd dump --format=json 2024-09-10T22:25:35.858 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/22997a4c-6fc2-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T22:25:36.125 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:25:35 smithi019 ceph-mon[31375]: pgmap v320: 97 pgs: 97 active+clean; 639 KiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-10T22:25:36.125 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:25:35 smithi019 ceph-mon[31375]: from='client.? 172.21.15.19:0/1026190874' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T22:25:36.125 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:25:35 smithi138 ceph-mon[35236]: pgmap v320: 97 pgs: 97 active+clean; 639 KiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-10T22:25:36.125 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:25:35 smithi138 ceph-mon[35236]: from='client.? 172.21.15.19:0/1026190874' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T22:25:36.359 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:25:35 smithi135 ceph-mon[34789]: pgmap v320: 97 pgs: 97 active+clean; 639 KiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-10T22:25:36.360 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:25:35 smithi135 ceph-mon[34789]: from='client.? 172.21.15.19:0/1026190874' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T22:25:36.367 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:36.365+0000 7fbb0aabd640 1 -- 172.21.15.19:0/1908029557 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbb04101810 msgr2=0x7fbb04101bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:25:36.367 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:36.365+0000 7fbb0aabd640 1 --2- 172.21.15.19:0/1908029557 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbb04101810 0x7fbb04101bf0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7fbaf4009900 tx=0x7fbaf402a410 comp rx=0 tx=0).stop 2024-09-10T22:25:36.367 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:36.365+0000 7fbb0aabd640 1 -- 172.21.15.19:0/1908029557 shutdown_connections 2024-09-10T22:25:36.367 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:36.365+0000 7fbb0aabd640 1 --2- 172.21.15.19:0/1908029557 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fbb0410d250 0x7fbb0410f640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:25:36.367 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:36.366+0000 7fbb0aabd640 1 --2- 172.21.15.19:0/1908029557 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbb0410a920 0x7fbb0410cd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:25:36.367 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:36.366+0000 7fbb0aabd640 1 --2- 172.21.15.19:0/1908029557 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbb04101810 0x7fbb04101bf0 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:25:36.367 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:36.366+0000 7fbb0aabd640 1 -- 172.21.15.19:0/1908029557 >> 172.21.15.19:0/1908029557 conn(0x7fbb04076f50 msgr2=0x7fbb04077360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:25:36.367 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:36.366+0000 7fbb0aabd640 1 -- 172.21.15.19:0/1908029557 shutdown_connections 2024-09-10T22:25:36.367 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:36.366+0000 7fbb0aabd640 1 -- 172.21.15.19:0/1908029557 wait complete. 2024-09-10T22:25:36.369 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:36.366+0000 7fbb0aabd640 1 Processor -- start 2024-09-10T22:25:36.369 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:36.366+0000 7fbb0aabd640 1 -- start start 2024-09-10T22:25:36.369 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:36.366+0000 7fbb0aabd640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbb04101810 0x7fbb041027e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:25:36.369 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:36.366+0000 7fbb0aabd640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fbb0410a920 0x7fbb04102d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:25:36.369 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:36.366+0000 7fbb0aabd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbb0410d250 0x7fbb04103260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:25:36.369 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:36.366+0000 7fbb0aabd640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fbb04112d50 con 0x7fbb0410d250 2024-09-10T22:25:36.369 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:36.366+0000 7fbb0aabd640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fbb04112bd0 con 0x7fbb04101810 2024-09-10T22:25:36.370 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:36.366+0000 7fbb0aabd640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7fbb04112ed0 con 0x7fbb0410a920 2024-09-10T22:25:36.370 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:36.367+0000 7fbb0905a640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbb0410d250 0x7fbb04103260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:25:36.370 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:36.367+0000 7fbb0905a640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbb0410d250 0x7fbb04103260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:38844/0 (socket says 172.21.15.19:38844) 2024-09-10T22:25:36.370 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:36.367+0000 7fbb0905a640 1 -- 172.21.15.19:0/1127243687 learned_addr learned my addr 172.21.15.19:0/1127243687 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:25:36.370 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:36.367+0000 7fbb03fff640 1 --2- 172.21.15.19:0/1127243687 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fbb0410a920 0x7fbb04102d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:25:36.370 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:36.367+0000 7fbb08859640 1 --2- 172.21.15.19:0/1127243687 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbb04101810 0x7fbb041027e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:25:36.370 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:36.367+0000 7fbb0905a640 1 -- 172.21.15.19:0/1127243687 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fbb0410a920 msgr2=0x7fbb04102d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:25:36.370 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:36.367+0000 7fbb0905a640 1 --2- 172.21.15.19:0/1127243687 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fbb0410a920 0x7fbb04102d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:25:36.370 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:36.367+0000 7fbb0905a640 1 -- 172.21.15.19:0/1127243687 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbb04101810 msgr2=0x7fbb041027e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:25:36.370 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:36.367+0000 7fbb0905a640 1 --2- 172.21.15.19:0/1127243687 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbb04101810 0x7fbb041027e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:25:36.370 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:36.367+0000 7fbb0905a640 1 -- 172.21.15.19:0/1127243687 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbb041a7600 con 0x7fbb0410d250 2024-09-10T22:25:36.370 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:36.367+0000 7fbb03fff640 1 --2- 172.21.15.19:0/1127243687 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fbb0410a920 0x7fbb04102d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T22:25:36.371 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:36.367+0000 7fbb0905a640 1 --2- 172.21.15.19:0/1127243687 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbb0410d250 0x7fbb04103260 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7fbafc009fd0 tx=0x7fbafc00b260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:25:36.371 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:36.367+0000 7fbb01ffb640 1 -- 172.21.15.19:0/1127243687 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbafc017070 con 0x7fbb0410d250 2024-09-10T22:25:36.371 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:36.367+0000 7fbb0aabd640 1 -- 172.21.15.19:0/1127243687 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbb041a78f0 con 0x7fbb0410d250 2024-09-10T22:25:36.371 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:36.367+0000 7fbb01ffb640 1 -- 172.21.15.19:0/1127243687 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbafc003e20 con 0x7fbb0410d250 2024-09-10T22:25:36.371 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:36.367+0000 7fbb01ffb640 1 -- 172.21.15.19:0/1127243687 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbafc010460 con 0x7fbb0410d250 2024-09-10T22:25:36.371 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:36.368+0000 7fbb0aabd640 1 -- 172.21.15.19:0/1127243687 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbb041a7e30 con 0x7fbb0410d250 2024-09-10T22:25:36.372 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:36.369+0000 7fbb0aabd640 1 -- 172.21.15.19:0/1127243687 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbb04101bf0 con 0x7fbb0410d250 2024-09-10T22:25:36.372 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:36.370+0000 7fbb01ffb640 1 -- 172.21.15.19:0/1127243687 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 17) ==== 153301+0+0 (secure 0 0 0) 0x7fbafc003970 con 0x7fbb0410d250 2024-09-10T22:25:36.372 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:36.370+0000 7fbb01ffb640 1 --2- 172.21.15.19:0/1127243687 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7fbaec0b5370 0x7fbaec0b7830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:25:36.372 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:36.371+0000 7fbb08859640 1 --2- 172.21.15.19:0/1127243687 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7fbaec0b5370 0x7fbaec0b7830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:25:36.372 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:36.371+0000 7fbb01ffb640 1 -- 172.21.15.19:0/1127243687 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8269+0+0 (secure 0 0 0) 0x7fbafc0e5b20 con 0x7fbb0410d250 2024-09-10T22:25:36.372 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:36.371+0000 7fbb08859640 1 --2- 172.21.15.19:0/1127243687 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7fbaec0b5370 0x7fbaec0b7830 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fbaf4031440 tx=0x7fbaf4005b50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:25:36.376 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:36.375+0000 7fbb01ffb640 1 -- 172.21.15.19:0/1127243687 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7fbafc0ac860 con 0x7fbb0410d250 2024-09-10T22:25:36.567 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:36.565+0000 7fbb0aabd640 1 -- 172.21.15.19:0/1127243687 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fbb041a8200 con 0x7fbb0410d250 2024-09-10T22:25:36.568 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:36.567+0000 7fbb01ffb640 1 -- 172.21.15.19:0/1127243687 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v75) ==== 74+0+22761 (secure 0 0 0) 0x7fbafc0ac160 con 0x7fbb0410d250 2024-09-10T22:25:36.568 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-10T22:25:36.569 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":75,"fsid":"22997a4c-6fc2-11ef-bcea-c7b262605968","created":"2024-09-10T22:16:16.754696+0000","modified":"2024-09-10T22:25:05.513986+0000","last_up_change":"2024-09-10T22:23:32.417392+0000","last_in_change":"2024-09-10T22:23:09.614371+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T22:19:50.731662+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-10T22:24:18.740121+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"73","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-10T22:24:20.795178+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"73","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"783d96cb-0a8a-47f3-8eab-77cd731a64bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6802","nonce":234761879},{"type":"v1","addr":"172.21.15.19:6803","nonce":234761879}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6804","nonce":234761879},{"type":"v1","addr":"172.21.15.19:6805","nonce":234761879}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6808","nonce":234761879},{"type":"v1","addr":"172.21.15.19:6809","nonce":234761879}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6806","nonce":234761879},{"type":"v1","addr":"172.21.15.19:6807","nonce":234761879}]},"public_addr":"172.21.15.19:6803/234761879","cluster_addr":"172.21.15.19:6805/234761879","heartbeat_back_addr":"172.21.15.19:6809/234761879","heartbeat_front_addr":"172.21.15.19:6807/234761879","state":["exists","up"]},{"osd":1,"uuid":"41043581-e0cf-43b5-bae0-0d95e2ef8156","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6800","nonce":1803526886},{"type":"v1","addr":"172.21.15.135:6801","nonce":1803526886}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6802","nonce":1803526886},{"type":"v1","addr":"172.21.15.135:6803","nonce":1803526886}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6806","nonce":1803526886},{"type":"v1","addr":"172.21.15.135:6807","nonce":1803526886}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6804","nonce":1803526886},{"type":"v1","addr":"172.21.15.135:6805","nonce":1803526886}]},"public_addr":"172.21.15.135:6801/1803526886","cluster_addr":"172.21.15.135:6803/1803526886","heartbeat_back_addr":"172.21.15.135:6807/1803526886","heartbeat_front_addr":"172.21.15.135:6805/1803526886","state":["exists","up"]},{"osd":2,"uuid":"a9b14a06-bbdc-4501-96e2-fb5f7127ca16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6800","nonce":2747418770},{"type":"v1","addr":"172.21.15.138:6801","nonce":2747418770}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6802","nonce":2747418770},{"type":"v1","addr":"172.21.15.138:6803","nonce":2747418770}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6806","nonce":2747418770},{"type":"v1","addr":"172.21.15.138:6807","nonce":2747418770}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6804","nonce":2747418770},{"type":"v1","addr":"172.21.15.138:6805","nonce":2747418770}]},"public_addr":"172.21.15.138:6801/2747418770","cluster_addr":"172.21.15.138:6803/2747418770","heartbeat_back_addr":"172.21.15.138:6807/2747418770","heartbeat_front_addr":"172.21.15.138:6805/2747418770","state":["exists","up"]},{"osd":3,"uuid":"a46268da-8666-4cfa-b11a-30eb12e271be","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":23,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6810","nonce":1889857224},{"type":"v1","addr":"172.21.15.19:6811","nonce":1889857224}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6812","nonce":1889857224},{"type":"v1","addr":"172.21.15.19:6813","nonce":1889857224}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6816","nonce":1889857224},{"type":"v1","addr":"172.21.15.19:6817","nonce":1889857224}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6814","nonce":1889857224},{"type":"v1","addr":"172.21.15.19:6815","nonce":1889857224}]},"public_addr":"172.21.15.19:6811/1889857224","cluster_addr":"172.21.15.19:6813/1889857224","heartbeat_back_addr":"172.21.15.19:6817/1889857224","heartbeat_front_addr":"172.21.15.19:6815/1889857224","state":["exists","up"]},{"osd":4,"uuid":"c58df06f-2de2-4655-88e7-ac6a3531839a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":29,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6808","nonce":436311825},{"type":"v1","addr":"172.21.15.135:6809","nonce":436311825}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6810","nonce":436311825},{"type":"v1","addr":"172.21.15.135:6811","nonce":436311825}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6814","nonce":436311825},{"type":"v1","addr":"172.21.15.135:6815","nonce":436311825}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6812","nonce":436311825},{"type":"v1","addr":"172.21.15.135:6813","nonce":436311825}]},"public_addr":"172.21.15.135:6809/436311825","cluster_addr":"172.21.15.135:6811/436311825","heartbeat_back_addr":"172.21.15.135:6815/436311825","heartbeat_front_addr":"172.21.15.135:6813/436311825","state":["exists","up"]},{"osd":5,"uuid":"c0900b0c-aef4-498d-a01b-a891bdb51122","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6808","nonce":1086764290},{"type":"v1","addr":"172.21.15.138:6809","nonce":1086764290}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6810","nonce":1086764290},{"type":"v1","addr":"172.21.15.138:6811","nonce":1086764290}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6814","nonce":1086764290},{"type":"v1","addr":"172.21.15.138:6815","nonce":1086764290}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6812","nonce":1086764290},{"type":"v1","addr":"172.21.15.138:6813","nonce":1086764290}]},"public_addr":"172.21.15.138:6809/1086764290","cluster_addr":"172.21.15.138:6811/1086764290","heartbeat_back_addr":"172.21.15.138:6815/1086764290","heartbeat_front_addr":"172.21.15.138:6813/1086764290","state":["exists","up"]},{"osd":6,"uuid":"f79cb310-8073-4ee5-80a6-87a290600321","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":40,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6818","nonce":406328354},{"type":"v1","addr":"172.21.15.19:6819","nonce":406328354}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6820","nonce":406328354},{"type":"v1","addr":"172.21.15.19:6821","nonce":406328354}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6824","nonce":406328354},{"type":"v1","addr":"172.21.15.19:6825","nonce":406328354}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6822","nonce":406328354},{"type":"v1","addr":"172.21.15.19:6823","nonce":406328354}]},"public_addr":"172.21.15.19:6819/406328354","cluster_addr":"172.21.15.19:6821/406328354","heartbeat_back_addr":"172.21.15.19:6825/406328354","heartbeat_front_addr":"172.21.15.19:6823/406328354","state":["exists","up"]},{"osd":7,"uuid":"cc76476a-92f3-489c-be9e-29cbbf39539e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6816","nonce":1096613674},{"type":"v1","addr":"172.21.15.135:6817","nonce":1096613674}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6818","nonce":1096613674},{"type":"v1","addr":"172.21.15.135:6819","nonce":1096613674}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6822","nonce":1096613674},{"type":"v1","addr":"172.21.15.135:6823","nonce":1096613674}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6820","nonce":1096613674},{"type":"v1","addr":"172.21.15.135:6821","nonce":1096613674}]},"public_addr":"172.21.15.135:6817/1096613674","cluster_addr":"172.21.15.135:6819/1096613674","heartbeat_back_addr":"172.21.15.135:6823/1096613674","heartbeat_front_addr":"172.21.15.135:6821/1096613674","state":["exists","up"]},{"osd":8,"uuid":"5323a006-a6e8-4403-9c51-65f46298d5c4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6816","nonce":3020394729},{"type":"v1","addr":"172.21.15.138:6817","nonce":3020394729}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6818","nonce":3020394729},{"type":"v1","addr":"172.21.15.138:6819","nonce":3020394729}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6822","nonce":3020394729},{"type":"v1","addr":"172.21.15.138:6823","nonce":3020394729}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6820","nonce":3020394729},{"type":"v1","addr":"172.21.15.138:6821","nonce":3020394729}]},"public_addr":"172.21.15.138:6817/3020394729","cluster_addr":"172.21.15.138:6819/3020394729","heartbeat_back_addr":"172.21.15.138:6823/3020394729","heartbeat_front_addr":"172.21.15.138:6821/3020394729","state":["exists","up"]},{"osd":9,"uuid":"b869ac42-c46e-442c-8b5b-f81c018e663c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":57,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6826","nonce":1488680899},{"type":"v1","addr":"172.21.15.19:6827","nonce":1488680899}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6828","nonce":1488680899},{"type":"v1","addr":"172.21.15.19:6829","nonce":1488680899}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6832","nonce":1488680899},{"type":"v1","addr":"172.21.15.19:6833","nonce":1488680899}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6830","nonce":1488680899},{"type":"v1","addr":"172.21.15.19:6831","nonce":1488680899}]},"public_addr":"172.21.15.19:6827/1488680899","cluster_addr":"172.21.15.19:6829/1488680899","heartbeat_back_addr":"172.21.15.19:6833/1488680899","heartbeat_front_addr":"172.21.15.19:6831/1488680899","state":["exists","up"]},{"osd":10,"uuid":"b8a2d69a-6821-4c69-b7eb-c0cfc8164614","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":62,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6824","nonce":3812626754},{"type":"v1","addr":"172.21.15.135:6825","nonce":3812626754}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6826","nonce":3812626754},{"type":"v1","addr":"172.21.15.135:6827","nonce":3812626754}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6830","nonce":3812626754},{"type":"v1","addr":"172.21.15.135:6831","nonce":3812626754}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6828","nonce":3812626754},{"type":"v1","addr":"172.21.15.135:6829","nonce":3812626754}]},"public_addr":"172.21.15.135:6825/3812626754","cluster_addr":"172.21.15.135:6827/3812626754","heartbeat_back_addr":"172.21.15.135:6831/3812626754","heartbeat_front_addr":"172.21.15.135:6829/3812626754","state":["exists","up"]},{"osd":11,"uuid":"a9264ab2-5843-44d2-aba8-1e12708e99d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6824","nonce":1098434807},{"type":"v1","addr":"172.21.15.138:6825","nonce":1098434807}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6826","nonce":1098434807},{"type":"v1","addr":"172.21.15.138:6827","nonce":1098434807}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6830","nonce":1098434807},{"type":"v1","addr":"172.21.15.138:6831","nonce":1098434807}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6828","nonce":1098434807},{"type":"v1","addr":"172.21.15.138:6829","nonce":1098434807}]},"public_addr":"172.21.15.138:6825/1098434807","cluster_addr":"172.21.15.138:6827/1098434807","heartbeat_back_addr":"172.21.15.138:6831/1098434807","heartbeat_front_addr":"172.21.15.138:6829/1098434807","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:18:58.008025+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:19:22.475890+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:19:47.124147+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:20:12.438853+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:20:37.195177+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:21:02.474248+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:21:27.087207+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:21:52.119211+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:22:16.569989+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:22:41.680986+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:23:06.391885+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:23:30.695460+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.0","mappings":[{"from":8,"to":4}]},{"pgid":"2.16","mappings":[{"from":2,"to":6}]},{"pgid":"2.17","mappings":[{"from":5,"to":1}]},{"pgid":"2.1a","mappings":[{"from":8,"to":1}]},{"pgid":"2.1d","mappings":[{"from":2,"to":4}]},{"pgid":"2.1f","mappings":[{"from":7,"to":11}]},{"pgid":"3.13","mappings":[{"from":4,"to":9}]},{"pgid":"3.1b","mappings":[{"from":4,"to":8}]},{"pgid":"3.21","mappings":[{"from":5,"to":9}]},{"pgid":"3.38","mappings":[{"from":3,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.19:0/2099468127":"2024-09-11T22:17:04.260826+0000","172.21.15.19:0/538724915":"2024-09-11T22:17:04.260826+0000","172.21.15.19:0/3504695777":"2024-09-11T22:17:04.260826+0000","172.21.15.19:0/1401613792":"2024-09-11T22:16:39.069638+0000","172.21.15.19:6801/3005924425":"2024-09-11T22:17:04.260826+0000","172.21.15.19:6800/3005924425":"2024-09-11T22:17:04.260826+0000","172.21.15.19:0/104917892":"2024-09-11T22:16:39.069638+0000","172.21.15.19:0/1778305990":"2024-09-11T22:16:39.069638+0000","172.21.15.19:6801/535670059":"2024-09-11T22:16:39.069638+0000","172.21.15.19:6800/535670059":"2024-09-11T22:16:39.069638+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T22:25:36.570 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:36.569+0000 7fbb0aabd640 1 -- 172.21.15.19:0/1127243687 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7fbaec0b5370 msgr2=0x7fbaec0b7830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:25:36.571 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:36.569+0000 7fbb0aabd640 1 --2- 172.21.15.19:0/1127243687 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7fbaec0b5370 0x7fbaec0b7830 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fbaf4031440 tx=0x7fbaf4005b50 comp rx=0 tx=0).stop 2024-09-10T22:25:36.571 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:36.569+0000 7fbb0aabd640 1 -- 172.21.15.19:0/1127243687 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbb0410d250 msgr2=0x7fbb04103260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:25:36.571 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:36.569+0000 7fbb0aabd640 1 --2- 172.21.15.19:0/1127243687 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbb0410d250 0x7fbb04103260 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7fbafc009fd0 tx=0x7fbafc00b260 comp rx=0 tx=0).stop 2024-09-10T22:25:36.571 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:36.569+0000 7fbb0aabd640 1 -- 172.21.15.19:0/1127243687 shutdown_connections 2024-09-10T22:25:36.571 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:36.569+0000 7fbb0aabd640 1 --2- 172.21.15.19:0/1127243687 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7fbaec0b5370 0x7fbaec0b7830 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:25:36.571 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:36.569+0000 7fbb0aabd640 1 --2- 172.21.15.19:0/1127243687 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbb0410d250 0x7fbb04103260 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:25:36.571 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:36.569+0000 7fbb0aabd640 1 --2- 172.21.15.19:0/1127243687 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fbb0410a920 0x7fbb04102d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:25:36.571 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:36.569+0000 7fbb0aabd640 1 --2- 172.21.15.19:0/1127243687 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbb04101810 0x7fbb041027e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:25:36.571 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:36.569+0000 7fbb0aabd640 1 -- 172.21.15.19:0/1127243687 >> 172.21.15.19:0/1127243687 conn(0x7fbb04076f50 msgr2=0x7fbb041005a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:25:36.571 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:36.569+0000 7fbb0aabd640 1 -- 172.21.15.19:0/1127243687 shutdown_connections 2024-09-10T22:25:36.571 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:36.569+0000 7fbb0aabd640 1 -- 172.21.15.19:0/1127243687 wait complete. 2024-09-10T22:25:37.125 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:25:36 smithi138 ceph-mon[35236]: from='client.? 172.21.15.19:0/1127243687' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-10T22:25:37.174 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:25:36 smithi019 ceph-mon[31375]: from='client.? 172.21.15.19:0/1127243687' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-10T22:25:37.206 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 22997a4c-6fc2-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-10T22:25:37.360 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:25:36 smithi135 ceph-mon[34789]: from='client.? 172.21.15.19:0/1127243687' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-10T22:25:37.466 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/22997a4c-6fc2-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T22:25:37.935 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:37.932+0000 7fd98228f640 1 -- 172.21.15.19:0/155955371 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd97c101c90 msgr2=0x7fd97c102070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:25:37.935 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:37.932+0000 7fd98228f640 1 --2- 172.21.15.19:0/155955371 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd97c101c90 0x7fd97c102070 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7fd96c009900 tx=0x7fd96c02a410 comp rx=0 tx=0).stop 2024-09-10T22:25:37.935 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:37.932+0000 7fd98228f640 1 -- 172.21.15.19:0/155955371 shutdown_connections 2024-09-10T22:25:37.935 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:37.932+0000 7fd98228f640 1 --2- 172.21.15.19:0/155955371 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd97c108020 0x7fd97c10e820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:25:37.936 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:37.932+0000 7fd98228f640 1 --2- 172.21.15.19:0/155955371 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd97c1076a0 0x7fd97c107ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:25:37.936 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:37.932+0000 7fd98228f640 1 --2- 172.21.15.19:0/155955371 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd97c101c90 0x7fd97c102070 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:25:37.936 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:37.932+0000 7fd98228f640 1 -- 172.21.15.19:0/155955371 >> 172.21.15.19:0/155955371 conn(0x7fd97c0fd700 msgr2=0x7fd97c0ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:25:37.936 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:37.932+0000 7fd98228f640 1 -- 172.21.15.19:0/155955371 shutdown_connections 2024-09-10T22:25:37.936 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:37.932+0000 7fd98228f640 1 -- 172.21.15.19:0/155955371 wait complete. 2024-09-10T22:25:37.936 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:37.932+0000 7fd98228f640 1 Processor -- start 2024-09-10T22:25:37.936 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:37.932+0000 7fd98228f640 1 -- start start 2024-09-10T22:25:37.936 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:37.933+0000 7fd98228f640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd97c101c90 0x7fd97c1992f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:25:37.936 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:37.933+0000 7fd98228f640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd97c1076a0 0x7fd97c199830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:25:37.936 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:37.933+0000 7fd98228f640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd97c108020 0x7fd97c19ebd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:25:37.936 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:37.933+0000 7fd98228f640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fd97c111ce0 con 0x7fd97c1076a0 2024-09-10T22:25:37.936 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:37.933+0000 7fd98228f640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fd97c111b60 con 0x7fd97c101c90 2024-09-10T22:25:37.937 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:37.933+0000 7fd98228f640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7fd97c111e60 con 0x7fd97c108020 2024-09-10T22:25:37.937 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:37.933+0000 7fd97b7fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd97c1076a0 0x7fd97c199830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:25:37.937 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:37.933+0000 7fd97b7fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd97c1076a0 0x7fd97c199830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:38860/0 (socket says 172.21.15.19:38860) 2024-09-10T22:25:37.937 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:37.933+0000 7fd97b7fe640 1 -- 172.21.15.19:0/1137375542 learned_addr learned my addr 172.21.15.19:0/1137375542 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:25:37.937 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:37.933+0000 7fd97bfff640 1 --2- 172.21.15.19:0/1137375542 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd97c101c90 0x7fd97c1992f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:25:37.937 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:37.933+0000 7fd98082c640 1 --2- 172.21.15.19:0/1137375542 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd97c108020 0x7fd97c19ebd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:25:37.937 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:37.933+0000 7fd97b7fe640 1 -- 172.21.15.19:0/1137375542 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd97c108020 msgr2=0x7fd97c19ebd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:25:37.937 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:37.933+0000 7fd97b7fe640 1 --2- 172.21.15.19:0/1137375542 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd97c108020 0x7fd97c19ebd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:25:37.937 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:37.933+0000 7fd97b7fe640 1 -- 172.21.15.19:0/1137375542 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd97c101c90 msgr2=0x7fd97c1992f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:25:37.937 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:37.933+0000 7fd97b7fe640 1 --2- 172.21.15.19:0/1137375542 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd97c101c90 0x7fd97c1992f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:25:37.937 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:37.933+0000 7fd97b7fe640 1 -- 172.21.15.19:0/1137375542 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd97c19f3a0 con 0x7fd97c1076a0 2024-09-10T22:25:37.938 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:37.933+0000 7fd97b7fe640 1 --2- 172.21.15.19:0/1137375542 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd97c1076a0 0x7fd97c199830 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7fd97000d950 tx=0x7fd97000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:25:37.938 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:37.933+0000 7fd9797fa640 1 -- 172.21.15.19:0/1137375542 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd970017070 con 0x7fd97c1076a0 2024-09-10T22:25:37.938 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:37.934+0000 7fd9797fa640 1 -- 172.21.15.19:0/1137375542 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd970009c30 con 0x7fd97c1076a0 2024-09-10T22:25:37.938 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:37.934+0000 7fd98228f640 1 -- 172.21.15.19:0/1137375542 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd97c19f690 con 0x7fd97c1076a0 2024-09-10T22:25:37.938 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:37.934+0000 7fd9797fa640 1 -- 172.21.15.19:0/1137375542 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd97000f620 con 0x7fd97c1076a0 2024-09-10T22:25:37.938 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:37.934+0000 7fd98228f640 1 -- 172.21.15.19:0/1137375542 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd97c1a5d50 con 0x7fd97c1076a0 2024-09-10T22:25:37.939 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:37.935+0000 7fd98228f640 1 -- 172.21.15.19:0/1137375542 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd97c102070 con 0x7fd97c1076a0 2024-09-10T22:25:37.939 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:37.936+0000 7fd9797fa640 1 -- 172.21.15.19:0/1137375542 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 17) ==== 153301+0+0 (secure 0 0 0) 0x7fd970010460 con 0x7fd97c1076a0 2024-09-10T22:25:37.939 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:37.937+0000 7fd9797fa640 1 --2- 172.21.15.19:0/1137375542 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7fd9640b5370 0x7fd9640b7830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:25:37.939 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:37.937+0000 7fd97bfff640 1 --2- 172.21.15.19:0/1137375542 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7fd9640b5370 0x7fd9640b7830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:25:37.939 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:37.937+0000 7fd9797fa640 1 -- 172.21.15.19:0/1137375542 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8269+0+0 (secure 0 0 0) 0x7fd9700e59c0 con 0x7fd97c1076a0 2024-09-10T22:25:37.939 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:37.937+0000 7fd97bfff640 1 --2- 172.21.15.19:0/1137375542 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7fd9640b5370 0x7fd9640b7830 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fd96c031440 tx=0x7fd96c005b50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:25:37.941 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:37.940+0000 7fd9797fa640 1 -- 172.21.15.19:0/1137375542 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7fd9700ac700 con 0x7fd97c1076a0 2024-09-10T22:25:38.163 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:38.162+0000 7fd98228f640 1 -- 172.21.15.19:0/1137375542 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd97c1a60c0 con 0x7fd97c1076a0 2024-09-10T22:25:38.163 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:25:37 smithi019 ceph-mon[31375]: pgmap v321: 97 pgs: 97 active+clean; 639 KiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-10T22:25:38.164 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:38.162+0000 7fd9797fa640 1 -- 172.21.15.19:0/1137375542 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) ==== 94+0+11921 (secure 0 0 0) 0x7fd970009de0 con 0x7fd97c1076a0 2024-09-10T22:25:38.164 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-10T22:25:38.164 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":24,"btime":"2024-09-10T22:24:34:220851+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14673,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6835/1835804747","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6834","nonce":1835804747},{"type":"v1","addr":"172.21.15.19:6835","nonce":1835804747}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14685,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6837/1750470490","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6836","nonce":1750470490},{"type":"v1","addr":"172.21.15.19:6837","nonce":1750470490}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14733,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6839/2642941149","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6838","nonce":2642941149},{"type":"v1","addr":"172.21.15.19:6839","nonce":2642941149}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14745,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6841/2449948682","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6840","nonce":2449948682},{"type":"v1","addr":"172.21.15.19:6841","nonce":2449948682}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24511,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.138:6833/2524811494","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6832","nonce":2524811494},{"type":"v1","addr":"172.21.15.138:6833","nonce":2524811494}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24512,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6833/3014993624","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6832","nonce":3014993624},{"type":"v1","addr":"172.21.15.135:6833","nonce":3014993624}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":24,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-10T22:24:22.733925+0000","modified":"2024-09-10T22:24:33.797491+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24581,"mds_1":24568,"mds_2":24553},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24527":{"gid":24527,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.135:6835/3715773348","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6834","nonce":3715773348},{"type":"v1","addr":"172.21.15.135:6835","nonce":3715773348}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24541":{"gid":24541,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.138:6835/933547028","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6834","nonce":933547028},{"type":"v1","addr":"172.21.15.138:6835","nonce":933547028}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24551":{"gid":24551,"name":"h","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.135:6837/3495029135","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6836","nonce":3495029135},{"type":"v1","addr":"172.21.15.135:6837","nonce":3495029135}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24553":{"gid":24553,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":10,"addr":"172.21.15.138:6837/3353290042","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6836","nonce":3353290042},{"type":"v1","addr":"172.21.15.138:6837","nonce":3353290042}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24568":{"gid":24568,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.138:6839/383637208","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6838","nonce":383637208},{"type":"v1","addr":"172.21.15.138:6839","nonce":383637208}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24581":{"gid":24581,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.135:6839/1254769802","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6838","nonce":1254769802},{"type":"v1","addr":"172.21.15.135:6839","nonce":1254769802}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24581,"qdb_cluster":[24553,24568,24581]},"id":1}]} 2024-09-10T22:25:38.165 INFO:teuthology.orchestra.run.smithi019.stderr:dumped fsmap epoch 24 2024-09-10T22:25:38.167 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:38.165+0000 7fd98228f640 1 -- 172.21.15.19:0/1137375542 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7fd9640b5370 msgr2=0x7fd9640b7830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:25:38.167 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:38.165+0000 7fd98228f640 1 --2- 172.21.15.19:0/1137375542 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7fd9640b5370 0x7fd9640b7830 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fd96c031440 tx=0x7fd96c005b50 comp rx=0 tx=0).stop 2024-09-10T22:25:38.167 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:38.165+0000 7fd98228f640 1 -- 172.21.15.19:0/1137375542 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd97c1076a0 msgr2=0x7fd97c199830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:25:38.167 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:38.165+0000 7fd98228f640 1 --2- 172.21.15.19:0/1137375542 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd97c1076a0 0x7fd97c199830 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7fd97000d950 tx=0x7fd97000de10 comp rx=0 tx=0).stop 2024-09-10T22:25:38.167 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:38.165+0000 7fd98228f640 1 -- 172.21.15.19:0/1137375542 shutdown_connections 2024-09-10T22:25:38.167 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:38.165+0000 7fd98228f640 1 --2- 172.21.15.19:0/1137375542 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7fd9640b5370 0x7fd9640b7830 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:25:38.167 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:38.165+0000 7fd98228f640 1 --2- 172.21.15.19:0/1137375542 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd97c108020 0x7fd97c19ebd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:25:38.167 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:38.165+0000 7fd98228f640 1 --2- 172.21.15.19:0/1137375542 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd97c1076a0 0x7fd97c199830 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:25:38.167 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:38.165+0000 7fd98228f640 1 --2- 172.21.15.19:0/1137375542 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd97c101c90 0x7fd97c1992f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:25:38.168 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:38.165+0000 7fd98228f640 1 -- 172.21.15.19:0/1137375542 >> 172.21.15.19:0/1137375542 conn(0x7fd97c0fd700 msgr2=0x7fd97c06abf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:25:38.168 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:38.166+0000 7fd98228f640 1 -- 172.21.15.19:0/1137375542 shutdown_connections 2024-09-10T22:25:38.168 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:38.166+0000 7fd98228f640 1 -- 172.21.15.19:0/1137375542 wait complete. 2024-09-10T22:25:38.359 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:25:37 smithi135 ceph-mon[34789]: pgmap v321: 97 pgs: 97 active+clean; 639 KiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-10T22:25:38.375 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:25:37 smithi138 ceph-mon[35236]: pgmap v321: 97 pgs: 97 active+clean; 639 KiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-10T22:25:38.891 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 24, 'flags': 50, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': True, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 32, 'explicitly_allowed_features': 32, 'created': '2024-09-10T22:24:22.733925+0000', 'modified': '2024-09-10T22:24:33.797491+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 3, 'in': [0, 1, 2], 'up': {'mds_0': 24581, 'mds_1': 24568, 'mds_2': 24553}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_24527': {'gid': 24527, 'name': 'e', 'rank': 2, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.135:6835/3715773348', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.135:6834', 'nonce': 3715773348}, {'type': 'v1', 'addr': '172.21.15.135:6835', 'nonce': 3715773348}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24541': {'gid': 24541, 'name': 'f', 'rank': 1, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.138:6835/933547028', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.138:6834', 'nonce': 933547028}, {'type': 'v1', 'addr': '172.21.15.138:6835', 'nonce': 933547028}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24551': {'gid': 24551, 'name': 'h', 'rank': 0, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.135:6837/3495029135', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.135:6836', 'nonce': 3495029135}, {'type': 'v1', 'addr': '172.21.15.135:6837', 'nonce': 3495029135}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24553': {'gid': 24553, 'name': 'c', 'rank': 2, 'incarnation': 21, 'state': 'up:active', 'state_seq': 10, 'addr': '172.21.15.138:6837/3353290042', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.138:6836', 'nonce': 3353290042}, {'type': 'v1', 'addr': '172.21.15.138:6837', 'nonce': 3353290042}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24568': {'gid': 24568, 'name': 'i', 'rank': 1, 'incarnation': 19, 'state': 'up:active', 'state_seq': 8, 'addr': '172.21.15.138:6839/383637208', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.138:6838', 'nonce': 383637208}, {'type': 'v1', 'addr': '172.21.15.138:6839', 'nonce': 383637208}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24581': {'gid': 24581, 'name': 'b', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.135:6839/1254769802', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.135:6838', 'nonce': 1254769802}, {'type': 'v1', 'addr': '172.21.15.135:6839', 'nonce': 1254769802}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 24581, 'qdb_cluster': [24553, 24568, 24581]} 2024-09-10T22:25:38.891 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 3/3 2024-09-10T22:25:38.891 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 22997a4c-6fc2-11ef-bcea-c7b262605968 -- ceph tell mds.c status 2024-09-10T22:25:39.154 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/22997a4c-6fc2-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T22:25:39.208 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:25:38 smithi019 ceph-mon[31375]: from='client.? 172.21.15.19:0/1137375542' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T22:25:39.360 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:25:38 smithi135 ceph-mon[34789]: from='client.? 172.21.15.19:0/1137375542' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T22:25:39.375 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:25:38 smithi138 ceph-mon[35236]: from='client.? 172.21.15.19:0/1137375542' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T22:25:39.693 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:39.692+0000 7f6c20feb640 1 -- 172.21.15.19:0/2560367722 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6c1c1076a0 msgr2=0x7f6c1c107ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:25:39.693 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:39.692+0000 7f6c20feb640 1 --2- 172.21.15.19:0/2560367722 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6c1c1076a0 0x7f6c1c107ae0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f6c0c009900 tx=0x7f6c0c02a410 comp rx=0 tx=0).stop 2024-09-10T22:25:39.694 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:39.692+0000 7f6c20feb640 1 -- 172.21.15.19:0/2560367722 shutdown_connections 2024-09-10T22:25:39.694 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:39.692+0000 7f6c20feb640 1 --2- 172.21.15.19:0/2560367722 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f6c1c108020 0x7f6c1c10e820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:25:39.694 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:39.692+0000 7f6c20feb640 1 --2- 172.21.15.19:0/2560367722 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6c1c1076a0 0x7f6c1c107ae0 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:25:39.694 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:39.692+0000 7f6c20feb640 1 --2- 172.21.15.19:0/2560367722 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6c1c101c90 0x7f6c1c102070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:25:39.694 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:39.692+0000 7f6c20feb640 1 -- 172.21.15.19:0/2560367722 >> 172.21.15.19:0/2560367722 conn(0x7f6c1c0fd700 msgr2=0x7f6c1c0ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:25:39.694 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:39.692+0000 7f6c20feb640 1 -- 172.21.15.19:0/2560367722 shutdown_connections 2024-09-10T22:25:39.694 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:39.692+0000 7f6c20feb640 1 -- 172.21.15.19:0/2560367722 wait complete. 2024-09-10T22:25:39.696 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:39.693+0000 7f6c20feb640 1 Processor -- start 2024-09-10T22:25:39.696 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:39.693+0000 7f6c20feb640 1 -- start start 2024-09-10T22:25:39.696 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:39.693+0000 7f6c20feb640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6c1c101c90 0x7f6c1c199270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:25:39.696 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:39.693+0000 7f6c20feb640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f6c1c1076a0 0x7f6c1c1997b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:25:39.696 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:39.693+0000 7f6c20feb640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6c1c108020 0x7f6c1c19eb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:25:39.696 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:39.693+0000 7f6c20feb640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f6c1c111c70 con 0x7f6c1c108020 2024-09-10T22:25:39.697 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:39.693+0000 7f6c20feb640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f6c1c111af0 con 0x7f6c1c101c90 2024-09-10T22:25:39.697 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:39.693+0000 7f6c20feb640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f6c1c111df0 con 0x7f6c1c1076a0 2024-09-10T22:25:39.697 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:39.693+0000 7f6c1ad9d640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6c1c108020 0x7f6c1c19eb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:25:39.697 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:39.693+0000 7f6c1ad9d640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6c1c108020 0x7f6c1c19eb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:38870/0 (socket says 172.21.15.19:38870) 2024-09-10T22:25:39.697 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:39.693+0000 7f6c1ad9d640 1 -- 172.21.15.19:0/446493462 learned_addr learned my addr 172.21.15.19:0/446493462 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:25:39.697 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:39.693+0000 7f6c19d9b640 1 --2- 172.21.15.19:0/446493462 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f6c1c1076a0 0x7f6c1c1997b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:25:39.697 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:39.693+0000 7f6c1a59c640 1 --2- 172.21.15.19:0/446493462 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6c1c101c90 0x7f6c1c199270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:25:39.697 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:39.693+0000 7f6c1ad9d640 1 -- 172.21.15.19:0/446493462 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f6c1c1076a0 msgr2=0x7f6c1c1997b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:25:39.697 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:39.693+0000 7f6c1ad9d640 1 --2- 172.21.15.19:0/446493462 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f6c1c1076a0 0x7f6c1c1997b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:25:39.697 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:39.693+0000 7f6c1ad9d640 1 -- 172.21.15.19:0/446493462 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6c1c101c90 msgr2=0x7f6c1c199270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:25:39.697 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:39.693+0000 7f6c1ad9d640 1 --2- 172.21.15.19:0/446493462 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6c1c101c90 0x7f6c1c199270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:25:39.697 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:39.693+0000 7f6c1ad9d640 1 -- 172.21.15.19:0/446493462 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6c1c19f320 con 0x7f6c1c108020 2024-09-10T22:25:39.698 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:39.694+0000 7f6c1ad9d640 1 --2- 172.21.15.19:0/446493462 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6c1c108020 0x7f6c1c19eb50 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f6c1400eaa0 tx=0x7f6c1400eea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:25:39.698 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:39.694+0000 7f6c137fe640 1 -- 172.21.15.19:0/446493462 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c14004d20 con 0x7f6c1c108020 2024-09-10T22:25:39.698 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:39.694+0000 7f6c137fe640 1 -- 172.21.15.19:0/446493462 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6c14005020 con 0x7f6c1c108020 2024-09-10T22:25:39.698 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:39.694+0000 7f6c20feb640 1 -- 172.21.15.19:0/446493462 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6c1c19f610 con 0x7f6c1c108020 2024-09-10T22:25:39.698 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:39.694+0000 7f6c137fe640 1 -- 172.21.15.19:0/446493462 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c140116b0 con 0x7f6c1c108020 2024-09-10T22:25:39.698 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:39.694+0000 7f6c20feb640 1 -- 172.21.15.19:0/446493462 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6c1c1a5cd0 con 0x7f6c1c108020 2024-09-10T22:25:39.703 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:39.696+0000 7f6c137fe640 1 -- 172.21.15.19:0/446493462 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 17) ==== 153301+0+0 (secure 0 0 0) 0x7f6c1400f040 con 0x7f6c1c108020 2024-09-10T22:25:39.703 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:39.697+0000 7f6c233c0740 1 Processor -- start 2024-09-10T22:25:39.703 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:39.697+0000 7f6c233c0740 1 -- start start 2024-09-10T22:25:39.703 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:39.697+0000 7f6c233c0740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55fad19dfd30 0x55fad19e0110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:25:39.703 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:39.697+0000 7f6c233c0740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55fad19e0650 0x55fad19f04b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:25:39.703 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:39.697+0000 7f6c233c0740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55fad19f09f0 0x55fad19f2de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:25:39.704 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:39.697+0000 7f6c233c0740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x55fad1957c10 con 0x55fad19dfd30 2024-09-10T22:25:39.704 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:39.697+0000 7f6c233c0740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55fad1947040 con 0x55fad19e0650 2024-09-10T22:25:39.704 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:39.697+0000 7f6c233c0740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x55fad194ae50 con 0x55fad19f09f0 2024-09-10T22:25:39.704 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:39.697+0000 7f6c19d9b640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55fad19dfd30 0x55fad19e0110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:25:39.704 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:39.697+0000 7f6c19d9b640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55fad19dfd30 0x55fad19e0110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:38882/0 (socket says 172.21.15.19:38882) 2024-09-10T22:25:39.704 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:39.697+0000 7f6c19d9b640 1 -- 172.21.15.19:0/433754175 learned_addr learned my addr 172.21.15.19:0/433754175 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:25:39.704 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:39.697+0000 7f6c1a59c640 1 --2- 172.21.15.19:0/433754175 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55fad19e0650 0x55fad19f04b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:25:39.704 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:39.698+0000 7f6c137fe640 1 --2- 172.21.15.19:0/446493462 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f6c080b53f0 0x7f6c080b78b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:25:39.704 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:39.698+0000 7f6c19d9b640 1 -- 172.21.15.19:0/433754175 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55fad19f09f0 msgr2=0x55fad19f2de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:25:39.704 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:39.698+0000 7f6c19d9b640 1 --2- 172.21.15.19:0/433754175 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55fad19f09f0 0x55fad19f2de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:25:39.704 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:39.698+0000 7f6c19d9b640 1 -- 172.21.15.19:0/433754175 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55fad19e0650 msgr2=0x55fad19f04b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:25:39.704 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:39.698+0000 7f6c19d9b640 1 --2- 172.21.15.19:0/433754175 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55fad19e0650 0x55fad19f04b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:25:39.705 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:39.698+0000 7f6c19d9b640 1 -- 172.21.15.19:0/433754175 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fad16a5540 con 0x55fad19dfd30 2024-09-10T22:25:39.705 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:39.698+0000 7f6c1a59c640 1 --2- 172.21.15.19:0/433754175 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55fad19e0650 0x55fad19f04b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T22:25:39.705 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:39.698+0000 7f6c1ad9d640 1 --2- 172.21.15.19:0/446493462 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f6c080b53f0 0x7f6c080b78b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:25:39.705 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:39.698+0000 7f6c19d9b640 1 --2- 172.21.15.19:0/433754175 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55fad19dfd30 0x55fad19e0110 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f6c0c033000 tx=0x7f6c0c009680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c26a405c91a94826 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:25:39.705 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:39.698+0000 7f6c137fe640 1 -- 172.21.15.19:0/446493462 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8269+0+0 (secure 0 0 0) 0x7f6c140e5bc0 con 0x7f6c1c108020 2024-09-10T22:25:39.705 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:39.698+0000 7f6c10ff9640 1 -- 172.21.15.19:0/433754175 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c0c035040 con 0x55fad19dfd30 2024-09-10T22:25:39.705 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:39.698+0000 7f6c10ff9640 1 -- 172.21.15.19:0/433754175 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6c0c0316a0 con 0x55fad19dfd30 2024-09-10T22:25:39.705 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:39.698+0000 7f6c10ff9640 1 -- 172.21.15.19:0/433754175 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c0c004750 con 0x55fad19dfd30 2024-09-10T22:25:39.705 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:39.699+0000 7f6c233c0740 1 -- 172.21.15.19:0/433754175 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55fad19dfd30 msgr2=0x55fad19e0110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:25:39.705 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:39.699+0000 7f6c1ad9d640 1 --2- 172.21.15.19:0/446493462 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f6c080b53f0 0x7f6c080b78b0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f6c140abea0 tx=0x7f6c14079670 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:25:39.705 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:39.699+0000 7f6c233c0740 1 --2- 172.21.15.19:0/433754175 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55fad19dfd30 0x55fad19e0110 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f6c0c033000 tx=0x7f6c0c009680 comp rx=0 tx=0).stop 2024-09-10T22:25:39.705 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:39.699+0000 7f6c233c0740 1 -- 172.21.15.19:0/433754175 shutdown_connections 2024-09-10T22:25:39.706 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:39.699+0000 7f6c233c0740 1 --2- 172.21.15.19:0/433754175 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55fad19f09f0 0x55fad19f2de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:25:39.706 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:39.699+0000 7f6c233c0740 1 --2- 172.21.15.19:0/433754175 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55fad19e0650 0x55fad19f04b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:25:39.706 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:39.699+0000 7f6c233c0740 1 --2- 172.21.15.19:0/433754175 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55fad19dfd30 0x55fad19e0110 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:25:39.706 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:39.699+0000 7f6c233c0740 1 -- 172.21.15.19:0/433754175 >> 172.21.15.19:0/433754175 conn(0x55fad19ddb60 msgr2=0x55fad19ded00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:25:39.706 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:39.699+0000 7f6c233c0740 1 -- 172.21.15.19:0/433754175 shutdown_connections 2024-09-10T22:25:39.706 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:39.699+0000 7f6c233c0740 1 -- 172.21.15.19:0/433754175 wait complete. 2024-09-10T22:25:39.706 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:39.699+0000 7f6c233c0740 1 -- start start 2024-09-10T22:25:39.706 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:39.700+0000 7f6c233c0740 1 Processor -- start 2024-09-10T22:25:39.706 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:39.700+0000 7f6c233c0740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55fad19dfd30 0x55fad19ed980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:25:39.706 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:39.700+0000 7f6c233c0740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55fad19e0650 0x55fad19edec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:25:39.706 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:39.700+0000 7f6c233c0740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55fad19f09f0 0x55fad19ee400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:25:39.706 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:39.700+0000 7f6c233c0740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x55fad17a85f0 con 0x55fad19e0650 2024-09-10T22:25:39.706 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:39.700+0000 7f6c233c0740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55fad18e2010 con 0x55fad19f09f0 2024-09-10T22:25:39.706 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:39.700+0000 7f6c233c0740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x55fad19f3640 con 0x55fad19dfd30 2024-09-10T22:25:39.706 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:39.700+0000 7f6c233c0740 10 client.0 _ll_register_callbacks cb 0x55fad1941340 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T22:25:39.707 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:39.700+0000 7f6c1a59c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55fad19e0650 0x55fad19edec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:25:39.707 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:39.700+0000 7f6c1a59c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55fad19e0650 0x55fad19edec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:38898/0 (socket says 172.21.15.19:38898) 2024-09-10T22:25:39.707 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:39.700+0000 7f6c1a59c640 1 -- 172.21.15.19:0/1284759175 learned_addr learned my addr 172.21.15.19:0/1284759175 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:25:39.707 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:39.700+0000 7f6c19d9b640 1 --2- 172.21.15.19:0/1284759175 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55fad19dfd30 0x55fad19ed980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:25:39.707 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:39.700+0000 7f6c19d9b640 1 --2- 172.21.15.19:0/1284759175 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55fad19f09f0 0x55fad19ee400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:25:39.707 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:39.700+0000 7f6c1a59c640 1 -- 172.21.15.19:0/1284759175 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55fad19dfd30 msgr2=0x55fad19ed980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:25:39.707 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:39.700+0000 7f6c1a59c640 1 --2- 172.21.15.19:0/1284759175 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55fad19dfd30 0x55fad19ed980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:25:39.707 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:39.700+0000 7f6c1a59c640 1 -- 172.21.15.19:0/1284759175 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55fad19f09f0 msgr2=0x55fad19ee400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:25:39.707 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:39.700+0000 7f6c1a59c640 1 --2- 172.21.15.19:0/1284759175 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55fad19f09f0 0x55fad19ee400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:25:39.707 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:39.700+0000 7f6c1a59c640 1 -- 172.21.15.19:0/1284759175 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fad190fa00 con 0x55fad19e0650 2024-09-10T22:25:39.707 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:39.700+0000 7f6c1a59c640 1 --2- 172.21.15.19:0/1284759175 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55fad19e0650 0x55fad19edec0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f6c04011800 tx=0x7f6c04011cc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5f4cf93d6fcbeca1 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:25:39.707 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:39.700+0000 7f6c01ffb640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-10T22:25:39.708 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:39.701+0000 7f6c01ffb640 1 -- 172.21.15.19:0/1284759175 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c0401f060 con 0x55fad19e0650 2024-09-10T22:25:39.708 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:39.701+0000 7f6c01ffb640 1 -- 172.21.15.19:0/1284759175 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8269+0+0 (secure 0 0 0) 0x7f6c0400fd50 con 0x55fad19e0650 2024-09-10T22:25:39.708 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:39.701+0000 7f6c233c0740 1 -- 172.21.15.19:0/1284759175 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6c0c0316a0 con 0x55fad19e0650 2024-09-10T22:25:39.708 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:39.701+0000 7f6c01ffb640 1 -- 172.21.15.19:0/1284759175 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f6c04012450 con 0x55fad19e0650 2024-09-10T22:25:39.708 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:39.701+0000 7f6c233c0740 10 client.15111 fetch_fsmap learned FSMap version 24 2024-09-10T22:25:39.708 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:39.701+0000 7f6c233c0740 1 -- 172.21.15.19:0/1284759175 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55fad19ff200 con 0x55fad19e0650 2024-09-10T22:25:39.708 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:39.701+0000 7f6c01ffb640 1 -- 172.21.15.19:0/1284759175 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6c0c0316a0 con 0x55fad19e0650 2024-09-10T22:25:39.708 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:39.701+0000 7f6c01ffb640 1 -- 172.21.15.19:0/1284759175 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f6c04025630 con 0x55fad19e0650 2024-09-10T22:25:39.708 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:39.701+0000 7f6c233c0740 10 client.15111 fetch_fsmap finished waiting for FSMap version 24 2024-09-10T22:25:39.708 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:39.701+0000 7f6c233c0740 10 client.15111 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-10T22:25:39.708 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:39.701+0000 7f6c233c0740 20 client.15111 populate_metadata read hostname 'smithi019' 2024-09-10T22:25:39.708 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:39.701+0000 7f6c233c0740 1 --2- 172.21.15.19:0/1284759175 >> [v2:172.21.15.138:6836/3353290042,v1:172.21.15.138:6837/3353290042] conn(0x55fad1a01850 0x55fad1a02cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:25:39.708 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:39.701+0000 7f6c233c0740 4 client.15111 mds_command: new command op to 24553 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T22:25:39.709 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:39.701+0000 7f6c233c0740 1 -- 172.21.15.19:0/1284759175 --> [v2:172.21.15.138:6836/3353290042,v1:172.21.15.138:6837/3353290042] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55fad1959b60 con 0x55fad1a01850 2024-09-10T22:25:39.709 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:39.702+0000 7f6c19d9b640 1 --2- 172.21.15.19:0/1284759175 >> [v2:172.21.15.138:6836/3353290042,v1:172.21.15.138:6837/3353290042] conn(0x55fad1a01850 0x55fad1a02cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:25:39.709 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:39.702+0000 7f6c01ffb640 10 client.15111 ms_handle_connect on v2:172.21.15.138:6836/3353290042 2024-09-10T22:25:39.709 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:39.702+0000 7f6c19d9b640 1 --2- 172.21.15.19:0/1284759175 >> [v2:172.21.15.138:6836/3353290042,v1:172.21.15.138:6837/3353290042] conn(0x55fad1a01850 0x55fad1a02cc0 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=74affa85c812bcac server_cookie=be8e7967fd5220b7 in_seq=0 out_seq=0 2024-09-10T22:25:39.710 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:39.703+0000 7f6c01ffb640 1 -- 172.21.15.19:0/1284759175 <== mds.2 v2:172.21.15.138:6836/3353290042 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55fad1959b60 con 0x55fad1a01850 2024-09-10T22:25:39.710 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:39.703+0000 7f6c01ffb640 10 client.15111 handle_command_reply: tid=0 2024-09-10T22:25:39.710 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:39.703+0000 7f6c233c0740 1 client.15111 shutdown 2024-09-10T22:25:39.710 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:39.703+0000 7f6c233c0740 1 -- 172.21.15.19:0/1284759175 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55fad19e0650 msgr2=0x55fad19edec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:25:39.710 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:39.703+0000 7f6c233c0740 1 --2- 172.21.15.19:0/1284759175 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55fad19e0650 0x55fad19edec0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f6c04011800 tx=0x7f6c04011cc0 comp rx=0 tx=0).stop 2024-09-10T22:25:39.710 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:39.703+0000 7f6c233c0740 1 -- 172.21.15.19:0/1284759175 shutdown_connections 2024-09-10T22:25:39.710 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:39.703+0000 7f6c233c0740 1 --2- 172.21.15.19:0/1284759175 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55fad19f09f0 0x55fad19ee400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:25:39.710 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:39.703+0000 7f6c233c0740 1 --2- 172.21.15.19:0/1284759175 >> [v2:172.21.15.138:6836/3353290042,v1:172.21.15.138:6837/3353290042] conn(0x55fad1a01850 0x55fad1a02cc0 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:25:39.710 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:39.703+0000 7f6c233c0740 1 --2- 172.21.15.19:0/1284759175 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55fad19e0650 0x55fad19edec0 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:25:39.710 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:39.703+0000 7f6c233c0740 1 --2- 172.21.15.19:0/1284759175 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55fad19dfd30 0x55fad19ed980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:25:39.711 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:39.703+0000 7f6c233c0740 1 -- 172.21.15.19:0/1284759175 >> 172.21.15.19:0/1284759175 conn(0x55fad19ddb60 msgr2=0x55fad19dcd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:25:39.711 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:39.703+0000 7f6c01ffb640 0 client.15111 ms_handle_reset on v2:172.21.15.138:6836/3353290042 2024-09-10T22:25:39.711 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:39.703+0000 7f6c233c0740 1 -- 172.21.15.19:0/1284759175 shutdown_connections 2024-09-10T22:25:39.711 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:39.703+0000 7f6c233c0740 1 -- 172.21.15.19:0/1284759175 wait complete. 2024-09-10T22:25:39.711 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:39.703+0000 7f6c233c0740 20 client.15111 trim_cache size 0 max 16384 2024-09-10T22:25:39.724 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:39.722+0000 7f6c233c0740 1 Processor -- start 2024-09-10T22:25:39.724 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:39.722+0000 7f6c233c0740 1 -- start start 2024-09-10T22:25:39.724 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:39.722+0000 7f6c233c0740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55fad19dfd30 0x55fad19ee740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:25:39.724 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:39.722+0000 7f6c233c0740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55fad19e0650 0x55fad19eb480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:25:39.724 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:39.722+0000 7f6c233c0740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55fad19f09f0 0x55fad19f1a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:25:39.724 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:39.722+0000 7f6c233c0740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x55fad1a01000 con 0x55fad19f09f0 2024-09-10T22:25:39.724 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:39.722+0000 7f6c233c0740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55fad1a016d0 con 0x55fad19e0650 2024-09-10T22:25:39.724 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:39.722+0000 7f6c233c0740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x55fad1a01da0 con 0x55fad19dfd30 2024-09-10T22:25:39.724 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:39.722+0000 7f6c19d9b640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55fad19f09f0 0x55fad19f1a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:25:39.724 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:39.722+0000 7f6c19d9b640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55fad19f09f0 0x55fad19f1a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:38914/0 (socket says 172.21.15.19:38914) 2024-09-10T22:25:39.724 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:39.722+0000 7f6c19d9b640 1 -- 172.21.15.19:0/3034779026 learned_addr learned my addr 172.21.15.19:0/3034779026 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:25:39.725 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:39.722+0000 7f6c19d9b640 1 --2- 172.21.15.19:0/3034779026 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55fad19dfd30 0x55fad19ee740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:25:39.725 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:39.722+0000 7f6c1a59c640 1 --2- 172.21.15.19:0/3034779026 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55fad19e0650 0x55fad19eb480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:25:39.725 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:39.722+0000 7f6c19d9b640 1 -- 172.21.15.19:0/3034779026 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55fad19dfd30 msgr2=0x55fad19ee740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:25:39.725 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:39.722+0000 7f6c19d9b640 1 --2- 172.21.15.19:0/3034779026 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55fad19dfd30 0x55fad19ee740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:25:39.725 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:39.722+0000 7f6c19d9b640 1 -- 172.21.15.19:0/3034779026 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55fad19e0650 msgr2=0x55fad19eb480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:25:39.725 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:39.722+0000 7f6c19d9b640 1 --2- 172.21.15.19:0/3034779026 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55fad19e0650 0x55fad19eb480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:25:39.725 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:39.722+0000 7f6c19d9b640 1 -- 172.21.15.19:0/3034779026 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fad19e0480 con 0x55fad19f09f0 2024-09-10T22:25:39.725 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:39.722+0000 7f6c19d9b640 1 --2- 172.21.15.19:0/3034779026 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55fad19f09f0 0x55fad19f1a70 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f6c0c032df0 tx=0x7f6c0c000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fcbae82db2da7cac server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:25:39.725 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:39.723+0000 7f6c03fff640 1 -- 172.21.15.19:0/3034779026 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c0c035040 con 0x55fad19f09f0 2024-09-10T22:25:39.725 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:39.723+0000 7f6c03fff640 1 -- 172.21.15.19:0/3034779026 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6c0c0054c0 con 0x55fad19f09f0 2024-09-10T22:25:39.725 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:39.723+0000 7f6c03fff640 1 -- 172.21.15.19:0/3034779026 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c0c032260 con 0x55fad19f09f0 2024-09-10T22:25:39.729 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:39.723+0000 7f6c233c0740 1 -- 172.21.15.19:0/3034779026 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55fad19f09f0 msgr2=0x55fad19f1a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:25:39.729 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:39.723+0000 7f6c233c0740 1 --2- 172.21.15.19:0/3034779026 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55fad19f09f0 0x55fad19f1a70 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f6c0c032df0 tx=0x7f6c0c000bc0 comp rx=0 tx=0).stop 2024-09-10T22:25:39.729 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:39.723+0000 7f6c233c0740 1 -- 172.21.15.19:0/3034779026 shutdown_connections 2024-09-10T22:25:39.729 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:39.723+0000 7f6c233c0740 1 --2- 172.21.15.19:0/3034779026 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55fad19f09f0 0x55fad19f1a70 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:25:39.729 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:39.723+0000 7f6c233c0740 1 --2- 172.21.15.19:0/3034779026 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55fad19e0650 0x55fad19eb480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:25:39.729 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:39.723+0000 7f6c233c0740 1 --2- 172.21.15.19:0/3034779026 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55fad19dfd30 0x55fad19ee740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:25:39.729 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:39.723+0000 7f6c233c0740 1 -- 172.21.15.19:0/3034779026 >> 172.21.15.19:0/3034779026 conn(0x55fad19ddb60 msgr2=0x55fad19f2a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:25:39.729 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:39.723+0000 7f6c233c0740 1 -- 172.21.15.19:0/3034779026 shutdown_connections 2024-09-10T22:25:39.729 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:39.723+0000 7f6c233c0740 1 -- 172.21.15.19:0/3034779026 wait complete. 2024-09-10T22:25:39.729 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:39.724+0000 7f6c233c0740 1 -- start start 2024-09-10T22:25:39.730 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:39.724+0000 7f6c233c0740 1 Processor -- start 2024-09-10T22:25:39.730 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:39.724+0000 7f6c233c0740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55fad19dfd30 0x55fad19e2140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:25:39.730 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:39.724+0000 7f6c233c0740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55fad19e0650 0x55fad19dc4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:25:39.730 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:39.724+0000 7f6c233c0740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55fad19f09f0 0x55fad19dca20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:25:39.730 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:39.724+0000 7f6c233c0740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x55fad1a02b40 con 0x55fad19e0650 2024-09-10T22:25:39.730 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:39.724+0000 7f6c233c0740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55fad1a02470 con 0x55fad19dfd30 2024-09-10T22:25:39.730 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:39.724+0000 7f6c233c0740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x55fad1a03210 con 0x55fad19f09f0 2024-09-10T22:25:39.730 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:39.724+0000 7f6c233c0740 10 client.0 _ll_register_callbacks cb 0x7f6c0400a670 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T22:25:39.730 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:39.724+0000 7f6c1a59c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55fad19e0650 0x55fad19dc4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:25:39.730 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:39.724+0000 7f6c1a59c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55fad19e0650 0x55fad19dc4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:38928/0 (socket says 172.21.15.19:38928) 2024-09-10T22:25:39.730 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:39.724+0000 7f6c1a59c640 1 -- 172.21.15.19:0/853365522 learned_addr learned my addr 172.21.15.19:0/853365522 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:25:39.730 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:39.724+0000 7f6c19d9b640 1 --2- 172.21.15.19:0/853365522 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55fad19dfd30 0x55fad19e2140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:25:39.731 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:39.724+0000 7f6c1a59c640 1 -- 172.21.15.19:0/853365522 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55fad19f09f0 msgr2=0x55fad19dca20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:25:39.731 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:39.724+0000 7f6c1a59c640 1 --2- 172.21.15.19:0/853365522 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55fad19f09f0 0x55fad19dca20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:25:39.731 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:39.724+0000 7f6c1a59c640 1 -- 172.21.15.19:0/853365522 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55fad19dfd30 msgr2=0x55fad19e2140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:25:39.731 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:39.724+0000 7f6c1a59c640 1 --2- 172.21.15.19:0/853365522 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55fad19dfd30 0x55fad19e2140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:25:39.731 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:39.724+0000 7f6c1a59c640 1 -- 172.21.15.19:0/853365522 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fad19dcfe0 con 0x55fad19e0650 2024-09-10T22:25:39.731 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:39.724+0000 7f6c19d9b640 1 --2- 172.21.15.19:0/853365522 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55fad19dfd30 0x55fad19e2140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T22:25:39.731 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:39.724+0000 7f6c1a59c640 1 --2- 172.21.15.19:0/853365522 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55fad19e0650 0x55fad19dc4e0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f6c04025c40 tx=0x7f6c04025630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=debdbd9afae294c5 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:25:39.731 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:39.724+0000 7f6c01ffb640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-10T22:25:39.731 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:39.725+0000 7f6c01ffb640 1 -- 172.21.15.19:0/853365522 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c04032060 con 0x55fad19e0650 2024-09-10T22:25:39.731 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:39.725+0000 7f6c01ffb640 1 -- 172.21.15.19:0/853365522 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8269+0+0 (secure 0 0 0) 0x7f6c04005450 con 0x55fad19e0650 2024-09-10T22:25:39.731 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:39.725+0000 7f6c233c0740 1 -- 172.21.15.19:0/853365522 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6c0c0054c0 con 0x55fad19e0650 2024-09-10T22:25:39.731 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:39.725+0000 7f6c01ffb640 1 -- 172.21.15.19:0/853365522 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f6c04025850 con 0x55fad19e0650 2024-09-10T22:25:39.732 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:39.725+0000 7f6c233c0740 10 client.15117 fetch_fsmap learned FSMap version 24 2024-09-10T22:25:39.732 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:39.725+0000 7f6c233c0740 1 -- 172.21.15.19:0/853365522 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55fad1a0bc60 con 0x55fad19e0650 2024-09-10T22:25:39.732 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:39.725+0000 7f6c01ffb640 1 -- 172.21.15.19:0/853365522 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6c0c0054c0 con 0x55fad19e0650 2024-09-10T22:25:39.732 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:39.725+0000 7f6c01ffb640 1 -- 172.21.15.19:0/853365522 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f6c04004c30 con 0x55fad19e0650 2024-09-10T22:25:39.732 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:39.725+0000 7f6c233c0740 10 client.15117 fetch_fsmap finished waiting for FSMap version 24 2024-09-10T22:25:39.732 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:39.725+0000 7f6c233c0740 10 client.15117 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-10T22:25:39.732 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:39.725+0000 7f6c233c0740 20 client.15117 populate_metadata read hostname 'smithi019' 2024-09-10T22:25:39.732 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:39.725+0000 7f6c233c0740 1 --2- 172.21.15.19:0/853365522 >> [v2:172.21.15.138:6836/3353290042,v1:172.21.15.138:6837/3353290042] conn(0x55fad1a72bb0 0x55fad1a718c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:25:39.732 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:39.725+0000 7f6c233c0740 4 client.15117 mds_command: new command op to 24553 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-10T22:25:39.732 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:39.725+0000 7f6c233c0740 1 -- 172.21.15.19:0/853365522 --> [v2:172.21.15.138:6836/3353290042,v1:172.21.15.138:6837/3353290042] -- command(tid 0: {"prefix": "status"}) -- 0x55fad1955610 con 0x55fad1a72bb0 2024-09-10T22:25:39.732 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:39.726+0000 7f6c19d9b640 1 --2- 172.21.15.19:0/853365522 >> [v2:172.21.15.138:6836/3353290042,v1:172.21.15.138:6837/3353290042] conn(0x55fad1a72bb0 0x55fad1a718c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:25:39.732 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:39.726+0000 7f6c19d9b640 1 --2- 172.21.15.19:0/853365522 >> [v2:172.21.15.138:6836/3353290042,v1:172.21.15.138:6837/3353290042] conn(0x55fad1a72bb0 0x55fad1a718c0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=1967afe366fa9df9 server_cookie=1c89c8a1417f021c in_seq=0 out_seq=0 2024-09-10T22:25:39.733 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:39.726+0000 7f6c01ffb640 10 client.15117 ms_handle_connect on v2:172.21.15.138:6836/3353290042 2024-09-10T22:25:39.733 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:39.726+0000 7f6c01ffb640 1 -- 172.21.15.19:0/853365522 <== mds.2 v2:172.21.15.138:6836/3353290042 1 ==== command_reply(tid 0: 0 ) ==== 8+0+327 (crc 0 0 0) 0x55fad1955610 con 0x55fad1a72bb0 2024-09-10T22:25:39.733 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:39.726+0000 7f6c01ffb640 10 client.15117 handle_command_reply: tid=0 2024-09-10T22:25:39.733 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:39.726+0000 7f6c233c0740 1 client.15117 shutdown 2024-09-10T22:25:39.733 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:39.727+0000 7f6c233c0740 1 -- 172.21.15.19:0/853365522 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55fad19e0650 msgr2=0x55fad19dc4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:25:39.733 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:39.727+0000 7f6c233c0740 1 --2- 172.21.15.19:0/853365522 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55fad19e0650 0x55fad19dc4e0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f6c04025c40 tx=0x7f6c04025630 comp rx=0 tx=0).stop 2024-09-10T22:25:39.733 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:39.727+0000 7f6c233c0740 1 -- 172.21.15.19:0/853365522 shutdown_connections 2024-09-10T22:25:39.733 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:39.727+0000 7f6c233c0740 1 --2- 172.21.15.19:0/853365522 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55fad19f09f0 0x55fad19dca20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:25:39.733 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:39.727+0000 7f6c233c0740 1 --2- 172.21.15.19:0/853365522 >> [v2:172.21.15.138:6836/3353290042,v1:172.21.15.138:6837/3353290042] conn(0x55fad1a72bb0 0x55fad1a718c0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:25:39.733 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:39.727+0000 7f6c233c0740 1 --2- 172.21.15.19:0/853365522 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55fad19e0650 0x55fad19dc4e0 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:25:39.733 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:39.727+0000 7f6c233c0740 1 --2- 172.21.15.19:0/853365522 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55fad19dfd30 0x55fad19e2140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:25:39.733 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:39.727+0000 7f6c233c0740 1 -- 172.21.15.19:0/853365522 >> 172.21.15.19:0/853365522 conn(0x55fad19ddb60 msgr2=0x55fad19f1a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:25:39.733 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:39.727+0000 7f6c01ffb640 0 client.15117 ms_handle_reset on v2:172.21.15.138:6836/3353290042 2024-09-10T22:25:39.734 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:39.727+0000 7f6c233c0740 1 -- 172.21.15.19:0/853365522 shutdown_connections 2024-09-10T22:25:39.734 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:39.727+0000 7f6c233c0740 1 -- 172.21.15.19:0/853365522 wait complete. 2024-09-10T22:25:39.734 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:39.727+0000 7f6c233c0740 20 client.15117 trim_cache size 0 max 16384 2024-09-10T22:25:39.734 INFO:teuthology.orchestra.run.smithi019.stdout:{ 2024-09-10T22:25:39.734 INFO:teuthology.orchestra.run.smithi019.stdout: "cluster_fsid": "22997a4c-6fc2-11ef-bcea-c7b262605968", 2024-09-10T22:25:39.734 INFO:teuthology.orchestra.run.smithi019.stdout: "whoami": 2, 2024-09-10T22:25:39.734 INFO:teuthology.orchestra.run.smithi019.stdout: "id": 24553, 2024-09-10T22:25:39.734 INFO:teuthology.orchestra.run.smithi019.stdout: "want_state": "up:active", 2024-09-10T22:25:39.734 INFO:teuthology.orchestra.run.smithi019.stdout: "state": "up:active", 2024-09-10T22:25:39.734 INFO:teuthology.orchestra.run.smithi019.stdout: "fs_name": "cephfs", 2024-09-10T22:25:39.735 INFO:teuthology.orchestra.run.smithi019.stdout: "rank_uptime": 68.523608457999998, 2024-09-10T22:25:39.735 INFO:teuthology.orchestra.run.smithi019.stdout: "mdsmap_epoch": 24, 2024-09-10T22:25:39.735 INFO:teuthology.orchestra.run.smithi019.stdout: "osdmap_epoch": 75, 2024-09-10T22:25:39.735 INFO:teuthology.orchestra.run.smithi019.stdout: "osdmap_epoch_barrier": 73, 2024-09-10T22:25:39.735 INFO:teuthology.orchestra.run.smithi019.stdout: "uptime": 101.427756312 2024-09-10T22:25:39.735 INFO:teuthology.orchestra.run.smithi019.stdout:} 2024-09-10T22:25:39.736 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:39.727+0000 7f6c20feb640 1 -- 172.21.15.19:0/446493462 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f6c080b53f0 msgr2=0x7f6c080b78b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:25:39.736 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:39.727+0000 7f6c20feb640 1 --2- 172.21.15.19:0/446493462 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f6c080b53f0 0x7f6c080b78b0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f6c140abea0 tx=0x7f6c14079670 comp rx=0 tx=0).stop 2024-09-10T22:25:39.736 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:39.727+0000 7f6c20feb640 1 -- 172.21.15.19:0/446493462 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6c1c108020 msgr2=0x7f6c1c19eb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:25:39.736 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:39.727+0000 7f6c20feb640 1 --2- 172.21.15.19:0/446493462 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6c1c108020 0x7f6c1c19eb50 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f6c1400eaa0 tx=0x7f6c1400eea0 comp rx=0 tx=0).stop 2024-09-10T22:25:39.736 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:39.727+0000 7f6c20feb640 1 -- 172.21.15.19:0/446493462 shutdown_connections 2024-09-10T22:25:39.736 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:39.727+0000 7f6c20feb640 1 --2- 172.21.15.19:0/446493462 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f6c080b53f0 0x7f6c080b78b0 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:25:39.736 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:39.727+0000 7f6c20feb640 1 --2- 172.21.15.19:0/446493462 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6c1c108020 0x7f6c1c19eb50 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:25:39.736 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:39.727+0000 7f6c20feb640 1 --2- 172.21.15.19:0/446493462 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f6c1c1076a0 0x7f6c1c1997b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:25:39.737 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:39.727+0000 7f6c20feb640 1 --2- 172.21.15.19:0/446493462 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6c1c101c90 0x7f6c1c199270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:25:39.737 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:39.727+0000 7f6c20feb640 1 -- 172.21.15.19:0/446493462 >> 172.21.15.19:0/446493462 conn(0x7f6c1c0fd700 msgr2=0x7f6c1c100610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:25:39.737 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:39.727+0000 7f6c20feb640 1 -- 172.21.15.19:0/446493462 shutdown_connections 2024-09-10T22:25:39.737 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:39.727+0000 7f6c20feb640 1 -- 172.21.15.19:0/446493462 wait complete. 2024-09-10T22:25:40.208 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:25:39 smithi019 ceph-mon[31375]: pgmap v322: 97 pgs: 97 active+clean; 639 KiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-10T22:25:40.359 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:25:39 smithi135 ceph-mon[34789]: pgmap v322: 97 pgs: 97 active+clean; 639 KiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-10T22:25:40.375 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:25:39 smithi138 ceph-mon[35236]: pgmap v322: 97 pgs: 97 active+clean; 639 KiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-10T22:25:40.418 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 22997a4c-6fc2-11ef-bcea-c7b262605968 -- ceph tell mds.i status 2024-09-10T22:25:40.678 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/22997a4c-6fc2-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T22:25:41.241 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:41.214+0000 7fb437034640 1 -- 172.21.15.19:0/658411087 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb430102dc0 msgr2=0x7fb4301031a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:25:41.242 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:41.214+0000 7fb437034640 1 --2- 172.21.15.19:0/658411087 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb430102dc0 0x7fb4301031a0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7fb424009900 tx=0x7fb42402a410 comp rx=0 tx=0).stop 2024-09-10T22:25:41.242 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:41.214+0000 7fb437034640 1 -- 172.21.15.19:0/658411087 shutdown_connections 2024-09-10T22:25:41.242 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:41.214+0000 7fb437034640 1 --2- 172.21.15.19:0/658411087 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb430109150 0x7fb43010f950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:25:41.242 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:41.214+0000 7fb437034640 1 --2- 172.21.15.19:0/658411087 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb4301087d0 0x7fb430108c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:25:41.242 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:41.214+0000 7fb437034640 1 --2- 172.21.15.19:0/658411087 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb430102dc0 0x7fb4301031a0 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:25:41.242 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:41.214+0000 7fb437034640 1 -- 172.21.15.19:0/658411087 >> 172.21.15.19:0/658411087 conn(0x7fb4300fe830 msgr2=0x7fb430100c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:25:41.242 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:41.214+0000 7fb437034640 1 -- 172.21.15.19:0/658411087 shutdown_connections 2024-09-10T22:25:41.242 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:41.214+0000 7fb437034640 1 -- 172.21.15.19:0/658411087 wait complete. 2024-09-10T22:25:41.242 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:41.215+0000 7fb437034640 1 Processor -- start 2024-09-10T22:25:41.242 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:41.215+0000 7fb437034640 1 -- start start 2024-09-10T22:25:41.243 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:41.215+0000 7fb437034640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb430102dc0 0x7fb430199440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:25:41.243 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:41.215+0000 7fb437034640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb4301087d0 0x7fb430199980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:25:41.243 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:41.215+0000 7fb437034640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb430109150 0x7fb43019ed20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:25:41.243 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:41.215+0000 7fb437034640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fb430112e50 con 0x7fb430102dc0 2024-09-10T22:25:41.243 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:41.215+0000 7fb437034640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fb430112cd0 con 0x7fb430109150 2024-09-10T22:25:41.243 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:41.215+0000 7fb437034640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7fb430112fd0 con 0x7fb4301087d0 2024-09-10T22:25:41.243 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:41.215+0000 7fb434dd0640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb430102dc0 0x7fb430199440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:25:41.243 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:41.216+0000 7fb434dd0640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb430102dc0 0x7fb430199440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:38948/0 (socket says 172.21.15.19:38948) 2024-09-10T22:25:41.243 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:41.216+0000 7fb434dd0640 1 -- 172.21.15.19:0/2090282913 learned_addr learned my addr 172.21.15.19:0/2090282913 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:25:41.243 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:41.216+0000 7fb434dd0640 1 -- 172.21.15.19:0/2090282913 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb4301087d0 msgr2=0x7fb430199980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:25:41.243 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:41.216+0000 7fb42ffff640 1 --2- 172.21.15.19:0/2090282913 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb4301087d0 0x7fb430199980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:25:41.244 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:41.216+0000 7fb434dd0640 1 --2- 172.21.15.19:0/2090282913 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb4301087d0 0x7fb430199980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:25:41.244 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:41.216+0000 7fb434dd0640 1 -- 172.21.15.19:0/2090282913 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb430109150 msgr2=0x7fb43019ed20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:25:41.244 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:41.216+0000 7fb4355d1640 1 --2- 172.21.15.19:0/2090282913 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb430109150 0x7fb43019ed20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:25:41.244 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:41.216+0000 7fb434dd0640 1 --2- 172.21.15.19:0/2090282913 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb430109150 0x7fb43019ed20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:25:41.244 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:41.216+0000 7fb434dd0640 1 -- 172.21.15.19:0/2090282913 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb43019f4f0 con 0x7fb430102dc0 2024-09-10T22:25:41.244 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:41.216+0000 7fb434dd0640 1 --2- 172.21.15.19:0/2090282913 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb430102dc0 0x7fb430199440 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7fb424006010 tx=0x7fb4240042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:25:41.244 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:41.216+0000 7fb42dffb640 1 -- 172.21.15.19:0/2090282913 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb42403f030 con 0x7fb430102dc0 2024-09-10T22:25:41.244 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:41.216+0000 7fb42dffb640 1 -- 172.21.15.19:0/2090282913 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb424003800 con 0x7fb430102dc0 2024-09-10T22:25:41.244 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:41.216+0000 7fb437034640 1 -- 172.21.15.19:0/2090282913 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb43019f780 con 0x7fb430102dc0 2024-09-10T22:25:41.244 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:41.216+0000 7fb42dffb640 1 -- 172.21.15.19:0/2090282913 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb424035070 con 0x7fb430102dc0 2024-09-10T22:25:41.244 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:41.216+0000 7fb437034640 1 -- 172.21.15.19:0/2090282913 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb4301a5ea0 con 0x7fb430102dc0 2024-09-10T22:25:41.244 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:41.219+0000 7fb439409740 1 Processor -- start 2024-09-10T22:25:41.245 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:41.219+0000 7fb439409740 1 -- start start 2024-09-10T22:25:41.245 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:41.219+0000 7fb42dffb640 1 -- 172.21.15.19:0/2090282913 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 17) ==== 153301+0+0 (secure 0 0 0) 0x7fb424031b10 con 0x7fb430102dc0 2024-09-10T22:25:41.245 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:41.219+0000 7fb439409740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x557724f82d30 0x557724f83110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:25:41.245 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:41.219+0000 7fb439409740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x557724f83650 0x557724f934b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:25:41.245 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:41.219+0000 7fb439409740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557724f939f0 0x557724f95de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:25:41.245 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:41.219+0000 7fb439409740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x557724efac10 con 0x557724f83650 2024-09-10T22:25:41.245 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:41.219+0000 7fb439409740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x557724eea040 con 0x557724f939f0 2024-09-10T22:25:41.245 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:41.219+0000 7fb439409740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x557724eede50 con 0x557724f82d30 2024-09-10T22:25:41.245 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:41.220+0000 7fb434dd0640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x557724f83650 0x557724f934b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:25:41.245 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:41.220+0000 7fb434dd0640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x557724f83650 0x557724f934b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:38950/0 (socket says 172.21.15.19:38950) 2024-09-10T22:25:41.245 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:41.220+0000 7fb434dd0640 1 -- 172.21.15.19:0/4287536317 learned_addr learned my addr 172.21.15.19:0/4287536317 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:25:41.246 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:41.220+0000 7fb4355d1640 1 --2- 172.21.15.19:0/4287536317 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x557724f82d30 0x557724f83110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:25:41.246 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:41.220+0000 7fb42ffff640 1 --2- 172.21.15.19:0/4287536317 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557724f939f0 0x557724f95de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:25:41.246 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:41.220+0000 7fb434dd0640 1 -- 172.21.15.19:0/4287536317 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x557724f82d30 msgr2=0x557724f83110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:25:41.246 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:41.220+0000 7fb434dd0640 1 --2- 172.21.15.19:0/4287536317 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x557724f82d30 0x557724f83110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:25:41.246 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:41.220+0000 7fb434dd0640 1 -- 172.21.15.19:0/4287536317 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557724f939f0 msgr2=0x557724f95de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:25:41.246 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:41.220+0000 7fb434dd0640 1 --2- 172.21.15.19:0/4287536317 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557724f939f0 0x557724f95de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:25:41.246 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:41.220+0000 7fb434dd0640 1 -- 172.21.15.19:0/4287536317 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557724c48540 con 0x557724f83650 2024-09-10T22:25:41.246 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:41.220+0000 7fb434dd0640 1 --2- 172.21.15.19:0/4287536317 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x557724f83650 0x557724f934b0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7fb42410ccf0 tx=0x7fb42410cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1d52c5a2d50fe9d9 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:25:41.246 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:41.220+0000 7fb42dffb640 1 --2- 172.21.15.19:0/2090282913 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7fb4200b53f0 0x7fb4200b78b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:25:41.246 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:41.220+0000 7fb4355d1640 1 --2- 172.21.15.19:0/2090282913 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7fb4200b53f0 0x7fb4200b78b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:25:41.246 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:41.220+0000 7fb41affd640 1 -- 172.21.15.19:0/4287536317 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb4240c9380 con 0x557724f83650 2024-09-10T22:25:41.246 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:41.220+0000 7fb41affd640 1 -- 172.21.15.19:0/4287536317 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb424113070 con 0x557724f83650 2024-09-10T22:25:41.246 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:41.221+0000 7fb41affd640 1 -- 172.21.15.19:0/4287536317 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb4240cb840 con 0x557724f83650 2024-09-10T22:25:41.247 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:41.221+0000 7fb42dffb640 1 -- 172.21.15.19:0/2090282913 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8269+0+0 (secure 0 0 0) 0x7fb4241066f0 con 0x7fb430102dc0 2024-09-10T22:25:41.247 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:41.221+0000 7fb439409740 1 -- 172.21.15.19:0/4287536317 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x557724f83650 msgr2=0x557724f934b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:25:41.247 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:41.221+0000 7fb4355d1640 1 --2- 172.21.15.19:0/2090282913 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7fb4200b53f0 0x7fb4200b78b0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fb428007ed0 tx=0x7fb4280075c0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:25:41.247 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:41.221+0000 7fb439409740 1 --2- 172.21.15.19:0/4287536317 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x557724f83650 0x557724f934b0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7fb42410ccf0 tx=0x7fb42410cde0 comp rx=0 tx=0).stop 2024-09-10T22:25:41.247 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:41.221+0000 7fb439409740 1 -- 172.21.15.19:0/4287536317 shutdown_connections 2024-09-10T22:25:41.247 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:41.221+0000 7fb439409740 1 --2- 172.21.15.19:0/4287536317 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557724f939f0 0x557724f95de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:25:41.247 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:41.221+0000 7fb439409740 1 --2- 172.21.15.19:0/4287536317 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x557724f83650 0x557724f934b0 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:25:41.247 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:41.221+0000 7fb439409740 1 --2- 172.21.15.19:0/4287536317 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x557724f82d30 0x557724f83110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:25:41.247 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:41.221+0000 7fb439409740 1 -- 172.21.15.19:0/4287536317 >> 172.21.15.19:0/4287536317 conn(0x557724f80b60 msgr2=0x557724f81d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:25:41.247 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:41.221+0000 7fb439409740 1 -- 172.21.15.19:0/4287536317 shutdown_connections 2024-09-10T22:25:41.247 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:41.221+0000 7fb439409740 1 -- 172.21.15.19:0/4287536317 wait complete. 2024-09-10T22:25:41.247 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:41.222+0000 7fb439409740 1 -- start start 2024-09-10T22:25:41.247 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:41.222+0000 7fb439409740 1 Processor -- start 2024-09-10T22:25:41.248 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:41.222+0000 7fb439409740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557724f82d30 0x557724f90920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:25:41.248 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:41.222+0000 7fb439409740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x557724f83650 0x557724f90e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:25:41.248 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:41.222+0000 7fb439409740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x557724f939f0 0x557724f913a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:25:41.248 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:41.222+0000 7fb439409740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x557724d4b5f0 con 0x557724f83650 2024-09-10T22:25:41.248 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:41.222+0000 7fb439409740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x557724e85010 con 0x557724f82d30 2024-09-10T22:25:41.248 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:41.222+0000 7fb439409740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x557724f96460 con 0x557724f939f0 2024-09-10T22:25:41.248 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:41.222+0000 7fb439409740 10 client.0 _ll_register_callbacks cb 0x557724ee4340 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T22:25:41.248 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:41.222+0000 7fb42ffff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x557724f83650 0x557724f90e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:25:41.248 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:41.222+0000 7fb42ffff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x557724f83650 0x557724f90e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:38962/0 (socket says 172.21.15.19:38962) 2024-09-10T22:25:41.248 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:41.222+0000 7fb42ffff640 1 -- 172.21.15.19:0/2496293529 learned_addr learned my addr 172.21.15.19:0/2496293529 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:25:41.248 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:41.222+0000 7fb4355d1640 1 --2- 172.21.15.19:0/2496293529 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x557724f939f0 0x557724f913a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:25:41.248 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:41.223+0000 7fb434dd0640 1 --2- 172.21.15.19:0/2496293529 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557724f82d30 0x557724f90920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:25:41.248 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:41.223+0000 7fb42ffff640 1 -- 172.21.15.19:0/2496293529 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x557724f939f0 msgr2=0x557724f913a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:25:41.249 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:41.223+0000 7fb42ffff640 1 --2- 172.21.15.19:0/2496293529 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x557724f939f0 0x557724f913a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:25:41.249 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:41.223+0000 7fb42ffff640 1 -- 172.21.15.19:0/2496293529 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557724f82d30 msgr2=0x557724f90920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:25:41.249 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:41.223+0000 7fb42ffff640 1 --2- 172.21.15.19:0/2496293529 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557724f82d30 0x557724f90920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:25:41.249 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:41.223+0000 7fb42ffff640 1 -- 172.21.15.19:0/2496293529 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557724eb2a00 con 0x557724f83650 2024-09-10T22:25:41.249 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:41.223+0000 7fb434dd0640 1 --2- 172.21.15.19:0/2496293529 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557724f82d30 0x557724f90920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T22:25:41.249 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:41.223+0000 7fb42ffff640 1 --2- 172.21.15.19:0/2496293529 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x557724f83650 0x557724f90e60 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7fb41c00e280 tx=0x7fb41c00e740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=64c47a6b2b71d389 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:25:41.249 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:41.223+0000 7fb40ffff640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-10T22:25:41.249 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:41.223+0000 7fb40ffff640 1 -- 172.21.15.19:0/2496293529 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb41c018020 con 0x557724f83650 2024-09-10T22:25:41.249 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:41.223+0000 7fb40ffff640 1 -- 172.21.15.19:0/2496293529 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8269+0+0 (secure 0 0 0) 0x7fb41c013660 con 0x557724f83650 2024-09-10T22:25:41.249 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:41.223+0000 7fb439409740 1 -- 172.21.15.19:0/2496293529 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb424113070 con 0x557724f83650 2024-09-10T22:25:41.249 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:41.223+0000 7fb40ffff640 1 -- 172.21.15.19:0/2496293529 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fb41c023050 con 0x557724f83650 2024-09-10T22:25:41.249 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:41.223+0000 7fb439409740 10 client.15129 fetch_fsmap learned FSMap version 24 2024-09-10T22:25:41.250 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:41.223+0000 7fb439409740 1 -- 172.21.15.19:0/2496293529 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x557724fa1f60 con 0x557724f83650 2024-09-10T22:25:41.250 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:41.223+0000 7fb40ffff640 1 -- 172.21.15.19:0/2496293529 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb424113070 con 0x557724f83650 2024-09-10T22:25:41.250 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:41.224+0000 7fb40ffff640 1 -- 172.21.15.19:0/2496293529 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7fb41c014a80 con 0x557724f83650 2024-09-10T22:25:41.250 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:41.224+0000 7fb439409740 10 client.15129 fetch_fsmap finished waiting for FSMap version 24 2024-09-10T22:25:41.250 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:41.224+0000 7fb439409740 10 client.15129 resolve_mds: resolved name 'i' to daemon mds.i 2024-09-10T22:25:41.250 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:41.224+0000 7fb439409740 20 client.15129 populate_metadata read hostname 'smithi019' 2024-09-10T22:25:41.250 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:41.224+0000 7fb439409740 1 --2- 172.21.15.19:0/2496293529 >> [v2:172.21.15.138:6838/383637208,v1:172.21.15.138:6839/383637208] conn(0x557724fa45f0 0x557724fa5a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:25:41.250 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:41.224+0000 7fb439409740 4 client.15129 mds_command: new command op to 24568 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T22:25:41.250 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:41.224+0000 7fb439409740 1 -- 172.21.15.19:0/2496293529 --> [v2:172.21.15.138:6838/383637208,v1:172.21.15.138:6839/383637208] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x557724efcb60 con 0x557724fa45f0 2024-09-10T22:25:41.250 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:41.224+0000 7fb434dd0640 1 --2- 172.21.15.19:0/2496293529 >> [v2:172.21.15.138:6838/383637208,v1:172.21.15.138:6839/383637208] conn(0x557724fa45f0 0x557724fa5a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:25:41.250 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:41.225+0000 7fb40ffff640 10 client.15129 ms_handle_connect on v2:172.21.15.138:6838/383637208 2024-09-10T22:25:41.250 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:41.225+0000 7fb434dd0640 1 --2- 172.21.15.19:0/2496293529 >> [v2:172.21.15.138:6838/383637208,v1:172.21.15.138:6839/383637208] conn(0x557724fa45f0 0x557724fa5a60 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=65fc09be73d8fd6c server_cookie=2997ad2d2376c3f8 in_seq=0 out_seq=0 2024-09-10T22:25:41.250 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:41.225+0000 7fb40ffff640 1 -- 172.21.15.19:0/2496293529 <== mds.1 v2:172.21.15.138:6838/383637208 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x557724efcb60 con 0x557724fa45f0 2024-09-10T22:25:41.250 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:41.225+0000 7fb40ffff640 10 client.15129 handle_command_reply: tid=0 2024-09-10T22:25:41.251 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:41.225+0000 7fb439409740 1 client.15129 shutdown 2024-09-10T22:25:41.251 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:41.226+0000 7fb439409740 1 -- 172.21.15.19:0/2496293529 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x557724f83650 msgr2=0x557724f90e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:25:41.251 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:41.226+0000 7fb439409740 1 --2- 172.21.15.19:0/2496293529 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x557724f83650 0x557724f90e60 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7fb41c00e280 tx=0x7fb41c00e740 comp rx=0 tx=0).stop 2024-09-10T22:25:41.251 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:41.226+0000 7fb439409740 1 -- 172.21.15.19:0/2496293529 shutdown_connections 2024-09-10T22:25:41.251 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:41.226+0000 7fb439409740 1 --2- 172.21.15.19:0/2496293529 >> [v2:172.21.15.138:6838/383637208,v1:172.21.15.138:6839/383637208] conn(0x557724fa45f0 0x557724fa5a60 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:25:41.251 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:41.226+0000 7fb439409740 1 --2- 172.21.15.19:0/2496293529 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x557724f939f0 0x557724f913a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:25:41.251 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:41.226+0000 7fb439409740 1 --2- 172.21.15.19:0/2496293529 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x557724f83650 0x557724f90e60 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:25:41.251 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:41.226+0000 7fb40ffff640 0 client.15129 ms_handle_reset on v2:172.21.15.138:6838/383637208 2024-09-10T22:25:41.251 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:41.226+0000 7fb439409740 1 --2- 172.21.15.19:0/2496293529 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557724f82d30 0x557724f90920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:25:41.251 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:41.226+0000 7fb439409740 1 -- 172.21.15.19:0/2496293529 >> 172.21.15.19:0/2496293529 conn(0x557724f80b60 msgr2=0x557724f7fd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:25:41.251 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:41.226+0000 7fb439409740 1 -- 172.21.15.19:0/2496293529 shutdown_connections 2024-09-10T22:25:41.251 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:41.226+0000 7fb439409740 1 -- 172.21.15.19:0/2496293529 wait complete. 2024-09-10T22:25:41.251 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:41.226+0000 7fb439409740 20 client.15129 trim_cache size 0 max 16384 2024-09-10T22:25:41.256 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:41.244+0000 7fb439409740 1 Processor -- start 2024-09-10T22:25:41.256 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:41.244+0000 7fb439409740 1 -- start start 2024-09-10T22:25:41.256 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:41.245+0000 7fb439409740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x557724f82d30 0x557724f804f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:25:41.256 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:41.245+0000 7fb439409740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x557724f83650 0x557724f959f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:25:41.256 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:41.245+0000 7fb439409740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557724f939f0 0x557724f94a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:25:41.256 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:41.245+0000 7fb439409740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x557724fa3da0 con 0x557724f83650 2024-09-10T22:25:41.256 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:41.245+0000 7fb439409740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x557724fa4470 con 0x557724f939f0 2024-09-10T22:25:41.256 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:41.245+0000 7fb439409740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x557724fa4b40 con 0x557724f82d30 2024-09-10T22:25:41.256 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:41.245+0000 7fb42ffff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x557724f83650 0x557724f959f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:25:41.256 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:41.245+0000 7fb42ffff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x557724f83650 0x557724f959f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:38974/0 (socket says 172.21.15.19:38974) 2024-09-10T22:25:41.257 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:41.245+0000 7fb42ffff640 1 -- 172.21.15.19:0/3639871001 learned_addr learned my addr 172.21.15.19:0/3639871001 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:25:41.257 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:41.245+0000 7fb4355d1640 1 --2- 172.21.15.19:0/3639871001 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557724f939f0 0x557724f94a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:25:41.257 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:41.245+0000 7fb434dd0640 1 --2- 172.21.15.19:0/3639871001 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x557724f82d30 0x557724f804f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:25:41.257 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:41.245+0000 7fb42ffff640 1 -- 172.21.15.19:0/3639871001 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x557724f82d30 msgr2=0x557724f804f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:25:41.257 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:41.245+0000 7fb42ffff640 1 --2- 172.21.15.19:0/3639871001 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x557724f82d30 0x557724f804f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:25:41.257 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:41.245+0000 7fb42ffff640 1 -- 172.21.15.19:0/3639871001 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557724f939f0 msgr2=0x557724f94a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:25:41.257 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:41.245+0000 7fb42ffff640 1 --2- 172.21.15.19:0/3639871001 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557724f939f0 0x557724f94a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:25:41.257 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:41.245+0000 7fb42ffff640 1 -- 172.21.15.19:0/3639871001 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557724f815e0 con 0x557724f83650 2024-09-10T22:25:41.257 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:41.245+0000 7fb4355d1640 1 --2- 172.21.15.19:0/3639871001 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557724f939f0 0x557724f94a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T22:25:41.257 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:41.245+0000 7fb434dd0640 1 --2- 172.21.15.19:0/3639871001 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x557724f82d30 0x557724f804f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T22:25:41.257 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:41.245+0000 7fb42ffff640 1 --2- 172.21.15.19:0/3639871001 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x557724f83650 0x557724f959f0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7fb41c001eb0 tx=0x7fb41c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b86244c095992b77 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:25:41.258 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:41.245+0000 7fb41a7fc640 1 -- 172.21.15.19:0/3639871001 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb41c018070 con 0x557724f83650 2024-09-10T22:25:41.258 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:41.245+0000 7fb41a7fc640 1 -- 172.21.15.19:0/3639871001 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb41c00e0b0 con 0x557724f83650 2024-09-10T22:25:41.258 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:41.245+0000 7fb41a7fc640 1 -- 172.21.15.19:0/3639871001 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb41c0138e0 con 0x557724f83650 2024-09-10T22:25:41.258 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:41.246+0000 7fb439409740 1 -- 172.21.15.19:0/3639871001 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x557724f83650 msgr2=0x557724f959f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:25:41.258 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:41.246+0000 7fb439409740 1 --2- 172.21.15.19:0/3639871001 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x557724f83650 0x557724f959f0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7fb41c001eb0 tx=0x7fb41c0046c0 comp rx=0 tx=0).stop 2024-09-10T22:25:41.258 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:41.246+0000 7fb439409740 1 -- 172.21.15.19:0/3639871001 shutdown_connections 2024-09-10T22:25:41.258 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:41.246+0000 7fb439409740 1 --2- 172.21.15.19:0/3639871001 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557724f939f0 0x557724f94a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:25:41.258 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:41.246+0000 7fb439409740 1 --2- 172.21.15.19:0/3639871001 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x557724f83650 0x557724f959f0 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:25:41.258 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:41.246+0000 7fb439409740 1 --2- 172.21.15.19:0/3639871001 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x557724f82d30 0x557724f804f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:25:41.258 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:41.246+0000 7fb439409740 1 -- 172.21.15.19:0/3639871001 >> 172.21.15.19:0/3639871001 conn(0x557724f80b60 msgr2=0x557724fa3420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:25:41.258 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:41.246+0000 7fb439409740 1 -- 172.21.15.19:0/3639871001 shutdown_connections 2024-09-10T22:25:41.258 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:41.246+0000 7fb439409740 1 -- 172.21.15.19:0/3639871001 wait complete. 2024-09-10T22:25:41.258 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:41.246+0000 7fb439409740 1 -- start start 2024-09-10T22:25:41.258 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:41.247+0000 7fb439409740 1 Processor -- start 2024-09-10T22:25:41.259 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:41.247+0000 7fb439409740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557724f82d30 0x557724f85440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:25:41.259 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:41.247+0000 7fb439409740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x557724f83650 0x557724f91f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:25:41.259 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:41.247+0000 7fb439409740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x557724f939f0 0x557724f924b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:25:41.259 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:41.247+0000 7fb439409740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x557724fa58e0 con 0x557724f939f0 2024-09-10T22:25:41.259 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:41.247+0000 7fb439409740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x557724fa5210 con 0x557724f82d30 2024-09-10T22:25:41.259 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:41.247+0000 7fb439409740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x557724fa5fb0 con 0x557724f83650 2024-09-10T22:25:41.259 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:41.247+0000 7fb439409740 10 client.0 _ll_register_callbacks cb 0x7fb41c00c150 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T22:25:41.259 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:41.247+0000 7fb4355d1640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x557724f939f0 0x557724f924b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:25:41.259 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:41.247+0000 7fb4355d1640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x557724f939f0 0x557724f924b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:38990/0 (socket says 172.21.15.19:38990) 2024-09-10T22:25:41.259 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:41.247+0000 7fb4355d1640 1 -- 172.21.15.19:0/4038318527 learned_addr learned my addr 172.21.15.19:0/4038318527 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:25:41.259 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:41.247+0000 7fb434dd0640 1 --2- 172.21.15.19:0/4038318527 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557724f82d30 0x557724f85440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:25:41.259 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:41.247+0000 7fb42ffff640 1 --2- 172.21.15.19:0/4038318527 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x557724f83650 0x557724f91f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:25:41.259 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:41.247+0000 7fb4355d1640 1 -- 172.21.15.19:0/4038318527 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x557724f83650 msgr2=0x557724f91f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:25:41.259 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:41.248+0000 7fb4355d1640 1 --2- 172.21.15.19:0/4038318527 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x557724f83650 0x557724f91f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:25:41.260 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:41.248+0000 7fb4355d1640 1 -- 172.21.15.19:0/4038318527 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557724f82d30 msgr2=0x557724f85440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:25:41.260 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:41.248+0000 7fb4355d1640 1 --2- 172.21.15.19:0/4038318527 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557724f82d30 0x557724f85440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:25:41.260 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:41.248+0000 7fb4355d1640 1 -- 172.21.15.19:0/4038318527 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557724f92ce0 con 0x557724f939f0 2024-09-10T22:25:41.260 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:41.248+0000 7fb434dd0640 1 --2- 172.21.15.19:0/4038318527 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557724f82d30 0x557724f85440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T22:25:41.260 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:41.248+0000 7fb4355d1640 1 --2- 172.21.15.19:0/4038318527 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x557724f939f0 0x557724f924b0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7fb428012e50 tx=0x7fb428004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a2ea8fc51f618f0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:25:41.260 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:41.248+0000 7fb40ffff640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-10T22:25:41.260 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:41.248+0000 7fb40ffff640 1 -- 172.21.15.19:0/4038318527 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb42802a430 con 0x557724f939f0 2024-09-10T22:25:41.260 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:41.248+0000 7fb40ffff640 1 -- 172.21.15.19:0/4038318527 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8269+0+0 (secure 0 0 0) 0x7fb428021400 con 0x557724f939f0 2024-09-10T22:25:41.260 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:41.248+0000 7fb439409740 1 -- 172.21.15.19:0/4038318527 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb41c00e0b0 con 0x557724f939f0 2024-09-10T22:25:41.261 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:41.248+0000 7fb40ffff640 1 -- 172.21.15.19:0/4038318527 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fb428021640 con 0x557724f939f0 2024-09-10T22:25:41.261 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:41.248+0000 7fb439409740 10 client.15135 fetch_fsmap learned FSMap version 24 2024-09-10T22:25:41.261 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:41.248+0000 7fb439409740 1 -- 172.21.15.19:0/4038318527 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x557725015840 con 0x557724f939f0 2024-09-10T22:25:41.261 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:41.248+0000 7fb40ffff640 1 -- 172.21.15.19:0/4038318527 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb41c00e0b0 con 0x557724f939f0 2024-09-10T22:25:41.261 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:41.248+0000 7fb40ffff640 1 -- 172.21.15.19:0/4038318527 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7fb428011040 con 0x557724f939f0 2024-09-10T22:25:41.261 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:41.249+0000 7fb439409740 10 client.15135 fetch_fsmap finished waiting for FSMap version 24 2024-09-10T22:25:41.261 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:41.249+0000 7fb439409740 10 client.15135 resolve_mds: resolved name 'i' to daemon mds.i 2024-09-10T22:25:41.261 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:41.249+0000 7fb439409740 20 client.15135 populate_metadata read hostname 'smithi019' 2024-09-10T22:25:41.261 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:41.249+0000 7fb439409740 1 --2- 172.21.15.19:0/4038318527 >> [v2:172.21.15.138:6838/383637208,v1:172.21.15.138:6839/383637208] conn(0x55772501a4b0 0x5577250191c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:25:41.261 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:41.249+0000 7fb439409740 4 client.15135 mds_command: new command op to 24568 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-10T22:25:41.261 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:41.249+0000 7fb439409740 1 -- 172.21.15.19:0/4038318527 --> [v2:172.21.15.138:6838/383637208,v1:172.21.15.138:6839/383637208] -- command(tid 0: {"prefix": "status"}) -- 0x557724ef8610 con 0x55772501a4b0 2024-09-10T22:25:41.261 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:41.249+0000 7fb434dd0640 1 --2- 172.21.15.19:0/4038318527 >> [v2:172.21.15.138:6838/383637208,v1:172.21.15.138:6839/383637208] conn(0x55772501a4b0 0x5577250191c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:25:41.262 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:41.249+0000 7fb434dd0640 1 --2- 172.21.15.19:0/4038318527 >> [v2:172.21.15.138:6838/383637208,v1:172.21.15.138:6839/383637208] conn(0x55772501a4b0 0x5577250191c0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=af384ff27732f485 server_cookie=d53c24ddea43ad63 in_seq=0 out_seq=0 2024-09-10T22:25:41.262 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:41.249+0000 7fb40ffff640 10 client.15135 ms_handle_connect on v2:172.21.15.138:6838/383637208 2024-09-10T22:25:41.262 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:41.249+0000 7fb40ffff640 1 -- 172.21.15.19:0/4038318527 <== mds.1 v2:172.21.15.138:6838/383637208 1 ==== command_reply(tid 0: 0 ) ==== 8+0+326 (crc 0 0 0) 0x557724ef8610 con 0x55772501a4b0 2024-09-10T22:25:41.262 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:41.249+0000 7fb40ffff640 10 client.15135 handle_command_reply: tid=0 2024-09-10T22:25:41.262 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:41.249+0000 7fb439409740 1 client.15135 shutdown 2024-09-10T22:25:41.262 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:41.250+0000 7fb439409740 1 -- 172.21.15.19:0/4038318527 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x557724f939f0 msgr2=0x557724f924b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:25:41.262 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:41.250+0000 7fb439409740 1 --2- 172.21.15.19:0/4038318527 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x557724f939f0 0x557724f924b0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7fb428012e50 tx=0x7fb428004a40 comp rx=0 tx=0).stop 2024-09-10T22:25:41.262 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:41.250+0000 7fb439409740 1 -- 172.21.15.19:0/4038318527 shutdown_connections 2024-09-10T22:25:41.262 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:41.250+0000 7fb439409740 1 --2- 172.21.15.19:0/4038318527 >> [v2:172.21.15.138:6838/383637208,v1:172.21.15.138:6839/383637208] conn(0x55772501a4b0 0x5577250191c0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:25:41.262 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:41.250+0000 7fb439409740 1 --2- 172.21.15.19:0/4038318527 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x557724f939f0 0x557724f924b0 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:25:41.262 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:41.250+0000 7fb439409740 1 --2- 172.21.15.19:0/4038318527 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x557724f83650 0x557724f91f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:25:41.263 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:41.250+0000 7fb40ffff640 0 client.15135 ms_handle_reset on v2:172.21.15.138:6838/383637208 2024-09-10T22:25:41.263 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:41.250+0000 7fb439409740 1 --2- 172.21.15.19:0/4038318527 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557724f82d30 0x557724f85440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:25:41.263 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:41.250+0000 7fb439409740 1 -- 172.21.15.19:0/4038318527 >> 172.21.15.19:0/4038318527 conn(0x557724f80b60 msgr2=0x557724f959f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:25:41.263 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:41.250+0000 7fb439409740 1 -- 172.21.15.19:0/4038318527 shutdown_connections 2024-09-10T22:25:41.263 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:41.250+0000 7fb439409740 1 -- 172.21.15.19:0/4038318527 wait complete. 2024-09-10T22:25:41.263 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:41.250+0000 7fb439409740 20 client.15135 trim_cache size 0 max 16384 2024-09-10T22:25:41.263 INFO:teuthology.orchestra.run.smithi019.stdout:{ 2024-09-10T22:25:41.263 INFO:teuthology.orchestra.run.smithi019.stdout: "cluster_fsid": "22997a4c-6fc2-11ef-bcea-c7b262605968", 2024-09-10T22:25:41.264 INFO:teuthology.orchestra.run.smithi019.stdout: "whoami": 1, 2024-09-10T22:25:41.264 INFO:teuthology.orchestra.run.smithi019.stdout: "id": 24568, 2024-09-10T22:25:41.264 INFO:teuthology.orchestra.run.smithi019.stdout: "want_state": "up:active", 2024-09-10T22:25:41.264 INFO:teuthology.orchestra.run.smithi019.stdout: "state": "up:active", 2024-09-10T22:25:41.264 INFO:teuthology.orchestra.run.smithi019.stdout: "fs_name": "cephfs", 2024-09-10T22:25:41.264 INFO:teuthology.orchestra.run.smithi019.stdout: "rank_uptime": 71.062458039000006, 2024-09-10T22:25:41.264 INFO:teuthology.orchestra.run.smithi019.stdout: "mdsmap_epoch": 24, 2024-09-10T22:25:41.264 INFO:teuthology.orchestra.run.smithi019.stdout: "osdmap_epoch": 75, 2024-09-10T22:25:41.265 INFO:teuthology.orchestra.run.smithi019.stdout: "osdmap_epoch_barrier": 73, 2024-09-10T22:25:41.265 INFO:teuthology.orchestra.run.smithi019.stdout: "uptime": 97.730754808 2024-09-10T22:25:41.265 INFO:teuthology.orchestra.run.smithi019.stdout:} 2024-09-10T22:25:41.265 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:41.250+0000 7fb437034640 1 -- 172.21.15.19:0/2090282913 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7fb4200b53f0 msgr2=0x7fb4200b78b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:25:41.265 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:41.250+0000 7fb437034640 1 --2- 172.21.15.19:0/2090282913 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7fb4200b53f0 0x7fb4200b78b0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fb428007ed0 tx=0x7fb4280075c0 comp rx=0 tx=0).stop 2024-09-10T22:25:41.266 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:41.250+0000 7fb437034640 1 -- 172.21.15.19:0/2090282913 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb430102dc0 msgr2=0x7fb430199440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:25:41.266 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:41.250+0000 7fb437034640 1 --2- 172.21.15.19:0/2090282913 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb430102dc0 0x7fb430199440 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7fb424006010 tx=0x7fb4240042f0 comp rx=0 tx=0).stop 2024-09-10T22:25:41.266 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:41.251+0000 7fb437034640 1 -- 172.21.15.19:0/2090282913 shutdown_connections 2024-09-10T22:25:41.266 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:41.251+0000 7fb437034640 1 --2- 172.21.15.19:0/2090282913 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7fb4200b53f0 0x7fb4200b78b0 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:25:41.266 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:41.251+0000 7fb437034640 1 --2- 172.21.15.19:0/2090282913 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb430109150 0x7fb43019ed20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:25:41.266 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:41.251+0000 7fb437034640 1 --2- 172.21.15.19:0/2090282913 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb4301087d0 0x7fb430199980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:25:41.266 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:41.251+0000 7fb437034640 1 --2- 172.21.15.19:0/2090282913 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb430102dc0 0x7fb430199440 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:25:41.266 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:41.251+0000 7fb437034640 1 -- 172.21.15.19:0/2090282913 >> 172.21.15.19:0/2090282913 conn(0x7fb4300fe830 msgr2=0x7fb430100c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:25:41.266 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:41.251+0000 7fb437034640 1 -- 172.21.15.19:0/2090282913 shutdown_connections 2024-09-10T22:25:41.266 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:41.251+0000 7fb437034640 1 -- 172.21.15.19:0/2090282913 wait complete. 2024-09-10T22:25:41.886 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 22997a4c-6fc2-11ef-bcea-c7b262605968 -- ceph tell mds.b status 2024-09-10T22:25:42.149 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/22997a4c-6fc2-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T22:25:42.208 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:25:41 smithi019 ceph-mon[31375]: pgmap v323: 97 pgs: 97 active+clean; 639 KiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-09-10T22:25:42.359 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:25:41 smithi135 ceph-mon[34789]: pgmap v323: 97 pgs: 97 active+clean; 639 KiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-09-10T22:25:42.375 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:25:41 smithi138 ceph-mon[35236]: pgmap v323: 97 pgs: 97 active+clean; 639 KiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-09-10T22:25:42.657 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:42.655+0000 7fb84a56a640 1 -- 172.21.15.19:0/1899607472 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb8441087d0 msgr2=0x7fb844108c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:25:42.657 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:42.655+0000 7fb84a56a640 1 --2- 172.21.15.19:0/1899607472 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb8441087d0 0x7fb844108c10 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7fb838009900 tx=0x7fb83802a410 comp rx=0 tx=0).stop 2024-09-10T22:25:42.657 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:42.655+0000 7fb84a56a640 1 -- 172.21.15.19:0/1899607472 shutdown_connections 2024-09-10T22:25:42.657 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:42.655+0000 7fb84a56a640 1 --2- 172.21.15.19:0/1899607472 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb844109150 0x7fb84410f950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:25:42.657 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:42.655+0000 7fb84a56a640 1 --2- 172.21.15.19:0/1899607472 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb8441087d0 0x7fb844108c10 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:25:42.658 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:42.655+0000 7fb84a56a640 1 --2- 172.21.15.19:0/1899607472 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb844102dc0 0x7fb8441031a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:25:42.658 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:42.655+0000 7fb84a56a640 1 -- 172.21.15.19:0/1899607472 >> 172.21.15.19:0/1899607472 conn(0x7fb8440fe830 msgr2=0x7fb844100c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:25:42.658 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:42.655+0000 7fb84a56a640 1 -- 172.21.15.19:0/1899607472 shutdown_connections 2024-09-10T22:25:42.658 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:42.655+0000 7fb84a56a640 1 -- 172.21.15.19:0/1899607472 wait complete. 2024-09-10T22:25:42.661 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:42.656+0000 7fb84a56a640 1 Processor -- start 2024-09-10T22:25:42.661 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:42.656+0000 7fb84a56a640 1 -- start start 2024-09-10T22:25:42.661 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:42.657+0000 7fb84a56a640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb844102dc0 0x7fb8440754a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:25:42.661 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:42.657+0000 7fb84a56a640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb8441087d0 0x7fb8440759e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:25:42.662 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:42.657+0000 7fb84a56a640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb844109150 0x7fb844075f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:25:42.662 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:42.657+0000 7fb84a56a640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fb844112e60 con 0x7fb844109150 2024-09-10T22:25:42.662 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:42.657+0000 7fb84a56a640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fb844112ce0 con 0x7fb8441087d0 2024-09-10T22:25:42.662 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:42.657+0000 7fb84a56a640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7fb844112fe0 con 0x7fb844102dc0 2024-09-10T22:25:42.663 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:42.657+0000 7fb848b07640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb844109150 0x7fb844075f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:25:42.663 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:42.657+0000 7fb848b07640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb844109150 0x7fb844075f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:39010/0 (socket says 172.21.15.19:39010) 2024-09-10T22:25:42.663 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:42.657+0000 7fb848b07640 1 -- 172.21.15.19:0/3512027638 learned_addr learned my addr 172.21.15.19:0/3512027638 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:25:42.663 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:42.657+0000 7fb843fff640 1 --2- 172.21.15.19:0/3512027638 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb844102dc0 0x7fb8440754a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:25:42.663 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:42.657+0000 7fb8437fe640 1 --2- 172.21.15.19:0/3512027638 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb8441087d0 0x7fb8440759e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:25:42.663 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:42.657+0000 7fb848b07640 1 -- 172.21.15.19:0/3512027638 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb844102dc0 msgr2=0x7fb8440754a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:25:42.664 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:42.657+0000 7fb848b07640 1 --2- 172.21.15.19:0/3512027638 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb844102dc0 0x7fb8440754a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:25:42.664 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:42.657+0000 7fb848b07640 1 -- 172.21.15.19:0/3512027638 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb8441087d0 msgr2=0x7fb8440759e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:25:42.664 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:42.657+0000 7fb848b07640 1 --2- 172.21.15.19:0/3512027638 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb8441087d0 0x7fb8440759e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:25:42.664 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:42.657+0000 7fb848b07640 1 -- 172.21.15.19:0/3512027638 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb8441a7690 con 0x7fb844109150 2024-09-10T22:25:42.664 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:42.657+0000 7fb8437fe640 1 --2- 172.21.15.19:0/3512027638 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb8441087d0 0x7fb8440759e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T22:25:42.664 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:42.658+0000 7fb848b07640 1 --2- 172.21.15.19:0/3512027638 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb844109150 0x7fb844075f20 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7fb83c00b990 tx=0x7fb83c00bd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:25:42.665 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:42.658+0000 7fb8417fa640 1 -- 172.21.15.19:0/3512027638 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb83c019070 con 0x7fb844109150 2024-09-10T22:25:42.665 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:42.658+0000 7fb8417fa640 1 -- 172.21.15.19:0/3512027638 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb83c014440 con 0x7fb844109150 2024-09-10T22:25:42.665 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:42.658+0000 7fb8417fa640 1 -- 172.21.15.19:0/3512027638 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb83c0075d0 con 0x7fb844109150 2024-09-10T22:25:42.665 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:42.658+0000 7fb84a56a640 1 -- 172.21.15.19:0/3512027638 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb8441a7980 con 0x7fb844109150 2024-09-10T22:25:42.665 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:42.658+0000 7fb84a56a640 1 -- 172.21.15.19:0/3512027638 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb8441a7ec0 con 0x7fb844109150 2024-09-10T22:25:42.673 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:42.661+0000 7fb84c93f740 1 Processor -- start 2024-09-10T22:25:42.673 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:42.661+0000 7fb8417fa640 1 -- 172.21.15.19:0/3512027638 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 17) ==== 153301+0+0 (secure 0 0 0) 0x7fb83c00caa0 con 0x7fb844109150 2024-09-10T22:25:42.673 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:42.661+0000 7fb84c93f740 1 -- start start 2024-09-10T22:25:42.673 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:42.661+0000 7fb84c93f740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5624bfad5d30 0x5624bfad6110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:25:42.673 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:42.661+0000 7fb84c93f740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5624bfad6650 0x5624bfae20a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:25:42.673 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:42.661+0000 7fb84c93f740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5624bfae25e0 0x5624bfae49d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:25:42.673 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:42.661+0000 7fb84c93f740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x5624bfa4dc10 con 0x5624bfad6650 2024-09-10T22:25:42.673 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:42.661+0000 7fb84c93f740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x5624bfa3d040 con 0x5624bfae25e0 2024-09-10T22:25:42.674 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:42.661+0000 7fb84c93f740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x5624bfa40e50 con 0x5624bfad5d30 2024-09-10T22:25:42.674 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:42.662+0000 7fb843fff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5624bfad6650 0x5624bfae20a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:25:42.674 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:42.662+0000 7fb843fff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5624bfad6650 0x5624bfae20a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:39014/0 (socket says 172.21.15.19:39014) 2024-09-10T22:25:42.674 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:42.662+0000 7fb843fff640 1 -- 172.21.15.19:0/3656579163 learned_addr learned my addr 172.21.15.19:0/3656579163 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:25:42.674 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:42.662+0000 7fb8437fe640 1 --2- 172.21.15.19:0/3656579163 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5624bfae25e0 0x5624bfae49d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:25:42.674 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:42.662+0000 7fb8437fe640 1 --2- 172.21.15.19:0/3656579163 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5624bfad5d30 0x5624bfad6110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:25:42.674 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:42.662+0000 7fb843fff640 1 -- 172.21.15.19:0/3656579163 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5624bfad5d30 msgr2=0x5624bfad6110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:25:42.674 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:42.662+0000 7fb843fff640 1 --2- 172.21.15.19:0/3656579163 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5624bfad5d30 0x5624bfad6110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:25:42.674 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:42.662+0000 7fb843fff640 1 -- 172.21.15.19:0/3656579163 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5624bfae25e0 msgr2=0x5624bfae49d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:25:42.674 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:42.662+0000 7fb843fff640 1 --2- 172.21.15.19:0/3656579163 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5624bfae25e0 0x5624bfae49d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:25:42.674 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:42.662+0000 7fb843fff640 1 -- 172.21.15.19:0/3656579163 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5624bf79b540 con 0x5624bfad6650 2024-09-10T22:25:42.674 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:42.662+0000 7fb8437fe640 1 --2- 172.21.15.19:0/3656579163 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5624bfad5d30 0x5624bfad6110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T22:25:42.674 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:42.662+0000 7fb8417fa640 1 --2- 172.21.15.19:0/3512027638 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7fb82c0b5370 0x7fb82c0b7830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:25:42.675 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:42.662+0000 7fb8437fe640 1 --2- 172.21.15.19:0/3512027638 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7fb82c0b5370 0x7fb82c0b7830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:25:42.675 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:42.662+0000 7fb843fff640 1 --2- 172.21.15.19:0/3656579163 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5624bfad6650 0x5624bfae20a0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7fb83400ad30 tx=0x7fb83400f790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c749935cc1b04b25 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:25:42.675 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:42.662+0000 7fb8417fa640 1 -- 172.21.15.19:0/3512027638 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8269+0+0 (secure 0 0 0) 0x7fb83c0e5550 con 0x7fb844109150 2024-09-10T22:25:42.675 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:42.662+0000 7fb82a7fc640 1 -- 172.21.15.19:0/3656579163 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb834010840 con 0x5624bfad6650 2024-09-10T22:25:42.675 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:42.663+0000 7fb82a7fc640 1 -- 172.21.15.19:0/3656579163 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb834014070 con 0x5624bfad6650 2024-09-10T22:25:42.675 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:42.663+0000 7fb82a7fc640 1 -- 172.21.15.19:0/3656579163 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb834018ae0 con 0x5624bfad6650 2024-09-10T22:25:42.675 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:42.663+0000 7fb84c93f740 1 -- 172.21.15.19:0/3656579163 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5624bfad6650 msgr2=0x5624bfae20a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:25:42.675 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:42.663+0000 7fb8437fe640 1 --2- 172.21.15.19:0/3512027638 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7fb82c0b5370 0x7fb82c0b7830 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fb838000c00 tx=0x7fb8380095a0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:25:42.675 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:42.663+0000 7fb84c93f740 1 --2- 172.21.15.19:0/3656579163 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5624bfad6650 0x5624bfae20a0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7fb83400ad30 tx=0x7fb83400f790 comp rx=0 tx=0).stop 2024-09-10T22:25:42.675 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:42.663+0000 7fb84c93f740 1 -- 172.21.15.19:0/3656579163 shutdown_connections 2024-09-10T22:25:42.675 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:42.663+0000 7fb84c93f740 1 --2- 172.21.15.19:0/3656579163 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5624bfae25e0 0x5624bfae49d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:25:42.675 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:42.663+0000 7fb84c93f740 1 --2- 172.21.15.19:0/3656579163 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5624bfad6650 0x5624bfae20a0 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:25:42.675 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:42.663+0000 7fb84c93f740 1 --2- 172.21.15.19:0/3656579163 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5624bfad5d30 0x5624bfad6110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:25:42.675 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:42.663+0000 7fb84c93f740 1 -- 172.21.15.19:0/3656579163 >> 172.21.15.19:0/3656579163 conn(0x5624bfad3b60 msgr2=0x5624bfad4d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:25:42.676 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:42.663+0000 7fb84c93f740 1 -- 172.21.15.19:0/3656579163 shutdown_connections 2024-09-10T22:25:42.676 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:42.663+0000 7fb84c93f740 1 -- 172.21.15.19:0/3656579163 wait complete. 2024-09-10T22:25:42.676 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:42.664+0000 7fb84c93f740 1 -- start start 2024-09-10T22:25:42.676 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:42.664+0000 7fb84c93f740 1 Processor -- start 2024-09-10T22:25:42.676 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:42.664+0000 7fb84c93f740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5624bfad5d30 0x5624bfadf600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:25:42.676 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:42.664+0000 7fb84c93f740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5624bfad6650 0x5624bfadfb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:25:42.676 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:42.664+0000 7fb84c93f740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5624bfae25e0 0x5624bfae0080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:25:42.676 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:42.664+0000 7fb84c93f740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x5624bf89e5f0 con 0x5624bfad6650 2024-09-10T22:25:42.676 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:42.664+0000 7fb84c93f740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x5624bf9d8010 con 0x5624bfae25e0 2024-09-10T22:25:42.676 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:42.664+0000 7fb84c93f740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x5624bfae5290 con 0x5624bfad5d30 2024-09-10T22:25:42.676 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:42.664+0000 7fb84c93f740 10 client.0 _ll_register_callbacks cb 0x5624bfa37340 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T22:25:42.676 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:42.664+0000 7fb8437fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5624bfad6650 0x5624bfadfb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:25:42.677 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:42.664+0000 7fb8437fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5624bfad6650 0x5624bfadfb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:39028/0 (socket says 172.21.15.19:39028) 2024-09-10T22:25:42.677 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:42.664+0000 7fb8437fe640 1 -- 172.21.15.19:0/646441260 learned_addr learned my addr 172.21.15.19:0/646441260 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:25:42.677 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:42.665+0000 7fb848b07640 1 --2- 172.21.15.19:0/646441260 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5624bfae25e0 0x5624bfae0080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:25:42.677 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:42.665+0000 7fb843fff640 1 --2- 172.21.15.19:0/646441260 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5624bfad5d30 0x5624bfadf600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:25:42.677 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:42.665+0000 7fb8437fe640 1 -- 172.21.15.19:0/646441260 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5624bfad5d30 msgr2=0x5624bfadf600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:25:42.677 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:42.665+0000 7fb8437fe640 1 --2- 172.21.15.19:0/646441260 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5624bfad5d30 0x5624bfadf600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:25:42.677 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:42.665+0000 7fb8437fe640 1 -- 172.21.15.19:0/646441260 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5624bfae25e0 msgr2=0x5624bfae0080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:25:42.677 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:42.665+0000 7fb8437fe640 1 --2- 172.21.15.19:0/646441260 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5624bfae25e0 0x5624bfae0080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:25:42.677 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:42.665+0000 7fb8437fe640 1 -- 172.21.15.19:0/646441260 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5624bfa05a00 con 0x5624bfad6650 2024-09-10T22:25:42.677 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:42.665+0000 7fb843fff640 1 --2- 172.21.15.19:0/646441260 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5624bfad5d30 0x5624bfadf600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T22:25:42.677 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:42.665+0000 7fb848b07640 1 --2- 172.21.15.19:0/646441260 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5624bfae25e0 0x5624bfae0080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T22:25:42.677 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:42.665+0000 7fb8437fe640 1 --2- 172.21.15.19:0/646441260 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5624bfad6650 0x5624bfadfb40 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7fb838033000 tx=0x7fb838031400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=177f406568bce798 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:25:42.677 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:42.665+0000 7fb8237fe640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-10T22:25:42.678 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:42.665+0000 7fb8237fe640 1 -- 172.21.15.19:0/646441260 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb83804e070 con 0x5624bfad6650 2024-09-10T22:25:42.678 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:42.665+0000 7fb8237fe640 1 -- 172.21.15.19:0/646441260 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8269+0+0 (secure 0 0 0) 0x7fb838005220 con 0x5624bfad6650 2024-09-10T22:25:42.678 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:42.665+0000 7fb84c93f740 1 -- 172.21.15.19:0/646441260 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb834014070 con 0x5624bfad6650 2024-09-10T22:25:42.678 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:42.665+0000 7fb8237fe640 1 -- 172.21.15.19:0/646441260 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fb838059050 con 0x5624bfad6650 2024-09-10T22:25:42.678 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:42.665+0000 7fb84c93f740 10 client.15147 fetch_fsmap learned FSMap version 24 2024-09-10T22:25:42.678 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:42.665+0000 7fb84c93f740 1 -- 172.21.15.19:0/646441260 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x5624bfaf0e10 con 0x5624bfad6650 2024-09-10T22:25:42.678 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:42.665+0000 7fb8237fe640 1 -- 172.21.15.19:0/646441260 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb834014070 con 0x5624bfad6650 2024-09-10T22:25:42.678 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:42.666+0000 7fb8237fe640 1 -- 172.21.15.19:0/646441260 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7fb83803a040 con 0x5624bfad6650 2024-09-10T22:25:42.678 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:42.666+0000 7fb84c93f740 10 client.15147 fetch_fsmap finished waiting for FSMap version 24 2024-09-10T22:25:42.678 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:42.666+0000 7fb84c93f740 10 client.15147 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-10T22:25:42.678 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:42.666+0000 7fb84c93f740 20 client.15147 populate_metadata read hostname 'smithi019' 2024-09-10T22:25:42.678 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:42.666+0000 7fb84c93f740 1 --2- 172.21.15.19:0/646441260 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x5624bfaf3470 0x5624bfaf48e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:25:42.678 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:42.666+0000 7fb84c93f740 4 client.15147 mds_command: new command op to 24581 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T22:25:42.678 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:42.666+0000 7fb84c93f740 1 -- 172.21.15.19:0/646441260 --> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5624bfa4fb60 con 0x5624bfaf3470 2024-09-10T22:25:42.679 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:42.666+0000 7fb843fff640 1 --2- 172.21.15.19:0/646441260 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x5624bfaf3470 0x5624bfaf48e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:25:42.679 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:42.667+0000 7fb8237fe640 10 client.15147 ms_handle_connect on v2:172.21.15.135:6838/1254769802 2024-09-10T22:25:42.679 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:42.667+0000 7fb843fff640 1 --2- 172.21.15.19:0/646441260 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x5624bfaf3470 0x5624bfaf48e0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ddab16761ff6959f server_cookie=ebd8989682b4e30f in_seq=0 out_seq=0 2024-09-10T22:25:42.679 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:42.667+0000 7fb8237fe640 1 -- 172.21.15.19:0/646441260 <== mds.0 v2:172.21.15.135:6838/1254769802 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5624bfa4fb60 con 0x5624bfaf3470 2024-09-10T22:25:42.679 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:42.667+0000 7fb8237fe640 10 client.15147 handle_command_reply: tid=0 2024-09-10T22:25:42.679 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:42.667+0000 7fb84c93f740 1 client.15147 shutdown 2024-09-10T22:25:42.679 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:42.668+0000 7fb84c93f740 1 -- 172.21.15.19:0/646441260 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5624bfad6650 msgr2=0x5624bfadfb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:25:42.679 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:42.668+0000 7fb84c93f740 1 --2- 172.21.15.19:0/646441260 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5624bfad6650 0x5624bfadfb40 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7fb838033000 tx=0x7fb838031400 comp rx=0 tx=0).stop 2024-09-10T22:25:42.679 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:42.668+0000 7fb84c93f740 1 -- 172.21.15.19:0/646441260 shutdown_connections 2024-09-10T22:25:42.679 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:42.668+0000 7fb84c93f740 1 --2- 172.21.15.19:0/646441260 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5624bfae25e0 0x5624bfae0080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:25:42.679 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:42.668+0000 7fb84c93f740 1 --2- 172.21.15.19:0/646441260 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5624bfad6650 0x5624bfadfb40 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:25:42.679 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:42.668+0000 7fb84c93f740 1 --2- 172.21.15.19:0/646441260 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x5624bfaf3470 0x5624bfaf48e0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:25:42.679 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:42.668+0000 7fb8237fe640 0 client.15147 ms_handle_reset on v2:172.21.15.135:6838/1254769802 2024-09-10T22:25:42.680 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:42.668+0000 7fb84c93f740 1 --2- 172.21.15.19:0/646441260 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5624bfad5d30 0x5624bfadf600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:25:42.680 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:42.668+0000 7fb84c93f740 1 -- 172.21.15.19:0/646441260 >> 172.21.15.19:0/646441260 conn(0x5624bfad3b60 msgr2=0x5624bfad9700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:25:42.680 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:42.668+0000 7fb84c93f740 1 -- 172.21.15.19:0/646441260 shutdown_connections 2024-09-10T22:25:42.680 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:42.668+0000 7fb84c93f740 1 -- 172.21.15.19:0/646441260 wait complete. 2024-09-10T22:25:42.680 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:42.668+0000 7fb84c93f740 20 client.15147 trim_cache size 0 max 16384 2024-09-10T22:25:42.688 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:42.686+0000 7fb84c93f740 1 Processor -- start 2024-09-10T22:25:42.688 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:42.686+0000 7fb84c93f740 1 -- start start 2024-09-10T22:25:42.688 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:42.686+0000 7fb84c93f740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5624bfad5d30 0x5624bfae03c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:25:42.688 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:42.686+0000 7fb84c93f740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5624bfad6650 0x5624bfadc810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:25:42.688 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:42.686+0000 7fb84c93f740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5624bfae25e0 0x5624bfadcd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:25:42.689 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:42.686+0000 7fb84c93f740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x5624bfaf2c20 con 0x5624bfad6650 2024-09-10T22:25:42.689 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:42.686+0000 7fb84c93f740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x5624bfaf32f0 con 0x5624bfad5d30 2024-09-10T22:25:42.689 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:42.686+0000 7fb84c93f740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x5624bfaf39c0 con 0x5624bfae25e0 2024-09-10T22:25:42.689 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:42.686+0000 7fb8437fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5624bfad6650 0x5624bfadc810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:25:42.689 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:42.687+0000 7fb8437fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5624bfad6650 0x5624bfadc810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:39036/0 (socket says 172.21.15.19:39036) 2024-09-10T22:25:42.689 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:42.687+0000 7fb8437fe640 1 -- 172.21.15.19:0/1593465830 learned_addr learned my addr 172.21.15.19:0/1593465830 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:25:42.689 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:42.687+0000 7fb8437fe640 1 -- 172.21.15.19:0/1593465830 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5624bfae25e0 msgr2=0x5624bfadcd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:25:42.689 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:42.687+0000 7fb8437fe640 1 --2- 172.21.15.19:0/1593465830 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5624bfae25e0 0x5624bfadcd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:25:42.689 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:42.687+0000 7fb8437fe640 1 -- 172.21.15.19:0/1593465830 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5624bfad5d30 msgr2=0x5624bfae03c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:25:42.689 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:42.687+0000 7fb843fff640 1 --2- 172.21.15.19:0/1593465830 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5624bfad5d30 0x5624bfae03c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:25:42.689 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:42.687+0000 7fb8437fe640 1 --2- 172.21.15.19:0/1593465830 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5624bfad5d30 0x5624bfae03c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:25:42.689 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:42.687+0000 7fb8437fe640 1 -- 172.21.15.19:0/1593465830 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5624bfaf2a50 con 0x5624bfad6650 2024-09-10T22:25:42.689 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:42.687+0000 7fb8437fe640 1 --2- 172.21.15.19:0/1593465830 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5624bfad6650 0x5624bfadc810 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7fb8380317c0 tx=0x7fb838004370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a7ca43e18136bcfc server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:25:42.693 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:42.687+0000 7fb829ffb640 1 -- 172.21.15.19:0/1593465830 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb838062070 con 0x5624bfad6650 2024-09-10T22:25:42.694 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:42.687+0000 7fb829ffb640 1 -- 172.21.15.19:0/1593465830 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb838031a30 con 0x5624bfad6650 2024-09-10T22:25:42.694 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:42.687+0000 7fb829ffb640 1 -- 172.21.15.19:0/1593465830 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb83804e070 con 0x5624bfad6650 2024-09-10T22:25:42.694 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:42.688+0000 7fb84c93f740 1 -- 172.21.15.19:0/1593465830 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5624bfad6650 msgr2=0x5624bfadc810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:25:42.694 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:42.688+0000 7fb84c93f740 1 --2- 172.21.15.19:0/1593465830 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5624bfad6650 0x5624bfadc810 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7fb8380317c0 tx=0x7fb838004370 comp rx=0 tx=0).stop 2024-09-10T22:25:42.694 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:42.688+0000 7fb84c93f740 1 -- 172.21.15.19:0/1593465830 shutdown_connections 2024-09-10T22:25:42.694 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:42.688+0000 7fb84c93f740 1 --2- 172.21.15.19:0/1593465830 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5624bfae25e0 0x5624bfadcd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:25:42.694 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:42.688+0000 7fb84c93f740 1 --2- 172.21.15.19:0/1593465830 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5624bfad6650 0x5624bfadc810 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:25:42.694 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:42.688+0000 7fb84c93f740 1 --2- 172.21.15.19:0/1593465830 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5624bfad5d30 0x5624bfae03c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:25:42.694 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:42.688+0000 7fb84c93f740 1 -- 172.21.15.19:0/1593465830 >> 172.21.15.19:0/1593465830 conn(0x5624bfad3b60 msgr2=0x5624bfada880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:25:42.694 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:42.688+0000 7fb84c93f740 1 -- 172.21.15.19:0/1593465830 shutdown_connections 2024-09-10T22:25:42.694 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:42.688+0000 7fb84c93f740 1 -- 172.21.15.19:0/1593465830 wait complete. 2024-09-10T22:25:42.694 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:42.688+0000 7fb84c93f740 1 -- start start 2024-09-10T22:25:42.695 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:42.689+0000 7fb84c93f740 1 Processor -- start 2024-09-10T22:25:42.695 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:42.689+0000 7fb84c93f740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5624bfad5d30 0x5624bfafcfe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:25:42.695 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:42.689+0000 7fb84c93f740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5624bfad6650 0x5624bfafd560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:25:42.695 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:42.689+0000 7fb84c93f740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5624bfae25e0 0x5624bfaf76f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:25:42.695 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:42.689+0000 7fb84c93f740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x5624bfaf4760 con 0x5624bfad6650 2024-09-10T22:25:42.695 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:42.689+0000 7fb84c93f740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x5624bfaf4090 con 0x5624bfae25e0 2024-09-10T22:25:42.695 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:42.689+0000 7fb84c93f740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x5624bfaf4e30 con 0x5624bfad5d30 2024-09-10T22:25:42.695 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:42.689+0000 7fb84c93f740 10 client.0 _ll_register_callbacks cb 0x7fb838009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T22:25:42.695 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:42.689+0000 7fb8437fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5624bfad6650 0x5624bfafd560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:25:42.695 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:42.689+0000 7fb8437fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5624bfad6650 0x5624bfafd560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:39048/0 (socket says 172.21.15.19:39048) 2024-09-10T22:25:42.696 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:42.689+0000 7fb843fff640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5624bfad5d30 0x5624bfafcfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:25:42.696 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:42.689+0000 7fb8437fe640 1 -- 172.21.15.19:0/3934441097 learned_addr learned my addr 172.21.15.19:0/3934441097 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:25:42.696 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:42.689+0000 7fb848b07640 1 --2- 172.21.15.19:0/3934441097 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5624bfae25e0 0x5624bfaf76f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:25:42.696 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:42.689+0000 7fb8437fe640 1 -- 172.21.15.19:0/3934441097 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5624bfad5d30 msgr2=0x5624bfafcfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:25:42.696 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:42.689+0000 7fb8437fe640 1 --2- 172.21.15.19:0/3934441097 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5624bfad5d30 0x5624bfafcfe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:25:42.696 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:42.689+0000 7fb8437fe640 1 -- 172.21.15.19:0/3934441097 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5624bfae25e0 msgr2=0x5624bfaf76f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:25:42.696 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:42.689+0000 7fb8437fe640 1 --2- 172.21.15.19:0/3934441097 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5624bfae25e0 0x5624bfaf76f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:25:42.696 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:42.689+0000 7fb8437fe640 1 -- 172.21.15.19:0/3934441097 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5624bfaf7f20 con 0x5624bfad6650 2024-09-10T22:25:42.696 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:42.690+0000 7fb8437fe640 1 --2- 172.21.15.19:0/3934441097 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5624bfad6650 0x5624bfafd560 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7fb838060040 tx=0x7fb83804a680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1e4611c99b5be319 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:25:42.696 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:42.690+0000 7fb8237fe640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-10T22:25:42.696 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:42.690+0000 7fb8237fe640 1 -- 172.21.15.19:0/3934441097 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb838062030 con 0x5624bfad6650 2024-09-10T22:25:42.696 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:42.690+0000 7fb8237fe640 1 -- 172.21.15.19:0/3934441097 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8269+0+0 (secure 0 0 0) 0x7fb838031e00 con 0x5624bfad6650 2024-09-10T22:25:42.697 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:42.690+0000 7fb84c93f740 1 -- 172.21.15.19:0/3934441097 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb838031a30 con 0x5624bfad6650 2024-09-10T22:25:42.697 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:42.690+0000 7fb8237fe640 1 -- 172.21.15.19:0/3934441097 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fb83804e040 con 0x5624bfad6650 2024-09-10T22:25:42.697 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:42.690+0000 7fb84c93f740 10 client.15153 fetch_fsmap learned FSMap version 24 2024-09-10T22:25:42.697 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:42.690+0000 7fb84c93f740 1 -- 172.21.15.19:0/3934441097 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x5624bfb60aa0 con 0x5624bfad6650 2024-09-10T22:25:42.697 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:42.690+0000 7fb8237fe640 1 -- 172.21.15.19:0/3934441097 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb838031a30 con 0x5624bfad6650 2024-09-10T22:25:42.697 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:42.690+0000 7fb8237fe640 1 -- 172.21.15.19:0/3934441097 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7fb83803dab0 con 0x5624bfad6650 2024-09-10T22:25:42.697 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:42.690+0000 7fb84c93f740 10 client.15153 fetch_fsmap finished waiting for FSMap version 24 2024-09-10T22:25:42.697 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:42.690+0000 7fb84c93f740 10 client.15153 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-10T22:25:42.697 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:42.690+0000 7fb84c93f740 20 client.15153 populate_metadata read hostname 'smithi019' 2024-09-10T22:25:42.697 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:42.690+0000 7fb84c93f740 1 --2- 172.21.15.19:0/3934441097 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x5624bfb653a0 0x5624bfb640b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:25:42.697 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:42.690+0000 7fb84c93f740 4 client.15153 mds_command: new command op to 24581 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-10T22:25:42.697 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:42.690+0000 7fb84c93f740 1 -- 172.21.15.19:0/3934441097 --> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] -- command(tid 0: {"prefix": "status"}) -- 0x5624bfa4b610 con 0x5624bfb653a0 2024-09-10T22:25:42.698 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:42.691+0000 7fb843fff640 1 --2- 172.21.15.19:0/3934441097 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x5624bfb653a0 0x5624bfb640b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:25:42.698 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:42.691+0000 7fb843fff640 1 --2- 172.21.15.19:0/3934441097 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x5624bfb653a0 0x5624bfb640b0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d83d07473c611f77 server_cookie=3adb0cd59ae3f788 in_seq=0 out_seq=0 2024-09-10T22:25:42.698 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:42.691+0000 7fb8237fe640 10 client.15153 ms_handle_connect on v2:172.21.15.135:6838/1254769802 2024-09-10T22:25:42.698 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:42.691+0000 7fb8237fe640 1 -- 172.21.15.19:0/3934441097 <== mds.0 v2:172.21.15.135:6838/1254769802 1 ==== command_reply(tid 0: 0 ) ==== 8+0+326 (crc 0 0 0) 0x5624bfa4b610 con 0x5624bfb653a0 2024-09-10T22:25:42.698 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:42.691+0000 7fb8237fe640 10 client.15153 handle_command_reply: tid=0 2024-09-10T22:25:42.698 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:42.691+0000 7fb84c93f740 1 client.15153 shutdown 2024-09-10T22:25:42.698 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:42.691+0000 7fb84c93f740 1 -- 172.21.15.19:0/3934441097 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5624bfad6650 msgr2=0x5624bfafd560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:25:42.698 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:42.691+0000 7fb84c93f740 1 --2- 172.21.15.19:0/3934441097 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5624bfad6650 0x5624bfafd560 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7fb838060040 tx=0x7fb83804a680 comp rx=0 tx=0).stop 2024-09-10T22:25:42.698 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:42.691+0000 7fb84c93f740 1 -- 172.21.15.19:0/3934441097 shutdown_connections 2024-09-10T22:25:42.698 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:42.691+0000 7fb84c93f740 1 --2- 172.21.15.19:0/3934441097 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5624bfae25e0 0x5624bfaf76f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:25:42.698 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:42.691+0000 7fb84c93f740 1 --2- 172.21.15.19:0/3934441097 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5624bfad6650 0x5624bfafd560 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:25:42.698 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:42.691+0000 7fb84c93f740 1 --2- 172.21.15.19:0/3934441097 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x5624bfb653a0 0x5624bfb640b0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:25:42.699 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:42.691+0000 7fb84c93f740 1 --2- 172.21.15.19:0/3934441097 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5624bfad5d30 0x5624bfafcfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:25:42.699 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:42.691+0000 7fb8237fe640 0 client.15153 ms_handle_reset on v2:172.21.15.135:6838/1254769802 2024-09-10T22:25:42.699 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:42.691+0000 7fb84c93f740 1 -- 172.21.15.19:0/3934441097 >> 172.21.15.19:0/3934441097 conn(0x5624bfad3b60 msgr2=0x5624bfaed520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:25:42.699 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:42.692+0000 7fb84c93f740 1 -- 172.21.15.19:0/3934441097 shutdown_connections 2024-09-10T22:25:42.699 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:42.692+0000 7fb84c93f740 1 -- 172.21.15.19:0/3934441097 wait complete. 2024-09-10T22:25:42.699 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:42.692+0000 7fb84c93f740 20 client.15153 trim_cache size 0 max 16384 2024-09-10T22:25:42.699 INFO:teuthology.orchestra.run.smithi019.stdout:{ 2024-09-10T22:25:42.699 INFO:teuthology.orchestra.run.smithi019.stdout: "cluster_fsid": "22997a4c-6fc2-11ef-bcea-c7b262605968", 2024-09-10T22:25:42.699 INFO:teuthology.orchestra.run.smithi019.stdout: "whoami": 0, 2024-09-10T22:25:42.699 INFO:teuthology.orchestra.run.smithi019.stdout: "id": 24581, 2024-09-10T22:25:42.700 INFO:teuthology.orchestra.run.smithi019.stdout: "want_state": "up:active", 2024-09-10T22:25:42.700 INFO:teuthology.orchestra.run.smithi019.stdout: "state": "up:active", 2024-09-10T22:25:42.700 INFO:teuthology.orchestra.run.smithi019.stdout: "fs_name": "cephfs", 2024-09-10T22:25:42.700 INFO:teuthology.orchestra.run.smithi019.stdout: "rank_uptime": 79.553034126, 2024-09-10T22:25:42.700 INFO:teuthology.orchestra.run.smithi019.stdout: "mdsmap_epoch": 24, 2024-09-10T22:25:42.700 INFO:teuthology.orchestra.run.smithi019.stdout: "osdmap_epoch": 75, 2024-09-10T22:25:42.700 INFO:teuthology.orchestra.run.smithi019.stdout: "osdmap_epoch_barrier": 73, 2024-09-10T22:25:42.700 INFO:teuthology.orchestra.run.smithi019.stdout: "uptime": 90.279959895000005 2024-09-10T22:25:42.700 INFO:teuthology.orchestra.run.smithi019.stdout:} 2024-09-10T22:25:42.701 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:42.692+0000 7fb84a56a640 1 -- 172.21.15.19:0/3512027638 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7fb82c0b5370 msgr2=0x7fb82c0b7830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:25:42.701 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:42.692+0000 7fb84a56a640 1 --2- 172.21.15.19:0/3512027638 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7fb82c0b5370 0x7fb82c0b7830 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fb838000c00 tx=0x7fb8380095a0 comp rx=0 tx=0).stop 2024-09-10T22:25:42.701 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:42.692+0000 7fb84a56a640 1 -- 172.21.15.19:0/3512027638 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb844109150 msgr2=0x7fb844075f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:25:42.701 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:42.692+0000 7fb84a56a640 1 --2- 172.21.15.19:0/3512027638 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb844109150 0x7fb844075f20 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7fb83c00b990 tx=0x7fb83c00bd90 comp rx=0 tx=0).stop 2024-09-10T22:25:42.701 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:42.692+0000 7fb84a56a640 1 -- 172.21.15.19:0/3512027638 shutdown_connections 2024-09-10T22:25:42.701 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:42.692+0000 7fb84a56a640 1 --2- 172.21.15.19:0/3512027638 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7fb82c0b5370 0x7fb82c0b7830 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:25:42.701 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:42.692+0000 7fb84a56a640 1 --2- 172.21.15.19:0/3512027638 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb844109150 0x7fb844075f20 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:25:42.701 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:42.692+0000 7fb84a56a640 1 --2- 172.21.15.19:0/3512027638 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb8441087d0 0x7fb8440759e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:25:42.701 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:42.692+0000 7fb84a56a640 1 --2- 172.21.15.19:0/3512027638 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb844102dc0 0x7fb8440754a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:25:42.702 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:42.692+0000 7fb84a56a640 1 -- 172.21.15.19:0/3512027638 >> 172.21.15.19:0/3512027638 conn(0x7fb8440fe830 msgr2=0x7fb844100c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:25:42.702 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:42.693+0000 7fb84a56a640 1 -- 172.21.15.19:0/3512027638 shutdown_connections 2024-09-10T22:25:42.702 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:42.693+0000 7fb84a56a640 1 -- 172.21.15.19:0/3512027638 wait complete. 2024-09-10T22:25:43.442 INFO:tasks.cephadm:Setup complete, yielding 2024-09-10T22:25:43.442 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-09-10T22:25:43.452 INFO:tasks.cephadm:Running commands on role mon.a host ubuntu@smithi019.front.sepia.ceph.com 2024-09-10T22:25:43.452 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 22997a4c-6fc2-11ef-bcea-c7b262605968 -- bash -c 'ceph orch status' 2024-09-10T22:25:43.711 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/22997a4c-6fc2-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T22:25:44.140 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:25:43 smithi019 ceph-mon[31375]: pgmap v324: 97 pgs: 97 active+clean; 639 KiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-10T22:25:44.232 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:44.223+0000 7fbe91797640 1 -- 172.21.15.19:0/3811449641 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbe8c101220 msgr2=0x7fbe8c10b070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:25:44.232 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:44.223+0000 7fbe91797640 1 --2- 172.21.15.19:0/3811449641 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbe8c101220 0x7fbe8c10b070 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7fbe84009cd0 tx=0x7fbe8402a8e0 comp rx=0 tx=0).stop 2024-09-10T22:25:44.232 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:44.223+0000 7fbe91797640 1 -- 172.21.15.19:0/3811449641 shutdown_connections 2024-09-10T22:25:44.232 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:44.223+0000 7fbe91797640 1 --2- 172.21.15.19:0/3811449641 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbe8c101220 0x7fbe8c10b070 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:25:44.232 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:44.223+0000 7fbe91797640 1 --2- 172.21.15.19:0/3811449641 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fbe8c1049c0 0x7fbe8c100b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:25:44.232 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:44.223+0000 7fbe91797640 1 --2- 172.21.15.19:0/3811449641 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbe8c104080 0x7fbe8c104480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:25:44.232 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:44.223+0000 7fbe91797640 1 -- 172.21.15.19:0/3811449641 >> 172.21.15.19:0/3811449641 conn(0x7fbe8c0fc970 msgr2=0x7fbe8c0fedd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:25:44.232 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:44.223+0000 7fbe91797640 1 -- 172.21.15.19:0/3811449641 shutdown_connections 2024-09-10T22:25:44.232 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:44.223+0000 7fbe91797640 1 -- 172.21.15.19:0/3811449641 wait complete. 2024-09-10T22:25:44.232 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:44.224+0000 7fbe91797640 1 Processor -- start 2024-09-10T22:25:44.232 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:44.224+0000 7fbe91797640 1 -- start start 2024-09-10T22:25:44.233 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:44.224+0000 7fbe91797640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbe8c101220 0x7fbe8c198dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:25:44.233 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:44.224+0000 7fbe91797640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fbe8c104080 0x7fbe8c199410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:25:44.233 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:44.224+0000 7fbe91797640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbe8c1049c0 0x7fbe8c19a050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:25:44.233 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:44.224+0000 7fbe91797640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fbe8c10e6e0 con 0x7fbe8c1049c0 2024-09-10T22:25:44.233 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:44.224+0000 7fbe91797640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fbe8c10e560 con 0x7fbe8c101220 2024-09-10T22:25:44.233 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:44.224+0000 7fbe91797640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7fbe8c10e860 con 0x7fbe8c104080 2024-09-10T22:25:44.233 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:44.224+0000 7fbe8b7fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbe8c1049c0 0x7fbe8c19a050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:25:44.233 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:44.224+0000 7fbe8b7fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbe8c1049c0 0x7fbe8c19a050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:36136/0 (socket says 172.21.15.19:36136) 2024-09-10T22:25:44.233 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:44.224+0000 7fbe8b7fe640 1 -- 172.21.15.19:0/3091247348 learned_addr learned my addr 172.21.15.19:0/3091247348 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:25:44.233 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:44.224+0000 7fbe8affd640 1 --2- 172.21.15.19:0/3091247348 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbe8c101220 0x7fbe8c198dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:25:44.233 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:44.225+0000 7fbe8a7fc640 1 --2- 172.21.15.19:0/3091247348 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fbe8c104080 0x7fbe8c199410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:25:44.233 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:44.225+0000 7fbe8b7fe640 1 -- 172.21.15.19:0/3091247348 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fbe8c104080 msgr2=0x7fbe8c199410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:25:44.234 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:44.225+0000 7fbe8b7fe640 1 --2- 172.21.15.19:0/3091247348 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fbe8c104080 0x7fbe8c199410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:25:44.234 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:44.225+0000 7fbe8b7fe640 1 -- 172.21.15.19:0/3091247348 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbe8c101220 msgr2=0x7fbe8c198dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:25:44.234 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:44.225+0000 7fbe8b7fe640 1 --2- 172.21.15.19:0/3091247348 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbe8c101220 0x7fbe8c198dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:25:44.234 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:44.225+0000 7fbe8b7fe640 1 -- 172.21.15.19:0/3091247348 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbe8c19a8f0 con 0x7fbe8c1049c0 2024-09-10T22:25:44.234 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:44.225+0000 7fbe8b7fe640 1 --2- 172.21.15.19:0/3091247348 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbe8c1049c0 0x7fbe8c19a050 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7fbe84004af0 tx=0x7fbe84003c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:25:44.234 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:44.225+0000 7fbe73fff640 1 -- 172.21.15.19:0/3091247348 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe84004250 con 0x7fbe8c1049c0 2024-09-10T22:25:44.234 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:44.225+0000 7fbe91797640 1 -- 172.21.15.19:0/3091247348 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbe8c19ab80 con 0x7fbe8c1049c0 2024-09-10T22:25:44.234 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:44.225+0000 7fbe73fff640 1 -- 172.21.15.19:0/3091247348 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbe840305a0 con 0x7fbe8c1049c0 2024-09-10T22:25:44.234 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:44.225+0000 7fbe73fff640 1 -- 172.21.15.19:0/3091247348 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe840466e0 con 0x7fbe8c1049c0 2024-09-10T22:25:44.234 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:44.225+0000 7fbe91797640 1 -- 172.21.15.19:0/3091247348 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbe8c1a12c0 con 0x7fbe8c1049c0 2024-09-10T22:25:44.234 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:44.226+0000 7fbe91797640 1 -- 172.21.15.19:0/3091247348 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbe8c104480 con 0x7fbe8c1049c0 2024-09-10T22:25:44.234 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:44.228+0000 7fbe73fff640 1 -- 172.21.15.19:0/3091247348 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 17) ==== 153301+0+0 (secure 0 0 0) 0x7fbe8404e070 con 0x7fbe8c1049c0 2024-09-10T22:25:44.234 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:44.228+0000 7fbe73fff640 1 --2- 172.21.15.19:0/3091247348 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7fbe740b5370 0x7fbe740b7830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:25:44.234 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:44.229+0000 7fbe8affd640 1 --2- 172.21.15.19:0/3091247348 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7fbe740b5370 0x7fbe740b7830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:25:44.235 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:44.229+0000 7fbe73fff640 1 -- 172.21.15.19:0/3091247348 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8269+0+0 (secure 0 0 0) 0x7fbe8402e030 con 0x7fbe8c1049c0 2024-09-10T22:25:44.235 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:44.229+0000 7fbe8affd640 1 --2- 172.21.15.19:0/3091247348 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7fbe740b5370 0x7fbe740b7830 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fbe7c0058c0 tx=0x7fbe7c00a2d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:25:44.235 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:44.232+0000 7fbe73fff640 1 -- 172.21.15.19:0/3091247348 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7fbe8404b060 con 0x7fbe8c1049c0 2024-09-10T22:25:44.359 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:25:43 smithi135 ceph-mon[34789]: pgmap v324: 97 pgs: 97 active+clean; 639 KiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-10T22:25:44.375 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:25:43 smithi138 ceph-mon[35236]: pgmap v324: 97 pgs: 97 active+clean; 639 KiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-10T22:25:44.438 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:44.437+0000 7fbe91797640 1 -- 172.21.15.19:0/3091247348 --> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] -- mgr_command(tid 0: {"prefix": "orch status", "target": ["mon-mgr", ""]}) -- 0x7fbe8c063590 con 0x7fbe740b5370 2024-09-10T22:25:44.439 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:44.438+0000 7fbe73fff640 1 -- 172.21.15.19:0/3091247348 <== mgr.14150 v2:172.21.15.19:6800/2119495487 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+43 (secure 0 0 0) 0x7fbe8c063590 con 0x7fbe740b5370 2024-09-10T22:25:44.439 INFO:teuthology.orchestra.run.smithi019.stdout:Backend: cephadm 2024-09-10T22:25:44.440 INFO:teuthology.orchestra.run.smithi019.stdout:Available: Yes 2024-09-10T22:25:44.440 INFO:teuthology.orchestra.run.smithi019.stdout:Paused: No 2024-09-10T22:25:44.442 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:44.440+0000 7fbe91797640 1 -- 172.21.15.19:0/3091247348 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7fbe740b5370 msgr2=0x7fbe740b7830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:25:44.442 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:44.440+0000 7fbe91797640 1 --2- 172.21.15.19:0/3091247348 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7fbe740b5370 0x7fbe740b7830 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fbe7c0058c0 tx=0x7fbe7c00a2d0 comp rx=0 tx=0).stop 2024-09-10T22:25:44.442 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:44.440+0000 7fbe91797640 1 -- 172.21.15.19:0/3091247348 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbe8c1049c0 msgr2=0x7fbe8c19a050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:25:44.442 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:44.440+0000 7fbe91797640 1 --2- 172.21.15.19:0/3091247348 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbe8c1049c0 0x7fbe8c19a050 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7fbe84004af0 tx=0x7fbe84003c10 comp rx=0 tx=0).stop 2024-09-10T22:25:44.442 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:44.440+0000 7fbe91797640 1 -- 172.21.15.19:0/3091247348 shutdown_connections 2024-09-10T22:25:44.442 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:44.440+0000 7fbe91797640 1 --2- 172.21.15.19:0/3091247348 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7fbe740b5370 0x7fbe740b7830 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:25:44.442 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:44.440+0000 7fbe91797640 1 --2- 172.21.15.19:0/3091247348 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbe8c1049c0 0x7fbe8c19a050 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:25:44.442 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:44.440+0000 7fbe91797640 1 --2- 172.21.15.19:0/3091247348 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fbe8c104080 0x7fbe8c199410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:25:44.442 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:44.440+0000 7fbe91797640 1 --2- 172.21.15.19:0/3091247348 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbe8c101220 0x7fbe8c198dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:25:44.443 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:44.440+0000 7fbe91797640 1 -- 172.21.15.19:0/3091247348 >> 172.21.15.19:0/3091247348 conn(0x7fbe8c0fc970 msgr2=0x7fbe8c1070c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:25:44.443 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:44.441+0000 7fbe91797640 1 -- 172.21.15.19:0/3091247348 shutdown_connections 2024-09-10T22:25:44.443 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:44.441+0000 7fbe91797640 1 -- 172.21.15.19:0/3091247348 wait complete. 2024-09-10T22:25:45.050 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 22997a4c-6fc2-11ef-bcea-c7b262605968 -- bash -c 'ceph orch ps' 2024-09-10T22:25:45.307 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/22997a4c-6fc2-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T22:25:45.765 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:45.762+0000 7f79c7b91640 1 -- 172.21.15.19:0/522280633 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f79c0107f60 msgr2=0x7f79c010a350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:25:45.766 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:45.762+0000 7f79c7b91640 1 --2- 172.21.15.19:0/522280633 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f79c0107f60 0x7f79c010a350 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f79b0009900 tx=0x7f79b002a410 comp rx=0 tx=0).stop 2024-09-10T22:25:45.766 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:45.762+0000 7f79c7b91640 1 -- 172.21.15.19:0/522280633 shutdown_connections 2024-09-10T22:25:45.766 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:45.762+0000 7f79c7b91640 1 --2- 172.21.15.19:0/522280633 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f79c010a970 0x7f79c010ce30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:25:45.766 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:45.762+0000 7f79c7b91640 1 --2- 172.21.15.19:0/522280633 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f79c0107f60 0x7f79c010a350 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:25:45.766 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:45.762+0000 7f79c7b91640 1 --2- 172.21.15.19:0/522280633 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f79c006bfb0 0x7f79c0107a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:25:45.766 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:45.762+0000 7f79c7b91640 1 -- 172.21.15.19:0/522280633 >> 172.21.15.19:0/522280633 conn(0x7f79c00fd210 msgr2=0x7f79c00ff650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:25:45.766 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:45.763+0000 7f79c7b91640 1 -- 172.21.15.19:0/522280633 shutdown_connections 2024-09-10T22:25:45.766 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:45.763+0000 7f79c7b91640 1 -- 172.21.15.19:0/522280633 wait complete. 2024-09-10T22:25:45.766 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:45.763+0000 7f79c7b91640 1 Processor -- start 2024-09-10T22:25:45.766 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:45.763+0000 7f79c7b91640 1 -- start start 2024-09-10T22:25:45.766 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:45.763+0000 7f79c7b91640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f79c006bfb0 0x7f79c019b070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:25:45.767 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:45.763+0000 7f79c7b91640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f79c0107f60 0x7f79c019b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:25:45.767 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:45.763+0000 7f79c7b91640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f79c010a970 0x7f79c019c300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:25:45.767 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:45.763+0000 7f79c7b91640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f79c0110920 con 0x7f79c0107f60 2024-09-10T22:25:45.767 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:45.763+0000 7f79c7b91640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f79c01107a0 con 0x7f79c006bfb0 2024-09-10T22:25:45.767 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:45.763+0000 7f79c7b91640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f79c0110aa0 con 0x7f79c010a970 2024-09-10T22:25:45.767 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:45.763+0000 7f79c512c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f79c0107f60 0x7f79c019b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:25:45.767 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:45.764+0000 7f79c512c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f79c0107f60 0x7f79c019b6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:36162/0 (socket says 172.21.15.19:36162) 2024-09-10T22:25:45.767 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:45.764+0000 7f79c512c640 1 -- 172.21.15.19:0/2472444565 learned_addr learned my addr 172.21.15.19:0/2472444565 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:25:45.767 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:45.764+0000 7f79c612e640 1 --2- 172.21.15.19:0/2472444565 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f79c010a970 0x7f79c019c300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:25:45.767 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:45.764+0000 7f79c592d640 1 --2- 172.21.15.19:0/2472444565 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f79c006bfb0 0x7f79c019b070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:25:45.767 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:45.764+0000 7f79c512c640 1 -- 172.21.15.19:0/2472444565 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f79c010a970 msgr2=0x7f79c019c300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:25:45.767 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:45.764+0000 7f79c512c640 1 --2- 172.21.15.19:0/2472444565 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f79c010a970 0x7f79c019c300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:25:45.768 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:45.764+0000 7f79c512c640 1 -- 172.21.15.19:0/2472444565 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f79c006bfb0 msgr2=0x7f79c019b070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:25:45.768 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:45.764+0000 7f79c512c640 1 --2- 172.21.15.19:0/2472444565 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f79c006bfb0 0x7f79c019b070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:25:45.768 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:45.764+0000 7f79c512c640 1 -- 172.21.15.19:0/2472444565 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f79c019cba0 con 0x7f79c0107f60 2024-09-10T22:25:45.768 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:45.764+0000 7f79c612e640 1 --2- 172.21.15.19:0/2472444565 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f79c010a970 0x7f79c019c300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T22:25:45.768 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:45.764+0000 7f79c512c640 1 --2- 172.21.15.19:0/2472444565 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f79c0107f60 0x7f79c019b6c0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f79b0006010 tx=0x7f79b00042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:25:45.768 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:45.764+0000 7f79b6ffd640 1 -- 172.21.15.19:0/2472444565 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79b003f030 con 0x7f79c0107f60 2024-09-10T22:25:45.768 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:45.764+0000 7f79b6ffd640 1 -- 172.21.15.19:0/2472444565 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f79b0003cb0 con 0x7f79c0107f60 2024-09-10T22:25:45.768 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:45.764+0000 7f79c7b91640 1 -- 172.21.15.19:0/2472444565 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f79c019ce30 con 0x7f79c0107f60 2024-09-10T22:25:45.768 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:45.764+0000 7f79b6ffd640 1 -- 172.21.15.19:0/2472444565 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79b0035070 con 0x7f79c0107f60 2024-09-10T22:25:45.768 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:45.764+0000 7f79c7b91640 1 -- 172.21.15.19:0/2472444565 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f79c01a3420 con 0x7f79c0107f60 2024-09-10T22:25:45.769 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:45.765+0000 7f79c7b91640 1 -- 172.21.15.19:0/2472444565 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f79c00fed00 con 0x7f79c0107f60 2024-09-10T22:25:45.769 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:45.767+0000 7f79b6ffd640 1 -- 172.21.15.19:0/2472444565 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 17) ==== 153301+0+0 (secure 0 0 0) 0x7f79b003bb60 con 0x7f79c0107f60 2024-09-10T22:25:45.769 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:45.767+0000 7f79b6ffd640 1 --2- 172.21.15.19:0/2472444565 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f79ac0b5370 0x7f79ac0b7830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:25:45.769 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:45.768+0000 7f79c592d640 1 --2- 172.21.15.19:0/2472444565 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f79ac0b5370 0x7f79ac0b7830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:25:45.769 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:45.768+0000 7f79b6ffd640 1 -- 172.21.15.19:0/2472444565 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8269+0+0 (secure 0 0 0) 0x7f79b0106790 con 0x7f79c0107f60 2024-09-10T22:25:45.770 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:45.768+0000 7f79c592d640 1 --2- 172.21.15.19:0/2472444565 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f79ac0b5370 0x7f79ac0b7830 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f79bc005fd0 tx=0x7f79bc005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:25:45.773 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:45.772+0000 7f79b6ffd640 1 -- 172.21.15.19:0/2472444565 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f79b00cd4d0 con 0x7f79c0107f60 2024-09-10T22:25:45.958 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:25:45 smithi019 ceph-mon[31375]: pgmap v325: 97 pgs: 97 active+clean; 639 KiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-10T22:25:45.958 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:25:45 smithi019 ceph-mon[31375]: from='client.15159 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T22:25:45.970 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:45.969+0000 7f79c7b91640 1 -- 172.21.15.19:0/2472444565 --> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7f79c0063590 con 0x7f79ac0b5370 2024-09-10T22:25:45.983 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:45.981+0000 7f79b6ffd640 1 -- 172.21.15.19:0/2472444565 <== mgr.14150 v2:172.21.15.19:6800/2119495487 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+4185 (secure 0 0 0) 0x7f79c0063590 con 0x7f79ac0b5370 2024-09-10T22:25:45.983 INFO:teuthology.orchestra.run.smithi019.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-10T22:25:45.983 INFO:teuthology.orchestra.run.smithi019.stdout:mds.a smithi019 running (96s) 17s ago 96s 14.3M - 19.3.0-4854-g8f219c47 589dd18248e4 16d7ea2bbef2 2024-09-10T22:25:45.983 INFO:teuthology.orchestra.run.smithi019.stdout:mds.b smithi135 running (93s) 25s ago 93s 28.8M - 19.3.0-4854-g8f219c47 589dd18248e4 6fb2e6fcd715 2024-09-10T22:25:45.983 INFO:teuthology.orchestra.run.smithi019.stdout:mds.c smithi138 running (108s) 25s ago 107s 20.8M - 19.3.0-4854-g8f219c47 589dd18248e4 74c18554cfd2 2024-09-10T22:25:45.983 INFO:teuthology.orchestra.run.smithi019.stdout:mds.d smithi019 running (115s) 17s ago 115s 14.6M - 19.3.0-4854-g8f219c47 589dd18248e4 9c8759d92dcf 2024-09-10T22:25:45.983 INFO:teuthology.orchestra.run.smithi019.stdout:mds.e smithi135 running (113s) 25s ago 112s 17.3M - 19.3.0-4854-g8f219c47 589dd18248e4 2fa618a33836 2024-09-10T22:25:45.983 INFO:teuthology.orchestra.run.smithi019.stdout:mds.f smithi138 running (110s) 25s ago 110s 19.7M - 19.3.0-4854-g8f219c47 589dd18248e4 e5b74373683a 2024-09-10T22:25:45.983 INFO:teuthology.orchestra.run.smithi019.stdout:mds.g smithi019 running (99s) 17s ago 99s 16.8M - 19.3.0-4854-g8f219c47 589dd18248e4 d78254ae03bc 2024-09-10T22:25:45.983 INFO:teuthology.orchestra.run.smithi019.stdout:mds.h smithi135 running (105s) 25s ago 105s 18.5M - 19.3.0-4854-g8f219c47 589dd18248e4 ce1d853e4315 2024-09-10T22:25:45.984 INFO:teuthology.orchestra.run.smithi019.stdout:mds.i smithi138 running (102s) 25s ago 102s 18.6M - 19.3.0-4854-g8f219c47 589dd18248e4 5bf363fdcbba 2024-09-10T22:25:45.984 INFO:teuthology.orchestra.run.smithi019.stdout:mds.j smithi019 running (118s) 17s ago 118s 14.7M - 19.3.0-4854-g8f219c47 589dd18248e4 297f16ebdbc6 2024-09-10T22:25:45.984 INFO:teuthology.orchestra.run.smithi019.stdout:mds.k smithi135 running (2m) 25s ago 2m 14.0M - 19.3.0-4854-g8f219c47 589dd18248e4 3acd4fb17fd4 2024-09-10T22:25:45.984 INFO:teuthology.orchestra.run.smithi019.stdout:mds.l smithi138 running (2m) 25s ago 2m 14.7M - 19.3.0-4854-g8f219c47 589dd18248e4 1308ae046e9e 2024-09-10T22:25:45.984 INFO:teuthology.orchestra.run.smithi019.stdout:mgr.x smithi019 *:9283,8765 running (9m) 17s ago 9m 522M - 19.3.0-4854-g8f219c47 589dd18248e4 abb4423f855b 2024-09-10T22:25:45.984 INFO:teuthology.orchestra.run.smithi019.stdout:mgr.y smithi135 *:8443,8765 running (7m) 25s ago 7m 458M - 19.3.0-4854-g8f219c47 589dd18248e4 8155995dafc3 2024-09-10T22:25:45.984 INFO:teuthology.orchestra.run.smithi019.stdout:mgr.z smithi138 *:8443,8765 running (7m) 25s ago 7m 458M - 19.3.0-4854-g8f219c47 589dd18248e4 ecaaea115c2f 2024-09-10T22:25:45.984 INFO:teuthology.orchestra.run.smithi019.stdout:mon.a smithi019 running (9m) 17s ago 9m 51.8M 2048M 19.3.0-4854-g8f219c47 589dd18248e4 9dcddfe60fd2 2024-09-10T22:25:45.984 INFO:teuthology.orchestra.run.smithi019.stdout:mon.b smithi135 running (7m) 25s ago 7m 41.1M 2048M 19.3.0-4854-g8f219c47 589dd18248e4 b8f7a223e8ed 2024-09-10T22:25:45.984 INFO:teuthology.orchestra.run.smithi019.stdout:mon.c smithi138 running (8m) 25s ago 8m 41.5M 2048M 19.3.0-4854-g8f219c47 589dd18248e4 79446bdec6a9 2024-09-10T22:25:45.984 INFO:teuthology.orchestra.run.smithi019.stdout:osd.0 smithi019 running (6m) 17s ago 6m 55.5M 4273M 19.3.0-4854-g8f219c47 589dd18248e4 8bef7f5ab255 2024-09-10T22:25:45.984 INFO:teuthology.orchestra.run.smithi019.stdout:osd.1 smithi135 running (6m) 25s ago 6m 55.7M 1453M 19.3.0-4854-g8f219c47 589dd18248e4 9ec6f408f2dc 2024-09-10T22:25:45.984 INFO:teuthology.orchestra.run.smithi019.stdout:osd.2 smithi138 running (6m) 25s ago 6m 58.3M 4272M 19.3.0-4854-g8f219c47 589dd18248e4 2b2baac2436c 2024-09-10T22:25:45.985 INFO:teuthology.orchestra.run.smithi019.stdout:osd.3 smithi019 running (5m) 17s ago 5m 46.3M 4273M 19.3.0-4854-g8f219c47 589dd18248e4 983ff26efd84 2024-09-10T22:25:45.985 INFO:teuthology.orchestra.run.smithi019.stdout:osd.4 smithi135 running (5m) 25s ago 5m 48.3M 1453M 19.3.0-4854-g8f219c47 589dd18248e4 808fafdf68fc 2024-09-10T22:25:45.985 INFO:teuthology.orchestra.run.smithi019.stdout:osd.5 smithi138 running (4m) 25s ago 4m 48.9M 4272M 19.3.0-4854-g8f219c47 589dd18248e4 a103b41acd1f 2024-09-10T22:25:45.985 INFO:teuthology.orchestra.run.smithi019.stdout:osd.6 smithi019 running (4m) 17s ago 4m 44.9M 4273M 19.3.0-4854-g8f219c47 589dd18248e4 5fbd5f28bef8 2024-09-10T22:25:45.985 INFO:teuthology.orchestra.run.smithi019.stdout:osd.7 smithi135 running (4m) 25s ago 4m 55.8M 1453M 19.3.0-4854-g8f219c47 589dd18248e4 fffdc7b78edb 2024-09-10T22:25:45.985 INFO:teuthology.orchestra.run.smithi019.stdout:osd.8 smithi138 running (3m) 25s ago 3m 46.4M 4272M 19.3.0-4854-g8f219c47 589dd18248e4 b2b1c3afcc3a 2024-09-10T22:25:45.985 INFO:teuthology.orchestra.run.smithi019.stdout:osd.9 smithi019 running (3m) 17s ago 3m 46.4M 4273M 19.3.0-4854-g8f219c47 589dd18248e4 5edb06d2d43c 2024-09-10T22:25:45.985 INFO:teuthology.orchestra.run.smithi019.stdout:osd.10 smithi135 running (2m) 25s ago 2m 54.0M 1453M 19.3.0-4854-g8f219c47 589dd18248e4 c1d646343c5c 2024-09-10T22:25:45.985 INFO:teuthology.orchestra.run.smithi019.stdout:osd.11 smithi138 running (2m) 25s ago 2m 42.9M 4272M 19.3.0-4854-g8f219c47 589dd18248e4 e8513dea8811 2024-09-10T22:25:45.986 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:45.983+0000 7f79c7b91640 1 -- 172.21.15.19:0/2472444565 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f79ac0b5370 msgr2=0x7f79ac0b7830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:25:45.986 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:45.983+0000 7f79c7b91640 1 --2- 172.21.15.19:0/2472444565 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f79ac0b5370 0x7f79ac0b7830 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f79bc005fd0 tx=0x7f79bc005850 comp rx=0 tx=0).stop 2024-09-10T22:25:45.986 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:45.983+0000 7f79c7b91640 1 -- 172.21.15.19:0/2472444565 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f79c0107f60 msgr2=0x7f79c019b6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:25:45.986 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:45.983+0000 7f79c7b91640 1 --2- 172.21.15.19:0/2472444565 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f79c0107f60 0x7f79c019b6c0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f79b0006010 tx=0x7f79b00042f0 comp rx=0 tx=0).stop 2024-09-10T22:25:45.986 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:45.984+0000 7f79c7b91640 1 -- 172.21.15.19:0/2472444565 shutdown_connections 2024-09-10T22:25:45.986 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:45.984+0000 7f79c7b91640 1 --2- 172.21.15.19:0/2472444565 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f79ac0b5370 0x7f79ac0b7830 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:25:45.986 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:45.984+0000 7f79c7b91640 1 --2- 172.21.15.19:0/2472444565 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f79c010a970 0x7f79c019c300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:25:45.987 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:45.984+0000 7f79c7b91640 1 --2- 172.21.15.19:0/2472444565 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f79c0107f60 0x7f79c019b6c0 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:25:45.987 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:45.984+0000 7f79c7b91640 1 --2- 172.21.15.19:0/2472444565 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f79c006bfb0 0x7f79c019b070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:25:45.987 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:45.984+0000 7f79c7b91640 1 -- 172.21.15.19:0/2472444565 >> 172.21.15.19:0/2472444565 conn(0x7f79c00fd210 msgr2=0x7f79c0108b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:25:45.987 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:45.984+0000 7f79c7b91640 1 -- 172.21.15.19:0/2472444565 shutdown_connections 2024-09-10T22:25:45.987 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:45.984+0000 7f79c7b91640 1 -- 172.21.15.19:0/2472444565 wait complete. 2024-09-10T22:25:46.359 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:25:45 smithi135 ceph-mon[34789]: pgmap v325: 97 pgs: 97 active+clean; 639 KiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-10T22:25:46.360 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:25:45 smithi135 ceph-mon[34789]: from='client.15159 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T22:25:46.374 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:25:45 smithi138 ceph-mon[35236]: pgmap v325: 97 pgs: 97 active+clean; 639 KiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-10T22:25:46.375 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:25:45 smithi138 ceph-mon[35236]: from='client.15159 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T22:25:46.605 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 22997a4c-6fc2-11ef-bcea-c7b262605968 -- bash -c 'ceph orch ls' 2024-09-10T22:25:46.862 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/22997a4c-6fc2-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T22:25:47.159 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:25:46 smithi019 ceph-mon[31375]: from='client.15165 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T22:25:47.359 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:25:46 smithi135 ceph-mon[34789]: from='client.15165 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T22:25:47.365 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:47.353+0000 7f861b417640 1 -- 172.21.15.19:0/495532182 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8614105b80 msgr2=0x7f8614107ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:25:47.365 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:47.353+0000 7f861b417640 1 --2- 172.21.15.19:0/495532182 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8614105b80 0x7f8614107ff0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f8604009900 tx=0x7f860402a410 comp rx=0 tx=0).stop 2024-09-10T22:25:47.365 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:47.353+0000 7f861b417640 1 -- 172.21.15.19:0/495532182 shutdown_connections 2024-09-10T22:25:47.365 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:47.353+0000 7f861b417640 1 --2- 172.21.15.19:0/495532182 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8614108730 0x7f861410abf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:25:47.365 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:47.353+0000 7f861b417640 1 --2- 172.21.15.19:0/495532182 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8614105b80 0x7f8614107ff0 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:25:47.365 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:47.353+0000 7f861b417640 1 --2- 172.21.15.19:0/495532182 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f861406b6e0 0x7f86141055f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:25:47.365 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:47.353+0000 7f861b417640 1 -- 172.21.15.19:0/495532182 >> 172.21.15.19:0/495532182 conn(0x7f86140fd1e0 msgr2=0x7f86140ff620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:25:47.366 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:47.353+0000 7f861b417640 1 -- 172.21.15.19:0/495532182 shutdown_connections 2024-09-10T22:25:47.366 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:47.353+0000 7f861b417640 1 -- 172.21.15.19:0/495532182 wait complete. 2024-09-10T22:25:47.366 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:47.353+0000 7f861b417640 1 Processor -- start 2024-09-10T22:25:47.366 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:47.354+0000 7f861b417640 1 -- start start 2024-09-10T22:25:47.366 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:47.354+0000 7f861b417640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f861406b6e0 0x7f861419b170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:25:47.366 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:47.354+0000 7f861b417640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8614105b80 0x7f861419b7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:25:47.366 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:47.354+0000 7f861b417640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f8614108730 0x7f861419c400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:25:47.366 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:47.354+0000 7f861b417640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f861410e760 con 0x7f8614105b80 2024-09-10T22:25:47.366 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:47.354+0000 7f861b417640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f861410e5e0 con 0x7f861406b6e0 2024-09-10T22:25:47.366 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:47.354+0000 7f861b417640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f861410e8e0 con 0x7f8614108730 2024-09-10T22:25:47.366 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:47.354+0000 7f86189b2640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8614105b80 0x7f861419b7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:25:47.366 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:47.354+0000 7f86189b2640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8614105b80 0x7f861419b7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:36176/0 (socket says 172.21.15.19:36176) 2024-09-10T22:25:47.367 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:47.354+0000 7f86189b2640 1 -- 172.21.15.19:0/1035225907 learned_addr learned my addr 172.21.15.19:0/1035225907 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:25:47.367 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:47.354+0000 7f86191b3640 1 --2- 172.21.15.19:0/1035225907 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f861406b6e0 0x7f861419b170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:25:47.367 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:47.354+0000 7f86189b2640 1 -- 172.21.15.19:0/1035225907 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f8614108730 msgr2=0x7f861419c400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:25:47.367 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:47.354+0000 7f86199b4640 1 --2- 172.21.15.19:0/1035225907 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f8614108730 0x7f861419c400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:25:47.367 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:47.354+0000 7f86189b2640 1 --2- 172.21.15.19:0/1035225907 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f8614108730 0x7f861419c400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:25:47.367 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:47.354+0000 7f86189b2640 1 -- 172.21.15.19:0/1035225907 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f861406b6e0 msgr2=0x7f861419b170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:25:47.367 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:47.354+0000 7f86189b2640 1 --2- 172.21.15.19:0/1035225907 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f861406b6e0 0x7f861419b170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:25:47.367 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:47.354+0000 7f86189b2640 1 -- 172.21.15.19:0/1035225907 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f861419cca0 con 0x7f8614105b80 2024-09-10T22:25:47.367 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:47.354+0000 7f86199b4640 1 --2- 172.21.15.19:0/1035225907 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f8614108730 0x7f861419c400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T22:25:47.367 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:47.354+0000 7f86189b2640 1 --2- 172.21.15.19:0/1035225907 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8614105b80 0x7f861419b7c0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f8604006010 tx=0x7f8604004430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:25:47.367 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:47.354+0000 7f860a7fc640 1 -- 172.21.15.19:0/1035225907 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f860403f030 con 0x7f8614105b80 2024-09-10T22:25:47.368 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:47.355+0000 7f861b417640 1 -- 172.21.15.19:0/1035225907 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f861419cf30 con 0x7f8614105b80 2024-09-10T22:25:47.368 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:47.355+0000 7f860a7fc640 1 -- 172.21.15.19:0/1035225907 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8604003cb0 con 0x7f8614105b80 2024-09-10T22:25:47.368 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:47.355+0000 7f860a7fc640 1 -- 172.21.15.19:0/1035225907 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8604035070 con 0x7f8614105b80 2024-09-10T22:25:47.368 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:47.355+0000 7f861b417640 1 -- 172.21.15.19:0/1035225907 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f86141a3520 con 0x7f8614105b80 2024-09-10T22:25:47.368 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:47.355+0000 7f861b417640 1 -- 172.21.15.19:0/1035225907 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f86141a3840 con 0x7f8614105b80 2024-09-10T22:25:47.368 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:47.357+0000 7f860a7fc640 1 -- 172.21.15.19:0/1035225907 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 17) ==== 153301+0+0 (secure 0 0 0) 0x7f860403bc20 con 0x7f8614105b80 2024-09-10T22:25:47.368 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:47.358+0000 7f860a7fc640 1 --2- 172.21.15.19:0/1035225907 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f86000b5370 0x7f86000b7830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:25:47.368 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:47.358+0000 7f86191b3640 1 --2- 172.21.15.19:0/1035225907 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f86000b5370 0x7f86000b7830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:25:47.368 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:47.358+0000 7f860a7fc640 1 -- 172.21.15.19:0/1035225907 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8269+0+0 (secure 0 0 0) 0x7f8604106c60 con 0x7f8614105b80 2024-09-10T22:25:47.368 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:47.359+0000 7f86191b3640 1 --2- 172.21.15.19:0/1035225907 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f86000b5370 0x7f86000b7830 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f8610009890 tx=0x7f8610008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:25:47.368 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:47.361+0000 7f860a7fc640 1 -- 172.21.15.19:0/1035225907 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f86040cd940 con 0x7f8614105b80 2024-09-10T22:25:47.374 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:25:46 smithi138 ceph-mon[35236]: from='client.15165 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T22:25:47.559 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:47.558+0000 7f861b417640 1 -- 172.21.15.19:0/1035225907 --> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] -- mgr_command(tid 0: {"prefix": "orch ls", "target": ["mon-mgr", ""]}) -- 0x7f861410a4b0 con 0x7f86000b5370 2024-09-10T22:25:47.566 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:47.565+0000 7f860a7fc640 1 -- 172.21.15.19:0/1035225907 <== mgr.14150 v2:172.21.15.19:6800/2119495487 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+980 (secure 0 0 0) 0x7f861410a4b0 con 0x7f86000b5370 2024-09-10T22:25:47.567 INFO:teuthology.orchestra.run.smithi019.stdout:NAME PORTS RUNNING REFRESHED AGE PLACEMENT 2024-09-10T22:25:47.567 INFO:teuthology.orchestra.run.smithi019.stdout:mds.all 12/12 27s ago 2m smithi019=a;smithi019=d;smithi019=g;smithi019=j;smithi135=b;smithi135=e;smithi135=h;smithi135=k;smithi138=c;smithi138=f;smithi138=i;smithi138=l;count:12 2024-09-10T22:25:47.567 INFO:teuthology.orchestra.run.smithi019.stdout:mgr 3/3 27s ago 7m smithi019=x;smithi135=y;smithi138=z;count:3 2024-09-10T22:25:47.567 INFO:teuthology.orchestra.run.smithi019.stdout:mon 3/3 27s ago 8m smithi019:172.21.15.19=a;smithi135:172.21.15.135=b;smithi138:172.21.15.138=c;count:3 2024-09-10T22:25:47.567 INFO:teuthology.orchestra.run.smithi019.stdout:osd 12 27s ago - 2024-09-10T22:25:47.568 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:47.567+0000 7f861b417640 1 -- 172.21.15.19:0/1035225907 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f86000b5370 msgr2=0x7f86000b7830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:25:47.569 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:47.567+0000 7f861b417640 1 --2- 172.21.15.19:0/1035225907 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f86000b5370 0x7f86000b7830 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f8610009890 tx=0x7f8610008040 comp rx=0 tx=0).stop 2024-09-10T22:25:47.569 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:47.567+0000 7f861b417640 1 -- 172.21.15.19:0/1035225907 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8614105b80 msgr2=0x7f861419b7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:25:47.569 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:47.567+0000 7f861b417640 1 --2- 172.21.15.19:0/1035225907 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8614105b80 0x7f861419b7c0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f8604006010 tx=0x7f8604004430 comp rx=0 tx=0).stop 2024-09-10T22:25:47.569 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:47.567+0000 7f861b417640 1 -- 172.21.15.19:0/1035225907 shutdown_connections 2024-09-10T22:25:47.569 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:47.567+0000 7f861b417640 1 --2- 172.21.15.19:0/1035225907 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f86000b5370 0x7f86000b7830 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:25:47.569 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:47.567+0000 7f861b417640 1 --2- 172.21.15.19:0/1035225907 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f8614108730 0x7f861419c400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:25:47.569 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:47.567+0000 7f861b417640 1 --2- 172.21.15.19:0/1035225907 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8614105b80 0x7f861419b7c0 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:25:47.569 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:47.567+0000 7f861b417640 1 --2- 172.21.15.19:0/1035225907 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f861406b6e0 0x7f861419b170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:25:47.569 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:47.567+0000 7f861b417640 1 -- 172.21.15.19:0/1035225907 >> 172.21.15.19:0/1035225907 conn(0x7f86140fd1e0 msgr2=0x7f86140ff5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:25:47.569 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:47.567+0000 7f861b417640 1 -- 172.21.15.19:0/1035225907 shutdown_connections 2024-09-10T22:25:47.569 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:47.567+0000 7f861b417640 1 -- 172.21.15.19:0/1035225907 wait complete. 2024-09-10T22:25:48.199 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:25:47 smithi019 ceph-mon[31375]: pgmap v326: 97 pgs: 97 active+clean; 639 KiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-10T22:25:48.242 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 22997a4c-6fc2-11ef-bcea-c7b262605968 -- bash -c 'ceph orch host ls' 2024-09-10T22:25:48.359 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:25:47 smithi135 ceph-mon[34789]: pgmap v326: 97 pgs: 97 active+clean; 639 KiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-10T22:25:48.374 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:25:47 smithi138 ceph-mon[35236]: pgmap v326: 97 pgs: 97 active+clean; 639 KiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-10T22:25:48.506 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/22997a4c-6fc2-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T22:25:49.027 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:48.984+0000 7fea8a03e640 1 -- 172.21.15.19:0/3961064261 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fea8406b6e0 msgr2=0x7fea841055f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:25:49.027 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:48.984+0000 7fea8a03e640 1 --2- 172.21.15.19:0/3961064261 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fea8406b6e0 0x7fea841055f0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7fea74009ca0 tx=0x7fea7402a8c0 comp rx=0 tx=0).stop 2024-09-10T22:25:49.027 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:48.985+0000 7fea8a03e640 1 -- 172.21.15.19:0/3961064261 shutdown_connections 2024-09-10T22:25:49.028 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:48.985+0000 7fea8a03e640 1 --2- 172.21.15.19:0/3961064261 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fea84108730 0x7fea8410abf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:25:49.028 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:48.985+0000 7fea8a03e640 1 --2- 172.21.15.19:0/3961064261 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fea84105b80 0x7fea84107ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:25:49.028 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:48.985+0000 7fea8a03e640 1 --2- 172.21.15.19:0/3961064261 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fea8406b6e0 0x7fea841055f0 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:25:49.028 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:48.985+0000 7fea8a03e640 1 -- 172.21.15.19:0/3961064261 >> 172.21.15.19:0/3961064261 conn(0x7fea840fd1e0 msgr2=0x7fea840ff620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:25:49.028 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:48.985+0000 7fea8a03e640 1 -- 172.21.15.19:0/3961064261 shutdown_connections 2024-09-10T22:25:49.028 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:48.985+0000 7fea8a03e640 1 -- 172.21.15.19:0/3961064261 wait complete. 2024-09-10T22:25:49.028 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:48.985+0000 7fea8a03e640 1 Processor -- start 2024-09-10T22:25:49.028 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:48.985+0000 7fea8a03e640 1 -- start start 2024-09-10T22:25:49.028 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:48.986+0000 7fea8a03e640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fea8406b6e0 0x7fea84198ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:25:49.028 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:48.986+0000 7fea8a03e640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fea84105b80 0x7fea841994f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:25:49.029 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:48.986+0000 7fea8a03e640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fea84108730 0x7fea8419a0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:25:49.029 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:48.986+0000 7fea8a03e640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fea8410e6b0 con 0x7fea84108730 2024-09-10T22:25:49.029 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:48.986+0000 7fea8a03e640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fea8410e530 con 0x7fea84105b80 2024-09-10T22:25:49.029 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:48.986+0000 7fea8a03e640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7fea8410e830 con 0x7fea8406b6e0 2024-09-10T22:25:49.029 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:48.986+0000 7fea83fff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fea84108730 0x7fea8419a0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:25:49.029 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:48.986+0000 7fea83fff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fea84108730 0x7fea8419a0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:36196/0 (socket says 172.21.15.19:36196) 2024-09-10T22:25:49.029 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:48.986+0000 7fea83fff640 1 -- 172.21.15.19:0/3510071170 learned_addr learned my addr 172.21.15.19:0/3510071170 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:25:49.029 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:48.986+0000 7fea837fe640 1 --2- 172.21.15.19:0/3510071170 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fea8406b6e0 0x7fea84198ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:25:49.029 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:48.986+0000 7fea82ffd640 1 --2- 172.21.15.19:0/3510071170 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fea84105b80 0x7fea841994f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:25:49.029 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:48.986+0000 7fea83fff640 1 -- 172.21.15.19:0/3510071170 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fea8406b6e0 msgr2=0x7fea84198ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:25:49.030 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:48.986+0000 7fea83fff640 1 --2- 172.21.15.19:0/3510071170 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fea8406b6e0 0x7fea84198ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:25:49.030 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:48.986+0000 7fea83fff640 1 -- 172.21.15.19:0/3510071170 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fea84105b80 msgr2=0x7fea841994f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:25:49.030 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:48.986+0000 7fea83fff640 1 --2- 172.21.15.19:0/3510071170 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fea84105b80 0x7fea841994f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:25:49.030 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:48.986+0000 7fea83fff640 1 -- 172.21.15.19:0/3510071170 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fea8419a960 con 0x7fea84108730 2024-09-10T22:25:49.030 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:48.986+0000 7fea837fe640 1 --2- 172.21.15.19:0/3510071170 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fea8406b6e0 0x7fea84198ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T22:25:49.030 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:48.986+0000 7fea83fff640 1 --2- 172.21.15.19:0/3510071170 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fea84108730 0x7fea8419a0c0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7fea7c00c970 tx=0x7fea7c00ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:25:49.030 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:48.987+0000 7fea80ff9640 1 -- 172.21.15.19:0/3510071170 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea7c007bb0 con 0x7fea84108730 2024-09-10T22:25:49.030 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:48.987+0000 7fea8a03e640 1 -- 172.21.15.19:0/3510071170 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fea8419ac50 con 0x7fea84108730 2024-09-10T22:25:49.030 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:48.987+0000 7fea80ff9640 1 -- 172.21.15.19:0/3510071170 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fea7c007d50 con 0x7fea84108730 2024-09-10T22:25:49.030 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:48.987+0000 7fea80ff9640 1 -- 172.21.15.19:0/3510071170 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea7c004e60 con 0x7fea84108730 2024-09-10T22:25:49.030 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:48.987+0000 7fea8a03e640 1 -- 172.21.15.19:0/3510071170 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fea841a1330 con 0x7fea84108730 2024-09-10T22:25:49.030 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:48.988+0000 7fea8a03e640 1 -- 172.21.15.19:0/3510071170 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fea840fecd0 con 0x7fea84108730 2024-09-10T22:25:49.031 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:48.989+0000 7fea80ff9640 1 -- 172.21.15.19:0/3510071170 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 17) ==== 153301+0+0 (secure 0 0 0) 0x7fea7c005000 con 0x7fea84108730 2024-09-10T22:25:49.031 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:48.990+0000 7fea80ff9640 1 --2- 172.21.15.19:0/3510071170 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7fea6c0b5370 0x7fea6c0b7830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:25:49.031 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:48.990+0000 7fea837fe640 1 --2- 172.21.15.19:0/3510071170 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7fea6c0b5370 0x7fea6c0b7830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:25:49.031 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:48.990+0000 7fea80ff9640 1 -- 172.21.15.19:0/3510071170 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8269+0+0 (secure 0 0 0) 0x7fea7c0e5ec0 con 0x7fea84108730 2024-09-10T22:25:49.031 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:48.990+0000 7fea837fe640 1 --2- 172.21.15.19:0/3510071170 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7fea6c0b5370 0x7fea6c0b7830 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fea74031b50 tx=0x7fea74005ef0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:25:49.031 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:48.992+0000 7fea80ff9640 1 -- 172.21.15.19:0/3510071170 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7fea7c014030 con 0x7fea84108730 2024-09-10T22:25:49.187 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:49.186+0000 7fea8a03e640 1 -- 172.21.15.19:0/3510071170 --> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""]}) -- 0x7fea84063590 con 0x7fea6c0b5370 2024-09-10T22:25:49.187 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:25:48 smithi019 ceph-mon[31375]: from='client.15171 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T22:25:49.188 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:49.187+0000 7fea80ff9640 1 -- 172.21.15.19:0/3510071170 <== mgr.14150 v2:172.21.15.19:6800/2119495487 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+191 (secure 0 0 0) 0x7fea84063590 con 0x7fea6c0b5370 2024-09-10T22:25:49.189 INFO:teuthology.orchestra.run.smithi019.stdout:HOST ADDR LABELS STATUS 2024-09-10T22:25:49.189 INFO:teuthology.orchestra.run.smithi019.stdout:smithi019 172.21.15.19 2024-09-10T22:25:49.189 INFO:teuthology.orchestra.run.smithi019.stdout:smithi135 172.21.15.135 2024-09-10T22:25:49.189 INFO:teuthology.orchestra.run.smithi019.stdout:smithi138 172.21.15.138 2024-09-10T22:25:49.189 INFO:teuthology.orchestra.run.smithi019.stdout:3 hosts in cluster 2024-09-10T22:25:49.191 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:49.190+0000 7fea8a03e640 1 -- 172.21.15.19:0/3510071170 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7fea6c0b5370 msgr2=0x7fea6c0b7830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:25:49.191 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:49.190+0000 7fea8a03e640 1 --2- 172.21.15.19:0/3510071170 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7fea6c0b5370 0x7fea6c0b7830 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fea74031b50 tx=0x7fea74005ef0 comp rx=0 tx=0).stop 2024-09-10T22:25:49.191 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:49.190+0000 7fea8a03e640 1 -- 172.21.15.19:0/3510071170 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fea84108730 msgr2=0x7fea8419a0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:25:49.191 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:49.190+0000 7fea8a03e640 1 --2- 172.21.15.19:0/3510071170 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fea84108730 0x7fea8419a0c0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7fea7c00c970 tx=0x7fea7c00ce30 comp rx=0 tx=0).stop 2024-09-10T22:25:49.191 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:49.190+0000 7fea8a03e640 1 -- 172.21.15.19:0/3510071170 shutdown_connections 2024-09-10T22:25:49.191 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:49.190+0000 7fea8a03e640 1 --2- 172.21.15.19:0/3510071170 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7fea6c0b5370 0x7fea6c0b7830 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:25:49.192 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:49.190+0000 7fea8a03e640 1 --2- 172.21.15.19:0/3510071170 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fea84108730 0x7fea8419a0c0 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:25:49.192 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:49.190+0000 7fea8a03e640 1 --2- 172.21.15.19:0/3510071170 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fea84105b80 0x7fea841994f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:25:49.192 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:49.190+0000 7fea8a03e640 1 --2- 172.21.15.19:0/3510071170 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fea8406b6e0 0x7fea84198ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:25:49.192 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:49.190+0000 7fea8a03e640 1 -- 172.21.15.19:0/3510071170 >> 172.21.15.19:0/3510071170 conn(0x7fea840fd1e0 msgr2=0x7fea84103ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:25:49.192 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:49.190+0000 7fea8a03e640 1 -- 172.21.15.19:0/3510071170 shutdown_connections 2024-09-10T22:25:49.192 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:49.190+0000 7fea8a03e640 1 -- 172.21.15.19:0/3510071170 wait complete. 2024-09-10T22:25:49.276 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:25:48 smithi138 ceph-mon[35236]: from='client.15171 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T22:25:49.359 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:25:48 smithi135 ceph-mon[34789]: from='client.15171 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T22:25:49.795 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 22997a4c-6fc2-11ef-bcea-c7b262605968 -- bash -c 'ceph orch device ls' 2024-09-10T22:25:50.055 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/22997a4c-6fc2-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T22:25:50.176 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:25:49 smithi019 ceph-mon[31375]: pgmap v327: 97 pgs: 97 active+clean; 639 KiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-10T22:25:50.360 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:25:49 smithi135 ceph-mon[34789]: pgmap v327: 97 pgs: 97 active+clean; 639 KiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-10T22:25:50.375 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:25:49 smithi138 ceph-mon[35236]: pgmap v327: 97 pgs: 97 active+clean; 639 KiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-10T22:25:50.588 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:50.585+0000 7f5fd0791640 1 -- 172.21.15.19:0/156292088 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5fc8102a40 msgr2=0x7f5fc8102e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:25:50.588 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:50.585+0000 7f5fd0791640 1 --2- 172.21.15.19:0/156292088 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5fc8102a40 0x7f5fc8102e40 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f5fc4009930 tx=0x7f5fc402a420 comp rx=0 tx=0).stop 2024-09-10T22:25:50.589 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:50.585+0000 7f5fd0791640 1 -- 172.21.15.19:0/156292088 shutdown_connections 2024-09-10T22:25:50.589 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:50.585+0000 7f5fd0791640 1 --2- 172.21.15.19:0/156292088 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5fc8104560 0x7f5fc810aee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:25:50.589 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:50.585+0000 7f5fd0791640 1 --2- 172.21.15.19:0/156292088 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5fc8103ba0 0x7f5fc8104020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:25:50.589 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:50.585+0000 7f5fd0791640 1 --2- 172.21.15.19:0/156292088 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5fc8102a40 0x7f5fc8102e40 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:25:50.589 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:50.585+0000 7f5fd0791640 1 -- 172.21.15.19:0/156292088 >> 172.21.15.19:0/156292088 conn(0x7f5fc80fe2f0 msgr2=0x7f5fc8100750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:25:50.589 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:50.585+0000 7f5fd0791640 1 -- 172.21.15.19:0/156292088 shutdown_connections 2024-09-10T22:25:50.589 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:50.585+0000 7f5fd0791640 1 -- 172.21.15.19:0/156292088 wait complete. 2024-09-10T22:25:50.589 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:50.585+0000 7f5fd0791640 1 Processor -- start 2024-09-10T22:25:50.589 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:50.586+0000 7f5fd0791640 1 -- start start 2024-09-10T22:25:50.589 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:50.586+0000 7f5fd0791640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5fc8102a40 0x7f5fc819b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:25:50.589 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:50.586+0000 7f5fd0791640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5fc8103ba0 0x7f5fc819b720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:25:50.590 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:50.586+0000 7f5fd0791640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5fc8104560 0x7f5fc819c360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:25:50.590 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:50.586+0000 7f5fd0791640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f5fc810e7a0 con 0x7f5fc8104560 2024-09-10T22:25:50.590 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:50.586+0000 7f5fd0791640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f5fc810e620 con 0x7f5fc8103ba0 2024-09-10T22:25:50.590 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:50.586+0000 7f5fd0791640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f5fc810e920 con 0x7f5fc8102a40 2024-09-10T22:25:50.590 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:50.586+0000 7f5fced2e640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5fc8104560 0x7f5fc819c360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:25:50.590 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:50.586+0000 7f5fced2e640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5fc8104560 0x7f5fc819c360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:36218/0 (socket says 172.21.15.19:36218) 2024-09-10T22:25:50.590 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:50.586+0000 7f5fced2e640 1 -- 172.21.15.19:0/4147435127 learned_addr learned my addr 172.21.15.19:0/4147435127 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:25:50.590 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:50.586+0000 7f5fcdd2c640 1 --2- 172.21.15.19:0/4147435127 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5fc8103ba0 0x7f5fc819b720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:25:50.590 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:50.586+0000 7f5fce52d640 1 --2- 172.21.15.19:0/4147435127 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5fc8102a40 0x7f5fc819b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:25:50.590 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:50.586+0000 7f5fced2e640 1 -- 172.21.15.19:0/4147435127 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5fc8102a40 msgr2=0x7f5fc819b0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:25:50.591 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:50.586+0000 7f5fced2e640 1 --2- 172.21.15.19:0/4147435127 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5fc8102a40 0x7f5fc819b0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:25:50.591 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:50.586+0000 7f5fced2e640 1 -- 172.21.15.19:0/4147435127 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5fc8103ba0 msgr2=0x7f5fc819b720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:25:50.591 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:50.586+0000 7f5fced2e640 1 --2- 172.21.15.19:0/4147435127 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5fc8103ba0 0x7f5fc819b720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:25:50.591 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:50.586+0000 7f5fced2e640 1 -- 172.21.15.19:0/4147435127 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5fc819cc00 con 0x7f5fc8104560 2024-09-10T22:25:50.591 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:50.586+0000 7f5fced2e640 1 --2- 172.21.15.19:0/4147435127 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5fc8104560 0x7f5fc819c360 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f5fc000b970 tx=0x7f5fc000be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:25:50.591 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:50.587+0000 7f5fbf7fe640 1 -- 172.21.15.19:0/4147435127 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5fc0019070 con 0x7f5fc8104560 2024-09-10T22:25:50.591 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:50.587+0000 7f5fd0791640 1 -- 172.21.15.19:0/4147435127 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5fc819cef0 con 0x7f5fc8104560 2024-09-10T22:25:50.591 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:50.587+0000 7f5fbf7fe640 1 -- 172.21.15.19:0/4147435127 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5fc0014440 con 0x7f5fc8104560 2024-09-10T22:25:50.591 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:50.587+0000 7f5fbf7fe640 1 -- 172.21.15.19:0/4147435127 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5fc00075d0 con 0x7f5fc8104560 2024-09-10T22:25:50.591 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:50.587+0000 7f5fd0791640 1 -- 172.21.15.19:0/4147435127 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5fc81a35d0 con 0x7f5fc8104560 2024-09-10T22:25:50.592 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:50.588+0000 7f5fd0791640 1 -- 172.21.15.19:0/4147435127 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5fc81a3800 con 0x7f5fc8104560 2024-09-10T22:25:50.593 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:50.590+0000 7f5fbf7fe640 1 -- 172.21.15.19:0/4147435127 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 17) ==== 153301+0+0 (secure 0 0 0) 0x7f5fc000cb40 con 0x7f5fc8104560 2024-09-10T22:25:50.593 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:50.591+0000 7f5fbf7fe640 1 --2- 172.21.15.19:0/4147435127 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f5fb40b5370 0x7f5fb40b7830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:25:50.593 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:50.591+0000 7f5fce52d640 1 --2- 172.21.15.19:0/4147435127 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f5fb40b5370 0x7f5fb40b7830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:25:50.593 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:50.591+0000 7f5fbf7fe640 1 -- 172.21.15.19:0/4147435127 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8269+0+0 (secure 0 0 0) 0x7f5fc00e5ab0 con 0x7f5fc8104560 2024-09-10T22:25:50.593 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:50.591+0000 7f5fce52d640 1 --2- 172.21.15.19:0/4147435127 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f5fb40b5370 0x7f5fb40b7830 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f5fc4006010 tx=0x7f5fc4005e50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:25:50.595 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:50.594+0000 7f5fbf7fe640 1 -- 172.21.15.19:0/4147435127 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f5fc00ac790 con 0x7f5fc8104560 2024-09-10T22:25:50.789 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:50.788+0000 7f5fd0791640 1 -- 172.21.15.19:0/4147435127 --> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] -- mgr_command(tid 0: {"prefix": "orch device ls", "target": ["mon-mgr", ""]}) -- 0x7f5fc81099d0 con 0x7f5fb40b5370 2024-09-10T22:25:50.790 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:50.789+0000 7f5fbf7fe640 1 -- 172.21.15.19:0/4147435127 <== mgr.14150 v2:172.21.15.19:6800/2119495487 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+532 (secure 0 0 0) 0x7f5fc81099d0 con 0x7f5fb40b5370 2024-09-10T22:25:50.791 INFO:teuthology.orchestra.run.smithi019.stdout:HOST PATH TYPE DEVICE ID SIZE AVAILABLE REFRESHED REJECT REASONS 2024-09-10T22:25:50.791 INFO:teuthology.orchestra.run.smithi019.stdout:smithi019 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_CVFT5330002G400BGN 372G No 3m ago Has a FileSystem, LVM detected 2024-09-10T22:25:50.791 INFO:teuthology.orchestra.run.smithi019.stdout:smithi135 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_PHFT620401BA400BGN 372G No 2m ago Has a FileSystem, LVM detected 2024-09-10T22:25:50.791 INFO:teuthology.orchestra.run.smithi019.stdout:smithi138 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_CVFT6161003C400BGN 372G No 2m ago Has a FileSystem, LVM detected 2024-09-10T22:25:50.793 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:50.792+0000 7f5fd0791640 1 -- 172.21.15.19:0/4147435127 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f5fb40b5370 msgr2=0x7f5fb40b7830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:25:50.793 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:50.792+0000 7f5fd0791640 1 --2- 172.21.15.19:0/4147435127 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f5fb40b5370 0x7f5fb40b7830 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f5fc4006010 tx=0x7f5fc4005e50 comp rx=0 tx=0).stop 2024-09-10T22:25:50.793 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:50.792+0000 7f5fd0791640 1 -- 172.21.15.19:0/4147435127 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5fc8104560 msgr2=0x7f5fc819c360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:25:50.793 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:50.792+0000 7f5fd0791640 1 --2- 172.21.15.19:0/4147435127 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5fc8104560 0x7f5fc819c360 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f5fc000b970 tx=0x7f5fc000be30 comp rx=0 tx=0).stop 2024-09-10T22:25:50.794 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:50.792+0000 7f5fd0791640 1 -- 172.21.15.19:0/4147435127 shutdown_connections 2024-09-10T22:25:50.794 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:50.792+0000 7f5fd0791640 1 --2- 172.21.15.19:0/4147435127 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f5fb40b5370 0x7f5fb40b7830 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:25:50.794 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:50.792+0000 7f5fd0791640 1 --2- 172.21.15.19:0/4147435127 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5fc8104560 0x7f5fc819c360 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:25:50.794 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:50.792+0000 7f5fd0791640 1 --2- 172.21.15.19:0/4147435127 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5fc8103ba0 0x7f5fc819b720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:25:50.794 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:50.792+0000 7f5fd0791640 1 --2- 172.21.15.19:0/4147435127 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5fc8102a40 0x7f5fc819b0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:25:50.794 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:50.792+0000 7f5fd0791640 1 -- 172.21.15.19:0/4147435127 >> 172.21.15.19:0/4147435127 conn(0x7f5fc80fe2f0 msgr2=0x7f5fc81092c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:25:50.794 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:50.792+0000 7f5fd0791640 1 -- 172.21.15.19:0/4147435127 shutdown_connections 2024-09-10T22:25:50.794 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:50.792+0000 7f5fd0791640 1 -- 172.21.15.19:0/4147435127 wait complete. 2024-09-10T22:25:51.208 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:25:50 smithi019 ceph-mon[31375]: from='client.15177 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T22:25:51.261 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:25:50 smithi135 ceph-mon[34789]: from='client.15177 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T22:25:51.375 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:25:50 smithi138 ceph-mon[35236]: from='client.15177 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T22:25:51.486 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-09-10T22:25:51.495 INFO:tasks.cephadm:Running commands on role mon.a host ubuntu@smithi019.front.sepia.ceph.com 2024-09-10T22:25:51.495 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 22997a4c-6fc2-11ef-bcea-c7b262605968 -- bash -c 'ceph fs dump' 2024-09-10T22:25:51.756 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/22997a4c-6fc2-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T22:25:52.158 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:25:51 smithi019 ceph-mon[31375]: pgmap v328: 97 pgs: 97 active+clean; 639 KiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-09-10T22:25:52.158 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:25:51 smithi019 ceph-mon[31375]: from='client.15183 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T22:25:52.249 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:52.240+0000 7fa0c570d640 1 -- 172.21.15.19:0/1619746697 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa0c0108770 msgr2=0x7fa0c010ac30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:25:52.250 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:52.240+0000 7fa0c570d640 1 --2- 172.21.15.19:0/1619746697 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa0c0108770 0x7fa0c010ac30 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7fa0b8009900 tx=0x7fa0b802a410 comp rx=0 tx=0).stop 2024-09-10T22:25:52.250 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:52.240+0000 7fa0c570d640 1 -- 172.21.15.19:0/1619746697 shutdown_connections 2024-09-10T22:25:52.250 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:52.240+0000 7fa0c570d640 1 --2- 172.21.15.19:0/1619746697 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa0c0108770 0x7fa0c010ac30 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:25:52.250 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:52.240+0000 7fa0c570d640 1 --2- 172.21.15.19:0/1619746697 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa0c0105bc0 0x7fa0c0108030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:25:52.250 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:52.240+0000 7fa0c570d640 1 --2- 172.21.15.19:0/1619746697 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa0c006c0c0 0x7fa0c0105630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:25:52.250 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:52.240+0000 7fa0c570d640 1 -- 172.21.15.19:0/1619746697 >> 172.21.15.19:0/1619746697 conn(0x7fa0c00fd200 msgr2=0x7fa0c00ff660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:25:52.250 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:52.240+0000 7fa0c570d640 1 -- 172.21.15.19:0/1619746697 shutdown_connections 2024-09-10T22:25:52.250 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:52.240+0000 7fa0c570d640 1 -- 172.21.15.19:0/1619746697 wait complete. 2024-09-10T22:25:52.251 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:52.241+0000 7fa0c570d640 1 Processor -- start 2024-09-10T22:25:52.251 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:52.241+0000 7fa0c570d640 1 -- start start 2024-09-10T22:25:52.251 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:52.242+0000 7fa0c570d640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa0c006c0c0 0x7fa0c0198e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:25:52.251 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:52.242+0000 7fa0c570d640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa0c0105bc0 0x7fa0c01994a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:25:52.251 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:52.242+0000 7fa0c570d640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa0c0108770 0x7fa0c019a0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:25:52.251 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:52.242+0000 7fa0c570d640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fa0c010e7c0 con 0x7fa0c0105bc0 2024-09-10T22:25:52.251 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:52.242+0000 7fa0c570d640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fa0c010e640 con 0x7fa0c0108770 2024-09-10T22:25:52.251 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:52.242+0000 7fa0c570d640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7fa0c010e940 con 0x7fa0c006c0c0 2024-09-10T22:25:52.251 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:52.242+0000 7fa0be7fc640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa0c0105bc0 0x7fa0c01994a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:25:52.252 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:52.242+0000 7fa0be7fc640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa0c0105bc0 0x7fa0c01994a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:36232/0 (socket says 172.21.15.19:36232) 2024-09-10T22:25:52.252 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:52.242+0000 7fa0be7fc640 1 -- 172.21.15.19:0/3279091634 learned_addr learned my addr 172.21.15.19:0/3279091634 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:25:52.252 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:52.242+0000 7fa0beffd640 1 --2- 172.21.15.19:0/3279091634 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa0c006c0c0 0x7fa0c0198e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:25:52.252 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:52.242+0000 7fa0bf7fe640 1 --2- 172.21.15.19:0/3279091634 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa0c0108770 0x7fa0c019a0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:25:52.252 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:52.242+0000 7fa0be7fc640 1 -- 172.21.15.19:0/3279091634 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa0c006c0c0 msgr2=0x7fa0c0198e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:25:52.252 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:52.242+0000 7fa0be7fc640 1 --2- 172.21.15.19:0/3279091634 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa0c006c0c0 0x7fa0c0198e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:25:52.252 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:52.242+0000 7fa0be7fc640 1 -- 172.21.15.19:0/3279091634 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa0c0108770 msgr2=0x7fa0c019a0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:25:52.252 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:52.242+0000 7fa0be7fc640 1 --2- 172.21.15.19:0/3279091634 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa0c0108770 0x7fa0c019a0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:25:52.252 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:52.242+0000 7fa0be7fc640 1 -- 172.21.15.19:0/3279091634 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa0c019a980 con 0x7fa0c0105bc0 2024-09-10T22:25:52.252 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:52.242+0000 7fa0bf7fe640 1 --2- 172.21.15.19:0/3279091634 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa0c0108770 0x7fa0c019a0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T22:25:52.252 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:52.242+0000 7fa0be7fc640 1 --2- 172.21.15.19:0/3279091634 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa0c0105bc0 0x7fa0c01994a0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7fa0b400d740 tx=0x7fa0b400dc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:25:52.252 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:52.242+0000 7fa0a7fff640 1 -- 172.21.15.19:0/3279091634 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0b4017070 con 0x7fa0c0105bc0 2024-09-10T22:25:52.253 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:52.242+0000 7fa0a7fff640 1 -- 172.21.15.19:0/3279091634 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa0b400de50 con 0x7fa0c0105bc0 2024-09-10T22:25:52.253 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:52.242+0000 7fa0c570d640 1 -- 172.21.15.19:0/3279091634 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa0c019ac70 con 0x7fa0c0105bc0 2024-09-10T22:25:52.253 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:52.242+0000 7fa0a7fff640 1 -- 172.21.15.19:0/3279091634 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0b4004ce0 con 0x7fa0c0105bc0 2024-09-10T22:25:52.253 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:52.243+0000 7fa0c570d640 1 -- 172.21.15.19:0/3279091634 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa0c01a1350 con 0x7fa0c0105bc0 2024-09-10T22:25:52.253 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:52.243+0000 7fa0c570d640 1 -- 172.21.15.19:0/3279091634 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa0c0106020 con 0x7fa0c0105bc0 2024-09-10T22:25:52.253 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:52.245+0000 7fa0a7fff640 1 -- 172.21.15.19:0/3279091634 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 17) ==== 153301+0+0 (secure 0 0 0) 0x7fa0b4004e80 con 0x7fa0c0105bc0 2024-09-10T22:25:52.253 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:52.246+0000 7fa0a7fff640 1 --2- 172.21.15.19:0/3279091634 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7fa0a80b5370 0x7fa0a80b7830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:25:52.253 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:52.246+0000 7fa0beffd640 1 --2- 172.21.15.19:0/3279091634 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7fa0a80b5370 0x7fa0a80b7830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:25:52.253 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:52.246+0000 7fa0a7fff640 1 -- 172.21.15.19:0/3279091634 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8269+0+0 (secure 0 0 0) 0x7fa0b40e5b40 con 0x7fa0c0105bc0 2024-09-10T22:25:52.253 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:52.246+0000 7fa0beffd640 1 --2- 172.21.15.19:0/3279091634 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7fa0a80b5370 0x7fa0a80b7830 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fa0b000a400 tx=0x7fa0b000d040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:25:52.254 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:52.249+0000 7fa0a7fff640 1 -- 172.21.15.19:0/3279091634 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7fa0b40ac880 con 0x7fa0c0105bc0 2024-09-10T22:25:52.359 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:25:51 smithi135 ceph-mon[34789]: pgmap v328: 97 pgs: 97 active+clean; 639 KiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-09-10T22:25:52.360 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:25:51 smithi135 ceph-mon[34789]: from='client.15183 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T22:25:52.375 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:25:51 smithi138 ceph-mon[35236]: pgmap v328: 97 pgs: 97 active+clean; 639 KiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-09-10T22:25:52.375 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:25:51 smithi138 ceph-mon[35236]: from='client.15183 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T22:25:52.475 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:52.474+0000 7fa0c570d640 1 -- 172.21.15.19:0/3279091634 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs dump"} v 0) -- 0x7fa0c00fecf0 con 0x7fa0c0105bc0 2024-09-10T22:25:52.475 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:52.474+0000 7fa0a7fff640 1 -- 172.21.15.19:0/3279091634 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 24 v24) ==== 76+0+3093 (secure 0 0 0) 0x7fa0c00fecf0 con 0x7fa0c0105bc0 2024-09-10T22:25:52.476 INFO:teuthology.orchestra.run.smithi019.stdout:e24 2024-09-10T22:25:52.476 INFO:teuthology.orchestra.run.smithi019.stdout:btime 2024-09-10T22:24:34:220851+0000 2024-09-10T22:25:52.476 INFO:teuthology.orchestra.run.smithi019.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-10T22:25:52.476 INFO:teuthology.orchestra.run.smithi019.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-10T22:25:52.476 INFO:teuthology.orchestra.run.smithi019.stdout:legacy client fscid: 1 2024-09-10T22:25:52.476 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-10T22:25:52.476 INFO:teuthology.orchestra.run.smithi019.stdout:Filesystem 'cephfs' (1) 2024-09-10T22:25:52.476 INFO:teuthology.orchestra.run.smithi019.stdout:fs_name cephfs 2024-09-10T22:25:52.477 INFO:teuthology.orchestra.run.smithi019.stdout:epoch 24 2024-09-10T22:25:52.477 INFO:teuthology.orchestra.run.smithi019.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-09-10T22:25:52.477 INFO:teuthology.orchestra.run.smithi019.stdout:created 2024-09-10T22:24:22.733925+0000 2024-09-10T22:25:52.477 INFO:teuthology.orchestra.run.smithi019.stdout:modified 2024-09-10T22:24:33.797491+0000 2024-09-10T22:25:52.477 INFO:teuthology.orchestra.run.smithi019.stdout:tableserver 0 2024-09-10T22:25:52.477 INFO:teuthology.orchestra.run.smithi019.stdout:root 0 2024-09-10T22:25:52.477 INFO:teuthology.orchestra.run.smithi019.stdout:session_timeout 300 2024-09-10T22:25:52.477 INFO:teuthology.orchestra.run.smithi019.stdout:session_autoclose 300 2024-09-10T22:25:52.477 INFO:teuthology.orchestra.run.smithi019.stdout:max_file_size 1099511627776 2024-09-10T22:25:52.477 INFO:teuthology.orchestra.run.smithi019.stdout:max_xattr_size 65536 2024-09-10T22:25:52.477 INFO:teuthology.orchestra.run.smithi019.stdout:required_client_features {} 2024-09-10T22:25:52.477 INFO:teuthology.orchestra.run.smithi019.stdout:last_failure 0 2024-09-10T22:25:52.478 INFO:teuthology.orchestra.run.smithi019.stdout:last_failure_osd_epoch 0 2024-09-10T22:25:52.478 INFO:teuthology.orchestra.run.smithi019.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-10T22:25:52.478 INFO:teuthology.orchestra.run.smithi019.stdout:max_mds 3 2024-09-10T22:25:52.478 INFO:teuthology.orchestra.run.smithi019.stdout:in 0,1,2 2024-09-10T22:25:52.478 INFO:teuthology.orchestra.run.smithi019.stdout:up {0=24581,1=24568,2=24553} 2024-09-10T22:25:52.478 INFO:teuthology.orchestra.run.smithi019.stdout:failed 2024-09-10T22:25:52.478 INFO:teuthology.orchestra.run.smithi019.stdout:damaged 2024-09-10T22:25:52.478 INFO:teuthology.orchestra.run.smithi019.stdout:stopped 2024-09-10T22:25:52.478 INFO:teuthology.orchestra.run.smithi019.stdout:data_pools [3] 2024-09-10T22:25:52.478 INFO:teuthology.orchestra.run.smithi019.stdout:metadata_pool 2 2024-09-10T22:25:52.478 INFO:teuthology.orchestra.run.smithi019.stdout:inline_data disabled 2024-09-10T22:25:52.478 INFO:teuthology.orchestra.run.smithi019.stdout:balancer 2024-09-10T22:25:52.478 INFO:teuthology.orchestra.run.smithi019.stdout:bal_rank_mask -1 2024-09-10T22:25:52.479 INFO:teuthology.orchestra.run.smithi019.stdout:standby_count_wanted 0 2024-09-10T22:25:52.479 INFO:teuthology.orchestra.run.smithi019.stdout:qdb_cluster leader: 24581 members: 24553,24568,24581 2024-09-10T22:25:52.479 INFO:teuthology.orchestra.run.smithi019.stdout:[mds.b{0:24581} state up:active seq 4 addr [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] compat {c=[1],r=[1],i=[1fff]}] 2024-09-10T22:25:52.479 INFO:teuthology.orchestra.run.smithi019.stdout:[mds.h{0:24551} state up:standby-replay seq 1 addr [v2:172.21.15.135:6836/3495029135,v1:172.21.15.135:6837/3495029135] compat {c=[1],r=[1],i=[1fff]}] 2024-09-10T22:25:52.479 INFO:teuthology.orchestra.run.smithi019.stdout:[mds.i{1:24568} state up:active seq 8 addr [v2:172.21.15.138:6838/383637208,v1:172.21.15.138:6839/383637208] compat {c=[1],r=[1],i=[1fff]}] 2024-09-10T22:25:52.479 INFO:teuthology.orchestra.run.smithi019.stdout:[mds.f{1:24541} state up:standby-replay seq 1 addr [v2:172.21.15.138:6834/933547028,v1:172.21.15.138:6835/933547028] compat {c=[1],r=[1],i=[1fff]}] 2024-09-10T22:25:52.479 INFO:teuthology.orchestra.run.smithi019.stdout:[mds.c{2:24553} state up:active seq 10 addr [v2:172.21.15.138:6836/3353290042,v1:172.21.15.138:6837/3353290042] compat {c=[1],r=[1],i=[1fff]}] 2024-09-10T22:25:52.479 INFO:teuthology.orchestra.run.smithi019.stdout:[mds.e{2:24527} state up:standby-replay seq 1 addr [v2:172.21.15.135:6834/3715773348,v1:172.21.15.135:6835/3715773348] compat {c=[1],r=[1],i=[1fff]}] 2024-09-10T22:25:52.479 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-10T22:25:52.479 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-10T22:25:52.479 INFO:teuthology.orchestra.run.smithi019.stdout:Standby daemons: 2024-09-10T22:25:52.479 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-10T22:25:52.479 INFO:teuthology.orchestra.run.smithi019.stdout:[mds.j{-1:14673} state up:standby seq 1 addr [v2:172.21.15.19:6834/1835804747,v1:172.21.15.19:6835/1835804747] compat {c=[1],r=[1],i=[1fff]}] 2024-09-10T22:25:52.480 INFO:teuthology.orchestra.run.smithi019.stdout:[mds.d{-1:14685} state up:standby seq 1 addr [v2:172.21.15.19:6836/1750470490,v1:172.21.15.19:6837/1750470490] compat {c=[1],r=[1],i=[1fff]}] 2024-09-10T22:25:52.480 INFO:teuthology.orchestra.run.smithi019.stdout:[mds.g{-1:14733} state up:standby seq 1 addr [v2:172.21.15.19:6838/2642941149,v1:172.21.15.19:6839/2642941149] compat {c=[1],r=[1],i=[1fff]}] 2024-09-10T22:25:52.480 INFO:teuthology.orchestra.run.smithi019.stdout:[mds.a{-1:14745} state up:standby seq 1 addr [v2:172.21.15.19:6840/2449948682,v1:172.21.15.19:6841/2449948682] compat {c=[1],r=[1],i=[1fff]}] 2024-09-10T22:25:52.480 INFO:teuthology.orchestra.run.smithi019.stdout:[mds.l{-1:24511} state up:standby seq 1 addr [v2:172.21.15.138:6832/2524811494,v1:172.21.15.138:6833/2524811494] compat {c=[1],r=[1],i=[1fff]}] 2024-09-10T22:25:52.480 INFO:teuthology.orchestra.run.smithi019.stdout:[mds.k{-1:24512} state up:standby seq 1 addr [v2:172.21.15.135:6832/3014993624,v1:172.21.15.135:6833/3014993624] compat {c=[1],r=[1],i=[1fff]}] 2024-09-10T22:25:52.481 INFO:teuthology.orchestra.run.smithi019.stderr:dumped fsmap epoch 24 2024-09-10T22:25:52.481 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:52.477+0000 7fa0c570d640 1 -- 172.21.15.19:0/3279091634 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7fa0a80b5370 msgr2=0x7fa0a80b7830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:25:52.481 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:52.477+0000 7fa0c570d640 1 --2- 172.21.15.19:0/3279091634 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7fa0a80b5370 0x7fa0a80b7830 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fa0b000a400 tx=0x7fa0b000d040 comp rx=0 tx=0).stop 2024-09-10T22:25:52.481 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:52.477+0000 7fa0c570d640 1 -- 172.21.15.19:0/3279091634 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa0c0105bc0 msgr2=0x7fa0c01994a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:25:52.481 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:52.477+0000 7fa0c570d640 1 --2- 172.21.15.19:0/3279091634 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa0c0105bc0 0x7fa0c01994a0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7fa0b400d740 tx=0x7fa0b400dc00 comp rx=0 tx=0).stop 2024-09-10T22:25:52.481 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:52.477+0000 7fa0c570d640 1 -- 172.21.15.19:0/3279091634 shutdown_connections 2024-09-10T22:25:52.481 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:52.477+0000 7fa0c570d640 1 --2- 172.21.15.19:0/3279091634 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7fa0a80b5370 0x7fa0a80b7830 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:25:52.481 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:52.477+0000 7fa0c570d640 1 --2- 172.21.15.19:0/3279091634 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa0c0108770 0x7fa0c019a0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:25:52.481 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:52.477+0000 7fa0c570d640 1 --2- 172.21.15.19:0/3279091634 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa0c0105bc0 0x7fa0c01994a0 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:25:52.481 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:52.477+0000 7fa0c570d640 1 --2- 172.21.15.19:0/3279091634 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa0c006c0c0 0x7fa0c0198e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:25:52.482 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:52.477+0000 7fa0c570d640 1 -- 172.21.15.19:0/3279091634 >> 172.21.15.19:0/3279091634 conn(0x7fa0c00fd200 msgr2=0x7fa0c0103ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:25:52.482 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:52.477+0000 7fa0c570d640 1 -- 172.21.15.19:0/3279091634 shutdown_connections 2024-09-10T22:25:52.482 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:52.477+0000 7fa0c570d640 1 -- 172.21.15.19:0/3279091634 wait complete. 2024-09-10T22:25:53.137 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:25:52 smithi019 ceph-mon[31375]: from='client.? 172.21.15.19:0/3279091634' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-10T22:25:53.167 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 22997a4c-6fc2-11ef-bcea-c7b262605968 -- bash -c 'ceph osd dump' 2024-09-10T22:25:53.359 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:25:52 smithi135 ceph-mon[34789]: from='client.? 172.21.15.19:0/3279091634' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-10T22:25:53.375 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:25:52 smithi138 ceph-mon[35236]: from='client.? 172.21.15.19:0/3279091634' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-10T22:25:53.425 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/22997a4c-6fc2-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T22:25:53.907 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:53.896+0000 7f020352e640 1 -- 172.21.15.19:0/3316459622 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f01fc104560 msgr2=0x7f01fc10aee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:25:53.907 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:53.896+0000 7f020352e640 1 --2- 172.21.15.19:0/3316459622 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f01fc104560 0x7f01fc10aee0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f01f4009cd0 tx=0x7f01f402a8e0 comp rx=0 tx=0).stop 2024-09-10T22:25:53.907 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:53.896+0000 7f020352e640 1 -- 172.21.15.19:0/3316459622 shutdown_connections 2024-09-10T22:25:53.907 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:53.896+0000 7f020352e640 1 --2- 172.21.15.19:0/3316459622 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f01fc104560 0x7f01fc10aee0 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:25:53.907 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:53.896+0000 7f020352e640 1 --2- 172.21.15.19:0/3316459622 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f01fc103ba0 0x7f01fc104020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:25:53.907 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:53.896+0000 7f020352e640 1 --2- 172.21.15.19:0/3316459622 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f01fc102a40 0x7f01fc102e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:25:53.907 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:53.896+0000 7f020352e640 1 -- 172.21.15.19:0/3316459622 >> 172.21.15.19:0/3316459622 conn(0x7f01fc0fe2f0 msgr2=0x7f01fc100750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:25:53.907 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:53.896+0000 7f020352e640 1 -- 172.21.15.19:0/3316459622 shutdown_connections 2024-09-10T22:25:53.907 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:53.896+0000 7f020352e640 1 -- 172.21.15.19:0/3316459622 wait complete. 2024-09-10T22:25:53.907 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:53.897+0000 7f020352e640 1 Processor -- start 2024-09-10T22:25:53.908 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:53.897+0000 7f020352e640 1 -- start start 2024-09-10T22:25:53.908 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:53.897+0000 7f020352e640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f01fc102a40 0x7f01fc198ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:25:53.908 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:53.897+0000 7f020352e640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f01fc103ba0 0x7f01fc199530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:25:53.908 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:53.897+0000 7f020352e640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f01fc104560 0x7f01fc19a170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:25:53.908 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:53.897+0000 7f020352e640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f01fc10e7f0 con 0x7f01fc103ba0 2024-09-10T22:25:53.908 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:53.897+0000 7f020352e640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f01fc10e670 con 0x7f01fc104560 2024-09-10T22:25:53.908 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:53.897+0000 7f020352e640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f01fc10e970 con 0x7f01fc102a40 2024-09-10T22:25:53.908 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:53.897+0000 7f0200ac9640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f01fc103ba0 0x7f01fc199530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:25:53.908 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:53.897+0000 7f0200ac9640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f01fc103ba0 0x7f01fc199530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:37454/0 (socket says 172.21.15.19:37454) 2024-09-10T22:25:53.908 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:53.897+0000 7f0200ac9640 1 -- 172.21.15.19:0/3638902831 learned_addr learned my addr 172.21.15.19:0/3638902831 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:25:53.908 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:53.898+0000 7f0201acb640 1 --2- 172.21.15.19:0/3638902831 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f01fc104560 0x7f01fc19a170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:25:53.909 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:53.898+0000 7f02012ca640 1 --2- 172.21.15.19:0/3638902831 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f01fc102a40 0x7f01fc198ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:25:53.909 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:53.898+0000 7f0200ac9640 1 -- 172.21.15.19:0/3638902831 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f01fc102a40 msgr2=0x7f01fc198ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:25:53.909 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:53.898+0000 7f0200ac9640 1 --2- 172.21.15.19:0/3638902831 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f01fc102a40 0x7f01fc198ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:25:53.909 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:53.898+0000 7f0200ac9640 1 -- 172.21.15.19:0/3638902831 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f01fc104560 msgr2=0x7f01fc19a170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:25:53.909 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:53.898+0000 7f0200ac9640 1 --2- 172.21.15.19:0/3638902831 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f01fc104560 0x7f01fc19a170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:25:53.909 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:53.898+0000 7f0200ac9640 1 -- 172.21.15.19:0/3638902831 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f01fc19aa10 con 0x7f01fc103ba0 2024-09-10T22:25:53.909 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:53.898+0000 7f0201acb640 1 --2- 172.21.15.19:0/3638902831 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f01fc104560 0x7f01fc19a170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T22:25:53.909 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:53.898+0000 7f0200ac9640 1 --2- 172.21.15.19:0/3638902831 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f01fc103ba0 0x7f01fc199530 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f01f000b4a0 tx=0x7f01f000b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:25:53.909 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:53.898+0000 7f01fa7fc640 1 -- 172.21.15.19:0/3638902831 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01f0014070 con 0x7f01fc103ba0 2024-09-10T22:25:53.909 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:53.898+0000 7f01fa7fc640 1 -- 172.21.15.19:0/3638902831 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f01f0010ac0 con 0x7f01fc103ba0 2024-09-10T22:25:53.909 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:53.898+0000 7f020352e640 1 -- 172.21.15.19:0/3638902831 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f01fc19ad00 con 0x7f01fc103ba0 2024-09-10T22:25:53.909 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:53.898+0000 7f01fa7fc640 1 -- 172.21.15.19:0/3638902831 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01f0017c30 con 0x7f01fc103ba0 2024-09-10T22:25:53.910 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:53.898+0000 7f020352e640 1 -- 172.21.15.19:0/3638902831 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f01fc1a13e0 con 0x7f01fc103ba0 2024-09-10T22:25:53.910 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:53.899+0000 7f020352e640 1 -- 172.21.15.19:0/3638902831 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f01fc1a1610 con 0x7f01fc103ba0 2024-09-10T22:25:53.910 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:53.901+0000 7f01fa7fc640 1 -- 172.21.15.19:0/3638902831 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 17) ==== 153301+0+0 (secure 0 0 0) 0x7f01f0010610 con 0x7f01fc103ba0 2024-09-10T22:25:53.910 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:53.902+0000 7f01fa7fc640 1 --2- 172.21.15.19:0/3638902831 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f01e40b5370 0x7f01e40b7830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:25:53.910 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:53.902+0000 7f02012ca640 1 --2- 172.21.15.19:0/3638902831 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f01e40b5370 0x7f01e40b7830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:25:53.910 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:53.902+0000 7f01fa7fc640 1 -- 172.21.15.19:0/3638902831 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8269+0+0 (secure 0 0 0) 0x7f01f00e5760 con 0x7f01fc103ba0 2024-09-10T22:25:53.910 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:53.902+0000 7f02012ca640 1 --2- 172.21.15.19:0/3638902831 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f01e40b5370 0x7f01e40b7830 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f01ec009890 tx=0x7f01ec008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:25:53.910 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:53.905+0000 7f01fa7fc640 1 -- 172.21.15.19:0/3638902831 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f01f00ac440 con 0x7f01fc103ba0 2024-09-10T22:25:54.100 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:54.099+0000 7f020352e640 1 -- 172.21.15.19:0/3638902831 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd dump"} v 0) -- 0x7f01fc1a17e0 con 0x7f01fc103ba0 2024-09-10T22:25:54.101 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:25:53 smithi019 ceph-mon[31375]: pgmap v329: 97 pgs: 97 active+clean; 639 KiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-10T22:25:54.101 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:54.100+0000 7f01fa7fc640 1 -- 172.21.15.19:0/3638902831 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump"}]=0 v75) ==== 56+0+5334 (secure 0 0 0) 0x7f01f00abd40 con 0x7f01fc103ba0 2024-09-10T22:25:54.102 INFO:teuthology.orchestra.run.smithi019.stdout:epoch 75 2024-09-10T22:25:54.102 INFO:teuthology.orchestra.run.smithi019.stdout:fsid 22997a4c-6fc2-11ef-bcea-c7b262605968 2024-09-10T22:25:54.102 INFO:teuthology.orchestra.run.smithi019.stdout:created 2024-09-10T22:16:16.754696+0000 2024-09-10T22:25:54.102 INFO:teuthology.orchestra.run.smithi019.stdout:modified 2024-09-10T22:25:05.513986+0000 2024-09-10T22:25:54.102 INFO:teuthology.orchestra.run.smithi019.stdout:flags sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit 2024-09-10T22:25:54.102 INFO:teuthology.orchestra.run.smithi019.stdout:crush_version 26 2024-09-10T22:25:54.102 INFO:teuthology.orchestra.run.smithi019.stdout:full_ratio 0.95 2024-09-10T22:25:54.102 INFO:teuthology.orchestra.run.smithi019.stdout:backfillfull_ratio 0.9 2024-09-10T22:25:54.103 INFO:teuthology.orchestra.run.smithi019.stdout:nearfull_ratio 0.85 2024-09-10T22:25:54.103 INFO:teuthology.orchestra.run.smithi019.stdout:require_min_compat_client luminous 2024-09-10T22:25:54.103 INFO:teuthology.orchestra.run.smithi019.stdout:min_compat_client luminous 2024-09-10T22:25:54.103 INFO:teuthology.orchestra.run.smithi019.stdout:require_osd_release squid 2024-09-10T22:25:54.103 INFO:teuthology.orchestra.run.smithi019.stdout:stretch_mode_enabled false 2024-09-10T22:25:54.103 INFO:teuthology.orchestra.run.smithi019.stdout:pool 1 '.mgr' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 1 pgp_num 1 autoscale_mode off last_change 20 flags hashpspool stripe_width 0 pg_num_max 32 pg_num_min 1 application mgr read_balance_score 12.00 2024-09-10T22:25:54.103 INFO:teuthology.orchestra.run.smithi019.stdout:pool 2 'cephfs_metadata' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 32 pgp_num 32 autoscale_mode off last_change 73 flags hashpspool stripe_width 0 pg_autoscale_bias 4 pg_num_min 16 recovery_priority 5 application cephfs read_balance_score 2.25 2024-09-10T22:25:54.103 INFO:teuthology.orchestra.run.smithi019.stdout:pool 3 'cephfs_data' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 64 pgp_num 64 autoscale_mode off last_change 73 flags hashpspool stripe_width 0 pg_num_min 64 target_size_ratio 0.9 application cephfs read_balance_score 1.50 2024-09-10T22:25:54.103 INFO:teuthology.orchestra.run.smithi019.stdout:max_osd 12 2024-09-10T22:25:54.103 INFO:teuthology.orchestra.run.smithi019.stdout:osd.0 up in weight 1 up_from 8 up_thru 71 down_at 0 last_clean_interval [0,0) [v2:172.21.15.19:6802/234761879,v1:172.21.15.19:6803/234761879] [v2:172.21.15.19:6804/234761879,v1:172.21.15.19:6805/234761879] exists,up 783d96cb-0a8a-47f3-8eab-77cd731a64bd 2024-09-10T22:25:54.104 INFO:teuthology.orchestra.run.smithi019.stdout:osd.1 up in weight 1 up_from 12 up_thru 71 down_at 0 last_clean_interval [0,0) [v2:172.21.15.135:6800/1803526886,v1:172.21.15.135:6801/1803526886] [v2:172.21.15.135:6802/1803526886,v1:172.21.15.135:6803/1803526886] exists,up 41043581-e0cf-43b5-bae0-0d95e2ef8156 2024-09-10T22:25:54.104 INFO:teuthology.orchestra.run.smithi019.stdout:osd.2 up in weight 1 up_from 17 up_thru 74 down_at 0 last_clean_interval [0,0) [v2:172.21.15.138:6800/2747418770,v1:172.21.15.138:6801/2747418770] [v2:172.21.15.138:6802/2747418770,v1:172.21.15.138:6803/2747418770] exists,up a9b14a06-bbdc-4501-96e2-fb5f7127ca16 2024-09-10T22:25:54.104 INFO:teuthology.orchestra.run.smithi019.stdout:osd.3 up in weight 1 up_from 23 up_thru 71 down_at 0 last_clean_interval [0,0) [v2:172.21.15.19:6810/1889857224,v1:172.21.15.19:6811/1889857224] [v2:172.21.15.19:6812/1889857224,v1:172.21.15.19:6813/1889857224] exists,up a46268da-8666-4cfa-b11a-30eb12e271be 2024-09-10T22:25:54.104 INFO:teuthology.orchestra.run.smithi019.stdout:osd.4 up in weight 1 up_from 29 up_thru 71 down_at 0 last_clean_interval [0,0) [v2:172.21.15.135:6808/436311825,v1:172.21.15.135:6809/436311825] [v2:172.21.15.135:6810/436311825,v1:172.21.15.135:6811/436311825] exists,up c58df06f-2de2-4655-88e7-ac6a3531839a 2024-09-10T22:25:54.104 INFO:teuthology.orchestra.run.smithi019.stdout:osd.5 up in weight 1 up_from 34 up_thru 74 down_at 0 last_clean_interval [0,0) [v2:172.21.15.138:6808/1086764290,v1:172.21.15.138:6809/1086764290] [v2:172.21.15.138:6810/1086764290,v1:172.21.15.138:6811/1086764290] exists,up c0900b0c-aef4-498d-a01b-a891bdb51122 2024-09-10T22:25:54.104 INFO:teuthology.orchestra.run.smithi019.stdout:osd.6 up in weight 1 up_from 40 up_thru 71 down_at 0 last_clean_interval [0,0) [v2:172.21.15.19:6818/406328354,v1:172.21.15.19:6819/406328354] [v2:172.21.15.19:6820/406328354,v1:172.21.15.19:6821/406328354] exists,up f79cb310-8073-4ee5-80a6-87a290600321 2024-09-10T22:25:54.104 INFO:teuthology.orchestra.run.smithi019.stdout:osd.7 up in weight 1 up_from 46 up_thru 74 down_at 0 last_clean_interval [0,0) [v2:172.21.15.135:6816/1096613674,v1:172.21.15.135:6817/1096613674] [v2:172.21.15.135:6818/1096613674,v1:172.21.15.135:6819/1096613674] exists,up cc76476a-92f3-489c-be9e-29cbbf39539e 2024-09-10T22:25:54.104 INFO:teuthology.orchestra.run.smithi019.stdout:osd.8 up in weight 1 up_from 51 up_thru 74 down_at 0 last_clean_interval [0,0) [v2:172.21.15.138:6816/3020394729,v1:172.21.15.138:6817/3020394729] [v2:172.21.15.138:6818/3020394729,v1:172.21.15.138:6819/3020394729] exists,up 5323a006-a6e8-4403-9c51-65f46298d5c4 2024-09-10T22:25:54.104 INFO:teuthology.orchestra.run.smithi019.stdout:osd.9 up in weight 1 up_from 57 up_thru 74 down_at 0 last_clean_interval [0,0) [v2:172.21.15.19:6826/1488680899,v1:172.21.15.19:6827/1488680899] [v2:172.21.15.19:6828/1488680899,v1:172.21.15.19:6829/1488680899] exists,up b869ac42-c46e-442c-8b5b-f81c018e663c 2024-09-10T22:25:54.104 INFO:teuthology.orchestra.run.smithi019.stdout:osd.10 up in weight 1 up_from 62 up_thru 74 down_at 0 last_clean_interval [0,0) [v2:172.21.15.135:6824/3812626754,v1:172.21.15.135:6825/3812626754] [v2:172.21.15.135:6826/3812626754,v1:172.21.15.135:6827/3812626754] exists,up b8a2d69a-6821-4c69-b7eb-c0cfc8164614 2024-09-10T22:25:54.104 INFO:teuthology.orchestra.run.smithi019.stdout:osd.11 up in weight 1 up_from 67 up_thru 71 down_at 0 last_clean_interval [0,0) [v2:172.21.15.138:6824/1098434807,v1:172.21.15.138:6825/1098434807] [v2:172.21.15.138:6826/1098434807,v1:172.21.15.138:6827/1098434807] exists,up a9264ab2-5843-44d2-aba8-1e12708e99d6 2024-09-10T22:25:54.105 INFO:teuthology.orchestra.run.smithi019.stdout:pg_upmap_items 2.0 [8,4] 2024-09-10T22:25:54.105 INFO:teuthology.orchestra.run.smithi019.stdout:pg_upmap_items 2.16 [2,6] 2024-09-10T22:25:54.105 INFO:teuthology.orchestra.run.smithi019.stdout:pg_upmap_items 2.17 [5,1] 2024-09-10T22:25:54.105 INFO:teuthology.orchestra.run.smithi019.stdout:pg_upmap_items 2.1a [8,1] 2024-09-10T22:25:54.105 INFO:teuthology.orchestra.run.smithi019.stdout:pg_upmap_items 2.1d [2,4] 2024-09-10T22:25:54.105 INFO:teuthology.orchestra.run.smithi019.stdout:pg_upmap_items 2.1f [7,11] 2024-09-10T22:25:54.105 INFO:teuthology.orchestra.run.smithi019.stdout:pg_upmap_items 3.13 [4,9] 2024-09-10T22:25:54.105 INFO:teuthology.orchestra.run.smithi019.stdout:pg_upmap_items 3.1b [4,8] 2024-09-10T22:25:54.106 INFO:teuthology.orchestra.run.smithi019.stdout:pg_upmap_items 3.21 [5,9] 2024-09-10T22:25:54.106 INFO:teuthology.orchestra.run.smithi019.stdout:pg_upmap_items 3.38 [3,9] 2024-09-10T22:25:54.106 INFO:teuthology.orchestra.run.smithi019.stdout:blocklist 172.21.15.19:0/2099468127 expires 2024-09-11T22:17:04.260826+0000 2024-09-10T22:25:54.106 INFO:teuthology.orchestra.run.smithi019.stdout:blocklist 172.21.15.19:0/538724915 expires 2024-09-11T22:17:04.260826+0000 2024-09-10T22:25:54.106 INFO:teuthology.orchestra.run.smithi019.stdout:blocklist 172.21.15.19:0/3504695777 expires 2024-09-11T22:17:04.260826+0000 2024-09-10T22:25:54.106 INFO:teuthology.orchestra.run.smithi019.stdout:blocklist 172.21.15.19:0/1401613792 expires 2024-09-11T22:16:39.069638+0000 2024-09-10T22:25:54.106 INFO:teuthology.orchestra.run.smithi019.stdout:blocklist 172.21.15.19:6801/3005924425 expires 2024-09-11T22:17:04.260826+0000 2024-09-10T22:25:54.106 INFO:teuthology.orchestra.run.smithi019.stdout:blocklist 172.21.15.19:6800/3005924425 expires 2024-09-11T22:17:04.260826+0000 2024-09-10T22:25:54.107 INFO:teuthology.orchestra.run.smithi019.stdout:blocklist 172.21.15.19:0/104917892 expires 2024-09-11T22:16:39.069638+0000 2024-09-10T22:25:54.107 INFO:teuthology.orchestra.run.smithi019.stdout:blocklist 172.21.15.19:0/1778305990 expires 2024-09-11T22:16:39.069638+0000 2024-09-10T22:25:54.107 INFO:teuthology.orchestra.run.smithi019.stdout:blocklist 172.21.15.19:6801/535670059 expires 2024-09-11T22:16:39.069638+0000 2024-09-10T22:25:54.107 INFO:teuthology.orchestra.run.smithi019.stdout:blocklist 172.21.15.19:6800/535670059 expires 2024-09-11T22:16:39.069638+0000 2024-09-10T22:25:54.108 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:54.102+0000 7f020352e640 1 -- 172.21.15.19:0/3638902831 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f01e40b5370 msgr2=0x7f01e40b7830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:25:54.108 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:54.102+0000 7f020352e640 1 --2- 172.21.15.19:0/3638902831 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f01e40b5370 0x7f01e40b7830 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f01ec009890 tx=0x7f01ec008040 comp rx=0 tx=0).stop 2024-09-10T22:25:54.108 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:54.102+0000 7f020352e640 1 -- 172.21.15.19:0/3638902831 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f01fc103ba0 msgr2=0x7f01fc199530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:25:54.108 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:54.102+0000 7f020352e640 1 --2- 172.21.15.19:0/3638902831 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f01fc103ba0 0x7f01fc199530 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f01f000b4a0 tx=0x7f01f000b960 comp rx=0 tx=0).stop 2024-09-10T22:25:54.108 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:54.102+0000 7f020352e640 1 -- 172.21.15.19:0/3638902831 shutdown_connections 2024-09-10T22:25:54.108 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:54.102+0000 7f020352e640 1 --2- 172.21.15.19:0/3638902831 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f01e40b5370 0x7f01e40b7830 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:25:54.108 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:54.102+0000 7f020352e640 1 --2- 172.21.15.19:0/3638902831 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f01fc104560 0x7f01fc19a170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:25:54.109 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:54.102+0000 7f020352e640 1 --2- 172.21.15.19:0/3638902831 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f01fc103ba0 0x7f01fc199530 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:25:54.109 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:54.102+0000 7f020352e640 1 --2- 172.21.15.19:0/3638902831 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f01fc102a40 0x7f01fc198ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:25:54.109 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:54.103+0000 7f020352e640 1 -- 172.21.15.19:0/3638902831 >> 172.21.15.19:0/3638902831 conn(0x7f01fc0fe2f0 msgr2=0x7f01fc104eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:25:54.109 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:54.103+0000 7f020352e640 1 -- 172.21.15.19:0/3638902831 shutdown_connections 2024-09-10T22:25:54.109 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:54.103+0000 7f020352e640 1 -- 172.21.15.19:0/3638902831 wait complete. 2024-09-10T22:25:54.359 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:25:53 smithi135 ceph-mon[34789]: pgmap v329: 97 pgs: 97 active+clean; 639 KiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-10T22:25:54.375 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:25:53 smithi138 ceph-mon[35236]: pgmap v329: 97 pgs: 97 active+clean; 639 KiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-10T22:25:54.799 INFO:teuthology.run_tasks:Running task fs.ready... 2024-09-10T22:25:54.812 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 22997a4c-6fc2-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-10T22:25:55.072 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/22997a4c-6fc2-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T22:25:55.193 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:25:54 smithi019 ceph-mon[31375]: from='client.? 172.21.15.19:0/3638902831' entity='client.admin' cmd={"prefix": "osd dump"} : dispatch 2024-09-10T22:25:55.359 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:25:54 smithi135 ceph-mon[34789]: from='client.? 172.21.15.19:0/3638902831' entity='client.admin' cmd={"prefix": "osd dump"} : dispatch 2024-09-10T22:25:55.375 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:25:54 smithi138 ceph-mon[35236]: from='client.? 172.21.15.19:0/3638902831' entity='client.admin' cmd={"prefix": "osd dump"} : dispatch 2024-09-10T22:25:55.639 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:55.605+0000 7fc0d1605640 1 -- 172.21.15.19:0/3318407438 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc0cc102920 msgr2=0x7fc0cc102d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:25:55.639 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:55.605+0000 7fc0d1605640 1 --2- 172.21.15.19:0/3318407438 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc0cc102920 0x7fc0cc102d00 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7fc0bc009900 tx=0x7fc0bc02a410 comp rx=0 tx=0).stop 2024-09-10T22:25:55.639 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:55.605+0000 7fc0d1605640 1 -- 172.21.15.19:0/3318407438 shutdown_connections 2024-09-10T22:25:55.639 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:55.605+0000 7fc0d1605640 1 --2- 172.21.15.19:0/3318407438 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc0cc108120 0x7fc0cc10e870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:25:55.639 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:55.605+0000 7fc0d1605640 1 --2- 172.21.15.19:0/3318407438 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc0cc107780 0x7fc0cc107be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:25:55.639 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:55.605+0000 7fc0d1605640 1 --2- 172.21.15.19:0/3318407438 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc0cc102920 0x7fc0cc102d00 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:25:55.639 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:55.605+0000 7fc0d1605640 1 -- 172.21.15.19:0/3318407438 >> 172.21.15.19:0/3318407438 conn(0x7fc0cc076f50 msgr2=0x7fc0cc077360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:25:55.639 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:55.605+0000 7fc0d1605640 1 -- 172.21.15.19:0/3318407438 shutdown_connections 2024-09-10T22:25:55.639 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:55.605+0000 7fc0d1605640 1 -- 172.21.15.19:0/3318407438 wait complete. 2024-09-10T22:25:55.640 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:55.606+0000 7fc0d1605640 1 Processor -- start 2024-09-10T22:25:55.640 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:55.606+0000 7fc0d1605640 1 -- start start 2024-09-10T22:25:55.640 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:55.606+0000 7fc0d1605640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc0cc102920 0x7fc0cc199280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:25:55.640 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:55.606+0000 7fc0d1605640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc0cc107780 0x7fc0cc1997c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:25:55.640 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:55.606+0000 7fc0d1605640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc0cc108120 0x7fc0cc19eb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:25:55.640 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:55.606+0000 7fc0d1605640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fc0cc111ca0 con 0x7fc0cc108120 2024-09-10T22:25:55.640 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:55.606+0000 7fc0d1605640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fc0cc111b20 con 0x7fc0cc107780 2024-09-10T22:25:55.640 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:55.606+0000 7fc0d1605640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7fc0cc111e20 con 0x7fc0cc102920 2024-09-10T22:25:55.640 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:55.606+0000 7fc0cb7fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc0cc108120 0x7fc0cc19eb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:25:55.640 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:55.606+0000 7fc0cb7fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc0cc108120 0x7fc0cc19eb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:37472/0 (socket says 172.21.15.19:37472) 2024-09-10T22:25:55.640 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:55.606+0000 7fc0cb7fe640 1 -- 172.21.15.19:0/1413767781 learned_addr learned my addr 172.21.15.19:0/1413767781 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:25:55.640 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:55.606+0000 7fc0caffd640 1 --2- 172.21.15.19:0/1413767781 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc0cc102920 0x7fc0cc199280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:25:55.641 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:55.606+0000 7fc0ca7fc640 1 --2- 172.21.15.19:0/1413767781 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc0cc107780 0x7fc0cc1997c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:25:55.641 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:55.606+0000 7fc0cb7fe640 1 -- 172.21.15.19:0/1413767781 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc0cc102920 msgr2=0x7fc0cc199280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:25:55.641 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:55.606+0000 7fc0cb7fe640 1 --2- 172.21.15.19:0/1413767781 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc0cc102920 0x7fc0cc199280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:25:55.641 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:55.606+0000 7fc0cb7fe640 1 -- 172.21.15.19:0/1413767781 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc0cc107780 msgr2=0x7fc0cc1997c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:25:55.641 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:55.606+0000 7fc0cb7fe640 1 --2- 172.21.15.19:0/1413767781 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc0cc107780 0x7fc0cc1997c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:25:55.641 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:55.606+0000 7fc0cb7fe640 1 -- 172.21.15.19:0/1413767781 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc0cc19f330 con 0x7fc0cc108120 2024-09-10T22:25:55.641 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:55.606+0000 7fc0caffd640 1 --2- 172.21.15.19:0/1413767781 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc0cc102920 0x7fc0cc199280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T22:25:55.641 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:55.607+0000 7fc0cb7fe640 1 --2- 172.21.15.19:0/1413767781 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc0cc108120 0x7fc0cc19eb60 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7fc0c400cce0 tx=0x7fc0c400a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:25:55.641 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:55.607+0000 7fc0b3fff640 1 -- 172.21.15.19:0/1413767781 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0c400f450 con 0x7fc0cc108120 2024-09-10T22:25:55.641 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:55.607+0000 7fc0b3fff640 1 -- 172.21.15.19:0/1413767781 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc0c400faa0 con 0x7fc0cc108120 2024-09-10T22:25:55.641 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:55.607+0000 7fc0d1605640 1 -- 172.21.15.19:0/1413767781 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc0cc19f620 con 0x7fc0cc108120 2024-09-10T22:25:55.641 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:55.607+0000 7fc0b3fff640 1 -- 172.21.15.19:0/1413767781 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0c4018b70 con 0x7fc0cc108120 2024-09-10T22:25:55.641 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:55.607+0000 7fc0d1605640 1 -- 172.21.15.19:0/1413767781 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc0cc1a5ce0 con 0x7fc0cc108120 2024-09-10T22:25:55.642 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:55.608+0000 7fc0d1605640 1 -- 172.21.15.19:0/1413767781 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc0cc102d00 con 0x7fc0cc108120 2024-09-10T22:25:55.642 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:55.609+0000 7fc0b3fff640 1 -- 172.21.15.19:0/1413767781 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 17) ==== 153301+0+0 (secure 0 0 0) 0x7fc0c400f5f0 con 0x7fc0cc108120 2024-09-10T22:25:55.642 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:55.610+0000 7fc0b3fff640 1 --2- 172.21.15.19:0/1413767781 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7fc0b40b5370 0x7fc0b40b7830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:25:55.642 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:55.610+0000 7fc0caffd640 1 --2- 172.21.15.19:0/1413767781 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7fc0b40b5370 0x7fc0b40b7830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:25:55.642 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:55.611+0000 7fc0b3fff640 1 -- 172.21.15.19:0/1413767781 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8269+0+0 (secure 0 0 0) 0x7fc0c40e6570 con 0x7fc0cc108120 2024-09-10T22:25:55.642 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:55.611+0000 7fc0caffd640 1 --2- 172.21.15.19:0/1413767781 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7fc0b40b5370 0x7fc0b40b7830 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fc0bc000c00 tx=0x7fc0bc031400 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:25:55.642 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:55.615+0000 7fc0b3fff640 1 -- 172.21.15.19:0/1413767781 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7fc0c4014030 con 0x7fc0cc108120 2024-09-10T22:25:55.841 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:55.840+0000 7fc0d1605640 1 -- 172.21.15.19:0/1413767781 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc0cc02e5c0 con 0x7fc0cc108120 2024-09-10T22:25:55.842 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:55.841+0000 7fc0b3fff640 1 -- 172.21.15.19:0/1413767781 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) ==== 94+0+11921 (secure 0 0 0) 0x7fc0c40ad2b0 con 0x7fc0cc108120 2024-09-10T22:25:55.842 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-10T22:25:55.843 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":24,"btime":"2024-09-10T22:24:34:220851+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14673,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6835/1835804747","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6834","nonce":1835804747},{"type":"v1","addr":"172.21.15.19:6835","nonce":1835804747}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14685,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6837/1750470490","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6836","nonce":1750470490},{"type":"v1","addr":"172.21.15.19:6837","nonce":1750470490}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14733,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6839/2642941149","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6838","nonce":2642941149},{"type":"v1","addr":"172.21.15.19:6839","nonce":2642941149}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14745,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6841/2449948682","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6840","nonce":2449948682},{"type":"v1","addr":"172.21.15.19:6841","nonce":2449948682}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24511,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.138:6833/2524811494","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6832","nonce":2524811494},{"type":"v1","addr":"172.21.15.138:6833","nonce":2524811494}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24512,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6833/3014993624","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6832","nonce":3014993624},{"type":"v1","addr":"172.21.15.135:6833","nonce":3014993624}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":24,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-10T22:24:22.733925+0000","modified":"2024-09-10T22:24:33.797491+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24581,"mds_1":24568,"mds_2":24553},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24527":{"gid":24527,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.135:6835/3715773348","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6834","nonce":3715773348},{"type":"v1","addr":"172.21.15.135:6835","nonce":3715773348}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24541":{"gid":24541,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.138:6835/933547028","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6834","nonce":933547028},{"type":"v1","addr":"172.21.15.138:6835","nonce":933547028}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24551":{"gid":24551,"name":"h","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.135:6837/3495029135","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6836","nonce":3495029135},{"type":"v1","addr":"172.21.15.135:6837","nonce":3495029135}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24553":{"gid":24553,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":10,"addr":"172.21.15.138:6837/3353290042","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6836","nonce":3353290042},{"type":"v1","addr":"172.21.15.138:6837","nonce":3353290042}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24568":{"gid":24568,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.138:6839/383637208","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6838","nonce":383637208},{"type":"v1","addr":"172.21.15.138:6839","nonce":383637208}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24581":{"gid":24581,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.135:6839/1254769802","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6838","nonce":1254769802},{"type":"v1","addr":"172.21.15.135:6839","nonce":1254769802}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24581,"qdb_cluster":[24553,24568,24581]},"id":1}]} 2024-09-10T22:25:55.843 INFO:teuthology.orchestra.run.smithi019.stderr:dumped fsmap epoch 24 2024-09-10T22:25:55.844 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:55.843+0000 7fc0d1605640 1 -- 172.21.15.19:0/1413767781 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7fc0b40b5370 msgr2=0x7fc0b40b7830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:25:55.845 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:55.843+0000 7fc0d1605640 1 --2- 172.21.15.19:0/1413767781 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7fc0b40b5370 0x7fc0b40b7830 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fc0bc000c00 tx=0x7fc0bc031400 comp rx=0 tx=0).stop 2024-09-10T22:25:55.845 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:55.843+0000 7fc0d1605640 1 -- 172.21.15.19:0/1413767781 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc0cc108120 msgr2=0x7fc0cc19eb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:25:55.845 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:55.843+0000 7fc0d1605640 1 --2- 172.21.15.19:0/1413767781 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc0cc108120 0x7fc0cc19eb60 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7fc0c400cce0 tx=0x7fc0c400a620 comp rx=0 tx=0).stop 2024-09-10T22:25:55.845 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:55.843+0000 7fc0d1605640 1 -- 172.21.15.19:0/1413767781 shutdown_connections 2024-09-10T22:25:55.845 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:55.843+0000 7fc0d1605640 1 --2- 172.21.15.19:0/1413767781 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7fc0b40b5370 0x7fc0b40b7830 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:25:55.845 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:55.843+0000 7fc0d1605640 1 --2- 172.21.15.19:0/1413767781 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc0cc108120 0x7fc0cc19eb60 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:25:55.845 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:55.843+0000 7fc0d1605640 1 --2- 172.21.15.19:0/1413767781 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc0cc107780 0x7fc0cc1997c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:25:55.845 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:55.843+0000 7fc0d1605640 1 --2- 172.21.15.19:0/1413767781 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc0cc102920 0x7fc0cc199280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:25:55.846 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:55.843+0000 7fc0d1605640 1 -- 172.21.15.19:0/1413767781 >> 172.21.15.19:0/1413767781 conn(0x7fc0cc076f50 msgr2=0x7fc0cc105b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:25:55.846 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:55.843+0000 7fc0d1605640 1 -- 172.21.15.19:0/1413767781 shutdown_connections 2024-09-10T22:25:55.846 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:55.843+0000 7fc0d1605640 1 -- 172.21.15.19:0/1413767781 wait complete. 2024-09-10T22:25:56.205 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:25:55 smithi019 ceph-mon[31375]: pgmap v330: 97 pgs: 97 active+clean; 639 KiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-10T22:25:56.205 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:25:55 smithi019 ceph-mon[31375]: from='client.? 172.21.15.19:0/1413767781' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T22:25:56.359 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:25:55 smithi135 ceph-mon[34789]: pgmap v330: 97 pgs: 97 active+clean; 639 KiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-10T22:25:56.360 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:25:55 smithi135 ceph-mon[34789]: from='client.? 172.21.15.19:0/1413767781' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T22:25:56.375 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:25:55 smithi138 ceph-mon[35236]: pgmap v330: 97 pgs: 97 active+clean; 639 KiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-10T22:25:56.375 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:25:55 smithi138 ceph-mon[35236]: from='client.? 172.21.15.19:0/1413767781' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T22:25:56.532 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 22997a4c-6fc2-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-10T22:25:56.790 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/22997a4c-6fc2-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T22:25:57.329 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:57.305+0000 7f0dbec07640 1 -- 172.21.15.19:0/3038088810 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0db810d100 msgr2=0x7f0db810f560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:25:57.329 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:57.305+0000 7f0dbec07640 1 --2- 172.21.15.19:0/3038088810 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0db810d100 0x7f0db810f560 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f0db0009ca0 tx=0x7f0db002a8c0 comp rx=0 tx=0).stop 2024-09-10T22:25:57.330 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:57.305+0000 7f0dbec07640 1 -- 172.21.15.19:0/3038088810 shutdown_connections 2024-09-10T22:25:57.330 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:57.305+0000 7f0dbec07640 1 --2- 172.21.15.19:0/3038088810 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0db810d100 0x7f0db810f560 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:25:57.330 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:57.305+0000 7f0dbec07640 1 --2- 172.21.15.19:0/3038088810 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f0db81045c0 0x7f0db810cab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:25:57.330 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:57.305+0000 7f0dbec07640 1 --2- 172.21.15.19:0/3038088810 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0db8103ca0 0x7f0db8104080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:25:57.330 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:57.305+0000 7f0dbec07640 1 -- 172.21.15.19:0/3038088810 >> 172.21.15.19:0/3038088810 conn(0x7f0db80fd700 msgr2=0x7f0db80ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:25:57.330 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:57.305+0000 7f0dbec07640 1 -- 172.21.15.19:0/3038088810 shutdown_connections 2024-09-10T22:25:57.330 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:57.305+0000 7f0dbec07640 1 -- 172.21.15.19:0/3038088810 wait complete. 2024-09-10T22:25:57.330 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:57.306+0000 7f0dbec07640 1 Processor -- start 2024-09-10T22:25:57.330 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:57.306+0000 7f0dbec07640 1 -- start start 2024-09-10T22:25:57.330 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:57.306+0000 7f0dbec07640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f0db8103ca0 0x7f0db8199220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:25:57.330 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:57.306+0000 7f0dbec07640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0db81045c0 0x7f0db8199760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:25:57.330 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:57.306+0000 7f0dbec07640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0db810d100 0x7f0db819eb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:25:57.331 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:57.306+0000 7f0dbec07640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f0db8112db0 con 0x7f0db81045c0 2024-09-10T22:25:57.331 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:57.306+0000 7f0dbec07640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f0db8112c30 con 0x7f0db810d100 2024-09-10T22:25:57.331 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:57.306+0000 7f0dbec07640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f0db8112f30 con 0x7f0db8103ca0 2024-09-10T22:25:57.331 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:57.306+0000 7f0db7fff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0db81045c0 0x7f0db8199760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:25:57.331 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:57.306+0000 7f0db7fff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0db81045c0 0x7f0db8199760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:37490/0 (socket says 172.21.15.19:37490) 2024-09-10T22:25:57.331 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:57.306+0000 7f0db7fff640 1 -- 172.21.15.19:0/1820932638 learned_addr learned my addr 172.21.15.19:0/1820932638 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:25:57.331 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:57.306+0000 7f0dbd1a4640 1 --2- 172.21.15.19:0/1820932638 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0db810d100 0x7f0db819eb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:25:57.331 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:57.306+0000 7f0dbc9a3640 1 --2- 172.21.15.19:0/1820932638 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f0db8103ca0 0x7f0db8199220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:25:57.331 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:57.307+0000 7f0db7fff640 1 -- 172.21.15.19:0/1820932638 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f0db8103ca0 msgr2=0x7f0db8199220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:25:57.331 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:57.307+0000 7f0db7fff640 1 --2- 172.21.15.19:0/1820932638 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f0db8103ca0 0x7f0db8199220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:25:57.332 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:57.307+0000 7f0db7fff640 1 -- 172.21.15.19:0/1820932638 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0db810d100 msgr2=0x7f0db819eb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:25:57.332 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:57.307+0000 7f0db7fff640 1 --2- 172.21.15.19:0/1820932638 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0db810d100 0x7f0db819eb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:25:57.332 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:57.307+0000 7f0db7fff640 1 -- 172.21.15.19:0/1820932638 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0db819f2d0 con 0x7f0db81045c0 2024-09-10T22:25:57.332 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:57.307+0000 7f0dbc9a3640 1 --2- 172.21.15.19:0/1820932638 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f0db8103ca0 0x7f0db8199220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T22:25:57.332 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:57.307+0000 7f0db7fff640 1 --2- 172.21.15.19:0/1820932638 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0db81045c0 0x7f0db8199760 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f0dac00c970 tx=0x7f0dac00ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:25:57.332 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:57.307+0000 7f0db5ffb640 1 -- 172.21.15.19:0/1820932638 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0dac007bb0 con 0x7f0db81045c0 2024-09-10T22:25:57.332 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:57.307+0000 7f0db5ffb640 1 -- 172.21.15.19:0/1820932638 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0dac007d50 con 0x7f0db81045c0 2024-09-10T22:25:57.332 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:57.307+0000 7f0dbec07640 1 -- 172.21.15.19:0/1820932638 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0db819f5c0 con 0x7f0db81045c0 2024-09-10T22:25:57.332 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:57.307+0000 7f0db5ffb640 1 -- 172.21.15.19:0/1820932638 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0dac00f7b0 con 0x7f0db81045c0 2024-09-10T22:25:57.332 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:57.307+0000 7f0dbec07640 1 -- 172.21.15.19:0/1820932638 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0db81a5d00 con 0x7f0db81045c0 2024-09-10T22:25:57.332 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:57.308+0000 7f0dbec07640 1 -- 172.21.15.19:0/1820932638 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0db8104080 con 0x7f0db81045c0 2024-09-10T22:25:57.332 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:57.310+0000 7f0db5ffb640 1 -- 172.21.15.19:0/1820932638 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 17) ==== 153301+0+0 (secure 0 0 0) 0x7f0dac018480 con 0x7f0db81045c0 2024-09-10T22:25:57.333 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:57.310+0000 7f0db5ffb640 1 --2- 172.21.15.19:0/1820932638 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f0da00b5370 0x7f0da00b7830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:25:57.333 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:57.310+0000 7f0dbc9a3640 1 --2- 172.21.15.19:0/1820932638 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f0da00b5370 0x7f0da00b7830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:25:57.333 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:57.310+0000 7f0db5ffb640 1 -- 172.21.15.19:0/1820932638 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8269+0+0 (secure 0 0 0) 0x7f0dac0e6320 con 0x7f0db81045c0 2024-09-10T22:25:57.333 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:57.311+0000 7f0dbc9a3640 1 --2- 172.21.15.19:0/1820932638 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f0da00b5370 0x7f0da00b7830 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f0da8006fd0 tx=0x7f0da8008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:25:57.333 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:57.313+0000 7f0db5ffb640 1 -- 172.21.15.19:0/1820932638 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f0dac0ad180 con 0x7f0db81045c0 2024-09-10T22:25:57.535 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:57.534+0000 7f0dbec07640 1 -- 172.21.15.19:0/1820932638 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f0db81a60e0 con 0x7f0db81045c0 2024-09-10T22:25:57.536 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:57.534+0000 7f0db5ffb640 1 -- 172.21.15.19:0/1820932638 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) ==== 94+0+11921 (secure 0 0 0) 0x7f0dac0aca80 con 0x7f0db81045c0 2024-09-10T22:25:57.536 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-10T22:25:57.537 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":24,"btime":"2024-09-10T22:24:34:220851+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14673,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6835/1835804747","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6834","nonce":1835804747},{"type":"v1","addr":"172.21.15.19:6835","nonce":1835804747}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14685,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6837/1750470490","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6836","nonce":1750470490},{"type":"v1","addr":"172.21.15.19:6837","nonce":1750470490}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14733,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6839/2642941149","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6838","nonce":2642941149},{"type":"v1","addr":"172.21.15.19:6839","nonce":2642941149}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14745,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6841/2449948682","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6840","nonce":2449948682},{"type":"v1","addr":"172.21.15.19:6841","nonce":2449948682}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24511,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.138:6833/2524811494","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6832","nonce":2524811494},{"type":"v1","addr":"172.21.15.138:6833","nonce":2524811494}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24512,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6833/3014993624","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6832","nonce":3014993624},{"type":"v1","addr":"172.21.15.135:6833","nonce":3014993624}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":24,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-10T22:24:22.733925+0000","modified":"2024-09-10T22:24:33.797491+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24581,"mds_1":24568,"mds_2":24553},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24527":{"gid":24527,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.135:6835/3715773348","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6834","nonce":3715773348},{"type":"v1","addr":"172.21.15.135:6835","nonce":3715773348}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24541":{"gid":24541,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.138:6835/933547028","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6834","nonce":933547028},{"type":"v1","addr":"172.21.15.138:6835","nonce":933547028}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24551":{"gid":24551,"name":"h","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.135:6837/3495029135","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6836","nonce":3495029135},{"type":"v1","addr":"172.21.15.135:6837","nonce":3495029135}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24553":{"gid":24553,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":10,"addr":"172.21.15.138:6837/3353290042","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6836","nonce":3353290042},{"type":"v1","addr":"172.21.15.138:6837","nonce":3353290042}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24568":{"gid":24568,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.138:6839/383637208","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6838","nonce":383637208},{"type":"v1","addr":"172.21.15.138:6839","nonce":383637208}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24581":{"gid":24581,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.135:6839/1254769802","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6838","nonce":1254769802},{"type":"v1","addr":"172.21.15.135:6839","nonce":1254769802}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24581,"qdb_cluster":[24553,24568,24581]},"id":1}]} 2024-09-10T22:25:57.537 INFO:teuthology.orchestra.run.smithi019.stderr:dumped fsmap epoch 24 2024-09-10T22:25:57.539 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:57.538+0000 7f0dbec07640 1 -- 172.21.15.19:0/1820932638 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f0da00b5370 msgr2=0x7f0da00b7830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:25:57.539 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:57.538+0000 7f0dbec07640 1 --2- 172.21.15.19:0/1820932638 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f0da00b5370 0x7f0da00b7830 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f0da8006fd0 tx=0x7f0da8008040 comp rx=0 tx=0).stop 2024-09-10T22:25:57.539 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:57.538+0000 7f0dbec07640 1 -- 172.21.15.19:0/1820932638 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0db81045c0 msgr2=0x7f0db8199760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:25:57.539 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:57.538+0000 7f0dbec07640 1 --2- 172.21.15.19:0/1820932638 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0db81045c0 0x7f0db8199760 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f0dac00c970 tx=0x7f0dac00ce30 comp rx=0 tx=0).stop 2024-09-10T22:25:57.540 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:57.538+0000 7f0dbec07640 1 -- 172.21.15.19:0/1820932638 shutdown_connections 2024-09-10T22:25:57.540 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:57.538+0000 7f0dbec07640 1 --2- 172.21.15.19:0/1820932638 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f0da00b5370 0x7f0da00b7830 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:25:57.540 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:57.538+0000 7f0dbec07640 1 --2- 172.21.15.19:0/1820932638 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0db810d100 0x7f0db819eb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:25:57.540 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:57.538+0000 7f0dbec07640 1 --2- 172.21.15.19:0/1820932638 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0db81045c0 0x7f0db8199760 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:25:57.540 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:57.538+0000 7f0dbec07640 1 --2- 172.21.15.19:0/1820932638 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f0db8103ca0 0x7f0db8199220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:25:57.540 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:57.538+0000 7f0dbec07640 1 -- 172.21.15.19:0/1820932638 >> 172.21.15.19:0/1820932638 conn(0x7f0db80fd700 msgr2=0x7f0db810f320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:25:57.540 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:57.538+0000 7f0dbec07640 1 -- 172.21.15.19:0/1820932638 shutdown_connections 2024-09-10T22:25:57.540 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:57.538+0000 7f0dbec07640 1 -- 172.21.15.19:0/1820932638 wait complete. 2024-09-10T22:25:58.191 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:25:57 smithi019 ceph-mon[31375]: pgmap v331: 97 pgs: 97 active+clean; 639 KiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-10T22:25:58.191 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:25:57 smithi019 ceph-mon[31375]: from='client.? 172.21.15.19:0/1820932638' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T22:25:58.220 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 22997a4c-6fc2-11ef-bcea-c7b262605968 -- ceph osd dump --format=json 2024-09-10T22:25:58.359 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:25:57 smithi135 ceph-mon[34789]: pgmap v331: 97 pgs: 97 active+clean; 639 KiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-10T22:25:58.360 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:25:57 smithi135 ceph-mon[34789]: from='client.? 172.21.15.19:0/1820932638' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T22:25:58.375 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:25:57 smithi138 ceph-mon[35236]: pgmap v331: 97 pgs: 97 active+clean; 639 KiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-10T22:25:58.375 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:25:57 smithi138 ceph-mon[35236]: from='client.? 172.21.15.19:0/1820932638' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T22:25:58.476 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/22997a4c-6fc2-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T22:25:58.952 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:58.934+0000 7f05fa5b8640 1 -- 172.21.15.19:0/2749570420 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f05f41076a0 msgr2=0x7f05f4107ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:25:58.953 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:58.934+0000 7f05fa5b8640 1 --2- 172.21.15.19:0/2749570420 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f05f41076a0 0x7f05f4107ae0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f05dc009900 tx=0x7f05dc02a410 comp rx=0 tx=0).stop 2024-09-10T22:25:58.953 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:58.934+0000 7f05fa5b8640 1 -- 172.21.15.19:0/2749570420 shutdown_connections 2024-09-10T22:25:58.953 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:58.934+0000 7f05fa5b8640 1 --2- 172.21.15.19:0/2749570420 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f05f4108020 0x7f05f410e820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:25:58.953 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:58.934+0000 7f05fa5b8640 1 --2- 172.21.15.19:0/2749570420 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f05f41076a0 0x7f05f4107ae0 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:25:58.953 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:58.934+0000 7f05fa5b8640 1 --2- 172.21.15.19:0/2749570420 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f05f4101c90 0x7f05f4102070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:25:58.953 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:58.934+0000 7f05fa5b8640 1 -- 172.21.15.19:0/2749570420 >> 172.21.15.19:0/2749570420 conn(0x7f05f40fd700 msgr2=0x7f05f40ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:25:58.953 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:58.934+0000 7f05fa5b8640 1 -- 172.21.15.19:0/2749570420 shutdown_connections 2024-09-10T22:25:58.953 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:58.934+0000 7f05fa5b8640 1 -- 172.21.15.19:0/2749570420 wait complete. 2024-09-10T22:25:58.953 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:58.935+0000 7f05fa5b8640 1 Processor -- start 2024-09-10T22:25:58.953 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:58.935+0000 7f05fa5b8640 1 -- start start 2024-09-10T22:25:58.954 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:58.935+0000 7f05fa5b8640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f05f4101c90 0x7f05f4199270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:25:58.954 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:58.935+0000 7f05fa5b8640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f05f41076a0 0x7f05f41997b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:25:58.954 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:58.935+0000 7f05fa5b8640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f05f4108020 0x7f05f419eb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:25:58.954 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:58.935+0000 7f05fa5b8640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f05f4111ce0 con 0x7f05f4108020 2024-09-10T22:25:58.954 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:58.935+0000 7f05fa5b8640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f05f4111b60 con 0x7f05f41076a0 2024-09-10T22:25:58.954 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:58.935+0000 7f05fa5b8640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f05f4111e60 con 0x7f05f4101c90 2024-09-10T22:25:58.954 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:58.935+0000 7f05f8b55640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f05f4108020 0x7f05f419eb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:25:58.954 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:58.935+0000 7f05f8b55640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f05f4108020 0x7f05f419eb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:37518/0 (socket says 172.21.15.19:37518) 2024-09-10T22:25:58.954 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:58.935+0000 7f05f8b55640 1 -- 172.21.15.19:0/1649166513 learned_addr learned my addr 172.21.15.19:0/1649166513 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:25:58.954 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:58.935+0000 7f05ebfff640 1 --2- 172.21.15.19:0/1649166513 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f05f41076a0 0x7f05f41997b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:25:58.954 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:58.935+0000 7f05f3fff640 1 --2- 172.21.15.19:0/1649166513 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f05f4101c90 0x7f05f4199270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:25:58.954 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:58.935+0000 7f05f8b55640 1 -- 172.21.15.19:0/1649166513 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f05f4101c90 msgr2=0x7f05f4199270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:25:58.955 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:58.935+0000 7f05f8b55640 1 --2- 172.21.15.19:0/1649166513 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f05f4101c90 0x7f05f4199270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:25:58.955 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:58.935+0000 7f05f8b55640 1 -- 172.21.15.19:0/1649166513 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f05f41076a0 msgr2=0x7f05f41997b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:25:58.955 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:58.935+0000 7f05f8b55640 1 --2- 172.21.15.19:0/1649166513 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f05f41076a0 0x7f05f41997b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:25:58.955 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:58.935+0000 7f05f8b55640 1 -- 172.21.15.19:0/1649166513 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f05f419f320 con 0x7f05f4108020 2024-09-10T22:25:58.955 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:58.935+0000 7f05f3fff640 1 --2- 172.21.15.19:0/1649166513 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f05f4101c90 0x7f05f4199270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T22:25:58.955 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:58.936+0000 7f05f8b55640 1 --2- 172.21.15.19:0/1649166513 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f05f4108020 0x7f05f419eb50 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f05ec00eaa0 tx=0x7f05ec00ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:25:58.955 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:58.936+0000 7f05f1ffb640 1 -- 172.21.15.19:0/1649166513 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05ec00cdb0 con 0x7f05f4108020 2024-09-10T22:25:58.955 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:58.936+0000 7f05f1ffb640 1 -- 172.21.15.19:0/1649166513 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f05ec005020 con 0x7f05f4108020 2024-09-10T22:25:58.955 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:58.936+0000 7f05fa5b8640 1 -- 172.21.15.19:0/1649166513 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f05f419f610 con 0x7f05f4108020 2024-09-10T22:25:58.955 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:58.936+0000 7f05f1ffb640 1 -- 172.21.15.19:0/1649166513 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05ec0116d0 con 0x7f05f4108020 2024-09-10T22:25:58.955 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:58.936+0000 7f05fa5b8640 1 -- 172.21.15.19:0/1649166513 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f05f41a5cd0 con 0x7f05f4108020 2024-09-10T22:25:58.955 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:58.937+0000 7f05fa5b8640 1 -- 172.21.15.19:0/1649166513 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f05f4102070 con 0x7f05f4108020 2024-09-10T22:25:58.956 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:58.938+0000 7f05f1ffb640 1 -- 172.21.15.19:0/1649166513 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 17) ==== 153301+0+0 (secure 0 0 0) 0x7f05ec00f040 con 0x7f05f4108020 2024-09-10T22:25:58.956 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:58.939+0000 7f05f1ffb640 1 --2- 172.21.15.19:0/1649166513 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f05e00b53f0 0x7f05e00b78b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:25:58.956 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:58.939+0000 7f05f3fff640 1 --2- 172.21.15.19:0/1649166513 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f05e00b53f0 0x7f05e00b78b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:25:58.956 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:58.939+0000 7f05f1ffb640 1 -- 172.21.15.19:0/1649166513 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8269+0+0 (secure 0 0 0) 0x7f05ec0e5fc0 con 0x7f05f4108020 2024-09-10T22:25:58.956 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:58.939+0000 7f05f3fff640 1 --2- 172.21.15.19:0/1649166513 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f05e00b53f0 0x7f05e00b78b0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f05e40058c0 tx=0x7f05e4005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:25:58.956 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:58.942+0000 7f05f1ffb640 1 -- 172.21.15.19:0/1649166513 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f05ec016030 con 0x7f05f4108020 2024-09-10T22:25:59.129 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:59.128+0000 7f05fa5b8640 1 -- 172.21.15.19:0/1649166513 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f05f419a3a0 con 0x7f05f4108020 2024-09-10T22:25:59.130 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:59.129+0000 7f05f1ffb640 1 -- 172.21.15.19:0/1649166513 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v75) ==== 74+0+22761 (secure 0 0 0) 0x7f05ec0acd20 con 0x7f05f4108020 2024-09-10T22:25:59.131 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-10T22:25:59.131 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":75,"fsid":"22997a4c-6fc2-11ef-bcea-c7b262605968","created":"2024-09-10T22:16:16.754696+0000","modified":"2024-09-10T22:25:05.513986+0000","last_up_change":"2024-09-10T22:23:32.417392+0000","last_in_change":"2024-09-10T22:23:09.614371+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T22:19:50.731662+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-10T22:24:18.740121+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"73","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-10T22:24:20.795178+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"73","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"783d96cb-0a8a-47f3-8eab-77cd731a64bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6802","nonce":234761879},{"type":"v1","addr":"172.21.15.19:6803","nonce":234761879}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6804","nonce":234761879},{"type":"v1","addr":"172.21.15.19:6805","nonce":234761879}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6808","nonce":234761879},{"type":"v1","addr":"172.21.15.19:6809","nonce":234761879}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6806","nonce":234761879},{"type":"v1","addr":"172.21.15.19:6807","nonce":234761879}]},"public_addr":"172.21.15.19:6803/234761879","cluster_addr":"172.21.15.19:6805/234761879","heartbeat_back_addr":"172.21.15.19:6809/234761879","heartbeat_front_addr":"172.21.15.19:6807/234761879","state":["exists","up"]},{"osd":1,"uuid":"41043581-e0cf-43b5-bae0-0d95e2ef8156","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6800","nonce":1803526886},{"type":"v1","addr":"172.21.15.135:6801","nonce":1803526886}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6802","nonce":1803526886},{"type":"v1","addr":"172.21.15.135:6803","nonce":1803526886}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6806","nonce":1803526886},{"type":"v1","addr":"172.21.15.135:6807","nonce":1803526886}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6804","nonce":1803526886},{"type":"v1","addr":"172.21.15.135:6805","nonce":1803526886}]},"public_addr":"172.21.15.135:6801/1803526886","cluster_addr":"172.21.15.135:6803/1803526886","heartbeat_back_addr":"172.21.15.135:6807/1803526886","heartbeat_front_addr":"172.21.15.135:6805/1803526886","state":["exists","up"]},{"osd":2,"uuid":"a9b14a06-bbdc-4501-96e2-fb5f7127ca16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6800","nonce":2747418770},{"type":"v1","addr":"172.21.15.138:6801","nonce":2747418770}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6802","nonce":2747418770},{"type":"v1","addr":"172.21.15.138:6803","nonce":2747418770}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6806","nonce":2747418770},{"type":"v1","addr":"172.21.15.138:6807","nonce":2747418770}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6804","nonce":2747418770},{"type":"v1","addr":"172.21.15.138:6805","nonce":2747418770}]},"public_addr":"172.21.15.138:6801/2747418770","cluster_addr":"172.21.15.138:6803/2747418770","heartbeat_back_addr":"172.21.15.138:6807/2747418770","heartbeat_front_addr":"172.21.15.138:6805/2747418770","state":["exists","up"]},{"osd":3,"uuid":"a46268da-8666-4cfa-b11a-30eb12e271be","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":23,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6810","nonce":1889857224},{"type":"v1","addr":"172.21.15.19:6811","nonce":1889857224}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6812","nonce":1889857224},{"type":"v1","addr":"172.21.15.19:6813","nonce":1889857224}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6816","nonce":1889857224},{"type":"v1","addr":"172.21.15.19:6817","nonce":1889857224}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6814","nonce":1889857224},{"type":"v1","addr":"172.21.15.19:6815","nonce":1889857224}]},"public_addr":"172.21.15.19:6811/1889857224","cluster_addr":"172.21.15.19:6813/1889857224","heartbeat_back_addr":"172.21.15.19:6817/1889857224","heartbeat_front_addr":"172.21.15.19:6815/1889857224","state":["exists","up"]},{"osd":4,"uuid":"c58df06f-2de2-4655-88e7-ac6a3531839a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":29,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6808","nonce":436311825},{"type":"v1","addr":"172.21.15.135:6809","nonce":436311825}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6810","nonce":436311825},{"type":"v1","addr":"172.21.15.135:6811","nonce":436311825}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6814","nonce":436311825},{"type":"v1","addr":"172.21.15.135:6815","nonce":436311825}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6812","nonce":436311825},{"type":"v1","addr":"172.21.15.135:6813","nonce":436311825}]},"public_addr":"172.21.15.135:6809/436311825","cluster_addr":"172.21.15.135:6811/436311825","heartbeat_back_addr":"172.21.15.135:6815/436311825","heartbeat_front_addr":"172.21.15.135:6813/436311825","state":["exists","up"]},{"osd":5,"uuid":"c0900b0c-aef4-498d-a01b-a891bdb51122","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6808","nonce":1086764290},{"type":"v1","addr":"172.21.15.138:6809","nonce":1086764290}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6810","nonce":1086764290},{"type":"v1","addr":"172.21.15.138:6811","nonce":1086764290}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6814","nonce":1086764290},{"type":"v1","addr":"172.21.15.138:6815","nonce":1086764290}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6812","nonce":1086764290},{"type":"v1","addr":"172.21.15.138:6813","nonce":1086764290}]},"public_addr":"172.21.15.138:6809/1086764290","cluster_addr":"172.21.15.138:6811/1086764290","heartbeat_back_addr":"172.21.15.138:6815/1086764290","heartbeat_front_addr":"172.21.15.138:6813/1086764290","state":["exists","up"]},{"osd":6,"uuid":"f79cb310-8073-4ee5-80a6-87a290600321","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":40,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6818","nonce":406328354},{"type":"v1","addr":"172.21.15.19:6819","nonce":406328354}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6820","nonce":406328354},{"type":"v1","addr":"172.21.15.19:6821","nonce":406328354}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6824","nonce":406328354},{"type":"v1","addr":"172.21.15.19:6825","nonce":406328354}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6822","nonce":406328354},{"type":"v1","addr":"172.21.15.19:6823","nonce":406328354}]},"public_addr":"172.21.15.19:6819/406328354","cluster_addr":"172.21.15.19:6821/406328354","heartbeat_back_addr":"172.21.15.19:6825/406328354","heartbeat_front_addr":"172.21.15.19:6823/406328354","state":["exists","up"]},{"osd":7,"uuid":"cc76476a-92f3-489c-be9e-29cbbf39539e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6816","nonce":1096613674},{"type":"v1","addr":"172.21.15.135:6817","nonce":1096613674}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6818","nonce":1096613674},{"type":"v1","addr":"172.21.15.135:6819","nonce":1096613674}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6822","nonce":1096613674},{"type":"v1","addr":"172.21.15.135:6823","nonce":1096613674}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6820","nonce":1096613674},{"type":"v1","addr":"172.21.15.135:6821","nonce":1096613674}]},"public_addr":"172.21.15.135:6817/1096613674","cluster_addr":"172.21.15.135:6819/1096613674","heartbeat_back_addr":"172.21.15.135:6823/1096613674","heartbeat_front_addr":"172.21.15.135:6821/1096613674","state":["exists","up"]},{"osd":8,"uuid":"5323a006-a6e8-4403-9c51-65f46298d5c4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6816","nonce":3020394729},{"type":"v1","addr":"172.21.15.138:6817","nonce":3020394729}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6818","nonce":3020394729},{"type":"v1","addr":"172.21.15.138:6819","nonce":3020394729}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6822","nonce":3020394729},{"type":"v1","addr":"172.21.15.138:6823","nonce":3020394729}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6820","nonce":3020394729},{"type":"v1","addr":"172.21.15.138:6821","nonce":3020394729}]},"public_addr":"172.21.15.138:6817/3020394729","cluster_addr":"172.21.15.138:6819/3020394729","heartbeat_back_addr":"172.21.15.138:6823/3020394729","heartbeat_front_addr":"172.21.15.138:6821/3020394729","state":["exists","up"]},{"osd":9,"uuid":"b869ac42-c46e-442c-8b5b-f81c018e663c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":57,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6826","nonce":1488680899},{"type":"v1","addr":"172.21.15.19:6827","nonce":1488680899}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6828","nonce":1488680899},{"type":"v1","addr":"172.21.15.19:6829","nonce":1488680899}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6832","nonce":1488680899},{"type":"v1","addr":"172.21.15.19:6833","nonce":1488680899}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6830","nonce":1488680899},{"type":"v1","addr":"172.21.15.19:6831","nonce":1488680899}]},"public_addr":"172.21.15.19:6827/1488680899","cluster_addr":"172.21.15.19:6829/1488680899","heartbeat_back_addr":"172.21.15.19:6833/1488680899","heartbeat_front_addr":"172.21.15.19:6831/1488680899","state":["exists","up"]},{"osd":10,"uuid":"b8a2d69a-6821-4c69-b7eb-c0cfc8164614","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":62,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6824","nonce":3812626754},{"type":"v1","addr":"172.21.15.135:6825","nonce":3812626754}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6826","nonce":3812626754},{"type":"v1","addr":"172.21.15.135:6827","nonce":3812626754}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6830","nonce":3812626754},{"type":"v1","addr":"172.21.15.135:6831","nonce":3812626754}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6828","nonce":3812626754},{"type":"v1","addr":"172.21.15.135:6829","nonce":3812626754}]},"public_addr":"172.21.15.135:6825/3812626754","cluster_addr":"172.21.15.135:6827/3812626754","heartbeat_back_addr":"172.21.15.135:6831/3812626754","heartbeat_front_addr":"172.21.15.135:6829/3812626754","state":["exists","up"]},{"osd":11,"uuid":"a9264ab2-5843-44d2-aba8-1e12708e99d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6824","nonce":1098434807},{"type":"v1","addr":"172.21.15.138:6825","nonce":1098434807}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6826","nonce":1098434807},{"type":"v1","addr":"172.21.15.138:6827","nonce":1098434807}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6830","nonce":1098434807},{"type":"v1","addr":"172.21.15.138:6831","nonce":1098434807}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6828","nonce":1098434807},{"type":"v1","addr":"172.21.15.138:6829","nonce":1098434807}]},"public_addr":"172.21.15.138:6825/1098434807","cluster_addr":"172.21.15.138:6827/1098434807","heartbeat_back_addr":"172.21.15.138:6831/1098434807","heartbeat_front_addr":"172.21.15.138:6829/1098434807","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:18:58.008025+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:19:22.475890+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:19:47.124147+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:20:12.438853+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:20:37.195177+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:21:02.474248+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:21:27.087207+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:21:52.119211+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:22:16.569989+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:22:41.680986+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:23:06.391885+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:23:30.695460+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.0","mappings":[{"from":8,"to":4}]},{"pgid":"2.16","mappings":[{"from":2,"to":6}]},{"pgid":"2.17","mappings":[{"from":5,"to":1}]},{"pgid":"2.1a","mappings":[{"from":8,"to":1}]},{"pgid":"2.1d","mappings":[{"from":2,"to":4}]},{"pgid":"2.1f","mappings":[{"from":7,"to":11}]},{"pgid":"3.13","mappings":[{"from":4,"to":9}]},{"pgid":"3.1b","mappings":[{"from":4,"to":8}]},{"pgid":"3.21","mappings":[{"from":5,"to":9}]},{"pgid":"3.38","mappings":[{"from":3,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.19:0/2099468127":"2024-09-11T22:17:04.260826+0000","172.21.15.19:0/538724915":"2024-09-11T22:17:04.260826+0000","172.21.15.19:0/3504695777":"2024-09-11T22:17:04.260826+0000","172.21.15.19:0/1401613792":"2024-09-11T22:16:39.069638+0000","172.21.15.19:6801/3005924425":"2024-09-11T22:17:04.260826+0000","172.21.15.19:6800/3005924425":"2024-09-11T22:17:04.260826+0000","172.21.15.19:0/104917892":"2024-09-11T22:16:39.069638+0000","172.21.15.19:0/1778305990":"2024-09-11T22:16:39.069638+0000","172.21.15.19:6801/535670059":"2024-09-11T22:16:39.069638+0000","172.21.15.19:6800/535670059":"2024-09-11T22:16:39.069638+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T22:25:59.133 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:59.131+0000 7f05fa5b8640 1 -- 172.21.15.19:0/1649166513 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f05e00b53f0 msgr2=0x7f05e00b78b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:25:59.133 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:59.131+0000 7f05fa5b8640 1 --2- 172.21.15.19:0/1649166513 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f05e00b53f0 0x7f05e00b78b0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f05e40058c0 tx=0x7f05e4005850 comp rx=0 tx=0).stop 2024-09-10T22:25:59.133 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:59.131+0000 7f05fa5b8640 1 -- 172.21.15.19:0/1649166513 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f05f4108020 msgr2=0x7f05f419eb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:25:59.133 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:59.131+0000 7f05fa5b8640 1 --2- 172.21.15.19:0/1649166513 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f05f4108020 0x7f05f419eb50 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f05ec00eaa0 tx=0x7f05ec00ef60 comp rx=0 tx=0).stop 2024-09-10T22:25:59.133 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:59.131+0000 7f05fa5b8640 1 -- 172.21.15.19:0/1649166513 shutdown_connections 2024-09-10T22:25:59.133 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:59.131+0000 7f05fa5b8640 1 --2- 172.21.15.19:0/1649166513 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f05e00b53f0 0x7f05e00b78b0 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:25:59.133 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:59.131+0000 7f05fa5b8640 1 --2- 172.21.15.19:0/1649166513 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f05f4108020 0x7f05f419eb50 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:25:59.133 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:59.131+0000 7f05fa5b8640 1 --2- 172.21.15.19:0/1649166513 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f05f41076a0 0x7f05f41997b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:25:59.133 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:59.131+0000 7f05fa5b8640 1 --2- 172.21.15.19:0/1649166513 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f05f4101c90 0x7f05f4199270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:25:59.133 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:59.131+0000 7f05fa5b8640 1 -- 172.21.15.19:0/1649166513 >> 172.21.15.19:0/1649166513 conn(0x7f05f40fd700 msgr2=0x7f05f406ac90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:25:59.134 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:59.132+0000 7f05fa5b8640 1 -- 172.21.15.19:0/1649166513 shutdown_connections 2024-09-10T22:25:59.134 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:25:59.132+0000 7f05fa5b8640 1 -- 172.21.15.19:0/1649166513 wait complete. 2024-09-10T22:25:59.813 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 24, 'flags': 50, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': True, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 32, 'explicitly_allowed_features': 32, 'created': '2024-09-10T22:24:22.733925+0000', 'modified': '2024-09-10T22:24:33.797491+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 3, 'in': [0, 1, 2], 'up': {'mds_0': 24581, 'mds_1': 24568, 'mds_2': 24553}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_24527': {'gid': 24527, 'name': 'e', 'rank': 2, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.135:6835/3715773348', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.135:6834', 'nonce': 3715773348}, {'type': 'v1', 'addr': '172.21.15.135:6835', 'nonce': 3715773348}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24541': {'gid': 24541, 'name': 'f', 'rank': 1, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.138:6835/933547028', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.138:6834', 'nonce': 933547028}, {'type': 'v1', 'addr': '172.21.15.138:6835', 'nonce': 933547028}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24551': {'gid': 24551, 'name': 'h', 'rank': 0, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.135:6837/3495029135', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.135:6836', 'nonce': 3495029135}, {'type': 'v1', 'addr': '172.21.15.135:6837', 'nonce': 3495029135}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24553': {'gid': 24553, 'name': 'c', 'rank': 2, 'incarnation': 21, 'state': 'up:active', 'state_seq': 10, 'addr': '172.21.15.138:6837/3353290042', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.138:6836', 'nonce': 3353290042}, {'type': 'v1', 'addr': '172.21.15.138:6837', 'nonce': 3353290042}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24568': {'gid': 24568, 'name': 'i', 'rank': 1, 'incarnation': 19, 'state': 'up:active', 'state_seq': 8, 'addr': '172.21.15.138:6839/383637208', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.138:6838', 'nonce': 383637208}, {'type': 'v1', 'addr': '172.21.15.138:6839', 'nonce': 383637208}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24581': {'gid': 24581, 'name': 'b', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.135:6839/1254769802', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.135:6838', 'nonce': 1254769802}, {'type': 'v1', 'addr': '172.21.15.135:6839', 'nonce': 1254769802}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 24581, 'qdb_cluster': [24553, 24568, 24581]} 2024-09-10T22:25:59.813 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 3/3 2024-09-10T22:25:59.813 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 22997a4c-6fc2-11ef-bcea-c7b262605968 -- ceph tell mds.c status 2024-09-10T22:26:00.073 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/22997a4c-6fc2-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T22:26:00.194 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:25:59 smithi019 ceph-mon[31375]: pgmap v332: 97 pgs: 97 active+clean; 639 KiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-10T22:26:00.194 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:25:59 smithi019 ceph-mon[31375]: from='client.? 172.21.15.19:0/1649166513' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-10T22:26:00.360 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:25:59 smithi135 ceph-mon[34789]: pgmap v332: 97 pgs: 97 active+clean; 639 KiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-10T22:26:00.360 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:25:59 smithi135 ceph-mon[34789]: from='client.? 172.21.15.19:0/1649166513' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-10T22:26:00.375 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:25:59 smithi138 ceph-mon[35236]: pgmap v332: 97 pgs: 97 active+clean; 639 KiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-10T22:26:00.375 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:25:59 smithi138 ceph-mon[35236]: from='client.? 172.21.15.19:0/1649166513' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-10T22:26:00.562 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:00.560+0000 7fb7997e1640 1 -- 172.21.15.19:0/2206816805 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb79410d140 msgr2=0x7fb79410f5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:26:00.562 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:00.560+0000 7fb7997e1640 1 --2- 172.21.15.19:0/2206816805 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb79410d140 0x7fb79410f5a0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7fb78c009ca0 tx=0x7fb78c02a8c0 comp rx=0 tx=0).stop 2024-09-10T22:26:00.562 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:00.560+0000 7fb7997e1640 1 -- 172.21.15.19:0/2206816805 shutdown_connections 2024-09-10T22:26:00.562 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:00.560+0000 7fb7997e1640 1 --2- 172.21.15.19:0/2206816805 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb79410d140 0x7fb79410f5a0 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:26:00.562 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:00.560+0000 7fb7997e1640 1 --2- 172.21.15.19:0/2206816805 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb794104600 0x7fb79410caf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:26:00.562 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:00.560+0000 7fb7997e1640 1 --2- 172.21.15.19:0/2206816805 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb794103ce0 0x7fb7941040c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:26:00.562 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:00.560+0000 7fb7997e1640 1 -- 172.21.15.19:0/2206816805 >> 172.21.15.19:0/2206816805 conn(0x7fb7940fd700 msgr2=0x7fb7940ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:26:00.563 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:00.560+0000 7fb7997e1640 1 -- 172.21.15.19:0/2206816805 shutdown_connections 2024-09-10T22:26:00.563 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:00.560+0000 7fb7997e1640 1 -- 172.21.15.19:0/2206816805 wait complete. 2024-09-10T22:26:00.563 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:00.560+0000 7fb7997e1640 1 Processor -- start 2024-09-10T22:26:00.563 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:00.561+0000 7fb7997e1640 1 -- start start 2024-09-10T22:26:00.564 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:00.561+0000 7fb7997e1640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb794103ce0 0x7fb794199200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:26:00.564 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:00.561+0000 7fb7997e1640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb794104600 0x7fb794199740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:26:00.564 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:00.561+0000 7fb7997e1640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb79410d140 0x7fb79419eae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:26:00.565 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:00.561+0000 7fb7997e1640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fb794112db0 con 0x7fb794104600 2024-09-10T22:26:00.565 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:00.561+0000 7fb7997e1640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fb794112c30 con 0x7fb79410d140 2024-09-10T22:26:00.565 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:00.561+0000 7fb7997e1640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7fb794112f30 con 0x7fb794103ce0 2024-09-10T22:26:00.565 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:00.561+0000 7fb7927fc640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb794104600 0x7fb794199740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:26:00.565 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:00.561+0000 7fb7927fc640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb794104600 0x7fb794199740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:37542/0 (socket says 172.21.15.19:37542) 2024-09-10T22:26:00.565 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:00.561+0000 7fb7927fc640 1 -- 172.21.15.19:0/3079076834 learned_addr learned my addr 172.21.15.19:0/3079076834 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:26:00.565 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:00.561+0000 7fb7937fe640 1 --2- 172.21.15.19:0/3079076834 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb79410d140 0x7fb79419eae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:26:00.565 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:00.561+0000 7fb792ffd640 1 --2- 172.21.15.19:0/3079076834 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb794103ce0 0x7fb794199200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:26:00.565 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:00.561+0000 7fb7927fc640 1 -- 172.21.15.19:0/3079076834 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb794103ce0 msgr2=0x7fb794199200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:26:00.565 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:00.561+0000 7fb7927fc640 1 --2- 172.21.15.19:0/3079076834 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb794103ce0 0x7fb794199200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:26:00.565 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:00.561+0000 7fb7927fc640 1 -- 172.21.15.19:0/3079076834 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb79410d140 msgr2=0x7fb79419eae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:26:00.565 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:00.561+0000 7fb7927fc640 1 --2- 172.21.15.19:0/3079076834 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb79410d140 0x7fb79419eae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:26:00.566 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:00.561+0000 7fb7927fc640 1 -- 172.21.15.19:0/3079076834 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb79419f2b0 con 0x7fb794104600 2024-09-10T22:26:00.566 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:00.562+0000 7fb7927fc640 1 --2- 172.21.15.19:0/3079076834 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb794104600 0x7fb794199740 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7fb78800c970 tx=0x7fb78800ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:26:00.566 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:00.562+0000 7fb77bfff640 1 -- 172.21.15.19:0/3079076834 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb788007bb0 con 0x7fb794104600 2024-09-10T22:26:00.566 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:00.562+0000 7fb77bfff640 1 -- 172.21.15.19:0/3079076834 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb788007d50 con 0x7fb794104600 2024-09-10T22:26:00.566 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:00.562+0000 7fb77bfff640 1 -- 172.21.15.19:0/3079076834 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb78800f7b0 con 0x7fb794104600 2024-09-10T22:26:00.566 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:00.562+0000 7fb7997e1640 1 -- 172.21.15.19:0/3079076834 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb79419f5a0 con 0x7fb794104600 2024-09-10T22:26:00.566 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:00.562+0000 7fb7997e1640 1 -- 172.21.15.19:0/3079076834 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb7941a5c60 con 0x7fb794104600 2024-09-10T22:26:00.571 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:00.564+0000 7fb79bbb6740 1 Processor -- start 2024-09-10T22:26:00.571 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:00.565+0000 7fb77bfff640 1 -- 172.21.15.19:0/3079076834 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 17) ==== 153301+0+0 (secure 0 0 0) 0x7fb788018480 con 0x7fb794104600 2024-09-10T22:26:00.571 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:00.565+0000 7fb79bbb6740 1 -- start start 2024-09-10T22:26:00.571 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:00.565+0000 7fb79bbb6740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562e9c8b0d30 0x562e9c8b1110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:26:00.571 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:00.565+0000 7fb79bbb6740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x562e9c8b1650 0x562e9c8bd0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:26:00.571 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:00.565+0000 7fb79bbb6740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x562e9c8bd5e0 0x562e9c8bf9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:26:00.571 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:00.565+0000 7fb79bbb6740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x562e9c828c10 con 0x562e9c8bd5e0 2024-09-10T22:26:00.572 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:00.565+0000 7fb79bbb6740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x562e9c818040 con 0x562e9c8b0d30 2024-09-10T22:26:00.572 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:00.565+0000 7fb79bbb6740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x562e9c81be50 con 0x562e9c8b1650 2024-09-10T22:26:00.572 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:00.565+0000 7fb7927fc640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x562e9c8bd5e0 0x562e9c8bf9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:26:00.572 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:00.565+0000 7fb7927fc640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x562e9c8bd5e0 0x562e9c8bf9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:37546/0 (socket says 172.21.15.19:37546) 2024-09-10T22:26:00.572 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:00.565+0000 7fb7927fc640 1 -- 172.21.15.19:0/2603500250 learned_addr learned my addr 172.21.15.19:0/2603500250 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:26:00.572 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:00.565+0000 7fb7937fe640 1 --2- 172.21.15.19:0/2603500250 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562e9c8b0d30 0x562e9c8b1110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:26:00.572 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:00.565+0000 7fb792ffd640 1 --2- 172.21.15.19:0/2603500250 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x562e9c8b1650 0x562e9c8bd0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:26:00.572 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:00.565+0000 7fb7927fc640 1 -- 172.21.15.19:0/2603500250 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x562e9c8b1650 msgr2=0x562e9c8bd0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:26:00.572 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:00.565+0000 7fb7927fc640 1 --2- 172.21.15.19:0/2603500250 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x562e9c8b1650 0x562e9c8bd0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:26:00.572 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:00.565+0000 7fb7927fc640 1 -- 172.21.15.19:0/2603500250 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562e9c8b0d30 msgr2=0x562e9c8b1110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:26:00.572 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:00.565+0000 7fb7927fc640 1 --2- 172.21.15.19:0/2603500250 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562e9c8b0d30 0x562e9c8b1110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:26:00.573 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:00.566+0000 7fb7927fc640 1 -- 172.21.15.19:0/2603500250 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562e9c576540 con 0x562e9c8bd5e0 2024-09-10T22:26:00.573 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:00.566+0000 7fb792ffd640 1 --2- 172.21.15.19:0/2603500250 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x562e9c8b1650 0x562e9c8bd0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T22:26:00.573 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:00.566+0000 7fb77bfff640 1 --2- 172.21.15.19:0/3079076834 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7fb77c0b5370 0x7fb77c0b7830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:26:00.573 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:00.566+0000 7fb7927fc640 1 --2- 172.21.15.19:0/2603500250 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x562e9c8bd5e0 0x562e9c8bf9d0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7fb7880ee480 tx=0x7fb7880ee570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=18387c84680c264c server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:26:00.573 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:00.566+0000 7fb7937fe640 1 --2- 172.21.15.19:0/3079076834 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7fb77c0b5370 0x7fb77c0b7830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:26:00.573 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:00.566+0000 7fb7797fa640 1 -- 172.21.15.19:0/2603500250 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7880a8df0 con 0x562e9c8bd5e0 2024-09-10T22:26:00.573 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:00.566+0000 7fb77bfff640 1 -- 172.21.15.19:0/3079076834 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8269+0+0 (secure 0 0 0) 0x7fb7880e60d0 con 0x7fb794104600 2024-09-10T22:26:00.573 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:00.566+0000 7fb7797fa640 1 -- 172.21.15.19:0/2603500250 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb7880ac2b0 con 0x562e9c8bd5e0 2024-09-10T22:26:00.573 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:00.566+0000 7fb7797fa640 1 -- 172.21.15.19:0/2603500250 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7880823f0 con 0x562e9c8bd5e0 2024-09-10T22:26:00.573 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:00.567+0000 7fb79bbb6740 1 -- 172.21.15.19:0/2603500250 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x562e9c8bd5e0 msgr2=0x562e9c8bf9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:26:00.573 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:00.567+0000 7fb7937fe640 1 --2- 172.21.15.19:0/3079076834 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7fb77c0b5370 0x7fb77c0b7830 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fb78c009430 tx=0x7fb78c005c30 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:26:00.573 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:00.567+0000 7fb79bbb6740 1 --2- 172.21.15.19:0/2603500250 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x562e9c8bd5e0 0x562e9c8bf9d0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7fb7880ee480 tx=0x7fb7880ee570 comp rx=0 tx=0).stop 2024-09-10T22:26:00.574 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:00.567+0000 7fb79bbb6740 1 -- 172.21.15.19:0/2603500250 shutdown_connections 2024-09-10T22:26:00.574 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:00.567+0000 7fb79bbb6740 1 --2- 172.21.15.19:0/2603500250 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x562e9c8bd5e0 0x562e9c8bf9d0 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:26:00.574 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:00.567+0000 7fb79bbb6740 1 --2- 172.21.15.19:0/2603500250 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x562e9c8b1650 0x562e9c8bd0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:26:00.574 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:00.567+0000 7fb79bbb6740 1 --2- 172.21.15.19:0/2603500250 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562e9c8b0d30 0x562e9c8b1110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:26:00.574 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:00.567+0000 7fb79bbb6740 1 -- 172.21.15.19:0/2603500250 >> 172.21.15.19:0/2603500250 conn(0x562e9c8aeb60 msgr2=0x562e9c8afd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:26:00.574 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:00.567+0000 7fb79bbb6740 1 -- 172.21.15.19:0/2603500250 shutdown_connections 2024-09-10T22:26:00.574 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:00.567+0000 7fb79bbb6740 1 -- 172.21.15.19:0/2603500250 wait complete. 2024-09-10T22:26:00.574 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:00.567+0000 7fb79bbb6740 1 -- start start 2024-09-10T22:26:00.574 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:00.567+0000 7fb79bbb6740 1 Processor -- start 2024-09-10T22:26:00.574 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:00.568+0000 7fb79bbb6740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x562e9c8b0d30 0x562e9c8ba510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:26:00.574 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:00.568+0000 7fb79bbb6740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x562e9c8b1650 0x562e9c8baa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:26:00.575 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:00.568+0000 7fb79bbb6740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562e9c8bd5e0 0x562e9c8baf90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:26:00.575 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:00.568+0000 7fb79bbb6740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x562e9c6795f0 con 0x562e9c8b0d30 2024-09-10T22:26:00.575 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:00.568+0000 7fb79bbb6740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x562e9c7b3010 con 0x562e9c8bd5e0 2024-09-10T22:26:00.575 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:00.568+0000 7fb79bbb6740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x562e9c8c4640 con 0x562e9c8b1650 2024-09-10T22:26:00.575 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:00.568+0000 7fb79bbb6740 10 client.0 _ll_register_callbacks cb 0x562e9c812340 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T22:26:00.575 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:00.568+0000 7fb792ffd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x562e9c8b0d30 0x562e9c8ba510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:26:00.575 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:00.568+0000 7fb792ffd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x562e9c8b0d30 0x562e9c8ba510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:37560/0 (socket says 172.21.15.19:37560) 2024-09-10T22:26:00.575 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:00.568+0000 7fb792ffd640 1 -- 172.21.15.19:0/1424475243 learned_addr learned my addr 172.21.15.19:0/1424475243 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:26:00.575 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:00.568+0000 7fb7927fc640 1 --2- 172.21.15.19:0/1424475243 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x562e9c8b1650 0x562e9c8baa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:26:00.575 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:00.568+0000 7fb7937fe640 1 --2- 172.21.15.19:0/1424475243 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562e9c8bd5e0 0x562e9c8baf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:26:00.575 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:00.568+0000 7fb792ffd640 1 -- 172.21.15.19:0/1424475243 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x562e9c8b1650 msgr2=0x562e9c8baa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:26:00.575 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:00.568+0000 7fb792ffd640 1 --2- 172.21.15.19:0/1424475243 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x562e9c8b1650 0x562e9c8baa50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:26:00.576 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:00.568+0000 7fb792ffd640 1 -- 172.21.15.19:0/1424475243 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562e9c8bd5e0 msgr2=0x562e9c8baf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:26:00.576 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:00.568+0000 7fb792ffd640 1 --2- 172.21.15.19:0/1424475243 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562e9c8bd5e0 0x562e9c8baf90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:26:00.576 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:00.568+0000 7fb792ffd640 1 -- 172.21.15.19:0/1424475243 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562e9c7e0a00 con 0x562e9c8b0d30 2024-09-10T22:26:00.576 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:00.568+0000 7fb792ffd640 1 --2- 172.21.15.19:0/1424475243 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x562e9c8b0d30 0x562e9c8ba510 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7fb78400be80 tx=0x7fb7840117b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=947b6fbe95df2c6a server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:26:00.576 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:00.568+0000 7fb776ff5640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-10T22:26:00.576 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:00.568+0000 7fb776ff5640 1 -- 172.21.15.19:0/1424475243 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb784005220 con 0x562e9c8b0d30 2024-09-10T22:26:00.576 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:00.568+0000 7fb776ff5640 1 -- 172.21.15.19:0/1424475243 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8269+0+0 (secure 0 0 0) 0x7fb7840053c0 con 0x562e9c8b0d30 2024-09-10T22:26:00.576 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:00.569+0000 7fb79bbb6740 1 -- 172.21.15.19:0/1424475243 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb7880ac2b0 con 0x562e9c8b0d30 2024-09-10T22:26:00.576 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:00.569+0000 7fb776ff5640 1 -- 172.21.15.19:0/1424475243 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fb784021070 con 0x562e9c8b0d30 2024-09-10T22:26:00.576 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:00.569+0000 7fb79bbb6740 10 client.15225 fetch_fsmap learned FSMap version 24 2024-09-10T22:26:00.576 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:00.569+0000 7fb79bbb6740 1 -- 172.21.15.19:0/1424475243 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x562e9c8d0220 con 0x562e9c8b0d30 2024-09-10T22:26:00.576 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:00.569+0000 7fb776ff5640 1 -- 172.21.15.19:0/1424475243 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb7880ac2b0 con 0x562e9c8b0d30 2024-09-10T22:26:00.577 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:00.569+0000 7fb776ff5640 1 -- 172.21.15.19:0/1424475243 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7fb78401b710 con 0x562e9c8b0d30 2024-09-10T22:26:00.577 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:00.569+0000 7fb79bbb6740 10 client.15225 fetch_fsmap finished waiting for FSMap version 24 2024-09-10T22:26:00.577 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:00.569+0000 7fb79bbb6740 10 client.15225 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-10T22:26:00.577 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:00.569+0000 7fb79bbb6740 20 client.15225 populate_metadata read hostname 'smithi019' 2024-09-10T22:26:00.577 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:00.569+0000 7fb79bbb6740 1 --2- 172.21.15.19:0/1424475243 >> [v2:172.21.15.138:6836/3353290042,v1:172.21.15.138:6837/3353290042] conn(0x562e9c8d2830 0x562e9c8d3ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:26:00.577 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:00.569+0000 7fb79bbb6740 4 client.15225 mds_command: new command op to 24553 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T22:26:00.577 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:00.569+0000 7fb79bbb6740 1 -- 172.21.15.19:0/1424475243 --> [v2:172.21.15.138:6836/3353290042,v1:172.21.15.138:6837/3353290042] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562e9c82ab60 con 0x562e9c8d2830 2024-09-10T22:26:00.577 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:00.570+0000 7fb7927fc640 1 --2- 172.21.15.19:0/1424475243 >> [v2:172.21.15.138:6836/3353290042,v1:172.21.15.138:6837/3353290042] conn(0x562e9c8d2830 0x562e9c8d3ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:26:00.577 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:00.570+0000 7fb7927fc640 1 --2- 172.21.15.19:0/1424475243 >> [v2:172.21.15.138:6836/3353290042,v1:172.21.15.138:6837/3353290042] conn(0x562e9c8d2830 0x562e9c8d3ca0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=8296312c9a964ddb server_cookie=c4f6334beb6dd0d8 in_seq=0 out_seq=0 2024-09-10T22:26:00.577 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:00.570+0000 7fb776ff5640 10 client.15225 ms_handle_connect on v2:172.21.15.138:6836/3353290042 2024-09-10T22:26:00.579 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:00.571+0000 7fb776ff5640 1 -- 172.21.15.19:0/1424475243 <== mds.2 v2:172.21.15.138:6836/3353290042 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x562e9c82ab60 con 0x562e9c8d2830 2024-09-10T22:26:00.579 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:00.571+0000 7fb776ff5640 10 client.15225 handle_command_reply: tid=0 2024-09-10T22:26:00.579 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:00.571+0000 7fb79bbb6740 1 client.15225 shutdown 2024-09-10T22:26:00.579 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:00.571+0000 7fb79bbb6740 1 -- 172.21.15.19:0/1424475243 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x562e9c8b0d30 msgr2=0x562e9c8ba510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:26:00.579 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:00.571+0000 7fb79bbb6740 1 --2- 172.21.15.19:0/1424475243 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x562e9c8b0d30 0x562e9c8ba510 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7fb78400be80 tx=0x7fb7840117b0 comp rx=0 tx=0).stop 2024-09-10T22:26:00.579 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:00.571+0000 7fb79bbb6740 1 -- 172.21.15.19:0/1424475243 shutdown_connections 2024-09-10T22:26:00.579 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:00.571+0000 7fb79bbb6740 1 --2- 172.21.15.19:0/1424475243 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562e9c8bd5e0 0x562e9c8baf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:26:00.579 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:00.571+0000 7fb79bbb6740 1 --2- 172.21.15.19:0/1424475243 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x562e9c8b1650 0x562e9c8baa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:26:00.579 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:00.571+0000 7fb79bbb6740 1 --2- 172.21.15.19:0/1424475243 >> [v2:172.21.15.138:6836/3353290042,v1:172.21.15.138:6837/3353290042] conn(0x562e9c8d2830 0x562e9c8d3ca0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:26:00.579 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:00.571+0000 7fb79bbb6740 1 --2- 172.21.15.19:0/1424475243 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x562e9c8b0d30 0x562e9c8ba510 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:26:00.580 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:00.571+0000 7fb79bbb6740 1 -- 172.21.15.19:0/1424475243 >> 172.21.15.19:0/1424475243 conn(0x562e9c8aeb60 msgr2=0x562e9c8b4700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:26:00.580 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:00.571+0000 7fb776ff5640 0 client.15225 ms_handle_reset on v2:172.21.15.138:6836/3353290042 2024-09-10T22:26:00.580 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:00.571+0000 7fb79bbb6740 1 -- 172.21.15.19:0/1424475243 shutdown_connections 2024-09-10T22:26:00.580 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:00.571+0000 7fb79bbb6740 1 -- 172.21.15.19:0/1424475243 wait complete. 2024-09-10T22:26:00.580 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:00.571+0000 7fb79bbb6740 20 client.15225 trim_cache size 0 max 16384 2024-09-10T22:26:00.591 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:00.589+0000 7fb79bbb6740 1 Processor -- start 2024-09-10T22:26:00.591 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:00.589+0000 7fb79bbb6740 1 -- start start 2024-09-10T22:26:00.591 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:00.589+0000 7fb79bbb6740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x562e9c8b0d30 0x562e9c8b4da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:26:00.592 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:00.589+0000 7fb79bbb6740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x562e9c8b1650 0x562e9c8d16e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:26:00.592 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:00.589+0000 7fb79bbb6740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562e9c8bd5e0 0x562e9c8b5780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:26:00.592 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:00.589+0000 7fb79bbb6740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x562e9c8d1fe0 con 0x562e9c8b1650 2024-09-10T22:26:00.592 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:00.589+0000 7fb79bbb6740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x562e9c8d26b0 con 0x562e9c8bd5e0 2024-09-10T22:26:00.592 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:00.589+0000 7fb79bbb6740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x562e9c8d2d80 con 0x562e9c8b0d30 2024-09-10T22:26:00.592 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:00.590+0000 7fb7927fc640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x562e9c8b1650 0x562e9c8d16e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:26:00.592 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:00.590+0000 7fb7927fc640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x562e9c8b1650 0x562e9c8d16e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:37570/0 (socket says 172.21.15.19:37570) 2024-09-10T22:26:00.592 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:00.590+0000 7fb7927fc640 1 -- 172.21.15.19:0/788961319 learned_addr learned my addr 172.21.15.19:0/788961319 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:26:00.592 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:00.590+0000 7fb792ffd640 1 --2- 172.21.15.19:0/788961319 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x562e9c8b0d30 0x562e9c8b4da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:26:00.592 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:00.590+0000 7fb7927fc640 1 -- 172.21.15.19:0/788961319 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x562e9c8b0d30 msgr2=0x562e9c8b4da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:26:00.592 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:00.590+0000 7fb7927fc640 1 --2- 172.21.15.19:0/788961319 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x562e9c8b0d30 0x562e9c8b4da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:26:00.592 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:00.590+0000 7fb7927fc640 1 -- 172.21.15.19:0/788961319 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562e9c8bd5e0 msgr2=0x562e9c8b5780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:26:00.593 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:00.590+0000 7fb7927fc640 1 --2- 172.21.15.19:0/788961319 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562e9c8bd5e0 0x562e9c8b5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:26:00.593 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:00.590+0000 7fb7927fc640 1 -- 172.21.15.19:0/788961319 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562e9c8af5e0 con 0x562e9c8b1650 2024-09-10T22:26:00.593 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:00.590+0000 7fb7927fc640 1 --2- 172.21.15.19:0/788961319 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x562e9c8b1650 0x562e9c8d16e0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7fb7880eea70 tx=0x7fb788018e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aef1267b786912d6 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:26:00.593 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:00.590+0000 7fb778ff9640 1 -- 172.21.15.19:0/788961319 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7880830f0 con 0x562e9c8b1650 2024-09-10T22:26:00.593 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:00.590+0000 7fb778ff9640 1 -- 172.21.15.19:0/788961319 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb7880ac2b0 con 0x562e9c8b1650 2024-09-10T22:26:00.593 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:00.590+0000 7fb778ff9640 1 -- 172.21.15.19:0/788961319 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb78807b030 con 0x562e9c8b1650 2024-09-10T22:26:00.596 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:00.591+0000 7fb79bbb6740 1 -- 172.21.15.19:0/788961319 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x562e9c8b1650 msgr2=0x562e9c8d16e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:26:00.596 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:00.591+0000 7fb79bbb6740 1 --2- 172.21.15.19:0/788961319 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x562e9c8b1650 0x562e9c8d16e0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7fb7880eea70 tx=0x7fb788018e00 comp rx=0 tx=0).stop 2024-09-10T22:26:00.596 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:00.591+0000 7fb79bbb6740 1 -- 172.21.15.19:0/788961319 shutdown_connections 2024-09-10T22:26:00.596 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:00.591+0000 7fb79bbb6740 1 --2- 172.21.15.19:0/788961319 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562e9c8bd5e0 0x562e9c8b5780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:26:00.596 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:00.591+0000 7fb79bbb6740 1 --2- 172.21.15.19:0/788961319 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x562e9c8b1650 0x562e9c8d16e0 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:26:00.596 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:00.591+0000 7fb79bbb6740 1 --2- 172.21.15.19:0/788961319 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x562e9c8b0d30 0x562e9c8b4da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:26:00.596 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:00.591+0000 7fb79bbb6740 1 -- 172.21.15.19:0/788961319 >> 172.21.15.19:0/788961319 conn(0x562e9c8aeb60 msgr2=0x562e9c8afbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:26:00.596 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:00.591+0000 7fb79bbb6740 1 -- 172.21.15.19:0/788961319 shutdown_connections 2024-09-10T22:26:00.597 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:00.591+0000 7fb79bbb6740 1 -- 172.21.15.19:0/788961319 wait complete. 2024-09-10T22:26:00.597 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:00.591+0000 7fb79bbb6740 1 -- start start 2024-09-10T22:26:00.597 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:00.591+0000 7fb79bbb6740 1 Processor -- start 2024-09-10T22:26:00.597 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:00.592+0000 7fb79bbb6740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562e9c8b0d30 0x562e9c8dbf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:26:00.597 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:00.592+0000 7fb79bbb6740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x562e9c8b1650 0x562e9c8dc440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:26:00.597 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:00.592+0000 7fb79bbb6740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x562e9c8bd5e0 0x562e9c8dc980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:26:00.597 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:00.592+0000 7fb79bbb6740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x562e9c8d3b20 con 0x562e9c8b1650 2024-09-10T22:26:00.597 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:00.592+0000 7fb79bbb6740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x562e9c8d3450 con 0x562e9c8b0d30 2024-09-10T22:26:00.597 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:00.592+0000 7fb79bbb6740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x562e9c8d41f0 con 0x562e9c8bd5e0 2024-09-10T22:26:00.597 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:00.592+0000 7fb79bbb6740 10 client.0 _ll_register_callbacks cb 0x7fb78400b3a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T22:26:00.597 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:00.592+0000 7fb7927fc640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x562e9c8b1650 0x562e9c8dc440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:26:00.597 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:00.592+0000 7fb7927fc640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x562e9c8b1650 0x562e9c8dc440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:37586/0 (socket says 172.21.15.19:37586) 2024-09-10T22:26:00.598 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:00.592+0000 7fb7927fc640 1 -- 172.21.15.19:0/2332940711 learned_addr learned my addr 172.21.15.19:0/2332940711 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:26:00.598 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:00.592+0000 7fb7937fe640 1 --2- 172.21.15.19:0/2332940711 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x562e9c8bd5e0 0x562e9c8dc980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:26:00.598 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:00.592+0000 7fb792ffd640 1 --2- 172.21.15.19:0/2332940711 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562e9c8b0d30 0x562e9c8dbf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:26:00.598 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:00.592+0000 7fb7927fc640 1 -- 172.21.15.19:0/2332940711 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x562e9c8bd5e0 msgr2=0x562e9c8dc980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:26:00.598 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:00.592+0000 7fb7927fc640 1 --2- 172.21.15.19:0/2332940711 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x562e9c8bd5e0 0x562e9c8dc980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:26:00.598 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:00.592+0000 7fb7927fc640 1 -- 172.21.15.19:0/2332940711 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562e9c8b0d30 msgr2=0x562e9c8dbf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:26:00.598 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:00.592+0000 7fb7927fc640 1 --2- 172.21.15.19:0/2332940711 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562e9c8b0d30 0x562e9c8dbf00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:26:00.598 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:00.592+0000 7fb7927fc640 1 -- 172.21.15.19:0/2332940711 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562e9c8d7180 con 0x562e9c8b1650 2024-09-10T22:26:00.598 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:00.592+0000 7fb7927fc640 1 --2- 172.21.15.19:0/2332940711 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x562e9c8b1650 0x562e9c8dc440 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7fb7880e3fe0 tx=0x7fb78800a4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4679c557af3020ae server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:26:00.598 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:00.592+0000 7fb776ff5640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-10T22:26:00.598 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:00.592+0000 7fb776ff5640 1 -- 172.21.15.19:0/2332940711 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7880abf10 con 0x562e9c8b1650 2024-09-10T22:26:00.598 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:00.592+0000 7fb776ff5640 1 -- 172.21.15.19:0/2332940711 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8269+0+0 (secure 0 0 0) 0x7fb788018a30 con 0x562e9c8b1650 2024-09-10T22:26:00.599 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:00.592+0000 7fb79bbb6740 1 -- 172.21.15.19:0/2332940711 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb7880ac2b0 con 0x562e9c8b1650 2024-09-10T22:26:00.599 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:00.593+0000 7fb776ff5640 1 -- 172.21.15.19:0/2332940711 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fb7880ac0f0 con 0x562e9c8b1650 2024-09-10T22:26:00.599 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:00.593+0000 7fb79bbb6740 10 client.15231 fetch_fsmap learned FSMap version 24 2024-09-10T22:26:00.599 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:00.593+0000 7fb79bbb6740 1 -- 172.21.15.19:0/2332940711 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x562e9c93f6c0 con 0x562e9c8b1650 2024-09-10T22:26:00.599 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:00.593+0000 7fb776ff5640 1 -- 172.21.15.19:0/2332940711 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb7880ac2b0 con 0x562e9c8b1650 2024-09-10T22:26:00.599 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:00.593+0000 7fb776ff5640 1 -- 172.21.15.19:0/2332940711 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7fb788085070 con 0x562e9c8b1650 2024-09-10T22:26:00.599 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:00.593+0000 7fb79bbb6740 10 client.15231 fetch_fsmap finished waiting for FSMap version 24 2024-09-10T22:26:00.599 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:00.593+0000 7fb79bbb6740 10 client.15231 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-10T22:26:00.599 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:00.593+0000 7fb79bbb6740 20 client.15231 populate_metadata read hostname 'smithi019' 2024-09-10T22:26:00.599 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:00.593+0000 7fb79bbb6740 1 --2- 172.21.15.19:0/2332940711 >> [v2:172.21.15.138:6836/3353290042,v1:172.21.15.138:6837/3353290042] conn(0x562e9c943ca0 0x562e9c9429b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:26:00.599 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:00.593+0000 7fb79bbb6740 4 client.15231 mds_command: new command op to 24553 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-10T22:26:00.599 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:00.593+0000 7fb79bbb6740 1 -- 172.21.15.19:0/2332940711 --> [v2:172.21.15.138:6836/3353290042,v1:172.21.15.138:6837/3353290042] -- command(tid 0: {"prefix": "status"}) -- 0x562e9c826610 con 0x562e9c943ca0 2024-09-10T22:26:00.600 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:00.594+0000 7fb792ffd640 1 --2- 172.21.15.19:0/2332940711 >> [v2:172.21.15.138:6836/3353290042,v1:172.21.15.138:6837/3353290042] conn(0x562e9c943ca0 0x562e9c9429b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:26:00.601 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:00.596+0000 7fb792ffd640 1 --2- 172.21.15.19:0/2332940711 >> [v2:172.21.15.138:6836/3353290042,v1:172.21.15.138:6837/3353290042] conn(0x562e9c943ca0 0x562e9c9429b0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=9f97b83ac523e14d server_cookie=610542b1bca9d4d in_seq=0 out_seq=0 2024-09-10T22:26:00.601 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:00.596+0000 7fb776ff5640 10 client.15231 ms_handle_connect on v2:172.21.15.138:6836/3353290042 2024-09-10T22:26:00.601 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:00.596+0000 7fb776ff5640 1 -- 172.21.15.19:0/2332940711 <== mds.2 v2:172.21.15.138:6836/3353290042 1 ==== command_reply(tid 0: 0 ) ==== 8+0+327 (crc 0 0 0) 0x562e9c826610 con 0x562e9c943ca0 2024-09-10T22:26:00.601 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:00.596+0000 7fb776ff5640 10 client.15231 handle_command_reply: tid=0 2024-09-10T22:26:00.601 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:00.596+0000 7fb79bbb6740 1 client.15231 shutdown 2024-09-10T22:26:00.601 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:00.596+0000 7fb79bbb6740 1 -- 172.21.15.19:0/2332940711 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x562e9c8b1650 msgr2=0x562e9c8dc440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:26:00.601 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:00.596+0000 7fb79bbb6740 1 --2- 172.21.15.19:0/2332940711 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x562e9c8b1650 0x562e9c8dc440 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7fb7880e3fe0 tx=0x7fb78800a4a0 comp rx=0 tx=0).stop 2024-09-10T22:26:00.601 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:00.596+0000 7fb79bbb6740 1 -- 172.21.15.19:0/2332940711 shutdown_connections 2024-09-10T22:26:00.601 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:00.596+0000 7fb79bbb6740 1 --2- 172.21.15.19:0/2332940711 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x562e9c8bd5e0 0x562e9c8dc980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:26:00.601 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:00.596+0000 7fb79bbb6740 1 --2- 172.21.15.19:0/2332940711 >> [v2:172.21.15.138:6836/3353290042,v1:172.21.15.138:6837/3353290042] conn(0x562e9c943ca0 0x562e9c9429b0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:26:00.601 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:00.596+0000 7fb79bbb6740 1 --2- 172.21.15.19:0/2332940711 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x562e9c8b1650 0x562e9c8dc440 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:26:00.601 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:00.596+0000 7fb79bbb6740 1 --2- 172.21.15.19:0/2332940711 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562e9c8b0d30 0x562e9c8dbf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:26:00.602 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:00.596+0000 7fb776ff5640 0 client.15231 ms_handle_reset on v2:172.21.15.138:6836/3353290042 2024-09-10T22:26:00.602 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:00.596+0000 7fb79bbb6740 1 -- 172.21.15.19:0/2332940711 >> 172.21.15.19:0/2332940711 conn(0x562e9c8aeb60 msgr2=0x562e9c8d16e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:26:00.602 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:00.596+0000 7fb79bbb6740 1 -- 172.21.15.19:0/2332940711 shutdown_connections 2024-09-10T22:26:00.602 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:00.597+0000 7fb79bbb6740 1 -- 172.21.15.19:0/2332940711 wait complete. 2024-09-10T22:26:00.602 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:00.597+0000 7fb79bbb6740 20 client.15231 trim_cache size 0 max 16384 2024-09-10T22:26:00.602 INFO:teuthology.orchestra.run.smithi019.stdout:{ 2024-09-10T22:26:00.602 INFO:teuthology.orchestra.run.smithi019.stdout: "cluster_fsid": "22997a4c-6fc2-11ef-bcea-c7b262605968", 2024-09-10T22:26:00.602 INFO:teuthology.orchestra.run.smithi019.stdout: "whoami": 2, 2024-09-10T22:26:00.602 INFO:teuthology.orchestra.run.smithi019.stdout: "id": 24553, 2024-09-10T22:26:00.602 INFO:teuthology.orchestra.run.smithi019.stdout: "want_state": "up:active", 2024-09-10T22:26:00.603 INFO:teuthology.orchestra.run.smithi019.stdout: "state": "up:active", 2024-09-10T22:26:00.603 INFO:teuthology.orchestra.run.smithi019.stdout: "fs_name": "cephfs", 2024-09-10T22:26:00.603 INFO:teuthology.orchestra.run.smithi019.stdout: "rank_uptime": 89.393360529000006, 2024-09-10T22:26:00.603 INFO:teuthology.orchestra.run.smithi019.stdout: "mdsmap_epoch": 24, 2024-09-10T22:26:00.603 INFO:teuthology.orchestra.run.smithi019.stdout: "osdmap_epoch": 75, 2024-09-10T22:26:00.603 INFO:teuthology.orchestra.run.smithi019.stdout: "osdmap_epoch_barrier": 73, 2024-09-10T22:26:00.603 INFO:teuthology.orchestra.run.smithi019.stdout: "uptime": 122.297508744 2024-09-10T22:26:00.603 INFO:teuthology.orchestra.run.smithi019.stdout:} 2024-09-10T22:26:00.604 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:00.597+0000 7fb7997e1640 1 -- 172.21.15.19:0/3079076834 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7fb77c0b5370 msgr2=0x7fb77c0b7830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:26:00.604 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:00.597+0000 7fb7997e1640 1 --2- 172.21.15.19:0/3079076834 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7fb77c0b5370 0x7fb77c0b7830 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fb78c009430 tx=0x7fb78c005c30 comp rx=0 tx=0).stop 2024-09-10T22:26:00.604 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:00.597+0000 7fb7997e1640 1 -- 172.21.15.19:0/3079076834 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb794104600 msgr2=0x7fb794199740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:26:00.604 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:00.597+0000 7fb7997e1640 1 --2- 172.21.15.19:0/3079076834 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb794104600 0x7fb794199740 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7fb78800c970 tx=0x7fb78800ce30 comp rx=0 tx=0).stop 2024-09-10T22:26:00.604 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:00.597+0000 7fb7997e1640 1 -- 172.21.15.19:0/3079076834 shutdown_connections 2024-09-10T22:26:00.604 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:00.597+0000 7fb7997e1640 1 --2- 172.21.15.19:0/3079076834 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7fb77c0b5370 0x7fb77c0b7830 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:26:00.604 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:00.597+0000 7fb7997e1640 1 --2- 172.21.15.19:0/3079076834 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb79410d140 0x7fb79419eae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:26:00.604 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:00.597+0000 7fb7997e1640 1 --2- 172.21.15.19:0/3079076834 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb794104600 0x7fb794199740 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:26:00.605 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:00.597+0000 7fb7997e1640 1 --2- 172.21.15.19:0/3079076834 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb794103ce0 0x7fb794199200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:26:00.605 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:00.597+0000 7fb7997e1640 1 -- 172.21.15.19:0/3079076834 >> 172.21.15.19:0/3079076834 conn(0x7fb7940fd700 msgr2=0x7fb79410f350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:26:00.605 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:00.597+0000 7fb7997e1640 1 -- 172.21.15.19:0/3079076834 shutdown_connections 2024-09-10T22:26:00.605 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:00.597+0000 7fb7997e1640 1 -- 172.21.15.19:0/3079076834 wait complete. 2024-09-10T22:26:01.507 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 22997a4c-6fc2-11ef-bcea-c7b262605968 -- ceph tell mds.i status 2024-09-10T22:26:01.786 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/22997a4c-6fc2-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T22:26:02.073 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:26:01 smithi019 ceph-mon[31375]: pgmap v333: 97 pgs: 97 active+clean; 639 KiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-09-10T22:26:02.276 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:02.261+0000 7fc64d33c640 1 -- 172.21.15.19:0/3764105992 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc648108040 msgr2=0x7fc64810e840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:26:02.276 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:02.261+0000 7fc64d33c640 1 --2- 172.21.15.19:0/3764105992 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc648108040 0x7fc64810e840 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7fc640009ca0 tx=0x7fc64002a8c0 comp rx=0 tx=0).stop 2024-09-10T22:26:02.277 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:02.261+0000 7fc64d33c640 1 -- 172.21.15.19:0/3764105992 shutdown_connections 2024-09-10T22:26:02.277 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:02.261+0000 7fc64d33c640 1 --2- 172.21.15.19:0/3764105992 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc648108040 0x7fc64810e840 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:26:02.277 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:02.261+0000 7fc64d33c640 1 --2- 172.21.15.19:0/3764105992 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc6481076c0 0x7fc648107b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:26:02.277 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:02.261+0000 7fc64d33c640 1 --2- 172.21.15.19:0/3764105992 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc648101cb0 0x7fc648102090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:26:02.277 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:02.261+0000 7fc64d33c640 1 -- 172.21.15.19:0/3764105992 >> 172.21.15.19:0/3764105992 conn(0x7fc6480fd700 msgr2=0x7fc6480ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:26:02.277 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:02.261+0000 7fc64d33c640 1 -- 172.21.15.19:0/3764105992 shutdown_connections 2024-09-10T22:26:02.277 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:02.261+0000 7fc64d33c640 1 -- 172.21.15.19:0/3764105992 wait complete. 2024-09-10T22:26:02.277 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:02.262+0000 7fc64d33c640 1 Processor -- start 2024-09-10T22:26:02.277 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:02.262+0000 7fc64d33c640 1 -- start start 2024-09-10T22:26:02.277 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:02.262+0000 7fc64d33c640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc648101cb0 0x7fc648199ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:26:02.277 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:02.262+0000 7fc64d33c640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc6481076c0 0x7fc64819a530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:26:02.277 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:02.262+0000 7fc64d33c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc648108040 0x7fc6481a5070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:26:02.277 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:02.262+0000 7fc64d33c640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fc648111d00 con 0x7fc648108040 2024-09-10T22:26:02.278 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:02.262+0000 7fc64d33c640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fc648111b80 con 0x7fc648101cb0 2024-09-10T22:26:02.278 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:02.262+0000 7fc64d33c640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7fc648111e80 con 0x7fc6481076c0 2024-09-10T22:26:02.278 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:02.262+0000 7fc6477fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc648108040 0x7fc6481a5070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:26:02.278 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:02.262+0000 7fc6477fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc648108040 0x7fc6481a5070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:37614/0 (socket says 172.21.15.19:37614) 2024-09-10T22:26:02.278 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:02.262+0000 7fc6477fe640 1 -- 172.21.15.19:0/2050980199 learned_addr learned my addr 172.21.15.19:0/2050980199 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:26:02.278 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:02.262+0000 7fc63ffff640 1 --2- 172.21.15.19:0/2050980199 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc6481076c0 0x7fc64819a530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:26:02.278 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:02.262+0000 7fc646ffd640 1 --2- 172.21.15.19:0/2050980199 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc648101cb0 0x7fc648199ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:26:02.278 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:02.262+0000 7fc6477fe640 1 -- 172.21.15.19:0/2050980199 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc6481076c0 msgr2=0x7fc64819a530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:26:02.278 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:02.262+0000 7fc6477fe640 1 --2- 172.21.15.19:0/2050980199 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc6481076c0 0x7fc64819a530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:26:02.278 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:02.262+0000 7fc6477fe640 1 -- 172.21.15.19:0/2050980199 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc648101cb0 msgr2=0x7fc648199ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:26:02.278 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:02.262+0000 7fc6477fe640 1 --2- 172.21.15.19:0/2050980199 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc648101cb0 0x7fc648199ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:26:02.278 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:02.262+0000 7fc6477fe640 1 -- 172.21.15.19:0/2050980199 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc6481a55b0 con 0x7fc648108040 2024-09-10T22:26:02.279 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:02.263+0000 7fc6477fe640 1 --2- 172.21.15.19:0/2050980199 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc648108040 0x7fc6481a5070 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7fc640005cc0 tx=0x7fc64002f380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:26:02.279 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:02.263+0000 7fc644ff9640 1 -- 172.21.15.19:0/2050980199 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc640003bf0 con 0x7fc648108040 2024-09-10T22:26:02.279 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:02.263+0000 7fc64d33c640 1 -- 172.21.15.19:0/2050980199 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc6481a5780 con 0x7fc648108040 2024-09-10T22:26:02.279 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:02.263+0000 7fc644ff9640 1 -- 172.21.15.19:0/2050980199 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc640003d90 con 0x7fc648108040 2024-09-10T22:26:02.279 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:02.263+0000 7fc644ff9640 1 -- 172.21.15.19:0/2050980199 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc64002fbc0 con 0x7fc648108040 2024-09-10T22:26:02.279 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:02.263+0000 7fc64d33c640 1 -- 172.21.15.19:0/2050980199 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc6481a5c60 con 0x7fc648108040 2024-09-10T22:26:02.279 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:02.266+0000 7fc64f711740 1 Processor -- start 2024-09-10T22:26:02.279 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:02.266+0000 7fc644ff9640 1 -- 172.21.15.19:0/2050980199 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 17) ==== 153301+0+0 (secure 0 0 0) 0x7fc640004610 con 0x7fc648108040 2024-09-10T22:26:02.279 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:02.266+0000 7fc64f711740 1 -- start start 2024-09-10T22:26:02.279 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:02.266+0000 7fc64f711740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556dfcf16140 0x556dfcf16520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:26:02.279 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:02.266+0000 7fc64f711740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x556dfcf16a60 0x556dfcf224b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:26:02.279 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:02.266+0000 7fc64f711740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x556dfcf229f0 0x556dfcf24de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:26:02.279 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:02.266+0000 7fc64f711740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x556dfce89c10 con 0x556dfcf16a60 2024-09-10T22:26:02.280 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:02.266+0000 7fc64f711740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x556dfce79040 con 0x556dfcf16140 2024-09-10T22:26:02.280 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:02.266+0000 7fc64f711740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x556dfce7ce50 con 0x556dfcf229f0 2024-09-10T22:26:02.280 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:02.266+0000 7fc646ffd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x556dfcf16a60 0x556dfcf224b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:26:02.280 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:02.266+0000 7fc646ffd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x556dfcf16a60 0x556dfcf224b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:37628/0 (socket says 172.21.15.19:37628) 2024-09-10T22:26:02.280 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:02.266+0000 7fc646ffd640 1 -- 172.21.15.19:0/1925431754 learned_addr learned my addr 172.21.15.19:0/1925431754 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:26:02.280 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:02.267+0000 7fc63ffff640 1 --2- 172.21.15.19:0/1925431754 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x556dfcf229f0 0x556dfcf24de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:26:02.280 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:02.267+0000 7fc63ffff640 1 --2- 172.21.15.19:0/1925431754 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556dfcf16140 0x556dfcf16520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:26:02.280 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:02.267+0000 7fc646ffd640 1 -- 172.21.15.19:0/1925431754 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x556dfcf229f0 msgr2=0x556dfcf24de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:26:02.280 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:02.267+0000 7fc646ffd640 1 --2- 172.21.15.19:0/1925431754 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x556dfcf229f0 0x556dfcf24de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:26:02.280 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:02.267+0000 7fc646ffd640 1 -- 172.21.15.19:0/1925431754 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556dfcf16140 msgr2=0x556dfcf16520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:26:02.280 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:02.267+0000 7fc646ffd640 1 --2- 172.21.15.19:0/1925431754 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556dfcf16140 0x556dfcf16520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:26:02.280 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:02.267+0000 7fc646ffd640 1 -- 172.21.15.19:0/1925431754 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556dfcbd7540 con 0x556dfcf16a60 2024-09-10T22:26:02.281 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:02.267+0000 7fc644ff9640 1 --2- 172.21.15.19:0/2050980199 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7fc6340b5370 0x7fc6340b7830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:26:02.281 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:02.267+0000 7fc646ffd640 1 --2- 172.21.15.19:0/1925431754 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x556dfcf16a60 0x556dfcf224b0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7fc63800b760 tx=0x7fc63800bc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1ce779e74e4b12b8 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:26:02.281 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:02.267+0000 7fc63ffff640 1 --2- 172.21.15.19:0/2050980199 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7fc6340b5370 0x7fc6340b7830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:26:02.281 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:02.267+0000 7fc644ff9640 1 -- 172.21.15.19:0/2050980199 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8269+0+0 (secure 0 0 0) 0x7fc6401071f0 con 0x7fc648108040 2024-09-10T22:26:02.281 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:02.267+0000 7fc63d7fa640 1 -- 172.21.15.19:0/1925431754 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc638003dd0 con 0x556dfcf16a60 2024-09-10T22:26:02.281 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:02.267+0000 7fc63d7fa640 1 -- 172.21.15.19:0/1925431754 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc638015070 con 0x556dfcf16a60 2024-09-10T22:26:02.281 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:02.267+0000 7fc63d7fa640 1 -- 172.21.15.19:0/1925431754 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc638004d90 con 0x556dfcf16a60 2024-09-10T22:26:02.281 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:02.268+0000 7fc64f711740 1 -- 172.21.15.19:0/1925431754 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x556dfcf16a60 msgr2=0x556dfcf224b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:26:02.281 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:02.268+0000 7fc64f711740 1 --2- 172.21.15.19:0/1925431754 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x556dfcf16a60 0x556dfcf224b0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7fc63800b760 tx=0x7fc63800bc20 comp rx=0 tx=0).stop 2024-09-10T22:26:02.281 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:02.268+0000 7fc63ffff640 1 --2- 172.21.15.19:0/2050980199 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7fc6340b5370 0x7fc6340b7830 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fc630005d00 tx=0x7fc63000b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:26:02.281 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:02.268+0000 7fc64f711740 1 -- 172.21.15.19:0/1925431754 shutdown_connections 2024-09-10T22:26:02.281 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:02.268+0000 7fc64f711740 1 --2- 172.21.15.19:0/1925431754 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x556dfcf229f0 0x556dfcf24de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:26:02.282 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:02.268+0000 7fc64f711740 1 --2- 172.21.15.19:0/1925431754 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x556dfcf16a60 0x556dfcf224b0 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:26:02.282 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:02.268+0000 7fc64f711740 1 --2- 172.21.15.19:0/1925431754 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556dfcf16140 0x556dfcf16520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:26:02.282 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:02.268+0000 7fc64f711740 1 -- 172.21.15.19:0/1925431754 >> 172.21.15.19:0/1925431754 conn(0x556dfcf13f70 msgr2=0x556dfcf15110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:26:02.282 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:02.268+0000 7fc64f711740 1 -- 172.21.15.19:0/1925431754 shutdown_connections 2024-09-10T22:26:02.282 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:02.268+0000 7fc64f711740 1 -- 172.21.15.19:0/1925431754 wait complete. 2024-09-10T22:26:02.282 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:02.269+0000 7fc64f711740 1 -- start start 2024-09-10T22:26:02.282 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:02.269+0000 7fc64f711740 1 Processor -- start 2024-09-10T22:26:02.282 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:02.269+0000 7fc64f711740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x556dfcf16140 0x556dfcf1f9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:26:02.282 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:02.269+0000 7fc64f711740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x556dfcf16a60 0x556dfcf1fee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:26:02.282 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:02.269+0000 7fc64f711740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556dfcf229f0 0x556dfcf20420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:26:02.282 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:02.269+0000 7fc64f711740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x556dfccda5f0 con 0x556dfcf16140 2024-09-10T22:26:02.282 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:02.269+0000 7fc64f711740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x556dfce14010 con 0x556dfcf229f0 2024-09-10T22:26:02.282 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:02.269+0000 7fc64f711740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x556dfcf25670 con 0x556dfcf16a60 2024-09-10T22:26:02.283 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:02.269+0000 7fc64f711740 10 client.0 _ll_register_callbacks cb 0x556dfce73340 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T22:26:02.283 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:02.269+0000 7fc646ffd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x556dfcf16140 0x556dfcf1f9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:26:02.283 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:02.269+0000 7fc646ffd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x556dfcf16140 0x556dfcf1f9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:37640/0 (socket says 172.21.15.19:37640) 2024-09-10T22:26:02.283 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:02.269+0000 7fc646ffd640 1 -- 172.21.15.19:0/573900932 learned_addr learned my addr 172.21.15.19:0/573900932 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:26:02.283 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:02.269+0000 7fc6477fe640 1 --2- 172.21.15.19:0/573900932 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556dfcf229f0 0x556dfcf20420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:26:02.283 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:02.269+0000 7fc646ffd640 1 -- 172.21.15.19:0/573900932 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x556dfcf16a60 msgr2=0x556dfcf1fee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:26:02.283 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:02.269+0000 7fc63ffff640 1 --2- 172.21.15.19:0/573900932 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x556dfcf16a60 0x556dfcf1fee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:26:02.283 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:02.269+0000 7fc646ffd640 1 --2- 172.21.15.19:0/573900932 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x556dfcf16a60 0x556dfcf1fee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:26:02.283 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:02.270+0000 7fc646ffd640 1 -- 172.21.15.19:0/573900932 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556dfcf229f0 msgr2=0x556dfcf20420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:26:02.283 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:02.270+0000 7fc646ffd640 1 --2- 172.21.15.19:0/573900932 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556dfcf229f0 0x556dfcf20420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:26:02.283 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:02.270+0000 7fc646ffd640 1 -- 172.21.15.19:0/573900932 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556dfce41a00 con 0x556dfcf16140 2024-09-10T22:26:02.283 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:02.270+0000 7fc6477fe640 1 --2- 172.21.15.19:0/573900932 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556dfcf229f0 0x556dfcf20420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T22:26:02.283 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:02.270+0000 7fc63ffff640 1 --2- 172.21.15.19:0/573900932 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x556dfcf16a60 0x556dfcf1fee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T22:26:02.284 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:02.270+0000 7fc646ffd640 1 --2- 172.21.15.19:0/573900932 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x556dfcf16140 0x556dfcf1f9a0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7fc638006010 tx=0x7fc638003e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f46afc2465f75ce6 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:26:02.284 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:02.270+0000 7fc62e7fc640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-10T22:26:02.284 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:02.270+0000 7fc62e7fc640 1 -- 172.21.15.19:0/573900932 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6380046c0 con 0x556dfcf16140 2024-09-10T22:26:02.284 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:02.270+0000 7fc64f711740 1 -- 172.21.15.19:0/573900932 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc638015070 con 0x556dfcf16140 2024-09-10T22:26:02.284 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:02.270+0000 7fc62e7fc640 1 -- 172.21.15.19:0/573900932 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8269+0+0 (secure 0 0 0) 0x7fc638011650 con 0x556dfcf16140 2024-09-10T22:26:02.284 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:02.270+0000 7fc62e7fc640 1 -- 172.21.15.19:0/573900932 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fc638011850 con 0x556dfcf16140 2024-09-10T22:26:02.284 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:02.270+0000 7fc64f711740 10 client.15243 fetch_fsmap learned FSMap version 24 2024-09-10T22:26:02.284 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:02.270+0000 7fc64f711740 1 -- 172.21.15.19:0/573900932 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x556dfcf31210 con 0x556dfcf16140 2024-09-10T22:26:02.284 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:02.270+0000 7fc62e7fc640 1 -- 172.21.15.19:0/573900932 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc638015070 con 0x556dfcf16140 2024-09-10T22:26:02.284 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:02.270+0000 7fc62e7fc640 1 -- 172.21.15.19:0/573900932 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7fc6380258d0 con 0x556dfcf16140 2024-09-10T22:26:02.284 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:02.271+0000 7fc64f711740 10 client.15243 fetch_fsmap finished waiting for FSMap version 24 2024-09-10T22:26:02.284 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:02.271+0000 7fc64f711740 10 client.15243 resolve_mds: resolved name 'i' to daemon mds.i 2024-09-10T22:26:02.284 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:02.271+0000 7fc64f711740 20 client.15243 populate_metadata read hostname 'smithi019' 2024-09-10T22:26:02.285 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:02.271+0000 7fc64f711740 1 --2- 172.21.15.19:0/573900932 >> [v2:172.21.15.138:6838/383637208,v1:172.21.15.138:6839/383637208] conn(0x556dfcf33600 0x556dfcf34a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:26:02.285 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:02.271+0000 7fc64f711740 4 client.15243 mds_command: new command op to 24568 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T22:26:02.285 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:02.271+0000 7fc64f711740 1 -- 172.21.15.19:0/573900932 --> [v2:172.21.15.138:6838/383637208,v1:172.21.15.138:6839/383637208] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x556dfce8bb60 con 0x556dfcf33600 2024-09-10T22:26:02.285 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:02.271+0000 7fc63ffff640 1 --2- 172.21.15.19:0/573900932 >> [v2:172.21.15.138:6838/383637208,v1:172.21.15.138:6839/383637208] conn(0x556dfcf33600 0x556dfcf34a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:26:02.285 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:02.271+0000 7fc62e7fc640 10 client.15243 ms_handle_connect on v2:172.21.15.138:6838/383637208 2024-09-10T22:26:02.285 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:02.271+0000 7fc63ffff640 1 --2- 172.21.15.19:0/573900932 >> [v2:172.21.15.138:6838/383637208,v1:172.21.15.138:6839/383637208] conn(0x556dfcf33600 0x556dfcf34a70 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=a76bda3e15dd88d8 server_cookie=d3f6c6938cf64b0c in_seq=0 out_seq=0 2024-09-10T22:26:02.285 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:02.272+0000 7fc62e7fc640 1 -- 172.21.15.19:0/573900932 <== mds.1 v2:172.21.15.138:6838/383637208 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x556dfce8bb60 con 0x556dfcf33600 2024-09-10T22:26:02.285 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:02.272+0000 7fc62e7fc640 10 client.15243 handle_command_reply: tid=0 2024-09-10T22:26:02.285 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:02.272+0000 7fc64f711740 1 client.15243 shutdown 2024-09-10T22:26:02.285 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:02.272+0000 7fc64f711740 1 -- 172.21.15.19:0/573900932 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x556dfcf16140 msgr2=0x556dfcf1f9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:26:02.285 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:02.272+0000 7fc64f711740 1 --2- 172.21.15.19:0/573900932 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x556dfcf16140 0x556dfcf1f9a0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7fc638006010 tx=0x7fc638003e00 comp rx=0 tx=0).stop 2024-09-10T22:26:02.285 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:02.272+0000 7fc64f711740 1 -- 172.21.15.19:0/573900932 shutdown_connections 2024-09-10T22:26:02.285 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:02.272+0000 7fc64f711740 1 --2- 172.21.15.19:0/573900932 >> [v2:172.21.15.138:6838/383637208,v1:172.21.15.138:6839/383637208] conn(0x556dfcf33600 0x556dfcf34a70 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:26:02.286 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:02.272+0000 7fc62e7fc640 0 client.15243 ms_handle_reset on v2:172.21.15.138:6838/383637208 2024-09-10T22:26:02.286 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:02.272+0000 7fc64f711740 1 --2- 172.21.15.19:0/573900932 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556dfcf229f0 0x556dfcf20420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:26:02.286 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:02.272+0000 7fc64f711740 1 --2- 172.21.15.19:0/573900932 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x556dfcf16a60 0x556dfcf1fee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:26:02.286 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:02.272+0000 7fc64f711740 1 --2- 172.21.15.19:0/573900932 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x556dfcf16140 0x556dfcf1f9a0 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:26:02.286 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:02.272+0000 7fc64f711740 1 -- 172.21.15.19:0/573900932 >> 172.21.15.19:0/573900932 conn(0x556dfcf13f70 msgr2=0x556dfcf0ed00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:26:02.286 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:02.272+0000 7fc64f711740 1 -- 172.21.15.19:0/573900932 shutdown_connections 2024-09-10T22:26:02.286 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:02.273+0000 7fc64f711740 1 -- 172.21.15.19:0/573900932 wait complete. 2024-09-10T22:26:02.286 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:02.273+0000 7fc64f711740 20 client.15243 trim_cache size 0 max 16384 2024-09-10T22:26:02.293 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:02.292+0000 7fc64f711740 1 Processor -- start 2024-09-10T22:26:02.293 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:02.292+0000 7fc64f711740 1 -- start start 2024-09-10T22:26:02.295 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:02.292+0000 7fc64f711740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x556dfcf16140 0x556dfcf1a1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:26:02.295 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:02.292+0000 7fc64f711740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x556dfcf16a60 0x556dfcf150a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:26:02.295 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:02.292+0000 7fc64f711740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556dfcf229f0 0x556dfcf155e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:26:02.295 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:02.292+0000 7fc64f711740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x556dfcf32db0 con 0x556dfcf16a60 2024-09-10T22:26:02.295 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:02.292+0000 7fc64f711740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x556dfcf33480 con 0x556dfcf229f0 2024-09-10T22:26:02.296 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:02.292+0000 7fc64f711740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x556dfcf33b50 con 0x556dfcf16140 2024-09-10T22:26:02.296 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:02.292+0000 7fc63ffff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x556dfcf16a60 0x556dfcf150a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:26:02.296 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:02.292+0000 7fc63ffff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x556dfcf16a60 0x556dfcf150a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:37650/0 (socket says 172.21.15.19:37650) 2024-09-10T22:26:02.296 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:02.292+0000 7fc63ffff640 1 -- 172.21.15.19:0/2406640288 learned_addr learned my addr 172.21.15.19:0/2406640288 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:26:02.296 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:02.292+0000 7fc646ffd640 1 --2- 172.21.15.19:0/2406640288 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x556dfcf16140 0x556dfcf1a1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:26:02.296 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:02.292+0000 7fc6477fe640 1 --2- 172.21.15.19:0/2406640288 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556dfcf229f0 0x556dfcf155e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:26:02.296 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:02.292+0000 7fc63ffff640 1 -- 172.21.15.19:0/2406640288 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x556dfcf16140 msgr2=0x556dfcf1a1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:26:02.296 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:02.292+0000 7fc63ffff640 1 --2- 172.21.15.19:0/2406640288 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x556dfcf16140 0x556dfcf1a1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:26:02.296 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:02.292+0000 7fc63ffff640 1 -- 172.21.15.19:0/2406640288 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556dfcf229f0 msgr2=0x556dfcf155e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:26:02.296 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:02.293+0000 7fc63ffff640 1 --2- 172.21.15.19:0/2406640288 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556dfcf229f0 0x556dfcf155e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:26:02.296 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:02.293+0000 7fc63ffff640 1 -- 172.21.15.19:0/2406640288 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556dfcf149f0 con 0x556dfcf16a60 2024-09-10T22:26:02.296 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:02.293+0000 7fc63ffff640 1 --2- 172.21.15.19:0/2406640288 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x556dfcf16a60 0x556dfcf150a0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7fc64806c090 tx=0x7fc630004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c260ea2147d5e869 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:26:02.297 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:02.293+0000 7fc63cff9640 1 -- 172.21.15.19:0/2406640288 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc63001f450 con 0x556dfcf16a60 2024-09-10T22:26:02.297 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:02.293+0000 7fc63cff9640 1 -- 172.21.15.19:0/2406640288 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc63001faa0 con 0x556dfcf16a60 2024-09-10T22:26:02.297 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:02.293+0000 7fc63cff9640 1 -- 172.21.15.19:0/2406640288 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc630031ad0 con 0x556dfcf16a60 2024-09-10T22:26:02.297 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:02.294+0000 7fc64f711740 1 -- 172.21.15.19:0/2406640288 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x556dfcf16a60 msgr2=0x556dfcf150a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:26:02.297 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:02.294+0000 7fc64f711740 1 --2- 172.21.15.19:0/2406640288 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x556dfcf16a60 0x556dfcf150a0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7fc64806c090 tx=0x7fc630004730 comp rx=0 tx=0).stop 2024-09-10T22:26:02.297 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:02.294+0000 7fc64f711740 1 -- 172.21.15.19:0/2406640288 shutdown_connections 2024-09-10T22:26:02.297 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:02.294+0000 7fc64f711740 1 --2- 172.21.15.19:0/2406640288 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556dfcf229f0 0x556dfcf155e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:26:02.297 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:02.294+0000 7fc64f711740 1 --2- 172.21.15.19:0/2406640288 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x556dfcf16a60 0x556dfcf150a0 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:26:02.297 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:02.294+0000 7fc64f711740 1 --2- 172.21.15.19:0/2406640288 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x556dfcf16140 0x556dfcf1a1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:26:02.297 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:02.294+0000 7fc64f711740 1 -- 172.21.15.19:0/2406640288 >> 172.21.15.19:0/2406640288 conn(0x556dfcf13f70 msgr2=0x556dfcf32610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:26:02.297 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:02.294+0000 7fc64f711740 1 -- 172.21.15.19:0/2406640288 shutdown_connections 2024-09-10T22:26:02.297 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:02.294+0000 7fc64f711740 1 -- 172.21.15.19:0/2406640288 wait complete. 2024-09-10T22:26:02.298 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:02.294+0000 7fc64f711740 1 -- start start 2024-09-10T22:26:02.298 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:02.294+0000 7fc64f711740 1 Processor -- start 2024-09-10T22:26:02.300 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:02.295+0000 7fc64f711740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x556dfcf16140 0x556dfcf36db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:26:02.301 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:02.295+0000 7fc64f711740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556dfcf16a60 0x556dfcf372f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:26:02.301 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:02.295+0000 7fc64f711740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x556dfcf229f0 0x556dfcf37830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:26:02.301 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:02.295+0000 7fc64f711740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x556dfcf348f0 con 0x556dfcf16140 2024-09-10T22:26:02.301 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:02.295+0000 7fc64f711740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x556dfcf34220 con 0x556dfcf16a60 2024-09-10T22:26:02.301 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:02.295+0000 7fc64f711740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x556dfcf34fc0 con 0x556dfcf229f0 2024-09-10T22:26:02.301 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:02.295+0000 7fc64f711740 10 client.0 _ll_register_callbacks cb 0x7fc63000b7c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T22:26:02.301 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:02.295+0000 7fc646ffd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x556dfcf16140 0x556dfcf36db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:26:02.301 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:02.295+0000 7fc646ffd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x556dfcf16140 0x556dfcf36db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:37654/0 (socket says 172.21.15.19:37654) 2024-09-10T22:26:02.301 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:02.295+0000 7fc646ffd640 1 -- 172.21.15.19:0/1429653614 learned_addr learned my addr 172.21.15.19:0/1429653614 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:26:02.301 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:02.295+0000 7fc63ffff640 1 --2- 172.21.15.19:0/1429653614 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556dfcf16a60 0x556dfcf372f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:26:02.301 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:02.295+0000 7fc6477fe640 1 --2- 172.21.15.19:0/1429653614 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x556dfcf229f0 0x556dfcf37830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:26:02.301 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:02.295+0000 7fc646ffd640 1 -- 172.21.15.19:0/1429653614 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x556dfcf229f0 msgr2=0x556dfcf37830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:26:02.301 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:02.295+0000 7fc646ffd640 1 --2- 172.21.15.19:0/1429653614 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x556dfcf229f0 0x556dfcf37830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:26:02.302 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:02.295+0000 7fc646ffd640 1 -- 172.21.15.19:0/1429653614 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556dfcf16a60 msgr2=0x556dfcf372f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:26:02.302 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:02.295+0000 7fc646ffd640 1 --2- 172.21.15.19:0/1429653614 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556dfcf16a60 0x556dfcf372f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:26:02.302 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:02.295+0000 7fc646ffd640 1 -- 172.21.15.19:0/1429653614 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556dfcf3c6c0 con 0x556dfcf16140 2024-09-10T22:26:02.302 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:02.295+0000 7fc63ffff640 1 --2- 172.21.15.19:0/1429653614 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556dfcf16a60 0x556dfcf372f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T22:26:02.302 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:02.295+0000 7fc6477fe640 1 --2- 172.21.15.19:0/1429653614 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x556dfcf229f0 0x556dfcf37830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T22:26:02.302 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:02.295+0000 7fc646ffd640 1 --2- 172.21.15.19:0/1429653614 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x556dfcf16140 0x556dfcf36db0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7fc63800c010 tx=0x7fc63800b410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4d142c0f9a65562 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:26:02.302 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:02.295+0000 7fc62e7fc640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-10T22:26:02.302 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:02.295+0000 7fc62e7fc640 1 -- 172.21.15.19:0/1429653614 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc638034070 con 0x556dfcf16140 2024-09-10T22:26:02.302 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:02.295+0000 7fc62e7fc640 1 -- 172.21.15.19:0/1429653614 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8269+0+0 (secure 0 0 0) 0x7fc638003e70 con 0x556dfcf16140 2024-09-10T22:26:02.302 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:02.295+0000 7fc64f711740 1 -- 172.21.15.19:0/1429653614 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc63001faa0 con 0x556dfcf16140 2024-09-10T22:26:02.302 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:02.296+0000 7fc62e7fc640 1 -- 172.21.15.19:0/1429653614 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fc6380119f0 con 0x556dfcf16140 2024-09-10T22:26:02.302 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:02.296+0000 7fc64f711740 10 client.15249 fetch_fsmap learned FSMap version 24 2024-09-10T22:26:02.302 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:02.296+0000 7fc64f711740 1 -- 172.21.15.19:0/1429653614 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x556dfcfa03b0 con 0x556dfcf16140 2024-09-10T22:26:02.302 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:02.296+0000 7fc62e7fc640 1 -- 172.21.15.19:0/1429653614 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc63001faa0 con 0x556dfcf16140 2024-09-10T22:26:02.303 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:02.296+0000 7fc62e7fc640 1 -- 172.21.15.19:0/1429653614 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7fc638025430 con 0x556dfcf16140 2024-09-10T22:26:02.303 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:02.296+0000 7fc64f711740 10 client.15249 fetch_fsmap finished waiting for FSMap version 24 2024-09-10T22:26:02.303 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:02.296+0000 7fc64f711740 10 client.15249 resolve_mds: resolved name 'i' to daemon mds.i 2024-09-10T22:26:02.303 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:02.296+0000 7fc64f711740 20 client.15249 populate_metadata read hostname 'smithi019' 2024-09-10T22:26:02.303 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:02.296+0000 7fc64f711740 1 --2- 172.21.15.19:0/1429653614 >> [v2:172.21.15.138:6838/383637208,v1:172.21.15.138:6839/383637208] conn(0x556dfcf33600 0x556dfcfa3c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:26:02.303 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:02.296+0000 7fc64f711740 4 client.15249 mds_command: new command op to 24568 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-10T22:26:02.303 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:02.296+0000 7fc64f711740 1 -- 172.21.15.19:0/1429653614 --> [v2:172.21.15.138:6838/383637208,v1:172.21.15.138:6839/383637208] -- command(tid 0: {"prefix": "status"}) -- 0x556dfce87610 con 0x556dfcf33600 2024-09-10T22:26:02.303 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:02.297+0000 7fc63ffff640 1 --2- 172.21.15.19:0/1429653614 >> [v2:172.21.15.138:6838/383637208,v1:172.21.15.138:6839/383637208] conn(0x556dfcf33600 0x556dfcfa3c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:26:02.303 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:02.297+0000 7fc62e7fc640 10 client.15249 ms_handle_connect on v2:172.21.15.138:6838/383637208 2024-09-10T22:26:02.303 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:02.297+0000 7fc63ffff640 1 --2- 172.21.15.19:0/1429653614 >> [v2:172.21.15.138:6838/383637208,v1:172.21.15.138:6839/383637208] conn(0x556dfcf33600 0x556dfcfa3c50 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=d5819ed78bc39c49 server_cookie=80c98b3edc858b36 in_seq=0 out_seq=0 2024-09-10T22:26:02.303 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:02.297+0000 7fc62e7fc640 1 -- 172.21.15.19:0/1429653614 <== mds.1 v2:172.21.15.138:6838/383637208 1 ==== command_reply(tid 0: 0 ) ==== 8+0+327 (crc 0 0 0) 0x556dfce87610 con 0x556dfcf33600 2024-09-10T22:26:02.303 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:02.297+0000 7fc62e7fc640 10 client.15249 handle_command_reply: tid=0 2024-09-10T22:26:02.303 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:02.297+0000 7fc64f711740 1 client.15249 shutdown 2024-09-10T22:26:02.304 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:02.297+0000 7fc64f711740 1 -- 172.21.15.19:0/1429653614 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x556dfcf16140 msgr2=0x556dfcf36db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:26:02.304 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:02.298+0000 7fc64f711740 1 --2- 172.21.15.19:0/1429653614 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x556dfcf16140 0x556dfcf36db0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7fc63800c010 tx=0x7fc63800b410 comp rx=0 tx=0).stop 2024-09-10T22:26:02.304 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:02.298+0000 7fc64f711740 1 -- 172.21.15.19:0/1429653614 shutdown_connections 2024-09-10T22:26:02.304 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:02.298+0000 7fc64f711740 1 --2- 172.21.15.19:0/1429653614 >> [v2:172.21.15.138:6838/383637208,v1:172.21.15.138:6839/383637208] conn(0x556dfcf33600 0x556dfcfa3c50 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:26:02.304 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:02.298+0000 7fc64f711740 1 --2- 172.21.15.19:0/1429653614 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x556dfcf229f0 0x556dfcf37830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:26:02.304 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:02.298+0000 7fc64f711740 1 --2- 172.21.15.19:0/1429653614 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556dfcf16a60 0x556dfcf372f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:26:02.304 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:02.298+0000 7fc64f711740 1 --2- 172.21.15.19:0/1429653614 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x556dfcf16140 0x556dfcf36db0 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:26:02.304 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:02.298+0000 7fc64f711740 1 -- 172.21.15.19:0/1429653614 >> 172.21.15.19:0/1429653614 conn(0x556dfcf13f70 msgr2=0x556dfcf1abf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:26:02.304 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:02.298+0000 7fc62e7fc640 0 client.15249 ms_handle_reset on v2:172.21.15.138:6838/383637208 2024-09-10T22:26:02.304 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:02.298+0000 7fc64f711740 1 -- 172.21.15.19:0/1429653614 shutdown_connections 2024-09-10T22:26:02.304 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:02.298+0000 7fc64f711740 1 -- 172.21.15.19:0/1429653614 wait complete. 2024-09-10T22:26:02.304 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:02.298+0000 7fc64f711740 20 client.15249 trim_cache size 0 max 16384 2024-09-10T22:26:02.305 INFO:teuthology.orchestra.run.smithi019.stdout:{ 2024-09-10T22:26:02.305 INFO:teuthology.orchestra.run.smithi019.stdout: "cluster_fsid": "22997a4c-6fc2-11ef-bcea-c7b262605968", 2024-09-10T22:26:02.305 INFO:teuthology.orchestra.run.smithi019.stdout: "whoami": 1, 2024-09-10T22:26:02.305 INFO:teuthology.orchestra.run.smithi019.stdout: "id": 24568, 2024-09-10T22:26:02.305 INFO:teuthology.orchestra.run.smithi019.stdout: "want_state": "up:active", 2024-09-10T22:26:02.305 INFO:teuthology.orchestra.run.smithi019.stdout: "state": "up:active", 2024-09-10T22:26:02.305 INFO:teuthology.orchestra.run.smithi019.stdout: "fs_name": "cephfs", 2024-09-10T22:26:02.305 INFO:teuthology.orchestra.run.smithi019.stdout: "rank_uptime": 92.110318543999995, 2024-09-10T22:26:02.305 INFO:teuthology.orchestra.run.smithi019.stdout: "mdsmap_epoch": 24, 2024-09-10T22:26:02.306 INFO:teuthology.orchestra.run.smithi019.stdout: "osdmap_epoch": 75, 2024-09-10T22:26:02.306 INFO:teuthology.orchestra.run.smithi019.stdout: "osdmap_epoch_barrier": 73, 2024-09-10T22:26:02.306 INFO:teuthology.orchestra.run.smithi019.stdout: "uptime": 118.778614054 2024-09-10T22:26:02.306 INFO:teuthology.orchestra.run.smithi019.stdout:} 2024-09-10T22:26:02.306 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:02.299+0000 7fc64d33c640 1 -- 172.21.15.19:0/2050980199 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7fc6340b5370 msgr2=0x7fc6340b7830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:26:02.306 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:02.299+0000 7fc64d33c640 1 --2- 172.21.15.19:0/2050980199 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7fc6340b5370 0x7fc6340b7830 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fc630005d00 tx=0x7fc63000b390 comp rx=0 tx=0).stop 2024-09-10T22:26:02.307 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:02.299+0000 7fc64d33c640 1 -- 172.21.15.19:0/2050980199 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc648108040 msgr2=0x7fc6481a5070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:26:02.307 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:02.299+0000 7fc64d33c640 1 --2- 172.21.15.19:0/2050980199 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc648108040 0x7fc6481a5070 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7fc640005cc0 tx=0x7fc64002f380 comp rx=0 tx=0).stop 2024-09-10T22:26:02.307 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:02.299+0000 7fc64d33c640 1 -- 172.21.15.19:0/2050980199 shutdown_connections 2024-09-10T22:26:02.307 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:02.299+0000 7fc64d33c640 1 --2- 172.21.15.19:0/2050980199 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7fc6340b5370 0x7fc6340b7830 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:26:02.307 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:02.299+0000 7fc64d33c640 1 --2- 172.21.15.19:0/2050980199 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc648108040 0x7fc6481a5070 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:26:02.307 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:02.299+0000 7fc64d33c640 1 --2- 172.21.15.19:0/2050980199 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc6481076c0 0x7fc64819a530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:26:02.307 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:02.299+0000 7fc64d33c640 1 --2- 172.21.15.19:0/2050980199 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc648101cb0 0x7fc648199ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:26:02.307 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:02.299+0000 7fc64d33c640 1 -- 172.21.15.19:0/2050980199 >> 172.21.15.19:0/2050980199 conn(0x7fc6480fd700 msgr2=0x7fc6480ffaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:26:02.307 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:02.299+0000 7fc64d33c640 1 -- 172.21.15.19:0/2050980199 shutdown_connections 2024-09-10T22:26:02.307 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:02.299+0000 7fc64d33c640 1 -- 172.21.15.19:0/2050980199 wait complete. 2024-09-10T22:26:02.360 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:26:01 smithi135 ceph-mon[34789]: pgmap v333: 97 pgs: 97 active+clean; 639 KiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-09-10T22:26:02.374 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:26:01 smithi138 ceph-mon[35236]: pgmap v333: 97 pgs: 97 active+clean; 639 KiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-09-10T22:26:02.966 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 22997a4c-6fc2-11ef-bcea-c7b262605968 -- ceph tell mds.b status 2024-09-10T22:26:03.227 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/22997a4c-6fc2-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T22:26:03.744 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:03.732+0000 7fc9fbd09640 1 -- 172.21.15.19:0/48207822 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc9f4108060 msgr2=0x7fc9f410e860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:26:03.745 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:03.732+0000 7fc9fbd09640 1 --2- 172.21.15.19:0/48207822 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc9f4108060 0x7fc9f410e860 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7fc9ec009ca0 tx=0x7fc9ec02a8c0 comp rx=0 tx=0).stop 2024-09-10T22:26:03.745 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:03.732+0000 7fc9fbd09640 1 -- 172.21.15.19:0/48207822 shutdown_connections 2024-09-10T22:26:03.745 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:03.732+0000 7fc9fbd09640 1 --2- 172.21.15.19:0/48207822 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc9f4108060 0x7fc9f410e860 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:26:03.745 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:03.732+0000 7fc9fbd09640 1 --2- 172.21.15.19:0/48207822 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc9f41076e0 0x7fc9f4107b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:26:03.745 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:03.732+0000 7fc9fbd09640 1 --2- 172.21.15.19:0/48207822 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc9f4101cd0 0x7fc9f41020b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:26:03.745 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:03.732+0000 7fc9fbd09640 1 -- 172.21.15.19:0/48207822 >> 172.21.15.19:0/48207822 conn(0x7fc9f40fd700 msgr2=0x7fc9f40ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:26:03.745 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:03.732+0000 7fc9fbd09640 1 -- 172.21.15.19:0/48207822 shutdown_connections 2024-09-10T22:26:03.745 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:03.732+0000 7fc9fbd09640 1 -- 172.21.15.19:0/48207822 wait complete. 2024-09-10T22:26:03.745 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:03.733+0000 7fc9fbd09640 1 Processor -- start 2024-09-10T22:26:03.745 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:03.733+0000 7fc9fbd09640 1 -- start start 2024-09-10T22:26:03.745 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:03.733+0000 7fc9fbd09640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc9f4101cd0 0x7fc9f40fde30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:26:03.745 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:03.733+0000 7fc9fbd09640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc9f41076e0 0x7fc9f40fe370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:26:03.746 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:03.733+0000 7fc9fbd09640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc9f4108060 0x7fc9f40fe8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:26:03.746 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:03.733+0000 7fc9fbd09640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fc9f4111ce0 con 0x7fc9f4108060 2024-09-10T22:26:03.746 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:03.733+0000 7fc9fbd09640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fc9f4111b60 con 0x7fc9f41076e0 2024-09-10T22:26:03.746 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:03.733+0000 7fc9fbd09640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7fc9f4111e60 con 0x7fc9f4101cd0 2024-09-10T22:26:03.746 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:03.733+0000 7fc9fa2a6640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc9f4108060 0x7fc9f40fe8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:26:03.746 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:03.733+0000 7fc9fa2a6640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc9f4108060 0x7fc9f40fe8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:53420/0 (socket says 172.21.15.19:53420) 2024-09-10T22:26:03.746 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:03.733+0000 7fc9fa2a6640 1 -- 172.21.15.19:0/111157248 learned_addr learned my addr 172.21.15.19:0/111157248 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:26:03.746 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:03.733+0000 7fc9f92a4640 1 --2- 172.21.15.19:0/111157248 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc9f41076e0 0x7fc9f40fe370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:26:03.746 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:03.733+0000 7fc9f9aa5640 1 --2- 172.21.15.19:0/111157248 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc9f4101cd0 0x7fc9f40fde30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:26:03.746 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:03.733+0000 7fc9fa2a6640 1 -- 172.21.15.19:0/111157248 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc9f4101cd0 msgr2=0x7fc9f40fde30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:26:03.746 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:03.733+0000 7fc9fa2a6640 1 --2- 172.21.15.19:0/111157248 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc9f4101cd0 0x7fc9f40fde30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:26:03.746 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:03.733+0000 7fc9fa2a6640 1 -- 172.21.15.19:0/111157248 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc9f41076e0 msgr2=0x7fc9f40fe370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:26:03.747 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:03.733+0000 7fc9fa2a6640 1 --2- 172.21.15.19:0/111157248 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc9f41076e0 0x7fc9f40fe370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:26:03.747 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:03.733+0000 7fc9fa2a6640 1 -- 172.21.15.19:0/111157248 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc9f41a76b0 con 0x7fc9f4108060 2024-09-10T22:26:03.747 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:03.733+0000 7fc9f92a4640 1 --2- 172.21.15.19:0/111157248 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc9f41076e0 0x7fc9f40fe370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T22:26:03.747 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:03.733+0000 7fc9f9aa5640 1 --2- 172.21.15.19:0/111157248 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc9f4101cd0 0x7fc9f40fde30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T22:26:03.747 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:03.734+0000 7fc9fa2a6640 1 --2- 172.21.15.19:0/111157248 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc9f4108060 0x7fc9f40fe8b0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7fc9ec005cc0 tx=0x7fc9ec02f380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:26:03.747 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:03.734+0000 7fc9eaffd640 1 -- 172.21.15.19:0/111157248 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9ec003bf0 con 0x7fc9f4108060 2024-09-10T22:26:03.747 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:03.734+0000 7fc9eaffd640 1 -- 172.21.15.19:0/111157248 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc9ec003d90 con 0x7fc9f4108060 2024-09-10T22:26:03.747 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:03.734+0000 7fc9fbd09640 1 -- 172.21.15.19:0/111157248 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc9f41a7940 con 0x7fc9f4108060 2024-09-10T22:26:03.747 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:03.734+0000 7fc9eaffd640 1 -- 172.21.15.19:0/111157248 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9ec02fbc0 con 0x7fc9f4108060 2024-09-10T22:26:03.747 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:03.734+0000 7fc9fbd09640 1 -- 172.21.15.19:0/111157248 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc9f41a7ed0 con 0x7fc9f4108060 2024-09-10T22:26:03.747 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:03.736+0000 7fc9eaffd640 1 -- 172.21.15.19:0/111157248 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 17) ==== 153301+0+0 (secure 0 0 0) 0x7fc9ec004610 con 0x7fc9f4108060 2024-09-10T22:26:03.747 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:03.737+0000 7fc9fe0de740 1 Processor -- start 2024-09-10T22:26:03.748 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:03.737+0000 7fc9fe0de740 1 -- start start 2024-09-10T22:26:03.748 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:03.737+0000 7fc9fe0de740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55da22115d30 0x55da22116110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:26:03.748 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:03.737+0000 7fc9fe0de740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55da22116650 0x55da221220a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:26:03.748 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:03.737+0000 7fc9fe0de740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55da221225e0 0x55da221249d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:26:03.748 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:03.737+0000 7fc9fe0de740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x55da2208dc10 con 0x55da22115d30 2024-09-10T22:26:03.748 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:03.737+0000 7fc9fe0de740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55da2207d040 con 0x55da22116650 2024-09-10T22:26:03.748 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:03.737+0000 7fc9fe0de740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x55da22080e50 con 0x55da221225e0 2024-09-10T22:26:03.748 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:03.737+0000 7fc9f92a4640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55da22115d30 0x55da22116110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:26:03.748 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:03.737+0000 7fc9f92a4640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55da22115d30 0x55da22116110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:53424/0 (socket says 172.21.15.19:53424) 2024-09-10T22:26:03.748 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:03.737+0000 7fc9f92a4640 1 -- 172.21.15.19:0/230616041 learned_addr learned my addr 172.21.15.19:0/230616041 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:26:03.748 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:03.737+0000 7fc9f9aa5640 1 --2- 172.21.15.19:0/230616041 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55da22116650 0x55da221220a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:26:03.748 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:03.737+0000 7fc9f92a4640 1 -- 172.21.15.19:0/230616041 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55da221225e0 msgr2=0x55da221249d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:26:03.748 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:03.737+0000 7fc9f92a4640 1 --2- 172.21.15.19:0/230616041 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55da221225e0 0x55da221249d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:26:03.749 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:03.737+0000 7fc9f92a4640 1 -- 172.21.15.19:0/230616041 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55da22116650 msgr2=0x55da221220a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:26:03.749 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:03.737+0000 7fc9f92a4640 1 --2- 172.21.15.19:0/230616041 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55da22116650 0x55da221220a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:26:03.749 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:03.737+0000 7fc9f92a4640 1 -- 172.21.15.19:0/230616041 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55da21ddb540 con 0x55da22115d30 2024-09-10T22:26:03.749 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:03.737+0000 7fc9eaffd640 1 --2- 172.21.15.19:0/111157248 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7fc9e00b53f0 0x7fc9e00b78b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:26:03.749 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:03.738+0000 7fc9f9aa5640 1 --2- 172.21.15.19:0/111157248 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7fc9e00b53f0 0x7fc9e00b78b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:26:03.749 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:03.738+0000 7fc9f92a4640 1 --2- 172.21.15.19:0/230616041 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55da22115d30 0x55da22116110 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7fc9e400bd60 tx=0x7fc9e4011750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=33ad16d882bd71e server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:26:03.749 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:03.738+0000 7fc9eaffd640 1 -- 172.21.15.19:0/111157248 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8269+0+0 (secure 0 0 0) 0x7fc9ec1072c0 con 0x7fc9f4108060 2024-09-10T22:26:03.749 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:03.738+0000 7fc9dffff640 1 -- 172.21.15.19:0/230616041 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9e4004230 con 0x55da22115d30 2024-09-10T22:26:03.749 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:03.738+0000 7fc9dffff640 1 -- 172.21.15.19:0/230616041 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc9e400be50 con 0x55da22115d30 2024-09-10T22:26:03.750 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:03.738+0000 7fc9dffff640 1 -- 172.21.15.19:0/230616041 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9e4012650 con 0x55da22115d30 2024-09-10T22:26:03.750 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:03.739+0000 7fc9fe0de740 1 -- 172.21.15.19:0/230616041 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55da22115d30 msgr2=0x55da22116110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:26:03.750 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:03.739+0000 7fc9fe0de740 1 --2- 172.21.15.19:0/230616041 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55da22115d30 0x55da22116110 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7fc9e400bd60 tx=0x7fc9e4011750 comp rx=0 tx=0).stop 2024-09-10T22:26:03.750 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:03.739+0000 7fc9f9aa5640 1 --2- 172.21.15.19:0/111157248 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7fc9e00b53f0 0x7fc9e00b78b0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x55da22118eb0 tx=0x7fc9f0005e90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:26:03.750 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:03.739+0000 7fc9fe0de740 1 -- 172.21.15.19:0/230616041 shutdown_connections 2024-09-10T22:26:03.750 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:03.739+0000 7fc9fe0de740 1 --2- 172.21.15.19:0/230616041 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55da221225e0 0x55da221249d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:26:03.750 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:03.739+0000 7fc9fe0de740 1 --2- 172.21.15.19:0/230616041 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55da22116650 0x55da221220a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:26:03.750 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:03.739+0000 7fc9fe0de740 1 --2- 172.21.15.19:0/230616041 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55da22115d30 0x55da22116110 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:26:03.751 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:03.739+0000 7fc9fe0de740 1 -- 172.21.15.19:0/230616041 >> 172.21.15.19:0/230616041 conn(0x55da22113b60 msgr2=0x55da22114d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:26:03.751 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:03.739+0000 7fc9fe0de740 1 -- 172.21.15.19:0/230616041 shutdown_connections 2024-09-10T22:26:03.751 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:03.739+0000 7fc9fe0de740 1 -- 172.21.15.19:0/230616041 wait complete. 2024-09-10T22:26:03.751 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:03.739+0000 7fc9fe0de740 1 -- start start 2024-09-10T22:26:03.751 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:03.739+0000 7fc9fe0de740 1 Processor -- start 2024-09-10T22:26:03.751 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:03.740+0000 7fc9fe0de740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55da22115d30 0x55da2211f560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:26:03.751 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:03.740+0000 7fc9fe0de740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55da22116650 0x55da2211faa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:26:03.751 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:03.740+0000 7fc9fe0de740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55da221225e0 0x55da2211ffe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:26:03.752 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:03.740+0000 7fc9fe0de740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x55da21ede5f0 con 0x55da221225e0 2024-09-10T22:26:03.752 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:03.740+0000 7fc9fe0de740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55da22018010 con 0x55da22115d30 2024-09-10T22:26:03.752 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:03.740+0000 7fc9fe0de740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x55da22125290 con 0x55da22116650 2024-09-10T22:26:03.752 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:03.740+0000 7fc9fe0de740 10 client.0 _ll_register_callbacks cb 0x55da22077340 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T22:26:03.752 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:03.740+0000 7fc9fa2a6640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55da221225e0 0x55da2211ffe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:26:03.752 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:03.740+0000 7fc9fa2a6640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55da221225e0 0x55da2211ffe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:53432/0 (socket says 172.21.15.19:53432) 2024-09-10T22:26:03.752 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:03.740+0000 7fc9fa2a6640 1 -- 172.21.15.19:0/3452638799 learned_addr learned my addr 172.21.15.19:0/3452638799 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:26:03.753 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:03.740+0000 7fc9f9aa5640 1 --2- 172.21.15.19:0/3452638799 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55da22115d30 0x55da2211f560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:26:03.753 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:03.740+0000 7fc9f92a4640 1 --2- 172.21.15.19:0/3452638799 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55da22116650 0x55da2211faa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:26:03.753 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:03.740+0000 7fc9fa2a6640 1 -- 172.21.15.19:0/3452638799 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55da22116650 msgr2=0x55da2211faa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:26:03.753 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:03.740+0000 7fc9fa2a6640 1 --2- 172.21.15.19:0/3452638799 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55da22116650 0x55da2211faa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:26:03.753 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:03.740+0000 7fc9fa2a6640 1 -- 172.21.15.19:0/3452638799 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55da22115d30 msgr2=0x55da2211f560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:26:03.753 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:03.740+0000 7fc9fa2a6640 1 --2- 172.21.15.19:0/3452638799 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55da22115d30 0x55da2211f560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:26:03.753 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:03.740+0000 7fc9fa2a6640 1 -- 172.21.15.19:0/3452638799 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55da22045a00 con 0x55da221225e0 2024-09-10T22:26:03.753 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:03.740+0000 7fc9f92a4640 1 --2- 172.21.15.19:0/3452638799 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55da22116650 0x55da2211faa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T22:26:03.753 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:03.740+0000 7fc9fa2a6640 1 --2- 172.21.15.19:0/3452638799 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55da221225e0 0x55da2211ffe0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7fc9ec0c9ed0 tx=0x7fc9ec1050d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=efa7ca36a2fe1f37 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:26:03.756 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:03.740+0000 7fc9dd7fa640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-10T22:26:03.756 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:03.741+0000 7fc9dd7fa640 1 -- 172.21.15.19:0/3452638799 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9ec0ce000 con 0x55da221225e0 2024-09-10T22:26:03.756 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:03.741+0000 7fc9dd7fa640 1 -- 172.21.15.19:0/3452638799 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8269+0+0 (secure 0 0 0) 0x7fc9ec0d6a00 con 0x55da221225e0 2024-09-10T22:26:03.756 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:03.741+0000 7fc9fe0de740 1 -- 172.21.15.19:0/3452638799 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc9e400be50 con 0x55da221225e0 2024-09-10T22:26:03.756 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:03.741+0000 7fc9dd7fa640 1 -- 172.21.15.19:0/3452638799 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fc9ec0098b0 con 0x55da221225e0 2024-09-10T22:26:03.756 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:03.741+0000 7fc9fe0de740 10 client.15261 fetch_fsmap learned FSMap version 24 2024-09-10T22:26:03.756 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:03.741+0000 7fc9fe0de740 1 -- 172.21.15.19:0/3452638799 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55da22130e30 con 0x55da221225e0 2024-09-10T22:26:03.756 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:03.741+0000 7fc9dd7fa640 1 -- 172.21.15.19:0/3452638799 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc9e400be50 con 0x55da221225e0 2024-09-10T22:26:03.756 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:03.741+0000 7fc9dd7fa640 1 -- 172.21.15.19:0/3452638799 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7fc9ec0c9250 con 0x55da221225e0 2024-09-10T22:26:03.756 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:03.741+0000 7fc9fe0de740 10 client.15261 fetch_fsmap finished waiting for FSMap version 24 2024-09-10T22:26:03.757 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:03.741+0000 7fc9fe0de740 10 client.15261 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-10T22:26:03.757 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:03.741+0000 7fc9fe0de740 20 client.15261 populate_metadata read hostname 'smithi019' 2024-09-10T22:26:03.757 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:03.741+0000 7fc9fe0de740 1 --2- 172.21.15.19:0/3452638799 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x55da221334f0 0x55da22134960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:26:03.757 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:03.741+0000 7fc9fe0de740 4 client.15261 mds_command: new command op to 24581 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T22:26:03.757 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:03.741+0000 7fc9fe0de740 1 -- 172.21.15.19:0/3452638799 --> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55da2208fb60 con 0x55da221334f0 2024-09-10T22:26:03.757 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:03.742+0000 7fc9f9aa5640 1 --2- 172.21.15.19:0/3452638799 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x55da221334f0 0x55da22134960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:26:03.757 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:03.742+0000 7fc9dd7fa640 10 client.15261 ms_handle_connect on v2:172.21.15.135:6838/1254769802 2024-09-10T22:26:03.757 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:03.742+0000 7fc9f9aa5640 1 --2- 172.21.15.19:0/3452638799 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x55da221334f0 0x55da22134960 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4054d3e400f4347e server_cookie=69ec71391c4a9a5f in_seq=0 out_seq=0 2024-09-10T22:26:03.757 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:03.743+0000 7fc9dd7fa640 1 -- 172.21.15.19:0/3452638799 <== mds.0 v2:172.21.15.135:6838/1254769802 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55da2208fb60 con 0x55da221334f0 2024-09-10T22:26:03.757 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:03.743+0000 7fc9dd7fa640 10 client.15261 handle_command_reply: tid=0 2024-09-10T22:26:03.757 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:03.743+0000 7fc9fe0de740 1 client.15261 shutdown 2024-09-10T22:26:03.757 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:03.743+0000 7fc9fe0de740 1 -- 172.21.15.19:0/3452638799 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55da221225e0 msgr2=0x55da2211ffe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:26:03.758 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:03.743+0000 7fc9fe0de740 1 --2- 172.21.15.19:0/3452638799 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55da221225e0 0x55da2211ffe0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7fc9ec0c9ed0 tx=0x7fc9ec1050d0 comp rx=0 tx=0).stop 2024-09-10T22:26:03.758 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:03.743+0000 7fc9fe0de740 1 -- 172.21.15.19:0/3452638799 shutdown_connections 2024-09-10T22:26:03.758 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:03.743+0000 7fc9fe0de740 1 --2- 172.21.15.19:0/3452638799 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55da221225e0 0x55da2211ffe0 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:26:03.758 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:03.743+0000 7fc9fe0de740 1 --2- 172.21.15.19:0/3452638799 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x55da221334f0 0x55da22134960 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:26:03.758 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:03.743+0000 7fc9dd7fa640 0 client.15261 ms_handle_reset on v2:172.21.15.135:6838/1254769802 2024-09-10T22:26:03.758 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:03.743+0000 7fc9fe0de740 1 --2- 172.21.15.19:0/3452638799 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55da22116650 0x55da2211faa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:26:03.758 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:03.743+0000 7fc9fe0de740 1 --2- 172.21.15.19:0/3452638799 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55da22115d30 0x55da2211f560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:26:03.758 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:03.743+0000 7fc9fe0de740 1 -- 172.21.15.19:0/3452638799 >> 172.21.15.19:0/3452638799 conn(0x55da22113b60 msgr2=0x55da22119700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:26:03.758 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:03.743+0000 7fc9fe0de740 1 -- 172.21.15.19:0/3452638799 shutdown_connections 2024-09-10T22:26:03.758 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:03.743+0000 7fc9fe0de740 1 -- 172.21.15.19:0/3452638799 wait complete. 2024-09-10T22:26:03.758 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:03.743+0000 7fc9fe0de740 20 client.15261 trim_cache size 0 max 16384 2024-09-10T22:26:03.764 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:03.761+0000 7fc9fe0de740 1 Processor -- start 2024-09-10T22:26:03.764 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:03.762+0000 7fc9fe0de740 1 -- start start 2024-09-10T22:26:03.764 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:03.762+0000 7fc9fe0de740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55da22115d30 0x55da2211de20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:26:03.764 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:03.762+0000 7fc9fe0de740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55da22116650 0x55da2211e360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:26:03.764 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:03.762+0000 7fc9fe0de740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55da221225e0 0x55da2211c9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:26:03.764 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:03.762+0000 7fc9fe0de740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x55da22132ca0 con 0x55da22115d30 2024-09-10T22:26:03.764 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:03.762+0000 7fc9fe0de740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55da22133370 con 0x55da22116650 2024-09-10T22:26:03.764 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:03.762+0000 7fc9fe0de740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x55da22133a40 con 0x55da221225e0 2024-09-10T22:26:03.764 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:03.762+0000 7fc9f9aa5640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55da22115d30 0x55da2211de20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:26:03.765 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:03.762+0000 7fc9f9aa5640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55da22115d30 0x55da2211de20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:53436/0 (socket says 172.21.15.19:53436) 2024-09-10T22:26:03.765 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:03.762+0000 7fc9f9aa5640 1 -- 172.21.15.19:0/1878300020 learned_addr learned my addr 172.21.15.19:0/1878300020 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:26:03.765 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:03.762+0000 7fc9fa2a6640 1 --2- 172.21.15.19:0/1878300020 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55da221225e0 0x55da2211c9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:26:03.765 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:03.762+0000 7fc9f92a4640 1 --2- 172.21.15.19:0/1878300020 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55da22116650 0x55da2211e360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:26:03.765 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:03.762+0000 7fc9f9aa5640 1 -- 172.21.15.19:0/1878300020 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55da221225e0 msgr2=0x55da2211c9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:26:03.765 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:03.762+0000 7fc9f9aa5640 1 --2- 172.21.15.19:0/1878300020 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55da221225e0 0x55da2211c9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:26:03.765 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:03.762+0000 7fc9f9aa5640 1 -- 172.21.15.19:0/1878300020 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55da22116650 msgr2=0x55da2211e360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:26:03.765 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:03.762+0000 7fc9f9aa5640 1 --2- 172.21.15.19:0/1878300020 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55da22116650 0x55da2211e360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:26:03.765 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:03.762+0000 7fc9f9aa5640 1 -- 172.21.15.19:0/1878300020 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55da2211daa0 con 0x55da22115d30 2024-09-10T22:26:03.765 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:03.762+0000 7fc9f92a4640 1 --2- 172.21.15.19:0/1878300020 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55da22116650 0x55da2211e360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T22:26:03.765 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:03.762+0000 7fc9f9aa5640 1 --2- 172.21.15.19:0/1878300020 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55da22115d30 0x55da2211de20 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7fc9f000fdc0 tx=0x7fc9f0015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6c3167f60e7ca655 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:26:03.765 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:03.762+0000 7fc9df7fe640 1 -- 172.21.15.19:0/1878300020 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9f0004220 con 0x55da22115d30 2024-09-10T22:26:03.765 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:03.762+0000 7fc9df7fe640 1 -- 172.21.15.19:0/1878300020 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc9f00043c0 con 0x55da22115d30 2024-09-10T22:26:03.766 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:03.763+0000 7fc9df7fe640 1 -- 172.21.15.19:0/1878300020 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9f001f910 con 0x55da22115d30 2024-09-10T22:26:03.769 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:03.763+0000 7fc9fe0de740 1 -- 172.21.15.19:0/1878300020 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55da22115d30 msgr2=0x55da2211de20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:26:03.769 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:03.763+0000 7fc9fe0de740 1 --2- 172.21.15.19:0/1878300020 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55da22115d30 0x55da2211de20 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7fc9f000fdc0 tx=0x7fc9f0015000 comp rx=0 tx=0).stop 2024-09-10T22:26:03.769 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:03.763+0000 7fc9fe0de740 1 -- 172.21.15.19:0/1878300020 shutdown_connections 2024-09-10T22:26:03.770 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:03.763+0000 7fc9fe0de740 1 --2- 172.21.15.19:0/1878300020 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55da221225e0 0x55da2211c9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:26:03.770 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:03.763+0000 7fc9fe0de740 1 --2- 172.21.15.19:0/1878300020 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55da22116650 0x55da2211e360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:26:03.770 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:03.763+0000 7fc9fe0de740 1 --2- 172.21.15.19:0/1878300020 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55da22115d30 0x55da2211de20 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:26:03.770 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:03.763+0000 7fc9fe0de740 1 -- 172.21.15.19:0/1878300020 >> 172.21.15.19:0/1878300020 conn(0x55da22113b60 msgr2=0x55da22132180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:26:03.770 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:03.763+0000 7fc9fe0de740 1 -- 172.21.15.19:0/1878300020 shutdown_connections 2024-09-10T22:26:03.770 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:03.763+0000 7fc9fe0de740 1 -- 172.21.15.19:0/1878300020 wait complete. 2024-09-10T22:26:03.770 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:03.764+0000 7fc9fe0de740 1 -- start start 2024-09-10T22:26:03.770 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:03.764+0000 7fc9fe0de740 1 Processor -- start 2024-09-10T22:26:03.770 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:03.764+0000 7fc9fe0de740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55da22115d30 0x55da22137b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:26:03.770 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:03.764+0000 7fc9fe0de740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55da22116650 0x55da22138040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:26:03.770 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:03.764+0000 7fc9fe0de740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55da221225e0 0x55da22138580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:26:03.770 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:03.764+0000 7fc9fe0de740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x55da221347e0 con 0x55da22116650 2024-09-10T22:26:03.770 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:03.764+0000 7fc9fe0de740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55da22134110 con 0x55da22115d30 2024-09-10T22:26:03.771 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:03.764+0000 7fc9fe0de740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x55da22134eb0 con 0x55da221225e0 2024-09-10T22:26:03.771 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:03.764+0000 7fc9fe0de740 10 client.0 _ll_register_callbacks cb 0x7fc9ec009640 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T22:26:03.771 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:03.764+0000 7fc9f92a4640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55da22116650 0x55da22138040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:26:03.771 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:03.764+0000 7fc9f92a4640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55da22116650 0x55da22138040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:53440/0 (socket says 172.21.15.19:53440) 2024-09-10T22:26:03.771 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:03.764+0000 7fc9f92a4640 1 -- 172.21.15.19:0/3128792455 learned_addr learned my addr 172.21.15.19:0/3128792455 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:26:03.771 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:03.764+0000 7fc9fa2a6640 1 --2- 172.21.15.19:0/3128792455 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55da221225e0 0x55da22138580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:26:03.771 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:03.764+0000 7fc9f9aa5640 1 --2- 172.21.15.19:0/3128792455 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55da22115d30 0x55da22137b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:26:03.771 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:03.765+0000 7fc9f92a4640 1 -- 172.21.15.19:0/3128792455 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55da221225e0 msgr2=0x55da22138580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:26:03.771 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:03.765+0000 7fc9f92a4640 1 --2- 172.21.15.19:0/3128792455 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55da221225e0 0x55da22138580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:26:03.771 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:03.765+0000 7fc9f92a4640 1 -- 172.21.15.19:0/3128792455 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55da22115d30 msgr2=0x55da22137b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:26:03.771 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:03.765+0000 7fc9f92a4640 1 --2- 172.21.15.19:0/3128792455 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55da22115d30 0x55da22137b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:26:03.771 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:03.765+0000 7fc9f92a4640 1 -- 172.21.15.19:0/3128792455 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55da2213cda0 con 0x55da22116650 2024-09-10T22:26:03.772 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:03.765+0000 7fc9f9aa5640 1 --2- 172.21.15.19:0/3128792455 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55da22115d30 0x55da22137b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T22:26:03.772 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:03.765+0000 7fc9f92a4640 1 --2- 172.21.15.19:0/3128792455 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55da22116650 0x55da22138040 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7fc9e400bd60 tx=0x7fc9e400b2c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=134ff5547fa77d63 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:26:03.772 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:03.765+0000 7fc9dd7fa640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-10T22:26:03.772 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:03.765+0000 7fc9dd7fa640 1 -- 172.21.15.19:0/3128792455 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9e400b430 con 0x55da22116650 2024-09-10T22:26:03.772 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:03.765+0000 7fc9dd7fa640 1 -- 172.21.15.19:0/3128792455 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8269+0+0 (secure 0 0 0) 0x7fc9e401a600 con 0x55da22116650 2024-09-10T22:26:03.772 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:03.765+0000 7fc9fe0de740 1 -- 172.21.15.19:0/3128792455 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc9f00043c0 con 0x55da22116650 2024-09-10T22:26:03.772 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:03.765+0000 7fc9dd7fa640 1 -- 172.21.15.19:0/3128792455 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fc9e401a800 con 0x55da22116650 2024-09-10T22:26:03.772 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:03.765+0000 7fc9fe0de740 10 client.15267 fetch_fsmap learned FSMap version 24 2024-09-10T22:26:03.772 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:03.765+0000 7fc9fe0de740 1 -- 172.21.15.19:0/3128792455 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55da221a0310 con 0x55da22116650 2024-09-10T22:26:03.772 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:03.765+0000 7fc9dd7fa640 1 -- 172.21.15.19:0/3128792455 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc9f00043c0 con 0x55da22116650 2024-09-10T22:26:03.772 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:03.765+0000 7fc9dd7fa640 1 -- 172.21.15.19:0/3128792455 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7fc9e4026b50 con 0x55da22116650 2024-09-10T22:26:03.772 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:03.765+0000 7fc9fe0de740 10 client.15267 fetch_fsmap finished waiting for FSMap version 24 2024-09-10T22:26:03.772 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:03.765+0000 7fc9fe0de740 10 client.15267 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-10T22:26:03.773 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:03.766+0000 7fc9fe0de740 20 client.15267 populate_metadata read hostname 'smithi019' 2024-09-10T22:26:03.773 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:03.766+0000 7fc9fe0de740 1 --2- 172.21.15.19:0/3128792455 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x55da221334f0 0x55da221a3810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:26:03.773 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:03.766+0000 7fc9fe0de740 4 client.15267 mds_command: new command op to 24581 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-10T22:26:03.773 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:03.766+0000 7fc9fe0de740 1 -- 172.21.15.19:0/3128792455 --> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] -- command(tid 0: {"prefix": "status"}) -- 0x55da2208b610 con 0x55da221334f0 2024-09-10T22:26:03.773 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:03.766+0000 7fc9f9aa5640 1 --2- 172.21.15.19:0/3128792455 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x55da221334f0 0x55da221a3810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:26:03.773 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:03.766+0000 7fc9f9aa5640 1 --2- 172.21.15.19:0/3128792455 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x55da221334f0 0x55da221a3810 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3c1fe65a3419a6a2 server_cookie=c1d54937ac21e7db in_seq=0 out_seq=0 2024-09-10T22:26:03.773 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:03.766+0000 7fc9dd7fa640 10 client.15267 ms_handle_connect on v2:172.21.15.135:6838/1254769802 2024-09-10T22:26:03.773 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:03.766+0000 7fc9dd7fa640 1 -- 172.21.15.19:0/3128792455 <== mds.0 v2:172.21.15.135:6838/1254769802 1 ==== command_reply(tid 0: 0 ) ==== 8+0+327 (crc 0 0 0) 0x55da2208b610 con 0x55da221334f0 2024-09-10T22:26:03.773 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:03.766+0000 7fc9dd7fa640 10 client.15267 handle_command_reply: tid=0 2024-09-10T22:26:03.773 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:03.766+0000 7fc9fe0de740 1 client.15267 shutdown 2024-09-10T22:26:03.773 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:03.767+0000 7fc9fe0de740 1 -- 172.21.15.19:0/3128792455 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55da22116650 msgr2=0x55da22138040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:26:03.773 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:03.767+0000 7fc9fe0de740 1 --2- 172.21.15.19:0/3128792455 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55da22116650 0x55da22138040 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7fc9e400bd60 tx=0x7fc9e400b2c0 comp rx=0 tx=0).stop 2024-09-10T22:26:03.773 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:03.767+0000 7fc9fe0de740 1 -- 172.21.15.19:0/3128792455 shutdown_connections 2024-09-10T22:26:03.774 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:03.767+0000 7fc9fe0de740 1 --2- 172.21.15.19:0/3128792455 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x55da221334f0 0x55da221a3810 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:26:03.774 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:03.767+0000 7fc9fe0de740 1 --2- 172.21.15.19:0/3128792455 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55da221225e0 0x55da22138580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:26:03.774 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:03.767+0000 7fc9fe0de740 1 --2- 172.21.15.19:0/3128792455 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55da22116650 0x55da22138040 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:26:03.774 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:03.767+0000 7fc9fe0de740 1 --2- 172.21.15.19:0/3128792455 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55da22115d30 0x55da22137b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:26:03.774 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:03.767+0000 7fc9dd7fa640 0 client.15267 ms_handle_reset on v2:172.21.15.135:6838/1254769802 2024-09-10T22:26:03.774 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:03.767+0000 7fc9fe0de740 1 -- 172.21.15.19:0/3128792455 >> 172.21.15.19:0/3128792455 conn(0x55da22113b60 msgr2=0x55da2211dde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:26:03.774 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:03.767+0000 7fc9fe0de740 1 -- 172.21.15.19:0/3128792455 shutdown_connections 2024-09-10T22:26:03.774 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:03.767+0000 7fc9fe0de740 1 -- 172.21.15.19:0/3128792455 wait complete. 2024-09-10T22:26:03.774 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:03.767+0000 7fc9fe0de740 20 client.15267 trim_cache size 0 max 16384 2024-09-10T22:26:03.774 INFO:teuthology.orchestra.run.smithi019.stdout:{ 2024-09-10T22:26:03.775 INFO:teuthology.orchestra.run.smithi019.stdout: "cluster_fsid": "22997a4c-6fc2-11ef-bcea-c7b262605968", 2024-09-10T22:26:03.775 INFO:teuthology.orchestra.run.smithi019.stdout: "whoami": 0, 2024-09-10T22:26:03.775 INFO:teuthology.orchestra.run.smithi019.stdout: "id": 24581, 2024-09-10T22:26:03.775 INFO:teuthology.orchestra.run.smithi019.stdout: "want_state": "up:active", 2024-09-10T22:26:03.775 INFO:teuthology.orchestra.run.smithi019.stdout: "state": "up:active", 2024-09-10T22:26:03.775 INFO:teuthology.orchestra.run.smithi019.stdout: "fs_name": "cephfs", 2024-09-10T22:26:03.775 INFO:teuthology.orchestra.run.smithi019.stdout: "rank_uptime": 100.62820944400001, 2024-09-10T22:26:03.775 INFO:teuthology.orchestra.run.smithi019.stdout: "mdsmap_epoch": 24, 2024-09-10T22:26:03.775 INFO:teuthology.orchestra.run.smithi019.stdout: "osdmap_epoch": 75, 2024-09-10T22:26:03.775 INFO:teuthology.orchestra.run.smithi019.stdout: "osdmap_epoch_barrier": 73, 2024-09-10T22:26:03.775 INFO:teuthology.orchestra.run.smithi019.stdout: "uptime": 111.355134807 2024-09-10T22:26:03.775 INFO:teuthology.orchestra.run.smithi019.stdout:} 2024-09-10T22:26:03.776 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:03.767+0000 7fc9fbd09640 1 -- 172.21.15.19:0/111157248 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7fc9e00b53f0 msgr2=0x7fc9e00b78b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:26:03.776 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:03.767+0000 7fc9fbd09640 1 --2- 172.21.15.19:0/111157248 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7fc9e00b53f0 0x7fc9e00b78b0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x55da22118eb0 tx=0x7fc9f0005e90 comp rx=0 tx=0).stop 2024-09-10T22:26:03.776 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:03.767+0000 7fc9fbd09640 1 -- 172.21.15.19:0/111157248 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc9f4108060 msgr2=0x7fc9f40fe8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:26:03.776 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:03.767+0000 7fc9fbd09640 1 --2- 172.21.15.19:0/111157248 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc9f4108060 0x7fc9f40fe8b0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7fc9ec005cc0 tx=0x7fc9ec02f380 comp rx=0 tx=0).stop 2024-09-10T22:26:03.776 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:03.767+0000 7fc9fbd09640 1 -- 172.21.15.19:0/111157248 shutdown_connections 2024-09-10T22:26:03.776 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:03.767+0000 7fc9fbd09640 1 --2- 172.21.15.19:0/111157248 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7fc9e00b53f0 0x7fc9e00b78b0 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:26:03.777 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:03.767+0000 7fc9fbd09640 1 --2- 172.21.15.19:0/111157248 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc9f4108060 0x7fc9f40fe8b0 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:26:03.777 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:03.767+0000 7fc9fbd09640 1 --2- 172.21.15.19:0/111157248 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc9f41076e0 0x7fc9f40fe370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:26:03.777 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:03.767+0000 7fc9fbd09640 1 --2- 172.21.15.19:0/111157248 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc9f4101cd0 0x7fc9f40fde30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:26:03.777 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:03.767+0000 7fc9fbd09640 1 -- 172.21.15.19:0/111157248 >> 172.21.15.19:0/111157248 conn(0x7fc9f40fd700 msgr2=0x7fc9f406b6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:26:03.777 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:03.768+0000 7fc9fbd09640 1 -- 172.21.15.19:0/111157248 shutdown_connections 2024-09-10T22:26:03.777 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:03.768+0000 7fc9fbd09640 1 -- 172.21.15.19:0/111157248 wait complete. 2024-09-10T22:26:04.208 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:26:03 smithi019 ceph-mon[31375]: pgmap v334: 97 pgs: 97 active+clean; 639 KiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-10T22:26:04.359 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:26:03 smithi135 ceph-mon[34789]: pgmap v334: 97 pgs: 97 active+clean; 639 KiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-10T22:26:04.375 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:26:03 smithi138 ceph-mon[35236]: pgmap v334: 97 pgs: 97 active+clean; 639 KiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-10T22:26:04.650 INFO:teuthology.run_tasks:Running task kclient... 2024-09-10T22:26:04.677 INFO:tasks.kclient:Mounting kernel clients... 2024-09-10T22:26:04.677 INFO:tasks.kclient:config is {'client.0': {}} 2024-09-10T22:26:04.677 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T22:26:04.677 DEBUG:teuthology.orchestra.run.smithi019:> ip netns list 2024-09-10T22:26:04.696 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T22:26:04.696 DEBUG:teuthology.orchestra.run.smithi019:> sudo ip link delete ceph-brx 2024-09-10T22:26:04.775 INFO:teuthology.orchestra.run.smithi019.stderr:Cannot find device "ceph-brx" 2024-09-10T22:26:04.776 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-10T22:26:04.776 INFO:tasks.kclient:client.0 config is {'mntopts': ['ms_mode=secure', 'wsync'], 'syntax': 'v2', 'mount_subvol_num': 1} 2024-09-10T22:26:04.777 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-09-10T22:26:04.777 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-10T22:26:04.777 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 22997a4c-6fc2-11ef-bcea-c7b262605968 -- ceph fs ls 2024-09-10T22:26:05.078 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/22997a4c-6fc2-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T22:26:05.200 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:26:04 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.c", "id": [2, 4]} : dispatch 2024-09-10T22:26:05.200 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:26:04 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.d", "id": [5, 11]} : dispatch 2024-09-10T22:26:05.359 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:26:04 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.c", "id": [2, 4]} : dispatch 2024-09-10T22:26:05.359 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:26:04 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.d", "id": [5, 11]} : dispatch 2024-09-10T22:26:05.375 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:26:04 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.c", "id": [2, 4]} : dispatch 2024-09-10T22:26:05.375 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:26:04 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.d", "id": [5, 11]} : dispatch 2024-09-10T22:26:05.592 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:05.588+0000 7fc064615640 1 -- 172.21.15.19:0/3308876915 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc05c103ce0 msgr2=0x7fc05c1040c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:26:05.592 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:05.588+0000 7fc064615640 1 --2- 172.21.15.19:0/3308876915 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc05c103ce0 0x7fc05c1040c0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7fc058009900 tx=0x7fc05802a410 comp rx=0 tx=0).stop 2024-09-10T22:26:05.592 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:05.588+0000 7fc064615640 1 -- 172.21.15.19:0/3308876915 shutdown_connections 2024-09-10T22:26:05.592 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:05.588+0000 7fc064615640 1 --2- 172.21.15.19:0/3308876915 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc05c10d140 0x7fc05c10f5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:26:05.592 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:05.588+0000 7fc064615640 1 --2- 172.21.15.19:0/3308876915 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc05c104600 0x7fc05c10caf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:26:05.592 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:05.588+0000 7fc064615640 1 --2- 172.21.15.19:0/3308876915 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc05c103ce0 0x7fc05c1040c0 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:26:05.593 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:05.588+0000 7fc064615640 1 -- 172.21.15.19:0/3308876915 >> 172.21.15.19:0/3308876915 conn(0x7fc05c0fd700 msgr2=0x7fc05c0ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:26:05.593 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:05.588+0000 7fc064615640 1 -- 172.21.15.19:0/3308876915 shutdown_connections 2024-09-10T22:26:05.593 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:05.588+0000 7fc064615640 1 -- 172.21.15.19:0/3308876915 wait complete. 2024-09-10T22:26:05.595 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:05.589+0000 7fc064615640 1 Processor -- start 2024-09-10T22:26:05.595 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:05.589+0000 7fc064615640 1 -- start start 2024-09-10T22:26:05.595 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:05.589+0000 7fc064615640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc05c103ce0 0x7fc05c1992a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:26:05.595 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:05.589+0000 7fc064615640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc05c104600 0x7fc05c1997e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:26:05.595 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:05.589+0000 7fc064615640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc05c10d140 0x7fc05c19eb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:26:05.595 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:05.589+0000 7fc064615640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fc05c112df0 con 0x7fc05c10d140 2024-09-10T22:26:05.595 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:05.589+0000 7fc064615640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fc05c112c70 con 0x7fc05c104600 2024-09-10T22:26:05.595 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:05.589+0000 7fc064615640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7fc05c112f70 con 0x7fc05c103ce0 2024-09-10T22:26:05.596 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:05.589+0000 7fc062bb2640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc05c10d140 0x7fc05c19eb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:26:05.596 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:05.589+0000 7fc062bb2640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc05c10d140 0x7fc05c19eb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:53466/0 (socket says 172.21.15.19:53466) 2024-09-10T22:26:05.596 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:05.589+0000 7fc062bb2640 1 -- 172.21.15.19:0/2422796939 learned_addr learned my addr 172.21.15.19:0/2422796939 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:26:05.596 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:05.590+0000 7fc0623b1640 1 --2- 172.21.15.19:0/2422796939 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc05c103ce0 0x7fc05c1992a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:26:05.596 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:05.590+0000 7fc061bb0640 1 --2- 172.21.15.19:0/2422796939 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc05c104600 0x7fc05c1997e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:26:05.596 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:05.590+0000 7fc062bb2640 1 -- 172.21.15.19:0/2422796939 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc05c103ce0 msgr2=0x7fc05c1992a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:26:05.596 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:05.590+0000 7fc062bb2640 1 --2- 172.21.15.19:0/2422796939 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc05c103ce0 0x7fc05c1992a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:26:05.596 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:05.590+0000 7fc062bb2640 1 -- 172.21.15.19:0/2422796939 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc05c104600 msgr2=0x7fc05c1997e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:26:05.596 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:05.590+0000 7fc062bb2640 1 --2- 172.21.15.19:0/2422796939 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc05c104600 0x7fc05c1997e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:26:05.596 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:05.590+0000 7fc062bb2640 1 -- 172.21.15.19:0/2422796939 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc05c19f350 con 0x7fc05c10d140 2024-09-10T22:26:05.596 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:05.590+0000 7fc061bb0640 1 --2- 172.21.15.19:0/2422796939 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc05c104600 0x7fc05c1997e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T22:26:05.596 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:05.590+0000 7fc062bb2640 1 --2- 172.21.15.19:0/2422796939 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc05c10d140 0x7fc05c19eb80 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7fc05400b970 tx=0x7fc05400be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:26:05.597 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:05.590+0000 7fc0537fe640 1 -- 172.21.15.19:0/2422796939 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc054019070 con 0x7fc05c10d140 2024-09-10T22:26:05.597 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:05.590+0000 7fc0537fe640 1 -- 172.21.15.19:0/2422796939 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc054014440 con 0x7fc05c10d140 2024-09-10T22:26:05.597 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:05.590+0000 7fc064615640 1 -- 172.21.15.19:0/2422796939 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc05c19f640 con 0x7fc05c10d140 2024-09-10T22:26:05.597 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:05.591+0000 7fc0537fe640 1 -- 172.21.15.19:0/2422796939 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0540075d0 con 0x7fc05c10d140 2024-09-10T22:26:05.597 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:05.591+0000 7fc064615640 1 -- 172.21.15.19:0/2422796939 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc05c1a5d80 con 0x7fc05c10d140 2024-09-10T22:26:05.597 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:05.591+0000 7fc064615640 1 -- 172.21.15.19:0/2422796939 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc05c1040c0 con 0x7fc05c10d140 2024-09-10T22:26:05.597 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:05.593+0000 7fc0537fe640 1 -- 172.21.15.19:0/2422796939 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 17) ==== 153301+0+0 (secure 0 0 0) 0x7fc05400cb40 con 0x7fc05c10d140 2024-09-10T22:26:05.597 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:05.593+0000 7fc0537fe640 1 --2- 172.21.15.19:0/2422796939 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7fc0480b53f0 0x7fc0480b78b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:26:05.597 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:05.593+0000 7fc0623b1640 1 --2- 172.21.15.19:0/2422796939 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7fc0480b53f0 0x7fc0480b78b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:26:05.597 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:05.594+0000 7fc0537fe640 1 -- 172.21.15.19:0/2422796939 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8327+0+0 (secure 0 0 0) 0x7fc0540e5550 con 0x7fc05c10d140 2024-09-10T22:26:05.597 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:05.594+0000 7fc0623b1640 1 --2- 172.21.15.19:0/2422796939 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7fc0480b53f0 0x7fc0480b78b0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fc058031440 tx=0x7fc0580095f0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:26:05.598 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:05.597+0000 7fc0537fe640 1 -- 172.21.15.19:0/2422796939 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7fc0540ac250 con 0x7fc05c10d140 2024-09-10T22:26:05.821 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:05.820+0000 7fc064615640 1 -- 172.21.15.19:0/2422796939 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7fc05c1a6120 con 0x7fc05c10d140 2024-09-10T22:26:05.822 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:05.820+0000 7fc0537fe640 1 -- 172.21.15.19:0/2422796939 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v24) ==== 53+0+73 (secure 0 0 0) 0x7fc0540abb50 con 0x7fc05c10d140 2024-09-10T22:26:05.822 INFO:teuthology.orchestra.run.smithi019.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-10T22:26:05.824 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:05.822+0000 7fc064615640 1 -- 172.21.15.19:0/2422796939 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7fc0480b53f0 msgr2=0x7fc0480b78b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:26:05.824 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:05.822+0000 7fc064615640 1 --2- 172.21.15.19:0/2422796939 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7fc0480b53f0 0x7fc0480b78b0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fc058031440 tx=0x7fc0580095f0 comp rx=0 tx=0).stop 2024-09-10T22:26:05.824 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:05.822+0000 7fc064615640 1 -- 172.21.15.19:0/2422796939 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc05c10d140 msgr2=0x7fc05c19eb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:26:05.824 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:05.822+0000 7fc064615640 1 --2- 172.21.15.19:0/2422796939 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc05c10d140 0x7fc05c19eb80 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7fc05400b970 tx=0x7fc05400be30 comp rx=0 tx=0).stop 2024-09-10T22:26:05.824 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:05.822+0000 7fc064615640 1 -- 172.21.15.19:0/2422796939 shutdown_connections 2024-09-10T22:26:05.825 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:05.822+0000 7fc064615640 1 --2- 172.21.15.19:0/2422796939 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7fc0480b53f0 0x7fc0480b78b0 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:26:05.825 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:05.822+0000 7fc064615640 1 --2- 172.21.15.19:0/2422796939 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc05c10d140 0x7fc05c19eb80 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:26:05.825 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:05.822+0000 7fc064615640 1 --2- 172.21.15.19:0/2422796939 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc05c104600 0x7fc05c1997e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:26:05.825 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:05.822+0000 7fc064615640 1 --2- 172.21.15.19:0/2422796939 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc05c103ce0 0x7fc05c1992a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:26:05.825 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:05.822+0000 7fc064615640 1 -- 172.21.15.19:0/2422796939 >> 172.21.15.19:0/2422796939 conn(0x7fc05c0fd700 msgr2=0x7fc05c10f360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:26:05.825 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:05.823+0000 7fc064615640 1 -- 172.21.15.19:0/2422796939 shutdown_connections 2024-09-10T22:26:05.825 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:05.823+0000 7fc064615640 1 -- 172.21.15.19:0/2422796939 wait complete. 2024-09-10T22:26:06.208 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:26:05 smithi019 ceph-mon[31375]: pgmap v335: 97 pgs: 97 active+clean; 639 KiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-10T22:26:06.208 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:26:05 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.c", "id": [2, 4]}]': finished 2024-09-10T22:26:06.209 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:26:05 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.d", "id": [5, 11]}]': finished 2024-09-10T22:26:06.209 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:26:05 smithi019 ceph-mon[31375]: osdmap e76: 12 total, 12 up, 12 in 2024-09-10T22:26:06.209 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:26:05 smithi019 ceph-mon[31375]: from='client.? 172.21.15.19:0/2422796939' entity='client.admin' cmd={"prefix": "fs ls"} : dispatch 2024-09-10T22:26:06.360 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:26:05 smithi135 ceph-mon[34789]: pgmap v335: 97 pgs: 97 active+clean; 639 KiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-10T22:26:06.360 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:26:05 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.c", "id": [2, 4]}]': finished 2024-09-10T22:26:06.360 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:26:05 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.d", "id": [5, 11]}]': finished 2024-09-10T22:26:06.360 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:26:05 smithi135 ceph-mon[34789]: osdmap e76: 12 total, 12 up, 12 in 2024-09-10T22:26:06.360 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:26:05 smithi135 ceph-mon[34789]: from='client.? 172.21.15.19:0/2422796939' entity='client.admin' cmd={"prefix": "fs ls"} : dispatch 2024-09-10T22:26:06.375 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:26:05 smithi138 ceph-mon[35236]: pgmap v335: 97 pgs: 97 active+clean; 639 KiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-10T22:26:06.375 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:26:05 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.c", "id": [2, 4]}]': finished 2024-09-10T22:26:06.375 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:26:05 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.d", "id": [5, 11]}]': finished 2024-09-10T22:26:06.375 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:26:05 smithi138 ceph-mon[35236]: osdmap e76: 12 total, 12 up, 12 in 2024-09-10T22:26:06.375 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:26:05 smithi138 ceph-mon[35236]: from='client.? 172.21.15.19:0/2422796939' entity='client.admin' cmd={"prefix": "fs ls"} : dispatch 2024-09-10T22:26:06.524 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-10T22:26:06.524 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-10T22:26:06.524 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi019.front.sepia.ceph.com 2024-09-10T22:26:06.524 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-10T22:26:06.524 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-10T22:26:06.524 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-10T22:26:06.524 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-10T22:26:06.524 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-10T22:26:06.524 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-10T22:26:06.524 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T22:26:06.525 DEBUG:teuthology.orchestra.run.smithi019:> ip addr 2024-09-10T22:26:06.542 INFO:teuthology.orchestra.run.smithi019.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-10T22:26:06.542 INFO:teuthology.orchestra.run.smithi019.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-10T22:26:06.542 INFO:teuthology.orchestra.run.smithi019.stdout: inet 127.0.0.1/8 scope host lo 2024-09-10T22:26:06.542 INFO:teuthology.orchestra.run.smithi019.stdout: valid_lft forever preferred_lft forever 2024-09-10T22:26:06.542 INFO:teuthology.orchestra.run.smithi019.stdout: inet6 ::1/128 scope host 2024-09-10T22:26:06.542 INFO:teuthology.orchestra.run.smithi019.stdout: valid_lft forever preferred_lft forever 2024-09-10T22:26:06.542 INFO:teuthology.orchestra.run.smithi019.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-10T22:26:06.542 INFO:teuthology.orchestra.run.smithi019.stdout: link/ether 0c:c4:7a:6b:fd:12 brd ff:ff:ff:ff:ff:ff 2024-09-10T22:26:06.543 INFO:teuthology.orchestra.run.smithi019.stdout: altname enp7s0f0 2024-09-10T22:26:06.543 INFO:teuthology.orchestra.run.smithi019.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-10T22:26:06.543 INFO:teuthology.orchestra.run.smithi019.stdout: link/ether 0c:c4:7a:6b:fd:13 brd ff:ff:ff:ff:ff:ff 2024-09-10T22:26:06.543 INFO:teuthology.orchestra.run.smithi019.stdout: altname enp7s0f1 2024-09-10T22:26:06.543 INFO:teuthology.orchestra.run.smithi019.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-10T22:26:06.543 INFO:teuthology.orchestra.run.smithi019.stdout: link/ether 0c:c4:7a:bd:16:1e brd ff:ff:ff:ff:ff:ff 2024-09-10T22:26:06.543 INFO:teuthology.orchestra.run.smithi019.stdout: altname enp1s0f0 2024-09-10T22:26:06.543 INFO:teuthology.orchestra.run.smithi019.stdout: inet 172.21.15.19/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2024-09-10T22:26:06.543 INFO:teuthology.orchestra.run.smithi019.stdout: valid_lft 42143sec preferred_lft 42143sec 2024-09-10T22:26:06.543 INFO:teuthology.orchestra.run.smithi019.stdout: inet6 fe80::ec4:7aff:febd:161e/64 scope link 2024-09-10T22:26:06.543 INFO:teuthology.orchestra.run.smithi019.stdout: valid_lft forever preferred_lft forever 2024-09-10T22:26:06.543 INFO:teuthology.orchestra.run.smithi019.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-10T22:26:06.543 INFO:teuthology.orchestra.run.smithi019.stdout: link/ether 0c:c4:7a:bd:16:1f brd ff:ff:ff:ff:ff:ff 2024-09-10T22:26:06.544 INFO:teuthology.orchestra.run.smithi019.stdout: altname enp1s0f1 2024-09-10T22:26:06.544 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-09-10T22:26:06.544 DEBUG:teuthology.orchestra.run.smithi019:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-10T22:26:06.544 DEBUG:teuthology.orchestra.run.smithi019:> set -e 2024-09-10T22:26:06.544 DEBUG:teuthology.orchestra.run.smithi019:> sudo ip link add name ceph-brx type bridge 2024-09-10T22:26:06.544 DEBUG:teuthology.orchestra.run.smithi019:> sudo ip addr flush dev ceph-brx 2024-09-10T22:26:06.544 DEBUG:teuthology.orchestra.run.smithi019:> sudo ip link set ceph-brx up 2024-09-10T22:26:06.544 DEBUG:teuthology.orchestra.run.smithi019:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-09-10T22:26:06.545 DEBUG:teuthology.orchestra.run.smithi019:> ') 2024-09-10T22:26:06.633 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:06 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-10T22:26:06.751 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:06 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T22:26:06.757 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T22:26:06.757 DEBUG:teuthology.orchestra.run.smithi019:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-10T22:26:06.783 INFO:teuthology.orchestra.run.smithi019.stdout:1 2024-09-10T22:26:06.785 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T22:26:06.785 DEBUG:teuthology.orchestra.run.smithi019:> route 2024-09-10T22:26:06.864 INFO:teuthology.orchestra.run.smithi019.stdout:Kernel IP routing table 2024-09-10T22:26:06.864 INFO:teuthology.orchestra.run.smithi019.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-10T22:26:06.864 INFO:teuthology.orchestra.run.smithi019.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-09-10T22:26:06.864 INFO:teuthology.orchestra.run.smithi019.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-09-10T22:26:06.864 INFO:teuthology.orchestra.run.smithi019.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-10T22:26:06.864 DEBUG:teuthology.orchestra.run.smithi019:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-10T22:26:06.865 DEBUG:teuthology.orchestra.run.smithi019:> set -e 2024-09-10T22:26:06.865 DEBUG:teuthology.orchestra.run.smithi019:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-09-10T22:26:06.865 DEBUG:teuthology.orchestra.run.smithi019:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-09-10T22:26:06.865 DEBUG:teuthology.orchestra.run.smithi019:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-09-10T22:26:06.865 DEBUG:teuthology.orchestra.run.smithi019:> ') 2024-09-10T22:26:06.953 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:06 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-10T22:26:07.046 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:26:06 smithi019 ceph-mon[31375]: osdmap e77: 12 total, 12 up, 12 in 2024-09-10T22:26:07.140 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:07 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T22:26:07.146 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T22:26:07.146 DEBUG:teuthology.orchestra.run.smithi019:> ip netns list 2024-09-10T22:26:07.163 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T22:26:07.163 DEBUG:teuthology.orchestra.run.smithi019:> ip netns list-id 2024-09-10T22:26:07.219 DEBUG:teuthology.orchestra.run.smithi019:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-10T22:26:07.219 DEBUG:teuthology.orchestra.run.smithi019:> set -e 2024-09-10T22:26:07.219 DEBUG:teuthology.orchestra.run.smithi019:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-10T22:26:07.220 DEBUG:teuthology.orchestra.run.smithi019:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2024-09-10T22:26:07.220 DEBUG:teuthology.orchestra.run.smithi019:> ') 2024-09-10T22:26:07.309 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:07 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-10T22:26:07.333 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:07 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T22:26:07.339 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2024-09-10T22:26:07.339 DEBUG:teuthology.orchestra.run.smithi019:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-10T22:26:07.340 DEBUG:teuthology.orchestra.run.smithi019:> set -e 2024-09-10T22:26:07.340 DEBUG:teuthology.orchestra.run.smithi019:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2024-09-10T22:26:07.340 DEBUG:teuthology.orchestra.run.smithi019:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-09-10T22:26:07.340 DEBUG:teuthology.orchestra.run.smithi019:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2024-09-10T22:26:07.340 DEBUG:teuthology.orchestra.run.smithi019:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2024-09-10T22:26:07.340 DEBUG:teuthology.orchestra.run.smithi019:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2024-09-10T22:26:07.340 DEBUG:teuthology.orchestra.run.smithi019:> ') 2024-09-10T22:26:07.359 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:26:06 smithi135 ceph-mon[34789]: osdmap e77: 12 total, 12 up, 12 in 2024-09-10T22:26:07.375 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:26:06 smithi138 ceph-mon[35236]: osdmap e77: 12 total, 12 up, 12 in 2024-09-10T22:26:07.390 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:07 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-10T22:26:07.468 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:07 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T22:26:07.474 DEBUG:teuthology.orchestra.run.smithi019:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-10T22:26:07.474 DEBUG:teuthology.orchestra.run.smithi019:> set -e 2024-09-10T22:26:07.475 DEBUG:teuthology.orchestra.run.smithi019:> sudo ip link set brx.0 up 2024-09-10T22:26:07.475 DEBUG:teuthology.orchestra.run.smithi019:> sudo ip link set dev brx.0 master ceph-brx 2024-09-10T22:26:07.475 DEBUG:teuthology.orchestra.run.smithi019:> ') 2024-09-10T22:26:07.525 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:07 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-10T22:26:07.548 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:07 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T22:26:07.554 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-10T22:26:07.554 DEBUG:teuthology.orchestra.run.smithi019:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-10T22:26:07.570 INFO:teuthology.orchestra.run.smithi019.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-10T22:26:07.570 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-10T22:26:07.570 DEBUG:teuthology.orchestra.run.smithi019:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-10T22:26:07.626 WARNING:tasks.cephfs.mount:You cannot specify both: cephfs_mntpt and mount_subvol_num 2024-09-10T22:26:07.626 INFO:tasks.cephfs.mount:Mounting subvol 1 for now 2024-09-10T22:26:07.626 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/volumes/qa/sv_1/45bb5791-2315-449d-a832-cd11716fd37f 2024-09-10T22:26:07.626 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T22:26:07.627 DEBUG:teuthology.orchestra.run.smithi019:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/volumes/qa/sv_1/45bb5791-2315-449d-a832-cd11716fd37f /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,ms_mode=secure,wsync,nofallback 2024-09-10T22:26:07.739 INFO:teuthology.orchestra.run.smithi019.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,ms_mode=secure,wsync,nofallback 2024-09-10T22:26:07.739 INFO:teuthology.orchestra.run.smithi019.stdout:mount.ceph: options "norequire_active_mds,norbytes,ms_mode=secure,wsync". 2024-09-10T22:26:07.880 INFO:teuthology.orchestra.run.smithi019.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,ms_mode=secure,wsync,nofallback 2024-09-10T22:26:07.880 INFO:teuthology.orchestra.run.smithi019.stdout:mount.ceph: options "norequire_active_mds,norbytes,ms_mode=secure,wsync". 2024-09-10T22:26:07.880 INFO:teuthology.orchestra.run.smithi019.stdout:mount.ceph: resolved to: "172.21.15.19:3300,172.21.15.135:3300,172.21.15.138:3300" 2024-09-10T22:26:07.881 INFO:teuthology.orchestra.run.smithi019.stdout:mount.ceph: trying mount with new device syntax: 0@22997a4c-6fc2-11ef-bcea-c7b262605968.cephfs=/volumes/qa/sv_1/45bb5791-2315-449d-a832-cd11716fd37f 2024-09-10T22:26:07.881 INFO:teuthology.orchestra.run.smithi019.stdout:mount.ceph: options "norequire_active_mds,norbytes,ms_mode=secure,wsync,name=0,key=0,mon_addr=172.21.15.19:3300/172.21.15.135:3300/172.21.15.138:3300" will pass to kernel 2024-09-10T22:26:07.882 INFO:teuthology.orchestra.run.smithi019.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-09-10T22:26:07.882 INFO:teuthology.orchestra.run.smithi019.stdout: You just mounted a file system that supports labels which does not 2024-09-10T22:26:07.882 INFO:teuthology.orchestra.run.smithi019.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-10T22:26:07.882 INFO:teuthology.orchestra.run.smithi019.stdout: applications will generate AVC messages and not be allowed access to 2024-09-10T22:26:07.882 INFO:teuthology.orchestra.run.smithi019.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-10T22:26:07.883 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-10T22:26:07.884 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T22:26:07.884 DEBUG:teuthology.orchestra.run.smithi019:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-10T22:26:07.910 DEBUG:teuthology.orchestra.run.smithi019:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-10T22:26:08.002 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:08 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-10T22:26:08.004 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:08 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T22:26:08.010 INFO:teuthology.orchestra.run.smithi019.stdout:client24908 2024-09-10T22:26:08.010 DEBUG:teuthology.orchestra.run.smithi019:> set -ex 2024-09-10T22:26:08.010 DEBUG:teuthology.orchestra.run.smithi019:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T22:26:08.027 DEBUG:teuthology.orchestra.run.smithi019:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-10T22:26:08.116 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:08 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-10T22:26:08.118 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:08 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T22:26:08.124 INFO:teuthology.orchestra.run.smithi019.stdout:client24908 2024-09-10T22:26:08.125 DEBUG:teuthology.orchestra.run.smithi019:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-10T22:26:08.175 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:08 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-10T22:26:08.177 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:08 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T22:26:08.182 INFO:teuthology.orchestra.run.smithi019.stdout:client24908 2024-09-10T22:26:08.183 DEBUG:teuthology.orchestra.run.smithi019:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=300 -- bash -c 'sudo dd if=/sys/kernel/debug/ceph/22997a4c-6fc2-11ef-bcea-c7b262605968.client24908/status') 2024-09-10T22:26:08.232 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:08 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-10T22:26:08.241 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:26:07 smithi019 ceph-mon[31375]: pgmap v338: 97 pgs: 97 active+clean; 639 KiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 639 B/s wr, 8 op/s 2024-09-10T22:26:08.241 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:26:07 smithi019 ceph-mon[31375]: mgrmap e18: x(active, since 9m), standbys: z, y 2024-09-10T22:26:08.243 INFO:teuthology.orchestra.run.smithi019.stdout:instance: client.24908 (3)172.21.15.19:0/2553443582 2024-09-10T22:26:08.243 INFO:teuthology.orchestra.run.smithi019.stdout:blocklisted: false 2024-09-10T22:26:08.243 INFO:teuthology.orchestra.run.smithi019.stderr:0+1 records in 2024-09-10T22:26:08.243 INFO:teuthology.orchestra.run.smithi019.stderr:0+1 records out 2024-09-10T22:26:08.243 INFO:teuthology.orchestra.run.smithi019.stderr:71 bytes copied, 2.3788e-05 s, 3.0 MB/s 2024-09-10T22:26:08.244 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:08 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T22:26:08.251 INFO:teuthology.run_tasks:Running task exec... 2024-09-10T22:26:08.261 INFO:teuthology.task.exec:Executing custom commands... 2024-09-10T22:26:08.261 INFO:teuthology.task.exec:Running commands on role mon.a host ubuntu@smithi019.front.sepia.ceph.com 2024-09-10T22:26:08.261 DEBUG:teuthology.orchestra.run.smithi019:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs set cephfs balance_automate true' 2024-09-10T22:26:08.359 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:26:07 smithi135 ceph-mon[34789]: pgmap v338: 97 pgs: 97 active+clean; 639 KiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 639 B/s wr, 8 op/s 2024-09-10T22:26:08.360 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:26:07 smithi135 ceph-mon[34789]: mgrmap e18: x(active, since 9m), standbys: z, y 2024-09-10T22:26:08.368 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:08.365+0000 7fcb39b89640 1 -- 172.21.15.19:0/525845770 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fcb3406bfb0 msgr2=0x7fcb34105580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:26:08.368 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:08.365+0000 7fcb39b89640 1 --2- 172.21.15.19:0/525845770 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fcb3406bfb0 0x7fcb34105580 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7fcb24009900 tx=0x7fcb2402a410 comp rx=0 tx=0).stop 2024-09-10T22:26:08.368 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:08.365+0000 7fcb39b89640 1 -- 172.21.15.19:0/525845770 shutdown_connections 2024-09-10T22:26:08.368 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:08.365+0000 7fcb39b89640 1 --2- 172.21.15.19:0/525845770 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcb341086c0 0x7fcb3410ab80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:26:08.368 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:08.365+0000 7fcb39b89640 1 --2- 172.21.15.19:0/525845770 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fcb34105b10 0x7fcb34107f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:26:08.368 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:08.365+0000 7fcb39b89640 1 --2- 172.21.15.19:0/525845770 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fcb3406bfb0 0x7fcb34105580 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:26:08.368 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:08.365+0000 7fcb39b89640 1 -- 172.21.15.19:0/525845770 >> 172.21.15.19:0/525845770 conn(0x7fcb340fd150 msgr2=0x7fcb340ff590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:26:08.369 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:08.366+0000 7fcb39b89640 1 -- 172.21.15.19:0/525845770 shutdown_connections 2024-09-10T22:26:08.369 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:08.366+0000 7fcb39b89640 1 -- 172.21.15.19:0/525845770 wait complete. 2024-09-10T22:26:08.369 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:08.366+0000 7fcb39b89640 1 Processor -- start 2024-09-10T22:26:08.371 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:08.366+0000 7fcb39b89640 1 -- start start 2024-09-10T22:26:08.371 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:08.366+0000 7fcb39b89640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcb3406bfb0 0x7fcb3419b010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:26:08.371 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:08.366+0000 7fcb39b89640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fcb34105b10 0x7fcb3419b660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:26:08.371 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:08.366+0000 7fcb39b89640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fcb341086c0 0x7fcb3419c290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:26:08.371 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:08.366+0000 7fcb39b89640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fcb3410e610 con 0x7fcb34105b10 2024-09-10T22:26:08.371 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:08.366+0000 7fcb39b89640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fcb3410e490 con 0x7fcb3406bfb0 2024-09-10T22:26:08.371 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:08.366+0000 7fcb39b89640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7fcb3410e790 con 0x7fcb341086c0 2024-09-10T22:26:08.371 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:08.367+0000 7fcb32ffd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fcb34105b10 0x7fcb3419b660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:26:08.371 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:08.367+0000 7fcb32ffd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fcb34105b10 0x7fcb3419b660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:53478/0 (socket says 172.21.15.19:53478) 2024-09-10T22:26:08.371 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:08.367+0000 7fcb32ffd640 1 -- 172.21.15.19:0/4197331294 learned_addr learned my addr 172.21.15.19:0/4197331294 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:26:08.371 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:08.367+0000 7fcb33fff640 1 --2- 172.21.15.19:0/4197331294 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fcb341086c0 0x7fcb3419c290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:26:08.372 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:08.367+0000 7fcb337fe640 1 --2- 172.21.15.19:0/4197331294 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcb3406bfb0 0x7fcb3419b010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:26:08.372 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:08.367+0000 7fcb32ffd640 1 -- 172.21.15.19:0/4197331294 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fcb341086c0 msgr2=0x7fcb3419c290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:26:08.372 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:08.367+0000 7fcb32ffd640 1 --2- 172.21.15.19:0/4197331294 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fcb341086c0 0x7fcb3419c290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:26:08.372 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:08.367+0000 7fcb32ffd640 1 -- 172.21.15.19:0/4197331294 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcb3406bfb0 msgr2=0x7fcb3419b010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:26:08.372 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:08.367+0000 7fcb32ffd640 1 --2- 172.21.15.19:0/4197331294 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcb3406bfb0 0x7fcb3419b010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:26:08.372 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:08.367+0000 7fcb32ffd640 1 -- 172.21.15.19:0/4197331294 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcb3419cb50 con 0x7fcb34105b10 2024-09-10T22:26:08.372 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:08.367+0000 7fcb33fff640 1 --2- 172.21.15.19:0/4197331294 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fcb341086c0 0x7fcb3419c290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T22:26:08.372 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:08.367+0000 7fcb32ffd640 1 --2- 172.21.15.19:0/4197331294 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fcb34105b10 0x7fcb3419b660 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7fcb2800e9f0 tx=0x7fcb2800edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:26:08.372 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:08.367+0000 7fcb30ff9640 1 -- 172.21.15.19:0/4197331294 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb2800cd80 con 0x7fcb34105b10 2024-09-10T22:26:08.372 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:08.367+0000 7fcb30ff9640 1 -- 172.21.15.19:0/4197331294 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fcb280054d0 con 0x7fcb34105b10 2024-09-10T22:26:08.372 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:08.367+0000 7fcb39b89640 1 -- 172.21.15.19:0/4197331294 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcb3419ce40 con 0x7fcb34105b10 2024-09-10T22:26:08.372 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:08.367+0000 7fcb30ff9640 1 -- 172.21.15.19:0/4197331294 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb28010690 con 0x7fcb34105b10 2024-09-10T22:26:08.372 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:08.367+0000 7fcb39b89640 1 -- 172.21.15.19:0/4197331294 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcb341a3510 con 0x7fcb34105b10 2024-09-10T22:26:08.373 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:08.368+0000 7fcb39b89640 1 -- 172.21.15.19:0/4197331294 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcb341a36e0 con 0x7fcb34105b10 2024-09-10T22:26:08.373 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:08.370+0000 7fcb30ff9640 1 -- 172.21.15.19:0/4197331294 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 18) ==== 153250+0+0 (secure 0 0 0) 0x7fcb28004e30 con 0x7fcb34105b10 2024-09-10T22:26:08.373 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:08.370+0000 7fcb30ff9640 1 --2- 172.21.15.19:0/4197331294 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7fcb1c0b5360 0x7fcb1c0b7820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:26:08.373 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:08.371+0000 7fcb337fe640 1 --2- 172.21.15.19:0/4197331294 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7fcb1c0b5360 0x7fcb1c0b7820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:26:08.374 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:08.371+0000 7fcb30ff9640 1 -- 172.21.15.19:0/4197331294 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8327+0+0 (secure 0 0 0) 0x7fcb280e6320 con 0x7fcb34105b10 2024-09-10T22:26:08.374 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:08.371+0000 7fcb337fe640 1 --2- 172.21.15.19:0/4197331294 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7fcb1c0b5360 0x7fcb1c0b7820 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fcb24000c00 tx=0x7fcb240314a0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:26:08.374 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:26:07 smithi138 ceph-mon[35236]: pgmap v338: 97 pgs: 97 active+clean; 639 KiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 639 B/s wr, 8 op/s 2024-09-10T22:26:08.375 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:26:07 smithi138 ceph-mon[35236]: mgrmap e18: x(active, since 9m), standbys: z, y 2024-09-10T22:26:08.375 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:08.373+0000 7fcb30ff9640 1 -- 172.21.15.19:0/4197331294 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7fcb28056220 con 0x7fcb34105b10 2024-09-10T22:26:08.602 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:08.600+0000 7fcb39b89640 1 -- 172.21.15.19:0/4197331294 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"} v 0) -- 0x7fcb341a3a30 con 0x7fcb34105b10 2024-09-10T22:26:08.972 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:08.970+0000 7fcb30ff9640 1 -- 172.21.15.19:0/4197331294 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]=0 v25) ==== 117+0+0 (secure 0 0 0) 0x7fcb280ad180 con 0x7fcb34105b10 2024-09-10T22:26:08.975 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:08.972+0000 7fcb39b89640 1 -- 172.21.15.19:0/4197331294 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7fcb1c0b5360 msgr2=0x7fcb1c0b7820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:26:08.975 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:08.972+0000 7fcb39b89640 1 --2- 172.21.15.19:0/4197331294 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7fcb1c0b5360 0x7fcb1c0b7820 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fcb24000c00 tx=0x7fcb240314a0 comp rx=0 tx=0).stop 2024-09-10T22:26:08.975 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:08.972+0000 7fcb39b89640 1 -- 172.21.15.19:0/4197331294 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fcb34105b10 msgr2=0x7fcb3419b660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:26:08.975 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:08.972+0000 7fcb39b89640 1 --2- 172.21.15.19:0/4197331294 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fcb34105b10 0x7fcb3419b660 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7fcb2800e9f0 tx=0x7fcb2800edf0 comp rx=0 tx=0).stop 2024-09-10T22:26:08.975 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:08.972+0000 7fcb39b89640 1 -- 172.21.15.19:0/4197331294 shutdown_connections 2024-09-10T22:26:08.975 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:08.972+0000 7fcb39b89640 1 --2- 172.21.15.19:0/4197331294 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7fcb1c0b5360 0x7fcb1c0b7820 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:26:08.975 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:08.972+0000 7fcb39b89640 1 --2- 172.21.15.19:0/4197331294 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fcb341086c0 0x7fcb3419c290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:26:08.975 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:08.972+0000 7fcb39b89640 1 --2- 172.21.15.19:0/4197331294 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fcb34105b10 0x7fcb3419b660 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:26:08.975 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:08.972+0000 7fcb39b89640 1 --2- 172.21.15.19:0/4197331294 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcb3406bfb0 0x7fcb3419b010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:26:08.975 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:08.973+0000 7fcb39b89640 1 -- 172.21.15.19:0/4197331294 >> 172.21.15.19:0/4197331294 conn(0x7fcb340fd150 msgr2=0x7fcb340ff540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:26:08.976 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:08.973+0000 7fcb39b89640 1 -- 172.21.15.19:0/4197331294 shutdown_connections 2024-09-10T22:26:08.976 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:08.973+0000 7fcb39b89640 1 -- 172.21.15.19:0/4197331294 wait complete. 2024-09-10T22:26:08.986 INFO:teuthology.run_tasks:Running task check-counter... 2024-09-10T22:26:08.997 INFO:teuthology.run_tasks:Running task fwd_scrub... 2024-09-10T22:26:09.020 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-10T22:26:09.125 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:09.123+0000 7f99a91bb640 1 -- 172.21.15.19:0/3371356620 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f99a406bec0 msgr2=0x7f99a4105580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:26:09.126 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:09.123+0000 7f99a91bb640 1 --2- 172.21.15.19:0/3371356620 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f99a406bec0 0x7f99a4105580 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f9994009900 tx=0x7f999402a410 comp rx=0 tx=0).stop 2024-09-10T22:26:09.126 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:09.123+0000 7f99a91bb640 1 -- 172.21.15.19:0/3371356620 shutdown_connections 2024-09-10T22:26:09.126 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:09.123+0000 7f99a91bb640 1 --2- 172.21.15.19:0/3371356620 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f99a41086c0 0x7f99a410ab80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:26:09.126 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:09.123+0000 7f99a91bb640 1 --2- 172.21.15.19:0/3371356620 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f99a4105b10 0x7f99a4107f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:26:09.126 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:09.123+0000 7f99a91bb640 1 --2- 172.21.15.19:0/3371356620 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f99a406bec0 0x7f99a4105580 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:26:09.126 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:09.123+0000 7f99a91bb640 1 -- 172.21.15.19:0/3371356620 >> 172.21.15.19:0/3371356620 conn(0x7f99a40fd190 msgr2=0x7f99a40ff5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:26:09.126 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:09.123+0000 7f99a91bb640 1 -- 172.21.15.19:0/3371356620 shutdown_connections 2024-09-10T22:26:09.126 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:09.123+0000 7f99a91bb640 1 -- 172.21.15.19:0/3371356620 wait complete. 2024-09-10T22:26:09.126 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:09.124+0000 7f99a91bb640 1 Processor -- start 2024-09-10T22:26:09.129 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:09.124+0000 7f99a91bb640 1 -- start start 2024-09-10T22:26:09.129 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:09.124+0000 7f99a91bb640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f99a406bec0 0x7f99a4198e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:26:09.129 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:09.124+0000 7f99a91bb640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f99a4105b10 0x7f99a41994a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:26:09.129 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:09.124+0000 7f99a91bb640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f99a41086c0 0x7f99a419a0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:26:09.129 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:09.124+0000 7f99a91bb640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f99a410e670 con 0x7f99a41086c0 2024-09-10T22:26:09.129 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:09.124+0000 7f99a91bb640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f99a410e4f0 con 0x7f99a406bec0 2024-09-10T22:26:09.129 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:09.124+0000 7f99a91bb640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f99a410e7f0 con 0x7f99a4105b10 2024-09-10T22:26:09.129 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:09.124+0000 7f99a359e640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f99a41086c0 0x7f99a419a0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:26:09.129 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:09.124+0000 7f99a359e640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f99a41086c0 0x7f99a419a0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:53492/0 (socket says 172.21.15.19:53492) 2024-09-10T22:26:09.129 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:09.124+0000 7f99a359e640 1 -- 172.21.15.19:0/3914094410 learned_addr learned my addr 172.21.15.19:0/3914094410 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:26:09.129 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:09.124+0000 7f99a2d9d640 1 --2- 172.21.15.19:0/3914094410 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f99a406bec0 0x7f99a4198e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:26:09.130 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:09.124+0000 7f999a59c640 1 --2- 172.21.15.19:0/3914094410 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f99a4105b10 0x7f99a41994a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:26:09.130 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:09.125+0000 7f99a359e640 1 -- 172.21.15.19:0/3914094410 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f99a4105b10 msgr2=0x7f99a41994a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:26:09.130 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:09.125+0000 7f99a359e640 1 --2- 172.21.15.19:0/3914094410 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f99a4105b10 0x7f99a41994a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:26:09.130 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:09.125+0000 7f99a359e640 1 -- 172.21.15.19:0/3914094410 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f99a406bec0 msgr2=0x7f99a4198e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:26:09.130 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:09.125+0000 7f99a359e640 1 --2- 172.21.15.19:0/3914094410 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f99a406bec0 0x7f99a4198e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:26:09.130 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:09.125+0000 7f99a359e640 1 -- 172.21.15.19:0/3914094410 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f99a419a990 con 0x7f99a41086c0 2024-09-10T22:26:09.130 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:09.125+0000 7f999a59c640 1 --2- 172.21.15.19:0/3914094410 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f99a4105b10 0x7f99a41994a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T22:26:09.130 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:09.125+0000 7f99a2d9d640 1 --2- 172.21.15.19:0/3914094410 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f99a406bec0 0x7f99a4198e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T22:26:09.130 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:09.125+0000 7f99a359e640 1 --2- 172.21.15.19:0/3914094410 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f99a41086c0 0x7f99a419a0d0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f999c00eaa0 tx=0x7f999c00ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:26:09.130 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:09.125+0000 7f99a0d99640 1 -- 172.21.15.19:0/3914094410 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f999c00cdb0 con 0x7f99a41086c0 2024-09-10T22:26:09.130 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:09.125+0000 7f99a91bb640 1 -- 172.21.15.19:0/3914094410 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f99a419ac80 con 0x7f99a41086c0 2024-09-10T22:26:09.130 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:09.125+0000 7f99a0d99640 1 -- 172.21.15.19:0/3914094410 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f999c005020 con 0x7f99a41086c0 2024-09-10T22:26:09.131 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:09.125+0000 7f99a0d99640 1 -- 172.21.15.19:0/3914094410 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f999c0116d0 con 0x7f99a41086c0 2024-09-10T22:26:09.131 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:09.125+0000 7f99a91bb640 1 -- 172.21.15.19:0/3914094410 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f99a41a1350 con 0x7f99a41086c0 2024-09-10T22:26:09.131 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:09.126+0000 7f99a91bb640 1 -- 172.21.15.19:0/3914094410 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f99a40fec80 con 0x7f99a41086c0 2024-09-10T22:26:09.132 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:09.127+0000 7f99a0d99640 1 -- 172.21.15.19:0/3914094410 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 18) ==== 153250+0+0 (secure 0 0 0) 0x7f999c00f040 con 0x7f99a41086c0 2024-09-10T22:26:09.132 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:09.128+0000 7f99a0d99640 1 --2- 172.21.15.19:0/3914094410 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f99900b52e0 0x7f99900b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:26:09.132 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:09.128+0000 7f99a2d9d640 1 --2- 172.21.15.19:0/3914094410 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f99900b52e0 0x7f99900b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:26:09.132 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:09.128+0000 7f99a0d99640 1 -- 172.21.15.19:0/3914094410 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8327+0+0 (secure 0 0 0) 0x7f999c0e5f70 con 0x7f99a41086c0 2024-09-10T22:26:09.132 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:09.129+0000 7f99a2d9d640 1 --2- 172.21.15.19:0/3914094410 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f99900b52e0 0x7f99900b77a0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f9994000c00 tx=0x7f99940314a0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:26:09.133 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:09.131+0000 7f99a0d99640 1 -- 172.21.15.19:0/3914094410 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f999c016030 con 0x7f99a41086c0 2024-09-10T22:26:09.319 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:09.317+0000 7f99a91bb640 1 -- 172.21.15.19:0/3914094410 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f99a402e7c0 con 0x7f99a41086c0 2024-09-10T22:26:09.320 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:09.318+0000 7f99a0d99640 1 -- 172.21.15.19:0/3914094410 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v77) ==== 74+0+22854 (secure 0 0 0) 0x7f999c0acdd0 con 0x7f99a41086c0 2024-09-10T22:26:09.321 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-10T22:26:09.321 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":77,"fsid":"22997a4c-6fc2-11ef-bcea-c7b262605968","created":"2024-09-10T22:16:16.754696+0000","modified":"2024-09-10T22:26:05.946930+0000","last_up_change":"2024-09-10T22:23:32.417392+0000","last_in_change":"2024-09-10T22:23:09.614371+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T22:19:50.731662+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-10T22:24:18.740121+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"73","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-10T22:24:20.795178+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"73","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"783d96cb-0a8a-47f3-8eab-77cd731a64bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6802","nonce":234761879},{"type":"v1","addr":"172.21.15.19:6803","nonce":234761879}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6804","nonce":234761879},{"type":"v1","addr":"172.21.15.19:6805","nonce":234761879}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6808","nonce":234761879},{"type":"v1","addr":"172.21.15.19:6809","nonce":234761879}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6806","nonce":234761879},{"type":"v1","addr":"172.21.15.19:6807","nonce":234761879}]},"public_addr":"172.21.15.19:6803/234761879","cluster_addr":"172.21.15.19:6805/234761879","heartbeat_back_addr":"172.21.15.19:6809/234761879","heartbeat_front_addr":"172.21.15.19:6807/234761879","state":["exists","up"]},{"osd":1,"uuid":"41043581-e0cf-43b5-bae0-0d95e2ef8156","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6800","nonce":1803526886},{"type":"v1","addr":"172.21.15.135:6801","nonce":1803526886}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6802","nonce":1803526886},{"type":"v1","addr":"172.21.15.135:6803","nonce":1803526886}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6806","nonce":1803526886},{"type":"v1","addr":"172.21.15.135:6807","nonce":1803526886}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6804","nonce":1803526886},{"type":"v1","addr":"172.21.15.135:6805","nonce":1803526886}]},"public_addr":"172.21.15.135:6801/1803526886","cluster_addr":"172.21.15.135:6803/1803526886","heartbeat_back_addr":"172.21.15.135:6807/1803526886","heartbeat_front_addr":"172.21.15.135:6805/1803526886","state":["exists","up"]},{"osd":2,"uuid":"a9b14a06-bbdc-4501-96e2-fb5f7127ca16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6800","nonce":2747418770},{"type":"v1","addr":"172.21.15.138:6801","nonce":2747418770}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6802","nonce":2747418770},{"type":"v1","addr":"172.21.15.138:6803","nonce":2747418770}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6806","nonce":2747418770},{"type":"v1","addr":"172.21.15.138:6807","nonce":2747418770}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6804","nonce":2747418770},{"type":"v1","addr":"172.21.15.138:6805","nonce":2747418770}]},"public_addr":"172.21.15.138:6801/2747418770","cluster_addr":"172.21.15.138:6803/2747418770","heartbeat_back_addr":"172.21.15.138:6807/2747418770","heartbeat_front_addr":"172.21.15.138:6805/2747418770","state":["exists","up"]},{"osd":3,"uuid":"a46268da-8666-4cfa-b11a-30eb12e271be","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":23,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6810","nonce":1889857224},{"type":"v1","addr":"172.21.15.19:6811","nonce":1889857224}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6812","nonce":1889857224},{"type":"v1","addr":"172.21.15.19:6813","nonce":1889857224}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6816","nonce":1889857224},{"type":"v1","addr":"172.21.15.19:6817","nonce":1889857224}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6814","nonce":1889857224},{"type":"v1","addr":"172.21.15.19:6815","nonce":1889857224}]},"public_addr":"172.21.15.19:6811/1889857224","cluster_addr":"172.21.15.19:6813/1889857224","heartbeat_back_addr":"172.21.15.19:6817/1889857224","heartbeat_front_addr":"172.21.15.19:6815/1889857224","state":["exists","up"]},{"osd":4,"uuid":"c58df06f-2de2-4655-88e7-ac6a3531839a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":29,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6808","nonce":436311825},{"type":"v1","addr":"172.21.15.135:6809","nonce":436311825}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6810","nonce":436311825},{"type":"v1","addr":"172.21.15.135:6811","nonce":436311825}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6814","nonce":436311825},{"type":"v1","addr":"172.21.15.135:6815","nonce":436311825}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6812","nonce":436311825},{"type":"v1","addr":"172.21.15.135:6813","nonce":436311825}]},"public_addr":"172.21.15.135:6809/436311825","cluster_addr":"172.21.15.135:6811/436311825","heartbeat_back_addr":"172.21.15.135:6815/436311825","heartbeat_front_addr":"172.21.15.135:6813/436311825","state":["exists","up"]},{"osd":5,"uuid":"c0900b0c-aef4-498d-a01b-a891bdb51122","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6808","nonce":1086764290},{"type":"v1","addr":"172.21.15.138:6809","nonce":1086764290}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6810","nonce":1086764290},{"type":"v1","addr":"172.21.15.138:6811","nonce":1086764290}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6814","nonce":1086764290},{"type":"v1","addr":"172.21.15.138:6815","nonce":1086764290}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6812","nonce":1086764290},{"type":"v1","addr":"172.21.15.138:6813","nonce":1086764290}]},"public_addr":"172.21.15.138:6809/1086764290","cluster_addr":"172.21.15.138:6811/1086764290","heartbeat_back_addr":"172.21.15.138:6815/1086764290","heartbeat_front_addr":"172.21.15.138:6813/1086764290","state":["exists","up"]},{"osd":6,"uuid":"f79cb310-8073-4ee5-80a6-87a290600321","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":40,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6818","nonce":406328354},{"type":"v1","addr":"172.21.15.19:6819","nonce":406328354}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6820","nonce":406328354},{"type":"v1","addr":"172.21.15.19:6821","nonce":406328354}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6824","nonce":406328354},{"type":"v1","addr":"172.21.15.19:6825","nonce":406328354}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6822","nonce":406328354},{"type":"v1","addr":"172.21.15.19:6823","nonce":406328354}]},"public_addr":"172.21.15.19:6819/406328354","cluster_addr":"172.21.15.19:6821/406328354","heartbeat_back_addr":"172.21.15.19:6825/406328354","heartbeat_front_addr":"172.21.15.19:6823/406328354","state":["exists","up"]},{"osd":7,"uuid":"cc76476a-92f3-489c-be9e-29cbbf39539e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6816","nonce":1096613674},{"type":"v1","addr":"172.21.15.135:6817","nonce":1096613674}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6818","nonce":1096613674},{"type":"v1","addr":"172.21.15.135:6819","nonce":1096613674}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6822","nonce":1096613674},{"type":"v1","addr":"172.21.15.135:6823","nonce":1096613674}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6820","nonce":1096613674},{"type":"v1","addr":"172.21.15.135:6821","nonce":1096613674}]},"public_addr":"172.21.15.135:6817/1096613674","cluster_addr":"172.21.15.135:6819/1096613674","heartbeat_back_addr":"172.21.15.135:6823/1096613674","heartbeat_front_addr":"172.21.15.135:6821/1096613674","state":["exists","up"]},{"osd":8,"uuid":"5323a006-a6e8-4403-9c51-65f46298d5c4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6816","nonce":3020394729},{"type":"v1","addr":"172.21.15.138:6817","nonce":3020394729}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6818","nonce":3020394729},{"type":"v1","addr":"172.21.15.138:6819","nonce":3020394729}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6822","nonce":3020394729},{"type":"v1","addr":"172.21.15.138:6823","nonce":3020394729}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6820","nonce":3020394729},{"type":"v1","addr":"172.21.15.138:6821","nonce":3020394729}]},"public_addr":"172.21.15.138:6817/3020394729","cluster_addr":"172.21.15.138:6819/3020394729","heartbeat_back_addr":"172.21.15.138:6823/3020394729","heartbeat_front_addr":"172.21.15.138:6821/3020394729","state":["exists","up"]},{"osd":9,"uuid":"b869ac42-c46e-442c-8b5b-f81c018e663c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":57,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6826","nonce":1488680899},{"type":"v1","addr":"172.21.15.19:6827","nonce":1488680899}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6828","nonce":1488680899},{"type":"v1","addr":"172.21.15.19:6829","nonce":1488680899}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6832","nonce":1488680899},{"type":"v1","addr":"172.21.15.19:6833","nonce":1488680899}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6830","nonce":1488680899},{"type":"v1","addr":"172.21.15.19:6831","nonce":1488680899}]},"public_addr":"172.21.15.19:6827/1488680899","cluster_addr":"172.21.15.19:6829/1488680899","heartbeat_back_addr":"172.21.15.19:6833/1488680899","heartbeat_front_addr":"172.21.15.19:6831/1488680899","state":["exists","up"]},{"osd":10,"uuid":"b8a2d69a-6821-4c69-b7eb-c0cfc8164614","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":62,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6824","nonce":3812626754},{"type":"v1","addr":"172.21.15.135:6825","nonce":3812626754}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6826","nonce":3812626754},{"type":"v1","addr":"172.21.15.135:6827","nonce":3812626754}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6830","nonce":3812626754},{"type":"v1","addr":"172.21.15.135:6831","nonce":3812626754}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6828","nonce":3812626754},{"type":"v1","addr":"172.21.15.135:6829","nonce":3812626754}]},"public_addr":"172.21.15.135:6825/3812626754","cluster_addr":"172.21.15.135:6827/3812626754","heartbeat_back_addr":"172.21.15.135:6831/3812626754","heartbeat_front_addr":"172.21.15.135:6829/3812626754","state":["exists","up"]},{"osd":11,"uuid":"a9264ab2-5843-44d2-aba8-1e12708e99d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6824","nonce":1098434807},{"type":"v1","addr":"172.21.15.138:6825","nonce":1098434807}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6826","nonce":1098434807},{"type":"v1","addr":"172.21.15.138:6827","nonce":1098434807}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6830","nonce":1098434807},{"type":"v1","addr":"172.21.15.138:6831","nonce":1098434807}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6828","nonce":1098434807},{"type":"v1","addr":"172.21.15.138:6829","nonce":1098434807}]},"public_addr":"172.21.15.138:6825/1098434807","cluster_addr":"172.21.15.138:6827/1098434807","heartbeat_back_addr":"172.21.15.138:6831/1098434807","heartbeat_front_addr":"172.21.15.138:6829/1098434807","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:18:58.008025+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:19:22.475890+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:19:47.124147+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:20:12.438853+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:20:37.195177+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:21:02.474248+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:21:27.087207+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:21:52.119211+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:22:16.569989+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:22:41.680986+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:23:06.391885+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:23:30.695460+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.0","mappings":[{"from":8,"to":4}]},{"pgid":"2.c","mappings":[{"from":2,"to":4}]},{"pgid":"2.d","mappings":[{"from":5,"to":11}]},{"pgid":"2.16","mappings":[{"from":2,"to":6}]},{"pgid":"2.17","mappings":[{"from":5,"to":1}]},{"pgid":"2.1a","mappings":[{"from":8,"to":1}]},{"pgid":"2.1d","mappings":[{"from":2,"to":4}]},{"pgid":"2.1f","mappings":[{"from":7,"to":11}]},{"pgid":"3.13","mappings":[{"from":4,"to":9}]},{"pgid":"3.1b","mappings":[{"from":4,"to":8}]},{"pgid":"3.21","mappings":[{"from":5,"to":9}]},{"pgid":"3.38","mappings":[{"from":3,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.19:0/2099468127":"2024-09-11T22:17:04.260826+0000","172.21.15.19:0/538724915":"2024-09-11T22:17:04.260826+0000","172.21.15.19:0/3504695777":"2024-09-11T22:17:04.260826+0000","172.21.15.19:0/1401613792":"2024-09-11T22:16:39.069638+0000","172.21.15.19:6801/3005924425":"2024-09-11T22:17:04.260826+0000","172.21.15.19:6800/3005924425":"2024-09-11T22:17:04.260826+0000","172.21.15.19:0/104917892":"2024-09-11T22:16:39.069638+0000","172.21.15.19:0/1778305990":"2024-09-11T22:16:39.069638+0000","172.21.15.19:6801/535670059":"2024-09-11T22:16:39.069638+0000","172.21.15.19:6800/535670059":"2024-09-11T22:16:39.069638+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T22:26:09.323 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:09.320+0000 7f99a91bb640 1 -- 172.21.15.19:0/3914094410 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f99900b52e0 msgr2=0x7f99900b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:26:09.323 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:09.320+0000 7f99a91bb640 1 --2- 172.21.15.19:0/3914094410 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f99900b52e0 0x7f99900b77a0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f9994000c00 tx=0x7f99940314a0 comp rx=0 tx=0).stop 2024-09-10T22:26:09.323 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:09.320+0000 7f99a91bb640 1 -- 172.21.15.19:0/3914094410 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f99a41086c0 msgr2=0x7f99a419a0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:26:09.323 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:09.320+0000 7f99a91bb640 1 --2- 172.21.15.19:0/3914094410 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f99a41086c0 0x7f99a419a0d0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f999c00eaa0 tx=0x7f999c00ef60 comp rx=0 tx=0).stop 2024-09-10T22:26:09.323 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:09.320+0000 7f99a91bb640 1 -- 172.21.15.19:0/3914094410 shutdown_connections 2024-09-10T22:26:09.323 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:09.320+0000 7f99a91bb640 1 --2- 172.21.15.19:0/3914094410 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f99900b52e0 0x7f99900b77a0 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:26:09.323 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:09.320+0000 7f99a91bb640 1 --2- 172.21.15.19:0/3914094410 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f99a41086c0 0x7f99a419a0d0 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:26:09.323 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:09.320+0000 7f99a91bb640 1 --2- 172.21.15.19:0/3914094410 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f99a4105b10 0x7f99a41994a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:26:09.323 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:09.320+0000 7f99a91bb640 1 --2- 172.21.15.19:0/3914094410 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f99a406bec0 0x7f99a4198e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:26:09.324 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:09.320+0000 7f99a91bb640 1 -- 172.21.15.19:0/3914094410 >> 172.21.15.19:0/3914094410 conn(0x7f99a40fd190 msgr2=0x7f99a4103d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:26:09.324 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:09.321+0000 7f99a91bb640 1 -- 172.21.15.19:0/3914094410 shutdown_connections 2024-09-10T22:26:09.324 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:09.321+0000 7f99a91bb640 1 -- 172.21.15.19:0/3914094410 wait complete. 2024-09-10T22:26:09.332 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:26:08 smithi019 ceph-mon[31375]: from='client.? 172.21.15.19:0/4197331294' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"} : dispatch 2024-09-10T22:26:09.334 INFO:tasks.fwd_scrub.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-10T22:19:50.731662+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-10T22:24:18.740121+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '73', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-09-10T22:24:20.795178+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '73', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-10T22:26:09.335 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-10T22:26:09.359 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:26:08 smithi135 ceph-mon[34789]: from='client.? 172.21.15.19:0/4197331294' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"} : dispatch 2024-09-10T22:26:09.375 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:26:08 smithi138 ceph-mon[35236]: from='client.? 172.21.15.19:0/4197331294' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"} : dispatch 2024-09-10T22:26:09.445 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:09.439+0000 7f0152a6b640 1 -- 172.21.15.19:0/714186916 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f014c1033a0 msgr2=0x7f014c109d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:26:09.445 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:09.439+0000 7f0152a6b640 1 --2- 172.21.15.19:0/714186916 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f014c1033a0 0x7f014c109d20 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f0144009cd0 tx=0x7f014402a8e0 comp rx=0 tx=0).stop 2024-09-10T22:26:09.445 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:09.439+0000 7f0152a6b640 1 -- 172.21.15.19:0/714186916 shutdown_connections 2024-09-10T22:26:09.445 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:09.439+0000 7f0152a6b640 1 --2- 172.21.15.19:0/714186916 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f014c1033a0 0x7f014c109d20 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:26:09.446 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:09.439+0000 7f0152a6b640 1 --2- 172.21.15.19:0/714186916 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f014c1029e0 0x7f014c102e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:26:09.446 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:09.439+0000 7f0152a6b640 1 --2- 172.21.15.19:0/714186916 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f014c101890 0x7f014c101c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:26:09.446 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:09.439+0000 7f0152a6b640 1 -- 172.21.15.19:0/714186916 >> 172.21.15.19:0/714186916 conn(0x7f014c0fd150 msgr2=0x7f014c0ff570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:26:09.446 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:09.439+0000 7f0152a6b640 1 -- 172.21.15.19:0/714186916 shutdown_connections 2024-09-10T22:26:09.446 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:09.439+0000 7f0152a6b640 1 -- 172.21.15.19:0/714186916 wait complete. 2024-09-10T22:26:09.446 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:09.440+0000 7f0152a6b640 1 Processor -- start 2024-09-10T22:26:09.447 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:09.440+0000 7f0152a6b640 1 -- start start 2024-09-10T22:26:09.447 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:09.440+0000 7f0152a6b640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f014c101890 0x7f014c198d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:26:09.447 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:09.440+0000 7f0152a6b640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f014c1029e0 0x7f014c199350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:26:09.447 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:09.440+0000 7f0152a6b640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f014c1033a0 0x7f014c199f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:26:09.447 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:09.440+0000 7f0152a6b640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f014c10d4e0 con 0x7f014c1033a0 2024-09-10T22:26:09.448 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:09.440+0000 7f0152a6b640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f014c10d360 con 0x7f014c101890 2024-09-10T22:26:09.448 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:09.440+0000 7f0152a6b640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f014c10d660 con 0x7f014c1029e0 2024-09-10T22:26:09.448 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:09.440+0000 7f0151008640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f014c1033a0 0x7f014c199f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:26:09.448 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:09.440+0000 7f0151008640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f014c1033a0 0x7f014c199f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:53514/0 (socket says 172.21.15.19:53514) 2024-09-10T22:26:09.448 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:09.440+0000 7f0151008640 1 -- 172.21.15.19:0/4184990242 learned_addr learned my addr 172.21.15.19:0/4184990242 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:26:09.448 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:09.440+0000 7f0150807640 1 --2- 172.21.15.19:0/4184990242 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f014c101890 0x7f014c198d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:26:09.449 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:09.440+0000 7f0151008640 1 -- 172.21.15.19:0/4184990242 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f014c1029e0 msgr2=0x7f014c199350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:26:09.449 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:09.440+0000 7f014bfff640 1 --2- 172.21.15.19:0/4184990242 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f014c1029e0 0x7f014c199350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:26:09.449 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:09.440+0000 7f0151008640 1 --2- 172.21.15.19:0/4184990242 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f014c1029e0 0x7f014c199350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:26:09.449 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:09.440+0000 7f0151008640 1 -- 172.21.15.19:0/4184990242 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f014c101890 msgr2=0x7f014c198d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:26:09.449 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:09.440+0000 7f0151008640 1 --2- 172.21.15.19:0/4184990242 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f014c101890 0x7f014c198d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:26:09.450 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:09.440+0000 7f0151008640 1 -- 172.21.15.19:0/4184990242 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f014c19a840 con 0x7f014c1033a0 2024-09-10T22:26:09.450 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:09.440+0000 7f0150807640 1 --2- 172.21.15.19:0/4184990242 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f014c101890 0x7f014c198d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T22:26:09.450 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:09.441+0000 7f0151008640 1 --2- 172.21.15.19:0/4184990242 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f014c1033a0 0x7f014c199f80 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f0144033040 tx=0x7f0144003c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:26:09.450 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:09.441+0000 7f0149ffb640 1 -- 172.21.15.19:0/4184990242 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0144004450 con 0x7f014c1033a0 2024-09-10T22:26:09.450 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:09.441+0000 7f0152a6b640 1 -- 172.21.15.19:0/4184990242 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f014c19aad0 con 0x7f014c1033a0 2024-09-10T22:26:09.450 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:09.441+0000 7f0149ffb640 1 -- 172.21.15.19:0/4184990242 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0144003e10 con 0x7f014c1033a0 2024-09-10T22:26:09.451 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:09.441+0000 7f0149ffb640 1 -- 172.21.15.19:0/4184990242 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f014403b400 con 0x7f014c1033a0 2024-09-10T22:26:09.451 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:09.441+0000 7f0152a6b640 1 -- 172.21.15.19:0/4184990242 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f014c1a1200 con 0x7f014c1033a0 2024-09-10T22:26:09.451 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:09.442+0000 7f0152a6b640 1 -- 172.21.15.19:0/4184990242 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f014c1a13d0 con 0x7f014c1033a0 2024-09-10T22:26:09.453 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:09.443+0000 7f0149ffb640 1 -- 172.21.15.19:0/4184990242 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 18) ==== 153250+0+0 (secure 0 0 0) 0x7f014404d020 con 0x7f014c1033a0 2024-09-10T22:26:09.453 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:09.444+0000 7f0149ffb640 1 --2- 172.21.15.19:0/4184990242 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f013c0b52e0 0x7f013c0b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:26:09.453 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:09.444+0000 7f0149ffb640 1 -- 172.21.15.19:0/4184990242 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8327+0+0 (secure 0 0 0) 0x7f014402e030 con 0x7f014c1033a0 2024-09-10T22:26:09.453 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:09.444+0000 7f0150807640 1 --2- 172.21.15.19:0/4184990242 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f013c0b52e0 0x7f013c0b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:26:09.453 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:09.445+0000 7f0150807640 1 --2- 172.21.15.19:0/4184990242 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f013c0b52e0 0x7f013c0b77a0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f01400058c0 tx=0x7f0140005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:26:09.454 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:09.447+0000 7f0149ffb640 1 -- 172.21.15.19:0/4184990242 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f01440cdb60 con 0x7f014c1033a0 2024-09-10T22:26:09.634 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:09.632+0000 7f0152a6b640 1 -- 172.21.15.19:0/4184990242 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f014c1a15a0 con 0x7f014c1033a0 2024-09-10T22:26:09.635 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:09.633+0000 7f0149ffb640 1 -- 172.21.15.19:0/4184990242 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v77) ==== 93+0+10 (secure 0 0 0) 0x7f01440cd460 con 0x7f014c1033a0 2024-09-10T22:26:09.635 INFO:teuthology.orchestra.run.smithi019.stdout:pg_num: 1 2024-09-10T22:26:09.637 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:09.635+0000 7f0152a6b640 1 -- 172.21.15.19:0/4184990242 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f013c0b52e0 msgr2=0x7f013c0b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:26:09.638 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:09.635+0000 7f0152a6b640 1 --2- 172.21.15.19:0/4184990242 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f013c0b52e0 0x7f013c0b77a0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f01400058c0 tx=0x7f0140005850 comp rx=0 tx=0).stop 2024-09-10T22:26:09.638 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:09.635+0000 7f0152a6b640 1 -- 172.21.15.19:0/4184990242 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f014c1033a0 msgr2=0x7f014c199f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:26:09.638 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:09.635+0000 7f0152a6b640 1 --2- 172.21.15.19:0/4184990242 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f014c1033a0 0x7f014c199f80 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f0144033040 tx=0x7f0144003c20 comp rx=0 tx=0).stop 2024-09-10T22:26:09.638 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:09.635+0000 7f0152a6b640 1 -- 172.21.15.19:0/4184990242 shutdown_connections 2024-09-10T22:26:09.638 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:09.635+0000 7f0152a6b640 1 --2- 172.21.15.19:0/4184990242 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f013c0b52e0 0x7f013c0b77a0 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:26:09.638 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:09.635+0000 7f0152a6b640 1 --2- 172.21.15.19:0/4184990242 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f014c1033a0 0x7f014c199f80 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:26:09.638 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:09.635+0000 7f0152a6b640 1 --2- 172.21.15.19:0/4184990242 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f014c1029e0 0x7f014c199350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:26:09.638 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:09.635+0000 7f0152a6b640 1 --2- 172.21.15.19:0/4184990242 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f014c101890 0x7f014c198d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:26:09.638 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:09.635+0000 7f0152a6b640 1 -- 172.21.15.19:0/4184990242 >> 172.21.15.19:0/4184990242 conn(0x7f014c0fd150 msgr2=0x7f014c0feae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:26:09.638 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:09.635+0000 7f0152a6b640 1 -- 172.21.15.19:0/4184990242 shutdown_connections 2024-09-10T22:26:09.638 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:09.635+0000 7f0152a6b640 1 -- 172.21.15.19:0/4184990242 wait complete. 2024-09-10T22:26:09.648 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-10T22:26:09.758 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:09.752+0000 7f107b59e640 1 -- 172.21.15.19:0/287963046 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f107c1016b0 msgr2=0x7f107c101ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:26:09.758 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:09.752+0000 7f107b59e640 1 --2- 172.21.15.19:0/287963046 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f107c1016b0 0x7f107c101ab0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f106c009930 tx=0x7f106c02a420 comp rx=0 tx=0).stop 2024-09-10T22:26:09.758 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:09.753+0000 7f107b59e640 1 -- 172.21.15.19:0/287963046 shutdown_connections 2024-09-10T22:26:09.758 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:09.753+0000 7f107b59e640 1 --2- 172.21.15.19:0/287963046 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f107c1031c0 0x7f107c109b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:26:09.759 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:09.753+0000 7f107b59e640 1 --2- 172.21.15.19:0/287963046 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f107c102800 0x7f107c102c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:26:09.759 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:09.753+0000 7f107b59e640 1 --2- 172.21.15.19:0/287963046 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f107c1016b0 0x7f107c101ab0 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:26:09.759 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:09.753+0000 7f107b59e640 1 -- 172.21.15.19:0/287963046 >> 172.21.15.19:0/287963046 conn(0x7f107c0fcf50 msgr2=0x7f107c0ff390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:26:09.759 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:09.753+0000 7f107b59e640 1 -- 172.21.15.19:0/287963046 shutdown_connections 2024-09-10T22:26:09.759 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:09.753+0000 7f107b59e640 1 -- 172.21.15.19:0/287963046 wait complete. 2024-09-10T22:26:09.759 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:09.753+0000 7f107b59e640 1 Processor -- start 2024-09-10T22:26:09.759 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:09.753+0000 7f107b59e640 1 -- start start 2024-09-10T22:26:09.759 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:09.753+0000 7f107b59e640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f107c1016b0 0x7f107c105470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:26:09.759 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:09.753+0000 7f107b59e640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f107c102800 0x7f107c103cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:26:09.759 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:09.753+0000 7f107b59e640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f107c1031c0 0x7f107c104210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:26:09.760 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:09.753+0000 7f107b59e640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f107c10d3d0 con 0x7f107c1016b0 2024-09-10T22:26:09.760 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:09.753+0000 7f107b59e640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f107c10d250 con 0x7f107c102800 2024-09-10T22:26:09.760 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:09.753+0000 7f107b59e640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f107c10d550 con 0x7f107c1031c0 2024-09-10T22:26:09.760 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:09.754+0000 7f107a59c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f107c1016b0 0x7f107c105470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:26:09.760 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:09.754+0000 7f107a59c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f107c1016b0 0x7f107c105470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:53528/0 (socket says 172.21.15.19:53528) 2024-09-10T22:26:09.760 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:09.754+0000 7f107a59c640 1 -- 172.21.15.19:0/3525915898 learned_addr learned my addr 172.21.15.19:0/3525915898 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:26:09.761 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:09.754+0000 7f1073fff640 1 --2- 172.21.15.19:0/3525915898 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f107c102800 0x7f107c103cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:26:09.761 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:09.754+0000 7f107ad9d640 1 --2- 172.21.15.19:0/3525915898 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f107c1031c0 0x7f107c104210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:26:09.761 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:09.754+0000 7f107a59c640 1 -- 172.21.15.19:0/3525915898 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f107c1031c0 msgr2=0x7f107c104210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:26:09.761 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:09.754+0000 7f107a59c640 1 --2- 172.21.15.19:0/3525915898 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f107c1031c0 0x7f107c104210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:26:09.761 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:09.754+0000 7f107a59c640 1 -- 172.21.15.19:0/3525915898 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f107c102800 msgr2=0x7f107c103cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:26:09.761 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:09.754+0000 7f107a59c640 1 --2- 172.21.15.19:0/3525915898 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f107c102800 0x7f107c103cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:26:09.761 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:09.754+0000 7f107a59c640 1 -- 172.21.15.19:0/3525915898 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f107c104a80 con 0x7f107c1016b0 2024-09-10T22:26:09.761 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:09.754+0000 7f1073fff640 1 --2- 172.21.15.19:0/3525915898 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f107c102800 0x7f107c103cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T22:26:09.761 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:09.754+0000 7f107ad9d640 1 --2- 172.21.15.19:0/3525915898 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f107c1031c0 0x7f107c104210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T22:26:09.761 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:09.754+0000 7f107a59c640 1 --2- 172.21.15.19:0/3525915898 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f107c1016b0 0x7f107c105470 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f106c031500 tx=0x7f106c003d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:26:09.761 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:09.754+0000 7f10737fe640 1 -- 172.21.15.19:0/3525915898 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f106c03f070 con 0x7f107c1016b0 2024-09-10T22:26:09.762 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:09.754+0000 7f10737fe640 1 -- 172.21.15.19:0/3525915898 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f106c03b460 con 0x7f107c1016b0 2024-09-10T22:26:09.762 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:09.754+0000 7f107b59e640 1 -- 172.21.15.19:0/3525915898 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f107c1a2c10 con 0x7f107c1016b0 2024-09-10T22:26:09.762 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:09.754+0000 7f10737fe640 1 -- 172.21.15.19:0/3525915898 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f106c035030 con 0x7f107c1016b0 2024-09-10T22:26:09.762 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:09.754+0000 7f107b59e640 1 -- 172.21.15.19:0/3525915898 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f107c1a3120 con 0x7f107c1016b0 2024-09-10T22:26:09.762 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:09.755+0000 7f107b59e640 1 -- 172.21.15.19:0/3525915898 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f107c1a32f0 con 0x7f107c1016b0 2024-09-10T22:26:09.763 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:09.757+0000 7f10737fe640 1 -- 172.21.15.19:0/3525915898 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 18) ==== 153250+0+0 (secure 0 0 0) 0x7f106c03b910 con 0x7f107c1016b0 2024-09-10T22:26:09.763 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:09.757+0000 7f10737fe640 1 --2- 172.21.15.19:0/3525915898 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f10680b5360 0x7f10680b7820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:26:09.763 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:09.757+0000 7f1073fff640 1 --2- 172.21.15.19:0/3525915898 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f10680b5360 0x7f10680b7820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:26:09.763 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:09.758+0000 7f10737fe640 1 -- 172.21.15.19:0/3525915898 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8327+0+0 (secure 0 0 0) 0x7f106c106d10 con 0x7f107c1016b0 2024-09-10T22:26:09.763 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:09.758+0000 7f1073fff640 1 --2- 172.21.15.19:0/3525915898 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f10680b5360 0x7f10680b7820 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f1064009930 tx=0x7f1064008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:26:09.763 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:09.760+0000 7f10737fe640 1 -- 172.21.15.19:0/3525915898 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f106c0cdbf0 con 0x7f107c1016b0 2024-09-10T22:26:09.947 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:09.945+0000 7f107b59e640 1 -- 172.21.15.19:0/3525915898 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f107c1a34c0 con 0x7f107c1016b0 2024-09-10T22:26:09.947 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:09.945+0000 7f10737fe640 1 -- 172.21.15.19:0/3525915898 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v77) ==== 104+0+11 (secure 0 0 0) 0x7f106c0d63a0 con 0x7f107c1016b0 2024-09-10T22:26:09.948 INFO:teuthology.orchestra.run.smithi019.stdout:pg_num: 32 2024-09-10T22:26:09.950 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:09.947+0000 7f107b59e640 1 -- 172.21.15.19:0/3525915898 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f10680b5360 msgr2=0x7f10680b7820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:26:09.950 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:09.947+0000 7f107b59e640 1 --2- 172.21.15.19:0/3525915898 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f10680b5360 0x7f10680b7820 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f1064009930 tx=0x7f1064008040 comp rx=0 tx=0).stop 2024-09-10T22:26:09.950 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:09.947+0000 7f107b59e640 1 -- 172.21.15.19:0/3525915898 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f107c1016b0 msgr2=0x7f107c105470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:26:09.950 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:09.947+0000 7f107b59e640 1 --2- 172.21.15.19:0/3525915898 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f107c1016b0 0x7f107c105470 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f106c031500 tx=0x7f106c003d50 comp rx=0 tx=0).stop 2024-09-10T22:26:09.950 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:09.947+0000 7f107b59e640 1 -- 172.21.15.19:0/3525915898 shutdown_connections 2024-09-10T22:26:09.950 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:09.947+0000 7f107b59e640 1 --2- 172.21.15.19:0/3525915898 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f10680b5360 0x7f10680b7820 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:26:09.950 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:09.947+0000 7f107b59e640 1 --2- 172.21.15.19:0/3525915898 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f107c1031c0 0x7f107c104210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:26:09.950 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:09.947+0000 7f107b59e640 1 --2- 172.21.15.19:0/3525915898 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f107c102800 0x7f107c103cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:26:09.951 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:09.947+0000 7f107b59e640 1 --2- 172.21.15.19:0/3525915898 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f107c1016b0 0x7f107c105470 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:26:09.951 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:09.947+0000 7f107b59e640 1 -- 172.21.15.19:0/3525915898 >> 172.21.15.19:0/3525915898 conn(0x7f107c0fcf50 msgr2=0x7f107c0fe910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:26:09.951 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:09.947+0000 7f107b59e640 1 -- 172.21.15.19:0/3525915898 shutdown_connections 2024-09-10T22:26:09.951 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:09.948+0000 7f107b59e640 1 -- 172.21.15.19:0/3525915898 wait complete. 2024-09-10T22:26:09.961 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-10T22:26:10.071 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:10.066+0000 7fdb4172b640 1 -- 172.21.15.19:0/438617769 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdb3c105b30 msgr2=0x7fdb3c107f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:26:10.072 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:10.066+0000 7fdb4172b640 1 --2- 172.21.15.19:0/438617769 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdb3c105b30 0x7fdb3c107f40 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7fdb30009900 tx=0x7fdb3002a410 comp rx=0 tx=0).stop 2024-09-10T22:26:10.072 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:10.066+0000 7fdb4172b640 1 -- 172.21.15.19:0/438617769 shutdown_connections 2024-09-10T22:26:10.072 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:10.066+0000 7fdb4172b640 1 --2- 172.21.15.19:0/438617769 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fdb3c108680 0x7fdb3c10ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:26:10.072 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:10.066+0000 7fdb4172b640 1 --2- 172.21.15.19:0/438617769 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdb3c105b30 0x7fdb3c107f40 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:26:10.072 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:10.066+0000 7fdb4172b640 1 --2- 172.21.15.19:0/438617769 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdb3c06af00 0x7fdb3c1055f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:26:10.072 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:10.066+0000 7fdb4172b640 1 -- 172.21.15.19:0/438617769 >> 172.21.15.19:0/438617769 conn(0x7fdb3c0fd140 msgr2=0x7fdb3c0ff560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:26:10.072 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:10.066+0000 7fdb4172b640 1 -- 172.21.15.19:0/438617769 shutdown_connections 2024-09-10T22:26:10.073 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:10.066+0000 7fdb4172b640 1 -- 172.21.15.19:0/438617769 wait complete. 2024-09-10T22:26:10.073 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:10.067+0000 7fdb4172b640 1 Processor -- start 2024-09-10T22:26:10.073 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:10.067+0000 7fdb4172b640 1 -- start start 2024-09-10T22:26:10.073 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:10.067+0000 7fdb4172b640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdb3c06af00 0x7fdb3c198d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:26:10.073 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:10.067+0000 7fdb4172b640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fdb3c105b30 0x7fdb3c1993e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:26:10.073 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:10.067+0000 7fdb4172b640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdb3c108680 0x7fdb3c19a010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:26:10.073 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:10.067+0000 7fdb4172b640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fdb3c10e5d0 con 0x7fdb3c108680 2024-09-10T22:26:10.074 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:10.067+0000 7fdb4172b640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fdb3c10e450 con 0x7fdb3c06af00 2024-09-10T22:26:10.074 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:10.067+0000 7fdb4172b640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7fdb3c10e750 con 0x7fdb3c105b30 2024-09-10T22:26:10.074 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:10.067+0000 7fdb3b7fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdb3c108680 0x7fdb3c19a010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:26:10.074 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:10.067+0000 7fdb3b7fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdb3c108680 0x7fdb3c19a010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:53544/0 (socket says 172.21.15.19:53544) 2024-09-10T22:26:10.074 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:10.067+0000 7fdb3b7fe640 1 -- 172.21.15.19:0/331788404 learned_addr learned my addr 172.21.15.19:0/331788404 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:26:10.074 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:10.068+0000 7fdb3affd640 1 --2- 172.21.15.19:0/331788404 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdb3c06af00 0x7fdb3c198d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:26:10.074 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:10.068+0000 7fdb3a7fc640 1 --2- 172.21.15.19:0/331788404 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fdb3c105b30 0x7fdb3c1993e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:26:10.074 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:10.068+0000 7fdb3b7fe640 1 -- 172.21.15.19:0/331788404 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fdb3c105b30 msgr2=0x7fdb3c1993e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:26:10.074 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:10.068+0000 7fdb3b7fe640 1 --2- 172.21.15.19:0/331788404 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fdb3c105b30 0x7fdb3c1993e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:26:10.074 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:10.068+0000 7fdb3b7fe640 1 -- 172.21.15.19:0/331788404 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdb3c06af00 msgr2=0x7fdb3c198d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:26:10.075 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:10.068+0000 7fdb3b7fe640 1 --2- 172.21.15.19:0/331788404 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdb3c06af00 0x7fdb3c198d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:26:10.075 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:10.068+0000 7fdb3b7fe640 1 -- 172.21.15.19:0/331788404 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdb3c19a8d0 con 0x7fdb3c108680 2024-09-10T22:26:10.075 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:10.068+0000 7fdb3b7fe640 1 --2- 172.21.15.19:0/331788404 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdb3c108680 0x7fdb3c19a010 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7fdb3400d750 tx=0x7fdb3400dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:26:10.075 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:10.068+0000 7fdb23fff640 1 -- 172.21.15.19:0/331788404 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb34017070 con 0x7fdb3c108680 2024-09-10T22:26:10.075 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:10.068+0000 7fdb4172b640 1 -- 172.21.15.19:0/331788404 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdb3c19abc0 con 0x7fdb3c108680 2024-09-10T22:26:10.075 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:10.068+0000 7fdb23fff640 1 -- 172.21.15.19:0/331788404 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fdb340054d0 con 0x7fdb3c108680 2024-09-10T22:26:10.075 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:10.068+0000 7fdb23fff640 1 -- 172.21.15.19:0/331788404 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb34004c60 con 0x7fdb3c108680 2024-09-10T22:26:10.075 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:10.068+0000 7fdb4172b640 1 -- 172.21.15.19:0/331788404 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdb3c1a1290 con 0x7fdb3c108680 2024-09-10T22:26:10.075 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:10.069+0000 7fdb4172b640 1 -- 172.21.15.19:0/331788404 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdb3c0fec30 con 0x7fdb3c108680 2024-09-10T22:26:10.076 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:10.071+0000 7fdb23fff640 1 -- 172.21.15.19:0/331788404 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 18) ==== 153250+0+0 (secure 0 0 0) 0x7fdb34004e00 con 0x7fdb3c108680 2024-09-10T22:26:10.077 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:10.071+0000 7fdb23fff640 1 --2- 172.21.15.19:0/331788404 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7fdb240b52e0 0x7fdb240b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:26:10.077 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:10.072+0000 7fdb3affd640 1 --2- 172.21.15.19:0/331788404 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7fdb240b52e0 0x7fdb240b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:26:10.077 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:10.072+0000 7fdb23fff640 1 -- 172.21.15.19:0/331788404 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8327+0+0 (secure 0 0 0) 0x7fdb340e5a40 con 0x7fdb3c108680 2024-09-10T22:26:10.077 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:10.072+0000 7fdb3affd640 1 --2- 172.21.15.19:0/331788404 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7fdb240b52e0 0x7fdb240b77a0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fdb2c005fd0 tx=0x7fdb2c009520 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:26:10.077 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:10.074+0000 7fdb23fff640 1 -- 172.21.15.19:0/331788404 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7fdb340ac8a0 con 0x7fdb3c108680 2024-09-10T22:26:10.264 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:10.262+0000 7fdb4172b640 1 -- 172.21.15.19:0/331788404 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7fdb3c02e7c0 con 0x7fdb3c108680 2024-09-10T22:26:10.264 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:10.262+0000 7fdb23fff640 1 -- 172.21.15.19:0/331788404 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v77) ==== 100+0+11 (secure 0 0 0) 0x7fdb340ac1a0 con 0x7fdb3c108680 2024-09-10T22:26:10.265 INFO:teuthology.orchestra.run.smithi019.stdout:pg_num: 64 2024-09-10T22:26:10.267 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:10.264+0000 7fdb4172b640 1 -- 172.21.15.19:0/331788404 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7fdb240b52e0 msgr2=0x7fdb240b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:26:10.267 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:10.264+0000 7fdb4172b640 1 --2- 172.21.15.19:0/331788404 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7fdb240b52e0 0x7fdb240b77a0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fdb2c005fd0 tx=0x7fdb2c009520 comp rx=0 tx=0).stop 2024-09-10T22:26:10.267 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:10.264+0000 7fdb4172b640 1 -- 172.21.15.19:0/331788404 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdb3c108680 msgr2=0x7fdb3c19a010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:26:10.267 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:10.264+0000 7fdb4172b640 1 --2- 172.21.15.19:0/331788404 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdb3c108680 0x7fdb3c19a010 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7fdb3400d750 tx=0x7fdb3400dc10 comp rx=0 tx=0).stop 2024-09-10T22:26:10.267 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:10.265+0000 7fdb4172b640 1 -- 172.21.15.19:0/331788404 shutdown_connections 2024-09-10T22:26:10.267 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:10.265+0000 7fdb4172b640 1 --2- 172.21.15.19:0/331788404 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7fdb240b52e0 0x7fdb240b77a0 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:26:10.268 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:10.265+0000 7fdb4172b640 1 --2- 172.21.15.19:0/331788404 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdb3c108680 0x7fdb3c19a010 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:26:10.268 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:10.265+0000 7fdb4172b640 1 --2- 172.21.15.19:0/331788404 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fdb3c105b30 0x7fdb3c1993e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:26:10.268 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:10.265+0000 7fdb4172b640 1 --2- 172.21.15.19:0/331788404 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdb3c06af00 0x7fdb3c198d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:26:10.268 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:10.265+0000 7fdb4172b640 1 -- 172.21.15.19:0/331788404 >> 172.21.15.19:0/331788404 conn(0x7fdb3c0fd140 msgr2=0x7fdb3c103e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:26:10.268 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:10.265+0000 7fdb4172b640 1 -- 172.21.15.19:0/331788404 shutdown_connections 2024-09-10T22:26:10.268 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:10.265+0000 7fdb4172b640 1 -- 172.21.15.19:0/331788404 wait complete. 2024-09-10T22:26:10.277 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:26:09 smithi019 ceph-mon[31375]: pgmap v339: 97 pgs: 97 active+clean; 639 KiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 639 B/s wr, 6 op/s 2024-09-10T22:26:10.277 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:26:09 smithi019 ceph-mon[31375]: from='client.? 172.21.15.19:0/4197331294' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]': finished 2024-09-10T22:26:10.277 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:26:09 smithi019 ceph-mon[31375]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-09-10T22:26:10.277 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:26:09 smithi019 ceph-mon[31375]: from='client.? 172.21.15.19:0/3914094410' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-10T22:26:10.277 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:26:09 smithi019 ceph-mon[31375]: from='client.? 172.21.15.19:0/4184990242' entity='client.admin' cmd={"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} : dispatch 2024-09-10T22:26:10.277 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:26:09 smithi019 ceph-mon[31375]: from='client.? 172.21.15.19:0/3525915898' entity='client.admin' cmd={"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} : dispatch 2024-09-10T22:26:10.278 INFO:tasks.fwd_scrub:Wait for all MDSs to reach steady state... 2024-09-10T22:26:10.279 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 22997a4c-6fc2-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-10T22:26:10.359 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:26:09 smithi135 ceph-mon[34789]: pgmap v339: 97 pgs: 97 active+clean; 639 KiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 639 B/s wr, 6 op/s 2024-09-10T22:26:10.360 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:26:09 smithi135 ceph-mon[34789]: from='client.? 172.21.15.19:0/4197331294' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]': finished 2024-09-10T22:26:10.360 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:26:09 smithi135 ceph-mon[34789]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-09-10T22:26:10.360 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:26:09 smithi135 ceph-mon[34789]: from='client.? 172.21.15.19:0/3914094410' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-10T22:26:10.360 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:26:09 smithi135 ceph-mon[34789]: from='client.? 172.21.15.19:0/4184990242' entity='client.admin' cmd={"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} : dispatch 2024-09-10T22:26:10.360 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:26:09 smithi135 ceph-mon[34789]: from='client.? 172.21.15.19:0/3525915898' entity='client.admin' cmd={"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} : dispatch 2024-09-10T22:26:10.375 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:26:09 smithi138 ceph-mon[35236]: pgmap v339: 97 pgs: 97 active+clean; 639 KiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 639 B/s wr, 6 op/s 2024-09-10T22:26:10.375 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:26:09 smithi138 ceph-mon[35236]: from='client.? 172.21.15.19:0/4197331294' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]': finished 2024-09-10T22:26:10.375 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:26:09 smithi138 ceph-mon[35236]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-09-10T22:26:10.375 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:26:09 smithi138 ceph-mon[35236]: from='client.? 172.21.15.19:0/3914094410' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-10T22:26:10.375 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:26:09 smithi138 ceph-mon[35236]: from='client.? 172.21.15.19:0/4184990242' entity='client.admin' cmd={"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} : dispatch 2024-09-10T22:26:10.375 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:26:09 smithi138 ceph-mon[35236]: from='client.? 172.21.15.19:0/3525915898' entity='client.admin' cmd={"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} : dispatch 2024-09-10T22:26:10.539 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/22997a4c-6fc2-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T22:26:11.058 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:11.040+0000 7f0300146640 1 -- 172.21.15.19:0/3168207039 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f02f8103ce0 msgr2=0x7f02f81040c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:26:11.058 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:11.040+0000 7f0300146640 1 --2- 172.21.15.19:0/3168207039 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f02f8103ce0 0x7f02f81040c0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f02e8009900 tx=0x7f02e802a410 comp rx=0 tx=0).stop 2024-09-10T22:26:11.059 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:11.040+0000 7f0300146640 1 -- 172.21.15.19:0/3168207039 shutdown_connections 2024-09-10T22:26:11.059 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:11.040+0000 7f0300146640 1 --2- 172.21.15.19:0/3168207039 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f02f810d140 0x7f02f810f5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:26:11.059 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:11.040+0000 7f0300146640 1 --2- 172.21.15.19:0/3168207039 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f02f8104600 0x7f02f810caf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:26:11.059 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:11.040+0000 7f0300146640 1 --2- 172.21.15.19:0/3168207039 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f02f8103ce0 0x7f02f81040c0 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:26:11.059 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:11.040+0000 7f0300146640 1 -- 172.21.15.19:0/3168207039 >> 172.21.15.19:0/3168207039 conn(0x7f02f80fd700 msgr2=0x7f02f80ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:26:11.059 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:11.040+0000 7f0300146640 1 -- 172.21.15.19:0/3168207039 shutdown_connections 2024-09-10T22:26:11.059 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:11.040+0000 7f0300146640 1 -- 172.21.15.19:0/3168207039 wait complete. 2024-09-10T22:26:11.059 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:11.041+0000 7f0300146640 1 Processor -- start 2024-09-10T22:26:11.059 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:11.041+0000 7f0300146640 1 -- start start 2024-09-10T22:26:11.059 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:11.041+0000 7f0300146640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f02f8103ce0 0x7f02f8199240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:26:11.059 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:11.041+0000 7f0300146640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f02f8104600 0x7f02f8199780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:26:11.059 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:11.041+0000 7f0300146640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f02f810d140 0x7f02f819eb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:26:11.060 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:11.041+0000 7f0300146640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f02f8112db0 con 0x7f02f8104600 2024-09-10T22:26:11.060 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:11.041+0000 7f0300146640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f02f8112c30 con 0x7f02f810d140 2024-09-10T22:26:11.060 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:11.041+0000 7f0300146640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f02f8112f30 con 0x7f02f8103ce0 2024-09-10T22:26:11.060 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:11.041+0000 7f02fd6e1640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f02f8104600 0x7f02f8199780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:26:11.060 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:11.041+0000 7f02fd6e1640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f02f8104600 0x7f02f8199780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:53562/0 (socket says 172.21.15.19:53562) 2024-09-10T22:26:11.060 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:11.041+0000 7f02fd6e1640 1 -- 172.21.15.19:0/2566092528 learned_addr learned my addr 172.21.15.19:0/2566092528 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:26:11.060 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:11.041+0000 7f02fe6e3640 1 --2- 172.21.15.19:0/2566092528 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f02f810d140 0x7f02f819eb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:26:11.060 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:11.042+0000 7f02fdee2640 1 --2- 172.21.15.19:0/2566092528 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f02f8103ce0 0x7f02f8199240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:26:11.060 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:11.042+0000 7f02fd6e1640 1 -- 172.21.15.19:0/2566092528 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f02f8103ce0 msgr2=0x7f02f8199240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:26:11.060 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:11.042+0000 7f02fd6e1640 1 --2- 172.21.15.19:0/2566092528 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f02f8103ce0 0x7f02f8199240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:26:11.060 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:11.042+0000 7f02fd6e1640 1 -- 172.21.15.19:0/2566092528 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f02f810d140 msgr2=0x7f02f819eb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:26:11.061 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:11.042+0000 7f02fd6e1640 1 --2- 172.21.15.19:0/2566092528 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f02f810d140 0x7f02f819eb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:26:11.061 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:11.042+0000 7f02fd6e1640 1 -- 172.21.15.19:0/2566092528 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f02f819f2f0 con 0x7f02f8104600 2024-09-10T22:26:11.061 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:11.042+0000 7f02fdee2640 1 --2- 172.21.15.19:0/2566092528 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f02f8103ce0 0x7f02f8199240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T22:26:11.061 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:11.042+0000 7f02fd6e1640 1 --2- 172.21.15.19:0/2566092528 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f02f8104600 0x7f02f8199780 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f02f400c970 tx=0x7f02f400ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:26:11.061 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:11.042+0000 7f02eeffd640 1 -- 172.21.15.19:0/2566092528 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02f4007bb0 con 0x7f02f8104600 2024-09-10T22:26:11.061 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:11.042+0000 7f02eeffd640 1 -- 172.21.15.19:0/2566092528 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f02f4007d50 con 0x7f02f8104600 2024-09-10T22:26:11.061 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:11.042+0000 7f0300146640 1 -- 172.21.15.19:0/2566092528 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f02f819f5e0 con 0x7f02f8104600 2024-09-10T22:26:11.061 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:11.042+0000 7f02eeffd640 1 -- 172.21.15.19:0/2566092528 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02f400f7b0 con 0x7f02f8104600 2024-09-10T22:26:11.061 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:11.042+0000 7f0300146640 1 -- 172.21.15.19:0/2566092528 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f02f81a5ca0 con 0x7f02f8104600 2024-09-10T22:26:11.061 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:11.043+0000 7f0300146640 1 -- 172.21.15.19:0/2566092528 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f02f81040c0 con 0x7f02f8104600 2024-09-10T22:26:11.061 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:11.044+0000 7f02eeffd640 1 -- 172.21.15.19:0/2566092528 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 18) ==== 153250+0+0 (secure 0 0 0) 0x7f02f4018480 con 0x7f02f8104600 2024-09-10T22:26:11.062 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:11.045+0000 7f02eeffd640 1 --2- 172.21.15.19:0/2566092528 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f02e40b52e0 0x7f02e40b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:26:11.062 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:11.045+0000 7f02fdee2640 1 --2- 172.21.15.19:0/2566092528 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f02e40b52e0 0x7f02e40b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:26:11.062 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:11.045+0000 7f02eeffd640 1 -- 172.21.15.19:0/2566092528 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8327+0+0 (secure 0 0 0) 0x7f02f40e5fd0 con 0x7f02f8104600 2024-09-10T22:26:11.062 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:11.046+0000 7f02fdee2640 1 --2- 172.21.15.19:0/2566092528 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f02e40b52e0 0x7f02e40b77a0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f02e8000c00 tx=0x7f02e8031400 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:26:11.062 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:11.049+0000 7f02eeffd640 1 -- 172.21.15.19:0/2566092528 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f02f40ace60 con 0x7f02f8104600 2024-09-10T22:26:11.208 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:26:10 smithi019 ceph-mon[31375]: from='client.? 172.21.15.19:0/331788404' entity='client.admin' cmd={"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} : dispatch 2024-09-10T22:26:11.273 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:11.271+0000 7f0300146640 1 -- 172.21.15.19:0/2566092528 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f02f819a370 con 0x7f02f8104600 2024-09-10T22:26:11.274 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:11.272+0000 7f02eeffd640 1 -- 172.21.15.19:0/2566092528 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) ==== 94+0+11921 (secure 0 0 0) 0x7f02f40ac760 con 0x7f02f8104600 2024-09-10T22:26:11.274 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-10T22:26:11.275 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":25,"btime":"2024-09-10T22:26:08:965324+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14673,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6835/1835804747","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6834","nonce":1835804747},{"type":"v1","addr":"172.21.15.19:6835","nonce":1835804747}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14685,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6837/1750470490","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6836","nonce":1750470490},{"type":"v1","addr":"172.21.15.19:6837","nonce":1750470490}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14733,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6839/2642941149","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6838","nonce":2642941149},{"type":"v1","addr":"172.21.15.19:6839","nonce":2642941149}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14745,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6841/2449948682","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6840","nonce":2449948682},{"type":"v1","addr":"172.21.15.19:6841","nonce":2449948682}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24511,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.138:6833/2524811494","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6832","nonce":2524811494},{"type":"v1","addr":"172.21.15.138:6833","nonce":2524811494}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24512,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6833/3014993624","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6832","nonce":3014993624},{"type":"v1","addr":"172.21.15.135:6833","nonce":3014993624}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":25,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-10T22:24:22.733925+0000","modified":"2024-09-10T22:26:08.602673+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24581,"mds_1":24568,"mds_2":24553},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24527":{"gid":24527,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.135:6835/3715773348","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6834","nonce":3715773348},{"type":"v1","addr":"172.21.15.135:6835","nonce":3715773348}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24541":{"gid":24541,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.138:6835/933547028","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6834","nonce":933547028},{"type":"v1","addr":"172.21.15.138:6835","nonce":933547028}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24551":{"gid":24551,"name":"h","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.135:6837/3495029135","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6836","nonce":3495029135},{"type":"v1","addr":"172.21.15.135:6837","nonce":3495029135}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24553":{"gid":24553,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":10,"addr":"172.21.15.138:6837/3353290042","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6836","nonce":3353290042},{"type":"v1","addr":"172.21.15.138:6837","nonce":3353290042}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24568":{"gid":24568,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.138:6839/383637208","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6838","nonce":383637208},{"type":"v1","addr":"172.21.15.138:6839","nonce":383637208}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24581":{"gid":24581,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.135:6839/1254769802","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6838","nonce":1254769802},{"type":"v1","addr":"172.21.15.135:6839","nonce":1254769802}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24581,"qdb_cluster":[24581,24568,24553]},"id":1}]} 2024-09-10T22:26:11.275 INFO:teuthology.orchestra.run.smithi019.stderr:dumped fsmap epoch 25 2024-09-10T22:26:11.276 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:11.274+0000 7f0300146640 1 -- 172.21.15.19:0/2566092528 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f02e40b52e0 msgr2=0x7f02e40b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:26:11.277 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:11.274+0000 7f0300146640 1 --2- 172.21.15.19:0/2566092528 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f02e40b52e0 0x7f02e40b77a0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f02e8000c00 tx=0x7f02e8031400 comp rx=0 tx=0).stop 2024-09-10T22:26:11.277 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:11.274+0000 7f0300146640 1 -- 172.21.15.19:0/2566092528 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f02f8104600 msgr2=0x7f02f8199780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:26:11.277 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:11.274+0000 7f0300146640 1 --2- 172.21.15.19:0/2566092528 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f02f8104600 0x7f02f8199780 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f02f400c970 tx=0x7f02f400ce30 comp rx=0 tx=0).stop 2024-09-10T22:26:11.277 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:11.274+0000 7f0300146640 1 -- 172.21.15.19:0/2566092528 shutdown_connections 2024-09-10T22:26:11.277 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:11.274+0000 7f0300146640 1 --2- 172.21.15.19:0/2566092528 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f02e40b52e0 0x7f02e40b77a0 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:26:11.277 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:11.274+0000 7f0300146640 1 --2- 172.21.15.19:0/2566092528 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f02f810d140 0x7f02f819eb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:26:11.277 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:11.274+0000 7f0300146640 1 --2- 172.21.15.19:0/2566092528 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f02f8104600 0x7f02f8199780 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:26:11.277 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:11.274+0000 7f0300146640 1 --2- 172.21.15.19:0/2566092528 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f02f8103ce0 0x7f02f8199240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:26:11.277 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:11.274+0000 7f0300146640 1 -- 172.21.15.19:0/2566092528 >> 172.21.15.19:0/2566092528 conn(0x7f02f80fd700 msgr2=0x7f02f80fe360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:26:11.277 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:11.274+0000 7f0300146640 1 -- 172.21.15.19:0/2566092528 shutdown_connections 2024-09-10T22:26:11.277 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:11.274+0000 7f0300146640 1 -- 172.21.15.19:0/2566092528 wait complete. 2024-09-10T22:26:11.359 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:26:10 smithi135 ceph-mon[34789]: from='client.? 172.21.15.19:0/331788404' entity='client.admin' cmd={"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} : dispatch 2024-09-10T22:26:11.374 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:26:10 smithi138 ceph-mon[35236]: from='client.? 172.21.15.19:0/331788404' entity='client.admin' cmd={"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} : dispatch 2024-09-10T22:26:12.055 INFO:tasks.fwd_scrub:Ready to start scrub thrashing 2024-09-10T22:26:12.055 INFO:tasks.fwd_scrub.ceph_manager:waiting for clean 2024-09-10T22:26:12.055 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-10T22:26:12.170 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:12.165+0000 7fa10c623640 1 -- 172.21.15.19:0/889687443 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa1041018b0 msgr2=0x7fa104101cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:26:12.170 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:12.165+0000 7fa10c623640 1 --2- 172.21.15.19:0/889687443 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa1041018b0 0x7fa104101cb0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7fa100009930 tx=0x7fa10002a420 comp rx=0 tx=0).stop 2024-09-10T22:26:12.170 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:12.165+0000 7fa10c623640 1 -- 172.21.15.19:0/889687443 shutdown_connections 2024-09-10T22:26:12.170 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:12.165+0000 7fa10c623640 1 --2- 172.21.15.19:0/889687443 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa1041033c0 0x7fa104109d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:26:12.170 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:12.165+0000 7fa10c623640 1 --2- 172.21.15.19:0/889687443 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa104102a00 0x7fa104102e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:26:12.170 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:12.165+0000 7fa10c623640 1 --2- 172.21.15.19:0/889687443 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa1041018b0 0x7fa104101cb0 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:26:12.171 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:12.165+0000 7fa10c623640 1 -- 172.21.15.19:0/889687443 >> 172.21.15.19:0/889687443 conn(0x7fa1040fd190 msgr2=0x7fa1040ff5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:26:12.171 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:12.165+0000 7fa10c623640 1 -- 172.21.15.19:0/889687443 shutdown_connections 2024-09-10T22:26:12.171 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:12.165+0000 7fa10c623640 1 -- 172.21.15.19:0/889687443 wait complete. 2024-09-10T22:26:12.171 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:12.166+0000 7fa10c623640 1 Processor -- start 2024-09-10T22:26:12.171 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:12.166+0000 7fa10c623640 1 -- start start 2024-09-10T22:26:12.171 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:12.166+0000 7fa10c623640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa1041018b0 0x7fa10419b030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:26:12.171 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:12.166+0000 7fa10c623640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa104102a00 0x7fa10419b680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:26:12.171 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:12.166+0000 7fa10c623640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa1041033c0 0x7fa10419c2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:26:12.171 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:12.166+0000 7fa10c623640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fa10410e650 con 0x7fa1041033c0 2024-09-10T22:26:12.171 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:12.166+0000 7fa10c623640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fa10410e4d0 con 0x7fa1041018b0 2024-09-10T22:26:12.172 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:12.166+0000 7fa10c623640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7fa10410e7d0 con 0x7fa104102a00 2024-09-10T22:26:12.172 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:12.166+0000 7fa10abc0640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa1041033c0 0x7fa10419c2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:26:12.172 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:12.166+0000 7fa10abc0640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa1041033c0 0x7fa10419c2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:53580/0 (socket says 172.21.15.19:53580) 2024-09-10T22:26:12.172 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:12.166+0000 7fa10abc0640 1 -- 172.21.15.19:0/3242012292 learned_addr learned my addr 172.21.15.19:0/3242012292 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:26:12.172 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:12.166+0000 7fa10a3bf640 1 --2- 172.21.15.19:0/3242012292 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa1041018b0 0x7fa10419b030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:26:12.172 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:12.166+0000 7fa109bbe640 1 --2- 172.21.15.19:0/3242012292 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa104102a00 0x7fa10419b680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:26:12.172 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:12.167+0000 7fa10abc0640 1 -- 172.21.15.19:0/3242012292 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa104102a00 msgr2=0x7fa10419b680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:26:12.172 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:12.167+0000 7fa10abc0640 1 --2- 172.21.15.19:0/3242012292 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa104102a00 0x7fa10419b680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:26:12.172 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:12.167+0000 7fa10abc0640 1 -- 172.21.15.19:0/3242012292 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa1041018b0 msgr2=0x7fa10419b030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:26:12.172 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:12.167+0000 7fa10abc0640 1 --2- 172.21.15.19:0/3242012292 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa1041018b0 0x7fa10419b030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:26:12.173 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:12.167+0000 7fa10abc0640 1 -- 172.21.15.19:0/3242012292 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa10419cb70 con 0x7fa1041033c0 2024-09-10T22:26:12.173 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:12.167+0000 7fa10abc0640 1 --2- 172.21.15.19:0/3242012292 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa1041033c0 0x7fa10419c2b0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7fa0fc00eb10 tx=0x7fa0fc00c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:26:12.173 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:12.167+0000 7fa0fb7fe640 1 -- 172.21.15.19:0/3242012292 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0fc004b20 con 0x7fa1041033c0 2024-09-10T22:26:12.173 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:12.167+0000 7fa0fb7fe640 1 -- 172.21.15.19:0/3242012292 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa0fc004cc0 con 0x7fa1041033c0 2024-09-10T22:26:12.173 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:12.167+0000 7fa10c623640 1 -- 172.21.15.19:0/3242012292 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa10419ce60 con 0x7fa1041033c0 2024-09-10T22:26:12.173 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:12.167+0000 7fa0fb7fe640 1 -- 172.21.15.19:0/3242012292 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0fc010670 con 0x7fa1041033c0 2024-09-10T22:26:12.173 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:12.167+0000 7fa10c623640 1 -- 172.21.15.19:0/3242012292 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa1041a3530 con 0x7fa1041033c0 2024-09-10T22:26:12.174 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:12.168+0000 7fa10c623640 1 -- 172.21.15.19:0/3242012292 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa104101cb0 con 0x7fa1041033c0 2024-09-10T22:26:12.174 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:12.169+0000 7fa0fb7fe640 1 -- 172.21.15.19:0/3242012292 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 18) ==== 153250+0+0 (secure 0 0 0) 0x7fa0fc005020 con 0x7fa1041033c0 2024-09-10T22:26:12.174 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:12.170+0000 7fa0fb7fe640 1 --2- 172.21.15.19:0/3242012292 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7fa0f00b52e0 0x7fa0f00b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:26:12.174 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:12.170+0000 7fa10a3bf640 1 --2- 172.21.15.19:0/3242012292 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7fa0f00b52e0 0x7fa0f00b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:26:12.174 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:12.170+0000 7fa0fb7fe640 1 -- 172.21.15.19:0/3242012292 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8327+0+0 (secure 0 0 0) 0x7fa0fc0e62d0 con 0x7fa1041033c0 2024-09-10T22:26:12.175 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:12.171+0000 7fa10a3bf640 1 --2- 172.21.15.19:0/3242012292 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7fa0f00b52e0 0x7fa0f00b77a0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fa100006010 tx=0x7fa1000314a0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:26:12.177 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:12.175+0000 7fa0fb7fe640 1 -- 172.21.15.19:0/3242012292 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7fa0fc0ad130 con 0x7fa1041033c0 2024-09-10T22:26:12.359 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:26:11 smithi135 ceph-mon[34789]: pgmap v340: 97 pgs: 97 active+clean; 640 KiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 895 B/s wr, 6 op/s; 81 B/s, 0 objects/s recovering 2024-09-10T22:26:12.360 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:26:11 smithi135 ceph-mon[34789]: from='client.? 172.21.15.19:0/2566092528' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T22:26:12.360 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:12.358+0000 7fa10c623640 1 -- 172.21.15.19:0/3242012292 --> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fa104108900 con 0x7fa0f00b52e0 2024-09-10T22:26:12.365 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:12.363+0000 7fa0fb7fe640 1 -- 172.21.15.19:0/3242012292 <== mgr.14150 v2:172.21.15.19:6800/2119495487 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258945 (secure 0 0 0) 0x7fa104108900 con 0x7fa0f00b52e0 2024-09-10T22:26:12.368 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-10T22:26:12.369 INFO:teuthology.orchestra.run.smithi019.stderr:dumped all 2024-09-10T22:26:12.371 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:12.366+0000 7fa10c623640 1 -- 172.21.15.19:0/3242012292 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7fa0f00b52e0 msgr2=0x7fa0f00b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:26:12.371 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:12.366+0000 7fa10c623640 1 --2- 172.21.15.19:0/3242012292 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7fa0f00b52e0 0x7fa0f00b77a0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fa100006010 tx=0x7fa1000314a0 comp rx=0 tx=0).stop 2024-09-10T22:26:12.371 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:12.366+0000 7fa10c623640 1 -- 172.21.15.19:0/3242012292 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa1041033c0 msgr2=0x7fa10419c2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:26:12.371 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:12.366+0000 7fa10c623640 1 --2- 172.21.15.19:0/3242012292 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa1041033c0 0x7fa10419c2b0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7fa0fc00eb10 tx=0x7fa0fc00c2d0 comp rx=0 tx=0).stop 2024-09-10T22:26:12.371 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:12.366+0000 7fa10c623640 1 -- 172.21.15.19:0/3242012292 shutdown_connections 2024-09-10T22:26:12.371 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:12.366+0000 7fa10c623640 1 --2- 172.21.15.19:0/3242012292 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7fa0f00b52e0 0x7fa0f00b77a0 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:26:12.371 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:12.366+0000 7fa10c623640 1 --2- 172.21.15.19:0/3242012292 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa1041033c0 0x7fa10419c2b0 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:26:12.372 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:12.366+0000 7fa10c623640 1 --2- 172.21.15.19:0/3242012292 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa104102a00 0x7fa10419b680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:26:12.372 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:12.366+0000 7fa10c623640 1 --2- 172.21.15.19:0/3242012292 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa1041018b0 0x7fa10419b030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:26:12.372 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:12.366+0000 7fa10c623640 1 -- 172.21.15.19:0/3242012292 >> 172.21.15.19:0/3242012292 conn(0x7fa1040fd190 msgr2=0x7fa1041081f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:26:12.372 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:12.366+0000 7fa10c623640 1 -- 172.21.15.19:0/3242012292 shutdown_connections 2024-09-10T22:26:12.372 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:12.366+0000 7fa10c623640 1 -- 172.21.15.19:0/3242012292 wait complete. 2024-09-10T22:26:12.375 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:26:11 smithi138 ceph-mon[35236]: pgmap v340: 97 pgs: 97 active+clean; 640 KiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 895 B/s wr, 6 op/s; 81 B/s, 0 objects/s recovering 2024-09-10T22:26:12.375 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:26:11 smithi138 ceph-mon[35236]: from='client.? 172.21.15.19:0/2566092528' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T22:26:12.378 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:26:11 smithi019 ceph-mon[31375]: pgmap v340: 97 pgs: 97 active+clean; 640 KiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 895 B/s wr, 6 op/s; 81 B/s, 0 objects/s recovering 2024-09-10T22:26:12.378 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:26:11 smithi019 ceph-mon[31375]: from='client.? 172.21.15.19:0/2566092528' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T22:26:12.379 INFO:teuthology.orchestra.run.smithi019.stdout:{"pg_ready":true,"pg_map":{"version":340,"stamp":"2024-09-10T22:26:10.389327+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":655063,"num_objects":64,"num_object_clones":0,"num_object_copies":192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":675,"num_read_kb":426,"num_write":296,"num_write_kb":2268,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":24,"num_bytes_recovered":2953164,"num_keys_recovered":10,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":739,"ondisk_log_size":739,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":292,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":378000,"kb_used_data":12048,"kb_used_omap":18,"kb_used_meta":365677,"kb_avail":1124563824,"statfs":{"total":1151940427776,"available":1151553355776,"internally_reserved":0,"allocated":12337152,"data_stored":6894905,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19142,"internal_metadata":374453562},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":11,"apply_latency_ms":11,"commit_latency_ns":11000000,"apply_latency_ns":11000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":698,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":21,"num_write":10,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":652,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.001766"},"pg_stats":[{"pgid":"3.3f","version":"75'8","reported_seq":30,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T22:26:05.953476+0000","last_change":"2024-09-10T22:24:22.139905+0000","last_active":"2024-09-10T22:26:05.953476+0000","last_peered":"2024-09-10T22:26:05.953476+0000","last_clean":"2024-09-10T22:26:05.953476+0000","last_became_active":"2024-09-10T22:24:22.139558+0000","last_became_peered":"2024-09-10T22:24:22.139558+0000","last_unstale":"2024-09-10T22:26:05.953476+0000","last_undegraded":"2024-09-10T22:26:05.953476+0000","last_fullsized":"2024-09-10T22:26:05.953476+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_clean_scrub_stamp":"2024-09-10T22:24:21.113844+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:44:10.434972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"75'4","reported_seq":26,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T22:26:05.954611+0000","last_change":"2024-09-10T22:24:22.136722+0000","last_active":"2024-09-10T22:26:05.954611+0000","last_peered":"2024-09-10T22:26:05.954611+0000","last_clean":"2024-09-10T22:26:05.954611+0000","last_became_active":"2024-09-10T22:24:22.136080+0000","last_became_peered":"2024-09-10T22:24:22.136080+0000","last_unstale":"2024-09-10T22:26:05.954611+0000","last_undegraded":"2024-09-10T22:26:05.954611+0000","last_fullsized":"2024-09-10T22:26:05.954611+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_clean_scrub_stamp":"2024-09-10T22:24:21.113844+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:52:50.562031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"75'7","reported_seq":29,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T22:26:05.954617+0000","last_change":"2024-09-10T22:24:22.141323+0000","last_active":"2024-09-10T22:26:05.954617+0000","last_peered":"2024-09-10T22:26:05.954617+0000","last_clean":"2024-09-10T22:26:05.954617+0000","last_became_active":"2024-09-10T22:24:22.140895+0000","last_became_peered":"2024-09-10T22:24:22.140895+0000","last_unstale":"2024-09-10T22:26:05.954617+0000","last_undegraded":"2024-09-10T22:26:05.954617+0000","last_fullsized":"2024-09-10T22:26:05.954617+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_clean_scrub_stamp":"2024-09-10T22:24:21.113844+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:46:22.604672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"75'8","reported_seq":30,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T22:26:05.951352+0000","last_change":"2024-09-10T22:24:22.138806+0000","last_active":"2024-09-10T22:26:05.951352+0000","last_peered":"2024-09-10T22:26:05.951352+0000","last_clean":"2024-09-10T22:26:05.951352+0000","last_became_active":"2024-09-10T22:24:22.138502+0000","last_became_peered":"2024-09-10T22:24:22.138502+0000","last_unstale":"2024-09-10T22:26:05.951352+0000","last_undegraded":"2024-09-10T22:26:05.951352+0000","last_fullsized":"2024-09-10T22:26:05.951352+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_clean_scrub_stamp":"2024-09-10T22:24:21.113844+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:45:01.626820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"75'4","reported_seq":26,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T22:26:06.594143+0000","last_change":"2024-09-10T22:24:22.141233+0000","last_active":"2024-09-10T22:26:06.594143+0000","last_peered":"2024-09-10T22:26:06.594143+0000","last_clean":"2024-09-10T22:26:06.594143+0000","last_became_active":"2024-09-10T22:24:22.140944+0000","last_became_peered":"2024-09-10T22:24:22.140944+0000","last_unstale":"2024-09-10T22:26:06.594143+0000","last_undegraded":"2024-09-10T22:26:06.594143+0000","last_fullsized":"2024-09-10T22:26:06.594143+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_clean_scrub_stamp":"2024-09-10T22:24:21.113844+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:09:29.615658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"75'6","reported_seq":26,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-10T22:26:04.954706+0000","last_change":"2024-09-10T22:24:22.137990+0000","last_active":"2024-09-10T22:26:04.954706+0000","last_peered":"2024-09-10T22:26:04.954706+0000","last_clean":"2024-09-10T22:26:04.954706+0000","last_became_active":"2024-09-10T22:24:22.137685+0000","last_became_peered":"2024-09-10T22:24:22.137685+0000","last_unstale":"2024-09-10T22:26:04.954706+0000","last_undegraded":"2024-09-10T22:26:04.954706+0000","last_fullsized":"2024-09-10T22:26:04.954706+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_clean_scrub_stamp":"2024-09-10T22:24:21.113844+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:32:23.891069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"75'5","reported_seq":27,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T22:26:06.365123+0000","last_change":"2024-09-10T22:24:22.148073+0000","last_active":"2024-09-10T22:26:06.365123+0000","last_peered":"2024-09-10T22:26:06.365123+0000","last_clean":"2024-09-10T22:26:06.365123+0000","last_became_active":"2024-09-10T22:24:22.147785+0000","last_became_peered":"2024-09-10T22:24:22.147785+0000","last_unstale":"2024-09-10T22:26:06.365123+0000","last_undegraded":"2024-09-10T22:26:06.365123+0000","last_fullsized":"2024-09-10T22:26:06.365123+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_clean_scrub_stamp":"2024-09-10T22:24:21.113844+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:39:48.847949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"75'9","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T22:26:05.952288+0000","last_change":"2024-09-10T22:25:05.524455+0000","last_active":"2024-09-10T22:26:05.952288+0000","last_peered":"2024-09-10T22:26:05.952288+0000","last_clean":"2024-09-10T22:26:05.952288+0000","last_became_active":"2024-09-10T22:25:05.523985+0000","last_became_peered":"2024-09-10T22:25:05.523985+0000","last_unstale":"2024-09-10T22:26:05.952288+0000","last_undegraded":"2024-09-10T22:26:05.952288+0000","last_fullsized":"2024-09-10T22:26:05.952288+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_clean_scrub_stamp":"2024-09-10T22:24:21.113844+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:20:33.302885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,5,10],"acting":[9,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.37","version":"75'11","reported_seq":31,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-10T22:26:05.073113+0000","last_change":"2024-09-10T22:24:22.148042+0000","last_active":"2024-09-10T22:26:05.073113+0000","last_peered":"2024-09-10T22:26:05.073113+0000","last_clean":"2024-09-10T22:26:05.073113+0000","last_became_active":"2024-09-10T22:24:22.147722+0000","last_became_peered":"2024-09-10T22:24:22.147722+0000","last_unstale":"2024-09-10T22:26:05.073113+0000","last_undegraded":"2024-09-10T22:26:05.073113+0000","last_fullsized":"2024-09-10T22:26:05.073113+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_clean_scrub_stamp":"2024-09-10T22:24:21.113844+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:42:42.383957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"75'16","reported_seq":36,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-10T22:26:04.955275+0000","last_change":"2024-09-10T22:24:22.138956+0000","last_active":"2024-09-10T22:26:04.955275+0000","last_peered":"2024-09-10T22:26:04.955275+0000","last_clean":"2024-09-10T22:26:04.955275+0000","last_became_active":"2024-09-10T22:24:22.138530+0000","last_became_peered":"2024-09-10T22:24:22.138530+0000","last_unstale":"2024-09-10T22:26:04.955275+0000","last_undegraded":"2024-09-10T22:26:04.955275+0000","last_fullsized":"2024-09-10T22:26:04.955275+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_clean_scrub_stamp":"2024-09-10T22:24:21.113844+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:37:55.316556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"75'6","reported_seq":28,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T22:26:06.365684+0000","last_change":"2024-09-10T22:24:22.143435+0000","last_active":"2024-09-10T22:26:06.365684+0000","last_peered":"2024-09-10T22:26:06.365684+0000","last_clean":"2024-09-10T22:26:06.365684+0000","last_became_active":"2024-09-10T22:24:22.143100+0000","last_became_peered":"2024-09-10T22:24:22.143100+0000","last_unstale":"2024-09-10T22:26:06.365684+0000","last_undegraded":"2024-09-10T22:26:06.365684+0000","last_fullsized":"2024-09-10T22:26:06.365684+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_clean_scrub_stamp":"2024-09-10T22:24:21.113844+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:24:14.344203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"75'7","reported_seq":29,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T22:26:05.951417+0000","last_change":"2024-09-10T22:24:22.138101+0000","last_active":"2024-09-10T22:26:05.951417+0000","last_peered":"2024-09-10T22:26:05.951417+0000","last_clean":"2024-09-10T22:26:05.951417+0000","last_became_active":"2024-09-10T22:24:22.137479+0000","last_became_peered":"2024-09-10T22:24:22.137479+0000","last_unstale":"2024-09-10T22:26:05.951417+0000","last_undegraded":"2024-09-10T22:26:05.951417+0000","last_fullsized":"2024-09-10T22:26:05.951417+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_clean_scrub_stamp":"2024-09-10T22:24:21.113844+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:48:09.423136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"75'10","reported_seq":32,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T22:26:06.351060+0000","last_change":"2024-09-10T22:24:22.137157+0000","last_active":"2024-09-10T22:26:06.351060+0000","last_peered":"2024-09-10T22:26:06.351060+0000","last_clean":"2024-09-10T22:26:06.351060+0000","last_became_active":"2024-09-10T22:24:22.136817+0000","last_became_peered":"2024-09-10T22:24:22.136817+0000","last_unstale":"2024-09-10T22:26:06.351060+0000","last_undegraded":"2024-09-10T22:26:06.351060+0000","last_fullsized":"2024-09-10T22:26:06.351060+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_clean_scrub_stamp":"2024-09-10T22:24:21.113844+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:54:32.922776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"75'7","reported_seq":29,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T22:26:05.954575+0000","last_change":"2024-09-10T22:24:22.138828+0000","last_active":"2024-09-10T22:26:05.954575+0000","last_peered":"2024-09-10T22:26:05.954575+0000","last_clean":"2024-09-10T22:26:05.954575+0000","last_became_active":"2024-09-10T22:24:22.138509+0000","last_became_peered":"2024-09-10T22:24:22.138509+0000","last_unstale":"2024-09-10T22:26:05.954575+0000","last_undegraded":"2024-09-10T22:26:05.954575+0000","last_fullsized":"2024-09-10T22:26:05.954575+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_clean_scrub_stamp":"2024-09-10T22:24:21.113844+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:14:19.492298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"75'7","reported_seq":29,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T22:26:05.954349+0000","last_change":"2024-09-10T22:24:22.139317+0000","last_active":"2024-09-10T22:26:05.954349+0000","last_peered":"2024-09-10T22:26:05.954349+0000","last_clean":"2024-09-10T22:26:05.954349+0000","last_became_active":"2024-09-10T22:24:22.138949+0000","last_became_peered":"2024-09-10T22:24:22.138949+0000","last_unstale":"2024-09-10T22:26:05.954349+0000","last_undegraded":"2024-09-10T22:26:05.954349+0000","last_fullsized":"2024-09-10T22:26:05.954349+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_clean_scrub_stamp":"2024-09-10T22:24:21.113844+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:34:56.412955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"75'9","reported_seq":29,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-10T22:26:05.072027+0000","last_change":"2024-09-10T22:24:22.147283+0000","last_active":"2024-09-10T22:26:05.072027+0000","last_peered":"2024-09-10T22:26:05.072027+0000","last_clean":"2024-09-10T22:26:05.072027+0000","last_became_active":"2024-09-10T22:24:22.146954+0000","last_became_peered":"2024-09-10T22:24:22.146954+0000","last_unstale":"2024-09-10T22:26:05.072027+0000","last_undegraded":"2024-09-10T22:26:05.072027+0000","last_fullsized":"2024-09-10T22:26:05.072027+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_clean_scrub_stamp":"2024-09-10T22:24:21.113844+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:22:21.772747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"75'8","reported_seq":30,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T22:26:05.953660+0000","last_change":"2024-09-10T22:24:22.139482+0000","last_active":"2024-09-10T22:26:05.953660+0000","last_peered":"2024-09-10T22:26:05.953660+0000","last_clean":"2024-09-10T22:26:05.953660+0000","last_became_active":"2024-09-10T22:24:22.139135+0000","last_became_peered":"2024-09-10T22:24:22.139135+0000","last_unstale":"2024-09-10T22:26:05.953660+0000","last_undegraded":"2024-09-10T22:26:05.953660+0000","last_fullsized":"2024-09-10T22:26:05.953660+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_clean_scrub_stamp":"2024-09-10T22:24:21.113844+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:25:31.639392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"75'10","reported_seq":32,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T22:26:05.952449+0000","last_change":"2024-09-10T22:24:22.142465+0000","last_active":"2024-09-10T22:26:05.952449+0000","last_peered":"2024-09-10T22:26:05.952449+0000","last_clean":"2024-09-10T22:26:05.952449+0000","last_became_active":"2024-09-10T22:24:22.142110+0000","last_became_peered":"2024-09-10T22:24:22.142110+0000","last_unstale":"2024-09-10T22:26:05.952449+0000","last_undegraded":"2024-09-10T22:26:05.952449+0000","last_fullsized":"2024-09-10T22:26:05.952449+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_clean_scrub_stamp":"2024-09-10T22:24:21.113844+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:16:20.476055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"75'7","reported_seq":29,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T22:26:05.954453+0000","last_change":"2024-09-10T22:24:22.147942+0000","last_active":"2024-09-10T22:26:05.954453+0000","last_peered":"2024-09-10T22:26:05.954453+0000","last_clean":"2024-09-10T22:26:05.954453+0000","last_became_active":"2024-09-10T22:24:22.147637+0000","last_became_peered":"2024-09-10T22:24:22.147637+0000","last_unstale":"2024-09-10T22:26:05.954453+0000","last_undegraded":"2024-09-10T22:26:05.954453+0000","last_fullsized":"2024-09-10T22:26:05.954453+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_clean_scrub_stamp":"2024-09-10T22:24:21.113844+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:46:36.831534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"75'8","reported_seq":30,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T22:26:05.953920+0000","last_change":"2024-09-10T22:24:22.138032+0000","last_active":"2024-09-10T22:26:05.953920+0000","last_peered":"2024-09-10T22:26:05.953920+0000","last_clean":"2024-09-10T22:26:05.953920+0000","last_became_active":"2024-09-10T22:24:22.137657+0000","last_became_peered":"2024-09-10T22:24:22.137657+0000","last_unstale":"2024-09-10T22:26:05.953920+0000","last_undegraded":"2024-09-10T22:26:05.953920+0000","last_fullsized":"2024-09-10T22:26:05.953920+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_clean_scrub_stamp":"2024-09-10T22:24:21.113844+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:06:51.479298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"75'11","reported_seq":33,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T22:26:06.351040+0000","last_change":"2024-09-10T22:24:22.141106+0000","last_active":"2024-09-10T22:26:06.351040+0000","last_peered":"2024-09-10T22:26:06.351040+0000","last_clean":"2024-09-10T22:26:06.351040+0000","last_became_active":"2024-09-10T22:24:22.140780+0000","last_became_peered":"2024-09-10T22:24:22.140780+0000","last_unstale":"2024-09-10T22:26:06.351040+0000","last_undegraded":"2024-09-10T22:26:06.351040+0000","last_fullsized":"2024-09-10T22:26:06.351040+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_clean_scrub_stamp":"2024-09-10T22:24:21.113844+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:25:21.302463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"75'10","reported_seq":30,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-10T22:26:05.072173+0000","last_change":"2024-09-10T22:24:22.146772+0000","last_active":"2024-09-10T22:26:05.072173+0000","last_peered":"2024-09-10T22:26:05.072173+0000","last_clean":"2024-09-10T22:26:05.072173+0000","last_became_active":"2024-09-10T22:24:22.146317+0000","last_became_peered":"2024-09-10T22:24:22.146317+0000","last_unstale":"2024-09-10T22:26:05.072173+0000","last_undegraded":"2024-09-10T22:26:05.072173+0000","last_fullsized":"2024-09-10T22:26:05.072173+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_clean_scrub_stamp":"2024-09-10T22:24:21.113844+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:13:55.706482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"75'8","reported_seq":30,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T22:26:05.957169+0000","last_change":"2024-09-10T22:24:22.139791+0000","last_active":"2024-09-10T22:26:05.957169+0000","last_peered":"2024-09-10T22:26:05.957169+0000","last_clean":"2024-09-10T22:26:05.957169+0000","last_became_active":"2024-09-10T22:24:22.139491+0000","last_became_peered":"2024-09-10T22:24:22.139491+0000","last_unstale":"2024-09-10T22:26:05.957169+0000","last_undegraded":"2024-09-10T22:26:05.957169+0000","last_fullsized":"2024-09-10T22:26:05.957169+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_clean_scrub_stamp":"2024-09-10T22:24:21.113844+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:18:29.412412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"75'6","reported_seq":28,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T22:26:05.951202+0000","last_change":"2024-09-10T22:24:22.143383+0000","last_active":"2024-09-10T22:26:05.951202+0000","last_peered":"2024-09-10T22:26:05.951202+0000","last_clean":"2024-09-10T22:26:05.951202+0000","last_became_active":"2024-09-10T22:24:22.143045+0000","last_became_peered":"2024-09-10T22:24:22.143045+0000","last_unstale":"2024-09-10T22:26:05.951202+0000","last_undegraded":"2024-09-10T22:26:05.951202+0000","last_fullsized":"2024-09-10T22:26:05.951202+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_clean_scrub_stamp":"2024-09-10T22:24:21.113844+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:37:10.135448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"75'2","reported_seq":24,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T22:26:05.957386+0000","last_change":"2024-09-10T22:24:22.141851+0000","last_active":"2024-09-10T22:26:05.957386+0000","last_peered":"2024-09-10T22:26:05.957386+0000","last_clean":"2024-09-10T22:26:05.957386+0000","last_became_active":"2024-09-10T22:24:22.141469+0000","last_became_peered":"2024-09-10T22:24:22.141469+0000","last_unstale":"2024-09-10T22:26:05.957386+0000","last_undegraded":"2024-09-10T22:26:05.957386+0000","last_fullsized":"2024-09-10T22:26:05.957386+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_clean_scrub_stamp":"2024-09-10T22:24:21.113844+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:03:59.805704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"75'15","reported_seq":37,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T22:26:05.954813+0000","last_change":"2024-09-10T22:24:22.139821+0000","last_active":"2024-09-10T22:26:05.954813+0000","last_peered":"2024-09-10T22:26:05.954813+0000","last_clean":"2024-09-10T22:26:05.954813+0000","last_became_active":"2024-09-10T22:24:22.139398+0000","last_became_peered":"2024-09-10T22:24:22.139398+0000","last_unstale":"2024-09-10T22:26:05.954813+0000","last_undegraded":"2024-09-10T22:26:05.954813+0000","last_fullsized":"2024-09-10T22:26:05.954813+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_clean_scrub_stamp":"2024-09-10T22:24:21.113844+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:18:22.160919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"75'6","reported_seq":28,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T22:26:05.953889+0000","last_change":"2024-09-10T22:24:22.141219+0000","last_active":"2024-09-10T22:26:05.953889+0000","last_peered":"2024-09-10T22:26:05.953889+0000","last_clean":"2024-09-10T22:26:05.953889+0000","last_became_active":"2024-09-10T22:24:22.140900+0000","last_became_peered":"2024-09-10T22:24:22.140900+0000","last_unstale":"2024-09-10T22:26:05.953889+0000","last_undegraded":"2024-09-10T22:26:05.953889+0000","last_fullsized":"2024-09-10T22:26:05.953889+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_clean_scrub_stamp":"2024-09-10T22:24:21.113844+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:27:59.115533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"75'4","reported_seq":26,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T22:26:06.351288+0000","last_change":"2024-09-10T22:24:22.139738+0000","last_active":"2024-09-10T22:26:06.351288+0000","last_peered":"2024-09-10T22:26:06.351288+0000","last_clean":"2024-09-10T22:26:06.351288+0000","last_became_active":"2024-09-10T22:24:22.139096+0000","last_became_peered":"2024-09-10T22:24:22.139096+0000","last_unstale":"2024-09-10T22:26:06.351288+0000","last_undegraded":"2024-09-10T22:26:06.351288+0000","last_fullsized":"2024-09-10T22:26:06.351288+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_clean_scrub_stamp":"2024-09-10T22:24:21.113844+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:16:39.110610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"75'7","reported_seq":29,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T22:26:05.954604+0000","last_change":"2024-09-10T22:24:22.144896+0000","last_active":"2024-09-10T22:26:05.954604+0000","last_peered":"2024-09-10T22:26:05.954604+0000","last_clean":"2024-09-10T22:26:05.954604+0000","last_became_active":"2024-09-10T22:24:22.144622+0000","last_became_peered":"2024-09-10T22:24:22.144622+0000","last_unstale":"2024-09-10T22:26:05.954604+0000","last_undegraded":"2024-09-10T22:26:05.954604+0000","last_fullsized":"2024-09-10T22:26:05.954604+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_clean_scrub_stamp":"2024-09-10T22:24:21.113844+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:32:44.648993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"75'8","reported_seq":30,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T22:26:05.953526+0000","last_change":"2024-09-10T22:24:22.148082+0000","last_active":"2024-09-10T22:26:05.953526+0000","last_peered":"2024-09-10T22:26:05.953526+0000","last_clean":"2024-09-10T22:26:05.953526+0000","last_became_active":"2024-09-10T22:24:22.147664+0000","last_became_peered":"2024-09-10T22:24:22.147664+0000","last_unstale":"2024-09-10T22:26:05.953526+0000","last_undegraded":"2024-09-10T22:26:05.953526+0000","last_fullsized":"2024-09-10T22:26:05.953526+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_clean_scrub_stamp":"2024-09-10T22:24:21.113844+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:12:40.154756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"75'12","reported_seq":41,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T22:26:05.953815+0000","last_change":"2024-09-10T22:25:05.638351+0000","last_active":"2024-09-10T22:26:05.953815+0000","last_peered":"2024-09-10T22:26:05.953815+0000","last_clean":"2024-09-10T22:26:05.953815+0000","last_became_active":"2024-09-10T22:25:05.637523+0000","last_became_peered":"2024-09-10T22:25:05.637523+0000","last_unstale":"2024-09-10T22:26:05.953815+0000","last_undegraded":"2024-09-10T22:26:05.953815+0000","last_fullsized":"2024-09-10T22:26:05.953815+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_clean_scrub_stamp":"2024-09-10T22:24:21.113844+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:09:37.231420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,9,4],"acting":[2,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"75'9","reported_seq":31,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T22:26:05.953229+0000","last_change":"2024-09-10T22:24:22.141534+0000","last_active":"2024-09-10T22:26:05.953229+0000","last_peered":"2024-09-10T22:26:05.953229+0000","last_clean":"2024-09-10T22:26:05.953229+0000","last_became_active":"2024-09-10T22:24:22.141243+0000","last_became_peered":"2024-09-10T22:24:22.141243+0000","last_unstale":"2024-09-10T22:26:05.953229+0000","last_undegraded":"2024-09-10T22:26:05.953229+0000","last_fullsized":"2024-09-10T22:26:05.953229+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_clean_scrub_stamp":"2024-09-10T22:24:21.113844+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:26:23.559943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"75'7","reported_seq":29,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T22:26:06.594143+0000","last_change":"2024-09-10T22:24:22.144951+0000","last_active":"2024-09-10T22:26:06.594143+0000","last_peered":"2024-09-10T22:26:06.594143+0000","last_clean":"2024-09-10T22:26:06.594143+0000","last_became_active":"2024-09-10T22:24:22.144634+0000","last_became_peered":"2024-09-10T22:24:22.144634+0000","last_unstale":"2024-09-10T22:26:06.594143+0000","last_undegraded":"2024-09-10T22:26:06.594143+0000","last_fullsized":"2024-09-10T22:26:06.594143+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_clean_scrub_stamp":"2024-09-10T22:24:21.113844+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:04:19.350081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"77'6","reported_seq":134,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T22:26:08.623766+0000","last_change":"2024-09-10T22:24:20.128083+0000","last_active":"2024-09-10T22:26:08.623766+0000","last_peered":"2024-09-10T22:26:08.623766+0000","last_clean":"2024-09-10T22:26:08.623766+0000","last_became_active":"2024-09-10T22:24:20.127676+0000","last_became_peered":"2024-09-10T22:24:20.127676+0000","last_unstale":"2024-09-10T22:26:08.623766+0000","last_undegraded":"2024-09-10T22:26:08.623766+0000","last_fullsized":"2024-09-10T22:26:08.623766+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:19.099039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:19.099039+0000","last_clean_scrub_stamp":"2024-09-10T22:24:19.099039+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:37:51.745817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":930,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":101,"num_read_kb":3,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"75'8","reported_seq":37,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T22:26:05.951367+0000","last_change":"2024-09-10T22:25:05.638296+0000","last_active":"2024-09-10T22:26:05.951367+0000","last_peered":"2024-09-10T22:26:05.951367+0000","last_clean":"2024-09-10T22:26:05.951367+0000","last_became_active":"2024-09-10T22:25:05.637649+0000","last_became_peered":"2024-09-10T22:25:05.637649+0000","last_unstale":"2024-09-10T22:26:05.951367+0000","last_undegraded":"2024-09-10T22:26:05.951367+0000","last_fullsized":"2024-09-10T22:26:05.951367+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_clean_scrub_stamp":"2024-09-10T22:24:21.113844+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:07:42.674144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3],"acting":[5,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"73'3","reported_seq":39,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-10T22:26:04.954789+0000","last_change":"2024-09-10T22:25:05.532533+0000","last_active":"2024-09-10T22:26:04.954789+0000","last_peered":"2024-09-10T22:26:04.954789+0000","last_clean":"2024-09-10T22:26:04.954789+0000","last_became_active":"2024-09-10T22:25:05.526228+0000","last_became_peered":"2024-09-10T22:25:05.526228+0000","last_unstale":"2024-09-10T22:26:04.954789+0000","last_undegraded":"2024-09-10T22:26:04.954789+0000","last_fullsized":"2024-09-10T22:26:04.954789+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:19.099039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:19.099039+0000","last_clean_scrub_stamp":"2024-09-10T22:24:19.099039+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:53:36.903083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,6],"acting":[10,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"73'2","reported_seq":29,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T22:26:06.351270+0000","last_change":"2024-09-10T22:24:20.122635+0000","last_active":"2024-09-10T22:26:06.351270+0000","last_peered":"2024-09-10T22:26:06.351270+0000","last_clean":"2024-09-10T22:26:06.351270+0000","last_became_active":"2024-09-10T22:24:20.122289+0000","last_became_peered":"2024-09-10T22:24:20.122289+0000","last_unstale":"2024-09-10T22:26:06.351270+0000","last_undegraded":"2024-09-10T22:26:06.351270+0000","last_fullsized":"2024-09-10T22:26:06.351270+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:19.099039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:19.099039+0000","last_clean_scrub_stamp":"2024-09-10T22:24:19.099039+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:30:40.779513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"75'8","reported_seq":30,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T22:26:05.956943+0000","last_change":"2024-09-10T22:24:22.137417+0000","last_active":"2024-09-10T22:26:05.956943+0000","last_peered":"2024-09-10T22:26:05.956943+0000","last_clean":"2024-09-10T22:26:05.956943+0000","last_became_active":"2024-09-10T22:24:22.136913+0000","last_became_peered":"2024-09-10T22:24:22.136913+0000","last_unstale":"2024-09-10T22:26:05.956943+0000","last_undegraded":"2024-09-10T22:26:05.956943+0000","last_fullsized":"2024-09-10T22:26:05.956943+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_clean_scrub_stamp":"2024-09-10T22:24:21.113844+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:23:39.551056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"73'1","reported_seq":28,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T22:26:05.951411+0000","last_change":"2024-09-10T22:24:20.128416+0000","last_active":"2024-09-10T22:26:05.951411+0000","last_peered":"2024-09-10T22:26:05.951411+0000","last_clean":"2024-09-10T22:26:05.951411+0000","last_became_active":"2024-09-10T22:24:20.127998+0000","last_became_peered":"2024-09-10T22:24:20.127998+0000","last_unstale":"2024-09-10T22:26:05.951411+0000","last_undegraded":"2024-09-10T22:26:05.951411+0000","last_fullsized":"2024-09-10T22:26:05.951411+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:19.099039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:19.099039+0000","last_clean_scrub_stamp":"2024-09-10T22:24:19.099039+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:44:39.871564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"75'11","reported_seq":33,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T22:26:05.952467+0000","last_change":"2024-09-10T22:24:22.136355+0000","last_active":"2024-09-10T22:26:05.952467+0000","last_peered":"2024-09-10T22:26:05.952467+0000","last_clean":"2024-09-10T22:26:05.952467+0000","last_became_active":"2024-09-10T22:24:22.136047+0000","last_became_peered":"2024-09-10T22:24:22.136047+0000","last_unstale":"2024-09-10T22:26:05.952467+0000","last_undegraded":"2024-09-10T22:26:05.952467+0000","last_fullsized":"2024-09-10T22:26:05.952467+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_clean_scrub_stamp":"2024-09-10T22:24:21.113844+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:56:14.739365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"73'3","reported_seq":134,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-10T22:26:04.955192+0000","last_change":"2024-09-10T22:25:05.537891+0000","last_active":"2024-09-10T22:26:04.955192+0000","last_peered":"2024-09-10T22:26:04.955192+0000","last_clean":"2024-09-10T22:26:04.955192+0000","last_became_active":"2024-09-10T22:25:05.526085+0000","last_became_peered":"2024-09-10T22:25:05.526085+0000","last_unstale":"2024-09-10T22:26:04.955192+0000","last_undegraded":"2024-09-10T22:26:04.955192+0000","last_fullsized":"2024-09-10T22:26:04.955192+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:19.099039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:19.099039+0000","last_clean_scrub_stamp":"2024-09-10T22:24:19.099039+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:57:02.158783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":88,"num_read_kb":88,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":90,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,9],"acting":[10,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"75'10","reported_seq":30,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-10T22:26:05.072683+0000","last_change":"2024-09-10T22:24:22.143321+0000","last_active":"2024-09-10T22:26:05.072683+0000","last_peered":"2024-09-10T22:26:05.072683+0000","last_clean":"2024-09-10T22:26:05.072683+0000","last_became_active":"2024-09-10T22:24:22.143036+0000","last_became_peered":"2024-09-10T22:24:22.143036+0000","last_unstale":"2024-09-10T22:26:05.072683+0000","last_undegraded":"2024-09-10T22:26:05.072683+0000","last_fullsized":"2024-09-10T22:26:05.072683+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_clean_scrub_stamp":"2024-09-10T22:24:21.113844+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:51:42.473300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"73'2","reported_seq":40,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T22:26:06.365710+0000","last_change":"2024-09-10T22:25:05.534611+0000","last_active":"2024-09-10T22:26:06.365710+0000","last_peered":"2024-09-10T22:26:06.365710+0000","last_clean":"2024-09-10T22:26:06.365710+0000","last_became_active":"2024-09-10T22:25:05.526934+0000","last_became_peered":"2024-09-10T22:25:05.526934+0000","last_unstale":"2024-09-10T22:26:06.365710+0000","last_undegraded":"2024-09-10T22:26:06.365710+0000","last_fullsized":"2024-09-10T22:26:06.365710+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:19.099039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:19.099039+0000","last_clean_scrub_stamp":"2024-09-10T22:24:19.099039+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:39:20.317571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"75'9","reported_seq":31,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T22:26:05.954780+0000","last_change":"2024-09-10T22:24:22.144830+0000","last_active":"2024-09-10T22:26:05.954780+0000","last_peered":"2024-09-10T22:26:05.954780+0000","last_clean":"2024-09-10T22:26:05.954780+0000","last_became_active":"2024-09-10T22:24:22.144358+0000","last_became_peered":"2024-09-10T22:24:22.144358+0000","last_unstale":"2024-09-10T22:26:05.954780+0000","last_undegraded":"2024-09-10T22:26:05.954780+0000","last_fullsized":"2024-09-10T22:26:05.954780+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_clean_scrub_stamp":"2024-09-10T22:24:21.113844+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:28:14.398474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"73'4","reported_seq":32,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T22:26:05.951595+0000","last_change":"2024-09-10T22:24:20.383555+0000","last_active":"2024-09-10T22:26:05.951595+0000","last_peered":"2024-09-10T22:26:05.951595+0000","last_clean":"2024-09-10T22:26:05.951595+0000","last_became_active":"2024-09-10T22:24:20.383163+0000","last_became_peered":"2024-09-10T22:24:20.383163+0000","last_unstale":"2024-09-10T22:26:05.951595+0000","last_undegraded":"2024-09-10T22:26:05.951595+0000","last_fullsized":"2024-09-10T22:26:05.951595+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:19.099039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:19.099039+0000","last_clean_scrub_stamp":"2024-09-10T22:24:19.099039+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:14:03.052220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"75'11","reported_seq":31,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-10T22:26:05.072322+0000","last_change":"2024-09-10T22:24:22.144562+0000","last_active":"2024-09-10T22:26:05.072322+0000","last_peered":"2024-09-10T22:26:05.072322+0000","last_clean":"2024-09-10T22:26:05.072322+0000","last_became_active":"2024-09-10T22:24:22.144146+0000","last_became_peered":"2024-09-10T22:24:22.144146+0000","last_unstale":"2024-09-10T22:26:05.072322+0000","last_undegraded":"2024-09-10T22:26:05.072322+0000","last_fullsized":"2024-09-10T22:26:05.072322+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_clean_scrub_stamp":"2024-09-10T22:24:21.113844+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:57:36.070289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"75'31","reported_seq":254,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-10T22:26:05.358383+0000","last_change":"2024-09-10T22:24:20.126245+0000","last_active":"2024-09-10T22:26:05.358383+0000","last_peered":"2024-09-10T22:26:05.358383+0000","last_clean":"2024-09-10T22:26:05.358383+0000","last_became_active":"2024-09-10T22:24:20.125839+0000","last_became_peered":"2024-09-10T22:24:20.125839+0000","last_unstale":"2024-09-10T22:26:05.358383+0000","last_undegraded":"2024-09-10T22:26:05.358383+0000","last_fullsized":"2024-09-10T22:26:05.358383+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:19.099039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:19.099039+0000","last_clean_scrub_stamp":"2024-09-10T22:24:19.099039+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:45:05.155436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":60011,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":198,"num_read_kb":157,"num_write":32,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"75'6","reported_seq":28,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T22:26:06.594223+0000","last_change":"2024-09-10T22:24:22.142178+0000","last_active":"2024-09-10T22:26:06.594223+0000","last_peered":"2024-09-10T22:26:06.594223+0000","last_clean":"2024-09-10T22:26:06.594223+0000","last_became_active":"2024-09-10T22:24:22.141883+0000","last_became_peered":"2024-09-10T22:24:22.141883+0000","last_unstale":"2024-09-10T22:26:06.594223+0000","last_undegraded":"2024-09-10T22:26:06.594223+0000","last_fullsized":"2024-09-10T22:26:06.594223+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_clean_scrub_stamp":"2024-09-10T22:24:21.113844+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:24:50.996273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"73'6","reported_seq":34,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T22:26:05.954056+0000","last_change":"2024-09-10T22:24:20.126129+0000","last_active":"2024-09-10T22:26:05.954056+0000","last_peered":"2024-09-10T22:26:05.954056+0000","last_clean":"2024-09-10T22:26:05.954056+0000","last_became_active":"2024-09-10T22:24:20.125749+0000","last_became_peered":"2024-09-10T22:24:20.125749+0000","last_unstale":"2024-09-10T22:26:05.954056+0000","last_undegraded":"2024-09-10T22:26:05.954056+0000","last_fullsized":"2024-09-10T22:26:05.954056+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:19.099039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:19.099039+0000","last_clean_scrub_stamp":"2024-09-10T22:24:19.099039+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:58:35.224036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"75'9","reported_seq":31,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T22:26:06.350986+0000","last_change":"2024-09-10T22:24:22.143964+0000","last_active":"2024-09-10T22:26:06.350986+0000","last_peered":"2024-09-10T22:26:06.350986+0000","last_clean":"2024-09-10T22:26:06.350986+0000","last_became_active":"2024-09-10T22:24:22.143589+0000","last_became_peered":"2024-09-10T22:24:22.143589+0000","last_unstale":"2024-09-10T22:26:06.350986+0000","last_undegraded":"2024-09-10T22:26:06.350986+0000","last_fullsized":"2024-09-10T22:26:06.350986+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_clean_scrub_stamp":"2024-09-10T22:24:21.113844+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:41:41.737627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"73'3","reported_seq":30,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T22:26:05.951305+0000","last_change":"2024-09-10T22:24:20.128012+0000","last_active":"2024-09-10T22:26:05.951305+0000","last_peered":"2024-09-10T22:26:05.951305+0000","last_clean":"2024-09-10T22:26:05.951305+0000","last_became_active":"2024-09-10T22:24:20.127335+0000","last_became_peered":"2024-09-10T22:24:20.127335+0000","last_unstale":"2024-09-10T22:26:05.951305+0000","last_undegraded":"2024-09-10T22:26:05.951305+0000","last_fullsized":"2024-09-10T22:26:05.951305+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:19.099039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:19.099039+0000","last_clean_scrub_stamp":"2024-09-10T22:24:19.099039+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:20:27.017032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"75'15","reported_seq":44,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T22:26:06.365478+0000","last_change":"2024-09-10T22:25:05.526382+0000","last_active":"2024-09-10T22:26:06.365478+0000","last_peered":"2024-09-10T22:26:06.365478+0000","last_clean":"2024-09-10T22:26:06.365478+0000","last_became_active":"2024-09-10T22:25:05.526037+0000","last_became_peered":"2024-09-10T22:25:05.526037+0000","last_unstale":"2024-09-10T22:26:06.365478+0000","last_undegraded":"2024-09-10T22:26:06.365478+0000","last_fullsized":"2024-09-10T22:26:06.365478+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_clean_scrub_stamp":"2024-09-10T22:24:21.113844+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:15:12.891318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,6],"acting":[7,9,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"75'5","reported_seq":134,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T22:26:08.390161+0000","last_change":"2024-09-10T22:24:20.124069+0000","last_active":"2024-09-10T22:26:08.390161+0000","last_peered":"2024-09-10T22:26:08.390161+0000","last_clean":"2024-09-10T22:26:08.390161+0000","last_became_active":"2024-09-10T22:24:20.123675+0000","last_became_peered":"2024-09-10T22:24:20.123675+0000","last_unstale":"2024-09-10T22:26:08.390161+0000","last_undegraded":"2024-09-10T22:26:08.390161+0000","last_fullsized":"2024-09-10T22:26:08.390161+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:19.099039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:19.099039+0000","last_clean_scrub_stamp":"2024-09-10T22:24:19.099039+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:32:50.287012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1120,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":103,"num_read_kb":5,"num_write":4,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"75'6","reported_seq":28,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T22:26:06.365122+0000","last_change":"2024-09-10T22:24:22.146870+0000","last_active":"2024-09-10T22:26:06.365122+0000","last_peered":"2024-09-10T22:26:06.365122+0000","last_clean":"2024-09-10T22:26:06.365122+0000","last_became_active":"2024-09-10T22:24:22.146615+0000","last_became_peered":"2024-09-10T22:24:22.146615+0000","last_unstale":"2024-09-10T22:26:06.365122+0000","last_undegraded":"2024-09-10T22:26:06.365122+0000","last_fullsized":"2024-09-10T22:26:06.365122+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_clean_scrub_stamp":"2024-09-10T22:24:21.113844+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:00:05.579248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"73'15","reported_seq":43,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T22:26:06.594490+0000","last_change":"2024-09-10T22:24:20.383675+0000","last_active":"2024-09-10T22:26:06.594490+0000","last_peered":"2024-09-10T22:26:06.594490+0000","last_clean":"2024-09-10T22:26:06.594490+0000","last_became_active":"2024-09-10T22:24:20.383317+0000","last_became_peered":"2024-09-10T22:24:20.383317+0000","last_unstale":"2024-09-10T22:26:06.594490+0000","last_undegraded":"2024-09-10T22:26:06.594490+0000","last_fullsized":"2024-09-10T22:26:06.594490+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:19.099039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:19.099039+0000","last_clean_scrub_stamp":"2024-09-10T22:24:19.099039+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:43:24.989851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"75'6","reported_seq":28,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T22:26:05.951214+0000","last_change":"2024-09-10T22:24:22.144872+0000","last_active":"2024-09-10T22:26:05.951214+0000","last_peered":"2024-09-10T22:26:05.951214+0000","last_clean":"2024-09-10T22:26:05.951214+0000","last_became_active":"2024-09-10T22:24:22.144570+0000","last_became_peered":"2024-09-10T22:24:22.144570+0000","last_unstale":"2024-09-10T22:26:05.951214+0000","last_undegraded":"2024-09-10T22:26:05.951214+0000","last_fullsized":"2024-09-10T22:26:05.951214+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_clean_scrub_stamp":"2024-09-10T22:24:21.113844+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:20:17.937544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"73'2","reported_seq":30,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T22:26:06.595004+0000","last_change":"2024-09-10T22:24:20.125849+0000","last_active":"2024-09-10T22:26:06.595004+0000","last_peered":"2024-09-10T22:26:06.595004+0000","last_clean":"2024-09-10T22:26:06.595004+0000","last_became_active":"2024-09-10T22:24:20.125042+0000","last_became_peered":"2024-09-10T22:24:20.125042+0000","last_unstale":"2024-09-10T22:26:06.595004+0000","last_undegraded":"2024-09-10T22:26:06.595004+0000","last_fullsized":"2024-09-10T22:26:06.595004+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:19.099039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:19.099039+0000","last_clean_scrub_stamp":"2024-09-10T22:24:19.099039+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:36:28.249115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"75'5","reported_seq":27,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T22:26:05.953217+0000","last_change":"2024-09-10T22:24:22.141232+0000","last_active":"2024-09-10T22:26:05.953217+0000","last_peered":"2024-09-10T22:26:05.953217+0000","last_clean":"2024-09-10T22:26:05.953217+0000","last_became_active":"2024-09-10T22:24:22.140903+0000","last_became_peered":"2024-09-10T22:24:22.140903+0000","last_unstale":"2024-09-10T22:26:05.953217+0000","last_undegraded":"2024-09-10T22:26:05.953217+0000","last_fullsized":"2024-09-10T22:26:05.953217+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_clean_scrub_stamp":"2024-09-10T22:24:21.113844+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:15:11.627126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"73'2","reported_seq":29,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T22:26:06.351674+0000","last_change":"2024-09-10T22:24:20.122829+0000","last_active":"2024-09-10T22:26:06.351674+0000","last_peered":"2024-09-10T22:26:06.351674+0000","last_clean":"2024-09-10T22:26:06.351674+0000","last_became_active":"2024-09-10T22:24:20.122545+0000","last_became_peered":"2024-09-10T22:24:20.122545+0000","last_unstale":"2024-09-10T22:26:06.351674+0000","last_undegraded":"2024-09-10T22:26:06.351674+0000","last_fullsized":"2024-09-10T22:26:06.351674+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:19.099039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:19.099039+0000","last_clean_scrub_stamp":"2024-09-10T22:24:19.099039+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:18:27.758029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"75'9","reported_seq":31,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T22:26:06.365191+0000","last_change":"2024-09-10T22:24:22.139725+0000","last_active":"2024-09-10T22:26:06.365191+0000","last_peered":"2024-09-10T22:26:06.365191+0000","last_clean":"2024-09-10T22:26:06.365191+0000","last_became_active":"2024-09-10T22:24:22.139293+0000","last_became_peered":"2024-09-10T22:24:22.139293+0000","last_unstale":"2024-09-10T22:26:06.365191+0000","last_undegraded":"2024-09-10T22:26:06.365191+0000","last_fullsized":"2024-09-10T22:26:06.365191+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_clean_scrub_stamp":"2024-09-10T22:24:21.113844+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:43:14.424880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"73'1","reported_seq":16,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T22:26:05.963961+0000","last_change":"2024-09-10T22:26:05.963539+0000","last_active":"2024-09-10T22:26:05.963961+0000","last_peered":"2024-09-10T22:26:05.963961+0000","last_clean":"2024-09-10T22:26:05.963961+0000","last_became_active":"2024-09-10T22:26:05.959671+0000","last_became_peered":"2024-09-10T22:26:05.959671+0000","last_unstale":"2024-09-10T22:26:05.963961+0000","last_undegraded":"2024-09-10T22:26:05.963961+0000","last_fullsized":"2024-09-10T22:26:05.963961+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:19.099039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:19.099039+0000","last_clean_scrub_stamp":"2024-09-10T22:24:19.099039+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:32:07.837404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":70,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,10,3],"acting":[11,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.c","version":"75'7","reported_seq":29,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T22:26:06.365143+0000","last_change":"2024-09-10T22:24:22.149522+0000","last_active":"2024-09-10T22:26:06.365143+0000","last_peered":"2024-09-10T22:26:06.365143+0000","last_clean":"2024-09-10T22:26:06.365143+0000","last_became_active":"2024-09-10T22:24:22.148710+0000","last_became_peered":"2024-09-10T22:24:22.148710+0000","last_unstale":"2024-09-10T22:26:06.365143+0000","last_undegraded":"2024-09-10T22:26:06.365143+0000","last_fullsized":"2024-09-10T22:26:06.365143+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_clean_scrub_stamp":"2024-09-10T22:24:21.113844+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:44:32.020949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"73'3","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T22:26:05.961597+0000","last_change":"2024-09-10T22:26:05.961171+0000","last_active":"2024-09-10T22:26:05.961597+0000","last_peered":"2024-09-10T22:26:05.961597+0000","last_clean":"2024-09-10T22:26:05.961597+0000","last_became_active":"2024-09-10T22:26:05.956892+0000","last_became_peered":"2024-09-10T22:26:05.956892+0000","last_unstale":"2024-09-10T22:26:05.961597+0000","last_undegraded":"2024-09-10T22:26:05.961597+0000","last_fullsized":"2024-09-10T22:26:05.961597+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:19.099039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:19.099039+0000","last_clean_scrub_stamp":"2024-09-10T22:24:19.099039+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:04:37.103581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":582,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,0],"acting":[4,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.d","version":"75'7","reported_seq":29,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T22:26:06.365151+0000","last_change":"2024-09-10T22:24:22.142335+0000","last_active":"2024-09-10T22:26:06.365151+0000","last_peered":"2024-09-10T22:26:06.365151+0000","last_clean":"2024-09-10T22:26:06.365151+0000","last_became_active":"2024-09-10T22:24:22.142001+0000","last_became_peered":"2024-09-10T22:24:22.142001+0000","last_unstale":"2024-09-10T22:26:06.365151+0000","last_undegraded":"2024-09-10T22:26:06.365151+0000","last_fullsized":"2024-09-10T22:26:06.365151+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_clean_scrub_stamp":"2024-09-10T22:24:21.113844+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:46:20.043915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"19'92","reported_seq":100,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T22:26:06.365521+0000","last_change":"2024-09-10T22:23:11.163678+0000","last_active":"2024-09-10T22:26:06.365521+0000","last_peered":"2024-09-10T22:26:06.365521+0000","last_clean":"2024-09-10T22:26:06.365521+0000","last_became_active":"2024-09-10T22:23:11.158387+0000","last_became_peered":"2024-09-10T22:23:11.158387+0000","last_unstale":"2024-09-10T22:26:06.365521+0000","last_undegraded":"2024-09-10T22:26:06.365521+0000","last_fullsized":"2024-09-10T22:26:06.365521+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:19:50.906986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:19:50.906986+0000","last_clean_scrub_stamp":"2024-09-10T22:19:50.906986+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:11:31.570355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"73'3","reported_seq":32,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T22:26:05.950986+0000","last_change":"2024-09-10T22:24:20.123048+0000","last_active":"2024-09-10T22:26:05.950986+0000","last_peered":"2024-09-10T22:26:05.950986+0000","last_clean":"2024-09-10T22:26:05.950986+0000","last_became_active":"2024-09-10T22:24:20.121906+0000","last_became_peered":"2024-09-10T22:24:20.121906+0000","last_unstale":"2024-09-10T22:26:05.950986+0000","last_undegraded":"2024-09-10T22:26:05.950986+0000","last_fullsized":"2024-09-10T22:26:05.950986+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:19.099039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:19.099039+0000","last_clean_scrub_stamp":"2024-09-10T22:24:19.099039+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:11:00.293820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"75'8","reported_seq":30,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T22:26:05.957409+0000","last_change":"2024-09-10T22:24:22.146378+0000","last_active":"2024-09-10T22:26:05.957409+0000","last_peered":"2024-09-10T22:26:05.957409+0000","last_clean":"2024-09-10T22:26:05.957409+0000","last_became_active":"2024-09-10T22:24:22.145841+0000","last_became_peered":"2024-09-10T22:24:22.145841+0000","last_unstale":"2024-09-10T22:26:05.957409+0000","last_undegraded":"2024-09-10T22:26:05.957409+0000","last_fullsized":"2024-09-10T22:26:05.957409+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_clean_scrub_stamp":"2024-09-10T22:24:21.113844+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:20:31.785243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"73'3","reported_seq":41,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T22:26:06.365469+0000","last_change":"2024-09-10T22:25:05.640672+0000","last_active":"2024-09-10T22:26:06.365469+0000","last_peered":"2024-09-10T22:26:06.365469+0000","last_clean":"2024-09-10T22:26:06.365469+0000","last_became_active":"2024-09-10T22:25:05.637774+0000","last_became_peered":"2024-09-10T22:25:05.637774+0000","last_unstale":"2024-09-10T22:26:06.365469+0000","last_undegraded":"2024-09-10T22:26:06.365469+0000","last_fullsized":"2024-09-10T22:26:06.365469+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:19.099039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:19.099039+0000","last_clean_scrub_stamp":"2024-09-10T22:24:19.099039+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:33:20.970862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,4],"acting":[7,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"75'5","reported_seq":27,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T22:26:06.350989+0000","last_change":"2024-09-10T22:24:22.139850+0000","last_active":"2024-09-10T22:26:06.350989+0000","last_peered":"2024-09-10T22:26:06.350989+0000","last_clean":"2024-09-10T22:26:06.350989+0000","last_became_active":"2024-09-10T22:24:22.137885+0000","last_became_peered":"2024-09-10T22:24:22.137885+0000","last_unstale":"2024-09-10T22:26:06.350989+0000","last_undegraded":"2024-09-10T22:26:06.350989+0000","last_fullsized":"2024-09-10T22:26:06.350989+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_clean_scrub_stamp":"2024-09-10T22:24:21.113844+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:52:55.988247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"75'5","reported_seq":130,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T22:26:08.389562+0000","last_change":"2024-09-10T22:24:20.383650+0000","last_active":"2024-09-10T22:26:08.389562+0000","last_peered":"2024-09-10T22:26:08.389562+0000","last_clean":"2024-09-10T22:26:08.389562+0000","last_became_active":"2024-09-10T22:24:20.383286+0000","last_became_peered":"2024-09-10T22:24:20.383286+0000","last_unstale":"2024-09-10T22:26:08.389562+0000","last_undegraded":"2024-09-10T22:26:08.389562+0000","last_fullsized":"2024-09-10T22:26:08.389562+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:19.099039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:19.099039+0000","last_clean_scrub_stamp":"2024-09-10T22:24:19.099039+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:38:04.467105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":98,"num_read_kb":98,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"75'8","reported_seq":30,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T22:26:05.951282+0000","last_change":"2024-09-10T22:24:22.141717+0000","last_active":"2024-09-10T22:26:05.951282+0000","last_peered":"2024-09-10T22:26:05.951282+0000","last_clean":"2024-09-10T22:26:05.951282+0000","last_became_active":"2024-09-10T22:24:22.141426+0000","last_became_peered":"2024-09-10T22:24:22.141426+0000","last_unstale":"2024-09-10T22:26:05.951282+0000","last_undegraded":"2024-09-10T22:26:05.951282+0000","last_fullsized":"2024-09-10T22:26:05.951282+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_clean_scrub_stamp":"2024-09-10T22:24:21.113844+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:13:58.341345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"73'1","reported_seq":28,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T22:26:06.365602+0000","last_change":"2024-09-10T22:24:20.127658+0000","last_active":"2024-09-10T22:26:06.365602+0000","last_peered":"2024-09-10T22:26:06.365602+0000","last_clean":"2024-09-10T22:26:06.365602+0000","last_became_active":"2024-09-10T22:24:20.127366+0000","last_became_peered":"2024-09-10T22:24:20.127366+0000","last_unstale":"2024-09-10T22:26:06.365602+0000","last_undegraded":"2024-09-10T22:26:06.365602+0000","last_fullsized":"2024-09-10T22:26:06.365602+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:19.099039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:19.099039+0000","last_clean_scrub_stamp":"2024-09-10T22:24:19.099039+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:36:05.439417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"75'7","reported_seq":27,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-10T22:26:04.954839+0000","last_change":"2024-09-10T22:24:22.144799+0000","last_active":"2024-09-10T22:26:04.954839+0000","last_peered":"2024-09-10T22:26:04.954839+0000","last_clean":"2024-09-10T22:26:04.954839+0000","last_became_active":"2024-09-10T22:24:22.144543+0000","last_became_peered":"2024-09-10T22:24:22.144543+0000","last_unstale":"2024-09-10T22:26:04.954839+0000","last_undegraded":"2024-09-10T22:26:04.954839+0000","last_fullsized":"2024-09-10T22:26:04.954839+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_clean_scrub_stamp":"2024-09-10T22:24:21.113844+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:45:46.193108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":27,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T22:26:05.952481+0000","last_change":"2024-09-10T22:24:20.383345+0000","last_active":"2024-09-10T22:26:05.952481+0000","last_peered":"2024-09-10T22:26:05.952481+0000","last_clean":"2024-09-10T22:26:05.952481+0000","last_became_active":"2024-09-10T22:24:20.383023+0000","last_became_peered":"2024-09-10T22:24:20.383023+0000","last_unstale":"2024-09-10T22:26:05.952481+0000","last_undegraded":"2024-09-10T22:26:05.952481+0000","last_fullsized":"2024-09-10T22:26:05.952481+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:19.099039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:19.099039+0000","last_clean_scrub_stamp":"2024-09-10T22:24:19.099039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:27:31.771060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"75'5","reported_seq":25,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-10T22:26:04.954932+0000","last_change":"2024-09-10T22:24:22.143130+0000","last_active":"2024-09-10T22:26:04.954932+0000","last_peered":"2024-09-10T22:26:04.954932+0000","last_clean":"2024-09-10T22:26:04.954932+0000","last_became_active":"2024-09-10T22:24:22.142664+0000","last_became_peered":"2024-09-10T22:24:22.142664+0000","last_unstale":"2024-09-10T22:26:04.954932+0000","last_undegraded":"2024-09-10T22:26:04.954932+0000","last_fullsized":"2024-09-10T22:26:04.954932+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_clean_scrub_stamp":"2024-09-10T22:24:21.113844+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:49:53.325307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"73'1","reported_seq":29,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T22:26:06.594852+0000","last_change":"2024-09-10T22:24:20.383795+0000","last_active":"2024-09-10T22:26:06.594852+0000","last_peered":"2024-09-10T22:26:06.594852+0000","last_clean":"2024-09-10T22:26:06.594852+0000","last_became_active":"2024-09-10T22:24:20.383418+0000","last_became_peered":"2024-09-10T22:24:20.383418+0000","last_unstale":"2024-09-10T22:26:06.594852+0000","last_undegraded":"2024-09-10T22:26:06.594852+0000","last_fullsized":"2024-09-10T22:26:06.594852+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:19.099039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:19.099039+0000","last_clean_scrub_stamp":"2024-09-10T22:24:19.099039+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:52:26.602544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"75'9","reported_seq":31,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T22:26:06.351153+0000","last_change":"2024-09-10T22:24:22.139416+0000","last_active":"2024-09-10T22:26:06.351153+0000","last_peered":"2024-09-10T22:26:06.351153+0000","last_clean":"2024-09-10T22:26:06.351153+0000","last_became_active":"2024-09-10T22:24:22.138648+0000","last_became_peered":"2024-09-10T22:24:22.138648+0000","last_unstale":"2024-09-10T22:26:06.351153+0000","last_undegraded":"2024-09-10T22:26:06.351153+0000","last_fullsized":"2024-09-10T22:26:06.351153+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_clean_scrub_stamp":"2024-09-10T22:24:21.113844+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:12:20.064134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"77'12","reported_seq":39,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T22:26:05.952761+0000","last_change":"2024-09-10T22:24:20.124001+0000","last_active":"2024-09-10T22:26:05.952761+0000","last_peered":"2024-09-10T22:26:05.952761+0000","last_clean":"2024-09-10T22:26:05.952761+0000","last_became_active":"2024-09-10T22:24:20.123616+0000","last_became_peered":"2024-09-10T22:24:20.123616+0000","last_unstale":"2024-09-10T22:26:05.952761+0000","last_undegraded":"2024-09-10T22:26:05.952761+0000","last_fullsized":"2024-09-10T22:26:05.952761+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:19.099039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:19.099039+0000","last_clean_scrub_stamp":"2024-09-10T22:24:19.099039+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:12:47.003561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"75'5","reported_seq":27,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T22:26:05.957528+0000","last_change":"2024-09-10T22:24:22.146936+0000","last_active":"2024-09-10T22:26:05.957528+0000","last_peered":"2024-09-10T22:26:05.957528+0000","last_clean":"2024-09-10T22:26:05.957528+0000","last_became_active":"2024-09-10T22:24:22.146578+0000","last_became_peered":"2024-09-10T22:24:22.146578+0000","last_unstale":"2024-09-10T22:26:05.957528+0000","last_undegraded":"2024-09-10T22:26:05.957528+0000","last_fullsized":"2024-09-10T22:26:05.957528+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_clean_scrub_stamp":"2024-09-10T22:24:21.113844+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:44:20.229747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"73'4","reported_seq":31,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T22:26:05.951333+0000","last_change":"2024-09-10T22:24:20.406642+0000","last_active":"2024-09-10T22:26:05.951333+0000","last_peered":"2024-09-10T22:26:05.951333+0000","last_clean":"2024-09-10T22:26:05.951333+0000","last_became_active":"2024-09-10T22:24:20.406288+0000","last_became_peered":"2024-09-10T22:24:20.406288+0000","last_unstale":"2024-09-10T22:26:05.951333+0000","last_undegraded":"2024-09-10T22:26:05.951333+0000","last_fullsized":"2024-09-10T22:26:05.951333+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:19.099039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:19.099039+0000","last_clean_scrub_stamp":"2024-09-10T22:24:19.099039+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:10:48.558751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"75'7","reported_seq":29,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T22:26:05.954742+0000","last_change":"2024-09-10T22:24:22.142511+0000","last_active":"2024-09-10T22:26:05.954742+0000","last_peered":"2024-09-10T22:26:05.954742+0000","last_clean":"2024-09-10T22:26:05.954742+0000","last_became_active":"2024-09-10T22:24:22.142200+0000","last_became_peered":"2024-09-10T22:24:22.142200+0000","last_unstale":"2024-09-10T22:26:05.954742+0000","last_undegraded":"2024-09-10T22:26:05.954742+0000","last_fullsized":"2024-09-10T22:26:05.954742+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_clean_scrub_stamp":"2024-09-10T22:24:21.113844+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:09:46.928679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"73'2","reported_seq":27,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-10T22:26:05.072117+0000","last_change":"2024-09-10T22:24:20.383403+0000","last_active":"2024-09-10T22:26:05.072117+0000","last_peered":"2024-09-10T22:26:05.072117+0000","last_clean":"2024-09-10T22:26:05.072117+0000","last_became_active":"2024-09-10T22:24:20.383143+0000","last_became_peered":"2024-09-10T22:24:20.383143+0000","last_unstale":"2024-09-10T22:26:05.072117+0000","last_undegraded":"2024-09-10T22:26:05.072117+0000","last_fullsized":"2024-09-10T22:26:05.072117+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:19.099039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:19.099039+0000","last_clean_scrub_stamp":"2024-09-10T22:24:19.099039+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:54:07.338628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"75'2","reported_seq":24,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T22:26:06.594153+0000","last_change":"2024-09-10T22:24:22.136604+0000","last_active":"2024-09-10T22:26:06.594153+0000","last_peered":"2024-09-10T22:26:06.594153+0000","last_clean":"2024-09-10T22:26:06.594153+0000","last_became_active":"2024-09-10T22:24:22.136298+0000","last_became_peered":"2024-09-10T22:24:22.136298+0000","last_unstale":"2024-09-10T22:26:06.594153+0000","last_undegraded":"2024-09-10T22:26:06.594153+0000","last_fullsized":"2024-09-10T22:26:06.594153+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_clean_scrub_stamp":"2024-09-10T22:24:21.113844+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:39:11.777729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"73'3","reported_seq":30,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T22:26:05.957274+0000","last_change":"2024-09-10T22:24:20.124911+0000","last_active":"2024-09-10T22:26:05.957274+0000","last_peered":"2024-09-10T22:26:05.957274+0000","last_clean":"2024-09-10T22:26:05.957274+0000","last_became_active":"2024-09-10T22:24:20.124152+0000","last_became_peered":"2024-09-10T22:24:20.124152+0000","last_unstale":"2024-09-10T22:26:05.957274+0000","last_undegraded":"2024-09-10T22:26:05.957274+0000","last_fullsized":"2024-09-10T22:26:05.957274+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:19.099039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:19.099039+0000","last_clean_scrub_stamp":"2024-09-10T22:24:19.099039+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:32:30.837104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"75'9","reported_seq":31,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T22:26:05.953318+0000","last_change":"2024-09-10T22:24:22.138080+0000","last_active":"2024-09-10T22:26:05.953318+0000","last_peered":"2024-09-10T22:26:05.953318+0000","last_clean":"2024-09-10T22:26:05.953318+0000","last_became_active":"2024-09-10T22:24:22.137775+0000","last_became_peered":"2024-09-10T22:24:22.137775+0000","last_unstale":"2024-09-10T22:26:05.953318+0000","last_undegraded":"2024-09-10T22:26:05.953318+0000","last_fullsized":"2024-09-10T22:26:05.953318+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_clean_scrub_stamp":"2024-09-10T22:24:21.113844+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:10:48.320495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"73'1","reported_seq":28,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T22:26:05.953923+0000","last_change":"2024-09-10T22:24:20.125551+0000","last_active":"2024-09-10T22:26:05.953923+0000","last_peered":"2024-09-10T22:26:05.953923+0000","last_clean":"2024-09-10T22:26:05.953923+0000","last_became_active":"2024-09-10T22:24:20.125064+0000","last_became_peered":"2024-09-10T22:24:20.125064+0000","last_unstale":"2024-09-10T22:26:05.953923+0000","last_undegraded":"2024-09-10T22:26:05.953923+0000","last_fullsized":"2024-09-10T22:26:05.953923+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:19.099039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:19.099039+0000","last_clean_scrub_stamp":"2024-09-10T22:24:19.099039+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:29:48.598158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"75'8","reported_seq":30,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T22:26:05.957263+0000","last_change":"2024-09-10T22:24:22.142894+0000","last_active":"2024-09-10T22:26:05.957263+0000","last_peered":"2024-09-10T22:26:05.957263+0000","last_clean":"2024-09-10T22:26:05.957263+0000","last_became_active":"2024-09-10T22:24:22.142554+0000","last_became_peered":"2024-09-10T22:24:22.142554+0000","last_unstale":"2024-09-10T22:26:05.957263+0000","last_undegraded":"2024-09-10T22:26:05.957263+0000","last_fullsized":"2024-09-10T22:26:05.957263+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_clean_scrub_stamp":"2024-09-10T22:24:21.113844+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:11:11.457622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"73'4","reported_seq":32,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T22:26:06.594771+0000","last_change":"2024-09-10T22:24:20.128212+0000","last_active":"2024-09-10T22:26:06.594771+0000","last_peered":"2024-09-10T22:26:06.594771+0000","last_clean":"2024-09-10T22:26:06.594771+0000","last_became_active":"2024-09-10T22:24:20.127597+0000","last_became_peered":"2024-09-10T22:24:20.127597+0000","last_unstale":"2024-09-10T22:26:06.594771+0000","last_undegraded":"2024-09-10T22:26:06.594771+0000","last_fullsized":"2024-09-10T22:26:06.594771+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:19.099039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:19.099039+0000","last_clean_scrub_stamp":"2024-09-10T22:24:19.099039+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:48:28.543222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"75'5","reported_seq":27,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T22:26:06.365441+0000","last_change":"2024-09-10T22:24:22.144321+0000","last_active":"2024-09-10T22:26:06.365441+0000","last_peered":"2024-09-10T22:26:06.365441+0000","last_clean":"2024-09-10T22:26:06.365441+0000","last_became_active":"2024-09-10T22:24:22.144037+0000","last_became_peered":"2024-09-10T22:24:22.144037+0000","last_unstale":"2024-09-10T22:26:06.365441+0000","last_undegraded":"2024-09-10T22:26:06.365441+0000","last_fullsized":"2024-09-10T22:26:06.365441+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_clean_scrub_stamp":"2024-09-10T22:24:21.113844+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:28:00.600758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"75'15","reported_seq":37,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T22:26:05.951547+0000","last_change":"2024-09-10T22:24:22.145574+0000","last_active":"2024-09-10T22:26:05.951547+0000","last_peered":"2024-09-10T22:26:05.951547+0000","last_clean":"2024-09-10T22:26:05.951547+0000","last_became_active":"2024-09-10T22:24:22.144425+0000","last_became_peered":"2024-09-10T22:24:22.144425+0000","last_unstale":"2024-09-10T22:26:05.951547+0000","last_undegraded":"2024-09-10T22:26:05.951547+0000","last_fullsized":"2024-09-10T22:26:05.951547+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_clean_scrub_stamp":"2024-09-10T22:24:21.113844+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:41:10.177782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"73'2","reported_seq":29,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T22:26:06.594742+0000","last_change":"2024-09-10T22:24:20.124627+0000","last_active":"2024-09-10T22:26:06.594742+0000","last_peered":"2024-09-10T22:26:06.594742+0000","last_clean":"2024-09-10T22:26:06.594742+0000","last_became_active":"2024-09-10T22:24:20.124174+0000","last_became_peered":"2024-09-10T22:24:20.124174+0000","last_unstale":"2024-09-10T22:26:06.594742+0000","last_undegraded":"2024-09-10T22:26:06.594742+0000","last_fullsized":"2024-09-10T22:26:06.594742+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:19.099039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:19.099039+0000","last_clean_scrub_stamp":"2024-09-10T22:24:19.099039+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:35:26.871316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"75'9","reported_seq":29,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-10T22:26:05.072230+0000","last_change":"2024-09-10T22:24:22.142531+0000","last_active":"2024-09-10T22:26:05.072230+0000","last_peered":"2024-09-10T22:26:05.072230+0000","last_clean":"2024-09-10T22:26:05.072230+0000","last_became_active":"2024-09-10T22:24:22.142240+0000","last_became_peered":"2024-09-10T22:24:22.142240+0000","last_unstale":"2024-09-10T22:26:05.072230+0000","last_undegraded":"2024-09-10T22:26:05.072230+0000","last_fullsized":"2024-09-10T22:26:05.072230+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_clean_scrub_stamp":"2024-09-10T22:24:21.113844+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:30:56.868586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"73'4","reported_seq":44,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T22:26:06.594840+0000","last_change":"2024-09-10T22:25:05.644160+0000","last_active":"2024-09-10T22:26:06.594840+0000","last_peered":"2024-09-10T22:26:06.594840+0000","last_clean":"2024-09-10T22:26:06.594840+0000","last_became_active":"2024-09-10T22:25:05.638026+0000","last_became_peered":"2024-09-10T22:25:05.638026+0000","last_unstale":"2024-09-10T22:26:06.594840+0000","last_undegraded":"2024-09-10T22:26:06.594840+0000","last_fullsized":"2024-09-10T22:26:06.594840+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:19.099039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:19.099039+0000","last_clean_scrub_stamp":"2024-09-10T22:24:19.099039+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:58:18.112018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":10,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,4,7],"acting":[8,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"75'6","reported_seq":28,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T22:26:05.954730+0000","last_change":"2024-09-10T22:24:22.141121+0000","last_active":"2024-09-10T22:26:05.954730+0000","last_peered":"2024-09-10T22:26:05.954730+0000","last_clean":"2024-09-10T22:26:05.954730+0000","last_became_active":"2024-09-10T22:24:22.140490+0000","last_became_peered":"2024-09-10T22:24:22.140490+0000","last_unstale":"2024-09-10T22:26:05.954730+0000","last_undegraded":"2024-09-10T22:26:05.954730+0000","last_fullsized":"2024-09-10T22:26:05.954730+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_clean_scrub_stamp":"2024-09-10T22:24:21.113844+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:52:22.840740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"73'2","reported_seq":29,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T22:26:05.957592+0000","last_change":"2024-09-10T22:24:20.385053+0000","last_active":"2024-09-10T22:26:05.957592+0000","last_peered":"2024-09-10T22:26:05.957592+0000","last_clean":"2024-09-10T22:26:05.957592+0000","last_became_active":"2024-09-10T22:24:20.384432+0000","last_became_peered":"2024-09-10T22:24:20.384432+0000","last_unstale":"2024-09-10T22:26:05.957592+0000","last_undegraded":"2024-09-10T22:26:05.957592+0000","last_fullsized":"2024-09-10T22:26:05.957592+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:19.099039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:19.099039+0000","last_clean_scrub_stamp":"2024-09-10T22:24:19.099039+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:18:15.685331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"75'5","reported_seq":27,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T22:26:05.957488+0000","last_change":"2024-09-10T22:24:22.143884+0000","last_active":"2024-09-10T22:26:05.957488+0000","last_peered":"2024-09-10T22:26:05.957488+0000","last_clean":"2024-09-10T22:26:05.957488+0000","last_became_active":"2024-09-10T22:24:22.143446+0000","last_became_peered":"2024-09-10T22:24:22.143446+0000","last_unstale":"2024-09-10T22:26:05.957488+0000","last_undegraded":"2024-09-10T22:26:05.957488+0000","last_fullsized":"2024-09-10T22:26:05.957488+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_clean_scrub_stamp":"2024-09-10T22:24:21.113844+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:28:32.453668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"73'9","reported_seq":54,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T22:26:05.952794+0000","last_change":"2024-09-10T22:25:05.528200+0000","last_active":"2024-09-10T22:26:05.952794+0000","last_peered":"2024-09-10T22:26:05.952794+0000","last_clean":"2024-09-10T22:26:05.952794+0000","last_became_active":"2024-09-10T22:25:05.520346+0000","last_became_peered":"2024-09-10T22:25:05.520346+0000","last_unstale":"2024-09-10T22:26:05.952794+0000","last_undegraded":"2024-09-10T22:26:05.952794+0000","last_fullsized":"2024-09-10T22:26:05.952794+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:19.099039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:19.099039+0000","last_clean_scrub_stamp":"2024-09-10T22:24:19.099039+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:38:21.050372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":582,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,11,8],"acting":[9,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":502,"ondisk_log_size":502,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":64461,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":599,"num_read_kb":362,"num_write":171,"num_write_kb":116,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":14,"num_bytes_recovered":1324,"num_keys_recovered":10,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":417792,"data_stored":193075,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":145,"ondisk_log_size":145,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4751360,"data_stored":4722944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":92,"ondisk_log_size":92,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":67,"seq":287762808867,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27872,"kb_used_data":840,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717280,"statfs":{"total":95995035648,"available":95966494720,"internally_reserved":0,"allocated":860160,"data_stored":414872,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":10,"up_from":62,"seq":266287972391,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36824,"kb_used_data":1480,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708328,"statfs":{"total":95995035648,"available":95957327872,"internally_reserved":0,"allocated":1515520,"data_stored":1049116,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":36174272},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":9,"up_from":57,"seq":244813135916,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27876,"kb_used_data":848,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717276,"statfs":{"total":95995035648,"available":95966490624,"internally_reserved":0,"allocated":868352,"data_stored":414456,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,5,6,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":51,"seq":219043332145,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27880,"kb_used_data":848,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717272,"statfs":{"total":95995035648,"available":95966486528,"internally_reserved":0,"allocated":868352,"data_stored":414376,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":7,"up_from":46,"seq":197568495671,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36772,"kb_used_data":1424,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708380,"statfs":{"total":95995035648,"available":95957381120,"internally_reserved":0,"allocated":1458176,"data_stored":1006173,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":36174282},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":40,"seq":171798691900,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27864,"kb_used_data":836,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717288,"statfs":{"total":95995035648,"available":95966502912,"internally_reserved":0,"allocated":856064,"data_stored":413845,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":34,"seq":146028888128,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28460,"kb_used_data":1432,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716692,"statfs":{"total":95995035648,"available":95965892608,"internally_reserved":0,"allocated":1466368,"data_stored":1005747,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":29,"seq":124554051653,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27876,"kb_used_data":844,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717276,"statfs":{"total":95995035648,"available":95966490624,"internally_reserved":0,"allocated":864256,"data_stored":415396,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":23,"seq":98784247882,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27884,"kb_used_data":852,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717268,"statfs":{"total":95995035648,"available":95966482432,"internally_reserved":0,"allocated":872448,"data_stored":414156,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444112,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36252,"kb_used_data":904,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708900,"statfs":{"total":95995035648,"available":95957913600,"internally_reserved":0,"allocated":925696,"data_stored":466456,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":12,"seq":51539607636,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36232,"kb_used_data":884,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708920,"statfs":{"total":95995035648,"available":95957934080,"internally_reserved":0,"allocated":905216,"data_stored":465196,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738458,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36208,"kb_used_data":856,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708944,"statfs":{"total":95995035648,"available":95957958656,"internally_reserved":0,"allocated":876544,"data_stored":415116,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":60101,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":60779,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1758,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1624,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":2050,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":62121,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-10T22:26:12.384 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-10T22:26:12.526 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:12.521+0000 7f4282efe640 1 -- 172.21.15.19:0/1923521617 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f427c105ae0 msgr2=0x7f427c107f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:26:12.526 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:12.521+0000 7f4282efe640 1 --2- 172.21.15.19:0/1923521617 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f427c105ae0 0x7f427c107f50 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f4264009900 tx=0x7f426402a410 comp rx=0 tx=0).stop 2024-09-10T22:26:12.526 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:12.522+0000 7f4282efe640 1 -- 172.21.15.19:0/1923521617 shutdown_connections 2024-09-10T22:26:12.526 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:12.522+0000 7f4282efe640 1 --2- 172.21.15.19:0/1923521617 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f427c108690 0x7f427c10ab50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:26:12.526 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:12.522+0000 7f4282efe640 1 --2- 172.21.15.19:0/1923521617 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f427c105ae0 0x7f427c107f50 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:26:12.526 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:12.522+0000 7f4282efe640 1 --2- 172.21.15.19:0/1923521617 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f427c06ba60 0x7f427c105550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:26:12.527 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:12.522+0000 7f4282efe640 1 -- 172.21.15.19:0/1923521617 >> 172.21.15.19:0/1923521617 conn(0x7f427c0fd120 msgr2=0x7f427c0ff560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:26:12.527 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:12.522+0000 7f4282efe640 1 -- 172.21.15.19:0/1923521617 shutdown_connections 2024-09-10T22:26:12.527 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:12.522+0000 7f4282efe640 1 -- 172.21.15.19:0/1923521617 wait complete. 2024-09-10T22:26:12.527 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:12.522+0000 7f4282efe640 1 Processor -- start 2024-09-10T22:26:12.527 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:12.522+0000 7f4282efe640 1 -- start start 2024-09-10T22:26:12.527 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:12.522+0000 7f4282efe640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f427c06ba60 0x7f427c198cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:26:12.527 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:12.522+0000 7f4282efe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f427c105ae0 0x7f427c199320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:26:12.527 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:12.522+0000 7f4282efe640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f427c108690 0x7f427c199f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:26:12.527 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:12.522+0000 7f4282efe640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f427c10e610 con 0x7f427c105ae0 2024-09-10T22:26:12.527 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:12.522+0000 7f4282efe640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f427c10e490 con 0x7f427c06ba60 2024-09-10T22:26:12.527 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:12.522+0000 7f4282efe640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f427c10e790 con 0x7f427c108690 2024-09-10T22:26:12.527 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:12.522+0000 7f427bfff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f427c105ae0 0x7f427c199320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:26:12.528 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:12.522+0000 7f427bfff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f427c105ae0 0x7f427c199320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:53598/0 (socket says 172.21.15.19:53598) 2024-09-10T22:26:12.528 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:12.522+0000 7f427bfff640 1 -- 172.21.15.19:0/3291957810 learned_addr learned my addr 172.21.15.19:0/3291957810 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:26:12.528 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:12.523+0000 7f4280c9a640 1 --2- 172.21.15.19:0/3291957810 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f427c06ba60 0x7f427c198cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:26:12.528 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:12.523+0000 7f428149b640 1 --2- 172.21.15.19:0/3291957810 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f427c108690 0x7f427c199f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:26:12.528 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:12.523+0000 7f427bfff640 1 -- 172.21.15.19:0/3291957810 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f427c108690 msgr2=0x7f427c199f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:26:12.528 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:12.523+0000 7f427bfff640 1 --2- 172.21.15.19:0/3291957810 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f427c108690 0x7f427c199f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:26:12.528 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:12.523+0000 7f427bfff640 1 -- 172.21.15.19:0/3291957810 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f427c06ba60 msgr2=0x7f427c198cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:26:12.528 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:12.523+0000 7f427bfff640 1 --2- 172.21.15.19:0/3291957810 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f427c06ba60 0x7f427c198cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:26:12.528 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:12.523+0000 7f427bfff640 1 -- 172.21.15.19:0/3291957810 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f427c19a810 con 0x7f427c105ae0 2024-09-10T22:26:12.528 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:12.523+0000 7f4280c9a640 1 --2- 172.21.15.19:0/3291957810 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f427c06ba60 0x7f427c198cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T22:26:12.528 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:12.523+0000 7f427bfff640 1 --2- 172.21.15.19:0/3291957810 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f427c105ae0 0x7f427c199320 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f4264005ab0 tx=0x7f4264003cd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:26:12.528 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:12.523+0000 7f4279ffb640 1 -- 172.21.15.19:0/3291957810 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f426403f070 con 0x7f427c105ae0 2024-09-10T22:26:12.529 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:12.523+0000 7f4279ffb640 1 -- 172.21.15.19:0/3291957810 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f426403b460 con 0x7f427c105ae0 2024-09-10T22:26:12.529 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:12.523+0000 7f4279ffb640 1 -- 172.21.15.19:0/3291957810 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4264035030 con 0x7f427c105ae0 2024-09-10T22:26:12.529 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:12.523+0000 7f4282efe640 1 -- 172.21.15.19:0/3291957810 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f427c19aaa0 con 0x7f427c105ae0 2024-09-10T22:26:12.529 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:12.523+0000 7f4282efe640 1 -- 172.21.15.19:0/3291957810 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f427c1a0ff0 con 0x7f427c105ae0 2024-09-10T22:26:12.530 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:12.524+0000 7f4282efe640 1 -- 172.21.15.19:0/3291957810 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f427c0fec10 con 0x7f427c105ae0 2024-09-10T22:26:12.530 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:12.526+0000 7f4279ffb640 1 -- 172.21.15.19:0/3291957810 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 18) ==== 153250+0+0 (secure 0 0 0) 0x7f426403b8d0 con 0x7f427c105ae0 2024-09-10T22:26:12.530 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:12.526+0000 7f4279ffb640 1 --2- 172.21.15.19:0/3291957810 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f42680b52e0 0x7f42680b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:26:12.530 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:12.527+0000 7f4280c9a640 1 --2- 172.21.15.19:0/3291957810 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f42680b52e0 0x7f42680b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:26:12.530 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:12.527+0000 7f4279ffb640 1 -- 172.21.15.19:0/3291957810 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8327+0+0 (secure 0 0 0) 0x7f4264106d00 con 0x7f427c105ae0 2024-09-10T22:26:12.530 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:12.527+0000 7f4280c9a640 1 --2- 172.21.15.19:0/3291957810 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f42680b52e0 0x7f42680b77a0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f426c005d00 tx=0x7f426c005ed0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:26:12.531 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:12.529+0000 7f4279ffb640 1 -- 172.21.15.19:0/3291957810 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f42640cdb60 con 0x7f427c105ae0 2024-09-10T22:26:12.713 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:12.711+0000 7f4282efe640 1 -- 172.21.15.19:0/3291957810 --> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f427c063590 con 0x7f42680b52e0 2024-09-10T22:26:12.717 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:12.715+0000 7f4279ffb640 1 -- 172.21.15.19:0/3291957810 <== mgr.14150 v2:172.21.15.19:6800/2119495487 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258894 (secure 0 0 0) 0x7f427c063590 con 0x7f42680b52e0 2024-09-10T22:26:12.720 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-10T22:26:12.722 INFO:teuthology.orchestra.run.smithi019.stderr:dumped all 2024-09-10T22:26:12.723 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:12.719+0000 7f4282efe640 1 -- 172.21.15.19:0/3291957810 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f42680b52e0 msgr2=0x7f42680b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:26:12.723 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:12.719+0000 7f4282efe640 1 --2- 172.21.15.19:0/3291957810 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f42680b52e0 0x7f42680b77a0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f426c005d00 tx=0x7f426c005ed0 comp rx=0 tx=0).stop 2024-09-10T22:26:12.723 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:12.719+0000 7f4282efe640 1 -- 172.21.15.19:0/3291957810 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f427c105ae0 msgr2=0x7f427c199320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:26:12.723 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:12.719+0000 7f4282efe640 1 --2- 172.21.15.19:0/3291957810 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f427c105ae0 0x7f427c199320 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f4264005ab0 tx=0x7f4264003cd0 comp rx=0 tx=0).stop 2024-09-10T22:26:12.723 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:12.719+0000 7f4282efe640 1 -- 172.21.15.19:0/3291957810 shutdown_connections 2024-09-10T22:26:12.723 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:12.719+0000 7f4282efe640 1 --2- 172.21.15.19:0/3291957810 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f42680b52e0 0x7f42680b77a0 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:26:12.724 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:12.719+0000 7f4282efe640 1 --2- 172.21.15.19:0/3291957810 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f427c108690 0x7f427c199f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:26:12.724 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:12.719+0000 7f4282efe640 1 --2- 172.21.15.19:0/3291957810 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f427c105ae0 0x7f427c199320 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:26:12.724 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:12.719+0000 7f4282efe640 1 --2- 172.21.15.19:0/3291957810 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f427c06ba60 0x7f427c198cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:26:12.724 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:12.719+0000 7f4282efe640 1 -- 172.21.15.19:0/3291957810 >> 172.21.15.19:0/3291957810 conn(0x7f427c0fd120 msgr2=0x7f427c103d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:26:12.724 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:12.719+0000 7f4282efe640 1 -- 172.21.15.19:0/3291957810 shutdown_connections 2024-09-10T22:26:12.724 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:12.719+0000 7f4282efe640 1 -- 172.21.15.19:0/3291957810 wait complete. 2024-09-10T22:26:12.732 INFO:teuthology.orchestra.run.smithi019.stdout:{"pg_ready":true,"pg_map":{"version":341,"stamp":"2024-09-10T22:26:12.389857+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":655371,"num_objects":64,"num_object_clones":0,"num_object_copies":192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":691,"num_read_kb":437,"num_write":298,"num_write_kb":2270,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":24,"num_bytes_recovered":2953164,"num_keys_recovered":10,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":741,"ondisk_log_size":741,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":378056,"kb_used_data":12108,"kb_used_omap":18,"kb_used_meta":365677,"kb_avail":1124563768,"statfs":{"total":1151940427776,"available":1151553298432,"internally_reserved":0,"allocated":12398592,"data_stored":6929769,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19142,"internal_metadata":374453562},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1006,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":62,"num_read_kb":32,"num_write":12,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":652,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.001786"},"pg_stats":[{"pgid":"3.3f","version":"75'8","reported_seq":30,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T22:26:05.953476+0000","last_change":"2024-09-10T22:24:22.139905+0000","last_active":"2024-09-10T22:26:05.953476+0000","last_peered":"2024-09-10T22:26:05.953476+0000","last_clean":"2024-09-10T22:26:05.953476+0000","last_became_active":"2024-09-10T22:24:22.139558+0000","last_became_peered":"2024-09-10T22:24:22.139558+0000","last_unstale":"2024-09-10T22:26:05.953476+0000","last_undegraded":"2024-09-10T22:26:05.953476+0000","last_fullsized":"2024-09-10T22:26:05.953476+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_clean_scrub_stamp":"2024-09-10T22:24:21.113844+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:44:10.434972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"75'4","reported_seq":26,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T22:26:05.954611+0000","last_change":"2024-09-10T22:24:22.136722+0000","last_active":"2024-09-10T22:26:05.954611+0000","last_peered":"2024-09-10T22:26:05.954611+0000","last_clean":"2024-09-10T22:26:05.954611+0000","last_became_active":"2024-09-10T22:24:22.136080+0000","last_became_peered":"2024-09-10T22:24:22.136080+0000","last_unstale":"2024-09-10T22:26:05.954611+0000","last_undegraded":"2024-09-10T22:26:05.954611+0000","last_fullsized":"2024-09-10T22:26:05.954611+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_clean_scrub_stamp":"2024-09-10T22:24:21.113844+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:52:50.562031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"75'7","reported_seq":29,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T22:26:05.954617+0000","last_change":"2024-09-10T22:24:22.141323+0000","last_active":"2024-09-10T22:26:05.954617+0000","last_peered":"2024-09-10T22:26:05.954617+0000","last_clean":"2024-09-10T22:26:05.954617+0000","last_became_active":"2024-09-10T22:24:22.140895+0000","last_became_peered":"2024-09-10T22:24:22.140895+0000","last_unstale":"2024-09-10T22:26:05.954617+0000","last_undegraded":"2024-09-10T22:26:05.954617+0000","last_fullsized":"2024-09-10T22:26:05.954617+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_clean_scrub_stamp":"2024-09-10T22:24:21.113844+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:46:22.604672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"75'8","reported_seq":30,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T22:26:05.951352+0000","last_change":"2024-09-10T22:24:22.138806+0000","last_active":"2024-09-10T22:26:05.951352+0000","last_peered":"2024-09-10T22:26:05.951352+0000","last_clean":"2024-09-10T22:26:05.951352+0000","last_became_active":"2024-09-10T22:24:22.138502+0000","last_became_peered":"2024-09-10T22:24:22.138502+0000","last_unstale":"2024-09-10T22:26:05.951352+0000","last_undegraded":"2024-09-10T22:26:05.951352+0000","last_fullsized":"2024-09-10T22:26:05.951352+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_clean_scrub_stamp":"2024-09-10T22:24:21.113844+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:45:01.626820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"75'4","reported_seq":26,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T22:26:06.594143+0000","last_change":"2024-09-10T22:24:22.141233+0000","last_active":"2024-09-10T22:26:06.594143+0000","last_peered":"2024-09-10T22:26:06.594143+0000","last_clean":"2024-09-10T22:26:06.594143+0000","last_became_active":"2024-09-10T22:24:22.140944+0000","last_became_peered":"2024-09-10T22:24:22.140944+0000","last_unstale":"2024-09-10T22:26:06.594143+0000","last_undegraded":"2024-09-10T22:26:06.594143+0000","last_fullsized":"2024-09-10T22:26:06.594143+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_clean_scrub_stamp":"2024-09-10T22:24:21.113844+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:09:29.615658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"75'6","reported_seq":28,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T22:26:05.955522+0000","last_change":"2024-09-10T22:24:22.137990+0000","last_active":"2024-09-10T22:26:05.955522+0000","last_peered":"2024-09-10T22:26:05.955522+0000","last_clean":"2024-09-10T22:26:05.955522+0000","last_became_active":"2024-09-10T22:24:22.137685+0000","last_became_peered":"2024-09-10T22:24:22.137685+0000","last_unstale":"2024-09-10T22:26:05.955522+0000","last_undegraded":"2024-09-10T22:26:05.955522+0000","last_fullsized":"2024-09-10T22:26:05.955522+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_clean_scrub_stamp":"2024-09-10T22:24:21.113844+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:32:23.891069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"75'5","reported_seq":27,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T22:26:06.365123+0000","last_change":"2024-09-10T22:24:22.148073+0000","last_active":"2024-09-10T22:26:06.365123+0000","last_peered":"2024-09-10T22:26:06.365123+0000","last_clean":"2024-09-10T22:26:06.365123+0000","last_became_active":"2024-09-10T22:24:22.147785+0000","last_became_peered":"2024-09-10T22:24:22.147785+0000","last_unstale":"2024-09-10T22:26:06.365123+0000","last_undegraded":"2024-09-10T22:26:06.365123+0000","last_fullsized":"2024-09-10T22:26:06.365123+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_clean_scrub_stamp":"2024-09-10T22:24:21.113844+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:39:48.847949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"75'9","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T22:26:05.952288+0000","last_change":"2024-09-10T22:25:05.524455+0000","last_active":"2024-09-10T22:26:05.952288+0000","last_peered":"2024-09-10T22:26:05.952288+0000","last_clean":"2024-09-10T22:26:05.952288+0000","last_became_active":"2024-09-10T22:25:05.523985+0000","last_became_peered":"2024-09-10T22:25:05.523985+0000","last_unstale":"2024-09-10T22:26:05.952288+0000","last_undegraded":"2024-09-10T22:26:05.952288+0000","last_fullsized":"2024-09-10T22:26:05.952288+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_clean_scrub_stamp":"2024-09-10T22:24:21.113844+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:20:33.302885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,5,10],"acting":[9,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.37","version":"75'11","reported_seq":33,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T22:26:06.575609+0000","last_change":"2024-09-10T22:24:22.148042+0000","last_active":"2024-09-10T22:26:06.575609+0000","last_peered":"2024-09-10T22:26:06.575609+0000","last_clean":"2024-09-10T22:26:06.575609+0000","last_became_active":"2024-09-10T22:24:22.147722+0000","last_became_peered":"2024-09-10T22:24:22.147722+0000","last_unstale":"2024-09-10T22:26:06.575609+0000","last_undegraded":"2024-09-10T22:26:06.575609+0000","last_fullsized":"2024-09-10T22:26:06.575609+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_clean_scrub_stamp":"2024-09-10T22:24:21.113844+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:42:42.383957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"75'16","reported_seq":38,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T22:26:05.955991+0000","last_change":"2024-09-10T22:24:22.138956+0000","last_active":"2024-09-10T22:26:05.955991+0000","last_peered":"2024-09-10T22:26:05.955991+0000","last_clean":"2024-09-10T22:26:05.955991+0000","last_became_active":"2024-09-10T22:24:22.138530+0000","last_became_peered":"2024-09-10T22:24:22.138530+0000","last_unstale":"2024-09-10T22:26:05.955991+0000","last_undegraded":"2024-09-10T22:26:05.955991+0000","last_fullsized":"2024-09-10T22:26:05.955991+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_clean_scrub_stamp":"2024-09-10T22:24:21.113844+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:37:55.316556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"75'6","reported_seq":28,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T22:26:06.365684+0000","last_change":"2024-09-10T22:24:22.143435+0000","last_active":"2024-09-10T22:26:06.365684+0000","last_peered":"2024-09-10T22:26:06.365684+0000","last_clean":"2024-09-10T22:26:06.365684+0000","last_became_active":"2024-09-10T22:24:22.143100+0000","last_became_peered":"2024-09-10T22:24:22.143100+0000","last_unstale":"2024-09-10T22:26:06.365684+0000","last_undegraded":"2024-09-10T22:26:06.365684+0000","last_fullsized":"2024-09-10T22:26:06.365684+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_clean_scrub_stamp":"2024-09-10T22:24:21.113844+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:24:14.344203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"75'7","reported_seq":29,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T22:26:05.951417+0000","last_change":"2024-09-10T22:24:22.138101+0000","last_active":"2024-09-10T22:26:05.951417+0000","last_peered":"2024-09-10T22:26:05.951417+0000","last_clean":"2024-09-10T22:26:05.951417+0000","last_became_active":"2024-09-10T22:24:22.137479+0000","last_became_peered":"2024-09-10T22:24:22.137479+0000","last_unstale":"2024-09-10T22:26:05.951417+0000","last_undegraded":"2024-09-10T22:26:05.951417+0000","last_fullsized":"2024-09-10T22:26:05.951417+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_clean_scrub_stamp":"2024-09-10T22:24:21.113844+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:48:09.423136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"75'10","reported_seq":32,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T22:26:06.351060+0000","last_change":"2024-09-10T22:24:22.137157+0000","last_active":"2024-09-10T22:26:06.351060+0000","last_peered":"2024-09-10T22:26:06.351060+0000","last_clean":"2024-09-10T22:26:06.351060+0000","last_became_active":"2024-09-10T22:24:22.136817+0000","last_became_peered":"2024-09-10T22:24:22.136817+0000","last_unstale":"2024-09-10T22:26:06.351060+0000","last_undegraded":"2024-09-10T22:26:06.351060+0000","last_fullsized":"2024-09-10T22:26:06.351060+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_clean_scrub_stamp":"2024-09-10T22:24:21.113844+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:54:32.922776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"75'7","reported_seq":29,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T22:26:05.954575+0000","last_change":"2024-09-10T22:24:22.138828+0000","last_active":"2024-09-10T22:26:05.954575+0000","last_peered":"2024-09-10T22:26:05.954575+0000","last_clean":"2024-09-10T22:26:05.954575+0000","last_became_active":"2024-09-10T22:24:22.138509+0000","last_became_peered":"2024-09-10T22:24:22.138509+0000","last_unstale":"2024-09-10T22:26:05.954575+0000","last_undegraded":"2024-09-10T22:26:05.954575+0000","last_fullsized":"2024-09-10T22:26:05.954575+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_clean_scrub_stamp":"2024-09-10T22:24:21.113844+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:14:19.492298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"75'7","reported_seq":29,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T22:26:05.954349+0000","last_change":"2024-09-10T22:24:22.139317+0000","last_active":"2024-09-10T22:26:05.954349+0000","last_peered":"2024-09-10T22:26:05.954349+0000","last_clean":"2024-09-10T22:26:05.954349+0000","last_became_active":"2024-09-10T22:24:22.138949+0000","last_became_peered":"2024-09-10T22:24:22.138949+0000","last_unstale":"2024-09-10T22:26:05.954349+0000","last_undegraded":"2024-09-10T22:26:05.954349+0000","last_fullsized":"2024-09-10T22:26:05.954349+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_clean_scrub_stamp":"2024-09-10T22:24:21.113844+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:34:56.412955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"75'9","reported_seq":31,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T22:26:06.575431+0000","last_change":"2024-09-10T22:24:22.147283+0000","last_active":"2024-09-10T22:26:06.575431+0000","last_peered":"2024-09-10T22:26:06.575431+0000","last_clean":"2024-09-10T22:26:06.575431+0000","last_became_active":"2024-09-10T22:24:22.146954+0000","last_became_peered":"2024-09-10T22:24:22.146954+0000","last_unstale":"2024-09-10T22:26:06.575431+0000","last_undegraded":"2024-09-10T22:26:06.575431+0000","last_fullsized":"2024-09-10T22:26:06.575431+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_clean_scrub_stamp":"2024-09-10T22:24:21.113844+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:22:21.772747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"75'8","reported_seq":30,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T22:26:05.953660+0000","last_change":"2024-09-10T22:24:22.139482+0000","last_active":"2024-09-10T22:26:05.953660+0000","last_peered":"2024-09-10T22:26:05.953660+0000","last_clean":"2024-09-10T22:26:05.953660+0000","last_became_active":"2024-09-10T22:24:22.139135+0000","last_became_peered":"2024-09-10T22:24:22.139135+0000","last_unstale":"2024-09-10T22:26:05.953660+0000","last_undegraded":"2024-09-10T22:26:05.953660+0000","last_fullsized":"2024-09-10T22:26:05.953660+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_clean_scrub_stamp":"2024-09-10T22:24:21.113844+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:25:31.639392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"75'10","reported_seq":32,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T22:26:05.952449+0000","last_change":"2024-09-10T22:24:22.142465+0000","last_active":"2024-09-10T22:26:05.952449+0000","last_peered":"2024-09-10T22:26:05.952449+0000","last_clean":"2024-09-10T22:26:05.952449+0000","last_became_active":"2024-09-10T22:24:22.142110+0000","last_became_peered":"2024-09-10T22:24:22.142110+0000","last_unstale":"2024-09-10T22:26:05.952449+0000","last_undegraded":"2024-09-10T22:26:05.952449+0000","last_fullsized":"2024-09-10T22:26:05.952449+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_clean_scrub_stamp":"2024-09-10T22:24:21.113844+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:16:20.476055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"75'7","reported_seq":29,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T22:26:05.954453+0000","last_change":"2024-09-10T22:24:22.147942+0000","last_active":"2024-09-10T22:26:05.954453+0000","last_peered":"2024-09-10T22:26:05.954453+0000","last_clean":"2024-09-10T22:26:05.954453+0000","last_became_active":"2024-09-10T22:24:22.147637+0000","last_became_peered":"2024-09-10T22:24:22.147637+0000","last_unstale":"2024-09-10T22:26:05.954453+0000","last_undegraded":"2024-09-10T22:26:05.954453+0000","last_fullsized":"2024-09-10T22:26:05.954453+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_clean_scrub_stamp":"2024-09-10T22:24:21.113844+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:46:36.831534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"75'8","reported_seq":30,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T22:26:05.953920+0000","last_change":"2024-09-10T22:24:22.138032+0000","last_active":"2024-09-10T22:26:05.953920+0000","last_peered":"2024-09-10T22:26:05.953920+0000","last_clean":"2024-09-10T22:26:05.953920+0000","last_became_active":"2024-09-10T22:24:22.137657+0000","last_became_peered":"2024-09-10T22:24:22.137657+0000","last_unstale":"2024-09-10T22:26:05.953920+0000","last_undegraded":"2024-09-10T22:26:05.953920+0000","last_fullsized":"2024-09-10T22:26:05.953920+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_clean_scrub_stamp":"2024-09-10T22:24:21.113844+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:06:51.479298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"75'11","reported_seq":33,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T22:26:06.351040+0000","last_change":"2024-09-10T22:24:22.141106+0000","last_active":"2024-09-10T22:26:06.351040+0000","last_peered":"2024-09-10T22:26:06.351040+0000","last_clean":"2024-09-10T22:26:06.351040+0000","last_became_active":"2024-09-10T22:24:22.140780+0000","last_became_peered":"2024-09-10T22:24:22.140780+0000","last_unstale":"2024-09-10T22:26:06.351040+0000","last_undegraded":"2024-09-10T22:26:06.351040+0000","last_fullsized":"2024-09-10T22:26:06.351040+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_clean_scrub_stamp":"2024-09-10T22:24:21.113844+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:25:21.302463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"75'10","reported_seq":32,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T22:26:06.575460+0000","last_change":"2024-09-10T22:24:22.146772+0000","last_active":"2024-09-10T22:26:06.575460+0000","last_peered":"2024-09-10T22:26:06.575460+0000","last_clean":"2024-09-10T22:26:06.575460+0000","last_became_active":"2024-09-10T22:24:22.146317+0000","last_became_peered":"2024-09-10T22:24:22.146317+0000","last_unstale":"2024-09-10T22:26:06.575460+0000","last_undegraded":"2024-09-10T22:26:06.575460+0000","last_fullsized":"2024-09-10T22:26:06.575460+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_clean_scrub_stamp":"2024-09-10T22:24:21.113844+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:13:55.706482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"75'8","reported_seq":30,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T22:26:05.957169+0000","last_change":"2024-09-10T22:24:22.139791+0000","last_active":"2024-09-10T22:26:05.957169+0000","last_peered":"2024-09-10T22:26:05.957169+0000","last_clean":"2024-09-10T22:26:05.957169+0000","last_became_active":"2024-09-10T22:24:22.139491+0000","last_became_peered":"2024-09-10T22:24:22.139491+0000","last_unstale":"2024-09-10T22:26:05.957169+0000","last_undegraded":"2024-09-10T22:26:05.957169+0000","last_fullsized":"2024-09-10T22:26:05.957169+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_clean_scrub_stamp":"2024-09-10T22:24:21.113844+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:18:29.412412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"75'6","reported_seq":28,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T22:26:05.951202+0000","last_change":"2024-09-10T22:24:22.143383+0000","last_active":"2024-09-10T22:26:05.951202+0000","last_peered":"2024-09-10T22:26:05.951202+0000","last_clean":"2024-09-10T22:26:05.951202+0000","last_became_active":"2024-09-10T22:24:22.143045+0000","last_became_peered":"2024-09-10T22:24:22.143045+0000","last_unstale":"2024-09-10T22:26:05.951202+0000","last_undegraded":"2024-09-10T22:26:05.951202+0000","last_fullsized":"2024-09-10T22:26:05.951202+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_clean_scrub_stamp":"2024-09-10T22:24:21.113844+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:37:10.135448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"75'2","reported_seq":24,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T22:26:05.957386+0000","last_change":"2024-09-10T22:24:22.141851+0000","last_active":"2024-09-10T22:26:05.957386+0000","last_peered":"2024-09-10T22:26:05.957386+0000","last_clean":"2024-09-10T22:26:05.957386+0000","last_became_active":"2024-09-10T22:24:22.141469+0000","last_became_peered":"2024-09-10T22:24:22.141469+0000","last_unstale":"2024-09-10T22:26:05.957386+0000","last_undegraded":"2024-09-10T22:26:05.957386+0000","last_fullsized":"2024-09-10T22:26:05.957386+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_clean_scrub_stamp":"2024-09-10T22:24:21.113844+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:03:59.805704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"75'15","reported_seq":37,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T22:26:05.954813+0000","last_change":"2024-09-10T22:24:22.139821+0000","last_active":"2024-09-10T22:26:05.954813+0000","last_peered":"2024-09-10T22:26:05.954813+0000","last_clean":"2024-09-10T22:26:05.954813+0000","last_became_active":"2024-09-10T22:24:22.139398+0000","last_became_peered":"2024-09-10T22:24:22.139398+0000","last_unstale":"2024-09-10T22:26:05.954813+0000","last_undegraded":"2024-09-10T22:26:05.954813+0000","last_fullsized":"2024-09-10T22:26:05.954813+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_clean_scrub_stamp":"2024-09-10T22:24:21.113844+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:18:22.160919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"75'6","reported_seq":28,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T22:26:05.953889+0000","last_change":"2024-09-10T22:24:22.141219+0000","last_active":"2024-09-10T22:26:05.953889+0000","last_peered":"2024-09-10T22:26:05.953889+0000","last_clean":"2024-09-10T22:26:05.953889+0000","last_became_active":"2024-09-10T22:24:22.140900+0000","last_became_peered":"2024-09-10T22:24:22.140900+0000","last_unstale":"2024-09-10T22:26:05.953889+0000","last_undegraded":"2024-09-10T22:26:05.953889+0000","last_fullsized":"2024-09-10T22:26:05.953889+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_clean_scrub_stamp":"2024-09-10T22:24:21.113844+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:27:59.115533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"75'4","reported_seq":26,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T22:26:06.351288+0000","last_change":"2024-09-10T22:24:22.139738+0000","last_active":"2024-09-10T22:26:06.351288+0000","last_peered":"2024-09-10T22:26:06.351288+0000","last_clean":"2024-09-10T22:26:06.351288+0000","last_became_active":"2024-09-10T22:24:22.139096+0000","last_became_peered":"2024-09-10T22:24:22.139096+0000","last_unstale":"2024-09-10T22:26:06.351288+0000","last_undegraded":"2024-09-10T22:26:06.351288+0000","last_fullsized":"2024-09-10T22:26:06.351288+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_clean_scrub_stamp":"2024-09-10T22:24:21.113844+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:16:39.110610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"75'7","reported_seq":29,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T22:26:05.954604+0000","last_change":"2024-09-10T22:24:22.144896+0000","last_active":"2024-09-10T22:26:05.954604+0000","last_peered":"2024-09-10T22:26:05.954604+0000","last_clean":"2024-09-10T22:26:05.954604+0000","last_became_active":"2024-09-10T22:24:22.144622+0000","last_became_peered":"2024-09-10T22:24:22.144622+0000","last_unstale":"2024-09-10T22:26:05.954604+0000","last_undegraded":"2024-09-10T22:26:05.954604+0000","last_fullsized":"2024-09-10T22:26:05.954604+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_clean_scrub_stamp":"2024-09-10T22:24:21.113844+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:32:44.648993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"75'8","reported_seq":30,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T22:26:05.953526+0000","last_change":"2024-09-10T22:24:22.148082+0000","last_active":"2024-09-10T22:26:05.953526+0000","last_peered":"2024-09-10T22:26:05.953526+0000","last_clean":"2024-09-10T22:26:05.953526+0000","last_became_active":"2024-09-10T22:24:22.147664+0000","last_became_peered":"2024-09-10T22:24:22.147664+0000","last_unstale":"2024-09-10T22:26:05.953526+0000","last_undegraded":"2024-09-10T22:26:05.953526+0000","last_fullsized":"2024-09-10T22:26:05.953526+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_clean_scrub_stamp":"2024-09-10T22:24:21.113844+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:12:40.154756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"75'12","reported_seq":41,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T22:26:05.953815+0000","last_change":"2024-09-10T22:25:05.638351+0000","last_active":"2024-09-10T22:26:05.953815+0000","last_peered":"2024-09-10T22:26:05.953815+0000","last_clean":"2024-09-10T22:26:05.953815+0000","last_became_active":"2024-09-10T22:25:05.637523+0000","last_became_peered":"2024-09-10T22:25:05.637523+0000","last_unstale":"2024-09-10T22:26:05.953815+0000","last_undegraded":"2024-09-10T22:26:05.953815+0000","last_fullsized":"2024-09-10T22:26:05.953815+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_clean_scrub_stamp":"2024-09-10T22:24:21.113844+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:09:37.231420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,9,4],"acting":[2,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"75'9","reported_seq":31,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T22:26:05.953229+0000","last_change":"2024-09-10T22:24:22.141534+0000","last_active":"2024-09-10T22:26:05.953229+0000","last_peered":"2024-09-10T22:26:05.953229+0000","last_clean":"2024-09-10T22:26:05.953229+0000","last_became_active":"2024-09-10T22:24:22.141243+0000","last_became_peered":"2024-09-10T22:24:22.141243+0000","last_unstale":"2024-09-10T22:26:05.953229+0000","last_undegraded":"2024-09-10T22:26:05.953229+0000","last_fullsized":"2024-09-10T22:26:05.953229+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_clean_scrub_stamp":"2024-09-10T22:24:21.113844+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:26:23.559943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"75'7","reported_seq":29,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T22:26:06.594143+0000","last_change":"2024-09-10T22:24:22.144951+0000","last_active":"2024-09-10T22:26:06.594143+0000","last_peered":"2024-09-10T22:26:06.594143+0000","last_clean":"2024-09-10T22:26:06.594143+0000","last_became_active":"2024-09-10T22:24:22.144634+0000","last_became_peered":"2024-09-10T22:24:22.144634+0000","last_unstale":"2024-09-10T22:26:06.594143+0000","last_undegraded":"2024-09-10T22:26:06.594143+0000","last_fullsized":"2024-09-10T22:26:06.594143+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_clean_scrub_stamp":"2024-09-10T22:24:21.113844+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:04:19.350081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"77'6","reported_seq":134,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T22:26:08.623766+0000","last_change":"2024-09-10T22:24:20.128083+0000","last_active":"2024-09-10T22:26:08.623766+0000","last_peered":"2024-09-10T22:26:08.623766+0000","last_clean":"2024-09-10T22:26:08.623766+0000","last_became_active":"2024-09-10T22:24:20.127676+0000","last_became_peered":"2024-09-10T22:24:20.127676+0000","last_unstale":"2024-09-10T22:26:08.623766+0000","last_undegraded":"2024-09-10T22:26:08.623766+0000","last_fullsized":"2024-09-10T22:26:08.623766+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:19.099039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:19.099039+0000","last_clean_scrub_stamp":"2024-09-10T22:24:19.099039+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:37:51.745817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":930,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":101,"num_read_kb":3,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"75'8","reported_seq":37,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T22:26:05.951367+0000","last_change":"2024-09-10T22:25:05.638296+0000","last_active":"2024-09-10T22:26:05.951367+0000","last_peered":"2024-09-10T22:26:05.951367+0000","last_clean":"2024-09-10T22:26:05.951367+0000","last_became_active":"2024-09-10T22:25:05.637649+0000","last_became_peered":"2024-09-10T22:25:05.637649+0000","last_unstale":"2024-09-10T22:26:05.951367+0000","last_undegraded":"2024-09-10T22:26:05.951367+0000","last_fullsized":"2024-09-10T22:26:05.951367+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_clean_scrub_stamp":"2024-09-10T22:24:21.113844+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:07:42.674144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3],"acting":[5,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"73'3","reported_seq":41,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T22:26:05.955561+0000","last_change":"2024-09-10T22:25:05.532533+0000","last_active":"2024-09-10T22:26:05.955561+0000","last_peered":"2024-09-10T22:26:05.955561+0000","last_clean":"2024-09-10T22:26:05.955561+0000","last_became_active":"2024-09-10T22:25:05.526228+0000","last_became_peered":"2024-09-10T22:25:05.526228+0000","last_unstale":"2024-09-10T22:26:05.955561+0000","last_undegraded":"2024-09-10T22:26:05.955561+0000","last_fullsized":"2024-09-10T22:26:05.955561+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:19.099039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:19.099039+0000","last_clean_scrub_stamp":"2024-09-10T22:24:19.099039+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:53:36.903083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,6],"acting":[10,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"73'2","reported_seq":29,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T22:26:06.351270+0000","last_change":"2024-09-10T22:24:20.122635+0000","last_active":"2024-09-10T22:26:06.351270+0000","last_peered":"2024-09-10T22:26:06.351270+0000","last_clean":"2024-09-10T22:26:06.351270+0000","last_became_active":"2024-09-10T22:24:20.122289+0000","last_became_peered":"2024-09-10T22:24:20.122289+0000","last_unstale":"2024-09-10T22:26:06.351270+0000","last_undegraded":"2024-09-10T22:26:06.351270+0000","last_fullsized":"2024-09-10T22:26:06.351270+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:19.099039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:19.099039+0000","last_clean_scrub_stamp":"2024-09-10T22:24:19.099039+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:30:40.779513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"75'8","reported_seq":30,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T22:26:05.956943+0000","last_change":"2024-09-10T22:24:22.137417+0000","last_active":"2024-09-10T22:26:05.956943+0000","last_peered":"2024-09-10T22:26:05.956943+0000","last_clean":"2024-09-10T22:26:05.956943+0000","last_became_active":"2024-09-10T22:24:22.136913+0000","last_became_peered":"2024-09-10T22:24:22.136913+0000","last_unstale":"2024-09-10T22:26:05.956943+0000","last_undegraded":"2024-09-10T22:26:05.956943+0000","last_fullsized":"2024-09-10T22:26:05.956943+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_clean_scrub_stamp":"2024-09-10T22:24:21.113844+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:23:39.551056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"73'1","reported_seq":28,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T22:26:05.951411+0000","last_change":"2024-09-10T22:24:20.128416+0000","last_active":"2024-09-10T22:26:05.951411+0000","last_peered":"2024-09-10T22:26:05.951411+0000","last_clean":"2024-09-10T22:26:05.951411+0000","last_became_active":"2024-09-10T22:24:20.127998+0000","last_became_peered":"2024-09-10T22:24:20.127998+0000","last_unstale":"2024-09-10T22:26:05.951411+0000","last_undegraded":"2024-09-10T22:26:05.951411+0000","last_fullsized":"2024-09-10T22:26:05.951411+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:19.099039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:19.099039+0000","last_clean_scrub_stamp":"2024-09-10T22:24:19.099039+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:44:39.871564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"75'11","reported_seq":33,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T22:26:05.952467+0000","last_change":"2024-09-10T22:24:22.136355+0000","last_active":"2024-09-10T22:26:05.952467+0000","last_peered":"2024-09-10T22:26:05.952467+0000","last_clean":"2024-09-10T22:26:05.952467+0000","last_became_active":"2024-09-10T22:24:22.136047+0000","last_became_peered":"2024-09-10T22:24:22.136047+0000","last_unstale":"2024-09-10T22:26:05.952467+0000","last_undegraded":"2024-09-10T22:26:05.952467+0000","last_fullsized":"2024-09-10T22:26:05.952467+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_clean_scrub_stamp":"2024-09-10T22:24:21.113844+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:56:14.739365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"77'4","reported_seq":142,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T22:26:08.622443+0000","last_change":"2024-09-10T22:25:05.537891+0000","last_active":"2024-09-10T22:26:08.622443+0000","last_peered":"2024-09-10T22:26:08.622443+0000","last_clean":"2024-09-10T22:26:08.622443+0000","last_became_active":"2024-09-10T22:25:05.526085+0000","last_became_peered":"2024-09-10T22:25:05.526085+0000","last_unstale":"2024-09-10T22:26:08.622443+0000","last_undegraded":"2024-09-10T22:26:08.622443+0000","last_fullsized":"2024-09-10T22:26:08.622443+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:19.099039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:19.099039+0000","last_clean_scrub_stamp":"2024-09-10T22:24:19.099039+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:57:02.158783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":93,"num_read_kb":93,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":90,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,9],"acting":[10,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"75'10","reported_seq":32,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T22:26:06.575641+0000","last_change":"2024-09-10T22:24:22.143321+0000","last_active":"2024-09-10T22:26:06.575641+0000","last_peered":"2024-09-10T22:26:06.575641+0000","last_clean":"2024-09-10T22:26:06.575641+0000","last_became_active":"2024-09-10T22:24:22.143036+0000","last_became_peered":"2024-09-10T22:24:22.143036+0000","last_unstale":"2024-09-10T22:26:06.575641+0000","last_undegraded":"2024-09-10T22:26:06.575641+0000","last_fullsized":"2024-09-10T22:26:06.575641+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_clean_scrub_stamp":"2024-09-10T22:24:21.113844+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:51:42.473300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"73'2","reported_seq":40,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T22:26:06.365710+0000","last_change":"2024-09-10T22:25:05.534611+0000","last_active":"2024-09-10T22:26:06.365710+0000","last_peered":"2024-09-10T22:26:06.365710+0000","last_clean":"2024-09-10T22:26:06.365710+0000","last_became_active":"2024-09-10T22:25:05.526934+0000","last_became_peered":"2024-09-10T22:25:05.526934+0000","last_unstale":"2024-09-10T22:26:06.365710+0000","last_undegraded":"2024-09-10T22:26:06.365710+0000","last_fullsized":"2024-09-10T22:26:06.365710+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:19.099039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:19.099039+0000","last_clean_scrub_stamp":"2024-09-10T22:24:19.099039+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:39:20.317571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"75'9","reported_seq":31,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T22:26:05.954780+0000","last_change":"2024-09-10T22:24:22.144830+0000","last_active":"2024-09-10T22:26:05.954780+0000","last_peered":"2024-09-10T22:26:05.954780+0000","last_clean":"2024-09-10T22:26:05.954780+0000","last_became_active":"2024-09-10T22:24:22.144358+0000","last_became_peered":"2024-09-10T22:24:22.144358+0000","last_unstale":"2024-09-10T22:26:05.954780+0000","last_undegraded":"2024-09-10T22:26:05.954780+0000","last_fullsized":"2024-09-10T22:26:05.954780+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_clean_scrub_stamp":"2024-09-10T22:24:21.113844+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:28:14.398474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"73'4","reported_seq":32,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T22:26:05.951595+0000","last_change":"2024-09-10T22:24:20.383555+0000","last_active":"2024-09-10T22:26:05.951595+0000","last_peered":"2024-09-10T22:26:05.951595+0000","last_clean":"2024-09-10T22:26:05.951595+0000","last_became_active":"2024-09-10T22:24:20.383163+0000","last_became_peered":"2024-09-10T22:24:20.383163+0000","last_unstale":"2024-09-10T22:26:05.951595+0000","last_undegraded":"2024-09-10T22:26:05.951595+0000","last_fullsized":"2024-09-10T22:26:05.951595+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:19.099039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:19.099039+0000","last_clean_scrub_stamp":"2024-09-10T22:24:19.099039+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:14:03.052220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"75'11","reported_seq":33,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T22:26:06.575515+0000","last_change":"2024-09-10T22:24:22.144562+0000","last_active":"2024-09-10T22:26:06.575515+0000","last_peered":"2024-09-10T22:26:06.575515+0000","last_clean":"2024-09-10T22:26:06.575515+0000","last_became_active":"2024-09-10T22:24:22.144146+0000","last_became_peered":"2024-09-10T22:24:22.144146+0000","last_unstale":"2024-09-10T22:26:06.575515+0000","last_undegraded":"2024-09-10T22:26:06.575515+0000","last_fullsized":"2024-09-10T22:26:06.575515+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_clean_scrub_stamp":"2024-09-10T22:24:21.113844+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:57:36.070289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"77'32","reported_seq":268,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T22:26:10.366807+0000","last_change":"2024-09-10T22:24:20.126245+0000","last_active":"2024-09-10T22:26:10.366807+0000","last_peered":"2024-09-10T22:26:10.366807+0000","last_clean":"2024-09-10T22:26:10.366807+0000","last_became_active":"2024-09-10T22:24:20.125839+0000","last_became_peered":"2024-09-10T22:24:20.125839+0000","last_unstale":"2024-09-10T22:26:10.366807+0000","last_undegraded":"2024-09-10T22:26:10.366807+0000","last_fullsized":"2024-09-10T22:26:10.366807+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:19.099039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:19.099039+0000","last_clean_scrub_stamp":"2024-09-10T22:24:19.099039+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:45:05.155436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":60319,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":209,"num_read_kb":163,"num_write":33,"num_write_kb":73,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"75'6","reported_seq":28,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T22:26:06.594223+0000","last_change":"2024-09-10T22:24:22.142178+0000","last_active":"2024-09-10T22:26:06.594223+0000","last_peered":"2024-09-10T22:26:06.594223+0000","last_clean":"2024-09-10T22:26:06.594223+0000","last_became_active":"2024-09-10T22:24:22.141883+0000","last_became_peered":"2024-09-10T22:24:22.141883+0000","last_unstale":"2024-09-10T22:26:06.594223+0000","last_undegraded":"2024-09-10T22:26:06.594223+0000","last_fullsized":"2024-09-10T22:26:06.594223+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_clean_scrub_stamp":"2024-09-10T22:24:21.113844+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:24:50.996273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"73'6","reported_seq":34,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T22:26:05.954056+0000","last_change":"2024-09-10T22:24:20.126129+0000","last_active":"2024-09-10T22:26:05.954056+0000","last_peered":"2024-09-10T22:26:05.954056+0000","last_clean":"2024-09-10T22:26:05.954056+0000","last_became_active":"2024-09-10T22:24:20.125749+0000","last_became_peered":"2024-09-10T22:24:20.125749+0000","last_unstale":"2024-09-10T22:26:05.954056+0000","last_undegraded":"2024-09-10T22:26:05.954056+0000","last_fullsized":"2024-09-10T22:26:05.954056+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:19.099039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:19.099039+0000","last_clean_scrub_stamp":"2024-09-10T22:24:19.099039+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:58:35.224036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"75'9","reported_seq":31,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T22:26:06.350986+0000","last_change":"2024-09-10T22:24:22.143964+0000","last_active":"2024-09-10T22:26:06.350986+0000","last_peered":"2024-09-10T22:26:06.350986+0000","last_clean":"2024-09-10T22:26:06.350986+0000","last_became_active":"2024-09-10T22:24:22.143589+0000","last_became_peered":"2024-09-10T22:24:22.143589+0000","last_unstale":"2024-09-10T22:26:06.350986+0000","last_undegraded":"2024-09-10T22:26:06.350986+0000","last_fullsized":"2024-09-10T22:26:06.350986+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_clean_scrub_stamp":"2024-09-10T22:24:21.113844+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:41:41.737627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"73'3","reported_seq":30,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T22:26:05.951305+0000","last_change":"2024-09-10T22:24:20.128012+0000","last_active":"2024-09-10T22:26:05.951305+0000","last_peered":"2024-09-10T22:26:05.951305+0000","last_clean":"2024-09-10T22:26:05.951305+0000","last_became_active":"2024-09-10T22:24:20.127335+0000","last_became_peered":"2024-09-10T22:24:20.127335+0000","last_unstale":"2024-09-10T22:26:05.951305+0000","last_undegraded":"2024-09-10T22:26:05.951305+0000","last_fullsized":"2024-09-10T22:26:05.951305+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:19.099039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:19.099039+0000","last_clean_scrub_stamp":"2024-09-10T22:24:19.099039+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:20:27.017032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"75'15","reported_seq":44,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T22:26:06.365478+0000","last_change":"2024-09-10T22:25:05.526382+0000","last_active":"2024-09-10T22:26:06.365478+0000","last_peered":"2024-09-10T22:26:06.365478+0000","last_clean":"2024-09-10T22:26:06.365478+0000","last_became_active":"2024-09-10T22:25:05.526037+0000","last_became_peered":"2024-09-10T22:25:05.526037+0000","last_unstale":"2024-09-10T22:26:06.365478+0000","last_undegraded":"2024-09-10T22:26:06.365478+0000","last_fullsized":"2024-09-10T22:26:06.365478+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_clean_scrub_stamp":"2024-09-10T22:24:21.113844+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:15:12.891318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,6],"acting":[7,9,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"75'5","reported_seq":134,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T22:26:08.390161+0000","last_change":"2024-09-10T22:24:20.124069+0000","last_active":"2024-09-10T22:26:08.390161+0000","last_peered":"2024-09-10T22:26:08.390161+0000","last_clean":"2024-09-10T22:26:08.390161+0000","last_became_active":"2024-09-10T22:24:20.123675+0000","last_became_peered":"2024-09-10T22:24:20.123675+0000","last_unstale":"2024-09-10T22:26:08.390161+0000","last_undegraded":"2024-09-10T22:26:08.390161+0000","last_fullsized":"2024-09-10T22:26:08.390161+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:19.099039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:19.099039+0000","last_clean_scrub_stamp":"2024-09-10T22:24:19.099039+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:32:50.287012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1120,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":103,"num_read_kb":5,"num_write":4,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"75'6","reported_seq":28,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T22:26:06.365122+0000","last_change":"2024-09-10T22:24:22.146870+0000","last_active":"2024-09-10T22:26:06.365122+0000","last_peered":"2024-09-10T22:26:06.365122+0000","last_clean":"2024-09-10T22:26:06.365122+0000","last_became_active":"2024-09-10T22:24:22.146615+0000","last_became_peered":"2024-09-10T22:24:22.146615+0000","last_unstale":"2024-09-10T22:26:06.365122+0000","last_undegraded":"2024-09-10T22:26:06.365122+0000","last_fullsized":"2024-09-10T22:26:06.365122+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_clean_scrub_stamp":"2024-09-10T22:24:21.113844+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:00:05.579248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"73'15","reported_seq":43,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T22:26:06.594490+0000","last_change":"2024-09-10T22:24:20.383675+0000","last_active":"2024-09-10T22:26:06.594490+0000","last_peered":"2024-09-10T22:26:06.594490+0000","last_clean":"2024-09-10T22:26:06.594490+0000","last_became_active":"2024-09-10T22:24:20.383317+0000","last_became_peered":"2024-09-10T22:24:20.383317+0000","last_unstale":"2024-09-10T22:26:06.594490+0000","last_undegraded":"2024-09-10T22:26:06.594490+0000","last_fullsized":"2024-09-10T22:26:06.594490+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:19.099039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:19.099039+0000","last_clean_scrub_stamp":"2024-09-10T22:24:19.099039+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:43:24.989851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"75'6","reported_seq":28,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T22:26:05.951214+0000","last_change":"2024-09-10T22:24:22.144872+0000","last_active":"2024-09-10T22:26:05.951214+0000","last_peered":"2024-09-10T22:26:05.951214+0000","last_clean":"2024-09-10T22:26:05.951214+0000","last_became_active":"2024-09-10T22:24:22.144570+0000","last_became_peered":"2024-09-10T22:24:22.144570+0000","last_unstale":"2024-09-10T22:26:05.951214+0000","last_undegraded":"2024-09-10T22:26:05.951214+0000","last_fullsized":"2024-09-10T22:26:05.951214+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_clean_scrub_stamp":"2024-09-10T22:24:21.113844+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:20:17.937544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"73'2","reported_seq":30,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T22:26:06.595004+0000","last_change":"2024-09-10T22:24:20.125849+0000","last_active":"2024-09-10T22:26:06.595004+0000","last_peered":"2024-09-10T22:26:06.595004+0000","last_clean":"2024-09-10T22:26:06.595004+0000","last_became_active":"2024-09-10T22:24:20.125042+0000","last_became_peered":"2024-09-10T22:24:20.125042+0000","last_unstale":"2024-09-10T22:26:06.595004+0000","last_undegraded":"2024-09-10T22:26:06.595004+0000","last_fullsized":"2024-09-10T22:26:06.595004+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:19.099039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:19.099039+0000","last_clean_scrub_stamp":"2024-09-10T22:24:19.099039+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:36:28.249115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"75'5","reported_seq":27,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T22:26:05.953217+0000","last_change":"2024-09-10T22:24:22.141232+0000","last_active":"2024-09-10T22:26:05.953217+0000","last_peered":"2024-09-10T22:26:05.953217+0000","last_clean":"2024-09-10T22:26:05.953217+0000","last_became_active":"2024-09-10T22:24:22.140903+0000","last_became_peered":"2024-09-10T22:24:22.140903+0000","last_unstale":"2024-09-10T22:26:05.953217+0000","last_undegraded":"2024-09-10T22:26:05.953217+0000","last_fullsized":"2024-09-10T22:26:05.953217+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_clean_scrub_stamp":"2024-09-10T22:24:21.113844+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:15:11.627126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"73'2","reported_seq":29,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T22:26:06.351674+0000","last_change":"2024-09-10T22:24:20.122829+0000","last_active":"2024-09-10T22:26:06.351674+0000","last_peered":"2024-09-10T22:26:06.351674+0000","last_clean":"2024-09-10T22:26:06.351674+0000","last_became_active":"2024-09-10T22:24:20.122545+0000","last_became_peered":"2024-09-10T22:24:20.122545+0000","last_unstale":"2024-09-10T22:26:06.351674+0000","last_undegraded":"2024-09-10T22:26:06.351674+0000","last_fullsized":"2024-09-10T22:26:06.351674+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:19.099039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:19.099039+0000","last_clean_scrub_stamp":"2024-09-10T22:24:19.099039+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:18:27.758029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"75'9","reported_seq":31,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T22:26:06.365191+0000","last_change":"2024-09-10T22:24:22.139725+0000","last_active":"2024-09-10T22:26:06.365191+0000","last_peered":"2024-09-10T22:26:06.365191+0000","last_clean":"2024-09-10T22:26:06.365191+0000","last_became_active":"2024-09-10T22:24:22.139293+0000","last_became_peered":"2024-09-10T22:24:22.139293+0000","last_unstale":"2024-09-10T22:26:06.365191+0000","last_undegraded":"2024-09-10T22:26:06.365191+0000","last_fullsized":"2024-09-10T22:26:06.365191+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_clean_scrub_stamp":"2024-09-10T22:24:21.113844+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:43:14.424880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"73'1","reported_seq":16,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T22:26:05.963961+0000","last_change":"2024-09-10T22:26:05.963539+0000","last_active":"2024-09-10T22:26:05.963961+0000","last_peered":"2024-09-10T22:26:05.963961+0000","last_clean":"2024-09-10T22:26:05.963961+0000","last_became_active":"2024-09-10T22:26:05.959671+0000","last_became_peered":"2024-09-10T22:26:05.959671+0000","last_unstale":"2024-09-10T22:26:05.963961+0000","last_undegraded":"2024-09-10T22:26:05.963961+0000","last_fullsized":"2024-09-10T22:26:05.963961+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:19.099039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:19.099039+0000","last_clean_scrub_stamp":"2024-09-10T22:24:19.099039+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:32:07.837404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":70,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,10,3],"acting":[11,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.c","version":"75'7","reported_seq":29,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T22:26:06.365143+0000","last_change":"2024-09-10T22:24:22.149522+0000","last_active":"2024-09-10T22:26:06.365143+0000","last_peered":"2024-09-10T22:26:06.365143+0000","last_clean":"2024-09-10T22:26:06.365143+0000","last_became_active":"2024-09-10T22:24:22.148710+0000","last_became_peered":"2024-09-10T22:24:22.148710+0000","last_unstale":"2024-09-10T22:26:06.365143+0000","last_undegraded":"2024-09-10T22:26:06.365143+0000","last_fullsized":"2024-09-10T22:26:06.365143+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_clean_scrub_stamp":"2024-09-10T22:24:21.113844+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:44:32.020949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"73'3","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T22:26:05.961597+0000","last_change":"2024-09-10T22:26:05.961171+0000","last_active":"2024-09-10T22:26:05.961597+0000","last_peered":"2024-09-10T22:26:05.961597+0000","last_clean":"2024-09-10T22:26:05.961597+0000","last_became_active":"2024-09-10T22:26:05.956892+0000","last_became_peered":"2024-09-10T22:26:05.956892+0000","last_unstale":"2024-09-10T22:26:05.961597+0000","last_undegraded":"2024-09-10T22:26:05.961597+0000","last_fullsized":"2024-09-10T22:26:05.961597+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:19.099039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:19.099039+0000","last_clean_scrub_stamp":"2024-09-10T22:24:19.099039+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:04:37.103581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":582,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,0],"acting":[4,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.d","version":"75'7","reported_seq":29,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T22:26:06.365151+0000","last_change":"2024-09-10T22:24:22.142335+0000","last_active":"2024-09-10T22:26:06.365151+0000","last_peered":"2024-09-10T22:26:06.365151+0000","last_clean":"2024-09-10T22:26:06.365151+0000","last_became_active":"2024-09-10T22:24:22.142001+0000","last_became_peered":"2024-09-10T22:24:22.142001+0000","last_unstale":"2024-09-10T22:26:06.365151+0000","last_undegraded":"2024-09-10T22:26:06.365151+0000","last_fullsized":"2024-09-10T22:26:06.365151+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_clean_scrub_stamp":"2024-09-10T22:24:21.113844+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:46:20.043915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"19'92","reported_seq":100,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T22:26:06.365521+0000","last_change":"2024-09-10T22:23:11.163678+0000","last_active":"2024-09-10T22:26:06.365521+0000","last_peered":"2024-09-10T22:26:06.365521+0000","last_clean":"2024-09-10T22:26:06.365521+0000","last_became_active":"2024-09-10T22:23:11.158387+0000","last_became_peered":"2024-09-10T22:23:11.158387+0000","last_unstale":"2024-09-10T22:26:06.365521+0000","last_undegraded":"2024-09-10T22:26:06.365521+0000","last_fullsized":"2024-09-10T22:26:06.365521+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:19:50.906986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:19:50.906986+0000","last_clean_scrub_stamp":"2024-09-10T22:19:50.906986+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:11:31.570355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"73'3","reported_seq":32,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T22:26:05.950986+0000","last_change":"2024-09-10T22:24:20.123048+0000","last_active":"2024-09-10T22:26:05.950986+0000","last_peered":"2024-09-10T22:26:05.950986+0000","last_clean":"2024-09-10T22:26:05.950986+0000","last_became_active":"2024-09-10T22:24:20.121906+0000","last_became_peered":"2024-09-10T22:24:20.121906+0000","last_unstale":"2024-09-10T22:26:05.950986+0000","last_undegraded":"2024-09-10T22:26:05.950986+0000","last_fullsized":"2024-09-10T22:26:05.950986+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:19.099039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:19.099039+0000","last_clean_scrub_stamp":"2024-09-10T22:24:19.099039+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:11:00.293820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"75'8","reported_seq":30,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T22:26:05.957409+0000","last_change":"2024-09-10T22:24:22.146378+0000","last_active":"2024-09-10T22:26:05.957409+0000","last_peered":"2024-09-10T22:26:05.957409+0000","last_clean":"2024-09-10T22:26:05.957409+0000","last_became_active":"2024-09-10T22:24:22.145841+0000","last_became_peered":"2024-09-10T22:24:22.145841+0000","last_unstale":"2024-09-10T22:26:05.957409+0000","last_undegraded":"2024-09-10T22:26:05.957409+0000","last_fullsized":"2024-09-10T22:26:05.957409+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_clean_scrub_stamp":"2024-09-10T22:24:21.113844+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:20:31.785243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"73'3","reported_seq":41,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T22:26:06.365469+0000","last_change":"2024-09-10T22:25:05.640672+0000","last_active":"2024-09-10T22:26:06.365469+0000","last_peered":"2024-09-10T22:26:06.365469+0000","last_clean":"2024-09-10T22:26:06.365469+0000","last_became_active":"2024-09-10T22:25:05.637774+0000","last_became_peered":"2024-09-10T22:25:05.637774+0000","last_unstale":"2024-09-10T22:26:06.365469+0000","last_undegraded":"2024-09-10T22:26:06.365469+0000","last_fullsized":"2024-09-10T22:26:06.365469+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:19.099039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:19.099039+0000","last_clean_scrub_stamp":"2024-09-10T22:24:19.099039+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:33:20.970862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,4],"acting":[7,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"75'5","reported_seq":27,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T22:26:06.350989+0000","last_change":"2024-09-10T22:24:22.139850+0000","last_active":"2024-09-10T22:26:06.350989+0000","last_peered":"2024-09-10T22:26:06.350989+0000","last_clean":"2024-09-10T22:26:06.350989+0000","last_became_active":"2024-09-10T22:24:22.137885+0000","last_became_peered":"2024-09-10T22:24:22.137885+0000","last_unstale":"2024-09-10T22:26:06.350989+0000","last_undegraded":"2024-09-10T22:26:06.350989+0000","last_fullsized":"2024-09-10T22:26:06.350989+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_clean_scrub_stamp":"2024-09-10T22:24:21.113844+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:52:55.988247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"75'5","reported_seq":130,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T22:26:08.389562+0000","last_change":"2024-09-10T22:24:20.383650+0000","last_active":"2024-09-10T22:26:08.389562+0000","last_peered":"2024-09-10T22:26:08.389562+0000","last_clean":"2024-09-10T22:26:08.389562+0000","last_became_active":"2024-09-10T22:24:20.383286+0000","last_became_peered":"2024-09-10T22:24:20.383286+0000","last_unstale":"2024-09-10T22:26:08.389562+0000","last_undegraded":"2024-09-10T22:26:08.389562+0000","last_fullsized":"2024-09-10T22:26:08.389562+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:19.099039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:19.099039+0000","last_clean_scrub_stamp":"2024-09-10T22:24:19.099039+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:38:04.467105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":98,"num_read_kb":98,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"75'8","reported_seq":30,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T22:26:05.951282+0000","last_change":"2024-09-10T22:24:22.141717+0000","last_active":"2024-09-10T22:26:05.951282+0000","last_peered":"2024-09-10T22:26:05.951282+0000","last_clean":"2024-09-10T22:26:05.951282+0000","last_became_active":"2024-09-10T22:24:22.141426+0000","last_became_peered":"2024-09-10T22:24:22.141426+0000","last_unstale":"2024-09-10T22:26:05.951282+0000","last_undegraded":"2024-09-10T22:26:05.951282+0000","last_fullsized":"2024-09-10T22:26:05.951282+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_clean_scrub_stamp":"2024-09-10T22:24:21.113844+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:13:58.341345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"73'1","reported_seq":28,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T22:26:06.365602+0000","last_change":"2024-09-10T22:24:20.127658+0000","last_active":"2024-09-10T22:26:06.365602+0000","last_peered":"2024-09-10T22:26:06.365602+0000","last_clean":"2024-09-10T22:26:06.365602+0000","last_became_active":"2024-09-10T22:24:20.127366+0000","last_became_peered":"2024-09-10T22:24:20.127366+0000","last_unstale":"2024-09-10T22:26:06.365602+0000","last_undegraded":"2024-09-10T22:26:06.365602+0000","last_fullsized":"2024-09-10T22:26:06.365602+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:19.099039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:19.099039+0000","last_clean_scrub_stamp":"2024-09-10T22:24:19.099039+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:36:05.439417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"75'7","reported_seq":29,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T22:26:05.955653+0000","last_change":"2024-09-10T22:24:22.144799+0000","last_active":"2024-09-10T22:26:05.955653+0000","last_peered":"2024-09-10T22:26:05.955653+0000","last_clean":"2024-09-10T22:26:05.955653+0000","last_became_active":"2024-09-10T22:24:22.144543+0000","last_became_peered":"2024-09-10T22:24:22.144543+0000","last_unstale":"2024-09-10T22:26:05.955653+0000","last_undegraded":"2024-09-10T22:26:05.955653+0000","last_fullsized":"2024-09-10T22:26:05.955653+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_clean_scrub_stamp":"2024-09-10T22:24:21.113844+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:45:46.193108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":27,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T22:26:05.952481+0000","last_change":"2024-09-10T22:24:20.383345+0000","last_active":"2024-09-10T22:26:05.952481+0000","last_peered":"2024-09-10T22:26:05.952481+0000","last_clean":"2024-09-10T22:26:05.952481+0000","last_became_active":"2024-09-10T22:24:20.383023+0000","last_became_peered":"2024-09-10T22:24:20.383023+0000","last_unstale":"2024-09-10T22:26:05.952481+0000","last_undegraded":"2024-09-10T22:26:05.952481+0000","last_fullsized":"2024-09-10T22:26:05.952481+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:19.099039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:19.099039+0000","last_clean_scrub_stamp":"2024-09-10T22:24:19.099039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:27:31.771060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"75'5","reported_seq":27,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T22:26:05.955762+0000","last_change":"2024-09-10T22:24:22.143130+0000","last_active":"2024-09-10T22:26:05.955762+0000","last_peered":"2024-09-10T22:26:05.955762+0000","last_clean":"2024-09-10T22:26:05.955762+0000","last_became_active":"2024-09-10T22:24:22.142664+0000","last_became_peered":"2024-09-10T22:24:22.142664+0000","last_unstale":"2024-09-10T22:26:05.955762+0000","last_undegraded":"2024-09-10T22:26:05.955762+0000","last_fullsized":"2024-09-10T22:26:05.955762+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_clean_scrub_stamp":"2024-09-10T22:24:21.113844+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:49:53.325307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"73'1","reported_seq":29,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T22:26:06.594852+0000","last_change":"2024-09-10T22:24:20.383795+0000","last_active":"2024-09-10T22:26:06.594852+0000","last_peered":"2024-09-10T22:26:06.594852+0000","last_clean":"2024-09-10T22:26:06.594852+0000","last_became_active":"2024-09-10T22:24:20.383418+0000","last_became_peered":"2024-09-10T22:24:20.383418+0000","last_unstale":"2024-09-10T22:26:06.594852+0000","last_undegraded":"2024-09-10T22:26:06.594852+0000","last_fullsized":"2024-09-10T22:26:06.594852+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:19.099039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:19.099039+0000","last_clean_scrub_stamp":"2024-09-10T22:24:19.099039+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:52:26.602544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"75'9","reported_seq":31,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T22:26:06.351153+0000","last_change":"2024-09-10T22:24:22.139416+0000","last_active":"2024-09-10T22:26:06.351153+0000","last_peered":"2024-09-10T22:26:06.351153+0000","last_clean":"2024-09-10T22:26:06.351153+0000","last_became_active":"2024-09-10T22:24:22.138648+0000","last_became_peered":"2024-09-10T22:24:22.138648+0000","last_unstale":"2024-09-10T22:26:06.351153+0000","last_undegraded":"2024-09-10T22:26:06.351153+0000","last_fullsized":"2024-09-10T22:26:06.351153+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_clean_scrub_stamp":"2024-09-10T22:24:21.113844+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:12:20.064134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"77'12","reported_seq":39,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T22:26:05.952761+0000","last_change":"2024-09-10T22:24:20.124001+0000","last_active":"2024-09-10T22:26:05.952761+0000","last_peered":"2024-09-10T22:26:05.952761+0000","last_clean":"2024-09-10T22:26:05.952761+0000","last_became_active":"2024-09-10T22:24:20.123616+0000","last_became_peered":"2024-09-10T22:24:20.123616+0000","last_unstale":"2024-09-10T22:26:05.952761+0000","last_undegraded":"2024-09-10T22:26:05.952761+0000","last_fullsized":"2024-09-10T22:26:05.952761+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:19.099039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:19.099039+0000","last_clean_scrub_stamp":"2024-09-10T22:24:19.099039+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:12:47.003561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"75'5","reported_seq":27,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T22:26:05.957528+0000","last_change":"2024-09-10T22:24:22.146936+0000","last_active":"2024-09-10T22:26:05.957528+0000","last_peered":"2024-09-10T22:26:05.957528+0000","last_clean":"2024-09-10T22:26:05.957528+0000","last_became_active":"2024-09-10T22:24:22.146578+0000","last_became_peered":"2024-09-10T22:24:22.146578+0000","last_unstale":"2024-09-10T22:26:05.957528+0000","last_undegraded":"2024-09-10T22:26:05.957528+0000","last_fullsized":"2024-09-10T22:26:05.957528+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_clean_scrub_stamp":"2024-09-10T22:24:21.113844+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:44:20.229747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"73'4","reported_seq":31,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T22:26:05.951333+0000","last_change":"2024-09-10T22:24:20.406642+0000","last_active":"2024-09-10T22:26:05.951333+0000","last_peered":"2024-09-10T22:26:05.951333+0000","last_clean":"2024-09-10T22:26:05.951333+0000","last_became_active":"2024-09-10T22:24:20.406288+0000","last_became_peered":"2024-09-10T22:24:20.406288+0000","last_unstale":"2024-09-10T22:26:05.951333+0000","last_undegraded":"2024-09-10T22:26:05.951333+0000","last_fullsized":"2024-09-10T22:26:05.951333+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:19.099039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:19.099039+0000","last_clean_scrub_stamp":"2024-09-10T22:24:19.099039+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:10:48.558751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"75'7","reported_seq":29,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T22:26:05.954742+0000","last_change":"2024-09-10T22:24:22.142511+0000","last_active":"2024-09-10T22:26:05.954742+0000","last_peered":"2024-09-10T22:26:05.954742+0000","last_clean":"2024-09-10T22:26:05.954742+0000","last_became_active":"2024-09-10T22:24:22.142200+0000","last_became_peered":"2024-09-10T22:24:22.142200+0000","last_unstale":"2024-09-10T22:26:05.954742+0000","last_undegraded":"2024-09-10T22:26:05.954742+0000","last_fullsized":"2024-09-10T22:26:05.954742+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_clean_scrub_stamp":"2024-09-10T22:24:21.113844+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:09:46.928679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"73'2","reported_seq":29,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T22:26:06.575841+0000","last_change":"2024-09-10T22:24:20.383403+0000","last_active":"2024-09-10T22:26:06.575841+0000","last_peered":"2024-09-10T22:26:06.575841+0000","last_clean":"2024-09-10T22:26:06.575841+0000","last_became_active":"2024-09-10T22:24:20.383143+0000","last_became_peered":"2024-09-10T22:24:20.383143+0000","last_unstale":"2024-09-10T22:26:06.575841+0000","last_undegraded":"2024-09-10T22:26:06.575841+0000","last_fullsized":"2024-09-10T22:26:06.575841+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:19.099039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:19.099039+0000","last_clean_scrub_stamp":"2024-09-10T22:24:19.099039+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:54:07.338628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"75'2","reported_seq":24,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T22:26:06.594153+0000","last_change":"2024-09-10T22:24:22.136604+0000","last_active":"2024-09-10T22:26:06.594153+0000","last_peered":"2024-09-10T22:26:06.594153+0000","last_clean":"2024-09-10T22:26:06.594153+0000","last_became_active":"2024-09-10T22:24:22.136298+0000","last_became_peered":"2024-09-10T22:24:22.136298+0000","last_unstale":"2024-09-10T22:26:06.594153+0000","last_undegraded":"2024-09-10T22:26:06.594153+0000","last_fullsized":"2024-09-10T22:26:06.594153+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_clean_scrub_stamp":"2024-09-10T22:24:21.113844+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:39:11.777729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"73'3","reported_seq":30,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T22:26:05.957274+0000","last_change":"2024-09-10T22:24:20.124911+0000","last_active":"2024-09-10T22:26:05.957274+0000","last_peered":"2024-09-10T22:26:05.957274+0000","last_clean":"2024-09-10T22:26:05.957274+0000","last_became_active":"2024-09-10T22:24:20.124152+0000","last_became_peered":"2024-09-10T22:24:20.124152+0000","last_unstale":"2024-09-10T22:26:05.957274+0000","last_undegraded":"2024-09-10T22:26:05.957274+0000","last_fullsized":"2024-09-10T22:26:05.957274+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:19.099039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:19.099039+0000","last_clean_scrub_stamp":"2024-09-10T22:24:19.099039+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:32:30.837104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"75'9","reported_seq":31,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T22:26:05.953318+0000","last_change":"2024-09-10T22:24:22.138080+0000","last_active":"2024-09-10T22:26:05.953318+0000","last_peered":"2024-09-10T22:26:05.953318+0000","last_clean":"2024-09-10T22:26:05.953318+0000","last_became_active":"2024-09-10T22:24:22.137775+0000","last_became_peered":"2024-09-10T22:24:22.137775+0000","last_unstale":"2024-09-10T22:26:05.953318+0000","last_undegraded":"2024-09-10T22:26:05.953318+0000","last_fullsized":"2024-09-10T22:26:05.953318+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_clean_scrub_stamp":"2024-09-10T22:24:21.113844+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:10:48.320495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"73'1","reported_seq":28,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T22:26:05.953923+0000","last_change":"2024-09-10T22:24:20.125551+0000","last_active":"2024-09-10T22:26:05.953923+0000","last_peered":"2024-09-10T22:26:05.953923+0000","last_clean":"2024-09-10T22:26:05.953923+0000","last_became_active":"2024-09-10T22:24:20.125064+0000","last_became_peered":"2024-09-10T22:24:20.125064+0000","last_unstale":"2024-09-10T22:26:05.953923+0000","last_undegraded":"2024-09-10T22:26:05.953923+0000","last_fullsized":"2024-09-10T22:26:05.953923+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:19.099039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:19.099039+0000","last_clean_scrub_stamp":"2024-09-10T22:24:19.099039+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:29:48.598158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"75'8","reported_seq":30,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T22:26:05.957263+0000","last_change":"2024-09-10T22:24:22.142894+0000","last_active":"2024-09-10T22:26:05.957263+0000","last_peered":"2024-09-10T22:26:05.957263+0000","last_clean":"2024-09-10T22:26:05.957263+0000","last_became_active":"2024-09-10T22:24:22.142554+0000","last_became_peered":"2024-09-10T22:24:22.142554+0000","last_unstale":"2024-09-10T22:26:05.957263+0000","last_undegraded":"2024-09-10T22:26:05.957263+0000","last_fullsized":"2024-09-10T22:26:05.957263+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_clean_scrub_stamp":"2024-09-10T22:24:21.113844+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:11:11.457622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"73'4","reported_seq":32,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T22:26:06.594771+0000","last_change":"2024-09-10T22:24:20.128212+0000","last_active":"2024-09-10T22:26:06.594771+0000","last_peered":"2024-09-10T22:26:06.594771+0000","last_clean":"2024-09-10T22:26:06.594771+0000","last_became_active":"2024-09-10T22:24:20.127597+0000","last_became_peered":"2024-09-10T22:24:20.127597+0000","last_unstale":"2024-09-10T22:26:06.594771+0000","last_undegraded":"2024-09-10T22:26:06.594771+0000","last_fullsized":"2024-09-10T22:26:06.594771+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:19.099039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:19.099039+0000","last_clean_scrub_stamp":"2024-09-10T22:24:19.099039+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:48:28.543222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"75'5","reported_seq":27,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T22:26:06.365441+0000","last_change":"2024-09-10T22:24:22.144321+0000","last_active":"2024-09-10T22:26:06.365441+0000","last_peered":"2024-09-10T22:26:06.365441+0000","last_clean":"2024-09-10T22:26:06.365441+0000","last_became_active":"2024-09-10T22:24:22.144037+0000","last_became_peered":"2024-09-10T22:24:22.144037+0000","last_unstale":"2024-09-10T22:26:06.365441+0000","last_undegraded":"2024-09-10T22:26:06.365441+0000","last_fullsized":"2024-09-10T22:26:06.365441+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_clean_scrub_stamp":"2024-09-10T22:24:21.113844+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:28:00.600758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"75'15","reported_seq":37,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T22:26:05.951547+0000","last_change":"2024-09-10T22:24:22.145574+0000","last_active":"2024-09-10T22:26:05.951547+0000","last_peered":"2024-09-10T22:26:05.951547+0000","last_clean":"2024-09-10T22:26:05.951547+0000","last_became_active":"2024-09-10T22:24:22.144425+0000","last_became_peered":"2024-09-10T22:24:22.144425+0000","last_unstale":"2024-09-10T22:26:05.951547+0000","last_undegraded":"2024-09-10T22:26:05.951547+0000","last_fullsized":"2024-09-10T22:26:05.951547+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_clean_scrub_stamp":"2024-09-10T22:24:21.113844+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:41:10.177782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"73'2","reported_seq":29,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T22:26:06.594742+0000","last_change":"2024-09-10T22:24:20.124627+0000","last_active":"2024-09-10T22:26:06.594742+0000","last_peered":"2024-09-10T22:26:06.594742+0000","last_clean":"2024-09-10T22:26:06.594742+0000","last_became_active":"2024-09-10T22:24:20.124174+0000","last_became_peered":"2024-09-10T22:24:20.124174+0000","last_unstale":"2024-09-10T22:26:06.594742+0000","last_undegraded":"2024-09-10T22:26:06.594742+0000","last_fullsized":"2024-09-10T22:26:06.594742+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:19.099039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:19.099039+0000","last_clean_scrub_stamp":"2024-09-10T22:24:19.099039+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:35:26.871316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"75'9","reported_seq":31,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T22:26:06.575513+0000","last_change":"2024-09-10T22:24:22.142531+0000","last_active":"2024-09-10T22:26:06.575513+0000","last_peered":"2024-09-10T22:26:06.575513+0000","last_clean":"2024-09-10T22:26:06.575513+0000","last_became_active":"2024-09-10T22:24:22.142240+0000","last_became_peered":"2024-09-10T22:24:22.142240+0000","last_unstale":"2024-09-10T22:26:06.575513+0000","last_undegraded":"2024-09-10T22:26:06.575513+0000","last_fullsized":"2024-09-10T22:26:06.575513+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_clean_scrub_stamp":"2024-09-10T22:24:21.113844+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:30:56.868586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"73'4","reported_seq":44,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T22:26:06.594840+0000","last_change":"2024-09-10T22:25:05.644160+0000","last_active":"2024-09-10T22:26:06.594840+0000","last_peered":"2024-09-10T22:26:06.594840+0000","last_clean":"2024-09-10T22:26:06.594840+0000","last_became_active":"2024-09-10T22:25:05.638026+0000","last_became_peered":"2024-09-10T22:25:05.638026+0000","last_unstale":"2024-09-10T22:26:06.594840+0000","last_undegraded":"2024-09-10T22:26:06.594840+0000","last_fullsized":"2024-09-10T22:26:06.594840+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:19.099039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:19.099039+0000","last_clean_scrub_stamp":"2024-09-10T22:24:19.099039+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:58:18.112018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":10,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,4,7],"acting":[8,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"75'6","reported_seq":28,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T22:26:05.954730+0000","last_change":"2024-09-10T22:24:22.141121+0000","last_active":"2024-09-10T22:26:05.954730+0000","last_peered":"2024-09-10T22:26:05.954730+0000","last_clean":"2024-09-10T22:26:05.954730+0000","last_became_active":"2024-09-10T22:24:22.140490+0000","last_became_peered":"2024-09-10T22:24:22.140490+0000","last_unstale":"2024-09-10T22:26:05.954730+0000","last_undegraded":"2024-09-10T22:26:05.954730+0000","last_fullsized":"2024-09-10T22:26:05.954730+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_clean_scrub_stamp":"2024-09-10T22:24:21.113844+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:52:22.840740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"73'2","reported_seq":29,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T22:26:05.957592+0000","last_change":"2024-09-10T22:24:20.385053+0000","last_active":"2024-09-10T22:26:05.957592+0000","last_peered":"2024-09-10T22:26:05.957592+0000","last_clean":"2024-09-10T22:26:05.957592+0000","last_became_active":"2024-09-10T22:24:20.384432+0000","last_became_peered":"2024-09-10T22:24:20.384432+0000","last_unstale":"2024-09-10T22:26:05.957592+0000","last_undegraded":"2024-09-10T22:26:05.957592+0000","last_fullsized":"2024-09-10T22:26:05.957592+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:19.099039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:19.099039+0000","last_clean_scrub_stamp":"2024-09-10T22:24:19.099039+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:18:15.685331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"75'5","reported_seq":27,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T22:26:05.957488+0000","last_change":"2024-09-10T22:24:22.143884+0000","last_active":"2024-09-10T22:26:05.957488+0000","last_peered":"2024-09-10T22:26:05.957488+0000","last_clean":"2024-09-10T22:26:05.957488+0000","last_became_active":"2024-09-10T22:24:22.143446+0000","last_became_peered":"2024-09-10T22:24:22.143446+0000","last_unstale":"2024-09-10T22:26:05.957488+0000","last_undegraded":"2024-09-10T22:26:05.957488+0000","last_fullsized":"2024-09-10T22:26:05.957488+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_clean_scrub_stamp":"2024-09-10T22:24:21.113844+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:28:32.453668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"73'9","reported_seq":54,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T22:26:05.952794+0000","last_change":"2024-09-10T22:25:05.528200+0000","last_active":"2024-09-10T22:26:05.952794+0000","last_peered":"2024-09-10T22:26:05.952794+0000","last_clean":"2024-09-10T22:26:05.952794+0000","last_became_active":"2024-09-10T22:25:05.520346+0000","last_became_peered":"2024-09-10T22:25:05.520346+0000","last_unstale":"2024-09-10T22:26:05.952794+0000","last_undegraded":"2024-09-10T22:26:05.952794+0000","last_fullsized":"2024-09-10T22:26:05.952794+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:19.099039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:19.099039+0000","last_clean_scrub_stamp":"2024-09-10T22:24:19.099039+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:38:21.050372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":582,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,11,8],"acting":[9,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":502,"ondisk_log_size":502,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":64769,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":615,"num_read_kb":373,"num_write":173,"num_write_kb":118,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":14,"num_bytes_recovered":1324,"num_keys_recovered":10,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":417792,"data_stored":194307,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":147,"ondisk_log_size":147,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4751360,"data_stored":4722944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":92,"ondisk_log_size":92,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":67,"seq":287762808867,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27872,"kb_used_data":840,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717280,"statfs":{"total":95995035648,"available":95966494720,"internally_reserved":0,"allocated":860160,"data_stored":414872,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":10,"up_from":62,"seq":266287972392,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36860,"kb_used_data":1512,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708292,"statfs":{"total":95995035648,"available":95957291008,"internally_reserved":0,"allocated":1548288,"data_stored":1066552,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":36174272},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":57,"seq":244813135916,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27876,"kb_used_data":848,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717276,"statfs":{"total":95995035648,"available":95966490624,"internally_reserved":0,"allocated":868352,"data_stored":414456,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,5,6,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":51,"seq":219043332145,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27880,"kb_used_data":848,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717272,"statfs":{"total":95995035648,"available":95966486528,"internally_reserved":0,"allocated":868352,"data_stored":414376,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":7,"up_from":46,"seq":197568495671,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36772,"kb_used_data":1424,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708380,"statfs":{"total":95995035648,"available":95957381120,"internally_reserved":0,"allocated":1458176,"data_stored":1006173,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":36174282},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":40,"seq":171798691900,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27864,"kb_used_data":836,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717288,"statfs":{"total":95995035648,"available":95966502912,"internally_reserved":0,"allocated":856064,"data_stored":413845,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":34,"seq":146028888128,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28460,"kb_used_data":1432,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716692,"statfs":{"total":95995035648,"available":95965892608,"internally_reserved":0,"allocated":1466368,"data_stored":1005747,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":29,"seq":124554051653,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27876,"kb_used_data":844,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717276,"statfs":{"total":95995035648,"available":95966490624,"internally_reserved":0,"allocated":864256,"data_stored":415396,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":23,"seq":98784247882,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27884,"kb_used_data":852,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717268,"statfs":{"total":95995035648,"available":95966482432,"internally_reserved":0,"allocated":872448,"data_stored":414156,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444113,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36260,"kb_used_data":916,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708892,"statfs":{"total":95995035648,"available":95957905408,"internally_reserved":0,"allocated":937984,"data_stored":475033,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":12,"seq":51539607637,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36244,"kb_used_data":900,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708908,"statfs":{"total":95995035648,"available":95957921792,"internally_reserved":0,"allocated":921600,"data_stored":474047,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738459,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36208,"kb_used_data":856,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708944,"statfs":{"total":95995035648,"available":95957958656,"internally_reserved":0,"allocated":876544,"data_stored":415116,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":60409,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":61395,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1758,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1624,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":2050,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":62429,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-10T22:26:12.736 INFO:tasks.fwd_scrub.ceph_manager:clean! 2024-09-10T22:26:12.737 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-10T22:26:12.878 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:12.874+0000 7f89af7e2640 1 -- 172.21.15.19:0/182246861 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f89a81033c0 msgr2=0x7f89a8109d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:26:12.878 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:12.874+0000 7f89af7e2640 1 --2- 172.21.15.19:0/182246861 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f89a81033c0 0x7f89a8109d40 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f89a0009cd0 tx=0x7f89a002a8e0 comp rx=0 tx=0).stop 2024-09-10T22:26:12.878 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:12.874+0000 7f89af7e2640 1 -- 172.21.15.19:0/182246861 shutdown_connections 2024-09-10T22:26:12.878 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:12.874+0000 7f89af7e2640 1 --2- 172.21.15.19:0/182246861 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f89a81033c0 0x7f89a8109d40 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:26:12.878 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:12.874+0000 7f89af7e2640 1 --2- 172.21.15.19:0/182246861 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f89a8102a00 0x7f89a8102e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:26:12.879 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:12.874+0000 7f89af7e2640 1 --2- 172.21.15.19:0/182246861 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f89a81018b0 0x7f89a8101cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:26:12.879 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:12.874+0000 7f89af7e2640 1 -- 172.21.15.19:0/182246861 >> 172.21.15.19:0/182246861 conn(0x7f89a80fd190 msgr2=0x7f89a80ff5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:26:12.879 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:12.874+0000 7f89af7e2640 1 -- 172.21.15.19:0/182246861 shutdown_connections 2024-09-10T22:26:12.879 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:12.874+0000 7f89af7e2640 1 -- 172.21.15.19:0/182246861 wait complete. 2024-09-10T22:26:12.879 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:12.875+0000 7f89af7e2640 1 Processor -- start 2024-09-10T22:26:12.879 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:12.875+0000 7f89af7e2640 1 -- start start 2024-09-10T22:26:12.879 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:12.875+0000 7f89af7e2640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f89a81018b0 0x7f89a8198d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:26:12.879 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:12.875+0000 7f89af7e2640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f89a8102a00 0x7f89a8199360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:26:12.879 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:12.875+0000 7f89af7e2640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f89a81033c0 0x7f89a8199f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:26:12.879 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:12.875+0000 7f89af7e2640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f89a810d520 con 0x7f89a81018b0 2024-09-10T22:26:12.879 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:12.875+0000 7f89af7e2640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f89a810d3a0 con 0x7f89a8102a00 2024-09-10T22:26:12.879 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:12.875+0000 7f89af7e2640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f89a810d6a0 con 0x7f89a81033c0 2024-09-10T22:26:12.879 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:12.875+0000 7f89ad57e640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f89a81018b0 0x7f89a8198d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:26:12.880 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:12.875+0000 7f89ad57e640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f89a81018b0 0x7f89a8198d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:53612/0 (socket says 172.21.15.19:53612) 2024-09-10T22:26:12.880 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:12.875+0000 7f89ad57e640 1 -- 172.21.15.19:0/1317970408 learned_addr learned my addr 172.21.15.19:0/1317970408 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:26:12.880 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:12.875+0000 7f89acd7d640 1 --2- 172.21.15.19:0/1317970408 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f89a8102a00 0x7f89a8199360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:26:12.880 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:12.875+0000 7f89add7f640 1 --2- 172.21.15.19:0/1317970408 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f89a81033c0 0x7f89a8199f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:26:12.880 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:12.875+0000 7f89ad57e640 1 -- 172.21.15.19:0/1317970408 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f89a81033c0 msgr2=0x7f89a8199f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:26:12.880 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:12.875+0000 7f89ad57e640 1 --2- 172.21.15.19:0/1317970408 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f89a81033c0 0x7f89a8199f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:26:12.880 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:12.875+0000 7f89ad57e640 1 -- 172.21.15.19:0/1317970408 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f89a8102a00 msgr2=0x7f89a8199360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:26:12.880 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:12.875+0000 7f89ad57e640 1 --2- 172.21.15.19:0/1317970408 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f89a8102a00 0x7f89a8199360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:26:12.880 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:12.875+0000 7f89ad57e640 1 -- 172.21.15.19:0/1317970408 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f89a819a850 con 0x7f89a81018b0 2024-09-10T22:26:12.880 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:12.875+0000 7f89ad57e640 1 --2- 172.21.15.19:0/1317970408 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f89a81018b0 0x7f89a8198d10 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f89a400c970 tx=0x7f89a400cd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:26:12.880 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:12.876+0000 7f899a7fc640 1 -- 172.21.15.19:0/1317970408 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89a4007bb0 con 0x7f89a81018b0 2024-09-10T22:26:12.880 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:12.876+0000 7f899a7fc640 1 -- 172.21.15.19:0/1317970408 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f89a4007d50 con 0x7f89a81018b0 2024-09-10T22:26:12.881 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:12.876+0000 7f89af7e2640 1 -- 172.21.15.19:0/1317970408 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f89a819ab40 con 0x7f89a81018b0 2024-09-10T22:26:12.881 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:12.876+0000 7f899a7fc640 1 -- 172.21.15.19:0/1317970408 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89a4004de0 con 0x7f89a81018b0 2024-09-10T22:26:12.881 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:12.876+0000 7f89af7e2640 1 -- 172.21.15.19:0/1317970408 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f89a81a1210 con 0x7f89a81018b0 2024-09-10T22:26:12.882 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:12.877+0000 7f89af7e2640 1 -- 172.21.15.19:0/1317970408 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f89a81a13e0 con 0x7f89a81018b0 2024-09-10T22:26:12.882 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:12.878+0000 7f899a7fc640 1 -- 172.21.15.19:0/1317970408 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 18) ==== 153250+0+0 (secure 0 0 0) 0x7f89a4004f80 con 0x7f89a81018b0 2024-09-10T22:26:12.882 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:12.879+0000 7f899a7fc640 1 --2- 172.21.15.19:0/1317970408 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f89940b52e0 0x7f89940b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:26:12.882 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:12.879+0000 7f89acd7d640 1 --2- 172.21.15.19:0/1317970408 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f89940b52e0 0x7f89940b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:26:12.882 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:12.879+0000 7f899a7fc640 1 -- 172.21.15.19:0/1317970408 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8327+0+0 (secure 0 0 0) 0x7f89a40e5d10 con 0x7f89a81018b0 2024-09-10T22:26:12.882 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:12.879+0000 7f89acd7d640 1 --2- 172.21.15.19:0/1317970408 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f89940b52e0 0x7f89940b77a0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f899c00abe0 tx=0x7f899c00a2d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:26:12.884 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:12.882+0000 7f899a7fc640 1 -- 172.21.15.19:0/1317970408 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f89a4014030 con 0x7f89a81018b0 2024-09-10T22:26:13.066 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:13.064+0000 7f89af7e2640 1 -- 172.21.15.19:0/1317970408 --> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f89a80ff210 con 0x7f89940b52e0 2024-09-10T22:26:13.070 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:13.068+0000 7f899a7fc640 1 -- 172.21.15.19:0/1317970408 <== mgr.14150 v2:172.21.15.19:6800/2119495487 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258894 (secure 0 0 0) 0x7f89a80ff210 con 0x7f89940b52e0 2024-09-10T22:26:13.073 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-10T22:26:13.075 INFO:teuthology.orchestra.run.smithi019.stderr:dumped all 2024-09-10T22:26:13.077 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:13.071+0000 7f89af7e2640 1 -- 172.21.15.19:0/1317970408 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f89940b52e0 msgr2=0x7f89940b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:26:13.077 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:13.071+0000 7f89af7e2640 1 --2- 172.21.15.19:0/1317970408 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f89940b52e0 0x7f89940b77a0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f899c00abe0 tx=0x7f899c00a2d0 comp rx=0 tx=0).stop 2024-09-10T22:26:13.077 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:13.072+0000 7f89af7e2640 1 -- 172.21.15.19:0/1317970408 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f89a81018b0 msgr2=0x7f89a8198d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:26:13.077 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:13.072+0000 7f89af7e2640 1 --2- 172.21.15.19:0/1317970408 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f89a81018b0 0x7f89a8198d10 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f89a400c970 tx=0x7f89a400cd70 comp rx=0 tx=0).stop 2024-09-10T22:26:13.077 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:13.072+0000 7f89af7e2640 1 -- 172.21.15.19:0/1317970408 shutdown_connections 2024-09-10T22:26:13.077 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:13.072+0000 7f89af7e2640 1 --2- 172.21.15.19:0/1317970408 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f89940b52e0 0x7f89940b77a0 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:26:13.077 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:13.072+0000 7f89af7e2640 1 --2- 172.21.15.19:0/1317970408 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f89a81033c0 0x7f89a8199f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:26:13.077 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:13.072+0000 7f89af7e2640 1 --2- 172.21.15.19:0/1317970408 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f89a8102a00 0x7f89a8199360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:26:13.077 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:13.072+0000 7f89af7e2640 1 --2- 172.21.15.19:0/1317970408 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f89a81018b0 0x7f89a8198d10 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:26:13.077 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:13.072+0000 7f89af7e2640 1 -- 172.21.15.19:0/1317970408 >> 172.21.15.19:0/1317970408 conn(0x7f89a80fd190 msgr2=0x7f89a80feb00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:26:13.077 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:13.072+0000 7f89af7e2640 1 -- 172.21.15.19:0/1317970408 shutdown_connections 2024-09-10T22:26:13.078 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:13.072+0000 7f89af7e2640 1 -- 172.21.15.19:0/1317970408 wait complete. 2024-09-10T22:26:13.085 INFO:teuthology.orchestra.run.smithi019.stdout:{"pg_ready":true,"pg_map":{"version":341,"stamp":"2024-09-10T22:26:12.389857+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":655371,"num_objects":64,"num_object_clones":0,"num_object_copies":192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":691,"num_read_kb":437,"num_write":298,"num_write_kb":2270,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":24,"num_bytes_recovered":2953164,"num_keys_recovered":10,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":741,"ondisk_log_size":741,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":378056,"kb_used_data":12108,"kb_used_omap":18,"kb_used_meta":365677,"kb_avail":1124563768,"statfs":{"total":1151940427776,"available":1151553298432,"internally_reserved":0,"allocated":12398592,"data_stored":6929769,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19142,"internal_metadata":374453562},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1006,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":62,"num_read_kb":32,"num_write":12,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":652,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.001786"},"pg_stats":[{"pgid":"3.3f","version":"75'8","reported_seq":30,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T22:26:05.953476+0000","last_change":"2024-09-10T22:24:22.139905+0000","last_active":"2024-09-10T22:26:05.953476+0000","last_peered":"2024-09-10T22:26:05.953476+0000","last_clean":"2024-09-10T22:26:05.953476+0000","last_became_active":"2024-09-10T22:24:22.139558+0000","last_became_peered":"2024-09-10T22:24:22.139558+0000","last_unstale":"2024-09-10T22:26:05.953476+0000","last_undegraded":"2024-09-10T22:26:05.953476+0000","last_fullsized":"2024-09-10T22:26:05.953476+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_clean_scrub_stamp":"2024-09-10T22:24:21.113844+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:44:10.434972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"75'4","reported_seq":26,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T22:26:05.954611+0000","last_change":"2024-09-10T22:24:22.136722+0000","last_active":"2024-09-10T22:26:05.954611+0000","last_peered":"2024-09-10T22:26:05.954611+0000","last_clean":"2024-09-10T22:26:05.954611+0000","last_became_active":"2024-09-10T22:24:22.136080+0000","last_became_peered":"2024-09-10T22:24:22.136080+0000","last_unstale":"2024-09-10T22:26:05.954611+0000","last_undegraded":"2024-09-10T22:26:05.954611+0000","last_fullsized":"2024-09-10T22:26:05.954611+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_clean_scrub_stamp":"2024-09-10T22:24:21.113844+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:52:50.562031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"75'7","reported_seq":29,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T22:26:05.954617+0000","last_change":"2024-09-10T22:24:22.141323+0000","last_active":"2024-09-10T22:26:05.954617+0000","last_peered":"2024-09-10T22:26:05.954617+0000","last_clean":"2024-09-10T22:26:05.954617+0000","last_became_active":"2024-09-10T22:24:22.140895+0000","last_became_peered":"2024-09-10T22:24:22.140895+0000","last_unstale":"2024-09-10T22:26:05.954617+0000","last_undegraded":"2024-09-10T22:26:05.954617+0000","last_fullsized":"2024-09-10T22:26:05.954617+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_clean_scrub_stamp":"2024-09-10T22:24:21.113844+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:46:22.604672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"75'8","reported_seq":30,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T22:26:05.951352+0000","last_change":"2024-09-10T22:24:22.138806+0000","last_active":"2024-09-10T22:26:05.951352+0000","last_peered":"2024-09-10T22:26:05.951352+0000","last_clean":"2024-09-10T22:26:05.951352+0000","last_became_active":"2024-09-10T22:24:22.138502+0000","last_became_peered":"2024-09-10T22:24:22.138502+0000","last_unstale":"2024-09-10T22:26:05.951352+0000","last_undegraded":"2024-09-10T22:26:05.951352+0000","last_fullsized":"2024-09-10T22:26:05.951352+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_clean_scrub_stamp":"2024-09-10T22:24:21.113844+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:45:01.626820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"75'4","reported_seq":26,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T22:26:06.594143+0000","last_change":"2024-09-10T22:24:22.141233+0000","last_active":"2024-09-10T22:26:06.594143+0000","last_peered":"2024-09-10T22:26:06.594143+0000","last_clean":"2024-09-10T22:26:06.594143+0000","last_became_active":"2024-09-10T22:24:22.140944+0000","last_became_peered":"2024-09-10T22:24:22.140944+0000","last_unstale":"2024-09-10T22:26:06.594143+0000","last_undegraded":"2024-09-10T22:26:06.594143+0000","last_fullsized":"2024-09-10T22:26:06.594143+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_clean_scrub_stamp":"2024-09-10T22:24:21.113844+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:09:29.615658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"75'6","reported_seq":28,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T22:26:05.955522+0000","last_change":"2024-09-10T22:24:22.137990+0000","last_active":"2024-09-10T22:26:05.955522+0000","last_peered":"2024-09-10T22:26:05.955522+0000","last_clean":"2024-09-10T22:26:05.955522+0000","last_became_active":"2024-09-10T22:24:22.137685+0000","last_became_peered":"2024-09-10T22:24:22.137685+0000","last_unstale":"2024-09-10T22:26:05.955522+0000","last_undegraded":"2024-09-10T22:26:05.955522+0000","last_fullsized":"2024-09-10T22:26:05.955522+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_clean_scrub_stamp":"2024-09-10T22:24:21.113844+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:32:23.891069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"75'5","reported_seq":27,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T22:26:06.365123+0000","last_change":"2024-09-10T22:24:22.148073+0000","last_active":"2024-09-10T22:26:06.365123+0000","last_peered":"2024-09-10T22:26:06.365123+0000","last_clean":"2024-09-10T22:26:06.365123+0000","last_became_active":"2024-09-10T22:24:22.147785+0000","last_became_peered":"2024-09-10T22:24:22.147785+0000","last_unstale":"2024-09-10T22:26:06.365123+0000","last_undegraded":"2024-09-10T22:26:06.365123+0000","last_fullsized":"2024-09-10T22:26:06.365123+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_clean_scrub_stamp":"2024-09-10T22:24:21.113844+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:39:48.847949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"75'9","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T22:26:05.952288+0000","last_change":"2024-09-10T22:25:05.524455+0000","last_active":"2024-09-10T22:26:05.952288+0000","last_peered":"2024-09-10T22:26:05.952288+0000","last_clean":"2024-09-10T22:26:05.952288+0000","last_became_active":"2024-09-10T22:25:05.523985+0000","last_became_peered":"2024-09-10T22:25:05.523985+0000","last_unstale":"2024-09-10T22:26:05.952288+0000","last_undegraded":"2024-09-10T22:26:05.952288+0000","last_fullsized":"2024-09-10T22:26:05.952288+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_clean_scrub_stamp":"2024-09-10T22:24:21.113844+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:20:33.302885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,5,10],"acting":[9,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.37","version":"75'11","reported_seq":33,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T22:26:06.575609+0000","last_change":"2024-09-10T22:24:22.148042+0000","last_active":"2024-09-10T22:26:06.575609+0000","last_peered":"2024-09-10T22:26:06.575609+0000","last_clean":"2024-09-10T22:26:06.575609+0000","last_became_active":"2024-09-10T22:24:22.147722+0000","last_became_peered":"2024-09-10T22:24:22.147722+0000","last_unstale":"2024-09-10T22:26:06.575609+0000","last_undegraded":"2024-09-10T22:26:06.575609+0000","last_fullsized":"2024-09-10T22:26:06.575609+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_clean_scrub_stamp":"2024-09-10T22:24:21.113844+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:42:42.383957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"75'16","reported_seq":38,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T22:26:05.955991+0000","last_change":"2024-09-10T22:24:22.138956+0000","last_active":"2024-09-10T22:26:05.955991+0000","last_peered":"2024-09-10T22:26:05.955991+0000","last_clean":"2024-09-10T22:26:05.955991+0000","last_became_active":"2024-09-10T22:24:22.138530+0000","last_became_peered":"2024-09-10T22:24:22.138530+0000","last_unstale":"2024-09-10T22:26:05.955991+0000","last_undegraded":"2024-09-10T22:26:05.955991+0000","last_fullsized":"2024-09-10T22:26:05.955991+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_clean_scrub_stamp":"2024-09-10T22:24:21.113844+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:37:55.316556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"75'6","reported_seq":28,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T22:26:06.365684+0000","last_change":"2024-09-10T22:24:22.143435+0000","last_active":"2024-09-10T22:26:06.365684+0000","last_peered":"2024-09-10T22:26:06.365684+0000","last_clean":"2024-09-10T22:26:06.365684+0000","last_became_active":"2024-09-10T22:24:22.143100+0000","last_became_peered":"2024-09-10T22:24:22.143100+0000","last_unstale":"2024-09-10T22:26:06.365684+0000","last_undegraded":"2024-09-10T22:26:06.365684+0000","last_fullsized":"2024-09-10T22:26:06.365684+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_clean_scrub_stamp":"2024-09-10T22:24:21.113844+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:24:14.344203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"75'7","reported_seq":29,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T22:26:05.951417+0000","last_change":"2024-09-10T22:24:22.138101+0000","last_active":"2024-09-10T22:26:05.951417+0000","last_peered":"2024-09-10T22:26:05.951417+0000","last_clean":"2024-09-10T22:26:05.951417+0000","last_became_active":"2024-09-10T22:24:22.137479+0000","last_became_peered":"2024-09-10T22:24:22.137479+0000","last_unstale":"2024-09-10T22:26:05.951417+0000","last_undegraded":"2024-09-10T22:26:05.951417+0000","last_fullsized":"2024-09-10T22:26:05.951417+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_clean_scrub_stamp":"2024-09-10T22:24:21.113844+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:48:09.423136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"75'10","reported_seq":32,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T22:26:06.351060+0000","last_change":"2024-09-10T22:24:22.137157+0000","last_active":"2024-09-10T22:26:06.351060+0000","last_peered":"2024-09-10T22:26:06.351060+0000","last_clean":"2024-09-10T22:26:06.351060+0000","last_became_active":"2024-09-10T22:24:22.136817+0000","last_became_peered":"2024-09-10T22:24:22.136817+0000","last_unstale":"2024-09-10T22:26:06.351060+0000","last_undegraded":"2024-09-10T22:26:06.351060+0000","last_fullsized":"2024-09-10T22:26:06.351060+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_clean_scrub_stamp":"2024-09-10T22:24:21.113844+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:54:32.922776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"75'7","reported_seq":29,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T22:26:05.954575+0000","last_change":"2024-09-10T22:24:22.138828+0000","last_active":"2024-09-10T22:26:05.954575+0000","last_peered":"2024-09-10T22:26:05.954575+0000","last_clean":"2024-09-10T22:26:05.954575+0000","last_became_active":"2024-09-10T22:24:22.138509+0000","last_became_peered":"2024-09-10T22:24:22.138509+0000","last_unstale":"2024-09-10T22:26:05.954575+0000","last_undegraded":"2024-09-10T22:26:05.954575+0000","last_fullsized":"2024-09-10T22:26:05.954575+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_clean_scrub_stamp":"2024-09-10T22:24:21.113844+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:14:19.492298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"75'7","reported_seq":29,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T22:26:05.954349+0000","last_change":"2024-09-10T22:24:22.139317+0000","last_active":"2024-09-10T22:26:05.954349+0000","last_peered":"2024-09-10T22:26:05.954349+0000","last_clean":"2024-09-10T22:26:05.954349+0000","last_became_active":"2024-09-10T22:24:22.138949+0000","last_became_peered":"2024-09-10T22:24:22.138949+0000","last_unstale":"2024-09-10T22:26:05.954349+0000","last_undegraded":"2024-09-10T22:26:05.954349+0000","last_fullsized":"2024-09-10T22:26:05.954349+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_clean_scrub_stamp":"2024-09-10T22:24:21.113844+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:34:56.412955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"75'9","reported_seq":31,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T22:26:06.575431+0000","last_change":"2024-09-10T22:24:22.147283+0000","last_active":"2024-09-10T22:26:06.575431+0000","last_peered":"2024-09-10T22:26:06.575431+0000","last_clean":"2024-09-10T22:26:06.575431+0000","last_became_active":"2024-09-10T22:24:22.146954+0000","last_became_peered":"2024-09-10T22:24:22.146954+0000","last_unstale":"2024-09-10T22:26:06.575431+0000","last_undegraded":"2024-09-10T22:26:06.575431+0000","last_fullsized":"2024-09-10T22:26:06.575431+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_clean_scrub_stamp":"2024-09-10T22:24:21.113844+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:22:21.772747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"75'8","reported_seq":30,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T22:26:05.953660+0000","last_change":"2024-09-10T22:24:22.139482+0000","last_active":"2024-09-10T22:26:05.953660+0000","last_peered":"2024-09-10T22:26:05.953660+0000","last_clean":"2024-09-10T22:26:05.953660+0000","last_became_active":"2024-09-10T22:24:22.139135+0000","last_became_peered":"2024-09-10T22:24:22.139135+0000","last_unstale":"2024-09-10T22:26:05.953660+0000","last_undegraded":"2024-09-10T22:26:05.953660+0000","last_fullsized":"2024-09-10T22:26:05.953660+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_clean_scrub_stamp":"2024-09-10T22:24:21.113844+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:25:31.639392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"75'10","reported_seq":32,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T22:26:05.952449+0000","last_change":"2024-09-10T22:24:22.142465+0000","last_active":"2024-09-10T22:26:05.952449+0000","last_peered":"2024-09-10T22:26:05.952449+0000","last_clean":"2024-09-10T22:26:05.952449+0000","last_became_active":"2024-09-10T22:24:22.142110+0000","last_became_peered":"2024-09-10T22:24:22.142110+0000","last_unstale":"2024-09-10T22:26:05.952449+0000","last_undegraded":"2024-09-10T22:26:05.952449+0000","last_fullsized":"2024-09-10T22:26:05.952449+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_clean_scrub_stamp":"2024-09-10T22:24:21.113844+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:16:20.476055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"75'7","reported_seq":29,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T22:26:05.954453+0000","last_change":"2024-09-10T22:24:22.147942+0000","last_active":"2024-09-10T22:26:05.954453+0000","last_peered":"2024-09-10T22:26:05.954453+0000","last_clean":"2024-09-10T22:26:05.954453+0000","last_became_active":"2024-09-10T22:24:22.147637+0000","last_became_peered":"2024-09-10T22:24:22.147637+0000","last_unstale":"2024-09-10T22:26:05.954453+0000","last_undegraded":"2024-09-10T22:26:05.954453+0000","last_fullsized":"2024-09-10T22:26:05.954453+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_clean_scrub_stamp":"2024-09-10T22:24:21.113844+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:46:36.831534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"75'8","reported_seq":30,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T22:26:05.953920+0000","last_change":"2024-09-10T22:24:22.138032+0000","last_active":"2024-09-10T22:26:05.953920+0000","last_peered":"2024-09-10T22:26:05.953920+0000","last_clean":"2024-09-10T22:26:05.953920+0000","last_became_active":"2024-09-10T22:24:22.137657+0000","last_became_peered":"2024-09-10T22:24:22.137657+0000","last_unstale":"2024-09-10T22:26:05.953920+0000","last_undegraded":"2024-09-10T22:26:05.953920+0000","last_fullsized":"2024-09-10T22:26:05.953920+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_clean_scrub_stamp":"2024-09-10T22:24:21.113844+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:06:51.479298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"75'11","reported_seq":33,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T22:26:06.351040+0000","last_change":"2024-09-10T22:24:22.141106+0000","last_active":"2024-09-10T22:26:06.351040+0000","last_peered":"2024-09-10T22:26:06.351040+0000","last_clean":"2024-09-10T22:26:06.351040+0000","last_became_active":"2024-09-10T22:24:22.140780+0000","last_became_peered":"2024-09-10T22:24:22.140780+0000","last_unstale":"2024-09-10T22:26:06.351040+0000","last_undegraded":"2024-09-10T22:26:06.351040+0000","last_fullsized":"2024-09-10T22:26:06.351040+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_clean_scrub_stamp":"2024-09-10T22:24:21.113844+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:25:21.302463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"75'10","reported_seq":32,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T22:26:06.575460+0000","last_change":"2024-09-10T22:24:22.146772+0000","last_active":"2024-09-10T22:26:06.575460+0000","last_peered":"2024-09-10T22:26:06.575460+0000","last_clean":"2024-09-10T22:26:06.575460+0000","last_became_active":"2024-09-10T22:24:22.146317+0000","last_became_peered":"2024-09-10T22:24:22.146317+0000","last_unstale":"2024-09-10T22:26:06.575460+0000","last_undegraded":"2024-09-10T22:26:06.575460+0000","last_fullsized":"2024-09-10T22:26:06.575460+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_clean_scrub_stamp":"2024-09-10T22:24:21.113844+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:13:55.706482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"75'8","reported_seq":30,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T22:26:05.957169+0000","last_change":"2024-09-10T22:24:22.139791+0000","last_active":"2024-09-10T22:26:05.957169+0000","last_peered":"2024-09-10T22:26:05.957169+0000","last_clean":"2024-09-10T22:26:05.957169+0000","last_became_active":"2024-09-10T22:24:22.139491+0000","last_became_peered":"2024-09-10T22:24:22.139491+0000","last_unstale":"2024-09-10T22:26:05.957169+0000","last_undegraded":"2024-09-10T22:26:05.957169+0000","last_fullsized":"2024-09-10T22:26:05.957169+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_clean_scrub_stamp":"2024-09-10T22:24:21.113844+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:18:29.412412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"75'6","reported_seq":28,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T22:26:05.951202+0000","last_change":"2024-09-10T22:24:22.143383+0000","last_active":"2024-09-10T22:26:05.951202+0000","last_peered":"2024-09-10T22:26:05.951202+0000","last_clean":"2024-09-10T22:26:05.951202+0000","last_became_active":"2024-09-10T22:24:22.143045+0000","last_became_peered":"2024-09-10T22:24:22.143045+0000","last_unstale":"2024-09-10T22:26:05.951202+0000","last_undegraded":"2024-09-10T22:26:05.951202+0000","last_fullsized":"2024-09-10T22:26:05.951202+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_clean_scrub_stamp":"2024-09-10T22:24:21.113844+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:37:10.135448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"75'2","reported_seq":24,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T22:26:05.957386+0000","last_change":"2024-09-10T22:24:22.141851+0000","last_active":"2024-09-10T22:26:05.957386+0000","last_peered":"2024-09-10T22:26:05.957386+0000","last_clean":"2024-09-10T22:26:05.957386+0000","last_became_active":"2024-09-10T22:24:22.141469+0000","last_became_peered":"2024-09-10T22:24:22.141469+0000","last_unstale":"2024-09-10T22:26:05.957386+0000","last_undegraded":"2024-09-10T22:26:05.957386+0000","last_fullsized":"2024-09-10T22:26:05.957386+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_clean_scrub_stamp":"2024-09-10T22:24:21.113844+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:03:59.805704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"75'15","reported_seq":37,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T22:26:05.954813+0000","last_change":"2024-09-10T22:24:22.139821+0000","last_active":"2024-09-10T22:26:05.954813+0000","last_peered":"2024-09-10T22:26:05.954813+0000","last_clean":"2024-09-10T22:26:05.954813+0000","last_became_active":"2024-09-10T22:24:22.139398+0000","last_became_peered":"2024-09-10T22:24:22.139398+0000","last_unstale":"2024-09-10T22:26:05.954813+0000","last_undegraded":"2024-09-10T22:26:05.954813+0000","last_fullsized":"2024-09-10T22:26:05.954813+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_clean_scrub_stamp":"2024-09-10T22:24:21.113844+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:18:22.160919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"75'6","reported_seq":28,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T22:26:05.953889+0000","last_change":"2024-09-10T22:24:22.141219+0000","last_active":"2024-09-10T22:26:05.953889+0000","last_peered":"2024-09-10T22:26:05.953889+0000","last_clean":"2024-09-10T22:26:05.953889+0000","last_became_active":"2024-09-10T22:24:22.140900+0000","last_became_peered":"2024-09-10T22:24:22.140900+0000","last_unstale":"2024-09-10T22:26:05.953889+0000","last_undegraded":"2024-09-10T22:26:05.953889+0000","last_fullsized":"2024-09-10T22:26:05.953889+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_clean_scrub_stamp":"2024-09-10T22:24:21.113844+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:27:59.115533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"75'4","reported_seq":26,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T22:26:06.351288+0000","last_change":"2024-09-10T22:24:22.139738+0000","last_active":"2024-09-10T22:26:06.351288+0000","last_peered":"2024-09-10T22:26:06.351288+0000","last_clean":"2024-09-10T22:26:06.351288+0000","last_became_active":"2024-09-10T22:24:22.139096+0000","last_became_peered":"2024-09-10T22:24:22.139096+0000","last_unstale":"2024-09-10T22:26:06.351288+0000","last_undegraded":"2024-09-10T22:26:06.351288+0000","last_fullsized":"2024-09-10T22:26:06.351288+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_clean_scrub_stamp":"2024-09-10T22:24:21.113844+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:16:39.110610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"75'7","reported_seq":29,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T22:26:05.954604+0000","last_change":"2024-09-10T22:24:22.144896+0000","last_active":"2024-09-10T22:26:05.954604+0000","last_peered":"2024-09-10T22:26:05.954604+0000","last_clean":"2024-09-10T22:26:05.954604+0000","last_became_active":"2024-09-10T22:24:22.144622+0000","last_became_peered":"2024-09-10T22:24:22.144622+0000","last_unstale":"2024-09-10T22:26:05.954604+0000","last_undegraded":"2024-09-10T22:26:05.954604+0000","last_fullsized":"2024-09-10T22:26:05.954604+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_clean_scrub_stamp":"2024-09-10T22:24:21.113844+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:32:44.648993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"75'8","reported_seq":30,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T22:26:05.953526+0000","last_change":"2024-09-10T22:24:22.148082+0000","last_active":"2024-09-10T22:26:05.953526+0000","last_peered":"2024-09-10T22:26:05.953526+0000","last_clean":"2024-09-10T22:26:05.953526+0000","last_became_active":"2024-09-10T22:24:22.147664+0000","last_became_peered":"2024-09-10T22:24:22.147664+0000","last_unstale":"2024-09-10T22:26:05.953526+0000","last_undegraded":"2024-09-10T22:26:05.953526+0000","last_fullsized":"2024-09-10T22:26:05.953526+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_clean_scrub_stamp":"2024-09-10T22:24:21.113844+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:12:40.154756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"75'12","reported_seq":41,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T22:26:05.953815+0000","last_change":"2024-09-10T22:25:05.638351+0000","last_active":"2024-09-10T22:26:05.953815+0000","last_peered":"2024-09-10T22:26:05.953815+0000","last_clean":"2024-09-10T22:26:05.953815+0000","last_became_active":"2024-09-10T22:25:05.637523+0000","last_became_peered":"2024-09-10T22:25:05.637523+0000","last_unstale":"2024-09-10T22:26:05.953815+0000","last_undegraded":"2024-09-10T22:26:05.953815+0000","last_fullsized":"2024-09-10T22:26:05.953815+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_clean_scrub_stamp":"2024-09-10T22:24:21.113844+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:09:37.231420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,9,4],"acting":[2,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"75'9","reported_seq":31,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T22:26:05.953229+0000","last_change":"2024-09-10T22:24:22.141534+0000","last_active":"2024-09-10T22:26:05.953229+0000","last_peered":"2024-09-10T22:26:05.953229+0000","last_clean":"2024-09-10T22:26:05.953229+0000","last_became_active":"2024-09-10T22:24:22.141243+0000","last_became_peered":"2024-09-10T22:24:22.141243+0000","last_unstale":"2024-09-10T22:26:05.953229+0000","last_undegraded":"2024-09-10T22:26:05.953229+0000","last_fullsized":"2024-09-10T22:26:05.953229+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_clean_scrub_stamp":"2024-09-10T22:24:21.113844+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:26:23.559943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"75'7","reported_seq":29,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T22:26:06.594143+0000","last_change":"2024-09-10T22:24:22.144951+0000","last_active":"2024-09-10T22:26:06.594143+0000","last_peered":"2024-09-10T22:26:06.594143+0000","last_clean":"2024-09-10T22:26:06.594143+0000","last_became_active":"2024-09-10T22:24:22.144634+0000","last_became_peered":"2024-09-10T22:24:22.144634+0000","last_unstale":"2024-09-10T22:26:06.594143+0000","last_undegraded":"2024-09-10T22:26:06.594143+0000","last_fullsized":"2024-09-10T22:26:06.594143+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_clean_scrub_stamp":"2024-09-10T22:24:21.113844+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:04:19.350081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"77'6","reported_seq":134,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T22:26:08.623766+0000","last_change":"2024-09-10T22:24:20.128083+0000","last_active":"2024-09-10T22:26:08.623766+0000","last_peered":"2024-09-10T22:26:08.623766+0000","last_clean":"2024-09-10T22:26:08.623766+0000","last_became_active":"2024-09-10T22:24:20.127676+0000","last_became_peered":"2024-09-10T22:24:20.127676+0000","last_unstale":"2024-09-10T22:26:08.623766+0000","last_undegraded":"2024-09-10T22:26:08.623766+0000","last_fullsized":"2024-09-10T22:26:08.623766+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:19.099039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:19.099039+0000","last_clean_scrub_stamp":"2024-09-10T22:24:19.099039+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:37:51.745817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":930,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":101,"num_read_kb":3,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"75'8","reported_seq":37,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T22:26:05.951367+0000","last_change":"2024-09-10T22:25:05.638296+0000","last_active":"2024-09-10T22:26:05.951367+0000","last_peered":"2024-09-10T22:26:05.951367+0000","last_clean":"2024-09-10T22:26:05.951367+0000","last_became_active":"2024-09-10T22:25:05.637649+0000","last_became_peered":"2024-09-10T22:25:05.637649+0000","last_unstale":"2024-09-10T22:26:05.951367+0000","last_undegraded":"2024-09-10T22:26:05.951367+0000","last_fullsized":"2024-09-10T22:26:05.951367+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_clean_scrub_stamp":"2024-09-10T22:24:21.113844+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:07:42.674144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3],"acting":[5,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"73'3","reported_seq":41,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T22:26:05.955561+0000","last_change":"2024-09-10T22:25:05.532533+0000","last_active":"2024-09-10T22:26:05.955561+0000","last_peered":"2024-09-10T22:26:05.955561+0000","last_clean":"2024-09-10T22:26:05.955561+0000","last_became_active":"2024-09-10T22:25:05.526228+0000","last_became_peered":"2024-09-10T22:25:05.526228+0000","last_unstale":"2024-09-10T22:26:05.955561+0000","last_undegraded":"2024-09-10T22:26:05.955561+0000","last_fullsized":"2024-09-10T22:26:05.955561+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:19.099039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:19.099039+0000","last_clean_scrub_stamp":"2024-09-10T22:24:19.099039+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:53:36.903083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,6],"acting":[10,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"73'2","reported_seq":29,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T22:26:06.351270+0000","last_change":"2024-09-10T22:24:20.122635+0000","last_active":"2024-09-10T22:26:06.351270+0000","last_peered":"2024-09-10T22:26:06.351270+0000","last_clean":"2024-09-10T22:26:06.351270+0000","last_became_active":"2024-09-10T22:24:20.122289+0000","last_became_peered":"2024-09-10T22:24:20.122289+0000","last_unstale":"2024-09-10T22:26:06.351270+0000","last_undegraded":"2024-09-10T22:26:06.351270+0000","last_fullsized":"2024-09-10T22:26:06.351270+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:19.099039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:19.099039+0000","last_clean_scrub_stamp":"2024-09-10T22:24:19.099039+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:30:40.779513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"75'8","reported_seq":30,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T22:26:05.956943+0000","last_change":"2024-09-10T22:24:22.137417+0000","last_active":"2024-09-10T22:26:05.956943+0000","last_peered":"2024-09-10T22:26:05.956943+0000","last_clean":"2024-09-10T22:26:05.956943+0000","last_became_active":"2024-09-10T22:24:22.136913+0000","last_became_peered":"2024-09-10T22:24:22.136913+0000","last_unstale":"2024-09-10T22:26:05.956943+0000","last_undegraded":"2024-09-10T22:26:05.956943+0000","last_fullsized":"2024-09-10T22:26:05.956943+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_clean_scrub_stamp":"2024-09-10T22:24:21.113844+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:23:39.551056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"73'1","reported_seq":28,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T22:26:05.951411+0000","last_change":"2024-09-10T22:24:20.128416+0000","last_active":"2024-09-10T22:26:05.951411+0000","last_peered":"2024-09-10T22:26:05.951411+0000","last_clean":"2024-09-10T22:26:05.951411+0000","last_became_active":"2024-09-10T22:24:20.127998+0000","last_became_peered":"2024-09-10T22:24:20.127998+0000","last_unstale":"2024-09-10T22:26:05.951411+0000","last_undegraded":"2024-09-10T22:26:05.951411+0000","last_fullsized":"2024-09-10T22:26:05.951411+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:19.099039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:19.099039+0000","last_clean_scrub_stamp":"2024-09-10T22:24:19.099039+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:44:39.871564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"75'11","reported_seq":33,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T22:26:05.952467+0000","last_change":"2024-09-10T22:24:22.136355+0000","last_active":"2024-09-10T22:26:05.952467+0000","last_peered":"2024-09-10T22:26:05.952467+0000","last_clean":"2024-09-10T22:26:05.952467+0000","last_became_active":"2024-09-10T22:24:22.136047+0000","last_became_peered":"2024-09-10T22:24:22.136047+0000","last_unstale":"2024-09-10T22:26:05.952467+0000","last_undegraded":"2024-09-10T22:26:05.952467+0000","last_fullsized":"2024-09-10T22:26:05.952467+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_clean_scrub_stamp":"2024-09-10T22:24:21.113844+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:56:14.739365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"77'4","reported_seq":142,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T22:26:08.622443+0000","last_change":"2024-09-10T22:25:05.537891+0000","last_active":"2024-09-10T22:26:08.622443+0000","last_peered":"2024-09-10T22:26:08.622443+0000","last_clean":"2024-09-10T22:26:08.622443+0000","last_became_active":"2024-09-10T22:25:05.526085+0000","last_became_peered":"2024-09-10T22:25:05.526085+0000","last_unstale":"2024-09-10T22:26:08.622443+0000","last_undegraded":"2024-09-10T22:26:08.622443+0000","last_fullsized":"2024-09-10T22:26:08.622443+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:19.099039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:19.099039+0000","last_clean_scrub_stamp":"2024-09-10T22:24:19.099039+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:57:02.158783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":93,"num_read_kb":93,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":90,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,9],"acting":[10,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"75'10","reported_seq":32,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T22:26:06.575641+0000","last_change":"2024-09-10T22:24:22.143321+0000","last_active":"2024-09-10T22:26:06.575641+0000","last_peered":"2024-09-10T22:26:06.575641+0000","last_clean":"2024-09-10T22:26:06.575641+0000","last_became_active":"2024-09-10T22:24:22.143036+0000","last_became_peered":"2024-09-10T22:24:22.143036+0000","last_unstale":"2024-09-10T22:26:06.575641+0000","last_undegraded":"2024-09-10T22:26:06.575641+0000","last_fullsized":"2024-09-10T22:26:06.575641+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_clean_scrub_stamp":"2024-09-10T22:24:21.113844+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:51:42.473300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"73'2","reported_seq":40,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T22:26:06.365710+0000","last_change":"2024-09-10T22:25:05.534611+0000","last_active":"2024-09-10T22:26:06.365710+0000","last_peered":"2024-09-10T22:26:06.365710+0000","last_clean":"2024-09-10T22:26:06.365710+0000","last_became_active":"2024-09-10T22:25:05.526934+0000","last_became_peered":"2024-09-10T22:25:05.526934+0000","last_unstale":"2024-09-10T22:26:06.365710+0000","last_undegraded":"2024-09-10T22:26:06.365710+0000","last_fullsized":"2024-09-10T22:26:06.365710+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:19.099039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:19.099039+0000","last_clean_scrub_stamp":"2024-09-10T22:24:19.099039+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:39:20.317571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"75'9","reported_seq":31,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T22:26:05.954780+0000","last_change":"2024-09-10T22:24:22.144830+0000","last_active":"2024-09-10T22:26:05.954780+0000","last_peered":"2024-09-10T22:26:05.954780+0000","last_clean":"2024-09-10T22:26:05.954780+0000","last_became_active":"2024-09-10T22:24:22.144358+0000","last_became_peered":"2024-09-10T22:24:22.144358+0000","last_unstale":"2024-09-10T22:26:05.954780+0000","last_undegraded":"2024-09-10T22:26:05.954780+0000","last_fullsized":"2024-09-10T22:26:05.954780+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_clean_scrub_stamp":"2024-09-10T22:24:21.113844+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:28:14.398474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"73'4","reported_seq":32,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T22:26:05.951595+0000","last_change":"2024-09-10T22:24:20.383555+0000","last_active":"2024-09-10T22:26:05.951595+0000","last_peered":"2024-09-10T22:26:05.951595+0000","last_clean":"2024-09-10T22:26:05.951595+0000","last_became_active":"2024-09-10T22:24:20.383163+0000","last_became_peered":"2024-09-10T22:24:20.383163+0000","last_unstale":"2024-09-10T22:26:05.951595+0000","last_undegraded":"2024-09-10T22:26:05.951595+0000","last_fullsized":"2024-09-10T22:26:05.951595+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:19.099039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:19.099039+0000","last_clean_scrub_stamp":"2024-09-10T22:24:19.099039+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:14:03.052220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"75'11","reported_seq":33,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T22:26:06.575515+0000","last_change":"2024-09-10T22:24:22.144562+0000","last_active":"2024-09-10T22:26:06.575515+0000","last_peered":"2024-09-10T22:26:06.575515+0000","last_clean":"2024-09-10T22:26:06.575515+0000","last_became_active":"2024-09-10T22:24:22.144146+0000","last_became_peered":"2024-09-10T22:24:22.144146+0000","last_unstale":"2024-09-10T22:26:06.575515+0000","last_undegraded":"2024-09-10T22:26:06.575515+0000","last_fullsized":"2024-09-10T22:26:06.575515+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_clean_scrub_stamp":"2024-09-10T22:24:21.113844+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:57:36.070289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"77'32","reported_seq":268,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T22:26:10.366807+0000","last_change":"2024-09-10T22:24:20.126245+0000","last_active":"2024-09-10T22:26:10.366807+0000","last_peered":"2024-09-10T22:26:10.366807+0000","last_clean":"2024-09-10T22:26:10.366807+0000","last_became_active":"2024-09-10T22:24:20.125839+0000","last_became_peered":"2024-09-10T22:24:20.125839+0000","last_unstale":"2024-09-10T22:26:10.366807+0000","last_undegraded":"2024-09-10T22:26:10.366807+0000","last_fullsized":"2024-09-10T22:26:10.366807+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:19.099039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:19.099039+0000","last_clean_scrub_stamp":"2024-09-10T22:24:19.099039+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:45:05.155436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":60319,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":209,"num_read_kb":163,"num_write":33,"num_write_kb":73,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"75'6","reported_seq":28,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T22:26:06.594223+0000","last_change":"2024-09-10T22:24:22.142178+0000","last_active":"2024-09-10T22:26:06.594223+0000","last_peered":"2024-09-10T22:26:06.594223+0000","last_clean":"2024-09-10T22:26:06.594223+0000","last_became_active":"2024-09-10T22:24:22.141883+0000","last_became_peered":"2024-09-10T22:24:22.141883+0000","last_unstale":"2024-09-10T22:26:06.594223+0000","last_undegraded":"2024-09-10T22:26:06.594223+0000","last_fullsized":"2024-09-10T22:26:06.594223+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_clean_scrub_stamp":"2024-09-10T22:24:21.113844+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:24:50.996273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"73'6","reported_seq":34,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T22:26:05.954056+0000","last_change":"2024-09-10T22:24:20.126129+0000","last_active":"2024-09-10T22:26:05.954056+0000","last_peered":"2024-09-10T22:26:05.954056+0000","last_clean":"2024-09-10T22:26:05.954056+0000","last_became_active":"2024-09-10T22:24:20.125749+0000","last_became_peered":"2024-09-10T22:24:20.125749+0000","last_unstale":"2024-09-10T22:26:05.954056+0000","last_undegraded":"2024-09-10T22:26:05.954056+0000","last_fullsized":"2024-09-10T22:26:05.954056+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:19.099039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:19.099039+0000","last_clean_scrub_stamp":"2024-09-10T22:24:19.099039+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:58:35.224036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"75'9","reported_seq":31,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T22:26:06.350986+0000","last_change":"2024-09-10T22:24:22.143964+0000","last_active":"2024-09-10T22:26:06.350986+0000","last_peered":"2024-09-10T22:26:06.350986+0000","last_clean":"2024-09-10T22:26:06.350986+0000","last_became_active":"2024-09-10T22:24:22.143589+0000","last_became_peered":"2024-09-10T22:24:22.143589+0000","last_unstale":"2024-09-10T22:26:06.350986+0000","last_undegraded":"2024-09-10T22:26:06.350986+0000","last_fullsized":"2024-09-10T22:26:06.350986+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_clean_scrub_stamp":"2024-09-10T22:24:21.113844+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:41:41.737627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"73'3","reported_seq":30,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T22:26:05.951305+0000","last_change":"2024-09-10T22:24:20.128012+0000","last_active":"2024-09-10T22:26:05.951305+0000","last_peered":"2024-09-10T22:26:05.951305+0000","last_clean":"2024-09-10T22:26:05.951305+0000","last_became_active":"2024-09-10T22:24:20.127335+0000","last_became_peered":"2024-09-10T22:24:20.127335+0000","last_unstale":"2024-09-10T22:26:05.951305+0000","last_undegraded":"2024-09-10T22:26:05.951305+0000","last_fullsized":"2024-09-10T22:26:05.951305+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:19.099039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:19.099039+0000","last_clean_scrub_stamp":"2024-09-10T22:24:19.099039+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:20:27.017032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"75'15","reported_seq":44,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T22:26:06.365478+0000","last_change":"2024-09-10T22:25:05.526382+0000","last_active":"2024-09-10T22:26:06.365478+0000","last_peered":"2024-09-10T22:26:06.365478+0000","last_clean":"2024-09-10T22:26:06.365478+0000","last_became_active":"2024-09-10T22:25:05.526037+0000","last_became_peered":"2024-09-10T22:25:05.526037+0000","last_unstale":"2024-09-10T22:26:06.365478+0000","last_undegraded":"2024-09-10T22:26:06.365478+0000","last_fullsized":"2024-09-10T22:26:06.365478+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_clean_scrub_stamp":"2024-09-10T22:24:21.113844+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:15:12.891318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,6],"acting":[7,9,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"75'5","reported_seq":134,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T22:26:08.390161+0000","last_change":"2024-09-10T22:24:20.124069+0000","last_active":"2024-09-10T22:26:08.390161+0000","last_peered":"2024-09-10T22:26:08.390161+0000","last_clean":"2024-09-10T22:26:08.390161+0000","last_became_active":"2024-09-10T22:24:20.123675+0000","last_became_peered":"2024-09-10T22:24:20.123675+0000","last_unstale":"2024-09-10T22:26:08.390161+0000","last_undegraded":"2024-09-10T22:26:08.390161+0000","last_fullsized":"2024-09-10T22:26:08.390161+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:19.099039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:19.099039+0000","last_clean_scrub_stamp":"2024-09-10T22:24:19.099039+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:32:50.287012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1120,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":103,"num_read_kb":5,"num_write":4,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"75'6","reported_seq":28,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T22:26:06.365122+0000","last_change":"2024-09-10T22:24:22.146870+0000","last_active":"2024-09-10T22:26:06.365122+0000","last_peered":"2024-09-10T22:26:06.365122+0000","last_clean":"2024-09-10T22:26:06.365122+0000","last_became_active":"2024-09-10T22:24:22.146615+0000","last_became_peered":"2024-09-10T22:24:22.146615+0000","last_unstale":"2024-09-10T22:26:06.365122+0000","last_undegraded":"2024-09-10T22:26:06.365122+0000","last_fullsized":"2024-09-10T22:26:06.365122+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_clean_scrub_stamp":"2024-09-10T22:24:21.113844+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:00:05.579248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"73'15","reported_seq":43,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T22:26:06.594490+0000","last_change":"2024-09-10T22:24:20.383675+0000","last_active":"2024-09-10T22:26:06.594490+0000","last_peered":"2024-09-10T22:26:06.594490+0000","last_clean":"2024-09-10T22:26:06.594490+0000","last_became_active":"2024-09-10T22:24:20.383317+0000","last_became_peered":"2024-09-10T22:24:20.383317+0000","last_unstale":"2024-09-10T22:26:06.594490+0000","last_undegraded":"2024-09-10T22:26:06.594490+0000","last_fullsized":"2024-09-10T22:26:06.594490+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:19.099039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:19.099039+0000","last_clean_scrub_stamp":"2024-09-10T22:24:19.099039+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:43:24.989851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"75'6","reported_seq":28,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T22:26:05.951214+0000","last_change":"2024-09-10T22:24:22.144872+0000","last_active":"2024-09-10T22:26:05.951214+0000","last_peered":"2024-09-10T22:26:05.951214+0000","last_clean":"2024-09-10T22:26:05.951214+0000","last_became_active":"2024-09-10T22:24:22.144570+0000","last_became_peered":"2024-09-10T22:24:22.144570+0000","last_unstale":"2024-09-10T22:26:05.951214+0000","last_undegraded":"2024-09-10T22:26:05.951214+0000","last_fullsized":"2024-09-10T22:26:05.951214+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_clean_scrub_stamp":"2024-09-10T22:24:21.113844+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:20:17.937544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"73'2","reported_seq":30,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T22:26:06.595004+0000","last_change":"2024-09-10T22:24:20.125849+0000","last_active":"2024-09-10T22:26:06.595004+0000","last_peered":"2024-09-10T22:26:06.595004+0000","last_clean":"2024-09-10T22:26:06.595004+0000","last_became_active":"2024-09-10T22:24:20.125042+0000","last_became_peered":"2024-09-10T22:24:20.125042+0000","last_unstale":"2024-09-10T22:26:06.595004+0000","last_undegraded":"2024-09-10T22:26:06.595004+0000","last_fullsized":"2024-09-10T22:26:06.595004+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:19.099039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:19.099039+0000","last_clean_scrub_stamp":"2024-09-10T22:24:19.099039+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:36:28.249115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"75'5","reported_seq":27,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T22:26:05.953217+0000","last_change":"2024-09-10T22:24:22.141232+0000","last_active":"2024-09-10T22:26:05.953217+0000","last_peered":"2024-09-10T22:26:05.953217+0000","last_clean":"2024-09-10T22:26:05.953217+0000","last_became_active":"2024-09-10T22:24:22.140903+0000","last_became_peered":"2024-09-10T22:24:22.140903+0000","last_unstale":"2024-09-10T22:26:05.953217+0000","last_undegraded":"2024-09-10T22:26:05.953217+0000","last_fullsized":"2024-09-10T22:26:05.953217+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_clean_scrub_stamp":"2024-09-10T22:24:21.113844+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:15:11.627126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"73'2","reported_seq":29,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T22:26:06.351674+0000","last_change":"2024-09-10T22:24:20.122829+0000","last_active":"2024-09-10T22:26:06.351674+0000","last_peered":"2024-09-10T22:26:06.351674+0000","last_clean":"2024-09-10T22:26:06.351674+0000","last_became_active":"2024-09-10T22:24:20.122545+0000","last_became_peered":"2024-09-10T22:24:20.122545+0000","last_unstale":"2024-09-10T22:26:06.351674+0000","last_undegraded":"2024-09-10T22:26:06.351674+0000","last_fullsized":"2024-09-10T22:26:06.351674+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:19.099039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:19.099039+0000","last_clean_scrub_stamp":"2024-09-10T22:24:19.099039+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:18:27.758029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"75'9","reported_seq":31,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T22:26:06.365191+0000","last_change":"2024-09-10T22:24:22.139725+0000","last_active":"2024-09-10T22:26:06.365191+0000","last_peered":"2024-09-10T22:26:06.365191+0000","last_clean":"2024-09-10T22:26:06.365191+0000","last_became_active":"2024-09-10T22:24:22.139293+0000","last_became_peered":"2024-09-10T22:24:22.139293+0000","last_unstale":"2024-09-10T22:26:06.365191+0000","last_undegraded":"2024-09-10T22:26:06.365191+0000","last_fullsized":"2024-09-10T22:26:06.365191+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_clean_scrub_stamp":"2024-09-10T22:24:21.113844+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:43:14.424880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"73'1","reported_seq":16,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T22:26:05.963961+0000","last_change":"2024-09-10T22:26:05.963539+0000","last_active":"2024-09-10T22:26:05.963961+0000","last_peered":"2024-09-10T22:26:05.963961+0000","last_clean":"2024-09-10T22:26:05.963961+0000","last_became_active":"2024-09-10T22:26:05.959671+0000","last_became_peered":"2024-09-10T22:26:05.959671+0000","last_unstale":"2024-09-10T22:26:05.963961+0000","last_undegraded":"2024-09-10T22:26:05.963961+0000","last_fullsized":"2024-09-10T22:26:05.963961+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:19.099039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:19.099039+0000","last_clean_scrub_stamp":"2024-09-10T22:24:19.099039+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:32:07.837404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":70,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,10,3],"acting":[11,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.c","version":"75'7","reported_seq":29,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T22:26:06.365143+0000","last_change":"2024-09-10T22:24:22.149522+0000","last_active":"2024-09-10T22:26:06.365143+0000","last_peered":"2024-09-10T22:26:06.365143+0000","last_clean":"2024-09-10T22:26:06.365143+0000","last_became_active":"2024-09-10T22:24:22.148710+0000","last_became_peered":"2024-09-10T22:24:22.148710+0000","last_unstale":"2024-09-10T22:26:06.365143+0000","last_undegraded":"2024-09-10T22:26:06.365143+0000","last_fullsized":"2024-09-10T22:26:06.365143+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_clean_scrub_stamp":"2024-09-10T22:24:21.113844+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:44:32.020949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"73'3","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T22:26:05.961597+0000","last_change":"2024-09-10T22:26:05.961171+0000","last_active":"2024-09-10T22:26:05.961597+0000","last_peered":"2024-09-10T22:26:05.961597+0000","last_clean":"2024-09-10T22:26:05.961597+0000","last_became_active":"2024-09-10T22:26:05.956892+0000","last_became_peered":"2024-09-10T22:26:05.956892+0000","last_unstale":"2024-09-10T22:26:05.961597+0000","last_undegraded":"2024-09-10T22:26:05.961597+0000","last_fullsized":"2024-09-10T22:26:05.961597+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:19.099039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:19.099039+0000","last_clean_scrub_stamp":"2024-09-10T22:24:19.099039+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:04:37.103581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":582,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,0],"acting":[4,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.d","version":"75'7","reported_seq":29,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T22:26:06.365151+0000","last_change":"2024-09-10T22:24:22.142335+0000","last_active":"2024-09-10T22:26:06.365151+0000","last_peered":"2024-09-10T22:26:06.365151+0000","last_clean":"2024-09-10T22:26:06.365151+0000","last_became_active":"2024-09-10T22:24:22.142001+0000","last_became_peered":"2024-09-10T22:24:22.142001+0000","last_unstale":"2024-09-10T22:26:06.365151+0000","last_undegraded":"2024-09-10T22:26:06.365151+0000","last_fullsized":"2024-09-10T22:26:06.365151+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_clean_scrub_stamp":"2024-09-10T22:24:21.113844+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:46:20.043915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"19'92","reported_seq":100,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T22:26:06.365521+0000","last_change":"2024-09-10T22:23:11.163678+0000","last_active":"2024-09-10T22:26:06.365521+0000","last_peered":"2024-09-10T22:26:06.365521+0000","last_clean":"2024-09-10T22:26:06.365521+0000","last_became_active":"2024-09-10T22:23:11.158387+0000","last_became_peered":"2024-09-10T22:23:11.158387+0000","last_unstale":"2024-09-10T22:26:06.365521+0000","last_undegraded":"2024-09-10T22:26:06.365521+0000","last_fullsized":"2024-09-10T22:26:06.365521+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:19:50.906986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:19:50.906986+0000","last_clean_scrub_stamp":"2024-09-10T22:19:50.906986+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:11:31.570355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"73'3","reported_seq":32,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T22:26:05.950986+0000","last_change":"2024-09-10T22:24:20.123048+0000","last_active":"2024-09-10T22:26:05.950986+0000","last_peered":"2024-09-10T22:26:05.950986+0000","last_clean":"2024-09-10T22:26:05.950986+0000","last_became_active":"2024-09-10T22:24:20.121906+0000","last_became_peered":"2024-09-10T22:24:20.121906+0000","last_unstale":"2024-09-10T22:26:05.950986+0000","last_undegraded":"2024-09-10T22:26:05.950986+0000","last_fullsized":"2024-09-10T22:26:05.950986+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:19.099039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:19.099039+0000","last_clean_scrub_stamp":"2024-09-10T22:24:19.099039+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:11:00.293820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"75'8","reported_seq":30,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T22:26:05.957409+0000","last_change":"2024-09-10T22:24:22.146378+0000","last_active":"2024-09-10T22:26:05.957409+0000","last_peered":"2024-09-10T22:26:05.957409+0000","last_clean":"2024-09-10T22:26:05.957409+0000","last_became_active":"2024-09-10T22:24:22.145841+0000","last_became_peered":"2024-09-10T22:24:22.145841+0000","last_unstale":"2024-09-10T22:26:05.957409+0000","last_undegraded":"2024-09-10T22:26:05.957409+0000","last_fullsized":"2024-09-10T22:26:05.957409+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_clean_scrub_stamp":"2024-09-10T22:24:21.113844+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:20:31.785243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"73'3","reported_seq":41,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T22:26:06.365469+0000","last_change":"2024-09-10T22:25:05.640672+0000","last_active":"2024-09-10T22:26:06.365469+0000","last_peered":"2024-09-10T22:26:06.365469+0000","last_clean":"2024-09-10T22:26:06.365469+0000","last_became_active":"2024-09-10T22:25:05.637774+0000","last_became_peered":"2024-09-10T22:25:05.637774+0000","last_unstale":"2024-09-10T22:26:06.365469+0000","last_undegraded":"2024-09-10T22:26:06.365469+0000","last_fullsized":"2024-09-10T22:26:06.365469+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:19.099039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:19.099039+0000","last_clean_scrub_stamp":"2024-09-10T22:24:19.099039+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:33:20.970862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,4],"acting":[7,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"75'5","reported_seq":27,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T22:26:06.350989+0000","last_change":"2024-09-10T22:24:22.139850+0000","last_active":"2024-09-10T22:26:06.350989+0000","last_peered":"2024-09-10T22:26:06.350989+0000","last_clean":"2024-09-10T22:26:06.350989+0000","last_became_active":"2024-09-10T22:24:22.137885+0000","last_became_peered":"2024-09-10T22:24:22.137885+0000","last_unstale":"2024-09-10T22:26:06.350989+0000","last_undegraded":"2024-09-10T22:26:06.350989+0000","last_fullsized":"2024-09-10T22:26:06.350989+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_clean_scrub_stamp":"2024-09-10T22:24:21.113844+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:52:55.988247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"75'5","reported_seq":130,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T22:26:08.389562+0000","last_change":"2024-09-10T22:24:20.383650+0000","last_active":"2024-09-10T22:26:08.389562+0000","last_peered":"2024-09-10T22:26:08.389562+0000","last_clean":"2024-09-10T22:26:08.389562+0000","last_became_active":"2024-09-10T22:24:20.383286+0000","last_became_peered":"2024-09-10T22:24:20.383286+0000","last_unstale":"2024-09-10T22:26:08.389562+0000","last_undegraded":"2024-09-10T22:26:08.389562+0000","last_fullsized":"2024-09-10T22:26:08.389562+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:19.099039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:19.099039+0000","last_clean_scrub_stamp":"2024-09-10T22:24:19.099039+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:38:04.467105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":98,"num_read_kb":98,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"75'8","reported_seq":30,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T22:26:05.951282+0000","last_change":"2024-09-10T22:24:22.141717+0000","last_active":"2024-09-10T22:26:05.951282+0000","last_peered":"2024-09-10T22:26:05.951282+0000","last_clean":"2024-09-10T22:26:05.951282+0000","last_became_active":"2024-09-10T22:24:22.141426+0000","last_became_peered":"2024-09-10T22:24:22.141426+0000","last_unstale":"2024-09-10T22:26:05.951282+0000","last_undegraded":"2024-09-10T22:26:05.951282+0000","last_fullsized":"2024-09-10T22:26:05.951282+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_clean_scrub_stamp":"2024-09-10T22:24:21.113844+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:13:58.341345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"73'1","reported_seq":28,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T22:26:06.365602+0000","last_change":"2024-09-10T22:24:20.127658+0000","last_active":"2024-09-10T22:26:06.365602+0000","last_peered":"2024-09-10T22:26:06.365602+0000","last_clean":"2024-09-10T22:26:06.365602+0000","last_became_active":"2024-09-10T22:24:20.127366+0000","last_became_peered":"2024-09-10T22:24:20.127366+0000","last_unstale":"2024-09-10T22:26:06.365602+0000","last_undegraded":"2024-09-10T22:26:06.365602+0000","last_fullsized":"2024-09-10T22:26:06.365602+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:19.099039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:19.099039+0000","last_clean_scrub_stamp":"2024-09-10T22:24:19.099039+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:36:05.439417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"75'7","reported_seq":29,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T22:26:05.955653+0000","last_change":"2024-09-10T22:24:22.144799+0000","last_active":"2024-09-10T22:26:05.955653+0000","last_peered":"2024-09-10T22:26:05.955653+0000","last_clean":"2024-09-10T22:26:05.955653+0000","last_became_active":"2024-09-10T22:24:22.144543+0000","last_became_peered":"2024-09-10T22:24:22.144543+0000","last_unstale":"2024-09-10T22:26:05.955653+0000","last_undegraded":"2024-09-10T22:26:05.955653+0000","last_fullsized":"2024-09-10T22:26:05.955653+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_clean_scrub_stamp":"2024-09-10T22:24:21.113844+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:45:46.193108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":27,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T22:26:05.952481+0000","last_change":"2024-09-10T22:24:20.383345+0000","last_active":"2024-09-10T22:26:05.952481+0000","last_peered":"2024-09-10T22:26:05.952481+0000","last_clean":"2024-09-10T22:26:05.952481+0000","last_became_active":"2024-09-10T22:24:20.383023+0000","last_became_peered":"2024-09-10T22:24:20.383023+0000","last_unstale":"2024-09-10T22:26:05.952481+0000","last_undegraded":"2024-09-10T22:26:05.952481+0000","last_fullsized":"2024-09-10T22:26:05.952481+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:19.099039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:19.099039+0000","last_clean_scrub_stamp":"2024-09-10T22:24:19.099039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:27:31.771060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"75'5","reported_seq":27,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T22:26:05.955762+0000","last_change":"2024-09-10T22:24:22.143130+0000","last_active":"2024-09-10T22:26:05.955762+0000","last_peered":"2024-09-10T22:26:05.955762+0000","last_clean":"2024-09-10T22:26:05.955762+0000","last_became_active":"2024-09-10T22:24:22.142664+0000","last_became_peered":"2024-09-10T22:24:22.142664+0000","last_unstale":"2024-09-10T22:26:05.955762+0000","last_undegraded":"2024-09-10T22:26:05.955762+0000","last_fullsized":"2024-09-10T22:26:05.955762+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_clean_scrub_stamp":"2024-09-10T22:24:21.113844+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:49:53.325307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"73'1","reported_seq":29,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T22:26:06.594852+0000","last_change":"2024-09-10T22:24:20.383795+0000","last_active":"2024-09-10T22:26:06.594852+0000","last_peered":"2024-09-10T22:26:06.594852+0000","last_clean":"2024-09-10T22:26:06.594852+0000","last_became_active":"2024-09-10T22:24:20.383418+0000","last_became_peered":"2024-09-10T22:24:20.383418+0000","last_unstale":"2024-09-10T22:26:06.594852+0000","last_undegraded":"2024-09-10T22:26:06.594852+0000","last_fullsized":"2024-09-10T22:26:06.594852+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:19.099039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:19.099039+0000","last_clean_scrub_stamp":"2024-09-10T22:24:19.099039+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:52:26.602544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"75'9","reported_seq":31,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T22:26:06.351153+0000","last_change":"2024-09-10T22:24:22.139416+0000","last_active":"2024-09-10T22:26:06.351153+0000","last_peered":"2024-09-10T22:26:06.351153+0000","last_clean":"2024-09-10T22:26:06.351153+0000","last_became_active":"2024-09-10T22:24:22.138648+0000","last_became_peered":"2024-09-10T22:24:22.138648+0000","last_unstale":"2024-09-10T22:26:06.351153+0000","last_undegraded":"2024-09-10T22:26:06.351153+0000","last_fullsized":"2024-09-10T22:26:06.351153+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_clean_scrub_stamp":"2024-09-10T22:24:21.113844+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:12:20.064134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"77'12","reported_seq":39,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T22:26:05.952761+0000","last_change":"2024-09-10T22:24:20.124001+0000","last_active":"2024-09-10T22:26:05.952761+0000","last_peered":"2024-09-10T22:26:05.952761+0000","last_clean":"2024-09-10T22:26:05.952761+0000","last_became_active":"2024-09-10T22:24:20.123616+0000","last_became_peered":"2024-09-10T22:24:20.123616+0000","last_unstale":"2024-09-10T22:26:05.952761+0000","last_undegraded":"2024-09-10T22:26:05.952761+0000","last_fullsized":"2024-09-10T22:26:05.952761+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:19.099039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:19.099039+0000","last_clean_scrub_stamp":"2024-09-10T22:24:19.099039+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:12:47.003561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"75'5","reported_seq":27,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T22:26:05.957528+0000","last_change":"2024-09-10T22:24:22.146936+0000","last_active":"2024-09-10T22:26:05.957528+0000","last_peered":"2024-09-10T22:26:05.957528+0000","last_clean":"2024-09-10T22:26:05.957528+0000","last_became_active":"2024-09-10T22:24:22.146578+0000","last_became_peered":"2024-09-10T22:24:22.146578+0000","last_unstale":"2024-09-10T22:26:05.957528+0000","last_undegraded":"2024-09-10T22:26:05.957528+0000","last_fullsized":"2024-09-10T22:26:05.957528+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_clean_scrub_stamp":"2024-09-10T22:24:21.113844+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:44:20.229747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"73'4","reported_seq":31,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T22:26:05.951333+0000","last_change":"2024-09-10T22:24:20.406642+0000","last_active":"2024-09-10T22:26:05.951333+0000","last_peered":"2024-09-10T22:26:05.951333+0000","last_clean":"2024-09-10T22:26:05.951333+0000","last_became_active":"2024-09-10T22:24:20.406288+0000","last_became_peered":"2024-09-10T22:24:20.406288+0000","last_unstale":"2024-09-10T22:26:05.951333+0000","last_undegraded":"2024-09-10T22:26:05.951333+0000","last_fullsized":"2024-09-10T22:26:05.951333+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:19.099039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:19.099039+0000","last_clean_scrub_stamp":"2024-09-10T22:24:19.099039+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:10:48.558751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"75'7","reported_seq":29,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T22:26:05.954742+0000","last_change":"2024-09-10T22:24:22.142511+0000","last_active":"2024-09-10T22:26:05.954742+0000","last_peered":"2024-09-10T22:26:05.954742+0000","last_clean":"2024-09-10T22:26:05.954742+0000","last_became_active":"2024-09-10T22:24:22.142200+0000","last_became_peered":"2024-09-10T22:24:22.142200+0000","last_unstale":"2024-09-10T22:26:05.954742+0000","last_undegraded":"2024-09-10T22:26:05.954742+0000","last_fullsized":"2024-09-10T22:26:05.954742+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_clean_scrub_stamp":"2024-09-10T22:24:21.113844+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:09:46.928679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"73'2","reported_seq":29,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T22:26:06.575841+0000","last_change":"2024-09-10T22:24:20.383403+0000","last_active":"2024-09-10T22:26:06.575841+0000","last_peered":"2024-09-10T22:26:06.575841+0000","last_clean":"2024-09-10T22:26:06.575841+0000","last_became_active":"2024-09-10T22:24:20.383143+0000","last_became_peered":"2024-09-10T22:24:20.383143+0000","last_unstale":"2024-09-10T22:26:06.575841+0000","last_undegraded":"2024-09-10T22:26:06.575841+0000","last_fullsized":"2024-09-10T22:26:06.575841+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:19.099039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:19.099039+0000","last_clean_scrub_stamp":"2024-09-10T22:24:19.099039+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:54:07.338628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"75'2","reported_seq":24,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T22:26:06.594153+0000","last_change":"2024-09-10T22:24:22.136604+0000","last_active":"2024-09-10T22:26:06.594153+0000","last_peered":"2024-09-10T22:26:06.594153+0000","last_clean":"2024-09-10T22:26:06.594153+0000","last_became_active":"2024-09-10T22:24:22.136298+0000","last_became_peered":"2024-09-10T22:24:22.136298+0000","last_unstale":"2024-09-10T22:26:06.594153+0000","last_undegraded":"2024-09-10T22:26:06.594153+0000","last_fullsized":"2024-09-10T22:26:06.594153+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_clean_scrub_stamp":"2024-09-10T22:24:21.113844+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:39:11.777729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"73'3","reported_seq":30,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T22:26:05.957274+0000","last_change":"2024-09-10T22:24:20.124911+0000","last_active":"2024-09-10T22:26:05.957274+0000","last_peered":"2024-09-10T22:26:05.957274+0000","last_clean":"2024-09-10T22:26:05.957274+0000","last_became_active":"2024-09-10T22:24:20.124152+0000","last_became_peered":"2024-09-10T22:24:20.124152+0000","last_unstale":"2024-09-10T22:26:05.957274+0000","last_undegraded":"2024-09-10T22:26:05.957274+0000","last_fullsized":"2024-09-10T22:26:05.957274+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:19.099039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:19.099039+0000","last_clean_scrub_stamp":"2024-09-10T22:24:19.099039+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:32:30.837104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"75'9","reported_seq":31,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T22:26:05.953318+0000","last_change":"2024-09-10T22:24:22.138080+0000","last_active":"2024-09-10T22:26:05.953318+0000","last_peered":"2024-09-10T22:26:05.953318+0000","last_clean":"2024-09-10T22:26:05.953318+0000","last_became_active":"2024-09-10T22:24:22.137775+0000","last_became_peered":"2024-09-10T22:24:22.137775+0000","last_unstale":"2024-09-10T22:26:05.953318+0000","last_undegraded":"2024-09-10T22:26:05.953318+0000","last_fullsized":"2024-09-10T22:26:05.953318+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_clean_scrub_stamp":"2024-09-10T22:24:21.113844+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:10:48.320495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"73'1","reported_seq":28,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T22:26:05.953923+0000","last_change":"2024-09-10T22:24:20.125551+0000","last_active":"2024-09-10T22:26:05.953923+0000","last_peered":"2024-09-10T22:26:05.953923+0000","last_clean":"2024-09-10T22:26:05.953923+0000","last_became_active":"2024-09-10T22:24:20.125064+0000","last_became_peered":"2024-09-10T22:24:20.125064+0000","last_unstale":"2024-09-10T22:26:05.953923+0000","last_undegraded":"2024-09-10T22:26:05.953923+0000","last_fullsized":"2024-09-10T22:26:05.953923+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:19.099039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:19.099039+0000","last_clean_scrub_stamp":"2024-09-10T22:24:19.099039+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:29:48.598158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"75'8","reported_seq":30,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T22:26:05.957263+0000","last_change":"2024-09-10T22:24:22.142894+0000","last_active":"2024-09-10T22:26:05.957263+0000","last_peered":"2024-09-10T22:26:05.957263+0000","last_clean":"2024-09-10T22:26:05.957263+0000","last_became_active":"2024-09-10T22:24:22.142554+0000","last_became_peered":"2024-09-10T22:24:22.142554+0000","last_unstale":"2024-09-10T22:26:05.957263+0000","last_undegraded":"2024-09-10T22:26:05.957263+0000","last_fullsized":"2024-09-10T22:26:05.957263+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_clean_scrub_stamp":"2024-09-10T22:24:21.113844+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:11:11.457622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"73'4","reported_seq":32,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T22:26:06.594771+0000","last_change":"2024-09-10T22:24:20.128212+0000","last_active":"2024-09-10T22:26:06.594771+0000","last_peered":"2024-09-10T22:26:06.594771+0000","last_clean":"2024-09-10T22:26:06.594771+0000","last_became_active":"2024-09-10T22:24:20.127597+0000","last_became_peered":"2024-09-10T22:24:20.127597+0000","last_unstale":"2024-09-10T22:26:06.594771+0000","last_undegraded":"2024-09-10T22:26:06.594771+0000","last_fullsized":"2024-09-10T22:26:06.594771+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:19.099039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:19.099039+0000","last_clean_scrub_stamp":"2024-09-10T22:24:19.099039+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:48:28.543222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"75'5","reported_seq":27,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T22:26:06.365441+0000","last_change":"2024-09-10T22:24:22.144321+0000","last_active":"2024-09-10T22:26:06.365441+0000","last_peered":"2024-09-10T22:26:06.365441+0000","last_clean":"2024-09-10T22:26:06.365441+0000","last_became_active":"2024-09-10T22:24:22.144037+0000","last_became_peered":"2024-09-10T22:24:22.144037+0000","last_unstale":"2024-09-10T22:26:06.365441+0000","last_undegraded":"2024-09-10T22:26:06.365441+0000","last_fullsized":"2024-09-10T22:26:06.365441+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_clean_scrub_stamp":"2024-09-10T22:24:21.113844+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:28:00.600758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"75'15","reported_seq":37,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T22:26:05.951547+0000","last_change":"2024-09-10T22:24:22.145574+0000","last_active":"2024-09-10T22:26:05.951547+0000","last_peered":"2024-09-10T22:26:05.951547+0000","last_clean":"2024-09-10T22:26:05.951547+0000","last_became_active":"2024-09-10T22:24:22.144425+0000","last_became_peered":"2024-09-10T22:24:22.144425+0000","last_unstale":"2024-09-10T22:26:05.951547+0000","last_undegraded":"2024-09-10T22:26:05.951547+0000","last_fullsized":"2024-09-10T22:26:05.951547+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_clean_scrub_stamp":"2024-09-10T22:24:21.113844+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:41:10.177782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"73'2","reported_seq":29,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T22:26:06.594742+0000","last_change":"2024-09-10T22:24:20.124627+0000","last_active":"2024-09-10T22:26:06.594742+0000","last_peered":"2024-09-10T22:26:06.594742+0000","last_clean":"2024-09-10T22:26:06.594742+0000","last_became_active":"2024-09-10T22:24:20.124174+0000","last_became_peered":"2024-09-10T22:24:20.124174+0000","last_unstale":"2024-09-10T22:26:06.594742+0000","last_undegraded":"2024-09-10T22:26:06.594742+0000","last_fullsized":"2024-09-10T22:26:06.594742+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:19.099039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:19.099039+0000","last_clean_scrub_stamp":"2024-09-10T22:24:19.099039+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:35:26.871316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"75'9","reported_seq":31,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T22:26:06.575513+0000","last_change":"2024-09-10T22:24:22.142531+0000","last_active":"2024-09-10T22:26:06.575513+0000","last_peered":"2024-09-10T22:26:06.575513+0000","last_clean":"2024-09-10T22:26:06.575513+0000","last_became_active":"2024-09-10T22:24:22.142240+0000","last_became_peered":"2024-09-10T22:24:22.142240+0000","last_unstale":"2024-09-10T22:26:06.575513+0000","last_undegraded":"2024-09-10T22:26:06.575513+0000","last_fullsized":"2024-09-10T22:26:06.575513+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_clean_scrub_stamp":"2024-09-10T22:24:21.113844+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:30:56.868586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"73'4","reported_seq":44,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T22:26:06.594840+0000","last_change":"2024-09-10T22:25:05.644160+0000","last_active":"2024-09-10T22:26:06.594840+0000","last_peered":"2024-09-10T22:26:06.594840+0000","last_clean":"2024-09-10T22:26:06.594840+0000","last_became_active":"2024-09-10T22:25:05.638026+0000","last_became_peered":"2024-09-10T22:25:05.638026+0000","last_unstale":"2024-09-10T22:26:06.594840+0000","last_undegraded":"2024-09-10T22:26:06.594840+0000","last_fullsized":"2024-09-10T22:26:06.594840+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:19.099039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:19.099039+0000","last_clean_scrub_stamp":"2024-09-10T22:24:19.099039+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:58:18.112018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":10,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,4,7],"acting":[8,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"75'6","reported_seq":28,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T22:26:05.954730+0000","last_change":"2024-09-10T22:24:22.141121+0000","last_active":"2024-09-10T22:26:05.954730+0000","last_peered":"2024-09-10T22:26:05.954730+0000","last_clean":"2024-09-10T22:26:05.954730+0000","last_became_active":"2024-09-10T22:24:22.140490+0000","last_became_peered":"2024-09-10T22:24:22.140490+0000","last_unstale":"2024-09-10T22:26:05.954730+0000","last_undegraded":"2024-09-10T22:26:05.954730+0000","last_fullsized":"2024-09-10T22:26:05.954730+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_clean_scrub_stamp":"2024-09-10T22:24:21.113844+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:52:22.840740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"73'2","reported_seq":29,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T22:26:05.957592+0000","last_change":"2024-09-10T22:24:20.385053+0000","last_active":"2024-09-10T22:26:05.957592+0000","last_peered":"2024-09-10T22:26:05.957592+0000","last_clean":"2024-09-10T22:26:05.957592+0000","last_became_active":"2024-09-10T22:24:20.384432+0000","last_became_peered":"2024-09-10T22:24:20.384432+0000","last_unstale":"2024-09-10T22:26:05.957592+0000","last_undegraded":"2024-09-10T22:26:05.957592+0000","last_fullsized":"2024-09-10T22:26:05.957592+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:19.099039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:19.099039+0000","last_clean_scrub_stamp":"2024-09-10T22:24:19.099039+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:18:15.685331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"75'5","reported_seq":27,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T22:26:05.957488+0000","last_change":"2024-09-10T22:24:22.143884+0000","last_active":"2024-09-10T22:26:05.957488+0000","last_peered":"2024-09-10T22:26:05.957488+0000","last_clean":"2024-09-10T22:26:05.957488+0000","last_became_active":"2024-09-10T22:24:22.143446+0000","last_became_peered":"2024-09-10T22:24:22.143446+0000","last_unstale":"2024-09-10T22:26:05.957488+0000","last_undegraded":"2024-09-10T22:26:05.957488+0000","last_fullsized":"2024-09-10T22:26:05.957488+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:21.113844+0000","last_clean_scrub_stamp":"2024-09-10T22:24:21.113844+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:28:32.453668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"73'9","reported_seq":54,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-10T22:26:05.952794+0000","last_change":"2024-09-10T22:25:05.528200+0000","last_active":"2024-09-10T22:26:05.952794+0000","last_peered":"2024-09-10T22:26:05.952794+0000","last_clean":"2024-09-10T22:26:05.952794+0000","last_became_active":"2024-09-10T22:25:05.520346+0000","last_became_peered":"2024-09-10T22:25:05.520346+0000","last_unstale":"2024-09-10T22:26:05.952794+0000","last_undegraded":"2024-09-10T22:26:05.952794+0000","last_fullsized":"2024-09-10T22:26:05.952794+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:24:19.099039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:24:19.099039+0000","last_clean_scrub_stamp":"2024-09-10T22:24:19.099039+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:38:21.050372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":582,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,11,8],"acting":[9,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":502,"ondisk_log_size":502,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":64769,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":615,"num_read_kb":373,"num_write":173,"num_write_kb":118,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":14,"num_bytes_recovered":1324,"num_keys_recovered":10,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":417792,"data_stored":194307,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":147,"ondisk_log_size":147,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4751360,"data_stored":4722944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":92,"ondisk_log_size":92,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":67,"seq":287762808867,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27872,"kb_used_data":840,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717280,"statfs":{"total":95995035648,"available":95966494720,"internally_reserved":0,"allocated":860160,"data_stored":414872,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":10,"up_from":62,"seq":266287972392,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36860,"kb_used_data":1512,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708292,"statfs":{"total":95995035648,"available":95957291008,"internally_reserved":0,"allocated":1548288,"data_stored":1066552,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":36174272},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":57,"seq":244813135916,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27876,"kb_used_data":848,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717276,"statfs":{"total":95995035648,"available":95966490624,"internally_reserved":0,"allocated":868352,"data_stored":414456,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,5,6,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":51,"seq":219043332145,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27880,"kb_used_data":848,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717272,"statfs":{"total":95995035648,"available":95966486528,"internally_reserved":0,"allocated":868352,"data_stored":414376,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":7,"up_from":46,"seq":197568495671,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36772,"kb_used_data":1424,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708380,"statfs":{"total":95995035648,"available":95957381120,"internally_reserved":0,"allocated":1458176,"data_stored":1006173,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":36174282},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":40,"seq":171798691900,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27864,"kb_used_data":836,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717288,"statfs":{"total":95995035648,"available":95966502912,"internally_reserved":0,"allocated":856064,"data_stored":413845,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":34,"seq":146028888128,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28460,"kb_used_data":1432,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716692,"statfs":{"total":95995035648,"available":95965892608,"internally_reserved":0,"allocated":1466368,"data_stored":1005747,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":29,"seq":124554051653,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27876,"kb_used_data":844,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717276,"statfs":{"total":95995035648,"available":95966490624,"internally_reserved":0,"allocated":864256,"data_stored":415396,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":23,"seq":98784247882,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27884,"kb_used_data":852,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717268,"statfs":{"total":95995035648,"available":95966482432,"internally_reserved":0,"allocated":872448,"data_stored":414156,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444113,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36260,"kb_used_data":916,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708892,"statfs":{"total":95995035648,"available":95957905408,"internally_reserved":0,"allocated":937984,"data_stored":475033,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":12,"seq":51539607637,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36244,"kb_used_data":900,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708908,"statfs":{"total":95995035648,"available":95957921792,"internally_reserved":0,"allocated":921600,"data_stored":474047,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738459,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36208,"kb_used_data":856,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708944,"statfs":{"total":95995035648,"available":95957958656,"internally_reserved":0,"allocated":876544,"data_stored":415116,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":60409,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":61395,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1758,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1624,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":2050,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":62429,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-10T22:26:13.089 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 22997a4c-6fc2-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-10T22:26:13.381 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/22997a4c-6fc2-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T22:26:13.856 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:13.854+0000 7f232ce4d640 1 -- 172.21.15.19:0/3508481524 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2328104600 msgr2=0x7f232810caf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:26:13.856 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:13.854+0000 7f232ce4d640 1 --2- 172.21.15.19:0/3508481524 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2328104600 0x7f232810caf0 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f2310009900 tx=0x7f231002a440 comp rx=0 tx=0).stop 2024-09-10T22:26:13.857 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:13.854+0000 7f232ce4d640 1 -- 172.21.15.19:0/3508481524 shutdown_connections 2024-09-10T22:26:13.857 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:13.854+0000 7f232ce4d640 1 --2- 172.21.15.19:0/3508481524 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f232810d140 0x7f232810f5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:26:13.857 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:13.854+0000 7f232ce4d640 1 --2- 172.21.15.19:0/3508481524 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2328104600 0x7f232810caf0 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:26:13.857 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:13.854+0000 7f232ce4d640 1 --2- 172.21.15.19:0/3508481524 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f2328103ce0 0x7f23281040c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:26:13.857 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:13.854+0000 7f232ce4d640 1 -- 172.21.15.19:0/3508481524 >> 172.21.15.19:0/3508481524 conn(0x7f23280fd700 msgr2=0x7f23280ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:26:13.857 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:13.854+0000 7f232ce4d640 1 -- 172.21.15.19:0/3508481524 shutdown_connections 2024-09-10T22:26:13.857 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:13.854+0000 7f232ce4d640 1 -- 172.21.15.19:0/3508481524 wait complete. 2024-09-10T22:26:13.859 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:13.855+0000 7f232ce4d640 1 Processor -- start 2024-09-10T22:26:13.859 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:13.855+0000 7f232ce4d640 1 -- start start 2024-09-10T22:26:13.859 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:13.855+0000 7f232ce4d640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2328103ce0 0x7f23281994a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:26:13.859 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:13.855+0000 7f232ce4d640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f2328104600 0x7f23281999e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:26:13.859 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:13.855+0000 7f232ce4d640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f232810d140 0x7f232819ed80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:26:13.859 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:13.855+0000 7f232ce4d640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f2328112eb0 con 0x7f2328103ce0 2024-09-10T22:26:13.859 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:13.855+0000 7f232ce4d640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f2328112d30 con 0x7f232810d140 2024-09-10T22:26:13.859 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:13.855+0000 7f232ce4d640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f2328113030 con 0x7f2328104600 2024-09-10T22:26:13.859 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:13.855+0000 7f232659c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2328103ce0 0x7f23281994a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:26:13.859 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:13.855+0000 7f232659c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2328103ce0 0x7f23281994a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:46310/0 (socket says 172.21.15.19:46310) 2024-09-10T22:26:13.859 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:13.855+0000 7f232659c640 1 -- 172.21.15.19:0/3564630521 learned_addr learned my addr 172.21.15.19:0/3564630521 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:26:13.860 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:13.855+0000 7f231ffff640 1 --2- 172.21.15.19:0/3564630521 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f2328104600 0x7f23281999e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:26:13.860 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:13.856+0000 7f2326d9d640 1 --2- 172.21.15.19:0/3564630521 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f232810d140 0x7f232819ed80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:26:13.860 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:13.856+0000 7f232659c640 1 -- 172.21.15.19:0/3564630521 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f2328104600 msgr2=0x7f23281999e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:26:13.860 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:13.856+0000 7f232659c640 1 --2- 172.21.15.19:0/3564630521 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f2328104600 0x7f23281999e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:26:13.860 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:13.856+0000 7f232659c640 1 -- 172.21.15.19:0/3564630521 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f232810d140 msgr2=0x7f232819ed80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:26:13.860 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:13.856+0000 7f232659c640 1 --2- 172.21.15.19:0/3564630521 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f232810d140 0x7f232819ed80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:26:13.860 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:13.856+0000 7f232659c640 1 -- 172.21.15.19:0/3564630521 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f232819f550 con 0x7f2328103ce0 2024-09-10T22:26:13.860 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:13.856+0000 7f232659c640 1 --2- 172.21.15.19:0/3564630521 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2328103ce0 0x7f23281994a0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f231800b450 tx=0x7f231800b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:26:13.860 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:13.856+0000 7f231f7fe640 1 -- 172.21.15.19:0/3564630521 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2318015020 con 0x7f2328103ce0 2024-09-10T22:26:13.860 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:13.856+0000 7f231f7fe640 1 -- 172.21.15.19:0/3564630521 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2318011d40 con 0x7f2328103ce0 2024-09-10T22:26:13.860 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:13.856+0000 7f232ce4d640 1 -- 172.21.15.19:0/3564630521 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f232819f840 con 0x7f2328103ce0 2024-09-10T22:26:13.860 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:13.856+0000 7f232ce4d640 1 -- 172.21.15.19:0/3564630521 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f23281a60d0 con 0x7f2328103ce0 2024-09-10T22:26:13.860 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:13.856+0000 7f231f7fe640 1 -- 172.21.15.19:0/3564630521 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f231800f340 con 0x7f2328103ce0 2024-09-10T22:26:13.861 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:13.857+0000 7f232ce4d640 1 -- 172.21.15.19:0/3564630521 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2328104140 con 0x7f2328103ce0 2024-09-10T22:26:13.861 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:13.859+0000 7f231f7fe640 1 -- 172.21.15.19:0/3564630521 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 18) ==== 153250+0+0 (secure 0 0 0) 0x7f2318011890 con 0x7f2328103ce0 2024-09-10T22:26:13.862 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:13.860+0000 7f231f7fe640 1 --2- 172.21.15.19:0/3564630521 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f23140b5360 0x7f23140b7820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:26:13.862 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:13.860+0000 7f231ffff640 1 --2- 172.21.15.19:0/3564630521 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f23140b5360 0x7f23140b7820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:26:13.863 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:13.860+0000 7f231f7fe640 1 -- 172.21.15.19:0/3564630521 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8327+0+0 (secure 0 0 0) 0x7f23180e5c30 con 0x7f2328103ce0 2024-09-10T22:26:13.863 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:13.861+0000 7f231ffff640 1 --2- 172.21.15.19:0/3564630521 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f23140b5360 0x7f23140b7820 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f2310009230 tx=0x7f23100058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:26:13.865 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:13.863+0000 7f231f7fe640 1 -- 172.21.15.19:0/3564630521 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f231801f020 con 0x7f2328103ce0 2024-09-10T22:26:14.086 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:14.084+0000 7f232ce4d640 1 -- 172.21.15.19:0/3564630521 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f232819a5d0 con 0x7f2328103ce0 2024-09-10T22:26:14.087 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:26:13 smithi019 ceph-mon[31375]: from='client.15315 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-10T22:26:14.087 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:26:13 smithi019 ceph-mon[31375]: pgmap v341: 97 pgs: 97 active+clean; 640 KiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 1.1 KiB/s wr, 9 op/s; 81 B/s, 0 objects/s recovering 2024-09-10T22:26:14.087 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:26:13 smithi019 ceph-mon[31375]: from='client.15321 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-10T22:26:14.087 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:26:13 smithi019 ceph-mon[31375]: from='client.15327 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-10T22:26:14.087 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:14.085+0000 7f231f7fe640 1 -- 172.21.15.19:0/3564630521 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) ==== 94+0+11921 (secure 0 0 0) 0x7f232819a5d0 con 0x7f2328103ce0 2024-09-10T22:26:14.088 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-10T22:26:14.088 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":25,"btime":"2024-09-10T22:26:08:965324+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14673,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6835/1835804747","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6834","nonce":1835804747},{"type":"v1","addr":"172.21.15.19:6835","nonce":1835804747}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14685,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6837/1750470490","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6836","nonce":1750470490},{"type":"v1","addr":"172.21.15.19:6837","nonce":1750470490}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14733,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6839/2642941149","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6838","nonce":2642941149},{"type":"v1","addr":"172.21.15.19:6839","nonce":2642941149}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14745,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6841/2449948682","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6840","nonce":2449948682},{"type":"v1","addr":"172.21.15.19:6841","nonce":2449948682}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24511,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.138:6833/2524811494","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6832","nonce":2524811494},{"type":"v1","addr":"172.21.15.138:6833","nonce":2524811494}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24512,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6833/3014993624","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6832","nonce":3014993624},{"type":"v1","addr":"172.21.15.135:6833","nonce":3014993624}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":25,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-10T22:24:22.733925+0000","modified":"2024-09-10T22:26:08.602673+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24581,"mds_1":24568,"mds_2":24553},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24527":{"gid":24527,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.135:6835/3715773348","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6834","nonce":3715773348},{"type":"v1","addr":"172.21.15.135:6835","nonce":3715773348}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24541":{"gid":24541,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.138:6835/933547028","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6834","nonce":933547028},{"type":"v1","addr":"172.21.15.138:6835","nonce":933547028}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24551":{"gid":24551,"name":"h","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.135:6837/3495029135","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6836","nonce":3495029135},{"type":"v1","addr":"172.21.15.135:6837","nonce":3495029135}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24553":{"gid":24553,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":10,"addr":"172.21.15.138:6837/3353290042","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6836","nonce":3353290042},{"type":"v1","addr":"172.21.15.138:6837","nonce":3353290042}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24568":{"gid":24568,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.138:6839/383637208","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6838","nonce":383637208},{"type":"v1","addr":"172.21.15.138:6839","nonce":383637208}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24581":{"gid":24581,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.135:6839/1254769802","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6838","nonce":1254769802},{"type":"v1","addr":"172.21.15.135:6839","nonce":1254769802}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24581,"qdb_cluster":[24581,24568,24553]},"id":1}]} 2024-09-10T22:26:14.088 INFO:teuthology.orchestra.run.smithi019.stderr:dumped fsmap epoch 25 2024-09-10T22:26:14.089 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:14.087+0000 7f232ce4d640 1 -- 172.21.15.19:0/3564630521 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f23140b5360 msgr2=0x7f23140b7820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:26:14.089 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:14.087+0000 7f232ce4d640 1 --2- 172.21.15.19:0/3564630521 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f23140b5360 0x7f23140b7820 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f2310009230 tx=0x7f23100058d0 comp rx=0 tx=0).stop 2024-09-10T22:26:14.090 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:14.087+0000 7f232ce4d640 1 -- 172.21.15.19:0/3564630521 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2328103ce0 msgr2=0x7f23281994a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:26:14.090 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:14.087+0000 7f232ce4d640 1 --2- 172.21.15.19:0/3564630521 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2328103ce0 0x7f23281994a0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f231800b450 tx=0x7f231800b910 comp rx=0 tx=0).stop 2024-09-10T22:26:14.090 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:14.087+0000 7f232ce4d640 1 -- 172.21.15.19:0/3564630521 shutdown_connections 2024-09-10T22:26:14.090 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:14.087+0000 7f232ce4d640 1 --2- 172.21.15.19:0/3564630521 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f23140b5360 0x7f23140b7820 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:26:14.090 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:14.087+0000 7f232ce4d640 1 --2- 172.21.15.19:0/3564630521 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f232810d140 0x7f232819ed80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:26:14.090 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:14.087+0000 7f232ce4d640 1 --2- 172.21.15.19:0/3564630521 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f2328104600 0x7f23281999e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:26:14.090 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:14.087+0000 7f232ce4d640 1 --2- 172.21.15.19:0/3564630521 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2328103ce0 0x7f23281994a0 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:26:14.090 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:14.087+0000 7f232ce4d640 1 -- 172.21.15.19:0/3564630521 >> 172.21.15.19:0/3564630521 conn(0x7f23280fd700 msgr2=0x7f23280fe400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:26:14.090 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:14.087+0000 7f232ce4d640 1 -- 172.21.15.19:0/3564630521 shutdown_connections 2024-09-10T22:26:14.090 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:14.087+0000 7f232ce4d640 1 -- 172.21.15.19:0/3564630521 wait complete. 2024-09-10T22:26:14.359 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:26:13 smithi135 ceph-mon[34789]: from='client.15315 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-10T22:26:14.360 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:26:13 smithi135 ceph-mon[34789]: pgmap v341: 97 pgs: 97 active+clean; 640 KiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 1.1 KiB/s wr, 9 op/s; 81 B/s, 0 objects/s recovering 2024-09-10T22:26:14.360 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:26:13 smithi135 ceph-mon[34789]: from='client.15321 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-10T22:26:14.360 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:26:13 smithi135 ceph-mon[34789]: from='client.15327 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-10T22:26:14.375 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:26:13 smithi138 ceph-mon[35236]: from='client.15315 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-10T22:26:14.375 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:26:13 smithi138 ceph-mon[35236]: pgmap v341: 97 pgs: 97 active+clean; 640 KiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 1.1 KiB/s wr, 9 op/s; 81 B/s, 0 objects/s recovering 2024-09-10T22:26:14.375 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:26:13 smithi138 ceph-mon[35236]: from='client.15321 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-10T22:26:14.375 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:26:13 smithi138 ceph-mon[35236]: from='client.15327 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-10T22:26:14.930 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 22997a4c-6fc2-11ef-bcea-c7b262605968 -- ceph osd dump --format=json 2024-09-10T22:26:15.197 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/22997a4c-6fc2-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T22:26:15.208 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:26:14 smithi019 ceph-mon[31375]: from='client.? 172.21.15.19:0/3564630521' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T22:26:15.359 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:26:14 smithi135 ceph-mon[34789]: from='client.? 172.21.15.19:0/3564630521' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T22:26:15.375 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:26:14 smithi138 ceph-mon[35236]: from='client.? 172.21.15.19:0/3564630521' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T22:26:15.689 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:15.678+0000 7f35ed60a640 1 -- 172.21.15.19:0/1509452645 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f35e8102dc0 msgr2=0x7f35e81031a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:26:15.689 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:15.678+0000 7f35ed60a640 1 --2- 172.21.15.19:0/1509452645 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f35e8102dc0 0x7f35e81031a0 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f35d8009900 tx=0x7f35d802a410 comp rx=0 tx=0).stop 2024-09-10T22:26:15.689 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:15.678+0000 7f35ed60a640 1 -- 172.21.15.19:0/1509452645 shutdown_connections 2024-09-10T22:26:15.689 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:15.678+0000 7f35ed60a640 1 --2- 172.21.15.19:0/1509452645 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f35e8109150 0x7f35e810f950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:26:15.689 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:15.678+0000 7f35ed60a640 1 --2- 172.21.15.19:0/1509452645 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f35e81087d0 0x7f35e8108c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:26:15.689 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:15.678+0000 7f35ed60a640 1 --2- 172.21.15.19:0/1509452645 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f35e8102dc0 0x7f35e81031a0 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:26:15.689 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:15.678+0000 7f35ed60a640 1 -- 172.21.15.19:0/1509452645 >> 172.21.15.19:0/1509452645 conn(0x7f35e80fe870 msgr2=0x7f35e8100c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:26:15.690 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:15.678+0000 7f35ed60a640 1 -- 172.21.15.19:0/1509452645 shutdown_connections 2024-09-10T22:26:15.690 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:15.678+0000 7f35ed60a640 1 -- 172.21.15.19:0/1509452645 wait complete. 2024-09-10T22:26:15.690 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:15.679+0000 7f35ed60a640 1 Processor -- start 2024-09-10T22:26:15.690 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:15.679+0000 7f35ed60a640 1 -- start start 2024-09-10T22:26:15.690 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:15.679+0000 7f35ed60a640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f35e8102dc0 0x7f35e81992e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:26:15.690 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:15.679+0000 7f35ed60a640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f35e81087d0 0x7f35e8199820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:26:15.690 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:15.679+0000 7f35ed60a640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f35e8109150 0x7f35e819ebc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:26:15.690 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:15.679+0000 7f35ed60a640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f35e8112e10 con 0x7f35e8102dc0 2024-09-10T22:26:15.690 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:15.679+0000 7f35ed60a640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f35e8112c90 con 0x7f35e81087d0 2024-09-10T22:26:15.690 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:15.679+0000 7f35ed60a640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f35e8112f90 con 0x7f35e8109150 2024-09-10T22:26:15.690 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:15.679+0000 7f35e6ffd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f35e8102dc0 0x7f35e81992e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:26:15.690 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:15.679+0000 7f35e6ffd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f35e8102dc0 0x7f35e81992e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:46324/0 (socket says 172.21.15.19:46324) 2024-09-10T22:26:15.690 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:15.679+0000 7f35e6ffd640 1 -- 172.21.15.19:0/1400501800 learned_addr learned my addr 172.21.15.19:0/1400501800 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:26:15.691 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:15.679+0000 7f35dffff640 1 --2- 172.21.15.19:0/1400501800 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f35e81087d0 0x7f35e8199820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:26:15.691 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:15.680+0000 7f35e6ffd640 1 -- 172.21.15.19:0/1400501800 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f35e8109150 msgr2=0x7f35e819ebc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:26:15.691 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:15.679+0000 7f35e77fe640 1 --2- 172.21.15.19:0/1400501800 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f35e8109150 0x7f35e819ebc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:26:15.691 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:15.680+0000 7f35e6ffd640 1 --2- 172.21.15.19:0/1400501800 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f35e8109150 0x7f35e819ebc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:26:15.691 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:15.680+0000 7f35e6ffd640 1 -- 172.21.15.19:0/1400501800 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f35e81087d0 msgr2=0x7f35e8199820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:26:15.691 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:15.680+0000 7f35e6ffd640 1 --2- 172.21.15.19:0/1400501800 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f35e81087d0 0x7f35e8199820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:26:15.691 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:15.680+0000 7f35e6ffd640 1 -- 172.21.15.19:0/1400501800 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f35e819f390 con 0x7f35e8102dc0 2024-09-10T22:26:15.691 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:15.680+0000 7f35e6ffd640 1 --2- 172.21.15.19:0/1400501800 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f35e8102dc0 0x7f35e81992e0 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f35d8006010 tx=0x7f35d80042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:26:15.691 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:15.680+0000 7f35e4ff9640 1 -- 172.21.15.19:0/1400501800 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35d803f030 con 0x7f35e8102dc0 2024-09-10T22:26:15.691 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:15.680+0000 7f35e4ff9640 1 -- 172.21.15.19:0/1400501800 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f35d8003800 con 0x7f35e8102dc0 2024-09-10T22:26:15.691 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:15.680+0000 7f35ed60a640 1 -- 172.21.15.19:0/1400501800 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f35e819f620 con 0x7f35e8102dc0 2024-09-10T22:26:15.691 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:15.680+0000 7f35e4ff9640 1 -- 172.21.15.19:0/1400501800 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35d8035070 con 0x7f35e8102dc0 2024-09-10T22:26:15.691 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:15.680+0000 7f35ed60a640 1 -- 172.21.15.19:0/1400501800 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f35e81a5d40 con 0x7f35e8102dc0 2024-09-10T22:26:15.691 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:15.681+0000 7f35ed60a640 1 -- 172.21.15.19:0/1400501800 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f35e81031a0 con 0x7f35e8102dc0 2024-09-10T22:26:15.691 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:15.683+0000 7f35e4ff9640 1 -- 172.21.15.19:0/1400501800 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 18) ==== 153250+0+0 (secure 0 0 0) 0x7f35d8031b10 con 0x7f35e8102dc0 2024-09-10T22:26:15.692 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:15.684+0000 7f35e4ff9640 1 --2- 172.21.15.19:0/1400501800 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f35d40b5360 0x7f35d40b7820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:26:15.692 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:15.684+0000 7f35dffff640 1 --2- 172.21.15.19:0/1400501800 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f35d40b5360 0x7f35d40b7820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:26:15.692 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:15.684+0000 7f35e4ff9640 1 -- 172.21.15.19:0/1400501800 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8327+0+0 (secure 0 0 0) 0x7f35d81068b0 con 0x7f35e8102dc0 2024-09-10T22:26:15.692 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:15.685+0000 7f35dffff640 1 --2- 172.21.15.19:0/1400501800 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f35d40b5360 0x7f35d40b7820 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f35e8107ec0 tx=0x7f35d000a4c0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:26:15.692 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:15.688+0000 7f35e4ff9640 1 -- 172.21.15.19:0/1400501800 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f35d80cd6b0 con 0x7f35e8102dc0 2024-09-10T22:26:15.879 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:15.876+0000 7f35ed60a640 1 -- 172.21.15.19:0/1400501800 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f35e819a410 con 0x7f35e8102dc0 2024-09-10T22:26:15.880 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:15.878+0000 7f35e4ff9640 1 -- 172.21.15.19:0/1400501800 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v77) ==== 74+0+22854 (secure 0 0 0) 0x7f35e819a410 con 0x7f35e8102dc0 2024-09-10T22:26:15.880 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-10T22:26:15.880 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":77,"fsid":"22997a4c-6fc2-11ef-bcea-c7b262605968","created":"2024-09-10T22:16:16.754696+0000","modified":"2024-09-10T22:26:05.946930+0000","last_up_change":"2024-09-10T22:23:32.417392+0000","last_in_change":"2024-09-10T22:23:09.614371+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T22:19:50.731662+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-10T22:24:18.740121+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"73","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-10T22:24:20.795178+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"73","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"783d96cb-0a8a-47f3-8eab-77cd731a64bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6802","nonce":234761879},{"type":"v1","addr":"172.21.15.19:6803","nonce":234761879}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6804","nonce":234761879},{"type":"v1","addr":"172.21.15.19:6805","nonce":234761879}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6808","nonce":234761879},{"type":"v1","addr":"172.21.15.19:6809","nonce":234761879}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6806","nonce":234761879},{"type":"v1","addr":"172.21.15.19:6807","nonce":234761879}]},"public_addr":"172.21.15.19:6803/234761879","cluster_addr":"172.21.15.19:6805/234761879","heartbeat_back_addr":"172.21.15.19:6809/234761879","heartbeat_front_addr":"172.21.15.19:6807/234761879","state":["exists","up"]},{"osd":1,"uuid":"41043581-e0cf-43b5-bae0-0d95e2ef8156","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6800","nonce":1803526886},{"type":"v1","addr":"172.21.15.135:6801","nonce":1803526886}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6802","nonce":1803526886},{"type":"v1","addr":"172.21.15.135:6803","nonce":1803526886}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6806","nonce":1803526886},{"type":"v1","addr":"172.21.15.135:6807","nonce":1803526886}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6804","nonce":1803526886},{"type":"v1","addr":"172.21.15.135:6805","nonce":1803526886}]},"public_addr":"172.21.15.135:6801/1803526886","cluster_addr":"172.21.15.135:6803/1803526886","heartbeat_back_addr":"172.21.15.135:6807/1803526886","heartbeat_front_addr":"172.21.15.135:6805/1803526886","state":["exists","up"]},{"osd":2,"uuid":"a9b14a06-bbdc-4501-96e2-fb5f7127ca16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6800","nonce":2747418770},{"type":"v1","addr":"172.21.15.138:6801","nonce":2747418770}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6802","nonce":2747418770},{"type":"v1","addr":"172.21.15.138:6803","nonce":2747418770}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6806","nonce":2747418770},{"type":"v1","addr":"172.21.15.138:6807","nonce":2747418770}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6804","nonce":2747418770},{"type":"v1","addr":"172.21.15.138:6805","nonce":2747418770}]},"public_addr":"172.21.15.138:6801/2747418770","cluster_addr":"172.21.15.138:6803/2747418770","heartbeat_back_addr":"172.21.15.138:6807/2747418770","heartbeat_front_addr":"172.21.15.138:6805/2747418770","state":["exists","up"]},{"osd":3,"uuid":"a46268da-8666-4cfa-b11a-30eb12e271be","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":23,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6810","nonce":1889857224},{"type":"v1","addr":"172.21.15.19:6811","nonce":1889857224}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6812","nonce":1889857224},{"type":"v1","addr":"172.21.15.19:6813","nonce":1889857224}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6816","nonce":1889857224},{"type":"v1","addr":"172.21.15.19:6817","nonce":1889857224}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6814","nonce":1889857224},{"type":"v1","addr":"172.21.15.19:6815","nonce":1889857224}]},"public_addr":"172.21.15.19:6811/1889857224","cluster_addr":"172.21.15.19:6813/1889857224","heartbeat_back_addr":"172.21.15.19:6817/1889857224","heartbeat_front_addr":"172.21.15.19:6815/1889857224","state":["exists","up"]},{"osd":4,"uuid":"c58df06f-2de2-4655-88e7-ac6a3531839a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":29,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6808","nonce":436311825},{"type":"v1","addr":"172.21.15.135:6809","nonce":436311825}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6810","nonce":436311825},{"type":"v1","addr":"172.21.15.135:6811","nonce":436311825}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6814","nonce":436311825},{"type":"v1","addr":"172.21.15.135:6815","nonce":436311825}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6812","nonce":436311825},{"type":"v1","addr":"172.21.15.135:6813","nonce":436311825}]},"public_addr":"172.21.15.135:6809/436311825","cluster_addr":"172.21.15.135:6811/436311825","heartbeat_back_addr":"172.21.15.135:6815/436311825","heartbeat_front_addr":"172.21.15.135:6813/436311825","state":["exists","up"]},{"osd":5,"uuid":"c0900b0c-aef4-498d-a01b-a891bdb51122","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6808","nonce":1086764290},{"type":"v1","addr":"172.21.15.138:6809","nonce":1086764290}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6810","nonce":1086764290},{"type":"v1","addr":"172.21.15.138:6811","nonce":1086764290}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6814","nonce":1086764290},{"type":"v1","addr":"172.21.15.138:6815","nonce":1086764290}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6812","nonce":1086764290},{"type":"v1","addr":"172.21.15.138:6813","nonce":1086764290}]},"public_addr":"172.21.15.138:6809/1086764290","cluster_addr":"172.21.15.138:6811/1086764290","heartbeat_back_addr":"172.21.15.138:6815/1086764290","heartbeat_front_addr":"172.21.15.138:6813/1086764290","state":["exists","up"]},{"osd":6,"uuid":"f79cb310-8073-4ee5-80a6-87a290600321","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":40,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6818","nonce":406328354},{"type":"v1","addr":"172.21.15.19:6819","nonce":406328354}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6820","nonce":406328354},{"type":"v1","addr":"172.21.15.19:6821","nonce":406328354}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6824","nonce":406328354},{"type":"v1","addr":"172.21.15.19:6825","nonce":406328354}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6822","nonce":406328354},{"type":"v1","addr":"172.21.15.19:6823","nonce":406328354}]},"public_addr":"172.21.15.19:6819/406328354","cluster_addr":"172.21.15.19:6821/406328354","heartbeat_back_addr":"172.21.15.19:6825/406328354","heartbeat_front_addr":"172.21.15.19:6823/406328354","state":["exists","up"]},{"osd":7,"uuid":"cc76476a-92f3-489c-be9e-29cbbf39539e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6816","nonce":1096613674},{"type":"v1","addr":"172.21.15.135:6817","nonce":1096613674}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6818","nonce":1096613674},{"type":"v1","addr":"172.21.15.135:6819","nonce":1096613674}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6822","nonce":1096613674},{"type":"v1","addr":"172.21.15.135:6823","nonce":1096613674}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6820","nonce":1096613674},{"type":"v1","addr":"172.21.15.135:6821","nonce":1096613674}]},"public_addr":"172.21.15.135:6817/1096613674","cluster_addr":"172.21.15.135:6819/1096613674","heartbeat_back_addr":"172.21.15.135:6823/1096613674","heartbeat_front_addr":"172.21.15.135:6821/1096613674","state":["exists","up"]},{"osd":8,"uuid":"5323a006-a6e8-4403-9c51-65f46298d5c4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6816","nonce":3020394729},{"type":"v1","addr":"172.21.15.138:6817","nonce":3020394729}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6818","nonce":3020394729},{"type":"v1","addr":"172.21.15.138:6819","nonce":3020394729}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6822","nonce":3020394729},{"type":"v1","addr":"172.21.15.138:6823","nonce":3020394729}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6820","nonce":3020394729},{"type":"v1","addr":"172.21.15.138:6821","nonce":3020394729}]},"public_addr":"172.21.15.138:6817/3020394729","cluster_addr":"172.21.15.138:6819/3020394729","heartbeat_back_addr":"172.21.15.138:6823/3020394729","heartbeat_front_addr":"172.21.15.138:6821/3020394729","state":["exists","up"]},{"osd":9,"uuid":"b869ac42-c46e-442c-8b5b-f81c018e663c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":57,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6826","nonce":1488680899},{"type":"v1","addr":"172.21.15.19:6827","nonce":1488680899}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6828","nonce":1488680899},{"type":"v1","addr":"172.21.15.19:6829","nonce":1488680899}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6832","nonce":1488680899},{"type":"v1","addr":"172.21.15.19:6833","nonce":1488680899}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6830","nonce":1488680899},{"type":"v1","addr":"172.21.15.19:6831","nonce":1488680899}]},"public_addr":"172.21.15.19:6827/1488680899","cluster_addr":"172.21.15.19:6829/1488680899","heartbeat_back_addr":"172.21.15.19:6833/1488680899","heartbeat_front_addr":"172.21.15.19:6831/1488680899","state":["exists","up"]},{"osd":10,"uuid":"b8a2d69a-6821-4c69-b7eb-c0cfc8164614","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":62,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6824","nonce":3812626754},{"type":"v1","addr":"172.21.15.135:6825","nonce":3812626754}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6826","nonce":3812626754},{"type":"v1","addr":"172.21.15.135:6827","nonce":3812626754}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6830","nonce":3812626754},{"type":"v1","addr":"172.21.15.135:6831","nonce":3812626754}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6828","nonce":3812626754},{"type":"v1","addr":"172.21.15.135:6829","nonce":3812626754}]},"public_addr":"172.21.15.135:6825/3812626754","cluster_addr":"172.21.15.135:6827/3812626754","heartbeat_back_addr":"172.21.15.135:6831/3812626754","heartbeat_front_addr":"172.21.15.135:6829/3812626754","state":["exists","up"]},{"osd":11,"uuid":"a9264ab2-5843-44d2-aba8-1e12708e99d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6824","nonce":1098434807},{"type":"v1","addr":"172.21.15.138:6825","nonce":1098434807}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6826","nonce":1098434807},{"type":"v1","addr":"172.21.15.138:6827","nonce":1098434807}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6830","nonce":1098434807},{"type":"v1","addr":"172.21.15.138:6831","nonce":1098434807}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6828","nonce":1098434807},{"type":"v1","addr":"172.21.15.138:6829","nonce":1098434807}]},"public_addr":"172.21.15.138:6825/1098434807","cluster_addr":"172.21.15.138:6827/1098434807","heartbeat_back_addr":"172.21.15.138:6831/1098434807","heartbeat_front_addr":"172.21.15.138:6829/1098434807","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:18:58.008025+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:19:22.475890+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:19:47.124147+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:20:12.438853+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:20:37.195177+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:21:02.474248+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:21:27.087207+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:21:52.119211+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:22:16.569989+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:22:41.680986+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:23:06.391885+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:23:30.695460+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.0","mappings":[{"from":8,"to":4}]},{"pgid":"2.c","mappings":[{"from":2,"to":4}]},{"pgid":"2.d","mappings":[{"from":5,"to":11}]},{"pgid":"2.16","mappings":[{"from":2,"to":6}]},{"pgid":"2.17","mappings":[{"from":5,"to":1}]},{"pgid":"2.1a","mappings":[{"from":8,"to":1}]},{"pgid":"2.1d","mappings":[{"from":2,"to":4}]},{"pgid":"2.1f","mappings":[{"from":7,"to":11}]},{"pgid":"3.13","mappings":[{"from":4,"to":9}]},{"pgid":"3.1b","mappings":[{"from":4,"to":8}]},{"pgid":"3.21","mappings":[{"from":5,"to":9}]},{"pgid":"3.38","mappings":[{"from":3,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.19:0/2099468127":"2024-09-11T22:17:04.260826+0000","172.21.15.19:0/538724915":"2024-09-11T22:17:04.260826+0000","172.21.15.19:0/3504695777":"2024-09-11T22:17:04.260826+0000","172.21.15.19:0/1401613792":"2024-09-11T22:16:39.069638+0000","172.21.15.19:6801/3005924425":"2024-09-11T22:17:04.260826+0000","172.21.15.19:6800/3005924425":"2024-09-11T22:17:04.260826+0000","172.21.15.19:0/104917892":"2024-09-11T22:16:39.069638+0000","172.21.15.19:0/1778305990":"2024-09-11T22:16:39.069638+0000","172.21.15.19:6801/535670059":"2024-09-11T22:16:39.069638+0000","172.21.15.19:6800/535670059":"2024-09-11T22:16:39.069638+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T22:26:15.882 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:15.880+0000 7f35ed60a640 1 -- 172.21.15.19:0/1400501800 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f35d40b5360 msgr2=0x7f35d40b7820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:26:15.882 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:15.880+0000 7f35ed60a640 1 --2- 172.21.15.19:0/1400501800 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f35d40b5360 0x7f35d40b7820 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f35e8107ec0 tx=0x7f35d000a4c0 comp rx=0 tx=0).stop 2024-09-10T22:26:15.882 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:15.880+0000 7f35ed60a640 1 -- 172.21.15.19:0/1400501800 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f35e8102dc0 msgr2=0x7f35e81992e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:26:15.882 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:15.880+0000 7f35ed60a640 1 --2- 172.21.15.19:0/1400501800 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f35e8102dc0 0x7f35e81992e0 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f35d8006010 tx=0x7f35d80042f0 comp rx=0 tx=0).stop 2024-09-10T22:26:15.883 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:15.880+0000 7f35ed60a640 1 -- 172.21.15.19:0/1400501800 shutdown_connections 2024-09-10T22:26:15.883 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:15.880+0000 7f35ed60a640 1 --2- 172.21.15.19:0/1400501800 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f35d40b5360 0x7f35d40b7820 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:26:15.883 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:15.880+0000 7f35ed60a640 1 --2- 172.21.15.19:0/1400501800 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f35e8109150 0x7f35e819ebc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:26:15.883 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:15.880+0000 7f35ed60a640 1 --2- 172.21.15.19:0/1400501800 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f35e81087d0 0x7f35e8199820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:26:15.883 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:15.880+0000 7f35ed60a640 1 --2- 172.21.15.19:0/1400501800 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f35e8102dc0 0x7f35e81992e0 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:26:15.883 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:15.880+0000 7f35ed60a640 1 -- 172.21.15.19:0/1400501800 >> 172.21.15.19:0/1400501800 conn(0x7f35e80fe870 msgr2=0x7f35e8100c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:26:15.883 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:15.880+0000 7f35ed60a640 1 -- 172.21.15.19:0/1400501800 shutdown_connections 2024-09-10T22:26:15.883 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:15.880+0000 7f35ed60a640 1 -- 172.21.15.19:0/1400501800 wait complete. 2024-09-10T22:26:16.176 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:26:15 smithi019 ceph-mon[31375]: pgmap v342: 97 pgs: 97 active+clean; 640 KiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 867 B/s wr, 6 op/s; 69 B/s, 0 objects/s recovering 2024-09-10T22:26:16.176 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:26:15 smithi019 ceph-mon[31375]: from='client.? 172.21.15.19:0/1400501800' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-10T22:26:16.359 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:26:15 smithi135 ceph-mon[34789]: pgmap v342: 97 pgs: 97 active+clean; 640 KiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 867 B/s wr, 6 op/s; 69 B/s, 0 objects/s recovering 2024-09-10T22:26:16.360 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:26:15 smithi135 ceph-mon[34789]: from='client.? 172.21.15.19:0/1400501800' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-10T22:26:16.375 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:26:15 smithi138 ceph-mon[35236]: pgmap v342: 97 pgs: 97 active+clean; 640 KiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 867 B/s wr, 6 op/s; 69 B/s, 0 objects/s recovering 2024-09-10T22:26:16.375 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:26:15 smithi138 ceph-mon[35236]: from='client.? 172.21.15.19:0/1400501800' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-10T22:26:16.641 DEBUG:tasks.fwd_scrub:Yielding 2024-09-10T22:26:16.641 INFO:teuthology.run_tasks:Running task background_exec... 2024-09-10T22:26:16.652 INFO:teuthology.task.background_exec:Running background command on role mon.a host ubuntu@smithi019.front.sepia.ceph.com 2024-09-10T22:26:16.652 DEBUG:teuthology.orchestra.run.smithi019:> sudo TESTDIR=/home/ubuntu/cephtest daemon-helper kill --kill-group bash -c 'while sleep 13; do ceph tell mds.cephfs:0 flush journal; done' 2024-09-10T22:26:16.652 INFO:tasks.fwd_scrub.fs.[cephfs]:start scrubbing fs: cephfs 2024-09-10T22:26:16.652 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-10T22:26:16.653 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 22997a4c-6fc2-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-10T22:26:16.655 INFO:teuthology.run_tasks:Running task workunit... 2024-09-10T22:26:16.680 INFO:tasks.workunit:Pulling workunits from ref 8f219c476cb4f26fc5719c661c0323719a45cb30 2024-09-10T22:26:16.681 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-09-10T22:26:16.681 INFO:tasks.workunit:timeout=3h 2024-09-10T22:26:16.681 INFO:tasks.workunit:cleanup=True 2024-09-10T22:26:16.681 DEBUG:teuthology.orchestra.run.smithi019:> stat -- /home/ubuntu/cephtest/mnt.0 2024-09-10T22:26:16.698 INFO:teuthology.orchestra.run.smithi019.stdout: File: /home/ubuntu/cephtest/mnt.0 2024-09-10T22:26:16.698 INFO:teuthology.orchestra.run.smithi019.stdout: Size: 0 Blocks: 0 IO Block: 65536 directory 2024-09-10T22:26:16.698 INFO:teuthology.orchestra.run.smithi019.stdout:Device: 78h/120d Inode: 1099511628283 Links: 2 2024-09-10T22:26:16.698 INFO:teuthology.orchestra.run.smithi019.stdout:Access: (1777/drwxrwxrwt) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-10T22:26:16.699 INFO:teuthology.orchestra.run.smithi019.stdout:Context: system_u:object_r:unlabeled_t:s0 2024-09-10T22:26:16.699 INFO:teuthology.orchestra.run.smithi019.stdout:Access: 2024-09-10 22:24:40.926072508 +0000 2024-09-10T22:26:16.699 INFO:teuthology.orchestra.run.smithi019.stdout:Modify: 2024-09-10 22:24:40.926072508 +0000 2024-09-10T22:26:16.699 INFO:teuthology.orchestra.run.smithi019.stdout:Change: 2024-09-10 22:26:07.907001603 +0000 2024-09-10T22:26:16.699 INFO:teuthology.orchestra.run.smithi019.stdout: Birth: 2024-09-10 22:24:40.926072508 +0000 2024-09-10T22:26:16.699 INFO:tasks.workunit:Did not need to create dir /home/ubuntu/cephtest/mnt.0 2024-09-10T22:26:16.699 DEBUG:teuthology.orchestra.run.smithi019:> cd -- /home/ubuntu/cephtest/mnt.0 && sudo install -d -m 0755 --owner=ubuntu -- client.0 2024-09-10T22:26:16.771 DEBUG:teuthology.orchestra.run.smithi019:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://github.com/ceph/ceph-ci.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 8f219c476cb4f26fc5719c661c0323719a45cb30 2024-09-10T22:26:16.829 INFO:tasks.workunit.client.0.smithi019.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-09-10T22:26:16.922 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/22997a4c-6fc2-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T22:26:17.472 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:17.449+0000 7f509e780640 1 -- 172.21.15.19:0/2927093570 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5098103b30 msgr2=0x7f5098103f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:26:17.472 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:17.449+0000 7f509e780640 1 --2- 172.21.15.19:0/2927093570 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5098103b30 0x7f5098103f10 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f5088009900 tx=0x7f508802a410 comp rx=0 tx=0).stop 2024-09-10T22:26:17.472 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:17.449+0000 7f509e780640 1 -- 172.21.15.19:0/2927093570 shutdown_connections 2024-09-10T22:26:17.473 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:17.449+0000 7f509e780640 1 --2- 172.21.15.19:0/2927093570 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f509810d0e0 0x7f509810f550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:26:17.473 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:17.449+0000 7f509e780640 1 --2- 172.21.15.19:0/2927093570 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5098104530 0x7f509810cb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:26:17.473 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:17.449+0000 7f509e780640 1 --2- 172.21.15.19:0/2927093570 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5098103b30 0x7f5098103f10 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:26:17.473 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:17.449+0000 7f509e780640 1 -- 172.21.15.19:0/2927093570 >> 172.21.15.19:0/2927093570 conn(0x7f50980fd700 msgr2=0x7f50980ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:26:17.473 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:17.449+0000 7f509e780640 1 -- 172.21.15.19:0/2927093570 shutdown_connections 2024-09-10T22:26:17.473 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:17.449+0000 7f509e780640 1 -- 172.21.15.19:0/2927093570 wait complete. 2024-09-10T22:26:17.473 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:17.450+0000 7f509e780640 1 Processor -- start 2024-09-10T22:26:17.473 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:17.450+0000 7f509e780640 1 -- start start 2024-09-10T22:26:17.473 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:17.450+0000 7f509e780640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5098103b30 0x7f50981992e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:26:17.473 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:17.450+0000 7f509e780640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5098104530 0x7f5098199820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:26:17.473 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:17.450+0000 7f509e780640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f509810d0e0 0x7f509819ebc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:26:17.474 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:17.450+0000 7f509e780640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f5098112df0 con 0x7f509810d0e0 2024-09-10T22:26:17.474 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:17.450+0000 7f509e780640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f5098112c70 con 0x7f5098104530 2024-09-10T22:26:17.474 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:17.450+0000 7f509e780640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f5098112f70 con 0x7f5098103b30 2024-09-10T22:26:17.474 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:17.450+0000 7f509cd1d640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f509810d0e0 0x7f509819ebc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:26:17.474 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:17.450+0000 7f509cd1d640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f509810d0e0 0x7f509819ebc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:46352/0 (socket says 172.21.15.19:46352) 2024-09-10T22:26:17.474 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:17.450+0000 7f509cd1d640 1 -- 172.21.15.19:0/3695347373 learned_addr learned my addr 172.21.15.19:0/3695347373 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:26:17.474 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:17.450+0000 7f508ffff640 1 --2- 172.21.15.19:0/3695347373 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5098104530 0x7f5098199820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:26:17.474 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:17.450+0000 7f509cd1d640 1 -- 172.21.15.19:0/3695347373 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5098103b30 msgr2=0x7f50981992e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:26:17.474 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:17.450+0000 7f509cd1d640 1 --2- 172.21.15.19:0/3695347373 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5098103b30 0x7f50981992e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:26:17.474 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:17.450+0000 7f509cd1d640 1 -- 172.21.15.19:0/3695347373 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5098104530 msgr2=0x7f5098199820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:26:17.474 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:17.450+0000 7f509cd1d640 1 --2- 172.21.15.19:0/3695347373 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5098104530 0x7f5098199820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:26:17.474 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:17.450+0000 7f509cd1d640 1 -- 172.21.15.19:0/3695347373 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f509819f390 con 0x7f509810d0e0 2024-09-10T22:26:17.475 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:17.450+0000 7f509cd1d640 1 --2- 172.21.15.19:0/3695347373 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f509810d0e0 0x7f509819ebc0 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f509000b970 tx=0x7f509000be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:26:17.475 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:17.451+0000 7f5095ffb640 1 -- 172.21.15.19:0/3695347373 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5090019070 con 0x7f509810d0e0 2024-09-10T22:26:17.475 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:17.451+0000 7f5095ffb640 1 -- 172.21.15.19:0/3695347373 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5090014440 con 0x7f509810d0e0 2024-09-10T22:26:17.475 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:17.451+0000 7f5095ffb640 1 -- 172.21.15.19:0/3695347373 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50900075d0 con 0x7f509810d0e0 2024-09-10T22:26:17.475 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:17.451+0000 7f509e780640 1 -- 172.21.15.19:0/3695347373 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f509819f680 con 0x7f509810d0e0 2024-09-10T22:26:17.475 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:17.451+0000 7f509e780640 1 -- 172.21.15.19:0/3695347373 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f50981a5d40 con 0x7f509810d0e0 2024-09-10T22:26:17.475 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:17.454+0000 7f5095ffb640 1 -- 172.21.15.19:0/3695347373 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 18) ==== 153250+0+0 (secure 0 0 0) 0x7f50900077b0 con 0x7f509810d0e0 2024-09-10T22:26:17.475 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:17.454+0000 7f50a0b55740 1 Processor -- start 2024-09-10T22:26:17.475 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:17.454+0000 7f50a0b55740 1 -- start start 2024-09-10T22:26:17.475 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:17.454+0000 7f50a0b55740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x561824331ee0 0x5618243322c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:26:17.475 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:17.454+0000 7f50a0b55740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561824332800 0x56182433e250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:26:17.476 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:17.454+0000 7f50a0b55740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56182433e790 0x561824340b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:26:17.476 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:17.454+0000 7f50a0b55740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x5618242a8e60 con 0x56182433e790 2024-09-10T22:26:17.476 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:17.454+0000 7f50a0b55740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x561824298290 con 0x561824332800 2024-09-10T22:26:17.476 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:17.454+0000 7f50a0b55740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x56182429c0a0 con 0x561824331ee0 2024-09-10T22:26:17.476 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:17.454+0000 7f508ffff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56182433e790 0x561824340b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:26:17.476 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:17.454+0000 7f508ffff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56182433e790 0x561824340b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:46368/0 (socket says 172.21.15.19:46368) 2024-09-10T22:26:17.476 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:17.454+0000 7f508ffff640 1 -- 172.21.15.19:0/1343075138 learned_addr learned my addr 172.21.15.19:0/1343075138 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:26:17.476 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:17.455+0000 7f5097fff640 1 --2- 172.21.15.19:0/1343075138 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561824332800 0x56182433e250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:26:17.476 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:17.455+0000 7f508ffff640 1 --2- 172.21.15.19:0/1343075138 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x561824331ee0 0x5618243322c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:26:17.476 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:17.455+0000 7f508ffff640 1 -- 172.21.15.19:0/1343075138 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x561824331ee0 msgr2=0x5618243322c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:26:17.476 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:17.455+0000 7f508ffff640 1 --2- 172.21.15.19:0/1343075138 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x561824331ee0 0x5618243322c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:26:17.476 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:17.455+0000 7f508ffff640 1 -- 172.21.15.19:0/1343075138 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561824332800 msgr2=0x56182433e250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:26:17.477 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:17.455+0000 7f508ffff640 1 --2- 172.21.15.19:0/1343075138 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561824332800 0x56182433e250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:26:17.477 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:17.455+0000 7f508ffff640 1 -- 172.21.15.19:0/1343075138 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561823ff6930 con 0x56182433e790 2024-09-10T22:26:17.477 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:17.455+0000 7f508ffff640 1 --2- 172.21.15.19:0/1343075138 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56182433e790 0x561824340b80 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f5080013620 tx=0x7f508000c710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=42b5175cf34e6142 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:26:17.477 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:17.455+0000 7f5095ffb640 1 --2- 172.21.15.19:0/3695347373 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f50840b52e0 0x7f50840b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:26:17.477 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:17.455+0000 7f508e7fc640 1 -- 172.21.15.19:0/1343075138 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5080019030 con 0x56182433e790 2024-09-10T22:26:17.478 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:17.455+0000 7f5097fff640 1 --2- 172.21.15.19:0/3695347373 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f50840b52e0 0x7f50840b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:26:17.478 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:17.455+0000 7f5095ffb640 1 -- 172.21.15.19:0/3695347373 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8327+0+0 (secure 0 0 0) 0x7f50900e54b0 con 0x7f509810d0e0 2024-09-10T22:26:17.478 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:17.455+0000 7f508e7fc640 1 -- 172.21.15.19:0/1343075138 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f50800054d0 con 0x56182433e790 2024-09-10T22:26:17.478 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:17.455+0000 7f508e7fc640 1 -- 172.21.15.19:0/1343075138 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5080011620 con 0x56182433e790 2024-09-10T22:26:17.478 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:17.456+0000 7f50a0b55740 1 -- 172.21.15.19:0/1343075138 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56182433e790 msgr2=0x561824340b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:26:17.478 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:17.456+0000 7f5097fff640 1 --2- 172.21.15.19:0/3695347373 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f50840b52e0 0x7f50840b77a0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f50880057c0 tx=0x7f5088031400 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:26:17.478 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:17.456+0000 7f50a0b55740 1 --2- 172.21.15.19:0/1343075138 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56182433e790 0x561824340b80 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f5080013620 tx=0x7f508000c710 comp rx=0 tx=0).stop 2024-09-10T22:26:17.478 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:17.456+0000 7f50a0b55740 1 -- 172.21.15.19:0/1343075138 shutdown_connections 2024-09-10T22:26:17.478 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:17.456+0000 7f50a0b55740 1 --2- 172.21.15.19:0/1343075138 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56182433e790 0x561824340b80 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:26:17.478 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:17.456+0000 7f50a0b55740 1 --2- 172.21.15.19:0/1343075138 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561824332800 0x56182433e250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:26:17.478 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:17.456+0000 7f50a0b55740 1 --2- 172.21.15.19:0/1343075138 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x561824331ee0 0x5618243322c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:26:17.478 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:17.456+0000 7f50a0b55740 1 -- 172.21.15.19:0/1343075138 >> 172.21.15.19:0/1343075138 conn(0x56182432fd10 msgr2=0x561824330eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:26:17.479 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:17.456+0000 7f50a0b55740 1 -- 172.21.15.19:0/1343075138 shutdown_connections 2024-09-10T22:26:17.479 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:17.456+0000 7f50a0b55740 1 -- 172.21.15.19:0/1343075138 wait complete. 2024-09-10T22:26:17.479 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:17.457+0000 7f50a0b55740 1 -- start start 2024-09-10T22:26:17.479 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:17.457+0000 7f50a0b55740 1 Processor -- start 2024-09-10T22:26:17.479 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:17.457+0000 7f50a0b55740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561824331ee0 0x56182433b7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:26:17.479 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:17.457+0000 7f50a0b55740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x561824332800 0x56182433bd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:26:17.479 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:17.457+0000 7f50a0b55740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x56182433e790 0x56182433c270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:26:17.479 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:17.457+0000 7f50a0b55740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x5618240f9890 con 0x561824332800 2024-09-10T22:26:17.479 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:17.457+0000 7f50a0b55740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x561824232d40 con 0x561824331ee0 2024-09-10T22:26:17.479 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:17.457+0000 7f50a0b55740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x561824341440 con 0x56182433e790 2024-09-10T22:26:17.479 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:17.457+0000 7f50a0b55740 10 client.0 _ll_register_callbacks cb 0x561824296c80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T22:26:17.480 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:17.457+0000 7f508ffff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x561824332800 0x56182433bd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:26:17.480 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:17.457+0000 7f508ffff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x561824332800 0x56182433bd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:46384/0 (socket says 172.21.15.19:46384) 2024-09-10T22:26:17.480 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:17.457+0000 7f508ffff640 1 -- 172.21.15.19:0/1722613049 learned_addr learned my addr 172.21.15.19:0/1722613049 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:26:17.480 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:17.458+0000 7f5097fff640 1 --2- 172.21.15.19:0/1722613049 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561824331ee0 0x56182433b7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:26:17.480 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:17.458+0000 7f509cd1d640 1 --2- 172.21.15.19:0/1722613049 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x56182433e790 0x56182433c270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:26:17.480 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:17.458+0000 7f508ffff640 1 -- 172.21.15.19:0/1722613049 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x56182433e790 msgr2=0x56182433c270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:26:17.480 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:17.458+0000 7f508ffff640 1 --2- 172.21.15.19:0/1722613049 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x56182433e790 0x56182433c270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:26:17.480 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:17.458+0000 7f508ffff640 1 -- 172.21.15.19:0/1722613049 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561824331ee0 msgr2=0x56182433b7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:26:17.480 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:17.458+0000 7f508ffff640 1 --2- 172.21.15.19:0/1722613049 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561824331ee0 0x56182433b7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:26:17.480 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:17.458+0000 7f508ffff640 1 -- 172.21.15.19:0/1722613049 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56182434a930 con 0x561824332800 2024-09-10T22:26:17.480 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:17.458+0000 7f508ffff640 1 --2- 172.21.15.19:0/1722613049 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x561824332800 0x56182433bd30 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f5080004630 tx=0x7f5080005700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=432ea7244b060e9 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:26:17.480 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:17.458+0000 7f50777fe640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-10T22:26:17.481 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:17.458+0000 7f50777fe640 1 -- 172.21.15.19:0/1722613049 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5080019040 con 0x561824332800 2024-09-10T22:26:17.481 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:17.458+0000 7f50a0b55740 1 -- 172.21.15.19:0/1722613049 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f50800054d0 con 0x561824332800 2024-09-10T22:26:17.481 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:17.458+0000 7f50777fe640 1 -- 172.21.15.19:0/1722613049 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8327+0+0 (secure 0 0 0) 0x7f5080005000 con 0x561824332800 2024-09-10T22:26:17.481 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:17.458+0000 7f50777fe640 1 -- 172.21.15.19:0/1722613049 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f5080030050 con 0x561824332800 2024-09-10T22:26:17.481 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:17.458+0000 7f50a0b55740 10 client.15351 fetch_fsmap learned FSMap version 25 2024-09-10T22:26:17.481 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:17.458+0000 7f50a0b55740 1 -- 172.21.15.19:0/1722613049 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x56182434d310 con 0x561824332800 2024-09-10T22:26:17.481 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:17.458+0000 7f50777fe640 1 -- 172.21.15.19:0/1722613049 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f50800054d0 con 0x561824332800 2024-09-10T22:26:17.481 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:17.459+0000 7f50777fe640 1 -- 172.21.15.19:0/1722613049 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f5080025020 con 0x561824332800 2024-09-10T22:26:17.481 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:17.459+0000 7f50a0b55740 10 client.15351 fetch_fsmap finished waiting for FSMap version 25 2024-09-10T22:26:17.481 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:17.459+0000 7f50a0b55740 10 client.15351 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-10T22:26:17.481 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:17.459+0000 7f50a0b55740 20 client.15351 populate_metadata read hostname 'smithi019' 2024-09-10T22:26:17.481 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:17.459+0000 7f50a0b55740 1 --2- 172.21.15.19:0/1722613049 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x56182434e6c0 0x561824350ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:26:17.481 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:17.459+0000 7f50a0b55740 4 client.15351 mds_command: new command op to 24581 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T22:26:17.482 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:17.459+0000 7f50a0b55740 1 -- 172.21.15.19:0/1722613049 --> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5618242aadb0 con 0x56182434e6c0 2024-09-10T22:26:17.482 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:17.459+0000 7f5097fff640 1 --2- 172.21.15.19:0/1722613049 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x56182434e6c0 0x561824350ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:26:17.482 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:17.459+0000 7f50777fe640 10 client.15351 ms_handle_connect on v2:172.21.15.135:6838/1254769802 2024-09-10T22:26:17.482 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:17.459+0000 7f5097fff640 1 --2- 172.21.15.19:0/1722613049 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x56182434e6c0 0x561824350ab0 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3d21dbb1ff38ea0 server_cookie=744f05910eb28e76 in_seq=0 out_seq=0 2024-09-10T22:26:17.482 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:17.460+0000 7f50777fe640 1 -- 172.21.15.19:0/1722613049 <== mds.0 v2:172.21.15.135:6838/1254769802 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5618242aadb0 con 0x56182434e6c0 2024-09-10T22:26:17.482 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:17.460+0000 7f50777fe640 10 client.15351 handle_command_reply: tid=0 2024-09-10T22:26:17.482 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:17.460+0000 7f50a0b55740 1 client.15351 shutdown 2024-09-10T22:26:17.482 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:17.460+0000 7f50a0b55740 1 -- 172.21.15.19:0/1722613049 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x561824332800 msgr2=0x56182433bd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:26:17.482 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:17.460+0000 7f50a0b55740 1 --2- 172.21.15.19:0/1722613049 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x561824332800 0x56182433bd30 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f5080004630 tx=0x7f5080005700 comp rx=0 tx=0).stop 2024-09-10T22:26:17.482 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:17.460+0000 7f50a0b55740 1 -- 172.21.15.19:0/1722613049 shutdown_connections 2024-09-10T22:26:17.482 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:17.460+0000 7f50a0b55740 1 --2- 172.21.15.19:0/1722613049 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x56182434e6c0 0x561824350ab0 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:26:17.482 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:17.460+0000 7f50a0b55740 1 --2- 172.21.15.19:0/1722613049 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x56182433e790 0x56182433c270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:26:17.483 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:17.460+0000 7f50777fe640 0 client.15351 ms_handle_reset on v2:172.21.15.135:6838/1254769802 2024-09-10T22:26:17.483 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:17.460+0000 7f50a0b55740 1 --2- 172.21.15.19:0/1722613049 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x561824332800 0x56182433bd30 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:26:17.483 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:17.460+0000 7f50a0b55740 1 --2- 172.21.15.19:0/1722613049 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561824331ee0 0x56182433b7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:26:17.483 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:17.460+0000 7f50a0b55740 1 -- 172.21.15.19:0/1722613049 >> 172.21.15.19:0/1722613049 conn(0x56182432fd10 msgr2=0x56182432ef70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:26:17.483 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:17.460+0000 7f50a0b55740 1 -- 172.21.15.19:0/1722613049 shutdown_connections 2024-09-10T22:26:17.483 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:17.460+0000 7f50a0b55740 1 -- 172.21.15.19:0/1722613049 wait complete. 2024-09-10T22:26:17.483 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:17.460+0000 7f50a0b55740 20 client.15351 trim_cache size 0 max 16384 2024-09-10T22:26:17.488 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:17.478+0000 7f50a0b55740 1 Processor -- start 2024-09-10T22:26:17.488 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:17.478+0000 7f50a0b55740 1 -- start start 2024-09-10T22:26:17.488 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:17.478+0000 7f50a0b55740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x561824331ee0 0x5618243357a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:26:17.488 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:17.479+0000 7f50a0b55740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561824332800 0x5618243562e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:26:17.488 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:17.479+0000 7f50a0b55740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x56182433e790 0x561824356820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:26:17.488 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:17.479+0000 7f50a0b55740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f50981b0e90 con 0x561824331ee0 2024-09-10T22:26:17.488 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:17.479+0000 7f50a0b55740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f50981ae760 con 0x561824332800 2024-09-10T22:26:17.488 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:17.479+0000 7f50a0b55740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f50981ac5b0 con 0x56182433e790 2024-09-10T22:26:17.488 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:17.479+0000 7f5097fff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x561824331ee0 0x5618243357a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:26:17.489 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:17.479+0000 7f5097fff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x561824331ee0 0x5618243357a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:46396/0 (socket says 172.21.15.19:46396) 2024-09-10T22:26:17.489 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:17.479+0000 7f5097fff640 1 -- 172.21.15.19:0/705532246 learned_addr learned my addr 172.21.15.19:0/705532246 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:26:17.489 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:17.479+0000 7f508ffff640 1 --2- 172.21.15.19:0/705532246 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561824332800 0x5618243562e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:26:17.489 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:17.479+0000 7f509cd1d640 1 --2- 172.21.15.19:0/705532246 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x56182433e790 0x561824356820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:26:17.489 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:17.479+0000 7f5097fff640 1 -- 172.21.15.19:0/705532246 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x56182433e790 msgr2=0x561824356820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:26:17.489 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:17.479+0000 7f5097fff640 1 --2- 172.21.15.19:0/705532246 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x56182433e790 0x561824356820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:26:17.489 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:17.479+0000 7f5097fff640 1 -- 172.21.15.19:0/705532246 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561824332800 msgr2=0x5618243562e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:26:17.489 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:17.479+0000 7f5097fff640 1 --2- 172.21.15.19:0/705532246 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561824332800 0x5618243562e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:26:17.489 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:17.479+0000 7f5097fff640 1 -- 172.21.15.19:0/705532246 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56182432fb40 con 0x561824331ee0 2024-09-10T22:26:17.489 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:17.479+0000 7f508ffff640 1 --2- 172.21.15.19:0/705532246 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561824332800 0x5618243562e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T22:26:17.489 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:17.479+0000 7f5097fff640 1 --2- 172.21.15.19:0/705532246 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x561824331ee0 0x5618243357a0 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f5088004500 tx=0x7f508803d000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9eb41059846cf4b4 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:26:17.490 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:17.480+0000 7f508dffb640 1 -- 172.21.15.19:0/705532246 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5088035040 con 0x561824331ee0 2024-09-10T22:26:17.490 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:17.480+0000 7f508dffb640 1 -- 172.21.15.19:0/705532246 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5088057070 con 0x561824331ee0 2024-09-10T22:26:17.490 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:17.480+0000 7f508dffb640 1 -- 172.21.15.19:0/705532246 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5088031b80 con 0x561824331ee0 2024-09-10T22:26:17.490 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:17.480+0000 7f50a0b55740 1 -- 172.21.15.19:0/705532246 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x561824331ee0 msgr2=0x5618243357a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:26:17.490 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:17.480+0000 7f50a0b55740 1 --2- 172.21.15.19:0/705532246 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x561824331ee0 0x5618243357a0 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f5088004500 tx=0x7f508803d000 comp rx=0 tx=0).stop 2024-09-10T22:26:17.490 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:17.480+0000 7f50a0b55740 1 -- 172.21.15.19:0/705532246 shutdown_connections 2024-09-10T22:26:17.490 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:17.480+0000 7f50a0b55740 1 --2- 172.21.15.19:0/705532246 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x56182433e790 0x561824356820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:26:17.490 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:17.480+0000 7f50a0b55740 1 --2- 172.21.15.19:0/705532246 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561824332800 0x5618243562e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:26:17.490 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:17.480+0000 7f50a0b55740 1 --2- 172.21.15.19:0/705532246 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x561824331ee0 0x5618243357a0 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:26:17.490 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:17.480+0000 7f50a0b55740 1 -- 172.21.15.19:0/705532246 >> 172.21.15.19:0/705532246 conn(0x56182432fd10 msgr2=0x561824335090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:26:17.490 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:17.480+0000 7f50a0b55740 1 -- 172.21.15.19:0/705532246 shutdown_connections 2024-09-10T22:26:17.490 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:17.480+0000 7f50a0b55740 1 -- 172.21.15.19:0/705532246 wait complete. 2024-09-10T22:26:17.490 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:17.481+0000 7f50a0b55740 1 -- start start 2024-09-10T22:26:17.491 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:17.481+0000 7f50a0b55740 1 Processor -- start 2024-09-10T22:26:17.491 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:17.481+0000 7f50a0b55740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x561824331ee0 0x561824343020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:26:17.491 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:17.481+0000 7f50a0b55740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561824332800 0x5618243435a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:26:17.491 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:17.481+0000 7f50a0b55740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56182433e790 0x5618243b4520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:26:17.491 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:17.481+0000 7f50a0b55740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f50981acc20 con 0x56182433e790 2024-09-10T22:26:17.491 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:17.481+0000 7f50a0b55740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f50981ae090 con 0x561824332800 2024-09-10T22:26:17.491 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:17.481+0000 7f50a0b55740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f50981ad2f0 con 0x561824331ee0 2024-09-10T22:26:17.491 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:17.481+0000 7f50a0b55740 10 client.0 _ll_register_callbacks cb 0x7f5088009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T22:26:17.491 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:17.481+0000 7f509cd1d640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56182433e790 0x5618243b4520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:26:17.491 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:17.481+0000 7f509cd1d640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56182433e790 0x5618243b4520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:46400/0 (socket says 172.21.15.19:46400) 2024-09-10T22:26:17.491 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:17.481+0000 7f509cd1d640 1 -- 172.21.15.19:0/599041861 learned_addr learned my addr 172.21.15.19:0/599041861 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:26:17.491 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:17.481+0000 7f5097fff640 1 --2- 172.21.15.19:0/599041861 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x561824331ee0 0x561824343020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:26:17.492 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:17.481+0000 7f508ffff640 1 --2- 172.21.15.19:0/599041861 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561824332800 0x5618243435a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:26:17.492 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:17.481+0000 7f509cd1d640 1 -- 172.21.15.19:0/599041861 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x561824331ee0 msgr2=0x561824343020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:26:17.492 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:17.481+0000 7f509cd1d640 1 --2- 172.21.15.19:0/599041861 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x561824331ee0 0x561824343020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:26:17.492 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:17.481+0000 7f509cd1d640 1 -- 172.21.15.19:0/599041861 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561824332800 msgr2=0x5618243435a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:26:17.492 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:17.481+0000 7f509cd1d640 1 --2- 172.21.15.19:0/599041861 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561824332800 0x5618243435a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:26:17.492 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:17.481+0000 7f509cd1d640 1 -- 172.21.15.19:0/599041861 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5618243b4c30 con 0x56182433e790 2024-09-10T22:26:17.492 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:17.482+0000 7f508ffff640 1 --2- 172.21.15.19:0/599041861 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561824332800 0x5618243435a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T22:26:17.492 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:17.482+0000 7f509cd1d640 1 --2- 172.21.15.19:0/599041861 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56182433e790 0x5618243b4520 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f50900e32c0 tx=0x7f50900aba10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d8b440b3e13a3ece server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:26:17.492 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:17.482+0000 7f50777fe640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-10T22:26:17.492 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:17.482+0000 7f50777fe640 1 -- 172.21.15.19:0/599041861 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50900e52b0 con 0x56182433e790 2024-09-10T22:26:17.492 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:17.482+0000 7f50777fe640 1 -- 172.21.15.19:0/599041861 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8327+0+0 (secure 0 0 0) 0x7f509000cb40 con 0x56182433e790 2024-09-10T22:26:17.492 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:17.482+0000 7f50a0b55740 1 -- 172.21.15.19:0/599041861 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5088057070 con 0x56182433e790 2024-09-10T22:26:17.492 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:17.482+0000 7f50777fe640 1 -- 172.21.15.19:0/599041861 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f509000cd60 con 0x56182433e790 2024-09-10T22:26:17.493 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:17.482+0000 7f50a0b55740 10 client.15357 fetch_fsmap learned FSMap version 25 2024-09-10T22:26:17.493 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:17.482+0000 7f50a0b55740 1 -- 172.21.15.19:0/599041861 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x5618243bc070 con 0x56182433e790 2024-09-10T22:26:17.493 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:17.482+0000 7f50777fe640 1 -- 172.21.15.19:0/599041861 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5088057070 con 0x56182433e790 2024-09-10T22:26:17.493 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:17.482+0000 7f50777fe640 1 -- 172.21.15.19:0/599041861 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f50900a7920 con 0x56182433e790 2024-09-10T22:26:17.493 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:17.482+0000 7f50a0b55740 10 client.15357 fetch_fsmap finished waiting for FSMap version 25 2024-09-10T22:26:17.493 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:17.482+0000 7f50a0b55740 10 client.15357 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-10T22:26:17.493 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:17.482+0000 7f50a0b55740 20 client.15357 populate_metadata read hostname 'smithi019' 2024-09-10T22:26:17.493 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:17.482+0000 7f50a0b55740 1 --2- 172.21.15.19:0/599041861 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x5618243bc7f0 0x5618243bec10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:26:17.493 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:17.483+0000 7f50a0b55740 4 client.15357 mds_command: new command op to 24581 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-10T22:26:17.493 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:17.483+0000 7f50a0b55740 1 -- 172.21.15.19:0/599041861 --> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x5618242a6860 con 0x5618243bc7f0 2024-09-10T22:26:17.493 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:17.483+0000 7f5097fff640 1 --2- 172.21.15.19:0/599041861 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x5618243bc7f0 0x5618243bec10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:26:17.493 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:17.483+0000 7f5097fff640 1 --2- 172.21.15.19:0/599041861 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x5618243bc7f0 0x5618243bec10 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=582976cb33c7da5b server_cookie=530d7e3d69815211 in_seq=0 out_seq=0 2024-09-10T22:26:17.494 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:17.483+0000 7f50777fe640 10 client.15357 ms_handle_connect on v2:172.21.15.135:6838/1254769802 2024-09-10T22:26:17.494 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:17.485+0000 7f50777fe640 1 -- 172.21.15.19:0/599041861 <== mds.0 v2:172.21.15.135:6838/1254769802 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x5618242a6860 con 0x5618243bc7f0 2024-09-10T22:26:17.494 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:17.485+0000 7f50777fe640 10 client.15357 handle_command_reply: tid=0 2024-09-10T22:26:17.494 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:17.485+0000 7f50a0b55740 1 client.15357 shutdown 2024-09-10T22:26:17.494 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:17.485+0000 7f50a0b55740 1 -- 172.21.15.19:0/599041861 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56182433e790 msgr2=0x5618243b4520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:26:17.494 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:17.485+0000 7f50a0b55740 1 --2- 172.21.15.19:0/599041861 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56182433e790 0x5618243b4520 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f50900e32c0 tx=0x7f50900aba10 comp rx=0 tx=0).stop 2024-09-10T22:26:17.494 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:17.485+0000 7f50a0b55740 1 -- 172.21.15.19:0/599041861 shutdown_connections 2024-09-10T22:26:17.494 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:17.485+0000 7f50a0b55740 1 --2- 172.21.15.19:0/599041861 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56182433e790 0x5618243b4520 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:26:17.494 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:17.485+0000 7f50a0b55740 1 --2- 172.21.15.19:0/599041861 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561824332800 0x5618243435a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:26:17.494 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:17.485+0000 7f50a0b55740 1 --2- 172.21.15.19:0/599041861 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x5618243bc7f0 0x5618243bec10 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:26:17.494 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:17.485+0000 7f50a0b55740 1 --2- 172.21.15.19:0/599041861 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x561824331ee0 0x561824343020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:26:17.494 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:17.485+0000 7f50a0b55740 1 -- 172.21.15.19:0/599041861 >> 172.21.15.19:0/599041861 conn(0x56182432fd10 msgr2=0x561824349ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:26:17.494 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:17.485+0000 7f50777fe640 0 client.15357 ms_handle_reset on v2:172.21.15.135:6838/1254769802 2024-09-10T22:26:17.494 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:17.485+0000 7f50a0b55740 1 -- 172.21.15.19:0/599041861 shutdown_connections 2024-09-10T22:26:17.495 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:17.485+0000 7f50a0b55740 1 -- 172.21.15.19:0/599041861 wait complete. 2024-09-10T22:26:17.495 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:17.485+0000 7f50a0b55740 20 client.15357 trim_cache size 0 max 16384 2024-09-10T22:26:17.495 INFO:teuthology.orchestra.run.smithi019.stdout:{ 2024-09-10T22:26:17.495 INFO:teuthology.orchestra.run.smithi019.stdout: "return_code": 0, 2024-09-10T22:26:17.495 INFO:teuthology.orchestra.run.smithi019.stdout: "scrub_tag": "9b6bfdee-303c-4c12-af56-dc85860d112a", 2024-09-10T22:26:17.495 INFO:teuthology.orchestra.run.smithi019.stdout: "mode": "asynchronous" 2024-09-10T22:26:17.495 INFO:teuthology.orchestra.run.smithi019.stdout:} 2024-09-10T22:26:17.496 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:17.486+0000 7f509e780640 1 -- 172.21.15.19:0/3695347373 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f50840b52e0 msgr2=0x7f50840b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:26:17.496 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:17.486+0000 7f509e780640 1 --2- 172.21.15.19:0/3695347373 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f50840b52e0 0x7f50840b77a0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f50880057c0 tx=0x7f5088031400 comp rx=0 tx=0).stop 2024-09-10T22:26:17.496 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:17.486+0000 7f509e780640 1 -- 172.21.15.19:0/3695347373 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f509810d0e0 msgr2=0x7f509819ebc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:26:17.497 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:17.486+0000 7f509e780640 1 --2- 172.21.15.19:0/3695347373 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f509810d0e0 0x7f509819ebc0 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f509000b970 tx=0x7f509000be30 comp rx=0 tx=0).stop 2024-09-10T22:26:17.497 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:17.486+0000 7f509e780640 1 -- 172.21.15.19:0/3695347373 shutdown_connections 2024-09-10T22:26:17.497 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:17.486+0000 7f509e780640 1 --2- 172.21.15.19:0/3695347373 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f50840b52e0 0x7f50840b77a0 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:26:17.497 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:17.486+0000 7f509e780640 1 --2- 172.21.15.19:0/3695347373 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f509810d0e0 0x7f509819ebc0 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:26:17.497 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:17.486+0000 7f509e780640 1 --2- 172.21.15.19:0/3695347373 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5098104530 0x7f5098199820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:26:17.497 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:17.486+0000 7f509e780640 1 --2- 172.21.15.19:0/3695347373 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5098103b30 0x7f50981992e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:26:17.497 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:17.486+0000 7f509e780640 1 -- 172.21.15.19:0/3695347373 >> 172.21.15.19:0/3695347373 conn(0x7f50980fd700 msgr2=0x7f50980fe300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:26:17.497 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:17.486+0000 7f509e780640 1 -- 172.21.15.19:0/3695347373 shutdown_connections 2024-09-10T22:26:17.497 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:17.486+0000 7f509e780640 1 -- 172.21.15.19:0/3695347373 wait complete. 2024-09-10T22:26:18.174 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 22997a4c-6fc2-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-10T22:26:18.360 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:26:17 smithi135 ceph-mon[34789]: pgmap v343: 97 pgs: 97 active+clean; 645 KiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 980 B/s wr, 6 op/s; 62 B/s, 0 objects/s recovering 2024-09-10T22:26:18.374 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:26:17 smithi138 ceph-mon[35236]: pgmap v343: 97 pgs: 97 active+clean; 645 KiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 980 B/s wr, 6 op/s; 62 B/s, 0 objects/s recovering 2024-09-10T22:26:18.458 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:26:17 smithi019 ceph-mon[31375]: pgmap v343: 97 pgs: 97 active+clean; 645 KiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 980 B/s wr, 6 op/s; 62 B/s, 0 objects/s recovering 2024-09-10T22:26:18.476 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/22997a4c-6fc2-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T22:26:18.980 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:18.978+0000 7efd85c39640 1 -- 172.21.15.19:0/1900203579 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7efd8010d250 msgr2=0x7efd8010f640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:26:18.981 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:18.978+0000 7efd85c39640 1 --2- 172.21.15.19:0/1900203579 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7efd8010d250 0x7efd8010f640 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7efd78009ca0 tx=0x7efd7802a8c0 comp rx=0 tx=0).stop 2024-09-10T22:26:18.981 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:18.978+0000 7efd85c39640 1 -- 172.21.15.19:0/1900203579 shutdown_connections 2024-09-10T22:26:18.981 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:18.978+0000 7efd85c39640 1 --2- 172.21.15.19:0/1900203579 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7efd8010d250 0x7efd8010f640 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:26:18.981 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:18.978+0000 7efd85c39640 1 --2- 172.21.15.19:0/1900203579 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7efd8010a920 0x7efd8010cd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:26:18.981 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:18.978+0000 7efd85c39640 1 --2- 172.21.15.19:0/1900203579 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efd80101810 0x7efd80101bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:26:18.981 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:18.978+0000 7efd85c39640 1 -- 172.21.15.19:0/1900203579 >> 172.21.15.19:0/1900203579 conn(0x7efd80076f50 msgr2=0x7efd80077360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:26:18.981 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:18.978+0000 7efd85c39640 1 -- 172.21.15.19:0/1900203579 shutdown_connections 2024-09-10T22:26:18.981 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:18.978+0000 7efd85c39640 1 -- 172.21.15.19:0/1900203579 wait complete. 2024-09-10T22:26:18.983 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:18.979+0000 7efd85c39640 1 Processor -- start 2024-09-10T22:26:18.983 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:18.979+0000 7efd85c39640 1 -- start start 2024-09-10T22:26:18.983 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:18.979+0000 7efd85c39640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7efd80101810 0x7efd8019b450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:26:18.983 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:18.979+0000 7efd85c39640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7efd8010a920 0x7efd8019b990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:26:18.983 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:18.979+0000 7efd85c39640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efd8010d250 0x7efd801a0d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:26:18.983 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:18.979+0000 7efd85c39640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7efd80112d90 con 0x7efd80101810 2024-09-10T22:26:18.983 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:18.979+0000 7efd85c39640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7efd80112c10 con 0x7efd8010d250 2024-09-10T22:26:18.983 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:18.979+0000 7efd85c39640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7efd80112f10 con 0x7efd8010a920 2024-09-10T22:26:18.983 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:18.979+0000 7efd7f7fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7efd80101810 0x7efd8019b450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:26:18.983 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:18.979+0000 7efd7f7fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7efd80101810 0x7efd8019b450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:46420/0 (socket says 172.21.15.19:46420) 2024-09-10T22:26:18.983 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:18.979+0000 7efd7f7fe640 1 -- 172.21.15.19:0/3963836771 learned_addr learned my addr 172.21.15.19:0/3963836771 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:26:18.984 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:18.980+0000 7efd7f7fe640 1 -- 172.21.15.19:0/3963836771 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7efd8010a920 msgr2=0x7efd8019b990 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-10T22:26:18.984 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:18.980+0000 7efd7f7fe640 1 --2- 172.21.15.19:0/3963836771 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7efd8010a920 0x7efd8019b990 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:26:18.984 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:18.980+0000 7efd7f7fe640 1 -- 172.21.15.19:0/3963836771 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efd8010d250 msgr2=0x7efd801a0d30 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-10T22:26:18.984 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:18.980+0000 7efd7f7fe640 1 --2- 172.21.15.19:0/3963836771 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efd8010d250 0x7efd801a0d30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:26:18.984 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:18.980+0000 7efd7f7fe640 1 -- 172.21.15.19:0/3963836771 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efd801a1500 con 0x7efd80101810 2024-09-10T22:26:18.984 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:18.980+0000 7efd7f7fe640 1 --2- 172.21.15.19:0/3963836771 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7efd80101810 0x7efd8019b450 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7efd7000d950 tx=0x7efd7000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:26:18.984 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:18.980+0000 7efd7cff9640 1 -- 172.21.15.19:0/3963836771 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd70017030 con 0x7efd80101810 2024-09-10T22:26:18.984 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:18.980+0000 7efd7cff9640 1 -- 172.21.15.19:0/3963836771 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7efd70004020 con 0x7efd80101810 2024-09-10T22:26:18.984 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:18.980+0000 7efd85c39640 1 -- 172.21.15.19:0/3963836771 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efd801a17f0 con 0x7efd80101810 2024-09-10T22:26:18.984 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:18.980+0000 7efd7cff9640 1 -- 172.21.15.19:0/3963836771 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd700047a0 con 0x7efd80101810 2024-09-10T22:26:18.984 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:18.980+0000 7efd85c39640 1 -- 172.21.15.19:0/3963836771 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efd801a7eb0 con 0x7efd80101810 2024-09-10T22:26:18.987 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:18.982+0000 7efd8800e740 1 Processor -- start 2024-09-10T22:26:18.987 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:18.983+0000 7efd7cff9640 1 -- 172.21.15.19:0/3963836771 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 18) ==== 153250+0+0 (secure 0 0 0) 0x7efd70009a30 con 0x7efd80101810 2024-09-10T22:26:18.987 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:18.983+0000 7efd8800e740 1 -- start start 2024-09-10T22:26:18.987 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:18.983+0000 7efd8800e740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5576116de480 0x5576116de860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:26:18.987 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:18.983+0000 7efd8800e740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5576116deda0 0x5576116ea7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:26:18.987 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:18.983+0000 7efd8800e740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5576116ead30 0x5576116ed120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:26:18.987 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:18.983+0000 7efd8800e740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x557611654e50 con 0x5576116de480 2024-09-10T22:26:18.988 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:18.983+0000 7efd8800e740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x557611644280 con 0x5576116deda0 2024-09-10T22:26:18.988 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:18.983+0000 7efd8800e740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x557611648090 con 0x5576116ead30 2024-09-10T22:26:18.988 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:18.983+0000 7efd7ffff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5576116de480 0x5576116de860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:26:18.988 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:18.983+0000 7efd7ffff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5576116de480 0x5576116de860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:46436/0 (socket says 172.21.15.19:46436) 2024-09-10T22:26:18.988 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:18.983+0000 7efd7ffff640 1 -- 172.21.15.19:0/3887990998 learned_addr learned my addr 172.21.15.19:0/3887990998 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:26:18.988 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:18.983+0000 7efd7f7fe640 1 --2- 172.21.15.19:0/3887990998 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5576116deda0 0x5576116ea7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:26:18.988 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:18.983+0000 7efd7effd640 1 --2- 172.21.15.19:0/3887990998 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5576116ead30 0x5576116ed120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:26:18.988 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:18.983+0000 7efd7ffff640 1 -- 172.21.15.19:0/3887990998 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5576116ead30 msgr2=0x5576116ed120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:26:18.988 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:18.983+0000 7efd7ffff640 1 --2- 172.21.15.19:0/3887990998 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5576116ead30 0x5576116ed120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:26:18.988 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:18.983+0000 7efd7ffff640 1 -- 172.21.15.19:0/3887990998 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5576116deda0 msgr2=0x5576116ea7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:26:18.988 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:18.983+0000 7efd7ffff640 1 --2- 172.21.15.19:0/3887990998 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5576116deda0 0x5576116ea7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:26:18.988 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:18.983+0000 7efd7ffff640 1 -- 172.21.15.19:0/3887990998 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5576113a2650 con 0x5576116de480 2024-09-10T22:26:18.989 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:18.984+0000 7efd7cff9640 1 --2- 172.21.15.19:0/3963836771 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7efd680b52e0 0x7efd680b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:26:18.989 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:18.984+0000 7efd7ffff640 1 --2- 172.21.15.19:0/3887990998 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5576116de480 0x5576116de860 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7efd780097b0 tx=0x7efd78009800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e7255788ec9a27d6 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:26:18.989 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:18.984+0000 7efd7f7fe640 1 --2- 172.21.15.19:0/3963836771 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7efd680b52e0 0x7efd680b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:26:18.989 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:18.984+0000 7efd65ffb640 1 -- 172.21.15.19:0/3887990998 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd78031cf0 con 0x5576116de480 2024-09-10T22:26:18.989 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:18.984+0000 7efd65ffb640 1 -- 172.21.15.19:0/3887990998 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7efd7803f070 con 0x5576116de480 2024-09-10T22:26:18.989 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:18.984+0000 7efd65ffb640 1 -- 172.21.15.19:0/3887990998 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd78003e60 con 0x5576116de480 2024-09-10T22:26:18.989 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:18.984+0000 7efd7cff9640 1 -- 172.21.15.19:0/3963836771 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8327+0+0 (secure 0 0 0) 0x7efd700e57b0 con 0x7efd80101810 2024-09-10T22:26:18.989 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:18.985+0000 7efd8800e740 1 -- 172.21.15.19:0/3887990998 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5576116de480 msgr2=0x5576116de860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:26:18.989 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:18.985+0000 7efd8800e740 1 --2- 172.21.15.19:0/3887990998 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5576116de480 0x5576116de860 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7efd780097b0 tx=0x7efd78009800 comp rx=0 tx=0).stop 2024-09-10T22:26:18.989 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:18.985+0000 7efd7f7fe640 1 --2- 172.21.15.19:0/3963836771 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7efd680b52e0 0x7efd680b77a0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7efd700e35c0 tx=0x7efd70093040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:26:18.989 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:18.985+0000 7efd8800e740 1 -- 172.21.15.19:0/3887990998 shutdown_connections 2024-09-10T22:26:18.989 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:18.985+0000 7efd8800e740 1 --2- 172.21.15.19:0/3887990998 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5576116ead30 0x5576116ed120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:26:18.989 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:18.985+0000 7efd8800e740 1 --2- 172.21.15.19:0/3887990998 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5576116deda0 0x5576116ea7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:26:18.990 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:18.985+0000 7efd8800e740 1 --2- 172.21.15.19:0/3887990998 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5576116de480 0x5576116de860 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:26:18.990 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:18.985+0000 7efd8800e740 1 -- 172.21.15.19:0/3887990998 >> 172.21.15.19:0/3887990998 conn(0x5576116dc2b0 msgr2=0x5576116dd450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:26:18.990 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:18.985+0000 7efd8800e740 1 -- 172.21.15.19:0/3887990998 shutdown_connections 2024-09-10T22:26:18.990 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:18.985+0000 7efd8800e740 1 -- 172.21.15.19:0/3887990998 wait complete. 2024-09-10T22:26:18.993 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:18.985+0000 7efd8800e740 1 -- start start 2024-09-10T22:26:18.993 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:18.986+0000 7efd8800e740 1 Processor -- start 2024-09-10T22:26:18.993 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:18.986+0000 7efd8800e740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5576116de480 0x5576116ea640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:26:18.994 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:18.986+0000 7efd8800e740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5576116deda0 0x5576116e7a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:26:18.994 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:18.986+0000 7efd8800e740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5576116ead30 0x5576116e80c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:26:18.994 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:18.986+0000 7efd8800e740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x5576114a5700 con 0x5576116de480 2024-09-10T22:26:18.994 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:18.986+0000 7efd8800e740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x5576115df110 con 0x5576116ead30 2024-09-10T22:26:18.994 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:18.986+0000 7efd8800e740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x5576116ed950 con 0x5576116deda0 2024-09-10T22:26:18.994 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:18.986+0000 7efd8800e740 10 client.0 _ll_register_callbacks cb 0x5576115f8990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T22:26:18.994 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:18.986+0000 7efd7ffff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5576116de480 0x5576116ea640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:26:18.994 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:18.986+0000 7efd7ffff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5576116de480 0x5576116ea640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:46446/0 (socket says 172.21.15.19:46446) 2024-09-10T22:26:18.994 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:18.986+0000 7efd7ffff640 1 -- 172.21.15.19:0/3357734456 learned_addr learned my addr 172.21.15.19:0/3357734456 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:26:18.994 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:18.987+0000 7efd7ffff640 1 -- 172.21.15.19:0/3357734456 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5576116deda0 msgr2=0x5576116e7a90 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-10T22:26:18.994 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:18.987+0000 7efd7ffff640 1 --2- 172.21.15.19:0/3357734456 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5576116deda0 0x5576116e7a90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:26:18.994 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:18.987+0000 7efd7ffff640 1 -- 172.21.15.19:0/3357734456 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5576116ead30 msgr2=0x5576116e80c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:26:18.995 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:18.987+0000 7efd7ffff640 1 --2- 172.21.15.19:0/3357734456 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5576116ead30 0x5576116e80c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:26:18.995 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:18.987+0000 7efd7ffff640 1 -- 172.21.15.19:0/3357734456 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55761160cc40 con 0x5576116de480 2024-09-10T22:26:18.995 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:18.987+0000 7efd7ffff640 1 --2- 172.21.15.19:0/3357734456 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5576116de480 0x5576116ea640 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7efd7802ade0 tx=0x7efd780099f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f7af4c48ccb9384d server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:26:18.995 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:18.987+0000 7efd5effd640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-10T22:26:18.995 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:18.987+0000 7efd5effd640 1 -- 172.21.15.19:0/3357734456 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd78053060 con 0x5576116de480 2024-09-10T22:26:18.995 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:18.987+0000 7efd5effd640 1 -- 172.21.15.19:0/3357734456 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8327+0+0 (secure 0 0 0) 0x7efd78004040 con 0x5576116de480 2024-09-10T22:26:18.995 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:18.987+0000 7efd8800e740 1 -- 172.21.15.19:0/3357734456 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7efd7803f070 con 0x5576116de480 2024-09-10T22:26:18.995 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:18.987+0000 7efd5effd640 1 -- 172.21.15.19:0/3357734456 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7efd78003e40 con 0x5576116de480 2024-09-10T22:26:18.995 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:18.987+0000 7efd8800e740 10 client.15369 fetch_fsmap learned FSMap version 25 2024-09-10T22:26:18.995 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:18.987+0000 7efd8800e740 1 -- 172.21.15.19:0/3357734456 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x5576116f92e0 con 0x5576116de480 2024-09-10T22:26:18.995 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:18.988+0000 7efd5effd640 1 -- 172.21.15.19:0/3357734456 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7efd7803f070 con 0x5576116de480 2024-09-10T22:26:18.995 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:18.988+0000 7efd5effd640 1 -- 172.21.15.19:0/3357734456 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7efd78057030 con 0x5576116de480 2024-09-10T22:26:18.995 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:18.988+0000 7efd8800e740 10 client.15369 fetch_fsmap finished waiting for FSMap version 25 2024-09-10T22:26:18.996 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:18.988+0000 7efd8800e740 10 client.15369 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-10T22:26:18.996 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:18.988+0000 7efd8800e740 20 client.15369 populate_metadata read hostname 'smithi019' 2024-09-10T22:26:18.996 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:18.988+0000 7efd8800e740 1 --2- 172.21.15.19:0/3357734456 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x5576116fa630 0x5576116fca20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:26:18.996 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:18.988+0000 7efd8800e740 4 client.15369 mds_command: new command op to 24581 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T22:26:18.996 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:18.988+0000 7efd8800e740 1 -- 172.21.15.19:0/3357734456 --> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x557611656da0 con 0x5576116fa630 2024-09-10T22:26:18.996 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:18.988+0000 7efd7effd640 1 --2- 172.21.15.19:0/3357734456 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x5576116fa630 0x5576116fca20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:26:18.996 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:18.989+0000 7efd7effd640 1 --2- 172.21.15.19:0/3357734456 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x5576116fa630 0x5576116fca20 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6b5798605a4d23bf server_cookie=56879f4869ba560 in_seq=0 out_seq=0 2024-09-10T22:26:18.996 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:18.989+0000 7efd5effd640 10 client.15369 ms_handle_connect on v2:172.21.15.135:6838/1254769802 2024-09-10T22:26:18.996 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:18.990+0000 7efd5effd640 1 -- 172.21.15.19:0/3357734456 <== mds.0 v2:172.21.15.135:6838/1254769802 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x557611656da0 con 0x5576116fa630 2024-09-10T22:26:18.996 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:18.990+0000 7efd5effd640 10 client.15369 handle_command_reply: tid=0 2024-09-10T22:26:18.996 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:18.990+0000 7efd8800e740 1 client.15369 shutdown 2024-09-10T22:26:18.996 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:18.990+0000 7efd8800e740 1 -- 172.21.15.19:0/3357734456 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5576116de480 msgr2=0x5576116ea640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:26:18.996 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:18.990+0000 7efd8800e740 1 --2- 172.21.15.19:0/3357734456 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5576116de480 0x5576116ea640 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7efd7802ade0 tx=0x7efd780099f0 comp rx=0 tx=0).stop 2024-09-10T22:26:18.997 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:18.990+0000 7efd8800e740 1 -- 172.21.15.19:0/3357734456 shutdown_connections 2024-09-10T22:26:18.997 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:18.990+0000 7efd8800e740 1 --2- 172.21.15.19:0/3357734456 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5576116ead30 0x5576116e80c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:26:18.997 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:18.990+0000 7efd8800e740 1 --2- 172.21.15.19:0/3357734456 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x5576116fa630 0x5576116fca20 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:26:18.997 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:18.990+0000 7efd8800e740 1 --2- 172.21.15.19:0/3357734456 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5576116deda0 0x5576116e7a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:26:18.997 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:18.990+0000 7efd8800e740 1 --2- 172.21.15.19:0/3357734456 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5576116de480 0x5576116ea640 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:26:18.997 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:18.990+0000 7efd5effd640 0 client.15369 ms_handle_reset on v2:172.21.15.135:6838/1254769802 2024-09-10T22:26:18.997 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:18.990+0000 7efd8800e740 1 -- 172.21.15.19:0/3357734456 >> 172.21.15.19:0/3357734456 conn(0x5576116dc2b0 msgr2=0x5576116e1e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:26:18.997 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:18.990+0000 7efd8800e740 1 -- 172.21.15.19:0/3357734456 shutdown_connections 2024-09-10T22:26:18.997 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:18.990+0000 7efd8800e740 1 -- 172.21.15.19:0/3357734456 wait complete. 2024-09-10T22:26:18.997 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:18.991+0000 7efd8800e740 20 client.15369 trim_cache size 0 max 16384 2024-09-10T22:26:19.016 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:19.012+0000 7efd8800e740 1 Processor -- start 2024-09-10T22:26:19.017 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:19.012+0000 7efd8800e740 1 -- start start 2024-09-10T22:26:19.017 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:19.012+0000 7efd8800e740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5576116de480 0x5576116ddaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:26:19.017 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:19.012+0000 7efd8800e740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5576116deda0 0x5576116dbbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:26:19.017 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:19.012+0000 7efd8800e740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5576116ead30 0x5576116ec120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:26:19.017 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:19.013+0000 7efd8800e740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7efd801b3080 con 0x5576116deda0 2024-09-10T22:26:19.017 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:19.013+0000 7efd8800e740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7efd801b0950 con 0x5576116ead30 2024-09-10T22:26:19.017 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:19.013+0000 7efd8800e740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7efd801ae7a0 con 0x5576116de480 2024-09-10T22:26:19.017 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:19.013+0000 7efd7effd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5576116deda0 0x5576116dbbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:26:19.017 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:19.013+0000 7efd7effd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5576116deda0 0x5576116dbbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:46454/0 (socket says 172.21.15.19:46454) 2024-09-10T22:26:19.017 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:19.013+0000 7efd7effd640 1 -- 172.21.15.19:0/767515401 learned_addr learned my addr 172.21.15.19:0/767515401 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:26:19.017 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:19.013+0000 7efd7ffff640 1 --2- 172.21.15.19:0/767515401 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5576116de480 0x5576116ddaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:26:19.018 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:19.013+0000 7efd7ffff640 1 --2- 172.21.15.19:0/767515401 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5576116ead30 0x5576116ec120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:26:19.018 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:19.013+0000 7efd7effd640 1 -- 172.21.15.19:0/767515401 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5576116de480 msgr2=0x5576116ddaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:26:19.018 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:19.013+0000 7efd7effd640 1 --2- 172.21.15.19:0/767515401 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5576116de480 0x5576116ddaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:26:19.018 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:19.013+0000 7efd7effd640 1 -- 172.21.15.19:0/767515401 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5576116ead30 msgr2=0x5576116ec120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:26:19.018 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:19.013+0000 7efd7effd640 1 --2- 172.21.15.19:0/767515401 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5576116ead30 0x5576116ec120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:26:19.018 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:19.013+0000 7efd7effd640 1 -- 172.21.15.19:0/767515401 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5576116dcf90 con 0x5576116deda0 2024-09-10T22:26:19.018 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:19.013+0000 7efd7ffff640 1 --2- 172.21.15.19:0/767515401 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5576116ead30 0x5576116ec120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T22:26:19.018 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:19.013+0000 7efd7effd640 1 --2- 172.21.15.19:0/767515401 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5576116deda0 0x5576116dbbc0 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7efd74005fd0 tx=0x7efd7400b260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7206443eaabd72c5 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:26:19.018 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:19.013+0000 7efd657fa640 1 -- 172.21.15.19:0/767515401 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd7400bbb0 con 0x5576116deda0 2024-09-10T22:26:19.018 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:19.013+0000 7efd657fa640 1 -- 172.21.15.19:0/767515401 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7efd74003ee0 con 0x5576116deda0 2024-09-10T22:26:19.018 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:19.013+0000 7efd657fa640 1 -- 172.21.15.19:0/767515401 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd74004d10 con 0x5576116deda0 2024-09-10T22:26:19.018 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:19.014+0000 7efd8800e740 1 -- 172.21.15.19:0/767515401 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5576116deda0 msgr2=0x5576116dbbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:26:19.019 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:19.014+0000 7efd8800e740 1 --2- 172.21.15.19:0/767515401 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5576116deda0 0x5576116dbbc0 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7efd74005fd0 tx=0x7efd7400b260 comp rx=0 tx=0).stop 2024-09-10T22:26:19.019 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:19.014+0000 7efd8800e740 1 -- 172.21.15.19:0/767515401 shutdown_connections 2024-09-10T22:26:19.019 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:19.014+0000 7efd8800e740 1 --2- 172.21.15.19:0/767515401 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5576116ead30 0x5576116ec120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:26:19.019 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:19.014+0000 7efd8800e740 1 --2- 172.21.15.19:0/767515401 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5576116deda0 0x5576116dbbc0 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:26:19.019 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:19.014+0000 7efd8800e740 1 --2- 172.21.15.19:0/767515401 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5576116de480 0x5576116ddaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:26:19.019 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:19.014+0000 7efd8800e740 1 -- 172.21.15.19:0/767515401 >> 172.21.15.19:0/767515401 conn(0x5576116dc2b0 msgr2=0x5576116dd3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:26:19.019 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:19.014+0000 7efd8800e740 1 -- 172.21.15.19:0/767515401 shutdown_connections 2024-09-10T22:26:19.019 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:19.014+0000 7efd8800e740 1 -- 172.21.15.19:0/767515401 wait complete. 2024-09-10T22:26:19.019 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:19.015+0000 7efd8800e740 1 -- start start 2024-09-10T22:26:19.022 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:19.015+0000 7efd8800e740 1 Processor -- start 2024-09-10T22:26:19.022 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:19.015+0000 7efd8800e740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5576116de480 0x5576117002f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:26:19.022 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:19.015+0000 7efd8800e740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5576116deda0 0x5576116fc7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:26:19.023 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:19.015+0000 7efd8800e740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5576116ead30 0x5576116fce00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:26:19.023 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:19.015+0000 7efd8800e740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7efd801aee10 con 0x5576116ead30 2024-09-10T22:26:19.023 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:19.015+0000 7efd8800e740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7efd801b0280 con 0x5576116de480 2024-09-10T22:26:19.023 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:19.015+0000 7efd8800e740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7efd801af4e0 con 0x5576116deda0 2024-09-10T22:26:19.023 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:19.015+0000 7efd8800e740 10 client.0 _ll_register_callbacks cb 0x7efd700eb420 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T22:26:19.023 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:19.015+0000 7efd7ffff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5576116ead30 0x5576116fce00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:26:19.023 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:19.015+0000 7efd7ffff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5576116ead30 0x5576116fce00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:46466/0 (socket says 172.21.15.19:46466) 2024-09-10T22:26:19.023 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:19.015+0000 7efd7ffff640 1 -- 172.21.15.19:0/84580665 learned_addr learned my addr 172.21.15.19:0/84580665 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:26:19.023 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:19.015+0000 7efd7ffff640 1 --2- 172.21.15.19:0/84580665 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5576116de480 0x5576117002f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:26:19.023 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:19.016+0000 7efd7ffff640 1 -- 172.21.15.19:0/84580665 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5576116deda0 msgr2=0x5576116fc7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:26:19.023 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:19.016+0000 7efd7effd640 1 --2- 172.21.15.19:0/84580665 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5576116deda0 0x5576116fc7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:26:19.023 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:19.016+0000 7efd7ffff640 1 --2- 172.21.15.19:0/84580665 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5576116deda0 0x5576116fc7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:26:19.023 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:19.016+0000 7efd7ffff640 1 -- 172.21.15.19:0/84580665 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5576116de480 msgr2=0x5576117002f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:26:19.024 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:19.016+0000 7efd7ffff640 1 --2- 172.21.15.19:0/84580665 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5576116de480 0x5576117002f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:26:19.024 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:19.016+0000 7efd7ffff640 1 -- 172.21.15.19:0/84580665 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5576117671a0 con 0x5576116ead30 2024-09-10T22:26:19.024 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:19.016+0000 7efd7ffff640 1 --2- 172.21.15.19:0/84580665 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5576116ead30 0x5576116fce00 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7efd7802fa80 tx=0x7efd780099f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=72f9f29a2366acb2 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:26:19.024 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:19.016+0000 7efd5effd640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-10T22:26:19.024 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:19.016+0000 7efd5effd640 1 -- 172.21.15.19:0/84580665 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd78053040 con 0x5576116ead30 2024-09-10T22:26:19.024 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:19.016+0000 7efd8800e740 1 -- 172.21.15.19:0/84580665 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7efd74003ee0 con 0x5576116ead30 2024-09-10T22:26:19.024 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:19.016+0000 7efd5effd640 1 -- 172.21.15.19:0/84580665 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8327+0+0 (secure 0 0 0) 0x7efd78031890 con 0x5576116ead30 2024-09-10T22:26:19.024 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:19.016+0000 7efd5effd640 1 -- 172.21.15.19:0/84580665 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7efd7802fd70 con 0x5576116ead30 2024-09-10T22:26:19.024 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:19.016+0000 7efd8800e740 10 client.15375 fetch_fsmap learned FSMap version 25 2024-09-10T22:26:19.024 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:19.016+0000 7efd8800e740 1 -- 172.21.15.19:0/84580665 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x557611768270 con 0x5576116ead30 2024-09-10T22:26:19.024 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:19.016+0000 7efd5effd640 1 -- 172.21.15.19:0/84580665 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7efd74003ee0 con 0x5576116ead30 2024-09-10T22:26:19.024 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:19.016+0000 7efd5effd640 1 -- 172.21.15.19:0/84580665 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7efd78057040 con 0x5576116ead30 2024-09-10T22:26:19.025 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:19.017+0000 7efd8800e740 10 client.15375 fetch_fsmap finished waiting for FSMap version 25 2024-09-10T22:26:19.025 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:19.017+0000 7efd8800e740 10 client.15375 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-10T22:26:19.025 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:19.017+0000 7efd8800e740 20 client.15375 populate_metadata read hostname 'smithi019' 2024-09-10T22:26:19.025 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:19.017+0000 7efd8800e740 1 --2- 172.21.15.19:0/84580665 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x5576117688e0 0x55761176ad00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:26:19.025 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:19.017+0000 7efd8800e740 4 client.15375 mds_command: new command op to 24581 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-10T22:26:19.025 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:19.017+0000 7efd8800e740 1 -- 172.21.15.19:0/84580665 --> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] -- command(tid 0: {"prefix": "scrub status"}) -- 0x557611652850 con 0x5576117688e0 2024-09-10T22:26:19.025 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:19.017+0000 7efd7effd640 1 --2- 172.21.15.19:0/84580665 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x5576117688e0 0x55761176ad00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:26:19.025 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:19.017+0000 7efd7effd640 1 --2- 172.21.15.19:0/84580665 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x5576117688e0 0x55761176ad00 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ddcad932e9cb55bc server_cookie=19b91acfa83a8c2a in_seq=0 out_seq=0 2024-09-10T22:26:19.025 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:19.017+0000 7efd5effd640 10 client.15375 ms_handle_connect on v2:172.21.15.135:6838/1254769802 2024-09-10T22:26:19.025 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:19.017+0000 7efd5effd640 1 -- 172.21.15.19:0/84580665 <== mds.0 v2:172.21.15.135:6838/1254769802 1 ==== command_reply(tid 0: 0 ) ==== 8+0+570 (crc 0 0 0) 0x557611652850 con 0x5576117688e0 2024-09-10T22:26:19.025 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:19.017+0000 7efd5effd640 10 client.15375 handle_command_reply: tid=0 2024-09-10T22:26:19.025 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:19.017+0000 7efd8800e740 1 client.15375 shutdown 2024-09-10T22:26:19.025 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:19.018+0000 7efd8800e740 1 -- 172.21.15.19:0/84580665 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5576116ead30 msgr2=0x5576116fce00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:26:19.026 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:19.018+0000 7efd8800e740 1 --2- 172.21.15.19:0/84580665 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5576116ead30 0x5576116fce00 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7efd7802fa80 tx=0x7efd780099f0 comp rx=0 tx=0).stop 2024-09-10T22:26:19.026 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:19.018+0000 7efd8800e740 1 -- 172.21.15.19:0/84580665 shutdown_connections 2024-09-10T22:26:19.026 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:19.018+0000 7efd8800e740 1 --2- 172.21.15.19:0/84580665 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5576116ead30 0x5576116fce00 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:26:19.026 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:19.018+0000 7efd8800e740 1 --2- 172.21.15.19:0/84580665 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x5576117688e0 0x55761176ad00 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:26:19.026 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:19.018+0000 7efd8800e740 1 --2- 172.21.15.19:0/84580665 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5576116deda0 0x5576116fc7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:26:19.026 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:19.018+0000 7efd5effd640 0 client.15375 ms_handle_reset on v2:172.21.15.135:6838/1254769802 2024-09-10T22:26:19.026 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:19.018+0000 7efd8800e740 1 --2- 172.21.15.19:0/84580665 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5576116de480 0x5576117002f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:26:19.026 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:19.018+0000 7efd8800e740 1 -- 172.21.15.19:0/84580665 >> 172.21.15.19:0/84580665 conn(0x5576116dc2b0 msgr2=0x5576116e1550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:26:19.026 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:19.018+0000 7efd8800e740 1 -- 172.21.15.19:0/84580665 shutdown_connections 2024-09-10T22:26:19.026 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:19.018+0000 7efd8800e740 1 -- 172.21.15.19:0/84580665 wait complete. 2024-09-10T22:26:19.026 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:19.018+0000 7efd8800e740 20 client.15375 trim_cache size 0 max 16384 2024-09-10T22:26:19.027 INFO:teuthology.orchestra.run.smithi019.stdout:{ 2024-09-10T22:26:19.027 INFO:teuthology.orchestra.run.smithi019.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-10T22:26:19.027 INFO:teuthology.orchestra.run.smithi019.stdout: "scrubs": { 2024-09-10T22:26:19.027 INFO:teuthology.orchestra.run.smithi019.stdout: "9b6bfdee-303c-4c12-af56-dc85860d112a": { 2024-09-10T22:26:19.027 INFO:teuthology.orchestra.run.smithi019.stdout: "path": "/", 2024-09-10T22:26:19.027 INFO:teuthology.orchestra.run.smithi019.stdout: "tag": "9b6bfdee-303c-4c12-af56-dc85860d112a", 2024-09-10T22:26:19.027 INFO:teuthology.orchestra.run.smithi019.stdout: "options": "recursive,force" 2024-09-10T22:26:19.027 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-10T22:26:19.027 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:26:19.027 INFO:teuthology.orchestra.run.smithi019.stdout: "scrub_stats": { 2024-09-10T22:26:19.027 INFO:teuthology.orchestra.run.smithi019.stdout: "9b6bfdee-303c-4c12-af56-dc85860d112a": { 2024-09-10T22:26:19.027 INFO:teuthology.orchestra.run.smithi019.stdout: "start_time": "2024-09-10T22:26:17.484162+0000", 2024-09-10T22:26:19.028 INFO:teuthology.orchestra.run.smithi019.stdout: "path": "/", 2024-09-10T22:26:19.028 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_started": 0, 2024-09-10T22:26:19.028 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_passed": 0, 2024-09-10T22:26:19.028 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_failed": 0, 2024-09-10T22:26:19.028 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_skipped": 0 2024-09-10T22:26:19.028 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-10T22:26:19.028 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-10T22:26:19.028 INFO:teuthology.orchestra.run.smithi019.stdout:} 2024-09-10T22:26:19.029 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:19.018+0000 7efd85c39640 1 -- 172.21.15.19:0/3963836771 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7efd680b52e0 msgr2=0x7efd680b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:26:19.029 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:19.018+0000 7efd85c39640 1 --2- 172.21.15.19:0/3963836771 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7efd680b52e0 0x7efd680b77a0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7efd700e35c0 tx=0x7efd70093040 comp rx=0 tx=0).stop 2024-09-10T22:26:19.029 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:19.018+0000 7efd85c39640 1 -- 172.21.15.19:0/3963836771 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7efd80101810 msgr2=0x7efd8019b450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:26:19.029 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:19.018+0000 7efd85c39640 1 --2- 172.21.15.19:0/3963836771 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7efd80101810 0x7efd8019b450 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7efd7000d950 tx=0x7efd7000de10 comp rx=0 tx=0).stop 2024-09-10T22:26:19.029 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:19.018+0000 7efd85c39640 1 -- 172.21.15.19:0/3963836771 shutdown_connections 2024-09-10T22:26:19.029 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:19.019+0000 7efd85c39640 1 --2- 172.21.15.19:0/3963836771 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7efd680b52e0 0x7efd680b77a0 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:26:19.029 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:19.019+0000 7efd85c39640 1 --2- 172.21.15.19:0/3963836771 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efd8010d250 0x7efd801a0d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:26:19.029 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:19.019+0000 7efd85c39640 1 --2- 172.21.15.19:0/3963836771 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7efd8010a920 0x7efd8019b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:26:19.030 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:19.019+0000 7efd85c39640 1 --2- 172.21.15.19:0/3963836771 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7efd80101810 0x7efd8019b450 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:26:19.030 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:19.019+0000 7efd85c39640 1 -- 172.21.15.19:0/3963836771 >> 172.21.15.19:0/3963836771 conn(0x7efd80076f50 msgr2=0x7efd80108ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:26:19.030 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:19.019+0000 7efd85c39640 1 -- 172.21.15.19:0/3963836771 shutdown_connections 2024-09-10T22:26:19.030 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:19.019+0000 7efd85c39640 1 -- 172.21.15.19:0/3963836771 wait complete. 2024-09-10T22:26:19.208 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:26:19 smithi019 ceph-mon[31375]: scrub queued for path: / 2024-09-10T22:26:19.208 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:26:19 smithi019 ceph-mon[31375]: scrub summary: idle+waiting paths [/] 2024-09-10T22:26:19.208 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:26:19 smithi019 ceph-mon[31375]: scrub summary: active paths [/] 2024-09-10T22:26:19.208 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:26:19 smithi019 ceph-mon[31375]: scrub summary: idle+waiting paths [/] 2024-09-10T22:26:19.277 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:26:19 smithi138 ceph-mon[35236]: scrub queued for path: / 2024-09-10T22:26:19.277 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:26:19 smithi138 ceph-mon[35236]: scrub summary: idle+waiting paths [/] 2024-09-10T22:26:19.277 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:26:19 smithi138 ceph-mon[35236]: scrub summary: active paths [/] 2024-09-10T22:26:19.278 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:26:19 smithi138 ceph-mon[35236]: scrub summary: idle+waiting paths [/] 2024-09-10T22:26:19.360 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:26:19 smithi135 ceph-mon[34789]: scrub queued for path: / 2024-09-10T22:26:19.360 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:26:19 smithi135 ceph-mon[34789]: scrub summary: idle+waiting paths [/] 2024-09-10T22:26:19.360 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:26:19 smithi135 ceph-mon[34789]: scrub summary: active paths [/] 2024-09-10T22:26:19.360 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:26:19 smithi135 ceph-mon[34789]: scrub summary: idle+waiting paths [/] 2024-09-10T22:26:19.853 INFO:tasks.cephfs.filesystem:scrub status for tag:9b6bfdee-303c-4c12-af56-dc85860d112a - {'path': '/', 'tag': '9b6bfdee-303c-4c12-af56-dc85860d112a', 'options': 'recursive,force'} 2024-09-10T22:26:20.208 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:26:20 smithi019 ceph-mon[31375]: pgmap v344: 97 pgs: 97 active+clean; 645 KiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 853 B/s wr, 5 op/s; 54 B/s, 0 objects/s recovering 2024-09-10T22:26:20.359 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:26:20 smithi135 ceph-mon[34789]: pgmap v344: 97 pgs: 97 active+clean; 645 KiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 853 B/s wr, 5 op/s; 54 B/s, 0 objects/s recovering 2024-09-10T22:26:20.375 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:26:20 smithi138 ceph-mon[35236]: pgmap v344: 97 pgs: 97 active+clean; 645 KiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 853 B/s wr, 5 op/s; 54 B/s, 0 objects/s recovering 2024-09-10T22:26:22.360 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:26:22 smithi135 ceph-mon[34789]: pgmap v345: 97 pgs: 97 active+clean; 645 KiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 938 B/s wr, 7 op/s; 54 B/s, 0 objects/s recovering 2024-09-10T22:26:22.375 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:26:22 smithi138 ceph-mon[35236]: pgmap v345: 97 pgs: 97 active+clean; 645 KiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 938 B/s wr, 7 op/s; 54 B/s, 0 objects/s recovering 2024-09-10T22:26:22.458 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:26:22 smithi019 ceph-mon[31375]: pgmap v345: 97 pgs: 97 active+clean; 645 KiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 938 B/s wr, 7 op/s; 54 B/s, 0 objects/s recovering 2024-09-10T22:26:24.359 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:26:24 smithi135 ceph-mon[34789]: pgmap v346: 97 pgs: 97 active+clean; 651 KiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 1.2 KiB/s wr, 7 op/s 2024-09-10T22:26:24.375 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:26:24 smithi138 ceph-mon[35236]: pgmap v346: 97 pgs: 97 active+clean; 651 KiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 1.2 KiB/s wr, 7 op/s 2024-09-10T22:26:24.458 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:26:24 smithi019 ceph-mon[31375]: pgmap v346: 97 pgs: 97 active+clean; 651 KiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 1.2 KiB/s wr, 7 op/s 2024-09-10T22:26:26.359 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:26:26 smithi135 ceph-mon[34789]: pgmap v347: 97 pgs: 97 active+clean; 651 KiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 1.1 KiB/s wr, 5 op/s 2024-09-10T22:26:26.375 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:26:26 smithi138 ceph-mon[35236]: pgmap v347: 97 pgs: 97 active+clean; 651 KiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 1.1 KiB/s wr, 5 op/s 2024-09-10T22:26:26.458 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:26:26 smithi019 ceph-mon[31375]: pgmap v347: 97 pgs: 97 active+clean; 651 KiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 1.1 KiB/s wr, 5 op/s 2024-09-10T22:26:28.359 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:26:28 smithi135 ceph-mon[34789]: pgmap v348: 97 pgs: 97 active+clean; 651 KiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 1.1 KiB/s wr, 8 op/s 2024-09-10T22:26:28.374 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:26:28 smithi138 ceph-mon[35236]: pgmap v348: 97 pgs: 97 active+clean; 651 KiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 1.1 KiB/s wr, 8 op/s 2024-09-10T22:26:28.458 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:26:28 smithi019 ceph-mon[31375]: pgmap v348: 97 pgs: 97 active+clean; 651 KiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 1.1 KiB/s wr, 8 op/s 2024-09-10T22:26:29.811 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:29.807+0000 7f571dfe8640 1 -- 172.21.15.19:0/847160355 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f571806b410 msgr2=0x7f5718105590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:26:29.811 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:29.807+0000 7f571dfe8640 1 --2- 172.21.15.19:0/847160355 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f571806b410 0x7f5718105590 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f5708009900 tx=0x7f570802a410 comp rx=0 tx=0).stop 2024-09-10T22:26:29.811 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:29.808+0000 7f571dfe8640 1 -- 172.21.15.19:0/847160355 shutdown_connections 2024-09-10T22:26:29.811 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:29.808+0000 7f571dfe8640 1 --2- 172.21.15.19:0/847160355 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5718108680 0x7f571810ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:26:29.811 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:29.808+0000 7f571dfe8640 1 --2- 172.21.15.19:0/847160355 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5718105ad0 0x7f5718107f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:26:29.811 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:29.808+0000 7f571dfe8640 1 --2- 172.21.15.19:0/847160355 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f571806b410 0x7f5718105590 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:26:29.812 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:29.808+0000 7f571dfe8640 1 -- 172.21.15.19:0/847160355 >> 172.21.15.19:0/847160355 conn(0x7f57180fd140 msgr2=0x7f57180ff560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:26:29.812 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:29.808+0000 7f571dfe8640 1 -- 172.21.15.19:0/847160355 shutdown_connections 2024-09-10T22:26:29.812 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:29.808+0000 7f571dfe8640 1 -- 172.21.15.19:0/847160355 wait complete. 2024-09-10T22:26:29.812 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:29.808+0000 7f571dfe8640 1 Processor -- start 2024-09-10T22:26:29.812 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:29.808+0000 7f571dfe8640 1 -- start start 2024-09-10T22:26:29.812 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:29.809+0000 7f571dfe8640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f571806b410 0x7f5718198e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:26:29.812 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:29.809+0000 7f571dfe8640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5718105ad0 0x7f5718199480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:26:29.812 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:29.809+0000 7f571dfe8640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5718108680 0x7f571819a0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:26:29.812 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:29.809+0000 7f571dfe8640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f571810e670 con 0x7f571806b410 2024-09-10T22:26:29.812 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:29.809+0000 7f571dfe8640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f571810e4f0 con 0x7f5718108680 2024-09-10T22:26:29.812 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:29.809+0000 7f571dfe8640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f571810e7f0 con 0x7f5718105ad0 2024-09-10T22:26:29.812 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:29.809+0000 7f57177fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f571806b410 0x7f5718198e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:26:29.813 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:29.809+0000 7f57177fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f571806b410 0x7f5718198e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:51422/0 (socket says 172.21.15.19:51422) 2024-09-10T22:26:29.813 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:29.809+0000 7f57177fe640 1 -- 172.21.15.19:0/2507755258 learned_addr learned my addr 172.21.15.19:0/2507755258 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:26:29.813 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:29.809+0000 7f5717fff640 1 --2- 172.21.15.19:0/2507755258 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5718108680 0x7f571819a0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:26:29.813 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:29.809+0000 7f570ffff640 1 --2- 172.21.15.19:0/2507755258 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5718105ad0 0x7f5718199480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:26:29.813 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:29.809+0000 7f57177fe640 1 -- 172.21.15.19:0/2507755258 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5718105ad0 msgr2=0x7f5718199480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:26:29.813 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:29.809+0000 7f57177fe640 1 --2- 172.21.15.19:0/2507755258 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5718105ad0 0x7f5718199480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:26:29.813 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:29.809+0000 7f57177fe640 1 -- 172.21.15.19:0/2507755258 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5718108680 msgr2=0x7f571819a0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:26:29.813 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:29.809+0000 7f57177fe640 1 --2- 172.21.15.19:0/2507755258 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5718108680 0x7f571819a0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:26:29.813 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:29.809+0000 7f57177fe640 1 -- 172.21.15.19:0/2507755258 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f571819a970 con 0x7f571806b410 2024-09-10T22:26:29.813 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:29.809+0000 7f57177fe640 1 --2- 172.21.15.19:0/2507755258 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f571806b410 0x7f5718198e30 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f5708005940 tx=0x7f5708004430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:26:29.813 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:29.809+0000 7f57157fa640 1 -- 172.21.15.19:0/2507755258 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f570803f030 con 0x7f571806b410 2024-09-10T22:26:29.813 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:29.809+0000 7f57157fa640 1 -- 172.21.15.19:0/2507755258 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5708003cb0 con 0x7f571806b410 2024-09-10T22:26:29.813 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:29.810+0000 7f57157fa640 1 -- 172.21.15.19:0/2507755258 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5708035070 con 0x7f571806b410 2024-09-10T22:26:29.814 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:29.810+0000 7f571dfe8640 1 -- 172.21.15.19:0/2507755258 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f571819ac00 con 0x7f571806b410 2024-09-10T22:26:29.814 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:29.810+0000 7f571dfe8640 1 -- 172.21.15.19:0/2507755258 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f57181015d0 con 0x7f571806b410 2024-09-10T22:26:29.816 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:29.812+0000 7f57157fa640 1 -- 172.21.15.19:0/2507755258 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 18) ==== 153250+0+0 (secure 0 0 0) 0x7f570803bbf0 con 0x7f571806b410 2024-09-10T22:26:29.816 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:29.813+0000 7f5720e90740 1 Processor -- start 2024-09-10T22:26:29.816 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:29.813+0000 7f57157fa640 1 --2- 172.21.15.19:0/2507755258 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f57040b5360 0x7f57040b7820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:26:29.816 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:29.813+0000 7f5720e90740 1 -- start start 2024-09-10T22:26:29.816 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:29.813+0000 7f5717fff640 1 --2- 172.21.15.19:0/2507755258 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f57040b5360 0x7f57040b7820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:26:29.816 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:29.813+0000 7f57157fa640 1 -- 172.21.15.19:0/2507755258 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8327+0+0 (secure 0 0 0) 0x7f5708106430 con 0x7f571806b410 2024-09-10T22:26:29.816 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:29.813+0000 7f5720e90740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x561e920be860 0x561e920c0c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:26:29.816 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:29.813+0000 7f5720e90740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561e920c1190 0x561e920c3580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:26:29.816 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:29.813+0000 7f5720e90740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x561e920c3bd0 0x561e920c6090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:26:29.816 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:29.813+0000 7f5720e90740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x561e920306f0 con 0x561e920c3bd0 2024-09-10T22:26:29.816 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:29.813+0000 7f5720e90740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x561e9201fb20 con 0x561e920c1190 2024-09-10T22:26:29.817 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:29.813+0000 7f5720e90740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x561e92023930 con 0x561e920be860 2024-09-10T22:26:29.817 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:29.813+0000 7f5717fff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x561e920c3bd0 0x561e920c6090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:26:29.817 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:29.814+0000 7f5717fff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x561e920c3bd0 0x561e920c6090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:51430/0 (socket says 172.21.15.19:51430) 2024-09-10T22:26:29.817 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:29.814+0000 7f5717fff640 1 -- 172.21.15.19:0/3636637527 learned_addr learned my addr 172.21.15.19:0/3636637527 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:26:29.817 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:29.814+0000 7f57177fe640 1 --2- 172.21.15.19:0/3636637527 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x561e920be860 0x561e920c0c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:26:29.817 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:29.814+0000 7f570ffff640 1 --2- 172.21.15.19:0/3636637527 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561e920c1190 0x561e920c3580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:26:29.817 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:29.814+0000 7f57177fe640 1 -- 172.21.15.19:0/3636637527 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561e920c1190 msgr2=0x561e920c3580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:26:29.817 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:29.814+0000 7f57177fe640 1 --2- 172.21.15.19:0/3636637527 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561e920c1190 0x561e920c3580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:26:29.817 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:29.814+0000 7f57177fe640 1 -- 172.21.15.19:0/3636637527 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x561e920c3bd0 msgr2=0x561e920c6090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:26:29.817 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:29.814+0000 7f57177fe640 1 --2- 172.21.15.19:0/3636637527 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x561e920c3bd0 0x561e920c6090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:26:29.817 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:29.814+0000 7f57177fe640 1 -- 172.21.15.19:0/3636637527 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561e91fe5530 con 0x561e920be860 2024-09-10T22:26:29.817 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:29.814+0000 7f5717fff640 1 --2- 172.21.15.19:0/2507755258 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f57040b5360 0x7f57040b7820 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f5710009fd0 tx=0x7f5710014c50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:26:29.818 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:29.814+0000 7f57177fe640 1 --2- 172.21.15.19:0/3636637527 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x561e920be860 0x561e920c0c50 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f5708103e70 tx=0x7f5708005d50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1c47f1c07d81c1ce server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:26:29.818 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:29.814+0000 7f570dffb640 1 -- 172.21.15.19:0/3636637527 <== mon.1 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57080cde60 con 0x561e920be860 2024-09-10T22:26:29.818 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:29.814+0000 7f570dffb640 1 -- 172.21.15.19:0/3636637527 <== mon.1 v2:172.21.15.138:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f57080cc640 con 0x561e920be860 2024-09-10T22:26:29.818 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:29.814+0000 7f570dffb640 1 -- 172.21.15.19:0/3636637527 <== mon.1 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5708049040 con 0x561e920be860 2024-09-10T22:26:29.822 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:29.815+0000 7f5720e90740 1 -- 172.21.15.19:0/3636637527 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x561e920be860 msgr2=0x561e920c0c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:26:29.822 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:29.815+0000 7f5720e90740 1 --2- 172.21.15.19:0/3636637527 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x561e920be860 0x561e920c0c50 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f5708103e70 tx=0x7f5708005d50 comp rx=0 tx=0).stop 2024-09-10T22:26:29.822 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:29.815+0000 7f5720e90740 1 -- 172.21.15.19:0/3636637527 shutdown_connections 2024-09-10T22:26:29.822 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:29.815+0000 7f5720e90740 1 --2- 172.21.15.19:0/3636637527 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x561e920c3bd0 0x561e920c6090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:26:29.823 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:29.815+0000 7f5720e90740 1 --2- 172.21.15.19:0/3636637527 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561e920c1190 0x561e920c3580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:26:29.823 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:29.815+0000 7f5720e90740 1 --2- 172.21.15.19:0/3636637527 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x561e920be860 0x561e920c0c50 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:26:29.823 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:29.815+0000 7f5720e90740 1 -- 172.21.15.19:0/3636637527 >> 172.21.15.19:0/3636637527 conn(0x561e920b99b0 msgr2=0x561e920ba740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:26:29.823 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:29.815+0000 7f5720e90740 1 -- 172.21.15.19:0/3636637527 shutdown_connections 2024-09-10T22:26:29.823 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:29.815+0000 7f5720e90740 1 -- 172.21.15.19:0/3636637527 wait complete. 2024-09-10T22:26:29.823 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:29.816+0000 7f5720e90740 1 -- start start 2024-09-10T22:26:29.823 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:29.816+0000 7f5720e90740 1 Processor -- start 2024-09-10T22:26:29.823 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:29.816+0000 7f5720e90740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x561e920be860 0x561e920c7ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:26:29.823 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:29.816+0000 7f5720e90740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x561e920c1190 0x561e920c8240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:26:29.823 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:29.816+0000 7f5720e90740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561e920c3bd0 0x561e920c8e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:26:29.823 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:29.816+0000 7f5720e90740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x561e91f57ab0 con 0x561e920be860 2024-09-10T22:26:29.823 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:29.816+0000 7f5720e90740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x561e91fc5730 con 0x561e920c3bd0 2024-09-10T22:26:29.824 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:29.816+0000 7f5720e90740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x561e920c6970 con 0x561e920c1190 2024-09-10T22:26:29.824 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:29.816+0000 7f5720e90740 10 client.0 _ll_register_callbacks cb 0x561e920196b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T22:26:29.824 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:29.817+0000 7f57177fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x561e920be860 0x561e920c7ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:26:29.824 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:29.817+0000 7f57177fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x561e920be860 0x561e920c7ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:51438/0 (socket says 172.21.15.19:51438) 2024-09-10T22:26:29.824 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:29.817+0000 7f57177fe640 1 -- 172.21.15.19:0/1865676561 learned_addr learned my addr 172.21.15.19:0/1865676561 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:26:29.824 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:29.817+0000 7f5717fff640 1 --2- 172.21.15.19:0/1865676561 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561e920c3bd0 0x561e920c8e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:26:29.824 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:29.817+0000 7f570ffff640 1 --2- 172.21.15.19:0/1865676561 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x561e920c1190 0x561e920c8240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:26:29.824 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:29.817+0000 7f57177fe640 1 -- 172.21.15.19:0/1865676561 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x561e920c1190 msgr2=0x561e920c8240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:26:29.824 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:29.817+0000 7f57177fe640 1 --2- 172.21.15.19:0/1865676561 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x561e920c1190 0x561e920c8240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:26:29.824 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:29.817+0000 7f57177fe640 1 -- 172.21.15.19:0/1865676561 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561e920c3bd0 msgr2=0x561e920c8e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:26:29.824 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:29.817+0000 7f57177fe640 1 --2- 172.21.15.19:0/1865676561 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561e920c3bd0 0x561e920c8e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:26:29.825 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:29.817+0000 7f57177fe640 1 -- 172.21.15.19:0/1865676561 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561e91d81790 con 0x561e920be860 2024-09-10T22:26:29.825 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:29.817+0000 7f570ffff640 1 --2- 172.21.15.19:0/1865676561 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x561e920c1190 0x561e920c8240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T22:26:29.825 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:29.817+0000 7f57177fe640 1 --2- 172.21.15.19:0/1865676561 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x561e920be860 0x561e920c7ba0 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f57080ccac0 tx=0x7f57080314c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a8ca795ae6a35fa2 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:26:29.825 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:29.817+0000 7f56f6ffd640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-10T22:26:29.825 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:29.817+0000 7f56f6ffd640 1 -- 172.21.15.19:0/1865676561 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57080f3020 con 0x561e920be860 2024-09-10T22:26:29.825 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:29.817+0000 7f56f6ffd640 1 -- 172.21.15.19:0/1865676561 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8327+0+0 (secure 0 0 0) 0x7f57080ccd90 con 0x561e920be860 2024-09-10T22:26:29.825 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:29.817+0000 7f5720e90740 1 -- 172.21.15.19:0/1865676561 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f57080cc640 con 0x561e920be860 2024-09-10T22:26:29.825 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:29.817+0000 7f56f6ffd640 1 -- 172.21.15.19:0/1865676561 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f57080cde60 con 0x561e920be860 2024-09-10T22:26:29.825 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:29.817+0000 7f5720e90740 10 client.15387 fetch_fsmap learned FSMap version 25 2024-09-10T22:26:29.825 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:29.817+0000 7f5720e90740 1 -- 172.21.15.19:0/1865676561 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x561e91dfa620 con 0x561e920be860 2024-09-10T22:26:29.825 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:29.818+0000 7f56f6ffd640 1 -- 172.21.15.19:0/1865676561 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f57080cc640 con 0x561e920be860 2024-09-10T22:26:29.825 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:29.818+0000 7f56f6ffd640 1 -- 172.21.15.19:0/1865676561 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f57080d5c30 con 0x561e920be860 2024-09-10T22:26:29.825 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:29.818+0000 7f5720e90740 10 client.15387 fetch_fsmap finished waiting for FSMap version 25 2024-09-10T22:26:29.826 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:29.818+0000 7f5720e90740 10 client.15387 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-10T22:26:29.826 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:29.818+0000 7f5720e90740 20 client.15387 populate_metadata read hostname 'smithi019' 2024-09-10T22:26:29.826 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:29.818+0000 7f5720e90740 1 --2- 172.21.15.19:0/1865676561 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x561e920d3250 0x561e920d56b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:26:29.826 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:29.818+0000 7f5720e90740 4 client.15387 mds_command: new command op to 24581 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T22:26:29.826 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:29.818+0000 7f5720e90740 1 -- 172.21.15.19:0/1865676561 --> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x561e92032640 con 0x561e920d3250 2024-09-10T22:26:29.826 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:29.818+0000 7f570ffff640 1 --2- 172.21.15.19:0/1865676561 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x561e920d3250 0x561e920d56b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:26:29.826 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:29.818+0000 7f56f6ffd640 10 client.15387 ms_handle_connect on v2:172.21.15.135:6838/1254769802 2024-09-10T22:26:29.826 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:29.818+0000 7f570ffff640 1 --2- 172.21.15.19:0/1865676561 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x561e920d3250 0x561e920d56b0 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ddc7a925c748caf7 server_cookie=9a670e34de11a43e in_seq=0 out_seq=0 2024-09-10T22:26:29.826 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:29.819+0000 7f56f6ffd640 1 -- 172.21.15.19:0/1865676561 <== mds.0 v2:172.21.15.135:6838/1254769802 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x561e92032640 con 0x561e920d3250 2024-09-10T22:26:29.826 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:29.819+0000 7f56f6ffd640 10 client.15387 handle_command_reply: tid=0 2024-09-10T22:26:29.826 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:29.819+0000 7f5720e90740 1 client.15387 shutdown 2024-09-10T22:26:29.827 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:29.819+0000 7f5720e90740 1 -- 172.21.15.19:0/1865676561 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x561e920be860 msgr2=0x561e920c7ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:26:29.827 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:29.819+0000 7f5720e90740 1 --2- 172.21.15.19:0/1865676561 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x561e920be860 0x561e920c7ba0 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f57080ccac0 tx=0x7f57080314c0 comp rx=0 tx=0).stop 2024-09-10T22:26:29.827 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:29.819+0000 7f5720e90740 1 -- 172.21.15.19:0/1865676561 shutdown_connections 2024-09-10T22:26:29.827 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:29.819+0000 7f5720e90740 1 --2- 172.21.15.19:0/1865676561 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561e920c3bd0 0x561e920c8e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:26:29.827 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:29.819+0000 7f5720e90740 1 --2- 172.21.15.19:0/1865676561 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x561e920d3250 0x561e920d56b0 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:26:29.827 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:29.819+0000 7f5720e90740 1 --2- 172.21.15.19:0/1865676561 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x561e920c1190 0x561e920c8240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:26:29.827 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:29.819+0000 7f5720e90740 1 --2- 172.21.15.19:0/1865676561 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x561e920be860 0x561e920c7ba0 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:26:29.827 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:29.819+0000 7f56f6ffd640 0 client.15387 ms_handle_reset on v2:172.21.15.135:6838/1254769802 2024-09-10T22:26:29.827 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:29.819+0000 7f5720e90740 1 -- 172.21.15.19:0/1865676561 >> 172.21.15.19:0/1865676561 conn(0x561e920b99b0 msgr2=0x561e920b8bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:26:29.827 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:29.820+0000 7f5720e90740 1 -- 172.21.15.19:0/1865676561 shutdown_connections 2024-09-10T22:26:29.827 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:29.820+0000 7f5720e90740 1 -- 172.21.15.19:0/1865676561 wait complete. 2024-09-10T22:26:29.827 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:29.820+0000 7f5720e90740 20 client.15387 trim_cache size 0 max 16384 2024-09-10T22:26:29.839 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:29.836+0000 7f5720e90740 1 Processor -- start 2024-09-10T22:26:29.839 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:29.836+0000 7f5720e90740 1 -- start start 2024-09-10T22:26:29.840 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:29.836+0000 7f5720e90740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x561e920be860 0x561e920bdd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:26:29.840 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:29.836+0000 7f5720e90740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561e920c1190 0x561e920be290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:26:29.840 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:29.836+0000 7f5720e90740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x561e920c3bd0 0x561e920c3fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:26:29.840 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:29.836+0000 7f5720e90740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f57181aebf0 con 0x561e920be860 2024-09-10T22:26:29.840 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:29.836+0000 7f5720e90740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f57181ac4c0 con 0x561e920c1190 2024-09-10T22:26:29.840 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:29.836+0000 7f5720e90740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f57181aa310 con 0x561e920c3bd0 2024-09-10T22:26:29.840 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:29.836+0000 7f57177fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x561e920be860 0x561e920bdd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:26:29.840 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:29.836+0000 7f57177fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x561e920be860 0x561e920bdd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:51454/0 (socket says 172.21.15.19:51454) 2024-09-10T22:26:29.840 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:29.836+0000 7f57177fe640 1 -- 172.21.15.19:0/1400259691 learned_addr learned my addr 172.21.15.19:0/1400259691 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:26:29.840 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:29.836+0000 7f570ffff640 1 --2- 172.21.15.19:0/1400259691 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561e920c1190 0x561e920be290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:26:29.841 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:29.837+0000 7f5717fff640 1 --2- 172.21.15.19:0/1400259691 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x561e920c3bd0 0x561e920c3fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:26:29.841 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:29.837+0000 7f57177fe640 1 -- 172.21.15.19:0/1400259691 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x561e920c3bd0 msgr2=0x561e920c3fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:26:29.841 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:29.837+0000 7f57177fe640 1 --2- 172.21.15.19:0/1400259691 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x561e920c3bd0 0x561e920c3fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:26:29.841 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:29.837+0000 7f57177fe640 1 -- 172.21.15.19:0/1400259691 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561e920c1190 msgr2=0x561e920be290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:26:29.841 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:29.837+0000 7f57177fe640 1 --2- 172.21.15.19:0/1400259691 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561e920c1190 0x561e920be290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:26:29.841 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:29.837+0000 7f57177fe640 1 -- 172.21.15.19:0/1400259691 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561e920c38f0 con 0x561e920be860 2024-09-10T22:26:29.841 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:29.837+0000 7f570ffff640 1 --2- 172.21.15.19:0/1400259691 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561e920c1190 0x561e920be290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T22:26:29.841 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:29.837+0000 7f57177fe640 1 --2- 172.21.15.19:0/1400259691 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x561e920be860 0x561e920bdd50 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f57080c9da0 tx=0x7f570803b4e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2ab90cc20b05a533 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:26:29.841 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:29.837+0000 7f570d7fa640 1 -- 172.21.15.19:0/1400259691 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57080f3070 con 0x561e920be860 2024-09-10T22:26:29.841 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:29.837+0000 7f570d7fa640 1 -- 172.21.15.19:0/1400259691 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f57080cc640 con 0x561e920be860 2024-09-10T22:26:29.841 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:29.837+0000 7f570d7fa640 1 -- 172.21.15.19:0/1400259691 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5708049070 con 0x561e920be860 2024-09-10T22:26:29.841 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:29.838+0000 7f5720e90740 1 -- 172.21.15.19:0/1400259691 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x561e920be860 msgr2=0x561e920bdd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:26:29.842 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:29.838+0000 7f5720e90740 1 --2- 172.21.15.19:0/1400259691 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x561e920be860 0x561e920bdd50 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f57080c9da0 tx=0x7f570803b4e0 comp rx=0 tx=0).stop 2024-09-10T22:26:29.842 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:29.838+0000 7f5720e90740 1 -- 172.21.15.19:0/1400259691 shutdown_connections 2024-09-10T22:26:29.842 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:29.838+0000 7f5720e90740 1 --2- 172.21.15.19:0/1400259691 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x561e920c3bd0 0x561e920c3fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:26:29.842 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:29.838+0000 7f5720e90740 1 --2- 172.21.15.19:0/1400259691 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561e920c1190 0x561e920be290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:26:29.842 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:29.838+0000 7f5720e90740 1 --2- 172.21.15.19:0/1400259691 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x561e920be860 0x561e920bdd50 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:26:29.842 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:29.838+0000 7f5720e90740 1 -- 172.21.15.19:0/1400259691 >> 172.21.15.19:0/1400259691 conn(0x561e920b99b0 msgr2=0x561e920c6c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:26:29.842 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:29.838+0000 7f5720e90740 1 -- 172.21.15.19:0/1400259691 shutdown_connections 2024-09-10T22:26:29.842 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:29.838+0000 7f5720e90740 1 -- 172.21.15.19:0/1400259691 wait complete. 2024-09-10T22:26:29.842 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:29.838+0000 7f5720e90740 1 -- start start 2024-09-10T22:26:29.842 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:29.839+0000 7f5720e90740 1 Processor -- start 2024-09-10T22:26:29.845 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:29.839+0000 7f5720e90740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561e920be860 0x561e920cf220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:26:29.845 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:29.839+0000 7f5720e90740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x561e920c1190 0x561e920cf8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:26:29.845 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:29.839+0000 7f5720e90740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x561e920c3bd0 0x561e920ce010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:26:29.845 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:29.839+0000 7f5720e90740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f57181aa980 con 0x561e920c1190 2024-09-10T22:26:29.845 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:29.839+0000 7f5720e90740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f57181abdf0 con 0x561e920be860 2024-09-10T22:26:29.845 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:29.839+0000 7f5720e90740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f57181ab050 con 0x561e920c3bd0 2024-09-10T22:26:29.845 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:29.839+0000 7f5720e90740 10 client.0 _ll_register_callbacks cb 0x7f57000093c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T22:26:29.845 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:29.839+0000 7f570ffff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x561e920c1190 0x561e920cf8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:26:29.845 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:29.839+0000 7f570ffff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x561e920c1190 0x561e920cf8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:51460/0 (socket says 172.21.15.19:51460) 2024-09-10T22:26:29.845 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:29.839+0000 7f570ffff640 1 -- 172.21.15.19:0/995491873 learned_addr learned my addr 172.21.15.19:0/995491873 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:26:29.846 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:29.839+0000 7f57177fe640 1 --2- 172.21.15.19:0/995491873 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561e920be860 0x561e920cf220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:26:29.846 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:29.839+0000 7f5717fff640 1 --2- 172.21.15.19:0/995491873 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x561e920c3bd0 0x561e920ce010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:26:29.846 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:29.839+0000 7f570ffff640 1 -- 172.21.15.19:0/995491873 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x561e920c3bd0 msgr2=0x561e920ce010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:26:29.846 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:29.839+0000 7f570ffff640 1 --2- 172.21.15.19:0/995491873 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x561e920c3bd0 0x561e920ce010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:26:29.846 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:29.839+0000 7f570ffff640 1 -- 172.21.15.19:0/995491873 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561e920be860 msgr2=0x561e920cf220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:26:29.846 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:29.839+0000 7f570ffff640 1 --2- 172.21.15.19:0/995491873 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561e920be860 0x561e920cf220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:26:29.846 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:29.839+0000 7f570ffff640 1 -- 172.21.15.19:0/995491873 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561e920ce810 con 0x561e920c1190 2024-09-10T22:26:29.846 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:29.840+0000 7f570ffff640 1 --2- 172.21.15.19:0/995491873 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x561e920c1190 0x561e920cf8c0 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x561e920d5ec0 tx=0x7f57000168c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7f8a5c772b51ac1d server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:26:29.846 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:29.840+0000 7f56f6ffd640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-10T22:26:29.846 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:29.840+0000 7f56f6ffd640 1 -- 172.21.15.19:0/995491873 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5700015690 con 0x561e920c1190 2024-09-10T22:26:29.846 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:29.840+0000 7f56f6ffd640 1 -- 172.21.15.19:0/995491873 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8327+0+0 (secure 0 0 0) 0x7f5700015830 con 0x561e920c1190 2024-09-10T22:26:29.846 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:29.840+0000 7f5720e90740 1 -- 172.21.15.19:0/995491873 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f57080cc640 con 0x561e920c1190 2024-09-10T22:26:29.846 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:29.840+0000 7f56f6ffd640 1 -- 172.21.15.19:0/995491873 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f5700015a30 con 0x561e920c1190 2024-09-10T22:26:29.847 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:29.840+0000 7f5720e90740 10 client.15393 fetch_fsmap learned FSMap version 25 2024-09-10T22:26:29.847 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:29.840+0000 7f5720e90740 1 -- 172.21.15.19:0/995491873 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x561e920cd780 con 0x561e920c1190 2024-09-10T22:26:29.847 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:29.840+0000 7f56f6ffd640 1 -- 172.21.15.19:0/995491873 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f57080cc640 con 0x561e920c1190 2024-09-10T22:26:29.847 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:29.840+0000 7f56f6ffd640 1 -- 172.21.15.19:0/995491873 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f570002e050 con 0x561e920c1190 2024-09-10T22:26:29.847 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:29.840+0000 7f5720e90740 10 client.15393 fetch_fsmap finished waiting for FSMap version 25 2024-09-10T22:26:29.847 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:29.840+0000 7f5720e90740 10 client.15393 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-10T22:26:29.847 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:29.840+0000 7f5720e90740 20 client.15393 populate_metadata read hostname 'smithi019' 2024-09-10T22:26:29.847 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:29.840+0000 7f5720e90740 1 --2- 172.21.15.19:0/995491873 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x561e921407a0 0x561e92142bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:26:29.847 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:29.840+0000 7f5720e90740 4 client.15393 mds_command: new command op to 24581 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-10T22:26:29.847 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:29.840+0000 7f5720e90740 1 -- 172.21.15.19:0/995491873 --> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] -- command(tid 0: {"prefix": "flush journal"}) -- 0x561e9202e0f0 con 0x561e921407a0 2024-09-10T22:26:29.847 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:29.840+0000 7f57177fe640 1 --2- 172.21.15.19:0/995491873 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x561e921407a0 0x561e92142bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:26:29.847 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:29.841+0000 7f57177fe640 1 --2- 172.21.15.19:0/995491873 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x561e921407a0 0x561e92142bc0 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5f5ccad20c9dc0c4 server_cookie=2092d48e0d36bfc2 in_seq=0 out_seq=0 2024-09-10T22:26:29.847 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:29.841+0000 7f56f6ffd640 10 client.15393 ms_handle_connect on v2:172.21.15.135:6838/1254769802 2024-09-10T22:26:29.851 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:29.850+0000 7f56f6ffd640 1 -- 172.21.15.19:0/995491873 <== mds.0 v2:172.21.15.135:6838/1254769802 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x561e9202e0f0 con 0x561e921407a0 2024-09-10T22:26:29.852 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:29.850+0000 7f56f6ffd640 10 client.15393 handle_command_reply: tid=0 2024-09-10T22:26:29.852 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:29.850+0000 7f5720e90740 1 client.15393 shutdown 2024-09-10T22:26:29.852 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:29.850+0000 7f5720e90740 1 -- 172.21.15.19:0/995491873 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x561e920c1190 msgr2=0x561e920cf8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:26:29.852 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:29.850+0000 7f5720e90740 1 --2- 172.21.15.19:0/995491873 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x561e920c1190 0x561e920cf8c0 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x561e920d5ec0 tx=0x7f57000168c0 comp rx=0 tx=0).stop 2024-09-10T22:26:29.852 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:29.850+0000 7f5720e90740 1 -- 172.21.15.19:0/995491873 shutdown_connections 2024-09-10T22:26:29.852 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:29.850+0000 7f5720e90740 1 --2- 172.21.15.19:0/995491873 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x561e921407a0 0x561e92142bc0 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:26:29.852 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:29.850+0000 7f5720e90740 1 --2- 172.21.15.19:0/995491873 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x561e920c3bd0 0x561e920ce010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:26:29.852 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:29.850+0000 7f5720e90740 1 --2- 172.21.15.19:0/995491873 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x561e920c1190 0x561e920cf8c0 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:26:29.852 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:29.850+0000 7f56f6ffd640 0 client.15393 ms_handle_reset on v2:172.21.15.135:6838/1254769802 2024-09-10T22:26:29.852 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:29.850+0000 7f5720e90740 1 --2- 172.21.15.19:0/995491873 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561e920be860 0x561e920cf220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:26:29.852 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:29.850+0000 7f5720e90740 1 -- 172.21.15.19:0/995491873 >> 172.21.15.19:0/995491873 conn(0x561e920b99b0 msgr2=0x561e920bdd50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:26:29.853 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:29.850+0000 7f5720e90740 1 -- 172.21.15.19:0/995491873 shutdown_connections 2024-09-10T22:26:29.853 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:29.850+0000 7f5720e90740 1 -- 172.21.15.19:0/995491873 wait complete. 2024-09-10T22:26:29.853 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:29.850+0000 7f5720e90740 20 client.15393 trim_cache size 0 max 16384 2024-09-10T22:26:29.853 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stdout:{ 2024-09-10T22:26:29.853 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stdout: "message": "", 2024-09-10T22:26:29.853 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stdout: "return_code": 0 2024-09-10T22:26:29.853 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stdout:} 2024-09-10T22:26:29.854 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:29.851+0000 7f571dfe8640 1 -- 172.21.15.19:0/2507755258 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f57040b5360 msgr2=0x7f57040b7820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:26:29.854 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:29.851+0000 7f571dfe8640 1 --2- 172.21.15.19:0/2507755258 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f57040b5360 0x7f57040b7820 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f5710009fd0 tx=0x7f5710014c50 comp rx=0 tx=0).stop 2024-09-10T22:26:29.854 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:29.851+0000 7f571dfe8640 1 -- 172.21.15.19:0/2507755258 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f571806b410 msgr2=0x7f5718198e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:26:29.854 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:29.851+0000 7f571dfe8640 1 --2- 172.21.15.19:0/2507755258 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f571806b410 0x7f5718198e30 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f5708005940 tx=0x7f5708004430 comp rx=0 tx=0).stop 2024-09-10T22:26:29.854 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:29.851+0000 7f571dfe8640 1 -- 172.21.15.19:0/2507755258 shutdown_connections 2024-09-10T22:26:29.854 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:29.851+0000 7f571dfe8640 1 --2- 172.21.15.19:0/2507755258 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f57040b5360 0x7f57040b7820 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:26:29.855 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:29.851+0000 7f571dfe8640 1 --2- 172.21.15.19:0/2507755258 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5718108680 0x7f571819a0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:26:29.855 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:29.851+0000 7f571dfe8640 1 --2- 172.21.15.19:0/2507755258 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5718105ad0 0x7f5718199480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:26:29.855 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:29.851+0000 7f571dfe8640 1 --2- 172.21.15.19:0/2507755258 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f571806b410 0x7f5718198e30 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:26:29.855 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:29.851+0000 7f571dfe8640 1 -- 172.21.15.19:0/2507755258 >> 172.21.15.19:0/2507755258 conn(0x7f57180fd140 msgr2=0x7f5718103da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:26:29.855 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:29.851+0000 7f571dfe8640 1 -- 172.21.15.19:0/2507755258 shutdown_connections 2024-09-10T22:26:29.855 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:29.851+0000 7f571dfe8640 1 -- 172.21.15.19:0/2507755258 wait complete. 2024-09-10T22:26:30.359 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:26:30 smithi135 ceph-mon[34789]: pgmap v349: 97 pgs: 97 active+clean; 651 KiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 597 B/s wr, 5 op/s 2024-09-10T22:26:30.360 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:26:30 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T22:26:30.375 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:26:30 smithi138 ceph-mon[35236]: pgmap v349: 97 pgs: 97 active+clean; 651 KiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 597 B/s wr, 5 op/s 2024-09-10T22:26:30.375 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:26:30 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T22:26:30.458 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:26:30 smithi019 ceph-mon[31375]: pgmap v349: 97 pgs: 97 active+clean; 651 KiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 597 B/s wr, 5 op/s 2024-09-10T22:26:30.458 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:26:30 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T22:26:32.109 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:26:31 smithi135 ceph-mon[34789]: pgmap v350: 97 pgs: 97 active+clean; 651 KiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 767 B/s wr, 7 op/s 2024-09-10T22:26:32.110 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:26:31 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:26:32.110 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:26:31 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:26:32.110 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:26:31 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:26:32.110 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:26:31 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:26:32.125 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:26:31 smithi138 ceph-mon[35236]: pgmap v350: 97 pgs: 97 active+clean; 651 KiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 767 B/s wr, 7 op/s 2024-09-10T22:26:32.125 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:26:31 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:26:32.125 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:26:31 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:26:32.125 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:26:31 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:26:32.125 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:26:31 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:26:32.208 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:26:31 smithi019 ceph-mon[31375]: pgmap v350: 97 pgs: 97 active+clean; 651 KiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 767 B/s wr, 7 op/s 2024-09-10T22:26:32.208 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:26:31 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:26:32.208 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:26:31 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:26:32.208 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:26:31 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:26:32.208 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:26:31 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:26:33.109 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:26:32 smithi135 ceph-mon[34789]: scrub summary: idle 2024-09-10T22:26:33.125 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:26:32 smithi138 ceph-mon[35236]: scrub summary: idle 2024-09-10T22:26:33.208 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:26:32 smithi019 ceph-mon[31375]: scrub summary: idle 2024-09-10T22:26:34.109 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:26:33 smithi135 ceph-mon[34789]: pgmap v351: 97 pgs: 97 active+clean; 654 KiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 1.5 KiB/s wr, 8 op/s 2024-09-10T22:26:34.110 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:26:33 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:26:34.110 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:26:33 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:26:34.125 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:26:33 smithi138 ceph-mon[35236]: pgmap v351: 97 pgs: 97 active+clean; 654 KiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 1.5 KiB/s wr, 8 op/s 2024-09-10T22:26:34.125 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:26:33 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:26:34.125 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:26:33 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:26:34.208 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:26:33 smithi019 ceph-mon[31375]: pgmap v351: 97 pgs: 97 active+clean; 654 KiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 1.5 KiB/s wr, 8 op/s 2024-09-10T22:26:34.208 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:26:33 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:26:34.208 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:26:33 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:26:35.109 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:26:34 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T22:26:35.110 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:26:34 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T22:26:35.110 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:26:34 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:26:35.125 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:26:34 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T22:26:35.125 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:26:34 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T22:26:35.125 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:26:34 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:26:35.208 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:26:34 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T22:26:35.208 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:26:34 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T22:26:35.208 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:26:34 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:26:36.375 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:26:36 smithi138 ceph-mon[35236]: pgmap v352: 97 pgs: 97 active+clean; 654 KiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 1.5 KiB/s wr, 9 op/s 2024-09-10T22:26:36.458 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:26:36 smithi019 ceph-mon[31375]: pgmap v352: 97 pgs: 97 active+clean; 654 KiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 1.5 KiB/s wr, 9 op/s 2024-09-10T22:26:36.609 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:26:36 smithi135 ceph-mon[34789]: pgmap v352: 97 pgs: 97 active+clean; 654 KiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 1.5 KiB/s wr, 9 op/s 2024-09-10T22:26:38.375 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:26:38 smithi138 ceph-mon[35236]: pgmap v353: 97 pgs: 97 active+clean; 654 KiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 1.7 KiB/s wr, 11 op/s 2024-09-10T22:26:38.459 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:26:38 smithi019 ceph-mon[31375]: pgmap v353: 97 pgs: 97 active+clean; 654 KiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 1.7 KiB/s wr, 11 op/s 2024-09-10T22:26:38.610 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:26:38 smithi135 ceph-mon[34789]: pgmap v353: 97 pgs: 97 active+clean; 654 KiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 1.7 KiB/s wr, 11 op/s 2024-09-10T22:26:40.127 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:26:40 smithi019 ceph-mon[31375]: pgmap v354: 97 pgs: 97 active+clean; 654 KiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 1.7 KiB/s wr, 9 op/s 2024-09-10T22:26:40.610 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:26:40 smithi135 ceph-mon[34789]: pgmap v354: 97 pgs: 97 active+clean; 654 KiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 1.7 KiB/s wr, 9 op/s 2024-09-10T22:26:40.625 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:26:40 smithi138 ceph-mon[35236]: pgmap v354: 97 pgs: 97 active+clean; 654 KiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 1.7 KiB/s wr, 9 op/s 2024-09-10T22:26:42.458 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:26:42 smithi019 ceph-mon[31375]: pgmap v355: 97 pgs: 97 active+clean; 654 KiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 1.7 KiB/s wr, 10 op/s 2024-09-10T22:26:42.610 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:26:42 smithi135 ceph-mon[34789]: pgmap v355: 97 pgs: 97 active+clean; 654 KiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 1.7 KiB/s wr, 10 op/s 2024-09-10T22:26:42.625 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:26:42 smithi138 ceph-mon[35236]: pgmap v355: 97 pgs: 97 active+clean; 654 KiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 1.7 KiB/s wr, 10 op/s 2024-09-10T22:26:42.995 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:42.993+0000 7f725cefe640 1 -- 172.21.15.19:0/3372178352 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f72581029e0 msgr2=0x7f7258102e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:26:42.995 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:42.993+0000 7f725cefe640 1 --2- 172.21.15.19:0/3372178352 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f72581029e0 0x7f7258102e60 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f724c009900 tx=0x7f724c02a410 comp rx=0 tx=0).stop 2024-09-10T22:26:42.995 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:42.993+0000 7f725cefe640 1 -- 172.21.15.19:0/3372178352 shutdown_connections 2024-09-10T22:26:42.995 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:42.993+0000 7f725cefe640 1 --2- 172.21.15.19:0/3372178352 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f72581033a0 0x7f7258109d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:26:42.995 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:42.993+0000 7f725cefe640 1 --2- 172.21.15.19:0/3372178352 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f72581029e0 0x7f7258102e60 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:26:42.995 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:42.993+0000 7f725cefe640 1 --2- 172.21.15.19:0/3372178352 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7258101890 0x7f7258101c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:26:42.995 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:42.993+0000 7f725cefe640 1 -- 172.21.15.19:0/3372178352 >> 172.21.15.19:0/3372178352 conn(0x7f72580fd130 msgr2=0x7f72580ff570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:26:42.995 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:42.993+0000 7f725cefe640 1 -- 172.21.15.19:0/3372178352 shutdown_connections 2024-09-10T22:26:42.995 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:42.993+0000 7f725cefe640 1 -- 172.21.15.19:0/3372178352 wait complete. 2024-09-10T22:26:42.997 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:42.994+0000 7f725cefe640 1 Processor -- start 2024-09-10T22:26:42.998 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:42.994+0000 7f725cefe640 1 -- start start 2024-09-10T22:26:42.998 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:42.995+0000 7f725cefe640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7258101890 0x7f7258198d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:26:42.998 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:42.995+0000 7f725cefe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f72581029e0 0x7f7258199390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:26:42.998 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:42.995+0000 7f7255d9b640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f72581029e0 0x7f7258199390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:26:42.998 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:42.995+0000 7f7255d9b640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f72581029e0 0x7f7258199390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:45432/0 (socket says 172.21.15.19:45432) 2024-09-10T22:26:42.998 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:42.995+0000 7f7255d9b640 1 -- 172.21.15.19:0/2447390229 learned_addr learned my addr 172.21.15.19:0/2447390229 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:26:42.998 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:42.995+0000 7f725659c640 1 --2- 172.21.15.19:0/2447390229 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7258101890 0x7f7258198d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:26:42.998 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:42.995+0000 7f725cefe640 1 --2- 172.21.15.19:0/2447390229 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f72581033a0 0x7f7258199fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:26:42.998 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:42.995+0000 7f725cefe640 1 -- 172.21.15.19:0/2447390229 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f725810e680 con 0x7f72581029e0 2024-09-10T22:26:42.998 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:42.995+0000 7f725cefe640 1 -- 172.21.15.19:0/2447390229 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f725810e500 con 0x7f7258101890 2024-09-10T22:26:42.998 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:42.995+0000 7f725cefe640 1 -- 172.21.15.19:0/2447390229 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f725810e800 con 0x7f72581033a0 2024-09-10T22:26:42.998 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:42.995+0000 7f725659c640 1 -- 172.21.15.19:0/2447390229 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f72581033a0 msgr2=0x7f7258199fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:26:42.999 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:42.995+0000 7f725659c640 1 --2- 172.21.15.19:0/2447390229 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f72581033a0 0x7f7258199fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:26:42.999 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:42.995+0000 7f725659c640 1 -- 172.21.15.19:0/2447390229 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f72581029e0 msgr2=0x7f7258199390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:26:42.999 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:42.995+0000 7f725659c640 1 --2- 172.21.15.19:0/2447390229 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f72581029e0 0x7f7258199390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:26:42.999 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:42.995+0000 7f725659c640 1 -- 172.21.15.19:0/2447390229 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f725819a880 con 0x7f7258101890 2024-09-10T22:26:42.999 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:42.996+0000 7f725659c640 1 --2- 172.21.15.19:0/2447390229 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7258101890 0x7f7258198d40 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f724800e9f0 tx=0x7f724800eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:26:42.999 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:42.996+0000 7f72477fe640 1 -- 172.21.15.19:0/2447390229 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f724800ccc0 con 0x7f7258101890 2024-09-10T22:26:42.999 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:42.996+0000 7f725cefe640 1 -- 172.21.15.19:0/2447390229 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f725819ab70 con 0x7f7258101890 2024-09-10T22:26:42.999 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:42.996+0000 7f72477fe640 1 -- 172.21.15.19:0/2447390229 <== mon.2 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f72480108e0 con 0x7f7258101890 2024-09-10T22:26:42.999 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:42.996+0000 7f72477fe640 1 -- 172.21.15.19:0/2447390229 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7248018880 con 0x7f7258101890 2024-09-10T22:26:42.999 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:42.997+0000 7f725cefe640 1 -- 172.21.15.19:0/2447390229 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f725810a5c0 con 0x7f7258101890 2024-09-10T22:26:43.001 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:43.000+0000 7f72477fe640 1 -- 172.21.15.19:0/2447390229 <== mon.2 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 18) ==== 153250+0+0 (secure 0 0 0) 0x7f7248010430 con 0x7f7258101890 2024-09-10T22:26:43.001 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:43.000+0000 7f725fcce740 1 Processor -- start 2024-09-10T22:26:43.001 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:43.000+0000 7f725fcce740 1 -- start start 2024-09-10T22:26:43.003 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:43.001+0000 7f725fcce740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559f7a30b860 0x559f7a30dc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:26:43.003 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:43.001+0000 7f725fcce740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x559f7a30e190 0x559f7a310580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:26:43.003 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:43.001+0000 7f725fcce740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x559f7a310bd0 0x559f7a313090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:26:43.003 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:43.001+0000 7f725fcce740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x559f7a27d6f0 con 0x559f7a310bd0 2024-09-10T22:26:43.003 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:43.001+0000 7f725fcce740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x559f7a26cb20 con 0x559f7a30b860 2024-09-10T22:26:43.003 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:43.001+0000 7f725fcce740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x559f7a270930 con 0x559f7a30e190 2024-09-10T22:26:43.003 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:43.001+0000 7f7255d9b640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x559f7a310bd0 0x559f7a313090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:26:43.004 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:43.001+0000 7f7255d9b640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x559f7a310bd0 0x559f7a313090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:45448/0 (socket says 172.21.15.19:45448) 2024-09-10T22:26:43.004 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:43.001+0000 7f7255d9b640 1 -- 172.21.15.19:0/1768041319 learned_addr learned my addr 172.21.15.19:0/1768041319 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:26:43.004 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:43.001+0000 7f725659c640 1 --2- 172.21.15.19:0/1768041319 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x559f7a30e190 0x559f7a310580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:26:43.004 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:43.001+0000 7f7256d9d640 1 --2- 172.21.15.19:0/1768041319 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559f7a30b860 0x559f7a30dc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:26:43.004 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:43.002+0000 7f7255d9b640 1 -- 172.21.15.19:0/1768041319 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x559f7a30e190 msgr2=0x559f7a310580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:26:43.004 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:43.002+0000 7f7255d9b640 1 --2- 172.21.15.19:0/1768041319 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x559f7a30e190 0x559f7a310580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:26:43.004 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:43.002+0000 7f7255d9b640 1 -- 172.21.15.19:0/1768041319 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559f7a30b860 msgr2=0x559f7a30dc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:26:43.004 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:43.002+0000 7f7255d9b640 1 --2- 172.21.15.19:0/1768041319 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559f7a30b860 0x559f7a30dc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:26:43.004 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:43.002+0000 7f7255d9b640 1 -- 172.21.15.19:0/1768041319 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559f7a232530 con 0x559f7a310bd0 2024-09-10T22:26:43.004 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:43.002+0000 7f72477fe640 1 --2- 172.21.15.19:0/2447390229 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f72400b52e0 0x7f72400b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:26:43.004 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:43.002+0000 7f7256d9d640 1 --2- 172.21.15.19:0/1768041319 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559f7a30b860 0x559f7a30dc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T22:26:43.005 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:43.002+0000 7f7256d9d640 1 --2- 172.21.15.19:0/2447390229 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f72400b52e0 0x7f72400b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:26:43.005 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:43.002+0000 7f7255d9b640 1 --2- 172.21.15.19:0/1768041319 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x559f7a310bd0 0x559f7a313090 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f724c006010 tx=0x7f724c004170 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c2c8dbab967b9a5d server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:26:43.008 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:43.002+0000 7f7244ff9640 1 -- 172.21.15.19:0/1768041319 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f724c035030 con 0x559f7a310bd0 2024-09-10T22:26:43.008 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:43.002+0000 7f7244ff9640 1 -- 172.21.15.19:0/1768041319 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f724c040070 con 0x559f7a310bd0 2024-09-10T22:26:43.008 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:43.002+0000 7f7244ff9640 1 -- 172.21.15.19:0/1768041319 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f724c031a50 con 0x559f7a310bd0 2024-09-10T22:26:43.008 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:43.003+0000 7f72477fe640 1 -- 172.21.15.19:0/2447390229 <== mon.2 v2:172.21.15.135:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8327+0+0 (secure 0 0 0) 0x7f72480e6000 con 0x7f7258101890 2024-09-10T22:26:43.008 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:43.003+0000 7f725fcce740 1 -- 172.21.15.19:0/1768041319 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x559f7a310bd0 msgr2=0x559f7a313090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:26:43.008 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:43.003+0000 7f7256d9d640 1 --2- 172.21.15.19:0/2447390229 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f72400b52e0 0x7f72400b77a0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f7250009270 tx=0x7f72500095e0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:26:43.008 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:43.003+0000 7f725fcce740 1 --2- 172.21.15.19:0/1768041319 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x559f7a310bd0 0x559f7a313090 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f724c006010 tx=0x7f724c004170 comp rx=0 tx=0).stop 2024-09-10T22:26:43.008 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:43.003+0000 7f725fcce740 1 -- 172.21.15.19:0/1768041319 shutdown_connections 2024-09-10T22:26:43.008 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:43.003+0000 7f725fcce740 1 --2- 172.21.15.19:0/1768041319 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x559f7a310bd0 0x559f7a313090 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:26:43.008 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:43.003+0000 7f725fcce740 1 --2- 172.21.15.19:0/1768041319 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x559f7a30e190 0x559f7a310580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:26:43.008 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:43.003+0000 7f725fcce740 1 --2- 172.21.15.19:0/1768041319 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559f7a30b860 0x559f7a30dc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:26:43.009 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:43.004+0000 7f725fcce740 1 -- 172.21.15.19:0/1768041319 >> 172.21.15.19:0/1768041319 conn(0x559f7a3069b0 msgr2=0x559f7a307740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:26:43.009 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:43.004+0000 7f725fcce740 1 -- 172.21.15.19:0/1768041319 shutdown_connections 2024-09-10T22:26:43.009 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:43.004+0000 7f725fcce740 1 -- 172.21.15.19:0/1768041319 wait complete. 2024-09-10T22:26:43.009 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:43.004+0000 7f725fcce740 1 -- start start 2024-09-10T22:26:43.009 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:43.004+0000 7f725fcce740 1 Processor -- start 2024-09-10T22:26:43.009 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:43.005+0000 7f725fcce740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x559f7a30b860 0x559f7a314e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:26:43.009 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:43.005+0000 7f725fcce740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x559f7a30e190 0x559f7a3154e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:26:43.009 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:43.005+0000 7f725fcce740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559f7a310bd0 0x559f7a3160b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:26:43.009 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:43.005+0000 7f7255d9b640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x559f7a30e190 0x559f7a3154e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:26:43.009 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:43.005+0000 7f7255d9b640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x559f7a30e190 0x559f7a3154e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:45454/0 (socket says 172.21.15.19:45454) 2024-09-10T22:26:43.009 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:43.005+0000 7f725659c640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x559f7a30b860 0x559f7a314e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:26:43.009 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:43.005+0000 7f725659c640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x559f7a30b860 0x559f7a314e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.19:60516/0 (socket says 172.21.15.19:60516) 2024-09-10T22:26:43.010 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:43.005+0000 7f7255d9b640 1 -- 172.21.15.19:0/1972790175 learned_addr learned my addr 172.21.15.19:0/1972790175 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:26:43.010 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:43.005+0000 7f725fcce740 1 -- 172.21.15.19:0/1972790175 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x559f7a1a4ab0 con 0x559f7a30e190 2024-09-10T22:26:43.010 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:43.005+0000 7f725fcce740 1 -- 172.21.15.19:0/1972790175 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x559f7a212730 con 0x559f7a310bd0 2024-09-10T22:26:43.010 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:43.005+0000 7f725fcce740 1 -- 172.21.15.19:0/1972790175 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x559f7a313b50 con 0x559f7a30b860 2024-09-10T22:26:43.010 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:43.006+0000 7f7256d9d640 1 --2- 172.21.15.19:0/1972790175 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559f7a310bd0 0x559f7a3160b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:26:43.010 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:43.006+0000 7f7255d9b640 1 -- 172.21.15.19:0/1972790175 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x559f7a30b860 msgr2=0x559f7a314e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:26:43.010 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:43.006+0000 7f7255d9b640 1 --2- 172.21.15.19:0/1972790175 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x559f7a30b860 0x559f7a314e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:26:43.010 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:43.006+0000 7f7255d9b640 1 -- 172.21.15.19:0/1972790175 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559f7a310bd0 msgr2=0x559f7a3160b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:26:43.010 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:43.006+0000 7f7255d9b640 1 --2- 172.21.15.19:0/1972790175 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559f7a310bd0 0x559f7a3160b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:26:43.010 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:43.006+0000 7f7255d9b640 1 -- 172.21.15.19:0/1972790175 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559f79fce790 con 0x559f7a30e190 2024-09-10T22:26:43.010 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:43.006+0000 7f7255d9b640 1 --2- 172.21.15.19:0/1972790175 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x559f7a30e190 0x559f7a3154e0 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f724c0092a0 tx=0x7f724c005dc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=56c94d4918be11b8 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:26:43.010 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:43.006+0000 7f723dffb640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-10T22:26:43.011 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:43.006+0000 7f725fcce740 10 client.0 _ll_register_callbacks cb 0x559f7a2666b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T22:26:43.011 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:43.006+0000 7f725fcce740 1 -- 172.21.15.19:0/1972790175 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f724c040070 con 0x559f7a30e190 2024-09-10T22:26:43.011 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:43.006+0000 7f723dffb640 1 -- 172.21.15.19:0/1972790175 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f724c052060 con 0x559f7a30e190 2024-09-10T22:26:43.011 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:43.006+0000 7f723dffb640 1 -- 172.21.15.19:0/1972790175 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8327+0+0 (secure 0 0 0) 0x7f724c031df0 con 0x559f7a30e190 2024-09-10T22:26:43.011 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:43.006+0000 7f723dffb640 1 -- 172.21.15.19:0/1972790175 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f724c035050 con 0x559f7a30e190 2024-09-10T22:26:43.011 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:43.006+0000 7f725fcce740 10 client.15405 fetch_fsmap learned FSMap version 25 2024-09-10T22:26:43.011 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:43.007+0000 7f725fcce740 1 -- 172.21.15.19:0/1972790175 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({fsmap=25}) -- 0x559f7a047620 con 0x559f7a30e190 2024-09-10T22:26:43.013 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:43.007+0000 7f723dffb640 1 -- 172.21.15.19:0/1972790175 <== mon.0 v2:172.21.15.19:3300/0 4 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f724c056030 con 0x559f7a30e190 2024-09-10T22:26:43.013 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:43.007+0000 7f725fcce740 10 client.15405 fetch_fsmap finished waiting for FSMap version 25 2024-09-10T22:26:43.013 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:43.007+0000 7f725fcce740 10 client.15405 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-10T22:26:43.013 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:43.007+0000 7f725fcce740 20 client.15405 populate_metadata read hostname 'smithi019' 2024-09-10T22:26:43.013 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:43.007+0000 7f725fcce740 1 --2- 172.21.15.19:0/1972790175 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x559f7a3200c0 0x559f7a3224b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:26:43.013 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:43.007+0000 7f725fcce740 4 client.15405 mds_command: new command op to 24581 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T22:26:43.013 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:43.007+0000 7f725fcce740 1 -- 172.21.15.19:0/1972790175 --> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x559f7a27f640 con 0x559f7a3200c0 2024-09-10T22:26:43.013 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:43.007+0000 7f725659c640 1 --2- 172.21.15.19:0/1972790175 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x559f7a3200c0 0x559f7a3224b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:26:43.014 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:43.008+0000 7f723dffb640 10 client.15405 ms_handle_connect on v2:172.21.15.135:6838/1254769802 2024-09-10T22:26:43.014 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:43.008+0000 7f725659c640 1 --2- 172.21.15.19:0/1972790175 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x559f7a3200c0 0x559f7a3224b0 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b4e56ecc3207735c server_cookie=6e1c1e87b7c1e2db in_seq=0 out_seq=0 2024-09-10T22:26:43.014 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:43.009+0000 7f723dffb640 1 -- 172.21.15.19:0/1972790175 <== mds.0 v2:172.21.15.135:6838/1254769802 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x559f7a27f640 con 0x559f7a3200c0 2024-09-10T22:26:43.014 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:43.009+0000 7f723dffb640 10 client.15405 handle_command_reply: tid=0 2024-09-10T22:26:43.014 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:43.009+0000 7f725fcce740 1 client.15405 shutdown 2024-09-10T22:26:43.014 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:43.009+0000 7f725fcce740 1 -- 172.21.15.19:0/1972790175 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x559f7a30e190 msgr2=0x559f7a3154e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:26:43.014 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:43.009+0000 7f725fcce740 1 --2- 172.21.15.19:0/1972790175 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x559f7a30e190 0x559f7a3154e0 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f724c0092a0 tx=0x7f724c005dc0 comp rx=0 tx=0).stop 2024-09-10T22:26:43.014 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:43.009+0000 7f725fcce740 1 -- 172.21.15.19:0/1972790175 shutdown_connections 2024-09-10T22:26:43.014 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:43.009+0000 7f725fcce740 1 --2- 172.21.15.19:0/1972790175 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559f7a310bd0 0x559f7a3160b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:26:43.014 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:43.009+0000 7f725fcce740 1 --2- 172.21.15.19:0/1972790175 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x559f7a30e190 0x559f7a3154e0 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:26:43.014 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:43.009+0000 7f725fcce740 1 --2- 172.21.15.19:0/1972790175 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x559f7a3200c0 0x559f7a3224b0 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:26:43.014 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:43.009+0000 7f725fcce740 1 --2- 172.21.15.19:0/1972790175 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x559f7a30b860 0x559f7a314e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:26:43.014 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:43.009+0000 7f725fcce740 1 -- 172.21.15.19:0/1972790175 >> 172.21.15.19:0/1972790175 conn(0x559f7a3069b0 msgr2=0x559f7a305bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:26:43.015 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:43.009+0000 7f723dffb640 0 client.15405 ms_handle_reset on v2:172.21.15.135:6838/1254769802 2024-09-10T22:26:43.015 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:43.009+0000 7f725fcce740 1 -- 172.21.15.19:0/1972790175 shutdown_connections 2024-09-10T22:26:43.015 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:43.009+0000 7f725fcce740 1 -- 172.21.15.19:0/1972790175 wait complete. 2024-09-10T22:26:43.015 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:43.009+0000 7f725fcce740 20 client.15405 trim_cache size 0 max 16384 2024-09-10T22:26:43.042 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:43.039+0000 7f725fcce740 1 Processor -- start 2024-09-10T22:26:43.042 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:43.039+0000 7f725fcce740 1 -- start start 2024-09-10T22:26:43.042 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:43.039+0000 7f725fcce740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559f7a30b860 0x559f7a310fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:26:43.042 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:43.039+0000 7f725fcce740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x559f7a30e190 0x559f7a3114f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:26:43.042 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:43.039+0000 7f725fcce740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x559f7a310bd0 0x559f7a314e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:26:43.042 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:43.039+0000 7f725fcce740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f72581aea30 con 0x559f7a310bd0 2024-09-10T22:26:43.043 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:43.039+0000 7f725fcce740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f72581ac300 con 0x559f7a30b860 2024-09-10T22:26:43.043 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:43.039+0000 7f725fcce740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f72581aa150 con 0x559f7a30e190 2024-09-10T22:26:43.043 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:43.040+0000 7f725659c640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559f7a30b860 0x559f7a310fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:26:43.043 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:43.040+0000 7f725659c640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559f7a30b860 0x559f7a310fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.19:45634/0 (socket says 172.21.15.19:45634) 2024-09-10T22:26:43.043 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:43.040+0000 7f725659c640 1 -- 172.21.15.19:0/1153746375 learned_addr learned my addr 172.21.15.19:0/1153746375 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:26:43.043 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:43.040+0000 7f7256d9d640 1 --2- 172.21.15.19:0/1153746375 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x559f7a310bd0 0x559f7a314e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:26:43.043 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:43.040+0000 7f7255d9b640 1 --2- 172.21.15.19:0/1153746375 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x559f7a30e190 0x559f7a3114f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:26:43.043 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:43.040+0000 7f725659c640 1 -- 172.21.15.19:0/1153746375 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x559f7a30e190 msgr2=0x559f7a3114f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:26:43.043 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:43.040+0000 7f725659c640 1 --2- 172.21.15.19:0/1153746375 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x559f7a30e190 0x559f7a3114f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:26:43.043 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:43.040+0000 7f725659c640 1 -- 172.21.15.19:0/1153746375 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x559f7a310bd0 msgr2=0x559f7a314e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:26:43.043 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:43.040+0000 7f725659c640 1 --2- 172.21.15.19:0/1153746375 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x559f7a310bd0 0x559f7a314e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:26:43.043 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:43.040+0000 7f725659c640 1 -- 172.21.15.19:0/1153746375 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559f7a322b00 con 0x559f7a30b860 2024-09-10T22:26:43.044 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:43.040+0000 7f7255d9b640 1 --2- 172.21.15.19:0/1153746375 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x559f7a30e190 0x559f7a3114f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T22:26:43.044 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:43.040+0000 7f7256d9d640 1 --2- 172.21.15.19:0/1153746375 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x559f7a310bd0 0x559f7a314e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T22:26:43.044 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:43.040+0000 7f725659c640 1 --2- 172.21.15.19:0/1153746375 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559f7a30b860 0x559f7a310fb0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f72480a99d0 tx=0x7f72480e9ae0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=421b00126cd8859b server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:26:43.044 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:43.041+0000 7f723ffff640 1 -- 172.21.15.19:0/1153746375 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72480a6e60 con 0x559f7a30b860 2024-09-10T22:26:43.044 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:43.041+0000 7f723ffff640 1 -- 172.21.15.19:0/1153746375 <== mon.2 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f72480ac270 con 0x559f7a30b860 2024-09-10T22:26:43.044 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:43.041+0000 7f723ffff640 1 -- 172.21.15.19:0/1153746375 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72480b5cf0 con 0x559f7a30b860 2024-09-10T22:26:43.048 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:43.042+0000 7f725fcce740 1 -- 172.21.15.19:0/1153746375 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559f7a30b860 msgr2=0x559f7a310fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:26:43.048 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:43.042+0000 7f725fcce740 1 --2- 172.21.15.19:0/1153746375 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559f7a30b860 0x559f7a310fb0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f72480a99d0 tx=0x7f72480e9ae0 comp rx=0 tx=0).stop 2024-09-10T22:26:43.049 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:43.042+0000 7f725fcce740 1 -- 172.21.15.19:0/1153746375 shutdown_connections 2024-09-10T22:26:43.049 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:43.042+0000 7f725fcce740 1 --2- 172.21.15.19:0/1153746375 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x559f7a310bd0 0x559f7a314e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:26:43.049 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:43.042+0000 7f725fcce740 1 --2- 172.21.15.19:0/1153746375 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x559f7a30e190 0x559f7a3114f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:26:43.049 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:43.042+0000 7f725fcce740 1 --2- 172.21.15.19:0/1153746375 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559f7a30b860 0x559f7a310fb0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:26:43.049 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:43.042+0000 7f725fcce740 1 -- 172.21.15.19:0/1153746375 >> 172.21.15.19:0/1153746375 conn(0x559f7a3069b0 msgr2=0x559f7a30ad50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:26:43.049 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:43.042+0000 7f725fcce740 1 -- 172.21.15.19:0/1153746375 shutdown_connections 2024-09-10T22:26:43.049 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:43.042+0000 7f725fcce740 1 -- 172.21.15.19:0/1153746375 wait complete. 2024-09-10T22:26:43.049 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:43.042+0000 7f725fcce740 1 -- start start 2024-09-10T22:26:43.049 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:43.043+0000 7f725fcce740 1 Processor -- start 2024-09-10T22:26:43.049 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:43.043+0000 7f725fcce740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x559f7a30b860 0x559f7a31c1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:26:43.049 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:43.043+0000 7f725fcce740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559f7a30e190 0x559f7a31c850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:26:43.049 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:43.043+0000 7f725fcce740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x559f7a310bd0 0x559f7a38af50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:26:43.050 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:43.043+0000 7f725fcce740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f72581aa7c0 con 0x559f7a310bd0 2024-09-10T22:26:43.050 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:43.043+0000 7f725fcce740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f72581abc30 con 0x559f7a30e190 2024-09-10T22:26:43.050 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:43.043+0000 7f725fcce740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f72581aae90 con 0x559f7a30b860 2024-09-10T22:26:43.050 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:43.043+0000 7f7256d9d640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x559f7a310bd0 0x559f7a38af50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:26:43.050 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:43.043+0000 7f725659c640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x559f7a30b860 0x559f7a31c1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:26:43.050 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:43.043+0000 7f7255d9b640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559f7a30e190 0x559f7a31c850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:26:43.050 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:43.043+0000 7f7256d9d640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x559f7a310bd0 0x559f7a38af50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:45472/0 (socket says 172.21.15.19:45472) 2024-09-10T22:26:43.050 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:43.043+0000 7f7256d9d640 1 -- 172.21.15.19:0/2040718132 learned_addr learned my addr 172.21.15.19:0/2040718132 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:26:43.050 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:43.043+0000 7f725fcce740 10 client.0 _ll_register_callbacks cb 0x7f7250009500 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T22:26:43.050 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:43.044+0000 7f725659c640 1 -- 172.21.15.19:0/2040718132 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559f7a30e190 msgr2=0x559f7a31c850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:26:43.050 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:43.044+0000 7f725659c640 1 --2- 172.21.15.19:0/2040718132 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559f7a30e190 0x559f7a31c850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:26:43.050 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:43.044+0000 7f725659c640 1 -- 172.21.15.19:0/2040718132 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x559f7a310bd0 msgr2=0x559f7a38af50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:26:43.051 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:43.044+0000 7f725659c640 1 --2- 172.21.15.19:0/2040718132 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x559f7a310bd0 0x559f7a38af50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:26:43.051 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:43.044+0000 7f725659c640 1 -- 172.21.15.19:0/2040718132 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559f7a38b5f0 con 0x559f7a30b860 2024-09-10T22:26:43.051 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:43.044+0000 7f7256d9d640 1 --2- 172.21.15.19:0/2040718132 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x559f7a310bd0 0x559f7a38af50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T22:26:43.051 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:43.044+0000 7f7255d9b640 1 --2- 172.21.15.19:0/2040718132 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559f7a30e190 0x559f7a31c850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T22:26:43.051 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:43.044+0000 7f725659c640 1 --2- 172.21.15.19:0/2040718132 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x559f7a30b860 0x559f7a31c1f0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f72480a99d0 tx=0x7f72480ac780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=621a89e2f03c6fd8 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:26:43.051 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:43.044+0000 7f723dffb640 10 client.0 ms_handle_connect on v2:172.21.15.138:3300/0 2024-09-10T22:26:43.051 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:43.044+0000 7f723dffb640 1 -- 172.21.15.19:0/2040718132 <== mon.1 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72480a6e60 con 0x559f7a30b860 2024-09-10T22:26:43.051 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:43.044+0000 7f723dffb640 1 -- 172.21.15.19:0/2040718132 <== mon.1 v2:172.21.15.138:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8327+0+0 (secure 0 0 0) 0x7f72480a89d0 con 0x559f7a30b860 2024-09-10T22:26:43.051 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:43.045+0000 7f725fcce740 1 -- 172.21.15.19:0/2040718132 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f72480ac270 con 0x559f7a30b860 2024-09-10T22:26:43.051 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:43.045+0000 7f723dffb640 1 -- 172.21.15.19:0/2040718132 <== mon.1 v2:172.21.15.138:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f72480abed0 con 0x559f7a30b860 2024-09-10T22:26:43.051 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:43.045+0000 7f725fcce740 10 client.24982 fetch_fsmap learned FSMap version 25 2024-09-10T22:26:43.051 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:43.045+0000 7f725fcce740 1 -- 172.21.15.19:0/2040718132 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x559f7a38c930 con 0x559f7a30b860 2024-09-10T22:26:43.051 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:43.045+0000 7f723dffb640 1 -- 172.21.15.19:0/2040718132 <== mon.1 v2:172.21.15.138:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f72480ac270 con 0x559f7a30b860 2024-09-10T22:26:43.052 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:43.046+0000 7f723dffb640 1 -- 172.21.15.19:0/2040718132 <== mon.1 v2:172.21.15.138:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f72480e80c0 con 0x559f7a30b860 2024-09-10T22:26:43.052 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:43.046+0000 7f725fcce740 10 client.24982 fetch_fsmap finished waiting for FSMap version 25 2024-09-10T22:26:43.052 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:43.046+0000 7f725fcce740 10 client.24982 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-10T22:26:43.052 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:43.046+0000 7f725fcce740 20 client.24982 populate_metadata read hostname 'smithi019' 2024-09-10T22:26:43.052 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:43.046+0000 7f725fcce740 1 --2- 172.21.15.19:0/2040718132 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x559f7a38d2e0 0x559f7a38f700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:26:43.052 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:43.046+0000 7f725fcce740 4 client.24982 mds_command: new command op to 24581 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-10T22:26:43.052 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:43.046+0000 7f725fcce740 1 -- 172.21.15.19:0/2040718132 --> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] -- command(tid 0: {"prefix": "flush journal"}) -- 0x559f7a27b0f0 con 0x559f7a38d2e0 2024-09-10T22:26:43.052 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:43.046+0000 7f7255d9b640 1 --2- 172.21.15.19:0/2040718132 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x559f7a38d2e0 0x559f7a38f700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:26:43.052 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:43.047+0000 7f7255d9b640 1 --2- 172.21.15.19:0/2040718132 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x559f7a38d2e0 0x559f7a38f700 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8fd8ef4217264e2c server_cookie=ff2fdce5c1e36461 in_seq=0 out_seq=0 2024-09-10T22:26:43.052 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:43.047+0000 7f723dffb640 10 client.24982 ms_handle_connect on v2:172.21.15.135:6838/1254769802 2024-09-10T22:26:43.056 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:43.053+0000 7f723dffb640 1 -- 172.21.15.19:0/2040718132 <== mds.0 v2:172.21.15.135:6838/1254769802 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x559f7a27b0f0 con 0x559f7a38d2e0 2024-09-10T22:26:43.056 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:43.053+0000 7f723dffb640 10 client.24982 handle_command_reply: tid=0 2024-09-10T22:26:43.056 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:43.053+0000 7f725fcce740 1 client.24982 shutdown 2024-09-10T22:26:43.057 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:43.053+0000 7f725fcce740 1 -- 172.21.15.19:0/2040718132 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x559f7a30b860 msgr2=0x559f7a31c1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:26:43.057 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:43.053+0000 7f725fcce740 1 --2- 172.21.15.19:0/2040718132 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x559f7a30b860 0x559f7a31c1f0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f72480a99d0 tx=0x7f72480ac780 comp rx=0 tx=0).stop 2024-09-10T22:26:43.057 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:43.053+0000 7f725fcce740 1 -- 172.21.15.19:0/2040718132 shutdown_connections 2024-09-10T22:26:43.057 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:43.053+0000 7f725fcce740 1 --2- 172.21.15.19:0/2040718132 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x559f7a310bd0 0x559f7a38af50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:26:43.057 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:43.053+0000 7f725fcce740 1 --2- 172.21.15.19:0/2040718132 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559f7a30e190 0x559f7a31c850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:26:43.057 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:43.053+0000 7f725fcce740 1 --2- 172.21.15.19:0/2040718132 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x559f7a38d2e0 0x559f7a38f700 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:26:43.057 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:43.054+0000 7f725fcce740 1 --2- 172.21.15.19:0/2040718132 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x559f7a30b860 0x559f7a31c1f0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:26:43.057 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:43.054+0000 7f723dffb640 0 client.24982 ms_handle_reset on v2:172.21.15.135:6838/1254769802 2024-09-10T22:26:43.057 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:43.054+0000 7f725fcce740 1 -- 172.21.15.19:0/2040718132 >> 172.21.15.19:0/2040718132 conn(0x559f7a3069b0 msgr2=0x559f7a30ad10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:26:43.057 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:43.054+0000 7f725fcce740 1 -- 172.21.15.19:0/2040718132 shutdown_connections 2024-09-10T22:26:43.057 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:43.054+0000 7f725fcce740 1 -- 172.21.15.19:0/2040718132 wait complete. 2024-09-10T22:26:43.057 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:43.054+0000 7f725fcce740 20 client.24982 trim_cache size 0 max 16384 2024-09-10T22:26:43.058 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stdout:{ 2024-09-10T22:26:43.058 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stdout: "message": "", 2024-09-10T22:26:43.058 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stdout: "return_code": 0 2024-09-10T22:26:43.058 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stdout:} 2024-09-10T22:26:43.059 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:43.054+0000 7f725cefe640 1 -- 172.21.15.19:0/2447390229 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f72400b52e0 msgr2=0x7f72400b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:26:43.059 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:43.054+0000 7f725cefe640 1 --2- 172.21.15.19:0/2447390229 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f72400b52e0 0x7f72400b77a0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f7250009270 tx=0x7f72500095e0 comp rx=0 tx=0).stop 2024-09-10T22:26:43.059 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:43.054+0000 7f725cefe640 1 -- 172.21.15.19:0/2447390229 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7258101890 msgr2=0x7f7258198d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:26:43.059 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:43.054+0000 7f725cefe640 1 --2- 172.21.15.19:0/2447390229 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7258101890 0x7f7258198d40 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f724800e9f0 tx=0x7f724800eeb0 comp rx=0 tx=0).stop 2024-09-10T22:26:43.059 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:43.055+0000 7f725cefe640 1 -- 172.21.15.19:0/2447390229 shutdown_connections 2024-09-10T22:26:43.059 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:43.055+0000 7f725cefe640 1 --2- 172.21.15.19:0/2447390229 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f72400b52e0 0x7f72400b77a0 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:26:43.059 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:43.055+0000 7f725cefe640 1 --2- 172.21.15.19:0/2447390229 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f72581033a0 0x7f7258199fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:26:43.059 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:43.055+0000 7f725cefe640 1 --2- 172.21.15.19:0/2447390229 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f72581029e0 0x7f7258199390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:26:43.059 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:43.055+0000 7f725cefe640 1 --2- 172.21.15.19:0/2447390229 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7258101890 0x7f7258198d40 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:26:43.059 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:43.055+0000 7f725cefe640 1 -- 172.21.15.19:0/2447390229 >> 172.21.15.19:0/2447390229 conn(0x7f72580fd130 msgr2=0x7f7258105d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:26:43.060 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:43.055+0000 7f725cefe640 1 -- 172.21.15.19:0/2447390229 shutdown_connections 2024-09-10T22:26:43.060 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:43.055+0000 7f725cefe640 1 -- 172.21.15.19:0/2447390229 wait complete. 2024-09-10T22:26:44.458 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:26:44 smithi019 ceph-mon[31375]: pgmap v356: 97 pgs: 97 active+clean; 654 KiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 1.5 KiB/s wr, 9 op/s 2024-09-10T22:26:44.609 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:26:44 smithi135 ceph-mon[34789]: pgmap v356: 97 pgs: 97 active+clean; 654 KiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 1.5 KiB/s wr, 9 op/s 2024-09-10T22:26:44.625 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:26:44 smithi138 ceph-mon[35236]: pgmap v356: 97 pgs: 97 active+clean; 654 KiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 1.5 KiB/s wr, 9 op/s 2024-09-10T22:26:46.458 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:26:46 smithi019 ceph-mon[31375]: pgmap v357: 97 pgs: 97 active+clean; 654 KiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 767 B/s wr, 7 op/s 2024-09-10T22:26:46.609 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:26:46 smithi135 ceph-mon[34789]: pgmap v357: 97 pgs: 97 active+clean; 654 KiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 767 B/s wr, 7 op/s 2024-09-10T22:26:46.625 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:26:46 smithi138 ceph-mon[35236]: pgmap v357: 97 pgs: 97 active+clean; 654 KiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 767 B/s wr, 7 op/s 2024-09-10T22:26:48.458 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:26:48 smithi019 ceph-mon[31375]: pgmap v358: 97 pgs: 97 active+clean; 654 KiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 597 B/s wr, 8 op/s 2024-09-10T22:26:48.609 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:26:48 smithi135 ceph-mon[34789]: pgmap v358: 97 pgs: 97 active+clean; 654 KiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 597 B/s wr, 8 op/s 2024-09-10T22:26:48.624 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:26:48 smithi138 ceph-mon[35236]: pgmap v358: 97 pgs: 97 active+clean; 654 KiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 597 B/s wr, 8 op/s 2024-09-10T22:26:49.458 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:26:49 smithi019 ceph-mon[31375]: pgmap v359: 97 pgs: 97 active+clean; 654 KiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 426 B/s wr, 5 op/s 2024-09-10T22:26:49.525 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:26:49 smithi138 ceph-mon[35236]: pgmap v359: 97 pgs: 97 active+clean; 654 KiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 426 B/s wr, 5 op/s 2024-09-10T22:26:49.609 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:26:49 smithi135 ceph-mon[34789]: pgmap v359: 97 pgs: 97 active+clean; 654 KiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 426 B/s wr, 5 op/s 2024-09-10T22:26:49.854 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 22997a4c-6fc2-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-10T22:26:50.154 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/22997a4c-6fc2-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T22:26:50.718 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:50.716+0000 7f33aa4ad640 1 -- 172.21.15.19:0/220069361 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f33a4101ca0 msgr2=0x7f33a4102080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:26:50.718 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:50.716+0000 7f33aa4ad640 1 --2- 172.21.15.19:0/220069361 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f33a4101ca0 0x7f33a4102080 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f3394009900 tx=0x7f339402a410 comp rx=0 tx=0).stop 2024-09-10T22:26:50.718 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:50.716+0000 7f33aa4ad640 1 -- 172.21.15.19:0/220069361 shutdown_connections 2024-09-10T22:26:50.718 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:50.716+0000 7f33aa4ad640 1 --2- 172.21.15.19:0/220069361 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f33a4108030 0x7f33a410e830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:26:50.718 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:50.716+0000 7f33aa4ad640 1 --2- 172.21.15.19:0/220069361 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f33a41076b0 0x7f33a4107af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:26:50.718 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:50.716+0000 7f33aa4ad640 1 --2- 172.21.15.19:0/220069361 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f33a4101ca0 0x7f33a4102080 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:26:50.719 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:50.716+0000 7f33aa4ad640 1 -- 172.21.15.19:0/220069361 >> 172.21.15.19:0/220069361 conn(0x7f33a40fd730 msgr2=0x7f33a40ffb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:26:50.719 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:50.716+0000 7f33aa4ad640 1 -- 172.21.15.19:0/220069361 shutdown_connections 2024-09-10T22:26:50.719 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:50.716+0000 7f33aa4ad640 1 -- 172.21.15.19:0/220069361 wait complete. 2024-09-10T22:26:50.719 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:50.718+0000 7f33aa4ad640 1 Processor -- start 2024-09-10T22:26:50.719 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:50.718+0000 7f33aa4ad640 1 -- start start 2024-09-10T22:26:50.720 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:50.719+0000 7f33aa4ad640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f33a4101ca0 0x7f33a41980e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:26:50.720 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:50.719+0000 7f33aa4ad640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f33a41076b0 0x7f33a4198620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:26:50.721 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:50.719+0000 7f33aa4ad640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f33a4108030 0x7f33a419d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:26:50.721 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:50.719+0000 7f33a3fff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f33a4101ca0 0x7f33a41980e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:26:50.721 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:50.719+0000 7f33a3fff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f33a4101ca0 0x7f33a41980e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:45052/0 (socket says 172.21.15.19:45052) 2024-09-10T22:26:50.721 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:50.719+0000 7f33a3fff640 1 -- 172.21.15.19:0/1815022190 learned_addr learned my addr 172.21.15.19:0/1815022190 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:26:50.721 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:50.719+0000 7f33aa4ad640 1 -- 172.21.15.19:0/1815022190 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f33a4111cf0 con 0x7f33a4101ca0 2024-09-10T22:26:50.721 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:50.719+0000 7f33a8a4a640 1 --2- 172.21.15.19:0/1815022190 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f33a4108030 0x7f33a419d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:26:50.721 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:50.719+0000 7f33aa4ad640 1 -- 172.21.15.19:0/1815022190 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f33a4111b70 con 0x7f33a41076b0 2024-09-10T22:26:50.721 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:50.719+0000 7f33a37fe640 1 --2- 172.21.15.19:0/1815022190 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f33a41076b0 0x7f33a4198620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:26:50.721 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:50.719+0000 7f33aa4ad640 1 -- 172.21.15.19:0/1815022190 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f33a4111e70 con 0x7f33a4108030 2024-09-10T22:26:50.722 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:50.720+0000 7f33a3fff640 1 -- 172.21.15.19:0/1815022190 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f33a4108030 msgr2=0x7f33a419d9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:26:50.722 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:50.720+0000 7f33a3fff640 1 --2- 172.21.15.19:0/1815022190 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f33a4108030 0x7f33a419d9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:26:50.722 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:50.720+0000 7f33a3fff640 1 -- 172.21.15.19:0/1815022190 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f33a41076b0 msgr2=0x7f33a4198620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:26:50.722 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:50.720+0000 7f33a3fff640 1 --2- 172.21.15.19:0/1815022190 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f33a41076b0 0x7f33a4198620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:26:50.722 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:50.720+0000 7f33a3fff640 1 -- 172.21.15.19:0/1815022190 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f33a419e190 con 0x7f33a4101ca0 2024-09-10T22:26:50.722 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:50.720+0000 7f33a3fff640 1 --2- 172.21.15.19:0/1815022190 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f33a4101ca0 0x7f33a41980e0 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f3394006010 tx=0x7f33940042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:26:50.722 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:50.720+0000 7f33a17fa640 1 -- 172.21.15.19:0/1815022190 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f339403f030 con 0x7f33a4101ca0 2024-09-10T22:26:50.723 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:50.720+0000 7f33a17fa640 1 -- 172.21.15.19:0/1815022190 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3394003800 con 0x7f33a4101ca0 2024-09-10T22:26:50.723 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:50.720+0000 7f33a17fa640 1 -- 172.21.15.19:0/1815022190 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3394035070 con 0x7f33a4101ca0 2024-09-10T22:26:50.723 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:50.721+0000 7f33aa4ad640 1 -- 172.21.15.19:0/1815022190 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f33a419e420 con 0x7f33a4101ca0 2024-09-10T22:26:50.723 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:50.721+0000 7f33aa4ad640 1 -- 172.21.15.19:0/1815022190 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f33a406b4b0 con 0x7f33a4101ca0 2024-09-10T22:26:50.726 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:50.724+0000 7f33a17fa640 1 -- 172.21.15.19:0/1815022190 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 18) ==== 153250+0+0 (secure 0 0 0) 0x7f3394031b10 con 0x7f33a4101ca0 2024-09-10T22:26:50.726 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:50.725+0000 7f33ac882740 1 Processor -- start 2024-09-10T22:26:50.726 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:50.725+0000 7f33ac882740 1 -- start start 2024-09-10T22:26:50.727 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:50.725+0000 7f33ac882740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559bd9aa7480 0x559bd9aa7860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:26:50.727 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:50.725+0000 7f33ac882740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x559bd9aa7da0 0x559bd9ab37f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:26:50.727 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:50.726+0000 7f33ac882740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x559bd9ab3d30 0x559bd9ab6120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:26:50.727 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:50.726+0000 7f33ac882740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x559bd9a1de50 con 0x559bd9aa7da0 2024-09-10T22:26:50.727 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:50.726+0000 7f33ac882740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x559bd9a0d280 con 0x559bd9aa7480 2024-09-10T22:26:50.727 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:50.726+0000 7f33ac882740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x559bd9a11090 con 0x559bd9ab3d30 2024-09-10T22:26:50.728 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:50.726+0000 7f33a8a4a640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559bd9aa7480 0x559bd9aa7860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:26:50.728 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:50.726+0000 7f33a8a4a640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559bd9aa7480 0x559bd9aa7860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.19:52990/0 (socket says 172.21.15.19:52990) 2024-09-10T22:26:50.728 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:50.726+0000 7f33a8a4a640 1 -- 172.21.15.19:0/1081790328 learned_addr learned my addr 172.21.15.19:0/1081790328 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:26:50.728 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:50.726+0000 7f33a17fa640 1 --2- 172.21.15.19:0/1815022190 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f338c0b9770 0x7f338c0bbc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:26:50.728 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:50.726+0000 7f33a37fe640 1 --2- 172.21.15.19:0/1081790328 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x559bd9ab3d30 0x559bd9ab6120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:26:50.728 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:50.726+0000 7f33a8a4a640 1 --2- 172.21.15.19:0/1815022190 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f338c0b9770 0x7f338c0bbc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:26:50.728 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:50.726+0000 7f33a8a4a640 1 -- 172.21.15.19:0/1081790328 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x559bd9ab3d30 msgr2=0x559bd9ab6120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:26:50.729 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:50.726+0000 7f33a8a4a640 1 --2- 172.21.15.19:0/1081790328 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x559bd9ab3d30 0x559bd9ab6120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:26:50.729 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:50.726+0000 7f33a8a4a640 1 -- 172.21.15.19:0/1081790328 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x559bd9aa7da0 msgr2=0x559bd9ab37f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-10T22:26:50.729 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:50.726+0000 7f33a17fa640 1 -- 172.21.15.19:0/1815022190 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8327+0+0 (secure 0 0 0) 0x7f3394106030 con 0x7f33a4101ca0 2024-09-10T22:26:50.729 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:50.727+0000 7f33a3fff640 1 --2- 172.21.15.19:0/1081790328 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x559bd9aa7da0 0x559bd9ab37f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:26:50.729 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:50.727+0000 7f33a8a4a640 1 --2- 172.21.15.19:0/1081790328 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x559bd9aa7da0 0x559bd9ab37f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:26:50.729 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:50.727+0000 7f33a8a4a640 1 -- 172.21.15.19:0/1081790328 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559bd976b650 con 0x559bd9aa7480 2024-09-10T22:26:50.729 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:50.727+0000 7f33a3fff640 1 --2- 172.21.15.19:0/1081790328 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x559bd9aa7da0 0x559bd9ab37f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T22:26:50.729 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:50.727+0000 7f33a8a4a640 1 --2- 172.21.15.19:0/1081790328 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559bd9aa7480 0x559bd9aa7860 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f339c0135e0 tx=0x7f339c013aa0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b8468b005d8839db server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:26:50.731 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:50.727+0000 7f338a7fc640 1 -- 172.21.15.19:0/1081790328 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f339c011dd0 con 0x559bd9aa7480 2024-09-10T22:26:50.732 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:50.727+0000 7f338a7fc640 1 -- 172.21.15.19:0/1081790328 <== mon.2 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f339c01b410 con 0x559bd9aa7480 2024-09-10T22:26:50.732 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:50.728+0000 7f33ac882740 1 -- 172.21.15.19:0/1081790328 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559bd9aa7480 msgr2=0x559bd9aa7860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:26:50.732 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:50.728+0000 7f33a8a4a640 1 --2- 172.21.15.19:0/1815022190 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f338c0b9770 0x7f338c0bbc30 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f339c01f000 tx=0x7f339c01b000 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:26:50.732 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:50.728+0000 7f33ac882740 1 --2- 172.21.15.19:0/1081790328 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559bd9aa7480 0x559bd9aa7860 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f339c0135e0 tx=0x7f339c013aa0 comp rx=0 tx=0).stop 2024-09-10T22:26:50.732 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:50.728+0000 7f33ac882740 1 -- 172.21.15.19:0/1081790328 shutdown_connections 2024-09-10T22:26:50.732 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:50.728+0000 7f33ac882740 1 --2- 172.21.15.19:0/1081790328 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x559bd9ab3d30 0x559bd9ab6120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:26:50.732 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:50.728+0000 7f33ac882740 1 --2- 172.21.15.19:0/1081790328 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x559bd9aa7da0 0x559bd9ab37f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:26:50.732 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:50.728+0000 7f33ac882740 1 --2- 172.21.15.19:0/1081790328 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559bd9aa7480 0x559bd9aa7860 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:26:50.732 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:50.728+0000 7f33ac882740 1 -- 172.21.15.19:0/1081790328 >> 172.21.15.19:0/1081790328 conn(0x559bd9aa52b0 msgr2=0x559bd9aa6450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:26:50.732 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:50.728+0000 7f33ac882740 1 -- 172.21.15.19:0/1081790328 shutdown_connections 2024-09-10T22:26:50.732 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:50.728+0000 7f33ac882740 1 -- 172.21.15.19:0/1081790328 wait complete. 2024-09-10T22:26:50.733 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:50.729+0000 7f33ac882740 1 -- start start 2024-09-10T22:26:50.733 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:50.729+0000 7f33ac882740 1 Processor -- start 2024-09-10T22:26:50.733 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:50.729+0000 7f33ac882740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559bd9aa7480 0x559bd9ab35a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:26:50.733 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:50.730+0000 7f33ac882740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x559bd9aa7da0 0x559bd9ab09f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:26:50.733 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:50.730+0000 7f33ac882740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x559bd9ab3d30 0x559bd9ab0f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:26:50.733 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:50.730+0000 7f33ac882740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x559bd986e700 con 0x559bd9aa7da0 2024-09-10T22:26:50.733 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:50.730+0000 7f33a37fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x559bd9aa7da0 0x559bd9ab09f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:26:50.733 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:50.730+0000 7f33a37fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x559bd9aa7da0 0x559bd9ab09f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:45070/0 (socket says 172.21.15.19:45070) 2024-09-10T22:26:50.733 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:50.730+0000 7f33a37fe640 1 -- 172.21.15.19:0/1108651011 learned_addr learned my addr 172.21.15.19:0/1108651011 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:26:50.733 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:50.730+0000 7f33a3fff640 1 --2- 172.21.15.19:0/1108651011 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559bd9aa7480 0x559bd9ab35a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:26:50.733 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:50.730+0000 7f33a8a4a640 1 --2- 172.21.15.19:0/1108651011 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x559bd9ab3d30 0x559bd9ab0f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:26:50.737 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:50.730+0000 7f33ac882740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x559bd99a8110 con 0x559bd9aa7480 2024-09-10T22:26:50.737 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:50.730+0000 7f33ac882740 1 -- 172.21.15.19:0/1108651011 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x559bd9ab6a00 con 0x559bd9ab3d30 2024-09-10T22:26:50.737 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:50.730+0000 7f33a37fe640 1 -- 172.21.15.19:0/1108651011 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x559bd9ab3d30 msgr2=0x559bd9ab0f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:26:50.737 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:50.730+0000 7f33a37fe640 1 --2- 172.21.15.19:0/1108651011 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x559bd9ab3d30 0x559bd9ab0f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:26:50.738 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:50.730+0000 7f33a37fe640 1 -- 172.21.15.19:0/1108651011 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559bd9aa7480 msgr2=0x559bd9ab35a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:26:50.738 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:50.730+0000 7f33a37fe640 1 --2- 172.21.15.19:0/1108651011 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559bd9aa7480 0x559bd9ab35a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:26:50.738 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:50.730+0000 7f33a37fe640 1 -- 172.21.15.19:0/1108651011 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559bd99d5c40 con 0x559bd9aa7da0 2024-09-10T22:26:50.738 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:50.730+0000 7f33a3fff640 1 --2- 172.21.15.19:0/1108651011 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559bd9aa7480 0x559bd9ab35a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T22:26:50.738 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:50.730+0000 7f33a8a4a640 1 --2- 172.21.15.19:0/1108651011 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x559bd9ab3d30 0x559bd9ab0f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T22:26:50.738 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:50.731+0000 7f33a37fe640 1 --2- 172.21.15.19:0/1108651011 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x559bd9aa7da0 0x559bd9ab09f0 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f339800f3e0 tx=0x7f339800f8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e484a932f0f1be48 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:26:50.738 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:50.731+0000 7f33ac882740 10 client.0 _ll_register_callbacks cb 0x559bd99c1990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T22:26:50.738 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:50.731+0000 7f33ac882740 1 -- 172.21.15.19:0/1108651011 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f339c01b410 con 0x559bd9aa7da0 2024-09-10T22:26:50.738 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:50.731+0000 7f33837fe640 10 client.15420 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-10T22:26:50.738 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:50.731+0000 7f33837fe640 1 -- 172.21.15.19:0/1108651011 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3398005220 con 0x559bd9aa7da0 2024-09-10T22:26:50.738 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:50.731+0000 7f33837fe640 1 -- 172.21.15.19:0/1108651011 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8327+0+0 (secure 0 0 0) 0x7f33980053c0 con 0x559bd9aa7da0 2024-09-10T22:26:50.738 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:50.731+0000 7f33837fe640 1 -- 172.21.15.19:0/1108651011 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f3398005620 con 0x559bd9aa7da0 2024-09-10T22:26:50.738 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:50.731+0000 7f33ac882740 10 client.15420 fetch_fsmap learned FSMap version 25 2024-09-10T22:26:50.739 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:50.731+0000 7f33ac882740 1 -- 172.21.15.19:0/1108651011 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({fsmap=25}) -- 0x559bd9aca9d0 con 0x559bd9aa7da0 2024-09-10T22:26:50.739 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:50.732+0000 7f33837fe640 1 -- 172.21.15.19:0/1108651011 <== mon.0 v2:172.21.15.19:3300/0 4 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f33980047a0 con 0x559bd9aa7da0 2024-09-10T22:26:50.739 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:50.732+0000 7f33ac882740 10 client.15420 fetch_fsmap finished waiting for FSMap version 25 2024-09-10T22:26:50.739 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:50.732+0000 7f33ac882740 10 client.15420 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-10T22:26:50.739 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:50.732+0000 7f33ac882740 20 client.15420 populate_metadata read hostname 'smithi019' 2024-09-10T22:26:50.739 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:50.732+0000 7f33ac882740 1 --2- 172.21.15.19:0/1108651011 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x559bd9acbe20 0x559bd9ace210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:26:50.739 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:50.732+0000 7f33ac882740 4 client.15420 mds_command: new command op to 24581 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T22:26:50.739 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:50.732+0000 7f33ac882740 1 -- 172.21.15.19:0/1108651011 --> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x559bd9a1fda0 con 0x559bd9acbe20 2024-09-10T22:26:50.739 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:50.732+0000 7f33a3fff640 1 --2- 172.21.15.19:0/1108651011 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x559bd9acbe20 0x559bd9ace210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:26:50.739 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:50.733+0000 7f33837fe640 10 client.15420 ms_handle_connect on v2:172.21.15.135:6838/1254769802 2024-09-10T22:26:50.739 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:50.733+0000 7f33a3fff640 1 --2- 172.21.15.19:0/1108651011 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x559bd9acbe20 0x559bd9ace210 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=72a5d430ff862702 server_cookie=b52b1252e8d68c04 in_seq=0 out_seq=0 2024-09-10T22:26:50.739 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:50.733+0000 7f33837fe640 1 -- 172.21.15.19:0/1108651011 <== mds.0 v2:172.21.15.135:6838/1254769802 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x559bd9a1fda0 con 0x559bd9acbe20 2024-09-10T22:26:50.739 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:50.733+0000 7f33837fe640 10 client.15420 handle_command_reply: tid=0 2024-09-10T22:26:50.740 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:50.733+0000 7f33ac882740 1 client.15420 shutdown 2024-09-10T22:26:50.740 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:50.734+0000 7f33ac882740 1 -- 172.21.15.19:0/1108651011 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x559bd9aa7da0 msgr2=0x559bd9ab09f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:26:50.740 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:50.734+0000 7f33ac882740 1 --2- 172.21.15.19:0/1108651011 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x559bd9aa7da0 0x559bd9ab09f0 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f339800f3e0 tx=0x7f339800f8a0 comp rx=0 tx=0).stop 2024-09-10T22:26:50.740 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:50.734+0000 7f33ac882740 1 -- 172.21.15.19:0/1108651011 shutdown_connections 2024-09-10T22:26:50.740 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:50.734+0000 7f33ac882740 1 --2- 172.21.15.19:0/1108651011 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x559bd9acbe20 0x559bd9ace210 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:26:50.740 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:50.734+0000 7f33ac882740 1 --2- 172.21.15.19:0/1108651011 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x559bd9ab3d30 0x559bd9ab0f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:26:50.740 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:50.734+0000 7f33ac882740 1 --2- 172.21.15.19:0/1108651011 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x559bd9aa7da0 0x559bd9ab09f0 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:26:50.740 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:50.734+0000 7f33ac882740 1 --2- 172.21.15.19:0/1108651011 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559bd9aa7480 0x559bd9ab35a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:26:50.740 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:50.734+0000 7f33ac882740 1 -- 172.21.15.19:0/1108651011 >> 172.21.15.19:0/1108651011 conn(0x559bd9aa52b0 msgr2=0x559bd9aaae50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:26:50.740 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:50.734+0000 7f33837fe640 0 client.15420 ms_handle_reset on v2:172.21.15.135:6838/1254769802 2024-09-10T22:26:50.740 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:50.734+0000 7f33ac882740 1 -- 172.21.15.19:0/1108651011 shutdown_connections 2024-09-10T22:26:50.740 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:50.734+0000 7f33ac882740 1 -- 172.21.15.19:0/1108651011 wait complete. 2024-09-10T22:26:50.740 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:50.734+0000 7f33ac882740 20 client.15420 trim_cache size 0 max 16384 2024-09-10T22:26:50.771 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:50.769+0000 7f33ac882740 1 Processor -- start 2024-09-10T22:26:50.771 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:50.769+0000 7f33ac882740 1 -- start start 2024-09-10T22:26:50.771 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:50.769+0000 7f33ac882740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x559bd9aa7480 0x559bd9aa4bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:26:50.771 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:50.769+0000 7f33ac882740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559bd9aa7da0 0x559bd9aaf270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:26:50.771 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:50.769+0000 7f33ac882740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x559bd9ab3d30 0x559bd9aadc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:26:50.771 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:50.769+0000 7f33ac882740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f33a41aebf0 con 0x559bd9ab3d30 2024-09-10T22:26:50.771 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:50.769+0000 7f33ac882740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f33a41ac4c0 con 0x559bd9aa7da0 2024-09-10T22:26:50.773 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:50.769+0000 7f33ac882740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f33a41aa310 con 0x559bd9aa7480 2024-09-10T22:26:50.773 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:50.770+0000 7f33a8a4a640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x559bd9ab3d30 0x559bd9aadc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:26:50.774 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:50.770+0000 7f33a8a4a640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x559bd9ab3d30 0x559bd9aadc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:45082/0 (socket says 172.21.15.19:45082) 2024-09-10T22:26:50.774 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:50.770+0000 7f33a8a4a640 1 -- 172.21.15.19:0/1171742542 learned_addr learned my addr 172.21.15.19:0/1171742542 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:26:50.774 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:50.770+0000 7f33a37fe640 1 --2- 172.21.15.19:0/1171742542 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559bd9aa7da0 0x559bd9aaf270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:26:50.774 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:50.770+0000 7f33a3fff640 1 --2- 172.21.15.19:0/1171742542 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x559bd9aa7480 0x559bd9aa4bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:26:50.774 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:50.770+0000 7f33a8a4a640 1 -- 172.21.15.19:0/1171742542 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x559bd9aa7480 msgr2=0x559bd9aa4bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:26:50.774 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:50.770+0000 7f33a8a4a640 1 --2- 172.21.15.19:0/1171742542 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x559bd9aa7480 0x559bd9aa4bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:26:50.774 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:50.770+0000 7f33a8a4a640 1 -- 172.21.15.19:0/1171742542 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559bd9aa7da0 msgr2=0x559bd9aaf270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:26:50.774 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:50.770+0000 7f33a8a4a640 1 --2- 172.21.15.19:0/1171742542 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559bd9aa7da0 0x559bd9aaf270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:26:50.774 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:50.770+0000 7f33a8a4a640 1 -- 172.21.15.19:0/1171742542 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559bd9aaf950 con 0x559bd9ab3d30 2024-09-10T22:26:50.774 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:50.770+0000 7f33a8a4a640 1 --2- 172.21.15.19:0/1171742542 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x559bd9ab3d30 0x559bd9aadc00 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f339c012010 tx=0x7f339c005f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f1f2bd2ca6fc3ead server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:26:50.774 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:50.770+0000 7f3389ffb640 1 -- 172.21.15.19:0/1171742542 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f339c00ab00 con 0x559bd9ab3d30 2024-09-10T22:26:50.775 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:50.771+0000 7f3389ffb640 1 -- 172.21.15.19:0/1171742542 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f339c00e700 con 0x559bd9ab3d30 2024-09-10T22:26:50.775 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:50.771+0000 7f3389ffb640 1 -- 172.21.15.19:0/1171742542 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f339c01b5c0 con 0x559bd9ab3d30 2024-09-10T22:26:50.775 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:50.771+0000 7f33ac882740 1 -- 172.21.15.19:0/1171742542 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x559bd9ab3d30 msgr2=0x559bd9aadc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:26:50.775 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:50.771+0000 7f33ac882740 1 --2- 172.21.15.19:0/1171742542 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x559bd9ab3d30 0x559bd9aadc00 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f339c012010 tx=0x7f339c005f60 comp rx=0 tx=0).stop 2024-09-10T22:26:50.775 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:50.772+0000 7f33ac882740 1 -- 172.21.15.19:0/1171742542 shutdown_connections 2024-09-10T22:26:50.775 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:50.772+0000 7f33ac882740 1 --2- 172.21.15.19:0/1171742542 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x559bd9ab3d30 0x559bd9aadc00 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:26:50.777 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:50.772+0000 7f33ac882740 1 --2- 172.21.15.19:0/1171742542 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559bd9aa7da0 0x559bd9aaf270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:26:50.777 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:50.772+0000 7f33ac882740 1 --2- 172.21.15.19:0/1171742542 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x559bd9aa7480 0x559bd9aa4bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:26:50.777 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:50.772+0000 7f33ac882740 1 -- 172.21.15.19:0/1171742542 >> 172.21.15.19:0/1171742542 conn(0x559bd9aa52b0 msgr2=0x559bd9acdd90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:26:50.778 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:50.772+0000 7f33ac882740 1 -- 172.21.15.19:0/1171742542 shutdown_connections 2024-09-10T22:26:50.778 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:50.772+0000 7f33ac882740 1 -- 172.21.15.19:0/1171742542 wait complete. 2024-09-10T22:26:50.778 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:50.772+0000 7f33ac882740 1 -- start start 2024-09-10T22:26:50.778 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:50.772+0000 7f33ac882740 1 Processor -- start 2024-09-10T22:26:50.778 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:50.773+0000 7f33ac882740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559bd9aa7480 0x559bd9ac4a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:26:50.778 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:50.773+0000 7f33ac882740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x559bd9aa7da0 0x559bd9ac4fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:26:50.778 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:50.773+0000 7f33ac882740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x559bd9ab3d30 0x559bd9ac1200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:26:50.778 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:50.773+0000 7f33a37fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x559bd9aa7da0 0x559bd9ac4fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:26:50.778 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:50.773+0000 7f33a37fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x559bd9aa7da0 0x559bd9ac4fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:45090/0 (socket says 172.21.15.19:45090) 2024-09-10T22:26:50.778 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:50.773+0000 7f33a37fe640 1 -- 172.21.15.19:0/4098061723 learned_addr learned my addr 172.21.15.19:0/4098061723 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:26:50.778 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:50.773+0000 7f33ac882740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f33a41aa980 con 0x559bd9aa7da0 2024-09-10T22:26:50.778 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:50.773+0000 7f33ac882740 1 -- 172.21.15.19:0/4098061723 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f33a41abdf0 con 0x559bd9aa7480 2024-09-10T22:26:50.779 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:50.773+0000 7f33ac882740 1 -- 172.21.15.19:0/4098061723 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f33a41ab050 con 0x559bd9ab3d30 2024-09-10T22:26:50.779 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:50.773+0000 7f33ac882740 10 client.0 _ll_register_callbacks cb 0x7f339800a330 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T22:26:50.779 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:50.773+0000 7f33a8a4a640 1 --2- 172.21.15.19:0/4098061723 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x559bd9ab3d30 0x559bd9ac1200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:26:50.779 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:50.773+0000 7f33a3fff640 1 --2- 172.21.15.19:0/4098061723 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559bd9aa7480 0x559bd9ac4a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:26:50.779 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:50.773+0000 7f33a8a4a640 1 -- 172.21.15.19:0/4098061723 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559bd9aa7480 msgr2=0x559bd9ac4a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:26:50.779 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:50.773+0000 7f33a8a4a640 1 --2- 172.21.15.19:0/4098061723 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559bd9aa7480 0x559bd9ac4a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:26:50.779 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:50.773+0000 7f33a8a4a640 1 -- 172.21.15.19:0/4098061723 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x559bd9aa7da0 msgr2=0x559bd9ac4fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:26:50.780 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:50.773+0000 7f33a8a4a640 1 --2- 172.21.15.19:0/4098061723 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x559bd9aa7da0 0x559bd9ac4fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:26:50.780 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:50.773+0000 7f33a8a4a640 1 -- 172.21.15.19:0/4098061723 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559bd9ac1a30 con 0x559bd9ab3d30 2024-09-10T22:26:50.780 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:50.773+0000 7f33a37fe640 1 --2- 172.21.15.19:0/4098061723 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x559bd9aa7da0 0x559bd9ac4fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T22:26:50.780 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:50.774+0000 7f33a8a4a640 1 --2- 172.21.15.19:0/4098061723 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x559bd9ab3d30 0x559bd9ac1200 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f339c014fd0 tx=0x7f339c00ad30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=96e6715b0aa0bba2 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:26:50.780 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:50.774+0000 7f33837fe640 10 client.0 ms_handle_connect on v2:172.21.15.138:3300/0 2024-09-10T22:26:50.780 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:50.774+0000 7f33837fe640 1 -- 172.21.15.19:0/4098061723 <== mon.1 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f339c011d70 con 0x559bd9ab3d30 2024-09-10T22:26:50.781 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:50.774+0000 7f33ac882740 1 -- 172.21.15.19:0/4098061723 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f339c00e700 con 0x559bd9ab3d30 2024-09-10T22:26:50.781 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:50.774+0000 7f33837fe640 1 -- 172.21.15.19:0/4098061723 <== mon.1 v2:172.21.15.138:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8327+0+0 (secure 0 0 0) 0x7f339c021040 con 0x559bd9ab3d30 2024-09-10T22:26:50.781 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:50.774+0000 7f33837fe640 1 -- 172.21.15.19:0/4098061723 <== mon.1 v2:172.21.15.138:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f339c004600 con 0x559bd9ab3d30 2024-09-10T22:26:50.781 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:50.777+0000 7f33ac882740 10 client.24991 fetch_fsmap learned FSMap version 25 2024-09-10T22:26:50.781 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:50.777+0000 7f33ac882740 1 -- 172.21.15.19:0/4098061723 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x559bd9ab7a80 con 0x559bd9ab3d30 2024-09-10T22:26:50.781 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:50.777+0000 7f33837fe640 1 -- 172.21.15.19:0/4098061723 <== mon.1 v2:172.21.15.138:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f339c00e700 con 0x559bd9ab3d30 2024-09-10T22:26:50.781 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:50.777+0000 7f33837fe640 1 -- 172.21.15.19:0/4098061723 <== mon.1 v2:172.21.15.138:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f339c01bb00 con 0x559bd9ab3d30 2024-09-10T22:26:50.781 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:50.778+0000 7f33ac882740 10 client.24991 fetch_fsmap finished waiting for FSMap version 25 2024-09-10T22:26:50.781 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:50.778+0000 7f33ac882740 10 client.24991 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-10T22:26:50.781 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:50.778+0000 7f33ac882740 20 client.24991 populate_metadata read hostname 'smithi019' 2024-09-10T22:26:50.781 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:50.778+0000 7f33ac882740 1 --2- 172.21.15.19:0/4098061723 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x559bd9ab7f70 0x559bd9aba360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:26:50.781 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:50.778+0000 7f33ac882740 4 client.24991 mds_command: new command op to 24581 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-10T22:26:50.782 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:50.778+0000 7f33ac882740 1 -- 172.21.15.19:0/4098061723 --> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] -- command(tid 0: {"prefix": "scrub status"}) -- 0x559bd9a1b850 con 0x559bd9ab7f70 2024-09-10T22:26:50.782 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:50.778+0000 7f33a3fff640 1 --2- 172.21.15.19:0/4098061723 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x559bd9ab7f70 0x559bd9aba360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:26:50.782 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:50.779+0000 7f33a3fff640 1 --2- 172.21.15.19:0/4098061723 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x559bd9ab7f70 0x559bd9aba360 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3b1fb9b1d3328366 server_cookie=c6ea45b461669e8e in_seq=0 out_seq=0 2024-09-10T22:26:50.783 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:50.779+0000 7f33837fe640 10 client.24991 ms_handle_connect on v2:172.21.15.135:6838/1254769802 2024-09-10T22:26:50.783 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:50.779+0000 7f33837fe640 1 -- 172.21.15.19:0/4098061723 <== mds.0 v2:172.21.15.135:6838/1254769802 1 ==== command_reply(tid 0: 0 ) ==== 8+0+374 (crc 0 0 0) 0x559bd9a1b850 con 0x559bd9ab7f70 2024-09-10T22:26:50.783 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:50.779+0000 7f33837fe640 10 client.24991 handle_command_reply: tid=0 2024-09-10T22:26:50.783 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:50.779+0000 7f33ac882740 1 client.24991 shutdown 2024-09-10T22:26:50.783 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:50.779+0000 7f33ac882740 1 -- 172.21.15.19:0/4098061723 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x559bd9ab3d30 msgr2=0x559bd9ac1200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:26:50.783 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:50.779+0000 7f33ac882740 1 --2- 172.21.15.19:0/4098061723 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x559bd9ab3d30 0x559bd9ac1200 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f339c014fd0 tx=0x7f339c00ad30 comp rx=0 tx=0).stop 2024-09-10T22:26:50.783 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:50.779+0000 7f33ac882740 1 -- 172.21.15.19:0/4098061723 shutdown_connections 2024-09-10T22:26:50.783 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:50.779+0000 7f33ac882740 1 --2- 172.21.15.19:0/4098061723 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x559bd9ab7f70 0x559bd9aba360 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:26:50.783 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:50.779+0000 7f33837fe640 0 client.24991 ms_handle_reset on v2:172.21.15.135:6838/1254769802 2024-09-10T22:26:50.783 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:50.779+0000 7f33ac882740 1 --2- 172.21.15.19:0/4098061723 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x559bd9ab3d30 0x559bd9ac1200 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:26:50.784 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:50.779+0000 7f33ac882740 1 --2- 172.21.15.19:0/4098061723 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x559bd9aa7da0 0x559bd9ac4fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:26:50.784 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:50.779+0000 7f33ac882740 1 --2- 172.21.15.19:0/4098061723 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559bd9aa7480 0x559bd9ac4a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:26:50.784 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:50.779+0000 7f33ac882740 1 -- 172.21.15.19:0/4098061723 >> 172.21.15.19:0/4098061723 conn(0x559bd9aa52b0 msgr2=0x559bd9acdd90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:26:50.784 INFO:teuthology.orchestra.run.smithi019.stdout:{ 2024-09-10T22:26:50.784 INFO:teuthology.orchestra.run.smithi019.stdout: "status": "no active scrubs running", 2024-09-10T22:26:50.784 INFO:teuthology.orchestra.run.smithi019.stdout: "scrubs": {}, 2024-09-10T22:26:50.784 INFO:teuthology.orchestra.run.smithi019.stdout: "scrub_stats": { 2024-09-10T22:26:50.784 INFO:teuthology.orchestra.run.smithi019.stdout: "9b6bfdee-303c-4c12-af56-dc85860d112a": { 2024-09-10T22:26:50.784 INFO:teuthology.orchestra.run.smithi019.stdout: "start_time": "2024-09-10T22:26:17.484162+0000", 2024-09-10T22:26:50.785 INFO:teuthology.orchestra.run.smithi019.stdout: "path": "/", 2024-09-10T22:26:50.785 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_started": 0, 2024-09-10T22:26:50.785 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_passed": 0, 2024-09-10T22:26:50.785 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_failed": 0, 2024-09-10T22:26:50.785 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_skipped": 0 2024-09-10T22:26:50.785 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-10T22:26:50.785 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-10T22:26:50.785 INFO:teuthology.orchestra.run.smithi019.stdout:} 2024-09-10T22:26:50.785 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:50.779+0000 7f33ac882740 1 -- 172.21.15.19:0/4098061723 shutdown_connections 2024-09-10T22:26:50.786 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:50.779+0000 7f33ac882740 1 -- 172.21.15.19:0/4098061723 wait complete. 2024-09-10T22:26:50.786 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:50.780+0000 7f33ac882740 20 client.24991 trim_cache size 0 max 16384 2024-09-10T22:26:50.786 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:50.781+0000 7f33aa4ad640 1 -- 172.21.15.19:0/1815022190 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f338c0b9770 msgr2=0x7f338c0bbc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:26:50.786 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:50.781+0000 7f33aa4ad640 1 --2- 172.21.15.19:0/1815022190 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f338c0b9770 0x7f338c0bbc30 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f339c01f000 tx=0x7f339c01b000 comp rx=0 tx=0).stop 2024-09-10T22:26:50.786 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:50.781+0000 7f33aa4ad640 1 -- 172.21.15.19:0/1815022190 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f33a4101ca0 msgr2=0x7f33a41980e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:26:50.786 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:50.781+0000 7f33aa4ad640 1 --2- 172.21.15.19:0/1815022190 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f33a4101ca0 0x7f33a41980e0 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f3394006010 tx=0x7f33940042f0 comp rx=0 tx=0).stop 2024-09-10T22:26:50.786 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:50.781+0000 7f33aa4ad640 1 -- 172.21.15.19:0/1815022190 shutdown_connections 2024-09-10T22:26:50.786 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:50.781+0000 7f33aa4ad640 1 --2- 172.21.15.19:0/1815022190 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f338c0b9770 0x7f338c0bbc30 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:26:50.786 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:50.781+0000 7f33aa4ad640 1 --2- 172.21.15.19:0/1815022190 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f33a4108030 0x7f33a419d9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:26:50.786 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:50.781+0000 7f33aa4ad640 1 --2- 172.21.15.19:0/1815022190 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f33a41076b0 0x7f33a4198620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:26:50.786 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:50.781+0000 7f33aa4ad640 1 --2- 172.21.15.19:0/1815022190 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f33a4101ca0 0x7f33a41980e0 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:26:50.786 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:50.781+0000 7f33aa4ad640 1 -- 172.21.15.19:0/1815022190 >> 172.21.15.19:0/1815022190 conn(0x7f33a40fd730 msgr2=0x7f33a40ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:26:50.786 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:50.782+0000 7f33aa4ad640 1 -- 172.21.15.19:0/1815022190 shutdown_connections 2024-09-10T22:26:50.787 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:50.782+0000 7f33aa4ad640 1 -- 172.21.15.19:0/1815022190 wait complete. 2024-09-10T22:26:51.607 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-10T22:26:51.607 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 22997a4c-6fc2-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-10T22:26:51.708 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:26:51 smithi019 ceph-mon[31375]: pgmap v360: 97 pgs: 97 active+clean; 654 KiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-10T22:26:51.859 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:26:51 smithi135 ceph-mon[34789]: pgmap v360: 97 pgs: 97 active+clean; 654 KiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-10T22:26:51.875 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:26:51 smithi138 ceph-mon[35236]: pgmap v360: 97 pgs: 97 active+clean; 654 KiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-10T22:26:52.018 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/22997a4c-6fc2-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T22:26:52.567 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:52.565+0000 7f62ca985640 1 -- 172.21.15.19:0/2874119639 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f62c41076a0 msgr2=0x7f62c4107ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:26:52.567 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:52.565+0000 7f62ca985640 1 --2- 172.21.15.19:0/2874119639 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f62c41076a0 0x7f62c4107ae0 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f62b8009900 tx=0x7f62b802a410 comp rx=0 tx=0).stop 2024-09-10T22:26:52.567 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:52.565+0000 7f62ca985640 1 -- 172.21.15.19:0/2874119639 shutdown_connections 2024-09-10T22:26:52.568 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:52.565+0000 7f62ca985640 1 --2- 172.21.15.19:0/2874119639 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f62c4108020 0x7f62c410e820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:26:52.568 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:52.565+0000 7f62ca985640 1 --2- 172.21.15.19:0/2874119639 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f62c41076a0 0x7f62c4107ae0 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:26:52.568 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:52.565+0000 7f62ca985640 1 --2- 172.21.15.19:0/2874119639 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f62c4101c90 0x7f62c4102070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:26:52.568 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:52.565+0000 7f62ca985640 1 -- 172.21.15.19:0/2874119639 >> 172.21.15.19:0/2874119639 conn(0x7f62c40fd700 msgr2=0x7f62c40ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:26:52.569 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:52.566+0000 7f62ca985640 1 -- 172.21.15.19:0/2874119639 shutdown_connections 2024-09-10T22:26:52.569 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:52.566+0000 7f62ca985640 1 -- 172.21.15.19:0/2874119639 wait complete. 2024-09-10T22:26:52.569 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:52.567+0000 7f62ca985640 1 Processor -- start 2024-09-10T22:26:52.569 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:52.567+0000 7f62ca985640 1 -- start start 2024-09-10T22:26:52.570 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:52.568+0000 7f62ca985640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f62c4101c90 0x7f62c419a120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:26:52.570 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:52.568+0000 7f62ca985640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f62c41076a0 0x7f62c419a660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:26:52.570 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:52.568+0000 7f62c37fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f62c41076a0 0x7f62c419a660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:26:52.570 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:52.568+0000 7f62c37fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f62c41076a0 0x7f62c419a660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:45110/0 (socket says 172.21.15.19:45110) 2024-09-10T22:26:52.571 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:52.568+0000 7f62ca985640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f62c4108020 0x7f62c419abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:26:52.571 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:52.568+0000 7f62c37fe640 1 -- 172.21.15.19:0/2861995350 learned_addr learned my addr 172.21.15.19:0/2861995350 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:26:52.571 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:52.568+0000 7f62ca985640 1 -- 172.21.15.19:0/2861995350 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f62c4111d30 con 0x7f62c41076a0 2024-09-10T22:26:52.571 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:52.568+0000 7f62ca985640 1 -- 172.21.15.19:0/2861995350 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f62c4111bb0 con 0x7f62c4101c90 2024-09-10T22:26:52.571 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:52.568+0000 7f62c3fff640 1 --2- 172.21.15.19:0/2861995350 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f62c4101c90 0x7f62c419a120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:26:52.571 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:52.568+0000 7f62ca985640 1 -- 172.21.15.19:0/2861995350 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f62c4111eb0 con 0x7f62c4108020 2024-09-10T22:26:52.571 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:52.568+0000 7f62c8f22640 1 --2- 172.21.15.19:0/2861995350 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f62c4108020 0x7f62c419abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:26:52.571 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:52.569+0000 7f62c37fe640 1 -- 172.21.15.19:0/2861995350 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f62c4108020 msgr2=0x7f62c419abc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:26:52.571 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:52.569+0000 7f62c37fe640 1 --2- 172.21.15.19:0/2861995350 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f62c4108020 0x7f62c419abc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:26:52.571 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:52.569+0000 7f62c37fe640 1 -- 172.21.15.19:0/2861995350 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f62c4101c90 msgr2=0x7f62c419a120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:26:52.571 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:52.569+0000 7f62c37fe640 1 --2- 172.21.15.19:0/2861995350 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f62c4101c90 0x7f62c419a120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:26:52.571 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:52.569+0000 7f62c37fe640 1 -- 172.21.15.19:0/2861995350 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f62c41a5500 con 0x7f62c41076a0 2024-09-10T22:26:52.572 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:52.569+0000 7f62c37fe640 1 --2- 172.21.15.19:0/2861995350 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f62c41076a0 0x7f62c419a660 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f62b8005ab0 tx=0x7f62b8003c80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:26:52.572 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:52.569+0000 7f62c17fa640 1 -- 172.21.15.19:0/2861995350 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62b803f070 con 0x7f62c41076a0 2024-09-10T22:26:52.572 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:52.569+0000 7f62ca985640 1 -- 172.21.15.19:0/2861995350 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f62c41a5790 con 0x7f62c41076a0 2024-09-10T22:26:52.572 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:52.569+0000 7f62c17fa640 1 -- 172.21.15.19:0/2861995350 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f62b8031d60 con 0x7f62c41076a0 2024-09-10T22:26:52.573 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:52.569+0000 7f62c17fa640 1 -- 172.21.15.19:0/2861995350 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62b8035030 con 0x7f62c41076a0 2024-09-10T22:26:52.573 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:52.570+0000 7f62ca985640 1 -- 172.21.15.19:0/2861995350 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f62c4197f10 con 0x7f62c41076a0 2024-09-10T22:26:52.573 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:52.571+0000 7f62ca985640 1 -- 172.21.15.19:0/2861995350 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f62c4102070 con 0x7f62c41076a0 2024-09-10T22:26:52.576 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:52.573+0000 7f62c17fa640 1 -- 172.21.15.19:0/2861995350 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 18) ==== 153250+0+0 (secure 0 0 0) 0x7f62b803b460 con 0x7f62c41076a0 2024-09-10T22:26:52.576 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:52.574+0000 7f62c17fa640 1 --2- 172.21.15.19:0/2861995350 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f62ac0b9770 0x7f62ac0bbc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:26:52.576 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:52.575+0000 7f62c3fff640 1 --2- 172.21.15.19:0/2861995350 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f62ac0b9770 0x7f62ac0bbc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:26:52.576 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:52.575+0000 7f62c17fa640 1 -- 172.21.15.19:0/2861995350 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8327+0+0 (secure 0 0 0) 0x7f62b8106c80 con 0x7f62c41076a0 2024-09-10T22:26:52.577 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:52.575+0000 7f62c3fff640 1 --2- 172.21.15.19:0/2861995350 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f62ac0b9770 0x7f62ac0bbc30 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f62b4009bd0 tx=0x7f62b4005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:26:52.578 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:52.577+0000 7f62c17fa640 1 -- 172.21.15.19:0/2861995350 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f62b80cd490 con 0x7f62c41076a0 2024-09-10T22:26:52.850 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:52.849+0000 7f62ca985640 1 -- 172.21.15.19:0/2861995350 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f62c406aec0 con 0x7f62c41076a0 2024-09-10T22:26:52.851 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:52.849+0000 7f62c17fa640 1 -- 172.21.15.19:0/2861995350 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) ==== 94+0+11921 (secure 0 0 0) 0x7f62b80d1ec0 con 0x7f62c41076a0 2024-09-10T22:26:52.851 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-10T22:26:52.851 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":25,"btime":"2024-09-10T22:26:08:965324+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14673,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6835/1835804747","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6834","nonce":1835804747},{"type":"v1","addr":"172.21.15.19:6835","nonce":1835804747}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14685,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6837/1750470490","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6836","nonce":1750470490},{"type":"v1","addr":"172.21.15.19:6837","nonce":1750470490}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14733,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6839/2642941149","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6838","nonce":2642941149},{"type":"v1","addr":"172.21.15.19:6839","nonce":2642941149}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14745,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6841/2449948682","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6840","nonce":2449948682},{"type":"v1","addr":"172.21.15.19:6841","nonce":2449948682}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24511,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.138:6833/2524811494","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6832","nonce":2524811494},{"type":"v1","addr":"172.21.15.138:6833","nonce":2524811494}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24512,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6833/3014993624","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6832","nonce":3014993624},{"type":"v1","addr":"172.21.15.135:6833","nonce":3014993624}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":25,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-10T22:24:22.733925+0000","modified":"2024-09-10T22:26:08.602673+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24581,"mds_1":24568,"mds_2":24553},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24527":{"gid":24527,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.135:6835/3715773348","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6834","nonce":3715773348},{"type":"v1","addr":"172.21.15.135:6835","nonce":3715773348}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24541":{"gid":24541,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.138:6835/933547028","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6834","nonce":933547028},{"type":"v1","addr":"172.21.15.138:6835","nonce":933547028}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24551":{"gid":24551,"name":"h","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.135:6837/3495029135","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6836","nonce":3495029135},{"type":"v1","addr":"172.21.15.135:6837","nonce":3495029135}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24553":{"gid":24553,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":10,"addr":"172.21.15.138:6837/3353290042","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6836","nonce":3353290042},{"type":"v1","addr":"172.21.15.138:6837","nonce":3353290042}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24568":{"gid":24568,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.138:6839/383637208","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6838","nonce":383637208},{"type":"v1","addr":"172.21.15.138:6839","nonce":383637208}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24581":{"gid":24581,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.135:6839/1254769802","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6838","nonce":1254769802},{"type":"v1","addr":"172.21.15.135:6839","nonce":1254769802}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24581,"qdb_cluster":[24581,24568,24553]},"id":1}]} 2024-09-10T22:26:52.851 INFO:teuthology.orchestra.run.smithi019.stderr:dumped fsmap epoch 25 2024-09-10T22:26:52.854 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:52.852+0000 7f62ca985640 1 -- 172.21.15.19:0/2861995350 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f62ac0b9770 msgr2=0x7f62ac0bbc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:26:52.854 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:52.852+0000 7f62ca985640 1 --2- 172.21.15.19:0/2861995350 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f62ac0b9770 0x7f62ac0bbc30 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f62b4009bd0 tx=0x7f62b4005f90 comp rx=0 tx=0).stop 2024-09-10T22:26:52.855 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:52.853+0000 7f62ca985640 1 -- 172.21.15.19:0/2861995350 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f62c41076a0 msgr2=0x7f62c419a660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:26:52.855 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:52.853+0000 7f62ca985640 1 --2- 172.21.15.19:0/2861995350 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f62c41076a0 0x7f62c419a660 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f62b8005ab0 tx=0x7f62b8003c80 comp rx=0 tx=0).stop 2024-09-10T22:26:52.855 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:52.853+0000 7f62ca985640 1 -- 172.21.15.19:0/2861995350 shutdown_connections 2024-09-10T22:26:52.855 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:52.853+0000 7f62ca985640 1 --2- 172.21.15.19:0/2861995350 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f62ac0b9770 0x7f62ac0bbc30 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:26:52.855 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:52.853+0000 7f62ca985640 1 --2- 172.21.15.19:0/2861995350 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f62c4108020 0x7f62c419abc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:26:52.855 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:52.853+0000 7f62ca985640 1 --2- 172.21.15.19:0/2861995350 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f62c41076a0 0x7f62c419a660 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:26:52.855 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:52.853+0000 7f62ca985640 1 --2- 172.21.15.19:0/2861995350 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f62c4101c90 0x7f62c419a120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:26:52.855 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:52.853+0000 7f62ca985640 1 -- 172.21.15.19:0/2861995350 >> 172.21.15.19:0/2861995350 conn(0x7f62c40fd700 msgr2=0x7f62c40ffaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:26:52.856 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:52.853+0000 7f62ca985640 1 -- 172.21.15.19:0/2861995350 shutdown_connections 2024-09-10T22:26:52.856 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:52.853+0000 7f62ca985640 1 -- 172.21.15.19:0/2861995350 wait complete. 2024-09-10T22:26:53.477 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:26:53 smithi019 ceph-mon[31375]: pgmap v361: 97 pgs: 97 active+clean; 654 KiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-10T22:26:53.477 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:26:53 smithi019 ceph-mon[31375]: from='client.? 172.21.15.19:0/2861995350' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T22:26:53.506 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 22997a4c-6fc2-11ef-bcea-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-09-10T22:26:53.859 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:26:53 smithi135 ceph-mon[34789]: pgmap v361: 97 pgs: 97 active+clean; 654 KiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-10T22:26:53.860 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:26:53 smithi135 ceph-mon[34789]: from='client.? 172.21.15.19:0/2861995350' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T22:26:53.867 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/22997a4c-6fc2-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T22:26:53.875 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:26:53 smithi138 ceph-mon[35236]: pgmap v361: 97 pgs: 97 active+clean; 654 KiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-10T22:26:53.875 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:26:53 smithi138 ceph-mon[35236]: from='client.? 172.21.15.19:0/2861995350' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T22:26:54.414 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:54.411+0000 7f3d66269640 1 -- 172.21.15.19:0/2154212082 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3d60108020 msgr2=0x7f3d6010e820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:26:54.416 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:54.411+0000 7f3d66269640 1 --2- 172.21.15.19:0/2154212082 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3d60108020 0x7f3d6010e820 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f3d58009ca0 tx=0x7f3d5802a8c0 comp rx=0 tx=0).stop 2024-09-10T22:26:54.416 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:54.412+0000 7f3d66269640 1 -- 172.21.15.19:0/2154212082 shutdown_connections 2024-09-10T22:26:54.416 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:54.412+0000 7f3d66269640 1 --2- 172.21.15.19:0/2154212082 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3d60108020 0x7f3d6010e820 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:26:54.416 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:54.412+0000 7f3d66269640 1 --2- 172.21.15.19:0/2154212082 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3d601076a0 0x7f3d60107ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:26:54.416 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:54.412+0000 7f3d66269640 1 --2- 172.21.15.19:0/2154212082 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3d60101c90 0x7f3d60102070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:26:54.416 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:54.412+0000 7f3d66269640 1 -- 172.21.15.19:0/2154212082 >> 172.21.15.19:0/2154212082 conn(0x7f3d600fd700 msgr2=0x7f3d600ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:26:54.416 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:54.412+0000 7f3d66269640 1 -- 172.21.15.19:0/2154212082 shutdown_connections 2024-09-10T22:26:54.416 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:54.412+0000 7f3d66269640 1 -- 172.21.15.19:0/2154212082 wait complete. 2024-09-10T22:26:54.416 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:54.413+0000 7f3d66269640 1 Processor -- start 2024-09-10T22:26:54.417 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:54.413+0000 7f3d66269640 1 -- start start 2024-09-10T22:26:54.417 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:54.413+0000 7f3d66269640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3d60101c90 0x7f3d60199580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:26:54.417 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:54.413+0000 7f3d66269640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3d601076a0 0x7f3d60199ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:26:54.417 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:54.413+0000 7f3d66269640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3d60108020 0x7f3d6019b910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:26:54.417 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:54.414+0000 7f3d66269640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f3d60111d30 con 0x7f3d60101c90 2024-09-10T22:26:54.417 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:54.414+0000 7f3d5ffff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3d60101c90 0x7f3d60199580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:26:54.417 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:54.414+0000 7f3d5ffff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3d60101c90 0x7f3d60199580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:32798/0 (socket says 172.21.15.19:32798) 2024-09-10T22:26:54.417 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:54.414+0000 7f3d5ffff640 1 -- 172.21.15.19:0/2113950250 learned_addr learned my addr 172.21.15.19:0/2113950250 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:26:54.417 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:54.414+0000 7f3d66269640 1 -- 172.21.15.19:0/2113950250 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f3d60111bb0 con 0x7f3d60108020 2024-09-10T22:26:54.417 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:54.414+0000 7f3d66269640 1 -- 172.21.15.19:0/2113950250 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f3d60111eb0 con 0x7f3d601076a0 2024-09-10T22:26:54.417 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:54.414+0000 7f3d64806640 1 --2- 172.21.15.19:0/2113950250 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3d60108020 0x7f3d6019b910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:26:54.417 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:54.414+0000 7f3d5f7fe640 1 --2- 172.21.15.19:0/2113950250 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3d601076a0 0x7f3d60199ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:26:54.418 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:54.414+0000 7f3d5ffff640 1 -- 172.21.15.19:0/2113950250 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3d601076a0 msgr2=0x7f3d60199ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:26:54.418 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:54.414+0000 7f3d5ffff640 1 --2- 172.21.15.19:0/2113950250 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3d601076a0 0x7f3d60199ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:26:54.418 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:54.414+0000 7f3d5ffff640 1 -- 172.21.15.19:0/2113950250 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3d60108020 msgr2=0x7f3d6019b910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:26:54.418 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:54.414+0000 7f3d5ffff640 1 --2- 172.21.15.19:0/2113950250 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3d60108020 0x7f3d6019b910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:26:54.418 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:54.414+0000 7f3d5ffff640 1 -- 172.21.15.19:0/2113950250 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3d6019c0e0 con 0x7f3d60101c90 2024-09-10T22:26:54.418 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:54.414+0000 7f3d64806640 1 --2- 172.21.15.19:0/2113950250 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3d60108020 0x7f3d6019b910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T22:26:54.418 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:54.414+0000 7f3d5f7fe640 1 --2- 172.21.15.19:0/2113950250 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3d601076a0 0x7f3d60199ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T22:26:54.418 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:54.415+0000 7f3d5ffff640 1 --2- 172.21.15.19:0/2113950250 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3d60101c90 0x7f3d60199580 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f3d5000d950 tx=0x7f3d5000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:26:54.419 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:54.415+0000 7f3d5d7fa640 1 -- 172.21.15.19:0/2113950250 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d50017070 con 0x7f3d60101c90 2024-09-10T22:26:54.419 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:54.415+0000 7f3d5d7fa640 1 -- 172.21.15.19:0/2113950250 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3d50009c30 con 0x7f3d60101c90 2024-09-10T22:26:54.419 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:54.415+0000 7f3d5d7fa640 1 -- 172.21.15.19:0/2113950250 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d5000f620 con 0x7f3d60101c90 2024-09-10T22:26:54.419 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:54.415+0000 7f3d66269640 1 -- 172.21.15.19:0/2113950250 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3d6019c3d0 con 0x7f3d60101c90 2024-09-10T22:26:54.419 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:54.416+0000 7f3d66269640 1 -- 172.21.15.19:0/2113950250 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3d601a5cb0 con 0x7f3d60101c90 2024-09-10T22:26:54.420 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:54.418+0000 7f3d5d7fa640 1 -- 172.21.15.19:0/2113950250 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 18) ==== 153250+0+0 (secure 0 0 0) 0x7f3d50010460 con 0x7f3d60101c90 2024-09-10T22:26:54.422 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:54.419+0000 7f3d5d7fa640 1 --2- 172.21.15.19:0/2113950250 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f3d480b53e0 0x7f3d480b78a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:26:54.422 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:54.419+0000 7f3d5d7fa640 1 -- 172.21.15.19:0/2113950250 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8327+0+0 (secure 0 0 0) 0x7f3d500e5170 con 0x7f3d60101c90 2024-09-10T22:26:54.422 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:54.419+0000 7f3d5f7fe640 1 --2- 172.21.15.19:0/2113950250 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f3d480b53e0 0x7f3d480b78a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:26:54.422 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:54.420+0000 7f3d6863e740 1 Processor -- start 2024-09-10T22:26:54.422 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:54.420+0000 7f3d6863e740 1 -- start start 2024-09-10T22:26:54.422 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:54.420+0000 7f3d6863e740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x564fc466e4d0 0x564fc466e8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:26:54.422 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:54.420+0000 7f3d6863e740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x564fc466edf0 0x564fc467a840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:26:54.422 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:54.420+0000 7f3d5f7fe640 1 --2- 172.21.15.19:0/2113950250 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f3d480b53e0 0x7f3d480b78a0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f3d60100a90 tx=0x7f3d54005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:26:54.422 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:54.420+0000 7f3d6863e740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564fc467ad80 0x564fc467d170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:26:54.422 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:54.420+0000 7f3d6863e740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x564fc45e4ea0 con 0x564fc466edf0 2024-09-10T22:26:54.422 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:54.420+0000 7f3d6863e740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x564fc45d42d0 con 0x564fc467ad80 2024-09-10T22:26:54.423 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:54.420+0000 7f3d6863e740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x564fc45d80e0 con 0x564fc466e4d0 2024-09-10T22:26:54.423 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:54.420+0000 7f3d5f7fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x564fc466edf0 0x564fc467a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:26:54.423 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:54.420+0000 7f3d64806640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564fc467ad80 0x564fc467d170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:26:54.423 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:54.420+0000 7f3d64806640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564fc467ad80 0x564fc467d170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.19:59696/0 (socket says 172.21.15.19:59696) 2024-09-10T22:26:54.423 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:54.420+0000 7f3d64806640 1 -- 172.21.15.19:0/3581983507 learned_addr learned my addr 172.21.15.19:0/3581983507 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:26:54.423 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:54.421+0000 7f3d5ffff640 1 --2- 172.21.15.19:0/3581983507 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x564fc466e4d0 0x564fc466e8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:26:54.424 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:54.421+0000 7f3d64806640 1 -- 172.21.15.19:0/3581983507 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x564fc466e4d0 msgr2=0x564fc466e8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:26:54.424 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:54.421+0000 7f3d64806640 1 --2- 172.21.15.19:0/3581983507 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x564fc466e4d0 0x564fc466e8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:26:54.424 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:54.421+0000 7f3d64806640 1 -- 172.21.15.19:0/3581983507 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x564fc466edf0 msgr2=0x564fc467a840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:26:54.424 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:54.421+0000 7f3d64806640 1 --2- 172.21.15.19:0/3581983507 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x564fc466edf0 0x564fc467a840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:26:54.425 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:54.421+0000 7f3d64806640 1 -- 172.21.15.19:0/3581983507 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564fc4332650 con 0x564fc467ad80 2024-09-10T22:26:54.425 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:54.421+0000 7f3d5ffff640 1 --2- 172.21.15.19:0/3581983507 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x564fc466e4d0 0x564fc466e8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T22:26:54.425 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:54.421+0000 7f3d64806640 1 --2- 172.21.15.19:0/3581983507 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564fc467ad80 0x564fc467d170 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f3d58009ca0 tx=0x7f3d58005f80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=dc9ba02e67f78bb8 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:26:54.425 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:54.421+0000 7f3d467fc640 1 -- 172.21.15.19:0/3581983507 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d58031650 con 0x564fc467ad80 2024-09-10T22:26:54.425 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:54.421+0000 7f3d467fc640 1 -- 172.21.15.19:0/3581983507 <== mon.2 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3d58036040 con 0x564fc467ad80 2024-09-10T22:26:54.425 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:54.421+0000 7f3d467fc640 1 -- 172.21.15.19:0/3581983507 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d580044c0 con 0x564fc467ad80 2024-09-10T22:26:54.425 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:54.422+0000 7f3d6863e740 1 -- 172.21.15.19:0/3581983507 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564fc467ad80 msgr2=0x564fc467d170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:26:54.425 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:54.422+0000 7f3d6863e740 1 --2- 172.21.15.19:0/3581983507 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564fc467ad80 0x564fc467d170 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f3d58009ca0 tx=0x7f3d58005f80 comp rx=0 tx=0).stop 2024-09-10T22:26:54.425 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:54.423+0000 7f3d6863e740 1 -- 172.21.15.19:0/3581983507 shutdown_connections 2024-09-10T22:26:54.426 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:54.423+0000 7f3d6863e740 1 --2- 172.21.15.19:0/3581983507 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564fc467ad80 0x564fc467d170 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:26:54.426 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:54.423+0000 7f3d6863e740 1 --2- 172.21.15.19:0/3581983507 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x564fc466edf0 0x564fc467a840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:26:54.426 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:54.423+0000 7f3d6863e740 1 --2- 172.21.15.19:0/3581983507 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x564fc466e4d0 0x564fc466e8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:26:54.426 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:54.423+0000 7f3d6863e740 1 -- 172.21.15.19:0/3581983507 >> 172.21.15.19:0/3581983507 conn(0x564fc466c300 msgr2=0x564fc466d4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:26:54.426 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:54.423+0000 7f3d6863e740 1 -- 172.21.15.19:0/3581983507 shutdown_connections 2024-09-10T22:26:54.426 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:54.423+0000 7f3d6863e740 1 -- 172.21.15.19:0/3581983507 wait complete. 2024-09-10T22:26:54.426 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:54.423+0000 7f3d6863e740 1 -- start start 2024-09-10T22:26:54.436 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:54.423+0000 7f3d6863e740 1 Processor -- start 2024-09-10T22:26:54.437 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:54.424+0000 7f3d6863e740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564fc466e4d0 0x564fc467a5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:26:54.437 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:54.424+0000 7f3d6863e740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x564fc466edf0 0x564fc46779f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:26:54.437 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:54.424+0000 7f3d6863e740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x564fc467ad80 0x564fc4677f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:26:54.437 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:54.424+0000 7f3d5ffff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564fc466e4d0 0x564fc467a5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:26:54.437 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:54.424+0000 7f3d5ffff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564fc466e4d0 0x564fc467a5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.19:59706/0 (socket says 172.21.15.19:59706) 2024-09-10T22:26:54.438 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:54.424+0000 7f3d6863e740 1 -- 172.21.15.19:0/3371442449 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x564fc4435700 con 0x564fc467ad80 2024-09-10T22:26:54.438 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:54.424+0000 7f3d5ffff640 1 -- 172.21.15.19:0/3371442449 learned_addr learned my addr 172.21.15.19:0/3371442449 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:26:54.438 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:54.424+0000 7f3d6863e740 1 -- 172.21.15.19:0/3371442449 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x564fc456f160 con 0x564fc466e4d0 2024-09-10T22:26:54.438 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:54.424+0000 7f3d6863e740 1 -- 172.21.15.19:0/3371442449 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x564fc468e9b0 con 0x564fc466edf0 2024-09-10T22:26:54.438 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:54.424+0000 7f3d64806640 1 --2- 172.21.15.19:0/3371442449 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x564fc467ad80 0x564fc4677f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:26:54.438 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:54.424+0000 7f3d6863e740 10 client.0 _ll_register_callbacks cb 0x564fc45889e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T22:26:54.439 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:54.424+0000 7f3d5f7fe640 1 --2- 172.21.15.19:0/3371442449 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x564fc466edf0 0x564fc46779f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:26:54.439 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:54.424+0000 7f3d5ffff640 1 -- 172.21.15.19:0/3371442449 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x564fc466edf0 msgr2=0x564fc46779f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:26:54.439 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:54.424+0000 7f3d5ffff640 1 --2- 172.21.15.19:0/3371442449 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x564fc466edf0 0x564fc46779f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:26:54.439 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:54.424+0000 7f3d5ffff640 1 -- 172.21.15.19:0/3371442449 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x564fc467ad80 msgr2=0x564fc4677f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:26:54.440 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:54.424+0000 7f3d5ffff640 1 --2- 172.21.15.19:0/3371442449 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x564fc467ad80 0x564fc4677f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:26:54.440 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:54.424+0000 7f3d5ffff640 1 -- 172.21.15.19:0/3371442449 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564fc459cc90 con 0x564fc466e4d0 2024-09-10T22:26:54.440 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:54.424+0000 7f3d5f7fe640 1 --2- 172.21.15.19:0/3371442449 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x564fc466edf0 0x564fc46779f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T22:26:54.440 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:54.424+0000 7f3d64806640 1 --2- 172.21.15.19:0/3371442449 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x564fc467ad80 0x564fc4677f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T22:26:54.440 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:54.425+0000 7f3d5ffff640 1 --2- 172.21.15.19:0/3371442449 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564fc466e4d0 0x564fc467a5a0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f3d500ab570 tx=0x7f3d500ab770 comp rx=0 tx=0).ready entity=mon.2 client_cookie=39b6c4b93580889f server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:26:54.441 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:54.425+0000 7f3d3f7fe640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-09-10T22:26:54.441 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:54.425+0000 7f3d3f7fe640 1 -- 172.21.15.19:0/3371442449 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d50020070 con 0x564fc466e4d0 2024-09-10T22:26:54.441 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:54.425+0000 7f3d3f7fe640 1 -- 172.21.15.19:0/3371442449 <== mon.2 v2:172.21.15.135:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8327+0+0 (secure 0 0 0) 0x7f3d500aacd0 con 0x564fc466e4d0 2024-09-10T22:26:54.441 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:54.425+0000 7f3d6863e740 1 -- 172.21.15.19:0/3371442449 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3d58036040 con 0x564fc466e4d0 2024-09-10T22:26:54.441 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:54.425+0000 7f3d3f7fe640 1 -- 172.21.15.19:0/3371442449 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f3d50009de0 con 0x564fc466e4d0 2024-09-10T22:26:54.442 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:54.425+0000 7f3d6863e740 10 client.25043 fetch_fsmap learned FSMap version 25 2024-09-10T22:26:54.442 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:54.425+0000 7f3d6863e740 1 -- 172.21.15.19:0/3371442449 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x564fc469a1a0 con 0x564fc466e4d0 2024-09-10T22:26:54.442 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:54.425+0000 7f3d3f7fe640 1 -- 172.21.15.19:0/3371442449 <== mon.2 v2:172.21.15.135:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3d58036040 con 0x564fc466e4d0 2024-09-10T22:26:54.442 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:54.426+0000 7f3d3f7fe640 1 -- 172.21.15.19:0/3371442449 <== mon.2 v2:172.21.15.135:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f3d5005b150 con 0x564fc466e4d0 2024-09-10T22:26:54.442 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:54.426+0000 7f3d6863e740 10 client.25043 fetch_fsmap finished waiting for FSMap version 25 2024-09-10T22:26:54.442 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:54.426+0000 7f3d6863e740 10 client.25043 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-10T22:26:54.443 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:54.426+0000 7f3d6863e740 20 client.25043 populate_metadata read hostname 'smithi019' 2024-09-10T22:26:54.443 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:54.426+0000 7f3d6863e740 1 --2- 172.21.15.19:0/3371442449 >> [v2:172.21.15.138:6836/3353290042,v1:172.21.15.138:6837/3353290042] conn(0x564fc469b650 0x564fc469dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:26:54.443 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:54.426+0000 7f3d6863e740 4 client.25043 mds_command: new command op to 24553 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T22:26:54.443 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:54.426+0000 7f3d6863e740 1 -- 172.21.15.19:0/3371442449 --> [v2:172.21.15.138:6836/3353290042,v1:172.21.15.138:6837/3353290042] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564fc45e6df0 con 0x564fc469b650 2024-09-10T22:26:54.443 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:54.427+0000 7f3d5f7fe640 1 --2- 172.21.15.19:0/3371442449 >> [v2:172.21.15.138:6836/3353290042,v1:172.21.15.138:6837/3353290042] conn(0x564fc469b650 0x564fc469dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:26:54.443 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:54.427+0000 7f3d3f7fe640 10 client.25043 ms_handle_connect on v2:172.21.15.138:6836/3353290042 2024-09-10T22:26:54.444 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:54.427+0000 7f3d5f7fe640 1 --2- 172.21.15.19:0/3371442449 >> [v2:172.21.15.138:6836/3353290042,v1:172.21.15.138:6837/3353290042] conn(0x564fc469b650 0x564fc469dac0 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=63b510ca79f0288e server_cookie=ae045e3a897dec19 in_seq=0 out_seq=0 2024-09-10T22:26:54.444 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:54.428+0000 7f3d3f7fe640 1 -- 172.21.15.19:0/3371442449 <== mds.2 v2:172.21.15.138:6836/3353290042 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x564fc45e6df0 con 0x564fc469b650 2024-09-10T22:26:54.444 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:54.428+0000 7f3d3f7fe640 10 client.25043 handle_command_reply: tid=0 2024-09-10T22:26:54.444 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:54.428+0000 7f3d6863e740 1 client.25043 shutdown 2024-09-10T22:26:54.444 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:54.428+0000 7f3d6863e740 1 -- 172.21.15.19:0/3371442449 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564fc466e4d0 msgr2=0x564fc467a5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:26:54.444 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:54.428+0000 7f3d6863e740 1 --2- 172.21.15.19:0/3371442449 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564fc466e4d0 0x564fc467a5a0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f3d500ab570 tx=0x7f3d500ab770 comp rx=0 tx=0).stop 2024-09-10T22:26:54.445 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:54.428+0000 7f3d6863e740 1 -- 172.21.15.19:0/3371442449 shutdown_connections 2024-09-10T22:26:54.445 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:54.428+0000 7f3d6863e740 1 --2- 172.21.15.19:0/3371442449 >> [v2:172.21.15.138:6836/3353290042,v1:172.21.15.138:6837/3353290042] conn(0x564fc469b650 0x564fc469dac0 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:26:54.445 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:54.428+0000 7f3d6863e740 1 --2- 172.21.15.19:0/3371442449 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x564fc467ad80 0x564fc4677f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:26:54.445 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:54.428+0000 7f3d6863e740 1 --2- 172.21.15.19:0/3371442449 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x564fc466edf0 0x564fc46779f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:26:54.445 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:54.428+0000 7f3d3f7fe640 0 client.25043 ms_handle_reset on v2:172.21.15.138:6836/3353290042 2024-09-10T22:26:54.445 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:54.428+0000 7f3d6863e740 1 --2- 172.21.15.19:0/3371442449 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564fc466e4d0 0x564fc467a5a0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:26:54.446 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:54.428+0000 7f3d6863e740 1 -- 172.21.15.19:0/3371442449 >> 172.21.15.19:0/3371442449 conn(0x564fc466c300 msgr2=0x564fc4671ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:26:54.446 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:54.428+0000 7f3d6863e740 1 -- 172.21.15.19:0/3371442449 shutdown_connections 2024-09-10T22:26:54.446 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:54.428+0000 7f3d6863e740 1 -- 172.21.15.19:0/3371442449 wait complete. 2024-09-10T22:26:54.446 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:54.429+0000 7f3d6863e740 20 client.25043 trim_cache size 0 max 16384 2024-09-10T22:26:54.458 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:54.455+0000 7f3d6863e740 1 Processor -- start 2024-09-10T22:26:54.459 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:54.455+0000 7f3d6863e740 1 -- start start 2024-09-10T22:26:54.459 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:54.455+0000 7f3d6863e740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564fc466e4d0 0x564fc4679730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:26:54.459 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:54.455+0000 7f3d6863e740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x564fc466edf0 0x564fc4674c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:26:54.459 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:54.455+0000 7f3d6863e740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x564fc467ad80 0x564fc4675140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:26:54.459 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:54.455+0000 7f3d6863e740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f3d601aeb90 con 0x564fc466edf0 2024-09-10T22:26:54.459 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:54.455+0000 7f3d6863e740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f3d60073090 con 0x564fc466e4d0 2024-09-10T22:26:54.460 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:54.455+0000 7f3d6863e740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f3d60070ee0 con 0x564fc467ad80 2024-09-10T22:26:54.460 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:54.455+0000 7f3d5f7fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x564fc466edf0 0x564fc4674c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:26:54.460 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:54.455+0000 7f3d5f7fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x564fc466edf0 0x564fc4674c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:32832/0 (socket says 172.21.15.19:32832) 2024-09-10T22:26:54.460 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:54.455+0000 7f3d5f7fe640 1 -- 172.21.15.19:0/1823152897 learned_addr learned my addr 172.21.15.19:0/1823152897 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:26:54.460 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:54.456+0000 7f3d5ffff640 1 --2- 172.21.15.19:0/1823152897 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564fc466e4d0 0x564fc4679730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:26:54.461 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:54.456+0000 7f3d64806640 1 --2- 172.21.15.19:0/1823152897 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x564fc467ad80 0x564fc4675140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:26:54.461 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:54.456+0000 7f3d5f7fe640 1 -- 172.21.15.19:0/1823152897 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x564fc467ad80 msgr2=0x564fc4675140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:26:54.461 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:54.456+0000 7f3d5f7fe640 1 --2- 172.21.15.19:0/1823152897 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x564fc467ad80 0x564fc4675140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:26:54.461 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:54.456+0000 7f3d5f7fe640 1 -- 172.21.15.19:0/1823152897 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564fc466e4d0 msgr2=0x564fc4679730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:26:54.461 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:54.456+0000 7f3d5f7fe640 1 --2- 172.21.15.19:0/1823152897 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564fc466e4d0 0x564fc4679730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:26:54.461 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:54.456+0000 7f3d5f7fe640 1 -- 172.21.15.19:0/1823152897 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564fc467a910 con 0x564fc466edf0 2024-09-10T22:26:54.462 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:54.457+0000 7f3d5f7fe640 1 --2- 172.21.15.19:0/1823152897 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x564fc466edf0 0x564fc4674c00 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f3d54010c50 tx=0x7f3d54016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fc66a4b67bf8d54a server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:26:54.462 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:54.457+0000 7f3d45ffb640 1 -- 172.21.15.19:0/1823152897 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d54012ad0 con 0x564fc466edf0 2024-09-10T22:26:54.462 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:54.457+0000 7f3d45ffb640 1 -- 172.21.15.19:0/1823152897 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3d5402b020 con 0x564fc466edf0 2024-09-10T22:26:54.462 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:54.457+0000 7f3d45ffb640 1 -- 172.21.15.19:0/1823152897 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d54003c40 con 0x564fc466edf0 2024-09-10T22:26:54.465 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:54.458+0000 7f3d6863e740 1 -- 172.21.15.19:0/1823152897 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x564fc466edf0 msgr2=0x564fc4674c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:26:54.465 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:54.458+0000 7f3d6863e740 1 --2- 172.21.15.19:0/1823152897 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x564fc466edf0 0x564fc4674c00 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f3d54010c50 tx=0x7f3d54016000 comp rx=0 tx=0).stop 2024-09-10T22:26:54.465 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:54.458+0000 7f3d6863e740 1 -- 172.21.15.19:0/1823152897 shutdown_connections 2024-09-10T22:26:54.465 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:54.458+0000 7f3d6863e740 1 --2- 172.21.15.19:0/1823152897 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x564fc467ad80 0x564fc4675140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:26:54.465 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:54.458+0000 7f3d6863e740 1 --2- 172.21.15.19:0/1823152897 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x564fc466edf0 0x564fc4674c00 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:26:54.465 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:54.458+0000 7f3d6863e740 1 --2- 172.21.15.19:0/1823152897 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564fc466e4d0 0x564fc4679730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:26:54.465 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:54.458+0000 7f3d6863e740 1 -- 172.21.15.19:0/1823152897 >> 172.21.15.19:0/1823152897 conn(0x564fc466c300 msgr2=0x564fc4679020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:26:54.465 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:54.459+0000 7f3d6863e740 1 -- 172.21.15.19:0/1823152897 shutdown_connections 2024-09-10T22:26:54.466 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:54.459+0000 7f3d6863e740 1 -- 172.21.15.19:0/1823152897 wait complete. 2024-09-10T22:26:54.466 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:54.459+0000 7f3d6863e740 1 -- start start 2024-09-10T22:26:54.466 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:54.460+0000 7f3d6863e740 1 Processor -- start 2024-09-10T22:26:54.466 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:54.460+0000 7f3d6863e740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564fc466e4d0 0x564fc4690720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:26:54.466 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:54.461+0000 7f3d6863e740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x564fc466edf0 0x564fc4690ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:26:54.466 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:54.461+0000 7f3d5ffff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564fc466e4d0 0x564fc4690720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:26:54.466 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:54.461+0000 7f3d5ffff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564fc466e4d0 0x564fc4690720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.19:59718/0 (socket says 172.21.15.19:59718) 2024-09-10T22:26:54.466 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:54.461+0000 7f3d5ffff640 1 -- 172.21.15.19:0/3685900963 learned_addr learned my addr 172.21.15.19:0/3685900963 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:26:54.466 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:54.461+0000 7f3d6863e740 1 --2- 172.21.15.19:0/3685900963 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x564fc467ad80 0x564fc4701660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:26:54.467 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:54.461+0000 7f3d5f7fe640 1 --2- 172.21.15.19:0/3685900963 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x564fc466edf0 0x564fc4690ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:26:54.467 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:54.461+0000 7f3d6863e740 1 -- 172.21.15.19:0/3685900963 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f3d60071550 con 0x564fc466edf0 2024-09-10T22:26:54.467 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:54.461+0000 7f3d6863e740 1 -- 172.21.15.19:0/3685900963 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f3d600729c0 con 0x564fc466e4d0 2024-09-10T22:26:54.467 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:54.461+0000 7f3d6863e740 1 -- 172.21.15.19:0/3685900963 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f3d60071c20 con 0x564fc467ad80 2024-09-10T22:26:54.467 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:54.461+0000 7f3d6863e740 10 client.0 _ll_register_callbacks cb 0x7f3d5000df40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T22:26:54.467 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:54.462+0000 7f3d64806640 1 --2- 172.21.15.19:0/3685900963 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x564fc467ad80 0x564fc4701660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:26:54.467 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:54.462+0000 7f3d5ffff640 1 -- 172.21.15.19:0/3685900963 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x564fc467ad80 msgr2=0x564fc4701660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:26:54.467 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:54.462+0000 7f3d5ffff640 1 --2- 172.21.15.19:0/3685900963 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x564fc467ad80 0x564fc4701660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:26:54.468 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:54.462+0000 7f3d5ffff640 1 -- 172.21.15.19:0/3685900963 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x564fc466edf0 msgr2=0x564fc4690ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:26:54.468 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:54.462+0000 7f3d5ffff640 1 --2- 172.21.15.19:0/3685900963 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x564fc466edf0 0x564fc4690ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:26:54.468 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:54.462+0000 7f3d5ffff640 1 -- 172.21.15.19:0/3685900963 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564fc4701d70 con 0x564fc466e4d0 2024-09-10T22:26:54.468 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:54.462+0000 7f3d5ffff640 1 --2- 172.21.15.19:0/3685900963 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564fc466e4d0 0x564fc4690720 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f3d50010fd0 tx=0x7f3d500b4f80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=95294f2f417b275 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:26:54.468 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:54.462+0000 7f3d3f7fe640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-09-10T22:26:54.468 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:54.462+0000 7f3d3f7fe640 1 -- 172.21.15.19:0/3685900963 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d50020070 con 0x564fc466e4d0 2024-09-10T22:26:54.468 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:54.462+0000 7f3d3f7fe640 1 -- 172.21.15.19:0/3685900963 <== mon.2 v2:172.21.15.135:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8327+0+0 (secure 0 0 0) 0x7f3d500cedc0 con 0x564fc466e4d0 2024-09-10T22:26:54.468 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:54.462+0000 7f3d6863e740 1 -- 172.21.15.19:0/3685900963 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3d5402b020 con 0x564fc466e4d0 2024-09-10T22:26:54.468 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:54.463+0000 7f3d3f7fe640 1 -- 172.21.15.19:0/3685900963 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f3d500c6050 con 0x564fc466e4d0 2024-09-10T22:26:54.469 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:54.463+0000 7f3d6863e740 10 client.25049 fetch_fsmap learned FSMap version 25 2024-09-10T22:26:54.469 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:54.463+0000 7f3d6863e740 1 -- 172.21.15.19:0/3685900963 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x564fc4709210 con 0x564fc466e4d0 2024-09-10T22:26:54.469 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:54.463+0000 7f3d3f7fe640 1 -- 172.21.15.19:0/3685900963 <== mon.2 v2:172.21.15.135:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3d500ab380 con 0x564fc466e4d0 2024-09-10T22:26:54.469 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:54.464+0000 7f3d3f7fe640 1 -- 172.21.15.19:0/3685900963 <== mon.2 v2:172.21.15.135:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f3d500b14e0 con 0x564fc466e4d0 2024-09-10T22:26:54.470 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:54.464+0000 7f3d6863e740 10 client.25049 fetch_fsmap finished waiting for FSMap version 25 2024-09-10T22:26:54.471 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:54.464+0000 7f3d6863e740 10 client.25049 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-10T22:26:54.471 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:54.464+0000 7f3d6863e740 20 client.25049 populate_metadata read hostname 'smithi019' 2024-09-10T22:26:54.471 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:54.464+0000 7f3d6863e740 1 --2- 172.21.15.19:0/3685900963 >> [v2:172.21.15.138:6836/3353290042,v1:172.21.15.138:6837/3353290042] conn(0x564fc469b650 0x564fc470ba00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:26:54.471 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:54.464+0000 7f3d6863e740 4 client.25049 mds_command: new command op to 24553 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-10T22:26:54.471 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:54.464+0000 7f3d6863e740 1 -- 172.21.15.19:0/3685900963 --> [v2:172.21.15.138:6836/3353290042,v1:172.21.15.138:6837/3353290042] -- command(tid 0: {"prefix": "damage ls"}) -- 0x7f3d5402b020 con 0x564fc469b650 2024-09-10T22:26:54.471 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:54.464+0000 7f3d5f7fe640 1 --2- 172.21.15.19:0/3685900963 >> [v2:172.21.15.138:6836/3353290042,v1:172.21.15.138:6837/3353290042] conn(0x564fc469b650 0x564fc470ba00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:26:54.471 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:54.465+0000 7f3d5f7fe640 1 --2- 172.21.15.19:0/3685900963 >> [v2:172.21.15.138:6836/3353290042,v1:172.21.15.138:6837/3353290042] conn(0x564fc469b650 0x564fc470ba00 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=19941f4d30d610cb server_cookie=43305ce3ab848fc7 in_seq=0 out_seq=0 2024-09-10T22:26:54.472 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:54.465+0000 7f3d3f7fe640 10 client.25049 ms_handle_connect on v2:172.21.15.138:6836/3353290042 2024-09-10T22:26:54.472 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:54.465+0000 7f3d3f7fe640 1 -- 172.21.15.19:0/3685900963 <== mds.2 v2:172.21.15.138:6836/3353290042 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x7f3d5402b020 con 0x564fc469b650 2024-09-10T22:26:54.472 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:54.465+0000 7f3d3f7fe640 10 client.25049 handle_command_reply: tid=0 2024-09-10T22:26:54.472 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:54.465+0000 7f3d6863e740 1 client.25049 shutdown 2024-09-10T22:26:54.472 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:54.465+0000 7f3d6863e740 1 -- 172.21.15.19:0/3685900963 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564fc466e4d0 msgr2=0x564fc4690720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:26:54.472 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:54.465+0000 7f3d6863e740 1 --2- 172.21.15.19:0/3685900963 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564fc466e4d0 0x564fc4690720 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f3d50010fd0 tx=0x7f3d500b4f80 comp rx=0 tx=0).stop 2024-09-10T22:26:54.472 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:54.465+0000 7f3d6863e740 1 -- 172.21.15.19:0/3685900963 shutdown_connections 2024-09-10T22:26:54.472 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:54.465+0000 7f3d6863e740 1 --2- 172.21.15.19:0/3685900963 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x564fc467ad80 0x564fc4701660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:26:54.472 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:54.465+0000 7f3d6863e740 1 --2- 172.21.15.19:0/3685900963 >> [v2:172.21.15.138:6836/3353290042,v1:172.21.15.138:6837/3353290042] conn(0x564fc469b650 0x564fc470ba00 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:26:54.473 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:54.465+0000 7f3d6863e740 1 --2- 172.21.15.19:0/3685900963 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x564fc466edf0 0x564fc4690ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:26:54.473 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:54.465+0000 7f3d6863e740 1 --2- 172.21.15.19:0/3685900963 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564fc466e4d0 0x564fc4690720 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:26:54.473 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:54.465+0000 7f3d6863e740 1 -- 172.21.15.19:0/3685900963 >> 172.21.15.19:0/3685900963 conn(0x564fc466c300 msgr2=0x564fc4679840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:26:54.473 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:54.465+0000 7f3d3f7fe640 0 client.25049 ms_handle_reset on v2:172.21.15.138:6836/3353290042 2024-09-10T22:26:54.473 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:54.466+0000 7f3d6863e740 1 -- 172.21.15.19:0/3685900963 shutdown_connections 2024-09-10T22:26:54.473 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:54.466+0000 7f3d6863e740 1 -- 172.21.15.19:0/3685900963 wait complete. 2024-09-10T22:26:54.473 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:54.466+0000 7f3d6863e740 20 client.25049 trim_cache size 0 max 16384 2024-09-10T22:26:54.474 INFO:teuthology.orchestra.run.smithi019.stdout:[] 2024-09-10T22:26:54.475 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:54.466+0000 7f3d66269640 1 -- 172.21.15.19:0/2113950250 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f3d480b53e0 msgr2=0x7f3d480b78a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:26:54.475 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:54.466+0000 7f3d66269640 1 --2- 172.21.15.19:0/2113950250 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f3d480b53e0 0x7f3d480b78a0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f3d60100a90 tx=0x7f3d54005f90 comp rx=0 tx=0).stop 2024-09-10T22:26:54.476 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:54.467+0000 7f3d66269640 1 -- 172.21.15.19:0/2113950250 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3d60101c90 msgr2=0x7f3d60199580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:26:54.476 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:54.467+0000 7f3d66269640 1 --2- 172.21.15.19:0/2113950250 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3d60101c90 0x7f3d60199580 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f3d5000d950 tx=0x7f3d5000de10 comp rx=0 tx=0).stop 2024-09-10T22:26:54.476 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:54.467+0000 7f3d66269640 1 -- 172.21.15.19:0/2113950250 shutdown_connections 2024-09-10T22:26:54.476 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:54.467+0000 7f3d66269640 1 --2- 172.21.15.19:0/2113950250 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f3d480b53e0 0x7f3d480b78a0 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:26:54.476 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:54.467+0000 7f3d66269640 1 --2- 172.21.15.19:0/2113950250 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3d60108020 0x7f3d6019b910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:26:54.476 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:54.467+0000 7f3d66269640 1 --2- 172.21.15.19:0/2113950250 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3d601076a0 0x7f3d60199ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:26:54.477 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:54.467+0000 7f3d66269640 1 --2- 172.21.15.19:0/2113950250 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3d60101c90 0x7f3d60199580 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:26:54.477 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:54.467+0000 7f3d66269640 1 -- 172.21.15.19:0/2113950250 >> 172.21.15.19:0/2113950250 conn(0x7f3d600fd700 msgr2=0x7f3d6006aa50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:26:54.477 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:54.468+0000 7f3d66269640 1 -- 172.21.15.19:0/2113950250 shutdown_connections 2024-09-10T22:26:54.477 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:54.468+0000 7f3d66269640 1 -- 172.21.15.19:0/2113950250 wait complete. 2024-09-10T22:26:55.205 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 22997a4c-6fc2-11ef-bcea-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-09-10T22:26:55.494 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/22997a4c-6fc2-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T22:26:55.745 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:26:55 smithi019 ceph-mon[31375]: pgmap v362: 97 pgs: 97 active+clean; 654 KiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 511 B/s wr, 6 op/s 2024-09-10T22:26:55.860 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:26:55 smithi135 ceph-mon[34789]: pgmap v362: 97 pgs: 97 active+clean; 654 KiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 511 B/s wr, 6 op/s 2024-09-10T22:26:55.875 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:26:55 smithi138 ceph-mon[35236]: pgmap v362: 97 pgs: 97 active+clean; 654 KiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 511 B/s wr, 6 op/s 2024-09-10T22:26:56.061 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:56.059+0000 7fea1d85f640 1 -- 172.21.15.19:0/3826374113 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fea18102de0 msgr2=0x7fea181031c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:26:56.062 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:56.059+0000 7fea1d85f640 1 --2- 172.21.15.19:0/3826374113 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fea18102de0 0x7fea181031c0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fea08009860 tx=0x7fea0802a340 comp rx=0 tx=0).stop 2024-09-10T22:26:56.062 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:56.059+0000 7fea1d85f640 1 -- 172.21.15.19:0/3826374113 shutdown_connections 2024-09-10T22:26:56.062 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:56.059+0000 7fea1d85f640 1 --2- 172.21.15.19:0/3826374113 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fea18109170 0x7fea1810f970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:26:56.062 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:56.059+0000 7fea1d85f640 1 --2- 172.21.15.19:0/3826374113 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fea181087f0 0x7fea18108c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:26:56.062 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:56.059+0000 7fea1d85f640 1 --2- 172.21.15.19:0/3826374113 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fea18102de0 0x7fea181031c0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:26:56.062 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:56.059+0000 7fea1d85f640 1 -- 172.21.15.19:0/3826374113 >> 172.21.15.19:0/3826374113 conn(0x7fea180fe830 msgr2=0x7fea18100c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:26:56.062 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:56.059+0000 7fea1d85f640 1 -- 172.21.15.19:0/3826374113 shutdown_connections 2024-09-10T22:26:56.062 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:56.060+0000 7fea1d85f640 1 -- 172.21.15.19:0/3826374113 wait complete. 2024-09-10T22:26:56.062 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:56.060+0000 7fea1d85f640 1 Processor -- start 2024-09-10T22:26:56.064 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:56.061+0000 7fea1d85f640 1 -- start start 2024-09-10T22:26:56.064 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:56.061+0000 7fea1d85f640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fea18102de0 0x7fea18199280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:26:56.064 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:56.061+0000 7fea1d85f640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fea181087f0 0x7fea181997c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:26:56.064 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:56.061+0000 7fea1d85f640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fea18109170 0x7fea1819eb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:26:56.064 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:56.061+0000 7fea16ffd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fea18102de0 0x7fea18199280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:26:56.064 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:56.061+0000 7fea1d85f640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fea18112df0 con 0x7fea18102de0 2024-09-10T22:26:56.065 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:56.061+0000 7fea1d85f640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fea18112c70 con 0x7fea18109170 2024-09-10T22:26:56.065 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:56.061+0000 7fea1d85f640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7fea18112f70 con 0x7fea181087f0 2024-09-10T22:26:56.065 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:56.061+0000 7fea16ffd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fea18102de0 0x7fea18199280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:32864/0 (socket says 172.21.15.19:32864) 2024-09-10T22:26:56.065 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:56.061+0000 7fea16ffd640 1 -- 172.21.15.19:0/3496124438 learned_addr learned my addr 172.21.15.19:0/3496124438 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:26:56.065 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:56.061+0000 7fea167fc640 1 --2- 172.21.15.19:0/3496124438 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fea181087f0 0x7fea181997c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:26:56.065 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:56.062+0000 7fea177fe640 1 --2- 172.21.15.19:0/3496124438 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fea18109170 0x7fea1819eb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:26:56.065 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:56.062+0000 7fea167fc640 1 -- 172.21.15.19:0/3496124438 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fea18109170 msgr2=0x7fea1819eb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:26:56.065 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:56.062+0000 7fea167fc640 1 --2- 172.21.15.19:0/3496124438 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fea18109170 0x7fea1819eb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:26:56.065 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:56.062+0000 7fea167fc640 1 -- 172.21.15.19:0/3496124438 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fea18102de0 msgr2=0x7fea18199280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:26:56.065 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:56.062+0000 7fea167fc640 1 --2- 172.21.15.19:0/3496124438 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fea18102de0 0x7fea18199280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:26:56.066 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:56.062+0000 7fea167fc640 1 -- 172.21.15.19:0/3496124438 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fea1819f330 con 0x7fea181087f0 2024-09-10T22:26:56.066 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:56.062+0000 7fea16ffd640 1 --2- 172.21.15.19:0/3496124438 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fea18102de0 0x7fea18199280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T22:26:56.066 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:56.062+0000 7fea167fc640 1 --2- 172.21.15.19:0/3496124438 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fea181087f0 0x7fea181997c0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fea0c00e9f0 tx=0x7fea0c00eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:26:56.066 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:56.063+0000 7fea1c85d640 1 -- 172.21.15.19:0/3496124438 <== mon.1 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea0c00ccc0 con 0x7fea181087f0 2024-09-10T22:26:56.066 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:56.063+0000 7fea1d85f640 1 -- 172.21.15.19:0/3496124438 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fea1819f620 con 0x7fea181087f0 2024-09-10T22:26:56.066 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:56.063+0000 7fea1c85d640 1 -- 172.21.15.19:0/3496124438 <== mon.1 v2:172.21.15.138:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fea0c0108e0 con 0x7fea181087f0 2024-09-10T22:26:56.066 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:56.063+0000 7fea1d85f640 1 -- 172.21.15.19:0/3496124438 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fea18075550 con 0x7fea181087f0 2024-09-10T22:26:56.067 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:56.064+0000 7fea1c85d640 1 -- 172.21.15.19:0/3496124438 <== mon.1 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea0c018880 con 0x7fea181087f0 2024-09-10T22:26:56.070 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:56.066+0000 7fea1fc34740 1 Processor -- start 2024-09-10T22:26:56.070 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:56.066+0000 7fea1fc34740 1 -- start start 2024-09-10T22:26:56.070 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:56.067+0000 7fea1fc34740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55e4b37770f0 0x55e4b37774d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:26:56.070 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:56.067+0000 7fea1fc34740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55e4b3777a10 0x55e4b378bc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:26:56.070 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:56.067+0000 7fea1fc34740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e4b378c1b0 0x55e4b378e5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:26:56.070 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:56.067+0000 7fea1fc34740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x55e4b36edea0 con 0x55e4b3777a10 2024-09-10T22:26:56.070 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:56.067+0000 7fea1fc34740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55e4b36dd2d0 con 0x55e4b378c1b0 2024-09-10T22:26:56.071 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:56.067+0000 7fea1fc34740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x55e4b36e10e0 con 0x55e4b37770f0 2024-09-10T22:26:56.071 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:56.067+0000 7fea16ffd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55e4b3777a10 0x55e4b378bc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:26:56.071 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:56.067+0000 7fea16ffd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55e4b3777a10 0x55e4b378bc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:32866/0 (socket says 172.21.15.19:32866) 2024-09-10T22:26:56.071 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:56.067+0000 7fea16ffd640 1 -- 172.21.15.19:0/2631061254 learned_addr learned my addr 172.21.15.19:0/2631061254 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:26:56.071 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:56.067+0000 7fea177fe640 1 --2- 172.21.15.19:0/2631061254 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55e4b37770f0 0x55e4b37774d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:26:56.071 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:56.067+0000 7fea177fe640 1 -- 172.21.15.19:0/2631061254 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e4b378c1b0 msgr2=0x55e4b378e5a0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-10T22:26:56.084 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:56.068+0000 7fea177fe640 1 --2- 172.21.15.19:0/2631061254 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e4b378c1b0 0x55e4b378e5a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:26:56.084 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:56.068+0000 7fea177fe640 1 -- 172.21.15.19:0/2631061254 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55e4b3777a10 msgr2=0x55e4b378bc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:26:56.084 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:56.068+0000 7fea177fe640 1 --2- 172.21.15.19:0/2631061254 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55e4b3777a10 0x55e4b378bc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:26:56.084 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:56.068+0000 7fea177fe640 1 -- 172.21.15.19:0/2631061254 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e4b343b650 con 0x55e4b37770f0 2024-09-10T22:26:56.084 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:56.068+0000 7fea16ffd640 1 --2- 172.21.15.19:0/2631061254 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55e4b3777a10 0x55e4b378bc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T22:26:56.085 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:56.068+0000 7fea177fe640 1 --2- 172.21.15.19:0/2631061254 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55e4b37770f0 0x55e4b37774d0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fea100099b0 tx=0x7fea100095c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1fe79fa13fa42b90 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:26:56.085 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:56.068+0000 7fea1c85d640 1 -- 172.21.15.19:0/3496124438 <== mon.1 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 18) ==== 153250+0+0 (secure 0 0 0) 0x7fea0c010430 con 0x7fea181087f0 2024-09-10T22:26:56.085 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:56.068+0000 7fe9fdffb640 1 -- 172.21.15.19:0/2631061254 <== mon.1 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea10003970 con 0x55e4b37770f0 2024-09-10T22:26:56.085 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:56.068+0000 7fe9fdffb640 1 -- 172.21.15.19:0/2631061254 <== mon.1 v2:172.21.15.138:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fea1000d6b0 con 0x55e4b37770f0 2024-09-10T22:26:56.085 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:56.068+0000 7fe9fdffb640 1 -- 172.21.15.19:0/2631061254 <== mon.1 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea10004220 con 0x55e4b37770f0 2024-09-10T22:26:56.085 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:56.069+0000 7fea1fc34740 1 -- 172.21.15.19:0/2631061254 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55e4b37770f0 msgr2=0x55e4b37774d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:26:56.086 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:56.069+0000 7fea1fc34740 1 --2- 172.21.15.19:0/2631061254 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55e4b37770f0 0x55e4b37774d0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fea100099b0 tx=0x7fea100095c0 comp rx=0 tx=0).stop 2024-09-10T22:26:56.086 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:56.069+0000 7fea1fc34740 1 -- 172.21.15.19:0/2631061254 shutdown_connections 2024-09-10T22:26:56.086 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:56.069+0000 7fea1fc34740 1 --2- 172.21.15.19:0/2631061254 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e4b378c1b0 0x55e4b378e5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:26:56.086 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:56.069+0000 7fea1fc34740 1 --2- 172.21.15.19:0/2631061254 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55e4b3777a10 0x55e4b378bc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:26:56.086 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:56.069+0000 7fea1fc34740 1 --2- 172.21.15.19:0/2631061254 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55e4b37770f0 0x55e4b37774d0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:26:56.086 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:56.069+0000 7fea1fc34740 1 -- 172.21.15.19:0/2631061254 >> 172.21.15.19:0/2631061254 conn(0x55e4b3774f20 msgr2=0x55e4b37760c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:26:56.086 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:56.069+0000 7fea1c85d640 1 --2- 172.21.15.19:0/3496124438 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7fea000b51b0 0x7fea000b7670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:26:56.087 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:56.070+0000 7fea1fc34740 1 -- 172.21.15.19:0/2631061254 shutdown_connections 2024-09-10T22:26:56.087 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:56.070+0000 7fea1fc34740 1 -- 172.21.15.19:0/2631061254 wait complete. 2024-09-10T22:26:56.087 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:56.070+0000 7fea177fe640 1 --2- 172.21.15.19:0/3496124438 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7fea000b51b0 0x7fea000b7670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:26:56.087 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:56.070+0000 7fea1c85d640 1 -- 172.21.15.19:0/3496124438 <== mon.1 v2:172.21.15.138:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8327+0+0 (secure 0 0 0) 0x7fea0c0e5fc0 con 0x7fea181087f0 2024-09-10T22:26:56.087 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:56.070+0000 7fea1fc34740 1 -- start start 2024-09-10T22:26:56.087 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:56.071+0000 7fea1fc34740 1 Processor -- start 2024-09-10T22:26:56.087 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:56.071+0000 7fea177fe640 1 --2- 172.21.15.19:0/3496124438 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7fea000b51b0 0x7fea000b7670 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fea10009e20 tx=0x7fea10005bd0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:26:56.088 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:56.071+0000 7fea1fc34740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55e4b37770f0 0x55e4b378bac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:26:56.088 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:56.071+0000 7fea1fc34740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55e4b3777a10 0x55e4b3788f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:26:56.088 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:56.071+0000 7fea1fc34740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e4b378c1b0 0x55e4b3789560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:26:56.088 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:56.071+0000 7fea1fc34740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x55e4b353e700 con 0x55e4b3777a10 2024-09-10T22:26:56.088 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:56.071+0000 7fea1fc34740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55e4b3678160 con 0x55e4b378c1b0 2024-09-10T22:26:56.088 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:56.071+0000 7fea1fc34740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x55e4b378ee30 con 0x55e4b37770f0 2024-09-10T22:26:56.088 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:56.071+0000 7fea1fc34740 10 client.0 _ll_register_callbacks cb 0x55e4b36919e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T22:26:56.089 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:56.071+0000 7fea16ffd640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55e4b37770f0 0x55e4b378bac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:26:56.089 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:56.071+0000 7fea177fe640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e4b378c1b0 0x55e4b3789560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:26:56.089 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:56.071+0000 7fea167fc640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55e4b3777a10 0x55e4b3788f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:26:56.089 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:56.071+0000 7fea177fe640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e4b378c1b0 0x55e4b3789560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.19:59746/0 (socket says 172.21.15.19:59746) 2024-09-10T22:26:56.089 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:56.071+0000 7fea177fe640 1 -- 172.21.15.19:0/449808323 learned_addr learned my addr 172.21.15.19:0/449808323 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:26:56.089 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:56.072+0000 7fea177fe640 1 -- 172.21.15.19:0/449808323 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55e4b37770f0 msgr2=0x55e4b378bac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:26:56.089 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:56.072+0000 7fea177fe640 1 --2- 172.21.15.19:0/449808323 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55e4b37770f0 0x55e4b378bac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:26:56.090 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:56.072+0000 7fea177fe640 1 -- 172.21.15.19:0/449808323 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55e4b3777a10 msgr2=0x55e4b3788f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:26:56.090 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:56.072+0000 7fea177fe640 1 --2- 172.21.15.19:0/449808323 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55e4b3777a10 0x55e4b3788f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:26:56.090 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:56.072+0000 7fea177fe640 1 -- 172.21.15.19:0/449808323 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e4b36a5c90 con 0x55e4b378c1b0 2024-09-10T22:26:56.090 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:56.072+0000 7fea167fc640 1 --2- 172.21.15.19:0/449808323 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55e4b3777a10 0x55e4b3788f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T22:26:56.090 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:56.072+0000 7fea177fe640 1 --2- 172.21.15.19:0/449808323 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e4b378c1b0 0x55e4b3789560 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fea1001a000 tx=0x7fea100095c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e7ad0ad804956a37 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:26:56.090 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:56.072+0000 7fe9f6ffd640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-09-10T22:26:56.090 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:56.073+0000 7fe9f6ffd640 1 -- 172.21.15.19:0/449808323 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea1002f450 con 0x55e4b378c1b0 2024-09-10T22:26:56.091 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:56.073+0000 7fe9f6ffd640 1 -- 172.21.15.19:0/449808323 <== mon.2 v2:172.21.15.135:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8327+0+0 (secure 0 0 0) 0x7fea1002f5f0 con 0x55e4b378c1b0 2024-09-10T22:26:56.091 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:56.073+0000 7fea1fc34740 1 -- 172.21.15.19:0/449808323 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fea1000d6b0 con 0x55e4b378c1b0 2024-09-10T22:26:56.091 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:56.073+0000 7fe9f6ffd640 1 -- 172.21.15.19:0/449808323 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fea1002f7f0 con 0x55e4b378c1b0 2024-09-10T22:26:56.091 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:56.073+0000 7fea1fc34740 10 client.25058 fetch_fsmap learned FSMap version 25 2024-09-10T22:26:56.091 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:56.073+0000 7fea1fc34740 1 -- 172.21.15.19:0/449808323 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55e4b3785920 con 0x55e4b378c1b0 2024-09-10T22:26:56.091 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:56.073+0000 7fe9f6ffd640 1 -- 172.21.15.19:0/449808323 <== mon.2 v2:172.21.15.135:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fea1000d6b0 con 0x55e4b378c1b0 2024-09-10T22:26:56.091 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:56.074+0000 7fe9f6ffd640 1 -- 172.21.15.19:0/449808323 <== mon.2 v2:172.21.15.135:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fea1000b040 con 0x55e4b378c1b0 2024-09-10T22:26:56.092 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:56.074+0000 7fea1fc34740 10 client.25058 fetch_fsmap finished waiting for FSMap version 25 2024-09-10T22:26:56.092 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:56.074+0000 7fea1fc34740 10 client.25058 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-10T22:26:56.092 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:56.074+0000 7fea1fc34740 20 client.25058 populate_metadata read hostname 'smithi019' 2024-09-10T22:26:56.092 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:56.074+0000 7fea1fc34740 1 --2- 172.21.15.19:0/449808323 >> [v2:172.21.15.138:6838/383637208,v1:172.21.15.138:6839/383637208] conn(0x55e4b3791430 0x55e4b3793890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:26:56.092 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:56.074+0000 7fea1fc34740 4 client.25058 mds_command: new command op to 24568 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T22:26:56.092 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:56.074+0000 7fea1fc34740 1 -- 172.21.15.19:0/449808323 --> [v2:172.21.15.138:6838/383637208,v1:172.21.15.138:6839/383637208] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e4b36efdf0 con 0x55e4b3791430 2024-09-10T22:26:56.092 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:56.075+0000 7fea16ffd640 1 --2- 172.21.15.19:0/449808323 >> [v2:172.21.15.138:6838/383637208,v1:172.21.15.138:6839/383637208] conn(0x55e4b3791430 0x55e4b3793890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:26:56.092 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:56.075+0000 7fe9f6ffd640 10 client.25058 ms_handle_connect on v2:172.21.15.138:6838/383637208 2024-09-10T22:26:56.093 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:56.075+0000 7fea16ffd640 1 --2- 172.21.15.19:0/449808323 >> [v2:172.21.15.138:6838/383637208,v1:172.21.15.138:6839/383637208] conn(0x55e4b3791430 0x55e4b3793890 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=9708b3d41c8bddbf server_cookie=992382cff036a8c0 in_seq=0 out_seq=0 2024-09-10T22:26:56.093 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:56.076+0000 7fe9f6ffd640 1 -- 172.21.15.19:0/449808323 <== mds.1 v2:172.21.15.138:6838/383637208 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55e4b36efdf0 con 0x55e4b3791430 2024-09-10T22:26:56.093 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:56.076+0000 7fe9f6ffd640 10 client.25058 handle_command_reply: tid=0 2024-09-10T22:26:56.093 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:56.076+0000 7fea1fc34740 1 client.25058 shutdown 2024-09-10T22:26:56.093 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:56.076+0000 7fea1fc34740 1 -- 172.21.15.19:0/449808323 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e4b378c1b0 msgr2=0x55e4b3789560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:26:56.093 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:56.076+0000 7fea1fc34740 1 --2- 172.21.15.19:0/449808323 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e4b378c1b0 0x55e4b3789560 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fea1001a000 tx=0x7fea100095c0 comp rx=0 tx=0).stop 2024-09-10T22:26:56.093 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:56.076+0000 7fea1fc34740 1 -- 172.21.15.19:0/449808323 shutdown_connections 2024-09-10T22:26:56.094 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:56.076+0000 7fea1fc34740 1 --2- 172.21.15.19:0/449808323 >> [v2:172.21.15.138:6838/383637208,v1:172.21.15.138:6839/383637208] conn(0x55e4b3791430 0x55e4b3793890 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:26:56.094 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:56.076+0000 7fea1fc34740 1 --2- 172.21.15.19:0/449808323 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e4b378c1b0 0x55e4b3789560 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:26:56.094 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:56.076+0000 7fea1fc34740 1 --2- 172.21.15.19:0/449808323 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55e4b3777a10 0x55e4b3788f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:26:56.094 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:56.076+0000 7fea1fc34740 1 --2- 172.21.15.19:0/449808323 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55e4b37770f0 0x55e4b378bac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:26:56.094 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:56.076+0000 7fea1fc34740 1 -- 172.21.15.19:0/449808323 >> 172.21.15.19:0/449808323 conn(0x55e4b3774f20 msgr2=0x55e4b377aac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:26:56.094 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:56.076+0000 7fe9f6ffd640 0 client.25058 ms_handle_reset on v2:172.21.15.138:6838/383637208 2024-09-10T22:26:56.094 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:56.076+0000 7fea1fc34740 1 -- 172.21.15.19:0/449808323 shutdown_connections 2024-09-10T22:26:56.094 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:56.076+0000 7fea1fc34740 1 -- 172.21.15.19:0/449808323 wait complete. 2024-09-10T22:26:56.095 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:56.077+0000 7fea1fc34740 20 client.25058 trim_cache size 0 max 16384 2024-09-10T22:26:56.115 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:56.103+0000 7fea1fc34740 1 Processor -- start 2024-09-10T22:26:56.115 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:56.103+0000 7fea1fc34740 1 -- start start 2024-09-10T22:26:56.115 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:56.104+0000 7fea1fc34740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55e4b37770f0 0x55e4b378e070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:26:56.115 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:56.104+0000 7fea1fc34740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55e4b3777a10 0x55e4b378e5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:26:56.115 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:56.104+0000 7fea1fc34740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e4b378c1b0 0x55e4b378d120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:26:56.116 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:56.104+0000 7fea1fc34740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fea181ae870 con 0x55e4b37770f0 2024-09-10T22:26:56.116 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:56.104+0000 7fea1fc34740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fea181ac140 con 0x55e4b378c1b0 2024-09-10T22:26:56.116 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:56.104+0000 7fea1fc34740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7fea181aa040 con 0x55e4b3777a10 2024-09-10T22:26:56.116 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:56.104+0000 7fea167fc640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55e4b3777a10 0x55e4b378e5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:26:56.116 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:56.104+0000 7fea167fc640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55e4b3777a10 0x55e4b378e5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.19:60836/0 (socket says 172.21.15.19:60836) 2024-09-10T22:26:56.116 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:56.104+0000 7fea167fc640 1 -- 172.21.15.19:0/966362335 learned_addr learned my addr 172.21.15.19:0/966362335 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:26:56.116 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:56.104+0000 7fea177fe640 1 --2- 172.21.15.19:0/966362335 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e4b378c1b0 0x55e4b378d120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:26:56.116 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:56.105+0000 7fea16ffd640 1 --2- 172.21.15.19:0/966362335 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55e4b37770f0 0x55e4b378e070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:26:56.116 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:56.105+0000 7fea167fc640 1 -- 172.21.15.19:0/966362335 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e4b378c1b0 msgr2=0x55e4b378d120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:26:56.116 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:56.105+0000 7fea167fc640 1 --2- 172.21.15.19:0/966362335 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e4b378c1b0 0x55e4b378d120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:26:56.116 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:56.105+0000 7fea167fc640 1 -- 172.21.15.19:0/966362335 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55e4b37770f0 msgr2=0x55e4b378e070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:26:56.116 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:56.105+0000 7fea167fc640 1 --2- 172.21.15.19:0/966362335 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55e4b37770f0 0x55e4b378e070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:26:56.116 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:56.105+0000 7fea167fc640 1 -- 172.21.15.19:0/966362335 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e4b3787450 con 0x55e4b3777a10 2024-09-10T22:26:56.117 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:56.105+0000 7fea16ffd640 1 --2- 172.21.15.19:0/966362335 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55e4b37770f0 0x55e4b378e070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T22:26:56.117 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:56.105+0000 7fea167fc640 1 --2- 172.21.15.19:0/966362335 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55e4b3777a10 0x55e4b378e5b0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fea0c0ac3c0 tx=0x7fea0c0abef0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9519643697a13fbc server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:26:56.117 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:56.105+0000 7fe9fd7fa640 1 -- 172.21.15.19:0/966362335 <== mon.1 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea0c0abb20 con 0x55e4b3777a10 2024-09-10T22:26:56.117 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:56.105+0000 7fe9fd7fa640 1 -- 172.21.15.19:0/966362335 <== mon.1 v2:172.21.15.138:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fea0c0ac6c0 con 0x55e4b3777a10 2024-09-10T22:26:56.117 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:56.105+0000 7fe9fd7fa640 1 -- 172.21.15.19:0/966362335 <== mon.1 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea0c010a90 con 0x55e4b3777a10 2024-09-10T22:26:56.117 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:56.106+0000 7fea1fc34740 1 -- 172.21.15.19:0/966362335 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55e4b3777a10 msgr2=0x55e4b378e5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:26:56.117 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:56.106+0000 7fea1fc34740 1 --2- 172.21.15.19:0/966362335 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55e4b3777a10 0x55e4b378e5b0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fea0c0ac3c0 tx=0x7fea0c0abef0 comp rx=0 tx=0).stop 2024-09-10T22:26:56.117 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:56.106+0000 7fea1fc34740 1 -- 172.21.15.19:0/966362335 shutdown_connections 2024-09-10T22:26:56.117 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:56.106+0000 7fea1fc34740 1 --2- 172.21.15.19:0/966362335 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e4b378c1b0 0x55e4b378d120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:26:56.117 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:56.106+0000 7fea1fc34740 1 --2- 172.21.15.19:0/966362335 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55e4b3777a10 0x55e4b378e5b0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:26:56.117 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:56.106+0000 7fea1fc34740 1 --2- 172.21.15.19:0/966362335 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55e4b37770f0 0x55e4b378e070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:26:56.117 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:56.106+0000 7fea1fc34740 1 -- 172.21.15.19:0/966362335 >> 172.21.15.19:0/966362335 conn(0x55e4b3774f20 msgr2=0x55e4b3788d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:26:56.117 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:56.107+0000 7fea1fc34740 1 -- 172.21.15.19:0/966362335 shutdown_connections 2024-09-10T22:26:56.118 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:56.107+0000 7fea1fc34740 1 -- 172.21.15.19:0/966362335 wait complete. 2024-09-10T22:26:56.118 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:56.107+0000 7fea1fc34740 1 -- start start 2024-09-10T22:26:56.118 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:56.107+0000 7fea1fc34740 1 Processor -- start 2024-09-10T22:26:56.118 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:56.108+0000 7fea1fc34740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e4b37770f0 0x55e4b3795f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:26:56.118 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:56.108+0000 7fea1fc34740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55e4b3777a10 0x55e4b3796530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:26:56.118 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:56.108+0000 7fea1fc34740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55e4b378c1b0 0x55e4b382a4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:26:56.118 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:56.108+0000 7fea167fc640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55e4b3777a10 0x55e4b3796530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:26:56.118 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:56.108+0000 7fea167fc640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55e4b3777a10 0x55e4b3796530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.19:60848/0 (socket says 172.21.15.19:60848) 2024-09-10T22:26:56.118 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:56.108+0000 7fea16ffd640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e4b37770f0 0x55e4b3795f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:26:56.118 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:56.108+0000 7fea16ffd640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e4b37770f0 0x55e4b3795f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.19:59762/0 (socket says 172.21.15.19:59762) 2024-09-10T22:26:56.118 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:56.108+0000 7fea177fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55e4b378c1b0 0x55e4b382a4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:26:56.118 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:56.108+0000 7fea177fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55e4b378c1b0 0x55e4b382a4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:32892/0 (socket says 172.21.15.19:32892) 2024-09-10T22:26:56.118 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:56.108+0000 7fea167fc640 1 -- 172.21.15.19:0/3734934310 learned_addr learned my addr 172.21.15.19:0/3734934310 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:26:56.119 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:56.108+0000 7fea1fc34740 1 -- 172.21.15.19:0/3734934310 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fea181aa600 con 0x55e4b378c1b0 2024-09-10T22:26:56.119 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:56.108+0000 7fea1fc34740 1 -- 172.21.15.19:0/3734934310 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fea181aba70 con 0x55e4b37770f0 2024-09-10T22:26:56.119 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:56.108+0000 7fea1fc34740 1 -- 172.21.15.19:0/3734934310 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7fea181aacd0 con 0x55e4b3777a10 2024-09-10T22:26:56.119 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:56.109+0000 7fea16ffd640 1 -- 172.21.15.19:0/3734934310 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55e4b3777a10 msgr2=0x55e4b3796530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:26:56.119 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:56.109+0000 7fea16ffd640 1 --2- 172.21.15.19:0/3734934310 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55e4b3777a10 0x55e4b3796530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:26:56.119 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:56.109+0000 7fea16ffd640 1 -- 172.21.15.19:0/3734934310 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55e4b378c1b0 msgr2=0x55e4b382a4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:26:56.119 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:56.109+0000 7fea16ffd640 1 --2- 172.21.15.19:0/3734934310 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55e4b378c1b0 0x55e4b382a4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:26:56.119 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:56.109+0000 7fea16ffd640 1 -- 172.21.15.19:0/3734934310 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e4b382abe0 con 0x55e4b37770f0 2024-09-10T22:26:56.119 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:56.109+0000 7fea177fe640 1 --2- 172.21.15.19:0/3734934310 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55e4b378c1b0 0x55e4b382a4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T22:26:56.119 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:56.109+0000 7fea16ffd640 1 --2- 172.21.15.19:0/3734934310 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e4b37770f0 0x55e4b3795f90 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fea08000c00 tx=0x7fea08030c70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9211013dec8f774b server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:26:56.119 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:56.110+0000 7fe9f6ffd640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-09-10T22:26:56.119 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:56.109+0000 7fea1fc34740 10 client.0 _ll_register_callbacks cb 0x7fea08035070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T22:26:56.119 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:56.110+0000 7fea1fc34740 1 -- 172.21.15.19:0/3734934310 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fea0c0ac6c0 con 0x55e4b37770f0 2024-09-10T22:26:56.119 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:56.110+0000 7fe9f6ffd640 1 -- 172.21.15.19:0/3734934310 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea08049020 con 0x55e4b37770f0 2024-09-10T22:26:56.120 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:56.110+0000 7fe9f6ffd640 1 -- 172.21.15.19:0/3734934310 <== mon.2 v2:172.21.15.135:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8327+0+0 (secure 0 0 0) 0x7fea08004450 con 0x55e4b37770f0 2024-09-10T22:26:56.120 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:56.110+0000 7fe9f6ffd640 1 -- 172.21.15.19:0/3734934310 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fea08037040 con 0x55e4b37770f0 2024-09-10T22:26:56.120 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:56.110+0000 7fea1fc34740 10 client.25064 fetch_fsmap learned FSMap version 25 2024-09-10T22:26:56.120 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:56.110+0000 7fea1fc34740 1 -- 172.21.15.19:0/3734934310 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({fsmap=25}) -- 0x55e4b3832e20 con 0x55e4b37770f0 2024-09-10T22:26:56.120 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:56.110+0000 7fe9f6ffd640 1 -- 172.21.15.19:0/3734934310 <== mon.2 v2:172.21.15.135:3300/0 4 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fea0803d040 con 0x55e4b37770f0 2024-09-10T22:26:56.120 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:56.110+0000 7fea1fc34740 10 client.25064 fetch_fsmap finished waiting for FSMap version 25 2024-09-10T22:26:56.120 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:56.110+0000 7fea1fc34740 10 client.25064 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-10T22:26:56.120 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:56.111+0000 7fea1fc34740 20 client.25064 populate_metadata read hostname 'smithi019' 2024-09-10T22:26:56.120 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:56.111+0000 7fea1fc34740 1 --2- 172.21.15.19:0/3734934310 >> [v2:172.21.15.138:6838/383637208,v1:172.21.15.138:6839/383637208] conn(0x55e4b3833440 0x55e4b3835900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:26:56.120 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:56.111+0000 7fea1fc34740 4 client.25064 mds_command: new command op to 24568 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-10T22:26:56.120 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:56.111+0000 7fea1fc34740 1 -- 172.21.15.19:0/3734934310 --> [v2:172.21.15.138:6838/383637208,v1:172.21.15.138:6839/383637208] -- command(tid 0: {"prefix": "damage ls"}) -- 0x7fea0c0ac6c0 con 0x55e4b3833440 2024-09-10T22:26:56.120 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:56.111+0000 7fea167fc640 1 --2- 172.21.15.19:0/3734934310 >> [v2:172.21.15.138:6838/383637208,v1:172.21.15.138:6839/383637208] conn(0x55e4b3833440 0x55e4b3835900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:26:56.120 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:56.111+0000 7fea167fc640 1 --2- 172.21.15.19:0/3734934310 >> [v2:172.21.15.138:6838/383637208,v1:172.21.15.138:6839/383637208] conn(0x55e4b3833440 0x55e4b3835900 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=2d313b44c18fe0f4 server_cookie=b3e6e0f225dba1ad in_seq=0 out_seq=0 2024-09-10T22:26:56.121 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:56.111+0000 7fe9f6ffd640 10 client.25064 ms_handle_connect on v2:172.21.15.138:6838/383637208 2024-09-10T22:26:56.121 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:56.112+0000 7fe9f6ffd640 1 -- 172.21.15.19:0/3734934310 <== mds.1 v2:172.21.15.138:6838/383637208 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x7fea0c0ac6c0 con 0x55e4b3833440 2024-09-10T22:26:56.121 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:56.112+0000 7fe9f6ffd640 10 client.25064 handle_command_reply: tid=0 2024-09-10T22:26:56.121 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:56.112+0000 7fea1fc34740 1 client.25064 shutdown 2024-09-10T22:26:56.121 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:56.112+0000 7fea1fc34740 1 -- 172.21.15.19:0/3734934310 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e4b37770f0 msgr2=0x55e4b3795f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:26:56.121 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:56.112+0000 7fea1fc34740 1 --2- 172.21.15.19:0/3734934310 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e4b37770f0 0x55e4b3795f90 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fea08000c00 tx=0x7fea08030c70 comp rx=0 tx=0).stop 2024-09-10T22:26:56.121 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:56.112+0000 7fea1fc34740 1 -- 172.21.15.19:0/3734934310 shutdown_connections 2024-09-10T22:26:56.121 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:56.112+0000 7fea1fc34740 1 --2- 172.21.15.19:0/3734934310 >> [v2:172.21.15.138:6838/383637208,v1:172.21.15.138:6839/383637208] conn(0x55e4b3833440 0x55e4b3835900 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:26:56.121 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:56.112+0000 7fe9f6ffd640 0 client.25064 ms_handle_reset on v2:172.21.15.138:6838/383637208 2024-09-10T22:26:56.121 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:56.112+0000 7fea1fc34740 1 --2- 172.21.15.19:0/3734934310 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55e4b378c1b0 0x55e4b382a4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:26:56.122 INFO:teuthology.orchestra.run.smithi019.stdout:[] 2024-09-10T22:26:56.123 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:56.112+0000 7fea1fc34740 1 --2- 172.21.15.19:0/3734934310 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55e4b3777a10 0x55e4b3796530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:26:56.123 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:56.112+0000 7fea1fc34740 1 --2- 172.21.15.19:0/3734934310 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e4b37770f0 0x55e4b3795f90 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:26:56.123 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:56.112+0000 7fea1fc34740 1 -- 172.21.15.19:0/3734934310 >> 172.21.15.19:0/3734934310 conn(0x55e4b3774f20 msgr2=0x55e4b378e070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:26:56.123 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:56.112+0000 7fea1fc34740 1 -- 172.21.15.19:0/3734934310 shutdown_connections 2024-09-10T22:26:56.123 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:56.112+0000 7fea1fc34740 1 -- 172.21.15.19:0/3734934310 wait complete. 2024-09-10T22:26:56.123 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:56.112+0000 7fea1fc34740 20 client.25064 trim_cache size 0 max 16384 2024-09-10T22:26:56.123 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:56.113+0000 7fea1d85f640 1 -- 172.21.15.19:0/3496124438 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7fea000b51b0 msgr2=0x7fea000b7670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:26:56.123 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:56.113+0000 7fea1d85f640 1 --2- 172.21.15.19:0/3496124438 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7fea000b51b0 0x7fea000b7670 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fea10009e20 tx=0x7fea10005bd0 comp rx=0 tx=0).stop 2024-09-10T22:26:56.123 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:56.113+0000 7fea1d85f640 1 -- 172.21.15.19:0/3496124438 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fea181087f0 msgr2=0x7fea181997c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:26:56.123 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:56.113+0000 7fea1d85f640 1 --2- 172.21.15.19:0/3496124438 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fea181087f0 0x7fea181997c0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fea0c00e9f0 tx=0x7fea0c00eeb0 comp rx=0 tx=0).stop 2024-09-10T22:26:56.124 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:56.113+0000 7fea1d85f640 1 -- 172.21.15.19:0/3496124438 shutdown_connections 2024-09-10T22:26:56.124 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:56.113+0000 7fea1d85f640 1 --2- 172.21.15.19:0/3496124438 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7fea000b51b0 0x7fea000b7670 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:26:56.124 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:56.113+0000 7fea1d85f640 1 --2- 172.21.15.19:0/3496124438 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fea18109170 0x7fea1819eb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:26:56.124 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:56.113+0000 7fea1d85f640 1 --2- 172.21.15.19:0/3496124438 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fea181087f0 0x7fea181997c0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:26:56.124 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:56.114+0000 7fea1d85f640 1 --2- 172.21.15.19:0/3496124438 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fea18102de0 0x7fea18199280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:26:56.124 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:56.114+0000 7fea1d85f640 1 -- 172.21.15.19:0/3496124438 >> 172.21.15.19:0/3496124438 conn(0x7fea180fe830 msgr2=0x7fea18100c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:26:56.124 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:56.114+0000 7fea1d85f640 1 -- 172.21.15.19:0/3496124438 shutdown_connections 2024-09-10T22:26:56.124 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:56.114+0000 7fea1d85f640 1 -- 172.21.15.19:0/3496124438 wait complete. 2024-09-10T22:26:56.200 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:56.198+0000 7f09b5d5d640 1 -- 172.21.15.19:0/2184862512 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f09b0101870 msgr2=0x7f09b0101c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:26:56.200 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:56.198+0000 7f09b5d5d640 1 --2- 172.21.15.19:0/2184862512 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f09b0101870 0x7f09b0101c70 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f09a0009900 tx=0x7f09a002a3f0 comp rx=0 tx=0).stop 2024-09-10T22:26:56.200 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:56.199+0000 7f09b5d5d640 1 -- 172.21.15.19:0/2184862512 shutdown_connections 2024-09-10T22:26:56.200 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:56.199+0000 7f09b5d5d640 1 --2- 172.21.15.19:0/2184862512 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f09b0103380 0x7f09b0109d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:26:56.201 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:56.199+0000 7f09b5d5d640 1 --2- 172.21.15.19:0/2184862512 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f09b01029c0 0x7f09b0102e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:26:56.201 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:56.199+0000 7f09b5d5d640 1 --2- 172.21.15.19:0/2184862512 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f09b0101870 0x7f09b0101c70 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:26:56.201 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:56.199+0000 7f09b5d5d640 1 -- 172.21.15.19:0/2184862512 >> 172.21.15.19:0/2184862512 conn(0x7f09b00fd130 msgr2=0x7f09b00ff550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:26:56.201 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:56.199+0000 7f09b5d5d640 1 -- 172.21.15.19:0/2184862512 shutdown_connections 2024-09-10T22:26:56.201 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:56.199+0000 7f09b5d5d640 1 -- 172.21.15.19:0/2184862512 wait complete. 2024-09-10T22:26:56.202 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:56.200+0000 7f09b5d5d640 1 Processor -- start 2024-09-10T22:26:56.202 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:56.200+0000 7f09b5d5d640 1 -- start start 2024-09-10T22:26:56.202 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:56.200+0000 7f09b5d5d640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f09b0101870 0x7f09b0198b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:26:56.202 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:56.200+0000 7f09b5d5d640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f09b01029c0 0x7f09b0199180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:26:56.202 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:56.200+0000 7f09b5d5d640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f09b0103380 0x7f09b0199db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:26:56.202 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:56.200+0000 7f09b5d5d640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f09b010e5b0 con 0x7f09b0101870 2024-09-10T22:26:56.202 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:56.200+0000 7f09b5d5d640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f09b010e430 con 0x7f09b01029c0 2024-09-10T22:26:56.202 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:56.200+0000 7f09b5d5d640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f09b010e730 con 0x7f09b0103380 2024-09-10T22:26:56.203 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:56.200+0000 7f09af7fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f09b0101870 0x7f09b0198b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:26:56.203 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:56.200+0000 7f09af7fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f09b0101870 0x7f09b0198b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:32914/0 (socket says 172.21.15.19:32914) 2024-09-10T22:26:56.203 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:56.200+0000 7f09af7fe640 1 -- 172.21.15.19:0/3909277109 learned_addr learned my addr 172.21.15.19:0/3909277109 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:26:56.203 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:56.201+0000 7f09affff640 1 --2- 172.21.15.19:0/3909277109 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f09b0103380 0x7f09b0199db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:26:56.203 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:56.201+0000 7f09a7fff640 1 --2- 172.21.15.19:0/3909277109 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f09b01029c0 0x7f09b0199180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:26:56.204 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:56.201+0000 7f09af7fe640 1 -- 172.21.15.19:0/3909277109 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f09b0103380 msgr2=0x7f09b0199db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:26:56.204 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:56.201+0000 7f09af7fe640 1 --2- 172.21.15.19:0/3909277109 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f09b0103380 0x7f09b0199db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:26:56.204 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:56.201+0000 7f09af7fe640 1 -- 172.21.15.19:0/3909277109 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f09b01029c0 msgr2=0x7f09b0199180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:26:56.204 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:56.201+0000 7f09af7fe640 1 --2- 172.21.15.19:0/3909277109 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f09b01029c0 0x7f09b0199180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:26:56.204 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:56.201+0000 7f09af7fe640 1 -- 172.21.15.19:0/3909277109 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f09b019a670 con 0x7f09b0101870 2024-09-10T22:26:56.204 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:56.201+0000 7f09affff640 1 --2- 172.21.15.19:0/3909277109 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f09b0103380 0x7f09b0199db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T22:26:56.204 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:56.201+0000 7f09a7fff640 1 --2- 172.21.15.19:0/3909277109 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f09b01029c0 0x7f09b0199180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T22:26:56.204 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:56.202+0000 7f09af7fe640 1 --2- 172.21.15.19:0/3909277109 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f09b0101870 0x7f09b0198b30 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f09a0032fd0 tx=0x7f09a0004430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:26:56.205 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:56.202+0000 7f09ad7fa640 1 -- 172.21.15.19:0/3909277109 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09a003f030 con 0x7f09b0101870 2024-09-10T22:26:56.205 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:56.202+0000 7f09ad7fa640 1 -- 172.21.15.19:0/3909277109 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f09a0003cb0 con 0x7f09b0101870 2024-09-10T22:26:56.205 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:56.202+0000 7f09b5d5d640 1 -- 172.21.15.19:0/3909277109 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f09b019a900 con 0x7f09b0101870 2024-09-10T22:26:56.205 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:56.202+0000 7f09ad7fa640 1 -- 172.21.15.19:0/3909277109 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09a0035070 con 0x7f09b0101870 2024-09-10T22:26:56.205 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:56.203+0000 7f09b5d5d640 1 -- 172.21.15.19:0/3909277109 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f09b010a5a0 con 0x7f09b0101870 2024-09-10T22:26:56.207 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:56.206+0000 7f09ad7fa640 1 -- 172.21.15.19:0/3909277109 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 18) ==== 153250+0+0 (secure 0 0 0) 0x7f09a003b4f0 con 0x7f09b0101870 2024-09-10T22:26:56.208 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:56.206+0000 7f09b8c0a740 1 Processor -- start 2024-09-10T22:26:56.209 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:56.207+0000 7f09b8c0a740 1 -- start start 2024-09-10T22:26:56.209 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:56.207+0000 7f09b8c0a740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x555651b60880 0x555651b62c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:26:56.209 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:56.207+0000 7f09b8c0a740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x555651b631b0 0x555651b655a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:26:56.209 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:56.207+0000 7f09b8c0a740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555651b65bf0 0x555651b680b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:26:56.209 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:56.207+0000 7f09af7fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x555651b631b0 0x555651b655a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:26:56.209 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:56.207+0000 7f09b8c0a740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x555651ad26f0 con 0x555651b631b0 2024-09-10T22:26:56.209 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:56.207+0000 7f09b8c0a740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x555651ac1b20 con 0x555651b65bf0 2024-09-10T22:26:56.209 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:56.207+0000 7f09b8c0a740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x555651ac5930 con 0x555651b60880 2024-09-10T22:26:56.209 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:56.207+0000 7f09af7fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x555651b631b0 0x555651b655a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:32930/0 (socket says 172.21.15.19:32930) 2024-09-10T22:26:56.209 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:56.207+0000 7f09af7fe640 1 -- 172.21.15.19:0/3050985114 learned_addr learned my addr 172.21.15.19:0/3050985114 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:26:56.209 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:56.207+0000 7f09a7fff640 1 --2- 172.21.15.19:0/3050985114 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555651b65bf0 0x555651b680b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:26:56.209 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:56.207+0000 7f09affff640 1 --2- 172.21.15.19:0/3050985114 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x555651b60880 0x555651b62c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:26:56.211 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:56.208+0000 7f09affff640 1 -- 172.21.15.19:0/3050985114 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555651b65bf0 msgr2=0x555651b680b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:26:56.211 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:56.208+0000 7f09affff640 1 --2- 172.21.15.19:0/3050985114 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555651b65bf0 0x555651b680b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:26:56.211 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:56.208+0000 7f09affff640 1 -- 172.21.15.19:0/3050985114 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x555651b631b0 msgr2=0x555651b655a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:26:56.211 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:56.208+0000 7f09ad7fa640 1 --2- 172.21.15.19:0/3909277109 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f099c0b5360 0x7f099c0b7820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:26:56.211 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:56.208+0000 7f09affff640 1 --2- 172.21.15.19:0/3050985114 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x555651b631b0 0x555651b655a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:26:56.211 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:56.208+0000 7f09affff640 1 -- 172.21.15.19:0/3050985114 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555651a87530 con 0x555651b60880 2024-09-10T22:26:56.211 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:56.208+0000 7f09af7fe640 1 --2- 172.21.15.19:0/3050985114 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x555651b631b0 0x555651b655a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T22:26:56.212 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:56.208+0000 7f09a7fff640 1 --2- 172.21.15.19:0/3909277109 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f099c0b5360 0x7f099c0b7820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:26:56.212 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:56.208+0000 7f09ad7fa640 1 -- 172.21.15.19:0/3909277109 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8327+0+0 (secure 0 0 0) 0x7f09a0106040 con 0x7f09b0101870 2024-09-10T22:26:56.212 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:56.208+0000 7f09affff640 1 --2- 172.21.15.19:0/3050985114 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x555651b60880 0x555651b62c70 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f09a8005fd0 tx=0x7f09a8010b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=87fd1ffa568a834c server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:26:56.212 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:56.209+0000 7f09a5ffb640 1 -- 172.21.15.19:0/3050985114 <== mon.1 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09a8003b70 con 0x555651b60880 2024-09-10T22:26:56.212 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:56.209+0000 7f09a7fff640 1 --2- 172.21.15.19:0/3909277109 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f099c0b5360 0x7f099c0b7820 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f0998010620 tx=0x7f099800a2d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:26:56.212 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:56.209+0000 7f09a5ffb640 1 -- 172.21.15.19:0/3050985114 <== mon.1 v2:172.21.15.138:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f09a8010e90 con 0x555651b60880 2024-09-10T22:26:56.212 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:56.209+0000 7f09a5ffb640 1 -- 172.21.15.19:0/3050985114 <== mon.1 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09a80045f0 con 0x555651b60880 2024-09-10T22:26:56.212 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:56.210+0000 7f09b8c0a740 1 -- 172.21.15.19:0/3050985114 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x555651b60880 msgr2=0x555651b62c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:26:56.212 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:56.210+0000 7f09b8c0a740 1 --2- 172.21.15.19:0/3050985114 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x555651b60880 0x555651b62c70 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f09a8005fd0 tx=0x7f09a8010b80 comp rx=0 tx=0).stop 2024-09-10T22:26:56.212 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:56.210+0000 7f09b8c0a740 1 -- 172.21.15.19:0/3050985114 shutdown_connections 2024-09-10T22:26:56.212 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:56.210+0000 7f09b8c0a740 1 --2- 172.21.15.19:0/3050985114 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555651b65bf0 0x555651b680b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:26:56.213 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:56.210+0000 7f09b8c0a740 1 --2- 172.21.15.19:0/3050985114 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x555651b631b0 0x555651b655a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:26:56.213 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:56.210+0000 7f09b8c0a740 1 --2- 172.21.15.19:0/3050985114 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x555651b60880 0x555651b62c70 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:26:56.213 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:56.210+0000 7f09b8c0a740 1 -- 172.21.15.19:0/3050985114 >> 172.21.15.19:0/3050985114 conn(0x555651b5b9d0 msgr2=0x555651b5c760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:26:56.213 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:56.210+0000 7f09b8c0a740 1 -- 172.21.15.19:0/3050985114 shutdown_connections 2024-09-10T22:26:56.213 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:56.210+0000 7f09b8c0a740 1 -- 172.21.15.19:0/3050985114 wait complete. 2024-09-10T22:26:56.215 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:56.210+0000 7f09b8c0a740 1 -- start start 2024-09-10T22:26:56.215 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:56.211+0000 7f09b8c0a740 1 Processor -- start 2024-09-10T22:26:56.215 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:56.211+0000 7f09b8c0a740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x555651b60880 0x555651b69f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:26:56.215 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:56.211+0000 7f09b8c0a740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555651b631b0 0x555651b6a5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:26:56.215 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:56.211+0000 7f09b8c0a740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x555651b65bf0 0x555651b6b180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:26:56.216 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:56.211+0000 7f09b8c0a740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x5556519f9ab0 con 0x555651b65bf0 2024-09-10T22:26:56.216 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:56.211+0000 7f09b8c0a740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x555651a67730 con 0x555651b631b0 2024-09-10T22:26:56.216 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:56.211+0000 7f09b8c0a740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x555651b68bd0 con 0x555651b60880 2024-09-10T22:26:56.216 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:56.211+0000 7f09b8c0a740 10 client.0 _ll_register_callbacks cb 0x555651abb6b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T22:26:56.216 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:56.211+0000 7f09af7fe640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x555651b60880 0x555651b69f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:26:56.216 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:56.211+0000 7f09a7fff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555651b631b0 0x555651b6a5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:26:56.216 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:56.211+0000 7f09af7fe640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x555651b60880 0x555651b69f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.19:60882/0 (socket says 172.21.15.19:60882) 2024-09-10T22:26:56.216 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:56.211+0000 7f09af7fe640 1 -- 172.21.15.19:0/630917908 learned_addr learned my addr 172.21.15.19:0/630917908 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:26:56.216 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:56.211+0000 7f09affff640 1 --2- 172.21.15.19:0/630917908 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x555651b65bf0 0x555651b6b180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:26:56.216 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:56.212+0000 7f09af7fe640 1 -- 172.21.15.19:0/630917908 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555651b631b0 msgr2=0x555651b6a5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:26:56.216 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:56.212+0000 7f09af7fe640 1 --2- 172.21.15.19:0/630917908 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555651b631b0 0x555651b6a5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:26:56.217 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:56.212+0000 7f09af7fe640 1 -- 172.21.15.19:0/630917908 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x555651b65bf0 msgr2=0x555651b6b180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:26:56.217 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:56.212+0000 7f09af7fe640 1 --2- 172.21.15.19:0/630917908 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x555651b65bf0 0x555651b6b180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:26:56.217 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:56.212+0000 7f09af7fe640 1 -- 172.21.15.19:0/630917908 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555651823790 con 0x555651b60880 2024-09-10T22:26:56.217 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:56.212+0000 7f09affff640 1 --2- 172.21.15.19:0/630917908 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x555651b65bf0 0x555651b6b180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T22:26:56.217 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:56.212+0000 7f09af7fe640 1 --2- 172.21.15.19:0/630917908 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x555651b60880 0x555651b69f10 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f09a0109950 tx=0x7f09a003b890 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bb6271798a88c705 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:26:56.217 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:56.212+0000 7f098effd640 10 client.0 ms_handle_connect on v2:172.21.15.138:3300/0 2024-09-10T22:26:56.217 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:56.212+0000 7f098effd640 1 -- 172.21.15.19:0/630917908 <== mon.1 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09a00cc610 con 0x555651b60880 2024-09-10T22:26:56.217 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:56.212+0000 7f098effd640 1 -- 172.21.15.19:0/630917908 <== mon.1 v2:172.21.15.138:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8327+0+0 (secure 0 0 0) 0x7f09a00c8ab0 con 0x555651b60880 2024-09-10T22:26:56.217 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:56.212+0000 7f09b8c0a740 1 -- 172.21.15.19:0/630917908 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f09a8010e90 con 0x555651b60880 2024-09-10T22:26:56.217 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:56.212+0000 7f098effd640 1 -- 172.21.15.19:0/630917908 <== mon.1 v2:172.21.15.138:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f09a0003e60 con 0x555651b60880 2024-09-10T22:26:56.217 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:56.212+0000 7f09b8c0a740 10 client.25036 fetch_fsmap learned FSMap version 25 2024-09-10T22:26:56.217 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:56.212+0000 7f09b8c0a740 1 -- 172.21.15.19:0/630917908 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55565189c620 con 0x555651b60880 2024-09-10T22:26:56.217 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:56.213+0000 7f098effd640 1 -- 172.21.15.19:0/630917908 <== mon.1 v2:172.21.15.138:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f09a8010e90 con 0x555651b60880 2024-09-10T22:26:56.218 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:56.213+0000 7f098effd640 1 -- 172.21.15.19:0/630917908 <== mon.1 v2:172.21.15.138:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f09a00d5940 con 0x555651b60880 2024-09-10T22:26:56.218 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:56.213+0000 7f09b8c0a740 10 client.25036 fetch_fsmap finished waiting for FSMap version 25 2024-09-10T22:26:56.218 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:56.213+0000 7f09b8c0a740 10 client.25036 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-10T22:26:56.218 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:56.213+0000 7f09b8c0a740 20 client.25036 populate_metadata read hostname 'smithi019' 2024-09-10T22:26:56.218 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:56.213+0000 7f09b8c0a740 1 --2- 172.21.15.19:0/630917908 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x555651b756f0 0x555651b77b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:26:56.218 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:56.213+0000 7f09b8c0a740 4 client.25036 mds_command: new command op to 24581 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T22:26:56.218 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:56.213+0000 7f09b8c0a740 1 -- 172.21.15.19:0/630917908 --> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x555651ad4640 con 0x555651b756f0 2024-09-10T22:26:56.218 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:56.213+0000 7f09a7fff640 1 --2- 172.21.15.19:0/630917908 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x555651b756f0 0x555651b77b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:26:56.218 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:56.214+0000 7f098effd640 10 client.25036 ms_handle_connect on v2:172.21.15.135:6838/1254769802 2024-09-10T22:26:56.218 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:56.214+0000 7f09a7fff640 1 --2- 172.21.15.19:0/630917908 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x555651b756f0 0x555651b77b90 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1be53edcdf6fa126 server_cookie=10f989a8199315a0 in_seq=0 out_seq=0 2024-09-10T22:26:56.219 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:56.215+0000 7f098effd640 1 -- 172.21.15.19:0/630917908 <== mds.0 v2:172.21.15.135:6838/1254769802 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x555651ad4640 con 0x555651b756f0 2024-09-10T22:26:56.219 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:56.215+0000 7f098effd640 10 client.25036 handle_command_reply: tid=0 2024-09-10T22:26:56.220 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:56.215+0000 7f09b8c0a740 1 client.25036 shutdown 2024-09-10T22:26:56.220 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:56.215+0000 7f09b8c0a740 1 -- 172.21.15.19:0/630917908 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x555651b60880 msgr2=0x555651b69f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:26:56.220 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:56.215+0000 7f09b8c0a740 1 --2- 172.21.15.19:0/630917908 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x555651b60880 0x555651b69f10 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f09a0109950 tx=0x7f09a003b890 comp rx=0 tx=0).stop 2024-09-10T22:26:56.220 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:56.215+0000 7f09b8c0a740 1 -- 172.21.15.19:0/630917908 shutdown_connections 2024-09-10T22:26:56.220 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:56.215+0000 7f09b8c0a740 1 --2- 172.21.15.19:0/630917908 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x555651b65bf0 0x555651b6b180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:26:56.220 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:56.215+0000 7f09b8c0a740 1 --2- 172.21.15.19:0/630917908 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555651b631b0 0x555651b6a5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:26:56.220 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:56.215+0000 7f09b8c0a740 1 --2- 172.21.15.19:0/630917908 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x555651b756f0 0x555651b77b90 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:26:56.220 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:56.215+0000 7f09b8c0a740 1 --2- 172.21.15.19:0/630917908 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x555651b60880 0x555651b69f10 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:26:56.220 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:56.215+0000 7f09b8c0a740 1 -- 172.21.15.19:0/630917908 >> 172.21.15.19:0/630917908 conn(0x555651b5b9d0 msgr2=0x555651b5abf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:26:56.220 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:56.215+0000 7f098effd640 0 client.25036 ms_handle_reset on v2:172.21.15.135:6838/1254769802 2024-09-10T22:26:56.220 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:56.215+0000 7f09b8c0a740 1 -- 172.21.15.19:0/630917908 shutdown_connections 2024-09-10T22:26:56.220 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:56.215+0000 7f09b8c0a740 1 -- 172.21.15.19:0/630917908 wait complete. 2024-09-10T22:26:56.220 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:56.215+0000 7f09b8c0a740 20 client.25036 trim_cache size 0 max 16384 2024-09-10T22:26:56.246 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:56.244+0000 7f09b8c0a740 1 Processor -- start 2024-09-10T22:26:56.246 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:56.244+0000 7f09b8c0a740 1 -- start start 2024-09-10T22:26:56.246 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:56.245+0000 7f09b8c0a740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555651b60880 0x555651b69150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:26:56.246 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:56.245+0000 7f09b8c0a740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x555651b631b0 0x555651b5fd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:26:56.247 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:56.245+0000 7f09b8c0a740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x555651b65bf0 0x555651b60280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:26:56.247 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:56.245+0000 7f09b8c0a740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f09b01aea30 con 0x555651b631b0 2024-09-10T22:26:56.247 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:56.245+0000 7f09b8c0a740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f09b01ac300 con 0x555651b60880 2024-09-10T22:26:56.247 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:56.245+0000 7f09b8c0a740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f09b01aa150 con 0x555651b65bf0 2024-09-10T22:26:56.247 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:56.245+0000 7f09a7fff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x555651b631b0 0x555651b5fd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:26:56.248 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:56.245+0000 7f09a7fff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x555651b631b0 0x555651b5fd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:32950/0 (socket says 172.21.15.19:32950) 2024-09-10T22:26:56.248 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:56.245+0000 7f09a7fff640 1 -- 172.21.15.19:0/708856752 learned_addr learned my addr 172.21.15.19:0/708856752 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:26:56.248 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:56.245+0000 7f09af7fe640 1 --2- 172.21.15.19:0/708856752 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555651b60880 0x555651b69150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:26:56.248 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:56.245+0000 7f09af7fe640 1 -- 172.21.15.19:0/708856752 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x555651b65bf0 msgr2=0x555651b60280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:26:56.248 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:56.245+0000 7f09af7fe640 1 --2- 172.21.15.19:0/708856752 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x555651b65bf0 0x555651b60280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:26:56.248 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:56.245+0000 7f09af7fe640 1 -- 172.21.15.19:0/708856752 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x555651b631b0 msgr2=0x555651b5fd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:26:56.248 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:56.245+0000 7f09af7fe640 1 --2- 172.21.15.19:0/708856752 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x555651b631b0 0x555651b5fd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:26:56.248 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:56.245+0000 7f09af7fe640 1 -- 172.21.15.19:0/708856752 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555651b6b4f0 con 0x555651b60880 2024-09-10T22:26:56.248 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:56.245+0000 7f09a7fff640 1 --2- 172.21.15.19:0/708856752 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x555651b631b0 0x555651b5fd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T22:26:56.248 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:56.246+0000 7f09af7fe640 1 --2- 172.21.15.19:0/708856752 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555651b60880 0x555651b69150 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f09a00c9ab0 tx=0x7f09a0005fd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cf22f4ff437cf551 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:26:56.248 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:56.246+0000 7f09a57fa640 1 -- 172.21.15.19:0/708856752 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09a00cbfb0 con 0x555651b60880 2024-09-10T22:26:56.248 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:56.246+0000 7f09a57fa640 1 -- 172.21.15.19:0/708856752 <== mon.2 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f09a000b0b0 con 0x555651b60880 2024-09-10T22:26:56.249 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:56.246+0000 7f09a57fa640 1 -- 172.21.15.19:0/708856752 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09a00cc190 con 0x555651b60880 2024-09-10T22:26:56.251 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:56.247+0000 7f09b8c0a740 1 -- 172.21.15.19:0/708856752 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555651b60880 msgr2=0x555651b69150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:26:56.251 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:56.247+0000 7f09b8c0a740 1 --2- 172.21.15.19:0/708856752 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555651b60880 0x555651b69150 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f09a00c9ab0 tx=0x7f09a0005fd0 comp rx=0 tx=0).stop 2024-09-10T22:26:56.251 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:56.247+0000 7f09b8c0a740 1 -- 172.21.15.19:0/708856752 shutdown_connections 2024-09-10T22:26:56.251 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:56.247+0000 7f09b8c0a740 1 --2- 172.21.15.19:0/708856752 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x555651b65bf0 0x555651b60280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:26:56.251 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:56.247+0000 7f09b8c0a740 1 --2- 172.21.15.19:0/708856752 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x555651b631b0 0x555651b5fd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:26:56.251 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:56.247+0000 7f09b8c0a740 1 --2- 172.21.15.19:0/708856752 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555651b60880 0x555651b69150 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:26:56.251 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:56.247+0000 7f09b8c0a740 1 -- 172.21.15.19:0/708856752 >> 172.21.15.19:0/708856752 conn(0x555651b5b9d0 msgr2=0x555651b77700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:26:56.251 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:56.247+0000 7f09b8c0a740 1 -- 172.21.15.19:0/708856752 shutdown_connections 2024-09-10T22:26:56.251 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:56.247+0000 7f09b8c0a740 1 -- 172.21.15.19:0/708856752 wait complete. 2024-09-10T22:26:56.251 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:56.248+0000 7f09b8c0a740 1 -- start start 2024-09-10T22:26:56.251 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:56.248+0000 7f09b8c0a740 1 Processor -- start 2024-09-10T22:26:56.252 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:56.248+0000 7f09b8c0a740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555651b60880 0x555651b71820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:26:56.252 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:56.248+0000 7f09b8c0a740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x555651b631b0 0x555651b70520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:26:56.252 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:56.248+0000 7f09b8c0a740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x555651b65bf0 0x555651b70a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:26:56.252 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:56.248+0000 7f09b8c0a740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f09b01aa7c0 con 0x555651b65bf0 2024-09-10T22:26:56.252 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:56.248+0000 7f09b8c0a740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f09b01abc30 con 0x555651b60880 2024-09-10T22:26:56.252 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:56.248+0000 7f09affff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x555651b65bf0 0x555651b70a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:26:56.252 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:56.248+0000 7f09affff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x555651b65bf0 0x555651b70a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:32954/0 (socket says 172.21.15.19:32954) 2024-09-10T22:26:56.252 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:56.249+0000 7f09affff640 1 -- 172.21.15.19:0/4142563706 learned_addr learned my addr 172.21.15.19:0/4142563706 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:26:56.252 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:56.249+0000 7f09af7fe640 1 --2- 172.21.15.19:0/4142563706 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555651b60880 0x555651b71820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:26:56.252 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:56.249+0000 7f09b8c0a740 1 -- 172.21.15.19:0/4142563706 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f09b01aae90 con 0x555651b631b0 2024-09-10T22:26:56.252 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:56.249+0000 7f09b8c0a740 10 client.0 _ll_register_callbacks cb 0x7f09a01098a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T22:26:56.252 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:56.249+0000 7f09a7fff640 1 --2- 172.21.15.19:0/4142563706 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x555651b631b0 0x555651b70520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:26:56.253 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:56.249+0000 7f09a7fff640 1 -- 172.21.15.19:0/4142563706 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555651b60880 msgr2=0x555651b71820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:26:56.253 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:56.249+0000 7f09a7fff640 1 --2- 172.21.15.19:0/4142563706 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555651b60880 0x555651b71820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:26:56.253 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:56.249+0000 7f09a7fff640 1 -- 172.21.15.19:0/4142563706 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x555651b65bf0 msgr2=0x555651b70a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:26:56.253 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:56.249+0000 7f09a7fff640 1 --2- 172.21.15.19:0/4142563706 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x555651b65bf0 0x555651b70a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:26:56.253 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:56.249+0000 7f09a7fff640 1 -- 172.21.15.19:0/4142563706 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555651b710a0 con 0x555651b631b0 2024-09-10T22:26:56.253 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:56.249+0000 7f09affff640 1 --2- 172.21.15.19:0/4142563706 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x555651b65bf0 0x555651b70a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T22:26:56.253 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:56.250+0000 7f09a7fff640 1 --2- 172.21.15.19:0/4142563706 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x555651b631b0 0x555651b70520 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f0998010eb0 tx=0x7f09980046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=44ac863aa2900973 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:26:56.253 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:56.250+0000 7f098effd640 10 client.0 ms_handle_connect on v2:172.21.15.138:3300/0 2024-09-10T22:26:56.255 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:56.250+0000 7f098effd640 1 -- 172.21.15.19:0/4142563706 <== mon.1 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0998033060 con 0x555651b631b0 2024-09-10T22:26:56.255 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:56.250+0000 7f09b8c0a740 1 -- 172.21.15.19:0/4142563706 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f09a000b0b0 con 0x555651b631b0 2024-09-10T22:26:56.255 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:56.250+0000 7f098effd640 1 -- 172.21.15.19:0/4142563706 <== mon.1 v2:172.21.15.138:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8327+0+0 (secure 0 0 0) 0x7f0998004a00 con 0x555651b631b0 2024-09-10T22:26:56.255 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:56.250+0000 7f098effd640 1 -- 172.21.15.19:0/4142563706 <== mon.1 v2:172.21.15.138:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f0998004c00 con 0x555651b631b0 2024-09-10T22:26:56.255 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:56.250+0000 7f09b8c0a740 10 client.25039 fetch_fsmap learned FSMap version 25 2024-09-10T22:26:56.255 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:56.250+0000 7f09b8c0a740 1 -- 172.21.15.19:0/4142563706 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x555651be26a0 con 0x555651b631b0 2024-09-10T22:26:56.255 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:56.251+0000 7f098effd640 1 -- 172.21.15.19:0/4142563706 <== mon.1 v2:172.21.15.138:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f09a000b0b0 con 0x555651b631b0 2024-09-10T22:26:56.255 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:56.251+0000 7f098effd640 1 -- 172.21.15.19:0/4142563706 <== mon.1 v2:172.21.15.138:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f0998037030 con 0x555651b631b0 2024-09-10T22:26:56.255 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:56.251+0000 7f09b8c0a740 10 client.25039 fetch_fsmap finished waiting for FSMap version 25 2024-09-10T22:26:56.256 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:56.251+0000 7f09b8c0a740 10 client.25039 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-10T22:26:56.256 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:56.251+0000 7f09b8c0a740 20 client.25039 populate_metadata read hostname 'smithi019' 2024-09-10T22:26:56.256 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:56.251+0000 7f09b8c0a740 1 --2- 172.21.15.19:0/4142563706 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x555651be2f80 0x555651be53a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:26:56.256 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:56.251+0000 7f09b8c0a740 4 client.25039 mds_command: new command op to 24581 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-10T22:26:56.256 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:56.251+0000 7f09b8c0a740 1 -- 172.21.15.19:0/4142563706 --> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] -- command(tid 0: {"prefix": "flush journal"}) -- 0x555651ad00f0 con 0x555651be2f80 2024-09-10T22:26:56.256 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:56.251+0000 7f09af7fe640 1 --2- 172.21.15.19:0/4142563706 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x555651be2f80 0x555651be53a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:26:56.256 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:56.252+0000 7f098effd640 10 client.25039 ms_handle_connect on v2:172.21.15.135:6838/1254769802 2024-09-10T22:26:56.256 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:56.252+0000 7f09af7fe640 1 --2- 172.21.15.19:0/4142563706 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x555651be2f80 0x555651be53a0 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c16afdc5a8ccc27a server_cookie=b049e8bc47787e02 in_seq=0 out_seq=0 2024-09-10T22:26:56.261 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:56.260+0000 7f098effd640 1 -- 172.21.15.19:0/4142563706 <== mds.0 v2:172.21.15.135:6838/1254769802 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x555651ad00f0 con 0x555651be2f80 2024-09-10T22:26:56.261 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:56.260+0000 7f098effd640 10 client.25039 handle_command_reply: tid=0 2024-09-10T22:26:56.261 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:56.260+0000 7f09b8c0a740 1 client.25039 shutdown 2024-09-10T22:26:56.262 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:56.260+0000 7f09b8c0a740 1 -- 172.21.15.19:0/4142563706 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x555651b631b0 msgr2=0x555651b70520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:26:56.262 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:56.260+0000 7f09b8c0a740 1 --2- 172.21.15.19:0/4142563706 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x555651b631b0 0x555651b70520 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f0998010eb0 tx=0x7f09980046c0 comp rx=0 tx=0).stop 2024-09-10T22:26:56.262 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:56.260+0000 7f09b8c0a740 1 -- 172.21.15.19:0/4142563706 shutdown_connections 2024-09-10T22:26:56.262 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:56.260+0000 7f09b8c0a740 1 --2- 172.21.15.19:0/4142563706 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x555651b65bf0 0x555651b70a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:26:56.262 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:56.260+0000 7f09b8c0a740 1 --2- 172.21.15.19:0/4142563706 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x555651be2f80 0x555651be53a0 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:26:56.262 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:56.260+0000 7f09b8c0a740 1 --2- 172.21.15.19:0/4142563706 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x555651b631b0 0x555651b70520 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:26:56.262 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:56.260+0000 7f09b8c0a740 1 --2- 172.21.15.19:0/4142563706 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555651b60880 0x555651b71820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:26:56.262 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:56.260+0000 7f09b8c0a740 1 -- 172.21.15.19:0/4142563706 >> 172.21.15.19:0/4142563706 conn(0x555651b5b9d0 msgr2=0x555651b5fd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:26:56.262 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:56.260+0000 7f098effd640 0 client.25039 ms_handle_reset on v2:172.21.15.135:6838/1254769802 2024-09-10T22:26:56.262 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:56.260+0000 7f09b8c0a740 1 -- 172.21.15.19:0/4142563706 shutdown_connections 2024-09-10T22:26:56.262 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:56.260+0000 7f09b8c0a740 1 -- 172.21.15.19:0/4142563706 wait complete. 2024-09-10T22:26:56.262 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:56.260+0000 7f09b8c0a740 20 client.25039 trim_cache size 0 max 16384 2024-09-10T22:26:56.263 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stdout:{ 2024-09-10T22:26:56.263 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stdout: "message": "", 2024-09-10T22:26:56.263 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stdout: "return_code": 0 2024-09-10T22:26:56.263 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stdout:} 2024-09-10T22:26:56.264 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:56.261+0000 7f09b5d5d640 1 -- 172.21.15.19:0/3909277109 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f099c0b5360 msgr2=0x7f099c0b7820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:26:56.264 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:56.261+0000 7f09b5d5d640 1 --2- 172.21.15.19:0/3909277109 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f099c0b5360 0x7f099c0b7820 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f0998010620 tx=0x7f099800a2d0 comp rx=0 tx=0).stop 2024-09-10T22:26:56.264 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:56.261+0000 7f09b5d5d640 1 -- 172.21.15.19:0/3909277109 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f09b0101870 msgr2=0x7f09b0198b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:26:56.264 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:56.261+0000 7f09b5d5d640 1 --2- 172.21.15.19:0/3909277109 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f09b0101870 0x7f09b0198b30 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f09a0032fd0 tx=0x7f09a0004430 comp rx=0 tx=0).stop 2024-09-10T22:26:56.264 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:56.261+0000 7f09b5d5d640 1 -- 172.21.15.19:0/3909277109 shutdown_connections 2024-09-10T22:26:56.264 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:56.261+0000 7f09b5d5d640 1 --2- 172.21.15.19:0/3909277109 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f099c0b5360 0x7f099c0b7820 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:26:56.264 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:56.261+0000 7f09b5d5d640 1 --2- 172.21.15.19:0/3909277109 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f09b0103380 0x7f09b0199db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:26:56.264 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:56.261+0000 7f09b5d5d640 1 --2- 172.21.15.19:0/3909277109 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f09b01029c0 0x7f09b0199180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:26:56.265 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:56.261+0000 7f09b5d5d640 1 --2- 172.21.15.19:0/3909277109 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f09b0101870 0x7f09b0198b30 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:26:56.265 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:56.261+0000 7f09b5d5d640 1 -- 172.21.15.19:0/3909277109 >> 172.21.15.19:0/3909277109 conn(0x7f09b00fd130 msgr2=0x7f09b0105ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:26:56.265 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:56.261+0000 7f09b5d5d640 1 -- 172.21.15.19:0/3909277109 shutdown_connections 2024-09-10T22:26:56.265 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:26:56.261+0000 7f09b5d5d640 1 -- 172.21.15.19:0/3909277109 wait complete. 2024-09-10T22:26:56.798 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 22997a4c-6fc2-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-10T22:26:57.197 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/22997a4c-6fc2-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T22:26:57.661 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:26:57 smithi019 ceph-mon[31375]: pgmap v363: 97 pgs: 97 active+clean; 664 KiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 1.2 KiB/s wr, 8 op/s 2024-09-10T22:26:57.791 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:57.789+0000 7f0dbbc51640 1 -- 172.21.15.19:0/3891110931 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0db410d100 msgr2=0x7f0db410f560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:26:57.791 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:57.789+0000 7f0dbbc51640 1 --2- 172.21.15.19:0/3891110931 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0db410d100 0x7f0db410f560 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f0dac009ca0 tx=0x7f0dac02a8c0 comp rx=0 tx=0).stop 2024-09-10T22:26:57.791 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:57.789+0000 7f0dbbc51640 1 -- 172.21.15.19:0/3891110931 shutdown_connections 2024-09-10T22:26:57.791 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:57.789+0000 7f0dbbc51640 1 --2- 172.21.15.19:0/3891110931 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0db410d100 0x7f0db410f560 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:26:57.791 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:57.789+0000 7f0dbbc51640 1 --2- 172.21.15.19:0/3891110931 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f0db41045c0 0x7f0db410cab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:26:57.792 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:57.789+0000 7f0dbbc51640 1 --2- 172.21.15.19:0/3891110931 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0db4103ca0 0x7f0db4104080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:26:57.792 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:57.789+0000 7f0dbbc51640 1 -- 172.21.15.19:0/3891110931 >> 172.21.15.19:0/3891110931 conn(0x7f0db40fd700 msgr2=0x7f0db40ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:26:57.792 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:57.789+0000 7f0dbbc51640 1 -- 172.21.15.19:0/3891110931 shutdown_connections 2024-09-10T22:26:57.792 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:57.789+0000 7f0dbbc51640 1 -- 172.21.15.19:0/3891110931 wait complete. 2024-09-10T22:26:57.792 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:57.790+0000 7f0dbbc51640 1 Processor -- start 2024-09-10T22:26:57.792 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:57.790+0000 7f0dbbc51640 1 -- start start 2024-09-10T22:26:57.794 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:57.790+0000 7f0dbbc51640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0db4103ca0 0x7f0db4199220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:26:57.794 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:57.790+0000 7f0dbbc51640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f0db41045c0 0x7f0db4199760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:26:57.794 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:57.790+0000 7f0dbbc51640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0db410d100 0x7f0db419eb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:26:57.794 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:57.790+0000 7f0dbbc51640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f0db4112d70 con 0x7f0db4103ca0 2024-09-10T22:26:57.794 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:57.790+0000 7f0dbbc51640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f0db4112bf0 con 0x7f0db410d100 2024-09-10T22:26:57.794 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:57.790+0000 7f0dbbc51640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f0db4112ef0 con 0x7f0db41045c0 2024-09-10T22:26:57.794 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:57.790+0000 7f0db99ed640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0db4103ca0 0x7f0db4199220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:26:57.794 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:57.790+0000 7f0db99ed640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0db4103ca0 0x7f0db4199220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:32960/0 (socket says 172.21.15.19:32960) 2024-09-10T22:26:57.795 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:57.790+0000 7f0db99ed640 1 -- 172.21.15.19:0/671570106 learned_addr learned my addr 172.21.15.19:0/671570106 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:26:57.795 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:57.791+0000 7f0dba1ee640 1 --2- 172.21.15.19:0/671570106 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0db410d100 0x7f0db419eb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:26:57.795 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:57.791+0000 7f0db91ec640 1 --2- 172.21.15.19:0/671570106 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f0db41045c0 0x7f0db4199760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:26:57.795 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:57.791+0000 7f0db99ed640 1 -- 172.21.15.19:0/671570106 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f0db41045c0 msgr2=0x7f0db4199760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:26:57.795 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:57.791+0000 7f0db99ed640 1 --2- 172.21.15.19:0/671570106 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f0db41045c0 0x7f0db4199760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:26:57.795 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:57.791+0000 7f0db99ed640 1 -- 172.21.15.19:0/671570106 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0db410d100 msgr2=0x7f0db419eb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:26:57.795 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:57.791+0000 7f0db99ed640 1 --2- 172.21.15.19:0/671570106 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0db410d100 0x7f0db419eb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:26:57.795 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:57.791+0000 7f0db99ed640 1 -- 172.21.15.19:0/671570106 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0db419f2d0 con 0x7f0db4103ca0 2024-09-10T22:26:57.795 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:57.791+0000 7f0db91ec640 1 --2- 172.21.15.19:0/671570106 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f0db41045c0 0x7f0db4199760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T22:26:57.795 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:57.791+0000 7f0db99ed640 1 --2- 172.21.15.19:0/671570106 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0db4103ca0 0x7f0db4199220 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f0db000d950 tx=0x7f0db000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:26:57.795 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:57.791+0000 7f0daaffd640 1 -- 172.21.15.19:0/671570106 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0db0017030 con 0x7f0db4103ca0 2024-09-10T22:26:57.795 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:57.791+0000 7f0dbbc51640 1 -- 172.21.15.19:0/671570106 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0db419f5c0 con 0x7f0db4103ca0 2024-09-10T22:26:57.795 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:57.792+0000 7f0dbbc51640 1 -- 172.21.15.19:0/671570106 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0db41a5e50 con 0x7f0db4103ca0 2024-09-10T22:26:57.796 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:57.792+0000 7f0daaffd640 1 -- 172.21.15.19:0/671570106 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0db0004020 con 0x7f0db4103ca0 2024-09-10T22:26:57.796 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:57.792+0000 7f0daaffd640 1 -- 172.21.15.19:0/671570106 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0db00047a0 con 0x7f0db4103ca0 2024-09-10T22:26:57.798 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:57.794+0000 7f0dbe026740 1 Processor -- start 2024-09-10T22:26:57.798 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:57.795+0000 7f0dbe026740 1 -- start start 2024-09-10T22:26:57.798 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:57.795+0000 7f0dbe026740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5598b16aff90 0x5598b16ae500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:26:57.798 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:57.795+0000 7f0dbe026740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5598b16aea40 0x5598b16aee80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:26:57.798 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:57.795+0000 7f0dbe026740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5598b16bf070 0x5598b16c1460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:26:57.798 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:57.795+0000 7f0dbe026740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x5598b1620ea0 con 0x5598b16aea40 2024-09-10T22:26:57.798 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:57.795+0000 7f0dbe026740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x5598b16102d0 con 0x5598b16bf070 2024-09-10T22:26:57.798 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:57.795+0000 7f0dbe026740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x5598b16140e0 con 0x5598b16aff90 2024-09-10T22:26:57.798 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:57.796+0000 7f0dba1ee640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5598b16aff90 0x5598b16ae500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:26:57.798 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:57.796+0000 7f0dba1ee640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5598b16aff90 0x5598b16ae500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.19:60918/0 (socket says 172.21.15.19:60918) 2024-09-10T22:26:57.799 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:57.796+0000 7f0dba1ee640 1 -- 172.21.15.19:0/2756206809 learned_addr learned my addr 172.21.15.19:0/2756206809 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:26:57.799 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:57.796+0000 7f0dba1ee640 1 -- 172.21.15.19:0/2756206809 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5598b16bf070 msgr2=0x5598b16c1460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:26:57.799 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:57.796+0000 7f0dba1ee640 1 --2- 172.21.15.19:0/2756206809 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5598b16bf070 0x5598b16c1460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:26:57.799 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:57.796+0000 7f0dba1ee640 1 -- 172.21.15.19:0/2756206809 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5598b16aea40 msgr2=0x5598b16aee80 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-10T22:26:57.799 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:57.796+0000 7f0dba1ee640 1 --2- 172.21.15.19:0/2756206809 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5598b16aea40 0x5598b16aee80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:26:57.799 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:57.796+0000 7f0dba1ee640 1 -- 172.21.15.19:0/2756206809 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5598b136e650 con 0x5598b16aff90 2024-09-10T22:26:57.799 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:57.796+0000 7f0dba1ee640 1 --2- 172.21.15.19:0/2756206809 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5598b16aff90 0x5598b16ae500 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f0dac009dc0 tx=0x7f0dac005fa0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e9f3f2d275c9aa76 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:26:57.800 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:57.797+0000 7f0d9ffff640 1 -- 172.21.15.19:0/2756206809 <== mon.1 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0dac031cf0 con 0x5598b16aff90 2024-09-10T22:26:57.801 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:57.797+0000 7f0d9ffff640 1 -- 172.21.15.19:0/2756206809 <== mon.1 v2:172.21.15.138:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0dac036070 con 0x5598b16aff90 2024-09-10T22:26:57.801 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:57.797+0000 7f0d9ffff640 1 -- 172.21.15.19:0/2756206809 <== mon.1 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0dac0042a0 con 0x5598b16aff90 2024-09-10T22:26:57.801 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:57.797+0000 7f0daaffd640 1 -- 172.21.15.19:0/671570106 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 18) ==== 153250+0+0 (secure 0 0 0) 0x7f0db00041d0 con 0x7f0db4103ca0 2024-09-10T22:26:57.801 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:57.798+0000 7f0dbe026740 1 -- 172.21.15.19:0/2756206809 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5598b16aff90 msgr2=0x5598b16ae500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:26:57.801 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:57.798+0000 7f0dbe026740 1 --2- 172.21.15.19:0/2756206809 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5598b16aff90 0x5598b16ae500 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f0dac009dc0 tx=0x7f0dac005fa0 comp rx=0 tx=0).stop 2024-09-10T22:26:57.801 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:57.798+0000 7f0dbe026740 1 -- 172.21.15.19:0/2756206809 shutdown_connections 2024-09-10T22:26:57.801 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:57.798+0000 7f0dbe026740 1 --2- 172.21.15.19:0/2756206809 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5598b16bf070 0x5598b16c1460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:26:57.801 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:57.798+0000 7f0dbe026740 1 --2- 172.21.15.19:0/2756206809 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5598b16aea40 0x5598b16aee80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:26:57.801 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:57.798+0000 7f0dbe026740 1 --2- 172.21.15.19:0/2756206809 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5598b16aff90 0x5598b16ae500 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:26:57.801 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:57.798+0000 7f0dbe026740 1 -- 172.21.15.19:0/2756206809 >> 172.21.15.19:0/2756206809 conn(0x5598b16ac270 msgr2=0x5598b16ac650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:26:57.801 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:57.798+0000 7f0dbe026740 1 -- 172.21.15.19:0/2756206809 shutdown_connections 2024-09-10T22:26:57.801 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:57.798+0000 7f0dbe026740 1 -- 172.21.15.19:0/2756206809 wait complete. 2024-09-10T22:26:57.801 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:57.799+0000 7f0dbe026740 1 -- start start 2024-09-10T22:26:57.802 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:57.799+0000 7f0daaffd640 1 --2- 172.21.15.19:0/671570106 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f0da00b5270 0x7f0da00b7730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:26:57.802 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:57.799+0000 7f0dbe026740 1 Processor -- start 2024-09-10T22:26:57.802 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:57.799+0000 7f0dba1ee640 1 --2- 172.21.15.19:0/671570106 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f0da00b5270 0x7f0da00b7730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:26:57.802 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:57.799+0000 7f0daaffd640 1 -- 172.21.15.19:0/671570106 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8327+0+0 (secure 0 0 0) 0x7f0db00e5550 con 0x7f0db4103ca0 2024-09-10T22:26:57.808 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:57.800+0000 7f0dba1ee640 1 --2- 172.21.15.19:0/671570106 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f0da00b5270 0x7f0da00b7730 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f0dac009ca0 tx=0x7f0dac03d040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:26:57.808 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:57.800+0000 7f0dbe026740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5598b16aea40 0x5598b16ab0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:26:57.809 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:57.800+0000 7f0dbe026740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5598b16aff90 0x5598b16a84f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:26:57.809 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:57.800+0000 7f0dbe026740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5598b16bf070 0x5598b16a8a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:26:57.809 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:57.800+0000 7f0dbe026740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x5598b1471700 con 0x5598b16bf070 2024-09-10T22:26:57.809 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:57.800+0000 7f0dbe026740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x5598b15ab160 con 0x5598b16aea40 2024-09-10T22:26:57.809 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:57.801+0000 7f0dbe026740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x5598b16c1dd0 con 0x5598b16aff90 2024-09-10T22:26:57.809 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:57.801+0000 7f0dba1ee640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5598b16bf070 0x5598b16a8a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:26:57.809 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:57.801+0000 7f0dba1ee640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5598b16bf070 0x5598b16a8a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:32964/0 (socket says 172.21.15.19:32964) 2024-09-10T22:26:57.809 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:57.801+0000 7f0dba1ee640 1 -- 172.21.15.19:0/1468392292 learned_addr learned my addr 172.21.15.19:0/1468392292 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:26:57.809 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:57.801+0000 7f0db91ec640 1 --2- 172.21.15.19:0/1468392292 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5598b16aff90 0x5598b16a84f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:26:57.809 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:57.801+0000 7f0db99ed640 1 --2- 172.21.15.19:0/1468392292 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5598b16aea40 0x5598b16ab0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:26:57.809 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:57.801+0000 7f0dba1ee640 1 -- 172.21.15.19:0/1468392292 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5598b16aff90 msgr2=0x5598b16a84f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:26:57.809 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:57.801+0000 7f0dba1ee640 1 --2- 172.21.15.19:0/1468392292 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5598b16aff90 0x5598b16a84f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:26:57.810 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:57.801+0000 7f0dba1ee640 1 -- 172.21.15.19:0/1468392292 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5598b16aea40 msgr2=0x5598b16ab0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:26:57.810 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:57.801+0000 7f0dba1ee640 1 --2- 172.21.15.19:0/1468392292 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5598b16aea40 0x5598b16ab0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:26:57.810 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:57.801+0000 7f0dbe026740 10 client.0 _ll_register_callbacks cb 0x5598b15c49e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T22:26:57.810 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:57.801+0000 7f0dba1ee640 1 -- 172.21.15.19:0/1468392292 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5598b15d8c90 con 0x5598b16bf070 2024-09-10T22:26:57.810 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:57.801+0000 7f0db91ec640 1 --2- 172.21.15.19:0/1468392292 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5598b16aff90 0x5598b16a84f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T22:26:57.810 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:57.801+0000 7f0dbe026740 1 -- 172.21.15.19:0/1468392292 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0dac036070 con 0x5598b16bf070 2024-09-10T22:26:57.810 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:57.801+0000 7f0dba1ee640 1 --2- 172.21.15.19:0/1468392292 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5598b16bf070 0x5598b16a8a70 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f0dac009dc0 tx=0x7f0dac0095c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7ab8d2f80d667c0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:26:57.810 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:57.801+0000 7f0d9d7fa640 10 client.15486 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-10T22:26:57.811 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:57.802+0000 7f0d9d7fa640 1 -- 172.21.15.19:0/1468392292 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0dac049040 con 0x5598b16bf070 2024-09-10T22:26:57.811 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:57.802+0000 7f0d9d7fa640 1 -- 172.21.15.19:0/1468392292 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8327+0+0 (secure 0 0 0) 0x7f0dac02f660 con 0x5598b16bf070 2024-09-10T22:26:57.811 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:57.802+0000 7f0d9d7fa640 1 -- 172.21.15.19:0/1468392292 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f0dac02f860 con 0x5598b16bf070 2024-09-10T22:26:57.811 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:57.802+0000 7f0dbe026740 10 client.15486 fetch_fsmap learned FSMap version 25 2024-09-10T22:26:57.811 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:57.802+0000 7f0dbe026740 1 -- 172.21.15.19:0/1468392292 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({fsmap=25}) -- 0x5598b16cd5b0 con 0x5598b16bf070 2024-09-10T22:26:57.811 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:57.803+0000 7f0d9d7fa640 1 -- 172.21.15.19:0/1468392292 <== mon.0 v2:172.21.15.19:3300/0 4 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f0dac04c030 con 0x5598b16bf070 2024-09-10T22:26:57.811 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:57.803+0000 7f0dbe026740 10 client.15486 fetch_fsmap finished waiting for FSMap version 25 2024-09-10T22:26:57.811 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:57.803+0000 7f0dbe026740 10 client.15486 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-10T22:26:57.811 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:57.803+0000 7f0dbe026740 20 client.15486 populate_metadata read hostname 'smithi019' 2024-09-10T22:26:57.811 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:57.803+0000 7f0dbe026740 1 --2- 172.21.15.19:0/1468392292 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x5598b16cea60 0x5598b16d0ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:26:57.811 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:57.803+0000 7f0dbe026740 4 client.15486 mds_command: new command op to 24581 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T22:26:57.812 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:57.803+0000 7f0dbe026740 1 -- 172.21.15.19:0/1468392292 --> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5598b1622df0 con 0x5598b16cea60 2024-09-10T22:26:57.812 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:57.803+0000 7f0db99ed640 1 --2- 172.21.15.19:0/1468392292 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x5598b16cea60 0x5598b16d0ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:26:57.812 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:57.804+0000 7f0db99ed640 1 --2- 172.21.15.19:0/1468392292 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x5598b16cea60 0x5598b16d0ee0 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fb59641b6614d668 server_cookie=add787718a9efad1 in_seq=0 out_seq=0 2024-09-10T22:26:57.812 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:57.804+0000 7f0d9d7fa640 10 client.15486 ms_handle_connect on v2:172.21.15.135:6838/1254769802 2024-09-10T22:26:57.812 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:57.804+0000 7f0d9d7fa640 1 -- 172.21.15.19:0/1468392292 <== mds.0 v2:172.21.15.135:6838/1254769802 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5598b1622df0 con 0x5598b16cea60 2024-09-10T22:26:57.812 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:57.805+0000 7f0d9d7fa640 10 client.15486 handle_command_reply: tid=0 2024-09-10T22:26:57.812 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:57.805+0000 7f0dbe026740 1 client.15486 shutdown 2024-09-10T22:26:57.812 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:57.805+0000 7f0dbe026740 1 -- 172.21.15.19:0/1468392292 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5598b16bf070 msgr2=0x5598b16a8a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:26:57.812 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:57.805+0000 7f0dbe026740 1 --2- 172.21.15.19:0/1468392292 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5598b16bf070 0x5598b16a8a70 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f0dac009dc0 tx=0x7f0dac0095c0 comp rx=0 tx=0).stop 2024-09-10T22:26:57.812 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:57.805+0000 7f0dbe026740 1 -- 172.21.15.19:0/1468392292 shutdown_connections 2024-09-10T22:26:57.812 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:57.805+0000 7f0dbe026740 1 --2- 172.21.15.19:0/1468392292 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5598b16bf070 0x5598b16a8a70 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:26:57.812 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:57.805+0000 7f0dbe026740 1 --2- 172.21.15.19:0/1468392292 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x5598b16cea60 0x5598b16d0ee0 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:26:57.813 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:57.805+0000 7f0dbe026740 1 --2- 172.21.15.19:0/1468392292 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5598b16aff90 0x5598b16a84f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:26:57.813 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:57.805+0000 7f0dbe026740 1 --2- 172.21.15.19:0/1468392292 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5598b16aea40 0x5598b16ab0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:26:57.813 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:57.805+0000 7f0dbe026740 1 -- 172.21.15.19:0/1468392292 >> 172.21.15.19:0/1468392292 conn(0x5598b16ac270 msgr2=0x5598b16b1ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:26:57.813 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:57.805+0000 7f0d9d7fa640 0 client.15486 ms_handle_reset on v2:172.21.15.135:6838/1254769802 2024-09-10T22:26:57.813 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:57.806+0000 7f0dbe026740 1 -- 172.21.15.19:0/1468392292 shutdown_connections 2024-09-10T22:26:57.813 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:57.806+0000 7f0dbe026740 1 -- 172.21.15.19:0/1468392292 wait complete. 2024-09-10T22:26:57.813 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:57.806+0000 7f0dbe026740 20 client.15486 trim_cache size 0 max 16384 2024-09-10T22:26:57.821 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:57.819+0000 7f0dbe026740 1 Processor -- start 2024-09-10T22:26:57.821 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:57.819+0000 7f0dbe026740 1 -- start start 2024-09-10T22:26:57.821 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:57.820+0000 7f0dbe026740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5598b16aea40 0x5598b16bb760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:26:57.821 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:57.820+0000 7f0dbe026740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5598b16aff90 0x5598b16be060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:26:57.821 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:57.820+0000 7f0dbe026740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5598b16bf070 0x5598b16be5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:26:57.822 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:57.820+0000 7f0dbe026740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f0d98010e50 con 0x5598b16aea40 2024-09-10T22:26:57.822 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:57.820+0000 7f0dbe026740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f0d9800e720 con 0x5598b16aff90 2024-09-10T22:26:57.822 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:57.820+0000 7f0dbe026740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f0d9800c570 con 0x5598b16bf070 2024-09-10T22:26:57.822 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:57.820+0000 7f0db99ed640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5598b16aea40 0x5598b16bb760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:26:57.822 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:57.820+0000 7f0db99ed640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5598b16aea40 0x5598b16bb760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:32980/0 (socket says 172.21.15.19:32980) 2024-09-10T22:26:57.822 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:57.820+0000 7f0db99ed640 1 -- 172.21.15.19:0/1274971292 learned_addr learned my addr 172.21.15.19:0/1274971292 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:26:57.822 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:57.820+0000 7f0db91ec640 1 --2- 172.21.15.19:0/1274971292 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5598b16aff90 0x5598b16be060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:26:57.822 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:57.820+0000 7f0dba1ee640 1 --2- 172.21.15.19:0/1274971292 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5598b16bf070 0x5598b16be5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:26:57.823 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:57.820+0000 7f0db99ed640 1 -- 172.21.15.19:0/1274971292 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5598b16bf070 msgr2=0x5598b16be5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:26:57.823 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:57.820+0000 7f0db99ed640 1 --2- 172.21.15.19:0/1274971292 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5598b16bf070 0x5598b16be5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:26:57.823 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:57.820+0000 7f0db99ed640 1 -- 172.21.15.19:0/1274971292 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5598b16aff90 msgr2=0x5598b16be060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:26:57.823 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:57.821+0000 7f0db99ed640 1 --2- 172.21.15.19:0/1274971292 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5598b16aff90 0x5598b16be060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:26:57.824 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:57.821+0000 7f0db99ed640 1 -- 172.21.15.19:0/1274971292 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5598b16ab9b0 con 0x5598b16aea40 2024-09-10T22:26:57.824 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:57.821+0000 7f0db91ec640 1 --2- 172.21.15.19:0/1274971292 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5598b16aff90 0x5598b16be060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T22:26:57.824 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:57.821+0000 7f0dba1ee640 1 --2- 172.21.15.19:0/1274971292 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5598b16bf070 0x5598b16be5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T22:26:57.824 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:57.821+0000 7f0db99ed640 1 --2- 172.21.15.19:0/1274971292 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5598b16aea40 0x5598b16bb760 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f0db00a8f20 tx=0x7f0db00e2ec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d95d528b163a6ca1 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:26:57.824 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:57.821+0000 7f0d9f7fe640 1 -- 172.21.15.19:0/1274971292 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0db00ab7c0 con 0x5598b16aea40 2024-09-10T22:26:57.824 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:57.821+0000 7f0d9f7fe640 1 -- 172.21.15.19:0/1274971292 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0db0014040 con 0x5598b16aea40 2024-09-10T22:26:57.824 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:57.821+0000 7f0d9f7fe640 1 -- 172.21.15.19:0/1274971292 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0db00a7f20 con 0x5598b16aea40 2024-09-10T22:26:57.825 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:57.822+0000 7f0dbe026740 1 -- 172.21.15.19:0/1274971292 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5598b16aea40 msgr2=0x5598b16bb760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:26:57.826 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:57.822+0000 7f0dbe026740 1 --2- 172.21.15.19:0/1274971292 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5598b16aea40 0x5598b16bb760 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f0db00a8f20 tx=0x7f0db00e2ec0 comp rx=0 tx=0).stop 2024-09-10T22:26:57.826 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:57.822+0000 7f0dbe026740 1 -- 172.21.15.19:0/1274971292 shutdown_connections 2024-09-10T22:26:57.826 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:57.822+0000 7f0dbe026740 1 --2- 172.21.15.19:0/1274971292 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5598b16bf070 0x5598b16be5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:26:57.826 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:57.822+0000 7f0dbe026740 1 --2- 172.21.15.19:0/1274971292 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5598b16aff90 0x5598b16be060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:26:57.826 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:57.822+0000 7f0dbe026740 1 --2- 172.21.15.19:0/1274971292 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5598b16aea40 0x5598b16bb760 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:26:57.826 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:57.822+0000 7f0dbe026740 1 -- 172.21.15.19:0/1274971292 >> 172.21.15.19:0/1274971292 conn(0x5598b16ac270 msgr2=0x5598b16bb050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:26:57.826 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:57.823+0000 7f0dbe026740 1 -- 172.21.15.19:0/1274971292 shutdown_connections 2024-09-10T22:26:57.826 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:57.823+0000 7f0dbe026740 1 -- 172.21.15.19:0/1274971292 wait complete. 2024-09-10T22:26:57.826 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:57.823+0000 7f0dbe026740 1 -- start start 2024-09-10T22:26:57.826 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:57.823+0000 7f0dbe026740 1 Processor -- start 2024-09-10T22:26:57.826 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:57.824+0000 7f0dbe026740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5598b16aea40 0x5598b16d2a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:26:57.826 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:57.824+0000 7f0dbe026740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5598b16aff90 0x5598b16d2fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:26:57.826 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:57.824+0000 7f0dbe026740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5598b16bf070 0x5598b173a960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:26:57.827 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:57.824+0000 7f0dbe026740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f0d9800cbe0 con 0x5598b16bf070 2024-09-10T22:26:57.827 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:57.824+0000 7f0dbe026740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f0d9800e050 con 0x5598b16aff90 2024-09-10T22:26:57.827 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:57.824+0000 7f0dbe026740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f0d9800d2b0 con 0x5598b16aea40 2024-09-10T22:26:57.827 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:57.824+0000 7f0db91ec640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5598b16aff90 0x5598b16d2fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:26:57.827 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:57.824+0000 7f0dba1ee640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5598b16bf070 0x5598b173a960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:26:57.827 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:57.824+0000 7f0db91ec640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5598b16aff90 0x5598b16d2fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.19:59888/0 (socket says 172.21.15.19:59888) 2024-09-10T22:26:57.827 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:57.824+0000 7f0db91ec640 1 -- 172.21.15.19:0/2272485680 learned_addr learned my addr 172.21.15.19:0/2272485680 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:26:57.827 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:57.824+0000 7f0dbe026740 10 client.0 _ll_register_callbacks cb 0x7f0dac005ef0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T22:26:57.827 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:57.824+0000 7f0db99ed640 1 --2- 172.21.15.19:0/2272485680 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5598b16aea40 0x5598b16d2a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:26:57.830 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:57.825+0000 7f0db91ec640 1 -- 172.21.15.19:0/2272485680 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5598b16aea40 msgr2=0x5598b16d2a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:26:57.830 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:57.825+0000 7f0db91ec640 1 --2- 172.21.15.19:0/2272485680 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5598b16aea40 0x5598b16d2a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:26:57.830 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:57.825+0000 7f0db91ec640 1 -- 172.21.15.19:0/2272485680 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5598b16bf070 msgr2=0x5598b173a960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:26:57.830 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:57.825+0000 7f0db91ec640 1 --2- 172.21.15.19:0/2272485680 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5598b16bf070 0x5598b173a960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:26:57.830 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:57.825+0000 7f0db91ec640 1 -- 172.21.15.19:0/2272485680 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5598b173aea0 con 0x5598b16aff90 2024-09-10T22:26:57.830 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:57.825+0000 7f0dba1ee640 1 --2- 172.21.15.19:0/2272485680 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5598b16bf070 0x5598b173a960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T22:26:57.831 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:57.825+0000 7f0db91ec640 1 --2- 172.21.15.19:0/2272485680 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5598b16aff90 0x5598b16d2fa0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f0da40134b0 tx=0x7f0da4013970 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d140039cbe5dc983 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:26:57.831 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:57.825+0000 7f0d9d7fa640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-09-10T22:26:57.831 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:57.825+0000 7f0d9d7fa640 1 -- 172.21.15.19:0/2272485680 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0da4005220 con 0x5598b16aff90 2024-09-10T22:26:57.831 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:57.825+0000 7f0dbe026740 1 -- 172.21.15.19:0/2272485680 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0db0014040 con 0x5598b16aff90 2024-09-10T22:26:57.831 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:57.825+0000 7f0d9d7fa640 1 -- 172.21.15.19:0/2272485680 <== mon.2 v2:172.21.15.135:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8327+0+0 (secure 0 0 0) 0x7f0da40053c0 con 0x5598b16aff90 2024-09-10T22:26:57.831 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:57.825+0000 7f0d9d7fa640 1 -- 172.21.15.19:0/2272485680 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f0da40055c0 con 0x5598b16aff90 2024-09-10T22:26:57.831 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:57.825+0000 7f0dbe026740 10 client.25091 fetch_fsmap learned FSMap version 25 2024-09-10T22:26:57.831 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:57.825+0000 7f0dbe026740 1 -- 172.21.15.19:0/2272485680 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x5598b173c0f0 con 0x5598b16aff90 2024-09-10T22:26:57.831 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:57.826+0000 7f0d9d7fa640 1 -- 172.21.15.19:0/2272485680 <== mon.2 v2:172.21.15.135:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0db0014040 con 0x5598b16aff90 2024-09-10T22:26:57.831 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:57.826+0000 7f0d9d7fa640 1 -- 172.21.15.19:0/2272485680 <== mon.2 v2:172.21.15.135:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f0da4025050 con 0x5598b16aff90 2024-09-10T22:26:57.831 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:57.826+0000 7f0dbe026740 10 client.25091 fetch_fsmap finished waiting for FSMap version 25 2024-09-10T22:26:57.831 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:57.826+0000 7f0dbe026740 10 client.25091 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-10T22:26:57.832 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:57.826+0000 7f0dbe026740 20 client.25091 populate_metadata read hostname 'smithi019' 2024-09-10T22:26:57.832 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:57.826+0000 7f0dbe026740 1 --2- 172.21.15.19:0/2272485680 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x5598b173c880 0x5598b173eca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:26:57.832 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:57.826+0000 7f0dbe026740 4 client.25091 mds_command: new command op to 24581 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-10T22:26:57.832 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:57.826+0000 7f0dbe026740 1 -- 172.21.15.19:0/2272485680 --> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5598b161e8a0 con 0x5598b173c880 2024-09-10T22:26:57.832 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:57.826+0000 7f0db99ed640 1 --2- 172.21.15.19:0/2272485680 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x5598b173c880 0x5598b173eca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:26:57.832 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:57.826+0000 7f0d9d7fa640 10 client.25091 ms_handle_connect on v2:172.21.15.135:6838/1254769802 2024-09-10T22:26:57.832 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:57.826+0000 7f0db99ed640 1 --2- 172.21.15.19:0/2272485680 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x5598b173c880 0x5598b173eca0 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=dcc1a2e8665983a3 server_cookie=d30e5f0fdcd0139b in_seq=0 out_seq=0 2024-09-10T22:26:57.832 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:57.827+0000 7f0d9d7fa640 1 -- 172.21.15.19:0/2272485680 <== mds.0 v2:172.21.15.135:6838/1254769802 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5598b161e8a0 con 0x5598b173c880 2024-09-10T22:26:57.832 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:57.827+0000 7f0d9d7fa640 10 client.25091 handle_command_reply: tid=0 2024-09-10T22:26:57.832 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:57.827+0000 7f0dbe026740 1 client.25091 shutdown 2024-09-10T22:26:57.832 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:57.827+0000 7f0dbe026740 1 -- 172.21.15.19:0/2272485680 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5598b16aff90 msgr2=0x5598b16d2fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:26:57.832 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:57.827+0000 7f0dbe026740 1 --2- 172.21.15.19:0/2272485680 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5598b16aff90 0x5598b16d2fa0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f0da40134b0 tx=0x7f0da4013970 comp rx=0 tx=0).stop 2024-09-10T22:26:57.833 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:57.827+0000 7f0dbe026740 1 -- 172.21.15.19:0/2272485680 shutdown_connections 2024-09-10T22:26:57.833 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:57.827+0000 7f0dbe026740 1 --2- 172.21.15.19:0/2272485680 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5598b16bf070 0x5598b173a960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:26:57.833 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:57.827+0000 7f0dbe026740 1 --2- 172.21.15.19:0/2272485680 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5598b16aff90 0x5598b16d2fa0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:26:57.833 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:57.827+0000 7f0dbe026740 1 --2- 172.21.15.19:0/2272485680 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x5598b173c880 0x5598b173eca0 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:26:57.833 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:57.827+0000 7f0d9d7fa640 0 client.25091 ms_handle_reset on v2:172.21.15.135:6838/1254769802 2024-09-10T22:26:57.833 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:57.827+0000 7f0dbe026740 1 --2- 172.21.15.19:0/2272485680 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5598b16aea40 0x5598b16d2a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:26:57.833 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:57.827+0000 7f0dbe026740 1 -- 172.21.15.19:0/2272485680 >> 172.21.15.19:0/2272485680 conn(0x5598b16ac270 msgr2=0x5598b16a9b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:26:57.833 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:57.827+0000 7f0dbe026740 1 -- 172.21.15.19:0/2272485680 shutdown_connections 2024-09-10T22:26:57.833 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:57.827+0000 7f0dbe026740 1 -- 172.21.15.19:0/2272485680 wait complete. 2024-09-10T22:26:57.833 INFO:teuthology.orchestra.run.smithi019.stdout:[] 2024-09-10T22:26:57.834 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:57.827+0000 7f0dbe026740 20 client.25091 trim_cache size 0 max 16384 2024-09-10T22:26:57.834 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:57.828+0000 7f0dbbc51640 1 -- 172.21.15.19:0/671570106 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f0da00b5270 msgr2=0x7f0da00b7730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:26:57.834 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:57.828+0000 7f0dbbc51640 1 --2- 172.21.15.19:0/671570106 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f0da00b5270 0x7f0da00b7730 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f0dac009ca0 tx=0x7f0dac03d040 comp rx=0 tx=0).stop 2024-09-10T22:26:57.835 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:57.828+0000 7f0dbbc51640 1 -- 172.21.15.19:0/671570106 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0db4103ca0 msgr2=0x7f0db4199220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:26:57.835 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:57.828+0000 7f0dbbc51640 1 --2- 172.21.15.19:0/671570106 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0db4103ca0 0x7f0db4199220 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f0db000d950 tx=0x7f0db000de10 comp rx=0 tx=0).stop 2024-09-10T22:26:57.835 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:57.828+0000 7f0dbbc51640 1 -- 172.21.15.19:0/671570106 shutdown_connections 2024-09-10T22:26:57.835 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:57.828+0000 7f0dbbc51640 1 --2- 172.21.15.19:0/671570106 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f0da00b5270 0x7f0da00b7730 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:26:57.835 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:57.828+0000 7f0dbbc51640 1 --2- 172.21.15.19:0/671570106 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0db410d100 0x7f0db419eb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:26:57.835 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:57.828+0000 7f0dbbc51640 1 --2- 172.21.15.19:0/671570106 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f0db41045c0 0x7f0db4199760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:26:57.835 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:57.828+0000 7f0dbbc51640 1 --2- 172.21.15.19:0/671570106 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0db4103ca0 0x7f0db4199220 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:26:57.835 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:57.828+0000 7f0dbbc51640 1 -- 172.21.15.19:0/671570106 >> 172.21.15.19:0/671570106 conn(0x7f0db40fd700 msgr2=0x7f0db40fe300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:26:57.835 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:57.829+0000 7f0dbbc51640 1 -- 172.21.15.19:0/671570106 shutdown_connections 2024-09-10T22:26:57.835 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:26:57.829+0000 7f0dbbc51640 1 -- 172.21.15.19:0/671570106 wait complete. 2024-09-10T22:26:57.859 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:26:57 smithi135 ceph-mon[34789]: pgmap v363: 97 pgs: 97 active+clean; 664 KiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 1.2 KiB/s wr, 8 op/s 2024-09-10T22:26:57.874 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:26:57 smithi138 ceph-mon[35236]: pgmap v363: 97 pgs: 97 active+clean; 664 KiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 1.2 KiB/s wr, 8 op/s 2024-09-10T22:26:59.413 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-10T22:26:59.414 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 22997a4c-6fc2-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-10T22:26:59.708 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:26:59 smithi019 ceph-mon[31375]: pgmap v364: 97 pgs: 97 active+clean; 664 KiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 938 B/s wr, 5 op/s 2024-09-10T22:26:59.779 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/22997a4c-6fc2-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T22:26:59.859 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:26:59 smithi135 ceph-mon[34789]: pgmap v364: 97 pgs: 97 active+clean; 664 KiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 938 B/s wr, 5 op/s 2024-09-10T22:26:59.875 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:26:59 smithi138 ceph-mon[35236]: pgmap v364: 97 pgs: 97 active+clean; 664 KiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 938 B/s wr, 5 op/s 2024-09-10T22:27:00.283 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:00.279+0000 7f01e9bb6640 1 -- 172.21.15.19:0/3741062090 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f01e410f3e0 msgr2=0x7f01e41117d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:27:00.284 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:00.279+0000 7f01e9bb6640 1 --2- 172.21.15.19:0/3741062090 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f01e410f3e0 0x7f01e41117d0 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f01dc009ca0 tx=0x7f01dc02a950 comp rx=0 tx=0).stop 2024-09-10T22:27:00.284 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:00.280+0000 7f01e9bb6640 1 -- 172.21.15.19:0/3741062090 shutdown_connections 2024-09-10T22:27:00.284 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:00.280+0000 7f01e9bb6640 1 --2- 172.21.15.19:0/3741062090 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f01e410f3e0 0x7f01e41117d0 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:27:00.284 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:00.280+0000 7f01e9bb6640 1 --2- 172.21.15.19:0/3741062090 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f01e4102150 0x7f01e410eea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:27:00.284 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:00.280+0000 7f01e9bb6640 1 --2- 172.21.15.19:0/3741062090 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f01e4101830 0x7f01e4101c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:27:00.284 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:00.280+0000 7f01e9bb6640 1 -- 172.21.15.19:0/3741062090 >> 172.21.15.19:0/3741062090 conn(0x7f01e40fd700 msgr2=0x7f01e40ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:27:00.284 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:00.280+0000 7f01e9bb6640 1 -- 172.21.15.19:0/3741062090 shutdown_connections 2024-09-10T22:27:00.284 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:00.280+0000 7f01e9bb6640 1 -- 172.21.15.19:0/3741062090 wait complete. 2024-09-10T22:27:00.284 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:00.280+0000 7f01e9bb6640 1 Processor -- start 2024-09-10T22:27:00.284 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:00.281+0000 7f01e9bb6640 1 -- start start 2024-09-10T22:27:00.285 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:00.281+0000 7f01e9bb6640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f01e4101830 0x7f01e419b440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:27:00.285 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:00.281+0000 7f01e9bb6640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f01e4102150 0x7f01e419b980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:27:00.285 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:00.281+0000 7f01e9bb6640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f01e410f3e0 0x7f01e41a0d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:27:00.285 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:00.281+0000 7f01e9bb6640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f01e4114f20 con 0x7f01e410f3e0 2024-09-10T22:27:00.285 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:00.281+0000 7f01e9bb6640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f01e4114da0 con 0x7f01e4102150 2024-09-10T22:27:00.285 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:00.281+0000 7f01e9bb6640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f01e41150a0 con 0x7f01e4101830 2024-09-10T22:27:00.285 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:00.281+0000 7f01e3fff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f01e410f3e0 0x7f01e41a0d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:27:00.285 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:00.281+0000 7f01e3fff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f01e410f3e0 0x7f01e41a0d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:33008/0 (socket says 172.21.15.19:33008) 2024-09-10T22:27:00.285 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:00.281+0000 7f01e3fff640 1 -- 172.21.15.19:0/1471428783 learned_addr learned my addr 172.21.15.19:0/1471428783 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:27:00.285 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:00.281+0000 7f01e2ffd640 1 --2- 172.21.15.19:0/1471428783 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f01e4102150 0x7f01e419b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:27:00.285 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:00.281+0000 7f01e37fe640 1 --2- 172.21.15.19:0/1471428783 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f01e4101830 0x7f01e419b440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:27:00.285 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:00.282+0000 7f01e37fe640 1 -- 172.21.15.19:0/1471428783 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f01e4102150 msgr2=0x7f01e419b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:27:00.285 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:00.282+0000 7f01e37fe640 1 --2- 172.21.15.19:0/1471428783 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f01e4102150 0x7f01e419b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:27:00.286 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:00.282+0000 7f01e37fe640 1 -- 172.21.15.19:0/1471428783 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f01e410f3e0 msgr2=0x7f01e41a0d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:27:00.286 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:00.282+0000 7f01e37fe640 1 --2- 172.21.15.19:0/1471428783 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f01e410f3e0 0x7f01e41a0d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:27:00.286 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:00.282+0000 7f01e37fe640 1 -- 172.21.15.19:0/1471428783 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f01e41a14f0 con 0x7f01e4101830 2024-09-10T22:27:00.286 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:00.282+0000 7f01e3fff640 1 --2- 172.21.15.19:0/1471428783 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f01e410f3e0 0x7f01e41a0d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T22:27:00.286 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:00.282+0000 7f01e37fe640 1 --2- 172.21.15.19:0/1471428783 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f01e4101830 0x7f01e419b440 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f01d400e9f0 tx=0x7f01d400eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:27:00.286 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:00.283+0000 7f01e0ff9640 1 -- 172.21.15.19:0/1471428783 <== mon.1 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01d400ccc0 con 0x7f01e4101830 2024-09-10T22:27:00.286 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:00.283+0000 7f01e9bb6640 1 -- 172.21.15.19:0/1471428783 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f01e41a17e0 con 0x7f01e4101830 2024-09-10T22:27:00.287 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:00.283+0000 7f01e0ff9640 1 -- 172.21.15.19:0/1471428783 <== mon.1 v2:172.21.15.138:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f01d40108e0 con 0x7f01e4101830 2024-09-10T22:27:00.287 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:00.283+0000 7f01e0ff9640 1 -- 172.21.15.19:0/1471428783 <== mon.1 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01d4018880 con 0x7f01e4101830 2024-09-10T22:27:00.287 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:00.283+0000 7f01e9bb6640 1 -- 172.21.15.19:0/1471428783 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f01e41a7ea0 con 0x7f01e4101830 2024-09-10T22:27:00.287 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:00.286+0000 7f01ebf8b740 1 Processor -- start 2024-09-10T22:27:00.287 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:00.286+0000 7f01ebf8b740 1 -- start start 2024-09-10T22:27:00.288 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:00.286+0000 7f01ebf8b740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5622f9c2cee0 0x5622f9c2d2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:27:00.288 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:00.286+0000 7f01ebf8b740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5622f9c2d800 0x5622f9c39250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:27:00.288 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:00.286+0000 7f01ebf8b740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5622f9c39790 0x5622f9c3bb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:27:00.288 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:00.286+0000 7f01ebf8b740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x5622f9ba3e60 con 0x5622f9c2d800 2024-09-10T22:27:00.288 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:00.286+0000 7f01ebf8b740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x5622f9b93290 con 0x5622f9c39790 2024-09-10T22:27:00.288 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:00.286+0000 7f01ebf8b740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x5622f9b970a0 con 0x5622f9c2cee0 2024-09-10T22:27:00.288 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:00.286+0000 7f01e3fff640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5622f9c2cee0 0x5622f9c2d2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:27:00.288 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:00.286+0000 7f01e3fff640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5622f9c2cee0 0x5622f9c2d2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.19:60982/0 (socket says 172.21.15.19:60982) 2024-09-10T22:27:00.288 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:00.286+0000 7f01e3fff640 1 -- 172.21.15.19:0/1673132364 learned_addr learned my addr 172.21.15.19:0/1673132364 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:27:00.288 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:00.286+0000 7f01e2ffd640 1 --2- 172.21.15.19:0/1673132364 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5622f9c39790 0x5622f9c3bb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:27:00.290 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:00.287+0000 7f01e2ffd640 1 -- 172.21.15.19:0/1673132364 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5622f9c2cee0 msgr2=0x5622f9c2d2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:27:00.291 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:00.287+0000 7f01e2ffd640 1 --2- 172.21.15.19:0/1673132364 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5622f9c2cee0 0x5622f9c2d2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:27:00.291 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:00.287+0000 7f01e2ffd640 1 -- 172.21.15.19:0/1673132364 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5622f9c2d800 msgr2=0x5622f9c39250 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-10T22:27:00.291 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:00.287+0000 7f01e2ffd640 1 --2- 172.21.15.19:0/1673132364 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5622f9c2d800 0x5622f9c39250 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:27:00.291 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:00.287+0000 7f01e2ffd640 1 -- 172.21.15.19:0/1673132364 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5622f98f1930 con 0x5622f9c39790 2024-09-10T22:27:00.291 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:00.287+0000 7f01e0ff9640 1 -- 172.21.15.19:0/1471428783 <== mon.1 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 18) ==== 153250+0+0 (secure 0 0 0) 0x7f01d4010430 con 0x7f01e4101830 2024-09-10T22:27:00.291 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:00.287+0000 7f01e2ffd640 1 --2- 172.21.15.19:0/1673132364 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5622f9c39790 0x5622f9c3bb80 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f01d8009bf0 tx=0x7f01d8011810 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d09158abaa66ca80 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:27:00.291 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:00.287+0000 7f01c9ffb640 1 -- 172.21.15.19:0/1673132364 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01d8004050 con 0x5622f9c39790 2024-09-10T22:27:00.291 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:00.287+0000 7f01c9ffb640 1 -- 172.21.15.19:0/1673132364 <== mon.2 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f01d80054d0 con 0x5622f9c39790 2024-09-10T22:27:00.291 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:00.287+0000 7f01c9ffb640 1 -- 172.21.15.19:0/1673132364 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01d8004d90 con 0x5622f9c39790 2024-09-10T22:27:00.291 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:00.288+0000 7f01e0ff9640 1 --2- 172.21.15.19:0/1471428783 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f01cc0b52e0 0x7f01cc0b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:27:00.291 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:00.288+0000 7f01ebf8b740 1 -- 172.21.15.19:0/1673132364 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5622f9c39790 msgr2=0x5622f9c3bb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:27:00.291 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:00.288+0000 7f01ebf8b740 1 --2- 172.21.15.19:0/1673132364 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5622f9c39790 0x5622f9c3bb80 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f01d8009bf0 tx=0x7f01d8011810 comp rx=0 tx=0).stop 2024-09-10T22:27:00.292 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:00.288+0000 7f01e3fff640 1 --2- 172.21.15.19:0/1471428783 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f01cc0b52e0 0x7f01cc0b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:27:00.292 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:00.288+0000 7f01e0ff9640 1 -- 172.21.15.19:0/1471428783 <== mon.1 v2:172.21.15.138:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8327+0+0 (secure 0 0 0) 0x7f01d40e5f50 con 0x7f01e4101830 2024-09-10T22:27:00.292 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:00.288+0000 7f01ebf8b740 1 -- 172.21.15.19:0/1673132364 shutdown_connections 2024-09-10T22:27:00.292 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:00.288+0000 7f01ebf8b740 1 --2- 172.21.15.19:0/1673132364 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5622f9c39790 0x5622f9c3bb80 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:27:00.292 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:00.288+0000 7f01ebf8b740 1 --2- 172.21.15.19:0/1673132364 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5622f9c2d800 0x5622f9c39250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:27:00.292 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:00.288+0000 7f01ebf8b740 1 --2- 172.21.15.19:0/1673132364 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5622f9c2cee0 0x5622f9c2d2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:27:00.292 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:00.289+0000 7f01ebf8b740 1 -- 172.21.15.19:0/1673132364 >> 172.21.15.19:0/1673132364 conn(0x5622f9c2ad10 msgr2=0x5622f9c2beb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:27:00.292 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:00.289+0000 7f01ebf8b740 1 -- 172.21.15.19:0/1673132364 shutdown_connections 2024-09-10T22:27:00.292 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:00.289+0000 7f01ebf8b740 1 -- 172.21.15.19:0/1673132364 wait complete. 2024-09-10T22:27:00.293 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:00.289+0000 7f01e3fff640 1 --2- 172.21.15.19:0/1471428783 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f01cc0b52e0 0x7f01cc0b77a0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f01dc02fcc0 tx=0x7f01dc009860 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:27:00.293 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:00.289+0000 7f01ebf8b740 1 -- start start 2024-09-10T22:27:00.293 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:00.289+0000 7f01ebf8b740 1 Processor -- start 2024-09-10T22:27:00.296 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:00.290+0000 7f01ebf8b740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5622f9c2cee0 0x5622f9c366f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:27:00.296 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:00.290+0000 7f01ebf8b740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5622f9c2d800 0x5622f9c36c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:27:00.296 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:00.290+0000 7f01ebf8b740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5622f9c39790 0x5622f9c37170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:27:00.296 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:00.290+0000 7f01ebf8b740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x5622f99f4890 con 0x5622f9c2cee0 2024-09-10T22:27:00.296 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:00.290+0000 7f01ebf8b740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x5622f9b2dd40 con 0x5622f9c2d800 2024-09-10T22:27:00.296 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:00.290+0000 7f01ebf8b740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x5622f9c44c50 con 0x5622f9c39790 2024-09-10T22:27:00.297 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:00.290+0000 7f01ebf8b740 10 client.0 _ll_register_callbacks cb 0x5622f9b91c80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T22:27:00.297 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:00.290+0000 7f01e37fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5622f9c2cee0 0x5622f9c366f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:27:00.297 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:00.290+0000 7f01e37fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5622f9c2cee0 0x5622f9c366f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:33016/0 (socket says 172.21.15.19:33016) 2024-09-10T22:27:00.297 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:00.290+0000 7f01e37fe640 1 -- 172.21.15.19:0/3668635751 learned_addr learned my addr 172.21.15.19:0/3668635751 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:27:00.297 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:00.290+0000 7f01e2ffd640 1 --2- 172.21.15.19:0/3668635751 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5622f9c2d800 0x5622f9c36c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:27:00.297 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:00.290+0000 7f01e3fff640 1 --2- 172.21.15.19:0/3668635751 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5622f9c39790 0x5622f9c37170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:27:00.297 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:00.291+0000 7f01e37fe640 1 -- 172.21.15.19:0/3668635751 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5622f9c39790 msgr2=0x5622f9c37170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:27:00.297 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:00.291+0000 7f01e37fe640 1 --2- 172.21.15.19:0/3668635751 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5622f9c39790 0x5622f9c37170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:27:00.297 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:00.291+0000 7f01e37fe640 1 -- 172.21.15.19:0/3668635751 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5622f9c2d800 msgr2=0x5622f9c36c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:27:00.297 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:00.291+0000 7f01e37fe640 1 --2- 172.21.15.19:0/3668635751 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5622f9c2d800 0x5622f9c36c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:27:00.297 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:00.291+0000 7f01e37fe640 1 -- 172.21.15.19:0/3668635751 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5622f9c4e000 con 0x5622f9c2cee0 2024-09-10T22:27:00.298 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:00.291+0000 7f01e37fe640 1 --2- 172.21.15.19:0/3668635751 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5622f9c2cee0 0x5622f9c366f0 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f01d40a99d0 tx=0x7f01d40abed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=29f8cd0b72d8d62d server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:27:00.298 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:00.291+0000 7f01c2ffd640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-10T22:27:00.298 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:00.291+0000 7f01c2ffd640 1 -- 172.21.15.19:0/3668635751 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01d40a6e60 con 0x5622f9c2cee0 2024-09-10T22:27:00.298 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:00.291+0000 7f01c2ffd640 1 -- 172.21.15.19:0/3668635751 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8327+0+0 (secure 0 0 0) 0x7f01d40abbc0 con 0x5622f9c2cee0 2024-09-10T22:27:00.298 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:00.291+0000 7f01ebf8b740 1 -- 172.21.15.19:0/3668635751 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f01d80054d0 con 0x5622f9c2cee0 2024-09-10T22:27:00.298 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:00.291+0000 7f01c2ffd640 1 -- 172.21.15.19:0/3668635751 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f01d40ac760 con 0x5622f9c2cee0 2024-09-10T22:27:00.298 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:00.291+0000 7f01ebf8b740 10 client.15501 fetch_fsmap learned FSMap version 25 2024-09-10T22:27:00.298 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:00.291+0000 7f01ebf8b740 1 -- 172.21.15.19:0/3668635751 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x5622f9c509b0 con 0x5622f9c2cee0 2024-09-10T22:27:00.298 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:00.292+0000 7f01c2ffd640 1 -- 172.21.15.19:0/3668635751 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f01d80054d0 con 0x5622f9c2cee0 2024-09-10T22:27:00.298 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:00.292+0000 7f01c2ffd640 1 -- 172.21.15.19:0/3668635751 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f01d40b2320 con 0x5622f9c2cee0 2024-09-10T22:27:00.299 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:00.292+0000 7f01ebf8b740 10 client.15501 fetch_fsmap finished waiting for FSMap version 25 2024-09-10T22:27:00.299 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:00.292+0000 7f01ebf8b740 10 client.15501 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-10T22:27:00.299 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:00.292+0000 7f01ebf8b740 20 client.15501 populate_metadata read hostname 'smithi019' 2024-09-10T22:27:00.299 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:00.292+0000 7f01ebf8b740 1 --2- 172.21.15.19:0/3668635751 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x5622f9c51e70 0x5622f9c54280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:27:00.299 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:00.292+0000 7f01ebf8b740 4 client.15501 mds_command: new command op to 24581 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T22:27:00.299 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:00.292+0000 7f01ebf8b740 1 -- 172.21.15.19:0/3668635751 --> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5622f9ba5db0 con 0x5622f9c51e70 2024-09-10T22:27:00.299 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:00.292+0000 7f01e2ffd640 1 --2- 172.21.15.19:0/3668635751 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x5622f9c51e70 0x5622f9c54280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:27:00.299 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:00.293+0000 7f01c2ffd640 10 client.15501 ms_handle_connect on v2:172.21.15.135:6838/1254769802 2024-09-10T22:27:00.299 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:00.293+0000 7f01e2ffd640 1 --2- 172.21.15.19:0/3668635751 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x5622f9c51e70 0x5622f9c54280 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=86e18d93e8a7feae server_cookie=468d57a8b8b7df2c in_seq=0 out_seq=0 2024-09-10T22:27:00.299 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:00.293+0000 7f01c2ffd640 1 -- 172.21.15.19:0/3668635751 <== mds.0 v2:172.21.15.135:6838/1254769802 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5622f9ba5db0 con 0x5622f9c51e70 2024-09-10T22:27:00.299 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:00.293+0000 7f01c2ffd640 10 client.15501 handle_command_reply: tid=0 2024-09-10T22:27:00.299 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:00.293+0000 7f01ebf8b740 1 client.15501 shutdown 2024-09-10T22:27:00.299 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:00.294+0000 7f01ebf8b740 1 -- 172.21.15.19:0/3668635751 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5622f9c2cee0 msgr2=0x5622f9c366f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:27:00.300 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:00.294+0000 7f01ebf8b740 1 --2- 172.21.15.19:0/3668635751 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5622f9c2cee0 0x5622f9c366f0 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f01d40a99d0 tx=0x7f01d40abed0 comp rx=0 tx=0).stop 2024-09-10T22:27:00.300 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:00.294+0000 7f01ebf8b740 1 -- 172.21.15.19:0/3668635751 shutdown_connections 2024-09-10T22:27:00.300 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:00.294+0000 7f01ebf8b740 1 --2- 172.21.15.19:0/3668635751 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x5622f9c51e70 0x5622f9c54280 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:27:00.300 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:00.294+0000 7f01ebf8b740 1 --2- 172.21.15.19:0/3668635751 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5622f9c39790 0x5622f9c37170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:27:00.300 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:00.294+0000 7f01c2ffd640 0 client.15501 ms_handle_reset on v2:172.21.15.135:6838/1254769802 2024-09-10T22:27:00.300 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:00.294+0000 7f01ebf8b740 1 --2- 172.21.15.19:0/3668635751 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5622f9c2d800 0x5622f9c36c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:27:00.300 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:00.294+0000 7f01ebf8b740 1 --2- 172.21.15.19:0/3668635751 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5622f9c2cee0 0x5622f9c366f0 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:27:00.300 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:00.294+0000 7f01ebf8b740 1 -- 172.21.15.19:0/3668635751 >> 172.21.15.19:0/3668635751 conn(0x5622f9c2ad10 msgr2=0x5622f9c29f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:27:00.301 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:00.294+0000 7f01ebf8b740 1 -- 172.21.15.19:0/3668635751 shutdown_connections 2024-09-10T22:27:00.301 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:00.294+0000 7f01ebf8b740 1 -- 172.21.15.19:0/3668635751 wait complete. 2024-09-10T22:27:00.301 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:00.294+0000 7f01ebf8b740 20 client.15501 trim_cache size 0 max 16384 2024-09-10T22:27:00.313 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:00.312+0000 7f01ebf8b740 1 Processor -- start 2024-09-10T22:27:00.313 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:00.312+0000 7f01ebf8b740 1 -- start start 2024-09-10T22:27:00.315 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:00.312+0000 7f01ebf8b740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5622f9c2cee0 0x5622f9c34220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:27:00.315 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:00.312+0000 7f01ebf8b740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5622f9c2d800 0x5622f9c59b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:27:00.315 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:00.312+0000 7f01ebf8b740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5622f9c39790 0x5622f9c5a090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:27:00.315 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:00.312+0000 7f01ebf8b740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f01e41aec60 con 0x5622f9c2d800 2024-09-10T22:27:00.315 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:00.312+0000 7f01ebf8b740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f01e41ac530 con 0x5622f9c2cee0 2024-09-10T22:27:00.315 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:00.313+0000 7f01ebf8b740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f01e41aa3a0 con 0x5622f9c39790 2024-09-10T22:27:00.316 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:00.313+0000 7f01e2ffd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5622f9c2d800 0x5622f9c59b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:27:00.316 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:00.313+0000 7f01e2ffd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5622f9c2d800 0x5622f9c59b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:33028/0 (socket says 172.21.15.19:33028) 2024-09-10T22:27:00.316 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:00.313+0000 7f01e2ffd640 1 -- 172.21.15.19:0/824111295 learned_addr learned my addr 172.21.15.19:0/824111295 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:27:00.316 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:00.313+0000 7f01e3fff640 1 --2- 172.21.15.19:0/824111295 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5622f9c39790 0x5622f9c5a090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:27:00.316 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:00.313+0000 7f01e37fe640 1 --2- 172.21.15.19:0/824111295 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5622f9c2cee0 0x5622f9c34220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:27:00.316 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:00.313+0000 7f01e2ffd640 1 -- 172.21.15.19:0/824111295 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5622f9c39790 msgr2=0x5622f9c5a090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:27:00.316 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:00.313+0000 7f01e2ffd640 1 --2- 172.21.15.19:0/824111295 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5622f9c39790 0x5622f9c5a090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:27:00.316 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:00.313+0000 7f01e2ffd640 1 -- 172.21.15.19:0/824111295 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5622f9c2cee0 msgr2=0x5622f9c34220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:27:00.316 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:00.313+0000 7f01e2ffd640 1 --2- 172.21.15.19:0/824111295 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5622f9c2cee0 0x5622f9c34220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:27:00.316 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:00.313+0000 7f01e2ffd640 1 -- 172.21.15.19:0/824111295 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5622f9c34bf0 con 0x5622f9c2d800 2024-09-10T22:27:00.317 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:00.313+0000 7f01e2ffd640 1 --2- 172.21.15.19:0/824111295 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5622f9c2d800 0x5622f9c59b50 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f01d8004760 tx=0x7f01d8004a30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2adb35010f7d848c server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:27:00.317 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:00.314+0000 7f01c97fa640 1 -- 172.21.15.19:0/824111295 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01d8031070 con 0x5622f9c2d800 2024-09-10T22:27:00.317 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:00.314+0000 7f01c97fa640 1 -- 172.21.15.19:0/824111295 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f01d801f040 con 0x5622f9c2d800 2024-09-10T22:27:00.317 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:00.314+0000 7f01c97fa640 1 -- 172.21.15.19:0/824111295 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01d8025dc0 con 0x5622f9c2d800 2024-09-10T22:27:00.319 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:00.315+0000 7f01ebf8b740 1 -- 172.21.15.19:0/824111295 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5622f9c2d800 msgr2=0x5622f9c59b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:27:00.319 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:00.315+0000 7f01ebf8b740 1 --2- 172.21.15.19:0/824111295 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5622f9c2d800 0x5622f9c59b50 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f01d8004760 tx=0x7f01d8004a30 comp rx=0 tx=0).stop 2024-09-10T22:27:00.319 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:00.315+0000 7f01ebf8b740 1 -- 172.21.15.19:0/824111295 shutdown_connections 2024-09-10T22:27:00.319 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:00.315+0000 7f01ebf8b740 1 --2- 172.21.15.19:0/824111295 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5622f9c39790 0x5622f9c5a090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:27:00.320 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:00.315+0000 7f01ebf8b740 1 --2- 172.21.15.19:0/824111295 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5622f9c2d800 0x5622f9c59b50 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:27:00.320 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:00.315+0000 7f01ebf8b740 1 --2- 172.21.15.19:0/824111295 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5622f9c2cee0 0x5622f9c34220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:27:00.320 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:00.315+0000 7f01ebf8b740 1 -- 172.21.15.19:0/824111295 >> 172.21.15.19:0/824111295 conn(0x5622f9c2ad10 msgr2=0x5622f9c33b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:27:00.320 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:00.315+0000 7f01ebf8b740 1 -- 172.21.15.19:0/824111295 shutdown_connections 2024-09-10T22:27:00.320 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:00.315+0000 7f01ebf8b740 1 -- 172.21.15.19:0/824111295 wait complete. 2024-09-10T22:27:00.320 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:00.315+0000 7f01ebf8b740 1 -- start start 2024-09-10T22:27:00.320 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:00.316+0000 7f01ebf8b740 1 Processor -- start 2024-09-10T22:27:00.320 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:00.316+0000 7f01ebf8b740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5622f9c2cee0 0x5622f9c4a100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:27:00.320 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:00.316+0000 7f01ebf8b740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5622f9c2d800 0x5622f9c4a6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:27:00.320 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:00.316+0000 7f01ebf8b740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5622f9c39790 0x5622f9c44ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:27:00.320 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:00.316+0000 7f01e2ffd640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5622f9c2d800 0x5622f9c4a6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:27:00.321 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:00.316+0000 7f01e37fe640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5622f9c2cee0 0x5622f9c4a100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:27:00.321 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:00.316+0000 7f01e37fe640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5622f9c2cee0 0x5622f9c4a100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.19:32790/0 (socket says 172.21.15.19:32790) 2024-09-10T22:27:00.321 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:00.317+0000 7f01e3fff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5622f9c39790 0x5622f9c44ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:27:00.321 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:00.317+0000 7f01e2ffd640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5622f9c2d800 0x5622f9c4a6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.19:59940/0 (socket says 172.21.15.19:59940) 2024-09-10T22:27:00.321 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:00.317+0000 7f01e3fff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5622f9c39790 0x5622f9c44ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:33032/0 (socket says 172.21.15.19:33032) 2024-09-10T22:27:00.321 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:00.317+0000 7f01e37fe640 1 -- 172.21.15.19:0/966720501 learned_addr learned my addr 172.21.15.19:0/966720501 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:27:00.321 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:00.317+0000 7f01ebf8b740 1 -- 172.21.15.19:0/966720501 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f01e41aa9f0 con 0x5622f9c39790 2024-09-10T22:27:00.321 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:00.317+0000 7f01ebf8b740 1 -- 172.21.15.19:0/966720501 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f01e41abe60 con 0x5622f9c2d800 2024-09-10T22:27:00.321 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:00.317+0000 7f01ebf8b740 1 -- 172.21.15.19:0/966720501 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f01e41ab0c0 con 0x5622f9c2cee0 2024-09-10T22:27:00.321 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:00.317+0000 7f01e37fe640 1 -- 172.21.15.19:0/966720501 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5622f9c2d800 msgr2=0x5622f9c4a6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:27:00.321 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:00.317+0000 7f01e37fe640 1 --2- 172.21.15.19:0/966720501 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5622f9c2d800 0x5622f9c4a6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:27:00.321 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:00.317+0000 7f01e37fe640 1 -- 172.21.15.19:0/966720501 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5622f9c39790 msgr2=0x5622f9c44ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:27:00.321 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:00.317+0000 7f01e37fe640 1 --2- 172.21.15.19:0/966720501 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5622f9c39790 0x5622f9c44ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:27:00.322 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:00.317+0000 7f01e37fe640 1 -- 172.21.15.19:0/966720501 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5622f9c45700 con 0x5622f9c2cee0 2024-09-10T22:27:00.322 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:00.317+0000 7f01e3fff640 1 --2- 172.21.15.19:0/966720501 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5622f9c39790 0x5622f9c44ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T22:27:00.322 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:00.317+0000 7f01ebf8b740 10 client.0 _ll_register_callbacks cb 0x7f01d4010770 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T22:27:00.322 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:00.317+0000 7f01ebf8b740 1 -- 172.21.15.19:0/966720501 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f01d801f040 con 0x5622f9c2cee0 2024-09-10T22:27:00.322 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:00.318+0000 7f01e37fe640 1 --2- 172.21.15.19:0/966720501 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5622f9c2cee0 0x5622f9c4a100 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f01d40b26e0 tx=0x7f01d40abc70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9c235d59bb0075b8 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:27:00.322 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:00.318+0000 7f01c2ffd640 10 client.25072 ms_handle_connect on v2:172.21.15.138:3300/0 2024-09-10T22:27:00.322 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:00.318+0000 7f01c2ffd640 1 -- 172.21.15.19:0/966720501 <== mon.1 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01d40a6e60 con 0x5622f9c2cee0 2024-09-10T22:27:00.322 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:00.318+0000 7f01c2ffd640 1 -- 172.21.15.19:0/966720501 <== mon.1 v2:172.21.15.138:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8327+0+0 (secure 0 0 0) 0x7f01d40ad9e0 con 0x5622f9c2cee0 2024-09-10T22:27:00.322 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:00.318+0000 7f01c2ffd640 1 -- 172.21.15.19:0/966720501 <== mon.1 v2:172.21.15.138:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f01d40ac530 con 0x5622f9c2cee0 2024-09-10T22:27:00.322 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:00.318+0000 7f01ebf8b740 10 client.25072 fetch_fsmap learned FSMap version 25 2024-09-10T22:27:00.322 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:00.318+0000 7f01ebf8b740 1 -- 172.21.15.19:0/966720501 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({fsmap=25}) -- 0x5622f9cbf630 con 0x5622f9c2cee0 2024-09-10T22:27:00.324 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:00.319+0000 7f01c2ffd640 1 -- 172.21.15.19:0/966720501 <== mon.1 v2:172.21.15.138:3300/0 4 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f01d40adbe0 con 0x5622f9c2cee0 2024-09-10T22:27:00.324 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:00.319+0000 7f01ebf8b740 10 client.25072 fetch_fsmap finished waiting for FSMap version 25 2024-09-10T22:27:00.324 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:00.319+0000 7f01ebf8b740 10 client.25072 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-10T22:27:00.324 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:00.319+0000 7f01ebf8b740 20 client.25072 populate_metadata read hostname 'smithi019' 2024-09-10T22:27:00.324 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:00.319+0000 7f01ebf8b740 1 --2- 172.21.15.19:0/966720501 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x5622f9c51e70 0x5622f9cc1d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:27:00.325 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:00.319+0000 7f01ebf8b740 4 client.25072 mds_command: new command op to 24581 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-10T22:27:00.325 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:00.319+0000 7f01ebf8b740 1 -- 172.21.15.19:0/966720501 --> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x5622f9ba1860 con 0x5622f9c51e70 2024-09-10T22:27:00.325 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:00.319+0000 7f01e2ffd640 1 --2- 172.21.15.19:0/966720501 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x5622f9c51e70 0x5622f9cc1d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:27:00.325 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:00.320+0000 7f01c2ffd640 10 client.25072 ms_handle_connect on v2:172.21.15.135:6838/1254769802 2024-09-10T22:27:00.325 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:00.320+0000 7f01e2ffd640 1 --2- 172.21.15.19:0/966720501 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x5622f9c51e70 0x5622f9cc1d30 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6e3da11b67435dc6 server_cookie=d4e69c990ccefa19 in_seq=0 out_seq=0 2024-09-10T22:27:00.325 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:00.321+0000 7f01c2ffd640 1 -- 172.21.15.19:0/966720501 <== mds.0 v2:172.21.15.135:6838/1254769802 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x5622f9ba1860 con 0x5622f9c51e70 2024-09-10T22:27:00.325 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:00.321+0000 7f01c2ffd640 10 client.25072 handle_command_reply: tid=0 2024-09-10T22:27:00.325 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:00.321+0000 7f01ebf8b740 1 client.25072 shutdown 2024-09-10T22:27:00.325 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:00.321+0000 7f01ebf8b740 1 -- 172.21.15.19:0/966720501 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5622f9c2cee0 msgr2=0x5622f9c4a100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:27:00.325 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:00.321+0000 7f01ebf8b740 1 --2- 172.21.15.19:0/966720501 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5622f9c2cee0 0x5622f9c4a100 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f01d40b26e0 tx=0x7f01d40abc70 comp rx=0 tx=0).stop 2024-09-10T22:27:00.325 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:00.322+0000 7f01ebf8b740 1 -- 172.21.15.19:0/966720501 shutdown_connections 2024-09-10T22:27:00.325 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:00.322+0000 7f01ebf8b740 1 --2- 172.21.15.19:0/966720501 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5622f9c39790 0x5622f9c44ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:27:00.325 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:00.322+0000 7f01ebf8b740 1 --2- 172.21.15.19:0/966720501 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5622f9c2d800 0x5622f9c4a6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:27:00.326 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:00.322+0000 7f01ebf8b740 1 --2- 172.21.15.19:0/966720501 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x5622f9c51e70 0x5622f9cc1d30 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:27:00.326 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:00.322+0000 7f01ebf8b740 1 --2- 172.21.15.19:0/966720501 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5622f9c2cee0 0x5622f9c4a100 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:27:00.326 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:00.322+0000 7f01ebf8b740 1 -- 172.21.15.19:0/966720501 >> 172.21.15.19:0/966720501 conn(0x5622f9c2ad10 msgr2=0x5622f9c37d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:27:00.326 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:00.322+0000 7f01c2ffd640 0 client.25072 ms_handle_reset on v2:172.21.15.135:6838/1254769802 2024-09-10T22:27:00.326 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:00.322+0000 7f01ebf8b740 1 -- 172.21.15.19:0/966720501 shutdown_connections 2024-09-10T22:27:00.326 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:00.322+0000 7f01ebf8b740 1 -- 172.21.15.19:0/966720501 wait complete. 2024-09-10T22:27:00.326 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:00.322+0000 7f01ebf8b740 20 client.25072 trim_cache size 0 max 16384 2024-09-10T22:27:00.326 INFO:teuthology.orchestra.run.smithi019.stdout:{ 2024-09-10T22:27:00.326 INFO:teuthology.orchestra.run.smithi019.stdout: "return_code": 0, 2024-09-10T22:27:00.327 INFO:teuthology.orchestra.run.smithi019.stdout: "scrub_tag": "b38852c8-478a-42ef-8384-b2c55d5313a4", 2024-09-10T22:27:00.327 INFO:teuthology.orchestra.run.smithi019.stdout: "mode": "asynchronous" 2024-09-10T22:27:00.327 INFO:teuthology.orchestra.run.smithi019.stdout:} 2024-09-10T22:27:00.327 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:00.323+0000 7f01e9bb6640 1 -- 172.21.15.19:0/1471428783 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f01cc0b52e0 msgr2=0x7f01cc0b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:27:00.327 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:00.323+0000 7f01e9bb6640 1 --2- 172.21.15.19:0/1471428783 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f01cc0b52e0 0x7f01cc0b77a0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f01dc02fcc0 tx=0x7f01dc009860 comp rx=0 tx=0).stop 2024-09-10T22:27:00.327 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:00.323+0000 7f01e9bb6640 1 -- 172.21.15.19:0/1471428783 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f01e4101830 msgr2=0x7f01e419b440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:27:00.327 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:00.323+0000 7f01e9bb6640 1 --2- 172.21.15.19:0/1471428783 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f01e4101830 0x7f01e419b440 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f01d400e9f0 tx=0x7f01d400eeb0 comp rx=0 tx=0).stop 2024-09-10T22:27:00.328 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:00.323+0000 7f01e9bb6640 1 -- 172.21.15.19:0/1471428783 shutdown_connections 2024-09-10T22:27:00.328 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:00.323+0000 7f01e9bb6640 1 --2- 172.21.15.19:0/1471428783 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f01cc0b52e0 0x7f01cc0b77a0 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:27:00.328 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:00.323+0000 7f01e9bb6640 1 --2- 172.21.15.19:0/1471428783 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f01e410f3e0 0x7f01e41a0d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:27:00.328 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:00.323+0000 7f01e9bb6640 1 --2- 172.21.15.19:0/1471428783 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f01e4102150 0x7f01e419b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:27:00.328 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:00.323+0000 7f01e9bb6640 1 --2- 172.21.15.19:0/1471428783 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f01e4101830 0x7f01e419b440 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:27:00.328 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:00.323+0000 7f01e9bb6640 1 -- 172.21.15.19:0/1471428783 >> 172.21.15.19:0/1471428783 conn(0x7f01e40fd700 msgr2=0x7f01e4110730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:27:00.328 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:00.323+0000 7f01e9bb6640 1 -- 172.21.15.19:0/1471428783 shutdown_connections 2024-09-10T22:27:00.328 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:00.323+0000 7f01e9bb6640 1 -- 172.21.15.19:0/1471428783 wait complete. 2024-09-10T22:27:00.859 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:27:00 smithi135 ceph-mon[34789]: scrub queued for path: / 2024-09-10T22:27:00.860 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:27:00 smithi135 ceph-mon[34789]: scrub summary: idle+waiting paths [/] 2024-09-10T22:27:00.860 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:27:00 smithi135 ceph-mon[34789]: scrub summary: active paths [/] 2024-09-10T22:27:00.860 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:27:00 smithi135 ceph-mon[34789]: scrub summary: idle+waiting paths [/] 2024-09-10T22:27:00.875 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:27:00 smithi138 ceph-mon[35236]: scrub queued for path: / 2024-09-10T22:27:00.875 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:27:00 smithi138 ceph-mon[35236]: scrub summary: idle+waiting paths [/] 2024-09-10T22:27:00.875 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:27:00 smithi138 ceph-mon[35236]: scrub summary: active paths [/] 2024-09-10T22:27:00.875 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:27:00 smithi138 ceph-mon[35236]: scrub summary: idle+waiting paths [/] 2024-09-10T22:27:00.926 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:27:00 smithi019 ceph-mon[31375]: scrub queued for path: / 2024-09-10T22:27:00.927 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:27:00 smithi019 ceph-mon[31375]: scrub summary: idle+waiting paths [/] 2024-09-10T22:27:00.927 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:27:00 smithi019 ceph-mon[31375]: scrub summary: active paths [/] 2024-09-10T22:27:00.927 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:27:00 smithi019 ceph-mon[31375]: scrub summary: idle+waiting paths [/] 2024-09-10T22:27:01.034 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 22997a4c-6fc2-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-10T22:27:01.387 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/22997a4c-6fc2-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T22:27:01.736 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:27:01 smithi019 ceph-mon[31375]: pgmap v365: 97 pgs: 97 active+clean; 664 KiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 1.2 KiB/s wr, 7 op/s 2024-09-10T22:27:01.860 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:27:01 smithi135 ceph-mon[34789]: pgmap v365: 97 pgs: 97 active+clean; 664 KiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 1.2 KiB/s wr, 7 op/s 2024-09-10T22:27:01.874 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:27:01 smithi138 ceph-mon[35236]: pgmap v365: 97 pgs: 97 active+clean; 664 KiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 1.2 KiB/s wr, 7 op/s 2024-09-10T22:27:01.879 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:01.878+0000 7fd77c702640 1 -- 172.21.15.19:0/3169686186 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd7741045c0 msgr2=0x7fd77410cab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:27:01.879 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:01.878+0000 7fd77c702640 1 --2- 172.21.15.19:0/3169686186 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd7741045c0 0x7fd77410cab0 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7fd764009900 tx=0x7fd76402a410 comp rx=0 tx=0).stop 2024-09-10T22:27:01.879 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:01.878+0000 7fd77c702640 1 -- 172.21.15.19:0/3169686186 shutdown_connections 2024-09-10T22:27:01.879 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:01.878+0000 7fd77c702640 1 --2- 172.21.15.19:0/3169686186 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd77410d100 0x7fd77410f560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:27:01.879 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:01.878+0000 7fd77c702640 1 --2- 172.21.15.19:0/3169686186 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd7741045c0 0x7fd77410cab0 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:27:01.880 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:01.878+0000 7fd77c702640 1 --2- 172.21.15.19:0/3169686186 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd774103ca0 0x7fd774104080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:27:01.880 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:01.878+0000 7fd77c702640 1 -- 172.21.15.19:0/3169686186 >> 172.21.15.19:0/3169686186 conn(0x7fd7740fd700 msgr2=0x7fd7740ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:27:01.880 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:01.878+0000 7fd77c702640 1 -- 172.21.15.19:0/3169686186 shutdown_connections 2024-09-10T22:27:01.880 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:01.878+0000 7fd77c702640 1 -- 172.21.15.19:0/3169686186 wait complete. 2024-09-10T22:27:01.881 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:01.879+0000 7fd77c702640 1 Processor -- start 2024-09-10T22:27:01.881 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:01.879+0000 7fd77c702640 1 -- start start 2024-09-10T22:27:01.881 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:01.879+0000 7fd77c702640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd774103ca0 0x7fd774101950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:27:01.881 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:01.879+0000 7fd77c702640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd7741045c0 0x7fd774101e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:27:01.881 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:01.879+0000 7fd77c702640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd77410d100 0x7fd7741023d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:27:01.881 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:01.879+0000 7fd77c702640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fd774112d70 con 0x7fd77410d100 2024-09-10T22:27:01.881 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:01.879+0000 7fd77c702640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fd774112bf0 con 0x7fd774103ca0 2024-09-10T22:27:01.881 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:01.879+0000 7fd77c702640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7fd774112ef0 con 0x7fd7741045c0 2024-09-10T22:27:01.882 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:01.879+0000 7fd77ac9f640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd77410d100 0x7fd7741023d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:27:01.882 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:01.879+0000 7fd779c9d640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd7741045c0 0x7fd774101e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:27:01.882 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:01.879+0000 7fd77ac9f640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd77410d100 0x7fd7741023d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:33038/0 (socket says 172.21.15.19:33038) 2024-09-10T22:27:01.882 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:01.880+0000 7fd77ac9f640 1 -- 172.21.15.19:0/2735084131 learned_addr learned my addr 172.21.15.19:0/2735084131 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:27:01.882 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:01.880+0000 7fd77a49e640 1 --2- 172.21.15.19:0/2735084131 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd774103ca0 0x7fd774101950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:27:01.883 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:01.880+0000 7fd77ac9f640 1 -- 172.21.15.19:0/2735084131 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd7741045c0 msgr2=0x7fd774101e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:27:01.883 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:01.880+0000 7fd77ac9f640 1 --2- 172.21.15.19:0/2735084131 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd7741045c0 0x7fd774101e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:27:01.883 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:01.880+0000 7fd77ac9f640 1 -- 172.21.15.19:0/2735084131 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd774103ca0 msgr2=0x7fd774101950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:27:01.883 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:01.880+0000 7fd77ac9f640 1 --2- 172.21.15.19:0/2735084131 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd774103ca0 0x7fd774101950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:27:01.883 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:01.880+0000 7fd77ac9f640 1 -- 172.21.15.19:0/2735084131 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd7741a76a0 con 0x7fd77410d100 2024-09-10T22:27:01.883 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:01.880+0000 7fd77ac9f640 1 --2- 172.21.15.19:0/2735084131 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd77410d100 0x7fd7741023d0 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7fd76c00cce0 tx=0x7fd76c00a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:27:01.883 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:01.881+0000 7fd76b7fe640 1 -- 172.21.15.19:0/2735084131 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd76c00f450 con 0x7fd77410d100 2024-09-10T22:27:01.883 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:01.881+0000 7fd76b7fe640 1 -- 172.21.15.19:0/2735084131 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd76c00faa0 con 0x7fd77410d100 2024-09-10T22:27:01.883 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:01.881+0000 7fd76b7fe640 1 -- 172.21.15.19:0/2735084131 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd76c018b70 con 0x7fd77410d100 2024-09-10T22:27:01.883 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:01.881+0000 7fd77c702640 1 -- 172.21.15.19:0/2735084131 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd7741a7990 con 0x7fd77410d100 2024-09-10T22:27:01.883 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:01.881+0000 7fd77c702640 1 -- 172.21.15.19:0/2735084131 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd7741a7e50 con 0x7fd77410d100 2024-09-10T22:27:01.885 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:01.884+0000 7fd77ead7740 1 Processor -- start 2024-09-10T22:27:01.886 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:01.885+0000 7fd76b7fe640 1 -- 172.21.15.19:0/2735084131 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 18) ==== 153250+0+0 (secure 0 0 0) 0x7fd76c00f5f0 con 0x7fd77410d100 2024-09-10T22:27:01.886 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:01.885+0000 7fd77ead7740 1 -- start start 2024-09-10T22:27:01.887 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:01.885+0000 7fd77ead7740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55da8f1670a0 0x55da8f167480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:27:01.887 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:01.885+0000 7fd77ead7740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55da8f1679c0 0x55da8f173410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:27:01.887 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:01.885+0000 7fd77ead7740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55da8f173950 0x55da8f175d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:27:01.887 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:01.885+0000 7fd77ead7740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x55da8f0dde50 con 0x55da8f1679c0 2024-09-10T22:27:01.887 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:01.885+0000 7fd77ead7740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55da8f0cd280 con 0x55da8f173950 2024-09-10T22:27:01.887 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:01.885+0000 7fd77ead7740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x55da8f0d1090 con 0x55da8f1670a0 2024-09-10T22:27:01.888 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:01.886+0000 7fd77a49e640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55da8f1679c0 0x55da8f173410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:27:01.888 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:01.886+0000 7fd77a49e640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55da8f1679c0 0x55da8f173410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:33052/0 (socket says 172.21.15.19:33052) 2024-09-10T22:27:01.888 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:01.886+0000 7fd77a49e640 1 -- 172.21.15.19:0/3478895355 learned_addr learned my addr 172.21.15.19:0/3478895355 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:27:01.888 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:01.886+0000 7fd779c9d640 1 --2- 172.21.15.19:0/3478895355 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55da8f173950 0x55da8f175d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:27:01.889 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:01.886+0000 7fd77a49e640 1 -- 172.21.15.19:0/3478895355 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55da8f1670a0 msgr2=0x55da8f167480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:27:01.889 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:01.886+0000 7fd77a49e640 1 --2- 172.21.15.19:0/3478895355 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55da8f1670a0 0x55da8f167480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:27:01.889 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:01.886+0000 7fd77a49e640 1 -- 172.21.15.19:0/3478895355 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55da8f173950 msgr2=0x55da8f175d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:27:01.889 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:01.886+0000 7fd77a49e640 1 --2- 172.21.15.19:0/3478895355 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55da8f173950 0x55da8f175d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:27:01.889 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:01.886+0000 7fd77a49e640 1 -- 172.21.15.19:0/3478895355 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55da8ee2b650 con 0x55da8f1679c0 2024-09-10T22:27:01.889 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:01.886+0000 7fd76b7fe640 1 --2- 172.21.15.19:0/2735084131 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7fd7600b5360 0x7fd7600b7820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:27:01.889 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:01.886+0000 7fd77a49e640 1 --2- 172.21.15.19:0/3478895355 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55da8f1679c0 0x55da8f173410 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7fd77000ac20 tx=0x7fd77000f790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1e19efbd792da5ce server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:27:01.889 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:01.886+0000 7fd779c9d640 1 --2- 172.21.15.19:0/2735084131 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7fd7600b5360 0x7fd7600b7820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:27:01.889 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:01.887+0000 7fd76b7fe640 1 -- 172.21.15.19:0/2735084131 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8327+0+0 (secure 0 0 0) 0x7fd76c0e6290 con 0x7fd77410d100 2024-09-10T22:27:01.890 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:01.887+0000 7fd768ff9640 1 -- 172.21.15.19:0/3478895355 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd77001d070 con 0x55da8f1679c0 2024-09-10T22:27:01.890 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:01.887+0000 7fd768ff9640 1 -- 172.21.15.19:0/3478895355 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd770018af0 con 0x55da8f1679c0 2024-09-10T22:27:01.890 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:01.887+0000 7fd768ff9640 1 -- 172.21.15.19:0/3478895355 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd770010a40 con 0x55da8f1679c0 2024-09-10T22:27:01.890 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:01.888+0000 7fd779c9d640 1 --2- 172.21.15.19:0/2735084131 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7fd7600b5360 0x7fd7600b7820 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fd764000c00 tx=0x7fd764031400 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:27:01.890 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:01.888+0000 7fd77ead7740 1 -- 172.21.15.19:0/3478895355 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55da8f1679c0 msgr2=0x55da8f173410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:27:01.890 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:01.888+0000 7fd77ead7740 1 --2- 172.21.15.19:0/3478895355 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55da8f1679c0 0x55da8f173410 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7fd77000ac20 tx=0x7fd77000f790 comp rx=0 tx=0).stop 2024-09-10T22:27:01.890 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:01.888+0000 7fd77ead7740 1 -- 172.21.15.19:0/3478895355 shutdown_connections 2024-09-10T22:27:01.890 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:01.888+0000 7fd77ead7740 1 --2- 172.21.15.19:0/3478895355 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55da8f173950 0x55da8f175d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:27:01.890 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:01.888+0000 7fd77ead7740 1 --2- 172.21.15.19:0/3478895355 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55da8f1679c0 0x55da8f173410 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:27:01.890 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:01.888+0000 7fd77ead7740 1 --2- 172.21.15.19:0/3478895355 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55da8f1670a0 0x55da8f167480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:27:01.890 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:01.888+0000 7fd77ead7740 1 -- 172.21.15.19:0/3478895355 >> 172.21.15.19:0/3478895355 conn(0x55da8f164ed0 msgr2=0x55da8f166070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:27:01.893 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:01.888+0000 7fd77ead7740 1 -- 172.21.15.19:0/3478895355 shutdown_connections 2024-09-10T22:27:01.893 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:01.888+0000 7fd77ead7740 1 -- 172.21.15.19:0/3478895355 wait complete. 2024-09-10T22:27:01.893 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:01.888+0000 7fd77ead7740 1 -- start start 2024-09-10T22:27:01.893 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:01.888+0000 7fd77ead7740 1 Processor -- start 2024-09-10T22:27:01.894 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:01.889+0000 7fd77ead7740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55da8f1670a0 0x55da8f173180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:27:01.894 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:01.889+0000 7fd77ead7740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55da8f1679c0 0x55da8f1705d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:27:01.894 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:01.889+0000 7fd77ead7740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55da8f173950 0x55da8f170b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:27:01.894 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:01.889+0000 7fd77ead7740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x55da8ef2e700 con 0x55da8f1670a0 2024-09-10T22:27:01.894 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:01.889+0000 7fd77ead7740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55da8f068110 con 0x55da8f173950 2024-09-10T22:27:01.894 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:01.889+0000 7fd77ead7740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x55da8f176620 con 0x55da8f1679c0 2024-09-10T22:27:01.894 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:01.889+0000 7fd77ead7740 10 client.0 _ll_register_callbacks cb 0x55da8f081990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T22:27:01.894 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:01.889+0000 7fd77a49e640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55da8f1670a0 0x55da8f173180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:27:01.894 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:01.889+0000 7fd77a49e640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55da8f1670a0 0x55da8f173180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:33068/0 (socket says 172.21.15.19:33068) 2024-09-10T22:27:01.894 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:01.889+0000 7fd77a49e640 1 -- 172.21.15.19:0/2236660649 learned_addr learned my addr 172.21.15.19:0/2236660649 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:27:01.894 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:01.889+0000 7fd779c9d640 1 --2- 172.21.15.19:0/2236660649 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55da8f1679c0 0x55da8f1705d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:27:01.894 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:01.890+0000 7fd77a49e640 1 -- 172.21.15.19:0/2236660649 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55da8f1679c0 msgr2=0x55da8f1705d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:27:01.895 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:01.890+0000 7fd77a49e640 1 --2- 172.21.15.19:0/2236660649 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55da8f1679c0 0x55da8f1705d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:27:01.895 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:01.890+0000 7fd77a49e640 1 -- 172.21.15.19:0/2236660649 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55da8f173950 msgr2=0x55da8f170b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:27:01.895 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:01.890+0000 7fd77a49e640 1 --2- 172.21.15.19:0/2236660649 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55da8f173950 0x55da8f170b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:27:01.895 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:01.890+0000 7fd77a49e640 1 -- 172.21.15.19:0/2236660649 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55da8f095c40 con 0x55da8f1670a0 2024-09-10T22:27:01.895 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:01.890+0000 7fd77a49e640 1 --2- 172.21.15.19:0/2236660649 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55da8f1670a0 0x55da8f173180 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7fd7700186d0 tx=0x7fd770018700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e48ed65128f922fe server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:27:01.895 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:01.890+0000 7fd75dffb640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-10T22:27:01.895 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:01.890+0000 7fd75dffb640 1 -- 172.21.15.19:0/2236660649 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd77001d050 con 0x55da8f1670a0 2024-09-10T22:27:01.895 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:01.890+0000 7fd75dffb640 1 -- 172.21.15.19:0/2236660649 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8327+0+0 (secure 0 0 0) 0x7fd770005450 con 0x55da8f1670a0 2024-09-10T22:27:01.895 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:01.890+0000 7fd77ead7740 1 -- 172.21.15.19:0/2236660649 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd770018af0 con 0x55da8f1670a0 2024-09-10T22:27:01.895 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:01.890+0000 7fd75dffb640 1 -- 172.21.15.19:0/2236660649 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fd770018920 con 0x55da8f1670a0 2024-09-10T22:27:01.895 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:01.891+0000 7fd77ead7740 10 client.15519 fetch_fsmap learned FSMap version 25 2024-09-10T22:27:01.895 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:01.891+0000 7fd77ead7740 1 -- 172.21.15.19:0/2236660649 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55da8f18a6a0 con 0x55da8f1670a0 2024-09-10T22:27:01.895 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:01.891+0000 7fd75dffb640 1 -- 172.21.15.19:0/2236660649 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd770018af0 con 0x55da8f1670a0 2024-09-10T22:27:01.896 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:01.891+0000 7fd75dffb640 1 -- 172.21.15.19:0/2236660649 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fd7700046c0 con 0x55da8f1670a0 2024-09-10T22:27:01.896 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:01.891+0000 7fd77ead7740 10 client.15519 fetch_fsmap finished waiting for FSMap version 25 2024-09-10T22:27:01.896 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:01.891+0000 7fd77ead7740 10 client.15519 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-10T22:27:01.896 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:01.891+0000 7fd77ead7740 20 client.15519 populate_metadata read hostname 'smithi019' 2024-09-10T22:27:01.896 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:01.891+0000 7fd77ead7740 1 --2- 172.21.15.19:0/2236660649 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x55da8f18b9f0 0x55da8f18dde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:27:01.896 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:01.891+0000 7fd77ead7740 4 client.15519 mds_command: new command op to 24581 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T22:27:01.896 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:01.891+0000 7fd77ead7740 1 -- 172.21.15.19:0/2236660649 --> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55da8f0dfda0 con 0x55da8f18b9f0 2024-09-10T22:27:01.896 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:01.892+0000 7fd779c9d640 1 --2- 172.21.15.19:0/2236660649 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x55da8f18b9f0 0x55da8f18dde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:27:01.896 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:01.892+0000 7fd779c9d640 1 --2- 172.21.15.19:0/2236660649 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x55da8f18b9f0 0x55da8f18dde0 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=aee4fe62bc60b08f server_cookie=7e856094d2fbf418 in_seq=0 out_seq=0 2024-09-10T22:27:01.896 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:01.892+0000 7fd75dffb640 10 client.15519 ms_handle_connect on v2:172.21.15.135:6838/1254769802 2024-09-10T22:27:01.897 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:01.893+0000 7fd75dffb640 1 -- 172.21.15.19:0/2236660649 <== mds.0 v2:172.21.15.135:6838/1254769802 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55da8f0dfda0 con 0x55da8f18b9f0 2024-09-10T22:27:01.897 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:01.893+0000 7fd75dffb640 10 client.15519 handle_command_reply: tid=0 2024-09-10T22:27:01.897 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:01.893+0000 7fd77ead7740 1 client.15519 shutdown 2024-09-10T22:27:01.897 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:01.893+0000 7fd77ead7740 1 -- 172.21.15.19:0/2236660649 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55da8f1670a0 msgr2=0x55da8f173180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:27:01.898 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:01.893+0000 7fd77ead7740 1 --2- 172.21.15.19:0/2236660649 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55da8f1670a0 0x55da8f173180 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7fd7700186d0 tx=0x7fd770018700 comp rx=0 tx=0).stop 2024-09-10T22:27:01.898 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:01.893+0000 7fd77ead7740 1 -- 172.21.15.19:0/2236660649 shutdown_connections 2024-09-10T22:27:01.898 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:01.893+0000 7fd77ead7740 1 --2- 172.21.15.19:0/2236660649 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55da8f173950 0x55da8f170b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:27:01.898 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:01.893+0000 7fd77ead7740 1 --2- 172.21.15.19:0/2236660649 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x55da8f18b9f0 0x55da8f18dde0 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:27:01.898 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:01.893+0000 7fd77ead7740 1 --2- 172.21.15.19:0/2236660649 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55da8f1679c0 0x55da8f1705d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:27:01.898 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:01.893+0000 7fd77ead7740 1 --2- 172.21.15.19:0/2236660649 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55da8f1670a0 0x55da8f173180 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:27:01.898 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:01.893+0000 7fd77ead7740 1 -- 172.21.15.19:0/2236660649 >> 172.21.15.19:0/2236660649 conn(0x55da8f164ed0 msgr2=0x55da8f16aa70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:27:01.898 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:01.893+0000 7fd75dffb640 0 client.15519 ms_handle_reset on v2:172.21.15.135:6838/1254769802 2024-09-10T22:27:01.898 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:01.893+0000 7fd77ead7740 1 -- 172.21.15.19:0/2236660649 shutdown_connections 2024-09-10T22:27:01.898 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:01.894+0000 7fd77ead7740 1 -- 172.21.15.19:0/2236660649 wait complete. 2024-09-10T22:27:01.898 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:01.894+0000 7fd77ead7740 20 client.15519 trim_cache size 0 max 16384 2024-09-10T22:27:01.921 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:01.919+0000 7fd77ead7740 1 Processor -- start 2024-09-10T22:27:01.921 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:01.919+0000 7fd77ead7740 1 -- start start 2024-09-10T22:27:01.921 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:01.919+0000 7fd77ead7740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55da8f1670a0 0x55da8f1663d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:27:01.921 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:01.919+0000 7fd77ead7740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55da8f1679c0 0x55da8f163e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:27:01.921 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:01.919+0000 7fd77ead7740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55da8f173950 0x55da8f16d7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:27:01.922 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:01.919+0000 7fd779c9d640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55da8f1679c0 0x55da8f163e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:27:01.922 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:01.919+0000 7fd77ead7740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fd7741aecd0 con 0x55da8f1679c0 2024-09-10T22:27:01.922 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:01.919+0000 7fd77ead7740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fd7741ac5a0 con 0x55da8f173950 2024-09-10T22:27:01.922 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:01.919+0000 7fd77ead7740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7fd7741aa430 con 0x55da8f1670a0 2024-09-10T22:27:01.922 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:01.919+0000 7fd779c9d640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55da8f1679c0 0x55da8f163e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:33072/0 (socket says 172.21.15.19:33072) 2024-09-10T22:27:01.922 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:01.919+0000 7fd779c9d640 1 -- 172.21.15.19:0/1488452311 learned_addr learned my addr 172.21.15.19:0/1488452311 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:27:01.922 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:01.919+0000 7fd77a49e640 1 --2- 172.21.15.19:0/1488452311 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55da8f1670a0 0x55da8f1663d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:27:01.922 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:01.920+0000 7fd77ac9f640 1 --2- 172.21.15.19:0/1488452311 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55da8f173950 0x55da8f16d7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:27:01.922 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:01.920+0000 7fd779c9d640 1 -- 172.21.15.19:0/1488452311 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55da8f1670a0 msgr2=0x55da8f1663d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:27:01.922 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:01.920+0000 7fd779c9d640 1 --2- 172.21.15.19:0/1488452311 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55da8f1670a0 0x55da8f1663d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:27:01.922 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:01.920+0000 7fd779c9d640 1 -- 172.21.15.19:0/1488452311 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55da8f173950 msgr2=0x55da8f16d7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:27:01.922 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:01.920+0000 7fd779c9d640 1 --2- 172.21.15.19:0/1488452311 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55da8f173950 0x55da8f16d7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:27:01.923 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:01.920+0000 7fd779c9d640 1 -- 172.21.15.19:0/1488452311 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55da8f165950 con 0x55da8f1679c0 2024-09-10T22:27:01.923 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:01.920+0000 7fd779c9d640 1 --2- 172.21.15.19:0/1488452311 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55da8f1679c0 0x55da8f163e10 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7fd764009900 tx=0x7fd764043000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=363c7e64a22ab17b server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:27:01.923 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:01.920+0000 7fd75ffff640 1 -- 172.21.15.19:0/1488452311 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd764043070 con 0x55da8f1679c0 2024-09-10T22:27:01.924 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:01.920+0000 7fd75ffff640 1 -- 172.21.15.19:0/1488452311 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd764057070 con 0x55da8f1679c0 2024-09-10T22:27:01.924 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:01.920+0000 7fd75ffff640 1 -- 172.21.15.19:0/1488452311 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd764035040 con 0x55da8f1679c0 2024-09-10T22:27:01.925 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:01.921+0000 7fd77ead7740 1 -- 172.21.15.19:0/1488452311 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55da8f1679c0 msgr2=0x55da8f163e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:27:01.925 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:01.921+0000 7fd77ead7740 1 --2- 172.21.15.19:0/1488452311 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55da8f1679c0 0x55da8f163e10 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7fd764009900 tx=0x7fd764043000 comp rx=0 tx=0).stop 2024-09-10T22:27:01.925 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:01.921+0000 7fd77ead7740 1 -- 172.21.15.19:0/1488452311 shutdown_connections 2024-09-10T22:27:01.925 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:01.921+0000 7fd77ead7740 1 --2- 172.21.15.19:0/1488452311 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55da8f173950 0x55da8f16d7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:27:01.925 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:01.921+0000 7fd77ead7740 1 --2- 172.21.15.19:0/1488452311 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55da8f1679c0 0x55da8f163e10 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:27:01.925 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:01.921+0000 7fd77ead7740 1 --2- 172.21.15.19:0/1488452311 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55da8f1670a0 0x55da8f1663d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:27:01.925 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:01.921+0000 7fd77ead7740 1 -- 172.21.15.19:0/1488452311 >> 172.21.15.19:0/1488452311 conn(0x55da8f164ed0 msgr2=0x55da8f163700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:27:01.925 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:01.921+0000 7fd77ead7740 1 -- 172.21.15.19:0/1488452311 shutdown_connections 2024-09-10T22:27:01.925 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:01.921+0000 7fd77ead7740 1 -- 172.21.15.19:0/1488452311 wait complete. 2024-09-10T22:27:01.925 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:01.922+0000 7fd77ead7740 1 -- start start 2024-09-10T22:27:01.925 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:01.922+0000 7fd77ead7740 1 Processor -- start 2024-09-10T22:27:01.925 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:01.922+0000 7fd77ead7740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55da8f1670a0 0x55da8f184b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:27:01.926 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:01.922+0000 7fd77ead7740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55da8f1679c0 0x55da8f180080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:27:01.926 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:01.922+0000 7fd77ead7740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55da8f173950 0x55da8f180810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:27:01.926 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:01.922+0000 7fd77ead7740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fd7741aaa80 con 0x55da8f1679c0 2024-09-10T22:27:01.926 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:01.922+0000 7fd77ead7740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fd7741abed0 con 0x55da8f173950 2024-09-10T22:27:01.926 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:01.922+0000 7fd77ead7740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7fd7741ab130 con 0x55da8f1670a0 2024-09-10T22:27:01.926 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:01.922+0000 7fd77ead7740 10 client.0 _ll_register_callbacks cb 0x7fd77001b070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T22:27:01.926 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:01.922+0000 7fd779c9d640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55da8f1679c0 0x55da8f180080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:27:01.926 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:01.922+0000 7fd779c9d640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55da8f1679c0 0x55da8f180080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:33080/0 (socket says 172.21.15.19:33080) 2024-09-10T22:27:01.926 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:01.922+0000 7fd779c9d640 1 -- 172.21.15.19:0/2775596022 learned_addr learned my addr 172.21.15.19:0/2775596022 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:27:01.926 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:01.922+0000 7fd77a49e640 1 --2- 172.21.15.19:0/2775596022 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55da8f1670a0 0x55da8f184b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:27:01.926 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:01.922+0000 7fd77ac9f640 1 --2- 172.21.15.19:0/2775596022 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55da8f173950 0x55da8f180810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:27:01.927 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:01.923+0000 7fd779c9d640 1 -- 172.21.15.19:0/2775596022 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55da8f1670a0 msgr2=0x55da8f184b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:27:01.927 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:01.923+0000 7fd779c9d640 1 --2- 172.21.15.19:0/2775596022 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55da8f1670a0 0x55da8f184b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:27:01.927 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:01.923+0000 7fd779c9d640 1 -- 172.21.15.19:0/2775596022 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55da8f173950 msgr2=0x55da8f180810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:27:01.927 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:01.923+0000 7fd779c9d640 1 --2- 172.21.15.19:0/2775596022 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55da8f173950 0x55da8f180810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:27:01.927 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:01.923+0000 7fd779c9d640 1 -- 172.21.15.19:0/2775596022 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55da8f1f76d0 con 0x55da8f1679c0 2024-09-10T22:27:01.927 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:01.923+0000 7fd77ac9f640 1 --2- 172.21.15.19:0/2775596022 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55da8f173950 0x55da8f180810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T22:27:01.927 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:01.923+0000 7fd779c9d640 1 --2- 172.21.15.19:0/2775596022 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55da8f1679c0 0x55da8f180080 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7fd764005ec0 tx=0x7fd764003ea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7f2651785cc60100 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:27:01.927 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:01.923+0000 7fd75dffb640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-10T22:27:01.927 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:01.923+0000 7fd75dffb640 1 -- 172.21.15.19:0/2775596022 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd76405f070 con 0x55da8f1679c0 2024-09-10T22:27:01.927 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:01.923+0000 7fd75dffb640 1 -- 172.21.15.19:0/2775596022 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8327+0+0 (secure 0 0 0) 0x7fd7640035f0 con 0x55da8f1679c0 2024-09-10T22:27:01.927 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:01.923+0000 7fd77ead7740 1 -- 172.21.15.19:0/2775596022 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd764057070 con 0x55da8f1679c0 2024-09-10T22:27:01.928 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:01.924+0000 7fd75dffb640 1 -- 172.21.15.19:0/2775596022 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fd764035050 con 0x55da8f1679c0 2024-09-10T22:27:01.928 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:01.924+0000 7fd77ead7740 10 client.15525 fetch_fsmap learned FSMap version 25 2024-09-10T22:27:01.929 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:01.924+0000 7fd77ead7740 1 -- 172.21.15.19:0/2775596022 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55da8f1f89e0 con 0x55da8f1679c0 2024-09-10T22:27:01.929 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:01.924+0000 7fd75dffb640 1 -- 172.21.15.19:0/2775596022 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd764069030 con 0x55da8f1679c0 2024-09-10T22:27:01.929 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:01.924+0000 7fd75dffb640 1 -- 172.21.15.19:0/2775596022 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fd76403d450 con 0x55da8f1679c0 2024-09-10T22:27:01.929 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:01.924+0000 7fd77ead7740 10 client.15525 fetch_fsmap finished waiting for FSMap version 25 2024-09-10T22:27:01.929 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:01.924+0000 7fd77ead7740 10 client.15525 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-10T22:27:01.929 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:01.924+0000 7fd77ead7740 20 client.15525 populate_metadata read hostname 'smithi019' 2024-09-10T22:27:01.929 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:01.924+0000 7fd77ead7740 1 --2- 172.21.15.19:0/2775596022 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x55da8f1f90e0 0x55da8f1fb500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:27:01.929 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:01.924+0000 7fd77ead7740 4 client.15525 mds_command: new command op to 24581 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-10T22:27:01.929 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:01.924+0000 7fd77ead7740 1 -- 172.21.15.19:0/2775596022 --> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55da8f0db850 con 0x55da8f1f90e0 2024-09-10T22:27:01.929 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:01.925+0000 7fd77a49e640 1 --2- 172.21.15.19:0/2775596022 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x55da8f1f90e0 0x55da8f1fb500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:27:01.929 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:01.925+0000 7fd77a49e640 1 --2- 172.21.15.19:0/2775596022 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x55da8f1f90e0 0x55da8f1fb500 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2f3d163e6a0b1d52 server_cookie=97dac062d5b0aced in_seq=0 out_seq=0 2024-09-10T22:27:01.930 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:01.925+0000 7fd75dffb640 10 client.15525 ms_handle_connect on v2:172.21.15.135:6838/1254769802 2024-09-10T22:27:01.930 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:01.926+0000 7fd75dffb640 1 -- 172.21.15.19:0/2775596022 <== mds.0 v2:172.21.15.135:6838/1254769802 1 ==== command_reply(tid 0: 0 ) ==== 8+0+854 (crc 0 0 0) 0x55da8f0db850 con 0x55da8f1f90e0 2024-09-10T22:27:01.930 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:01.926+0000 7fd75dffb640 10 client.15525 handle_command_reply: tid=0 2024-09-10T22:27:01.930 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:01.926+0000 7fd77ead7740 1 client.15525 shutdown 2024-09-10T22:27:01.930 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:01.926+0000 7fd77ead7740 1 -- 172.21.15.19:0/2775596022 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55da8f1679c0 msgr2=0x55da8f180080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:27:01.930 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:01.926+0000 7fd77ead7740 1 --2- 172.21.15.19:0/2775596022 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55da8f1679c0 0x55da8f180080 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7fd764005ec0 tx=0x7fd764003ea0 comp rx=0 tx=0).stop 2024-09-10T22:27:01.930 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:01.926+0000 7fd77ead7740 1 -- 172.21.15.19:0/2775596022 shutdown_connections 2024-09-10T22:27:01.930 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:01.926+0000 7fd77ead7740 1 --2- 172.21.15.19:0/2775596022 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55da8f173950 0x55da8f180810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:27:01.930 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:01.926+0000 7fd77ead7740 1 --2- 172.21.15.19:0/2775596022 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55da8f1679c0 0x55da8f180080 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:27:01.931 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:01.926+0000 7fd77ead7740 1 --2- 172.21.15.19:0/2775596022 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x55da8f1f90e0 0x55da8f1fb500 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:27:01.931 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:01.926+0000 7fd75dffb640 0 client.15525 ms_handle_reset on v2:172.21.15.135:6838/1254769802 2024-09-10T22:27:01.931 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:01.926+0000 7fd77ead7740 1 --2- 172.21.15.19:0/2775596022 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55da8f1670a0 0x55da8f184b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:27:01.931 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:01.926+0000 7fd77ead7740 1 -- 172.21.15.19:0/2775596022 >> 172.21.15.19:0/2775596022 conn(0x55da8f164ed0 msgr2=0x55da8f172420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:27:01.931 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:01.926+0000 7fd77ead7740 1 -- 172.21.15.19:0/2775596022 shutdown_connections 2024-09-10T22:27:01.931 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:01.926+0000 7fd77ead7740 1 -- 172.21.15.19:0/2775596022 wait complete. 2024-09-10T22:27:01.931 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:01.926+0000 7fd77ead7740 20 client.15525 trim_cache size 0 max 16384 2024-09-10T22:27:01.931 INFO:teuthology.orchestra.run.smithi019.stdout:{ 2024-09-10T22:27:01.931 INFO:teuthology.orchestra.run.smithi019.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-10T22:27:01.932 INFO:teuthology.orchestra.run.smithi019.stdout: "scrubs": { 2024-09-10T22:27:01.932 INFO:teuthology.orchestra.run.smithi019.stdout: "b38852c8-478a-42ef-8384-b2c55d5313a4": { 2024-09-10T22:27:01.932 INFO:teuthology.orchestra.run.smithi019.stdout: "path": "/", 2024-09-10T22:27:01.932 INFO:teuthology.orchestra.run.smithi019.stdout: "tag": "b38852c8-478a-42ef-8384-b2c55d5313a4", 2024-09-10T22:27:01.932 INFO:teuthology.orchestra.run.smithi019.stdout: "options": "recursive,force" 2024-09-10T22:27:01.932 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-10T22:27:01.932 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:27:01.932 INFO:teuthology.orchestra.run.smithi019.stdout: "scrub_stats": { 2024-09-10T22:27:01.932 INFO:teuthology.orchestra.run.smithi019.stdout: "b38852c8-478a-42ef-8384-b2c55d5313a4": { 2024-09-10T22:27:01.932 INFO:teuthology.orchestra.run.smithi019.stdout: "start_time": "2024-09-10T22:27:00.320308+0000", 2024-09-10T22:27:01.932 INFO:teuthology.orchestra.run.smithi019.stdout: "path": "/", 2024-09-10T22:27:01.932 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_started": 0, 2024-09-10T22:27:01.933 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_passed": 0, 2024-09-10T22:27:01.933 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_failed": 0, 2024-09-10T22:27:01.933 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_skipped": 0 2024-09-10T22:27:01.933 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:27:01.933 INFO:teuthology.orchestra.run.smithi019.stdout: "9b6bfdee-303c-4c12-af56-dc85860d112a": { 2024-09-10T22:27:01.933 INFO:teuthology.orchestra.run.smithi019.stdout: "start_time": "2024-09-10T22:26:17.484162+0000", 2024-09-10T22:27:01.933 INFO:teuthology.orchestra.run.smithi019.stdout: "path": "/", 2024-09-10T22:27:01.933 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_started": 0, 2024-09-10T22:27:01.933 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_passed": 0, 2024-09-10T22:27:01.933 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_failed": 0, 2024-09-10T22:27:01.933 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_skipped": 0 2024-09-10T22:27:01.933 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-10T22:27:01.934 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-10T22:27:01.934 INFO:teuthology.orchestra.run.smithi019.stdout:} 2024-09-10T22:27:01.934 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:01.927+0000 7fd77c702640 1 -- 172.21.15.19:0/2735084131 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7fd7600b5360 msgr2=0x7fd7600b7820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:27:01.934 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:01.927+0000 7fd77c702640 1 --2- 172.21.15.19:0/2735084131 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7fd7600b5360 0x7fd7600b7820 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fd764000c00 tx=0x7fd764031400 comp rx=0 tx=0).stop 2024-09-10T22:27:01.935 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:01.927+0000 7fd77c702640 1 -- 172.21.15.19:0/2735084131 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd77410d100 msgr2=0x7fd7741023d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:27:01.935 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:01.927+0000 7fd77c702640 1 --2- 172.21.15.19:0/2735084131 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd77410d100 0x7fd7741023d0 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7fd76c00cce0 tx=0x7fd76c00a620 comp rx=0 tx=0).stop 2024-09-10T22:27:01.935 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:01.927+0000 7fd77c702640 1 -- 172.21.15.19:0/2735084131 shutdown_connections 2024-09-10T22:27:01.935 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:01.927+0000 7fd77c702640 1 --2- 172.21.15.19:0/2735084131 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7fd7600b5360 0x7fd7600b7820 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:27:01.935 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:01.927+0000 7fd77c702640 1 --2- 172.21.15.19:0/2735084131 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd77410d100 0x7fd7741023d0 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:27:01.935 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:01.927+0000 7fd77c702640 1 --2- 172.21.15.19:0/2735084131 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd7741045c0 0x7fd774101e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:27:01.935 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:01.927+0000 7fd77c702640 1 --2- 172.21.15.19:0/2735084131 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd774103ca0 0x7fd774101950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:27:01.935 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:01.927+0000 7fd77c702640 1 -- 172.21.15.19:0/2735084131 >> 172.21.15.19:0/2735084131 conn(0x7fd7740fd700 msgr2=0x7fd7740fe300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:27:01.935 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:01.927+0000 7fd77c702640 1 -- 172.21.15.19:0/2735084131 shutdown_connections 2024-09-10T22:27:01.935 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:01.927+0000 7fd77c702640 1 -- 172.21.15.19:0/2735084131 wait complete. 2024-09-10T22:27:02.620 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:27:02 smithi019 ceph-mon[31375]: scrub summary: idle 2024-09-10T22:27:02.660 INFO:tasks.cephfs.filesystem:scrub status for tag:b38852c8-478a-42ef-8384-b2c55d5313a4 - {'path': '/', 'tag': 'b38852c8-478a-42ef-8384-b2c55d5313a4', 'options': 'recursive,force'} 2024-09-10T22:27:02.859 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:27:02 smithi135 ceph-mon[34789]: scrub summary: idle 2024-09-10T22:27:02.875 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:27:02 smithi138 ceph-mon[35236]: scrub summary: idle 2024-09-10T22:27:03.860 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:27:03 smithi135 ceph-mon[34789]: pgmap v366: 97 pgs: 97 active+clean; 665 KiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 1.7 KiB/s wr, 8 op/s 2024-09-10T22:27:03.874 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:27:03 smithi138 ceph-mon[35236]: pgmap v366: 97 pgs: 97 active+clean; 665 KiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 1.7 KiB/s wr, 8 op/s 2024-09-10T22:27:03.958 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:27:03 smithi019 ceph-mon[31375]: pgmap v366: 97 pgs: 97 active+clean; 665 KiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 1.7 KiB/s wr, 8 op/s 2024-09-10T22:27:05.859 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:27:05 smithi135 ceph-mon[34789]: pgmap v367: 97 pgs: 97 active+clean; 665 KiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 1.7 KiB/s wr, 7 op/s 2024-09-10T22:27:05.875 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:27:05 smithi138 ceph-mon[35236]: pgmap v367: 97 pgs: 97 active+clean; 665 KiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 1.7 KiB/s wr, 7 op/s 2024-09-10T22:27:05.958 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:27:05 smithi019 ceph-mon[31375]: pgmap v367: 97 pgs: 97 active+clean; 665 KiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 1.7 KiB/s wr, 7 op/s 2024-09-10T22:27:07.859 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:27:07 smithi135 ceph-mon[34789]: pgmap v368: 97 pgs: 97 active+clean; 665 KiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 1.6 KiB/s wr, 10 op/s 2024-09-10T22:27:07.875 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:27:07 smithi138 ceph-mon[35236]: pgmap v368: 97 pgs: 97 active+clean; 665 KiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 1.6 KiB/s wr, 10 op/s 2024-09-10T22:27:07.958 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:27:07 smithi019 ceph-mon[31375]: pgmap v368: 97 pgs: 97 active+clean; 665 KiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 1.6 KiB/s wr, 10 op/s 2024-09-10T22:27:09.357 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:09.354+0000 7f8eb053a640 1 -- 172.21.15.19:0/4234892756 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8ea8103370 msgr2=0x7f8ea8109cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:27:09.358 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:09.354+0000 7f8eb053a640 1 --2- 172.21.15.19:0/4234892756 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8ea8103370 0x7f8ea8109cf0 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f8ea0009cd0 tx=0x7f8ea002a8e0 comp rx=0 tx=0).stop 2024-09-10T22:27:09.358 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:09.354+0000 7f8eb053a640 1 -- 172.21.15.19:0/4234892756 shutdown_connections 2024-09-10T22:27:09.358 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:09.354+0000 7f8eb053a640 1 --2- 172.21.15.19:0/4234892756 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8ea8103370 0x7f8ea8109cf0 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:27:09.358 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:09.354+0000 7f8eb053a640 1 --2- 172.21.15.19:0/4234892756 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f8ea81029b0 0x7f8ea8102e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:27:09.358 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:09.354+0000 7f8eb053a640 1 --2- 172.21.15.19:0/4234892756 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8ea8101860 0x7f8ea8101c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:27:09.358 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:09.354+0000 7f8eb053a640 1 -- 172.21.15.19:0/4234892756 >> 172.21.15.19:0/4234892756 conn(0x7f8ea80fd140 msgr2=0x7f8ea80ff560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:27:09.358 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:09.354+0000 7f8eb053a640 1 -- 172.21.15.19:0/4234892756 shutdown_connections 2024-09-10T22:27:09.358 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:09.354+0000 7f8eb053a640 1 -- 172.21.15.19:0/4234892756 wait complete. 2024-09-10T22:27:09.358 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:09.355+0000 7f8eb053a640 1 Processor -- start 2024-09-10T22:27:09.358 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:09.355+0000 7f8eb053a640 1 -- start start 2024-09-10T22:27:09.358 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:09.355+0000 7f8eb053a640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f8ea8101860 0x7f8ea8105620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:27:09.359 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:09.355+0000 7f8eb053a640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8ea81029b0 0x7f8ea8103e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:27:09.359 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:09.355+0000 7f8eb053a640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8ea8103370 0x7f8ea81043c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:27:09.359 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:09.355+0000 7f8eb053a640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f8ea810d4b0 con 0x7f8ea81029b0 2024-09-10T22:27:09.359 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:09.355+0000 7f8eb053a640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f8ea810d330 con 0x7f8ea8103370 2024-09-10T22:27:09.359 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:09.355+0000 7f8eb053a640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f8ea810d630 con 0x7f8ea8101860 2024-09-10T22:27:09.359 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:09.355+0000 7f8eadad5640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8ea81029b0 0x7f8ea8103e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:27:09.359 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:09.355+0000 7f8eadad5640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8ea81029b0 0x7f8ea8103e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:32778/0 (socket says 172.21.15.19:32778) 2024-09-10T22:27:09.359 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:09.355+0000 7f8eadad5640 1 -- 172.21.15.19:0/722351112 learned_addr learned my addr 172.21.15.19:0/722351112 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:27:09.359 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:09.355+0000 7f8eaead7640 1 --2- 172.21.15.19:0/722351112 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8ea8103370 0x7f8ea81043c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:27:09.359 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:09.355+0000 7f8eae2d6640 1 --2- 172.21.15.19:0/722351112 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f8ea8101860 0x7f8ea8105620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:27:09.359 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:09.355+0000 7f8eadad5640 1 -- 172.21.15.19:0/722351112 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f8ea8101860 msgr2=0x7f8ea8105620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:27:09.359 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:09.355+0000 7f8eadad5640 1 --2- 172.21.15.19:0/722351112 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f8ea8101860 0x7f8ea8105620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:27:09.360 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:09.355+0000 7f8eadad5640 1 -- 172.21.15.19:0/722351112 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8ea8103370 msgr2=0x7f8ea81043c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:27:09.360 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:09.355+0000 7f8eadad5640 1 --2- 172.21.15.19:0/722351112 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8ea8103370 0x7f8ea81043c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:27:09.360 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:09.355+0000 7f8eadad5640 1 -- 172.21.15.19:0/722351112 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8ea8104c30 con 0x7f8ea81029b0 2024-09-10T22:27:09.360 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:09.355+0000 7f8eaead7640 1 --2- 172.21.15.19:0/722351112 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8ea8103370 0x7f8ea81043c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T22:27:09.360 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:09.356+0000 7f8eadad5640 1 --2- 172.21.15.19:0/722351112 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8ea81029b0 0x7f8ea8103e80 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f8e9800c920 tx=0x7f8e9800cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:27:09.360 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:09.356+0000 7f8e9f7fe640 1 -- 172.21.15.19:0/722351112 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e98007c70 con 0x7f8ea81029b0 2024-09-10T22:27:09.360 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:09.356+0000 7f8e9f7fe640 1 -- 172.21.15.19:0/722351112 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8e98007e10 con 0x7f8ea81029b0 2024-09-10T22:27:09.360 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:09.356+0000 7f8eb053a640 1 -- 172.21.15.19:0/722351112 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8ea81a2d90 con 0x7f8ea81029b0 2024-09-10T22:27:09.360 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:09.356+0000 7f8e9f7fe640 1 -- 172.21.15.19:0/722351112 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e98018820 con 0x7f8ea81029b0 2024-09-10T22:27:09.360 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:09.356+0000 7f8eb053a640 1 -- 172.21.15.19:0/722351112 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8ea81a3250 con 0x7f8ea81029b0 2024-09-10T22:27:09.363 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:09.359+0000 7f8eb33e2740 1 Processor -- start 2024-09-10T22:27:09.363 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:09.359+0000 7f8eb33e2740 1 -- start start 2024-09-10T22:27:09.363 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:09.359+0000 7f8e9f7fe640 1 -- 172.21.15.19:0/722351112 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 18) ==== 153250+0+0 (secure 0 0 0) 0x7f8e9800f450 con 0x7f8ea81029b0 2024-09-10T22:27:09.363 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:09.359+0000 7f8eb33e2740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55b4ab550860 0x55b4ab552c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:27:09.363 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:09.360+0000 7f8eb33e2740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b4ab553190 0x55b4ab555580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:27:09.364 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:09.360+0000 7f8eb33e2740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55b4ab555bd0 0x55b4ab558090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:27:09.364 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:09.360+0000 7f8eb33e2740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x55b4ab4c26f0 con 0x55b4ab555bd0 2024-09-10T22:27:09.364 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:09.360+0000 7f8eb33e2740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55b4ab4b1b20 con 0x55b4ab553190 2024-09-10T22:27:09.364 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:09.360+0000 7f8eb33e2740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x55b4ab4b5930 con 0x55b4ab550860 2024-09-10T22:27:09.364 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:09.360+0000 7f8eadad5640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55b4ab555bd0 0x55b4ab558090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:27:09.364 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:09.360+0000 7f8eadad5640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55b4ab555bd0 0x55b4ab558090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:32788/0 (socket says 172.21.15.19:32788) 2024-09-10T22:27:09.364 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:09.360+0000 7f8eadad5640 1 -- 172.21.15.19:0/1561999019 learned_addr learned my addr 172.21.15.19:0/1561999019 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:27:09.364 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:09.360+0000 7f8eaead7640 1 --2- 172.21.15.19:0/1561999019 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55b4ab550860 0x55b4ab552c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:27:09.364 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:09.360+0000 7f8eae2d6640 1 --2- 172.21.15.19:0/1561999019 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b4ab553190 0x55b4ab555580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:27:09.364 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:09.360+0000 7f8eadad5640 1 -- 172.21.15.19:0/1561999019 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55b4ab550860 msgr2=0x55b4ab552c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:27:09.364 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:09.360+0000 7f8eadad5640 1 --2- 172.21.15.19:0/1561999019 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55b4ab550860 0x55b4ab552c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:27:09.365 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:09.360+0000 7f8eadad5640 1 -- 172.21.15.19:0/1561999019 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b4ab553190 msgr2=0x55b4ab555580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:27:09.365 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:09.360+0000 7f8eadad5640 1 --2- 172.21.15.19:0/1561999019 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b4ab553190 0x55b4ab555580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:27:09.365 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:09.360+0000 7f8eadad5640 1 -- 172.21.15.19:0/1561999019 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b4ab477530 con 0x55b4ab555bd0 2024-09-10T22:27:09.365 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:09.360+0000 7f8eaead7640 1 --2- 172.21.15.19:0/1561999019 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55b4ab550860 0x55b4ab552c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T22:27:09.365 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:09.360+0000 7f8eadad5640 1 --2- 172.21.15.19:0/1561999019 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55b4ab555bd0 0x55b4ab558090 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f8e980e9f40 tx=0x7f8e980ee1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=68bbc88fddeb5d4d server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:27:09.365 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:09.361+0000 7f8e9cbfe640 1 -- 172.21.15.19:0/1561999019 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e980f9070 con 0x55b4ab555bd0 2024-09-10T22:27:09.365 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:09.361+0000 7f8e9cbfe640 1 -- 172.21.15.19:0/1561999019 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8e980eed80 con 0x55b4ab555bd0 2024-09-10T22:27:09.365 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:09.361+0000 7f8e9cbfe640 1 -- 172.21.15.19:0/1561999019 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e980f36d0 con 0x55b4ab555bd0 2024-09-10T22:27:09.365 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:09.361+0000 7f8e9f7fe640 1 --2- 172.21.15.19:0/722351112 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f8e940b52e0 0x7f8e940b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:27:09.365 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:09.361+0000 7f8eaead7640 1 --2- 172.21.15.19:0/722351112 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f8e940b52e0 0x7f8e940b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:27:09.365 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:09.361+0000 7f8e9f7fe640 1 -- 172.21.15.19:0/722351112 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8327+0+0 (secure 0 0 0) 0x7f8e980e5e30 con 0x7f8ea81029b0 2024-09-10T22:27:09.365 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:09.362+0000 7f8eaead7640 1 --2- 172.21.15.19:0/722351112 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f8e940b52e0 0x7f8e940b77a0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f8ea0009430 tx=0x7f8ea0031870 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:27:09.365 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:09.362+0000 7f8eb33e2740 1 -- 172.21.15.19:0/1561999019 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55b4ab555bd0 msgr2=0x55b4ab558090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:27:09.366 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:09.362+0000 7f8eb33e2740 1 --2- 172.21.15.19:0/1561999019 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55b4ab555bd0 0x55b4ab558090 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f8e980e9f40 tx=0x7f8e980ee1a0 comp rx=0 tx=0).stop 2024-09-10T22:27:09.366 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:09.362+0000 7f8eb33e2740 1 -- 172.21.15.19:0/1561999019 shutdown_connections 2024-09-10T22:27:09.366 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:09.362+0000 7f8eb33e2740 1 --2- 172.21.15.19:0/1561999019 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55b4ab555bd0 0x55b4ab558090 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:27:09.366 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:09.362+0000 7f8eb33e2740 1 --2- 172.21.15.19:0/1561999019 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b4ab553190 0x55b4ab555580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:27:09.366 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:09.362+0000 7f8eb33e2740 1 --2- 172.21.15.19:0/1561999019 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55b4ab550860 0x55b4ab552c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:27:09.366 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:09.362+0000 7f8eb33e2740 1 -- 172.21.15.19:0/1561999019 >> 172.21.15.19:0/1561999019 conn(0x55b4ab54b9b0 msgr2=0x55b4ab54c740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:27:09.366 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:09.362+0000 7f8eb33e2740 1 -- 172.21.15.19:0/1561999019 shutdown_connections 2024-09-10T22:27:09.366 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:09.362+0000 7f8eb33e2740 1 -- 172.21.15.19:0/1561999019 wait complete. 2024-09-10T22:27:09.366 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:09.362+0000 7f8eb33e2740 1 -- start start 2024-09-10T22:27:09.366 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:09.362+0000 7f8eb33e2740 1 Processor -- start 2024-09-10T22:27:09.370 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:09.362+0000 7f8eb33e2740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b4ab550860 0x55b4ab559ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:27:09.370 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:09.362+0000 7f8eb33e2740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55b4ab553190 0x55b4ab55a590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:27:09.370 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:09.363+0000 7f8eb33e2740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55b4ab555bd0 0x55b4ab55b160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:27:09.370 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:09.363+0000 7f8eb33e2740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x55b4ab3e9ab0 con 0x55b4ab555bd0 2024-09-10T22:27:09.370 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:09.363+0000 7f8eb33e2740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55b4ab457730 con 0x55b4ab550860 2024-09-10T22:27:09.370 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:09.363+0000 7f8eb33e2740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x55b4ab558bb0 con 0x55b4ab553190 2024-09-10T22:27:09.370 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:09.363+0000 7f8eb33e2740 10 client.0 _ll_register_callbacks cb 0x55b4ab4ab6b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T22:27:09.370 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:09.363+0000 7f8eaead7640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55b4ab555bd0 0x55b4ab55b160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:27:09.370 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:09.363+0000 7f8eaead7640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55b4ab555bd0 0x55b4ab55b160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:32802/0 (socket says 172.21.15.19:32802) 2024-09-10T22:27:09.370 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:09.363+0000 7f8eaead7640 1 -- 172.21.15.19:0/1044082702 learned_addr learned my addr 172.21.15.19:0/1044082702 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:27:09.371 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:09.363+0000 7f8eae2d6640 1 --2- 172.21.15.19:0/1044082702 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b4ab550860 0x55b4ab559ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:27:09.371 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:09.363+0000 7f8eadad5640 1 --2- 172.21.15.19:0/1044082702 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55b4ab553190 0x55b4ab55a590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:27:09.371 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:09.363+0000 7f8eaead7640 1 -- 172.21.15.19:0/1044082702 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55b4ab553190 msgr2=0x55b4ab55a590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:27:09.371 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:09.363+0000 7f8eaead7640 1 --2- 172.21.15.19:0/1044082702 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55b4ab553190 0x55b4ab55a590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:27:09.371 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:09.363+0000 7f8eaead7640 1 -- 172.21.15.19:0/1044082702 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b4ab550860 msgr2=0x55b4ab559ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:27:09.371 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:09.363+0000 7f8eaead7640 1 --2- 172.21.15.19:0/1044082702 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b4ab550860 0x55b4ab559ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:27:09.371 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:09.363+0000 7f8eaead7640 1 -- 172.21.15.19:0/1044082702 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b4ab213790 con 0x55b4ab555bd0 2024-09-10T22:27:09.371 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:09.363+0000 7f8eaead7640 1 --2- 172.21.15.19:0/1044082702 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55b4ab555bd0 0x55b4ab55b160 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f8ea0009cd0 tx=0x7f8ea002a8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=20cb4ac382064bf3 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:27:09.371 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:09.363+0000 7f8e91ffb640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-10T22:27:09.371 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:09.363+0000 7f8e91ffb640 1 -- 172.21.15.19:0/1044082702 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ea0055060 con 0x55b4ab555bd0 2024-09-10T22:27:09.371 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:09.363+0000 7f8eb33e2740 1 -- 172.21.15.19:0/1044082702 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8e980eed80 con 0x55b4ab555bd0 2024-09-10T22:27:09.371 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:09.363+0000 7f8e91ffb640 1 -- 172.21.15.19:0/1044082702 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8327+0+0 (secure 0 0 0) 0x7f8ea00047a0 con 0x55b4ab555bd0 2024-09-10T22:27:09.371 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:09.364+0000 7f8e91ffb640 1 -- 172.21.15.19:0/1044082702 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f8ea00305a0 con 0x55b4ab555bd0 2024-09-10T22:27:09.372 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:09.364+0000 7f8eb33e2740 10 client.15537 fetch_fsmap learned FSMap version 25 2024-09-10T22:27:09.372 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:09.364+0000 7f8eb33e2740 1 -- 172.21.15.19:0/1044082702 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55b4ab28c620 con 0x55b4ab555bd0 2024-09-10T22:27:09.372 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:09.364+0000 7f8e91ffb640 1 -- 172.21.15.19:0/1044082702 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8e980eed80 con 0x55b4ab555bd0 2024-09-10T22:27:09.372 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:09.364+0000 7f8e91ffb640 1 -- 172.21.15.19:0/1044082702 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f8ea0059030 con 0x55b4ab555bd0 2024-09-10T22:27:09.372 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:09.364+0000 7f8eb33e2740 10 client.15537 fetch_fsmap finished waiting for FSMap version 25 2024-09-10T22:27:09.372 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:09.364+0000 7f8eb33e2740 10 client.15537 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-10T22:27:09.372 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:09.364+0000 7f8eb33e2740 20 client.15537 populate_metadata read hostname 'smithi019' 2024-09-10T22:27:09.372 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:09.364+0000 7f8eb33e2740 1 --2- 172.21.15.19:0/1044082702 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x55b4ab5657d0 0x55b4ab567c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:27:09.372 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:09.364+0000 7f8eb33e2740 4 client.15537 mds_command: new command op to 24581 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T22:27:09.372 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:09.364+0000 7f8eb33e2740 1 -- 172.21.15.19:0/1044082702 --> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b4ab4c4640 con 0x55b4ab5657d0 2024-09-10T22:27:09.372 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:09.364+0000 7f8eae2d6640 1 --2- 172.21.15.19:0/1044082702 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x55b4ab5657d0 0x55b4ab567c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:27:09.373 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:09.365+0000 7f8eae2d6640 1 --2- 172.21.15.19:0/1044082702 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x55b4ab5657d0 0x55b4ab567c90 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=89eb2239307d687d server_cookie=5db56cfbed37db90 in_seq=0 out_seq=0 2024-09-10T22:27:09.373 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:09.365+0000 7f8e91ffb640 10 client.15537 ms_handle_connect on v2:172.21.15.135:6838/1254769802 2024-09-10T22:27:09.373 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:09.365+0000 7f8e91ffb640 1 -- 172.21.15.19:0/1044082702 <== mds.0 v2:172.21.15.135:6838/1254769802 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55b4ab4c4640 con 0x55b4ab5657d0 2024-09-10T22:27:09.373 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:09.365+0000 7f8e91ffb640 10 client.15537 handle_command_reply: tid=0 2024-09-10T22:27:09.373 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:09.366+0000 7f8eb33e2740 1 client.15537 shutdown 2024-09-10T22:27:09.373 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:09.366+0000 7f8eb33e2740 1 -- 172.21.15.19:0/1044082702 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55b4ab555bd0 msgr2=0x55b4ab55b160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:27:09.373 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:09.366+0000 7f8eb33e2740 1 --2- 172.21.15.19:0/1044082702 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55b4ab555bd0 0x55b4ab55b160 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f8ea0009cd0 tx=0x7f8ea002a8e0 comp rx=0 tx=0).stop 2024-09-10T22:27:09.373 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:09.366+0000 7f8eb33e2740 1 -- 172.21.15.19:0/1044082702 shutdown_connections 2024-09-10T22:27:09.373 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:09.366+0000 7f8eb33e2740 1 --2- 172.21.15.19:0/1044082702 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55b4ab555bd0 0x55b4ab55b160 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:27:09.373 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:09.366+0000 7f8eb33e2740 1 --2- 172.21.15.19:0/1044082702 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x55b4ab5657d0 0x55b4ab567c90 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:27:09.373 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:09.366+0000 7f8eb33e2740 1 --2- 172.21.15.19:0/1044082702 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55b4ab553190 0x55b4ab55a590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:27:09.373 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:09.366+0000 7f8e91ffb640 0 client.15537 ms_handle_reset on v2:172.21.15.135:6838/1254769802 2024-09-10T22:27:09.373 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:09.366+0000 7f8eb33e2740 1 --2- 172.21.15.19:0/1044082702 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b4ab550860 0x55b4ab559ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:27:09.374 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:09.366+0000 7f8eb33e2740 1 -- 172.21.15.19:0/1044082702 >> 172.21.15.19:0/1044082702 conn(0x55b4ab54b9b0 msgr2=0x55b4ab54abf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:27:09.374 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:09.366+0000 7f8eb33e2740 1 -- 172.21.15.19:0/1044082702 shutdown_connections 2024-09-10T22:27:09.374 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:09.366+0000 7f8eb33e2740 1 -- 172.21.15.19:0/1044082702 wait complete. 2024-09-10T22:27:09.374 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:09.366+0000 7f8eb33e2740 20 client.15537 trim_cache size 0 max 16384 2024-09-10T22:27:09.383 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:09.381+0000 7f8eb33e2740 1 Processor -- start 2024-09-10T22:27:09.383 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:09.381+0000 7f8eb33e2740 1 -- start start 2024-09-10T22:27:09.383 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:09.381+0000 7f8eb33e2740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b4ab550860 0x55b4ab556020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:27:09.383 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:09.381+0000 7f8eb33e2740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55b4ab553190 0x55b4ab556560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:27:09.384 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:09.381+0000 7f8eb33e2740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55b4ab555bd0 0x55b4ab54fcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:27:09.384 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:09.381+0000 7f8eb33e2740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f8ea81aea50 con 0x55b4ab553190 2024-09-10T22:27:09.384 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:09.381+0000 7f8eb33e2740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f8ea81ac320 con 0x55b4ab550860 2024-09-10T22:27:09.384 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:09.381+0000 7f8eb33e2740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f8ea81aa170 con 0x55b4ab555bd0 2024-09-10T22:27:09.384 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:09.381+0000 7f8eadad5640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55b4ab553190 0x55b4ab556560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:27:09.384 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:09.381+0000 7f8eadad5640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55b4ab553190 0x55b4ab556560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:32810/0 (socket says 172.21.15.19:32810) 2024-09-10T22:27:09.384 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:09.381+0000 7f8eadad5640 1 -- 172.21.15.19:0/2000939839 learned_addr learned my addr 172.21.15.19:0/2000939839 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:27:09.384 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:09.381+0000 7f8eae2d6640 1 --2- 172.21.15.19:0/2000939839 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b4ab550860 0x55b4ab556020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:27:09.384 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:09.381+0000 7f8eaead7640 1 --2- 172.21.15.19:0/2000939839 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55b4ab555bd0 0x55b4ab54fcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:27:09.384 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:09.381+0000 7f8eadad5640 1 -- 172.21.15.19:0/2000939839 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55b4ab555bd0 msgr2=0x55b4ab54fcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:27:09.384 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:09.381+0000 7f8eadad5640 1 --2- 172.21.15.19:0/2000939839 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55b4ab555bd0 0x55b4ab54fcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:27:09.384 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:09.381+0000 7f8eadad5640 1 -- 172.21.15.19:0/2000939839 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b4ab550860 msgr2=0x55b4ab556020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:27:09.385 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:09.381+0000 7f8eadad5640 1 --2- 172.21.15.19:0/2000939839 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b4ab550860 0x55b4ab556020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:27:09.385 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:09.382+0000 7f8eadad5640 1 -- 172.21.15.19:0/2000939839 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b4ab5558f0 con 0x55b4ab553190 2024-09-10T22:27:09.385 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:09.382+0000 7f8eae2d6640 1 --2- 172.21.15.19:0/2000939839 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b4ab550860 0x55b4ab556020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T22:27:09.385 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:09.382+0000 7f8eadad5640 1 --2- 172.21.15.19:0/2000939839 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55b4ab553190 0x55b4ab556560 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f8e980ee6a0 tx=0x7f8e980076c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cbdf231e9d7c23ed server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:27:09.385 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:09.382+0000 7f8e93fff640 1 -- 172.21.15.19:0/2000939839 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e980a8430 con 0x55b4ab553190 2024-09-10T22:27:09.385 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:09.382+0000 7f8e93fff640 1 -- 172.21.15.19:0/2000939839 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8e980ac0a0 con 0x55b4ab553190 2024-09-10T22:27:09.385 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:09.382+0000 7f8e93fff640 1 -- 172.21.15.19:0/2000939839 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e980abd00 con 0x55b4ab553190 2024-09-10T22:27:09.388 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:09.383+0000 7f8eb33e2740 1 -- 172.21.15.19:0/2000939839 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55b4ab553190 msgr2=0x55b4ab556560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:27:09.388 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:09.383+0000 7f8eb33e2740 1 --2- 172.21.15.19:0/2000939839 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55b4ab553190 0x55b4ab556560 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f8e980ee6a0 tx=0x7f8e980076c0 comp rx=0 tx=0).stop 2024-09-10T22:27:09.389 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:09.383+0000 7f8eb33e2740 1 -- 172.21.15.19:0/2000939839 shutdown_connections 2024-09-10T22:27:09.389 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:09.383+0000 7f8eb33e2740 1 --2- 172.21.15.19:0/2000939839 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55b4ab555bd0 0x55b4ab54fcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:27:09.389 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:09.383+0000 7f8eb33e2740 1 --2- 172.21.15.19:0/2000939839 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55b4ab553190 0x55b4ab556560 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:27:09.389 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:09.383+0000 7f8eb33e2740 1 --2- 172.21.15.19:0/2000939839 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b4ab550860 0x55b4ab556020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:27:09.389 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:09.383+0000 7f8eb33e2740 1 -- 172.21.15.19:0/2000939839 >> 172.21.15.19:0/2000939839 conn(0x55b4ab54b9b0 msgr2=0x55b4ab546af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:27:09.389 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:09.383+0000 7f8eb33e2740 1 -- 172.21.15.19:0/2000939839 shutdown_connections 2024-09-10T22:27:09.389 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:09.383+0000 7f8eb33e2740 1 -- 172.21.15.19:0/2000939839 wait complete. 2024-09-10T22:27:09.389 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:09.383+0000 7f8eb33e2740 1 -- start start 2024-09-10T22:27:09.389 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:09.383+0000 7f8eb33e2740 1 Processor -- start 2024-09-10T22:27:09.389 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:09.383+0000 7f8eb33e2740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55b4ab550860 0x55b4ab561690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:27:09.389 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:09.383+0000 7f8eb33e2740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b4ab553190 0x55b4ab560330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:27:09.389 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:09.383+0000 7f8eb33e2740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55b4ab555bd0 0x55b4ab560870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:27:09.389 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:09.383+0000 7f8eb33e2740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f8ea81aa7e0 con 0x55b4ab555bd0 2024-09-10T22:27:09.390 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:09.383+0000 7f8eb33e2740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f8ea81abc50 con 0x55b4ab553190 2024-09-10T22:27:09.390 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:09.383+0000 7f8eb33e2740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f8ea81aaeb0 con 0x55b4ab550860 2024-09-10T22:27:09.390 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:09.383+0000 7f8eb33e2740 10 client.0 _ll_register_callbacks cb 0x7f8ea0009800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T22:27:09.390 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:09.383+0000 7f8eaead7640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55b4ab555bd0 0x55b4ab560870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:27:09.390 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:09.384+0000 7f8eaead7640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55b4ab555bd0 0x55b4ab560870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:32826/0 (socket says 172.21.15.19:32826) 2024-09-10T22:27:09.390 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:09.384+0000 7f8eaead7640 1 -- 172.21.15.19:0/969021197 learned_addr learned my addr 172.21.15.19:0/969021197 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:27:09.390 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:09.384+0000 7f8eadad5640 1 --2- 172.21.15.19:0/969021197 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b4ab553190 0x55b4ab560330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:27:09.390 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:09.384+0000 7f8eae2d6640 1 --2- 172.21.15.19:0/969021197 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55b4ab550860 0x55b4ab561690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:27:09.390 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:09.384+0000 7f8eaead7640 1 -- 172.21.15.19:0/969021197 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55b4ab550860 msgr2=0x55b4ab561690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:27:09.390 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:09.384+0000 7f8eaead7640 1 --2- 172.21.15.19:0/969021197 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55b4ab550860 0x55b4ab561690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:27:09.390 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:09.384+0000 7f8eaead7640 1 -- 172.21.15.19:0/969021197 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b4ab553190 msgr2=0x55b4ab560330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:27:09.390 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:09.384+0000 7f8eaead7640 1 --2- 172.21.15.19:0/969021197 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b4ab553190 0x55b4ab560330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:27:09.391 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:09.384+0000 7f8eaead7640 1 -- 172.21.15.19:0/969021197 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b4ab560db0 con 0x55b4ab555bd0 2024-09-10T22:27:09.391 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:09.384+0000 7f8eaead7640 1 --2- 172.21.15.19:0/969021197 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55b4ab555bd0 0x55b4ab560870 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f8ea0042040 tx=0x7f8ea0004410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2a5edbf549faa294 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:27:09.391 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:09.384+0000 7f8e91ffb640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-10T22:27:09.391 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:09.384+0000 7f8e91ffb640 1 -- 172.21.15.19:0/969021197 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ea0055040 con 0x55b4ab555bd0 2024-09-10T22:27:09.391 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:09.384+0000 7f8e91ffb640 1 -- 172.21.15.19:0/969021197 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8327+0+0 (secure 0 0 0) 0x7f8ea0046e40 con 0x55b4ab555bd0 2024-09-10T22:27:09.391 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:09.384+0000 7f8eb33e2740 1 -- 172.21.15.19:0/969021197 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8e980ac0a0 con 0x55b4ab555bd0 2024-09-10T22:27:09.391 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:09.384+0000 7f8e91ffb640 1 -- 172.21.15.19:0/969021197 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f8ea006a050 con 0x55b4ab555bd0 2024-09-10T22:27:09.391 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:09.384+0000 7f8eb33e2740 10 client.15543 fetch_fsmap learned FSMap version 25 2024-09-10T22:27:09.391 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:09.384+0000 7f8eb33e2740 1 -- 172.21.15.19:0/969021197 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55b4ab55ff30 con 0x55b4ab555bd0 2024-09-10T22:27:09.391 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:09.385+0000 7f8e91ffb640 1 -- 172.21.15.19:0/969021197 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8e980ac0a0 con 0x55b4ab555bd0 2024-09-10T22:27:09.391 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:09.385+0000 7f8e91ffb640 1 -- 172.21.15.19:0/969021197 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f8ea0059040 con 0x55b4ab555bd0 2024-09-10T22:27:09.391 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:09.385+0000 7f8eb33e2740 10 client.15543 fetch_fsmap finished waiting for FSMap version 25 2024-09-10T22:27:09.392 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:09.385+0000 7f8eb33e2740 10 client.15543 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-10T22:27:09.392 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:09.385+0000 7f8eb33e2740 20 client.15543 populate_metadata read hostname 'smithi019' 2024-09-10T22:27:09.392 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:09.385+0000 7f8eb33e2740 1 --2- 172.21.15.19:0/969021197 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x55b4ab5d2e90 0x55b4ab5d52b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:27:09.392 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:09.385+0000 7f8eb33e2740 4 client.15543 mds_command: new command op to 24581 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-10T22:27:09.392 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:09.385+0000 7f8eb33e2740 1 -- 172.21.15.19:0/969021197 --> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55b4ab4c00f0 con 0x55b4ab5d2e90 2024-09-10T22:27:09.392 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:09.385+0000 7f8eae2d6640 1 --2- 172.21.15.19:0/969021197 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x55b4ab5d2e90 0x55b4ab5d52b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:27:09.392 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:09.385+0000 7f8eae2d6640 1 --2- 172.21.15.19:0/969021197 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x55b4ab5d2e90 0x55b4ab5d52b0 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4781682be3b8f75 server_cookie=846494f53d4ec12a in_seq=0 out_seq=0 2024-09-10T22:27:09.392 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:09.385+0000 7f8e91ffb640 10 client.15543 ms_handle_connect on v2:172.21.15.135:6838/1254769802 2024-09-10T22:27:09.393 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:09.389+0000 7f8e91ffb640 1 -- 172.21.15.19:0/969021197 <== mds.0 v2:172.21.15.135:6838/1254769802 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55b4ab4c00f0 con 0x55b4ab5d2e90 2024-09-10T22:27:09.394 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:09.389+0000 7f8e91ffb640 10 client.15543 handle_command_reply: tid=0 2024-09-10T22:27:09.394 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:09.389+0000 7f8eb33e2740 1 client.15543 shutdown 2024-09-10T22:27:09.394 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:09.389+0000 7f8eb33e2740 1 -- 172.21.15.19:0/969021197 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55b4ab555bd0 msgr2=0x55b4ab560870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:27:09.394 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:09.389+0000 7f8eb33e2740 1 --2- 172.21.15.19:0/969021197 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55b4ab555bd0 0x55b4ab560870 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f8ea0042040 tx=0x7f8ea0004410 comp rx=0 tx=0).stop 2024-09-10T22:27:09.394 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:09.389+0000 7f8eb33e2740 1 -- 172.21.15.19:0/969021197 shutdown_connections 2024-09-10T22:27:09.394 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:09.389+0000 7f8eb33e2740 1 --2- 172.21.15.19:0/969021197 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55b4ab555bd0 0x55b4ab560870 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:27:09.394 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:09.389+0000 7f8eb33e2740 1 --2- 172.21.15.19:0/969021197 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b4ab553190 0x55b4ab560330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:27:09.394 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:09.389+0000 7f8eb33e2740 1 --2- 172.21.15.19:0/969021197 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x55b4ab5d2e90 0x55b4ab5d52b0 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:27:09.394 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:09.389+0000 7f8eb33e2740 1 --2- 172.21.15.19:0/969021197 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55b4ab550860 0x55b4ab561690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:27:09.394 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:09.389+0000 7f8e91ffb640 0 client.15543 ms_handle_reset on v2:172.21.15.135:6838/1254769802 2024-09-10T22:27:09.394 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:09.389+0000 7f8eb33e2740 1 -- 172.21.15.19:0/969021197 >> 172.21.15.19:0/969021197 conn(0x55b4ab54b9b0 msgr2=0x55b4ab556020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:27:09.395 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:09.389+0000 7f8eb33e2740 1 -- 172.21.15.19:0/969021197 shutdown_connections 2024-09-10T22:27:09.395 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:09.390+0000 7f8eb33e2740 1 -- 172.21.15.19:0/969021197 wait complete. 2024-09-10T22:27:09.395 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:09.390+0000 7f8eb33e2740 20 client.15543 trim_cache size 0 max 16384 2024-09-10T22:27:09.395 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stdout:{ 2024-09-10T22:27:09.395 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stdout: "message": "", 2024-09-10T22:27:09.395 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stdout: "return_code": 0 2024-09-10T22:27:09.395 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stdout:} 2024-09-10T22:27:09.396 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:09.390+0000 7f8eb053a640 1 -- 172.21.15.19:0/722351112 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f8e940b52e0 msgr2=0x7f8e940b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:27:09.396 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:09.390+0000 7f8eb053a640 1 --2- 172.21.15.19:0/722351112 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f8e940b52e0 0x7f8e940b77a0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f8ea0009430 tx=0x7f8ea0031870 comp rx=0 tx=0).stop 2024-09-10T22:27:09.396 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:09.390+0000 7f8eb053a640 1 -- 172.21.15.19:0/722351112 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8ea81029b0 msgr2=0x7f8ea8103e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:27:09.396 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:09.390+0000 7f8eb053a640 1 --2- 172.21.15.19:0/722351112 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8ea81029b0 0x7f8ea8103e80 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f8e9800c920 tx=0x7f8e9800cde0 comp rx=0 tx=0).stop 2024-09-10T22:27:09.396 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:09.390+0000 7f8eb053a640 1 -- 172.21.15.19:0/722351112 shutdown_connections 2024-09-10T22:27:09.396 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:09.390+0000 7f8eb053a640 1 --2- 172.21.15.19:0/722351112 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f8e940b52e0 0x7f8e940b77a0 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:27:09.397 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:09.390+0000 7f8eb053a640 1 --2- 172.21.15.19:0/722351112 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8ea8103370 0x7f8ea81043c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:27:09.397 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:09.390+0000 7f8eb053a640 1 --2- 172.21.15.19:0/722351112 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8ea81029b0 0x7f8ea8103e80 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:27:09.397 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:09.390+0000 7f8eb053a640 1 --2- 172.21.15.19:0/722351112 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f8ea8101860 0x7f8ea8105620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:27:09.397 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:09.390+0000 7f8eb053a640 1 -- 172.21.15.19:0/722351112 >> 172.21.15.19:0/722351112 conn(0x7f8ea80fd140 msgr2=0x7f8ea80fead0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:27:09.397 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:09.390+0000 7f8eb053a640 1 -- 172.21.15.19:0/722351112 shutdown_connections 2024-09-10T22:27:09.397 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:09.390+0000 7f8eb053a640 1 -- 172.21.15.19:0/722351112 wait complete. 2024-09-10T22:27:09.760 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:27:09 smithi019 ceph-mon[31375]: pgmap v369: 97 pgs: 97 active+clean; 665 KiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 767 B/s wr, 7 op/s 2024-09-10T22:27:09.859 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:27:09 smithi135 ceph-mon[34789]: pgmap v369: 97 pgs: 97 active+clean; 665 KiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 767 B/s wr, 7 op/s 2024-09-10T22:27:09.875 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:27:09 smithi138 ceph-mon[35236]: pgmap v369: 97 pgs: 97 active+clean; 665 KiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 767 B/s wr, 7 op/s 2024-09-10T22:27:10.429 INFO:tasks.workunit.client.0.smithi019.stderr:Updating files: 96% (11723/12088) Updating files: 97% (11726/12088) Updating files: 98% (11847/12088) Updating files: 99% (11968/12088) Updating files: 100% (12088/12088) Updating files: 100% (12088/12088), done. 2024-09-10T22:27:11.326 INFO:tasks.workunit.client.0.smithi019.stderr:Note: switching to '8f219c476cb4f26fc5719c661c0323719a45cb30'. 2024-09-10T22:27:11.326 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-10T22:27:11.326 INFO:tasks.workunit.client.0.smithi019.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-09-10T22:27:11.326 INFO:tasks.workunit.client.0.smithi019.stderr:changes and commit them, and you can discard any commits you make in this 2024-09-10T22:27:11.327 INFO:tasks.workunit.client.0.smithi019.stderr:state without impacting any branches by switching back to a branch. 2024-09-10T22:27:11.327 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-10T22:27:11.327 INFO:tasks.workunit.client.0.smithi019.stderr:If you want to create a new branch to retain commits you create, you may 2024-09-10T22:27:11.327 INFO:tasks.workunit.client.0.smithi019.stderr:do so (now or later) by using -c with the switch command. Example: 2024-09-10T22:27:11.327 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-10T22:27:11.327 INFO:tasks.workunit.client.0.smithi019.stderr: git switch -c 2024-09-10T22:27:11.327 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-10T22:27:11.327 INFO:tasks.workunit.client.0.smithi019.stderr:Or undo this operation with: 2024-09-10T22:27:11.327 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-10T22:27:11.327 INFO:tasks.workunit.client.0.smithi019.stderr: git switch - 2024-09-10T22:27:11.327 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-10T22:27:11.327 INFO:tasks.workunit.client.0.smithi019.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-09-10T22:27:11.327 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-10T22:27:11.328 INFO:tasks.workunit.client.0.smithi019.stderr:HEAD is now at 8f219c476cb Merge branch 'mgr-vol-mod-disable' of https://github.com/rishabh-d-dave/ceph into wip-hemanth-testing-2024-09-10-0723 2024-09-10T22:27:11.331 DEBUG:teuthology.orchestra.run.smithi019:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-09-10T22:27:11.368 INFO:tasks.workunit.client.0.smithi019.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-09-10T22:27:11.370 INFO:tasks.workunit.client.0.smithi019.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-10T22:27:11.370 INFO:tasks.workunit.client.0.smithi019.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-09-10T22:27:11.860 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:27:11 smithi135 ceph-mon[34789]: pgmap v370: 97 pgs: 97 active+clean; 665 KiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 767 B/s wr, 8 op/s 2024-09-10T22:27:11.874 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:27:11 smithi138 ceph-mon[35236]: pgmap v370: 97 pgs: 97 active+clean; 665 KiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 767 B/s wr, 8 op/s 2024-09-10T22:27:11.958 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:27:11 smithi019 ceph-mon[31375]: pgmap v370: 97 pgs: 97 active+clean; 665 KiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 767 B/s wr, 8 op/s 2024-09-10T22:27:12.075 INFO:tasks.workunit.client.0.smithi019.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-09-10T22:27:12.140 INFO:tasks.workunit.client.0.smithi019.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-09-10T22:27:12.181 INFO:tasks.workunit.client.0.smithi019.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-10T22:27:12.182 INFO:tasks.workunit.client.0.smithi019.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-10T22:27:12.182 INFO:tasks.workunit.client.0.smithi019.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-09-10T22:27:12.223 INFO:tasks.workunit.client.0.smithi019.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-10T22:27:12.227 DEBUG:teuthology.orchestra.run.smithi019:> set -ex 2024-09-10T22:27:12.227 DEBUG:teuthology.orchestra.run.smithi019:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-09-10T22:27:12.284 INFO:tasks.workunit:Running workunits matching suites/iogen.sh on client.0... 2024-09-10T22:27:12.285 INFO:tasks.workunit:Running workunit suites/iogen.sh... 2024-09-10T22:27:12.285 DEBUG:teuthology.orchestra.run.smithi019:workunit test suites/iogen.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=8f219c476cb4f26fc5719c661c0323719a45cb30 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/suites/iogen.sh 2024-09-10T22:27:12.347 INFO:tasks.workunit.client.0.smithi019.stdout:getting iogen 2024-09-10T22:27:12.348 INFO:tasks.workunit.client.0.smithi019.stderr:+ echo 'getting iogen' 2024-09-10T22:27:12.348 INFO:tasks.workunit.client.0.smithi019.stderr:+ wget http://download.ceph.com/qa/iogen_3.1p0.tar 2024-09-10T22:27:12.366 INFO:tasks.workunit.client.0.smithi019.stderr:--2024-09-10 22:27:12-- http://download.ceph.com/qa/iogen_3.1p0.tar 2024-09-10T22:27:12.366 INFO:tasks.workunit.client.0.smithi019.stderr:Resolving download.ceph.com (download.ceph.com)... 158.69.68.124, 2607:5300:201:2000::3:58a1 2024-09-10T22:27:12.387 INFO:tasks.workunit.client.0.smithi019.stderr:Connecting to download.ceph.com (download.ceph.com)|158.69.68.124|:80... connected. 2024-09-10T22:27:12.408 INFO:tasks.workunit.client.0.smithi019.stderr:HTTP request sent, awaiting response... 200 OK 2024-09-10T22:27:12.408 INFO:tasks.workunit.client.0.smithi019.stderr:Length: 8071 (7.9K) [application/octet-stream] 2024-09-10T22:27:12.409 INFO:tasks.workunit.client.0.smithi019.stderr:Saving to: ‘iogen_3.1p0.tar’ 2024-09-10T22:27:12.413 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-10T22:27:12.413 INFO:tasks.workunit.client.0.smithi019.stderr: 0K ....... 100% 549M=0s 2024-09-10T22:27:12.413 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-10T22:27:12.413 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-10 22:27:12 (549 MB/s) - ‘iogen_3.1p0.tar’ saved [8071/8071] 2024-09-10T22:27:12.413 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-10T22:27:12.413 INFO:tasks.workunit.client.0.smithi019.stderr:+ tar -xvzf iogen_3.1p0.tar 2024-09-10T22:27:12.424 INFO:tasks.workunit.client.0.smithi019.stdout:iogen_3.1p0 2024-09-10T22:27:12.425 INFO:tasks.workunit.client.0.smithi019.stdout:iogen_3.1p0/src 2024-09-10T22:27:12.426 INFO:tasks.workunit.client.0.smithi019.stdout:iogen_3.1p0/src/iogen.8 2024-09-10T22:27:12.428 INFO:tasks.workunit.client.0.smithi019.stdout:iogen_3.1p0/src/iogen.c 2024-09-10T22:27:12.429 INFO:tasks.workunit.client.0.smithi019.stdout:iogen_3.1p0/README 2024-09-10T22:27:12.430 INFO:tasks.workunit.client.0.smithi019.stdout:iogen_3.1p0/Makefile.bsd 2024-09-10T22:27:12.432 INFO:tasks.workunit.client.0.smithi019.stdout:iogen_3.1p0/Makefile 2024-09-10T22:27:12.433 INFO:tasks.workunit.client.0.smithi019.stderr:+ cd iogen_3.1p0 2024-09-10T22:27:12.434 INFO:tasks.workunit.client.0.smithi019.stdout:making iogen 2024-09-10T22:27:12.434 INFO:tasks.workunit.client.0.smithi019.stderr:+ echo 'making iogen' 2024-09-10T22:27:12.434 INFO:tasks.workunit.client.0.smithi019.stderr:+ make 2024-09-10T22:27:12.440 INFO:tasks.workunit.client.0.smithi019.stdout:gcc -D_FILE_OFFSET_BITS=64 -DVERSION=\"3.1p0\" -Dstrlcpy=strncpy -Darc4random=rand -O2 src/iogen.c -o iogen 2024-09-10T22:27:12.660 INFO:tasks.workunit.client.0.smithi019.stdout:nroff -mandoc -Tascii src/iogen.8 > iogen.cat8 2024-09-10T22:27:12.761 INFO:tasks.workunit.client.0.smithi019.stdout:running iogen 2024-09-10T22:27:12.762 INFO:tasks.workunit.client.0.smithi019.stderr:+ echo 'running iogen' 2024-09-10T22:27:12.762 INFO:tasks.workunit.client.0.smithi019.stderr:+ ./iogen -n 5 -s 2g 2024-09-10T22:27:12.762 INFO:tasks.workunit.client.0.smithi019.stderr:child spawned 87872 2024-09-10T22:27:12.763 INFO:tasks.workunit.client.0.smithi019.stderr:child spawned 87873 2024-09-10T22:27:12.763 INFO:tasks.workunit.client.0.smithi019.stderr:child spawned 87874 2024-09-10T22:27:12.763 INFO:tasks.workunit.client.0.smithi019.stderr:child spawned 87875 2024-09-10T22:27:12.763 INFO:tasks.workunit.client.0.smithi019.stderr:child spawned 87876 2024-09-10T22:27:12.763 INFO:tasks.workunit.client.0.smithi019.stdout:sleep for 10 min 2024-09-10T22:27:12.763 INFO:tasks.workunit.client.0.smithi019.stderr:+ echo 'sleep for 10 min' 2024-09-10T22:27:12.763 INFO:tasks.workunit.client.0.smithi019.stderr:+ sleep 600 2024-09-10T22:27:13.860 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:27:13 smithi135 ceph-mon[34789]: pgmap v371: 97 pgs: 97 active+clean; 666 KiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 682 B/s wr, 8 op/s 2024-09-10T22:27:13.875 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:27:13 smithi138 ceph-mon[35236]: pgmap v371: 97 pgs: 97 active+clean; 666 KiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 682 B/s wr, 8 op/s 2024-09-10T22:27:13.963 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:27:13 smithi019 ceph-mon[31375]: pgmap v371: 97 pgs: 97 active+clean; 666 KiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 682 B/s wr, 8 op/s 2024-09-10T22:27:15.860 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:27:15 smithi135 ceph-mon[34789]: pgmap v372: 97 pgs: 97 active+clean; 117 MiB data, 493 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 9.7 MiB/s wr, 8 op/s 2024-09-10T22:27:15.875 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:27:15 smithi138 ceph-mon[35236]: pgmap v372: 97 pgs: 97 active+clean; 117 MiB data, 493 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 9.7 MiB/s wr, 8 op/s 2024-09-10T22:27:15.958 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:27:15 smithi019 ceph-mon[31375]: pgmap v372: 97 pgs: 97 active+clean; 117 MiB data, 493 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 9.7 MiB/s wr, 8 op/s 2024-09-10T22:27:17.876 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:27:17 smithi138 ceph-mon[35236]: pgmap v373: 97 pgs: 97 active+clean; 1.0 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 227 KiB/s rd, 86 MiB/s wr, 98 op/s 2024-09-10T22:27:17.958 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:27:17 smithi019 ceph-mon[31375]: pgmap v373: 97 pgs: 97 active+clean; 1.0 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 227 KiB/s rd, 86 MiB/s wr, 98 op/s 2024-09-10T22:27:18.109 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:27:17 smithi135 ceph-mon[34789]: pgmap v373: 97 pgs: 97 active+clean; 1.0 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 227 KiB/s rd, 86 MiB/s wr, 98 op/s 2024-09-10T22:27:19.959 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:27:19 smithi019 ceph-mon[31375]: pgmap v374: 97 pgs: 97 active+clean; 1.3 GiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 226 KiB/s rd, 111 MiB/s wr, 102 op/s 2024-09-10T22:27:20.109 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:27:19 smithi135 ceph-mon[34789]: pgmap v374: 97 pgs: 97 active+clean; 1.3 GiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 226 KiB/s rd, 111 MiB/s wr, 102 op/s 2024-09-10T22:27:20.125 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:27:19 smithi138 ceph-mon[35236]: pgmap v374: 97 pgs: 97 active+clean; 1.3 GiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 226 KiB/s rd, 111 MiB/s wr, 102 op/s 2024-09-10T22:27:21.959 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:27:21 smithi019 ceph-mon[31375]: pgmap v375: 97 pgs: 97 active+clean; 4.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 640 KiB/s rd, 347 MiB/s wr, 315 op/s 2024-09-10T22:27:22.111 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:27:21 smithi135 ceph-mon[34789]: pgmap v375: 97 pgs: 97 active+clean; 4.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 640 KiB/s rd, 347 MiB/s wr, 315 op/s 2024-09-10T22:27:22.124 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:27:21 smithi138 ceph-mon[35236]: pgmap v375: 97 pgs: 97 active+clean; 4.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 640 KiB/s rd, 347 MiB/s wr, 315 op/s 2024-09-10T22:27:22.668 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:22.665+0000 7fee55025640 1 -- 172.21.15.19:0/894316483 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fee5010a3c0 msgr2=0x7fee5010a7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:27:22.669 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:22.665+0000 7fee4effd640 1 -- 172.21.15.19:0/894316483 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee40035020 con 0x7fee5010a3c0 2024-09-10T22:27:22.669 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:22.666+0000 7fee55025640 1 --2- 172.21.15.19:0/894316483 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fee5010a3c0 0x7fee5010a7c0 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7fee40009900 tx=0x7fee4002a440 comp rx=0 tx=0).stop 2024-09-10T22:27:22.678 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:22.675+0000 7fee55025640 1 -- 172.21.15.19:0/894316483 shutdown_connections 2024-09-10T22:27:22.678 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:22.675+0000 7fee55025640 1 --2- 172.21.15.19:0/894316483 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fee50074500 0x7fee5011a090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:27:22.678 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:22.675+0000 7fee55025640 1 --2- 172.21.15.19:0/894316483 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fee5010ad00 0x7fee50073e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:27:22.679 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:22.675+0000 7fee55025640 1 --2- 172.21.15.19:0/894316483 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fee5010a3c0 0x7fee5010a7c0 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:27:22.679 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:22.675+0000 7fee55025640 1 -- 172.21.15.19:0/894316483 >> 172.21.15.19:0/894316483 conn(0x7fee5006f850 msgr2=0x7fee50071c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:27:22.682 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:22.680+0000 7fee55025640 1 -- 172.21.15.19:0/894316483 shutdown_connections 2024-09-10T22:27:22.682 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:22.681+0000 7fee55025640 1 -- 172.21.15.19:0/894316483 wait complete. 2024-09-10T22:27:22.687 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:22.682+0000 7fee55025640 1 Processor -- start 2024-09-10T22:27:22.688 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:22.683+0000 7fee55025640 1 -- start start 2024-09-10T22:27:22.688 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:22.685+0000 7fee55025640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fee50074500 0x7fee501a7b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:27:22.688 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:22.685+0000 7fee55025640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fee5010a3c0 0x7fee501a8150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:27:22.688 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:22.685+0000 7fee55025640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fee5010ad00 0x7fee501a8d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:27:22.688 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:22.686+0000 7fee55025640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fee5011d300 con 0x7fee5010a3c0 2024-09-10T22:27:22.688 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:22.686+0000 7fee55025640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fee5011d180 con 0x7fee5010ad00 2024-09-10T22:27:22.688 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:22.686+0000 7fee55025640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7fee5011d480 con 0x7fee50074500 2024-09-10T22:27:22.688 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:22.686+0000 7fee4f7fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fee5010a3c0 0x7fee501a8150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:27:22.689 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:22.686+0000 7fee4f7fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fee5010a3c0 0x7fee501a8150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:49968/0 (socket says 172.21.15.19:49968) 2024-09-10T22:27:22.689 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:22.686+0000 7fee4f7fe640 1 -- 172.21.15.19:0/1509830150 learned_addr learned my addr 172.21.15.19:0/1509830150 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:27:22.690 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:22.687+0000 7fee4f7fe640 1 -- 172.21.15.19:0/1509830150 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fee50074500 msgr2=0x7fee501a7b00 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-10T22:27:22.690 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:22.687+0000 7fee4f7fe640 1 --2- 172.21.15.19:0/1509830150 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fee50074500 0x7fee501a7b00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:27:22.690 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:22.687+0000 7fee4f7fe640 1 -- 172.21.15.19:0/1509830150 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fee5010ad00 msgr2=0x7fee501a8d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:27:22.690 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:22.687+0000 7fee4f7fe640 1 --2- 172.21.15.19:0/1509830150 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fee5010ad00 0x7fee501a8d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:27:22.690 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:22.687+0000 7fee4f7fe640 1 -- 172.21.15.19:0/1509830150 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fee501a9640 con 0x7fee5010a3c0 2024-09-10T22:27:22.691 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:22.688+0000 7fee4f7fe640 1 --2- 172.21.15.19:0/1509830150 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fee5010a3c0 0x7fee501a8150 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7fee4800ba50 tx=0x7fee4800bf10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:27:22.691 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:22.689+0000 7fee4d7fa640 1 -- 172.21.15.19:0/1509830150 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee48019070 con 0x7fee5010a3c0 2024-09-10T22:27:22.692 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:22.689+0000 7fee55025640 1 -- 172.21.15.19:0/1509830150 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fee501a9930 con 0x7fee5010a3c0 2024-09-10T22:27:22.692 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:22.689+0000 7fee55025640 1 -- 172.21.15.19:0/1509830150 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fee501b0000 con 0x7fee5010a3c0 2024-09-10T22:27:22.697 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:22.695+0000 7fee59054740 1 Processor -- start 2024-09-10T22:27:22.698 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:22.696+0000 7fee4d7fa640 1 -- 172.21.15.19:0/1509830150 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fee4800cc10 con 0x7fee5010a3c0 2024-09-10T22:27:22.698 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:22.696+0000 7fee4d7fa640 1 -- 172.21.15.19:0/1509830150 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee480075d0 con 0x7fee5010a3c0 2024-09-10T22:27:22.704 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:22.700+0000 7fee59054740 1 -- start start 2024-09-10T22:27:22.705 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:22.700+0000 7fee59054740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x556a479986c0 0x556a4799dd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:27:22.705 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:22.700+0000 7fee59054740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556a4799e2a0 0x556a479a06b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:27:22.705 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:22.700+0000 7fee59054740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x556a479a0dc0 0x556a479a3280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:27:22.705 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:22.700+0000 7fee59054740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x556a4790d6f0 con 0x556a479a0dc0 2024-09-10T22:27:22.705 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:22.700+0000 7fee59054740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x556a478fcb20 con 0x556a4799e2a0 2024-09-10T22:27:22.705 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:22.700+0000 7fee59054740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x556a47900930 con 0x556a479986c0 2024-09-10T22:27:22.708 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:22.702+0000 7fee4d7fa640 1 -- 172.21.15.19:0/1509830150 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 18) ==== 153250+0+0 (secure 0 0 0) 0x7fee480078b0 con 0x7fee5010a3c0 2024-09-10T22:27:22.708 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:22.704+0000 7fee54824640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x556a479986c0 0x556a4799dd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:27:22.708 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:22.704+0000 7fee54824640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x556a479986c0 0x556a4799dd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.19:35624/0 (socket says 172.21.15.19:35624) 2024-09-10T22:27:22.708 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:22.704+0000 7fee54824640 1 -- 172.21.15.19:0/1269976724 learned_addr learned my addr 172.21.15.19:0/1269976724 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:27:22.708 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:22.705+0000 7fee4d7fa640 1 --2- 172.21.15.19:0/1509830150 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7fee380b5460 0x7fee380b7920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:27:22.709 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:22.707+0000 7fee54824640 1 -- 172.21.15.19:0/1269976724 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556a4799e2a0 msgr2=0x556a479a06b0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-10T22:27:22.709 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:22.707+0000 7fee54824640 1 --2- 172.21.15.19:0/1269976724 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556a4799e2a0 0x556a479a06b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:27:22.709 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:22.707+0000 7fee54824640 1 -- 172.21.15.19:0/1269976724 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x556a479a0dc0 msgr2=0x556a479a3280 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-10T22:27:22.709 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:22.707+0000 7fee54824640 1 --2- 172.21.15.19:0/1269976724 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x556a479a0dc0 0x556a479a3280 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:27:22.709 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:22.707+0000 7fee54824640 1 -- 172.21.15.19:0/1269976724 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556a478c2530 con 0x556a479986c0 2024-09-10T22:27:22.710 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:22.708+0000 7fee4d7fa640 1 -- 172.21.15.19:0/1509830150 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8327+0+0 (secure 0 0 0) 0x7fee4800cdc0 con 0x7fee5010a3c0 2024-09-10T22:27:22.710 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:22.709+0000 7fee54824640 1 --2- 172.21.15.19:0/1509830150 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7fee380b5460 0x7fee380b7920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:27:22.713 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:22.711+0000 7fee54824640 1 --2- 172.21.15.19:0/1509830150 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7fee380b5460 0x7fee380b7920 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fee4400b4b0 tx=0x7fee44008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:27:22.714 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:22.711+0000 7fee54824640 1 --2- 172.21.15.19:0/1269976724 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x556a479986c0 0x556a4799dd60 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fee440098f0 tx=0x7fee44009db0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3ea6c61cf396def2 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:27:22.717 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:22.716+0000 7fee55025640 1 -- 172.21.15.19:0/1269976724 <== mon.1 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee4400f040 con 0x556a479986c0 2024-09-10T22:27:22.717 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:22.716+0000 7fee55025640 1 -- 172.21.15.19:0/1269976724 <== mon.1 v2:172.21.15.138:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fee44020070 con 0x556a479986c0 2024-09-10T22:27:22.720 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:22.718+0000 7fee59054740 1 -- 172.21.15.19:0/1269976724 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x556a479986c0 msgr2=0x556a4799dd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:27:22.720 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:22.718+0000 7fee59054740 1 --2- 172.21.15.19:0/1269976724 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x556a479986c0 0x556a4799dd60 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fee440098f0 tx=0x7fee44009db0 comp rx=0 tx=0).stop 2024-09-10T22:27:22.720 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:22.719+0000 7fee59054740 1 -- 172.21.15.19:0/1269976724 shutdown_connections 2024-09-10T22:27:22.720 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:22.719+0000 7fee59054740 1 --2- 172.21.15.19:0/1269976724 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x556a479a0dc0 0x556a479a3280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:27:22.721 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:22.719+0000 7fee59054740 1 --2- 172.21.15.19:0/1269976724 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556a4799e2a0 0x556a479a06b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:27:22.721 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:22.719+0000 7fee59054740 1 --2- 172.21.15.19:0/1269976724 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x556a479986c0 0x556a4799dd60 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:27:22.721 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:22.719+0000 7fee59054740 1 -- 172.21.15.19:0/1269976724 >> 172.21.15.19:0/1269976724 conn(0x556a47996ea0 msgr2=0x556a47997c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:27:22.721 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:22.719+0000 7fee59054740 1 -- 172.21.15.19:0/1269976724 shutdown_connections 2024-09-10T22:27:22.723 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:22.719+0000 7fee59054740 1 -- 172.21.15.19:0/1269976724 wait complete. 2024-09-10T22:27:22.724 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:22.720+0000 7fee59054740 1 -- start start 2024-09-10T22:27:22.724 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:22.721+0000 7fee59054740 1 Processor -- start 2024-09-10T22:27:22.724 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:22.721+0000 7fee59054740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x556a479986c0 0x556a479b6190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:27:22.724 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:22.721+0000 7fee59054740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556a4799e2a0 0x556a479b6830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:27:22.724 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:22.721+0000 7fee59054740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x556a479a0dc0 0x556a479b7400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:27:22.724 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:22.722+0000 7fee59054740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x556a47834ab0 con 0x556a479a0dc0 2024-09-10T22:27:22.724 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:22.722+0000 7fee59054740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x556a478a2730 con 0x556a4799e2a0 2024-09-10T22:27:22.724 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:22.722+0000 7fee59054740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x556a479b4e00 con 0x556a479986c0 2024-09-10T22:27:22.724 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:22.722+0000 7fee59054740 10 client.0 _ll_register_callbacks cb 0x556a478f66b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T22:27:22.725 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:22.722+0000 7fee54824640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x556a479a0dc0 0x556a479b7400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:27:22.725 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:22.723+0000 7fee54824640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x556a479a0dc0 0x556a479b7400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:49982/0 (socket says 172.21.15.19:49982) 2024-09-10T22:27:22.726 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:22.723+0000 7fee54824640 1 -- 172.21.15.19:0/3116850952 learned_addr learned my addr 172.21.15.19:0/3116850952 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:27:22.729 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:22.724+0000 7fee4ffff640 1 --2- 172.21.15.19:0/3116850952 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x556a479986c0 0x556a479b6190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:27:22.729 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:22.724+0000 7fee4f7fe640 1 --2- 172.21.15.19:0/3116850952 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556a4799e2a0 0x556a479b6830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:27:22.730 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:22.726+0000 7fee4f7fe640 1 -- 172.21.15.19:0/3116850952 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x556a479986c0 msgr2=0x556a479b6190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:27:22.730 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:22.726+0000 7fee4f7fe640 1 --2- 172.21.15.19:0/3116850952 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x556a479986c0 0x556a479b6190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:27:22.730 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:22.726+0000 7fee4f7fe640 1 -- 172.21.15.19:0/3116850952 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x556a479a0dc0 msgr2=0x556a479b7400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:27:22.730 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:22.726+0000 7fee4f7fe640 1 --2- 172.21.15.19:0/3116850952 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x556a479a0dc0 0x556a479b7400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:27:22.731 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:22.727+0000 7fee4f7fe640 1 -- 172.21.15.19:0/3116850952 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556a4765e790 con 0x556a4799e2a0 2024-09-10T22:27:22.732 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:22.727+0000 7fee4f7fe640 1 --2- 172.21.15.19:0/3116850952 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556a4799e2a0 0x556a479b6830 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fee480e3d90 tx=0x7fee480a7170 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c89a6c2681fe54e3 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:27:22.732 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:22.728+0000 7fee2f7fe640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-09-10T22:27:22.732 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:22.728+0000 7fee2f7fe640 1 -- 172.21.15.19:0/3116850952 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee480a92d0 con 0x556a4799e2a0 2024-09-10T22:27:22.733 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:22.728+0000 7fee59054740 1 -- 172.21.15.19:0/3116850952 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fee44020070 con 0x556a4799e2a0 2024-09-10T22:27:22.733 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:22.729+0000 7fee2f7fe640 1 -- 172.21.15.19:0/3116850952 <== mon.2 v2:172.21.15.135:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8327+0+0 (secure 0 0 0) 0x7fee480b1210 con 0x556a4799e2a0 2024-09-10T22:27:22.733 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:22.729+0000 7fee2f7fe640 1 -- 172.21.15.19:0/3116850952 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fee480a9470 con 0x556a4799e2a0 2024-09-10T22:27:22.733 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:22.729+0000 7fee59054740 10 client.25142 fetch_fsmap learned FSMap version 25 2024-09-10T22:27:22.733 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:22.729+0000 7fee59054740 1 -- 172.21.15.19:0/3116850952 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x556a476d7620 con 0x556a4799e2a0 2024-09-10T22:27:22.735 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:22.731+0000 7fee2f7fe640 1 -- 172.21.15.19:0/3116850952 <== mon.2 v2:172.21.15.135:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fee44020070 con 0x556a4799e2a0 2024-09-10T22:27:22.735 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:22.731+0000 7fee2f7fe640 1 -- 172.21.15.19:0/3116850952 <== mon.2 v2:172.21.15.135:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fee480078b0 con 0x556a4799e2a0 2024-09-10T22:27:22.736 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:22.731+0000 7fee59054740 10 client.25142 fetch_fsmap finished waiting for FSMap version 25 2024-09-10T22:27:22.736 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:22.731+0000 7fee59054740 10 client.25142 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-10T22:27:22.736 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:22.731+0000 7fee59054740 20 client.25142 populate_metadata read hostname 'smithi019' 2024-09-10T22:27:22.736 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:22.732+0000 7fee59054740 1 --2- 172.21.15.19:0/3116850952 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x556a479a6b80 0x556a479a8fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:27:22.736 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:22.732+0000 7fee59054740 4 client.25142 mds_command: new command op to 24581 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T22:27:22.736 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:22.732+0000 7fee59054740 1 -- 172.21.15.19:0/3116850952 --> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x556a4790f640 con 0x556a479a6b80 2024-09-10T22:27:22.736 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:22.734+0000 7fee4ffff640 1 --2- 172.21.15.19:0/3116850952 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x556a479a6b80 0x556a479a8fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:27:22.745 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:22.742+0000 7fee4ffff640 1 --2- 172.21.15.19:0/3116850952 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x556a479a6b80 0x556a479a8fa0 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c9441329037ee3ca server_cookie=5f0626f11db63e61 in_seq=0 out_seq=0 2024-09-10T22:27:22.745 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:22.743+0000 7fee2f7fe640 10 client.25142 ms_handle_connect on v2:172.21.15.135:6838/1254769802 2024-09-10T22:27:22.748 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:22.746+0000 7fee2f7fe640 1 -- 172.21.15.19:0/3116850952 <== mds.0 v2:172.21.15.135:6838/1254769802 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x556a4790f640 con 0x556a479a6b80 2024-09-10T22:27:22.748 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:22.746+0000 7fee2f7fe640 10 client.25142 handle_command_reply: tid=0 2024-09-10T22:27:22.748 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:22.746+0000 7fee59054740 1 client.25142 shutdown 2024-09-10T22:27:22.749 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:22.747+0000 7fee59054740 1 -- 172.21.15.19:0/3116850952 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556a4799e2a0 msgr2=0x556a479b6830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:27:22.749 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:22.747+0000 7fee59054740 1 --2- 172.21.15.19:0/3116850952 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556a4799e2a0 0x556a479b6830 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fee480e3d90 tx=0x7fee480a7170 comp rx=0 tx=0).stop 2024-09-10T22:27:22.749 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:22.747+0000 7fee59054740 1 -- 172.21.15.19:0/3116850952 shutdown_connections 2024-09-10T22:27:22.750 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:22.747+0000 7fee59054740 1 --2- 172.21.15.19:0/3116850952 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x556a479a0dc0 0x556a479b7400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:27:22.750 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:22.747+0000 7fee59054740 1 --2- 172.21.15.19:0/3116850952 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556a4799e2a0 0x556a479b6830 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:27:22.750 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:22.747+0000 7fee59054740 1 --2- 172.21.15.19:0/3116850952 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x556a479a6b80 0x556a479a8fa0 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:27:22.750 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:22.747+0000 7fee59054740 1 --2- 172.21.15.19:0/3116850952 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x556a479986c0 0x556a479b6190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:27:22.750 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:22.747+0000 7fee59054740 1 -- 172.21.15.19:0/3116850952 >> 172.21.15.19:0/3116850952 conn(0x556a47996ea0 msgr2=0x556a4799e6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:27:22.750 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:22.748+0000 7fee2f7fe640 0 client.25142 ms_handle_reset on v2:172.21.15.135:6838/1254769802 2024-09-10T22:27:22.751 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:22.749+0000 7fee59054740 1 -- 172.21.15.19:0/3116850952 shutdown_connections 2024-09-10T22:27:22.751 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:22.750+0000 7fee59054740 1 -- 172.21.15.19:0/3116850952 wait complete. 2024-09-10T22:27:22.751 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:22.750+0000 7fee59054740 20 client.25142 trim_cache size 0 max 16384 2024-09-10T22:27:22.794 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:22.792+0000 7fee59054740 1 Processor -- start 2024-09-10T22:27:22.794 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:22.793+0000 7fee59054740 1 -- start start 2024-09-10T22:27:22.794 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:22.793+0000 7fee59054740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x556a479986c0 0x556a479a0470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:27:22.795 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:22.794+0000 7fee59054740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x556a4799e2a0 0x556a4799f8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:27:22.795 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:22.794+0000 7fee4ffff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x556a479986c0 0x556a479a0470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:27:22.795 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:22.794+0000 7fee4ffff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x556a479986c0 0x556a479a0470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:49990/0 (socket says 172.21.15.19:49990) 2024-09-10T22:27:22.795 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:22.794+0000 7fee59054740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556a479a0dc0 0x556a4799fde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:27:22.795 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:22.794+0000 7fee59054740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fee3c011000 con 0x556a479986c0 2024-09-10T22:27:22.795 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:22.794+0000 7fee59054740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fee3c00e8d0 con 0x556a479a0dc0 2024-09-10T22:27:22.796 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:22.794+0000 7fee59054740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7fee3c00c720 con 0x556a4799e2a0 2024-09-10T22:27:22.796 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:22.794+0000 7fee4ffff640 1 -- 172.21.15.19:0/3190680132 learned_addr learned my addr 172.21.15.19:0/3190680132 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:27:22.796 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:22.794+0000 7fee4ffff640 1 -- 172.21.15.19:0/3190680132 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x556a4799e2a0 msgr2=0x556a4799f8a0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-10T22:27:22.796 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:22.794+0000 7fee4ffff640 1 --2- 172.21.15.19:0/3190680132 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x556a4799e2a0 0x556a4799f8a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:27:22.796 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:22.794+0000 7fee4ffff640 1 -- 172.21.15.19:0/3190680132 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556a479a0dc0 msgr2=0x556a4799fde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:27:22.796 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:22.794+0000 7fee4ffff640 1 --2- 172.21.15.19:0/3190680132 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556a479a0dc0 0x556a4799fde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:27:22.797 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:22.794+0000 7fee4ffff640 1 -- 172.21.15.19:0/3190680132 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556a4799d370 con 0x556a479986c0 2024-09-10T22:27:22.797 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:22.795+0000 7fee4ffff640 1 --2- 172.21.15.19:0/3190680132 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x556a479986c0 0x556a479a0470 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7fee40006010 tx=0x7fee40005b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dca9d34eb03bf4ac server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:27:22.797 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:22.796+0000 7fee35ffb640 1 -- 172.21.15.19:0/3190680132 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee40047070 con 0x556a479986c0 2024-09-10T22:27:22.797 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:22.796+0000 7fee35ffb640 1 -- 172.21.15.19:0/3190680132 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fee40004430 con 0x556a479986c0 2024-09-10T22:27:22.797 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:22.796+0000 7fee35ffb640 1 -- 172.21.15.19:0/3190680132 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee40035040 con 0x556a479986c0 2024-09-10T22:27:22.799 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:22.797+0000 7fee59054740 1 -- 172.21.15.19:0/3190680132 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x556a479986c0 msgr2=0x556a479a0470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:27:22.799 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:22.797+0000 7fee59054740 1 --2- 172.21.15.19:0/3190680132 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x556a479986c0 0x556a479a0470 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7fee40006010 tx=0x7fee40005b50 comp rx=0 tx=0).stop 2024-09-10T22:27:22.799 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:22.798+0000 7fee59054740 1 -- 172.21.15.19:0/3190680132 shutdown_connections 2024-09-10T22:27:22.799 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:22.798+0000 7fee59054740 1 --2- 172.21.15.19:0/3190680132 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556a479a0dc0 0x556a4799fde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:27:22.800 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:22.798+0000 7fee59054740 1 --2- 172.21.15.19:0/3190680132 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x556a4799e2a0 0x556a4799f8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:27:22.800 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:22.798+0000 7fee59054740 1 --2- 172.21.15.19:0/3190680132 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x556a479986c0 0x556a479a0470 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:27:22.800 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:22.798+0000 7fee59054740 1 -- 172.21.15.19:0/3190680132 >> 172.21.15.19:0/3190680132 conn(0x556a47996ea0 msgr2=0x556a4799d6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:27:22.800 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:22.798+0000 7fee59054740 1 -- 172.21.15.19:0/3190680132 shutdown_connections 2024-09-10T22:27:22.800 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:22.798+0000 7fee59054740 1 -- 172.21.15.19:0/3190680132 wait complete. 2024-09-10T22:27:22.800 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:22.799+0000 7fee59054740 1 -- start start 2024-09-10T22:27:22.801 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:22.799+0000 7fee59054740 1 Processor -- start 2024-09-10T22:27:22.801 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:22.800+0000 7fee59054740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x556a479986c0 0x556a479b9ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:27:22.802 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:22.801+0000 7fee59054740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x556a4799e2a0 0x556a479ba1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:27:22.803 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:22.801+0000 7fee59054740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556a479a0dc0 0x556a479baef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:27:22.803 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:22.801+0000 7fee59054740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fee3c00cd90 con 0x556a4799e2a0 2024-09-10T22:27:22.803 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:22.801+0000 7fee59054740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fee3c00e200 con 0x556a479a0dc0 2024-09-10T22:27:22.803 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:22.801+0000 7fee59054740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7fee3c00d460 con 0x556a479986c0 2024-09-10T22:27:22.803 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:22.802+0000 7fee59054740 10 client.0 _ll_register_callbacks cb 0x7fee48021070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T22:27:22.803 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:22.802+0000 7fee4ffff640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x556a479986c0 0x556a479b9ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:27:22.804 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:22.802+0000 7fee4f7fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x556a4799e2a0 0x556a479ba1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:27:22.804 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:22.802+0000 7fee4f7fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x556a4799e2a0 0x556a479ba1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:50002/0 (socket says 172.21.15.19:50002) 2024-09-10T22:27:22.804 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:22.802+0000 7fee4f7fe640 1 -- 172.21.15.19:0/2300955706 learned_addr learned my addr 172.21.15.19:0/2300955706 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:27:22.804 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:22.802+0000 7fee54824640 1 --2- 172.21.15.19:0/2300955706 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556a479a0dc0 0x556a479baef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:27:22.805 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:22.803+0000 7fee4f7fe640 1 -- 172.21.15.19:0/2300955706 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x556a479986c0 msgr2=0x556a479b9ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:27:22.805 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:22.803+0000 7fee4f7fe640 1 --2- 172.21.15.19:0/2300955706 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x556a479986c0 0x556a479b9ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:27:22.805 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:22.803+0000 7fee4f7fe640 1 -- 172.21.15.19:0/2300955706 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556a479a0dc0 msgr2=0x556a479baef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:27:22.805 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:22.803+0000 7fee4f7fe640 1 --2- 172.21.15.19:0/2300955706 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556a479a0dc0 0x556a479baef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:27:22.805 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:22.803+0000 7fee4f7fe640 1 -- 172.21.15.19:0/2300955706 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556a479bb430 con 0x556a4799e2a0 2024-09-10T22:27:22.806 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:22.804+0000 7fee4f7fe640 1 --2- 172.21.15.19:0/2300955706 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x556a4799e2a0 0x556a479ba1e0 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7fee480a9b50 tx=0x7fee480a8fe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=efb312bbec5d665a server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:27:22.806 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:22.804+0000 7fee2f7fe640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-10T22:27:22.806 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:22.804+0000 7fee2f7fe640 1 -- 172.21.15.19:0/2300955706 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee480c6070 con 0x556a4799e2a0 2024-09-10T22:27:22.806 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:22.805+0000 7fee59054740 1 -- 172.21.15.19:0/2300955706 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fee40004430 con 0x556a4799e2a0 2024-09-10T22:27:22.806 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:22.805+0000 7fee2f7fe640 1 -- 172.21.15.19:0/2300955706 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8327+0+0 (secure 0 0 0) 0x7fee48007870 con 0x556a4799e2a0 2024-09-10T22:27:22.807 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:22.805+0000 7fee2f7fe640 1 -- 172.21.15.19:0/2300955706 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fee480a9640 con 0x556a4799e2a0 2024-09-10T22:27:22.807 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:22.805+0000 7fee59054740 10 client.15558 fetch_fsmap learned FSMap version 25 2024-09-10T22:27:22.807 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:22.805+0000 7fee59054740 1 -- 172.21.15.19:0/2300955706 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x556a47a3f620 con 0x556a4799e2a0 2024-09-10T22:27:22.807 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:22.806+0000 7fee2f7fe640 1 -- 172.21.15.19:0/2300955706 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fee40004430 con 0x556a4799e2a0 2024-09-10T22:27:22.811 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:22.807+0000 7fee2f7fe640 1 -- 172.21.15.19:0/2300955706 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fee480ce100 con 0x556a4799e2a0 2024-09-10T22:27:22.811 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:22.807+0000 7fee59054740 10 client.15558 fetch_fsmap finished waiting for FSMap version 25 2024-09-10T22:27:22.811 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:22.807+0000 7fee59054740 10 client.15558 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-10T22:27:22.811 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:22.807+0000 7fee59054740 20 client.15558 populate_metadata read hostname 'smithi019' 2024-09-10T22:27:22.811 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:22.807+0000 7fee59054740 1 --2- 172.21.15.19:0/2300955706 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x556a47a3fe10 0x556a47a42230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:27:22.811 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:22.807+0000 7fee59054740 4 client.15558 mds_command: new command op to 24581 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-10T22:27:22.811 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:22.807+0000 7fee59054740 1 -- 172.21.15.19:0/2300955706 --> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] -- command(tid 0: {"prefix": "flush journal"}) -- 0x556a4790b0f0 con 0x556a47a3fe10 2024-09-10T22:27:22.811 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:22.809+0000 7fee4ffff640 1 --2- 172.21.15.19:0/2300955706 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x556a47a3fe10 0x556a47a42230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:27:22.819 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:22.818+0000 7fee2f7fe640 10 client.15558 ms_handle_connect on v2:172.21.15.135:6838/1254769802 2024-09-10T22:27:22.819 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:22.818+0000 7fee4ffff640 1 --2- 172.21.15.19:0/2300955706 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x556a47a3fe10 0x556a47a42230 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=de94632645d029 server_cookie=de4016b48a28a3c9 in_seq=0 out_seq=0 2024-09-10T22:27:24.109 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:27:23 smithi135 ceph-mon[34789]: pgmap v376: 97 pgs: 97 active+clean; 5.4 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 752 KiB/s rd, 462 MiB/s wr, 380 op/s 2024-09-10T22:27:24.125 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:27:23 smithi138 ceph-mon[35236]: pgmap v376: 97 pgs: 97 active+clean; 5.4 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 752 KiB/s rd, 462 MiB/s wr, 380 op/s 2024-09-10T22:27:24.208 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:27:23 smithi019 ceph-mon[31375]: pgmap v376: 97 pgs: 97 active+clean; 5.4 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 752 KiB/s rd, 462 MiB/s wr, 380 op/s 2024-09-10T22:27:26.109 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:27:25 smithi135 ceph-mon[34789]: pgmap v377: 97 pgs: 97 active+clean; 6.6 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 568 MiB/s wr, 477 op/s 2024-09-10T22:27:26.124 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:27:25 smithi138 ceph-mon[35236]: pgmap v377: 97 pgs: 97 active+clean; 6.6 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 568 MiB/s wr, 477 op/s 2024-09-10T22:27:26.209 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:27:25 smithi019 ceph-mon[31375]: pgmap v377: 97 pgs: 97 active+clean; 6.6 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 568 MiB/s wr, 477 op/s 2024-09-10T22:27:27.143 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:27.140+0000 7fee2f7fe640 1 -- 172.21.15.19:0/2300955706 <== mds.0 v2:172.21.15.135:6838/1254769802 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x556a4790b0f0 con 0x556a47a3fe10 2024-09-10T22:27:27.143 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:27.140+0000 7fee2f7fe640 10 client.15558 handle_command_reply: tid=0 2024-09-10T22:27:27.144 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:27.140+0000 7fee59054740 1 client.15558 shutdown 2024-09-10T22:27:27.144 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:27.141+0000 7fee59054740 1 -- 172.21.15.19:0/2300955706 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x556a4799e2a0 msgr2=0x556a479ba1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:27:27.144 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:27.141+0000 7fee59054740 1 --2- 172.21.15.19:0/2300955706 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x556a4799e2a0 0x556a479ba1e0 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7fee480a9b50 tx=0x7fee480a8fe0 comp rx=0 tx=0).stop 2024-09-10T22:27:27.144 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:27.141+0000 7fee59054740 1 -- 172.21.15.19:0/2300955706 shutdown_connections 2024-09-10T22:27:27.144 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:27.141+0000 7fee59054740 1 --2- 172.21.15.19:0/2300955706 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556a479a0dc0 0x556a479baef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:27:27.144 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:27.141+0000 7fee59054740 1 --2- 172.21.15.19:0/2300955706 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x556a4799e2a0 0x556a479ba1e0 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:27:27.144 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:27.141+0000 7fee59054740 1 --2- 172.21.15.19:0/2300955706 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x556a47a3fe10 0x556a47a42230 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:27:27.144 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:27.141+0000 7fee59054740 1 --2- 172.21.15.19:0/2300955706 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x556a479986c0 0x556a479b9ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:27:27.144 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:27.141+0000 7fee59054740 1 -- 172.21.15.19:0/2300955706 >> 172.21.15.19:0/2300955706 conn(0x556a47996ea0 msgr2=0x556a4799f8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:27:27.145 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:27.141+0000 7fee2f7fe640 0 client.15558 ms_handle_reset on v2:172.21.15.135:6838/1254769802 2024-09-10T22:27:27.145 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:27.142+0000 7fee59054740 1 -- 172.21.15.19:0/2300955706 shutdown_connections 2024-09-10T22:27:27.145 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:27.142+0000 7fee59054740 1 -- 172.21.15.19:0/2300955706 wait complete. 2024-09-10T22:27:27.145 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:27.142+0000 7fee59054740 20 client.15558 trim_cache size 0 max 16384 2024-09-10T22:27:27.146 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stdout:{ 2024-09-10T22:27:27.146 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stdout: "message": "", 2024-09-10T22:27:27.146 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stdout: "return_code": 0 2024-09-10T22:27:27.146 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stdout:} 2024-09-10T22:27:27.150 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:27.147+0000 7fee36ffd640 1 -- 172.21.15.19:0/1509830150 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7fee380b5460 msgr2=0x7fee380b7920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:27:27.150 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:27.147+0000 7fee36ffd640 1 --2- 172.21.15.19:0/1509830150 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7fee380b5460 0x7fee380b7920 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fee4400b4b0 tx=0x7fee44008040 comp rx=0 tx=0).stop 2024-09-10T22:27:27.150 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:27.147+0000 7fee36ffd640 1 -- 172.21.15.19:0/1509830150 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fee5010a3c0 msgr2=0x7fee501a8150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:27:27.150 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:27.147+0000 7fee36ffd640 1 --2- 172.21.15.19:0/1509830150 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fee5010a3c0 0x7fee501a8150 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7fee4800ba50 tx=0x7fee4800bf10 comp rx=0 tx=0).stop 2024-09-10T22:27:27.156 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:27.154+0000 7fee36ffd640 1 -- 172.21.15.19:0/1509830150 shutdown_connections 2024-09-10T22:27:27.156 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:27.154+0000 7fee36ffd640 1 --2- 172.21.15.19:0/1509830150 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7fee380b5460 0x7fee380b7920 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:27:27.156 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:27.154+0000 7fee36ffd640 1 --2- 172.21.15.19:0/1509830150 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fee5010ad00 0x7fee501a8d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:27:27.156 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:27.154+0000 7fee36ffd640 1 --2- 172.21.15.19:0/1509830150 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fee5010a3c0 0x7fee501a8150 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:27:27.156 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:27.154+0000 7fee36ffd640 1 --2- 172.21.15.19:0/1509830150 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fee50074500 0x7fee501a7b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:27:27.156 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:27.154+0000 7fee36ffd640 1 -- 172.21.15.19:0/1509830150 >> 172.21.15.19:0/1509830150 conn(0x7fee5006f850 msgr2=0x7fee50071470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:27:27.161 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:27.157+0000 7fee36ffd640 1 -- 172.21.15.19:0/1509830150 shutdown_connections 2024-09-10T22:27:27.162 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:27.157+0000 7fee36ffd640 1 -- 172.21.15.19:0/1509830150 wait complete. 2024-09-10T22:27:28.109 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:27:27 smithi135 ceph-mon[34789]: pgmap v378: 97 pgs: 97 active+clean; 8.6 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 740 MiB/s wr, 585 op/s 2024-09-10T22:27:28.125 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:27:27 smithi138 ceph-mon[35236]: pgmap v378: 97 pgs: 97 active+clean; 8.6 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 740 MiB/s wr, 585 op/s 2024-09-10T22:27:28.208 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:27:27 smithi019 ceph-mon[31375]: pgmap v378: 97 pgs: 97 active+clean; 8.6 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 740 MiB/s wr, 585 op/s 2024-09-10T22:27:30.209 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:27:29 smithi019 ceph-mon[31375]: pgmap v379: 97 pgs: 97 active+clean; 9.0 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 905 KiB/s rd, 698 MiB/s wr, 538 op/s 2024-09-10T22:27:30.360 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:27:29 smithi135 ceph-mon[34789]: pgmap v379: 97 pgs: 97 active+clean; 9.0 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 905 KiB/s rd, 698 MiB/s wr, 538 op/s 2024-09-10T22:27:30.376 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:27:29 smithi138 ceph-mon[35236]: pgmap v379: 97 pgs: 97 active+clean; 9.0 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 905 KiB/s rd, 698 MiB/s wr, 538 op/s 2024-09-10T22:27:32.209 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:27:31 smithi019 ceph-mon[31375]: pgmap v380: 97 pgs: 97 active+clean; 9.9 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 829 MiB/s wr, 1.01k op/s 2024-09-10T22:27:32.362 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:27:31 smithi135 ceph-mon[34789]: pgmap v380: 97 pgs: 97 active+clean; 9.9 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 829 MiB/s wr, 1.01k op/s 2024-09-10T22:27:32.374 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:27:31 smithi138 ceph-mon[35236]: pgmap v380: 97 pgs: 97 active+clean; 9.9 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 829 MiB/s wr, 1.01k op/s 2024-09-10T22:27:32.662 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 22997a4c-6fc2-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-10T22:27:33.339 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/22997a4c-6fc2-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T22:27:34.321 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:27:34 smithi019 ceph-mon[31375]: pgmap v381: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 668 MiB/s wr, 1.02k op/s 2024-09-10T22:27:34.321 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:27:34 smithi019 ceph-mon[31375]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-09-10T22:27:34.361 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:27:34 smithi135 ceph-mon[34789]: pgmap v381: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 668 MiB/s wr, 1.02k op/s 2024-09-10T22:27:34.361 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:27:34 smithi135 ceph-mon[34789]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-09-10T22:27:34.375 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:27:34 smithi138 ceph-mon[35236]: pgmap v381: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 668 MiB/s wr, 1.02k op/s 2024-09-10T22:27:34.375 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:27:34 smithi138 ceph-mon[35236]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-09-10T22:27:34.566 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:34.536+0000 7fa325ccd640 1 -- 172.21.15.19:0/4116705091 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa32010a150 msgr2=0x7fa3201111b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:27:34.566 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:34.537+0000 7fa325ccd640 1 --2- 172.21.15.19:0/4116705091 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa32010a150 0x7fa3201111b0 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7fa310009ca0 tx=0x7fa31002a950 comp rx=0 tx=0).stop 2024-09-10T22:27:34.566 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:34.538+0000 7fa325ccd640 1 -- 172.21.15.19:0/4116705091 shutdown_connections 2024-09-10T22:27:34.566 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:34.538+0000 7fa325ccd640 1 --2- 172.21.15.19:0/4116705091 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa32011c0a0 0x7fa32011e490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:27:34.566 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:34.538+0000 7fa325ccd640 1 --2- 172.21.15.19:0/4116705091 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa32010a530 0x7fa32010a930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:27:34.566 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:34.538+0000 7fa325ccd640 1 --2- 172.21.15.19:0/4116705091 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa32010a150 0x7fa3201111b0 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:27:34.566 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:34.538+0000 7fa325ccd640 1 -- 172.21.15.19:0/4116705091 >> 172.21.15.19:0/4116705091 conn(0x7fa32006dfc0 msgr2=0x7fa32006e3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:27:34.566 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:34.539+0000 7fa325ccd640 1 -- 172.21.15.19:0/4116705091 shutdown_connections 2024-09-10T22:27:34.567 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:34.539+0000 7fa325ccd640 1 -- 172.21.15.19:0/4116705091 wait complete. 2024-09-10T22:27:34.567 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:34.540+0000 7fa325ccd640 1 Processor -- start 2024-09-10T22:27:34.567 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:34.540+0000 7fa325ccd640 1 -- start start 2024-09-10T22:27:34.567 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:34.540+0000 7fa325ccd640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa32010a150 0x7fa3201a8080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:27:34.567 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:34.540+0000 7fa325ccd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa32010a530 0x7fa3201a85c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:27:34.567 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:34.541+0000 7fa325ccd640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa32011c0a0 0x7fa3201ad960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:27:34.567 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:34.541+0000 7fa31effd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa32010a530 0x7fa3201a85c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:27:34.567 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:34.541+0000 7fa325ccd640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fa320121b70 con 0x7fa32010a530 2024-09-10T22:27:34.567 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:34.541+0000 7fa325ccd640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fa3201219f0 con 0x7fa32011c0a0 2024-09-10T22:27:34.567 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:34.541+0000 7fa325ccd640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7fa320121cf0 con 0x7fa32010a150 2024-09-10T22:27:34.567 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:34.541+0000 7fa31effd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa32010a530 0x7fa3201a85c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:53288/0 (socket says 172.21.15.19:53288) 2024-09-10T22:27:34.568 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:34.541+0000 7fa31effd640 1 -- 172.21.15.19:0/714916095 learned_addr learned my addr 172.21.15.19:0/714916095 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:27:34.568 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:34.541+0000 7fa31ffff640 1 --2- 172.21.15.19:0/714916095 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa32011c0a0 0x7fa3201ad960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:27:34.568 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:34.542+0000 7fa31f7fe640 1 --2- 172.21.15.19:0/714916095 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa32010a150 0x7fa3201a8080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:27:34.568 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:34.542+0000 7fa31effd640 1 -- 172.21.15.19:0/714916095 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa32010a150 msgr2=0x7fa3201a8080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:27:34.568 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:34.542+0000 7fa31effd640 1 --2- 172.21.15.19:0/714916095 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa32010a150 0x7fa3201a8080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:27:34.568 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:34.542+0000 7fa31effd640 1 -- 172.21.15.19:0/714916095 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa32011c0a0 msgr2=0x7fa3201ad960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:27:34.568 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:34.542+0000 7fa31effd640 1 --2- 172.21.15.19:0/714916095 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa32011c0a0 0x7fa3201ad960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:27:34.568 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:34.542+0000 7fa31effd640 1 -- 172.21.15.19:0/714916095 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa3201ae130 con 0x7fa32010a530 2024-09-10T22:27:34.568 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:34.542+0000 7fa31effd640 1 --2- 172.21.15.19:0/714916095 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa32010a530 0x7fa3201a85c0 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7fa31800e9f0 tx=0x7fa31800eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:27:34.568 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:34.543+0000 7fa31cff9640 1 -- 172.21.15.19:0/714916095 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa31800cd80 con 0x7fa32010a530 2024-09-10T22:27:34.568 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:34.543+0000 7fa31cff9640 1 -- 172.21.15.19:0/714916095 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa3180108e0 con 0x7fa32010a530 2024-09-10T22:27:34.569 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:34.544+0000 7fa31cff9640 1 -- 172.21.15.19:0/714916095 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa318018980 con 0x7fa32010a530 2024-09-10T22:27:34.569 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:34.544+0000 7fa325ccd640 1 -- 172.21.15.19:0/714916095 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa3201ae420 con 0x7fa32010a530 2024-09-10T22:27:34.569 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:34.544+0000 7fa325ccd640 1 -- 172.21.15.19:0/714916095 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa3201b4ae0 con 0x7fa32010a530 2024-09-10T22:27:34.569 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:34.548+0000 7fa3280a2740 1 Processor -- start 2024-09-10T22:27:34.569 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:34.548+0000 7fa3280a2740 1 -- start start 2024-09-10T22:27:34.569 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:34.549+0000 7fa3280a2740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5623e30bc480 0x5623e30bc860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:27:34.569 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:34.549+0000 7fa3280a2740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5623e30bcda0 0x5623e30c87f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:27:34.569 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:34.549+0000 7fa3280a2740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5623e30c8d30 0x5623e30cb120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:27:34.569 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:34.549+0000 7fa3280a2740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x5623e3032e50 con 0x5623e30c8d30 2024-09-10T22:27:34.569 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:34.549+0000 7fa3280a2740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x5623e3022280 con 0x5623e30bcda0 2024-09-10T22:27:34.569 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:34.549+0000 7fa3280a2740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x5623e3026090 con 0x5623e30bc480 2024-09-10T22:27:34.569 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:34.549+0000 7fa31f7fe640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5623e30bcda0 0x5623e30c87f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:27:34.569 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:34.549+0000 7fa31f7fe640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5623e30bcda0 0x5623e30c87f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.19:59868/0 (socket says 172.21.15.19:59868) 2024-09-10T22:27:34.570 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:34.549+0000 7fa31f7fe640 1 -- 172.21.15.19:0/437509521 learned_addr learned my addr 172.21.15.19:0/437509521 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:27:34.570 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:34.550+0000 7fa31ffff640 1 --2- 172.21.15.19:0/437509521 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5623e30bc480 0x5623e30bc860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:27:34.570 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:34.550+0000 7fa31cff9640 1 -- 172.21.15.19:0/714916095 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 18) ==== 153250+0+0 (secure 0 0 0) 0x7fa318010430 con 0x7fa32010a530 2024-09-10T22:27:34.570 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:34.550+0000 7fa31f7fe640 1 -- 172.21.15.19:0/437509521 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5623e30bc480 msgr2=0x5623e30bc860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:27:34.570 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:34.550+0000 7fa31f7fe640 1 --2- 172.21.15.19:0/437509521 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5623e30bc480 0x5623e30bc860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:27:34.570 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:34.550+0000 7fa31f7fe640 1 -- 172.21.15.19:0/437509521 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5623e30c8d30 msgr2=0x5623e30cb120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:27:34.570 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:34.550+0000 7fa31f7fe640 1 --2- 172.21.15.19:0/437509521 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5623e30c8d30 0x5623e30cb120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:27:34.570 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:34.550+0000 7fa31f7fe640 1 -- 172.21.15.19:0/437509521 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5623e2d80650 con 0x5623e30bcda0 2024-09-10T22:27:34.570 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:34.551+0000 7fa31cff9640 1 --2- 172.21.15.19:0/714916095 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7fa30c0b53a0 0x7fa30c0b7860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:27:34.570 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:34.551+0000 7fa31ffff640 1 --2- 172.21.15.19:0/714916095 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7fa30c0b53a0 0x7fa30c0b7860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:27:34.570 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:34.552+0000 7fa31cff9640 1 -- 172.21.15.19:0/714916095 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8327+0+0 (secure 0 0 0) 0x7fa3180e6050 con 0x7fa32010a530 2024-09-10T22:27:34.571 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:34.552+0000 7fa31ffff640 1 --2- 172.21.15.19:0/714916095 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7fa30c0b53a0 0x7fa30c0b7860 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fa308005fd0 tx=0x7fa30800b5b0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:27:34.571 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:34.552+0000 7fa31f7fe640 1 --2- 172.21.15.19:0/437509521 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5623e30bcda0 0x5623e30c87f0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fa31002aec0 tx=0x7fa310009a20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fc2c2b64fefd0eff server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:27:34.571 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:34.553+0000 7fa315ffb640 1 -- 172.21.15.19:0/437509521 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa310034050 con 0x5623e30bcda0 2024-09-10T22:27:34.571 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:34.553+0000 7fa315ffb640 1 -- 172.21.15.19:0/437509521 <== mon.2 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa310003e20 con 0x5623e30bcda0 2024-09-10T22:27:34.571 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:34.553+0000 7fa315ffb640 1 -- 172.21.15.19:0/437509521 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3100042a0 con 0x5623e30bcda0 2024-09-10T22:27:34.571 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:34.555+0000 7fa3280a2740 1 -- 172.21.15.19:0/437509521 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5623e30bcda0 msgr2=0x5623e30c87f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:27:34.571 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:34.555+0000 7fa3280a2740 1 --2- 172.21.15.19:0/437509521 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5623e30bcda0 0x5623e30c87f0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fa31002aec0 tx=0x7fa310009a20 comp rx=0 tx=0).stop 2024-09-10T22:27:34.571 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:34.555+0000 7fa3280a2740 1 -- 172.21.15.19:0/437509521 shutdown_connections 2024-09-10T22:27:34.571 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:34.555+0000 7fa3280a2740 1 --2- 172.21.15.19:0/437509521 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5623e30c8d30 0x5623e30cb120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:27:34.571 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:34.555+0000 7fa3280a2740 1 --2- 172.21.15.19:0/437509521 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5623e30bcda0 0x5623e30c87f0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:27:34.571 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:34.555+0000 7fa3280a2740 1 --2- 172.21.15.19:0/437509521 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5623e30bc480 0x5623e30bc860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:27:34.571 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:34.555+0000 7fa3280a2740 1 -- 172.21.15.19:0/437509521 >> 172.21.15.19:0/437509521 conn(0x5623e30ba2b0 msgr2=0x5623e30bb450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:27:34.572 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:34.555+0000 7fa3280a2740 1 -- 172.21.15.19:0/437509521 shutdown_connections 2024-09-10T22:27:34.572 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:34.555+0000 7fa3280a2740 1 -- 172.21.15.19:0/437509521 wait complete. 2024-09-10T22:27:34.572 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:34.556+0000 7fa3280a2740 1 -- start start 2024-09-10T22:27:34.572 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:34.556+0000 7fa3280a2740 1 Processor -- start 2024-09-10T22:27:34.572 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:34.556+0000 7fa3280a2740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5623e30bc480 0x5623e30c85f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:27:34.572 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:34.557+0000 7fa3280a2740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5623e30bcda0 0x5623e30c5a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:27:34.572 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:34.557+0000 7fa3280a2740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5623e30c8d30 0x5623e30c6020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:27:34.572 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:34.557+0000 7fa3280a2740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x5623e2e83700 con 0x5623e30bc480 2024-09-10T22:27:34.572 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:34.557+0000 7fa3280a2740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x5623e2fbd110 con 0x5623e30bcda0 2024-09-10T22:27:34.572 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:34.557+0000 7fa3280a2740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x5623e30dc960 con 0x5623e30c8d30 2024-09-10T22:27:34.572 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:34.557+0000 7fa3280a2740 10 client.0 _ll_register_callbacks cb 0x5623e2fd6990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T22:27:34.573 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:34.557+0000 7fa31f7fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5623e30bc480 0x5623e30c85f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:27:34.573 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:34.557+0000 7fa31f7fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5623e30bc480 0x5623e30c85f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:53310/0 (socket says 172.21.15.19:53310) 2024-09-10T22:27:34.573 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:34.557+0000 7fa31effd640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5623e30bcda0 0x5623e30c5a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:27:34.573 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:34.557+0000 7fa31f7fe640 1 -- 172.21.15.19:0/1622918821 learned_addr learned my addr 172.21.15.19:0/1622918821 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:27:34.573 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:34.558+0000 7fa31ffff640 1 --2- 172.21.15.19:0/1622918821 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5623e30c8d30 0x5623e30c6020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:27:34.573 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:34.558+0000 7fa31f7fe640 1 -- 172.21.15.19:0/1622918821 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5623e30c8d30 msgr2=0x5623e30c6020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:27:34.573 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:34.558+0000 7fa31f7fe640 1 --2- 172.21.15.19:0/1622918821 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5623e30c8d30 0x5623e30c6020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:27:34.573 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:34.558+0000 7fa31f7fe640 1 -- 172.21.15.19:0/1622918821 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5623e30bcda0 msgr2=0x5623e30c5a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:27:34.573 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:34.558+0000 7fa31f7fe640 1 --2- 172.21.15.19:0/1622918821 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5623e30bcda0 0x5623e30c5a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:27:34.573 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:34.558+0000 7fa31f7fe640 1 -- 172.21.15.19:0/1622918821 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5623e2feac40 con 0x5623e30bc480 2024-09-10T22:27:34.573 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:34.558+0000 7fa31effd640 1 --2- 172.21.15.19:0/1622918821 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5623e30bcda0 0x5623e30c5a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T22:27:34.573 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:34.558+0000 7fa31f7fe640 1 --2- 172.21.15.19:0/1622918821 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5623e30bc480 0x5623e30c85f0 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7fa31002af40 tx=0x7fa310003c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=764ea77c7273647 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:27:34.574 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:34.558+0000 7fa2feffd640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-10T22:27:34.574 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:34.559+0000 7fa2feffd640 1 -- 172.21.15.19:0/1622918821 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa31004f020 con 0x5623e30bc480 2024-09-10T22:27:34.574 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:34.559+0000 7fa2feffd640 1 -- 172.21.15.19:0/1622918821 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8327+0+0 (secure 0 0 0) 0x7fa31002fa80 con 0x5623e30bc480 2024-09-10T22:27:34.574 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:34.559+0000 7fa3280a2740 1 -- 172.21.15.19:0/1622918821 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa310003e20 con 0x5623e30bc480 2024-09-10T22:27:34.574 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:34.559+0000 7fa2feffd640 1 -- 172.21.15.19:0/1622918821 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7fa310034020 con 0x5623e30bc480 2024-09-10T22:27:34.574 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:34.559+0000 7fa3280a2740 10 client.15567 fetch_fsmap learned FSMap version 26 2024-09-10T22:27:34.574 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:34.559+0000 7fa3280a2740 1 -- 172.21.15.19:0/1622918821 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x5623e30e8290 con 0x5623e30bc480 2024-09-10T22:27:34.574 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:34.560+0000 7fa2feffd640 1 -- 172.21.15.19:0/1622918821 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa31002fc80 con 0x5623e30bc480 2024-09-10T22:27:34.574 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:34.560+0000 7fa2feffd640 1 -- 172.21.15.19:0/1622918821 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 26) ==== 8350+0+0 (secure 0 0 0) 0x7fa310041070 con 0x5623e30bc480 2024-09-10T22:27:34.574 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:34.560+0000 7fa3280a2740 10 client.15567 fetch_fsmap finished waiting for FSMap version 26 2024-09-10T22:27:34.574 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:34.560+0000 7fa3280a2740 10 client.15567 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-10T22:27:34.574 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:34.560+0000 7fa3280a2740 20 client.15567 populate_metadata read hostname 'smithi019' 2024-09-10T22:27:34.574 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:34.560+0000 7fa3280a2740 1 --2- 172.21.15.19:0/1622918821 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x5623e30e95e0 0x5623e30eb9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:27:34.575 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:34.560+0000 7fa3280a2740 4 client.15567 mds_command: new command op to 24581 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T22:27:34.575 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:34.560+0000 7fa3280a2740 1 -- 172.21.15.19:0/1622918821 --> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7fa310003e20 con 0x5623e30e95e0 2024-09-10T22:27:34.575 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:34.560+0000 7fa31effd640 1 --2- 172.21.15.19:0/1622918821 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x5623e30e95e0 0x5623e30eb9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:27:34.575 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:34.563+0000 7fa2feffd640 10 client.15567 ms_handle_connect on v2:172.21.15.135:6838/1254769802 2024-09-10T22:27:34.575 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:34.563+0000 7fa31effd640 1 --2- 172.21.15.19:0/1622918821 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x5623e30e95e0 0x5623e30eb9d0 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c3a86b8bbdbad202 server_cookie=64ccdfae79b0a395 in_seq=0 out_seq=0 2024-09-10T22:27:34.576 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:34.565+0000 7fa2feffd640 1 -- 172.21.15.19:0/1622918821 <== mds.0 v2:172.21.15.135:6838/1254769802 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x7fa310003e20 con 0x5623e30e95e0 2024-09-10T22:27:34.577 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:34.565+0000 7fa2feffd640 10 client.15567 handle_command_reply: tid=0 2024-09-10T22:27:34.577 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:34.566+0000 7fa3280a2740 1 client.15567 shutdown 2024-09-10T22:27:34.577 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:34.566+0000 7fa3280a2740 1 -- 172.21.15.19:0/1622918821 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5623e30bc480 msgr2=0x5623e30c85f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:27:34.577 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:34.566+0000 7fa3280a2740 1 --2- 172.21.15.19:0/1622918821 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5623e30bc480 0x5623e30c85f0 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7fa31002af40 tx=0x7fa310003c10 comp rx=0 tx=0).stop 2024-09-10T22:27:34.577 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:34.566+0000 7fa3280a2740 1 -- 172.21.15.19:0/1622918821 shutdown_connections 2024-09-10T22:27:34.577 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:34.566+0000 7fa3280a2740 1 --2- 172.21.15.19:0/1622918821 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x5623e30e95e0 0x5623e30eb9d0 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:27:34.577 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:34.566+0000 7fa2feffd640 0 client.15567 ms_handle_reset on v2:172.21.15.135:6838/1254769802 2024-09-10T22:27:34.577 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:34.566+0000 7fa3280a2740 1 --2- 172.21.15.19:0/1622918821 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5623e30c8d30 0x5623e30c6020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:27:34.577 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:34.566+0000 7fa3280a2740 1 --2- 172.21.15.19:0/1622918821 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5623e30bcda0 0x5623e30c5a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:27:34.577 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:34.566+0000 7fa3280a2740 1 --2- 172.21.15.19:0/1622918821 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5623e30bc480 0x5623e30c85f0 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:27:34.577 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:34.566+0000 7fa3280a2740 1 -- 172.21.15.19:0/1622918821 >> 172.21.15.19:0/1622918821 conn(0x5623e30ba2b0 msgr2=0x5623e30bfe20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:27:34.577 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:34.567+0000 7fa3280a2740 1 -- 172.21.15.19:0/1622918821 shutdown_connections 2024-09-10T22:27:34.578 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:34.567+0000 7fa3280a2740 1 -- 172.21.15.19:0/1622918821 wait complete. 2024-09-10T22:27:34.578 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:34.567+0000 7fa3280a2740 20 client.15567 trim_cache size 0 max 16384 2024-09-10T22:27:34.607 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:34.606+0000 7fa3280a2740 1 Processor -- start 2024-09-10T22:27:34.608 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:34.606+0000 7fa3280a2740 1 -- start start 2024-09-10T22:27:34.608 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:34.607+0000 7fa3280a2740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5623e30bc480 0x5623e30bb7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:27:34.608 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:34.607+0000 7fa3280a2740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5623e30bcda0 0x5623e30b9bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:27:34.608 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:34.607+0000 7fa3280a2740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5623e30c8d30 0x5623e30c7780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:27:34.608 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:34.607+0000 7fa3280a2740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fa3201b7420 con 0x5623e30c8d30 2024-09-10T22:27:34.608 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:34.607+0000 7fa3280a2740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fa3201b4d10 con 0x5623e30bc480 2024-09-10T22:27:34.609 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:34.607+0000 7fa3280a2740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7fa32010a970 con 0x5623e30bcda0 2024-09-10T22:27:34.609 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:34.607+0000 7fa31f7fe640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5623e30bc480 0x5623e30bb7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:27:34.609 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:34.607+0000 7fa31f7fe640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5623e30bc480 0x5623e30bb7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.19:59894/0 (socket says 172.21.15.19:59894) 2024-09-10T22:27:34.609 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:34.607+0000 7fa31f7fe640 1 -- 172.21.15.19:0/1895118103 learned_addr learned my addr 172.21.15.19:0/1895118103 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:27:34.609 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:34.607+0000 7fa31effd640 1 --2- 172.21.15.19:0/1895118103 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5623e30bcda0 0x5623e30b9bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:27:34.609 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:34.607+0000 7fa31ffff640 1 --2- 172.21.15.19:0/1895118103 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5623e30c8d30 0x5623e30c7780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:27:34.610 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:34.608+0000 7fa31effd640 1 -- 172.21.15.19:0/1895118103 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5623e30bc480 msgr2=0x5623e30bb7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:27:34.610 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:34.608+0000 7fa31effd640 1 --2- 172.21.15.19:0/1895118103 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5623e30bc480 0x5623e30bb7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:27:34.610 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:34.608+0000 7fa31effd640 1 -- 172.21.15.19:0/1895118103 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5623e30c8d30 msgr2=0x5623e30c7780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:27:34.610 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:34.608+0000 7fa31effd640 1 --2- 172.21.15.19:0/1895118103 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5623e30c8d30 0x5623e30c7780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:27:34.610 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:34.608+0000 7fa31effd640 1 -- 172.21.15.19:0/1895118103 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5623e30bcbd0 con 0x5623e30bcda0 2024-09-10T22:27:34.610 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:34.608+0000 7fa31ffff640 1 --2- 172.21.15.19:0/1895118103 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5623e30c8d30 0x5623e30c7780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T22:27:34.610 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:34.608+0000 7fa31effd640 1 --2- 172.21.15.19:0/1895118103 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5623e30bcda0 0x5623e30b9bc0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fa3180ac6e0 tx=0x7fa31800cf20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=856767b8f9f9fadc server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:27:34.611 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:34.609+0000 7fa3157fa640 1 -- 172.21.15.19:0/1895118103 <== mon.1 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3180ac750 con 0x5623e30bcda0 2024-09-10T22:27:34.611 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:34.609+0000 7fa3157fa640 1 -- 172.21.15.19:0/1895118103 <== mon.1 v2:172.21.15.138:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa3180a6e50 con 0x5623e30bcda0 2024-09-10T22:27:34.611 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:34.609+0000 7fa3157fa640 1 -- 172.21.15.19:0/1895118103 <== mon.1 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa318018b20 con 0x5623e30bcda0 2024-09-10T22:27:34.612 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:34.610+0000 7fa3280a2740 1 -- 172.21.15.19:0/1895118103 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5623e30bcda0 msgr2=0x5623e30b9bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:27:34.612 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:34.610+0000 7fa3280a2740 1 --2- 172.21.15.19:0/1895118103 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5623e30bcda0 0x5623e30b9bc0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fa3180ac6e0 tx=0x7fa31800cf20 comp rx=0 tx=0).stop 2024-09-10T22:27:34.612 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:34.611+0000 7fa3280a2740 1 -- 172.21.15.19:0/1895118103 shutdown_connections 2024-09-10T22:27:34.612 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:34.611+0000 7fa3280a2740 1 --2- 172.21.15.19:0/1895118103 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5623e30c8d30 0x5623e30c7780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:27:34.612 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:34.611+0000 7fa3280a2740 1 --2- 172.21.15.19:0/1895118103 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5623e30bcda0 0x5623e30b9bc0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:27:34.612 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:34.611+0000 7fa3280a2740 1 --2- 172.21.15.19:0/1895118103 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5623e30bc480 0x5623e30bb7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:27:34.612 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:34.611+0000 7fa3280a2740 1 -- 172.21.15.19:0/1895118103 >> 172.21.15.19:0/1895118103 conn(0x5623e30ba2b0 msgr2=0x5623e30c7070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:27:34.614 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:34.613+0000 7fa3280a2740 1 -- 172.21.15.19:0/1895118103 shutdown_connections 2024-09-10T22:27:34.614 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:34.613+0000 7fa3280a2740 1 -- 172.21.15.19:0/1895118103 wait complete. 2024-09-10T22:27:34.614 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:34.613+0000 7fa3280a2740 1 -- start start 2024-09-10T22:27:34.615 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:34.614+0000 7fa3280a2740 1 Processor -- start 2024-09-10T22:27:34.615 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:34.614+0000 7fa3280a2740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5623e30bc480 0x5623e30ecab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:27:34.616 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:34.614+0000 7fa3280a2740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5623e30bcda0 0x5623e30ecff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:27:34.617 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:34.615+0000 7fa31f7fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5623e30bc480 0x5623e30ecab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:27:34.617 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:34.615+0000 7fa31f7fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5623e30bc480 0x5623e30ecab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:53324/0 (socket says 172.21.15.19:53324) 2024-09-10T22:27:34.617 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:34.615+0000 7fa31f7fe640 1 -- 172.21.15.19:0/652286398 learned_addr learned my addr 172.21.15.19:0/652286398 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:27:34.617 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:34.615+0000 7fa3280a2740 1 --2- 172.21.15.19:0/652286398 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5623e30c8d30 0x5623e30ed530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:27:34.617 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:34.615+0000 7fa3280a2740 1 -- 172.21.15.19:0/652286398 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fa320118530 con 0x5623e30bc480 2024-09-10T22:27:34.617 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:34.615+0000 7fa3280a2740 1 -- 172.21.15.19:0/652286398 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fa3201199a0 con 0x5623e30c8d30 2024-09-10T22:27:34.617 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:34.615+0000 7fa3280a2740 1 -- 172.21.15.19:0/652286398 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7fa320118c00 con 0x5623e30bcda0 2024-09-10T22:27:34.617 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:34.615+0000 7fa31ffff640 1 --2- 172.21.15.19:0/652286398 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5623e30c8d30 0x5623e30ed530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:27:34.617 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:34.615+0000 7fa31effd640 1 --2- 172.21.15.19:0/652286398 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5623e30bcda0 0x5623e30ecff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:27:34.618 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:34.616+0000 7fa31f7fe640 1 -- 172.21.15.19:0/652286398 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5623e30bcda0 msgr2=0x5623e30ecff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:27:34.618 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:34.616+0000 7fa31f7fe640 1 --2- 172.21.15.19:0/652286398 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5623e30bcda0 0x5623e30ecff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:27:34.618 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:34.616+0000 7fa31f7fe640 1 -- 172.21.15.19:0/652286398 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5623e30c8d30 msgr2=0x5623e30ed530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:27:34.619 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:34.616+0000 7fa31f7fe640 1 --2- 172.21.15.19:0/652286398 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5623e30c8d30 0x5623e30ed530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:27:34.619 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:34.616+0000 7fa31f7fe640 1 -- 172.21.15.19:0/652286398 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5623e31552d0 con 0x5623e30bc480 2024-09-10T22:27:34.619 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:34.616+0000 7fa31f7fe640 1 --2- 172.21.15.19:0/652286398 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5623e30bc480 0x5623e30ecab0 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7fa310009430 tx=0x7fa310043670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7048672781b8c356 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:27:34.619 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:34.617+0000 7fa3280a2740 10 client.0 _ll_register_callbacks cb 0x7fa310009b20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T22:27:34.619 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:34.617+0000 7fa2feffd640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-10T22:27:34.619 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:34.617+0000 7fa3280a2740 1 -- 172.21.15.19:0/652286398 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa3180a6e50 con 0x5623e30bc480 2024-09-10T22:27:34.619 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:34.617+0000 7fa2feffd640 1 -- 172.21.15.19:0/652286398 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa310063060 con 0x5623e30bc480 2024-09-10T22:27:34.619 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:34.617+0000 7fa2feffd640 1 -- 172.21.15.19:0/652286398 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8327+0+0 (secure 0 0 0) 0x7fa31002fa80 con 0x5623e30bc480 2024-09-10T22:27:34.619 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:34.617+0000 7fa2feffd640 1 -- 172.21.15.19:0/652286398 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7fa31002fd00 con 0x5623e30bc480 2024-09-10T22:27:34.620 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:34.617+0000 7fa3280a2740 10 client.15573 fetch_fsmap learned FSMap version 26 2024-09-10T22:27:34.620 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:34.617+0000 7fa3280a2740 1 -- 172.21.15.19:0/652286398 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({fsmap=26}) -- 0x5623e31562d0 con 0x5623e30bc480 2024-09-10T22:27:34.620 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:34.618+0000 7fa2feffd640 1 -- 172.21.15.19:0/652286398 <== mon.0 v2:172.21.15.19:3300/0 4 ==== fsmap(e 26) ==== 8350+0+0 (secure 0 0 0) 0x7fa310041040 con 0x5623e30bc480 2024-09-10T22:27:34.620 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:34.618+0000 7fa3280a2740 10 client.15573 fetch_fsmap finished waiting for FSMap version 26 2024-09-10T22:27:34.620 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:34.618+0000 7fa3280a2740 10 client.15573 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-10T22:27:34.620 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:34.618+0000 7fa3280a2740 20 client.15573 populate_metadata read hostname 'smithi019' 2024-09-10T22:27:34.620 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:34.618+0000 7fa3280a2740 1 --2- 172.21.15.19:0/652286398 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x5623e30e95e0 0x5623e3158af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:27:34.620 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:34.618+0000 7fa3280a2740 4 client.15573 mds_command: new command op to 24581 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-10T22:27:34.620 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:34.618+0000 7fa3280a2740 1 -- 172.21.15.19:0/652286398 --> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] -- command(tid 0: {"prefix": "scrub status"}) -- 0x5623e3034da0 con 0x5623e30e95e0 2024-09-10T22:27:34.621 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:34.619+0000 7fa31effd640 1 --2- 172.21.15.19:0/652286398 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x5623e30e95e0 0x5623e3158af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:27:34.621 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:34.620+0000 7fa31effd640 1 --2- 172.21.15.19:0/652286398 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x5623e30e95e0 0x5623e3158af0 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b0c053cd827d2465 server_cookie=eba5d5ccfa5b781c in_seq=0 out_seq=0 2024-09-10T22:27:34.621 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:34.620+0000 7fa2feffd640 10 client.15573 ms_handle_connect on v2:172.21.15.135:6838/1254769802 2024-09-10T22:27:34.621 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:34.620+0000 7fa2feffd640 1 -- 172.21.15.19:0/652286398 <== mds.0 v2:172.21.15.135:6838/1254769802 1 ==== command_reply(tid 0: 0 ) ==== 8+0+658 (crc 0 0 0) 0x5623e3034da0 con 0x5623e30e95e0 2024-09-10T22:27:34.622 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:34.620+0000 7fa2feffd640 10 client.15573 handle_command_reply: tid=0 2024-09-10T22:27:34.622 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:34.620+0000 7fa3280a2740 1 client.15573 shutdown 2024-09-10T22:27:34.631 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:34.629+0000 7fa3280a2740 1 -- 172.21.15.19:0/652286398 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5623e30bc480 msgr2=0x5623e30ecab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:27:34.631 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:34.630+0000 7fa3280a2740 1 --2- 172.21.15.19:0/652286398 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5623e30bc480 0x5623e30ecab0 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7fa310009430 tx=0x7fa310043670 comp rx=0 tx=0).stop 2024-09-10T22:27:34.634 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:34.632+0000 7fa3280a2740 1 -- 172.21.15.19:0/652286398 shutdown_connections 2024-09-10T22:27:34.634 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:34.632+0000 7fa3280a2740 1 --2- 172.21.15.19:0/652286398 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5623e30c8d30 0x5623e30ed530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:27:34.634 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:34.632+0000 7fa3280a2740 1 --2- 172.21.15.19:0/652286398 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x5623e30e95e0 0x5623e3158af0 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:27:34.634 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:34.632+0000 7fa3280a2740 1 --2- 172.21.15.19:0/652286398 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5623e30bcda0 0x5623e30ecff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:27:34.634 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:34.632+0000 7fa3280a2740 1 --2- 172.21.15.19:0/652286398 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5623e30bc480 0x5623e30ecab0 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:27:34.634 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:34.632+0000 7fa3280a2740 1 -- 172.21.15.19:0/652286398 >> 172.21.15.19:0/652286398 conn(0x5623e30ba2b0 msgr2=0x5623e30c7890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:27:34.634 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:34.632+0000 7fa2feffd640 0 client.15573 ms_handle_reset on v2:172.21.15.135:6838/1254769802 2024-09-10T22:27:34.634 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:34.632+0000 7fa3280a2740 1 -- 172.21.15.19:0/652286398 shutdown_connections 2024-09-10T22:27:34.635 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:34.634+0000 7fa3280a2740 1 -- 172.21.15.19:0/652286398 wait complete. 2024-09-10T22:27:34.636 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:34.634+0000 7fa3280a2740 20 client.15573 trim_cache size 0 max 16384 2024-09-10T22:27:34.637 INFO:teuthology.orchestra.run.smithi019.stdout:{ 2024-09-10T22:27:34.637 INFO:teuthology.orchestra.run.smithi019.stdout: "status": "no active scrubs running", 2024-09-10T22:27:34.637 INFO:teuthology.orchestra.run.smithi019.stdout: "scrubs": {}, 2024-09-10T22:27:34.637 INFO:teuthology.orchestra.run.smithi019.stdout: "scrub_stats": { 2024-09-10T22:27:34.637 INFO:teuthology.orchestra.run.smithi019.stdout: "b38852c8-478a-42ef-8384-b2c55d5313a4": { 2024-09-10T22:27:34.638 INFO:teuthology.orchestra.run.smithi019.stdout: "start_time": "2024-09-10T22:27:00.320308+0000", 2024-09-10T22:27:34.638 INFO:teuthology.orchestra.run.smithi019.stdout: "path": "/", 2024-09-10T22:27:34.638 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_started": 0, 2024-09-10T22:27:34.638 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_passed": 0, 2024-09-10T22:27:34.638 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_failed": 0, 2024-09-10T22:27:34.638 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_skipped": 0 2024-09-10T22:27:34.638 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:27:34.638 INFO:teuthology.orchestra.run.smithi019.stdout: "9b6bfdee-303c-4c12-af56-dc85860d112a": { 2024-09-10T22:27:34.638 INFO:teuthology.orchestra.run.smithi019.stdout: "start_time": "2024-09-10T22:26:17.484162+0000", 2024-09-10T22:27:34.638 INFO:teuthology.orchestra.run.smithi019.stdout: "path": "/", 2024-09-10T22:27:34.638 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_started": 0, 2024-09-10T22:27:34.638 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_passed": 0, 2024-09-10T22:27:34.638 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_failed": 0, 2024-09-10T22:27:34.638 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_skipped": 0 2024-09-10T22:27:34.639 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-10T22:27:34.639 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-10T22:27:34.639 INFO:teuthology.orchestra.run.smithi019.stdout:} 2024-09-10T22:27:34.640 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:34.639+0000 7fa325ccd640 1 -- 172.21.15.19:0/714916095 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7fa30c0b53a0 msgr2=0x7fa30c0b7860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:27:34.641 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:34.639+0000 7fa325ccd640 1 --2- 172.21.15.19:0/714916095 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7fa30c0b53a0 0x7fa30c0b7860 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fa308005fd0 tx=0x7fa30800b5b0 comp rx=0 tx=0).stop 2024-09-10T22:27:34.641 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:34.639+0000 7fa325ccd640 1 -- 172.21.15.19:0/714916095 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa32010a530 msgr2=0x7fa3201a85c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:27:34.641 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:34.639+0000 7fa325ccd640 1 --2- 172.21.15.19:0/714916095 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa32010a530 0x7fa3201a85c0 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7fa31800e9f0 tx=0x7fa31800eeb0 comp rx=0 tx=0).stop 2024-09-10T22:27:34.641 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:34.639+0000 7fa325ccd640 1 -- 172.21.15.19:0/714916095 shutdown_connections 2024-09-10T22:27:34.641 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:34.639+0000 7fa325ccd640 1 --2- 172.21.15.19:0/714916095 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7fa30c0b53a0 0x7fa30c0b7860 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:27:34.641 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:34.639+0000 7fa325ccd640 1 --2- 172.21.15.19:0/714916095 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa32011c0a0 0x7fa3201ad960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:27:34.641 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:34.639+0000 7fa325ccd640 1 --2- 172.21.15.19:0/714916095 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa32010a530 0x7fa3201a85c0 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:27:34.642 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:34.639+0000 7fa325ccd640 1 --2- 172.21.15.19:0/714916095 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa32010a150 0x7fa3201a8080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:27:34.642 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:34.639+0000 7fa325ccd640 1 -- 172.21.15.19:0/714916095 >> 172.21.15.19:0/714916095 conn(0x7fa32006dfc0 msgr2=0x7fa32011c6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:27:34.642 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:34.639+0000 7fa325ccd640 1 -- 172.21.15.19:0/714916095 shutdown_connections 2024-09-10T22:27:34.642 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:34.639+0000 7fa325ccd640 1 -- 172.21.15.19:0/714916095 wait complete. 2024-09-10T22:27:35.461 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:27:35 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T22:27:35.461 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:27:35 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:27:35.461 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:27:35 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:27:35.461 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:27:35 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:27:35.461 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:27:35 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:27:35.612 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:27:35 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T22:27:35.612 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:27:35 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:27:35.612 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:27:35 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:27:35.612 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:27:35 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:27:35.612 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:27:35 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:27:35.625 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:27:35 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T22:27:35.625 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:27:35 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:27:35.625 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:27:35 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:27:35.625 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:27:35 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:27:35.625 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:27:35 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:27:36.081 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-10T22:27:36.081 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 22997a4c-6fc2-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-10T22:27:36.459 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:27:36 smithi019 ceph-mon[31375]: pgmap v382: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 631 MiB/s wr, 1.09k op/s 2024-09-10T22:27:36.459 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:27:36 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:27:36.459 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:27:36 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:27:36.610 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:27:36 smithi135 ceph-mon[34789]: pgmap v382: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 631 MiB/s wr, 1.09k op/s 2024-09-10T22:27:36.610 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:27:36 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:27:36.610 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:27:36 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:27:36.625 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:27:36 smithi138 ceph-mon[35236]: pgmap v382: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 631 MiB/s wr, 1.09k op/s 2024-09-10T22:27:36.625 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:27:36 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:27:36.625 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:27:36 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:27:36.707 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/22997a4c-6fc2-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T22:27:37.570 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:27:37 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T22:27:37.570 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:27:37 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T22:27:37.570 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:27:37 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:27:37.811 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:37.807+0000 7fd112e8a640 1 -- 172.21.15.19:0/3327416807 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd10c10a530 msgr2=0x7fd10c10a970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:27:37.812 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:37.807+0000 7fd112e8a640 1 --2- 172.21.15.19:0/3327416807 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd10c10a530 0x7fd10c10a970 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7fd104009ca0 tx=0x7fd10402a8f0 comp rx=0 tx=0).stop 2024-09-10T22:27:37.812 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:37.809+0000 7fd112e8a640 1 -- 172.21.15.19:0/3327416807 shutdown_connections 2024-09-10T22:27:37.812 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:37.809+0000 7fd112e8a640 1 --2- 172.21.15.19:0/3327416807 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd10c11c0a0 0x7fd10c11e490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:27:37.812 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:37.809+0000 7fd112e8a640 1 --2- 172.21.15.19:0/3327416807 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd10c10a530 0x7fd10c10a970 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:27:37.812 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:37.809+0000 7fd112e8a640 1 --2- 172.21.15.19:0/3327416807 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd10c10a150 0x7fd10c1111b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:27:37.812 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:37.809+0000 7fd112e8a640 1 -- 172.21.15.19:0/3327416807 >> 172.21.15.19:0/3327416807 conn(0x7fd10c06cb30 msgr2=0x7fd10c06cf40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:27:37.812 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:37.809+0000 7fd112e8a640 1 -- 172.21.15.19:0/3327416807 shutdown_connections 2024-09-10T22:27:37.813 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:37.809+0000 7fd112e8a640 1 -- 172.21.15.19:0/3327416807 wait complete. 2024-09-10T22:27:37.813 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:37.810+0000 7fd112e8a640 1 Processor -- start 2024-09-10T22:27:37.814 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:37.811+0000 7fd112e8a640 1 -- start start 2024-09-10T22:27:37.814 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:37.811+0000 7fd112e8a640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd10c10a150 0x7fd10c119430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:27:37.814 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:37.811+0000 7fd112e8a640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd10c10a530 0x7fd10c119970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:27:37.814 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:37.811+0000 7fd112e8a640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd10c11c0a0 0x7fd10c112730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:27:37.814 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:37.811+0000 7fd112e8a640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fd10c121aa0 con 0x7fd10c10a150 2024-09-10T22:27:37.814 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:37.811+0000 7fd112e8a640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fd10c121920 con 0x7fd10c11c0a0 2024-09-10T22:27:37.814 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:37.811+0000 7fd112e8a640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7fd10c121c20 con 0x7fd10c10a530 2024-09-10T22:27:37.819 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:37.817+0000 7fd111687640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd10c10a530 0x7fd10c119970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:27:37.819 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:37.817+0000 7fd111e88640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd10c10a150 0x7fd10c119430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:27:37.819 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:37.817+0000 7fd111e88640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd10c10a150 0x7fd10c119430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:53354/0 (socket says 172.21.15.19:53354) 2024-09-10T22:27:37.819 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:37.817+0000 7fd111e88640 1 -- 172.21.15.19:0/421602278 learned_addr learned my addr 172.21.15.19:0/421602278 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:27:37.819 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:37.818+0000 7fd112689640 1 --2- 172.21.15.19:0/421602278 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd10c11c0a0 0x7fd10c112730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:27:37.820 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:37.818+0000 7fd111687640 1 -- 172.21.15.19:0/421602278 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd10c11c0a0 msgr2=0x7fd10c112730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:27:37.820 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:37.818+0000 7fd111687640 1 --2- 172.21.15.19:0/421602278 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd10c11c0a0 0x7fd10c112730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:27:37.820 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:37.818+0000 7fd111687640 1 -- 172.21.15.19:0/421602278 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd10c10a150 msgr2=0x7fd10c119430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:27:37.820 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:37.818+0000 7fd111687640 1 --2- 172.21.15.19:0/421602278 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd10c10a150 0x7fd10c119430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:27:37.820 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:37.818+0000 7fd111687640 1 -- 172.21.15.19:0/421602278 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd10c112ff0 con 0x7fd10c10a530 2024-09-10T22:27:37.821 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:37.819+0000 7fd111687640 1 --2- 172.21.15.19:0/421602278 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd10c10a530 0x7fd10c119970 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fd10402aee0 tx=0x7fd104031ed0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:27:37.824 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:37.822+0000 7fd102ffd640 1 -- 172.21.15.19:0/421602278 <== mon.1 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd104030870 con 0x7fd10c10a530 2024-09-10T22:27:37.824 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:37.822+0000 7fd112e8a640 1 -- 172.21.15.19:0/421602278 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd10c113280 con 0x7fd10c10a530 2024-09-10T22:27:37.824 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:37.822+0000 7fd112e8a640 1 -- 172.21.15.19:0/421602278 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd10c118270 con 0x7fd10c10a530 2024-09-10T22:27:37.824 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:37.822+0000 7fd102ffd640 1 -- 172.21.15.19:0/421602278 <== mon.1 v2:172.21.15.138:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd10402d070 con 0x7fd10c10a530 2024-09-10T22:27:37.825 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:37.823+0000 7fd102ffd640 1 -- 172.21.15.19:0/421602278 <== mon.1 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd10403bcd0 con 0x7fd10c10a530 2024-09-10T22:27:37.827 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:37.825+0000 7fd112e8a640 1 -- 172.21.15.19:0/421602278 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd10c0747b0 con 0x7fd10c10a530 2024-09-10T22:27:37.834 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:37.831+0000 7fd102ffd640 1 -- 172.21.15.19:0/421602278 <== mon.1 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 18) ==== 153250+0+0 (secure 0 0 0) 0x7fd10403b400 con 0x7fd10c10a530 2024-09-10T22:27:37.838 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:37.833+0000 7fd102ffd640 1 --2- 172.21.15.19:0/421602278 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7fd0f80b55b0 0x7fd0f80b7a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:27:37.838 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:37.834+0000 7fd102ffd640 1 -- 172.21.15.19:0/421602278 <== mon.1 v2:172.21.15.138:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8327+0+0 (secure 0 0 0) 0x7fd104106bf0 con 0x7fd10c10a530 2024-09-10T22:27:37.838 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:37.835+0000 7fd111e88640 1 --2- 172.21.15.19:0/421602278 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7fd0f80b55b0 0x7fd0f80b7a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:27:37.844 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:37.838+0000 7fd102ffd640 1 -- 172.21.15.19:0/421602278 <== mon.1 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7fd1040cda70 con 0x7fd10c10a530 2024-09-10T22:27:37.860 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:27:37 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T22:27:37.860 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:27:37 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T22:27:37.860 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:27:37 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:27:37.875 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:27:37 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T22:27:37.875 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:27:37 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T22:27:37.875 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:27:37 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:27:37.881 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:37.878+0000 7fd111e88640 1 --2- 172.21.15.19:0/421602278 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7fd0f80b55b0 0x7fd0f80b7a70 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fd108009c20 tx=0x7fd108005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:27:38.338 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:38.337+0000 7fd112e8a640 1 -- 172.21.15.19:0/421602278 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd10c10a970 con 0x7fd10c10a530 2024-09-10T22:27:38.339 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:38.338+0000 7fd102ffd640 1 -- 172.21.15.19:0/421602278 <== mon.1 v2:172.21.15.138:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) ==== 94+0+11922 (secure 0 0 0) 0x7fd1040cd370 con 0x7fd10c10a530 2024-09-10T22:27:38.339 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-10T22:27:38.340 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":26,"btime":"2024-09-10T22:27:32:930215+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14673,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6835/1835804747","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6834","nonce":1835804747},{"type":"v1","addr":"172.21.15.19:6835","nonce":1835804747}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14685,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6837/1750470490","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6836","nonce":1750470490},{"type":"v1","addr":"172.21.15.19:6837","nonce":1750470490}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14733,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6839/2642941149","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6838","nonce":2642941149},{"type":"v1","addr":"172.21.15.19:6839","nonce":2642941149}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14745,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6841/2449948682","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6840","nonce":2449948682},{"type":"v1","addr":"172.21.15.19:6841","nonce":2449948682}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24511,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.138:6833/2524811494","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6832","nonce":2524811494},{"type":"v1","addr":"172.21.15.138:6833","nonce":2524811494}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24512,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6833/3014993624","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6832","nonce":3014993624},{"type":"v1","addr":"172.21.15.135:6833","nonce":3014993624}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":26,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-10T22:24:22.733925+0000","modified":"2024-09-10T22:27:32.420238+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24581,"mds_1":24568,"mds_2":24553},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24527":{"gid":24527,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.135:6835/3715773348","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6834","nonce":3715773348},{"type":"v1","addr":"172.21.15.135:6835","nonce":3715773348}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24541":{"gid":24541,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.138:6835/933547028","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6834","nonce":933547028},{"type":"v1","addr":"172.21.15.138:6835","nonce":933547028}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24551":{"gid":24551,"name":"h","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.135:6837/3495029135","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6836","nonce":3495029135},{"type":"v1","addr":"172.21.15.135:6837","nonce":3495029135}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24553":{"gid":24553,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":10,"addr":"172.21.15.138:6837/3353290042","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6836","nonce":3353290042},{"type":"v1","addr":"172.21.15.138:6837","nonce":3353290042}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24568":{"gid":24568,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.138:6839/383637208","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6838","nonce":383637208},{"type":"v1","addr":"172.21.15.138:6839","nonce":383637208}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24581":{"gid":24581,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.135:6839/1254769802","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6838","nonce":1254769802},{"type":"v1","addr":"172.21.15.135:6839","nonce":1254769802}]},"join_fscid":-1,"export_targets":[1],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24581,"qdb_cluster":[24553,24568,24581]},"id":1}]} 2024-09-10T22:27:38.340 INFO:teuthology.orchestra.run.smithi019.stderr:dumped fsmap epoch 26 2024-09-10T22:27:38.343 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:38.341+0000 7fd112e8a640 1 -- 172.21.15.19:0/421602278 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7fd0f80b55b0 msgr2=0x7fd0f80b7a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:27:38.343 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:38.341+0000 7fd112e8a640 1 --2- 172.21.15.19:0/421602278 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7fd0f80b55b0 0x7fd0f80b7a70 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fd108009c20 tx=0x7fd108005f90 comp rx=0 tx=0).stop 2024-09-10T22:27:38.343 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:38.341+0000 7fd112e8a640 1 -- 172.21.15.19:0/421602278 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd10c10a530 msgr2=0x7fd10c119970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:27:38.343 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:38.341+0000 7fd112e8a640 1 --2- 172.21.15.19:0/421602278 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd10c10a530 0x7fd10c119970 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fd10402aee0 tx=0x7fd104031ed0 comp rx=0 tx=0).stop 2024-09-10T22:27:38.343 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:38.341+0000 7fd112e8a640 1 -- 172.21.15.19:0/421602278 shutdown_connections 2024-09-10T22:27:38.343 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:38.341+0000 7fd112e8a640 1 --2- 172.21.15.19:0/421602278 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7fd0f80b55b0 0x7fd0f80b7a70 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:27:38.343 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:38.341+0000 7fd112e8a640 1 --2- 172.21.15.19:0/421602278 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd10c11c0a0 0x7fd10c112730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:27:38.343 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:38.341+0000 7fd112e8a640 1 --2- 172.21.15.19:0/421602278 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd10c10a530 0x7fd10c119970 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:27:38.343 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:38.341+0000 7fd112e8a640 1 --2- 172.21.15.19:0/421602278 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd10c10a150 0x7fd10c119430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:27:38.343 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:38.341+0000 7fd112e8a640 1 -- 172.21.15.19:0/421602278 >> 172.21.15.19:0/421602278 conn(0x7fd10c06cb30 msgr2=0x7fd10c11c520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:27:38.344 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:38.342+0000 7fd112e8a640 1 -- 172.21.15.19:0/421602278 shutdown_connections 2024-09-10T22:27:38.344 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:38.342+0000 7fd112e8a640 1 -- 172.21.15.19:0/421602278 wait complete. 2024-09-10T22:27:38.709 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:27:38 smithi019 ceph-mon[31375]: pgmap v383: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 961 KiB/s rd, 673 MiB/s wr, 1.15k op/s 2024-09-10T22:27:38.709 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:27:38 smithi019 ceph-mon[31375]: from='client.? 172.21.15.19:0/421602278' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T22:27:38.859 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:27:38 smithi135 ceph-mon[34789]: pgmap v383: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 961 KiB/s rd, 673 MiB/s wr, 1.15k op/s 2024-09-10T22:27:38.860 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:27:38 smithi135 ceph-mon[34789]: from='client.? 172.21.15.19:0/421602278' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T22:27:38.875 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:27:38 smithi138 ceph-mon[35236]: pgmap v383: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 961 KiB/s rd, 673 MiB/s wr, 1.15k op/s 2024-09-10T22:27:38.875 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:27:38 smithi138 ceph-mon[35236]: from='client.? 172.21.15.19:0/421602278' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T22:27:39.570 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 22997a4c-6fc2-11ef-bcea-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-09-10T22:27:39.875 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:27:39 smithi138 ceph-mon[35236]: pgmap v384: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 960 KiB/s rd, 518 MiB/s wr, 1.06k op/s 2024-09-10T22:27:39.894 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/22997a4c-6fc2-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T22:27:39.958 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:27:39 smithi019 ceph-mon[31375]: pgmap v384: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 960 KiB/s rd, 518 MiB/s wr, 1.06k op/s 2024-09-10T22:27:40.109 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:27:39 smithi135 ceph-mon[34789]: pgmap v384: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 960 KiB/s rd, 518 MiB/s wr, 1.06k op/s 2024-09-10T22:27:40.352 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:40.350+0000 7fc7a2fd3640 1 -- 172.21.15.19:0/987996241 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc79c1033c0 msgr2=0x7fc79c109d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:27:40.352 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:40.350+0000 7fc7a2fd3640 1 --2- 172.21.15.19:0/987996241 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc79c1033c0 0x7fc79c109d40 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7fc794009cd0 tx=0x7fc79402a8e0 comp rx=0 tx=0).stop 2024-09-10T22:27:40.352 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:40.351+0000 7fc7a2fd3640 1 -- 172.21.15.19:0/987996241 shutdown_connections 2024-09-10T22:27:40.352 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:40.351+0000 7fc7a2fd3640 1 --2- 172.21.15.19:0/987996241 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc79c1033c0 0x7fc79c109d40 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:27:40.352 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:40.351+0000 7fc7a2fd3640 1 --2- 172.21.15.19:0/987996241 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc79c102a00 0x7fc79c102e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:27:40.353 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:40.351+0000 7fc7a2fd3640 1 --2- 172.21.15.19:0/987996241 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc79c1018b0 0x7fc79c101cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:27:40.353 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:40.351+0000 7fc7a2fd3640 1 -- 172.21.15.19:0/987996241 >> 172.21.15.19:0/987996241 conn(0x7fc79c0fd150 msgr2=0x7fc79c0ff590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:27:40.353 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:40.351+0000 7fc7a2fd3640 1 -- 172.21.15.19:0/987996241 shutdown_connections 2024-09-10T22:27:40.353 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:40.351+0000 7fc7a2fd3640 1 -- 172.21.15.19:0/987996241 wait complete. 2024-09-10T22:27:40.355 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:40.351+0000 7fc7a2fd3640 1 Processor -- start 2024-09-10T22:27:40.355 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:40.351+0000 7fc7a2fd3640 1 -- start start 2024-09-10T22:27:40.355 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:40.352+0000 7fc7a2fd3640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc79c1018b0 0x7fc79c19af80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:27:40.355 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:40.352+0000 7fc7a2fd3640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc79c102a00 0x7fc79c19b5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:27:40.355 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:40.352+0000 7fc7a2fd3640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc79c1033c0 0x7fc79c19c200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:27:40.355 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:40.352+0000 7fc7a2fd3640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fc79c10d500 con 0x7fc79c1018b0 2024-09-10T22:27:40.355 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:40.352+0000 7fc7a2fd3640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fc79c10d380 con 0x7fc79c102a00 2024-09-10T22:27:40.355 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:40.352+0000 7fc7a2fd3640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7fc79c10d680 con 0x7fc79c1033c0 2024-09-10T22:27:40.355 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:40.352+0000 7fc793fff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc79c102a00 0x7fc79c19b5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:27:40.355 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:40.352+0000 7fc7a0d6f640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc79c1018b0 0x7fc79c19af80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:27:40.355 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:40.352+0000 7fc793fff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc79c102a00 0x7fc79c19b5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.19:59936/0 (socket says 172.21.15.19:59936) 2024-09-10T22:27:40.355 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:40.352+0000 7fc793fff640 1 -- 172.21.15.19:0/3643481221 learned_addr learned my addr 172.21.15.19:0/3643481221 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:27:40.356 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:40.352+0000 7fc7a1570640 1 --2- 172.21.15.19:0/3643481221 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc79c1033c0 0x7fc79c19c200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:27:40.356 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:40.352+0000 7fc793fff640 1 -- 172.21.15.19:0/3643481221 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc79c1033c0 msgr2=0x7fc79c19c200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:27:40.356 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:40.352+0000 7fc793fff640 1 --2- 172.21.15.19:0/3643481221 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc79c1033c0 0x7fc79c19c200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:27:40.356 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:40.352+0000 7fc793fff640 1 -- 172.21.15.19:0/3643481221 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc79c1018b0 msgr2=0x7fc79c19af80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:27:40.356 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:40.352+0000 7fc793fff640 1 --2- 172.21.15.19:0/3643481221 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc79c1018b0 0x7fc79c19af80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:27:40.356 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:40.352+0000 7fc793fff640 1 -- 172.21.15.19:0/3643481221 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc79c19cac0 con 0x7fc79c102a00 2024-09-10T22:27:40.356 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:40.352+0000 7fc793fff640 1 --2- 172.21.15.19:0/3643481221 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc79c102a00 0x7fc79c19b5d0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fc78c00d950 tx=0x7fc78c00de10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:27:40.356 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:40.353+0000 7fc791ffb640 1 -- 172.21.15.19:0/3643481221 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc78c017070 con 0x7fc79c102a00 2024-09-10T22:27:40.356 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:40.353+0000 7fc791ffb640 1 -- 172.21.15.19:0/3643481221 <== mon.2 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc78c009c30 con 0x7fc79c102a00 2024-09-10T22:27:40.356 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:40.353+0000 7fc791ffb640 1 -- 172.21.15.19:0/3643481221 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc78c00f620 con 0x7fc79c102a00 2024-09-10T22:27:40.356 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:40.353+0000 7fc7a2fd3640 1 -- 172.21.15.19:0/3643481221 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc79c19cdb0 con 0x7fc79c102a00 2024-09-10T22:27:40.356 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:40.353+0000 7fc7a2fd3640 1 -- 172.21.15.19:0/3643481221 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc79c1a3480 con 0x7fc79c102a00 2024-09-10T22:27:40.359 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:40.356+0000 7fc791ffb640 1 -- 172.21.15.19:0/3643481221 <== mon.2 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 18) ==== 153250+0+0 (secure 0 0 0) 0x7fc78c010460 con 0x7fc79c102a00 2024-09-10T22:27:40.359 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:40.356+0000 7fc7a5e7b740 1 Processor -- start 2024-09-10T22:27:40.359 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:40.356+0000 7fc7a5e7b740 1 -- start start 2024-09-10T22:27:40.359 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:40.356+0000 7fc7a5e7b740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x557d5e97b860 0x557d5e97dc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:27:40.359 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:40.356+0000 7fc7a5e7b740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557d5e97e190 0x557d5e980580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:27:40.359 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:40.356+0000 7fc7a5e7b740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x557d5e980bd0 0x557d5e983090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:27:40.359 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:40.356+0000 7fc7a5e7b740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x557d5e8ed6f0 con 0x557d5e97b860 2024-09-10T22:27:40.359 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:40.356+0000 7fc7a5e7b740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x557d5e8dcb20 con 0x557d5e97e190 2024-09-10T22:27:40.360 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:40.356+0000 7fc7a5e7b740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x557d5e8e0930 con 0x557d5e980bd0 2024-09-10T22:27:40.360 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:40.356+0000 7fc793fff640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x557d5e980bd0 0x557d5e983090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:27:40.360 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:40.356+0000 7fc7a0d6f640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557d5e97e190 0x557d5e980580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:27:40.360 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:40.357+0000 7fc7a0d6f640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557d5e97e190 0x557d5e980580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.19:59940/0 (socket says 172.21.15.19:59940) 2024-09-10T22:27:40.360 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:40.357+0000 7fc793fff640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x557d5e980bd0 0x557d5e983090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.19:36154/0 (socket says 172.21.15.19:36154) 2024-09-10T22:27:40.360 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:40.357+0000 7fc7a0d6f640 1 -- 172.21.15.19:0/1272543029 learned_addr learned my addr 172.21.15.19:0/1272543029 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:27:40.360 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:40.357+0000 7fc7a1570640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x557d5e97b860 0x557d5e97dc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:27:40.360 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:40.357+0000 7fc7a0d6f640 1 -- 172.21.15.19:0/1272543029 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x557d5e980bd0 msgr2=0x557d5e983090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:27:40.360 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:40.357+0000 7fc7a0d6f640 1 --2- 172.21.15.19:0/1272543029 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x557d5e980bd0 0x557d5e983090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:27:40.360 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:40.357+0000 7fc7a0d6f640 1 -- 172.21.15.19:0/1272543029 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x557d5e97b860 msgr2=0x557d5e97dc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:27:40.360 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:40.357+0000 7fc7a0d6f640 1 --2- 172.21.15.19:0/1272543029 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x557d5e97b860 0x557d5e97dc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:27:40.360 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:40.357+0000 7fc7a0d6f640 1 -- 172.21.15.19:0/1272543029 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557d5e8a2530 con 0x557d5e97e190 2024-09-10T22:27:40.361 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:40.357+0000 7fc793fff640 1 --2- 172.21.15.19:0/1272543029 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x557d5e980bd0 0x557d5e983090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T22:27:40.361 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:40.357+0000 7fc791ffb640 1 --2- 172.21.15.19:0/3643481221 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7fc7840b5360 0x7fc7840b7820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:27:40.361 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:40.357+0000 7fc7a0d6f640 1 --2- 172.21.15.19:0/1272543029 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557d5e97e190 0x557d5e980580 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fc798009cf0 tx=0x7fc798011810 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9d4eb4cbbf4713df server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:27:40.361 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:40.357+0000 7fc7a1570640 1 --2- 172.21.15.19:0/3643481221 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7fc7840b5360 0x7fc7840b7820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:27:40.361 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:40.357+0000 7fc791ffb640 1 -- 172.21.15.19:0/3643481221 <== mon.2 v2:172.21.15.135:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8327+0+0 (secure 0 0 0) 0x7fc78c0e57a0 con 0x7fc79c102a00 2024-09-10T22:27:40.361 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:40.357+0000 7fc782ffd640 1 -- 172.21.15.19:0/1272543029 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc798004230 con 0x557d5e97e190 2024-09-10T22:27:40.361 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:40.357+0000 7fc782ffd640 1 -- 172.21.15.19:0/1272543029 <== mon.2 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc7980043d0 con 0x557d5e97e190 2024-09-10T22:27:40.361 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:40.357+0000 7fc782ffd640 1 -- 172.21.15.19:0/1272543029 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc798019880 con 0x557d5e97e190 2024-09-10T22:27:40.366 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:40.358+0000 7fc7a5e7b740 1 -- 172.21.15.19:0/1272543029 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557d5e97e190 msgr2=0x557d5e980580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:27:40.366 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:40.358+0000 7fc7a1570640 1 --2- 172.21.15.19:0/3643481221 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7fc7840b5360 0x7fc7840b7820 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fc794005e30 tx=0x7fc79403d040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:27:40.366 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:40.358+0000 7fc7a5e7b740 1 --2- 172.21.15.19:0/1272543029 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557d5e97e190 0x557d5e980580 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fc798009cf0 tx=0x7fc798011810 comp rx=0 tx=0).stop 2024-09-10T22:27:40.366 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:40.358+0000 7fc7a5e7b740 1 -- 172.21.15.19:0/1272543029 shutdown_connections 2024-09-10T22:27:40.367 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:40.358+0000 7fc7a5e7b740 1 --2- 172.21.15.19:0/1272543029 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x557d5e980bd0 0x557d5e983090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:27:40.367 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:40.358+0000 7fc7a5e7b740 1 --2- 172.21.15.19:0/1272543029 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557d5e97e190 0x557d5e980580 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:27:40.367 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:40.358+0000 7fc7a5e7b740 1 --2- 172.21.15.19:0/1272543029 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x557d5e97b860 0x557d5e97dc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:27:40.367 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:40.358+0000 7fc7a5e7b740 1 -- 172.21.15.19:0/1272543029 >> 172.21.15.19:0/1272543029 conn(0x557d5e9769b0 msgr2=0x557d5e977740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:27:40.367 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:40.358+0000 7fc7a5e7b740 1 -- 172.21.15.19:0/1272543029 shutdown_connections 2024-09-10T22:27:40.367 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:40.358+0000 7fc7a5e7b740 1 -- 172.21.15.19:0/1272543029 wait complete. 2024-09-10T22:27:40.367 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:40.359+0000 7fc7a5e7b740 1 -- start start 2024-09-10T22:27:40.367 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:40.359+0000 7fc7a5e7b740 1 Processor -- start 2024-09-10T22:27:40.367 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:40.359+0000 7fc7a5e7b740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x557d5e97b860 0x557d5e984e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:27:40.367 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:40.359+0000 7fc7a5e7b740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557d5e97e190 0x557d5e985530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:27:40.367 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:40.359+0000 7fc7a5e7b740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x557d5e980bd0 0x557d5e986100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:27:40.367 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:40.359+0000 7fc7a5e7b740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x557d5e814ab0 con 0x557d5e97b860 2024-09-10T22:27:40.368 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:40.359+0000 7fc7a5e7b740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x557d5e882730 con 0x557d5e97e190 2024-09-10T22:27:40.368 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:40.360+0000 7fc7a5e7b740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x557d5e983bb0 con 0x557d5e980bd0 2024-09-10T22:27:40.368 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:40.360+0000 7fc793fff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557d5e97e190 0x557d5e985530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:27:40.368 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:40.360+0000 7fc793fff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557d5e97e190 0x557d5e985530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.19:59956/0 (socket says 172.21.15.19:59956) 2024-09-10T22:27:40.368 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:40.360+0000 7fc793fff640 1 -- 172.21.15.19:0/1361806600 learned_addr learned my addr 172.21.15.19:0/1361806600 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:27:40.368 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:40.360+0000 7fc7a5e7b740 10 client.0 _ll_register_callbacks cb 0x557d5e8d66b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T22:27:40.368 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:40.360+0000 7fc7a1570640 1 --2- 172.21.15.19:0/1361806600 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x557d5e980bd0 0x557d5e986100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:27:40.368 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:40.360+0000 7fc7a0d6f640 1 --2- 172.21.15.19:0/1361806600 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x557d5e97b860 0x557d5e984e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:27:40.368 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:40.360+0000 7fc793fff640 1 -- 172.21.15.19:0/1361806600 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x557d5e980bd0 msgr2=0x557d5e986100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:27:40.368 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:40.360+0000 7fc793fff640 1 --2- 172.21.15.19:0/1361806600 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x557d5e980bd0 0x557d5e986100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:27:40.368 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:40.360+0000 7fc793fff640 1 -- 172.21.15.19:0/1361806600 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x557d5e97b860 msgr2=0x557d5e984e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:27:40.368 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:40.360+0000 7fc793fff640 1 --2- 172.21.15.19:0/1361806600 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x557d5e97b860 0x557d5e984e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:27:40.368 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:40.360+0000 7fc793fff640 1 -- 172.21.15.19:0/1361806600 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557d5e63e790 con 0x557d5e97e190 2024-09-10T22:27:40.369 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:40.360+0000 7fc7a0d6f640 1 --2- 172.21.15.19:0/1361806600 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x557d5e97b860 0x557d5e984e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T22:27:40.369 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:40.360+0000 7fc793fff640 1 --2- 172.21.15.19:0/1361806600 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557d5e97e190 0x557d5e985530 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fc78c0a8580 tx=0x7fc78c00bf60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d5ab5a94731a2b server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:27:40.369 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:40.360+0000 7fc77bfff640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-09-10T22:27:40.369 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:40.360+0000 7fc77bfff640 1 -- 172.21.15.19:0/1361806600 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc78c020070 con 0x557d5e97e190 2024-09-10T22:27:40.369 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:40.360+0000 7fc7a5e7b740 1 -- 172.21.15.19:0/1361806600 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc7980043d0 con 0x557d5e97e190 2024-09-10T22:27:40.369 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:40.360+0000 7fc77bfff640 1 -- 172.21.15.19:0/1361806600 <== mon.2 v2:172.21.15.135:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8327+0+0 (secure 0 0 0) 0x7fc78c010780 con 0x557d5e97e190 2024-09-10T22:27:40.369 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:40.361+0000 7fc77bfff640 1 -- 172.21.15.19:0/1361806600 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7fc78c0ab900 con 0x557d5e97e190 2024-09-10T22:27:40.369 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:40.361+0000 7fc7a5e7b740 10 client.25181 fetch_fsmap learned FSMap version 26 2024-09-10T22:27:40.369 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:40.361+0000 7fc7a5e7b740 1 -- 172.21.15.19:0/1361806600 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x557d5e6b7620 con 0x557d5e97e190 2024-09-10T22:27:40.369 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:40.361+0000 7fc77bfff640 1 -- 172.21.15.19:0/1361806600 <== mon.2 v2:172.21.15.135:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc7980043d0 con 0x557d5e97e190 2024-09-10T22:27:40.369 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:40.361+0000 7fc77bfff640 1 -- 172.21.15.19:0/1361806600 <== mon.2 v2:172.21.15.135:3300/0 5 ==== fsmap(e 26) ==== 8350+0+0 (secure 0 0 0) 0x7fc78c097190 con 0x557d5e97e190 2024-09-10T22:27:40.369 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:40.361+0000 7fc7a5e7b740 10 client.25181 fetch_fsmap finished waiting for FSMap version 26 2024-09-10T22:27:40.369 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:40.361+0000 7fc7a5e7b740 10 client.25181 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-10T22:27:40.370 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:40.361+0000 7fc7a5e7b740 20 client.25181 populate_metadata read hostname 'smithi019' 2024-09-10T22:27:40.370 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:40.361+0000 7fc7a5e7b740 1 --2- 172.21.15.19:0/1361806600 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x557d5e9907f0 0x557d5e992be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:27:40.370 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:40.361+0000 7fc7a5e7b740 4 client.25181 mds_command: new command op to 24581 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T22:27:40.370 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:40.361+0000 7fc7a5e7b740 1 -- 172.21.15.19:0/1361806600 --> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x557d5e8ef640 con 0x557d5e9907f0 2024-09-10T22:27:40.370 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:40.362+0000 7fc7a0d6f640 1 --2- 172.21.15.19:0/1361806600 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x557d5e9907f0 0x557d5e992be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:27:40.370 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:40.362+0000 7fc7a0d6f640 1 --2- 172.21.15.19:0/1361806600 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x557d5e9907f0 0x557d5e992be0 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8063f06ec0ee5aae server_cookie=e6c3b314d9390044 in_seq=0 out_seq=0 2024-09-10T22:27:40.370 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:40.362+0000 7fc77bfff640 10 client.25181 ms_handle_connect on v2:172.21.15.135:6838/1254769802 2024-09-10T22:27:40.370 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:40.363+0000 7fc77bfff640 1 -- 172.21.15.19:0/1361806600 <== mds.0 v2:172.21.15.135:6838/1254769802 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x557d5e8ef640 con 0x557d5e9907f0 2024-09-10T22:27:40.370 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:40.363+0000 7fc77bfff640 10 client.25181 handle_command_reply: tid=0 2024-09-10T22:27:40.370 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:40.363+0000 7fc7a5e7b740 1 client.25181 shutdown 2024-09-10T22:27:40.370 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:40.363+0000 7fc7a5e7b740 1 -- 172.21.15.19:0/1361806600 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557d5e97e190 msgr2=0x557d5e985530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:27:40.370 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:40.363+0000 7fc7a5e7b740 1 --2- 172.21.15.19:0/1361806600 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557d5e97e190 0x557d5e985530 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fc78c0a8580 tx=0x7fc78c00bf60 comp rx=0 tx=0).stop 2024-09-10T22:27:40.371 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:40.363+0000 7fc7a5e7b740 1 -- 172.21.15.19:0/1361806600 shutdown_connections 2024-09-10T22:27:40.371 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:40.363+0000 7fc7a5e7b740 1 --2- 172.21.15.19:0/1361806600 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x557d5e9907f0 0x557d5e992be0 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:27:40.371 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:40.363+0000 7fc77bfff640 0 client.25181 ms_handle_reset on v2:172.21.15.135:6838/1254769802 2024-09-10T22:27:40.371 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:40.363+0000 7fc7a5e7b740 1 --2- 172.21.15.19:0/1361806600 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x557d5e980bd0 0x557d5e986100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:27:40.371 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:40.363+0000 7fc7a5e7b740 1 --2- 172.21.15.19:0/1361806600 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557d5e97e190 0x557d5e985530 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:27:40.371 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:40.363+0000 7fc7a5e7b740 1 --2- 172.21.15.19:0/1361806600 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x557d5e97b860 0x557d5e984e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:27:40.371 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:40.364+0000 7fc7a5e7b740 1 -- 172.21.15.19:0/1361806600 >> 172.21.15.19:0/1361806600 conn(0x557d5e9769b0 msgr2=0x557d5e975bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:27:40.371 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:40.364+0000 7fc7a5e7b740 1 -- 172.21.15.19:0/1361806600 shutdown_connections 2024-09-10T22:27:40.371 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:40.364+0000 7fc7a5e7b740 1 -- 172.21.15.19:0/1361806600 wait complete. 2024-09-10T22:27:40.371 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:40.364+0000 7fc7a5e7b740 20 client.25181 trim_cache size 0 max 16384 2024-09-10T22:27:40.384 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:40.382+0000 7fc7a5e7b740 1 Processor -- start 2024-09-10T22:27:40.385 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:40.382+0000 7fc7a5e7b740 1 -- start start 2024-09-10T22:27:40.385 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:40.382+0000 7fc7a5e7b740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x557d5e97b860 0x557d5e977210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:27:40.385 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:40.382+0000 7fc7a5e7b740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x557d5e97e190 0x557d5e977750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:27:40.385 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:40.382+0000 7fc7a5e7b740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557d5e980bd0 0x557d5e979a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:27:40.385 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:40.382+0000 7fc7a5e7b740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fc79c1aec40 con 0x557d5e97b860 2024-09-10T22:27:40.385 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:40.382+0000 7fc7a5e7b740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fc79c1ac510 con 0x557d5e980bd0 2024-09-10T22:27:40.385 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:40.382+0000 7fc7a5e7b740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7fc79c1aa360 con 0x557d5e97e190 2024-09-10T22:27:40.385 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:40.382+0000 7fc7a0d6f640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x557d5e97b860 0x557d5e977210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:27:40.385 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:40.382+0000 7fc7a1570640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557d5e980bd0 0x557d5e979a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:27:40.385 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:40.382+0000 7fc7a0d6f640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x557d5e97b860 0x557d5e977210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:53392/0 (socket says 172.21.15.19:53392) 2024-09-10T22:27:40.385 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:40.382+0000 7fc7a0d6f640 1 -- 172.21.15.19:0/486814802 learned_addr learned my addr 172.21.15.19:0/486814802 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:27:40.385 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:40.382+0000 7fc793fff640 1 --2- 172.21.15.19:0/486814802 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x557d5e97e190 0x557d5e977750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:27:40.386 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:40.383+0000 7fc7a1570640 1 -- 172.21.15.19:0/486814802 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x557d5e97e190 msgr2=0x557d5e977750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:27:40.386 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:40.383+0000 7fc7a1570640 1 --2- 172.21.15.19:0/486814802 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x557d5e97e190 0x557d5e977750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:27:40.386 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:40.383+0000 7fc7a1570640 1 -- 172.21.15.19:0/486814802 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x557d5e97b860 msgr2=0x557d5e977210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:27:40.386 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:40.383+0000 7fc7a1570640 1 --2- 172.21.15.19:0/486814802 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x557d5e97b860 0x557d5e977210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:27:40.386 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:40.383+0000 7fc7a1570640 1 -- 172.21.15.19:0/486814802 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557d5e984c60 con 0x557d5e980bd0 2024-09-10T22:27:40.386 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:40.383+0000 7fc7a0d6f640 1 --2- 172.21.15.19:0/486814802 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x557d5e97b860 0x557d5e977210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T22:27:40.386 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:40.383+0000 7fc7a1570640 1 --2- 172.21.15.19:0/486814802 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557d5e980bd0 0x557d5e979a00 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fc794006010 tx=0x7fc794041000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d89b9aac3d246a0a server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:27:40.386 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:40.383+0000 7fc7827fc640 1 -- 172.21.15.19:0/486814802 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc794031ae0 con 0x557d5e980bd0 2024-09-10T22:27:40.386 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:40.383+0000 7fc7827fc640 1 -- 172.21.15.19:0/486814802 <== mon.2 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc794036040 con 0x557d5e980bd0 2024-09-10T22:27:40.386 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:40.383+0000 7fc7827fc640 1 -- 172.21.15.19:0/486814802 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc794030e70 con 0x557d5e980bd0 2024-09-10T22:27:40.389 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:40.384+0000 7fc7a5e7b740 1 -- 172.21.15.19:0/486814802 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557d5e980bd0 msgr2=0x557d5e979a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:27:40.389 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:40.384+0000 7fc7a5e7b740 1 --2- 172.21.15.19:0/486814802 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557d5e980bd0 0x557d5e979a00 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fc794006010 tx=0x7fc794041000 comp rx=0 tx=0).stop 2024-09-10T22:27:40.389 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:40.384+0000 7fc7a5e7b740 1 -- 172.21.15.19:0/486814802 shutdown_connections 2024-09-10T22:27:40.389 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:40.384+0000 7fc7a5e7b740 1 --2- 172.21.15.19:0/486814802 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557d5e980bd0 0x557d5e979a00 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:27:40.389 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:40.384+0000 7fc7a5e7b740 1 --2- 172.21.15.19:0/486814802 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x557d5e97e190 0x557d5e977750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:27:40.390 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:40.384+0000 7fc7a5e7b740 1 --2- 172.21.15.19:0/486814802 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x557d5e97b860 0x557d5e977210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:27:40.390 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:40.384+0000 7fc7a5e7b740 1 -- 172.21.15.19:0/486814802 >> 172.21.15.19:0/486814802 conn(0x557d5e9769b0 msgr2=0x557d5e97ad50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:27:40.390 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:40.384+0000 7fc7a5e7b740 1 -- 172.21.15.19:0/486814802 shutdown_connections 2024-09-10T22:27:40.390 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:40.384+0000 7fc7a5e7b740 1 -- 172.21.15.19:0/486814802 wait complete. 2024-09-10T22:27:40.390 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:40.385+0000 7fc7a5e7b740 1 -- start start 2024-09-10T22:27:40.390 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:40.385+0000 7fc7a5e7b740 1 Processor -- start 2024-09-10T22:27:40.390 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:40.385+0000 7fc7a5e7b740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x557d5e97b860 0x557d5e98c980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:27:40.390 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:40.385+0000 7fc7a5e7b740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557d5e97e190 0x557d5e98b680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:27:40.390 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:40.385+0000 7fc7a5e7b740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x557d5e980bd0 0x557d5e98bbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:27:40.390 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:40.385+0000 7fc7a5e7b740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fc79c1aa9d0 con 0x557d5e97b860 2024-09-10T22:27:40.390 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:40.385+0000 7fc7a5e7b740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fc79c1abe40 con 0x557d5e97e190 2024-09-10T22:27:40.390 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:40.385+0000 7fc7a5e7b740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7fc79c1ab0a0 con 0x557d5e980bd0 2024-09-10T22:27:40.390 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:40.385+0000 7fc7a5e7b740 10 client.0 _ll_register_callbacks cb 0x7fc78c00df40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T22:27:40.391 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:40.385+0000 7fc7a1570640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x557d5e980bd0 0x557d5e98bbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:27:40.391 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:40.385+0000 7fc793fff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557d5e97e190 0x557d5e98b680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:27:40.391 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:40.386+0000 7fc7a1570640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x557d5e980bd0 0x557d5e98bbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.19:36174/0 (socket says 172.21.15.19:36174) 2024-09-10T22:27:40.391 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:40.386+0000 7fc793fff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557d5e97e190 0x557d5e98b680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.19:59980/0 (socket says 172.21.15.19:59980) 2024-09-10T22:27:40.391 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:40.386+0000 7fc7a0d6f640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x557d5e97b860 0x557d5e98c980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:27:40.391 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:40.386+0000 7fc7a1570640 1 -- 172.21.15.19:0/1628797808 learned_addr learned my addr 172.21.15.19:0/1628797808 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:27:40.391 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:40.386+0000 7fc793fff640 1 -- 172.21.15.19:0/1628797808 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x557d5e980bd0 msgr2=0x557d5e98bbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:27:40.391 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:40.386+0000 7fc793fff640 1 --2- 172.21.15.19:0/1628797808 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x557d5e980bd0 0x557d5e98bbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:27:40.391 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:40.386+0000 7fc793fff640 1 -- 172.21.15.19:0/1628797808 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x557d5e97b860 msgr2=0x557d5e98c980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:27:40.391 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:40.386+0000 7fc793fff640 1 --2- 172.21.15.19:0/1628797808 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x557d5e97b860 0x557d5e98c980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:27:40.391 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:40.386+0000 7fc793fff640 1 -- 172.21.15.19:0/1628797808 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557d5e98c3f0 con 0x557d5e97e190 2024-09-10T22:27:40.391 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:40.386+0000 7fc793fff640 1 --2- 172.21.15.19:0/1628797808 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557d5e97e190 0x557d5e98b680 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fc78c0e5c20 tx=0x7fc78c010c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ec53b2dd24bc8f6e server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:27:40.391 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:40.386+0000 7fc77bfff640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-09-10T22:27:40.392 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:40.386+0000 7fc77bfff640 1 -- 172.21.15.19:0/1628797808 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc78c020040 con 0x557d5e97e190 2024-09-10T22:27:40.392 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:40.386+0000 7fc77bfff640 1 -- 172.21.15.19:0/1628797808 <== mon.2 v2:172.21.15.135:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8327+0+0 (secure 0 0 0) 0x7fc78c0aaee0 con 0x557d5e97e190 2024-09-10T22:27:40.392 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:40.386+0000 7fc7a5e7b740 1 -- 172.21.15.19:0/1628797808 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc794036040 con 0x557d5e97e190 2024-09-10T22:27:40.392 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:40.386+0000 7fc77bfff640 1 -- 172.21.15.19:0/1628797808 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7fc78c0ab720 con 0x557d5e97e190 2024-09-10T22:27:40.392 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:40.387+0000 7fc7a5e7b740 10 client.25187 fetch_fsmap learned FSMap version 26 2024-09-10T22:27:40.392 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:40.387+0000 7fc7a5e7b740 1 -- 172.21.15.19:0/1628797808 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x557d5e9fd770 con 0x557d5e97e190 2024-09-10T22:27:40.392 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:40.387+0000 7fc77bfff640 1 -- 172.21.15.19:0/1628797808 <== mon.2 v2:172.21.15.135:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc794036040 con 0x557d5e97e190 2024-09-10T22:27:40.392 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:40.387+0000 7fc77bfff640 1 -- 172.21.15.19:0/1628797808 <== mon.2 v2:172.21.15.135:3300/0 5 ==== fsmap(e 26) ==== 8350+0+0 (secure 0 0 0) 0x7fc78c0930b0 con 0x557d5e97e190 2024-09-10T22:27:40.392 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:40.387+0000 7fc7a5e7b740 10 client.25187 fetch_fsmap finished waiting for FSMap version 26 2024-09-10T22:27:40.392 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:40.387+0000 7fc7a5e7b740 10 client.25187 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-10T22:27:40.392 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:40.387+0000 7fc7a5e7b740 20 client.25187 populate_metadata read hostname 'smithi019' 2024-09-10T22:27:40.392 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:40.387+0000 7fc7a5e7b740 1 --2- 172.21.15.19:0/1628797808 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x557d5e9907f0 0x557d5ea00190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:27:40.392 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:40.387+0000 7fc7a5e7b740 4 client.25187 mds_command: new command op to 24581 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-10T22:27:40.393 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:40.387+0000 7fc7a5e7b740 1 -- 172.21.15.19:0/1628797808 --> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] -- command(tid 0: {"prefix": "flush journal"}) -- 0x557d5e8eb0f0 con 0x557d5e9907f0 2024-09-10T22:27:40.393 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:40.387+0000 7fc7a0d6f640 1 --2- 172.21.15.19:0/1628797808 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x557d5e9907f0 0x557d5ea00190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:27:40.393 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:40.388+0000 7fc7a0d6f640 1 --2- 172.21.15.19:0/1628797808 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x557d5e9907f0 0x557d5ea00190 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ff235ff0da55e682 server_cookie=e2c32c6b6c29111 in_seq=0 out_seq=0 2024-09-10T22:27:40.393 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:40.388+0000 7fc77bfff640 10 client.25187 ms_handle_connect on v2:172.21.15.135:6838/1254769802 2024-09-10T22:27:40.904 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:40.894+0000 7fd9a272c640 1 -- 172.21.15.19:0/1490370486 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd99c101cc0 msgr2=0x7fd99c1020a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:27:40.904 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:40.894+0000 7fd9a272c640 1 --2- 172.21.15.19:0/1490370486 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd99c101cc0 0x7fd99c1020a0 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7fd98c009900 tx=0x7fd98c02a410 comp rx=0 tx=0).stop 2024-09-10T22:27:40.904 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:40.895+0000 7fd9a272c640 1 -- 172.21.15.19:0/1490370486 shutdown_connections 2024-09-10T22:27:40.904 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:40.895+0000 7fd9a272c640 1 --2- 172.21.15.19:0/1490370486 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd99c108050 0x7fd99c10e850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:27:40.904 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:40.895+0000 7fd9a272c640 1 --2- 172.21.15.19:0/1490370486 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd99c1076d0 0x7fd99c107b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:27:40.904 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:40.895+0000 7fd9a272c640 1 --2- 172.21.15.19:0/1490370486 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd99c101cc0 0x7fd99c1020a0 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:27:40.904 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:40.895+0000 7fd9a272c640 1 -- 172.21.15.19:0/1490370486 >> 172.21.15.19:0/1490370486 conn(0x7fd99c0fd770 msgr2=0x7fd99c0ffb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:27:40.904 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:40.895+0000 7fd9a272c640 1 -- 172.21.15.19:0/1490370486 shutdown_connections 2024-09-10T22:27:40.904 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:40.895+0000 7fd9a272c640 1 -- 172.21.15.19:0/1490370486 wait complete. 2024-09-10T22:27:40.905 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:40.896+0000 7fd9a272c640 1 Processor -- start 2024-09-10T22:27:40.905 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:40.896+0000 7fd9a272c640 1 -- start start 2024-09-10T22:27:40.905 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:40.897+0000 7fd9a272c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd99c101cc0 0x7fd99c1981f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:27:40.905 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:40.897+0000 7fd9a272c640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd99c1076d0 0x7fd99c198730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:27:40.905 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:40.897+0000 7fd9a272c640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd99c108050 0x7fd99c19dad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:27:40.905 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:40.897+0000 7fd9a272c640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fd99c111d60 con 0x7fd99c101cc0 2024-09-10T22:27:40.905 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:40.897+0000 7fd9a272c640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fd99c111be0 con 0x7fd99c108050 2024-09-10T22:27:40.905 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:40.897+0000 7fd9a272c640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7fd99c111ee0 con 0x7fd99c1076d0 2024-09-10T22:27:40.905 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:40.897+0000 7fd99b7fe640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd99c1076d0 0x7fd99c198730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:27:40.905 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:40.897+0000 7fd99bfff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd99c101cc0 0x7fd99c1981f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:27:40.905 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:40.897+0000 7fd99b7fe640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd99c1076d0 0x7fd99c198730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.19:36192/0 (socket says 172.21.15.19:36192) 2024-09-10T22:27:40.905 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:40.897+0000 7fd99b7fe640 1 -- 172.21.15.19:0/3715933393 learned_addr learned my addr 172.21.15.19:0/3715933393 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:27:40.906 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:40.897+0000 7fd9a0cc9640 1 --2- 172.21.15.19:0/3715933393 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd99c108050 0x7fd99c19dad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:27:40.906 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:40.897+0000 7fd99bfff640 1 -- 172.21.15.19:0/3715933393 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd99c1076d0 msgr2=0x7fd99c198730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:27:40.906 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:40.897+0000 7fd99bfff640 1 --2- 172.21.15.19:0/3715933393 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd99c1076d0 0x7fd99c198730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:27:40.906 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:40.897+0000 7fd99bfff640 1 -- 172.21.15.19:0/3715933393 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd99c108050 msgr2=0x7fd99c19dad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:27:40.906 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:40.897+0000 7fd99bfff640 1 --2- 172.21.15.19:0/3715933393 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd99c108050 0x7fd99c19dad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:27:40.906 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:40.897+0000 7fd99bfff640 1 -- 172.21.15.19:0/3715933393 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd99c19e2a0 con 0x7fd99c101cc0 2024-09-10T22:27:40.906 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:40.897+0000 7fd99b7fe640 1 --2- 172.21.15.19:0/3715933393 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd99c1076d0 0x7fd99c198730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T22:27:40.906 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:40.898+0000 7fd99bfff640 1 --2- 172.21.15.19:0/3715933393 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd99c101cc0 0x7fd99c1981f0 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7fd98c02aa00 tx=0x7fd98c003b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:27:40.906 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:40.898+0000 7fd9997fa640 1 -- 172.21.15.19:0/3715933393 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd98c03f070 con 0x7fd99c101cc0 2024-09-10T22:27:40.906 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:40.898+0000 7fd9a272c640 1 -- 172.21.15.19:0/3715933393 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd99c19e530 con 0x7fd99c101cc0 2024-09-10T22:27:40.906 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:40.898+0000 7fd9997fa640 1 -- 172.21.15.19:0/3715933393 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd98c031b50 con 0x7fd99c101cc0 2024-09-10T22:27:40.906 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:40.898+0000 7fd9997fa640 1 -- 172.21.15.19:0/3715933393 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd98c035030 con 0x7fd99c101cc0 2024-09-10T22:27:40.906 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:40.898+0000 7fd9a272c640 1 -- 172.21.15.19:0/3715933393 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd99c06b2d0 con 0x7fd99c101cc0 2024-09-10T22:27:40.906 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:40.901+0000 7fd9a4b01740 1 Processor -- start 2024-09-10T22:27:40.907 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:40.901+0000 7fd9a4b01740 1 -- start start 2024-09-10T22:27:40.907 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:40.902+0000 7fd9a4b01740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x558b990e10f0 0x558b990e14d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:27:40.907 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:40.902+0000 7fd9a4b01740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x558b990e1a10 0x558b990ed460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:27:40.907 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:40.902+0000 7fd9a4b01740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558b990ed9a0 0x558b990efd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:27:40.907 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:40.902+0000 7fd9a4b01740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x558b99057ea0 con 0x558b990e10f0 2024-09-10T22:27:40.907 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:40.902+0000 7fd9a4b01740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x558b990472d0 con 0x558b990ed9a0 2024-09-10T22:27:40.907 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:40.902+0000 7fd9a4b01740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x558b9904b0e0 con 0x558b990e1a10 2024-09-10T22:27:40.907 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:40.902+0000 7fd9997fa640 1 -- 172.21.15.19:0/3715933393 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 18) ==== 153250+0+0 (secure 0 0 0) 0x7fd98c0316a0 con 0x7fd99c101cc0 2024-09-10T22:27:40.907 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:40.902+0000 7fd99b7fe640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558b990ed9a0 0x558b990efd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:27:40.907 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:40.902+0000 7fd99b7fe640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558b990ed9a0 0x558b990efd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.19:60010/0 (socket says 172.21.15.19:60010) 2024-09-10T22:27:40.907 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:40.902+0000 7fd9a0cc9640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x558b990e10f0 0x558b990e14d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:27:40.907 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:40.902+0000 7fd99b7fe640 1 -- 172.21.15.19:0/4216863454 learned_addr learned my addr 172.21.15.19:0/4216863454 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:27:40.908 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:40.902+0000 7fd99bfff640 1 --2- 172.21.15.19:0/4216863454 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x558b990e1a10 0x558b990ed460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:27:40.908 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:40.902+0000 7fd99b7fe640 1 -- 172.21.15.19:0/4216863454 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x558b990e1a10 msgr2=0x558b990ed460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:27:40.908 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:40.902+0000 7fd99b7fe640 1 --2- 172.21.15.19:0/4216863454 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x558b990e1a10 0x558b990ed460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:27:40.908 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:40.902+0000 7fd99b7fe640 1 -- 172.21.15.19:0/4216863454 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x558b990e10f0 msgr2=0x558b990e14d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:27:40.908 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:40.902+0000 7fd99b7fe640 1 --2- 172.21.15.19:0/4216863454 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x558b990e10f0 0x558b990e14d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:27:40.908 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:40.902+0000 7fd99b7fe640 1 -- 172.21.15.19:0/4216863454 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558b98da5650 con 0x558b990ed9a0 2024-09-10T22:27:40.912 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:40.903+0000 7fd99b7fe640 1 --2- 172.21.15.19:0/4216863454 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558b990ed9a0 0x558b990efd90 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fd990009c70 tx=0x7fd990005f90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4b4c3e30c7de1f5a server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:27:40.913 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:40.903+0000 7fd9827fc640 1 -- 172.21.15.19:0/4216863454 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd99000be50 con 0x558b990ed9a0 2024-09-10T22:27:40.913 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:40.903+0000 7fd9827fc640 1 -- 172.21.15.19:0/4216863454 <== mon.2 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd9900035f0 con 0x558b990ed9a0 2024-09-10T22:27:40.913 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:40.903+0000 7fd9827fc640 1 -- 172.21.15.19:0/4216863454 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd99001e660 con 0x558b990ed9a0 2024-09-10T22:27:40.913 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:40.903+0000 7fd9997fa640 1 --2- 172.21.15.19:0/3715933393 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7fd9840b52e0 0x7fd9840b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:27:40.913 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:40.904+0000 7fd9a0cc9640 1 --2- 172.21.15.19:0/3715933393 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7fd9840b52e0 0x7fd9840b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:27:40.913 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:40.904+0000 7fd9997fa640 1 -- 172.21.15.19:0/3715933393 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8327+0+0 (secure 0 0 0) 0x7fd98c106560 con 0x7fd99c101cc0 2024-09-10T22:27:40.913 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:40.904+0000 7fd9a4b01740 1 -- 172.21.15.19:0/4216863454 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558b990ed9a0 msgr2=0x558b990efd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:27:40.913 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:40.904+0000 7fd9a4b01740 1 --2- 172.21.15.19:0/4216863454 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558b990ed9a0 0x558b990efd90 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fd990009c70 tx=0x7fd990005f90 comp rx=0 tx=0).stop 2024-09-10T22:27:40.913 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:40.904+0000 7fd9a4b01740 1 -- 172.21.15.19:0/4216863454 shutdown_connections 2024-09-10T22:27:40.913 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:40.904+0000 7fd9a4b01740 1 --2- 172.21.15.19:0/4216863454 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558b990ed9a0 0x558b990efd90 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:27:40.914 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:40.904+0000 7fd9a4b01740 1 --2- 172.21.15.19:0/4216863454 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x558b990e1a10 0x558b990ed460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:27:40.914 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:40.904+0000 7fd9a4b01740 1 --2- 172.21.15.19:0/4216863454 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x558b990e10f0 0x558b990e14d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:27:40.914 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:40.904+0000 7fd9a4b01740 1 -- 172.21.15.19:0/4216863454 >> 172.21.15.19:0/4216863454 conn(0x558b990def20 msgr2=0x558b990e00c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:27:40.914 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:40.904+0000 7fd9a0cc9640 1 --2- 172.21.15.19:0/3715933393 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7fd9840b52e0 0x7fd9840b77a0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fd994007f00 tx=0x7fd994007520 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:27:40.914 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:40.904+0000 7fd9a4b01740 1 -- 172.21.15.19:0/4216863454 shutdown_connections 2024-09-10T22:27:40.914 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:40.904+0000 7fd9a4b01740 1 -- 172.21.15.19:0/4216863454 wait complete. 2024-09-10T22:27:40.914 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:40.905+0000 7fd9a4b01740 1 -- start start 2024-09-10T22:27:40.914 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:40.905+0000 7fd9a4b01740 1 Processor -- start 2024-09-10T22:27:40.914 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:40.905+0000 7fd9a4b01740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x558b990e10f0 0x558b990ed200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:27:40.914 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:40.905+0000 7fd9a4b01740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558b990e1a10 0x558b990ea650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:27:40.914 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:40.906+0000 7fd9a4b01740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x558b990ed9a0 0x558b990eabd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:27:40.914 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:40.906+0000 7fd99b7fe640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558b990e1a10 0x558b990ea650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:27:40.914 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:40.906+0000 7fd99b7fe640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558b990e1a10 0x558b990ea650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.19:60020/0 (socket says 172.21.15.19:60020) 2024-09-10T22:27:40.915 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:40.906+0000 7fd99b7fe640 1 -- 172.21.15.19:0/1074755726 learned_addr learned my addr 172.21.15.19:0/1074755726 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:27:40.915 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:40.906+0000 7fd9a4b01740 1 -- 172.21.15.19:0/1074755726 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x558b98ea8700 con 0x558b990e10f0 2024-09-10T22:27:40.915 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:40.906+0000 7fd9a4b01740 1 -- 172.21.15.19:0/1074755726 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x558b98fe2160 con 0x558b990e1a10 2024-09-10T22:27:40.915 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:40.906+0000 7fd9a4b01740 1 -- 172.21.15.19:0/1074755726 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x558b990f0620 con 0x558b990ed9a0 2024-09-10T22:27:40.915 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:40.906+0000 7fd9a0cc9640 1 --2- 172.21.15.19:0/1074755726 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x558b990ed9a0 0x558b990eabd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:27:40.915 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:40.906+0000 7fd9a4b01740 10 client.0 _ll_register_callbacks cb 0x558b98ffb9e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T22:27:40.915 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:40.907+0000 7fd99b7fe640 1 -- 172.21.15.19:0/1074755726 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x558b990ed9a0 msgr2=0x558b990eabd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:27:40.915 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:40.907+0000 7fd99b7fe640 1 --2- 172.21.15.19:0/1074755726 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x558b990ed9a0 0x558b990eabd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:27:40.915 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:40.907+0000 7fd99b7fe640 1 -- 172.21.15.19:0/1074755726 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x558b990e10f0 msgr2=0x558b990ed200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:27:40.915 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:40.907+0000 7fd99b7fe640 1 --2- 172.21.15.19:0/1074755726 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x558b990e10f0 0x558b990ed200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:27:40.915 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:40.907+0000 7fd99b7fe640 1 -- 172.21.15.19:0/1074755726 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558b9900fc90 con 0x558b990e1a10 2024-09-10T22:27:40.915 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:40.907+0000 7fd99b7fe640 1 --2- 172.21.15.19:0/1074755726 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558b990e1a10 0x558b990ea650 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fd990003f30 tx=0x7fd9900041c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ef22dd33f7495476 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:27:40.915 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:40.907+0000 7fd97b7fe640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-09-10T22:27:40.916 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:40.908+0000 7fd97b7fe640 1 -- 172.21.15.19:0/1074755726 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd990005c50 con 0x558b990e1a10 2024-09-10T22:27:40.916 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:40.908+0000 7fd9a4b01740 1 -- 172.21.15.19:0/1074755726 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd9900035f0 con 0x558b990e1a10 2024-09-10T22:27:40.916 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:40.908+0000 7fd97b7fe640 1 -- 172.21.15.19:0/1074755726 <== mon.2 v2:172.21.15.135:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8327+0+0 (secure 0 0 0) 0x7fd9900043b0 con 0x558b990e1a10 2024-09-10T22:27:40.916 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:40.908+0000 7fd97b7fe640 1 -- 172.21.15.19:0/1074755726 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7fd99000be50 con 0x558b990e1a10 2024-09-10T22:27:40.916 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:40.908+0000 7fd9a4b01740 10 client.25199 fetch_fsmap learned FSMap version 26 2024-09-10T22:27:40.916 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:40.908+0000 7fd9a4b01740 1 -- 172.21.15.19:0/1074755726 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x558b990fbf30 con 0x558b990e1a10 2024-09-10T22:27:40.916 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:40.909+0000 7fd97b7fe640 1 -- 172.21.15.19:0/1074755726 <== mon.2 v2:172.21.15.135:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd9900035f0 con 0x558b990e1a10 2024-09-10T22:27:40.916 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:40.909+0000 7fd97b7fe640 1 -- 172.21.15.19:0/1074755726 <== mon.2 v2:172.21.15.135:3300/0 5 ==== fsmap(e 26) ==== 8350+0+0 (secure 0 0 0) 0x7fd99003a020 con 0x558b990e1a10 2024-09-10T22:27:40.916 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:40.910+0000 7fd9a4b01740 10 client.25199 fetch_fsmap finished waiting for FSMap version 26 2024-09-10T22:27:40.916 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:40.910+0000 7fd9a4b01740 10 client.25199 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-10T22:27:40.916 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:40.910+0000 7fd9a4b01740 20 client.25199 populate_metadata read hostname 'smithi019' 2024-09-10T22:27:40.916 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:40.910+0000 7fd9a4b01740 1 --2- 172.21.15.19:0/1074755726 >> [v2:172.21.15.138:6836/3353290042,v1:172.21.15.138:6837/3353290042] conn(0x558b990fd2e0 0x558b990ff6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:27:40.916 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:40.910+0000 7fd9a4b01740 4 client.25199 mds_command: new command op to 24553 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T22:27:40.917 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:40.910+0000 7fd9a4b01740 1 -- 172.21.15.19:0/1074755726 --> [v2:172.21.15.138:6836/3353290042,v1:172.21.15.138:6837/3353290042] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x558b99059df0 con 0x558b990fd2e0 2024-09-10T22:27:40.917 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:40.910+0000 7fd99bfff640 1 --2- 172.21.15.19:0/1074755726 >> [v2:172.21.15.138:6836/3353290042,v1:172.21.15.138:6837/3353290042] conn(0x558b990fd2e0 0x558b990ff6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:27:40.917 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:40.911+0000 7fd99bfff640 1 --2- 172.21.15.19:0/1074755726 >> [v2:172.21.15.138:6836/3353290042,v1:172.21.15.138:6837/3353290042] conn(0x558b990fd2e0 0x558b990ff6d0 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=d4fc61dfb70d55b6 server_cookie=52b085393b344a8a in_seq=0 out_seq=0 2024-09-10T22:27:40.917 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:40.911+0000 7fd97b7fe640 10 client.25199 ms_handle_connect on v2:172.21.15.138:6836/3353290042 2024-09-10T22:27:40.919 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:40.912+0000 7fd97b7fe640 1 -- 172.21.15.19:0/1074755726 <== mds.2 v2:172.21.15.138:6836/3353290042 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x558b99059df0 con 0x558b990fd2e0 2024-09-10T22:27:40.919 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:40.912+0000 7fd97b7fe640 10 client.25199 handle_command_reply: tid=0 2024-09-10T22:27:40.919 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:40.912+0000 7fd9a4b01740 1 client.25199 shutdown 2024-09-10T22:27:40.919 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:40.912+0000 7fd9a4b01740 1 -- 172.21.15.19:0/1074755726 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558b990e1a10 msgr2=0x558b990ea650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:27:40.919 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:40.912+0000 7fd9a4b01740 1 --2- 172.21.15.19:0/1074755726 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558b990e1a10 0x558b990ea650 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fd990003f30 tx=0x7fd9900041c0 comp rx=0 tx=0).stop 2024-09-10T22:27:40.919 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:40.912+0000 7fd9a4b01740 1 -- 172.21.15.19:0/1074755726 shutdown_connections 2024-09-10T22:27:40.919 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:40.912+0000 7fd9a4b01740 1 --2- 172.21.15.19:0/1074755726 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x558b990ed9a0 0x558b990eabd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:27:40.919 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:40.912+0000 7fd9a4b01740 1 --2- 172.21.15.19:0/1074755726 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558b990e1a10 0x558b990ea650 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:27:40.919 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:40.912+0000 7fd9a4b01740 1 --2- 172.21.15.19:0/1074755726 >> [v2:172.21.15.138:6836/3353290042,v1:172.21.15.138:6837/3353290042] conn(0x558b990fd2e0 0x558b990ff6d0 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:27:40.919 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:40.912+0000 7fd9a4b01740 1 --2- 172.21.15.19:0/1074755726 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x558b990e10f0 0x558b990ed200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:27:40.919 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:40.912+0000 7fd97b7fe640 0 client.25199 ms_handle_reset on v2:172.21.15.138:6836/3353290042 2024-09-10T22:27:40.920 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:40.912+0000 7fd9a4b01740 1 -- 172.21.15.19:0/1074755726 >> 172.21.15.19:0/1074755726 conn(0x558b990def20 msgr2=0x558b990e4a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:27:40.920 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:40.913+0000 7fd9a4b01740 1 -- 172.21.15.19:0/1074755726 shutdown_connections 2024-09-10T22:27:40.920 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:40.913+0000 7fd9a4b01740 1 -- 172.21.15.19:0/1074755726 wait complete. 2024-09-10T22:27:40.920 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:40.913+0000 7fd9a4b01740 20 client.25199 trim_cache size 0 max 16384 2024-09-10T22:27:40.930 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:40.928+0000 7fd9a4b01740 1 Processor -- start 2024-09-10T22:27:40.930 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:40.928+0000 7fd9a4b01740 1 -- start start 2024-09-10T22:27:40.930 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:40.929+0000 7fd9a4b01740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558b990def20 0x558b990f98b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:27:40.931 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:40.929+0000 7fd9a4b01740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x558b990e10f0 0x558b990ff2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:27:40.931 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:40.929+0000 7fd9a4b01740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x558b990e1a10 0x558b990e78a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:27:40.931 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:40.929+0000 7fd9a4b01740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fd99c1aec10 con 0x558b990e1a10 2024-09-10T22:27:40.932 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:40.929+0000 7fd9a4b01740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fd99c1ac4e0 con 0x558b990def20 2024-09-10T22:27:40.932 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:40.929+0000 7fd9a4b01740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7fd99c1aa330 con 0x558b990e10f0 2024-09-10T22:27:40.932 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:40.929+0000 7fd99bfff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558b990def20 0x558b990f98b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:27:40.932 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:40.929+0000 7fd99b7fe640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x558b990e10f0 0x558b990ff2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:27:40.932 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:40.929+0000 7fd99bfff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558b990def20 0x558b990f98b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.19:60030/0 (socket says 172.21.15.19:60030) 2024-09-10T22:27:40.932 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:40.929+0000 7fd99bfff640 1 -- 172.21.15.19:0/654036831 learned_addr learned my addr 172.21.15.19:0/654036831 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:27:40.932 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:40.930+0000 7fd99b7fe640 1 -- 172.21.15.19:0/654036831 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558b990def20 msgr2=0x558b990f98b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:27:40.932 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:40.930+0000 7fd99b7fe640 1 --2- 172.21.15.19:0/654036831 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558b990def20 0x558b990f98b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:27:40.932 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:40.930+0000 7fd99b7fe640 1 -- 172.21.15.19:0/654036831 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x558b990e1a10 msgr2=0x558b990e78a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:27:40.932 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:40.930+0000 7fd99b7fe640 1 --2- 172.21.15.19:0/654036831 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x558b990e1a10 0x558b990e78a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:27:40.932 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:40.930+0000 7fd99b7fe640 1 -- 172.21.15.19:0/654036831 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558b990eaf40 con 0x558b990e10f0 2024-09-10T22:27:40.932 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:40.930+0000 7fd99bfff640 1 --2- 172.21.15.19:0/654036831 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558b990def20 0x558b990f98b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T22:27:40.932 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:40.930+0000 7fd99b7fe640 1 --2- 172.21.15.19:0/654036831 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x558b990e10f0 0x558b990ff2f0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fd99000c010 tx=0x7fd9900059b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5625583902f20a70 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:27:40.933 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:40.930+0000 7fd981ffb640 1 -- 172.21.15.19:0/654036831 <== mon.1 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd990041070 con 0x558b990e10f0 2024-09-10T22:27:40.933 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:40.930+0000 7fd981ffb640 1 -- 172.21.15.19:0/654036831 <== mon.1 v2:172.21.15.138:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd9900035f0 con 0x558b990e10f0 2024-09-10T22:27:40.933 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:40.930+0000 7fd981ffb640 1 -- 172.21.15.19:0/654036831 <== mon.1 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd990003ab0 con 0x558b990e10f0 2024-09-10T22:27:40.934 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:40.931+0000 7fd9a4b01740 1 -- 172.21.15.19:0/654036831 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x558b990e10f0 msgr2=0x558b990ff2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:27:40.934 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:40.931+0000 7fd9a4b01740 1 --2- 172.21.15.19:0/654036831 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x558b990e10f0 0x558b990ff2f0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fd99000c010 tx=0x7fd9900059b0 comp rx=0 tx=0).stop 2024-09-10T22:27:40.934 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:40.931+0000 7fd9a4b01740 1 -- 172.21.15.19:0/654036831 shutdown_connections 2024-09-10T22:27:40.934 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:40.931+0000 7fd9a4b01740 1 --2- 172.21.15.19:0/654036831 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x558b990e1a10 0x558b990e78a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:27:40.934 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:40.931+0000 7fd9a4b01740 1 --2- 172.21.15.19:0/654036831 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x558b990e10f0 0x558b990ff2f0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:27:40.934 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:40.931+0000 7fd9a4b01740 1 --2- 172.21.15.19:0/654036831 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558b990def20 0x558b990f98b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:27:40.934 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:40.931+0000 7fd9a4b01740 1 -- 172.21.15.19:0/654036831 >> 172.21.15.19:0/654036831 conn(0x558b990ff9d0 msgr2=0x558b990e8ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:27:40.935 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:40.931+0000 7fd9a4b01740 1 -- 172.21.15.19:0/654036831 shutdown_connections 2024-09-10T22:27:40.935 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:40.931+0000 7fd9a4b01740 1 -- 172.21.15.19:0/654036831 wait complete. 2024-09-10T22:27:40.935 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:40.932+0000 7fd9a4b01740 1 -- start start 2024-09-10T22:27:40.935 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:40.932+0000 7fd9a4b01740 1 Processor -- start 2024-09-10T22:27:40.935 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:40.933+0000 7fd9a4b01740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x558b990def20 0x558b990f58d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:27:40.935 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:40.933+0000 7fd9a4b01740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558b990e10f0 0x558b990f5e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:27:40.935 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:40.933+0000 7fd9a4b01740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x558b990e1a10 0x558b990f3570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:27:40.935 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:40.933+0000 7fd9a4b01740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fd99c1aa9a0 con 0x558b990e1a10 2024-09-10T22:27:40.935 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:40.933+0000 7fd9a4b01740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fd99c1abe10 con 0x558b990e10f0 2024-09-10T22:27:40.935 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:40.933+0000 7fd9a4b01740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7fd99c1ab070 con 0x558b990def20 2024-09-10T22:27:40.935 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:40.933+0000 7fd9a4b01740 10 client.0 _ll_register_callbacks cb 0x7fd994007860 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T22:27:40.937 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:40.933+0000 7fd99bfff640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x558b990def20 0x558b990f58d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:27:40.937 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:40.933+0000 7fd99bfff640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x558b990def20 0x558b990f58d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.19:36228/0 (socket says 172.21.15.19:36228) 2024-09-10T22:27:40.937 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:40.933+0000 7fd99b7fe640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558b990e10f0 0x558b990f5e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:27:40.937 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:40.933+0000 7fd99bfff640 1 -- 172.21.15.19:0/4040579745 learned_addr learned my addr 172.21.15.19:0/4040579745 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:27:40.937 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:40.933+0000 7fd99bfff640 1 -- 172.21.15.19:0/4040579745 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558b990e10f0 msgr2=0x558b990f5e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:27:40.937 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:40.933+0000 7fd99bfff640 1 --2- 172.21.15.19:0/4040579745 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558b990e10f0 0x558b990f5e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:27:40.937 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:40.933+0000 7fd99bfff640 1 -- 172.21.15.19:0/4040579745 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x558b990e1a10 msgr2=0x558b990f3570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:27:40.937 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:40.933+0000 7fd99bfff640 1 --2- 172.21.15.19:0/4040579745 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x558b990e1a10 0x558b990f3570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:27:40.937 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:40.933+0000 7fd99bfff640 1 -- 172.21.15.19:0/4040579745 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558b990f3c60 con 0x558b990def20 2024-09-10T22:27:40.937 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:40.933+0000 7fd99b7fe640 1 --2- 172.21.15.19:0/4040579745 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558b990e10f0 0x558b990f5e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T22:27:40.937 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:40.934+0000 7fd99bfff640 1 --2- 172.21.15.19:0/4040579745 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x558b990def20 0x558b990f58d0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fd98c000c00 tx=0x7fd98c03b720 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3f13e17a6821a0e9 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:27:40.937 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:40.934+0000 7fd97b7fe640 10 client.0 ms_handle_connect on v2:172.21.15.138:3300/0 2024-09-10T22:27:40.938 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:40.934+0000 7fd97b7fe640 1 -- 172.21.15.19:0/4040579745 <== mon.1 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd98c049040 con 0x558b990def20 2024-09-10T22:27:40.938 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:40.934+0000 7fd97b7fe640 1 -- 172.21.15.19:0/4040579745 <== mon.1 v2:172.21.15.138:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8327+0+0 (secure 0 0 0) 0x7fd98c0b40e0 con 0x558b990def20 2024-09-10T22:27:40.938 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:40.934+0000 7fd9a4b01740 1 -- 172.21.15.19:0/4040579745 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd9900035f0 con 0x558b990def20 2024-09-10T22:27:40.938 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:40.934+0000 7fd97b7fe640 1 -- 172.21.15.19:0/4040579745 <== mon.1 v2:172.21.15.138:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7fd98c0cc660 con 0x558b990def20 2024-09-10T22:27:40.938 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:40.934+0000 7fd9a4b01740 10 client.25162 fetch_fsmap learned FSMap version 26 2024-09-10T22:27:40.938 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:40.934+0000 7fd9a4b01740 1 -- 172.21.15.19:0/4040579745 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x558b9916aaa0 con 0x558b990def20 2024-09-10T22:27:40.938 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:40.934+0000 7fd97b7fe640 1 -- 172.21.15.19:0/4040579745 <== mon.1 v2:172.21.15.138:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd9900035f0 con 0x558b990def20 2024-09-10T22:27:40.938 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:40.935+0000 7fd97b7fe640 1 -- 172.21.15.19:0/4040579745 <== mon.1 v2:172.21.15.138:3300/0 5 ==== fsmap(e 26) ==== 8350+0+0 (secure 0 0 0) 0x7fd98c0c8f80 con 0x558b990def20 2024-09-10T22:27:40.938 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:40.935+0000 7fd9a4b01740 10 client.25162 fetch_fsmap finished waiting for FSMap version 26 2024-09-10T22:27:40.938 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:40.935+0000 7fd9a4b01740 10 client.25162 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-10T22:27:40.938 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:40.935+0000 7fd9a4b01740 20 client.25162 populate_metadata read hostname 'smithi019' 2024-09-10T22:27:40.938 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:40.935+0000 7fd9a4b01740 1 --2- 172.21.15.19:0/4040579745 >> [v2:172.21.15.138:6836/3353290042,v1:172.21.15.138:6837/3353290042] conn(0x558b990ed9a0 0x558b9916d200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:27:40.938 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:40.935+0000 7fd9a4b01740 4 client.25162 mds_command: new command op to 24553 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-10T22:27:40.939 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:40.935+0000 7fd9a4b01740 1 -- 172.21.15.19:0/4040579745 --> [v2:172.21.15.138:6836/3353290042,v1:172.21.15.138:6837/3353290042] -- command(tid 0: {"prefix": "damage ls"}) -- 0x558b990558a0 con 0x558b990ed9a0 2024-09-10T22:27:40.939 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:40.935+0000 7fd99b7fe640 1 --2- 172.21.15.19:0/4040579745 >> [v2:172.21.15.138:6836/3353290042,v1:172.21.15.138:6837/3353290042] conn(0x558b990ed9a0 0x558b9916d200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:27:40.939 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:40.936+0000 7fd99b7fe640 1 --2- 172.21.15.19:0/4040579745 >> [v2:172.21.15.138:6836/3353290042,v1:172.21.15.138:6837/3353290042] conn(0x558b990ed9a0 0x558b9916d200 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=f28df45bc1178188 server_cookie=e7529597206f4210 in_seq=0 out_seq=0 2024-09-10T22:27:40.940 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:40.936+0000 7fd97b7fe640 10 client.25162 ms_handle_connect on v2:172.21.15.138:6836/3353290042 2024-09-10T22:27:40.940 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:40.936+0000 7fd97b7fe640 1 -- 172.21.15.19:0/4040579745 <== mds.2 v2:172.21.15.138:6836/3353290042 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x558b990558a0 con 0x558b990ed9a0 2024-09-10T22:27:40.940 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:40.936+0000 7fd97b7fe640 10 client.25162 handle_command_reply: tid=0 2024-09-10T22:27:40.940 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:40.936+0000 7fd9a4b01740 1 client.25162 shutdown 2024-09-10T22:27:40.940 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:40.936+0000 7fd9a4b01740 1 -- 172.21.15.19:0/4040579745 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x558b990def20 msgr2=0x558b990f58d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:27:40.940 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:40.937+0000 7fd9a4b01740 1 --2- 172.21.15.19:0/4040579745 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x558b990def20 0x558b990f58d0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fd98c000c00 tx=0x7fd98c03b720 comp rx=0 tx=0).stop 2024-09-10T22:27:40.940 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:40.937+0000 7fd9a4b01740 1 -- 172.21.15.19:0/4040579745 shutdown_connections 2024-09-10T22:27:40.940 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:40.937+0000 7fd9a4b01740 1 --2- 172.21.15.19:0/4040579745 >> [v2:172.21.15.138:6836/3353290042,v1:172.21.15.138:6837/3353290042] conn(0x558b990ed9a0 0x558b9916d200 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:27:40.940 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:40.937+0000 7fd9a4b01740 1 --2- 172.21.15.19:0/4040579745 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x558b990e1a10 0x558b990f3570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:27:40.940 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:40.937+0000 7fd9a4b01740 1 --2- 172.21.15.19:0/4040579745 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558b990e10f0 0x558b990f5e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:27:40.940 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:40.937+0000 7fd9a4b01740 1 --2- 172.21.15.19:0/4040579745 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x558b990def20 0x558b990f58d0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:27:40.940 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:40.937+0000 7fd97b7fe640 0 client.25162 ms_handle_reset on v2:172.21.15.138:6836/3353290042 2024-09-10T22:27:40.941 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:40.937+0000 7fd9a4b01740 1 -- 172.21.15.19:0/4040579745 >> 172.21.15.19:0/4040579745 conn(0x558b990ff9d0 msgr2=0x558b990e92d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:27:40.941 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:40.937+0000 7fd9a4b01740 1 -- 172.21.15.19:0/4040579745 shutdown_connections 2024-09-10T22:27:40.941 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:40.937+0000 7fd9a4b01740 1 -- 172.21.15.19:0/4040579745 wait complete. 2024-09-10T22:27:40.941 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:40.937+0000 7fd9a4b01740 20 client.25162 trim_cache size 0 max 16384 2024-09-10T22:27:40.941 INFO:teuthology.orchestra.run.smithi019.stdout:[] 2024-09-10T22:27:40.942 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:40.938+0000 7fd9a272c640 1 -- 172.21.15.19:0/3715933393 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7fd9840b52e0 msgr2=0x7fd9840b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:27:40.942 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:40.939+0000 7fd9a272c640 1 --2- 172.21.15.19:0/3715933393 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7fd9840b52e0 0x7fd9840b77a0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fd994007f00 tx=0x7fd994007520 comp rx=0 tx=0).stop 2024-09-10T22:27:40.942 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:40.939+0000 7fd9a272c640 1 -- 172.21.15.19:0/3715933393 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd99c101cc0 msgr2=0x7fd99c1981f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:27:40.942 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:40.939+0000 7fd9a272c640 1 --2- 172.21.15.19:0/3715933393 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd99c101cc0 0x7fd99c1981f0 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7fd98c02aa00 tx=0x7fd98c003b90 comp rx=0 tx=0).stop 2024-09-10T22:27:40.942 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:40.939+0000 7fd9a272c640 1 -- 172.21.15.19:0/3715933393 shutdown_connections 2024-09-10T22:27:40.942 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:40.939+0000 7fd9a272c640 1 --2- 172.21.15.19:0/3715933393 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7fd9840b52e0 0x7fd9840b77a0 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:27:40.942 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:40.939+0000 7fd9a272c640 1 --2- 172.21.15.19:0/3715933393 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd99c108050 0x7fd99c19dad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:27:40.943 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:40.939+0000 7fd9a272c640 1 --2- 172.21.15.19:0/3715933393 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd99c1076d0 0x7fd99c198730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:27:40.943 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:40.939+0000 7fd9a272c640 1 --2- 172.21.15.19:0/3715933393 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd99c101cc0 0x7fd99c1981f0 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:27:40.943 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:40.939+0000 7fd9a272c640 1 -- 172.21.15.19:0/3715933393 >> 172.21.15.19:0/3715933393 conn(0x7fd99c0fd770 msgr2=0x7fd99c0ff070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:27:40.943 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:40.939+0000 7fd9a272c640 1 -- 172.21.15.19:0/3715933393 shutdown_connections 2024-09-10T22:27:40.943 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:40.939+0000 7fd9a272c640 1 -- 172.21.15.19:0/3715933393 wait complete. 2024-09-10T22:27:41.958 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:27:41 smithi019 ceph-mon[31375]: pgmap v385: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 648 MiB/s wr, 1.16k op/s 2024-09-10T22:27:42.109 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:27:41 smithi135 ceph-mon[34789]: pgmap v385: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 648 MiB/s wr, 1.16k op/s 2024-09-10T22:27:42.124 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:27:41 smithi138 ceph-mon[35236]: pgmap v385: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 648 MiB/s wr, 1.16k op/s 2024-09-10T22:27:42.386 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 22997a4c-6fc2-11ef-bcea-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-09-10T22:27:42.912 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/22997a4c-6fc2-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T22:27:43.538 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:43.536+0000 7fc77bfff640 1 -- 172.21.15.19:0/1628797808 <== mds.0 v2:172.21.15.135:6838/1254769802 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x557d5e8eb0f0 con 0x557d5e9907f0 2024-09-10T22:27:43.539 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:43.536+0000 7fc77bfff640 10 client.25187 handle_command_reply: tid=0 2024-09-10T22:27:43.539 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:43.536+0000 7fc7a5e7b740 1 client.25187 shutdown 2024-09-10T22:27:43.539 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:43.537+0000 7fc7a5e7b740 1 -- 172.21.15.19:0/1628797808 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557d5e97e190 msgr2=0x557d5e98b680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:27:43.539 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:43.537+0000 7fc7a5e7b740 1 --2- 172.21.15.19:0/1628797808 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557d5e97e190 0x557d5e98b680 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fc78c0e5c20 tx=0x7fc78c010c00 comp rx=0 tx=0).stop 2024-09-10T22:27:43.539 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:43.537+0000 7fc7a5e7b740 1 -- 172.21.15.19:0/1628797808 shutdown_connections 2024-09-10T22:27:43.539 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:43.537+0000 7fc7a5e7b740 1 --2- 172.21.15.19:0/1628797808 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x557d5e9907f0 0x557d5ea00190 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:27:43.539 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:43.537+0000 7fc7a5e7b740 1 --2- 172.21.15.19:0/1628797808 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x557d5e980bd0 0x557d5e98bbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:27:43.539 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:43.537+0000 7fc7a5e7b740 1 --2- 172.21.15.19:0/1628797808 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557d5e97e190 0x557d5e98b680 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:27:43.539 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:43.537+0000 7fc7a5e7b740 1 --2- 172.21.15.19:0/1628797808 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x557d5e97b860 0x557d5e98c980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:27:43.539 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:43.537+0000 7fc7a5e7b740 1 -- 172.21.15.19:0/1628797808 >> 172.21.15.19:0/1628797808 conn(0x557d5e9769b0 msgr2=0x557d5e977210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:27:43.539 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:43.537+0000 7fc77bfff640 0 client.25187 ms_handle_reset on v2:172.21.15.135:6838/1254769802 2024-09-10T22:27:43.539 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:43.537+0000 7fc7a5e7b740 1 -- 172.21.15.19:0/1628797808 shutdown_connections 2024-09-10T22:27:43.539 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:43.537+0000 7fc7a5e7b740 1 -- 172.21.15.19:0/1628797808 wait complete. 2024-09-10T22:27:43.540 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:43.537+0000 7fc7a5e7b740 20 client.25187 trim_cache size 0 max 16384 2024-09-10T22:27:43.540 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stdout:{ 2024-09-10T22:27:43.540 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stdout: "message": "", 2024-09-10T22:27:43.540 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stdout: "return_code": 0 2024-09-10T22:27:43.540 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stdout:} 2024-09-10T22:27:43.541 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:43.538+0000 7fc7a2fd3640 1 -- 172.21.15.19:0/3643481221 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7fc7840b5360 msgr2=0x7fc7840b7820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:27:43.541 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:43.538+0000 7fc7a2fd3640 1 --2- 172.21.15.19:0/3643481221 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7fc7840b5360 0x7fc7840b7820 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fc794005e30 tx=0x7fc79403d040 comp rx=0 tx=0).stop 2024-09-10T22:27:43.541 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:43.538+0000 7fc7a2fd3640 1 -- 172.21.15.19:0/3643481221 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc79c102a00 msgr2=0x7fc79c19b5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:27:43.541 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:43.538+0000 7fc7a2fd3640 1 --2- 172.21.15.19:0/3643481221 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc79c102a00 0x7fc79c19b5d0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fc78c00d950 tx=0x7fc78c00de10 comp rx=0 tx=0).stop 2024-09-10T22:27:43.541 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:43.539+0000 7fc7a2fd3640 1 -- 172.21.15.19:0/3643481221 shutdown_connections 2024-09-10T22:27:43.541 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:43.539+0000 7fc7a2fd3640 1 --2- 172.21.15.19:0/3643481221 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7fc7840b5360 0x7fc7840b7820 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:27:43.541 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:43.539+0000 7fc7a2fd3640 1 --2- 172.21.15.19:0/3643481221 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc79c1033c0 0x7fc79c19c200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:27:43.541 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:43.539+0000 7fc7a2fd3640 1 --2- 172.21.15.19:0/3643481221 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc79c102a00 0x7fc79c19b5d0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:27:43.541 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:43.539+0000 7fc7a2fd3640 1 --2- 172.21.15.19:0/3643481221 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc79c1018b0 0x7fc79c19af80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:27:43.542 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:43.539+0000 7fc7a2fd3640 1 -- 172.21.15.19:0/3643481221 >> 172.21.15.19:0/3643481221 conn(0x7fc79c0fd150 msgr2=0x7fc79c0feba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:27:43.542 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:43.539+0000 7fc7a2fd3640 1 -- 172.21.15.19:0/3643481221 shutdown_connections 2024-09-10T22:27:43.542 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:43.539+0000 7fc7a2fd3640 1 -- 172.21.15.19:0/3643481221 wait complete. 2024-09-10T22:27:43.554 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:43.552+0000 7fdb6bc3c640 1 -- 172.21.15.19:0/1966886478 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdb64101cc0 msgr2=0x7fdb641020a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:27:43.554 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:43.552+0000 7fdb6bc3c640 1 --2- 172.21.15.19:0/1966886478 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdb64101cc0 0x7fdb641020a0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fdb60009900 tx=0x7fdb6002a410 comp rx=0 tx=0).stop 2024-09-10T22:27:43.554 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:43.553+0000 7fdb6bc3c640 1 -- 172.21.15.19:0/1966886478 shutdown_connections 2024-09-10T22:27:43.554 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:43.553+0000 7fdb6bc3c640 1 --2- 172.21.15.19:0/1966886478 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdb64108050 0x7fdb6410e850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:27:43.555 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:43.553+0000 7fdb6bc3c640 1 --2- 172.21.15.19:0/1966886478 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fdb641076d0 0x7fdb64107b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:27:43.555 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:43.553+0000 7fdb6bc3c640 1 --2- 172.21.15.19:0/1966886478 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdb64101cc0 0x7fdb641020a0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:27:43.555 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:43.553+0000 7fdb6bc3c640 1 -- 172.21.15.19:0/1966886478 >> 172.21.15.19:0/1966886478 conn(0x7fdb640fd770 msgr2=0x7fdb640ffb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:27:43.555 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:43.553+0000 7fdb6bc3c640 1 -- 172.21.15.19:0/1966886478 shutdown_connections 2024-09-10T22:27:43.555 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:43.553+0000 7fdb6bc3c640 1 -- 172.21.15.19:0/1966886478 wait complete. 2024-09-10T22:27:43.556 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:43.554+0000 7fdb6bc3c640 1 Processor -- start 2024-09-10T22:27:43.556 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:43.554+0000 7fdb6bc3c640 1 -- start start 2024-09-10T22:27:43.556 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:43.554+0000 7fdb6bc3c640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fdb64101cc0 0x7fdb6419a120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:27:43.556 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:43.554+0000 7fdb6bc3c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdb641076d0 0x7fdb6419a660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:27:43.556 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:43.555+0000 7fdb699d8640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fdb64101cc0 0x7fdb6419a120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:27:43.556 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:43.555+0000 7fdb691d7640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdb641076d0 0x7fdb6419a660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:27:43.556 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:43.555+0000 7fdb699d8640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fdb64101cc0 0x7fdb6419a120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.19:42682/0 (socket says 172.21.15.19:42682) 2024-09-10T22:27:43.556 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:43.555+0000 7fdb691d7640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdb641076d0 0x7fdb6419a660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:55852/0 (socket says 172.21.15.19:55852) 2024-09-10T22:27:43.557 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:43.555+0000 7fdb699d8640 1 -- 172.21.15.19:0/3524035442 learned_addr learned my addr 172.21.15.19:0/3524035442 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:27:43.557 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:43.555+0000 7fdb6bc3c640 1 --2- 172.21.15.19:0/3524035442 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdb64108050 0x7fdb6419abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:27:43.557 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:43.555+0000 7fdb6bc3c640 1 -- 172.21.15.19:0/3524035442 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fdb64111d10 con 0x7fdb641076d0 2024-09-10T22:27:43.557 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:43.555+0000 7fdb6bc3c640 1 -- 172.21.15.19:0/3524035442 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fdb64111b90 con 0x7fdb64108050 2024-09-10T22:27:43.557 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:43.555+0000 7fdb6bc3c640 1 -- 172.21.15.19:0/3524035442 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7fdb64111e90 con 0x7fdb64101cc0 2024-09-10T22:27:43.558 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:43.555+0000 7fdb6a1d9640 1 --2- 172.21.15.19:0/3524035442 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdb64108050 0x7fdb6419abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:27:43.558 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:43.555+0000 7fdb691d7640 1 -- 172.21.15.19:0/3524035442 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fdb64101cc0 msgr2=0x7fdb6419a120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:27:43.558 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:43.555+0000 7fdb691d7640 1 --2- 172.21.15.19:0/3524035442 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fdb64101cc0 0x7fdb6419a120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:27:43.558 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:43.555+0000 7fdb691d7640 1 -- 172.21.15.19:0/3524035442 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdb64108050 msgr2=0x7fdb6419abc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:27:43.558 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:43.555+0000 7fdb691d7640 1 --2- 172.21.15.19:0/3524035442 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdb64108050 0x7fdb6419abc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:27:43.558 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:43.555+0000 7fdb691d7640 1 -- 172.21.15.19:0/3524035442 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdb641a5500 con 0x7fdb641076d0 2024-09-10T22:27:43.558 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:43.556+0000 7fdb691d7640 1 --2- 172.21.15.19:0/3524035442 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdb641076d0 0x7fdb6419a660 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7fdb5400e9f0 tx=0x7fdb5400eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:27:43.558 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:43.556+0000 7fdb5affd640 1 -- 172.21.15.19:0/3524035442 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb5400ccc0 con 0x7fdb641076d0 2024-09-10T22:27:43.559 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:43.556+0000 7fdb5affd640 1 -- 172.21.15.19:0/3524035442 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fdb540108e0 con 0x7fdb641076d0 2024-09-10T22:27:43.559 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:43.556+0000 7fdb5affd640 1 -- 172.21.15.19:0/3524035442 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb54018880 con 0x7fdb641076d0 2024-09-10T22:27:43.559 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:43.556+0000 7fdb6bc3c640 1 -- 172.21.15.19:0/3524035442 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdb641a57f0 con 0x7fdb641076d0 2024-09-10T22:27:43.559 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:43.556+0000 7fdb6bc3c640 1 -- 172.21.15.19:0/3524035442 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdb641a5d30 con 0x7fdb641076d0 2024-09-10T22:27:43.560 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:43.559+0000 7fdb6e011740 1 Processor -- start 2024-09-10T22:27:43.561 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:43.559+0000 7fdb5affd640 1 -- 172.21.15.19:0/3524035442 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 18) ==== 153250+0+0 (secure 0 0 0) 0x7fdb54018a20 con 0x7fdb641076d0 2024-09-10T22:27:43.561 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:43.559+0000 7fdb6e011740 1 -- start start 2024-09-10T22:27:43.561 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:43.560+0000 7fdb6e011740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5603ba4af4d0 0x5603ba4af8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:27:43.561 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:43.560+0000 7fdb6e011740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5603ba4afdf0 0x5603ba4bb840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:27:43.561 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:43.560+0000 7fdb6e011740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5603ba4bbd80 0x5603ba4be170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:27:43.562 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:43.560+0000 7fdb6e011740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x5603ba425ea0 con 0x5603ba4af4d0 2024-09-10T22:27:43.562 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:43.560+0000 7fdb6e011740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x5603ba4152d0 con 0x5603ba4afdf0 2024-09-10T22:27:43.562 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:43.560+0000 7fdb6e011740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x5603ba4190e0 con 0x5603ba4bbd80 2024-09-10T22:27:43.562 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:43.560+0000 7fdb691d7640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5603ba4bbd80 0x5603ba4be170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:27:43.562 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:43.560+0000 7fdb691d7640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5603ba4bbd80 0x5603ba4be170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.19:42692/0 (socket says 172.21.15.19:42692) 2024-09-10T22:27:43.562 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:43.560+0000 7fdb691d7640 1 -- 172.21.15.19:0/4031396875 learned_addr learned my addr 172.21.15.19:0/4031396875 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:27:43.564 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:43.560+0000 7fdb691d7640 1 -- 172.21.15.19:0/4031396875 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5603ba4afdf0 msgr2=0x5603ba4bb840 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-10T22:27:43.565 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:43.560+0000 7fdb691d7640 1 --2- 172.21.15.19:0/4031396875 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5603ba4afdf0 0x5603ba4bb840 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:27:43.565 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:43.560+0000 7fdb691d7640 1 -- 172.21.15.19:0/4031396875 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5603ba4af4d0 msgr2=0x5603ba4af8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:27:43.565 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:43.560+0000 7fdb691d7640 1 --2- 172.21.15.19:0/4031396875 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5603ba4af4d0 0x5603ba4af8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:27:43.565 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:43.560+0000 7fdb691d7640 1 -- 172.21.15.19:0/4031396875 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5603ba173650 con 0x5603ba4bbd80 2024-09-10T22:27:43.565 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:43.561+0000 7fdb691d7640 1 --2- 172.21.15.19:0/4031396875 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5603ba4bbd80 0x5603ba4be170 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fdb540ee190 tx=0x7fdb540ee650 comp rx=0 tx=0).ready entity=mon.1 client_cookie=192acff42eca95a5 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:27:43.565 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:43.561+0000 7fdb5affd640 1 --2- 172.21.15.19:0/3524035442 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7fdb500b52e0 0x7fdb500b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:27:43.565 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:43.561+0000 7fdb4ffff640 1 -- 172.21.15.19:0/4031396875 <== mon.1 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb540f9070 con 0x5603ba4bbd80 2024-09-10T22:27:43.566 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:43.561+0000 7fdb4ffff640 1 -- 172.21.15.19:0/4031396875 <== mon.1 v2:172.21.15.138:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fdb540ac2c0 con 0x5603ba4bbd80 2024-09-10T22:27:43.566 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:43.561+0000 7fdb4ffff640 1 -- 172.21.15.19:0/4031396875 <== mon.1 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb540ac580 con 0x5603ba4bbd80 2024-09-10T22:27:43.566 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:43.561+0000 7fdb6a1d9640 1 --2- 172.21.15.19:0/3524035442 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7fdb500b52e0 0x7fdb500b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:27:43.566 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:43.561+0000 7fdb5affd640 1 -- 172.21.15.19:0/3524035442 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8327+0+0 (secure 0 0 0) 0x7fdb540e5fe0 con 0x7fdb641076d0 2024-09-10T22:27:43.566 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:43.562+0000 7fdb6e011740 1 -- 172.21.15.19:0/4031396875 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5603ba4bbd80 msgr2=0x5603ba4be170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:27:43.567 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:43.562+0000 7fdb6e011740 1 --2- 172.21.15.19:0/4031396875 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5603ba4bbd80 0x5603ba4be170 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fdb540ee190 tx=0x7fdb540ee650 comp rx=0 tx=0).stop 2024-09-10T22:27:43.567 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:43.562+0000 7fdb6a1d9640 1 --2- 172.21.15.19:0/3524035442 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7fdb500b52e0 0x7fdb500b77a0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fdb6419b100 tx=0x7fdb5c009ab0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:27:43.567 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:43.562+0000 7fdb6e011740 1 -- 172.21.15.19:0/4031396875 shutdown_connections 2024-09-10T22:27:43.567 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:43.562+0000 7fdb6e011740 1 --2- 172.21.15.19:0/4031396875 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5603ba4bbd80 0x5603ba4be170 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:27:43.567 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:43.562+0000 7fdb6e011740 1 --2- 172.21.15.19:0/4031396875 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5603ba4afdf0 0x5603ba4bb840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:27:43.567 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:43.562+0000 7fdb6e011740 1 --2- 172.21.15.19:0/4031396875 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5603ba4af4d0 0x5603ba4af8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:27:43.567 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:43.562+0000 7fdb6e011740 1 -- 172.21.15.19:0/4031396875 >> 172.21.15.19:0/4031396875 conn(0x5603ba4ad300 msgr2=0x5603ba4ae4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:27:43.567 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:43.562+0000 7fdb6e011740 1 -- 172.21.15.19:0/4031396875 shutdown_connections 2024-09-10T22:27:43.567 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:43.562+0000 7fdb6e011740 1 -- 172.21.15.19:0/4031396875 wait complete. 2024-09-10T22:27:43.568 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:43.562+0000 7fdb6e011740 1 -- start start 2024-09-10T22:27:43.568 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:43.562+0000 7fdb6e011740 1 Processor -- start 2024-09-10T22:27:43.568 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:43.563+0000 7fdb6e011740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5603ba4af4d0 0x5603ba4bb610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:27:43.568 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:43.563+0000 7fdb6e011740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5603ba4afdf0 0x5603ba4b8a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:27:43.568 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:43.563+0000 7fdb6e011740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5603ba4bbd80 0x5603ba4b9000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:27:43.568 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:43.563+0000 7fdb6e011740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x5603ba276700 con 0x5603ba4bbd80 2024-09-10T22:27:43.568 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:43.563+0000 7fdb6e011740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x5603ba3b0160 con 0x5603ba4afdf0 2024-09-10T22:27:43.568 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:43.563+0000 7fdb6e011740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x5603ba4bea00 con 0x5603ba4af4d0 2024-09-10T22:27:43.569 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:43.563+0000 7fdb6e011740 10 client.0 _ll_register_callbacks cb 0x5603ba3c99e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T22:27:43.569 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:43.563+0000 7fdb699d8640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5603ba4af4d0 0x5603ba4bb610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:27:43.569 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:43.563+0000 7fdb6a1d9640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5603ba4bbd80 0x5603ba4b9000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:27:43.569 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:43.563+0000 7fdb699d8640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5603ba4af4d0 0x5603ba4bb610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.19:42698/0 (socket says 172.21.15.19:42698) 2024-09-10T22:27:43.569 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:43.563+0000 7fdb699d8640 1 -- 172.21.15.19:0/636396608 learned_addr learned my addr 172.21.15.19:0/636396608 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:27:43.569 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:43.563+0000 7fdb6a1d9640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5603ba4bbd80 0x5603ba4b9000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:55858/0 (socket says 172.21.15.19:55858) 2024-09-10T22:27:43.569 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:43.563+0000 7fdb691d7640 1 --2- 172.21.15.19:0/636396608 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5603ba4afdf0 0x5603ba4b8a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:27:43.569 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:43.563+0000 7fdb699d8640 1 -- 172.21.15.19:0/636396608 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5603ba4afdf0 msgr2=0x5603ba4b8a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:27:43.569 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:43.563+0000 7fdb699d8640 1 --2- 172.21.15.19:0/636396608 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5603ba4afdf0 0x5603ba4b8a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:27:43.569 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:43.563+0000 7fdb699d8640 1 -- 172.21.15.19:0/636396608 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5603ba4bbd80 msgr2=0x5603ba4b9000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:27:43.569 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:43.563+0000 7fdb699d8640 1 --2- 172.21.15.19:0/636396608 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5603ba4bbd80 0x5603ba4b9000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:27:43.569 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:43.563+0000 7fdb699d8640 1 -- 172.21.15.19:0/636396608 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5603ba3ddc90 con 0x5603ba4af4d0 2024-09-10T22:27:43.571 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:43.564+0000 7fdb699d8640 1 --2- 172.21.15.19:0/636396608 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5603ba4af4d0 0x5603ba4bb610 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fdb60000c00 tx=0x7fdb60031d40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d241cb4ef21199ff server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:27:43.571 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:43.564+0000 7fdb4d7fa640 10 client.0 ms_handle_connect on v2:172.21.15.138:3300/0 2024-09-10T22:27:43.572 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:43.564+0000 7fdb4d7fa640 1 -- 172.21.15.19:0/636396608 <== mon.1 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb60040070 con 0x5603ba4af4d0 2024-09-10T22:27:43.572 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:43.564+0000 7fdb4d7fa640 1 -- 172.21.15.19:0/636396608 <== mon.1 v2:172.21.15.138:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8327+0+0 (secure 0 0 0) 0x7fdb600318b0 con 0x5603ba4af4d0 2024-09-10T22:27:43.572 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:43.564+0000 7fdb6e011740 1 -- 172.21.15.19:0/636396608 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fdb540ac2c0 con 0x5603ba4af4d0 2024-09-10T22:27:43.572 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:43.564+0000 7fdb4d7fa640 1 -- 172.21.15.19:0/636396608 <== mon.1 v2:172.21.15.138:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7fdb60035040 con 0x5603ba4af4d0 2024-09-10T22:27:43.572 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:43.564+0000 7fdb6e011740 10 client.25174 fetch_fsmap learned FSMap version 26 2024-09-10T22:27:43.572 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:43.564+0000 7fdb6e011740 1 -- 172.21.15.19:0/636396608 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x5603ba4ca2d0 con 0x5603ba4af4d0 2024-09-10T22:27:43.572 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:43.564+0000 7fdb4d7fa640 1 -- 172.21.15.19:0/636396608 <== mon.1 v2:172.21.15.138:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fdb540ac2c0 con 0x5603ba4af4d0 2024-09-10T22:27:43.572 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:43.565+0000 7fdb4d7fa640 1 -- 172.21.15.19:0/636396608 <== mon.1 v2:172.21.15.138:3300/0 5 ==== fsmap(e 26) ==== 8350+0+0 (secure 0 0 0) 0x7fdb60003c10 con 0x5603ba4af4d0 2024-09-10T22:27:43.572 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:43.565+0000 7fdb6e011740 10 client.25174 fetch_fsmap finished waiting for FSMap version 26 2024-09-10T22:27:43.572 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:43.565+0000 7fdb6e011740 10 client.25174 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-10T22:27:43.572 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:43.565+0000 7fdb6e011740 20 client.25174 populate_metadata read hostname 'smithi019' 2024-09-10T22:27:43.573 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:43.565+0000 7fdb6e011740 1 --2- 172.21.15.19:0/636396608 >> [v2:172.21.15.138:6838/383637208,v1:172.21.15.138:6839/383637208] conn(0x5603ba4cbba0 0x5603ba4ce000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:27:43.573 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:43.565+0000 7fdb6e011740 4 client.25174 mds_command: new command op to 24568 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T22:27:43.573 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:43.565+0000 7fdb6e011740 1 -- 172.21.15.19:0/636396608 --> [v2:172.21.15.138:6838/383637208,v1:172.21.15.138:6839/383637208] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5603ba427df0 con 0x5603ba4cbba0 2024-09-10T22:27:43.573 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:43.565+0000 7fdb691d7640 1 --2- 172.21.15.19:0/636396608 >> [v2:172.21.15.138:6838/383637208,v1:172.21.15.138:6839/383637208] conn(0x5603ba4cbba0 0x5603ba4ce000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:27:43.573 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:43.565+0000 7fdb4d7fa640 10 client.25174 ms_handle_connect on v2:172.21.15.138:6838/383637208 2024-09-10T22:27:43.573 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:43.565+0000 7fdb691d7640 1 --2- 172.21.15.19:0/636396608 >> [v2:172.21.15.138:6838/383637208,v1:172.21.15.138:6839/383637208] conn(0x5603ba4cbba0 0x5603ba4ce000 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=4fc9cfe8d5bbaccb server_cookie=f5a3483d0f2de6bb in_seq=0 out_seq=0 2024-09-10T22:27:43.573 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:43.566+0000 7fdb4d7fa640 1 -- 172.21.15.19:0/636396608 <== mds.1 v2:172.21.15.138:6838/383637208 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5603ba427df0 con 0x5603ba4cbba0 2024-09-10T22:27:43.574 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:43.566+0000 7fdb4d7fa640 10 client.25174 handle_command_reply: tid=0 2024-09-10T22:27:43.574 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:43.566+0000 7fdb6e011740 1 client.25174 shutdown 2024-09-10T22:27:43.574 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:43.566+0000 7fdb6e011740 1 -- 172.21.15.19:0/636396608 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5603ba4af4d0 msgr2=0x5603ba4bb610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:27:43.574 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:43.566+0000 7fdb6e011740 1 --2- 172.21.15.19:0/636396608 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5603ba4af4d0 0x5603ba4bb610 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fdb60000c00 tx=0x7fdb60031d40 comp rx=0 tx=0).stop 2024-09-10T22:27:43.574 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:43.566+0000 7fdb6e011740 1 -- 172.21.15.19:0/636396608 shutdown_connections 2024-09-10T22:27:43.574 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:43.566+0000 7fdb6e011740 1 --2- 172.21.15.19:0/636396608 >> [v2:172.21.15.138:6838/383637208,v1:172.21.15.138:6839/383637208] conn(0x5603ba4cbba0 0x5603ba4ce000 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:27:43.574 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:43.566+0000 7fdb6e011740 1 --2- 172.21.15.19:0/636396608 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5603ba4bbd80 0x5603ba4b9000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:27:43.574 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:43.566+0000 7fdb6e011740 1 --2- 172.21.15.19:0/636396608 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5603ba4afdf0 0x5603ba4b8a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:27:43.574 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:43.566+0000 7fdb4d7fa640 0 client.25174 ms_handle_reset on v2:172.21.15.138:6838/383637208 2024-09-10T22:27:43.574 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:43.566+0000 7fdb6e011740 1 --2- 172.21.15.19:0/636396608 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5603ba4af4d0 0x5603ba4bb610 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:27:43.574 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:43.566+0000 7fdb6e011740 1 -- 172.21.15.19:0/636396608 >> 172.21.15.19:0/636396608 conn(0x5603ba4ad300 msgr2=0x5603ba4b2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:27:43.574 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:43.566+0000 7fdb6e011740 1 -- 172.21.15.19:0/636396608 shutdown_connections 2024-09-10T22:27:43.574 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:43.566+0000 7fdb6e011740 1 -- 172.21.15.19:0/636396608 wait complete. 2024-09-10T22:27:43.575 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:43.567+0000 7fdb6e011740 20 client.25174 trim_cache size 0 max 16384 2024-09-10T22:27:43.583 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:43.581+0000 7fdb6e011740 1 Processor -- start 2024-09-10T22:27:43.583 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:43.581+0000 7fdb6e011740 1 -- start start 2024-09-10T22:27:43.583 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:43.581+0000 7fdb6e011740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5603ba4af4d0 0x5603ba4b7f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:27:43.583 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:43.581+0000 7fdb6e011740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5603ba4afdf0 0x5603ba4acc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:27:43.583 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:43.581+0000 7fdb6e011740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5603ba4bbd80 0x5603ba4b5c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:27:43.584 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:43.581+0000 7fdb6e011740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fdb641b0fe0 con 0x5603ba4afdf0 2024-09-10T22:27:43.584 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:43.581+0000 7fdb6e011740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fdb641ae8b0 con 0x5603ba4af4d0 2024-09-10T22:27:43.584 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:43.581+0000 7fdb6e011740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7fdb641ac700 con 0x5603ba4bbd80 2024-09-10T22:27:43.584 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:43.581+0000 7fdb699d8640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5603ba4af4d0 0x5603ba4b7f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:27:43.584 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:43.581+0000 7fdb691d7640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5603ba4afdf0 0x5603ba4acc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:27:43.584 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:43.581+0000 7fdb6a1d9640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5603ba4bbd80 0x5603ba4b5c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:27:43.584 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:43.581+0000 7fdb6a1d9640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5603ba4bbd80 0x5603ba4b5c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.19:42700/0 (socket says 172.21.15.19:42700) 2024-09-10T22:27:43.584 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:43.581+0000 7fdb699d8640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5603ba4af4d0 0x5603ba4b7f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.19:41752/0 (socket says 172.21.15.19:41752) 2024-09-10T22:27:43.584 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:43.581+0000 7fdb6a1d9640 1 -- 172.21.15.19:0/496537654 learned_addr learned my addr 172.21.15.19:0/496537654 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:27:43.584 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:43.581+0000 7fdb699d8640 1 -- 172.21.15.19:0/496537654 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5603ba4bbd80 msgr2=0x5603ba4b5c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:27:43.584 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:43.581+0000 7fdb699d8640 1 --2- 172.21.15.19:0/496537654 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5603ba4bbd80 0x5603ba4b5c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:27:43.584 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:43.581+0000 7fdb699d8640 1 -- 172.21.15.19:0/496537654 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5603ba4afdf0 msgr2=0x5603ba4acc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:27:43.585 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:43.581+0000 7fdb699d8640 1 --2- 172.21.15.19:0/496537654 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5603ba4afdf0 0x5603ba4acc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:27:43.585 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:43.581+0000 7fdb699d8640 1 -- 172.21.15.19:0/496537654 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5603ba4add80 con 0x5603ba4af4d0 2024-09-10T22:27:43.585 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:43.581+0000 7fdb6a1d9640 1 --2- 172.21.15.19:0/496537654 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5603ba4bbd80 0x5603ba4b5c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T22:27:43.585 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:43.582+0000 7fdb699d8640 1 --2- 172.21.15.19:0/496537654 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5603ba4af4d0 0x5603ba4b7f50 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fdb60009a20 tx=0x7fdb60005780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=964e20106d001bfd server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:27:43.585 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:43.582+0000 7fdb4f7fe640 1 -- 172.21.15.19:0/496537654 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb60040040 con 0x5603ba4af4d0 2024-09-10T22:27:43.585 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:43.582+0000 7fdb4f7fe640 1 -- 172.21.15.19:0/496537654 <== mon.2 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fdb6003c830 con 0x5603ba4af4d0 2024-09-10T22:27:43.585 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:43.582+0000 7fdb4f7fe640 1 -- 172.21.15.19:0/496537654 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb60004400 con 0x5603ba4af4d0 2024-09-10T22:27:43.588 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:43.583+0000 7fdb6e011740 1 -- 172.21.15.19:0/496537654 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5603ba4af4d0 msgr2=0x5603ba4b7f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:27:43.588 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:43.583+0000 7fdb6e011740 1 --2- 172.21.15.19:0/496537654 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5603ba4af4d0 0x5603ba4b7f50 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fdb60009a20 tx=0x7fdb60005780 comp rx=0 tx=0).stop 2024-09-10T22:27:43.588 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:43.583+0000 7fdb6e011740 1 -- 172.21.15.19:0/496537654 shutdown_connections 2024-09-10T22:27:43.588 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:43.583+0000 7fdb6e011740 1 --2- 172.21.15.19:0/496537654 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5603ba4bbd80 0x5603ba4b5c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:27:43.588 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:43.583+0000 7fdb6e011740 1 --2- 172.21.15.19:0/496537654 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5603ba4afdf0 0x5603ba4acc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:27:43.588 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:43.583+0000 7fdb6e011740 1 --2- 172.21.15.19:0/496537654 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5603ba4af4d0 0x5603ba4b7f50 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:27:43.588 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:43.583+0000 7fdb6e011740 1 -- 172.21.15.19:0/496537654 >> 172.21.15.19:0/496537654 conn(0x5603ba4ad300 msgr2=0x5603ba4b72e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:27:43.588 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:43.583+0000 7fdb6e011740 1 -- 172.21.15.19:0/496537654 shutdown_connections 2024-09-10T22:27:43.589 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:43.583+0000 7fdb6e011740 1 -- 172.21.15.19:0/496537654 wait complete. 2024-09-10T22:27:43.589 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:43.584+0000 7fdb6e011740 1 -- start start 2024-09-10T22:27:43.589 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:43.584+0000 7fdb6e011740 1 Processor -- start 2024-09-10T22:27:43.589 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:43.584+0000 7fdb6e011740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5603ba4af4d0 0x5603ba4d1ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:27:43.589 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:43.584+0000 7fdb6e011740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5603ba4afdf0 0x5603ba4d2020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:27:43.589 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:43.584+0000 7fdb6e011740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5603ba4bbd80 0x5603ba537a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:27:43.589 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:43.585+0000 7fdb6e011740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fdb641acd70 con 0x5603ba4afdf0 2024-09-10T22:27:43.589 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:43.585+0000 7fdb6e011740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fdb641ae1e0 con 0x5603ba4bbd80 2024-09-10T22:27:43.589 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:43.585+0000 7fdb6e011740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7fdb641ad440 con 0x5603ba4af4d0 2024-09-10T22:27:43.589 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:43.585+0000 7fdb699d8640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5603ba4af4d0 0x5603ba4d1ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:27:43.589 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:43.585+0000 7fdb699d8640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5603ba4af4d0 0x5603ba4d1ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.19:42716/0 (socket says 172.21.15.19:42716) 2024-09-10T22:27:43.589 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:43.585+0000 7fdb699d8640 1 -- 172.21.15.19:0/2332604481 learned_addr learned my addr 172.21.15.19:0/2332604481 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:27:43.589 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:43.585+0000 7fdb6a1d9640 1 --2- 172.21.15.19:0/2332604481 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5603ba4bbd80 0x5603ba537a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:27:43.590 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:43.585+0000 7fdb6e011740 10 client.0 _ll_register_callbacks cb 0x7fdb54005e30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T22:27:43.590 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:43.585+0000 7fdb699d8640 1 -- 172.21.15.19:0/2332604481 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5603ba4bbd80 msgr2=0x5603ba537a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:27:43.590 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:43.585+0000 7fdb699d8640 1 --2- 172.21.15.19:0/2332604481 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5603ba4bbd80 0x5603ba537a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:27:43.590 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:43.585+0000 7fdb699d8640 1 -- 172.21.15.19:0/2332604481 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5603ba4afdf0 msgr2=0x5603ba4d2020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:27:43.590 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:43.585+0000 7fdb699d8640 1 --2- 172.21.15.19:0/2332604481 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5603ba4afdf0 0x5603ba4d2020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:27:43.590 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:43.585+0000 7fdb699d8640 1 -- 172.21.15.19:0/2332604481 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5603ba537f40 con 0x5603ba4af4d0 2024-09-10T22:27:43.590 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:43.585+0000 7fdb6a1d9640 1 --2- 172.21.15.19:0/2332604481 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5603ba4bbd80 0x5603ba537a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T22:27:43.590 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:43.585+0000 7fdb699d8640 1 --2- 172.21.15.19:0/2332604481 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5603ba4af4d0 0x5603ba4d1ae0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fdb6003c580 tx=0x7fdb600043b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c5bb3b2f776bc58b server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:27:43.590 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:43.585+0000 7fdb4d7fa640 10 client.0 ms_handle_connect on v2:172.21.15.138:3300/0 2024-09-10T22:27:43.590 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:43.585+0000 7fdb4d7fa640 1 -- 172.21.15.19:0/2332604481 <== mon.1 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb60000e60 con 0x5603ba4af4d0 2024-09-10T22:27:43.590 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:43.586+0000 7fdb4d7fa640 1 -- 172.21.15.19:0/2332604481 <== mon.1 v2:172.21.15.138:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8327+0+0 (secure 0 0 0) 0x7fdb600057f0 con 0x5603ba4af4d0 2024-09-10T22:27:43.590 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:43.586+0000 7fdb6e011740 1 -- 172.21.15.19:0/2332604481 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fdb6003c830 con 0x5603ba4af4d0 2024-09-10T22:27:43.590 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:43.586+0000 7fdb4d7fa640 1 -- 172.21.15.19:0/2332604481 <== mon.1 v2:172.21.15.138:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7fdb60040040 con 0x5603ba4af4d0 2024-09-10T22:27:43.591 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:43.586+0000 7fdb6e011740 10 client.25180 fetch_fsmap learned FSMap version 26 2024-09-10T22:27:43.591 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:43.586+0000 7fdb6e011740 1 -- 172.21.15.19:0/2332604481 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x5603ba5390e0 con 0x5603ba4af4d0 2024-09-10T22:27:43.591 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:43.586+0000 7fdb4d7fa640 1 -- 172.21.15.19:0/2332604481 <== mon.1 v2:172.21.15.138:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fdb6003c830 con 0x5603ba4af4d0 2024-09-10T22:27:43.591 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:43.586+0000 7fdb4d7fa640 1 -- 172.21.15.19:0/2332604481 <== mon.1 v2:172.21.15.138:3300/0 5 ==== fsmap(e 26) ==== 8350+0+0 (secure 0 0 0) 0x7fdb60003aa0 con 0x5603ba4af4d0 2024-09-10T22:27:43.591 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:43.586+0000 7fdb6e011740 10 client.25180 fetch_fsmap finished waiting for FSMap version 26 2024-09-10T22:27:43.591 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:43.586+0000 7fdb6e011740 10 client.25180 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-10T22:27:43.591 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:43.586+0000 7fdb6e011740 20 client.25180 populate_metadata read hostname 'smithi019' 2024-09-10T22:27:43.591 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:43.586+0000 7fdb6e011740 1 --2- 172.21.15.19:0/2332604481 >> [v2:172.21.15.138:6838/383637208,v1:172.21.15.138:6839/383637208] conn(0x5603ba5397a0 0x5603ba53bbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:27:43.591 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:43.586+0000 7fdb6e011740 4 client.25180 mds_command: new command op to 24568 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-10T22:27:43.591 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:43.586+0000 7fdb6e011740 1 -- 172.21.15.19:0/2332604481 --> [v2:172.21.15.138:6838/383637208,v1:172.21.15.138:6839/383637208] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5603ba4238a0 con 0x5603ba5397a0 2024-09-10T22:27:43.591 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:43.586+0000 7fdb691d7640 1 --2- 172.21.15.19:0/2332604481 >> [v2:172.21.15.138:6838/383637208,v1:172.21.15.138:6839/383637208] conn(0x5603ba5397a0 0x5603ba53bbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:27:43.591 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:43.587+0000 7fdb4d7fa640 10 client.25180 ms_handle_connect on v2:172.21.15.138:6838/383637208 2024-09-10T22:27:43.591 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:43.587+0000 7fdb691d7640 1 --2- 172.21.15.19:0/2332604481 >> [v2:172.21.15.138:6838/383637208,v1:172.21.15.138:6839/383637208] conn(0x5603ba5397a0 0x5603ba53bbe0 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=d5b2f8e2db1b864f server_cookie=fd195faf25504cfc in_seq=0 out_seq=0 2024-09-10T22:27:43.592 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:43.587+0000 7fdb4d7fa640 1 -- 172.21.15.19:0/2332604481 <== mds.1 v2:172.21.15.138:6838/383637208 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5603ba4238a0 con 0x5603ba5397a0 2024-09-10T22:27:43.592 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:43.587+0000 7fdb4d7fa640 10 client.25180 handle_command_reply: tid=0 2024-09-10T22:27:43.593 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:43.587+0000 7fdb6e011740 1 client.25180 shutdown 2024-09-10T22:27:43.593 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:43.587+0000 7fdb6e011740 1 -- 172.21.15.19:0/2332604481 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5603ba4af4d0 msgr2=0x5603ba4d1ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:27:43.593 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:43.587+0000 7fdb6e011740 1 --2- 172.21.15.19:0/2332604481 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5603ba4af4d0 0x5603ba4d1ae0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fdb6003c580 tx=0x7fdb600043b0 comp rx=0 tx=0).stop 2024-09-10T22:27:43.593 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:43.587+0000 7fdb6e011740 1 -- 172.21.15.19:0/2332604481 shutdown_connections 2024-09-10T22:27:43.593 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:43.587+0000 7fdb6e011740 1 --2- 172.21.15.19:0/2332604481 >> [v2:172.21.15.138:6838/383637208,v1:172.21.15.138:6839/383637208] conn(0x5603ba5397a0 0x5603ba53bbe0 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:27:43.593 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:43.587+0000 7fdb6e011740 1 --2- 172.21.15.19:0/2332604481 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5603ba4bbd80 0x5603ba537a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:27:43.593 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:43.587+0000 7fdb6e011740 1 --2- 172.21.15.19:0/2332604481 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5603ba4afdf0 0x5603ba4d2020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:27:43.593 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:43.587+0000 7fdb6e011740 1 --2- 172.21.15.19:0/2332604481 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5603ba4af4d0 0x5603ba4d1ae0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:27:43.593 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:43.587+0000 7fdb4d7fa640 0 client.25180 ms_handle_reset on v2:172.21.15.138:6838/383637208 2024-09-10T22:27:43.593 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:43.587+0000 7fdb6e011740 1 -- 172.21.15.19:0/2332604481 >> 172.21.15.19:0/2332604481 conn(0x5603ba4ad300 msgr2=0x5603ba4b2540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:27:43.593 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:43.588+0000 7fdb6e011740 1 -- 172.21.15.19:0/2332604481 shutdown_connections 2024-09-10T22:27:43.593 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:43.588+0000 7fdb6e011740 1 -- 172.21.15.19:0/2332604481 wait complete. 2024-09-10T22:27:43.593 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:43.588+0000 7fdb6e011740 20 client.25180 trim_cache size 0 max 16384 2024-09-10T22:27:43.594 INFO:teuthology.orchestra.run.smithi019.stdout:[] 2024-09-10T22:27:43.594 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:43.588+0000 7fdb6bc3c640 1 -- 172.21.15.19:0/3524035442 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7fdb500b52e0 msgr2=0x7fdb500b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:27:43.594 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:43.588+0000 7fdb6bc3c640 1 --2- 172.21.15.19:0/3524035442 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7fdb500b52e0 0x7fdb500b77a0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fdb6419b100 tx=0x7fdb5c009ab0 comp rx=0 tx=0).stop 2024-09-10T22:27:43.594 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:43.588+0000 7fdb6bc3c640 1 -- 172.21.15.19:0/3524035442 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdb641076d0 msgr2=0x7fdb6419a660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:27:43.595 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:43.588+0000 7fdb6bc3c640 1 --2- 172.21.15.19:0/3524035442 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdb641076d0 0x7fdb6419a660 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7fdb5400e9f0 tx=0x7fdb5400eeb0 comp rx=0 tx=0).stop 2024-09-10T22:27:43.595 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:43.589+0000 7fdb6bc3c640 1 -- 172.21.15.19:0/3524035442 shutdown_connections 2024-09-10T22:27:43.595 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:43.589+0000 7fdb6bc3c640 1 --2- 172.21.15.19:0/3524035442 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7fdb500b52e0 0x7fdb500b77a0 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:27:43.595 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:43.589+0000 7fdb6bc3c640 1 --2- 172.21.15.19:0/3524035442 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdb64108050 0x7fdb6419abc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:27:43.595 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:43.589+0000 7fdb6bc3c640 1 --2- 172.21.15.19:0/3524035442 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdb641076d0 0x7fdb6419a660 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:27:43.595 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:43.589+0000 7fdb6bc3c640 1 --2- 172.21.15.19:0/3524035442 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fdb64101cc0 0x7fdb6419a120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:27:43.595 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:43.589+0000 7fdb6bc3c640 1 -- 172.21.15.19:0/3524035442 >> 172.21.15.19:0/3524035442 conn(0x7fdb640fd770 msgr2=0x7fdb641059f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:27:43.595 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:43.589+0000 7fdb6bc3c640 1 -- 172.21.15.19:0/3524035442 shutdown_connections 2024-09-10T22:27:43.595 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:43.589+0000 7fdb6bc3c640 1 -- 172.21.15.19:0/3524035442 wait complete. 2024-09-10T22:27:43.958 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:27:43 smithi019 ceph-mon[31375]: pgmap v386: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 573 MiB/s wr, 778 op/s 2024-09-10T22:27:44.111 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:27:43 smithi135 ceph-mon[34789]: pgmap v386: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 573 MiB/s wr, 778 op/s 2024-09-10T22:27:44.125 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:27:43 smithi138 ceph-mon[35236]: pgmap v386: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 573 MiB/s wr, 778 op/s 2024-09-10T22:27:44.527 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 22997a4c-6fc2-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-10T22:27:45.101 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/22997a4c-6fc2-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T22:27:45.819 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:27:45 smithi019 ceph-mon[31375]: pgmap v387: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 563 MiB/s wr, 641 op/s 2024-09-10T22:27:45.875 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:45.655+0000 7f14f34fe640 1 -- 172.21.15.19:0/402139760 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f14ec10d160 msgr2=0x7f14ec10f5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:27:45.876 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:45.655+0000 7f14f34fe640 1 --2- 172.21.15.19:0/402139760 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f14ec10d160 0x7f14ec10f5d0 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f14e4009ca0 tx=0x7f14e402a8c0 comp rx=0 tx=0).stop 2024-09-10T22:27:45.876 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:45.655+0000 7f14f34fe640 1 -- 172.21.15.19:0/402139760 shutdown_connections 2024-09-10T22:27:45.876 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:45.655+0000 7f14f34fe640 1 --2- 172.21.15.19:0/402139760 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f14ec10d160 0x7f14ec10f5d0 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:27:45.876 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:45.655+0000 7f14f34fe640 1 --2- 172.21.15.19:0/402139760 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f14ec1045b0 0x7f14ec10cb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:27:45.876 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:45.655+0000 7f14f34fe640 1 --2- 172.21.15.19:0/402139760 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f14ec103bb0 0x7f14ec103f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:27:45.876 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:45.655+0000 7f14f34fe640 1 -- 172.21.15.19:0/402139760 >> 172.21.15.19:0/402139760 conn(0x7f14ec0fd7c0 msgr2=0x7f14ec0ffbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:27:45.876 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:45.655+0000 7f14f34fe640 1 -- 172.21.15.19:0/402139760 shutdown_connections 2024-09-10T22:27:45.876 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:45.655+0000 7f14f34fe640 1 -- 172.21.15.19:0/402139760 wait complete. 2024-09-10T22:27:45.876 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:45.656+0000 7f14f34fe640 1 Processor -- start 2024-09-10T22:27:45.876 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:45.656+0000 7f14f34fe640 1 -- start start 2024-09-10T22:27:45.877 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:45.657+0000 7f14f34fe640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f14ec103bb0 0x7f14ec199290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:27:45.877 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:45.657+0000 7f14f34fe640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f14ec1045b0 0x7f14ec1997d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:27:45.877 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:45.657+0000 7f14f34fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f14ec10d160 0x7f14ec19eb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:27:45.877 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:45.657+0000 7f14f34fe640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f14ec112de0 con 0x7f14ec10d160 2024-09-10T22:27:45.877 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:45.657+0000 7f14f34fe640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f14ec112c60 con 0x7f14ec1045b0 2024-09-10T22:27:45.877 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:45.657+0000 7f14f34fe640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f14ec112f60 con 0x7f14ec103bb0 2024-09-10T22:27:45.877 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:45.657+0000 7f14f0a99640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f14ec1045b0 0x7f14ec1997d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:27:45.877 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:45.657+0000 7f14f1a9b640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f14ec10d160 0x7f14ec19eb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:27:45.877 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:45.657+0000 7f14f0a99640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f14ec1045b0 0x7f14ec1997d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.19:41782/0 (socket says 172.21.15.19:41782) 2024-09-10T22:27:45.877 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:45.657+0000 7f14f1a9b640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f14ec10d160 0x7f14ec19eb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:55890/0 (socket says 172.21.15.19:55890) 2024-09-10T22:27:45.877 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:45.657+0000 7f14f0a99640 1 -- 172.21.15.19:0/697838914 learned_addr learned my addr 172.21.15.19:0/697838914 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:27:45.877 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:45.657+0000 7f14f129a640 1 --2- 172.21.15.19:0/697838914 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f14ec103bb0 0x7f14ec199290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:27:45.877 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:45.657+0000 7f14f0a99640 1 -- 172.21.15.19:0/697838914 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f14ec103bb0 msgr2=0x7f14ec199290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:27:45.878 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:45.657+0000 7f14f0a99640 1 --2- 172.21.15.19:0/697838914 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f14ec103bb0 0x7f14ec199290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:27:45.878 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:45.657+0000 7f14f0a99640 1 -- 172.21.15.19:0/697838914 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f14ec10d160 msgr2=0x7f14ec19eb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:27:45.878 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:45.657+0000 7f14f0a99640 1 --2- 172.21.15.19:0/697838914 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f14ec10d160 0x7f14ec19eb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:27:45.878 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:45.657+0000 7f14f0a99640 1 -- 172.21.15.19:0/697838914 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f14ec19f340 con 0x7f14ec1045b0 2024-09-10T22:27:45.878 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:45.657+0000 7f14f1a9b640 1 --2- 172.21.15.19:0/697838914 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f14ec10d160 0x7f14ec19eb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T22:27:45.878 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:45.658+0000 7f14f0a99640 1 --2- 172.21.15.19:0/697838914 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f14ec1045b0 0x7f14ec1997d0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f14dc00e9f0 tx=0x7f14dc00eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:27:45.878 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:45.658+0000 7f14e27fc640 1 -- 172.21.15.19:0/697838914 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14dc00cd80 con 0x7f14ec1045b0 2024-09-10T22:27:45.878 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:45.658+0000 7f14e27fc640 1 -- 172.21.15.19:0/697838914 <== mon.2 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f14dc0108e0 con 0x7f14ec1045b0 2024-09-10T22:27:45.878 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:45.658+0000 7f14f34fe640 1 -- 172.21.15.19:0/697838914 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f14ec19f630 con 0x7f14ec1045b0 2024-09-10T22:27:45.878 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:45.658+0000 7f14e27fc640 1 -- 172.21.15.19:0/697838914 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14dc018980 con 0x7f14ec1045b0 2024-09-10T22:27:45.878 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:45.658+0000 7f14f34fe640 1 -- 172.21.15.19:0/697838914 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f14ec1a5cf0 con 0x7f14ec1045b0 2024-09-10T22:27:45.878 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:45.661+0000 7f14f58d3740 1 Processor -- start 2024-09-10T22:27:45.879 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:45.662+0000 7f14e27fc640 1 -- 172.21.15.19:0/697838914 <== mon.2 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 18) ==== 153250+0+0 (secure 0 0 0) 0x7f14dc010430 con 0x7f14ec1045b0 2024-09-10T22:27:45.879 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:45.662+0000 7f14f58d3740 1 -- start start 2024-09-10T22:27:45.879 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:45.662+0000 7f14f58d3740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55674a82d0f0 0x55674a82d4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:27:45.879 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:45.662+0000 7f14f58d3740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55674a82da10 0x55674a839460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:27:45.879 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:45.662+0000 7f14f58d3740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55674a8399a0 0x55674a83bd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:27:45.879 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:45.662+0000 7f14f58d3740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x55674a7a3ea0 con 0x55674a82da10 2024-09-10T22:27:45.879 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:45.662+0000 7f14f58d3740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55674a7932d0 con 0x55674a82d0f0 2024-09-10T22:27:45.879 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:45.662+0000 7f14f58d3740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x55674a7970e0 con 0x55674a8399a0 2024-09-10T22:27:45.879 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:45.662+0000 7f14f129a640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55674a82da10 0x55674a839460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:27:45.879 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:45.662+0000 7f14f129a640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55674a82da10 0x55674a839460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:55896/0 (socket says 172.21.15.19:55896) 2024-09-10T22:27:45.879 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:45.662+0000 7f14f129a640 1 -- 172.21.15.19:0/4080178614 learned_addr learned my addr 172.21.15.19:0/4080178614 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:27:45.879 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:45.662+0000 7f14f1a9b640 1 --2- 172.21.15.19:0/4080178614 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55674a82d0f0 0x55674a82d4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:27:45.879 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:45.662+0000 7f14f0a99640 1 --2- 172.21.15.19:0/4080178614 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55674a8399a0 0x55674a83bd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:27:45.880 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:45.663+0000 7f14f1a9b640 1 -- 172.21.15.19:0/4080178614 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55674a8399a0 msgr2=0x55674a83bd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:27:45.880 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:45.663+0000 7f14f1a9b640 1 --2- 172.21.15.19:0/4080178614 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55674a8399a0 0x55674a83bd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:27:45.880 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:45.663+0000 7f14f1a9b640 1 -- 172.21.15.19:0/4080178614 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55674a82da10 msgr2=0x55674a839460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:27:45.880 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:45.663+0000 7f14f1a9b640 1 --2- 172.21.15.19:0/4080178614 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55674a82da10 0x55674a839460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:27:45.880 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:45.663+0000 7f14f1a9b640 1 -- 172.21.15.19:0/4080178614 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55674a4f1650 con 0x55674a82d0f0 2024-09-10T22:27:45.880 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:45.663+0000 7f14f129a640 1 --2- 172.21.15.19:0/4080178614 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55674a82da10 0x55674a839460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T22:27:45.880 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:45.663+0000 7f14e27fc640 1 --2- 172.21.15.19:0/697838914 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f14d80b52e0 0x7f14d80b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:27:45.880 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:45.663+0000 7f14f1a9b640 1 --2- 172.21.15.19:0/4080178614 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55674a82d0f0 0x55674a82d4d0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f14e4005e30 tx=0x7f14e402f310 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bae8ffde424b9ebb server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:27:45.880 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:45.663+0000 7f14f129a640 1 --2- 172.21.15.19:0/697838914 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f14d80b52e0 0x7f14d80b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:27:45.880 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:45.663+0000 7f14e27fc640 1 -- 172.21.15.19:0/697838914 <== mon.2 v2:172.21.15.135:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8327+0+0 (secure 0 0 0) 0x7f14dc0e5f20 con 0x7f14ec1045b0 2024-09-10T22:27:45.880 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:45.663+0000 7f14d77fe640 1 -- 172.21.15.19:0/4080178614 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14e4031450 con 0x55674a82d0f0 2024-09-10T22:27:45.880 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:45.663+0000 7f14d77fe640 1 -- 172.21.15.19:0/4080178614 <== mon.2 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f14e4036040 con 0x55674a82d0f0 2024-09-10T22:27:45.881 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:45.663+0000 7f14d77fe640 1 -- 172.21.15.19:0/4080178614 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14e4004330 con 0x55674a82d0f0 2024-09-10T22:27:45.881 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:45.664+0000 7f14f58d3740 1 -- 172.21.15.19:0/4080178614 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55674a82d0f0 msgr2=0x55674a82d4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:27:45.881 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:45.664+0000 7f14f129a640 1 --2- 172.21.15.19:0/697838914 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f14d80b52e0 0x7f14d80b77a0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x55674a82be00 tx=0x7f14e8005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:27:45.881 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:45.664+0000 7f14f58d3740 1 --2- 172.21.15.19:0/4080178614 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55674a82d0f0 0x55674a82d4d0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f14e4005e30 tx=0x7f14e402f310 comp rx=0 tx=0).stop 2024-09-10T22:27:45.881 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:45.664+0000 7f14f58d3740 1 -- 172.21.15.19:0/4080178614 shutdown_connections 2024-09-10T22:27:45.881 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:45.664+0000 7f14f58d3740 1 --2- 172.21.15.19:0/4080178614 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55674a8399a0 0x55674a83bd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:27:45.881 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:45.664+0000 7f14f58d3740 1 --2- 172.21.15.19:0/4080178614 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55674a82da10 0x55674a839460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:27:45.881 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:45.664+0000 7f14f58d3740 1 --2- 172.21.15.19:0/4080178614 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55674a82d0f0 0x55674a82d4d0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:27:45.881 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:45.664+0000 7f14f58d3740 1 -- 172.21.15.19:0/4080178614 >> 172.21.15.19:0/4080178614 conn(0x55674a82af20 msgr2=0x55674a82c0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:27:45.882 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:45.664+0000 7f14f58d3740 1 -- 172.21.15.19:0/4080178614 shutdown_connections 2024-09-10T22:27:45.882 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:45.664+0000 7f14f58d3740 1 -- 172.21.15.19:0/4080178614 wait complete. 2024-09-10T22:27:45.882 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:45.665+0000 7f14f58d3740 1 -- start start 2024-09-10T22:27:45.882 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:45.665+0000 7f14f58d3740 1 Processor -- start 2024-09-10T22:27:45.882 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:45.665+0000 7f14f58d3740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55674a82d0f0 0x55674a839310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:27:45.882 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:45.665+0000 7f14f58d3740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55674a82da10 0x55674a836760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:27:45.882 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:45.665+0000 7f14f58d3740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55674a8399a0 0x55674a836de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:27:45.882 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:45.665+0000 7f14f58d3740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x55674a5f4700 con 0x55674a82da10 2024-09-10T22:27:45.883 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:45.665+0000 7f14f58d3740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55674a72e160 con 0x55674a8399a0 2024-09-10T22:27:45.883 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:45.665+0000 7f14f58d3740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x55674a83c440 con 0x55674a82d0f0 2024-09-10T22:27:45.883 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:45.665+0000 7f14f58d3740 10 client.0 _ll_register_callbacks cb 0x55674a7479e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T22:27:45.883 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:45.666+0000 7f14f0a99640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55674a82da10 0x55674a836760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:27:45.883 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:45.666+0000 7f14f1a9b640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55674a8399a0 0x55674a836de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:27:45.884 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:45.666+0000 7f14f129a640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55674a82d0f0 0x55674a839310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:27:45.884 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:45.666+0000 7f14f1a9b640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55674a8399a0 0x55674a836de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.19:41796/0 (socket says 172.21.15.19:41796) 2024-09-10T22:27:45.884 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:45.666+0000 7f14f129a640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55674a82d0f0 0x55674a839310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.19:42772/0 (socket says 172.21.15.19:42772) 2024-09-10T22:27:45.884 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:45.666+0000 7f14f1a9b640 1 -- 172.21.15.19:0/2100106186 learned_addr learned my addr 172.21.15.19:0/2100106186 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:27:45.884 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:45.666+0000 7f14f0a99640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55674a82da10 0x55674a836760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:55906/0 (socket says 172.21.15.19:55906) 2024-09-10T22:27:45.884 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:45.666+0000 7f14f1a9b640 1 -- 172.21.15.19:0/2100106186 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55674a82d0f0 msgr2=0x55674a839310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:27:45.884 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:45.666+0000 7f14f1a9b640 1 --2- 172.21.15.19:0/2100106186 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55674a82d0f0 0x55674a839310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:27:45.884 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:45.666+0000 7f14f1a9b640 1 -- 172.21.15.19:0/2100106186 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55674a82da10 msgr2=0x55674a836760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:27:45.884 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:45.666+0000 7f14f1a9b640 1 --2- 172.21.15.19:0/2100106186 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55674a82da10 0x55674a836760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:27:45.884 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:45.666+0000 7f14f1a9b640 1 -- 172.21.15.19:0/2100106186 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55674a75bc90 con 0x55674a8399a0 2024-09-10T22:27:45.884 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:45.666+0000 7f14f129a640 1 --2- 172.21.15.19:0/2100106186 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55674a82d0f0 0x55674a839310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T22:27:45.884 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:45.666+0000 7f14f1a9b640 1 --2- 172.21.15.19:0/2100106186 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55674a8399a0 0x55674a836de0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f14e402f500 tx=0x7f14e4009660 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1e2ac4519ad3164d server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:27:45.885 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:45.666+0000 7f14d4ff9640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-09-10T22:27:45.885 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:45.667+0000 7f14d4ff9640 1 -- 172.21.15.19:0/2100106186 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14e4031660 con 0x55674a8399a0 2024-09-10T22:27:45.885 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:45.667+0000 7f14d4ff9640 1 -- 172.21.15.19:0/2100106186 <== mon.2 v2:172.21.15.135:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8327+0+0 (secure 0 0 0) 0x7f14e4031800 con 0x55674a8399a0 2024-09-10T22:27:45.885 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:45.667+0000 7f14f58d3740 1 -- 172.21.15.19:0/2100106186 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f14e4036040 con 0x55674a8399a0 2024-09-10T22:27:45.885 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:45.667+0000 7f14d4ff9640 1 -- 172.21.15.19:0/2100106186 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f14e40040b0 con 0x55674a8399a0 2024-09-10T22:27:45.885 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:45.667+0000 7f14f58d3740 10 client.25232 fetch_fsmap learned FSMap version 26 2024-09-10T22:27:45.885 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:45.667+0000 7f14f58d3740 1 -- 172.21.15.19:0/2100106186 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x55674a847df0 con 0x55674a8399a0 2024-09-10T22:27:45.885 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:45.667+0000 7f14d4ff9640 1 -- 172.21.15.19:0/2100106186 <== mon.2 v2:172.21.15.135:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f14e4036040 con 0x55674a8399a0 2024-09-10T22:27:45.885 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:45.667+0000 7f14d4ff9640 1 -- 172.21.15.19:0/2100106186 <== mon.2 v2:172.21.15.135:3300/0 5 ==== fsmap(e 26) ==== 8350+0+0 (secure 0 0 0) 0x7f14e404f070 con 0x55674a8399a0 2024-09-10T22:27:45.885 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:45.667+0000 7f14f58d3740 10 client.25232 fetch_fsmap finished waiting for FSMap version 26 2024-09-10T22:27:45.885 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:45.667+0000 7f14f58d3740 10 client.25232 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-10T22:27:45.885 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:45.667+0000 7f14f58d3740 20 client.25232 populate_metadata read hostname 'smithi019' 2024-09-10T22:27:45.885 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:45.667+0000 7f14f58d3740 1 --2- 172.21.15.19:0/2100106186 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x55674a849140 0x55674a84b530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:27:45.886 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:45.667+0000 7f14f58d3740 4 client.25232 mds_command: new command op to 24581 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T22:27:45.886 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:45.667+0000 7f14f58d3740 1 -- 172.21.15.19:0/2100106186 --> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55674a7a5df0 con 0x55674a849140 2024-09-10T22:27:45.886 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:45.667+0000 7f14f129a640 1 --2- 172.21.15.19:0/2100106186 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x55674a849140 0x55674a84b530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:27:45.886 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:45.668+0000 7f14d4ff9640 10 client.25232 ms_handle_connect on v2:172.21.15.135:6838/1254769802 2024-09-10T22:27:45.886 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:45.668+0000 7f14f129a640 1 --2- 172.21.15.19:0/2100106186 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x55674a849140 0x55674a84b530 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=702e27960b9aeeac server_cookie=e662063dc18b04ba in_seq=0 out_seq=0 2024-09-10T22:27:45.886 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:45.668+0000 7f14d4ff9640 1 -- 172.21.15.19:0/2100106186 <== mds.0 v2:172.21.15.135:6838/1254769802 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55674a7a5df0 con 0x55674a849140 2024-09-10T22:27:45.886 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:45.668+0000 7f14d4ff9640 10 client.25232 handle_command_reply: tid=0 2024-09-10T22:27:45.886 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:45.668+0000 7f14f58d3740 1 client.25232 shutdown 2024-09-10T22:27:45.886 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:45.669+0000 7f14f58d3740 1 -- 172.21.15.19:0/2100106186 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55674a8399a0 msgr2=0x55674a836de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:27:45.886 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:45.669+0000 7f14f58d3740 1 --2- 172.21.15.19:0/2100106186 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55674a8399a0 0x55674a836de0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f14e402f500 tx=0x7f14e4009660 comp rx=0 tx=0).stop 2024-09-10T22:27:45.886 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:45.669+0000 7f14f58d3740 1 -- 172.21.15.19:0/2100106186 shutdown_connections 2024-09-10T22:27:45.886 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:45.669+0000 7f14f58d3740 1 --2- 172.21.15.19:0/2100106186 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55674a8399a0 0x55674a836de0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:27:45.887 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:45.669+0000 7f14f58d3740 1 --2- 172.21.15.19:0/2100106186 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55674a82da10 0x55674a836760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:27:45.887 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:45.669+0000 7f14f58d3740 1 --2- 172.21.15.19:0/2100106186 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x55674a849140 0x55674a84b530 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:27:45.887 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:45.669+0000 7f14f58d3740 1 --2- 172.21.15.19:0/2100106186 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55674a82d0f0 0x55674a839310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:27:45.887 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:45.669+0000 7f14d4ff9640 0 client.25232 ms_handle_reset on v2:172.21.15.135:6838/1254769802 2024-09-10T22:27:45.887 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:45.669+0000 7f14f58d3740 1 -- 172.21.15.19:0/2100106186 >> 172.21.15.19:0/2100106186 conn(0x55674a82af20 msgr2=0x55674a830ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:27:45.887 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:45.669+0000 7f14f58d3740 1 -- 172.21.15.19:0/2100106186 shutdown_connections 2024-09-10T22:27:45.887 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:45.669+0000 7f14f58d3740 1 -- 172.21.15.19:0/2100106186 wait complete. 2024-09-10T22:27:45.887 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:45.669+0000 7f14f58d3740 20 client.25232 trim_cache size 0 max 16384 2024-09-10T22:27:45.887 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:45.683+0000 7f14f58d3740 1 Processor -- start 2024-09-10T22:27:45.887 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:45.683+0000 7f14f58d3740 1 -- start start 2024-09-10T22:27:45.887 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:45.683+0000 7f14f58d3740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55674a82d0f0 0x55674a82c760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:27:45.887 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:45.683+0000 7f14f58d3740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55674a82da10 0x55674a845670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:27:45.887 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:45.683+0000 7f14f58d3740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55674a8399a0 0x55674a83ad90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:27:45.888 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:45.683+0000 7f14f58d3740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f14ec1b0d50 con 0x55674a8399a0 2024-09-10T22:27:45.888 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:45.683+0000 7f14f58d3740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f14ec1ae620 con 0x55674a82da10 2024-09-10T22:27:45.888 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:45.683+0000 7f14f58d3740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f14ec1ac470 con 0x55674a82d0f0 2024-09-10T22:27:45.888 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:45.684+0000 7f14f0a99640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55674a82da10 0x55674a845670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:27:45.888 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:45.684+0000 7f14f129a640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55674a82d0f0 0x55674a82c760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:27:45.888 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:45.684+0000 7f14f0a99640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55674a82da10 0x55674a845670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.19:41810/0 (socket says 172.21.15.19:41810) 2024-09-10T22:27:45.888 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:45.684+0000 7f14f0a99640 1 -- 172.21.15.19:0/1135344310 learned_addr learned my addr 172.21.15.19:0/1135344310 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:27:45.888 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:45.684+0000 7f14f1a9b640 1 --2- 172.21.15.19:0/1135344310 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55674a8399a0 0x55674a83ad90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:27:45.888 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:45.684+0000 7f14f129a640 1 -- 172.21.15.19:0/1135344310 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55674a82da10 msgr2=0x55674a845670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:27:45.888 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:45.684+0000 7f14f129a640 1 --2- 172.21.15.19:0/1135344310 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55674a82da10 0x55674a845670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:27:45.888 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:45.684+0000 7f14f129a640 1 -- 172.21.15.19:0/1135344310 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55674a8399a0 msgr2=0x55674a83ad90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:27:45.888 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:45.684+0000 7f14f129a640 1 --2- 172.21.15.19:0/1135344310 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55674a8399a0 0x55674a83ad90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:27:45.888 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:45.684+0000 7f14f129a640 1 -- 172.21.15.19:0/1135344310 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55674a82bc00 con 0x55674a82d0f0 2024-09-10T22:27:45.889 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:45.684+0000 7f14f0a99640 1 --2- 172.21.15.19:0/1135344310 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55674a82da10 0x55674a845670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T22:27:45.889 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:45.684+0000 7f14f129a640 1 --2- 172.21.15.19:0/1135344310 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55674a82d0f0 0x55674a82c760 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x55674a83c440 tx=0x7f14e8012f90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=25e9e6b426ab7638 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:27:45.889 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:45.685+0000 7f14d6ffd640 1 -- 172.21.15.19:0/1135344310 <== mon.1 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14e8005020 con 0x55674a82d0f0 2024-09-10T22:27:45.889 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:45.685+0000 7f14d6ffd640 1 -- 172.21.15.19:0/1135344310 <== mon.1 v2:172.21.15.138:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f14e80047a0 con 0x55674a82d0f0 2024-09-10T22:27:45.889 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:45.685+0000 7f14d6ffd640 1 -- 172.21.15.19:0/1135344310 <== mon.1 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14e802a720 con 0x55674a82d0f0 2024-09-10T22:27:45.889 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:45.685+0000 7f14f58d3740 1 -- 172.21.15.19:0/1135344310 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55674a82d0f0 msgr2=0x55674a82c760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:27:45.889 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:45.685+0000 7f14f58d3740 1 --2- 172.21.15.19:0/1135344310 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55674a82d0f0 0x55674a82c760 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x55674a83c440 tx=0x7f14e8012f90 comp rx=0 tx=0).stop 2024-09-10T22:27:45.889 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:45.686+0000 7f14f58d3740 1 -- 172.21.15.19:0/1135344310 shutdown_connections 2024-09-10T22:27:45.889 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:45.686+0000 7f14f58d3740 1 --2- 172.21.15.19:0/1135344310 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55674a8399a0 0x55674a83ad90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:27:45.889 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:45.686+0000 7f14f58d3740 1 --2- 172.21.15.19:0/1135344310 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55674a82da10 0x55674a845670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:27:45.889 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:45.686+0000 7f14f58d3740 1 --2- 172.21.15.19:0/1135344310 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55674a82d0f0 0x55674a82c760 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:27:45.889 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:45.686+0000 7f14f58d3740 1 -- 172.21.15.19:0/1135344310 >> 172.21.15.19:0/1135344310 conn(0x55674a82af20 msgr2=0x55674a82c050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:27:45.890 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:45.686+0000 7f14f58d3740 1 -- 172.21.15.19:0/1135344310 shutdown_connections 2024-09-10T22:27:45.890 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:45.686+0000 7f14f58d3740 1 -- 172.21.15.19:0/1135344310 wait complete. 2024-09-10T22:27:45.890 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:45.686+0000 7f14f58d3740 1 -- start start 2024-09-10T22:27:45.890 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:45.686+0000 7f14f58d3740 1 Processor -- start 2024-09-10T22:27:45.890 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:45.687+0000 7f14f58d3740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55674a82d0f0 0x55674a8416e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:27:45.890 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:45.687+0000 7f14f58d3740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55674a82da10 0x55674a841c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:27:45.890 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:45.687+0000 7f14f58d3740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55674a8399a0 0x55674a83c690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:27:45.890 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:45.687+0000 7f14f58d3740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f14ec1acae0 con 0x55674a82da10 2024-09-10T22:27:45.890 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:45.687+0000 7f14f58d3740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f14ec1adf50 con 0x55674a8399a0 2024-09-10T22:27:45.890 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:45.687+0000 7f14f58d3740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f14ec1ad1b0 con 0x55674a82d0f0 2024-09-10T22:27:45.890 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:45.687+0000 7f14f0a99640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55674a82da10 0x55674a841c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:27:45.890 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:45.687+0000 7f14f0a99640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55674a82da10 0x55674a841c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:55924/0 (socket says 172.21.15.19:55924) 2024-09-10T22:27:45.890 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:45.687+0000 7f14f0a99640 1 -- 172.21.15.19:0/1821472323 learned_addr learned my addr 172.21.15.19:0/1821472323 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:27:45.891 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:45.687+0000 7f14f58d3740 10 client.0 _ll_register_callbacks cb 0x7f14e8009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T22:27:45.891 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:45.687+0000 7f14f129a640 1 --2- 172.21.15.19:0/1821472323 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55674a82d0f0 0x55674a8416e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:27:45.891 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:45.687+0000 7f14f1a9b640 1 --2- 172.21.15.19:0/1821472323 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55674a8399a0 0x55674a83c690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:27:45.891 INFO:teuthology.orchestra.run.smithi019.stdout:[] 2024-09-10T22:27:45.892 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:45.688+0000 7f14f0a99640 1 -- 172.21.15.19:0/1821472323 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55674a82d0f0 msgr2=0x55674a8416e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:27:45.892 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:45.688+0000 7f14f0a99640 1 --2- 172.21.15.19:0/1821472323 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55674a82d0f0 0x55674a8416e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:27:45.892 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:45.688+0000 7f14f0a99640 1 -- 172.21.15.19:0/1821472323 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55674a8399a0 msgr2=0x55674a83c690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:27:45.892 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:45.688+0000 7f14f0a99640 1 --2- 172.21.15.19:0/1821472323 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55674a8399a0 0x55674a83c690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:27:45.892 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:45.688+0000 7f14f0a99640 1 -- 172.21.15.19:0/1821472323 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55674a83cbd0 con 0x55674a82da10 2024-09-10T22:27:45.892 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:45.688+0000 7f14f1a9b640 1 --2- 172.21.15.19:0/1821472323 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55674a8399a0 0x55674a83c690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T22:27:45.893 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:45.688+0000 7f14f0a99640 1 --2- 172.21.15.19:0/1821472323 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55674a82da10 0x55674a841c20 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f14dc0e3a10 tx=0x7f14dc0e6220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4fc29a4da3379b50 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:27:45.893 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:45.688+0000 7f14d4ff9640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-10T22:27:45.893 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:45.688+0000 7f14d4ff9640 1 -- 172.21.15.19:0/1821472323 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14dc0ac500 con 0x55674a82da10 2024-09-10T22:27:45.893 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:45.688+0000 7f14d4ff9640 1 -- 172.21.15.19:0/1821472323 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8327+0+0 (secure 0 0 0) 0x7f14dc0ab990 con 0x55674a82da10 2024-09-10T22:27:45.893 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:45.688+0000 7f14f58d3740 1 -- 172.21.15.19:0/1821472323 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f14e80047a0 con 0x55674a82da10 2024-09-10T22:27:45.893 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:45.689+0000 7f14d4ff9640 1 -- 172.21.15.19:0/1821472323 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f14dc0abea0 con 0x55674a82da10 2024-09-10T22:27:45.893 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:45.689+0000 7f14f58d3740 10 client.15636 fetch_fsmap learned FSMap version 26 2024-09-10T22:27:45.893 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:45.689+0000 7f14f58d3740 1 -- 172.21.15.19:0/1821472323 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x55674a8b6520 con 0x55674a82da10 2024-09-10T22:27:45.893 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:45.689+0000 7f14d4ff9640 1 -- 172.21.15.19:0/1821472323 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f14e80047a0 con 0x55674a82da10 2024-09-10T22:27:45.893 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:45.689+0000 7f14d4ff9640 1 -- 172.21.15.19:0/1821472323 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 26) ==== 8350+0+0 (secure 0 0 0) 0x7f14dc0a8080 con 0x55674a82da10 2024-09-10T22:27:45.893 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:45.689+0000 7f14f58d3740 10 client.15636 fetch_fsmap finished waiting for FSMap version 26 2024-09-10T22:27:45.894 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:45.689+0000 7f14f58d3740 10 client.15636 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-10T22:27:45.894 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:45.689+0000 7f14f58d3740 20 client.15636 populate_metadata read hostname 'smithi019' 2024-09-10T22:27:45.894 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:45.689+0000 7f14f58d3740 1 --2- 172.21.15.19:0/1821472323 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x55674a8b6c30 0x55674a8b9050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:27:45.894 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:45.689+0000 7f14f58d3740 4 client.15636 mds_command: new command op to 24581 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-10T22:27:45.894 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:45.689+0000 7f14f58d3740 1 -- 172.21.15.19:0/1821472323 --> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55674a7a18a0 con 0x55674a8b6c30 2024-09-10T22:27:45.894 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:45.689+0000 7f14f129a640 1 --2- 172.21.15.19:0/1821472323 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x55674a8b6c30 0x55674a8b9050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:27:45.894 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:45.690+0000 7f14d4ff9640 10 client.15636 ms_handle_connect on v2:172.21.15.135:6838/1254769802 2024-09-10T22:27:45.894 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:45.690+0000 7f14f129a640 1 --2- 172.21.15.19:0/1821472323 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x55674a8b6c30 0x55674a8b9050 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9bd91a3d2530f67 server_cookie=ad456eb89dbd29c1 in_seq=0 out_seq=0 2024-09-10T22:27:45.894 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:45.690+0000 7f14d4ff9640 1 -- 172.21.15.19:0/1821472323 <== mds.0 v2:172.21.15.135:6838/1254769802 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55674a7a18a0 con 0x55674a8b6c30 2024-09-10T22:27:45.894 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:45.691+0000 7f14d4ff9640 10 client.15636 handle_command_reply: tid=0 2024-09-10T22:27:45.894 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:45.691+0000 7f14f58d3740 1 client.15636 shutdown 2024-09-10T22:27:45.894 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:45.691+0000 7f14f58d3740 1 -- 172.21.15.19:0/1821472323 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55674a82da10 msgr2=0x55674a841c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:27:45.895 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:45.691+0000 7f14f58d3740 1 --2- 172.21.15.19:0/1821472323 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55674a82da10 0x55674a841c20 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f14dc0e3a10 tx=0x7f14dc0e6220 comp rx=0 tx=0).stop 2024-09-10T22:27:45.895 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:45.691+0000 7f14f58d3740 1 -- 172.21.15.19:0/1821472323 shutdown_connections 2024-09-10T22:27:45.895 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:45.691+0000 7f14f58d3740 1 --2- 172.21.15.19:0/1821472323 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55674a8399a0 0x55674a83c690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:27:45.895 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:45.691+0000 7f14f58d3740 1 --2- 172.21.15.19:0/1821472323 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55674a82da10 0x55674a841c20 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:27:45.895 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:45.691+0000 7f14f58d3740 1 --2- 172.21.15.19:0/1821472323 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x55674a8b6c30 0x55674a8b9050 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:27:45.895 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:45.691+0000 7f14d4ff9640 0 client.15636 ms_handle_reset on v2:172.21.15.135:6838/1254769802 2024-09-10T22:27:45.895 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:45.691+0000 7f14f58d3740 1 --2- 172.21.15.19:0/1821472323 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55674a82d0f0 0x55674a8416e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:27:45.895 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:45.691+0000 7f14f58d3740 1 -- 172.21.15.19:0/1821472323 >> 172.21.15.19:0/1821472323 conn(0x55674a82af20 msgr2=0x55674a829750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:27:45.895 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:45.691+0000 7f14f58d3740 1 -- 172.21.15.19:0/1821472323 shutdown_connections 2024-09-10T22:27:45.895 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:45.691+0000 7f14f58d3740 1 -- 172.21.15.19:0/1821472323 wait complete. 2024-09-10T22:27:45.895 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:45.691+0000 7f14f58d3740 20 client.15636 trim_cache size 0 max 16384 2024-09-10T22:27:45.895 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:45.692+0000 7f14f34fe640 1 -- 172.21.15.19:0/697838914 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f14d80b52e0 msgr2=0x7f14d80b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:27:45.895 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:45.692+0000 7f14f34fe640 1 --2- 172.21.15.19:0/697838914 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f14d80b52e0 0x7f14d80b77a0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x55674a82be00 tx=0x7f14e8005f90 comp rx=0 tx=0).stop 2024-09-10T22:27:45.896 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:45.692+0000 7f14f34fe640 1 -- 172.21.15.19:0/697838914 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f14ec1045b0 msgr2=0x7f14ec1997d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:27:45.896 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:45.692+0000 7f14f34fe640 1 --2- 172.21.15.19:0/697838914 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f14ec1045b0 0x7f14ec1997d0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f14dc00e9f0 tx=0x7f14dc00eeb0 comp rx=0 tx=0).stop 2024-09-10T22:27:45.896 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:45.692+0000 7f14f34fe640 1 -- 172.21.15.19:0/697838914 shutdown_connections 2024-09-10T22:27:45.896 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:45.692+0000 7f14f34fe640 1 --2- 172.21.15.19:0/697838914 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f14d80b52e0 0x7f14d80b77a0 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:27:45.896 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:45.692+0000 7f14f34fe640 1 --2- 172.21.15.19:0/697838914 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f14ec10d160 0x7f14ec19eb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:27:45.896 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:45.692+0000 7f14f34fe640 1 --2- 172.21.15.19:0/697838914 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f14ec1045b0 0x7f14ec1997d0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:27:45.896 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:45.692+0000 7f14f34fe640 1 --2- 172.21.15.19:0/697838914 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f14ec103bb0 0x7f14ec199290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:27:45.896 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:45.692+0000 7f14f34fe640 1 -- 172.21.15.19:0/697838914 >> 172.21.15.19:0/697838914 conn(0x7f14ec0fd7c0 msgr2=0x7f14ec0fe3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:27:45.896 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:45.692+0000 7f14f34fe640 1 -- 172.21.15.19:0/697838914 shutdown_connections 2024-09-10T22:27:45.896 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:45.692+0000 7f14f34fe640 1 -- 172.21.15.19:0/697838914 wait complete. 2024-09-10T22:27:46.110 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:27:45 smithi135 ceph-mon[34789]: pgmap v387: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 563 MiB/s wr, 641 op/s 2024-09-10T22:27:46.625 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:27:45 smithi138 ceph-mon[35236]: pgmap v387: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 563 MiB/s wr, 641 op/s 2024-09-10T22:27:47.962 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-10T22:27:47.963 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 22997a4c-6fc2-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-10T22:27:48.110 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:27:47 smithi135 ceph-mon[34789]: pgmap v388: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 986 KiB/s rd, 589 MiB/s wr, 627 op/s 2024-09-10T22:27:48.125 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:27:47 smithi138 ceph-mon[35236]: pgmap v388: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 986 KiB/s rd, 589 MiB/s wr, 627 op/s 2024-09-10T22:27:48.208 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:27:47 smithi019 ceph-mon[31375]: pgmap v388: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 986 KiB/s rd, 589 MiB/s wr, 627 op/s 2024-09-10T22:27:48.390 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/22997a4c-6fc2-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T22:27:49.383 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:49.350+0000 7f8a43753640 1 -- 172.21.15.19:0/2363240737 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8a3c103ca0 msgr2=0x7f8a3c104080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:27:49.383 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:49.350+0000 7f8a43753640 1 --2- 172.21.15.19:0/2363240737 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8a3c103ca0 0x7f8a3c104080 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f8a38009900 tx=0x7f8a3802a410 comp rx=0 tx=0).stop 2024-09-10T22:27:49.383 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:49.350+0000 7f8a43753640 1 -- 172.21.15.19:0/2363240737 shutdown_connections 2024-09-10T22:27:49.383 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:49.350+0000 7f8a43753640 1 --2- 172.21.15.19:0/2363240737 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8a3c10d100 0x7f8a3c10f560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:27:49.383 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:49.350+0000 7f8a43753640 1 --2- 172.21.15.19:0/2363240737 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f8a3c1045c0 0x7f8a3c10cab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:27:49.383 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:49.350+0000 7f8a43753640 1 --2- 172.21.15.19:0/2363240737 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8a3c103ca0 0x7f8a3c104080 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:27:49.384 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:49.350+0000 7f8a43753640 1 -- 172.21.15.19:0/2363240737 >> 172.21.15.19:0/2363240737 conn(0x7f8a3c0fd700 msgr2=0x7f8a3c0ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:27:49.384 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:49.350+0000 7f8a43753640 1 -- 172.21.15.19:0/2363240737 shutdown_connections 2024-09-10T22:27:49.384 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:49.350+0000 7f8a43753640 1 -- 172.21.15.19:0/2363240737 wait complete. 2024-09-10T22:27:49.384 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:49.351+0000 7f8a43753640 1 Processor -- start 2024-09-10T22:27:49.384 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:49.351+0000 7f8a43753640 1 -- start start 2024-09-10T22:27:49.384 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:49.351+0000 7f8a43753640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8a3c103ca0 0x7f8a3c199290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:27:49.384 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:49.351+0000 7f8a43753640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8a3c1045c0 0x7f8a3c1997d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:27:49.384 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:49.351+0000 7f8a43753640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f8a3c10d100 0x7f8a3c19eb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:27:49.384 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:49.351+0000 7f8a43753640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f8a3c112dc0 con 0x7f8a3c1045c0 2024-09-10T22:27:49.384 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:49.351+0000 7f8a43753640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f8a3c112c40 con 0x7f8a3c103ca0 2024-09-10T22:27:49.384 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:49.351+0000 7f8a43753640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f8a3c112f40 con 0x7f8a3c10d100 2024-09-10T22:27:49.384 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:49.351+0000 7f8a40cee640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8a3c1045c0 0x7f8a3c1997d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:27:49.385 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:49.351+0000 7f8a414ef640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8a3c103ca0 0x7f8a3c199290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:27:49.385 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:49.351+0000 7f8a40cee640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8a3c1045c0 0x7f8a3c1997d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:55948/0 (socket says 172.21.15.19:55948) 2024-09-10T22:27:49.385 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:49.351+0000 7f8a40cee640 1 -- 172.21.15.19:0/415869311 learned_addr learned my addr 172.21.15.19:0/415869311 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:27:49.385 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:49.352+0000 7f8a41cf0640 1 --2- 172.21.15.19:0/415869311 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f8a3c10d100 0x7f8a3c19eb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:27:49.385 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:49.352+0000 7f8a40cee640 1 -- 172.21.15.19:0/415869311 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f8a3c10d100 msgr2=0x7f8a3c19eb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:27:49.385 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:49.352+0000 7f8a40cee640 1 --2- 172.21.15.19:0/415869311 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f8a3c10d100 0x7f8a3c19eb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:27:49.385 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:49.352+0000 7f8a40cee640 1 -- 172.21.15.19:0/415869311 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8a3c103ca0 msgr2=0x7f8a3c199290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:27:49.385 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:49.352+0000 7f8a40cee640 1 --2- 172.21.15.19:0/415869311 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8a3c103ca0 0x7f8a3c199290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:27:49.385 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:49.352+0000 7f8a40cee640 1 -- 172.21.15.19:0/415869311 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8a3c19f340 con 0x7f8a3c1045c0 2024-09-10T22:27:49.385 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:49.352+0000 7f8a414ef640 1 --2- 172.21.15.19:0/415869311 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8a3c103ca0 0x7f8a3c199290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T22:27:49.386 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:49.352+0000 7f8a40cee640 1 --2- 172.21.15.19:0/415869311 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8a3c1045c0 0x7f8a3c1997d0 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f8a2c00e9c0 tx=0x7f8a2c00ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:27:49.386 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:49.352+0000 7f8a327fc640 1 -- 172.21.15.19:0/415869311 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a2c00ccc0 con 0x7f8a3c1045c0 2024-09-10T22:27:49.386 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:49.352+0000 7f8a43753640 1 -- 172.21.15.19:0/415869311 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8a3c19f630 con 0x7f8a3c1045c0 2024-09-10T22:27:49.386 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:49.352+0000 7f8a327fc640 1 -- 172.21.15.19:0/415869311 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8a2c0035f0 con 0x7f8a3c1045c0 2024-09-10T22:27:49.386 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:49.352+0000 7f8a43753640 1 -- 172.21.15.19:0/415869311 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8a3c101a00 con 0x7f8a3c1045c0 2024-09-10T22:27:49.386 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:49.352+0000 7f8a327fc640 1 -- 172.21.15.19:0/415869311 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a2c00ce60 con 0x7f8a3c1045c0 2024-09-10T22:27:49.386 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:49.355+0000 7f8a327fc640 1 -- 172.21.15.19:0/415869311 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 18) ==== 153250+0+0 (secure 0 0 0) 0x7f8a2c021430 con 0x7f8a3c1045c0 2024-09-10T22:27:49.386 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:49.356+0000 7f8a45b28740 1 Processor -- start 2024-09-10T22:27:49.386 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:49.356+0000 7f8a45b28740 1 -- start start 2024-09-10T22:27:49.386 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:49.356+0000 7f8a45b28740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x556ff9c1eee0 0x556ff9c1f2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:27:49.387 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:49.356+0000 7f8a45b28740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x556ff9c1f800 0x556ff9c2b250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:27:49.387 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:49.356+0000 7f8a45b28740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556ff9c2b790 0x556ff9c2db80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:27:49.387 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:49.356+0000 7f8a45b28740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x556ff9b95e60 con 0x556ff9c1f800 2024-09-10T22:27:49.387 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:49.356+0000 7f8a45b28740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x556ff9b85290 con 0x556ff9c2b790 2024-09-10T22:27:49.387 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:49.356+0000 7f8a45b28740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x556ff9b890a0 con 0x556ff9c1eee0 2024-09-10T22:27:49.387 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:49.356+0000 7f8a40cee640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556ff9c2b790 0x556ff9c2db80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:27:49.387 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:49.356+0000 7f8a414ef640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x556ff9c1f800 0x556ff9c2b250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:27:49.387 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:49.356+0000 7f8a41cf0640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x556ff9c1eee0 0x556ff9c1f2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:27:49.387 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:49.356+0000 7f8a40cee640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556ff9c2b790 0x556ff9c2db80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.19:41846/0 (socket says 172.21.15.19:41846) 2024-09-10T22:27:49.388 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:49.356+0000 7f8a40cee640 1 -- 172.21.15.19:0/3268950132 learned_addr learned my addr 172.21.15.19:0/3268950132 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:27:49.388 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:49.357+0000 7f8a40cee640 1 -- 172.21.15.19:0/3268950132 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x556ff9c1eee0 msgr2=0x556ff9c1f2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:27:49.388 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:49.357+0000 7f8a40cee640 1 --2- 172.21.15.19:0/3268950132 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x556ff9c1eee0 0x556ff9c1f2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:27:49.388 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:49.357+0000 7f8a40cee640 1 -- 172.21.15.19:0/3268950132 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x556ff9c1f800 msgr2=0x556ff9c2b250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:27:49.388 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:49.357+0000 7f8a40cee640 1 --2- 172.21.15.19:0/3268950132 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x556ff9c1f800 0x556ff9c2b250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:27:49.388 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:49.357+0000 7f8a40cee640 1 -- 172.21.15.19:0/3268950132 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556ff98e3930 con 0x556ff9c2b790 2024-09-10T22:27:49.388 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:49.357+0000 7f8a40cee640 1 --2- 172.21.15.19:0/3268950132 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556ff9c2b790 0x556ff9c2db80 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f8a2c0e9c10 tx=0x7f8a2c0ee6d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4ad34d0fc187ddd server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:27:49.388 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:49.357+0000 7f8a277fe640 1 -- 172.21.15.19:0/3268950132 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a2c0f5070 con 0x556ff9c2b790 2024-09-10T22:27:49.388 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:49.357+0000 7f8a277fe640 1 -- 172.21.15.19:0/3268950132 <== mon.2 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8a2c0f1b30 con 0x556ff9c2b790 2024-09-10T22:27:49.388 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:49.357+0000 7f8a327fc640 1 --2- 172.21.15.19:0/415869311 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f8a280b5360 0x7f8a280b7820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:27:49.388 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:49.357+0000 7f8a277fe640 1 -- 172.21.15.19:0/3268950132 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a2c0f0aa0 con 0x556ff9c2b790 2024-09-10T22:27:49.388 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:49.357+0000 7f8a41cf0640 1 --2- 172.21.15.19:0/415869311 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f8a280b5360 0x7f8a280b7820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:27:49.389 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:49.358+0000 7f8a327fc640 1 -- 172.21.15.19:0/415869311 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8327+0+0 (secure 0 0 0) 0x7f8a2c0e5c00 con 0x7f8a3c1045c0 2024-09-10T22:27:49.389 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:49.358+0000 7f8a45b28740 1 -- 172.21.15.19:0/3268950132 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556ff9c2b790 msgr2=0x556ff9c2db80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:27:49.389 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:49.358+0000 7f8a45b28740 1 --2- 172.21.15.19:0/3268950132 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556ff9c2b790 0x556ff9c2db80 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f8a2c0e9c10 tx=0x7f8a2c0ee6d0 comp rx=0 tx=0).stop 2024-09-10T22:27:49.389 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:49.358+0000 7f8a41cf0640 1 --2- 172.21.15.19:0/415869311 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f8a280b5360 0x7f8a280b7820 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f8a34005fd0 tx=0x7f8a34009500 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:27:49.389 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:49.358+0000 7f8a45b28740 1 -- 172.21.15.19:0/3268950132 shutdown_connections 2024-09-10T22:27:49.389 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:49.358+0000 7f8a45b28740 1 --2- 172.21.15.19:0/3268950132 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556ff9c2b790 0x556ff9c2db80 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:27:49.389 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:49.358+0000 7f8a45b28740 1 --2- 172.21.15.19:0/3268950132 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x556ff9c1f800 0x556ff9c2b250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:27:49.389 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:49.358+0000 7f8a45b28740 1 --2- 172.21.15.19:0/3268950132 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x556ff9c1eee0 0x556ff9c1f2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:27:49.389 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:49.358+0000 7f8a45b28740 1 -- 172.21.15.19:0/3268950132 >> 172.21.15.19:0/3268950132 conn(0x556ff9c1cd10 msgr2=0x556ff9c1deb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:27:49.389 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:49.358+0000 7f8a45b28740 1 -- 172.21.15.19:0/3268950132 shutdown_connections 2024-09-10T22:27:49.389 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:49.358+0000 7f8a45b28740 1 -- 172.21.15.19:0/3268950132 wait complete. 2024-09-10T22:27:49.389 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:49.359+0000 7f8a45b28740 1 -- start start 2024-09-10T22:27:49.389 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:49.359+0000 7f8a45b28740 1 Processor -- start 2024-09-10T22:27:49.390 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:49.360+0000 7f8a45b28740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556ff9c1eee0 0x556ff9c286e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:27:49.390 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:49.360+0000 7f8a45b28740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x556ff9c1f800 0x556ff9c28c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:27:49.390 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:49.360+0000 7f8a45b28740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x556ff9c2b790 0x556ff9c29160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:27:49.390 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:49.360+0000 7f8a45b28740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x556ff99e6890 con 0x556ff9c2b790 2024-09-10T22:27:49.390 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:49.360+0000 7f8a45b28740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x556ff9b1fd40 con 0x556ff9c1eee0 2024-09-10T22:27:49.390 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:49.360+0000 7f8a45b28740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x556ff9c2e440 con 0x556ff9c1f800 2024-09-10T22:27:49.390 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:49.360+0000 7f8a45b28740 10 client.0 _ll_register_callbacks cb 0x556ff9b83c80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T22:27:49.390 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:49.360+0000 7f8a414ef640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556ff9c1eee0 0x556ff9c286e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:27:49.390 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:49.360+0000 7f8a40cee640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x556ff9c1f800 0x556ff9c28c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:27:49.390 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:49.360+0000 7f8a41cf0640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x556ff9c2b790 0x556ff9c29160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:27:49.390 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:49.360+0000 7f8a414ef640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556ff9c1eee0 0x556ff9c286e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.19:41850/0 (socket says 172.21.15.19:41850) 2024-09-10T22:27:49.390 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:49.360+0000 7f8a40cee640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x556ff9c1f800 0x556ff9c28c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.19:42818/0 (socket says 172.21.15.19:42818) 2024-09-10T22:27:49.391 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:49.360+0000 7f8a414ef640 1 -- 172.21.15.19:0/1158589148 learned_addr learned my addr 172.21.15.19:0/1158589148 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:27:49.391 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:49.360+0000 7f8a40cee640 1 -- 172.21.15.19:0/1158589148 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556ff9c1eee0 msgr2=0x556ff9c286e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:27:49.391 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:49.360+0000 7f8a40cee640 1 --2- 172.21.15.19:0/1158589148 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556ff9c1eee0 0x556ff9c286e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:27:49.391 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:49.360+0000 7f8a40cee640 1 -- 172.21.15.19:0/1158589148 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x556ff9c2b790 msgr2=0x556ff9c29160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:27:49.391 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:49.360+0000 7f8a40cee640 1 --2- 172.21.15.19:0/1158589148 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x556ff9c2b790 0x556ff9c29160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:27:49.391 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:49.360+0000 7f8a40cee640 1 -- 172.21.15.19:0/1158589148 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556ff9c37800 con 0x556ff9c1f800 2024-09-10T22:27:49.391 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:49.361+0000 7f8a40cee640 1 --2- 172.21.15.19:0/1158589148 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x556ff9c1f800 0x556ff9c28c20 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f8a2c00c6a0 tx=0x7f8a2c0f0560 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5a012e2f1efb0b27 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:27:49.391 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:49.361+0000 7f8a24ff9640 10 client.0 ms_handle_connect on v2:172.21.15.138:3300/0 2024-09-10T22:27:49.391 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:49.361+0000 7f8a24ff9640 1 -- 172.21.15.19:0/1158589148 <== mon.1 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a2c0f5060 con 0x556ff9c1f800 2024-09-10T22:27:49.391 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:49.361+0000 7f8a24ff9640 1 -- 172.21.15.19:0/1158589148 <== mon.1 v2:172.21.15.138:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8327+0+0 (secure 0 0 0) 0x7f8a2c0ac7c0 con 0x556ff9c1f800 2024-09-10T22:27:49.391 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:49.361+0000 7f8a45b28740 1 -- 172.21.15.19:0/1158589148 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8a2c0f1b30 con 0x556ff9c1f800 2024-09-10T22:27:49.391 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:49.361+0000 7f8a24ff9640 1 -- 172.21.15.19:0/1158589148 <== mon.1 v2:172.21.15.138:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f8a2c0a89b0 con 0x556ff9c1f800 2024-09-10T22:27:49.392 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:49.361+0000 7f8a45b28740 10 client.25210 fetch_fsmap learned FSMap version 26 2024-09-10T22:27:49.392 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:49.361+0000 7f8a45b28740 1 -- 172.21.15.19:0/1158589148 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x556ff9c3a1b0 con 0x556ff9c1f800 2024-09-10T22:27:49.392 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:49.361+0000 7f8a24ff9640 1 -- 172.21.15.19:0/1158589148 <== mon.1 v2:172.21.15.138:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8a2c0f1b30 con 0x556ff9c1f800 2024-09-10T22:27:49.392 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:49.361+0000 7f8a24ff9640 1 -- 172.21.15.19:0/1158589148 <== mon.1 v2:172.21.15.138:3300/0 5 ==== fsmap(e 26) ==== 8350+0+0 (secure 0 0 0) 0x7f8a2c0f1ce0 con 0x556ff9c1f800 2024-09-10T22:27:49.392 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:49.361+0000 7f8a45b28740 10 client.25210 fetch_fsmap finished waiting for FSMap version 26 2024-09-10T22:27:49.392 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:49.361+0000 7f8a45b28740 10 client.25210 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-10T22:27:49.392 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:49.361+0000 7f8a45b28740 20 client.25210 populate_metadata read hostname 'smithi019' 2024-09-10T22:27:49.392 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:49.361+0000 7f8a45b28740 1 --2- 172.21.15.19:0/1158589148 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x556ff9c3b500 0x556ff9c3d8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:27:49.392 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:49.361+0000 7f8a45b28740 4 client.25210 mds_command: new command op to 24581 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T22:27:49.392 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:49.361+0000 7f8a45b28740 1 -- 172.21.15.19:0/1158589148 --> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x556ff9b97db0 con 0x556ff9c3b500 2024-09-10T22:27:49.392 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:49.362+0000 7f8a414ef640 1 --2- 172.21.15.19:0/1158589148 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x556ff9c3b500 0x556ff9c3d8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:27:49.392 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:49.362+0000 7f8a414ef640 1 --2- 172.21.15.19:0/1158589148 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x556ff9c3b500 0x556ff9c3d8f0 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3943d84c454c69a7 server_cookie=21edba1574f12f2b in_seq=0 out_seq=0 2024-09-10T22:27:49.393 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:49.362+0000 7f8a24ff9640 10 client.25210 ms_handle_connect on v2:172.21.15.135:6838/1254769802 2024-09-10T22:27:49.393 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:49.363+0000 7f8a24ff9640 1 -- 172.21.15.19:0/1158589148 <== mds.0 v2:172.21.15.135:6838/1254769802 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x556ff9b97db0 con 0x556ff9c3b500 2024-09-10T22:27:49.393 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:49.363+0000 7f8a24ff9640 10 client.25210 handle_command_reply: tid=0 2024-09-10T22:27:49.393 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:49.363+0000 7f8a45b28740 1 client.25210 shutdown 2024-09-10T22:27:49.393 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:49.363+0000 7f8a45b28740 1 -- 172.21.15.19:0/1158589148 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x556ff9c1f800 msgr2=0x556ff9c28c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:27:49.393 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:49.363+0000 7f8a45b28740 1 --2- 172.21.15.19:0/1158589148 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x556ff9c1f800 0x556ff9c28c20 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f8a2c00c6a0 tx=0x7f8a2c0f0560 comp rx=0 tx=0).stop 2024-09-10T22:27:49.393 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:49.363+0000 7f8a45b28740 1 -- 172.21.15.19:0/1158589148 shutdown_connections 2024-09-10T22:27:49.393 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:49.363+0000 7f8a45b28740 1 --2- 172.21.15.19:0/1158589148 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x556ff9c2b790 0x556ff9c29160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:27:49.393 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:49.363+0000 7f8a45b28740 1 --2- 172.21.15.19:0/1158589148 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x556ff9c3b500 0x556ff9c3d8f0 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:27:49.393 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:49.363+0000 7f8a24ff9640 0 client.25210 ms_handle_reset on v2:172.21.15.135:6838/1254769802 2024-09-10T22:27:49.393 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:49.363+0000 7f8a45b28740 1 --2- 172.21.15.19:0/1158589148 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x556ff9c1f800 0x556ff9c28c20 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:27:49.393 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:49.363+0000 7f8a45b28740 1 --2- 172.21.15.19:0/1158589148 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556ff9c1eee0 0x556ff9c286e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:27:49.394 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:49.363+0000 7f8a45b28740 1 -- 172.21.15.19:0/1158589148 >> 172.21.15.19:0/1158589148 conn(0x556ff9c1cd10 msgr2=0x556ff9c1bf70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:27:49.394 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:49.364+0000 7f8a45b28740 1 -- 172.21.15.19:0/1158589148 shutdown_connections 2024-09-10T22:27:49.394 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:49.364+0000 7f8a45b28740 1 -- 172.21.15.19:0/1158589148 wait complete. 2024-09-10T22:27:49.394 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:49.364+0000 7f8a45b28740 20 client.25210 trim_cache size 0 max 16384 2024-09-10T22:27:49.398 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:49.384+0000 7f8a45b28740 1 Processor -- start 2024-09-10T22:27:49.399 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:49.385+0000 7f8a45b28740 1 -- start start 2024-09-10T22:27:49.399 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:49.385+0000 7f8a45b28740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x556ff9c1eee0 0x556ff9c258f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:27:49.399 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:49.385+0000 7f8a45b28740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556ff9c1f800 0x556ff9c25e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:27:49.399 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:49.385+0000 7f8a45b28740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x556ff9c2b790 0x556ff9c40920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:27:49.399 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:49.385+0000 7f8a45b28740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f8a20010e10 con 0x556ff9c1eee0 2024-09-10T22:27:49.399 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:49.385+0000 7f8a45b28740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f8a2000e6e0 con 0x556ff9c1f800 2024-09-10T22:27:49.399 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:49.385+0000 7f8a45b28740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f8a2000c530 con 0x556ff9c2b790 2024-09-10T22:27:49.399 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:49.385+0000 7f8a41cf0640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x556ff9c2b790 0x556ff9c40920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:27:49.399 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:49.385+0000 7f8a40cee640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556ff9c1f800 0x556ff9c25e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:27:49.399 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:49.385+0000 7f8a41cf0640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x556ff9c2b790 0x556ff9c40920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.19:42828/0 (socket says 172.21.15.19:42828) 2024-09-10T22:27:49.399 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:49.385+0000 7f8a41cf0640 1 -- 172.21.15.19:0/1554432918 learned_addr learned my addr 172.21.15.19:0/1554432918 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:27:49.399 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:49.386+0000 7f8a41cf0640 1 -- 172.21.15.19:0/1554432918 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556ff9c1f800 msgr2=0x556ff9c25e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:27:49.400 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:49.386+0000 7f8a414ef640 1 --2- 172.21.15.19:0/1554432918 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x556ff9c1eee0 0x556ff9c258f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:27:49.400 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:49.386+0000 7f8a41cf0640 1 --2- 172.21.15.19:0/1554432918 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556ff9c1f800 0x556ff9c25e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:27:49.400 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:49.386+0000 7f8a41cf0640 1 -- 172.21.15.19:0/1554432918 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x556ff9c1eee0 msgr2=0x556ff9c258f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:27:49.400 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:49.386+0000 7f8a41cf0640 1 --2- 172.21.15.19:0/1554432918 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x556ff9c1eee0 0x556ff9c258f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:27:49.400 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:49.386+0000 7f8a41cf0640 1 -- 172.21.15.19:0/1554432918 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556ff9c1d790 con 0x556ff9c2b790 2024-09-10T22:27:49.400 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:49.386+0000 7f8a40cee640 1 --2- 172.21.15.19:0/1554432918 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556ff9c1f800 0x556ff9c25e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T22:27:49.400 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:49.386+0000 7f8a414ef640 1 --2- 172.21.15.19:0/1554432918 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x556ff9c1eee0 0x556ff9c258f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T22:27:49.400 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:49.386+0000 7f8a41cf0640 1 --2- 172.21.15.19:0/1554432918 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x556ff9c2b790 0x556ff9c40920 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f8a34003f00 tx=0x7f8a3401a000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=84bf070c1fd5c2e server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:27:49.400 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:49.387+0000 7f8a26ffd640 1 -- 172.21.15.19:0/1554432918 <== mon.1 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a3402d070 con 0x556ff9c2b790 2024-09-10T22:27:49.401 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:49.387+0000 7f8a26ffd640 1 -- 172.21.15.19:0/1554432918 <== mon.1 v2:172.21.15.138:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8a3400fb10 con 0x556ff9c2b790 2024-09-10T22:27:49.401 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:49.387+0000 7f8a26ffd640 1 -- 172.21.15.19:0/1554432918 <== mon.1 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a3401dc60 con 0x556ff9c2b790 2024-09-10T22:27:49.401 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:49.388+0000 7f8a45b28740 1 -- 172.21.15.19:0/1554432918 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x556ff9c2b790 msgr2=0x556ff9c40920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:27:49.401 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:49.388+0000 7f8a45b28740 1 --2- 172.21.15.19:0/1554432918 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x556ff9c2b790 0x556ff9c40920 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f8a34003f00 tx=0x7f8a3401a000 comp rx=0 tx=0).stop 2024-09-10T22:27:49.401 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:49.388+0000 7f8a45b28740 1 -- 172.21.15.19:0/1554432918 shutdown_connections 2024-09-10T22:27:49.401 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:49.388+0000 7f8a45b28740 1 --2- 172.21.15.19:0/1554432918 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x556ff9c2b790 0x556ff9c40920 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:27:49.401 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:49.388+0000 7f8a45b28740 1 --2- 172.21.15.19:0/1554432918 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556ff9c1f800 0x556ff9c25e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:27:49.401 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:49.388+0000 7f8a45b28740 1 --2- 172.21.15.19:0/1554432918 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x556ff9c1eee0 0x556ff9c258f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:27:49.401 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:49.388+0000 7f8a45b28740 1 -- 172.21.15.19:0/1554432918 >> 172.21.15.19:0/1554432918 conn(0x556ff9c1cd10 msgr2=0x556ff9c36f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:27:49.401 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:49.388+0000 7f8a45b28740 1 -- 172.21.15.19:0/1554432918 shutdown_connections 2024-09-10T22:27:49.401 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:49.388+0000 7f8a45b28740 1 -- 172.21.15.19:0/1554432918 wait complete. 2024-09-10T22:27:49.401 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:49.388+0000 7f8a45b28740 1 -- start start 2024-09-10T22:27:49.401 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:49.388+0000 7f8a45b28740 1 Processor -- start 2024-09-10T22:27:49.402 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:49.389+0000 7f8a45b28740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x556ff9c1eee0 0x556ff9c9c1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:27:49.402 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:49.389+0000 7f8a45b28740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556ff9c1f800 0x556ff9c9c760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:27:49.402 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:49.389+0000 7f8a45b28740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x556ff9c2b790 0x556ff9c9e100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:27:49.402 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:49.389+0000 7f8a45b28740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f8a2000cba0 con 0x556ff9c1eee0 2024-09-10T22:27:49.402 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:49.389+0000 7f8a45b28740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f8a2000e010 con 0x556ff9c1f800 2024-09-10T22:27:49.402 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:49.389+0000 7f8a45b28740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f8a2000d270 con 0x556ff9c2b790 2024-09-10T22:27:49.402 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:49.389+0000 7f8a414ef640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x556ff9c1eee0 0x556ff9c9c1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:27:49.402 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:49.389+0000 7f8a414ef640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x556ff9c1eee0 0x556ff9c9c1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:55990/0 (socket says 172.21.15.19:55990) 2024-09-10T22:27:49.402 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:49.389+0000 7f8a414ef640 1 -- 172.21.15.19:0/172551048 learned_addr learned my addr 172.21.15.19:0/172551048 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:27:49.402 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:49.389+0000 7f8a40cee640 1 --2- 172.21.15.19:0/172551048 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556ff9c1f800 0x556ff9c9c760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:27:49.402 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:49.390+0000 7f8a41cf0640 1 --2- 172.21.15.19:0/172551048 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x556ff9c2b790 0x556ff9c9e100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:27:49.402 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:49.390+0000 7f8a40cee640 1 -- 172.21.15.19:0/172551048 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x556ff9c2b790 msgr2=0x556ff9c9e100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:27:49.402 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:49.390+0000 7f8a40cee640 1 --2- 172.21.15.19:0/172551048 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x556ff9c2b790 0x556ff9c9e100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:27:49.403 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:49.390+0000 7f8a40cee640 1 -- 172.21.15.19:0/172551048 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x556ff9c1eee0 msgr2=0x556ff9c9c1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:27:49.403 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:49.390+0000 7f8a40cee640 1 --2- 172.21.15.19:0/172551048 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x556ff9c1eee0 0x556ff9c9c1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:27:49.403 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:49.390+0000 7f8a40cee640 1 -- 172.21.15.19:0/172551048 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556ff9c9e810 con 0x556ff9c1f800 2024-09-10T22:27:49.403 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:49.390+0000 7f8a414ef640 1 --2- 172.21.15.19:0/172551048 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x556ff9c1eee0 0x556ff9c9c1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T22:27:49.403 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:49.390+0000 7f8a45b28740 10 client.0 _ll_register_callbacks cb 0x7f8a2c005e30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T22:27:49.403 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:49.390+0000 7f8a45b28740 1 -- 172.21.15.19:0/172551048 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8a3400fb10 con 0x556ff9c1f800 2024-09-10T22:27:49.403 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:49.390+0000 7f8a40cee640 1 --2- 172.21.15.19:0/172551048 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556ff9c1f800 0x556ff9c9c760 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f8a2c000c00 tx=0x7f8a2c0e3d90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=38662892144b2d5a server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:27:49.403 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:49.390+0000 7f8a24ff9640 10 client.25256 ms_handle_connect on v2:172.21.15.135:3300/0 2024-09-10T22:27:49.403 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:49.390+0000 7f8a24ff9640 1 -- 172.21.15.19:0/172551048 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a2c0d3050 con 0x556ff9c1f800 2024-09-10T22:27:49.403 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:49.390+0000 7f8a24ff9640 1 -- 172.21.15.19:0/172551048 <== mon.2 v2:172.21.15.135:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8327+0+0 (secure 0 0 0) 0x7f8a2c0d31f0 con 0x556ff9c1f800 2024-09-10T22:27:49.403 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:49.390+0000 7f8a24ff9640 1 -- 172.21.15.19:0/172551048 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f8a2c0f5040 con 0x556ff9c1f800 2024-09-10T22:27:49.403 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:49.390+0000 7f8a45b28740 10 client.25256 fetch_fsmap learned FSMap version 26 2024-09-10T22:27:49.403 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:49.390+0000 7f8a45b28740 1 -- 172.21.15.19:0/172551048 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({fsmap=26}) -- 0x556ff9ca8c80 con 0x556ff9c1f800 2024-09-10T22:27:49.404 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:49.391+0000 7f8a24ff9640 1 -- 172.21.15.19:0/172551048 <== mon.2 v2:172.21.15.135:3300/0 4 ==== fsmap(e 26) ==== 8350+0+0 (secure 0 0 0) 0x7f8a2c0ab5c0 con 0x556ff9c1f800 2024-09-10T22:27:49.404 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:49.391+0000 7f8a45b28740 10 client.25256 fetch_fsmap finished waiting for FSMap version 26 2024-09-10T22:27:49.404 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:49.391+0000 7f8a45b28740 10 client.25256 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-10T22:27:49.404 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:49.391+0000 7f8a45b28740 20 client.25256 populate_metadata read hostname 'smithi019' 2024-09-10T22:27:49.404 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:49.391+0000 7f8a45b28740 1 --2- 172.21.15.19:0/172551048 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x556ff9ca9160 0x556ff9cab5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:27:49.404 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:49.391+0000 7f8a45b28740 4 client.25256 mds_command: new command op to 24581 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-10T22:27:49.404 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:49.391+0000 7f8a45b28740 1 -- 172.21.15.19:0/172551048 --> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x556ff9b93860 con 0x556ff9ca9160 2024-09-10T22:27:49.404 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:49.391+0000 7f8a414ef640 1 --2- 172.21.15.19:0/172551048 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x556ff9ca9160 0x556ff9cab5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:27:49.404 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:49.392+0000 7f8a414ef640 1 --2- 172.21.15.19:0/172551048 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x556ff9ca9160 0x556ff9cab5a0 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=211ee391e161e1d4 server_cookie=7307b1aa30251760 in_seq=0 out_seq=0 2024-09-10T22:27:49.404 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:49.392+0000 7f8a24ff9640 10 client.25256 ms_handle_connect on v2:172.21.15.135:6838/1254769802 2024-09-10T22:27:49.404 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:49.393+0000 7f8a24ff9640 1 -- 172.21.15.19:0/172551048 <== mds.0 v2:172.21.15.135:6838/1254769802 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x556ff9b93860 con 0x556ff9ca9160 2024-09-10T22:27:49.404 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:49.393+0000 7f8a24ff9640 10 client.25256 handle_command_reply: tid=0 2024-09-10T22:27:49.404 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:49.393+0000 7f8a45b28740 1 client.25256 shutdown 2024-09-10T22:27:49.405 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:49.393+0000 7f8a45b28740 1 -- 172.21.15.19:0/172551048 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556ff9c1f800 msgr2=0x556ff9c9c760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:27:49.405 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:49.393+0000 7f8a45b28740 1 --2- 172.21.15.19:0/172551048 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556ff9c1f800 0x556ff9c9c760 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f8a2c000c00 tx=0x7f8a2c0e3d90 comp rx=0 tx=0).stop 2024-09-10T22:27:49.405 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:49.394+0000 7f8a45b28740 1 -- 172.21.15.19:0/172551048 shutdown_connections 2024-09-10T22:27:49.405 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:49.394+0000 7f8a45b28740 1 --2- 172.21.15.19:0/172551048 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x556ff9ca9160 0x556ff9cab5a0 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:27:49.405 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:49.394+0000 7f8a45b28740 1 --2- 172.21.15.19:0/172551048 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x556ff9c2b790 0x556ff9c9e100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:27:49.405 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:49.394+0000 7f8a24ff9640 0 client.25256 ms_handle_reset on v2:172.21.15.135:6838/1254769802 2024-09-10T22:27:49.405 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:49.394+0000 7f8a45b28740 1 --2- 172.21.15.19:0/172551048 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556ff9c1f800 0x556ff9c9c760 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:27:49.405 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:49.394+0000 7f8a45b28740 1 --2- 172.21.15.19:0/172551048 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x556ff9c1eee0 0x556ff9c9c1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:27:49.405 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:49.394+0000 7f8a45b28740 1 -- 172.21.15.19:0/172551048 >> 172.21.15.19:0/172551048 conn(0x556ff9c1cd10 msgr2=0x556ff9c1b750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:27:49.405 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:49.394+0000 7f8a45b28740 1 -- 172.21.15.19:0/172551048 shutdown_connections 2024-09-10T22:27:49.405 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:49.394+0000 7f8a45b28740 1 -- 172.21.15.19:0/172551048 wait complete. 2024-09-10T22:27:49.405 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:49.394+0000 7f8a45b28740 20 client.25256 trim_cache size 0 max 16384 2024-09-10T22:27:49.406 INFO:teuthology.orchestra.run.smithi019.stdout:{ 2024-09-10T22:27:49.406 INFO:teuthology.orchestra.run.smithi019.stdout: "return_code": 0, 2024-09-10T22:27:49.406 INFO:teuthology.orchestra.run.smithi019.stdout: "scrub_tag": "c12c2a04-dcd6-4673-a98e-93f665d3f5d7", 2024-09-10T22:27:49.406 INFO:teuthology.orchestra.run.smithi019.stdout: "mode": "asynchronous" 2024-09-10T22:27:49.406 INFO:teuthology.orchestra.run.smithi019.stdout:} 2024-09-10T22:27:49.407 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:49.395+0000 7f8a43753640 1 -- 172.21.15.19:0/415869311 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f8a280b5360 msgr2=0x7f8a280b7820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:27:49.407 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:49.395+0000 7f8a43753640 1 --2- 172.21.15.19:0/415869311 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f8a280b5360 0x7f8a280b7820 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f8a34005fd0 tx=0x7f8a34009500 comp rx=0 tx=0).stop 2024-09-10T22:27:49.407 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:49.395+0000 7f8a43753640 1 -- 172.21.15.19:0/415869311 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8a3c1045c0 msgr2=0x7f8a3c1997d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:27:49.407 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:49.395+0000 7f8a43753640 1 --2- 172.21.15.19:0/415869311 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8a3c1045c0 0x7f8a3c1997d0 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f8a2c00e9c0 tx=0x7f8a2c00ee80 comp rx=0 tx=0).stop 2024-09-10T22:27:49.407 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:49.396+0000 7f8a43753640 1 -- 172.21.15.19:0/415869311 shutdown_connections 2024-09-10T22:27:49.407 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:49.396+0000 7f8a43753640 1 --2- 172.21.15.19:0/415869311 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f8a280b5360 0x7f8a280b7820 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:27:49.408 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:49.396+0000 7f8a43753640 1 --2- 172.21.15.19:0/415869311 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f8a3c10d100 0x7f8a3c19eb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:27:49.408 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:49.396+0000 7f8a43753640 1 --2- 172.21.15.19:0/415869311 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8a3c1045c0 0x7f8a3c1997d0 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:27:49.408 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:49.396+0000 7f8a43753640 1 --2- 172.21.15.19:0/415869311 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8a3c103ca0 0x7f8a3c199290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:27:49.408 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:49.396+0000 7f8a43753640 1 -- 172.21.15.19:0/415869311 >> 172.21.15.19:0/415869311 conn(0x7f8a3c0fd700 msgr2=0x7f8a3c10f360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:27:49.408 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:49.396+0000 7f8a43753640 1 -- 172.21.15.19:0/415869311 shutdown_connections 2024-09-10T22:27:49.408 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:49.396+0000 7f8a43753640 1 -- 172.21.15.19:0/415869311 wait complete. 2024-09-10T22:27:50.125 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:27:49 smithi138 ceph-mon[35236]: pgmap v389: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 984 KiB/s rd, 460 MiB/s wr, 497 op/s 2024-09-10T22:27:50.125 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:27:49 smithi138 ceph-mon[35236]: scrub queued for path: / 2024-09-10T22:27:50.125 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:27:49 smithi138 ceph-mon[35236]: scrub summary: idle+waiting paths [/] 2024-09-10T22:27:50.125 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:27:49 smithi138 ceph-mon[35236]: scrub summary: active paths [/] 2024-09-10T22:27:50.125 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:27:49 smithi138 ceph-mon[35236]: scrub summary: active paths [/] 2024-09-10T22:27:50.125 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:27:49 smithi138 ceph-mon[35236]: scrub summary: idle+waiting paths [/] 2024-09-10T22:27:50.208 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:27:49 smithi019 ceph-mon[31375]: pgmap v389: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 984 KiB/s rd, 460 MiB/s wr, 497 op/s 2024-09-10T22:27:50.208 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:27:49 smithi019 ceph-mon[31375]: scrub queued for path: / 2024-09-10T22:27:50.209 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:27:49 smithi019 ceph-mon[31375]: scrub summary: idle+waiting paths [/] 2024-09-10T22:27:50.209 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:27:49 smithi019 ceph-mon[31375]: scrub summary: active paths [/] 2024-09-10T22:27:50.209 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:27:49 smithi019 ceph-mon[31375]: scrub summary: active paths [/] 2024-09-10T22:27:50.209 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:27:49 smithi019 ceph-mon[31375]: scrub summary: idle+waiting paths [/] 2024-09-10T22:27:50.360 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:27:49 smithi135 ceph-mon[34789]: pgmap v389: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 984 KiB/s rd, 460 MiB/s wr, 497 op/s 2024-09-10T22:27:50.360 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:27:49 smithi135 ceph-mon[34789]: scrub queued for path: / 2024-09-10T22:27:50.360 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:27:49 smithi135 ceph-mon[34789]: scrub summary: idle+waiting paths [/] 2024-09-10T22:27:50.360 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:27:49 smithi135 ceph-mon[34789]: scrub summary: active paths [/] 2024-09-10T22:27:50.360 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:27:49 smithi135 ceph-mon[34789]: scrub summary: active paths [/] 2024-09-10T22:27:50.360 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:27:49 smithi135 ceph-mon[34789]: scrub summary: idle+waiting paths [/] 2024-09-10T22:27:50.716 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 22997a4c-6fc2-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-10T22:27:51.125 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:27:50 smithi138 ceph-mon[35236]: scrub summary: idle+waiting paths [/] 2024-09-10T22:27:51.209 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:27:50 smithi019 ceph-mon[31375]: scrub summary: idle+waiting paths [/] 2024-09-10T22:27:51.314 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/22997a4c-6fc2-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T22:27:51.359 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:27:50 smithi135 ceph-mon[34789]: scrub summary: idle+waiting paths [/] 2024-09-10T22:27:52.167 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:27:51 smithi019 ceph-mon[31375]: pgmap v390: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 541 MiB/s wr, 552 op/s 2024-09-10T22:27:52.326 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:52.260+0000 7f4d4645c640 1 -- 172.21.15.19:0/2586805354 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4d40109170 msgr2=0x7f4d4010f970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:27:52.326 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:52.260+0000 7f4d4645c640 1 --2- 172.21.15.19:0/2586805354 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4d40109170 0x7f4d4010f970 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f4d38009ca0 tx=0x7f4d3802a8c0 comp rx=0 tx=0).stop 2024-09-10T22:27:52.326 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:52.260+0000 7f4d4645c640 1 -- 172.21.15.19:0/2586805354 shutdown_connections 2024-09-10T22:27:52.326 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:52.260+0000 7f4d4645c640 1 --2- 172.21.15.19:0/2586805354 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4d40109170 0x7f4d4010f970 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:27:52.327 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:52.260+0000 7f4d4645c640 1 --2- 172.21.15.19:0/2586805354 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4d401087f0 0x7f4d40108c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:27:52.327 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:52.260+0000 7f4d4645c640 1 --2- 172.21.15.19:0/2586805354 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f4d40102de0 0x7f4d401031c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:27:52.327 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:52.260+0000 7f4d4645c640 1 -- 172.21.15.19:0/2586805354 >> 172.21.15.19:0/2586805354 conn(0x7f4d400fe830 msgr2=0x7f4d40100c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:27:52.327 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:52.260+0000 7f4d4645c640 1 -- 172.21.15.19:0/2586805354 shutdown_connections 2024-09-10T22:27:52.327 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:52.261+0000 7f4d4645c640 1 -- 172.21.15.19:0/2586805354 wait complete. 2024-09-10T22:27:52.327 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:52.261+0000 7f4d4645c640 1 Processor -- start 2024-09-10T22:27:52.327 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:52.261+0000 7f4d4645c640 1 -- start start 2024-09-10T22:27:52.327 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:52.262+0000 7f4d4645c640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f4d40102de0 0x7f4d400754a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:27:52.327 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:52.262+0000 7f4d4645c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4d401087f0 0x7f4d400759e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:27:52.327 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:52.262+0000 7f4d4645c640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4d40109170 0x7f4d40075f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:27:52.327 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:52.262+0000 7f4d4645c640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f4d40112e40 con 0x7f4d401087f0 2024-09-10T22:27:52.327 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:52.262+0000 7f4d4645c640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f4d40112cc0 con 0x7f4d40109170 2024-09-10T22:27:52.327 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:52.262+0000 7f4d4645c640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f4d40112fc0 con 0x7f4d40102de0 2024-09-10T22:27:52.328 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:52.262+0000 7f4d3f7fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4d401087f0 0x7f4d400759e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:27:52.328 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:52.262+0000 7f4d449f9640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4d40109170 0x7f4d40075f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:27:52.328 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:52.262+0000 7f4d3f7fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4d401087f0 0x7f4d400759e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:56016/0 (socket says 172.21.15.19:56016) 2024-09-10T22:27:52.328 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:52.262+0000 7f4d3f7fe640 1 -- 172.21.15.19:0/3646837443 learned_addr learned my addr 172.21.15.19:0/3646837443 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:27:52.328 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:52.262+0000 7f4d3ffff640 1 --2- 172.21.15.19:0/3646837443 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f4d40102de0 0x7f4d400754a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:27:52.328 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:52.262+0000 7f4d449f9640 1 -- 172.21.15.19:0/3646837443 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f4d40102de0 msgr2=0x7f4d400754a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:27:52.328 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:52.262+0000 7f4d449f9640 1 --2- 172.21.15.19:0/3646837443 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f4d40102de0 0x7f4d400754a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:27:52.328 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:52.262+0000 7f4d449f9640 1 -- 172.21.15.19:0/3646837443 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4d401087f0 msgr2=0x7f4d400759e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:27:52.328 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:52.262+0000 7f4d449f9640 1 --2- 172.21.15.19:0/3646837443 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4d401087f0 0x7f4d400759e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:27:52.328 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:52.262+0000 7f4d449f9640 1 -- 172.21.15.19:0/3646837443 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4d401a7650 con 0x7f4d40109170 2024-09-10T22:27:52.328 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:52.262+0000 7f4d3f7fe640 1 --2- 172.21.15.19:0/3646837443 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4d401087f0 0x7f4d400759e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T22:27:52.328 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:52.263+0000 7f4d449f9640 1 --2- 172.21.15.19:0/3646837443 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4d40109170 0x7f4d40075f20 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f4d38005e30 tx=0x7f4d380319f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:27:52.329 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:52.263+0000 7f4d3d7fa640 1 -- 172.21.15.19:0/3646837443 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d38003bf0 con 0x7f4d40109170 2024-09-10T22:27:52.329 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:52.263+0000 7f4d3d7fa640 1 -- 172.21.15.19:0/3646837443 <== mon.2 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4d38003d90 con 0x7f4d40109170 2024-09-10T22:27:52.329 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:52.263+0000 7f4d4645c640 1 -- 172.21.15.19:0/3646837443 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4d401a78e0 con 0x7f4d40109170 2024-09-10T22:27:52.329 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:52.263+0000 7f4d3d7fa640 1 -- 172.21.15.19:0/3646837443 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d3802fba0 con 0x7f4d40109170 2024-09-10T22:27:52.329 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:52.263+0000 7f4d4645c640 1 -- 172.21.15.19:0/3646837443 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4d401a7e20 con 0x7f4d40109170 2024-09-10T22:27:52.329 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:52.265+0000 7f4d48831740 1 Processor -- start 2024-09-10T22:27:52.329 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:52.266+0000 7f4d3d7fa640 1 -- 172.21.15.19:0/3646837443 <== mon.2 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 18) ==== 153250+0+0 (secure 0 0 0) 0x7f4d3802fd40 con 0x7f4d40109170 2024-09-10T22:27:52.329 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:52.266+0000 7f4d48831740 1 -- start start 2024-09-10T22:27:52.329 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:52.266+0000 7f4d48831740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5598213aa0a0 0x5598213aa480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:27:52.329 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:52.266+0000 7f4d48831740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5598213aa9c0 0x5598213b6410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:27:52.329 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:52.266+0000 7f4d48831740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5598213b6950 0x5598213b8d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:27:52.329 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:52.266+0000 7f4d48831740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x559821320e50 con 0x5598213b6950 2024-09-10T22:27:52.329 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:52.266+0000 7f4d48831740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x559821310280 con 0x5598213aa0a0 2024-09-10T22:27:52.330 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:52.266+0000 7f4d48831740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x559821314090 con 0x5598213aa9c0 2024-09-10T22:27:52.330 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:52.266+0000 7f4d3f7fe640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5598213aa0a0 0x5598213aa480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:27:52.330 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:52.266+0000 7f4d3f7fe640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5598213aa0a0 0x5598213aa480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.19:41896/0 (socket says 172.21.15.19:41896) 2024-09-10T22:27:52.330 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:52.266+0000 7f4d3f7fe640 1 -- 172.21.15.19:0/1539469756 learned_addr learned my addr 172.21.15.19:0/1539469756 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:27:52.330 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:52.267+0000 7f4d3f7fe640 1 --2- 172.21.15.19:0/1539469756 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5598213b6950 0x5598213b8d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:27:52.330 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:52.267+0000 7f4d3f7fe640 1 -- 172.21.15.19:0/1539469756 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5598213aa9c0 msgr2=0x5598213b6410 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-10T22:27:52.330 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:52.267+0000 7f4d3f7fe640 1 --2- 172.21.15.19:0/1539469756 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5598213aa9c0 0x5598213b6410 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:27:52.330 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:52.267+0000 7f4d3f7fe640 1 -- 172.21.15.19:0/1539469756 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5598213b6950 msgr2=0x5598213b8d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:27:52.330 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:52.267+0000 7f4d3f7fe640 1 --2- 172.21.15.19:0/1539469756 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5598213b6950 0x5598213b8d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:27:52.330 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:52.267+0000 7f4d3f7fe640 1 -- 172.21.15.19:0/1539469756 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55982106e650 con 0x5598213aa0a0 2024-09-10T22:27:52.330 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:52.267+0000 7f4d3d7fa640 1 --2- 172.21.15.19:0/3646837443 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f4d280b52e0 0x7f4d280b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:27:52.330 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:52.267+0000 7f4d3f7fe640 1 --2- 172.21.15.19:0/1539469756 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5598213aa0a0 0x5598213aa480 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f4d34012bd0 tx=0x7f4d340046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=781b9199537b6651 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:27:52.330 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:52.267+0000 7f4d3ffff640 1 --2- 172.21.15.19:0/3646837443 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f4d280b52e0 0x7f4d280b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:27:52.331 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:52.267+0000 7f4d3d7fa640 1 -- 172.21.15.19:0/3646837443 <== mon.2 v2:172.21.15.135:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8327+0+0 (secure 0 0 0) 0x7f4d38106e00 con 0x7f4d40109170 2024-09-10T22:27:52.331 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:52.267+0000 7f4d267fc640 1 -- 172.21.15.19:0/1539469756 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d34012cc0 con 0x5598213aa0a0 2024-09-10T22:27:52.331 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:52.267+0000 7f4d267fc640 1 -- 172.21.15.19:0/1539469756 <== mon.2 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4d34012050 con 0x5598213aa0a0 2024-09-10T22:27:52.331 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:52.267+0000 7f4d267fc640 1 -- 172.21.15.19:0/1539469756 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d340037f0 con 0x5598213aa0a0 2024-09-10T22:27:52.331 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:52.268+0000 7f4d48831740 1 -- 172.21.15.19:0/1539469756 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5598213aa0a0 msgr2=0x5598213aa480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:27:52.331 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:52.268+0000 7f4d48831740 1 --2- 172.21.15.19:0/1539469756 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5598213aa0a0 0x5598213aa480 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f4d34012bd0 tx=0x7f4d340046c0 comp rx=0 tx=0).stop 2024-09-10T22:27:52.331 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:52.268+0000 7f4d3ffff640 1 --2- 172.21.15.19:0/3646837443 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f4d280b52e0 0x7f4d280b77a0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x5598213a8db0 tx=0x7f4d3000b410 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:27:52.331 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:52.268+0000 7f4d48831740 1 -- 172.21.15.19:0/1539469756 shutdown_connections 2024-09-10T22:27:52.331 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:52.268+0000 7f4d48831740 1 --2- 172.21.15.19:0/1539469756 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5598213b6950 0x5598213b8d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:27:52.331 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:52.268+0000 7f4d48831740 1 --2- 172.21.15.19:0/1539469756 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5598213aa9c0 0x5598213b6410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:27:52.331 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:52.268+0000 7f4d48831740 1 --2- 172.21.15.19:0/1539469756 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5598213aa0a0 0x5598213aa480 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:27:52.331 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:52.268+0000 7f4d48831740 1 -- 172.21.15.19:0/1539469756 >> 172.21.15.19:0/1539469756 conn(0x5598213a7ed0 msgr2=0x5598213a9070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:27:52.332 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:52.268+0000 7f4d48831740 1 -- 172.21.15.19:0/1539469756 shutdown_connections 2024-09-10T22:27:52.332 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:52.268+0000 7f4d48831740 1 -- 172.21.15.19:0/1539469756 wait complete. 2024-09-10T22:27:52.332 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:52.269+0000 7f4d48831740 1 -- start start 2024-09-10T22:27:52.332 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:52.269+0000 7f4d48831740 1 Processor -- start 2024-09-10T22:27:52.332 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:52.270+0000 7f4d48831740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5598213aa0a0 0x5598213b6210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:27:52.332 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:52.270+0000 7f4d48831740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5598213aa9c0 0x5598213b3660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:27:52.332 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:52.270+0000 7f4d48831740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5598213b6950 0x5598213b3c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:27:52.332 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:52.270+0000 7f4d48831740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x559821171700 con 0x5598213aa9c0 2024-09-10T22:27:52.332 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:52.270+0000 7f4d48831740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x5598212ab110 con 0x5598213b6950 2024-09-10T22:27:52.332 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:52.270+0000 7f4d48831740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x5598213b95d0 con 0x5598213aa0a0 2024-09-10T22:27:52.332 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:52.270+0000 7f4d3f7fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5598213aa9c0 0x5598213b3660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:27:52.332 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:52.270+0000 7f4d48831740 10 client.0 _ll_register_callbacks cb 0x5598212c4990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T22:27:52.333 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:52.270+0000 7f4d3f7fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5598213aa9c0 0x5598213b3660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:56044/0 (socket says 172.21.15.19:56044) 2024-09-10T22:27:52.333 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:52.270+0000 7f4d3ffff640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5598213aa0a0 0x5598213b6210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:27:52.333 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:52.270+0000 7f4d3f7fe640 1 -- 172.21.15.19:0/2547353646 learned_addr learned my addr 172.21.15.19:0/2547353646 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:27:52.333 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:52.270+0000 7f4d449f9640 1 --2- 172.21.15.19:0/2547353646 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5598213b6950 0x5598213b3c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:27:52.333 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:52.270+0000 7f4d3ffff640 1 -- 172.21.15.19:0/2547353646 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5598213b6950 msgr2=0x5598213b3c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:27:52.333 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:52.270+0000 7f4d3ffff640 1 --2- 172.21.15.19:0/2547353646 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5598213b6950 0x5598213b3c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:27:52.333 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:52.270+0000 7f4d3ffff640 1 -- 172.21.15.19:0/2547353646 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5598213aa9c0 msgr2=0x5598213b3660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:27:52.333 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:52.270+0000 7f4d3ffff640 1 --2- 172.21.15.19:0/2547353646 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5598213aa9c0 0x5598213b3660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:27:52.333 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:52.270+0000 7f4d3ffff640 1 -- 172.21.15.19:0/2547353646 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5598212d8c40 con 0x5598213aa0a0 2024-09-10T22:27:52.333 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:52.271+0000 7f4d3ffff640 1 --2- 172.21.15.19:0/2547353646 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5598213aa0a0 0x5598213b6210 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f4d30005d00 tx=0x7f4d30004730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1cc2a700ebba2871 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:27:52.333 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:52.271+0000 7f4d1f7fe640 10 client.0 ms_handle_connect on v2:172.21.15.138:3300/0 2024-09-10T22:27:52.333 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:52.271+0000 7f4d1f7fe640 1 -- 172.21.15.19:0/2547353646 <== mon.1 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d3001e830 con 0x5598213aa0a0 2024-09-10T22:27:52.333 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:52.271+0000 7f4d1f7fe640 1 -- 172.21.15.19:0/2547353646 <== mon.1 v2:172.21.15.138:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8327+0+0 (secure 0 0 0) 0x7f4d3001e9d0 con 0x5598213aa0a0 2024-09-10T22:27:52.334 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:52.271+0000 7f4d48831740 1 -- 172.21.15.19:0/2547353646 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4d34012050 con 0x5598213aa0a0 2024-09-10T22:27:52.334 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:52.271+0000 7f4d1f7fe640 1 -- 172.21.15.19:0/2547353646 <== mon.1 v2:172.21.15.138:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f4d3001ec10 con 0x5598213aa0a0 2024-09-10T22:27:52.334 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:52.272+0000 7f4d48831740 10 client.25225 fetch_fsmap learned FSMap version 26 2024-09-10T22:27:52.334 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:52.272+0000 7f4d48831740 1 -- 172.21.15.19:0/2547353646 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x5598213c4f60 con 0x5598213aa0a0 2024-09-10T22:27:52.334 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:52.272+0000 7f4d1f7fe640 1 -- 172.21.15.19:0/2547353646 <== mon.1 v2:172.21.15.138:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4d3001edb0 con 0x5598213aa0a0 2024-09-10T22:27:52.334 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:52.272+0000 7f4d1f7fe640 1 -- 172.21.15.19:0/2547353646 <== mon.1 v2:172.21.15.138:3300/0 5 ==== fsmap(e 26) ==== 8350+0+0 (secure 0 0 0) 0x7f4d3002f050 con 0x5598213aa0a0 2024-09-10T22:27:52.334 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:52.272+0000 7f4d48831740 10 client.25225 fetch_fsmap finished waiting for FSMap version 26 2024-09-10T22:27:52.334 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:52.272+0000 7f4d48831740 10 client.25225 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-10T22:27:52.334 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:52.272+0000 7f4d48831740 20 client.25225 populate_metadata read hostname 'smithi019' 2024-09-10T22:27:52.334 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:52.272+0000 7f4d48831740 1 --2- 172.21.15.19:0/2547353646 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x5598213c6370 0x5598213c87d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:27:52.334 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:52.272+0000 7f4d48831740 4 client.25225 mds_command: new command op to 24581 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T22:27:52.334 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:52.272+0000 7f4d48831740 1 -- 172.21.15.19:0/2547353646 --> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f4d34012050 con 0x5598213c6370 2024-09-10T22:27:52.334 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:52.272+0000 7f4d3f7fe640 1 --2- 172.21.15.19:0/2547353646 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x5598213c6370 0x5598213c87d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:27:52.335 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:52.273+0000 7f4d1f7fe640 10 client.25225 ms_handle_connect on v2:172.21.15.135:6838/1254769802 2024-09-10T22:27:52.335 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:52.273+0000 7f4d3f7fe640 1 --2- 172.21.15.19:0/2547353646 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x5598213c6370 0x5598213c87d0 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=237d104ec17f89e4 server_cookie=b61fd6ca70207e0a in_seq=0 out_seq=0 2024-09-10T22:27:52.335 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:52.274+0000 7f4d1f7fe640 1 -- 172.21.15.19:0/2547353646 <== mds.0 v2:172.21.15.135:6838/1254769802 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x7f4d34012050 con 0x5598213c6370 2024-09-10T22:27:52.335 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:52.274+0000 7f4d1f7fe640 10 client.25225 handle_command_reply: tid=0 2024-09-10T22:27:52.335 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:52.274+0000 7f4d48831740 1 client.25225 shutdown 2024-09-10T22:27:52.335 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:52.274+0000 7f4d48831740 1 -- 172.21.15.19:0/2547353646 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5598213aa0a0 msgr2=0x5598213b6210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:27:52.335 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:52.274+0000 7f4d48831740 1 --2- 172.21.15.19:0/2547353646 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5598213aa0a0 0x5598213b6210 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f4d30005d00 tx=0x7f4d30004730 comp rx=0 tx=0).stop 2024-09-10T22:27:52.335 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:52.274+0000 7f4d48831740 1 -- 172.21.15.19:0/2547353646 shutdown_connections 2024-09-10T22:27:52.335 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:52.274+0000 7f4d48831740 1 --2- 172.21.15.19:0/2547353646 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5598213b6950 0x5598213b3c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:27:52.335 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:52.274+0000 7f4d48831740 1 --2- 172.21.15.19:0/2547353646 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5598213aa9c0 0x5598213b3660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:27:52.335 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:52.274+0000 7f4d48831740 1 --2- 172.21.15.19:0/2547353646 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x5598213c6370 0x5598213c87d0 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:27:52.335 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:52.274+0000 7f4d48831740 1 --2- 172.21.15.19:0/2547353646 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5598213aa0a0 0x5598213b6210 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:27:52.336 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:52.274+0000 7f4d48831740 1 -- 172.21.15.19:0/2547353646 >> 172.21.15.19:0/2547353646 conn(0x5598213a7ed0 msgr2=0x5598213ada40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:27:52.336 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:52.274+0000 7f4d1f7fe640 0 client.25225 ms_handle_reset on v2:172.21.15.135:6838/1254769802 2024-09-10T22:27:52.336 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:52.274+0000 7f4d48831740 1 -- 172.21.15.19:0/2547353646 shutdown_connections 2024-09-10T22:27:52.336 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:52.274+0000 7f4d48831740 1 -- 172.21.15.19:0/2547353646 wait complete. 2024-09-10T22:27:52.336 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:52.275+0000 7f4d48831740 20 client.25225 trim_cache size 0 max 16384 2024-09-10T22:27:52.336 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:52.304+0000 7f4d48831740 1 Processor -- start 2024-09-10T22:27:52.336 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:52.304+0000 7f4d48831740 1 -- start start 2024-09-10T22:27:52.336 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:52.304+0000 7f4d48831740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5598213aa0a0 0x5598213c2830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:27:52.336 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:52.305+0000 7f4d48831740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5598213aa9c0 0x5598213a2e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:27:52.336 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:52.305+0000 7f4d48831740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5598213b6950 0x5598213b1ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:27:52.336 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:52.305+0000 7f4d449f9640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5598213b6950 0x5598213b1ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:27:52.336 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:52.305+0000 7f4d449f9640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5598213b6950 0x5598213b1ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:56050/0 (socket says 172.21.15.19:56050) 2024-09-10T22:27:52.336 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:52.305+0000 7f4d449f9640 1 -- 172.21.15.19:0/2927575879 learned_addr learned my addr 172.21.15.19:0/2927575879 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:27:52.337 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:52.305+0000 7f4d48831740 1 -- 172.21.15.19:0/2927575879 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f4d401b2fd0 con 0x5598213b6950 2024-09-10T22:27:52.337 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:52.305+0000 7f4d48831740 1 -- 172.21.15.19:0/2927575879 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f4d401b08a0 con 0x5598213aa9c0 2024-09-10T22:27:52.337 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:52.305+0000 7f4d48831740 1 -- 172.21.15.19:0/2927575879 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f4d401ae6f0 con 0x5598213aa0a0 2024-09-10T22:27:52.337 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:52.305+0000 7f4d3ffff640 1 --2- 172.21.15.19:0/2927575879 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5598213aa0a0 0x5598213c2830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:27:52.337 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:52.306+0000 7f4d3ffff640 1 -- 172.21.15.19:0/2927575879 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5598213aa9c0 msgr2=0x5598213a2e20 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-10T22:27:52.337 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:52.306+0000 7f4d3ffff640 1 --2- 172.21.15.19:0/2927575879 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5598213aa9c0 0x5598213a2e20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:27:52.337 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:52.306+0000 7f4d3ffff640 1 -- 172.21.15.19:0/2927575879 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5598213b6950 msgr2=0x5598213b1ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:27:52.337 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:52.306+0000 7f4d3ffff640 1 --2- 172.21.15.19:0/2927575879 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5598213b6950 0x5598213b1ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:27:52.337 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:52.306+0000 7f4d3ffff640 1 -- 172.21.15.19:0/2927575879 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5598213a8950 con 0x5598213aa0a0 2024-09-10T22:27:52.337 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:52.307+0000 7f4d3ffff640 1 --2- 172.21.15.19:0/2927575879 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5598213aa0a0 0x5598213c2830 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f4d30006010 tx=0x7f4d3000be00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d49edef5c207bfb2 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:27:52.337 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:52.307+0000 7f4d25ffb640 1 -- 172.21.15.19:0/2927575879 <== mon.1 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d30026900 con 0x5598213aa0a0 2024-09-10T22:27:52.337 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:52.308+0000 7f4d25ffb640 1 -- 172.21.15.19:0/2927575879 <== mon.1 v2:172.21.15.138:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4d30026ba0 con 0x5598213aa0a0 2024-09-10T22:27:52.338 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:52.308+0000 7f4d25ffb640 1 -- 172.21.15.19:0/2927575879 <== mon.1 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d30039ae0 con 0x5598213aa0a0 2024-09-10T22:27:52.338 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:52.310+0000 7f4d48831740 1 -- 172.21.15.19:0/2927575879 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5598213aa0a0 msgr2=0x5598213c2830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:27:52.338 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:52.310+0000 7f4d48831740 1 --2- 172.21.15.19:0/2927575879 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5598213aa0a0 0x5598213c2830 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f4d30006010 tx=0x7f4d3000be00 comp rx=0 tx=0).stop 2024-09-10T22:27:52.338 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:52.310+0000 7f4d48831740 1 -- 172.21.15.19:0/2927575879 shutdown_connections 2024-09-10T22:27:52.338 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:52.310+0000 7f4d48831740 1 --2- 172.21.15.19:0/2927575879 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5598213b6950 0x5598213b1ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:27:52.338 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:52.310+0000 7f4d48831740 1 --2- 172.21.15.19:0/2927575879 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5598213aa9c0 0x5598213a2e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:27:52.338 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:52.310+0000 7f4d48831740 1 --2- 172.21.15.19:0/2927575879 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5598213aa0a0 0x5598213c2830 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:27:52.338 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:52.310+0000 7f4d48831740 1 -- 172.21.15.19:0/2927575879 >> 172.21.15.19:0/2927575879 conn(0x5598213a7ed0 msgr2=0x5598213a8f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:27:52.338 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:52.310+0000 7f4d48831740 1 -- 172.21.15.19:0/2927575879 shutdown_connections 2024-09-10T22:27:52.338 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:52.310+0000 7f4d48831740 1 -- 172.21.15.19:0/2927575879 wait complete. 2024-09-10T22:27:52.338 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:52.311+0000 7f4d48831740 1 -- start start 2024-09-10T22:27:52.338 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:52.311+0000 7f4d48831740 1 Processor -- start 2024-09-10T22:27:52.339 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:52.311+0000 7f4d48831740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5598213aa0a0 0x5598213bebb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:27:52.339 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:52.311+0000 7f4d48831740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5598213aa9c0 0x5598213bf0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:27:52.339 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:52.311+0000 7f4d48831740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5598213b6950 0x5598213af8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:27:52.339 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:52.312+0000 7f4d48831740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f4d401aed60 con 0x5598213b6950 2024-09-10T22:27:52.339 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:52.312+0000 7f4d48831740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f4d401b01d0 con 0x5598213aa0a0 2024-09-10T22:27:52.339 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:52.312+0000 7f4d48831740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f4d401af430 con 0x5598213aa9c0 2024-09-10T22:27:52.339 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:52.312+0000 7f4d48831740 10 client.0 _ll_register_callbacks cb 0x7f4d3000b8f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T22:27:52.339 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:52.312+0000 7f4d449f9640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5598213b6950 0x5598213af8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:27:52.339 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:52.312+0000 7f4d449f9640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5598213b6950 0x5598213af8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:56066/0 (socket says 172.21.15.19:56066) 2024-09-10T22:27:52.339 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:52.312+0000 7f4d449f9640 1 -- 172.21.15.19:0/3240323866 learned_addr learned my addr 172.21.15.19:0/3240323866 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:27:52.339 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:52.312+0000 7f4d449f9640 1 -- 172.21.15.19:0/3240323866 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5598213aa9c0 msgr2=0x5598213bf0f0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-10T22:27:52.339 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:52.312+0000 7f4d449f9640 1 --2- 172.21.15.19:0/3240323866 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5598213aa9c0 0x5598213bf0f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:27:52.340 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:52.312+0000 7f4d449f9640 1 -- 172.21.15.19:0/3240323866 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5598213aa0a0 msgr2=0x5598213bebb0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-10T22:27:52.340 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:52.312+0000 7f4d449f9640 1 --2- 172.21.15.19:0/3240323866 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5598213aa0a0 0x5598213bebb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:27:52.340 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:52.312+0000 7f4d449f9640 1 -- 172.21.15.19:0/3240323866 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5598213b0110 con 0x5598213b6950 2024-09-10T22:27:52.340 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:52.312+0000 7f4d449f9640 1 --2- 172.21.15.19:0/3240323866 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5598213b6950 0x5598213af8e0 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f4d380cd2f0 tx=0x7f4d380095c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4cbeb30644bd270d server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:27:52.340 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:52.312+0000 7f4d1f7fe640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-10T22:27:52.340 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:52.313+0000 7f4d1f7fe640 1 -- 172.21.15.19:0/3240323866 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d380cda50 con 0x5598213b6950 2024-09-10T22:27:52.340 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:52.313+0000 7f4d1f7fe640 1 -- 172.21.15.19:0/3240323866 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8327+0+0 (secure 0 0 0) 0x7f4d380d6660 con 0x5598213b6950 2024-09-10T22:27:52.340 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:52.313+0000 7f4d48831740 1 -- 172.21.15.19:0/3240323866 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4d30026ba0 con 0x5598213b6950 2024-09-10T22:27:52.340 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:52.313+0000 7f4d1f7fe640 1 -- 172.21.15.19:0/3240323866 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f4d380d6430 con 0x5598213b6950 2024-09-10T22:27:52.340 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:52.313+0000 7f4d48831740 10 client.15669 fetch_fsmap learned FSMap version 26 2024-09-10T22:27:52.340 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:52.313+0000 7f4d48831740 1 -- 172.21.15.19:0/3240323866 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x5598213b1480 con 0x5598213b6950 2024-09-10T22:27:52.340 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:52.323+0000 7f4d1f7fe640 1 -- 172.21.15.19:0/3240323866 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4d30026ba0 con 0x5598213b6950 2024-09-10T22:27:52.340 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:52.323+0000 7f4d1f7fe640 1 -- 172.21.15.19:0/3240323866 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 26) ==== 8350+0+0 (secure 0 0 0) 0x7f4d380cc850 con 0x5598213b6950 2024-09-10T22:27:52.341 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:52.323+0000 7f4d48831740 10 client.15669 fetch_fsmap finished waiting for FSMap version 26 2024-09-10T22:27:52.341 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:52.324+0000 7f4d48831740 10 client.15669 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-10T22:27:52.341 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:52.324+0000 7f4d48831740 20 client.15669 populate_metadata read hostname 'smithi019' 2024-09-10T22:27:52.341 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:52.324+0000 7f4d48831740 1 --2- 172.21.15.19:0/3240323866 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x55982143ce90 0x55982143f2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:27:52.341 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:52.324+0000 7f4d48831740 4 client.15669 mds_command: new command op to 24581 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-10T22:27:52.341 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:52.324+0000 7f4d48831740 1 -- 172.21.15.19:0/3240323866 --> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] -- command(tid 0: {"prefix": "scrub status"}) -- 0x559821322da0 con 0x55982143ce90 2024-09-10T22:27:52.343 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:52.328+0000 7f4d3ffff640 1 --2- 172.21.15.19:0/3240323866 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x55982143ce90 0x55982143f2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:27:52.343 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:52.334+0000 7f4d3ffff640 1 --2- 172.21.15.19:0/3240323866 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x55982143ce90 0x55982143f2b0 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9e90e83c7cbc852e server_cookie=9746d9c17beb5d26 in_seq=0 out_seq=0 2024-09-10T22:27:52.343 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:52.334+0000 7f4d1f7fe640 10 client.15669 ms_handle_connect on v2:172.21.15.135:6838/1254769802 2024-09-10T22:27:52.343 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:52.335+0000 7f4d1f7fe640 1 -- 172.21.15.19:0/3240323866 <== mds.0 v2:172.21.15.135:6838/1254769802 1 ==== command_reply(tid 0: 0 ) ==== 8+0+1138 (crc 0 0 0) 0x559821322da0 con 0x55982143ce90 2024-09-10T22:27:52.343 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:52.335+0000 7f4d1f7fe640 10 client.15669 handle_command_reply: tid=0 2024-09-10T22:27:52.343 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:52.335+0000 7f4d48831740 1 client.15669 shutdown 2024-09-10T22:27:52.343 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:52.335+0000 7f4d48831740 1 -- 172.21.15.19:0/3240323866 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5598213b6950 msgr2=0x5598213af8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:27:52.343 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:52.335+0000 7f4d48831740 1 --2- 172.21.15.19:0/3240323866 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5598213b6950 0x5598213af8e0 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f4d380cd2f0 tx=0x7f4d380095c0 comp rx=0 tx=0).stop 2024-09-10T22:27:52.343 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:52.335+0000 7f4d48831740 1 -- 172.21.15.19:0/3240323866 shutdown_connections 2024-09-10T22:27:52.344 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:52.335+0000 7f4d48831740 1 --2- 172.21.15.19:0/3240323866 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5598213b6950 0x5598213af8e0 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:27:52.344 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:52.335+0000 7f4d48831740 1 --2- 172.21.15.19:0/3240323866 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x55982143ce90 0x55982143f2b0 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:27:52.344 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:52.336+0000 7f4d1f7fe640 0 client.15669 ms_handle_reset on v2:172.21.15.135:6838/1254769802 2024-09-10T22:27:52.344 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:52.336+0000 7f4d48831740 1 --2- 172.21.15.19:0/3240323866 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5598213aa9c0 0x5598213bf0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:27:52.344 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:52.336+0000 7f4d48831740 1 --2- 172.21.15.19:0/3240323866 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5598213aa0a0 0x5598213bebb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:27:52.344 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:52.336+0000 7f4d48831740 1 -- 172.21.15.19:0/3240323866 >> 172.21.15.19:0/3240323866 conn(0x5598213a7ed0 msgr2=0x5598213b1e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:27:52.344 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:52.336+0000 7f4d48831740 1 -- 172.21.15.19:0/3240323866 shutdown_connections 2024-09-10T22:27:52.344 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:52.336+0000 7f4d48831740 1 -- 172.21.15.19:0/3240323866 wait complete. 2024-09-10T22:27:52.344 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:52.336+0000 7f4d48831740 20 client.15669 trim_cache size 0 max 16384 2024-09-10T22:27:52.344 INFO:teuthology.orchestra.run.smithi019.stdout:{ 2024-09-10T22:27:52.345 INFO:teuthology.orchestra.run.smithi019.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-10T22:27:52.345 INFO:teuthology.orchestra.run.smithi019.stdout: "scrubs": { 2024-09-10T22:27:52.345 INFO:teuthology.orchestra.run.smithi019.stdout: "c12c2a04-dcd6-4673-a98e-93f665d3f5d7": { 2024-09-10T22:27:52.345 INFO:teuthology.orchestra.run.smithi019.stdout: "path": "/", 2024-09-10T22:27:52.345 INFO:teuthology.orchestra.run.smithi019.stdout: "tag": "c12c2a04-dcd6-4673-a98e-93f665d3f5d7", 2024-09-10T22:27:52.345 INFO:teuthology.orchestra.run.smithi019.stdout: "options": "recursive,force" 2024-09-10T22:27:52.345 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-10T22:27:52.345 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:27:52.345 INFO:teuthology.orchestra.run.smithi019.stdout: "scrub_stats": { 2024-09-10T22:27:52.345 INFO:teuthology.orchestra.run.smithi019.stdout: "c12c2a04-dcd6-4673-a98e-93f665d3f5d7": { 2024-09-10T22:27:52.345 INFO:teuthology.orchestra.run.smithi019.stdout: "start_time": "2024-09-10T22:27:49.392329+0000", 2024-09-10T22:27:52.345 INFO:teuthology.orchestra.run.smithi019.stdout: "path": "/", 2024-09-10T22:27:52.346 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_started": 0, 2024-09-10T22:27:52.346 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_passed": 0, 2024-09-10T22:27:52.346 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_failed": 0, 2024-09-10T22:27:52.346 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_skipped": 0 2024-09-10T22:27:52.346 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:27:52.346 INFO:teuthology.orchestra.run.smithi019.stdout: "b38852c8-478a-42ef-8384-b2c55d5313a4": { 2024-09-10T22:27:52.346 INFO:teuthology.orchestra.run.smithi019.stdout: "start_time": "2024-09-10T22:27:00.320308+0000", 2024-09-10T22:27:52.346 INFO:teuthology.orchestra.run.smithi019.stdout: "path": "/", 2024-09-10T22:27:52.346 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_started": 0, 2024-09-10T22:27:52.346 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_passed": 0, 2024-09-10T22:27:52.346 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_failed": 0, 2024-09-10T22:27:52.346 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_skipped": 0 2024-09-10T22:27:52.346 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:27:52.347 INFO:teuthology.orchestra.run.smithi019.stdout: "9b6bfdee-303c-4c12-af56-dc85860d112a": { 2024-09-10T22:27:52.347 INFO:teuthology.orchestra.run.smithi019.stdout: "start_time": "2024-09-10T22:26:17.484162+0000", 2024-09-10T22:27:52.347 INFO:teuthology.orchestra.run.smithi019.stdout: "path": "/", 2024-09-10T22:27:52.347 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_started": 0, 2024-09-10T22:27:52.347 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_passed": 0, 2024-09-10T22:27:52.347 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_failed": 0, 2024-09-10T22:27:52.347 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_skipped": 0 2024-09-10T22:27:52.347 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-10T22:27:52.347 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-10T22:27:52.347 INFO:teuthology.orchestra.run.smithi019.stdout:} 2024-09-10T22:27:52.348 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:52.338+0000 7f4d4645c640 1 -- 172.21.15.19:0/3646837443 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f4d280b52e0 msgr2=0x7f4d280b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:27:52.348 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:52.338+0000 7f4d4645c640 1 --2- 172.21.15.19:0/3646837443 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f4d280b52e0 0x7f4d280b77a0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x5598213a8db0 tx=0x7f4d3000b410 comp rx=0 tx=0).stop 2024-09-10T22:27:52.348 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:52.338+0000 7f4d4645c640 1 -- 172.21.15.19:0/3646837443 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4d40109170 msgr2=0x7f4d40075f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:27:52.348 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:52.338+0000 7f4d4645c640 1 --2- 172.21.15.19:0/3646837443 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4d40109170 0x7f4d40075f20 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f4d38005e30 tx=0x7f4d380319f0 comp rx=0 tx=0).stop 2024-09-10T22:27:52.348 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:52.338+0000 7f4d4645c640 1 -- 172.21.15.19:0/3646837443 shutdown_connections 2024-09-10T22:27:52.348 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:52.338+0000 7f4d4645c640 1 --2- 172.21.15.19:0/3646837443 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f4d280b52e0 0x7f4d280b77a0 secure :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0x5598213a8db0 tx=0x7f4d3000b410 comp rx=0 tx=0).stop 2024-09-10T22:27:52.348 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:52.338+0000 7f4d4645c640 1 --2- 172.21.15.19:0/3646837443 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4d40109170 0x7f4d40075f20 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:27:52.348 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:52.338+0000 7f4d4645c640 1 --2- 172.21.15.19:0/3646837443 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4d401087f0 0x7f4d400759e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:27:52.348 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:52.338+0000 7f4d4645c640 1 --2- 172.21.15.19:0/3646837443 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f4d40102de0 0x7f4d400754a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:27:52.348 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:52.338+0000 7f4d4645c640 1 -- 172.21.15.19:0/3646837443 >> 172.21.15.19:0/3646837443 conn(0x7f4d400fe830 msgr2=0x7f4d400ff070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:27:52.349 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:52.338+0000 7f4d4645c640 1 -- 172.21.15.19:0/3646837443 shutdown_connections 2024-09-10T22:27:52.349 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:27:52.338+0000 7f4d4645c640 1 -- 172.21.15.19:0/3646837443 wait complete. 2024-09-10T22:27:52.359 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:27:51 smithi135 ceph-mon[34789]: pgmap v390: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 541 MiB/s wr, 552 op/s 2024-09-10T22:27:52.374 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:27:51 smithi138 ceph-mon[35236]: pgmap v390: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 541 MiB/s wr, 552 op/s 2024-09-10T22:27:53.637 INFO:tasks.cephfs.filesystem:scrub status for tag:c12c2a04-dcd6-4673-a98e-93f665d3f5d7 - {'path': '/', 'tag': 'c12c2a04-dcd6-4673-a98e-93f665d3f5d7', 'options': 'recursive,force'} 2024-09-10T22:27:54.359 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:27:54 smithi135 ceph-mon[34789]: pgmap v391: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 921 KiB/s rd, 445 MiB/s wr, 443 op/s 2024-09-10T22:27:54.375 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:27:54 smithi138 ceph-mon[35236]: pgmap v391: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 921 KiB/s rd, 445 MiB/s wr, 443 op/s 2024-09-10T22:27:54.458 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:27:54 smithi019 ceph-mon[31375]: pgmap v391: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 921 KiB/s rd, 445 MiB/s wr, 443 op/s 2024-09-10T22:27:56.360 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:27:56 smithi135 ceph-mon[34789]: pgmap v392: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 921 KiB/s rd, 439 MiB/s wr, 384 op/s 2024-09-10T22:27:56.375 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:27:56 smithi138 ceph-mon[35236]: pgmap v392: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 921 KiB/s rd, 439 MiB/s wr, 384 op/s 2024-09-10T22:27:56.458 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:27:56 smithi019 ceph-mon[31375]: pgmap v392: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 921 KiB/s rd, 439 MiB/s wr, 384 op/s 2024-09-10T22:27:56.755 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:56.753+0000 7f98ebb52640 1 -- 172.21.15.19:0/58437504 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f98e41029b0 msgr2=0x7f98e4102e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:27:56.755 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:56.753+0000 7f98ebb52640 1 --2- 172.21.15.19:0/58437504 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f98e41029b0 0x7f98e4102e30 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f98d4009930 tx=0x7f98d402a420 comp rx=0 tx=0).stop 2024-09-10T22:27:56.755 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:56.753+0000 7f98ebb52640 1 -- 172.21.15.19:0/58437504 shutdown_connections 2024-09-10T22:27:56.755 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:56.753+0000 7f98ebb52640 1 --2- 172.21.15.19:0/58437504 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f98e4103370 0x7f98e4109cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:27:56.755 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:56.753+0000 7f98ebb52640 1 --2- 172.21.15.19:0/58437504 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f98e41029b0 0x7f98e4102e30 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:27:56.755 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:56.753+0000 7f98ebb52640 1 --2- 172.21.15.19:0/58437504 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f98e4101860 0x7f98e4101c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:27:56.755 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:56.753+0000 7f98ebb52640 1 -- 172.21.15.19:0/58437504 >> 172.21.15.19:0/58437504 conn(0x7f98e40fd140 msgr2=0x7f98e40ff560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:27:56.756 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:56.753+0000 7f98ebb52640 1 -- 172.21.15.19:0/58437504 shutdown_connections 2024-09-10T22:27:56.756 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:56.753+0000 7f98ebb52640 1 -- 172.21.15.19:0/58437504 wait complete. 2024-09-10T22:27:56.758 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:56.754+0000 7f98ebb52640 1 Processor -- start 2024-09-10T22:27:56.758 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:56.754+0000 7f98ebb52640 1 -- start start 2024-09-10T22:27:56.758 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:56.754+0000 7f98ebb52640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f98e4101860 0x7f98e4198b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:27:56.758 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:56.754+0000 7f98ebb52640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f98e41029b0 0x7f98e41991c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:27:56.758 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:56.754+0000 7f98ebb52640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f98e4103370 0x7f98e4199df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:27:56.758 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:56.754+0000 7f98ebb52640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f98e410d520 con 0x7f98e41029b0 2024-09-10T22:27:56.758 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:56.754+0000 7f98ebb52640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f98e410d3a0 con 0x7f98e4101860 2024-09-10T22:27:56.758 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:56.754+0000 7f98ebb52640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f98e410d6a0 con 0x7f98e4103370 2024-09-10T22:27:56.758 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:56.755+0000 7f98e90ed640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f98e41029b0 0x7f98e41991c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:27:56.758 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:56.755+0000 7f98e90ed640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f98e41029b0 0x7f98e41991c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:34154/0 (socket says 172.21.15.19:34154) 2024-09-10T22:27:56.759 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:56.755+0000 7f98e90ed640 1 -- 172.21.15.19:0/74250010 learned_addr learned my addr 172.21.15.19:0/74250010 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:27:56.759 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:56.755+0000 7f98ea0ef640 1 --2- 172.21.15.19:0/74250010 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f98e4103370 0x7f98e4199df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:27:56.759 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:56.755+0000 7f98e90ed640 1 -- 172.21.15.19:0/74250010 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f98e4103370 msgr2=0x7f98e4199df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:27:56.759 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:56.755+0000 7f98e90ed640 1 --2- 172.21.15.19:0/74250010 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f98e4103370 0x7f98e4199df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:27:56.759 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:56.755+0000 7f98e90ed640 1 -- 172.21.15.19:0/74250010 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f98e4101860 msgr2=0x7f98e4198b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:27:56.759 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:56.755+0000 7f98e90ed640 1 --2- 172.21.15.19:0/74250010 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f98e4101860 0x7f98e4198b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:27:56.759 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:56.755+0000 7f98e90ed640 1 -- 172.21.15.19:0/74250010 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f98e419a6b0 con 0x7f98e41029b0 2024-09-10T22:27:56.759 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:56.755+0000 7f98e90ed640 1 --2- 172.21.15.19:0/74250010 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f98e41029b0 0x7f98e41991c0 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f98d4009850 tx=0x7f98d4003f80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:27:56.759 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:56.756+0000 7f98daffd640 1 -- 172.21.15.19:0/74250010 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98d403f070 con 0x7f98e41029b0 2024-09-10T22:27:56.759 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:56.756+0000 7f98ebb52640 1 -- 172.21.15.19:0/74250010 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f98e419a940 con 0x7f98e41029b0 2024-09-10T22:27:56.759 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:56.756+0000 7f98daffd640 1 -- 172.21.15.19:0/74250010 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f98d4031dd0 con 0x7f98e41029b0 2024-09-10T22:27:56.759 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:56.756+0000 7f98daffd640 1 -- 172.21.15.19:0/74250010 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98d4035030 con 0x7f98e41029b0 2024-09-10T22:27:56.759 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:56.756+0000 7f98ebb52640 1 -- 172.21.15.19:0/74250010 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f98e41a1070 con 0x7f98e41029b0 2024-09-10T22:27:56.762 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:56.760+0000 7f98daffd640 1 -- 172.21.15.19:0/74250010 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 18) ==== 153250+0+0 (secure 0 0 0) 0x7f98d403b610 con 0x7f98e41029b0 2024-09-10T22:27:56.762 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:56.760+0000 7f98ee9f9740 1 Processor -- start 2024-09-10T22:27:56.762 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:56.760+0000 7f98ee9f9740 1 -- start start 2024-09-10T22:27:56.762 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:56.760+0000 7f98ee9f9740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557211dd1860 0x557211dd3c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:27:56.762 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:56.760+0000 7f98ee9f9740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x557211dd4190 0x557211dd6580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:27:56.762 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:56.760+0000 7f98ee9f9740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x557211dd6bd0 0x557211dd9090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:27:56.762 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:56.760+0000 7f98ee9f9740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x557211d436f0 con 0x557211dd4190 2024-09-10T22:27:56.762 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:56.761+0000 7f98ee9f9740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x557211d32b20 con 0x557211dd1860 2024-09-10T22:27:56.763 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:56.761+0000 7f98ee9f9740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x557211d36930 con 0x557211dd6bd0 2024-09-10T22:27:56.763 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:56.761+0000 7f98e98ee640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x557211dd4190 0x557211dd6580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:27:56.763 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:56.761+0000 7f98e98ee640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x557211dd4190 0x557211dd6580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:34166/0 (socket says 172.21.15.19:34166) 2024-09-10T22:27:56.763 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:56.761+0000 7f98e98ee640 1 -- 172.21.15.19:0/1190879809 learned_addr learned my addr 172.21.15.19:0/1190879809 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:27:56.763 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:56.761+0000 7f98e90ed640 1 --2- 172.21.15.19:0/1190879809 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x557211dd6bd0 0x557211dd9090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:27:56.764 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:56.761+0000 7f98ea0ef640 1 --2- 172.21.15.19:0/1190879809 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557211dd1860 0x557211dd3c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:27:56.764 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:56.761+0000 7f98e98ee640 1 -- 172.21.15.19:0/1190879809 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x557211dd6bd0 msgr2=0x557211dd9090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:27:56.765 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:56.761+0000 7f98e98ee640 1 --2- 172.21.15.19:0/1190879809 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x557211dd6bd0 0x557211dd9090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:27:56.765 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:56.761+0000 7f98e98ee640 1 -- 172.21.15.19:0/1190879809 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557211dd1860 msgr2=0x557211dd3c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:27:56.765 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:56.761+0000 7f98e98ee640 1 --2- 172.21.15.19:0/1190879809 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557211dd1860 0x557211dd3c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:27:56.765 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:56.761+0000 7f98e98ee640 1 -- 172.21.15.19:0/1190879809 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557211cf8530 con 0x557211dd4190 2024-09-10T22:27:56.765 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:56.761+0000 7f98ea0ef640 1 --2- 172.21.15.19:0/1190879809 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557211dd1860 0x557211dd3c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T22:27:56.765 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:56.762+0000 7f98daffd640 1 --2- 172.21.15.19:0/74250010 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f98d00b52e0 0x7f98d00b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:27:56.765 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:56.762+0000 7f98ea0ef640 1 --2- 172.21.15.19:0/74250010 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f98d00b52e0 0x7f98d00b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:27:56.765 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:56.762+0000 7f98e98ee640 1 --2- 172.21.15.19:0/1190879809 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x557211dd4190 0x557211dd6580 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f98e0009c40 tx=0x7f98e000e720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9485ecf0f6f8348e server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:27:56.765 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:56.762+0000 7f98daffd640 1 -- 172.21.15.19:0/74250010 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8327+0+0 (secure 0 0 0) 0x7f98d4106920 con 0x7f98e41029b0 2024-09-10T22:27:56.765 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:56.762+0000 7f98cffff640 1 -- 172.21.15.19:0/1190879809 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98e0005020 con 0x557211dd4190 2024-09-10T22:27:56.765 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:56.762+0000 7f98cffff640 1 -- 172.21.15.19:0/1190879809 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f98e00047a0 con 0x557211dd4190 2024-09-10T22:27:56.765 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:56.762+0000 7f98cffff640 1 -- 172.21.15.19:0/1190879809 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98e0010690 con 0x557211dd4190 2024-09-10T22:27:56.769 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:56.764+0000 7f98ea0ef640 1 --2- 172.21.15.19:0/74250010 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f98d00b52e0 0x7f98d00b77a0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f98e41998f0 tx=0x7f98dc00a440 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:27:56.769 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:56.764+0000 7f98ee9f9740 1 -- 172.21.15.19:0/1190879809 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x557211dd4190 msgr2=0x557211dd6580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:27:56.769 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:56.764+0000 7f98ee9f9740 1 --2- 172.21.15.19:0/1190879809 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x557211dd4190 0x557211dd6580 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f98e0009c40 tx=0x7f98e000e720 comp rx=0 tx=0).stop 2024-09-10T22:27:56.769 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:56.764+0000 7f98ee9f9740 1 -- 172.21.15.19:0/1190879809 shutdown_connections 2024-09-10T22:27:56.770 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:56.764+0000 7f98ee9f9740 1 --2- 172.21.15.19:0/1190879809 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x557211dd6bd0 0x557211dd9090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:27:56.770 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:56.764+0000 7f98ee9f9740 1 --2- 172.21.15.19:0/1190879809 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x557211dd4190 0x557211dd6580 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:27:56.770 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:56.764+0000 7f98ee9f9740 1 --2- 172.21.15.19:0/1190879809 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557211dd1860 0x557211dd3c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:27:56.770 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:56.764+0000 7f98ee9f9740 1 -- 172.21.15.19:0/1190879809 >> 172.21.15.19:0/1190879809 conn(0x557211dcc9b0 msgr2=0x557211dcd740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:27:56.770 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:56.764+0000 7f98ee9f9740 1 -- 172.21.15.19:0/1190879809 shutdown_connections 2024-09-10T22:27:56.770 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:56.764+0000 7f98ee9f9740 1 -- 172.21.15.19:0/1190879809 wait complete. 2024-09-10T22:27:56.770 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:56.765+0000 7f98ee9f9740 1 -- start start 2024-09-10T22:27:56.770 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:56.765+0000 7f98ee9f9740 1 Processor -- start 2024-09-10T22:27:56.770 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:56.765+0000 7f98ee9f9740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x557211dd1860 0x557211ddaf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:27:56.770 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:56.765+0000 7f98ee9f9740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x557211dd4190 0x557211ddb5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:27:56.770 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:56.766+0000 7f98e98ee640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x557211dd1860 0x557211ddaf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:27:56.770 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:56.766+0000 7f98e98ee640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x557211dd1860 0x557211ddaf10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.19:56396/0 (socket says 172.21.15.19:56396) 2024-09-10T22:27:56.770 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:56.766+0000 7f98e98ee640 1 -- 172.21.15.19:0/1576807727 learned_addr learned my addr 172.21.15.19:0/1576807727 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:27:56.771 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:56.766+0000 7f98e90ed640 1 --2- 172.21.15.19:0/1576807727 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x557211dd4190 0x557211ddb5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:27:56.771 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:56.766+0000 7f98ee9f9740 1 --2- 172.21.15.19:0/1576807727 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557211dd6bd0 0x557211ddc180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:27:56.771 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:56.766+0000 7f98ee9f9740 1 -- 172.21.15.19:0/1576807727 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x557211c6aab0 con 0x557211dd4190 2024-09-10T22:27:56.771 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:56.766+0000 7f98ee9f9740 1 -- 172.21.15.19:0/1576807727 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x557211cd8730 con 0x557211dd6bd0 2024-09-10T22:27:56.771 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:56.766+0000 7f98ee9f9740 1 -- 172.21.15.19:0/1576807727 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x557211dd9c00 con 0x557211dd1860 2024-09-10T22:27:56.771 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:56.766+0000 7f98e98ee640 1 -- 172.21.15.19:0/1576807727 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557211dd6bd0 msgr2=0x557211ddc180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:27:56.771 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:56.766+0000 7f98e98ee640 1 --2- 172.21.15.19:0/1576807727 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557211dd6bd0 0x557211ddc180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:27:56.771 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:56.766+0000 7f98e98ee640 1 -- 172.21.15.19:0/1576807727 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x557211dd4190 msgr2=0x557211ddb5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:27:56.771 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:56.766+0000 7f98e98ee640 1 --2- 172.21.15.19:0/1576807727 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x557211dd4190 0x557211ddb5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:27:56.771 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:56.766+0000 7f98e98ee640 1 -- 172.21.15.19:0/1576807727 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557211a94790 con 0x557211dd1860 2024-09-10T22:27:56.771 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:56.766+0000 7f98e90ed640 1 --2- 172.21.15.19:0/1576807727 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x557211dd4190 0x557211ddb5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T22:27:56.771 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:56.766+0000 7f98ee9f9740 10 client.0 _ll_register_callbacks cb 0x557211d2c6b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T22:27:56.771 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:56.766+0000 7f98ee9f9740 1 -- 172.21.15.19:0/1576807727 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f98e00047a0 con 0x557211dd1860 2024-09-10T22:27:56.772 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:56.767+0000 7f98e98ee640 1 --2- 172.21.15.19:0/1576807727 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x557211dd1860 0x557211ddaf10 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f98e0004fd0 tx=0x7f98e0005750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a993fcf7bf3ed1 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:27:56.772 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:56.767+0000 7f98cd7fa640 10 client.25240 ms_handle_connect on v2:172.21.15.138:3300/0 2024-09-10T22:27:56.772 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:56.767+0000 7f98cd7fa640 1 -- 172.21.15.19:0/1576807727 <== mon.1 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98e0026020 con 0x557211dd1860 2024-09-10T22:27:56.772 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:56.767+0000 7f98cd7fa640 1 -- 172.21.15.19:0/1576807727 <== mon.1 v2:172.21.15.138:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8327+0+0 (secure 0 0 0) 0x7f98e0005200 con 0x557211dd1860 2024-09-10T22:27:56.772 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:56.767+0000 7f98cd7fa640 1 -- 172.21.15.19:0/1576807727 <== mon.1 v2:172.21.15.138:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f98e001d040 con 0x557211dd1860 2024-09-10T22:27:56.772 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:56.767+0000 7f98ee9f9740 10 client.25240 fetch_fsmap learned FSMap version 26 2024-09-10T22:27:56.772 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:56.767+0000 7f98ee9f9740 1 -- 172.21.15.19:0/1576807727 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({fsmap=26}) -- 0x557211b0d620 con 0x557211dd1860 2024-09-10T22:27:56.772 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:56.767+0000 7f98cd7fa640 1 -- 172.21.15.19:0/1576807727 <== mon.1 v2:172.21.15.138:3300/0 4 ==== fsmap(e 26) ==== 8350+0+0 (secure 0 0 0) 0x7f98e0018430 con 0x557211dd1860 2024-09-10T22:27:56.772 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:56.767+0000 7f98ee9f9740 10 client.25240 fetch_fsmap finished waiting for FSMap version 26 2024-09-10T22:27:56.772 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:56.767+0000 7f98ee9f9740 10 client.25240 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-10T22:27:56.772 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:56.767+0000 7f98ee9f9740 20 client.25240 populate_metadata read hostname 'smithi019' 2024-09-10T22:27:56.772 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:56.768+0000 7f98ee9f9740 1 --2- 172.21.15.19:0/1576807727 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x557211de6230 0x557211de8640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:27:56.773 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:56.768+0000 7f98ee9f9740 4 client.25240 mds_command: new command op to 24581 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T22:27:56.773 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:56.768+0000 7f98ee9f9740 1 -- 172.21.15.19:0/1576807727 --> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x557211d45640 con 0x557211de6230 2024-09-10T22:27:56.773 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:56.768+0000 7f98e90ed640 1 --2- 172.21.15.19:0/1576807727 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x557211de6230 0x557211de8640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:27:56.774 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:56.769+0000 7f98cd7fa640 10 client.25240 ms_handle_connect on v2:172.21.15.135:6838/1254769802 2024-09-10T22:27:56.774 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:56.769+0000 7f98e90ed640 1 --2- 172.21.15.19:0/1576807727 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x557211de6230 0x557211de8640 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ffab04c66ae4cd44 server_cookie=93802adfb8ff6798 in_seq=0 out_seq=0 2024-09-10T22:27:56.774 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:56.771+0000 7f98cd7fa640 1 -- 172.21.15.19:0/1576807727 <== mds.0 v2:172.21.15.135:6838/1254769802 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x557211d45640 con 0x557211de6230 2024-09-10T22:27:56.774 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:56.771+0000 7f98cd7fa640 10 client.25240 handle_command_reply: tid=0 2024-09-10T22:27:56.774 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:56.771+0000 7f98ee9f9740 1 client.25240 shutdown 2024-09-10T22:27:56.774 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:56.771+0000 7f98ee9f9740 1 -- 172.21.15.19:0/1576807727 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x557211dd1860 msgr2=0x557211ddaf10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:27:56.774 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:56.771+0000 7f98ee9f9740 1 --2- 172.21.15.19:0/1576807727 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x557211dd1860 0x557211ddaf10 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f98e0004fd0 tx=0x7f98e0005750 comp rx=0 tx=0).stop 2024-09-10T22:27:56.774 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:56.771+0000 7f98ee9f9740 1 -- 172.21.15.19:0/1576807727 shutdown_connections 2024-09-10T22:27:56.775 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:56.771+0000 7f98ee9f9740 1 --2- 172.21.15.19:0/1576807727 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557211dd6bd0 0x557211ddc180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:27:56.775 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:56.771+0000 7f98ee9f9740 1 --2- 172.21.15.19:0/1576807727 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x557211dd4190 0x557211ddb5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:27:56.775 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:56.771+0000 7f98ee9f9740 1 --2- 172.21.15.19:0/1576807727 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x557211de6230 0x557211de8640 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:27:56.775 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:56.771+0000 7f98ee9f9740 1 --2- 172.21.15.19:0/1576807727 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x557211dd1860 0x557211ddaf10 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:27:56.775 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:56.771+0000 7f98cd7fa640 0 client.25240 ms_handle_reset on v2:172.21.15.135:6838/1254769802 2024-09-10T22:27:56.775 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:56.771+0000 7f98ee9f9740 1 -- 172.21.15.19:0/1576807727 >> 172.21.15.19:0/1576807727 conn(0x557211dcc9b0 msgr2=0x557211dcbbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:27:56.775 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:56.771+0000 7f98ee9f9740 1 -- 172.21.15.19:0/1576807727 shutdown_connections 2024-09-10T22:27:56.775 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:56.771+0000 7f98ee9f9740 1 -- 172.21.15.19:0/1576807727 wait complete. 2024-09-10T22:27:56.775 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:56.771+0000 7f98ee9f9740 20 client.25240 trim_cache size 0 max 16384 2024-09-10T22:27:56.792 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:56.789+0000 7f98ee9f9740 1 Processor -- start 2024-09-10T22:27:56.792 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:56.790+0000 7f98ee9f9740 1 -- start start 2024-09-10T22:27:56.792 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:56.790+0000 7f98ee9f9740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x557211dd1860 0x557211dd12a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:27:56.792 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:56.790+0000 7f98ee9f9740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557211dd4190 0x557211de3150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:27:56.792 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:56.790+0000 7f98ee9f9740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x557211dd6bd0 0x557211dcb3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:27:56.793 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:56.790+0000 7f98ee9f9740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f98e41ac920 con 0x557211dd1860 2024-09-10T22:27:56.793 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:56.790+0000 7f98ee9f9740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f98e41aa1f0 con 0x557211dd4190 2024-09-10T22:27:56.793 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:56.790+0000 7f98ee9f9740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f98e41a8040 con 0x557211dd6bd0 2024-09-10T22:27:56.793 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:56.790+0000 7f98e98ee640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x557211dd1860 0x557211dd12a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:27:56.793 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:56.790+0000 7f98e98ee640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x557211dd1860 0x557211dd12a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:34184/0 (socket says 172.21.15.19:34184) 2024-09-10T22:27:56.793 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:56.790+0000 7f98e98ee640 1 -- 172.21.15.19:0/2765517524 learned_addr learned my addr 172.21.15.19:0/2765517524 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:27:56.793 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:56.790+0000 7f98ea0ef640 1 --2- 172.21.15.19:0/2765517524 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x557211dd6bd0 0x557211dcb3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:27:56.793 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:56.790+0000 7f98e90ed640 1 --2- 172.21.15.19:0/2765517524 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557211dd4190 0x557211de3150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:27:56.793 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:56.790+0000 7f98e98ee640 1 -- 172.21.15.19:0/2765517524 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x557211dd6bd0 msgr2=0x557211dcb3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:27:56.793 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:56.790+0000 7f98e98ee640 1 --2- 172.21.15.19:0/2765517524 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x557211dd6bd0 0x557211dcb3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:27:56.793 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:56.790+0000 7f98e98ee640 1 -- 172.21.15.19:0/2765517524 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557211dd4190 msgr2=0x557211de3150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:27:56.793 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:56.790+0000 7f98e98ee640 1 --2- 172.21.15.19:0/2765517524 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557211dd4190 0x557211de3150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:27:56.793 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:56.790+0000 7f98e98ee640 1 -- 172.21.15.19:0/2765517524 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557211dcdc10 con 0x557211dd1860 2024-09-10T22:27:56.794 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:56.790+0000 7f98e90ed640 1 --2- 172.21.15.19:0/2765517524 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557211dd4190 0x557211de3150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T22:27:56.794 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:56.791+0000 7f98e98ee640 1 --2- 172.21.15.19:0/2765517524 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x557211dd1860 0x557211dd12a0 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f98e00096f0 tx=0x7f98e001e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=509431199ff7971f server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:27:56.794 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:56.791+0000 7f98cf7fe640 1 -- 172.21.15.19:0/2765517524 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98e0026040 con 0x557211dd1860 2024-09-10T22:27:56.794 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:56.791+0000 7f98cf7fe640 1 -- 172.21.15.19:0/2765517524 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f98e00047a0 con 0x557211dd1860 2024-09-10T22:27:56.794 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:56.791+0000 7f98cf7fe640 1 -- 172.21.15.19:0/2765517524 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98e0034440 con 0x557211dd1860 2024-09-10T22:27:56.797 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:56.792+0000 7f98ee9f9740 1 -- 172.21.15.19:0/2765517524 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x557211dd1860 msgr2=0x557211dd12a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:27:56.797 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:56.792+0000 7f98ee9f9740 1 --2- 172.21.15.19:0/2765517524 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x557211dd1860 0x557211dd12a0 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f98e00096f0 tx=0x7f98e001e000 comp rx=0 tx=0).stop 2024-09-10T22:27:56.797 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:56.792+0000 7f98ee9f9740 1 -- 172.21.15.19:0/2765517524 shutdown_connections 2024-09-10T22:27:56.797 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:56.792+0000 7f98ee9f9740 1 --2- 172.21.15.19:0/2765517524 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x557211dd6bd0 0x557211dcb3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:27:56.797 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:56.792+0000 7f98ee9f9740 1 --2- 172.21.15.19:0/2765517524 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557211dd4190 0x557211de3150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:27:56.798 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:56.792+0000 7f98ee9f9740 1 --2- 172.21.15.19:0/2765517524 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x557211dd1860 0x557211dd12a0 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:27:56.798 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:56.792+0000 7f98ee9f9740 1 -- 172.21.15.19:0/2765517524 >> 172.21.15.19:0/2765517524 conn(0x557211dcc9b0 msgr2=0x557211dd0b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:27:56.798 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:56.792+0000 7f98ee9f9740 1 -- 172.21.15.19:0/2765517524 shutdown_connections 2024-09-10T22:27:56.798 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:56.792+0000 7f98ee9f9740 1 -- 172.21.15.19:0/2765517524 wait complete. 2024-09-10T22:27:56.798 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:56.792+0000 7f98ee9f9740 1 -- start start 2024-09-10T22:27:56.798 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:56.792+0000 7f98ee9f9740 1 Processor -- start 2024-09-10T22:27:56.798 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:56.793+0000 7f98ee9f9740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557211dd1860 0x557211de01a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:27:56.798 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:56.793+0000 7f98ee9f9740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x557211dd4190 0x557211de0840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:27:56.798 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:56.793+0000 7f98ee9f9740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x557211dd6bd0 0x557211de1410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:27:56.798 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:56.793+0000 7f98ee9f9740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f98e41a86b0 con 0x557211dd4190 2024-09-10T22:27:56.798 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:56.793+0000 7f98ee9f9740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f98e41a9b20 con 0x557211dd1860 2024-09-10T22:27:56.798 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:56.793+0000 7f98ee9f9740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f98e41a8d80 con 0x557211dd6bd0 2024-09-10T22:27:56.799 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:56.793+0000 7f98e90ed640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x557211dd4190 0x557211de0840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:27:56.799 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:56.793+0000 7f98e90ed640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x557211dd4190 0x557211de0840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:34188/0 (socket says 172.21.15.19:34188) 2024-09-10T22:27:56.799 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:56.793+0000 7f98e90ed640 1 -- 172.21.15.19:0/880215056 learned_addr learned my addr 172.21.15.19:0/880215056 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:27:56.799 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:56.793+0000 7f98e98ee640 1 --2- 172.21.15.19:0/880215056 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557211dd1860 0x557211de01a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:27:56.799 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:56.793+0000 7f98ee9f9740 10 client.0 _ll_register_callbacks cb 0x7f98e0009b10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T22:27:56.799 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:56.793+0000 7f98ea0ef640 1 --2- 172.21.15.19:0/880215056 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x557211dd6bd0 0x557211de1410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:27:56.799 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:56.793+0000 7f98e98ee640 1 -- 172.21.15.19:0/880215056 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x557211dd6bd0 msgr2=0x557211de1410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:27:56.799 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:56.793+0000 7f98e98ee640 1 --2- 172.21.15.19:0/880215056 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x557211dd6bd0 0x557211de1410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:27:56.799 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:56.793+0000 7f98e98ee640 1 -- 172.21.15.19:0/880215056 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x557211dd4190 msgr2=0x557211de0840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:27:56.799 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:56.793+0000 7f98e98ee640 1 --2- 172.21.15.19:0/880215056 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x557211dd4190 0x557211de0840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:27:56.799 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:56.793+0000 7f98e98ee640 1 -- 172.21.15.19:0/880215056 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557211de1c40 con 0x557211dd1860 2024-09-10T22:27:56.799 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:56.793+0000 7f98e90ed640 1 --2- 172.21.15.19:0/880215056 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x557211dd4190 0x557211de0840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T22:27:56.800 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:56.794+0000 7f98e98ee640 1 --2- 172.21.15.19:0/880215056 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557211dd1860 0x557211de01a0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f98e0009c40 tx=0x7f98e00040c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4a0ff12f910858cc server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:27:56.800 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:56.794+0000 7f98cd7fa640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-09-10T22:27:56.800 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:56.794+0000 7f98cd7fa640 1 -- 172.21.15.19:0/880215056 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98e0043060 con 0x557211dd1860 2024-09-10T22:27:56.800 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:56.794+0000 7f98ee9f9740 1 -- 172.21.15.19:0/880215056 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f98e00047a0 con 0x557211dd1860 2024-09-10T22:27:56.800 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:56.794+0000 7f98cd7fa640 1 -- 172.21.15.19:0/880215056 <== mon.2 v2:172.21.15.135:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8327+0+0 (secure 0 0 0) 0x7f98e00035f0 con 0x557211dd1860 2024-09-10T22:27:56.800 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:56.794+0000 7f98cd7fa640 1 -- 172.21.15.19:0/880215056 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f98e0026050 con 0x557211dd1860 2024-09-10T22:27:56.800 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:56.794+0000 7f98ee9f9740 10 client.25274 fetch_fsmap learned FSMap version 26 2024-09-10T22:27:56.800 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:56.794+0000 7f98ee9f9740 1 -- 172.21.15.19:0/880215056 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x557211de2fb0 con 0x557211dd1860 2024-09-10T22:27:56.800 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:56.794+0000 7f98cd7fa640 1 -- 172.21.15.19:0/880215056 <== mon.2 v2:172.21.15.135:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f98e00047a0 con 0x557211dd1860 2024-09-10T22:27:56.800 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:56.794+0000 7f98cd7fa640 1 -- 172.21.15.19:0/880215056 <== mon.2 v2:172.21.15.135:3300/0 5 ==== fsmap(e 26) ==== 8350+0+0 (secure 0 0 0) 0x7f98e0047030 con 0x557211dd1860 2024-09-10T22:27:56.800 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:56.794+0000 7f98ee9f9740 10 client.25274 fetch_fsmap finished waiting for FSMap version 26 2024-09-10T22:27:56.800 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:56.794+0000 7f98ee9f9740 10 client.25274 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-10T22:27:56.800 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:56.794+0000 7f98ee9f9740 20 client.25274 populate_metadata read hostname 'smithi019' 2024-09-10T22:27:56.801 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:56.794+0000 7f98ee9f9740 1 --2- 172.21.15.19:0/880215056 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x557211e57770 0x557211e59b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:27:56.801 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:56.794+0000 7f98ee9f9740 4 client.25274 mds_command: new command op to 24581 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-10T22:27:56.801 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:56.794+0000 7f98ee9f9740 1 -- 172.21.15.19:0/880215056 --> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] -- command(tid 0: {"prefix": "flush journal"}) -- 0x557211d410f0 con 0x557211e57770 2024-09-10T22:27:56.801 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:56.794+0000 7f98e90ed640 1 --2- 172.21.15.19:0/880215056 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x557211e57770 0x557211e59b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:27:56.801 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:56.795+0000 7f98cd7fa640 10 client.25274 ms_handle_connect on v2:172.21.15.135:6838/1254769802 2024-09-10T22:27:56.801 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:27:56.795+0000 7f98e90ed640 1 --2- 172.21.15.19:0/880215056 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x557211e57770 0x557211e59b60 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2ee6518cea4f6d2a server_cookie=c897d6dfaedda4f in_seq=0 out_seq=0 2024-09-10T22:27:57.610 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:27:57 smithi135 ceph-mon[34789]: pgmap v393: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 509 MiB/s wr, 368 op/s 2024-09-10T22:27:57.625 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:27:57 smithi138 ceph-mon[35236]: pgmap v393: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 509 MiB/s wr, 368 op/s 2024-09-10T22:27:57.708 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:27:57 smithi019 ceph-mon[31375]: pgmap v393: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 509 MiB/s wr, 368 op/s 2024-09-10T22:27:58.709 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:27:58 smithi019 ceph-mon[31375]: scrub summary: idle 2024-09-10T22:27:58.709 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:27:58 smithi019 ceph-mon[31375]: scrub summary: idle 2024-09-10T22:27:58.860 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:27:58 smithi135 ceph-mon[34789]: scrub summary: idle 2024-09-10T22:27:58.860 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:27:58 smithi135 ceph-mon[34789]: scrub summary: idle 2024-09-10T22:27:58.875 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:27:58 smithi138 ceph-mon[35236]: scrub summary: idle 2024-09-10T22:27:58.875 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:27:58 smithi138 ceph-mon[35236]: scrub summary: idle 2024-09-10T22:27:59.709 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:27:59 smithi019 ceph-mon[31375]: pgmap v394: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 429 MiB/s wr, 260 op/s 2024-09-10T22:27:59.860 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:27:59 smithi135 ceph-mon[34789]: pgmap v394: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 429 MiB/s wr, 260 op/s 2024-09-10T22:27:59.875 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:27:59 smithi138 ceph-mon[35236]: pgmap v394: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 429 MiB/s wr, 260 op/s 2024-09-10T22:28:01.861 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:28:01 smithi135 ceph-mon[34789]: pgmap v395: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 555 MiB/s wr, 462 op/s 2024-09-10T22:28:01.875 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:28:01 smithi138 ceph-mon[35236]: pgmap v395: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 555 MiB/s wr, 462 op/s 2024-09-10T22:28:01.965 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:28:01 smithi019 ceph-mon[31375]: pgmap v395: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 555 MiB/s wr, 462 op/s 2024-09-10T22:28:03.319 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:03.316+0000 7f98cd7fa640 1 -- 172.21.15.19:0/880215056 <== mds.0 v2:172.21.15.135:6838/1254769802 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x557211d410f0 con 0x557211e57770 2024-09-10T22:28:03.319 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:03.316+0000 7f98cd7fa640 10 client.25274 handle_command_reply: tid=0 2024-09-10T22:28:03.319 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:03.316+0000 7f98ee9f9740 1 client.25274 shutdown 2024-09-10T22:28:03.319 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:03.316+0000 7f98ee9f9740 1 -- 172.21.15.19:0/880215056 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557211dd1860 msgr2=0x557211de01a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:28:03.319 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:03.316+0000 7f98ee9f9740 1 --2- 172.21.15.19:0/880215056 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557211dd1860 0x557211de01a0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f98e0009c40 tx=0x7f98e00040c0 comp rx=0 tx=0).stop 2024-09-10T22:28:03.319 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:03.316+0000 7f98ee9f9740 1 -- 172.21.15.19:0/880215056 shutdown_connections 2024-09-10T22:28:03.319 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:03.316+0000 7f98ee9f9740 1 --2- 172.21.15.19:0/880215056 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x557211e57770 0x557211e59b60 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:28:03.320 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:03.316+0000 7f98ee9f9740 1 --2- 172.21.15.19:0/880215056 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x557211dd6bd0 0x557211de1410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:28:03.320 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:03.316+0000 7f98ee9f9740 1 --2- 172.21.15.19:0/880215056 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x557211dd4190 0x557211de0840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:28:03.320 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:03.316+0000 7f98cd7fa640 0 client.25274 ms_handle_reset on v2:172.21.15.135:6838/1254769802 2024-09-10T22:28:03.320 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:03.316+0000 7f98ee9f9740 1 --2- 172.21.15.19:0/880215056 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557211dd1860 0x557211de01a0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:28:03.320 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:03.316+0000 7f98ee9f9740 1 -- 172.21.15.19:0/880215056 >> 172.21.15.19:0/880215056 conn(0x557211dcc9b0 msgr2=0x557211dda000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:28:03.320 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:03.316+0000 7f98ee9f9740 1 -- 172.21.15.19:0/880215056 shutdown_connections 2024-09-10T22:28:03.320 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:03.316+0000 7f98ee9f9740 1 -- 172.21.15.19:0/880215056 wait complete. 2024-09-10T22:28:03.320 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:03.316+0000 7f98ee9f9740 20 client.25274 trim_cache size 0 max 16384 2024-09-10T22:28:03.320 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stdout:{ 2024-09-10T22:28:03.321 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stdout: "message": "", 2024-09-10T22:28:03.321 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stdout: "return_code": 0 2024-09-10T22:28:03.321 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stdout:} 2024-09-10T22:28:03.322 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:03.317+0000 7f98ebb52640 1 -- 172.21.15.19:0/74250010 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f98d00b52e0 msgr2=0x7f98d00b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:28:03.322 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:03.317+0000 7f98ebb52640 1 --2- 172.21.15.19:0/74250010 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f98d00b52e0 0x7f98d00b77a0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f98e41998f0 tx=0x7f98dc00a440 comp rx=0 tx=0).stop 2024-09-10T22:28:03.322 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:03.317+0000 7f98ebb52640 1 -- 172.21.15.19:0/74250010 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f98e41029b0 msgr2=0x7f98e41991c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:28:03.322 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:03.317+0000 7f98ebb52640 1 --2- 172.21.15.19:0/74250010 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f98e41029b0 0x7f98e41991c0 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f98d4009850 tx=0x7f98d4003f80 comp rx=0 tx=0).stop 2024-09-10T22:28:03.322 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:03.317+0000 7f98ebb52640 1 -- 172.21.15.19:0/74250010 shutdown_connections 2024-09-10T22:28:03.322 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:03.317+0000 7f98ebb52640 1 --2- 172.21.15.19:0/74250010 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f98d00b52e0 0x7f98d00b77a0 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:28:03.322 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:03.317+0000 7f98ebb52640 1 --2- 172.21.15.19:0/74250010 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f98e4103370 0x7f98e4199df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:28:03.322 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:03.317+0000 7f98ebb52640 1 --2- 172.21.15.19:0/74250010 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f98e41029b0 0x7f98e41991c0 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:28:03.322 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:03.317+0000 7f98ebb52640 1 --2- 172.21.15.19:0/74250010 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f98e4101860 0x7f98e4198b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:28:03.322 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:03.317+0000 7f98ebb52640 1 -- 172.21.15.19:0/74250010 >> 172.21.15.19:0/74250010 conn(0x7f98e40fd140 msgr2=0x7f98e406b160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:28:03.322 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:03.317+0000 7f98ebb52640 1 -- 172.21.15.19:0/74250010 shutdown_connections 2024-09-10T22:28:03.323 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:03.317+0000 7f98ebb52640 1 -- 172.21.15.19:0/74250010 wait complete. 2024-09-10T22:28:04.110 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:28:03 smithi135 ceph-mon[34789]: pgmap v396: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 517 MiB/s wr, 599 op/s 2024-09-10T22:28:04.124 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:28:03 smithi138 ceph-mon[35236]: pgmap v396: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 517 MiB/s wr, 599 op/s 2024-09-10T22:28:04.209 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:28:03 smithi019 ceph-mon[31375]: pgmap v396: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 517 MiB/s wr, 599 op/s 2024-09-10T22:28:06.110 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:28:05 smithi135 ceph-mon[34789]: pgmap v397: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 973 KiB/s rd, 503 MiB/s wr, 769 op/s 2024-09-10T22:28:06.125 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:28:05 smithi138 ceph-mon[35236]: pgmap v397: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 973 KiB/s rd, 503 MiB/s wr, 769 op/s 2024-09-10T22:28:06.208 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:28:05 smithi019 ceph-mon[31375]: pgmap v397: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 973 KiB/s rd, 503 MiB/s wr, 769 op/s 2024-09-10T22:28:08.110 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:28:07 smithi135 ceph-mon[34789]: pgmap v398: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 526 MiB/s wr, 835 op/s 2024-09-10T22:28:08.125 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:28:07 smithi138 ceph-mon[35236]: pgmap v398: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 526 MiB/s wr, 835 op/s 2024-09-10T22:28:08.208 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:28:07 smithi019 ceph-mon[31375]: pgmap v398: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 526 MiB/s wr, 835 op/s 2024-09-10T22:28:10.209 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:28:09 smithi019 ceph-mon[31375]: pgmap v399: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 865 KiB/s rd, 409 MiB/s wr, 767 op/s 2024-09-10T22:28:10.359 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:28:09 smithi135 ceph-mon[34789]: pgmap v399: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 865 KiB/s rd, 409 MiB/s wr, 767 op/s 2024-09-10T22:28:10.374 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:28:09 smithi138 ceph-mon[35236]: pgmap v399: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 865 KiB/s rd, 409 MiB/s wr, 767 op/s 2024-09-10T22:28:12.360 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:28:11 smithi135 ceph-mon[34789]: pgmap v400: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 504 MiB/s wr, 799 op/s 2024-09-10T22:28:12.375 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:28:11 smithi138 ceph-mon[35236]: pgmap v400: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 504 MiB/s wr, 799 op/s 2024-09-10T22:28:12.458 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:28:11 smithi019 ceph-mon[31375]: pgmap v400: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 504 MiB/s wr, 799 op/s 2024-09-10T22:28:14.359 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:28:14 smithi135 ceph-mon[34789]: pgmap v401: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 412 MiB/s wr, 691 op/s 2024-09-10T22:28:14.374 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:28:14 smithi138 ceph-mon[35236]: pgmap v401: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 412 MiB/s wr, 691 op/s 2024-09-10T22:28:14.458 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:28:14 smithi019 ceph-mon[31375]: pgmap v401: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 412 MiB/s wr, 691 op/s 2024-09-10T22:28:16.375 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:28:16 smithi138 ceph-mon[35236]: pgmap v402: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 393 MiB/s wr, 683 op/s 2024-09-10T22:28:16.458 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:28:16 smithi019 ceph-mon[31375]: pgmap v402: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 393 MiB/s wr, 683 op/s 2024-09-10T22:28:16.547 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:16.542+0000 7f574b765640 1 -- 172.21.15.19:0/3252971020 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5744105ad0 msgr2=0x7f5744107f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:28:16.547 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:16.542+0000 7f574b765640 1 --2- 172.21.15.19:0/3252971020 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5744105ad0 0x7f5744107f40 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f5734009900 tx=0x7f573402a420 comp rx=0 tx=0).stop 2024-09-10T22:28:16.547 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:16.542+0000 7f574b765640 1 -- 172.21.15.19:0/3252971020 shutdown_connections 2024-09-10T22:28:16.548 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:16.542+0000 7f574b765640 1 --2- 172.21.15.19:0/3252971020 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5744108680 0x7f574410ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:28:16.548 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:16.542+0000 7f574b765640 1 --2- 172.21.15.19:0/3252971020 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5744105ad0 0x7f5744107f40 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:28:16.548 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:16.542+0000 7f574b765640 1 --2- 172.21.15.19:0/3252971020 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f574406b410 0x7f5744105590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:28:16.548 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:16.542+0000 7f574b765640 1 -- 172.21.15.19:0/3252971020 >> 172.21.15.19:0/3252971020 conn(0x7f57440fd140 msgr2=0x7f57440ff560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:28:16.548 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:16.542+0000 7f574b765640 1 -- 172.21.15.19:0/3252971020 shutdown_connections 2024-09-10T22:28:16.548 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:16.542+0000 7f574b765640 1 -- 172.21.15.19:0/3252971020 wait complete. 2024-09-10T22:28:16.548 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:16.543+0000 7f574b765640 1 Processor -- start 2024-09-10T22:28:16.548 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:16.543+0000 7f574b765640 1 -- start start 2024-09-10T22:28:16.548 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:16.543+0000 7f574b765640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f574406b410 0x7f57441962b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:28:16.548 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:16.543+0000 7f574b765640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5744105ad0 0x7f5744196900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:28:16.548 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:16.543+0000 7f574b765640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5744108680 0x7f5744197530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:28:16.549 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:16.543+0000 7f574b765640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f57441107b0 con 0x7f574406b410 2024-09-10T22:28:16.549 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:16.543+0000 7f574b765640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f5744110630 con 0x7f5744108680 2024-09-10T22:28:16.549 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:16.543+0000 7f574b765640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f5744110930 con 0x7f5744105ad0 2024-09-10T22:28:16.549 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:16.544+0000 7f5748d00640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5744105ad0 0x7f5744196900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:28:16.549 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:16.544+0000 7f5749501640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f574406b410 0x7f57441962b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:28:16.549 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:16.544+0000 7f5748d00640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5744105ad0 0x7f5744196900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.19:34706/0 (socket says 172.21.15.19:34706) 2024-09-10T22:28:16.549 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:16.544+0000 7f5748d00640 1 -- 172.21.15.19:0/2415004154 learned_addr learned my addr 172.21.15.19:0/2415004154 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:28:16.549 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:16.544+0000 7f5749d02640 1 --2- 172.21.15.19:0/2415004154 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5744108680 0x7f5744197530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:28:16.549 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:16.544+0000 7f5748d00640 1 -- 172.21.15.19:0/2415004154 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5744108680 msgr2=0x7f5744197530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:28:16.549 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:16.544+0000 7f5748d00640 1 --2- 172.21.15.19:0/2415004154 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5744108680 0x7f5744197530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:28:16.549 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:16.544+0000 7f5748d00640 1 -- 172.21.15.19:0/2415004154 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f574406b410 msgr2=0x7f57441962b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:28:16.549 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:16.544+0000 7f5748d00640 1 --2- 172.21.15.19:0/2415004154 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f574406b410 0x7f57441962b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:28:16.550 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:16.544+0000 7f5748d00640 1 -- 172.21.15.19:0/2415004154 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5744197d30 con 0x7f5744105ad0 2024-09-10T22:28:16.550 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:16.544+0000 7f5749d02640 1 --2- 172.21.15.19:0/2415004154 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5744108680 0x7f5744197530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T22:28:16.550 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:16.544+0000 7f5748d00640 1 --2- 172.21.15.19:0/2415004154 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5744105ad0 0x7f5744196900 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f5734005ab0 tx=0x7f5734004270 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:28:16.550 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:16.545+0000 7f573a7fc640 1 -- 172.21.15.19:0/2415004154 <== mon.1 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f573403f030 con 0x7f5744105ad0 2024-09-10T22:28:16.550 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:16.545+0000 7f573a7fc640 1 -- 172.21.15.19:0/2415004154 <== mon.1 v2:172.21.15.138:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5734003aa0 con 0x7f5744105ad0 2024-09-10T22:28:16.550 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:16.545+0000 7f573a7fc640 1 -- 172.21.15.19:0/2415004154 <== mon.1 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5734035070 con 0x7f5744105ad0 2024-09-10T22:28:16.550 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:16.545+0000 7f574b765640 1 -- 172.21.15.19:0/2415004154 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5744197fc0 con 0x7f5744105ad0 2024-09-10T22:28:16.550 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:16.545+0000 7f574b765640 1 -- 172.21.15.19:0/2415004154 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f57441aff80 con 0x7f5744105ad0 2024-09-10T22:28:16.555 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:16.547+0000 7f573a7fc640 1 -- 172.21.15.19:0/2415004154 <== mon.1 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 18) ==== 153250+0+0 (secure 0 0 0) 0x7f57340035f0 con 0x7f5744105ad0 2024-09-10T22:28:16.555 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:16.548+0000 7f574e60e740 1 Processor -- start 2024-09-10T22:28:16.555 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:16.548+0000 7f574e60e740 1 -- start start 2024-09-10T22:28:16.555 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:16.548+0000 7f574e60e740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x564ceb682860 0x564ceb684c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:28:16.555 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:16.548+0000 7f574e60e740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564ceb685190 0x564ceb687580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:28:16.555 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:16.548+0000 7f574e60e740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x564ceb687bd0 0x564ceb68a090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:28:16.555 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:16.548+0000 7f574e60e740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x564ceb5f46f0 con 0x564ceb687bd0 2024-09-10T22:28:16.556 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:16.548+0000 7f574e60e740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x564ceb5e3b20 con 0x564ceb685190 2024-09-10T22:28:16.556 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:16.548+0000 7f574e60e740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x564ceb5e7930 con 0x564ceb682860 2024-09-10T22:28:16.556 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:16.549+0000 7f5749501640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564ceb685190 0x564ceb687580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:28:16.556 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:16.549+0000 7f5749d02640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x564ceb682860 0x564ceb684c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:28:16.556 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:16.549+0000 7f5749501640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564ceb685190 0x564ceb687580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.19:48102/0 (socket says 172.21.15.19:48102) 2024-09-10T22:28:16.556 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:16.549+0000 7f5749d02640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x564ceb682860 0x564ceb684c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.19:34712/0 (socket says 172.21.15.19:34712) 2024-09-10T22:28:16.556 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:16.549+0000 7f5749501640 1 -- 172.21.15.19:0/4164967072 learned_addr learned my addr 172.21.15.19:0/4164967072 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:28:16.556 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:16.549+0000 7f5748d00640 1 --2- 172.21.15.19:0/4164967072 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x564ceb687bd0 0x564ceb68a090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:28:16.556 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:16.549+0000 7f573a7fc640 1 --2- 172.21.15.19:0/2415004154 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f57300b5360 0x7f57300b7820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:28:16.556 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:16.549+0000 7f5749501640 1 -- 172.21.15.19:0/4164967072 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x564ceb682860 msgr2=0x564ceb684c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:28:16.556 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:16.549+0000 7f5749501640 1 --2- 172.21.15.19:0/4164967072 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x564ceb682860 0x564ceb684c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:28:16.556 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:16.549+0000 7f5749501640 1 -- 172.21.15.19:0/4164967072 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x564ceb687bd0 msgr2=0x564ceb68a090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:28:16.557 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:16.549+0000 7f5749501640 1 --2- 172.21.15.19:0/4164967072 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x564ceb687bd0 0x564ceb68a090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:28:16.557 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:16.549+0000 7f5749501640 1 -- 172.21.15.19:0/4164967072 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564ceb5a9530 con 0x564ceb685190 2024-09-10T22:28:16.557 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:16.549+0000 7f5749d02640 1 --2- 172.21.15.19:0/2415004154 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f57300b5360 0x7f57300b7820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:28:16.557 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:16.549+0000 7f5749501640 1 --2- 172.21.15.19:0/4164967072 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564ceb685190 0x564ceb687580 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f5740009c80 tx=0x7f57400117b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2264067ba03bb8c6 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:28:16.557 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:16.549+0000 7f573a7fc640 1 -- 172.21.15.19:0/2415004154 <== mon.1 v2:172.21.15.138:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8327+0+0 (secure 0 0 0) 0x7f57341066d0 con 0x7f5744105ad0 2024-09-10T22:28:16.557 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:16.549+0000 7f572f7fe640 1 -- 172.21.15.19:0/4164967072 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5740012450 con 0x564ceb685190 2024-09-10T22:28:16.557 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:16.550+0000 7f572f7fe640 1 -- 172.21.15.19:0/4164967072 <== mon.2 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5740012aa0 con 0x564ceb685190 2024-09-10T22:28:16.557 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:16.550+0000 7f572f7fe640 1 -- 172.21.15.19:0/4164967072 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f574000fc20 con 0x564ceb685190 2024-09-10T22:28:16.557 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:16.550+0000 7f574e60e740 1 -- 172.21.15.19:0/4164967072 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564ceb685190 msgr2=0x564ceb687580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:28:16.557 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:16.550+0000 7f5749d02640 1 --2- 172.21.15.19:0/2415004154 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f57300b5360 0x7f57300b7820 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f5744197030 tx=0x7f573c004ab0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:28:16.557 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:16.550+0000 7f574e60e740 1 --2- 172.21.15.19:0/4164967072 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564ceb685190 0x564ceb687580 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f5740009c80 tx=0x7f57400117b0 comp rx=0 tx=0).stop 2024-09-10T22:28:16.557 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:16.550+0000 7f574e60e740 1 -- 172.21.15.19:0/4164967072 shutdown_connections 2024-09-10T22:28:16.558 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:16.550+0000 7f574e60e740 1 --2- 172.21.15.19:0/4164967072 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x564ceb687bd0 0x564ceb68a090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:28:16.558 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:16.550+0000 7f574e60e740 1 --2- 172.21.15.19:0/4164967072 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564ceb685190 0x564ceb687580 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:28:16.558 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:16.550+0000 7f574e60e740 1 --2- 172.21.15.19:0/4164967072 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x564ceb682860 0x564ceb684c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:28:16.558 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:16.550+0000 7f574e60e740 1 -- 172.21.15.19:0/4164967072 >> 172.21.15.19:0/4164967072 conn(0x564ceb67d9b0 msgr2=0x564ceb67e740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:28:16.558 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:16.550+0000 7f574e60e740 1 -- 172.21.15.19:0/4164967072 shutdown_connections 2024-09-10T22:28:16.558 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:16.551+0000 7f574e60e740 1 -- 172.21.15.19:0/4164967072 wait complete. 2024-09-10T22:28:16.558 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:16.551+0000 7f574e60e740 1 -- start start 2024-09-10T22:28:16.558 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:16.551+0000 7f574e60e740 1 Processor -- start 2024-09-10T22:28:16.558 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:16.551+0000 7f574e60e740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x564ceb682860 0x564ceb68bec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:28:16.558 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:16.551+0000 7f574e60e740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564ceb685190 0x564ceb68c560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:28:16.558 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:16.551+0000 7f574e60e740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x564ceb687bd0 0x564ceb68d130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:28:16.558 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:16.551+0000 7f574e60e740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x564ceb51bab0 con 0x564ceb687bd0 2024-09-10T22:28:16.558 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:16.552+0000 7f574e60e740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x564ceb589730 con 0x564ceb685190 2024-09-10T22:28:16.559 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:16.552+0000 7f574e60e740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x564ceb68abb0 con 0x564ceb682860 2024-09-10T22:28:16.559 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:16.552+0000 7f574e60e740 10 client.0 _ll_register_callbacks cb 0x564ceb5dd6b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T22:28:16.559 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:16.552+0000 7f5748d00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564ceb685190 0x564ceb68c560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:28:16.559 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:16.552+0000 7f5749501640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x564ceb682860 0x564ceb68bec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:28:16.559 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:16.552+0000 7f5749501640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x564ceb682860 0x564ceb68bec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.19:34714/0 (socket says 172.21.15.19:34714) 2024-09-10T22:28:16.559 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:16.552+0000 7f5748d00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564ceb685190 0x564ceb68c560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.19:48108/0 (socket says 172.21.15.19:48108) 2024-09-10T22:28:16.559 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:16.552+0000 7f5749501640 1 -- 172.21.15.19:0/3895988317 learned_addr learned my addr 172.21.15.19:0/3895988317 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:28:16.559 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:16.552+0000 7f5749d02640 1 --2- 172.21.15.19:0/3895988317 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x564ceb687bd0 0x564ceb68d130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:28:16.559 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:16.552+0000 7f5749501640 1 -- 172.21.15.19:0/3895988317 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564ceb685190 msgr2=0x564ceb68c560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:28:16.559 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:16.552+0000 7f5749501640 1 --2- 172.21.15.19:0/3895988317 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564ceb685190 0x564ceb68c560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:28:16.559 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:16.552+0000 7f5749501640 1 -- 172.21.15.19:0/3895988317 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x564ceb687bd0 msgr2=0x564ceb68d130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:28:16.559 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:16.552+0000 7f5749501640 1 --2- 172.21.15.19:0/3895988317 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x564ceb687bd0 0x564ceb68d130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:28:16.559 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:16.552+0000 7f5749501640 1 -- 172.21.15.19:0/3895988317 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564ceb345790 con 0x564ceb682860 2024-09-10T22:28:16.560 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:16.552+0000 7f5749501640 1 --2- 172.21.15.19:0/3895988317 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x564ceb682860 0x564ceb68bec0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f5740009fa0 tx=0x7f5740009fd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=581dcf24b99f30ae server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:28:16.560 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:16.552+0000 7f572cff9640 10 client.0 ms_handle_connect on v2:172.21.15.138:3300/0 2024-09-10T22:28:16.560 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:16.552+0000 7f572cff9640 1 -- 172.21.15.19:0/3895988317 <== mon.1 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5740028020 con 0x564ceb682860 2024-09-10T22:28:16.560 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:16.552+0000 7f572cff9640 1 -- 172.21.15.19:0/3895988317 <== mon.1 v2:172.21.15.138:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8327+0+0 (secure 0 0 0) 0x7f5740012660 con 0x564ceb682860 2024-09-10T22:28:16.560 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:16.552+0000 7f574e60e740 1 -- 172.21.15.19:0/3895988317 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5740012aa0 con 0x564ceb682860 2024-09-10T22:28:16.560 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:16.553+0000 7f572cff9640 1 -- 172.21.15.19:0/3895988317 <== mon.1 v2:172.21.15.138:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f5740033050 con 0x564ceb682860 2024-09-10T22:28:16.560 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:16.553+0000 7f574e60e740 10 client.25258 fetch_fsmap learned FSMap version 26 2024-09-10T22:28:16.560 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:16.553+0000 7f574e60e740 1 -- 172.21.15.19:0/3895988317 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x564ceb3be620 con 0x564ceb682860 2024-09-10T22:28:16.560 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:16.553+0000 7f572cff9640 1 -- 172.21.15.19:0/3895988317 <== mon.1 v2:172.21.15.138:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5740012aa0 con 0x564ceb682860 2024-09-10T22:28:16.560 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:16.553+0000 7f572cff9640 1 -- 172.21.15.19:0/3895988317 <== mon.1 v2:172.21.15.138:3300/0 5 ==== fsmap(e 26) ==== 8350+0+0 (secure 0 0 0) 0x7f5740005170 con 0x564ceb682860 2024-09-10T22:28:16.560 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:16.553+0000 7f574e60e740 10 client.25258 fetch_fsmap finished waiting for FSMap version 26 2024-09-10T22:28:16.560 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:16.553+0000 7f574e60e740 10 client.25258 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-10T22:28:16.561 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:16.553+0000 7f574e60e740 20 client.25258 populate_metadata read hostname 'smithi019' 2024-09-10T22:28:16.561 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:16.553+0000 7f574e60e740 1 --2- 172.21.15.19:0/3895988317 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x564ceb6974d0 0x564ceb6998c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:28:16.561 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:16.553+0000 7f574e60e740 4 client.25258 mds_command: new command op to 24581 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T22:28:16.561 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:16.553+0000 7f574e60e740 1 -- 172.21.15.19:0/3895988317 --> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564ceb5f6640 con 0x564ceb6974d0 2024-09-10T22:28:16.561 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:16.553+0000 7f5748d00640 1 --2- 172.21.15.19:0/3895988317 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x564ceb6974d0 0x564ceb6998c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:28:16.562 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:16.554+0000 7f5748d00640 1 --2- 172.21.15.19:0/3895988317 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x564ceb6974d0 0x564ceb6998c0 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2b011eed0126e6eb server_cookie=e2549d72b90ad4e4 in_seq=0 out_seq=0 2024-09-10T22:28:16.562 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:16.554+0000 7f572cff9640 10 client.25258 ms_handle_connect on v2:172.21.15.135:6838/1254769802 2024-09-10T22:28:16.562 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:16.555+0000 7f572cff9640 1 -- 172.21.15.19:0/3895988317 <== mds.0 v2:172.21.15.135:6838/1254769802 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x564ceb5f6640 con 0x564ceb6974d0 2024-09-10T22:28:16.562 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:16.555+0000 7f572cff9640 10 client.25258 handle_command_reply: tid=0 2024-09-10T22:28:16.562 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:16.555+0000 7f574e60e740 1 client.25258 shutdown 2024-09-10T22:28:16.562 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:16.555+0000 7f574e60e740 1 -- 172.21.15.19:0/3895988317 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x564ceb682860 msgr2=0x564ceb68bec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:28:16.562 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:16.555+0000 7f574e60e740 1 --2- 172.21.15.19:0/3895988317 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x564ceb682860 0x564ceb68bec0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f5740009fa0 tx=0x7f5740009fd0 comp rx=0 tx=0).stop 2024-09-10T22:28:16.563 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:16.556+0000 7f574e60e740 1 -- 172.21.15.19:0/3895988317 shutdown_connections 2024-09-10T22:28:16.563 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:16.556+0000 7f574e60e740 1 --2- 172.21.15.19:0/3895988317 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x564ceb687bd0 0x564ceb68d130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:28:16.563 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:16.556+0000 7f574e60e740 1 --2- 172.21.15.19:0/3895988317 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564ceb685190 0x564ceb68c560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:28:16.563 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:16.556+0000 7f574e60e740 1 --2- 172.21.15.19:0/3895988317 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x564ceb6974d0 0x564ceb6998c0 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:28:16.563 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:16.556+0000 7f574e60e740 1 --2- 172.21.15.19:0/3895988317 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x564ceb682860 0x564ceb68bec0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:28:16.563 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:16.556+0000 7f572cff9640 0 client.25258 ms_handle_reset on v2:172.21.15.135:6838/1254769802 2024-09-10T22:28:16.563 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:16.556+0000 7f574e60e740 1 -- 172.21.15.19:0/3895988317 >> 172.21.15.19:0/3895988317 conn(0x564ceb67d9b0 msgr2=0x564ceb67cbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:28:16.563 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:16.556+0000 7f574e60e740 1 -- 172.21.15.19:0/3895988317 shutdown_connections 2024-09-10T22:28:16.563 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:16.556+0000 7f574e60e740 1 -- 172.21.15.19:0/3895988317 wait complete. 2024-09-10T22:28:16.563 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:16.556+0000 7f574e60e740 20 client.25258 trim_cache size 0 max 16384 2024-09-10T22:28:16.581 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:16.579+0000 7f574e60e740 1 Processor -- start 2024-09-10T22:28:16.581 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:16.579+0000 7f574e60e740 1 -- start start 2024-09-10T22:28:16.581 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:16.579+0000 7f574e60e740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x564ceb682860 0x564ceb6807f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:28:16.581 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:16.579+0000 7f574e60e740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564ceb685190 0x564ceb680d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:28:16.582 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:16.579+0000 7f574e60e740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x564ceb687bd0 0x564ceb69e130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:28:16.582 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:16.579+0000 7f574e60e740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f57441bb830 con 0x564ceb687bd0 2024-09-10T22:28:16.582 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:16.579+0000 7f574e60e740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f57441b9100 con 0x564ceb685190 2024-09-10T22:28:16.582 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:16.579+0000 7f574e60e740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f57441b6f50 con 0x564ceb682860 2024-09-10T22:28:16.582 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:16.579+0000 7f5749d02640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x564ceb687bd0 0x564ceb69e130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:28:16.582 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:16.579+0000 7f5749d02640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x564ceb687bd0 0x564ceb69e130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:35186/0 (socket says 172.21.15.19:35186) 2024-09-10T22:28:16.582 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:16.579+0000 7f5749d02640 1 -- 172.21.15.19:0/2101993561 learned_addr learned my addr 172.21.15.19:0/2101993561 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:28:16.582 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:16.579+0000 7f5748d00640 1 --2- 172.21.15.19:0/2101993561 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564ceb685190 0x564ceb680d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:28:16.582 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:16.579+0000 7f5749d02640 1 -- 172.21.15.19:0/2101993561 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x564ceb682860 msgr2=0x564ceb6807f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:28:16.582 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:16.579+0000 7f5749d02640 1 --2- 172.21.15.19:0/2101993561 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x564ceb682860 0x564ceb6807f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:28:16.582 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:16.579+0000 7f5749d02640 1 -- 172.21.15.19:0/2101993561 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564ceb685190 msgr2=0x564ceb680d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:28:16.582 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:16.579+0000 7f5749d02640 1 --2- 172.21.15.19:0/2101993561 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564ceb685190 0x564ceb680d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:28:16.582 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:16.580+0000 7f5749d02640 1 -- 172.21.15.19:0/2101993561 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564ceb6878f0 con 0x564ceb687bd0 2024-09-10T22:28:16.583 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:16.580+0000 7f5748d00640 1 --2- 172.21.15.19:0/2101993561 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564ceb685190 0x564ceb680d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T22:28:16.583 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:16.580+0000 7f5749d02640 1 --2- 172.21.15.19:0/2101993561 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x564ceb687bd0 0x564ceb69e130 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f573c014430 tx=0x7f573c009c40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8d15f76105f2814d server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:28:16.583 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:16.580+0000 7f572effd640 1 -- 172.21.15.19:0/2101993561 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f573c01a070 con 0x564ceb687bd0 2024-09-10T22:28:16.583 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:16.580+0000 7f572effd640 1 -- 172.21.15.19:0/2101993561 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f573c004d20 con 0x564ceb687bd0 2024-09-10T22:28:16.583 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:16.580+0000 7f572effd640 1 -- 172.21.15.19:0/2101993561 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f573c005950 con 0x564ceb687bd0 2024-09-10T22:28:16.586 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:16.581+0000 7f574e60e740 1 -- 172.21.15.19:0/2101993561 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x564ceb687bd0 msgr2=0x564ceb69e130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:28:16.586 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:16.581+0000 7f574e60e740 1 --2- 172.21.15.19:0/2101993561 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x564ceb687bd0 0x564ceb69e130 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f573c014430 tx=0x7f573c009c40 comp rx=0 tx=0).stop 2024-09-10T22:28:16.586 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:16.581+0000 7f574e60e740 1 -- 172.21.15.19:0/2101993561 shutdown_connections 2024-09-10T22:28:16.586 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:16.581+0000 7f574e60e740 1 --2- 172.21.15.19:0/2101993561 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x564ceb687bd0 0x564ceb69e130 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:28:16.586 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:16.581+0000 7f574e60e740 1 --2- 172.21.15.19:0/2101993561 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564ceb685190 0x564ceb680d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:28:16.586 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:16.581+0000 7f574e60e740 1 --2- 172.21.15.19:0/2101993561 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x564ceb682860 0x564ceb6807f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:28:16.586 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:16.581+0000 7f574e60e740 1 -- 172.21.15.19:0/2101993561 >> 172.21.15.19:0/2101993561 conn(0x564ceb67d9b0 msgr2=0x564ceb67cbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:28:16.586 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:16.581+0000 7f574e60e740 1 -- 172.21.15.19:0/2101993561 shutdown_connections 2024-09-10T22:28:16.586 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:16.582+0000 7f574e60e740 1 -- 172.21.15.19:0/2101993561 wait complete. 2024-09-10T22:28:16.587 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:16.582+0000 7f574e60e740 1 -- start start 2024-09-10T22:28:16.587 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:16.582+0000 7f574e60e740 1 Processor -- start 2024-09-10T22:28:16.587 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:16.583+0000 7f574e60e740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564ceb682860 0x564ceb693af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:28:16.587 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:16.583+0000 7f574e60e740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x564ceb685190 0x564ceb700320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:28:16.587 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:16.583+0000 7f574e60e740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x564ceb687bd0 0x564ceb7029b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:28:16.587 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:16.583+0000 7f574e60e740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f57441b75c0 con 0x564ceb687bd0 2024-09-10T22:28:16.587 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:16.583+0000 7f574e60e740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f57441b8a30 con 0x564ceb682860 2024-09-10T22:28:16.587 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:16.583+0000 7f574e60e740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f57441b7c90 con 0x564ceb685190 2024-09-10T22:28:16.587 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:16.583+0000 7f574e60e740 10 client.0 _ll_register_callbacks cb 0x7f573c009a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T22:28:16.587 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:16.583+0000 7f5748d00640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x564ceb685190 0x564ceb700320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:28:16.587 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:16.583+0000 7f5749501640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564ceb682860 0x564ceb693af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:28:16.587 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:16.583+0000 7f5749d02640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x564ceb687bd0 0x564ceb7029b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:28:16.587 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:16.583+0000 7f5748d00640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x564ceb685190 0x564ceb700320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.19:34724/0 (socket says 172.21.15.19:34724) 2024-09-10T22:28:16.588 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:16.583+0000 7f5748d00640 1 -- 172.21.15.19:0/3531481591 learned_addr learned my addr 172.21.15.19:0/3531481591 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:28:16.588 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:16.583+0000 7f5749d02640 1 --2- 172.21.15.19:0/3531481591 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x564ceb687bd0 0x564ceb7029b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:35196/0 (socket says 172.21.15.19:35196) 2024-09-10T22:28:16.588 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:16.583+0000 7f5749501640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564ceb682860 0x564ceb693af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.19:48126/0 (socket says 172.21.15.19:48126) 2024-09-10T22:28:16.588 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:16.583+0000 7f5748d00640 1 -- 172.21.15.19:0/3531481591 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564ceb682860 msgr2=0x564ceb693af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:28:16.588 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:16.583+0000 7f5748d00640 1 --2- 172.21.15.19:0/3531481591 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564ceb682860 0x564ceb693af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:28:16.588 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:16.583+0000 7f5748d00640 1 -- 172.21.15.19:0/3531481591 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x564ceb687bd0 msgr2=0x564ceb7029b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:28:16.588 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:16.583+0000 7f5748d00640 1 --2- 172.21.15.19:0/3531481591 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x564ceb687bd0 0x564ceb7029b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:28:16.588 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:16.583+0000 7f5748d00640 1 -- 172.21.15.19:0/3531481591 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564ceb7031e0 con 0x564ceb685190 2024-09-10T22:28:16.588 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:16.583+0000 7f5749d02640 1 --2- 172.21.15.19:0/3531481591 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x564ceb687bd0 0x564ceb7029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T22:28:16.588 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:16.583+0000 7f5749501640 1 --2- 172.21.15.19:0/3531481591 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564ceb682860 0x564ceb693af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T22:28:16.588 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:16.584+0000 7f5748d00640 1 --2- 172.21.15.19:0/3531481591 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x564ceb685190 0x564ceb700320 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f57340ccb30 tx=0x7f573402a420 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8e7c2b34ba02b85f server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:28:16.588 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:16.584+0000 7f572cff9640 10 client.0 ms_handle_connect on v2:172.21.15.138:3300/0 2024-09-10T22:28:16.588 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:16.584+0000 7f572cff9640 1 -- 172.21.15.19:0/3531481591 <== mon.1 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5734049030 con 0x564ceb685190 2024-09-10T22:28:16.589 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:16.584+0000 7f572cff9640 1 -- 172.21.15.19:0/3531481591 <== mon.1 v2:172.21.15.138:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8327+0+0 (secure 0 0 0) 0x7f5734003c50 con 0x564ceb685190 2024-09-10T22:28:16.589 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:16.584+0000 7f574e60e740 1 -- 172.21.15.19:0/3531481591 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f573c004d20 con 0x564ceb685190 2024-09-10T22:28:16.589 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:16.584+0000 7f572cff9640 1 -- 172.21.15.19:0/3531481591 <== mon.1 v2:172.21.15.138:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f573403b460 con 0x564ceb685190 2024-09-10T22:28:16.589 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:16.584+0000 7f574e60e740 10 client.25261 fetch_fsmap learned FSMap version 26 2024-09-10T22:28:16.589 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:16.584+0000 7f574e60e740 1 -- 172.21.15.19:0/3531481591 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x564ceb7044d0 con 0x564ceb685190 2024-09-10T22:28:16.589 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:16.584+0000 7f572cff9640 1 -- 172.21.15.19:0/3531481591 <== mon.1 v2:172.21.15.138:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f573c004d20 con 0x564ceb685190 2024-09-10T22:28:16.589 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:16.584+0000 7f572cff9640 1 -- 172.21.15.19:0/3531481591 <== mon.1 v2:172.21.15.138:3300/0 5 ==== fsmap(e 26) ==== 8350+0+0 (secure 0 0 0) 0x7f57340c90a0 con 0x564ceb685190 2024-09-10T22:28:16.589 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:16.584+0000 7f574e60e740 10 client.25261 fetch_fsmap finished waiting for FSMap version 26 2024-09-10T22:28:16.589 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:16.584+0000 7f574e60e740 10 client.25261 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-10T22:28:16.589 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:16.584+0000 7f574e60e740 20 client.25261 populate_metadata read hostname 'smithi019' 2024-09-10T22:28:16.589 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:16.584+0000 7f574e60e740 1 --2- 172.21.15.19:0/3531481591 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x564ceb6974d0 0x564ceb706ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:28:16.589 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:16.585+0000 7f574e60e740 4 client.25261 mds_command: new command op to 24581 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-10T22:28:16.589 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:16.585+0000 7f574e60e740 1 -- 172.21.15.19:0/3531481591 --> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] -- command(tid 0: {"prefix": "flush journal"}) -- 0x564ceb5f20f0 con 0x564ceb6974d0 2024-09-10T22:28:16.590 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:16.585+0000 7f5749501640 1 --2- 172.21.15.19:0/3531481591 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x564ceb6974d0 0x564ceb706ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:28:16.590 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:16.585+0000 7f5749501640 1 --2- 172.21.15.19:0/3531481591 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x564ceb6974d0 0x564ceb706ef0 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9d909b110b2934ba server_cookie=28159b76a4cd402b in_seq=0 out_seq=0 2024-09-10T22:28:16.590 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:16.585+0000 7f572cff9640 10 client.25261 ms_handle_connect on v2:172.21.15.135:6838/1254769802 2024-09-10T22:28:16.609 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:28:16 smithi135 ceph-mon[34789]: pgmap v402: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 393 MiB/s wr, 683 op/s 2024-09-10T22:28:18.422 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:18.420+0000 7f572cff9640 1 -- 172.21.15.19:0/3531481591 <== mds.0 v2:172.21.15.135:6838/1254769802 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x564ceb5f20f0 con 0x564ceb6974d0 2024-09-10T22:28:18.422 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:18.420+0000 7f572cff9640 10 client.25261 handle_command_reply: tid=0 2024-09-10T22:28:18.422 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:18.420+0000 7f574e60e740 1 client.25261 shutdown 2024-09-10T22:28:18.422 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:18.421+0000 7f574e60e740 1 -- 172.21.15.19:0/3531481591 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x564ceb685190 msgr2=0x564ceb700320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:28:18.422 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:18.421+0000 7f574e60e740 1 --2- 172.21.15.19:0/3531481591 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x564ceb685190 0x564ceb700320 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f57340ccb30 tx=0x7f573402a420 comp rx=0 tx=0).stop 2024-09-10T22:28:18.422 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:18.421+0000 7f574e60e740 1 -- 172.21.15.19:0/3531481591 shutdown_connections 2024-09-10T22:28:18.423 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:18.421+0000 7f574e60e740 1 --2- 172.21.15.19:0/3531481591 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x564ceb687bd0 0x564ceb7029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:28:18.423 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:18.421+0000 7f574e60e740 1 --2- 172.21.15.19:0/3531481591 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x564ceb6974d0 0x564ceb706ef0 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:28:18.423 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:18.421+0000 7f574e60e740 1 --2- 172.21.15.19:0/3531481591 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x564ceb685190 0x564ceb700320 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:28:18.423 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:18.421+0000 7f574e60e740 1 --2- 172.21.15.19:0/3531481591 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564ceb682860 0x564ceb693af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:28:18.423 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:18.421+0000 7f574e60e740 1 -- 172.21.15.19:0/3531481591 >> 172.21.15.19:0/3531481591 conn(0x564ceb67d9b0 msgr2=0x564ceb67f7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:28:18.423 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:18.421+0000 7f572cff9640 0 client.25261 ms_handle_reset on v2:172.21.15.135:6838/1254769802 2024-09-10T22:28:18.423 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:18.421+0000 7f574e60e740 1 -- 172.21.15.19:0/3531481591 shutdown_connections 2024-09-10T22:28:18.424 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:18.421+0000 7f574e60e740 1 -- 172.21.15.19:0/3531481591 wait complete. 2024-09-10T22:28:18.424 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:18.421+0000 7f574e60e740 20 client.25261 trim_cache size 0 max 16384 2024-09-10T22:28:18.424 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stdout:{ 2024-09-10T22:28:18.424 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stdout: "message": "", 2024-09-10T22:28:18.424 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stdout: "return_code": 0 2024-09-10T22:28:18.424 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stdout:} 2024-09-10T22:28:18.425 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:18.422+0000 7f574b765640 1 -- 172.21.15.19:0/2415004154 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f57300b5360 msgr2=0x7f57300b7820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:28:18.425 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:18.422+0000 7f574b765640 1 --2- 172.21.15.19:0/2415004154 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f57300b5360 0x7f57300b7820 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f5744197030 tx=0x7f573c004ab0 comp rx=0 tx=0).stop 2024-09-10T22:28:18.425 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:18.422+0000 7f574b765640 1 -- 172.21.15.19:0/2415004154 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5744105ad0 msgr2=0x7f5744196900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:28:18.425 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:18.422+0000 7f574b765640 1 --2- 172.21.15.19:0/2415004154 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5744105ad0 0x7f5744196900 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f5734005ab0 tx=0x7f5734004270 comp rx=0 tx=0).stop 2024-09-10T22:28:18.425 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:18.422+0000 7f574b765640 1 -- 172.21.15.19:0/2415004154 shutdown_connections 2024-09-10T22:28:18.425 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:18.422+0000 7f574b765640 1 --2- 172.21.15.19:0/2415004154 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f57300b5360 0x7f57300b7820 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:28:18.425 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:18.422+0000 7f574b765640 1 --2- 172.21.15.19:0/2415004154 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5744108680 0x7f5744197530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:28:18.426 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:18.422+0000 7f574b765640 1 --2- 172.21.15.19:0/2415004154 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5744105ad0 0x7f5744196900 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:28:18.426 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:18.422+0000 7f574b765640 1 --2- 172.21.15.19:0/2415004154 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f574406b410 0x7f57441962b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:28:18.426 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:18.422+0000 7f574b765640 1 -- 172.21.15.19:0/2415004154 >> 172.21.15.19:0/2415004154 conn(0x7f57440fd140 msgr2=0x7f5744103dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:28:18.426 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:18.422+0000 7f574b765640 1 -- 172.21.15.19:0/2415004154 shutdown_connections 2024-09-10T22:28:18.426 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:18.422+0000 7f574b765640 1 -- 172.21.15.19:0/2415004154 wait complete. 2024-09-10T22:28:18.708 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:28:18 smithi019 ceph-mon[31375]: pgmap v403: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 429 MiB/s wr, 772 op/s 2024-09-10T22:28:18.861 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:28:18 smithi135 ceph-mon[34789]: pgmap v403: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 429 MiB/s wr, 772 op/s 2024-09-10T22:28:18.874 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:28:18 smithi138 ceph-mon[35236]: pgmap v403: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 429 MiB/s wr, 772 op/s 2024-09-10T22:28:19.776 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:28:19 smithi138 ceph-mon[35236]: pgmap v404: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 764 KiB/s rd, 356 MiB/s wr, 695 op/s 2024-09-10T22:28:19.859 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:28:19 smithi135 ceph-mon[34789]: pgmap v404: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 764 KiB/s rd, 356 MiB/s wr, 695 op/s 2024-09-10T22:28:19.958 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:28:19 smithi019 ceph-mon[31375]: pgmap v404: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 764 KiB/s rd, 356 MiB/s wr, 695 op/s 2024-09-10T22:28:21.859 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:28:21 smithi135 ceph-mon[34789]: pgmap v405: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 474 MiB/s wr, 759 op/s 2024-09-10T22:28:21.874 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:28:21 smithi138 ceph-mon[35236]: pgmap v405: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 474 MiB/s wr, 759 op/s 2024-09-10T22:28:21.958 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:28:21 smithi019 ceph-mon[31375]: pgmap v405: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 474 MiB/s wr, 759 op/s 2024-09-10T22:28:23.638 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 22997a4c-6fc2-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-10T22:28:23.941 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/22997a4c-6fc2-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T22:28:23.958 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:28:23 smithi019 ceph-mon[31375]: pgmap v406: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 903 KiB/s rd, 428 MiB/s wr, 753 op/s 2024-09-10T22:28:24.109 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:28:23 smithi135 ceph-mon[34789]: pgmap v406: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 903 KiB/s rd, 428 MiB/s wr, 753 op/s 2024-09-10T22:28:24.126 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:28:23 smithi138 ceph-mon[35236]: pgmap v406: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 903 KiB/s rd, 428 MiB/s wr, 753 op/s 2024-09-10T22:28:24.733 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:24.730+0000 7fbe293df640 1 -- 172.21.15.19:0/3631535489 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbe241076a0 msgr2=0x7fbe24107ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:28:24.734 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:24.730+0000 7fbe293df640 1 --2- 172.21.15.19:0/3631535489 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbe241076a0 0x7fbe24107ae0 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7fbe18009900 tx=0x7fbe1802a410 comp rx=0 tx=0).stop 2024-09-10T22:28:24.745 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:24.733+0000 7fbe293df640 1 -- 172.21.15.19:0/3631535489 shutdown_connections 2024-09-10T22:28:24.745 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:24.733+0000 7fbe293df640 1 --2- 172.21.15.19:0/3631535489 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fbe24108020 0x7fbe2410e820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:28:24.746 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:24.733+0000 7fbe293df640 1 --2- 172.21.15.19:0/3631535489 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbe241076a0 0x7fbe24107ae0 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:28:24.746 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:24.733+0000 7fbe293df640 1 --2- 172.21.15.19:0/3631535489 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbe24101c90 0x7fbe24102070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:28:24.746 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:24.733+0000 7fbe293df640 1 -- 172.21.15.19:0/3631535489 >> 172.21.15.19:0/3631535489 conn(0x7fbe240fd700 msgr2=0x7fbe240ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:28:24.748 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:24.746+0000 7fbe293df640 1 -- 172.21.15.19:0/3631535489 shutdown_connections 2024-09-10T22:28:24.749 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:24.747+0000 7fbe293df640 1 -- 172.21.15.19:0/3631535489 wait complete. 2024-09-10T22:28:24.750 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:24.748+0000 7fbe293df640 1 Processor -- start 2024-09-10T22:28:24.751 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:24.749+0000 7fbe293df640 1 -- start start 2024-09-10T22:28:24.752 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:24.750+0000 7fbe293df640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbe24101c90 0x7fbe24199500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:28:24.752 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:24.750+0000 7fbe293df640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbe24108020 0x7fbe24199a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:28:24.753 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:24.750+0000 7fbe293df640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fbe2419ede0 0x7fbe2419f290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:28:24.754 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:24.751+0000 7fbe293df640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fbe24111ce0 con 0x7fbe24108020 2024-09-10T22:28:24.754 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:24.751+0000 7fbe293df640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fbe24111b60 con 0x7fbe24101c90 2024-09-10T22:28:24.754 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:24.751+0000 7fbe293df640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7fbe24111e60 con 0x7fbe2419ede0 2024-09-10T22:28:24.755 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:24.751+0000 7fbe227fc640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbe24108020 0x7fbe24199a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:28:24.755 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:24.752+0000 7fbe227fc640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbe24108020 0x7fbe24199a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:49486/0 (socket says 172.21.15.19:49486) 2024-09-10T22:28:24.755 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:24.752+0000 7fbe227fc640 1 -- 172.21.15.19:0/2445677623 learned_addr learned my addr 172.21.15.19:0/2445677623 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:28:24.755 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:24.753+0000 7fbe227fc640 1 -- 172.21.15.19:0/2445677623 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fbe2419ede0 msgr2=0x7fbe2419f290 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-10T22:28:24.755 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:24.753+0000 7fbe227fc640 1 --2- 172.21.15.19:0/2445677623 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fbe2419ede0 0x7fbe2419f290 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:28:24.755 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:24.753+0000 7fbe227fc640 1 -- 172.21.15.19:0/2445677623 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbe24101c90 msgr2=0x7fbe24199500 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-10T22:28:24.755 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:24.753+0000 7fbe227fc640 1 --2- 172.21.15.19:0/2445677623 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbe24101c90 0x7fbe24199500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:28:24.755 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:24.753+0000 7fbe227fc640 1 -- 172.21.15.19:0/2445677623 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbe2419f970 con 0x7fbe24108020 2024-09-10T22:28:24.755 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:24.754+0000 7fbe227fc640 1 --2- 172.21.15.19:0/2445677623 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbe24108020 0x7fbe24199a40 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7fbe18000c00 tx=0x7fbe18004c70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:28:24.756 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:24.754+0000 7fbe0bfff640 1 -- 172.21.15.19:0/2445677623 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe1803f020 con 0x7fbe24108020 2024-09-10T22:28:24.756 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:24.755+0000 7fbe0bfff640 1 -- 172.21.15.19:0/2445677623 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbe180053e0 con 0x7fbe24108020 2024-09-10T22:28:24.756 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:24.755+0000 7fbe293df640 1 -- 172.21.15.19:0/2445677623 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbe2419fc00 con 0x7fbe24108020 2024-09-10T22:28:24.757 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:24.755+0000 7fbe293df640 1 -- 172.21.15.19:0/2445677623 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbe241a6220 con 0x7fbe24108020 2024-09-10T22:28:24.760 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:24.759+0000 7fbe0bfff640 1 -- 172.21.15.19:0/2445677623 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe18035070 con 0x7fbe24108020 2024-09-10T22:28:24.765 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:24.764+0000 7fbe0bfff640 1 -- 172.21.15.19:0/2445677623 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 18) ==== 153250+0+0 (secure 0 0 0) 0x7fbe18003a00 con 0x7fbe24108020 2024-09-10T22:28:24.767 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:24.766+0000 7fbe0bfff640 1 --2- 172.21.15.19:0/2445677623 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7fbe0c0b5430 0x7fbe0c0b78f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:28:24.772 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:24.767+0000 7fbe0bfff640 1 -- 172.21.15.19:0/2445677623 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8327+0+0 (secure 0 0 0) 0x7fbe18106a30 con 0x7fbe24108020 2024-09-10T22:28:24.773 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:24.771+0000 7fbe2b7b4740 1 Processor -- start 2024-09-10T22:28:24.775 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:24.769+0000 7fbe22ffd640 1 --2- 172.21.15.19:0/2445677623 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7fbe0c0b5430 0x7fbe0c0b78f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:28:24.777 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:24.775+0000 7fbe22ffd640 1 --2- 172.21.15.19:0/2445677623 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7fbe0c0b5430 0x7fbe0c0b78f0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fbe140096b0 tx=0x7fbe14006c20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:28:24.779 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:24.776+0000 7fbe2b7b4740 1 -- start start 2024-09-10T22:28:24.779 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:24.777+0000 7fbe2b7b4740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f0a98c9480 0x55f0a98c9860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:28:24.779 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:24.777+0000 7fbe2b7b4740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55f0a98c9da0 0x55f0a98d57f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:28:24.779 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:24.777+0000 7fbe2b7b4740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55f0a98d5d30 0x55f0a98d8120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:28:24.779 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:24.778+0000 7fbe2b7b4740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x55f0a983fe50 con 0x55f0a98c9da0 2024-09-10T22:28:24.779 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:24.778+0000 7fbe2b7b4740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55f0a982f280 con 0x55f0a98c9480 2024-09-10T22:28:24.780 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:24.778+0000 7fbe2b7b4740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x55f0a9833090 con 0x55f0a98d5d30 2024-09-10T22:28:24.781 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:24.778+0000 7fbe227fc640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55f0a98c9da0 0x55f0a98d57f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:28:24.781 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:24.778+0000 7fbe227fc640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55f0a98c9da0 0x55f0a98d57f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:49494/0 (socket says 172.21.15.19:49494) 2024-09-10T22:28:24.781 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:24.779+0000 7fbe227fc640 1 -- 172.21.15.19:0/2266808815 learned_addr learned my addr 172.21.15.19:0/2266808815 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:28:24.781 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:24.779+0000 7fbe227fc640 1 -- 172.21.15.19:0/2266808815 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55f0a98d5d30 msgr2=0x55f0a98d8120 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-10T22:28:24.781 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:24.779+0000 7fbe227fc640 1 --2- 172.21.15.19:0/2266808815 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55f0a98d5d30 0x55f0a98d8120 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:28:24.781 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:24.779+0000 7fbe227fc640 1 -- 172.21.15.19:0/2266808815 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f0a98c9480 msgr2=0x55f0a98c9860 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-10T22:28:24.782 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:24.779+0000 7fbe227fc640 1 --2- 172.21.15.19:0/2266808815 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f0a98c9480 0x55f0a98c9860 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:28:24.782 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:24.779+0000 7fbe227fc640 1 -- 172.21.15.19:0/2266808815 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f0a958d650 con 0x55f0a98c9da0 2024-09-10T22:28:24.782 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:24.780+0000 7fbe227fc640 1 --2- 172.21.15.19:0/2266808815 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55f0a98c9da0 0x55f0a98d57f0 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7fbe180c9760 tx=0x7fbe18005e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d2a447a274284507 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:28:24.782 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:24.780+0000 7fbe097fa640 1 -- 172.21.15.19:0/2266808815 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe180d6070 con 0x55f0a98c9da0 2024-09-10T22:28:24.783 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:24.781+0000 7fbe097fa640 1 -- 172.21.15.19:0/2266808815 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbe180cd890 con 0x55f0a98c9da0 2024-09-10T22:28:24.783 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:24.782+0000 7fbe097fa640 1 -- 172.21.15.19:0/2266808815 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe180d6720 con 0x55f0a98c9da0 2024-09-10T22:28:24.784 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:24.782+0000 7fbe2b7b4740 1 -- 172.21.15.19:0/2266808815 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55f0a98c9da0 msgr2=0x55f0a98d57f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:28:24.784 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:24.782+0000 7fbe2b7b4740 1 --2- 172.21.15.19:0/2266808815 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55f0a98c9da0 0x55f0a98d57f0 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7fbe180c9760 tx=0x7fbe18005e80 comp rx=0 tx=0).stop 2024-09-10T22:28:24.791 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:24.789+0000 7fbe2b7b4740 1 -- 172.21.15.19:0/2266808815 shutdown_connections 2024-09-10T22:28:24.791 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:24.789+0000 7fbe2b7b4740 1 --2- 172.21.15.19:0/2266808815 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55f0a98d5d30 0x55f0a98d8120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:28:24.791 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:24.789+0000 7fbe2b7b4740 1 --2- 172.21.15.19:0/2266808815 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55f0a98c9da0 0x55f0a98d57f0 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:28:24.791 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:24.789+0000 7fbe2b7b4740 1 --2- 172.21.15.19:0/2266808815 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f0a98c9480 0x55f0a98c9860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:28:24.791 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:24.789+0000 7fbe2b7b4740 1 -- 172.21.15.19:0/2266808815 >> 172.21.15.19:0/2266808815 conn(0x55f0a98c72b0 msgr2=0x55f0a98c8450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:28:24.795 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:24.794+0000 7fbe2b7b4740 1 -- 172.21.15.19:0/2266808815 shutdown_connections 2024-09-10T22:28:24.797 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:24.794+0000 7fbe2b7b4740 1 -- 172.21.15.19:0/2266808815 wait complete. 2024-09-10T22:28:24.800 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:24.795+0000 7fbe2b7b4740 1 -- start start 2024-09-10T22:28:24.800 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:24.796+0000 7fbe2b7b4740 1 Processor -- start 2024-09-10T22:28:24.800 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:24.797+0000 7fbe2b7b4740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f0a98c9480 0x55f0a98d5590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:28:24.800 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:24.797+0000 7fbe2b7b4740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55f0a98c9da0 0x55f0a98d29e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:28:24.800 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:24.797+0000 7fbe2b7b4740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55f0a98d5d30 0x55f0a98d2f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:28:24.800 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:24.797+0000 7fbe2b7b4740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x55f0a9690700 con 0x55f0a98d5d30 2024-09-10T22:28:24.800 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:24.797+0000 7fbe2b7b4740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55f0a97ca110 con 0x55f0a98c9480 2024-09-10T22:28:24.801 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:24.797+0000 7fbe2b7b4740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x55f0a98d8770 con 0x55f0a98c9da0 2024-09-10T22:28:24.801 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:24.797+0000 7fbe2b7b4740 10 client.0 _ll_register_callbacks cb 0x55f0a97e3990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T22:28:24.802 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:24.799+0000 7fbe237fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55f0a98d5d30 0x55f0a98d2f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:28:24.802 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:24.799+0000 7fbe237fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55f0a98d5d30 0x55f0a98d2f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:49498/0 (socket says 172.21.15.19:49498) 2024-09-10T22:28:24.802 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:24.799+0000 7fbe237fe640 1 -- 172.21.15.19:0/1076760810 learned_addr learned my addr 172.21.15.19:0/1076760810 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:28:24.802 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:24.799+0000 7fbe237fe640 1 -- 172.21.15.19:0/1076760810 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55f0a98c9da0 msgr2=0x55f0a98d29e0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-10T22:28:24.802 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:24.799+0000 7fbe237fe640 1 --2- 172.21.15.19:0/1076760810 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55f0a98c9da0 0x55f0a98d29e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:28:24.802 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:24.799+0000 7fbe237fe640 1 -- 172.21.15.19:0/1076760810 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f0a98c9480 msgr2=0x55f0a98d5590 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-10T22:28:24.802 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:24.799+0000 7fbe237fe640 1 --2- 172.21.15.19:0/1076760810 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f0a98c9480 0x55f0a98d5590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:28:24.802 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:24.799+0000 7fbe237fe640 1 -- 172.21.15.19:0/1076760810 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f0a97f7c40 con 0x55f0a98d5d30 2024-09-10T22:28:24.803 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:24.800+0000 7fbe237fe640 1 --2- 172.21.15.19:0/1076760810 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55f0a98d5d30 0x55f0a98d2f60 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7fbe1c00e710 tx=0x7fbe1c00ebd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a501471e59c59f1d server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:28:24.803 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:24.800+0000 7fbe06ff5640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-10T22:28:24.803 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:24.800+0000 7fbe06ff5640 1 -- 172.21.15.19:0/1076760810 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe1c004d20 con 0x55f0a98d5d30 2024-09-10T22:28:24.803 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:24.800+0000 7fbe06ff5640 1 -- 172.21.15.19:0/1076760810 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8327+0+0 (secure 0 0 0) 0x7fbe1c00c7b0 con 0x55f0a98d5d30 2024-09-10T22:28:24.804 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:24.801+0000 7fbe2b7b4740 1 -- 172.21.15.19:0/1076760810 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbe180cd890 con 0x55f0a98d5d30 2024-09-10T22:28:24.804 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:24.802+0000 7fbe06ff5640 1 -- 172.21.15.19:0/1076760810 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7fbe1c00c9f0 con 0x55f0a98d5d30 2024-09-10T22:28:24.804 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:24.802+0000 7fbe2b7b4740 10 client.15717 fetch_fsmap learned FSMap version 26 2024-09-10T22:28:24.805 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:24.802+0000 7fbe2b7b4740 1 -- 172.21.15.19:0/1076760810 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x55f0a98fd8f0 con 0x55f0a98d5d30 2024-09-10T22:28:24.805 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:24.802+0000 7fbe06ff5640 1 -- 172.21.15.19:0/1076760810 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbe180cd890 con 0x55f0a98d5d30 2024-09-10T22:28:24.805 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:24.802+0000 7fbe06ff5640 1 -- 172.21.15.19:0/1076760810 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 26) ==== 8350+0+0 (secure 0 0 0) 0x7fbe1c0184c0 con 0x55f0a98d5d30 2024-09-10T22:28:24.805 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:24.803+0000 7fbe2b7b4740 10 client.15717 fetch_fsmap finished waiting for FSMap version 26 2024-09-10T22:28:24.805 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:24.803+0000 7fbe2b7b4740 10 client.15717 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-10T22:28:24.805 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:24.803+0000 7fbe2b7b4740 20 client.15717 populate_metadata read hostname 'smithi019' 2024-09-10T22:28:24.805 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:24.803+0000 7fbe2b7b4740 1 --2- 172.21.15.19:0/1076760810 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x55f0a98ff200 0x55f0a99016a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:28:24.805 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:24.803+0000 7fbe2b7b4740 4 client.15717 mds_command: new command op to 24581 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T22:28:24.805 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:24.803+0000 7fbe2b7b4740 1 -- 172.21.15.19:0/1076760810 --> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f0a9841da0 con 0x55f0a98ff200 2024-09-10T22:28:24.806 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:24.803+0000 7fbe22ffd640 1 --2- 172.21.15.19:0/1076760810 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x55f0a98ff200 0x55f0a99016a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:28:24.812 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:24.810+0000 7fbe22ffd640 1 --2- 172.21.15.19:0/1076760810 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x55f0a98ff200 0x55f0a99016a0 crc :-1 s=READY pgs=62 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7c6dd17129ed6730 server_cookie=4f7b4be8117d0130 in_seq=0 out_seq=0 2024-09-10T22:28:24.812 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:24.810+0000 7fbe06ff5640 10 client.15717 ms_handle_connect on v2:172.21.15.135:6838/1254769802 2024-09-10T22:28:24.815 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:24.813+0000 7fbe06ff5640 1 -- 172.21.15.19:0/1076760810 <== mds.0 v2:172.21.15.135:6838/1254769802 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55f0a9841da0 con 0x55f0a98ff200 2024-09-10T22:28:24.815 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:24.813+0000 7fbe06ff5640 10 client.15717 handle_command_reply: tid=0 2024-09-10T22:28:24.815 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:24.813+0000 7fbe2b7b4740 1 client.15717 shutdown 2024-09-10T22:28:24.815 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:24.813+0000 7fbe2b7b4740 1 -- 172.21.15.19:0/1076760810 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55f0a98d5d30 msgr2=0x55f0a98d2f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:28:24.816 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:24.813+0000 7fbe2b7b4740 1 --2- 172.21.15.19:0/1076760810 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55f0a98d5d30 0x55f0a98d2f60 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7fbe1c00e710 tx=0x7fbe1c00ebd0 comp rx=0 tx=0).stop 2024-09-10T22:28:24.816 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:24.813+0000 7fbe2b7b4740 1 -- 172.21.15.19:0/1076760810 shutdown_connections 2024-09-10T22:28:24.816 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:24.813+0000 7fbe2b7b4740 1 --2- 172.21.15.19:0/1076760810 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55f0a98d5d30 0x55f0a98d2f60 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:28:24.816 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:24.813+0000 7fbe2b7b4740 1 --2- 172.21.15.19:0/1076760810 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x55f0a98ff200 0x55f0a99016a0 crc :-1 s=READY pgs=62 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:28:24.816 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:24.813+0000 7fbe2b7b4740 1 --2- 172.21.15.19:0/1076760810 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55f0a98c9da0 0x55f0a98d29e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:28:24.816 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:24.813+0000 7fbe2b7b4740 1 --2- 172.21.15.19:0/1076760810 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f0a98c9480 0x55f0a98d5590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:28:24.816 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:24.813+0000 7fbe2b7b4740 1 -- 172.21.15.19:0/1076760810 >> 172.21.15.19:0/1076760810 conn(0x55f0a98c72b0 msgr2=0x55f0a98cce20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:28:24.816 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:24.813+0000 7fbe06ff5640 0 client.15717 ms_handle_reset on v2:172.21.15.135:6838/1254769802 2024-09-10T22:28:24.816 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:24.813+0000 7fbe2b7b4740 1 -- 172.21.15.19:0/1076760810 shutdown_connections 2024-09-10T22:28:24.816 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:24.813+0000 7fbe2b7b4740 1 -- 172.21.15.19:0/1076760810 wait complete. 2024-09-10T22:28:24.816 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:24.814+0000 7fbe2b7b4740 20 client.15717 trim_cache size 0 max 16384 2024-09-10T22:28:24.843 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:24.841+0000 7fbe2b7b4740 1 Processor -- start 2024-09-10T22:28:24.844 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:24.841+0000 7fbe2b7b4740 1 -- start start 2024-09-10T22:28:24.844 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:24.842+0000 7fbe2b7b4740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55f0a98c9480 0x55f0a98cfe00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:28:24.844 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:24.842+0000 7fbe2b7b4740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f0a98c9da0 0x55f0a98d0340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:28:24.844 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:24.842+0000 7fbe2b7b4740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55f0a98d5d30 0x55f0a9906f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:28:24.844 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:24.842+0000 7fbe2b7b4740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fbe10010fa0 con 0x55f0a98c9480 2024-09-10T22:28:24.845 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:24.842+0000 7fbe2b7b4740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fbe1000e870 con 0x55f0a98c9da0 2024-09-10T22:28:24.845 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:24.842+0000 7fbe2b7b4740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7fbe1000c6c0 con 0x55f0a98d5d30 2024-09-10T22:28:24.846 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:24.842+0000 7fbe22ffd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55f0a98c9480 0x55f0a98cfe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:28:24.847 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:24.842+0000 7fbe22ffd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55f0a98c9480 0x55f0a98cfe00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:49504/0 (socket says 172.21.15.19:49504) 2024-09-10T22:28:24.847 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:24.842+0000 7fbe22ffd640 1 -- 172.21.15.19:0/2696862186 learned_addr learned my addr 172.21.15.19:0/2696862186 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:28:24.847 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:24.842+0000 7fbe237fe640 1 --2- 172.21.15.19:0/2696862186 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55f0a98d5d30 0x55f0a9906f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:28:24.847 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:24.842+0000 7fbe22ffd640 1 -- 172.21.15.19:0/2696862186 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55f0a98d5d30 msgr2=0x55f0a9906f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:28:24.847 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:24.842+0000 7fbe22ffd640 1 --2- 172.21.15.19:0/2696862186 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55f0a98d5d30 0x55f0a9906f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:28:24.847 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:24.842+0000 7fbe22ffd640 1 -- 172.21.15.19:0/2696862186 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f0a98c9da0 msgr2=0x55f0a98d0340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:28:24.847 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:24.842+0000 7fbe22ffd640 1 --2- 172.21.15.19:0/2696862186 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f0a98c9da0 0x55f0a98d0340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:28:24.847 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:24.842+0000 7fbe22ffd640 1 -- 172.21.15.19:0/2696862186 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f0a98c2b60 con 0x55f0a98c9480 2024-09-10T22:28:24.847 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:24.843+0000 7fbe22ffd640 1 --2- 172.21.15.19:0/2696862186 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55f0a98c9480 0x55f0a98cfe00 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7fbe14000c00 tx=0x7fbe14012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ae1f1a3fbf6ed4a6 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:28:24.847 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:24.843+0000 7fbe08ff9640 1 -- 172.21.15.19:0/2696862186 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe1400b830 con 0x55f0a98c9480 2024-09-10T22:28:24.847 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:24.843+0000 7fbe08ff9640 1 -- 172.21.15.19:0/2696862186 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbe1402a070 con 0x55f0a98c9480 2024-09-10T22:28:24.848 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:24.843+0000 7fbe08ff9640 1 -- 172.21.15.19:0/2696862186 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe14025d40 con 0x55f0a98c9480 2024-09-10T22:28:24.848 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:24.844+0000 7fbe2b7b4740 1 -- 172.21.15.19:0/2696862186 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55f0a98c9480 msgr2=0x55f0a98cfe00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:28:24.848 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:24.844+0000 7fbe2b7b4740 1 --2- 172.21.15.19:0/2696862186 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55f0a98c9480 0x55f0a98cfe00 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7fbe14000c00 tx=0x7fbe14012000 comp rx=0 tx=0).stop 2024-09-10T22:28:24.848 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:24.845+0000 7fbe2b7b4740 1 -- 172.21.15.19:0/2696862186 shutdown_connections 2024-09-10T22:28:24.848 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:24.845+0000 7fbe2b7b4740 1 --2- 172.21.15.19:0/2696862186 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55f0a98d5d30 0x55f0a9906f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:28:24.848 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:24.845+0000 7fbe2b7b4740 1 --2- 172.21.15.19:0/2696862186 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f0a98c9da0 0x55f0a98d0340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:28:24.848 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:24.845+0000 7fbe2b7b4740 1 --2- 172.21.15.19:0/2696862186 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55f0a98c9480 0x55f0a98cfe00 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:28:24.848 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:24.845+0000 7fbe2b7b4740 1 -- 172.21.15.19:0/2696862186 >> 172.21.15.19:0/2696862186 conn(0x55f0a98c72b0 msgr2=0x55f0a98d1260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:28:24.848 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:24.845+0000 7fbe2b7b4740 1 -- 172.21.15.19:0/2696862186 shutdown_connections 2024-09-10T22:28:24.848 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:24.845+0000 7fbe2b7b4740 1 -- 172.21.15.19:0/2696862186 wait complete. 2024-09-10T22:28:24.848 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:24.845+0000 7fbe2b7b4740 1 -- start start 2024-09-10T22:28:24.849 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:24.846+0000 7fbe2b7b4740 1 Processor -- start 2024-09-10T22:28:24.850 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:24.846+0000 7fbe2b7b4740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55f0a98c9480 0x55f0a98e62c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:28:24.850 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:24.846+0000 7fbe2b7b4740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f0a98c9da0 0x55f0a98e6800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:28:24.850 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:24.846+0000 7fbe2b7b4740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55f0a98d5d30 0x55f0a98e1270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:28:24.850 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:24.846+0000 7fbe2b7b4740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fbe1000cd30 con 0x55f0a98c9480 2024-09-10T22:28:24.850 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:24.846+0000 7fbe2b7b4740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fbe1000e1a0 con 0x55f0a98c9da0 2024-09-10T22:28:24.850 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:24.846+0000 7fbe2b7b4740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7fbe1000d400 con 0x55f0a98d5d30 2024-09-10T22:28:24.850 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:24.846+0000 7fbe2b7b4740 10 client.0 _ll_register_callbacks cb 0x7fbe1c009900 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T22:28:24.850 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:24.847+0000 7fbe22ffd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55f0a98c9480 0x55f0a98e62c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:28:24.850 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:24.847+0000 7fbe22ffd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55f0a98c9480 0x55f0a98e62c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:49506/0 (socket says 172.21.15.19:49506) 2024-09-10T22:28:24.850 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:24.847+0000 7fbe22ffd640 1 -- 172.21.15.19:0/836782287 learned_addr learned my addr 172.21.15.19:0/836782287 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:28:24.851 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:24.847+0000 7fbe237fe640 1 --2- 172.21.15.19:0/836782287 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55f0a98d5d30 0x55f0a98e1270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:28:24.851 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:24.847+0000 7fbe22ffd640 1 -- 172.21.15.19:0/836782287 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55f0a98d5d30 msgr2=0x55f0a98e1270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:28:24.851 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:24.847+0000 7fbe22ffd640 1 --2- 172.21.15.19:0/836782287 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55f0a98d5d30 0x55f0a98e1270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:28:24.851 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:24.847+0000 7fbe22ffd640 1 -- 172.21.15.19:0/836782287 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f0a98c9da0 msgr2=0x55f0a98e6800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:28:24.851 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:24.847+0000 7fbe22ffd640 1 --2- 172.21.15.19:0/836782287 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f0a98c9da0 0x55f0a98e6800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:28:24.851 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:24.848+0000 7fbe22ffd640 1 -- 172.21.15.19:0/836782287 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f0a98e6f70 con 0x55f0a98c9480 2024-09-10T22:28:24.851 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:24.848+0000 7fbe237fe640 1 --2- 172.21.15.19:0/836782287 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55f0a98d5d30 0x55f0a98e1270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T22:28:24.851 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:24.848+0000 7fbe22ffd640 1 --2- 172.21.15.19:0/836782287 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55f0a98c9480 0x55f0a98e62c0 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7fbe14009570 tx=0x7fbe140046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3c5e655a41275ce2 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:28:24.851 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:24.848+0000 7fbe06ff5640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-10T22:28:24.852 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:24.848+0000 7fbe06ff5640 1 -- 172.21.15.19:0/836782287 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe14035070 con 0x55f0a98c9480 2024-09-10T22:28:24.852 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:24.849+0000 7fbe06ff5640 1 -- 172.21.15.19:0/836782287 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8327+0+0 (secure 0 0 0) 0x7fbe1400b830 con 0x55f0a98c9480 2024-09-10T22:28:24.852 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:24.849+0000 7fbe2b7b4740 1 -- 172.21.15.19:0/836782287 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbe1402a070 con 0x55f0a98c9480 2024-09-10T22:28:24.853 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:24.849+0000 7fbe06ff5640 1 -- 172.21.15.19:0/836782287 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7fbe14041050 con 0x55f0a98c9480 2024-09-10T22:28:24.853 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:24.849+0000 7fbe2b7b4740 10 client.15723 fetch_fsmap learned FSMap version 26 2024-09-10T22:28:24.853 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:24.849+0000 7fbe2b7b4740 1 -- 172.21.15.19:0/836782287 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x55f0a996c6d0 con 0x55f0a98c9480 2024-09-10T22:28:24.853 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:24.850+0000 7fbe06ff5640 1 -- 172.21.15.19:0/836782287 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbe1402a070 con 0x55f0a98c9480 2024-09-10T22:28:24.853 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:24.850+0000 7fbe06ff5640 1 -- 172.21.15.19:0/836782287 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 26) ==== 8350+0+0 (secure 0 0 0) 0x7fbe14012070 con 0x55f0a98c9480 2024-09-10T22:28:24.853 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:24.850+0000 7fbe2b7b4740 10 client.15723 fetch_fsmap finished waiting for FSMap version 26 2024-09-10T22:28:24.854 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:24.850+0000 7fbe2b7b4740 10 client.15723 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-10T22:28:24.854 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:24.850+0000 7fbe2b7b4740 20 client.15723 populate_metadata read hostname 'smithi019' 2024-09-10T22:28:24.854 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:24.850+0000 7fbe2b7b4740 1 --2- 172.21.15.19:0/836782287 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x55f0a996cd60 0x55f0a996f180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:28:24.854 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:24.850+0000 7fbe2b7b4740 4 client.15723 mds_command: new command op to 24581 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-10T22:28:24.854 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:24.850+0000 7fbe2b7b4740 1 -- 172.21.15.19:0/836782287 --> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55f0a983d850 con 0x55f0a996cd60 2024-09-10T22:28:24.855 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:24.852+0000 7fbe227fc640 1 --2- 172.21.15.19:0/836782287 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x55f0a996cd60 0x55f0a996f180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:28:24.857 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:24.856+0000 7fbe06ff5640 10 client.15723 ms_handle_connect on v2:172.21.15.135:6838/1254769802 2024-09-10T22:28:24.857 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:24.856+0000 7fbe227fc640 1 --2- 172.21.15.19:0/836782287 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x55f0a996cd60 0x55f0a996f180 crc :-1 s=READY pgs=63 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b789b727068aafba server_cookie=b6d917df71fb0dda in_seq=0 out_seq=0 2024-09-10T22:28:24.860 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:24.856+0000 7fbe06ff5640 1 -- 172.21.15.19:0/836782287 <== mds.0 v2:172.21.15.135:6838/1254769802 1 ==== command_reply(tid 0: 0 ) ==== 8+0+942 (crc 0 0 0) 0x55f0a983d850 con 0x55f0a996cd60 2024-09-10T22:28:24.860 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:24.856+0000 7fbe06ff5640 10 client.15723 handle_command_reply: tid=0 2024-09-10T22:28:24.860 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:24.856+0000 7fbe2b7b4740 1 client.15723 shutdown 2024-09-10T22:28:24.860 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:24.857+0000 7fbe2b7b4740 1 -- 172.21.15.19:0/836782287 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55f0a98c9480 msgr2=0x55f0a98e62c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:28:24.861 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:24.857+0000 7fbe2b7b4740 1 --2- 172.21.15.19:0/836782287 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55f0a98c9480 0x55f0a98e62c0 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7fbe14009570 tx=0x7fbe140046c0 comp rx=0 tx=0).stop 2024-09-10T22:28:24.861 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:24.857+0000 7fbe2b7b4740 1 -- 172.21.15.19:0/836782287 shutdown_connections 2024-09-10T22:28:24.861 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:24.857+0000 7fbe2b7b4740 1 --2- 172.21.15.19:0/836782287 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x55f0a996cd60 0x55f0a996f180 crc :-1 s=READY pgs=63 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:28:24.861 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:24.857+0000 7fbe06ff5640 0 client.15723 ms_handle_reset on v2:172.21.15.135:6838/1254769802 2024-09-10T22:28:24.861 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:24.857+0000 7fbe2b7b4740 1 --2- 172.21.15.19:0/836782287 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55f0a98d5d30 0x55f0a98e1270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:28:24.862 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:24.857+0000 7fbe2b7b4740 1 --2- 172.21.15.19:0/836782287 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f0a98c9da0 0x55f0a98e6800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:28:24.862 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:24.857+0000 7fbe2b7b4740 1 --2- 172.21.15.19:0/836782287 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55f0a98c9480 0x55f0a98e62c0 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:28:24.862 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:24.857+0000 7fbe2b7b4740 1 -- 172.21.15.19:0/836782287 >> 172.21.15.19:0/836782287 conn(0x55f0a98c72b0 msgr2=0x55f0a98d4010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:28:24.862 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:24.857+0000 7fbe2b7b4740 1 -- 172.21.15.19:0/836782287 shutdown_connections 2024-09-10T22:28:24.862 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:24.857+0000 7fbe2b7b4740 1 -- 172.21.15.19:0/836782287 wait complete. 2024-09-10T22:28:24.863 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:24.857+0000 7fbe2b7b4740 20 client.15723 trim_cache size 0 max 16384 2024-09-10T22:28:24.864 INFO:teuthology.orchestra.run.smithi019.stdout:{ 2024-09-10T22:28:24.864 INFO:teuthology.orchestra.run.smithi019.stdout: "status": "no active scrubs running", 2024-09-10T22:28:24.864 INFO:teuthology.orchestra.run.smithi019.stdout: "scrubs": {}, 2024-09-10T22:28:24.864 INFO:teuthology.orchestra.run.smithi019.stdout: "scrub_stats": { 2024-09-10T22:28:24.864 INFO:teuthology.orchestra.run.smithi019.stdout: "c12c2a04-dcd6-4673-a98e-93f665d3f5d7": { 2024-09-10T22:28:24.864 INFO:teuthology.orchestra.run.smithi019.stdout: "start_time": "2024-09-10T22:27:49.392329+0000", 2024-09-10T22:28:24.864 INFO:teuthology.orchestra.run.smithi019.stdout: "path": "/", 2024-09-10T22:28:24.864 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_started": 0, 2024-09-10T22:28:24.865 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_passed": 0, 2024-09-10T22:28:24.865 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_failed": 0, 2024-09-10T22:28:24.865 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_skipped": 0 2024-09-10T22:28:24.865 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:28:24.865 INFO:teuthology.orchestra.run.smithi019.stdout: "b38852c8-478a-42ef-8384-b2c55d5313a4": { 2024-09-10T22:28:24.865 INFO:teuthology.orchestra.run.smithi019.stdout: "start_time": "2024-09-10T22:27:00.320308+0000", 2024-09-10T22:28:24.865 INFO:teuthology.orchestra.run.smithi019.stdout: "path": "/", 2024-09-10T22:28:24.865 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_started": 0, 2024-09-10T22:28:24.865 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_passed": 0, 2024-09-10T22:28:24.865 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_failed": 0, 2024-09-10T22:28:24.865 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_skipped": 0 2024-09-10T22:28:24.865 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:28:24.865 INFO:teuthology.orchestra.run.smithi019.stdout: "9b6bfdee-303c-4c12-af56-dc85860d112a": { 2024-09-10T22:28:24.866 INFO:teuthology.orchestra.run.smithi019.stdout: "start_time": "2024-09-10T22:26:17.484162+0000", 2024-09-10T22:28:24.866 INFO:teuthology.orchestra.run.smithi019.stdout: "path": "/", 2024-09-10T22:28:24.866 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_started": 0, 2024-09-10T22:28:24.866 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_passed": 0, 2024-09-10T22:28:24.866 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_failed": 0, 2024-09-10T22:28:24.866 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_skipped": 0 2024-09-10T22:28:24.866 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-10T22:28:24.866 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-10T22:28:24.866 INFO:teuthology.orchestra.run.smithi019.stdout:} 2024-09-10T22:28:24.867 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:24.858+0000 7fbe293df640 1 -- 172.21.15.19:0/2445677623 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7fbe0c0b5430 msgr2=0x7fbe0c0b78f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:28:24.867 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:24.858+0000 7fbe293df640 1 --2- 172.21.15.19:0/2445677623 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7fbe0c0b5430 0x7fbe0c0b78f0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fbe140096b0 tx=0x7fbe14006c20 comp rx=0 tx=0).stop 2024-09-10T22:28:24.867 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:24.858+0000 7fbe293df640 1 -- 172.21.15.19:0/2445677623 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbe24108020 msgr2=0x7fbe24199a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:28:24.868 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:24.858+0000 7fbe293df640 1 --2- 172.21.15.19:0/2445677623 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbe24108020 0x7fbe24199a40 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7fbe18000c00 tx=0x7fbe18004c70 comp rx=0 tx=0).stop 2024-09-10T22:28:24.868 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:24.859+0000 7fbe293df640 1 -- 172.21.15.19:0/2445677623 shutdown_connections 2024-09-10T22:28:24.868 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:24.859+0000 7fbe293df640 1 --2- 172.21.15.19:0/2445677623 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7fbe0c0b5430 0x7fbe0c0b78f0 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:28:24.868 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:24.859+0000 7fbe293df640 1 --2- 172.21.15.19:0/2445677623 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fbe2419ede0 0x7fbe2419f290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:28:24.868 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:24.859+0000 7fbe293df640 1 --2- 172.21.15.19:0/2445677623 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbe24108020 0x7fbe24199a40 unknown :-1 s=CLOSED pgs=492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:28:24.868 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:24.859+0000 7fbe293df640 1 --2- 172.21.15.19:0/2445677623 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbe24101c90 0x7fbe24199500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:28:24.868 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:24.859+0000 7fbe293df640 1 -- 172.21.15.19:0/2445677623 >> 172.21.15.19:0/2445677623 conn(0x7fbe240fd700 msgr2=0x7fbe24100bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:28:24.868 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:24.859+0000 7fbe293df640 1 -- 172.21.15.19:0/2445677623 shutdown_connections 2024-09-10T22:28:24.868 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:24.859+0000 7fbe293df640 1 -- 172.21.15.19:0/2445677623 wait complete. 2024-09-10T22:28:25.880 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:28:25 smithi019 ceph-mon[31375]: pgmap v407: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 893 KiB/s rd, 439 MiB/s wr, 670 op/s 2024-09-10T22:28:25.883 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-10T22:28:25.883 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 22997a4c-6fc2-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-10T22:28:26.109 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:28:25 smithi135 ceph-mon[34789]: pgmap v407: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 893 KiB/s rd, 439 MiB/s wr, 670 op/s 2024-09-10T22:28:26.125 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:28:25 smithi138 ceph-mon[35236]: pgmap v407: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 893 KiB/s rd, 439 MiB/s wr, 670 op/s 2024-09-10T22:28:26.413 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/22997a4c-6fc2-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T22:28:27.104 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:27.087+0000 7f3e8f79d640 1 -- 172.21.15.19:0/1678972847 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3e88105f40 msgr2=0x7f3e8810f960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:28:27.104 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:27.087+0000 7f3e8f79d640 1 --2- 172.21.15.19:0/1678972847 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3e88105f40 0x7f3e8810f960 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f3e80009ca0 tx=0x7f3e8002a8c0 comp rx=0 tx=0).stop 2024-09-10T22:28:27.104 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:27.087+0000 7f3e8f79d640 1 -- 172.21.15.19:0/1678972847 shutdown_connections 2024-09-10T22:28:27.104 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:27.087+0000 7f3e8f79d640 1 --2- 172.21.15.19:0/1678972847 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3e88105f40 0x7f3e8810f960 unknown :-1 s=CLOSED pgs=497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:28:27.105 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:27.087+0000 7f3e8f79d640 1 --2- 172.21.15.19:0/1678972847 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3e881055a0 0x7f3e88105a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:28:27.105 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:27.087+0000 7f3e8f79d640 1 --2- 172.21.15.19:0/1678972847 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3e88101250 0x7f3e88101630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:28:27.105 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:27.087+0000 7f3e8f79d640 1 -- 172.21.15.19:0/1678972847 >> 172.21.15.19:0/1678972847 conn(0x7f3e88078140 msgr2=0x7f3e880ff530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:28:27.105 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:27.088+0000 7f3e8f79d640 1 -- 172.21.15.19:0/1678972847 shutdown_connections 2024-09-10T22:28:27.105 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:27.088+0000 7f3e8f79d640 1 -- 172.21.15.19:0/1678972847 wait complete. 2024-09-10T22:28:27.106 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:27.089+0000 7f3e8f79d640 1 Processor -- start 2024-09-10T22:28:27.106 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:27.089+0000 7f3e8f79d640 1 -- start start 2024-09-10T22:28:27.106 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:27.089+0000 7f3e8f79d640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3e88101250 0x7f3e8819b470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:28:27.106 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:27.089+0000 7f3e8f79d640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3e881055a0 0x7f3e8819b9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:28:27.106 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:27.089+0000 7f3e8d539640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3e88101250 0x7f3e8819b470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:28:27.106 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:27.089+0000 7f3e8d539640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3e88101250 0x7f3e8819b470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:49530/0 (socket says 172.21.15.19:49530) 2024-09-10T22:28:27.107 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:27.089+0000 7f3e8d539640 1 -- 172.21.15.19:0/458915817 learned_addr learned my addr 172.21.15.19:0/458915817 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:28:27.107 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:27.090+0000 7f3e8f79d640 1 --2- 172.21.15.19:0/458915817 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3e88105f40 0x7f3e881a0d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:28:27.107 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:27.090+0000 7f3e8cd38640 1 --2- 172.21.15.19:0/458915817 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3e881055a0 0x7f3e8819b9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:28:27.107 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:27.090+0000 7f3e8f79d640 1 -- 172.21.15.19:0/458915817 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f3e88112d80 con 0x7f3e88101250 2024-09-10T22:28:27.107 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:27.090+0000 7f3e8f79d640 1 -- 172.21.15.19:0/458915817 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f3e88112c00 con 0x7f3e88105f40 2024-09-10T22:28:27.108 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:27.090+0000 7f3e8f79d640 1 -- 172.21.15.19:0/458915817 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f3e88112f00 con 0x7f3e881055a0 2024-09-10T22:28:27.108 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:27.090+0000 7f3e8dd3a640 1 --2- 172.21.15.19:0/458915817 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3e88105f40 0x7f3e881a0d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:28:27.108 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:27.090+0000 7f3e8cd38640 1 -- 172.21.15.19:0/458915817 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3e88105f40 msgr2=0x7f3e881a0d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:28:27.108 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:27.090+0000 7f3e8cd38640 1 --2- 172.21.15.19:0/458915817 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3e88105f40 0x7f3e881a0d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:28:27.108 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:27.090+0000 7f3e8cd38640 1 -- 172.21.15.19:0/458915817 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3e88101250 msgr2=0x7f3e8819b470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:28:27.108 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:27.090+0000 7f3e8cd38640 1 --2- 172.21.15.19:0/458915817 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3e88101250 0x7f3e8819b470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:28:27.109 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:27.090+0000 7f3e8cd38640 1 -- 172.21.15.19:0/458915817 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3e881a1520 con 0x7f3e881055a0 2024-09-10T22:28:27.109 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:27.090+0000 7f3e8cd38640 1 --2- 172.21.15.19:0/458915817 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3e881055a0 0x7f3e8819b9b0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f3e7800e9f0 tx=0x7f3e7800eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:28:27.109 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:27.091+0000 7f3e7e7fc640 1 -- 172.21.15.19:0/458915817 <== mon.1 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e7800ccc0 con 0x7f3e881055a0 2024-09-10T22:28:27.109 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:27.091+0000 7f3e7e7fc640 1 -- 172.21.15.19:0/458915817 <== mon.1 v2:172.21.15.138:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3e780108e0 con 0x7f3e881055a0 2024-09-10T22:28:27.109 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:27.091+0000 7f3e7e7fc640 1 -- 172.21.15.19:0/458915817 <== mon.1 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e78018880 con 0x7f3e881055a0 2024-09-10T22:28:27.110 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:27.091+0000 7f3e8f79d640 1 -- 172.21.15.19:0/458915817 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3e881a1810 con 0x7f3e881055a0 2024-09-10T22:28:27.110 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:27.091+0000 7f3e8f79d640 1 -- 172.21.15.19:0/458915817 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3e881a7ed0 con 0x7f3e881055a0 2024-09-10T22:28:27.110 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:27.092+0000 7f3e8f79d640 1 -- 172.21.15.19:0/458915817 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3e88101630 con 0x7f3e881055a0 2024-09-10T22:28:27.110 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:27.094+0000 7f3e7e7fc640 1 -- 172.21.15.19:0/458915817 <== mon.1 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 18) ==== 153250+0+0 (secure 0 0 0) 0x7f3e78010430 con 0x7f3e881055a0 2024-09-10T22:28:27.110 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:27.096+0000 7f3e7e7fc640 1 --2- 172.21.15.19:0/458915817 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f3e740b5360 0x7f3e740b7820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:28:27.110 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:27.096+0000 7f3e8d539640 1 --2- 172.21.15.19:0/458915817 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f3e740b5360 0x7f3e740b7820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:28:27.111 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:27.096+0000 7f3e7e7fc640 1 -- 172.21.15.19:0/458915817 <== mon.1 v2:172.21.15.138:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8327+0+0 (secure 0 0 0) 0x7f3e780e5ee0 con 0x7f3e881055a0 2024-09-10T22:28:27.111 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:27.097+0000 7f3e8d539640 1 --2- 172.21.15.19:0/458915817 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f3e740b5360 0x7f3e740b7820 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f3e84009c90 tx=0x7f3e84005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:28:27.111 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:27.100+0000 7f3e7e7fc640 1 -- 172.21.15.19:0/458915817 <== mon.1 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f3e780ac6f0 con 0x7f3e881055a0 2024-09-10T22:28:27.362 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:27.360+0000 7f3e8f79d640 1 -- 172.21.15.19:0/458915817 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f3e881a82c0 con 0x7f3e881055a0 2024-09-10T22:28:27.362 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:27.361+0000 7f3e7e7fc640 1 -- 172.21.15.19:0/458915817 <== mon.1 v2:172.21.15.138:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) ==== 94+0+11922 (secure 0 0 0) 0x7f3e780b1120 con 0x7f3e881055a0 2024-09-10T22:28:27.363 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-10T22:28:27.363 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":26,"btime":"2024-09-10T22:27:32:930215+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14673,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6835/1835804747","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6834","nonce":1835804747},{"type":"v1","addr":"172.21.15.19:6835","nonce":1835804747}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14685,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6837/1750470490","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6836","nonce":1750470490},{"type":"v1","addr":"172.21.15.19:6837","nonce":1750470490}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14733,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6839/2642941149","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6838","nonce":2642941149},{"type":"v1","addr":"172.21.15.19:6839","nonce":2642941149}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14745,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6841/2449948682","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6840","nonce":2449948682},{"type":"v1","addr":"172.21.15.19:6841","nonce":2449948682}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24511,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.138:6833/2524811494","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6832","nonce":2524811494},{"type":"v1","addr":"172.21.15.138:6833","nonce":2524811494}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24512,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6833/3014993624","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6832","nonce":3014993624},{"type":"v1","addr":"172.21.15.135:6833","nonce":3014993624}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":26,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-10T22:24:22.733925+0000","modified":"2024-09-10T22:27:32.420238+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24581,"mds_1":24568,"mds_2":24553},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24527":{"gid":24527,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.135:6835/3715773348","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6834","nonce":3715773348},{"type":"v1","addr":"172.21.15.135:6835","nonce":3715773348}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24541":{"gid":24541,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.138:6835/933547028","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6834","nonce":933547028},{"type":"v1","addr":"172.21.15.138:6835","nonce":933547028}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24551":{"gid":24551,"name":"h","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.135:6837/3495029135","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6836","nonce":3495029135},{"type":"v1","addr":"172.21.15.135:6837","nonce":3495029135}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24553":{"gid":24553,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":10,"addr":"172.21.15.138:6837/3353290042","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6836","nonce":3353290042},{"type":"v1","addr":"172.21.15.138:6837","nonce":3353290042}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24568":{"gid":24568,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.138:6839/383637208","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6838","nonce":383637208},{"type":"v1","addr":"172.21.15.138:6839","nonce":383637208}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24581":{"gid":24581,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.135:6839/1254769802","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6838","nonce":1254769802},{"type":"v1","addr":"172.21.15.135:6839","nonce":1254769802}]},"join_fscid":-1,"export_targets":[1],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24581,"qdb_cluster":[24553,24568,24581]},"id":1}]} 2024-09-10T22:28:27.363 INFO:teuthology.orchestra.run.smithi019.stderr:dumped fsmap epoch 26 2024-09-10T22:28:27.365 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:27.363+0000 7f3e8f79d640 1 -- 172.21.15.19:0/458915817 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f3e740b5360 msgr2=0x7f3e740b7820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:28:27.365 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:27.363+0000 7f3e8f79d640 1 --2- 172.21.15.19:0/458915817 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f3e740b5360 0x7f3e740b7820 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f3e84009c90 tx=0x7f3e84005f90 comp rx=0 tx=0).stop 2024-09-10T22:28:27.365 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:27.363+0000 7f3e8f79d640 1 -- 172.21.15.19:0/458915817 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3e881055a0 msgr2=0x7f3e8819b9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:28:27.365 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:27.363+0000 7f3e8f79d640 1 --2- 172.21.15.19:0/458915817 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3e881055a0 0x7f3e8819b9b0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f3e7800e9f0 tx=0x7f3e7800eeb0 comp rx=0 tx=0).stop 2024-09-10T22:28:27.365 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:27.363+0000 7f3e8f79d640 1 -- 172.21.15.19:0/458915817 shutdown_connections 2024-09-10T22:28:27.365 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:27.364+0000 7f3e8f79d640 1 --2- 172.21.15.19:0/458915817 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f3e740b5360 0x7f3e740b7820 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:28:27.365 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:27.364+0000 7f3e8f79d640 1 --2- 172.21.15.19:0/458915817 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3e88105f40 0x7f3e881a0d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:28:27.365 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:27.364+0000 7f3e8f79d640 1 --2- 172.21.15.19:0/458915817 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3e881055a0 0x7f3e8819b9b0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:28:27.366 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:27.364+0000 7f3e8f79d640 1 --2- 172.21.15.19:0/458915817 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3e88101250 0x7f3e8819b470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:28:27.366 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:27.364+0000 7f3e8f79d640 1 -- 172.21.15.19:0/458915817 >> 172.21.15.19:0/458915817 conn(0x7f3e88078140 msgr2=0x7f3e88108ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:28:27.366 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:27.364+0000 7f3e8f79d640 1 -- 172.21.15.19:0/458915817 shutdown_connections 2024-09-10T22:28:27.366 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:27.364+0000 7f3e8f79d640 1 -- 172.21.15.19:0/458915817 wait complete. 2024-09-10T22:28:28.092 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:28:27 smithi019 ceph-mon[31375]: pgmap v408: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 483 MiB/s wr, 516 op/s 2024-09-10T22:28:28.093 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:28:27 smithi019 ceph-mon[31375]: from='client.? 172.21.15.19:0/458915817' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T22:28:28.110 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:28:27 smithi135 ceph-mon[34789]: pgmap v408: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 483 MiB/s wr, 516 op/s 2024-09-10T22:28:28.110 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:28:27 smithi135 ceph-mon[34789]: from='client.? 172.21.15.19:0/458915817' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T22:28:28.125 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:28:27 smithi138 ceph-mon[35236]: pgmap v408: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 483 MiB/s wr, 516 op/s 2024-09-10T22:28:28.125 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:28:27 smithi138 ceph-mon[35236]: from='client.? 172.21.15.19:0/458915817' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T22:28:28.164 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 22997a4c-6fc2-11ef-bcea-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-09-10T22:28:28.497 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/22997a4c-6fc2-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T22:28:29.188 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:29.182+0000 7fad4bb3c640 1 -- 172.21.15.19:0/3458683138 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fad44108020 msgr2=0x7fad4410e820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:28:29.188 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:29.182+0000 7fad4bb3c640 1 --2- 172.21.15.19:0/3458683138 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fad44108020 0x7fad4410e820 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7fad3c009ca0 tx=0x7fad3c02a8c0 comp rx=0 tx=0).stop 2024-09-10T22:28:29.188 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:29.182+0000 7fad4bb3c640 1 -- 172.21.15.19:0/3458683138 shutdown_connections 2024-09-10T22:28:29.188 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:29.182+0000 7fad4bb3c640 1 --2- 172.21.15.19:0/3458683138 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fad44108020 0x7fad4410e820 unknown :-1 s=CLOSED pgs=498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:28:29.188 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:29.182+0000 7fad4bb3c640 1 --2- 172.21.15.19:0/3458683138 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fad441076a0 0x7fad44107ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:28:29.188 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:29.182+0000 7fad4bb3c640 1 --2- 172.21.15.19:0/3458683138 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fad44101c90 0x7fad44102070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:28:29.189 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:29.182+0000 7fad4bb3c640 1 -- 172.21.15.19:0/3458683138 >> 172.21.15.19:0/3458683138 conn(0x7fad440fd700 msgr2=0x7fad440ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:28:29.189 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:29.183+0000 7fad4bb3c640 1 -- 172.21.15.19:0/3458683138 shutdown_connections 2024-09-10T22:28:29.189 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:29.183+0000 7fad4bb3c640 1 -- 172.21.15.19:0/3458683138 wait complete. 2024-09-10T22:28:29.189 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:29.184+0000 7fad4bb3c640 1 Processor -- start 2024-09-10T22:28:29.189 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:29.184+0000 7fad4bb3c640 1 -- start start 2024-09-10T22:28:29.189 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:29.184+0000 7fad4bb3c640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fad44101c90 0x7fad44198140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:28:29.189 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:29.184+0000 7fad4bb3c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fad441076a0 0x7fad44198680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:28:29.189 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:29.184+0000 7fad4bb3c640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fad44108020 0x7fad4419da20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:28:29.189 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:29.185+0000 7fad4bb3c640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fad44111d30 con 0x7fad441076a0 2024-09-10T22:28:29.190 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:29.185+0000 7fad4bb3c640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fad44111bb0 con 0x7fad44108020 2024-09-10T22:28:29.190 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:29.185+0000 7fad4bb3c640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7fad44111eb0 con 0x7fad44101c90 2024-09-10T22:28:29.190 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:29.185+0000 7fad498d8640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fad44101c90 0x7fad44198140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:28:29.190 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:29.185+0000 7fad498d8640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fad44101c90 0x7fad44198140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.19:39568/0 (socket says 172.21.15.19:39568) 2024-09-10T22:28:29.190 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:29.185+0000 7fad490d7640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fad441076a0 0x7fad44198680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:28:29.190 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:29.185+0000 7fad498d8640 1 -- 172.21.15.19:0/2798096789 learned_addr learned my addr 172.21.15.19:0/2798096789 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:28:29.190 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:29.185+0000 7fad4a0d9640 1 --2- 172.21.15.19:0/2798096789 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fad44108020 0x7fad4419da20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:28:29.191 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:29.185+0000 7fad498d8640 1 -- 172.21.15.19:0/2798096789 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fad44108020 msgr2=0x7fad4419da20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:28:29.191 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:29.185+0000 7fad498d8640 1 --2- 172.21.15.19:0/2798096789 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fad44108020 0x7fad4419da20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:28:29.191 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:29.185+0000 7fad498d8640 1 -- 172.21.15.19:0/2798096789 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fad441076a0 msgr2=0x7fad44198680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:28:29.191 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:29.185+0000 7fad498d8640 1 --2- 172.21.15.19:0/2798096789 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fad441076a0 0x7fad44198680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:28:29.191 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:29.185+0000 7fad498d8640 1 -- 172.21.15.19:0/2798096789 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fad4419e1f0 con 0x7fad44101c90 2024-09-10T22:28:29.191 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:29.185+0000 7fad4a0d9640 1 --2- 172.21.15.19:0/2798096789 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fad44108020 0x7fad4419da20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T22:28:29.191 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:29.186+0000 7fad498d8640 1 --2- 172.21.15.19:0/2798096789 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fad44101c90 0x7fad44198140 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fad4000e9f0 tx=0x7fad4000edf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:28:29.191 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:29.186+0000 7fad3affd640 1 -- 172.21.15.19:0/2798096789 <== mon.1 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad4000ccc0 con 0x7fad44101c90 2024-09-10T22:28:29.192 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:29.186+0000 7fad3affd640 1 -- 172.21.15.19:0/2798096789 <== mon.1 v2:172.21.15.138:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fad4000ce60 con 0x7fad44101c90 2024-09-10T22:28:29.192 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:29.186+0000 7fad4bb3c640 1 -- 172.21.15.19:0/2798096789 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fad4419e4e0 con 0x7fad44101c90 2024-09-10T22:28:29.192 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:29.186+0000 7fad3affd640 1 -- 172.21.15.19:0/2798096789 <== mon.1 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad40010430 con 0x7fad44101c90 2024-09-10T22:28:29.192 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:29.186+0000 7fad4bb3c640 1 -- 172.21.15.19:0/2798096789 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fad4406aab0 con 0x7fad44101c90 2024-09-10T22:28:29.199 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:29.189+0000 7fad4df11740 1 Processor -- start 2024-09-10T22:28:29.200 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:29.189+0000 7fad3affd640 1 -- 172.21.15.19:0/2798096789 <== mon.1 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 18) ==== 153250+0+0 (secure 0 0 0) 0x7fad400046c0 con 0x7fad44101c90 2024-09-10T22:28:29.200 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:29.189+0000 7fad4df11740 1 -- start start 2024-09-10T22:28:29.200 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:29.190+0000 7fad4df11740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55c2685154d0 0x55c2685158b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:28:29.200 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:29.190+0000 7fad4df11740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55c268515df0 0x55c268525c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:28:29.200 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:29.190+0000 7fad4df11740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c268526190 0x55c268528580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:28:29.200 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:29.190+0000 7fad4df11740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x55c26848bea0 con 0x55c268515df0 2024-09-10T22:28:29.201 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:29.190+0000 7fad4df11740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55c26847b2d0 con 0x55c268526190 2024-09-10T22:28:29.201 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:29.190+0000 7fad4df11740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x55c26847f0e0 con 0x55c2685154d0 2024-09-10T22:28:29.201 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:29.190+0000 7fad498d8640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55c268515df0 0x55c268525c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:28:29.201 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:29.190+0000 7fad498d8640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55c268515df0 0x55c268525c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:49572/0 (socket says 172.21.15.19:49572) 2024-09-10T22:28:29.201 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:29.190+0000 7fad4a0d9640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55c2685154d0 0x55c2685158b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:28:29.201 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:29.190+0000 7fad490d7640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c268526190 0x55c268528580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:28:29.201 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:29.190+0000 7fad4a0d9640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55c2685154d0 0x55c2685158b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.19:39582/0 (socket says 172.21.15.19:39582) 2024-09-10T22:28:29.201 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:29.190+0000 7fad490d7640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c268526190 0x55c268528580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.19:36894/0 (socket says 172.21.15.19:36894) 2024-09-10T22:28:29.201 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:29.190+0000 7fad4a0d9640 1 -- 172.21.15.19:0/3353130742 learned_addr learned my addr 172.21.15.19:0/3353130742 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:28:29.202 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:29.191+0000 7fad4a0d9640 1 -- 172.21.15.19:0/3353130742 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c268526190 msgr2=0x55c268528580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:28:29.202 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:29.191+0000 7fad4a0d9640 1 --2- 172.21.15.19:0/3353130742 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c268526190 0x55c268528580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:28:29.202 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:29.191+0000 7fad4a0d9640 1 -- 172.21.15.19:0/3353130742 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55c268515df0 msgr2=0x55c268525c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:28:29.202 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:29.191+0000 7fad4a0d9640 1 --2- 172.21.15.19:0/3353130742 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55c268515df0 0x55c268525c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:28:29.202 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:29.191+0000 7fad4a0d9640 1 -- 172.21.15.19:0/3353130742 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c2681d9650 con 0x55c2685154d0 2024-09-10T22:28:29.202 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:29.191+0000 7fad3affd640 1 --2- 172.21.15.19:0/2798096789 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7fad300b5360 0x7fad300b7820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:28:29.202 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:29.191+0000 7fad4a0d9640 1 --2- 172.21.15.19:0/3353130742 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55c2685154d0 0x55c2685158b0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fad3c02f4b0 tx=0x7fad3c009a20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c5c0455f8d174770 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:28:29.202 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:29.191+0000 7fad2ffff640 1 -- 172.21.15.19:0/3353130742 <== mon.1 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad3c031650 con 0x55c2685154d0 2024-09-10T22:28:29.203 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:29.192+0000 7fad2ffff640 1 -- 172.21.15.19:0/3353130742 <== mon.1 v2:172.21.15.138:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fad3c040070 con 0x55c2685154d0 2024-09-10T22:28:29.203 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:29.192+0000 7fad2ffff640 1 -- 172.21.15.19:0/3353130742 <== mon.1 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad3c004700 con 0x55c2685154d0 2024-09-10T22:28:29.203 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:29.192+0000 7fad3affd640 1 -- 172.21.15.19:0/2798096789 <== mon.1 v2:172.21.15.138:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8327+0+0 (secure 0 0 0) 0x7fad400e6010 con 0x7fad44101c90 2024-09-10T22:28:29.203 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:29.192+0000 7fad4df11740 1 -- 172.21.15.19:0/3353130742 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55c2685154d0 msgr2=0x55c2685158b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:28:29.203 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:29.192+0000 7fad4df11740 1 --2- 172.21.15.19:0/3353130742 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55c2685154d0 0x55c2685158b0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fad3c02f4b0 tx=0x7fad3c009a20 comp rx=0 tx=0).stop 2024-09-10T22:28:29.203 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:29.192+0000 7fad498d8640 1 --2- 172.21.15.19:0/2798096789 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7fad300b5360 0x7fad300b7820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:28:29.203 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:29.193+0000 7fad4df11740 1 -- 172.21.15.19:0/3353130742 shutdown_connections 2024-09-10T22:28:29.203 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:29.193+0000 7fad4df11740 1 --2- 172.21.15.19:0/3353130742 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c268526190 0x55c268528580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:28:29.203 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:29.193+0000 7fad4df11740 1 --2- 172.21.15.19:0/3353130742 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55c268515df0 0x55c268525c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:28:29.203 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:29.193+0000 7fad4df11740 1 --2- 172.21.15.19:0/3353130742 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55c2685154d0 0x55c2685158b0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:28:29.204 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:29.193+0000 7fad4df11740 1 -- 172.21.15.19:0/3353130742 >> 172.21.15.19:0/3353130742 conn(0x55c268513300 msgr2=0x55c2685144a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:28:29.204 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:29.193+0000 7fad4df11740 1 -- 172.21.15.19:0/3353130742 shutdown_connections 2024-09-10T22:28:29.204 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:29.193+0000 7fad4df11740 1 -- 172.21.15.19:0/3353130742 wait complete. 2024-09-10T22:28:29.204 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:29.193+0000 7fad498d8640 1 --2- 172.21.15.19:0/2798096789 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7fad300b5360 0x7fad300b7820 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fad400e3e20 tx=0x7fad400e9af0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:28:29.204 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:29.193+0000 7fad4df11740 1 -- start start 2024-09-10T22:28:29.204 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:29.194+0000 7fad4df11740 1 Processor -- start 2024-09-10T22:28:29.204 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:29.194+0000 7fad4df11740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55c2685154d0 0x55c268525af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:28:29.204 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:29.194+0000 7fad4df11740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55c268515df0 0x55c268522f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:28:29.205 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:29.194+0000 7fad4df11740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c268526190 0x55c2685235c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:28:29.205 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:29.194+0000 7fad4a0d9640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55c2685154d0 0x55c268525af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:28:29.205 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:29.194+0000 7fad4a0d9640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55c2685154d0 0x55c268525af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.19:39590/0 (socket says 172.21.15.19:39590) 2024-09-10T22:28:29.205 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:29.194+0000 7fad4a0d9640 1 -- 172.21.15.19:0/2919122399 learned_addr learned my addr 172.21.15.19:0/2919122399 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:28:29.205 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:29.195+0000 7fad4df11740 1 -- 172.21.15.19:0/2919122399 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x55c2682dc700 con 0x55c268515df0 2024-09-10T22:28:29.205 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:29.195+0000 7fad490d7640 1 --2- 172.21.15.19:0/2919122399 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55c268515df0 0x55c268522f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:28:29.205 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:29.195+0000 7fad4df11740 1 -- 172.21.15.19:0/2919122399 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55c268416160 con 0x55c268526190 2024-09-10T22:28:29.205 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:29.195+0000 7fad4df11740 1 -- 172.21.15.19:0/2919122399 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x55c268528de0 con 0x55c2685154d0 2024-09-10T22:28:29.205 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:29.195+0000 7fad4df11740 10 client.0 _ll_register_callbacks cb 0x55c26842f9e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T22:28:29.206 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:29.195+0000 7fad4a0d9640 1 -- 172.21.15.19:0/2919122399 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c268526190 msgr2=0x55c2685235c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:28:29.206 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:29.195+0000 7fad4a0d9640 1 --2- 172.21.15.19:0/2919122399 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c268526190 0x55c2685235c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:28:29.206 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:29.195+0000 7fad4a0d9640 1 -- 172.21.15.19:0/2919122399 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55c268515df0 msgr2=0x55c268522f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:28:29.206 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:29.195+0000 7fad4a0d9640 1 --2- 172.21.15.19:0/2919122399 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55c268515df0 0x55c268522f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:28:29.206 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:29.195+0000 7fad4a0d9640 1 -- 172.21.15.19:0/2919122399 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c268443c90 con 0x55c2685154d0 2024-09-10T22:28:29.206 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:29.195+0000 7fad490d7640 1 --2- 172.21.15.19:0/2919122399 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55c268515df0 0x55c268522f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T22:28:29.206 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:29.195+0000 7fad4a0d9640 1 --2- 172.21.15.19:0/2919122399 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55c2685154d0 0x55c268525af0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fad3c02ade0 tx=0x7fad3c005de0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2f571b5f42303a6 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:28:29.206 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:29.195+0000 7fad2d7fa640 10 client.0 ms_handle_connect on v2:172.21.15.138:3300/0 2024-09-10T22:28:29.206 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:29.195+0000 7fad2d7fa640 1 -- 172.21.15.19:0/2919122399 <== mon.1 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad3c051020 con 0x55c2685154d0 2024-09-10T22:28:29.206 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:29.196+0000 7fad4df11740 1 -- 172.21.15.19:0/2919122399 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fad3c040070 con 0x55c2685154d0 2024-09-10T22:28:29.207 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:29.196+0000 7fad2d7fa640 1 -- 172.21.15.19:0/2919122399 <== mon.1 v2:172.21.15.138:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8327+0+0 (secure 0 0 0) 0x7fad3c003970 con 0x55c2685154d0 2024-09-10T22:28:29.207 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:29.196+0000 7fad2d7fa640 1 -- 172.21.15.19:0/2919122399 <== mon.1 v2:172.21.15.138:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7fad3c05c050 con 0x55c2685154d0 2024-09-10T22:28:29.207 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:29.196+0000 7fad4df11740 10 client.25288 fetch_fsmap learned FSMap version 26 2024-09-10T22:28:29.207 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:29.196+0000 7fad4df11740 1 -- 172.21.15.19:0/2919122399 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x55c268534780 con 0x55c2685154d0 2024-09-10T22:28:29.207 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:29.196+0000 7fad2d7fa640 1 -- 172.21.15.19:0/2919122399 <== mon.1 v2:172.21.15.138:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fad3c040070 con 0x55c2685154d0 2024-09-10T22:28:29.207 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:29.196+0000 7fad2d7fa640 1 -- 172.21.15.19:0/2919122399 <== mon.1 v2:172.21.15.138:3300/0 5 ==== fsmap(e 26) ==== 8350+0+0 (secure 0 0 0) 0x7fad3c02fa50 con 0x55c2685154d0 2024-09-10T22:28:29.207 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:29.197+0000 7fad4df11740 10 client.25288 fetch_fsmap finished waiting for FSMap version 26 2024-09-10T22:28:29.207 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:29.197+0000 7fad4df11740 10 client.25288 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-10T22:28:29.207 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:29.197+0000 7fad4df11740 20 client.25288 populate_metadata read hostname 'smithi019' 2024-09-10T22:28:29.207 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:29.197+0000 7fad4df11740 1 --2- 172.21.15.19:0/2919122399 >> [v2:172.21.15.138:6836/3353290042,v1:172.21.15.138:6837/3353290042] conn(0x55c268535ad0 0x55c268537ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:28:29.208 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:29.197+0000 7fad4df11740 4 client.25288 mds_command: new command op to 24553 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T22:28:29.208 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:29.197+0000 7fad4df11740 1 -- 172.21.15.19:0/2919122399 --> [v2:172.21.15.138:6836/3353290042,v1:172.21.15.138:6837/3353290042] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c26848ddf0 con 0x55c268535ad0 2024-09-10T22:28:29.208 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:29.197+0000 7fad490d7640 1 --2- 172.21.15.19:0/2919122399 >> [v2:172.21.15.138:6836/3353290042,v1:172.21.15.138:6837/3353290042] conn(0x55c268535ad0 0x55c268537ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:28:29.208 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:29.197+0000 7fad2d7fa640 10 client.25288 ms_handle_connect on v2:172.21.15.138:6836/3353290042 2024-09-10T22:28:29.208 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:29.198+0000 7fad490d7640 1 --2- 172.21.15.19:0/2919122399 >> [v2:172.21.15.138:6836/3353290042,v1:172.21.15.138:6837/3353290042] conn(0x55c268535ad0 0x55c268537ec0 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=5cfe9589a81e3de1 server_cookie=e32f584965e09b45 in_seq=0 out_seq=0 2024-09-10T22:28:29.209 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:29.199+0000 7fad2d7fa640 1 -- 172.21.15.19:0/2919122399 <== mds.2 v2:172.21.15.138:6836/3353290042 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55c26848ddf0 con 0x55c268535ad0 2024-09-10T22:28:29.209 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:29.199+0000 7fad2d7fa640 10 client.25288 handle_command_reply: tid=0 2024-09-10T22:28:29.210 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:29.199+0000 7fad4df11740 1 client.25288 shutdown 2024-09-10T22:28:29.210 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:29.199+0000 7fad4df11740 1 -- 172.21.15.19:0/2919122399 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55c2685154d0 msgr2=0x55c268525af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:28:29.210 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:29.199+0000 7fad4df11740 1 --2- 172.21.15.19:0/2919122399 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55c2685154d0 0x55c268525af0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fad3c02ade0 tx=0x7fad3c005de0 comp rx=0 tx=0).stop 2024-09-10T22:28:29.210 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:29.199+0000 7fad4df11740 1 -- 172.21.15.19:0/2919122399 shutdown_connections 2024-09-10T22:28:29.210 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:29.199+0000 7fad4df11740 1 --2- 172.21.15.19:0/2919122399 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c268526190 0x55c2685235c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:28:29.210 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:29.199+0000 7fad4df11740 1 --2- 172.21.15.19:0/2919122399 >> [v2:172.21.15.138:6836/3353290042,v1:172.21.15.138:6837/3353290042] conn(0x55c268535ad0 0x55c268537ec0 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:28:29.210 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:29.199+0000 7fad2d7fa640 0 client.25288 ms_handle_reset on v2:172.21.15.138:6836/3353290042 2024-09-10T22:28:29.210 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:29.199+0000 7fad4df11740 1 --2- 172.21.15.19:0/2919122399 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55c268515df0 0x55c268522f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:28:29.210 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:29.199+0000 7fad4df11740 1 --2- 172.21.15.19:0/2919122399 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55c2685154d0 0x55c268525af0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:28:29.210 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:29.199+0000 7fad4df11740 1 -- 172.21.15.19:0/2919122399 >> 172.21.15.19:0/2919122399 conn(0x55c268513300 msgr2=0x55c268512420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:28:29.211 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:29.199+0000 7fad4df11740 1 -- 172.21.15.19:0/2919122399 shutdown_connections 2024-09-10T22:28:29.211 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:29.199+0000 7fad4df11740 1 -- 172.21.15.19:0/2919122399 wait complete. 2024-09-10T22:28:29.211 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:29.199+0000 7fad4df11740 20 client.25288 trim_cache size 0 max 16384 2024-09-10T22:28:29.214 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:29.213+0000 7fad4df11740 1 Processor -- start 2024-09-10T22:28:29.214 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:29.213+0000 7fad4df11740 1 -- start start 2024-09-10T22:28:29.215 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:29.213+0000 7fad4df11740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55c2685154d0 0x55c268512c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:28:29.215 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:29.213+0000 7fad4df11740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55c268515df0 0x55c2685320b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:28:29.216 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:29.213+0000 7fad4df11740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c268526190 0x55c268514670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:28:29.216 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:29.213+0000 7fad4df11740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fad441aebe0 con 0x55c268515df0 2024-09-10T22:28:29.216 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:29.213+0000 7fad4df11740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fad441ac4b0 con 0x55c268526190 2024-09-10T22:28:29.216 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:29.213+0000 7fad4df11740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7fad441aa300 con 0x55c2685154d0 2024-09-10T22:28:29.216 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:29.214+0000 7fad490d7640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55c268515df0 0x55c2685320b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:28:29.216 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:29.214+0000 7fad4a0d9640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55c2685154d0 0x55c268512c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:28:29.216 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:29.214+0000 7fad490d7640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55c268515df0 0x55c2685320b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:49586/0 (socket says 172.21.15.19:49586) 2024-09-10T22:28:29.216 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:29.214+0000 7fad490d7640 1 -- 172.21.15.19:0/3245867409 learned_addr learned my addr 172.21.15.19:0/3245867409 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:28:29.216 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:29.214+0000 7fad4a0d9640 1 --2- 172.21.15.19:0/3245867409 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c268526190 0x55c268514670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:28:29.216 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:29.214+0000 7fad490d7640 1 -- 172.21.15.19:0/3245867409 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55c2685154d0 msgr2=0x55c268512c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:28:29.216 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:29.214+0000 7fad490d7640 1 --2- 172.21.15.19:0/3245867409 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55c2685154d0 0x55c268512c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:28:29.216 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:29.214+0000 7fad490d7640 1 -- 172.21.15.19:0/3245867409 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c268526190 msgr2=0x55c268514670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:28:29.217 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:29.214+0000 7fad490d7640 1 --2- 172.21.15.19:0/3245867409 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c268526190 0x55c268514670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:28:29.217 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:29.214+0000 7fad490d7640 1 -- 172.21.15.19:0/3245867409 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c268523930 con 0x55c268515df0 2024-09-10T22:28:29.217 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:29.214+0000 7fad4a0d9640 1 --2- 172.21.15.19:0/3245867409 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55c2685154d0 0x55c268512c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T22:28:29.218 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:29.214+0000 7fad490d7640 1 --2- 172.21.15.19:0/3245867409 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55c268515df0 0x55c2685320b0 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x55c268513e40 tx=0x7fad3400a2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8537c018096c2321 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:28:29.218 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:29.215+0000 7fad2f7fe640 1 -- 172.21.15.19:0/3245867409 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad3400fad0 con 0x55c268515df0 2024-09-10T22:28:29.218 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:29.215+0000 7fad2f7fe640 1 -- 172.21.15.19:0/3245867409 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fad340054d0 con 0x55c268515df0 2024-09-10T22:28:29.218 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:29.215+0000 7fad2f7fe640 1 -- 172.21.15.19:0/3245867409 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad34004a90 con 0x55c268515df0 2024-09-10T22:28:29.218 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:29.215+0000 7fad4df11740 1 -- 172.21.15.19:0/3245867409 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55c268515df0 msgr2=0x55c2685320b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:28:29.219 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:29.215+0000 7fad4df11740 1 --2- 172.21.15.19:0/3245867409 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55c268515df0 0x55c2685320b0 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x55c268513e40 tx=0x7fad3400a2d0 comp rx=0 tx=0).stop 2024-09-10T22:28:29.219 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:29.216+0000 7fad4df11740 1 -- 172.21.15.19:0/3245867409 shutdown_connections 2024-09-10T22:28:29.219 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:29.216+0000 7fad4df11740 1 --2- 172.21.15.19:0/3245867409 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c268526190 0x55c268514670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:28:29.219 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:29.216+0000 7fad4df11740 1 --2- 172.21.15.19:0/3245867409 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55c268515df0 0x55c2685320b0 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:28:29.219 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:29.216+0000 7fad4df11740 1 --2- 172.21.15.19:0/3245867409 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55c2685154d0 0x55c268512c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:28:29.219 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:29.216+0000 7fad4df11740 1 -- 172.21.15.19:0/3245867409 >> 172.21.15.19:0/3245867409 conn(0x55c268513300 msgr2=0x55c268524d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:28:29.219 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:29.216+0000 7fad4df11740 1 -- 172.21.15.19:0/3245867409 shutdown_connections 2024-09-10T22:28:29.219 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:29.216+0000 7fad4df11740 1 -- 172.21.15.19:0/3245867409 wait complete. 2024-09-10T22:28:29.219 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:29.216+0000 7fad4df11740 1 -- start start 2024-09-10T22:28:29.219 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:29.216+0000 7fad4df11740 1 Processor -- start 2024-09-10T22:28:29.219 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:29.217+0000 7fad4df11740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55c2685154d0 0x55c26853b680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:28:29.219 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:29.217+0000 7fad4df11740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55c268515df0 0x55c268539bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:28:29.219 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:29.217+0000 7fad4df11740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c268526190 0x55c26853a110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:28:29.220 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:29.217+0000 7fad4df11740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fad441aa970 con 0x55c268515df0 2024-09-10T22:28:29.220 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:29.217+0000 7fad4df11740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fad441abde0 con 0x55c268526190 2024-09-10T22:28:29.220 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:29.217+0000 7fad4df11740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7fad441ab040 con 0x55c2685154d0 2024-09-10T22:28:29.220 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:29.217+0000 7fad4df11740 10 client.0 _ll_register_callbacks cb 0x7fad400e99c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T22:28:29.220 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:29.217+0000 7fad490d7640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55c268515df0 0x55c268539bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:28:29.220 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:29.217+0000 7fad4a0d9640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c268526190 0x55c26853a110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:28:29.220 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:29.217+0000 7fad4a0d9640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c268526190 0x55c26853a110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.19:36926/0 (socket says 172.21.15.19:36926) 2024-09-10T22:28:29.220 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:29.217+0000 7fad4a0d9640 1 -- 172.21.15.19:0/4012770877 learned_addr learned my addr 172.21.15.19:0/4012770877 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:28:29.220 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:29.217+0000 7fad4a0d9640 1 --2- 172.21.15.19:0/4012770877 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55c2685154d0 0x55c26853b680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:28:29.223 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:29.217+0000 7fad490d7640 1 -- 172.21.15.19:0/4012770877 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55c2685154d0 msgr2=0x55c26853b680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:28:29.223 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:29.218+0000 7fad490d7640 1 --2- 172.21.15.19:0/4012770877 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55c2685154d0 0x55c26853b680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:28:29.223 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:29.218+0000 7fad490d7640 1 -- 172.21.15.19:0/4012770877 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c268526190 msgr2=0x55c26853a110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:28:29.224 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:29.218+0000 7fad490d7640 1 --2- 172.21.15.19:0/4012770877 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c268526190 0x55c26853a110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:28:29.224 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:29.218+0000 7fad490d7640 1 -- 172.21.15.19:0/4012770877 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c26853a920 con 0x55c268515df0 2024-09-10T22:28:29.224 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:29.218+0000 7fad4a0d9640 1 --2- 172.21.15.19:0/4012770877 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c268526190 0x55c26853a110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T22:28:29.224 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:29.218+0000 7fad490d7640 1 --2- 172.21.15.19:0/4012770877 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55c268515df0 0x55c268539bd0 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x55c2685243c0 tx=0x7fad34005230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=acf5d4cd4af728dc server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:28:29.224 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:29.218+0000 7fad2d7fa640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-10T22:28:29.224 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:29.218+0000 7fad2d7fa640 1 -- 172.21.15.19:0/4012770877 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad34032020 con 0x55c268515df0 2024-09-10T22:28:29.224 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:29.218+0000 7fad2d7fa640 1 -- 172.21.15.19:0/4012770877 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8327+0+0 (secure 0 0 0) 0x7fad3400fce0 con 0x55c268515df0 2024-09-10T22:28:29.224 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:29.218+0000 7fad4df11740 1 -- 172.21.15.19:0/4012770877 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fad340054d0 con 0x55c268515df0 2024-09-10T22:28:29.224 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:29.219+0000 7fad2d7fa640 1 -- 172.21.15.19:0/4012770877 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7fad3403d050 con 0x55c268515df0 2024-09-10T22:28:29.224 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:29.219+0000 7fad4df11740 10 client.15747 fetch_fsmap learned FSMap version 26 2024-09-10T22:28:29.224 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:29.219+0000 7fad4df11740 1 -- 172.21.15.19:0/4012770877 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x55c2685a3690 con 0x55c268515df0 2024-09-10T22:28:29.224 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:29.219+0000 7fad2d7fa640 1 -- 172.21.15.19:0/4012770877 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fad34004b70 con 0x55c268515df0 2024-09-10T22:28:29.225 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:29.219+0000 7fad2d7fa640 1 -- 172.21.15.19:0/4012770877 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 26) ==== 8350+0+0 (secure 0 0 0) 0x7fad3402e6b0 con 0x55c268515df0 2024-09-10T22:28:29.225 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:29.219+0000 7fad4df11740 10 client.15747 fetch_fsmap finished waiting for FSMap version 26 2024-09-10T22:28:29.225 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:29.219+0000 7fad4df11740 10 client.15747 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-10T22:28:29.225 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:29.219+0000 7fad4df11740 20 client.15747 populate_metadata read hostname 'smithi019' 2024-09-10T22:28:29.225 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:29.219+0000 7fad4df11740 1 --2- 172.21.15.19:0/4012770877 >> [v2:172.21.15.138:6836/3353290042,v1:172.21.15.138:6837/3353290042] conn(0x55c2685a3e40 0x55c2685a6260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:28:29.225 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:29.219+0000 7fad4df11740 4 client.15747 mds_command: new command op to 24553 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-10T22:28:29.225 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:29.219+0000 7fad4df11740 1 -- 172.21.15.19:0/4012770877 --> [v2:172.21.15.138:6836/3353290042,v1:172.21.15.138:6837/3353290042] -- command(tid 0: {"prefix": "damage ls"}) -- 0x7fad340054d0 con 0x55c2685a3e40 2024-09-10T22:28:29.225 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:29.219+0000 7fad4a0d9640 1 --2- 172.21.15.19:0/4012770877 >> [v2:172.21.15.138:6836/3353290042,v1:172.21.15.138:6837/3353290042] conn(0x55c2685a3e40 0x55c2685a6260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:28:29.225 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:29.220+0000 7fad4a0d9640 1 --2- 172.21.15.19:0/4012770877 >> [v2:172.21.15.138:6836/3353290042,v1:172.21.15.138:6837/3353290042] conn(0x55c2685a3e40 0x55c2685a6260 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=97cbb8c1a070d3ae server_cookie=de3d9b38c4407dee in_seq=0 out_seq=0 2024-09-10T22:28:29.225 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:29.220+0000 7fad2d7fa640 10 client.15747 ms_handle_connect on v2:172.21.15.138:6836/3353290042 2024-09-10T22:28:29.225 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:29.220+0000 7fad2d7fa640 1 -- 172.21.15.19:0/4012770877 <== mds.2 v2:172.21.15.138:6836/3353290042 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x7fad340054d0 con 0x55c2685a3e40 2024-09-10T22:28:29.225 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:29.220+0000 7fad2d7fa640 10 client.15747 handle_command_reply: tid=0 2024-09-10T22:28:29.226 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:29.220+0000 7fad4df11740 1 client.15747 shutdown 2024-09-10T22:28:29.226 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:29.220+0000 7fad4df11740 1 -- 172.21.15.19:0/4012770877 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55c268515df0 msgr2=0x55c268539bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:28:29.226 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:29.220+0000 7fad4df11740 1 --2- 172.21.15.19:0/4012770877 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55c268515df0 0x55c268539bd0 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x55c2685243c0 tx=0x7fad34005230 comp rx=0 tx=0).stop 2024-09-10T22:28:29.226 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:29.220+0000 7fad4df11740 1 -- 172.21.15.19:0/4012770877 shutdown_connections 2024-09-10T22:28:29.226 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:29.220+0000 7fad4df11740 1 --2- 172.21.15.19:0/4012770877 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c268526190 0x55c26853a110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:28:29.226 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:29.220+0000 7fad4df11740 1 --2- 172.21.15.19:0/4012770877 >> [v2:172.21.15.138:6836/3353290042,v1:172.21.15.138:6837/3353290042] conn(0x55c2685a3e40 0x55c2685a6260 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:28:29.226 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:29.220+0000 7fad4df11740 1 --2- 172.21.15.19:0/4012770877 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55c268515df0 0x55c268539bd0 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:28:29.226 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:29.220+0000 7fad4df11740 1 --2- 172.21.15.19:0/4012770877 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55c2685154d0 0x55c26853b680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:28:29.226 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:29.220+0000 7fad4df11740 1 -- 172.21.15.19:0/4012770877 >> 172.21.15.19:0/4012770877 conn(0x55c268513300 msgr2=0x55c26851a620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:28:29.226 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:29.220+0000 7fad2d7fa640 0 client.15747 ms_handle_reset on v2:172.21.15.138:6836/3353290042 2024-09-10T22:28:29.226 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:29.221+0000 7fad4df11740 1 -- 172.21.15.19:0/4012770877 shutdown_connections 2024-09-10T22:28:29.226 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:29.221+0000 7fad4df11740 1 -- 172.21.15.19:0/4012770877 wait complete. 2024-09-10T22:28:29.226 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:29.221+0000 7fad4df11740 20 client.15747 trim_cache size 0 max 16384 2024-09-10T22:28:29.227 INFO:teuthology.orchestra.run.smithi019.stdout:[] 2024-09-10T22:28:29.228 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:29.221+0000 7fad4bb3c640 1 -- 172.21.15.19:0/2798096789 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7fad300b5360 msgr2=0x7fad300b7820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:28:29.228 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:29.221+0000 7fad4bb3c640 1 --2- 172.21.15.19:0/2798096789 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7fad300b5360 0x7fad300b7820 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fad400e3e20 tx=0x7fad400e9af0 comp rx=0 tx=0).stop 2024-09-10T22:28:29.228 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:29.221+0000 7fad4bb3c640 1 -- 172.21.15.19:0/2798096789 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fad44101c90 msgr2=0x7fad44198140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:28:29.228 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:29.221+0000 7fad4bb3c640 1 --2- 172.21.15.19:0/2798096789 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fad44101c90 0x7fad44198140 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fad4000e9f0 tx=0x7fad4000edf0 comp rx=0 tx=0).stop 2024-09-10T22:28:29.228 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:29.221+0000 7fad4bb3c640 1 -- 172.21.15.19:0/2798096789 shutdown_connections 2024-09-10T22:28:29.228 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:29.221+0000 7fad4bb3c640 1 --2- 172.21.15.19:0/2798096789 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7fad300b5360 0x7fad300b7820 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:28:29.229 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:29.221+0000 7fad4bb3c640 1 --2- 172.21.15.19:0/2798096789 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fad44108020 0x7fad4419da20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:28:29.229 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:29.221+0000 7fad4bb3c640 1 --2- 172.21.15.19:0/2798096789 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fad441076a0 0x7fad44198680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:28:29.229 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:29.221+0000 7fad4bb3c640 1 --2- 172.21.15.19:0/2798096789 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fad44101c90 0x7fad44198140 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:28:29.229 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:29.221+0000 7fad4bb3c640 1 -- 172.21.15.19:0/2798096789 >> 172.21.15.19:0/2798096789 conn(0x7fad440fd700 msgr2=0x7fad44103c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:28:29.229 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:29.222+0000 7fad4bb3c640 1 -- 172.21.15.19:0/2798096789 shutdown_connections 2024-09-10T22:28:29.229 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:29.222+0000 7fad4bb3c640 1 -- 172.21.15.19:0/2798096789 wait complete. 2024-09-10T22:28:30.113 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:28:29 smithi135 ceph-mon[34789]: pgmap v409: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 754 KiB/s rd, 411 MiB/s wr, 250 op/s 2024-09-10T22:28:30.124 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:28:29 smithi138 ceph-mon[35236]: pgmap v409: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 754 KiB/s rd, 411 MiB/s wr, 250 op/s 2024-09-10T22:28:30.209 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:28:29 smithi019 ceph-mon[31375]: pgmap v409: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 754 KiB/s rd, 411 MiB/s wr, 250 op/s 2024-09-10T22:28:30.450 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 22997a4c-6fc2-11ef-bcea-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-09-10T22:28:30.964 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/22997a4c-6fc2-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T22:28:31.580 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:31.579+0000 7fdff2c71640 1 -- 172.21.15.19:0/2929837265 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fdfec102130 msgr2=0x7fdfec1025b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:28:31.580 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:31.579+0000 7fdff2c71640 1 --2- 172.21.15.19:0/2929837265 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fdfec102130 0x7fdfec1025b0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fdfd8009860 tx=0x7fdfd802a340 comp rx=0 tx=0).stop 2024-09-10T22:28:31.580 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:31.579+0000 7fdff2c71640 1 -- 172.21.15.19:0/2929837265 shutdown_connections 2024-09-10T22:28:31.581 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:31.579+0000 7fdff2c71640 1 --2- 172.21.15.19:0/2929837265 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdfec102af0 0x7fdfec109470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:28:31.581 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:31.579+0000 7fdff2c71640 1 --2- 172.21.15.19:0/2929837265 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fdfec102130 0x7fdfec1025b0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:28:31.581 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:31.579+0000 7fdff2c71640 1 --2- 172.21.15.19:0/2929837265 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdfec100fe0 0x7fdfec1013e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:28:31.581 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:31.579+0000 7fdff2c71640 1 -- 172.21.15.19:0/2929837265 >> 172.21.15.19:0/2929837265 conn(0x7fdfec0fc880 msgr2=0x7fdfec0fecc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:28:31.581 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:31.579+0000 7fdff2c71640 1 -- 172.21.15.19:0/2929837265 shutdown_connections 2024-09-10T22:28:31.581 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:31.579+0000 7fdff2c71640 1 -- 172.21.15.19:0/2929837265 wait complete. 2024-09-10T22:28:31.582 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:31.580+0000 7fdff2c71640 1 Processor -- start 2024-09-10T22:28:31.582 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:31.580+0000 7fdff2c71640 1 -- start start 2024-09-10T22:28:31.582 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:31.580+0000 7fdff2c71640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fdfec100fe0 0x7fdfec198b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:28:31.582 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:31.581+0000 7fdff2c71640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdfec102130 0x7fdfec1991e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:28:31.582 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:31.581+0000 7fdff2c71640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdfec102af0 0x7fdfec199da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:28:31.582 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:31.581+0000 7fdff2c71640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fdfec10e5f0 con 0x7fdfec102af0 2024-09-10T22:28:31.582 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:31.581+0000 7fdff2c71640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fdfec10e470 con 0x7fdfec102130 2024-09-10T22:28:31.582 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:31.581+0000 7fdff2c71640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7fdfec10e770 con 0x7fdfec100fe0 2024-09-10T22:28:31.582 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:31.581+0000 7fdff0a0d640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fdfec100fe0 0x7fdfec198b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:28:31.582 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:31.581+0000 7fdff0a0d640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fdfec100fe0 0x7fdfec198b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.19:39634/0 (socket says 172.21.15.19:39634) 2024-09-10T22:28:31.583 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:31.581+0000 7fdff0a0d640 1 -- 172.21.15.19:0/2192291841 learned_addr learned my addr 172.21.15.19:0/2192291841 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:28:31.583 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:31.581+0000 7fdff120e640 1 --2- 172.21.15.19:0/2192291841 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdfec102af0 0x7fdfec199da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:28:31.583 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:31.581+0000 7fdfebfff640 1 --2- 172.21.15.19:0/2192291841 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdfec102130 0x7fdfec1991e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:28:31.584 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:31.581+0000 7fdff120e640 1 -- 172.21.15.19:0/2192291841 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fdfec100fe0 msgr2=0x7fdfec198b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:28:31.584 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:31.581+0000 7fdff120e640 1 --2- 172.21.15.19:0/2192291841 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fdfec100fe0 0x7fdfec198b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:28:31.584 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:31.581+0000 7fdff120e640 1 -- 172.21.15.19:0/2192291841 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdfec102130 msgr2=0x7fdfec1991e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:28:31.584 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:31.581+0000 7fdff120e640 1 --2- 172.21.15.19:0/2192291841 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdfec102130 0x7fdfec1991e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:28:31.584 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:31.581+0000 7fdff120e640 1 -- 172.21.15.19:0/2192291841 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdfec19a660 con 0x7fdfec102af0 2024-09-10T22:28:31.584 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:31.581+0000 7fdff0a0d640 1 --2- 172.21.15.19:0/2192291841 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fdfec100fe0 0x7fdfec198b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T22:28:31.584 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:31.581+0000 7fdfebfff640 1 --2- 172.21.15.19:0/2192291841 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdfec102130 0x7fdfec1991e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T22:28:31.584 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:31.582+0000 7fdff120e640 1 --2- 172.21.15.19:0/2192291841 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdfec102af0 0x7fdfec199da0 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7fdfe400e940 tx=0x7fdfe400ee00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:28:31.584 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:31.582+0000 7fdfe9ffb640 1 -- 172.21.15.19:0/2192291841 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdfe4004d20 con 0x7fdfec102af0 2024-09-10T22:28:31.585 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:31.582+0000 7fdff2c71640 1 -- 172.21.15.19:0/2192291841 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdfec19a950 con 0x7fdfec102af0 2024-09-10T22:28:31.585 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:31.582+0000 7fdfe9ffb640 1 -- 172.21.15.19:0/2192291841 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fdfe4005020 con 0x7fdfec102af0 2024-09-10T22:28:31.585 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:31.582+0000 7fdfe9ffb640 1 -- 172.21.15.19:0/2192291841 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdfe40116d0 con 0x7fdfec102af0 2024-09-10T22:28:31.585 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:31.582+0000 7fdff2c71640 1 -- 172.21.15.19:0/2192291841 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdfec10ae20 con 0x7fdfec102af0 2024-09-10T22:28:31.586 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:31.585+0000 7fdff5a47740 1 Processor -- start 2024-09-10T22:28:31.587 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:31.586+0000 7fdfe9ffb640 1 -- 172.21.15.19:0/2192291841 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 18) ==== 153250+0+0 (secure 0 0 0) 0x7fdfe400f040 con 0x7fdfec102af0 2024-09-10T22:28:31.588 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:31.586+0000 7fdff5a47740 1 -- start start 2024-09-10T22:28:31.589 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:31.587+0000 7fdff5a47740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x559ca1b904e0 0x559ca1b95a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:28:31.589 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:31.587+0000 7fdff5a47740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559ca1b96040 0x559ca1b984d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:28:31.589 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:31.587+0000 7fdff0a0d640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559ca1b96040 0x559ca1b984d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:28:31.589 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:31.587+0000 7fdff0a0d640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559ca1b96040 0x559ca1b984d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.19:36998/0 (socket says 172.21.15.19:36998) 2024-09-10T22:28:31.589 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:31.587+0000 7fdff5a47740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x559ca1b98be0 0x559ca1b9b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:28:31.589 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:31.587+0000 7fdff5a47740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x559ca1b056f0 con 0x559ca1b904e0 2024-09-10T22:28:31.589 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:31.587+0000 7fdff5a47740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x559ca1af4b20 con 0x559ca1b96040 2024-09-10T22:28:31.590 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:31.587+0000 7fdff5a47740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x559ca1af8930 con 0x559ca1b98be0 2024-09-10T22:28:31.590 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:31.587+0000 7fdff0a0d640 1 -- 172.21.15.19:0/1522144141 learned_addr learned my addr 172.21.15.19:0/1522144141 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:28:31.590 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:31.588+0000 7fdfebfff640 1 --2- 172.21.15.19:0/1522144141 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x559ca1b904e0 0x559ca1b95a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:28:31.590 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:31.588+0000 7fdff0a0d640 1 -- 172.21.15.19:0/1522144141 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x559ca1b98be0 msgr2=0x559ca1b9b0a0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-10T22:28:31.590 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:31.588+0000 7fdfebfff640 1 --2- 172.21.15.19:0/1522144141 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x559ca1b98be0 0x559ca1b9b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:28:31.592 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:31.588+0000 7fdff0a0d640 1 --2- 172.21.15.19:0/1522144141 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x559ca1b98be0 0x559ca1b9b0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:28:31.592 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:31.588+0000 7fdff0a0d640 1 -- 172.21.15.19:0/1522144141 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x559ca1b904e0 msgr2=0x559ca1b95a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:28:31.592 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:31.588+0000 7fdff0a0d640 1 --2- 172.21.15.19:0/1522144141 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x559ca1b904e0 0x559ca1b95a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:28:31.592 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:31.588+0000 7fdff0a0d640 1 -- 172.21.15.19:0/1522144141 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559ca1aba530 con 0x559ca1b96040 2024-09-10T22:28:31.592 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:31.588+0000 7fdfebfff640 1 --2- 172.21.15.19:0/1522144141 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x559ca1b98be0 0x559ca1b9b0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T22:28:31.592 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:31.588+0000 7fdfe9ffb640 1 --2- 172.21.15.19:0/2192291841 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7fdfdc0b5360 0x7fdfdc0b7820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:28:31.592 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:31.589+0000 7fdff0a0d640 1 --2- 172.21.15.19:0/1522144141 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559ca1b96040 0x559ca1b984d0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fdfe0010550 tx=0x7fdfe0010a10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=41d03ef096688d20 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:28:31.592 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:31.589+0000 7fdfebfff640 1 --2- 172.21.15.19:0/2192291841 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7fdfdc0b5360 0x7fdfdc0b7820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:28:31.592 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:31.589+0000 7fdfe9ffb640 1 -- 172.21.15.19:0/2192291841 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8327+0+0 (secure 0 0 0) 0x7fdfe40e58d0 con 0x7fdfec102af0 2024-09-10T22:28:31.592 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:31.589+0000 7fdff2c71640 1 -- 172.21.15.19:0/1522144141 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdfe000e7d0 con 0x559ca1b96040 2024-09-10T22:28:31.593 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:31.589+0000 7fdff2c71640 1 -- 172.21.15.19:0/1522144141 <== mon.2 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fdfe000ee20 con 0x559ca1b96040 2024-09-10T22:28:31.593 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:31.590+0000 7fdff2c71640 1 -- 172.21.15.19:0/1522144141 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdfe001b430 con 0x559ca1b96040 2024-09-10T22:28:31.593 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:31.590+0000 7fdff5a47740 1 -- 172.21.15.19:0/1522144141 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559ca1b96040 msgr2=0x559ca1b984d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:28:31.593 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:31.590+0000 7fdfebfff640 1 --2- 172.21.15.19:0/2192291841 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7fdfdc0b5360 0x7fdfdc0b7820 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fdfd8009830 tx=0x7fdfd8030340 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:28:31.593 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:31.590+0000 7fdff5a47740 1 --2- 172.21.15.19:0/1522144141 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559ca1b96040 0x559ca1b984d0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fdfe0010550 tx=0x7fdfe0010a10 comp rx=0 tx=0).stop 2024-09-10T22:28:31.593 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:31.590+0000 7fdff5a47740 1 -- 172.21.15.19:0/1522144141 shutdown_connections 2024-09-10T22:28:31.593 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:31.590+0000 7fdff5a47740 1 --2- 172.21.15.19:0/1522144141 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x559ca1b98be0 0x559ca1b9b0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:28:31.593 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:31.590+0000 7fdff5a47740 1 --2- 172.21.15.19:0/1522144141 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559ca1b96040 0x559ca1b984d0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:28:31.593 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:31.590+0000 7fdff5a47740 1 --2- 172.21.15.19:0/1522144141 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x559ca1b904e0 0x559ca1b95a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:28:31.593 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:31.590+0000 7fdff5a47740 1 -- 172.21.15.19:0/1522144141 >> 172.21.15.19:0/1522144141 conn(0x559ca1b8ebb0 msgr2=0x559ca1b8f940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:28:31.593 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:31.590+0000 7fdff5a47740 1 -- 172.21.15.19:0/1522144141 shutdown_connections 2024-09-10T22:28:31.593 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:31.590+0000 7fdff5a47740 1 -- 172.21.15.19:0/1522144141 wait complete. 2024-09-10T22:28:31.598 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:31.591+0000 7fdff5a47740 1 -- start start 2024-09-10T22:28:31.598 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:31.591+0000 7fdff5a47740 1 Processor -- start 2024-09-10T22:28:31.598 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:31.592+0000 7fdff5a47740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x559ca1b904e0 0x559ca1b9ce30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:28:31.598 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:31.592+0000 7fdff5a47740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559ca1b96040 0x559ca1b9d4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:28:31.598 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:31.592+0000 7fdff5a47740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x559ca1b98be0 0x559ca1b9e0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:28:31.598 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:31.592+0000 7fdff5a47740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x559ca1a2cab0 con 0x559ca1b904e0 2024-09-10T22:28:31.598 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:31.592+0000 7fdff5a47740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x559ca1a9a730 con 0x559ca1b96040 2024-09-10T22:28:31.598 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:31.592+0000 7fdff5a47740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x559ca1b9bc10 con 0x559ca1b98be0 2024-09-10T22:28:31.598 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:31.592+0000 7fdff5a47740 10 client.0 _ll_register_callbacks cb 0x559ca1aee6b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T22:28:31.598 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:31.592+0000 7fdff0a0d640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x559ca1b904e0 0x559ca1b9ce30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:28:31.599 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:31.592+0000 7fdfebfff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559ca1b96040 0x559ca1b9d4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:28:31.599 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:31.592+0000 7fdff120e640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x559ca1b98be0 0x559ca1b9e0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:28:31.599 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:31.592+0000 7fdff0a0d640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x559ca1b904e0 0x559ca1b9ce30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:49670/0 (socket says 172.21.15.19:49670) 2024-09-10T22:28:31.599 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:31.592+0000 7fdff0a0d640 1 -- 172.21.15.19:0/3288943935 learned_addr learned my addr 172.21.15.19:0/3288943935 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:28:31.599 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:31.592+0000 7fdff120e640 1 -- 172.21.15.19:0/3288943935 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559ca1b96040 msgr2=0x559ca1b9d4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:28:31.599 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:31.592+0000 7fdff120e640 1 --2- 172.21.15.19:0/3288943935 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559ca1b96040 0x559ca1b9d4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:28:31.599 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:31.593+0000 7fdff120e640 1 -- 172.21.15.19:0/3288943935 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x559ca1b904e0 msgr2=0x559ca1b9ce30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:28:31.599 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:31.593+0000 7fdff120e640 1 --2- 172.21.15.19:0/3288943935 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x559ca1b904e0 0x559ca1b9ce30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:28:31.599 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:31.593+0000 7fdff120e640 1 -- 172.21.15.19:0/3288943935 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559ca1856790 con 0x559ca1b98be0 2024-09-10T22:28:31.599 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:31.593+0000 7fdff0a0d640 1 --2- 172.21.15.19:0/3288943935 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x559ca1b904e0 0x559ca1b9ce30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T22:28:31.599 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:31.593+0000 7fdfebfff640 1 --2- 172.21.15.19:0/3288943935 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559ca1b96040 0x559ca1b9d4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T22:28:31.599 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:31.593+0000 7fdff120e640 1 --2- 172.21.15.19:0/3288943935 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x559ca1b98be0 0x559ca1b9e0a0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fdfe400c640 tx=0x7fdfe40ab850 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c60f37c189f17e15 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:28:31.599 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:31.593+0000 7fdfcbfff640 10 client.0 ms_handle_connect on v2:172.21.15.138:3300/0 2024-09-10T22:28:31.600 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:31.593+0000 7fdfcbfff640 1 -- 172.21.15.19:0/3288943935 <== mon.1 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdfe401f040 con 0x559ca1b98be0 2024-09-10T22:28:31.600 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:31.593+0000 7fdfcbfff640 1 -- 172.21.15.19:0/3288943935 <== mon.1 v2:172.21.15.138:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8327+0+0 (secure 0 0 0) 0x7fdfe400cb20 con 0x559ca1b98be0 2024-09-10T22:28:31.600 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:31.593+0000 7fdff5a47740 1 -- 172.21.15.19:0/3288943935 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fdfe000ee20 con 0x559ca1b98be0 2024-09-10T22:28:31.600 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:31.593+0000 7fdfcbfff640 1 -- 172.21.15.19:0/3288943935 <== mon.1 v2:172.21.15.138:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7fdfe40b0b10 con 0x559ca1b98be0 2024-09-10T22:28:31.600 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:31.594+0000 7fdff5a47740 10 client.25312 fetch_fsmap learned FSMap version 26 2024-09-10T22:28:31.600 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:31.594+0000 7fdff5a47740 1 -- 172.21.15.19:0/3288943935 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x559ca18cf620 con 0x559ca1b98be0 2024-09-10T22:28:31.600 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:31.594+0000 7fdfcbfff640 1 -- 172.21.15.19:0/3288943935 <== mon.1 v2:172.21.15.138:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fdfe40b55c0 con 0x559ca1b98be0 2024-09-10T22:28:31.600 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:31.594+0000 7fdfcbfff640 1 -- 172.21.15.19:0/3288943935 <== mon.1 v2:172.21.15.138:3300/0 5 ==== fsmap(e 26) ==== 8350+0+0 (secure 0 0 0) 0x7fdfe40ab460 con 0x559ca1b98be0 2024-09-10T22:28:31.600 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:31.594+0000 7fdff5a47740 10 client.25312 fetch_fsmap finished waiting for FSMap version 26 2024-09-10T22:28:31.600 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:31.594+0000 7fdff5a47740 10 client.25312 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-10T22:28:31.600 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:31.594+0000 7fdff5a47740 20 client.25312 populate_metadata read hostname 'smithi019' 2024-09-10T22:28:31.600 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:31.594+0000 7fdff5a47740 1 --2- 172.21.15.19:0/3288943935 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x559ca1bb0ef0 0x559ca1bb3310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:28:31.601 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:31.594+0000 7fdff5a47740 4 client.25312 mds_command: new command op to 24581 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T22:28:31.601 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:31.595+0000 7fdff0a0d640 1 --2- 172.21.15.19:0/3288943935 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x559ca1bb0ef0 0x559ca1bb3310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:28:31.601 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:31.595+0000 7fdfcbfff640 10 client.25312 ms_handle_connect on v2:172.21.15.135:6838/1254769802 2024-09-10T22:28:31.601 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:31.594+0000 7fdff5a47740 1 -- 172.21.15.19:0/3288943935 --> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7fdfe000ee20 con 0x559ca1bb0ef0 2024-09-10T22:28:31.601 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:31.595+0000 7fdff0a0d640 1 --2- 172.21.15.19:0/3288943935 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x559ca1bb0ef0 0x559ca1bb3310 crc :-1 s=READY pgs=64 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8e63c275355a726b server_cookie=87dbcd08bf76f4db in_seq=0 out_seq=0 2024-09-10T22:28:31.601 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:31.596+0000 7fdfcbfff640 1 -- 172.21.15.19:0/3288943935 <== mds.0 v2:172.21.15.135:6838/1254769802 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x7fdfe000ee20 con 0x559ca1bb0ef0 2024-09-10T22:28:31.601 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:31.596+0000 7fdfcbfff640 10 client.25312 handle_command_reply: tid=0 2024-09-10T22:28:31.601 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:31.596+0000 7fdff5a47740 1 client.25312 shutdown 2024-09-10T22:28:31.601 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:31.596+0000 7fdff5a47740 1 -- 172.21.15.19:0/3288943935 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x559ca1b98be0 msgr2=0x559ca1b9e0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:28:31.601 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:31.596+0000 7fdff5a47740 1 --2- 172.21.15.19:0/3288943935 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x559ca1b98be0 0x559ca1b9e0a0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fdfe400c640 tx=0x7fdfe40ab850 comp rx=0 tx=0).stop 2024-09-10T22:28:31.601 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:31.596+0000 7fdff5a47740 1 -- 172.21.15.19:0/3288943935 shutdown_connections 2024-09-10T22:28:31.601 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:31.596+0000 7fdff5a47740 1 --2- 172.21.15.19:0/3288943935 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x559ca1bb0ef0 0x559ca1bb3310 crc :-1 s=READY pgs=64 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:28:31.602 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:31.596+0000 7fdff5a47740 1 --2- 172.21.15.19:0/3288943935 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x559ca1b98be0 0x559ca1b9e0a0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:28:31.602 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:31.596+0000 7fdfcbfff640 0 client.25312 ms_handle_reset on v2:172.21.15.135:6838/1254769802 2024-09-10T22:28:31.602 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:31.596+0000 7fdff5a47740 1 --2- 172.21.15.19:0/3288943935 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559ca1b96040 0x559ca1b9d4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:28:31.602 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:31.596+0000 7fdff5a47740 1 --2- 172.21.15.19:0/3288943935 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x559ca1b904e0 0x559ca1b9ce30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:28:31.602 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:31.596+0000 7fdff5a47740 1 -- 172.21.15.19:0/3288943935 >> 172.21.15.19:0/3288943935 conn(0x559ca1b8ebb0 msgr2=0x559ca1b8dd90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:28:31.602 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:31.596+0000 7fdff5a47740 1 -- 172.21.15.19:0/3288943935 shutdown_connections 2024-09-10T22:28:31.602 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:31.596+0000 7fdff5a47740 1 -- 172.21.15.19:0/3288943935 wait complete. 2024-09-10T22:28:31.602 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:31.596+0000 7fdff5a47740 20 client.25312 trim_cache size 0 max 16384 2024-09-10T22:28:31.616 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:31.613+0000 7fdff5a47740 1 Processor -- start 2024-09-10T22:28:31.616 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:31.613+0000 7fdff5a47740 1 -- start start 2024-09-10T22:28:31.616 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:31.613+0000 7fdff5a47740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x559ca1b904e0 0x559ca1b91c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:28:31.616 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:31.614+0000 7fdff5a47740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x559ca1b96040 0x559ca1b92140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:28:31.617 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:31.614+0000 7fdff5a47740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559ca1b98be0 0x559ca1b95300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:28:31.617 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:31.614+0000 7fdff5a47740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fdfec1aa650 con 0x559ca1b904e0 2024-09-10T22:28:31.617 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:31.614+0000 7fdff5a47740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fdfec1a7f20 con 0x559ca1b98be0 2024-09-10T22:28:31.617 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:31.614+0000 7fdff5a47740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7fdfec1a5d70 con 0x559ca1b96040 2024-09-10T22:28:31.617 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:31.614+0000 7fdff0a0d640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x559ca1b904e0 0x559ca1b91c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:28:31.617 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:31.614+0000 7fdff0a0d640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x559ca1b904e0 0x559ca1b91c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:49698/0 (socket says 172.21.15.19:49698) 2024-09-10T22:28:31.617 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:31.614+0000 7fdff0a0d640 1 -- 172.21.15.19:0/854350962 learned_addr learned my addr 172.21.15.19:0/854350962 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:28:31.617 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:31.614+0000 7fdfebfff640 1 --2- 172.21.15.19:0/854350962 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x559ca1b96040 0x559ca1b92140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:28:31.617 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:31.614+0000 7fdff120e640 1 --2- 172.21.15.19:0/854350962 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559ca1b98be0 0x559ca1b95300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:28:31.617 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:31.614+0000 7fdff0a0d640 1 -- 172.21.15.19:0/854350962 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x559ca1b96040 msgr2=0x559ca1b92140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:28:31.617 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:31.614+0000 7fdff0a0d640 1 --2- 172.21.15.19:0/854350962 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x559ca1b96040 0x559ca1b92140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:28:31.618 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:31.614+0000 7fdff0a0d640 1 -- 172.21.15.19:0/854350962 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559ca1b98be0 msgr2=0x559ca1b95300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:28:31.618 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:31.614+0000 7fdff0a0d640 1 --2- 172.21.15.19:0/854350962 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559ca1b98be0 0x559ca1b95300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:28:31.618 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:31.614+0000 7fdff0a0d640 1 -- 172.21.15.19:0/854350962 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559ca1bb3680 con 0x559ca1b904e0 2024-09-10T22:28:31.618 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:31.614+0000 7fdfebfff640 1 --2- 172.21.15.19:0/854350962 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x559ca1b96040 0x559ca1b92140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T22:28:31.618 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:31.614+0000 7fdff120e640 1 --2- 172.21.15.19:0/854350962 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559ca1b98be0 0x559ca1b95300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T22:28:31.618 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:31.614+0000 7fdff0a0d640 1 --2- 172.21.15.19:0/854350962 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x559ca1b904e0 0x559ca1b91c00 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7fdfe0010550 tx=0x7fdfe000b700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8d8afdb78a049a46 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:28:31.618 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:31.614+0000 7fdfd67fc640 1 -- 172.21.15.19:0/854350962 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdfe0011640 con 0x559ca1b904e0 2024-09-10T22:28:31.618 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:31.614+0000 7fdfd67fc640 1 -- 172.21.15.19:0/854350962 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fdfe0011bf0 con 0x559ca1b904e0 2024-09-10T22:28:31.618 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:31.614+0000 7fdfd67fc640 1 -- 172.21.15.19:0/854350962 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdfe0003b50 con 0x559ca1b904e0 2024-09-10T22:28:31.622 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:31.615+0000 7fdff5a47740 1 -- 172.21.15.19:0/854350962 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x559ca1b904e0 msgr2=0x559ca1b91c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:28:31.622 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:31.615+0000 7fdff5a47740 1 --2- 172.21.15.19:0/854350962 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x559ca1b904e0 0x559ca1b91c00 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7fdfe0010550 tx=0x7fdfe000b700 comp rx=0 tx=0).stop 2024-09-10T22:28:31.622 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:31.615+0000 7fdff5a47740 1 -- 172.21.15.19:0/854350962 shutdown_connections 2024-09-10T22:28:31.622 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:31.615+0000 7fdff5a47740 1 --2- 172.21.15.19:0/854350962 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559ca1b98be0 0x559ca1b95300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:28:31.622 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:31.615+0000 7fdff5a47740 1 --2- 172.21.15.19:0/854350962 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x559ca1b96040 0x559ca1b92140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:28:31.622 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:31.615+0000 7fdff5a47740 1 --2- 172.21.15.19:0/854350962 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x559ca1b904e0 0x559ca1b91c00 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:28:31.622 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:31.615+0000 7fdff5a47740 1 -- 172.21.15.19:0/854350962 >> 172.21.15.19:0/854350962 conn(0x559ca1b8ebb0 msgr2=0x559ca1b89e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:28:31.622 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:31.615+0000 7fdff5a47740 1 -- 172.21.15.19:0/854350962 shutdown_connections 2024-09-10T22:28:31.622 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:31.615+0000 7fdff5a47740 1 -- 172.21.15.19:0/854350962 wait complete. 2024-09-10T22:28:31.622 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:31.616+0000 7fdff5a47740 1 -- start start 2024-09-10T22:28:31.623 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:31.616+0000 7fdff5a47740 1 Processor -- start 2024-09-10T22:28:31.623 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:31.616+0000 7fdff5a47740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x559ca1b904e0 0x559ca1ba4420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:28:31.623 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:31.616+0000 7fdff5a47740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x559ca1b96040 0x559ca1ba4ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:28:31.623 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:31.616+0000 7fdff5a47740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559ca1b98be0 0x559ca1ba32b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:28:31.623 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:31.616+0000 7fdff0a0d640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x559ca1b904e0 0x559ca1ba4420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:28:31.623 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:31.616+0000 7fdff5a47740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fdfec1a63e0 con 0x559ca1b904e0 2024-09-10T22:28:31.623 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:31.617+0000 7fdff5a47740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fdfec1a7850 con 0x559ca1b98be0 2024-09-10T22:28:31.623 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:31.617+0000 7fdff5a47740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7fdfec1a6ab0 con 0x559ca1b96040 2024-09-10T22:28:31.623 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:31.617+0000 7fdff0a0d640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x559ca1b904e0 0x559ca1ba4420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:49712/0 (socket says 172.21.15.19:49712) 2024-09-10T22:28:31.623 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:31.617+0000 7fdff0a0d640 1 -- 172.21.15.19:0/1025416549 learned_addr learned my addr 172.21.15.19:0/1025416549 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:28:31.623 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:31.617+0000 7fdff5a47740 10 client.0 _ll_register_callbacks cb 0x7fdfe40abeb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T22:28:31.623 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:31.617+0000 7fdfebfff640 1 --2- 172.21.15.19:0/1025416549 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x559ca1b96040 0x559ca1ba4ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:28:31.623 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:31.617+0000 7fdff120e640 1 --2- 172.21.15.19:0/1025416549 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559ca1b98be0 0x559ca1ba32b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:28:31.624 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:31.617+0000 7fdfebfff640 1 -- 172.21.15.19:0/1025416549 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559ca1b98be0 msgr2=0x559ca1ba32b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:28:31.624 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:31.617+0000 7fdfebfff640 1 --2- 172.21.15.19:0/1025416549 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559ca1b98be0 0x559ca1ba32b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:28:31.624 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:31.617+0000 7fdfebfff640 1 -- 172.21.15.19:0/1025416549 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x559ca1b904e0 msgr2=0x559ca1ba4420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:28:31.624 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:31.617+0000 7fdfebfff640 1 --2- 172.21.15.19:0/1025416549 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x559ca1b904e0 0x559ca1ba4420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:28:31.624 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:31.617+0000 7fdfebfff640 1 -- 172.21.15.19:0/1025416549 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559ca1ba3ab0 con 0x559ca1b96040 2024-09-10T22:28:31.624 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:31.617+0000 7fdff0a0d640 1 --2- 172.21.15.19:0/1025416549 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x559ca1b904e0 0x559ca1ba4420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T22:28:31.624 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:31.617+0000 7fdfebfff640 1 --2- 172.21.15.19:0/1025416549 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x559ca1b96040 0x559ca1ba4ac0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fdfd802a860 tx=0x7fdfd802a340 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e992df462cb91df5 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:28:31.624 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:31.617+0000 7fdfcbfff640 10 client.0 ms_handle_connect on v2:172.21.15.138:3300/0 2024-09-10T22:28:31.624 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:31.617+0000 7fdfcbfff640 1 -- 172.21.15.19:0/1025416549 <== mon.1 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdfd8052060 con 0x559ca1b96040 2024-09-10T22:28:31.624 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:31.617+0000 7fdfcbfff640 1 -- 172.21.15.19:0/1025416549 <== mon.1 v2:172.21.15.138:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8327+0+0 (secure 0 0 0) 0x7fdfd8033a00 con 0x559ca1b96040 2024-09-10T22:28:31.624 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:31.617+0000 7fdff5a47740 1 -- 172.21.15.19:0/1025416549 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fdfe0011bf0 con 0x559ca1b96040 2024-09-10T22:28:31.624 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:31.618+0000 7fdfcbfff640 1 -- 172.21.15.19:0/1025416549 <== mon.1 v2:172.21.15.138:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7fdfd8037040 con 0x559ca1b96040 2024-09-10T22:28:31.625 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:31.618+0000 7fdff5a47740 10 client.25321 fetch_fsmap learned FSMap version 26 2024-09-10T22:28:31.625 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:31.618+0000 7fdff5a47740 1 -- 172.21.15.19:0/1025416549 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x559ca1ba2940 con 0x559ca1b96040 2024-09-10T22:28:31.625 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:31.618+0000 7fdfcbfff640 1 -- 172.21.15.19:0/1025416549 <== mon.1 v2:172.21.15.138:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fdfe0011bf0 con 0x559ca1b96040 2024-09-10T22:28:31.625 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:31.618+0000 7fdfcbfff640 1 -- 172.21.15.19:0/1025416549 <== mon.1 v2:172.21.15.138:3300/0 5 ==== fsmap(e 26) ==== 8350+0+0 (secure 0 0 0) 0x7fdfd8056030 con 0x559ca1b96040 2024-09-10T22:28:31.625 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:31.618+0000 7fdff5a47740 10 client.25321 fetch_fsmap finished waiting for FSMap version 26 2024-09-10T22:28:31.625 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:31.618+0000 7fdff5a47740 10 client.25321 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-10T22:28:31.625 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:31.618+0000 7fdff5a47740 20 client.25321 populate_metadata read hostname 'smithi019' 2024-09-10T22:28:31.625 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:31.618+0000 7fdff5a47740 1 --2- 172.21.15.19:0/1025416549 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x559ca1bb0ef0 0x559ca1c20540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:28:31.625 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:31.618+0000 7fdff5a47740 4 client.25321 mds_command: new command op to 24581 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-10T22:28:31.625 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:31.618+0000 7fdff5a47740 1 -- 172.21.15.19:0/1025416549 --> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] -- command(tid 0: {"prefix": "flush journal"}) -- 0x559ca1b07640 con 0x559ca1bb0ef0 2024-09-10T22:28:31.625 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:31.618+0000 7fdff0a0d640 1 --2- 172.21.15.19:0/1025416549 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x559ca1bb0ef0 0x559ca1c20540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:28:31.625 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:31.619+0000 7fdfcbfff640 10 client.25321 ms_handle_connect on v2:172.21.15.135:6838/1254769802 2024-09-10T22:28:31.625 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:31.619+0000 7fdff0a0d640 1 --2- 172.21.15.19:0/1025416549 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x559ca1bb0ef0 0x559ca1c20540 crc :-1 s=READY pgs=65 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=360774096e8921f7 server_cookie=d150aca3c9ad3a9a in_seq=0 out_seq=0 2024-09-10T22:28:31.684 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:31.578+0000 7fb8fb2b6640 1 -- 172.21.15.19:0/1074210307 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb8f4103ca0 msgr2=0x7fb8f4104080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:28:31.684 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:31.578+0000 7fb8fb2b6640 1 --2- 172.21.15.19:0/1074210307 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb8f4103ca0 0x7fb8f4104080 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fb8f0009860 tx=0x7fb8f002a340 comp rx=0 tx=0).stop 2024-09-10T22:28:31.684 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:31.578+0000 7fb8fb2b6640 1 -- 172.21.15.19:0/1074210307 shutdown_connections 2024-09-10T22:28:31.684 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:31.578+0000 7fb8fb2b6640 1 --2- 172.21.15.19:0/1074210307 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb8f410d100 0x7fb8f410f560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:28:31.685 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:31.578+0000 7fb8fb2b6640 1 --2- 172.21.15.19:0/1074210307 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb8f41045c0 0x7fb8f410cab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:28:31.685 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:31.578+0000 7fb8fb2b6640 1 --2- 172.21.15.19:0/1074210307 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb8f4103ca0 0x7fb8f4104080 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:28:31.685 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:31.578+0000 7fb8fb2b6640 1 -- 172.21.15.19:0/1074210307 >> 172.21.15.19:0/1074210307 conn(0x7fb8f40fd700 msgr2=0x7fb8f40ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:28:31.685 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:31.578+0000 7fb8fb2b6640 1 -- 172.21.15.19:0/1074210307 shutdown_connections 2024-09-10T22:28:31.685 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:31.578+0000 7fb8fb2b6640 1 -- 172.21.15.19:0/1074210307 wait complete. 2024-09-10T22:28:31.685 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:31.579+0000 7fb8fb2b6640 1 Processor -- start 2024-09-10T22:28:31.685 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:31.579+0000 7fb8fb2b6640 1 -- start start 2024-09-10T22:28:31.685 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:31.579+0000 7fb8fb2b6640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb8f4103ca0 0x7fb8f4101950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:28:31.685 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:31.579+0000 7fb8fb2b6640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb8f41045c0 0x7fb8f4101e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:28:31.685 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:31.579+0000 7fb8fb2b6640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb8f410d100 0x7fb8f41023d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:28:31.685 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:31.579+0000 7fb8fb2b6640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fb8f4112d70 con 0x7fb8f410d100 2024-09-10T22:28:31.685 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:31.580+0000 7fb8fb2b6640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fb8f4112bf0 con 0x7fb8f4103ca0 2024-09-10T22:28:31.685 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:31.580+0000 7fb8fb2b6640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7fb8f4112ef0 con 0x7fb8f41045c0 2024-09-10T22:28:31.686 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:31.580+0000 7fb8f9052640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb8f4103ca0 0x7fb8f4101950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:28:31.686 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:31.580+0000 7fb8f9853640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb8f410d100 0x7fb8f41023d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:28:31.686 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:31.580+0000 7fb8f9853640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb8f410d100 0x7fb8f41023d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:49632/0 (socket says 172.21.15.19:49632) 2024-09-10T22:28:31.686 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:31.580+0000 7fb8f9853640 1 -- 172.21.15.19:0/3467649035 learned_addr learned my addr 172.21.15.19:0/3467649035 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:28:31.686 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:31.580+0000 7fb8f8851640 1 --2- 172.21.15.19:0/3467649035 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb8f41045c0 0x7fb8f4101e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:28:31.686 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:31.580+0000 7fb8f8851640 1 -- 172.21.15.19:0/3467649035 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb8f4103ca0 msgr2=0x7fb8f4101950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:28:31.686 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:31.580+0000 7fb8f8851640 1 --2- 172.21.15.19:0/3467649035 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb8f4103ca0 0x7fb8f4101950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:28:31.686 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:31.580+0000 7fb8f8851640 1 -- 172.21.15.19:0/3467649035 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb8f410d100 msgr2=0x7fb8f41023d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:28:31.686 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:31.580+0000 7fb8f8851640 1 --2- 172.21.15.19:0/3467649035 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb8f410d100 0x7fb8f41023d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:28:31.686 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:31.580+0000 7fb8f8851640 1 -- 172.21.15.19:0/3467649035 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb8f41a75e0 con 0x7fb8f41045c0 2024-09-10T22:28:31.686 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:31.580+0000 7fb8f9853640 1 --2- 172.21.15.19:0/3467649035 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb8f410d100 0x7fb8f41023d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T22:28:31.686 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:31.581+0000 7fb8f8851640 1 --2- 172.21.15.19:0/3467649035 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb8f41045c0 0x7fb8f4101e90 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fb8e400c940 tx=0x7fb8e400ce00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:28:31.687 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:31.581+0000 7fb8ea7fc640 1 -- 172.21.15.19:0/3467649035 <== mon.1 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8e4007bb0 con 0x7fb8f41045c0 2024-09-10T22:28:31.687 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:31.581+0000 7fb8fb2b6640 1 -- 172.21.15.19:0/3467649035 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb8f41a78d0 con 0x7fb8f41045c0 2024-09-10T22:28:31.687 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:31.581+0000 7fb8ea7fc640 1 -- 172.21.15.19:0/3467649035 <== mon.1 v2:172.21.15.138:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb8e4007d50 con 0x7fb8f41045c0 2024-09-10T22:28:31.687 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:31.581+0000 7fb8ea7fc640 1 -- 172.21.15.19:0/3467649035 <== mon.1 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8e4018660 con 0x7fb8f41045c0 2024-09-10T22:28:31.687 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:31.581+0000 7fb8fb2b6640 1 -- 172.21.15.19:0/3467649035 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb8f41a7e60 con 0x7fb8f41045c0 2024-09-10T22:28:31.687 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:31.585+0000 7fb8fd68b740 1 Processor -- start 2024-09-10T22:28:31.687 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:31.585+0000 7fb8fd68b740 1 -- start start 2024-09-10T22:28:31.687 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:31.586+0000 7fb8fd68b740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560aadc10900 0x560aadc10ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:28:31.687 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:31.586+0000 7fb8fd68b740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x560aadc11220 0x560aadc1cc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:28:31.687 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:31.586+0000 7fb8fd68b740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x560aadc1d1b0 0x560aadc1f5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:28:31.687 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:31.586+0000 7fb8fd68b740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x560aadb7eea0 con 0x560aadc1d1b0 2024-09-10T22:28:31.687 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:31.586+0000 7fb8fd68b740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x560aadb6e2d0 con 0x560aadc10900 2024-09-10T22:28:31.687 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:31.586+0000 7fb8fd68b740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x560aadb720e0 con 0x560aadc11220 2024-09-10T22:28:31.688 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:31.586+0000 7fb8f9052640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x560aadc11220 0x560aadc1cc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:28:31.688 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:31.586+0000 7fb8f9052640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x560aadc11220 0x560aadc1cc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.19:39644/0 (socket says 172.21.15.19:39644) 2024-09-10T22:28:31.688 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:31.586+0000 7fb8f9052640 1 -- 172.21.15.19:0/2830815071 learned_addr learned my addr 172.21.15.19:0/2830815071 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:28:31.688 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:31.586+0000 7fb8ea7fc640 1 -- 172.21.15.19:0/3467649035 <== mon.1 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 18) ==== 153250+0+0 (secure 0 0 0) 0x7fb8e4020030 con 0x7fb8f41045c0 2024-09-10T22:28:31.688 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:31.586+0000 7fb8f9853640 1 --2- 172.21.15.19:0/2830815071 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560aadc10900 0x560aadc10ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:28:31.688 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:31.587+0000 7fb8f9052640 1 -- 172.21.15.19:0/2830815071 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560aadc10900 msgr2=0x560aadc10ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:28:31.688 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:31.587+0000 7fb8f9052640 1 --2- 172.21.15.19:0/2830815071 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560aadc10900 0x560aadc10ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:28:31.688 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:31.587+0000 7fb8f9052640 1 -- 172.21.15.19:0/2830815071 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x560aadc1d1b0 msgr2=0x560aadc1f5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:28:31.688 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:31.587+0000 7fb8f8851640 1 --2- 172.21.15.19:0/2830815071 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x560aadc1d1b0 0x560aadc1f5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:28:31.688 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:31.587+0000 7fb8f9052640 1 --2- 172.21.15.19:0/2830815071 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x560aadc1d1b0 0x560aadc1f5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:28:31.688 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:31.587+0000 7fb8f9052640 1 -- 172.21.15.19:0/2830815071 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560aad8cc650 con 0x560aadc11220 2024-09-10T22:28:31.688 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:31.587+0000 7fb8f9853640 1 --2- 172.21.15.19:0/2830815071 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560aadc10900 0x560aadc10ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T22:28:31.689 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:31.587+0000 7fb8f8851640 1 --2- 172.21.15.19:0/2830815071 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x560aadc1d1b0 0x560aadc1f5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T22:28:31.689 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:31.587+0000 7fb8f9052640 1 --2- 172.21.15.19:0/2830815071 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x560aadc11220 0x560aadc1cc70 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fb8f0009860 tx=0x7fb8f0009510 comp rx=0 tx=0).ready entity=mon.1 client_cookie=865bc8afce3c2697 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:28:31.689 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:31.588+0000 7fb8df7fe640 1 -- 172.21.15.19:0/2830815071 <== mon.1 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8f0037040 con 0x560aadc11220 2024-09-10T22:28:31.689 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:31.588+0000 7fb8df7fe640 1 -- 172.21.15.19:0/2830815071 <== mon.1 v2:172.21.15.138:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb8f0030450 con 0x560aadc11220 2024-09-10T22:28:31.689 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:31.588+0000 7fb8df7fe640 1 -- 172.21.15.19:0/2830815071 <== mon.1 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8f0003a10 con 0x560aadc11220 2024-09-10T22:28:31.689 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:31.588+0000 7fb8ea7fc640 1 --2- 172.21.15.19:0/3467649035 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7fb8e00b5360 0x7fb8e00b7820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:28:31.689 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:31.589+0000 7fb8f9853640 1 --2- 172.21.15.19:0/3467649035 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7fb8e00b5360 0x7fb8e00b7820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:28:31.689 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:31.589+0000 7fb8ea7fc640 1 -- 172.21.15.19:0/3467649035 <== mon.1 v2:172.21.15.138:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8327+0+0 (secure 0 0 0) 0x7fb8e40e55e0 con 0x7fb8f41045c0 2024-09-10T22:28:31.689 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:31.591+0000 7fb8fd68b740 1 -- 172.21.15.19:0/2830815071 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x560aadc11220 msgr2=0x560aadc1cc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:28:31.689 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:31.591+0000 7fb8f9853640 1 --2- 172.21.15.19:0/3467649035 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7fb8e00b5360 0x7fb8e00b7820 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fb8ec009fd0 tx=0x7fb8ec0095c0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:28:31.689 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:31.591+0000 7fb8fd68b740 1 --2- 172.21.15.19:0/2830815071 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x560aadc11220 0x560aadc1cc70 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fb8f0009860 tx=0x7fb8f0009510 comp rx=0 tx=0).stop 2024-09-10T22:28:31.689 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:31.591+0000 7fb8fd68b740 1 -- 172.21.15.19:0/2830815071 shutdown_connections 2024-09-10T22:28:31.689 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:31.591+0000 7fb8fd68b740 1 --2- 172.21.15.19:0/2830815071 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x560aadc1d1b0 0x560aadc1f5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:28:31.690 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:31.591+0000 7fb8fd68b740 1 --2- 172.21.15.19:0/2830815071 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x560aadc11220 0x560aadc1cc70 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:28:31.690 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:31.591+0000 7fb8fd68b740 1 --2- 172.21.15.19:0/2830815071 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560aadc10900 0x560aadc10ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:28:31.690 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:31.591+0000 7fb8fd68b740 1 -- 172.21.15.19:0/2830815071 >> 172.21.15.19:0/2830815071 conn(0x560aadc0e730 msgr2=0x560aadc0f8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:28:31.690 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:31.591+0000 7fb8fd68b740 1 -- 172.21.15.19:0/2830815071 shutdown_connections 2024-09-10T22:28:31.690 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:31.591+0000 7fb8fd68b740 1 -- 172.21.15.19:0/2830815071 wait complete. 2024-09-10T22:28:31.690 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:31.591+0000 7fb8fd68b740 1 -- start start 2024-09-10T22:28:31.690 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:31.592+0000 7fb8fd68b740 1 Processor -- start 2024-09-10T22:28:31.690 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:31.592+0000 7fb8fd68b740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x560aadc10900 0x560aadc1ca80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:28:31.690 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:31.592+0000 7fb8fd68b740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x560aadc11220 0x560aadc19ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:28:31.690 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:31.592+0000 7fb8fd68b740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560aadc1d1b0 0x560aadc1a4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:28:31.690 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:31.592+0000 7fb8fd68b740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x560aad9cf700 con 0x560aadc10900 2024-09-10T22:28:31.690 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:31.592+0000 7fb8fd68b740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x560aadb09160 con 0x560aadc1d1b0 2024-09-10T22:28:31.690 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:31.592+0000 7fb8fd68b740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x560aadc1fdd0 con 0x560aadc11220 2024-09-10T22:28:31.691 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:31.592+0000 7fb8fd68b740 10 client.0 _ll_register_callbacks cb 0x560aadb229e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T22:28:31.691 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:31.593+0000 7fb8f9052640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x560aadc10900 0x560aadc1ca80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:28:31.691 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:31.593+0000 7fb8f9853640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560aadc1d1b0 0x560aadc1a4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:28:31.691 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:31.593+0000 7fb8f8851640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x560aadc11220 0x560aadc19ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:28:31.691 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:31.593+0000 7fb8f9853640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560aadc1d1b0 0x560aadc1a4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.19:37010/0 (socket says 172.21.15.19:37010) 2024-09-10T22:28:31.691 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:31.593+0000 7fb8f8851640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x560aadc11220 0x560aadc19ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.19:39676/0 (socket says 172.21.15.19:39676) 2024-09-10T22:28:31.691 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:31.593+0000 7fb8f9853640 1 -- 172.21.15.19:0/2617860642 learned_addr learned my addr 172.21.15.19:0/2617860642 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:28:31.691 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:31.593+0000 7fb8f9853640 1 -- 172.21.15.19:0/2617860642 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x560aadc11220 msgr2=0x560aadc19ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:28:31.691 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:31.593+0000 7fb8f9853640 1 --2- 172.21.15.19:0/2617860642 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x560aadc11220 0x560aadc19ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:28:31.691 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:31.593+0000 7fb8f9853640 1 -- 172.21.15.19:0/2617860642 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x560aadc10900 msgr2=0x560aadc1ca80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:28:31.691 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:31.593+0000 7fb8f9853640 1 --2- 172.21.15.19:0/2617860642 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x560aadc10900 0x560aadc1ca80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:28:31.691 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:31.593+0000 7fb8f9853640 1 -- 172.21.15.19:0/2617860642 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560aadb36c90 con 0x560aadc1d1b0 2024-09-10T22:28:31.692 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:31.593+0000 7fb8f9853640 1 --2- 172.21.15.19:0/2617860642 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560aadc1d1b0 0x560aadc1a4b0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fb8ec00bfd0 tx=0x7fb8ec004a40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c9877db59681962c server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:28:31.692 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:31.593+0000 7fb8dcff9640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-09-10T22:28:31.692 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:31.593+0000 7fb8dcff9640 1 -- 172.21.15.19:0/2617860642 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8ec02a060 con 0x560aadc1d1b0 2024-09-10T22:28:31.692 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:31.594+0000 7fb8dcff9640 1 -- 172.21.15.19:0/2617860642 <== mon.2 v2:172.21.15.135:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8327+0+0 (secure 0 0 0) 0x7fb8ec0185b0 con 0x560aadc1d1b0 2024-09-10T22:28:31.692 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:31.594+0000 7fb8fd68b740 1 -- 172.21.15.19:0/2617860642 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb8f0030450 con 0x560aadc1d1b0 2024-09-10T22:28:31.692 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:31.594+0000 7fb8dcff9640 1 -- 172.21.15.19:0/2617860642 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7fb8ec0187b0 con 0x560aadc1d1b0 2024-09-10T22:28:31.692 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:31.594+0000 7fb8fd68b740 10 client.25325 fetch_fsmap learned FSMap version 26 2024-09-10T22:28:31.692 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:31.594+0000 7fb8fd68b740 1 -- 172.21.15.19:0/2617860642 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x560aadc2b740 con 0x560aadc1d1b0 2024-09-10T22:28:31.692 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:31.594+0000 7fb8dcff9640 1 -- 172.21.15.19:0/2617860642 <== mon.2 v2:172.21.15.135:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb8f0030450 con 0x560aadc1d1b0 2024-09-10T22:28:31.692 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:31.594+0000 7fb8dcff9640 1 -- 172.21.15.19:0/2617860642 <== mon.2 v2:172.21.15.135:3300/0 5 ==== fsmap(e 26) ==== 8350+0+0 (secure 0 0 0) 0x7fb8ec02e030 con 0x560aadc1d1b0 2024-09-10T22:28:31.692 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:31.594+0000 7fb8fd68b740 10 client.25325 fetch_fsmap finished waiting for FSMap version 26 2024-09-10T22:28:31.692 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:31.594+0000 7fb8fd68b740 10 client.25325 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-10T22:28:31.693 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:31.595+0000 7fb8fd68b740 20 client.25325 populate_metadata read hostname 'smithi019' 2024-09-10T22:28:31.693 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:31.595+0000 7fb8fd68b740 1 --2- 172.21.15.19:0/2617860642 >> [v2:172.21.15.138:6838/383637208,v1:172.21.15.138:6839/383637208] conn(0x560aadc2ccf0 0x560aadc2f130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:28:31.693 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:31.595+0000 7fb8fd68b740 4 client.25325 mds_command: new command op to 24568 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T22:28:31.693 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:31.595+0000 7fb8fd68b740 1 -- 172.21.15.19:0/2617860642 --> [v2:172.21.15.138:6838/383637208,v1:172.21.15.138:6839/383637208] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x560aadb80df0 con 0x560aadc2ccf0 2024-09-10T22:28:31.693 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:31.595+0000 7fb8f9052640 1 --2- 172.21.15.19:0/2617860642 >> [v2:172.21.15.138:6838/383637208,v1:172.21.15.138:6839/383637208] conn(0x560aadc2ccf0 0x560aadc2f130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:28:31.693 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:31.596+0000 7fb8dcff9640 10 client.25325 ms_handle_connect on v2:172.21.15.138:6838/383637208 2024-09-10T22:28:31.693 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:31.596+0000 7fb8f9052640 1 --2- 172.21.15.19:0/2617860642 >> [v2:172.21.15.138:6838/383637208,v1:172.21.15.138:6839/383637208] conn(0x560aadc2ccf0 0x560aadc2f130 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=463a7fb0bc418927 server_cookie=56c9c65256d0eaf8 in_seq=0 out_seq=0 2024-09-10T22:28:31.693 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:31.596+0000 7fb8dcff9640 1 -- 172.21.15.19:0/2617860642 <== mds.1 v2:172.21.15.138:6838/383637208 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x560aadb80df0 con 0x560aadc2ccf0 2024-09-10T22:28:31.693 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:31.596+0000 7fb8dcff9640 10 client.25325 handle_command_reply: tid=0 2024-09-10T22:28:31.693 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:31.596+0000 7fb8fd68b740 1 client.25325 shutdown 2024-09-10T22:28:31.694 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:31.597+0000 7fb8fd68b740 1 -- 172.21.15.19:0/2617860642 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560aadc1d1b0 msgr2=0x560aadc1a4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:28:31.694 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:31.597+0000 7fb8fd68b740 1 --2- 172.21.15.19:0/2617860642 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560aadc1d1b0 0x560aadc1a4b0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fb8ec00bfd0 tx=0x7fb8ec004a40 comp rx=0 tx=0).stop 2024-09-10T22:28:31.694 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:31.597+0000 7fb8fd68b740 1 -- 172.21.15.19:0/2617860642 shutdown_connections 2024-09-10T22:28:31.694 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:31.597+0000 7fb8fd68b740 1 --2- 172.21.15.19:0/2617860642 >> [v2:172.21.15.138:6838/383637208,v1:172.21.15.138:6839/383637208] conn(0x560aadc2ccf0 0x560aadc2f130 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:28:31.694 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:31.597+0000 7fb8fd68b740 1 --2- 172.21.15.19:0/2617860642 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560aadc1d1b0 0x560aadc1a4b0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:28:31.694 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:31.597+0000 7fb8fd68b740 1 --2- 172.21.15.19:0/2617860642 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x560aadc11220 0x560aadc19ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:28:31.694 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:31.597+0000 7fb8fd68b740 1 --2- 172.21.15.19:0/2617860642 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x560aadc10900 0x560aadc1ca80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:28:31.694 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:31.597+0000 7fb8fd68b740 1 -- 172.21.15.19:0/2617860642 >> 172.21.15.19:0/2617860642 conn(0x560aadc0e730 msgr2=0x560aadc142a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:28:31.694 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:31.597+0000 7fb8dcff9640 0 client.25325 ms_handle_reset on v2:172.21.15.138:6838/383637208 2024-09-10T22:28:31.694 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:31.597+0000 7fb8fd68b740 1 -- 172.21.15.19:0/2617860642 shutdown_connections 2024-09-10T22:28:31.694 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:31.597+0000 7fb8fd68b740 1 -- 172.21.15.19:0/2617860642 wait complete. 2024-09-10T22:28:31.695 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:31.597+0000 7fb8fd68b740 20 client.25325 trim_cache size 0 max 16384 2024-09-10T22:28:31.695 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:31.629+0000 7fb8fd68b740 1 Processor -- start 2024-09-10T22:28:31.695 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:31.629+0000 7fb8fd68b740 1 -- start start 2024-09-10T22:28:31.696 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:31.629+0000 7fb8fd68b740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x560aadc10900 0x560aadc29090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:28:31.696 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:31.630+0000 7fb8fd68b740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x560aadc11220 0x560aadc193c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:28:31.696 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:31.630+0000 7fb8fd68b740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560aadc1d1b0 0x560aadc150e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:28:31.696 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:31.630+0000 7fb8fd68b740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fb8d8010ed0 con 0x560aadc10900 2024-09-10T22:28:31.696 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:31.630+0000 7fb8fd68b740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fb8d800e7a0 con 0x560aadc1d1b0 2024-09-10T22:28:31.696 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:31.630+0000 7fb8fd68b740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7fb8d800c5f0 con 0x560aadc11220 2024-09-10T22:28:31.696 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:31.630+0000 7fb8f9052640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x560aadc10900 0x560aadc29090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:28:31.696 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:31.630+0000 7fb8f9052640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x560aadc10900 0x560aadc29090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:49720/0 (socket says 172.21.15.19:49720) 2024-09-10T22:28:31.696 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:31.630+0000 7fb8f9052640 1 -- 172.21.15.19:0/1129633743 learned_addr learned my addr 172.21.15.19:0/1129633743 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:28:31.696 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:31.630+0000 7fb8f8851640 1 --2- 172.21.15.19:0/1129633743 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x560aadc11220 0x560aadc193c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:28:31.696 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:31.630+0000 7fb8f9853640 1 --2- 172.21.15.19:0/1129633743 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560aadc1d1b0 0x560aadc150e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:28:31.696 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:31.630+0000 7fb8f9052640 1 -- 172.21.15.19:0/1129633743 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x560aadc11220 msgr2=0x560aadc193c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:28:31.697 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:31.630+0000 7fb8f9052640 1 --2- 172.21.15.19:0/1129633743 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x560aadc11220 0x560aadc193c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:28:31.697 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:31.630+0000 7fb8f9052640 1 -- 172.21.15.19:0/1129633743 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560aadc1d1b0 msgr2=0x560aadc150e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:28:31.697 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:31.630+0000 7fb8f9052640 1 --2- 172.21.15.19:0/1129633743 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560aadc1d1b0 0x560aadc150e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:28:31.697 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:31.630+0000 7fb8f9052640 1 -- 172.21.15.19:0/1129633743 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560aadc0e4c0 con 0x560aadc10900 2024-09-10T22:28:31.697 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:31.630+0000 7fb8f8851640 1 --2- 172.21.15.19:0/1129633743 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x560aadc11220 0x560aadc193c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T22:28:31.697 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:31.630+0000 7fb8f9052640 1 --2- 172.21.15.19:0/1129633743 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x560aadc10900 0x560aadc29090 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7fb8f0009860 tx=0x7fb8f00058d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9de17186804511de server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:28:31.697 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:31.631+0000 7fb8deffd640 1 -- 172.21.15.19:0/1129633743 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8f0037040 con 0x560aadc10900 2024-09-10T22:28:31.697 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:31.631+0000 7fb8deffd640 1 -- 172.21.15.19:0/1129633743 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb8f0005500 con 0x560aadc10900 2024-09-10T22:28:31.697 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:31.631+0000 7fb8deffd640 1 -- 172.21.15.19:0/1129633743 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8f0004cd0 con 0x560aadc10900 2024-09-10T22:28:31.697 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:31.631+0000 7fb8fd68b740 1 -- 172.21.15.19:0/1129633743 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x560aadc10900 msgr2=0x560aadc29090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:28:31.697 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:31.631+0000 7fb8fd68b740 1 --2- 172.21.15.19:0/1129633743 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x560aadc10900 0x560aadc29090 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7fb8f0009860 tx=0x7fb8f00058d0 comp rx=0 tx=0).stop 2024-09-10T22:28:31.697 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:31.632+0000 7fb8fd68b740 1 -- 172.21.15.19:0/1129633743 shutdown_connections 2024-09-10T22:28:31.697 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:31.632+0000 7fb8fd68b740 1 --2- 172.21.15.19:0/1129633743 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560aadc1d1b0 0x560aadc150e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:28:31.698 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:31.632+0000 7fb8fd68b740 1 --2- 172.21.15.19:0/1129633743 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x560aadc11220 0x560aadc193c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:28:31.698 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:31.632+0000 7fb8fd68b740 1 --2- 172.21.15.19:0/1129633743 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x560aadc10900 0x560aadc29090 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:28:31.698 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:31.632+0000 7fb8fd68b740 1 -- 172.21.15.19:0/1129633743 >> 172.21.15.19:0/1129633743 conn(0x560aadc0e730 msgr2=0x560aadc0f640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:28:31.698 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:31.632+0000 7fb8fd68b740 1 -- 172.21.15.19:0/1129633743 shutdown_connections 2024-09-10T22:28:31.698 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:31.632+0000 7fb8fd68b740 1 -- 172.21.15.19:0/1129633743 wait complete. 2024-09-10T22:28:31.698 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:31.632+0000 7fb8fd68b740 1 -- start start 2024-09-10T22:28:31.698 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:31.633+0000 7fb8fd68b740 1 Processor -- start 2024-09-10T22:28:31.698 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:31.633+0000 7fb8fd68b740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x560aadc10900 0x560aadc257d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:28:31.698 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:31.634+0000 7fb8fd68b740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560aadc11220 0x560aadc16cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:28:31.698 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:31.634+0000 7fb8fd68b740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x560aadc1d1b0 0x560aadc17200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:28:31.698 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:31.634+0000 7fb8fd68b740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fb8d800cc60 con 0x560aadc1d1b0 2024-09-10T22:28:31.698 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:31.634+0000 7fb8fd68b740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fb8d800e0d0 con 0x560aadc11220 2024-09-10T22:28:31.699 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:31.634+0000 7fb8fd68b740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7fb8d800d330 con 0x560aadc10900 2024-09-10T22:28:31.699 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:31.634+0000 7fb8fd68b740 10 client.0 _ll_register_callbacks cb 0x7fb8ec009c90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T22:28:31.699 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:31.634+0000 7fb8f8851640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560aadc11220 0x560aadc16cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:28:31.699 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:31.634+0000 7fb8f8851640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560aadc11220 0x560aadc16cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.19:37048/0 (socket says 172.21.15.19:37048) 2024-09-10T22:28:31.699 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:31.634+0000 7fb8f8851640 1 -- 172.21.15.19:0/1735734642 learned_addr learned my addr 172.21.15.19:0/1735734642 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:28:31.699 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:31.634+0000 7fb8f9853640 1 --2- 172.21.15.19:0/1735734642 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x560aadc1d1b0 0x560aadc17200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:28:31.699 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:31.634+0000 7fb8f8851640 1 -- 172.21.15.19:0/1735734642 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x560aadc10900 msgr2=0x560aadc257d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:28:31.699 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:31.634+0000 7fb8f8851640 1 --2- 172.21.15.19:0/1735734642 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x560aadc10900 0x560aadc257d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:28:31.699 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:31.634+0000 7fb8f8851640 1 -- 172.21.15.19:0/1735734642 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x560aadc1d1b0 msgr2=0x560aadc17200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:28:31.699 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:31.634+0000 7fb8f8851640 1 --2- 172.21.15.19:0/1735734642 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x560aadc1d1b0 0x560aadc17200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:28:31.699 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:31.634+0000 7fb8f8851640 1 -- 172.21.15.19:0/1735734642 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560aadc17970 con 0x560aadc11220 2024-09-10T22:28:31.699 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:31.634+0000 7fb8f9853640 1 --2- 172.21.15.19:0/1735734642 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x560aadc1d1b0 0x560aadc17200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T22:28:31.700 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:31.635+0000 7fb8f8851640 1 --2- 172.21.15.19:0/1735734642 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560aadc11220 0x560aadc16cc0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fb8e4000c00 tx=0x7fb8e40ac260 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7d9a774259b0d3c server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:28:31.700 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:31.635+0000 7fb8dcff9640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-09-10T22:28:31.700 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:31.635+0000 7fb8dcff9640 1 -- 172.21.15.19:0/1735734642 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8e40a7450 con 0x560aadc11220 2024-09-10T22:28:31.700 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:31.635+0000 7fb8fd68b740 1 -- 172.21.15.19:0/1735734642 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb8f0005500 con 0x560aadc11220 2024-09-10T22:28:31.700 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:31.635+0000 7fb8dcff9640 1 -- 172.21.15.19:0/1735734642 <== mon.2 v2:172.21.15.135:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8327+0+0 (secure 0 0 0) 0x7fb8e40e52b0 con 0x560aadc11220 2024-09-10T22:28:31.700 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:31.635+0000 7fb8dcff9640 1 -- 172.21.15.19:0/1735734642 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7fb8e40ab7f0 con 0x560aadc11220 2024-09-10T22:28:31.700 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:31.635+0000 7fb8fd68b740 10 client.25337 fetch_fsmap learned FSMap version 26 2024-09-10T22:28:31.700 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:31.635+0000 7fb8fd68b740 1 -- 172.21.15.19:0/1735734642 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x560aadc99c00 con 0x560aadc11220 2024-09-10T22:28:31.700 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:31.635+0000 7fb8dcff9640 1 -- 172.21.15.19:0/1735734642 <== mon.2 v2:172.21.15.135:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb8f0005500 con 0x560aadc11220 2024-09-10T22:28:31.700 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:31.635+0000 7fb8dcff9640 1 -- 172.21.15.19:0/1735734642 <== mon.2 v2:172.21.15.135:3300/0 5 ==== fsmap(e 26) ==== 8350+0+0 (secure 0 0 0) 0x7fb8e4091b00 con 0x560aadc11220 2024-09-10T22:28:31.700 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:31.635+0000 7fb8fd68b740 10 client.25337 fetch_fsmap finished waiting for FSMap version 26 2024-09-10T22:28:31.700 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:31.635+0000 7fb8fd68b740 10 client.25337 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-10T22:28:31.700 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:31.635+0000 7fb8fd68b740 20 client.25337 populate_metadata read hostname 'smithi019' 2024-09-10T22:28:31.701 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:31.635+0000 7fb8fd68b740 1 --2- 172.21.15.19:0/1735734642 >> [v2:172.21.15.138:6838/383637208,v1:172.21.15.138:6839/383637208] conn(0x560aadc9a310 0x560aadc9c730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:28:31.701 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:31.635+0000 7fb8fd68b740 4 client.25337 mds_command: new command op to 24568 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-10T22:28:31.701 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:31.635+0000 7fb8fd68b740 1 -- 172.21.15.19:0/1735734642 --> [v2:172.21.15.138:6838/383637208,v1:172.21.15.138:6839/383637208] -- command(tid 0: {"prefix": "damage ls"}) -- 0x560aadb7c8a0 con 0x560aadc9a310 2024-09-10T22:28:31.701 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:31.636+0000 7fb8f9052640 1 --2- 172.21.15.19:0/1735734642 >> [v2:172.21.15.138:6838/383637208,v1:172.21.15.138:6839/383637208] conn(0x560aadc9a310 0x560aadc9c730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:28:31.701 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:31.636+0000 7fb8dcff9640 10 client.25337 ms_handle_connect on v2:172.21.15.138:6838/383637208 2024-09-10T22:28:31.701 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:31.636+0000 7fb8f9052640 1 --2- 172.21.15.19:0/1735734642 >> [v2:172.21.15.138:6838/383637208,v1:172.21.15.138:6839/383637208] conn(0x560aadc9a310 0x560aadc9c730 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=6d5398a1e146bd37 server_cookie=1a45420b88d1566c in_seq=0 out_seq=0 2024-09-10T22:28:31.701 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:31.637+0000 7fb8dcff9640 1 -- 172.21.15.19:0/1735734642 <== mds.1 v2:172.21.15.138:6838/383637208 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x560aadb7c8a0 con 0x560aadc9a310 2024-09-10T22:28:31.701 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:31.637+0000 7fb8dcff9640 10 client.25337 handle_command_reply: tid=0 2024-09-10T22:28:31.701 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:31.637+0000 7fb8fd68b740 1 client.25337 shutdown 2024-09-10T22:28:31.701 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:31.637+0000 7fb8fd68b740 1 -- 172.21.15.19:0/1735734642 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560aadc11220 msgr2=0x560aadc16cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:28:31.701 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:31.637+0000 7fb8fd68b740 1 --2- 172.21.15.19:0/1735734642 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560aadc11220 0x560aadc16cc0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fb8e4000c00 tx=0x7fb8e40ac260 comp rx=0 tx=0).stop 2024-09-10T22:28:31.701 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:31.637+0000 7fb8fd68b740 1 -- 172.21.15.19:0/1735734642 shutdown_connections 2024-09-10T22:28:31.702 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:31.637+0000 7fb8fd68b740 1 --2- 172.21.15.19:0/1735734642 >> [v2:172.21.15.138:6838/383637208,v1:172.21.15.138:6839/383637208] conn(0x560aadc9a310 0x560aadc9c730 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:28:31.702 INFO:teuthology.orchestra.run.smithi019.stdout:[] 2024-09-10T22:28:31.702 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:31.637+0000 7fb8fd68b740 1 --2- 172.21.15.19:0/1735734642 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x560aadc1d1b0 0x560aadc17200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:28:31.703 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:31.637+0000 7fb8dcff9640 0 client.25337 ms_handle_reset on v2:172.21.15.138:6838/383637208 2024-09-10T22:28:31.703 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:31.637+0000 7fb8fd68b740 1 --2- 172.21.15.19:0/1735734642 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560aadc11220 0x560aadc16cc0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:28:31.703 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:31.637+0000 7fb8fd68b740 1 --2- 172.21.15.19:0/1735734642 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x560aadc10900 0x560aadc257d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:28:31.703 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:31.637+0000 7fb8fd68b740 1 -- 172.21.15.19:0/1735734642 >> 172.21.15.19:0/1735734642 conn(0x560aadc0e730 msgr2=0x560aadc150e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:28:31.703 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:31.637+0000 7fb8fd68b740 1 -- 172.21.15.19:0/1735734642 shutdown_connections 2024-09-10T22:28:31.703 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:31.637+0000 7fb8fd68b740 1 -- 172.21.15.19:0/1735734642 wait complete. 2024-09-10T22:28:31.703 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:31.637+0000 7fb8fd68b740 20 client.25337 trim_cache size 0 max 16384 2024-09-10T22:28:31.703 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:31.638+0000 7fb8fb2b6640 1 -- 172.21.15.19:0/3467649035 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7fb8e00b5360 msgr2=0x7fb8e00b7820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:28:31.703 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:31.638+0000 7fb8fb2b6640 1 --2- 172.21.15.19:0/3467649035 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7fb8e00b5360 0x7fb8e00b7820 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fb8ec009fd0 tx=0x7fb8ec0095c0 comp rx=0 tx=0).stop 2024-09-10T22:28:31.703 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:31.638+0000 7fb8fb2b6640 1 -- 172.21.15.19:0/3467649035 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb8f41045c0 msgr2=0x7fb8f4101e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:28:31.703 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:31.638+0000 7fb8fb2b6640 1 --2- 172.21.15.19:0/3467649035 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb8f41045c0 0x7fb8f4101e90 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fb8e400c940 tx=0x7fb8e400ce00 comp rx=0 tx=0).stop 2024-09-10T22:28:31.703 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:31.638+0000 7fb8fb2b6640 1 -- 172.21.15.19:0/3467649035 shutdown_connections 2024-09-10T22:28:31.704 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:31.638+0000 7fb8fb2b6640 1 --2- 172.21.15.19:0/3467649035 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7fb8e00b5360 0x7fb8e00b7820 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:28:31.704 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:31.638+0000 7fb8fb2b6640 1 --2- 172.21.15.19:0/3467649035 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb8f410d100 0x7fb8f41023d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:28:31.704 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:31.638+0000 7fb8fb2b6640 1 --2- 172.21.15.19:0/3467649035 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb8f41045c0 0x7fb8f4101e90 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:28:31.704 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:31.638+0000 7fb8fb2b6640 1 --2- 172.21.15.19:0/3467649035 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb8f4103ca0 0x7fb8f4101950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:28:31.704 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:31.638+0000 7fb8fb2b6640 1 -- 172.21.15.19:0/3467649035 >> 172.21.15.19:0/3467649035 conn(0x7fb8f40fd700 msgr2=0x7fb8f40fe300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:28:31.704 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:31.639+0000 7fb8fb2b6640 1 -- 172.21.15.19:0/3467649035 shutdown_connections 2024-09-10T22:28:31.704 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:31.639+0000 7fb8fb2b6640 1 -- 172.21.15.19:0/3467649035 wait complete. 2024-09-10T22:28:32.109 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:28:31 smithi135 ceph-mon[34789]: pgmap v410: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 491 MiB/s wr, 615 op/s 2024-09-10T22:28:32.124 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:28:31 smithi138 ceph-mon[35236]: pgmap v410: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 491 MiB/s wr, 615 op/s 2024-09-10T22:28:32.209 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:28:31 smithi019 ceph-mon[31375]: pgmap v410: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 491 MiB/s wr, 615 op/s 2024-09-10T22:28:33.038 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 22997a4c-6fc2-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-10T22:28:33.490 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/22997a4c-6fc2-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T22:28:33.958 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:28:33 smithi019 ceph-mon[31375]: pgmap v411: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 770 KiB/s rd, 407 MiB/s wr, 741 op/s 2024-09-10T22:28:34.109 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:28:33 smithi135 ceph-mon[34789]: pgmap v411: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 770 KiB/s rd, 407 MiB/s wr, 741 op/s 2024-09-10T22:28:34.125 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:28:33 smithi138 ceph-mon[35236]: pgmap v411: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 770 KiB/s rd, 407 MiB/s wr, 741 op/s 2024-09-10T22:28:34.458 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:34.456+0000 7fdfcbfff640 1 -- 172.21.15.19:0/1025416549 <== mds.0 v2:172.21.15.135:6838/1254769802 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x559ca1b07640 con 0x559ca1bb0ef0 2024-09-10T22:28:34.458 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:34.456+0000 7fdfcbfff640 10 client.25321 handle_command_reply: tid=0 2024-09-10T22:28:34.458 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:34.456+0000 7fdff5a47740 1 client.25321 shutdown 2024-09-10T22:28:34.458 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:34.456+0000 7fdff5a47740 1 -- 172.21.15.19:0/1025416549 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x559ca1b96040 msgr2=0x559ca1ba4ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:28:34.458 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:34.456+0000 7fdff5a47740 1 --2- 172.21.15.19:0/1025416549 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x559ca1b96040 0x559ca1ba4ac0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fdfd802a860 tx=0x7fdfd802a340 comp rx=0 tx=0).stop 2024-09-10T22:28:34.458 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:34.456+0000 7fdff5a47740 1 -- 172.21.15.19:0/1025416549 shutdown_connections 2024-09-10T22:28:34.459 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:34.456+0000 7fdff5a47740 1 --2- 172.21.15.19:0/1025416549 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559ca1b98be0 0x559ca1ba32b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:28:34.459 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:34.456+0000 7fdff5a47740 1 --2- 172.21.15.19:0/1025416549 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x559ca1bb0ef0 0x559ca1c20540 crc :-1 s=READY pgs=65 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:28:34.459 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:34.456+0000 7fdff5a47740 1 --2- 172.21.15.19:0/1025416549 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x559ca1b96040 0x559ca1ba4ac0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:28:34.459 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:34.456+0000 7fdff5a47740 1 --2- 172.21.15.19:0/1025416549 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x559ca1b904e0 0x559ca1ba4420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:28:34.459 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:34.456+0000 7fdfcbfff640 0 client.25321 ms_handle_reset on v2:172.21.15.135:6838/1254769802 2024-09-10T22:28:34.459 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:34.456+0000 7fdff5a47740 1 -- 172.21.15.19:0/1025416549 >> 172.21.15.19:0/1025416549 conn(0x559ca1b8ebb0 msgr2=0x559ca1b91c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:28:34.459 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:34.456+0000 7fdff5a47740 1 -- 172.21.15.19:0/1025416549 shutdown_connections 2024-09-10T22:28:34.459 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:34.456+0000 7fdff5a47740 1 -- 172.21.15.19:0/1025416549 wait complete. 2024-09-10T22:28:34.459 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:34.457+0000 7fdff5a47740 20 client.25321 trim_cache size 0 max 16384 2024-09-10T22:28:34.460 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stdout:{ 2024-09-10T22:28:34.460 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stdout: "message": "", 2024-09-10T22:28:34.460 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stdout: "return_code": 0 2024-09-10T22:28:34.460 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stdout:} 2024-09-10T22:28:34.461 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:34.458+0000 7fdfd77fe640 1 -- 172.21.15.19:0/2192291841 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7fdfdc0b5360 msgr2=0x7fdfdc0b7820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:28:34.461 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:34.458+0000 7fdfd77fe640 1 --2- 172.21.15.19:0/2192291841 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7fdfdc0b5360 0x7fdfdc0b7820 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fdfd8009830 tx=0x7fdfd8030340 comp rx=0 tx=0).stop 2024-09-10T22:28:34.461 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:34.458+0000 7fdfd77fe640 1 -- 172.21.15.19:0/2192291841 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdfec102af0 msgr2=0x7fdfec199da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:28:34.461 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:34.458+0000 7fdfd77fe640 1 --2- 172.21.15.19:0/2192291841 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdfec102af0 0x7fdfec199da0 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7fdfe400e940 tx=0x7fdfe400ee00 comp rx=0 tx=0).stop 2024-09-10T22:28:34.461 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:34.459+0000 7fdfd77fe640 1 -- 172.21.15.19:0/2192291841 shutdown_connections 2024-09-10T22:28:34.461 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:34.459+0000 7fdfd77fe640 1 --2- 172.21.15.19:0/2192291841 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7fdfdc0b5360 0x7fdfdc0b7820 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:28:34.461 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:34.459+0000 7fdfd77fe640 1 --2- 172.21.15.19:0/2192291841 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdfec102af0 0x7fdfec199da0 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:28:34.461 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:34.459+0000 7fdfd77fe640 1 --2- 172.21.15.19:0/2192291841 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdfec102130 0x7fdfec1991e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:28:34.461 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:34.459+0000 7fdfd77fe640 1 --2- 172.21.15.19:0/2192291841 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fdfec100fe0 0x7fdfec198b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:28:34.462 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:34.459+0000 7fdfd77fe640 1 -- 172.21.15.19:0/2192291841 >> 172.21.15.19:0/2192291841 conn(0x7fdfec0fc880 msgr2=0x7fdfec105430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:28:34.462 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:34.459+0000 7fdfd77fe640 1 -- 172.21.15.19:0/2192291841 shutdown_connections 2024-09-10T22:28:34.462 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:34.459+0000 7fdfd77fe640 1 -- 172.21.15.19:0/2192291841 wait complete. 2024-09-10T22:28:34.511 INFO:teuthology.orchestra.run.smithi019.stdout:[] 2024-09-10T22:28:34.512 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:34.395+0000 7f05c5ffb640 1 -- 172.21.15.19:0/1085403828 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05b80318a0 con 0x7f05c8102de0 2024-09-10T22:28:34.512 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:34.396+0000 7f05cd65c640 1 -- 172.21.15.19:0/1085403828 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f05c8102de0 msgr2=0x7f05c81031c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:28:34.512 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:34.396+0000 7f05cd65c640 1 --2- 172.21.15.19:0/1085403828 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f05c8102de0 0x7f05c81031c0 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f05b8009900 tx=0x7f05b802a410 comp rx=0 tx=0).stop 2024-09-10T22:28:34.512 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:34.396+0000 7f05cd65c640 1 -- 172.21.15.19:0/1085403828 shutdown_connections 2024-09-10T22:28:34.512 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:34.396+0000 7f05cd65c640 1 --2- 172.21.15.19:0/1085403828 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f05c8109170 0x7f05c810f970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:28:34.512 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:34.396+0000 7f05cd65c640 1 --2- 172.21.15.19:0/1085403828 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f05c81087f0 0x7f05c8108c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:28:34.512 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:34.396+0000 7f05cd65c640 1 --2- 172.21.15.19:0/1085403828 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f05c8102de0 0x7f05c81031c0 unknown :-1 s=CLOSED pgs=504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:28:34.512 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:34.396+0000 7f05cd65c640 1 -- 172.21.15.19:0/1085403828 >> 172.21.15.19:0/1085403828 conn(0x7f05c80fe830 msgr2=0x7f05c8100c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:28:34.512 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:34.396+0000 7f05cd65c640 1 -- 172.21.15.19:0/1085403828 shutdown_connections 2024-09-10T22:28:34.513 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:34.396+0000 7f05cd65c640 1 -- 172.21.15.19:0/1085403828 wait complete. 2024-09-10T22:28:34.513 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:34.397+0000 7f05cd65c640 1 Processor -- start 2024-09-10T22:28:34.513 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:34.397+0000 7f05cd65c640 1 -- start start 2024-09-10T22:28:34.513 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:34.398+0000 7f05cd65c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f05c8102de0 0x7f05c8199420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:28:34.513 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:34.398+0000 7f05cd65c640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f05c81087f0 0x7f05c8199960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:28:34.513 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:34.398+0000 7f05cd65c640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f05c8109170 0x7f05c819ed00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:28:34.513 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:34.398+0000 7f05cd65c640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f05c8112ee0 con 0x7f05c8102de0 2024-09-10T22:28:34.513 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:34.398+0000 7f05cd65c640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f05c8112d60 con 0x7f05c81087f0 2024-09-10T22:28:34.513 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:34.398+0000 7f05cd65c640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f05c8113060 con 0x7f05c8109170 2024-09-10T22:28:34.513 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:34.398+0000 7f05c6ffd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f05c8102de0 0x7f05c8199420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:28:34.513 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:34.398+0000 7f05c6ffd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f05c8102de0 0x7f05c8199420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:36390/0 (socket says 172.21.15.19:36390) 2024-09-10T22:28:34.513 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:34.398+0000 7f05c6ffd640 1 -- 172.21.15.19:0/4082036706 learned_addr learned my addr 172.21.15.19:0/4082036706 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:28:34.514 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:34.399+0000 7f05c77fe640 1 --2- 172.21.15.19:0/4082036706 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f05c8109170 0x7f05c819ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:28:34.514 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:34.399+0000 7f05c67fc640 1 --2- 172.21.15.19:0/4082036706 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f05c81087f0 0x7f05c8199960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:28:34.514 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:34.399+0000 7f05c6ffd640 1 -- 172.21.15.19:0/4082036706 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f05c8109170 msgr2=0x7f05c819ed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:28:34.514 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:34.399+0000 7f05c6ffd640 1 --2- 172.21.15.19:0/4082036706 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f05c8109170 0x7f05c819ed00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:28:34.514 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:34.399+0000 7f05c6ffd640 1 -- 172.21.15.19:0/4082036706 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f05c81087f0 msgr2=0x7f05c8199960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:28:34.514 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:34.399+0000 7f05c6ffd640 1 --2- 172.21.15.19:0/4082036706 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f05c81087f0 0x7f05c8199960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:28:34.514 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:34.399+0000 7f05c6ffd640 1 -- 172.21.15.19:0/4082036706 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f05c819f4d0 con 0x7f05c8102de0 2024-09-10T22:28:34.514 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:34.400+0000 7f05c6ffd640 1 --2- 172.21.15.19:0/4082036706 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f05c8102de0 0x7f05c8199420 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f05b8005ec0 tx=0x7f05b8004360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:28:34.514 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:34.401+0000 7f05affff640 1 -- 172.21.15.19:0/4082036706 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05b803f070 con 0x7f05c8102de0 2024-09-10T22:28:34.514 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:34.401+0000 7f05affff640 1 -- 172.21.15.19:0/4082036706 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f05b8003aa0 con 0x7f05c8102de0 2024-09-10T22:28:34.514 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:34.401+0000 7f05affff640 1 -- 172.21.15.19:0/4082036706 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05b8035030 con 0x7f05c8102de0 2024-09-10T22:28:34.514 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:34.402+0000 7f05cd65c640 1 -- 172.21.15.19:0/4082036706 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f05c819f760 con 0x7f05c8102de0 2024-09-10T22:28:34.514 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:34.402+0000 7f05cd65c640 1 -- 172.21.15.19:0/4082036706 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f05c8075380 con 0x7f05c8102de0 2024-09-10T22:28:34.514 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:34.409+0000 7f05cfa31740 1 Processor -- start 2024-09-10T22:28:34.515 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:34.409+0000 7f05cfa31740 1 -- start start 2024-09-10T22:28:34.515 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:34.410+0000 7f05cfa31740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55cba902a0f0 0x55cba902a4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:28:34.515 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:34.410+0000 7f05cfa31740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55cba902aa10 0x55cba9036460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:28:34.515 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:34.411+0000 7f05cfa31740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55cba90369a0 0x55cba9038d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:28:34.515 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:34.411+0000 7f05cfa31740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x55cba8fa0ea0 con 0x55cba902a0f0 2024-09-10T22:28:34.515 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:34.411+0000 7f05cfa31740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55cba8f902d0 con 0x55cba902aa10 2024-09-10T22:28:34.515 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:34.411+0000 7f05cfa31740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x55cba8f940e0 con 0x55cba90369a0 2024-09-10T22:28:34.515 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:34.411+0000 7f05c77fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55cba902a0f0 0x55cba902a4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:28:34.515 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:34.411+0000 7f05c77fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55cba902a0f0 0x55cba902a4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:36394/0 (socket says 172.21.15.19:36394) 2024-09-10T22:28:34.515 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:34.411+0000 7f05c77fe640 1 -- 172.21.15.19:0/1187917551 learned_addr learned my addr 172.21.15.19:0/1187917551 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:28:34.515 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:34.411+0000 7f05c67fc640 1 --2- 172.21.15.19:0/1187917551 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55cba90369a0 0x55cba9038d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:28:34.515 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:34.412+0000 7f05c77fe640 1 -- 172.21.15.19:0/1187917551 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55cba90369a0 msgr2=0x55cba9038d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:28:34.515 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:34.412+0000 7f05c77fe640 1 --2- 172.21.15.19:0/1187917551 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55cba90369a0 0x55cba9038d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:28:34.516 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:34.412+0000 7f05c77fe640 1 -- 172.21.15.19:0/1187917551 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55cba902aa10 msgr2=0x55cba9036460 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-10T22:28:34.516 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:34.412+0000 7f05c77fe640 1 --2- 172.21.15.19:0/1187917551 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55cba902aa10 0x55cba9036460 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:28:34.516 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:34.412+0000 7f05c77fe640 1 -- 172.21.15.19:0/1187917551 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cba8cee650 con 0x55cba902a0f0 2024-09-10T22:28:34.516 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:34.412+0000 7f05c77fe640 1 --2- 172.21.15.19:0/1187917551 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55cba902a0f0 0x55cba902a4d0 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f05c0009f60 tx=0x7f05c0009f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eb68da7c34205f73 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:28:34.516 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:34.413+0000 7f05ad7fa640 1 -- 172.21.15.19:0/1187917551 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05c001a070 con 0x55cba902a0f0 2024-09-10T22:28:34.516 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:34.413+0000 7f05ad7fa640 1 -- 172.21.15.19:0/1187917551 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f05c00158c0 con 0x55cba902a0f0 2024-09-10T22:28:34.516 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:34.414+0000 7f05ad7fa640 1 -- 172.21.15.19:0/1187917551 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05c000a940 con 0x55cba902a0f0 2024-09-10T22:28:34.516 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:34.416+0000 7f05cfa31740 1 -- 172.21.15.19:0/1187917551 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55cba902a0f0 msgr2=0x55cba902a4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:28:34.516 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:34.416+0000 7f05cfa31740 1 --2- 172.21.15.19:0/1187917551 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55cba902a0f0 0x55cba902a4d0 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f05c0009f60 tx=0x7f05c0009f90 comp rx=0 tx=0).stop 2024-09-10T22:28:34.516 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:34.416+0000 7f05affff640 1 -- 172.21.15.19:0/4082036706 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 18) ==== 153250+0+0 (secure 0 0 0) 0x7f05b80035f0 con 0x7f05c8102de0 2024-09-10T22:28:34.516 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:34.417+0000 7f05affff640 1 --2- 172.21.15.19:0/4082036706 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f05b00b54b0 0x7f05b00b7970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:28:34.516 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:34.417+0000 7f05cfa31740 1 -- 172.21.15.19:0/1187917551 shutdown_connections 2024-09-10T22:28:34.517 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:34.417+0000 7f05cfa31740 1 --2- 172.21.15.19:0/1187917551 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55cba90369a0 0x55cba9038d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:28:34.517 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:34.417+0000 7f05affff640 1 -- 172.21.15.19:0/4082036706 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8327+0+0 (secure 0 0 0) 0x7f05b8106590 con 0x7f05c8102de0 2024-09-10T22:28:34.517 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:34.417+0000 7f05cfa31740 1 --2- 172.21.15.19:0/1187917551 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55cba902aa10 0x55cba9036460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:28:34.517 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:34.417+0000 7f05cfa31740 1 --2- 172.21.15.19:0/1187917551 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55cba902a0f0 0x55cba902a4d0 unknown :-1 s=CLOSED pgs=506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:28:34.517 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:34.417+0000 7f05cfa31740 1 -- 172.21.15.19:0/1187917551 >> 172.21.15.19:0/1187917551 conn(0x55cba9027f20 msgr2=0x55cba90290c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:28:34.517 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:34.418+0000 7f05c77fe640 1 --2- 172.21.15.19:0/4082036706 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f05b00b54b0 0x7f05b00b7970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:28:34.517 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:34.418+0000 7f05cfa31740 1 -- 172.21.15.19:0/1187917551 shutdown_connections 2024-09-10T22:28:34.517 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:34.418+0000 7f05cfa31740 1 -- 172.21.15.19:0/1187917551 wait complete. 2024-09-10T22:28:34.517 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:34.419+0000 7f05c77fe640 1 --2- 172.21.15.19:0/4082036706 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f05b00b54b0 0x7f05b00b7970 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f05c0000f80 tx=0x7f05c000a4a0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:28:34.517 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:34.419+0000 7f05cfa31740 1 -- start start 2024-09-10T22:28:34.517 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:34.419+0000 7f05cfa31740 1 Processor -- start 2024-09-10T22:28:34.517 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:34.422+0000 7f05cfa31740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55cba902a0f0 0x55cba9036230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:28:34.518 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:34.422+0000 7f05cfa31740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55cba902aa10 0x55cba9033680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:28:34.518 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:34.422+0000 7f05cfa31740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55cba90369a0 0x55cba9033c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:28:34.518 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:34.422+0000 7f05cfa31740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x55cba8df1700 con 0x55cba902a0f0 2024-09-10T22:28:34.518 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:34.422+0000 7f05cfa31740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55cba8f2b160 con 0x55cba90369a0 2024-09-10T22:28:34.518 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:34.422+0000 7f05cfa31740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x55cba90396c0 con 0x55cba902aa10 2024-09-10T22:28:34.518 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:34.422+0000 7f05cfa31740 10 client.0 _ll_register_callbacks cb 0x55cba8f449e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T22:28:34.518 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:34.422+0000 7f05c67fc640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55cba902aa10 0x55cba9033680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:28:34.518 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:34.423+0000 7f05c67fc640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55cba902aa10 0x55cba9033680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.19:33520/0 (socket says 172.21.15.19:33520) 2024-09-10T22:28:34.518 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:34.423+0000 7f05c67fc640 1 -- 172.21.15.19:0/2857995545 learned_addr learned my addr 172.21.15.19:0/2857995545 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:28:34.518 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:34.423+0000 7f05c6ffd640 1 --2- 172.21.15.19:0/2857995545 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55cba902a0f0 0x55cba9036230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:28:34.518 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:34.423+0000 7f05c77fe640 1 --2- 172.21.15.19:0/2857995545 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55cba90369a0 0x55cba9033c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:28:34.518 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:34.423+0000 7f05c6ffd640 1 -- 172.21.15.19:0/2857995545 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55cba902aa10 msgr2=0x55cba9033680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:28:34.518 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:34.423+0000 7f05c6ffd640 1 --2- 172.21.15.19:0/2857995545 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55cba902aa10 0x55cba9033680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:28:34.519 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:34.423+0000 7f05c6ffd640 1 -- 172.21.15.19:0/2857995545 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55cba90369a0 msgr2=0x55cba9033c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:28:34.519 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:34.423+0000 7f05c6ffd640 1 --2- 172.21.15.19:0/2857995545 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55cba90369a0 0x55cba9033c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:28:34.519 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:34.423+0000 7f05c6ffd640 1 -- 172.21.15.19:0/2857995545 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cba8f58c90 con 0x55cba902a0f0 2024-09-10T22:28:34.519 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:34.423+0000 7f05c77fe640 1 --2- 172.21.15.19:0/2857995545 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55cba90369a0 0x55cba9033c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T22:28:34.519 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:34.424+0000 7f05c6ffd640 1 --2- 172.21.15.19:0/2857995545 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55cba902a0f0 0x55cba9036230 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x55cba9028e00 tx=0x7f05b80c8b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1b659f6eebf640d7 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:28:34.519 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:34.424+0000 7f05aaff5640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-10T22:28:34.519 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:34.424+0000 7f05aaff5640 1 -- 172.21.15.19:0/2857995545 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05b80cc400 con 0x55cba902a0f0 2024-09-10T22:28:34.519 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:34.424+0000 7f05aaff5640 1 -- 172.21.15.19:0/2857995545 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8327+0+0 (secure 0 0 0) 0x7f05b80ccef0 con 0x55cba902a0f0 2024-09-10T22:28:34.519 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:34.425+0000 7f05cfa31740 1 -- 172.21.15.19:0/2857995545 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f05c00158c0 con 0x55cba902a0f0 2024-09-10T22:28:34.519 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:34.425+0000 7f05aaff5640 1 -- 172.21.15.19:0/2857995545 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f05b80c8400 con 0x55cba902a0f0 2024-09-10T22:28:34.519 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:34.425+0000 7f05cfa31740 10 client.15792 fetch_fsmap learned FSMap version 26 2024-09-10T22:28:34.519 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:34.425+0000 7f05cfa31740 1 -- 172.21.15.19:0/2857995545 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x55cba9044fc0 con 0x55cba902a0f0 2024-09-10T22:28:34.519 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:34.425+0000 7f05aaff5640 1 -- 172.21.15.19:0/2857995545 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f05b80cc7a0 con 0x55cba902a0f0 2024-09-10T22:28:34.520 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:34.426+0000 7f05aaff5640 1 -- 172.21.15.19:0/2857995545 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 26) ==== 8350+0+0 (secure 0 0 0) 0x7f05b80d5d90 con 0x55cba902a0f0 2024-09-10T22:28:34.520 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:34.426+0000 7f05cfa31740 10 client.15792 fetch_fsmap finished waiting for FSMap version 26 2024-09-10T22:28:34.520 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:34.426+0000 7f05cfa31740 10 client.15792 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-10T22:28:34.520 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:34.426+0000 7f05cfa31740 20 client.15792 populate_metadata read hostname 'smithi019' 2024-09-10T22:28:34.520 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:34.426+0000 7f05cfa31740 1 --2- 172.21.15.19:0/2857995545 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x55cba9046470 0x55cba9048890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:28:34.520 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:34.426+0000 7f05cfa31740 4 client.15792 mds_command: new command op to 24581 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T22:28:34.520 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:34.426+0000 7f05cfa31740 1 -- 172.21.15.19:0/2857995545 --> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f05c00158c0 con 0x55cba9046470 2024-09-10T22:28:34.520 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:34.426+0000 7f05c67fc640 1 --2- 172.21.15.19:0/2857995545 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x55cba9046470 0x55cba9048890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:28:34.520 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:34.427+0000 7f05c67fc640 1 --2- 172.21.15.19:0/2857995545 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x55cba9046470 0x55cba9048890 crc :-1 s=READY pgs=66 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e1bc439f9709e44a server_cookie=6298f279c44bf100 in_seq=0 out_seq=0 2024-09-10T22:28:34.520 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:34.427+0000 7f05aaff5640 10 client.15792 ms_handle_connect on v2:172.21.15.135:6838/1254769802 2024-09-10T22:28:34.520 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:34.428+0000 7f05aaff5640 1 -- 172.21.15.19:0/2857995545 <== mds.0 v2:172.21.15.135:6838/1254769802 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x7f05c00158c0 con 0x55cba9046470 2024-09-10T22:28:34.520 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:34.428+0000 7f05aaff5640 10 client.15792 handle_command_reply: tid=0 2024-09-10T22:28:34.520 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:34.428+0000 7f05cfa31740 1 client.15792 shutdown 2024-09-10T22:28:34.521 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:34.428+0000 7f05cfa31740 1 -- 172.21.15.19:0/2857995545 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55cba902a0f0 msgr2=0x55cba9036230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:28:34.521 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:34.428+0000 7f05cfa31740 1 --2- 172.21.15.19:0/2857995545 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55cba902a0f0 0x55cba9036230 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x55cba9028e00 tx=0x7f05b80c8b30 comp rx=0 tx=0).stop 2024-09-10T22:28:34.521 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:34.428+0000 7f05cfa31740 1 -- 172.21.15.19:0/2857995545 shutdown_connections 2024-09-10T22:28:34.521 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:34.428+0000 7f05cfa31740 1 --2- 172.21.15.19:0/2857995545 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55cba90369a0 0x55cba9033c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:28:34.521 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:34.428+0000 7f05cfa31740 1 --2- 172.21.15.19:0/2857995545 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x55cba9046470 0x55cba9048890 crc :-1 s=READY pgs=66 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:28:34.521 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:34.429+0000 7f05cfa31740 1 --2- 172.21.15.19:0/2857995545 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55cba902aa10 0x55cba9033680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:28:34.521 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:34.429+0000 7f05cfa31740 1 --2- 172.21.15.19:0/2857995545 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55cba902a0f0 0x55cba9036230 unknown :-1 s=CLOSED pgs=507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:28:34.521 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:34.429+0000 7f05cfa31740 1 -- 172.21.15.19:0/2857995545 >> 172.21.15.19:0/2857995545 conn(0x55cba9027f20 msgr2=0x55cba902da90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:28:34.521 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:34.429+0000 7f05aaff5640 0 client.15792 ms_handle_reset on v2:172.21.15.135:6838/1254769802 2024-09-10T22:28:34.521 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:34.429+0000 7f05cfa31740 1 -- 172.21.15.19:0/2857995545 shutdown_connections 2024-09-10T22:28:34.521 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:34.429+0000 7f05cfa31740 1 -- 172.21.15.19:0/2857995545 wait complete. 2024-09-10T22:28:34.521 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:34.429+0000 7f05cfa31740 20 client.15792 trim_cache size 0 max 16384 2024-09-10T22:28:34.522 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:34.448+0000 7f05cfa31740 1 Processor -- start 2024-09-10T22:28:34.522 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:34.448+0000 7f05cfa31740 1 -- start start 2024-09-10T22:28:34.522 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:34.448+0000 7f05cfa31740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55cba902a0f0 0x55cba9030890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:28:34.522 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:34.448+0000 7f05cfa31740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55cba902aa10 0x55cba9030dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:28:34.522 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:34.448+0000 7f05cfa31740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55cba90369a0 0x55cba904e140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:28:34.522 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:34.448+0000 7f05cfa31740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f05c81aed80 con 0x55cba902aa10 2024-09-10T22:28:34.522 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:34.448+0000 7f05cfa31740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f05c81ac650 con 0x55cba902a0f0 2024-09-10T22:28:34.522 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:34.448+0000 7f05cfa31740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f05c81aa4a0 con 0x55cba90369a0 2024-09-10T22:28:34.522 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:34.449+0000 7f05c67fc640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55cba902aa10 0x55cba9030dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:28:34.522 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:34.449+0000 7f05c6ffd640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55cba902a0f0 0x55cba9030890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:28:34.522 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:34.449+0000 7f05c67fc640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55cba902aa10 0x55cba9030dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:36418/0 (socket says 172.21.15.19:36418) 2024-09-10T22:28:34.522 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:34.449+0000 7f05c67fc640 1 -- 172.21.15.19:0/1823929888 learned_addr learned my addr 172.21.15.19:0/1823929888 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:28:34.522 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:34.449+0000 7f05c6ffd640 1 -- 172.21.15.19:0/1823929888 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55cba90369a0 msgr2=0x55cba904e140 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-10T22:28:34.523 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:34.449+0000 7f05c6ffd640 1 --2- 172.21.15.19:0/1823929888 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55cba90369a0 0x55cba904e140 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:28:34.523 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:34.449+0000 7f05c6ffd640 1 -- 172.21.15.19:0/1823929888 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55cba902aa10 msgr2=0x55cba9030dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:28:34.523 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:34.449+0000 7f05c6ffd640 1 --2- 172.21.15.19:0/1823929888 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55cba902aa10 0x55cba9030dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:28:34.523 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:34.449+0000 7f05c6ffd640 1 -- 172.21.15.19:0/1823929888 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cba9048c00 con 0x55cba902a0f0 2024-09-10T22:28:34.523 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:34.449+0000 7f05c67fc640 1 --2- 172.21.15.19:0/1823929888 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55cba902aa10 0x55cba9030dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T22:28:34.523 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:34.449+0000 7f05c6ffd640 1 --2- 172.21.15.19:0/1823929888 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55cba902a0f0 0x55cba9030890 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f05b8003f50 tx=0x7f05b803b560 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e59847dc4ace173c server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:28:34.523 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:34.450+0000 7f05acff9640 1 -- 172.21.15.19:0/1823929888 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05b80cc7a0 con 0x55cba902a0f0 2024-09-10T22:28:34.523 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:34.450+0000 7f05acff9640 1 -- 172.21.15.19:0/1823929888 <== mon.2 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f05b80cd390 con 0x55cba902a0f0 2024-09-10T22:28:34.523 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:34.450+0000 7f05acff9640 1 -- 172.21.15.19:0/1823929888 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05b80d1770 con 0x55cba902a0f0 2024-09-10T22:28:34.523 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:34.451+0000 7f05cfa31740 1 -- 172.21.15.19:0/1823929888 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55cba902a0f0 msgr2=0x55cba9030890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:28:34.523 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:34.451+0000 7f05cfa31740 1 --2- 172.21.15.19:0/1823929888 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55cba902a0f0 0x55cba9030890 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f05b8003f50 tx=0x7f05b803b560 comp rx=0 tx=0).stop 2024-09-10T22:28:34.523 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:34.451+0000 7f05cfa31740 1 -- 172.21.15.19:0/1823929888 shutdown_connections 2024-09-10T22:28:34.523 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:34.451+0000 7f05cfa31740 1 --2- 172.21.15.19:0/1823929888 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55cba90369a0 0x55cba904e140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:28:34.524 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:34.451+0000 7f05cfa31740 1 --2- 172.21.15.19:0/1823929888 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55cba902aa10 0x55cba9030dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:28:34.524 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:34.451+0000 7f05cfa31740 1 --2- 172.21.15.19:0/1823929888 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55cba902a0f0 0x55cba9030890 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:28:34.524 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:34.451+0000 7f05cfa31740 1 -- 172.21.15.19:0/1823929888 >> 172.21.15.19:0/1823929888 conn(0x55cba9027f20 msgr2=0x55cba9029030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:28:34.524 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:34.451+0000 7f05cfa31740 1 -- 172.21.15.19:0/1823929888 shutdown_connections 2024-09-10T22:28:34.524 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:34.451+0000 7f05cfa31740 1 -- 172.21.15.19:0/1823929888 wait complete. 2024-09-10T22:28:34.524 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:34.452+0000 7f05cfa31740 1 -- start start 2024-09-10T22:28:34.524 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:34.452+0000 7f05cfa31740 1 Processor -- start 2024-09-10T22:28:34.524 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:34.452+0000 7f05cfa31740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55cba902a0f0 0x55cba903aa90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:28:34.524 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:34.452+0000 7f05cfa31740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55cba902aa10 0x55cba903afd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:28:34.524 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:34.452+0000 7f05cfa31740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55cba90369a0 0x55cba903b510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:28:34.524 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:34.453+0000 7f05cfa31740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f05c81aab10 con 0x55cba902a0f0 2024-09-10T22:28:34.524 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:34.453+0000 7f05cfa31740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f05c81abf80 con 0x55cba902aa10 2024-09-10T22:28:34.524 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:34.453+0000 7f05cfa31740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f05c81ab1e0 con 0x55cba90369a0 2024-09-10T22:28:34.525 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:34.453+0000 7f05cfa31740 10 client.0 _ll_register_callbacks cb 0x7f05b803b460 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T22:28:34.525 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:34.453+0000 7f05c6ffd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55cba902a0f0 0x55cba903aa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:28:34.525 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:34.453+0000 7f05c6ffd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55cba902a0f0 0x55cba903aa90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:36434/0 (socket says 172.21.15.19:36434) 2024-09-10T22:28:34.525 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:34.453+0000 7f05c6ffd640 1 -- 172.21.15.19:0/4152968283 learned_addr learned my addr 172.21.15.19:0/4152968283 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:28:34.525 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:34.453+0000 7f05c77fe640 1 --2- 172.21.15.19:0/4152968283 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55cba90369a0 0x55cba903b510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:28:34.525 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:34.453+0000 7f05c67fc640 1 --2- 172.21.15.19:0/4152968283 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55cba902aa10 0x55cba903afd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:28:34.525 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:34.454+0000 7f05c6ffd640 1 -- 172.21.15.19:0/4152968283 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55cba90369a0 msgr2=0x55cba903b510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:28:34.525 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:34.454+0000 7f05c6ffd640 1 --2- 172.21.15.19:0/4152968283 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55cba90369a0 0x55cba903b510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:28:34.525 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:34.454+0000 7f05c6ffd640 1 -- 172.21.15.19:0/4152968283 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55cba902aa10 msgr2=0x55cba903afd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:28:34.525 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:34.454+0000 7f05c6ffd640 1 --2- 172.21.15.19:0/4152968283 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55cba902aa10 0x55cba903afd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:28:34.525 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:34.454+0000 7f05c6ffd640 1 -- 172.21.15.19:0/4152968283 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cba90b24a0 con 0x55cba902a0f0 2024-09-10T22:28:34.525 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:34.454+0000 7f05c6ffd640 1 --2- 172.21.15.19:0/4152968283 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55cba902a0f0 0x55cba903aa90 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f05b8006010 tx=0x7f05b80c8c60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=57bcca74782d83c5 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:28:34.526 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:34.454+0000 7f05aaff5640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-10T22:28:34.526 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:34.454+0000 7f05aaff5640 1 -- 172.21.15.19:0/4152968283 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05b80e6030 con 0x55cba902a0f0 2024-09-10T22:28:34.526 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:34.455+0000 7f05cfa31740 1 -- 172.21.15.19:0/4152968283 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f05b80cd390 con 0x55cba902a0f0 2024-09-10T22:28:34.526 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:34.455+0000 7f05aaff5640 1 -- 172.21.15.19:0/4152968283 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8327+0+0 (secure 0 0 0) 0x7f05b80ccef0 con 0x55cba902a0f0 2024-09-10T22:28:34.526 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:34.455+0000 7f05aaff5640 1 -- 172.21.15.19:0/4152968283 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f05b80cc7a0 con 0x55cba902a0f0 2024-09-10T22:28:34.526 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:34.456+0000 7f05cfa31740 10 client.15798 fetch_fsmap learned FSMap version 26 2024-09-10T22:28:34.526 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:34.456+0000 7f05cfa31740 1 -- 172.21.15.19:0/4152968283 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x55cba90b24a0 con 0x55cba902a0f0 2024-09-10T22:28:34.526 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:34.457+0000 7f05aaff5640 1 -- 172.21.15.19:0/4152968283 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f05b80cd390 con 0x55cba902a0f0 2024-09-10T22:28:34.526 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:34.458+0000 7f05aaff5640 1 -- 172.21.15.19:0/4152968283 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 26) ==== 8350+0+0 (secure 0 0 0) 0x7f05b80d1210 con 0x55cba902a0f0 2024-09-10T22:28:34.526 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:34.458+0000 7f05cfa31740 10 client.15798 fetch_fsmap finished waiting for FSMap version 26 2024-09-10T22:28:34.526 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:34.458+0000 7f05cfa31740 10 client.15798 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-10T22:28:34.526 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:34.458+0000 7f05cfa31740 20 client.15798 populate_metadata read hostname 'smithi019' 2024-09-10T22:28:34.526 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:34.458+0000 7f05cfa31740 1 --2- 172.21.15.19:0/4152968283 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x55cba90b3ad0 0x55cba90b5ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:28:34.527 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:34.458+0000 7f05cfa31740 4 client.15798 mds_command: new command op to 24581 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-10T22:28:34.527 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:34.458+0000 7f05cfa31740 1 -- 172.21.15.19:0/4152968283 --> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55cba8fa2df0 con 0x55cba90b3ad0 2024-09-10T22:28:34.527 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:34.459+0000 7f05c67fc640 1 --2- 172.21.15.19:0/4152968283 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x55cba90b3ad0 0x55cba90b5ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:28:34.527 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:34.460+0000 7f05aaff5640 10 client.15798 ms_handle_connect on v2:172.21.15.135:6838/1254769802 2024-09-10T22:28:34.527 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:34.460+0000 7f05c67fc640 1 --2- 172.21.15.19:0/4152968283 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x55cba90b3ad0 0x55cba90b5ef0 crc :-1 s=READY pgs=67 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a10354953f41646b server_cookie=4c5bc4bc8834a8e9 in_seq=0 out_seq=0 2024-09-10T22:28:34.527 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:34.460+0000 7f05aaff5640 1 -- 172.21.15.19:0/4152968283 <== mds.0 v2:172.21.15.135:6838/1254769802 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55cba8fa2df0 con 0x55cba90b3ad0 2024-09-10T22:28:34.527 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:34.460+0000 7f05aaff5640 10 client.15798 handle_command_reply: tid=0 2024-09-10T22:28:34.527 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:34.461+0000 7f05cfa31740 1 client.15798 shutdown 2024-09-10T22:28:34.527 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:34.461+0000 7f05cfa31740 1 -- 172.21.15.19:0/4152968283 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55cba902a0f0 msgr2=0x55cba903aa90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:28:34.527 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:34.461+0000 7f05cfa31740 1 --2- 172.21.15.19:0/4152968283 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55cba902a0f0 0x55cba903aa90 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f05b8006010 tx=0x7f05b80c8c60 comp rx=0 tx=0).stop 2024-09-10T22:28:34.527 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:34.461+0000 7f05cfa31740 1 -- 172.21.15.19:0/4152968283 shutdown_connections 2024-09-10T22:28:34.527 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:34.461+0000 7f05cfa31740 1 --2- 172.21.15.19:0/4152968283 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x55cba90b3ad0 0x55cba90b5ef0 crc :-1 s=READY pgs=67 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:28:34.527 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:34.461+0000 7f05cfa31740 1 --2- 172.21.15.19:0/4152968283 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55cba90369a0 0x55cba903b510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:28:34.528 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:34.461+0000 7f05aaff5640 0 client.15798 ms_handle_reset on v2:172.21.15.135:6838/1254769802 2024-09-10T22:28:34.528 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:34.461+0000 7f05cfa31740 1 --2- 172.21.15.19:0/4152968283 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55cba902aa10 0x55cba903afd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:28:34.528 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:34.461+0000 7f05cfa31740 1 --2- 172.21.15.19:0/4152968283 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55cba902a0f0 0x55cba903aa90 unknown :-1 s=CLOSED pgs=508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:28:34.528 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:34.461+0000 7f05cfa31740 1 -- 172.21.15.19:0/4152968283 >> 172.21.15.19:0/4152968283 conn(0x55cba9027f20 msgr2=0x55cba9034cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:28:34.528 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:34.461+0000 7f05cfa31740 1 -- 172.21.15.19:0/4152968283 shutdown_connections 2024-09-10T22:28:34.528 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:34.461+0000 7f05cfa31740 1 -- 172.21.15.19:0/4152968283 wait complete. 2024-09-10T22:28:34.528 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:34.462+0000 7f05cfa31740 20 client.15798 trim_cache size 0 max 16384 2024-09-10T22:28:34.528 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:34.463+0000 7f05cd65c640 1 -- 172.21.15.19:0/4082036706 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f05b00b54b0 msgr2=0x7f05b00b7970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:28:34.528 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:34.463+0000 7f05cd65c640 1 --2- 172.21.15.19:0/4082036706 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f05b00b54b0 0x7f05b00b7970 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f05c0000f80 tx=0x7f05c000a4a0 comp rx=0 tx=0).stop 2024-09-10T22:28:34.528 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:34.464+0000 7f05cd65c640 1 -- 172.21.15.19:0/4082036706 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f05c8102de0 msgr2=0x7f05c8199420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:28:34.528 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:34.464+0000 7f05cd65c640 1 --2- 172.21.15.19:0/4082036706 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f05c8102de0 0x7f05c8199420 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f05b8005ec0 tx=0x7f05b8004360 comp rx=0 tx=0).stop 2024-09-10T22:28:34.528 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:34.465+0000 7f05cd65c640 1 -- 172.21.15.19:0/4082036706 shutdown_connections 2024-09-10T22:28:34.528 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:34.465+0000 7f05cd65c640 1 --2- 172.21.15.19:0/4082036706 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f05b00b54b0 0x7f05b00b7970 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:28:34.529 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:34.465+0000 7f05cd65c640 1 --2- 172.21.15.19:0/4082036706 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f05c8109170 0x7f05c819ed00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:28:34.529 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:34.465+0000 7f05cd65c640 1 --2- 172.21.15.19:0/4082036706 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f05c81087f0 0x7f05c8199960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:28:34.529 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:34.465+0000 7f05cd65c640 1 --2- 172.21.15.19:0/4082036706 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f05c8102de0 0x7f05c8199420 unknown :-1 s=CLOSED pgs=505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:28:34.529 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:34.465+0000 7f05cd65c640 1 -- 172.21.15.19:0/4082036706 >> 172.21.15.19:0/4082036706 conn(0x7f05c80fe830 msgr2=0x7f05c8100c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:28:34.529 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:34.466+0000 7f05cd65c640 1 -- 172.21.15.19:0/4082036706 shutdown_connections 2024-09-10T22:28:34.529 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:34.467+0000 7f05cd65c640 1 -- 172.21.15.19:0/4082036706 wait complete. 2024-09-10T22:28:35.958 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:28:35 smithi019 ceph-mon[31375]: pgmap v412: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 391 MiB/s wr, 730 op/s 2024-09-10T22:28:36.109 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:28:35 smithi135 ceph-mon[34789]: pgmap v412: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 391 MiB/s wr, 730 op/s 2024-09-10T22:28:36.125 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:28:35 smithi138 ceph-mon[35236]: pgmap v412: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 391 MiB/s wr, 730 op/s 2024-09-10T22:28:36.758 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-10T22:28:36.758 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 22997a4c-6fc2-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-10T22:28:37.218 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/22997a4c-6fc2-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T22:28:38.110 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:28:37 smithi135 ceph-mon[34789]: pgmap v413: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 418 MiB/s wr, 735 op/s 2024-09-10T22:28:38.110 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:28:37 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T22:28:38.125 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:28:37 smithi138 ceph-mon[35236]: pgmap v413: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 418 MiB/s wr, 735 op/s 2024-09-10T22:28:38.125 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:28:37 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T22:28:38.170 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:28:37 smithi019 ceph-mon[31375]: pgmap v413: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 418 MiB/s wr, 735 op/s 2024-09-10T22:28:38.170 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:28:37 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T22:28:38.234 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:38.231+0000 7fea4fc4f640 1 -- 172.21.15.19:0/110360882 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fea481087d0 msgr2=0x7fea48108c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:28:38.234 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:38.231+0000 7fea4fc4f640 1 --2- 172.21.15.19:0/110360882 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fea481087d0 0x7fea48108c10 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7fea38009900 tx=0x7fea3802a410 comp rx=0 tx=0).stop 2024-09-10T22:28:38.234 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:38.232+0000 7fea4fc4f640 1 -- 172.21.15.19:0/110360882 shutdown_connections 2024-09-10T22:28:38.234 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:38.232+0000 7fea4fc4f640 1 --2- 172.21.15.19:0/110360882 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fea48109150 0x7fea4810f950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:28:38.234 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:38.232+0000 7fea4fc4f640 1 --2- 172.21.15.19:0/110360882 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fea481087d0 0x7fea48108c10 unknown :-1 s=CLOSED pgs=509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:28:38.234 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:38.232+0000 7fea4fc4f640 1 --2- 172.21.15.19:0/110360882 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fea48102dc0 0x7fea481031a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:28:38.235 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:38.232+0000 7fea4fc4f640 1 -- 172.21.15.19:0/110360882 >> 172.21.15.19:0/110360882 conn(0x7fea480fe870 msgr2=0x7fea48100c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:28:38.235 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:38.232+0000 7fea4fc4f640 1 -- 172.21.15.19:0/110360882 shutdown_connections 2024-09-10T22:28:38.235 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:38.232+0000 7fea4fc4f640 1 -- 172.21.15.19:0/110360882 wait complete. 2024-09-10T22:28:38.235 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:38.233+0000 7fea4fc4f640 1 Processor -- start 2024-09-10T22:28:38.236 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:38.233+0000 7fea4fc4f640 1 -- start start 2024-09-10T22:28:38.237 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:38.234+0000 7fea4fc4f640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fea48102dc0 0x7fea481a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:28:38.237 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:38.234+0000 7fea4fc4f640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fea48109150 0x7fea481a5cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:28:38.237 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:38.234+0000 7fea4fc4f640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fea4810ed60 0x7fea4810f210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:28:38.237 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:38.234+0000 7fea4fc4f640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fea48112e50 con 0x7fea48109150 2024-09-10T22:28:38.237 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:38.234+0000 7fea4fc4f640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fea48112cd0 con 0x7fea48102dc0 2024-09-10T22:28:38.237 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:38.234+0000 7fea4fc4f640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7fea48112fd0 con 0x7fea4810ed60 2024-09-10T22:28:38.237 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:38.234+0000 7fea4d1ea640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fea48109150 0x7fea481a5cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:28:38.237 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:38.234+0000 7fea4d1ea640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fea48109150 0x7fea481a5cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:36444/0 (socket says 172.21.15.19:36444) 2024-09-10T22:28:38.237 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:38.234+0000 7fea4d1ea640 1 -- 172.21.15.19:0/3485814113 learned_addr learned my addr 172.21.15.19:0/3485814113 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:28:38.237 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:38.234+0000 7fea4d9eb640 1 --2- 172.21.15.19:0/3485814113 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fea48102dc0 0x7fea481a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:28:38.238 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:38.235+0000 7fea4d1ea640 1 -- 172.21.15.19:0/3485814113 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fea4810ed60 msgr2=0x7fea4810f210 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-10T22:28:38.238 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:38.235+0000 7fea4d1ea640 1 --2- 172.21.15.19:0/3485814113 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fea4810ed60 0x7fea4810f210 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:28:38.238 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:38.235+0000 7fea4d1ea640 1 -- 172.21.15.19:0/3485814113 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fea48102dc0 msgr2=0x7fea481a5790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:28:38.238 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:38.235+0000 7fea4d1ea640 1 --2- 172.21.15.19:0/3485814113 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fea48102dc0 0x7fea481a5790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:28:38.238 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:38.235+0000 7fea4d1ea640 1 -- 172.21.15.19:0/3485814113 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fea4810f9e0 con 0x7fea48109150 2024-09-10T22:28:38.238 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:38.235+0000 7fea4d9eb640 1 --2- 172.21.15.19:0/3485814113 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fea48102dc0 0x7fea481a5790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T22:28:38.238 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:38.235+0000 7fea4d1ea640 1 --2- 172.21.15.19:0/3485814113 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fea48109150 0x7fea481a5cd0 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7fea38031440 tx=0x7fea380045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:28:38.239 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:38.235+0000 7fea3effd640 1 -- 172.21.15.19:0/3485814113 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea38035030 con 0x7fea48109150 2024-09-10T22:28:38.239 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:38.236+0000 7fea3effd640 1 -- 172.21.15.19:0/3485814113 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fea38003e30 con 0x7fea48109150 2024-09-10T22:28:38.239 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:38.236+0000 7fea3effd640 1 -- 172.21.15.19:0/3485814113 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea380318a0 con 0x7fea48109150 2024-09-10T22:28:38.239 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:38.236+0000 7fea4fc4f640 1 -- 172.21.15.19:0/3485814113 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fea481ac5d0 con 0x7fea48109150 2024-09-10T22:28:38.239 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:38.236+0000 7fea4fc4f640 1 -- 172.21.15.19:0/3485814113 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fea481ac970 con 0x7fea48109150 2024-09-10T22:28:38.242 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:38.241+0000 7fea52024740 1 Processor -- start 2024-09-10T22:28:38.243 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:38.241+0000 7fea52024740 1 -- start start 2024-09-10T22:28:38.243 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:38.242+0000 7fea52024740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x560438b46ee0 0x560438b472c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:28:38.243 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:38.242+0000 7fea52024740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560438b47800 0x560438b53250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:28:38.243 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:38.242+0000 7fea3effd640 1 -- 172.21.15.19:0/3485814113 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 18) ==== 153250+0+0 (secure 0 0 0) 0x7fea3804d060 con 0x7fea48109150 2024-09-10T22:28:38.244 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:38.242+0000 7fea4e1ec640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x560438b46ee0 0x560438b472c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:28:38.244 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:38.242+0000 7fea4e1ec640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x560438b46ee0 0x560438b472c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:36446/0 (socket says 172.21.15.19:36446) 2024-09-10T22:28:38.244 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:38.242+0000 7fea52024740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x560438b53790 0x560438b55b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:28:38.244 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:38.242+0000 7fea4e1ec640 1 -- 172.21.15.19:0/905343967 learned_addr learned my addr 172.21.15.19:0/905343967 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:28:38.244 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:38.242+0000 7fea52024740 1 -- 172.21.15.19:0/905343967 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x560438abde60 con 0x560438b46ee0 2024-09-10T22:28:38.244 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:38.242+0000 7fea52024740 1 -- 172.21.15.19:0/905343967 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x560438aad290 con 0x560438b47800 2024-09-10T22:28:38.244 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:38.242+0000 7fea52024740 1 -- 172.21.15.19:0/905343967 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x560438ab10a0 con 0x560438b53790 2024-09-10T22:28:38.245 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:38.243+0000 7fea4d9eb640 1 --2- 172.21.15.19:0/905343967 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560438b47800 0x560438b53250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:28:38.246 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:38.243+0000 7fea4e1ec640 1 -- 172.21.15.19:0/905343967 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x560438b53790 msgr2=0x560438b55b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:28:38.246 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:38.243+0000 7fea4e1ec640 1 --2- 172.21.15.19:0/905343967 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x560438b53790 0x560438b55b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:28:38.246 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:38.243+0000 7fea4e1ec640 1 -- 172.21.15.19:0/905343967 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560438b47800 msgr2=0x560438b53250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:28:38.246 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:38.243+0000 7fea4e1ec640 1 --2- 172.21.15.19:0/905343967 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560438b47800 0x560438b53250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:28:38.246 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:38.243+0000 7fea4e1ec640 1 -- 172.21.15.19:0/905343967 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56043880b930 con 0x560438b46ee0 2024-09-10T22:28:38.246 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:38.243+0000 7fea4d9eb640 1 --2- 172.21.15.19:0/905343967 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560438b47800 0x560438b53250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T22:28:38.246 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:38.243+0000 7fea4e1ec640 1 --2- 172.21.15.19:0/905343967 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x560438b46ee0 0x560438b472c0 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7fea40009750 tx=0x7fea40009c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c737df87ad8c5081 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:28:38.246 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:38.243+0000 7fea3effd640 1 --2- 172.21.15.19:0/3485814113 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7fea340b5360 0x7fea340b7820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:28:38.246 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:38.243+0000 7fea3effd640 1 -- 172.21.15.19:0/3485814113 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8327+0+0 (secure 0 0 0) 0x7fea38105ec0 con 0x7fea48109150 2024-09-10T22:28:38.246 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:38.243+0000 7fea4d9eb640 1 --2- 172.21.15.19:0/3485814113 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7fea340b5360 0x7fea340b7820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:28:38.246 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:38.243+0000 7fea33fff640 1 -- 172.21.15.19:0/905343967 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea40015020 con 0x560438b46ee0 2024-09-10T22:28:38.247 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:38.244+0000 7fea33fff640 1 -- 172.21.15.19:0/905343967 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fea40011420 con 0x560438b46ee0 2024-09-10T22:28:38.247 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:38.244+0000 7fea33fff640 1 -- 172.21.15.19:0/905343967 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea40009e60 con 0x560438b46ee0 2024-09-10T22:28:38.248 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:38.244+0000 7fea52024740 1 -- 172.21.15.19:0/905343967 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x560438b46ee0 msgr2=0x560438b472c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:28:38.248 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:38.244+0000 7fea52024740 1 --2- 172.21.15.19:0/905343967 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x560438b46ee0 0x560438b472c0 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7fea40009750 tx=0x7fea40009c10 comp rx=0 tx=0).stop 2024-09-10T22:28:38.248 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:38.245+0000 7fea52024740 1 -- 172.21.15.19:0/905343967 shutdown_connections 2024-09-10T22:28:38.248 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:38.245+0000 7fea52024740 1 --2- 172.21.15.19:0/905343967 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x560438b53790 0x560438b55b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:28:38.248 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:38.245+0000 7fea52024740 1 --2- 172.21.15.19:0/905343967 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560438b47800 0x560438b53250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:28:38.249 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:38.245+0000 7fea52024740 1 --2- 172.21.15.19:0/905343967 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x560438b46ee0 0x560438b472c0 unknown :-1 s=CLOSED pgs=511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:28:38.249 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:38.245+0000 7fea52024740 1 -- 172.21.15.19:0/905343967 >> 172.21.15.19:0/905343967 conn(0x560438b44d10 msgr2=0x560438b45eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:28:38.249 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:38.245+0000 7fea52024740 1 -- 172.21.15.19:0/905343967 shutdown_connections 2024-09-10T22:28:38.249 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:38.245+0000 7fea52024740 1 -- 172.21.15.19:0/905343967 wait complete. 2024-09-10T22:28:38.249 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:38.245+0000 7fea4d9eb640 1 --2- 172.21.15.19:0/3485814113 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7fea340b5360 0x7fea340b7820 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x560438b4a060 tx=0x7fea44009640 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:28:38.249 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:38.246+0000 7fea52024740 1 -- start start 2024-09-10T22:28:38.249 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:38.246+0000 7fea52024740 1 Processor -- start 2024-09-10T22:28:38.249 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:38.247+0000 7fea52024740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x560438b46ee0 0x560438b507c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:28:38.249 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:38.247+0000 7fea52024740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x560438b47800 0x560438b50d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:28:38.249 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:38.247+0000 7fea52024740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560438b53790 0x560438b51240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:28:38.249 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:38.247+0000 7fea52024740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x56043890e890 con 0x560438b47800 2024-09-10T22:28:38.250 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:38.247+0000 7fea52024740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x560438a47d40 con 0x560438b53790 2024-09-10T22:28:38.250 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:38.247+0000 7fea52024740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x560438b56440 con 0x560438b46ee0 2024-09-10T22:28:38.250 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:38.247+0000 7fea52024740 10 client.0 _ll_register_callbacks cb 0x560438aabc80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T22:28:38.251 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:38.247+0000 7fea4d1ea640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x560438b47800 0x560438b50d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:28:38.251 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:38.247+0000 7fea4d1ea640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x560438b47800 0x560438b50d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:36448/0 (socket says 172.21.15.19:36448) 2024-09-10T22:28:38.251 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:38.247+0000 7fea4d1ea640 1 -- 172.21.15.19:0/700748199 learned_addr learned my addr 172.21.15.19:0/700748199 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:28:38.251 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:38.248+0000 7fea4e1ec640 1 --2- 172.21.15.19:0/700748199 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560438b53790 0x560438b51240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:28:38.251 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:38.248+0000 7fea4d9eb640 1 --2- 172.21.15.19:0/700748199 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x560438b46ee0 0x560438b507c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:28:38.251 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:38.248+0000 7fea4d1ea640 1 -- 172.21.15.19:0/700748199 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x560438b46ee0 msgr2=0x560438b507c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:28:38.251 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:38.248+0000 7fea4d1ea640 1 --2- 172.21.15.19:0/700748199 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x560438b46ee0 0x560438b507c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:28:38.251 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:38.248+0000 7fea4d1ea640 1 -- 172.21.15.19:0/700748199 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560438b53790 msgr2=0x560438b51240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:28:38.251 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:38.248+0000 7fea4d1ea640 1 --2- 172.21.15.19:0/700748199 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560438b53790 0x560438b51240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:28:38.251 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:38.249+0000 7fea4d1ea640 1 -- 172.21.15.19:0/700748199 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560438b5f8a0 con 0x560438b47800 2024-09-10T22:28:38.252 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:38.249+0000 7fea4d1ea640 1 --2- 172.21.15.19:0/700748199 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x560438b47800 0x560438b50d00 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7fea38103960 tx=0x7fea380c8ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=390cb761ff8776b server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:28:38.252 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:38.249+0000 7fea317fa640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-10T22:28:38.253 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:38.250+0000 7fea317fa640 1 -- 172.21.15.19:0/700748199 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea3804a040 con 0x560438b47800 2024-09-10T22:28:38.253 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:38.250+0000 7fea317fa640 1 -- 172.21.15.19:0/700748199 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8327+0+0 (secure 0 0 0) 0x7fea380cca80 con 0x560438b47800 2024-09-10T22:28:38.253 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:38.250+0000 7fea52024740 1 -- 172.21.15.19:0/700748199 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fea40011420 con 0x560438b47800 2024-09-10T22:28:38.253 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:38.250+0000 7fea317fa640 1 -- 172.21.15.19:0/700748199 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7fea380cbf70 con 0x560438b47800 2024-09-10T22:28:38.253 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:38.250+0000 7fea52024740 10 client.15810 fetch_fsmap learned FSMap version 26 2024-09-10T22:28:38.253 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:38.250+0000 7fea52024740 1 -- 172.21.15.19:0/700748199 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x560438b621a0 con 0x560438b47800 2024-09-10T22:28:38.253 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:38.251+0000 7fea317fa640 1 -- 172.21.15.19:0/700748199 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fea40011420 con 0x560438b47800 2024-09-10T22:28:38.253 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:38.251+0000 7fea317fa640 1 -- 172.21.15.19:0/700748199 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 26) ==== 8350+0+0 (secure 0 0 0) 0x7fea380d5720 con 0x560438b47800 2024-09-10T22:28:38.253 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:38.251+0000 7fea52024740 10 client.15810 fetch_fsmap finished waiting for FSMap version 26 2024-09-10T22:28:38.253 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:38.251+0000 7fea52024740 10 client.15810 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-10T22:28:38.254 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:38.251+0000 7fea52024740 20 client.15810 populate_metadata read hostname 'smithi019' 2024-09-10T22:28:38.254 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:38.251+0000 7fea52024740 1 --2- 172.21.15.19:0/700748199 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x560438b63600 0x560438b65a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:28:38.254 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:38.251+0000 7fea52024740 4 client.15810 mds_command: new command op to 24581 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T22:28:38.254 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:38.251+0000 7fea52024740 1 -- 172.21.15.19:0/700748199 --> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x560438abfdb0 con 0x560438b63600 2024-09-10T22:28:38.254 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:38.252+0000 7fea4d9eb640 1 --2- 172.21.15.19:0/700748199 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x560438b63600 0x560438b65a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:28:38.254 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:38.253+0000 7fea317fa640 10 client.15810 ms_handle_connect on v2:172.21.15.135:6838/1254769802 2024-09-10T22:28:38.255 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:38.253+0000 7fea4d9eb640 1 --2- 172.21.15.19:0/700748199 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x560438b63600 0x560438b65a20 crc :-1 s=READY pgs=68 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e6e3162971ff6377 server_cookie=6fd9a956b693f17a in_seq=0 out_seq=0 2024-09-10T22:28:38.259 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:38.258+0000 7fea317fa640 1 -- 172.21.15.19:0/700748199 <== mds.0 v2:172.21.15.135:6838/1254769802 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x560438abfdb0 con 0x560438b63600 2024-09-10T22:28:38.259 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:38.258+0000 7fea317fa640 10 client.15810 handle_command_reply: tid=0 2024-09-10T22:28:38.259 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:38.258+0000 7fea52024740 1 client.15810 shutdown 2024-09-10T22:28:38.260 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:38.258+0000 7fea52024740 1 -- 172.21.15.19:0/700748199 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x560438b47800 msgr2=0x560438b50d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:28:38.260 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:38.258+0000 7fea52024740 1 --2- 172.21.15.19:0/700748199 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x560438b47800 0x560438b50d00 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7fea38103960 tx=0x7fea380c8ce0 comp rx=0 tx=0).stop 2024-09-10T22:28:38.260 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:38.258+0000 7fea52024740 1 -- 172.21.15.19:0/700748199 shutdown_connections 2024-09-10T22:28:38.260 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:38.258+0000 7fea52024740 1 --2- 172.21.15.19:0/700748199 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560438b53790 0x560438b51240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:28:38.260 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:38.258+0000 7fea52024740 1 --2- 172.21.15.19:0/700748199 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x560438b47800 0x560438b50d00 unknown :-1 s=CLOSED pgs=512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:28:38.260 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:38.258+0000 7fea52024740 1 --2- 172.21.15.19:0/700748199 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x560438b63600 0x560438b65a20 crc :-1 s=READY pgs=68 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:28:38.260 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:38.258+0000 7fea52024740 1 --2- 172.21.15.19:0/700748199 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x560438b46ee0 0x560438b507c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:28:38.261 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:38.258+0000 7fea52024740 1 -- 172.21.15.19:0/700748199 >> 172.21.15.19:0/700748199 conn(0x560438b44d10 msgr2=0x560438b43f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:28:38.261 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:38.258+0000 7fea317fa640 0 client.15810 ms_handle_reset on v2:172.21.15.135:6838/1254769802 2024-09-10T22:28:38.261 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:38.258+0000 7fea52024740 1 -- 172.21.15.19:0/700748199 shutdown_connections 2024-09-10T22:28:38.261 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:38.258+0000 7fea52024740 1 -- 172.21.15.19:0/700748199 wait complete. 2024-09-10T22:28:38.261 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:38.258+0000 7fea52024740 20 client.15810 trim_cache size 0 max 16384 2024-09-10T22:28:38.284 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:38.282+0000 7fea52024740 1 Processor -- start 2024-09-10T22:28:38.284 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:38.282+0000 7fea52024740 1 -- start start 2024-09-10T22:28:38.284 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:38.282+0000 7fea52024740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x560438b46ee0 0x560438b50050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:28:38.284 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:38.282+0000 7fea52024740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560438b47800 0x560438b4a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:28:38.284 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:38.282+0000 7fea52024740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x560438b53790 0x560438b4d9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:28:38.284 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:38.282+0000 7fea52024740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fea481b7ab0 con 0x560438b53790 2024-09-10T22:28:38.284 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:38.282+0000 7fea52024740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fea481b5380 con 0x560438b47800 2024-09-10T22:28:38.284 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:38.282+0000 7fea52024740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7fea481b31d0 con 0x560438b46ee0 2024-09-10T22:28:38.285 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:38.283+0000 7fea4d9eb640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x560438b46ee0 0x560438b50050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:28:38.285 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:38.283+0000 7fea4d1ea640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560438b47800 0x560438b4a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:28:38.286 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:38.283+0000 7fea4e1ec640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x560438b53790 0x560438b4d9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:28:38.286 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:38.283+0000 7fea4d1ea640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560438b47800 0x560438b4a7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.19:50778/0 (socket says 172.21.15.19:50778) 2024-09-10T22:28:38.286 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:38.283+0000 7fea4e1ec640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x560438b53790 0x560438b4d9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:36454/0 (socket says 172.21.15.19:36454) 2024-09-10T22:28:38.286 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:38.283+0000 7fea4d1ea640 1 -- 172.21.15.19:0/79990617 learned_addr learned my addr 172.21.15.19:0/79990617 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:28:38.286 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:38.283+0000 7fea4d1ea640 1 -- 172.21.15.19:0/79990617 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x560438b46ee0 msgr2=0x560438b50050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:28:38.286 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:38.283+0000 7fea4d1ea640 1 --2- 172.21.15.19:0/79990617 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x560438b46ee0 0x560438b50050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:28:38.286 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:38.283+0000 7fea4d1ea640 1 -- 172.21.15.19:0/79990617 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x560438b53790 msgr2=0x560438b4d9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:28:38.286 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:38.283+0000 7fea4d1ea640 1 --2- 172.21.15.19:0/79990617 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x560438b53790 0x560438b4d9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:28:38.286 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:38.283+0000 7fea4d1ea640 1 -- 172.21.15.19:0/79990617 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560438b45790 con 0x560438b47800 2024-09-10T22:28:38.286 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:38.283+0000 7fea4d9eb640 1 --2- 172.21.15.19:0/79990617 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x560438b46ee0 0x560438b50050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T22:28:38.286 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:38.283+0000 7fea4e1ec640 1 --2- 172.21.15.19:0/79990617 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x560438b53790 0x560438b4d9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T22:28:38.286 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:38.283+0000 7fea4d1ea640 1 --2- 172.21.15.19:0/79990617 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560438b47800 0x560438b4a7a0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fea38103cd0 tx=0x7fea38009260 comp rx=0 tx=0).ready entity=mon.2 client_cookie=733d3416a15a5074 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:28:38.286 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:38.284+0000 7fea337fe640 1 -- 172.21.15.19:0/79990617 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea3804a030 con 0x560438b47800 2024-09-10T22:28:38.287 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:38.284+0000 7fea337fe640 1 -- 172.21.15.19:0/79990617 <== mon.2 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fea380cc130 con 0x560438b47800 2024-09-10T22:28:38.287 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:38.284+0000 7fea337fe640 1 -- 172.21.15.19:0/79990617 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea380b7070 con 0x560438b47800 2024-09-10T22:28:38.288 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:38.285+0000 7fea52024740 1 -- 172.21.15.19:0/79990617 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560438b47800 msgr2=0x560438b4a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:28:38.288 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:38.285+0000 7fea52024740 1 --2- 172.21.15.19:0/79990617 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560438b47800 0x560438b4a7a0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fea38103cd0 tx=0x7fea38009260 comp rx=0 tx=0).stop 2024-09-10T22:28:38.288 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:38.285+0000 7fea52024740 1 -- 172.21.15.19:0/79990617 shutdown_connections 2024-09-10T22:28:38.288 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:38.285+0000 7fea52024740 1 --2- 172.21.15.19:0/79990617 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x560438b53790 0x560438b4d9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:28:38.288 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:38.285+0000 7fea52024740 1 --2- 172.21.15.19:0/79990617 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560438b47800 0x560438b4a7a0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:28:38.288 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:38.285+0000 7fea52024740 1 --2- 172.21.15.19:0/79990617 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x560438b46ee0 0x560438b50050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:28:38.288 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:38.285+0000 7fea52024740 1 -- 172.21.15.19:0/79990617 >> 172.21.15.19:0/79990617 conn(0x560438b44d10 msgr2=0x560438b4a090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:28:38.288 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:38.285+0000 7fea52024740 1 -- 172.21.15.19:0/79990617 shutdown_connections 2024-09-10T22:28:38.289 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:38.286+0000 7fea52024740 1 -- 172.21.15.19:0/79990617 wait complete. 2024-09-10T22:28:38.289 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:38.286+0000 7fea52024740 1 -- start start 2024-09-10T22:28:38.289 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:38.286+0000 7fea52024740 1 Processor -- start 2024-09-10T22:28:38.290 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:38.287+0000 7fea52024740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560438b46ee0 0x560438b57f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:28:38.291 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:38.287+0000 7fea52024740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x560438b47800 0x560438b584d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:28:38.291 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:38.287+0000 7fea52024740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x560438b53790 0x560438bc9480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:28:38.292 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:38.287+0000 7fea52024740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fea481b3840 con 0x560438b53790 2024-09-10T22:28:38.292 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:38.287+0000 7fea52024740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fea481b4cb0 con 0x560438b46ee0 2024-09-10T22:28:38.292 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:38.287+0000 7fea52024740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7fea481b3f10 con 0x560438b47800 2024-09-10T22:28:38.292 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:38.287+0000 7fea52024740 10 client.0 _ll_register_callbacks cb 0x7fea38032a50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T22:28:38.292 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:38.287+0000 7fea4d9eb640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560438b46ee0 0x560438b57f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:28:38.292 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:38.287+0000 7fea4e1ec640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x560438b53790 0x560438bc9480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:28:38.292 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:38.287+0000 7fea4d9eb640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560438b46ee0 0x560438b57f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.19:50788/0 (socket says 172.21.15.19:50788) 2024-09-10T22:28:38.292 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:38.287+0000 7fea4d9eb640 1 -- 172.21.15.19:0/756751750 learned_addr learned my addr 172.21.15.19:0/756751750 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:28:38.292 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:38.287+0000 7fea4d1ea640 1 --2- 172.21.15.19:0/756751750 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x560438b47800 0x560438b584d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:28:38.292 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:38.288+0000 7fea4d9eb640 1 -- 172.21.15.19:0/756751750 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x560438b47800 msgr2=0x560438b584d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:28:38.292 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:38.288+0000 7fea4d9eb640 1 --2- 172.21.15.19:0/756751750 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x560438b47800 0x560438b584d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:28:38.293 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:38.288+0000 7fea4d9eb640 1 -- 172.21.15.19:0/756751750 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x560438b53790 msgr2=0x560438bc9480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:28:38.293 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:38.288+0000 7fea4d9eb640 1 --2- 172.21.15.19:0/756751750 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x560438b53790 0x560438bc9480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:28:38.293 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:38.288+0000 7fea4d9eb640 1 -- 172.21.15.19:0/756751750 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560438b5ff70 con 0x560438b46ee0 2024-09-10T22:28:38.293 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:38.288+0000 7fea4d1ea640 1 --2- 172.21.15.19:0/756751750 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x560438b47800 0x560438b584d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T22:28:38.293 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:38.288+0000 7fea4d9eb640 1 --2- 172.21.15.19:0/756751750 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560438b46ee0 0x560438b57f50 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x560438b66250 tx=0x7fea44004b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=53f5aa8f7b4c18b3 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:28:38.293 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:38.288+0000 7fea317fa640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-09-10T22:28:38.293 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:38.288+0000 7fea317fa640 1 -- 172.21.15.19:0/756751750 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea44016d10 con 0x560438b46ee0 2024-09-10T22:28:38.295 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:38.288+0000 7fea317fa640 1 -- 172.21.15.19:0/756751750 <== mon.2 v2:172.21.15.135:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8327+0+0 (secure 0 0 0) 0x7fea4402c440 con 0x560438b46ee0 2024-09-10T22:28:38.295 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:38.288+0000 7fea52024740 1 -- 172.21.15.19:0/756751750 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fea380cc130 con 0x560438b46ee0 2024-09-10T22:28:38.295 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:38.289+0000 7fea317fa640 1 -- 172.21.15.19:0/756751750 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7fea4402c680 con 0x560438b46ee0 2024-09-10T22:28:38.295 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:38.289+0000 7fea52024740 10 client.25361 fetch_fsmap learned FSMap version 26 2024-09-10T22:28:38.295 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:38.289+0000 7fea52024740 1 -- 172.21.15.19:0/756751750 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x560438bd0e10 con 0x560438b46ee0 2024-09-10T22:28:38.295 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:38.289+0000 7fea317fa640 1 -- 172.21.15.19:0/756751750 <== mon.2 v2:172.21.15.135:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fea380cc130 con 0x560438b46ee0 2024-09-10T22:28:38.295 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:38.289+0000 7fea317fa640 1 -- 172.21.15.19:0/756751750 <== mon.2 v2:172.21.15.135:3300/0 5 ==== fsmap(e 26) ==== 8350+0+0 (secure 0 0 0) 0x7fea44035050 con 0x560438b46ee0 2024-09-10T22:28:38.295 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:38.289+0000 7fea52024740 10 client.25361 fetch_fsmap finished waiting for FSMap version 26 2024-09-10T22:28:38.295 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:38.289+0000 7fea52024740 10 client.25361 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-10T22:28:38.295 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:38.289+0000 7fea52024740 20 client.25361 populate_metadata read hostname 'smithi019' 2024-09-10T22:28:38.295 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:38.289+0000 7fea52024740 1 --2- 172.21.15.19:0/756751750 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x560438bd15a0 0x560438bd39c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:28:38.296 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:38.289+0000 7fea52024740 4 client.25361 mds_command: new command op to 24581 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-10T22:28:38.296 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:38.289+0000 7fea52024740 1 -- 172.21.15.19:0/756751750 --> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x560438abb860 con 0x560438bd15a0 2024-09-10T22:28:38.296 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:38.289+0000 7fea4d1ea640 1 --2- 172.21.15.19:0/756751750 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x560438bd15a0 0x560438bd39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:28:38.296 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:38.290+0000 7fea317fa640 10 client.25361 ms_handle_connect on v2:172.21.15.135:6838/1254769802 2024-09-10T22:28:38.296 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:38.290+0000 7fea4d1ea640 1 --2- 172.21.15.19:0/756751750 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x560438bd15a0 0x560438bd39c0 crc :-1 s=READY pgs=69 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b3ff8cbecce73209 server_cookie=106b17ae0c1334ca in_seq=0 out_seq=0 2024-09-10T22:28:38.369 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:38.367+0000 7fea317fa640 1 -- 172.21.15.19:0/756751750 <== mds.0 v2:172.21.15.135:6838/1254769802 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x560438abb860 con 0x560438bd15a0 2024-09-10T22:28:38.369 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:38.367+0000 7fea317fa640 10 client.25361 handle_command_reply: tid=0 2024-09-10T22:28:38.370 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:38.367+0000 7fea52024740 1 client.25361 shutdown 2024-09-10T22:28:38.370 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:38.367+0000 7fea52024740 1 -- 172.21.15.19:0/756751750 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560438b46ee0 msgr2=0x560438b57f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:28:38.370 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:38.367+0000 7fea52024740 1 --2- 172.21.15.19:0/756751750 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560438b46ee0 0x560438b57f50 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x560438b66250 tx=0x7fea44004b50 comp rx=0 tx=0).stop 2024-09-10T22:28:38.370 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:38.368+0000 7fea52024740 1 -- 172.21.15.19:0/756751750 shutdown_connections 2024-09-10T22:28:38.370 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:38.368+0000 7fea52024740 1 --2- 172.21.15.19:0/756751750 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x560438b53790 0x560438bc9480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:28:38.370 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:38.368+0000 7fea52024740 1 --2- 172.21.15.19:0/756751750 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x560438bd15a0 0x560438bd39c0 crc :-1 s=READY pgs=69 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:28:38.370 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:38.368+0000 7fea52024740 1 --2- 172.21.15.19:0/756751750 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x560438b47800 0x560438b584d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:28:38.370 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:38.368+0000 7fea52024740 1 --2- 172.21.15.19:0/756751750 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560438b46ee0 0x560438b57f50 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:28:38.370 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:38.368+0000 7fea317fa640 0 client.25361 ms_handle_reset on v2:172.21.15.135:6838/1254769802 2024-09-10T22:28:38.370 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:38.368+0000 7fea52024740 1 -- 172.21.15.19:0/756751750 >> 172.21.15.19:0/756751750 conn(0x560438b44d10 msgr2=0x560438b4a8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:28:38.370 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:38.368+0000 7fea52024740 1 -- 172.21.15.19:0/756751750 shutdown_connections 2024-09-10T22:28:38.370 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:38.368+0000 7fea52024740 1 -- 172.21.15.19:0/756751750 wait complete. 2024-09-10T22:28:38.370 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:38.368+0000 7fea52024740 20 client.25361 trim_cache size 0 max 16384 2024-09-10T22:28:38.371 INFO:teuthology.orchestra.run.smithi019.stdout:{ 2024-09-10T22:28:38.371 INFO:teuthology.orchestra.run.smithi019.stdout: "return_code": 0, 2024-09-10T22:28:38.371 INFO:teuthology.orchestra.run.smithi019.stdout: "scrub_tag": "eb518e3c-a71e-4f32-9ca0-ae88930ca218", 2024-09-10T22:28:38.371 INFO:teuthology.orchestra.run.smithi019.stdout: "mode": "asynchronous" 2024-09-10T22:28:38.371 INFO:teuthology.orchestra.run.smithi019.stdout:} 2024-09-10T22:28:38.372 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:38.369+0000 7fea4fc4f640 1 -- 172.21.15.19:0/3485814113 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7fea340b5360 msgr2=0x7fea340b7820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:28:38.372 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:38.369+0000 7fea4fc4f640 1 --2- 172.21.15.19:0/3485814113 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7fea340b5360 0x7fea340b7820 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x560438b4a060 tx=0x7fea44009640 comp rx=0 tx=0).stop 2024-09-10T22:28:38.372 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:38.369+0000 7fea4fc4f640 1 -- 172.21.15.19:0/3485814113 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fea48109150 msgr2=0x7fea481a5cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:28:38.372 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:38.369+0000 7fea4fc4f640 1 --2- 172.21.15.19:0/3485814113 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fea48109150 0x7fea481a5cd0 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7fea38031440 tx=0x7fea380045e0 comp rx=0 tx=0).stop 2024-09-10T22:28:38.372 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:38.369+0000 7fea4fc4f640 1 -- 172.21.15.19:0/3485814113 shutdown_connections 2024-09-10T22:28:38.372 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:38.369+0000 7fea4fc4f640 1 --2- 172.21.15.19:0/3485814113 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7fea340b5360 0x7fea340b7820 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:28:38.372 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:38.369+0000 7fea4fc4f640 1 --2- 172.21.15.19:0/3485814113 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fea4810ed60 0x7fea4810f210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:28:38.372 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:38.369+0000 7fea4fc4f640 1 --2- 172.21.15.19:0/3485814113 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fea48109150 0x7fea481a5cd0 unknown :-1 s=CLOSED pgs=510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:28:38.372 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:38.369+0000 7fea4fc4f640 1 --2- 172.21.15.19:0/3485814113 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fea48102dc0 0x7fea481a5790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:28:38.373 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:38.369+0000 7fea4fc4f640 1 -- 172.21.15.19:0/3485814113 >> 172.21.15.19:0/3485814113 conn(0x7fea480fe870 msgr2=0x7fea480ff210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:28:38.373 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:38.369+0000 7fea4fc4f640 1 -- 172.21.15.19:0/3485814113 shutdown_connections 2024-09-10T22:28:38.373 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:38.369+0000 7fea4fc4f640 1 -- 172.21.15.19:0/3485814113 wait complete. 2024-09-10T22:28:39.209 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:28:38 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T22:28:39.209 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:28:38 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T22:28:39.209 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:28:38 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:28:39.209 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:28:38 smithi019 ceph-mon[31375]: scrub queued for path: / 2024-09-10T22:28:39.209 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:28:38 smithi019 ceph-mon[31375]: scrub summary: idle+waiting paths [/] 2024-09-10T22:28:39.209 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:28:38 smithi019 ceph-mon[31375]: scrub summary: active paths [/] 2024-09-10T22:28:39.209 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:28:38 smithi019 ceph-mon[31375]: scrub summary: active paths [/] 2024-09-10T22:28:39.209 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:28:38 smithi019 ceph-mon[31375]: scrub summary: idle+waiting paths [/] 2024-09-10T22:28:39.360 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:28:38 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T22:28:39.360 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:28:38 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T22:28:39.360 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:28:38 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:28:39.360 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:28:38 smithi135 ceph-mon[34789]: scrub queued for path: / 2024-09-10T22:28:39.361 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:28:38 smithi135 ceph-mon[34789]: scrub summary: idle+waiting paths [/] 2024-09-10T22:28:39.361 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:28:38 smithi135 ceph-mon[34789]: scrub summary: active paths [/] 2024-09-10T22:28:39.361 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:28:38 smithi135 ceph-mon[34789]: scrub summary: active paths [/] 2024-09-10T22:28:39.361 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:28:38 smithi135 ceph-mon[34789]: scrub summary: idle+waiting paths [/] 2024-09-10T22:28:39.375 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:28:38 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T22:28:39.375 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:28:38 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T22:28:39.375 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:28:38 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:28:39.375 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:28:38 smithi138 ceph-mon[35236]: scrub queued for path: / 2024-09-10T22:28:39.375 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:28:38 smithi138 ceph-mon[35236]: scrub summary: idle+waiting paths [/] 2024-09-10T22:28:39.375 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:28:38 smithi138 ceph-mon[35236]: scrub summary: active paths [/] 2024-09-10T22:28:39.375 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:28:38 smithi138 ceph-mon[35236]: scrub summary: active paths [/] 2024-09-10T22:28:39.375 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:28:38 smithi138 ceph-mon[35236]: scrub summary: idle+waiting paths [/] 2024-09-10T22:28:39.719 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 22997a4c-6fc2-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-10T22:28:40.045 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/22997a4c-6fc2-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T22:28:40.208 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:28:39 smithi019 ceph-mon[31375]: pgmap v414: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 892 KiB/s rd, 338 MiB/s wr, 688 op/s 2024-09-10T22:28:40.209 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:28:39 smithi019 ceph-mon[31375]: scrub summary: idle+waiting paths [/] 2024-09-10T22:28:40.359 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:28:39 smithi135 ceph-mon[34789]: pgmap v414: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 892 KiB/s rd, 338 MiB/s wr, 688 op/s 2024-09-10T22:28:40.360 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:28:39 smithi135 ceph-mon[34789]: scrub summary: idle+waiting paths [/] 2024-09-10T22:28:40.375 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:28:39 smithi138 ceph-mon[35236]: pgmap v414: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 892 KiB/s rd, 338 MiB/s wr, 688 op/s 2024-09-10T22:28:40.375 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:28:39 smithi138 ceph-mon[35236]: scrub summary: idle+waiting paths [/] 2024-09-10T22:28:40.983 INFO:teuthology.orchestra.run.smithi019.stdout:{ 2024-09-10T22:28:40.984 INFO:teuthology.orchestra.run.smithi019.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-10T22:28:40.984 INFO:teuthology.orchestra.run.smithi019.stdout: "scrubs": { 2024-09-10T22:28:40.984 INFO:teuthology.orchestra.run.smithi019.stdout: "eb518e3c-a71e-4f32-9ca0-ae88930ca218": { 2024-09-10T22:28:40.984 INFO:teuthology.orchestra.run.smithi019.stdout: "path": "/", 2024-09-10T22:28:40.984 INFO:teuthology.orchestra.run.smithi019.stdout: "tag": "eb518e3c-a71e-4f32-9ca0-ae88930ca218", 2024-09-10T22:28:40.984 INFO:teuthology.orchestra.run.smithi019.stdout: "options": "recursive,force" 2024-09-10T22:28:40.984 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-10T22:28:40.984 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:28:40.984 INFO:teuthology.orchestra.run.smithi019.stdout: "scrub_stats": { 2024-09-10T22:28:40.984 INFO:teuthology.orchestra.run.smithi019.stdout: "eb518e3c-a71e-4f32-9ca0-ae88930ca218": { 2024-09-10T22:28:40.985 INFO:teuthology.orchestra.run.smithi019.stdout: "start_time": "2024-09-10T22:28:38.366352+0000", 2024-09-10T22:28:40.985 INFO:teuthology.orchestra.run.smithi019.stdout: "path": "/", 2024-09-10T22:28:40.985 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_started": 0, 2024-09-10T22:28:40.985 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_passed": 0, 2024-09-10T22:28:40.985 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_failed": 0, 2024-09-10T22:28:40.985 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_skipped": 0 2024-09-10T22:28:40.985 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:28:40.985 INFO:teuthology.orchestra.run.smithi019.stdout: "c12c2a04-dcd6-4673-a98e-93f665d3f5d7": { 2024-09-10T22:28:40.985 INFO:teuthology.orchestra.run.smithi019.stdout: "start_time": "2024-09-10T22:27:49.392329+0000", 2024-09-10T22:28:40.985 INFO:teuthology.orchestra.run.smithi019.stdout: "path": "/", 2024-09-10T22:28:40.985 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_started": 0, 2024-09-10T22:28:40.985 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_passed": 0, 2024-09-10T22:28:40.985 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_failed": 0, 2024-09-10T22:28:40.986 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_skipped": 0 2024-09-10T22:28:40.986 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:28:40.986 INFO:teuthology.orchestra.run.smithi019.stdout: "b38852c8-478a-42ef-8384-b2c55d5313a4": { 2024-09-10T22:28:40.986 INFO:teuthology.orchestra.run.smithi019.stdout: "start_time": "2024-09-10T22:27:00.320308+0000", 2024-09-10T22:28:40.986 INFO:teuthology.orchestra.run.smithi019.stdout: "path": "/", 2024-09-10T22:28:40.986 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_started": 0, 2024-09-10T22:28:40.986 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_passed": 0, 2024-09-10T22:28:40.986 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_failed": 0, 2024-09-10T22:28:40.986 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_skipped": 0 2024-09-10T22:28:40.986 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:28:40.986 INFO:teuthology.orchestra.run.smithi019.stdout: "9b6bfdee-303c-4c12-af56-dc85860d112a": { 2024-09-10T22:28:40.986 INFO:teuthology.orchestra.run.smithi019.stdout: "start_time": "2024-09-10T22:26:17.484162+0000", 2024-09-10T22:28:40.986 INFO:teuthology.orchestra.run.smithi019.stdout: "path": "/", 2024-09-10T22:28:40.986 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_started": 0, 2024-09-10T22:28:40.986 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_passed": 0, 2024-09-10T22:28:40.987 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_failed": 0, 2024-09-10T22:28:40.987 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_skipped": 0 2024-09-10T22:28:40.987 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-10T22:28:40.987 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-10T22:28:40.987 INFO:teuthology.orchestra.run.smithi019.stdout:} 2024-09-10T22:28:40.987 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:40.858+0000 7f4556053640 1 -- 172.21.15.19:0/1002852064 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f455010f420 msgr2=0x7f4550111810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:28:40.988 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:40.858+0000 7f4556053640 1 --2- 172.21.15.19:0/1002852064 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f455010f420 0x7f4550111810 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f4548009be0 tx=0x7f454802a750 comp rx=0 tx=0).stop 2024-09-10T22:28:40.988 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:40.858+0000 7f4556053640 1 -- 172.21.15.19:0/1002852064 shutdown_connections 2024-09-10T22:28:40.988 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:40.858+0000 7f4556053640 1 --2- 172.21.15.19:0/1002852064 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f455010f420 0x7f4550111810 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:28:40.988 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:40.858+0000 7f4556053640 1 --2- 172.21.15.19:0/1002852064 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f4550102190 0x7f455010eee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:28:40.988 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:40.858+0000 7f4556053640 1 --2- 172.21.15.19:0/1002852064 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4550101870 0x7f4550101c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:28:40.988 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:40.858+0000 7f4556053640 1 -- 172.21.15.19:0/1002852064 >> 172.21.15.19:0/1002852064 conn(0x7f45500fd740 msgr2=0x7f45500ffb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:28:40.988 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:40.858+0000 7f4556053640 1 -- 172.21.15.19:0/1002852064 shutdown_connections 2024-09-10T22:28:40.988 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:40.858+0000 7f4556053640 1 -- 172.21.15.19:0/1002852064 wait complete. 2024-09-10T22:28:40.988 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:40.860+0000 7f4556053640 1 Processor -- start 2024-09-10T22:28:40.988 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:40.861+0000 7f4556053640 1 -- start start 2024-09-10T22:28:40.988 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:40.862+0000 7f4556053640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4550101870 0x7f455019b450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:28:40.988 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:40.862+0000 7f4556053640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f4550102190 0x7f455019b990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:28:40.989 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:40.862+0000 7f4556053640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f455010f420 0x7f45501a0d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:28:40.989 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:40.862+0000 7f454f7fe640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4550101870 0x7f455019b450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:28:40.989 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:40.862+0000 7f454f7fe640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4550101870 0x7f455019b450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.19:50810/0 (socket says 172.21.15.19:50810) 2024-09-10T22:28:40.989 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:40.862+0000 7f454ffff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f455010f420 0x7f45501a0d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:28:40.989 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:40.862+0000 7f454ffff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f455010f420 0x7f45501a0d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:36472/0 (socket says 172.21.15.19:36472) 2024-09-10T22:28:40.989 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:40.862+0000 7f454f7fe640 1 -- 172.21.15.19:0/3004420143 learned_addr learned my addr 172.21.15.19:0/3004420143 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:28:40.989 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:40.862+0000 7f4556053640 1 -- 172.21.15.19:0/3004420143 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f4550114f80 con 0x7f455010f420 2024-09-10T22:28:40.989 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:40.862+0000 7f4556053640 1 -- 172.21.15.19:0/3004420143 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f4550114e00 con 0x7f4550101870 2024-09-10T22:28:40.989 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:40.862+0000 7f4556053640 1 -- 172.21.15.19:0/3004420143 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f4550115100 con 0x7f4550102190 2024-09-10T22:28:40.989 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:40.862+0000 7f454effd640 1 --2- 172.21.15.19:0/3004420143 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f4550102190 0x7f455019b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:28:40.989 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:40.863+0000 7f454ffff640 1 -- 172.21.15.19:0/3004420143 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f4550102190 msgr2=0x7f455019b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:28:40.989 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:40.863+0000 7f454ffff640 1 --2- 172.21.15.19:0/3004420143 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f4550102190 0x7f455019b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:28:40.990 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:40.863+0000 7f454ffff640 1 -- 172.21.15.19:0/3004420143 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4550101870 msgr2=0x7f455019b450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:28:40.990 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:40.863+0000 7f454ffff640 1 --2- 172.21.15.19:0/3004420143 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4550101870 0x7f455019b450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:28:40.990 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:40.863+0000 7f454ffff640 1 -- 172.21.15.19:0/3004420143 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f45501a1500 con 0x7f455010f420 2024-09-10T22:28:40.990 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:40.863+0000 7f454f7fe640 1 --2- 172.21.15.19:0/3004420143 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4550101870 0x7f455019b450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T22:28:40.990 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:40.863+0000 7f454effd640 1 --2- 172.21.15.19:0/3004420143 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f4550102190 0x7f455019b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T22:28:40.990 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:40.864+0000 7f454ffff640 1 --2- 172.21.15.19:0/3004420143 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f455010f420 0x7f45501a0d30 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f454802ac70 tx=0x7f4548003c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:28:40.990 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:40.864+0000 7f454cff9640 1 -- 172.21.15.19:0/3004420143 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4548041020 con 0x7f455010f420 2024-09-10T22:28:40.990 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:40.864+0000 7f454cff9640 1 -- 172.21.15.19:0/3004420143 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4548003e10 con 0x7f455010f420 2024-09-10T22:28:40.990 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:40.864+0000 7f454cff9640 1 -- 172.21.15.19:0/3004420143 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4548036040 con 0x7f455010f420 2024-09-10T22:28:40.990 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:40.864+0000 7f4556053640 1 -- 172.21.15.19:0/3004420143 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f45501a1790 con 0x7f455010f420 2024-09-10T22:28:40.990 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:40.864+0000 7f4556053640 1 -- 172.21.15.19:0/3004420143 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f45501a1b60 con 0x7f455010f420 2024-09-10T22:28:40.991 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:40.870+0000 7f4558428740 1 Processor -- start 2024-09-10T22:28:40.991 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:40.871+0000 7f454cff9640 1 -- 172.21.15.19:0/3004420143 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 18) ==== 153250+0+0 (secure 0 0 0) 0x7f4548030970 con 0x7f455010f420 2024-09-10T22:28:40.991 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:40.874+0000 7f4558428740 1 -- start start 2024-09-10T22:28:40.991 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:40.874+0000 7f454cff9640 1 --2- 172.21.15.19:0/3004420143 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f453c0b52e0 0x7f453c0b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:28:40.991 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:40.874+0000 7f4558428740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5613b262e8b0 0x5613b262ec90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:28:40.991 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:40.874+0000 7f4558428740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5613b262f1d0 0x5613b263ac20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:28:40.991 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:40.874+0000 7f4558428740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5613b263b160 0x5613b263d550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:28:40.992 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:40.874+0000 7f4558428740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x5613b259ce50 con 0x5613b263b160 2024-09-10T22:28:40.992 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:40.874+0000 7f4558428740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x5613b258c280 con 0x5613b262f1d0 2024-09-10T22:28:40.992 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:40.874+0000 7f4558428740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x5613b2590090 con 0x5613b262e8b0 2024-09-10T22:28:40.992 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:40.874+0000 7f454cff9640 1 -- 172.21.15.19:0/3004420143 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8327+0+0 (secure 0 0 0) 0x7f4548106980 con 0x7f455010f420 2024-09-10T22:28:40.992 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:40.875+0000 7f454effd640 1 --2- 172.21.15.19:0/3004420143 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f453c0b52e0 0x7f453c0b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:28:40.992 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:40.875+0000 7f454f7fe640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5613b262e8b0 0x5613b262ec90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:28:40.992 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:40.875+0000 7f454ffff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5613b263b160 0x5613b263d550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:28:40.992 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:40.875+0000 7f454ffff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5613b263b160 0x5613b263d550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:36488/0 (socket says 172.21.15.19:36488) 2024-09-10T22:28:40.992 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:40.875+0000 7f454ffff640 1 -- 172.21.15.19:0/1687958928 learned_addr learned my addr 172.21.15.19:0/1687958928 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:28:40.992 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:40.876+0000 7f454effd640 1 --2- 172.21.15.19:0/1687958928 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5613b262f1d0 0x5613b263ac20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:28:40.992 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:40.876+0000 7f454effd640 1 --2- 172.21.15.19:0/3004420143 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f453c0b52e0 0x7f453c0b77a0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f45500fffc0 tx=0x7f4540005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:28:40.992 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:40.876+0000 7f454ffff640 1 -- 172.21.15.19:0/1687958928 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5613b262e8b0 msgr2=0x5613b262ec90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:28:40.993 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:40.876+0000 7f454ffff640 1 --2- 172.21.15.19:0/1687958928 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5613b262e8b0 0x5613b262ec90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:28:40.993 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:40.876+0000 7f454ffff640 1 -- 172.21.15.19:0/1687958928 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5613b262f1d0 msgr2=0x5613b263ac20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:28:40.993 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:40.876+0000 7f454ffff640 1 --2- 172.21.15.19:0/1687958928 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5613b262f1d0 0x5613b263ac20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:28:40.993 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:40.876+0000 7f454ffff640 1 -- 172.21.15.19:0/1687958928 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5613b22ea650 con 0x5613b263b160 2024-09-10T22:28:40.993 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:40.876+0000 7f454effd640 1 --2- 172.21.15.19:0/1687958928 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5613b262f1d0 0x5613b263ac20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T22:28:40.993 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:40.876+0000 7f454ffff640 1 --2- 172.21.15.19:0/1687958928 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5613b263b160 0x5613b263d550 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f45480ccde0 tx=0x7f454802a750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f0b8c130a0477293 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:28:40.993 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:40.877+0000 7f4545ffb640 1 -- 172.21.15.19:0/1687958928 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45480cd7e0 con 0x5613b263b160 2024-09-10T22:28:40.993 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:40.877+0000 7f4545ffb640 1 -- 172.21.15.19:0/1687958928 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f45480cd0e0 con 0x5613b263b160 2024-09-10T22:28:40.993 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:40.877+0000 7f4545ffb640 1 -- 172.21.15.19:0/1687958928 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45480c9440 con 0x5613b263b160 2024-09-10T22:28:40.993 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:40.878+0000 7f4558428740 1 -- 172.21.15.19:0/1687958928 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5613b263b160 msgr2=0x5613b263d550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:28:40.994 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:40.878+0000 7f4558428740 1 --2- 172.21.15.19:0/1687958928 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5613b263b160 0x5613b263d550 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f45480ccde0 tx=0x7f454802a750 comp rx=0 tx=0).stop 2024-09-10T22:28:40.994 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:40.878+0000 7f4558428740 1 -- 172.21.15.19:0/1687958928 shutdown_connections 2024-09-10T22:28:40.994 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:40.878+0000 7f4558428740 1 --2- 172.21.15.19:0/1687958928 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5613b263b160 0x5613b263d550 unknown :-1 s=CLOSED pgs=514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:28:40.994 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:40.878+0000 7f4558428740 1 --2- 172.21.15.19:0/1687958928 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5613b262f1d0 0x5613b263ac20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:28:40.994 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:40.878+0000 7f4558428740 1 --2- 172.21.15.19:0/1687958928 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5613b262e8b0 0x5613b262ec90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:28:40.994 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:40.878+0000 7f4558428740 1 -- 172.21.15.19:0/1687958928 >> 172.21.15.19:0/1687958928 conn(0x5613b262c6e0 msgr2=0x5613b262d880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:28:40.994 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:40.878+0000 7f4558428740 1 -- 172.21.15.19:0/1687958928 shutdown_connections 2024-09-10T22:28:40.994 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:40.879+0000 7f4558428740 1 -- 172.21.15.19:0/1687958928 wait complete. 2024-09-10T22:28:40.994 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:40.879+0000 7f4558428740 1 -- start start 2024-09-10T22:28:40.994 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:40.879+0000 7f4558428740 1 Processor -- start 2024-09-10T22:28:40.994 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:40.880+0000 7f4558428740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5613b262e8b0 0x5613b263aa90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:28:40.994 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:40.880+0000 7f4558428740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5613b262f1d0 0x5613b2637ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:28:40.994 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:40.880+0000 7f4558428740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5613b263b160 0x5613b2638560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:28:40.995 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:40.880+0000 7f4558428740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x5613b23ed700 con 0x5613b262f1d0 2024-09-10T22:28:40.995 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:40.880+0000 7f4558428740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x5613b2527110 con 0x5613b262e8b0 2024-09-10T22:28:40.995 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:40.880+0000 7f4558428740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x5613b264ebb0 con 0x5613b263b160 2024-09-10T22:28:40.995 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:40.880+0000 7f454f7fe640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5613b262e8b0 0x5613b263aa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:28:40.995 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:40.880+0000 7f454ffff640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5613b263b160 0x5613b2638560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:28:40.995 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:40.880+0000 7f454f7fe640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5613b262e8b0 0x5613b263aa90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.19:50834/0 (socket says 172.21.15.19:50834) 2024-09-10T22:28:40.995 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:40.880+0000 7f454f7fe640 1 -- 172.21.15.19:0/2859942177 learned_addr learned my addr 172.21.15.19:0/2859942177 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:28:40.995 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:40.880+0000 7f454effd640 1 --2- 172.21.15.19:0/2859942177 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5613b262f1d0 0x5613b2637ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:28:40.995 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:40.881+0000 7f4558428740 10 client.0 _ll_register_callbacks cb 0x5613b2540990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T22:28:40.995 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:40.881+0000 7f454effd640 1 -- 172.21.15.19:0/2859942177 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5613b263b160 msgr2=0x5613b2638560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:28:40.995 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:40.881+0000 7f454effd640 1 --2- 172.21.15.19:0/2859942177 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5613b263b160 0x5613b2638560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:28:40.995 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:40.881+0000 7f454effd640 1 -- 172.21.15.19:0/2859942177 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5613b262e8b0 msgr2=0x5613b263aa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:28:40.995 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:40.881+0000 7f454effd640 1 --2- 172.21.15.19:0/2859942177 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5613b262e8b0 0x5613b263aa90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:28:40.996 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:40.881+0000 7f454effd640 1 -- 172.21.15.19:0/2859942177 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5613b2554c40 con 0x5613b262f1d0 2024-09-10T22:28:40.996 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:40.881+0000 7f454ffff640 1 --2- 172.21.15.19:0/2859942177 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5613b263b160 0x5613b2638560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T22:28:40.996 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:40.881+0000 7f454effd640 1 --2- 172.21.15.19:0/2859942177 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5613b262f1d0 0x5613b2637ee0 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f4540009fd0 tx=0x7f45400046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c260507af9098c6d server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:28:40.996 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:40.881+0000 7f4558428740 1 -- 172.21.15.19:0/2859942177 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f45480cd0e0 con 0x5613b262f1d0 2024-09-10T22:28:40.996 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:40.881+0000 7f452effd640 10 client.15828 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-10T22:28:40.996 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:40.882+0000 7f452effd640 1 -- 172.21.15.19:0/2859942177 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4540005220 con 0x5613b262f1d0 2024-09-10T22:28:40.996 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:40.882+0000 7f452effd640 1 -- 172.21.15.19:0/2859942177 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8327+0+0 (secure 0 0 0) 0x7f45400053c0 con 0x5613b262f1d0 2024-09-10T22:28:40.996 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:40.882+0000 7f452effd640 1 -- 172.21.15.19:0/2859942177 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f45400055c0 con 0x5613b262f1d0 2024-09-10T22:28:40.996 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:40.882+0000 7f4558428740 10 client.15828 fetch_fsmap learned FSMap version 26 2024-09-10T22:28:40.996 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:40.882+0000 7f4558428740 1 -- 172.21.15.19:0/2859942177 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({fsmap=26}) -- 0x5613b265a3a0 con 0x5613b262f1d0 2024-09-10T22:28:40.996 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:40.882+0000 7f452effd640 1 -- 172.21.15.19:0/2859942177 <== mon.0 v2:172.21.15.19:3300/0 4 ==== fsmap(e 26) ==== 8350+0+0 (secure 0 0 0) 0x7f454000f040 con 0x5613b262f1d0 2024-09-10T22:28:40.996 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:40.882+0000 7f4558428740 10 client.15828 fetch_fsmap finished waiting for FSMap version 26 2024-09-10T22:28:40.996 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:40.882+0000 7f4558428740 10 client.15828 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-10T22:28:40.996 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:40.882+0000 7f4558428740 20 client.15828 populate_metadata read hostname 'smithi019' 2024-09-10T22:28:40.997 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:40.882+0000 7f4558428740 1 --2- 172.21.15.19:0/2859942177 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x5613b265b750 0x5613b265dbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:28:40.997 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:40.882+0000 7f4558428740 4 client.15828 mds_command: new command op to 24581 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T22:28:40.997 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:40.882+0000 7f4558428740 1 -- 172.21.15.19:0/2859942177 --> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5613b259eda0 con 0x5613b265b750 2024-09-10T22:28:40.997 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:40.883+0000 7f454f7fe640 1 --2- 172.21.15.19:0/2859942177 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x5613b265b750 0x5613b265dbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:28:40.997 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:40.883+0000 7f452effd640 10 client.15828 ms_handle_connect on v2:172.21.15.135:6838/1254769802 2024-09-10T22:28:40.997 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:40.883+0000 7f454f7fe640 1 --2- 172.21.15.19:0/2859942177 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x5613b265b750 0x5613b265dbc0 crc :-1 s=READY pgs=70 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e1c5b819705fbbf2 server_cookie=c8d5b1ee67d5d8f0 in_seq=0 out_seq=0 2024-09-10T22:28:40.997 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:40.884+0000 7f452effd640 1 -- 172.21.15.19:0/2859942177 <== mds.0 v2:172.21.15.135:6838/1254769802 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5613b259eda0 con 0x5613b265b750 2024-09-10T22:28:40.997 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:40.884+0000 7f452effd640 10 client.15828 handle_command_reply: tid=0 2024-09-10T22:28:40.997 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:40.884+0000 7f4558428740 1 client.15828 shutdown 2024-09-10T22:28:40.997 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:40.885+0000 7f4558428740 1 -- 172.21.15.19:0/2859942177 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5613b262f1d0 msgr2=0x5613b2637ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:28:40.997 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:40.885+0000 7f4558428740 1 --2- 172.21.15.19:0/2859942177 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5613b262f1d0 0x5613b2637ee0 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f4540009fd0 tx=0x7f45400046c0 comp rx=0 tx=0).stop 2024-09-10T22:28:40.997 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:40.885+0000 7f4558428740 1 -- 172.21.15.19:0/2859942177 shutdown_connections 2024-09-10T22:28:40.998 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:40.885+0000 7f4558428740 1 --2- 172.21.15.19:0/2859942177 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x5613b265b750 0x5613b265dbc0 crc :-1 s=READY pgs=70 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:28:40.998 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:40.885+0000 7f452effd640 0 client.15828 ms_handle_reset on v2:172.21.15.135:6838/1254769802 2024-09-10T22:28:40.998 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:40.885+0000 7f4558428740 1 --2- 172.21.15.19:0/2859942177 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5613b263b160 0x5613b2638560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:28:40.998 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:40.885+0000 7f4558428740 1 --2- 172.21.15.19:0/2859942177 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5613b262f1d0 0x5613b2637ee0 unknown :-1 s=CLOSED pgs=515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:28:40.998 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:40.885+0000 7f4558428740 1 --2- 172.21.15.19:0/2859942177 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5613b262e8b0 0x5613b263aa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:28:40.998 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:40.885+0000 7f4558428740 1 -- 172.21.15.19:0/2859942177 >> 172.21.15.19:0/2859942177 conn(0x5613b262c6e0 msgr2=0x5613b2632250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:28:40.998 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:40.885+0000 7f4558428740 1 -- 172.21.15.19:0/2859942177 shutdown_connections 2024-09-10T22:28:40.998 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:40.885+0000 7f4558428740 1 -- 172.21.15.19:0/2859942177 wait complete. 2024-09-10T22:28:40.998 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:40.886+0000 7f4558428740 20 client.15828 trim_cache size 0 max 16384 2024-09-10T22:28:40.998 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:40.926+0000 7f4558428740 1 Processor -- start 2024-09-10T22:28:40.998 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:40.926+0000 7f4558428740 1 -- start start 2024-09-10T22:28:40.998 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:40.927+0000 7f4558428740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5613b262e8b0 0x5613b2657da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:28:40.998 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:40.927+0000 7f4558428740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5613b262f1d0 0x5613b262d780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:28:40.999 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:40.927+0000 7f454f7fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5613b262e8b0 0x5613b2657da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:28:40.999 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:40.927+0000 7f454f7fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5613b262e8b0 0x5613b2657da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:36506/0 (socket says 172.21.15.19:36506) 2024-09-10T22:28:40.999 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:40.927+0000 7f454f7fe640 1 -- 172.21.15.19:0/2193793268 learned_addr learned my addr 172.21.15.19:0/2193793268 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:28:40.999 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:40.927+0000 7f4558428740 1 --2- 172.21.15.19:0/2193793268 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5613b263b160 0x5613b2636760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:28:40.999 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:40.927+0000 7f4558428740 1 -- 172.21.15.19:0/2193793268 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f4530010e70 con 0x5613b262e8b0 2024-09-10T22:28:40.999 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:40.927+0000 7f4558428740 1 -- 172.21.15.19:0/2193793268 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f453000e740 con 0x5613b263b160 2024-09-10T22:28:40.999 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:40.927+0000 7f4558428740 1 -- 172.21.15.19:0/2193793268 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f453000c590 con 0x5613b262f1d0 2024-09-10T22:28:40.999 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:40.928+0000 7f454f7fe640 1 -- 172.21.15.19:0/2193793268 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5613b262f1d0 msgr2=0x5613b262d780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:28:40.999 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:40.928+0000 7f454f7fe640 1 --2- 172.21.15.19:0/2193793268 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5613b262f1d0 0x5613b262d780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:28:40.999 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:40.928+0000 7f454f7fe640 1 -- 172.21.15.19:0/2193793268 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5613b263b160 msgr2=0x5613b2636760 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-10T22:28:40.999 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:40.928+0000 7f454f7fe640 1 --2- 172.21.15.19:0/2193793268 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5613b263b160 0x5613b2636760 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:28:40.999 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:40.928+0000 7f454f7fe640 1 -- 172.21.15.19:0/2193793268 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5613b26388d0 con 0x5613b262e8b0 2024-09-10T22:28:40.999 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:40.929+0000 7f454f7fe640 1 --2- 172.21.15.19:0/2193793268 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5613b262e8b0 0x5613b2657da0 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f4538009990 tx=0x7f4538009260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5968284224b70d08 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:28:40.999 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:40.929+0000 7f45457fa640 1 -- 172.21.15.19:0/2193793268 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f453802a070 con 0x5613b262e8b0 2024-09-10T22:28:41.000 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:40.929+0000 7f45457fa640 1 -- 172.21.15.19:0/2193793268 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4538004310 con 0x5613b262e8b0 2024-09-10T22:28:41.000 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:40.929+0000 7f45457fa640 1 -- 172.21.15.19:0/2193793268 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f453801f8c0 con 0x5613b262e8b0 2024-09-10T22:28:41.000 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:40.931+0000 7f4558428740 1 -- 172.21.15.19:0/2193793268 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5613b262e8b0 msgr2=0x5613b2657da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:28:41.000 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:40.931+0000 7f4558428740 1 --2- 172.21.15.19:0/2193793268 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5613b262e8b0 0x5613b2657da0 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f4538009990 tx=0x7f4538009260 comp rx=0 tx=0).stop 2024-09-10T22:28:41.000 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:40.931+0000 7f4558428740 1 -- 172.21.15.19:0/2193793268 shutdown_connections 2024-09-10T22:28:41.000 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:40.931+0000 7f4558428740 1 --2- 172.21.15.19:0/2193793268 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5613b263b160 0x5613b2636760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:28:41.000 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:40.931+0000 7f4558428740 1 --2- 172.21.15.19:0/2193793268 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5613b262f1d0 0x5613b262d780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:28:41.000 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:40.931+0000 7f4558428740 1 --2- 172.21.15.19:0/2193793268 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5613b262e8b0 0x5613b2657da0 unknown :-1 s=CLOSED pgs=516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:28:41.000 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:40.931+0000 7f4558428740 1 -- 172.21.15.19:0/2193793268 >> 172.21.15.19:0/2193793268 conn(0x5613b262c6e0 msgr2=0x5613b261efa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:28:41.000 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:40.931+0000 7f4558428740 1 -- 172.21.15.19:0/2193793268 shutdown_connections 2024-09-10T22:28:41.000 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:40.931+0000 7f4558428740 1 -- 172.21.15.19:0/2193793268 wait complete. 2024-09-10T22:28:41.000 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:40.932+0000 7f4558428740 1 -- start start 2024-09-10T22:28:41.000 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:40.932+0000 7f4558428740 1 Processor -- start 2024-09-10T22:28:41.000 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:40.933+0000 7f4558428740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5613b262e8b0 0x5613b2653ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:28:41.001 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:40.933+0000 7f4558428740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5613b262f1d0 0x5613b2654530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:28:41.001 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:40.933+0000 7f4558428740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5613b263b160 0x5613b264edc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:28:41.001 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:40.933+0000 7f4558428740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f453000cc00 con 0x5613b262e8b0 2024-09-10T22:28:41.001 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:40.933+0000 7f4558428740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f453000e070 con 0x5613b263b160 2024-09-10T22:28:41.001 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:40.933+0000 7f4558428740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f453000d2d0 con 0x5613b262f1d0 2024-09-10T22:28:41.001 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:40.933+0000 7f4558428740 10 client.0 _ll_register_callbacks cb 0x7f4540016070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T22:28:41.001 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:40.933+0000 7f454f7fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5613b262e8b0 0x5613b2653ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:28:41.001 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:40.933+0000 7f454f7fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5613b262e8b0 0x5613b2653ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:36510/0 (socket says 172.21.15.19:36510) 2024-09-10T22:28:41.001 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:40.933+0000 7f454f7fe640 1 -- 172.21.15.19:0/1112311431 learned_addr learned my addr 172.21.15.19:0/1112311431 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:28:41.001 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:40.933+0000 7f454effd640 1 --2- 172.21.15.19:0/1112311431 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5613b262f1d0 0x5613b2654530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:28:41.002 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:40.934+0000 7f454f7fe640 1 -- 172.21.15.19:0/1112311431 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5613b262f1d0 msgr2=0x5613b2654530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:28:41.002 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:40.934+0000 7f454f7fe640 1 --2- 172.21.15.19:0/1112311431 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5613b262f1d0 0x5613b2654530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:28:41.002 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:40.934+0000 7f454f7fe640 1 -- 172.21.15.19:0/1112311431 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5613b263b160 msgr2=0x5613b264edc0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-10T22:28:41.002 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:40.934+0000 7f454f7fe640 1 --2- 172.21.15.19:0/1112311431 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5613b263b160 0x5613b264edc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:28:41.002 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:40.934+0000 7f454f7fe640 1 -- 172.21.15.19:0/1112311431 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5613b264f500 con 0x5613b262e8b0 2024-09-10T22:28:41.002 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:40.934+0000 7f454f7fe640 1 --2- 172.21.15.19:0/1112311431 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5613b262e8b0 0x5613b2653ff0 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f4538004570 tx=0x7f45380045a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ced85cff82250504 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:28:41.002 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:40.934+0000 7f452effd640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-10T22:28:41.002 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:40.934+0000 7f452effd640 1 -- 172.21.15.19:0/1112311431 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4538033020 con 0x5613b262e8b0 2024-09-10T22:28:41.002 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:40.934+0000 7f452effd640 1 -- 172.21.15.19:0/1112311431 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8327+0+0 (secure 0 0 0) 0x7f4538005240 con 0x5613b262e8b0 2024-09-10T22:28:41.002 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:40.934+0000 7f4558428740 1 -- 172.21.15.19:0/1112311431 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4538004310 con 0x5613b262e8b0 2024-09-10T22:28:41.003 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:40.935+0000 7f452effd640 1 -- 172.21.15.19:0/1112311431 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f453802a040 con 0x5613b262e8b0 2024-09-10T22:28:41.003 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:40.936+0000 7f4558428740 10 client.15834 fetch_fsmap learned FSMap version 26 2024-09-10T22:28:41.003 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:40.936+0000 7f4558428740 1 -- 172.21.15.19:0/1112311431 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x5613b26c90e0 con 0x5613b262e8b0 2024-09-10T22:28:41.003 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:40.936+0000 7f452effd640 1 -- 172.21.15.19:0/1112311431 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4538004310 con 0x5613b262e8b0 2024-09-10T22:28:41.003 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:40.936+0000 7f452effd640 1 -- 172.21.15.19:0/1112311431 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 26) ==== 8350+0+0 (secure 0 0 0) 0x7f453801f740 con 0x5613b262e8b0 2024-09-10T22:28:41.003 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:40.936+0000 7f4558428740 10 client.15834 fetch_fsmap finished waiting for FSMap version 26 2024-09-10T22:28:41.003 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:40.936+0000 7f4558428740 10 client.15834 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-10T22:28:41.003 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:40.936+0000 7f4558428740 20 client.15834 populate_metadata read hostname 'smithi019' 2024-09-10T22:28:41.003 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:40.936+0000 7f4558428740 1 --2- 172.21.15.19:0/1112311431 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x5613b265b750 0x5613b26cb7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:28:41.003 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:40.937+0000 7f4558428740 4 client.15834 mds_command: new command op to 24581 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-10T22:28:41.003 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:40.937+0000 7f4558428740 1 -- 172.21.15.19:0/1112311431 --> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] -- command(tid 0: {"prefix": "scrub status"}) -- 0x5613b259a850 con 0x5613b265b750 2024-09-10T22:28:41.003 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:40.938+0000 7f454effd640 1 --2- 172.21.15.19:0/1112311431 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x5613b265b750 0x5613b26cb7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:28:41.003 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:40.940+0000 7f452effd640 10 client.15834 ms_handle_connect on v2:172.21.15.135:6838/1254769802 2024-09-10T22:28:41.003 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:40.940+0000 7f454effd640 1 --2- 172.21.15.19:0/1112311431 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x5613b265b750 0x5613b26cb7a0 crc :-1 s=READY pgs=71 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=de830b47e0aa8f8b server_cookie=6d846793e948655d in_seq=0 out_seq=0 2024-09-10T22:28:41.004 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:40.941+0000 7f452effd640 1 -- 172.21.15.19:0/1112311431 <== mds.0 v2:172.21.15.135:6838/1254769802 1 ==== command_reply(tid 0: 0 ) ==== 8+0+1422 (crc 0 0 0) 0x5613b259a850 con 0x5613b265b750 2024-09-10T22:28:41.004 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:40.941+0000 7f452effd640 10 client.15834 handle_command_reply: tid=0 2024-09-10T22:28:41.004 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:40.941+0000 7f4558428740 1 client.15834 shutdown 2024-09-10T22:28:41.004 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:40.941+0000 7f4558428740 1 -- 172.21.15.19:0/1112311431 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5613b262e8b0 msgr2=0x5613b2653ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:28:41.004 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:40.941+0000 7f4558428740 1 --2- 172.21.15.19:0/1112311431 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5613b262e8b0 0x5613b2653ff0 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f4538004570 tx=0x7f45380045a0 comp rx=0 tx=0).stop 2024-09-10T22:28:41.004 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:40.942+0000 7f4558428740 1 -- 172.21.15.19:0/1112311431 shutdown_connections 2024-09-10T22:28:41.004 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:40.942+0000 7f4558428740 1 --2- 172.21.15.19:0/1112311431 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5613b263b160 0x5613b264edc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:28:41.004 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:40.942+0000 7f4558428740 1 --2- 172.21.15.19:0/1112311431 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x5613b265b750 0x5613b26cb7a0 crc :-1 s=READY pgs=71 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:28:41.004 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:40.942+0000 7f4558428740 1 --2- 172.21.15.19:0/1112311431 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5613b262f1d0 0x5613b2654530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:28:41.004 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:40.942+0000 7f4558428740 1 --2- 172.21.15.19:0/1112311431 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5613b262e8b0 0x5613b2653ff0 unknown :-1 s=CLOSED pgs=517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:28:41.004 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:40.942+0000 7f452effd640 0 client.15834 ms_handle_reset on v2:172.21.15.135:6838/1254769802 2024-09-10T22:28:41.004 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:40.942+0000 7f4558428740 1 -- 172.21.15.19:0/1112311431 >> 172.21.15.19:0/1112311431 conn(0x5613b262c6e0 msgr2=0x5613b262d780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:28:41.004 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:40.942+0000 7f4558428740 1 -- 172.21.15.19:0/1112311431 shutdown_connections 2024-09-10T22:28:41.005 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:40.942+0000 7f4558428740 1 -- 172.21.15.19:0/1112311431 wait complete. 2024-09-10T22:28:41.005 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:40.943+0000 7f4558428740 20 client.15834 trim_cache size 0 max 16384 2024-09-10T22:28:41.005 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:40.944+0000 7f4556053640 1 -- 172.21.15.19:0/3004420143 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f453c0b52e0 msgr2=0x7f453c0b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:28:41.005 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:40.944+0000 7f4556053640 1 --2- 172.21.15.19:0/3004420143 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f453c0b52e0 0x7f453c0b77a0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f45500fffc0 tx=0x7f4540005f90 comp rx=0 tx=0).stop 2024-09-10T22:28:41.005 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:40.944+0000 7f4556053640 1 -- 172.21.15.19:0/3004420143 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f455010f420 msgr2=0x7f45501a0d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:28:41.005 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:40.944+0000 7f4556053640 1 --2- 172.21.15.19:0/3004420143 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f455010f420 0x7f45501a0d30 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f454802ac70 tx=0x7f4548003c20 comp rx=0 tx=0).stop 2024-09-10T22:28:41.005 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:40.944+0000 7f4556053640 1 -- 172.21.15.19:0/3004420143 shutdown_connections 2024-09-10T22:28:41.005 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:40.944+0000 7f4556053640 1 --2- 172.21.15.19:0/3004420143 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f453c0b52e0 0x7f453c0b77a0 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:28:41.005 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:40.944+0000 7f4556053640 1 --2- 172.21.15.19:0/3004420143 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f455010f420 0x7f45501a0d30 unknown :-1 s=CLOSED pgs=513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:28:41.005 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:40.944+0000 7f4556053640 1 --2- 172.21.15.19:0/3004420143 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f4550102190 0x7f455019b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:28:41.006 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:40.944+0000 7f4556053640 1 --2- 172.21.15.19:0/3004420143 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4550101870 0x7f455019b450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:28:41.006 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:40.944+0000 7f4556053640 1 -- 172.21.15.19:0/3004420143 >> 172.21.15.19:0/3004420143 conn(0x7f45500fd740 msgr2=0x7f4550111610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:28:41.006 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:40.944+0000 7f4556053640 1 -- 172.21.15.19:0/3004420143 shutdown_connections 2024-09-10T22:28:41.006 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:28:40.944+0000 7f4556053640 1 -- 172.21.15.19:0/3004420143 wait complete. 2024-09-10T22:28:42.209 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:28:41 smithi019 ceph-mon[31375]: pgmap v415: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 960 KiB/s rd, 416 MiB/s wr, 693 op/s 2024-09-10T22:28:42.360 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:28:41 smithi135 ceph-mon[34789]: pgmap v415: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 960 KiB/s rd, 416 MiB/s wr, 693 op/s 2024-09-10T22:28:42.361 INFO:tasks.cephfs.filesystem:scrub status for tag:eb518e3c-a71e-4f32-9ca0-ae88930ca218 - {'path': '/', 'tag': 'eb518e3c-a71e-4f32-9ca0-ae88930ca218', 'options': 'recursive,force'} 2024-09-10T22:28:42.374 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:28:41 smithi138 ceph-mon[35236]: pgmap v415: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 960 KiB/s rd, 416 MiB/s wr, 693 op/s 2024-09-10T22:28:44.359 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:28:44 smithi135 ceph-mon[34789]: pgmap v416: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 919 KiB/s rd, 357 MiB/s wr, 323 op/s 2024-09-10T22:28:44.374 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:28:44 smithi138 ceph-mon[35236]: pgmap v416: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 919 KiB/s rd, 357 MiB/s wr, 323 op/s 2024-09-10T22:28:44.458 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:28:44 smithi019 ceph-mon[31375]: pgmap v416: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 919 KiB/s rd, 357 MiB/s wr, 323 op/s 2024-09-10T22:28:46.359 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:28:46 smithi135 ceph-mon[34789]: pgmap v417: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 918 KiB/s rd, 366 MiB/s wr, 149 op/s 2024-09-10T22:28:46.375 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:28:46 smithi138 ceph-mon[35236]: pgmap v417: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 918 KiB/s rd, 366 MiB/s wr, 149 op/s 2024-09-10T22:28:46.458 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:28:46 smithi019 ceph-mon[31375]: pgmap v417: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 918 KiB/s rd, 366 MiB/s wr, 149 op/s 2024-09-10T22:28:47.581 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:47.577+0000 7fade00ef640 1 -- 172.21.15.19:0/951944501 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fadd806b2e0 msgr2=0x7fadd81079b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:28:47.581 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:47.577+0000 7fade00ef640 1 --2- 172.21.15.19:0/951944501 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fadd806b2e0 0x7fadd81079b0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fadd4009900 tx=0x7fadd402a480 comp rx=0 tx=0).stop 2024-09-10T22:28:47.581 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:47.577+0000 7fade00ef640 1 -- 172.21.15.19:0/951944501 shutdown_connections 2024-09-10T22:28:47.581 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:47.577+0000 7fade00ef640 1 --2- 172.21.15.19:0/951944501 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fadd810a8a0 0x7fadd810cd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:28:47.581 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:47.577+0000 7fade00ef640 1 --2- 172.21.15.19:0/951944501 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fadd8107ef0 0x7fadd810a2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:28:47.581 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:47.577+0000 7fade00ef640 1 --2- 172.21.15.19:0/951944501 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fadd806b2e0 0x7fadd81079b0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:28:47.581 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:47.577+0000 7fade00ef640 1 -- 172.21.15.19:0/951944501 >> 172.21.15.19:0/951944501 conn(0x7fadd80fd140 msgr2=0x7fadd80ff560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:28:47.581 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:47.578+0000 7fade00ef640 1 -- 172.21.15.19:0/951944501 shutdown_connections 2024-09-10T22:28:47.582 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:47.578+0000 7fade00ef640 1 -- 172.21.15.19:0/951944501 wait complete. 2024-09-10T22:28:47.582 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:47.578+0000 7fade00ef640 1 Processor -- start 2024-09-10T22:28:47.582 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:47.578+0000 7fade00ef640 1 -- start start 2024-09-10T22:28:47.582 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:47.578+0000 7fade00ef640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fadd806b2e0 0x7fadd819afd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:28:47.582 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:47.578+0000 7fade00ef640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fadd8107ef0 0x7fadd819b620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:28:47.582 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:47.578+0000 7fade00ef640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fadd810a8a0 0x7fadd819c1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:28:47.582 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:47.578+0000 7fade00ef640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fadd8110820 con 0x7fadd8107ef0 2024-09-10T22:28:47.582 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:47.578+0000 7fade00ef640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fadd81106a0 con 0x7fadd810a8a0 2024-09-10T22:28:47.582 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:47.578+0000 7fade00ef640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7fadd81109a0 con 0x7fadd806b2e0 2024-09-10T22:28:47.582 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:47.579+0000 7faddd68a640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fadd8107ef0 0x7fadd819b620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:28:47.582 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:47.579+0000 7fadde68c640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fadd810a8a0 0x7fadd819c1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:28:47.582 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:47.579+0000 7fadde68c640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fadd810a8a0 0x7fadd819c1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.19:50318/0 (socket says 172.21.15.19:50318) 2024-09-10T22:28:47.582 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:47.579+0000 7faddd68a640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fadd8107ef0 0x7fadd819b620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:35682/0 (socket says 172.21.15.19:35682) 2024-09-10T22:28:47.583 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:47.579+0000 7fadde68c640 1 -- 172.21.15.19:0/3938145521 learned_addr learned my addr 172.21.15.19:0/3938145521 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:28:47.583 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:47.579+0000 7faddde8b640 1 --2- 172.21.15.19:0/3938145521 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fadd806b2e0 0x7fadd819afd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:28:47.583 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:47.579+0000 7fadde68c640 1 -- 172.21.15.19:0/3938145521 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fadd806b2e0 msgr2=0x7fadd819afd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:28:47.583 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:47.579+0000 7fadde68c640 1 --2- 172.21.15.19:0/3938145521 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fadd806b2e0 0x7fadd819afd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:28:47.583 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:47.579+0000 7fadde68c640 1 -- 172.21.15.19:0/3938145521 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fadd8107ef0 msgr2=0x7fadd819b620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:28:47.583 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:47.579+0000 7fadde68c640 1 --2- 172.21.15.19:0/3938145521 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fadd8107ef0 0x7fadd819b620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:28:47.583 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:47.579+0000 7fadde68c640 1 -- 172.21.15.19:0/3938145521 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fadd819caa0 con 0x7fadd810a8a0 2024-09-10T22:28:47.583 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:47.579+0000 7fadde68c640 1 --2- 172.21.15.19:0/3938145521 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fadd810a8a0 0x7fadd819c1e0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fadd000eb10 tx=0x7fadd000c2d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:28:47.583 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:47.579+0000 7fadceffd640 1 -- 172.21.15.19:0/3938145521 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fadd0004b20 con 0x7fadd810a8a0 2024-09-10T22:28:47.583 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:47.579+0000 7fadceffd640 1 -- 172.21.15.19:0/3938145521 <== mon.2 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fadd0004cc0 con 0x7fadd810a8a0 2024-09-10T22:28:47.583 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:47.579+0000 7fade00ef640 1 -- 172.21.15.19:0/3938145521 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fadd819cd90 con 0x7fadd810a8a0 2024-09-10T22:28:47.583 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:47.579+0000 7fadceffd640 1 -- 172.21.15.19:0/3938145521 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fadd0010670 con 0x7fadd810a8a0 2024-09-10T22:28:47.583 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:47.579+0000 7fade00ef640 1 -- 172.21.15.19:0/3938145521 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fadd81a3460 con 0x7fadd810a8a0 2024-09-10T22:28:47.586 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:47.582+0000 7fadceffd640 1 -- 172.21.15.19:0/3938145521 <== mon.2 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 18) ==== 153250+0+0 (secure 0 0 0) 0x7fadd0005020 con 0x7fadd810a8a0 2024-09-10T22:28:47.586 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:47.583+0000 7fade2ec1740 1 Processor -- start 2024-09-10T22:28:47.587 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:47.583+0000 7fade2ec1740 1 -- start start 2024-09-10T22:28:47.587 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:47.583+0000 7fade2ec1740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d1416f8860 0x55d1416fac50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:28:47.587 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:47.583+0000 7fade2ec1740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55d1416fb190 0x55d1416fd580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:28:47.587 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:47.583+0000 7fade2ec1740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d1416fdbd0 0x55d141700090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:28:47.587 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:47.583+0000 7fade2ec1740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x55d14166a6f0 con 0x55d1416fdbd0 2024-09-10T22:28:47.587 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:47.583+0000 7fade2ec1740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55d141659b20 con 0x55d1416f8860 2024-09-10T22:28:47.587 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:47.583+0000 7fade2ec1740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x55d14165d930 con 0x55d1416fb190 2024-09-10T22:28:47.587 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:47.583+0000 7faddd68a640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d1416f8860 0x55d1416fac50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:28:47.587 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:47.583+0000 7faddd68a640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d1416f8860 0x55d1416fac50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.19:50324/0 (socket says 172.21.15.19:50324) 2024-09-10T22:28:47.587 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:47.583+0000 7faddd68a640 1 -- 172.21.15.19:0/4194494089 learned_addr learned my addr 172.21.15.19:0/4194494089 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:28:47.587 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:47.583+0000 7faddde8b640 1 --2- 172.21.15.19:0/4194494089 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55d1416fb190 0x55d1416fd580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:28:47.587 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:47.583+0000 7faddd68a640 1 --2- 172.21.15.19:0/4194494089 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d1416fdbd0 0x55d141700090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:28:47.587 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:47.584+0000 7fadceffd640 1 --2- 172.21.15.19:0/3938145521 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7fadc40b52e0 0x7fadc40b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:28:47.588 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:47.584+0000 7faddd68a640 1 -- 172.21.15.19:0/4194494089 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55d1416fb190 msgr2=0x55d1416fd580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:28:47.588 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:47.584+0000 7faddd68a640 1 --2- 172.21.15.19:0/4194494089 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55d1416fb190 0x55d1416fd580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:28:47.588 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:47.584+0000 7faddd68a640 1 -- 172.21.15.19:0/4194494089 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d1416fdbd0 msgr2=0x55d141700090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:28:47.588 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:47.584+0000 7faddd68a640 1 --2- 172.21.15.19:0/4194494089 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d1416fdbd0 0x55d141700090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:28:47.588 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:47.584+0000 7faddd68a640 1 -- 172.21.15.19:0/4194494089 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d14161f530 con 0x55d1416f8860 2024-09-10T22:28:47.588 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:47.584+0000 7fadde68c640 1 --2- 172.21.15.19:0/3938145521 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7fadc40b52e0 0x7fadc40b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:28:47.588 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:47.584+0000 7faddd68a640 1 --2- 172.21.15.19:0/4194494089 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d1416f8860 0x55d1416fac50 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fadc80058c0 tx=0x7fadc8005850 comp rx=0 tx=0).ready entity=mon.2 client_cookie=710dc60b3a549c63 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:28:47.588 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:47.584+0000 7fadceffd640 1 -- 172.21.15.19:0/3938145521 <== mon.2 v2:172.21.15.135:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8327+0+0 (secure 0 0 0) 0x7fadd00e6190 con 0x7fadd810a8a0 2024-09-10T22:28:47.588 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:47.584+0000 7fadc3fff640 1 -- 172.21.15.19:0/4194494089 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fadc8004030 con 0x55d1416f8860 2024-09-10T22:28:47.588 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:47.584+0000 7fadc3fff640 1 -- 172.21.15.19:0/4194494089 <== mon.2 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fadc8005020 con 0x55d1416f8860 2024-09-10T22:28:47.588 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:47.584+0000 7fadc3fff640 1 -- 172.21.15.19:0/4194494089 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fadc8004c00 con 0x55d1416f8860 2024-09-10T22:28:47.588 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:47.585+0000 7fade2ec1740 1 -- 172.21.15.19:0/4194494089 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d1416f8860 msgr2=0x55d1416fac50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:28:47.589 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:47.585+0000 7fade2ec1740 1 --2- 172.21.15.19:0/4194494089 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d1416f8860 0x55d1416fac50 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fadc80058c0 tx=0x7fadc8005850 comp rx=0 tx=0).stop 2024-09-10T22:28:47.589 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:47.585+0000 7fadde68c640 1 --2- 172.21.15.19:0/3938145521 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7fadc40b52e0 0x7fadc40b77a0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fadd004c3c0 tx=0x7fadd00769c0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:28:47.589 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:47.585+0000 7fade2ec1740 1 -- 172.21.15.19:0/4194494089 shutdown_connections 2024-09-10T22:28:47.589 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:47.585+0000 7fade2ec1740 1 --2- 172.21.15.19:0/4194494089 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d1416fdbd0 0x55d141700090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:28:47.589 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:47.585+0000 7fade2ec1740 1 --2- 172.21.15.19:0/4194494089 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55d1416fb190 0x55d1416fd580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:28:47.589 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:47.585+0000 7fade2ec1740 1 --2- 172.21.15.19:0/4194494089 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d1416f8860 0x55d1416fac50 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:28:47.589 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:47.585+0000 7fade2ec1740 1 -- 172.21.15.19:0/4194494089 >> 172.21.15.19:0/4194494089 conn(0x55d1416f39b0 msgr2=0x55d1416f4740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:28:47.589 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:47.585+0000 7fade2ec1740 1 -- 172.21.15.19:0/4194494089 shutdown_connections 2024-09-10T22:28:47.589 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:47.585+0000 7fade2ec1740 1 -- 172.21.15.19:0/4194494089 wait complete. 2024-09-10T22:28:47.593 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:47.586+0000 7fade2ec1740 1 -- start start 2024-09-10T22:28:47.593 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:47.586+0000 7fade2ec1740 1 Processor -- start 2024-09-10T22:28:47.593 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:47.586+0000 7fade2ec1740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55d1416f8860 0x55d141701f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:28:47.593 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:47.586+0000 7fade2ec1740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d1416fb190 0x55d1417025f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:28:47.593 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:47.586+0000 7fade2ec1740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d1416fdbd0 0x55d1417031c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:28:47.593 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:47.586+0000 7fade2ec1740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x55d141591ab0 con 0x55d1416fb190 2024-09-10T22:28:47.594 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:47.586+0000 7fade2ec1740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55d1415ff730 con 0x55d1416fdbd0 2024-09-10T22:28:47.594 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:47.586+0000 7fade2ec1740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x55d141700bb0 con 0x55d1416f8860 2024-09-10T22:28:47.594 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:47.586+0000 7fade2ec1740 10 client.0 _ll_register_callbacks cb 0x55d1416536b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T22:28:47.594 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:47.586+0000 7faddde8b640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d1416fb190 0x55d1417025f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:28:47.594 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:47.586+0000 7faddd68a640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55d1416f8860 0x55d141701f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:28:47.594 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:47.586+0000 7faddde8b640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d1416fb190 0x55d1417025f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:35700/0 (socket says 172.21.15.19:35700) 2024-09-10T22:28:47.594 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:47.586+0000 7faddde8b640 1 -- 172.21.15.19:0/3310530917 learned_addr learned my addr 172.21.15.19:0/3310530917 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:28:47.594 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:47.586+0000 7faddd68a640 1 --2- 172.21.15.19:0/3310530917 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d1416fdbd0 0x55d1417031c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:28:47.594 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:47.587+0000 7faddd68a640 1 -- 172.21.15.19:0/3310530917 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d1416fdbd0 msgr2=0x55d1417031c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:28:47.594 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:47.587+0000 7faddd68a640 1 --2- 172.21.15.19:0/3310530917 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d1416fdbd0 0x55d1417031c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:28:47.594 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:47.587+0000 7faddd68a640 1 -- 172.21.15.19:0/3310530917 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d1416fb190 msgr2=0x55d1417025f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:28:47.594 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:47.587+0000 7faddd68a640 1 --2- 172.21.15.19:0/3310530917 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d1416fb190 0x55d1417025f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:28:47.594 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:47.587+0000 7faddd68a640 1 -- 172.21.15.19:0/3310530917 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d1413bb790 con 0x55d1416f8860 2024-09-10T22:28:47.595 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:47.587+0000 7faddde8b640 1 --2- 172.21.15.19:0/3310530917 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d1416fb190 0x55d1417025f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T22:28:47.595 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:47.587+0000 7faddd68a640 1 --2- 172.21.15.19:0/3310530917 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55d1416f8860 0x55d141701f50 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fadc801c000 tx=0x7fadc8009c70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f34e5ec1ef2875c9 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:28:47.595 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:47.587+0000 7fadc17fa640 10 client.0 ms_handle_connect on v2:172.21.15.138:3300/0 2024-09-10T22:28:47.595 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:47.587+0000 7fadc17fa640 1 -- 172.21.15.19:0/3310530917 <== mon.1 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fadc8004b00 con 0x55d1416f8860 2024-09-10T22:28:47.595 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:47.587+0000 7fadc17fa640 1 -- 172.21.15.19:0/3310530917 <== mon.1 v2:172.21.15.138:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8327+0+0 (secure 0 0 0) 0x7fadc8004ca0 con 0x55d1416f8860 2024-09-10T22:28:47.595 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:47.587+0000 7fade2ec1740 1 -- 172.21.15.19:0/3310530917 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fadc8005020 con 0x55d1416f8860 2024-09-10T22:28:47.595 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:47.587+0000 7fadc17fa640 1 -- 172.21.15.19:0/3310530917 <== mon.1 v2:172.21.15.138:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7fadc8004020 con 0x55d1416f8860 2024-09-10T22:28:47.595 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:47.587+0000 7fade2ec1740 10 client.25366 fetch_fsmap learned FSMap version 26 2024-09-10T22:28:47.595 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:47.587+0000 7fade2ec1740 1 -- 172.21.15.19:0/3310530917 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x55d141434620 con 0x55d1416f8860 2024-09-10T22:28:47.595 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:47.588+0000 7fadc17fa640 1 -- 172.21.15.19:0/3310530917 <== mon.1 v2:172.21.15.138:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fadc8005020 con 0x55d1416f8860 2024-09-10T22:28:47.595 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:47.588+0000 7fadc17fa640 1 -- 172.21.15.19:0/3310530917 <== mon.1 v2:172.21.15.138:3300/0 5 ==== fsmap(e 26) ==== 8350+0+0 (secure 0 0 0) 0x7fadc80035f0 con 0x55d1416f8860 2024-09-10T22:28:47.595 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:47.588+0000 7fade2ec1740 10 client.25366 fetch_fsmap finished waiting for FSMap version 26 2024-09-10T22:28:47.595 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:47.588+0000 7fade2ec1740 10 client.25366 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-10T22:28:47.596 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:47.588+0000 7fade2ec1740 20 client.25366 populate_metadata read hostname 'smithi019' 2024-09-10T22:28:47.596 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:47.588+0000 7fade2ec1740 1 --2- 172.21.15.19:0/3310530917 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x55d14170d5e0 0x55d14170fa10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:28:47.596 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:47.588+0000 7fade2ec1740 4 client.25366 mds_command: new command op to 24581 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T22:28:47.596 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:47.588+0000 7fade2ec1740 1 -- 172.21.15.19:0/3310530917 --> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d14166c640 con 0x55d14170d5e0 2024-09-10T22:28:47.596 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:47.588+0000 7faddde8b640 1 --2- 172.21.15.19:0/3310530917 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x55d14170d5e0 0x55d14170fa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:28:47.596 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:47.588+0000 7fadc17fa640 10 client.25366 ms_handle_connect on v2:172.21.15.135:6838/1254769802 2024-09-10T22:28:47.596 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:47.588+0000 7faddde8b640 1 --2- 172.21.15.19:0/3310530917 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x55d14170d5e0 0x55d14170fa10 crc :-1 s=READY pgs=72 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b678e80b1db37c8a server_cookie=da2ae16d01c360c8 in_seq=0 out_seq=0 2024-09-10T22:28:47.596 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:47.589+0000 7fadc17fa640 1 -- 172.21.15.19:0/3310530917 <== mds.0 v2:172.21.15.135:6838/1254769802 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55d14166c640 con 0x55d14170d5e0 2024-09-10T22:28:47.596 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:47.589+0000 7fadc17fa640 10 client.25366 handle_command_reply: tid=0 2024-09-10T22:28:47.596 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:47.589+0000 7fade2ec1740 1 client.25366 shutdown 2024-09-10T22:28:47.596 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:47.590+0000 7fade2ec1740 1 -- 172.21.15.19:0/3310530917 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55d1416f8860 msgr2=0x55d141701f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:28:47.596 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:47.590+0000 7fade2ec1740 1 --2- 172.21.15.19:0/3310530917 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55d1416f8860 0x55d141701f50 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fadc801c000 tx=0x7fadc8009c70 comp rx=0 tx=0).stop 2024-09-10T22:28:47.596 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:47.590+0000 7fade2ec1740 1 -- 172.21.15.19:0/3310530917 shutdown_connections 2024-09-10T22:28:47.597 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:47.590+0000 7fade2ec1740 1 --2- 172.21.15.19:0/3310530917 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d1416fdbd0 0x55d1417031c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:28:47.597 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:47.590+0000 7fade2ec1740 1 --2- 172.21.15.19:0/3310530917 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d1416fb190 0x55d1417025f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:28:47.597 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:47.590+0000 7fade2ec1740 1 --2- 172.21.15.19:0/3310530917 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x55d14170d5e0 0x55d14170fa10 crc :-1 s=READY pgs=72 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:28:47.597 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:47.590+0000 7fadc17fa640 0 client.25366 ms_handle_reset on v2:172.21.15.135:6838/1254769802 2024-09-10T22:28:47.597 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:47.590+0000 7fade2ec1740 1 --2- 172.21.15.19:0/3310530917 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55d1416f8860 0x55d141701f50 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:28:47.597 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:47.590+0000 7fade2ec1740 1 -- 172.21.15.19:0/3310530917 >> 172.21.15.19:0/3310530917 conn(0x55d1416f39b0 msgr2=0x55d1416f2bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:28:47.597 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:47.590+0000 7fade2ec1740 1 -- 172.21.15.19:0/3310530917 shutdown_connections 2024-09-10T22:28:47.597 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:47.590+0000 7fade2ec1740 1 -- 172.21.15.19:0/3310530917 wait complete. 2024-09-10T22:28:47.597 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:47.590+0000 7fade2ec1740 20 client.25366 trim_cache size 0 max 16384 2024-09-10T22:28:47.609 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:47.607+0000 7fade2ec1740 1 Processor -- start 2024-09-10T22:28:47.610 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:47.607+0000 7fade2ec1740 1 -- start start 2024-09-10T22:28:47.610 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:47.607+0000 7fade2ec1740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d1416f8860 0x55d1416f4920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:28:47.610 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:47.607+0000 7fade2ec1740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d1416fb190 0x55d1416fec30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:28:47.610 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:47.607+0000 7fade2ec1740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55d1416fdbd0 0x55d1416ff170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:28:47.610 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:47.607+0000 7fade2ec1740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fadd81aec20 con 0x55d1416f8860 2024-09-10T22:28:47.610 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:47.607+0000 7fade2ec1740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fadd81ac4f0 con 0x55d1416fb190 2024-09-10T22:28:47.610 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:47.607+0000 7fade2ec1740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7fadd81aa340 con 0x55d1416fdbd0 2024-09-10T22:28:47.610 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:47.607+0000 7faddd68a640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d1416f8860 0x55d1416f4920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:28:47.610 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:47.607+0000 7faddd68a640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d1416f8860 0x55d1416f4920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:35708/0 (socket says 172.21.15.19:35708) 2024-09-10T22:28:47.610 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:47.608+0000 7faddd68a640 1 -- 172.21.15.19:0/4100808658 learned_addr learned my addr 172.21.15.19:0/4100808658 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:28:47.610 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:47.608+0000 7faddd68a640 1 --2- 172.21.15.19:0/4100808658 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55d1416fdbd0 0x55d1416ff170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:28:47.611 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:47.608+0000 7faddd68a640 1 -- 172.21.15.19:0/4100808658 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55d1416fdbd0 msgr2=0x55d1416ff170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:28:47.611 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:47.608+0000 7faddd68a640 1 --2- 172.21.15.19:0/4100808658 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55d1416fdbd0 0x55d1416ff170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:28:47.611 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:47.608+0000 7faddd68a640 1 -- 172.21.15.19:0/4100808658 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d1416fb190 msgr2=0x55d1416fec30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:28:47.611 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:47.608+0000 7faddd68a640 1 --2- 172.21.15.19:0/4100808658 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d1416fb190 0x55d1416fec30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:28:47.611 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:47.608+0000 7faddd68a640 1 -- 172.21.15.19:0/4100808658 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d1416fafc0 con 0x55d1416f8860 2024-09-10T22:28:47.611 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:47.608+0000 7faddd68a640 1 --2- 172.21.15.19:0/4100808658 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d1416f8860 0x55d1416f4920 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7fadc8000c00 tx=0x7fadc8011720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5bb89251763b64bd server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:28:47.611 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:47.608+0000 7fadc37fe640 1 -- 172.21.15.19:0/4100808658 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fadc8000e60 con 0x55d1416f8860 2024-09-10T22:28:47.611 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:47.608+0000 7fadc37fe640 1 -- 172.21.15.19:0/4100808658 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fadc80056f0 con 0x55d1416f8860 2024-09-10T22:28:47.611 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:47.608+0000 7fadc37fe640 1 -- 172.21.15.19:0/4100808658 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fadc8004d40 con 0x55d1416f8860 2024-09-10T22:28:47.614 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:47.609+0000 7fade2ec1740 1 -- 172.21.15.19:0/4100808658 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d1416f8860 msgr2=0x55d1416f4920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:28:47.615 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:47.609+0000 7fade2ec1740 1 --2- 172.21.15.19:0/4100808658 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d1416f8860 0x55d1416f4920 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7fadc8000c00 tx=0x7fadc8011720 comp rx=0 tx=0).stop 2024-09-10T22:28:47.615 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:47.609+0000 7fade2ec1740 1 -- 172.21.15.19:0/4100808658 shutdown_connections 2024-09-10T22:28:47.615 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:47.609+0000 7fade2ec1740 1 --2- 172.21.15.19:0/4100808658 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55d1416fdbd0 0x55d1416ff170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:28:47.615 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:47.609+0000 7fade2ec1740 1 --2- 172.21.15.19:0/4100808658 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d1416fb190 0x55d1416fec30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:28:47.615 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:47.609+0000 7fade2ec1740 1 --2- 172.21.15.19:0/4100808658 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d1416f8860 0x55d1416f4920 unknown :-1 s=CLOSED pgs=518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:28:47.615 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:47.609+0000 7fade2ec1740 1 -- 172.21.15.19:0/4100808658 >> 172.21.15.19:0/4100808658 conn(0x55d1416f39b0 msgr2=0x55d1416f4210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:28:47.615 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:47.609+0000 7fade2ec1740 1 -- 172.21.15.19:0/4100808658 shutdown_connections 2024-09-10T22:28:47.615 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:47.609+0000 7fade2ec1740 1 -- 172.21.15.19:0/4100808658 wait complete. 2024-09-10T22:28:47.615 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:47.610+0000 7fade2ec1740 1 -- start start 2024-09-10T22:28:47.615 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:47.610+0000 7fade2ec1740 1 Processor -- start 2024-09-10T22:28:47.615 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:47.610+0000 7fade2ec1740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d1416f8860 0x55d141706a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:28:47.615 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:47.610+0000 7fade2ec1740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d1416fb190 0x55d141707120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:28:47.616 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:47.610+0000 7fade2ec1740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55d1416fdbd0 0x55d141707cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:28:47.616 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:47.610+0000 7fade2ec1740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fadd81aa9b0 con 0x55d1416fb190 2024-09-10T22:28:47.616 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:47.610+0000 7fade2ec1740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fadd81abe20 con 0x55d1416f8860 2024-09-10T22:28:47.616 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:47.610+0000 7fade2ec1740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7fadd81ab080 con 0x55d1416fdbd0 2024-09-10T22:28:47.616 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:47.610+0000 7fade2ec1740 10 client.0 _ll_register_callbacks cb 0x7fadc8009ea0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T22:28:47.616 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:47.611+0000 7faddde8b640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d1416fb190 0x55d141707120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:28:47.616 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:47.611+0000 7faddde8b640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d1416fb190 0x55d141707120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:35722/0 (socket says 172.21.15.19:35722) 2024-09-10T22:28:47.616 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:47.611+0000 7faddde8b640 1 -- 172.21.15.19:0/3471250897 learned_addr learned my addr 172.21.15.19:0/3471250897 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:28:47.616 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:47.611+0000 7faddd68a640 1 --2- 172.21.15.19:0/3471250897 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d1416f8860 0x55d141706a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:28:47.616 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:47.611+0000 7faddd68a640 1 --2- 172.21.15.19:0/3471250897 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55d1416fdbd0 0x55d141707cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:28:47.616 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:47.611+0000 7faddde8b640 1 -- 172.21.15.19:0/3471250897 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55d1416fdbd0 msgr2=0x55d141707cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:28:47.616 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:47.611+0000 7faddde8b640 1 --2- 172.21.15.19:0/3471250897 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55d1416fdbd0 0x55d141707cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:28:47.617 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:47.611+0000 7faddde8b640 1 -- 172.21.15.19:0/3471250897 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d1416f8860 msgr2=0x55d141706a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:28:47.617 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:47.611+0000 7faddde8b640 1 --2- 172.21.15.19:0/3471250897 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d1416f8860 0x55d141706a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:28:47.617 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:47.611+0000 7faddde8b640 1 -- 172.21.15.19:0/3471250897 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d141708520 con 0x55d1416fb190 2024-09-10T22:28:47.617 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:47.611+0000 7faddde8b640 1 --2- 172.21.15.19:0/3471250897 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d1416fb190 0x55d141707120 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7fadd402a9a0 tx=0x7fadd40315a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=80604a0561b843ab server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:28:47.617 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:47.611+0000 7fadc17fa640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-10T22:28:47.617 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:47.611+0000 7fadc17fa640 1 -- 172.21.15.19:0/3471250897 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fadd4035040 con 0x55d1416fb190 2024-09-10T22:28:47.617 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:47.611+0000 7fadc17fa640 1 -- 172.21.15.19:0/3471250897 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8327+0+0 (secure 0 0 0) 0x7fadd4046600 con 0x55d1416fb190 2024-09-10T22:28:47.617 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:47.611+0000 7fade2ec1740 1 -- 172.21.15.19:0/3471250897 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fadc80056f0 con 0x55d1416fb190 2024-09-10T22:28:47.617 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:47.612+0000 7fadc17fa640 1 -- 172.21.15.19:0/3471250897 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7fadd40319e0 con 0x55d1416fb190 2024-09-10T22:28:47.617 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:47.612+0000 7fade2ec1740 10 client.15852 fetch_fsmap learned FSMap version 26 2024-09-10T22:28:47.617 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:47.612+0000 7fade2ec1740 1 -- 172.21.15.19:0/3471250897 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x55d141709990 con 0x55d1416fb190 2024-09-10T22:28:47.617 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:47.612+0000 7fadc17fa640 1 -- 172.21.15.19:0/3471250897 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fadc80056f0 con 0x55d1416fb190 2024-09-10T22:28:47.617 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:47.612+0000 7fadc17fa640 1 -- 172.21.15.19:0/3471250897 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 26) ==== 8350+0+0 (secure 0 0 0) 0x7fadd403c9a0 con 0x55d1416fb190 2024-09-10T22:28:47.618 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:47.612+0000 7fade2ec1740 10 client.15852 fetch_fsmap finished waiting for FSMap version 26 2024-09-10T22:28:47.618 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:47.612+0000 7fade2ec1740 10 client.15852 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-10T22:28:47.618 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:47.612+0000 7fade2ec1740 20 client.15852 populate_metadata read hostname 'smithi019' 2024-09-10T22:28:47.618 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:47.612+0000 7fade2ec1740 1 --2- 172.21.15.19:0/3471250897 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x55d14177a610 0x55d14177ca00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:28:47.618 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:47.612+0000 7fade2ec1740 4 client.15852 mds_command: new command op to 24581 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-10T22:28:47.618 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:47.612+0000 7fade2ec1740 1 -- 172.21.15.19:0/3471250897 --> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55d1416680f0 con 0x55d14177a610 2024-09-10T22:28:47.618 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:47.612+0000 7faddd68a640 1 --2- 172.21.15.19:0/3471250897 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x55d14177a610 0x55d14177ca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:28:47.618 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:47.613+0000 7faddd68a640 1 --2- 172.21.15.19:0/3471250897 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x55d14177a610 0x55d14177ca00 crc :-1 s=READY pgs=73 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ea84620d88750318 server_cookie=b28eaa229e505ed in_seq=0 out_seq=0 2024-09-10T22:28:47.618 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:47.613+0000 7fadc17fa640 10 client.15852 ms_handle_connect on v2:172.21.15.135:6838/1254769802 2024-09-10T22:28:48.359 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:28:48 smithi135 ceph-mon[34789]: pgmap v418: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 756 KiB/s rd, 406 MiB/s wr, 197 op/s 2024-09-10T22:28:48.360 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:28:48 smithi135 ceph-mon[34789]: scrub summary: idle 2024-09-10T22:28:48.360 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:28:48 smithi135 ceph-mon[34789]: scrub summary: idle 2024-09-10T22:28:48.375 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:28:48 smithi138 ceph-mon[35236]: pgmap v418: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 756 KiB/s rd, 406 MiB/s wr, 197 op/s 2024-09-10T22:28:48.375 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:28:48 smithi138 ceph-mon[35236]: scrub summary: idle 2024-09-10T22:28:48.375 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:28:48 smithi138 ceph-mon[35236]: scrub summary: idle 2024-09-10T22:28:48.458 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:28:48 smithi019 ceph-mon[31375]: pgmap v418: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 756 KiB/s rd, 406 MiB/s wr, 197 op/s 2024-09-10T22:28:48.458 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:28:48 smithi019 ceph-mon[31375]: scrub summary: idle 2024-09-10T22:28:48.458 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:28:48 smithi019 ceph-mon[31375]: scrub summary: idle 2024-09-10T22:28:50.375 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:28:50 smithi138 ceph-mon[35236]: pgmap v419: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 754 KiB/s rd, 352 MiB/s wr, 206 op/s 2024-09-10T22:28:50.458 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:28:50 smithi019 ceph-mon[31375]: pgmap v419: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 754 KiB/s rd, 352 MiB/s wr, 206 op/s 2024-09-10T22:28:50.609 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:28:50 smithi135 ceph-mon[34789]: pgmap v419: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 754 KiB/s rd, 352 MiB/s wr, 206 op/s 2024-09-10T22:28:51.040 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:51.038+0000 7fadc17fa640 1 -- 172.21.15.19:0/3471250897 <== mds.0 v2:172.21.15.135:6838/1254769802 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55d1416680f0 con 0x55d14177a610 2024-09-10T22:28:51.040 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:51.038+0000 7fadc17fa640 10 client.15852 handle_command_reply: tid=0 2024-09-10T22:28:51.040 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:51.038+0000 7fade2ec1740 1 client.15852 shutdown 2024-09-10T22:28:51.040 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:51.038+0000 7fade2ec1740 1 -- 172.21.15.19:0/3471250897 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d1416fb190 msgr2=0x55d141707120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:28:51.040 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:51.038+0000 7fade2ec1740 1 --2- 172.21.15.19:0/3471250897 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d1416fb190 0x55d141707120 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7fadd402a9a0 tx=0x7fadd40315a0 comp rx=0 tx=0).stop 2024-09-10T22:28:51.040 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:51.038+0000 7fade2ec1740 1 -- 172.21.15.19:0/3471250897 shutdown_connections 2024-09-10T22:28:51.040 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:51.038+0000 7fade2ec1740 1 --2- 172.21.15.19:0/3471250897 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x55d14177a610 0x55d14177ca00 crc :-1 s=READY pgs=73 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:28:51.040 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:51.038+0000 7fade2ec1740 1 --2- 172.21.15.19:0/3471250897 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55d1416fdbd0 0x55d141707cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:28:51.040 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:51.038+0000 7fade2ec1740 1 --2- 172.21.15.19:0/3471250897 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d1416fb190 0x55d141707120 unknown :-1 s=CLOSED pgs=519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:28:51.041 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:51.038+0000 7fade2ec1740 1 --2- 172.21.15.19:0/3471250897 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d1416f8860 0x55d141706a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:28:51.041 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:51.038+0000 7fade2ec1740 1 -- 172.21.15.19:0/3471250897 >> 172.21.15.19:0/3471250897 conn(0x55d1416f39b0 msgr2=0x55d1416f2bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:28:51.041 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:51.038+0000 7fadc17fa640 0 client.15852 ms_handle_reset on v2:172.21.15.135:6838/1254769802 2024-09-10T22:28:51.041 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:51.038+0000 7fade2ec1740 1 -- 172.21.15.19:0/3471250897 shutdown_connections 2024-09-10T22:28:51.041 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:51.038+0000 7fade2ec1740 1 -- 172.21.15.19:0/3471250897 wait complete. 2024-09-10T22:28:51.041 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:51.039+0000 7fade2ec1740 20 client.15852 trim_cache size 0 max 16384 2024-09-10T22:28:51.041 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stdout:{ 2024-09-10T22:28:51.041 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stdout: "message": "", 2024-09-10T22:28:51.041 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stdout: "return_code": 0 2024-09-10T22:28:51.041 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stdout:} 2024-09-10T22:28:51.042 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:51.039+0000 7fade00ef640 1 -- 172.21.15.19:0/3938145521 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7fadc40b52e0 msgr2=0x7fadc40b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:28:51.042 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:51.039+0000 7fade00ef640 1 --2- 172.21.15.19:0/3938145521 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7fadc40b52e0 0x7fadc40b77a0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fadd004c3c0 tx=0x7fadd00769c0 comp rx=0 tx=0).stop 2024-09-10T22:28:51.043 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:51.039+0000 7fade00ef640 1 -- 172.21.15.19:0/3938145521 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fadd810a8a0 msgr2=0x7fadd819c1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:28:51.043 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:51.039+0000 7fade00ef640 1 --2- 172.21.15.19:0/3938145521 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fadd810a8a0 0x7fadd819c1e0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fadd000eb10 tx=0x7fadd000c2d0 comp rx=0 tx=0).stop 2024-09-10T22:28:51.043 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:51.039+0000 7fade00ef640 1 -- 172.21.15.19:0/3938145521 shutdown_connections 2024-09-10T22:28:51.043 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:51.039+0000 7fade00ef640 1 --2- 172.21.15.19:0/3938145521 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7fadc40b52e0 0x7fadc40b77a0 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:28:51.043 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:51.039+0000 7fade00ef640 1 --2- 172.21.15.19:0/3938145521 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fadd810a8a0 0x7fadd819c1e0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:28:51.043 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:51.039+0000 7fade00ef640 1 --2- 172.21.15.19:0/3938145521 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fadd8107ef0 0x7fadd819b620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:28:51.043 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:51.039+0000 7fade00ef640 1 --2- 172.21.15.19:0/3938145521 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fadd806b2e0 0x7fadd819afd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:28:51.043 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:51.040+0000 7fade00ef640 1 -- 172.21.15.19:0/3938145521 >> 172.21.15.19:0/3938145521 conn(0x7fadd80fd140 msgr2=0x7fadd810b5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:28:51.043 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:51.040+0000 7fade00ef640 1 -- 172.21.15.19:0/3938145521 shutdown_connections 2024-09-10T22:28:51.043 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:28:51.040+0000 7fade00ef640 1 -- 172.21.15.19:0/3938145521 wait complete. 2024-09-10T22:28:52.458 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:28:52 smithi019 ceph-mon[31375]: pgmap v420: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 422 MiB/s wr, 334 op/s 2024-09-10T22:28:52.609 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:28:52 smithi135 ceph-mon[34789]: pgmap v420: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 422 MiB/s wr, 334 op/s 2024-09-10T22:28:52.625 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:28:52 smithi138 ceph-mon[35236]: pgmap v420: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 422 MiB/s wr, 334 op/s 2024-09-10T22:28:54.458 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:28:54 smithi019 ceph-mon[31375]: pgmap v421: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 994 KiB/s rd, 384 MiB/s wr, 364 op/s 2024-09-10T22:28:54.609 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:28:54 smithi135 ceph-mon[34789]: pgmap v421: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 994 KiB/s rd, 384 MiB/s wr, 364 op/s 2024-09-10T22:28:54.624 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:28:54 smithi138 ceph-mon[35236]: pgmap v421: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 994 KiB/s rd, 384 MiB/s wr, 364 op/s 2024-09-10T22:28:56.609 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:28:56 smithi135 ceph-mon[34789]: pgmap v422: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 687 KiB/s rd, 383 MiB/s wr, 364 op/s 2024-09-10T22:28:56.625 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:28:56 smithi138 ceph-mon[35236]: pgmap v422: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 687 KiB/s rd, 383 MiB/s wr, 364 op/s 2024-09-10T22:28:56.708 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:28:56 smithi019 ceph-mon[31375]: pgmap v422: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 687 KiB/s rd, 383 MiB/s wr, 364 op/s 2024-09-10T22:28:57.609 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:28:57 smithi135 ceph-mon[34789]: pgmap v423: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 993 KiB/s rd, 403 MiB/s wr, 376 op/s 2024-09-10T22:28:57.709 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:28:57 smithi019 ceph-mon[31375]: pgmap v423: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 993 KiB/s rd, 403 MiB/s wr, 376 op/s 2024-09-10T22:28:57.875 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:28:57 smithi138 ceph-mon[35236]: pgmap v423: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 993 KiB/s rd, 403 MiB/s wr, 376 op/s 2024-09-10T22:28:59.859 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:28:59 smithi135 ceph-mon[34789]: pgmap v424: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 686 KiB/s rd, 343 MiB/s wr, 312 op/s 2024-09-10T22:28:59.874 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:28:59 smithi138 ceph-mon[35236]: pgmap v424: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 686 KiB/s rd, 343 MiB/s wr, 312 op/s 2024-09-10T22:28:59.959 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:28:59 smithi019 ceph-mon[31375]: pgmap v424: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 686 KiB/s rd, 343 MiB/s wr, 312 op/s 2024-09-10T22:29:01.958 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:29:01 smithi019 ceph-mon[31375]: pgmap v425: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 397 MiB/s wr, 301 op/s 2024-09-10T22:29:02.109 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:29:01 smithi135 ceph-mon[34789]: pgmap v425: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 397 MiB/s wr, 301 op/s 2024-09-10T22:29:02.124 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:29:01 smithi138 ceph-mon[35236]: pgmap v425: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 397 MiB/s wr, 301 op/s 2024-09-10T22:29:03.958 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:29:03 smithi019 ceph-mon[31375]: pgmap v426: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 759 KiB/s rd, 364 MiB/s wr, 193 op/s 2024-09-10T22:29:04.109 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:29:03 smithi135 ceph-mon[34789]: pgmap v426: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 759 KiB/s rd, 364 MiB/s wr, 193 op/s 2024-09-10T22:29:04.124 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:29:03 smithi138 ceph-mon[35236]: pgmap v426: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 759 KiB/s rd, 364 MiB/s wr, 193 op/s 2024-09-10T22:29:04.149 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:04.147+0000 7fd967b6b640 1 -- 172.21.15.19:0/1996849594 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd9601033a0 msgr2=0x7fd960109d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:29:04.149 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:04.147+0000 7fd967b6b640 1 --2- 172.21.15.19:0/1996849594 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd9601033a0 0x7fd960109d20 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7fd958009cd0 tx=0x7fd95802a8e0 comp rx=0 tx=0).stop 2024-09-10T22:29:04.149 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:04.148+0000 7fd967b6b640 1 -- 172.21.15.19:0/1996849594 shutdown_connections 2024-09-10T22:29:04.150 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:04.148+0000 7fd967b6b640 1 --2- 172.21.15.19:0/1996849594 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd9601033a0 0x7fd960109d20 unknown :-1 s=CLOSED pgs=520 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:29:04.150 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:04.148+0000 7fd967b6b640 1 --2- 172.21.15.19:0/1996849594 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd9601029e0 0x7fd960102e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:29:04.150 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:04.148+0000 7fd967b6b640 1 --2- 172.21.15.19:0/1996849594 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd960101890 0x7fd960101c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:29:04.150 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:04.148+0000 7fd967b6b640 1 -- 172.21.15.19:0/1996849594 >> 172.21.15.19:0/1996849594 conn(0x7fd9600fd150 msgr2=0x7fd9600ff570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:29:04.150 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:04.148+0000 7fd967b6b640 1 -- 172.21.15.19:0/1996849594 shutdown_connections 2024-09-10T22:29:04.150 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:04.148+0000 7fd967b6b640 1 -- 172.21.15.19:0/1996849594 wait complete. 2024-09-10T22:29:04.152 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:04.148+0000 7fd967b6b640 1 Processor -- start 2024-09-10T22:29:04.152 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:04.148+0000 7fd967b6b640 1 -- start start 2024-09-10T22:29:04.152 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:04.149+0000 7fd967b6b640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd960101890 0x7fd960198d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:29:04.152 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:04.149+0000 7fd967b6b640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd9601029e0 0x7fd960199390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:29:04.152 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:04.149+0000 7fd967b6b640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd9601033a0 0x7fd960199fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:29:04.152 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:04.149+0000 7fd967b6b640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fd96010d500 con 0x7fd9601033a0 2024-09-10T22:29:04.153 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:04.149+0000 7fd967b6b640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fd96010d380 con 0x7fd9601029e0 2024-09-10T22:29:04.153 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:04.149+0000 7fd967b6b640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7fd96010d680 con 0x7fd960101890 2024-09-10T22:29:04.153 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:04.149+0000 7fd965907640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd960101890 0x7fd960198d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:29:04.153 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:04.149+0000 7fd965106640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd9601029e0 0x7fd960199390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:29:04.153 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:04.149+0000 7fd965907640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd960101890 0x7fd960198d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.19:43484/0 (socket says 172.21.15.19:43484) 2024-09-10T22:29:04.153 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:04.149+0000 7fd965907640 1 -- 172.21.15.19:0/3398554630 learned_addr learned my addr 172.21.15.19:0/3398554630 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:29:04.153 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:04.149+0000 7fd966108640 1 --2- 172.21.15.19:0/3398554630 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd9601033a0 0x7fd960199fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:29:04.153 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:04.149+0000 7fd965106640 1 -- 172.21.15.19:0/3398554630 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd960101890 msgr2=0x7fd960198d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:29:04.153 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:04.149+0000 7fd965106640 1 --2- 172.21.15.19:0/3398554630 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd960101890 0x7fd960198d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:29:04.153 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:04.149+0000 7fd965106640 1 -- 172.21.15.19:0/3398554630 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd9601033a0 msgr2=0x7fd960199fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:29:04.153 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:04.149+0000 7fd965106640 1 --2- 172.21.15.19:0/3398554630 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd9601033a0 0x7fd960199fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:29:04.153 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:04.149+0000 7fd965106640 1 -- 172.21.15.19:0/3398554630 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd96019a880 con 0x7fd9601029e0 2024-09-10T22:29:04.154 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:04.149+0000 7fd965907640 1 --2- 172.21.15.19:0/3398554630 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd960101890 0x7fd960198d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T22:29:04.154 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:04.150+0000 7fd965106640 1 --2- 172.21.15.19:0/3398554630 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd9601029e0 0x7fd960199390 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fd95000e9f0 tx=0x7fd95000eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:29:04.154 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:04.150+0000 7fd956ffd640 1 -- 172.21.15.19:0/3398554630 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd95000ccc0 con 0x7fd9601029e0 2024-09-10T22:29:04.154 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:04.150+0000 7fd956ffd640 1 -- 172.21.15.19:0/3398554630 <== mon.2 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd9500108e0 con 0x7fd9601029e0 2024-09-10T22:29:04.154 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:04.150+0000 7fd956ffd640 1 -- 172.21.15.19:0/3398554630 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd950018880 con 0x7fd9601029e0 2024-09-10T22:29:04.154 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:04.150+0000 7fd967b6b640 1 -- 172.21.15.19:0/3398554630 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd96019ab70 con 0x7fd9601029e0 2024-09-10T22:29:04.154 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:04.150+0000 7fd967b6b640 1 -- 172.21.15.19:0/3398554630 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd9601a1240 con 0x7fd9601029e0 2024-09-10T22:29:04.156 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:04.153+0000 7fd956ffd640 1 -- 172.21.15.19:0/3398554630 <== mon.2 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 18) ==== 153250+0+0 (secure 0 0 0) 0x7fd950010430 con 0x7fd9601029e0 2024-09-10T22:29:04.156 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:04.153+0000 7fd96aa1b740 1 Processor -- start 2024-09-10T22:29:04.156 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:04.154+0000 7fd96aa1b740 1 -- start start 2024-09-10T22:29:04.156 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:04.154+0000 7fd96aa1b740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56070b937860 0x56070b939c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:29:04.156 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:04.154+0000 7fd96aa1b740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56070b93a190 0x56070b93c580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:29:04.156 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:04.154+0000 7fd96aa1b740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x56070b93cbd0 0x56070b93f090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:29:04.156 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:04.154+0000 7fd96aa1b740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x56070b8a96f0 con 0x56070b937860 2024-09-10T22:29:04.157 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:04.154+0000 7fd96aa1b740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x56070b898b20 con 0x56070b93a190 2024-09-10T22:29:04.157 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:04.154+0000 7fd96aa1b740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x56070b89c930 con 0x56070b93cbd0 2024-09-10T22:29:04.157 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:04.154+0000 7fd965907640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56070b93a190 0x56070b93c580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:29:04.157 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:04.154+0000 7fd966108640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56070b937860 0x56070b939c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:29:04.157 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:04.154+0000 7fd966108640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56070b937860 0x56070b939c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:37152/0 (socket says 172.21.15.19:37152) 2024-09-10T22:29:04.157 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:04.154+0000 7fd966108640 1 -- 172.21.15.19:0/1654131784 learned_addr learned my addr 172.21.15.19:0/1654131784 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:29:04.157 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:04.154+0000 7fd965907640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56070b93a190 0x56070b93c580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.19:53988/0 (socket says 172.21.15.19:53988) 2024-09-10T22:29:04.157 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:04.154+0000 7fd965106640 1 --2- 172.21.15.19:0/1654131784 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x56070b93cbd0 0x56070b93f090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:29:04.157 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:04.154+0000 7fd956ffd640 1 --2- 172.21.15.19:0/3398554630 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7fd94c0b5360 0x7fd94c0b7820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:29:04.157 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:04.154+0000 7fd966108640 1 -- 172.21.15.19:0/1654131784 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x56070b93cbd0 msgr2=0x56070b93f090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:29:04.157 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:04.154+0000 7fd966108640 1 --2- 172.21.15.19:0/1654131784 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x56070b93cbd0 0x56070b93f090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:29:04.157 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:04.154+0000 7fd966108640 1 -- 172.21.15.19:0/1654131784 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56070b93a190 msgr2=0x56070b93c580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:29:04.158 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:04.154+0000 7fd966108640 1 --2- 172.21.15.19:0/1654131784 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56070b93a190 0x56070b93c580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:29:04.158 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:04.154+0000 7fd966108640 1 -- 172.21.15.19:0/1654131784 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56070b85e530 con 0x56070b937860 2024-09-10T22:29:04.158 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:04.154+0000 7fd965106640 1 --2- 172.21.15.19:0/1654131784 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x56070b93cbd0 0x56070b93f090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T22:29:04.158 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:04.154+0000 7fd965907640 1 --2- 172.21.15.19:0/1654131784 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56070b93a190 0x56070b93c580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T22:29:04.158 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:04.155+0000 7fd966108640 1 --2- 172.21.15.19:0/3398554630 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7fd94c0b5360 0x7fd94c0b7820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:29:04.158 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:04.155+0000 7fd956ffd640 1 -- 172.21.15.19:0/3398554630 <== mon.2 v2:172.21.15.135:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8327+0+0 (secure 0 0 0) 0x7fd9500e5eb0 con 0x7fd9601029e0 2024-09-10T22:29:04.158 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:04.155+0000 7fd966108640 1 --2- 172.21.15.19:0/1654131784 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56070b937860 0x56070b939c50 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7fd958005e30 tx=0x7fd958009360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=18a73b04b38af963 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:29:04.161 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:04.155+0000 7fd966108640 1 --2- 172.21.15.19:0/3398554630 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7fd94c0b5360 0x7fd94c0b7820 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fd958045000 tx=0x7fd958047000 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:29:04.162 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:04.155+0000 7fd94bfff640 1 -- 172.21.15.19:0/1654131784 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd958042040 con 0x56070b937860 2024-09-10T22:29:04.162 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:04.155+0000 7fd94bfff640 1 -- 172.21.15.19:0/1654131784 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd95804c020 con 0x56070b937860 2024-09-10T22:29:04.162 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:04.155+0000 7fd94bfff640 1 -- 172.21.15.19:0/1654131784 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd958030a60 con 0x56070b937860 2024-09-10T22:29:04.162 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:04.156+0000 7fd96aa1b740 1 -- 172.21.15.19:0/1654131784 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56070b937860 msgr2=0x56070b939c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:29:04.162 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:04.156+0000 7fd96aa1b740 1 --2- 172.21.15.19:0/1654131784 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56070b937860 0x56070b939c50 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7fd958005e30 tx=0x7fd958009360 comp rx=0 tx=0).stop 2024-09-10T22:29:04.162 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:04.156+0000 7fd96aa1b740 1 -- 172.21.15.19:0/1654131784 shutdown_connections 2024-09-10T22:29:04.162 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:04.156+0000 7fd96aa1b740 1 --2- 172.21.15.19:0/1654131784 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x56070b93cbd0 0x56070b93f090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:29:04.162 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:04.156+0000 7fd96aa1b740 1 --2- 172.21.15.19:0/1654131784 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56070b93a190 0x56070b93c580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:29:04.162 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:04.156+0000 7fd96aa1b740 1 --2- 172.21.15.19:0/1654131784 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56070b937860 0x56070b939c50 unknown :-1 s=CLOSED pgs=521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:29:04.162 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:04.156+0000 7fd96aa1b740 1 -- 172.21.15.19:0/1654131784 >> 172.21.15.19:0/1654131784 conn(0x56070b9329b0 msgr2=0x56070b933740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:29:04.162 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:04.156+0000 7fd96aa1b740 1 -- 172.21.15.19:0/1654131784 shutdown_connections 2024-09-10T22:29:04.163 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:04.156+0000 7fd96aa1b740 1 -- 172.21.15.19:0/1654131784 wait complete. 2024-09-10T22:29:04.163 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:04.157+0000 7fd96aa1b740 1 -- start start 2024-09-10T22:29:04.163 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:04.157+0000 7fd96aa1b740 1 Processor -- start 2024-09-10T22:29:04.163 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:04.157+0000 7fd96aa1b740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56070b937860 0x56070b945330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:29:04.163 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:04.157+0000 7fd96aa1b740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x56070b93a190 0x56070b9459d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:29:04.163 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:04.157+0000 7fd96aa1b740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56070b93cbd0 0x56070b9465a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:29:04.163 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:04.157+0000 7fd96aa1b740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x56070b7d0ab0 con 0x56070b937860 2024-09-10T22:29:04.163 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:04.157+0000 7fd96aa1b740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x56070b83e730 con 0x56070b93cbd0 2024-09-10T22:29:04.163 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:04.157+0000 7fd96aa1b740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x56070b93fb50 con 0x56070b93a190 2024-09-10T22:29:04.163 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:04.157+0000 7fd96aa1b740 10 client.0 _ll_register_callbacks cb 0x56070b8926b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T22:29:04.163 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:04.157+0000 7fd966108640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56070b93cbd0 0x56070b9465a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:29:04.163 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:04.157+0000 7fd965907640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56070b937860 0x56070b945330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:29:04.164 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:04.157+0000 7fd966108640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56070b93cbd0 0x56070b9465a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.19:53996/0 (socket says 172.21.15.19:53996) 2024-09-10T22:29:04.164 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:04.157+0000 7fd966108640 1 -- 172.21.15.19:0/2771771241 learned_addr learned my addr 172.21.15.19:0/2771771241 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:29:04.164 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:04.158+0000 7fd965106640 1 --2- 172.21.15.19:0/2771771241 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x56070b93a190 0x56070b9459d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:29:04.164 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:04.158+0000 7fd966108640 1 -- 172.21.15.19:0/2771771241 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x56070b93a190 msgr2=0x56070b9459d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:29:04.164 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:04.158+0000 7fd966108640 1 --2- 172.21.15.19:0/2771771241 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x56070b93a190 0x56070b9459d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:29:04.164 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:04.158+0000 7fd966108640 1 -- 172.21.15.19:0/2771771241 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56070b937860 msgr2=0x56070b945330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:29:04.164 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:04.158+0000 7fd966108640 1 --2- 172.21.15.19:0/2771771241 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56070b937860 0x56070b945330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:29:04.164 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:04.158+0000 7fd966108640 1 -- 172.21.15.19:0/2771771241 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56070b5fa790 con 0x56070b93cbd0 2024-09-10T22:29:04.164 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:04.158+0000 7fd965106640 1 --2- 172.21.15.19:0/2771771241 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x56070b93a190 0x56070b9459d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T22:29:04.164 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:04.158+0000 7fd966108640 1 --2- 172.21.15.19:0/2771771241 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56070b93cbd0 0x56070b9465a0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fd958009600 tx=0x7fd958031850 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ac6fb22a0077bc35 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:29:04.164 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:04.158+0000 7fd9497fa640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-09-10T22:29:04.164 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:04.158+0000 7fd9497fa640 1 -- 172.21.15.19:0/2771771241 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd958042070 con 0x56070b93cbd0 2024-09-10T22:29:04.164 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:04.158+0000 7fd9497fa640 1 -- 172.21.15.19:0/2771771241 <== mon.2 v2:172.21.15.135:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8327+0+0 (secure 0 0 0) 0x7fd958004040 con 0x56070b93cbd0 2024-09-10T22:29:04.165 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:04.158+0000 7fd96aa1b740 1 -- 172.21.15.19:0/2771771241 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd95804c020 con 0x56070b93cbd0 2024-09-10T22:29:04.165 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:04.158+0000 7fd9497fa640 1 -- 172.21.15.19:0/2771771241 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7fd958062050 con 0x56070b93cbd0 2024-09-10T22:29:04.165 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:04.158+0000 7fd96aa1b740 10 client.25397 fetch_fsmap learned FSMap version 26 2024-09-10T22:29:04.165 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:04.158+0000 7fd96aa1b740 1 -- 172.21.15.19:0/2771771241 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x56070b673620 con 0x56070b93cbd0 2024-09-10T22:29:04.165 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:04.159+0000 7fd9497fa640 1 -- 172.21.15.19:0/2771771241 <== mon.2 v2:172.21.15.135:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd95804c020 con 0x56070b93cbd0 2024-09-10T22:29:04.165 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:04.159+0000 7fd9497fa640 1 -- 172.21.15.19:0/2771771241 <== mon.2 v2:172.21.15.135:3300/0 5 ==== fsmap(e 26) ==== 8350+0+0 (secure 0 0 0) 0x7fd958030070 con 0x56070b93cbd0 2024-09-10T22:29:04.165 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:04.159+0000 7fd96aa1b740 10 client.25397 fetch_fsmap finished waiting for FSMap version 26 2024-09-10T22:29:04.165 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:04.159+0000 7fd96aa1b740 10 client.25397 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-10T22:29:04.165 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:04.159+0000 7fd96aa1b740 20 client.25397 populate_metadata read hostname 'smithi019' 2024-09-10T22:29:04.165 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:04.159+0000 7fd96aa1b740 1 --2- 172.21.15.19:0/2771771241 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x56070b9507d0 0x56070b952bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:29:04.165 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:04.159+0000 7fd96aa1b740 4 client.25397 mds_command: new command op to 24581 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T22:29:04.166 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:04.159+0000 7fd96aa1b740 1 -- 172.21.15.19:0/2771771241 --> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56070b8ab640 con 0x56070b9507d0 2024-09-10T22:29:04.166 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:04.159+0000 7fd965907640 1 --2- 172.21.15.19:0/2771771241 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x56070b9507d0 0x56070b952bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:29:04.166 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:04.160+0000 7fd9497fa640 10 client.25397 ms_handle_connect on v2:172.21.15.135:6838/1254769802 2024-09-10T22:29:04.166 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:04.160+0000 7fd965907640 1 --2- 172.21.15.19:0/2771771241 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x56070b9507d0 0x56070b952bf0 crc :-1 s=READY pgs=74 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=98943b68f5424f67 server_cookie=65ec4546ddc0caab in_seq=0 out_seq=0 2024-09-10T22:29:04.167 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:04.162+0000 7fd9497fa640 1 -- 172.21.15.19:0/2771771241 <== mds.0 v2:172.21.15.135:6838/1254769802 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x56070b8ab640 con 0x56070b9507d0 2024-09-10T22:29:04.167 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:04.162+0000 7fd9497fa640 10 client.25397 handle_command_reply: tid=0 2024-09-10T22:29:04.167 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:04.162+0000 7fd96aa1b740 1 client.25397 shutdown 2024-09-10T22:29:04.167 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:04.162+0000 7fd96aa1b740 1 -- 172.21.15.19:0/2771771241 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56070b93cbd0 msgr2=0x56070b9465a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:29:04.167 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:04.162+0000 7fd96aa1b740 1 --2- 172.21.15.19:0/2771771241 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56070b93cbd0 0x56070b9465a0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fd958009600 tx=0x7fd958031850 comp rx=0 tx=0).stop 2024-09-10T22:29:04.167 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:04.162+0000 7fd96aa1b740 1 -- 172.21.15.19:0/2771771241 shutdown_connections 2024-09-10T22:29:04.167 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:04.162+0000 7fd96aa1b740 1 --2- 172.21.15.19:0/2771771241 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56070b93cbd0 0x56070b9465a0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:29:04.167 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:04.162+0000 7fd96aa1b740 1 --2- 172.21.15.19:0/2771771241 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x56070b9507d0 0x56070b952bf0 crc :-1 s=READY pgs=74 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:29:04.168 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:04.162+0000 7fd96aa1b740 1 --2- 172.21.15.19:0/2771771241 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x56070b93a190 0x56070b9459d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:29:04.168 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:04.162+0000 7fd9497fa640 0 client.25397 ms_handle_reset on v2:172.21.15.135:6838/1254769802 2024-09-10T22:29:04.168 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:04.162+0000 7fd96aa1b740 1 --2- 172.21.15.19:0/2771771241 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56070b937860 0x56070b945330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:29:04.168 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:04.162+0000 7fd96aa1b740 1 -- 172.21.15.19:0/2771771241 >> 172.21.15.19:0/2771771241 conn(0x56070b9329b0 msgr2=0x56070b931bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:29:04.168 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:04.162+0000 7fd96aa1b740 1 -- 172.21.15.19:0/2771771241 shutdown_connections 2024-09-10T22:29:04.168 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:04.162+0000 7fd96aa1b740 1 -- 172.21.15.19:0/2771771241 wait complete. 2024-09-10T22:29:04.168 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:04.162+0000 7fd96aa1b740 20 client.25397 trim_cache size 0 max 16384 2024-09-10T22:29:04.182 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:04.180+0000 7fd96aa1b740 1 Processor -- start 2024-09-10T22:29:04.182 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:04.180+0000 7fd96aa1b740 1 -- start start 2024-09-10T22:29:04.182 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:04.180+0000 7fd96aa1b740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x56070b937860 0x56070b933210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:29:04.182 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:04.180+0000 7fd96aa1b740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56070b93a190 0x56070b933750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:29:04.182 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:04.180+0000 7fd96aa1b740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56070b93cbd0 0x56070b93cfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:29:04.182 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:04.180+0000 7fd96aa1b740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fd9601aa640 con 0x56070b93cbd0 2024-09-10T22:29:04.182 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:04.180+0000 7fd96aa1b740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fd9601a7f10 con 0x56070b93a190 2024-09-10T22:29:04.183 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:04.180+0000 7fd96aa1b740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7fd9601a5dc0 con 0x56070b937860 2024-09-10T22:29:04.183 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:04.181+0000 7fd965106640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56070b93a190 0x56070b933750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:29:04.183 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:04.181+0000 7fd965907640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x56070b937860 0x56070b933210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:29:04.183 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:04.181+0000 7fd965106640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56070b93a190 0x56070b933750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.19:54008/0 (socket says 172.21.15.19:54008) 2024-09-10T22:29:04.183 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:04.181+0000 7fd965106640 1 -- 172.21.15.19:0/2352614404 learned_addr learned my addr 172.21.15.19:0/2352614404 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:29:04.183 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:04.181+0000 7fd965907640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x56070b937860 0x56070b933210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.19:43518/0 (socket says 172.21.15.19:43518) 2024-09-10T22:29:04.183 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:04.181+0000 7fd966108640 1 --2- 172.21.15.19:0/2352614404 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56070b93cbd0 0x56070b93cfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:29:04.183 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:04.181+0000 7fd965907640 1 -- 172.21.15.19:0/2352614404 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56070b93a190 msgr2=0x56070b933750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:29:04.187 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:04.181+0000 7fd965907640 1 --2- 172.21.15.19:0/2352614404 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56070b93a190 0x56070b933750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:29:04.187 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:04.181+0000 7fd965907640 1 -- 172.21.15.19:0/2352614404 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56070b93cbd0 msgr2=0x56070b93cfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:29:04.187 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:04.181+0000 7fd965907640 1 --2- 172.21.15.19:0/2352614404 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56070b93cbd0 0x56070b93cfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:29:04.187 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:04.181+0000 7fd965907640 1 -- 172.21.15.19:0/2352614404 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56070b945d40 con 0x56070b937860 2024-09-10T22:29:04.188 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:04.181+0000 7fd965106640 1 --2- 172.21.15.19:0/2352614404 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56070b93a190 0x56070b933750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T22:29:04.188 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:04.181+0000 7fd966108640 1 --2- 172.21.15.19:0/2352614404 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56070b93cbd0 0x56070b93cfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T22:29:04.188 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:04.182+0000 7fd965907640 1 --2- 172.21.15.19:0/2352614404 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x56070b937860 0x56070b933210 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x56070b9531d0 tx=0x7fd95c005f90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=dbcce329617b5872 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:29:04.188 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:04.182+0000 7fd94b7fe640 1 -- 172.21.15.19:0/2352614404 <== mon.1 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd95c005020 con 0x56070b937860 2024-09-10T22:29:04.188 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:04.182+0000 7fd94b7fe640 1 -- 172.21.15.19:0/2352614404 <== mon.1 v2:172.21.15.138:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd95c00f810 con 0x56070b937860 2024-09-10T22:29:04.188 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:04.182+0000 7fd94b7fe640 1 -- 172.21.15.19:0/2352614404 <== mon.1 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd95c004a00 con 0x56070b937860 2024-09-10T22:29:04.188 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:04.183+0000 7fd96aa1b740 1 -- 172.21.15.19:0/2352614404 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x56070b937860 msgr2=0x56070b933210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:29:04.188 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:04.183+0000 7fd96aa1b740 1 --2- 172.21.15.19:0/2352614404 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x56070b937860 0x56070b933210 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x56070b9531d0 tx=0x7fd95c005f90 comp rx=0 tx=0).stop 2024-09-10T22:29:04.188 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:04.183+0000 7fd96aa1b740 1 -- 172.21.15.19:0/2352614404 shutdown_connections 2024-09-10T22:29:04.188 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:04.183+0000 7fd96aa1b740 1 --2- 172.21.15.19:0/2352614404 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56070b93cbd0 0x56070b93cfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:29:04.188 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:04.183+0000 7fd96aa1b740 1 --2- 172.21.15.19:0/2352614404 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56070b93a190 0x56070b933750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:29:04.188 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:04.183+0000 7fd96aa1b740 1 --2- 172.21.15.19:0/2352614404 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x56070b937860 0x56070b933210 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:29:04.189 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:04.183+0000 7fd96aa1b740 1 -- 172.21.15.19:0/2352614404 >> 172.21.15.19:0/2352614404 conn(0x56070b9329b0 msgr2=0x56070b936db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:29:04.189 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:04.183+0000 7fd96aa1b740 1 -- 172.21.15.19:0/2352614404 shutdown_connections 2024-09-10T22:29:04.189 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:04.183+0000 7fd96aa1b740 1 -- 172.21.15.19:0/2352614404 wait complete. 2024-09-10T22:29:04.189 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:04.183+0000 7fd96aa1b740 1 -- start start 2024-09-10T22:29:04.189 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:04.183+0000 7fd96aa1b740 1 Processor -- start 2024-09-10T22:29:04.189 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:04.183+0000 7fd96aa1b740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x56070b937860 0x56070b94cd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:29:04.189 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:04.184+0000 7fd96aa1b740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56070b93a190 0x56070b94ba00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:29:04.189 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:04.184+0000 7fd96aa1b740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56070b93cbd0 0x56070b94bf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:29:04.189 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:04.184+0000 7fd96aa1b740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fd9601a63d0 con 0x56070b93a190 2024-09-10T22:29:04.189 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:04.184+0000 7fd96aa1b740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fd9601a7840 con 0x56070b93cbd0 2024-09-10T22:29:04.189 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:04.184+0000 7fd96aa1b740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7fd9601a6aa0 con 0x56070b937860 2024-09-10T22:29:04.189 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:04.184+0000 7fd96aa1b740 10 client.0 _ll_register_callbacks cb 0x7fd95c009530 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T22:29:04.189 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:04.184+0000 7fd965907640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x56070b937860 0x56070b94cd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:29:04.190 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:04.184+0000 7fd966108640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56070b93cbd0 0x56070b94bf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:29:04.190 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:04.184+0000 7fd965106640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56070b93a190 0x56070b94ba00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:29:04.190 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:04.184+0000 7fd965907640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x56070b937860 0x56070b94cd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.19:43520/0 (socket says 172.21.15.19:43520) 2024-09-10T22:29:04.190 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:04.184+0000 7fd966108640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56070b93cbd0 0x56070b94bf40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.19:54010/0 (socket says 172.21.15.19:54010) 2024-09-10T22:29:04.190 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:04.184+0000 7fd965907640 1 -- 172.21.15.19:0/2531975233 learned_addr learned my addr 172.21.15.19:0/2531975233 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:29:04.190 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:04.184+0000 7fd965907640 1 -- 172.21.15.19:0/2531975233 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56070b93cbd0 msgr2=0x56070b94bf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:29:04.190 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:04.184+0000 7fd965907640 1 --2- 172.21.15.19:0/2531975233 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56070b93cbd0 0x56070b94bf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:29:04.190 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:04.184+0000 7fd965907640 1 -- 172.21.15.19:0/2531975233 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56070b93a190 msgr2=0x56070b94ba00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:29:04.190 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:04.184+0000 7fd965907640 1 --2- 172.21.15.19:0/2531975233 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56070b93a190 0x56070b94ba00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:29:04.190 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:04.184+0000 7fd965907640 1 -- 172.21.15.19:0/2531975233 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56070b939fc0 con 0x56070b937860 2024-09-10T22:29:04.190 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:04.184+0000 7fd965907640 1 --2- 172.21.15.19:0/2531975233 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x56070b937860 0x56070b94cd00 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fd95c0057c0 tx=0x7fd95c012190 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8abeac4d2d4b8f1e server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:29:04.190 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:04.184+0000 7fd9497fa640 10 client.0 ms_handle_connect on v2:172.21.15.138:3300/0 2024-09-10T22:29:04.191 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:04.185+0000 7fd9497fa640 1 -- 172.21.15.19:0/2531975233 <== mon.1 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd95c00f9c0 con 0x56070b937860 2024-09-10T22:29:04.191 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:04.185+0000 7fd96aa1b740 1 -- 172.21.15.19:0/2531975233 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd95c00f810 con 0x56070b937860 2024-09-10T22:29:04.191 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:04.185+0000 7fd9497fa640 1 -- 172.21.15.19:0/2531975233 <== mon.1 v2:172.21.15.138:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8327+0+0 (secure 0 0 0) 0x7fd95c00fb60 con 0x56070b937860 2024-09-10T22:29:04.191 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:04.185+0000 7fd9497fa640 1 -- 172.21.15.19:0/2531975233 <== mon.1 v2:172.21.15.138:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7fd95c00fd60 con 0x56070b937860 2024-09-10T22:29:04.191 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:04.185+0000 7fd96aa1b740 10 client.25390 fetch_fsmap learned FSMap version 26 2024-09-10T22:29:04.191 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:04.185+0000 7fd96aa1b740 1 -- 172.21.15.19:0/2531975233 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x56070b9bd680 con 0x56070b937860 2024-09-10T22:29:04.191 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:04.185+0000 7fd9497fa640 1 -- 172.21.15.19:0/2531975233 <== mon.1 v2:172.21.15.138:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd95c00f810 con 0x56070b937860 2024-09-10T22:29:04.191 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:04.185+0000 7fd9497fa640 1 -- 172.21.15.19:0/2531975233 <== mon.1 v2:172.21.15.138:3300/0 5 ==== fsmap(e 26) ==== 8350+0+0 (secure 0 0 0) 0x7fd95c027550 con 0x56070b937860 2024-09-10T22:29:04.191 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:04.185+0000 7fd96aa1b740 10 client.25390 fetch_fsmap finished waiting for FSMap version 26 2024-09-10T22:29:04.191 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:04.185+0000 7fd96aa1b740 10 client.25390 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-10T22:29:04.191 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:04.185+0000 7fd96aa1b740 20 client.25390 populate_metadata read hostname 'smithi019' 2024-09-10T22:29:04.191 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:04.185+0000 7fd96aa1b740 1 --2- 172.21.15.19:0/2531975233 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x56070b9bdef0 0x56070b9c0310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:29:04.191 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:04.185+0000 7fd96aa1b740 4 client.25390 mds_command: new command op to 24581 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-10T22:29:04.192 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:04.185+0000 7fd96aa1b740 1 -- 172.21.15.19:0/2531975233 --> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] -- command(tid 0: {"prefix": "flush journal"}) -- 0x56070b8a70f0 con 0x56070b9bdef0 2024-09-10T22:29:04.192 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:04.186+0000 7fd965106640 1 --2- 172.21.15.19:0/2531975233 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x56070b9bdef0 0x56070b9c0310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:29:04.192 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:04.186+0000 7fd9497fa640 10 client.25390 ms_handle_connect on v2:172.21.15.135:6838/1254769802 2024-09-10T22:29:04.192 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:04.186+0000 7fd965106640 1 --2- 172.21.15.19:0/2531975233 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x56070b9bdef0 0x56070b9c0310 crc :-1 s=READY pgs=75 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=157150bf2f13ad9 server_cookie=18063c44a2a5153e in_seq=0 out_seq=0 2024-09-10T22:29:06.109 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:29:05 smithi135 ceph-mon[34789]: pgmap v427: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 720 KiB/s rd, 361 MiB/s wr, 160 op/s 2024-09-10T22:29:06.125 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:29:05 smithi138 ceph-mon[35236]: pgmap v427: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 720 KiB/s rd, 361 MiB/s wr, 160 op/s 2024-09-10T22:29:06.131 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:06.129+0000 7fd9497fa640 1 -- 172.21.15.19:0/2531975233 <== mds.0 v2:172.21.15.135:6838/1254769802 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x56070b8a70f0 con 0x56070b9bdef0 2024-09-10T22:29:06.131 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:06.129+0000 7fd9497fa640 10 client.25390 handle_command_reply: tid=0 2024-09-10T22:29:06.131 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:06.129+0000 7fd96aa1b740 1 client.25390 shutdown 2024-09-10T22:29:06.132 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:06.130+0000 7fd96aa1b740 1 -- 172.21.15.19:0/2531975233 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x56070b937860 msgr2=0x56070b94cd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:29:06.132 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:06.130+0000 7fd96aa1b740 1 --2- 172.21.15.19:0/2531975233 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x56070b937860 0x56070b94cd00 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fd95c0057c0 tx=0x7fd95c012190 comp rx=0 tx=0).stop 2024-09-10T22:29:06.132 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:06.130+0000 7fd96aa1b740 1 -- 172.21.15.19:0/2531975233 shutdown_connections 2024-09-10T22:29:06.132 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:06.130+0000 7fd96aa1b740 1 --2- 172.21.15.19:0/2531975233 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56070b93cbd0 0x56070b94bf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:29:06.132 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:06.130+0000 7fd96aa1b740 1 --2- 172.21.15.19:0/2531975233 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56070b93a190 0x56070b94ba00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:29:06.132 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:06.130+0000 7fd96aa1b740 1 --2- 172.21.15.19:0/2531975233 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x56070b9bdef0 0x56070b9c0310 crc :-1 s=READY pgs=75 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:29:06.132 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:06.130+0000 7fd96aa1b740 1 --2- 172.21.15.19:0/2531975233 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x56070b937860 0x56070b94cd00 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:29:06.132 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:06.130+0000 7fd9497fa640 0 client.25390 ms_handle_reset on v2:172.21.15.135:6838/1254769802 2024-09-10T22:29:06.132 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:06.130+0000 7fd96aa1b740 1 -- 172.21.15.19:0/2531975233 >> 172.21.15.19:0/2531975233 conn(0x56070b9329b0 msgr2=0x56070b936d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:29:06.133 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:06.130+0000 7fd96aa1b740 1 -- 172.21.15.19:0/2531975233 shutdown_connections 2024-09-10T22:29:06.133 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:06.130+0000 7fd96aa1b740 1 -- 172.21.15.19:0/2531975233 wait complete. 2024-09-10T22:29:06.133 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:06.130+0000 7fd96aa1b740 20 client.25390 trim_cache size 0 max 16384 2024-09-10T22:29:06.133 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stdout:{ 2024-09-10T22:29:06.133 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stdout: "message": "", 2024-09-10T22:29:06.133 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stdout: "return_code": 0 2024-09-10T22:29:06.133 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stdout:} 2024-09-10T22:29:06.134 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:06.131+0000 7fd967b6b640 1 -- 172.21.15.19:0/3398554630 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7fd94c0b5360 msgr2=0x7fd94c0b7820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:29:06.134 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:06.131+0000 7fd967b6b640 1 --2- 172.21.15.19:0/3398554630 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7fd94c0b5360 0x7fd94c0b7820 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fd958045000 tx=0x7fd958047000 comp rx=0 tx=0).stop 2024-09-10T22:29:06.134 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:06.131+0000 7fd967b6b640 1 -- 172.21.15.19:0/3398554630 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd9601029e0 msgr2=0x7fd960199390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:29:06.134 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:06.131+0000 7fd967b6b640 1 --2- 172.21.15.19:0/3398554630 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd9601029e0 0x7fd960199390 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fd95000e9f0 tx=0x7fd95000eeb0 comp rx=0 tx=0).stop 2024-09-10T22:29:06.134 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:06.131+0000 7fd967b6b640 1 -- 172.21.15.19:0/3398554630 shutdown_connections 2024-09-10T22:29:06.134 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:06.131+0000 7fd967b6b640 1 --2- 172.21.15.19:0/3398554630 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7fd94c0b5360 0x7fd94c0b7820 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:29:06.134 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:06.131+0000 7fd967b6b640 1 --2- 172.21.15.19:0/3398554630 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd9601033a0 0x7fd960199fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:29:06.134 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:06.131+0000 7fd967b6b640 1 --2- 172.21.15.19:0/3398554630 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd9601029e0 0x7fd960199390 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:29:06.135 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:06.131+0000 7fd967b6b640 1 --2- 172.21.15.19:0/3398554630 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd960101890 0x7fd960198d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:29:06.135 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:06.131+0000 7fd967b6b640 1 -- 172.21.15.19:0/3398554630 >> 172.21.15.19:0/3398554630 conn(0x7fd9600fd150 msgr2=0x7fd9600feb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:29:06.135 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:06.131+0000 7fd967b6b640 1 -- 172.21.15.19:0/3398554630 shutdown_connections 2024-09-10T22:29:06.135 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:06.131+0000 7fd967b6b640 1 -- 172.21.15.19:0/3398554630 wait complete. 2024-09-10T22:29:06.208 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:29:05 smithi019 ceph-mon[31375]: pgmap v427: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 720 KiB/s rd, 361 MiB/s wr, 160 op/s 2024-09-10T22:29:08.209 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:29:07 smithi019 ceph-mon[31375]: pgmap v428: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 991 KiB/s rd, 393 MiB/s wr, 197 op/s 2024-09-10T22:29:08.359 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:29:07 smithi135 ceph-mon[34789]: pgmap v428: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 991 KiB/s rd, 393 MiB/s wr, 197 op/s 2024-09-10T22:29:08.374 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:29:07 smithi138 ceph-mon[35236]: pgmap v428: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 991 KiB/s rd, 393 MiB/s wr, 197 op/s 2024-09-10T22:29:10.359 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:29:10 smithi135 ceph-mon[34789]: pgmap v429: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 685 KiB/s rd, 347 MiB/s wr, 181 op/s 2024-09-10T22:29:10.374 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:29:10 smithi138 ceph-mon[35236]: pgmap v429: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 685 KiB/s rd, 347 MiB/s wr, 181 op/s 2024-09-10T22:29:10.458 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:29:10 smithi019 ceph-mon[31375]: pgmap v429: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 685 KiB/s rd, 347 MiB/s wr, 181 op/s 2024-09-10T22:29:12.324 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:29:12 smithi019 ceph-mon[31375]: pgmap v430: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 395 MiB/s wr, 209 op/s 2024-09-10T22:29:12.359 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:29:12 smithi135 ceph-mon[34789]: pgmap v430: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 395 MiB/s wr, 209 op/s 2024-09-10T22:29:12.362 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 22997a4c-6fc2-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-10T22:29:12.375 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:29:12 smithi138 ceph-mon[35236]: pgmap v430: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 395 MiB/s wr, 209 op/s 2024-09-10T22:29:12.775 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/22997a4c-6fc2-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T22:29:13.442 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:13.430+0000 7f826aae7640 1 -- 172.21.15.19:0/1927342208 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f82641087a0 msgr2=0x7f8264108be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:29:13.443 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:13.430+0000 7f826aae7640 1 --2- 172.21.15.19:0/1927342208 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f82641087a0 0x7f8264108be0 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f8250009900 tx=0x7f825002a410 comp rx=0 tx=0).stop 2024-09-10T22:29:13.443 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:13.430+0000 7f826aae7640 1 -- 172.21.15.19:0/1927342208 shutdown_connections 2024-09-10T22:29:13.443 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:13.430+0000 7f826aae7640 1 --2- 172.21.15.19:0/1927342208 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f8264109120 0x7f826410f920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:29:13.443 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:13.430+0000 7f826aae7640 1 --2- 172.21.15.19:0/1927342208 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f82641087a0 0x7f8264108be0 unknown :-1 s=CLOSED pgs=522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:29:13.443 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:13.430+0000 7f826aae7640 1 --2- 172.21.15.19:0/1927342208 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8264102d90 0x7f8264103170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:29:13.443 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:13.430+0000 7f826aae7640 1 -- 172.21.15.19:0/1927342208 >> 172.21.15.19:0/1927342208 conn(0x7f82640fe820 msgr2=0x7f8264100c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:29:13.443 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:13.430+0000 7f826aae7640 1 -- 172.21.15.19:0/1927342208 shutdown_connections 2024-09-10T22:29:13.443 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:13.430+0000 7f826aae7640 1 -- 172.21.15.19:0/1927342208 wait complete. 2024-09-10T22:29:13.443 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:13.431+0000 7f826aae7640 1 Processor -- start 2024-09-10T22:29:13.443 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:13.431+0000 7f826aae7640 1 -- start start 2024-09-10T22:29:13.443 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:13.431+0000 7f826aae7640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f8264102d90 0x7f8264199290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:29:13.444 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:13.431+0000 7f826aae7640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f82641087a0 0x7f82641997d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:29:13.444 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:13.431+0000 7f826aae7640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8264109120 0x7f826419eb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:29:13.444 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:13.431+0000 7f826aae7640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f8264112da0 con 0x7f82641087a0 2024-09-10T22:29:13.444 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:13.431+0000 7f826aae7640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f8264112c20 con 0x7f8264109120 2024-09-10T22:29:13.444 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:13.431+0000 7f826aae7640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f8264112f20 con 0x7f8264102d90 2024-09-10T22:29:13.444 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:13.431+0000 7f8263fff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f82641087a0 0x7f82641997d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:29:13.444 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:13.431+0000 7f8263fff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f82641087a0 0x7f82641997d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:35816/0 (socket says 172.21.15.19:35816) 2024-09-10T22:29:13.444 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:13.431+0000 7f8268883640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f8264102d90 0x7f8264199290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:29:13.444 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:13.431+0000 7f8263fff640 1 -- 172.21.15.19:0/1550154452 learned_addr learned my addr 172.21.15.19:0/1550154452 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:29:13.444 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:13.431+0000 7f8269084640 1 --2- 172.21.15.19:0/1550154452 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8264109120 0x7f826419eb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:29:13.444 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:13.431+0000 7f8268883640 1 -- 172.21.15.19:0/1550154452 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8264109120 msgr2=0x7f826419eb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:29:13.444 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:13.431+0000 7f8268883640 1 --2- 172.21.15.19:0/1550154452 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8264109120 0x7f826419eb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:29:13.444 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:13.431+0000 7f8268883640 1 -- 172.21.15.19:0/1550154452 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f82641087a0 msgr2=0x7f82641997d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:29:13.445 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:13.431+0000 7f8268883640 1 --2- 172.21.15.19:0/1550154452 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f82641087a0 0x7f82641997d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:29:13.445 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:13.432+0000 7f8268883640 1 -- 172.21.15.19:0/1550154452 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f826419f340 con 0x7f8264102d90 2024-09-10T22:29:13.445 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:13.432+0000 7f8268883640 1 --2- 172.21.15.19:0/1550154452 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f8264102d90 0x7f8264199290 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f825800e9f0 tx=0x7f825800eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:29:13.445 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:13.432+0000 7f8261ffb640 1 -- 172.21.15.19:0/1550154452 <== mon.1 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f825800ccc0 con 0x7f8264102d90 2024-09-10T22:29:13.445 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:13.432+0000 7f826aae7640 1 -- 172.21.15.19:0/1550154452 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f826419f630 con 0x7f8264102d90 2024-09-10T22:29:13.445 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:13.432+0000 7f8261ffb640 1 -- 172.21.15.19:0/1550154452 <== mon.1 v2:172.21.15.138:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f82580108e0 con 0x7f8264102d90 2024-09-10T22:29:13.445 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:13.432+0000 7f8261ffb640 1 -- 172.21.15.19:0/1550154452 <== mon.1 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8258018880 con 0x7f8264102d90 2024-09-10T22:29:13.445 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:13.432+0000 7f826aae7640 1 -- 172.21.15.19:0/1550154452 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f82641a5cf0 con 0x7f8264102d90 2024-09-10T22:29:13.445 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:13.435+0000 7f8261ffb640 1 -- 172.21.15.19:0/1550154452 <== mon.1 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 18) ==== 153250+0+0 (secure 0 0 0) 0x7f8258010430 con 0x7f8264102d90 2024-09-10T22:29:13.445 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:13.435+0000 7f826cebc740 1 Processor -- start 2024-09-10T22:29:13.445 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:13.435+0000 7f826cebc740 1 -- start start 2024-09-10T22:29:13.445 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:13.435+0000 7f826cebc740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5564ffc1b480 0x5564ffc1b860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:29:13.446 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:13.435+0000 7f826cebc740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5564ffc1bda0 0x5564ffc2bc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:29:13.446 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:13.435+0000 7f826cebc740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5564ffc2c140 0x5564ffc2e530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:29:13.446 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:13.435+0000 7f826cebc740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x5564ffb91e50 con 0x5564ffc1bda0 2024-09-10T22:29:13.446 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:13.435+0000 7f826cebc740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x5564ffb81280 con 0x5564ffc2c140 2024-09-10T22:29:13.446 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:13.435+0000 7f826cebc740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x5564ffb85090 con 0x5564ffc1b480 2024-09-10T22:29:13.446 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:13.435+0000 7f8268883640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5564ffc1bda0 0x5564ffc2bc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:29:13.446 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:13.435+0000 7f8269084640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5564ffc1b480 0x5564ffc1b860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:29:13.446 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:13.436+0000 7f8269084640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5564ffc1b480 0x5564ffc1b860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.19:58180/0 (socket says 172.21.15.19:58180) 2024-09-10T22:29:13.446 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:13.436+0000 7f8269084640 1 -- 172.21.15.19:0/1657581980 learned_addr learned my addr 172.21.15.19:0/1657581980 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:29:13.447 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:13.436+0000 7f8263fff640 1 --2- 172.21.15.19:0/1657581980 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5564ffc2c140 0x5564ffc2e530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:29:13.447 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:13.436+0000 7f8269084640 1 -- 172.21.15.19:0/1657581980 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5564ffc2c140 msgr2=0x5564ffc2e530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:29:13.447 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:13.436+0000 7f8269084640 1 --2- 172.21.15.19:0/1657581980 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5564ffc2c140 0x5564ffc2e530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:29:13.447 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:13.436+0000 7f8269084640 1 -- 172.21.15.19:0/1657581980 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5564ffc1bda0 msgr2=0x5564ffc2bc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:29:13.447 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:13.436+0000 7f8269084640 1 --2- 172.21.15.19:0/1657581980 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5564ffc1bda0 0x5564ffc2bc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:29:13.447 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:13.436+0000 7f8269084640 1 -- 172.21.15.19:0/1657581980 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5564ff8df650 con 0x5564ffc1b480 2024-09-10T22:29:13.447 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:13.436+0000 7f8261ffb640 1 --2- 172.21.15.19:0/1550154452 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f82540b52e0 0x7f82540b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:29:13.447 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:13.436+0000 7f8269084640 1 --2- 172.21.15.19:0/1657581980 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5564ffc1b480 0x5564ffc1b860 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f825c011440 tx=0x7f825c011900 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f246aa3031878c86 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:29:13.447 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:13.436+0000 7f8268883640 1 --2- 172.21.15.19:0/1550154452 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f82540b52e0 0x7f82540b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:29:13.447 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:13.436+0000 7f824effd640 1 -- 172.21.15.19:0/1657581980 <== mon.1 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f825c004d20 con 0x5564ffc1b480 2024-09-10T22:29:13.447 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:13.436+0000 7f824effd640 1 -- 172.21.15.19:0/1657581980 <== mon.1 v2:172.21.15.138:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f825c004050 con 0x5564ffc1b480 2024-09-10T22:29:13.447 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:13.436+0000 7f824effd640 1 -- 172.21.15.19:0/1657581980 <== mon.1 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f825c00f7a0 con 0x5564ffc1b480 2024-09-10T22:29:13.448 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:13.437+0000 7f8261ffb640 1 -- 172.21.15.19:0/1550154452 <== mon.1 v2:172.21.15.138:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8327+0+0 (secure 0 0 0) 0x7f82580e5f90 con 0x7f8264102d90 2024-09-10T22:29:13.448 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:13.437+0000 7f826cebc740 1 -- 172.21.15.19:0/1657581980 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5564ffc1b480 msgr2=0x5564ffc1b860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:29:13.448 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:13.437+0000 7f8268883640 1 --2- 172.21.15.19:0/1550154452 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f82540b52e0 0x7f82540b77a0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f82580a8d10 tx=0x7f82580e99d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:29:13.448 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:13.437+0000 7f826cebc740 1 --2- 172.21.15.19:0/1657581980 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5564ffc1b480 0x5564ffc1b860 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f825c011440 tx=0x7f825c011900 comp rx=0 tx=0).stop 2024-09-10T22:29:13.448 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:13.437+0000 7f826cebc740 1 -- 172.21.15.19:0/1657581980 shutdown_connections 2024-09-10T22:29:13.448 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:13.437+0000 7f826cebc740 1 --2- 172.21.15.19:0/1657581980 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5564ffc2c140 0x5564ffc2e530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:29:13.448 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:13.437+0000 7f826cebc740 1 --2- 172.21.15.19:0/1657581980 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5564ffc1bda0 0x5564ffc2bc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:29:13.448 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:13.437+0000 7f826cebc740 1 --2- 172.21.15.19:0/1657581980 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5564ffc1b480 0x5564ffc1b860 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:29:13.448 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:13.437+0000 7f826cebc740 1 -- 172.21.15.19:0/1657581980 >> 172.21.15.19:0/1657581980 conn(0x5564ffc192b0 msgr2=0x5564ffc1a450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:29:13.448 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:13.438+0000 7f826cebc740 1 -- 172.21.15.19:0/1657581980 shutdown_connections 2024-09-10T22:29:13.448 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:13.438+0000 7f826cebc740 1 -- 172.21.15.19:0/1657581980 wait complete. 2024-09-10T22:29:13.448 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:13.438+0000 7f826cebc740 1 -- start start 2024-09-10T22:29:13.449 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:13.438+0000 7f826cebc740 1 Processor -- start 2024-09-10T22:29:13.449 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:13.439+0000 7f826cebc740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5564ffc1b480 0x5564ffc2baa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:29:13.449 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:13.439+0000 7f826cebc740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5564ffc1bda0 0x5564ffc28ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:29:13.449 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:13.439+0000 7f826cebc740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5564ffc2c140 0x5564ffc29570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:29:13.449 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:13.439+0000 7f826cebc740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x5564ff9e2700 con 0x5564ffc1bda0 2024-09-10T22:29:13.449 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:13.439+0000 7f826cebc740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x5564ffb1c110 con 0x5564ffc1b480 2024-09-10T22:29:13.449 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:13.439+0000 7f826cebc740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x5564ffc2edf0 con 0x5564ffc2c140 2024-09-10T22:29:13.449 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:13.439+0000 7f826cebc740 10 client.0 _ll_register_callbacks cb 0x5564ffb35990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T22:29:13.449 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:13.439+0000 7f8269084640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5564ffc1b480 0x5564ffc2baa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:29:13.449 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:13.439+0000 7f8269084640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5564ffc1b480 0x5564ffc2baa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.19:37972/0 (socket says 172.21.15.19:37972) 2024-09-10T22:29:13.449 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:13.439+0000 7f8269084640 1 -- 172.21.15.19:0/1660743312 learned_addr learned my addr 172.21.15.19:0/1660743312 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:29:13.449 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:13.439+0000 7f8263fff640 1 --2- 172.21.15.19:0/1660743312 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5564ffc1bda0 0x5564ffc28ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:29:13.450 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:13.439+0000 7f8269084640 1 --2- 172.21.15.19:0/1660743312 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5564ffc2c140 0x5564ffc29570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:29:13.450 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:13.439+0000 7f8269084640 1 -- 172.21.15.19:0/1660743312 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5564ffc2c140 msgr2=0x5564ffc29570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:29:13.450 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:13.439+0000 7f8269084640 1 --2- 172.21.15.19:0/1660743312 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5564ffc2c140 0x5564ffc29570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:29:13.450 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:13.439+0000 7f8269084640 1 -- 172.21.15.19:0/1660743312 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5564ffc1bda0 msgr2=0x5564ffc28ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:29:13.450 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:13.439+0000 7f8269084640 1 --2- 172.21.15.19:0/1660743312 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5564ffc1bda0 0x5564ffc28ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:29:13.450 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:13.439+0000 7f8269084640 1 -- 172.21.15.19:0/1660743312 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5564ffb49c40 con 0x5564ffc1b480 2024-09-10T22:29:13.450 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:13.440+0000 7f8243fff640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-09-10T22:29:13.450 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:13.440+0000 7f8269084640 1 --2- 172.21.15.19:0/1660743312 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5564ffc1b480 0x5564ffc2baa0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f825c009270 tx=0x7f825c003f50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a07a5e5d01ab0c7 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:29:13.450 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:13.440+0000 7f8243fff640 1 -- 172.21.15.19:0/1660743312 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f825c01d070 con 0x5564ffc1b480 2024-09-10T22:29:13.450 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:13.440+0000 7f8243fff640 1 -- 172.21.15.19:0/1660743312 <== mon.2 v2:172.21.15.135:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8327+0+0 (secure 0 0 0) 0x7f825c00f540 con 0x5564ffc1b480 2024-09-10T22:29:13.450 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:13.440+0000 7f826cebc740 1 -- 172.21.15.19:0/1660743312 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f825c004050 con 0x5564ffc1b480 2024-09-10T22:29:13.450 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:13.440+0000 7f8243fff640 1 -- 172.21.15.19:0/1660743312 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f825c00f740 con 0x5564ffc1b480 2024-09-10T22:29:13.450 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:13.440+0000 7f826cebc740 10 client.25415 fetch_fsmap learned FSMap version 26 2024-09-10T22:29:13.451 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:13.440+0000 7f826cebc740 1 -- 172.21.15.19:0/1660743312 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x5564ffc3a7d0 con 0x5564ffc1b480 2024-09-10T22:29:13.451 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:13.441+0000 7f8243fff640 1 -- 172.21.15.19:0/1660743312 <== mon.2 v2:172.21.15.135:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f825c004050 con 0x5564ffc1b480 2024-09-10T22:29:13.451 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:13.441+0000 7f8243fff640 1 -- 172.21.15.19:0/1660743312 <== mon.2 v2:172.21.15.135:3300/0 5 ==== fsmap(e 26) ==== 8350+0+0 (secure 0 0 0) 0x7f825c030030 con 0x5564ffc1b480 2024-09-10T22:29:13.451 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:13.441+0000 7f826cebc740 10 client.25415 fetch_fsmap finished waiting for FSMap version 26 2024-09-10T22:29:13.451 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:13.441+0000 7f826cebc740 10 client.25415 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-10T22:29:13.451 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:13.441+0000 7f826cebc740 20 client.25415 populate_metadata read hostname 'smithi019' 2024-09-10T22:29:13.451 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:13.441+0000 7f826cebc740 1 --2- 172.21.15.19:0/1660743312 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x5564ffc3bb80 0x5564ffc3df70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:29:13.451 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:13.441+0000 7f826cebc740 4 client.25415 mds_command: new command op to 24581 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T22:29:13.451 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:13.441+0000 7f826cebc740 1 -- 172.21.15.19:0/1660743312 --> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5564ffb93da0 con 0x5564ffc3bb80 2024-09-10T22:29:13.451 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:13.441+0000 7f8263fff640 1 --2- 172.21.15.19:0/1660743312 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x5564ffc3bb80 0x5564ffc3df70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:29:13.452 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:13.442+0000 7f8263fff640 1 --2- 172.21.15.19:0/1660743312 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x5564ffc3bb80 0x5564ffc3df70 crc :-1 s=READY pgs=76 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2b38e1ed9a0e86c9 server_cookie=59d6f78af8d29be in_seq=0 out_seq=0 2024-09-10T22:29:13.452 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:13.442+0000 7f8243fff640 10 client.25415 ms_handle_connect on v2:172.21.15.135:6838/1254769802 2024-09-10T22:29:13.453 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:13.443+0000 7f8243fff640 1 -- 172.21.15.19:0/1660743312 <== mds.0 v2:172.21.15.135:6838/1254769802 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5564ffb93da0 con 0x5564ffc3bb80 2024-09-10T22:29:13.453 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:13.443+0000 7f8243fff640 10 client.25415 handle_command_reply: tid=0 2024-09-10T22:29:13.453 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:13.443+0000 7f826cebc740 1 client.25415 shutdown 2024-09-10T22:29:13.453 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:13.443+0000 7f826cebc740 1 -- 172.21.15.19:0/1660743312 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5564ffc1b480 msgr2=0x5564ffc2baa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:29:13.453 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:13.443+0000 7f826cebc740 1 --2- 172.21.15.19:0/1660743312 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5564ffc1b480 0x5564ffc2baa0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f825c009270 tx=0x7f825c003f50 comp rx=0 tx=0).stop 2024-09-10T22:29:13.453 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:13.443+0000 7f826cebc740 1 -- 172.21.15.19:0/1660743312 shutdown_connections 2024-09-10T22:29:13.453 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:13.443+0000 7f826cebc740 1 --2- 172.21.15.19:0/1660743312 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x5564ffc3bb80 0x5564ffc3df70 crc :-1 s=READY pgs=76 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:29:13.453 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:13.443+0000 7f826cebc740 1 --2- 172.21.15.19:0/1660743312 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5564ffc2c140 0x5564ffc29570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:29:13.453 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:13.443+0000 7f826cebc740 1 --2- 172.21.15.19:0/1660743312 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5564ffc1bda0 0x5564ffc28ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:29:13.453 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:13.443+0000 7f8243fff640 0 client.25415 ms_handle_reset on v2:172.21.15.135:6838/1254769802 2024-09-10T22:29:13.453 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:13.443+0000 7f826cebc740 1 --2- 172.21.15.19:0/1660743312 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5564ffc1b480 0x5564ffc2baa0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:29:13.453 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:13.443+0000 7f826cebc740 1 -- 172.21.15.19:0/1660743312 >> 172.21.15.19:0/1660743312 conn(0x5564ffc192b0 msgr2=0x5564ffc1ee50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:29:13.454 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:13.443+0000 7f826cebc740 1 -- 172.21.15.19:0/1660743312 shutdown_connections 2024-09-10T22:29:13.454 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:13.443+0000 7f826cebc740 1 -- 172.21.15.19:0/1660743312 wait complete. 2024-09-10T22:29:13.454 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:13.443+0000 7f826cebc740 20 client.25415 trim_cache size 0 max 16384 2024-09-10T22:29:13.467 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:13.465+0000 7f826cebc740 1 Processor -- start 2024-09-10T22:29:13.467 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:13.465+0000 7f826cebc740 1 -- start start 2024-09-10T22:29:13.467 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:13.465+0000 7f826cebc740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5564ffc1b480 0x5564ffc38050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:29:13.467 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:13.465+0000 7f826cebc740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5564ffc1bda0 0x5564ffc43730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:29:13.467 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:13.465+0000 7f826cebc740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5564ffc2c140 0x5564ffc43c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:29:13.467 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:13.465+0000 7f826cebc740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f82641aec90 con 0x5564ffc1b480 2024-09-10T22:29:13.467 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:13.465+0000 7f826cebc740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f82641ac560 con 0x5564ffc2c140 2024-09-10T22:29:13.468 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:13.465+0000 7f826cebc740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f82641aa3b0 con 0x5564ffc1bda0 2024-09-10T22:29:13.468 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:13.465+0000 7f8269084640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5564ffc1b480 0x5564ffc38050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:29:13.468 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:13.465+0000 7f8269084640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5564ffc1b480 0x5564ffc38050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:35834/0 (socket says 172.21.15.19:35834) 2024-09-10T22:29:13.468 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:13.465+0000 7f8269084640 1 -- 172.21.15.19:0/2319691714 learned_addr learned my addr 172.21.15.19:0/2319691714 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:29:13.468 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:13.465+0000 7f8263fff640 1 --2- 172.21.15.19:0/2319691714 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5564ffc1bda0 0x5564ffc43730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:29:13.468 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:13.465+0000 7f8269084640 1 --2- 172.21.15.19:0/2319691714 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5564ffc2c140 0x5564ffc43c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:29:13.468 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:13.466+0000 7f8263fff640 1 -- 172.21.15.19:0/2319691714 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5564ffc2c140 msgr2=0x5564ffc43c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:29:13.468 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:13.466+0000 7f8263fff640 1 --2- 172.21.15.19:0/2319691714 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5564ffc2c140 0x5564ffc43c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:29:13.468 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:13.466+0000 7f8263fff640 1 -- 172.21.15.19:0/2319691714 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5564ffc1b480 msgr2=0x5564ffc38050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:29:13.468 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:13.466+0000 7f8263fff640 1 --2- 172.21.15.19:0/2319691714 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5564ffc1b480 0x5564ffc38050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:29:13.468 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:13.466+0000 7f8263fff640 1 -- 172.21.15.19:0/2319691714 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5564ffc3e500 con 0x5564ffc1bda0 2024-09-10T22:29:13.469 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:13.466+0000 7f8269084640 1 --2- 172.21.15.19:0/2319691714 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5564ffc1b480 0x5564ffc38050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T22:29:13.470 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:13.466+0000 7f8263fff640 1 --2- 172.21.15.19:0/2319691714 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5564ffc1bda0 0x5564ffc43730 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f8250004770 tx=0x7f82500058d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1fe35d4a10767966 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:29:13.470 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:13.466+0000 7f824e7fc640 1 -- 172.21.15.19:0/2319691714 <== mon.1 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f825004a070 con 0x5564ffc1bda0 2024-09-10T22:29:13.470 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:13.467+0000 7f824e7fc640 1 -- 172.21.15.19:0/2319691714 <== mon.1 v2:172.21.15.138:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8250031950 con 0x5564ffc1bda0 2024-09-10T22:29:13.470 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:13.467+0000 7f824e7fc640 1 -- 172.21.15.19:0/2319691714 <== mon.1 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8250035040 con 0x5564ffc1bda0 2024-09-10T22:29:13.470 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:13.468+0000 7f826cebc740 1 -- 172.21.15.19:0/2319691714 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5564ffc1bda0 msgr2=0x5564ffc43730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:29:13.470 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:13.468+0000 7f826cebc740 1 --2- 172.21.15.19:0/2319691714 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5564ffc1bda0 0x5564ffc43730 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f8250004770 tx=0x7f82500058d0 comp rx=0 tx=0).stop 2024-09-10T22:29:13.470 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:13.468+0000 7f826cebc740 1 -- 172.21.15.19:0/2319691714 shutdown_connections 2024-09-10T22:29:13.470 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:13.468+0000 7f826cebc740 1 --2- 172.21.15.19:0/2319691714 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5564ffc2c140 0x5564ffc43c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:29:13.471 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:13.468+0000 7f826cebc740 1 --2- 172.21.15.19:0/2319691714 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5564ffc1bda0 0x5564ffc43730 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:29:13.471 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:13.468+0000 7f826cebc740 1 --2- 172.21.15.19:0/2319691714 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5564ffc1b480 0x5564ffc38050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:29:13.471 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:13.468+0000 7f826cebc740 1 -- 172.21.15.19:0/2319691714 >> 172.21.15.19:0/2319691714 conn(0x5564ffc192b0 msgr2=0x5564ffc2a520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:29:13.471 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:13.468+0000 7f826cebc740 1 -- 172.21.15.19:0/2319691714 shutdown_connections 2024-09-10T22:29:13.471 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:13.468+0000 7f826cebc740 1 -- 172.21.15.19:0/2319691714 wait complete. 2024-09-10T22:29:13.471 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:13.468+0000 7f826cebc740 1 -- start start 2024-09-10T22:29:13.471 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:13.469+0000 7f826cebc740 1 Processor -- start 2024-09-10T22:29:13.473 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:13.469+0000 7f826cebc740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5564ffc1b480 0x5564ffc348f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:29:13.474 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:13.469+0000 7f826cebc740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5564ffc1bda0 0x5564ffc31080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:29:13.474 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:13.469+0000 7f826cebc740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5564ffc2c140 0x5564ffc31640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:29:13.474 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:13.469+0000 7f826cebc740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f82641aaa20 con 0x5564ffc1b480 2024-09-10T22:29:13.474 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:13.469+0000 7f826cebc740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f82641abe90 con 0x5564ffc2c140 2024-09-10T22:29:13.474 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:13.469+0000 7f826cebc740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f82641ab0f0 con 0x5564ffc1bda0 2024-09-10T22:29:13.474 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:13.469+0000 7f826cebc740 10 client.0 _ll_register_callbacks cb 0x7f82580e98a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T22:29:13.474 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:13.469+0000 7f8269084640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5564ffc1b480 0x5564ffc348f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:29:13.474 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:13.469+0000 7f8263fff640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5564ffc1bda0 0x5564ffc31080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:29:13.474 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:13.469+0000 7f8263fff640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5564ffc1bda0 0x5564ffc31080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.19:58218/0 (socket says 172.21.15.19:58218) 2024-09-10T22:29:13.474 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:13.469+0000 7f8263fff640 1 -- 172.21.15.19:0/548124020 learned_addr learned my addr 172.21.15.19:0/548124020 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:29:13.474 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:13.470+0000 7f8269084640 1 --2- 172.21.15.19:0/548124020 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5564ffc2c140 0x5564ffc31640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:29:13.475 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:13.470+0000 7f8269084640 1 -- 172.21.15.19:0/548124020 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5564ffc1bda0 msgr2=0x5564ffc31080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:29:13.475 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:13.470+0000 7f8269084640 1 --2- 172.21.15.19:0/548124020 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5564ffc1bda0 0x5564ffc31080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:29:13.475 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:13.470+0000 7f8269084640 1 -- 172.21.15.19:0/548124020 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5564ffc2c140 msgr2=0x5564ffc31640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:29:13.475 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:13.470+0000 7f8269084640 1 --2- 172.21.15.19:0/548124020 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5564ffc2c140 0x5564ffc31640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:29:13.475 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:13.470+0000 7f8269084640 1 -- 172.21.15.19:0/548124020 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5564ffc18f00 con 0x5564ffc1b480 2024-09-10T22:29:13.475 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:13.470+0000 7f8269084640 1 --2- 172.21.15.19:0/548124020 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5564ffc1b480 0x5564ffc348f0 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f825c009de0 tx=0x7f825c005fd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7b0cfbe636a98a98 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:29:13.475 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:13.470+0000 7f8243fff640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-10T22:29:13.475 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:13.470+0000 7f8243fff640 1 -- 172.21.15.19:0/548124020 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f825c01d070 con 0x5564ffc1b480 2024-09-10T22:29:13.475 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:13.470+0000 7f8243fff640 1 -- 172.21.15.19:0/548124020 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8327+0+0 (secure 0 0 0) 0x7f825c019430 con 0x5564ffc1b480 2024-09-10T22:29:13.475 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:13.470+0000 7f826cebc740 1 -- 172.21.15.19:0/548124020 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5564ffb8f850 con 0x5564ffc1b480 2024-09-10T22:29:13.475 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:13.471+0000 7f8243fff640 1 -- 172.21.15.19:0/548124020 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f825c046050 con 0x5564ffc1b480 2024-09-10T22:29:13.475 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:13.471+0000 7f826cebc740 10 client.15888 fetch_fsmap learned FSMap version 26 2024-09-10T22:29:13.475 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:13.471+0000 7f826cebc740 1 -- 172.21.15.19:0/548124020 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x5564ffca9860 con 0x5564ffc1b480 2024-09-10T22:29:13.475 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:13.471+0000 7f8243fff640 1 -- 172.21.15.19:0/548124020 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x5564ffb8f850 con 0x5564ffc1b480 2024-09-10T22:29:13.476 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:13.471+0000 7f8243fff640 1 -- 172.21.15.19:0/548124020 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 26) ==== 8350+0+0 (secure 0 0 0) 0x7f825c030070 con 0x5564ffc1b480 2024-09-10T22:29:13.476 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:13.471+0000 7f826cebc740 10 client.15888 fetch_fsmap finished waiting for FSMap version 26 2024-09-10T22:29:13.476 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:13.471+0000 7f826cebc740 10 client.15888 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-10T22:29:13.476 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:13.471+0000 7f826cebc740 20 client.15888 populate_metadata read hostname 'smithi019' 2024-09-10T22:29:13.476 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:13.471+0000 7f826cebc740 1 --2- 172.21.15.19:0/548124020 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x5564ffca9f00 0x5564ffcac320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:29:13.476 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:13.471+0000 7f826cebc740 4 client.15888 mds_command: new command op to 24581 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-10T22:29:13.476 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:13.471+0000 7f826cebc740 1 -- 172.21.15.19:0/548124020 --> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] -- command(tid 0: {"prefix": "scrub status"}) -- 0x5564ffb8cc80 con 0x5564ffca9f00 2024-09-10T22:29:13.476 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:13.472+0000 7f8263fff640 1 --2- 172.21.15.19:0/548124020 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x5564ffca9f00 0x5564ffcac320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:29:13.476 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:13.472+0000 7f8263fff640 1 --2- 172.21.15.19:0/548124020 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x5564ffca9f00 0x5564ffcac320 crc :-1 s=READY pgs=77 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9d9b0555e28cfa11 server_cookie=21c8ebfa94d60bdd in_seq=0 out_seq=0 2024-09-10T22:29:13.477 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:13.472+0000 7f8243fff640 10 client.15888 ms_handle_connect on v2:172.21.15.135:6838/1254769802 2024-09-10T22:29:13.477 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:13.473+0000 7f8243fff640 1 -- 172.21.15.19:0/548124020 <== mds.0 v2:172.21.15.135:6838/1254769802 1 ==== command_reply(tid 0: 0 ) ==== 8+0+1226 (crc 0 0 0) 0x5564ffb8cc80 con 0x5564ffca9f00 2024-09-10T22:29:13.477 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:13.473+0000 7f8243fff640 10 client.15888 handle_command_reply: tid=0 2024-09-10T22:29:13.477 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:13.473+0000 7f826cebc740 1 client.15888 shutdown 2024-09-10T22:29:13.477 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:13.473+0000 7f826cebc740 1 -- 172.21.15.19:0/548124020 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5564ffc1b480 msgr2=0x5564ffc348f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:29:13.477 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:13.473+0000 7f826cebc740 1 --2- 172.21.15.19:0/548124020 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5564ffc1b480 0x5564ffc348f0 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f825c009de0 tx=0x7f825c005fd0 comp rx=0 tx=0).stop 2024-09-10T22:29:13.478 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:13.473+0000 7f826cebc740 1 -- 172.21.15.19:0/548124020 shutdown_connections 2024-09-10T22:29:13.478 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:13.473+0000 7f826cebc740 1 --2- 172.21.15.19:0/548124020 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5564ffc2c140 0x5564ffc31640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:29:13.478 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:13.473+0000 7f826cebc740 1 --2- 172.21.15.19:0/548124020 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x5564ffca9f00 0x5564ffcac320 crc :-1 s=READY pgs=77 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:29:13.478 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:13.474+0000 7f8243fff640 0 client.15888 ms_handle_reset on v2:172.21.15.135:6838/1254769802 2024-09-10T22:29:13.478 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:13.474+0000 7f826cebc740 1 --2- 172.21.15.19:0/548124020 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5564ffc1bda0 0x5564ffc31080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:29:13.478 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:13.474+0000 7f826cebc740 1 --2- 172.21.15.19:0/548124020 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5564ffc1b480 0x5564ffc348f0 unknown :-1 s=CLOSED pgs=523 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:29:13.478 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:13.474+0000 7f826cebc740 1 -- 172.21.15.19:0/548124020 >> 172.21.15.19:0/548124020 conn(0x5564ffc192b0 msgr2=0x5564ffc17bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:29:13.478 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:13.474+0000 7f826cebc740 1 -- 172.21.15.19:0/548124020 shutdown_connections 2024-09-10T22:29:13.478 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:13.474+0000 7f826cebc740 1 -- 172.21.15.19:0/548124020 wait complete. 2024-09-10T22:29:13.478 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:13.474+0000 7f826cebc740 20 client.15888 trim_cache size 0 max 16384 2024-09-10T22:29:13.478 INFO:teuthology.orchestra.run.smithi019.stdout:{ 2024-09-10T22:29:13.479 INFO:teuthology.orchestra.run.smithi019.stdout: "status": "no active scrubs running", 2024-09-10T22:29:13.479 INFO:teuthology.orchestra.run.smithi019.stdout: "scrubs": {}, 2024-09-10T22:29:13.479 INFO:teuthology.orchestra.run.smithi019.stdout: "scrub_stats": { 2024-09-10T22:29:13.479 INFO:teuthology.orchestra.run.smithi019.stdout: "eb518e3c-a71e-4f32-9ca0-ae88930ca218": { 2024-09-10T22:29:13.479 INFO:teuthology.orchestra.run.smithi019.stdout: "start_time": "2024-09-10T22:28:38.366352+0000", 2024-09-10T22:29:13.479 INFO:teuthology.orchestra.run.smithi019.stdout: "path": "/", 2024-09-10T22:29:13.479 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_started": 0, 2024-09-10T22:29:13.479 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_passed": 0, 2024-09-10T22:29:13.479 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_failed": 0, 2024-09-10T22:29:13.479 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_skipped": 0 2024-09-10T22:29:13.479 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:29:13.479 INFO:teuthology.orchestra.run.smithi019.stdout: "c12c2a04-dcd6-4673-a98e-93f665d3f5d7": { 2024-09-10T22:29:13.480 INFO:teuthology.orchestra.run.smithi019.stdout: "start_time": "2024-09-10T22:27:49.392329+0000", 2024-09-10T22:29:13.480 INFO:teuthology.orchestra.run.smithi019.stdout: "path": "/", 2024-09-10T22:29:13.480 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_started": 0, 2024-09-10T22:29:13.480 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_passed": 0, 2024-09-10T22:29:13.480 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_failed": 0, 2024-09-10T22:29:13.480 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_skipped": 0 2024-09-10T22:29:13.480 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:29:13.480 INFO:teuthology.orchestra.run.smithi019.stdout: "b38852c8-478a-42ef-8384-b2c55d5313a4": { 2024-09-10T22:29:13.480 INFO:teuthology.orchestra.run.smithi019.stdout: "start_time": "2024-09-10T22:27:00.320308+0000", 2024-09-10T22:29:13.480 INFO:teuthology.orchestra.run.smithi019.stdout: "path": "/", 2024-09-10T22:29:13.480 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_started": 0, 2024-09-10T22:29:13.480 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_passed": 0, 2024-09-10T22:29:13.480 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_failed": 0, 2024-09-10T22:29:13.481 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_skipped": 0 2024-09-10T22:29:13.481 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:29:13.481 INFO:teuthology.orchestra.run.smithi019.stdout: "9b6bfdee-303c-4c12-af56-dc85860d112a": { 2024-09-10T22:29:13.481 INFO:teuthology.orchestra.run.smithi019.stdout: "start_time": "2024-09-10T22:26:17.484162+0000", 2024-09-10T22:29:13.481 INFO:teuthology.orchestra.run.smithi019.stdout: "path": "/", 2024-09-10T22:29:13.481 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_started": 0, 2024-09-10T22:29:13.481 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_passed": 0, 2024-09-10T22:29:13.484 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_failed": 0, 2024-09-10T22:29:13.484 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_skipped": 0 2024-09-10T22:29:13.484 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-10T22:29:13.485 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-10T22:29:13.485 INFO:teuthology.orchestra.run.smithi019.stdout:} 2024-09-10T22:29:13.486 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:13.475+0000 7f826aae7640 1 -- 172.21.15.19:0/1550154452 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f82540b52e0 msgr2=0x7f82540b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:29:13.486 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:13.475+0000 7f826aae7640 1 --2- 172.21.15.19:0/1550154452 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f82540b52e0 0x7f82540b77a0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f82580a8d10 tx=0x7f82580e99d0 comp rx=0 tx=0).stop 2024-09-10T22:29:13.486 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:13.475+0000 7f826aae7640 1 -- 172.21.15.19:0/1550154452 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f8264102d90 msgr2=0x7f8264199290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:29:13.486 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:13.475+0000 7f826aae7640 1 --2- 172.21.15.19:0/1550154452 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f8264102d90 0x7f8264199290 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f825800e9f0 tx=0x7f825800eeb0 comp rx=0 tx=0).stop 2024-09-10T22:29:13.486 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:13.475+0000 7f826aae7640 1 -- 172.21.15.19:0/1550154452 shutdown_connections 2024-09-10T22:29:13.486 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:13.475+0000 7f826aae7640 1 --2- 172.21.15.19:0/1550154452 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f82540b52e0 0x7f82540b77a0 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:29:13.486 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:13.475+0000 7f826aae7640 1 --2- 172.21.15.19:0/1550154452 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8264109120 0x7f826419eb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:29:13.486 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:13.475+0000 7f826aae7640 1 --2- 172.21.15.19:0/1550154452 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f82641087a0 0x7f82641997d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:29:13.486 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:13.475+0000 7f826aae7640 1 --2- 172.21.15.19:0/1550154452 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f8264102d90 0x7f8264199290 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:29:13.486 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:13.475+0000 7f826aae7640 1 -- 172.21.15.19:0/1550154452 >> 172.21.15.19:0/1550154452 conn(0x7f82640fe820 msgr2=0x7f8264100c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:29:13.486 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:13.475+0000 7f826aae7640 1 -- 172.21.15.19:0/1550154452 shutdown_connections 2024-09-10T22:29:13.486 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:13.475+0000 7f826aae7640 1 -- 172.21.15.19:0/1550154452 wait complete. 2024-09-10T22:29:14.365 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:29:14 smithi135 ceph-mon[34789]: pgmap v431: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 686 KiB/s rd, 360 MiB/s wr, 199 op/s 2024-09-10T22:29:14.375 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:29:14 smithi138 ceph-mon[35236]: pgmap v431: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 686 KiB/s rd, 360 MiB/s wr, 199 op/s 2024-09-10T22:29:14.414 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:29:14 smithi019 ceph-mon[31375]: pgmap v431: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 686 KiB/s rd, 360 MiB/s wr, 199 op/s 2024-09-10T22:29:14.415 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-10T22:29:14.415 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 22997a4c-6fc2-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-10T22:29:14.756 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/22997a4c-6fc2-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T22:29:15.351 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:15.348+0000 7f2d6b647640 1 -- 172.21.15.19:0/2359928838 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2d64108020 msgr2=0x7f2d6410e820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:29:15.352 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:15.348+0000 7f2d6b647640 1 --2- 172.21.15.19:0/2359928838 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2d64108020 0x7f2d6410e820 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f2d5c009ca0 tx=0x7f2d5c02a8c0 comp rx=0 tx=0).stop 2024-09-10T22:29:15.352 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:15.348+0000 7f2d6b647640 1 -- 172.21.15.19:0/2359928838 shutdown_connections 2024-09-10T22:29:15.352 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:15.348+0000 7f2d6b647640 1 --2- 172.21.15.19:0/2359928838 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2d64108020 0x7f2d6410e820 unknown :-1 s=CLOSED pgs=524 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:29:15.352 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:15.348+0000 7f2d6b647640 1 --2- 172.21.15.19:0/2359928838 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2d641076a0 0x7f2d64107ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:29:15.352 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:15.348+0000 7f2d6b647640 1 --2- 172.21.15.19:0/2359928838 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f2d64101c90 0x7f2d64102070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:29:15.352 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:15.348+0000 7f2d6b647640 1 -- 172.21.15.19:0/2359928838 >> 172.21.15.19:0/2359928838 conn(0x7f2d640fd700 msgr2=0x7f2d640ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:29:15.352 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:15.350+0000 7f2d6b647640 1 -- 172.21.15.19:0/2359928838 shutdown_connections 2024-09-10T22:29:15.353 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:15.350+0000 7f2d6b647640 1 -- 172.21.15.19:0/2359928838 wait complete. 2024-09-10T22:29:15.356 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:15.352+0000 7f2d6b647640 1 Processor -- start 2024-09-10T22:29:15.356 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:15.353+0000 7f2d6b647640 1 -- start start 2024-09-10T22:29:15.356 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:15.353+0000 7f2d6b647640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2d64101c90 0x7f2d64199230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:29:15.356 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:15.354+0000 7f2d6b647640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2d641076a0 0x7f2d64199770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:29:15.356 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:15.354+0000 7f2d6b647640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f2d64108020 0x7f2d6419eb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:29:15.356 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:15.354+0000 7f2d6b647640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f2d64112e00 con 0x7f2d64101c90 2024-09-10T22:29:15.356 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:15.354+0000 7f2d6b647640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f2d64112c80 con 0x7f2d641076a0 2024-09-10T22:29:15.356 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:15.354+0000 7f2d6b647640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f2d64112f80 con 0x7f2d64108020 2024-09-10T22:29:15.357 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:15.354+0000 7f2d693e3640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2d64101c90 0x7f2d64199230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:29:15.357 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:15.354+0000 7f2d693e3640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2d64101c90 0x7f2d64199230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:35872/0 (socket says 172.21.15.19:35872) 2024-09-10T22:29:15.357 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:15.354+0000 7f2d693e3640 1 -- 172.21.15.19:0/1417898728 learned_addr learned my addr 172.21.15.19:0/1417898728 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:29:15.357 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:15.355+0000 7f2d693e3640 1 -- 172.21.15.19:0/1417898728 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f2d64108020 msgr2=0x7f2d6419eb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:29:15.357 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:15.355+0000 7f2d693e3640 1 --2- 172.21.15.19:0/1417898728 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f2d64108020 0x7f2d6419eb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:29:15.357 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:15.355+0000 7f2d693e3640 1 -- 172.21.15.19:0/1417898728 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2d641076a0 msgr2=0x7f2d64199770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:29:15.357 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:15.355+0000 7f2d693e3640 1 --2- 172.21.15.19:0/1417898728 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2d641076a0 0x7f2d64199770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:29:15.357 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:15.355+0000 7f2d693e3640 1 -- 172.21.15.19:0/1417898728 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2d6419f2e0 con 0x7f2d64101c90 2024-09-10T22:29:15.361 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:15.356+0000 7f2d693e3640 1 --2- 172.21.15.19:0/1417898728 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2d64101c90 0x7f2d64199230 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f2d6000b4a0 tx=0x7f2d6000b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:29:15.361 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:15.357+0000 7f2d5a7fc640 1 -- 172.21.15.19:0/1417898728 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d60014070 con 0x7f2d64101c90 2024-09-10T22:29:15.361 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:15.357+0000 7f2d6b647640 1 -- 172.21.15.19:0/1417898728 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2d6419f5d0 con 0x7f2d64101c90 2024-09-10T22:29:15.361 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:15.357+0000 7f2d5a7fc640 1 -- 172.21.15.19:0/1417898728 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2d60010ac0 con 0x7f2d64101c90 2024-09-10T22:29:15.361 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:15.357+0000 7f2d5a7fc640 1 -- 172.21.15.19:0/1417898728 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d60017c00 con 0x7f2d64101c90 2024-09-10T22:29:15.361 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:15.358+0000 7f2d6b647640 1 -- 172.21.15.19:0/1417898728 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2d641a5d10 con 0x7f2d64101c90 2024-09-10T22:29:15.365 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:15.363+0000 7f2d4ffff640 1 -- 172.21.15.19:0/1417898728 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2d64102070 con 0x7f2d64101c90 2024-09-10T22:29:15.368 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:15.366+0000 7f2d5a7fc640 1 -- 172.21.15.19:0/1417898728 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 18) ==== 153250+0+0 (secure 0 0 0) 0x7f2d60010610 con 0x7f2d64101c90 2024-09-10T22:29:15.369 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:15.368+0000 7f2d5a7fc640 1 --2- 172.21.15.19:0/1417898728 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f2d500b5430 0x7f2d500b78f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:29:15.370 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:15.369+0000 7f2d68be2640 1 --2- 172.21.15.19:0/1417898728 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f2d500b5430 0x7f2d500b78f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:29:15.371 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:15.370+0000 7f2d5a7fc640 1 -- 172.21.15.19:0/1417898728 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8327+0+0 (secure 0 0 0) 0x7f2d600e5560 con 0x7f2d64101c90 2024-09-10T22:29:15.371 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:15.370+0000 7f2d68be2640 1 --2- 172.21.15.19:0/1417898728 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f2d500b5430 0x7f2d500b78f0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f2d641060c0 tx=0x7f2d54005c70 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:29:15.377 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:15.375+0000 7f2d5a7fc640 1 -- 172.21.15.19:0/1417898728 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f2d600ac440 con 0x7f2d64101c90 2024-09-10T22:29:15.699 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:15.697+0000 7f2d4ffff640 1 -- 172.21.15.19:0/1417898728 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f2d6419a360 con 0x7f2d64101c90 2024-09-10T22:29:15.702 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-10T22:29:15.702 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":26,"btime":"2024-09-10T22:27:32:930215+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14673,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6835/1835804747","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6834","nonce":1835804747},{"type":"v1","addr":"172.21.15.19:6835","nonce":1835804747}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14685,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6837/1750470490","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6836","nonce":1750470490},{"type":"v1","addr":"172.21.15.19:6837","nonce":1750470490}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14733,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6839/2642941149","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6838","nonce":2642941149},{"type":"v1","addr":"172.21.15.19:6839","nonce":2642941149}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14745,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6841/2449948682","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6840","nonce":2449948682},{"type":"v1","addr":"172.21.15.19:6841","nonce":2449948682}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24511,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.138:6833/2524811494","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6832","nonce":2524811494},{"type":"v1","addr":"172.21.15.138:6833","nonce":2524811494}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24512,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6833/3014993624","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6832","nonce":3014993624},{"type":"v1","addr":"172.21.15.135:6833","nonce":3014993624}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":26,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-10T22:24:22.733925+0000","modified":"2024-09-10T22:27:32.420238+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24581,"mds_1":24568,"mds_2":24553},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24527":{"gid":24527,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.135:6835/3715773348","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6834","nonce":3715773348},{"type":"v1","addr":"172.21.15.135:6835","nonce":3715773348}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24541":{"gid":24541,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.138:6835/933547028","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6834","nonce":933547028},{"type":"v1","addr":"172.21.15.138:6835","nonce":933547028}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24551":{"gid":24551,"name":"h","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.135:6837/3495029135","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6836","nonce":3495029135},{"type":"v1","addr":"172.21.15.135:6837","nonce":3495029135}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24553":{"gid":24553,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":10,"addr":"172.21.15.138:6837/3353290042","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6836","nonce":3353290042},{"type":"v1","addr":"172.21.15.138:6837","nonce":3353290042}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24568":{"gid":24568,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.138:6839/383637208","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6838","nonce":383637208},{"type":"v1","addr":"172.21.15.138:6839","nonce":383637208}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24581":{"gid":24581,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.135:6839/1254769802","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6838","nonce":1254769802},{"type":"v1","addr":"172.21.15.135:6839","nonce":1254769802}]},"join_fscid":-1,"export_targets":[1],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24581,"qdb_cluster":[24553,24568,24581]},"id":1}]} 2024-09-10T22:29:15.702 INFO:teuthology.orchestra.run.smithi019.stderr:dumped fsmap epoch 26 2024-09-10T22:29:15.703 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:15.700+0000 7f2d5a7fc640 1 -- 172.21.15.19:0/1417898728 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) ==== 94+0+11922 (secure 0 0 0) 0x7f2d600abd40 con 0x7f2d64101c90 2024-09-10T22:29:15.709 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:15.707+0000 7f2d4ffff640 1 -- 172.21.15.19:0/1417898728 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f2d500b5430 msgr2=0x7f2d500b78f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:29:15.709 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:15.707+0000 7f2d4ffff640 1 --2- 172.21.15.19:0/1417898728 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f2d500b5430 0x7f2d500b78f0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f2d641060c0 tx=0x7f2d54005c70 comp rx=0 tx=0).stop 2024-09-10T22:29:15.709 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:15.707+0000 7f2d4ffff640 1 -- 172.21.15.19:0/1417898728 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2d64101c90 msgr2=0x7f2d64199230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:29:15.709 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:15.707+0000 7f2d4ffff640 1 --2- 172.21.15.19:0/1417898728 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2d64101c90 0x7f2d64199230 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f2d6000b4a0 tx=0x7f2d6000b960 comp rx=0 tx=0).stop 2024-09-10T22:29:15.710 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:15.707+0000 7f2d4ffff640 1 -- 172.21.15.19:0/1417898728 shutdown_connections 2024-09-10T22:29:15.710 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:15.707+0000 7f2d4ffff640 1 --2- 172.21.15.19:0/1417898728 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f2d500b5430 0x7f2d500b78f0 secure :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f2d641060c0 tx=0x7f2d54005c70 comp rx=0 tx=0).stop 2024-09-10T22:29:15.710 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:15.707+0000 7f2d4ffff640 1 --2- 172.21.15.19:0/1417898728 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f2d64108020 0x7f2d6419eb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:29:15.710 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:15.707+0000 7f2d4ffff640 1 --2- 172.21.15.19:0/1417898728 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2d641076a0 0x7f2d64199770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:29:15.710 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:15.707+0000 7f2d4ffff640 1 --2- 172.21.15.19:0/1417898728 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2d64101c90 0x7f2d64199230 unknown :-1 s=CLOSED pgs=525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:29:15.710 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:15.707+0000 7f2d4ffff640 1 -- 172.21.15.19:0/1417898728 >> 172.21.15.19:0/1417898728 conn(0x7f2d640fd700 msgr2=0x7f2d640ffaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:29:15.710 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:15.708+0000 7f2d4ffff640 1 -- 172.21.15.19:0/1417898728 shutdown_connections 2024-09-10T22:29:15.710 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:15.708+0000 7f2d4ffff640 1 -- 172.21.15.19:0/1417898728 wait complete. 2024-09-10T22:29:16.359 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:29:16 smithi135 ceph-mon[34789]: pgmap v432: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 685 KiB/s rd, 363 MiB/s wr, 201 op/s 2024-09-10T22:29:16.360 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:29:16 smithi135 ceph-mon[34789]: from='client.? 172.21.15.19:0/1417898728' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T22:29:16.375 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:29:16 smithi138 ceph-mon[35236]: pgmap v432: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 685 KiB/s rd, 363 MiB/s wr, 201 op/s 2024-09-10T22:29:16.375 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:29:16 smithi138 ceph-mon[35236]: from='client.? 172.21.15.19:0/1417898728' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T22:29:16.458 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:29:16 smithi019 ceph-mon[31375]: pgmap v432: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 685 KiB/s rd, 363 MiB/s wr, 201 op/s 2024-09-10T22:29:16.458 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:29:16 smithi019 ceph-mon[31375]: from='client.? 172.21.15.19:0/1417898728' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T22:29:16.794 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 22997a4c-6fc2-11ef-bcea-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-09-10T22:29:17.109 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/22997a4c-6fc2-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T22:29:17.685 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:17.680+0000 7f094cb8e640 1 -- 172.21.15.19:0/1526643368 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0948100ad0 msgr2=0x7f0948100eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:29:17.685 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:17.680+0000 7f094cb8e640 1 --2- 172.21.15.19:0/1526643368 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0948100ad0 0x7f0948100eb0 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f0930009900 tx=0x7f093002a440 comp rx=0 tx=0).stop 2024-09-10T22:29:17.685 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:17.681+0000 7f094cb8e640 1 -- 172.21.15.19:0/1526643368 shutdown_connections 2024-09-10T22:29:17.685 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:17.681+0000 7f094cb8e640 1 --2- 172.21.15.19:0/1526643368 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f09481137f0 0x7f0948115be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:29:17.685 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:17.681+0000 7f094cb8e640 1 --2- 172.21.15.19:0/1526643368 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f09481013f0 0x7f09481132b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:29:17.685 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:17.681+0000 7f094cb8e640 1 --2- 172.21.15.19:0/1526643368 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0948100ad0 0x7f0948100eb0 unknown :-1 s=CLOSED pgs=526 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:29:17.685 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:17.681+0000 7f094cb8e640 1 -- 172.21.15.19:0/1526643368 >> 172.21.15.19:0/1526643368 conn(0x7f09480fca20 msgr2=0x7f09480fee40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:29:17.686 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:17.681+0000 7f094cb8e640 1 -- 172.21.15.19:0/1526643368 shutdown_connections 2024-09-10T22:29:17.686 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:17.681+0000 7f094cb8e640 1 -- 172.21.15.19:0/1526643368 wait complete. 2024-09-10T22:29:17.686 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:17.682+0000 7f094cb8e640 1 Processor -- start 2024-09-10T22:29:17.686 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:17.683+0000 7f094cb8e640 1 -- start start 2024-09-10T22:29:17.686 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:17.683+0000 7f094cb8e640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f0948100ad0 0x7f094819fb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:29:17.686 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:17.683+0000 7f094cb8e640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f09481013f0 0x7f09481a00b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:29:17.686 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:17.683+0000 7f094cb8e640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f09481137f0 0x7f09481a5450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:29:17.686 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:17.683+0000 7f094cb8e640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f09481194c0 con 0x7f09481013f0 2024-09-10T22:29:17.686 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:17.683+0000 7f094cb8e640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f0948119340 con 0x7f09481137f0 2024-09-10T22:29:17.688 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:17.683+0000 7f094cb8e640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f0948119640 con 0x7f0948100ad0 2024-09-10T22:29:17.690 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:17.684+0000 7f0946d9d640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f09481137f0 0x7f09481a5450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:29:17.690 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:17.684+0000 7f0946d9d640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f09481137f0 0x7f09481a5450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.19:38028/0 (socket says 172.21.15.19:38028) 2024-09-10T22:29:17.690 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:17.684+0000 7f0946d9d640 1 -- 172.21.15.19:0/481526612 learned_addr learned my addr 172.21.15.19:0/481526612 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:29:17.690 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:17.684+0000 7f0945d9b640 1 --2- 172.21.15.19:0/481526612 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f09481013f0 0x7f09481a00b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:29:17.690 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:17.684+0000 7f094659c640 1 --2- 172.21.15.19:0/481526612 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f0948100ad0 0x7f094819fb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:29:17.690 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:17.685+0000 7f0945d9b640 1 -- 172.21.15.19:0/481526612 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f0948100ad0 msgr2=0x7f094819fb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:29:17.690 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:17.685+0000 7f0945d9b640 1 --2- 172.21.15.19:0/481526612 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f0948100ad0 0x7f094819fb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:29:17.691 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:17.685+0000 7f0945d9b640 1 -- 172.21.15.19:0/481526612 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f09481137f0 msgr2=0x7f09481a5450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:29:17.691 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:17.685+0000 7f0945d9b640 1 --2- 172.21.15.19:0/481526612 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f09481137f0 0x7f09481a5450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:29:17.691 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:17.685+0000 7f0945d9b640 1 -- 172.21.15.19:0/481526612 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f09481a5c20 con 0x7f09481013f0 2024-09-10T22:29:17.691 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:17.686+0000 7f0945d9b640 1 --2- 172.21.15.19:0/481526612 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f09481013f0 0x7f09481a00b0 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f0938009fd0 tx=0x7f093800b870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:29:17.691 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:17.686+0000 7f093f7fe640 1 -- 172.21.15.19:0/481526612 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0938015020 con 0x7f09481013f0 2024-09-10T22:29:17.691 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:17.686+0000 7f094cb8e640 1 -- 172.21.15.19:0/481526612 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f09481a5f10 con 0x7f09481013f0 2024-09-10T22:29:17.691 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:17.686+0000 7f094cb8e640 1 -- 172.21.15.19:0/481526612 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f094806cd40 con 0x7f09481013f0 2024-09-10T22:29:17.691 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:17.687+0000 7f093f7fe640 1 -- 172.21.15.19:0/481526612 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0938011ce0 con 0x7f09481013f0 2024-09-10T22:29:17.691 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:17.687+0000 7f093f7fe640 1 -- 172.21.15.19:0/481526612 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0938010e20 con 0x7f09481013f0 2024-09-10T22:29:17.694 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:17.692+0000 7f093f7fe640 1 -- 172.21.15.19:0/481526612 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 18) ==== 153250+0+0 (secure 0 0 0) 0x7f09380104a0 con 0x7f09481013f0 2024-09-10T22:29:17.694 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:17.693+0000 7f094ef63740 1 Processor -- start 2024-09-10T22:29:17.695 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:17.693+0000 7f094ef63740 1 -- start start 2024-09-10T22:29:17.695 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:17.694+0000 7f094ef63740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ce949ca4d0 0x55ce949ca8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:29:17.695 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:17.694+0000 7f094ef63740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ce949cadf0 0x55ce949d6840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:29:17.696 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:17.694+0000 7f094ef63740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55ce949d6d80 0x55ce949d9170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:29:17.696 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:17.694+0000 7f094ef63740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x55ce94940ea0 con 0x55ce949cadf0 2024-09-10T22:29:17.696 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:17.694+0000 7f094ef63740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55ce949302d0 con 0x55ce949ca4d0 2024-09-10T22:29:17.696 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:17.694+0000 7f094ef63740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x55ce949340e0 con 0x55ce949d6d80 2024-09-10T22:29:17.697 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:17.695+0000 7f093f7fe640 1 --2- 172.21.15.19:0/481526612 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f09340c6370 0x7f09340c8830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:29:17.698 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:17.695+0000 7f094659c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ce949cadf0 0x55ce949d6840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:29:17.698 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:17.695+0000 7f094659c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ce949cadf0 0x55ce949d6840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:35892/0 (socket says 172.21.15.19:35892) 2024-09-10T22:29:17.698 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:17.695+0000 7f094659c640 1 -- 172.21.15.19:0/1214170640 learned_addr learned my addr 172.21.15.19:0/1214170640 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:29:17.699 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:17.695+0000 7f093f7fe640 1 -- 172.21.15.19:0/481526612 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8327+0+0 (secure 0 0 0) 0x7f09380e56b0 con 0x7f09481013f0 2024-09-10T22:29:17.699 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:17.695+0000 7f0945d9b640 1 --2- 172.21.15.19:0/1214170640 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55ce949d6d80 0x55ce949d9170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:29:17.700 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:17.696+0000 7f0946d9d640 1 --2- 172.21.15.19:0/1214170640 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ce949ca4d0 0x55ce949ca8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:29:17.700 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:17.696+0000 7f094659c640 1 -- 172.21.15.19:0/1214170640 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55ce949d6d80 msgr2=0x55ce949d9170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:29:17.700 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:17.696+0000 7f094659c640 1 --2- 172.21.15.19:0/1214170640 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55ce949d6d80 0x55ce949d9170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:29:17.700 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:17.696+0000 7f094659c640 1 -- 172.21.15.19:0/1214170640 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ce949ca4d0 msgr2=0x55ce949ca8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:29:17.700 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:17.696+0000 7f094659c640 1 --2- 172.21.15.19:0/1214170640 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ce949ca4d0 0x55ce949ca8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:29:17.700 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:17.696+0000 7f094659c640 1 -- 172.21.15.19:0/1214170640 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ce9468e650 con 0x55ce949cadf0 2024-09-10T22:29:17.700 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:17.696+0000 7f094659c640 1 --2- 172.21.15.19:0/1214170640 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ce949cadf0 0x55ce949d6840 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f0930009230 tx=0x7f0930004200 comp rx=0 tx=0).ready entity=mon.0 client_cookie=29d15a8f37dc0887 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:29:17.700 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:17.696+0000 7f093cff9640 1 -- 172.21.15.19:0/1214170640 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f093003f070 con 0x55ce949cadf0 2024-09-10T22:29:17.700 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:17.697+0000 7f093cff9640 1 -- 172.21.15.19:0/1214170640 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0930003aa0 con 0x55ce949cadf0 2024-09-10T22:29:17.700 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:17.698+0000 7f093cff9640 1 -- 172.21.15.19:0/1214170640 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0930035070 con 0x55ce949cadf0 2024-09-10T22:29:17.700 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:17.698+0000 7f094ef63740 1 -- 172.21.15.19:0/1214170640 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ce949cadf0 msgr2=0x55ce949d6840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:29:17.701 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:17.698+0000 7f094ef63740 1 --2- 172.21.15.19:0/1214170640 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ce949cadf0 0x55ce949d6840 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f0930009230 tx=0x7f0930004200 comp rx=0 tx=0).stop 2024-09-10T22:29:17.701 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:17.700+0000 7f0946d9d640 1 --2- 172.21.15.19:0/481526612 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f09340c6370 0x7f09340c8830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:29:17.701 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:17.700+0000 7f094ef63740 1 -- 172.21.15.19:0/1214170640 shutdown_connections 2024-09-10T22:29:17.701 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:17.700+0000 7f094ef63740 1 --2- 172.21.15.19:0/1214170640 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55ce949d6d80 0x55ce949d9170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:29:17.701 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:17.700+0000 7f094ef63740 1 --2- 172.21.15.19:0/1214170640 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ce949cadf0 0x55ce949d6840 unknown :-1 s=CLOSED pgs=528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:29:17.702 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:17.700+0000 7f094ef63740 1 --2- 172.21.15.19:0/1214170640 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ce949ca4d0 0x55ce949ca8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:29:17.702 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:17.700+0000 7f094ef63740 1 -- 172.21.15.19:0/1214170640 >> 172.21.15.19:0/1214170640 conn(0x55ce949c8300 msgr2=0x55ce949c94a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:29:17.702 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:17.701+0000 7f0946d9d640 1 --2- 172.21.15.19:0/481526612 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f09340c6370 0x7f09340c8830 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f09400070b0 tx=0x7f0940004ad0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:29:17.702 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:17.701+0000 7f094ef63740 1 -- 172.21.15.19:0/1214170640 shutdown_connections 2024-09-10T22:29:17.702 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:17.701+0000 7f094ef63740 1 -- 172.21.15.19:0/1214170640 wait complete. 2024-09-10T22:29:17.703 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:17.701+0000 7f094ef63740 1 -- start start 2024-09-10T22:29:17.703 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:17.702+0000 7f094ef63740 1 Processor -- start 2024-09-10T22:29:17.704 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:17.702+0000 7f094ef63740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ce949ca4d0 0x55ce949d6530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:29:17.704 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:17.702+0000 7f094ef63740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55ce949cadf0 0x55ce949d3980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:29:17.704 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:17.702+0000 7f094ef63740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ce949d6d80 0x55ce949d3ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:29:17.704 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:17.702+0000 7f094ef63740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x55ce94791700 con 0x55ce949ca4d0 2024-09-10T22:29:17.704 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:17.702+0000 7f094ef63740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55ce948cb160 con 0x55ce949d6d80 2024-09-10T22:29:17.704 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:17.702+0000 7f094ef63740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x55ce949d99f0 con 0x55ce949cadf0 2024-09-10T22:29:17.705 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:17.702+0000 7f094ef63740 10 client.0 _ll_register_callbacks cb 0x55ce948e49e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T22:29:17.705 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:17.702+0000 7f094659c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ce949ca4d0 0x55ce949d6530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:29:17.705 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:17.702+0000 7f094659c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ce949ca4d0 0x55ce949d6530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:35904/0 (socket says 172.21.15.19:35904) 2024-09-10T22:29:17.705 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:17.703+0000 7f094659c640 1 -- 172.21.15.19:0/3337685605 learned_addr learned my addr 172.21.15.19:0/3337685605 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:29:17.706 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:17.703+0000 7f094659c640 1 -- 172.21.15.19:0/3337685605 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55ce949cadf0 msgr2=0x55ce949d3980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:29:17.706 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:17.703+0000 7f094659c640 1 --2- 172.21.15.19:0/3337685605 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55ce949cadf0 0x55ce949d3980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:29:17.706 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:17.703+0000 7f094659c640 1 -- 172.21.15.19:0/3337685605 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ce949d6d80 msgr2=0x55ce949d3ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:29:17.706 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:17.703+0000 7f094659c640 1 --2- 172.21.15.19:0/3337685605 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ce949d6d80 0x55ce949d3ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:29:17.706 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:17.703+0000 7f094659c640 1 -- 172.21.15.19:0/3337685605 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ce948f8c90 con 0x55ce949ca4d0 2024-09-10T22:29:17.706 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:17.703+0000 7f094659c640 1 --2- 172.21.15.19:0/3337685605 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ce949ca4d0 0x55ce949d6530 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f0930003eb0 tx=0x7f0930005c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5b356996b27a2ece server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:29:17.706 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:17.703+0000 7f092dffb640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-10T22:29:17.706 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:17.703+0000 7f092dffb640 1 -- 172.21.15.19:0/3337685605 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f093003f070 con 0x55ce949ca4d0 2024-09-10T22:29:17.706 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:17.703+0000 7f092dffb640 1 -- 172.21.15.19:0/3337685605 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8327+0+0 (secure 0 0 0) 0x7f09300318f0 con 0x55ce949ca4d0 2024-09-10T22:29:17.706 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:17.704+0000 7f094ef63740 1 -- 172.21.15.19:0/3337685605 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0930003aa0 con 0x55ce949ca4d0 2024-09-10T22:29:17.706 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:17.704+0000 7f092dffb640 1 -- 172.21.15.19:0/3337685605 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f0930035040 con 0x55ce949ca4d0 2024-09-10T22:29:17.707 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:17.704+0000 7f094ef63740 10 client.15906 fetch_fsmap learned FSMap version 26 2024-09-10T22:29:17.707 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:17.704+0000 7f094ef63740 1 -- 172.21.15.19:0/3337685605 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x55ce949e5260 con 0x55ce949ca4d0 2024-09-10T22:29:17.707 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:17.704+0000 7f092dffb640 1 -- 172.21.15.19:0/3337685605 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0930005040 con 0x55ce949ca4d0 2024-09-10T22:29:17.707 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:17.705+0000 7f092dffb640 1 -- 172.21.15.19:0/3337685605 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 26) ==== 8350+0+0 (secure 0 0 0) 0x7f09300048f0 con 0x55ce949ca4d0 2024-09-10T22:29:17.707 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:17.705+0000 7f094ef63740 10 client.15906 fetch_fsmap finished waiting for FSMap version 26 2024-09-10T22:29:17.707 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:17.705+0000 7f094ef63740 10 client.15906 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-10T22:29:17.708 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:17.705+0000 7f094ef63740 20 client.15906 populate_metadata read hostname 'smithi019' 2024-09-10T22:29:17.708 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:17.705+0000 7f094ef63740 1 --2- 172.21.15.19:0/3337685605 >> [v2:172.21.15.138:6836/3353290042,v1:172.21.15.138:6837/3353290042] conn(0x55ce949e65b0 0x55ce949e89a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:29:17.708 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:17.705+0000 7f094ef63740 4 client.15906 mds_command: new command op to 24553 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T22:29:17.708 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:17.705+0000 7f094ef63740 1 -- 172.21.15.19:0/3337685605 --> [v2:172.21.15.138:6836/3353290042,v1:172.21.15.138:6837/3353290042] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f0930003aa0 con 0x55ce949e65b0 2024-09-10T22:29:17.708 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:17.706+0000 7f0945d9b640 1 --2- 172.21.15.19:0/3337685605 >> [v2:172.21.15.138:6836/3353290042,v1:172.21.15.138:6837/3353290042] conn(0x55ce949e65b0 0x55ce949e89a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:29:17.709 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:17.708+0000 7f092dffb640 10 client.15906 ms_handle_connect on v2:172.21.15.138:6836/3353290042 2024-09-10T22:29:17.709 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:17.708+0000 7f0945d9b640 1 --2- 172.21.15.19:0/3337685605 >> [v2:172.21.15.138:6836/3353290042,v1:172.21.15.138:6837/3353290042] conn(0x55ce949e65b0 0x55ce949e89a0 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=bb52a414efdcfa68 server_cookie=e7c55c25fd37d4dc in_seq=0 out_seq=0 2024-09-10T22:29:17.712 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:17.709+0000 7f092dffb640 1 -- 172.21.15.19:0/3337685605 <== mds.2 v2:172.21.15.138:6836/3353290042 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x7f0930003aa0 con 0x55ce949e65b0 2024-09-10T22:29:17.712 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:17.709+0000 7f092dffb640 10 client.15906 handle_command_reply: tid=0 2024-09-10T22:29:17.712 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:17.709+0000 7f094ef63740 1 client.15906 shutdown 2024-09-10T22:29:17.712 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:17.710+0000 7f094ef63740 1 -- 172.21.15.19:0/3337685605 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ce949ca4d0 msgr2=0x55ce949d6530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:29:17.713 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:17.710+0000 7f094ef63740 1 --2- 172.21.15.19:0/3337685605 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ce949ca4d0 0x55ce949d6530 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f0930003eb0 tx=0x7f0930005c00 comp rx=0 tx=0).stop 2024-09-10T22:29:17.713 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:17.710+0000 7f094ef63740 1 -- 172.21.15.19:0/3337685605 shutdown_connections 2024-09-10T22:29:17.713 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:17.710+0000 7f094ef63740 1 --2- 172.21.15.19:0/3337685605 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ce949d6d80 0x55ce949d3ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:29:17.713 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:17.710+0000 7f094ef63740 1 --2- 172.21.15.19:0/3337685605 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55ce949cadf0 0x55ce949d3980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:29:17.713 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:17.710+0000 7f094ef63740 1 --2- 172.21.15.19:0/3337685605 >> [v2:172.21.15.138:6836/3353290042,v1:172.21.15.138:6837/3353290042] conn(0x55ce949e65b0 0x55ce949e89a0 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:29:17.713 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:17.710+0000 7f094ef63740 1 --2- 172.21.15.19:0/3337685605 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ce949ca4d0 0x55ce949d6530 unknown :-1 s=CLOSED pgs=529 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:29:17.713 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:17.710+0000 7f094ef63740 1 -- 172.21.15.19:0/3337685605 >> 172.21.15.19:0/3337685605 conn(0x55ce949c8300 msgr2=0x55ce949cdea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:29:17.713 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:17.710+0000 7f092dffb640 0 client.15906 ms_handle_reset on v2:172.21.15.138:6836/3353290042 2024-09-10T22:29:17.713 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:17.710+0000 7f094ef63740 1 -- 172.21.15.19:0/3337685605 shutdown_connections 2024-09-10T22:29:17.713 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:17.710+0000 7f094ef63740 1 -- 172.21.15.19:0/3337685605 wait complete. 2024-09-10T22:29:17.713 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:17.710+0000 7f094ef63740 20 client.15906 trim_cache size 0 max 16384 2024-09-10T22:29:17.746 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:17.744+0000 7f094ef63740 1 Processor -- start 2024-09-10T22:29:17.746 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:17.744+0000 7f094ef63740 1 -- start start 2024-09-10T22:29:17.749 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:17.744+0000 7f094ef63740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55ce949ca4d0 0x55ce949c96f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:29:17.749 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:17.745+0000 7f094ef63740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ce949cadf0 0x55ce949d0b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:29:17.749 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:17.745+0000 7f094ef63740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ce949d6d80 0x55ce949d10d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:29:17.749 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:17.745+0000 7f094ef63740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f09481aee20 con 0x55ce949cadf0 2024-09-10T22:29:17.749 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:17.745+0000 7f094ef63740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f09481ac6f0 con 0x55ce949d6d80 2024-09-10T22:29:17.749 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:17.745+0000 7f094ef63740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f09480732f0 con 0x55ce949ca4d0 2024-09-10T22:29:17.749 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:17.746+0000 7f0946d9d640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ce949d6d80 0x55ce949d10d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:29:17.749 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:17.746+0000 7f0946d9d640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ce949d6d80 0x55ce949d10d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.19:38060/0 (socket says 172.21.15.19:38060) 2024-09-10T22:29:17.749 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:17.746+0000 7f0946d9d640 1 -- 172.21.15.19:0/2997234745 learned_addr learned my addr 172.21.15.19:0/2997234745 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:29:17.749 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:17.746+0000 7f0945d9b640 1 --2- 172.21.15.19:0/2997234745 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ce949cadf0 0x55ce949d0b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:29:17.750 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:17.746+0000 7f0945d9b640 1 -- 172.21.15.19:0/2997234745 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55ce949ca4d0 msgr2=0x55ce949c96f0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-10T22:29:17.750 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:17.746+0000 7f0945d9b640 1 --2- 172.21.15.19:0/2997234745 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55ce949ca4d0 0x55ce949c96f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:29:17.750 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:17.747+0000 7f0945d9b640 1 -- 172.21.15.19:0/2997234745 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ce949d6d80 msgr2=0x55ce949d10d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:29:17.750 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:17.747+0000 7f0945d9b640 1 --2- 172.21.15.19:0/2997234745 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ce949d6d80 0x55ce949d10d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:29:17.750 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:17.747+0000 7f0945d9b640 1 -- 172.21.15.19:0/2997234745 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ce949d98e0 con 0x55ce949cadf0 2024-09-10T22:29:17.750 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:17.747+0000 7f0945d9b640 1 --2- 172.21.15.19:0/2997234745 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ce949cadf0 0x55ce949d0b90 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f09380e31a0 tx=0x7f09380e3020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b5e79975987c443e server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:29:17.751 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:17.748+0000 7f092ffff640 1 -- 172.21.15.19:0/2997234745 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09380abe10 con 0x55ce949cadf0 2024-09-10T22:29:17.751 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:17.748+0000 7f092ffff640 1 -- 172.21.15.19:0/2997234745 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f09380b08f0 con 0x55ce949cadf0 2024-09-10T22:29:17.751 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:17.749+0000 7f094ef63740 1 -- 172.21.15.19:0/2997234745 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ce949cadf0 msgr2=0x55ce949d0b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:29:17.751 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:17.749+0000 7f094ef63740 1 --2- 172.21.15.19:0/2997234745 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ce949cadf0 0x55ce949d0b90 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f09380e31a0 tx=0x7f09380e3020 comp rx=0 tx=0).stop 2024-09-10T22:29:17.751 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:17.749+0000 7f094ef63740 1 -- 172.21.15.19:0/2997234745 shutdown_connections 2024-09-10T22:29:17.751 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:17.749+0000 7f094ef63740 1 --2- 172.21.15.19:0/2997234745 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ce949d6d80 0x55ce949d10d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:29:17.751 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:17.749+0000 7f094ef63740 1 --2- 172.21.15.19:0/2997234745 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ce949cadf0 0x55ce949d0b90 unknown :-1 s=CLOSED pgs=530 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:29:17.751 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:17.749+0000 7f094ef63740 1 --2- 172.21.15.19:0/2997234745 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55ce949ca4d0 0x55ce949c96f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:29:17.752 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:17.749+0000 7f094ef63740 1 -- 172.21.15.19:0/2997234745 >> 172.21.15.19:0/2997234745 conn(0x55ce949c8300 msgr2=0x55ce949c8fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:29:17.752 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:17.750+0000 7f094ef63740 1 -- 172.21.15.19:0/2997234745 shutdown_connections 2024-09-10T22:29:17.754 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:17.751+0000 7f094ef63740 1 -- 172.21.15.19:0/2997234745 wait complete. 2024-09-10T22:29:17.754 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:17.752+0000 7f094ef63740 1 -- start start 2024-09-10T22:29:17.754 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:17.752+0000 7f094ef63740 1 Processor -- start 2024-09-10T22:29:17.755 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:17.753+0000 7f094ef63740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55ce949ca4d0 0x55ce949e9d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:29:17.755 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:17.753+0000 7f094ef63740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ce949cadf0 0x55ce949ea250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:29:17.755 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:17.753+0000 7f094ef63740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ce949d6d80 0x55ce94a52120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:29:17.756 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:17.753+0000 7f094ef63740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f0948073960 con 0x55ce949d6d80 2024-09-10T22:29:17.756 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:17.753+0000 7f094ef63740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f0948074dd0 con 0x55ce949cadf0 2024-09-10T22:29:17.757 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:17.753+0000 7f094ef63740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f0948074030 con 0x55ce949ca4d0 2024-09-10T22:29:17.757 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:17.753+0000 7f094ef63740 10 client.0 _ll_register_callbacks cb 0x7f09300040d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T22:29:17.759 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:17.754+0000 7f0946d9d640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ce949d6d80 0x55ce94a52120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:29:17.759 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:17.754+0000 7f0946d9d640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ce949d6d80 0x55ce94a52120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:35922/0 (socket says 172.21.15.19:35922) 2024-09-10T22:29:17.759 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:17.754+0000 7f0946d9d640 1 -- 172.21.15.19:0/2362635956 learned_addr learned my addr 172.21.15.19:0/2362635956 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:29:17.759 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:17.755+0000 7f0946d9d640 1 -- 172.21.15.19:0/2362635956 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55ce949ca4d0 msgr2=0x55ce949e9d10 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-10T22:29:17.759 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:17.755+0000 7f0946d9d640 1 --2- 172.21.15.19:0/2362635956 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55ce949ca4d0 0x55ce949e9d10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:29:17.759 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:17.755+0000 7f0946d9d640 1 -- 172.21.15.19:0/2362635956 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ce949cadf0 msgr2=0x55ce949ea250 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-10T22:29:17.759 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:17.755+0000 7f0946d9d640 1 --2- 172.21.15.19:0/2362635956 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ce949cadf0 0x55ce949ea250 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:29:17.759 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:17.755+0000 7f0946d9d640 1 -- 172.21.15.19:0/2362635956 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ce949c8d80 con 0x55ce949d6d80 2024-09-10T22:29:17.763 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:17.760+0000 7f0946d9d640 1 --2- 172.21.15.19:0/2362635956 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ce949d6d80 0x55ce94a52120 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f0940017760 tx=0x7f094000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=779fcae75906e05e server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:29:17.763 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:17.761+0000 7f092dffb640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-10T22:29:17.764 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:17.762+0000 7f092dffb640 1 -- 172.21.15.19:0/2362635956 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0940025020 con 0x55ce949d6d80 2024-09-10T22:29:17.764 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:17.762+0000 7f092dffb640 1 -- 172.21.15.19:0/2362635956 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8327+0+0 (secure 0 0 0) 0x7f09400147a0 con 0x55ce949d6d80 2024-09-10T22:29:17.764 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:17.762+0000 7f094ef63740 1 -- 172.21.15.19:0/2362635956 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f09380b08f0 con 0x55ce949d6d80 2024-09-10T22:29:17.766 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:17.764+0000 7f092dffb640 1 -- 172.21.15.19:0/2362635956 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f09400149a0 con 0x55ce949d6d80 2024-09-10T22:29:17.766 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:17.764+0000 7f094ef63740 10 client.15912 fetch_fsmap learned FSMap version 26 2024-09-10T22:29:17.766 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:17.764+0000 7f094ef63740 1 -- 172.21.15.19:0/2362635956 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x55ce94a538c0 con 0x55ce949d6d80 2024-09-10T22:29:17.769 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:17.766+0000 7f092dffb640 1 -- 172.21.15.19:0/2362635956 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f09380b08f0 con 0x55ce949d6d80 2024-09-10T22:29:17.769 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:17.766+0000 7f092dffb640 1 -- 172.21.15.19:0/2362635956 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 26) ==== 8350+0+0 (secure 0 0 0) 0x7f09400203c0 con 0x55ce949d6d80 2024-09-10T22:29:17.769 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:17.766+0000 7f094ef63740 10 client.15912 fetch_fsmap finished waiting for FSMap version 26 2024-09-10T22:29:17.769 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:17.766+0000 7f094ef63740 10 client.15912 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-10T22:29:17.769 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:17.766+0000 7f094ef63740 20 client.15912 populate_metadata read hostname 'smithi019' 2024-09-10T22:29:17.769 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:17.766+0000 7f094ef63740 1 --2- 172.21.15.19:0/2362635956 >> [v2:172.21.15.138:6836/3353290042,v1:172.21.15.138:6837/3353290042] conn(0x55ce94a54020 0x55ce94a56460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:29:17.769 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:17.766+0000 7f094ef63740 4 client.15912 mds_command: new command op to 24553 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-10T22:29:17.769 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:17.766+0000 7f094ef63740 1 -- 172.21.15.19:0/2362635956 --> [v2:172.21.15.138:6836/3353290042,v1:172.21.15.138:6837/3353290042] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55ce94942df0 con 0x55ce94a54020 2024-09-10T22:29:17.777 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:17.774+0000 7f094659c640 1 --2- 172.21.15.19:0/2362635956 >> [v2:172.21.15.138:6836/3353290042,v1:172.21.15.138:6837/3353290042] conn(0x55ce94a54020 0x55ce94a56460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:29:17.786 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:17.784+0000 7f092dffb640 10 client.15912 ms_handle_connect on v2:172.21.15.138:6836/3353290042 2024-09-10T22:29:17.786 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:17.784+0000 7f094659c640 1 --2- 172.21.15.19:0/2362635956 >> [v2:172.21.15.138:6836/3353290042,v1:172.21.15.138:6837/3353290042] conn(0x55ce94a54020 0x55ce94a56460 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=54833f6917646ca3 server_cookie=3271752423bdff72 in_seq=0 out_seq=0 2024-09-10T22:29:17.787 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:17.786+0000 7f092dffb640 1 -- 172.21.15.19:0/2362635956 <== mds.2 v2:172.21.15.138:6836/3353290042 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55ce94942df0 con 0x55ce94a54020 2024-09-10T22:29:17.787 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:17.786+0000 7f092dffb640 10 client.15912 handle_command_reply: tid=0 2024-09-10T22:29:17.787 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:17.786+0000 7f094ef63740 1 client.15912 shutdown 2024-09-10T22:29:17.788 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:17.786+0000 7f094ef63740 1 -- 172.21.15.19:0/2362635956 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ce949d6d80 msgr2=0x55ce94a52120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:29:17.788 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:17.786+0000 7f094ef63740 1 --2- 172.21.15.19:0/2362635956 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ce949d6d80 0x55ce94a52120 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f0940017760 tx=0x7f094000b040 comp rx=0 tx=0).stop 2024-09-10T22:29:17.788 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:17.787+0000 7f094ef63740 1 -- 172.21.15.19:0/2362635956 shutdown_connections 2024-09-10T22:29:17.788 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:17.787+0000 7f094ef63740 1 --2- 172.21.15.19:0/2362635956 >> [v2:172.21.15.138:6836/3353290042,v1:172.21.15.138:6837/3353290042] conn(0x55ce94a54020 0x55ce94a56460 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:29:17.789 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:17.787+0000 7f094ef63740 1 --2- 172.21.15.19:0/2362635956 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ce949d6d80 0x55ce94a52120 unknown :-1 s=CLOSED pgs=531 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:29:17.789 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:17.787+0000 7f094ef63740 1 --2- 172.21.15.19:0/2362635956 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ce949cadf0 0x55ce949ea250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:29:17.789 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:17.787+0000 7f094ef63740 1 --2- 172.21.15.19:0/2362635956 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55ce949ca4d0 0x55ce949e9d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:29:17.789 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:17.787+0000 7f094ef63740 1 -- 172.21.15.19:0/2362635956 >> 172.21.15.19:0/2362635956 conn(0x55ce949c8300 msgr2=0x55ce949c7420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:29:17.789 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:17.787+0000 7f092dffb640 0 client.15912 ms_handle_reset on v2:172.21.15.138:6836/3353290042 2024-09-10T22:29:17.789 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:17.787+0000 7f094ef63740 1 -- 172.21.15.19:0/2362635956 shutdown_connections 2024-09-10T22:29:17.789 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:17.787+0000 7f094ef63740 1 -- 172.21.15.19:0/2362635956 wait complete. 2024-09-10T22:29:17.789 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:17.787+0000 7f094ef63740 20 client.15912 trim_cache size 0 max 16384 2024-09-10T22:29:17.789 INFO:teuthology.orchestra.run.smithi019.stdout:[] 2024-09-10T22:29:17.790 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:17.788+0000 7f094cb8e640 1 -- 172.21.15.19:0/481526612 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f09340c6370 msgr2=0x7f09340c8830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:29:17.790 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:17.788+0000 7f094cb8e640 1 --2- 172.21.15.19:0/481526612 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f09340c6370 0x7f09340c8830 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f09400070b0 tx=0x7f0940004ad0 comp rx=0 tx=0).stop 2024-09-10T22:29:17.790 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:17.788+0000 7f094cb8e640 1 -- 172.21.15.19:0/481526612 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f09481013f0 msgr2=0x7f09481a00b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:29:17.790 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:17.788+0000 7f094cb8e640 1 --2- 172.21.15.19:0/481526612 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f09481013f0 0x7f09481a00b0 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f0938009fd0 tx=0x7f093800b870 comp rx=0 tx=0).stop 2024-09-10T22:29:17.791 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:17.788+0000 7f094cb8e640 1 -- 172.21.15.19:0/481526612 shutdown_connections 2024-09-10T22:29:17.791 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:17.788+0000 7f094cb8e640 1 --2- 172.21.15.19:0/481526612 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f09340c6370 0x7f09340c8830 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:29:17.791 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:17.788+0000 7f094cb8e640 1 --2- 172.21.15.19:0/481526612 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f09481137f0 0x7f09481a5450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:29:17.791 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:17.788+0000 7f094cb8e640 1 --2- 172.21.15.19:0/481526612 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f09481013f0 0x7f09481a00b0 unknown :-1 s=CLOSED pgs=527 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:29:17.791 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:17.788+0000 7f094cb8e640 1 --2- 172.21.15.19:0/481526612 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f0948100ad0 0x7f094819fb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:29:17.791 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:17.788+0000 7f094cb8e640 1 -- 172.21.15.19:0/481526612 >> 172.21.15.19:0/481526612 conn(0x7f09480fca20 msgr2=0x7f0948107e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:29:17.791 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:17.789+0000 7f094cb8e640 1 -- 172.21.15.19:0/481526612 shutdown_connections 2024-09-10T22:29:17.791 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:17.789+0000 7f094cb8e640 1 -- 172.21.15.19:0/481526612 wait complete. 2024-09-10T22:29:18.360 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:29:18 smithi135 ceph-mon[34789]: pgmap v433: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 401 MiB/s wr, 214 op/s 2024-09-10T22:29:18.374 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:29:18 smithi138 ceph-mon[35236]: pgmap v433: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 401 MiB/s wr, 214 op/s 2024-09-10T22:29:18.458 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:29:18 smithi019 ceph-mon[31375]: pgmap v433: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 401 MiB/s wr, 214 op/s 2024-09-10T22:29:18.556 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 22997a4c-6fc2-11ef-bcea-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-09-10T22:29:18.868 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/22997a4c-6fc2-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T22:29:19.239 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:19.236+0000 7ff888164640 1 -- 172.21.15.19:0/3416568250 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff880105ad0 msgr2=0x7ff880107f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:29:19.239 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:19.236+0000 7ff888164640 1 --2- 172.21.15.19:0/3416568250 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff880105ad0 0x7ff880107f40 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7ff87c009900 tx=0x7ff87c02a410 comp rx=0 tx=0).stop 2024-09-10T22:29:19.239 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:19.236+0000 7ff888164640 1 -- 172.21.15.19:0/3416568250 shutdown_connections 2024-09-10T22:29:19.240 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:19.236+0000 7ff888164640 1 --2- 172.21.15.19:0/3416568250 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff880108680 0x7ff88010ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:29:19.240 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:19.236+0000 7ff888164640 1 --2- 172.21.15.19:0/3416568250 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff880105ad0 0x7ff880107f40 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:29:19.240 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:19.236+0000 7ff888164640 1 --2- 172.21.15.19:0/3416568250 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff88006bc90 0x7ff880105540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:29:19.240 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:19.236+0000 7ff888164640 1 -- 172.21.15.19:0/3416568250 >> 172.21.15.19:0/3416568250 conn(0x7ff8800fd130 msgr2=0x7ff8800ff550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:29:19.240 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:19.236+0000 7ff888164640 1 -- 172.21.15.19:0/3416568250 shutdown_connections 2024-09-10T22:29:19.240 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:19.236+0000 7ff888164640 1 -- 172.21.15.19:0/3416568250 wait complete. 2024-09-10T22:29:19.240 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:19.236+0000 7ff888164640 1 Processor -- start 2024-09-10T22:29:19.240 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:19.236+0000 7ff888164640 1 -- start start 2024-09-10T22:29:19.240 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:19.237+0000 7ff888164640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff88006bc90 0x7ff880198dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:29:19.240 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:19.237+0000 7ff888164640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff880105ad0 0x7ff880199420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:29:19.240 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:19.237+0000 7ff888164640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff880108680 0x7ff88019a050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:29:19.240 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:19.237+0000 7ff888164640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7ff88010e620 con 0x7ff880108680 2024-09-10T22:29:19.241 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:19.237+0000 7ff888164640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7ff88010e4a0 con 0x7ff88006bc90 2024-09-10T22:29:19.241 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:19.237+0000 7ff888164640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7ff88010e7a0 con 0x7ff880105ad0 2024-09-10T22:29:19.241 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:19.237+0000 7ff886701640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff880108680 0x7ff88019a050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:29:19.241 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:19.237+0000 7ff885f00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff88006bc90 0x7ff880198dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:29:19.241 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:19.237+0000 7ff8856ff640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff880105ad0 0x7ff880199420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:29:19.241 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:19.237+0000 7ff885f00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff88006bc90 0x7ff880198dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.19:38072/0 (socket says 172.21.15.19:38072) 2024-09-10T22:29:19.241 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:19.237+0000 7ff885f00640 1 -- 172.21.15.19:0/2213867294 learned_addr learned my addr 172.21.15.19:0/2213867294 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:29:19.241 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:19.237+0000 7ff886701640 1 -- 172.21.15.19:0/2213867294 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff880105ad0 msgr2=0x7ff880199420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:29:19.241 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:19.237+0000 7ff886701640 1 --2- 172.21.15.19:0/2213867294 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff880105ad0 0x7ff880199420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:29:19.241 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:19.237+0000 7ff886701640 1 -- 172.21.15.19:0/2213867294 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff88006bc90 msgr2=0x7ff880198dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:29:19.241 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:19.237+0000 7ff886701640 1 --2- 172.21.15.19:0/2213867294 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff88006bc90 0x7ff880198dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:29:19.241 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:19.237+0000 7ff886701640 1 -- 172.21.15.19:0/2213867294 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff88019a910 con 0x7ff880108680 2024-09-10T22:29:19.241 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:19.237+0000 7ff8856ff640 1 --2- 172.21.15.19:0/2213867294 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff880105ad0 0x7ff880199420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T22:29:19.242 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:19.237+0000 7ff885f00640 1 --2- 172.21.15.19:0/2213867294 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff88006bc90 0x7ff880198dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T22:29:19.242 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:19.237+0000 7ff886701640 1 --2- 172.21.15.19:0/2213867294 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff880108680 0x7ff88019a050 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7ff87800ec50 tx=0x7ff87800c6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:29:19.242 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:19.238+0000 7ff876ffd640 1 -- 172.21.15.19:0/2213867294 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff878003b70 con 0x7ff880108680 2024-09-10T22:29:19.242 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:19.238+0000 7ff876ffd640 1 -- 172.21.15.19:0/2213867294 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff878003d10 con 0x7ff880108680 2024-09-10T22:29:19.242 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:19.238+0000 7ff888164640 1 -- 172.21.15.19:0/2213867294 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff88019ac00 con 0x7ff880108680 2024-09-10T22:29:19.242 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:19.238+0000 7ff876ffd640 1 -- 172.21.15.19:0/2213867294 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff878010830 con 0x7ff880108680 2024-09-10T22:29:19.242 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:19.238+0000 7ff888164640 1 -- 172.21.15.19:0/2213867294 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff8801a12d0 con 0x7ff880108680 2024-09-10T22:29:19.244 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:19.241+0000 7ff88b010740 1 Processor -- start 2024-09-10T22:29:19.244 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:19.241+0000 7ff876ffd640 1 -- 172.21.15.19:0/2213867294 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 18) ==== 153250+0+0 (secure 0 0 0) 0x7ff878003ec0 con 0x7ff880108680 2024-09-10T22:29:19.244 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:19.241+0000 7ff88b010740 1 -- start start 2024-09-10T22:29:19.244 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:19.242+0000 7ff88b010740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55706a3ba860 0x55706a3bcc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:29:19.244 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:19.242+0000 7ff88b010740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55706a3bd190 0x55706a3bf580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:29:19.245 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:19.242+0000 7ff88b010740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55706a3bfbd0 0x55706a3c2090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:29:19.245 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:19.242+0000 7ff88b010740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x55706a32c6f0 con 0x55706a3bfbd0 2024-09-10T22:29:19.245 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:19.242+0000 7ff88b010740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55706a31bb20 con 0x55706a3ba860 2024-09-10T22:29:19.245 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:19.242+0000 7ff88b010740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x55706a31f930 con 0x55706a3bd190 2024-09-10T22:29:19.245 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:19.242+0000 7ff8856ff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55706a3ba860 0x55706a3bcc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:29:19.245 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:19.242+0000 7ff885f00640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55706a3bd190 0x55706a3bf580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:29:19.245 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:19.242+0000 7ff8856ff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55706a3ba860 0x55706a3bcc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.19:38086/0 (socket says 172.21.15.19:38086) 2024-09-10T22:29:19.245 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:19.242+0000 7ff8856ff640 1 -- 172.21.15.19:0/477912292 learned_addr learned my addr 172.21.15.19:0/477912292 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:29:19.245 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:19.242+0000 7ff885f00640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55706a3bd190 0x55706a3bf580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.19:58338/0 (socket says 172.21.15.19:58338) 2024-09-10T22:29:19.245 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:19.242+0000 7ff8856ff640 1 --2- 172.21.15.19:0/477912292 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55706a3bfbd0 0x55706a3c2090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:29:19.245 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:19.242+0000 7ff885f00640 1 -- 172.21.15.19:0/477912292 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55706a3ba860 msgr2=0x55706a3bcc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:29:19.245 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:19.242+0000 7ff885f00640 1 --2- 172.21.15.19:0/477912292 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55706a3ba860 0x55706a3bcc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:29:19.245 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:19.242+0000 7ff885f00640 1 -- 172.21.15.19:0/477912292 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55706a3bfbd0 msgr2=0x55706a3c2090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:29:19.245 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:19.242+0000 7ff885f00640 1 --2- 172.21.15.19:0/477912292 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55706a3bfbd0 0x55706a3c2090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:29:19.246 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:19.242+0000 7ff885f00640 1 -- 172.21.15.19:0/477912292 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55706a2e1530 con 0x55706a3bd190 2024-09-10T22:29:19.246 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:19.242+0000 7ff8856ff640 1 --2- 172.21.15.19:0/477912292 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55706a3ba860 0x55706a3bcc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T22:29:19.246 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:19.242+0000 7ff876ffd640 1 --2- 172.21.15.19:0/2213867294 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7ff86c0b52e0 0x7ff86c0b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:29:19.246 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:19.243+0000 7ff8856ff640 1 --2- 172.21.15.19:0/2213867294 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7ff86c0b52e0 0x7ff86c0b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:29:19.246 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:19.243+0000 7ff885f00640 1 --2- 172.21.15.19:0/477912292 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55706a3bd190 0x55706a3bf580 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7ff870011510 tx=0x7ff8700119d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=18f09b46d50292c2 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:29:19.246 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:19.243+0000 7ff876ffd640 1 -- 172.21.15.19:0/2213867294 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8327+0+0 (secure 0 0 0) 0x7ff8780e6170 con 0x7ff880108680 2024-09-10T22:29:19.246 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:19.243+0000 7ff86bfff640 1 -- 172.21.15.19:0/477912292 <== mon.1 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff87001e070 con 0x55706a3bd190 2024-09-10T22:29:19.246 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:19.243+0000 7ff86bfff640 1 -- 172.21.15.19:0/477912292 <== mon.1 v2:172.21.15.138:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff87000fa70 con 0x55706a3bd190 2024-09-10T22:29:19.246 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:19.243+0000 7ff86bfff640 1 -- 172.21.15.19:0/477912292 <== mon.1 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff870019af0 con 0x55706a3bd190 2024-09-10T22:29:19.249 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:19.244+0000 7ff88b010740 1 -- 172.21.15.19:0/477912292 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55706a3bd190 msgr2=0x55706a3bf580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:29:19.249 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:19.244+0000 7ff8856ff640 1 --2- 172.21.15.19:0/2213867294 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7ff86c0b52e0 0x7ff86c0b77a0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7ff87c000c00 tx=0x7ff87c005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:29:19.249 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:19.244+0000 7ff88b010740 1 --2- 172.21.15.19:0/477912292 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55706a3bd190 0x55706a3bf580 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7ff870011510 tx=0x7ff8700119d0 comp rx=0 tx=0).stop 2024-09-10T22:29:19.249 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:19.244+0000 7ff88b010740 1 -- 172.21.15.19:0/477912292 shutdown_connections 2024-09-10T22:29:19.249 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:19.244+0000 7ff88b010740 1 --2- 172.21.15.19:0/477912292 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55706a3bfbd0 0x55706a3c2090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:29:19.249 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:19.244+0000 7ff88b010740 1 --2- 172.21.15.19:0/477912292 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55706a3bd190 0x55706a3bf580 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:29:19.249 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:19.244+0000 7ff88b010740 1 --2- 172.21.15.19:0/477912292 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55706a3ba860 0x55706a3bcc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:29:19.249 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:19.244+0000 7ff88b010740 1 -- 172.21.15.19:0/477912292 >> 172.21.15.19:0/477912292 conn(0x55706a3b59b0 msgr2=0x55706a3b6740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:29:19.250 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:19.244+0000 7ff88b010740 1 -- 172.21.15.19:0/477912292 shutdown_connections 2024-09-10T22:29:19.250 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:19.244+0000 7ff88b010740 1 -- 172.21.15.19:0/477912292 wait complete. 2024-09-10T22:29:19.250 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:19.244+0000 7ff88b010740 1 -- start start 2024-09-10T22:29:19.250 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:19.244+0000 7ff88b010740 1 Processor -- start 2024-09-10T22:29:19.250 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:19.245+0000 7ff88b010740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55706a3ba860 0x55706a3c3ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:29:19.250 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:19.245+0000 7ff88b010740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55706a3bd190 0x55706a3c4590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:29:19.250 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:19.245+0000 7ff88b010740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55706a3bfbd0 0x55706a3c5160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:29:19.250 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:19.245+0000 7ff885f00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55706a3ba860 0x55706a3c3ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:29:19.250 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:19.245+0000 7ff886701640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55706a3bfbd0 0x55706a3c5160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:29:19.250 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:19.245+0000 7ff88b010740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x55706a253ab0 con 0x55706a3bfbd0 2024-09-10T22:29:19.250 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:19.245+0000 7ff8856ff640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55706a3bd190 0x55706a3c4590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:29:19.251 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:19.245+0000 7ff88b010740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55706a2c1730 con 0x55706a3ba860 2024-09-10T22:29:19.251 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:19.245+0000 7ff88b010740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x55706a3c2bb0 con 0x55706a3bd190 2024-09-10T22:29:19.251 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:19.245+0000 7ff885f00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55706a3ba860 0x55706a3c3ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.19:38098/0 (socket says 172.21.15.19:38098) 2024-09-10T22:29:19.251 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:19.245+0000 7ff8856ff640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55706a3bd190 0x55706a3c4590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.19:58350/0 (socket says 172.21.15.19:58350) 2024-09-10T22:29:19.251 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:19.245+0000 7ff885f00640 1 -- 172.21.15.19:0/3338816550 learned_addr learned my addr 172.21.15.19:0/3338816550 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:29:19.251 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:19.246+0000 7ff88b010740 10 client.0 _ll_register_callbacks cb 0x55706a3156b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T22:29:19.251 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:19.246+0000 7ff8856ff640 1 -- 172.21.15.19:0/3338816550 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55706a3ba860 msgr2=0x55706a3c3ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:29:19.251 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:19.246+0000 7ff8856ff640 1 --2- 172.21.15.19:0/3338816550 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55706a3ba860 0x55706a3c3ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:29:19.251 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:19.246+0000 7ff8856ff640 1 -- 172.21.15.19:0/3338816550 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55706a3bfbd0 msgr2=0x55706a3c5160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:29:19.251 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:19.246+0000 7ff8856ff640 1 --2- 172.21.15.19:0/3338816550 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55706a3bfbd0 0x55706a3c5160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:29:19.251 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:19.246+0000 7ff8856ff640 1 -- 172.21.15.19:0/3338816550 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55706a07d790 con 0x55706a3bd190 2024-09-10T22:29:19.251 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:19.246+0000 7ff886701640 1 --2- 172.21.15.19:0/3338816550 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55706a3bfbd0 0x55706a3c5160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T22:29:19.251 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:19.246+0000 7ff8856ff640 1 --2- 172.21.15.19:0/3338816550 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55706a3bd190 0x55706a3c4590 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7ff87c005ec0 tx=0x7ff87c02a410 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9a20c45dd1f746d0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:29:19.252 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:19.246+0000 7ff8697fa640 10 client.0 ms_handle_connect on v2:172.21.15.138:3300/0 2024-09-10T22:29:19.252 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:19.246+0000 7ff8697fa640 1 -- 172.21.15.19:0/3338816550 <== mon.1 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff87c035040 con 0x55706a3bd190 2024-09-10T22:29:19.252 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:19.246+0000 7ff8697fa640 1 -- 172.21.15.19:0/3338816550 <== mon.1 v2:172.21.15.138:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8327+0+0 (secure 0 0 0) 0x7ff87c046070 con 0x55706a3bd190 2024-09-10T22:29:19.252 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:19.246+0000 7ff88b010740 1 -- 172.21.15.19:0/3338816550 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff87000fa70 con 0x55706a3bd190 2024-09-10T22:29:19.252 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:19.247+0000 7ff8697fa640 1 -- 172.21.15.19:0/3338816550 <== mon.1 v2:172.21.15.138:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7ff87c05d050 con 0x55706a3bd190 2024-09-10T22:29:19.252 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:19.247+0000 7ff88b010740 10 client.25423 fetch_fsmap learned FSMap version 26 2024-09-10T22:29:19.252 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:19.247+0000 7ff88b010740 1 -- 172.21.15.19:0/3338816550 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x55706a0f6620 con 0x55706a3bd190 2024-09-10T22:29:19.252 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:19.247+0000 7ff8697fa640 1 -- 172.21.15.19:0/3338816550 <== mon.1 v2:172.21.15.138:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff87000fa70 con 0x55706a3bd190 2024-09-10T22:29:19.252 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:19.247+0000 7ff8697fa640 1 -- 172.21.15.19:0/3338816550 <== mon.1 v2:172.21.15.138:3300/0 5 ==== fsmap(e 26) ==== 8350+0+0 (secure 0 0 0) 0x7ff87c054a10 con 0x55706a3bd190 2024-09-10T22:29:19.252 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:19.247+0000 7ff88b010740 10 client.25423 fetch_fsmap finished waiting for FSMap version 26 2024-09-10T22:29:19.252 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:19.247+0000 7ff88b010740 10 client.25423 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-10T22:29:19.252 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:19.247+0000 7ff88b010740 20 client.25423 populate_metadata read hostname 'smithi019' 2024-09-10T22:29:19.252 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:19.247+0000 7ff88b010740 1 --2- 172.21.15.19:0/3338816550 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x55706a3cf7d0 0x55706a3d1bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:29:19.253 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:19.247+0000 7ff88b010740 4 client.25423 mds_command: new command op to 24581 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T22:29:19.253 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:19.247+0000 7ff88b010740 1 -- 172.21.15.19:0/3338816550 --> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55706a32e640 con 0x55706a3cf7d0 2024-09-10T22:29:19.253 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:19.247+0000 7ff885f00640 1 --2- 172.21.15.19:0/3338816550 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x55706a3cf7d0 0x55706a3d1bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:29:19.253 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:19.248+0000 7ff8697fa640 10 client.25423 ms_handle_connect on v2:172.21.15.135:6838/1254769802 2024-09-10T22:29:19.253 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:19.248+0000 7ff885f00640 1 --2- 172.21.15.19:0/3338816550 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x55706a3cf7d0 0x55706a3d1bc0 crc :-1 s=READY pgs=78 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=db572ab5021068cc server_cookie=7c2cae0941faf2dd in_seq=0 out_seq=0 2024-09-10T22:29:19.254 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:19.249+0000 7ff8697fa640 1 -- 172.21.15.19:0/3338816550 <== mds.0 v2:172.21.15.135:6838/1254769802 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55706a32e640 con 0x55706a3cf7d0 2024-09-10T22:29:19.254 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:19.249+0000 7ff8697fa640 10 client.25423 handle_command_reply: tid=0 2024-09-10T22:29:19.254 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:19.249+0000 7ff88b010740 1 client.25423 shutdown 2024-09-10T22:29:19.254 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:19.249+0000 7ff88b010740 1 -- 172.21.15.19:0/3338816550 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55706a3bd190 msgr2=0x55706a3c4590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:29:19.254 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:19.249+0000 7ff88b010740 1 --2- 172.21.15.19:0/3338816550 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55706a3bd190 0x55706a3c4590 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7ff87c005ec0 tx=0x7ff87c02a410 comp rx=0 tx=0).stop 2024-09-10T22:29:19.254 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:19.250+0000 7ff88b010740 1 -- 172.21.15.19:0/3338816550 shutdown_connections 2024-09-10T22:29:19.254 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:19.250+0000 7ff88b010740 1 --2- 172.21.15.19:0/3338816550 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55706a3bfbd0 0x55706a3c5160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:29:19.254 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:19.250+0000 7ff88b010740 1 --2- 172.21.15.19:0/3338816550 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x55706a3cf7d0 0x55706a3d1bc0 crc :-1 s=READY pgs=78 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:29:19.254 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:19.250+0000 7ff88b010740 1 --2- 172.21.15.19:0/3338816550 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55706a3bd190 0x55706a3c4590 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:29:19.255 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:19.250+0000 7ff8697fa640 0 client.25423 ms_handle_reset on v2:172.21.15.135:6838/1254769802 2024-09-10T22:29:19.255 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:19.250+0000 7ff88b010740 1 --2- 172.21.15.19:0/3338816550 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55706a3ba860 0x55706a3c3ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:29:19.255 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:19.250+0000 7ff88b010740 1 -- 172.21.15.19:0/3338816550 >> 172.21.15.19:0/3338816550 conn(0x55706a3b59b0 msgr2=0x55706a3b4bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:29:19.255 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:19.250+0000 7ff88b010740 1 -- 172.21.15.19:0/3338816550 shutdown_connections 2024-09-10T22:29:19.255 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:19.250+0000 7ff88b010740 1 -- 172.21.15.19:0/3338816550 wait complete. 2024-09-10T22:29:19.255 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:19.250+0000 7ff88b010740 20 client.25423 trim_cache size 0 max 16384 2024-09-10T22:29:19.270 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:19.267+0000 7ff88b010740 1 Processor -- start 2024-09-10T22:29:19.270 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:19.267+0000 7ff88b010740 1 -- start start 2024-09-10T22:29:19.270 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:19.267+0000 7ff88b010740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55706a3ba860 0x55706a3c3130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:29:19.270 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:19.267+0000 7ff88b010740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55706a3bd190 0x55706a3c3670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:29:19.270 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:19.267+0000 7ff88b010740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55706a3bfbd0 0x55706a3d64c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:29:19.270 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:19.267+0000 7ff88b010740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7ff8801aa7b0 con 0x55706a3bd190 2024-09-10T22:29:19.270 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:19.267+0000 7ff88b010740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7ff8801a8080 con 0x55706a3ba860 2024-09-10T22:29:19.270 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:19.267+0000 7ff88b010740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7ff8801a5ed0 con 0x55706a3bfbd0 2024-09-10T22:29:19.270 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:19.267+0000 7ff8856ff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55706a3bd190 0x55706a3c3670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:29:19.271 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:19.267+0000 7ff885f00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55706a3ba860 0x55706a3c3130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:29:19.271 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:19.267+0000 7ff885f00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55706a3ba860 0x55706a3c3130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.19:38106/0 (socket says 172.21.15.19:38106) 2024-09-10T22:29:19.271 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:19.267+0000 7ff885f00640 1 -- 172.21.15.19:0/4233180024 learned_addr learned my addr 172.21.15.19:0/4233180024 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:29:19.271 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:19.267+0000 7ff886701640 1 --2- 172.21.15.19:0/4233180024 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55706a3bfbd0 0x55706a3d64c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:29:19.271 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:19.268+0000 7ff886701640 1 -- 172.21.15.19:0/4233180024 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55706a3ba860 msgr2=0x55706a3c3130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:29:19.271 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:19.268+0000 7ff886701640 1 --2- 172.21.15.19:0/4233180024 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55706a3ba860 0x55706a3c3130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:29:19.271 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:19.268+0000 7ff886701640 1 -- 172.21.15.19:0/4233180024 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55706a3bd190 msgr2=0x55706a3c3670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:29:19.271 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:19.268+0000 7ff886701640 1 --2- 172.21.15.19:0/4233180024 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55706a3bd190 0x55706a3c3670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:29:19.271 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:19.268+0000 7ff886701640 1 -- 172.21.15.19:0/4233180024 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55706a3bf8f0 con 0x55706a3bfbd0 2024-09-10T22:29:19.271 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:19.268+0000 7ff885f00640 1 --2- 172.21.15.19:0/4233180024 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55706a3ba860 0x55706a3c3130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T22:29:19.271 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:19.268+0000 7ff8856ff640 1 --2- 172.21.15.19:0/4233180024 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55706a3bd190 0x55706a3c3670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T22:29:19.271 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:19.268+0000 7ff886701640 1 --2- 172.21.15.19:0/4233180024 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55706a3bfbd0 0x55706a3d64c0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7ff8780a6fd0 tx=0x7ff8780a8830 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ddb6aacb903736e2 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:29:19.272 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:19.268+0000 7ff86b7fe640 1 -- 172.21.15.19:0/4233180024 <== mon.1 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff878009820 con 0x55706a3bfbd0 2024-09-10T22:29:19.272 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:19.268+0000 7ff86b7fe640 1 -- 172.21.15.19:0/4233180024 <== mon.1 v2:172.21.15.138:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff878004660 con 0x55706a3bfbd0 2024-09-10T22:29:19.272 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:19.268+0000 7ff86b7fe640 1 -- 172.21.15.19:0/4233180024 <== mon.1 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff878092490 con 0x55706a3bfbd0 2024-09-10T22:29:19.275 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:19.269+0000 7ff88b010740 1 -- 172.21.15.19:0/4233180024 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55706a3bfbd0 msgr2=0x55706a3d64c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:29:19.275 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:19.269+0000 7ff88b010740 1 --2- 172.21.15.19:0/4233180024 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55706a3bfbd0 0x55706a3d64c0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7ff8780a6fd0 tx=0x7ff8780a8830 comp rx=0 tx=0).stop 2024-09-10T22:29:19.275 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:19.269+0000 7ff88b010740 1 -- 172.21.15.19:0/4233180024 shutdown_connections 2024-09-10T22:29:19.275 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:19.269+0000 7ff88b010740 1 --2- 172.21.15.19:0/4233180024 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55706a3bfbd0 0x55706a3d64c0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:29:19.276 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:19.269+0000 7ff88b010740 1 --2- 172.21.15.19:0/4233180024 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55706a3bd190 0x55706a3c3670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:29:19.276 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:19.269+0000 7ff88b010740 1 --2- 172.21.15.19:0/4233180024 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55706a3ba860 0x55706a3c3130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:29:19.276 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:19.269+0000 7ff88b010740 1 -- 172.21.15.19:0/4233180024 >> 172.21.15.19:0/4233180024 conn(0x55706a3b59b0 msgr2=0x55706a3b8a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:29:19.276 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:19.269+0000 7ff88b010740 1 -- 172.21.15.19:0/4233180024 shutdown_connections 2024-09-10T22:29:19.276 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:19.269+0000 7ff88b010740 1 -- 172.21.15.19:0/4233180024 wait complete. 2024-09-10T22:29:19.276 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:19.270+0000 7ff88b010740 1 -- start start 2024-09-10T22:29:19.276 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:19.270+0000 7ff88b010740 1 Processor -- start 2024-09-10T22:29:19.276 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:19.270+0000 7ff88b010740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55706a3ba860 0x55706a3cb720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:29:19.276 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:19.270+0000 7ff88b010740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55706a3bd190 0x55706a3ca420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:29:19.276 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:19.270+0000 7ff88b010740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55706a3bfbd0 0x55706a3ca960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:29:19.276 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:19.270+0000 7ff88b010740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7ff8801a6540 con 0x55706a3ba860 2024-09-10T22:29:19.276 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:19.270+0000 7ff88b010740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7ff8801a79b0 con 0x55706a3bfbd0 2024-09-10T22:29:19.276 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:19.270+0000 7ff88b010740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7ff8801a6c10 con 0x55706a3bd190 2024-09-10T22:29:19.277 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:19.270+0000 7ff88b010740 10 client.0 _ll_register_callbacks cb 0x7ff87c009520 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T22:29:19.277 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:19.270+0000 7ff885f00640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55706a3ba860 0x55706a3cb720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:29:19.277 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:19.270+0000 7ff885f00640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55706a3ba860 0x55706a3cb720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:35972/0 (socket says 172.21.15.19:35972) 2024-09-10T22:29:19.277 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:19.270+0000 7ff885f00640 1 -- 172.21.15.19:0/3982322317 learned_addr learned my addr 172.21.15.19:0/3982322317 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:29:19.277 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:19.271+0000 7ff8856ff640 1 --2- 172.21.15.19:0/3982322317 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55706a3bd190 0x55706a3ca420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:29:19.277 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:19.271+0000 7ff886701640 1 --2- 172.21.15.19:0/3982322317 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55706a3bfbd0 0x55706a3ca960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:29:19.277 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:19.271+0000 7ff885f00640 1 -- 172.21.15.19:0/3982322317 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55706a3bd190 msgr2=0x55706a3ca420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:29:19.277 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:19.271+0000 7ff885f00640 1 --2- 172.21.15.19:0/3982322317 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55706a3bd190 0x55706a3ca420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:29:19.277 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:19.271+0000 7ff885f00640 1 -- 172.21.15.19:0/3982322317 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55706a3bfbd0 msgr2=0x55706a3ca960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:29:19.277 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:19.271+0000 7ff885f00640 1 --2- 172.21.15.19:0/3982322317 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55706a3bfbd0 0x55706a3ca960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:29:19.277 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:19.271+0000 7ff885f00640 1 -- 172.21.15.19:0/3982322317 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55706a3caf20 con 0x55706a3ba860 2024-09-10T22:29:19.277 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:19.271+0000 7ff8856ff640 1 --2- 172.21.15.19:0/3982322317 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55706a3bd190 0x55706a3ca420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T22:29:19.278 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:19.271+0000 7ff886701640 1 --2- 172.21.15.19:0/3982322317 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55706a3bfbd0 0x55706a3ca960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T22:29:19.278 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:19.271+0000 7ff885f00640 1 --2- 172.21.15.19:0/3982322317 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55706a3ba860 0x55706a3cb720 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7ff870009640 tx=0x7ff8700095c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=94821e340313bae8 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:29:19.278 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:19.271+0000 7ff8697fa640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-10T22:29:19.278 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:19.271+0000 7ff8697fa640 1 -- 172.21.15.19:0/3982322317 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff870030070 con 0x55706a3ba860 2024-09-10T22:29:19.278 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:19.272+0000 7ff8697fa640 1 -- 172.21.15.19:0/3982322317 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8327+0+0 (secure 0 0 0) 0x7ff870005310 con 0x55706a3ba860 2024-09-10T22:29:19.278 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:19.272+0000 7ff88b010740 1 -- 172.21.15.19:0/3982322317 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55706a32a0f0 con 0x55706a3ba860 2024-09-10T22:29:19.278 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:19.272+0000 7ff8697fa640 1 -- 172.21.15.19:0/3982322317 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7ff87003c050 con 0x55706a3ba860 2024-09-10T22:29:19.278 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:19.272+0000 7ff88b010740 10 client.15930 fetch_fsmap learned FSMap version 26 2024-09-10T22:29:19.278 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:19.272+0000 7ff88b010740 1 -- 172.21.15.19:0/3982322317 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x55706a43c6d0 con 0x55706a3ba860 2024-09-10T22:29:19.278 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:19.272+0000 7ff8697fa640 1 -- 172.21.15.19:0/3982322317 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x55706a32a0f0 con 0x55706a3ba860 2024-09-10T22:29:19.278 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:19.272+0000 7ff8697fa640 1 -- 172.21.15.19:0/3982322317 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 26) ==== 8350+0+0 (secure 0 0 0) 0x7ff8700048b0 con 0x55706a3ba860 2024-09-10T22:29:19.278 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:19.272+0000 7ff88b010740 10 client.15930 fetch_fsmap finished waiting for FSMap version 26 2024-09-10T22:29:19.278 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:19.272+0000 7ff88b010740 10 client.15930 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-10T22:29:19.278 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:19.272+0000 7ff88b010740 20 client.15930 populate_metadata read hostname 'smithi019' 2024-09-10T22:29:19.279 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:19.272+0000 7ff88b010740 1 --2- 172.21.15.19:0/3982322317 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x55706a43cd80 0x55706a43f1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:29:19.279 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:19.272+0000 7ff88b010740 4 client.15930 mds_command: new command op to 24581 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-10T22:29:19.279 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:19.272+0000 7ff88b010740 1 -- 172.21.15.19:0/3982322317 --> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55706a327520 con 0x55706a43cd80 2024-09-10T22:29:19.279 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:19.273+0000 7ff8856ff640 1 --2- 172.21.15.19:0/3982322317 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x55706a43cd80 0x55706a43f1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:29:19.279 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:19.273+0000 7ff8697fa640 10 client.15930 ms_handle_connect on v2:172.21.15.135:6838/1254769802 2024-09-10T22:29:19.279 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:19.273+0000 7ff8856ff640 1 --2- 172.21.15.19:0/3982322317 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x55706a43cd80 0x55706a43f1a0 crc :-1 s=READY pgs=79 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7d0b3e6de6341e4e server_cookie=4f374a42b0fcd693 in_seq=0 out_seq=0 2024-09-10T22:29:19.588 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:19.585+0000 7fdc7955d640 1 -- 172.21.15.19:0/1783051722 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdc74108020 msgr2=0x7fdc7410e820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:29:19.588 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:19.585+0000 7fdc7955d640 1 --2- 172.21.15.19:0/1783051722 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdc74108020 0x7fdc7410e820 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7fdc6c009ca0 tx=0x7fdc6c02a8c0 comp rx=0 tx=0).stop 2024-09-10T22:29:19.588 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:19.585+0000 7fdc7955d640 1 -- 172.21.15.19:0/1783051722 shutdown_connections 2024-09-10T22:29:19.588 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:19.585+0000 7fdc7955d640 1 --2- 172.21.15.19:0/1783051722 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdc74108020 0x7fdc7410e820 unknown :-1 s=CLOSED pgs=534 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:29:19.588 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:19.585+0000 7fdc7955d640 1 --2- 172.21.15.19:0/1783051722 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fdc741076a0 0x7fdc74107ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:29:19.588 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:19.585+0000 7fdc7955d640 1 --2- 172.21.15.19:0/1783051722 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdc74101c90 0x7fdc74102070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:29:19.588 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:19.585+0000 7fdc7955d640 1 -- 172.21.15.19:0/1783051722 >> 172.21.15.19:0/1783051722 conn(0x7fdc740fd700 msgr2=0x7fdc740ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:29:19.588 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:19.586+0000 7fdc7955d640 1 -- 172.21.15.19:0/1783051722 shutdown_connections 2024-09-10T22:29:19.588 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:19.586+0000 7fdc7955d640 1 -- 172.21.15.19:0/1783051722 wait complete. 2024-09-10T22:29:19.588 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:19.586+0000 7fdc7955d640 1 Processor -- start 2024-09-10T22:29:19.589 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:19.587+0000 7fdc7955d640 1 -- start start 2024-09-10T22:29:19.589 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:19.587+0000 7fdc7955d640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdc74101c90 0x7fdc7410e310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:29:19.589 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:19.587+0000 7fdc7955d640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fdc741076a0 0x7fdc7410b560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:29:19.589 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:19.587+0000 7fdc7955d640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdc74108020 0x7fdc7410baa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:29:19.589 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:19.587+0000 7fdc7955d640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fdc74110c20 con 0x7fdc74101c90 2024-09-10T22:29:19.589 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:19.587+0000 7fdc7955d640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fdc74110aa0 con 0x7fdc74108020 2024-09-10T22:29:19.590 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:19.587+0000 7fdc7955d640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7fdc74110da0 con 0x7fdc741076a0 2024-09-10T22:29:19.590 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:19.587+0000 7fdc72ffd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdc74101c90 0x7fdc7410e310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:29:19.590 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:19.588+0000 7fdc72ffd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdc74101c90 0x7fdc7410e310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:35994/0 (socket says 172.21.15.19:35994) 2024-09-10T22:29:19.590 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:19.588+0000 7fdc72ffd640 1 -- 172.21.15.19:0/197076551 learned_addr learned my addr 172.21.15.19:0/197076551 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:29:19.590 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:19.588+0000 7fdc72ffd640 1 -- 172.21.15.19:0/197076551 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fdc741076a0 msgr2=0x7fdc7410b560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:29:19.590 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:19.588+0000 7fdc72ffd640 1 --2- 172.21.15.19:0/197076551 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fdc741076a0 0x7fdc7410b560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:29:19.590 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:19.588+0000 7fdc72ffd640 1 -- 172.21.15.19:0/197076551 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdc74108020 msgr2=0x7fdc7410baa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:29:19.590 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:19.588+0000 7fdc72ffd640 1 --2- 172.21.15.19:0/197076551 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdc74108020 0x7fdc7410baa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:29:19.590 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:19.588+0000 7fdc72ffd640 1 -- 172.21.15.19:0/197076551 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdc7410c0e0 con 0x7fdc74101c90 2024-09-10T22:29:19.591 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:19.589+0000 7fdc72ffd640 1 --2- 172.21.15.19:0/197076551 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdc74101c90 0x7fdc7410e310 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7fdc6400b4a0 tx=0x7fdc6400b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:29:19.591 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:19.589+0000 7fdc5bfff640 1 -- 172.21.15.19:0/197076551 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc64014070 con 0x7fdc74101c90 2024-09-10T22:29:19.591 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:19.589+0000 7fdc7955d640 1 -- 172.21.15.19:0/197076551 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdc741ac040 con 0x7fdc74101c90 2024-09-10T22:29:19.591 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:19.590+0000 7fdc5bfff640 1 -- 172.21.15.19:0/197076551 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fdc64010ac0 con 0x7fdc74101c90 2024-09-10T22:29:19.591 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:19.590+0000 7fdc5bfff640 1 -- 172.21.15.19:0/197076551 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc64017b50 con 0x7fdc74101c90 2024-09-10T22:29:19.592 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:19.590+0000 7fdc7955d640 1 -- 172.21.15.19:0/197076551 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdc741ac4b0 con 0x7fdc74101c90 2024-09-10T22:29:19.598 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:19.596+0000 7fdc7b932740 1 Processor -- start 2024-09-10T22:29:19.598 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:19.597+0000 7fdc7b932740 1 -- start start 2024-09-10T22:29:19.598 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:19.597+0000 7fdc7b932740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5645e38734d0 0x5645e38738b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:29:19.599 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:19.597+0000 7fdc7b932740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5645e3873df0 0x5645e387f840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:29:19.600 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:19.597+0000 7fdc7b932740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5645e387fd80 0x5645e3882170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:29:19.600 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:19.597+0000 7fdc7b932740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x5645e37e9ea0 con 0x5645e3873df0 2024-09-10T22:29:19.600 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:19.597+0000 7fdc7b932740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x5645e37d92d0 con 0x5645e387fd80 2024-09-10T22:29:19.600 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:19.597+0000 7fdc7b932740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x5645e37dd0e0 con 0x5645e38734d0 2024-09-10T22:29:19.600 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:19.597+0000 7fdc5bfff640 1 -- 172.21.15.19:0/197076551 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 18) ==== 153250+0+0 (secure 0 0 0) 0x7fdc64010c70 con 0x7fdc74101c90 2024-09-10T22:29:19.600 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:19.598+0000 7fdc737fe640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5645e38734d0 0x5645e38738b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:29:19.600 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:19.598+0000 7fdc737fe640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5645e38734d0 0x5645e38738b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.19:58382/0 (socket says 172.21.15.19:58382) 2024-09-10T22:29:19.601 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:19.598+0000 7fdc737fe640 1 -- 172.21.15.19:0/3492491328 learned_addr learned my addr 172.21.15.19:0/3492491328 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:29:19.601 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:19.598+0000 7fdc72ffd640 1 --2- 172.21.15.19:0/3492491328 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5645e3873df0 0x5645e387f840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:29:19.601 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:19.599+0000 7fdc5bfff640 1 --2- 172.21.15.19:0/197076551 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7fdc5c0b53a0 0x7fdc5c0b7860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:29:19.601 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:19.599+0000 7fdc72ffd640 1 -- 172.21.15.19:0/3492491328 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5645e38734d0 msgr2=0x5645e38738b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:29:19.601 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:19.599+0000 7fdc72ffd640 1 --2- 172.21.15.19:0/3492491328 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5645e38734d0 0x5645e38738b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:29:19.601 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:19.599+0000 7fdc72ffd640 1 -- 172.21.15.19:0/3492491328 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5645e387fd80 msgr2=0x5645e3882170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:29:19.601 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:19.599+0000 7fdc72ffd640 1 --2- 172.21.15.19:0/3492491328 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5645e387fd80 0x5645e3882170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:29:19.602 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:19.599+0000 7fdc72ffd640 1 -- 172.21.15.19:0/3492491328 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5645e3537650 con 0x5645e3873df0 2024-09-10T22:29:19.602 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:19.599+0000 7fdc737fe640 1 --2- 172.21.15.19:0/197076551 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7fdc5c0b53a0 0x7fdc5c0b7860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:29:19.602 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:19.600+0000 7fdc5bfff640 1 -- 172.21.15.19:0/197076551 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8327+0+0 (secure 0 0 0) 0x7fdc640e4e90 con 0x7fdc74101c90 2024-09-10T22:29:19.602 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:19.600+0000 7fdc72ffd640 1 --2- 172.21.15.19:0/3492491328 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5645e3873df0 0x5645e387f840 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7fdc640e2900 tx=0x7fdc6401e3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=de3f7929b95cf89a server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:29:19.602 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:19.600+0000 7fdc597fa640 1 -- 172.21.15.19:0/3492491328 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc640ab3c0 con 0x5645e3873df0 2024-09-10T22:29:19.602 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:19.600+0000 7fdc597fa640 1 -- 172.21.15.19:0/3492491328 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fdc64091410 con 0x5645e3873df0 2024-09-10T22:29:19.602 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:19.600+0000 7fdc597fa640 1 -- 172.21.15.19:0/3492491328 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc640e8680 con 0x5645e3873df0 2024-09-10T22:29:19.603 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:19.601+0000 7fdc7b932740 1 -- 172.21.15.19:0/3492491328 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5645e3873df0 msgr2=0x5645e387f840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:29:19.603 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:19.601+0000 7fdc7b932740 1 --2- 172.21.15.19:0/3492491328 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5645e3873df0 0x5645e387f840 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7fdc640e2900 tx=0x7fdc6401e3f0 comp rx=0 tx=0).stop 2024-09-10T22:29:19.604 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:19.601+0000 7fdc737fe640 1 --2- 172.21.15.19:0/197076551 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7fdc5c0b53a0 0x7fdc5c0b7860 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fdc6c031b30 tx=0x7fdc6c009800 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:29:19.604 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:19.602+0000 7fdc7b932740 1 -- 172.21.15.19:0/3492491328 shutdown_connections 2024-09-10T22:29:19.604 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:19.602+0000 7fdc7b932740 1 --2- 172.21.15.19:0/3492491328 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5645e387fd80 0x5645e3882170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:29:19.604 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:19.602+0000 7fdc7b932740 1 --2- 172.21.15.19:0/3492491328 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5645e3873df0 0x5645e387f840 unknown :-1 s=CLOSED pgs=536 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:29:19.604 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:19.602+0000 7fdc7b932740 1 --2- 172.21.15.19:0/3492491328 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5645e38734d0 0x5645e38738b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:29:19.604 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:19.602+0000 7fdc7b932740 1 -- 172.21.15.19:0/3492491328 >> 172.21.15.19:0/3492491328 conn(0x5645e3871300 msgr2=0x5645e38724a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:29:19.605 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:19.603+0000 7fdc7b932740 1 -- 172.21.15.19:0/3492491328 shutdown_connections 2024-09-10T22:29:19.605 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:19.603+0000 7fdc7b932740 1 -- 172.21.15.19:0/3492491328 wait complete. 2024-09-10T22:29:19.606 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:19.604+0000 7fdc7b932740 1 -- start start 2024-09-10T22:29:19.607 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:19.606+0000 7fdc7b932740 1 Processor -- start 2024-09-10T22:29:19.609 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:19.607+0000 7fdc7b932740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5645e38734d0 0x5645e387f620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:29:19.609 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:19.608+0000 7fdc7b932740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5645e3873df0 0x5645e387ca70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:29:19.609 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:19.608+0000 7fdc7b932740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5645e387fd80 0x5645e387d030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:29:19.611 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:19.609+0000 7fdc72ffd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5645e38734d0 0x5645e387f620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:29:19.611 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:19.609+0000 7fdc7b932740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x5645e363a700 con 0x5645e38734d0 2024-09-10T22:29:19.611 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:19.609+0000 7fdc7b932740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x5645e3774160 con 0x5645e3873df0 2024-09-10T22:29:19.612 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:19.609+0000 7fdc7b932740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x5645e3882940 con 0x5645e387fd80 2024-09-10T22:29:19.612 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:19.609+0000 7fdc72ffd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5645e38734d0 0x5645e387f620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:36012/0 (socket says 172.21.15.19:36012) 2024-09-10T22:29:19.612 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:19.609+0000 7fdc72ffd640 1 -- 172.21.15.19:0/3090193958 learned_addr learned my addr 172.21.15.19:0/3090193958 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:29:19.612 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:19.609+0000 7fdc7b932740 10 client.0 _ll_register_callbacks cb 0x5645e378d9e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T22:29:19.612 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:19.609+0000 7fdc72ffd640 1 -- 172.21.15.19:0/3090193958 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5645e387fd80 msgr2=0x5645e387d030 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-10T22:29:19.612 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:19.609+0000 7fdc72ffd640 1 --2- 172.21.15.19:0/3090193958 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5645e387fd80 0x5645e387d030 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:29:19.612 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:19.609+0000 7fdc72ffd640 1 -- 172.21.15.19:0/3090193958 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5645e3873df0 msgr2=0x5645e387ca70 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-10T22:29:19.612 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:19.609+0000 7fdc72ffd640 1 --2- 172.21.15.19:0/3090193958 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5645e3873df0 0x5645e387ca70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:29:19.612 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:19.609+0000 7fdc72ffd640 1 -- 172.21.15.19:0/3090193958 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5645e37a1c90 con 0x5645e38734d0 2024-09-10T22:29:19.612 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:19.609+0000 7fdc72ffd640 1 --2- 172.21.15.19:0/3090193958 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5645e38734d0 0x5645e387f620 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7fdc640e2ca0 tx=0x7fdc640047d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=afaeb151ad3eb774 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:29:19.613 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:19.609+0000 7fdc56ff5640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-10T22:29:19.613 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:19.609+0000 7fdc56ff5640 1 -- 172.21.15.19:0/3090193958 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc6401e040 con 0x5645e38734d0 2024-09-10T22:29:19.613 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:19.610+0000 7fdc56ff5640 1 -- 172.21.15.19:0/3090193958 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8327+0+0 (secure 0 0 0) 0x7fdc640910d0 con 0x5645e38734d0 2024-09-10T22:29:19.613 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:19.610+0000 7fdc7b932740 1 -- 172.21.15.19:0/3090193958 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fdc64091410 con 0x5645e38734d0 2024-09-10T22:29:19.613 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:19.610+0000 7fdc56ff5640 1 -- 172.21.15.19:0/3090193958 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7fdc640aad60 con 0x5645e38734d0 2024-09-10T22:29:19.613 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:19.610+0000 7fdc7b932740 10 client.15942 fetch_fsmap learned FSMap version 26 2024-09-10T22:29:19.614 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:19.610+0000 7fdc7b932740 1 -- 172.21.15.19:0/3090193958 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x5645e388e2c0 con 0x5645e38734d0 2024-09-10T22:29:19.614 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:19.610+0000 7fdc56ff5640 1 -- 172.21.15.19:0/3090193958 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fdc64091410 con 0x5645e38734d0 2024-09-10T22:29:19.614 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:19.610+0000 7fdc56ff5640 1 -- 172.21.15.19:0/3090193958 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 26) ==== 8350+0+0 (secure 0 0 0) 0x7fdc640a7860 con 0x5645e38734d0 2024-09-10T22:29:19.614 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:19.611+0000 7fdc7b932740 10 client.15942 fetch_fsmap finished waiting for FSMap version 26 2024-09-10T22:29:19.614 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:19.611+0000 7fdc7b932740 10 client.15942 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-10T22:29:19.614 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:19.611+0000 7fdc7b932740 20 client.15942 populate_metadata read hostname 'smithi019' 2024-09-10T22:29:19.614 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:19.611+0000 7fdc7b932740 1 --2- 172.21.15.19:0/3090193958 >> [v2:172.21.15.138:6838/383637208,v1:172.21.15.138:6839/383637208] conn(0x5645e388f610 0x5645e3891a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:29:19.614 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:19.611+0000 7fdc7b932740 4 client.15942 mds_command: new command op to 24568 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T22:29:19.614 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:19.611+0000 7fdc7b932740 1 -- 172.21.15.19:0/3090193958 --> [v2:172.21.15.138:6838/383637208,v1:172.21.15.138:6839/383637208] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5645e37ebdf0 con 0x5645e388f610 2024-09-10T22:29:19.615 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:19.613+0000 7fdc727fc640 1 --2- 172.21.15.19:0/3090193958 >> [v2:172.21.15.138:6838/383637208,v1:172.21.15.138:6839/383637208] conn(0x5645e388f610 0x5645e3891a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:29:19.617 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:19.615+0000 7fdc56ff5640 10 client.15942 ms_handle_connect on v2:172.21.15.138:6838/383637208 2024-09-10T22:29:19.617 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:19.615+0000 7fdc727fc640 1 --2- 172.21.15.19:0/3090193958 >> [v2:172.21.15.138:6838/383637208,v1:172.21.15.138:6839/383637208] conn(0x5645e388f610 0x5645e3891a00 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=165fc7e37af98add server_cookie=9782b02e2bf11fe6 in_seq=0 out_seq=0 2024-09-10T22:29:19.619 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:19.617+0000 7fdc56ff5640 1 -- 172.21.15.19:0/3090193958 <== mds.1 v2:172.21.15.138:6838/383637208 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5645e37ebdf0 con 0x5645e388f610 2024-09-10T22:29:19.619 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:19.617+0000 7fdc56ff5640 10 client.15942 handle_command_reply: tid=0 2024-09-10T22:29:19.619 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:19.617+0000 7fdc7b932740 1 client.15942 shutdown 2024-09-10T22:29:19.619 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:19.617+0000 7fdc7b932740 1 -- 172.21.15.19:0/3090193958 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5645e38734d0 msgr2=0x5645e387f620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:29:19.619 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:19.617+0000 7fdc7b932740 1 --2- 172.21.15.19:0/3090193958 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5645e38734d0 0x5645e387f620 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7fdc640e2ca0 tx=0x7fdc640047d0 comp rx=0 tx=0).stop 2024-09-10T22:29:19.619 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:19.617+0000 7fdc7b932740 1 -- 172.21.15.19:0/3090193958 shutdown_connections 2024-09-10T22:29:19.619 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:19.617+0000 7fdc7b932740 1 --2- 172.21.15.19:0/3090193958 >> [v2:172.21.15.138:6838/383637208,v1:172.21.15.138:6839/383637208] conn(0x5645e388f610 0x5645e3891a00 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:29:19.620 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:19.617+0000 7fdc7b932740 1 --2- 172.21.15.19:0/3090193958 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5645e387fd80 0x5645e387d030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:29:19.620 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:19.617+0000 7fdc56ff5640 0 client.15942 ms_handle_reset on v2:172.21.15.138:6838/383637208 2024-09-10T22:29:19.620 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:19.618+0000 7fdc7b932740 1 --2- 172.21.15.19:0/3090193958 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5645e3873df0 0x5645e387ca70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:29:19.620 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:19.618+0000 7fdc7b932740 1 --2- 172.21.15.19:0/3090193958 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5645e38734d0 0x5645e387f620 unknown :-1 s=CLOSED pgs=537 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:29:19.620 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:19.618+0000 7fdc7b932740 1 -- 172.21.15.19:0/3090193958 >> 172.21.15.19:0/3090193958 conn(0x5645e3871300 msgr2=0x5645e3876e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:29:19.620 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:19.618+0000 7fdc7b932740 1 -- 172.21.15.19:0/3090193958 shutdown_connections 2024-09-10T22:29:19.620 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:19.618+0000 7fdc7b932740 1 -- 172.21.15.19:0/3090193958 wait complete. 2024-09-10T22:29:19.620 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:19.618+0000 7fdc7b932740 20 client.15942 trim_cache size 0 max 16384 2024-09-10T22:29:19.647 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:19.642+0000 7fdc7b932740 1 Processor -- start 2024-09-10T22:29:19.647 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:19.642+0000 7fdc7b932740 1 -- start start 2024-09-10T22:29:19.647 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:19.643+0000 7fdc7b932740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5645e38734d0 0x5645e3870c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:29:19.647 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:19.643+0000 7fdc7b932740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5645e3873df0 0x5645e38723a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:29:19.647 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:19.643+0000 7fdc7b932740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5645e387fd80 0x5645e38728e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:29:19.647 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:19.643+0000 7fdc72ffd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5645e38734d0 0x5645e3870c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:29:19.647 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:19.643+0000 7fdc7b932740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fdc60010f00 con 0x5645e38734d0 2024-09-10T22:29:19.647 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:19.643+0000 7fdc72ffd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5645e38734d0 0x5645e3870c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:36024/0 (socket says 172.21.15.19:36024) 2024-09-10T22:29:19.647 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:19.643+0000 7fdc72ffd640 1 -- 172.21.15.19:0/2555612532 learned_addr learned my addr 172.21.15.19:0/2555612532 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:29:19.647 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:19.643+0000 7fdc737fe640 1 --2- 172.21.15.19:0/2555612532 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5645e387fd80 0x5645e38728e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:29:19.648 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:19.643+0000 7fdc7b932740 1 -- 172.21.15.19:0/2555612532 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fdc6000e7d0 con 0x5645e3873df0 2024-09-10T22:29:19.648 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:19.643+0000 7fdc7b932740 1 -- 172.21.15.19:0/2555612532 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7fdc6000c620 con 0x5645e387fd80 2024-09-10T22:29:19.648 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:19.644+0000 7fdc727fc640 1 --2- 172.21.15.19:0/2555612532 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5645e3873df0 0x5645e38723a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:29:19.648 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:19.644+0000 7fdc72ffd640 1 -- 172.21.15.19:0/2555612532 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5645e387fd80 msgr2=0x5645e38728e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:29:19.648 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:19.644+0000 7fdc72ffd640 1 --2- 172.21.15.19:0/2555612532 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5645e387fd80 0x5645e38728e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:29:19.648 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:19.644+0000 7fdc72ffd640 1 -- 172.21.15.19:0/2555612532 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5645e3873df0 msgr2=0x5645e38723a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:29:19.648 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:19.644+0000 7fdc72ffd640 1 --2- 172.21.15.19:0/2555612532 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5645e3873df0 0x5645e38723a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:29:19.648 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:19.644+0000 7fdc72ffd640 1 -- 172.21.15.19:0/2555612532 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5645e3871d80 con 0x5645e38734d0 2024-09-10T22:29:19.648 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:19.644+0000 7fdc72ffd640 1 --2- 172.21.15.19:0/2555612532 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5645e38734d0 0x5645e3870c10 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7fdc640a7600 tx=0x7fdc640cdfe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=abf5f90a138cd878 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:29:19.648 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:19.644+0000 7fdc58ff9640 1 -- 172.21.15.19:0/2555612532 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc6401e040 con 0x5645e38734d0 2024-09-10T22:29:19.648 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:19.644+0000 7fdc58ff9640 1 -- 172.21.15.19:0/2555612532 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fdc640ab5f0 con 0x5645e38734d0 2024-09-10T22:29:19.648 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:19.644+0000 7fdc58ff9640 1 -- 172.21.15.19:0/2555612532 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc640aaf40 con 0x5645e38734d0 2024-09-10T22:29:19.648 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:19.645+0000 7fdc7b932740 1 -- 172.21.15.19:0/2555612532 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5645e38734d0 msgr2=0x5645e3870c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:29:19.649 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:19.645+0000 7fdc7b932740 1 --2- 172.21.15.19:0/2555612532 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5645e38734d0 0x5645e3870c10 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7fdc640a7600 tx=0x7fdc640cdfe0 comp rx=0 tx=0).stop 2024-09-10T22:29:19.649 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:19.645+0000 7fdc7b932740 1 -- 172.21.15.19:0/2555612532 shutdown_connections 2024-09-10T22:29:19.649 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:19.645+0000 7fdc7b932740 1 --2- 172.21.15.19:0/2555612532 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5645e387fd80 0x5645e38728e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:29:19.649 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:19.645+0000 7fdc7b932740 1 --2- 172.21.15.19:0/2555612532 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5645e3873df0 0x5645e38723a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:29:19.649 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:19.645+0000 7fdc7b932740 1 --2- 172.21.15.19:0/2555612532 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5645e38734d0 0x5645e3870c10 unknown :-1 s=CLOSED pgs=538 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:29:19.649 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:19.645+0000 7fdc7b932740 1 -- 172.21.15.19:0/2555612532 >> 172.21.15.19:0/2555612532 conn(0x5645e3871300 msgr2=0x5645e3877d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:29:19.649 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:19.645+0000 7fdc7b932740 1 -- 172.21.15.19:0/2555612532 shutdown_connections 2024-09-10T22:29:19.649 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:19.645+0000 7fdc7b932740 1 -- 172.21.15.19:0/2555612532 wait complete. 2024-09-10T22:29:19.652 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:19.646+0000 7fdc7b932740 1 -- start start 2024-09-10T22:29:19.652 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:19.646+0000 7fdc7b932740 1 Processor -- start 2024-09-10T22:29:19.652 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:19.646+0000 7fdc7b932740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5645e38734d0 0x5645e38884d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:29:19.652 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:19.646+0000 7fdc7b932740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5645e3873df0 0x5645e3896d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:29:19.652 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:19.646+0000 7fdc7b932740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5645e387fd80 0x5645e3897390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:29:19.652 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:19.646+0000 7fdc7b932740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fdc6000cc90 con 0x5645e38734d0 2024-09-10T22:29:19.652 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:19.646+0000 7fdc7b932740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fdc6000e100 con 0x5645e3873df0 2024-09-10T22:29:19.652 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:19.646+0000 7fdc7b932740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7fdc6000d360 con 0x5645e387fd80 2024-09-10T22:29:19.652 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:19.646+0000 7fdc7b932740 10 client.0 _ll_register_callbacks cb 0x7fdc6c009b20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T22:29:19.652 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:19.647+0000 7fdc737fe640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5645e387fd80 0x5645e3897390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:29:19.653 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:19.647+0000 7fdc737fe640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5645e387fd80 0x5645e3897390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.19:58396/0 (socket says 172.21.15.19:58396) 2024-09-10T22:29:19.653 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:19.647+0000 7fdc737fe640 1 -- 172.21.15.19:0/292732137 learned_addr learned my addr 172.21.15.19:0/292732137 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:29:19.653 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:19.647+0000 7fdc72ffd640 1 --2- 172.21.15.19:0/292732137 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5645e38734d0 0x5645e38884d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:29:19.653 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:19.647+0000 7fdc737fe640 1 -- 172.21.15.19:0/292732137 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5645e3873df0 msgr2=0x5645e3896d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:29:19.653 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:19.647+0000 7fdc737fe640 1 --2- 172.21.15.19:0/292732137 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5645e3873df0 0x5645e3896d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:29:19.653 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:19.647+0000 7fdc737fe640 1 -- 172.21.15.19:0/292732137 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5645e38734d0 msgr2=0x5645e38884d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:29:19.653 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:19.647+0000 7fdc737fe640 1 --2- 172.21.15.19:0/292732137 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5645e38734d0 0x5645e38884d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:29:19.653 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:19.647+0000 7fdc737fe640 1 -- 172.21.15.19:0/292732137 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5645e3887130 con 0x5645e387fd80 2024-09-10T22:29:19.653 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:19.647+0000 7fdc737fe640 1 --2- 172.21.15.19:0/292732137 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5645e387fd80 0x5645e3897390 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fdc6c02f540 tx=0x7fdc6c0095c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3c53145f73718348 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:29:19.653 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:19.647+0000 7fdc56ff5640 10 client.0 ms_handle_connect on v2:172.21.15.138:3300/0 2024-09-10T22:29:19.653 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:19.648+0000 7fdc56ff5640 1 -- 172.21.15.19:0/292732137 <== mon.1 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc6c003e00 con 0x5645e387fd80 2024-09-10T22:29:19.653 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:19.648+0000 7fdc56ff5640 1 -- 172.21.15.19:0/292732137 <== mon.1 v2:172.21.15.138:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8327+0+0 (secure 0 0 0) 0x7fdc6c0046a0 con 0x5645e387fd80 2024-09-10T22:29:19.654 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:19.648+0000 7fdc7b932740 1 -- 172.21.15.19:0/292732137 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fdc640ab5f0 con 0x5645e387fd80 2024-09-10T22:29:19.654 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:19.648+0000 7fdc56ff5640 1 -- 172.21.15.19:0/292732137 <== mon.1 v2:172.21.15.138:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7fdc6c05b050 con 0x5645e387fd80 2024-09-10T22:29:19.654 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:19.648+0000 7fdc7b932740 10 client.25438 fetch_fsmap learned FSMap version 26 2024-09-10T22:29:19.654 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:19.648+0000 7fdc7b932740 1 -- 172.21.15.19:0/292732137 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x5645e38fc3b0 con 0x5645e387fd80 2024-09-10T22:29:19.654 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:19.648+0000 7fdc56ff5640 1 -- 172.21.15.19:0/292732137 <== mon.1 v2:172.21.15.138:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fdc6c036040 con 0x5645e387fd80 2024-09-10T22:29:19.654 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:19.649+0000 7fdc56ff5640 1 -- 172.21.15.19:0/292732137 <== mon.1 v2:172.21.15.138:3300/0 5 ==== fsmap(e 26) ==== 8350+0+0 (secure 0 0 0) 0x7fdc6c030780 con 0x5645e387fd80 2024-09-10T22:29:19.654 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:19.649+0000 7fdc7b932740 10 client.25438 fetch_fsmap finished waiting for FSMap version 26 2024-09-10T22:29:19.654 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:19.649+0000 7fdc7b932740 10 client.25438 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-10T22:29:19.654 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:19.649+0000 7fdc7b932740 20 client.25438 populate_metadata read hostname 'smithi019' 2024-09-10T22:29:19.654 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:19.649+0000 7fdc7b932740 1 --2- 172.21.15.19:0/292732137 >> [v2:172.21.15.138:6838/383637208,v1:172.21.15.138:6839/383637208] conn(0x5645e388f610 0x5645e38febd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:29:19.654 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:19.649+0000 7fdc7b932740 4 client.25438 mds_command: new command op to 24568 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-10T22:29:19.654 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:19.649+0000 7fdc7b932740 1 -- 172.21.15.19:0/292732137 --> [v2:172.21.15.138:6838/383637208,v1:172.21.15.138:6839/383637208] -- command(tid 0: {"prefix": "damage ls"}) -- 0x7fdc640ab5f0 con 0x5645e388f610 2024-09-10T22:29:19.654 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:19.649+0000 7fdc72ffd640 1 --2- 172.21.15.19:0/292732137 >> [v2:172.21.15.138:6838/383637208,v1:172.21.15.138:6839/383637208] conn(0x5645e388f610 0x5645e38febd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:29:19.655 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:19.650+0000 7fdc72ffd640 1 --2- 172.21.15.19:0/292732137 >> [v2:172.21.15.138:6838/383637208,v1:172.21.15.138:6839/383637208] conn(0x5645e388f610 0x5645e38febd0 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=11c6c188d87d607d server_cookie=ee9b7e360a8be47f in_seq=0 out_seq=0 2024-09-10T22:29:19.655 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:19.650+0000 7fdc56ff5640 10 client.25438 ms_handle_connect on v2:172.21.15.138:6838/383637208 2024-09-10T22:29:19.655 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:19.650+0000 7fdc56ff5640 1 -- 172.21.15.19:0/292732137 <== mds.1 v2:172.21.15.138:6838/383637208 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x7fdc640ab5f0 con 0x5645e388f610 2024-09-10T22:29:19.655 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:19.650+0000 7fdc56ff5640 10 client.25438 handle_command_reply: tid=0 2024-09-10T22:29:19.655 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:19.650+0000 7fdc7b932740 1 client.25438 shutdown 2024-09-10T22:29:19.656 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:19.651+0000 7fdc7b932740 1 -- 172.21.15.19:0/292732137 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5645e387fd80 msgr2=0x5645e3897390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:29:19.656 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:19.651+0000 7fdc7b932740 1 --2- 172.21.15.19:0/292732137 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5645e387fd80 0x5645e3897390 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fdc6c02f540 tx=0x7fdc6c0095c0 comp rx=0 tx=0).stop 2024-09-10T22:29:19.656 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:19.651+0000 7fdc7b932740 1 -- 172.21.15.19:0/292732137 shutdown_connections 2024-09-10T22:29:19.656 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:19.651+0000 7fdc7b932740 1 --2- 172.21.15.19:0/292732137 >> [v2:172.21.15.138:6838/383637208,v1:172.21.15.138:6839/383637208] conn(0x5645e388f610 0x5645e38febd0 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:29:19.656 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:19.651+0000 7fdc7b932740 1 --2- 172.21.15.19:0/292732137 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5645e387fd80 0x5645e3897390 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:29:19.656 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:19.651+0000 7fdc56ff5640 0 client.25438 ms_handle_reset on v2:172.21.15.138:6838/383637208 2024-09-10T22:29:19.656 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:19.651+0000 7fdc7b932740 1 --2- 172.21.15.19:0/292732137 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5645e3873df0 0x5645e3896d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:29:19.656 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:19.651+0000 7fdc7b932740 1 --2- 172.21.15.19:0/292732137 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5645e38734d0 0x5645e38884d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:29:19.656 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:19.651+0000 7fdc7b932740 1 -- 172.21.15.19:0/292732137 >> 172.21.15.19:0/292732137 conn(0x5645e3871300 msgr2=0x5645e38723a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:29:19.657 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:19.651+0000 7fdc7b932740 1 -- 172.21.15.19:0/292732137 shutdown_connections 2024-09-10T22:29:19.657 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:19.651+0000 7fdc7b932740 1 -- 172.21.15.19:0/292732137 wait complete. 2024-09-10T22:29:19.657 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:19.652+0000 7fdc7b932740 20 client.25438 trim_cache size 0 max 16384 2024-09-10T22:29:19.657 INFO:teuthology.orchestra.run.smithi019.stdout:[] 2024-09-10T22:29:19.658 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:19.652+0000 7fdc7955d640 1 -- 172.21.15.19:0/197076551 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7fdc5c0b53a0 msgr2=0x7fdc5c0b7860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:29:19.658 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:19.652+0000 7fdc7955d640 1 --2- 172.21.15.19:0/197076551 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7fdc5c0b53a0 0x7fdc5c0b7860 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fdc6c031b30 tx=0x7fdc6c009800 comp rx=0 tx=0).stop 2024-09-10T22:29:19.658 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:19.652+0000 7fdc7955d640 1 -- 172.21.15.19:0/197076551 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdc74101c90 msgr2=0x7fdc7410e310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:29:19.658 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:19.652+0000 7fdc7955d640 1 --2- 172.21.15.19:0/197076551 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdc74101c90 0x7fdc7410e310 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7fdc6400b4a0 tx=0x7fdc6400b960 comp rx=0 tx=0).stop 2024-09-10T22:29:19.658 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:19.653+0000 7fdc7955d640 1 -- 172.21.15.19:0/197076551 shutdown_connections 2024-09-10T22:29:19.658 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:19.653+0000 7fdc7955d640 1 --2- 172.21.15.19:0/197076551 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7fdc5c0b53a0 0x7fdc5c0b7860 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:29:19.658 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:19.653+0000 7fdc7955d640 1 --2- 172.21.15.19:0/197076551 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdc74108020 0x7fdc7410baa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:29:19.658 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:19.653+0000 7fdc7955d640 1 --2- 172.21.15.19:0/197076551 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fdc741076a0 0x7fdc7410b560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:29:19.658 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:19.653+0000 7fdc7955d640 1 --2- 172.21.15.19:0/197076551 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdc74101c90 0x7fdc7410e310 unknown :-1 s=CLOSED pgs=535 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:29:19.658 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:19.653+0000 7fdc7955d640 1 -- 172.21.15.19:0/197076551 >> 172.21.15.19:0/197076551 conn(0x7fdc740fd700 msgr2=0x7fdc740ffaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:29:19.658 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:19.653+0000 7fdc7955d640 1 -- 172.21.15.19:0/197076551 shutdown_connections 2024-09-10T22:29:19.659 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:19.653+0000 7fdc7955d640 1 -- 172.21.15.19:0/197076551 wait complete. 2024-09-10T22:29:20.458 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:29:20 smithi019 ceph-mon[31375]: pgmap v434: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 685 KiB/s rd, 353 MiB/s wr, 172 op/s 2024-09-10T22:29:20.609 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:29:20 smithi135 ceph-mon[34789]: pgmap v434: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 685 KiB/s rd, 353 MiB/s wr, 172 op/s 2024-09-10T22:29:20.625 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:29:20 smithi138 ceph-mon[35236]: pgmap v434: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 685 KiB/s rd, 353 MiB/s wr, 172 op/s 2024-09-10T22:29:20.629 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 22997a4c-6fc2-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-10T22:29:21.029 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/22997a4c-6fc2-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T22:29:21.781 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:21.742+0000 7f3d0621c640 1 -- 172.21.15.19:0/466732209 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3d00108020 msgr2=0x7f3d0010e820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:29:21.781 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:21.742+0000 7f3d0621c640 1 --2- 172.21.15.19:0/466732209 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3d00108020 0x7f3d0010e820 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f3cf8009ca0 tx=0x7f3cf802a8c0 comp rx=0 tx=0).stop 2024-09-10T22:29:21.781 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:21.742+0000 7f3d0621c640 1 -- 172.21.15.19:0/466732209 shutdown_connections 2024-09-10T22:29:21.781 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:21.742+0000 7f3d0621c640 1 --2- 172.21.15.19:0/466732209 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3d00108020 0x7f3d0010e820 unknown :-1 s=CLOSED pgs=539 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:29:21.781 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:21.742+0000 7f3d0621c640 1 --2- 172.21.15.19:0/466732209 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3d001076a0 0x7f3d00107ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:29:21.781 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:21.742+0000 7f3d0621c640 1 --2- 172.21.15.19:0/466732209 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3d00101c90 0x7f3d00102070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:29:21.782 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:21.742+0000 7f3d0621c640 1 -- 172.21.15.19:0/466732209 >> 172.21.15.19:0/466732209 conn(0x7f3d000fd700 msgr2=0x7f3d000ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:29:21.782 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:21.742+0000 7f3d0621c640 1 -- 172.21.15.19:0/466732209 shutdown_connections 2024-09-10T22:29:21.782 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:21.742+0000 7f3d0621c640 1 -- 172.21.15.19:0/466732209 wait complete. 2024-09-10T22:29:21.782 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:21.743+0000 7f3d0621c640 1 Processor -- start 2024-09-10T22:29:21.782 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:21.743+0000 7f3d0621c640 1 -- start start 2024-09-10T22:29:21.782 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:21.743+0000 7f3d0621c640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3d00101c90 0x7f3d0019a090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:29:21.782 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:21.743+0000 7f3d0621c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3d001076a0 0x7f3d0019a5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:29:21.782 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:21.743+0000 7f3d0621c640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3d00108020 0x7f3d0019ab30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:29:21.782 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:21.743+0000 7f3d0621c640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f3d00111ca0 con 0x7f3d001076a0 2024-09-10T22:29:21.782 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:21.743+0000 7f3d0621c640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f3d00111b20 con 0x7f3d00108020 2024-09-10T22:29:21.782 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:21.743+0000 7f3d0621c640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f3d00111e20 con 0x7f3d00101c90 2024-09-10T22:29:21.782 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:21.744+0000 7f3cf6ffd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3d001076a0 0x7f3d0019a5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:29:21.783 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:21.744+0000 7f3cf6ffd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3d001076a0 0x7f3d0019a5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:36050/0 (socket says 172.21.15.19:36050) 2024-09-10T22:29:21.783 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:21.744+0000 7f3cf6ffd640 1 -- 172.21.15.19:0/1297491078 learned_addr learned my addr 172.21.15.19:0/1297491078 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:29:21.783 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:21.744+0000 7f3cfffff640 1 --2- 172.21.15.19:0/1297491078 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3d00108020 0x7f3d0019ab30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:29:21.783 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:21.744+0000 7f3cff7fe640 1 --2- 172.21.15.19:0/1297491078 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3d00101c90 0x7f3d0019a090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:29:21.783 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:21.744+0000 7f3cf6ffd640 1 -- 172.21.15.19:0/1297491078 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3d00101c90 msgr2=0x7f3d0019a090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:29:21.783 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:21.744+0000 7f3cf6ffd640 1 --2- 172.21.15.19:0/1297491078 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3d00101c90 0x7f3d0019a090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:29:21.783 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:21.744+0000 7f3cf6ffd640 1 -- 172.21.15.19:0/1297491078 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3d00108020 msgr2=0x7f3d0019ab30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:29:21.783 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:21.744+0000 7f3cf6ffd640 1 --2- 172.21.15.19:0/1297491078 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3d00108020 0x7f3d0019ab30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:29:21.783 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:21.744+0000 7f3cf6ffd640 1 -- 172.21.15.19:0/1297491078 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3d001a5470 con 0x7f3d001076a0 2024-09-10T22:29:21.783 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:21.744+0000 7f3cf6ffd640 1 --2- 172.21.15.19:0/1297491078 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3d001076a0 0x7f3d0019a5d0 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f3ce800e9f0 tx=0x7f3ce800edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:29:21.783 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:21.744+0000 7f3cfd7fa640 1 -- 172.21.15.19:0/1297491078 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ce800cd80 con 0x7f3d001076a0 2024-09-10T22:29:21.783 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:21.744+0000 7f3cfd7fa640 1 -- 172.21.15.19:0/1297491078 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3ce80054d0 con 0x7f3d001076a0 2024-09-10T22:29:21.784 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:21.744+0000 7f3d0621c640 1 -- 172.21.15.19:0/1297491078 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3d001a5760 con 0x7f3d001076a0 2024-09-10T22:29:21.784 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:21.744+0000 7f3cfd7fa640 1 -- 172.21.15.19:0/1297491078 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ce8010690 con 0x7f3d001076a0 2024-09-10T22:29:21.784 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:21.744+0000 7f3d0621c640 1 -- 172.21.15.19:0/1297491078 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3d001a5c50 con 0x7f3d001076a0 2024-09-10T22:29:21.784 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:21.747+0000 7f3cfd7fa640 1 -- 172.21.15.19:0/1297491078 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 18) ==== 153250+0+0 (secure 0 0 0) 0x7f3ce8004e90 con 0x7f3d001076a0 2024-09-10T22:29:21.784 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:21.747+0000 7f3d085f1740 1 Processor -- start 2024-09-10T22:29:21.784 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:21.747+0000 7f3d085f1740 1 -- start start 2024-09-10T22:29:21.784 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:21.747+0000 7f3d085f1740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55c097d610f0 0x55c097d614d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:29:21.784 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:21.747+0000 7f3d085f1740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c097d61a10 0x55c097d6d460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:29:21.784 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:21.747+0000 7f3d085f1740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55c097d6d9a0 0x55c097d6fd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:29:21.784 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:21.747+0000 7f3d085f1740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x55c097cd7ea0 con 0x55c097d6d9a0 2024-09-10T22:29:21.784 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:21.747+0000 7f3d085f1740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55c097cc72d0 con 0x55c097d61a10 2024-09-10T22:29:21.784 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:21.747+0000 7f3d085f1740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x55c097ccb0e0 con 0x55c097d610f0 2024-09-10T22:29:21.785 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:21.747+0000 7f3cff7fe640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c097d61a10 0x55c097d6d460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:29:21.785 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:21.747+0000 7f3cff7fe640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c097d61a10 0x55c097d6d460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.19:38190/0 (socket says 172.21.15.19:38190) 2024-09-10T22:29:21.785 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:21.747+0000 7f3cff7fe640 1 -- 172.21.15.19:0/2671380754 learned_addr learned my addr 172.21.15.19:0/2671380754 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:29:21.785 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:21.747+0000 7f3cf6ffd640 1 --2- 172.21.15.19:0/2671380754 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55c097d6d9a0 0x55c097d6fd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:29:21.785 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:21.747+0000 7f3cfffff640 1 --2- 172.21.15.19:0/2671380754 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55c097d610f0 0x55c097d614d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:29:21.785 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:21.748+0000 7f3cff7fe640 1 -- 172.21.15.19:0/2671380754 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55c097d610f0 msgr2=0x55c097d614d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:29:21.785 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:21.748+0000 7f3cff7fe640 1 --2- 172.21.15.19:0/2671380754 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55c097d610f0 0x55c097d614d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:29:21.785 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:21.748+0000 7f3cff7fe640 1 -- 172.21.15.19:0/2671380754 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55c097d6d9a0 msgr2=0x55c097d6fd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:29:21.785 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:21.748+0000 7f3cff7fe640 1 --2- 172.21.15.19:0/2671380754 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55c097d6d9a0 0x55c097d6fd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:29:21.785 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:21.748+0000 7f3cff7fe640 1 -- 172.21.15.19:0/2671380754 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c097a25650 con 0x55c097d61a10 2024-09-10T22:29:21.785 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:21.748+0000 7f3cfd7fa640 1 --2- 172.21.15.19:0/1297491078 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f3cec0b52e0 0x7f3cec0b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:29:21.785 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:21.748+0000 7f3cff7fe640 1 --2- 172.21.15.19:0/2671380754 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c097d61a10 0x55c097d6d460 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f3cf0009cf0 tx=0x7f3cf0011810 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a7bf4d4261d815fb server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:29:21.786 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:21.748+0000 7f3cfffff640 1 --2- 172.21.15.19:0/1297491078 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f3cec0b52e0 0x7f3cec0b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:29:21.786 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:21.748+0000 7f3cfd7fa640 1 -- 172.21.15.19:0/1297491078 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8327+0+0 (secure 0 0 0) 0x7f3ce80e6040 con 0x7f3d001076a0 2024-09-10T22:29:21.786 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:21.748+0000 7f3cf5ffb640 1 -- 172.21.15.19:0/2671380754 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3cf0004230 con 0x55c097d61a10 2024-09-10T22:29:21.786 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:21.748+0000 7f3cf5ffb640 1 -- 172.21.15.19:0/2671380754 <== mon.2 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3cf00043d0 con 0x55c097d61a10 2024-09-10T22:29:21.786 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:21.748+0000 7f3cf5ffb640 1 -- 172.21.15.19:0/2671380754 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3cf0019880 con 0x55c097d61a10 2024-09-10T22:29:21.786 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:21.749+0000 7f3d085f1740 1 -- 172.21.15.19:0/2671380754 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c097d61a10 msgr2=0x55c097d6d460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:29:21.786 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:21.749+0000 7f3cfffff640 1 --2- 172.21.15.19:0/1297491078 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f3cec0b52e0 0x7f3cec0b77a0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f3cf8006010 tx=0x7f3cf80099a0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:29:21.786 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:21.749+0000 7f3d085f1740 1 --2- 172.21.15.19:0/2671380754 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c097d61a10 0x55c097d6d460 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f3cf0009cf0 tx=0x7f3cf0011810 comp rx=0 tx=0).stop 2024-09-10T22:29:21.786 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:21.749+0000 7f3d085f1740 1 -- 172.21.15.19:0/2671380754 shutdown_connections 2024-09-10T22:29:21.786 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:21.749+0000 7f3d085f1740 1 --2- 172.21.15.19:0/2671380754 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55c097d6d9a0 0x55c097d6fd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:29:21.786 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:21.749+0000 7f3d085f1740 1 --2- 172.21.15.19:0/2671380754 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c097d61a10 0x55c097d6d460 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:29:21.786 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:21.749+0000 7f3d085f1740 1 --2- 172.21.15.19:0/2671380754 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55c097d610f0 0x55c097d614d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:29:21.787 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:21.749+0000 7f3d085f1740 1 -- 172.21.15.19:0/2671380754 >> 172.21.15.19:0/2671380754 conn(0x55c097d5ef20 msgr2=0x55c097d600c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:29:21.787 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:21.749+0000 7f3d085f1740 1 -- 172.21.15.19:0/2671380754 shutdown_connections 2024-09-10T22:29:21.787 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:21.749+0000 7f3d085f1740 1 -- 172.21.15.19:0/2671380754 wait complete. 2024-09-10T22:29:21.787 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:21.750+0000 7f3d085f1740 1 -- start start 2024-09-10T22:29:21.787 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:21.750+0000 7f3d085f1740 1 Processor -- start 2024-09-10T22:29:21.787 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:21.750+0000 7f3d085f1740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c097d610f0 0x55c097d6d1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:29:21.787 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:21.751+0000 7f3d085f1740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55c097d61a10 0x55c097d6a620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:29:21.787 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:21.751+0000 7f3d085f1740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55c097d6d9a0 0x55c097d6ab60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:29:21.787 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:21.751+0000 7f3d085f1740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x55c097b28700 con 0x55c097d61a10 2024-09-10T22:29:21.787 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:21.751+0000 7f3d085f1740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55c097c62160 con 0x55c097d610f0 2024-09-10T22:29:21.787 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:21.751+0000 7f3d085f1740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x55c097d70620 con 0x55c097d6d9a0 2024-09-10T22:29:21.787 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:21.751+0000 7f3d085f1740 10 client.0 _ll_register_callbacks cb 0x55c097c7b9e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T22:29:21.787 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:21.751+0000 7f3cff7fe640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c097d610f0 0x55c097d6d1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:29:21.788 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:21.751+0000 7f3cf6ffd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55c097d61a10 0x55c097d6a620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:29:21.788 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:21.751+0000 7f3cfffff640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55c097d6d9a0 0x55c097d6ab60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:29:21.788 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:21.751+0000 7f3cff7fe640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c097d610f0 0x55c097d6d1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.19:38198/0 (socket says 172.21.15.19:38198) 2024-09-10T22:29:21.788 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:21.751+0000 7f3cff7fe640 1 -- 172.21.15.19:0/2142546517 learned_addr learned my addr 172.21.15.19:0/2142546517 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:29:21.788 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:21.751+0000 7f3cff7fe640 1 -- 172.21.15.19:0/2142546517 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55c097d6d9a0 msgr2=0x55c097d6ab60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:29:21.788 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:21.751+0000 7f3cff7fe640 1 --2- 172.21.15.19:0/2142546517 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55c097d6d9a0 0x55c097d6ab60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:29:21.788 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:21.751+0000 7f3cff7fe640 1 -- 172.21.15.19:0/2142546517 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55c097d61a10 msgr2=0x55c097d6a620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:29:21.788 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:21.751+0000 7f3cff7fe640 1 --2- 172.21.15.19:0/2142546517 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55c097d61a10 0x55c097d6a620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:29:21.788 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:21.751+0000 7f3cff7fe640 1 -- 172.21.15.19:0/2142546517 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c097c8fc90 con 0x55c097d610f0 2024-09-10T22:29:21.788 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:21.751+0000 7f3cfffff640 1 --2- 172.21.15.19:0/2142546517 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55c097d6d9a0 0x55c097d6ab60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T22:29:21.788 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:21.751+0000 7f3cff7fe640 1 --2- 172.21.15.19:0/2142546517 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c097d610f0 0x55c097d6d1d0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f3cf0019460 tx=0x7f3cf0003820 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5fa43ca830852ae9 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:29:21.789 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:21.751+0000 7f3cdeffd640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-09-10T22:29:21.789 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:21.751+0000 7f3cdeffd640 1 -- 172.21.15.19:0/2142546517 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3cf0027070 con 0x55c097d610f0 2024-09-10T22:29:21.789 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:21.752+0000 7f3cdeffd640 1 -- 172.21.15.19:0/2142546517 <== mon.2 v2:172.21.15.135:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8327+0+0 (secure 0 0 0) 0x7f3cf0005240 con 0x55c097d610f0 2024-09-10T22:29:21.789 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:21.752+0000 7f3d085f1740 1 -- 172.21.15.19:0/2142546517 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3cf00043d0 con 0x55c097d610f0 2024-09-10T22:29:21.789 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:21.752+0000 7f3cdeffd640 1 -- 172.21.15.19:0/2142546517 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f3cf0033050 con 0x55c097d610f0 2024-09-10T22:29:21.789 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:21.752+0000 7f3d085f1740 10 client.25460 fetch_fsmap learned FSMap version 26 2024-09-10T22:29:21.789 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:21.752+0000 7f3d085f1740 1 -- 172.21.15.19:0/2142546517 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x55c097d79950 con 0x55c097d610f0 2024-09-10T22:29:21.789 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:21.752+0000 7f3cdeffd640 1 -- 172.21.15.19:0/2142546517 <== mon.2 v2:172.21.15.135:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3cf00043d0 con 0x55c097d610f0 2024-09-10T22:29:21.789 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:21.752+0000 7f3cdeffd640 1 -- 172.21.15.19:0/2142546517 <== mon.2 v2:172.21.15.135:3300/0 5 ==== fsmap(e 26) ==== 8350+0+0 (secure 0 0 0) 0x7f3cf0004b70 con 0x55c097d610f0 2024-09-10T22:29:21.789 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:21.752+0000 7f3d085f1740 10 client.25460 fetch_fsmap finished waiting for FSMap version 26 2024-09-10T22:29:21.789 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:21.752+0000 7f3d085f1740 10 client.25460 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-10T22:29:21.789 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:21.752+0000 7f3d085f1740 20 client.25460 populate_metadata read hostname 'smithi019' 2024-09-10T22:29:21.790 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:21.752+0000 7f3d085f1740 1 --2- 172.21.15.19:0/2142546517 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x55c097d7ad60 0x55c097d7d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:29:21.790 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:21.752+0000 7f3d085f1740 4 client.25460 mds_command: new command op to 24581 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T22:29:21.790 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:21.752+0000 7f3d085f1740 1 -- 172.21.15.19:0/2142546517 --> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c097cd9df0 con 0x55c097d7ad60 2024-09-10T22:29:21.790 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:21.753+0000 7f3cf6ffd640 1 --2- 172.21.15.19:0/2142546517 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x55c097d7ad60 0x55c097d7d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:29:21.790 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:21.753+0000 7f3cdeffd640 10 client.25460 ms_handle_connect on v2:172.21.15.135:6838/1254769802 2024-09-10T22:29:21.790 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:21.753+0000 7f3cf6ffd640 1 --2- 172.21.15.19:0/2142546517 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x55c097d7ad60 0x55c097d7d1c0 crc :-1 s=READY pgs=80 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b52b620091b35cab server_cookie=754553ae5fde3c7a in_seq=0 out_seq=0 2024-09-10T22:29:21.790 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:21.754+0000 7f3cdeffd640 1 -- 172.21.15.19:0/2142546517 <== mds.0 v2:172.21.15.135:6838/1254769802 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55c097cd9df0 con 0x55c097d7ad60 2024-09-10T22:29:21.790 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:21.754+0000 7f3cdeffd640 10 client.25460 handle_command_reply: tid=0 2024-09-10T22:29:21.790 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:21.754+0000 7f3d085f1740 1 client.25460 shutdown 2024-09-10T22:29:21.791 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:21.754+0000 7f3d085f1740 1 -- 172.21.15.19:0/2142546517 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c097d610f0 msgr2=0x55c097d6d1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:29:21.791 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:21.754+0000 7f3d085f1740 1 --2- 172.21.15.19:0/2142546517 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c097d610f0 0x55c097d6d1d0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f3cf0019460 tx=0x7f3cf0003820 comp rx=0 tx=0).stop 2024-09-10T22:29:21.791 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:21.754+0000 7f3d085f1740 1 -- 172.21.15.19:0/2142546517 shutdown_connections 2024-09-10T22:29:21.791 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:21.754+0000 7f3d085f1740 1 --2- 172.21.15.19:0/2142546517 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x55c097d7ad60 0x55c097d7d1c0 crc :-1 s=READY pgs=80 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:29:21.791 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:21.754+0000 7f3d085f1740 1 --2- 172.21.15.19:0/2142546517 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55c097d6d9a0 0x55c097d6ab60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:29:21.791 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:21.754+0000 7f3d085f1740 1 --2- 172.21.15.19:0/2142546517 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55c097d61a10 0x55c097d6a620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:29:21.791 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:21.754+0000 7f3cdeffd640 0 client.25460 ms_handle_reset on v2:172.21.15.135:6838/1254769802 2024-09-10T22:29:21.791 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:21.754+0000 7f3d085f1740 1 --2- 172.21.15.19:0/2142546517 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c097d610f0 0x55c097d6d1d0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:29:21.791 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:21.754+0000 7f3d085f1740 1 -- 172.21.15.19:0/2142546517 >> 172.21.15.19:0/2142546517 conn(0x55c097d5ef20 msgr2=0x55c097d64ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:29:21.791 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:21.754+0000 7f3d085f1740 1 -- 172.21.15.19:0/2142546517 shutdown_connections 2024-09-10T22:29:21.791 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:21.754+0000 7f3d085f1740 1 -- 172.21.15.19:0/2142546517 wait complete. 2024-09-10T22:29:21.791 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:21.754+0000 7f3d085f1740 20 client.25460 trim_cache size 0 max 16384 2024-09-10T22:29:21.791 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:21.768+0000 7f3d085f1740 1 Processor -- start 2024-09-10T22:29:21.791 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:21.768+0000 7f3d085f1740 1 -- start start 2024-09-10T22:29:21.792 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:21.768+0000 7f3d085f1740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55c097d610f0 0x55c097d5e760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:29:21.792 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:21.768+0000 7f3d085f1740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c097d61a10 0x55c097d69b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:29:21.792 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:21.768+0000 7f3d085f1740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55c097d6d9a0 0x55c097d65870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:29:21.792 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:21.768+0000 7f3d085f1740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f3d001aec20 con 0x55c097d610f0 2024-09-10T22:29:21.792 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:21.768+0000 7f3d085f1740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f3d001ac4f0 con 0x55c097d61a10 2024-09-10T22:29:21.792 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:21.768+0000 7f3d085f1740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f3d001aa340 con 0x55c097d6d9a0 2024-09-10T22:29:21.792 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:21.768+0000 7f3cff7fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55c097d610f0 0x55c097d5e760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:29:21.792 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:21.768+0000 7f3cf6ffd640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c097d61a10 0x55c097d69b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:29:21.792 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:21.768+0000 7f3cff7fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55c097d610f0 0x55c097d5e760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:36084/0 (socket says 172.21.15.19:36084) 2024-09-10T22:29:21.792 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:21.768+0000 7f3cff7fe640 1 -- 172.21.15.19:0/61666389 learned_addr learned my addr 172.21.15.19:0/61666389 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:29:21.792 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:21.768+0000 7f3cfffff640 1 --2- 172.21.15.19:0/61666389 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55c097d6d9a0 0x55c097d65870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:29:21.792 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:21.768+0000 7f3cf6ffd640 1 -- 172.21.15.19:0/61666389 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55c097d6d9a0 msgr2=0x55c097d65870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:29:21.792 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:21.768+0000 7f3cf6ffd640 1 --2- 172.21.15.19:0/61666389 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55c097d6d9a0 0x55c097d65870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:29:21.793 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:21.768+0000 7f3cf6ffd640 1 -- 172.21.15.19:0/61666389 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55c097d610f0 msgr2=0x55c097d5e760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:29:21.793 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:21.768+0000 7f3cf6ffd640 1 --2- 172.21.15.19:0/61666389 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55c097d610f0 0x55c097d5e760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:29:21.793 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:21.768+0000 7f3cf6ffd640 1 -- 172.21.15.19:0/61666389 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c097d60790 con 0x55c097d61a10 2024-09-10T22:29:21.793 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:21.768+0000 7f3cff7fe640 1 --2- 172.21.15.19:0/61666389 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55c097d610f0 0x55c097d5e760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T22:29:21.793 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:21.768+0000 7f3cfffff640 1 --2- 172.21.15.19:0/61666389 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55c097d6d9a0 0x55c097d65870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T22:29:21.793 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:21.768+0000 7f3cf6ffd640 1 --2- 172.21.15.19:0/61666389 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c097d61a10 0x55c097d69b30 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f3ce80e3ab0 tx=0x7f3ce80e6400 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6d2299a3c0a0cbf3 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:29:21.793 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:21.769+0000 7f3cf57fa640 1 -- 172.21.15.19:0/61666389 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ce80ac570 con 0x55c097d61a10 2024-09-10T22:29:21.793 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:21.769+0000 7f3cf57fa640 1 -- 172.21.15.19:0/61666389 <== mon.2 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3ce80cf040 con 0x55c097d61a10 2024-09-10T22:29:21.793 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:21.769+0000 7f3cf57fa640 1 -- 172.21.15.19:0/61666389 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ce80abf10 con 0x55c097d61a10 2024-09-10T22:29:21.793 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:21.769+0000 7f3d085f1740 1 -- 172.21.15.19:0/61666389 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c097d61a10 msgr2=0x55c097d69b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:29:21.793 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:21.769+0000 7f3d085f1740 1 --2- 172.21.15.19:0/61666389 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c097d61a10 0x55c097d69b30 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f3ce80e3ab0 tx=0x7f3ce80e6400 comp rx=0 tx=0).stop 2024-09-10T22:29:21.793 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:21.769+0000 7f3d085f1740 1 -- 172.21.15.19:0/61666389 shutdown_connections 2024-09-10T22:29:21.794 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:21.769+0000 7f3d085f1740 1 --2- 172.21.15.19:0/61666389 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55c097d6d9a0 0x55c097d65870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:29:21.794 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:21.769+0000 7f3d085f1740 1 --2- 172.21.15.19:0/61666389 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c097d61a10 0x55c097d69b30 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:29:21.794 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:21.769+0000 7f3d085f1740 1 --2- 172.21.15.19:0/61666389 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55c097d610f0 0x55c097d5e760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:29:21.794 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:21.769+0000 7f3d085f1740 1 -- 172.21.15.19:0/61666389 >> 172.21.15.19:0/61666389 conn(0x55c097d5ef20 msgr2=0x55c097d6a5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:29:21.794 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:21.769+0000 7f3d085f1740 1 -- 172.21.15.19:0/61666389 shutdown_connections 2024-09-10T22:29:21.794 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:21.769+0000 7f3d085f1740 1 -- 172.21.15.19:0/61666389 wait complete. 2024-09-10T22:29:21.794 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:21.770+0000 7f3d085f1740 1 -- start start 2024-09-10T22:29:21.794 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:21.770+0000 7f3d085f1740 1 Processor -- start 2024-09-10T22:29:21.794 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:21.770+0000 7f3d085f1740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c097d610f0 0x55c097d71260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:29:21.794 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:21.770+0000 7f3d085f1740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55c097d61a10 0x55c097d71800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:29:21.794 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:21.770+0000 7f3d085f1740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55c097d6d9a0 0x55c097d75700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:29:21.794 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:21.770+0000 7f3d085f1740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f3d001aa9b0 con 0x55c097d6d9a0 2024-09-10T22:29:21.794 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:21.770+0000 7f3d085f1740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f3d001abe20 con 0x55c097d610f0 2024-09-10T22:29:21.795 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:21.770+0000 7f3d085f1740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f3d001ab080 con 0x55c097d61a10 2024-09-10T22:29:21.795 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:21.770+0000 7f3d085f1740 10 client.0 _ll_register_callbacks cb 0x7f3ce80e99f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T22:29:21.795 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:21.770+0000 7f3cfffff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55c097d6d9a0 0x55c097d75700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:29:21.795 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:21.770+0000 7f3cf6ffd640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55c097d61a10 0x55c097d71800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:29:21.795 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:21.770+0000 7f3cf6ffd640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55c097d61a10 0x55c097d71800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.19:58456/0 (socket says 172.21.15.19:58456) 2024-09-10T22:29:21.795 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:21.770+0000 7f3cf6ffd640 1 -- 172.21.15.19:0/2433940888 learned_addr learned my addr 172.21.15.19:0/2433940888 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:29:21.795 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:21.770+0000 7f3cfffff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55c097d6d9a0 0x55c097d75700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:36098/0 (socket says 172.21.15.19:36098) 2024-09-10T22:29:21.795 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:21.771+0000 7f3cff7fe640 1 --2- 172.21.15.19:0/2433940888 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c097d610f0 0x55c097d71260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:29:21.795 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:21.771+0000 7f3cf6ffd640 1 -- 172.21.15.19:0/2433940888 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c097d610f0 msgr2=0x55c097d71260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:29:21.795 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:21.771+0000 7f3cf6ffd640 1 --2- 172.21.15.19:0/2433940888 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c097d610f0 0x55c097d71260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:29:21.795 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:21.771+0000 7f3cf6ffd640 1 -- 172.21.15.19:0/2433940888 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55c097d6d9a0 msgr2=0x55c097d75700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:29:21.795 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:21.771+0000 7f3cf6ffd640 1 --2- 172.21.15.19:0/2433940888 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55c097d6d9a0 0x55c097d75700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:29:21.796 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:21.771+0000 7f3cf6ffd640 1 -- 172.21.15.19:0/2433940888 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c097d75e40 con 0x55c097d61a10 2024-09-10T22:29:21.796 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:21.771+0000 7f3cf6ffd640 1 --2- 172.21.15.19:0/2433940888 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55c097d61a10 0x55c097d71800 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f3ce80e3e50 tx=0x7f3ce8005c70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5c28d1c4072553c9 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:29:21.796 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:21.771+0000 7f3cdeffd640 10 client.0 ms_handle_connect on v2:172.21.15.138:3300/0 2024-09-10T22:29:21.796 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:21.771+0000 7f3cdeffd640 1 -- 172.21.15.19:0/2433940888 <== mon.1 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ce80ac0f0 con 0x55c097d61a10 2024-09-10T22:29:21.796 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:21.771+0000 7f3cdeffd640 1 -- 172.21.15.19:0/2433940888 <== mon.1 v2:172.21.15.138:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8327+0+0 (secure 0 0 0) 0x7f3ce80a8a10 con 0x55c097d61a10 2024-09-10T22:29:21.796 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:21.771+0000 7f3d085f1740 1 -- 172.21.15.19:0/2433940888 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3ce80cf040 con 0x55c097d61a10 2024-09-10T22:29:21.796 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:21.771+0000 7f3cdeffd640 1 -- 172.21.15.19:0/2433940888 <== mon.1 v2:172.21.15.138:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f3ce80abf10 con 0x55c097d61a10 2024-09-10T22:29:21.796 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:21.771+0000 7f3d085f1740 10 client.25456 fetch_fsmap learned FSMap version 26 2024-09-10T22:29:21.796 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:21.771+0000 7f3d085f1740 1 -- 172.21.15.19:0/2433940888 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x55c097df2890 con 0x55c097d61a10 2024-09-10T22:29:21.796 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:21.771+0000 7f3cdeffd640 1 -- 172.21.15.19:0/2433940888 <== mon.1 v2:172.21.15.138:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3ce80cf040 con 0x55c097d61a10 2024-09-10T22:29:21.796 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:21.772+0000 7f3cdeffd640 1 -- 172.21.15.19:0/2433940888 <== mon.1 v2:172.21.15.138:3300/0 5 ==== fsmap(e 26) ==== 8350+0+0 (secure 0 0 0) 0x7f3ce80e8110 con 0x55c097d61a10 2024-09-10T22:29:21.796 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:21.772+0000 7f3d085f1740 10 client.25456 fetch_fsmap finished waiting for FSMap version 26 2024-09-10T22:29:21.796 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:21.772+0000 7f3d085f1740 10 client.25456 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-10T22:29:21.797 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:21.772+0000 7f3d085f1740 20 client.25456 populate_metadata read hostname 'smithi019' 2024-09-10T22:29:21.797 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:21.772+0000 7f3d085f1740 1 --2- 172.21.15.19:0/2433940888 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x55c097df3070 0x55c097df5490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:29:21.797 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:21.772+0000 7f3d085f1740 4 client.25456 mds_command: new command op to 24581 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-10T22:29:21.797 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:21.772+0000 7f3d085f1740 1 -- 172.21.15.19:0/2433940888 --> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55c097cd58a0 con 0x55c097df3070 2024-09-10T22:29:21.797 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:21.772+0000 7f3cff7fe640 1 --2- 172.21.15.19:0/2433940888 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x55c097df3070 0x55c097df5490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:29:21.797 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:21.772+0000 7f3cff7fe640 1 --2- 172.21.15.19:0/2433940888 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x55c097df3070 0x55c097df5490 crc :-1 s=READY pgs=81 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4b5e02b1e48f315c server_cookie=c8222341d1ec1335 in_seq=0 out_seq=0 2024-09-10T22:29:21.797 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:21.772+0000 7f3cdeffd640 10 client.25456 ms_handle_connect on v2:172.21.15.135:6838/1254769802 2024-09-10T22:29:21.797 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:21.772+0000 7f3cdeffd640 1 -- 172.21.15.19:0/2433940888 <== mds.0 v2:172.21.15.135:6838/1254769802 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55c097cd58a0 con 0x55c097df3070 2024-09-10T22:29:21.797 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:21.772+0000 7f3cdeffd640 10 client.25456 handle_command_reply: tid=0 2024-09-10T22:29:21.797 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:21.772+0000 7f3d085f1740 1 client.25456 shutdown 2024-09-10T22:29:21.797 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:21.773+0000 7f3d085f1740 1 -- 172.21.15.19:0/2433940888 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55c097d61a10 msgr2=0x55c097d71800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:29:21.797 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:21.773+0000 7f3d085f1740 1 --2- 172.21.15.19:0/2433940888 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55c097d61a10 0x55c097d71800 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f3ce80e3e50 tx=0x7f3ce8005c70 comp rx=0 tx=0).stop 2024-09-10T22:29:21.797 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:21.773+0000 7f3d085f1740 1 -- 172.21.15.19:0/2433940888 shutdown_connections 2024-09-10T22:29:21.798 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:21.773+0000 7f3d085f1740 1 --2- 172.21.15.19:0/2433940888 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55c097d6d9a0 0x55c097d75700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:29:21.798 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:21.773+0000 7f3d085f1740 1 --2- 172.21.15.19:0/2433940888 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x55c097df3070 0x55c097df5490 crc :-1 s=READY pgs=81 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:29:21.798 INFO:teuthology.orchestra.run.smithi019.stdout:[] 2024-09-10T22:29:21.798 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:21.773+0000 7f3d085f1740 1 --2- 172.21.15.19:0/2433940888 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55c097d61a10 0x55c097d71800 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:29:21.798 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:21.773+0000 7f3d085f1740 1 --2- 172.21.15.19:0/2433940888 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c097d610f0 0x55c097d71260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:29:21.799 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:21.773+0000 7f3cdeffd640 0 client.25456 ms_handle_reset on v2:172.21.15.135:6838/1254769802 2024-09-10T22:29:21.799 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:21.773+0000 7f3d085f1740 1 -- 172.21.15.19:0/2433940888 >> 172.21.15.19:0/2433940888 conn(0x55c097d5ef20 msgr2=0x55c097d6a3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:29:21.799 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:21.773+0000 7f3d085f1740 1 -- 172.21.15.19:0/2433940888 shutdown_connections 2024-09-10T22:29:21.799 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:21.773+0000 7f3d085f1740 1 -- 172.21.15.19:0/2433940888 wait complete. 2024-09-10T22:29:21.799 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:21.773+0000 7f3d085f1740 20 client.25456 trim_cache size 0 max 16384 2024-09-10T22:29:21.799 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:21.773+0000 7f3d0621c640 1 -- 172.21.15.19:0/1297491078 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f3cec0b52e0 msgr2=0x7f3cec0b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:29:21.799 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:21.773+0000 7f3d0621c640 1 --2- 172.21.15.19:0/1297491078 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f3cec0b52e0 0x7f3cec0b77a0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f3cf8006010 tx=0x7f3cf80099a0 comp rx=0 tx=0).stop 2024-09-10T22:29:21.799 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:21.773+0000 7f3d0621c640 1 -- 172.21.15.19:0/1297491078 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3d001076a0 msgr2=0x7f3d0019a5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:29:21.799 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:21.773+0000 7f3d0621c640 1 --2- 172.21.15.19:0/1297491078 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3d001076a0 0x7f3d0019a5d0 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f3ce800e9f0 tx=0x7f3ce800edf0 comp rx=0 tx=0).stop 2024-09-10T22:29:21.799 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:21.773+0000 7f3d0621c640 1 -- 172.21.15.19:0/1297491078 shutdown_connections 2024-09-10T22:29:21.799 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:21.773+0000 7f3d0621c640 1 --2- 172.21.15.19:0/1297491078 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f3cec0b52e0 0x7f3cec0b77a0 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:29:21.799 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:21.773+0000 7f3d0621c640 1 --2- 172.21.15.19:0/1297491078 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3d00108020 0x7f3d0019ab30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:29:21.799 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:21.773+0000 7f3d0621c640 1 --2- 172.21.15.19:0/1297491078 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3d001076a0 0x7f3d0019a5d0 unknown :-1 s=CLOSED pgs=540 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:29:21.799 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:21.773+0000 7f3d0621c640 1 --2- 172.21.15.19:0/1297491078 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3d00101c90 0x7f3d0019a090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:29:21.800 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:21.773+0000 7f3d0621c640 1 -- 172.21.15.19:0/1297491078 >> 172.21.15.19:0/1297491078 conn(0x7f3d000fd700 msgr2=0x7f3d000ffaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:29:21.800 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:21.774+0000 7f3d0621c640 1 -- 172.21.15.19:0/1297491078 shutdown_connections 2024-09-10T22:29:21.800 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:21.774+0000 7f3d0621c640 1 -- 172.21.15.19:0/1297491078 wait complete. 2024-09-10T22:29:22.454 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:29:22 smithi019 ceph-mon[31375]: pgmap v435: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 686 KiB/s rd, 398 MiB/s wr, 192 op/s 2024-09-10T22:29:22.609 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:29:22 smithi135 ceph-mon[34789]: pgmap v435: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 686 KiB/s rd, 398 MiB/s wr, 192 op/s 2024-09-10T22:29:22.625 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:29:22 smithi138 ceph-mon[35236]: pgmap v435: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 686 KiB/s rd, 398 MiB/s wr, 192 op/s 2024-09-10T22:29:23.214 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:23.212+0000 7ff8697fa640 1 -- 172.21.15.19:0/3982322317 <== mds.0 v2:172.21.15.135:6838/1254769802 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55706a327520 con 0x55706a43cd80 2024-09-10T22:29:23.214 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:23.212+0000 7ff8697fa640 10 client.15930 handle_command_reply: tid=0 2024-09-10T22:29:23.214 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:23.212+0000 7ff88b010740 1 client.15930 shutdown 2024-09-10T22:29:23.214 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:23.212+0000 7ff88b010740 1 -- 172.21.15.19:0/3982322317 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55706a3ba860 msgr2=0x55706a3cb720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:29:23.214 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:23.212+0000 7ff88b010740 1 --2- 172.21.15.19:0/3982322317 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55706a3ba860 0x55706a3cb720 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7ff870009640 tx=0x7ff8700095c0 comp rx=0 tx=0).stop 2024-09-10T22:29:23.214 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:23.212+0000 7ff88b010740 1 -- 172.21.15.19:0/3982322317 shutdown_connections 2024-09-10T22:29:23.214 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:23.212+0000 7ff88b010740 1 --2- 172.21.15.19:0/3982322317 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55706a3bfbd0 0x55706a3ca960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:29:23.214 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:23.212+0000 7ff88b010740 1 --2- 172.21.15.19:0/3982322317 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x55706a43cd80 0x55706a43f1a0 crc :-1 s=READY pgs=79 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:29:23.214 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:23.212+0000 7ff88b010740 1 --2- 172.21.15.19:0/3982322317 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55706a3bd190 0x55706a3ca420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:29:23.215 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:23.212+0000 7ff88b010740 1 --2- 172.21.15.19:0/3982322317 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55706a3ba860 0x55706a3cb720 unknown :-1 s=CLOSED pgs=533 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:29:23.215 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:23.212+0000 7ff88b010740 1 -- 172.21.15.19:0/3982322317 >> 172.21.15.19:0/3982322317 conn(0x55706a3b59b0 msgr2=0x55706a3b98c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:29:23.215 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:23.212+0000 7ff8697fa640 0 client.15930 ms_handle_reset on v2:172.21.15.135:6838/1254769802 2024-09-10T22:29:23.215 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:23.212+0000 7ff88b010740 1 -- 172.21.15.19:0/3982322317 shutdown_connections 2024-09-10T22:29:23.215 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:23.212+0000 7ff88b010740 1 -- 172.21.15.19:0/3982322317 wait complete. 2024-09-10T22:29:23.215 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:23.212+0000 7ff88b010740 20 client.15930 trim_cache size 0 max 16384 2024-09-10T22:29:23.215 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stdout:{ 2024-09-10T22:29:23.215 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stdout: "message": "", 2024-09-10T22:29:23.215 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stdout: "return_code": 0 2024-09-10T22:29:23.215 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stdout:} 2024-09-10T22:29:23.216 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:23.214+0000 7ff888164640 1 -- 172.21.15.19:0/2213867294 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7ff86c0b52e0 msgr2=0x7ff86c0b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:29:23.216 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:23.214+0000 7ff888164640 1 --2- 172.21.15.19:0/2213867294 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7ff86c0b52e0 0x7ff86c0b77a0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7ff87c000c00 tx=0x7ff87c005a20 comp rx=0 tx=0).stop 2024-09-10T22:29:23.216 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:23.214+0000 7ff888164640 1 -- 172.21.15.19:0/2213867294 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff880108680 msgr2=0x7ff88019a050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:29:23.217 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:23.214+0000 7ff888164640 1 --2- 172.21.15.19:0/2213867294 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff880108680 0x7ff88019a050 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7ff87800ec50 tx=0x7ff87800c6a0 comp rx=0 tx=0).stop 2024-09-10T22:29:23.217 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:23.214+0000 7ff888164640 1 -- 172.21.15.19:0/2213867294 shutdown_connections 2024-09-10T22:29:23.217 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:23.214+0000 7ff888164640 1 --2- 172.21.15.19:0/2213867294 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7ff86c0b52e0 0x7ff86c0b77a0 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:29:23.217 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:23.214+0000 7ff888164640 1 --2- 172.21.15.19:0/2213867294 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff880108680 0x7ff88019a050 unknown :-1 s=CLOSED pgs=532 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:29:23.217 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:23.214+0000 7ff888164640 1 --2- 172.21.15.19:0/2213867294 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff880105ad0 0x7ff880199420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:29:23.217 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:23.214+0000 7ff888164640 1 --2- 172.21.15.19:0/2213867294 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff88006bc90 0x7ff880198dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:29:23.217 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:23.214+0000 7ff888164640 1 -- 172.21.15.19:0/2213867294 >> 172.21.15.19:0/2213867294 conn(0x7ff8800fd130 msgr2=0x7ff880103d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:29:23.217 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:23.214+0000 7ff888164640 1 -- 172.21.15.19:0/2213867294 shutdown_connections 2024-09-10T22:29:23.217 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:23.214+0000 7ff888164640 1 -- 172.21.15.19:0/2213867294 wait complete. 2024-09-10T22:29:24.042 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-10T22:29:24.042 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 22997a4c-6fc2-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-10T22:29:24.417 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/22997a4c-6fc2-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T22:29:24.458 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:29:24 smithi019 ceph-mon[31375]: pgmap v436: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 686 KiB/s rd, 366 MiB/s wr, 178 op/s 2024-09-10T22:29:24.609 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:29:24 smithi135 ceph-mon[34789]: pgmap v436: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 686 KiB/s rd, 366 MiB/s wr, 178 op/s 2024-09-10T22:29:24.625 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:29:24 smithi138 ceph-mon[35236]: pgmap v436: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 686 KiB/s rd, 366 MiB/s wr, 178 op/s 2024-09-10T22:29:25.357 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:25.315+0000 7f1c8bfa2640 1 -- 172.21.15.19:0/4147893872 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1c84108020 msgr2=0x7f1c8410e820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:29:25.357 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:25.316+0000 7f1c8bfa2640 1 --2- 172.21.15.19:0/4147893872 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1c84108020 0x7f1c8410e820 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f1c7c009ca0 tx=0x7f1c7c02a8c0 comp rx=0 tx=0).stop 2024-09-10T22:29:25.357 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:25.316+0000 7f1c8bfa2640 1 -- 172.21.15.19:0/4147893872 shutdown_connections 2024-09-10T22:29:25.358 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:25.316+0000 7f1c8bfa2640 1 --2- 172.21.15.19:0/4147893872 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1c84108020 0x7f1c8410e820 unknown :-1 s=CLOSED pgs=541 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:29:25.358 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:25.316+0000 7f1c8bfa2640 1 --2- 172.21.15.19:0/4147893872 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f1c841076a0 0x7f1c84107ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:29:25.358 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:25.316+0000 7f1c8bfa2640 1 --2- 172.21.15.19:0/4147893872 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1c84101c90 0x7f1c84102070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:29:25.358 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:25.316+0000 7f1c8bfa2640 1 -- 172.21.15.19:0/4147893872 >> 172.21.15.19:0/4147893872 conn(0x7f1c840fd700 msgr2=0x7f1c840ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:29:25.358 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:25.316+0000 7f1c8bfa2640 1 -- 172.21.15.19:0/4147893872 shutdown_connections 2024-09-10T22:29:25.358 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:25.316+0000 7f1c8bfa2640 1 -- 172.21.15.19:0/4147893872 wait complete. 2024-09-10T22:29:25.358 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:25.317+0000 7f1c8bfa2640 1 Processor -- start 2024-09-10T22:29:25.358 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:25.317+0000 7f1c8bfa2640 1 -- start start 2024-09-10T22:29:25.358 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:25.317+0000 7f1c8bfa2640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f1c84101c90 0x7f1c8419b520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:29:25.358 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:25.317+0000 7f1c8bfa2640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1c841076a0 0x7f1c8419ba60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:29:25.358 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:25.317+0000 7f1c8bfa2640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1c84108020 0x7f1c841a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:29:25.358 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:25.317+0000 7f1c8bfa2640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f1c84111ca0 con 0x7f1c841076a0 2024-09-10T22:29:25.359 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:25.317+0000 7f1c8bfa2640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f1c84111b20 con 0x7f1c84108020 2024-09-10T22:29:25.359 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:25.317+0000 7f1c8bfa2640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f1c84111e20 con 0x7f1c84101c90 2024-09-10T22:29:25.359 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:25.317+0000 7f1c8953d640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1c841076a0 0x7f1c8419ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:29:25.359 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:25.317+0000 7f1c8953d640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1c841076a0 0x7f1c8419ba60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:39668/0 (socket says 172.21.15.19:39668) 2024-09-10T22:29:25.359 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:25.317+0000 7f1c8953d640 1 -- 172.21.15.19:0/2779115842 learned_addr learned my addr 172.21.15.19:0/2779115842 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:29:25.359 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:25.317+0000 7f1c89d3e640 1 --2- 172.21.15.19:0/2779115842 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f1c84101c90 0x7f1c8419b520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:29:25.359 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:25.317+0000 7f1c8a53f640 1 --2- 172.21.15.19:0/2779115842 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1c84108020 0x7f1c841a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:29:25.359 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:25.317+0000 7f1c8953d640 1 -- 172.21.15.19:0/2779115842 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f1c84101c90 msgr2=0x7f1c8419b520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:29:25.359 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:25.317+0000 7f1c8953d640 1 --2- 172.21.15.19:0/2779115842 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f1c84101c90 0x7f1c8419b520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:29:25.359 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:25.317+0000 7f1c8953d640 1 -- 172.21.15.19:0/2779115842 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1c84108020 msgr2=0x7f1c841a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:29:25.359 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:25.317+0000 7f1c8953d640 1 --2- 172.21.15.19:0/2779115842 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1c84108020 0x7f1c841a0e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:29:25.359 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:25.318+0000 7f1c8953d640 1 -- 172.21.15.19:0/2779115842 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1c841a15d0 con 0x7f1c841076a0 2024-09-10T22:29:25.359 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:25.318+0000 7f1c89d3e640 1 --2- 172.21.15.19:0/2779115842 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f1c84101c90 0x7f1c8419b520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T22:29:25.360 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:25.318+0000 7f1c8953d640 1 --2- 172.21.15.19:0/2779115842 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1c841076a0 0x7f1c8419ba60 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f1c7400e9f0 tx=0x7f1c7400eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:29:25.360 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:25.318+0000 7f1c7affd640 1 -- 172.21.15.19:0/2779115842 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c7400cd80 con 0x7f1c841076a0 2024-09-10T22:29:25.360 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:25.318+0000 7f1c8bfa2640 1 -- 172.21.15.19:0/2779115842 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1c841a18c0 con 0x7f1c841076a0 2024-09-10T22:29:25.360 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:25.318+0000 7f1c8bfa2640 1 -- 172.21.15.19:0/2779115842 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1c841a7f80 con 0x7f1c841076a0 2024-09-10T22:29:25.360 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:25.318+0000 7f1c7affd640 1 -- 172.21.15.19:0/2779115842 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1c740108e0 con 0x7f1c841076a0 2024-09-10T22:29:25.360 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:25.318+0000 7f1c7affd640 1 -- 172.21.15.19:0/2779115842 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c740188e0 con 0x7f1c841076a0 2024-09-10T22:29:25.360 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:25.322+0000 7f1c8e377740 1 Processor -- start 2024-09-10T22:29:25.360 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:25.322+0000 7f1c8e377740 1 -- start start 2024-09-10T22:29:25.360 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:25.322+0000 7f1c8e377740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x564030769ee0 0x56403076a2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:29:25.360 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:25.322+0000 7f1c8e377740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56403076a800 0x564030776250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:29:25.360 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:25.322+0000 7f1c8e377740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x564030776790 0x564030778b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:29:25.360 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:25.322+0000 7f1c8e377740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x5640306e0e60 con 0x564030776790 2024-09-10T22:29:25.360 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:25.322+0000 7f1c8e377740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x5640306d0290 con 0x56403076a800 2024-09-10T22:29:25.361 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:25.322+0000 7f1c8e377740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x5640306d40a0 con 0x564030769ee0 2024-09-10T22:29:25.361 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:25.323+0000 7f1c8a53f640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x564030769ee0 0x56403076a2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:29:25.361 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:25.323+0000 7f1c8a53f640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x564030769ee0 0x56403076a2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.19:49850/0 (socket says 172.21.15.19:49850) 2024-09-10T22:29:25.361 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:25.323+0000 7f1c8a53f640 1 -- 172.21.15.19:0/885048925 learned_addr learned my addr 172.21.15.19:0/885048925 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:29:25.361 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:25.323+0000 7f1c7affd640 1 -- 172.21.15.19:0/2779115842 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 18) ==== 153250+0+0 (secure 0 0 0) 0x7f1c74010430 con 0x7f1c841076a0 2024-09-10T22:29:25.361 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:25.323+0000 7f1c8a53f640 1 -- 172.21.15.19:0/885048925 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56403076a800 msgr2=0x564030776250 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-10T22:29:25.361 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:25.323+0000 7f1c8a53f640 1 --2- 172.21.15.19:0/885048925 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56403076a800 0x564030776250 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:29:25.361 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:25.323+0000 7f1c8a53f640 1 -- 172.21.15.19:0/885048925 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x564030776790 msgr2=0x564030778b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:29:25.361 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:25.323+0000 7f1c8a53f640 1 --2- 172.21.15.19:0/885048925 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x564030776790 0x564030778b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:29:25.361 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:25.323+0000 7f1c8a53f640 1 -- 172.21.15.19:0/885048925 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56403042e930 con 0x564030769ee0 2024-09-10T22:29:25.361 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:25.323+0000 7f1c8a53f640 1 --2- 172.21.15.19:0/885048925 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x564030769ee0 0x56403076a2c0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f1c7c005fd0 tx=0x7f1c7c009800 comp rx=0 tx=0).ready entity=mon.1 client_cookie=eaab613a884ecd42 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:29:25.361 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:25.324+0000 7f1c7affd640 1 --2- 172.21.15.19:0/2779115842 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f1c700b5360 0x7f1c700b7820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:29:25.361 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:25.324+0000 7f1c89d3e640 1 --2- 172.21.15.19:0/2779115842 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f1c700b5360 0x7f1c700b7820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:29:25.362 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:25.324+0000 7f1c7affd640 1 -- 172.21.15.19:0/2779115842 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8327+0+0 (secure 0 0 0) 0x7f1c740e5d50 con 0x7f1c841076a0 2024-09-10T22:29:25.362 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:25.324+0000 7f1c89d3e640 1 --2- 172.21.15.19:0/2779115842 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f1c700b5360 0x7f1c700b7820 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x56403076d060 tx=0x7f1c8000b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:29:25.364 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:25.325+0000 7f1c6ffff640 1 -- 172.21.15.19:0/885048925 <== mon.1 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c7c031cf0 con 0x564030769ee0 2024-09-10T22:29:25.364 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:25.325+0000 7f1c6ffff640 1 -- 172.21.15.19:0/885048925 <== mon.1 v2:172.21.15.138:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1c7c036070 con 0x564030769ee0 2024-09-10T22:29:25.364 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:25.325+0000 7f1c6ffff640 1 -- 172.21.15.19:0/885048925 <== mon.1 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c7c0042a0 con 0x564030769ee0 2024-09-10T22:29:25.364 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:25.326+0000 7f1c8e377740 1 -- 172.21.15.19:0/885048925 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x564030769ee0 msgr2=0x56403076a2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:29:25.365 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:25.326+0000 7f1c8e377740 1 --2- 172.21.15.19:0/885048925 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x564030769ee0 0x56403076a2c0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f1c7c005fd0 tx=0x7f1c7c009800 comp rx=0 tx=0).stop 2024-09-10T22:29:25.365 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:25.326+0000 7f1c8e377740 1 -- 172.21.15.19:0/885048925 shutdown_connections 2024-09-10T22:29:25.365 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:25.326+0000 7f1c8e377740 1 --2- 172.21.15.19:0/885048925 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x564030776790 0x564030778b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:29:25.365 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:25.326+0000 7f1c8e377740 1 --2- 172.21.15.19:0/885048925 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56403076a800 0x564030776250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:29:25.365 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:25.326+0000 7f1c8e377740 1 --2- 172.21.15.19:0/885048925 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x564030769ee0 0x56403076a2c0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:29:25.365 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:25.326+0000 7f1c8e377740 1 -- 172.21.15.19:0/885048925 >> 172.21.15.19:0/885048925 conn(0x564030767d10 msgr2=0x564030768eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:29:25.365 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:25.327+0000 7f1c8e377740 1 -- 172.21.15.19:0/885048925 shutdown_connections 2024-09-10T22:29:25.365 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:25.327+0000 7f1c8e377740 1 -- 172.21.15.19:0/885048925 wait complete. 2024-09-10T22:29:25.365 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:25.327+0000 7f1c8e377740 1 -- start start 2024-09-10T22:29:25.365 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:25.327+0000 7f1c8e377740 1 Processor -- start 2024-09-10T22:29:25.365 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:25.327+0000 7f1c8e377740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x564030769ee0 0x564030773810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:29:25.365 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:25.328+0000 7f1c8e377740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56403076a800 0x564030773d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:29:25.365 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:25.328+0000 7f1c8e377740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x564030776790 0x564030774290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:29:25.366 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:25.328+0000 7f1c8e377740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x564030531890 con 0x564030769ee0 2024-09-10T22:29:25.366 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:25.328+0000 7f1c8e377740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x56403066ad40 con 0x56403076a800 2024-09-10T22:29:25.366 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:25.328+0000 7f1c8e377740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x564030779260 con 0x564030776790 2024-09-10T22:29:25.366 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:25.328+0000 7f1c8e377740 10 client.0 _ll_register_callbacks cb 0x5640306cec80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T22:29:25.366 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:25.328+0000 7f1c89d3e640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x564030769ee0 0x564030773810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:29:25.366 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:25.328+0000 7f1c8953d640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56403076a800 0x564030773d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:29:25.366 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:25.328+0000 7f1c89d3e640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x564030769ee0 0x564030773810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:39680/0 (socket says 172.21.15.19:39680) 2024-09-10T22:29:25.366 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:25.328+0000 7f1c89d3e640 1 -- 172.21.15.19:0/714134745 learned_addr learned my addr 172.21.15.19:0/714134745 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:29:25.366 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:25.328+0000 7f1c8a53f640 1 --2- 172.21.15.19:0/714134745 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x564030776790 0x564030774290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:29:25.366 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:25.328+0000 7f1c89d3e640 1 -- 172.21.15.19:0/714134745 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x564030776790 msgr2=0x564030774290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:29:25.366 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:25.328+0000 7f1c89d3e640 1 --2- 172.21.15.19:0/714134745 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x564030776790 0x564030774290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:29:25.366 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:25.328+0000 7f1c89d3e640 1 -- 172.21.15.19:0/714134745 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56403076a800 msgr2=0x564030773d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:29:25.367 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:25.328+0000 7f1c89d3e640 1 --2- 172.21.15.19:0/714134745 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56403076a800 0x564030773d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:29:25.367 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:25.328+0000 7f1c89d3e640 1 -- 172.21.15.19:0/714134745 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564030782780 con 0x564030769ee0 2024-09-10T22:29:25.367 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:25.328+0000 7f1c89d3e640 1 --2- 172.21.15.19:0/714134745 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x564030769ee0 0x564030773810 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f1c800119a0 tx=0x7f1c80004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c6183e5e2aef7cdb server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:29:25.367 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:25.328+0000 7f1c6d7fa640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-10T22:29:25.367 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:25.329+0000 7f1c6d7fa640 1 -- 172.21.15.19:0/714134745 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c8001cc50 con 0x564030769ee0 2024-09-10T22:29:25.367 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:25.329+0000 7f1c6d7fa640 1 -- 172.21.15.19:0/714134745 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8327+0+0 (secure 0 0 0) 0x7f1c8001cdf0 con 0x564030769ee0 2024-09-10T22:29:25.367 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:25.329+0000 7f1c8e377740 1 -- 172.21.15.19:0/714134745 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1c7c036070 con 0x564030769ee0 2024-09-10T22:29:25.367 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:25.329+0000 7f1c6d7fa640 1 -- 172.21.15.19:0/714134745 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f1c80027480 con 0x564030769ee0 2024-09-10T22:29:25.367 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:25.329+0000 7f1c8e377740 10 client.15975 fetch_fsmap learned FSMap version 26 2024-09-10T22:29:25.367 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:25.329+0000 7f1c8e377740 1 -- 172.21.15.19:0/714134745 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x564030785190 con 0x564030769ee0 2024-09-10T22:29:25.367 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:25.329+0000 7f1c6d7fa640 1 -- 172.21.15.19:0/714134745 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1c7c036070 con 0x564030769ee0 2024-09-10T22:29:25.367 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:25.329+0000 7f1c6d7fa640 1 -- 172.21.15.19:0/714134745 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 26) ==== 8350+0+0 (secure 0 0 0) 0x7f1c80030050 con 0x564030769ee0 2024-09-10T22:29:25.368 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:25.329+0000 7f1c8e377740 10 client.15975 fetch_fsmap finished waiting for FSMap version 26 2024-09-10T22:29:25.368 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:25.329+0000 7f1c8e377740 10 client.15975 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-10T22:29:25.368 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:25.329+0000 7f1c8e377740 20 client.15975 populate_metadata read hostname 'smithi019' 2024-09-10T22:29:25.368 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:25.329+0000 7f1c8e377740 1 --2- 172.21.15.19:0/714134745 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x5640307865f0 0x564030788a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:29:25.368 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:25.329+0000 7f1c8e377740 4 client.15975 mds_command: new command op to 24581 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T22:29:25.368 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:25.329+0000 7f1c8e377740 1 -- 172.21.15.19:0/714134745 --> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5640306e2db0 con 0x5640307865f0 2024-09-10T22:29:25.368 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:25.330+0000 7f1c8953d640 1 --2- 172.21.15.19:0/714134745 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x5640307865f0 0x564030788a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:29:25.368 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:25.330+0000 7f1c6d7fa640 10 client.15975 ms_handle_connect on v2:172.21.15.135:6838/1254769802 2024-09-10T22:29:25.368 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:25.330+0000 7f1c8953d640 1 --2- 172.21.15.19:0/714134745 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x5640307865f0 0x564030788a40 crc :-1 s=READY pgs=82 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a6f4e48c13c06cea server_cookie=e969dc84a478613 in_seq=0 out_seq=0 2024-09-10T22:29:25.368 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:25.330+0000 7f1c6d7fa640 1 -- 172.21.15.19:0/714134745 <== mds.0 v2:172.21.15.135:6838/1254769802 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5640306e2db0 con 0x5640307865f0 2024-09-10T22:29:25.368 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:25.330+0000 7f1c6d7fa640 10 client.15975 handle_command_reply: tid=0 2024-09-10T22:29:25.368 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:25.331+0000 7f1c8e377740 1 client.15975 shutdown 2024-09-10T22:29:25.368 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:25.331+0000 7f1c8e377740 1 -- 172.21.15.19:0/714134745 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x564030769ee0 msgr2=0x564030773810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:29:25.369 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:25.331+0000 7f1c8e377740 1 --2- 172.21.15.19:0/714134745 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x564030769ee0 0x564030773810 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f1c800119a0 tx=0x7f1c80004730 comp rx=0 tx=0).stop 2024-09-10T22:29:25.369 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:25.331+0000 7f1c8e377740 1 -- 172.21.15.19:0/714134745 shutdown_connections 2024-09-10T22:29:25.369 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:25.331+0000 7f1c8e377740 1 --2- 172.21.15.19:0/714134745 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x5640307865f0 0x564030788a40 crc :-1 s=READY pgs=82 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:29:25.369 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:25.331+0000 7f1c8e377740 1 --2- 172.21.15.19:0/714134745 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x564030776790 0x564030774290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:29:25.369 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:25.331+0000 7f1c8e377740 1 --2- 172.21.15.19:0/714134745 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56403076a800 0x564030773d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:29:25.369 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:25.331+0000 7f1c8e377740 1 --2- 172.21.15.19:0/714134745 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x564030769ee0 0x564030773810 unknown :-1 s=CLOSED pgs=543 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:29:25.369 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:25.331+0000 7f1c8e377740 1 -- 172.21.15.19:0/714134745 >> 172.21.15.19:0/714134745 conn(0x564030767d10 msgr2=0x564030766f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:29:25.369 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:25.331+0000 7f1c6d7fa640 0 client.15975 ms_handle_reset on v2:172.21.15.135:6838/1254769802 2024-09-10T22:29:25.369 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:25.331+0000 7f1c8e377740 1 -- 172.21.15.19:0/714134745 shutdown_connections 2024-09-10T22:29:25.369 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:25.331+0000 7f1c8e377740 1 -- 172.21.15.19:0/714134745 wait complete. 2024-09-10T22:29:25.369 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:25.331+0000 7f1c8e377740 20 client.15975 trim_cache size 0 max 16384 2024-09-10T22:29:25.371 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:25.368+0000 7f1c8e377740 1 Processor -- start 2024-09-10T22:29:25.371 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:25.368+0000 7f1c8e377740 1 -- start start 2024-09-10T22:29:25.371 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:25.368+0000 7f1c8e377740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564030767d10 0x5640307754b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:29:25.371 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:25.368+0000 7f1c8e377740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x564030769ee0 0x564030773e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:29:25.371 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:25.368+0000 7f1c8e377740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56403076a800 0x564030770a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:29:25.371 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:25.368+0000 7f1c8e377740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f1c68010ef0 con 0x56403076a800 2024-09-10T22:29:25.371 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:25.368+0000 7f1c8e377740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f1c6800e7c0 con 0x564030767d10 2024-09-10T22:29:25.371 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:25.368+0000 7f1c8e377740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f1c6800c610 con 0x564030769ee0 2024-09-10T22:29:25.371 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:25.368+0000 7f1c8a53f640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56403076a800 0x564030770a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:29:25.372 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:25.368+0000 7f1c8a53f640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56403076a800 0x564030770a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:39682/0 (socket says 172.21.15.19:39682) 2024-09-10T22:29:25.372 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:25.368+0000 7f1c8a53f640 1 -- 172.21.15.19:0/1090746428 learned_addr learned my addr 172.21.15.19:0/1090746428 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:29:25.372 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:25.368+0000 7f1c89d3e640 1 --2- 172.21.15.19:0/1090746428 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564030767d10 0x5640307754b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:29:25.372 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:25.368+0000 7f1c8953d640 1 --2- 172.21.15.19:0/1090746428 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x564030769ee0 0x564030773e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:29:25.372 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:25.369+0000 7f1c8a53f640 1 -- 172.21.15.19:0/1090746428 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x564030769ee0 msgr2=0x564030773e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:29:25.372 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:25.369+0000 7f1c8a53f640 1 --2- 172.21.15.19:0/1090746428 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x564030769ee0 0x564030773e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:29:25.372 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:25.369+0000 7f1c8a53f640 1 -- 172.21.15.19:0/1090746428 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564030767d10 msgr2=0x5640307754b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:29:25.372 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:25.369+0000 7f1c8a53f640 1 --2- 172.21.15.19:0/1090746428 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564030767d10 0x5640307754b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:29:25.372 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:25.369+0000 7f1c8a53f640 1 -- 172.21.15.19:0/1090746428 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564030767b40 con 0x56403076a800 2024-09-10T22:29:25.372 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:25.369+0000 7f1c89d3e640 1 --2- 172.21.15.19:0/1090746428 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564030767d10 0x5640307754b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T22:29:25.372 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:25.369+0000 7f1c8a53f640 1 --2- 172.21.15.19:0/1090746428 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56403076a800 0x564030770a20 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f1c7c009a60 tx=0x7f1c7c02a8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ccfec66ba131c056 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:29:25.372 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:25.369+0000 7f1c6f7fe640 1 -- 172.21.15.19:0/1090746428 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c7c031cf0 con 0x56403076a800 2024-09-10T22:29:25.373 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:25.369+0000 7f1c6f7fe640 1 -- 172.21.15.19:0/1090746428 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1c7c055070 con 0x56403076a800 2024-09-10T22:29:25.373 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:25.369+0000 7f1c6f7fe640 1 -- 172.21.15.19:0/1090746428 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c7c02fe20 con 0x56403076a800 2024-09-10T22:29:25.375 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:25.370+0000 7f1c8e377740 1 -- 172.21.15.19:0/1090746428 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56403076a800 msgr2=0x564030770a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:29:25.375 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:25.370+0000 7f1c8e377740 1 --2- 172.21.15.19:0/1090746428 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56403076a800 0x564030770a20 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f1c7c009a60 tx=0x7f1c7c02a8c0 comp rx=0 tx=0).stop 2024-09-10T22:29:25.375 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:25.370+0000 7f1c8e377740 1 -- 172.21.15.19:0/1090746428 shutdown_connections 2024-09-10T22:29:25.375 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:25.370+0000 7f1c8e377740 1 --2- 172.21.15.19:0/1090746428 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56403076a800 0x564030770a20 unknown :-1 s=CLOSED pgs=544 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:29:25.376 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:25.370+0000 7f1c8e377740 1 --2- 172.21.15.19:0/1090746428 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x564030769ee0 0x564030773e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:29:25.376 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:25.370+0000 7f1c8e377740 1 --2- 172.21.15.19:0/1090746428 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564030767d10 0x5640307754b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:29:25.376 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:25.370+0000 7f1c8e377740 1 -- 172.21.15.19:0/1090746428 >> 172.21.15.19:0/1090746428 conn(0x56403076f1b0 msgr2=0x564030773780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:29:25.376 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:25.370+0000 7f1c8e377740 1 -- 172.21.15.19:0/1090746428 shutdown_connections 2024-09-10T22:29:25.376 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:25.370+0000 7f1c8e377740 1 -- 172.21.15.19:0/1090746428 wait complete. 2024-09-10T22:29:25.376 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:25.371+0000 7f1c8e377740 1 -- start start 2024-09-10T22:29:25.376 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:25.371+0000 7f1c8e377740 1 Processor -- start 2024-09-10T22:29:25.376 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:25.371+0000 7f1c8e377740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x564030767d10 0x56403077ea30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:29:25.376 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:25.371+0000 7f1c8e377740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564030769ee0 0x56403077efb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:29:25.376 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:25.371+0000 7f1c8e377740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56403076a800 0x56403077b160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:29:25.376 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:25.371+0000 7f1c8e377740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f1c6800cc80 con 0x56403076a800 2024-09-10T22:29:25.377 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:25.371+0000 7f1c8e377740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f1c6800e0f0 con 0x564030769ee0 2024-09-10T22:29:25.377 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:25.371+0000 7f1c8e377740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f1c6800d350 con 0x564030767d10 2024-09-10T22:29:25.377 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:25.371+0000 7f1c8e377740 10 client.0 _ll_register_callbacks cb 0x7f1c8000bc40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T22:29:25.377 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:25.372+0000 7f1c8953d640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564030769ee0 0x56403077efb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:29:25.377 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:25.372+0000 7f1c89d3e640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x564030767d10 0x56403077ea30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:29:25.377 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:25.372+0000 7f1c8a53f640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56403076a800 0x56403077b160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:29:25.377 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:25.372+0000 7f1c8953d640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564030769ee0 0x56403077efb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.19:45452/0 (socket says 172.21.15.19:45452) 2024-09-10T22:29:25.377 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:25.372+0000 7f1c8953d640 1 -- 172.21.15.19:0/2074787296 learned_addr learned my addr 172.21.15.19:0/2074787296 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:29:25.377 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:25.372+0000 7f1c89d3e640 1 -- 172.21.15.19:0/2074787296 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564030769ee0 msgr2=0x56403077efb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:29:25.377 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:25.372+0000 7f1c89d3e640 1 --2- 172.21.15.19:0/2074787296 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564030769ee0 0x56403077efb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:29:25.377 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:25.372+0000 7f1c89d3e640 1 -- 172.21.15.19:0/2074787296 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56403076a800 msgr2=0x56403077b160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:29:25.377 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:25.372+0000 7f1c89d3e640 1 --2- 172.21.15.19:0/2074787296 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56403076a800 0x56403077b160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:29:25.377 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:25.372+0000 7f1c89d3e640 1 -- 172.21.15.19:0/2074787296 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56403077b990 con 0x564030767d10 2024-09-10T22:29:25.377 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:25.372+0000 7f1c8953d640 1 --2- 172.21.15.19:0/2074787296 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564030769ee0 0x56403077efb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T22:29:25.378 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:25.372+0000 7f1c89d3e640 1 --2- 172.21.15.19:0/2074787296 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x564030767d10 0x56403077ea30 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f1c8001e870 tx=0x7f1c8001e6d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=deea12f6376113e6 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:29:25.378 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:25.372+0000 7f1c6d7fa640 10 client.0 ms_handle_connect on v2:172.21.15.138:3300/0 2024-09-10T22:29:25.378 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:25.373+0000 7f1c6d7fa640 1 -- 172.21.15.19:0/2074787296 <== mon.1 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c80042060 con 0x564030767d10 2024-09-10T22:29:25.378 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:25.373+0000 7f1c6d7fa640 1 -- 172.21.15.19:0/2074787296 <== mon.1 v2:172.21.15.138:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8327+0+0 (secure 0 0 0) 0x7f1c80027620 con 0x564030767d10 2024-09-10T22:29:25.378 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:25.373+0000 7f1c8e377740 1 -- 172.21.15.19:0/2074787296 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1c7c055070 con 0x564030767d10 2024-09-10T22:29:25.378 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:25.373+0000 7f1c6d7fa640 1 -- 172.21.15.19:0/2074787296 <== mon.1 v2:172.21.15.138:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f1c80037070 con 0x564030767d10 2024-09-10T22:29:25.378 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:25.373+0000 7f1c8e377740 10 client.25474 fetch_fsmap learned FSMap version 26 2024-09-10T22:29:25.378 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:25.373+0000 7f1c8e377740 1 -- 172.21.15.19:0/2074787296 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x5640307f4310 con 0x564030767d10 2024-09-10T22:29:25.378 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:25.373+0000 7f1c6d7fa640 1 -- 172.21.15.19:0/2074787296 <== mon.1 v2:172.21.15.138:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1c7c055070 con 0x564030767d10 2024-09-10T22:29:25.378 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:25.373+0000 7f1c6d7fa640 1 -- 172.21.15.19:0/2074787296 <== mon.1 v2:172.21.15.138:3300/0 5 ==== fsmap(e 26) ==== 8350+0+0 (secure 0 0 0) 0x7f1c80046030 con 0x564030767d10 2024-09-10T22:29:25.378 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:25.373+0000 7f1c8e377740 10 client.25474 fetch_fsmap finished waiting for FSMap version 26 2024-09-10T22:29:25.378 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:25.373+0000 7f1c8e377740 10 client.25474 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-10T22:29:25.378 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:25.373+0000 7f1c8e377740 20 client.25474 populate_metadata read hostname 'smithi019' 2024-09-10T22:29:25.378 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:25.373+0000 7f1c8e377740 1 --2- 172.21.15.19:0/2074787296 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x564030776790 0x5640307f6b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:29:25.379 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:25.373+0000 7f1c8e377740 4 client.25474 mds_command: new command op to 24581 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-10T22:29:25.379 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:25.373+0000 7f1c8e377740 1 -- 172.21.15.19:0/2074787296 --> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x5640306de860 con 0x564030776790 2024-09-10T22:29:25.379 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:25.374+0000 7f1c8953d640 1 --2- 172.21.15.19:0/2074787296 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x564030776790 0x5640307f6b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:29:25.379 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:25.374+0000 7f1c8953d640 1 --2- 172.21.15.19:0/2074787296 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x564030776790 0x5640307f6b00 crc :-1 s=READY pgs=83 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2e27fdcf4e713f20 server_cookie=4563b0be12439eb2 in_seq=0 out_seq=0 2024-09-10T22:29:25.379 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:25.374+0000 7f1c6d7fa640 10 client.25474 ms_handle_connect on v2:172.21.15.135:6838/1254769802 2024-09-10T22:29:25.380 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:25.376+0000 7f1c6d7fa640 1 -- 172.21.15.19:0/2074787296 <== mds.0 v2:172.21.15.135:6838/1254769802 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x5640306de860 con 0x564030776790 2024-09-10T22:29:25.380 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:25.376+0000 7f1c6d7fa640 10 client.25474 handle_command_reply: tid=0 2024-09-10T22:29:25.380 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:25.376+0000 7f1c8e377740 1 client.25474 shutdown 2024-09-10T22:29:25.380 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:25.376+0000 7f1c8e377740 1 -- 172.21.15.19:0/2074787296 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x564030767d10 msgr2=0x56403077ea30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:29:25.380 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:25.376+0000 7f1c8e377740 1 --2- 172.21.15.19:0/2074787296 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x564030767d10 0x56403077ea30 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f1c8001e870 tx=0x7f1c8001e6d0 comp rx=0 tx=0).stop 2024-09-10T22:29:25.380 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:25.376+0000 7f1c8e377740 1 -- 172.21.15.19:0/2074787296 shutdown_connections 2024-09-10T22:29:25.380 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:25.376+0000 7f1c8e377740 1 --2- 172.21.15.19:0/2074787296 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56403076a800 0x56403077b160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:29:25.381 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:25.376+0000 7f1c8e377740 1 --2- 172.21.15.19:0/2074787296 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564030769ee0 0x56403077efb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:29:25.381 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:25.376+0000 7f1c8e377740 1 --2- 172.21.15.19:0/2074787296 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x564030776790 0x5640307f6b00 crc :-1 s=READY pgs=83 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:29:25.381 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:25.376+0000 7f1c8e377740 1 --2- 172.21.15.19:0/2074787296 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x564030767d10 0x56403077ea30 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:29:25.381 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:25.376+0000 7f1c8e377740 1 -- 172.21.15.19:0/2074787296 >> 172.21.15.19:0/2074787296 conn(0x56403076f1b0 msgr2=0x564030773fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:29:25.381 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:25.376+0000 7f1c6d7fa640 0 client.25474 ms_handle_reset on v2:172.21.15.135:6838/1254769802 2024-09-10T22:29:25.381 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:25.376+0000 7f1c8e377740 1 -- 172.21.15.19:0/2074787296 shutdown_connections 2024-09-10T22:29:25.381 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:25.376+0000 7f1c8e377740 1 -- 172.21.15.19:0/2074787296 wait complete. 2024-09-10T22:29:25.381 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:25.376+0000 7f1c8e377740 20 client.25474 trim_cache size 0 max 16384 2024-09-10T22:29:25.381 INFO:teuthology.orchestra.run.smithi019.stdout:{ 2024-09-10T22:29:25.382 INFO:teuthology.orchestra.run.smithi019.stdout: "return_code": 0, 2024-09-10T22:29:25.382 INFO:teuthology.orchestra.run.smithi019.stdout: "scrub_tag": "8f3bb3bf-911f-490c-9856-c80ea220dbbe", 2024-09-10T22:29:25.382 INFO:teuthology.orchestra.run.smithi019.stdout: "mode": "asynchronous" 2024-09-10T22:29:25.382 INFO:teuthology.orchestra.run.smithi019.stdout:} 2024-09-10T22:29:25.382 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:25.377+0000 7f1c8bfa2640 1 -- 172.21.15.19:0/2779115842 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f1c700b5360 msgr2=0x7f1c700b7820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:29:25.382 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:25.377+0000 7f1c8bfa2640 1 --2- 172.21.15.19:0/2779115842 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f1c700b5360 0x7f1c700b7820 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x56403076d060 tx=0x7f1c8000b390 comp rx=0 tx=0).stop 2024-09-10T22:29:25.383 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:25.377+0000 7f1c8bfa2640 1 -- 172.21.15.19:0/2779115842 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1c841076a0 msgr2=0x7f1c8419ba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:29:25.383 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:25.377+0000 7f1c8bfa2640 1 --2- 172.21.15.19:0/2779115842 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1c841076a0 0x7f1c8419ba60 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f1c7400e9f0 tx=0x7f1c7400eeb0 comp rx=0 tx=0).stop 2024-09-10T22:29:25.383 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:25.377+0000 7f1c8bfa2640 1 -- 172.21.15.19:0/2779115842 shutdown_connections 2024-09-10T22:29:25.383 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:25.377+0000 7f1c8bfa2640 1 --2- 172.21.15.19:0/2779115842 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f1c700b5360 0x7f1c700b7820 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:29:25.383 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:25.377+0000 7f1c8bfa2640 1 --2- 172.21.15.19:0/2779115842 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1c84108020 0x7f1c841a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:29:25.383 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:25.377+0000 7f1c8bfa2640 1 --2- 172.21.15.19:0/2779115842 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1c841076a0 0x7f1c8419ba60 unknown :-1 s=CLOSED pgs=542 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:29:25.383 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:25.377+0000 7f1c8bfa2640 1 --2- 172.21.15.19:0/2779115842 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f1c84101c90 0x7f1c8419b520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:29:25.383 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:25.377+0000 7f1c8bfa2640 1 -- 172.21.15.19:0/2779115842 >> 172.21.15.19:0/2779115842 conn(0x7f1c840fd700 msgr2=0x7f1c8410d000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:29:25.383 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:25.377+0000 7f1c8bfa2640 1 -- 172.21.15.19:0/2779115842 shutdown_connections 2024-09-10T22:29:25.383 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:25.377+0000 7f1c8bfa2640 1 -- 172.21.15.19:0/2779115842 wait complete. 2024-09-10T22:29:25.458 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:29:25 smithi019 ceph-mon[31375]: pgmap v437: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 949 KiB/s rd, 355 MiB/s wr, 175 op/s 2024-09-10T22:29:25.609 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:29:25 smithi135 ceph-mon[34789]: pgmap v437: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 949 KiB/s rd, 355 MiB/s wr, 175 op/s 2024-09-10T22:29:25.625 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:29:25 smithi138 ceph-mon[35236]: pgmap v437: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 949 KiB/s rd, 355 MiB/s wr, 175 op/s 2024-09-10T22:29:26.602 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:29:26 smithi019 ceph-mon[31375]: scrub queued for path: / 2024-09-10T22:29:26.603 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:29:26 smithi019 ceph-mon[31375]: scrub summary: idle+waiting paths [/] 2024-09-10T22:29:26.603 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:29:26 smithi019 ceph-mon[31375]: scrub summary: active paths [/] 2024-09-10T22:29:26.603 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:29:26 smithi019 ceph-mon[31375]: scrub summary: active paths [/] 2024-09-10T22:29:26.603 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:29:26 smithi019 ceph-mon[31375]: scrub summary: idle+waiting paths [/] 2024-09-10T22:29:26.604 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 22997a4c-6fc2-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-10T22:29:26.609 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:29:26 smithi135 ceph-mon[34789]: scrub queued for path: / 2024-09-10T22:29:26.609 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:29:26 smithi135 ceph-mon[34789]: scrub summary: idle+waiting paths [/] 2024-09-10T22:29:26.610 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:29:26 smithi135 ceph-mon[34789]: scrub summary: active paths [/] 2024-09-10T22:29:26.610 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:29:26 smithi135 ceph-mon[34789]: scrub summary: active paths [/] 2024-09-10T22:29:26.610 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:29:26 smithi135 ceph-mon[34789]: scrub summary: idle+waiting paths [/] 2024-09-10T22:29:26.624 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:29:26 smithi138 ceph-mon[35236]: scrub queued for path: / 2024-09-10T22:29:26.625 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:29:26 smithi138 ceph-mon[35236]: scrub summary: idle+waiting paths [/] 2024-09-10T22:29:26.625 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:29:26 smithi138 ceph-mon[35236]: scrub summary: active paths [/] 2024-09-10T22:29:26.625 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:29:26 smithi138 ceph-mon[35236]: scrub summary: active paths [/] 2024-09-10T22:29:26.625 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:29:26 smithi138 ceph-mon[35236]: scrub summary: idle+waiting paths [/] 2024-09-10T22:29:26.988 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/22997a4c-6fc2-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T22:29:27.787 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:29:27 smithi019 ceph-mon[31375]: scrub summary: idle+waiting paths [/] 2024-09-10T22:29:27.788 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:29:27 smithi019 ceph-mon[31375]: pgmap v438: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 951 KiB/s rd, 381 MiB/s wr, 190 op/s 2024-09-10T22:29:27.859 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:29:27 smithi135 ceph-mon[34789]: scrub summary: idle+waiting paths [/] 2024-09-10T22:29:27.860 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:29:27 smithi135 ceph-mon[34789]: pgmap v438: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 951 KiB/s rd, 381 MiB/s wr, 190 op/s 2024-09-10T22:29:27.874 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:29:27 smithi138 ceph-mon[35236]: scrub summary: idle+waiting paths [/] 2024-09-10T22:29:27.875 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:29:27 smithi138 ceph-mon[35236]: pgmap v438: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 951 KiB/s rd, 381 MiB/s wr, 190 op/s 2024-09-10T22:29:27.951 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:27.930+0000 7fd5c6d8d640 1 -- 172.21.15.19:0/2384860152 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd5c0104530 msgr2=0x7fd5c010cb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:29:27.952 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:27.930+0000 7fd5c6d8d640 1 --2- 172.21.15.19:0/2384860152 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd5c0104530 0x7fd5c010cb10 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fd5ac009860 tx=0x7fd5ac02a340 comp rx=0 tx=0).stop 2024-09-10T22:29:27.952 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:27.930+0000 7fd5c6d8d640 1 -- 172.21.15.19:0/2384860152 shutdown_connections 2024-09-10T22:29:27.952 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:27.930+0000 7fd5c6d8d640 1 --2- 172.21.15.19:0/2384860152 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd5c010d0e0 0x7fd5c010f550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:29:27.952 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:27.930+0000 7fd5c6d8d640 1 --2- 172.21.15.19:0/2384860152 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd5c0104530 0x7fd5c010cb10 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:29:27.952 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:27.930+0000 7fd5c6d8d640 1 --2- 172.21.15.19:0/2384860152 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd5c0103b30 0x7fd5c0103f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:29:27.952 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:27.930+0000 7fd5c6d8d640 1 -- 172.21.15.19:0/2384860152 >> 172.21.15.19:0/2384860152 conn(0x7fd5c00fd700 msgr2=0x7fd5c00ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:29:27.952 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:27.930+0000 7fd5c6d8d640 1 -- 172.21.15.19:0/2384860152 shutdown_connections 2024-09-10T22:29:27.952 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:27.930+0000 7fd5c6d8d640 1 -- 172.21.15.19:0/2384860152 wait complete. 2024-09-10T22:29:27.952 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:27.931+0000 7fd5c6d8d640 1 Processor -- start 2024-09-10T22:29:27.952 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:27.931+0000 7fd5c6d8d640 1 -- start start 2024-09-10T22:29:27.952 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:27.931+0000 7fd5c6d8d640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd5c0103b30 0x7fd5c01992d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:29:27.953 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:27.931+0000 7fd5c6d8d640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd5c0104530 0x7fd5c0199810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:29:27.953 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:27.931+0000 7fd5c6d8d640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd5c010d0e0 0x7fd5c019ebb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:29:27.953 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:27.932+0000 7fd5c6d8d640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fd5c0112d60 con 0x7fd5c0103b30 2024-09-10T22:29:27.953 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:27.932+0000 7fd5c6d8d640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fd5c0112be0 con 0x7fd5c010d0e0 2024-09-10T22:29:27.953 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:27.932+0000 7fd5c6d8d640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7fd5c0112ee0 con 0x7fd5c0104530 2024-09-10T22:29:27.953 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:27.932+0000 7fd5c4b29640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd5c0103b30 0x7fd5c01992d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:29:27.953 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:27.932+0000 7fd5c4b29640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd5c0103b30 0x7fd5c01992d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:39704/0 (socket says 172.21.15.19:39704) 2024-09-10T22:29:27.953 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:27.932+0000 7fd5c4b29640 1 -- 172.21.15.19:0/18090374 learned_addr learned my addr 172.21.15.19:0/18090374 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:29:27.953 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:27.932+0000 7fd5bffff640 1 --2- 172.21.15.19:0/18090374 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd5c0104530 0x7fd5c0199810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:29:27.953 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:27.932+0000 7fd5c532a640 1 --2- 172.21.15.19:0/18090374 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd5c010d0e0 0x7fd5c019ebb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:29:27.953 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:27.932+0000 7fd5c4b29640 1 -- 172.21.15.19:0/18090374 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd5c0104530 msgr2=0x7fd5c0199810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:29:27.953 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:27.932+0000 7fd5c4b29640 1 --2- 172.21.15.19:0/18090374 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd5c0104530 0x7fd5c0199810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:29:27.953 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:27.932+0000 7fd5c4b29640 1 -- 172.21.15.19:0/18090374 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd5c010d0e0 msgr2=0x7fd5c019ebb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:29:27.953 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:27.932+0000 7fd5c4b29640 1 --2- 172.21.15.19:0/18090374 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd5c010d0e0 0x7fd5c019ebb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:29:27.954 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:27.932+0000 7fd5c4b29640 1 -- 172.21.15.19:0/18090374 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd5c019f380 con 0x7fd5c0103b30 2024-09-10T22:29:27.954 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:27.932+0000 7fd5bffff640 1 --2- 172.21.15.19:0/18090374 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd5c0104530 0x7fd5c0199810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T22:29:27.954 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:27.932+0000 7fd5c4b29640 1 --2- 172.21.15.19:0/18090374 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd5c0103b30 0x7fd5c01992d0 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7fd5b400e9c0 tx=0x7fd5b400ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:29:27.954 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:27.933+0000 7fd5bdffb640 1 -- 172.21.15.19:0/18090374 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5b400ccc0 con 0x7fd5c0103b30 2024-09-10T22:29:27.954 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:27.933+0000 7fd5bdffb640 1 -- 172.21.15.19:0/18090374 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd5b40054d0 con 0x7fd5c0103b30 2024-09-10T22:29:27.954 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:27.933+0000 7fd5c6d8d640 1 -- 172.21.15.19:0/18090374 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd5c019f670 con 0x7fd5c0103b30 2024-09-10T22:29:27.954 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:27.933+0000 7fd5bdffb640 1 -- 172.21.15.19:0/18090374 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5b4010430 con 0x7fd5c0103b30 2024-09-10T22:29:27.954 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:27.933+0000 7fd5c6d8d640 1 -- 172.21.15.19:0/18090374 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd5c01a5f00 con 0x7fd5c0103b30 2024-09-10T22:29:27.954 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:27.936+0000 7fd5c9162740 1 Processor -- start 2024-09-10T22:29:27.954 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:27.936+0000 7fd5c9162740 1 -- start start 2024-09-10T22:29:27.954 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:27.936+0000 7fd5c9162740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561b1b865480 0x561b1b865860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:29:27.954 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:27.936+0000 7fd5c9162740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x561b1b865da0 0x561b1b875c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:29:27.954 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:27.936+0000 7fd5c9162740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x561b1b876140 0x561b1b878530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:29:27.954 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:27.936+0000 7fd5c9162740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x561b1b7dbe50 con 0x561b1b876140 2024-09-10T22:29:27.955 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:27.936+0000 7fd5c9162740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x561b1b7cb280 con 0x561b1b865480 2024-09-10T22:29:27.955 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:27.936+0000 7fd5c9162740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x561b1b7cf090 con 0x561b1b865da0 2024-09-10T22:29:27.955 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:27.936+0000 7fd5bffff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x561b1b876140 0x561b1b878530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:29:27.955 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:27.937+0000 7fd5bffff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x561b1b876140 0x561b1b878530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:39716/0 (socket says 172.21.15.19:39716) 2024-09-10T22:29:27.955 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:27.937+0000 7fd5bffff640 1 -- 172.21.15.19:0/860639694 learned_addr learned my addr 172.21.15.19:0/860639694 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:29:27.955 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:27.937+0000 7fd5c532a640 1 --2- 172.21.15.19:0/860639694 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561b1b865480 0x561b1b865860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:29:27.955 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:27.937+0000 7fd5bdffb640 1 -- 172.21.15.19:0/18090374 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 18) ==== 153250+0+0 (secure 0 0 0) 0x7fd5b4004f80 con 0x7fd5c0103b30 2024-09-10T22:29:27.955 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:27.937+0000 7fd5c532a640 1 -- 172.21.15.19:0/860639694 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x561b1b865da0 msgr2=0x561b1b875c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:29:27.955 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:27.937+0000 7fd5c532a640 1 --2- 172.21.15.19:0/860639694 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x561b1b865da0 0x561b1b875c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:29:27.955 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:27.937+0000 7fd5c532a640 1 -- 172.21.15.19:0/860639694 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x561b1b876140 msgr2=0x561b1b878530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:29:27.955 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:27.937+0000 7fd5c532a640 1 --2- 172.21.15.19:0/860639694 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x561b1b876140 0x561b1b878530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:29:27.955 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:27.937+0000 7fd5c532a640 1 -- 172.21.15.19:0/860639694 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561b1b529650 con 0x561b1b865480 2024-09-10T22:29:27.955 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:27.937+0000 7fd5bffff640 1 --2- 172.21.15.19:0/860639694 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x561b1b876140 0x561b1b878530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T22:29:27.956 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:27.937+0000 7fd5c532a640 1 --2- 172.21.15.19:0/860639694 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561b1b865480 0x561b1b865860 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fd5b8009eb0 tx=0x7fd5b8010740 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f21b0b71d2b0b12 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:29:27.956 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:27.937+0000 7fd5aaffd640 1 -- 172.21.15.19:0/860639694 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5b8016070 con 0x561b1b865480 2024-09-10T22:29:27.956 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:27.937+0000 7fd5aaffd640 1 -- 172.21.15.19:0/860639694 <== mon.2 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd5b8004d20 con 0x561b1b865480 2024-09-10T22:29:27.956 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:27.937+0000 7fd5aaffd640 1 -- 172.21.15.19:0/860639694 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5b8012740 con 0x561b1b865480 2024-09-10T22:29:27.956 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:27.938+0000 7fd5bdffb640 1 --2- 172.21.15.19:0/18090374 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7fd5b00b5360 0x7fd5b00b7820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:29:27.956 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:27.938+0000 7fd5bdffb640 1 -- 172.21.15.19:0/18090374 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8327+0+0 (secure 0 0 0) 0x7fd5b40e5fd0 con 0x7fd5c0103b30 2024-09-10T22:29:27.956 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:27.938+0000 7fd5c4b29640 1 --2- 172.21.15.19:0/18090374 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7fd5b00b5360 0x7fd5b00b7820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:29:27.956 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:27.938+0000 7fd5c4b29640 1 --2- 172.21.15.19:0/18090374 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7fd5b00b5360 0x7fd5b00b7820 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fd5b40e6270 tx=0x7fd5b40a8da0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:29:27.956 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:27.938+0000 7fd5c9162740 1 -- 172.21.15.19:0/860639694 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561b1b865480 msgr2=0x561b1b865860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:29:27.956 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:27.938+0000 7fd5c9162740 1 --2- 172.21.15.19:0/860639694 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561b1b865480 0x561b1b865860 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fd5b8009eb0 tx=0x7fd5b8010740 comp rx=0 tx=0).stop 2024-09-10T22:29:27.956 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:27.939+0000 7fd5c9162740 1 -- 172.21.15.19:0/860639694 shutdown_connections 2024-09-10T22:29:27.956 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:27.939+0000 7fd5c9162740 1 --2- 172.21.15.19:0/860639694 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x561b1b876140 0x561b1b878530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:29:27.956 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:27.939+0000 7fd5c9162740 1 --2- 172.21.15.19:0/860639694 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x561b1b865da0 0x561b1b875c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:29:27.956 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:27.939+0000 7fd5c9162740 1 --2- 172.21.15.19:0/860639694 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561b1b865480 0x561b1b865860 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:29:27.957 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:27.939+0000 7fd5c9162740 1 -- 172.21.15.19:0/860639694 >> 172.21.15.19:0/860639694 conn(0x561b1b8632b0 msgr2=0x561b1b864450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:29:27.957 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:27.939+0000 7fd5c9162740 1 -- 172.21.15.19:0/860639694 shutdown_connections 2024-09-10T22:29:27.957 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:27.939+0000 7fd5c9162740 1 -- 172.21.15.19:0/860639694 wait complete. 2024-09-10T22:29:27.957 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:27.939+0000 7fd5c9162740 1 -- start start 2024-09-10T22:29:27.957 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:27.939+0000 7fd5c9162740 1 Processor -- start 2024-09-10T22:29:27.957 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:27.940+0000 7fd5c9162740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x561b1b865480 0x561b1b875a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:29:27.957 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:27.940+0000 7fd5c9162740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x561b1b865da0 0x561b1b872ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:29:27.957 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:27.940+0000 7fd5c9162740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561b1b876140 0x561b1b873540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:29:27.957 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:27.940+0000 7fd5c9162740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x561b1b62c700 con 0x561b1b865da0 2024-09-10T22:29:27.957 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:27.940+0000 7fd5c9162740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x561b1b766110 con 0x561b1b876140 2024-09-10T22:29:27.957 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:27.940+0000 7fd5c9162740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x561b1b878df0 con 0x561b1b865480 2024-09-10T22:29:27.957 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:27.940+0000 7fd5c9162740 10 client.0 _ll_register_callbacks cb 0x561b1b77f990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T22:29:27.957 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:27.940+0000 7fd5bffff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x561b1b865da0 0x561b1b872ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:29:27.957 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:27.940+0000 7fd5bffff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x561b1b865da0 0x561b1b872ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:39726/0 (socket says 172.21.15.19:39726) 2024-09-10T22:29:27.958 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:27.940+0000 7fd5bffff640 1 -- 172.21.15.19:0/3699366108 learned_addr learned my addr 172.21.15.19:0/3699366108 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:29:27.958 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:27.940+0000 7fd5bffff640 1 -- 172.21.15.19:0/3699366108 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x561b1b865480 msgr2=0x561b1b875a70 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-10T22:29:27.958 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:27.940+0000 7fd5bffff640 1 --2- 172.21.15.19:0/3699366108 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x561b1b865480 0x561b1b875a70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:29:27.958 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:27.940+0000 7fd5bffff640 1 -- 172.21.15.19:0/3699366108 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561b1b876140 msgr2=0x561b1b873540 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-10T22:29:27.958 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:27.940+0000 7fd5bffff640 1 --2- 172.21.15.19:0/3699366108 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561b1b876140 0x561b1b873540 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:29:27.958 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:27.940+0000 7fd5bffff640 1 -- 172.21.15.19:0/3699366108 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561b1b793c40 con 0x561b1b865da0 2024-09-10T22:29:27.958 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:27.941+0000 7fd5bffff640 1 --2- 172.21.15.19:0/3699366108 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x561b1b865da0 0x561b1b872ec0 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7fd5ac02a930 tx=0x7fd5ac009580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=453b1bb6c245b3dd server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:29:27.958 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:27.941+0000 7fd59ffff640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-10T22:29:27.958 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:27.941+0000 7fd59ffff640 1 -- 172.21.15.19:0/3699366108 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5ac037040 con 0x561b1b865da0 2024-09-10T22:29:27.958 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:27.941+0000 7fd5c9162740 1 -- 172.21.15.19:0/3699366108 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd5b8004d20 con 0x561b1b865da0 2024-09-10T22:29:27.958 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:27.941+0000 7fd59ffff640 1 -- 172.21.15.19:0/3699366108 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8327+0+0 (secure 0 0 0) 0x7fd5ac030450 con 0x561b1b865da0 2024-09-10T22:29:27.958 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:27.942+0000 7fd59ffff640 1 -- 172.21.15.19:0/3699366108 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7fd5ac04d050 con 0x561b1b865da0 2024-09-10T22:29:27.958 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:27.942+0000 7fd5c9162740 10 client.15993 fetch_fsmap learned FSMap version 26 2024-09-10T22:29:27.958 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:27.942+0000 7fd5c9162740 1 -- 172.21.15.19:0/3699366108 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x561b1b8847e0 con 0x561b1b865da0 2024-09-10T22:29:27.959 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:27.942+0000 7fd59ffff640 1 -- 172.21.15.19:0/3699366108 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd5b8004d20 con 0x561b1b865da0 2024-09-10T22:29:27.959 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:27.942+0000 7fd59ffff640 1 -- 172.21.15.19:0/3699366108 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 26) ==== 8350+0+0 (secure 0 0 0) 0x7fd5ac003710 con 0x561b1b865da0 2024-09-10T22:29:27.959 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:27.942+0000 7fd5c9162740 10 client.15993 fetch_fsmap finished waiting for FSMap version 26 2024-09-10T22:29:27.959 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:27.942+0000 7fd5c9162740 10 client.15993 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-10T22:29:27.959 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:27.942+0000 7fd5c9162740 20 client.15993 populate_metadata read hostname 'smithi019' 2024-09-10T22:29:27.959 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:27.942+0000 7fd5c9162740 1 --2- 172.21.15.19:0/3699366108 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x561b1b8860b0 0x561b1b8884d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:29:27.959 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:27.942+0000 7fd5c9162740 4 client.15993 mds_command: new command op to 24581 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T22:29:27.959 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:27.942+0000 7fd5c9162740 1 -- 172.21.15.19:0/3699366108 --> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x561b1b7ddda0 con 0x561b1b8860b0 2024-09-10T22:29:27.959 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:27.943+0000 7fd5c532a640 1 --2- 172.21.15.19:0/3699366108 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x561b1b8860b0 0x561b1b8884d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:29:27.959 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:27.943+0000 7fd5c532a640 1 --2- 172.21.15.19:0/3699366108 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x561b1b8860b0 0x561b1b8884d0 crc :-1 s=READY pgs=84 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=64e590aba36543d0 server_cookie=d9f02983e4adfc32 in_seq=0 out_seq=0 2024-09-10T22:29:27.959 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:27.943+0000 7fd59ffff640 10 client.15993 ms_handle_connect on v2:172.21.15.135:6838/1254769802 2024-09-10T22:29:27.959 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:27.944+0000 7fd59ffff640 1 -- 172.21.15.19:0/3699366108 <== mds.0 v2:172.21.15.135:6838/1254769802 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x561b1b7ddda0 con 0x561b1b8860b0 2024-09-10T22:29:27.960 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:27.944+0000 7fd59ffff640 10 client.15993 handle_command_reply: tid=0 2024-09-10T22:29:27.960 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:27.944+0000 7fd5c9162740 1 client.15993 shutdown 2024-09-10T22:29:27.960 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:27.944+0000 7fd5c9162740 1 -- 172.21.15.19:0/3699366108 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x561b1b865da0 msgr2=0x561b1b872ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:29:27.960 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:27.944+0000 7fd5c9162740 1 --2- 172.21.15.19:0/3699366108 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x561b1b865da0 0x561b1b872ec0 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7fd5ac02a930 tx=0x7fd5ac009580 comp rx=0 tx=0).stop 2024-09-10T22:29:27.960 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:27.944+0000 7fd5c9162740 1 -- 172.21.15.19:0/3699366108 shutdown_connections 2024-09-10T22:29:27.960 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:27.944+0000 7fd5c9162740 1 --2- 172.21.15.19:0/3699366108 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561b1b876140 0x561b1b873540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:29:27.960 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:27.944+0000 7fd5c9162740 1 --2- 172.21.15.19:0/3699366108 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x561b1b865da0 0x561b1b872ec0 unknown :-1 s=CLOSED pgs=546 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:29:27.960 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:27.944+0000 7fd5c9162740 1 --2- 172.21.15.19:0/3699366108 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x561b1b8860b0 0x561b1b8884d0 crc :-1 s=READY pgs=84 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:29:27.960 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:27.944+0000 7fd5c9162740 1 --2- 172.21.15.19:0/3699366108 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x561b1b865480 0x561b1b875a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:29:27.960 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:27.944+0000 7fd5c9162740 1 -- 172.21.15.19:0/3699366108 >> 172.21.15.19:0/3699366108 conn(0x561b1b8632b0 msgr2=0x561b1b868e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:29:27.960 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:27.944+0000 7fd59ffff640 0 client.15993 ms_handle_reset on v2:172.21.15.135:6838/1254769802 2024-09-10T22:29:27.960 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:27.944+0000 7fd5c9162740 1 -- 172.21.15.19:0/3699366108 shutdown_connections 2024-09-10T22:29:27.960 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:27.944+0000 7fd5c9162740 1 -- 172.21.15.19:0/3699366108 wait complete. 2024-09-10T22:29:27.960 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:27.944+0000 7fd5c9162740 20 client.15993 trim_cache size 0 max 16384 2024-09-10T22:29:27.966 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:27.963+0000 7fd5c9162740 1 Processor -- start 2024-09-10T22:29:27.966 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:27.963+0000 7fd5c9162740 1 -- start start 2024-09-10T22:29:27.966 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:27.963+0000 7fd5c9162740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561b1b865480 0x561b1b882050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:29:27.966 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:27.963+0000 7fd5c9162740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x561b1b865da0 0x561b1b872c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:29:27.966 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:27.963+0000 7fd5c9162740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x561b1b876140 0x561b1b877f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:29:27.966 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:27.963+0000 7fd5c9162740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fd5c01aec60 con 0x561b1b876140 2024-09-10T22:29:27.966 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:27.963+0000 7fd5c9162740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fd5c01ac530 con 0x561b1b865480 2024-09-10T22:29:27.966 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:27.963+0000 7fd5c9162740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7fd5c01aa380 con 0x561b1b865da0 2024-09-10T22:29:27.967 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:27.963+0000 7fd5c532a640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x561b1b876140 0x561b1b877f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:29:27.967 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:27.963+0000 7fd5bffff640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x561b1b865da0 0x561b1b872c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:29:27.967 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:27.963+0000 7fd5c532a640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x561b1b876140 0x561b1b877f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:39736/0 (socket says 172.21.15.19:39736) 2024-09-10T22:29:27.967 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:27.963+0000 7fd5c532a640 1 -- 172.21.15.19:0/4145297990 learned_addr learned my addr 172.21.15.19:0/4145297990 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:29:27.967 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:27.964+0000 7fd5c532a640 1 --2- 172.21.15.19:0/4145297990 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561b1b865480 0x561b1b882050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:29:27.967 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:27.964+0000 7fd5bffff640 1 -- 172.21.15.19:0/4145297990 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561b1b865480 msgr2=0x561b1b882050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:29:27.967 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:27.964+0000 7fd5bffff640 1 --2- 172.21.15.19:0/4145297990 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561b1b865480 0x561b1b882050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:29:27.967 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:27.964+0000 7fd5bffff640 1 -- 172.21.15.19:0/4145297990 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x561b1b876140 msgr2=0x561b1b877f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:29:27.967 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:27.964+0000 7fd5bffff640 1 --2- 172.21.15.19:0/4145297990 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x561b1b876140 0x561b1b877f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:29:27.967 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:27.964+0000 7fd5bffff640 1 -- 172.21.15.19:0/4145297990 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561b1b865b90 con 0x561b1b865da0 2024-09-10T22:29:27.967 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:27.964+0000 7fd5c532a640 1 --2- 172.21.15.19:0/4145297990 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x561b1b876140 0x561b1b877f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T22:29:27.967 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:27.964+0000 7fd5bffff640 1 --2- 172.21.15.19:0/4145297990 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x561b1b865da0 0x561b1b872c70 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fd5ac02a860 tx=0x7fd5ac02a340 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8f446849eb2661e4 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:29:27.967 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:27.964+0000 7fd5aa7fc640 1 -- 172.21.15.19:0/4145297990 <== mon.1 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5ac037070 con 0x561b1b865da0 2024-09-10T22:29:27.967 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:27.964+0000 7fd5aa7fc640 1 -- 172.21.15.19:0/4145297990 <== mon.1 v2:172.21.15.138:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd5ac030900 con 0x561b1b865da0 2024-09-10T22:29:27.968 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:27.964+0000 7fd5aa7fc640 1 -- 172.21.15.19:0/4145297990 <== mon.1 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5ac0052a0 con 0x561b1b865da0 2024-09-10T22:29:27.972 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:27.965+0000 7fd5c9162740 1 -- 172.21.15.19:0/4145297990 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x561b1b865da0 msgr2=0x561b1b872c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:29:27.972 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:27.965+0000 7fd5c9162740 1 --2- 172.21.15.19:0/4145297990 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x561b1b865da0 0x561b1b872c70 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fd5ac02a860 tx=0x7fd5ac02a340 comp rx=0 tx=0).stop 2024-09-10T22:29:27.972 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:27.965+0000 7fd5c9162740 1 -- 172.21.15.19:0/4145297990 shutdown_connections 2024-09-10T22:29:27.972 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:27.965+0000 7fd5c9162740 1 --2- 172.21.15.19:0/4145297990 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x561b1b876140 0x561b1b877f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:29:27.972 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:27.965+0000 7fd5c9162740 1 --2- 172.21.15.19:0/4145297990 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x561b1b865da0 0x561b1b872c70 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:29:27.972 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:27.965+0000 7fd5c9162740 1 --2- 172.21.15.19:0/4145297990 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561b1b865480 0x561b1b882050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:29:27.972 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:27.965+0000 7fd5c9162740 1 -- 172.21.15.19:0/4145297990 >> 172.21.15.19:0/4145297990 conn(0x561b1b8632b0 msgr2=0x561b1b8880c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:29:27.973 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:27.966+0000 7fd5c9162740 1 -- 172.21.15.19:0/4145297990 shutdown_connections 2024-09-10T22:29:27.973 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:27.966+0000 7fd5c9162740 1 -- 172.21.15.19:0/4145297990 wait complete. 2024-09-10T22:29:27.973 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:27.966+0000 7fd5c9162740 1 -- start start 2024-09-10T22:29:27.973 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:27.966+0000 7fd5c9162740 1 Processor -- start 2024-09-10T22:29:27.973 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:27.967+0000 7fd5c9162740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x561b1b865480 0x561b1b87ea50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:29:27.973 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:27.967+0000 7fd5c9162740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561b1b876140 0x561b1b88db80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:29:27.973 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:27.967+0000 7fd5c9162740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x561b1b88e270 0x561b1b87a4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:29:27.973 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:27.967+0000 7fd5bffff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561b1b876140 0x561b1b88db80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:29:27.973 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:27.967+0000 7fd5c9162740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fd5c01aa9f0 con 0x561b1b88e270 2024-09-10T22:29:27.973 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:27.967+0000 7fd5c9162740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fd5c01abe60 con 0x561b1b876140 2024-09-10T22:29:27.973 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:27.967+0000 7fd5c9162740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7fd5c01ab0c0 con 0x561b1b865480 2024-09-10T22:29:27.974 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:27.967+0000 7fd5bffff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561b1b876140 0x561b1b88db80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.19:45490/0 (socket says 172.21.15.19:45490) 2024-09-10T22:29:27.974 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:27.967+0000 7fd5bffff640 1 -- 172.21.15.19:0/132194078 learned_addr learned my addr 172.21.15.19:0/132194078 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:29:27.974 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:27.967+0000 7fd5c9162740 10 client.0 _ll_register_callbacks cb 0x7fd5ac0096b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T22:29:27.974 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:27.967+0000 7fd5c532a640 1 --2- 172.21.15.19:0/132194078 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x561b1b88e270 0x561b1b87a4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:29:27.974 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:27.968+0000 7fd5bffff640 1 -- 172.21.15.19:0/132194078 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x561b1b865480 msgr2=0x561b1b87ea50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:29:27.974 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:27.968+0000 7fd5bffff640 1 --2- 172.21.15.19:0/132194078 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x561b1b865480 0x561b1b87ea50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:29:27.974 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:27.968+0000 7fd5bffff640 1 -- 172.21.15.19:0/132194078 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x561b1b88e270 msgr2=0x561b1b87a4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:29:27.974 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:27.968+0000 7fd5bffff640 1 --2- 172.21.15.19:0/132194078 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x561b1b88e270 0x561b1b87a4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:29:27.974 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:27.968+0000 7fd5bffff640 1 -- 172.21.15.19:0/132194078 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561b1b87aa00 con 0x561b1b876140 2024-09-10T22:29:27.974 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:27.968+0000 7fd5bffff640 1 --2- 172.21.15.19:0/132194078 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561b1b876140 0x561b1b88db80 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fd5ac02a900 tx=0x7fd5ac005a90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e51d1f4921712340 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:29:27.974 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:27.968+0000 7fd59ffff640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-09-10T22:29:27.974 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:27.968+0000 7fd59ffff640 1 -- 172.21.15.19:0/132194078 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5ac055070 con 0x561b1b876140 2024-09-10T22:29:27.974 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:27.968+0000 7fd59ffff640 1 -- 172.21.15.19:0/132194078 <== mon.2 v2:172.21.15.135:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8327+0+0 (secure 0 0 0) 0x7fd5ac003f20 con 0x561b1b876140 2024-09-10T22:29:27.975 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:27.968+0000 7fd5c9162740 1 -- 172.21.15.19:0/132194078 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd5ac030900 con 0x561b1b876140 2024-09-10T22:29:27.975 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:27.969+0000 7fd59ffff640 1 -- 172.21.15.19:0/132194078 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7fd5ac05f050 con 0x561b1b876140 2024-09-10T22:29:27.975 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:27.969+0000 7fd5c9162740 10 client.25496 fetch_fsmap learned FSMap version 26 2024-09-10T22:29:27.975 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:27.969+0000 7fd5c9162740 1 -- 172.21.15.19:0/132194078 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x561b1b8f3620 con 0x561b1b876140 2024-09-10T22:29:27.975 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:27.969+0000 7fd59ffff640 1 -- 172.21.15.19:0/132194078 <== mon.2 v2:172.21.15.135:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd5ac0327f0 con 0x561b1b876140 2024-09-10T22:29:27.975 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:27.969+0000 7fd59ffff640 1 -- 172.21.15.19:0/132194078 <== mon.2 v2:172.21.15.135:3300/0 5 ==== fsmap(e 26) ==== 8350+0+0 (secure 0 0 0) 0x7fd5ac03d5e0 con 0x561b1b876140 2024-09-10T22:29:27.975 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:27.969+0000 7fd5c9162740 10 client.25496 fetch_fsmap finished waiting for FSMap version 26 2024-09-10T22:29:27.975 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:27.969+0000 7fd5c9162740 10 client.25496 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-10T22:29:27.976 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:27.969+0000 7fd5c9162740 20 client.25496 populate_metadata read hostname 'smithi019' 2024-09-10T22:29:27.976 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:27.969+0000 7fd5c9162740 1 --2- 172.21.15.19:0/132194078 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x561b1b8f3bd0 0x561b1b8f5fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:29:27.976 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:27.969+0000 7fd5c9162740 4 client.25496 mds_command: new command op to 24581 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-10T22:29:27.976 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:27.969+0000 7fd5c9162740 1 -- 172.21.15.19:0/132194078 --> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] -- command(tid 0: {"prefix": "scrub status"}) -- 0x7fd5ac030900 con 0x561b1b8f3bd0 2024-09-10T22:29:27.976 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:27.969+0000 7fd5c532a640 1 --2- 172.21.15.19:0/132194078 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x561b1b8f3bd0 0x561b1b8f5fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:29:27.976 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:27.970+0000 7fd59ffff640 10 client.25496 ms_handle_connect on v2:172.21.15.135:6838/1254769802 2024-09-10T22:29:27.976 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:27.970+0000 7fd5c532a640 1 --2- 172.21.15.19:0/132194078 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x561b1b8f3bd0 0x561b1b8f5fc0 crc :-1 s=READY pgs=85 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3a538f249e680ed3 server_cookie=64fb430343ed97b1 in_seq=0 out_seq=0 2024-09-10T22:29:27.978 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:27.971+0000 7fd59ffff640 1 -- 172.21.15.19:0/132194078 <== mds.0 v2:172.21.15.135:6838/1254769802 1 ==== command_reply(tid 0: 0 ) ==== 8+0+1706 (crc 0 0 0) 0x7fd5ac030900 con 0x561b1b8f3bd0 2024-09-10T22:29:27.978 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:27.971+0000 7fd59ffff640 10 client.25496 handle_command_reply: tid=0 2024-09-10T22:29:27.978 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:27.971+0000 7fd5c9162740 1 client.25496 shutdown 2024-09-10T22:29:27.978 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:27.972+0000 7fd5c9162740 1 -- 172.21.15.19:0/132194078 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561b1b876140 msgr2=0x561b1b88db80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:29:27.978 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:27.972+0000 7fd5c9162740 1 --2- 172.21.15.19:0/132194078 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561b1b876140 0x561b1b88db80 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fd5ac02a900 tx=0x7fd5ac005a90 comp rx=0 tx=0).stop 2024-09-10T22:29:27.978 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:27.972+0000 7fd5c9162740 1 -- 172.21.15.19:0/132194078 shutdown_connections 2024-09-10T22:29:27.978 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:27.972+0000 7fd5c9162740 1 --2- 172.21.15.19:0/132194078 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x561b1b88e270 0x561b1b87a4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:29:27.979 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:27.972+0000 7fd5c9162740 1 --2- 172.21.15.19:0/132194078 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561b1b876140 0x561b1b88db80 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:29:27.979 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:27.972+0000 7fd5c9162740 1 --2- 172.21.15.19:0/132194078 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x561b1b8f3bd0 0x561b1b8f5fc0 crc :-1 s=READY pgs=85 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:29:27.979 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:27.972+0000 7fd5c9162740 1 --2- 172.21.15.19:0/132194078 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x561b1b865480 0x561b1b87ea50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:29:27.979 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:27.972+0000 7fd59ffff640 0 client.25496 ms_handle_reset on v2:172.21.15.135:6838/1254769802 2024-09-10T22:29:27.979 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:27.972+0000 7fd5c9162740 1 -- 172.21.15.19:0/132194078 >> 172.21.15.19:0/132194078 conn(0x561b1b8632b0 msgr2=0x561b1b877f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:29:27.979 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:27.972+0000 7fd5c9162740 1 -- 172.21.15.19:0/132194078 shutdown_connections 2024-09-10T22:29:27.979 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:27.972+0000 7fd5c9162740 1 -- 172.21.15.19:0/132194078 wait complete. 2024-09-10T22:29:27.979 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:27.972+0000 7fd5c9162740 20 client.25496 trim_cache size 0 max 16384 2024-09-10T22:29:27.979 INFO:teuthology.orchestra.run.smithi019.stdout:{ 2024-09-10T22:29:27.979 INFO:teuthology.orchestra.run.smithi019.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-10T22:29:27.980 INFO:teuthology.orchestra.run.smithi019.stdout: "scrubs": { 2024-09-10T22:29:27.980 INFO:teuthology.orchestra.run.smithi019.stdout: "8f3bb3bf-911f-490c-9856-c80ea220dbbe": { 2024-09-10T22:29:27.980 INFO:teuthology.orchestra.run.smithi019.stdout: "path": "/", 2024-09-10T22:29:27.980 INFO:teuthology.orchestra.run.smithi019.stdout: "tag": "8f3bb3bf-911f-490c-9856-c80ea220dbbe", 2024-09-10T22:29:27.980 INFO:teuthology.orchestra.run.smithi019.stdout: "options": "recursive,force" 2024-09-10T22:29:27.980 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-10T22:29:27.980 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:29:27.980 INFO:teuthology.orchestra.run.smithi019.stdout: "scrub_stats": { 2024-09-10T22:29:27.980 INFO:teuthology.orchestra.run.smithi019.stdout: "8f3bb3bf-911f-490c-9856-c80ea220dbbe": { 2024-09-10T22:29:27.980 INFO:teuthology.orchestra.run.smithi019.stdout: "start_time": "2024-09-10T22:29:25.374415+0000", 2024-09-10T22:29:27.980 INFO:teuthology.orchestra.run.smithi019.stdout: "path": "/", 2024-09-10T22:29:27.980 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_started": 0, 2024-09-10T22:29:27.981 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_passed": 0, 2024-09-10T22:29:27.981 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_failed": 0, 2024-09-10T22:29:27.981 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_skipped": 0 2024-09-10T22:29:27.981 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:29:27.981 INFO:teuthology.orchestra.run.smithi019.stdout: "eb518e3c-a71e-4f32-9ca0-ae88930ca218": { 2024-09-10T22:29:27.981 INFO:teuthology.orchestra.run.smithi019.stdout: "start_time": "2024-09-10T22:28:38.366352+0000", 2024-09-10T22:29:27.981 INFO:teuthology.orchestra.run.smithi019.stdout: "path": "/", 2024-09-10T22:29:27.981 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_started": 0, 2024-09-10T22:29:27.981 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_passed": 0, 2024-09-10T22:29:27.981 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_failed": 0, 2024-09-10T22:29:27.981 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_skipped": 0 2024-09-10T22:29:27.982 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:29:27.982 INFO:teuthology.orchestra.run.smithi019.stdout: "c12c2a04-dcd6-4673-a98e-93f665d3f5d7": { 2024-09-10T22:29:27.982 INFO:teuthology.orchestra.run.smithi019.stdout: "start_time": "2024-09-10T22:27:49.392329+0000", 2024-09-10T22:29:27.982 INFO:teuthology.orchestra.run.smithi019.stdout: "path": "/", 2024-09-10T22:29:27.982 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_started": 0, 2024-09-10T22:29:27.982 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_passed": 0, 2024-09-10T22:29:27.982 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_failed": 0, 2024-09-10T22:29:27.982 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_skipped": 0 2024-09-10T22:29:27.982 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:29:27.982 INFO:teuthology.orchestra.run.smithi019.stdout: "b38852c8-478a-42ef-8384-b2c55d5313a4": { 2024-09-10T22:29:27.982 INFO:teuthology.orchestra.run.smithi019.stdout: "start_time": "2024-09-10T22:27:00.320308+0000", 2024-09-10T22:29:27.982 INFO:teuthology.orchestra.run.smithi019.stdout: "path": "/", 2024-09-10T22:29:27.983 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_started": 0, 2024-09-10T22:29:27.983 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_passed": 0, 2024-09-10T22:29:27.983 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_failed": 0, 2024-09-10T22:29:27.983 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_skipped": 0 2024-09-10T22:29:27.983 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:29:27.983 INFO:teuthology.orchestra.run.smithi019.stdout: "9b6bfdee-303c-4c12-af56-dc85860d112a": { 2024-09-10T22:29:27.983 INFO:teuthology.orchestra.run.smithi019.stdout: "start_time": "2024-09-10T22:26:17.484162+0000", 2024-09-10T22:29:27.983 INFO:teuthology.orchestra.run.smithi019.stdout: "path": "/", 2024-09-10T22:29:27.983 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_started": 0, 2024-09-10T22:29:27.983 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_passed": 0, 2024-09-10T22:29:27.983 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_failed": 0, 2024-09-10T22:29:27.983 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_skipped": 0 2024-09-10T22:29:27.983 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-10T22:29:27.983 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-10T22:29:27.984 INFO:teuthology.orchestra.run.smithi019.stdout:} 2024-09-10T22:29:27.984 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:27.973+0000 7fd5c6d8d640 1 -- 172.21.15.19:0/18090374 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7fd5b00b5360 msgr2=0x7fd5b00b7820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:29:27.984 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:27.973+0000 7fd5c6d8d640 1 --2- 172.21.15.19:0/18090374 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7fd5b00b5360 0x7fd5b00b7820 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fd5b40e6270 tx=0x7fd5b40a8da0 comp rx=0 tx=0).stop 2024-09-10T22:29:27.984 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:27.973+0000 7fd5c6d8d640 1 -- 172.21.15.19:0/18090374 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd5c0103b30 msgr2=0x7fd5c01992d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:29:27.984 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:27.973+0000 7fd5c6d8d640 1 --2- 172.21.15.19:0/18090374 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd5c0103b30 0x7fd5c01992d0 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7fd5b400e9c0 tx=0x7fd5b400ee80 comp rx=0 tx=0).stop 2024-09-10T22:29:27.984 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:27.973+0000 7fd5c6d8d640 1 -- 172.21.15.19:0/18090374 shutdown_connections 2024-09-10T22:29:27.984 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:27.973+0000 7fd5c6d8d640 1 --2- 172.21.15.19:0/18090374 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7fd5b00b5360 0x7fd5b00b7820 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:29:27.985 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:27.973+0000 7fd5c6d8d640 1 --2- 172.21.15.19:0/18090374 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd5c010d0e0 0x7fd5c019ebb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:29:27.985 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:27.973+0000 7fd5c6d8d640 1 --2- 172.21.15.19:0/18090374 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd5c0104530 0x7fd5c0199810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:29:27.985 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:27.973+0000 7fd5c6d8d640 1 --2- 172.21.15.19:0/18090374 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd5c0103b30 0x7fd5c01992d0 unknown :-1 s=CLOSED pgs=545 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:29:27.985 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:27.973+0000 7fd5c6d8d640 1 -- 172.21.15.19:0/18090374 >> 172.21.15.19:0/18090374 conn(0x7fd5c00fd700 msgr2=0x7fd5c00fe440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:29:27.985 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:27.973+0000 7fd5c6d8d640 1 -- 172.21.15.19:0/18090374 shutdown_connections 2024-09-10T22:29:27.985 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:29:27.973+0000 7fd5c6d8d640 1 -- 172.21.15.19:0/18090374 wait complete. 2024-09-10T22:29:29.149 INFO:tasks.cephfs.filesystem:scrub status for tag:8f3bb3bf-911f-490c-9856-c80ea220dbbe - {'path': '/', 'tag': '8f3bb3bf-911f-490c-9856-c80ea220dbbe', 'options': 'recursive,force'} 2024-09-10T22:29:29.860 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:29:29 smithi135 ceph-mon[34789]: pgmap v439: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 608 KiB/s rd, 334 MiB/s wr, 168 op/s 2024-09-10T22:29:29.875 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:29:29 smithi138 ceph-mon[35236]: pgmap v439: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 608 KiB/s rd, 334 MiB/s wr, 168 op/s 2024-09-10T22:29:29.958 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:29:29 smithi019 ceph-mon[31375]: pgmap v439: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 608 KiB/s rd, 334 MiB/s wr, 168 op/s 2024-09-10T22:29:31.859 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:29:31 smithi135 ceph-mon[34789]: pgmap v440: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 895 KiB/s rd, 393 MiB/s wr, 216 op/s 2024-09-10T22:29:31.874 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:29:31 smithi138 ceph-mon[35236]: pgmap v440: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 895 KiB/s rd, 393 MiB/s wr, 216 op/s 2024-09-10T22:29:31.958 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:29:31 smithi019 ceph-mon[31375]: pgmap v440: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 895 KiB/s rd, 393 MiB/s wr, 216 op/s 2024-09-10T22:29:32.859 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:29:32 smithi135 ceph-mon[34789]: scrub summary: idle 2024-09-10T22:29:32.875 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:29:32 smithi138 ceph-mon[35236]: scrub summary: idle 2024-09-10T22:29:32.958 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:29:32 smithi019 ceph-mon[31375]: scrub summary: idle 2024-09-10T22:29:33.958 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:29:33 smithi019 ceph-mon[31375]: scrub summary: idle 2024-09-10T22:29:33.958 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:29:33 smithi019 ceph-mon[31375]: pgmap v441: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 895 KiB/s rd, 360 MiB/s wr, 213 op/s 2024-09-10T22:29:34.110 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:29:33 smithi135 ceph-mon[34789]: scrub summary: idle 2024-09-10T22:29:34.110 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:29:33 smithi135 ceph-mon[34789]: pgmap v441: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 895 KiB/s rd, 360 MiB/s wr, 213 op/s 2024-09-10T22:29:34.125 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:29:33 smithi138 ceph-mon[35236]: scrub summary: idle 2024-09-10T22:29:34.125 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:29:33 smithi138 ceph-mon[35236]: pgmap v441: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 895 KiB/s rd, 360 MiB/s wr, 213 op/s 2024-09-10T22:29:36.109 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:29:35 smithi135 ceph-mon[34789]: pgmap v442: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 773 KiB/s rd, 350 MiB/s wr, 221 op/s 2024-09-10T22:29:36.125 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:29:35 smithi138 ceph-mon[35236]: pgmap v442: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 773 KiB/s rd, 350 MiB/s wr, 221 op/s 2024-09-10T22:29:36.208 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:29:35 smithi019 ceph-mon[31375]: pgmap v442: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 773 KiB/s rd, 350 MiB/s wr, 221 op/s 2024-09-10T22:29:36.398 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:36.396+0000 7f5d8659c640 1 -- 172.21.15.19:0/1568697120 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d800318a0 con 0x7f5d88103390 2024-09-10T22:29:36.399 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:36.396+0000 7f5d8d233640 1 -- 172.21.15.19:0/1568697120 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5d88103390 msgr2=0x7f5d88109d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:29:36.399 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:36.396+0000 7f5d8d233640 1 --2- 172.21.15.19:0/1568697120 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5d88103390 0x7f5d88109d10 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7f5d80009930 tx=0x7f5d8002a420 comp rx=0 tx=0).stop 2024-09-10T22:29:36.399 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:36.397+0000 7f5d8d233640 1 -- 172.21.15.19:0/1568697120 shutdown_connections 2024-09-10T22:29:36.399 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:36.397+0000 7f5d8d233640 1 --2- 172.21.15.19:0/1568697120 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5d88103390 0x7f5d88109d10 unknown :-1 s=CLOSED pgs=547 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:29:36.399 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:36.397+0000 7f5d8d233640 1 --2- 172.21.15.19:0/1568697120 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5d881029d0 0x7f5d88102e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:29:36.399 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:36.397+0000 7f5d8d233640 1 --2- 172.21.15.19:0/1568697120 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5d88101880 0x7f5d88101c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:29:36.399 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:36.397+0000 7f5d8d233640 1 -- 172.21.15.19:0/1568697120 >> 172.21.15.19:0/1568697120 conn(0x7f5d880fd140 msgr2=0x7f5d880ff560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:29:36.399 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:36.397+0000 7f5d8d233640 1 -- 172.21.15.19:0/1568697120 shutdown_connections 2024-09-10T22:29:36.399 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:36.397+0000 7f5d8d233640 1 -- 172.21.15.19:0/1568697120 wait complete. 2024-09-10T22:29:36.403 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:36.398+0000 7f5d8d233640 1 Processor -- start 2024-09-10T22:29:36.403 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:36.399+0000 7f5d8d233640 1 -- start start 2024-09-10T22:29:36.403 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:36.399+0000 7f5d8d233640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5d88101880 0x7f5d88111d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:29:36.403 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:36.399+0000 7f5d8d233640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5d881029d0 0x7f5d881123a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:29:36.404 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:36.399+0000 7f5d8d233640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5d88103390 0x7f5d88112fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:29:36.404 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:36.399+0000 7f5d8d233640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f5d8810ba80 con 0x7f5d88103390 2024-09-10T22:29:36.404 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:36.399+0000 7f5d8d233640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f5d8810b900 con 0x7f5d881029d0 2024-09-10T22:29:36.404 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:36.399+0000 7f5d8d233640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f5d8810bc00 con 0x7f5d88101880 2024-09-10T22:29:36.404 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:36.400+0000 7f5d86d9d640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5d88101880 0x7f5d88111d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:29:36.404 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:36.400+0000 7f5d86d9d640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5d88101880 0x7f5d88111d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.19:46556/0 (socket says 172.21.15.19:46556) 2024-09-10T22:29:36.404 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:36.400+0000 7f5d86d9d640 1 -- 172.21.15.19:0/3258172366 learned_addr learned my addr 172.21.15.19:0/3258172366 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:29:36.404 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:36.401+0000 7f5d8759e640 1 --2- 172.21.15.19:0/3258172366 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5d88103390 0x7f5d88112fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:29:36.404 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:36.401+0000 7f5d7e59c640 1 --2- 172.21.15.19:0/3258172366 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5d881029d0 0x7f5d881123a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:29:36.404 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:36.401+0000 7f5d86d9d640 1 -- 172.21.15.19:0/3258172366 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5d881029d0 msgr2=0x7f5d881123a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:29:36.405 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:36.401+0000 7f5d86d9d640 1 --2- 172.21.15.19:0/3258172366 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5d881029d0 0x7f5d881123a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:29:36.405 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:36.401+0000 7f5d86d9d640 1 -- 172.21.15.19:0/3258172366 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5d88103390 msgr2=0x7f5d88112fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:29:36.405 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:36.401+0000 7f5d86d9d640 1 --2- 172.21.15.19:0/3258172366 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5d88103390 0x7f5d88112fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:29:36.405 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:36.401+0000 7f5d86d9d640 1 -- 172.21.15.19:0/3258172366 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5d88113890 con 0x7f5d88101880 2024-09-10T22:29:36.405 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:36.402+0000 7f5d86d9d640 1 --2- 172.21.15.19:0/3258172366 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5d88101880 0x7f5d88111d50 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f5d78007f30 tx=0x7f5d7800a620 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:29:36.405 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:36.403+0000 7f5d84d99640 1 -- 172.21.15.19:0/3258172366 <== mon.1 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d7800ce60 con 0x7f5d88101880 2024-09-10T22:29:36.406 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:36.403+0000 7f5d84d99640 1 -- 172.21.15.19:0/3258172366 <== mon.1 v2:172.21.15.138:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5d78031b10 con 0x7f5d88101880 2024-09-10T22:29:36.406 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:36.403+0000 7f5d84d99640 1 -- 172.21.15.19:0/3258172366 <== mon.1 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d7803abc0 con 0x7f5d88101880 2024-09-10T22:29:36.407 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:36.403+0000 7f5d8d233640 1 -- 172.21.15.19:0/3258172366 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5d88113b80 con 0x7f5d88101880 2024-09-10T22:29:36.407 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:36.404+0000 7f5d8d233640 1 -- 172.21.15.19:0/3258172366 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5d88116230 con 0x7f5d88101880 2024-09-10T22:29:36.409 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:36.408+0000 7f5d90003740 1 Processor -- start 2024-09-10T22:29:36.409 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:36.408+0000 7f5d90003740 1 -- start start 2024-09-10T22:29:36.411 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:36.408+0000 7f5d90003740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55efcb285860 0x55efcb287c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:29:36.411 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:36.408+0000 7f5d90003740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55efcb288190 0x55efcb28a580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:29:36.411 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:36.408+0000 7f5d90003740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55efcb28abd0 0x55efcb28d090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:29:36.411 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:36.408+0000 7f5d90003740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x55efcb1f76f0 con 0x55efcb285860 2024-09-10T22:29:36.411 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:36.408+0000 7f5d90003740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55efcb1e6b20 con 0x55efcb28abd0 2024-09-10T22:29:36.411 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:36.408+0000 7f5d90003740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x55efcb1ea930 con 0x55efcb288190 2024-09-10T22:29:36.412 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:36.409+0000 7f5d8759e640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55efcb285860 0x55efcb287c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:29:36.412 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:36.409+0000 7f5d8759e640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55efcb285860 0x55efcb287c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:41334/0 (socket says 172.21.15.19:41334) 2024-09-10T22:29:36.412 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:36.409+0000 7f5d8759e640 1 -- 172.21.15.19:0/2393515228 learned_addr learned my addr 172.21.15.19:0/2393515228 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:29:36.412 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:36.409+0000 7f5d7e59c640 1 --2- 172.21.15.19:0/2393515228 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55efcb28abd0 0x55efcb28d090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:29:36.412 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:36.410+0000 7f5d8759e640 1 -- 172.21.15.19:0/2393515228 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55efcb288190 msgr2=0x55efcb28a580 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-10T22:29:36.412 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:36.410+0000 7f5d8759e640 1 --2- 172.21.15.19:0/2393515228 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55efcb288190 0x55efcb28a580 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:29:36.412 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:36.410+0000 7f5d8759e640 1 -- 172.21.15.19:0/2393515228 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55efcb28abd0 msgr2=0x55efcb28d090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:29:36.412 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:36.410+0000 7f5d8759e640 1 --2- 172.21.15.19:0/2393515228 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55efcb28abd0 0x55efcb28d090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:29:36.412 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:36.410+0000 7f5d8759e640 1 -- 172.21.15.19:0/2393515228 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55efcb1ac530 con 0x55efcb285860 2024-09-10T22:29:36.412 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:36.410+0000 7f5d8759e640 1 --2- 172.21.15.19:0/2393515228 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55efcb285860 0x55efcb287c50 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f5d80009900 tx=0x7f5d80004310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9064fd756ae640e server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:29:36.414 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:36.410+0000 7f5d7d59a640 1 -- 172.21.15.19:0/2393515228 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d80035030 con 0x55efcb285860 2024-09-10T22:29:36.414 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:36.411+0000 7f5d7d59a640 1 -- 172.21.15.19:0/2393515228 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5d800054f0 con 0x55efcb285860 2024-09-10T22:29:36.414 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:36.411+0000 7f5d7d59a640 1 -- 172.21.15.19:0/2393515228 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d80003850 con 0x55efcb285860 2024-09-10T22:29:36.414 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:36.411+0000 7f5d84d99640 1 -- 172.21.15.19:0/3258172366 <== mon.1 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 18) ==== 153250+0+0 (secure 0 0 0) 0x7f5d78031660 con 0x7f5d88101880 2024-09-10T22:29:36.414 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:36.411+0000 7f5d90003740 1 -- 172.21.15.19:0/2393515228 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55efcb285860 msgr2=0x55efcb287c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:29:36.414 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:36.412+0000 7f5d90003740 1 --2- 172.21.15.19:0/2393515228 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55efcb285860 0x55efcb287c50 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f5d80009900 tx=0x7f5d80004310 comp rx=0 tx=0).stop 2024-09-10T22:29:36.415 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:36.412+0000 7f5d90003740 1 -- 172.21.15.19:0/2393515228 shutdown_connections 2024-09-10T22:29:36.415 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:36.412+0000 7f5d90003740 1 --2- 172.21.15.19:0/2393515228 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55efcb28abd0 0x55efcb28d090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:29:36.415 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:36.412+0000 7f5d90003740 1 --2- 172.21.15.19:0/2393515228 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55efcb288190 0x55efcb28a580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:29:36.415 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:36.412+0000 7f5d90003740 1 --2- 172.21.15.19:0/2393515228 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55efcb285860 0x55efcb287c50 unknown :-1 s=CLOSED pgs=548 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:29:36.415 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:36.412+0000 7f5d90003740 1 -- 172.21.15.19:0/2393515228 >> 172.21.15.19:0/2393515228 conn(0x55efcb2809b0 msgr2=0x55efcb281740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:29:36.415 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:36.412+0000 7f5d90003740 1 -- 172.21.15.19:0/2393515228 shutdown_connections 2024-09-10T22:29:36.415 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:36.412+0000 7f5d90003740 1 -- 172.21.15.19:0/2393515228 wait complete. 2024-09-10T22:29:36.417 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:36.413+0000 7f5d90003740 1 -- start start 2024-09-10T22:29:36.417 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:36.413+0000 7f5d84d99640 1 --2- 172.21.15.19:0/3258172366 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f5d740b5380 0x7f5d740b7840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:29:36.417 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:36.413+0000 7f5d90003740 1 Processor -- start 2024-09-10T22:29:36.417 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:36.414+0000 7f5d90003740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55efcb285860 0x55efcb28ef50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:29:36.417 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:36.414+0000 7f5d90003740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55efcb288190 0x55efcb28f5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:29:36.417 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:36.414+0000 7f5d90003740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55efcb28abd0 0x55efcb2901c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:29:36.418 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:36.414+0000 7f5d90003740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x55efcb11eab0 con 0x55efcb28abd0 2024-09-10T22:29:36.418 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:36.414+0000 7f5d90003740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55efcb18c730 con 0x55efcb285860 2024-09-10T22:29:36.418 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:36.414+0000 7f5d90003740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x55efcb28db50 con 0x55efcb288190 2024-09-10T22:29:36.418 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:36.414+0000 7f5d90003740 10 client.0 _ll_register_callbacks cb 0x55efcb1e06b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T22:29:36.418 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:36.414+0000 7f5d8759e640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55efcb28abd0 0x55efcb2901c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:29:36.418 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:36.414+0000 7f5d8759e640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55efcb28abd0 0x55efcb2901c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:41350/0 (socket says 172.21.15.19:41350) 2024-09-10T22:29:36.418 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:36.414+0000 7f5d8759e640 1 -- 172.21.15.19:0/1642486654 learned_addr learned my addr 172.21.15.19:0/1642486654 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:29:36.418 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:36.414+0000 7f5d8759e640 1 --2- 172.21.15.19:0/3258172366 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f5d740b5380 0x7f5d740b7840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:29:36.418 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:36.414+0000 7f5d86d9d640 1 --2- 172.21.15.19:0/1642486654 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55efcb285860 0x55efcb28ef50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:29:36.418 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:36.415+0000 7f5d84d99640 1 -- 172.21.15.19:0/3258172366 <== mon.1 v2:172.21.15.138:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8327+0+0 (secure 0 0 0) 0x7f5d78108110 con 0x7f5d88101880 2024-09-10T22:29:36.419 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:36.415+0000 7f5d8759e640 1 -- 172.21.15.19:0/1642486654 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55efcb288190 msgr2=0x55efcb28f5f0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-10T22:29:36.419 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:36.415+0000 7f5d8759e640 1 --2- 172.21.15.19:0/1642486654 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55efcb288190 0x55efcb28f5f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:29:36.419 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:36.415+0000 7f5d8759e640 1 -- 172.21.15.19:0/1642486654 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55efcb285860 msgr2=0x55efcb28ef50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:29:36.419 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:36.415+0000 7f5d8759e640 1 --2- 172.21.15.19:0/1642486654 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55efcb285860 0x55efcb28ef50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:29:36.419 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:36.415+0000 7f5d8759e640 1 -- 172.21.15.19:0/1642486654 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55efcaf48790 con 0x55efcb28abd0 2024-09-10T22:29:36.420 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:36.416+0000 7f5d8759e640 1 --2- 172.21.15.19:0/1642486654 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55efcb28abd0 0x55efcb2901c0 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f5d80004b80 tx=0x7f5d80004310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9ff2c086f4b32ba2 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:29:36.420 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:36.416+0000 7f5d6e7fc640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-10T22:29:36.420 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:36.416+0000 7f5d8759e640 1 --2- 172.21.15.19:0/3258172366 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f5d740b5380 0x7f5d740b7840 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f5d8002abd0 tx=0x7f5d80009620 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:29:36.420 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:36.416+0000 7f5d6e7fc640 1 -- 172.21.15.19:0/1642486654 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d80035040 con 0x55efcb28abd0 2024-09-10T22:29:36.420 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:36.416+0000 7f5d6e7fc640 1 -- 172.21.15.19:0/1642486654 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8327+0+0 (secure 0 0 0) 0x7f5d800315a0 con 0x55efcb28abd0 2024-09-10T22:29:36.420 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:36.416+0000 7f5d90003740 1 -- 172.21.15.19:0/1642486654 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5d800054f0 con 0x55efcb28abd0 2024-09-10T22:29:36.420 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:36.417+0000 7f5d6e7fc640 1 -- 172.21.15.19:0/1642486654 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f5d800317a0 con 0x55efcb28abd0 2024-09-10T22:29:36.420 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:36.418+0000 7f5d90003740 10 client.16011 fetch_fsmap learned FSMap version 26 2024-09-10T22:29:36.420 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:36.418+0000 7f5d90003740 1 -- 172.21.15.19:0/1642486654 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x55efcafc1620 con 0x55efcb28abd0 2024-09-10T22:29:36.421 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:36.419+0000 7f5d6e7fc640 1 -- 172.21.15.19:0/1642486654 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5d800054f0 con 0x55efcb28abd0 2024-09-10T22:29:36.421 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:36.419+0000 7f5d6e7fc640 1 -- 172.21.15.19:0/1642486654 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 26) ==== 8350+0+0 (secure 0 0 0) 0x7f5d80051040 con 0x55efcb28abd0 2024-09-10T22:29:36.422 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:36.419+0000 7f5d90003740 10 client.16011 fetch_fsmap finished waiting for FSMap version 26 2024-09-10T22:29:36.422 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:36.419+0000 7f5d90003740 10 client.16011 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-10T22:29:36.422 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:36.419+0000 7f5d90003740 20 client.16011 populate_metadata read hostname 'smithi019' 2024-09-10T22:29:36.422 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:36.419+0000 7f5d90003740 1 --2- 172.21.15.19:0/1642486654 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x55efcb29a3f0 0x55efcb29c7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:29:36.422 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:36.420+0000 7f5d90003740 4 client.16011 mds_command: new command op to 24581 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T22:29:36.422 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:36.420+0000 7f5d90003740 1 -- 172.21.15.19:0/1642486654 --> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55efcb1f9640 con 0x55efcb29a3f0 2024-09-10T22:29:36.423 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:36.422+0000 7f5d86d9d640 1 --2- 172.21.15.19:0/1642486654 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x55efcb29a3f0 0x55efcb29c7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:29:36.426 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:36.425+0000 7f5d6e7fc640 10 client.16011 ms_handle_connect on v2:172.21.15.135:6838/1254769802 2024-09-10T22:29:36.426 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:36.425+0000 7f5d86d9d640 1 --2- 172.21.15.19:0/1642486654 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x55efcb29a3f0 0x55efcb29c7e0 crc :-1 s=READY pgs=86 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=602bef68c8375899 server_cookie=ef3f5b7d94257252 in_seq=0 out_seq=0 2024-09-10T22:29:36.435 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:36.433+0000 7f5d6e7fc640 1 -- 172.21.15.19:0/1642486654 <== mds.0 v2:172.21.15.135:6838/1254769802 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55efcb1f9640 con 0x55efcb29a3f0 2024-09-10T22:29:36.435 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:36.433+0000 7f5d6e7fc640 10 client.16011 handle_command_reply: tid=0 2024-09-10T22:29:36.435 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:36.433+0000 7f5d90003740 1 client.16011 shutdown 2024-09-10T22:29:36.438 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:36.435+0000 7f5d90003740 1 -- 172.21.15.19:0/1642486654 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55efcb28abd0 msgr2=0x55efcb2901c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:29:36.438 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:36.436+0000 7f5d90003740 1 --2- 172.21.15.19:0/1642486654 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55efcb28abd0 0x55efcb2901c0 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f5d80004b80 tx=0x7f5d80004310 comp rx=0 tx=0).stop 2024-09-10T22:29:36.438 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:36.436+0000 7f5d90003740 1 -- 172.21.15.19:0/1642486654 shutdown_connections 2024-09-10T22:29:36.438 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:36.436+0000 7f5d90003740 1 --2- 172.21.15.19:0/1642486654 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55efcb28abd0 0x55efcb2901c0 unknown :-1 s=CLOSED pgs=549 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:29:36.438 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:36.436+0000 7f5d90003740 1 --2- 172.21.15.19:0/1642486654 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x55efcb29a3f0 0x55efcb29c7e0 crc :-1 s=READY pgs=86 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:29:36.438 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:36.436+0000 7f5d6e7fc640 0 client.16011 ms_handle_reset on v2:172.21.15.135:6838/1254769802 2024-09-10T22:29:36.439 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:36.436+0000 7f5d90003740 1 --2- 172.21.15.19:0/1642486654 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55efcb288190 0x55efcb28f5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:29:36.439 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:36.436+0000 7f5d90003740 1 --2- 172.21.15.19:0/1642486654 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55efcb285860 0x55efcb28ef50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:29:36.439 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:36.436+0000 7f5d90003740 1 -- 172.21.15.19:0/1642486654 >> 172.21.15.19:0/1642486654 conn(0x55efcb2809b0 msgr2=0x55efcb27fbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:29:36.440 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:36.439+0000 7f5d90003740 1 -- 172.21.15.19:0/1642486654 shutdown_connections 2024-09-10T22:29:36.440 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:36.439+0000 7f5d90003740 1 -- 172.21.15.19:0/1642486654 wait complete. 2024-09-10T22:29:36.441 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:36.439+0000 7f5d90003740 20 client.16011 trim_cache size 0 max 16384 2024-09-10T22:29:36.477 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:36.474+0000 7f5d90003740 1 Processor -- start 2024-09-10T22:29:36.477 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:36.474+0000 7f5d90003740 1 -- start start 2024-09-10T22:29:36.477 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:36.475+0000 7f5d90003740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55efcb285860 0x55efcb2901a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:29:36.477 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:36.475+0000 7f5d90003740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55efcb288190 0x55efcb28afb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:29:36.477 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:36.475+0000 7f5d90003740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55efcb28abd0 0x55efcb28b4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:29:36.477 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:36.475+0000 7f5d90003740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f5d881b2ee0 con 0x55efcb288190 2024-09-10T22:29:36.477 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:36.475+0000 7f5d90003740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f5d88073dc0 con 0x55efcb28abd0 2024-09-10T22:29:36.477 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:36.475+0000 7f5d90003740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f5d88071c10 con 0x55efcb285860 2024-09-10T22:29:36.477 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:36.475+0000 7f5d7e59c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55efcb288190 0x55efcb28afb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:29:36.477 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:36.475+0000 7f5d7e59c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55efcb288190 0x55efcb28afb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:41352/0 (socket says 172.21.15.19:41352) 2024-09-10T22:29:36.478 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:36.475+0000 7f5d7e59c640 1 -- 172.21.15.19:0/278949740 learned_addr learned my addr 172.21.15.19:0/278949740 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:29:36.478 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:36.475+0000 7f5d86d9d640 1 --2- 172.21.15.19:0/278949740 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55efcb285860 0x55efcb2901a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:29:36.479 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:36.476+0000 7f5d7e59c640 1 -- 172.21.15.19:0/278949740 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55efcb285860 msgr2=0x55efcb2901a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:29:36.479 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:36.476+0000 7f5d7e59c640 1 --2- 172.21.15.19:0/278949740 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55efcb285860 0x55efcb2901a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:29:36.479 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:36.476+0000 7f5d7e59c640 1 -- 172.21.15.19:0/278949740 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55efcb28abd0 msgr2=0x55efcb28b4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:29:36.479 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:36.476+0000 7f5d7e59c640 1 --2- 172.21.15.19:0/278949740 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55efcb28abd0 0x55efcb28b4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:29:36.479 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:36.476+0000 7f5d7e59c640 1 -- 172.21.15.19:0/278949740 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55efcb29cb50 con 0x55efcb288190 2024-09-10T22:29:36.480 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:36.476+0000 7f5d7e59c640 1 --2- 172.21.15.19:0/278949740 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55efcb288190 0x55efcb28afb0 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7f5d7000e9f0 tx=0x7f5d7000eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=67180b151aa0a510 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:29:36.480 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:36.476+0000 7f5d7cd99640 1 -- 172.21.15.19:0/278949740 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d70010c70 con 0x55efcb288190 2024-09-10T22:29:36.480 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:36.476+0000 7f5d7cd99640 1 -- 172.21.15.19:0/278949740 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5d70010e10 con 0x55efcb288190 2024-09-10T22:29:36.480 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:36.476+0000 7f5d7cd99640 1 -- 172.21.15.19:0/278949740 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d7001c830 con 0x55efcb288190 2024-09-10T22:29:36.480 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:36.477+0000 7f5d90003740 1 -- 172.21.15.19:0/278949740 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55efcb288190 msgr2=0x55efcb28afb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:29:36.480 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:36.477+0000 7f5d90003740 1 --2- 172.21.15.19:0/278949740 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55efcb288190 0x55efcb28afb0 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7f5d7000e9f0 tx=0x7f5d7000eeb0 comp rx=0 tx=0).stop 2024-09-10T22:29:36.480 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:36.477+0000 7f5d90003740 1 -- 172.21.15.19:0/278949740 shutdown_connections 2024-09-10T22:29:36.481 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:36.477+0000 7f5d90003740 1 --2- 172.21.15.19:0/278949740 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55efcb28abd0 0x55efcb28b4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:29:36.481 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:36.477+0000 7f5d90003740 1 --2- 172.21.15.19:0/278949740 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55efcb288190 0x55efcb28afb0 unknown :-1 s=CLOSED pgs=550 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:29:36.481 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:36.477+0000 7f5d90003740 1 --2- 172.21.15.19:0/278949740 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55efcb285860 0x55efcb2901a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:29:36.481 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:36.477+0000 7f5d90003740 1 -- 172.21.15.19:0/278949740 >> 172.21.15.19:0/278949740 conn(0x55efcb2809b0 msgr2=0x55efcb2812f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:29:36.481 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:36.478+0000 7f5d90003740 1 -- 172.21.15.19:0/278949740 shutdown_connections 2024-09-10T22:29:36.481 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:36.478+0000 7f5d90003740 1 -- 172.21.15.19:0/278949740 wait complete. 2024-09-10T22:29:36.481 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:36.478+0000 7f5d90003740 1 -- start start 2024-09-10T22:29:36.481 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:36.478+0000 7f5d90003740 1 Processor -- start 2024-09-10T22:29:36.484 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:36.478+0000 7f5d90003740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55efcb285860 0x55efcb296560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:29:36.484 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:36.478+0000 7f5d90003740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55efcb288190 0x55efcb296c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:29:36.484 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:36.478+0000 7f5d90003740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55efcb28abd0 0x55efcb2952c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:29:36.484 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:36.478+0000 7f5d90003740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f5d88072280 con 0x55efcb28abd0 2024-09-10T22:29:36.484 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:36.479+0000 7f5d8759e640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55efcb28abd0 0x55efcb2952c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:29:36.485 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:36.479+0000 7f5d8759e640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55efcb28abd0 0x55efcb2952c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:41360/0 (socket says 172.21.15.19:41360) 2024-09-10T22:29:36.485 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:36.479+0000 7f5d8759e640 1 -- 172.21.15.19:0/1412421702 learned_addr learned my addr 172.21.15.19:0/1412421702 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:29:36.485 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:36.479+0000 7f5d86d9d640 1 --2- 172.21.15.19:0/1412421702 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55efcb285860 0x55efcb296560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:29:36.485 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:36.479+0000 7f5d90003740 1 -- 172.21.15.19:0/1412421702 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f5d880736f0 con 0x55efcb288190 2024-09-10T22:29:36.485 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:36.479+0000 7f5d90003740 1 -- 172.21.15.19:0/1412421702 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f5d88072950 con 0x55efcb285860 2024-09-10T22:29:36.485 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:36.479+0000 7f5d90003740 10 client.0 _ll_register_callbacks cb 0x7f5d80004260 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T22:29:36.485 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:36.479+0000 7f5d7e59c640 1 --2- 172.21.15.19:0/1412421702 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55efcb288190 0x55efcb296c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:29:36.485 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:36.479+0000 7f5d8759e640 1 -- 172.21.15.19:0/1412421702 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55efcb285860 msgr2=0x55efcb296560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:29:36.485 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:36.479+0000 7f5d8759e640 1 --2- 172.21.15.19:0/1412421702 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55efcb285860 0x55efcb296560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:29:36.485 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:36.479+0000 7f5d8759e640 1 -- 172.21.15.19:0/1412421702 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55efcb288190 msgr2=0x55efcb296c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:29:36.485 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:36.479+0000 7f5d8759e640 1 --2- 172.21.15.19:0/1412421702 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55efcb288190 0x55efcb296c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:29:36.485 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:36.479+0000 7f5d8759e640 1 -- 172.21.15.19:0/1412421702 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55efcb295af0 con 0x55efcb28abd0 2024-09-10T22:29:36.486 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:36.479+0000 7f5d86d9d640 1 --2- 172.21.15.19:0/1412421702 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55efcb285860 0x55efcb296560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T22:29:36.486 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:36.480+0000 7f5d8759e640 1 --2- 172.21.15.19:0/1412421702 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55efcb28abd0 0x55efcb2952c0 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7f5d8005f040 tx=0x7f5d800058b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ab19b60c9d99c1cf server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:29:36.486 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:36.480+0000 7f5d6e7fc640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-10T22:29:36.486 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:36.480+0000 7f5d6e7fc640 1 -- 172.21.15.19:0/1412421702 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d80035070 con 0x55efcb28abd0 2024-09-10T22:29:36.486 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:36.480+0000 7f5d6e7fc640 1 -- 172.21.15.19:0/1412421702 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8327+0+0 (secure 0 0 0) 0x7f5d800047e0 con 0x55efcb28abd0 2024-09-10T22:29:36.486 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:36.480+0000 7f5d90003740 1 -- 172.21.15.19:0/1412421702 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5d70010e10 con 0x55efcb28abd0 2024-09-10T22:29:36.486 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:36.480+0000 7f5d6e7fc640 1 -- 172.21.15.19:0/1412421702 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f5d80004bb0 con 0x55efcb28abd0 2024-09-10T22:29:36.486 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:36.480+0000 7f5d90003740 10 client.16017 fetch_fsmap learned FSMap version 26 2024-09-10T22:29:36.486 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:36.480+0000 7f5d90003740 1 -- 172.21.15.19:0/1412421702 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x55efcb294940 con 0x55efcb28abd0 2024-09-10T22:29:36.486 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:36.480+0000 7f5d6e7fc640 1 -- 172.21.15.19:0/1412421702 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5d70010e10 con 0x55efcb28abd0 2024-09-10T22:29:36.486 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:36.480+0000 7f5d6e7fc640 1 -- 172.21.15.19:0/1412421702 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 26) ==== 8350+0+0 (secure 0 0 0) 0x7f5d8006e050 con 0x55efcb28abd0 2024-09-10T22:29:36.486 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:36.480+0000 7f5d90003740 10 client.16017 fetch_fsmap finished waiting for FSMap version 26 2024-09-10T22:29:36.486 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:36.480+0000 7f5d90003740 10 client.16017 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-10T22:29:36.486 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:36.480+0000 7f5d90003740 20 client.16017 populate_metadata read hostname 'smithi019' 2024-09-10T22:29:36.487 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:36.480+0000 7f5d90003740 1 --2- 172.21.15.19:0/1412421702 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x55efcb29a3f0 0x55efcb309550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:29:36.487 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:36.480+0000 7f5d90003740 4 client.16017 mds_command: new command op to 24581 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-10T22:29:36.487 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:36.480+0000 7f5d90003740 1 -- 172.21.15.19:0/1412421702 --> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55efcb1f50f0 con 0x55efcb29a3f0 2024-09-10T22:29:36.487 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:36.481+0000 7f5d86d9d640 1 --2- 172.21.15.19:0/1412421702 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x55efcb29a3f0 0x55efcb309550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:29:36.487 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:36.482+0000 7f5d86d9d640 1 --2- 172.21.15.19:0/1412421702 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x55efcb29a3f0 0x55efcb309550 crc :-1 s=READY pgs=87 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f1c4ec60a7e57f86 server_cookie=9d9c6a5119a0dd46 in_seq=0 out_seq=0 2024-09-10T22:29:36.487 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:36.482+0000 7f5d6e7fc640 10 client.16017 ms_handle_connect on v2:172.21.15.135:6838/1254769802 2024-09-10T22:29:38.109 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:29:37 smithi135 ceph-mon[34789]: pgmap v443: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 646 KiB/s rd, 388 MiB/s wr, 252 op/s 2024-09-10T22:29:38.124 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:29:37 smithi138 ceph-mon[35236]: pgmap v443: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 646 KiB/s rd, 388 MiB/s wr, 252 op/s 2024-09-10T22:29:38.208 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:29:37 smithi019 ceph-mon[31375]: pgmap v443: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 646 KiB/s rd, 388 MiB/s wr, 252 op/s 2024-09-10T22:29:38.515 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:38.513+0000 7f5d6e7fc640 1 -- 172.21.15.19:0/1412421702 <== mds.0 v2:172.21.15.135:6838/1254769802 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55efcb1f50f0 con 0x55efcb29a3f0 2024-09-10T22:29:38.515 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:38.513+0000 7f5d6e7fc640 10 client.16017 handle_command_reply: tid=0 2024-09-10T22:29:38.515 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:38.513+0000 7f5d90003740 1 client.16017 shutdown 2024-09-10T22:29:38.515 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:38.513+0000 7f5d90003740 1 -- 172.21.15.19:0/1412421702 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55efcb28abd0 msgr2=0x55efcb2952c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:29:38.515 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:38.513+0000 7f5d90003740 1 --2- 172.21.15.19:0/1412421702 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55efcb28abd0 0x55efcb2952c0 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7f5d8005f040 tx=0x7f5d800058b0 comp rx=0 tx=0).stop 2024-09-10T22:29:38.515 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:38.513+0000 7f5d90003740 1 -- 172.21.15.19:0/1412421702 shutdown_connections 2024-09-10T22:29:38.515 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:38.513+0000 7f5d90003740 1 --2- 172.21.15.19:0/1412421702 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55efcb28abd0 0x55efcb2952c0 unknown :-1 s=CLOSED pgs=551 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:29:38.515 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:38.513+0000 7f5d90003740 1 --2- 172.21.15.19:0/1412421702 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55efcb288190 0x55efcb296c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:29:38.515 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:38.513+0000 7f5d90003740 1 --2- 172.21.15.19:0/1412421702 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x55efcb29a3f0 0x55efcb309550 crc :-1 s=READY pgs=87 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:29:38.515 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:38.513+0000 7f5d90003740 1 --2- 172.21.15.19:0/1412421702 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55efcb285860 0x55efcb296560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:29:38.516 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:38.513+0000 7f5d90003740 1 -- 172.21.15.19:0/1412421702 >> 172.21.15.19:0/1412421702 conn(0x55efcb2809b0 msgr2=0x55efcb28afb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:29:38.516 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:38.513+0000 7f5d6e7fc640 0 client.16017 ms_handle_reset on v2:172.21.15.135:6838/1254769802 2024-09-10T22:29:38.516 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:38.514+0000 7f5d90003740 1 -- 172.21.15.19:0/1412421702 shutdown_connections 2024-09-10T22:29:38.516 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:38.514+0000 7f5d90003740 1 -- 172.21.15.19:0/1412421702 wait complete. 2024-09-10T22:29:38.516 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:38.514+0000 7f5d90003740 20 client.16017 trim_cache size 0 max 16384 2024-09-10T22:29:38.517 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stdout:{ 2024-09-10T22:29:38.517 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stdout: "message": "", 2024-09-10T22:29:38.517 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stdout: "return_code": 0 2024-09-10T22:29:38.517 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stdout:} 2024-09-10T22:29:38.517 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:38.515+0000 7f5d8d233640 1 -- 172.21.15.19:0/3258172366 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f5d740b5380 msgr2=0x7f5d740b7840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:29:38.518 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:38.515+0000 7f5d8d233640 1 --2- 172.21.15.19:0/3258172366 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f5d740b5380 0x7f5d740b7840 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f5d8002abd0 tx=0x7f5d80009620 comp rx=0 tx=0).stop 2024-09-10T22:29:38.518 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:38.515+0000 7f5d8d233640 1 -- 172.21.15.19:0/3258172366 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5d88101880 msgr2=0x7f5d88111d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:29:38.518 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:38.515+0000 7f5d8d233640 1 --2- 172.21.15.19:0/3258172366 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5d88101880 0x7f5d88111d50 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f5d78007f30 tx=0x7f5d7800a620 comp rx=0 tx=0).stop 2024-09-10T22:29:38.518 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:38.515+0000 7f5d8d233640 1 -- 172.21.15.19:0/3258172366 shutdown_connections 2024-09-10T22:29:38.518 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:38.515+0000 7f5d8d233640 1 --2- 172.21.15.19:0/3258172366 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f5d740b5380 0x7f5d740b7840 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:29:38.518 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:38.515+0000 7f5d8d233640 1 --2- 172.21.15.19:0/3258172366 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5d88103390 0x7f5d88112fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:29:38.518 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:38.515+0000 7f5d8d233640 1 --2- 172.21.15.19:0/3258172366 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5d881029d0 0x7f5d881123a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:29:38.518 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:38.515+0000 7f5d8d233640 1 --2- 172.21.15.19:0/3258172366 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5d88101880 0x7f5d88111d50 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:29:38.518 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:38.515+0000 7f5d8d233640 1 -- 172.21.15.19:0/3258172366 >> 172.21.15.19:0/3258172366 conn(0x7f5d880fd140 msgr2=0x7f5d8810e420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:29:38.518 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:38.515+0000 7f5d8d233640 1 -- 172.21.15.19:0/3258172366 shutdown_connections 2024-09-10T22:29:38.518 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:38.515+0000 7f5d8d233640 1 -- 172.21.15.19:0/3258172366 wait complete. 2024-09-10T22:29:39.110 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:29:38 smithi135 ceph-mon[34789]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-09-10T22:29:39.110 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:29:38 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T22:29:39.110 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:29:38 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T22:29:39.110 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:29:38 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T22:29:39.110 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:29:38 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:29:39.125 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:29:38 smithi138 ceph-mon[35236]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-09-10T22:29:39.125 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:29:38 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T22:29:39.125 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:29:38 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T22:29:39.125 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:29:38 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T22:29:39.125 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:29:38 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:29:39.209 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:29:38 smithi019 ceph-mon[31375]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-09-10T22:29:39.209 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:29:38 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T22:29:39.209 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:29:38 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T22:29:39.209 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:29:38 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T22:29:39.209 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:29:38 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:29:40.110 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:29:39 smithi019 ceph-mon[31375]: pgmap v444: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 644 KiB/s rd, 346 MiB/s wr, 230 op/s 2024-09-10T22:29:40.125 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:29:39 smithi138 ceph-mon[35236]: pgmap v444: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 644 KiB/s rd, 346 MiB/s wr, 230 op/s 2024-09-10T22:29:40.359 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:29:39 smithi135 ceph-mon[34789]: pgmap v444: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 644 KiB/s rd, 346 MiB/s wr, 230 op/s 2024-09-10T22:29:42.209 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:29:41 smithi019 ceph-mon[31375]: pgmap v445: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 991 KiB/s rd, 388 MiB/s wr, 251 op/s 2024-09-10T22:29:42.359 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:29:41 smithi135 ceph-mon[34789]: pgmap v445: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 991 KiB/s rd, 388 MiB/s wr, 251 op/s 2024-09-10T22:29:42.375 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:29:41 smithi138 ceph-mon[35236]: pgmap v445: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 991 KiB/s rd, 388 MiB/s wr, 251 op/s 2024-09-10T22:29:44.208 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:29:43 smithi019 ceph-mon[31375]: pgmap v446: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 705 KiB/s rd, 359 MiB/s wr, 220 op/s 2024-09-10T22:29:44.359 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:29:43 smithi135 ceph-mon[34789]: pgmap v446: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 705 KiB/s rd, 359 MiB/s wr, 220 op/s 2024-09-10T22:29:44.375 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:29:43 smithi138 ceph-mon[35236]: pgmap v446: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 705 KiB/s rd, 359 MiB/s wr, 220 op/s 2024-09-10T22:29:46.359 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:29:46 smithi135 ceph-mon[34789]: pgmap v447: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 821 KiB/s rd, 369 MiB/s wr, 220 op/s 2024-09-10T22:29:46.375 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:29:46 smithi138 ceph-mon[35236]: pgmap v447: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 821 KiB/s rd, 369 MiB/s wr, 220 op/s 2024-09-10T22:29:46.458 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:29:45 smithi019 ceph-mon[31375]: pgmap v447: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 821 KiB/s rd, 369 MiB/s wr, 220 op/s 2024-09-10T22:29:48.360 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:29:48 smithi135 ceph-mon[34789]: pgmap v448: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 815 KiB/s rd, 406 MiB/s wr, 238 op/s 2024-09-10T22:29:48.375 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:29:48 smithi138 ceph-mon[35236]: pgmap v448: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 815 KiB/s rd, 406 MiB/s wr, 238 op/s 2024-09-10T22:29:48.459 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:29:48 smithi019 ceph-mon[31375]: pgmap v448: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 815 KiB/s rd, 406 MiB/s wr, 238 op/s 2024-09-10T22:29:50.359 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:29:50 smithi135 ceph-mon[34789]: pgmap v449: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 679 KiB/s rd, 354 MiB/s wr, 201 op/s 2024-09-10T22:29:50.376 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:29:50 smithi138 ceph-mon[35236]: pgmap v449: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 679 KiB/s rd, 354 MiB/s wr, 201 op/s 2024-09-10T22:29:50.459 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:29:50 smithi019 ceph-mon[31375]: pgmap v449: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 679 KiB/s rd, 354 MiB/s wr, 201 op/s 2024-09-10T22:29:51.617 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:51.615+0000 7f215ed3d640 1 -- 172.21.15.19:0/1669533 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f21581029b0 msgr2=0x7f2158102e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:29:51.617 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:51.615+0000 7f215ed3d640 1 --2- 172.21.15.19:0/1669533 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f21581029b0 0x7f2158102e30 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7f2144009930 tx=0x7f214402a420 comp rx=0 tx=0).stop 2024-09-10T22:29:51.617 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:51.615+0000 7f215ed3d640 1 -- 172.21.15.19:0/1669533 shutdown_connections 2024-09-10T22:29:51.618 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:51.615+0000 7f215ed3d640 1 --2- 172.21.15.19:0/1669533 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f2158103370 0x7f2158109cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:29:51.618 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:51.615+0000 7f215ed3d640 1 --2- 172.21.15.19:0/1669533 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f21581029b0 0x7f2158102e30 unknown :-1 s=CLOSED pgs=552 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:29:51.618 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:51.615+0000 7f215ed3d640 1 --2- 172.21.15.19:0/1669533 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2158101860 0x7f2158101c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:29:51.618 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:51.615+0000 7f215ed3d640 1 -- 172.21.15.19:0/1669533 >> 172.21.15.19:0/1669533 conn(0x7f21580fd140 msgr2=0x7f21580ff560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:29:51.618 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:51.615+0000 7f215ed3d640 1 -- 172.21.15.19:0/1669533 shutdown_connections 2024-09-10T22:29:51.618 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:51.616+0000 7f215ed3d640 1 -- 172.21.15.19:0/1669533 wait complete. 2024-09-10T22:29:51.619 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:51.616+0000 7f215ed3d640 1 Processor -- start 2024-09-10T22:29:51.619 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:51.616+0000 7f215ed3d640 1 -- start start 2024-09-10T22:29:51.619 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:51.617+0000 7f215ed3d640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f2158101860 0x7f2158198da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:29:51.619 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:51.617+0000 7f215ed3d640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f21581029b0 0x7f21581993f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:29:51.619 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:51.617+0000 7f215ed3d640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2158103370 0x7f215819a020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:29:51.619 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:51.617+0000 7f2157fff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f21581029b0 0x7f21581993f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:29:51.619 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:51.617+0000 7f2157fff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f21581029b0 0x7f21581993f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:42420/0 (socket says 172.21.15.19:42420) 2024-09-10T22:29:51.619 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:51.617+0000 7f2157fff640 1 -- 172.21.15.19:0/1093433388 learned_addr learned my addr 172.21.15.19:0/1093433388 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:29:51.620 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:51.617+0000 7f215ed3d640 1 -- 172.21.15.19:0/1093433388 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f215810e660 con 0x7f21581029b0 2024-09-10T22:29:51.620 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:51.617+0000 7f215ed3d640 1 -- 172.21.15.19:0/1093433388 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f215810e4e0 con 0x7f2158103370 2024-09-10T22:29:51.620 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:51.617+0000 7f215ed3d640 1 -- 172.21.15.19:0/1093433388 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f215810e7e0 con 0x7f2158101860 2024-09-10T22:29:51.620 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:51.617+0000 7f215cad9640 1 --2- 172.21.15.19:0/1093433388 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f2158101860 0x7f2158198da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:29:51.620 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:51.617+0000 7f215d2da640 1 --2- 172.21.15.19:0/1093433388 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2158103370 0x7f215819a020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:29:51.620 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:51.618+0000 7f2157fff640 1 -- 172.21.15.19:0/1093433388 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f2158101860 msgr2=0x7f2158198da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:29:51.620 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:51.618+0000 7f2157fff640 1 --2- 172.21.15.19:0/1093433388 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f2158101860 0x7f2158198da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:29:51.620 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:51.618+0000 7f2157fff640 1 -- 172.21.15.19:0/1093433388 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2158103370 msgr2=0x7f215819a020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:29:51.620 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:51.618+0000 7f2157fff640 1 --2- 172.21.15.19:0/1093433388 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2158103370 0x7f215819a020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:29:51.620 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:51.618+0000 7f2157fff640 1 -- 172.21.15.19:0/1093433388 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f215819a8e0 con 0x7f21581029b0 2024-09-10T22:29:51.621 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:51.618+0000 7f2157fff640 1 --2- 172.21.15.19:0/1093433388 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f21581029b0 0x7f21581993f0 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f2144031500 tx=0x7f2144003c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:29:51.621 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:51.618+0000 7f2155ffb640 1 -- 172.21.15.19:0/1093433388 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f214403f070 con 0x7f21581029b0 2024-09-10T22:29:51.621 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:51.618+0000 7f2155ffb640 1 -- 172.21.15.19:0/1093433388 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2144031c50 con 0x7f21581029b0 2024-09-10T22:29:51.621 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:51.618+0000 7f2155ffb640 1 -- 172.21.15.19:0/1093433388 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2144035030 con 0x7f21581029b0 2024-09-10T22:29:51.621 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:51.619+0000 7f215ed3d640 1 -- 172.21.15.19:0/1093433388 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f215819ab70 con 0x7f21581029b0 2024-09-10T22:29:51.621 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:51.620+0000 7f215ed3d640 1 -- 172.21.15.19:0/1093433388 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f215810a780 con 0x7f21581029b0 2024-09-10T22:29:51.626 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:51.624+0000 7f2161be4740 1 Processor -- start 2024-09-10T22:29:51.626 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:51.625+0000 7f2161be4740 1 -- start start 2024-09-10T22:29:51.627 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:51.625+0000 7f2161be4740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5638cdb57860 0x5638cdb59c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:29:51.627 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:51.626+0000 7f2161be4740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5638cdb5a190 0x5638cdb5c580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:29:51.627 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:51.626+0000 7f2161be4740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5638cdb5cbd0 0x5638cdb5f090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:29:51.627 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:51.626+0000 7f2161be4740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x5638cdac96f0 con 0x5638cdb5cbd0 2024-09-10T22:29:51.628 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:51.626+0000 7f2161be4740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x5638cdab8b20 con 0x5638cdb57860 2024-09-10T22:29:51.628 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:51.626+0000 7f2161be4740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x5638cdabc930 con 0x5638cdb5a190 2024-09-10T22:29:51.628 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:51.626+0000 7f215cad9640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5638cdb5a190 0x5638cdb5c580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:29:51.628 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:51.627+0000 7f215cad9640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5638cdb5a190 0x5638cdb5c580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.19:49546/0 (socket says 172.21.15.19:49546) 2024-09-10T22:29:51.628 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:51.627+0000 7f215cad9640 1 -- 172.21.15.19:0/4173937179 learned_addr learned my addr 172.21.15.19:0/4173937179 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:29:51.630 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:51.628+0000 7f2155ffb640 1 -- 172.21.15.19:0/1093433388 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 18) ==== 153250+0+0 (secure 0 0 0) 0x7f214403b460 con 0x7f21581029b0 2024-09-10T22:29:51.631 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:51.629+0000 7f215d2da640 1 --2- 172.21.15.19:0/4173937179 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5638cdb57860 0x5638cdb59c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:29:51.631 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:51.629+0000 7f2157fff640 1 --2- 172.21.15.19:0/4173937179 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5638cdb5cbd0 0x5638cdb5f090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:29:51.631 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:51.629+0000 7f215cad9640 1 -- 172.21.15.19:0/4173937179 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5638cdb57860 msgr2=0x5638cdb59c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:29:51.631 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:51.629+0000 7f215cad9640 1 --2- 172.21.15.19:0/4173937179 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5638cdb57860 0x5638cdb59c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:29:51.631 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:51.629+0000 7f215cad9640 1 -- 172.21.15.19:0/4173937179 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5638cdb5cbd0 msgr2=0x5638cdb5f090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:29:51.631 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:51.630+0000 7f215cad9640 1 --2- 172.21.15.19:0/4173937179 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5638cdb5cbd0 0x5638cdb5f090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:29:51.632 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:51.630+0000 7f215cad9640 1 -- 172.21.15.19:0/4173937179 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5638cda7e530 con 0x5638cdb5a190 2024-09-10T22:29:51.632 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:51.630+0000 7f2155ffb640 1 --2- 172.21.15.19:0/1093433388 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f21480b5360 0x7f21480b7820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:29:51.632 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:51.630+0000 7f2157fff640 1 --2- 172.21.15.19:0/4173937179 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5638cdb5cbd0 0x5638cdb5f090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T22:29:51.633 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:51.631+0000 7f2155ffb640 1 -- 172.21.15.19:0/1093433388 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8327+0+0 (secure 0 0 0) 0x7f2144106a40 con 0x7f21581029b0 2024-09-10T22:29:51.633 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:51.631+0000 7f215cad9640 1 --2- 172.21.15.19:0/4173937179 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5638cdb5a190 0x5638cdb5c580 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f214c009cf0 tx=0x7f214c011810 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3624139f1c78c3cb server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:29:51.633 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:51.632+0000 7f2142ffd640 1 -- 172.21.15.19:0/4173937179 <== mon.1 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f214c01e070 con 0x5638cdb5a190 2024-09-10T22:29:51.634 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:51.632+0000 7f215d2da640 1 --2- 172.21.15.19:0/1093433388 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f21480b5360 0x7f21480b7820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:29:51.634 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:51.633+0000 7f215d2da640 1 --2- 172.21.15.19:0/1093433388 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f21480b5360 0x7f21480b7820 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f21500099a0 tx=0x7f2150009500 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:29:51.637 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:51.636+0000 7f2142ffd640 1 -- 172.21.15.19:0/4173937179 <== mon.1 v2:172.21.15.138:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f214c019ae0 con 0x5638cdb5a190 2024-09-10T22:29:51.638 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:51.636+0000 7f2142ffd640 1 -- 172.21.15.19:0/4173937179 <== mon.1 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f214c00e970 con 0x5638cdb5a190 2024-09-10T22:29:51.640 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:51.638+0000 7f2161be4740 1 -- 172.21.15.19:0/4173937179 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5638cdb5a190 msgr2=0x5638cdb5c580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:29:51.640 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:51.639+0000 7f2161be4740 1 --2- 172.21.15.19:0/4173937179 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5638cdb5a190 0x5638cdb5c580 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f214c009cf0 tx=0x7f214c011810 comp rx=0 tx=0).stop 2024-09-10T22:29:51.640 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:51.639+0000 7f2161be4740 1 -- 172.21.15.19:0/4173937179 shutdown_connections 2024-09-10T22:29:51.641 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:51.639+0000 7f2161be4740 1 --2- 172.21.15.19:0/4173937179 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5638cdb5cbd0 0x5638cdb5f090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:29:51.641 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:51.639+0000 7f2161be4740 1 --2- 172.21.15.19:0/4173937179 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5638cdb5a190 0x5638cdb5c580 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:29:51.641 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:51.639+0000 7f2161be4740 1 --2- 172.21.15.19:0/4173937179 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5638cdb57860 0x5638cdb59c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:29:51.641 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:51.639+0000 7f2161be4740 1 -- 172.21.15.19:0/4173937179 >> 172.21.15.19:0/4173937179 conn(0x5638cdb529b0 msgr2=0x5638cdb53740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:29:51.645 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:51.643+0000 7f2161be4740 1 -- 172.21.15.19:0/4173937179 shutdown_connections 2024-09-10T22:29:51.645 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:51.644+0000 7f2161be4740 1 -- 172.21.15.19:0/4173937179 wait complete. 2024-09-10T22:29:51.646 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:51.644+0000 7f2161be4740 1 -- start start 2024-09-10T22:29:51.646 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:51.645+0000 7f2161be4740 1 Processor -- start 2024-09-10T22:29:51.648 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:51.646+0000 7f2161be4740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5638cdb57860 0x5638cdb60ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:29:51.648 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:51.647+0000 7f2161be4740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5638cdb5a190 0x5638cdb61590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:29:51.648 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:51.647+0000 7f2161be4740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5638cdb5cbd0 0x5638cdb620f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:29:51.649 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:51.647+0000 7f215cad9640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5638cdb57860 0x5638cdb60ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:29:51.649 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:51.647+0000 7f215cad9640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5638cdb57860 0x5638cdb60ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:42440/0 (socket says 172.21.15.19:42440) 2024-09-10T22:29:51.650 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:51.647+0000 7f2157fff640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5638cdb5a190 0x5638cdb61590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:29:51.650 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:51.647+0000 7f2157fff640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5638cdb5a190 0x5638cdb61590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.19:49560/0 (socket says 172.21.15.19:49560) 2024-09-10T22:29:51.650 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:51.648+0000 7f215cad9640 1 -- 172.21.15.19:0/3636349342 learned_addr learned my addr 172.21.15.19:0/3636349342 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:29:51.650 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:51.648+0000 7f2161be4740 1 -- 172.21.15.19:0/3636349342 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x5638cd9f0ab0 con 0x5638cdb57860 2024-09-10T22:29:51.650 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:51.648+0000 7f215d2da640 1 --2- 172.21.15.19:0/3636349342 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5638cdb5cbd0 0x5638cdb620f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:29:51.650 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:51.648+0000 7f2161be4740 1 -- 172.21.15.19:0/3636349342 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x5638cda5e730 con 0x5638cdb5cbd0 2024-09-10T22:29:51.650 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:51.648+0000 7f2161be4740 1 -- 172.21.15.19:0/3636349342 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x5638cdb5fbb0 con 0x5638cdb5a190 2024-09-10T22:29:51.650 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:51.648+0000 7f2161be4740 10 client.0 _ll_register_callbacks cb 0x5638cdab26b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T22:29:51.655 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:51.653+0000 7f215d2da640 1 -- 172.21.15.19:0/3636349342 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5638cdb5a190 msgr2=0x5638cdb61590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:29:51.655 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:51.653+0000 7f215d2da640 1 --2- 172.21.15.19:0/3636349342 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5638cdb5a190 0x5638cdb61590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:29:51.655 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:51.653+0000 7f215d2da640 1 -- 172.21.15.19:0/3636349342 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5638cdb57860 msgr2=0x5638cdb60ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:29:51.655 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:51.653+0000 7f215d2da640 1 --2- 172.21.15.19:0/3636349342 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5638cdb57860 0x5638cdb60ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:29:51.655 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:51.653+0000 7f215d2da640 1 -- 172.21.15.19:0/3636349342 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5638cd81a790 con 0x5638cdb5cbd0 2024-09-10T22:29:51.656 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:51.654+0000 7f215d2da640 1 --2- 172.21.15.19:0/3636349342 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5638cdb5cbd0 0x5638cdb620f0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f2158199b20 tx=0x7f2150004ab0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f69a8152d8daaa15 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:29:51.656 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:51.654+0000 7f2137fff640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-09-10T22:29:51.656 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:51.655+0000 7f2137fff640 1 -- 172.21.15.19:0/3636349342 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f215002a020 con 0x5638cdb5cbd0 2024-09-10T22:29:51.657 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:51.655+0000 7f2137fff640 1 -- 172.21.15.19:0/3636349342 <== mon.2 v2:172.21.15.135:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8327+0+0 (secure 0 0 0) 0x7f21500263f0 con 0x5638cdb5cbd0 2024-09-10T22:29:51.657 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:51.655+0000 7f2161be4740 1 -- 172.21.15.19:0/3636349342 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f214c019ae0 con 0x5638cdb5cbd0 2024-09-10T22:29:51.657 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:51.655+0000 7f2137fff640 1 -- 172.21.15.19:0/3636349342 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f2150035050 con 0x5638cdb5cbd0 2024-09-10T22:29:51.659 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:51.657+0000 7f2161be4740 10 client.25520 fetch_fsmap learned FSMap version 27 2024-09-10T22:29:51.659 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:51.657+0000 7f2161be4740 1 -- 172.21.15.19:0/3636349342 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x5638cd893620 con 0x5638cdb5cbd0 2024-09-10T22:29:51.661 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:51.659+0000 7f2137fff640 1 -- 172.21.15.19:0/3636349342 <== mon.2 v2:172.21.15.135:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f214c019ae0 con 0x5638cdb5cbd0 2024-09-10T22:29:51.661 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:51.659+0000 7f2137fff640 1 -- 172.21.15.19:0/3636349342 <== mon.2 v2:172.21.15.135:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7f2150025030 con 0x5638cdb5cbd0 2024-09-10T22:29:51.667 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:51.664+0000 7f2161be4740 10 client.25520 fetch_fsmap finished waiting for FSMap version 27 2024-09-10T22:29:51.667 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:51.664+0000 7f2161be4740 10 client.25520 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-10T22:29:51.667 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:51.664+0000 7f2161be4740 20 client.25520 populate_metadata read hostname 'smithi019' 2024-09-10T22:29:51.667 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:51.664+0000 7f2161be4740 1 --2- 172.21.15.19:0/3636349342 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x5638cdb6c7a0 0x5638cdb6ebb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:29:51.667 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:51.664+0000 7f2161be4740 4 client.25520 mds_command: new command op to 24581 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T22:29:51.667 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:51.664+0000 7f2161be4740 1 -- 172.21.15.19:0/3636349342 --> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5638cdacb640 con 0x5638cdb6c7a0 2024-09-10T22:29:51.668 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:51.666+0000 7f215cad9640 1 --2- 172.21.15.19:0/3636349342 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x5638cdb6c7a0 0x5638cdb6ebb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:29:51.672 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:51.670+0000 7f215cad9640 1 --2- 172.21.15.19:0/3636349342 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x5638cdb6c7a0 0x5638cdb6ebb0 crc :-1 s=READY pgs=88 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c6805f7f91fd3575 server_cookie=4ae1b840a689978d in_seq=0 out_seq=0 2024-09-10T22:29:51.672 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:51.670+0000 7f2137fff640 10 client.25520 ms_handle_connect on v2:172.21.15.135:6838/1254769802 2024-09-10T22:29:51.682 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:51.681+0000 7f2137fff640 1 -- 172.21.15.19:0/3636349342 <== mds.0 v2:172.21.15.135:6838/1254769802 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5638cdacb640 con 0x5638cdb6c7a0 2024-09-10T22:29:51.682 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:51.681+0000 7f2137fff640 10 client.25520 handle_command_reply: tid=0 2024-09-10T22:29:51.682 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:51.681+0000 7f2161be4740 1 client.25520 shutdown 2024-09-10T22:29:51.684 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:51.682+0000 7f2161be4740 1 -- 172.21.15.19:0/3636349342 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5638cdb5cbd0 msgr2=0x5638cdb620f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:29:51.684 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:51.682+0000 7f2161be4740 1 --2- 172.21.15.19:0/3636349342 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5638cdb5cbd0 0x5638cdb620f0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f2158199b20 tx=0x7f2150004ab0 comp rx=0 tx=0).stop 2024-09-10T22:29:51.686 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:51.683+0000 7f2161be4740 1 -- 172.21.15.19:0/3636349342 shutdown_connections 2024-09-10T22:29:51.686 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:51.685+0000 7f2161be4740 1 --2- 172.21.15.19:0/3636349342 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5638cdb5cbd0 0x5638cdb620f0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:29:51.686 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:51.685+0000 7f2161be4740 1 --2- 172.21.15.19:0/3636349342 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x5638cdb6c7a0 0x5638cdb6ebb0 crc :-1 s=READY pgs=88 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:29:51.687 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:51.685+0000 7f2161be4740 1 --2- 172.21.15.19:0/3636349342 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5638cdb5a190 0x5638cdb61590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:29:51.687 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:51.685+0000 7f2161be4740 1 --2- 172.21.15.19:0/3636349342 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5638cdb57860 0x5638cdb60ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:29:51.687 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:51.685+0000 7f2161be4740 1 -- 172.21.15.19:0/3636349342 >> 172.21.15.19:0/3636349342 conn(0x5638cdb529b0 msgr2=0x5638cdb51bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:29:51.693 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:51.690+0000 7f2137fff640 0 client.25520 ms_handle_reset on v2:172.21.15.135:6838/1254769802 2024-09-10T22:29:51.693 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:51.691+0000 7f2161be4740 1 -- 172.21.15.19:0/3636349342 shutdown_connections 2024-09-10T22:29:51.693 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:51.691+0000 7f2161be4740 1 -- 172.21.15.19:0/3636349342 wait complete. 2024-09-10T22:29:51.693 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:51.691+0000 7f2161be4740 20 client.25520 trim_cache size 0 max 16384 2024-09-10T22:29:51.729 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:51.726+0000 7f2161be4740 1 Processor -- start 2024-09-10T22:29:51.730 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:51.726+0000 7f2161be4740 1 -- start start 2024-09-10T22:29:51.730 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:51.727+0000 7f2161be4740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5638cdb57860 0x5638cdb5d6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:29:51.730 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:51.727+0000 7f2161be4740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5638cdb5a190 0x5638cdb60130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:29:51.730 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:51.727+0000 7f2161be4740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5638cdb5cbd0 0x5638cdb60670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:29:51.730 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:51.727+0000 7f2161be4740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f21581aa880 con 0x5638cdb5a190 2024-09-10T22:29:51.730 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:51.727+0000 7f2161be4740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f21581a8150 con 0x5638cdb5cbd0 2024-09-10T22:29:51.730 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:51.727+0000 7f2161be4740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f21581a5fa0 con 0x5638cdb57860 2024-09-10T22:29:51.730 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:51.727+0000 7f2157fff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5638cdb5a190 0x5638cdb60130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:29:51.730 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:51.727+0000 7f2157fff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5638cdb5a190 0x5638cdb60130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:42456/0 (socket says 172.21.15.19:42456) 2024-09-10T22:29:51.730 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:51.727+0000 7f2157fff640 1 -- 172.21.15.19:0/2601441873 learned_addr learned my addr 172.21.15.19:0/2601441873 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:29:51.730 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:51.727+0000 7f215cad9640 1 --2- 172.21.15.19:0/2601441873 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5638cdb57860 0x5638cdb5d6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:29:51.731 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:51.727+0000 7f215d2da640 1 --2- 172.21.15.19:0/2601441873 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5638cdb5cbd0 0x5638cdb60670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:29:51.731 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:51.727+0000 7f2157fff640 1 -- 172.21.15.19:0/2601441873 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5638cdb57860 msgr2=0x5638cdb5d6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:29:51.731 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:51.727+0000 7f2157fff640 1 --2- 172.21.15.19:0/2601441873 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5638cdb57860 0x5638cdb5d6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:29:51.731 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:51.727+0000 7f2157fff640 1 -- 172.21.15.19:0/2601441873 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5638cdb5cbd0 msgr2=0x5638cdb60670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:29:51.731 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:51.727+0000 7f2157fff640 1 --2- 172.21.15.19:0/2601441873 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5638cdb5cbd0 0x5638cdb60670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:29:51.731 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:51.727+0000 7f2157fff640 1 -- 172.21.15.19:0/2601441873 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5638cdb59fc0 con 0x5638cdb5a190 2024-09-10T22:29:51.731 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:51.727+0000 7f215cad9640 1 --2- 172.21.15.19:0/2601441873 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5638cdb57860 0x5638cdb5d6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T22:29:51.731 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:51.727+0000 7f215d2da640 1 --2- 172.21.15.19:0/2601441873 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5638cdb5cbd0 0x5638cdb60670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T22:29:51.731 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:51.727+0000 7f2157fff640 1 --2- 172.21.15.19:0/2601441873 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5638cdb5a190 0x5638cdb60130 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f2144106d20 tx=0x7f214402a420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eb692ddd5ee35e23 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:29:51.731 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:51.728+0000 7f21427fc640 1 -- 172.21.15.19:0/2601441873 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21440cca90 con 0x5638cdb5a190 2024-09-10T22:29:51.731 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:51.728+0000 7f21427fc640 1 -- 172.21.15.19:0/2601441873 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2144031e00 con 0x5638cdb5a190 2024-09-10T22:29:51.731 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:51.728+0000 7f21427fc640 1 -- 172.21.15.19:0/2601441873 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21440cc8b0 con 0x5638cdb5a190 2024-09-10T22:29:51.733 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:51.730+0000 7f2161be4740 1 -- 172.21.15.19:0/2601441873 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5638cdb5a190 msgr2=0x5638cdb60130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:29:51.734 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:51.730+0000 7f2161be4740 1 --2- 172.21.15.19:0/2601441873 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5638cdb5a190 0x5638cdb60130 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f2144106d20 tx=0x7f214402a420 comp rx=0 tx=0).stop 2024-09-10T22:29:51.734 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:51.730+0000 7f2161be4740 1 -- 172.21.15.19:0/2601441873 shutdown_connections 2024-09-10T22:29:51.734 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:51.730+0000 7f2161be4740 1 --2- 172.21.15.19:0/2601441873 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5638cdb5cbd0 0x5638cdb60670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:29:51.734 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:51.730+0000 7f2161be4740 1 --2- 172.21.15.19:0/2601441873 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5638cdb5a190 0x5638cdb60130 unknown :-1 s=CLOSED pgs=554 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:29:51.734 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:51.730+0000 7f2161be4740 1 --2- 172.21.15.19:0/2601441873 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5638cdb57860 0x5638cdb5d6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:29:51.734 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:51.730+0000 7f2161be4740 1 -- 172.21.15.19:0/2601441873 >> 172.21.15.19:0/2601441873 conn(0x5638cdb529b0 msgr2=0x5638cdb5cfe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:29:51.734 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:51.730+0000 7f2161be4740 1 -- 172.21.15.19:0/2601441873 shutdown_connections 2024-09-10T22:29:51.734 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:51.730+0000 7f2161be4740 1 -- 172.21.15.19:0/2601441873 wait complete. 2024-09-10T22:29:51.734 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:51.730+0000 7f2161be4740 1 -- start start 2024-09-10T22:29:51.734 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:51.731+0000 7f2161be4740 1 Processor -- start 2024-09-10T22:29:51.735 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:51.731+0000 7f2161be4740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5638cdb57860 0x5638cdb68550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:29:51.735 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:51.731+0000 7f2161be4740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5638cdb5a190 0x5638cdb68bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:29:51.735 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:51.732+0000 7f2161be4740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5638cdb5cbd0 0x5638cdb67340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:29:51.735 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:51.732+0000 7f2161be4740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f21581a6610 con 0x5638cdb57860 2024-09-10T22:29:51.735 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:51.732+0000 7f2161be4740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f21581a7a80 con 0x5638cdb5a190 2024-09-10T22:29:51.735 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:51.732+0000 7f2161be4740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f21581a6ce0 con 0x5638cdb5cbd0 2024-09-10T22:29:51.735 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:51.732+0000 7f2161be4740 10 client.0 _ll_register_callbacks cb 0x7f2150009d10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T22:29:51.735 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:51.732+0000 7f215cad9640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5638cdb57860 0x5638cdb68550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:29:51.735 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:51.732+0000 7f215cad9640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5638cdb57860 0x5638cdb68550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:42460/0 (socket says 172.21.15.19:42460) 2024-09-10T22:29:51.735 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:51.732+0000 7f215cad9640 1 -- 172.21.15.19:0/2809246132 learned_addr learned my addr 172.21.15.19:0/2809246132 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:29:51.735 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:51.732+0000 7f2157fff640 1 --2- 172.21.15.19:0/2809246132 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5638cdb5a190 0x5638cdb68bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:29:51.737 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:51.733+0000 7f215cad9640 1 -- 172.21.15.19:0/2809246132 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5638cdb5cbd0 msgr2=0x5638cdb67340 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-10T22:29:51.737 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:51.733+0000 7f215cad9640 1 --2- 172.21.15.19:0/2809246132 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5638cdb5cbd0 0x5638cdb67340 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:29:51.737 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:51.733+0000 7f215cad9640 1 -- 172.21.15.19:0/2809246132 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5638cdb5a190 msgr2=0x5638cdb68bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:29:51.737 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:51.733+0000 7f215cad9640 1 --2- 172.21.15.19:0/2809246132 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5638cdb5a190 0x5638cdb68bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:29:51.737 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:51.733+0000 7f215cad9640 1 -- 172.21.15.19:0/2809246132 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5638cdb67b70 con 0x5638cdb57860 2024-09-10T22:29:51.737 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:51.733+0000 7f215cad9640 1 --2- 172.21.15.19:0/2809246132 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5638cdb57860 0x5638cdb68550 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f214c009460 tx=0x7f214c019430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d34ba02546d2e491 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:29:51.738 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:51.733+0000 7f2137fff640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-10T22:29:51.738 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:51.734+0000 7f2137fff640 1 -- 172.21.15.19:0/2809246132 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f214c01e040 con 0x5638cdb57860 2024-09-10T22:29:51.738 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:51.734+0000 7f2137fff640 1 -- 172.21.15.19:0/2809246132 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8327+0+0 (secure 0 0 0) 0x7f214c019880 con 0x5638cdb57860 2024-09-10T22:29:51.738 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:51.734+0000 7f2161be4740 1 -- 172.21.15.19:0/2809246132 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5638cdac70f0 con 0x5638cdb57860 2024-09-10T22:29:51.738 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:51.734+0000 7f2137fff640 1 -- 172.21.15.19:0/2809246132 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f214c005c50 con 0x5638cdb57860 2024-09-10T22:29:51.738 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:51.735+0000 7f2161be4740 10 client.16032 fetch_fsmap learned FSMap version 27 2024-09-10T22:29:51.738 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:51.735+0000 7f2161be4740 1 -- 172.21.15.19:0/2809246132 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x5638cdb66de0 con 0x5638cdb57860 2024-09-10T22:29:51.738 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:51.735+0000 7f2137fff640 1 -- 172.21.15.19:0/2809246132 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x5638cdac70f0 con 0x5638cdb57860 2024-09-10T22:29:51.738 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:51.735+0000 7f2137fff640 1 -- 172.21.15.19:0/2809246132 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7f214c003920 con 0x5638cdb57860 2024-09-10T22:29:51.738 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:51.735+0000 7f2161be4740 10 client.16032 fetch_fsmap finished waiting for FSMap version 27 2024-09-10T22:29:51.738 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:51.735+0000 7f2161be4740 10 client.16032 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-10T22:29:51.739 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:51.736+0000 7f2161be4740 20 client.16032 populate_metadata read hostname 'smithi019' 2024-09-10T22:29:51.739 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:51.736+0000 7f2161be4740 1 --2- 172.21.15.19:0/2809246132 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x5638cdbd9b50 0x5638cdbdbf70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:29:51.739 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:51.736+0000 7f2161be4740 4 client.16032 mds_command: new command op to 24581 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-10T22:29:51.739 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:51.736+0000 7f2161be4740 1 -- 172.21.15.19:0/2809246132 --> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5638cdac4520 con 0x5638cdbd9b50 2024-09-10T22:29:51.739 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:51.736+0000 7f2157fff640 1 --2- 172.21.15.19:0/2809246132 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x5638cdbd9b50 0x5638cdbdbf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:29:51.740 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:51.739+0000 7f2157fff640 1 --2- 172.21.15.19:0/2809246132 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x5638cdbd9b50 0x5638cdbdbf70 crc :-1 s=READY pgs=89 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=96221a15d93731e7 server_cookie=81401c602b0fa3df in_seq=0 out_seq=0 2024-09-10T22:29:51.740 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:51.739+0000 7f2137fff640 10 client.16032 ms_handle_connect on v2:172.21.15.135:6838/1254769802 2024-09-10T22:29:52.360 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:29:52 smithi135 ceph-mon[34789]: pgmap v450: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 387 MiB/s wr, 229 op/s 2024-09-10T22:29:52.375 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:29:52 smithi138 ceph-mon[35236]: pgmap v450: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 387 MiB/s wr, 229 op/s 2024-09-10T22:29:52.458 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:29:52 smithi019 ceph-mon[31375]: pgmap v450: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 387 MiB/s wr, 229 op/s 2024-09-10T22:29:54.361 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:29:54 smithi135 ceph-mon[34789]: pgmap v451: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 744 KiB/s rd, 357 MiB/s wr, 216 op/s 2024-09-10T22:29:54.375 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:29:54 smithi138 ceph-mon[35236]: pgmap v451: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 744 KiB/s rd, 357 MiB/s wr, 216 op/s 2024-09-10T22:29:54.458 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:29:54 smithi019 ceph-mon[31375]: pgmap v451: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 744 KiB/s rd, 357 MiB/s wr, 216 op/s 2024-09-10T22:29:54.473 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:54.470+0000 7f2137fff640 1 -- 172.21.15.19:0/2809246132 <== mds.0 v2:172.21.15.135:6838/1254769802 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5638cdac4520 con 0x5638cdbd9b50 2024-09-10T22:29:54.473 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:54.470+0000 7f2137fff640 10 client.16032 handle_command_reply: tid=0 2024-09-10T22:29:54.473 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:54.470+0000 7f2161be4740 1 client.16032 shutdown 2024-09-10T22:29:54.473 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:54.470+0000 7f2161be4740 1 -- 172.21.15.19:0/2809246132 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5638cdb57860 msgr2=0x5638cdb68550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:29:54.474 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:54.470+0000 7f2161be4740 1 --2- 172.21.15.19:0/2809246132 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5638cdb57860 0x5638cdb68550 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f214c009460 tx=0x7f214c019430 comp rx=0 tx=0).stop 2024-09-10T22:29:54.474 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:54.470+0000 7f2161be4740 1 -- 172.21.15.19:0/2809246132 shutdown_connections 2024-09-10T22:29:54.474 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:54.470+0000 7f2161be4740 1 --2- 172.21.15.19:0/2809246132 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x5638cdbd9b50 0x5638cdbdbf70 crc :-1 s=READY pgs=89 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:29:54.474 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:54.470+0000 7f2161be4740 1 --2- 172.21.15.19:0/2809246132 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5638cdb5cbd0 0x5638cdb67340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:29:54.474 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:54.470+0000 7f2137fff640 0 client.16032 ms_handle_reset on v2:172.21.15.135:6838/1254769802 2024-09-10T22:29:54.474 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:54.470+0000 7f2161be4740 1 --2- 172.21.15.19:0/2809246132 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5638cdb5a190 0x5638cdb68bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:29:54.474 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:54.471+0000 7f2161be4740 1 --2- 172.21.15.19:0/2809246132 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5638cdb57860 0x5638cdb68550 unknown :-1 s=CLOSED pgs=555 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:29:54.474 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:54.471+0000 7f2161be4740 1 -- 172.21.15.19:0/2809246132 >> 172.21.15.19:0/2809246132 conn(0x5638cdb529b0 msgr2=0x5638cdb53210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:29:54.474 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:54.471+0000 7f2161be4740 1 -- 172.21.15.19:0/2809246132 shutdown_connections 2024-09-10T22:29:54.474 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:54.471+0000 7f2161be4740 1 -- 172.21.15.19:0/2809246132 wait complete. 2024-09-10T22:29:54.474 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:54.471+0000 7f2161be4740 20 client.16032 trim_cache size 0 max 16384 2024-09-10T22:29:54.475 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stdout:{ 2024-09-10T22:29:54.475 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stdout: "message": "", 2024-09-10T22:29:54.475 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stdout: "return_code": 0 2024-09-10T22:29:54.475 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stdout:} 2024-09-10T22:29:54.476 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:54.472+0000 7f215ed3d640 1 -- 172.21.15.19:0/1093433388 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f21480b5360 msgr2=0x7f21480b7820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:29:54.476 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:54.472+0000 7f215ed3d640 1 --2- 172.21.15.19:0/1093433388 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f21480b5360 0x7f21480b7820 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f21500099a0 tx=0x7f2150009500 comp rx=0 tx=0).stop 2024-09-10T22:29:54.476 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:54.472+0000 7f215ed3d640 1 -- 172.21.15.19:0/1093433388 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f21581029b0 msgr2=0x7f21581993f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:29:54.476 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:54.472+0000 7f215ed3d640 1 --2- 172.21.15.19:0/1093433388 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f21581029b0 0x7f21581993f0 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f2144031500 tx=0x7f2144003c10 comp rx=0 tx=0).stop 2024-09-10T22:29:54.476 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:54.472+0000 7f215ed3d640 1 -- 172.21.15.19:0/1093433388 shutdown_connections 2024-09-10T22:29:54.476 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:54.472+0000 7f215ed3d640 1 --2- 172.21.15.19:0/1093433388 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f21480b5360 0x7f21480b7820 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:29:54.476 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:54.472+0000 7f215ed3d640 1 --2- 172.21.15.19:0/1093433388 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2158103370 0x7f215819a020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:29:54.476 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:54.472+0000 7f215ed3d640 1 --2- 172.21.15.19:0/1093433388 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f21581029b0 0x7f21581993f0 unknown :-1 s=CLOSED pgs=553 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:29:54.476 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:54.472+0000 7f215ed3d640 1 --2- 172.21.15.19:0/1093433388 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f2158101860 0x7f2158198da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:29:54.477 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:54.472+0000 7f215ed3d640 1 -- 172.21.15.19:0/1093433388 >> 172.21.15.19:0/1093433388 conn(0x7f21580fd140 msgr2=0x7f2158105d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:29:54.477 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:54.472+0000 7f215ed3d640 1 -- 172.21.15.19:0/1093433388 shutdown_connections 2024-09-10T22:29:54.477 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:29:54.472+0000 7f215ed3d640 1 -- 172.21.15.19:0/1093433388 wait complete. 2024-09-10T22:29:56.360 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:29:56 smithi135 ceph-mon[34789]: pgmap v452: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 930 KiB/s rd, 352 MiB/s wr, 210 op/s 2024-09-10T22:29:56.375 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:29:56 smithi138 ceph-mon[35236]: pgmap v452: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 930 KiB/s rd, 352 MiB/s wr, 210 op/s 2024-09-10T22:29:56.458 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:29:56 smithi019 ceph-mon[31375]: pgmap v452: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 930 KiB/s rd, 352 MiB/s wr, 210 op/s 2024-09-10T22:29:58.360 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:29:58 smithi135 ceph-mon[34789]: pgmap v453: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 874 KiB/s rd, 382 MiB/s wr, 219 op/s 2024-09-10T22:29:58.375 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:29:58 smithi138 ceph-mon[35236]: pgmap v453: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 874 KiB/s rd, 382 MiB/s wr, 219 op/s 2024-09-10T22:29:58.459 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:29:58 smithi019 ceph-mon[31375]: pgmap v453: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 874 KiB/s rd, 382 MiB/s wr, 219 op/s 2024-09-10T22:29:59.150 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 22997a4c-6fc2-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-10T22:29:59.469 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/22997a4c-6fc2-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T22:30:00.153 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:00.150+0000 7fc4eb8ce640 1 -- 172.21.15.19:0/3424859805 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc4e41087d0 msgr2=0x7fc4e4108c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:30:00.153 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:00.150+0000 7fc4eb8ce640 1 --2- 172.21.15.19:0/3424859805 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc4e41087d0 0x7fc4e4108c10 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7fc4d8009900 tx=0x7fc4d802a410 comp rx=0 tx=0).stop 2024-09-10T22:30:00.153 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:00.150+0000 7fc4eb8ce640 1 -- 172.21.15.19:0/3424859805 shutdown_connections 2024-09-10T22:30:00.154 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:00.150+0000 7fc4eb8ce640 1 --2- 172.21.15.19:0/3424859805 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc4e4109150 0x7fc4e410f950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:30:00.154 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:00.150+0000 7fc4eb8ce640 1 --2- 172.21.15.19:0/3424859805 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc4e41087d0 0x7fc4e4108c10 unknown :-1 s=CLOSED pgs=556 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:30:00.154 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:00.150+0000 7fc4eb8ce640 1 --2- 172.21.15.19:0/3424859805 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc4e4102dc0 0x7fc4e41031a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:30:00.154 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:00.150+0000 7fc4eb8ce640 1 -- 172.21.15.19:0/3424859805 >> 172.21.15.19:0/3424859805 conn(0x7fc4e40fe830 msgr2=0x7fc4e4100c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:30:00.154 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:00.150+0000 7fc4eb8ce640 1 -- 172.21.15.19:0/3424859805 shutdown_connections 2024-09-10T22:30:00.154 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:00.150+0000 7fc4eb8ce640 1 -- 172.21.15.19:0/3424859805 wait complete. 2024-09-10T22:30:00.156 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:00.151+0000 7fc4eb8ce640 1 Processor -- start 2024-09-10T22:30:00.156 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:00.151+0000 7fc4eb8ce640 1 -- start start 2024-09-10T22:30:00.156 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:00.152+0000 7fc4eb8ce640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc4e4102dc0 0x7fc4e4109940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:30:00.156 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:00.152+0000 7fc4eb8ce640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc4e41087d0 0x7fc4e4109e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:30:00.156 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:00.152+0000 7fc4eb8ce640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc4e4109150 0x7fc4e410a3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:30:00.156 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:00.152+0000 7fc4eb8ce640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fc4e4112e10 con 0x7fc4e41087d0 2024-09-10T22:30:00.156 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:00.152+0000 7fc4eb8ce640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fc4e4112c90 con 0x7fc4e4102dc0 2024-09-10T22:30:00.156 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:00.152+0000 7fc4eb8ce640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7fc4e4112f90 con 0x7fc4e4109150 2024-09-10T22:30:00.156 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:00.152+0000 7fc4e8e69640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc4e41087d0 0x7fc4e4109e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:30:00.156 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:00.152+0000 7fc4e8e69640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc4e41087d0 0x7fc4e4109e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:36028/0 (socket says 172.21.15.19:36028) 2024-09-10T22:30:00.157 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:00.152+0000 7fc4e8e69640 1 -- 172.21.15.19:0/301949979 learned_addr learned my addr 172.21.15.19:0/301949979 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:30:00.157 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:00.152+0000 7fc4e9e6b640 1 --2- 172.21.15.19:0/301949979 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc4e4109150 0x7fc4e410a3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:30:00.157 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:00.152+0000 7fc4e8e69640 1 -- 172.21.15.19:0/301949979 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc4e4109150 msgr2=0x7fc4e410a3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:30:00.157 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:00.152+0000 7fc4e8e69640 1 --2- 172.21.15.19:0/301949979 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc4e4109150 0x7fc4e410a3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:30:00.157 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:00.152+0000 7fc4e8e69640 1 -- 172.21.15.19:0/301949979 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc4e4102dc0 msgr2=0x7fc4e4109940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:30:00.157 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:00.152+0000 7fc4e8e69640 1 --2- 172.21.15.19:0/301949979 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc4e4102dc0 0x7fc4e4109940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:30:00.157 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:00.152+0000 7fc4e8e69640 1 -- 172.21.15.19:0/301949979 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc4e41abb00 con 0x7fc4e41087d0 2024-09-10T22:30:00.157 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:00.152+0000 7fc4e9e6b640 1 --2- 172.21.15.19:0/301949979 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc4e4109150 0x7fc4e410a3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T22:30:00.157 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:00.153+0000 7fc4e8e69640 1 --2- 172.21.15.19:0/301949979 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc4e41087d0 0x7fc4e4109e80 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7fc4d8005940 tx=0x7fc4d8004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:30:00.157 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:00.153+0000 7fc4e27fc640 1 -- 172.21.15.19:0/301949979 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4d803f030 con 0x7fc4e41087d0 2024-09-10T22:30:00.157 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:00.153+0000 7fc4e27fc640 1 -- 172.21.15.19:0/301949979 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc4d8003aa0 con 0x7fc4e41087d0 2024-09-10T22:30:00.157 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:00.153+0000 7fc4eb8ce640 1 -- 172.21.15.19:0/301949979 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc4e41abd90 con 0x7fc4e41087d0 2024-09-10T22:30:00.158 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:00.153+0000 7fc4e27fc640 1 -- 172.21.15.19:0/301949979 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4d8035070 con 0x7fc4e41087d0 2024-09-10T22:30:00.158 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:00.153+0000 7fc4eb8ce640 1 -- 172.21.15.19:0/301949979 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc4e41ac2e0 con 0x7fc4e41087d0 2024-09-10T22:30:00.159 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:00.157+0000 7fc4e27fc640 1 -- 172.21.15.19:0/301949979 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 18) ==== 153250+0+0 (secure 0 0 0) 0x7fc4d803bca0 con 0x7fc4e41087d0 2024-09-10T22:30:00.159 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:00.157+0000 7fc4edca3740 1 Processor -- start 2024-09-10T22:30:00.167 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:00.157+0000 7fc4edca3740 1 -- start start 2024-09-10T22:30:00.167 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:00.158+0000 7fc4edca3740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564a1242c480 0x564a1242c860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:30:00.167 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:00.158+0000 7fc4edca3740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x564a1242cda0 0x564a124387f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:30:00.167 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:00.158+0000 7fc4edca3740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x564a12438d30 0x564a1243b120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:30:00.167 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:00.158+0000 7fc4e966a640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x564a1242cda0 0x564a124387f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:30:00.167 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:00.158+0000 7fc4e966a640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x564a1242cda0 0x564a124387f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:36030/0 (socket says 172.21.15.19:36030) 2024-09-10T22:30:00.167 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:00.158+0000 7fc4e966a640 1 -- 172.21.15.19:0/1083159446 learned_addr learned my addr 172.21.15.19:0/1083159446 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:30:00.168 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:00.158+0000 7fc4edca3740 1 -- 172.21.15.19:0/1083159446 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x564a123a2e50 con 0x564a1242cda0 2024-09-10T22:30:00.168 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:00.158+0000 7fc4edca3740 1 -- 172.21.15.19:0/1083159446 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x564a12392280 con 0x564a1242c480 2024-09-10T22:30:00.168 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:00.158+0000 7fc4edca3740 1 -- 172.21.15.19:0/1083159446 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x564a12396090 con 0x564a12438d30 2024-09-10T22:30:00.168 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:00.158+0000 7fc4e27fc640 1 --2- 172.21.15.19:0/301949979 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7fc4cc0b5360 0x7fc4cc0b7820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:30:00.168 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:00.158+0000 7fc4e8e69640 1 --2- 172.21.15.19:0/1083159446 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x564a12438d30 0x564a1243b120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:30:00.168 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:00.159+0000 7fc4e9e6b640 1 --2- 172.21.15.19:0/1083159446 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564a1242c480 0x564a1242c860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:30:00.168 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:00.159+0000 7fc4e27fc640 1 -- 172.21.15.19:0/301949979 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8327+0+0 (secure 0 0 0) 0x7fc4d8106510 con 0x7fc4e41087d0 2024-09-10T22:30:00.168 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:00.159+0000 7fc4e966a640 1 -- 172.21.15.19:0/1083159446 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x564a12438d30 msgr2=0x564a1243b120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:30:00.168 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:00.159+0000 7fc4e966a640 1 --2- 172.21.15.19:0/1083159446 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x564a12438d30 0x564a1243b120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:30:00.168 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:00.159+0000 7fc4e966a640 1 -- 172.21.15.19:0/1083159446 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564a1242c480 msgr2=0x564a1242c860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:30:00.168 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:00.159+0000 7fc4e966a640 1 --2- 172.21.15.19:0/1083159446 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564a1242c480 0x564a1242c860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:30:00.168 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:00.159+0000 7fc4e966a640 1 -- 172.21.15.19:0/1083159446 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564a120f0650 con 0x564a1242cda0 2024-09-10T22:30:00.169 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:00.159+0000 7fc4e9e6b640 1 --2- 172.21.15.19:0/1083159446 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564a1242c480 0x564a1242c860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T22:30:00.169 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:00.159+0000 7fc4e8e69640 1 --2- 172.21.15.19:0/1083159446 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x564a12438d30 0x564a1243b120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T22:30:00.169 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:00.160+0000 7fc4e9e6b640 1 --2- 172.21.15.19:0/301949979 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7fc4cc0b5360 0x7fc4cc0b7820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:30:00.169 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:00.160+0000 7fc4e966a640 1 --2- 172.21.15.19:0/1083159446 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x564a1242cda0 0x564a124387f0 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7fc4d4009c40 tx=0x7fc4d400e720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fef4dab0feb3a1d2 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:30:00.169 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:00.160+0000 7fc4e9e6b640 1 --2- 172.21.15.19:0/301949979 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7fc4cc0b5360 0x7fc4cc0b7820 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fc4dc00b880 tx=0x7fc4dc004b50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:30:00.169 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:00.160+0000 7fc4cb7fe640 1 -- 172.21.15.19:0/1083159446 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4d4005020 con 0x564a1242cda0 2024-09-10T22:30:00.169 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:00.161+0000 7fc4cb7fe640 1 -- 172.21.15.19:0/1083159446 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc4d40047a0 con 0x564a1242cda0 2024-09-10T22:30:00.169 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:00.161+0000 7fc4cb7fe640 1 -- 172.21.15.19:0/1083159446 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4d4010690 con 0x564a1242cda0 2024-09-10T22:30:00.169 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:00.161+0000 7fc4edca3740 1 -- 172.21.15.19:0/1083159446 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x564a1242cda0 msgr2=0x564a124387f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:30:00.169 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:00.161+0000 7fc4edca3740 1 --2- 172.21.15.19:0/1083159446 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x564a1242cda0 0x564a124387f0 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7fc4d4009c40 tx=0x7fc4d400e720 comp rx=0 tx=0).stop 2024-09-10T22:30:00.169 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:00.161+0000 7fc4edca3740 1 -- 172.21.15.19:0/1083159446 shutdown_connections 2024-09-10T22:30:00.169 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:00.161+0000 7fc4edca3740 1 --2- 172.21.15.19:0/1083159446 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x564a12438d30 0x564a1243b120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:30:00.169 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:00.161+0000 7fc4edca3740 1 --2- 172.21.15.19:0/1083159446 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x564a1242cda0 0x564a124387f0 unknown :-1 s=CLOSED pgs=558 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:30:00.169 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:00.161+0000 7fc4edca3740 1 --2- 172.21.15.19:0/1083159446 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564a1242c480 0x564a1242c860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:30:00.170 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:00.161+0000 7fc4edca3740 1 -- 172.21.15.19:0/1083159446 >> 172.21.15.19:0/1083159446 conn(0x564a1242a2b0 msgr2=0x564a1242b450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:30:00.170 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:00.162+0000 7fc4edca3740 1 -- 172.21.15.19:0/1083159446 shutdown_connections 2024-09-10T22:30:00.170 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:00.162+0000 7fc4edca3740 1 -- 172.21.15.19:0/1083159446 wait complete. 2024-09-10T22:30:00.170 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:00.162+0000 7fc4edca3740 1 -- start start 2024-09-10T22:30:00.170 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:00.162+0000 7fc4edca3740 1 Processor -- start 2024-09-10T22:30:00.170 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:00.163+0000 7fc4edca3740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x564a1242c480 0x564a124385d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:30:00.170 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:00.163+0000 7fc4edca3740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x564a1242cda0 0x564a12435a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:30:00.170 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:00.163+0000 7fc4edca3740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564a12438d30 0x564a12435fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:30:00.170 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:00.163+0000 7fc4edca3740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x564a121f3700 con 0x564a1242c480 2024-09-10T22:30:00.170 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:00.163+0000 7fc4edca3740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x564a1232d110 con 0x564a12438d30 2024-09-10T22:30:00.170 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:00.163+0000 7fc4edca3740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x564a1243ba00 con 0x564a1242cda0 2024-09-10T22:30:00.170 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:00.163+0000 7fc4e8e69640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x564a1242cda0 0x564a12435a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:30:00.170 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:00.163+0000 7fc4e966a640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x564a1242c480 0x564a124385d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:30:00.171 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:00.163+0000 7fc4e8e69640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x564a1242cda0 0x564a12435a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.19:53830/0 (socket says 172.21.15.19:53830) 2024-09-10T22:30:00.171 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:00.163+0000 7fc4e966a640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x564a1242c480 0x564a124385d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:36034/0 (socket says 172.21.15.19:36034) 2024-09-10T22:30:00.171 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:00.163+0000 7fc4e8e69640 1 -- 172.21.15.19:0/822434269 learned_addr learned my addr 172.21.15.19:0/822434269 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:30:00.171 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:00.163+0000 7fc4edca3740 10 client.0 _ll_register_callbacks cb 0x564a12346990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T22:30:00.171 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:00.164+0000 7fc4e8e69640 1 -- 172.21.15.19:0/822434269 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564a12438d30 msgr2=0x564a12435fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:30:00.171 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:00.164+0000 7fc4e8e69640 1 --2- 172.21.15.19:0/822434269 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564a12438d30 0x564a12435fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:30:00.171 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:00.164+0000 7fc4e8e69640 1 -- 172.21.15.19:0/822434269 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x564a1242c480 msgr2=0x564a124385d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:30:00.171 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:00.164+0000 7fc4e8e69640 1 --2- 172.21.15.19:0/822434269 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x564a1242c480 0x564a124385d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:30:00.171 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:00.164+0000 7fc4e8e69640 1 -- 172.21.15.19:0/822434269 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564a1235ac40 con 0x564a1242cda0 2024-09-10T22:30:00.171 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:00.164+0000 7fc4e8e69640 1 --2- 172.21.15.19:0/822434269 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x564a1242cda0 0x564a12435a20 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fc4d8103fb0 tx=0x7fc4d80c8bd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f511c54bef1cb97c server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:30:00.171 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:00.164+0000 7fc4c8ff9640 10 client.0 ms_handle_connect on v2:172.21.15.138:3300/0 2024-09-10T22:30:00.171 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:00.164+0000 7fc4c8ff9640 1 -- 172.21.15.19:0/822434269 <== mon.1 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4d8049070 con 0x564a1242cda0 2024-09-10T22:30:00.172 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:00.164+0000 7fc4c8ff9640 1 -- 172.21.15.19:0/822434269 <== mon.1 v2:172.21.15.138:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8327+0+0 (secure 0 0 0) 0x7fc4d8106110 con 0x564a1242cda0 2024-09-10T22:30:00.172 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:00.164+0000 7fc4edca3740 1 -- 172.21.15.19:0/822434269 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc4d40047a0 con 0x564a1242cda0 2024-09-10T22:30:00.186 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:00.183+0000 7fc4c8ff9640 1 -- 172.21.15.19:0/822434269 <== mon.1 v2:172.21.15.138:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fc4d80cc780 con 0x564a1242cda0 2024-09-10T22:30:00.187 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:00.183+0000 7fc4edca3740 10 client.25516 fetch_fsmap learned FSMap version 27 2024-09-10T22:30:00.187 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:00.183+0000 7fc4edca3740 1 -- 172.21.15.19:0/822434269 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x564a12447290 con 0x564a1242cda0 2024-09-10T22:30:00.187 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:00.184+0000 7fc4c8ff9640 1 -- 172.21.15.19:0/822434269 <== mon.1 v2:172.21.15.138:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc4d40047a0 con 0x564a1242cda0 2024-09-10T22:30:00.187 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:00.184+0000 7fc4c8ff9640 1 -- 172.21.15.19:0/822434269 <== mon.1 v2:172.21.15.138:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7fc4d80cced0 con 0x564a1242cda0 2024-09-10T22:30:00.187 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:00.184+0000 7fc4edca3740 10 client.25516 fetch_fsmap finished waiting for FSMap version 27 2024-09-10T22:30:00.187 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:00.184+0000 7fc4edca3740 10 client.25516 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-10T22:30:00.187 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:00.184+0000 7fc4edca3740 20 client.25516 populate_metadata read hostname 'smithi019' 2024-09-10T22:30:00.187 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:00.184+0000 7fc4edca3740 1 --2- 172.21.15.19:0/822434269 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x564a124486f0 0x564a1244ab20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:30:00.187 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:00.184+0000 7fc4edca3740 4 client.25516 mds_command: new command op to 24581 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T22:30:00.187 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:00.184+0000 7fc4edca3740 1 -- 172.21.15.19:0/822434269 --> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564a123a4da0 con 0x564a124486f0 2024-09-10T22:30:00.188 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:00.184+0000 7fc4e966a640 1 --2- 172.21.15.19:0/822434269 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x564a124486f0 0x564a1244ab20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:30:00.189 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:00.185+0000 7fc4c8ff9640 10 client.25516 ms_handle_connect on v2:172.21.15.135:6838/1254769802 2024-09-10T22:30:00.189 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:00.185+0000 7fc4e966a640 1 --2- 172.21.15.19:0/822434269 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x564a124486f0 0x564a1244ab20 crc :-1 s=READY pgs=90 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bfa47ea8125fa7fa server_cookie=58c14df192c47df2 in_seq=0 out_seq=0 2024-09-10T22:30:00.189 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:00.185+0000 7fc4c8ff9640 1 -- 172.21.15.19:0/822434269 <== mds.0 v2:172.21.15.135:6838/1254769802 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x564a123a4da0 con 0x564a124486f0 2024-09-10T22:30:00.189 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:00.185+0000 7fc4c8ff9640 10 client.25516 handle_command_reply: tid=0 2024-09-10T22:30:00.189 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:00.185+0000 7fc4edca3740 1 client.25516 shutdown 2024-09-10T22:30:00.189 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:00.185+0000 7fc4edca3740 1 -- 172.21.15.19:0/822434269 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x564a1242cda0 msgr2=0x564a12435a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:30:00.189 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:00.186+0000 7fc4edca3740 1 --2- 172.21.15.19:0/822434269 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x564a1242cda0 0x564a12435a20 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fc4d8103fb0 tx=0x7fc4d80c8bd0 comp rx=0 tx=0).stop 2024-09-10T22:30:00.189 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:00.186+0000 7fc4edca3740 1 -- 172.21.15.19:0/822434269 shutdown_connections 2024-09-10T22:30:00.189 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:00.186+0000 7fc4edca3740 1 --2- 172.21.15.19:0/822434269 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564a12438d30 0x564a12435fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:30:00.189 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:00.186+0000 7fc4edca3740 1 --2- 172.21.15.19:0/822434269 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x564a124486f0 0x564a1244ab20 crc :-1 s=READY pgs=90 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:30:00.190 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:00.186+0000 7fc4edca3740 1 --2- 172.21.15.19:0/822434269 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x564a1242cda0 0x564a12435a20 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:30:00.190 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:00.186+0000 7fc4edca3740 1 --2- 172.21.15.19:0/822434269 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x564a1242c480 0x564a124385d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:30:00.190 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:00.186+0000 7fc4c8ff9640 0 client.25516 ms_handle_reset on v2:172.21.15.135:6838/1254769802 2024-09-10T22:30:00.190 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:00.186+0000 7fc4edca3740 1 -- 172.21.15.19:0/822434269 >> 172.21.15.19:0/822434269 conn(0x564a1242a2b0 msgr2=0x564a1242fe50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:30:00.190 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:00.186+0000 7fc4edca3740 1 -- 172.21.15.19:0/822434269 shutdown_connections 2024-09-10T22:30:00.190 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:00.186+0000 7fc4edca3740 1 -- 172.21.15.19:0/822434269 wait complete. 2024-09-10T22:30:00.190 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:00.186+0000 7fc4edca3740 20 client.25516 trim_cache size 0 max 16384 2024-09-10T22:30:00.209 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:00.205+0000 7fc4edca3740 1 Processor -- start 2024-09-10T22:30:00.209 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:00.205+0000 7fc4edca3740 1 -- start start 2024-09-10T22:30:00.209 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:00.205+0000 7fc4edca3740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564a1242c480 0x564a12444c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:30:00.209 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:00.205+0000 7fc4edca3740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x564a1242cda0 0x564a1242b2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:30:00.209 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:00.205+0000 7fc4edca3740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x564a12438d30 0x564a1243a120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:30:00.209 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:00.206+0000 7fc4edca3740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fc4e41b7430 con 0x564a12438d30 2024-09-10T22:30:00.209 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:00.206+0000 7fc4edca3740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fc4e41b4d00 con 0x564a1242c480 2024-09-10T22:30:00.209 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:00.206+0000 7fc4edca3740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7fc4e41b2b50 con 0x564a1242cda0 2024-09-10T22:30:00.210 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:00.206+0000 7fc4e966a640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564a1242c480 0x564a12444c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:30:00.210 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:00.206+0000 7fc4e8e69640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x564a1242cda0 0x564a1242b2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:30:00.210 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:00.206+0000 7fc4e966a640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564a1242c480 0x564a12444c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.19:53664/0 (socket says 172.21.15.19:53664) 2024-09-10T22:30:00.210 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:00.206+0000 7fc4e8e69640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x564a1242cda0 0x564a1242b2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.19:53832/0 (socket says 172.21.15.19:53832) 2024-09-10T22:30:00.210 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:00.206+0000 7fc4e966a640 1 -- 172.21.15.19:0/2124102799 learned_addr learned my addr 172.21.15.19:0/2124102799 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:30:00.210 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:00.206+0000 7fc4e9e6b640 1 --2- 172.21.15.19:0/2124102799 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x564a12438d30 0x564a1243a120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:30:00.210 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:00.206+0000 7fc4e966a640 1 -- 172.21.15.19:0/2124102799 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x564a1242cda0 msgr2=0x564a1242b2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:30:00.210 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:00.206+0000 7fc4e966a640 1 --2- 172.21.15.19:0/2124102799 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x564a1242cda0 0x564a1242b2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:30:00.210 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:00.206+0000 7fc4e966a640 1 -- 172.21.15.19:0/2124102799 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x564a12438d30 msgr2=0x564a1243a120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:30:00.210 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:00.206+0000 7fc4e966a640 1 --2- 172.21.15.19:0/2124102799 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x564a12438d30 0x564a1243a120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:30:00.210 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:00.206+0000 7fc4e966a640 1 -- 172.21.15.19:0/2124102799 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564a1242af90 con 0x564a1242c480 2024-09-10T22:30:00.211 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:00.206+0000 7fc4e9e6b640 1 --2- 172.21.15.19:0/2124102799 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x564a12438d30 0x564a1243a120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T22:30:00.211 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:00.206+0000 7fc4e966a640 1 --2- 172.21.15.19:0/2124102799 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564a1242c480 0x564a12444c60 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fc4d4009c40 tx=0x7fc4d400e720 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7f974ad74d09b3ea server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:30:00.211 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:00.207+0000 7fc4caffd640 1 -- 172.21.15.19:0/2124102799 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4d401d040 con 0x564a1242c480 2024-09-10T22:30:00.211 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:00.207+0000 7fc4caffd640 1 -- 172.21.15.19:0/2124102799 <== mon.2 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc4d4009820 con 0x564a1242c480 2024-09-10T22:30:00.211 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:00.207+0000 7fc4caffd640 1 -- 172.21.15.19:0/2124102799 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4d4018430 con 0x564a1242c480 2024-09-10T22:30:00.212 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:00.207+0000 7fc4edca3740 1 -- 172.21.15.19:0/2124102799 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564a1242c480 msgr2=0x564a12444c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:30:00.212 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:00.207+0000 7fc4edca3740 1 --2- 172.21.15.19:0/2124102799 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564a1242c480 0x564a12444c60 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fc4d4009c40 tx=0x7fc4d400e720 comp rx=0 tx=0).stop 2024-09-10T22:30:00.212 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:00.207+0000 7fc4edca3740 1 -- 172.21.15.19:0/2124102799 shutdown_connections 2024-09-10T22:30:00.212 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:00.207+0000 7fc4edca3740 1 --2- 172.21.15.19:0/2124102799 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x564a12438d30 0x564a1243a120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:30:00.212 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:00.207+0000 7fc4edca3740 1 --2- 172.21.15.19:0/2124102799 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x564a1242cda0 0x564a1242b2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:30:00.212 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:00.207+0000 7fc4edca3740 1 --2- 172.21.15.19:0/2124102799 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564a1242c480 0x564a12444c60 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:30:00.212 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:00.207+0000 7fc4edca3740 1 -- 172.21.15.19:0/2124102799 >> 172.21.15.19:0/2124102799 conn(0x564a1242a2b0 msgr2=0x564a124342a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:30:00.212 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:30:00 smithi019 ceph-mon[31375]: pgmap v454: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 660 KiB/s rd, 338 MiB/s wr, 187 op/s 2024-09-10T22:30:00.212 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:30:00 smithi019 ceph-mon[31375]: overall HEALTH_OK 2024-09-10T22:30:00.216 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:00.208+0000 7fc4edca3740 1 -- 172.21.15.19:0/2124102799 shutdown_connections 2024-09-10T22:30:00.216 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:00.208+0000 7fc4edca3740 1 -- 172.21.15.19:0/2124102799 wait complete. 2024-09-10T22:30:00.216 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:00.208+0000 7fc4edca3740 1 -- start start 2024-09-10T22:30:00.216 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:00.208+0000 7fc4edca3740 1 Processor -- start 2024-09-10T22:30:00.216 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:00.208+0000 7fc4edca3740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x564a1242c480 0x564a124411c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:30:00.216 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:00.208+0000 7fc4edca3740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564a1242cda0 0x564a1243fce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:30:00.216 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:00.208+0000 7fc4edca3740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x564a12438d30 0x564a12440220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:30:00.216 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:00.209+0000 7fc4edca3740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fc4e41b31c0 con 0x564a1242c480 2024-09-10T22:30:00.217 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:00.209+0000 7fc4edca3740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fc4e41b4630 con 0x564a1242cda0 2024-09-10T22:30:00.217 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:00.209+0000 7fc4edca3740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7fc4e41b3890 con 0x564a12438d30 2024-09-10T22:30:00.217 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:00.209+0000 7fc4edca3740 10 client.0 _ll_register_callbacks cb 0x7fc4d8005b50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T22:30:00.217 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:00.209+0000 7fc4e966a640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x564a1242c480 0x564a124411c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:30:00.217 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:00.209+0000 7fc4e966a640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x564a1242c480 0x564a124411c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:36054/0 (socket says 172.21.15.19:36054) 2024-09-10T22:30:00.217 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:00.209+0000 7fc4e966a640 1 -- 172.21.15.19:0/1078269492 learned_addr learned my addr 172.21.15.19:0/1078269492 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:30:00.217 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:00.209+0000 7fc4e9e6b640 1 --2- 172.21.15.19:0/1078269492 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x564a12438d30 0x564a12440220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:30:00.217 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:00.209+0000 7fc4e966a640 1 -- 172.21.15.19:0/1078269492 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x564a12438d30 msgr2=0x564a12440220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:30:00.217 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:00.209+0000 7fc4e966a640 1 --2- 172.21.15.19:0/1078269492 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x564a12438d30 0x564a12440220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:30:00.217 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:00.209+0000 7fc4e966a640 1 -- 172.21.15.19:0/1078269492 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564a1242cda0 msgr2=0x564a1243fce0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-10T22:30:00.217 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:00.209+0000 7fc4e966a640 1 --2- 172.21.15.19:0/1078269492 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564a1242cda0 0x564a1243fce0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:30:00.217 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:00.209+0000 7fc4e966a640 1 -- 172.21.15.19:0/1078269492 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564a124407e0 con 0x564a1242c480 2024-09-10T22:30:00.218 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:00.209+0000 7fc4e966a640 1 --2- 172.21.15.19:0/1078269492 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x564a1242c480 0x564a124411c0 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7fc4d4005e00 tx=0x7fc4d400ef50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f8fc0bd4f2ed3c1a server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:30:00.218 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:00.209+0000 7fc4c8ff9640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-10T22:30:00.218 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:00.209+0000 7fc4c8ff9640 1 -- 172.21.15.19:0/1078269492 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4d4003ca0 con 0x564a1242c480 2024-09-10T22:30:00.218 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:00.209+0000 7fc4c8ff9640 1 -- 172.21.15.19:0/1078269492 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8327+0+0 (secure 0 0 0) 0x7fc4d40035f0 con 0x564a1242c480 2024-09-10T22:30:00.218 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:00.209+0000 7fc4edca3740 1 -- 172.21.15.19:0/1078269492 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc4d4009820 con 0x564a1242c480 2024-09-10T22:30:00.218 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:00.210+0000 7fc4c8ff9640 1 -- 172.21.15.19:0/1078269492 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fc4d4003e40 con 0x564a1242c480 2024-09-10T22:30:00.218 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:00.210+0000 7fc4edca3740 10 client.16047 fetch_fsmap learned FSMap version 27 2024-09-10T22:30:00.218 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:00.210+0000 7fc4edca3740 1 -- 172.21.15.19:0/1078269492 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x564a124b6320 con 0x564a1242c480 2024-09-10T22:30:00.218 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:00.210+0000 7fc4c8ff9640 1 -- 172.21.15.19:0/1078269492 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc4d4003830 con 0x564a1242c480 2024-09-10T22:30:00.218 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:00.210+0000 7fc4c8ff9640 1 -- 172.21.15.19:0/1078269492 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7fc4d402c040 con 0x564a1242c480 2024-09-10T22:30:00.218 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:00.211+0000 7fc4edca3740 10 client.16047 fetch_fsmap finished waiting for FSMap version 27 2024-09-10T22:30:00.218 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:00.211+0000 7fc4edca3740 10 client.16047 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-10T22:30:00.218 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:00.211+0000 7fc4edca3740 20 client.16047 populate_metadata read hostname 'smithi019' 2024-09-10T22:30:00.219 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:00.211+0000 7fc4edca3740 1 --2- 172.21.15.19:0/1078269492 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x564a124b6930 0x564a124b8d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:30:00.219 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:00.211+0000 7fc4edca3740 4 client.16047 mds_command: new command op to 24581 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-10T22:30:00.219 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:00.211+0000 7fc4edca3740 1 -- 172.21.15.19:0/1078269492 --> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] -- command(tid 0: {"prefix": "scrub status"}) -- 0x7fc4d4009820 con 0x564a124b6930 2024-09-10T22:30:00.219 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:00.211+0000 7fc4e8e69640 1 --2- 172.21.15.19:0/1078269492 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x564a124b6930 0x564a124b8d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:30:00.219 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:00.211+0000 7fc4c8ff9640 10 client.16047 ms_handle_connect on v2:172.21.15.135:6838/1254769802 2024-09-10T22:30:00.219 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:00.211+0000 7fc4e8e69640 1 --2- 172.21.15.19:0/1078269492 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x564a124b6930 0x564a124b8d50 crc :-1 s=READY pgs=91 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=577b918a05331039 server_cookie=285b8414ff0b99c4 in_seq=0 out_seq=0 2024-09-10T22:30:00.219 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:00.212+0000 7fc4c8ff9640 1 -- 172.21.15.19:0/1078269492 <== mds.0 v2:172.21.15.135:6838/1254769802 1 ==== command_reply(tid 0: 0 ) ==== 8+0+1510 (crc 0 0 0) 0x7fc4d4009820 con 0x564a124b6930 2024-09-10T22:30:00.219 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:00.212+0000 7fc4c8ff9640 10 client.16047 handle_command_reply: tid=0 2024-09-10T22:30:00.219 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:00.212+0000 7fc4edca3740 1 client.16047 shutdown 2024-09-10T22:30:00.219 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:00.212+0000 7fc4edca3740 1 -- 172.21.15.19:0/1078269492 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x564a1242c480 msgr2=0x564a124411c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:30:00.219 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:00.212+0000 7fc4edca3740 1 --2- 172.21.15.19:0/1078269492 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x564a1242c480 0x564a124411c0 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7fc4d4005e00 tx=0x7fc4d400ef50 comp rx=0 tx=0).stop 2024-09-10T22:30:00.219 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:00.212+0000 7fc4edca3740 1 -- 172.21.15.19:0/1078269492 shutdown_connections 2024-09-10T22:30:00.219 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:00.212+0000 7fc4edca3740 1 --2- 172.21.15.19:0/1078269492 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x564a124b6930 0x564a124b8d50 crc :-1 s=READY pgs=91 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:30:00.220 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:00.212+0000 7fc4edca3740 1 --2- 172.21.15.19:0/1078269492 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x564a12438d30 0x564a12440220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:30:00.220 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:00.212+0000 7fc4edca3740 1 --2- 172.21.15.19:0/1078269492 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564a1242cda0 0x564a1243fce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:30:00.220 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:00.212+0000 7fc4edca3740 1 --2- 172.21.15.19:0/1078269492 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x564a1242c480 0x564a124411c0 unknown :-1 s=CLOSED pgs=559 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:30:00.220 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:00.212+0000 7fc4edca3740 1 -- 172.21.15.19:0/1078269492 >> 172.21.15.19:0/1078269492 conn(0x564a1242a2b0 msgr2=0x564a12434200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:30:00.220 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:00.212+0000 7fc4c8ff9640 0 client.16047 ms_handle_reset on v2:172.21.15.135:6838/1254769802 2024-09-10T22:30:00.220 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:00.213+0000 7fc4edca3740 1 -- 172.21.15.19:0/1078269492 shutdown_connections 2024-09-10T22:30:00.220 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:00.213+0000 7fc4edca3740 1 -- 172.21.15.19:0/1078269492 wait complete. 2024-09-10T22:30:00.220 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:00.213+0000 7fc4edca3740 20 client.16047 trim_cache size 0 max 16384 2024-09-10T22:30:00.220 INFO:teuthology.orchestra.run.smithi019.stdout:{ 2024-09-10T22:30:00.221 INFO:teuthology.orchestra.run.smithi019.stdout: "status": "no active scrubs running", 2024-09-10T22:30:00.221 INFO:teuthology.orchestra.run.smithi019.stdout: "scrubs": {}, 2024-09-10T22:30:00.221 INFO:teuthology.orchestra.run.smithi019.stdout: "scrub_stats": { 2024-09-10T22:30:00.221 INFO:teuthology.orchestra.run.smithi019.stdout: "8f3bb3bf-911f-490c-9856-c80ea220dbbe": { 2024-09-10T22:30:00.221 INFO:teuthology.orchestra.run.smithi019.stdout: "start_time": "2024-09-10T22:29:25.374415+0000", 2024-09-10T22:30:00.221 INFO:teuthology.orchestra.run.smithi019.stdout: "path": "/", 2024-09-10T22:30:00.221 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_started": 0, 2024-09-10T22:30:00.221 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_passed": 0, 2024-09-10T22:30:00.221 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_failed": 0, 2024-09-10T22:30:00.221 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_skipped": 0 2024-09-10T22:30:00.221 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:30:00.221 INFO:teuthology.orchestra.run.smithi019.stdout: "eb518e3c-a71e-4f32-9ca0-ae88930ca218": { 2024-09-10T22:30:00.221 INFO:teuthology.orchestra.run.smithi019.stdout: "start_time": "2024-09-10T22:28:38.366352+0000", 2024-09-10T22:30:00.222 INFO:teuthology.orchestra.run.smithi019.stdout: "path": "/", 2024-09-10T22:30:00.222 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_started": 0, 2024-09-10T22:30:00.222 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_passed": 0, 2024-09-10T22:30:00.222 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_failed": 0, 2024-09-10T22:30:00.222 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_skipped": 0 2024-09-10T22:30:00.222 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:30:00.222 INFO:teuthology.orchestra.run.smithi019.stdout: "c12c2a04-dcd6-4673-a98e-93f665d3f5d7": { 2024-09-10T22:30:00.222 INFO:teuthology.orchestra.run.smithi019.stdout: "start_time": "2024-09-10T22:27:49.392329+0000", 2024-09-10T22:30:00.222 INFO:teuthology.orchestra.run.smithi019.stdout: "path": "/", 2024-09-10T22:30:00.222 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_started": 0, 2024-09-10T22:30:00.222 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_passed": 0, 2024-09-10T22:30:00.222 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_failed": 0, 2024-09-10T22:30:00.222 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_skipped": 0 2024-09-10T22:30:00.223 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:30:00.223 INFO:teuthology.orchestra.run.smithi019.stdout: "b38852c8-478a-42ef-8384-b2c55d5313a4": { 2024-09-10T22:30:00.223 INFO:teuthology.orchestra.run.smithi019.stdout: "start_time": "2024-09-10T22:27:00.320308+0000", 2024-09-10T22:30:00.223 INFO:teuthology.orchestra.run.smithi019.stdout: "path": "/", 2024-09-10T22:30:00.223 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_started": 0, 2024-09-10T22:30:00.223 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_passed": 0, 2024-09-10T22:30:00.223 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_failed": 0, 2024-09-10T22:30:00.223 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_skipped": 0 2024-09-10T22:30:00.223 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:30:00.223 INFO:teuthology.orchestra.run.smithi019.stdout: "9b6bfdee-303c-4c12-af56-dc85860d112a": { 2024-09-10T22:30:00.223 INFO:teuthology.orchestra.run.smithi019.stdout: "start_time": "2024-09-10T22:26:17.484162+0000", 2024-09-10T22:30:00.223 INFO:teuthology.orchestra.run.smithi019.stdout: "path": "/", 2024-09-10T22:30:00.223 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_started": 0, 2024-09-10T22:30:00.224 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_passed": 0, 2024-09-10T22:30:00.224 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_failed": 0, 2024-09-10T22:30:00.224 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_skipped": 0 2024-09-10T22:30:00.224 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-10T22:30:00.224 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-10T22:30:00.224 INFO:teuthology.orchestra.run.smithi019.stdout:} 2024-09-10T22:30:00.225 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:00.213+0000 7fc4eb8ce640 1 -- 172.21.15.19:0/301949979 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7fc4cc0b5360 msgr2=0x7fc4cc0b7820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:30:00.225 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:00.213+0000 7fc4eb8ce640 1 --2- 172.21.15.19:0/301949979 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7fc4cc0b5360 0x7fc4cc0b7820 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fc4dc00b880 tx=0x7fc4dc004b50 comp rx=0 tx=0).stop 2024-09-10T22:30:00.225 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:00.213+0000 7fc4eb8ce640 1 -- 172.21.15.19:0/301949979 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc4e41087d0 msgr2=0x7fc4e4109e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:30:00.225 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:00.213+0000 7fc4eb8ce640 1 --2- 172.21.15.19:0/301949979 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc4e41087d0 0x7fc4e4109e80 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7fc4d8005940 tx=0x7fc4d8004270 comp rx=0 tx=0).stop 2024-09-10T22:30:00.225 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:00.213+0000 7fc4eb8ce640 1 -- 172.21.15.19:0/301949979 shutdown_connections 2024-09-10T22:30:00.225 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:00.213+0000 7fc4eb8ce640 1 --2- 172.21.15.19:0/301949979 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7fc4cc0b5360 0x7fc4cc0b7820 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:30:00.225 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:00.213+0000 7fc4eb8ce640 1 --2- 172.21.15.19:0/301949979 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc4e4109150 0x7fc4e410a3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:30:00.225 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:00.213+0000 7fc4eb8ce640 1 --2- 172.21.15.19:0/301949979 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc4e41087d0 0x7fc4e4109e80 unknown :-1 s=CLOSED pgs=557 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:30:00.226 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:00.213+0000 7fc4eb8ce640 1 --2- 172.21.15.19:0/301949979 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc4e4102dc0 0x7fc4e4109940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:30:00.226 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:00.213+0000 7fc4eb8ce640 1 -- 172.21.15.19:0/301949979 >> 172.21.15.19:0/301949979 conn(0x7fc4e40fe830 msgr2=0x7fc4e4105db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:30:00.226 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:00.214+0000 7fc4eb8ce640 1 -- 172.21.15.19:0/301949979 shutdown_connections 2024-09-10T22:30:00.226 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:00.214+0000 7fc4eb8ce640 1 -- 172.21.15.19:0/301949979 wait complete. 2024-09-10T22:30:00.609 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:30:00 smithi135 ceph-mon[34789]: pgmap v454: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 660 KiB/s rd, 338 MiB/s wr, 187 op/s 2024-09-10T22:30:00.610 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:30:00 smithi135 ceph-mon[34789]: overall HEALTH_OK 2024-09-10T22:30:00.625 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:30:00 smithi138 ceph-mon[35236]: pgmap v454: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 660 KiB/s rd, 338 MiB/s wr, 187 op/s 2024-09-10T22:30:00.625 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:30:00 smithi138 ceph-mon[35236]: overall HEALTH_OK 2024-09-10T22:30:01.299 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-10T22:30:01.299 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 22997a4c-6fc2-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-10T22:30:01.621 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/22997a4c-6fc2-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T22:30:02.345 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:02.339+0000 7f4c16646640 1 -- 172.21.15.19:0/3729296903 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4c10104570 msgr2=0x7f4c1010cb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:30:02.346 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:02.339+0000 7f4c16646640 1 --2- 172.21.15.19:0/3729296903 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4c10104570 0x7f4c1010cb50 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f4bf8009900 tx=0x7f4bf802a410 comp rx=0 tx=0).stop 2024-09-10T22:30:02.346 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:02.339+0000 7f4c16646640 1 -- 172.21.15.19:0/3729296903 shutdown_connections 2024-09-10T22:30:02.346 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:02.339+0000 7f4c16646640 1 --2- 172.21.15.19:0/3729296903 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f4c1010d120 0x7f4c1010f550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:30:02.346 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:02.339+0000 7f4c16646640 1 --2- 172.21.15.19:0/3729296903 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4c10104570 0x7f4c1010cb50 unknown :-1 s=CLOSED pgs=560 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:30:02.346 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:02.339+0000 7f4c16646640 1 --2- 172.21.15.19:0/3729296903 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4c10103b70 0x7f4c10103f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:30:02.346 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:02.340+0000 7f4c16646640 1 -- 172.21.15.19:0/3729296903 >> 172.21.15.19:0/3729296903 conn(0x7f4c100fd700 msgr2=0x7f4c100ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:30:02.347 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:02.340+0000 7f4c16646640 1 -- 172.21.15.19:0/3729296903 shutdown_connections 2024-09-10T22:30:02.347 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:02.340+0000 7f4c16646640 1 -- 172.21.15.19:0/3729296903 wait complete. 2024-09-10T22:30:02.347 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:02.340+0000 7f4c16646640 1 Processor -- start 2024-09-10T22:30:02.347 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:02.340+0000 7f4c16646640 1 -- start start 2024-09-10T22:30:02.347 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:02.341+0000 7f4c16646640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4c10103b70 0x7f4c101019f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:30:02.347 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:02.341+0000 7f4c16646640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4c10104570 0x7f4c10101f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:30:02.348 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:02.341+0000 7f4c16646640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f4c1010d120 0x7f4c10102470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:30:02.348 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:02.341+0000 7f4c16646640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f4c10112db0 con 0x7f4c10103b70 2024-09-10T22:30:02.348 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:02.341+0000 7f4c16646640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f4c10112c30 con 0x7f4c10104570 2024-09-10T22:30:02.348 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:02.341+0000 7f4c16646640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f4c10112f30 con 0x7f4c1010d120 2024-09-10T22:30:02.348 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:02.341+0000 7f4c07fff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4c10104570 0x7f4c10101f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:30:02.348 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:02.341+0000 7f4c0ffff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4c10103b70 0x7f4c101019f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:30:02.349 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:02.341+0000 7f4c07fff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4c10104570 0x7f4c10101f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.19:53686/0 (socket says 172.21.15.19:53686) 2024-09-10T22:30:02.349 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:02.341+0000 7f4c0ffff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4c10103b70 0x7f4c101019f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:36066/0 (socket says 172.21.15.19:36066) 2024-09-10T22:30:02.349 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:02.341+0000 7f4c07fff640 1 -- 172.21.15.19:0/1948652434 learned_addr learned my addr 172.21.15.19:0/1948652434 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:30:02.349 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:02.341+0000 7f4c14be3640 1 --2- 172.21.15.19:0/1948652434 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f4c1010d120 0x7f4c10102470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:30:02.349 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:02.341+0000 7f4c0ffff640 1 -- 172.21.15.19:0/1948652434 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f4c1010d120 msgr2=0x7f4c10102470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:30:02.349 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:02.341+0000 7f4c0ffff640 1 --2- 172.21.15.19:0/1948652434 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f4c1010d120 0x7f4c10102470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:30:02.349 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:02.341+0000 7f4c0ffff640 1 -- 172.21.15.19:0/1948652434 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4c10104570 msgr2=0x7f4c10101f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:30:02.350 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:02.341+0000 7f4c0ffff640 1 --2- 172.21.15.19:0/1948652434 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4c10104570 0x7f4c10101f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:30:02.350 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:02.341+0000 7f4c0ffff640 1 -- 172.21.15.19:0/1948652434 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4c101a76a0 con 0x7f4c10103b70 2024-09-10T22:30:02.350 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:02.341+0000 7f4c07fff640 1 --2- 172.21.15.19:0/1948652434 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4c10104570 0x7f4c10101f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T22:30:02.350 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:02.342+0000 7f4c0ffff640 1 --2- 172.21.15.19:0/1948652434 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4c10103b70 0x7f4c101019f0 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7f4c0000e9f0 tx=0x7f4c0000eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:30:02.350 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:02.342+0000 7f4c0dffb640 1 -- 172.21.15.19:0/1948652434 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c0000ccc0 con 0x7f4c10103b70 2024-09-10T22:30:02.350 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:02.342+0000 7f4c16646640 1 -- 172.21.15.19:0/1948652434 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4c101a7990 con 0x7f4c10103b70 2024-09-10T22:30:02.350 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:02.342+0000 7f4c0dffb640 1 -- 172.21.15.19:0/1948652434 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4c000108e0 con 0x7f4c10103b70 2024-09-10T22:30:02.351 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:02.342+0000 7f4c0dffb640 1 -- 172.21.15.19:0/1948652434 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c00018880 con 0x7f4c10103b70 2024-09-10T22:30:02.351 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:02.342+0000 7f4c16646640 1 -- 172.21.15.19:0/1948652434 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4c101a7f20 con 0x7f4c10103b70 2024-09-10T22:30:02.351 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:02.343+0000 7f4c16646640 1 -- 172.21.15.19:0/1948652434 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4c10103f50 con 0x7f4c10103b70 2024-09-10T22:30:02.353 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:02.345+0000 7f4c0dffb640 1 -- 172.21.15.19:0/1948652434 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 18) ==== 153250+0+0 (secure 0 0 0) 0x7f4c00010430 con 0x7f4c10103b70 2024-09-10T22:30:02.354 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:02.346+0000 7f4c0dffb640 1 --2- 172.21.15.19:0/1948652434 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f4bfc0b52e0 0x7f4bfc0b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:30:02.354 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:02.346+0000 7f4c07fff640 1 --2- 172.21.15.19:0/1948652434 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f4bfc0b52e0 0x7f4bfc0b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:30:02.354 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:02.346+0000 7f4c0dffb640 1 -- 172.21.15.19:0/1948652434 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8327+0+0 (secure 0 0 0) 0x7f4c000e6420 con 0x7f4c10103b70 2024-09-10T22:30:02.354 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:02.347+0000 7f4c07fff640 1 --2- 172.21.15.19:0/1948652434 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f4bfc0b52e0 0x7f4bfc0b77a0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f4c101034e0 tx=0x7f4bf8005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:30:02.354 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:02.349+0000 7f4c0dffb640 1 -- 172.21.15.19:0/1948652434 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f4c000acbd0 con 0x7f4c10103b70 2024-09-10T22:30:02.593 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:02.590+0000 7f4c16646640 1 -- 172.21.15.19:0/1948652434 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f4c10102cf0 con 0x7f4c10103b70 2024-09-10T22:30:02.593 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:30:02 smithi019 ceph-mon[31375]: pgmap v455: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 986 KiB/s rd, 387 MiB/s wr, 225 op/s 2024-09-10T22:30:02.594 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:02.591+0000 7f4c0dffb640 1 -- 172.21.15.19:0/1948652434 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) ==== 94+0+11921 (secure 0 0 0) 0x7f4c000b1600 con 0x7f4c10103b70 2024-09-10T22:30:02.594 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-10T22:30:02.594 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":27,"btime":"2024-09-10T22:29:37:724724+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14673,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6835/1835804747","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6834","nonce":1835804747},{"type":"v1","addr":"172.21.15.19:6835","nonce":1835804747}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14685,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6837/1750470490","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6836","nonce":1750470490},{"type":"v1","addr":"172.21.15.19:6837","nonce":1750470490}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14733,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6839/2642941149","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6838","nonce":2642941149},{"type":"v1","addr":"172.21.15.19:6839","nonce":2642941149}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14745,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6841/2449948682","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6840","nonce":2449948682},{"type":"v1","addr":"172.21.15.19:6841","nonce":2449948682}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24511,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.138:6833/2524811494","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6832","nonce":2524811494},{"type":"v1","addr":"172.21.15.138:6833","nonce":2524811494}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24512,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6833/3014993624","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6832","nonce":3014993624},{"type":"v1","addr":"172.21.15.135:6833","nonce":3014993624}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":27,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-10T22:24:22.733925+0000","modified":"2024-09-10T22:29:37.430699+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24581,"mds_1":24568,"mds_2":24553},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24527":{"gid":24527,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.135:6835/3715773348","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6834","nonce":3715773348},{"type":"v1","addr":"172.21.15.135:6835","nonce":3715773348}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24541":{"gid":24541,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.138:6835/933547028","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6834","nonce":933547028},{"type":"v1","addr":"172.21.15.138:6835","nonce":933547028}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24551":{"gid":24551,"name":"h","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.135:6837/3495029135","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6836","nonce":3495029135},{"type":"v1","addr":"172.21.15.135:6837","nonce":3495029135}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24553":{"gid":24553,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":10,"addr":"172.21.15.138:6837/3353290042","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6836","nonce":3353290042},{"type":"v1","addr":"172.21.15.138:6837","nonce":3353290042}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24568":{"gid":24568,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.138:6839/383637208","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6838","nonce":383637208},{"type":"v1","addr":"172.21.15.138:6839","nonce":383637208}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24581":{"gid":24581,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.135:6839/1254769802","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6838","nonce":1254769802},{"type":"v1","addr":"172.21.15.135:6839","nonce":1254769802}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24581,"qdb_cluster":[24581,24568,24553]},"id":1}]} 2024-09-10T22:30:02.595 INFO:teuthology.orchestra.run.smithi019.stderr:dumped fsmap epoch 27 2024-09-10T22:30:02.596 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:02.593+0000 7f4c16646640 1 -- 172.21.15.19:0/1948652434 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f4bfc0b52e0 msgr2=0x7f4bfc0b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:30:02.596 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:02.593+0000 7f4c16646640 1 --2- 172.21.15.19:0/1948652434 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f4bfc0b52e0 0x7f4bfc0b77a0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f4c101034e0 tx=0x7f4bf8005a20 comp rx=0 tx=0).stop 2024-09-10T22:30:02.597 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:02.593+0000 7f4c16646640 1 -- 172.21.15.19:0/1948652434 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4c10103b70 msgr2=0x7f4c101019f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:30:02.597 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:02.593+0000 7f4c16646640 1 --2- 172.21.15.19:0/1948652434 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4c10103b70 0x7f4c101019f0 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7f4c0000e9f0 tx=0x7f4c0000eeb0 comp rx=0 tx=0).stop 2024-09-10T22:30:02.597 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:02.594+0000 7f4c16646640 1 -- 172.21.15.19:0/1948652434 shutdown_connections 2024-09-10T22:30:02.597 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:02.594+0000 7f4c16646640 1 --2- 172.21.15.19:0/1948652434 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f4bfc0b52e0 0x7f4bfc0b77a0 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:30:02.597 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:02.594+0000 7f4c16646640 1 --2- 172.21.15.19:0/1948652434 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f4c1010d120 0x7f4c10102470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:30:02.597 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:02.594+0000 7f4c16646640 1 --2- 172.21.15.19:0/1948652434 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4c10104570 0x7f4c10101f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:30:02.597 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:02.594+0000 7f4c16646640 1 --2- 172.21.15.19:0/1948652434 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4c10103b70 0x7f4c101019f0 unknown :-1 s=CLOSED pgs=561 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:30:02.597 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:02.594+0000 7f4c16646640 1 -- 172.21.15.19:0/1948652434 >> 172.21.15.19:0/1948652434 conn(0x7f4c100fd700 msgr2=0x7f4c100fe360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:30:02.597 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:02.594+0000 7f4c16646640 1 -- 172.21.15.19:0/1948652434 shutdown_connections 2024-09-10T22:30:02.597 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:02.594+0000 7f4c16646640 1 -- 172.21.15.19:0/1948652434 wait complete. 2024-09-10T22:30:02.625 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:30:02 smithi138 ceph-mon[35236]: pgmap v455: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 986 KiB/s rd, 387 MiB/s wr, 225 op/s 2024-09-10T22:30:02.859 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:30:02 smithi135 ceph-mon[34789]: pgmap v455: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 986 KiB/s rd, 387 MiB/s wr, 225 op/s 2024-09-10T22:30:03.486 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 22997a4c-6fc2-11ef-bcea-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-09-10T22:30:03.536 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:30:03 smithi019 ceph-mon[31375]: pgmap v456: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 575 KiB/s rd, 355 MiB/s wr, 206 op/s 2024-09-10T22:30:03.536 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:30:03 smithi019 ceph-mon[31375]: from='client.? 172.21.15.19:0/1948652434' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T22:30:03.610 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:30:03 smithi135 ceph-mon[34789]: pgmap v456: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 575 KiB/s rd, 355 MiB/s wr, 206 op/s 2024-09-10T22:30:03.610 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:30:03 smithi135 ceph-mon[34789]: from='client.? 172.21.15.19:0/1948652434' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T22:30:03.625 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:30:03 smithi138 ceph-mon[35236]: pgmap v456: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 575 KiB/s rd, 355 MiB/s wr, 206 op/s 2024-09-10T22:30:03.625 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:30:03 smithi138 ceph-mon[35236]: from='client.? 172.21.15.19:0/1948652434' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T22:30:03.900 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/22997a4c-6fc2-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T22:30:04.738 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:04.735+0000 7fda56846640 1 -- 172.21.15.19:0/1061529561 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fda501076a0 msgr2=0x7fda50107ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:30:04.738 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:04.735+0000 7fda56846640 1 --2- 172.21.15.19:0/1061529561 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fda501076a0 0x7fda50107ae0 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7fda44009900 tx=0x7fda4402a410 comp rx=0 tx=0).stop 2024-09-10T22:30:04.738 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:04.735+0000 7fda56846640 1 -- 172.21.15.19:0/1061529561 shutdown_connections 2024-09-10T22:30:04.738 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:04.735+0000 7fda56846640 1 --2- 172.21.15.19:0/1061529561 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fda50108020 0x7fda5010e820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:30:04.738 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:04.735+0000 7fda56846640 1 --2- 172.21.15.19:0/1061529561 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fda501076a0 0x7fda50107ae0 unknown :-1 s=CLOSED pgs=562 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:30:04.738 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:04.735+0000 7fda56846640 1 --2- 172.21.15.19:0/1061529561 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fda50101c90 0x7fda50102070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:30:04.739 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:04.735+0000 7fda56846640 1 -- 172.21.15.19:0/1061529561 >> 172.21.15.19:0/1061529561 conn(0x7fda500fd700 msgr2=0x7fda500ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:30:04.739 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:04.735+0000 7fda56846640 1 -- 172.21.15.19:0/1061529561 shutdown_connections 2024-09-10T22:30:04.739 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:04.735+0000 7fda56846640 1 -- 172.21.15.19:0/1061529561 wait complete. 2024-09-10T22:30:04.739 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:04.736+0000 7fda56846640 1 Processor -- start 2024-09-10T22:30:04.739 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:04.736+0000 7fda56846640 1 -- start start 2024-09-10T22:30:04.740 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:04.736+0000 7fda56846640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fda50101c90 0x7fda50199290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:30:04.740 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:04.736+0000 7fda56846640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fda501076a0 0x7fda501997d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:30:04.741 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:04.736+0000 7fda56846640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fda50108020 0x7fda5019eb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:30:04.741 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:04.736+0000 7fda56846640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fda50112d80 con 0x7fda501076a0 2024-09-10T22:30:04.741 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:04.736+0000 7fda56846640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fda50112c00 con 0x7fda50108020 2024-09-10T22:30:04.741 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:04.736+0000 7fda56846640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7fda50112f00 con 0x7fda50101c90 2024-09-10T22:30:04.741 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:04.736+0000 7fda54de3640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fda50108020 0x7fda5019eb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:30:04.741 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:04.736+0000 7fda4f7fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fda501076a0 0x7fda501997d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:30:04.741 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:04.736+0000 7fda54de3640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fda50108020 0x7fda5019eb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.19:42564/0 (socket says 172.21.15.19:42564) 2024-09-10T22:30:04.741 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:04.736+0000 7fda54de3640 1 -- 172.21.15.19:0/3658212007 learned_addr learned my addr 172.21.15.19:0/3658212007 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:30:04.741 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:04.737+0000 7fda4ffff640 1 --2- 172.21.15.19:0/3658212007 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fda50101c90 0x7fda50199290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:30:04.742 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:04.737+0000 7fda54de3640 1 -- 172.21.15.19:0/3658212007 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fda50101c90 msgr2=0x7fda50199290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:30:04.742 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:04.737+0000 7fda54de3640 1 --2- 172.21.15.19:0/3658212007 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fda50101c90 0x7fda50199290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:30:04.742 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:04.737+0000 7fda54de3640 1 -- 172.21.15.19:0/3658212007 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fda501076a0 msgr2=0x7fda501997d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:30:04.742 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:04.737+0000 7fda54de3640 1 --2- 172.21.15.19:0/3658212007 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fda501076a0 0x7fda501997d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:30:04.742 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:04.737+0000 7fda54de3640 1 -- 172.21.15.19:0/3658212007 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fda5019f340 con 0x7fda50108020 2024-09-10T22:30:04.742 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:04.737+0000 7fda4ffff640 1 --2- 172.21.15.19:0/3658212007 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fda50101c90 0x7fda50199290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T22:30:04.742 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:04.737+0000 7fda54de3640 1 --2- 172.21.15.19:0/3658212007 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fda50108020 0x7fda5019eb70 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fda4800eaa0 tx=0x7fda4800ef60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:30:04.742 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:04.737+0000 7fda4d7fa640 1 -- 172.21.15.19:0/3658212007 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda4800cdb0 con 0x7fda50108020 2024-09-10T22:30:04.742 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:04.737+0000 7fda4d7fa640 1 -- 172.21.15.19:0/3658212007 <== mon.2 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fda48005020 con 0x7fda50108020 2024-09-10T22:30:04.742 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:04.737+0000 7fda56846640 1 -- 172.21.15.19:0/3658212007 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fda5019f630 con 0x7fda50108020 2024-09-10T22:30:04.742 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:04.738+0000 7fda4d7fa640 1 -- 172.21.15.19:0/3658212007 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda480116d0 con 0x7fda50108020 2024-09-10T22:30:04.742 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:04.738+0000 7fda56846640 1 -- 172.21.15.19:0/3658212007 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fda501a5cf0 con 0x7fda50108020 2024-09-10T22:30:04.747 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:04.741+0000 7fda58c1b740 1 Processor -- start 2024-09-10T22:30:04.747 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:04.741+0000 7fda4d7fa640 1 -- 172.21.15.19:0/3658212007 <== mon.2 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 18) ==== 153250+0+0 (secure 0 0 0) 0x7fda4800f040 con 0x7fda50108020 2024-09-10T22:30:04.747 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:04.742+0000 7fda58c1b740 1 -- start start 2024-09-10T22:30:04.747 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:04.742+0000 7fda58c1b740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ab0381c4d0 0x55ab0381c8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:30:04.748 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:04.742+0000 7fda58c1b740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ab0381cdf0 0x55ab03828840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:30:04.748 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:04.742+0000 7fda58c1b740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55ab03828d80 0x55ab0382b170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:30:04.748 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:04.742+0000 7fda58c1b740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x55ab03792ea0 con 0x55ab0381cdf0 2024-09-10T22:30:04.748 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:04.742+0000 7fda58c1b740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55ab037822d0 con 0x55ab0381c4d0 2024-09-10T22:30:04.748 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:04.742+0000 7fda58c1b740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x55ab037860e0 con 0x55ab03828d80 2024-09-10T22:30:04.748 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:04.742+0000 7fda4f7fe640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ab0381c4d0 0x55ab0381c8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:30:04.748 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:04.742+0000 7fda4f7fe640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ab0381c4d0 0x55ab0381c8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.19:42578/0 (socket says 172.21.15.19:42578) 2024-09-10T22:30:04.748 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:04.742+0000 7fda4f7fe640 1 -- 172.21.15.19:0/126253907 learned_addr learned my addr 172.21.15.19:0/126253907 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:30:04.748 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:04.742+0000 7fda4f7fe640 1 --2- 172.21.15.19:0/126253907 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55ab03828d80 0x55ab0382b170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:30:04.748 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:04.742+0000 7fda4ffff640 1 --2- 172.21.15.19:0/126253907 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ab0381cdf0 0x55ab03828840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:30:04.748 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:04.743+0000 7fda4f7fe640 1 -- 172.21.15.19:0/126253907 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55ab03828d80 msgr2=0x55ab0382b170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:30:04.748 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:04.743+0000 7fda4f7fe640 1 --2- 172.21.15.19:0/126253907 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55ab03828d80 0x55ab0382b170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:30:04.748 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:04.743+0000 7fda4f7fe640 1 -- 172.21.15.19:0/126253907 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ab0381cdf0 msgr2=0x55ab03828840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:30:04.749 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:04.743+0000 7fda4f7fe640 1 --2- 172.21.15.19:0/126253907 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ab0381cdf0 0x55ab03828840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:30:04.749 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:04.743+0000 7fda4f7fe640 1 -- 172.21.15.19:0/126253907 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ab034e0650 con 0x55ab0381c4d0 2024-09-10T22:30:04.749 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:04.743+0000 7fda4ffff640 1 --2- 172.21.15.19:0/126253907 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ab0381cdf0 0x55ab03828840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T22:30:04.749 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:04.743+0000 7fda4f7fe640 1 --2- 172.21.15.19:0/126253907 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ab0381c4d0 0x55ab0381c8b0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fda44009230 tx=0x7fda44005780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=696d12f9ca3edd01 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:30:04.749 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:04.743+0000 7fda4d7fa640 1 --2- 172.21.15.19:0/3658212007 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7fda380b5360 0x7fda380b7820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:30:04.749 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:04.743+0000 7fda367fc640 1 -- 172.21.15.19:0/126253907 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda44035030 con 0x55ab0381c4d0 2024-09-10T22:30:04.749 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:04.743+0000 7fda4ffff640 1 --2- 172.21.15.19:0/3658212007 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7fda380b5360 0x7fda380b7820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:30:04.749 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:04.743+0000 7fda367fc640 1 -- 172.21.15.19:0/126253907 <== mon.2 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fda440314a0 con 0x55ab0381c4d0 2024-09-10T22:30:04.749 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:04.743+0000 7fda4d7fa640 1 -- 172.21.15.19:0/3658212007 <== mon.2 v2:172.21.15.135:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8327+0+0 (secure 0 0 0) 0x7fda480e5b40 con 0x7fda50108020 2024-09-10T22:30:04.749 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:04.743+0000 7fda367fc640 1 -- 172.21.15.19:0/126253907 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda4403d6b0 con 0x55ab0381c4d0 2024-09-10T22:30:04.749 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:04.744+0000 7fda58c1b740 1 -- 172.21.15.19:0/126253907 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ab0381c4d0 msgr2=0x55ab0381c8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:30:04.749 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:04.744+0000 7fda58c1b740 1 --2- 172.21.15.19:0/126253907 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ab0381c4d0 0x55ab0381c8b0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fda44009230 tx=0x7fda44005780 comp rx=0 tx=0).stop 2024-09-10T22:30:04.749 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:04.744+0000 7fda4ffff640 1 --2- 172.21.15.19:0/3658212007 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7fda380b5360 0x7fda380b7820 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x55ab0381b1e0 tx=0x7fda4000b7f0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:30:04.750 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:04.744+0000 7fda58c1b740 1 -- 172.21.15.19:0/126253907 shutdown_connections 2024-09-10T22:30:04.750 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:04.744+0000 7fda58c1b740 1 --2- 172.21.15.19:0/126253907 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55ab03828d80 0x55ab0382b170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:30:04.750 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:04.744+0000 7fda58c1b740 1 --2- 172.21.15.19:0/126253907 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ab0381cdf0 0x55ab03828840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:30:04.750 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:04.744+0000 7fda58c1b740 1 --2- 172.21.15.19:0/126253907 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ab0381c4d0 0x55ab0381c8b0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:30:04.750 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:04.744+0000 7fda58c1b740 1 -- 172.21.15.19:0/126253907 >> 172.21.15.19:0/126253907 conn(0x55ab0381a300 msgr2=0x55ab0381b4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:30:04.750 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:04.744+0000 7fda58c1b740 1 -- 172.21.15.19:0/126253907 shutdown_connections 2024-09-10T22:30:04.750 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:04.744+0000 7fda58c1b740 1 -- 172.21.15.19:0/126253907 wait complete. 2024-09-10T22:30:04.750 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:04.745+0000 7fda58c1b740 1 -- start start 2024-09-10T22:30:04.750 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:04.745+0000 7fda58c1b740 1 Processor -- start 2024-09-10T22:30:04.754 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:04.745+0000 7fda58c1b740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ab0381c4d0 0x55ab03828630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:30:04.754 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:04.745+0000 7fda58c1b740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ab0381cdf0 0x55ab03825a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:30:04.754 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:04.745+0000 7fda58c1b740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55ab03828d80 0x55ab03826040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:30:04.754 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:04.745+0000 7fda58c1b740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x55ab035e3700 con 0x55ab0381cdf0 2024-09-10T22:30:04.754 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:04.745+0000 7fda58c1b740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55ab0371d160 con 0x55ab0381c4d0 2024-09-10T22:30:04.754 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:04.745+0000 7fda58c1b740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x55ab0382fe50 con 0x55ab03828d80 2024-09-10T22:30:04.754 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:04.746+0000 7fda58c1b740 10 client.0 _ll_register_callbacks cb 0x55ab037369e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T22:30:04.754 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:04.746+0000 7fda54de3640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55ab03828d80 0x55ab03826040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:30:04.754 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:04.746+0000 7fda54de3640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55ab03828d80 0x55ab03826040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.19:50470/0 (socket says 172.21.15.19:50470) 2024-09-10T22:30:04.754 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:04.746+0000 7fda54de3640 1 -- 172.21.15.19:0/2693476157 learned_addr learned my addr 172.21.15.19:0/2693476157 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:30:04.755 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:04.746+0000 7fda4f7fe640 1 --2- 172.21.15.19:0/2693476157 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ab0381cdf0 0x55ab03825a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:30:04.755 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:04.746+0000 7fda4ffff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ab0381c4d0 0x55ab03828630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:30:04.755 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:04.746+0000 7fda54de3640 1 -- 172.21.15.19:0/2693476157 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ab0381c4d0 msgr2=0x55ab03828630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:30:04.755 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:04.746+0000 7fda54de3640 1 --2- 172.21.15.19:0/2693476157 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ab0381c4d0 0x55ab03828630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:30:04.755 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:04.746+0000 7fda54de3640 1 -- 172.21.15.19:0/2693476157 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ab0381cdf0 msgr2=0x55ab03825a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:30:04.755 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:04.746+0000 7fda54de3640 1 --2- 172.21.15.19:0/2693476157 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ab0381cdf0 0x55ab03825a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:30:04.755 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:04.746+0000 7fda54de3640 1 -- 172.21.15.19:0/2693476157 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ab0374ac90 con 0x55ab03828d80 2024-09-10T22:30:04.755 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:04.746+0000 7fda4f7fe640 1 --2- 172.21.15.19:0/2693476157 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ab0381cdf0 0x55ab03825a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T22:30:04.755 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:04.746+0000 7fda4ffff640 1 --2- 172.21.15.19:0/2693476157 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ab0381c4d0 0x55ab03828630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T22:30:04.755 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:04.747+0000 7fda54de3640 1 --2- 172.21.15.19:0/2693476157 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55ab03828d80 0x55ab03826040 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fda4800efd0 tx=0x7fda480ac130 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6c6521b1957b493d server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:30:04.755 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:04.747+0000 7fda2f7fe640 10 client.0 ms_handle_connect on v2:172.21.15.138:3300/0 2024-09-10T22:30:04.755 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:04.747+0000 7fda2f7fe640 1 -- 172.21.15.19:0/2693476157 <== mon.1 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda4801f040 con 0x55ab03828d80 2024-09-10T22:30:04.755 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:04.747+0000 7fda58c1b740 1 -- 172.21.15.19:0/2693476157 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fda440314a0 con 0x55ab03828d80 2024-09-10T22:30:04.756 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:04.747+0000 7fda2f7fe640 1 -- 172.21.15.19:0/2693476157 <== mon.1 v2:172.21.15.138:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8327+0+0 (secure 0 0 0) 0x7fda480cf070 con 0x55ab03828d80 2024-09-10T22:30:04.756 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:04.747+0000 7fda2f7fe640 1 -- 172.21.15.19:0/2693476157 <== mon.1 v2:172.21.15.138:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fda480cf290 con 0x55ab03828d80 2024-09-10T22:30:04.756 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:04.747+0000 7fda58c1b740 10 client.25540 fetch_fsmap learned FSMap version 27 2024-09-10T22:30:04.756 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:04.747+0000 7fda58c1b740 1 -- 172.21.15.19:0/2693476157 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55ab0383b790 con 0x55ab03828d80 2024-09-10T22:30:04.756 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:04.747+0000 7fda2f7fe640 1 -- 172.21.15.19:0/2693476157 <== mon.1 v2:172.21.15.138:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fda440314a0 con 0x55ab03828d80 2024-09-10T22:30:04.756 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:04.747+0000 7fda2f7fe640 1 -- 172.21.15.19:0/2693476157 <== mon.1 v2:172.21.15.138:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7fda480a7b90 con 0x55ab03828d80 2024-09-10T22:30:04.756 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:04.748+0000 7fda58c1b740 10 client.25540 fetch_fsmap finished waiting for FSMap version 27 2024-09-10T22:30:04.756 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:04.748+0000 7fda58c1b740 10 client.25540 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-10T22:30:04.756 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:04.748+0000 7fda58c1b740 20 client.25540 populate_metadata read hostname 'smithi019' 2024-09-10T22:30:04.756 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:04.748+0000 7fda58c1b740 1 --2- 172.21.15.19:0/2693476157 >> [v2:172.21.15.138:6836/3353290042,v1:172.21.15.138:6837/3353290042] conn(0x55ab0383cca0 0x55ab0383f0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:30:04.756 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:04.748+0000 7fda58c1b740 4 client.25540 mds_command: new command op to 24553 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T22:30:04.756 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:04.748+0000 7fda58c1b740 1 -- 172.21.15.19:0/2693476157 --> [v2:172.21.15.138:6836/3353290042,v1:172.21.15.138:6837/3353290042] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ab03794df0 con 0x55ab0383cca0 2024-09-10T22:30:04.756 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:04.748+0000 7fda4ffff640 1 --2- 172.21.15.19:0/2693476157 >> [v2:172.21.15.138:6836/3353290042,v1:172.21.15.138:6837/3353290042] conn(0x55ab0383cca0 0x55ab0383f0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:30:04.757 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:04.748+0000 7fda2f7fe640 10 client.25540 ms_handle_connect on v2:172.21.15.138:6836/3353290042 2024-09-10T22:30:04.757 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:04.749+0000 7fda4ffff640 1 --2- 172.21.15.19:0/2693476157 >> [v2:172.21.15.138:6836/3353290042,v1:172.21.15.138:6837/3353290042] conn(0x55ab0383cca0 0x55ab0383f0b0 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=dab2019f4e4c876c server_cookie=934fcdc16b5de115 in_seq=0 out_seq=0 2024-09-10T22:30:04.757 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:04.749+0000 7fda2f7fe640 1 -- 172.21.15.19:0/2693476157 <== mds.2 v2:172.21.15.138:6836/3353290042 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55ab03794df0 con 0x55ab0383cca0 2024-09-10T22:30:04.757 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:04.749+0000 7fda2f7fe640 10 client.25540 handle_command_reply: tid=0 2024-09-10T22:30:04.757 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:04.749+0000 7fda58c1b740 1 client.25540 shutdown 2024-09-10T22:30:04.757 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:04.750+0000 7fda58c1b740 1 -- 172.21.15.19:0/2693476157 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55ab03828d80 msgr2=0x55ab03826040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:30:04.757 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:04.750+0000 7fda58c1b740 1 --2- 172.21.15.19:0/2693476157 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55ab03828d80 0x55ab03826040 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fda4800efd0 tx=0x7fda480ac130 comp rx=0 tx=0).stop 2024-09-10T22:30:04.757 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:04.750+0000 7fda58c1b740 1 -- 172.21.15.19:0/2693476157 shutdown_connections 2024-09-10T22:30:04.757 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:04.750+0000 7fda58c1b740 1 --2- 172.21.15.19:0/2693476157 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55ab03828d80 0x55ab03826040 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:30:04.757 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:04.750+0000 7fda58c1b740 1 --2- 172.21.15.19:0/2693476157 >> [v2:172.21.15.138:6836/3353290042,v1:172.21.15.138:6837/3353290042] conn(0x55ab0383cca0 0x55ab0383f0b0 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:30:04.757 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:04.750+0000 7fda2f7fe640 0 client.25540 ms_handle_reset on v2:172.21.15.138:6836/3353290042 2024-09-10T22:30:04.757 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:04.750+0000 7fda58c1b740 1 --2- 172.21.15.19:0/2693476157 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ab0381cdf0 0x55ab03825a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:30:04.757 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:04.750+0000 7fda58c1b740 1 --2- 172.21.15.19:0/2693476157 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ab0381c4d0 0x55ab03828630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:30:04.758 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:04.750+0000 7fda58c1b740 1 -- 172.21.15.19:0/2693476157 >> 172.21.15.19:0/2693476157 conn(0x55ab0381a300 msgr2=0x55ab0381fea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:30:04.758 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:04.750+0000 7fda58c1b740 1 -- 172.21.15.19:0/2693476157 shutdown_connections 2024-09-10T22:30:04.758 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:04.750+0000 7fda58c1b740 1 -- 172.21.15.19:0/2693476157 wait complete. 2024-09-10T22:30:04.758 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:04.750+0000 7fda58c1b740 20 client.25540 trim_cache size 0 max 16384 2024-09-10T22:30:04.784 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:04.781+0000 7fda58c1b740 1 Processor -- start 2024-09-10T22:30:04.785 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:04.781+0000 7fda58c1b740 1 -- start start 2024-09-10T22:30:04.785 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:04.782+0000 7fda58c1b740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ab0381c4d0 0x55ab03839080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:30:04.785 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:04.782+0000 7fda58c1b740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ab0381cdf0 0x55ab03822c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:30:04.785 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:04.782+0000 7fda58c1b740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55ab03828d80 0x55ab038231d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:30:04.785 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:04.782+0000 7fda58c1b740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fda501aebf0 con 0x55ab0381cdf0 2024-09-10T22:30:04.785 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:04.782+0000 7fda58c1b740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fda501ac4c0 con 0x55ab0381c4d0 2024-09-10T22:30:04.785 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:04.782+0000 7fda58c1b740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7fda501aa310 con 0x55ab03828d80 2024-09-10T22:30:04.785 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:04.782+0000 7fda4f7fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ab0381cdf0 0x55ab03822c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:30:04.785 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:04.782+0000 7fda4f7fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ab0381cdf0 0x55ab03822c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:50432/0 (socket says 172.21.15.19:50432) 2024-09-10T22:30:04.785 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:04.782+0000 7fda4f7fe640 1 -- 172.21.15.19:0/1934867667 learned_addr learned my addr 172.21.15.19:0/1934867667 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:30:04.787 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:04.782+0000 7fda4ffff640 1 --2- 172.21.15.19:0/1934867667 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ab0381c4d0 0x55ab03839080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:30:04.787 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:04.783+0000 7fda4f7fe640 1 -- 172.21.15.19:0/1934867667 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55ab03828d80 msgr2=0x55ab038231d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:30:04.787 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:04.783+0000 7fda4f7fe640 1 --2- 172.21.15.19:0/1934867667 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55ab03828d80 0x55ab038231d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:30:04.787 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:04.783+0000 7fda4f7fe640 1 -- 172.21.15.19:0/1934867667 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ab0381c4d0 msgr2=0x55ab03839080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:30:04.787 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:04.783+0000 7fda4f7fe640 1 --2- 172.21.15.19:0/1934867667 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ab0381c4d0 0x55ab03839080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:30:04.787 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:04.783+0000 7fda4f7fe640 1 -- 172.21.15.19:0/1934867667 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ab03820780 con 0x55ab0381cdf0 2024-09-10T22:30:04.787 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:04.783+0000 7fda4ffff640 1 --2- 172.21.15.19:0/1934867667 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ab0381c4d0 0x55ab03839080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T22:30:04.787 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:04.783+0000 7fda4f7fe640 1 --2- 172.21.15.19:0/1934867667 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ab0381cdf0 0x55ab03822c90 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7fda44033000 tx=0x7fda44031e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=92d9d0b068c306b2 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:30:04.787 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:04.783+0000 7fda35ffb640 1 -- 172.21.15.19:0/1934867667 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda44035040 con 0x55ab0381cdf0 2024-09-10T22:30:04.787 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:04.783+0000 7fda35ffb640 1 -- 172.21.15.19:0/1934867667 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fda440044a0 con 0x55ab0381cdf0 2024-09-10T22:30:04.788 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:04.783+0000 7fda35ffb640 1 -- 172.21.15.19:0/1934867667 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda44031b60 con 0x55ab0381cdf0 2024-09-10T22:30:04.788 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:04.784+0000 7fda58c1b740 1 -- 172.21.15.19:0/1934867667 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ab0381cdf0 msgr2=0x55ab03822c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:30:04.788 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:04.784+0000 7fda58c1b740 1 --2- 172.21.15.19:0/1934867667 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ab0381cdf0 0x55ab03822c90 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7fda44033000 tx=0x7fda44031e00 comp rx=0 tx=0).stop 2024-09-10T22:30:04.788 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:04.784+0000 7fda58c1b740 1 -- 172.21.15.19:0/1934867667 shutdown_connections 2024-09-10T22:30:04.788 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:04.784+0000 7fda58c1b740 1 --2- 172.21.15.19:0/1934867667 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55ab03828d80 0x55ab038231d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:30:04.788 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:04.784+0000 7fda58c1b740 1 --2- 172.21.15.19:0/1934867667 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ab0381cdf0 0x55ab03822c90 unknown :-1 s=CLOSED pgs=563 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:30:04.788 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:04.784+0000 7fda58c1b740 1 --2- 172.21.15.19:0/1934867667 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ab0381c4d0 0x55ab03839080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:30:04.788 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:04.784+0000 7fda58c1b740 1 -- 172.21.15.19:0/1934867667 >> 172.21.15.19:0/1934867667 conn(0x55ab0381a300 msgr2=0x55ab03820cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:30:04.788 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:04.784+0000 7fda58c1b740 1 -- 172.21.15.19:0/1934867667 shutdown_connections 2024-09-10T22:30:04.788 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:04.785+0000 7fda58c1b740 1 -- 172.21.15.19:0/1934867667 wait complete. 2024-09-10T22:30:04.792 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:04.785+0000 7fda58c1b740 1 -- start start 2024-09-10T22:30:04.792 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:04.785+0000 7fda58c1b740 1 Processor -- start 2024-09-10T22:30:04.792 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:04.786+0000 7fda58c1b740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ab0381c4d0 0x55ab038311d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:30:04.792 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:04.786+0000 7fda58c1b740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ab0381cdf0 0x55ab03831710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:30:04.792 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:04.786+0000 7fda58c1b740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55ab03828d80 0x55ab03831c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:30:04.792 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:04.786+0000 7fda58c1b740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fda501aa980 con 0x55ab0381cdf0 2024-09-10T22:30:04.793 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:04.786+0000 7fda4f7fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ab0381cdf0 0x55ab03831710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:30:04.793 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:04.786+0000 7fda4ffff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ab0381c4d0 0x55ab038311d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:30:04.793 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:04.786+0000 7fda4ffff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ab0381c4d0 0x55ab038311d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.19:42602/0 (socket says 172.21.15.19:42602) 2024-09-10T22:30:04.793 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:04.786+0000 7fda4ffff640 1 -- 172.21.15.19:0/1374785753 learned_addr learned my addr 172.21.15.19:0/1374785753 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:30:04.793 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:04.786+0000 7fda54de3640 1 --2- 172.21.15.19:0/1374785753 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55ab03828d80 0x55ab03831c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:30:04.793 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:04.786+0000 7fda58c1b740 1 -- 172.21.15.19:0/1374785753 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fda501abdf0 con 0x55ab0381c4d0 2024-09-10T22:30:04.793 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:04.786+0000 7fda58c1b740 1 -- 172.21.15.19:0/1374785753 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7fda501ab050 con 0x55ab03828d80 2024-09-10T22:30:04.793 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:04.787+0000 7fda58c1b740 10 client.0 _ll_register_callbacks cb 0x7fda48009270 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T22:30:04.793 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:04.787+0000 7fda4f7fe640 1 -- 172.21.15.19:0/1374785753 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55ab03828d80 msgr2=0x55ab03831c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:30:04.793 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:04.787+0000 7fda4f7fe640 1 --2- 172.21.15.19:0/1374785753 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55ab03828d80 0x55ab03831c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:30:04.793 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:04.787+0000 7fda4f7fe640 1 -- 172.21.15.19:0/1374785753 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ab0381c4d0 msgr2=0x55ab038311d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:30:04.793 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:04.787+0000 7fda4f7fe640 1 --2- 172.21.15.19:0/1374785753 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ab0381c4d0 0x55ab038311d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:30:04.793 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:04.787+0000 7fda4f7fe640 1 -- 172.21.15.19:0/1374785753 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ab038a8d80 con 0x55ab0381cdf0 2024-09-10T22:30:04.794 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:04.787+0000 7fda54de3640 1 --2- 172.21.15.19:0/1374785753 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55ab03828d80 0x55ab03831c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T22:30:04.794 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:04.787+0000 7fda4f7fe640 1 --2- 172.21.15.19:0/1374785753 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ab0381cdf0 0x55ab03831710 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7fda4402aa00 tx=0x7fda44031a10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6a43d77a6ee1ae28 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:30:04.794 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:04.787+0000 7fda2f7fe640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-10T22:30:04.794 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:04.788+0000 7fda2f7fe640 1 -- 172.21.15.19:0/1374785753 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda44035070 con 0x55ab0381cdf0 2024-09-10T22:30:04.794 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:04.788+0000 7fda2f7fe640 1 -- 172.21.15.19:0/1374785753 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8327+0+0 (secure 0 0 0) 0x7fda44005040 con 0x55ab0381cdf0 2024-09-10T22:30:04.794 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:04.788+0000 7fda58c1b740 1 -- 172.21.15.19:0/1374785753 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fda440044a0 con 0x55ab0381cdf0 2024-09-10T22:30:04.794 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:04.788+0000 7fda2f7fe640 1 -- 172.21.15.19:0/1374785753 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fda44005240 con 0x55ab0381cdf0 2024-09-10T22:30:04.794 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:04.788+0000 7fda58c1b740 10 client.16071 fetch_fsmap learned FSMap version 27 2024-09-10T22:30:04.794 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:04.789+0000 7fda58c1b740 1 -- 172.21.15.19:0/1374785753 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55ab038a9f90 con 0x55ab0381cdf0 2024-09-10T22:30:04.794 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:04.789+0000 7fda2f7fe640 1 -- 172.21.15.19:0/1374785753 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fda440044a0 con 0x55ab0381cdf0 2024-09-10T22:30:04.794 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:04.789+0000 7fda2f7fe640 1 -- 172.21.15.19:0/1374785753 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7fda440038c0 con 0x55ab0381cdf0 2024-09-10T22:30:04.794 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:04.789+0000 7fda58c1b740 10 client.16071 fetch_fsmap finished waiting for FSMap version 27 2024-09-10T22:30:04.795 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:04.789+0000 7fda58c1b740 10 client.16071 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-10T22:30:04.795 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:04.789+0000 7fda58c1b740 20 client.16071 populate_metadata read hostname 'smithi019' 2024-09-10T22:30:04.795 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:04.789+0000 7fda58c1b740 1 --2- 172.21.15.19:0/1374785753 >> [v2:172.21.15.138:6836/3353290042,v1:172.21.15.138:6837/3353290042] conn(0x55ab0383cca0 0x55ab038ac170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:30:04.795 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:04.789+0000 7fda58c1b740 4 client.16071 mds_command: new command op to 24553 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-10T22:30:04.795 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:04.789+0000 7fda58c1b740 1 -- 172.21.15.19:0/1374785753 --> [v2:172.21.15.138:6836/3353290042,v1:172.21.15.138:6837/3353290042] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55ab037908a0 con 0x55ab0383cca0 2024-09-10T22:30:04.795 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:04.790+0000 7fda4ffff640 1 --2- 172.21.15.19:0/1374785753 >> [v2:172.21.15.138:6836/3353290042,v1:172.21.15.138:6837/3353290042] conn(0x55ab0383cca0 0x55ab038ac170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:30:04.797 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:04.790+0000 7fda4ffff640 1 --2- 172.21.15.19:0/1374785753 >> [v2:172.21.15.138:6836/3353290042,v1:172.21.15.138:6837/3353290042] conn(0x55ab0383cca0 0x55ab038ac170 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=ce49d6556a09194e server_cookie=e408054f850cf385 in_seq=0 out_seq=0 2024-09-10T22:30:04.797 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:04.790+0000 7fda2f7fe640 10 client.16071 ms_handle_connect on v2:172.21.15.138:6836/3353290042 2024-09-10T22:30:04.797 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:04.790+0000 7fda2f7fe640 1 -- 172.21.15.19:0/1374785753 <== mds.2 v2:172.21.15.138:6836/3353290042 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55ab037908a0 con 0x55ab0383cca0 2024-09-10T22:30:04.797 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:04.790+0000 7fda2f7fe640 10 client.16071 handle_command_reply: tid=0 2024-09-10T22:30:04.797 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:04.790+0000 7fda58c1b740 1 client.16071 shutdown 2024-09-10T22:30:04.797 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:04.791+0000 7fda58c1b740 1 -- 172.21.15.19:0/1374785753 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ab0381cdf0 msgr2=0x55ab03831710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:30:04.797 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:04.791+0000 7fda58c1b740 1 --2- 172.21.15.19:0/1374785753 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ab0381cdf0 0x55ab03831710 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7fda4402aa00 tx=0x7fda44031a10 comp rx=0 tx=0).stop 2024-09-10T22:30:04.797 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:04.791+0000 7fda58c1b740 1 -- 172.21.15.19:0/1374785753 shutdown_connections 2024-09-10T22:30:04.797 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:04.791+0000 7fda58c1b740 1 --2- 172.21.15.19:0/1374785753 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55ab03828d80 0x55ab03831c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:30:04.798 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:04.791+0000 7fda58c1b740 1 --2- 172.21.15.19:0/1374785753 >> [v2:172.21.15.138:6836/3353290042,v1:172.21.15.138:6837/3353290042] conn(0x55ab0383cca0 0x55ab038ac170 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:30:04.798 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:04.791+0000 7fda58c1b740 1 --2- 172.21.15.19:0/1374785753 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ab0381cdf0 0x55ab03831710 unknown :-1 s=CLOSED pgs=564 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:30:04.798 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:04.791+0000 7fda2f7fe640 0 client.16071 ms_handle_reset on v2:172.21.15.138:6836/3353290042 2024-09-10T22:30:04.798 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:04.792+0000 7fda58c1b740 1 --2- 172.21.15.19:0/1374785753 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ab0381c4d0 0x55ab038311d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:30:04.798 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:04.792+0000 7fda58c1b740 1 -- 172.21.15.19:0/1374785753 >> 172.21.15.19:0/1374785753 conn(0x55ab0381a300 msgr2=0x55ab038270b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:30:04.798 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:04.792+0000 7fda58c1b740 1 -- 172.21.15.19:0/1374785753 shutdown_connections 2024-09-10T22:30:04.798 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:04.792+0000 7fda58c1b740 1 -- 172.21.15.19:0/1374785753 wait complete. 2024-09-10T22:30:04.798 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:04.794+0000 7fda58c1b740 20 client.16071 trim_cache size 0 max 16384 2024-09-10T22:30:04.798 INFO:teuthology.orchestra.run.smithi019.stdout:[] 2024-09-10T22:30:04.799 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:04.796+0000 7fda56846640 1 -- 172.21.15.19:0/3658212007 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7fda380b5360 msgr2=0x7fda380b7820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:30:04.799 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:04.796+0000 7fda56846640 1 --2- 172.21.15.19:0/3658212007 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7fda380b5360 0x7fda380b7820 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x55ab0381b1e0 tx=0x7fda4000b7f0 comp rx=0 tx=0).stop 2024-09-10T22:30:04.799 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:04.796+0000 7fda56846640 1 -- 172.21.15.19:0/3658212007 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fda50108020 msgr2=0x7fda5019eb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:30:04.799 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:04.796+0000 7fda56846640 1 --2- 172.21.15.19:0/3658212007 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fda50108020 0x7fda5019eb70 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fda4800eaa0 tx=0x7fda4800ef60 comp rx=0 tx=0).stop 2024-09-10T22:30:04.800 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:04.796+0000 7fda56846640 1 -- 172.21.15.19:0/3658212007 shutdown_connections 2024-09-10T22:30:04.800 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:04.796+0000 7fda56846640 1 --2- 172.21.15.19:0/3658212007 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7fda380b5360 0x7fda380b7820 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:30:04.800 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:04.796+0000 7fda56846640 1 --2- 172.21.15.19:0/3658212007 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fda50108020 0x7fda5019eb70 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:30:04.800 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:04.796+0000 7fda56846640 1 --2- 172.21.15.19:0/3658212007 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fda501076a0 0x7fda501997d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:30:04.800 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:04.796+0000 7fda56846640 1 --2- 172.21.15.19:0/3658212007 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fda50101c90 0x7fda50199290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:30:04.800 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:04.796+0000 7fda56846640 1 -- 172.21.15.19:0/3658212007 >> 172.21.15.19:0/3658212007 conn(0x7fda500fd700 msgr2=0x7fda500ffaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:30:04.800 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:04.796+0000 7fda56846640 1 -- 172.21.15.19:0/3658212007 shutdown_connections 2024-09-10T22:30:04.800 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:04.796+0000 7fda56846640 1 -- 172.21.15.19:0/3658212007 wait complete. 2024-09-10T22:30:05.811 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 22997a4c-6fc2-11ef-bcea-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-09-10T22:30:05.836 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:30:05 smithi019 ceph-mon[31375]: pgmap v457: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 731 KiB/s rd, 351 MiB/s wr, 204 op/s 2024-09-10T22:30:05.859 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:30:05 smithi135 ceph-mon[34789]: pgmap v457: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 731 KiB/s rd, 351 MiB/s wr, 204 op/s 2024-09-10T22:30:05.875 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:30:05 smithi138 ceph-mon[35236]: pgmap v457: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 731 KiB/s rd, 351 MiB/s wr, 204 op/s 2024-09-10T22:30:06.352 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/22997a4c-6fc2-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T22:30:07.020 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:07.018+0000 7feb28cfa640 1 -- 172.21.15.19:0/2105424652 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7feb24101c90 msgr2=0x7feb24102070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:30:07.021 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:07.018+0000 7feb28cfa640 1 --2- 172.21.15.19:0/2105424652 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7feb24101c90 0x7feb24102070 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7feb14009900 tx=0x7feb1402a410 comp rx=0 tx=0).stop 2024-09-10T22:30:07.021 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:07.019+0000 7feb28cfa640 1 -- 172.21.15.19:0/2105424652 shutdown_connections 2024-09-10T22:30:07.021 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:07.019+0000 7feb28cfa640 1 --2- 172.21.15.19:0/2105424652 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7feb24108020 0x7feb2410e820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:30:07.021 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:07.019+0000 7feb28cfa640 1 --2- 172.21.15.19:0/2105424652 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7feb241076a0 0x7feb24107ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:30:07.021 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:07.019+0000 7feb28cfa640 1 --2- 172.21.15.19:0/2105424652 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7feb24101c90 0x7feb24102070 unknown :-1 s=CLOSED pgs=565 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:30:07.021 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:07.019+0000 7feb28cfa640 1 -- 172.21.15.19:0/2105424652 >> 172.21.15.19:0/2105424652 conn(0x7feb240fd700 msgr2=0x7feb240ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:30:07.021 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:07.019+0000 7feb28cfa640 1 -- 172.21.15.19:0/2105424652 shutdown_connections 2024-09-10T22:30:07.021 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:07.019+0000 7feb28cfa640 1 -- 172.21.15.19:0/2105424652 wait complete. 2024-09-10T22:30:07.023 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:07.020+0000 7feb28cfa640 1 Processor -- start 2024-09-10T22:30:07.023 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:07.020+0000 7feb28cfa640 1 -- start start 2024-09-10T22:30:07.023 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:07.020+0000 7feb28cfa640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7feb24101c90 0x7feb241992b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:30:07.023 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:07.020+0000 7feb28cfa640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7feb241076a0 0x7feb241997f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:30:07.023 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:07.020+0000 7feb28cfa640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7feb24108020 0x7feb2419eb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:30:07.023 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:07.020+0000 7feb28cfa640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7feb24111d30 con 0x7feb24108020 2024-09-10T22:30:07.023 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:07.020+0000 7feb28cfa640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7feb24111bb0 con 0x7feb24101c90 2024-09-10T22:30:07.023 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:07.020+0000 7feb28cfa640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7feb24111eb0 con 0x7feb241076a0 2024-09-10T22:30:07.023 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:07.020+0000 7feb2259c640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7feb24101c90 0x7feb241992b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:30:07.023 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:07.020+0000 7feb2259c640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7feb24101c90 0x7feb241992b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.19:42620/0 (socket says 172.21.15.19:42620) 2024-09-10T22:30:07.023 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:07.020+0000 7feb2259c640 1 -- 172.21.15.19:0/2572139685 learned_addr learned my addr 172.21.15.19:0/2572139685 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:30:07.024 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:07.020+0000 7feb21d9b640 1 --2- 172.21.15.19:0/2572139685 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7feb241076a0 0x7feb241997f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:30:07.024 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:07.021+0000 7feb22d9d640 1 --2- 172.21.15.19:0/2572139685 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7feb24108020 0x7feb2419eb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:30:07.024 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:07.021+0000 7feb2259c640 1 -- 172.21.15.19:0/2572139685 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7feb241076a0 msgr2=0x7feb241997f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:30:07.024 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:07.021+0000 7feb2259c640 1 --2- 172.21.15.19:0/2572139685 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7feb241076a0 0x7feb241997f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:30:07.024 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:07.021+0000 7feb2259c640 1 -- 172.21.15.19:0/2572139685 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7feb24108020 msgr2=0x7feb2419eb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:30:07.024 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:07.021+0000 7feb2259c640 1 --2- 172.21.15.19:0/2572139685 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7feb24108020 0x7feb2419eb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:30:07.024 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:07.021+0000 7feb2259c640 1 -- 172.21.15.19:0/2572139685 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feb2419f360 con 0x7feb24101c90 2024-09-10T22:30:07.024 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:07.021+0000 7feb22d9d640 1 --2- 172.21.15.19:0/2572139685 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7feb24108020 0x7feb2419eb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T22:30:07.024 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:07.021+0000 7feb2259c640 1 --2- 172.21.15.19:0/2572139685 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7feb24101c90 0x7feb241992b0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7feb14005ab0 tx=0x7feb14003c10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:30:07.024 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:07.021+0000 7feb137fe640 1 -- 172.21.15.19:0/2572139685 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb1403f070 con 0x7feb24101c90 2024-09-10T22:30:07.024 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:07.021+0000 7feb137fe640 1 -- 172.21.15.19:0/2572139685 <== mon.2 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7feb14031b60 con 0x7feb24101c90 2024-09-10T22:30:07.024 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:07.021+0000 7feb28cfa640 1 -- 172.21.15.19:0/2572139685 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feb2419f5f0 con 0x7feb24101c90 2024-09-10T22:30:07.024 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:07.021+0000 7feb137fe640 1 -- 172.21.15.19:0/2572139685 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb14035030 con 0x7feb24101c90 2024-09-10T22:30:07.025 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:07.021+0000 7feb28cfa640 1 -- 172.21.15.19:0/2572139685 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feb241a5d10 con 0x7feb24101c90 2024-09-10T22:30:07.025 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:07.024+0000 7feb137fe640 1 -- 172.21.15.19:0/2572139685 <== mon.2 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 18) ==== 153250+0+0 (secure 0 0 0) 0x7feb1403b460 con 0x7feb24101c90 2024-09-10T22:30:07.025 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:07.024+0000 7feb2b0cf740 1 Processor -- start 2024-09-10T22:30:07.027 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:07.024+0000 7feb2b0cf740 1 -- start start 2024-09-10T22:30:07.027 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:07.025+0000 7feb2b0cf740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55934388f4d0 0x55934388f8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:30:07.028 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:07.025+0000 7feb2b0cf740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55934388fdf0 0x55934389b840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:30:07.028 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:07.025+0000 7feb2b0cf740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55934389bd80 0x55934389e170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:30:07.028 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:07.025+0000 7feb2b0cf740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x559343805ea0 con 0x55934389bd80 2024-09-10T22:30:07.028 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:07.025+0000 7feb2b0cf740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x5593437f52d0 con 0x55934388fdf0 2024-09-10T22:30:07.028 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:07.025+0000 7feb2b0cf740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x5593437f90e0 con 0x55934388f4d0 2024-09-10T22:30:07.028 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:07.025+0000 7feb2259c640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55934388fdf0 0x55934389b840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:30:07.028 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:07.025+0000 7feb22d9d640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55934388f4d0 0x55934388f8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:30:07.028 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:07.025+0000 7feb22d9d640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55934388f4d0 0x55934388f8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.19:50514/0 (socket says 172.21.15.19:50514) 2024-09-10T22:30:07.028 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:07.025+0000 7feb22d9d640 1 -- 172.21.15.19:0/2052206053 learned_addr learned my addr 172.21.15.19:0/2052206053 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:30:07.028 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:07.025+0000 7feb21d9b640 1 --2- 172.21.15.19:0/2052206053 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55934389bd80 0x55934389e170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:30:07.028 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:07.025+0000 7feb2259c640 1 -- 172.21.15.19:0/2052206053 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55934388f4d0 msgr2=0x55934388f8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:30:07.028 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:07.025+0000 7feb2259c640 1 --2- 172.21.15.19:0/2052206053 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55934388f4d0 0x55934388f8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:30:07.029 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:07.025+0000 7feb2259c640 1 -- 172.21.15.19:0/2052206053 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55934389bd80 msgr2=0x55934389e170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:30:07.029 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:07.025+0000 7feb2259c640 1 --2- 172.21.15.19:0/2052206053 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55934389bd80 0x55934389e170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:30:07.029 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:07.025+0000 7feb2259c640 1 -- 172.21.15.19:0/2052206053 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559343553650 con 0x55934388fdf0 2024-09-10T22:30:07.029 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:07.026+0000 7feb137fe640 1 --2- 172.21.15.19:0/2572139685 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7feb0c0b5360 0x7feb0c0b7820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:30:07.029 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:07.026+0000 7feb2259c640 1 --2- 172.21.15.19:0/2052206053 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55934388fdf0 0x55934389b840 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7feb14104050 tx=0x7feb1410c810 comp rx=0 tx=0).ready entity=mon.2 client_cookie=740f7eacfa4ee44d server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:30:07.029 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:07.026+0000 7feb22d9d640 1 --2- 172.21.15.19:0/2572139685 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7feb0c0b5360 0x7feb0c0b7820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:30:07.029 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:07.026+0000 7feb10ff9640 1 -- 172.21.15.19:0/2052206053 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb140c9390 con 0x55934388fdf0 2024-09-10T22:30:07.029 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:07.026+0000 7feb10ff9640 1 -- 172.21.15.19:0/2052206053 <== mon.2 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7feb140cc850 con 0x55934388fdf0 2024-09-10T22:30:07.029 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:07.026+0000 7feb137fe640 1 -- 172.21.15.19:0/2572139685 <== mon.2 v2:172.21.15.135:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8327+0+0 (secure 0 0 0) 0x7feb141065e0 con 0x7feb24101c90 2024-09-10T22:30:07.029 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:07.026+0000 7feb10ff9640 1 -- 172.21.15.19:0/2052206053 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb14043b50 con 0x55934388fdf0 2024-09-10T22:30:07.033 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:07.027+0000 7feb2b0cf740 1 -- 172.21.15.19:0/2052206053 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55934388fdf0 msgr2=0x55934389b840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:30:07.033 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:07.027+0000 7feb2b0cf740 1 --2- 172.21.15.19:0/2052206053 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55934388fdf0 0x55934389b840 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7feb14104050 tx=0x7feb1410c810 comp rx=0 tx=0).stop 2024-09-10T22:30:07.033 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:07.027+0000 7feb22d9d640 1 --2- 172.21.15.19:0/2572139685 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7feb0c0b5360 0x7feb0c0b7820 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7feb1c012640 tx=0x7feb1c009500 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:30:07.033 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:07.027+0000 7feb2b0cf740 1 -- 172.21.15.19:0/2052206053 shutdown_connections 2024-09-10T22:30:07.034 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:07.027+0000 7feb2b0cf740 1 --2- 172.21.15.19:0/2052206053 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55934389bd80 0x55934389e170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:30:07.034 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:07.027+0000 7feb2b0cf740 1 --2- 172.21.15.19:0/2052206053 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55934388fdf0 0x55934389b840 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:30:07.034 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:07.027+0000 7feb2b0cf740 1 --2- 172.21.15.19:0/2052206053 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55934388f4d0 0x55934388f8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:30:07.034 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:07.027+0000 7feb2b0cf740 1 -- 172.21.15.19:0/2052206053 >> 172.21.15.19:0/2052206053 conn(0x55934388d300 msgr2=0x55934388e4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:30:07.034 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:07.027+0000 7feb2b0cf740 1 -- 172.21.15.19:0/2052206053 shutdown_connections 2024-09-10T22:30:07.034 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:07.027+0000 7feb2b0cf740 1 -- 172.21.15.19:0/2052206053 wait complete. 2024-09-10T22:30:07.034 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:07.027+0000 7feb2b0cf740 1 -- start start 2024-09-10T22:30:07.034 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:07.028+0000 7feb2b0cf740 1 Processor -- start 2024-09-10T22:30:07.034 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:07.028+0000 7feb2b0cf740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55934388f4d0 0x55934389b7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:30:07.034 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:07.028+0000 7feb2b0cf740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55934389bd80 0x559343898bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:30:07.034 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:07.028+0000 7feb2b0cf740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5593438992e0 0x5593438abe80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:30:07.034 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:07.028+0000 7feb2b0cf740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x559343656700 con 0x55934389bd80 2024-09-10T22:30:07.034 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:07.028+0000 7feb2b0cf740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x559343790160 con 0x55934388f4d0 2024-09-10T22:30:07.035 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:07.028+0000 7feb2b0cf740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x5593438a2bd0 con 0x5593438992e0 2024-09-10T22:30:07.035 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:07.028+0000 7feb2b0cf740 10 client.0 _ll_register_callbacks cb 0x5593437a99e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T22:30:07.035 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:07.028+0000 7feb21d9b640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55934389bd80 0x559343898bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:30:07.035 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:07.028+0000 7feb21d9b640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55934389bd80 0x559343898bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:50478/0 (socket says 172.21.15.19:50478) 2024-09-10T22:30:07.035 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:07.028+0000 7feb21d9b640 1 -- 172.21.15.19:0/2907758368 learned_addr learned my addr 172.21.15.19:0/2907758368 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:30:07.035 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:07.028+0000 7feb2259c640 1 --2- 172.21.15.19:0/2907758368 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55934388f4d0 0x55934389b7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:30:07.035 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:07.028+0000 7feb22d9d640 1 --2- 172.21.15.19:0/2907758368 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5593438992e0 0x5593438abe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:30:07.035 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:07.028+0000 7feb21d9b640 1 -- 172.21.15.19:0/2907758368 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5593438992e0 msgr2=0x5593438abe80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:30:07.035 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:07.028+0000 7feb21d9b640 1 --2- 172.21.15.19:0/2907758368 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5593438992e0 0x5593438abe80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:30:07.035 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:07.028+0000 7feb21d9b640 1 -- 172.21.15.19:0/2907758368 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55934388f4d0 msgr2=0x55934389b7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:30:07.035 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:07.029+0000 7feb21d9b640 1 --2- 172.21.15.19:0/2907758368 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55934388f4d0 0x55934389b7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:30:07.035 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:07.029+0000 7feb21d9b640 1 -- 172.21.15.19:0/2907758368 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5593437bdc90 con 0x55934389bd80 2024-09-10T22:30:07.035 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:07.029+0000 7feb22d9d640 1 --2- 172.21.15.19:0/2907758368 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5593438992e0 0x5593438abe80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T22:30:07.035 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:07.029+0000 7feb2259c640 1 --2- 172.21.15.19:0/2907758368 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55934388f4d0 0x55934389b7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T22:30:07.036 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:07.029+0000 7feb21d9b640 1 --2- 172.21.15.19:0/2907758368 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55934389bd80 0x559343898bf0 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7feb180126d0 tx=0x7feb18012b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4c87e56b29af6707 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:30:07.036 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:07.029+0000 7feb09ffb640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-10T22:30:07.036 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:07.029+0000 7feb09ffb640 1 -- 172.21.15.19:0/2907758368 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb1800f8c0 con 0x55934389bd80 2024-09-10T22:30:07.036 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:07.029+0000 7feb2b0cf740 1 -- 172.21.15.19:0/2907758368 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7feb140cc850 con 0x55934389bd80 2024-09-10T22:30:07.036 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:07.029+0000 7feb09ffb640 1 -- 172.21.15.19:0/2907758368 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8327+0+0 (secure 0 0 0) 0x7feb1800fa60 con 0x55934389bd80 2024-09-10T22:30:07.036 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:07.029+0000 7feb09ffb640 1 -- 172.21.15.19:0/2907758368 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7feb1800fc60 con 0x55934389bd80 2024-09-10T22:30:07.036 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:07.029+0000 7feb2b0cf740 10 client.16080 fetch_fsmap learned FSMap version 27 2024-09-10T22:30:07.036 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:07.029+0000 7feb2b0cf740 1 -- 172.21.15.19:0/2907758368 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x5593438aea40 con 0x55934389bd80 2024-09-10T22:30:07.036 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:07.030+0000 7feb09ffb640 1 -- 172.21.15.19:0/2907758368 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7feb140cc850 con 0x55934389bd80 2024-09-10T22:30:07.036 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:07.030+0000 7feb09ffb640 1 -- 172.21.15.19:0/2907758368 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7feb18024020 con 0x55934389bd80 2024-09-10T22:30:07.036 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:07.030+0000 7feb2b0cf740 10 client.16080 fetch_fsmap finished waiting for FSMap version 27 2024-09-10T22:30:07.036 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:07.030+0000 7feb2b0cf740 10 client.16080 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-10T22:30:07.036 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:07.030+0000 7feb2b0cf740 20 client.16080 populate_metadata read hostname 'smithi019' 2024-09-10T22:30:07.036 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:07.030+0000 7feb2b0cf740 1 --2- 172.21.15.19:0/2907758368 >> [v2:172.21.15.138:6838/383637208,v1:172.21.15.138:6839/383637208] conn(0x5593438afe50 0x5593438b22a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:30:07.037 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:07.030+0000 7feb2b0cf740 4 client.16080 mds_command: new command op to 24568 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T22:30:07.037 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:07.030+0000 7feb2b0cf740 1 -- 172.21.15.19:0/2907758368 --> [v2:172.21.15.138:6838/383637208,v1:172.21.15.138:6839/383637208] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x559343807df0 con 0x5593438afe50 2024-09-10T22:30:07.037 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:07.030+0000 7feb2259c640 1 --2- 172.21.15.19:0/2907758368 >> [v2:172.21.15.138:6838/383637208,v1:172.21.15.138:6839/383637208] conn(0x5593438afe50 0x5593438b22a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:30:07.037 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:07.031+0000 7feb2259c640 1 --2- 172.21.15.19:0/2907758368 >> [v2:172.21.15.138:6838/383637208,v1:172.21.15.138:6839/383637208] conn(0x5593438afe50 0x5593438b22a0 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=5eda993c479ba8e2 server_cookie=48b56b605a647aed in_seq=0 out_seq=0 2024-09-10T22:30:07.037 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:07.031+0000 7feb09ffb640 10 client.16080 ms_handle_connect on v2:172.21.15.138:6838/383637208 2024-09-10T22:30:07.037 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:07.031+0000 7feb09ffb640 1 -- 172.21.15.19:0/2907758368 <== mds.1 v2:172.21.15.138:6838/383637208 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x559343807df0 con 0x5593438afe50 2024-09-10T22:30:07.037 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:07.031+0000 7feb09ffb640 10 client.16080 handle_command_reply: tid=0 2024-09-10T22:30:07.037 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:07.031+0000 7feb2b0cf740 1 client.16080 shutdown 2024-09-10T22:30:07.037 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:07.031+0000 7feb2b0cf740 1 -- 172.21.15.19:0/2907758368 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55934389bd80 msgr2=0x559343898bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:30:07.037 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:07.031+0000 7feb2b0cf740 1 --2- 172.21.15.19:0/2907758368 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55934389bd80 0x559343898bf0 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7feb180126d0 tx=0x7feb18012b90 comp rx=0 tx=0).stop 2024-09-10T22:30:07.037 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:07.031+0000 7feb2b0cf740 1 -- 172.21.15.19:0/2907758368 shutdown_connections 2024-09-10T22:30:07.037 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:07.031+0000 7feb2b0cf740 1 --2- 172.21.15.19:0/2907758368 >> [v2:172.21.15.138:6838/383637208,v1:172.21.15.138:6839/383637208] conn(0x5593438afe50 0x5593438b22a0 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:30:07.037 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:07.032+0000 7feb2b0cf740 1 --2- 172.21.15.19:0/2907758368 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5593438992e0 0x5593438abe80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:30:07.037 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:07.032+0000 7feb2b0cf740 1 --2- 172.21.15.19:0/2907758368 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55934389bd80 0x559343898bf0 unknown :-1 s=CLOSED pgs=566 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:30:07.038 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:07.032+0000 7feb2b0cf740 1 --2- 172.21.15.19:0/2907758368 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55934388f4d0 0x55934389b7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:30:07.038 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:07.032+0000 7feb2b0cf740 1 -- 172.21.15.19:0/2907758368 >> 172.21.15.19:0/2907758368 conn(0x55934388d300 msgr2=0x559343892e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:30:07.038 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:07.032+0000 7feb09ffb640 0 client.16080 ms_handle_reset on v2:172.21.15.138:6838/383637208 2024-09-10T22:30:07.038 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:07.032+0000 7feb2b0cf740 1 -- 172.21.15.19:0/2907758368 shutdown_connections 2024-09-10T22:30:07.038 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:07.032+0000 7feb2b0cf740 1 -- 172.21.15.19:0/2907758368 wait complete. 2024-09-10T22:30:07.038 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:07.032+0000 7feb2b0cf740 20 client.16080 trim_cache size 0 max 16384 2024-09-10T22:30:07.049 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:07.046+0000 7feb2b0cf740 1 Processor -- start 2024-09-10T22:30:07.049 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:07.046+0000 7feb2b0cf740 1 -- start start 2024-09-10T22:30:07.049 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:07.046+0000 7feb2b0cf740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55934388f4d0 0x5593438abdc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:30:07.049 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:07.046+0000 7feb2b0cf740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5593438992e0 0x55934388e2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:30:07.049 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:07.046+0000 7feb2b0cf740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55934389bd80 0x55934388e820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:30:07.049 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:07.046+0000 7feb2b0cf740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7feb241aecb0 con 0x5593438992e0 2024-09-10T22:30:07.049 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:07.047+0000 7feb2b0cf740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7feb241ac580 con 0x55934389bd80 2024-09-10T22:30:07.050 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:07.047+0000 7feb2b0cf740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7feb241aa3d0 con 0x55934388f4d0 2024-09-10T22:30:07.050 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:07.047+0000 7feb22d9d640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55934389bd80 0x55934388e820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:30:07.050 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:07.047+0000 7feb2259c640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55934388f4d0 0x5593438abdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:30:07.050 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:07.047+0000 7feb22d9d640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55934389bd80 0x55934388e820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.19:42642/0 (socket says 172.21.15.19:42642) 2024-09-10T22:30:07.050 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:07.047+0000 7feb22d9d640 1 -- 172.21.15.19:0/111899057 learned_addr learned my addr 172.21.15.19:0/111899057 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:30:07.050 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:07.047+0000 7feb21d9b640 1 --2- 172.21.15.19:0/111899057 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5593438992e0 0x55934388e2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:30:07.050 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:07.047+0000 7feb2259c640 1 -- 172.21.15.19:0/111899057 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55934389bd80 msgr2=0x55934388e820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:30:07.050 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:07.047+0000 7feb2259c640 1 --2- 172.21.15.19:0/111899057 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55934389bd80 0x55934388e820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:30:07.050 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:07.047+0000 7feb2259c640 1 -- 172.21.15.19:0/111899057 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5593438992e0 msgr2=0x55934388e2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:30:07.050 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:07.047+0000 7feb2259c640 1 --2- 172.21.15.19:0/111899057 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5593438992e0 0x55934388e2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:30:07.050 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:07.047+0000 7feb2259c640 1 -- 172.21.15.19:0/111899057 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55934388fc20 con 0x55934388f4d0 2024-09-10T22:30:07.050 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:07.047+0000 7feb22d9d640 1 --2- 172.21.15.19:0/111899057 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55934389bd80 0x55934388e820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T22:30:07.050 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:07.047+0000 7feb2259c640 1 --2- 172.21.15.19:0/111899057 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55934388f4d0 0x5593438abdc0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7feb14085290 tx=0x7feb140045e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4382d7b6f8364bbf server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:30:07.050 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:07.047+0000 7feb0bfff640 1 -- 172.21.15.19:0/111899057 <== mon.1 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb14049020 con 0x55934388f4d0 2024-09-10T22:30:07.050 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:07.048+0000 7feb0bfff640 1 -- 172.21.15.19:0/111899057 <== mon.1 v2:172.21.15.138:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7feb140cc850 con 0x55934388f4d0 2024-09-10T22:30:07.051 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:07.048+0000 7feb0bfff640 1 -- 172.21.15.19:0/111899057 <== mon.1 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb14031d10 con 0x55934388f4d0 2024-09-10T22:30:07.054 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:07.048+0000 7feb2b0cf740 1 -- 172.21.15.19:0/111899057 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55934388f4d0 msgr2=0x5593438abdc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:30:07.054 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:07.048+0000 7feb2b0cf740 1 --2- 172.21.15.19:0/111899057 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55934388f4d0 0x5593438abdc0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7feb14085290 tx=0x7feb140045e0 comp rx=0 tx=0).stop 2024-09-10T22:30:07.055 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:07.048+0000 7feb2b0cf740 1 -- 172.21.15.19:0/111899057 shutdown_connections 2024-09-10T22:30:07.055 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:07.048+0000 7feb2b0cf740 1 --2- 172.21.15.19:0/111899057 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55934389bd80 0x55934388e820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:30:07.055 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:07.048+0000 7feb2b0cf740 1 --2- 172.21.15.19:0/111899057 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5593438992e0 0x55934388e2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:30:07.055 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:07.048+0000 7feb2b0cf740 1 --2- 172.21.15.19:0/111899057 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55934388f4d0 0x5593438abdc0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:30:07.055 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:07.048+0000 7feb2b0cf740 1 -- 172.21.15.19:0/111899057 >> 172.21.15.19:0/111899057 conn(0x55934388d300 msgr2=0x559343893dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:30:07.055 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:07.048+0000 7feb2b0cf740 1 -- 172.21.15.19:0/111899057 shutdown_connections 2024-09-10T22:30:07.055 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:07.048+0000 7feb2b0cf740 1 -- 172.21.15.19:0/111899057 wait complete. 2024-09-10T22:30:07.055 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:07.049+0000 7feb2b0cf740 1 -- start start 2024-09-10T22:30:07.055 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:07.049+0000 7feb2b0cf740 1 Processor -- start 2024-09-10T22:30:07.055 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:07.049+0000 7feb2b0cf740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55934388f4d0 0x5593438a7e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:30:07.055 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:07.049+0000 7feb2b0cf740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5593438992e0 0x5593438a8370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:30:07.055 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:07.049+0000 7feb2b0cf740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55934389bd80 0x5593438a2de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:30:07.056 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:07.049+0000 7feb2b0cf740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7feb241aaa40 con 0x55934389bd80 2024-09-10T22:30:07.056 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:07.049+0000 7feb2b0cf740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7feb241abeb0 con 0x55934388f4d0 2024-09-10T22:30:07.056 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:07.049+0000 7feb2b0cf740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7feb241ab110 con 0x5593438992e0 2024-09-10T22:30:07.056 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:07.049+0000 7feb2b0cf740 10 client.0 _ll_register_callbacks cb 0x7feb18009850 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T22:30:07.056 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:07.049+0000 7feb22d9d640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55934389bd80 0x5593438a2de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:30:07.056 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:07.049+0000 7feb21d9b640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5593438992e0 0x5593438a8370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:30:07.056 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:07.049+0000 7feb21d9b640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5593438992e0 0x5593438a8370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.19:50536/0 (socket says 172.21.15.19:50536) 2024-09-10T22:30:07.056 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:07.049+0000 7feb22d9d640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55934389bd80 0x5593438a2de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:50508/0 (socket says 172.21.15.19:50508) 2024-09-10T22:30:07.056 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:07.049+0000 7feb21d9b640 1 -- 172.21.15.19:0/3139088881 learned_addr learned my addr 172.21.15.19:0/3139088881 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:30:07.056 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:07.049+0000 7feb2259c640 1 --2- 172.21.15.19:0/3139088881 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55934388f4d0 0x5593438a7e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:30:07.056 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:07.050+0000 7feb21d9b640 1 -- 172.21.15.19:0/3139088881 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55934388f4d0 msgr2=0x5593438a7e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:30:07.056 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:07.050+0000 7feb21d9b640 1 --2- 172.21.15.19:0/3139088881 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55934388f4d0 0x5593438a7e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:30:07.056 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:07.050+0000 7feb21d9b640 1 -- 172.21.15.19:0/3139088881 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55934389bd80 msgr2=0x5593438a2de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:30:07.057 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:07.050+0000 7feb21d9b640 1 --2- 172.21.15.19:0/3139088881 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55934389bd80 0x5593438a2de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:30:07.057 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:07.050+0000 7feb21d9b640 1 -- 172.21.15.19:0/3139088881 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5593438a8bc0 con 0x5593438992e0 2024-09-10T22:30:07.057 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:07.050+0000 7feb2259c640 1 --2- 172.21.15.19:0/3139088881 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55934388f4d0 0x5593438a7e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T22:30:07.057 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:07.050+0000 7feb21d9b640 1 --2- 172.21.15.19:0/3139088881 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5593438992e0 0x5593438a8370 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7feb18009730 tx=0x7feb180108d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a2a45169192af75f server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:30:07.057 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:07.050+0000 7feb09ffb640 10 client.0 ms_handle_connect on v2:172.21.15.138:3300/0 2024-09-10T22:30:07.057 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:07.050+0000 7feb09ffb640 1 -- 172.21.15.19:0/3139088881 <== mon.1 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb18010c50 con 0x5593438992e0 2024-09-10T22:30:07.057 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:07.050+0000 7feb09ffb640 1 -- 172.21.15.19:0/3139088881 <== mon.1 v2:172.21.15.138:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8327+0+0 (secure 0 0 0) 0x7feb18018040 con 0x5593438992e0 2024-09-10T22:30:07.057 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:07.050+0000 7feb2b0cf740 1 -- 172.21.15.19:0/3139088881 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7feb140cc850 con 0x5593438992e0 2024-09-10T22:30:07.057 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:07.051+0000 7feb09ffb640 1 -- 172.21.15.19:0/3139088881 <== mon.1 v2:172.21.15.138:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7feb18010df0 con 0x5593438992e0 2024-09-10T22:30:07.057 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:07.051+0000 7feb2b0cf740 10 client.25558 fetch_fsmap learned FSMap version 27 2024-09-10T22:30:07.057 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:07.051+0000 7feb2b0cf740 1 -- 172.21.15.19:0/3139088881 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55934391d400 con 0x5593438992e0 2024-09-10T22:30:07.057 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:07.051+0000 7feb09ffb640 1 -- 172.21.15.19:0/3139088881 <== mon.1 v2:172.21.15.138:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7feb140cc850 con 0x5593438992e0 2024-09-10T22:30:07.057 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:07.051+0000 7feb09ffb640 1 -- 172.21.15.19:0/3139088881 <== mon.1 v2:172.21.15.138:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7feb18024040 con 0x5593438992e0 2024-09-10T22:30:07.057 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:07.051+0000 7feb2b0cf740 10 client.25558 fetch_fsmap finished waiting for FSMap version 27 2024-09-10T22:30:07.058 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:07.051+0000 7feb2b0cf740 10 client.25558 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-10T22:30:07.058 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:07.051+0000 7feb2b0cf740 20 client.25558 populate_metadata read hostname 'smithi019' 2024-09-10T22:30:07.058 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:07.051+0000 7feb2b0cf740 1 --2- 172.21.15.19:0/3139088881 >> [v2:172.21.15.138:6838/383637208,v1:172.21.15.138:6839/383637208] conn(0x55934391dc00 0x559343920020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:30:07.058 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:07.051+0000 7feb2b0cf740 4 client.25558 mds_command: new command op to 24568 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-10T22:30:07.058 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:07.051+0000 7feb2b0cf740 1 -- 172.21.15.19:0/3139088881 --> [v2:172.21.15.138:6838/383637208,v1:172.21.15.138:6839/383637208] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5593438b2630 con 0x55934391dc00 2024-09-10T22:30:07.058 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:07.051+0000 7feb2259c640 1 --2- 172.21.15.19:0/3139088881 >> [v2:172.21.15.138:6838/383637208,v1:172.21.15.138:6839/383637208] conn(0x55934391dc00 0x559343920020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:30:07.058 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:07.052+0000 7feb09ffb640 10 client.25558 ms_handle_connect on v2:172.21.15.138:6838/383637208 2024-09-10T22:30:07.058 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:07.052+0000 7feb2259c640 1 --2- 172.21.15.19:0/3139088881 >> [v2:172.21.15.138:6838/383637208,v1:172.21.15.138:6839/383637208] conn(0x55934391dc00 0x559343920020 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=830a4f3aa788285e server_cookie=d8623479cd4107b6 in_seq=0 out_seq=0 2024-09-10T22:30:07.058 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:07.052+0000 7feb09ffb640 1 -- 172.21.15.19:0/3139088881 <== mds.1 v2:172.21.15.138:6838/383637208 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5593438b2630 con 0x55934391dc00 2024-09-10T22:30:07.058 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:07.052+0000 7feb09ffb640 10 client.25558 handle_command_reply: tid=0 2024-09-10T22:30:07.058 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:07.052+0000 7feb2b0cf740 1 client.25558 shutdown 2024-09-10T22:30:07.058 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:07.052+0000 7feb2b0cf740 1 -- 172.21.15.19:0/3139088881 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5593438992e0 msgr2=0x5593438a8370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:30:07.058 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:07.052+0000 7feb2b0cf740 1 --2- 172.21.15.19:0/3139088881 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5593438992e0 0x5593438a8370 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7feb18009730 tx=0x7feb180108d0 comp rx=0 tx=0).stop 2024-09-10T22:30:07.058 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:07.052+0000 7feb2b0cf740 1 -- 172.21.15.19:0/3139088881 shutdown_connections 2024-09-10T22:30:07.059 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:07.052+0000 7feb2b0cf740 1 --2- 172.21.15.19:0/3139088881 >> [v2:172.21.15.138:6838/383637208,v1:172.21.15.138:6839/383637208] conn(0x55934391dc00 0x559343920020 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:30:07.059 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:07.052+0000 7feb2b0cf740 1 --2- 172.21.15.19:0/3139088881 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55934389bd80 0x5593438a2de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:30:07.059 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:07.052+0000 7feb2b0cf740 1 --2- 172.21.15.19:0/3139088881 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5593438992e0 0x5593438a8370 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:30:07.059 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:07.052+0000 7feb2b0cf740 1 --2- 172.21.15.19:0/3139088881 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55934388f4d0 0x5593438a7e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:30:07.059 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:07.052+0000 7feb2b0cf740 1 -- 172.21.15.19:0/3139088881 >> 172.21.15.19:0/3139088881 conn(0x55934388d300 msgr2=0x55934388e2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:30:07.059 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:07.052+0000 7feb09ffb640 0 client.25558 ms_handle_reset on v2:172.21.15.138:6838/383637208 2024-09-10T22:30:07.059 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:07.052+0000 7feb2b0cf740 1 -- 172.21.15.19:0/3139088881 shutdown_connections 2024-09-10T22:30:07.059 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:07.052+0000 7feb2b0cf740 1 -- 172.21.15.19:0/3139088881 wait complete. 2024-09-10T22:30:07.059 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:07.052+0000 7feb2b0cf740 20 client.25558 trim_cache size 0 max 16384 2024-09-10T22:30:07.059 INFO:teuthology.orchestra.run.smithi019.stdout:[] 2024-09-10T22:30:07.060 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:07.053+0000 7feb28cfa640 1 -- 172.21.15.19:0/2572139685 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7feb0c0b5360 msgr2=0x7feb0c0b7820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:30:07.060 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:07.053+0000 7feb28cfa640 1 --2- 172.21.15.19:0/2572139685 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7feb0c0b5360 0x7feb0c0b7820 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7feb1c012640 tx=0x7feb1c009500 comp rx=0 tx=0).stop 2024-09-10T22:30:07.060 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:07.053+0000 7feb28cfa640 1 -- 172.21.15.19:0/2572139685 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7feb24101c90 msgr2=0x7feb241992b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:30:07.060 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:07.053+0000 7feb28cfa640 1 --2- 172.21.15.19:0/2572139685 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7feb24101c90 0x7feb241992b0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7feb14005ab0 tx=0x7feb14003c10 comp rx=0 tx=0).stop 2024-09-10T22:30:07.060 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:07.053+0000 7feb28cfa640 1 -- 172.21.15.19:0/2572139685 shutdown_connections 2024-09-10T22:30:07.060 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:07.053+0000 7feb28cfa640 1 --2- 172.21.15.19:0/2572139685 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7feb0c0b5360 0x7feb0c0b7820 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:30:07.060 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:07.053+0000 7feb28cfa640 1 --2- 172.21.15.19:0/2572139685 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7feb24108020 0x7feb2419eb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:30:07.060 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:07.053+0000 7feb28cfa640 1 --2- 172.21.15.19:0/2572139685 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7feb241076a0 0x7feb241997f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:30:07.061 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:07.053+0000 7feb28cfa640 1 --2- 172.21.15.19:0/2572139685 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7feb24101c90 0x7feb241992b0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:30:07.061 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:07.053+0000 7feb28cfa640 1 -- 172.21.15.19:0/2572139685 >> 172.21.15.19:0/2572139685 conn(0x7feb240fd700 msgr2=0x7feb2406ac40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:30:07.061 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:07.053+0000 7feb28cfa640 1 -- 172.21.15.19:0/2572139685 shutdown_connections 2024-09-10T22:30:07.061 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:07.053+0000 7feb28cfa640 1 -- 172.21.15.19:0/2572139685 wait complete. 2024-09-10T22:30:07.584 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:07.580+0000 7f6f63ccd640 1 -- 172.21.15.19:0/2404358320 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f6f5c103370 msgr2=0x7f6f5c109cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:30:07.584 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:07.580+0000 7f6f63ccd640 1 --2- 172.21.15.19:0/2404358320 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f6f5c103370 0x7f6f5c109cf0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f6f54009c10 tx=0x7f6f5402a6e0 comp rx=0 tx=0).stop 2024-09-10T22:30:07.584 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:07.580+0000 7f6f63ccd640 1 -- 172.21.15.19:0/2404358320 shutdown_connections 2024-09-10T22:30:07.584 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:07.580+0000 7f6f63ccd640 1 --2- 172.21.15.19:0/2404358320 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f6f5c103370 0x7f6f5c109cf0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:30:07.584 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:07.580+0000 7f6f63ccd640 1 --2- 172.21.15.19:0/2404358320 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6f5c1029b0 0x7f6f5c102e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:30:07.584 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:07.580+0000 7f6f63ccd640 1 --2- 172.21.15.19:0/2404358320 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6f5c101860 0x7f6f5c101c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:30:07.584 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:07.580+0000 7f6f63ccd640 1 -- 172.21.15.19:0/2404358320 >> 172.21.15.19:0/2404358320 conn(0x7f6f5c0fd140 msgr2=0x7f6f5c0ff560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:30:07.584 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:07.580+0000 7f6f63ccd640 1 -- 172.21.15.19:0/2404358320 shutdown_connections 2024-09-10T22:30:07.584 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:07.580+0000 7f6f63ccd640 1 -- 172.21.15.19:0/2404358320 wait complete. 2024-09-10T22:30:07.584 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:07.580+0000 7f6f63ccd640 1 Processor -- start 2024-09-10T22:30:07.584 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:07.580+0000 7f6f63ccd640 1 -- start start 2024-09-10T22:30:07.585 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:07.581+0000 7f6f63ccd640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f6f5c101860 0x7f6f5c198d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:30:07.585 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:07.581+0000 7f6f63ccd640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6f5c1029b0 0x7f6f5c199360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:30:07.585 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:07.581+0000 7f6f63ccd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6f5c103370 0x7f6f5c199f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:30:07.585 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:07.581+0000 7f6f63ccd640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f6f5c10d4b0 con 0x7f6f5c103370 2024-09-10T22:30:07.585 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:07.581+0000 7f6f63ccd640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f6f5c10d330 con 0x7f6f5c1029b0 2024-09-10T22:30:07.585 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:07.581+0000 7f6f63ccd640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f6f5c10d630 con 0x7f6f5c101860 2024-09-10T22:30:07.585 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:07.581+0000 7f6f61268640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6f5c1029b0 0x7f6f5c199360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:30:07.585 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:07.581+0000 7f6f6226a640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6f5c103370 0x7f6f5c199f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:30:07.585 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:07.581+0000 7f6f61268640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6f5c1029b0 0x7f6f5c199360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.19:42654/0 (socket says 172.21.15.19:42654) 2024-09-10T22:30:07.585 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:07.581+0000 7f6f61268640 1 -- 172.21.15.19:0/2503952355 learned_addr learned my addr 172.21.15.19:0/2503952355 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:30:07.585 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:07.581+0000 7f6f61a69640 1 --2- 172.21.15.19:0/2503952355 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f6f5c101860 0x7f6f5c198d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:30:07.585 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:07.581+0000 7f6f61268640 1 -- 172.21.15.19:0/2503952355 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f6f5c101860 msgr2=0x7f6f5c198d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:30:07.586 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:07.581+0000 7f6f61268640 1 --2- 172.21.15.19:0/2503952355 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f6f5c101860 0x7f6f5c198d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:30:07.586 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:07.581+0000 7f6f61268640 1 -- 172.21.15.19:0/2503952355 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6f5c103370 msgr2=0x7f6f5c199f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:30:07.586 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:07.581+0000 7f6f61268640 1 --2- 172.21.15.19:0/2503952355 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6f5c103370 0x7f6f5c199f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:30:07.586 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:07.581+0000 7f6f61268640 1 -- 172.21.15.19:0/2503952355 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6f5c19a850 con 0x7f6f5c1029b0 2024-09-10T22:30:07.586 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:07.581+0000 7f6f6226a640 1 --2- 172.21.15.19:0/2503952355 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6f5c103370 0x7f6f5c199f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T22:30:07.586 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:07.581+0000 7f6f61a69640 1 --2- 172.21.15.19:0/2503952355 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f6f5c101860 0x7f6f5c198d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T22:30:07.586 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:07.582+0000 7f6f61268640 1 --2- 172.21.15.19:0/2503952355 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6f5c1029b0 0x7f6f5c199360 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f6f4c00e9f0 tx=0x7f6f4c00eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:30:07.586 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:07.582+0000 7f6f52ffd640 1 -- 172.21.15.19:0/2503952355 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f4c00cd80 con 0x7f6f5c1029b0 2024-09-10T22:30:07.586 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:07.582+0000 7f6f52ffd640 1 -- 172.21.15.19:0/2503952355 <== mon.2 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6f4c0108e0 con 0x7f6f5c1029b0 2024-09-10T22:30:07.586 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:07.582+0000 7f6f63ccd640 1 -- 172.21.15.19:0/2503952355 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6f5c19ab40 con 0x7f6f5c1029b0 2024-09-10T22:30:07.586 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:07.582+0000 7f6f52ffd640 1 -- 172.21.15.19:0/2503952355 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f4c018980 con 0x7f6f5c1029b0 2024-09-10T22:30:07.586 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:07.582+0000 7f6f63ccd640 1 -- 172.21.15.19:0/2503952355 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6f5c1a1210 con 0x7f6f5c1029b0 2024-09-10T22:30:07.587 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:07.586+0000 7f6f66a9f740 1 Processor -- start 2024-09-10T22:30:07.587 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:07.586+0000 7f6f66a9f740 1 -- start start 2024-09-10T22:30:07.588 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:07.586+0000 7f6f66a9f740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5572a4ad6860 0x5572a4ad8c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:30:07.589 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:07.586+0000 7f6f66a9f740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5572a4ad9190 0x5572a4adb580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:30:07.589 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:07.586+0000 7f6f66a9f740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5572a4adbbd0 0x5572a4ade090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:30:07.589 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:07.586+0000 7f6f66a9f740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x5572a4a486f0 con 0x5572a4ad9190 2024-09-10T22:30:07.589 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:07.586+0000 7f6f66a9f740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x5572a4a37b20 con 0x5572a4adbbd0 2024-09-10T22:30:07.589 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:07.586+0000 7f6f66a9f740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x5572a4a3b930 con 0x5572a4ad6860 2024-09-10T22:30:07.589 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:07.586+0000 7f6f52ffd640 1 -- 172.21.15.19:0/2503952355 <== mon.2 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 18) ==== 153250+0+0 (secure 0 0 0) 0x7f6f4c018b20 con 0x7f6f5c1029b0 2024-09-10T22:30:07.589 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:07.586+0000 7f6f6226a640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5572a4ad6860 0x5572a4ad8c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:30:07.589 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:07.586+0000 7f6f61a69640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5572a4ad9190 0x5572a4adb580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:30:07.589 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:07.586+0000 7f6f6226a640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5572a4ad6860 0x5572a4ad8c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.19:50574/0 (socket says 172.21.15.19:50574) 2024-09-10T22:30:07.589 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:07.586+0000 7f6f61268640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5572a4adbbd0 0x5572a4ade090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:30:07.589 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:07.586+0000 7f6f61a69640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5572a4ad9190 0x5572a4adb580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:50532/0 (socket says 172.21.15.19:50532) 2024-09-10T22:30:07.589 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:07.586+0000 7f6f6226a640 1 -- 172.21.15.19:0/3487370080 learned_addr learned my addr 172.21.15.19:0/3487370080 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:30:07.590 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:07.587+0000 7f6f6226a640 1 -- 172.21.15.19:0/3487370080 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5572a4adbbd0 msgr2=0x5572a4ade090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:30:07.590 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:07.587+0000 7f6f6226a640 1 --2- 172.21.15.19:0/3487370080 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5572a4adbbd0 0x5572a4ade090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:30:07.590 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:07.587+0000 7f6f6226a640 1 -- 172.21.15.19:0/3487370080 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5572a4ad9190 msgr2=0x5572a4adb580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:30:07.590 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:07.587+0000 7f6f6226a640 1 --2- 172.21.15.19:0/3487370080 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5572a4ad9190 0x5572a4adb580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:30:07.590 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:07.587+0000 7f6f6226a640 1 -- 172.21.15.19:0/3487370080 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5572a49fd530 con 0x5572a4ad6860 2024-09-10T22:30:07.590 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:07.587+0000 7f6f61a69640 1 --2- 172.21.15.19:0/3487370080 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5572a4ad9190 0x5572a4adb580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T22:30:07.590 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:07.587+0000 7f6f6226a640 1 --2- 172.21.15.19:0/3487370080 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5572a4ad6860 0x5572a4ad8c50 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f6f54009c10 tx=0x7f6f54009310 comp rx=0 tx=0).ready entity=mon.1 client_cookie=53b89b86aaf424da server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:30:07.591 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:07.588+0000 7f6f52ffd640 1 --2- 172.21.15.19:0/2503952355 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f6f480b52e0 0x7f6f480b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:30:07.591 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:07.588+0000 7f6f61a69640 1 --2- 172.21.15.19:0/2503952355 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f6f480b52e0 0x7f6f480b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:30:07.591 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:07.588+0000 7f6f52ffd640 1 -- 172.21.15.19:0/2503952355 <== mon.2 v2:172.21.15.135:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8327+0+0 (secure 0 0 0) 0x7f6f4c0e5fe0 con 0x7f6f5c1029b0 2024-09-10T22:30:07.591 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:07.588+0000 7f6f61a69640 1 --2- 172.21.15.19:0/2503952355 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f6f480b52e0 0x7f6f480b77a0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f6f58009fd0 tx=0x7f6f58009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:30:07.620 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:07.618+0000 7f6f47fff640 1 -- 172.21.15.19:0/3487370080 <== mon.1 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f54041030 con 0x5572a4ad6860 2024-09-10T22:30:07.620 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:07.619+0000 7f6f47fff640 1 -- 172.21.15.19:0/3487370080 <== mon.1 v2:172.21.15.138:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6f54003970 con 0x5572a4ad6860 2024-09-10T22:30:07.620 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:07.619+0000 7f6f47fff640 1 -- 172.21.15.19:0/3487370080 <== mon.1 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f54036040 con 0x5572a4ad6860 2024-09-10T22:30:07.621 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:07.619+0000 7f6f66a9f740 1 -- 172.21.15.19:0/3487370080 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5572a4ad6860 msgr2=0x5572a4ad8c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:30:07.621 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:07.619+0000 7f6f66a9f740 1 --2- 172.21.15.19:0/3487370080 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5572a4ad6860 0x5572a4ad8c50 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f6f54009c10 tx=0x7f6f54009310 comp rx=0 tx=0).stop 2024-09-10T22:30:07.621 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:07.620+0000 7f6f66a9f740 1 -- 172.21.15.19:0/3487370080 shutdown_connections 2024-09-10T22:30:07.621 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:07.620+0000 7f6f66a9f740 1 --2- 172.21.15.19:0/3487370080 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5572a4adbbd0 0x5572a4ade090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:30:07.621 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:07.620+0000 7f6f66a9f740 1 --2- 172.21.15.19:0/3487370080 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5572a4ad9190 0x5572a4adb580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:30:07.622 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:07.620+0000 7f6f66a9f740 1 --2- 172.21.15.19:0/3487370080 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5572a4ad6860 0x5572a4ad8c50 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:30:07.622 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:07.620+0000 7f6f66a9f740 1 -- 172.21.15.19:0/3487370080 >> 172.21.15.19:0/3487370080 conn(0x5572a4ad19b0 msgr2=0x5572a4ad2740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:30:07.622 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:07.620+0000 7f6f66a9f740 1 -- 172.21.15.19:0/3487370080 shutdown_connections 2024-09-10T22:30:07.622 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:07.620+0000 7f6f66a9f740 1 -- 172.21.15.19:0/3487370080 wait complete. 2024-09-10T22:30:07.623 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:07.620+0000 7f6f66a9f740 1 -- start start 2024-09-10T22:30:07.623 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:07.620+0000 7f6f66a9f740 1 Processor -- start 2024-09-10T22:30:07.623 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:07.621+0000 7f6f66a9f740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5572a4ad6860 0x5572a4adfe90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:30:07.624 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:07.621+0000 7f6f66a9f740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5572a4ad9190 0x5572a4ae0530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:30:07.624 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:07.621+0000 7f6f66a9f740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5572a4adbbd0 0x5572a4ae1100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:30:07.624 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:07.621+0000 7f6f66a9f740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x5572a496fab0 con 0x5572a4adbbd0 2024-09-10T22:30:07.624 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:07.621+0000 7f6f66a9f740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x5572a49dd730 con 0x5572a4ad9190 2024-09-10T22:30:07.624 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:07.621+0000 7f6f66a9f740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x5572a4adeb50 con 0x5572a4ad6860 2024-09-10T22:30:07.624 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:07.621+0000 7f6f66a9f740 10 client.0 _ll_register_callbacks cb 0x5572a4a316b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T22:30:07.624 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:07.621+0000 7f6f6226a640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5572a4adbbd0 0x5572a4ae1100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:30:07.624 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:07.621+0000 7f6f6226a640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5572a4adbbd0 0x5572a4ae1100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:50548/0 (socket says 172.21.15.19:50548) 2024-09-10T22:30:07.624 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:07.621+0000 7f6f61268640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5572a4ad9190 0x5572a4ae0530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:30:07.624 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:07.621+0000 7f6f6226a640 1 -- 172.21.15.19:0/1861602520 learned_addr learned my addr 172.21.15.19:0/1861602520 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:30:07.624 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:07.621+0000 7f6f61a69640 1 --2- 172.21.15.19:0/1861602520 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5572a4ad6860 0x5572a4adfe90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:30:07.624 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:07.621+0000 7f6f61268640 1 -- 172.21.15.19:0/1861602520 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5572a4ad6860 msgr2=0x5572a4adfe90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:30:07.625 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:07.621+0000 7f6f61268640 1 --2- 172.21.15.19:0/1861602520 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5572a4ad6860 0x5572a4adfe90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:30:07.625 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:07.621+0000 7f6f61268640 1 -- 172.21.15.19:0/1861602520 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5572a4adbbd0 msgr2=0x5572a4ae1100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:30:07.625 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:07.621+0000 7f6f61268640 1 --2- 172.21.15.19:0/1861602520 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5572a4adbbd0 0x5572a4ae1100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:30:07.625 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:07.621+0000 7f6f61268640 1 -- 172.21.15.19:0/1861602520 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5572a4799790 con 0x5572a4ad9190 2024-09-10T22:30:07.625 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:07.621+0000 7f6f6226a640 1 --2- 172.21.15.19:0/1861602520 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5572a4adbbd0 0x5572a4ae1100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T22:30:07.625 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:07.621+0000 7f6f61a69640 1 --2- 172.21.15.19:0/1861602520 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5572a4ad6860 0x5572a4adfe90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T22:30:07.625 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:07.622+0000 7f6f61268640 1 --2- 172.21.15.19:0/1861602520 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5572a4ad9190 0x5572a4ae0530 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f6f4c0e3a20 tx=0x7f6f4c018420 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5b0bbba1d26986d1 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:30:07.625 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:07.622+0000 7f6f457fa640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-09-10T22:30:07.626 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:07.625+0000 7f6f457fa640 1 -- 172.21.15.19:0/1861602520 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f4c0abf00 con 0x5572a4ad9190 2024-09-10T22:30:07.626 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:07.625+0000 7f6f457fa640 1 -- 172.21.15.19:0/1861602520 <== mon.2 v2:172.21.15.135:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8327+0+0 (secure 0 0 0) 0x7f6f4c0b59e0 con 0x5572a4ad9190 2024-09-10T22:30:07.626 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:07.625+0000 7f6f66a9f740 1 -- 172.21.15.19:0/1861602520 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6f54003970 con 0x5572a4ad9190 2024-09-10T22:30:07.627 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:07.625+0000 7f6f457fa640 1 -- 172.21.15.19:0/1861602520 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f6f4c0ac2a0 con 0x5572a4ad9190 2024-09-10T22:30:07.628 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:07.625+0000 7f6f66a9f740 10 client.25574 fetch_fsmap learned FSMap version 27 2024-09-10T22:30:07.628 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:07.625+0000 7f6f66a9f740 1 -- 172.21.15.19:0/1861602520 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x5572a4812620 con 0x5572a4ad9190 2024-09-10T22:30:07.628 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:07.626+0000 7f6f457fa640 1 -- 172.21.15.19:0/1861602520 <== mon.2 v2:172.21.15.135:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6f54003970 con 0x5572a4ad9190 2024-09-10T22:30:07.628 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:07.626+0000 7f6f457fa640 1 -- 172.21.15.19:0/1861602520 <== mon.2 v2:172.21.15.135:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7f6f4c0a80e0 con 0x5572a4ad9190 2024-09-10T22:30:07.628 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:07.626+0000 7f6f66a9f740 10 client.25574 fetch_fsmap finished waiting for FSMap version 27 2024-09-10T22:30:07.628 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:07.626+0000 7f6f66a9f740 10 client.25574 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-10T22:30:07.628 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:07.626+0000 7f6f66a9f740 20 client.25574 populate_metadata read hostname 'smithi019' 2024-09-10T22:30:07.628 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:07.626+0000 7f6f66a9f740 1 --2- 172.21.15.19:0/1861602520 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x5572a4aeb740 0x5572a4aedb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:30:07.628 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:07.626+0000 7f6f66a9f740 4 client.25574 mds_command: new command op to 24581 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T22:30:07.628 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:07.626+0000 7f6f66a9f740 1 -- 172.21.15.19:0/1861602520 --> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5572a4a4a640 con 0x5572a4aeb740 2024-09-10T22:30:07.628 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:07.626+0000 7f6f61a69640 1 --2- 172.21.15.19:0/1861602520 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x5572a4aeb740 0x5572a4aedb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:30:07.629 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:07.626+0000 7f6f457fa640 10 client.25574 ms_handle_connect on v2:172.21.15.135:6838/1254769802 2024-09-10T22:30:07.629 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:07.626+0000 7f6f61a69640 1 --2- 172.21.15.19:0/1861602520 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x5572a4aeb740 0x5572a4aedb30 crc :-1 s=READY pgs=92 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b2268fa63aaa7d8f server_cookie=3c8a4b0b44615539 in_seq=0 out_seq=0 2024-09-10T22:30:07.630 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:07.627+0000 7f6f457fa640 1 -- 172.21.15.19:0/1861602520 <== mds.0 v2:172.21.15.135:6838/1254769802 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5572a4a4a640 con 0x5572a4aeb740 2024-09-10T22:30:07.630 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:07.627+0000 7f6f457fa640 10 client.25574 handle_command_reply: tid=0 2024-09-10T22:30:07.630 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:07.627+0000 7f6f66a9f740 1 client.25574 shutdown 2024-09-10T22:30:07.630 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:07.627+0000 7f6f66a9f740 1 -- 172.21.15.19:0/1861602520 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5572a4ad9190 msgr2=0x5572a4ae0530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:30:07.630 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:07.627+0000 7f6f66a9f740 1 --2- 172.21.15.19:0/1861602520 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5572a4ad9190 0x5572a4ae0530 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f6f4c0e3a20 tx=0x7f6f4c018420 comp rx=0 tx=0).stop 2024-09-10T22:30:07.630 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:07.627+0000 7f6f66a9f740 1 -- 172.21.15.19:0/1861602520 shutdown_connections 2024-09-10T22:30:07.630 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:07.627+0000 7f6f66a9f740 1 --2- 172.21.15.19:0/1861602520 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5572a4adbbd0 0x5572a4ae1100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:30:07.630 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:07.627+0000 7f6f66a9f740 1 --2- 172.21.15.19:0/1861602520 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5572a4ad9190 0x5572a4ae0530 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:30:07.630 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:07.627+0000 7f6f66a9f740 1 --2- 172.21.15.19:0/1861602520 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x5572a4aeb740 0x5572a4aedb30 crc :-1 s=READY pgs=92 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:30:07.631 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:07.627+0000 7f6f66a9f740 1 --2- 172.21.15.19:0/1861602520 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5572a4ad6860 0x5572a4adfe90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:30:07.631 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:07.627+0000 7f6f457fa640 0 client.25574 ms_handle_reset on v2:172.21.15.135:6838/1254769802 2024-09-10T22:30:07.631 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:07.627+0000 7f6f66a9f740 1 -- 172.21.15.19:0/1861602520 >> 172.21.15.19:0/1861602520 conn(0x5572a4ad19b0 msgr2=0x5572a4ad0bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:30:07.631 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:07.627+0000 7f6f66a9f740 1 -- 172.21.15.19:0/1861602520 shutdown_connections 2024-09-10T22:30:07.631 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:07.627+0000 7f6f66a9f740 1 -- 172.21.15.19:0/1861602520 wait complete. 2024-09-10T22:30:07.631 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:07.628+0000 7f6f66a9f740 20 client.25574 trim_cache size 0 max 16384 2024-09-10T22:30:07.646 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:07.643+0000 7f6f66a9f740 1 Processor -- start 2024-09-10T22:30:07.646 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:07.643+0000 7f6f66a9f740 1 -- start start 2024-09-10T22:30:07.646 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:07.643+0000 7f6f66a9f740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5572a4ad6860 0x5572a4adf0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:30:07.646 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:07.643+0000 7f6f66a9f740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5572a4ad9190 0x5572a4adf610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:30:07.646 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:07.643+0000 7f6f66a9f740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5572a4adbbd0 0x5572a4ad37e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:30:07.646 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:07.643+0000 7f6f66a9f740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f6f5c1aa6e0 con 0x5572a4ad9190 2024-09-10T22:30:07.646 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:07.643+0000 7f6f66a9f740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f6f5c1a7fb0 con 0x5572a4adbbd0 2024-09-10T22:30:07.646 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:07.643+0000 7f6f66a9f740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f6f5c1a5e00 con 0x5572a4ad6860 2024-09-10T22:30:07.646 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:07.643+0000 7f6f61268640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5572a4ad9190 0x5572a4adf610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:30:07.646 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:07.643+0000 7f6f6226a640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5572a4adbbd0 0x5572a4ad37e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:30:07.646 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:07.643+0000 7f6f6226a640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5572a4adbbd0 0x5572a4ad37e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.19:42694/0 (socket says 172.21.15.19:42694) 2024-09-10T22:30:07.646 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:07.643+0000 7f6f6226a640 1 -- 172.21.15.19:0/2985117923 learned_addr learned my addr 172.21.15.19:0/2985117923 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:30:07.647 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:07.643+0000 7f6f61a69640 1 --2- 172.21.15.19:0/2985117923 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5572a4ad6860 0x5572a4adf0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:30:07.647 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:07.643+0000 7f6f61268640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5572a4ad9190 0x5572a4adf610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:50550/0 (socket says 172.21.15.19:50550) 2024-09-10T22:30:07.647 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:07.644+0000 7f6f61a69640 1 -- 172.21.15.19:0/2985117923 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5572a4adbbd0 msgr2=0x5572a4ad37e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:30:07.647 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:07.644+0000 7f6f61a69640 1 --2- 172.21.15.19:0/2985117923 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5572a4adbbd0 0x5572a4ad37e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:30:07.647 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:07.644+0000 7f6f61a69640 1 -- 172.21.15.19:0/2985117923 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5572a4ad9190 msgr2=0x5572a4adf610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:30:07.647 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:07.644+0000 7f6f61a69640 1 --2- 172.21.15.19:0/2985117923 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5572a4ad9190 0x5572a4adf610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:30:07.647 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:07.644+0000 7f6f61a69640 1 -- 172.21.15.19:0/2985117923 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5572a4adb8f0 con 0x5572a4ad6860 2024-09-10T22:30:07.647 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:07.644+0000 7f6f61a69640 1 --2- 172.21.15.19:0/2985117923 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5572a4ad6860 0x5572a4adf0d0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x5572a4aee340 tx=0x7f6f5801b000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ef7867e8d5fe0c20 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:30:07.647 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:07.644+0000 7f6f477fe640 1 -- 172.21.15.19:0/2985117923 <== mon.1 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f58024190 con 0x5572a4ad6860 2024-09-10T22:30:07.647 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:07.644+0000 7f6f477fe640 1 -- 172.21.15.19:0/2985117923 <== mon.1 v2:172.21.15.138:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6f580035f0 con 0x5572a4ad6860 2024-09-10T22:30:07.647 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:07.644+0000 7f6f477fe640 1 -- 172.21.15.19:0/2985117923 <== mon.1 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f58024580 con 0x5572a4ad6860 2024-09-10T22:30:07.651 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:07.645+0000 7f6f66a9f740 1 -- 172.21.15.19:0/2985117923 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5572a4ad6860 msgr2=0x5572a4adf0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:30:07.651 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:07.645+0000 7f6f66a9f740 1 --2- 172.21.15.19:0/2985117923 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5572a4ad6860 0x5572a4adf0d0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x5572a4aee340 tx=0x7f6f5801b000 comp rx=0 tx=0).stop 2024-09-10T22:30:07.651 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:07.645+0000 7f6f66a9f740 1 -- 172.21.15.19:0/2985117923 shutdown_connections 2024-09-10T22:30:07.651 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:07.645+0000 7f6f66a9f740 1 --2- 172.21.15.19:0/2985117923 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5572a4adbbd0 0x5572a4ad37e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:30:07.651 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:07.645+0000 7f6f66a9f740 1 --2- 172.21.15.19:0/2985117923 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5572a4ad9190 0x5572a4adf610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:30:07.651 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:07.645+0000 7f6f66a9f740 1 --2- 172.21.15.19:0/2985117923 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5572a4ad6860 0x5572a4adf0d0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:30:07.651 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:07.645+0000 7f6f66a9f740 1 -- 172.21.15.19:0/2985117923 >> 172.21.15.19:0/2985117923 conn(0x5572a4ad19b0 msgr2=0x5572a4adbfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:30:07.651 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:07.645+0000 7f6f66a9f740 1 -- 172.21.15.19:0/2985117923 shutdown_connections 2024-09-10T22:30:07.651 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:07.645+0000 7f6f66a9f740 1 -- 172.21.15.19:0/2985117923 wait complete. 2024-09-10T22:30:07.652 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:07.646+0000 7f6f66a9f740 1 -- start start 2024-09-10T22:30:07.652 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:07.646+0000 7f6f66a9f740 1 Processor -- start 2024-09-10T22:30:07.652 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:07.647+0000 7f6f66a9f740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5572a4ad6860 0x5572a4ae7c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:30:07.652 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:07.647+0000 7f6f66a9f740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5572a4ad9190 0x5572a4ae6a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:30:07.652 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:07.647+0000 7f6f66a9f740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5572a4adbbd0 0x5572a4ae7110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:30:07.652 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:07.647+0000 7f6f66a9f740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f6f5c1a6470 con 0x5572a4ad9190 2024-09-10T22:30:07.652 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:07.647+0000 7f6f66a9f740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f6f5c1a78e0 con 0x5572a4ad6860 2024-09-10T22:30:07.652 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:07.647+0000 7f6f66a9f740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f6f5c1a6b40 con 0x5572a4adbbd0 2024-09-10T22:30:07.652 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:07.647+0000 7f6f66a9f740 10 client.0 _ll_register_callbacks cb 0x7f6f4c0e9710 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T22:30:07.652 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:07.647+0000 7f6f61a69640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5572a4ad6860 0x5572a4ae7c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:30:07.652 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:07.647+0000 7f6f61268640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5572a4ad9190 0x5572a4ae6a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:30:07.652 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:07.647+0000 7f6f61a69640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5572a4ad6860 0x5572a4ae7c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.19:42698/0 (socket says 172.21.15.19:42698) 2024-09-10T22:30:07.653 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:07.647+0000 7f6f61a69640 1 -- 172.21.15.19:0/1571458586 learned_addr learned my addr 172.21.15.19:0/1571458586 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:30:07.653 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:07.647+0000 7f6f6226a640 1 --2- 172.21.15.19:0/1571458586 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5572a4adbbd0 0x5572a4ae7110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:30:07.653 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:07.647+0000 7f6f61a69640 1 -- 172.21.15.19:0/1571458586 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5572a4adbbd0 msgr2=0x5572a4ae7110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:30:07.653 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:07.647+0000 7f6f61a69640 1 --2- 172.21.15.19:0/1571458586 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5572a4adbbd0 0x5572a4ae7110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:30:07.653 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:07.647+0000 7f6f61a69640 1 -- 172.21.15.19:0/1571458586 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5572a4ad9190 msgr2=0x5572a4ae6a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:30:07.653 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:07.647+0000 7f6f61a69640 1 --2- 172.21.15.19:0/1571458586 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5572a4ad9190 0x5572a4ae6a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:30:07.653 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:07.647+0000 7f6f61a69640 1 -- 172.21.15.19:0/1571458586 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5572a4ae54a0 con 0x5572a4ad6860 2024-09-10T22:30:07.653 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:07.647+0000 7f6f6226a640 1 --2- 172.21.15.19:0/1571458586 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5572a4adbbd0 0x5572a4ae7110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T22:30:07.653 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:07.648+0000 7f6f61a69640 1 --2- 172.21.15.19:0/1571458586 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5572a4ad6860 0x5572a4ae7c30 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f6f58009da0 tx=0x7f6f58024190 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d89874fd9ff33a16 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:30:07.653 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:07.648+0000 7f6f457fa640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-09-10T22:30:07.653 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:07.648+0000 7f6f457fa640 1 -- 172.21.15.19:0/1571458586 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f580037a0 con 0x5572a4ad6860 2024-09-10T22:30:07.653 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:07.648+0000 7f6f66a9f740 1 -- 172.21.15.19:0/1571458586 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6f580035f0 con 0x5572a4ad6860 2024-09-10T22:30:07.653 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:07.648+0000 7f6f457fa640 1 -- 172.21.15.19:0/1571458586 <== mon.2 v2:172.21.15.135:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8327+0+0 (secure 0 0 0) 0x7f6f58003940 con 0x5572a4ad6860 2024-09-10T22:30:07.654 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:07.648+0000 7f6f457fa640 1 -- 172.21.15.19:0/1571458586 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f6f58003b80 con 0x5572a4ad6860 2024-09-10T22:30:07.654 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:07.648+0000 7f6f66a9f740 10 client.25580 fetch_fsmap learned FSMap version 27 2024-09-10T22:30:07.654 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:07.648+0000 7f6f66a9f740 1 -- 172.21.15.19:0/1571458586 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x5572a4b58930 con 0x5572a4ad6860 2024-09-10T22:30:07.654 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:07.648+0000 7f6f457fa640 1 -- 172.21.15.19:0/1571458586 <== mon.2 v2:172.21.15.135:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6f580035f0 con 0x5572a4ad6860 2024-09-10T22:30:07.654 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:07.648+0000 7f6f457fa640 1 -- 172.21.15.19:0/1571458586 <== mon.2 v2:172.21.15.135:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7f6f58004a30 con 0x5572a4ad6860 2024-09-10T22:30:07.654 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:07.648+0000 7f6f66a9f740 10 client.25580 fetch_fsmap finished waiting for FSMap version 27 2024-09-10T22:30:07.654 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:07.648+0000 7f6f66a9f740 10 client.25580 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-10T22:30:07.654 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:07.648+0000 7f6f66a9f740 20 client.25580 populate_metadata read hostname 'smithi019' 2024-09-10T22:30:07.654 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:07.648+0000 7f6f66a9f740 1 --2- 172.21.15.19:0/1571458586 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x5572a4b592b0 0x5572a4b5b6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:30:07.654 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:07.648+0000 7f6f66a9f740 4 client.25580 mds_command: new command op to 24581 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-10T22:30:07.654 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:07.648+0000 7f6f66a9f740 1 -- 172.21.15.19:0/1571458586 --> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5572a4a460f0 con 0x5572a4b592b0 2024-09-10T22:30:07.654 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:07.649+0000 7f6f61268640 1 --2- 172.21.15.19:0/1571458586 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x5572a4b592b0 0x5572a4b5b6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:30:07.654 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:07.649+0000 7f6f61268640 1 --2- 172.21.15.19:0/1571458586 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x5572a4b592b0 0x5572a4b5b6d0 crc :-1 s=READY pgs=93 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8bbb1569200d11d server_cookie=bf541b54584ef55f in_seq=0 out_seq=0 2024-09-10T22:30:07.655 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:07.649+0000 7f6f457fa640 10 client.25580 ms_handle_connect on v2:172.21.15.135:6838/1254769802 2024-09-10T22:30:07.875 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:30:07 smithi138 ceph-mon[35236]: pgmap v458: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 715 KiB/s rd, 381 MiB/s wr, 221 op/s 2024-09-10T22:30:07.958 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:30:07 smithi019 ceph-mon[31375]: pgmap v458: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 715 KiB/s rd, 381 MiB/s wr, 221 op/s 2024-09-10T22:30:08.050 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 22997a4c-6fc2-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-10T22:30:08.109 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:30:07 smithi135 ceph-mon[34789]: pgmap v458: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 715 KiB/s rd, 381 MiB/s wr, 221 op/s 2024-09-10T22:30:08.502 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/22997a4c-6fc2-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T22:30:09.220 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:09.218+0000 7f0e1a979640 1 -- 172.21.15.19:0/3255699506 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0e14108020 msgr2=0x7f0e1410e820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:30:09.220 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:09.218+0000 7f0e1a979640 1 --2- 172.21.15.19:0/3255699506 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0e14108020 0x7f0e1410e820 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7f0e0401a910 tx=0x7f0e0403b470 comp rx=0 tx=0).stop 2024-09-10T22:30:09.220 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:09.218+0000 7f0e1a979640 1 -- 172.21.15.19:0/3255699506 shutdown_connections 2024-09-10T22:30:09.220 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:09.218+0000 7f0e1a979640 1 --2- 172.21.15.19:0/3255699506 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0e14108020 0x7f0e1410e820 unknown :-1 s=CLOSED pgs=567 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:30:09.220 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:09.218+0000 7f0e1a979640 1 --2- 172.21.15.19:0/3255699506 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0e141076a0 0x7f0e14107ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:30:09.220 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:09.218+0000 7f0e1a979640 1 --2- 172.21.15.19:0/3255699506 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f0e14101c90 0x7f0e14102070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:30:09.221 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:09.218+0000 7f0e1a979640 1 -- 172.21.15.19:0/3255699506 >> 172.21.15.19:0/3255699506 conn(0x7f0e140fd700 msgr2=0x7f0e140ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:30:09.221 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:09.220+0000 7f0e1a979640 1 -- 172.21.15.19:0/3255699506 shutdown_connections 2024-09-10T22:30:09.221 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:09.220+0000 7f0e1a979640 1 -- 172.21.15.19:0/3255699506 wait complete. 2024-09-10T22:30:09.223 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:09.221+0000 7f0e1a979640 1 Processor -- start 2024-09-10T22:30:09.225 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:09.221+0000 7f0e1a979640 1 -- start start 2024-09-10T22:30:09.225 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:09.222+0000 7f0e1a979640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f0e14101c90 0x7f0e1406fab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:30:09.225 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:09.222+0000 7f0e1a979640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0e141076a0 0x7f0e1406fff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:30:09.225 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:09.222+0000 7f0e1a979640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0e14108020 0x7f0e1419caa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:30:09.225 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:09.222+0000 7f0e1a979640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f0e1406e330 con 0x7f0e14108020 2024-09-10T22:30:09.225 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:09.222+0000 7f0e1a979640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f0e1406e1b0 con 0x7f0e141076a0 2024-09-10T22:30:09.225 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:09.222+0000 7f0e1a979640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f0e1406e4b0 con 0x7f0e14101c90 2024-09-10T22:30:09.228 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:09.225+0000 7f0e18f16640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0e14108020 0x7f0e1419caa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:30:09.228 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:09.225+0000 7f0e18f16640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0e14108020 0x7f0e1419caa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:50564/0 (socket says 172.21.15.19:50564) 2024-09-10T22:30:09.228 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:09.225+0000 7f0e18f16640 1 -- 172.21.15.19:0/3533227557 learned_addr learned my addr 172.21.15.19:0/3533227557 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:30:09.229 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:09.225+0000 7f0e13fff640 1 --2- 172.21.15.19:0/3533227557 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f0e14101c90 0x7f0e1406fab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:30:09.229 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:09.226+0000 7f0e137fe640 1 --2- 172.21.15.19:0/3533227557 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0e141076a0 0x7f0e1406fff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:30:09.229 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:09.226+0000 7f0e18f16640 1 -- 172.21.15.19:0/3533227557 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f0e14101c90 msgr2=0x7f0e1406fab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:30:09.229 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:09.226+0000 7f0e18f16640 1 --2- 172.21.15.19:0/3533227557 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f0e14101c90 0x7f0e1406fab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:30:09.230 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:09.226+0000 7f0e18f16640 1 -- 172.21.15.19:0/3533227557 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0e141076a0 msgr2=0x7f0e1406fff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:30:09.230 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:09.226+0000 7f0e18f16640 1 --2- 172.21.15.19:0/3533227557 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0e141076a0 0x7f0e1406fff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:30:09.230 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:09.226+0000 7f0e18f16640 1 -- 172.21.15.19:0/3533227557 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0e1419d270 con 0x7f0e14108020 2024-09-10T22:30:09.230 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:09.228+0000 7f0e18f16640 1 --2- 172.21.15.19:0/3533227557 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0e14108020 0x7f0e1419caa0 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7f0e04006010 tx=0x7f0e04040f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:30:09.231 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:09.229+0000 7f0e117fa640 1 -- 172.21.15.19:0/3533227557 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e0404f070 con 0x7f0e14108020 2024-09-10T22:30:09.232 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:09.229+0000 7f0e1a979640 1 -- 172.21.15.19:0/3533227557 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0e1419d500 con 0x7f0e14108020 2024-09-10T22:30:09.232 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:09.230+0000 7f0e1a979640 1 -- 172.21.15.19:0/3533227557 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0e141941b0 con 0x7f0e14108020 2024-09-10T22:30:09.233 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:09.230+0000 7f0e117fa640 1 -- 172.21.15.19:0/3533227557 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0e04004bf0 con 0x7f0e14108020 2024-09-10T22:30:09.234 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:09.230+0000 7f0e117fa640 1 -- 172.21.15.19:0/3533227557 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e04046050 con 0x7f0e14108020 2024-09-10T22:30:09.237 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:09.235+0000 7f0e1cd4e740 1 Processor -- start 2024-09-10T22:30:09.238 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:09.235+0000 7f0e117fa640 1 -- 172.21.15.19:0/3533227557 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 18) ==== 153250+0+0 (secure 0 0 0) 0x7f0e0404b450 con 0x7f0e14108020 2024-09-10T22:30:09.239 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:09.235+0000 7f0e1cd4e740 1 -- start start 2024-09-10T22:30:09.239 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:09.236+0000 7f0e1cd4e740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55658239a0f0 0x55658239a4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:30:09.239 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:09.236+0000 7f0e1cd4e740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55658239aa10 0x5565823a6460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:30:09.239 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:09.236+0000 7f0e1cd4e740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5565823a69a0 0x5565823a8d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:30:09.239 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:09.236+0000 7f0e1cd4e740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x556582310ea0 con 0x5565823a69a0 2024-09-10T22:30:09.239 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:09.236+0000 7f0e1cd4e740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x5565823002d0 con 0x55658239aa10 2024-09-10T22:30:09.239 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:09.236+0000 7f0e1cd4e740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x5565823040e0 con 0x55658239a0f0 2024-09-10T22:30:09.239 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:09.236+0000 7f0e137fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5565823a69a0 0x5565823a8d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:30:09.239 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:09.236+0000 7f0e137fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5565823a69a0 0x5565823a8d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:50576/0 (socket says 172.21.15.19:50576) 2024-09-10T22:30:09.239 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:09.236+0000 7f0e137fe640 1 -- 172.21.15.19:0/962412249 learned_addr learned my addr 172.21.15.19:0/962412249 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:30:09.240 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:09.237+0000 7f0e137fe640 1 -- 172.21.15.19:0/962412249 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55658239a0f0 msgr2=0x55658239a4d0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-10T22:30:09.240 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:09.237+0000 7f0e137fe640 1 --2- 172.21.15.19:0/962412249 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55658239a0f0 0x55658239a4d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:30:09.240 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:09.237+0000 7f0e137fe640 1 -- 172.21.15.19:0/962412249 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55658239aa10 msgr2=0x5565823a6460 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-10T22:30:09.240 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:09.237+0000 7f0e137fe640 1 --2- 172.21.15.19:0/962412249 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55658239aa10 0x5565823a6460 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:30:09.240 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:09.237+0000 7f0e137fe640 1 -- 172.21.15.19:0/962412249 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55658205e650 con 0x5565823a69a0 2024-09-10T22:30:09.240 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:09.237+0000 7f0e137fe640 1 --2- 172.21.15.19:0/962412249 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5565823a69a0 0x5565823a8d90 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7f0e0c008e20 tx=0x7f0e0c00d570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fff7b517bf4979a2 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:30:09.240 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:09.237+0000 7f0e117fa640 1 --2- 172.21.15.19:0/3533227557 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f0dfc0b54e0 0x7f0dfc0b79a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:30:09.241 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:09.238+0000 7f0dfa7fc640 1 -- 172.21.15.19:0/962412249 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e0c016030 con 0x5565823a69a0 2024-09-10T22:30:09.241 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:09.238+0000 7f0dfa7fc640 1 -- 172.21.15.19:0/962412249 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0e0c0128f0 con 0x5565823a69a0 2024-09-10T22:30:09.241 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:09.238+0000 7f0dfa7fc640 1 -- 172.21.15.19:0/962412249 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e0c0117b0 con 0x5565823a69a0 2024-09-10T22:30:09.241 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:09.238+0000 7f0e117fa640 1 -- 172.21.15.19:0/3533227557 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8327+0+0 (secure 0 0 0) 0x7f0e04117500 con 0x7f0e14108020 2024-09-10T22:30:09.241 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:09.238+0000 7f0e13fff640 1 --2- 172.21.15.19:0/3533227557 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f0dfc0b54e0 0x7f0dfc0b79a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:30:09.242 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:09.238+0000 7f0e1cd4e740 1 -- 172.21.15.19:0/962412249 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5565823a69a0 msgr2=0x5565823a8d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:30:09.242 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:09.239+0000 7f0e1cd4e740 1 --2- 172.21.15.19:0/962412249 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5565823a69a0 0x5565823a8d90 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7f0e0c008e20 tx=0x7f0e0c00d570 comp rx=0 tx=0).stop 2024-09-10T22:30:09.242 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:09.239+0000 7f0e1cd4e740 1 -- 172.21.15.19:0/962412249 shutdown_connections 2024-09-10T22:30:09.242 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:09.239+0000 7f0e1cd4e740 1 --2- 172.21.15.19:0/962412249 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5565823a69a0 0x5565823a8d90 secure :-1 s=CLOSED pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7f0e0c008e20 tx=0x7f0e0c00d570 comp rx=0 tx=0).stop 2024-09-10T22:30:09.243 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:09.239+0000 7f0e1cd4e740 1 --2- 172.21.15.19:0/962412249 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55658239aa10 0x5565823a6460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:30:09.243 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:09.239+0000 7f0e1cd4e740 1 --2- 172.21.15.19:0/962412249 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55658239a0f0 0x55658239a4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:30:09.243 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:09.239+0000 7f0e1cd4e740 1 -- 172.21.15.19:0/962412249 >> 172.21.15.19:0/962412249 conn(0x556582397f20 msgr2=0x5565823990c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:30:09.243 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:09.239+0000 7f0e13fff640 1 --2- 172.21.15.19:0/3533227557 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f0dfc0b54e0 0x7f0dfc0b79a0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x556582398e00 tx=0x7f0e08008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:30:09.243 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:09.239+0000 7f0e1cd4e740 1 -- 172.21.15.19:0/962412249 shutdown_connections 2024-09-10T22:30:09.243 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:09.239+0000 7f0e1cd4e740 1 -- 172.21.15.19:0/962412249 wait complete. 2024-09-10T22:30:09.243 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:09.240+0000 7f0e1cd4e740 1 -- start start 2024-09-10T22:30:09.243 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:09.240+0000 7f0e1cd4e740 1 Processor -- start 2024-09-10T22:30:09.245 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:09.241+0000 7f0e1cd4e740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55658239a0f0 0x5565823a3900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:30:09.245 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:09.241+0000 7f0e1cd4e740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55658239aa10 0x5565823a3e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:30:09.245 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:09.241+0000 7f0e1cd4e740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5565823a4380 0x5565823b29e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:30:09.245 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:09.241+0000 7f0e1cd4e740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x556582161700 con 0x55658239a0f0 2024-09-10T22:30:09.245 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:09.241+0000 7f0e1cd4e740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55658229b160 con 0x55658239aa10 2024-09-10T22:30:09.245 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:09.241+0000 7f0e1cd4e740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x5565823a9620 con 0x5565823a4380 2024-09-10T22:30:09.245 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:09.241+0000 7f0e1cd4e740 10 client.0 _ll_register_callbacks cb 0x5565822b49e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T22:30:09.246 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:09.241+0000 7f0e13fff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55658239a0f0 0x5565823a3900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:30:09.246 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:09.241+0000 7f0e13fff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55658239a0f0 0x5565823a3900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:50588/0 (socket says 172.21.15.19:50588) 2024-09-10T22:30:09.246 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:09.241+0000 7f0e13fff640 1 -- 172.21.15.19:0/2102130736 learned_addr learned my addr 172.21.15.19:0/2102130736 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:30:09.246 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:09.241+0000 7f0e18f16640 1 --2- 172.21.15.19:0/2102130736 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5565823a4380 0x5565823b29e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:30:09.246 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:09.241+0000 7f0e13fff640 1 -- 172.21.15.19:0/2102130736 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5565823a4380 msgr2=0x5565823b29e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:30:09.246 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:09.241+0000 7f0e13fff640 1 --2- 172.21.15.19:0/2102130736 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5565823a4380 0x5565823b29e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:30:09.246 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:09.241+0000 7f0e13fff640 1 -- 172.21.15.19:0/2102130736 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55658239aa10 msgr2=0x5565823a3e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:30:09.246 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:09.242+0000 7f0e13fff640 1 --2- 172.21.15.19:0/2102130736 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55658239aa10 0x5565823a3e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:30:09.246 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:09.242+0000 7f0e13fff640 1 -- 172.21.15.19:0/2102130736 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5565822c8c90 con 0x55658239a0f0 2024-09-10T22:30:09.246 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:09.242+0000 7f0e13fff640 1 --2- 172.21.15.19:0/2102130736 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55658239a0f0 0x5565823a3900 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7f0e0800bfd0 tx=0x7f0e080047d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b238d9bf1bde7236 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:30:09.246 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:09.242+0000 7f0df37fe640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-10T22:30:09.246 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:09.242+0000 7f0df37fe640 1 -- 172.21.15.19:0/2102130736 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e08024060 con 0x55658239a0f0 2024-09-10T22:30:09.246 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:09.242+0000 7f0e1cd4e740 1 -- 172.21.15.19:0/2102130736 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0e0c0128f0 con 0x55658239a0f0 2024-09-10T22:30:09.246 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:09.242+0000 7f0df37fe640 1 -- 172.21.15.19:0/2102130736 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8327+0+0 (secure 0 0 0) 0x7f0e0801f400 con 0x55658239a0f0 2024-09-10T22:30:09.247 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:09.242+0000 7f0df37fe640 1 -- 172.21.15.19:0/2102130736 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f0e0801f600 con 0x55658239a0f0 2024-09-10T22:30:09.247 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:09.242+0000 7f0e1cd4e740 10 client.16116 fetch_fsmap learned FSMap version 27 2024-09-10T22:30:09.247 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:09.242+0000 7f0e1cd4e740 1 -- 172.21.15.19:0/2102130736 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x5565823b56c0 con 0x55658239a0f0 2024-09-10T22:30:09.248 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:09.243+0000 7f0df37fe640 1 -- 172.21.15.19:0/2102130736 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0e0c0128f0 con 0x55658239a0f0 2024-09-10T22:30:09.248 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:09.243+0000 7f0df37fe640 1 -- 172.21.15.19:0/2102130736 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7f0e08028030 con 0x55658239a0f0 2024-09-10T22:30:09.248 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:09.243+0000 7f0e1cd4e740 10 client.16116 fetch_fsmap finished waiting for FSMap version 27 2024-09-10T22:30:09.248 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:09.243+0000 7f0e1cd4e740 10 client.16116 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-10T22:30:09.248 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:09.243+0000 7f0e1cd4e740 20 client.16116 populate_metadata read hostname 'smithi019' 2024-09-10T22:30:09.248 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:09.243+0000 7f0e1cd4e740 1 --2- 172.21.15.19:0/2102130736 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x5565823b6b70 0x5565823b9030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:30:09.248 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:09.243+0000 7f0e1cd4e740 4 client.16116 mds_command: new command op to 24581 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T22:30:09.248 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:09.243+0000 7f0e1cd4e740 1 -- 172.21.15.19:0/2102130736 --> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x556582312df0 con 0x5565823b6b70 2024-09-10T22:30:09.248 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:09.245+0000 7f0e137fe640 1 --2- 172.21.15.19:0/2102130736 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x5565823b6b70 0x5565823b9030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:30:09.253 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:09.251+0000 7f0df37fe640 10 client.16116 ms_handle_connect on v2:172.21.15.135:6838/1254769802 2024-09-10T22:30:09.253 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:09.251+0000 7f0e137fe640 1 --2- 172.21.15.19:0/2102130736 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x5565823b6b70 0x5565823b9030 crc :-1 s=READY pgs=94 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5746937c57e0b79c server_cookie=93418e439cc20c9a in_seq=0 out_seq=0 2024-09-10T22:30:09.254 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:09.252+0000 7f0df37fe640 1 -- 172.21.15.19:0/2102130736 <== mds.0 v2:172.21.15.135:6838/1254769802 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x556582312df0 con 0x5565823b6b70 2024-09-10T22:30:09.254 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:09.252+0000 7f0df37fe640 10 client.16116 handle_command_reply: tid=0 2024-09-10T22:30:09.255 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:09.252+0000 7f0e1cd4e740 1 client.16116 shutdown 2024-09-10T22:30:09.256 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:09.253+0000 7f0e1cd4e740 1 -- 172.21.15.19:0/2102130736 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55658239a0f0 msgr2=0x5565823a3900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:30:09.256 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:09.253+0000 7f0e1cd4e740 1 --2- 172.21.15.19:0/2102130736 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55658239a0f0 0x5565823a3900 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7f0e0800bfd0 tx=0x7f0e080047d0 comp rx=0 tx=0).stop 2024-09-10T22:30:09.257 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:09.253+0000 7f0e1cd4e740 1 -- 172.21.15.19:0/2102130736 shutdown_connections 2024-09-10T22:30:09.257 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:09.253+0000 7f0e1cd4e740 1 --2- 172.21.15.19:0/2102130736 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x5565823b6b70 0x5565823b9030 crc :-1 s=READY pgs=94 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:30:09.257 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:09.253+0000 7f0e1cd4e740 1 --2- 172.21.15.19:0/2102130736 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5565823a4380 0x5565823b29e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:30:09.257 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:09.253+0000 7f0e1cd4e740 1 --2- 172.21.15.19:0/2102130736 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55658239aa10 0x5565823a3e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:30:09.257 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:09.253+0000 7f0df37fe640 0 client.16116 ms_handle_reset on v2:172.21.15.135:6838/1254769802 2024-09-10T22:30:09.257 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:09.253+0000 7f0e1cd4e740 1 --2- 172.21.15.19:0/2102130736 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55658239a0f0 0x5565823a3900 secure :-1 s=CLOSED pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7f0e0800bfd0 tx=0x7f0e080047d0 comp rx=0 tx=0).stop 2024-09-10T22:30:09.257 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:09.253+0000 7f0e1cd4e740 1 -- 172.21.15.19:0/2102130736 >> 172.21.15.19:0/2102130736 conn(0x556582397f20 msgr2=0x55658239da90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:30:09.257 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:09.253+0000 7f0e1cd4e740 1 -- 172.21.15.19:0/2102130736 shutdown_connections 2024-09-10T22:30:09.257 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:09.254+0000 7f0e1cd4e740 1 -- 172.21.15.19:0/2102130736 wait complete. 2024-09-10T22:30:09.258 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:09.254+0000 7f0e1cd4e740 20 client.16116 trim_cache size 0 max 16384 2024-09-10T22:30:09.283 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:09.281+0000 7f0e1cd4e740 1 Processor -- start 2024-09-10T22:30:09.283 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:09.281+0000 7f0e1cd4e740 1 -- start start 2024-09-10T22:30:09.283 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:09.282+0000 7f0e1cd4e740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55658239aa10 0x556582392e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:30:09.284 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:09.282+0000 7f0e1cd4e740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5565823a4380 0x5565823a2890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:30:09.284 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:09.282+0000 7f0e1cd4e740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5565823b28e0 0x5565823b2d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:30:09.284 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:09.282+0000 7f0e1cd4e740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f0e00010ef0 con 0x5565823b28e0 2024-09-10T22:30:09.284 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:09.282+0000 7f0e1cd4e740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f0e0000e7c0 con 0x55658239aa10 2024-09-10T22:30:09.285 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:09.282+0000 7f0e18f16640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5565823b28e0 0x5565823b2d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:30:09.285 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:09.283+0000 7f0e18f16640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5565823b28e0 0x5565823b2d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:50600/0 (socket says 172.21.15.19:50600) 2024-09-10T22:30:09.285 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:09.283+0000 7f0e18f16640 1 -- 172.21.15.19:0/1106617896 learned_addr learned my addr 172.21.15.19:0/1106617896 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:30:09.285 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:09.283+0000 7f0e1cd4e740 1 -- 172.21.15.19:0/1106617896 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f0e0000c610 con 0x5565823a4380 2024-09-10T22:30:09.286 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:09.283+0000 7f0e18f16640 1 -- 172.21.15.19:0/1106617896 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5565823a4380 msgr2=0x5565823a2890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:30:09.286 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:09.283+0000 7f0e18f16640 1 --2- 172.21.15.19:0/1106617896 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5565823a4380 0x5565823a2890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:30:09.286 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:09.283+0000 7f0e18f16640 1 -- 172.21.15.19:0/1106617896 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55658239aa10 msgr2=0x556582392e70 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-10T22:30:09.286 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:09.283+0000 7f0e18f16640 1 --2- 172.21.15.19:0/1106617896 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55658239aa10 0x556582392e70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:30:09.287 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:09.283+0000 7f0e18f16640 1 -- 172.21.15.19:0/1106617896 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5565823989a0 con 0x5565823b28e0 2024-09-10T22:30:09.287 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:09.284+0000 7f0e18f16640 1 --2- 172.21.15.19:0/1106617896 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5565823b28e0 0x5565823b2d70 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f0e040dae70 tx=0x7f0e040dd370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e443ae291db30f21 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:30:09.287 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:09.284+0000 7f0df9ffb640 1 -- 172.21.15.19:0/1106617896 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e04059040 con 0x5565823b28e0 2024-09-10T22:30:09.287 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:09.284+0000 7f0df9ffb640 1 -- 172.21.15.19:0/1106617896 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0e040e2030 con 0x5565823b28e0 2024-09-10T22:30:09.287 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:09.284+0000 7f0df9ffb640 1 -- 172.21.15.19:0/1106617896 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e040e7190 con 0x5565823b28e0 2024-09-10T22:30:09.288 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:09.285+0000 7f0e1cd4e740 1 -- 172.21.15.19:0/1106617896 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5565823b28e0 msgr2=0x5565823b2d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:30:09.288 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:09.285+0000 7f0e1cd4e740 1 --2- 172.21.15.19:0/1106617896 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5565823b28e0 0x5565823b2d70 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f0e040dae70 tx=0x7f0e040dd370 comp rx=0 tx=0).stop 2024-09-10T22:30:09.288 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:09.285+0000 7f0e1cd4e740 1 -- 172.21.15.19:0/1106617896 shutdown_connections 2024-09-10T22:30:09.289 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:09.285+0000 7f0e1cd4e740 1 --2- 172.21.15.19:0/1106617896 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5565823b28e0 0x5565823b2d70 unknown :-1 s=CLOSED pgs=571 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:30:09.289 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:09.285+0000 7f0e1cd4e740 1 --2- 172.21.15.19:0/1106617896 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5565823a4380 0x5565823a2890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:30:09.292 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:09.285+0000 7f0e1cd4e740 1 --2- 172.21.15.19:0/1106617896 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55658239aa10 0x556582392e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:30:09.292 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:09.285+0000 7f0e1cd4e740 1 -- 172.21.15.19:0/1106617896 >> 172.21.15.19:0/1106617896 conn(0x556582397f20 msgr2=0x5565823a2180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:30:09.292 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:09.286+0000 7f0e1cd4e740 1 -- 172.21.15.19:0/1106617896 shutdown_connections 2024-09-10T22:30:09.292 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:09.286+0000 7f0e1cd4e740 1 -- 172.21.15.19:0/1106617896 wait complete. 2024-09-10T22:30:09.292 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:09.286+0000 7f0e1cd4e740 1 -- start start 2024-09-10T22:30:09.292 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:09.286+0000 7f0e1cd4e740 1 Processor -- start 2024-09-10T22:30:09.293 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:09.287+0000 7f0e1cd4e740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55658239aa10 0x5565823af0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:30:09.293 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:09.287+0000 7f0e1cd4e740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5565823a4380 0x5565823ab5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:30:09.293 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:09.287+0000 7f0e1cd4e740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5565823b28e0 0x5565823abae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:30:09.293 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:09.287+0000 7f0e1cd4e740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f0e0000cc80 con 0x5565823a4380 2024-09-10T22:30:09.293 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:09.287+0000 7f0e1cd4e740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f0e0000e0f0 con 0x5565823b28e0 2024-09-10T22:30:09.293 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:09.287+0000 7f0e1cd4e740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f0e0000d350 con 0x55658239aa10 2024-09-10T22:30:09.293 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:09.287+0000 7f0e1cd4e740 10 client.0 _ll_register_callbacks cb 0x7f0e0800b420 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T22:30:09.293 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:09.287+0000 7f0e137fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5565823a4380 0x5565823ab5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:30:09.293 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:09.287+0000 7f0e137fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5565823a4380 0x5565823ab5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:50608/0 (socket says 172.21.15.19:50608) 2024-09-10T22:30:09.293 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:09.287+0000 7f0e137fe640 1 -- 172.21.15.19:0/687705534 learned_addr learned my addr 172.21.15.19:0/687705534 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:30:09.293 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:09.287+0000 7f0e13fff640 1 --2- 172.21.15.19:0/687705534 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55658239aa10 0x5565823af0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:30:09.293 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:09.287+0000 7f0e137fe640 1 -- 172.21.15.19:0/687705534 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55658239aa10 msgr2=0x5565823af0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:30:09.294 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:09.287+0000 7f0e137fe640 1 --2- 172.21.15.19:0/687705534 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55658239aa10 0x5565823af0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:30:09.294 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:09.287+0000 7f0e137fe640 1 -- 172.21.15.19:0/687705534 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5565823b28e0 msgr2=0x5565823abae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:30:09.294 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:09.288+0000 7f0e137fe640 1 --2- 172.21.15.19:0/687705534 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5565823b28e0 0x5565823abae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:30:09.294 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:09.288+0000 7f0e137fe640 1 -- 172.21.15.19:0/687705534 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5565823ac2e0 con 0x5565823a4380 2024-09-10T22:30:09.294 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:09.288+0000 7f0e13fff640 1 --2- 172.21.15.19:0/687705534 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55658239aa10 0x5565823af0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T22:30:09.294 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:09.288+0000 7f0e137fe640 1 --2- 172.21.15.19:0/687705534 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5565823a4380 0x5565823ab5a0 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f0e0c004a80 tx=0x7f0e0c0082e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=26d0109230a02b50 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:30:09.294 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:09.288+0000 7f0df37fe640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-10T22:30:09.294 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:09.288+0000 7f0df37fe640 1 -- 172.21.15.19:0/687705534 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e0c01c870 con 0x5565823a4380 2024-09-10T22:30:09.294 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:09.288+0000 7f0e1cd4e740 1 -- 172.21.15.19:0/687705534 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0e040e2030 con 0x5565823a4380 2024-09-10T22:30:09.294 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:09.289+0000 7f0df37fe640 1 -- 172.21.15.19:0/687705534 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8327+0+0 (secure 0 0 0) 0x7f0e0c01ca10 con 0x5565823a4380 2024-09-10T22:30:09.294 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:09.289+0000 7f0df37fe640 1 -- 172.21.15.19:0/687705534 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f0e0c033050 con 0x5565823a4380 2024-09-10T22:30:09.295 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:09.289+0000 7f0e1cd4e740 10 client.16122 fetch_fsmap learned FSMap version 27 2024-09-10T22:30:09.295 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:09.289+0000 7f0e1cd4e740 1 -- 172.21.15.19:0/687705534 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x556582446b80 con 0x5565823a4380 2024-09-10T22:30:09.295 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:09.289+0000 7f0df37fe640 1 -- 172.21.15.19:0/687705534 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0e040e2030 con 0x5565823a4380 2024-09-10T22:30:09.295 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:09.290+0000 7f0df37fe640 1 -- 172.21.15.19:0/687705534 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7f0e0c012a80 con 0x5565823a4380 2024-09-10T22:30:09.295 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:09.290+0000 7f0e1cd4e740 10 client.16122 fetch_fsmap finished waiting for FSMap version 27 2024-09-10T22:30:09.295 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:09.290+0000 7f0e1cd4e740 10 client.16122 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-10T22:30:09.295 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:09.290+0000 7f0e1cd4e740 20 client.16122 populate_metadata read hostname 'smithi019' 2024-09-10T22:30:09.295 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:09.290+0000 7f0e1cd4e740 1 --2- 172.21.15.19:0/687705534 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x556582446f80 0x556582449370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:30:09.296 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:09.290+0000 7f0e1cd4e740 4 client.16122 mds_command: new command op to 24581 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-10T22:30:09.296 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:09.290+0000 7f0e1cd4e740 1 -- 172.21.15.19:0/687705534 --> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55658230e8a0 con 0x556582446f80 2024-09-10T22:30:09.296 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:09.291+0000 7f0e13fff640 1 --2- 172.21.15.19:0/687705534 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x556582446f80 0x556582449370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:30:09.298 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:09.297+0000 7f0df37fe640 10 client.16122 ms_handle_connect on v2:172.21.15.135:6838/1254769802 2024-09-10T22:30:09.299 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:09.297+0000 7f0e13fff640 1 --2- 172.21.15.19:0/687705534 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x556582446f80 0x556582449370 crc :-1 s=READY pgs=95 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bdcf66f67fa6b6a4 server_cookie=e22ec771519833ce in_seq=0 out_seq=0 2024-09-10T22:30:09.302 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:09.300+0000 7f0df37fe640 1 -- 172.21.15.19:0/687705534 <== mds.0 v2:172.21.15.135:6838/1254769802 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55658230e8a0 con 0x556582446f80 2024-09-10T22:30:09.302 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:09.300+0000 7f0df37fe640 10 client.16122 handle_command_reply: tid=0 2024-09-10T22:30:09.302 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:09.300+0000 7f0e1cd4e740 1 client.16122 shutdown 2024-09-10T22:30:09.303 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:09.301+0000 7f0e1cd4e740 1 -- 172.21.15.19:0/687705534 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5565823a4380 msgr2=0x5565823ab5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:30:09.303 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:09.301+0000 7f0e1cd4e740 1 --2- 172.21.15.19:0/687705534 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5565823a4380 0x5565823ab5a0 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f0e0c004a80 tx=0x7f0e0c0082e0 comp rx=0 tx=0).stop 2024-09-10T22:30:09.303 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:09.301+0000 7f0e1cd4e740 1 -- 172.21.15.19:0/687705534 shutdown_connections 2024-09-10T22:30:09.303 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:09.301+0000 7f0e1cd4e740 1 --2- 172.21.15.19:0/687705534 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5565823b28e0 0x5565823abae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:30:09.304 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:09.301+0000 7f0e1cd4e740 1 --2- 172.21.15.19:0/687705534 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5565823a4380 0x5565823ab5a0 unknown :-1 s=CLOSED pgs=572 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:30:09.304 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:09.301+0000 7f0e1cd4e740 1 --2- 172.21.15.19:0/687705534 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x556582446f80 0x556582449370 crc :-1 s=READY pgs=95 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:30:09.304 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:09.301+0000 7f0df37fe640 0 client.16122 ms_handle_reset on v2:172.21.15.135:6838/1254769802 2024-09-10T22:30:09.304 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:09.301+0000 7f0e1cd4e740 1 --2- 172.21.15.19:0/687705534 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55658239aa10 0x5565823af0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:30:09.304 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:09.301+0000 7f0e1cd4e740 1 -- 172.21.15.19:0/687705534 >> 172.21.15.19:0/687705534 conn(0x556582397f20 msgr2=0x5565823a2180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:30:09.304 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:09.301+0000 7f0e1cd4e740 1 -- 172.21.15.19:0/687705534 shutdown_connections 2024-09-10T22:30:09.304 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:09.301+0000 7f0e1cd4e740 1 -- 172.21.15.19:0/687705534 wait complete. 2024-09-10T22:30:09.304 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:09.302+0000 7f0e1cd4e740 20 client.16122 trim_cache size 0 max 16384 2024-09-10T22:30:09.305 INFO:teuthology.orchestra.run.smithi019.stdout:[] 2024-09-10T22:30:09.306 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:09.303+0000 7f0e1a979640 1 -- 172.21.15.19:0/3533227557 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f0dfc0b54e0 msgr2=0x7f0dfc0b79a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:30:09.306 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:09.303+0000 7f0e1a979640 1 --2- 172.21.15.19:0/3533227557 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f0dfc0b54e0 0x7f0dfc0b79a0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x556582398e00 tx=0x7f0e08008040 comp rx=0 tx=0).stop 2024-09-10T22:30:09.306 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:09.303+0000 7f0e1a979640 1 -- 172.21.15.19:0/3533227557 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0e14108020 msgr2=0x7f0e1419caa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:30:09.306 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:09.303+0000 7f0e1a979640 1 --2- 172.21.15.19:0/3533227557 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0e14108020 0x7f0e1419caa0 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7f0e04006010 tx=0x7f0e04040f70 comp rx=0 tx=0).stop 2024-09-10T22:30:09.306 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:09.303+0000 7f0e1a979640 1 -- 172.21.15.19:0/3533227557 shutdown_connections 2024-09-10T22:30:09.306 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:09.303+0000 7f0e1a979640 1 --2- 172.21.15.19:0/3533227557 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f0dfc0b54e0 0x7f0dfc0b79a0 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:30:09.306 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:09.303+0000 7f0e1a979640 1 --2- 172.21.15.19:0/3533227557 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0e14108020 0x7f0e1419caa0 unknown :-1 s=CLOSED pgs=568 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:30:09.306 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:09.303+0000 7f0e1a979640 1 --2- 172.21.15.19:0/3533227557 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0e141076a0 0x7f0e1406fff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:30:09.306 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:09.303+0000 7f0e1a979640 1 --2- 172.21.15.19:0/3533227557 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f0e14101c90 0x7f0e1406fab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:30:09.306 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:09.303+0000 7f0e1a979640 1 -- 172.21.15.19:0/3533227557 >> 172.21.15.19:0/3533227557 conn(0x7f0e140fd700 msgr2=0x7f0e140ffaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:30:09.308 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:09.307+0000 7f0e1a979640 1 -- 172.21.15.19:0/3533227557 shutdown_connections 2024-09-10T22:30:09.308 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:09.307+0000 7f0e1a979640 1 -- 172.21.15.19:0/3533227557 wait complete. 2024-09-10T22:30:09.859 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:30:09 smithi135 ceph-mon[34789]: pgmap v459: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 655 KiB/s rd, 337 MiB/s wr, 198 op/s 2024-09-10T22:30:09.887 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:30:09 smithi019 ceph-mon[31375]: pgmap v459: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 655 KiB/s rd, 337 MiB/s wr, 198 op/s 2024-09-10T22:30:10.125 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:30:09 smithi138 ceph-mon[35236]: pgmap v459: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 655 KiB/s rd, 337 MiB/s wr, 198 op/s 2024-09-10T22:30:11.089 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:11.087+0000 7f6f457fa640 1 -- 172.21.15.19:0/1571458586 <== mds.0 v2:172.21.15.135:6838/1254769802 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5572a4a460f0 con 0x5572a4b592b0 2024-09-10T22:30:11.089 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:11.087+0000 7f6f457fa640 10 client.25580 handle_command_reply: tid=0 2024-09-10T22:30:11.089 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:11.087+0000 7f6f66a9f740 1 client.25580 shutdown 2024-09-10T22:30:11.090 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:11.087+0000 7f6f66a9f740 1 -- 172.21.15.19:0/1571458586 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5572a4ad6860 msgr2=0x5572a4ae7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:30:11.090 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:11.087+0000 7f6f66a9f740 1 --2- 172.21.15.19:0/1571458586 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5572a4ad6860 0x5572a4ae7c30 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f6f58009da0 tx=0x7f6f58024190 comp rx=0 tx=0).stop 2024-09-10T22:30:11.090 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:11.087+0000 7f6f66a9f740 1 -- 172.21.15.19:0/1571458586 shutdown_connections 2024-09-10T22:30:11.090 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:11.087+0000 7f6f66a9f740 1 --2- 172.21.15.19:0/1571458586 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x5572a4b592b0 0x5572a4b5b6d0 crc :-1 s=READY pgs=93 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:30:11.090 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:11.087+0000 7f6f66a9f740 1 --2- 172.21.15.19:0/1571458586 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5572a4adbbd0 0x5572a4ae7110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:30:11.090 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:11.087+0000 7f6f66a9f740 1 --2- 172.21.15.19:0/1571458586 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5572a4ad9190 0x5572a4ae6a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:30:11.090 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:11.087+0000 7f6f66a9f740 1 --2- 172.21.15.19:0/1571458586 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5572a4ad6860 0x5572a4ae7c30 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:30:11.090 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:11.087+0000 7f6f66a9f740 1 -- 172.21.15.19:0/1571458586 >> 172.21.15.19:0/1571458586 conn(0x5572a4ad19b0 msgr2=0x5572a4ad58f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:30:11.090 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:11.087+0000 7f6f457fa640 0 client.25580 ms_handle_reset on v2:172.21.15.135:6838/1254769802 2024-09-10T22:30:11.090 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:11.087+0000 7f6f66a9f740 1 -- 172.21.15.19:0/1571458586 shutdown_connections 2024-09-10T22:30:11.090 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:11.087+0000 7f6f66a9f740 1 -- 172.21.15.19:0/1571458586 wait complete. 2024-09-10T22:30:11.091 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:11.088+0000 7f6f66a9f740 20 client.25580 trim_cache size 0 max 16384 2024-09-10T22:30:11.091 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stdout:{ 2024-09-10T22:30:11.091 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stdout: "message": "", 2024-09-10T22:30:11.091 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stdout: "return_code": 0 2024-09-10T22:30:11.091 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stdout:} 2024-09-10T22:30:11.092 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:11.089+0000 7f6f63ccd640 1 -- 172.21.15.19:0/2503952355 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f6f480b52e0 msgr2=0x7f6f480b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:30:11.093 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:11.089+0000 7f6f63ccd640 1 --2- 172.21.15.19:0/2503952355 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f6f480b52e0 0x7f6f480b77a0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f6f58009fd0 tx=0x7f6f58009260 comp rx=0 tx=0).stop 2024-09-10T22:30:11.093 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:11.089+0000 7f6f63ccd640 1 -- 172.21.15.19:0/2503952355 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6f5c1029b0 msgr2=0x7f6f5c199360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:30:11.093 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:11.089+0000 7f6f63ccd640 1 --2- 172.21.15.19:0/2503952355 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6f5c1029b0 0x7f6f5c199360 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f6f4c00e9f0 tx=0x7f6f4c00eeb0 comp rx=0 tx=0).stop 2024-09-10T22:30:11.093 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:11.089+0000 7f6f63ccd640 1 -- 172.21.15.19:0/2503952355 shutdown_connections 2024-09-10T22:30:11.093 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:11.089+0000 7f6f63ccd640 1 --2- 172.21.15.19:0/2503952355 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f6f480b52e0 0x7f6f480b77a0 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:30:11.093 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:11.089+0000 7f6f63ccd640 1 --2- 172.21.15.19:0/2503952355 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6f5c103370 0x7f6f5c199f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:30:11.093 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:11.089+0000 7f6f63ccd640 1 --2- 172.21.15.19:0/2503952355 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6f5c1029b0 0x7f6f5c199360 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:30:11.093 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:11.089+0000 7f6f63ccd640 1 --2- 172.21.15.19:0/2503952355 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f6f5c101860 0x7f6f5c198d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:30:11.093 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:11.089+0000 7f6f63ccd640 1 -- 172.21.15.19:0/2503952355 >> 172.21.15.19:0/2503952355 conn(0x7f6f5c0fd140 msgr2=0x7f6f5c0feb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:30:11.093 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:11.090+0000 7f6f63ccd640 1 -- 172.21.15.19:0/2503952355 shutdown_connections 2024-09-10T22:30:11.093 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:11.090+0000 7f6f63ccd640 1 -- 172.21.15.19:0/2503952355 wait complete. 2024-09-10T22:30:11.349 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-10T22:30:11.350 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 22997a4c-6fc2-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-10T22:30:11.659 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:30:11 smithi019 ceph-mon[31375]: pgmap v460: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 397 MiB/s wr, 230 op/s 2024-09-10T22:30:11.679 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/22997a4c-6fc2-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T22:30:12.109 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:30:11 smithi135 ceph-mon[34789]: pgmap v460: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 397 MiB/s wr, 230 op/s 2024-09-10T22:30:12.125 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:30:11 smithi138 ceph-mon[35236]: pgmap v460: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 397 MiB/s wr, 230 op/s 2024-09-10T22:30:12.588 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:12.425+0000 7f0a1828a640 1 -- 172.21.15.19:0/434314716 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0a10105f70 msgr2=0x7f0a1010f990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:30:12.588 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:12.425+0000 7f0a1828a640 1 --2- 172.21.15.19:0/434314716 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0a10105f70 0x7f0a1010f990 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7f0a08009ca0 tx=0x7f0a0802a8c0 comp rx=0 tx=0).stop 2024-09-10T22:30:12.589 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:12.425+0000 7f0a1828a640 1 -- 172.21.15.19:0/434314716 shutdown_connections 2024-09-10T22:30:12.589 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:12.425+0000 7f0a1828a640 1 --2- 172.21.15.19:0/434314716 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0a10105f70 0x7f0a1010f990 unknown :-1 s=CLOSED pgs=573 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:30:12.589 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:12.425+0000 7f0a1828a640 1 --2- 172.21.15.19:0/434314716 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f0a101055b0 0x7f0a10105a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:30:12.589 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:12.425+0000 7f0a1828a640 1 --2- 172.21.15.19:0/434314716 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0a101012f0 0x7f0a101016d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:30:12.589 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:12.425+0000 7f0a1828a640 1 -- 172.21.15.19:0/434314716 >> 172.21.15.19:0/434314716 conn(0x7f0a10078140 msgr2=0x7f0a100ff530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:30:12.589 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:12.425+0000 7f0a1828a640 1 -- 172.21.15.19:0/434314716 shutdown_connections 2024-09-10T22:30:12.589 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:12.425+0000 7f0a1828a640 1 -- 172.21.15.19:0/434314716 wait complete. 2024-09-10T22:30:12.589 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:12.426+0000 7f0a1828a640 1 Processor -- start 2024-09-10T22:30:12.589 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:12.426+0000 7f0a1828a640 1 -- start start 2024-09-10T22:30:12.589 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:12.427+0000 7f0a1828a640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f0a101012f0 0x7f0a1010eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:30:12.590 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:12.427+0000 7f0a1828a640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0a101055b0 0x7f0a1010f070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:30:12.590 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:12.427+0000 7f0a15825640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0a101055b0 0x7f0a1010f070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:30:12.590 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:12.427+0000 7f0a15825640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0a101055b0 0x7f0a1010f070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:50628/0 (socket says 172.21.15.19:50628) 2024-09-10T22:30:12.590 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:12.427+0000 7f0a15825640 1 -- 172.21.15.19:0/298924888 learned_addr learned my addr 172.21.15.19:0/298924888 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:30:12.590 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:12.428+0000 7f0a1828a640 1 --2- 172.21.15.19:0/298924888 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0a10105f70 0x7f0a1019fb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:30:12.590 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:12.428+0000 7f0a1828a640 1 -- 172.21.15.19:0/298924888 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f0a10112dd0 con 0x7f0a101055b0 2024-09-10T22:30:12.590 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:12.428+0000 7f0a1828a640 1 -- 172.21.15.19:0/298924888 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f0a10112c50 con 0x7f0a10105f70 2024-09-10T22:30:12.590 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:12.428+0000 7f0a1828a640 1 -- 172.21.15.19:0/298924888 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f0a10112f50 con 0x7f0a101012f0 2024-09-10T22:30:12.590 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:12.428+0000 7f0a16026640 1 --2- 172.21.15.19:0/298924888 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f0a101012f0 0x7f0a1010eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:30:12.590 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:12.428+0000 7f0a16827640 1 --2- 172.21.15.19:0/298924888 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0a10105f70 0x7f0a1019fb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:30:12.590 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:12.428+0000 7f0a16026640 1 -- 172.21.15.19:0/298924888 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0a10105f70 msgr2=0x7f0a1019fb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:30:12.590 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:12.428+0000 7f0a16026640 1 --2- 172.21.15.19:0/298924888 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0a10105f70 0x7f0a1019fb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:30:12.590 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:12.428+0000 7f0a16026640 1 -- 172.21.15.19:0/298924888 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0a101055b0 msgr2=0x7f0a1010f070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:30:12.591 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:12.428+0000 7f0a16026640 1 --2- 172.21.15.19:0/298924888 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0a101055b0 0x7f0a1010f070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:30:12.591 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:12.428+0000 7f0a16026640 1 -- 172.21.15.19:0/298924888 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0a101a02b0 con 0x7f0a101012f0 2024-09-10T22:30:12.591 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:12.429+0000 7f0a16026640 1 --2- 172.21.15.19:0/298924888 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f0a101012f0 0x7f0a1010eb30 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f0a0c00b3f0 tx=0x7f0a0c00b8b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:30:12.591 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:12.429+0000 7f0a077fe640 1 -- 172.21.15.19:0/298924888 <== mon.1 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a0c015020 con 0x7f0a101012f0 2024-09-10T22:30:12.591 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:12.429+0000 7f0a077fe640 1 -- 172.21.15.19:0/298924888 <== mon.1 v2:172.21.15.138:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0a0c011ce0 con 0x7f0a101012f0 2024-09-10T22:30:12.591 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:12.429+0000 7f0a077fe640 1 -- 172.21.15.19:0/298924888 <== mon.1 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a0c010d80 con 0x7f0a101012f0 2024-09-10T22:30:12.591 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:12.430+0000 7f0a1828a640 1 -- 172.21.15.19:0/298924888 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0a101a05a0 con 0x7f0a101012f0 2024-09-10T22:30:12.591 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:12.430+0000 7f0a1828a640 1 -- 172.21.15.19:0/298924888 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0a1019ca30 con 0x7f0a101012f0 2024-09-10T22:30:12.591 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:12.432+0000 7f0a1a65f740 1 Processor -- start 2024-09-10T22:30:12.591 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:12.433+0000 7f0a1a65f740 1 -- start start 2024-09-10T22:30:12.591 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:12.433+0000 7f0a1a65f740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x556a3aed5ee0 0x556a3aed62c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:30:12.591 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:12.433+0000 7f0a1a65f740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556a3aed6800 0x556a3aee2250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:30:12.591 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:12.433+0000 7f0a1a65f740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x556a3aee2790 0x556a3aee4b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:30:12.592 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:12.433+0000 7f0a1a65f740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x556a3ae4ce60 con 0x556a3aed5ee0 2024-09-10T22:30:12.592 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:12.433+0000 7f0a1a65f740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x556a3ae3c290 con 0x556a3aed6800 2024-09-10T22:30:12.592 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:12.433+0000 7f0a1a65f740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x556a3ae400a0 con 0x556a3aee2790 2024-09-10T22:30:12.592 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:12.434+0000 7f0a15825640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x556a3aee2790 0x556a3aee4b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:30:12.592 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:12.434+0000 7f0a15825640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x556a3aee2790 0x556a3aee4b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.19:50710/0 (socket says 172.21.15.19:50710) 2024-09-10T22:30:12.592 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:12.434+0000 7f0a15825640 1 -- 172.21.15.19:0/2024383159 learned_addr learned my addr 172.21.15.19:0/2024383159 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:30:12.592 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:12.434+0000 7f0a16827640 1 --2- 172.21.15.19:0/2024383159 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x556a3aed5ee0 0x556a3aed62c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:30:12.592 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:12.434+0000 7f0a077fe640 1 -- 172.21.15.19:0/298924888 <== mon.1 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 18) ==== 153250+0+0 (secure 0 0 0) 0x7f0a0c011830 con 0x7f0a101012f0 2024-09-10T22:30:12.592 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:12.434+0000 7f0a15825640 1 -- 172.21.15.19:0/2024383159 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556a3aed6800 msgr2=0x556a3aee2250 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-10T22:30:12.592 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:12.434+0000 7f0a15825640 1 --2- 172.21.15.19:0/2024383159 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556a3aed6800 0x556a3aee2250 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:30:12.592 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:12.434+0000 7f0a15825640 1 -- 172.21.15.19:0/2024383159 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x556a3aed5ee0 msgr2=0x556a3aed62c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:30:12.593 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:12.434+0000 7f0a15825640 1 --2- 172.21.15.19:0/2024383159 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x556a3aed5ee0 0x556a3aed62c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:30:12.593 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:12.434+0000 7f0a15825640 1 -- 172.21.15.19:0/2024383159 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556a3ab9a930 con 0x556a3aee2790 2024-09-10T22:30:12.593 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:12.434+0000 7f0a16827640 1 --2- 172.21.15.19:0/2024383159 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x556a3aed5ee0 0x556a3aed62c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T22:30:12.593 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:12.435+0000 7f0a15825640 1 --2- 172.21.15.19:0/2024383159 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x556a3aee2790 0x556a3aee4b80 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f0a00009d70 tx=0x7f0a00011810 comp rx=0 tx=0).ready entity=mon.1 client_cookie=42c91963b6208c5d server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:30:12.593 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:12.435+0000 7f0a04de6640 1 -- 172.21.15.19:0/2024383159 <== mon.1 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a00004230 con 0x556a3aee2790 2024-09-10T22:30:12.593 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:12.435+0000 7f0a04de6640 1 -- 172.21.15.19:0/2024383159 <== mon.1 v2:172.21.15.138:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0a000043d0 con 0x556a3aee2790 2024-09-10T22:30:12.593 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:12.435+0000 7f0a04de6640 1 -- 172.21.15.19:0/2024383159 <== mon.1 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a00004e10 con 0x556a3aee2790 2024-09-10T22:30:12.593 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:12.436+0000 7f0a077fe640 1 --2- 172.21.15.19:0/298924888 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f09fc0b52e0 0x7f09fc0b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:30:12.594 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:12.436+0000 7f0a1a65f740 1 -- 172.21.15.19:0/2024383159 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x556a3aee2790 msgr2=0x556a3aee4b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:30:12.594 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:12.436+0000 7f0a1a65f740 1 --2- 172.21.15.19:0/2024383159 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x556a3aee2790 0x556a3aee4b80 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f0a00009d70 tx=0x7f0a00011810 comp rx=0 tx=0).stop 2024-09-10T22:30:12.594 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:12.436+0000 7f0a1a65f740 1 -- 172.21.15.19:0/2024383159 shutdown_connections 2024-09-10T22:30:12.594 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:12.436+0000 7f0a1a65f740 1 --2- 172.21.15.19:0/2024383159 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x556a3aee2790 0x556a3aee4b80 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:30:12.594 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:12.436+0000 7f0a1a65f740 1 --2- 172.21.15.19:0/2024383159 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556a3aed6800 0x556a3aee2250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:30:12.594 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:12.436+0000 7f0a1a65f740 1 --2- 172.21.15.19:0/2024383159 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x556a3aed5ee0 0x556a3aed62c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:30:12.594 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:12.436+0000 7f0a16827640 1 --2- 172.21.15.19:0/298924888 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f09fc0b52e0 0x7f09fc0b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:30:12.594 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:12.436+0000 7f0a1a65f740 1 -- 172.21.15.19:0/2024383159 >> 172.21.15.19:0/2024383159 conn(0x556a3aed3d10 msgr2=0x556a3aed4eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:30:12.594 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:12.436+0000 7f0a077fe640 1 -- 172.21.15.19:0/298924888 <== mon.1 v2:172.21.15.138:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8327+0+0 (secure 0 0 0) 0x7f0a0c0e5610 con 0x7f0a101012f0 2024-09-10T22:30:12.594 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:12.436+0000 7f0a1a65f740 1 -- 172.21.15.19:0/2024383159 shutdown_connections 2024-09-10T22:30:12.594 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:12.436+0000 7f0a1a65f740 1 -- 172.21.15.19:0/2024383159 wait complete. 2024-09-10T22:30:12.594 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:12.437+0000 7f0a1a65f740 1 -- start start 2024-09-10T22:30:12.594 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:12.437+0000 7f0a1a65f740 1 Processor -- start 2024-09-10T22:30:12.594 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:12.437+0000 7f0a16827640 1 --2- 172.21.15.19:0/298924888 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f09fc0b52e0 0x7f09fc0b77a0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f0a08009430 tx=0x7f0a08031af0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:30:12.595 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:12.437+0000 7f0a1a65f740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x556a3aed5ee0 0x556a3aedf800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:30:12.595 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:12.437+0000 7f0a1a65f740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x556a3aed6800 0x556a3aedfd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:30:12.595 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:12.437+0000 7f0a1a65f740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556a3aee2790 0x556a3aee0280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:30:12.595 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:12.437+0000 7f0a1a65f740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x556a3ac9d890 con 0x556a3aed5ee0 2024-09-10T22:30:12.595 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:12.437+0000 7f0a1a65f740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x556a3add6d40 con 0x556a3aee2790 2024-09-10T22:30:12.595 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:12.437+0000 7f0a1a65f740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x556a3aee5440 con 0x556a3aed6800 2024-09-10T22:30:12.595 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:12.437+0000 7f0a1a65f740 10 client.0 _ll_register_callbacks cb 0x556a3ae3ac80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T22:30:12.595 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:12.437+0000 7f0a15825640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x556a3aed6800 0x556a3aedfd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:30:12.595 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:12.437+0000 7f0a15825640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x556a3aed6800 0x556a3aedfd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.19:50712/0 (socket says 172.21.15.19:50712) 2024-09-10T22:30:12.595 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:12.437+0000 7f0a15825640 1 -- 172.21.15.19:0/3845575506 learned_addr learned my addr 172.21.15.19:0/3845575506 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:30:12.595 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:12.437+0000 7f0a16026640 1 --2- 172.21.15.19:0/3845575506 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x556a3aed5ee0 0x556a3aedf800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:30:12.595 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:12.438+0000 7f0a16827640 1 --2- 172.21.15.19:0/3845575506 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556a3aee2790 0x556a3aee0280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:30:12.596 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:12.438+0000 7f0a15825640 1 -- 172.21.15.19:0/3845575506 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556a3aee2790 msgr2=0x556a3aee0280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:30:12.596 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:12.438+0000 7f0a15825640 1 --2- 172.21.15.19:0/3845575506 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556a3aee2790 0x556a3aee0280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:30:12.596 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:12.438+0000 7f0a15825640 1 -- 172.21.15.19:0/3845575506 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x556a3aed5ee0 msgr2=0x556a3aedf800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:30:12.596 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:12.438+0000 7f0a15825640 1 --2- 172.21.15.19:0/3845575506 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x556a3aed5ee0 0x556a3aedf800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:30:12.596 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:12.438+0000 7f0a15825640 1 -- 172.21.15.19:0/3845575506 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556a3aeee900 con 0x556a3aed6800 2024-09-10T22:30:12.596 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:12.438+0000 7f0a15825640 1 --2- 172.21.15.19:0/3845575506 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x556a3aed6800 0x556a3aedfd40 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f0a00009d40 tx=0x7f0a00009a90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=adbcd768dad3bec1 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:30:12.596 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:12.438+0000 7f09f9ffb640 10 client.0 ms_handle_connect on v2:172.21.15.138:3300/0 2024-09-10T22:30:12.596 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:12.438+0000 7f09f9ffb640 1 -- 172.21.15.19:0/3845575506 <== mon.1 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a00005430 con 0x556a3aed6800 2024-09-10T22:30:12.596 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:12.439+0000 7f0a1a65f740 1 -- 172.21.15.19:0/3845575506 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0a000043d0 con 0x556a3aed6800 2024-09-10T22:30:12.596 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:12.439+0000 7f09f9ffb640 1 -- 172.21.15.19:0/3845575506 <== mon.1 v2:172.21.15.138:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8327+0+0 (secure 0 0 0) 0x7f0a00019430 con 0x556a3aed6800 2024-09-10T22:30:12.596 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:12.439+0000 7f09f9ffb640 1 -- 172.21.15.19:0/3845575506 <== mon.1 v2:172.21.15.138:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f0a000055d0 con 0x556a3aed6800 2024-09-10T22:30:12.597 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:12.439+0000 7f0a1a65f740 10 client.25594 fetch_fsmap learned FSMap version 27 2024-09-10T22:30:12.597 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:12.439+0000 7f0a1a65f740 1 -- 172.21.15.19:0/3845575506 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x556a3aef12b0 con 0x556a3aed6800 2024-09-10T22:30:12.597 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:12.439+0000 7f09f9ffb640 1 -- 172.21.15.19:0/3845575506 <== mon.1 v2:172.21.15.138:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0a000043d0 con 0x556a3aed6800 2024-09-10T22:30:12.597 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:12.440+0000 7f09f9ffb640 1 -- 172.21.15.19:0/3845575506 <== mon.1 v2:172.21.15.138:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7f0a00024750 con 0x556a3aed6800 2024-09-10T22:30:12.597 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:12.440+0000 7f0a1a65f740 10 client.25594 fetch_fsmap finished waiting for FSMap version 27 2024-09-10T22:30:12.597 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:12.440+0000 7f0a1a65f740 10 client.25594 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-10T22:30:12.597 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:12.440+0000 7f0a1a65f740 20 client.25594 populate_metadata read hostname 'smithi019' 2024-09-10T22:30:12.597 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:12.440+0000 7f0a1a65f740 1 --2- 172.21.15.19:0/3845575506 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x556a3aef2660 0x556a3aef4a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:30:12.597 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:12.440+0000 7f0a1a65f740 4 client.25594 mds_command: new command op to 24581 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T22:30:12.597 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:12.440+0000 7f0a1a65f740 1 -- 172.21.15.19:0/3845575506 --> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x556a3ae4edb0 con 0x556a3aef2660 2024-09-10T22:30:12.597 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:12.441+0000 7f0a16026640 1 --2- 172.21.15.19:0/3845575506 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x556a3aef2660 0x556a3aef4a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:30:12.597 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:12.441+0000 7f09f9ffb640 10 client.25594 ms_handle_connect on v2:172.21.15.135:6838/1254769802 2024-09-10T22:30:12.598 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:12.441+0000 7f0a16026640 1 --2- 172.21.15.19:0/3845575506 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x556a3aef2660 0x556a3aef4a50 crc :-1 s=READY pgs=96 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1c25ca877990404 server_cookie=fd7fc51ca8d0a78c in_seq=0 out_seq=0 2024-09-10T22:30:12.598 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:12.442+0000 7f09f9ffb640 1 -- 172.21.15.19:0/3845575506 <== mds.0 v2:172.21.15.135:6838/1254769802 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x556a3ae4edb0 con 0x556a3aef2660 2024-09-10T22:30:12.598 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:12.442+0000 7f09f9ffb640 10 client.25594 handle_command_reply: tid=0 2024-09-10T22:30:12.598 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:12.442+0000 7f0a1a65f740 1 client.25594 shutdown 2024-09-10T22:30:12.598 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:12.443+0000 7f0a1a65f740 1 -- 172.21.15.19:0/3845575506 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x556a3aed6800 msgr2=0x556a3aedfd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:30:12.598 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:12.443+0000 7f0a1a65f740 1 --2- 172.21.15.19:0/3845575506 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x556a3aed6800 0x556a3aedfd40 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f0a00009d40 tx=0x7f0a00009a90 comp rx=0 tx=0).stop 2024-09-10T22:30:12.598 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:12.443+0000 7f0a1a65f740 1 -- 172.21.15.19:0/3845575506 shutdown_connections 2024-09-10T22:30:12.598 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:12.443+0000 7f0a1a65f740 1 --2- 172.21.15.19:0/3845575506 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556a3aee2790 0x556a3aee0280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:30:12.598 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:12.443+0000 7f0a1a65f740 1 --2- 172.21.15.19:0/3845575506 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x556a3aef2660 0x556a3aef4a50 crc :-1 s=READY pgs=96 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:30:12.598 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:12.443+0000 7f09f9ffb640 0 client.25594 ms_handle_reset on v2:172.21.15.135:6838/1254769802 2024-09-10T22:30:12.598 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:12.443+0000 7f0a1a65f740 1 --2- 172.21.15.19:0/3845575506 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x556a3aed6800 0x556a3aedfd40 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:30:12.598 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:12.443+0000 7f0a1a65f740 1 --2- 172.21.15.19:0/3845575506 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x556a3aed5ee0 0x556a3aedf800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:30:12.599 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:12.443+0000 7f0a1a65f740 1 -- 172.21.15.19:0/3845575506 >> 172.21.15.19:0/3845575506 conn(0x556a3aed3d10 msgr2=0x556a3aed2f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:30:12.599 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:12.443+0000 7f0a1a65f740 1 -- 172.21.15.19:0/3845575506 shutdown_connections 2024-09-10T22:30:12.599 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:12.443+0000 7f0a1a65f740 1 -- 172.21.15.19:0/3845575506 wait complete. 2024-09-10T22:30:12.599 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:12.443+0000 7f0a1a65f740 20 client.25594 trim_cache size 0 max 16384 2024-09-10T22:30:12.599 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:12.464+0000 7f0a1a65f740 1 Processor -- start 2024-09-10T22:30:12.599 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:12.464+0000 7f0a1a65f740 1 -- start start 2024-09-10T22:30:12.599 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:12.464+0000 7f0a1a65f740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556a3aed5ee0 0x556a3aee1540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:30:12.599 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:12.464+0000 7f0a1a65f740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x556a3aed6800 0x556a3aedca10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:30:12.599 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:12.464+0000 7f0a1a65f740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x556a3aee2790 0x556a3aedcf50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:30:12.599 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:12.464+0000 7f0a1a65f740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f0a101bfd10 con 0x556a3aed6800 2024-09-10T22:30:12.599 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:12.464+0000 7f0a1a65f740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f0a101bd5e0 con 0x556a3aed5ee0 2024-09-10T22:30:12.599 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:12.464+0000 7f0a1a65f740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f0a101bb430 con 0x556a3aee2790 2024-09-10T22:30:12.600 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:12.464+0000 7f0a15825640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x556a3aed6800 0x556a3aedca10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:30:12.600 INFO:teuthology.orchestra.run.smithi019.stdout:{ 2024-09-10T22:30:12.600 INFO:teuthology.orchestra.run.smithi019.stdout: "return_code": 0, 2024-09-10T22:30:12.601 INFO:teuthology.orchestra.run.smithi019.stdout: "scrub_tag": "fd1f1837-dcfa-4d88-99e8-2509f36c3f98", 2024-09-10T22:30:12.601 INFO:teuthology.orchestra.run.smithi019.stdout: "mode": "asynchronous" 2024-09-10T22:30:12.601 INFO:teuthology.orchestra.run.smithi019.stdout:} 2024-09-10T22:30:12.601 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:12.464+0000 7f0a15825640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x556a3aed6800 0x556a3aedca10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:50666/0 (socket says 172.21.15.19:50666) 2024-09-10T22:30:12.601 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:12.464+0000 7f0a15825640 1 -- 172.21.15.19:0/4085325864 learned_addr learned my addr 172.21.15.19:0/4085325864 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:30:12.601 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:12.464+0000 7f0a16026640 1 --2- 172.21.15.19:0/4085325864 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556a3aed5ee0 0x556a3aee1540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:30:12.601 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:12.464+0000 7f0a16827640 1 --2- 172.21.15.19:0/4085325864 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x556a3aee2790 0x556a3aedcf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:30:12.602 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:12.464+0000 7f0a15825640 1 -- 172.21.15.19:0/4085325864 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x556a3aee2790 msgr2=0x556a3aedcf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:30:12.602 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:12.464+0000 7f0a15825640 1 --2- 172.21.15.19:0/4085325864 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x556a3aee2790 0x556a3aedcf50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:30:12.602 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:12.464+0000 7f0a15825640 1 -- 172.21.15.19:0/4085325864 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556a3aed5ee0 msgr2=0x556a3aee1540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:30:12.602 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:12.464+0000 7f0a15825640 1 --2- 172.21.15.19:0/4085325864 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556a3aed5ee0 0x556a3aee1540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:30:12.602 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:12.464+0000 7f0a15825640 1 -- 172.21.15.19:0/4085325864 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556a3aede760 con 0x556a3aed6800 2024-09-10T22:30:12.602 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:12.464+0000 7f0a16026640 1 --2- 172.21.15.19:0/4085325864 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556a3aed5ee0 0x556a3aee1540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T22:30:12.602 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:12.465+0000 7f0a15825640 1 --2- 172.21.15.19:0/4085325864 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x556a3aed6800 0x556a3aedca10 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7f0a00030040 tx=0x7f0a00005d90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2993bc161df44e4e server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:30:12.602 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:12.465+0000 7f09fbfff640 1 -- 172.21.15.19:0/4085325864 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a00004660 con 0x556a3aed6800 2024-09-10T22:30:12.602 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:12.465+0000 7f09fbfff640 1 -- 172.21.15.19:0/4085325864 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0a00029070 con 0x556a3aed6800 2024-09-10T22:30:12.602 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:12.465+0000 7f09fbfff640 1 -- 172.21.15.19:0/4085325864 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a0002d6e0 con 0x556a3aed6800 2024-09-10T22:30:12.602 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:12.466+0000 7f0a1a65f740 1 -- 172.21.15.19:0/4085325864 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x556a3aed6800 msgr2=0x556a3aedca10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:30:12.603 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:12.466+0000 7f0a1a65f740 1 --2- 172.21.15.19:0/4085325864 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x556a3aed6800 0x556a3aedca10 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7f0a00030040 tx=0x7f0a00005d90 comp rx=0 tx=0).stop 2024-09-10T22:30:12.603 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:12.466+0000 7f0a1a65f740 1 -- 172.21.15.19:0/4085325864 shutdown_connections 2024-09-10T22:30:12.603 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:12.466+0000 7f0a1a65f740 1 --2- 172.21.15.19:0/4085325864 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x556a3aee2790 0x556a3aedcf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:30:12.603 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:12.466+0000 7f0a1a65f740 1 --2- 172.21.15.19:0/4085325864 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x556a3aed6800 0x556a3aedca10 unknown :-1 s=CLOSED pgs=574 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:30:12.603 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:12.466+0000 7f0a1a65f740 1 --2- 172.21.15.19:0/4085325864 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556a3aed5ee0 0x556a3aee1540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:30:12.603 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:12.466+0000 7f0a1a65f740 1 -- 172.21.15.19:0/4085325864 >> 172.21.15.19:0/4085325864 conn(0x556a3aed3d10 msgr2=0x556a3aee0e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:30:12.603 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:12.466+0000 7f0a1a65f740 1 -- 172.21.15.19:0/4085325864 shutdown_connections 2024-09-10T22:30:12.603 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:12.466+0000 7f0a1a65f740 1 -- 172.21.15.19:0/4085325864 wait complete. 2024-09-10T22:30:12.603 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:12.466+0000 7f0a1a65f740 1 -- start start 2024-09-10T22:30:12.603 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:12.467+0000 7f0a1a65f740 1 Processor -- start 2024-09-10T22:30:12.604 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:12.467+0000 7f0a1a65f740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556a3aed5ee0 0x556a3aee6b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:30:12.604 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:12.467+0000 7f0a1a65f740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x556a3aed6800 0x556a3aee70c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:30:12.604 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:12.467+0000 7f0a1a65f740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x556a3aee2790 0x556a3af5e370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:30:12.604 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:12.467+0000 7f0a1a65f740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f0a101bbaa0 con 0x556a3aed6800 2024-09-10T22:30:12.604 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:12.467+0000 7f0a1a65f740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f0a101bcf10 con 0x556a3aed5ee0 2024-09-10T22:30:12.604 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:12.467+0000 7f0a1a65f740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f0a101bc170 con 0x556a3aee2790 2024-09-10T22:30:12.604 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:12.467+0000 7f0a1a65f740 10 client.0 _ll_register_callbacks cb 0x7f0a10078550 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T22:30:12.604 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:12.467+0000 7f0a15825640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x556a3aed6800 0x556a3aee70c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:30:12.604 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:12.467+0000 7f0a15825640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x556a3aed6800 0x556a3aee70c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:50676/0 (socket says 172.21.15.19:50676) 2024-09-10T22:30:12.604 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:12.467+0000 7f0a16827640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x556a3aee2790 0x556a3af5e370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:30:12.604 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:12.467+0000 7f0a15825640 1 -- 172.21.15.19:0/3162398453 learned_addr learned my addr 172.21.15.19:0/3162398453 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:30:12.604 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:12.467+0000 7f0a16026640 1 --2- 172.21.15.19:0/3162398453 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556a3aed5ee0 0x556a3aee6b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:30:12.605 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:12.468+0000 7f0a16827640 1 -- 172.21.15.19:0/3162398453 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556a3aed5ee0 msgr2=0x556a3aee6b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:30:12.605 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:12.468+0000 7f0a16827640 1 --2- 172.21.15.19:0/3162398453 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556a3aed5ee0 0x556a3aee6b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:30:12.605 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:12.468+0000 7f0a16827640 1 -- 172.21.15.19:0/3162398453 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x556a3aed6800 msgr2=0x556a3aee70c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:30:12.605 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:12.468+0000 7f0a16827640 1 --2- 172.21.15.19:0/3162398453 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x556a3aed6800 0x556a3aee70c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:30:12.605 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:12.468+0000 7f0a16827640 1 -- 172.21.15.19:0/3162398453 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556a3af5e8b0 con 0x556a3aee2790 2024-09-10T22:30:12.605 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:12.468+0000 7f0a15825640 1 --2- 172.21.15.19:0/3162398453 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x556a3aed6800 0x556a3aee70c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T22:30:12.605 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:12.468+0000 7f0a16827640 1 --2- 172.21.15.19:0/3162398453 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x556a3aee2790 0x556a3af5e370 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f0a08006010 tx=0x7f0a080095c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6bacbe7c856a7c2e server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:30:12.605 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:12.468+0000 7f09f9ffb640 10 client.0 ms_handle_connect on v2:172.21.15.138:3300/0 2024-09-10T22:30:12.605 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:12.468+0000 7f09f9ffb640 1 -- 172.21.15.19:0/3162398453 <== mon.1 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a08003c40 con 0x556a3aee2790 2024-09-10T22:30:12.605 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:12.468+0000 7f0a1a65f740 1 -- 172.21.15.19:0/3162398453 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0a00029070 con 0x556a3aee2790 2024-09-10T22:30:12.605 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:12.468+0000 7f09f9ffb640 1 -- 172.21.15.19:0/3162398453 <== mon.1 v2:172.21.15.138:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8327+0+0 (secure 0 0 0) 0x7f0a08003de0 con 0x556a3aee2790 2024-09-10T22:30:12.605 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:12.468+0000 7f09f9ffb640 1 -- 172.21.15.19:0/3162398453 <== mon.1 v2:172.21.15.138:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f0a0802f720 con 0x556a3aee2790 2024-09-10T22:30:12.606 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:12.468+0000 7f0a1a65f740 10 client.25600 fetch_fsmap learned FSMap version 27 2024-09-10T22:30:12.606 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:12.468+0000 7f0a1a65f740 1 -- 172.21.15.19:0/3162398453 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x556a3af5fc70 con 0x556a3aee2790 2024-09-10T22:30:12.606 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:12.469+0000 7f09f9ffb640 1 -- 172.21.15.19:0/3162398453 <== mon.1 v2:172.21.15.138:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0a00029070 con 0x556a3aee2790 2024-09-10T22:30:12.606 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:12.469+0000 7f09f9ffb640 1 -- 172.21.15.19:0/3162398453 <== mon.1 v2:172.21.15.138:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7f0a0805b020 con 0x556a3aee2790 2024-09-10T22:30:12.606 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:12.469+0000 7f0a1a65f740 10 client.25600 fetch_fsmap finished waiting for FSMap version 27 2024-09-10T22:30:12.606 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:12.469+0000 7f0a1a65f740 10 client.25600 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-10T22:30:12.606 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:12.469+0000 7f0a1a65f740 20 client.25600 populate_metadata read hostname 'smithi019' 2024-09-10T22:30:12.606 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:12.469+0000 7f0a1a65f740 1 --2- 172.21.15.19:0/3162398453 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x556a3aef2660 0x556a3af62410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:30:12.606 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:12.469+0000 7f0a1a65f740 4 client.25600 mds_command: new command op to 24581 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-10T22:30:12.606 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:12.469+0000 7f0a1a65f740 1 -- 172.21.15.19:0/3162398453 --> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x556a3ae4a860 con 0x556a3aef2660 2024-09-10T22:30:12.606 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:12.469+0000 7f0a16026640 1 --2- 172.21.15.19:0/3162398453 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x556a3aef2660 0x556a3af62410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:30:12.606 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:12.470+0000 7f09f9ffb640 10 client.25600 ms_handle_connect on v2:172.21.15.135:6838/1254769802 2024-09-10T22:30:12.606 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:12.470+0000 7f0a16026640 1 --2- 172.21.15.19:0/3162398453 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x556a3aef2660 0x556a3af62410 crc :-1 s=READY pgs=97 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7d157d032730b610 server_cookie=d4f65f10a1e05734 in_seq=0 out_seq=0 2024-09-10T22:30:12.606 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:12.472+0000 7f09f9ffb640 1 -- 172.21.15.19:0/3162398453 <== mds.0 v2:172.21.15.135:6838/1254769802 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x556a3ae4a860 con 0x556a3aef2660 2024-09-10T22:30:12.607 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:12.472+0000 7f09f9ffb640 10 client.25600 handle_command_reply: tid=0 2024-09-10T22:30:12.607 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:12.472+0000 7f0a1a65f740 1 client.25600 shutdown 2024-09-10T22:30:12.607 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:12.472+0000 7f0a1a65f740 1 -- 172.21.15.19:0/3162398453 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x556a3aee2790 msgr2=0x556a3af5e370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:30:12.607 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:12.472+0000 7f0a1a65f740 1 --2- 172.21.15.19:0/3162398453 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x556a3aee2790 0x556a3af5e370 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f0a08006010 tx=0x7f0a080095c0 comp rx=0 tx=0).stop 2024-09-10T22:30:12.607 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:12.472+0000 7f0a1a65f740 1 -- 172.21.15.19:0/3162398453 shutdown_connections 2024-09-10T22:30:12.607 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:12.472+0000 7f0a1a65f740 1 --2- 172.21.15.19:0/3162398453 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x556a3aef2660 0x556a3af62410 crc :-1 s=READY pgs=97 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:30:12.607 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:12.472+0000 7f0a1a65f740 1 --2- 172.21.15.19:0/3162398453 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x556a3aee2790 0x556a3af5e370 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:30:12.607 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:12.472+0000 7f0a1a65f740 1 --2- 172.21.15.19:0/3162398453 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x556a3aed6800 0x556a3aee70c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:30:12.607 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:12.472+0000 7f0a1a65f740 1 --2- 172.21.15.19:0/3162398453 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556a3aed5ee0 0x556a3aee6b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:30:12.607 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:12.472+0000 7f0a1a65f740 1 -- 172.21.15.19:0/3162398453 >> 172.21.15.19:0/3162398453 conn(0x556a3aed3d10 msgr2=0x556a3aee1650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:30:12.607 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:12.472+0000 7f09f9ffb640 0 client.25600 ms_handle_reset on v2:172.21.15.135:6838/1254769802 2024-09-10T22:30:12.607 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:12.472+0000 7f0a1a65f740 1 -- 172.21.15.19:0/3162398453 shutdown_connections 2024-09-10T22:30:12.608 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:12.472+0000 7f0a1a65f740 1 -- 172.21.15.19:0/3162398453 wait complete. 2024-09-10T22:30:12.608 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:12.472+0000 7f0a1a65f740 20 client.25600 trim_cache size 0 max 16384 2024-09-10T22:30:12.608 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:12.473+0000 7f0a1828a640 1 -- 172.21.15.19:0/298924888 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f09fc0b52e0 msgr2=0x7f09fc0b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:30:12.608 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:12.473+0000 7f0a1828a640 1 --2- 172.21.15.19:0/298924888 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f09fc0b52e0 0x7f09fc0b77a0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f0a08009430 tx=0x7f0a08031af0 comp rx=0 tx=0).stop 2024-09-10T22:30:12.608 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:12.473+0000 7f0a1828a640 1 -- 172.21.15.19:0/298924888 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f0a101012f0 msgr2=0x7f0a1010eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:30:12.608 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:12.473+0000 7f0a1828a640 1 --2- 172.21.15.19:0/298924888 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f0a101012f0 0x7f0a1010eb30 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f0a0c00b3f0 tx=0x7f0a0c00b8b0 comp rx=0 tx=0).stop 2024-09-10T22:30:12.608 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:12.473+0000 7f0a1828a640 1 -- 172.21.15.19:0/298924888 shutdown_connections 2024-09-10T22:30:12.608 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:12.473+0000 7f0a1828a640 1 --2- 172.21.15.19:0/298924888 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f09fc0b52e0 0x7f09fc0b77a0 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:30:12.608 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:12.473+0000 7f0a1828a640 1 --2- 172.21.15.19:0/298924888 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0a10105f70 0x7f0a1019fb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:30:12.608 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:12.473+0000 7f0a1828a640 1 --2- 172.21.15.19:0/298924888 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0a101055b0 0x7f0a1010f070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:30:12.608 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:12.473+0000 7f0a1828a640 1 --2- 172.21.15.19:0/298924888 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f0a101012f0 0x7f0a1010eb30 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:30:12.608 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:12.473+0000 7f0a1828a640 1 -- 172.21.15.19:0/298924888 >> 172.21.15.19:0/298924888 conn(0x7f0a10078140 msgr2=0x7f0a10108fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:30:12.609 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:12.473+0000 7f0a1828a640 1 -- 172.21.15.19:0/298924888 shutdown_connections 2024-09-10T22:30:12.609 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:12.473+0000 7f0a1828a640 1 -- 172.21.15.19:0/298924888 wait complete. 2024-09-10T22:30:12.708 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:30:12 smithi019 ceph-mon[31375]: scrub summary: active paths [/] 2024-09-10T22:30:12.708 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:30:12 smithi019 ceph-mon[31375]: scrub summary: idle+waiting paths [/] 2024-09-10T22:30:13.109 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:30:12 smithi135 ceph-mon[34789]: scrub summary: active paths [/] 2024-09-10T22:30:13.110 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:30:12 smithi135 ceph-mon[34789]: scrub summary: idle+waiting paths [/] 2024-09-10T22:30:13.125 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:30:12 smithi138 ceph-mon[35236]: scrub summary: active paths [/] 2024-09-10T22:30:13.125 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:30:12 smithi138 ceph-mon[35236]: scrub summary: idle+waiting paths [/] 2024-09-10T22:30:13.776 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 22997a4c-6fc2-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-10T22:30:13.958 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:30:13 smithi019 ceph-mon[31375]: scrub queued for path: / 2024-09-10T22:30:13.959 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:30:13 smithi019 ceph-mon[31375]: scrub summary: idle+waiting paths [/] 2024-09-10T22:30:13.959 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:30:13 smithi019 ceph-mon[31375]: scrub summary: active paths [/] 2024-09-10T22:30:13.959 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:30:13 smithi019 ceph-mon[31375]: pgmap v461: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 705 KiB/s rd, 361 MiB/s wr, 195 op/s 2024-09-10T22:30:13.959 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:30:13 smithi019 ceph-mon[31375]: scrub summary: idle+waiting paths [/] 2024-09-10T22:30:14.110 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:30:13 smithi135 ceph-mon[34789]: scrub queued for path: / 2024-09-10T22:30:14.111 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:30:13 smithi135 ceph-mon[34789]: scrub summary: idle+waiting paths [/] 2024-09-10T22:30:14.111 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:30:13 smithi135 ceph-mon[34789]: scrub summary: active paths [/] 2024-09-10T22:30:14.111 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:30:13 smithi135 ceph-mon[34789]: pgmap v461: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 705 KiB/s rd, 361 MiB/s wr, 195 op/s 2024-09-10T22:30:14.111 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:30:13 smithi135 ceph-mon[34789]: scrub summary: idle+waiting paths [/] 2024-09-10T22:30:14.125 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:30:13 smithi138 ceph-mon[35236]: scrub queued for path: / 2024-09-10T22:30:14.125 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:30:13 smithi138 ceph-mon[35236]: scrub summary: idle+waiting paths [/] 2024-09-10T22:30:14.125 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:30:13 smithi138 ceph-mon[35236]: scrub summary: active paths [/] 2024-09-10T22:30:14.125 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:30:13 smithi138 ceph-mon[35236]: pgmap v461: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 705 KiB/s rd, 361 MiB/s wr, 195 op/s 2024-09-10T22:30:14.125 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:30:13 smithi138 ceph-mon[35236]: scrub summary: idle+waiting paths [/] 2024-09-10T22:30:14.160 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/22997a4c-6fc2-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T22:30:15.165 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:15.119+0000 7f84ec5ec640 1 -- 172.21.15.19:0/2131994674 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f84e4101c90 msgr2=0x7f84e4102070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:30:15.165 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:15.120+0000 7f84ec5ec640 1 --2- 172.21.15.19:0/2131994674 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f84e4101c90 0x7f84e4102070 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7f84e0009900 tx=0x7f84e002a410 comp rx=0 tx=0).stop 2024-09-10T22:30:15.165 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:15.121+0000 7f84ec5ec640 1 -- 172.21.15.19:0/2131994674 shutdown_connections 2024-09-10T22:30:15.165 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:15.121+0000 7f84ec5ec640 1 --2- 172.21.15.19:0/2131994674 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f84e4108020 0x7f84e410e820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:30:15.165 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:15.121+0000 7f84ec5ec640 1 --2- 172.21.15.19:0/2131994674 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f84e41076a0 0x7f84e4107ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:30:15.166 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:15.121+0000 7f84ec5ec640 1 --2- 172.21.15.19:0/2131994674 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f84e4101c90 0x7f84e4102070 unknown :-1 s=CLOSED pgs=575 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:30:15.166 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:15.121+0000 7f84ec5ec640 1 -- 172.21.15.19:0/2131994674 >> 172.21.15.19:0/2131994674 conn(0x7f84e40fd700 msgr2=0x7f84e40ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:30:15.166 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:15.126+0000 7f84ec5ec640 1 -- 172.21.15.19:0/2131994674 shutdown_connections 2024-09-10T22:30:15.166 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:15.126+0000 7f84ec5ec640 1 -- 172.21.15.19:0/2131994674 wait complete. 2024-09-10T22:30:15.166 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:15.127+0000 7f84ec5ec640 1 Processor -- start 2024-09-10T22:30:15.166 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:15.128+0000 7f84ec5ec640 1 -- start start 2024-09-10T22:30:15.166 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:15.128+0000 7f84ec5ec640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f84e4101c90 0x7f84e4199200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:30:15.166 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:15.128+0000 7f84ec5ec640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f84e41076a0 0x7f84e4199740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:30:15.166 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:15.129+0000 7f84ec5ec640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f84e4108020 0x7f84e419eae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:30:15.166 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:15.129+0000 7f84ec5ec640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f84e4112e90 con 0x7f84e4108020 2024-09-10T22:30:15.166 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:15.129+0000 7f84eab89640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f84e4108020 0x7f84e419eae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:30:15.167 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:15.129+0000 7f84eab89640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f84e4108020 0x7f84e419eae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:43324/0 (socket says 172.21.15.19:43324) 2024-09-10T22:30:15.167 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:15.129+0000 7f84eab89640 1 -- 172.21.15.19:0/21070272 learned_addr learned my addr 172.21.15.19:0/21070272 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:30:15.167 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:15.129+0000 7f84ec5ec640 1 -- 172.21.15.19:0/21070272 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f84e4112d10 con 0x7f84e41076a0 2024-09-10T22:30:15.167 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:15.129+0000 7f84ec5ec640 1 -- 172.21.15.19:0/21070272 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f84e4113010 con 0x7f84e4101c90 2024-09-10T22:30:15.167 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:15.130+0000 7f84e9b87640 1 --2- 172.21.15.19:0/21070272 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f84e41076a0 0x7f84e4199740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:30:15.167 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:15.130+0000 7f84eab89640 1 -- 172.21.15.19:0/21070272 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f84e4101c90 msgr2=0x7f84e4199200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:30:15.167 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:15.130+0000 7f84ea388640 1 --2- 172.21.15.19:0/21070272 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f84e4101c90 0x7f84e4199200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:30:15.167 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:15.130+0000 7f84eab89640 1 --2- 172.21.15.19:0/21070272 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f84e4101c90 0x7f84e4199200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:30:15.167 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:15.130+0000 7f84eab89640 1 -- 172.21.15.19:0/21070272 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f84e41076a0 msgr2=0x7f84e4199740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:30:15.167 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:15.130+0000 7f84eab89640 1 --2- 172.21.15.19:0/21070272 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f84e41076a0 0x7f84e4199740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:30:15.168 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:15.130+0000 7f84eab89640 1 -- 172.21.15.19:0/21070272 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f84e419f2b0 con 0x7f84e4108020 2024-09-10T22:30:15.168 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:15.130+0000 7f84ea388640 1 --2- 172.21.15.19:0/21070272 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f84e4101c90 0x7f84e4199200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T22:30:15.168 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:15.131+0000 7f84eab89640 1 --2- 172.21.15.19:0/21070272 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f84e4108020 0x7f84e419eae0 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7f84dc00b970 tx=0x7f84dc00be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:30:15.168 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:15.131+0000 7f84db7fe640 1 -- 172.21.15.19:0/21070272 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84dc019070 con 0x7f84e4108020 2024-09-10T22:30:15.168 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:15.131+0000 7f84db7fe640 1 -- 172.21.15.19:0/21070272 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f84dc014440 con 0x7f84e4108020 2024-09-10T22:30:15.168 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:15.131+0000 7f84ec5ec640 1 -- 172.21.15.19:0/21070272 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f84e419f5a0 con 0x7f84e4108020 2024-09-10T22:30:15.168 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:15.131+0000 7f84db7fe640 1 -- 172.21.15.19:0/21070272 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84dc0075d0 con 0x7f84e4108020 2024-09-10T22:30:15.168 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:15.132+0000 7f84ec5ec640 1 -- 172.21.15.19:0/21070272 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f84e41a5ce0 con 0x7f84e4108020 2024-09-10T22:30:15.168 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:15.135+0000 7f84ee9c1740 1 Processor -- start 2024-09-10T22:30:15.168 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:15.141+0000 7f84db7fe640 1 -- 172.21.15.19:0/21070272 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 18) ==== 153250+0+0 (secure 0 0 0) 0x7f84dc00cb40 con 0x7f84e4108020 2024-09-10T22:30:15.168 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:15.141+0000 7f84ee9c1740 1 -- start start 2024-09-10T22:30:15.168 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:15.141+0000 7f84ee9c1740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561e13f7f4b0 0x561e13f7f890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:30:15.168 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:15.141+0000 7f84ee9c1740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x561e13f7fdd0 0x561e13f8b820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:30:15.169 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:15.142+0000 7f84ee9c1740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x561e13f8bd60 0x561e13f8e150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:30:15.169 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:15.142+0000 7f84ee9c1740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x561e13ef1e50 con 0x561e13f8bd60 2024-09-10T22:30:15.169 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:15.142+0000 7f84ee9c1740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x561e13ee1280 con 0x561e13f7f4b0 2024-09-10T22:30:15.169 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:15.142+0000 7f84ee9c1740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x561e13ee5090 con 0x561e13f7fdd0 2024-09-10T22:30:15.169 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:15.142+0000 7f84e9b87640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x561e13f8bd60 0x561e13f8e150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:30:15.169 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:15.142+0000 7f84e9b87640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x561e13f8bd60 0x561e13f8e150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:43338/0 (socket says 172.21.15.19:43338) 2024-09-10T22:30:15.169 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:15.142+0000 7f84e9b87640 1 -- 172.21.15.19:0/4122122226 learned_addr learned my addr 172.21.15.19:0/4122122226 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:30:15.169 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:15.142+0000 7f84ea388640 1 --2- 172.21.15.19:0/4122122226 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x561e13f7fdd0 0x561e13f8b820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:30:15.169 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:15.142+0000 7f84e9b87640 1 -- 172.21.15.19:0/4122122226 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x561e13f7fdd0 msgr2=0x561e13f8b820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:30:15.169 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:15.143+0000 7f84e9b87640 1 --2- 172.21.15.19:0/4122122226 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x561e13f7fdd0 0x561e13f8b820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:30:15.170 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:15.143+0000 7f84e9b87640 1 -- 172.21.15.19:0/4122122226 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561e13f7f4b0 msgr2=0x561e13f7f890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:30:15.170 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:15.143+0000 7f84e9b87640 1 --2- 172.21.15.19:0/4122122226 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561e13f7f4b0 0x561e13f7f890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:30:15.170 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:15.143+0000 7f84e9b87640 1 -- 172.21.15.19:0/4122122226 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561e13c3f650 con 0x561e13f8bd60 2024-09-10T22:30:15.170 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:15.143+0000 7f84e9b87640 1 --2- 172.21.15.19:0/4122122226 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x561e13f8bd60 0x561e13f8e150 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7f84d400a950 tx=0x7f84d400ae10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5f9e0a5e82ff0524 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:30:15.170 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:15.143+0000 7f84d8ff9640 1 -- 172.21.15.19:0/4122122226 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84d400f040 con 0x561e13f8bd60 2024-09-10T22:30:15.170 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:15.144+0000 7f84d8ff9640 1 -- 172.21.15.19:0/4122122226 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f84d40044d0 con 0x561e13f8bd60 2024-09-10T22:30:15.170 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:15.144+0000 7f84d8ff9640 1 -- 172.21.15.19:0/4122122226 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84d4003a00 con 0x561e13f8bd60 2024-09-10T22:30:15.170 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:15.145+0000 7f84db7fe640 1 --2- 172.21.15.19:0/21070272 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f84d00b5420 0x7f84d00b78e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:30:15.170 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:15.145+0000 7f84ee9c1740 1 -- 172.21.15.19:0/4122122226 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x561e13f8bd60 msgr2=0x561e13f8e150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:30:15.170 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:15.145+0000 7f84ee9c1740 1 --2- 172.21.15.19:0/4122122226 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x561e13f8bd60 0x561e13f8e150 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7f84d400a950 tx=0x7f84d400ae10 comp rx=0 tx=0).stop 2024-09-10T22:30:15.170 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:15.145+0000 7f84db7fe640 1 -- 172.21.15.19:0/21070272 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8327+0+0 (secure 0 0 0) 0x7f84dc0e5480 con 0x7f84e4108020 2024-09-10T22:30:15.170 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:15.145+0000 7f84ee9c1740 1 -- 172.21.15.19:0/4122122226 shutdown_connections 2024-09-10T22:30:15.170 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:15.145+0000 7f84ee9c1740 1 --2- 172.21.15.19:0/4122122226 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x561e13f8bd60 0x561e13f8e150 unknown :-1 s=CLOSED pgs=577 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:30:15.171 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:15.145+0000 7f84ee9c1740 1 --2- 172.21.15.19:0/4122122226 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x561e13f7fdd0 0x561e13f8b820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:30:15.171 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:15.145+0000 7f84ee9c1740 1 --2- 172.21.15.19:0/4122122226 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561e13f7f4b0 0x561e13f7f890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:30:15.171 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:15.145+0000 7f84ee9c1740 1 -- 172.21.15.19:0/4122122226 >> 172.21.15.19:0/4122122226 conn(0x561e13f7d2e0 msgr2=0x561e13f7e480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:30:15.171 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:15.146+0000 7f84ea388640 1 --2- 172.21.15.19:0/21070272 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f84d00b5420 0x7f84d00b78e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:30:15.171 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:15.149+0000 7f84ee9c1740 1 -- 172.21.15.19:0/4122122226 shutdown_connections 2024-09-10T22:30:15.171 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:15.149+0000 7f84ea388640 1 --2- 172.21.15.19:0/21070272 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f84d00b5420 0x7f84d00b78e0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f84e000b230 tx=0x7f84e000b040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:30:15.171 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:15.149+0000 7f84ee9c1740 1 -- 172.21.15.19:0/4122122226 wait complete. 2024-09-10T22:30:15.171 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:15.150+0000 7f84ee9c1740 1 -- start start 2024-09-10T22:30:15.171 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:15.150+0000 7f84ee9c1740 1 Processor -- start 2024-09-10T22:30:15.171 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:15.151+0000 7f84ee9c1740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561e13f7f4b0 0x561e13f8b650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:30:15.171 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:15.151+0000 7f84ee9c1740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x561e13f7fdd0 0x561e13f88aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:30:15.171 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:15.151+0000 7f84ee9c1740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x561e13f8bd60 0x561e13f890d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:30:15.172 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:15.151+0000 7f84ee9c1740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x561e13d42700 con 0x561e13f7fdd0 2024-09-10T22:30:15.172 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:15.151+0000 7f84ee9c1740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x561e13e7c110 con 0x561e13f7f4b0 2024-09-10T22:30:15.172 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:15.151+0000 7f84ee9c1740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x561e13f8ea30 con 0x561e13f8bd60 2024-09-10T22:30:15.172 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:15.151+0000 7f84e9b87640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x561e13f7fdd0 0x561e13f88aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:30:15.172 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:15.151+0000 7f84e9b87640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x561e13f7fdd0 0x561e13f88aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:43350/0 (socket says 172.21.15.19:43350) 2024-09-10T22:30:15.172 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:15.151+0000 7f84e9b87640 1 -- 172.21.15.19:0/1367461123 learned_addr learned my addr 172.21.15.19:0/1367461123 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:30:15.172 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:15.151+0000 7f84ee9c1740 10 client.0 _ll_register_callbacks cb 0x561e13e95990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T22:30:15.172 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:15.152+0000 7f84ea388640 1 --2- 172.21.15.19:0/1367461123 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561e13f7f4b0 0x561e13f8b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:30:15.172 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:15.152+0000 7f84e9b87640 1 -- 172.21.15.19:0/1367461123 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x561e13f8bd60 msgr2=0x561e13f890d0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-10T22:30:15.172 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:15.152+0000 7f84e9b87640 1 --2- 172.21.15.19:0/1367461123 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x561e13f8bd60 0x561e13f890d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:30:15.172 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:15.152+0000 7f84e9b87640 1 -- 172.21.15.19:0/1367461123 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561e13f7f4b0 msgr2=0x561e13f8b650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:30:15.172 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:15.152+0000 7f84e9b87640 1 --2- 172.21.15.19:0/1367461123 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561e13f7f4b0 0x561e13f8b650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:30:15.173 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:15.152+0000 7f84e9b87640 1 -- 172.21.15.19:0/1367461123 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561e13ea9c40 con 0x561e13f7fdd0 2024-09-10T22:30:15.173 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:15.152+0000 7f84ea388640 1 --2- 172.21.15.19:0/1367461123 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561e13f7f4b0 0x561e13f8b650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T22:30:15.173 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:15.152+0000 7f84e9b87640 1 --2- 172.21.15.19:0/1367461123 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x561e13f7fdd0 0x561e13f88aa0 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7f84d4000ea0 tx=0x7f84d400ea40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4cd9fc6ac32ecbb6 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:30:15.173 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:15.152+0000 7f84cdffb640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-10T22:30:15.173 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:15.152+0000 7f84cdffb640 1 -- 172.21.15.19:0/1367461123 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84d4020070 con 0x561e13f7fdd0 2024-09-10T22:30:15.173 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:15.152+0000 7f84cdffb640 1 -- 172.21.15.19:0/1367461123 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8327+0+0 (secure 0 0 0) 0x7f84d4003910 con 0x561e13f7fdd0 2024-09-10T22:30:15.173 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:15.152+0000 7f84ee9c1740 1 -- 172.21.15.19:0/1367461123 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f84d40044d0 con 0x561e13f7fdd0 2024-09-10T22:30:15.173 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:15.153+0000 7f84cdffb640 1 -- 172.21.15.19:0/1367461123 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f84d402c050 con 0x561e13f7fdd0 2024-09-10T22:30:15.173 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:15.153+0000 7f84ee9c1740 10 client.16152 fetch_fsmap learned FSMap version 27 2024-09-10T22:30:15.173 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:15.153+0000 7f84ee9c1740 1 -- 172.21.15.19:0/1367461123 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x561e13f9a370 con 0x561e13f7fdd0 2024-09-10T22:30:15.173 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:15.153+0000 7f84cdffb640 1 -- 172.21.15.19:0/1367461123 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f84d40044d0 con 0x561e13f7fdd0 2024-09-10T22:30:15.173 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:15.153+0000 7f84cdffb640 1 -- 172.21.15.19:0/1367461123 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7f84d4013770 con 0x561e13f7fdd0 2024-09-10T22:30:15.173 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:15.153+0000 7f84ee9c1740 10 client.16152 fetch_fsmap finished waiting for FSMap version 27 2024-09-10T22:30:15.174 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:15.153+0000 7f84ee9c1740 10 client.16152 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-10T22:30:15.174 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:15.153+0000 7f84ee9c1740 20 client.16152 populate_metadata read hostname 'smithi019' 2024-09-10T22:30:15.174 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:15.153+0000 7f84ee9c1740 1 --2- 172.21.15.19:0/1367461123 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x561e13f9b950 0x561e13f9dd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:30:15.174 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:15.153+0000 7f84ee9c1740 4 client.16152 mds_command: new command op to 24581 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T22:30:15.174 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:15.153+0000 7f84ee9c1740 1 -- 172.21.15.19:0/1367461123 --> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x561e13ef3da0 con 0x561e13f9b950 2024-09-10T22:30:15.174 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:15.154+0000 7f84ea388640 1 --2- 172.21.15.19:0/1367461123 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x561e13f9b950 0x561e13f9dd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:30:15.174 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:15.155+0000 7f84ea388640 1 --2- 172.21.15.19:0/1367461123 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x561e13f9b950 0x561e13f9dd40 crc :-1 s=READY pgs=98 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6495250de5144dd1 server_cookie=ff0e72d99ef698c7 in_seq=0 out_seq=0 2024-09-10T22:30:15.174 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:15.155+0000 7f84cdffb640 10 client.16152 ms_handle_connect on v2:172.21.15.135:6838/1254769802 2024-09-10T22:30:15.174 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:15.160+0000 7f84cdffb640 1 -- 172.21.15.19:0/1367461123 <== mds.0 v2:172.21.15.135:6838/1254769802 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x561e13ef3da0 con 0x561e13f9b950 2024-09-10T22:30:15.174 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:15.160+0000 7f84cdffb640 10 client.16152 handle_command_reply: tid=0 2024-09-10T22:30:15.174 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:15.160+0000 7f84ee9c1740 1 client.16152 shutdown 2024-09-10T22:30:15.174 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:15.160+0000 7f84ee9c1740 1 -- 172.21.15.19:0/1367461123 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x561e13f7fdd0 msgr2=0x561e13f88aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:30:15.174 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:15.160+0000 7f84ee9c1740 1 --2- 172.21.15.19:0/1367461123 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x561e13f7fdd0 0x561e13f88aa0 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7f84d4000ea0 tx=0x7f84d400ea40 comp rx=0 tx=0).stop 2024-09-10T22:30:15.175 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:15.164+0000 7f84ee9c1740 1 -- 172.21.15.19:0/1367461123 shutdown_connections 2024-09-10T22:30:15.175 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:15.164+0000 7f84ee9c1740 1 --2- 172.21.15.19:0/1367461123 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x561e13f9b950 0x561e13f9dd40 crc :-1 s=READY pgs=98 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:30:15.175 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:15.164+0000 7f84ee9c1740 1 --2- 172.21.15.19:0/1367461123 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x561e13f8bd60 0x561e13f890d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:30:15.175 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:15.164+0000 7f84ee9c1740 1 --2- 172.21.15.19:0/1367461123 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x561e13f7fdd0 0x561e13f88aa0 unknown :-1 s=CLOSED pgs=578 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:30:15.175 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:15.164+0000 7f84ee9c1740 1 --2- 172.21.15.19:0/1367461123 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561e13f7f4b0 0x561e13f8b650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:30:15.175 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:15.164+0000 7f84ee9c1740 1 -- 172.21.15.19:0/1367461123 >> 172.21.15.19:0/1367461123 conn(0x561e13f7d2e0 msgr2=0x561e13f82e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:30:15.175 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:15.164+0000 7f84cdffb640 0 client.16152 ms_handle_reset on v2:172.21.15.135:6838/1254769802 2024-09-10T22:30:15.175 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:15.164+0000 7f84ee9c1740 1 -- 172.21.15.19:0/1367461123 shutdown_connections 2024-09-10T22:30:15.176 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:15.164+0000 7f84ee9c1740 1 -- 172.21.15.19:0/1367461123 wait complete. 2024-09-10T22:30:15.176 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:15.164+0000 7f84ee9c1740 20 client.16152 trim_cache size 0 max 16384 2024-09-10T22:30:15.217 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:15.210+0000 7f84ee9c1740 1 Processor -- start 2024-09-10T22:30:15.217 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:15.210+0000 7f84ee9c1740 1 -- start start 2024-09-10T22:30:15.217 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:15.210+0000 7f84ee9c1740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x561e13f7f4b0 0x561e13f8d150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:30:15.217 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:15.210+0000 7f84ee9c1740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x561e13f7fdd0 0x561e13f8d690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:30:15.217 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:15.211+0000 7f84ee9c1740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561e13f8bd60 0x561e13f85cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:30:15.218 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:15.211+0000 7f84ee9c1740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f84e41aeda0 con 0x561e13f7fdd0 2024-09-10T22:30:15.218 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:15.211+0000 7f84ee9c1740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f84e41ac670 con 0x561e13f8bd60 2024-09-10T22:30:15.218 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:15.211+0000 7f84ee9c1740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f84e41aa4e0 con 0x561e13f7f4b0 2024-09-10T22:30:15.218 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:15.211+0000 7f84e9b87640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x561e13f7fdd0 0x561e13f8d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:30:15.218 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:15.211+0000 7f84e9b87640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x561e13f7fdd0 0x561e13f8d690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:43358/0 (socket says 172.21.15.19:43358) 2024-09-10T22:30:15.218 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:15.211+0000 7f84e9b87640 1 -- 172.21.15.19:0/1980809535 learned_addr learned my addr 172.21.15.19:0/1980809535 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:30:15.218 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:15.212+0000 7f84eab89640 1 --2- 172.21.15.19:0/1980809535 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561e13f8bd60 0x561e13f85cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:30:15.218 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:15.212+0000 7f84e9b87640 1 -- 172.21.15.19:0/1980809535 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x561e13f7f4b0 msgr2=0x561e13f8d150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:30:15.218 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:15.212+0000 7f84e9b87640 1 --2- 172.21.15.19:0/1980809535 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x561e13f7f4b0 0x561e13f8d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:30:15.218 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:15.212+0000 7f84e9b87640 1 -- 172.21.15.19:0/1980809535 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561e13f8bd60 msgr2=0x561e13f85cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:30:15.218 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:15.212+0000 7f84e9b87640 1 --2- 172.21.15.19:0/1980809535 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561e13f8bd60 0x561e13f85cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:30:15.218 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:15.212+0000 7f84e9b87640 1 -- 172.21.15.19:0/1980809535 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561e13f7dd60 con 0x561e13f7fdd0 2024-09-10T22:30:15.218 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:15.213+0000 7f84e9b87640 1 --2- 172.21.15.19:0/1980809535 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x561e13f7fdd0 0x561e13f8d690 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7f84d400ae50 tx=0x7f84d40046d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=84a0668aead8d71e server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:30:15.219 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:15.214+0000 7f84cffff640 1 -- 172.21.15.19:0/1980809535 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84d4057070 con 0x561e13f7fdd0 2024-09-10T22:30:15.219 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:15.214+0000 7f84cffff640 1 -- 172.21.15.19:0/1980809535 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f84d4013910 con 0x561e13f7fdd0 2024-09-10T22:30:15.219 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:15.214+0000 7f84cffff640 1 -- 172.21.15.19:0/1980809535 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84d4029030 con 0x561e13f7fdd0 2024-09-10T22:30:15.219 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:15.216+0000 7f84ee9c1740 1 -- 172.21.15.19:0/1980809535 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x561e13f7fdd0 msgr2=0x561e13f8d690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:30:15.219 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:15.216+0000 7f84ee9c1740 1 --2- 172.21.15.19:0/1980809535 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x561e13f7fdd0 0x561e13f8d690 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7f84d400ae50 tx=0x7f84d40046d0 comp rx=0 tx=0).stop 2024-09-10T22:30:15.220 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:15.217+0000 7f84ee9c1740 1 -- 172.21.15.19:0/1980809535 shutdown_connections 2024-09-10T22:30:15.220 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:15.217+0000 7f84ee9c1740 1 --2- 172.21.15.19:0/1980809535 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561e13f8bd60 0x561e13f85cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:30:15.220 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:15.217+0000 7f84ee9c1740 1 --2- 172.21.15.19:0/1980809535 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x561e13f7fdd0 0x561e13f8d690 unknown :-1 s=CLOSED pgs=579 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:30:15.220 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:15.217+0000 7f84ee9c1740 1 --2- 172.21.15.19:0/1980809535 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x561e13f7f4b0 0x561e13f8d150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:30:15.221 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:15.217+0000 7f84ee9c1740 1 -- 172.21.15.19:0/1980809535 >> 172.21.15.19:0/1980809535 conn(0x561e13f7d2e0 msgr2=0x561e13f87320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:30:15.224 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:15.218+0000 7f84ee9c1740 1 -- 172.21.15.19:0/1980809535 shutdown_connections 2024-09-10T22:30:15.224 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:15.218+0000 7f84ee9c1740 1 -- 172.21.15.19:0/1980809535 wait complete. 2024-09-10T22:30:15.224 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:15.219+0000 7f84ee9c1740 1 -- start start 2024-09-10T22:30:15.224 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:15.220+0000 7f84ee9c1740 1 Processor -- start 2024-09-10T22:30:15.225 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:15.221+0000 7f84ee9c1740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561e13f7f4b0 0x561e13f79d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:30:15.225 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:15.222+0000 7f84ee9c1740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x561e13f7fdd0 0x561e13f7a270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:30:15.225 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:15.222+0000 7f84ee9c1740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x561e13f8bd60 0x561e13f7a7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:30:15.225 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:15.222+0000 7f84eab89640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x561e13f8bd60 0x561e13f7a7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:30:15.225 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:15.222+0000 7f84eab89640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x561e13f8bd60 0x561e13f7a7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:43364/0 (socket says 172.21.15.19:43364) 2024-09-10T22:30:15.226 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:15.223+0000 7f84eab89640 1 -- 172.21.15.19:0/836355344 learned_addr learned my addr 172.21.15.19:0/836355344 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:30:15.226 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:15.222+0000 7f84ee9c1740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f84e41aab30 con 0x561e13f8bd60 2024-09-10T22:30:15.226 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:15.223+0000 7f84ee9c1740 1 -- 172.21.15.19:0/836355344 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f84e41abfa0 con 0x561e13f7f4b0 2024-09-10T22:30:15.226 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:15.223+0000 7f84ee9c1740 1 -- 172.21.15.19:0/836355344 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f84e41ab200 con 0x561e13f7fdd0 2024-09-10T22:30:15.227 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:15.224+0000 7f84eab89640 1 -- 172.21.15.19:0/836355344 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x561e13f7fdd0 msgr2=0x561e13f7a270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:30:15.227 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:15.224+0000 7f84eab89640 1 --2- 172.21.15.19:0/836355344 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x561e13f7fdd0 0x561e13f7a270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:30:15.227 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:15.224+0000 7f84eab89640 1 -- 172.21.15.19:0/836355344 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561e13f7f4b0 msgr2=0x561e13f79d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:30:15.227 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:15.224+0000 7f84eab89640 1 --2- 172.21.15.19:0/836355344 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561e13f7f4b0 0x561e13f79d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:30:15.227 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:15.224+0000 7f84eab89640 1 -- 172.21.15.19:0/836355344 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561e13fa0830 con 0x561e13f8bd60 2024-09-10T22:30:15.227 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:15.224+0000 7f84ee9c1740 10 client.0 _ll_register_callbacks cb 0x7f84d400a850 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T22:30:15.227 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:15.224+0000 7f84ee9c1740 1 -- 172.21.15.19:0/836355344 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f84d4013910 con 0x561e13f8bd60 2024-09-10T22:30:15.228 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:15.225+0000 7f84eab89640 1 --2- 172.21.15.19:0/836355344 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x561e13f8bd60 0x561e13f7a7b0 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7f84dc0abb10 tx=0x7f84dc004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6030266bf195c87b server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:30:15.228 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:15.226+0000 7f84cdffb640 10 client.16158 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-10T22:30:15.229 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:15.227+0000 7f84cdffb640 1 -- 172.21.15.19:0/836355344 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84dc0b4e80 con 0x561e13f8bd60 2024-09-10T22:30:15.230 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:15.228+0000 7f84cdffb640 1 -- 172.21.15.19:0/836355344 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8327+0+0 (secure 0 0 0) 0x7f84dc0aade0 con 0x561e13f8bd60 2024-09-10T22:30:15.231 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:15.229+0000 7f84cdffb640 1 -- 172.21.15.19:0/836355344 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f84dc0ab000 con 0x561e13f8bd60 2024-09-10T22:30:15.233 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:15.230+0000 7f84ee9c1740 10 client.16158 fetch_fsmap learned FSMap version 27 2024-09-10T22:30:15.233 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:15.230+0000 7f84ee9c1740 1 -- 172.21.15.19:0/836355344 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({fsmap=27}) -- 0x561e14004760 con 0x561e13f8bd60 2024-09-10T22:30:15.236 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:15.233+0000 7f84cdffb640 1 -- 172.21.15.19:0/836355344 <== mon.0 v2:172.21.15.19:3300/0 4 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7f84dc0c6ba0 con 0x561e13f8bd60 2024-09-10T22:30:15.236 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:15.234+0000 7f84ee9c1740 10 client.16158 fetch_fsmap finished waiting for FSMap version 27 2024-09-10T22:30:15.236 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:15.234+0000 7f84ee9c1740 10 client.16158 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-10T22:30:15.236 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:15.234+0000 7f84ee9c1740 20 client.16158 populate_metadata read hostname 'smithi019' 2024-09-10T22:30:15.237 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:15.234+0000 7f84ee9c1740 1 --2- 172.21.15.19:0/836355344 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x561e14004d30 0x561e140071b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:30:15.237 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:15.235+0000 7f84ee9c1740 4 client.16158 mds_command: new command op to 24581 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-10T22:30:15.237 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:15.235+0000 7f84ee9c1740 1 -- 172.21.15.19:0/836355344 --> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] -- command(tid 0: {"prefix": "scrub status"}) -- 0x561e13eef850 con 0x561e14004d30 2024-09-10T22:30:15.238 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:15.237+0000 7f84ea388640 1 --2- 172.21.15.19:0/836355344 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x561e14004d30 0x561e140071b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:30:15.244 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:15.242+0000 7f84cdffb640 10 client.16158 ms_handle_connect on v2:172.21.15.135:6838/1254769802 2024-09-10T22:30:15.244 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:15.242+0000 7f84ea388640 1 --2- 172.21.15.19:0/836355344 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x561e14004d30 0x561e140071b0 crc :-1 s=READY pgs=99 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1c35b69fa3fee1a server_cookie=16eadeafcfd8c809 in_seq=0 out_seq=0 2024-09-10T22:30:15.247 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:15.245+0000 7f84cdffb640 1 -- 172.21.15.19:0/836355344 <== mds.0 v2:172.21.15.135:6838/1254769802 1 ==== command_reply(tid 0: 0 ) ==== 8+0+1990 (crc 0 0 0) 0x561e13eef850 con 0x561e14004d30 2024-09-10T22:30:15.247 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:15.245+0000 7f84cdffb640 10 client.16158 handle_command_reply: tid=0 2024-09-10T22:30:15.247 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:15.245+0000 7f84ee9c1740 1 client.16158 shutdown 2024-09-10T22:30:15.247 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:15.245+0000 7f84ee9c1740 1 -- 172.21.15.19:0/836355344 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x561e13f8bd60 msgr2=0x561e13f7a7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:30:15.247 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:15.245+0000 7f84ee9c1740 1 --2- 172.21.15.19:0/836355344 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x561e13f8bd60 0x561e13f7a7b0 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7f84dc0abb10 tx=0x7f84dc004a40 comp rx=0 tx=0).stop 2024-09-10T22:30:15.247 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:15.246+0000 7f84ee9c1740 1 -- 172.21.15.19:0/836355344 shutdown_connections 2024-09-10T22:30:15.248 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:15.246+0000 7f84ee9c1740 1 --2- 172.21.15.19:0/836355344 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x561e13f8bd60 0x561e13f7a7b0 unknown :-1 s=CLOSED pgs=580 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:30:15.248 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:15.246+0000 7f84ee9c1740 1 --2- 172.21.15.19:0/836355344 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x561e14004d30 0x561e140071b0 crc :-1 s=READY pgs=99 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:30:15.248 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:15.246+0000 7f84ee9c1740 1 --2- 172.21.15.19:0/836355344 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x561e13f7fdd0 0x561e13f7a270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:30:15.248 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:15.246+0000 7f84ee9c1740 1 --2- 172.21.15.19:0/836355344 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561e13f7f4b0 0x561e13f79d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:30:15.248 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:15.246+0000 7f84ee9c1740 1 -- 172.21.15.19:0/836355344 >> 172.21.15.19:0/836355344 conn(0x561e13f7d2e0 msgr2=0x561e13f8a0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:30:15.248 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:15.246+0000 7f84cdffb640 0 client.16158 ms_handle_reset on v2:172.21.15.135:6838/1254769802 2024-09-10T22:30:15.248 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:15.247+0000 7f84ee9c1740 1 -- 172.21.15.19:0/836355344 shutdown_connections 2024-09-10T22:30:15.249 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:15.247+0000 7f84ee9c1740 1 -- 172.21.15.19:0/836355344 wait complete. 2024-09-10T22:30:15.249 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:15.247+0000 7f84ee9c1740 20 client.16158 trim_cache size 0 max 16384 2024-09-10T22:30:15.249 INFO:teuthology.orchestra.run.smithi019.stdout:{ 2024-09-10T22:30:15.250 INFO:teuthology.orchestra.run.smithi019.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-10T22:30:15.250 INFO:teuthology.orchestra.run.smithi019.stdout: "scrubs": { 2024-09-10T22:30:15.250 INFO:teuthology.orchestra.run.smithi019.stdout: "fd1f1837-dcfa-4d88-99e8-2509f36c3f98": { 2024-09-10T22:30:15.250 INFO:teuthology.orchestra.run.smithi019.stdout: "path": "/", 2024-09-10T22:30:15.250 INFO:teuthology.orchestra.run.smithi019.stdout: "tag": "fd1f1837-dcfa-4d88-99e8-2509f36c3f98", 2024-09-10T22:30:15.250 INFO:teuthology.orchestra.run.smithi019.stdout: "options": "recursive,force" 2024-09-10T22:30:15.250 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-10T22:30:15.250 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:30:15.250 INFO:teuthology.orchestra.run.smithi019.stdout: "scrub_stats": { 2024-09-10T22:30:15.250 INFO:teuthology.orchestra.run.smithi019.stdout: "fd1f1837-dcfa-4d88-99e8-2509f36c3f98": { 2024-09-10T22:30:15.250 INFO:teuthology.orchestra.run.smithi019.stdout: "start_time": "2024-09-10T22:30:12.470477+0000", 2024-09-10T22:30:15.251 INFO:teuthology.orchestra.run.smithi019.stdout: "path": "/", 2024-09-10T22:30:15.251 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_started": 0, 2024-09-10T22:30:15.251 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_passed": 0, 2024-09-10T22:30:15.251 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_failed": 0, 2024-09-10T22:30:15.251 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_skipped": 0 2024-09-10T22:30:15.251 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:30:15.251 INFO:teuthology.orchestra.run.smithi019.stdout: "8f3bb3bf-911f-490c-9856-c80ea220dbbe": { 2024-09-10T22:30:15.251 INFO:teuthology.orchestra.run.smithi019.stdout: "start_time": "2024-09-10T22:29:25.374415+0000", 2024-09-10T22:30:15.251 INFO:teuthology.orchestra.run.smithi019.stdout: "path": "/", 2024-09-10T22:30:15.251 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_started": 0, 2024-09-10T22:30:15.251 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_passed": 0, 2024-09-10T22:30:15.251 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_failed": 0, 2024-09-10T22:30:15.251 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_skipped": 0 2024-09-10T22:30:15.251 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:30:15.252 INFO:teuthology.orchestra.run.smithi019.stdout: "eb518e3c-a71e-4f32-9ca0-ae88930ca218": { 2024-09-10T22:30:15.252 INFO:teuthology.orchestra.run.smithi019.stdout: "start_time": "2024-09-10T22:28:38.366352+0000", 2024-09-10T22:30:15.252 INFO:teuthology.orchestra.run.smithi019.stdout: "path": "/", 2024-09-10T22:30:15.252 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_started": 0, 2024-09-10T22:30:15.252 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_passed": 0, 2024-09-10T22:30:15.252 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_failed": 0, 2024-09-10T22:30:15.252 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_skipped": 0 2024-09-10T22:30:15.252 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:30:15.252 INFO:teuthology.orchestra.run.smithi019.stdout: "c12c2a04-dcd6-4673-a98e-93f665d3f5d7": { 2024-09-10T22:30:15.252 INFO:teuthology.orchestra.run.smithi019.stdout: "start_time": "2024-09-10T22:27:49.392329+0000", 2024-09-10T22:30:15.252 INFO:teuthology.orchestra.run.smithi019.stdout: "path": "/", 2024-09-10T22:30:15.252 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_started": 0, 2024-09-10T22:30:15.252 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_passed": 0, 2024-09-10T22:30:15.252 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_failed": 0, 2024-09-10T22:30:15.253 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_skipped": 0 2024-09-10T22:30:15.253 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:30:15.253 INFO:teuthology.orchestra.run.smithi019.stdout: "b38852c8-478a-42ef-8384-b2c55d5313a4": { 2024-09-10T22:30:15.253 INFO:teuthology.orchestra.run.smithi019.stdout: "start_time": "2024-09-10T22:27:00.320308+0000", 2024-09-10T22:30:15.253 INFO:teuthology.orchestra.run.smithi019.stdout: "path": "/", 2024-09-10T22:30:15.253 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_started": 0, 2024-09-10T22:30:15.253 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_passed": 0, 2024-09-10T22:30:15.253 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_failed": 0, 2024-09-10T22:30:15.253 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_skipped": 0 2024-09-10T22:30:15.253 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:30:15.253 INFO:teuthology.orchestra.run.smithi019.stdout: "9b6bfdee-303c-4c12-af56-dc85860d112a": { 2024-09-10T22:30:15.253 INFO:teuthology.orchestra.run.smithi019.stdout: "start_time": "2024-09-10T22:26:17.484162+0000", 2024-09-10T22:30:15.253 INFO:teuthology.orchestra.run.smithi019.stdout: "path": "/", 2024-09-10T22:30:15.253 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_started": 0, 2024-09-10T22:30:15.254 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_passed": 0, 2024-09-10T22:30:15.254 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_failed": 0, 2024-09-10T22:30:15.254 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_skipped": 0 2024-09-10T22:30:15.254 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-10T22:30:15.254 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-10T22:30:15.254 INFO:teuthology.orchestra.run.smithi019.stdout:} 2024-09-10T22:30:15.254 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:15.249+0000 7f84ec5ec640 1 -- 172.21.15.19:0/21070272 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f84d00b5420 msgr2=0x7f84d00b78e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:30:15.255 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:15.249+0000 7f84ec5ec640 1 --2- 172.21.15.19:0/21070272 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f84d00b5420 0x7f84d00b78e0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f84e000b230 tx=0x7f84e000b040 comp rx=0 tx=0).stop 2024-09-10T22:30:15.255 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:15.249+0000 7f84ec5ec640 1 -- 172.21.15.19:0/21070272 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f84e4108020 msgr2=0x7f84e419eae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:30:15.255 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:15.249+0000 7f84ec5ec640 1 --2- 172.21.15.19:0/21070272 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f84e4108020 0x7f84e419eae0 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7f84dc00b970 tx=0x7f84dc00be30 comp rx=0 tx=0).stop 2024-09-10T22:30:15.255 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:15.249+0000 7f84ec5ec640 1 -- 172.21.15.19:0/21070272 shutdown_connections 2024-09-10T22:30:15.255 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:15.249+0000 7f84ec5ec640 1 --2- 172.21.15.19:0/21070272 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f84d00b5420 0x7f84d00b78e0 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:30:15.255 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:15.249+0000 7f84ec5ec640 1 --2- 172.21.15.19:0/21070272 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f84e4108020 0x7f84e419eae0 unknown :-1 s=CLOSED pgs=576 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:30:15.255 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:15.249+0000 7f84ec5ec640 1 --2- 172.21.15.19:0/21070272 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f84e41076a0 0x7f84e4199740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:30:15.255 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:15.249+0000 7f84ec5ec640 1 --2- 172.21.15.19:0/21070272 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f84e4101c90 0x7f84e4199200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:30:15.255 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:15.249+0000 7f84ec5ec640 1 -- 172.21.15.19:0/21070272 >> 172.21.15.19:0/21070272 conn(0x7f84e40fd700 msgr2=0x7f84e4105d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:30:15.255 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:15.249+0000 7f84ec5ec640 1 -- 172.21.15.19:0/21070272 shutdown_connections 2024-09-10T22:30:15.255 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:15.249+0000 7f84ec5ec640 1 -- 172.21.15.19:0/21070272 wait complete. 2024-09-10T22:30:16.110 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:30:15 smithi135 ceph-mon[34789]: pgmap v462: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 857 KiB/s rd, 374 MiB/s wr, 202 op/s 2024-09-10T22:30:16.125 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:30:15 smithi138 ceph-mon[35236]: pgmap v462: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 857 KiB/s rd, 374 MiB/s wr, 202 op/s 2024-09-10T22:30:16.208 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:30:15 smithi019 ceph-mon[31375]: pgmap v462: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 857 KiB/s rd, 374 MiB/s wr, 202 op/s 2024-09-10T22:30:16.555 INFO:tasks.cephfs.filesystem:scrub status for tag:fd1f1837-dcfa-4d88-99e8-2509f36c3f98 - {'path': '/', 'tag': 'fd1f1837-dcfa-4d88-99e8-2509f36c3f98', 'options': 'recursive,force'} 2024-09-10T22:30:18.110 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:30:17 smithi135 ceph-mon[34789]: pgmap v463: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 854 KiB/s rd, 400 MiB/s wr, 231 op/s 2024-09-10T22:30:18.125 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:30:17 smithi138 ceph-mon[35236]: pgmap v463: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 854 KiB/s rd, 400 MiB/s wr, 231 op/s 2024-09-10T22:30:18.208 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:30:17 smithi019 ceph-mon[31375]: pgmap v463: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 854 KiB/s rd, 400 MiB/s wr, 231 op/s 2024-09-10T22:30:20.111 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:30:19 smithi135 ceph-mon[34789]: pgmap v464: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 683 KiB/s rd, 353 MiB/s wr, 214 op/s 2024-09-10T22:30:20.125 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:30:19 smithi138 ceph-mon[35236]: pgmap v464: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 683 KiB/s rd, 353 MiB/s wr, 214 op/s 2024-09-10T22:30:20.208 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:30:19 smithi019 ceph-mon[31375]: pgmap v464: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 683 KiB/s rd, 353 MiB/s wr, 214 op/s 2024-09-10T22:30:22.110 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:30:21 smithi135 ceph-mon[34789]: pgmap v465: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 1003 KiB/s rd, 399 MiB/s wr, 247 op/s 2024-09-10T22:30:22.125 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:30:21 smithi138 ceph-mon[35236]: pgmap v465: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 1003 KiB/s rd, 399 MiB/s wr, 247 op/s 2024-09-10T22:30:22.208 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:30:21 smithi019 ceph-mon[31375]: pgmap v465: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 1003 KiB/s rd, 399 MiB/s wr, 247 op/s 2024-09-10T22:30:22.958 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:30:22 smithi019 ceph-mon[31375]: scrub summary: idle 2024-09-10T22:30:22.958 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:30:22 smithi019 ceph-mon[31375]: scrub summary: idle 2024-09-10T22:30:23.110 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:30:22 smithi135 ceph-mon[34789]: scrub summary: idle 2024-09-10T22:30:23.110 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:30:22 smithi135 ceph-mon[34789]: scrub summary: idle 2024-09-10T22:30:23.125 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:30:22 smithi138 ceph-mon[35236]: scrub summary: idle 2024-09-10T22:30:23.125 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:30:22 smithi138 ceph-mon[35236]: scrub summary: idle 2024-09-10T22:30:24.109 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:30:23 smithi135 ceph-mon[34789]: pgmap v466: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 626 KiB/s rd, 342 MiB/s wr, 221 op/s 2024-09-10T22:30:24.125 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:30:23 smithi138 ceph-mon[35236]: pgmap v466: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 626 KiB/s rd, 342 MiB/s wr, 221 op/s 2024-09-10T22:30:24.212 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:30:23 smithi019 ceph-mon[31375]: pgmap v466: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 626 KiB/s rd, 342 MiB/s wr, 221 op/s 2024-09-10T22:30:24.323 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:24.321+0000 7f5596375640 1 -- 172.21.15.19:0/287657237 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5590102130 msgr2=0x7f55901025b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:30:24.323 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:24.321+0000 7f5596375640 1 --2- 172.21.15.19:0/287657237 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5590102130 0x7f55901025b0 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7f558400aa40 tx=0x7f558402b750 comp rx=0 tx=0).stop 2024-09-10T22:30:24.323 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:24.321+0000 7f5596375640 1 -- 172.21.15.19:0/287657237 shutdown_connections 2024-09-10T22:30:24.323 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:24.321+0000 7f5596375640 1 --2- 172.21.15.19:0/287657237 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5590102af0 0x7f5590109470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:30:24.323 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:24.321+0000 7f5596375640 1 --2- 172.21.15.19:0/287657237 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5590102130 0x7f55901025b0 unknown :-1 s=CLOSED pgs=581 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:30:24.323 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:24.321+0000 7f5596375640 1 --2- 172.21.15.19:0/287657237 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5590100fe0 0x7f55901013e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:30:24.324 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:24.321+0000 7f5596375640 1 -- 172.21.15.19:0/287657237 >> 172.21.15.19:0/287657237 conn(0x7f55900fc880 msgr2=0x7f55900fecc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:30:24.324 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:24.321+0000 7f5596375640 1 -- 172.21.15.19:0/287657237 shutdown_connections 2024-09-10T22:30:24.324 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:24.321+0000 7f5596375640 1 -- 172.21.15.19:0/287657237 wait complete. 2024-09-10T22:30:24.324 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:24.322+0000 7f5596375640 1 Processor -- start 2024-09-10T22:30:24.324 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:24.322+0000 7f5596375640 1 -- start start 2024-09-10T22:30:24.326 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:24.322+0000 7f5596375640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5590100fe0 0x7f559019b000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:30:24.326 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:24.322+0000 7f5596375640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5590102130 0x7f559019b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:30:24.326 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:24.322+0000 7f5596375640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5590102af0 0x7f559019c280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:30:24.327 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:24.322+0000 7f5596375640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f559010c3e0 con 0x7f5590100fe0 2024-09-10T22:30:24.327 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:24.322+0000 7f5596375640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f559010c260 con 0x7f5590102af0 2024-09-10T22:30:24.327 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:24.322+0000 7f5596375640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f559010c560 con 0x7f5590102130 2024-09-10T22:30:24.327 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:24.322+0000 7f558ffff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5590100fe0 0x7f559019b000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:30:24.327 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:24.322+0000 7f558ffff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5590100fe0 0x7f559019b000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:47976/0 (socket says 172.21.15.19:47976) 2024-09-10T22:30:24.327 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:24.322+0000 7f558ffff640 1 -- 172.21.15.19:0/1003071193 learned_addr learned my addr 172.21.15.19:0/1003071193 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:30:24.327 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:24.323+0000 7f558f7fe640 1 --2- 172.21.15.19:0/1003071193 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5590102130 0x7f559019b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:30:24.327 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:24.323+0000 7f5594912640 1 --2- 172.21.15.19:0/1003071193 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5590102af0 0x7f559019c280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:30:24.327 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:24.323+0000 7f558ffff640 1 -- 172.21.15.19:0/1003071193 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5590102130 msgr2=0x7f559019b650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:30:24.327 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:24.323+0000 7f558ffff640 1 --2- 172.21.15.19:0/1003071193 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5590102130 0x7f559019b650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:30:24.327 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:24.323+0000 7f558ffff640 1 -- 172.21.15.19:0/1003071193 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5590102af0 msgr2=0x7f559019c280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:30:24.327 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:24.323+0000 7f558ffff640 1 --2- 172.21.15.19:0/1003071193 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5590102af0 0x7f559019c280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:30:24.328 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:24.323+0000 7f558ffff640 1 -- 172.21.15.19:0/1003071193 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f559019cb40 con 0x7f5590100fe0 2024-09-10T22:30:24.328 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:24.323+0000 7f558ffff640 1 --2- 172.21.15.19:0/1003071193 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5590100fe0 0x7f559019b000 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f558000d950 tx=0x7f558000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:30:24.328 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:24.323+0000 7f558d7fa640 1 -- 172.21.15.19:0/1003071193 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5580017030 con 0x7f5590100fe0 2024-09-10T22:30:24.328 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:24.324+0000 7f5596375640 1 -- 172.21.15.19:0/1003071193 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f559019ce30 con 0x7f5590100fe0 2024-09-10T22:30:24.328 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:24.324+0000 7f558d7fa640 1 -- 172.21.15.19:0/1003071193 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5580004020 con 0x7f5590100fe0 2024-09-10T22:30:24.328 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:24.324+0000 7f558d7fa640 1 -- 172.21.15.19:0/1003071193 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55800047a0 con 0x7f5590100fe0 2024-09-10T22:30:24.328 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:24.324+0000 7f5596375640 1 -- 172.21.15.19:0/1003071193 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f55901a3500 con 0x7f5590100fe0 2024-09-10T22:30:24.329 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:24.328+0000 7f559921e740 1 Processor -- start 2024-09-10T22:30:24.329 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:24.328+0000 7f559921e740 1 -- start start 2024-09-10T22:30:24.329 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:24.328+0000 7f559921e740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55a2a30d5860 0x55a2a30d7c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:30:24.330 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:24.328+0000 7f559921e740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55a2a30d8190 0x55a2a30da580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:30:24.330 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:24.328+0000 7f559921e740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a2a30dabd0 0x55a2a30dd090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:30:24.330 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:24.328+0000 7f559921e740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x55a2a30476f0 con 0x55a2a30d8190 2024-09-10T22:30:24.330 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:24.328+0000 7f559921e740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55a2a3036b20 con 0x55a2a30dabd0 2024-09-10T22:30:24.330 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:24.328+0000 7f559921e740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x55a2a303a930 con 0x55a2a30d5860 2024-09-10T22:30:24.331 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:24.328+0000 7f5594912640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55a2a30d5860 0x55a2a30d7c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:30:24.331 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:24.328+0000 7f5594912640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55a2a30d5860 0x55a2a30d7c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.19:33458/0 (socket says 172.21.15.19:33458) 2024-09-10T22:30:24.331 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:24.328+0000 7f5594912640 1 -- 172.21.15.19:0/2907283650 learned_addr learned my addr 172.21.15.19:0/2907283650 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:30:24.331 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:24.329+0000 7f558d7fa640 1 -- 172.21.15.19:0/1003071193 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 18) ==== 153250+0+0 (secure 0 0 0) 0x7f5580009a30 con 0x7f5590100fe0 2024-09-10T22:30:24.331 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:24.329+0000 7f5594912640 1 -- 172.21.15.19:0/2907283650 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a2a30dabd0 msgr2=0x55a2a30dd090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:30:24.331 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:24.329+0000 7f5594912640 1 --2- 172.21.15.19:0/2907283650 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a2a30dabd0 0x55a2a30dd090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:30:24.331 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:24.329+0000 7f5594912640 1 -- 172.21.15.19:0/2907283650 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55a2a30d8190 msgr2=0x55a2a30da580 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-10T22:30:24.332 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:24.329+0000 7f5594912640 1 --2- 172.21.15.19:0/2907283650 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55a2a30d8190 0x55a2a30da580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:30:24.332 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:24.329+0000 7f5594912640 1 -- 172.21.15.19:0/2907283650 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a2a2ffc530 con 0x55a2a30d5860 2024-09-10T22:30:24.332 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:24.329+0000 7f5594912640 1 --2- 172.21.15.19:0/2907283650 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55a2a30d5860 0x55a2a30d7c50 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f5588009f00 tx=0x7f55880107a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f2718ad42ee0681a server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:30:24.332 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:24.329+0000 7f55767fc640 1 -- 172.21.15.19:0/2907283650 <== mon.1 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5588003b70 con 0x55a2a30d5860 2024-09-10T22:30:24.332 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:24.329+0000 7f55767fc640 1 -- 172.21.15.19:0/2907283650 <== mon.1 v2:172.21.15.138:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5588003d10 con 0x55a2a30d5860 2024-09-10T22:30:24.332 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:24.329+0000 7f55767fc640 1 -- 172.21.15.19:0/2907283650 <== mon.1 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5588011980 con 0x55a2a30d5860 2024-09-10T22:30:24.335 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:24.330+0000 7f558d7fa640 1 --2- 172.21.15.19:0/1003071193 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f55780b52e0 0x7f55780b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:30:24.336 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:24.330+0000 7f559921e740 1 -- 172.21.15.19:0/2907283650 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55a2a30d5860 msgr2=0x55a2a30d7c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:30:24.336 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:24.330+0000 7f559921e740 1 --2- 172.21.15.19:0/2907283650 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55a2a30d5860 0x55a2a30d7c50 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f5588009f00 tx=0x7f55880107a0 comp rx=0 tx=0).stop 2024-09-10T22:30:24.336 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:24.330+0000 7f559921e740 1 -- 172.21.15.19:0/2907283650 shutdown_connections 2024-09-10T22:30:24.336 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:24.330+0000 7f559921e740 1 --2- 172.21.15.19:0/2907283650 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a2a30dabd0 0x55a2a30dd090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:30:24.336 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:24.330+0000 7f559921e740 1 --2- 172.21.15.19:0/2907283650 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55a2a30d8190 0x55a2a30da580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:30:24.336 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:24.330+0000 7f559921e740 1 --2- 172.21.15.19:0/2907283650 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55a2a30d5860 0x55a2a30d7c50 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:30:24.336 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:24.330+0000 7f559921e740 1 -- 172.21.15.19:0/2907283650 >> 172.21.15.19:0/2907283650 conn(0x55a2a30d09b0 msgr2=0x55a2a30d1740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:30:24.336 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:24.330+0000 7f558ffff640 1 --2- 172.21.15.19:0/1003071193 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f55780b52e0 0x7f55780b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:30:24.336 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:24.331+0000 7f558d7fa640 1 -- 172.21.15.19:0/1003071193 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8327+0+0 (secure 0 0 0) 0x7f55800e5750 con 0x7f5590100fe0 2024-09-10T22:30:24.336 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:24.331+0000 7f558ffff640 1 --2- 172.21.15.19:0/1003071193 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f55780b52e0 0x7f55780b77a0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f558001b000 tx=0x7f5580093040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:30:24.336 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:24.331+0000 7f559921e740 1 -- 172.21.15.19:0/2907283650 shutdown_connections 2024-09-10T22:30:24.336 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:24.331+0000 7f559921e740 1 -- 172.21.15.19:0/2907283650 wait complete. 2024-09-10T22:30:24.337 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:24.331+0000 7f559921e740 1 -- start start 2024-09-10T22:30:24.337 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:24.332+0000 7f559921e740 1 Processor -- start 2024-09-10T22:30:24.337 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:24.332+0000 7f559921e740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55a2a30d5860 0x55a2a30deef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:30:24.337 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:24.332+0000 7f559921e740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55a2a30d8190 0x55a2a30df590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:30:24.337 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:24.332+0000 7f559921e740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a2a30dabd0 0x55a2a30e0160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:30:24.337 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:24.332+0000 7f559921e740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x55a2a2f6eab0 con 0x55a2a30d5860 2024-09-10T22:30:24.337 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:24.332+0000 7f559921e740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55a2a2fdc730 con 0x55a2a30dabd0 2024-09-10T22:30:24.337 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:24.332+0000 7f559921e740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x55a2a30ddbb0 con 0x55a2a30d8190 2024-09-10T22:30:24.337 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:24.332+0000 7f559921e740 10 client.0 _ll_register_callbacks cb 0x55a2a30306b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T22:30:24.337 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:24.332+0000 7f5594912640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55a2a30d5860 0x55a2a30deef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:30:24.337 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:24.332+0000 7f5594912640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55a2a30d5860 0x55a2a30deef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:47988/0 (socket says 172.21.15.19:47988) 2024-09-10T22:30:24.337 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:24.332+0000 7f5594912640 1 -- 172.21.15.19:0/3777302775 learned_addr learned my addr 172.21.15.19:0/3777302775 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:30:24.337 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:24.332+0000 7f558f7fe640 1 --2- 172.21.15.19:0/3777302775 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55a2a30d8190 0x55a2a30df590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:30:24.338 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:24.333+0000 7f5594912640 1 -- 172.21.15.19:0/3777302775 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55a2a30d8190 msgr2=0x55a2a30df590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:30:24.338 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:24.333+0000 7f5594912640 1 --2- 172.21.15.19:0/3777302775 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55a2a30d8190 0x55a2a30df590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:30:24.338 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:24.333+0000 7f5594912640 1 -- 172.21.15.19:0/3777302775 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a2a30dabd0 msgr2=0x55a2a30e0160 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-10T22:30:24.338 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:24.333+0000 7f5594912640 1 --2- 172.21.15.19:0/3777302775 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a2a30dabd0 0x55a2a30e0160 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:30:24.338 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:24.333+0000 7f5594912640 1 -- 172.21.15.19:0/3777302775 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a2a2d98790 con 0x55a2a30d5860 2024-09-10T22:30:24.338 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:24.333+0000 7f556f7fe640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-10T22:30:24.338 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:24.333+0000 7f5594912640 1 --2- 172.21.15.19:0/3777302775 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55a2a30d5860 0x55a2a30deef0 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f5588004970 tx=0x7f5588004230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=992082fde6704009 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:30:24.338 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:24.333+0000 7f556f7fe640 1 -- 172.21.15.19:0/3777302775 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5588004a00 con 0x55a2a30d5860 2024-09-10T22:30:24.338 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:24.333+0000 7f556f7fe640 1 -- 172.21.15.19:0/3777302775 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8327+0+0 (secure 0 0 0) 0x7f5588004ba0 con 0x55a2a30d5860 2024-09-10T22:30:24.338 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:24.333+0000 7f559921e740 1 -- 172.21.15.19:0/3777302775 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5588003d10 con 0x55a2a30d5860 2024-09-10T22:30:24.338 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:24.333+0000 7f556f7fe640 1 -- 172.21.15.19:0/3777302775 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f5588011680 con 0x55a2a30d5860 2024-09-10T22:30:24.338 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:24.333+0000 7f559921e740 10 client.16167 fetch_fsmap learned FSMap version 27 2024-09-10T22:30:24.338 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:24.333+0000 7f559921e740 1 -- 172.21.15.19:0/3777302775 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55a2a2e11620 con 0x55a2a30d5860 2024-09-10T22:30:24.339 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:24.334+0000 7f556f7fe640 1 -- 172.21.15.19:0/3777302775 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5588003d10 con 0x55a2a30d5860 2024-09-10T22:30:24.339 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:24.334+0000 7f556f7fe640 1 -- 172.21.15.19:0/3777302775 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7f558802f020 con 0x55a2a30d5860 2024-09-10T22:30:24.339 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:24.334+0000 7f559921e740 10 client.16167 fetch_fsmap finished waiting for FSMap version 27 2024-09-10T22:30:24.339 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:24.334+0000 7f559921e740 10 client.16167 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-10T22:30:24.339 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:24.334+0000 7f559921e740 20 client.16167 populate_metadata read hostname 'smithi019' 2024-09-10T22:30:24.339 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:24.334+0000 7f559921e740 1 --2- 172.21.15.19:0/3777302775 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x55a2a30ea4f0 0x55a2a30ec8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:30:24.339 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:24.334+0000 7f559921e740 4 client.16167 mds_command: new command op to 24581 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T22:30:24.339 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:24.334+0000 7f559921e740 1 -- 172.21.15.19:0/3777302775 --> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a2a3049640 con 0x55a2a30ea4f0 2024-09-10T22:30:24.339 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:24.334+0000 7f558f7fe640 1 --2- 172.21.15.19:0/3777302775 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x55a2a30ea4f0 0x55a2a30ec8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:30:24.340 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:24.335+0000 7f556f7fe640 10 client.16167 ms_handle_connect on v2:172.21.15.135:6838/1254769802 2024-09-10T22:30:24.341 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:24.335+0000 7f558f7fe640 1 --2- 172.21.15.19:0/3777302775 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x55a2a30ea4f0 0x55a2a30ec8e0 crc :-1 s=READY pgs=100 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ce2b8b8b61021ccb server_cookie=5a7587a64a64cd04 in_seq=0 out_seq=0 2024-09-10T22:30:24.341 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:24.337+0000 7f556f7fe640 1 -- 172.21.15.19:0/3777302775 <== mds.0 v2:172.21.15.135:6838/1254769802 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55a2a3049640 con 0x55a2a30ea4f0 2024-09-10T22:30:24.341 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:24.337+0000 7f556f7fe640 10 client.16167 handle_command_reply: tid=0 2024-09-10T22:30:24.341 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:24.337+0000 7f559921e740 1 client.16167 shutdown 2024-09-10T22:30:24.341 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:24.337+0000 7f559921e740 1 -- 172.21.15.19:0/3777302775 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55a2a30d5860 msgr2=0x55a2a30deef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:30:24.341 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:24.337+0000 7f559921e740 1 --2- 172.21.15.19:0/3777302775 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55a2a30d5860 0x55a2a30deef0 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f5588004970 tx=0x7f5588004230 comp rx=0 tx=0).stop 2024-09-10T22:30:24.341 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:24.337+0000 7f559921e740 1 -- 172.21.15.19:0/3777302775 shutdown_connections 2024-09-10T22:30:24.341 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:24.337+0000 7f559921e740 1 --2- 172.21.15.19:0/3777302775 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a2a30dabd0 0x55a2a30e0160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:30:24.341 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:24.337+0000 7f559921e740 1 --2- 172.21.15.19:0/3777302775 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x55a2a30ea4f0 0x55a2a30ec8e0 crc :-1 s=READY pgs=100 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:30:24.341 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:24.337+0000 7f559921e740 1 --2- 172.21.15.19:0/3777302775 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55a2a30d8190 0x55a2a30df590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:30:24.341 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:24.337+0000 7f556f7fe640 0 client.16167 ms_handle_reset on v2:172.21.15.135:6838/1254769802 2024-09-10T22:30:24.341 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:24.337+0000 7f559921e740 1 --2- 172.21.15.19:0/3777302775 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55a2a30d5860 0x55a2a30deef0 unknown :-1 s=CLOSED pgs=583 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:30:24.341 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:24.337+0000 7f559921e740 1 -- 172.21.15.19:0/3777302775 >> 172.21.15.19:0/3777302775 conn(0x55a2a30d09b0 msgr2=0x55a2a30cfbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:30:24.342 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:24.337+0000 7f559921e740 1 -- 172.21.15.19:0/3777302775 shutdown_connections 2024-09-10T22:30:24.342 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:24.337+0000 7f559921e740 1 -- 172.21.15.19:0/3777302775 wait complete. 2024-09-10T22:30:24.342 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:24.337+0000 7f559921e740 20 client.16167 trim_cache size 0 max 16384 2024-09-10T22:30:24.358 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:24.355+0000 7f559921e740 1 Processor -- start 2024-09-10T22:30:24.358 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:24.355+0000 7f559921e740 1 -- start start 2024-09-10T22:30:24.358 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:24.355+0000 7f559921e740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55a2a30d5860 0x55a2a30dea90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:30:24.358 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:24.355+0000 7f559921e740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55a2a30d8190 0x55a2a30d4cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:30:24.358 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:24.355+0000 7f559921e740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a2a30dabd0 0x55a2a30d5230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:30:24.359 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:24.355+0000 7f559921e740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f55901aec90 con 0x55a2a30d8190 2024-09-10T22:30:24.359 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:24.355+0000 7f559921e740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f55901ac560 con 0x55a2a30dabd0 2024-09-10T22:30:24.359 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:24.355+0000 7f559921e740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f55901aa3b0 con 0x55a2a30d5860 2024-09-10T22:30:24.359 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:24.356+0000 7f558f7fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55a2a30d8190 0x55a2a30d4cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:30:24.359 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:24.356+0000 7f558f7fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55a2a30d8190 0x55a2a30d4cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:47990/0 (socket says 172.21.15.19:47990) 2024-09-10T22:30:24.359 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:24.356+0000 7f558f7fe640 1 -- 172.21.15.19:0/3104468944 learned_addr learned my addr 172.21.15.19:0/3104468944 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:30:24.359 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:24.356+0000 7f5594912640 1 --2- 172.21.15.19:0/3104468944 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55a2a30d5860 0x55a2a30dea90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:30:24.359 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:24.356+0000 7f5594912640 1 --2- 172.21.15.19:0/3104468944 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a2a30dabd0 0x55a2a30d5230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:30:24.359 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:24.356+0000 7f558f7fe640 1 -- 172.21.15.19:0/3104468944 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55a2a30d5860 msgr2=0x55a2a30dea90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:30:24.359 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:24.356+0000 7f558f7fe640 1 --2- 172.21.15.19:0/3104468944 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55a2a30d5860 0x55a2a30dea90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:30:24.359 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:24.356+0000 7f558f7fe640 1 -- 172.21.15.19:0/3104468944 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a2a30dabd0 msgr2=0x55a2a30d5230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:30:24.359 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:24.356+0000 7f558f7fe640 1 --2- 172.21.15.19:0/3104468944 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a2a30dabd0 0x55a2a30d5230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:30:24.359 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:24.356+0000 7f558f7fe640 1 -- 172.21.15.19:0/3104468944 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a2a30ecc50 con 0x55a2a30d8190 2024-09-10T22:30:24.360 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:24.356+0000 7f558f7fe640 1 --2- 172.21.15.19:0/3104468944 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55a2a30d8190 0x55a2a30d4cf0 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7f558400aa10 tx=0x7f5584005fd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6765a6d767c43319 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:30:24.360 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:24.356+0000 7f5575ffb640 1 -- 172.21.15.19:0/3104468944 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5584036040 con 0x55a2a30d8190 2024-09-10T22:30:24.360 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:24.356+0000 7f5575ffb640 1 -- 172.21.15.19:0/3104468944 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5584004040 con 0x55a2a30d8190 2024-09-10T22:30:24.360 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:24.356+0000 7f5575ffb640 1 -- 172.21.15.19:0/3104468944 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5584003af0 con 0x55a2a30d8190 2024-09-10T22:30:24.363 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:24.357+0000 7f559921e740 1 -- 172.21.15.19:0/3104468944 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55a2a30d8190 msgr2=0x55a2a30d4cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:30:24.363 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:24.357+0000 7f559921e740 1 --2- 172.21.15.19:0/3104468944 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55a2a30d8190 0x55a2a30d4cf0 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7f558400aa10 tx=0x7f5584005fd0 comp rx=0 tx=0).stop 2024-09-10T22:30:24.363 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:24.357+0000 7f559921e740 1 -- 172.21.15.19:0/3104468944 shutdown_connections 2024-09-10T22:30:24.363 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:24.357+0000 7f559921e740 1 --2- 172.21.15.19:0/3104468944 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a2a30dabd0 0x55a2a30d5230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:30:24.364 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:24.357+0000 7f559921e740 1 --2- 172.21.15.19:0/3104468944 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55a2a30d8190 0x55a2a30d4cf0 unknown :-1 s=CLOSED pgs=584 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:30:24.364 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:24.357+0000 7f559921e740 1 --2- 172.21.15.19:0/3104468944 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55a2a30d5860 0x55a2a30dea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:30:24.364 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:24.357+0000 7f559921e740 1 -- 172.21.15.19:0/3104468944 >> 172.21.15.19:0/3104468944 conn(0x55a2a30d09b0 msgr2=0x55a2a30d15f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:30:24.364 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:24.357+0000 7f559921e740 1 -- 172.21.15.19:0/3104468944 shutdown_connections 2024-09-10T22:30:24.364 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:24.357+0000 7f559921e740 1 -- 172.21.15.19:0/3104468944 wait complete. 2024-09-10T22:30:24.364 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:24.358+0000 7f559921e740 1 -- start start 2024-09-10T22:30:24.364 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:24.358+0000 7f559921e740 1 Processor -- start 2024-09-10T22:30:24.364 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:24.358+0000 7f559921e740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55a2a30d5860 0x55a2a30e3890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:30:24.364 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:24.358+0000 7f559921e740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55a2a30d8190 0x55a2a30e3f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:30:24.364 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:24.358+0000 7f559921e740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a2a30dabd0 0x55a2a30e4950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:30:24.364 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:24.358+0000 7f559921e740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f55901aaa20 con 0x55a2a30d8190 2024-09-10T22:30:24.364 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:24.358+0000 7f559921e740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f55901abe90 con 0x55a2a30dabd0 2024-09-10T22:30:24.365 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:24.358+0000 7f559921e740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f55901ab0f0 con 0x55a2a30d5860 2024-09-10T22:30:24.365 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:24.358+0000 7f559921e740 10 client.0 _ll_register_callbacks cb 0x7f5588009dd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T22:30:24.365 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:24.358+0000 7f558f7fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55a2a30d8190 0x55a2a30e3f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:30:24.365 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:24.358+0000 7f558f7fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55a2a30d8190 0x55a2a30e3f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:48006/0 (socket says 172.21.15.19:48006) 2024-09-10T22:30:24.365 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:24.358+0000 7f558f7fe640 1 -- 172.21.15.19:0/2852830166 learned_addr learned my addr 172.21.15.19:0/2852830166 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:30:24.365 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:24.358+0000 7f5594912640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55a2a30d5860 0x55a2a30e3890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:30:24.365 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:24.358+0000 7f5594912640 1 --2- 172.21.15.19:0/2852830166 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a2a30dabd0 0x55a2a30e4950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:30:24.365 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:24.359+0000 7f558f7fe640 1 -- 172.21.15.19:0/2852830166 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55a2a30d5860 msgr2=0x55a2a30e3890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:30:24.365 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:24.359+0000 7f558f7fe640 1 --2- 172.21.15.19:0/2852830166 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55a2a30d5860 0x55a2a30e3890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:30:24.365 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:24.359+0000 7f558f7fe640 1 -- 172.21.15.19:0/2852830166 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a2a30dabd0 msgr2=0x55a2a30e4950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:30:24.365 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:24.359+0000 7f558f7fe640 1 --2- 172.21.15.19:0/2852830166 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a2a30dabd0 0x55a2a30e4950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:30:24.365 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:24.359+0000 7f558f7fe640 1 -- 172.21.15.19:0/2852830166 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a2a30e5180 con 0x55a2a30d8190 2024-09-10T22:30:24.366 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:24.359+0000 7f558f7fe640 1 --2- 172.21.15.19:0/2852830166 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55a2a30d8190 0x55a2a30e3f30 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7f558400a3b0 tx=0x7f558402be10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2cec8654851cc34e server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:30:24.366 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:24.359+0000 7f556f7fe640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-10T22:30:24.366 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:24.359+0000 7f556f7fe640 1 -- 172.21.15.19:0/2852830166 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5584052020 con 0x55a2a30d8190 2024-09-10T22:30:24.366 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:24.359+0000 7f556f7fe640 1 -- 172.21.15.19:0/2852830166 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8327+0+0 (secure 0 0 0) 0x7f5584004400 con 0x55a2a30d8190 2024-09-10T22:30:24.366 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:24.359+0000 7f559921e740 1 -- 172.21.15.19:0/2852830166 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5584004040 con 0x55a2a30d8190 2024-09-10T22:30:24.366 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:24.359+0000 7f556f7fe640 1 -- 172.21.15.19:0/2852830166 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f558405d050 con 0x55a2a30d8190 2024-09-10T22:30:24.366 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:24.359+0000 7f559921e740 10 client.16173 fetch_fsmap learned FSMap version 27 2024-09-10T22:30:24.366 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:24.359+0000 7f559921e740 1 -- 172.21.15.19:0/2852830166 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55a2a30e64d0 con 0x55a2a30d8190 2024-09-10T22:30:24.366 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:24.359+0000 7f556f7fe640 1 -- 172.21.15.19:0/2852830166 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5584004040 con 0x55a2a30d8190 2024-09-10T22:30:24.366 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:24.359+0000 7f556f7fe640 1 -- 172.21.15.19:0/2852830166 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7f558400b040 con 0x55a2a30d8190 2024-09-10T22:30:24.366 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:24.360+0000 7f559921e740 10 client.16173 fetch_fsmap finished waiting for FSMap version 27 2024-09-10T22:30:24.366 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:24.360+0000 7f559921e740 10 client.16173 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-10T22:30:24.366 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:24.360+0000 7f559921e740 20 client.16173 populate_metadata read hostname 'smithi019' 2024-09-10T22:30:24.367 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:24.360+0000 7f559921e740 1 --2- 172.21.15.19:0/2852830166 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x55a2a30ea4f0 0x55a2a31593e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:30:24.367 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:24.360+0000 7f559921e740 4 client.16173 mds_command: new command op to 24581 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-10T22:30:24.367 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:24.360+0000 7f559921e740 1 -- 172.21.15.19:0/2852830166 --> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55a2a30450f0 con 0x55a2a30ea4f0 2024-09-10T22:30:24.367 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:24.360+0000 7f5594912640 1 --2- 172.21.15.19:0/2852830166 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x55a2a30ea4f0 0x55a2a31593e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:30:24.367 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:24.360+0000 7f556f7fe640 10 client.16173 ms_handle_connect on v2:172.21.15.135:6838/1254769802 2024-09-10T22:30:24.367 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:24.360+0000 7f5594912640 1 --2- 172.21.15.19:0/2852830166 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x55a2a30ea4f0 0x55a2a31593e0 crc :-1 s=READY pgs=101 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ac6a84565885428d server_cookie=1292a7c1ea3d18c8 in_seq=0 out_seq=0 2024-09-10T22:30:26.113 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:30:25 smithi135 ceph-mon[34789]: pgmap v467: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 723 KiB/s rd, 347 MiB/s wr, 232 op/s 2024-09-10T22:30:26.124 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:30:25 smithi138 ceph-mon[35236]: pgmap v467: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 723 KiB/s rd, 347 MiB/s wr, 232 op/s 2024-09-10T22:30:26.208 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:30:25 smithi019 ceph-mon[31375]: pgmap v467: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 723 KiB/s rd, 347 MiB/s wr, 232 op/s 2024-09-10T22:30:28.208 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:30:27 smithi019 ceph-mon[31375]: pgmap v468: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 786 KiB/s rd, 376 MiB/s wr, 254 op/s 2024-09-10T22:30:28.359 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:30:27 smithi135 ceph-mon[34789]: pgmap v468: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 786 KiB/s rd, 376 MiB/s wr, 254 op/s 2024-09-10T22:30:28.361 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:28.358+0000 7f556f7fe640 1 -- 172.21.15.19:0/2852830166 <== mds.0 v2:172.21.15.135:6838/1254769802 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55a2a30450f0 con 0x55a2a30ea4f0 2024-09-10T22:30:28.361 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:28.358+0000 7f556f7fe640 10 client.16173 handle_command_reply: tid=0 2024-09-10T22:30:28.361 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:28.358+0000 7f559921e740 1 client.16173 shutdown 2024-09-10T22:30:28.361 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:28.359+0000 7f559921e740 1 -- 172.21.15.19:0/2852830166 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55a2a30d8190 msgr2=0x55a2a30e3f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:30:28.361 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:28.359+0000 7f559921e740 1 --2- 172.21.15.19:0/2852830166 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55a2a30d8190 0x55a2a30e3f30 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7f558400a3b0 tx=0x7f558402be10 comp rx=0 tx=0).stop 2024-09-10T22:30:28.361 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:28.359+0000 7f559921e740 1 -- 172.21.15.19:0/2852830166 shutdown_connections 2024-09-10T22:30:28.361 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:28.359+0000 7f559921e740 1 --2- 172.21.15.19:0/2852830166 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a2a30dabd0 0x55a2a30e4950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:30:28.361 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:28.359+0000 7f559921e740 1 --2- 172.21.15.19:0/2852830166 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55a2a30d8190 0x55a2a30e3f30 unknown :-1 s=CLOSED pgs=585 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:30:28.361 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:28.359+0000 7f559921e740 1 --2- 172.21.15.19:0/2852830166 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x55a2a30ea4f0 0x55a2a31593e0 crc :-1 s=READY pgs=101 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:30:28.361 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:28.359+0000 7f559921e740 1 --2- 172.21.15.19:0/2852830166 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55a2a30d5860 0x55a2a30e3890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:30:28.361 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:28.359+0000 7f559921e740 1 -- 172.21.15.19:0/2852830166 >> 172.21.15.19:0/2852830166 conn(0x55a2a30d09b0 msgr2=0x55a2a30d1450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:30:28.362 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:28.359+0000 7f556f7fe640 0 client.16173 ms_handle_reset on v2:172.21.15.135:6838/1254769802 2024-09-10T22:30:28.362 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:28.359+0000 7f559921e740 1 -- 172.21.15.19:0/2852830166 shutdown_connections 2024-09-10T22:30:28.362 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:28.359+0000 7f559921e740 1 -- 172.21.15.19:0/2852830166 wait complete. 2024-09-10T22:30:28.362 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:28.359+0000 7f559921e740 20 client.16173 trim_cache size 0 max 16384 2024-09-10T22:30:28.362 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stdout:{ 2024-09-10T22:30:28.362 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stdout: "message": "", 2024-09-10T22:30:28.362 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stdout: "return_code": 0 2024-09-10T22:30:28.362 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stdout:} 2024-09-10T22:30:28.363 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:28.360+0000 7f5596375640 1 -- 172.21.15.19:0/1003071193 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f55780b52e0 msgr2=0x7f55780b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:30:28.363 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:28.360+0000 7f5596375640 1 --2- 172.21.15.19:0/1003071193 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f55780b52e0 0x7f55780b77a0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f558001b000 tx=0x7f5580093040 comp rx=0 tx=0).stop 2024-09-10T22:30:28.363 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:28.360+0000 7f5596375640 1 -- 172.21.15.19:0/1003071193 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5590100fe0 msgr2=0x7f559019b000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:30:28.363 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:28.360+0000 7f5596375640 1 --2- 172.21.15.19:0/1003071193 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5590100fe0 0x7f559019b000 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f558000d950 tx=0x7f558000de10 comp rx=0 tx=0).stop 2024-09-10T22:30:28.364 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:28.361+0000 7f5596375640 1 -- 172.21.15.19:0/1003071193 shutdown_connections 2024-09-10T22:30:28.364 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:28.361+0000 7f5596375640 1 --2- 172.21.15.19:0/1003071193 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f55780b52e0 0x7f55780b77a0 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:30:28.364 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:28.361+0000 7f5596375640 1 --2- 172.21.15.19:0/1003071193 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5590102af0 0x7f559019c280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:30:28.364 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:28.361+0000 7f5596375640 1 --2- 172.21.15.19:0/1003071193 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5590102130 0x7f559019b650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:30:28.364 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:28.361+0000 7f5596375640 1 --2- 172.21.15.19:0/1003071193 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5590100fe0 0x7f559019b000 unknown :-1 s=CLOSED pgs=582 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:30:28.365 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:28.361+0000 7f5596375640 1 -- 172.21.15.19:0/1003071193 >> 172.21.15.19:0/1003071193 conn(0x7f55900fc880 msgr2=0x7f55901034b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:30:28.365 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:28.361+0000 7f5596375640 1 -- 172.21.15.19:0/1003071193 shutdown_connections 2024-09-10T22:30:28.365 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:28.361+0000 7f5596375640 1 -- 172.21.15.19:0/1003071193 wait complete. 2024-09-10T22:30:28.375 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:30:27 smithi138 ceph-mon[35236]: pgmap v468: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 786 KiB/s rd, 376 MiB/s wr, 254 op/s 2024-09-10T22:30:30.208 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:30:29 smithi019 ceph-mon[31375]: pgmap v469: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 632 KiB/s rd, 336 MiB/s wr, 219 op/s 2024-09-10T22:30:30.359 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:30:29 smithi135 ceph-mon[34789]: pgmap v469: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 632 KiB/s rd, 336 MiB/s wr, 219 op/s 2024-09-10T22:30:30.375 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:30:29 smithi138 ceph-mon[35236]: pgmap v469: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 632 KiB/s rd, 336 MiB/s wr, 219 op/s 2024-09-10T22:30:32.359 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:30:32 smithi135 ceph-mon[34789]: pgmap v470: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 878 KiB/s rd, 386 MiB/s wr, 251 op/s 2024-09-10T22:30:32.375 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:30:32 smithi138 ceph-mon[35236]: pgmap v470: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 878 KiB/s rd, 386 MiB/s wr, 251 op/s 2024-09-10T22:30:32.458 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:30:32 smithi019 ceph-mon[31375]: pgmap v470: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 878 KiB/s rd, 386 MiB/s wr, 251 op/s 2024-09-10T22:30:34.359 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:30:34 smithi135 ceph-mon[34789]: pgmap v471: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 642 KiB/s rd, 333 MiB/s wr, 214 op/s 2024-09-10T22:30:34.374 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:30:34 smithi138 ceph-mon[35236]: pgmap v471: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 642 KiB/s rd, 333 MiB/s wr, 214 op/s 2024-09-10T22:30:34.458 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:30:34 smithi019 ceph-mon[31375]: pgmap v471: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 642 KiB/s rd, 333 MiB/s wr, 214 op/s 2024-09-10T22:30:36.609 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:30:36 smithi135 ceph-mon[34789]: pgmap v472: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 702 KiB/s rd, 343 MiB/s wr, 211 op/s 2024-09-10T22:30:36.625 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:30:36 smithi138 ceph-mon[35236]: pgmap v472: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 702 KiB/s rd, 343 MiB/s wr, 211 op/s 2024-09-10T22:30:36.708 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:30:36 smithi019 ceph-mon[31375]: pgmap v472: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 702 KiB/s rd, 343 MiB/s wr, 211 op/s 2024-09-10T22:30:38.609 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:30:38 smithi135 ceph-mon[34789]: pgmap v473: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 863 KiB/s rd, 377 MiB/s wr, 220 op/s 2024-09-10T22:30:38.625 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:30:38 smithi138 ceph-mon[35236]: pgmap v473: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 863 KiB/s rd, 377 MiB/s wr, 220 op/s 2024-09-10T22:30:38.708 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:30:38 smithi019 ceph-mon[31375]: pgmap v473: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 863 KiB/s rd, 377 MiB/s wr, 220 op/s 2024-09-10T22:30:39.609 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:30:39 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T22:30:39.625 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:30:39 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T22:30:39.708 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:30:39 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T22:30:40.609 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:30:40 smithi135 ceph-mon[34789]: pgmap v474: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 649 KiB/s rd, 335 MiB/s wr, 187 op/s 2024-09-10T22:30:40.610 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:30:40 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T22:30:40.610 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:30:40 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T22:30:40.610 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:30:40 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:30:40.610 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:30:40 smithi019 ceph-mon[31375]: pgmap v474: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 649 KiB/s rd, 335 MiB/s wr, 187 op/s 2024-09-10T22:30:40.610 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:30:40 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T22:30:40.610 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:30:40 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T22:30:40.610 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:30:40 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:30:40.625 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:30:40 smithi138 ceph-mon[35236]: pgmap v474: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 649 KiB/s rd, 335 MiB/s wr, 187 op/s 2024-09-10T22:30:40.625 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:30:40 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T22:30:40.625 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:30:40 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T22:30:40.625 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:30:40 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:30:41.466 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:41.464+0000 7fd121262640 1 -- 172.21.15.19:0/1351903352 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd11c1029b0 msgr2=0x7fd11c102e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:30:41.466 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:41.464+0000 7fd121262640 1 --2- 172.21.15.19:0/1351903352 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd11c1029b0 0x7fd11c102e30 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7fd104009930 tx=0x7fd10402a420 comp rx=0 tx=0).stop 2024-09-10T22:30:41.466 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:41.464+0000 7fd121262640 1 -- 172.21.15.19:0/1351903352 shutdown_connections 2024-09-10T22:30:41.466 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:41.464+0000 7fd121262640 1 --2- 172.21.15.19:0/1351903352 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd11c103370 0x7fd11c109cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:30:41.466 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:41.464+0000 7fd121262640 1 --2- 172.21.15.19:0/1351903352 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd11c1029b0 0x7fd11c102e30 unknown :-1 s=CLOSED pgs=586 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:30:41.466 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:41.464+0000 7fd121262640 1 --2- 172.21.15.19:0/1351903352 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd11c101860 0x7fd11c101c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:30:41.466 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:41.464+0000 7fd121262640 1 -- 172.21.15.19:0/1351903352 >> 172.21.15.19:0/1351903352 conn(0x7fd11c0fd140 msgr2=0x7fd11c0ff560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:30:41.466 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:41.464+0000 7fd121262640 1 -- 172.21.15.19:0/1351903352 shutdown_connections 2024-09-10T22:30:41.467 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:41.464+0000 7fd121262640 1 -- 172.21.15.19:0/1351903352 wait complete. 2024-09-10T22:30:41.467 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:41.465+0000 7fd121262640 1 Processor -- start 2024-09-10T22:30:41.467 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:41.465+0000 7fd121262640 1 -- start start 2024-09-10T22:30:41.469 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:41.465+0000 7fd121262640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd11c101860 0x7fd11c06b1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:30:41.469 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:41.465+0000 7fd121262640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd11c1029b0 0x7fd11c19da80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:30:41.469 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:41.465+0000 7fd121262640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd11c103370 0x7fd11c1a00a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:30:41.469 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:41.465+0000 7fd121262640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fd11c10d500 con 0x7fd11c1029b0 2024-09-10T22:30:41.469 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:41.465+0000 7fd121262640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fd11c10d380 con 0x7fd11c101860 2024-09-10T22:30:41.469 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:41.465+0000 7fd121262640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7fd11c10d680 con 0x7fd11c103370 2024-09-10T22:30:41.469 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:41.465+0000 7fd113fff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd11c1029b0 0x7fd11c19da80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:30:41.469 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:41.465+0000 7fd113fff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd11c1029b0 0x7fd11c19da80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:41804/0 (socket says 172.21.15.19:41804) 2024-09-10T22:30:41.469 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:41.465+0000 7fd113fff640 1 -- 172.21.15.19:0/3741640935 learned_addr learned my addr 172.21.15.19:0/3741640935 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:30:41.469 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:41.465+0000 7fd11b7fe640 1 --2- 172.21.15.19:0/3741640935 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd11c103370 0x7fd11c1a00a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:30:41.469 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:41.465+0000 7fd11affd640 1 --2- 172.21.15.19:0/3741640935 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd11c101860 0x7fd11c06b1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:30:41.470 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:41.465+0000 7fd113fff640 1 -- 172.21.15.19:0/3741640935 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd11c103370 msgr2=0x7fd11c1a00a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:30:41.470 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:41.466+0000 7fd113fff640 1 --2- 172.21.15.19:0/3741640935 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd11c103370 0x7fd11c1a00a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:30:41.470 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:41.466+0000 7fd113fff640 1 -- 172.21.15.19:0/3741640935 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd11c101860 msgr2=0x7fd11c06b1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:30:41.470 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:41.466+0000 7fd113fff640 1 --2- 172.21.15.19:0/3741640935 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd11c101860 0x7fd11c06b1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:30:41.470 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:41.466+0000 7fd113fff640 1 -- 172.21.15.19:0/3741640935 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd11c1a09b0 con 0x7fd11c1029b0 2024-09-10T22:30:41.470 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:41.466+0000 7fd11b7fe640 1 --2- 172.21.15.19:0/3741640935 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd11c103370 0x7fd11c1a00a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T22:30:41.470 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:41.466+0000 7fd11affd640 1 --2- 172.21.15.19:0/3741640935 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd11c101860 0x7fd11c06b1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T22:30:41.470 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:41.466+0000 7fd113fff640 1 --2- 172.21.15.19:0/3741640935 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd11c1029b0 0x7fd11c19da80 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7fd104031500 tx=0x7fd104003c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:30:41.470 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:41.466+0000 7fd118ff9640 1 -- 172.21.15.19:0/3741640935 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd10403f070 con 0x7fd11c1029b0 2024-09-10T22:30:41.470 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:41.466+0000 7fd118ff9640 1 -- 172.21.15.19:0/3741640935 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd104031c50 con 0x7fd11c1029b0 2024-09-10T22:30:41.470 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:41.466+0000 7fd121262640 1 -- 172.21.15.19:0/3741640935 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd11c1a0be0 con 0x7fd11c1029b0 2024-09-10T22:30:41.470 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:41.466+0000 7fd118ff9640 1 -- 172.21.15.19:0/3741640935 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd104035030 con 0x7fd11c1029b0 2024-09-10T22:30:41.470 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:41.466+0000 7fd121262640 1 -- 172.21.15.19:0/3741640935 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd11c1a10d0 con 0x7fd11c1029b0 2024-09-10T22:30:41.473 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:41.469+0000 7fd118ff9640 1 -- 172.21.15.19:0/3741640935 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 18) ==== 153250+0+0 (secure 0 0 0) 0x7fd10403b460 con 0x7fd11c1029b0 2024-09-10T22:30:41.473 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:41.469+0000 7fd124031740 1 Processor -- start 2024-09-10T22:30:41.473 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:41.469+0000 7fd124031740 1 -- start start 2024-09-10T22:30:41.473 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:41.470+0000 7fd124031740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55c22426a860 0x55c22426cc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:30:41.474 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:41.470+0000 7fd124031740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c22426d190 0x55c22426f580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:30:41.474 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:41.470+0000 7fd124031740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55c22426fbd0 0x55c224272090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:30:41.474 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:41.470+0000 7fd124031740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x55c2241dc6f0 con 0x55c22426a860 2024-09-10T22:30:41.474 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:41.470+0000 7fd124031740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55c2241cbb20 con 0x55c22426d190 2024-09-10T22:30:41.474 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:41.470+0000 7fd124031740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x55c2241cf930 con 0x55c22426fbd0 2024-09-10T22:30:41.474 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:41.470+0000 7fd11b7fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55c22426a860 0x55c22426cc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:30:41.474 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:41.470+0000 7fd11b7fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55c22426a860 0x55c22426cc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:41806/0 (socket says 172.21.15.19:41806) 2024-09-10T22:30:41.474 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:41.470+0000 7fd11b7fe640 1 -- 172.21.15.19:0/1560247021 learned_addr learned my addr 172.21.15.19:0/1560247021 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:30:41.474 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:41.470+0000 7fd11affd640 1 --2- 172.21.15.19:0/1560247021 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c22426d190 0x55c22426f580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:30:41.474 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:41.470+0000 7fd113fff640 1 --2- 172.21.15.19:0/1560247021 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55c22426fbd0 0x55c224272090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:30:41.475 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:41.470+0000 7fd118ff9640 1 --2- 172.21.15.19:0/3741640935 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7fd1080b52e0 0x7fd1080b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:30:41.475 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:41.470+0000 7fd11b7fe640 1 -- 172.21.15.19:0/1560247021 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55c22426fbd0 msgr2=0x55c224272090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:30:41.475 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:41.470+0000 7fd11b7fe640 1 --2- 172.21.15.19:0/1560247021 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55c22426fbd0 0x55c224272090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:30:41.475 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:41.470+0000 7fd11b7fe640 1 -- 172.21.15.19:0/1560247021 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c22426d190 msgr2=0x55c22426f580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:30:41.475 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:41.470+0000 7fd11b7fe640 1 --2- 172.21.15.19:0/1560247021 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c22426d190 0x55c22426f580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:30:41.475 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:41.470+0000 7fd11b7fe640 1 -- 172.21.15.19:0/1560247021 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c224191530 con 0x55c22426a860 2024-09-10T22:30:41.475 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:41.470+0000 7fd11affd640 1 --2- 172.21.15.19:0/1560247021 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c22426d190 0x55c22426f580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T22:30:41.475 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:41.470+0000 7fd113fff640 1 --2- 172.21.15.19:0/1560247021 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55c22426fbd0 0x55c224272090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T22:30:41.475 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:41.470+0000 7fd11b7fe640 1 --2- 172.21.15.19:0/3741640935 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7fd1080b52e0 0x7fd1080b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:30:41.475 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:41.471+0000 7fd118ff9640 1 -- 172.21.15.19:0/3741640935 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8327+0+0 (secure 0 0 0) 0x7fd1041065f0 con 0x7fd11c1029b0 2024-09-10T22:30:41.475 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:41.471+0000 7fd11b7fe640 1 --2- 172.21.15.19:0/1560247021 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55c22426a860 0x55c22426cc50 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7fd114011940 tx=0x7fd114011e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8954d9a19de6e598 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:30:41.475 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:41.471+0000 7fd1117fa640 1 -- 172.21.15.19:0/1560247021 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd114017070 con 0x55c22426a860 2024-09-10T22:30:41.475 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:41.471+0000 7fd11b7fe640 1 --2- 172.21.15.19:0/3741640935 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7fd1080b52e0 0x7fd1080b77a0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fd114023000 tx=0x7fd114024000 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:30:41.475 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:41.471+0000 7fd1117fa640 1 -- 172.21.15.19:0/1560247021 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd114011250 con 0x55c22426a860 2024-09-10T22:30:41.475 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:41.471+0000 7fd1117fa640 1 -- 172.21.15.19:0/1560247021 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd114010c10 con 0x55c22426a860 2024-09-10T22:30:41.476 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:41.472+0000 7fd124031740 1 -- 172.21.15.19:0/1560247021 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55c22426a860 msgr2=0x55c22426cc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:30:41.476 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:41.472+0000 7fd124031740 1 --2- 172.21.15.19:0/1560247021 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55c22426a860 0x55c22426cc50 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7fd114011940 tx=0x7fd114011e00 comp rx=0 tx=0).stop 2024-09-10T22:30:41.476 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:41.472+0000 7fd124031740 1 -- 172.21.15.19:0/1560247021 shutdown_connections 2024-09-10T22:30:41.476 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:41.472+0000 7fd124031740 1 --2- 172.21.15.19:0/1560247021 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55c22426fbd0 0x55c224272090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:30:41.476 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:41.472+0000 7fd124031740 1 --2- 172.21.15.19:0/1560247021 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c22426d190 0x55c22426f580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:30:41.476 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:41.472+0000 7fd124031740 1 --2- 172.21.15.19:0/1560247021 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55c22426a860 0x55c22426cc50 unknown :-1 s=CLOSED pgs=588 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:30:41.476 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:41.472+0000 7fd124031740 1 -- 172.21.15.19:0/1560247021 >> 172.21.15.19:0/1560247021 conn(0x55c2242659b0 msgr2=0x55c224266740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:30:41.476 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:41.472+0000 7fd124031740 1 -- 172.21.15.19:0/1560247021 shutdown_connections 2024-09-10T22:30:41.476 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:41.472+0000 7fd124031740 1 -- 172.21.15.19:0/1560247021 wait complete. 2024-09-10T22:30:41.480 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:41.472+0000 7fd124031740 1 -- start start 2024-09-10T22:30:41.481 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:41.472+0000 7fd124031740 1 Processor -- start 2024-09-10T22:30:41.481 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:41.473+0000 7fd124031740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c22426a860 0x55c224273f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:30:41.481 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:41.473+0000 7fd124031740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55c22426d190 0x55c2242745c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:30:41.481 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:41.473+0000 7fd124031740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55c22426fbd0 0x55c224275190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:30:41.481 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:41.473+0000 7fd124031740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x55c224103ab0 con 0x55c22426fbd0 2024-09-10T22:30:41.481 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:41.473+0000 7fd124031740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55c224171730 con 0x55c22426a860 2024-09-10T22:30:41.481 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:41.473+0000 7fd124031740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x55c224272bb0 con 0x55c22426d190 2024-09-10T22:30:41.481 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:41.473+0000 7fd124031740 10 client.0 _ll_register_callbacks cb 0x55c2241c56b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T22:30:41.481 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:41.473+0000 7fd11b7fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55c22426fbd0 0x55c224275190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:30:41.481 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:41.473+0000 7fd113fff640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55c22426d190 0x55c2242745c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:30:41.481 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:41.473+0000 7fd11b7fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55c22426fbd0 0x55c224275190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:41808/0 (socket says 172.21.15.19:41808) 2024-09-10T22:30:41.481 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:41.473+0000 7fd11b7fe640 1 -- 172.21.15.19:0/3114909041 learned_addr learned my addr 172.21.15.19:0/3114909041 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:30:41.482 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:41.473+0000 7fd113fff640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55c22426d190 0x55c2242745c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.19:39906/0 (socket says 172.21.15.19:39906) 2024-09-10T22:30:41.482 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:41.473+0000 7fd11affd640 1 --2- 172.21.15.19:0/3114909041 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c22426a860 0x55c224273f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:30:41.482 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:41.473+0000 7fd113fff640 1 -- 172.21.15.19:0/3114909041 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c22426a860 msgr2=0x55c224273f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:30:41.482 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:41.473+0000 7fd113fff640 1 --2- 172.21.15.19:0/3114909041 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c22426a860 0x55c224273f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:30:41.482 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:41.473+0000 7fd113fff640 1 -- 172.21.15.19:0/3114909041 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55c22426fbd0 msgr2=0x55c224275190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:30:41.482 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:41.473+0000 7fd113fff640 1 --2- 172.21.15.19:0/3114909041 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55c22426fbd0 0x55c224275190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:30:41.482 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:41.473+0000 7fd113fff640 1 -- 172.21.15.19:0/3114909041 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c223f2d790 con 0x55c22426d190 2024-09-10T22:30:41.482 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:41.473+0000 7fd113fff640 1 --2- 172.21.15.19:0/3114909041 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55c22426d190 0x55c2242745c0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fd1041040e0 tx=0x7fd104005e10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bba26d17dac99e98 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:30:41.482 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:41.474+0000 7fd1027fc640 10 client.0 ms_handle_connect on v2:172.21.15.138:3300/0 2024-09-10T22:30:41.482 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:41.474+0000 7fd1027fc640 1 -- 172.21.15.19:0/3114909041 <== mon.1 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd104049040 con 0x55c22426d190 2024-09-10T22:30:41.482 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:41.474+0000 7fd1027fc640 1 -- 172.21.15.19:0/3114909041 <== mon.1 v2:172.21.15.138:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8327+0+0 (secure 0 0 0) 0x7fd1040b4270 con 0x55c22426d190 2024-09-10T22:30:41.482 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:41.474+0000 7fd124031740 1 -- 172.21.15.19:0/3114909041 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd114011250 con 0x55c22426d190 2024-09-10T22:30:41.483 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:41.474+0000 7fd1027fc640 1 -- 172.21.15.19:0/3114909041 <== mon.1 v2:172.21.15.138:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fd1040cc570 con 0x55c22426d190 2024-09-10T22:30:41.483 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:41.474+0000 7fd124031740 10 client.25633 fetch_fsmap learned FSMap version 27 2024-09-10T22:30:41.483 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:41.474+0000 7fd124031740 1 -- 172.21.15.19:0/3114909041 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55c223fa6620 con 0x55c22426d190 2024-09-10T22:30:41.483 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:41.474+0000 7fd1027fc640 1 -- 172.21.15.19:0/3114909041 <== mon.1 v2:172.21.15.138:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd114011250 con 0x55c22426d190 2024-09-10T22:30:41.483 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:41.474+0000 7fd1027fc640 1 -- 172.21.15.19:0/3114909041 <== mon.1 v2:172.21.15.138:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7fd1040d5e50 con 0x55c22426d190 2024-09-10T22:30:41.483 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:41.474+0000 7fd124031740 10 client.25633 fetch_fsmap finished waiting for FSMap version 27 2024-09-10T22:30:41.483 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:41.474+0000 7fd124031740 10 client.25633 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-10T22:30:41.483 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:41.474+0000 7fd124031740 20 client.25633 populate_metadata read hostname 'smithi019' 2024-09-10T22:30:41.483 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:41.474+0000 7fd124031740 1 --2- 172.21.15.19:0/3114909041 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x55c22427f7a0 0x55c224281b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:30:41.483 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:41.474+0000 7fd124031740 4 client.25633 mds_command: new command op to 24581 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T22:30:41.483 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:41.474+0000 7fd124031740 1 -- 172.21.15.19:0/3114909041 --> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c2241de640 con 0x55c22427f7a0 2024-09-10T22:30:41.483 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:41.475+0000 7fd11affd640 1 --2- 172.21.15.19:0/3114909041 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x55c22427f7a0 0x55c224281b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:30:41.483 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:41.475+0000 7fd1027fc640 10 client.25633 ms_handle_connect on v2:172.21.15.135:6838/1254769802 2024-09-10T22:30:41.484 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:41.475+0000 7fd11affd640 1 --2- 172.21.15.19:0/3114909041 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x55c22427f7a0 0x55c224281b90 crc :-1 s=READY pgs=102 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=680214f82156aa9e server_cookie=b119066b7f87a06c in_seq=0 out_seq=0 2024-09-10T22:30:41.484 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:41.476+0000 7fd1027fc640 1 -- 172.21.15.19:0/3114909041 <== mds.0 v2:172.21.15.135:6838/1254769802 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55c2241de640 con 0x55c22427f7a0 2024-09-10T22:30:41.484 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:41.476+0000 7fd1027fc640 10 client.25633 handle_command_reply: tid=0 2024-09-10T22:30:41.484 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:41.476+0000 7fd124031740 1 client.25633 shutdown 2024-09-10T22:30:41.484 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:41.476+0000 7fd124031740 1 -- 172.21.15.19:0/3114909041 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55c22426d190 msgr2=0x55c2242745c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:30:41.484 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:41.476+0000 7fd124031740 1 --2- 172.21.15.19:0/3114909041 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55c22426d190 0x55c2242745c0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fd1041040e0 tx=0x7fd104005e10 comp rx=0 tx=0).stop 2024-09-10T22:30:41.484 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:41.476+0000 7fd124031740 1 -- 172.21.15.19:0/3114909041 shutdown_connections 2024-09-10T22:30:41.485 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:41.476+0000 7fd124031740 1 --2- 172.21.15.19:0/3114909041 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55c22426fbd0 0x55c224275190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:30:41.485 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:41.476+0000 7fd124031740 1 --2- 172.21.15.19:0/3114909041 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x55c22427f7a0 0x55c224281b90 crc :-1 s=READY pgs=102 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:30:41.485 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:41.476+0000 7fd124031740 1 --2- 172.21.15.19:0/3114909041 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55c22426d190 0x55c2242745c0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:30:41.485 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:41.476+0000 7fd124031740 1 --2- 172.21.15.19:0/3114909041 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c22426a860 0x55c224273f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:30:41.485 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:41.476+0000 7fd1027fc640 0 client.25633 ms_handle_reset on v2:172.21.15.135:6838/1254769802 2024-09-10T22:30:41.485 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:41.476+0000 7fd124031740 1 -- 172.21.15.19:0/3114909041 >> 172.21.15.19:0/3114909041 conn(0x55c2242659b0 msgr2=0x55c224264bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:30:41.485 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:41.476+0000 7fd124031740 1 -- 172.21.15.19:0/3114909041 shutdown_connections 2024-09-10T22:30:41.485 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:41.476+0000 7fd124031740 1 -- 172.21.15.19:0/3114909041 wait complete. 2024-09-10T22:30:41.485 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:41.476+0000 7fd124031740 20 client.25633 trim_cache size 0 max 16384 2024-09-10T22:30:41.496 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:41.494+0000 7fd124031740 1 Processor -- start 2024-09-10T22:30:41.496 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:41.495+0000 7fd124031740 1 -- start start 2024-09-10T22:30:41.498 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:41.495+0000 7fd124031740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55c22426a860 0x55c224273160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:30:41.498 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:41.495+0000 7fd124031740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55c22426d190 0x55c2242736a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:30:41.498 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:41.495+0000 7fd124031740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c22426fbd0 0x55c224286450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:30:41.498 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:41.495+0000 7fd124031740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fd11c1ac960 con 0x55c22426a860 2024-09-10T22:30:41.498 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:41.495+0000 7fd124031740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fd11c1aa230 con 0x55c22426fbd0 2024-09-10T22:30:41.498 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:41.495+0000 7fd124031740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7fd11c1a8080 con 0x55c22426d190 2024-09-10T22:30:41.498 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:41.495+0000 7fd11affd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55c22426a860 0x55c224273160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:30:41.498 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:41.495+0000 7fd11b7fe640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c22426fbd0 0x55c224286450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:30:41.498 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:41.495+0000 7fd11b7fe640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c22426fbd0 0x55c224286450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.19:36424/0 (socket says 172.21.15.19:36424) 2024-09-10T22:30:41.498 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:41.495+0000 7fd11b7fe640 1 -- 172.21.15.19:0/2146184489 learned_addr learned my addr 172.21.15.19:0/2146184489 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:30:41.498 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:41.495+0000 7fd11affd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55c22426a860 0x55c224273160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:41822/0 (socket says 172.21.15.19:41822) 2024-09-10T22:30:41.498 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:41.495+0000 7fd113fff640 1 --2- 172.21.15.19:0/2146184489 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55c22426d190 0x55c2242736a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:30:41.499 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:41.495+0000 7fd11b7fe640 1 -- 172.21.15.19:0/2146184489 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55c22426d190 msgr2=0x55c2242736a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:30:41.499 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:41.495+0000 7fd11b7fe640 1 --2- 172.21.15.19:0/2146184489 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55c22426d190 0x55c2242736a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:30:41.499 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:41.495+0000 7fd11b7fe640 1 -- 172.21.15.19:0/2146184489 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55c22426a860 msgr2=0x55c224273160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:30:41.499 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:41.495+0000 7fd11b7fe640 1 --2- 172.21.15.19:0/2146184489 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55c22426a860 0x55c224273160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:30:41.499 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:41.495+0000 7fd11b7fe640 1 -- 172.21.15.19:0/2146184489 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c22426f8f0 con 0x55c22426fbd0 2024-09-10T22:30:41.499 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:41.495+0000 7fd11affd640 1 --2- 172.21.15.19:0/2146184489 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55c22426a860 0x55c224273160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T22:30:41.499 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:41.496+0000 7fd11b7fe640 1 --2- 172.21.15.19:0/2146184489 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c22426fbd0 0x55c224286450 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fd114009ee0 tx=0x7fd114009f10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2973eb95cd104788 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:30:41.499 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:41.496+0000 7fd110ff9640 1 -- 172.21.15.19:0/2146184489 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd114017070 con 0x55c22426fbd0 2024-09-10T22:30:41.499 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:41.496+0000 7fd110ff9640 1 -- 172.21.15.19:0/2146184489 <== mon.2 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd114004950 con 0x55c22426fbd0 2024-09-10T22:30:41.499 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:41.496+0000 7fd110ff9640 1 -- 172.21.15.19:0/2146184489 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd114010aa0 con 0x55c22426fbd0 2024-09-10T22:30:41.502 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:41.497+0000 7fd124031740 1 -- 172.21.15.19:0/2146184489 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c22426fbd0 msgr2=0x55c224286450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:30:41.502 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:41.497+0000 7fd124031740 1 --2- 172.21.15.19:0/2146184489 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c22426fbd0 0x55c224286450 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fd114009ee0 tx=0x7fd114009f10 comp rx=0 tx=0).stop 2024-09-10T22:30:41.503 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:41.497+0000 7fd124031740 1 -- 172.21.15.19:0/2146184489 shutdown_connections 2024-09-10T22:30:41.503 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:41.497+0000 7fd124031740 1 --2- 172.21.15.19:0/2146184489 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c22426fbd0 0x55c224286450 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:30:41.503 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:41.497+0000 7fd124031740 1 --2- 172.21.15.19:0/2146184489 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55c22426d190 0x55c2242736a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:30:41.503 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:41.497+0000 7fd124031740 1 --2- 172.21.15.19:0/2146184489 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55c22426a860 0x55c224273160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:30:41.503 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:41.497+0000 7fd124031740 1 -- 172.21.15.19:0/2146184489 >> 172.21.15.19:0/2146184489 conn(0x55c2242659b0 msgr2=0x55c224268a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:30:41.503 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:41.497+0000 7fd124031740 1 -- 172.21.15.19:0/2146184489 shutdown_connections 2024-09-10T22:30:41.503 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:41.497+0000 7fd124031740 1 -- 172.21.15.19:0/2146184489 wait complete. 2024-09-10T22:30:41.503 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:41.497+0000 7fd124031740 1 -- start start 2024-09-10T22:30:41.503 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:41.497+0000 7fd124031740 1 Processor -- start 2024-09-10T22:30:41.503 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:41.497+0000 7fd124031740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55c22426a860 0x55c22427abf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:30:41.503 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:41.497+0000 7fd124031740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c22426d190 0x55c22427b130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:30:41.503 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:41.497+0000 7fd124031740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55c22426fbd0 0x55c22427b670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:30:41.503 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:41.497+0000 7fd124031740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fd11c1a86f0 con 0x55c22426a860 2024-09-10T22:30:41.504 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:41.497+0000 7fd124031740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fd11c1a9b60 con 0x55c22426d190 2024-09-10T22:30:41.504 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:41.497+0000 7fd124031740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7fd11c1a8dc0 con 0x55c22426fbd0 2024-09-10T22:30:41.504 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:41.497+0000 7fd124031740 10 client.0 _ll_register_callbacks cb 0x7fd104109dc0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T22:30:41.504 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:41.498+0000 7fd11affd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55c22426a860 0x55c22427abf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:30:41.504 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:41.498+0000 7fd11affd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55c22426a860 0x55c22427abf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:41838/0 (socket says 172.21.15.19:41838) 2024-09-10T22:30:41.504 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:41.498+0000 7fd11affd640 1 -- 172.21.15.19:0/2396255899 learned_addr learned my addr 172.21.15.19:0/2396255899 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:30:41.504 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:41.498+0000 7fd11b7fe640 1 --2- 172.21.15.19:0/2396255899 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55c22426fbd0 0x55c22427b670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:30:41.504 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:41.498+0000 7fd113fff640 1 --2- 172.21.15.19:0/2396255899 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c22426d190 0x55c22427b130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:30:41.504 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:41.498+0000 7fd11affd640 1 -- 172.21.15.19:0/2396255899 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55c22426fbd0 msgr2=0x55c22427b670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:30:41.504 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:41.498+0000 7fd11affd640 1 --2- 172.21.15.19:0/2396255899 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55c22426fbd0 0x55c22427b670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:30:41.504 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:41.498+0000 7fd11affd640 1 -- 172.21.15.19:0/2396255899 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c22426d190 msgr2=0x55c22427b130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:30:41.504 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:41.498+0000 7fd11affd640 1 --2- 172.21.15.19:0/2396255899 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c22426d190 0x55c22427b130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:30:41.504 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:41.498+0000 7fd11affd640 1 -- 172.21.15.19:0/2396255899 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c224279a00 con 0x55c22426a860 2024-09-10T22:30:41.505 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:41.498+0000 7fd11affd640 1 --2- 172.21.15.19:0/2396255899 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55c22426a860 0x55c22427abf0 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x55c2242823d0 tx=0x7fd10c012bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=659b591add8201a0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:30:41.505 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:41.498+0000 7fd1027fc640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-10T22:30:41.505 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:41.498+0000 7fd1027fc640 1 -- 172.21.15.19:0/2396255899 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd10c010af0 con 0x55c22426a860 2024-09-10T22:30:41.505 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:41.498+0000 7fd1027fc640 1 -- 172.21.15.19:0/2396255899 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8327+0+0 (secure 0 0 0) 0x7fd10c010c90 con 0x55c22426a860 2024-09-10T22:30:41.505 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:41.498+0000 7fd124031740 1 -- 172.21.15.19:0/2396255899 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd114004950 con 0x55c22426a860 2024-09-10T22:30:41.505 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:41.498+0000 7fd1027fc640 1 -- 172.21.15.19:0/2396255899 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fd10c005020 con 0x55c22426a860 2024-09-10T22:30:41.505 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:41.498+0000 7fd124031740 10 client.16191 fetch_fsmap learned FSMap version 27 2024-09-10T22:30:41.505 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:41.498+0000 7fd124031740 1 -- 172.21.15.19:0/2396255899 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55c2242ecca0 con 0x55c22426a860 2024-09-10T22:30:41.505 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:41.499+0000 7fd1027fc640 1 -- 172.21.15.19:0/2396255899 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd114004950 con 0x55c22426a860 2024-09-10T22:30:41.505 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:41.499+0000 7fd1027fc640 1 -- 172.21.15.19:0/2396255899 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7fd10c023070 con 0x55c22426a860 2024-09-10T22:30:41.505 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:41.499+0000 7fd124031740 10 client.16191 fetch_fsmap finished waiting for FSMap version 27 2024-09-10T22:30:41.505 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:41.499+0000 7fd124031740 10 client.16191 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-10T22:30:41.506 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:41.499+0000 7fd124031740 20 client.16191 populate_metadata read hostname 'smithi019' 2024-09-10T22:30:41.506 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:41.499+0000 7fd124031740 1 --2- 172.21.15.19:0/2396255899 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x55c2242ed680 0x55c2242efaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:30:41.506 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:41.499+0000 7fd124031740 4 client.16191 mds_command: new command op to 24581 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-10T22:30:41.506 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:41.499+0000 7fd124031740 1 -- 172.21.15.19:0/2396255899 --> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55c2241da0f0 con 0x55c2242ed680 2024-09-10T22:30:41.506 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:41.499+0000 7fd113fff640 1 --2- 172.21.15.19:0/2396255899 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x55c2242ed680 0x55c2242efaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:30:41.506 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:41.500+0000 7fd1027fc640 10 client.16191 ms_handle_connect on v2:172.21.15.135:6838/1254769802 2024-09-10T22:30:41.506 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:41.499+0000 7fd113fff640 1 --2- 172.21.15.19:0/2396255899 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x55c2242ed680 0x55c2242efaa0 crc :-1 s=READY pgs=103 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5f9694dcafb58788 server_cookie=5e0ec4423eb429cd in_seq=0 out_seq=0 2024-09-10T22:30:41.609 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:30:41 smithi135 ceph-mon[34789]: pgmap v475: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 985 KiB/s rd, 404 MiB/s wr, 230 op/s 2024-09-10T22:30:41.626 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:30:41 smithi138 ceph-mon[35236]: pgmap v475: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 985 KiB/s rd, 404 MiB/s wr, 230 op/s 2024-09-10T22:30:41.711 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:30:41 smithi019 ceph-mon[31375]: pgmap v475: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 985 KiB/s rd, 404 MiB/s wr, 230 op/s 2024-09-10T22:30:43.860 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:30:43 smithi135 ceph-mon[34789]: pgmap v476: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 739 KiB/s rd, 358 MiB/s wr, 206 op/s 2024-09-10T22:30:43.875 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:30:43 smithi138 ceph-mon[35236]: pgmap v476: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 739 KiB/s rd, 358 MiB/s wr, 206 op/s 2024-09-10T22:30:43.958 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:30:43 smithi019 ceph-mon[31375]: pgmap v476: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 739 KiB/s rd, 358 MiB/s wr, 206 op/s 2024-09-10T22:30:45.860 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:30:45 smithi135 ceph-mon[34789]: pgmap v477: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 655 KiB/s rd, 367 MiB/s wr, 223 op/s 2024-09-10T22:30:45.874 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:30:45 smithi138 ceph-mon[35236]: pgmap v477: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 655 KiB/s rd, 367 MiB/s wr, 223 op/s 2024-09-10T22:30:45.958 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:30:45 smithi019 ceph-mon[31375]: pgmap v477: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 655 KiB/s rd, 367 MiB/s wr, 223 op/s 2024-09-10T22:30:46.556 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 22997a4c-6fc2-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-10T22:30:46.928 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:46.925+0000 7fd1027fc640 1 -- 172.21.15.19:0/2396255899 <== mds.0 v2:172.21.15.135:6838/1254769802 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55c2241da0f0 con 0x55c2242ed680 2024-09-10T22:30:46.928 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:46.925+0000 7fd1027fc640 10 client.16191 handle_command_reply: tid=0 2024-09-10T22:30:46.928 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:46.926+0000 7fd124031740 1 client.16191 shutdown 2024-09-10T22:30:46.928 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:46.926+0000 7fd124031740 1 -- 172.21.15.19:0/2396255899 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55c22426a860 msgr2=0x55c22427abf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:30:46.928 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:46.926+0000 7fd124031740 1 --2- 172.21.15.19:0/2396255899 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55c22426a860 0x55c22427abf0 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x55c2242823d0 tx=0x7fd10c012bf0 comp rx=0 tx=0).stop 2024-09-10T22:30:46.928 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:46.926+0000 7fd124031740 1 -- 172.21.15.19:0/2396255899 shutdown_connections 2024-09-10T22:30:46.928 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:46.926+0000 7fd124031740 1 --2- 172.21.15.19:0/2396255899 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x55c2242ed680 0x55c2242efaa0 crc :-1 s=READY pgs=103 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:30:46.928 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:46.926+0000 7fd124031740 1 --2- 172.21.15.19:0/2396255899 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55c22426fbd0 0x55c22427b670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:30:46.928 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:46.926+0000 7fd124031740 1 --2- 172.21.15.19:0/2396255899 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c22426d190 0x55c22427b130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:30:46.929 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:46.926+0000 7fd124031740 1 --2- 172.21.15.19:0/2396255899 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55c22426a860 0x55c22427abf0 unknown :-1 s=CLOSED pgs=589 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:30:46.929 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:46.926+0000 7fd124031740 1 -- 172.21.15.19:0/2396255899 >> 172.21.15.19:0/2396255899 conn(0x55c2242659b0 msgr2=0x55c224273160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:30:46.929 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:46.926+0000 7fd1027fc640 0 client.16191 ms_handle_reset on v2:172.21.15.135:6838/1254769802 2024-09-10T22:30:46.929 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:46.926+0000 7fd124031740 1 -- 172.21.15.19:0/2396255899 shutdown_connections 2024-09-10T22:30:46.929 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:46.926+0000 7fd124031740 1 -- 172.21.15.19:0/2396255899 wait complete. 2024-09-10T22:30:46.929 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:46.926+0000 7fd124031740 20 client.16191 trim_cache size 0 max 16384 2024-09-10T22:30:46.929 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stdout:{ 2024-09-10T22:30:46.929 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stdout: "message": "", 2024-09-10T22:30:46.929 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stdout: "return_code": 0 2024-09-10T22:30:46.929 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stdout:} 2024-09-10T22:30:46.930 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:46.927+0000 7fd121262640 1 -- 172.21.15.19:0/3741640935 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7fd1080b52e0 msgr2=0x7fd1080b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:30:46.930 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:46.927+0000 7fd121262640 1 --2- 172.21.15.19:0/3741640935 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7fd1080b52e0 0x7fd1080b77a0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fd114023000 tx=0x7fd114024000 comp rx=0 tx=0).stop 2024-09-10T22:30:46.930 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:46.927+0000 7fd121262640 1 -- 172.21.15.19:0/3741640935 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd11c1029b0 msgr2=0x7fd11c19da80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:30:46.930 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:46.927+0000 7fd121262640 1 --2- 172.21.15.19:0/3741640935 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd11c1029b0 0x7fd11c19da80 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7fd104031500 tx=0x7fd104003c10 comp rx=0 tx=0).stop 2024-09-10T22:30:46.931 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:46.927+0000 7fd121262640 1 -- 172.21.15.19:0/3741640935 shutdown_connections 2024-09-10T22:30:46.931 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:46.927+0000 7fd121262640 1 --2- 172.21.15.19:0/3741640935 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7fd1080b52e0 0x7fd1080b77a0 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:30:46.931 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:46.927+0000 7fd121262640 1 --2- 172.21.15.19:0/3741640935 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd11c103370 0x7fd11c1a00a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:30:46.931 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:46.928+0000 7fd121262640 1 --2- 172.21.15.19:0/3741640935 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd11c1029b0 0x7fd11c19da80 unknown :-1 s=CLOSED pgs=587 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:30:46.931 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:46.928+0000 7fd121262640 1 --2- 172.21.15.19:0/3741640935 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd11c101860 0x7fd11c06b1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:30:46.931 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:46.928+0000 7fd121262640 1 -- 172.21.15.19:0/3741640935 >> 172.21.15.19:0/3741640935 conn(0x7fd11c0fd140 msgr2=0x7fd11c105d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:30:46.931 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:46.928+0000 7fd121262640 1 -- 172.21.15.19:0/3741640935 shutdown_connections 2024-09-10T22:30:46.931 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:30:46.928+0000 7fd121262640 1 -- 172.21.15.19:0/3741640935 wait complete. 2024-09-10T22:30:46.966 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/22997a4c-6fc2-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T22:30:47.685 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:47.567+0000 7f85b1d1d640 1 -- 172.21.15.19:0/3531083330 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f85ac1045e0 msgr2=0x7f85ac10cad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:30:47.685 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:47.567+0000 7f85b1d1d640 1 --2- 172.21.15.19:0/3531083330 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f85ac1045e0 0x7f85ac10cad0 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7f8594009900 tx=0x7f859402a410 comp rx=0 tx=0).stop 2024-09-10T22:30:47.685 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:47.567+0000 7f85b1d1d640 1 -- 172.21.15.19:0/3531083330 shutdown_connections 2024-09-10T22:30:47.685 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:47.567+0000 7f85b1d1d640 1 --2- 172.21.15.19:0/3531083330 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f85ac10d120 0x7f85ac10f580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:30:47.685 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:47.567+0000 7f85b1d1d640 1 --2- 172.21.15.19:0/3531083330 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f85ac1045e0 0x7f85ac10cad0 unknown :-1 s=CLOSED pgs=590 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:30:47.686 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:47.567+0000 7f85b1d1d640 1 --2- 172.21.15.19:0/3531083330 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f85ac103cc0 0x7f85ac1040a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:30:47.686 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:47.567+0000 7f85b1d1d640 1 -- 172.21.15.19:0/3531083330 >> 172.21.15.19:0/3531083330 conn(0x7f85ac0fd740 msgr2=0x7f85ac0ffb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:30:47.686 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:47.567+0000 7f85b1d1d640 1 -- 172.21.15.19:0/3531083330 shutdown_connections 2024-09-10T22:30:47.686 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:47.567+0000 7f85b1d1d640 1 -- 172.21.15.19:0/3531083330 wait complete. 2024-09-10T22:30:47.686 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:47.568+0000 7f85b1d1d640 1 Processor -- start 2024-09-10T22:30:47.686 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:47.568+0000 7f85b1d1d640 1 -- start start 2024-09-10T22:30:47.686 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:47.569+0000 7f85b1d1d640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f85ac103cc0 0x7f85ac1992d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:30:47.686 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:47.569+0000 7f85b1d1d640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f85ac1045e0 0x7f85ac199810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:30:47.686 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:47.569+0000 7f85b1d1d640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f85ac10d120 0x7f85ac19ebb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:30:47.686 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:47.569+0000 7f85b1d1d640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f85ac112de0 con 0x7f85ac103cc0 2024-09-10T22:30:47.686 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:47.569+0000 7f85b1d1d640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f85ac112c60 con 0x7f85ac10d120 2024-09-10T22:30:47.686 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:47.569+0000 7f85b1d1d640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f85ac112f60 con 0x7f85ac1045e0 2024-09-10T22:30:47.687 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:47.569+0000 7f85a2ffd640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f85ac1045e0 0x7f85ac199810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:30:47.687 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:47.569+0000 7f85abfff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f85ac10d120 0x7f85ac19ebb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:30:47.687 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:47.569+0000 7f85ab7fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f85ac103cc0 0x7f85ac1992d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:30:47.687 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:47.569+0000 7f85a2ffd640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f85ac1045e0 0x7f85ac199810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.19:34536/0 (socket says 172.21.15.19:34536) 2024-09-10T22:30:47.687 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:47.569+0000 7f85abfff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f85ac10d120 0x7f85ac19ebb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.19:45384/0 (socket says 172.21.15.19:45384) 2024-09-10T22:30:47.687 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:47.569+0000 7f85a2ffd640 1 -- 172.21.15.19:0/425118797 learned_addr learned my addr 172.21.15.19:0/425118797 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:30:47.687 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:47.569+0000 7f85a2ffd640 1 -- 172.21.15.19:0/425118797 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f85ac10d120 msgr2=0x7f85ac19ebb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:30:47.687 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:47.569+0000 7f85a2ffd640 1 --2- 172.21.15.19:0/425118797 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f85ac10d120 0x7f85ac19ebb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:30:47.687 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:47.569+0000 7f85a2ffd640 1 -- 172.21.15.19:0/425118797 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f85ac103cc0 msgr2=0x7f85ac1992d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:30:47.687 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:47.569+0000 7f85a2ffd640 1 --2- 172.21.15.19:0/425118797 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f85ac103cc0 0x7f85ac1992d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:30:47.687 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:47.569+0000 7f85a2ffd640 1 -- 172.21.15.19:0/425118797 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f85ac19f380 con 0x7f85ac1045e0 2024-09-10T22:30:47.687 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:47.569+0000 7f85abfff640 1 --2- 172.21.15.19:0/425118797 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f85ac10d120 0x7f85ac19ebb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T22:30:47.687 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:47.569+0000 7f85ab7fe640 1 --2- 172.21.15.19:0/425118797 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f85ac103cc0 0x7f85ac1992d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T22:30:47.688 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:47.570+0000 7f85a2ffd640 1 --2- 172.21.15.19:0/425118797 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f85ac1045e0 0x7f85ac199810 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f8594005ab0 tx=0x7f8594003ae0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:30:47.688 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:47.570+0000 7f85a97fa640 1 -- 172.21.15.19:0/425118797 <== mon.1 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f859403f070 con 0x7f85ac1045e0 2024-09-10T22:30:47.688 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:47.570+0000 7f85a97fa640 1 -- 172.21.15.19:0/425118797 <== mon.1 v2:172.21.15.138:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8594031b50 con 0x7f85ac1045e0 2024-09-10T22:30:47.688 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:47.570+0000 7f85b1d1d640 1 -- 172.21.15.19:0/425118797 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f85ac19f610 con 0x7f85ac1045e0 2024-09-10T22:30:47.688 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:47.570+0000 7f85a97fa640 1 -- 172.21.15.19:0/425118797 <== mon.1 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8594035030 con 0x7f85ac1045e0 2024-09-10T22:30:47.688 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:47.570+0000 7f85b1d1d640 1 -- 172.21.15.19:0/425118797 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f85ac101850 con 0x7f85ac1045e0 2024-09-10T22:30:47.688 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:47.573+0000 7f85a97fa640 1 -- 172.21.15.19:0/425118797 <== mon.1 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 18) ==== 153250+0+0 (secure 0 0 0) 0x7f859403bb00 con 0x7f85ac1045e0 2024-09-10T22:30:47.688 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:47.573+0000 7f85b40f2740 1 Processor -- start 2024-09-10T22:30:47.688 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:47.573+0000 7f85b40f2740 1 -- start start 2024-09-10T22:30:47.688 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:47.573+0000 7f85b40f2740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55abedd860a0 0x55abedd86480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:30:47.688 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:47.573+0000 7f85b40f2740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55abedd869c0 0x55abedd92410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:30:47.688 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:47.573+0000 7f85b40f2740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55abedd92950 0x55abedd94d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:30:47.689 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:47.573+0000 7f85b40f2740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x55abedcfce50 con 0x55abedd92950 2024-09-10T22:30:47.689 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:47.573+0000 7f85b40f2740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55abedcec280 con 0x55abedd860a0 2024-09-10T22:30:47.689 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:47.573+0000 7f85b40f2740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x55abedcf0090 con 0x55abedd869c0 2024-09-10T22:30:47.689 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:47.573+0000 7f85a2ffd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55abedd92950 0x55abedd94d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:30:47.689 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:47.573+0000 7f85ab7fe640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55abedd869c0 0x55abedd92410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:30:47.689 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:47.573+0000 7f85abfff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55abedd860a0 0x55abedd86480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:30:47.689 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:47.573+0000 7f85ab7fe640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55abedd869c0 0x55abedd92410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.19:34544/0 (socket says 172.21.15.19:34544) 2024-09-10T22:30:47.689 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:47.573+0000 7f85abfff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55abedd860a0 0x55abedd86480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.19:45388/0 (socket says 172.21.15.19:45388) 2024-09-10T22:30:47.689 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:47.573+0000 7f85ab7fe640 1 -- 172.21.15.19:0/3796168848 learned_addr learned my addr 172.21.15.19:0/3796168848 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:30:47.689 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:47.574+0000 7f85abfff640 1 -- 172.21.15.19:0/3796168848 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55abedd869c0 msgr2=0x55abedd92410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:30:47.689 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:47.574+0000 7f85abfff640 1 --2- 172.21.15.19:0/3796168848 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55abedd869c0 0x55abedd92410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:30:47.689 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:47.574+0000 7f85abfff640 1 -- 172.21.15.19:0/3796168848 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55abedd92950 msgr2=0x55abedd94d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:30:47.689 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:47.574+0000 7f85abfff640 1 --2- 172.21.15.19:0/3796168848 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55abedd92950 0x55abedd94d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:30:47.690 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:47.574+0000 7f85abfff640 1 -- 172.21.15.19:0/3796168848 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55abeda4a650 con 0x55abedd860a0 2024-09-10T22:30:47.690 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:47.574+0000 7f85ab7fe640 1 --2- 172.21.15.19:0/3796168848 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55abedd869c0 0x55abedd92410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T22:30:47.690 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:47.574+0000 7f85abfff640 1 --2- 172.21.15.19:0/3796168848 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55abedd860a0 0x55abedd86480 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f85a4010a00 tx=0x7f85a4009500 comp rx=0 tx=0).ready entity=mon.2 client_cookie=df12382c4e0677ab server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:30:47.690 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:47.574+0000 7f85a1ffb640 1 -- 172.21.15.19:0/3796168848 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85a401e030 con 0x55abedd860a0 2024-09-10T22:30:47.690 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:47.574+0000 7f85a97fa640 1 --2- 172.21.15.19:0/425118797 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f85980b52e0 0x7f85980b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:30:47.690 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:47.574+0000 7f85a1ffb640 1 -- 172.21.15.19:0/3796168848 <== mon.2 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f85a400b920 con 0x55abedd860a0 2024-09-10T22:30:47.690 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:47.574+0000 7f85a1ffb640 1 -- 172.21.15.19:0/3796168848 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85a40055f0 con 0x55abedd860a0 2024-09-10T22:30:47.690 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:47.575+0000 7f85ab7fe640 1 --2- 172.21.15.19:0/425118797 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f85980b52e0 0x7f85980b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:30:47.690 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:47.575+0000 7f85a97fa640 1 -- 172.21.15.19:0/425118797 <== mon.1 v2:172.21.15.138:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8327+0+0 (secure 0 0 0) 0x7f85941064f0 con 0x7f85ac1045e0 2024-09-10T22:30:47.690 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:47.575+0000 7f85ab7fe640 1 --2- 172.21.15.19:0/425118797 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f85980b52e0 0x7f85980b77a0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x55abedd84db0 tx=0x7f859c005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:30:47.690 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:47.575+0000 7f85b40f2740 1 -- 172.21.15.19:0/3796168848 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55abedd860a0 msgr2=0x55abedd86480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:30:47.690 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:47.575+0000 7f85b40f2740 1 --2- 172.21.15.19:0/3796168848 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55abedd860a0 0x55abedd86480 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f85a4010a00 tx=0x7f85a4009500 comp rx=0 tx=0).stop 2024-09-10T22:30:47.690 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:47.575+0000 7f85b40f2740 1 -- 172.21.15.19:0/3796168848 shutdown_connections 2024-09-10T22:30:47.690 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:47.575+0000 7f85b40f2740 1 --2- 172.21.15.19:0/3796168848 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55abedd92950 0x55abedd94d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:30:47.691 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:47.575+0000 7f85b40f2740 1 --2- 172.21.15.19:0/3796168848 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55abedd869c0 0x55abedd92410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:30:47.691 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:47.575+0000 7f85b40f2740 1 --2- 172.21.15.19:0/3796168848 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55abedd860a0 0x55abedd86480 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:30:47.691 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:47.575+0000 7f85b40f2740 1 -- 172.21.15.19:0/3796168848 >> 172.21.15.19:0/3796168848 conn(0x55abedd83ed0 msgr2=0x55abedd85070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:30:47.691 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:47.575+0000 7f85b40f2740 1 -- 172.21.15.19:0/3796168848 shutdown_connections 2024-09-10T22:30:47.691 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:47.575+0000 7f85b40f2740 1 -- 172.21.15.19:0/3796168848 wait complete. 2024-09-10T22:30:47.691 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:47.576+0000 7f85b40f2740 1 -- start start 2024-09-10T22:30:47.691 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:47.576+0000 7f85b40f2740 1 Processor -- start 2024-09-10T22:30:47.691 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:47.576+0000 7f85b40f2740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55abedd860a0 0x55abedd921c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:30:47.691 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:47.576+0000 7f85b40f2740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55abedd869c0 0x55abedd8f610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:30:47.692 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:47.576+0000 7f85b40f2740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55abedd92950 0x55abedd8fb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:30:47.692 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:47.576+0000 7f85b40f2740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x55abedb4d700 con 0x55abedd869c0 2024-09-10T22:30:47.692 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:47.576+0000 7f85b40f2740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55abedc87110 con 0x55abedd860a0 2024-09-10T22:30:47.692 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:47.576+0000 7f85b40f2740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x55abedd955d0 con 0x55abedd92950 2024-09-10T22:30:47.692 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:47.576+0000 7f85b40f2740 10 client.0 _ll_register_callbacks cb 0x55abedca0990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T22:30:47.692 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:47.577+0000 7f85a2ffd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55abedd869c0 0x55abedd8f610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:30:47.692 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:47.577+0000 7f85a2ffd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55abedd869c0 0x55abedd8f610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:55080/0 (socket says 172.21.15.19:55080) 2024-09-10T22:30:47.692 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:47.577+0000 7f85a2ffd640 1 -- 172.21.15.19:0/2647787542 learned_addr learned my addr 172.21.15.19:0/2647787542 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:30:47.692 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:47.577+0000 7f85ab7fe640 1 --2- 172.21.15.19:0/2647787542 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55abedd860a0 0x55abedd921c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:30:47.692 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:47.577+0000 7f85abfff640 1 --2- 172.21.15.19:0/2647787542 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55abedd92950 0x55abedd8fb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:30:47.692 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:47.577+0000 7f85a2ffd640 1 -- 172.21.15.19:0/2647787542 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55abedd92950 msgr2=0x55abedd8fb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:30:47.692 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:47.577+0000 7f85a2ffd640 1 --2- 172.21.15.19:0/2647787542 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55abedd92950 0x55abedd8fb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:30:47.692 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:47.577+0000 7f85a2ffd640 1 -- 172.21.15.19:0/2647787542 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55abedd860a0 msgr2=0x55abedd921c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:30:47.692 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:47.577+0000 7f85a2ffd640 1 --2- 172.21.15.19:0/2647787542 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55abedd860a0 0x55abedd921c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:30:47.693 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:47.577+0000 7f85a2ffd640 1 -- 172.21.15.19:0/2647787542 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55abedcb4c40 con 0x55abedd869c0 2024-09-10T22:30:47.693 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:47.577+0000 7f85a2ffd640 1 --2- 172.21.15.19:0/2647787542 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55abedd869c0 0x55abedd8f610 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7f85940c91c0 tx=0x7f85940092e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=38a909316091ba3a server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:30:47.693 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:47.577+0000 7f858affd640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-10T22:30:47.693 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:47.577+0000 7f858affd640 1 -- 172.21.15.19:0/2647787542 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8594049030 con 0x55abedd869c0 2024-09-10T22:30:47.693 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:47.577+0000 7f858affd640 1 -- 172.21.15.19:0/2647787542 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8327+0+0 (secure 0 0 0) 0x7f85941060d0 con 0x55abedd869c0 2024-09-10T22:30:47.693 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:47.577+0000 7f85b40f2740 1 -- 172.21.15.19:0/2647787542 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f85a400b920 con 0x55abedd869c0 2024-09-10T22:30:47.693 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:47.577+0000 7f858affd640 1 -- 172.21.15.19:0/2647787542 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f85940c9240 con 0x55abedd869c0 2024-09-10T22:30:47.693 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:47.577+0000 7f85b40f2740 10 client.16203 fetch_fsmap learned FSMap version 27 2024-09-10T22:30:47.693 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:47.577+0000 7f85b40f2740 1 -- 172.21.15.19:0/2647787542 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55abedda0e80 con 0x55abedd869c0 2024-09-10T22:30:47.693 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:47.578+0000 7f858affd640 1 -- 172.21.15.19:0/2647787542 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f85a400b920 con 0x55abedd869c0 2024-09-10T22:30:47.693 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:47.578+0000 7f858affd640 1 -- 172.21.15.19:0/2647787542 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7f85940c8050 con 0x55abedd869c0 2024-09-10T22:30:47.693 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:47.578+0000 7f85b40f2740 10 client.16203 fetch_fsmap finished waiting for FSMap version 27 2024-09-10T22:30:47.694 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:47.578+0000 7f85b40f2740 10 client.16203 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-10T22:30:47.694 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:47.578+0000 7f85b40f2740 20 client.16203 populate_metadata read hostname 'smithi019' 2024-09-10T22:30:47.694 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:47.578+0000 7f85b40f2740 1 --2- 172.21.15.19:0/2647787542 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x55abedda22c0 0x55abedda46f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:30:47.694 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:47.578+0000 7f85b40f2740 4 client.16203 mds_command: new command op to 24581 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T22:30:47.694 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:47.578+0000 7f85b40f2740 1 -- 172.21.15.19:0/2647787542 --> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55abedcfeda0 con 0x55abedda22c0 2024-09-10T22:30:47.694 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:47.578+0000 7f85ab7fe640 1 --2- 172.21.15.19:0/2647787542 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x55abedda22c0 0x55abedda46f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:30:47.694 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:47.579+0000 7f85ab7fe640 1 --2- 172.21.15.19:0/2647787542 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x55abedda22c0 0x55abedda46f0 crc :-1 s=READY pgs=104 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fd8b18a7f7d6eec5 server_cookie=2a6bef62feb38a6e in_seq=0 out_seq=0 2024-09-10T22:30:47.694 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:47.579+0000 7f858affd640 10 client.16203 ms_handle_connect on v2:172.21.15.135:6838/1254769802 2024-09-10T22:30:47.694 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:47.579+0000 7f858affd640 1 -- 172.21.15.19:0/2647787542 <== mds.0 v2:172.21.15.135:6838/1254769802 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55abedcfeda0 con 0x55abedda22c0 2024-09-10T22:30:47.694 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:47.579+0000 7f858affd640 10 client.16203 handle_command_reply: tid=0 2024-09-10T22:30:47.694 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:47.579+0000 7f85b40f2740 1 client.16203 shutdown 2024-09-10T22:30:47.694 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:47.580+0000 7f85b40f2740 1 -- 172.21.15.19:0/2647787542 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55abedd869c0 msgr2=0x55abedd8f610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:30:47.694 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:47.580+0000 7f85b40f2740 1 --2- 172.21.15.19:0/2647787542 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55abedd869c0 0x55abedd8f610 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7f85940c91c0 tx=0x7f85940092e0 comp rx=0 tx=0).stop 2024-09-10T22:30:47.694 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:47.580+0000 7f85b40f2740 1 -- 172.21.15.19:0/2647787542 shutdown_connections 2024-09-10T22:30:47.695 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:47.580+0000 7f85b40f2740 1 --2- 172.21.15.19:0/2647787542 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x55abedda22c0 0x55abedda46f0 crc :-1 s=READY pgs=104 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:30:47.695 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:47.580+0000 7f85b40f2740 1 --2- 172.21.15.19:0/2647787542 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55abedd92950 0x55abedd8fb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:30:47.695 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:47.580+0000 7f85b40f2740 1 --2- 172.21.15.19:0/2647787542 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55abedd869c0 0x55abedd8f610 unknown :-1 s=CLOSED pgs=591 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:30:47.695 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:47.580+0000 7f858affd640 0 client.16203 ms_handle_reset on v2:172.21.15.135:6838/1254769802 2024-09-10T22:30:47.695 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:47.580+0000 7f85b40f2740 1 --2- 172.21.15.19:0/2647787542 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55abedd860a0 0x55abedd921c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:30:47.695 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:47.580+0000 7f85b40f2740 1 -- 172.21.15.19:0/2647787542 >> 172.21.15.19:0/2647787542 conn(0x55abedd83ed0 msgr2=0x55abedd89a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:30:47.695 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:47.580+0000 7f85b40f2740 1 -- 172.21.15.19:0/2647787542 shutdown_connections 2024-09-10T22:30:47.695 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:47.580+0000 7f85b40f2740 1 -- 172.21.15.19:0/2647787542 wait complete. 2024-09-10T22:30:47.695 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:47.580+0000 7f85b40f2740 20 client.16203 trim_cache size 0 max 16384 2024-09-10T22:30:47.695 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:47.598+0000 7f85b40f2740 1 Processor -- start 2024-09-10T22:30:47.695 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:47.598+0000 7f85b40f2740 1 -- start start 2024-09-10T22:30:47.695 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:47.598+0000 7f85b40f2740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55abedd860a0 0x55abedd9e800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:30:47.695 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:47.598+0000 7f85b40f2740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55abedd869c0 0x55abedd82e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:30:47.695 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:47.598+0000 7f85b40f2740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55abedd92950 0x55abedd93d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:30:47.696 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:47.598+0000 7f85b40f2740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f85ac1aead0 con 0x55abedd869c0 2024-09-10T22:30:47.696 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:47.598+0000 7f85b40f2740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f85ac1ac3a0 con 0x55abedd92950 2024-09-10T22:30:47.696 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:47.598+0000 7f85b40f2740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f85ac1aa1f0 con 0x55abedd860a0 2024-09-10T22:30:47.696 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:47.598+0000 7f85a2ffd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55abedd869c0 0x55abedd82e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:30:47.696 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:47.598+0000 7f85a2ffd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55abedd869c0 0x55abedd82e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:55086/0 (socket says 172.21.15.19:55086) 2024-09-10T22:30:47.696 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:47.598+0000 7f85a2ffd640 1 -- 172.21.15.19:0/3146592971 learned_addr learned my addr 172.21.15.19:0/3146592971 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:30:47.696 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:47.598+0000 7f85abfff640 1 --2- 172.21.15.19:0/3146592971 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55abedd92950 0x55abedd93d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:30:47.696 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:47.598+0000 7f85ab7fe640 1 --2- 172.21.15.19:0/3146592971 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55abedd860a0 0x55abedd9e800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:30:47.696 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:47.599+0000 7f85a2ffd640 1 -- 172.21.15.19:0/3146592971 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55abedd860a0 msgr2=0x55abedd9e800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:30:47.697 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:47.599+0000 7f85a2ffd640 1 --2- 172.21.15.19:0/3146592971 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55abedd860a0 0x55abedd9e800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:30:47.697 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:47.599+0000 7f85a2ffd640 1 -- 172.21.15.19:0/3146592971 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55abedd92950 msgr2=0x55abedd93d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:30:47.697 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:47.599+0000 7f85a2ffd640 1 --2- 172.21.15.19:0/3146592971 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55abedd92950 0x55abedd93d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:30:47.697 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:47.599+0000 7f85a2ffd640 1 -- 172.21.15.19:0/3146592971 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55abedd8aaf0 con 0x55abedd869c0 2024-09-10T22:30:47.697 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:47.599+0000 7f85ab7fe640 1 --2- 172.21.15.19:0/3146592971 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55abedd860a0 0x55abedd9e800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T22:30:47.697 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:47.599+0000 7f85a2ffd640 1 --2- 172.21.15.19:0/3146592971 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55abedd869c0 0x55abedd82e10 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7f8594031440 tx=0x7f859402a410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bf7b333664d482db server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:30:47.697 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:47.599+0000 7f85a17fa640 1 -- 172.21.15.19:0/3146592971 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8594049030 con 0x55abedd869c0 2024-09-10T22:30:47.697 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:47.599+0000 7f85a17fa640 1 -- 172.21.15.19:0/3146592971 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f85940cd2f0 con 0x55abedd869c0 2024-09-10T22:30:47.697 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:47.599+0000 7f85a17fa640 1 -- 172.21.15.19:0/3146592971 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85940cc360 con 0x55abedd869c0 2024-09-10T22:30:47.697 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:47.600+0000 7f85b40f2740 1 -- 172.21.15.19:0/3146592971 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55abedd869c0 msgr2=0x55abedd82e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:30:47.697 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:47.600+0000 7f85b40f2740 1 --2- 172.21.15.19:0/3146592971 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55abedd869c0 0x55abedd82e10 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7f8594031440 tx=0x7f859402a410 comp rx=0 tx=0).stop 2024-09-10T22:30:47.698 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:47.600+0000 7f85b40f2740 1 -- 172.21.15.19:0/3146592971 shutdown_connections 2024-09-10T22:30:47.698 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:47.600+0000 7f85b40f2740 1 --2- 172.21.15.19:0/3146592971 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55abedd92950 0x55abedd93d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:30:47.698 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:47.600+0000 7f85b40f2740 1 --2- 172.21.15.19:0/3146592971 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55abedd869c0 0x55abedd82e10 unknown :-1 s=CLOSED pgs=592 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:30:47.698 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:47.600+0000 7f85b40f2740 1 --2- 172.21.15.19:0/3146592971 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55abedd860a0 0x55abedd9e800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:30:47.698 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:47.600+0000 7f85b40f2740 1 -- 172.21.15.19:0/3146592971 >> 172.21.15.19:0/3146592971 conn(0x55abedd83ed0 msgr2=0x55abedd82700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:30:47.698 INFO:teuthology.orchestra.run.smithi019.stdout:{ 2024-09-10T22:30:47.699 INFO:teuthology.orchestra.run.smithi019.stdout: "status": "no active scrubs running", 2024-09-10T22:30:47.699 INFO:teuthology.orchestra.run.smithi019.stdout: "scrubs": {}, 2024-09-10T22:30:47.699 INFO:teuthology.orchestra.run.smithi019.stdout: "scrub_stats": { 2024-09-10T22:30:47.699 INFO:teuthology.orchestra.run.smithi019.stdout: "fd1f1837-dcfa-4d88-99e8-2509f36c3f98": { 2024-09-10T22:30:47.699 INFO:teuthology.orchestra.run.smithi019.stdout: "start_time": "2024-09-10T22:30:12.470477+0000", 2024-09-10T22:30:47.699 INFO:teuthology.orchestra.run.smithi019.stdout: "path": "/", 2024-09-10T22:30:47.699 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_started": 0, 2024-09-10T22:30:47.699 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_passed": 0, 2024-09-10T22:30:47.699 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_failed": 0, 2024-09-10T22:30:47.699 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_skipped": 0 2024-09-10T22:30:47.699 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:30:47.699 INFO:teuthology.orchestra.run.smithi019.stdout: "8f3bb3bf-911f-490c-9856-c80ea220dbbe": { 2024-09-10T22:30:47.700 INFO:teuthology.orchestra.run.smithi019.stdout: "start_time": "2024-09-10T22:29:25.374415+0000", 2024-09-10T22:30:47.700 INFO:teuthology.orchestra.run.smithi019.stdout: "path": "/", 2024-09-10T22:30:47.700 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_started": 0, 2024-09-10T22:30:47.700 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_passed": 0, 2024-09-10T22:30:47.700 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_failed": 0, 2024-09-10T22:30:47.700 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_skipped": 0 2024-09-10T22:30:47.700 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:30:47.700 INFO:teuthology.orchestra.run.smithi019.stdout: "eb518e3c-a71e-4f32-9ca0-ae88930ca218": { 2024-09-10T22:30:47.700 INFO:teuthology.orchestra.run.smithi019.stdout: "start_time": "2024-09-10T22:28:38.366352+0000", 2024-09-10T22:30:47.700 INFO:teuthology.orchestra.run.smithi019.stdout: "path": "/", 2024-09-10T22:30:47.700 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_started": 0, 2024-09-10T22:30:47.700 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_passed": 0, 2024-09-10T22:30:47.700 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_failed": 0, 2024-09-10T22:30:47.701 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_skipped": 0 2024-09-10T22:30:47.701 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:30:47.701 INFO:teuthology.orchestra.run.smithi019.stdout: "c12c2a04-dcd6-4673-a98e-93f665d3f5d7": { 2024-09-10T22:30:47.701 INFO:teuthology.orchestra.run.smithi019.stdout: "start_time": "2024-09-10T22:27:49.392329+0000", 2024-09-10T22:30:47.701 INFO:teuthology.orchestra.run.smithi019.stdout: "path": "/", 2024-09-10T22:30:47.701 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_started": 0, 2024-09-10T22:30:47.701 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_passed": 0, 2024-09-10T22:30:47.701 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_failed": 0, 2024-09-10T22:30:47.701 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_skipped": 0 2024-09-10T22:30:47.701 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:30:47.701 INFO:teuthology.orchestra.run.smithi019.stdout: "b38852c8-478a-42ef-8384-b2c55d5313a4": { 2024-09-10T22:30:47.701 INFO:teuthology.orchestra.run.smithi019.stdout: "start_time": "2024-09-10T22:27:00.320308+0000", 2024-09-10T22:30:47.701 INFO:teuthology.orchestra.run.smithi019.stdout: "path": "/", 2024-09-10T22:30:47.702 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_started": 0, 2024-09-10T22:30:47.702 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_passed": 0, 2024-09-10T22:30:47.702 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_failed": 0, 2024-09-10T22:30:47.702 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_skipped": 0 2024-09-10T22:30:47.702 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:30:47.702 INFO:teuthology.orchestra.run.smithi019.stdout: "9b6bfdee-303c-4c12-af56-dc85860d112a": { 2024-09-10T22:30:47.702 INFO:teuthology.orchestra.run.smithi019.stdout: "start_time": "2024-09-10T22:26:17.484162+0000", 2024-09-10T22:30:47.702 INFO:teuthology.orchestra.run.smithi019.stdout: "path": "/", 2024-09-10T22:30:47.702 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_started": 0, 2024-09-10T22:30:47.702 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_passed": 0, 2024-09-10T22:30:47.702 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_failed": 0, 2024-09-10T22:30:47.702 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_skipped": 0 2024-09-10T22:30:47.702 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-10T22:30:47.702 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-10T22:30:47.703 INFO:teuthology.orchestra.run.smithi019.stdout:} 2024-09-10T22:30:47.703 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:47.600+0000 7f85b40f2740 1 -- 172.21.15.19:0/3146592971 shutdown_connections 2024-09-10T22:30:47.703 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:47.600+0000 7f85b40f2740 1 -- 172.21.15.19:0/3146592971 wait complete. 2024-09-10T22:30:47.703 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:47.601+0000 7f85b40f2740 1 -- start start 2024-09-10T22:30:47.703 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:47.601+0000 7f85b40f2740 1 Processor -- start 2024-09-10T22:30:47.703 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:47.601+0000 7f85b40f2740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55abedd860a0 0x55abedd9b010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:30:47.703 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:47.601+0000 7f85b40f2740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55abedd869c0 0x55abedd98aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:30:47.704 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:47.601+0000 7f85b40f2740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55abedd92950 0x55abedd98fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:30:47.704 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:47.601+0000 7f85b40f2740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f85ac1aa860 con 0x55abedd869c0 2024-09-10T22:30:47.704 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:47.601+0000 7f85b40f2740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f85ac1abcd0 con 0x55abedd92950 2024-09-10T22:30:47.704 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:47.601+0000 7f85b40f2740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f85ac1aaf30 con 0x55abedd860a0 2024-09-10T22:30:47.704 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:47.601+0000 7f85b40f2740 10 client.0 _ll_register_callbacks cb 0x7f8594005d50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T22:30:47.704 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:47.601+0000 7f85a2ffd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55abedd869c0 0x55abedd98aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:30:47.704 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:47.601+0000 7f85ab7fe640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55abedd860a0 0x55abedd9b010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:30:47.704 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:47.601+0000 7f85ab7fe640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55abedd860a0 0x55abedd9b010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.19:34574/0 (socket says 172.21.15.19:34574) 2024-09-10T22:30:47.704 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:47.601+0000 7f85a2ffd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55abedd869c0 0x55abedd98aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:55102/0 (socket says 172.21.15.19:55102) 2024-09-10T22:30:47.704 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:47.601+0000 7f85ab7fe640 1 -- 172.21.15.19:0/767560697 learned_addr learned my addr 172.21.15.19:0/767560697 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:30:47.704 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:47.601+0000 7f85abfff640 1 --2- 172.21.15.19:0/767560697 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55abedd92950 0x55abedd98fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:30:47.704 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:47.602+0000 7f85ab7fe640 1 -- 172.21.15.19:0/767560697 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55abedd92950 msgr2=0x55abedd98fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:30:47.705 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:47.602+0000 7f85ab7fe640 1 --2- 172.21.15.19:0/767560697 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55abedd92950 0x55abedd98fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:30:47.705 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:47.602+0000 7f85ab7fe640 1 -- 172.21.15.19:0/767560697 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55abedd869c0 msgr2=0x55abedd98aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:30:47.705 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:47.602+0000 7f85ab7fe640 1 --2- 172.21.15.19:0/767560697 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55abedd869c0 0x55abedd98aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:30:47.705 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:47.602+0000 7f85ab7fe640 1 -- 172.21.15.19:0/767560697 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55abedd99810 con 0x55abedd860a0 2024-09-10T22:30:47.705 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:47.602+0000 7f85a2ffd640 1 --2- 172.21.15.19:0/767560697 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55abedd869c0 0x55abedd98aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T22:30:47.705 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:47.602+0000 7f85ab7fe640 1 --2- 172.21.15.19:0/767560697 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55abedd860a0 0x55abedd9b010 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f859c0042b0 tx=0x7f859c0046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d4407d425ac0e8a server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:30:47.705 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:47.602+0000 7f858affd640 10 client.0 ms_handle_connect on v2:172.21.15.138:3300/0 2024-09-10T22:30:47.705 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:47.604+0000 7f858affd640 1 -- 172.21.15.19:0/767560697 <== mon.1 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f859c036060 con 0x55abedd860a0 2024-09-10T22:30:47.705 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:47.604+0000 7f858affd640 1 -- 172.21.15.19:0/767560697 <== mon.1 v2:172.21.15.138:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8327+0+0 (secure 0 0 0) 0x7f859c0043a0 con 0x55abedd860a0 2024-09-10T22:30:47.705 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:47.604+0000 7f85b40f2740 1 -- 172.21.15.19:0/767560697 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f85940cd2f0 con 0x55abedd860a0 2024-09-10T22:30:47.705 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:47.604+0000 7f858affd640 1 -- 172.21.15.19:0/767560697 <== mon.1 v2:172.21.15.138:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f859c0035f0 con 0x55abedd860a0 2024-09-10T22:30:47.705 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:47.604+0000 7f85b40f2740 10 client.25657 fetch_fsmap learned FSMap version 27 2024-09-10T22:30:47.706 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:47.604+0000 7f85b40f2740 1 -- 172.21.15.19:0/767560697 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55abede10260 con 0x55abedd860a0 2024-09-10T22:30:47.706 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:47.604+0000 7f858affd640 1 -- 172.21.15.19:0/767560697 <== mon.1 v2:172.21.15.138:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f85940cd2f0 con 0x55abedd860a0 2024-09-10T22:30:47.706 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:47.604+0000 7f858affd640 1 -- 172.21.15.19:0/767560697 <== mon.1 v2:172.21.15.138:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7f859c03a030 con 0x55abedd860a0 2024-09-10T22:30:47.706 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:47.604+0000 7f85b40f2740 10 client.25657 fetch_fsmap finished waiting for FSMap version 27 2024-09-10T22:30:47.706 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:47.604+0000 7f85b40f2740 10 client.25657 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-10T22:30:47.706 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:47.604+0000 7f85b40f2740 20 client.25657 populate_metadata read hostname 'smithi019' 2024-09-10T22:30:47.706 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:47.604+0000 7f85b40f2740 1 --2- 172.21.15.19:0/767560697 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x55abedda22c0 0x55abede12970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:30:47.706 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:47.605+0000 7f85b40f2740 4 client.25657 mds_command: new command op to 24581 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-10T22:30:47.706 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:47.605+0000 7f85b40f2740 1 -- 172.21.15.19:0/767560697 --> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55abedcfa850 con 0x55abedda22c0 2024-09-10T22:30:47.706 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:47.605+0000 7f85a2ffd640 1 --2- 172.21.15.19:0/767560697 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x55abedda22c0 0x55abede12970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:30:47.706 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:47.605+0000 7f858affd640 10 client.25657 ms_handle_connect on v2:172.21.15.135:6838/1254769802 2024-09-10T22:30:47.706 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:47.605+0000 7f85a2ffd640 1 --2- 172.21.15.19:0/767560697 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x55abedda22c0 0x55abede12970 crc :-1 s=READY pgs=105 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=52c0af808585aa5 server_cookie=3adeeee698b20376 in_seq=0 out_seq=0 2024-09-10T22:30:47.706 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:47.605+0000 7f858affd640 1 -- 172.21.15.19:0/767560697 <== mds.0 v2:172.21.15.135:6838/1254769802 1 ==== command_reply(tid 0: 0 ) ==== 8+0+1794 (crc 0 0 0) 0x55abedcfa850 con 0x55abedda22c0 2024-09-10T22:30:47.706 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:47.605+0000 7f858affd640 10 client.25657 handle_command_reply: tid=0 2024-09-10T22:30:47.707 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:47.605+0000 7f85b40f2740 1 client.25657 shutdown 2024-09-10T22:30:47.707 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:47.606+0000 7f85b40f2740 1 -- 172.21.15.19:0/767560697 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55abedd860a0 msgr2=0x55abedd9b010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:30:47.707 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:47.606+0000 7f85b40f2740 1 --2- 172.21.15.19:0/767560697 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55abedd860a0 0x55abedd9b010 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f859c0042b0 tx=0x7f859c0046c0 comp rx=0 tx=0).stop 2024-09-10T22:30:47.707 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:47.606+0000 7f85b40f2740 1 -- 172.21.15.19:0/767560697 shutdown_connections 2024-09-10T22:30:47.707 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:47.606+0000 7f85b40f2740 1 --2- 172.21.15.19:0/767560697 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55abedd92950 0x55abedd98fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:30:47.707 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:47.606+0000 7f85b40f2740 1 --2- 172.21.15.19:0/767560697 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55abedd869c0 0x55abedd98aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:30:47.707 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:47.606+0000 7f85b40f2740 1 --2- 172.21.15.19:0/767560697 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x55abedda22c0 0x55abede12970 crc :-1 s=READY pgs=105 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:30:47.707 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:47.606+0000 7f85b40f2740 1 --2- 172.21.15.19:0/767560697 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55abedd860a0 0x55abedd9b010 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:30:47.707 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:47.606+0000 7f858affd640 0 client.25657 ms_handle_reset on v2:172.21.15.135:6838/1254769802 2024-09-10T22:30:47.707 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:47.606+0000 7f85b40f2740 1 -- 172.21.15.19:0/767560697 >> 172.21.15.19:0/767560697 conn(0x55abedd83ed0 msgr2=0x55abedd91460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:30:47.707 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:47.606+0000 7f85b40f2740 1 -- 172.21.15.19:0/767560697 shutdown_connections 2024-09-10T22:30:47.707 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:47.606+0000 7f85b40f2740 1 -- 172.21.15.19:0/767560697 wait complete. 2024-09-10T22:30:47.708 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:47.606+0000 7f85b40f2740 20 client.25657 trim_cache size 0 max 16384 2024-09-10T22:30:47.708 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:47.606+0000 7f85b1d1d640 1 -- 172.21.15.19:0/425118797 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f85980b52e0 msgr2=0x7f85980b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:30:47.708 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:47.606+0000 7f85b1d1d640 1 --2- 172.21.15.19:0/425118797 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f85980b52e0 0x7f85980b77a0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x55abedd84db0 tx=0x7f859c005f90 comp rx=0 tx=0).stop 2024-09-10T22:30:47.708 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:47.606+0000 7f85b1d1d640 1 -- 172.21.15.19:0/425118797 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f85ac1045e0 msgr2=0x7f85ac199810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:30:47.708 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:47.606+0000 7f85b1d1d640 1 --2- 172.21.15.19:0/425118797 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f85ac1045e0 0x7f85ac199810 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f8594005ab0 tx=0x7f8594003ae0 comp rx=0 tx=0).stop 2024-09-10T22:30:47.708 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:47.606+0000 7f85b1d1d640 1 -- 172.21.15.19:0/425118797 shutdown_connections 2024-09-10T22:30:47.708 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:47.606+0000 7f85b1d1d640 1 --2- 172.21.15.19:0/425118797 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f85980b52e0 0x7f85980b77a0 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:30:47.708 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:47.607+0000 7f85b1d1d640 1 --2- 172.21.15.19:0/425118797 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f85ac10d120 0x7f85ac19ebb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:30:47.708 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:47.607+0000 7f85b1d1d640 1 --2- 172.21.15.19:0/425118797 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f85ac1045e0 0x7f85ac199810 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:30:47.708 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:47.607+0000 7f85b1d1d640 1 --2- 172.21.15.19:0/425118797 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f85ac103cc0 0x7f85ac1992d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:30:47.708 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:47.607+0000 7f85b1d1d640 1 -- 172.21.15.19:0/425118797 >> 172.21.15.19:0/425118797 conn(0x7f85ac0fd740 msgr2=0x7f85ac0fe340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:30:47.708 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:47.607+0000 7f85b1d1d640 1 -- 172.21.15.19:0/425118797 shutdown_connections 2024-09-10T22:30:47.708 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:47.607+0000 7f85b1d1d640 1 -- 172.21.15.19:0/425118797 wait complete. 2024-09-10T22:30:47.860 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:30:47 smithi135 ceph-mon[34789]: pgmap v478: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 988 KiB/s rd, 390 MiB/s wr, 415 op/s 2024-09-10T22:30:47.875 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:30:47 smithi138 ceph-mon[35236]: pgmap v478: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 988 KiB/s rd, 390 MiB/s wr, 415 op/s 2024-09-10T22:30:47.958 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:30:47 smithi019 ceph-mon[31375]: pgmap v478: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 988 KiB/s rd, 390 MiB/s wr, 415 op/s 2024-09-10T22:30:48.631 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-10T22:30:48.631 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 22997a4c-6fc2-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-10T22:30:49.039 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/22997a4c-6fc2-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T22:30:49.673 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:49.671+0000 7f4b0367e640 1 -- 172.21.15.19:0/1290507760 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4afc10fb90 msgr2=0x7f4afc116370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:30:49.674 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:49.671+0000 7f4b0367e640 1 --2- 172.21.15.19:0/1290507760 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4afc10fb90 0x7f4afc116370 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7f4af8009900 tx=0x7f4af802a410 comp rx=0 tx=0).stop 2024-09-10T22:30:49.674 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:49.671+0000 7f4b0367e640 1 -- 172.21.15.19:0/1290507760 shutdown_connections 2024-09-10T22:30:49.674 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:49.671+0000 7f4b0367e640 1 --2- 172.21.15.19:0/1290507760 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4afc10fb90 0x7f4afc116370 unknown :-1 s=CLOSED pgs=593 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:30:49.674 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:49.671+0000 7f4b0367e640 1 --2- 172.21.15.19:0/1290507760 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f4afc10f210 0x7f4afc10f650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:30:49.674 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:49.671+0000 7f4b0367e640 1 --2- 172.21.15.19:0/1290507760 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4afc10a3b0 0x7f4afc10a790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:30:49.674 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:49.671+0000 7f4b0367e640 1 -- 172.21.15.19:0/1290507760 >> 172.21.15.19:0/1290507760 conn(0x7f4afc06e2e0 msgr2=0x7f4afc06e6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:30:49.674 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:49.672+0000 7f4b0367e640 1 -- 172.21.15.19:0/1290507760 shutdown_connections 2024-09-10T22:30:49.674 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:49.672+0000 7f4b0367e640 1 -- 172.21.15.19:0/1290507760 wait complete. 2024-09-10T22:30:49.675 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:49.673+0000 7f4b0367e640 1 Processor -- start 2024-09-10T22:30:49.675 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:49.673+0000 7f4b0367e640 1 -- start start 2024-09-10T22:30:49.676 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:49.673+0000 7f4b0367e640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4afc10a3b0 0x7f4afc1a3cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:30:49.676 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:49.673+0000 7f4b0367e640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f4afc10f210 0x7f4afc1a4210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:30:49.676 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:49.673+0000 7f4b0367e640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4afc10fb90 0x7f4afc1a95b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:30:49.676 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:49.673+0000 7f4b0367e640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f4afc1198c0 con 0x7f4afc10a3b0 2024-09-10T22:30:49.676 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:49.673+0000 7f4b0367e640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f4afc119740 con 0x7f4afc10fb90 2024-09-10T22:30:49.676 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:49.673+0000 7f4b0367e640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f4afc119a40 con 0x7f4afc10f210 2024-09-10T22:30:49.677 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:49.674+0000 7f4b0141a640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4afc10a3b0 0x7f4afc1a3cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:30:49.677 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:49.674+0000 7f4b01c1b640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4afc10fb90 0x7f4afc1a95b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:30:49.677 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:49.675+0000 7f4b01c1b640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4afc10fb90 0x7f4afc1a95b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.19:45428/0 (socket says 172.21.15.19:45428) 2024-09-10T22:30:49.677 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:49.675+0000 7f4b01c1b640 1 -- 172.21.15.19:0/1532582840 learned_addr learned my addr 172.21.15.19:0/1532582840 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:30:49.677 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:49.675+0000 7f4b0141a640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4afc10a3b0 0x7f4afc1a3cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:55116/0 (socket says 172.21.15.19:55116) 2024-09-10T22:30:49.678 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:49.675+0000 7f4b00c19640 1 --2- 172.21.15.19:0/1532582840 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f4afc10f210 0x7f4afc1a4210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:30:49.679 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:49.676+0000 7f4b0141a640 1 -- 172.21.15.19:0/1532582840 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f4afc10f210 msgr2=0x7f4afc1a4210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:30:49.679 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:49.676+0000 7f4b0141a640 1 --2- 172.21.15.19:0/1532582840 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f4afc10f210 0x7f4afc1a4210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:30:49.679 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:49.676+0000 7f4b0141a640 1 -- 172.21.15.19:0/1532582840 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4afc10fb90 msgr2=0x7f4afc1a95b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:30:49.679 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:49.676+0000 7f4b0141a640 1 --2- 172.21.15.19:0/1532582840 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4afc10fb90 0x7f4afc1a95b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:30:49.679 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:49.676+0000 7f4b0141a640 1 -- 172.21.15.19:0/1532582840 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4afc1a9d80 con 0x7f4afc10a3b0 2024-09-10T22:30:49.679 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:49.676+0000 7f4b01c1b640 1 --2- 172.21.15.19:0/1532582840 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4afc10fb90 0x7f4afc1a95b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T22:30:49.679 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:49.676+0000 7f4b00c19640 1 --2- 172.21.15.19:0/1532582840 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f4afc10f210 0x7f4afc1a4210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T22:30:49.679 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:49.677+0000 7f4b0141a640 1 --2- 172.21.15.19:0/1532582840 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4afc10a3b0 0x7f4afc1a3cd0 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7f4af400bd70 tx=0x7f4af400bda0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:30:49.683 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:49.680+0000 7f4af27fc640 1 -- 172.21.15.19:0/1532582840 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4af4019070 con 0x7f4afc10a3b0 2024-09-10T22:30:49.683 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:49.680+0000 7f4af27fc640 1 -- 172.21.15.19:0/1532582840 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4af400cdf0 con 0x7f4afc10a3b0 2024-09-10T22:30:49.685 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:49.681+0000 7f4af27fc640 1 -- 172.21.15.19:0/1532582840 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4af40127b0 con 0x7f4afc10a3b0 2024-09-10T22:30:49.685 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:49.681+0000 7f4b0367e640 1 -- 172.21.15.19:0/1532582840 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4afc1aa070 con 0x7f4afc10a3b0 2024-09-10T22:30:49.685 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:49.682+0000 7f4b0367e640 1 -- 172.21.15.19:0/1532582840 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4afc1b0730 con 0x7f4afc10a3b0 2024-09-10T22:30:49.686 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:49.684+0000 7f4b0367e640 1 -- 172.21.15.19:0/1532582840 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4afc074c90 con 0x7f4afc10a3b0 2024-09-10T22:30:49.697 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:49.695+0000 7f4af27fc640 1 -- 172.21.15.19:0/1532582840 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 18) ==== 153250+0+0 (secure 0 0 0) 0x7f4af4025080 con 0x7f4afc10a3b0 2024-09-10T22:30:49.700 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:49.696+0000 7f4af27fc640 1 --2- 172.21.15.19:0/1532582840 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f4ae80b5300 0x7f4ae80b77c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:30:49.700 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:49.697+0000 7f4af27fc640 1 -- 172.21.15.19:0/1532582840 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8327+0+0 (secure 0 0 0) 0x7f4af40e5690 con 0x7f4afc10a3b0 2024-09-10T22:30:49.701 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:49.699+0000 7f4b00c19640 1 --2- 172.21.15.19:0/1532582840 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f4ae80b5300 0x7f4ae80b77c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:30:49.702 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:49.701+0000 7f4b00c19640 1 --2- 172.21.15.19:0/1532582840 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f4ae80b5300 0x7f4ae80b77c0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f4afc10fa10 tx=0x7f4aec009110 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:30:49.711 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:49.709+0000 7f4af27fc640 1 -- 172.21.15.19:0/1532582840 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f4af40abec0 con 0x7f4afc10a3b0 2024-09-10T22:30:49.959 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:30:49 smithi019 ceph-mon[31375]: pgmap v479: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 730 KiB/s rd, 339 MiB/s wr, 499 op/s 2024-09-10T22:30:50.061 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:50.059+0000 7f4b0367e640 1 -- 172.21.15.19:0/1532582840 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f4afc1b0a50 con 0x7f4afc10a3b0 2024-09-10T22:30:50.062 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-10T22:30:50.063 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":27,"btime":"2024-09-10T22:29:37:724724+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14673,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6835/1835804747","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6834","nonce":1835804747},{"type":"v1","addr":"172.21.15.19:6835","nonce":1835804747}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14685,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6837/1750470490","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6836","nonce":1750470490},{"type":"v1","addr":"172.21.15.19:6837","nonce":1750470490}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14733,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6839/2642941149","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6838","nonce":2642941149},{"type":"v1","addr":"172.21.15.19:6839","nonce":2642941149}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14745,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6841/2449948682","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6840","nonce":2449948682},{"type":"v1","addr":"172.21.15.19:6841","nonce":2449948682}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24511,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.138:6833/2524811494","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6832","nonce":2524811494},{"type":"v1","addr":"172.21.15.138:6833","nonce":2524811494}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24512,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6833/3014993624","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6832","nonce":3014993624},{"type":"v1","addr":"172.21.15.135:6833","nonce":3014993624}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":27,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-10T22:24:22.733925+0000","modified":"2024-09-10T22:29:37.430699+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24581,"mds_1":24568,"mds_2":24553},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24527":{"gid":24527,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.135:6835/3715773348","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6834","nonce":3715773348},{"type":"v1","addr":"172.21.15.135:6835","nonce":3715773348}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24541":{"gid":24541,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.138:6835/933547028","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6834","nonce":933547028},{"type":"v1","addr":"172.21.15.138:6835","nonce":933547028}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24551":{"gid":24551,"name":"h","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.135:6837/3495029135","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6836","nonce":3495029135},{"type":"v1","addr":"172.21.15.135:6837","nonce":3495029135}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24553":{"gid":24553,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":10,"addr":"172.21.15.138:6837/3353290042","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6836","nonce":3353290042},{"type":"v1","addr":"172.21.15.138:6837","nonce":3353290042}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24568":{"gid":24568,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.138:6839/383637208","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6838","nonce":383637208},{"type":"v1","addr":"172.21.15.138:6839","nonce":383637208}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24581":{"gid":24581,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.135:6839/1254769802","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6838","nonce":1254769802},{"type":"v1","addr":"172.21.15.135:6839","nonce":1254769802}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24581,"qdb_cluster":[24581,24568,24553]},"id":1}]} 2024-09-10T22:30:50.063 INFO:teuthology.orchestra.run.smithi019.stderr:dumped fsmap epoch 27 2024-09-10T22:30:50.063 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:50.060+0000 7f4af27fc640 1 -- 172.21.15.19:0/1532582840 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) ==== 94+0+11921 (secure 0 0 0) 0x7f4af40b08f0 con 0x7f4afc10a3b0 2024-09-10T22:30:50.065 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:50.063+0000 7f4b0367e640 1 -- 172.21.15.19:0/1532582840 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f4ae80b5300 msgr2=0x7f4ae80b77c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:30:50.065 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:50.063+0000 7f4b0367e640 1 --2- 172.21.15.19:0/1532582840 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f4ae80b5300 0x7f4ae80b77c0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f4afc10fa10 tx=0x7f4aec009110 comp rx=0 tx=0).stop 2024-09-10T22:30:50.065 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:50.063+0000 7f4b0367e640 1 -- 172.21.15.19:0/1532582840 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4afc10a3b0 msgr2=0x7f4afc1a3cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:30:50.065 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:50.063+0000 7f4b0367e640 1 --2- 172.21.15.19:0/1532582840 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4afc10a3b0 0x7f4afc1a3cd0 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7f4af400bd70 tx=0x7f4af400bda0 comp rx=0 tx=0).stop 2024-09-10T22:30:50.065 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:50.063+0000 7f4b0367e640 1 -- 172.21.15.19:0/1532582840 shutdown_connections 2024-09-10T22:30:50.065 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:50.063+0000 7f4b0367e640 1 --2- 172.21.15.19:0/1532582840 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f4ae80b5300 0x7f4ae80b77c0 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:30:50.065 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:50.063+0000 7f4b0367e640 1 --2- 172.21.15.19:0/1532582840 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4afc10fb90 0x7f4afc1a95b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:30:50.066 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:50.063+0000 7f4b0367e640 1 --2- 172.21.15.19:0/1532582840 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f4afc10f210 0x7f4afc1a4210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:30:50.066 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:50.063+0000 7f4b0367e640 1 --2- 172.21.15.19:0/1532582840 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4afc10a3b0 0x7f4afc1a3cd0 unknown :-1 s=CLOSED pgs=594 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:30:50.066 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:50.063+0000 7f4b0367e640 1 -- 172.21.15.19:0/1532582840 >> 172.21.15.19:0/1532582840 conn(0x7f4afc06e2e0 msgr2=0x7f4afc11aa30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:30:50.066 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:50.063+0000 7f4b0367e640 1 -- 172.21.15.19:0/1532582840 shutdown_connections 2024-09-10T22:30:50.066 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:50.063+0000 7f4b0367e640 1 -- 172.21.15.19:0/1532582840 wait complete. 2024-09-10T22:30:50.110 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:30:49 smithi135 ceph-mon[34789]: pgmap v479: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 730 KiB/s rd, 339 MiB/s wr, 499 op/s 2024-09-10T22:30:50.125 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:30:49 smithi138 ceph-mon[35236]: pgmap v479: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 730 KiB/s rd, 339 MiB/s wr, 499 op/s 2024-09-10T22:30:50.958 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:30:50 smithi019 ceph-mon[31375]: from='client.? 172.21.15.19:0/1532582840' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T22:30:51.025 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:30:50 smithi138 ceph-mon[35236]: from='client.? 172.21.15.19:0/1532582840' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T22:30:51.109 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:30:50 smithi135 ceph-mon[34789]: from='client.? 172.21.15.19:0/1532582840' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T22:30:51.143 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 22997a4c-6fc2-11ef-bcea-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-09-10T22:30:51.576 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/22997a4c-6fc2-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T22:30:51.893 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:30:51 smithi019 ceph-mon[31375]: pgmap v480: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 967 KiB/s rd, 382 MiB/s wr, 740 op/s 2024-09-10T22:30:52.038 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:30:51 smithi138 ceph-mon[35236]: pgmap v480: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 967 KiB/s rd, 382 MiB/s wr, 740 op/s 2024-09-10T22:30:52.109 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:30:51 smithi135 ceph-mon[34789]: pgmap v480: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 967 KiB/s rd, 382 MiB/s wr, 740 op/s 2024-09-10T22:30:52.184 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:52.148+0000 7f2c5f9f9640 1 -- 172.21.15.19:0/1624315357 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2c58103ca0 msgr2=0x7f2c58104080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:30:52.184 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:52.148+0000 7f2c5f9f9640 1 --2- 172.21.15.19:0/1624315357 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2c58103ca0 0x7f2c58104080 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7f2c54009900 tx=0x7f2c5402a410 comp rx=0 tx=0).stop 2024-09-10T22:30:52.184 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:52.148+0000 7f2c5f9f9640 1 -- 172.21.15.19:0/1624315357 shutdown_connections 2024-09-10T22:30:52.184 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:52.148+0000 7f2c5f9f9640 1 --2- 172.21.15.19:0/1624315357 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f2c5810d100 0x7f2c5810f560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:30:52.184 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:52.148+0000 7f2c5f9f9640 1 --2- 172.21.15.19:0/1624315357 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2c581045c0 0x7f2c5810cab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:30:52.185 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:52.148+0000 7f2c5f9f9640 1 --2- 172.21.15.19:0/1624315357 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2c58103ca0 0x7f2c58104080 unknown :-1 s=CLOSED pgs=595 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:30:52.185 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:52.148+0000 7f2c5f9f9640 1 -- 172.21.15.19:0/1624315357 >> 172.21.15.19:0/1624315357 conn(0x7f2c580fd700 msgr2=0x7f2c580ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:30:52.185 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:52.148+0000 7f2c5f9f9640 1 -- 172.21.15.19:0/1624315357 shutdown_connections 2024-09-10T22:30:52.185 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:52.148+0000 7f2c5f9f9640 1 -- 172.21.15.19:0/1624315357 wait complete. 2024-09-10T22:30:52.185 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:52.149+0000 7f2c5f9f9640 1 Processor -- start 2024-09-10T22:30:52.185 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:52.149+0000 7f2c5f9f9640 1 -- start start 2024-09-10T22:30:52.185 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:52.149+0000 7f2c5f9f9640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2c58103ca0 0x7f2c58101950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:30:52.185 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:52.149+0000 7f2c5f9f9640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f2c581045c0 0x7f2c58101e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:30:52.185 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:52.149+0000 7f2c5f9f9640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2c5810d100 0x7f2c581023d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:30:52.185 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:52.149+0000 7f2c5f9f9640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f2c58112dc0 con 0x7f2c5810d100 2024-09-10T22:30:52.185 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:52.149+0000 7f2c5f9f9640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f2c58112c40 con 0x7f2c58103ca0 2024-09-10T22:30:52.185 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:52.149+0000 7f2c5f9f9640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f2c58112f40 con 0x7f2c581045c0 2024-09-10T22:30:52.186 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:52.149+0000 7f2c5cf94640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f2c581045c0 0x7f2c58101e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:30:52.186 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:52.149+0000 7f2c5d795640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2c58103ca0 0x7f2c58101950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:30:52.186 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:52.149+0000 7f2c5d795640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2c58103ca0 0x7f2c58101950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.19:45446/0 (socket says 172.21.15.19:45446) 2024-09-10T22:30:52.186 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:52.149+0000 7f2c5d795640 1 -- 172.21.15.19:0/2397176301 learned_addr learned my addr 172.21.15.19:0/2397176301 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:30:52.186 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:52.149+0000 7f2c5df96640 1 --2- 172.21.15.19:0/2397176301 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2c5810d100 0x7f2c581023d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:30:52.186 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:52.150+0000 7f2c5d795640 1 -- 172.21.15.19:0/2397176301 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f2c581045c0 msgr2=0x7f2c58101e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:30:52.186 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:52.150+0000 7f2c5d795640 1 --2- 172.21.15.19:0/2397176301 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f2c581045c0 0x7f2c58101e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:30:52.186 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:52.150+0000 7f2c5d795640 1 -- 172.21.15.19:0/2397176301 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2c5810d100 msgr2=0x7f2c581023d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:30:52.186 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:52.150+0000 7f2c5d795640 1 --2- 172.21.15.19:0/2397176301 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2c5810d100 0x7f2c581023d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:30:52.186 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:52.150+0000 7f2c5d795640 1 -- 172.21.15.19:0/2397176301 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2c581a76b0 con 0x7f2c58103ca0 2024-09-10T22:30:52.186 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:52.150+0000 7f2c5cf94640 1 --2- 172.21.15.19:0/2397176301 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f2c581045c0 0x7f2c58101e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T22:30:52.186 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:52.150+0000 7f2c5df96640 1 --2- 172.21.15.19:0/2397176301 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2c5810d100 0x7f2c581023d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T22:30:52.186 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:52.150+0000 7f2c5d795640 1 --2- 172.21.15.19:0/2397176301 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2c58103ca0 0x7f2c58101950 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f2c54031440 tx=0x7f2c54003b90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:30:52.187 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:52.150+0000 7f2c4e7fc640 1 -- 172.21.15.19:0/2397176301 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c5403f070 con 0x7f2c58103ca0 2024-09-10T22:30:52.187 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:52.150+0000 7f2c4e7fc640 1 -- 172.21.15.19:0/2397176301 <== mon.2 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2c54031b50 con 0x7f2c58103ca0 2024-09-10T22:30:52.187 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:52.150+0000 7f2c5f9f9640 1 -- 172.21.15.19:0/2397176301 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2c581a7940 con 0x7f2c58103ca0 2024-09-10T22:30:52.187 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:52.150+0000 7f2c4e7fc640 1 -- 172.21.15.19:0/2397176301 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c54035030 con 0x7f2c58103ca0 2024-09-10T22:30:52.187 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:52.150+0000 7f2c5f9f9640 1 -- 172.21.15.19:0/2397176301 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2c581a7e20 con 0x7f2c58103ca0 2024-09-10T22:30:52.187 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:52.153+0000 7f2c4e7fc640 1 -- 172.21.15.19:0/2397176301 <== mon.2 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 18) ==== 153250+0+0 (secure 0 0 0) 0x7f2c540316a0 con 0x7f2c58103ca0 2024-09-10T22:30:52.187 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:52.153+0000 7f2c61dce740 1 Processor -- start 2024-09-10T22:30:52.187 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:52.153+0000 7f2c61dce740 1 -- start start 2024-09-10T22:30:52.187 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:52.153+0000 7f2c61dce740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x556c4f5bb0f0 0x556c4f5bb4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:30:52.187 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:52.153+0000 7f2c61dce740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556c4f5bba10 0x556c4f5c7460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:30:52.187 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:52.153+0000 7f2c61dce740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x556c4f5c79a0 0x556c4f5c9d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:30:52.187 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:52.153+0000 7f2c61dce740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x556c4f531ea0 con 0x556c4f5c79a0 2024-09-10T22:30:52.187 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:52.153+0000 7f2c61dce740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x556c4f5212d0 con 0x556c4f5bba10 2024-09-10T22:30:52.188 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:52.153+0000 7f2c61dce740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x556c4f5250e0 con 0x556c4f5bb0f0 2024-09-10T22:30:52.188 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:52.153+0000 7f2c5df96640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x556c4f5bb0f0 0x556c4f5bb4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:30:52.188 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:52.153+0000 7f2c5cf94640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x556c4f5c79a0 0x556c4f5c9d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:30:52.188 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:52.153+0000 7f2c5df96640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x556c4f5bb0f0 0x556c4f5bb4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.19:34616/0 (socket says 172.21.15.19:34616) 2024-09-10T22:30:52.188 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:52.153+0000 7f2c5df96640 1 -- 172.21.15.19:0/926803914 learned_addr learned my addr 172.21.15.19:0/926803914 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:30:52.188 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:52.153+0000 7f2c5d795640 1 --2- 172.21.15.19:0/926803914 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556c4f5bba10 0x556c4f5c7460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:30:52.188 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:52.154+0000 7f2c5df96640 1 -- 172.21.15.19:0/926803914 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556c4f5bba10 msgr2=0x556c4f5c7460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:30:52.188 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:52.154+0000 7f2c5df96640 1 --2- 172.21.15.19:0/926803914 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556c4f5bba10 0x556c4f5c7460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:30:52.188 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:52.154+0000 7f2c5df96640 1 -- 172.21.15.19:0/926803914 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x556c4f5c79a0 msgr2=0x556c4f5c9d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:30:52.188 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:52.154+0000 7f2c5df96640 1 --2- 172.21.15.19:0/926803914 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x556c4f5c79a0 0x556c4f5c9d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:30:52.188 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:52.154+0000 7f2c5df96640 1 -- 172.21.15.19:0/926803914 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556c4f27f650 con 0x556c4f5bb0f0 2024-09-10T22:30:52.188 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:52.154+0000 7f2c4e7fc640 1 --2- 172.21.15.19:0/2397176301 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f2c440b5320 0x7f2c440b77e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:30:52.189 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:52.154+0000 7f2c5df96640 1 --2- 172.21.15.19:0/926803914 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x556c4f5bb0f0 0x556c4f5bb4d0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f2c500117a0 tx=0x7f2c50011c60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=66f22b97ae50d222 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:30:52.189 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:52.154+0000 7f2c5d795640 1 --2- 172.21.15.19:0/2397176301 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f2c440b5320 0x7f2c440b77e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:30:52.189 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:52.154+0000 7f2c437fe640 1 -- 172.21.15.19:0/926803914 <== mon.1 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c50011220 con 0x556c4f5bb0f0 2024-09-10T22:30:52.189 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:52.154+0000 7f2c437fe640 1 -- 172.21.15.19:0/926803914 <== mon.1 v2:172.21.15.138:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2c5000fa60 con 0x556c4f5bb0f0 2024-09-10T22:30:52.189 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:52.154+0000 7f2c437fe640 1 -- 172.21.15.19:0/926803914 <== mon.1 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c50005660 con 0x556c4f5bb0f0 2024-09-10T22:30:52.189 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:52.154+0000 7f2c4e7fc640 1 -- 172.21.15.19:0/2397176301 <== mon.2 v2:172.21.15.135:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8327+0+0 (secure 0 0 0) 0x7f2c54106560 con 0x7f2c58103ca0 2024-09-10T22:30:52.189 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:52.155+0000 7f2c61dce740 1 -- 172.21.15.19:0/926803914 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x556c4f5bb0f0 msgr2=0x556c4f5bb4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:30:52.189 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:52.155+0000 7f2c61dce740 1 --2- 172.21.15.19:0/926803914 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x556c4f5bb0f0 0x556c4f5bb4d0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f2c500117a0 tx=0x7f2c50011c60 comp rx=0 tx=0).stop 2024-09-10T22:30:52.189 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:52.155+0000 7f2c5d795640 1 --2- 172.21.15.19:0/2397176301 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f2c440b5320 0x7f2c440b77e0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f2c54109fd0 tx=0x7f2c5410c0e0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:30:52.189 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:52.155+0000 7f2c61dce740 1 -- 172.21.15.19:0/926803914 shutdown_connections 2024-09-10T22:30:52.189 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:52.155+0000 7f2c61dce740 1 --2- 172.21.15.19:0/926803914 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x556c4f5c79a0 0x556c4f5c9d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:30:52.189 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:52.155+0000 7f2c61dce740 1 --2- 172.21.15.19:0/926803914 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556c4f5bba10 0x556c4f5c7460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:30:52.189 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:52.155+0000 7f2c61dce740 1 --2- 172.21.15.19:0/926803914 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x556c4f5bb0f0 0x556c4f5bb4d0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:30:52.189 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:52.155+0000 7f2c61dce740 1 -- 172.21.15.19:0/926803914 >> 172.21.15.19:0/926803914 conn(0x556c4f5b8f20 msgr2=0x556c4f5ba0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:30:52.190 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:52.155+0000 7f2c61dce740 1 -- 172.21.15.19:0/926803914 shutdown_connections 2024-09-10T22:30:52.190 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:52.155+0000 7f2c61dce740 1 -- 172.21.15.19:0/926803914 wait complete. 2024-09-10T22:30:52.190 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:52.155+0000 7f2c61dce740 1 -- start start 2024-09-10T22:30:52.190 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:52.156+0000 7f2c61dce740 1 Processor -- start 2024-09-10T22:30:52.190 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:52.156+0000 7f2c61dce740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556c4f5bb0f0 0x556c4f5c7280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:30:52.190 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:52.156+0000 7f2c61dce740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x556c4f5bba10 0x556c4f5c46d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:30:52.190 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:52.156+0000 7f2c61dce740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x556c4f5c79a0 0x556c4f5c4d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:30:52.190 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:52.156+0000 7f2c61dce740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x556c4f382700 con 0x556c4f5bba10 2024-09-10T22:30:52.190 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:52.156+0000 7f2c61dce740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x556c4f4bc160 con 0x556c4f5bb0f0 2024-09-10T22:30:52.190 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:52.156+0000 7f2c61dce740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x556c4f5ca620 con 0x556c4f5c79a0 2024-09-10T22:30:52.190 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:52.156+0000 7f2c61dce740 10 client.0 _ll_register_callbacks cb 0x556c4f4d59e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T22:30:52.190 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:52.156+0000 7f2c5cf94640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x556c4f5bba10 0x556c4f5c46d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:30:52.190 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:52.156+0000 7f2c5df96640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556c4f5bb0f0 0x556c4f5c7280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:30:52.191 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:52.156+0000 7f2c5cf94640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x556c4f5bba10 0x556c4f5c46d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:55162/0 (socket says 172.21.15.19:55162) 2024-09-10T22:30:52.191 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:52.156+0000 7f2c5cf94640 1 -- 172.21.15.19:0/755481384 learned_addr learned my addr 172.21.15.19:0/755481384 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:30:52.191 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:52.156+0000 7f2c5df96640 1 --2- 172.21.15.19:0/755481384 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x556c4f5c79a0 0x556c4f5c4d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:30:52.191 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:52.156+0000 7f2c5cf94640 1 -- 172.21.15.19:0/755481384 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x556c4f5c79a0 msgr2=0x556c4f5c4d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:30:52.191 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:52.156+0000 7f2c5cf94640 1 --2- 172.21.15.19:0/755481384 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x556c4f5c79a0 0x556c4f5c4d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:30:52.191 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:52.156+0000 7f2c5cf94640 1 -- 172.21.15.19:0/755481384 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556c4f5bb0f0 msgr2=0x556c4f5c7280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:30:52.191 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:52.156+0000 7f2c5cf94640 1 --2- 172.21.15.19:0/755481384 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556c4f5bb0f0 0x556c4f5c7280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:30:52.191 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:52.156+0000 7f2c5cf94640 1 -- 172.21.15.19:0/755481384 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556c4f4e9c90 con 0x556c4f5bba10 2024-09-10T22:30:52.191 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:52.156+0000 7f2c5df96640 1 --2- 172.21.15.19:0/755481384 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x556c4f5c79a0 0x556c4f5c4d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T22:30:52.191 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:52.157+0000 7f2c5cf94640 1 --2- 172.21.15.19:0/755481384 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x556c4f5bba10 0x556c4f5c46d0 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7f2c48012d00 tx=0x7f2c4800f790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=16d863075539cfc1 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:30:52.191 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:52.157+0000 7f2c40ff9640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-10T22:30:52.191 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:52.157+0000 7f2c40ff9640 1 -- 172.21.15.19:0/755481384 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c48009d80 con 0x556c4f5bba10 2024-09-10T22:30:52.191 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:52.157+0000 7f2c40ff9640 1 -- 172.21.15.19:0/755481384 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8327+0+0 (secure 0 0 0) 0x7f2c48012110 con 0x556c4f5bba10 2024-09-10T22:30:52.192 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:52.157+0000 7f2c61dce740 1 -- 172.21.15.19:0/755481384 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2c5000fa60 con 0x556c4f5bba10 2024-09-10T22:30:52.192 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:52.157+0000 7f2c40ff9640 1 -- 172.21.15.19:0/755481384 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f2c48004030 con 0x556c4f5bba10 2024-09-10T22:30:52.192 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:52.157+0000 7f2c61dce740 10 client.16227 fetch_fsmap learned FSMap version 27 2024-09-10T22:30:52.192 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:52.157+0000 7f2c61dce740 1 -- 172.21.15.19:0/755481384 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x556c4f5d6020 con 0x556c4f5bba10 2024-09-10T22:30:52.192 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:52.157+0000 7f2c40ff9640 1 -- 172.21.15.19:0/755481384 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2c5000fa60 con 0x556c4f5bba10 2024-09-10T22:30:52.192 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:52.157+0000 7f2c40ff9640 1 -- 172.21.15.19:0/755481384 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7f2c48025050 con 0x556c4f5bba10 2024-09-10T22:30:52.192 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:52.158+0000 7f2c61dce740 10 client.16227 fetch_fsmap finished waiting for FSMap version 27 2024-09-10T22:30:52.192 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:52.158+0000 7f2c61dce740 10 client.16227 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-10T22:30:52.192 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:52.158+0000 7f2c61dce740 20 client.16227 populate_metadata read hostname 'smithi019' 2024-09-10T22:30:52.192 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:52.158+0000 7f2c61dce740 1 --2- 172.21.15.19:0/755481384 >> [v2:172.21.15.138:6836/3353290042,v1:172.21.15.138:6837/3353290042] conn(0x556c4f5d7430 0x556c4f5d9820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:30:52.192 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:52.158+0000 7f2c61dce740 4 client.16227 mds_command: new command op to 24553 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T22:30:52.192 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:52.158+0000 7f2c61dce740 1 -- 172.21.15.19:0/755481384 --> [v2:172.21.15.138:6836/3353290042,v1:172.21.15.138:6837/3353290042] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x556c4f533df0 con 0x556c4f5d7430 2024-09-10T22:30:52.192 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:52.158+0000 7f2c5df96640 1 --2- 172.21.15.19:0/755481384 >> [v2:172.21.15.138:6836/3353290042,v1:172.21.15.138:6837/3353290042] conn(0x556c4f5d7430 0x556c4f5d9820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:30:52.193 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:52.158+0000 7f2c40ff9640 10 client.16227 ms_handle_connect on v2:172.21.15.138:6836/3353290042 2024-09-10T22:30:52.193 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:52.158+0000 7f2c5df96640 1 --2- 172.21.15.19:0/755481384 >> [v2:172.21.15.138:6836/3353290042,v1:172.21.15.138:6837/3353290042] conn(0x556c4f5d7430 0x556c4f5d9820 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=9a79b1246cd54c0c server_cookie=8a71dc6ec8b89cfe in_seq=0 out_seq=0 2024-09-10T22:30:52.193 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:52.159+0000 7f2c40ff9640 1 -- 172.21.15.19:0/755481384 <== mds.2 v2:172.21.15.138:6836/3353290042 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x556c4f533df0 con 0x556c4f5d7430 2024-09-10T22:30:52.193 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:52.159+0000 7f2c40ff9640 10 client.16227 handle_command_reply: tid=0 2024-09-10T22:30:52.193 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:52.159+0000 7f2c61dce740 1 client.16227 shutdown 2024-09-10T22:30:52.193 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:52.159+0000 7f2c61dce740 1 -- 172.21.15.19:0/755481384 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x556c4f5bba10 msgr2=0x556c4f5c46d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:30:52.193 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:52.159+0000 7f2c61dce740 1 --2- 172.21.15.19:0/755481384 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x556c4f5bba10 0x556c4f5c46d0 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7f2c48012d00 tx=0x7f2c4800f790 comp rx=0 tx=0).stop 2024-09-10T22:30:52.193 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:52.159+0000 7f2c61dce740 1 -- 172.21.15.19:0/755481384 shutdown_connections 2024-09-10T22:30:52.193 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:52.159+0000 7f2c61dce740 1 --2- 172.21.15.19:0/755481384 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x556c4f5c79a0 0x556c4f5c4d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:30:52.193 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:52.159+0000 7f2c61dce740 1 --2- 172.21.15.19:0/755481384 >> [v2:172.21.15.138:6836/3353290042,v1:172.21.15.138:6837/3353290042] conn(0x556c4f5d7430 0x556c4f5d9820 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:30:52.193 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:52.159+0000 7f2c61dce740 1 --2- 172.21.15.19:0/755481384 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x556c4f5bba10 0x556c4f5c46d0 unknown :-1 s=CLOSED pgs=596 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:30:52.193 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:52.159+0000 7f2c61dce740 1 --2- 172.21.15.19:0/755481384 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556c4f5bb0f0 0x556c4f5c7280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:30:52.194 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:52.159+0000 7f2c40ff9640 0 client.16227 ms_handle_reset on v2:172.21.15.138:6836/3353290042 2024-09-10T22:30:52.194 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:52.159+0000 7f2c61dce740 1 -- 172.21.15.19:0/755481384 >> 172.21.15.19:0/755481384 conn(0x556c4f5b8f20 msgr2=0x556c4f5bea90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:30:52.194 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:52.159+0000 7f2c61dce740 1 -- 172.21.15.19:0/755481384 shutdown_connections 2024-09-10T22:30:52.194 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:52.159+0000 7f2c61dce740 1 -- 172.21.15.19:0/755481384 wait complete. 2024-09-10T22:30:52.194 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:52.159+0000 7f2c61dce740 20 client.16227 trim_cache size 0 max 16384 2024-09-10T22:30:52.194 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:52.174+0000 7f2c61dce740 1 Processor -- start 2024-09-10T22:30:52.194 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:52.174+0000 7f2c61dce740 1 -- start start 2024-09-10T22:30:52.194 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:52.174+0000 7f2c61dce740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556c4f5bb0f0 0x556c4f5ba6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:30:52.194 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:52.174+0000 7f2c61dce740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x556c4f5bba10 0x556c4f5b8760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:30:52.194 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:52.174+0000 7f2c61dce740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x556c4f5c79a0 0x556c4f5c8d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:30:52.194 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:52.174+0000 7f2c61dce740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f2c581b30a0 con 0x556c4f5bba10 2024-09-10T22:30:52.194 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:52.174+0000 7f2c61dce740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f2c581b0970 con 0x556c4f5bb0f0 2024-09-10T22:30:52.194 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:52.174+0000 7f2c61dce740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f2c581ae7c0 con 0x556c4f5c79a0 2024-09-10T22:30:52.195 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:52.174+0000 7f2c5cf94640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x556c4f5bba10 0x556c4f5b8760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:30:52.195 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:52.174+0000 7f2c5df96640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556c4f5bb0f0 0x556c4f5ba6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:30:52.195 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:52.174+0000 7f2c5df96640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556c4f5bb0f0 0x556c4f5ba6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.19:45472/0 (socket says 172.21.15.19:45472) 2024-09-10T22:30:52.195 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:52.174+0000 7f2c5df96640 1 -- 172.21.15.19:0/2128575304 learned_addr learned my addr 172.21.15.19:0/2128575304 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:30:52.195 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:52.175+0000 7f2c5df96640 1 --2- 172.21.15.19:0/2128575304 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x556c4f5c79a0 0x556c4f5c8d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:30:52.195 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:52.175+0000 7f2c5df96640 1 -- 172.21.15.19:0/2128575304 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x556c4f5c79a0 msgr2=0x556c4f5c8d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:30:52.195 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:52.175+0000 7f2c5df96640 1 --2- 172.21.15.19:0/2128575304 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x556c4f5c79a0 0x556c4f5c8d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:30:52.195 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:52.175+0000 7f2c5df96640 1 -- 172.21.15.19:0/2128575304 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x556c4f5bba10 msgr2=0x556c4f5b8760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:30:52.195 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:52.175+0000 7f2c5df96640 1 --2- 172.21.15.19:0/2128575304 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x556c4f5bba10 0x556c4f5b8760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:30:52.195 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:52.175+0000 7f2c5df96640 1 -- 172.21.15.19:0/2128575304 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556c4f5bb840 con 0x556c4f5bb0f0 2024-09-10T22:30:52.195 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:52.175+0000 7f2c5cf94640 1 --2- 172.21.15.19:0/2128575304 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x556c4f5bba10 0x556c4f5b8760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T22:30:52.195 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:52.175+0000 7f2c5df96640 1 --2- 172.21.15.19:0/2128575304 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556c4f5bb0f0 0x556c4f5ba6f0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f2c50009730 tx=0x7f2c50009500 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8746f48ae9a8277c server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:30:52.195 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:52.175+0000 7f2c42ffd640 1 -- 172.21.15.19:0/2128575304 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c5001d040 con 0x556c4f5bb0f0 2024-09-10T22:30:52.196 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:52.175+0000 7f2c42ffd640 1 -- 172.21.15.19:0/2128575304 <== mon.2 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2c50003e20 con 0x556c4f5bb0f0 2024-09-10T22:30:52.196 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:52.175+0000 7f2c42ffd640 1 -- 172.21.15.19:0/2128575304 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c50019430 con 0x556c4f5bb0f0 2024-09-10T22:30:52.196 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:52.176+0000 7f2c61dce740 1 -- 172.21.15.19:0/2128575304 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556c4f5bb0f0 msgr2=0x556c4f5ba6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:30:52.196 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:52.176+0000 7f2c61dce740 1 --2- 172.21.15.19:0/2128575304 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556c4f5bb0f0 0x556c4f5ba6f0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f2c50009730 tx=0x7f2c50009500 comp rx=0 tx=0).stop 2024-09-10T22:30:52.196 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:52.176+0000 7f2c61dce740 1 -- 172.21.15.19:0/2128575304 shutdown_connections 2024-09-10T22:30:52.196 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:52.176+0000 7f2c61dce740 1 --2- 172.21.15.19:0/2128575304 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x556c4f5c79a0 0x556c4f5c8d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:30:52.196 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:52.176+0000 7f2c61dce740 1 --2- 172.21.15.19:0/2128575304 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x556c4f5bba10 0x556c4f5b8760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:30:52.196 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:52.176+0000 7f2c61dce740 1 --2- 172.21.15.19:0/2128575304 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556c4f5bb0f0 0x556c4f5ba6f0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:30:52.196 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:52.176+0000 7f2c61dce740 1 -- 172.21.15.19:0/2128575304 >> 172.21.15.19:0/2128575304 conn(0x556c4f5b8f20 msgr2=0x556c4f5b9fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:30:52.196 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:52.176+0000 7f2c61dce740 1 -- 172.21.15.19:0/2128575304 shutdown_connections 2024-09-10T22:30:52.196 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:52.176+0000 7f2c61dce740 1 -- 172.21.15.19:0/2128575304 wait complete. 2024-09-10T22:30:52.196 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:52.177+0000 7f2c61dce740 1 -- start start 2024-09-10T22:30:52.196 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:52.177+0000 7f2c61dce740 1 Processor -- start 2024-09-10T22:30:52.196 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:52.177+0000 7f2c61dce740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x556c4f5bb0f0 0x556c4f5cfbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:30:52.197 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:52.177+0000 7f2c61dce740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x556c4f5bba10 0x556c4f5d0170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:30:52.197 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:52.177+0000 7f2c61dce740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556c4f5c79a0 0x556c4f5ca940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:30:52.197 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:52.177+0000 7f2c61dce740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f2c581aee30 con 0x556c4f5bb0f0 2024-09-10T22:30:52.197 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:52.177+0000 7f2c61dce740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f2c581b02a0 con 0x556c4f5c79a0 2024-09-10T22:30:52.197 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:52.177+0000 7f2c61dce740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f2c581af500 con 0x556c4f5bba10 2024-09-10T22:30:52.197 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:52.177+0000 7f2c61dce740 10 client.0 _ll_register_callbacks cb 0x7f2c48009cd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T22:30:52.197 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:52.177+0000 7f2c5df96640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x556c4f5bb0f0 0x556c4f5cfbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:30:52.197 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:52.177+0000 7f2c5df96640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x556c4f5bb0f0 0x556c4f5cfbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:55176/0 (socket says 172.21.15.19:55176) 2024-09-10T22:30:52.197 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:52.177+0000 7f2c5df96640 1 -- 172.21.15.19:0/2278976156 learned_addr learned my addr 172.21.15.19:0/2278976156 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:30:52.197 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:52.177+0000 7f2c5cf94640 1 --2- 172.21.15.19:0/2278976156 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x556c4f5bba10 0x556c4f5d0170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:30:52.197 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:52.177+0000 7f2c5df96640 1 --2- 172.21.15.19:0/2278976156 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556c4f5c79a0 0x556c4f5ca940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:30:52.197 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:52.178+0000 7f2c5df96640 1 -- 172.21.15.19:0/2278976156 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x556c4f5bba10 msgr2=0x556c4f5d0170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:30:52.198 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:52.178+0000 7f2c5df96640 1 --2- 172.21.15.19:0/2278976156 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x556c4f5bba10 0x556c4f5d0170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:30:52.198 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:52.178+0000 7f2c5df96640 1 -- 172.21.15.19:0/2278976156 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556c4f5c79a0 msgr2=0x556c4f5ca940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:30:52.198 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:52.178+0000 7f2c5df96640 1 --2- 172.21.15.19:0/2278976156 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556c4f5c79a0 0x556c4f5ca940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:30:52.198 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:52.178+0000 7f2c5df96640 1 -- 172.21.15.19:0/2278976156 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556c4f5cb170 con 0x556c4f5bb0f0 2024-09-10T22:30:52.198 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:52.178+0000 7f2c5cf94640 1 --2- 172.21.15.19:0/2278976156 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x556c4f5bba10 0x556c4f5d0170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T22:30:52.198 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:52.178+0000 7f2c5df96640 1 --2- 172.21.15.19:0/2278976156 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x556c4f5bb0f0 0x556c4f5cfbf0 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7f2c50011770 tx=0x7f2c50011c60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8aa62c5a9cbd7b6c server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:30:52.198 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:52.178+0000 7f2c40ff9640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-10T22:30:52.198 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:52.178+0000 7f2c40ff9640 1 -- 172.21.15.19:0/2278976156 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c50041060 con 0x556c4f5bb0f0 2024-09-10T22:30:52.198 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:52.178+0000 7f2c61dce740 1 -- 172.21.15.19:0/2278976156 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2c50003e20 con 0x556c4f5bb0f0 2024-09-10T22:30:52.198 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:52.178+0000 7f2c40ff9640 1 -- 172.21.15.19:0/2278976156 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8327+0+0 (secure 0 0 0) 0x7f2c50005330 con 0x556c4f5bb0f0 2024-09-10T22:30:52.198 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:52.178+0000 7f2c40ff9640 1 -- 172.21.15.19:0/2278976156 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f2c5001d070 con 0x556c4f5bb0f0 2024-09-10T22:30:52.198 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:52.178+0000 7f2c61dce740 10 client.16233 fetch_fsmap learned FSMap version 27 2024-09-10T22:30:52.198 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:52.178+0000 7f2c61dce740 1 -- 172.21.15.19:0/2278976156 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x556c4f644ef0 con 0x556c4f5bb0f0 2024-09-10T22:30:52.198 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:52.178+0000 7f2c40ff9640 1 -- 172.21.15.19:0/2278976156 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2c50003e20 con 0x556c4f5bb0f0 2024-09-10T22:30:52.199 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:52.179+0000 7f2c40ff9640 1 -- 172.21.15.19:0/2278976156 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7f2c50045030 con 0x556c4f5bb0f0 2024-09-10T22:30:52.199 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:52.179+0000 7f2c61dce740 10 client.16233 fetch_fsmap finished waiting for FSMap version 27 2024-09-10T22:30:52.199 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:52.179+0000 7f2c61dce740 10 client.16233 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-10T22:30:52.199 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:52.179+0000 7f2c61dce740 20 client.16233 populate_metadata read hostname 'smithi019' 2024-09-10T22:30:52.199 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:52.179+0000 7f2c61dce740 1 --2- 172.21.15.19:0/2278976156 >> [v2:172.21.15.138:6836/3353290042,v1:172.21.15.138:6837/3353290042] conn(0x556c4f6453a0 0x556c4f6477c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:30:52.199 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:52.179+0000 7f2c61dce740 4 client.16233 mds_command: new command op to 24553 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-10T22:30:52.199 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:52.179+0000 7f2c61dce740 1 -- 172.21.15.19:0/2278976156 --> [v2:172.21.15.138:6836/3353290042,v1:172.21.15.138:6837/3353290042] -- command(tid 0: {"prefix": "damage ls"}) -- 0x556c4f52f8a0 con 0x556c4f6453a0 2024-09-10T22:30:52.199 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:52.179+0000 7f2c5cf94640 1 --2- 172.21.15.19:0/2278976156 >> [v2:172.21.15.138:6836/3353290042,v1:172.21.15.138:6837/3353290042] conn(0x556c4f6453a0 0x556c4f6477c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:30:52.199 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:52.179+0000 7f2c40ff9640 10 client.16233 ms_handle_connect on v2:172.21.15.138:6836/3353290042 2024-09-10T22:30:52.199 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:52.179+0000 7f2c5cf94640 1 --2- 172.21.15.19:0/2278976156 >> [v2:172.21.15.138:6836/3353290042,v1:172.21.15.138:6837/3353290042] conn(0x556c4f6453a0 0x556c4f6477c0 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=b4ed2cd7aa840391 server_cookie=98ba83b0974fcab9 in_seq=0 out_seq=0 2024-09-10T22:30:52.199 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:52.179+0000 7f2c40ff9640 1 -- 172.21.15.19:0/2278976156 <== mds.2 v2:172.21.15.138:6836/3353290042 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x556c4f52f8a0 con 0x556c4f6453a0 2024-09-10T22:30:52.199 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:52.179+0000 7f2c40ff9640 10 client.16233 handle_command_reply: tid=0 2024-09-10T22:30:52.199 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:52.179+0000 7f2c61dce740 1 client.16233 shutdown 2024-09-10T22:30:52.200 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:52.180+0000 7f2c61dce740 1 -- 172.21.15.19:0/2278976156 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x556c4f5bb0f0 msgr2=0x556c4f5cfbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:30:52.200 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:52.180+0000 7f2c61dce740 1 --2- 172.21.15.19:0/2278976156 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x556c4f5bb0f0 0x556c4f5cfbf0 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7f2c50011770 tx=0x7f2c50011c60 comp rx=0 tx=0).stop 2024-09-10T22:30:52.200 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:52.180+0000 7f2c61dce740 1 -- 172.21.15.19:0/2278976156 shutdown_connections 2024-09-10T22:30:52.200 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:52.180+0000 7f2c61dce740 1 --2- 172.21.15.19:0/2278976156 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556c4f5c79a0 0x556c4f5ca940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:30:52.200 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:52.180+0000 7f2c61dce740 1 --2- 172.21.15.19:0/2278976156 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x556c4f5bba10 0x556c4f5d0170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:30:52.200 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:52.180+0000 7f2c61dce740 1 --2- 172.21.15.19:0/2278976156 >> [v2:172.21.15.138:6836/3353290042,v1:172.21.15.138:6837/3353290042] conn(0x556c4f6453a0 0x556c4f6477c0 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:30:52.200 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:52.180+0000 7f2c61dce740 1 --2- 172.21.15.19:0/2278976156 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x556c4f5bb0f0 0x556c4f5cfbf0 unknown :-1 s=CLOSED pgs=597 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:30:52.200 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:52.180+0000 7f2c61dce740 1 -- 172.21.15.19:0/2278976156 >> 172.21.15.19:0/2278976156 conn(0x556c4f5b8f20 msgr2=0x556c4f5c5d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:30:52.200 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:52.180+0000 7f2c40ff9640 0 client.16233 ms_handle_reset on v2:172.21.15.138:6836/3353290042 2024-09-10T22:30:52.200 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:52.180+0000 7f2c61dce740 1 -- 172.21.15.19:0/2278976156 shutdown_connections 2024-09-10T22:30:52.200 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:52.180+0000 7f2c61dce740 1 -- 172.21.15.19:0/2278976156 wait complete. 2024-09-10T22:30:52.200 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:52.180+0000 7f2c61dce740 20 client.16233 trim_cache size 0 max 16384 2024-09-10T22:30:52.201 INFO:teuthology.orchestra.run.smithi019.stdout:[] 2024-09-10T22:30:52.202 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:52.180+0000 7f2c5f9f9640 1 -- 172.21.15.19:0/2397176301 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f2c440b5320 msgr2=0x7f2c440b77e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:30:52.202 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:52.180+0000 7f2c5f9f9640 1 --2- 172.21.15.19:0/2397176301 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f2c440b5320 0x7f2c440b77e0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f2c54109fd0 tx=0x7f2c5410c0e0 comp rx=0 tx=0).stop 2024-09-10T22:30:52.202 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:52.180+0000 7f2c5f9f9640 1 -- 172.21.15.19:0/2397176301 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2c58103ca0 msgr2=0x7f2c58101950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:30:52.202 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:52.180+0000 7f2c5f9f9640 1 --2- 172.21.15.19:0/2397176301 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2c58103ca0 0x7f2c58101950 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f2c54031440 tx=0x7f2c54003b90 comp rx=0 tx=0).stop 2024-09-10T22:30:52.202 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:52.181+0000 7f2c5f9f9640 1 -- 172.21.15.19:0/2397176301 shutdown_connections 2024-09-10T22:30:52.202 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:52.181+0000 7f2c5f9f9640 1 --2- 172.21.15.19:0/2397176301 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f2c440b5320 0x7f2c440b77e0 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:30:52.202 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:52.181+0000 7f2c5f9f9640 1 --2- 172.21.15.19:0/2397176301 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2c5810d100 0x7f2c581023d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:30:52.202 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:52.181+0000 7f2c5f9f9640 1 --2- 172.21.15.19:0/2397176301 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f2c581045c0 0x7f2c58101e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:30:52.202 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:52.181+0000 7f2c5f9f9640 1 --2- 172.21.15.19:0/2397176301 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2c58103ca0 0x7f2c58101950 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:30:52.202 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:52.181+0000 7f2c5f9f9640 1 -- 172.21.15.19:0/2397176301 >> 172.21.15.19:0/2397176301 conn(0x7f2c580fd700 msgr2=0x7f2c580fe300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:30:52.202 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:52.181+0000 7f2c5f9f9640 1 -- 172.21.15.19:0/2397176301 shutdown_connections 2024-09-10T22:30:52.202 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:52.181+0000 7f2c5f9f9640 1 -- 172.21.15.19:0/2397176301 wait complete. 2024-09-10T22:30:53.105 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 22997a4c-6fc2-11ef-bcea-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-09-10T22:30:53.523 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/22997a4c-6fc2-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T22:30:53.875 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:30:53 smithi138 ceph-mon[35236]: pgmap v481: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 631 KiB/s rd, 317 MiB/s wr, 688 op/s 2024-09-10T22:30:53.959 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:30:53 smithi019 ceph-mon[31375]: pgmap v481: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 631 KiB/s rd, 317 MiB/s wr, 688 op/s 2024-09-10T22:30:54.109 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:30:53 smithi135 ceph-mon[34789]: pgmap v481: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 631 KiB/s rd, 317 MiB/s wr, 688 op/s 2024-09-10T22:30:54.110 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:54.108+0000 7fec6b9a7640 1 -- 172.21.15.19:0/42920245 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fec64108020 msgr2=0x7fec6410e820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:30:54.110 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:54.108+0000 7fec6b9a7640 1 --2- 172.21.15.19:0/42920245 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fec64108020 0x7fec6410e820 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fec5c009ca0 tx=0x7fec5c02a8c0 comp rx=0 tx=0).stop 2024-09-10T22:30:54.111 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:54.108+0000 7fec6b9a7640 1 -- 172.21.15.19:0/42920245 shutdown_connections 2024-09-10T22:30:54.111 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:54.108+0000 7fec6b9a7640 1 --2- 172.21.15.19:0/42920245 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fec64108020 0x7fec6410e820 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:30:54.111 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:54.108+0000 7fec6b9a7640 1 --2- 172.21.15.19:0/42920245 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fec641076a0 0x7fec64107ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:30:54.111 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:54.108+0000 7fec6b9a7640 1 --2- 172.21.15.19:0/42920245 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fec64101c90 0x7fec64102070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:30:54.111 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:54.108+0000 7fec6b9a7640 1 -- 172.21.15.19:0/42920245 >> 172.21.15.19:0/42920245 conn(0x7fec640fd700 msgr2=0x7fec640ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:30:54.111 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:54.109+0000 7fec6b9a7640 1 -- 172.21.15.19:0/42920245 shutdown_connections 2024-09-10T22:30:54.111 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:54.109+0000 7fec6b9a7640 1 -- 172.21.15.19:0/42920245 wait complete. 2024-09-10T22:30:54.114 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:54.109+0000 7fec6b9a7640 1 Processor -- start 2024-09-10T22:30:54.114 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:54.110+0000 7fec6b9a7640 1 -- start start 2024-09-10T22:30:54.114 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:54.110+0000 7fec6b9a7640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fec64101c90 0x7fec6419a010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:30:54.115 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:54.110+0000 7fec6b9a7640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fec641076a0 0x7fec6419a550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:30:54.115 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:54.110+0000 7fec6b9a7640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fec64108020 0x7fec6419aab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:30:54.115 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:54.110+0000 7fec6b9a7640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fec64111ce0 con 0x7fec64101c90 2024-09-10T22:30:54.116 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:54.110+0000 7fec6b9a7640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fec64111b60 con 0x7fec64108020 2024-09-10T22:30:54.116 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:54.110+0000 7fec6b9a7640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7fec64111e60 con 0x7fec641076a0 2024-09-10T22:30:54.116 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:54.110+0000 7fec69743640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fec64101c90 0x7fec6419a010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:30:54.116 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:54.110+0000 7fec69f44640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fec64108020 0x7fec6419aab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:30:54.116 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:54.110+0000 7fec69743640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fec64101c90 0x7fec6419a010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:50090/0 (socket says 172.21.15.19:50090) 2024-09-10T22:30:54.116 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:54.110+0000 7fec69743640 1 -- 172.21.15.19:0/1661912166 learned_addr learned my addr 172.21.15.19:0/1661912166 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:30:54.116 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:54.110+0000 7fec68f42640 1 --2- 172.21.15.19:0/1661912166 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fec641076a0 0x7fec6419a550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:30:54.116 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:54.110+0000 7fec69f44640 1 -- 172.21.15.19:0/1661912166 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fec641076a0 msgr2=0x7fec6419a550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:30:54.116 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:54.110+0000 7fec69f44640 1 --2- 172.21.15.19:0/1661912166 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fec641076a0 0x7fec6419a550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:30:54.116 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:54.111+0000 7fec69f44640 1 -- 172.21.15.19:0/1661912166 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fec64101c90 msgr2=0x7fec6419a010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:30:54.116 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:54.111+0000 7fec69f44640 1 --2- 172.21.15.19:0/1661912166 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fec64101c90 0x7fec6419a010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:30:54.117 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:54.111+0000 7fec69f44640 1 -- 172.21.15.19:0/1661912166 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fec641a53f0 con 0x7fec64108020 2024-09-10T22:30:54.117 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:54.111+0000 7fec68f42640 1 --2- 172.21.15.19:0/1661912166 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fec641076a0 0x7fec6419a550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T22:30:54.117 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:54.111+0000 7fec69743640 1 --2- 172.21.15.19:0/1661912166 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fec64101c90 0x7fec6419a010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T22:30:54.117 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:54.111+0000 7fec69f44640 1 --2- 172.21.15.19:0/1661912166 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fec64108020 0x7fec6419aab0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fec5c02ade0 tx=0x7fec5c031660 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:30:54.117 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:54.111+0000 7fec5a7fc640 1 -- 172.21.15.19:0/1661912166 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec5c04c070 con 0x7fec64108020 2024-09-10T22:30:54.117 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:54.111+0000 7fec5a7fc640 1 -- 172.21.15.19:0/1661912166 <== mon.2 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fec5c003e20 con 0x7fec64108020 2024-09-10T22:30:54.117 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:54.111+0000 7fec6b9a7640 1 -- 172.21.15.19:0/1661912166 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fec64197e00 con 0x7fec64108020 2024-09-10T22:30:54.117 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:54.111+0000 7fec5a7fc640 1 -- 172.21.15.19:0/1661912166 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec5c0042a0 con 0x7fec64108020 2024-09-10T22:30:54.117 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:54.111+0000 7fec6b9a7640 1 -- 172.21.15.19:0/1661912166 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fec64198340 con 0x7fec64108020 2024-09-10T22:30:54.119 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:54.114+0000 7fec5a7fc640 1 -- 172.21.15.19:0/1661912166 <== mon.2 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 18) ==== 153250+0+0 (secure 0 0 0) 0x7fec5c004440 con 0x7fec64108020 2024-09-10T22:30:54.120 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:54.114+0000 7fec6dd7c740 1 Processor -- start 2024-09-10T22:30:54.120 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:54.114+0000 7fec6dd7c740 1 -- start start 2024-09-10T22:30:54.120 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:54.115+0000 7fec6dd7c740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55f9e75400f0 0x55f9e75404d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:30:54.120 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:54.115+0000 7fec6dd7c740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f9e7540a10 0x55f9e754c460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:30:54.120 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:54.115+0000 7fec6dd7c740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55f9e754c9a0 0x55f9e754ed90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:30:54.120 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:54.115+0000 7fec6dd7c740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x55f9e74b6ea0 con 0x55f9e754c9a0 2024-09-10T22:30:54.120 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:54.115+0000 7fec6dd7c740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55f9e74a62d0 con 0x55f9e7540a10 2024-09-10T22:30:54.120 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:54.115+0000 7fec6dd7c740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x55f9e74aa0e0 con 0x55f9e75400f0 2024-09-10T22:30:54.120 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:54.115+0000 7fec69743640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f9e7540a10 0x55f9e754c460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:30:54.120 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:54.115+0000 7fec68f42640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55f9e75400f0 0x55f9e75404d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:30:54.121 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:54.115+0000 7fec68f42640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55f9e75400f0 0x55f9e75404d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.19:37052/0 (socket says 172.21.15.19:37052) 2024-09-10T22:30:54.121 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:54.115+0000 7fec69743640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f9e7540a10 0x55f9e754c460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.19:44778/0 (socket says 172.21.15.19:44778) 2024-09-10T22:30:54.121 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:54.115+0000 7fec68f42640 1 -- 172.21.15.19:0/411510301 learned_addr learned my addr 172.21.15.19:0/411510301 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:30:54.121 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:54.115+0000 7fec68f42640 1 --2- 172.21.15.19:0/411510301 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55f9e754c9a0 0x55f9e754ed90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:30:54.121 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:54.115+0000 7fec69743640 1 -- 172.21.15.19:0/411510301 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55f9e75400f0 msgr2=0x55f9e75404d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:30:54.121 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:54.115+0000 7fec69743640 1 --2- 172.21.15.19:0/411510301 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55f9e75400f0 0x55f9e75404d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:30:54.121 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:54.115+0000 7fec69743640 1 -- 172.21.15.19:0/411510301 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55f9e754c9a0 msgr2=0x55f9e754ed90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:30:54.121 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:54.115+0000 7fec69743640 1 --2- 172.21.15.19:0/411510301 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55f9e754c9a0 0x55f9e754ed90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:30:54.121 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:54.115+0000 7fec69743640 1 -- 172.21.15.19:0/411510301 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f9e7204650 con 0x55f9e7540a10 2024-09-10T22:30:54.121 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:54.115+0000 7fec68f42640 1 --2- 172.21.15.19:0/411510301 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55f9e75400f0 0x55f9e75404d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T22:30:54.121 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:54.116+0000 7fec5a7fc640 1 --2- 172.21.15.19:0/1661912166 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7fec500b52e0 0x7fec500b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:30:54.121 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:54.116+0000 7fec68f42640 1 --2- 172.21.15.19:0/1661912166 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7fec500b52e0 0x7fec500b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:30:54.122 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:54.116+0000 7fec69743640 1 --2- 172.21.15.19:0/411510301 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f9e7540a10 0x55f9e754c460 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fec600114f0 tx=0x7fec600119b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=826203bdd8415e8f server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:30:54.122 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:54.116+0000 7fec5a7fc640 1 -- 172.21.15.19:0/1661912166 <== mon.2 v2:172.21.15.135:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8327+0+0 (secure 0 0 0) 0x7fec5c10a500 con 0x7fec64108020 2024-09-10T22:30:54.122 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:54.116+0000 7fec4f7fe640 1 -- 172.21.15.19:0/411510301 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec60011250 con 0x55f9e7540a10 2024-09-10T22:30:54.122 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:54.116+0000 7fec4f7fe640 1 -- 172.21.15.19:0/411510301 <== mon.2 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fec600035f0 con 0x55f9e7540a10 2024-09-10T22:30:54.122 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:54.116+0000 7fec4f7fe640 1 -- 172.21.15.19:0/411510301 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec600044e0 con 0x55f9e7540a10 2024-09-10T22:30:54.122 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:54.116+0000 7fec68f42640 1 --2- 172.21.15.19:0/1661912166 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7fec500b52e0 0x7fec500b77a0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fec5400d5c0 tx=0x7fec54005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:30:54.122 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:54.117+0000 7fec6dd7c740 1 -- 172.21.15.19:0/411510301 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f9e7540a10 msgr2=0x55f9e754c460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:30:54.122 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:54.117+0000 7fec6dd7c740 1 --2- 172.21.15.19:0/411510301 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f9e7540a10 0x55f9e754c460 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fec600114f0 tx=0x7fec600119b0 comp rx=0 tx=0).stop 2024-09-10T22:30:54.122 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:54.117+0000 7fec6dd7c740 1 -- 172.21.15.19:0/411510301 shutdown_connections 2024-09-10T22:30:54.122 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:54.117+0000 7fec6dd7c740 1 --2- 172.21.15.19:0/411510301 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55f9e754c9a0 0x55f9e754ed90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:30:54.122 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:54.117+0000 7fec6dd7c740 1 --2- 172.21.15.19:0/411510301 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f9e7540a10 0x55f9e754c460 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:30:54.122 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:54.117+0000 7fec6dd7c740 1 --2- 172.21.15.19:0/411510301 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55f9e75400f0 0x55f9e75404d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:30:54.122 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:54.117+0000 7fec6dd7c740 1 -- 172.21.15.19:0/411510301 >> 172.21.15.19:0/411510301 conn(0x55f9e753df20 msgr2=0x55f9e753f0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:30:54.123 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:54.117+0000 7fec6dd7c740 1 -- 172.21.15.19:0/411510301 shutdown_connections 2024-09-10T22:30:54.123 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:54.118+0000 7fec6dd7c740 1 -- 172.21.15.19:0/411510301 wait complete. 2024-09-10T22:30:54.123 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:54.118+0000 7fec6dd7c740 1 -- start start 2024-09-10T22:30:54.123 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:54.118+0000 7fec6dd7c740 1 Processor -- start 2024-09-10T22:30:54.127 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:54.119+0000 7fec6dd7c740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55f9e75400f0 0x55f9e754c200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:30:54.127 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:54.119+0000 7fec6dd7c740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55f9e7540a10 0x55f9e7549650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:30:54.127 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:54.119+0000 7fec6dd7c740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f9e754c9a0 0x55f9e7549bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:30:54.127 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:54.119+0000 7fec6dd7c740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x55f9e7307700 con 0x55f9e7540a10 2024-09-10T22:30:54.127 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:54.119+0000 7fec6dd7c740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55f9e7441160 con 0x55f9e754c9a0 2024-09-10T22:30:54.127 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:54.119+0000 7fec6dd7c740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x55f9e754f620 con 0x55f9e75400f0 2024-09-10T22:30:54.127 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:54.119+0000 7fec6dd7c740 10 client.0 _ll_register_callbacks cb 0x55f9e745a9e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T22:30:54.127 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:54.119+0000 7fec69743640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55f9e75400f0 0x55f9e754c200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:30:54.128 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:54.119+0000 7fec69743640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55f9e75400f0 0x55f9e754c200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.19:37062/0 (socket says 172.21.15.19:37062) 2024-09-10T22:30:54.128 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:54.119+0000 7fec68f42640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55f9e7540a10 0x55f9e7549650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:30:54.128 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:54.119+0000 7fec69743640 1 -- 172.21.15.19:0/134152153 learned_addr learned my addr 172.21.15.19:0/134152153 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:30:54.128 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:54.119+0000 7fec69f44640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f9e754c9a0 0x55f9e7549bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:30:54.128 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:54.120+0000 7fec69743640 1 -- 172.21.15.19:0/134152153 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f9e754c9a0 msgr2=0x55f9e7549bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:30:54.128 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:54.120+0000 7fec69743640 1 --2- 172.21.15.19:0/134152153 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f9e754c9a0 0x55f9e7549bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:30:54.128 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:54.120+0000 7fec69743640 1 -- 172.21.15.19:0/134152153 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55f9e7540a10 msgr2=0x55f9e7549650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:30:54.128 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:54.120+0000 7fec69743640 1 --2- 172.21.15.19:0/134152153 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55f9e7540a10 0x55f9e7549650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:30:54.128 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:54.120+0000 7fec69743640 1 -- 172.21.15.19:0/134152153 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f9e746ec90 con 0x55f9e75400f0 2024-09-10T22:30:54.128 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:54.120+0000 7fec69f44640 1 --2- 172.21.15.19:0/134152153 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f9e754c9a0 0x55f9e7549bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T22:30:54.128 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:54.120+0000 7fec68f42640 1 --2- 172.21.15.19:0/134152153 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55f9e7540a10 0x55f9e7549650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T22:30:54.128 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:54.120+0000 7fec69743640 1 --2- 172.21.15.19:0/134152153 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55f9e75400f0 0x55f9e754c200 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fec60009620 tx=0x7fec60004230 comp rx=0 tx=0).ready entity=mon.1 client_cookie=980c567cc3d55ea4 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:30:54.129 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:54.120+0000 7fec4cff9640 10 client.0 ms_handle_connect on v2:172.21.15.138:3300/0 2024-09-10T22:30:54.129 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:54.120+0000 7fec4cff9640 1 -- 172.21.15.19:0/134152153 <== mon.1 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec60028070 con 0x55f9e75400f0 2024-09-10T22:30:54.129 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:54.120+0000 7fec6dd7c740 1 -- 172.21.15.19:0/134152153 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fec600035f0 con 0x55f9e75400f0 2024-09-10T22:30:54.129 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:54.120+0000 7fec4cff9640 1 -- 172.21.15.19:0/134152153 <== mon.1 v2:172.21.15.138:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8327+0+0 (secure 0 0 0) 0x7fec600037a0 con 0x55f9e75400f0 2024-09-10T22:30:54.129 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:54.120+0000 7fec4cff9640 1 -- 172.21.15.19:0/134152153 <== mon.1 v2:172.21.15.138:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fec60034050 con 0x55f9e75400f0 2024-09-10T22:30:54.129 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:54.120+0000 7fec6dd7c740 10 client.25690 fetch_fsmap learned FSMap version 27 2024-09-10T22:30:54.129 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:54.120+0000 7fec6dd7c740 1 -- 172.21.15.19:0/134152153 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55f9e755aed0 con 0x55f9e75400f0 2024-09-10T22:30:54.129 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:54.121+0000 7fec4cff9640 1 -- 172.21.15.19:0/134152153 <== mon.1 v2:172.21.15.138:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fec600035f0 con 0x55f9e75400f0 2024-09-10T22:30:54.129 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:54.121+0000 7fec4cff9640 1 -- 172.21.15.19:0/134152153 <== mon.1 v2:172.21.15.138:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7fec600046c0 con 0x55f9e75400f0 2024-09-10T22:30:54.129 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:54.121+0000 7fec6dd7c740 10 client.25690 fetch_fsmap finished waiting for FSMap version 27 2024-09-10T22:30:54.129 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:54.121+0000 7fec6dd7c740 10 client.25690 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-10T22:30:54.129 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:54.121+0000 7fec6dd7c740 20 client.25690 populate_metadata read hostname 'smithi019' 2024-09-10T22:30:54.129 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:54.121+0000 7fec6dd7c740 1 --2- 172.21.15.19:0/134152153 >> [v2:172.21.15.138:6838/383637208,v1:172.21.15.138:6839/383637208] conn(0x55f9e755c6a0 0x55f9e755eb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:30:54.130 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:54.121+0000 7fec6dd7c740 4 client.25690 mds_command: new command op to 24568 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T22:30:54.130 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:54.121+0000 7fec6dd7c740 1 -- 172.21.15.19:0/134152153 --> [v2:172.21.15.138:6838/383637208,v1:172.21.15.138:6839/383637208] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f9e74b8df0 con 0x55f9e755c6a0 2024-09-10T22:30:54.130 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:54.121+0000 7fec68f42640 1 --2- 172.21.15.19:0/134152153 >> [v2:172.21.15.138:6838/383637208,v1:172.21.15.138:6839/383637208] conn(0x55f9e755c6a0 0x55f9e755eb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:30:54.130 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:54.122+0000 7fec68f42640 1 --2- 172.21.15.19:0/134152153 >> [v2:172.21.15.138:6838/383637208,v1:172.21.15.138:6839/383637208] conn(0x55f9e755c6a0 0x55f9e755eb00 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=8a3d39db4a5023a5 server_cookie=b0ccfb9c000451a3 in_seq=0 out_seq=0 2024-09-10T22:30:54.130 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:54.122+0000 7fec4cff9640 10 client.25690 ms_handle_connect on v2:172.21.15.138:6838/383637208 2024-09-10T22:30:54.130 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:54.122+0000 7fec4cff9640 1 -- 172.21.15.19:0/134152153 <== mds.1 v2:172.21.15.138:6838/383637208 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55f9e74b8df0 con 0x55f9e755c6a0 2024-09-10T22:30:54.130 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:54.122+0000 7fec4cff9640 10 client.25690 handle_command_reply: tid=0 2024-09-10T22:30:54.130 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:54.122+0000 7fec6dd7c740 1 client.25690 shutdown 2024-09-10T22:30:54.130 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:54.123+0000 7fec6dd7c740 1 -- 172.21.15.19:0/134152153 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55f9e75400f0 msgr2=0x55f9e754c200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:30:54.130 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:54.123+0000 7fec6dd7c740 1 --2- 172.21.15.19:0/134152153 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55f9e75400f0 0x55f9e754c200 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fec60009620 tx=0x7fec60004230 comp rx=0 tx=0).stop 2024-09-10T22:30:54.130 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:54.123+0000 7fec6dd7c740 1 -- 172.21.15.19:0/134152153 shutdown_connections 2024-09-10T22:30:54.130 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:54.123+0000 7fec6dd7c740 1 --2- 172.21.15.19:0/134152153 >> [v2:172.21.15.138:6838/383637208,v1:172.21.15.138:6839/383637208] conn(0x55f9e755c6a0 0x55f9e755eb00 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:30:54.130 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:54.123+0000 7fec6dd7c740 1 --2- 172.21.15.19:0/134152153 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f9e754c9a0 0x55f9e7549bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:30:54.131 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:54.123+0000 7fec4cff9640 0 client.25690 ms_handle_reset on v2:172.21.15.138:6838/383637208 2024-09-10T22:30:54.131 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:54.123+0000 7fec6dd7c740 1 --2- 172.21.15.19:0/134152153 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55f9e7540a10 0x55f9e7549650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:30:54.131 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:54.123+0000 7fec6dd7c740 1 --2- 172.21.15.19:0/134152153 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55f9e75400f0 0x55f9e754c200 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:30:54.131 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:54.123+0000 7fec6dd7c740 1 -- 172.21.15.19:0/134152153 >> 172.21.15.19:0/134152153 conn(0x55f9e753df20 msgr2=0x55f9e7543ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:30:54.131 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:54.123+0000 7fec6dd7c740 1 -- 172.21.15.19:0/134152153 shutdown_connections 2024-09-10T22:30:54.131 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:54.123+0000 7fec6dd7c740 1 -- 172.21.15.19:0/134152153 wait complete. 2024-09-10T22:30:54.131 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:54.123+0000 7fec6dd7c740 20 client.25690 trim_cache size 0 max 16384 2024-09-10T22:30:54.139 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:54.138+0000 7fec6dd7c740 1 Processor -- start 2024-09-10T22:30:54.140 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:54.138+0000 7fec6dd7c740 1 -- start start 2024-09-10T22:30:54.140 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:54.138+0000 7fec6dd7c740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55f9e75400f0 0x55f9e7558850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:30:54.140 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:54.138+0000 7fec6dd7c740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f9e7540a10 0x55f9e75448d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:30:54.140 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:54.138+0000 7fec6dd7c740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55f9e754c9a0 0x55f9e7544e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:30:54.140 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:54.138+0000 7fec6dd7c740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fec641aeb50 con 0x55f9e754c9a0 2024-09-10T22:30:54.140 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:54.138+0000 7fec6dd7c740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fec641ac420 con 0x55f9e7540a10 2024-09-10T22:30:54.140 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:54.138+0000 7fec6dd7c740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7fec641aa270 con 0x55f9e75400f0 2024-09-10T22:30:54.140 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:54.138+0000 7fec69743640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55f9e75400f0 0x55f9e7558850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:30:54.140 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:54.138+0000 7fec68f42640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f9e7540a10 0x55f9e75448d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:30:54.140 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:54.138+0000 7fec69f44640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55f9e754c9a0 0x55f9e7544e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:30:54.140 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:54.138+0000 7fec69743640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55f9e75400f0 0x55f9e7558850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.19:37076/0 (socket says 172.21.15.19:37076) 2024-09-10T22:30:54.141 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:54.138+0000 7fec69743640 1 -- 172.21.15.19:0/503948215 learned_addr learned my addr 172.21.15.19:0/503948215 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:30:54.143 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:54.139+0000 7fec68f42640 1 -- 172.21.15.19:0/503948215 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55f9e75400f0 msgr2=0x55f9e7558850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:30:54.143 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:54.139+0000 7fec68f42640 1 --2- 172.21.15.19:0/503948215 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55f9e75400f0 0x55f9e7558850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:30:54.143 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:54.139+0000 7fec68f42640 1 -- 172.21.15.19:0/503948215 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55f9e754c9a0 msgr2=0x55f9e7544e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:30:54.143 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:54.139+0000 7fec68f42640 1 --2- 172.21.15.19:0/503948215 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55f9e754c9a0 0x55f9e7544e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:30:54.143 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:54.139+0000 7fec68f42640 1 -- 172.21.15.19:0/503948215 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f9e7549f40 con 0x55f9e7540a10 2024-09-10T22:30:54.143 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:54.139+0000 7fec69f44640 1 --2- 172.21.15.19:0/503948215 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55f9e754c9a0 0x55f9e7544e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T22:30:54.143 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:54.139+0000 7fec68f42640 1 --2- 172.21.15.19:0/503948215 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f9e7540a10 0x55f9e75448d0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x55f9e755ca80 tx=0x7fec540046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f2987a9ca6d551b7 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:30:54.143 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:54.139+0000 7fec4effd640 1 -- 172.21.15.19:0/503948215 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec54010e90 con 0x55f9e7540a10 2024-09-10T22:30:54.144 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:54.139+0000 7fec4effd640 1 -- 172.21.15.19:0/503948215 <== mon.2 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fec540054d0 con 0x55f9e7540a10 2024-09-10T22:30:54.144 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:54.139+0000 7fec4effd640 1 -- 172.21.15.19:0/503948215 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec5402c470 con 0x55f9e7540a10 2024-09-10T22:30:54.144 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:54.140+0000 7fec6dd7c740 1 -- 172.21.15.19:0/503948215 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f9e7540a10 msgr2=0x55f9e75448d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:30:54.144 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:54.140+0000 7fec6dd7c740 1 --2- 172.21.15.19:0/503948215 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f9e7540a10 0x55f9e75448d0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x55f9e755ca80 tx=0x7fec540046c0 comp rx=0 tx=0).stop 2024-09-10T22:30:54.144 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:54.140+0000 7fec6dd7c740 1 -- 172.21.15.19:0/503948215 shutdown_connections 2024-09-10T22:30:54.144 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:54.140+0000 7fec6dd7c740 1 --2- 172.21.15.19:0/503948215 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55f9e754c9a0 0x55f9e7544e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:30:54.144 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:54.140+0000 7fec6dd7c740 1 --2- 172.21.15.19:0/503948215 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f9e7540a10 0x55f9e75448d0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:30:54.144 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:54.140+0000 7fec6dd7c740 1 --2- 172.21.15.19:0/503948215 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55f9e75400f0 0x55f9e7558850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:30:54.144 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:54.140+0000 7fec6dd7c740 1 -- 172.21.15.19:0/503948215 >> 172.21.15.19:0/503948215 conn(0x55f9e753df20 msgr2=0x55f9e7549400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:30:54.144 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:54.140+0000 7fec6dd7c740 1 -- 172.21.15.19:0/503948215 shutdown_connections 2024-09-10T22:30:54.144 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:54.140+0000 7fec6dd7c740 1 -- 172.21.15.19:0/503948215 wait complete. 2024-09-10T22:30:54.144 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:54.141+0000 7fec6dd7c740 1 -- start start 2024-09-10T22:30:54.144 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:54.141+0000 7fec6dd7c740 1 Processor -- start 2024-09-10T22:30:54.145 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:54.141+0000 7fec6dd7c740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55f9e75400f0 0x55f9e754fca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:30:54.145 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:54.141+0000 7fec6dd7c740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f9e7540a10 0x55f9e75501e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:30:54.145 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:54.141+0000 7fec6dd7c740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55f9e754c9a0 0x55f9e75c7600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:30:54.145 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:54.141+0000 7fec6dd7c740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fec641aa8e0 con 0x55f9e754c9a0 2024-09-10T22:30:54.145 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:54.141+0000 7fec6dd7c740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fec641abd50 con 0x55f9e7540a10 2024-09-10T22:30:54.145 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:54.141+0000 7fec6dd7c740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7fec641aafb0 con 0x55f9e75400f0 2024-09-10T22:30:54.145 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:54.141+0000 7fec6dd7c740 10 client.0 _ll_register_callbacks cb 0x7fec54009e90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T22:30:54.145 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:54.142+0000 7fec68f42640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f9e7540a10 0x55f9e75501e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:30:54.145 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:54.142+0000 7fec68f42640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f9e7540a10 0x55f9e75501e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.19:44796/0 (socket says 172.21.15.19:44796) 2024-09-10T22:30:54.145 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:54.142+0000 7fec68f42640 1 -- 172.21.15.19:0/162026833 learned_addr learned my addr 172.21.15.19:0/162026833 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:30:54.145 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:54.142+0000 7fec69f44640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55f9e754c9a0 0x55f9e75c7600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:30:54.145 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:54.142+0000 7fec69743640 1 --2- 172.21.15.19:0/162026833 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55f9e75400f0 0x55f9e754fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:30:54.148 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:54.142+0000 7fec68f42640 1 -- 172.21.15.19:0/162026833 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55f9e75400f0 msgr2=0x55f9e754fca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:30:54.148 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:54.142+0000 7fec68f42640 1 --2- 172.21.15.19:0/162026833 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55f9e75400f0 0x55f9e754fca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:30:54.148 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:54.142+0000 7fec68f42640 1 -- 172.21.15.19:0/162026833 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55f9e754c9a0 msgr2=0x55f9e75c7600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:30:54.148 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:54.142+0000 7fec68f42640 1 --2- 172.21.15.19:0/162026833 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55f9e754c9a0 0x55f9e75c7600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:30:54.148 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:54.142+0000 7fec68f42640 1 -- 172.21.15.19:0/162026833 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f9e75c7b40 con 0x55f9e7540a10 2024-09-10T22:30:54.148 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:54.142+0000 7fec69743640 1 --2- 172.21.15.19:0/162026833 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55f9e75400f0 0x55f9e754fca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T22:30:54.148 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:54.142+0000 7fec69f44640 1 --2- 172.21.15.19:0/162026833 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55f9e754c9a0 0x55f9e75c7600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T22:30:54.148 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:54.142+0000 7fec68f42640 1 --2- 172.21.15.19:0/162026833 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f9e7540a10 0x55f9e75501e0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fec540093b0 tx=0x7fec5400dfb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1333e8dd1d2abc3b server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:30:54.149 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:54.142+0000 7fec4cff9640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-09-10T22:30:54.149 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:54.142+0000 7fec4cff9640 1 -- 172.21.15.19:0/162026833 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec54042060 con 0x55f9e7540a10 2024-09-10T22:30:54.149 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:54.143+0000 7fec4cff9640 1 -- 172.21.15.19:0/162026833 <== mon.2 v2:172.21.15.135:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8327+0+0 (secure 0 0 0) 0x7fec54005210 con 0x55f9e7540a10 2024-09-10T22:30:54.149 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:54.143+0000 7fec6dd7c740 1 -- 172.21.15.19:0/162026833 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fec540054d0 con 0x55f9e7540a10 2024-09-10T22:30:54.149 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:54.143+0000 7fec4cff9640 1 -- 172.21.15.19:0/162026833 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fec54012e10 con 0x55f9e7540a10 2024-09-10T22:30:54.149 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:54.143+0000 7fec6dd7c740 10 client.25682 fetch_fsmap learned FSMap version 27 2024-09-10T22:30:54.149 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:54.143+0000 7fec6dd7c740 1 -- 172.21.15.19:0/162026833 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55f9e75c8d80 con 0x55f9e7540a10 2024-09-10T22:30:54.149 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:54.143+0000 7fec4cff9640 1 -- 172.21.15.19:0/162026833 <== mon.2 v2:172.21.15.135:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fec540054d0 con 0x55f9e7540a10 2024-09-10T22:30:54.149 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:54.143+0000 7fec4cff9640 1 -- 172.21.15.19:0/162026833 <== mon.2 v2:172.21.15.135:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7fec54046030 con 0x55f9e7540a10 2024-09-10T22:30:54.149 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:54.143+0000 7fec6dd7c740 10 client.25682 fetch_fsmap finished waiting for FSMap version 27 2024-09-10T22:30:54.149 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:54.143+0000 7fec6dd7c740 10 client.25682 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-10T22:30:54.149 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:54.143+0000 7fec6dd7c740 20 client.25682 populate_metadata read hostname 'smithi019' 2024-09-10T22:30:54.150 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:54.143+0000 7fec6dd7c740 1 --2- 172.21.15.19:0/162026833 >> [v2:172.21.15.138:6838/383637208,v1:172.21.15.138:6839/383637208] conn(0x55f9e75c9440 0x55f9e75cb860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:30:54.150 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:54.143+0000 7fec6dd7c740 4 client.25682 mds_command: new command op to 24568 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-10T22:30:54.150 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:54.143+0000 7fec6dd7c740 1 -- 172.21.15.19:0/162026833 --> [v2:172.21.15.138:6838/383637208,v1:172.21.15.138:6839/383637208] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55f9e74b48a0 con 0x55f9e75c9440 2024-09-10T22:30:54.150 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:54.144+0000 7fec69743640 1 --2- 172.21.15.19:0/162026833 >> [v2:172.21.15.138:6838/383637208,v1:172.21.15.138:6839/383637208] conn(0x55f9e75c9440 0x55f9e75cb860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:30:54.150 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:54.144+0000 7fec69743640 1 --2- 172.21.15.19:0/162026833 >> [v2:172.21.15.138:6838/383637208,v1:172.21.15.138:6839/383637208] conn(0x55f9e75c9440 0x55f9e75cb860 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=9c8a38c6fb04aaa3 server_cookie=7bc83b243e268d44 in_seq=0 out_seq=0 2024-09-10T22:30:54.150 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:54.144+0000 7fec4cff9640 10 client.25682 ms_handle_connect on v2:172.21.15.138:6838/383637208 2024-09-10T22:30:54.150 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:54.144+0000 7fec4cff9640 1 -- 172.21.15.19:0/162026833 <== mds.1 v2:172.21.15.138:6838/383637208 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55f9e74b48a0 con 0x55f9e75c9440 2024-09-10T22:30:54.150 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:54.144+0000 7fec4cff9640 10 client.25682 handle_command_reply: tid=0 2024-09-10T22:30:54.150 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:54.144+0000 7fec6dd7c740 1 client.25682 shutdown 2024-09-10T22:30:54.150 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:54.144+0000 7fec6dd7c740 1 -- 172.21.15.19:0/162026833 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f9e7540a10 msgr2=0x55f9e75501e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:30:54.150 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:54.144+0000 7fec6dd7c740 1 --2- 172.21.15.19:0/162026833 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f9e7540a10 0x55f9e75501e0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fec540093b0 tx=0x7fec5400dfb0 comp rx=0 tx=0).stop 2024-09-10T22:30:54.150 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:54.144+0000 7fec6dd7c740 1 -- 172.21.15.19:0/162026833 shutdown_connections 2024-09-10T22:30:54.151 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:54.144+0000 7fec6dd7c740 1 --2- 172.21.15.19:0/162026833 >> [v2:172.21.15.138:6838/383637208,v1:172.21.15.138:6839/383637208] conn(0x55f9e75c9440 0x55f9e75cb860 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:30:54.151 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:54.144+0000 7fec6dd7c740 1 --2- 172.21.15.19:0/162026833 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55f9e754c9a0 0x55f9e75c7600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:30:54.151 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:54.144+0000 7fec6dd7c740 1 --2- 172.21.15.19:0/162026833 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f9e7540a10 0x55f9e75501e0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:30:54.151 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:54.144+0000 7fec6dd7c740 1 --2- 172.21.15.19:0/162026833 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55f9e75400f0 0x55f9e754fca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:30:54.151 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:54.144+0000 7fec6dd7c740 1 -- 172.21.15.19:0/162026833 >> 172.21.15.19:0/162026833 conn(0x55f9e753df20 msgr2=0x55f9e75448d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:30:54.151 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:54.144+0000 7fec4cff9640 0 client.25682 ms_handle_reset on v2:172.21.15.138:6838/383637208 2024-09-10T22:30:54.151 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:54.145+0000 7fec6dd7c740 1 -- 172.21.15.19:0/162026833 shutdown_connections 2024-09-10T22:30:54.151 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:54.145+0000 7fec6dd7c740 1 -- 172.21.15.19:0/162026833 wait complete. 2024-09-10T22:30:54.151 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:54.145+0000 7fec6dd7c740 20 client.25682 trim_cache size 0 max 16384 2024-09-10T22:30:54.151 INFO:teuthology.orchestra.run.smithi019.stdout:[] 2024-09-10T22:30:54.152 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:54.145+0000 7fec6b9a7640 1 -- 172.21.15.19:0/1661912166 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7fec500b52e0 msgr2=0x7fec500b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:30:54.152 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:54.145+0000 7fec6b9a7640 1 --2- 172.21.15.19:0/1661912166 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7fec500b52e0 0x7fec500b77a0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fec5400d5c0 tx=0x7fec54005f90 comp rx=0 tx=0).stop 2024-09-10T22:30:54.153 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:54.145+0000 7fec6b9a7640 1 -- 172.21.15.19:0/1661912166 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fec64108020 msgr2=0x7fec6419aab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:30:54.153 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:54.145+0000 7fec6b9a7640 1 --2- 172.21.15.19:0/1661912166 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fec64108020 0x7fec6419aab0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fec5c02ade0 tx=0x7fec5c031660 comp rx=0 tx=0).stop 2024-09-10T22:30:54.153 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:54.146+0000 7fec6b9a7640 1 -- 172.21.15.19:0/1661912166 shutdown_connections 2024-09-10T22:30:54.153 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:54.146+0000 7fec6b9a7640 1 --2- 172.21.15.19:0/1661912166 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7fec500b52e0 0x7fec500b77a0 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:30:54.153 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:54.146+0000 7fec6b9a7640 1 --2- 172.21.15.19:0/1661912166 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fec64108020 0x7fec6419aab0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:30:54.153 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:54.146+0000 7fec6b9a7640 1 --2- 172.21.15.19:0/1661912166 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fec641076a0 0x7fec6419a550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:30:54.153 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:54.146+0000 7fec6b9a7640 1 --2- 172.21.15.19:0/1661912166 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fec64101c90 0x7fec6419a010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:30:54.153 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:54.146+0000 7fec6b9a7640 1 -- 172.21.15.19:0/1661912166 >> 172.21.15.19:0/1661912166 conn(0x7fec640fd700 msgr2=0x7fec640ffaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:30:54.153 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:54.146+0000 7fec6b9a7640 1 -- 172.21.15.19:0/1661912166 shutdown_connections 2024-09-10T22:30:54.153 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:54.146+0000 7fec6b9a7640 1 -- 172.21.15.19:0/1661912166 wait complete. 2024-09-10T22:30:55.592 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 22997a4c-6fc2-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-10T22:30:55.912 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:30:55 smithi135 ceph-mon[34789]: pgmap v482: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 973 KiB/s rd, 325 MiB/s wr, 676 op/s 2024-09-10T22:30:55.959 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:30:55 smithi019 ceph-mon[31375]: pgmap v482: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 973 KiB/s rd, 325 MiB/s wr, 676 op/s 2024-09-10T22:30:56.031 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/22997a4c-6fc2-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T22:30:56.125 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:30:55 smithi138 ceph-mon[35236]: pgmap v482: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 973 KiB/s rd, 325 MiB/s wr, 676 op/s 2024-09-10T22:30:57.066 INFO:teuthology.orchestra.run.smithi019.stdout:[] 2024-09-10T22:30:57.067 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:57.009+0000 7ff4a99f1640 1 -- 172.21.15.19:0/1271849793 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff4a4102de0 msgr2=0x7ff4a41031c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:30:57.067 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:57.009+0000 7ff4a99f1640 1 --2- 172.21.15.19:0/1271849793 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff4a4102de0 0x7ff4a41031c0 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7ff494009900 tx=0x7ff49402a410 comp rx=0 tx=0).stop 2024-09-10T22:30:57.067 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:57.009+0000 7ff4a99f1640 1 -- 172.21.15.19:0/1271849793 shutdown_connections 2024-09-10T22:30:57.067 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:57.009+0000 7ff4a99f1640 1 --2- 172.21.15.19:0/1271849793 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff4a4109170 0x7ff4a410f970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:30:57.068 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:57.009+0000 7ff4a99f1640 1 --2- 172.21.15.19:0/1271849793 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff4a41087f0 0x7ff4a4108c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:30:57.068 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:57.009+0000 7ff4a99f1640 1 --2- 172.21.15.19:0/1271849793 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff4a4102de0 0x7ff4a41031c0 unknown :-1 s=CLOSED pgs=598 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:30:57.068 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:57.009+0000 7ff4a99f1640 1 -- 172.21.15.19:0/1271849793 >> 172.21.15.19:0/1271849793 conn(0x7ff4a40fe870 msgr2=0x7ff4a4100c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:30:57.068 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:57.009+0000 7ff4a99f1640 1 -- 172.21.15.19:0/1271849793 shutdown_connections 2024-09-10T22:30:57.068 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:57.009+0000 7ff4a99f1640 1 -- 172.21.15.19:0/1271849793 wait complete. 2024-09-10T22:30:57.068 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:57.010+0000 7ff4a99f1640 1 Processor -- start 2024-09-10T22:30:57.068 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:57.010+0000 7ff4a99f1640 1 -- start start 2024-09-10T22:30:57.068 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:57.011+0000 7ff4a99f1640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff4a4102de0 0x7ff4a4199330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:30:57.068 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:57.011+0000 7ff4a99f1640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff4a41087f0 0x7ff4a4199870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:30:57.068 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:57.011+0000 7ff4a99f1640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff4a4109170 0x7ff4a419ec10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:30:57.068 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:57.011+0000 7ff4a99f1640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7ff4a4112e80 con 0x7ff4a4102de0 2024-09-10T22:30:57.069 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:57.011+0000 7ff4a99f1640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7ff4a4112d00 con 0x7ff4a41087f0 2024-09-10T22:30:57.069 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:57.011+0000 7ff4a99f1640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7ff4a4113000 con 0x7ff4a4109170 2024-09-10T22:30:57.069 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:57.011+0000 7ff4a2ffd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff4a4102de0 0x7ff4a4199330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:30:57.069 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:57.011+0000 7ff49bfff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff4a41087f0 0x7ff4a4199870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:30:57.069 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:57.011+0000 7ff4a2ffd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff4a4102de0 0x7ff4a4199330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:50132/0 (socket says 172.21.15.19:50132) 2024-09-10T22:30:57.069 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:57.011+0000 7ff4a2ffd640 1 -- 172.21.15.19:0/241035020 learned_addr learned my addr 172.21.15.19:0/241035020 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:30:57.069 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:57.011+0000 7ff4a37fe640 1 --2- 172.21.15.19:0/241035020 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff4a4109170 0x7ff4a419ec10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:30:57.069 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:57.011+0000 7ff49bfff640 1 -- 172.21.15.19:0/241035020 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff4a4109170 msgr2=0x7ff4a419ec10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:30:57.069 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:57.011+0000 7ff49bfff640 1 --2- 172.21.15.19:0/241035020 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff4a4109170 0x7ff4a419ec10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:30:57.069 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:57.011+0000 7ff49bfff640 1 -- 172.21.15.19:0/241035020 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff4a4102de0 msgr2=0x7ff4a4199330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:30:57.070 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:57.011+0000 7ff49bfff640 1 --2- 172.21.15.19:0/241035020 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff4a4102de0 0x7ff4a4199330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:30:57.070 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:57.011+0000 7ff49bfff640 1 -- 172.21.15.19:0/241035020 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff4a419f3e0 con 0x7ff4a41087f0 2024-09-10T22:30:57.070 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:57.011+0000 7ff49bfff640 1 --2- 172.21.15.19:0/241035020 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff4a41087f0 0x7ff4a4199870 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7ff48c00e9f0 tx=0x7ff48c00edf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:30:57.070 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:57.012+0000 7ff4a89ef640 1 -- 172.21.15.19:0/241035020 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff48c00ccc0 con 0x7ff4a41087f0 2024-09-10T22:30:57.070 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:57.012+0000 7ff4a89ef640 1 -- 172.21.15.19:0/241035020 <== mon.2 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff48c0108e0 con 0x7ff4a41087f0 2024-09-10T22:30:57.070 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:57.012+0000 7ff4a89ef640 1 -- 172.21.15.19:0/241035020 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff48c018840 con 0x7ff4a41087f0 2024-09-10T22:30:57.070 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:57.012+0000 7ff4a99f1640 1 -- 172.21.15.19:0/241035020 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff4a419f6d0 con 0x7ff4a41087f0 2024-09-10T22:30:57.070 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:57.012+0000 7ff4a99f1640 1 -- 172.21.15.19:0/241035020 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff4a41a5d90 con 0x7ff4a41087f0 2024-09-10T22:30:57.070 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:57.014+0000 7ff4a89ef640 1 -- 172.21.15.19:0/241035020 <== mon.2 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 18) ==== 153250+0+0 (secure 0 0 0) 0x7ff48c010430 con 0x7ff4a41087f0 2024-09-10T22:30:57.070 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:57.015+0000 7ff4abdc6740 1 Processor -- start 2024-09-10T22:30:57.070 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:57.015+0000 7ff4abdc6740 1 -- start start 2024-09-10T22:30:57.070 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:57.015+0000 7ff4abdc6740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55bf35ab40f0 0x55bf35ab44d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:30:57.070 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:57.015+0000 7ff4abdc6740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55bf35ab4a10 0x55bf35ac4870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:30:57.071 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:57.015+0000 7ff4abdc6740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55bf35ac4db0 0x55bf35ac71a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:30:57.071 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:57.015+0000 7ff4abdc6740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x55bf35a2aea0 con 0x55bf35ab4a10 2024-09-10T22:30:57.071 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:57.015+0000 7ff4abdc6740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55bf35a1a2d0 con 0x55bf35ac4db0 2024-09-10T22:30:57.071 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:57.015+0000 7ff4abdc6740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x55bf35a1e0e0 con 0x55bf35ab40f0 2024-09-10T22:30:57.071 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:57.015+0000 7ff4a2ffd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55bf35ab4a10 0x55bf35ac4870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:30:57.071 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:57.015+0000 7ff4a2ffd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55bf35ab4a10 0x55bf35ac4870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:50140/0 (socket says 172.21.15.19:50140) 2024-09-10T22:30:57.071 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:57.015+0000 7ff4a2ffd640 1 -- 172.21.15.19:0/1113982190 learned_addr learned my addr 172.21.15.19:0/1113982190 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:30:57.071 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:57.015+0000 7ff4a37fe640 1 --2- 172.21.15.19:0/1113982190 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55bf35ab40f0 0x55bf35ab44d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:30:57.071 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:57.015+0000 7ff4a89ef640 1 --2- 172.21.15.19:0/241035020 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7ff4900b5360 0x7ff4900b7820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:30:57.071 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:57.016+0000 7ff4a37fe640 1 --2- 172.21.15.19:0/241035020 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7ff4900b5360 0x7ff4900b7820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:30:57.071 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:57.016+0000 7ff49bfff640 1 --2- 172.21.15.19:0/1113982190 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55bf35ac4db0 0x55bf35ac71a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:30:57.071 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:57.016+0000 7ff4a89ef640 1 -- 172.21.15.19:0/241035020 <== mon.2 v2:172.21.15.135:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8327+0+0 (secure 0 0 0) 0x7ff48c0e5e00 con 0x7ff4a41087f0 2024-09-10T22:30:57.072 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:57.016+0000 7ff4a37fe640 1 -- 172.21.15.19:0/1113982190 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55bf35ac4db0 msgr2=0x55bf35ac71a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:30:57.072 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:57.016+0000 7ff4a37fe640 1 --2- 172.21.15.19:0/1113982190 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55bf35ac4db0 0x55bf35ac71a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:30:57.072 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:57.016+0000 7ff4a37fe640 1 -- 172.21.15.19:0/1113982190 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55bf35ab4a10 msgr2=0x55bf35ac4870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:30:57.072 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:57.016+0000 7ff4a37fe640 1 --2- 172.21.15.19:0/1113982190 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55bf35ab4a10 0x55bf35ac4870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:30:57.072 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:57.016+0000 7ff4a37fe640 1 -- 172.21.15.19:0/1113982190 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bf35778650 con 0x55bf35ab40f0 2024-09-10T22:30:57.072 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:57.016+0000 7ff4a2ffd640 1 --2- 172.21.15.19:0/1113982190 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55bf35ab4a10 0x55bf35ac4870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T22:30:57.072 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:57.016+0000 7ff49bfff640 1 --2- 172.21.15.19:0/1113982190 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55bf35ac4db0 0x55bf35ac71a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T22:30:57.072 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:57.016+0000 7ff4a37fe640 1 --2- 172.21.15.19:0/1113982190 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55bf35ab40f0 0x55bf35ab44d0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7ff49c013630 tx=0x7ff49c013af0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1ffaf22a2876223e server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:30:57.072 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:57.017+0000 7ff499ffb640 1 -- 172.21.15.19:0/1113982190 <== mon.1 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff49c0120d0 con 0x55bf35ab40f0 2024-09-10T22:30:57.072 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:57.017+0000 7ff4a37fe640 1 --2- 172.21.15.19:0/241035020 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7ff4900b5360 0x7ff4900b7820 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7ff49c023000 tx=0x7ff49c020000 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:30:57.072 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:57.017+0000 7ff499ffb640 1 -- 172.21.15.19:0/1113982190 <== mon.1 v2:172.21.15.138:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff49c012270 con 0x55bf35ab40f0 2024-09-10T22:30:57.072 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:57.017+0000 7ff499ffb640 1 -- 172.21.15.19:0/1113982190 <== mon.1 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff49c010870 con 0x55bf35ab40f0 2024-09-10T22:30:57.073 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:57.018+0000 7ff4abdc6740 1 -- 172.21.15.19:0/1113982190 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55bf35ab40f0 msgr2=0x55bf35ab44d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:30:57.073 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:57.018+0000 7ff4abdc6740 1 --2- 172.21.15.19:0/1113982190 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55bf35ab40f0 0x55bf35ab44d0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7ff49c013630 tx=0x7ff49c013af0 comp rx=0 tx=0).stop 2024-09-10T22:30:57.073 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:57.018+0000 7ff4abdc6740 1 -- 172.21.15.19:0/1113982190 shutdown_connections 2024-09-10T22:30:57.073 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:57.018+0000 7ff4abdc6740 1 --2- 172.21.15.19:0/1113982190 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55bf35ac4db0 0x55bf35ac71a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:30:57.073 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:57.018+0000 7ff4abdc6740 1 --2- 172.21.15.19:0/1113982190 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55bf35ab4a10 0x55bf35ac4870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:30:57.073 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:57.018+0000 7ff4abdc6740 1 --2- 172.21.15.19:0/1113982190 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55bf35ab40f0 0x55bf35ab44d0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:30:57.073 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:57.018+0000 7ff4abdc6740 1 -- 172.21.15.19:0/1113982190 >> 172.21.15.19:0/1113982190 conn(0x55bf35ab1f20 msgr2=0x55bf35ab30c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:30:57.073 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:57.018+0000 7ff4abdc6740 1 -- 172.21.15.19:0/1113982190 shutdown_connections 2024-09-10T22:30:57.073 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:57.018+0000 7ff4abdc6740 1 -- 172.21.15.19:0/1113982190 wait complete. 2024-09-10T22:30:57.074 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:57.018+0000 7ff4abdc6740 1 -- start start 2024-09-10T22:30:57.074 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:57.018+0000 7ff4abdc6740 1 Processor -- start 2024-09-10T22:30:57.074 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:57.019+0000 7ff4abdc6740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55bf35ab40f0 0x55bf35ac4710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:30:57.074 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:57.019+0000 7ff4abdc6740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55bf35ab4a10 0x55bf35ac1b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:30:57.074 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:57.019+0000 7ff4abdc6740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55bf35ac4db0 0x55bf35ac21e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:30:57.074 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:57.019+0000 7ff4abdc6740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x55bf3587b700 con 0x55bf35ab4a10 2024-09-10T22:30:57.074 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:57.019+0000 7ff4abdc6740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55bf359b5160 con 0x55bf35ab40f0 2024-09-10T22:30:57.074 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:57.019+0000 7ff4abdc6740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x55bf35ac7a60 con 0x55bf35ac4db0 2024-09-10T22:30:57.074 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:57.019+0000 7ff4abdc6740 10 client.0 _ll_register_callbacks cb 0x55bf359ce9e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T22:30:57.074 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:57.019+0000 7ff4a2ffd640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55bf35ab40f0 0x55bf35ac4710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:30:57.074 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:57.019+0000 7ff4a2ffd640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55bf35ab40f0 0x55bf35ac4710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.19:44846/0 (socket says 172.21.15.19:44846) 2024-09-10T22:30:57.074 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:57.019+0000 7ff4a2ffd640 1 -- 172.21.15.19:0/2278151145 learned_addr learned my addr 172.21.15.19:0/2278151145 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:30:57.074 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:57.019+0000 7ff4a37fe640 1 --2- 172.21.15.19:0/2278151145 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55bf35ac4db0 0x55bf35ac21e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:30:57.075 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:57.019+0000 7ff49bfff640 1 --2- 172.21.15.19:0/2278151145 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55bf35ab4a10 0x55bf35ac1b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:30:57.075 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:57.019+0000 7ff4a37fe640 1 -- 172.21.15.19:0/2278151145 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55bf35ab40f0 msgr2=0x55bf35ac4710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:30:57.075 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:57.019+0000 7ff4a37fe640 1 --2- 172.21.15.19:0/2278151145 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55bf35ab40f0 0x55bf35ac4710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:30:57.075 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:57.019+0000 7ff4a37fe640 1 -- 172.21.15.19:0/2278151145 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55bf35ab4a10 msgr2=0x55bf35ac1b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:30:57.075 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:57.019+0000 7ff4a37fe640 1 --2- 172.21.15.19:0/2278151145 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55bf35ab4a10 0x55bf35ac1b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:30:57.075 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:57.019+0000 7ff4a37fe640 1 -- 172.21.15.19:0/2278151145 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bf359e2c90 con 0x55bf35ac4db0 2024-09-10T22:30:57.075 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:57.019+0000 7ff49bfff640 1 --2- 172.21.15.19:0/2278151145 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55bf35ab4a10 0x55bf35ac1b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T22:30:57.075 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:57.019+0000 7ff4a2ffd640 1 --2- 172.21.15.19:0/2278151145 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55bf35ab40f0 0x55bf35ac4710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T22:30:57.075 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:57.020+0000 7ff4a37fe640 1 --2- 172.21.15.19:0/2278151145 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55bf35ac4db0 0x55bf35ac21e0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7ff49c013630 tx=0x7ff49c00f7d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f5ac9dcbd8a8cf1b server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:30:57.075 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:57.020+0000 7ff482ffd640 10 client.0 ms_handle_connect on v2:172.21.15.138:3300/0 2024-09-10T22:30:57.075 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:57.020+0000 7ff482ffd640 1 -- 172.21.15.19:0/2278151145 <== mon.1 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff49c01c840 con 0x55bf35ac4db0 2024-09-10T22:30:57.075 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:57.020+0000 7ff482ffd640 1 -- 172.21.15.19:0/2278151145 <== mon.1 v2:172.21.15.138:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8327+0+0 (secure 0 0 0) 0x7ff49c01c9e0 con 0x55bf35ac4db0 2024-09-10T22:30:57.076 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:57.020+0000 7ff4abdc6740 1 -- 172.21.15.19:0/2278151145 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff49c012270 con 0x55bf35ac4db0 2024-09-10T22:30:57.076 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:57.020+0000 7ff482ffd640 1 -- 172.21.15.19:0/2278151145 <== mon.1 v2:172.21.15.138:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7ff49c01cbe0 con 0x55bf35ac4db0 2024-09-10T22:30:57.076 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:57.020+0000 7ff4abdc6740 10 client.25708 fetch_fsmap learned FSMap version 27 2024-09-10T22:30:57.076 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:57.020+0000 7ff4abdc6740 1 -- 172.21.15.19:0/2278151145 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55bf35ad3370 con 0x55bf35ac4db0 2024-09-10T22:30:57.076 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:57.020+0000 7ff482ffd640 1 -- 172.21.15.19:0/2278151145 <== mon.1 v2:172.21.15.138:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff49c012270 con 0x55bf35ac4db0 2024-09-10T22:30:57.076 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:57.020+0000 7ff482ffd640 1 -- 172.21.15.19:0/2278151145 <== mon.1 v2:172.21.15.138:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7ff49c02e020 con 0x55bf35ac4db0 2024-09-10T22:30:57.076 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:57.021+0000 7ff4abdc6740 10 client.25708 fetch_fsmap finished waiting for FSMap version 27 2024-09-10T22:30:57.076 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:57.021+0000 7ff4abdc6740 10 client.25708 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-10T22:30:57.076 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:57.021+0000 7ff4abdc6740 20 client.25708 populate_metadata read hostname 'smithi019' 2024-09-10T22:30:57.076 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:57.021+0000 7ff4abdc6740 1 --2- 172.21.15.19:0/2278151145 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x55bf35ad4770 0x55bf35ad6b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:30:57.076 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:57.021+0000 7ff4abdc6740 4 client.25708 mds_command: new command op to 24581 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T22:30:57.076 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:57.021+0000 7ff4abdc6740 1 -- 172.21.15.19:0/2278151145 --> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55bf35a2cdf0 con 0x55bf35ad4770 2024-09-10T22:30:57.076 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:57.021+0000 7ff4a2ffd640 1 --2- 172.21.15.19:0/2278151145 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x55bf35ad4770 0x55bf35ad6b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:30:57.077 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:57.021+0000 7ff482ffd640 10 client.25708 ms_handle_connect on v2:172.21.15.135:6838/1254769802 2024-09-10T22:30:57.077 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:57.021+0000 7ff4a2ffd640 1 --2- 172.21.15.19:0/2278151145 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x55bf35ad4770 0x55bf35ad6b60 crc :-1 s=READY pgs=106 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=76aeb5bfb5838b7c server_cookie=e3d01008525c7620 in_seq=0 out_seq=0 2024-09-10T22:30:57.077 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:57.022+0000 7ff482ffd640 1 -- 172.21.15.19:0/2278151145 <== mds.0 v2:172.21.15.135:6838/1254769802 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55bf35a2cdf0 con 0x55bf35ad4770 2024-09-10T22:30:57.077 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:57.022+0000 7ff482ffd640 10 client.25708 handle_command_reply: tid=0 2024-09-10T22:30:57.077 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:57.022+0000 7ff4abdc6740 1 client.25708 shutdown 2024-09-10T22:30:57.077 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:57.023+0000 7ff4abdc6740 1 -- 172.21.15.19:0/2278151145 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55bf35ac4db0 msgr2=0x55bf35ac21e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:30:57.077 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:57.023+0000 7ff4abdc6740 1 --2- 172.21.15.19:0/2278151145 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55bf35ac4db0 0x55bf35ac21e0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7ff49c013630 tx=0x7ff49c00f7d0 comp rx=0 tx=0).stop 2024-09-10T22:30:57.077 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:57.023+0000 7ff4abdc6740 1 -- 172.21.15.19:0/2278151145 shutdown_connections 2024-09-10T22:30:57.077 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:57.023+0000 7ff4abdc6740 1 --2- 172.21.15.19:0/2278151145 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x55bf35ad4770 0x55bf35ad6b60 crc :-1 s=READY pgs=106 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:30:57.077 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:57.023+0000 7ff4abdc6740 1 --2- 172.21.15.19:0/2278151145 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55bf35ac4db0 0x55bf35ac21e0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:30:57.077 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:57.023+0000 7ff482ffd640 0 client.25708 ms_handle_reset on v2:172.21.15.135:6838/1254769802 2024-09-10T22:30:57.077 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:57.023+0000 7ff4abdc6740 1 --2- 172.21.15.19:0/2278151145 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55bf35ab4a10 0x55bf35ac1b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:30:57.077 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:57.023+0000 7ff4abdc6740 1 --2- 172.21.15.19:0/2278151145 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55bf35ab40f0 0x55bf35ac4710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:30:57.078 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:57.023+0000 7ff4abdc6740 1 -- 172.21.15.19:0/2278151145 >> 172.21.15.19:0/2278151145 conn(0x55bf35ab1f20 msgr2=0x55bf35ab7ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:30:57.078 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:57.023+0000 7ff4abdc6740 1 -- 172.21.15.19:0/2278151145 shutdown_connections 2024-09-10T22:30:57.078 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:57.023+0000 7ff4abdc6740 1 -- 172.21.15.19:0/2278151145 wait complete. 2024-09-10T22:30:57.078 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:57.023+0000 7ff4abdc6740 20 client.25708 trim_cache size 0 max 16384 2024-09-10T22:30:57.078 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:57.037+0000 7ff4abdc6740 1 Processor -- start 2024-09-10T22:30:57.078 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:57.037+0000 7ff4abdc6740 1 -- start start 2024-09-10T22:30:57.078 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:57.037+0000 7ff4abdc6740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55bf35ab40f0 0x55bf35ad0c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:30:57.078 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:57.037+0000 7ff4abdc6740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55bf35ab4a10 0x55bf35aace70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:30:57.078 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:57.037+0000 7ff4abdc6740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55bf35ac4db0 0x55bf35adc320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:30:57.078 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:57.037+0000 7ff4abdc6740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7ff4a41aed50 con 0x55bf35ac4db0 2024-09-10T22:30:57.078 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:57.037+0000 7ff4abdc6740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7ff4a41ac620 con 0x55bf35ab40f0 2024-09-10T22:30:57.078 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:57.037+0000 7ff4abdc6740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7ff4a41aa470 con 0x55bf35ab4a10 2024-09-10T22:30:57.078 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:57.037+0000 7ff4a37fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55bf35ac4db0 0x55bf35adc320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:30:57.079 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:57.037+0000 7ff4a37fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55bf35ac4db0 0x55bf35adc320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:50164/0 (socket says 172.21.15.19:50164) 2024-09-10T22:30:57.079 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:57.037+0000 7ff4a37fe640 1 -- 172.21.15.19:0/4160774457 learned_addr learned my addr 172.21.15.19:0/4160774457 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:30:57.079 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:57.037+0000 7ff4a2ffd640 1 --2- 172.21.15.19:0/4160774457 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55bf35ab40f0 0x55bf35ad0c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:30:57.079 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:57.037+0000 7ff49bfff640 1 --2- 172.21.15.19:0/4160774457 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55bf35ab4a10 0x55bf35aace70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:30:57.079 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:57.038+0000 7ff4a2ffd640 1 -- 172.21.15.19:0/4160774457 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55bf35ab4a10 msgr2=0x55bf35aace70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:30:57.079 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:57.038+0000 7ff4a2ffd640 1 --2- 172.21.15.19:0/4160774457 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55bf35ab4a10 0x55bf35aace70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:30:57.079 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:57.038+0000 7ff4a2ffd640 1 -- 172.21.15.19:0/4160774457 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55bf35ac4db0 msgr2=0x55bf35adc320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:30:57.079 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:57.038+0000 7ff4a2ffd640 1 --2- 172.21.15.19:0/4160774457 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55bf35ac4db0 0x55bf35adc320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:30:57.079 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:57.038+0000 7ff4a2ffd640 1 -- 172.21.15.19:0/4160774457 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bf35ac64a0 con 0x55bf35ab40f0 2024-09-10T22:30:57.079 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:57.038+0000 7ff49bfff640 1 --2- 172.21.15.19:0/4160774457 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55bf35ab4a10 0x55bf35aace70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T22:30:57.079 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:57.038+0000 7ff4a37fe640 1 --2- 172.21.15.19:0/4160774457 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55bf35ac4db0 0x55bf35adc320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T22:30:57.079 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:57.038+0000 7ff4a2ffd640 1 --2- 172.21.15.19:0/4160774457 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55bf35ab40f0 0x55bf35ad0c80 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x55bf35ad72c0 tx=0x7ff49402a9b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e44a6d681383945e server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:30:57.079 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:57.038+0000 7ff4997fa640 1 -- 172.21.15.19:0/4160774457 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff494035040 con 0x55bf35ab40f0 2024-09-10T22:30:57.080 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:57.038+0000 7ff4997fa640 1 -- 172.21.15.19:0/4160774457 <== mon.2 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff4940047a0 con 0x55bf35ab40f0 2024-09-10T22:30:57.080 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:57.038+0000 7ff4997fa640 1 -- 172.21.15.19:0/4160774457 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff494003970 con 0x55bf35ab40f0 2024-09-10T22:30:57.080 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:57.039+0000 7ff4abdc6740 1 -- 172.21.15.19:0/4160774457 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55bf35ab40f0 msgr2=0x55bf35ad0c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:30:57.080 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:57.039+0000 7ff4abdc6740 1 --2- 172.21.15.19:0/4160774457 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55bf35ab40f0 0x55bf35ad0c80 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x55bf35ad72c0 tx=0x7ff49402a9b0 comp rx=0 tx=0).stop 2024-09-10T22:30:57.080 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:57.039+0000 7ff4abdc6740 1 -- 172.21.15.19:0/4160774457 shutdown_connections 2024-09-10T22:30:57.080 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:57.039+0000 7ff4abdc6740 1 --2- 172.21.15.19:0/4160774457 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55bf35ac4db0 0x55bf35adc320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:30:57.080 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:57.039+0000 7ff4abdc6740 1 --2- 172.21.15.19:0/4160774457 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55bf35ab4a10 0x55bf35aace70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:30:57.080 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:57.039+0000 7ff4abdc6740 1 --2- 172.21.15.19:0/4160774457 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55bf35ab40f0 0x55bf35ad0c80 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:30:57.080 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:57.039+0000 7ff4abdc6740 1 -- 172.21.15.19:0/4160774457 >> 172.21.15.19:0/4160774457 conn(0x55bf35ab1f20 msgr2=0x55bf35ab3050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:30:57.080 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:57.039+0000 7ff4abdc6740 1 -- 172.21.15.19:0/4160774457 shutdown_connections 2024-09-10T22:30:57.080 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:57.039+0000 7ff4abdc6740 1 -- 172.21.15.19:0/4160774457 wait complete. 2024-09-10T22:30:57.080 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:57.040+0000 7ff4abdc6740 1 -- start start 2024-09-10T22:30:57.080 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:57.040+0000 7ff4abdc6740 1 Processor -- start 2024-09-10T22:30:57.081 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:57.040+0000 7ff4abdc6740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55bf35ab40f0 0x55bf35accec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:30:57.081 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:57.040+0000 7ff4abdc6740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55bf35ab4a10 0x55bf35acd420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:30:57.081 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:57.040+0000 7ff4abdc6740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55bf35ac4db0 0x55bf35ac9cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:30:57.081 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:57.040+0000 7ff4abdc6740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7ff4a41aaae0 con 0x55bf35ac4db0 2024-09-10T22:30:57.081 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:57.040+0000 7ff4abdc6740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7ff4a41abf50 con 0x55bf35ab40f0 2024-09-10T22:30:57.081 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:57.040+0000 7ff4abdc6740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7ff4a41ab1b0 con 0x55bf35ab4a10 2024-09-10T22:30:57.081 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:57.040+0000 7ff4abdc6740 10 client.0 _ll_register_callbacks cb 0x7ff49c0093a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T22:30:57.081 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:57.040+0000 7ff49bfff640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55bf35ab4a10 0x55bf35acd420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:30:57.081 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:57.040+0000 7ff4a2ffd640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55bf35ab40f0 0x55bf35accec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:30:57.081 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:57.040+0000 7ff49bfff640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55bf35ab4a10 0x55bf35acd420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.19:37160/0 (socket says 172.21.15.19:37160) 2024-09-10T22:30:57.081 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:57.040+0000 7ff4a37fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55bf35ac4db0 0x55bf35ac9cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:30:57.081 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:57.040+0000 7ff49bfff640 1 -- 172.21.15.19:0/1826844756 learned_addr learned my addr 172.21.15.19:0/1826844756 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:30:57.081 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:57.041+0000 7ff49bfff640 1 -- 172.21.15.19:0/1826844756 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55bf35ab40f0 msgr2=0x55bf35accec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:30:57.082 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:57.041+0000 7ff49bfff640 1 --2- 172.21.15.19:0/1826844756 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55bf35ab40f0 0x55bf35accec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:30:57.082 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:57.041+0000 7ff49bfff640 1 -- 172.21.15.19:0/1826844756 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55bf35ac4db0 msgr2=0x55bf35ac9cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:30:57.082 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:57.041+0000 7ff49bfff640 1 --2- 172.21.15.19:0/1826844756 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55bf35ac4db0 0x55bf35ac9cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:30:57.082 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:57.041+0000 7ff49bfff640 1 -- 172.21.15.19:0/1826844756 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bf35aca440 con 0x55bf35ab4a10 2024-09-10T22:30:57.082 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:57.041+0000 7ff49bfff640 1 --2- 172.21.15.19:0/1826844756 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55bf35ab4a10 0x55bf35acd420 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7ff48c0ac260 tx=0x7ff48c0abd50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=608663562baf641d server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:30:57.082 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:57.041+0000 7ff482ffd640 10 client.0 ms_handle_connect on v2:172.21.15.138:3300/0 2024-09-10T22:30:57.082 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:57.041+0000 7ff482ffd640 1 -- 172.21.15.19:0/1826844756 <== mon.1 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff48c026040 con 0x55bf35ab4a10 2024-09-10T22:30:57.082 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:57.041+0000 7ff482ffd640 1 -- 172.21.15.19:0/1826844756 <== mon.1 v2:172.21.15.138:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8327+0+0 (secure 0 0 0) 0x7ff48c0775a0 con 0x55bf35ab4a10 2024-09-10T22:30:57.082 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:57.041+0000 7ff4abdc6740 1 -- 172.21.15.19:0/1826844756 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff4940047a0 con 0x55bf35ab4a10 2024-09-10T22:30:57.082 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:57.041+0000 7ff482ffd640 1 -- 172.21.15.19:0/1826844756 <== mon.1 v2:172.21.15.138:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7ff48c0acc60 con 0x55bf35ab4a10 2024-09-10T22:30:57.082 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:57.041+0000 7ff4abdc6740 10 client.25714 fetch_fsmap learned FSMap version 27 2024-09-10T22:30:57.082 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:57.041+0000 7ff4abdc6740 1 -- 172.21.15.19:0/1826844756 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55bf35b42010 con 0x55bf35ab4a10 2024-09-10T22:30:57.082 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:57.042+0000 7ff482ffd640 1 -- 172.21.15.19:0/1826844756 <== mon.1 v2:172.21.15.138:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff4940047a0 con 0x55bf35ab4a10 2024-09-10T22:30:57.082 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:57.042+0000 7ff482ffd640 1 -- 172.21.15.19:0/1826844756 <== mon.1 v2:172.21.15.138:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7ff48c0a7eb0 con 0x55bf35ab4a10 2024-09-10T22:30:57.083 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:57.042+0000 7ff4abdc6740 10 client.25714 fetch_fsmap finished waiting for FSMap version 27 2024-09-10T22:30:57.083 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:57.042+0000 7ff4abdc6740 10 client.25714 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-10T22:30:57.083 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:57.042+0000 7ff4abdc6740 20 client.25714 populate_metadata read hostname 'smithi019' 2024-09-10T22:30:57.083 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:57.042+0000 7ff4abdc6740 1 --2- 172.21.15.19:0/1826844756 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x55bf35ad4770 0x55bf35b447d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:30:57.083 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:57.042+0000 7ff4abdc6740 4 client.25714 mds_command: new command op to 24581 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-10T22:30:57.083 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:57.042+0000 7ff4abdc6740 1 -- 172.21.15.19:0/1826844756 --> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55bf35a288a0 con 0x55bf35ad4770 2024-09-10T22:30:57.083 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:57.042+0000 7ff4a2ffd640 1 --2- 172.21.15.19:0/1826844756 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x55bf35ad4770 0x55bf35b447d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:30:57.083 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:57.042+0000 7ff482ffd640 10 client.25714 ms_handle_connect on v2:172.21.15.135:6838/1254769802 2024-09-10T22:30:57.083 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:57.043+0000 7ff4a2ffd640 1 --2- 172.21.15.19:0/1826844756 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x55bf35ad4770 0x55bf35b447d0 crc :-1 s=READY pgs=107 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a69f6ca0beae3fff server_cookie=cd16521db47c37e2 in_seq=0 out_seq=0 2024-09-10T22:30:57.083 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:57.043+0000 7ff482ffd640 1 -- 172.21.15.19:0/1826844756 <== mds.0 v2:172.21.15.135:6838/1254769802 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55bf35a288a0 con 0x55bf35ad4770 2024-09-10T22:30:57.083 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:57.043+0000 7ff482ffd640 10 client.25714 handle_command_reply: tid=0 2024-09-10T22:30:57.083 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:57.043+0000 7ff4abdc6740 1 client.25714 shutdown 2024-09-10T22:30:57.083 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:57.043+0000 7ff4abdc6740 1 -- 172.21.15.19:0/1826844756 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55bf35ab4a10 msgr2=0x55bf35acd420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:30:57.084 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:57.043+0000 7ff4abdc6740 1 --2- 172.21.15.19:0/1826844756 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55bf35ab4a10 0x55bf35acd420 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7ff48c0ac260 tx=0x7ff48c0abd50 comp rx=0 tx=0).stop 2024-09-10T22:30:57.084 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:57.043+0000 7ff4abdc6740 1 -- 172.21.15.19:0/1826844756 shutdown_connections 2024-09-10T22:30:57.084 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:57.043+0000 7ff4abdc6740 1 --2- 172.21.15.19:0/1826844756 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55bf35ac4db0 0x55bf35ac9cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:30:57.084 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:57.043+0000 7ff4abdc6740 1 --2- 172.21.15.19:0/1826844756 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x55bf35ad4770 0x55bf35b447d0 crc :-1 s=READY pgs=107 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:30:57.084 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:57.043+0000 7ff4abdc6740 1 --2- 172.21.15.19:0/1826844756 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55bf35ab4a10 0x55bf35acd420 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:30:57.084 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:57.043+0000 7ff4abdc6740 1 --2- 172.21.15.19:0/1826844756 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55bf35ab40f0 0x55bf35accec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:30:57.084 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:57.043+0000 7ff482ffd640 0 client.25714 ms_handle_reset on v2:172.21.15.135:6838/1254769802 2024-09-10T22:30:57.084 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:57.043+0000 7ff4abdc6740 1 -- 172.21.15.19:0/1826844756 >> 172.21.15.19:0/1826844756 conn(0x55bf35ab1f20 msgr2=0x55bf35ac3190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:30:57.084 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:57.043+0000 7ff4abdc6740 1 -- 172.21.15.19:0/1826844756 shutdown_connections 2024-09-10T22:30:57.084 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:57.043+0000 7ff4abdc6740 1 -- 172.21.15.19:0/1826844756 wait complete. 2024-09-10T22:30:57.085 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:57.043+0000 7ff4abdc6740 20 client.25714 trim_cache size 0 max 16384 2024-09-10T22:30:57.085 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:57.044+0000 7ff4a99f1640 1 -- 172.21.15.19:0/241035020 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7ff4900b5360 msgr2=0x7ff4900b7820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:30:57.085 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:57.044+0000 7ff4a99f1640 1 --2- 172.21.15.19:0/241035020 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7ff4900b5360 0x7ff4900b7820 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7ff49c023000 tx=0x7ff49c020000 comp rx=0 tx=0).stop 2024-09-10T22:30:57.085 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:57.044+0000 7ff4a99f1640 1 -- 172.21.15.19:0/241035020 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff4a41087f0 msgr2=0x7ff4a4199870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:30:57.085 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:57.044+0000 7ff4a99f1640 1 --2- 172.21.15.19:0/241035020 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff4a41087f0 0x7ff4a4199870 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7ff48c00e9f0 tx=0x7ff48c00edf0 comp rx=0 tx=0).stop 2024-09-10T22:30:57.085 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:57.044+0000 7ff4a99f1640 1 -- 172.21.15.19:0/241035020 shutdown_connections 2024-09-10T22:30:57.085 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:57.044+0000 7ff4a99f1640 1 --2- 172.21.15.19:0/241035020 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7ff4900b5360 0x7ff4900b7820 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:30:57.085 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:57.044+0000 7ff4a99f1640 1 --2- 172.21.15.19:0/241035020 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff4a4109170 0x7ff4a419ec10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:30:57.085 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:57.044+0000 7ff4a99f1640 1 --2- 172.21.15.19:0/241035020 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff4a41087f0 0x7ff4a4199870 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:30:57.085 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:57.044+0000 7ff4a99f1640 1 --2- 172.21.15.19:0/241035020 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff4a4102de0 0x7ff4a4199330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:30:57.085 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:57.044+0000 7ff4a99f1640 1 -- 172.21.15.19:0/241035020 >> 172.21.15.19:0/241035020 conn(0x7ff4a40fe870 msgr2=0x7ff4a4100080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:30:57.085 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:57.044+0000 7ff4a99f1640 1 -- 172.21.15.19:0/241035020 shutdown_connections 2024-09-10T22:30:57.085 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:30:57.044+0000 7ff4a99f1640 1 -- 172.21.15.19:0/241035020 wait complete. 2024-09-10T22:30:57.958 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:30:57 smithi019 ceph-mon[31375]: pgmap v483: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 974 KiB/s rd, 364 MiB/s wr, 674 op/s 2024-09-10T22:30:58.109 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:30:57 smithi135 ceph-mon[34789]: pgmap v483: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 974 KiB/s rd, 364 MiB/s wr, 674 op/s 2024-09-10T22:30:58.125 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:30:57 smithi138 ceph-mon[35236]: pgmap v483: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 974 KiB/s rd, 364 MiB/s wr, 674 op/s 2024-09-10T22:30:59.472 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-10T22:30:59.472 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 22997a4c-6fc2-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-10T22:30:59.772 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/22997a4c-6fc2-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T22:30:59.919 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:30:59 smithi019 ceph-mon[31375]: pgmap v484: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 580 KiB/s rd, 323 MiB/s wr, 472 op/s 2024-09-10T22:31:00.053 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:00.034+0000 7f7151671640 1 -- 172.21.15.19:0/58305702 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f714c105ac0 msgr2=0x7f714c107f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:31:00.053 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:00.034+0000 7f7151671640 1 --2- 172.21.15.19:0/58305702 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f714c105ac0 0x7f714c107f50 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7f7134009900 tx=0x7f713402a410 comp rx=0 tx=0).stop 2024-09-10T22:31:00.053 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:00.034+0000 7f7151671640 1 -- 172.21.15.19:0/58305702 shutdown_connections 2024-09-10T22:31:00.053 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:00.034+0000 7f7151671640 1 --2- 172.21.15.19:0/58305702 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f714c1086e0 0x7f714c10aba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:31:00.054 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:00.034+0000 7f7151671640 1 --2- 172.21.15.19:0/58305702 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f714c105ac0 0x7f714c107f50 unknown :-1 s=CLOSED pgs=599 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:31:00.054 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:00.034+0000 7f7151671640 1 --2- 172.21.15.19:0/58305702 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f714c06bc50 0x7f714c105580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:31:00.054 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:00.034+0000 7f7151671640 1 -- 172.21.15.19:0/58305702 >> 172.21.15.19:0/58305702 conn(0x7f714c0fd130 msgr2=0x7f714c0ff550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:31:00.054 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:00.034+0000 7f7151671640 1 -- 172.21.15.19:0/58305702 shutdown_connections 2024-09-10T22:31:00.054 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:00.034+0000 7f7151671640 1 -- 172.21.15.19:0/58305702 wait complete. 2024-09-10T22:31:00.054 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:00.034+0000 7f7151671640 1 Processor -- start 2024-09-10T22:31:00.054 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:00.034+0000 7f7151671640 1 -- start start 2024-09-10T22:31:00.055 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:00.035+0000 7f7151671640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f714c06bc50 0x7f714c198e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:31:00.055 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:00.035+0000 7f7151671640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f714c105ac0 0x7f714c199470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:31:00.055 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:00.035+0000 7f7151671640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f714c1086e0 0x7f714c19a030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:31:00.055 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:00.035+0000 7f7151671640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f714c10e5b0 con 0x7f714c1086e0 2024-09-10T22:31:00.055 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:00.035+0000 7f7151671640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f714c10e430 con 0x7f714c105ac0 2024-09-10T22:31:00.055 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:00.035+0000 7f7151671640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f714c10e730 con 0x7f714c06bc50 2024-09-10T22:31:00.055 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:00.035+0000 7f714b7fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f714c1086e0 0x7f714c19a030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:31:00.055 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:00.035+0000 7f714b7fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f714c1086e0 0x7f714c19a030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:50202/0 (socket says 172.21.15.19:50202) 2024-09-10T22:31:00.055 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:00.035+0000 7f714b7fe640 1 -- 172.21.15.19:0/2125820416 learned_addr learned my addr 172.21.15.19:0/2125820416 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:31:00.055 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:00.035+0000 7f7143fff640 1 --2- 172.21.15.19:0/2125820416 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f714c105ac0 0x7f714c199470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:31:00.056 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:00.035+0000 7f714affd640 1 --2- 172.21.15.19:0/2125820416 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f714c06bc50 0x7f714c198e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:31:00.056 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:00.035+0000 7f714b7fe640 1 -- 172.21.15.19:0/2125820416 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f714c06bc50 msgr2=0x7f714c198e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:31:00.056 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:00.035+0000 7f714b7fe640 1 --2- 172.21.15.19:0/2125820416 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f714c06bc50 0x7f714c198e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:31:00.056 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:00.035+0000 7f714b7fe640 1 -- 172.21.15.19:0/2125820416 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f714c105ac0 msgr2=0x7f714c199470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:31:00.056 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:00.035+0000 7f714b7fe640 1 --2- 172.21.15.19:0/2125820416 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f714c105ac0 0x7f714c199470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:31:00.056 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:00.035+0000 7f714b7fe640 1 -- 172.21.15.19:0/2125820416 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f714c19a8f0 con 0x7f714c1086e0 2024-09-10T22:31:00.056 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:00.035+0000 7f714b7fe640 1 --2- 172.21.15.19:0/2125820416 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f714c1086e0 0x7f714c19a030 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7f714400efd0 tx=0x7f714400c6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:31:00.056 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:00.035+0000 7f7148ff9640 1 -- 172.21.15.19:0/2125820416 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7144003b70 con 0x7f714c1086e0 2024-09-10T22:31:00.056 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:00.035+0000 7f7148ff9640 1 -- 172.21.15.19:0/2125820416 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7144003d10 con 0x7f714c1086e0 2024-09-10T22:31:00.056 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:00.035+0000 7f7151671640 1 -- 172.21.15.19:0/2125820416 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f714c19abe0 con 0x7f714c1086e0 2024-09-10T22:31:00.056 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:00.036+0000 7f7148ff9640 1 -- 172.21.15.19:0/2125820416 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71440108a0 con 0x7f714c1086e0 2024-09-10T22:31:00.056 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:00.036+0000 7f7151671640 1 -- 172.21.15.19:0/2125820416 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f714c1a12b0 con 0x7f714c1086e0 2024-09-10T22:31:00.056 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:00.038+0000 7f7148ff9640 1 -- 172.21.15.19:0/2125820416 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 18) ==== 153250+0+0 (secure 0 0 0) 0x7f714401f020 con 0x7f714c1086e0 2024-09-10T22:31:00.057 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:00.038+0000 7f7154447740 1 Processor -- start 2024-09-10T22:31:00.057 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:00.038+0000 7f7154447740 1 -- start start 2024-09-10T22:31:00.057 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:00.038+0000 7f7154447740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5609ce2bc860 0x5609ce2bec50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:31:00.057 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:00.038+0000 7f7154447740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5609ce2bf190 0x5609ce2c1580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:31:00.057 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:00.038+0000 7f7154447740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5609ce2c1bd0 0x5609ce2c4090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:31:00.057 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:00.038+0000 7f7154447740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x5609ce22e6f0 con 0x5609ce2c1bd0 2024-09-10T22:31:00.057 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:00.038+0000 7f7154447740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x5609ce21db20 con 0x5609ce2bc860 2024-09-10T22:31:00.057 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:00.038+0000 7f7154447740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x5609ce221930 con 0x5609ce2bf190 2024-09-10T22:31:00.057 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:00.039+0000 7f714affd640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5609ce2bf190 0x5609ce2c1580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:31:00.057 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:00.039+0000 7f7143fff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5609ce2c1bd0 0x5609ce2c4090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:31:00.057 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:00.039+0000 7f714affd640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5609ce2bf190 0x5609ce2c1580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.19:37184/0 (socket says 172.21.15.19:37184) 2024-09-10T22:31:00.057 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:00.039+0000 7f714affd640 1 -- 172.21.15.19:0/1650023580 learned_addr learned my addr 172.21.15.19:0/1650023580 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:31:00.058 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:00.039+0000 7f7143fff640 1 --2- 172.21.15.19:0/1650023580 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5609ce2bc860 0x5609ce2bec50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:31:00.058 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:00.039+0000 7f714affd640 1 -- 172.21.15.19:0/1650023580 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5609ce2bc860 msgr2=0x5609ce2bec50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:31:00.058 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:00.039+0000 7f714affd640 1 --2- 172.21.15.19:0/1650023580 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5609ce2bc860 0x5609ce2bec50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:31:00.058 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:00.039+0000 7f714affd640 1 -- 172.21.15.19:0/1650023580 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5609ce2c1bd0 msgr2=0x5609ce2c4090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:31:00.058 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:00.039+0000 7f714affd640 1 --2- 172.21.15.19:0/1650023580 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5609ce2c1bd0 0x5609ce2c4090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:31:00.058 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:00.039+0000 7f714affd640 1 -- 172.21.15.19:0/1650023580 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5609ce1e3530 con 0x5609ce2bf190 2024-09-10T22:31:00.058 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:00.039+0000 7f7148ff9640 1 --2- 172.21.15.19:0/2125820416 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f71380b52e0 0x7f71380b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:31:00.058 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:00.039+0000 7f714affd640 1 --2- 172.21.15.19:0/1650023580 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5609ce2bf190 0x5609ce2c1580 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f713c009ca0 tx=0x7f713c0117b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=70660351b1316598 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:31:00.058 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:00.039+0000 7f7143fff640 1 --2- 172.21.15.19:0/2125820416 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f71380b52e0 0x7f71380b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:31:00.059 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:00.039+0000 7f7148ff9640 1 -- 172.21.15.19:0/2125820416 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8327+0+0 (secure 0 0 0) 0x7f71440e5dc0 con 0x7f714c1086e0 2024-09-10T22:31:00.059 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:00.039+0000 7f71417fa640 1 -- 172.21.15.19:0/1650023580 <== mon.1 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f713c012450 con 0x5609ce2bf190 2024-09-10T22:31:00.059 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:00.039+0000 7f71417fa640 1 -- 172.21.15.19:0/1650023580 <== mon.1 v2:172.21.15.138:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f713c012aa0 con 0x5609ce2bf190 2024-09-10T22:31:00.059 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:00.039+0000 7f71417fa640 1 -- 172.21.15.19:0/1650023580 <== mon.1 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f713c00fa70 con 0x5609ce2bf190 2024-09-10T22:31:00.059 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:00.040+0000 7f7154447740 1 -- 172.21.15.19:0/1650023580 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5609ce2bf190 msgr2=0x5609ce2c1580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:31:00.059 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:00.040+0000 7f7143fff640 1 --2- 172.21.15.19:0/2125820416 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f71380b52e0 0x7f71380b77a0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f7134000c00 tx=0x7f713402a410 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:31:00.059 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:00.040+0000 7f7154447740 1 --2- 172.21.15.19:0/1650023580 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5609ce2bf190 0x5609ce2c1580 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f713c009ca0 tx=0x7f713c0117b0 comp rx=0 tx=0).stop 2024-09-10T22:31:00.059 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:00.041+0000 7f7154447740 1 -- 172.21.15.19:0/1650023580 shutdown_connections 2024-09-10T22:31:00.059 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:00.041+0000 7f7154447740 1 --2- 172.21.15.19:0/1650023580 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5609ce2c1bd0 0x5609ce2c4090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:31:00.059 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:00.041+0000 7f7154447740 1 --2- 172.21.15.19:0/1650023580 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5609ce2bf190 0x5609ce2c1580 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:31:00.059 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:00.041+0000 7f7154447740 1 --2- 172.21.15.19:0/1650023580 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5609ce2bc860 0x5609ce2bec50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:31:00.059 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:00.041+0000 7f7154447740 1 -- 172.21.15.19:0/1650023580 >> 172.21.15.19:0/1650023580 conn(0x5609ce2b79b0 msgr2=0x5609ce2b8740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:31:00.060 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:00.041+0000 7f7154447740 1 -- 172.21.15.19:0/1650023580 shutdown_connections 2024-09-10T22:31:00.060 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:00.041+0000 7f7154447740 1 -- 172.21.15.19:0/1650023580 wait complete. 2024-09-10T22:31:00.060 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:00.041+0000 7f7154447740 1 -- start start 2024-09-10T22:31:00.060 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:00.041+0000 7f7154447740 1 Processor -- start 2024-09-10T22:31:00.060 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:00.041+0000 7f7154447740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5609ce2bc860 0x5609ce2c5ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:31:00.060 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:00.041+0000 7f7154447740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5609ce2bf190 0x5609ce2c6590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:31:00.060 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:00.041+0000 7f7154447740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5609ce2c1bd0 0x5609ce2c7160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:31:00.060 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:00.041+0000 7f7154447740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x5609ce155ab0 con 0x5609ce2bc860 2024-09-10T22:31:00.060 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:00.041+0000 7f7154447740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x5609ce1c3730 con 0x5609ce2c1bd0 2024-09-10T22:31:00.060 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:00.041+0000 7f7154447740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x5609ce2c4bb0 con 0x5609ce2bf190 2024-09-10T22:31:00.060 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:00.041+0000 7f7154447740 10 client.0 _ll_register_callbacks cb 0x5609ce2176b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T22:31:00.060 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:00.042+0000 7f714affd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5609ce2bc860 0x5609ce2c5ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:31:00.060 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:00.042+0000 7f7143fff640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5609ce2bf190 0x5609ce2c6590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:31:00.061 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:00.042+0000 7f714b7fe640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5609ce2c1bd0 0x5609ce2c7160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:31:00.061 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:00.042+0000 7f714affd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5609ce2bc860 0x5609ce2c5ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:50216/0 (socket says 172.21.15.19:50216) 2024-09-10T22:31:00.061 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:00.042+0000 7f7143fff640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5609ce2bf190 0x5609ce2c6590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.19:37192/0 (socket says 172.21.15.19:37192) 2024-09-10T22:31:00.061 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:00.042+0000 7f714affd640 1 -- 172.21.15.19:0/1086766173 learned_addr learned my addr 172.21.15.19:0/1086766173 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:31:00.061 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:00.042+0000 7f714affd640 1 -- 172.21.15.19:0/1086766173 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5609ce2bf190 msgr2=0x5609ce2c6590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:31:00.061 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:00.042+0000 7f714affd640 1 --2- 172.21.15.19:0/1086766173 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5609ce2bf190 0x5609ce2c6590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:31:00.061 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:00.042+0000 7f714affd640 1 -- 172.21.15.19:0/1086766173 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5609ce2c1bd0 msgr2=0x5609ce2c7160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:31:00.061 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:00.042+0000 7f714affd640 1 --2- 172.21.15.19:0/1086766173 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5609ce2c1bd0 0x5609ce2c7160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:31:00.061 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:00.042+0000 7f714affd640 1 -- 172.21.15.19:0/1086766173 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5609cdf7f790 con 0x5609ce2bc860 2024-09-10T22:31:00.062 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:00.042+0000 7f714b7fe640 1 --2- 172.21.15.19:0/1086766173 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5609ce2c1bd0 0x5609ce2c7160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T22:31:00.062 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:00.042+0000 7f714affd640 1 --2- 172.21.15.19:0/1086766173 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5609ce2bc860 0x5609ce2c5ef0 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7f713c009500 tx=0x7f713c009fc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cb1c7739c74043f3 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:31:00.062 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:00.042+0000 7f71327fc640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-10T22:31:00.062 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:00.042+0000 7f71327fc640 1 -- 172.21.15.19:0/1086766173 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f713c029020 con 0x5609ce2bc860 2024-09-10T22:31:00.062 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:00.042+0000 7f71327fc640 1 -- 172.21.15.19:0/1086766173 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8327+0+0 (secure 0 0 0) 0x7f713c00fa00 con 0x5609ce2bc860 2024-09-10T22:31:00.062 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:00.042+0000 7f7154447740 1 -- 172.21.15.19:0/1086766173 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f713c012aa0 con 0x5609ce2bc860 2024-09-10T22:31:00.062 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:00.043+0000 7f71327fc640 1 -- 172.21.15.19:0/1086766173 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f713c034050 con 0x5609ce2bc860 2024-09-10T22:31:00.062 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:00.043+0000 7f7154447740 10 client.16278 fetch_fsmap learned FSMap version 27 2024-09-10T22:31:00.062 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:00.043+0000 7f7154447740 1 -- 172.21.15.19:0/1086766173 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x5609cdff8620 con 0x5609ce2bc860 2024-09-10T22:31:00.062 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:00.043+0000 7f71327fc640 1 -- 172.21.15.19:0/1086766173 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f713c012aa0 con 0x5609ce2bc860 2024-09-10T22:31:00.062 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:00.043+0000 7f71327fc640 1 -- 172.21.15.19:0/1086766173 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7f713c0046c0 con 0x5609ce2bc860 2024-09-10T22:31:00.062 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:00.043+0000 7f7154447740 10 client.16278 fetch_fsmap finished waiting for FSMap version 27 2024-09-10T22:31:00.062 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:00.043+0000 7f7154447740 10 client.16278 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-10T22:31:00.063 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:00.043+0000 7f7154447740 20 client.16278 populate_metadata read hostname 'smithi019' 2024-09-10T22:31:00.063 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:00.043+0000 7f7154447740 1 --2- 172.21.15.19:0/1086766173 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x5609ce2d1500 0x5609ce2d38f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:31:00.063 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:00.043+0000 7f7154447740 4 client.16278 mds_command: new command op to 24581 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T22:31:00.063 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:00.043+0000 7f7154447740 1 -- 172.21.15.19:0/1086766173 --> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5609ce230640 con 0x5609ce2d1500 2024-09-10T22:31:00.063 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:00.043+0000 7f7143fff640 1 --2- 172.21.15.19:0/1086766173 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x5609ce2d1500 0x5609ce2d38f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:31:00.063 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:00.044+0000 7f71327fc640 10 client.16278 ms_handle_connect on v2:172.21.15.135:6838/1254769802 2024-09-10T22:31:00.063 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:00.044+0000 7f7143fff640 1 --2- 172.21.15.19:0/1086766173 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x5609ce2d1500 0x5609ce2d38f0 crc :-1 s=READY pgs=108 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=18989edd35699f69 server_cookie=18bb55b403023d0d in_seq=0 out_seq=0 2024-09-10T22:31:00.063 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:00.044+0000 7f71327fc640 1 -- 172.21.15.19:0/1086766173 <== mds.0 v2:172.21.15.135:6838/1254769802 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5609ce230640 con 0x5609ce2d1500 2024-09-10T22:31:00.063 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:00.044+0000 7f71327fc640 10 client.16278 handle_command_reply: tid=0 2024-09-10T22:31:00.063 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:00.045+0000 7f7154447740 1 client.16278 shutdown 2024-09-10T22:31:00.063 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:00.045+0000 7f7154447740 1 -- 172.21.15.19:0/1086766173 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5609ce2bc860 msgr2=0x5609ce2c5ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:31:00.063 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:00.045+0000 7f7154447740 1 --2- 172.21.15.19:0/1086766173 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5609ce2bc860 0x5609ce2c5ef0 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7f713c009500 tx=0x7f713c009fc0 comp rx=0 tx=0).stop 2024-09-10T22:31:00.064 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:00.045+0000 7f7154447740 1 -- 172.21.15.19:0/1086766173 shutdown_connections 2024-09-10T22:31:00.064 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:00.045+0000 7f7154447740 1 --2- 172.21.15.19:0/1086766173 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5609ce2c1bd0 0x5609ce2c7160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:31:00.064 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:00.045+0000 7f7154447740 1 --2- 172.21.15.19:0/1086766173 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x5609ce2d1500 0x5609ce2d38f0 crc :-1 s=READY pgs=108 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:31:00.064 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:00.045+0000 7f7154447740 1 --2- 172.21.15.19:0/1086766173 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5609ce2bf190 0x5609ce2c6590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:31:00.064 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:00.045+0000 7f7154447740 1 --2- 172.21.15.19:0/1086766173 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5609ce2bc860 0x5609ce2c5ef0 unknown :-1 s=CLOSED pgs=601 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:31:00.064 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:00.045+0000 7f71327fc640 0 client.16278 ms_handle_reset on v2:172.21.15.135:6838/1254769802 2024-09-10T22:31:00.064 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:00.045+0000 7f7154447740 1 -- 172.21.15.19:0/1086766173 >> 172.21.15.19:0/1086766173 conn(0x5609ce2b79b0 msgr2=0x5609ce2b6bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:31:00.064 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:00.045+0000 7f7154447740 1 -- 172.21.15.19:0/1086766173 shutdown_connections 2024-09-10T22:31:00.064 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:00.045+0000 7f7154447740 1 -- 172.21.15.19:0/1086766173 wait complete. 2024-09-10T22:31:00.064 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:00.045+0000 7f7154447740 20 client.16278 trim_cache size 0 max 16384 2024-09-10T22:31:00.070 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:00.062+0000 7f7154447740 1 Processor -- start 2024-09-10T22:31:00.070 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:00.062+0000 7f7154447740 1 -- start start 2024-09-10T22:31:00.070 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:00.063+0000 7f7154447740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5609ce2bc860 0x5609ce2b6ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:31:00.070 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:00.063+0000 7f7154447740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5609ce2bf190 0x5609ce2ba7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:31:00.070 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:00.063+0000 7f7154447740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5609ce2c1bd0 0x5609ce2bad30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:31:00.070 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:00.063+0000 7f7154447740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f714c1ac9d0 con 0x5609ce2c1bd0 2024-09-10T22:31:00.070 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:00.063+0000 7f7154447740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f714c1aa2a0 con 0x5609ce2bf190 2024-09-10T22:31:00.071 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:00.063+0000 7f7154447740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f714c1a80f0 con 0x5609ce2bc860 2024-09-10T22:31:00.071 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:00.063+0000 7f714b7fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5609ce2c1bd0 0x5609ce2bad30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:31:00.071 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:00.063+0000 7f7143fff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5609ce2bf190 0x5609ce2ba7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:31:00.071 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:00.063+0000 7f714b7fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5609ce2c1bd0 0x5609ce2bad30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:50232/0 (socket says 172.21.15.19:50232) 2024-09-10T22:31:00.071 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:00.063+0000 7f714b7fe640 1 -- 172.21.15.19:0/2075002621 learned_addr learned my addr 172.21.15.19:0/2075002621 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:31:00.071 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:00.063+0000 7f714affd640 1 --2- 172.21.15.19:0/2075002621 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5609ce2bc860 0x5609ce2b6ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:31:00.071 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:00.064+0000 7f7143fff640 1 -- 172.21.15.19:0/2075002621 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5609ce2bc860 msgr2=0x5609ce2b6ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:31:00.071 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:00.064+0000 7f7143fff640 1 --2- 172.21.15.19:0/2075002621 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5609ce2bc860 0x5609ce2b6ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:31:00.071 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:00.064+0000 7f7143fff640 1 -- 172.21.15.19:0/2075002621 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5609ce2c1bd0 msgr2=0x5609ce2bad30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:31:00.071 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:00.064+0000 7f7143fff640 1 --2- 172.21.15.19:0/2075002621 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5609ce2c1bd0 0x5609ce2bad30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:31:00.071 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:00.064+0000 7f7143fff640 1 -- 172.21.15.19:0/2075002621 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5609ce2befc0 con 0x5609ce2bf190 2024-09-10T22:31:00.072 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:00.064+0000 7f7143fff640 1 --2- 172.21.15.19:0/2075002621 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5609ce2bf190 0x5609ce2ba7f0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f7134006010 tx=0x7f713403f070 comp rx=0 tx=0).ready entity=mon.2 client_cookie=351bdd611c575ad0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:31:00.072 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:00.064+0000 7f7140ff9640 1 -- 172.21.15.19:0/2075002621 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7134035040 con 0x5609ce2bf190 2024-09-10T22:31:00.072 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:00.064+0000 7f7140ff9640 1 -- 172.21.15.19:0/2075002621 <== mon.2 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f71340317a0 con 0x5609ce2bf190 2024-09-10T22:31:00.072 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:00.064+0000 7f7140ff9640 1 -- 172.21.15.19:0/2075002621 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7134003d90 con 0x5609ce2bf190 2024-09-10T22:31:00.072 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:00.065+0000 7f7154447740 1 -- 172.21.15.19:0/2075002621 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5609ce2bf190 msgr2=0x5609ce2ba7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:31:00.072 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:00.065+0000 7f7154447740 1 --2- 172.21.15.19:0/2075002621 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5609ce2bf190 0x5609ce2ba7f0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f7134006010 tx=0x7f713403f070 comp rx=0 tx=0).stop 2024-09-10T22:31:00.072 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:00.065+0000 7f7154447740 1 -- 172.21.15.19:0/2075002621 shutdown_connections 2024-09-10T22:31:00.072 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:00.065+0000 7f7154447740 1 --2- 172.21.15.19:0/2075002621 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5609ce2c1bd0 0x5609ce2bad30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:31:00.072 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:00.065+0000 7f7154447740 1 --2- 172.21.15.19:0/2075002621 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5609ce2bf190 0x5609ce2ba7f0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:31:00.072 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:00.065+0000 7f7154447740 1 --2- 172.21.15.19:0/2075002621 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5609ce2bc860 0x5609ce2b6ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:31:00.072 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:00.065+0000 7f7154447740 1 -- 172.21.15.19:0/2075002621 >> 172.21.15.19:0/2075002621 conn(0x5609ce2b79b0 msgr2=0x5609ce2b63d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:31:00.072 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:00.065+0000 7f7154447740 1 -- 172.21.15.19:0/2075002621 shutdown_connections 2024-09-10T22:31:00.072 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:00.065+0000 7f7154447740 1 -- 172.21.15.19:0/2075002621 wait complete. 2024-09-10T22:31:00.073 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:00.066+0000 7f7154447740 1 -- start start 2024-09-10T22:31:00.073 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:00.066+0000 7f7154447740 1 Processor -- start 2024-09-10T22:31:00.073 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:00.066+0000 7f7154447740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5609ce2bc860 0x5609ce2cd3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:31:00.073 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:00.066+0000 7f7154447740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5609ce2bf190 0x5609ce2cda90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:31:00.073 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:00.066+0000 7f7154447740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5609ce2c1bd0 0x5609ce336700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:31:00.073 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:00.066+0000 7f7154447740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f714c1a8760 con 0x5609ce2c1bd0 2024-09-10T22:31:00.073 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:00.066+0000 7f7154447740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f714c1a9bd0 con 0x5609ce2bc860 2024-09-10T22:31:00.073 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:00.066+0000 7f7154447740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f714c1a8e30 con 0x5609ce2bf190 2024-09-10T22:31:00.073 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:00.066+0000 7f7154447740 10 client.0 _ll_register_callbacks cb 0x7f713c005e30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T22:31:00.073 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:00.066+0000 7f7143fff640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5609ce2bf190 0x5609ce2cda90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:31:00.073 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:00.066+0000 7f7143fff640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5609ce2bf190 0x5609ce2cda90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.19:37212/0 (socket says 172.21.15.19:37212) 2024-09-10T22:31:00.073 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:00.066+0000 7f7143fff640 1 -- 172.21.15.19:0/1470134831 learned_addr learned my addr 172.21.15.19:0/1470134831 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:31:00.074 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:00.067+0000 7f714affd640 1 --2- 172.21.15.19:0/1470134831 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5609ce2bc860 0x5609ce2cd3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:31:00.074 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:00.067+0000 7f7143fff640 1 -- 172.21.15.19:0/1470134831 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5609ce2bc860 msgr2=0x5609ce2cd3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:31:00.074 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:00.067+0000 7f7143fff640 1 --2- 172.21.15.19:0/1470134831 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5609ce2bc860 0x5609ce2cd3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:31:00.074 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:00.067+0000 7f7143fff640 1 -- 172.21.15.19:0/1470134831 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5609ce2c1bd0 msgr2=0x5609ce336700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:31:00.074 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:00.067+0000 7f7143fff640 1 --2- 172.21.15.19:0/1470134831 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5609ce2c1bd0 0x5609ce336700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:31:00.074 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:00.067+0000 7f7143fff640 1 -- 172.21.15.19:0/1470134831 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5609ce336f30 con 0x5609ce2bf190 2024-09-10T22:31:00.074 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:00.067+0000 7f7143fff640 1 --2- 172.21.15.19:0/1470134831 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5609ce2bf190 0x5609ce2cda90 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f7134031f30 tx=0x7f71340319e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ec37590b1a94229d server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:31:00.074 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:00.067+0000 7f71327fc640 10 client.0 ms_handle_connect on v2:172.21.15.138:3300/0 2024-09-10T22:31:00.074 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:00.067+0000 7f71327fc640 1 -- 172.21.15.19:0/1470134831 <== mon.1 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7134035040 con 0x5609ce2bf190 2024-09-10T22:31:00.074 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:00.067+0000 7f71327fc640 1 -- 172.21.15.19:0/1470134831 <== mon.1 v2:172.21.15.138:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8327+0+0 (secure 0 0 0) 0x7f7134003d10 con 0x5609ce2bf190 2024-09-10T22:31:00.074 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:00.067+0000 7f7154447740 1 -- 172.21.15.19:0/1470134831 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f71340317a0 con 0x5609ce2bf190 2024-09-10T22:31:00.074 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:00.067+0000 7f71327fc640 1 -- 172.21.15.19:0/1470134831 <== mon.1 v2:172.21.15.138:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f713406e050 con 0x5609ce2bf190 2024-09-10T22:31:00.074 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:00.068+0000 7f7154447740 10 client.25732 fetch_fsmap learned FSMap version 27 2024-09-10T22:31:00.075 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:00.068+0000 7f7154447740 1 -- 172.21.15.19:0/1470134831 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x5609ce33e2a0 con 0x5609ce2bf190 2024-09-10T22:31:00.075 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:00.068+0000 7f71327fc640 1 -- 172.21.15.19:0/1470134831 <== mon.1 v2:172.21.15.138:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f71340317a0 con 0x5609ce2bf190 2024-09-10T22:31:00.075 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:00.068+0000 7f71327fc640 1 -- 172.21.15.19:0/1470134831 <== mon.1 v2:172.21.15.138:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7f713405e9d0 con 0x5609ce2bf190 2024-09-10T22:31:00.075 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:00.068+0000 7f7154447740 10 client.25732 fetch_fsmap finished waiting for FSMap version 27 2024-09-10T22:31:00.075 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:00.068+0000 7f7154447740 10 client.25732 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-10T22:31:00.075 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:00.068+0000 7f7154447740 20 client.25732 populate_metadata read hostname 'smithi019' 2024-09-10T22:31:00.075 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:00.068+0000 7f7154447740 1 --2- 172.21.15.19:0/1470134831 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x5609ce33ec80 0x5609ce3410a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:31:00.075 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:00.068+0000 7f7154447740 4 client.25732 mds_command: new command op to 24581 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-10T22:31:00.075 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:00.068+0000 7f7154447740 1 -- 172.21.15.19:0/1470134831 --> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5609ce22c0f0 con 0x5609ce33ec80 2024-09-10T22:31:00.075 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:00.068+0000 7f714affd640 1 --2- 172.21.15.19:0/1470134831 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x5609ce33ec80 0x5609ce3410a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:31:00.075 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:00.069+0000 7f714affd640 1 --2- 172.21.15.19:0/1470134831 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x5609ce33ec80 0x5609ce3410a0 crc :-1 s=READY pgs=109 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=af6f5e06b3514285 server_cookie=db18697b530c216d in_seq=0 out_seq=0 2024-09-10T22:31:00.075 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:00.069+0000 7f71327fc640 10 client.25732 ms_handle_connect on v2:172.21.15.135:6838/1254769802 2024-09-10T22:31:00.110 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:30:59 smithi135 ceph-mon[34789]: pgmap v484: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 580 KiB/s rd, 323 MiB/s wr, 472 op/s 2024-09-10T22:31:00.125 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:30:59 smithi138 ceph-mon[35236]: pgmap v484: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 580 KiB/s rd, 323 MiB/s wr, 472 op/s 2024-09-10T22:31:00.694 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:00.634+0000 7efdbe51e640 1 -- 172.21.15.19:0/253285947 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7efdb8109170 msgr2=0x7efdb810f970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:31:00.694 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:00.634+0000 7efdbe51e640 1 --2- 172.21.15.19:0/253285947 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7efdb8109170 0x7efdb810f970 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7efdb0009ca0 tx=0x7efdb002a8c0 comp rx=0 tx=0).stop 2024-09-10T22:31:00.694 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:00.634+0000 7efdbe51e640 1 -- 172.21.15.19:0/253285947 shutdown_connections 2024-09-10T22:31:00.695 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:00.634+0000 7efdbe51e640 1 --2- 172.21.15.19:0/253285947 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7efdb8109170 0x7efdb810f970 unknown :-1 s=CLOSED pgs=602 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:31:00.695 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:00.634+0000 7efdbe51e640 1 --2- 172.21.15.19:0/253285947 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efdb81087f0 0x7efdb8108c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:31:00.695 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:00.634+0000 7efdbe51e640 1 --2- 172.21.15.19:0/253285947 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7efdb8102de0 0x7efdb81031c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:31:00.695 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:00.634+0000 7efdbe51e640 1 -- 172.21.15.19:0/253285947 >> 172.21.15.19:0/253285947 conn(0x7efdb80fe830 msgr2=0x7efdb8100c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:31:00.695 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:00.634+0000 7efdbe51e640 1 -- 172.21.15.19:0/253285947 shutdown_connections 2024-09-10T22:31:00.695 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:00.634+0000 7efdbe51e640 1 -- 172.21.15.19:0/253285947 wait complete. 2024-09-10T22:31:00.695 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:00.634+0000 7efdbe51e640 1 Processor -- start 2024-09-10T22:31:00.695 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:00.634+0000 7efdbe51e640 1 -- start start 2024-09-10T22:31:00.695 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:00.635+0000 7efdbe51e640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efdb8102de0 0x7efdb8076f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:31:00.695 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:00.635+0000 7efdbe51e640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7efdb81087f0 0x7efdb80754a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:31:00.695 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:00.635+0000 7efdbe51e640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7efdb8109170 0x7efdb8075ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:31:00.695 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:00.635+0000 7efdbe51e640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7efdb8112df0 con 0x7efdb8109170 2024-09-10T22:31:00.695 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:00.635+0000 7efdbe51e640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7efdb8112c70 con 0x7efdb8102de0 2024-09-10T22:31:00.696 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:00.635+0000 7efdbe51e640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7efdb8112f70 con 0x7efdb81087f0 2024-09-10T22:31:00.696 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:00.635+0000 7efdb7fff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efdb8102de0 0x7efdb8076f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:31:00.696 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:00.635+0000 7efdbcabb640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7efdb8109170 0x7efdb8075ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:31:00.696 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:00.635+0000 7efdb7fff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efdb8102de0 0x7efdb8076f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.19:44930/0 (socket says 172.21.15.19:44930) 2024-09-10T22:31:00.696 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:00.635+0000 7efdb7fff640 1 -- 172.21.15.19:0/170077422 learned_addr learned my addr 172.21.15.19:0/170077422 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:31:00.696 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:00.635+0000 7efdb77fe640 1 --2- 172.21.15.19:0/170077422 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7efdb81087f0 0x7efdb80754a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:31:00.696 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:00.635+0000 7efdb7fff640 1 -- 172.21.15.19:0/170077422 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7efdb81087f0 msgr2=0x7efdb80754a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:31:00.696 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:00.635+0000 7efdb7fff640 1 --2- 172.21.15.19:0/170077422 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7efdb81087f0 0x7efdb80754a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:31:00.696 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:00.635+0000 7efdb7fff640 1 -- 172.21.15.19:0/170077422 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7efdb8109170 msgr2=0x7efdb8075ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:31:00.696 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:00.635+0000 7efdb7fff640 1 --2- 172.21.15.19:0/170077422 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7efdb8109170 0x7efdb8075ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:31:00.696 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:00.635+0000 7efdb7fff640 1 -- 172.21.15.19:0/170077422 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efdb81abba0 con 0x7efdb8102de0 2024-09-10T22:31:00.696 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:00.636+0000 7efdb7fff640 1 --2- 172.21.15.19:0/170077422 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efdb8102de0 0x7efdb8076f50 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7efda800e9f0 tx=0x7efda800edf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:31:00.696 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:00.636+0000 7efdb57fa640 1 -- 172.21.15.19:0/170077422 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efda800cd80 con 0x7efdb8102de0 2024-09-10T22:31:00.697 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:00.636+0000 7efdbe51e640 1 -- 172.21.15.19:0/170077422 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efdb81abd70 con 0x7efdb8102de0 2024-09-10T22:31:00.697 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:00.636+0000 7efdb57fa640 1 -- 172.21.15.19:0/170077422 <== mon.2 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7efda80054d0 con 0x7efdb8102de0 2024-09-10T22:31:00.697 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:00.636+0000 7efdb57fa640 1 -- 172.21.15.19:0/170077422 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efda8010690 con 0x7efdb8102de0 2024-09-10T22:31:00.697 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:00.636+0000 7efdbe51e640 1 -- 172.21.15.19:0/170077422 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efdb81ac1d0 con 0x7efdb8102de0 2024-09-10T22:31:00.697 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:00.638+0000 7efdc08f3740 1 Processor -- start 2024-09-10T22:31:00.697 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:00.639+0000 7efdc08f3740 1 -- start start 2024-09-10T22:31:00.697 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:00.639+0000 7efdb57fa640 1 -- 172.21.15.19:0/170077422 <== mon.2 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 18) ==== 153250+0+0 (secure 0 0 0) 0x7efda8004e90 con 0x7efdb8102de0 2024-09-10T22:31:00.697 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:00.639+0000 7efdc08f3740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5628d3324ee0 0x5628d33252c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:31:00.697 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:00.639+0000 7efdc08f3740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5628d3325800 0x5628d3331250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:31:00.697 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:00.639+0000 7efdc08f3740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5628d3331790 0x5628d3333b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:31:00.697 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:00.639+0000 7efdc08f3740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x5628d329be60 con 0x5628d3324ee0 2024-09-10T22:31:00.698 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:00.639+0000 7efdc08f3740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x5628d328b290 con 0x5628d3331790 2024-09-10T22:31:00.698 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:00.639+0000 7efdc08f3740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x5628d328f0a0 con 0x5628d3325800 2024-09-10T22:31:00.698 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:00.639+0000 7efdbcabb640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5628d3324ee0 0x5628d33252c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:31:00.698 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:00.639+0000 7efdb7fff640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5628d3325800 0x5628d3331250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:31:00.698 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:00.639+0000 7efdb77fe640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5628d3331790 0x5628d3333b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:31:00.698 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:00.639+0000 7efdbcabb640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5628d3324ee0 0x5628d33252c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:50294/0 (socket says 172.21.15.19:50294) 2024-09-10T22:31:00.698 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:00.639+0000 7efdbcabb640 1 -- 172.21.15.19:0/3821309076 learned_addr learned my addr 172.21.15.19:0/3821309076 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:31:00.698 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:00.639+0000 7efdbcabb640 1 -- 172.21.15.19:0/3821309076 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5628d3325800 msgr2=0x5628d3331250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:31:00.698 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:00.639+0000 7efdbcabb640 1 --2- 172.21.15.19:0/3821309076 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5628d3325800 0x5628d3331250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:31:00.698 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:00.639+0000 7efdbcabb640 1 -- 172.21.15.19:0/3821309076 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5628d3331790 msgr2=0x5628d3333b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:31:00.698 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:00.639+0000 7efdbcabb640 1 --2- 172.21.15.19:0/3821309076 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5628d3331790 0x5628d3333b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:31:00.698 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:00.639+0000 7efdbcabb640 1 -- 172.21.15.19:0/3821309076 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5628d2fe9930 con 0x5628d3324ee0 2024-09-10T22:31:00.698 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:00.639+0000 7efdb77fe640 1 --2- 172.21.15.19:0/3821309076 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5628d3331790 0x5628d3333b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T22:31:00.699 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:00.640+0000 7efdbcabb640 1 --2- 172.21.15.19:0/3821309076 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5628d3324ee0 0x5628d33252c0 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7efdb0005ef0 tx=0x7efdb0005f20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8fede9cb596b1681 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:31:00.699 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:00.640+0000 7efdb57fa640 1 --2- 172.21.15.19:0/170077422 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7efda00b52e0 0x7efda00b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:31:00.699 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:00.640+0000 7efd9e7fc640 1 -- 172.21.15.19:0/3821309076 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efdb0031cf0 con 0x5628d3324ee0 2024-09-10T22:31:00.699 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:00.640+0000 7efd9e7fc640 1 -- 172.21.15.19:0/3821309076 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7efdb0036070 con 0x5628d3324ee0 2024-09-10T22:31:00.699 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:00.640+0000 7efd9e7fc640 1 -- 172.21.15.19:0/3821309076 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efdb00042a0 con 0x5628d3324ee0 2024-09-10T22:31:00.699 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:00.640+0000 7efdb7fff640 1 --2- 172.21.15.19:0/170077422 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7efda00b52e0 0x7efda00b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:31:00.699 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:00.640+0000 7efdb57fa640 1 -- 172.21.15.19:0/170077422 <== mon.2 v2:172.21.15.135:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8327+0+0 (secure 0 0 0) 0x7efda80e6010 con 0x7efdb8102de0 2024-09-10T22:31:00.699 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:00.641+0000 7efdc08f3740 1 -- 172.21.15.19:0/3821309076 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5628d3324ee0 msgr2=0x5628d33252c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:31:00.699 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:00.641+0000 7efdb7fff640 1 --2- 172.21.15.19:0/170077422 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7efda00b52e0 0x7efda00b77a0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7efda801c000 tx=0x7efda80e8040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:31:00.699 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:00.641+0000 7efdc08f3740 1 --2- 172.21.15.19:0/3821309076 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5628d3324ee0 0x5628d33252c0 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7efdb0005ef0 tx=0x7efdb0005f20 comp rx=0 tx=0).stop 2024-09-10T22:31:00.699 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:00.641+0000 7efdc08f3740 1 -- 172.21.15.19:0/3821309076 shutdown_connections 2024-09-10T22:31:00.699 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:00.641+0000 7efdc08f3740 1 --2- 172.21.15.19:0/3821309076 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5628d3331790 0x5628d3333b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:31:00.699 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:00.641+0000 7efdc08f3740 1 --2- 172.21.15.19:0/3821309076 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5628d3325800 0x5628d3331250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:31:00.699 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:00.641+0000 7efdc08f3740 1 --2- 172.21.15.19:0/3821309076 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5628d3324ee0 0x5628d33252c0 unknown :-1 s=CLOSED pgs=603 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:31:00.700 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:00.641+0000 7efdc08f3740 1 -- 172.21.15.19:0/3821309076 >> 172.21.15.19:0/3821309076 conn(0x5628d3322d10 msgr2=0x5628d3323eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:31:00.700 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:00.641+0000 7efdc08f3740 1 -- 172.21.15.19:0/3821309076 shutdown_connections 2024-09-10T22:31:00.700 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:00.641+0000 7efdc08f3740 1 -- 172.21.15.19:0/3821309076 wait complete. 2024-09-10T22:31:00.700 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:00.641+0000 7efdc08f3740 1 -- start start 2024-09-10T22:31:00.700 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:00.642+0000 7efdc08f3740 1 Processor -- start 2024-09-10T22:31:00.700 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:00.642+0000 7efdc08f3740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5628d3324ee0 0x5628d332e810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:31:00.700 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:00.642+0000 7efdc08f3740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5628d3325800 0x5628d332ed50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:31:00.700 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:00.642+0000 7efdc08f3740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5628d3331790 0x5628d332f290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:31:00.700 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:00.642+0000 7efdc08f3740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x5628d30ec890 con 0x5628d3325800 2024-09-10T22:31:00.700 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:00.642+0000 7efdc08f3740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x5628d3225d40 con 0x5628d3331790 2024-09-10T22:31:00.700 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:00.642+0000 7efdc08f3740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x5628d3334260 con 0x5628d3324ee0 2024-09-10T22:31:00.700 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:00.642+0000 7efdc08f3740 10 client.0 _ll_register_callbacks cb 0x5628d3289c80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T22:31:00.700 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:00.642+0000 7efdb77fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5628d3325800 0x5628d332ed50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:31:00.701 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:00.642+0000 7efdbcabb640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5628d3324ee0 0x5628d332e810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:31:00.701 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:00.642+0000 7efdb77fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5628d3325800 0x5628d332ed50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:50302/0 (socket says 172.21.15.19:50302) 2024-09-10T22:31:00.701 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:00.642+0000 7efdb77fe640 1 -- 172.21.15.19:0/2670835906 learned_addr learned my addr 172.21.15.19:0/2670835906 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:31:00.701 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:00.642+0000 7efdbcabb640 1 --2- 172.21.15.19:0/2670835906 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5628d3331790 0x5628d332f290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:31:00.701 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:00.642+0000 7efdb77fe640 1 -- 172.21.15.19:0/2670835906 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5628d3324ee0 msgr2=0x5628d332e810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:31:00.702 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:00.642+0000 7efdb77fe640 1 --2- 172.21.15.19:0/2670835906 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5628d3324ee0 0x5628d332e810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:31:00.702 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:00.642+0000 7efdb77fe640 1 -- 172.21.15.19:0/2670835906 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5628d3331790 msgr2=0x5628d332f290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:31:00.702 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:00.642+0000 7efdb77fe640 1 --2- 172.21.15.19:0/2670835906 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5628d3331790 0x5628d332f290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:31:00.702 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:00.642+0000 7efdb77fe640 1 -- 172.21.15.19:0/2670835906 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5628d333d6f0 con 0x5628d3325800 2024-09-10T22:31:00.702 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:00.643+0000 7efdb77fe640 1 --2- 172.21.15.19:0/2670835906 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5628d3325800 0x5628d332ed50 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7efdac0126e0 tx=0x7efdac012ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5903d1932f5a710b server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:31:00.702 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:00.643+0000 7efd977fe640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-10T22:31:00.702 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:00.643+0000 7efd977fe640 1 -- 172.21.15.19:0/2670835906 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efdac012190 con 0x5628d3325800 2024-09-10T22:31:00.702 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:00.643+0000 7efd977fe640 1 -- 172.21.15.19:0/2670835906 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8327+0+0 (secure 0 0 0) 0x7efdac00f920 con 0x5628d3325800 2024-09-10T22:31:00.703 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:00.643+0000 7efdc08f3740 1 -- 172.21.15.19:0/2670835906 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7efdb0036070 con 0x5628d3325800 2024-09-10T22:31:00.703 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:00.643+0000 7efd977fe640 1 -- 172.21.15.19:0/2670835906 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7efdac00fb20 con 0x5628d3325800 2024-09-10T22:31:00.703 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:00.643+0000 7efdc08f3740 10 client.16293 fetch_fsmap learned FSMap version 27 2024-09-10T22:31:00.703 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:00.643+0000 7efdc08f3740 1 -- 172.21.15.19:0/2670835906 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x5628d33400e0 con 0x5628d3325800 2024-09-10T22:31:00.703 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:00.643+0000 7efd977fe640 1 -- 172.21.15.19:0/2670835906 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7efdb0036070 con 0x5628d3325800 2024-09-10T22:31:00.703 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:00.644+0000 7efd977fe640 1 -- 172.21.15.19:0/2670835906 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7efdac024020 con 0x5628d3325800 2024-09-10T22:31:00.703 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:00.644+0000 7efdc08f3740 10 client.16293 fetch_fsmap finished waiting for FSMap version 27 2024-09-10T22:31:00.703 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:00.644+0000 7efdc08f3740 10 client.16293 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-10T22:31:00.703 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:00.644+0000 7efdc08f3740 20 client.16293 populate_metadata read hostname 'smithi019' 2024-09-10T22:31:00.704 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:00.644+0000 7efdc08f3740 1 --2- 172.21.15.19:0/2670835906 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x5628d33415b0 0x5628d33439a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:31:00.704 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:00.644+0000 7efdc08f3740 4 client.16293 mds_command: new command op to 24581 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T22:31:00.704 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:00.644+0000 7efdc08f3740 1 -- 172.21.15.19:0/2670835906 --> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5628d329ddb0 con 0x5628d33415b0 2024-09-10T22:31:00.704 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:00.644+0000 7efdbcabb640 1 --2- 172.21.15.19:0/2670835906 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x5628d33415b0 0x5628d33439a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:31:00.704 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:00.644+0000 7efd977fe640 10 client.16293 ms_handle_connect on v2:172.21.15.135:6838/1254769802 2024-09-10T22:31:00.704 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:00.644+0000 7efdbcabb640 1 --2- 172.21.15.19:0/2670835906 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x5628d33415b0 0x5628d33439a0 crc :-1 s=READY pgs=110 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=261236e2535a2dad server_cookie=1847d75b47f86d82 in_seq=0 out_seq=0 2024-09-10T22:31:00.704 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:00.645+0000 7efd977fe640 1 -- 172.21.15.19:0/2670835906 <== mds.0 v2:172.21.15.135:6838/1254769802 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5628d329ddb0 con 0x5628d33415b0 2024-09-10T22:31:00.704 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:00.645+0000 7efd977fe640 10 client.16293 handle_command_reply: tid=0 2024-09-10T22:31:00.704 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:00.645+0000 7efdc08f3740 1 client.16293 shutdown 2024-09-10T22:31:00.704 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:00.645+0000 7efdc08f3740 1 -- 172.21.15.19:0/2670835906 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5628d3325800 msgr2=0x5628d332ed50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:31:00.704 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:00.645+0000 7efdc08f3740 1 --2- 172.21.15.19:0/2670835906 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5628d3325800 0x5628d332ed50 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7efdac0126e0 tx=0x7efdac012ba0 comp rx=0 tx=0).stop 2024-09-10T22:31:00.704 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:00.646+0000 7efdc08f3740 1 -- 172.21.15.19:0/2670835906 shutdown_connections 2024-09-10T22:31:00.704 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:00.646+0000 7efdc08f3740 1 --2- 172.21.15.19:0/2670835906 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5628d3331790 0x5628d332f290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:31:00.705 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:00.646+0000 7efdc08f3740 1 --2- 172.21.15.19:0/2670835906 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5628d3325800 0x5628d332ed50 unknown :-1 s=CLOSED pgs=604 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:31:00.705 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:00.646+0000 7efdc08f3740 1 --2- 172.21.15.19:0/2670835906 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x5628d33415b0 0x5628d33439a0 crc :-1 s=READY pgs=110 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:31:00.705 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:00.646+0000 7efdc08f3740 1 --2- 172.21.15.19:0/2670835906 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5628d3324ee0 0x5628d332e810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:31:00.705 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:00.646+0000 7efd977fe640 0 client.16293 ms_handle_reset on v2:172.21.15.135:6838/1254769802 2024-09-10T22:31:00.705 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:00.646+0000 7efdc08f3740 1 -- 172.21.15.19:0/2670835906 >> 172.21.15.19:0/2670835906 conn(0x5628d3322d10 msgr2=0x5628d3321f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:31:00.705 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:00.646+0000 7efdc08f3740 1 -- 172.21.15.19:0/2670835906 shutdown_connections 2024-09-10T22:31:00.705 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:00.646+0000 7efdc08f3740 1 -- 172.21.15.19:0/2670835906 wait complete. 2024-09-10T22:31:00.705 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:00.646+0000 7efdc08f3740 20 client.16293 trim_cache size 0 max 16384 2024-09-10T22:31:00.705 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:00.664+0000 7efdc08f3740 1 Processor -- start 2024-09-10T22:31:00.705 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:00.664+0000 7efdc08f3740 1 -- start start 2024-09-10T22:31:00.706 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:00.664+0000 7efdc08f3740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5628d3324ee0 0x5628d33287a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:31:00.706 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:00.664+0000 7efdc08f3740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5628d3325800 0x5628d332ba20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:31:00.706 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:00.664+0000 7efdc08f3740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5628d3331790 0x5628d332bf60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:31:00.706 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:00.664+0000 7efdc08f3740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7efdb81b73c0 con 0x5628d3331790 2024-09-10T22:31:00.706 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:00.664+0000 7efdc08f3740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7efdb81b4c90 con 0x5628d3325800 2024-09-10T22:31:00.706 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:00.664+0000 7efdc08f3740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7efdb81b2ae0 con 0x5628d3324ee0 2024-09-10T22:31:00.706 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:00.664+0000 7efdbcabb640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5628d3324ee0 0x5628d33287a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:31:00.706 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:00.664+0000 7efdbcabb640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5628d3324ee0 0x5628d33287a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.19:37258/0 (socket says 172.21.15.19:37258) 2024-09-10T22:31:00.706 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:00.664+0000 7efdbcabb640 1 -- 172.21.15.19:0/1513372461 learned_addr learned my addr 172.21.15.19:0/1513372461 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:31:00.706 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:00.664+0000 7efdb77fe640 1 --2- 172.21.15.19:0/1513372461 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5628d3325800 0x5628d332ba20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:31:00.706 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:00.664+0000 7efdbcabb640 1 --2- 172.21.15.19:0/1513372461 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5628d3331790 0x5628d332bf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:31:00.706 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:00.665+0000 7efdbcabb640 1 -- 172.21.15.19:0/1513372461 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5628d3325800 msgr2=0x5628d332ba20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:31:00.706 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:00.665+0000 7efdbcabb640 1 --2- 172.21.15.19:0/1513372461 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5628d3325800 0x5628d332ba20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:31:00.707 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:00.665+0000 7efdbcabb640 1 -- 172.21.15.19:0/1513372461 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5628d3331790 msgr2=0x5628d332bf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:31:00.707 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:00.665+0000 7efdbcabb640 1 --2- 172.21.15.19:0/1513372461 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5628d3331790 0x5628d332bf60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:31:00.707 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:00.665+0000 7efdbcabb640 1 -- 172.21.15.19:0/1513372461 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5628d3343fd0 con 0x5628d3324ee0 2024-09-10T22:31:00.707 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:00.665+0000 7efdbcabb640 1 --2- 172.21.15.19:0/1513372461 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5628d3324ee0 0x5628d33287a0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7efdb0003fd0 tx=0x7efdb002a8c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6483104c1f3b4950 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:31:00.707 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:00.665+0000 7efd9dffb640 1 -- 172.21.15.19:0/1513372461 <== mon.1 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efdb0031af0 con 0x5628d3324ee0 2024-09-10T22:31:00.707 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:00.665+0000 7efd9dffb640 1 -- 172.21.15.19:0/1513372461 <== mon.1 v2:172.21.15.138:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7efdb0036040 con 0x5628d3324ee0 2024-09-10T22:31:00.707 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:00.665+0000 7efd9dffb640 1 -- 172.21.15.19:0/1513372461 <== mon.1 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efdb00042f0 con 0x5628d3324ee0 2024-09-10T22:31:00.707 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:00.666+0000 7efdc08f3740 1 -- 172.21.15.19:0/1513372461 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5628d3324ee0 msgr2=0x5628d33287a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:31:00.707 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:00.666+0000 7efdc08f3740 1 --2- 172.21.15.19:0/1513372461 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5628d3324ee0 0x5628d33287a0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7efdb0003fd0 tx=0x7efdb002a8c0 comp rx=0 tx=0).stop 2024-09-10T22:31:00.707 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:00.666+0000 7efdc08f3740 1 -- 172.21.15.19:0/1513372461 shutdown_connections 2024-09-10T22:31:00.707 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:00.666+0000 7efdc08f3740 1 --2- 172.21.15.19:0/1513372461 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5628d3331790 0x5628d332bf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:31:00.707 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:00.666+0000 7efdc08f3740 1 --2- 172.21.15.19:0/1513372461 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5628d3325800 0x5628d332ba20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:31:00.707 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:00.666+0000 7efdc08f3740 1 --2- 172.21.15.19:0/1513372461 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5628d3324ee0 0x5628d33287a0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:31:00.708 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:00.666+0000 7efdc08f3740 1 -- 172.21.15.19:0/1513372461 >> 172.21.15.19:0/1513372461 conn(0x5628d3322d10 msgr2=0x5628d3328090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:31:00.708 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:00.666+0000 7efdc08f3740 1 -- 172.21.15.19:0/1513372461 shutdown_connections 2024-09-10T22:31:00.708 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:00.666+0000 7efdc08f3740 1 -- 172.21.15.19:0/1513372461 wait complete. 2024-09-10T22:31:00.708 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:00.666+0000 7efdc08f3740 1 -- start start 2024-09-10T22:31:00.708 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:00.666+0000 7efdc08f3740 1 Processor -- start 2024-09-10T22:31:00.708 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:00.667+0000 7efdc08f3740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5628d3324ee0 0x5628d3339e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:31:00.708 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:00.667+0000 7efdc08f3740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5628d3325800 0x5628d3336330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:31:00.708 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:00.667+0000 7efdc08f3740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5628d3331790 0x5628d3336a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:31:00.708 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:00.667+0000 7efdc08f3740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7efdb81b3150 con 0x5628d3331790 2024-09-10T22:31:00.708 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:00.667+0000 7efdc08f3740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7efdb81b45c0 con 0x5628d3325800 2024-09-10T22:31:00.708 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:00.667+0000 7efdc08f3740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7efdb81b3820 con 0x5628d3324ee0 2024-09-10T22:31:00.709 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:00.667+0000 7efdc08f3740 10 client.0 _ll_register_callbacks cb 0x7efdac009930 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T22:31:00.709 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:00.667+0000 7efdbcabb640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5628d3331790 0x5628d3336a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:31:00.709 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:00.667+0000 7efdbcabb640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5628d3331790 0x5628d3336a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:50330/0 (socket says 172.21.15.19:50330) 2024-09-10T22:31:00.709 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:00.667+0000 7efdbcabb640 1 -- 172.21.15.19:0/3711236992 learned_addr learned my addr 172.21.15.19:0/3711236992 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:31:00.709 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:00.667+0000 7efdb77fe640 1 --2- 172.21.15.19:0/3711236992 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5628d3325800 0x5628d3336330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:31:00.709 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:00.667+0000 7efdbcabb640 1 --2- 172.21.15.19:0/3711236992 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5628d3324ee0 0x5628d3339e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:31:00.709 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:00.667+0000 7efdbcabb640 1 -- 172.21.15.19:0/3711236992 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5628d3324ee0 msgr2=0x5628d3339e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:31:00.710 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:00.667+0000 7efdbcabb640 1 --2- 172.21.15.19:0/3711236992 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5628d3324ee0 0x5628d3339e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:31:00.710 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:00.667+0000 7efdbcabb640 1 -- 172.21.15.19:0/3711236992 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5628d3325800 msgr2=0x5628d3336330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:31:00.710 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:00.667+0000 7efdbcabb640 1 --2- 172.21.15.19:0/3711236992 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5628d3325800 0x5628d3336330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:31:00.710 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:00.667+0000 7efdbcabb640 1 -- 172.21.15.19:0/3711236992 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5628d332f6b0 con 0x5628d3331790 2024-09-10T22:31:00.710 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:00.667+0000 7efdbcabb640 1 --2- 172.21.15.19:0/3711236992 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5628d3331790 0x5628d3336a00 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7efdb0009620 tx=0x7efdb0005f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f020a3cf1d460f48 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:31:00.710 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:00.667+0000 7efd977fe640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-10T22:31:00.710 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:00.668+0000 7efd977fe640 1 -- 172.21.15.19:0/3711236992 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efdb0031bb0 con 0x5628d3331790 2024-09-10T22:31:00.710 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:00.668+0000 7efd977fe640 1 -- 172.21.15.19:0/3711236992 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8327+0+0 (secure 0 0 0) 0x7efdb0031d50 con 0x5628d3331790 2024-09-10T22:31:00.710 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:00.668+0000 7efdc08f3740 1 -- 172.21.15.19:0/3711236992 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7efdb0036040 con 0x5628d3331790 2024-09-10T22:31:00.711 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:00.668+0000 7efd977fe640 1 -- 172.21.15.19:0/3711236992 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7efdb0031550 con 0x5628d3331790 2024-09-10T22:31:00.711 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:00.668+0000 7efdc08f3740 10 client.16299 fetch_fsmap learned FSMap version 27 2024-09-10T22:31:00.711 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:00.668+0000 7efdc08f3740 1 -- 172.21.15.19:0/3711236992 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x5628d3323790 con 0x5628d3331790 2024-09-10T22:31:00.711 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:00.668+0000 7efd977fe640 1 -- 172.21.15.19:0/3711236992 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7efdb0036040 con 0x5628d3331790 2024-09-10T22:31:00.711 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:00.668+0000 7efd977fe640 1 -- 172.21.15.19:0/3711236992 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7efdb0043020 con 0x5628d3331790 2024-09-10T22:31:00.711 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:00.668+0000 7efdc08f3740 10 client.16299 fetch_fsmap finished waiting for FSMap version 27 2024-09-10T22:31:00.711 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:00.668+0000 7efdc08f3740 10 client.16299 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-10T22:31:00.711 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:00.668+0000 7efdc08f3740 20 client.16299 populate_metadata read hostname 'smithi019' 2024-09-10T22:31:00.711 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:00.668+0000 7efdc08f3740 1 --2- 172.21.15.19:0/3711236992 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x5628d33af6b0 0x5628d33b1ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:31:00.712 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:00.668+0000 7efdc08f3740 4 client.16299 mds_command: new command op to 24581 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-10T22:31:00.712 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:00.668+0000 7efdc08f3740 1 -- 172.21.15.19:0/3711236992 --> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x5628d3299860 con 0x5628d33af6b0 2024-09-10T22:31:00.712 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:00.669+0000 7efdb77fe640 1 --2- 172.21.15.19:0/3711236992 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x5628d33af6b0 0x5628d33b1ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:31:00.712 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:00.669+0000 7efdb77fe640 1 --2- 172.21.15.19:0/3711236992 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x5628d33af6b0 0x5628d33b1ad0 crc :-1 s=READY pgs=111 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a5da7b8a3e620b34 server_cookie=deb415f98750bd32 in_seq=0 out_seq=0 2024-09-10T22:31:00.712 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:00.669+0000 7efd977fe640 10 client.16299 ms_handle_connect on v2:172.21.15.135:6838/1254769802 2024-09-10T22:31:00.712 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:00.671+0000 7efd977fe640 1 -- 172.21.15.19:0/3711236992 <== mds.0 v2:172.21.15.135:6838/1254769802 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x5628d3299860 con 0x5628d33af6b0 2024-09-10T22:31:00.712 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:00.671+0000 7efd977fe640 10 client.16299 handle_command_reply: tid=0 2024-09-10T22:31:00.712 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:00.671+0000 7efdc08f3740 1 client.16299 shutdown 2024-09-10T22:31:00.712 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:00.671+0000 7efdc08f3740 1 -- 172.21.15.19:0/3711236992 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5628d3331790 msgr2=0x5628d3336a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:31:00.712 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:00.671+0000 7efdc08f3740 1 --2- 172.21.15.19:0/3711236992 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5628d3331790 0x5628d3336a00 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7efdb0009620 tx=0x7efdb0005f90 comp rx=0 tx=0).stop 2024-09-10T22:31:00.712 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:00.671+0000 7efdc08f3740 1 -- 172.21.15.19:0/3711236992 shutdown_connections 2024-09-10T22:31:00.712 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:00.671+0000 7efdc08f3740 1 --2- 172.21.15.19:0/3711236992 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5628d3331790 0x5628d3336a00 unknown :-1 s=CLOSED pgs=605 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:31:00.713 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:00.671+0000 7efdc08f3740 1 --2- 172.21.15.19:0/3711236992 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5628d3325800 0x5628d3336330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:31:00.713 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:00.671+0000 7efdc08f3740 1 --2- 172.21.15.19:0/3711236992 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x5628d33af6b0 0x5628d33b1ad0 crc :-1 s=READY pgs=111 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:31:00.713 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:00.671+0000 7efdc08f3740 1 --2- 172.21.15.19:0/3711236992 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5628d3324ee0 0x5628d3339e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:31:00.713 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:00.671+0000 7efd977fe640 0 client.16299 ms_handle_reset on v2:172.21.15.135:6838/1254769802 2024-09-10T22:31:00.713 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:00.671+0000 7efdc08f3740 1 -- 172.21.15.19:0/3711236992 >> 172.21.15.19:0/3711236992 conn(0x5628d3322d10 msgr2=0x5628d3321f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:31:00.713 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:00.671+0000 7efdc08f3740 1 -- 172.21.15.19:0/3711236992 shutdown_connections 2024-09-10T22:31:00.713 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:00.671+0000 7efdc08f3740 1 -- 172.21.15.19:0/3711236992 wait complete. 2024-09-10T22:31:00.713 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:00.672+0000 7efdc08f3740 20 client.16299 trim_cache size 0 max 16384 2024-09-10T22:31:00.713 INFO:teuthology.orchestra.run.smithi019.stdout:{ 2024-09-10T22:31:00.714 INFO:teuthology.orchestra.run.smithi019.stdout: "return_code": 0, 2024-09-10T22:31:00.714 INFO:teuthology.orchestra.run.smithi019.stdout: "scrub_tag": "715ec863-8a9d-45b6-967f-59b15ce1bf12", 2024-09-10T22:31:00.714 INFO:teuthology.orchestra.run.smithi019.stdout: "mode": "asynchronous" 2024-09-10T22:31:00.714 INFO:teuthology.orchestra.run.smithi019.stdout:} 2024-09-10T22:31:00.714 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:00.672+0000 7efdbe51e640 1 -- 172.21.15.19:0/170077422 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7efda00b52e0 msgr2=0x7efda00b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:31:00.714 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:00.672+0000 7efdbe51e640 1 --2- 172.21.15.19:0/170077422 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7efda00b52e0 0x7efda00b77a0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7efda801c000 tx=0x7efda80e8040 comp rx=0 tx=0).stop 2024-09-10T22:31:00.714 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:00.672+0000 7efdbe51e640 1 -- 172.21.15.19:0/170077422 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efdb8102de0 msgr2=0x7efdb8076f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:31:00.715 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:00.672+0000 7efdbe51e640 1 --2- 172.21.15.19:0/170077422 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efdb8102de0 0x7efdb8076f50 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7efda800e9f0 tx=0x7efda800edf0 comp rx=0 tx=0).stop 2024-09-10T22:31:00.715 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:00.672+0000 7efdbe51e640 1 -- 172.21.15.19:0/170077422 shutdown_connections 2024-09-10T22:31:00.715 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:00.672+0000 7efdbe51e640 1 --2- 172.21.15.19:0/170077422 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7efda00b52e0 0x7efda00b77a0 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:31:00.715 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:00.672+0000 7efdbe51e640 1 --2- 172.21.15.19:0/170077422 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7efdb8109170 0x7efdb8075ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:31:00.715 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:00.672+0000 7efdbe51e640 1 --2- 172.21.15.19:0/170077422 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7efdb81087f0 0x7efdb80754a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:31:00.715 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:00.672+0000 7efdbe51e640 1 --2- 172.21.15.19:0/170077422 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efdb8102de0 0x7efdb8076f50 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:31:00.715 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:00.672+0000 7efdbe51e640 1 -- 172.21.15.19:0/170077422 >> 172.21.15.19:0/170077422 conn(0x7efdb80fe830 msgr2=0x7efdb80ff060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:31:00.715 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:00.672+0000 7efdbe51e640 1 -- 172.21.15.19:0/170077422 shutdown_connections 2024-09-10T22:31:00.715 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:00.672+0000 7efdbe51e640 1 -- 172.21.15.19:0/170077422 wait complete. 2024-09-10T22:31:01.158 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:01.156+0000 7f71327fc640 1 -- 172.21.15.19:0/1470134831 <== mds.0 v2:172.21.15.135:6838/1254769802 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5609ce22c0f0 con 0x5609ce33ec80 2024-09-10T22:31:01.158 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:01.156+0000 7f71327fc640 10 client.25732 handle_command_reply: tid=0 2024-09-10T22:31:01.158 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:01.156+0000 7f7154447740 1 client.25732 shutdown 2024-09-10T22:31:01.158 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:01.156+0000 7f7154447740 1 -- 172.21.15.19:0/1470134831 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5609ce2bf190 msgr2=0x5609ce2cda90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:31:01.159 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:01.156+0000 7f7154447740 1 --2- 172.21.15.19:0/1470134831 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5609ce2bf190 0x5609ce2cda90 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f7134031f30 tx=0x7f71340319e0 comp rx=0 tx=0).stop 2024-09-10T22:31:01.159 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:01.156+0000 7f7154447740 1 -- 172.21.15.19:0/1470134831 shutdown_connections 2024-09-10T22:31:01.159 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:01.156+0000 7f7154447740 1 --2- 172.21.15.19:0/1470134831 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5609ce2c1bd0 0x5609ce336700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:31:01.159 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:01.156+0000 7f7154447740 1 --2- 172.21.15.19:0/1470134831 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x5609ce33ec80 0x5609ce3410a0 crc :-1 s=READY pgs=109 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:31:01.159 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:01.156+0000 7f7154447740 1 --2- 172.21.15.19:0/1470134831 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5609ce2bf190 0x5609ce2cda90 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:31:01.159 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:01.156+0000 7f7154447740 1 --2- 172.21.15.19:0/1470134831 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5609ce2bc860 0x5609ce2cd3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:31:01.159 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:01.156+0000 7f7154447740 1 -- 172.21.15.19:0/1470134831 >> 172.21.15.19:0/1470134831 conn(0x5609ce2b79b0 msgr2=0x5609ce2b6bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:31:01.159 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:01.156+0000 7f71327fc640 0 client.25732 ms_handle_reset on v2:172.21.15.135:6838/1254769802 2024-09-10T22:31:01.159 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:01.156+0000 7f7154447740 1 -- 172.21.15.19:0/1470134831 shutdown_connections 2024-09-10T22:31:01.159 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:01.156+0000 7f7154447740 1 -- 172.21.15.19:0/1470134831 wait complete. 2024-09-10T22:31:01.159 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:01.156+0000 7f7154447740 20 client.25732 trim_cache size 0 max 16384 2024-09-10T22:31:01.160 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stdout:{ 2024-09-10T22:31:01.160 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stdout: "message": "", 2024-09-10T22:31:01.160 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stdout: "return_code": 0 2024-09-10T22:31:01.160 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stdout:} 2024-09-10T22:31:01.161 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:01.158+0000 7f7151671640 1 -- 172.21.15.19:0/2125820416 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f71380b52e0 msgr2=0x7f71380b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:31:01.161 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:01.158+0000 7f7151671640 1 --2- 172.21.15.19:0/2125820416 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f71380b52e0 0x7f71380b77a0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f7134000c00 tx=0x7f713402a410 comp rx=0 tx=0).stop 2024-09-10T22:31:01.161 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:01.158+0000 7f7151671640 1 -- 172.21.15.19:0/2125820416 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f714c1086e0 msgr2=0x7f714c19a030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:31:01.161 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:01.158+0000 7f7151671640 1 --2- 172.21.15.19:0/2125820416 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f714c1086e0 0x7f714c19a030 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7f714400efd0 tx=0x7f714400c6a0 comp rx=0 tx=0).stop 2024-09-10T22:31:01.161 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:01.158+0000 7f7151671640 1 -- 172.21.15.19:0/2125820416 shutdown_connections 2024-09-10T22:31:01.161 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:01.158+0000 7f7151671640 1 --2- 172.21.15.19:0/2125820416 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f71380b52e0 0x7f71380b77a0 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:31:01.161 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:01.158+0000 7f7151671640 1 --2- 172.21.15.19:0/2125820416 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f714c1086e0 0x7f714c19a030 unknown :-1 s=CLOSED pgs=600 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:31:01.161 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:01.158+0000 7f7151671640 1 --2- 172.21.15.19:0/2125820416 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f714c105ac0 0x7f714c199470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:31:01.162 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:01.158+0000 7f7151671640 1 --2- 172.21.15.19:0/2125820416 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f714c06bc50 0x7f714c198e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:31:01.162 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:01.158+0000 7f7151671640 1 -- 172.21.15.19:0/2125820416 >> 172.21.15.19:0/2125820416 conn(0x7f714c0fd130 msgr2=0x7f714c103df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:31:01.162 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:01.158+0000 7f7151671640 1 -- 172.21.15.19:0/2125820416 shutdown_connections 2024-09-10T22:31:01.162 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:01.158+0000 7f7151671640 1 -- 172.21.15.19:0/2125820416 wait complete. 2024-09-10T22:31:01.848 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 22997a4c-6fc2-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-10T22:31:02.110 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:31:01 smithi135 ceph-mon[34789]: pgmap v485: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 928 KiB/s rd, 378 MiB/s wr, 378 op/s 2024-09-10T22:31:02.110 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:31:01 smithi135 ceph-mon[34789]: scrub queued for path: / 2024-09-10T22:31:02.110 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:31:01 smithi135 ceph-mon[34789]: scrub summary: idle+waiting paths [/] 2024-09-10T22:31:02.110 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:31:01 smithi135 ceph-mon[34789]: scrub summary: active paths [/] 2024-09-10T22:31:02.110 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:31:01 smithi135 ceph-mon[34789]: scrub summary: active paths [/] 2024-09-10T22:31:02.110 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:31:01 smithi135 ceph-mon[34789]: scrub summary: idle+waiting paths [/] 2024-09-10T22:31:02.110 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:31:01 smithi135 ceph-mon[34789]: scrub summary: idle+waiting paths [/] 2024-09-10T22:31:02.125 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:31:01 smithi138 ceph-mon[35236]: pgmap v485: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 928 KiB/s rd, 378 MiB/s wr, 378 op/s 2024-09-10T22:31:02.125 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:31:01 smithi138 ceph-mon[35236]: scrub queued for path: / 2024-09-10T22:31:02.125 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:31:01 smithi138 ceph-mon[35236]: scrub summary: idle+waiting paths [/] 2024-09-10T22:31:02.125 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:31:01 smithi138 ceph-mon[35236]: scrub summary: active paths [/] 2024-09-10T22:31:02.125 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:31:01 smithi138 ceph-mon[35236]: scrub summary: active paths [/] 2024-09-10T22:31:02.125 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:31:01 smithi138 ceph-mon[35236]: scrub summary: idle+waiting paths [/] 2024-09-10T22:31:02.126 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:31:01 smithi138 ceph-mon[35236]: scrub summary: idle+waiting paths [/] 2024-09-10T22:31:02.208 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:31:01 smithi019 ceph-mon[31375]: pgmap v485: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 928 KiB/s rd, 378 MiB/s wr, 378 op/s 2024-09-10T22:31:02.208 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:31:01 smithi019 ceph-mon[31375]: scrub queued for path: / 2024-09-10T22:31:02.209 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:31:01 smithi019 ceph-mon[31375]: scrub summary: idle+waiting paths [/] 2024-09-10T22:31:02.209 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:31:01 smithi019 ceph-mon[31375]: scrub summary: active paths [/] 2024-09-10T22:31:02.209 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:31:01 smithi019 ceph-mon[31375]: scrub summary: active paths [/] 2024-09-10T22:31:02.209 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:31:01 smithi019 ceph-mon[31375]: scrub summary: idle+waiting paths [/] 2024-09-10T22:31:02.209 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:31:01 smithi019 ceph-mon[31375]: scrub summary: idle+waiting paths [/] 2024-09-10T22:31:02.256 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/22997a4c-6fc2-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T22:31:03.240 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:03.158+0000 7fe8c49f6640 1 -- 172.21.15.19:0/2224329434 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe8c01076a0 msgr2=0x7fe8c0107ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:31:03.240 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:03.158+0000 7fe8c49f6640 1 --2- 172.21.15.19:0/2224329434 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe8c01076a0 0x7fe8c0107ae0 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7fe8a8009900 tx=0x7fe8a802a410 comp rx=0 tx=0).stop 2024-09-10T22:31:03.240 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:03.158+0000 7fe8c49f6640 1 -- 172.21.15.19:0/2224329434 shutdown_connections 2024-09-10T22:31:03.240 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:03.158+0000 7fe8c49f6640 1 --2- 172.21.15.19:0/2224329434 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe8c0108020 0x7fe8c010e820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:31:03.240 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:03.158+0000 7fe8c49f6640 1 --2- 172.21.15.19:0/2224329434 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe8c01076a0 0x7fe8c0107ae0 unknown :-1 s=CLOSED pgs=606 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:31:03.240 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:03.158+0000 7fe8c49f6640 1 --2- 172.21.15.19:0/2224329434 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe8c0101c90 0x7fe8c0102070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:31:03.240 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:03.158+0000 7fe8c49f6640 1 -- 172.21.15.19:0/2224329434 >> 172.21.15.19:0/2224329434 conn(0x7fe8c00fd700 msgr2=0x7fe8c00ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:31:03.241 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:03.159+0000 7fe8c49f6640 1 -- 172.21.15.19:0/2224329434 shutdown_connections 2024-09-10T22:31:03.241 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:03.159+0000 7fe8c49f6640 1 -- 172.21.15.19:0/2224329434 wait complete. 2024-09-10T22:31:03.241 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:03.159+0000 7fe8c49f6640 1 Processor -- start 2024-09-10T22:31:03.241 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:03.159+0000 7fe8c49f6640 1 -- start start 2024-09-10T22:31:03.241 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:03.160+0000 7fe8c49f6640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe8c0101c90 0x7fe8c01992c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:31:03.241 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:03.160+0000 7fe8c49f6640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe8c01076a0 0x7fe8c0199800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:31:03.241 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:03.160+0000 7fe8c49f6640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe8c0108020 0x7fe8c019eba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:31:03.241 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:03.160+0000 7fe8c49f6640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fe8c0111ca0 con 0x7fe8c0108020 2024-09-10T22:31:03.241 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:03.160+0000 7fe8c49f6640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fe8c0111b20 con 0x7fe8c0101c90 2024-09-10T22:31:03.241 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:03.160+0000 7fe8c49f6640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7fe8c0111e20 con 0x7fe8c01076a0 2024-09-10T22:31:03.241 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:03.160+0000 7fe8bed9d640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe8c0108020 0x7fe8c019eba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:31:03.241 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:03.160+0000 7fe8bed9d640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe8c0108020 0x7fe8c019eba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:50336/0 (socket says 172.21.15.19:50336) 2024-09-10T22:31:03.242 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:03.160+0000 7fe8b7fff640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe8c01076a0 0x7fe8c0199800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:31:03.242 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:03.160+0000 7fe8bed9d640 1 -- 172.21.15.19:0/716845843 learned_addr learned my addr 172.21.15.19:0/716845843 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:31:03.242 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:03.160+0000 7fe8be59c640 1 --2- 172.21.15.19:0/716845843 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe8c0101c90 0x7fe8c01992c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:31:03.242 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:03.160+0000 7fe8bed9d640 1 -- 172.21.15.19:0/716845843 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe8c01076a0 msgr2=0x7fe8c0199800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:31:03.242 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:03.160+0000 7fe8bed9d640 1 --2- 172.21.15.19:0/716845843 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe8c01076a0 0x7fe8c0199800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:31:03.242 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:03.160+0000 7fe8bed9d640 1 -- 172.21.15.19:0/716845843 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe8c0101c90 msgr2=0x7fe8c01992c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:31:03.242 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:03.160+0000 7fe8bed9d640 1 --2- 172.21.15.19:0/716845843 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe8c0101c90 0x7fe8c01992c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:31:03.242 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:03.160+0000 7fe8bed9d640 1 -- 172.21.15.19:0/716845843 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe8c019f370 con 0x7fe8c0108020 2024-09-10T22:31:03.242 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:03.160+0000 7fe8be59c640 1 --2- 172.21.15.19:0/716845843 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe8c0101c90 0x7fe8c01992c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T22:31:03.242 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:03.160+0000 7fe8bed9d640 1 --2- 172.21.15.19:0/716845843 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe8c0108020 0x7fe8c019eba0 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7fe8b800eaa0 tx=0x7fe8b800ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:31:03.242 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:03.161+0000 7fe8b77fe640 1 -- 172.21.15.19:0/716845843 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8b800cdb0 con 0x7fe8c0108020 2024-09-10T22:31:03.242 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:03.161+0000 7fe8b77fe640 1 -- 172.21.15.19:0/716845843 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe8b8005020 con 0x7fe8c0108020 2024-09-10T22:31:03.243 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:03.161+0000 7fe8b77fe640 1 -- 172.21.15.19:0/716845843 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8b80116d0 con 0x7fe8c0108020 2024-09-10T22:31:03.243 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:03.161+0000 7fe8c49f6640 1 -- 172.21.15.19:0/716845843 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe8c019f660 con 0x7fe8c0108020 2024-09-10T22:31:03.243 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:03.161+0000 7fe8c49f6640 1 -- 172.21.15.19:0/716845843 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe8c01a5ef0 con 0x7fe8c0108020 2024-09-10T22:31:03.243 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:03.163+0000 7fe8c6dcb740 1 Processor -- start 2024-09-10T22:31:03.243 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:03.163+0000 7fe8b77fe640 1 -- 172.21.15.19:0/716845843 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 18) ==== 153250+0+0 (secure 0 0 0) 0x7fe8b800f040 con 0x7fe8c0108020 2024-09-10T22:31:03.243 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:03.163+0000 7fe8c6dcb740 1 -- start start 2024-09-10T22:31:03.243 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:03.164+0000 7fe8c6dcb740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d1e9afe480 0x55d1e9afe860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:31:03.243 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:03.164+0000 7fe8c6dcb740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55d1e9afeda0 0x55d1e9b0ec00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:31:03.243 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:03.164+0000 7fe8c6dcb740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d1e9b0f140 0x55d1e9b11530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:31:03.243 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:03.164+0000 7fe8c6dcb740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x55d1e9a74e50 con 0x55d1e9afe480 2024-09-10T22:31:03.243 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:03.164+0000 7fe8c6dcb740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55d1e9a64280 con 0x55d1e9b0f140 2024-09-10T22:31:03.243 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:03.164+0000 7fe8c6dcb740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x55d1e9a68090 con 0x55d1e9afeda0 2024-09-10T22:31:03.243 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:03.164+0000 7fe8b7fff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d1e9afe480 0x55d1e9afe860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:31:03.243 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:03.164+0000 7fe8b7fff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d1e9afe480 0x55d1e9afe860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:50340/0 (socket says 172.21.15.19:50340) 2024-09-10T22:31:03.244 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:03.164+0000 7fe8b7fff640 1 -- 172.21.15.19:0/133569923 learned_addr learned my addr 172.21.15.19:0/133569923 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:31:03.244 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:03.164+0000 7fe8be59c640 1 --2- 172.21.15.19:0/133569923 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55d1e9afeda0 0x55d1e9b0ec00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:31:03.244 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:03.164+0000 7fe8b7fff640 1 -- 172.21.15.19:0/133569923 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55d1e9afeda0 msgr2=0x55d1e9b0ec00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:31:03.244 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:03.164+0000 7fe8b77fe640 1 --2- 172.21.15.19:0/716845843 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7fe8ac0b5360 0x7fe8ac0b7820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:31:03.244 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:03.164+0000 7fe8b7fff640 1 --2- 172.21.15.19:0/133569923 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55d1e9afeda0 0x55d1e9b0ec00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:31:03.244 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:03.164+0000 7fe8b7fff640 1 -- 172.21.15.19:0/133569923 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d1e9b0f140 msgr2=0x55d1e9b11530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:31:03.244 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:03.164+0000 7fe8b7fff640 1 --2- 172.21.15.19:0/133569923 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d1e9b0f140 0x55d1e9b11530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:31:03.244 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:03.164+0000 7fe8b7fff640 1 -- 172.21.15.19:0/133569923 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d1e97c2650 con 0x55d1e9afe480 2024-09-10T22:31:03.244 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:03.164+0000 7fe8be59c640 1 --2- 172.21.15.19:0/133569923 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55d1e9afeda0 0x55d1e9b0ec00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T22:31:03.244 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:03.165+0000 7fe8b77fe640 1 -- 172.21.15.19:0/716845843 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8327+0+0 (secure 0 0 0) 0x7fe8b80e5930 con 0x7fe8c0108020 2024-09-10T22:31:03.244 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:03.165+0000 7fe8b7fff640 1 --2- 172.21.15.19:0/133569923 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d1e9afe480 0x55d1e9afe860 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7fe8a8009900 tx=0x7fe8a8032c80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d21616f40824e684 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:31:03.244 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:03.165+0000 7fe8bed9d640 1 --2- 172.21.15.19:0/716845843 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7fe8ac0b5360 0x7fe8ac0b7820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:31:03.244 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:03.165+0000 7fe8b4ff9640 1 -- 172.21.15.19:0/133569923 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8a8040070 con 0x55d1e9afe480 2024-09-10T22:31:03.245 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:03.165+0000 7fe8b4ff9640 1 -- 172.21.15.19:0/133569923 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe8a8004030 con 0x55d1e9afe480 2024-09-10T22:31:03.245 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:03.165+0000 7fe8b4ff9640 1 -- 172.21.15.19:0/133569923 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8a8035040 con 0x55d1e9afe480 2024-09-10T22:31:03.245 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:03.166+0000 7fe8c6dcb740 1 -- 172.21.15.19:0/133569923 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d1e9afe480 msgr2=0x55d1e9afe860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:31:03.245 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:03.166+0000 7fe8c6dcb740 1 --2- 172.21.15.19:0/133569923 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d1e9afe480 0x55d1e9afe860 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7fe8a8009900 tx=0x7fe8a8032c80 comp rx=0 tx=0).stop 2024-09-10T22:31:03.245 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:03.166+0000 7fe8bed9d640 1 --2- 172.21.15.19:0/716845843 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7fe8ac0b5360 0x7fe8ac0b7820 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fe8b80abe40 tx=0x7fe8b8005890 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:31:03.245 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:03.166+0000 7fe8c6dcb740 1 -- 172.21.15.19:0/133569923 shutdown_connections 2024-09-10T22:31:03.245 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:03.166+0000 7fe8c6dcb740 1 --2- 172.21.15.19:0/133569923 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d1e9b0f140 0x55d1e9b11530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:31:03.245 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:03.166+0000 7fe8c6dcb740 1 --2- 172.21.15.19:0/133569923 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55d1e9afeda0 0x55d1e9b0ec00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:31:03.245 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:03.166+0000 7fe8c6dcb740 1 --2- 172.21.15.19:0/133569923 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d1e9afe480 0x55d1e9afe860 unknown :-1 s=CLOSED pgs=608 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:31:03.245 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:03.166+0000 7fe8c6dcb740 1 -- 172.21.15.19:0/133569923 >> 172.21.15.19:0/133569923 conn(0x55d1e9afc2b0 msgr2=0x55d1e9afd450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:31:03.245 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:03.166+0000 7fe8c6dcb740 1 -- 172.21.15.19:0/133569923 shutdown_connections 2024-09-10T22:31:03.245 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:03.166+0000 7fe8c6dcb740 1 -- 172.21.15.19:0/133569923 wait complete. 2024-09-10T22:31:03.245 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:03.167+0000 7fe8c6dcb740 1 -- start start 2024-09-10T22:31:03.245 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:03.167+0000 7fe8c6dcb740 1 Processor -- start 2024-09-10T22:31:03.246 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:03.167+0000 7fe8c6dcb740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d1e9afeda0 0x55d1e9b0c0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:31:03.246 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:03.167+0000 7fe8c6dcb740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d1e9b0f140 0x55d1e9b0c610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:31:03.246 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:03.167+0000 7fe8c6dcb740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55d1e9b0cb50 0x55d1e9b1b140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:31:03.246 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:03.167+0000 7fe8c6dcb740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x55d1e98c5700 con 0x55d1e9afeda0 2024-09-10T22:31:03.246 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:03.167+0000 7fe8c6dcb740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55d1e99ff110 con 0x55d1e9b0f140 2024-09-10T22:31:03.246 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:03.167+0000 7fe8c6dcb740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x55d1e9b11de0 con 0x55d1e9b0cb50 2024-09-10T22:31:03.246 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:03.167+0000 7fe8c6dcb740 10 client.0 _ll_register_callbacks cb 0x55d1e9a18990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T22:31:03.246 INFO:teuthology.orchestra.run.smithi019.stdout:{ 2024-09-10T22:31:03.246 INFO:teuthology.orchestra.run.smithi019.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-10T22:31:03.247 INFO:teuthology.orchestra.run.smithi019.stdout: "scrubs": { 2024-09-10T22:31:03.247 INFO:teuthology.orchestra.run.smithi019.stdout: "715ec863-8a9d-45b6-967f-59b15ce1bf12": { 2024-09-10T22:31:03.247 INFO:teuthology.orchestra.run.smithi019.stdout: "path": "/", 2024-09-10T22:31:03.247 INFO:teuthology.orchestra.run.smithi019.stdout: "tag": "715ec863-8a9d-45b6-967f-59b15ce1bf12", 2024-09-10T22:31:03.247 INFO:teuthology.orchestra.run.smithi019.stdout: "options": "recursive,force" 2024-09-10T22:31:03.247 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-10T22:31:03.247 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:31:03.247 INFO:teuthology.orchestra.run.smithi019.stdout: "scrub_stats": { 2024-09-10T22:31:03.247 INFO:teuthology.orchestra.run.smithi019.stdout: "715ec863-8a9d-45b6-967f-59b15ce1bf12": { 2024-09-10T22:31:03.247 INFO:teuthology.orchestra.run.smithi019.stdout: "start_time": "2024-09-10T22:31:00.669516+0000", 2024-09-10T22:31:03.247 INFO:teuthology.orchestra.run.smithi019.stdout: "path": "/", 2024-09-10T22:31:03.247 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_started": 0, 2024-09-10T22:31:03.248 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_passed": 0, 2024-09-10T22:31:03.248 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_failed": 0, 2024-09-10T22:31:03.248 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_skipped": 0 2024-09-10T22:31:03.248 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:31:03.248 INFO:teuthology.orchestra.run.smithi019.stdout: "fd1f1837-dcfa-4d88-99e8-2509f36c3f98": { 2024-09-10T22:31:03.248 INFO:teuthology.orchestra.run.smithi019.stdout: "start_time": "2024-09-10T22:30:12.470477+0000", 2024-09-10T22:31:03.248 INFO:teuthology.orchestra.run.smithi019.stdout: "path": "/", 2024-09-10T22:31:03.248 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_started": 0, 2024-09-10T22:31:03.248 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_passed": 0, 2024-09-10T22:31:03.248 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_failed": 0, 2024-09-10T22:31:03.248 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_skipped": 0 2024-09-10T22:31:03.248 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:31:03.249 INFO:teuthology.orchestra.run.smithi019.stdout: "8f3bb3bf-911f-490c-9856-c80ea220dbbe": { 2024-09-10T22:31:03.249 INFO:teuthology.orchestra.run.smithi019.stdout: "start_time": "2024-09-10T22:29:25.374415+0000", 2024-09-10T22:31:03.249 INFO:teuthology.orchestra.run.smithi019.stdout: "path": "/", 2024-09-10T22:31:03.249 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_started": 0, 2024-09-10T22:31:03.249 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_passed": 0, 2024-09-10T22:31:03.249 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_failed": 0, 2024-09-10T22:31:03.249 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_skipped": 0 2024-09-10T22:31:03.249 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:31:03.249 INFO:teuthology.orchestra.run.smithi019.stdout: "eb518e3c-a71e-4f32-9ca0-ae88930ca218": { 2024-09-10T22:31:03.249 INFO:teuthology.orchestra.run.smithi019.stdout: "start_time": "2024-09-10T22:28:38.366352+0000", 2024-09-10T22:31:03.249 INFO:teuthology.orchestra.run.smithi019.stdout: "path": "/", 2024-09-10T22:31:03.249 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_started": 0, 2024-09-10T22:31:03.249 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_passed": 0, 2024-09-10T22:31:03.250 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_failed": 0, 2024-09-10T22:31:03.250 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_skipped": 0 2024-09-10T22:31:03.250 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:31:03.250 INFO:teuthology.orchestra.run.smithi019.stdout: "c12c2a04-dcd6-4673-a98e-93f665d3f5d7": { 2024-09-10T22:31:03.250 INFO:teuthology.orchestra.run.smithi019.stdout: "start_time": "2024-09-10T22:27:49.392329+0000", 2024-09-10T22:31:03.250 INFO:teuthology.orchestra.run.smithi019.stdout: "path": "/", 2024-09-10T22:31:03.250 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_started": 0, 2024-09-10T22:31:03.250 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_passed": 0, 2024-09-10T22:31:03.250 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_failed": 0, 2024-09-10T22:31:03.250 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_skipped": 0 2024-09-10T22:31:03.250 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:31:03.250 INFO:teuthology.orchestra.run.smithi019.stdout: "b38852c8-478a-42ef-8384-b2c55d5313a4": { 2024-09-10T22:31:03.250 INFO:teuthology.orchestra.run.smithi019.stdout: "start_time": "2024-09-10T22:27:00.320308+0000", 2024-09-10T22:31:03.250 INFO:teuthology.orchestra.run.smithi019.stdout: "path": "/", 2024-09-10T22:31:03.251 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_started": 0, 2024-09-10T22:31:03.251 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_passed": 0, 2024-09-10T22:31:03.251 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_failed": 0, 2024-09-10T22:31:03.251 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_skipped": 0 2024-09-10T22:31:03.251 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:31:03.251 INFO:teuthology.orchestra.run.smithi019.stdout: "9b6bfdee-303c-4c12-af56-dc85860d112a": { 2024-09-10T22:31:03.251 INFO:teuthology.orchestra.run.smithi019.stdout: "start_time": "2024-09-10T22:26:17.484162+0000", 2024-09-10T22:31:03.251 INFO:teuthology.orchestra.run.smithi019.stdout: "path": "/", 2024-09-10T22:31:03.251 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_started": 0, 2024-09-10T22:31:03.251 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_passed": 0, 2024-09-10T22:31:03.251 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_failed": 0, 2024-09-10T22:31:03.251 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_skipped": 0 2024-09-10T22:31:03.251 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-10T22:31:03.251 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-10T22:31:03.252 INFO:teuthology.orchestra.run.smithi019.stdout:} 2024-09-10T22:31:03.252 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:03.167+0000 7fe8b7fff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d1e9afeda0 0x55d1e9b0c0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:31:03.252 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:03.167+0000 7fe8b7fff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d1e9afeda0 0x55d1e9b0c0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:50354/0 (socket says 172.21.15.19:50354) 2024-09-10T22:31:03.252 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:03.167+0000 7fe8b7fff640 1 -- 172.21.15.19:0/2513305019 learned_addr learned my addr 172.21.15.19:0/2513305019 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:31:03.252 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:03.167+0000 7fe8be59c640 1 --2- 172.21.15.19:0/2513305019 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d1e9b0f140 0x55d1e9b0c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:31:03.252 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:03.168+0000 7fe8b7fff640 1 --2- 172.21.15.19:0/2513305019 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55d1e9b0cb50 0x55d1e9b1b140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:31:03.252 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:03.168+0000 7fe8b7fff640 1 -- 172.21.15.19:0/2513305019 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55d1e9b0cb50 msgr2=0x55d1e9b1b140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:31:03.252 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:03.168+0000 7fe8b7fff640 1 --2- 172.21.15.19:0/2513305019 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55d1e9b0cb50 0x55d1e9b1b140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:31:03.253 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:03.168+0000 7fe8b7fff640 1 -- 172.21.15.19:0/2513305019 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d1e9b0f140 msgr2=0x55d1e9b0c610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:31:03.253 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:03.168+0000 7fe8b7fff640 1 --2- 172.21.15.19:0/2513305019 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d1e9b0f140 0x55d1e9b0c610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:31:03.253 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:03.168+0000 7fe8b7fff640 1 -- 172.21.15.19:0/2513305019 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d1e9a2cc40 con 0x55d1e9afeda0 2024-09-10T22:31:03.253 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:03.168+0000 7fe8b7fff640 1 --2- 172.21.15.19:0/2513305019 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d1e9afeda0 0x55d1e9b0c0d0 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7fe8a8009850 tx=0x7fe8a8005260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7a154f6631cc2c9a server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:31:03.253 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:03.168+0000 7fe8a5ffb640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-10T22:31:03.253 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:03.168+0000 7fe8a5ffb640 1 -- 172.21.15.19:0/2513305019 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8a8040040 con 0x55d1e9afeda0 2024-09-10T22:31:03.253 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:03.168+0000 7fe8a5ffb640 1 -- 172.21.15.19:0/2513305019 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8327+0+0 (secure 0 0 0) 0x7fe8a80043f0 con 0x55d1e9afeda0 2024-09-10T22:31:03.253 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:03.168+0000 7fe8c6dcb740 1 -- 172.21.15.19:0/2513305019 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe8a8004030 con 0x55d1e9afeda0 2024-09-10T22:31:03.253 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:03.168+0000 7fe8a5ffb640 1 -- 172.21.15.19:0/2513305019 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fe8a805a050 con 0x55d1e9afeda0 2024-09-10T22:31:03.253 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:03.168+0000 7fe8c6dcb740 10 client.16311 fetch_fsmap learned FSMap version 27 2024-09-10T22:31:03.253 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:03.168+0000 7fe8c6dcb740 1 -- 172.21.15.19:0/2513305019 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55d1e9b1dd20 con 0x55d1e9afeda0 2024-09-10T22:31:03.253 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:03.169+0000 7fe8a5ffb640 1 -- 172.21.15.19:0/2513305019 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe8a8004030 con 0x55d1e9afeda0 2024-09-10T22:31:03.254 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:03.169+0000 7fe8a5ffb640 1 -- 172.21.15.19:0/2513305019 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7fe8a8004ce0 con 0x55d1e9afeda0 2024-09-10T22:31:03.254 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:03.169+0000 7fe8c6dcb740 10 client.16311 fetch_fsmap finished waiting for FSMap version 27 2024-09-10T22:31:03.254 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:03.169+0000 7fe8c6dcb740 10 client.16311 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-10T22:31:03.254 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:03.169+0000 7fe8c6dcb740 20 client.16311 populate_metadata read hostname 'smithi019' 2024-09-10T22:31:03.254 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:03.169+0000 7fe8c6dcb740 1 --2- 172.21.15.19:0/2513305019 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x55d1e9b1f070 0x55d1e9b21460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:31:03.254 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:03.169+0000 7fe8c6dcb740 4 client.16311 mds_command: new command op to 24581 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T22:31:03.254 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:03.169+0000 7fe8c6dcb740 1 -- 172.21.15.19:0/2513305019 --> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d1e9a76da0 con 0x55d1e9b1f070 2024-09-10T22:31:03.254 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:03.169+0000 7fe8be59c640 1 --2- 172.21.15.19:0/2513305019 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x55d1e9b1f070 0x55d1e9b21460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:31:03.254 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:03.170+0000 7fe8be59c640 1 --2- 172.21.15.19:0/2513305019 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x55d1e9b1f070 0x55d1e9b21460 crc :-1 s=READY pgs=112 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=57847f1199540fed server_cookie=9efbf7cc64a5b53c in_seq=0 out_seq=0 2024-09-10T22:31:03.254 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:03.170+0000 7fe8a5ffb640 10 client.16311 ms_handle_connect on v2:172.21.15.135:6838/1254769802 2024-09-10T22:31:03.254 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:03.170+0000 7fe8a5ffb640 1 -- 172.21.15.19:0/2513305019 <== mds.0 v2:172.21.15.135:6838/1254769802 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55d1e9a76da0 con 0x55d1e9b1f070 2024-09-10T22:31:03.254 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:03.170+0000 7fe8a5ffb640 10 client.16311 handle_command_reply: tid=0 2024-09-10T22:31:03.254 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:03.170+0000 7fe8c6dcb740 1 client.16311 shutdown 2024-09-10T22:31:03.255 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:03.171+0000 7fe8c6dcb740 1 -- 172.21.15.19:0/2513305019 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d1e9afeda0 msgr2=0x55d1e9b0c0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:31:03.255 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:03.171+0000 7fe8c6dcb740 1 --2- 172.21.15.19:0/2513305019 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d1e9afeda0 0x55d1e9b0c0d0 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7fe8a8009850 tx=0x7fe8a8005260 comp rx=0 tx=0).stop 2024-09-10T22:31:03.255 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:03.171+0000 7fe8c6dcb740 1 -- 172.21.15.19:0/2513305019 shutdown_connections 2024-09-10T22:31:03.255 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:03.171+0000 7fe8c6dcb740 1 --2- 172.21.15.19:0/2513305019 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x55d1e9b1f070 0x55d1e9b21460 crc :-1 s=READY pgs=112 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:31:03.255 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:03.171+0000 7fe8c6dcb740 1 --2- 172.21.15.19:0/2513305019 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55d1e9b0cb50 0x55d1e9b1b140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:31:03.255 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:03.171+0000 7fe8c6dcb740 1 --2- 172.21.15.19:0/2513305019 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d1e9b0f140 0x55d1e9b0c610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:31:03.255 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:03.171+0000 7fe8a5ffb640 0 client.16311 ms_handle_reset on v2:172.21.15.135:6838/1254769802 2024-09-10T22:31:03.255 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:03.171+0000 7fe8c6dcb740 1 --2- 172.21.15.19:0/2513305019 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d1e9afeda0 0x55d1e9b0c0d0 unknown :-1 s=CLOSED pgs=609 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:31:03.255 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:03.171+0000 7fe8c6dcb740 1 -- 172.21.15.19:0/2513305019 >> 172.21.15.19:0/2513305019 conn(0x55d1e9afc2b0 msgr2=0x55d1e9b01de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:31:03.255 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:03.171+0000 7fe8c6dcb740 1 -- 172.21.15.19:0/2513305019 shutdown_connections 2024-09-10T22:31:03.255 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:03.171+0000 7fe8c6dcb740 1 -- 172.21.15.19:0/2513305019 wait complete. 2024-09-10T22:31:03.255 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:03.171+0000 7fe8c6dcb740 20 client.16311 trim_cache size 0 max 16384 2024-09-10T22:31:03.256 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:03.190+0000 7fe8c6dcb740 1 Processor -- start 2024-09-10T22:31:03.256 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:03.190+0000 7fe8c6dcb740 1 -- start start 2024-09-10T22:31:03.256 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:03.190+0000 7fe8c6dcb740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d1e9b0cb50 0x55d1e9afbbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:31:03.256 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:03.190+0000 7fe8c6dcb740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55d1e9b0f140 0x55d1e9b0ddc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:31:03.256 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:03.190+0000 7fe8c6dcb740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d1e9b1b0b0 0x55d1e9b1b540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:31:03.256 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:03.190+0000 7fe8c6dcb740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fe8c01aeb70 con 0x55d1e9b0cb50 2024-09-10T22:31:03.256 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:03.190+0000 7fe8c6dcb740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fe8c01ac440 con 0x55d1e9b1b0b0 2024-09-10T22:31:03.256 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:03.190+0000 7fe8c6dcb740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7fe8c01aa290 con 0x55d1e9b0f140 2024-09-10T22:31:03.256 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:03.190+0000 7fe8b7fff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d1e9b0cb50 0x55d1e9afbbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:31:03.256 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:03.190+0000 7fe8b7fff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d1e9b0cb50 0x55d1e9afbbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:50362/0 (socket says 172.21.15.19:50362) 2024-09-10T22:31:03.256 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:03.190+0000 7fe8b7fff640 1 -- 172.21.15.19:0/739229514 learned_addr learned my addr 172.21.15.19:0/739229514 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:31:03.256 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:03.191+0000 7fe8be59c640 1 --2- 172.21.15.19:0/739229514 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55d1e9b0f140 0x55d1e9b0ddc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:31:03.257 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:03.191+0000 7fe8b7fff640 1 --2- 172.21.15.19:0/739229514 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d1e9b1b0b0 0x55d1e9b1b540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:31:03.257 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:03.191+0000 7fe8b7fff640 1 -- 172.21.15.19:0/739229514 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55d1e9b0f140 msgr2=0x55d1e9b0ddc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:31:03.257 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:03.191+0000 7fe8b7fff640 1 --2- 172.21.15.19:0/739229514 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55d1e9b0f140 0x55d1e9b0ddc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:31:03.257 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:03.191+0000 7fe8b7fff640 1 -- 172.21.15.19:0/739229514 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d1e9b1b0b0 msgr2=0x55d1e9b1b540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:31:03.257 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:03.191+0000 7fe8b7fff640 1 --2- 172.21.15.19:0/739229514 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d1e9b1b0b0 0x55d1e9b1b540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:31:03.257 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:03.191+0000 7fe8b7fff640 1 -- 172.21.15.19:0/739229514 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d1e9b0a010 con 0x55d1e9b0cb50 2024-09-10T22:31:03.257 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:03.191+0000 7fe8be59c640 1 --2- 172.21.15.19:0/739229514 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55d1e9b0f140 0x55d1e9b0ddc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T22:31:03.257 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:03.191+0000 7fe8b7fff640 1 --2- 172.21.15.19:0/739229514 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d1e9b0cb50 0x55d1e9afbbc0 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7fe8a8005df0 tx=0x7fe8a8009600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7976a70e53ca7a87 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:31:03.257 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:03.191+0000 7fe8a7fff640 1 -- 172.21.15.19:0/739229514 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8a8040070 con 0x55d1e9b0cb50 2024-09-10T22:31:03.257 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:03.191+0000 7fe8a7fff640 1 -- 172.21.15.19:0/739229514 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe8a80043f0 con 0x55d1e9b0cb50 2024-09-10T22:31:03.257 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:03.191+0000 7fe8a7fff640 1 -- 172.21.15.19:0/739229514 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8a8035030 con 0x55d1e9b0cb50 2024-09-10T22:31:03.257 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:03.192+0000 7fe8c6dcb740 1 -- 172.21.15.19:0/739229514 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d1e9b0cb50 msgr2=0x55d1e9afbbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:31:03.258 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:03.192+0000 7fe8c6dcb740 1 --2- 172.21.15.19:0/739229514 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d1e9b0cb50 0x55d1e9afbbc0 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7fe8a8005df0 tx=0x7fe8a8009600 comp rx=0 tx=0).stop 2024-09-10T22:31:03.258 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:03.192+0000 7fe8c6dcb740 1 -- 172.21.15.19:0/739229514 shutdown_connections 2024-09-10T22:31:03.258 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:03.192+0000 7fe8c6dcb740 1 --2- 172.21.15.19:0/739229514 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d1e9b1b0b0 0x55d1e9b1b540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:31:03.258 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:03.192+0000 7fe8c6dcb740 1 --2- 172.21.15.19:0/739229514 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55d1e9b0f140 0x55d1e9b0ddc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:31:03.258 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:03.192+0000 7fe8c6dcb740 1 --2- 172.21.15.19:0/739229514 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d1e9b0cb50 0x55d1e9afbbc0 unknown :-1 s=CLOSED pgs=610 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:31:03.258 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:03.192+0000 7fe8c6dcb740 1 -- 172.21.15.19:0/739229514 >> 172.21.15.19:0/739229514 conn(0x55d1e9afc2b0 msgr2=0x55d1e9b0d6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:31:03.258 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:03.192+0000 7fe8c6dcb740 1 -- 172.21.15.19:0/739229514 shutdown_connections 2024-09-10T22:31:03.258 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:03.192+0000 7fe8c6dcb740 1 -- 172.21.15.19:0/739229514 wait complete. 2024-09-10T22:31:03.258 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:03.192+0000 7fe8c6dcb740 1 -- start start 2024-09-10T22:31:03.258 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:03.193+0000 7fe8c6dcb740 1 Processor -- start 2024-09-10T22:31:03.258 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:03.193+0000 7fe8c6dcb740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d1e9b0cb50 0x55d1e9b24e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:31:03.258 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:03.193+0000 7fe8c6dcb740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55d1e9b0f140 0x55d1e9b23360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:31:03.258 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:03.193+0000 7fe8c6dcb740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d1e9b1b0b0 0x55d1e9b23af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:31:03.259 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:03.193+0000 7fe8c6dcb740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fe8c01aa900 con 0x55d1e9b1b0b0 2024-09-10T22:31:03.259 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:03.193+0000 7fe8c6dcb740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fe8c01abd70 con 0x55d1e9b0cb50 2024-09-10T22:31:03.259 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:03.193+0000 7fe8c6dcb740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7fe8c01aafd0 con 0x55d1e9b0f140 2024-09-10T22:31:03.259 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:03.193+0000 7fe8c6dcb740 10 client.0 _ll_register_callbacks cb 0x7fe8b0009b50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T22:31:03.259 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:03.193+0000 7fe8b7fff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d1e9b0cb50 0x55d1e9b24e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:31:03.259 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:03.193+0000 7fe8b7fff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d1e9b1b0b0 0x55d1e9b23af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:31:03.259 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:03.193+0000 7fe8be59c640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55d1e9b0f140 0x55d1e9b23360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:31:03.259 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:03.193+0000 7fe8b7fff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d1e9b1b0b0 0x55d1e9b23af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:50370/0 (socket says 172.21.15.19:50370) 2024-09-10T22:31:03.259 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:03.193+0000 7fe8b7fff640 1 -- 172.21.15.19:0/1172514492 learned_addr learned my addr 172.21.15.19:0/1172514492 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:31:03.259 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:03.193+0000 7fe8b7fff640 1 -- 172.21.15.19:0/1172514492 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55d1e9b0f140 msgr2=0x55d1e9b23360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:31:03.259 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:03.193+0000 7fe8b7fff640 1 --2- 172.21.15.19:0/1172514492 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55d1e9b0f140 0x55d1e9b23360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:31:03.259 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:03.193+0000 7fe8b7fff640 1 -- 172.21.15.19:0/1172514492 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d1e9b0cb50 msgr2=0x55d1e9b24e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:31:03.260 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:03.193+0000 7fe8b7fff640 1 --2- 172.21.15.19:0/1172514492 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d1e9b0cb50 0x55d1e9b24e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:31:03.260 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:03.193+0000 7fe8b7fff640 1 -- 172.21.15.19:0/1172514492 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d1e9b8bbf0 con 0x55d1e9b1b0b0 2024-09-10T22:31:03.260 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:03.193+0000 7fe8be59c640 1 --2- 172.21.15.19:0/1172514492 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55d1e9b0f140 0x55d1e9b23360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T22:31:03.260 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:03.194+0000 7fe8b7fff640 1 --2- 172.21.15.19:0/1172514492 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d1e9b1b0b0 0x55d1e9b23af0 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7fe8a8005390 tx=0x7fe8a8031400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e4be236eeb1b8635 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:31:03.260 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:03.194+0000 7fe8a5ffb640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-10T22:31:03.260 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:03.194+0000 7fe8a5ffb640 1 -- 172.21.15.19:0/1172514492 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8a8040070 con 0x55d1e9b1b0b0 2024-09-10T22:31:03.260 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:03.194+0000 7fe8a5ffb640 1 -- 172.21.15.19:0/1172514492 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8327+0+0 (secure 0 0 0) 0x7fe8a8032d70 con 0x55d1e9b1b0b0 2024-09-10T22:31:03.260 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:03.194+0000 7fe8c6dcb740 1 -- 172.21.15.19:0/1172514492 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe8a80043f0 con 0x55d1e9b1b0b0 2024-09-10T22:31:03.260 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:03.194+0000 7fe8a5ffb640 1 -- 172.21.15.19:0/1172514492 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fe8a8035040 con 0x55d1e9b1b0b0 2024-09-10T22:31:03.260 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:03.194+0000 7fe8c6dcb740 10 client.16317 fetch_fsmap learned FSMap version 27 2024-09-10T22:31:03.260 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:03.194+0000 7fe8c6dcb740 1 -- 172.21.15.19:0/1172514492 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55d1e9b8ce30 con 0x55d1e9b1b0b0 2024-09-10T22:31:03.260 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:03.194+0000 7fe8a5ffb640 1 -- 172.21.15.19:0/1172514492 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe8a80043f0 con 0x55d1e9b1b0b0 2024-09-10T22:31:03.260 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:03.194+0000 7fe8a5ffb640 1 -- 172.21.15.19:0/1172514492 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7fe8a8004bf0 con 0x55d1e9b1b0b0 2024-09-10T22:31:03.261 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:03.194+0000 7fe8c6dcb740 10 client.16317 fetch_fsmap finished waiting for FSMap version 27 2024-09-10T22:31:03.261 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:03.194+0000 7fe8c6dcb740 10 client.16317 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-10T22:31:03.261 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:03.194+0000 7fe8c6dcb740 20 client.16317 populate_metadata read hostname 'smithi019' 2024-09-10T22:31:03.261 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:03.194+0000 7fe8c6dcb740 1 --2- 172.21.15.19:0/1172514492 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x55d1e9b8d220 0x55d1e9b8f640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:31:03.261 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:03.194+0000 7fe8c6dcb740 4 client.16317 mds_command: new command op to 24581 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-10T22:31:03.261 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:03.194+0000 7fe8c6dcb740 1 -- 172.21.15.19:0/1172514492 --> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55d1e9a72850 con 0x55d1e9b8d220 2024-09-10T22:31:03.261 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:03.195+0000 7fe8be59c640 1 --2- 172.21.15.19:0/1172514492 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x55d1e9b8d220 0x55d1e9b8f640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:31:03.261 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:03.195+0000 7fe8a5ffb640 10 client.16317 ms_handle_connect on v2:172.21.15.135:6838/1254769802 2024-09-10T22:31:03.262 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:03.195+0000 7fe8be59c640 1 --2- 172.21.15.19:0/1172514492 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x55d1e9b8d220 0x55d1e9b8f640 crc :-1 s=READY pgs=113 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=63588dd1882ce135 server_cookie=1d9d23a8f8ac29e1 in_seq=0 out_seq=0 2024-09-10T22:31:03.262 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:03.195+0000 7fe8a5ffb640 1 -- 172.21.15.19:0/1172514492 <== mds.0 v2:172.21.15.135:6838/1254769802 1 ==== command_reply(tid 0: 0 ) ==== 8+0+2274 (crc 0 0 0) 0x55d1e9a72850 con 0x55d1e9b8d220 2024-09-10T22:31:03.262 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:03.195+0000 7fe8a5ffb640 10 client.16317 handle_command_reply: tid=0 2024-09-10T22:31:03.262 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:03.195+0000 7fe8c6dcb740 1 client.16317 shutdown 2024-09-10T22:31:03.262 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:03.195+0000 7fe8c6dcb740 1 -- 172.21.15.19:0/1172514492 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d1e9b1b0b0 msgr2=0x55d1e9b23af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:31:03.262 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:03.195+0000 7fe8c6dcb740 1 --2- 172.21.15.19:0/1172514492 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d1e9b1b0b0 0x55d1e9b23af0 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7fe8a8005390 tx=0x7fe8a8031400 comp rx=0 tx=0).stop 2024-09-10T22:31:03.262 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:03.195+0000 7fe8c6dcb740 1 -- 172.21.15.19:0/1172514492 shutdown_connections 2024-09-10T22:31:03.262 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:03.195+0000 7fe8c6dcb740 1 --2- 172.21.15.19:0/1172514492 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d1e9b1b0b0 0x55d1e9b23af0 unknown :-1 s=CLOSED pgs=611 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:31:03.262 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:03.195+0000 7fe8c6dcb740 1 --2- 172.21.15.19:0/1172514492 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x55d1e9b8d220 0x55d1e9b8f640 crc :-1 s=READY pgs=113 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:31:03.262 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:03.195+0000 7fe8c6dcb740 1 --2- 172.21.15.19:0/1172514492 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55d1e9b0f140 0x55d1e9b23360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:31:03.262 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:03.195+0000 7fe8c6dcb740 1 --2- 172.21.15.19:0/1172514492 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d1e9b0cb50 0x55d1e9b24e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:31:03.262 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:03.195+0000 7fe8c6dcb740 1 -- 172.21.15.19:0/1172514492 >> 172.21.15.19:0/1172514492 conn(0x55d1e9afc2b0 msgr2=0x55d1e9b1a8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:31:03.263 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:03.196+0000 7fe8a5ffb640 0 client.16317 ms_handle_reset on v2:172.21.15.135:6838/1254769802 2024-09-10T22:31:03.263 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:03.196+0000 7fe8c6dcb740 1 -- 172.21.15.19:0/1172514492 shutdown_connections 2024-09-10T22:31:03.263 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:03.196+0000 7fe8c6dcb740 1 -- 172.21.15.19:0/1172514492 wait complete. 2024-09-10T22:31:03.263 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:03.196+0000 7fe8c6dcb740 20 client.16317 trim_cache size 0 max 16384 2024-09-10T22:31:03.263 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:03.196+0000 7fe8c49f6640 1 -- 172.21.15.19:0/716845843 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7fe8ac0b5360 msgr2=0x7fe8ac0b7820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:31:03.263 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:03.196+0000 7fe8c49f6640 1 --2- 172.21.15.19:0/716845843 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7fe8ac0b5360 0x7fe8ac0b7820 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fe8b80abe40 tx=0x7fe8b8005890 comp rx=0 tx=0).stop 2024-09-10T22:31:03.263 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:03.196+0000 7fe8c49f6640 1 -- 172.21.15.19:0/716845843 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe8c0108020 msgr2=0x7fe8c019eba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:31:03.263 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:03.196+0000 7fe8c49f6640 1 --2- 172.21.15.19:0/716845843 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe8c0108020 0x7fe8c019eba0 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7fe8b800eaa0 tx=0x7fe8b800ef60 comp rx=0 tx=0).stop 2024-09-10T22:31:03.263 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:03.196+0000 7fe8c49f6640 1 -- 172.21.15.19:0/716845843 shutdown_connections 2024-09-10T22:31:03.263 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:03.196+0000 7fe8c49f6640 1 --2- 172.21.15.19:0/716845843 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7fe8ac0b5360 0x7fe8ac0b7820 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:31:03.263 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:03.196+0000 7fe8c49f6640 1 --2- 172.21.15.19:0/716845843 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe8c0108020 0x7fe8c019eba0 unknown :-1 s=CLOSED pgs=607 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:31:03.263 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:03.196+0000 7fe8c49f6640 1 --2- 172.21.15.19:0/716845843 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe8c01076a0 0x7fe8c0199800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:31:03.264 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:03.196+0000 7fe8c49f6640 1 --2- 172.21.15.19:0/716845843 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe8c0101c90 0x7fe8c01992c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:31:03.264 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:03.196+0000 7fe8c49f6640 1 -- 172.21.15.19:0/716845843 >> 172.21.15.19:0/716845843 conn(0x7fe8c00fd700 msgr2=0x7fe8c01047a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:31:03.264 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:03.197+0000 7fe8c49f6640 1 -- 172.21.15.19:0/716845843 shutdown_connections 2024-09-10T22:31:03.264 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:03.197+0000 7fe8c49f6640 1 -- 172.21.15.19:0/716845843 wait complete. 2024-09-10T22:31:03.875 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:31:03 smithi138 ceph-mon[35236]: pgmap v486: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 692 KiB/s rd, 329 MiB/s wr, 126 op/s 2024-09-10T22:31:04.110 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:31:03 smithi135 ceph-mon[34789]: pgmap v486: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 692 KiB/s rd, 329 MiB/s wr, 126 op/s 2024-09-10T22:31:04.208 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:31:03 smithi019 ceph-mon[31375]: pgmap v486: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 692 KiB/s rd, 329 MiB/s wr, 126 op/s 2024-09-10T22:31:04.595 INFO:tasks.cephfs.filesystem:scrub status for tag:715ec863-8a9d-45b6-967f-59b15ce1bf12 - {'path': '/', 'tag': '715ec863-8a9d-45b6-967f-59b15ce1bf12', 'options': 'recursive,force'} 2024-09-10T22:31:06.110 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:31:05 smithi135 ceph-mon[34789]: pgmap v487: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 693 KiB/s rd, 341 MiB/s wr, 136 op/s 2024-09-10T22:31:06.125 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:31:05 smithi138 ceph-mon[35236]: pgmap v487: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 693 KiB/s rd, 341 MiB/s wr, 136 op/s 2024-09-10T22:31:06.209 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:31:05 smithi019 ceph-mon[31375]: pgmap v487: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 693 KiB/s rd, 341 MiB/s wr, 136 op/s 2024-09-10T22:31:08.110 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:31:07 smithi135 ceph-mon[34789]: pgmap v488: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 690 KiB/s rd, 365 MiB/s wr, 194 op/s 2024-09-10T22:31:08.110 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:31:07 smithi135 ceph-mon[34789]: scrub summary: idle 2024-09-10T22:31:08.110 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:31:07 smithi135 ceph-mon[34789]: scrub summary: idle 2024-09-10T22:31:08.125 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:31:07 smithi138 ceph-mon[35236]: pgmap v488: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 690 KiB/s rd, 365 MiB/s wr, 194 op/s 2024-09-10T22:31:08.125 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:31:07 smithi138 ceph-mon[35236]: scrub summary: idle 2024-09-10T22:31:08.125 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:31:07 smithi138 ceph-mon[35236]: scrub summary: idle 2024-09-10T22:31:08.208 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:31:07 smithi019 ceph-mon[31375]: pgmap v488: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 690 KiB/s rd, 365 MiB/s wr, 194 op/s 2024-09-10T22:31:08.208 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:31:07 smithi019 ceph-mon[31375]: scrub summary: idle 2024-09-10T22:31:08.209 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:31:07 smithi019 ceph-mon[31375]: scrub summary: idle 2024-09-10T22:31:10.109 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:31:09 smithi135 ceph-mon[34789]: pgmap v489: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 688 KiB/s rd, 318 MiB/s wr, 218 op/s 2024-09-10T22:31:10.125 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:31:09 smithi138 ceph-mon[35236]: pgmap v489: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 688 KiB/s rd, 318 MiB/s wr, 218 op/s 2024-09-10T22:31:10.208 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:31:09 smithi019 ceph-mon[31375]: pgmap v489: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 688 KiB/s rd, 318 MiB/s wr, 218 op/s 2024-09-10T22:31:11.958 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:31:11 smithi019 ceph-mon[31375]: pgmap v490: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 364 MiB/s wr, 377 op/s 2024-09-10T22:31:12.110 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:31:11 smithi135 ceph-mon[34789]: pgmap v490: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 364 MiB/s wr, 377 op/s 2024-09-10T22:31:12.125 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:31:11 smithi138 ceph-mon[35236]: pgmap v490: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 364 MiB/s wr, 377 op/s 2024-09-10T22:31:14.110 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:31:13 smithi135 ceph-mon[34789]: pgmap v491: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 683 KiB/s rd, 312 MiB/s wr, 399 op/s 2024-09-10T22:31:14.125 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:31:13 smithi138 ceph-mon[35236]: pgmap v491: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 683 KiB/s rd, 312 MiB/s wr, 399 op/s 2024-09-10T22:31:14.213 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:31:13 smithi019 ceph-mon[31375]: pgmap v491: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 683 KiB/s rd, 312 MiB/s wr, 399 op/s 2024-09-10T22:31:14.347 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:14.342+0000 7fdf3eb0e640 1 -- 172.21.15.19:0/2548143896 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdf38103370 msgr2=0x7fdf38109cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:31:14.347 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:14.342+0000 7fdf3eb0e640 1 --2- 172.21.15.19:0/2548143896 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdf38103370 0x7fdf38109cf0 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7fdf30009cd0 tx=0x7fdf3002a8e0 comp rx=0 tx=0).stop 2024-09-10T22:31:14.347 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:14.342+0000 7fdf3eb0e640 1 -- 172.21.15.19:0/2548143896 shutdown_connections 2024-09-10T22:31:14.347 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:14.342+0000 7fdf3eb0e640 1 --2- 172.21.15.19:0/2548143896 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdf38103370 0x7fdf38109cf0 unknown :-1 s=CLOSED pgs=612 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:31:14.347 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:14.342+0000 7fdf3eb0e640 1 --2- 172.21.15.19:0/2548143896 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fdf381029b0 0x7fdf38102e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:31:14.347 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:14.342+0000 7fdf3eb0e640 1 --2- 172.21.15.19:0/2548143896 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdf38101860 0x7fdf38101c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:31:14.347 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:14.342+0000 7fdf3eb0e640 1 -- 172.21.15.19:0/2548143896 >> 172.21.15.19:0/2548143896 conn(0x7fdf380fd140 msgr2=0x7fdf380ff560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:31:14.347 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:14.342+0000 7fdf3eb0e640 1 -- 172.21.15.19:0/2548143896 shutdown_connections 2024-09-10T22:31:14.348 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:14.342+0000 7fdf3eb0e640 1 -- 172.21.15.19:0/2548143896 wait complete. 2024-09-10T22:31:14.348 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:14.343+0000 7fdf3eb0e640 1 Processor -- start 2024-09-10T22:31:14.348 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:14.343+0000 7fdf3eb0e640 1 -- start start 2024-09-10T22:31:14.348 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:14.343+0000 7fdf3eb0e640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdf38101860 0x7fdf3806b1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:31:14.348 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:14.343+0000 7fdf3eb0e640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fdf381029b0 0x7fdf3819da60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:31:14.348 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:14.343+0000 7fdf3eb0e640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdf38103370 0x7fdf381a0080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:31:14.348 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:14.343+0000 7fdf3eb0e640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fdf3810d520 con 0x7fdf38101860 2024-09-10T22:31:14.348 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:14.343+0000 7fdf3eb0e640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fdf3810d3a0 con 0x7fdf38103370 2024-09-10T22:31:14.348 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:14.343+0000 7fdf3eb0e640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7fdf3810d6a0 con 0x7fdf381029b0 2024-09-10T22:31:14.348 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:14.343+0000 7fdf3c8aa640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdf38101860 0x7fdf3806b1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:31:14.348 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:14.343+0000 7fdf3c8aa640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdf38101860 0x7fdf3806b1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:34012/0 (socket says 172.21.15.19:34012) 2024-09-10T22:31:14.349 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:14.343+0000 7fdf3c8aa640 1 -- 172.21.15.19:0/2153400629 learned_addr learned my addr 172.21.15.19:0/2153400629 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:31:14.349 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:14.343+0000 7fdf37fff640 1 --2- 172.21.15.19:0/2153400629 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fdf381029b0 0x7fdf3819da60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:31:14.349 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:14.343+0000 7fdf3d0ab640 1 --2- 172.21.15.19:0/2153400629 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdf38103370 0x7fdf381a0080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:31:14.349 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:14.344+0000 7fdf3c8aa640 1 -- 172.21.15.19:0/2153400629 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fdf381029b0 msgr2=0x7fdf3819da60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:31:14.349 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:14.344+0000 7fdf3c8aa640 1 --2- 172.21.15.19:0/2153400629 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fdf381029b0 0x7fdf3819da60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:31:14.349 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:14.344+0000 7fdf3c8aa640 1 -- 172.21.15.19:0/2153400629 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdf38103370 msgr2=0x7fdf381a0080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:31:14.349 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:14.344+0000 7fdf3c8aa640 1 --2- 172.21.15.19:0/2153400629 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdf38103370 0x7fdf381a0080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:31:14.349 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:14.344+0000 7fdf3c8aa640 1 -- 172.21.15.19:0/2153400629 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdf381a0990 con 0x7fdf38101860 2024-09-10T22:31:14.349 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:14.344+0000 7fdf3c8aa640 1 --2- 172.21.15.19:0/2153400629 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdf38101860 0x7fdf3806b1a0 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7fdf2c00e9f0 tx=0x7fdf2c00eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:31:14.349 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:14.344+0000 7fdf35ffb640 1 -- 172.21.15.19:0/2153400629 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf2c00cd80 con 0x7fdf38101860 2024-09-10T22:31:14.349 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:14.344+0000 7fdf35ffb640 1 -- 172.21.15.19:0/2153400629 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fdf2c0108e0 con 0x7fdf38101860 2024-09-10T22:31:14.349 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:14.344+0000 7fdf3eb0e640 1 -- 172.21.15.19:0/2153400629 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdf381a0c20 con 0x7fdf38101860 2024-09-10T22:31:14.350 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:14.344+0000 7fdf35ffb640 1 -- 172.21.15.19:0/2153400629 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf2c018980 con 0x7fdf38101860 2024-09-10T22:31:14.350 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:14.345+0000 7fdf3eb0e640 1 -- 172.21.15.19:0/2153400629 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdf381a1170 con 0x7fdf38101860 2024-09-10T22:31:14.352 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:14.347+0000 7fdf35ffb640 1 -- 172.21.15.19:0/2153400629 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 18) ==== 153250+0+0 (secure 0 0 0) 0x7fdf2c010430 con 0x7fdf38101860 2024-09-10T22:31:14.352 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:14.348+0000 7fdf35ffb640 1 --2- 172.21.15.19:0/2153400629 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7fdf280b52e0 0x7fdf280b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:31:14.352 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:14.349+0000 7fdf37fff640 1 --2- 172.21.15.19:0/2153400629 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7fdf280b52e0 0x7fdf280b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:31:14.353 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:14.349+0000 7fdf35ffb640 1 -- 172.21.15.19:0/2153400629 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8327+0+0 (secure 0 0 0) 0x7fdf2c0e5f20 con 0x7fdf38101860 2024-09-10T22:31:14.353 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:14.349+0000 7fdf37fff640 1 --2- 172.21.15.19:0/2153400629 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7fdf280b52e0 0x7fdf280b77a0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7fdf24009bd0 tx=0x7fdf24005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:31:14.353 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:14.349+0000 7fdf418d8740 1 Processor -- start 2024-09-10T22:31:14.353 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:14.350+0000 7fdf418d8740 1 -- start start 2024-09-10T22:31:14.353 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:14.350+0000 7fdf418d8740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x563626072860 0x563626074c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:31:14.353 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:14.350+0000 7fdf418d8740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x563626075190 0x563626077580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:31:14.353 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:14.350+0000 7fdf418d8740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563626077bd0 0x56362607a090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:31:14.353 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:14.350+0000 7fdf418d8740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x563625fe46f0 con 0x563626075190 2024-09-10T22:31:14.353 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:14.350+0000 7fdf418d8740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x563625fd3b20 con 0x563626077bd0 2024-09-10T22:31:14.353 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:14.350+0000 7fdf418d8740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x563625fd7930 con 0x563626072860 2024-09-10T22:31:14.354 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:14.350+0000 7fdf37fff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x563626075190 0x563626077580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:31:14.354 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:14.350+0000 7fdf3d0ab640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563626077bd0 0x56362607a090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:31:14.354 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:14.350+0000 7fdf37fff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x563626075190 0x563626077580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:34024/0 (socket says 172.21.15.19:34024) 2024-09-10T22:31:14.354 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:14.350+0000 7fdf37fff640 1 -- 172.21.15.19:0/3524461413 learned_addr learned my addr 172.21.15.19:0/3524461413 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:31:14.354 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:14.350+0000 7fdf3c8aa640 1 --2- 172.21.15.19:0/3524461413 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x563626072860 0x563626074c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:31:14.354 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:14.350+0000 7fdf3d0ab640 1 -- 172.21.15.19:0/3524461413 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x563626072860 msgr2=0x563626074c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:31:14.354 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:14.350+0000 7fdf3d0ab640 1 --2- 172.21.15.19:0/3524461413 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x563626072860 0x563626074c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:31:14.354 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:14.350+0000 7fdf3d0ab640 1 -- 172.21.15.19:0/3524461413 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x563626075190 msgr2=0x563626077580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:31:14.354 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:14.350+0000 7fdf3d0ab640 1 --2- 172.21.15.19:0/3524461413 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x563626075190 0x563626077580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:31:14.354 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:14.350+0000 7fdf3d0ab640 1 -- 172.21.15.19:0/3524461413 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563625f99530 con 0x563626077bd0 2024-09-10T22:31:14.354 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:14.351+0000 7fdf3d0ab640 1 --2- 172.21.15.19:0/3524461413 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563626077bd0 0x56362607a090 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fdf3002ae00 tx=0x7fdf30009a20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=669e954cd03eff1e server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:31:14.355 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:14.351+0000 7fdf22ffd640 1 -- 172.21.15.19:0/3524461413 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf30048070 con 0x563626077bd0 2024-09-10T22:31:14.355 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:14.351+0000 7fdf22ffd640 1 -- 172.21.15.19:0/3524461413 <== mon.2 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fdf30036070 con 0x563626077bd0 2024-09-10T22:31:14.355 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:14.351+0000 7fdf22ffd640 1 -- 172.21.15.19:0/3524461413 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf30004460 con 0x563626077bd0 2024-09-10T22:31:14.359 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:14.352+0000 7fdf418d8740 1 -- 172.21.15.19:0/3524461413 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563626077bd0 msgr2=0x56362607a090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:31:14.360 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:14.352+0000 7fdf418d8740 1 --2- 172.21.15.19:0/3524461413 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563626077bd0 0x56362607a090 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fdf3002ae00 tx=0x7fdf30009a20 comp rx=0 tx=0).stop 2024-09-10T22:31:14.360 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:14.352+0000 7fdf418d8740 1 -- 172.21.15.19:0/3524461413 shutdown_connections 2024-09-10T22:31:14.360 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:14.352+0000 7fdf418d8740 1 --2- 172.21.15.19:0/3524461413 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563626077bd0 0x56362607a090 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:31:14.360 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:14.352+0000 7fdf418d8740 1 --2- 172.21.15.19:0/3524461413 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x563626075190 0x563626077580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:31:14.360 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:14.352+0000 7fdf418d8740 1 --2- 172.21.15.19:0/3524461413 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x563626072860 0x563626074c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:31:14.360 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:14.352+0000 7fdf418d8740 1 -- 172.21.15.19:0/3524461413 >> 172.21.15.19:0/3524461413 conn(0x56362606d9b0 msgr2=0x56362606e740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:31:14.360 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:14.352+0000 7fdf418d8740 1 -- 172.21.15.19:0/3524461413 shutdown_connections 2024-09-10T22:31:14.360 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:14.352+0000 7fdf418d8740 1 -- 172.21.15.19:0/3524461413 wait complete. 2024-09-10T22:31:14.360 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:14.353+0000 7fdf418d8740 1 -- start start 2024-09-10T22:31:14.360 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:14.353+0000 7fdf418d8740 1 Processor -- start 2024-09-10T22:31:14.360 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:14.353+0000 7fdf418d8740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x563626072860 0x563626080330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:31:14.361 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:14.353+0000 7fdf418d8740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563626075190 0x5636260809d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:31:14.361 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:14.353+0000 7fdf418d8740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x563626077bd0 0x5636260815a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:31:14.361 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:14.353+0000 7fdf418d8740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x563625f0bab0 con 0x563626072860 2024-09-10T22:31:14.361 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:14.353+0000 7fdf418d8740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x563625f79730 con 0x563626075190 2024-09-10T22:31:14.361 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:14.353+0000 7fdf418d8740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x56362607ef60 con 0x563626077bd0 2024-09-10T22:31:14.361 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:14.353+0000 7fdf418d8740 10 client.0 _ll_register_callbacks cb 0x563625fcd6b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T22:31:14.361 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:14.354+0000 7fdf3d0ab640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x563626077bd0 0x5636260815a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:31:14.361 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:14.354+0000 7fdf3c8aa640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x563626072860 0x563626080330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:31:14.361 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:14.354+0000 7fdf3d0ab640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x563626077bd0 0x5636260815a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.19:43390/0 (socket says 172.21.15.19:43390) 2024-09-10T22:31:14.361 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:14.354+0000 7fdf3d0ab640 1 -- 172.21.15.19:0/2051603999 learned_addr learned my addr 172.21.15.19:0/2051603999 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:31:14.361 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:14.354+0000 7fdf37fff640 1 --2- 172.21.15.19:0/2051603999 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563626075190 0x5636260809d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:31:14.361 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:14.354+0000 7fdf3d0ab640 1 -- 172.21.15.19:0/2051603999 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563626075190 msgr2=0x5636260809d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:31:14.362 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:14.354+0000 7fdf3d0ab640 1 --2- 172.21.15.19:0/2051603999 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563626075190 0x5636260809d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:31:14.362 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:14.354+0000 7fdf3d0ab640 1 -- 172.21.15.19:0/2051603999 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x563626072860 msgr2=0x563626080330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:31:14.362 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:14.354+0000 7fdf3d0ab640 1 --2- 172.21.15.19:0/2051603999 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x563626072860 0x563626080330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:31:14.362 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:14.354+0000 7fdf3d0ab640 1 -- 172.21.15.19:0/2051603999 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563625d35790 con 0x563626077bd0 2024-09-10T22:31:14.362 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:14.354+0000 7fdf3d0ab640 1 --2- 172.21.15.19:0/2051603999 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x563626077bd0 0x5636260815a0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fdf30009bf0 tx=0x7fdf30031d80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=315c1b35668cf3e5 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:31:14.362 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:14.354+0000 7fdf17fff640 10 client.0 ms_handle_connect on v2:172.21.15.138:3300/0 2024-09-10T22:31:14.362 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:14.354+0000 7fdf17fff640 1 -- 172.21.15.19:0/2051603999 <== mon.1 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf30048040 con 0x563626077bd0 2024-09-10T22:31:14.362 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:14.354+0000 7fdf17fff640 1 -- 172.21.15.19:0/2051603999 <== mon.1 v2:172.21.15.138:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8327+0+0 (secure 0 0 0) 0x7fdf30003c30 con 0x563626077bd0 2024-09-10T22:31:14.362 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:14.354+0000 7fdf418d8740 1 -- 172.21.15.19:0/2051603999 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fdf30036070 con 0x563626077bd0 2024-09-10T22:31:14.362 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:14.355+0000 7fdf17fff640 1 -- 172.21.15.19:0/2051603999 <== mon.1 v2:172.21.15.138:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fdf300041e0 con 0x563626077bd0 2024-09-10T22:31:14.362 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:14.355+0000 7fdf418d8740 10 client.25780 fetch_fsmap learned FSMap version 27 2024-09-10T22:31:14.363 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:14.355+0000 7fdf418d8740 1 -- 172.21.15.19:0/2051603999 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x563625dae620 con 0x563626077bd0 2024-09-10T22:31:14.363 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:14.355+0000 7fdf17fff640 1 -- 172.21.15.19:0/2051603999 <== mon.1 v2:172.21.15.138:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fdf30036070 con 0x563626077bd0 2024-09-10T22:31:14.363 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:14.355+0000 7fdf17fff640 1 -- 172.21.15.19:0/2051603999 <== mon.1 v2:172.21.15.138:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7fdf3004b030 con 0x563626077bd0 2024-09-10T22:31:14.363 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:14.355+0000 7fdf418d8740 10 client.25780 fetch_fsmap finished waiting for FSMap version 27 2024-09-10T22:31:14.363 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:14.355+0000 7fdf418d8740 10 client.25780 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-10T22:31:14.363 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:14.355+0000 7fdf418d8740 20 client.25780 populate_metadata read hostname 'smithi019' 2024-09-10T22:31:14.363 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:14.355+0000 7fdf418d8740 1 --2- 172.21.15.19:0/2051603999 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x56362608b7d0 0x56362608dbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:31:14.363 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:14.355+0000 7fdf418d8740 4 client.25780 mds_command: new command op to 24581 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T22:31:14.363 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:14.355+0000 7fdf418d8740 1 -- 172.21.15.19:0/2051603999 --> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x563625fe6640 con 0x56362608b7d0 2024-09-10T22:31:14.363 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:14.356+0000 7fdf3c8aa640 1 --2- 172.21.15.19:0/2051603999 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x56362608b7d0 0x56362608dbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:31:14.363 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:14.356+0000 7fdf17fff640 10 client.25780 ms_handle_connect on v2:172.21.15.135:6838/1254769802 2024-09-10T22:31:14.363 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:14.356+0000 7fdf3c8aa640 1 --2- 172.21.15.19:0/2051603999 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x56362608b7d0 0x56362608dbc0 crc :-1 s=READY pgs=114 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f5ccbda8d2401c1e server_cookie=d2b3f60c7ef0edbb in_seq=0 out_seq=0 2024-09-10T22:31:14.363 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:14.357+0000 7fdf17fff640 1 -- 172.21.15.19:0/2051603999 <== mds.0 v2:172.21.15.135:6838/1254769802 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x563625fe6640 con 0x56362608b7d0 2024-09-10T22:31:14.364 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:14.357+0000 7fdf17fff640 10 client.25780 handle_command_reply: tid=0 2024-09-10T22:31:14.364 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:14.357+0000 7fdf418d8740 1 client.25780 shutdown 2024-09-10T22:31:14.364 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:14.357+0000 7fdf418d8740 1 -- 172.21.15.19:0/2051603999 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x563626077bd0 msgr2=0x5636260815a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:31:14.364 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:14.357+0000 7fdf418d8740 1 --2- 172.21.15.19:0/2051603999 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x563626077bd0 0x5636260815a0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fdf30009bf0 tx=0x7fdf30031d80 comp rx=0 tx=0).stop 2024-09-10T22:31:14.364 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:14.357+0000 7fdf418d8740 1 -- 172.21.15.19:0/2051603999 shutdown_connections 2024-09-10T22:31:14.364 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:14.357+0000 7fdf418d8740 1 --2- 172.21.15.19:0/2051603999 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x56362608b7d0 0x56362608dbc0 crc :-1 s=READY pgs=114 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:31:14.364 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:14.357+0000 7fdf418d8740 1 --2- 172.21.15.19:0/2051603999 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x563626077bd0 0x5636260815a0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:31:14.364 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:14.357+0000 7fdf418d8740 1 --2- 172.21.15.19:0/2051603999 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563626075190 0x5636260809d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:31:14.364 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:14.357+0000 7fdf17fff640 0 client.25780 ms_handle_reset on v2:172.21.15.135:6838/1254769802 2024-09-10T22:31:14.364 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:14.357+0000 7fdf418d8740 1 --2- 172.21.15.19:0/2051603999 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x563626072860 0x563626080330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:31:14.364 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:14.357+0000 7fdf418d8740 1 -- 172.21.15.19:0/2051603999 >> 172.21.15.19:0/2051603999 conn(0x56362606d9b0 msgr2=0x56362606cbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:31:14.364 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:14.357+0000 7fdf418d8740 1 -- 172.21.15.19:0/2051603999 shutdown_connections 2024-09-10T22:31:14.365 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:14.357+0000 7fdf418d8740 1 -- 172.21.15.19:0/2051603999 wait complete. 2024-09-10T22:31:14.365 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:14.357+0000 7fdf418d8740 20 client.25780 trim_cache size 0 max 16384 2024-09-10T22:31:14.377 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:14.374+0000 7fdf418d8740 1 Processor -- start 2024-09-10T22:31:14.377 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:14.374+0000 7fdf418d8740 1 -- start start 2024-09-10T22:31:14.377 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:14.374+0000 7fdf418d8740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x563626072860 0x563626081580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:31:14.377 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:14.374+0000 7fdf418d8740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563626075190 0x563626071dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:31:14.377 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:14.374+0000 7fdf418d8740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x563626077bd0 0x563626077fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:31:14.377 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:14.374+0000 7fdf418d8740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fdf381aa670 con 0x563626072860 2024-09-10T22:31:14.377 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:14.374+0000 7fdf418d8740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fdf381a7f40 con 0x563626075190 2024-09-10T22:31:14.377 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:14.374+0000 7fdf418d8740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7fdf381a5d90 con 0x563626077bd0 2024-09-10T22:31:14.378 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:14.374+0000 7fdf3c8aa640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x563626072860 0x563626081580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:31:14.378 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:14.374+0000 7fdf3c8aa640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x563626072860 0x563626081580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:34048/0 (socket says 172.21.15.19:34048) 2024-09-10T22:31:14.378 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:14.374+0000 7fdf3c8aa640 1 -- 172.21.15.19:0/364649129 learned_addr learned my addr 172.21.15.19:0/364649129 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:31:14.378 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:14.374+0000 7fdf37fff640 1 --2- 172.21.15.19:0/364649129 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563626075190 0x563626071dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:31:14.378 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:14.374+0000 7fdf3d0ab640 1 --2- 172.21.15.19:0/364649129 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x563626077bd0 0x563626077fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:31:14.378 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:14.374+0000 7fdf3c8aa640 1 -- 172.21.15.19:0/364649129 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x563626077bd0 msgr2=0x563626077fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:31:14.378 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:14.374+0000 7fdf3c8aa640 1 --2- 172.21.15.19:0/364649129 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x563626077bd0 0x563626077fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:31:14.378 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:14.374+0000 7fdf3c8aa640 1 -- 172.21.15.19:0/364649129 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563626075190 msgr2=0x563626071dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:31:14.379 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:14.374+0000 7fdf3c8aa640 1 --2- 172.21.15.19:0/364649129 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563626075190 0x563626071dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:31:14.379 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:14.374+0000 7fdf3c8aa640 1 -- 172.21.15.19:0/364649129 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56362608e1f0 con 0x563626072860 2024-09-10T22:31:14.379 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:14.375+0000 7fdf3c8aa640 1 --2- 172.21.15.19:0/364649129 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x563626072860 0x563626081580 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7fdf2c0a99a0 tx=0x7fdf2c0e3890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5f63bc891c5044b1 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:31:14.379 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:14.375+0000 7fdf227fc640 1 -- 172.21.15.19:0/364649129 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf2c0b5e60 con 0x563626072860 2024-09-10T22:31:14.379 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:14.375+0000 7fdf227fc640 1 -- 172.21.15.19:0/364649129 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fdf2c0b1160 con 0x563626072860 2024-09-10T22:31:14.379 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:14.375+0000 7fdf227fc640 1 -- 172.21.15.19:0/364649129 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf2c018d80 con 0x563626072860 2024-09-10T22:31:14.383 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:14.376+0000 7fdf418d8740 1 -- 172.21.15.19:0/364649129 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x563626072860 msgr2=0x563626081580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:31:14.383 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:14.376+0000 7fdf418d8740 1 --2- 172.21.15.19:0/364649129 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x563626072860 0x563626081580 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7fdf2c0a99a0 tx=0x7fdf2c0e3890 comp rx=0 tx=0).stop 2024-09-10T22:31:14.383 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:14.376+0000 7fdf418d8740 1 -- 172.21.15.19:0/364649129 shutdown_connections 2024-09-10T22:31:14.383 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:14.376+0000 7fdf418d8740 1 --2- 172.21.15.19:0/364649129 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x563626077bd0 0x563626077fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:31:14.383 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:14.376+0000 7fdf418d8740 1 --2- 172.21.15.19:0/364649129 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563626075190 0x563626071dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:31:14.383 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:14.376+0000 7fdf418d8740 1 --2- 172.21.15.19:0/364649129 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x563626072860 0x563626081580 unknown :-1 s=CLOSED pgs=614 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:31:14.383 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:14.376+0000 7fdf418d8740 1 -- 172.21.15.19:0/364649129 >> 172.21.15.19:0/364649129 conn(0x56362606d9b0 msgr2=0x56362606e5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:31:14.383 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:14.376+0000 7fdf418d8740 1 -- 172.21.15.19:0/364649129 shutdown_connections 2024-09-10T22:31:14.383 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:14.376+0000 7fdf418d8740 1 -- 172.21.15.19:0/364649129 wait complete. 2024-09-10T22:31:14.384 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:14.376+0000 7fdf418d8740 1 -- start start 2024-09-10T22:31:14.384 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:14.377+0000 7fdf418d8740 1 Processor -- start 2024-09-10T22:31:14.384 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:14.377+0000 7fdf418d8740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x563626072860 0x5636260852a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:31:14.384 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:14.377+0000 7fdf418d8740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563626075190 0x563626085940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:31:14.384 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:14.377+0000 7fdf418d8740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x563626077bd0 0x563626086510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:31:14.384 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:14.377+0000 7fdf418d8740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fdf381a6400 con 0x563626077bd0 2024-09-10T22:31:14.384 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:14.377+0000 7fdf418d8740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fdf381a7870 con 0x563626075190 2024-09-10T22:31:14.384 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:14.377+0000 7fdf418d8740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7fdf381a6ad0 con 0x563626072860 2024-09-10T22:31:14.384 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:14.377+0000 7fdf418d8740 10 client.0 _ll_register_callbacks cb 0x7fdf30046070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T22:31:14.384 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:14.377+0000 7fdf3d0ab640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x563626077bd0 0x563626086510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:31:14.384 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:14.377+0000 7fdf37fff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563626075190 0x563626085940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:31:14.384 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:14.377+0000 7fdf3d0ab640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x563626077bd0 0x563626086510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:34064/0 (socket says 172.21.15.19:34064) 2024-09-10T22:31:14.385 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:14.377+0000 7fdf3d0ab640 1 -- 172.21.15.19:0/1826602163 learned_addr learned my addr 172.21.15.19:0/1826602163 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:31:14.385 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:14.378+0000 7fdf3c8aa640 1 --2- 172.21.15.19:0/1826602163 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x563626072860 0x5636260852a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:31:14.385 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:14.378+0000 7fdf37fff640 1 -- 172.21.15.19:0/1826602163 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x563626072860 msgr2=0x5636260852a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:31:14.385 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:14.378+0000 7fdf37fff640 1 --2- 172.21.15.19:0/1826602163 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x563626072860 0x5636260852a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:31:14.385 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:14.378+0000 7fdf37fff640 1 -- 172.21.15.19:0/1826602163 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x563626077bd0 msgr2=0x563626086510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:31:14.385 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:14.378+0000 7fdf37fff640 1 --2- 172.21.15.19:0/1826602163 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x563626077bd0 0x563626086510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:31:14.385 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:14.378+0000 7fdf37fff640 1 -- 172.21.15.19:0/1826602163 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563626086d40 con 0x563626075190 2024-09-10T22:31:14.385 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:14.378+0000 7fdf3c8aa640 1 --2- 172.21.15.19:0/1826602163 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x563626072860 0x5636260852a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T22:31:14.385 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:14.378+0000 7fdf37fff640 1 --2- 172.21.15.19:0/1826602163 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563626075190 0x563626085940 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fdf24004170 tx=0x7fdf24004730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1326f661f957b3a0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:31:14.385 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:14.378+0000 7fdf17fff640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-09-10T22:31:14.385 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:14.378+0000 7fdf17fff640 1 -- 172.21.15.19:0/1826602163 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf24005020 con 0x563626075190 2024-09-10T22:31:14.385 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:14.378+0000 7fdf17fff640 1 -- 172.21.15.19:0/1826602163 <== mon.2 v2:172.21.15.135:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8327+0+0 (secure 0 0 0) 0x7fdf240051c0 con 0x563626075190 2024-09-10T22:31:14.386 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:14.378+0000 7fdf418d8740 1 -- 172.21.15.19:0/1826602163 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fdf2c0b1160 con 0x563626075190 2024-09-10T22:31:14.386 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:14.378+0000 7fdf17fff640 1 -- 172.21.15.19:0/1826602163 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fdf240053c0 con 0x563626075190 2024-09-10T22:31:14.386 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:14.378+0000 7fdf418d8740 10 client.25766 fetch_fsmap learned FSMap version 27 2024-09-10T22:31:14.386 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:14.378+0000 7fdf418d8740 1 -- 172.21.15.19:0/1826602163 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x563626088180 con 0x563626075190 2024-09-10T22:31:14.386 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:14.379+0000 7fdf17fff640 1 -- 172.21.15.19:0/1826602163 <== mon.2 v2:172.21.15.135:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fdf2c0b1160 con 0x563626075190 2024-09-10T22:31:14.386 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:14.379+0000 7fdf17fff640 1 -- 172.21.15.19:0/1826602163 <== mon.2 v2:172.21.15.135:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7fdf24028070 con 0x563626075190 2024-09-10T22:31:14.386 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:14.379+0000 7fdf418d8740 10 client.25766 fetch_fsmap finished waiting for FSMap version 27 2024-09-10T22:31:14.386 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:14.379+0000 7fdf418d8740 10 client.25766 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-10T22:31:14.386 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:14.379+0000 7fdf418d8740 20 client.25766 populate_metadata read hostname 'smithi019' 2024-09-10T22:31:14.386 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:14.379+0000 7fdf418d8740 1 --2- 172.21.15.19:0/1826602163 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x5636260f8b50 0x5636260faf70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:31:14.387 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:14.379+0000 7fdf418d8740 4 client.25766 mds_command: new command op to 24581 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-10T22:31:14.387 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:14.379+0000 7fdf418d8740 1 -- 172.21.15.19:0/1826602163 --> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] -- command(tid 0: {"prefix": "flush journal"}) -- 0x563625fe20f0 con 0x5636260f8b50 2024-09-10T22:31:14.387 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:14.379+0000 7fdf3c8aa640 1 --2- 172.21.15.19:0/1826602163 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x5636260f8b50 0x5636260faf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:31:14.387 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:14.379+0000 7fdf3c8aa640 1 --2- 172.21.15.19:0/1826602163 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x5636260f8b50 0x5636260faf70 crc :-1 s=READY pgs=115 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3e04bb0e5917409b server_cookie=19972933bfc7e0ef in_seq=0 out_seq=0 2024-09-10T22:31:14.387 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:14.379+0000 7fdf17fff640 10 client.25766 ms_handle_connect on v2:172.21.15.135:6838/1254769802 2024-09-10T22:31:16.210 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:31:15 smithi019 ceph-mon[31375]: pgmap v492: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 908 KiB/s rd, 320 MiB/s wr, 416 op/s 2024-09-10T22:31:16.361 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:31:15 smithi135 ceph-mon[34789]: pgmap v492: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 908 KiB/s rd, 320 MiB/s wr, 416 op/s 2024-09-10T22:31:16.375 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:31:15 smithi138 ceph-mon[35236]: pgmap v492: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 908 KiB/s rd, 320 MiB/s wr, 416 op/s 2024-09-10T22:31:18.208 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:31:17 smithi019 ceph-mon[31375]: pgmap v493: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 908 KiB/s rd, 339 MiB/s wr, 430 op/s 2024-09-10T22:31:18.359 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:31:17 smithi135 ceph-mon[34789]: pgmap v493: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 908 KiB/s rd, 339 MiB/s wr, 430 op/s 2024-09-10T22:31:18.375 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:31:17 smithi138 ceph-mon[35236]: pgmap v493: 97 pgs: 97 active+clean; 10 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 908 KiB/s rd, 339 MiB/s wr, 430 op/s 2024-09-10T22:31:20.359 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:31:19 smithi135 ceph-mon[34789]: pgmap v494: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 570 KiB/s rd, 298 MiB/s wr, 367 op/s 2024-09-10T22:31:20.375 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:31:19 smithi138 ceph-mon[35236]: pgmap v494: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 570 KiB/s rd, 298 MiB/s wr, 367 op/s 2024-09-10T22:31:20.458 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:31:19 smithi019 ceph-mon[31375]: pgmap v494: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 570 KiB/s rd, 298 MiB/s wr, 367 op/s 2024-09-10T22:31:20.956 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:20.953+0000 7fdf17fff640 1 -- 172.21.15.19:0/1826602163 <== mds.0 v2:172.21.15.135:6838/1254769802 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x563625fe20f0 con 0x5636260f8b50 2024-09-10T22:31:20.956 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:20.953+0000 7fdf17fff640 10 client.25766 handle_command_reply: tid=0 2024-09-10T22:31:20.956 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:20.953+0000 7fdf418d8740 1 client.25766 shutdown 2024-09-10T22:31:20.956 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:20.954+0000 7fdf418d8740 1 -- 172.21.15.19:0/1826602163 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563626075190 msgr2=0x563626085940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:31:20.956 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:20.954+0000 7fdf418d8740 1 --2- 172.21.15.19:0/1826602163 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563626075190 0x563626085940 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fdf24004170 tx=0x7fdf24004730 comp rx=0 tx=0).stop 2024-09-10T22:31:20.956 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:20.954+0000 7fdf418d8740 1 -- 172.21.15.19:0/1826602163 shutdown_connections 2024-09-10T22:31:20.956 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:20.954+0000 7fdf418d8740 1 --2- 172.21.15.19:0/1826602163 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x563626077bd0 0x563626086510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:31:20.957 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:20.954+0000 7fdf418d8740 1 --2- 172.21.15.19:0/1826602163 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563626075190 0x563626085940 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:31:20.957 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:20.954+0000 7fdf418d8740 1 --2- 172.21.15.19:0/1826602163 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x5636260f8b50 0x5636260faf70 crc :-1 s=READY pgs=115 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:31:20.957 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:20.954+0000 7fdf418d8740 1 --2- 172.21.15.19:0/1826602163 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x563626072860 0x5636260852a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:31:20.957 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:20.954+0000 7fdf418d8740 1 -- 172.21.15.19:0/1826602163 >> 172.21.15.19:0/1826602163 conn(0x56362606d9b0 msgr2=0x563626071c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:31:20.957 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:20.954+0000 7fdf17fff640 0 client.25766 ms_handle_reset on v2:172.21.15.135:6838/1254769802 2024-09-10T22:31:20.957 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:20.954+0000 7fdf418d8740 1 -- 172.21.15.19:0/1826602163 shutdown_connections 2024-09-10T22:31:20.957 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:20.954+0000 7fdf418d8740 1 -- 172.21.15.19:0/1826602163 wait complete. 2024-09-10T22:31:20.957 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:20.954+0000 7fdf418d8740 20 client.25766 trim_cache size 0 max 16384 2024-09-10T22:31:20.958 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stdout:{ 2024-09-10T22:31:20.958 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stdout: "message": "", 2024-09-10T22:31:20.958 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stdout: "return_code": 0 2024-09-10T22:31:20.958 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stdout:} 2024-09-10T22:31:20.958 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:20.955+0000 7fdf3eb0e640 1 -- 172.21.15.19:0/2153400629 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7fdf280b52e0 msgr2=0x7fdf280b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:31:20.959 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:20.955+0000 7fdf3eb0e640 1 --2- 172.21.15.19:0/2153400629 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7fdf280b52e0 0x7fdf280b77a0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7fdf24009bd0 tx=0x7fdf24005f90 comp rx=0 tx=0).stop 2024-09-10T22:31:20.959 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:20.955+0000 7fdf3eb0e640 1 -- 172.21.15.19:0/2153400629 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdf38101860 msgr2=0x7fdf3806b1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:31:20.959 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:20.955+0000 7fdf3eb0e640 1 --2- 172.21.15.19:0/2153400629 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdf38101860 0x7fdf3806b1a0 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7fdf2c00e9f0 tx=0x7fdf2c00eeb0 comp rx=0 tx=0).stop 2024-09-10T22:31:20.959 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:20.956+0000 7fdf3eb0e640 1 -- 172.21.15.19:0/2153400629 shutdown_connections 2024-09-10T22:31:20.959 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:20.956+0000 7fdf3eb0e640 1 --2- 172.21.15.19:0/2153400629 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7fdf280b52e0 0x7fdf280b77a0 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:31:20.959 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:20.956+0000 7fdf3eb0e640 1 --2- 172.21.15.19:0/2153400629 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdf38103370 0x7fdf381a0080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:31:20.959 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:20.956+0000 7fdf3eb0e640 1 --2- 172.21.15.19:0/2153400629 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fdf381029b0 0x7fdf3819da60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:31:20.959 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:20.956+0000 7fdf3eb0e640 1 --2- 172.21.15.19:0/2153400629 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdf38101860 0x7fdf3806b1a0 unknown :-1 s=CLOSED pgs=613 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:31:20.959 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:20.956+0000 7fdf3eb0e640 1 -- 172.21.15.19:0/2153400629 >> 172.21.15.19:0/2153400629 conn(0x7fdf380fd140 msgr2=0x7fdf38105cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:31:20.959 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:20.956+0000 7fdf3eb0e640 1 -- 172.21.15.19:0/2153400629 shutdown_connections 2024-09-10T22:31:20.959 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:20.956+0000 7fdf3eb0e640 1 -- 172.21.15.19:0/2153400629 wait complete. 2024-09-10T22:31:22.360 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:31:21 smithi135 ceph-mon[34789]: pgmap v495: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 869 KiB/s rd, 347 MiB/s wr, 352 op/s 2024-09-10T22:31:22.375 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:31:21 smithi138 ceph-mon[35236]: pgmap v495: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 869 KiB/s rd, 347 MiB/s wr, 352 op/s 2024-09-10T22:31:22.458 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:31:21 smithi019 ceph-mon[31375]: pgmap v495: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 869 KiB/s rd, 347 MiB/s wr, 352 op/s 2024-09-10T22:31:24.360 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:31:24 smithi135 ceph-mon[34789]: pgmap v496: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 526 KiB/s rd, 299 MiB/s wr, 195 op/s 2024-09-10T22:31:24.375 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:31:24 smithi138 ceph-mon[35236]: pgmap v496: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 526 KiB/s rd, 299 MiB/s wr, 195 op/s 2024-09-10T22:31:24.458 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:31:24 smithi019 ceph-mon[31375]: pgmap v496: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 526 KiB/s rd, 299 MiB/s wr, 195 op/s 2024-09-10T22:31:26.361 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:31:26 smithi135 ceph-mon[34789]: pgmap v497: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 526 KiB/s rd, 314 MiB/s wr, 164 op/s 2024-09-10T22:31:26.375 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:31:26 smithi138 ceph-mon[35236]: pgmap v497: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 526 KiB/s rd, 314 MiB/s wr, 164 op/s 2024-09-10T22:31:26.458 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:31:26 smithi019 ceph-mon[31375]: pgmap v497: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 526 KiB/s rd, 314 MiB/s wr, 164 op/s 2024-09-10T22:31:28.458 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:31:28 smithi019 ceph-mon[31375]: pgmap v498: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 613 KiB/s rd, 355 MiB/s wr, 173 op/s 2024-09-10T22:31:28.614 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:31:28 smithi135 ceph-mon[34789]: pgmap v498: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 613 KiB/s rd, 355 MiB/s wr, 173 op/s 2024-09-10T22:31:28.673 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:31:28 smithi138 ceph-mon[35236]: pgmap v498: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 613 KiB/s rd, 355 MiB/s wr, 173 op/s 2024-09-10T22:31:30.458 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:31:30 smithi019 ceph-mon[31375]: pgmap v499: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 611 KiB/s rd, 321 MiB/s wr, 151 op/s 2024-09-10T22:31:30.610 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:31:30 smithi135 ceph-mon[34789]: pgmap v499: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 611 KiB/s rd, 321 MiB/s wr, 151 op/s 2024-09-10T22:31:30.625 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:31:30 smithi138 ceph-mon[35236]: pgmap v499: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 611 KiB/s rd, 321 MiB/s wr, 151 op/s 2024-09-10T22:31:32.461 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:31:32 smithi019 ceph-mon[31375]: pgmap v500: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 729 KiB/s rd, 377 MiB/s wr, 186 op/s 2024-09-10T22:31:32.610 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:31:32 smithi135 ceph-mon[34789]: pgmap v500: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 729 KiB/s rd, 377 MiB/s wr, 186 op/s 2024-09-10T22:31:32.625 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:31:32 smithi138 ceph-mon[35236]: pgmap v500: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 729 KiB/s rd, 377 MiB/s wr, 186 op/s 2024-09-10T22:31:34.066 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:34.063+0000 7fef0aa33640 1 -- 172.21.15.19:0/983924004 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fef04102980 msgr2=0x7fef04102d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:31:34.067 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:34.063+0000 7fef0aa33640 1 --2- 172.21.15.19:0/983924004 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fef04102980 0x7fef04102d80 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7feef4009930 tx=0x7feef402a420 comp rx=0 tx=0).stop 2024-09-10T22:31:34.067 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:34.063+0000 7fef0aa33640 1 -- 172.21.15.19:0/983924004 shutdown_connections 2024-09-10T22:31:34.067 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:34.063+0000 7fef0aa33640 1 --2- 172.21.15.19:0/983924004 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fef04104490 0x7fef0410ae10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:31:34.067 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:34.063+0000 7fef0aa33640 1 --2- 172.21.15.19:0/983924004 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fef04103ad0 0x7fef04103f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:31:34.067 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:34.063+0000 7fef0aa33640 1 --2- 172.21.15.19:0/983924004 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fef04102980 0x7fef04102d80 unknown :-1 s=CLOSED pgs=615 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:31:34.067 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:34.063+0000 7fef0aa33640 1 -- 172.21.15.19:0/983924004 >> 172.21.15.19:0/983924004 conn(0x7fef040fe240 msgr2=0x7fef04100660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:31:34.067 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:34.063+0000 7fef0aa33640 1 -- 172.21.15.19:0/983924004 shutdown_connections 2024-09-10T22:31:34.067 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:34.063+0000 7fef0aa33640 1 -- 172.21.15.19:0/983924004 wait complete. 2024-09-10T22:31:34.067 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:34.063+0000 7fef0aa33640 1 Processor -- start 2024-09-10T22:31:34.068 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:34.063+0000 7fef0aa33640 1 -- start start 2024-09-10T22:31:34.068 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:34.064+0000 7fef0aa33640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fef04102980 0x7fef04076ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:31:34.068 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:34.064+0000 7fef0aa33640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fef04103ad0 0x7fef04075540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:31:34.068 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:34.064+0000 7fef0aa33640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fef04104490 0x7fef04075a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:31:34.068 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:34.064+0000 7fef0aa33640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fef0410e640 con 0x7fef04103ad0 2024-09-10T22:31:34.068 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:34.064+0000 7fef0aa33640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fef0410e4c0 con 0x7fef04104490 2024-09-10T22:31:34.068 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:34.064+0000 7fef0aa33640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7fef0410e7c0 con 0x7fef04102980 2024-09-10T22:31:34.068 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:34.064+0000 7fef037fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fef04103ad0 0x7fef04075540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:31:34.068 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:34.064+0000 7fef037fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fef04103ad0 0x7fef04075540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:53544/0 (socket says 172.21.15.19:53544) 2024-09-10T22:31:34.069 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:34.064+0000 7fef037fe640 1 -- 172.21.15.19:0/3273227286 learned_addr learned my addr 172.21.15.19:0/3273227286 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:31:34.069 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:34.064+0000 7fef08fd0640 1 --2- 172.21.15.19:0/3273227286 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fef04104490 0x7fef04075a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:31:34.069 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:34.064+0000 7fef03fff640 1 --2- 172.21.15.19:0/3273227286 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fef04102980 0x7fef04076ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:31:34.069 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:34.064+0000 7fef037fe640 1 -- 172.21.15.19:0/3273227286 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fef04102980 msgr2=0x7fef04076ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:31:34.069 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:34.064+0000 7fef037fe640 1 --2- 172.21.15.19:0/3273227286 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fef04102980 0x7fef04076ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:31:34.069 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:34.064+0000 7fef037fe640 1 -- 172.21.15.19:0/3273227286 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fef04104490 msgr2=0x7fef04075a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:31:34.070 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:34.064+0000 7fef037fe640 1 --2- 172.21.15.19:0/3273227286 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fef04104490 0x7fef04075a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:31:34.070 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:34.064+0000 7fef037fe640 1 -- 172.21.15.19:0/3273227286 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fef040762f0 con 0x7fef04103ad0 2024-09-10T22:31:34.070 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:34.064+0000 7fef037fe640 1 --2- 172.21.15.19:0/3273227286 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fef04103ad0 0x7fef04075540 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7feef800d950 tx=0x7feef800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:31:34.070 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:34.064+0000 7fef017fa640 1 -- 172.21.15.19:0/3273227286 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feef8017070 con 0x7fef04103ad0 2024-09-10T22:31:34.070 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:34.064+0000 7fef017fa640 1 -- 172.21.15.19:0/3273227286 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7feef8009c30 con 0x7fef04103ad0 2024-09-10T22:31:34.070 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:34.065+0000 7fef0aa33640 1 -- 172.21.15.19:0/3273227286 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fef041a2e70 con 0x7fef04103ad0 2024-09-10T22:31:34.071 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:34.065+0000 7fef017fa640 1 -- 172.21.15.19:0/3273227286 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feef800f620 con 0x7fef04103ad0 2024-09-10T22:31:34.071 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:34.065+0000 7fef0aa33640 1 -- 172.21.15.19:0/3273227286 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fef041a3380 con 0x7fef04103ad0 2024-09-10T22:31:34.076 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:34.067+0000 7fef0d803740 1 Processor -- start 2024-09-10T22:31:34.077 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:34.067+0000 7fef0d803740 1 -- start start 2024-09-10T22:31:34.077 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:34.067+0000 7fef017fa640 1 -- 172.21.15.19:0/3273227286 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 18) ==== 153250+0+0 (secure 0 0 0) 0x7feef8010460 con 0x7fef04103ad0 2024-09-10T22:31:34.077 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:34.067+0000 7fef0d803740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56127fc83860 0x56127fc85c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:31:34.077 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:34.067+0000 7fef0d803740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56127fc86190 0x56127fc88580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:31:34.077 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:34.067+0000 7fef0d803740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x56127fc88bd0 0x56127fc8b090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:31:34.077 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:34.067+0000 7fef0d803740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x56127fbf56f0 con 0x56127fc83860 2024-09-10T22:31:34.077 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:34.067+0000 7fef0d803740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x56127fbe4b20 con 0x56127fc86190 2024-09-10T22:31:34.078 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:34.067+0000 7fef0d803740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x56127fbe8930 con 0x56127fc88bd0 2024-09-10T22:31:34.078 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:34.068+0000 7fef08fd0640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56127fc83860 0x56127fc85c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:31:34.078 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:34.068+0000 7fef03fff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56127fc86190 0x56127fc88580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:31:34.078 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:34.068+0000 7fef037fe640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x56127fc88bd0 0x56127fc8b090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:31:34.078 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:34.068+0000 7fef08fd0640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56127fc83860 0x56127fc85c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:53560/0 (socket says 172.21.15.19:53560) 2024-09-10T22:31:34.078 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:34.068+0000 7fef03fff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56127fc86190 0x56127fc88580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.19:46224/0 (socket says 172.21.15.19:46224) 2024-09-10T22:31:34.079 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:34.068+0000 7fef08fd0640 1 -- 172.21.15.19:0/1100953706 learned_addr learned my addr 172.21.15.19:0/1100953706 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:31:34.079 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:34.068+0000 7fef08fd0640 1 -- 172.21.15.19:0/1100953706 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x56127fc88bd0 msgr2=0x56127fc8b090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:31:34.079 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:34.068+0000 7fef08fd0640 1 --2- 172.21.15.19:0/1100953706 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x56127fc88bd0 0x56127fc8b090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:31:34.079 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:34.068+0000 7fef08fd0640 1 -- 172.21.15.19:0/1100953706 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56127fc86190 msgr2=0x56127fc88580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:31:34.079 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:34.068+0000 7fef08fd0640 1 --2- 172.21.15.19:0/1100953706 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56127fc86190 0x56127fc88580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:31:34.079 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:34.068+0000 7fef08fd0640 1 -- 172.21.15.19:0/1100953706 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56127fbaa530 con 0x56127fc83860 2024-09-10T22:31:34.079 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:34.068+0000 7fef03fff640 1 --2- 172.21.15.19:0/1100953706 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56127fc86190 0x56127fc88580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T22:31:34.079 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:34.068+0000 7fef08fd0640 1 --2- 172.21.15.19:0/1100953706 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56127fc83860 0x56127fc85c50 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7feefc009ee0 tx=0x7feefc010740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9f7bd3cff7311942 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:31:34.079 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:34.068+0000 7fef017fa640 1 --2- 172.21.15.19:0/3273227286 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7feeec0b5360 0x7feeec0b7820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:31:34.079 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:34.068+0000 7feeea7fc640 1 -- 172.21.15.19:0/1100953706 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feefc016070 con 0x56127fc83860 2024-09-10T22:31:34.079 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:34.068+0000 7fef03fff640 1 --2- 172.21.15.19:0/3273227286 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7feeec0b5360 0x7feeec0b7820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:31:34.080 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:34.069+0000 7feeea7fc640 1 -- 172.21.15.19:0/1100953706 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7feefc004d20 con 0x56127fc83860 2024-09-10T22:31:34.080 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:34.069+0000 7feeea7fc640 1 -- 172.21.15.19:0/1100953706 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feefc012740 con 0x56127fc83860 2024-09-10T22:31:34.080 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:34.069+0000 7fef017fa640 1 -- 172.21.15.19:0/3273227286 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8327+0+0 (secure 0 0 0) 0x7feef80e58e0 con 0x7fef04103ad0 2024-09-10T22:31:34.080 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:34.069+0000 7fef0d803740 1 -- 172.21.15.19:0/1100953706 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56127fc83860 msgr2=0x56127fc85c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:31:34.080 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:34.069+0000 7fef03fff640 1 --2- 172.21.15.19:0/3273227286 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7feeec0b5360 0x7feeec0b7820 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7feef4006010 tx=0x7feef4005a40 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:31:34.080 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:34.069+0000 7fef0d803740 1 --2- 172.21.15.19:0/1100953706 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56127fc83860 0x56127fc85c50 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7feefc009ee0 tx=0x7feefc010740 comp rx=0 tx=0).stop 2024-09-10T22:31:34.080 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:34.070+0000 7fef0d803740 1 -- 172.21.15.19:0/1100953706 shutdown_connections 2024-09-10T22:31:34.080 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:34.070+0000 7fef0d803740 1 --2- 172.21.15.19:0/1100953706 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x56127fc88bd0 0x56127fc8b090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:31:34.080 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:34.070+0000 7fef0d803740 1 --2- 172.21.15.19:0/1100953706 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56127fc86190 0x56127fc88580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:31:34.080 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:34.070+0000 7fef0d803740 1 --2- 172.21.15.19:0/1100953706 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56127fc83860 0x56127fc85c50 unknown :-1 s=CLOSED pgs=617 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:31:34.080 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:34.070+0000 7fef0d803740 1 -- 172.21.15.19:0/1100953706 >> 172.21.15.19:0/1100953706 conn(0x56127fc7e9b0 msgr2=0x56127fc7f740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:31:34.080 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:34.070+0000 7fef0d803740 1 -- 172.21.15.19:0/1100953706 shutdown_connections 2024-09-10T22:31:34.080 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:34.070+0000 7fef0d803740 1 -- 172.21.15.19:0/1100953706 wait complete. 2024-09-10T22:31:34.081 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:34.070+0000 7fef0d803740 1 -- start start 2024-09-10T22:31:34.081 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:34.070+0000 7fef0d803740 1 Processor -- start 2024-09-10T22:31:34.081 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:34.070+0000 7fef0d803740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56127fc83860 0x56127fc8cfc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:31:34.081 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:34.070+0000 7fef0d803740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x56127fc86190 0x56127fc8d660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:31:34.081 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:34.070+0000 7fef0d803740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56127fc88bd0 0x56127fc8e230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:31:34.082 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:34.070+0000 7fef0d803740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x56127fb1cab0 con 0x56127fc88bd0 2024-09-10T22:31:34.082 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:34.070+0000 7fef0d803740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x56127fb8a730 con 0x56127fc83860 2024-09-10T22:31:34.082 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:34.070+0000 7fef0d803740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x56127fc8bbb0 con 0x56127fc86190 2024-09-10T22:31:34.082 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:34.071+0000 7fef0d803740 10 client.0 _ll_register_callbacks cb 0x56127fbde6b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T22:31:34.082 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:34.071+0000 7fef08fd0640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56127fc88bd0 0x56127fc8e230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:31:34.082 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:34.071+0000 7fef03fff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56127fc83860 0x56127fc8cfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:31:34.082 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:34.071+0000 7fef03fff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56127fc83860 0x56127fc8cfc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.19:46226/0 (socket says 172.21.15.19:46226) 2024-09-10T22:31:34.082 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:34.071+0000 7fef08fd0640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56127fc88bd0 0x56127fc8e230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:53562/0 (socket says 172.21.15.19:53562) 2024-09-10T22:31:34.082 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:34.071+0000 7fef03fff640 1 -- 172.21.15.19:0/499795140 learned_addr learned my addr 172.21.15.19:0/499795140 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:31:34.083 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:34.071+0000 7fef037fe640 1 --2- 172.21.15.19:0/499795140 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x56127fc86190 0x56127fc8d660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:31:34.083 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:34.071+0000 7fef08fd0640 1 -- 172.21.15.19:0/499795140 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x56127fc86190 msgr2=0x56127fc8d660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:31:34.083 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:34.071+0000 7fef08fd0640 1 --2- 172.21.15.19:0/499795140 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x56127fc86190 0x56127fc8d660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:31:34.083 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:34.071+0000 7fef08fd0640 1 -- 172.21.15.19:0/499795140 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56127fc83860 msgr2=0x56127fc8cfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:31:34.083 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:34.071+0000 7fef08fd0640 1 --2- 172.21.15.19:0/499795140 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56127fc83860 0x56127fc8cfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:31:34.083 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:34.071+0000 7fef08fd0640 1 -- 172.21.15.19:0/499795140 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56127f946790 con 0x56127fc88bd0 2024-09-10T22:31:34.083 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:34.071+0000 7fef08fd0640 1 --2- 172.21.15.19:0/499795140 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56127fc88bd0 0x56127fc8e230 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7feefc006010 tx=0x7feefc009c50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=470038f62337a889 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:31:34.083 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:34.071+0000 7feee37fe640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-10T22:31:34.083 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:34.071+0000 7feee37fe640 1 -- 172.21.15.19:0/499795140 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feefc028060 con 0x56127fc88bd0 2024-09-10T22:31:34.083 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:34.071+0000 7feee37fe640 1 -- 172.21.15.19:0/499795140 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8327+0+0 (secure 0 0 0) 0x7feefc0050e0 con 0x56127fc88bd0 2024-09-10T22:31:34.083 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:34.071+0000 7fef0d803740 1 -- 172.21.15.19:0/499795140 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7feefc004d20 con 0x56127fc88bd0 2024-09-10T22:31:34.083 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:34.071+0000 7feee37fe640 1 -- 172.21.15.19:0/499795140 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7feefc016070 con 0x56127fc88bd0 2024-09-10T22:31:34.084 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:34.071+0000 7fef0d803740 10 client.16347 fetch_fsmap learned FSMap version 27 2024-09-10T22:31:34.084 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:34.071+0000 7fef0d803740 1 -- 172.21.15.19:0/499795140 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x56127f9bf620 con 0x56127fc88bd0 2024-09-10T22:31:34.084 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:34.072+0000 7feee37fe640 1 -- 172.21.15.19:0/499795140 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7feefc004d20 con 0x56127fc88bd0 2024-09-10T22:31:34.084 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:34.072+0000 7feee37fe640 1 -- 172.21.15.19:0/499795140 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7feefc02c030 con 0x56127fc88bd0 2024-09-10T22:31:34.084 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:34.072+0000 7fef0d803740 10 client.16347 fetch_fsmap finished waiting for FSMap version 27 2024-09-10T22:31:34.084 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:34.072+0000 7fef0d803740 10 client.16347 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-10T22:31:34.084 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:34.072+0000 7fef0d803740 20 client.16347 populate_metadata read hostname 'smithi019' 2024-09-10T22:31:34.084 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:34.072+0000 7fef0d803740 1 --2- 172.21.15.19:0/499795140 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x56127fc98570 0x56127fc9a960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:31:34.084 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:34.072+0000 7fef0d803740 4 client.16347 mds_command: new command op to 24581 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T22:31:34.084 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:34.072+0000 7fef0d803740 1 -- 172.21.15.19:0/499795140 --> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56127fbf7640 con 0x56127fc98570 2024-09-10T22:31:34.084 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:34.072+0000 7fef03fff640 1 --2- 172.21.15.19:0/499795140 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x56127fc98570 0x56127fc9a960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:31:34.084 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:34.073+0000 7fef03fff640 1 --2- 172.21.15.19:0/499795140 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x56127fc98570 0x56127fc9a960 crc :-1 s=READY pgs=116 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=aabc924bd961ea4b server_cookie=78aecb0fd471a6a9 in_seq=0 out_seq=0 2024-09-10T22:31:34.084 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:34.073+0000 7feee37fe640 10 client.16347 ms_handle_connect on v2:172.21.15.135:6838/1254769802 2024-09-10T22:31:34.085 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:34.073+0000 7feee37fe640 1 -- 172.21.15.19:0/499795140 <== mds.0 v2:172.21.15.135:6838/1254769802 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x56127fbf7640 con 0x56127fc98570 2024-09-10T22:31:34.085 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:34.073+0000 7feee37fe640 10 client.16347 handle_command_reply: tid=0 2024-09-10T22:31:34.085 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:34.073+0000 7fef0d803740 1 client.16347 shutdown 2024-09-10T22:31:34.085 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:34.073+0000 7fef0d803740 1 -- 172.21.15.19:0/499795140 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56127fc88bd0 msgr2=0x56127fc8e230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:31:34.085 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:34.073+0000 7fef0d803740 1 --2- 172.21.15.19:0/499795140 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56127fc88bd0 0x56127fc8e230 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7feefc006010 tx=0x7feefc009c50 comp rx=0 tx=0).stop 2024-09-10T22:31:34.085 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:34.074+0000 7fef0d803740 1 -- 172.21.15.19:0/499795140 shutdown_connections 2024-09-10T22:31:34.085 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:34.074+0000 7fef0d803740 1 --2- 172.21.15.19:0/499795140 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56127fc88bd0 0x56127fc8e230 unknown :-1 s=CLOSED pgs=618 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:31:34.085 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:34.074+0000 7fef0d803740 1 --2- 172.21.15.19:0/499795140 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x56127fc98570 0x56127fc9a960 crc :-1 s=READY pgs=116 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:31:34.085 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:34.074+0000 7fef0d803740 1 --2- 172.21.15.19:0/499795140 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x56127fc86190 0x56127fc8d660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:31:34.085 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:34.074+0000 7fef0d803740 1 --2- 172.21.15.19:0/499795140 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56127fc83860 0x56127fc8cfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:31:34.085 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:34.074+0000 7feee37fe640 0 client.16347 ms_handle_reset on v2:172.21.15.135:6838/1254769802 2024-09-10T22:31:34.085 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:34.074+0000 7fef0d803740 1 -- 172.21.15.19:0/499795140 >> 172.21.15.19:0/499795140 conn(0x56127fc7e9b0 msgr2=0x56127fc7dbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:31:34.086 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:34.074+0000 7fef0d803740 1 -- 172.21.15.19:0/499795140 shutdown_connections 2024-09-10T22:31:34.086 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:34.074+0000 7fef0d803740 1 -- 172.21.15.19:0/499795140 wait complete. 2024-09-10T22:31:34.086 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:34.074+0000 7fef0d803740 20 client.16347 trim_cache size 0 max 16384 2024-09-10T22:31:34.092 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:34.089+0000 7fef0d803740 1 Processor -- start 2024-09-10T22:31:34.092 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:34.089+0000 7fef0d803740 1 -- start start 2024-09-10T22:31:34.092 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:34.089+0000 7fef0d803740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56127fc7e9b0 0x56127fc8c930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:31:34.092 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:34.089+0000 7fef0d803740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56127fc83860 0x56127fc817f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:31:34.092 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:34.089+0000 7fef0d803740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x56127fc86190 0x56127fc81d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:31:34.093 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:34.089+0000 7fef0d803740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fef041aec50 con 0x56127fc83860 2024-09-10T22:31:34.093 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:34.089+0000 7fef0d803740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fef041ac520 con 0x56127fc7e9b0 2024-09-10T22:31:34.093 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:34.089+0000 7fef0d803740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7fef041aa370 con 0x56127fc86190 2024-09-10T22:31:34.093 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:34.089+0000 7fef03fff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56127fc7e9b0 0x56127fc8c930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:31:34.093 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:34.089+0000 7fef037fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56127fc83860 0x56127fc817f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:31:34.093 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:34.089+0000 7fef03fff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56127fc7e9b0 0x56127fc8c930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.19:46240/0 (socket says 172.21.15.19:46240) 2024-09-10T22:31:34.094 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:34.089+0000 7fef03fff640 1 -- 172.21.15.19:0/1183450399 learned_addr learned my addr 172.21.15.19:0/1183450399 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:31:34.094 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:34.089+0000 7fef08fd0640 1 --2- 172.21.15.19:0/1183450399 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x56127fc86190 0x56127fc81d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:31:34.094 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:34.090+0000 7fef037fe640 1 -- 172.21.15.19:0/1183450399 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x56127fc86190 msgr2=0x56127fc81d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:31:34.095 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:34.090+0000 7fef037fe640 1 --2- 172.21.15.19:0/1183450399 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x56127fc86190 0x56127fc81d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:31:34.095 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:34.090+0000 7fef037fe640 1 -- 172.21.15.19:0/1183450399 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56127fc7e9b0 msgr2=0x56127fc8c930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:31:34.095 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:34.090+0000 7fef037fe640 1 --2- 172.21.15.19:0/1183450399 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56127fc7e9b0 0x56127fc8c930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:31:34.095 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:34.090+0000 7fef037fe640 1 -- 172.21.15.19:0/1183450399 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56127fc85fc0 con 0x56127fc83860 2024-09-10T22:31:34.095 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:34.090+0000 7fef08fd0640 1 --2- 172.21.15.19:0/1183450399 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x56127fc86190 0x56127fc81d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T22:31:34.095 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:34.090+0000 7fef03fff640 1 --2- 172.21.15.19:0/1183450399 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56127fc7e9b0 0x56127fc8c930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T22:31:34.095 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:34.090+0000 7fef037fe640 1 --2- 172.21.15.19:0/1183450399 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56127fc83860 0x56127fc817f0 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7feef80e33d0 tx=0x7feef80b5040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ebc2e7c562f4d38f server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:31:34.095 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:34.090+0000 7feee9ffb640 1 -- 172.21.15.19:0/1183450399 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feef8091e60 con 0x56127fc83860 2024-09-10T22:31:34.095 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:34.090+0000 7feee9ffb640 1 -- 172.21.15.19:0/1183450399 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7feef80cf0b0 con 0x56127fc83860 2024-09-10T22:31:34.095 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:34.090+0000 7feee9ffb640 1 -- 172.21.15.19:0/1183450399 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feef8020040 con 0x56127fc83860 2024-09-10T22:31:34.099 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:34.091+0000 7fef0d803740 1 -- 172.21.15.19:0/1183450399 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56127fc83860 msgr2=0x56127fc817f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:31:34.099 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:34.091+0000 7fef0d803740 1 --2- 172.21.15.19:0/1183450399 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56127fc83860 0x56127fc817f0 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7feef80e33d0 tx=0x7feef80b5040 comp rx=0 tx=0).stop 2024-09-10T22:31:34.099 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:34.091+0000 7fef0d803740 1 -- 172.21.15.19:0/1183450399 shutdown_connections 2024-09-10T22:31:34.099 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:34.091+0000 7fef0d803740 1 --2- 172.21.15.19:0/1183450399 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x56127fc86190 0x56127fc81d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:31:34.099 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:34.091+0000 7fef0d803740 1 --2- 172.21.15.19:0/1183450399 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56127fc83860 0x56127fc817f0 unknown :-1 s=CLOSED pgs=619 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:31:34.099 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:34.091+0000 7fef0d803740 1 --2- 172.21.15.19:0/1183450399 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56127fc7e9b0 0x56127fc8c930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:31:34.099 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:34.091+0000 7fef0d803740 1 -- 172.21.15.19:0/1183450399 >> 172.21.15.19:0/1183450399 conn(0x56127fc79ea0 msgr2=0x56127fc8c220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:31:34.099 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:34.091+0000 7fef0d803740 1 -- 172.21.15.19:0/1183450399 shutdown_connections 2024-09-10T22:31:34.099 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:34.091+0000 7fef0d803740 1 -- 172.21.15.19:0/1183450399 wait complete. 2024-09-10T22:31:34.099 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:34.091+0000 7fef0d803740 1 -- start start 2024-09-10T22:31:34.099 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:34.091+0000 7fef0d803740 1 Processor -- start 2024-09-10T22:31:34.100 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:34.092+0000 7fef0d803740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x56127fc7e9b0 0x56127fc94c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:31:34.100 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:34.092+0000 7fef0d803740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56127fc83860 0x56127fc939b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:31:34.100 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:34.092+0000 7fef0d803740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56127fc86190 0x56127fc940a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:31:34.100 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:34.092+0000 7fef0d803740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fef041aa9e0 con 0x56127fc86190 2024-09-10T22:31:34.100 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:34.092+0000 7fef0d803740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fef041abe50 con 0x56127fc83860 2024-09-10T22:31:34.100 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:34.092+0000 7fef0d803740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7fef041ab0b0 con 0x56127fc7e9b0 2024-09-10T22:31:34.100 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:34.092+0000 7fef0d803740 10 client.0 _ll_register_callbacks cb 0x7feef4009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T22:31:34.100 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:34.092+0000 7fef08fd0640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56127fc86190 0x56127fc940a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:31:34.100 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:34.092+0000 7fef037fe640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56127fc83860 0x56127fc939b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:31:34.100 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:34.092+0000 7fef08fd0640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56127fc86190 0x56127fc940a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:53578/0 (socket says 172.21.15.19:53578) 2024-09-10T22:31:34.100 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:34.092+0000 7fef037fe640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56127fc83860 0x56127fc939b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.19:46250/0 (socket says 172.21.15.19:46250) 2024-09-10T22:31:34.100 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:34.092+0000 7fef08fd0640 1 -- 172.21.15.19:0/3659646715 learned_addr learned my addr 172.21.15.19:0/3659646715 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:31:34.101 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:34.092+0000 7fef03fff640 1 --2- 172.21.15.19:0/3659646715 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x56127fc7e9b0 0x56127fc94c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:31:34.101 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:34.092+0000 7fef08fd0640 1 -- 172.21.15.19:0/3659646715 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x56127fc7e9b0 msgr2=0x56127fc94c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:31:34.101 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:34.092+0000 7fef08fd0640 1 --2- 172.21.15.19:0/3659646715 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x56127fc7e9b0 0x56127fc94c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:31:34.101 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:34.092+0000 7fef08fd0640 1 -- 172.21.15.19:0/3659646715 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56127fc83860 msgr2=0x56127fc939b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:31:34.101 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:34.092+0000 7fef08fd0640 1 --2- 172.21.15.19:0/3659646715 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56127fc83860 0x56127fc939b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:31:34.101 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:34.092+0000 7fef08fd0640 1 -- 172.21.15.19:0/3659646715 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56127fc926e0 con 0x56127fc86190 2024-09-10T22:31:34.101 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:34.092+0000 7fef037fe640 1 --2- 172.21.15.19:0/3659646715 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56127fc83860 0x56127fc939b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T22:31:34.101 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:34.092+0000 7fef08fd0640 1 --2- 172.21.15.19:0/3659646715 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56127fc86190 0x56127fc940a0 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x56127fc8dd10 tx=0x7feefc005df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f3277bcafdc6753b server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:31:34.101 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:34.092+0000 7feee37fe640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-10T22:31:34.101 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:34.092+0000 7feee37fe640 1 -- 172.21.15.19:0/3659646715 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feefc028040 con 0x56127fc86190 2024-09-10T22:31:34.101 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:34.092+0000 7feee37fe640 1 -- 172.21.15.19:0/3659646715 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8327+0+0 (secure 0 0 0) 0x7feefc020050 con 0x56127fc86190 2024-09-10T22:31:34.101 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:34.092+0000 7fef0d803740 1 -- 172.21.15.19:0/3659646715 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x56127fbf30f0 con 0x56127fc86190 2024-09-10T22:31:34.101 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:34.092+0000 7feee37fe640 1 -- 172.21.15.19:0/3659646715 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7feefc009760 con 0x56127fc86190 2024-09-10T22:31:34.102 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:34.092+0000 7fef0d803740 10 client.16353 fetch_fsmap learned FSMap version 27 2024-09-10T22:31:34.102 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:34.092+0000 7fef0d803740 1 -- 172.21.15.19:0/3659646715 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x56127fd05560 con 0x56127fc86190 2024-09-10T22:31:34.102 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:34.093+0000 7feee37fe640 1 -- 172.21.15.19:0/3659646715 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x56127fbf30f0 con 0x56127fc86190 2024-09-10T22:31:34.102 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:34.093+0000 7feee37fe640 1 -- 172.21.15.19:0/3659646715 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7feefc035020 con 0x56127fc86190 2024-09-10T22:31:34.102 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:34.093+0000 7fef0d803740 10 client.16353 fetch_fsmap finished waiting for FSMap version 27 2024-09-10T22:31:34.102 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:34.093+0000 7fef0d803740 10 client.16353 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-10T22:31:34.102 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:34.093+0000 7fef0d803740 20 client.16353 populate_metadata read hostname 'smithi019' 2024-09-10T22:31:34.102 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:34.093+0000 7fef0d803740 1 --2- 172.21.15.19:0/3659646715 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x56127fc88bd0 0x56127fd07f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:31:34.102 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:34.093+0000 7fef0d803740 4 client.16353 mds_command: new command op to 24581 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-10T22:31:34.102 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:34.093+0000 7fef0d803740 1 -- 172.21.15.19:0/3659646715 --> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] -- command(tid 0: {"prefix": "flush journal"}) -- 0x56127fbf0520 con 0x56127fc88bd0 2024-09-10T22:31:34.103 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:34.093+0000 7fef03fff640 1 --2- 172.21.15.19:0/3659646715 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x56127fc88bd0 0x56127fd07f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:31:34.103 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:34.094+0000 7fef03fff640 1 --2- 172.21.15.19:0/3659646715 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x56127fc88bd0 0x56127fd07f70 crc :-1 s=READY pgs=117 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8b2cd3282b04dbdd server_cookie=f20455d3ad2fd405 in_seq=0 out_seq=0 2024-09-10T22:31:34.103 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:34.094+0000 7feee37fe640 10 client.16353 ms_handle_connect on v2:172.21.15.135:6838/1254769802 2024-09-10T22:31:34.597 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 22997a4c-6fc2-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-10T22:31:34.610 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:31:34 smithi135 ceph-mon[34789]: pgmap v501: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 620 KiB/s rd, 332 MiB/s wr, 169 op/s 2024-09-10T22:31:34.622 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:31:34 smithi019 ceph-mon[31375]: pgmap v501: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 620 KiB/s rd, 332 MiB/s wr, 169 op/s 2024-09-10T22:31:34.625 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:31:34 smithi138 ceph-mon[35236]: pgmap v501: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 620 KiB/s rd, 332 MiB/s wr, 169 op/s 2024-09-10T22:31:35.006 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/22997a4c-6fc2-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T22:31:35.459 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:31:35 smithi019 ceph-mon[31375]: pgmap v502: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 620 KiB/s rd, 347 MiB/s wr, 189 op/s 2024-09-10T22:31:35.610 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:31:35 smithi135 ceph-mon[34789]: pgmap v502: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 620 KiB/s rd, 347 MiB/s wr, 189 op/s 2024-09-10T22:31:35.625 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:31:35 smithi138 ceph-mon[35236]: pgmap v502: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 620 KiB/s rd, 347 MiB/s wr, 189 op/s 2024-09-10T22:31:35.731 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:35.668+0000 7f7c28f64640 1 -- 172.21.15.19:0/1296466524 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7c24103ca0 msgr2=0x7f7c24104080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:31:35.731 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:35.668+0000 7f7c28f64640 1 --2- 172.21.15.19:0/1296466524 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7c24103ca0 0x7f7c24104080 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7f7c14009900 tx=0x7f7c1402a410 comp rx=0 tx=0).stop 2024-09-10T22:31:35.731 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:35.668+0000 7f7c28f64640 1 -- 172.21.15.19:0/1296466524 shutdown_connections 2024-09-10T22:31:35.731 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:35.668+0000 7f7c28f64640 1 --2- 172.21.15.19:0/1296466524 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7c2410d100 0x7f7c2410f560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:31:35.732 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:35.668+0000 7f7c28f64640 1 --2- 172.21.15.19:0/1296466524 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7c241045c0 0x7f7c2410cab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:31:35.732 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:35.668+0000 7f7c28f64640 1 --2- 172.21.15.19:0/1296466524 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7c24103ca0 0x7f7c24104080 unknown :-1 s=CLOSED pgs=621 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:31:35.732 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:35.668+0000 7f7c28f64640 1 -- 172.21.15.19:0/1296466524 >> 172.21.15.19:0/1296466524 conn(0x7f7c240fd700 msgr2=0x7f7c240ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:31:35.732 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:35.668+0000 7f7c28f64640 1 -- 172.21.15.19:0/1296466524 shutdown_connections 2024-09-10T22:31:35.732 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:35.668+0000 7f7c28f64640 1 -- 172.21.15.19:0/1296466524 wait complete. 2024-09-10T22:31:35.732 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:35.669+0000 7f7c28f64640 1 Processor -- start 2024-09-10T22:31:35.732 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:35.669+0000 7f7c28f64640 1 -- start start 2024-09-10T22:31:35.732 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:35.669+0000 7f7c28f64640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7c24103ca0 0x7f7c24101950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:31:35.732 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:35.669+0000 7f7c28f64640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7c241045c0 0x7f7c24101e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:31:35.732 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:35.669+0000 7f7c28f64640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7c2410d100 0x7f7c241023d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:31:35.732 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:35.669+0000 7f7c28f64640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f7c24112d70 con 0x7f7c2410d100 2024-09-10T22:31:35.732 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:35.669+0000 7f7c28f64640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f7c24112bf0 con 0x7f7c24103ca0 2024-09-10T22:31:35.732 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:35.669+0000 7f7c28f64640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f7c24112ef0 con 0x7f7c241045c0 2024-09-10T22:31:35.733 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:35.669+0000 7f7c22d9d640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7c2410d100 0x7f7c241023d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:31:35.733 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:35.669+0000 7f7c2259c640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7c24103ca0 0x7f7c24101950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:31:35.733 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:35.669+0000 7f7c2259c640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7c24103ca0 0x7f7c24101950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.19:46276/0 (socket says 172.21.15.19:46276) 2024-09-10T22:31:35.733 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:35.669+0000 7f7c2259c640 1 -- 172.21.15.19:0/2252805428 learned_addr learned my addr 172.21.15.19:0/2252805428 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:31:35.733 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:35.669+0000 7f7c21d9b640 1 --2- 172.21.15.19:0/2252805428 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7c241045c0 0x7f7c24101e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:31:35.733 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:35.670+0000 7f7c21d9b640 1 -- 172.21.15.19:0/2252805428 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7c24103ca0 msgr2=0x7f7c24101950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:31:35.733 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:35.670+0000 7f7c21d9b640 1 --2- 172.21.15.19:0/2252805428 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7c24103ca0 0x7f7c24101950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:31:35.733 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:35.670+0000 7f7c21d9b640 1 -- 172.21.15.19:0/2252805428 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7c2410d100 msgr2=0x7f7c241023d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:31:35.733 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:35.670+0000 7f7c21d9b640 1 --2- 172.21.15.19:0/2252805428 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7c2410d100 0x7f7c241023d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:31:35.733 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:35.670+0000 7f7c21d9b640 1 -- 172.21.15.19:0/2252805428 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7c241a76e0 con 0x7f7c241045c0 2024-09-10T22:31:35.733 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:35.670+0000 7f7c22d9d640 1 --2- 172.21.15.19:0/2252805428 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7c2410d100 0x7f7c241023d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T22:31:35.733 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:35.670+0000 7f7c2259c640 1 --2- 172.21.15.19:0/2252805428 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7c24103ca0 0x7f7c24101950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T22:31:35.733 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:35.670+0000 7f7c21d9b640 1 --2- 172.21.15.19:0/2252805428 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7c241045c0 0x7f7c24101e90 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f7c1800e790 tx=0x7f7c1800ec50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:31:35.734 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:35.670+0000 7f7c137fe640 1 -- 172.21.15.19:0/2252805428 <== mon.1 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c1800eea0 con 0x7f7c241045c0 2024-09-10T22:31:35.734 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:35.670+0000 7f7c28f64640 1 -- 172.21.15.19:0/2252805428 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7c241a79d0 con 0x7f7c241045c0 2024-09-10T22:31:35.734 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:35.670+0000 7f7c137fe640 1 -- 172.21.15.19:0/2252805428 <== mon.1 v2:172.21.15.138:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7c1800ccc0 con 0x7f7c241045c0 2024-09-10T22:31:35.734 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:35.670+0000 7f7c137fe640 1 -- 172.21.15.19:0/2252805428 <== mon.1 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c18010430 con 0x7f7c241045c0 2024-09-10T22:31:35.734 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:35.670+0000 7f7c28f64640 1 -- 172.21.15.19:0/2252805428 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7c241a7ec0 con 0x7f7c241045c0 2024-09-10T22:31:35.734 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:35.673+0000 7f7c137fe640 1 -- 172.21.15.19:0/2252805428 <== mon.1 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 18) ==== 153250+0+0 (secure 0 0 0) 0x7f7c18003f20 con 0x7f7c241045c0 2024-09-10T22:31:35.734 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:35.674+0000 7f7c2b339740 1 Processor -- start 2024-09-10T22:31:35.734 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:35.674+0000 7f7c2b339740 1 -- start start 2024-09-10T22:31:35.734 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:35.675+0000 7f7c2b339740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564e8552c0a0 0x564e8552c480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:31:35.734 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:35.675+0000 7f7c2b339740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x564e8552c9c0 0x564e85538410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:31:35.734 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:35.675+0000 7f7c2b339740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x564e85538950 0x564e8553ad40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:31:35.734 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:35.675+0000 7f7c2b339740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x564e854a2e50 con 0x564e8552c9c0 2024-09-10T22:31:35.735 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:35.675+0000 7f7c2b339740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x564e85492280 con 0x564e8552c0a0 2024-09-10T22:31:35.735 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:35.675+0000 7f7c2b339740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x564e85496090 con 0x564e85538950 2024-09-10T22:31:35.735 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:35.675+0000 7f7c2259c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x564e8552c9c0 0x564e85538410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:31:35.735 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:35.675+0000 7f7c22d9d640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564e8552c0a0 0x564e8552c480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:31:35.735 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:35.675+0000 7f7c2259c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x564e8552c9c0 0x564e85538410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:53606/0 (socket says 172.21.15.19:53606) 2024-09-10T22:31:35.735 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:35.675+0000 7f7c2259c640 1 -- 172.21.15.19:0/3232665168 learned_addr learned my addr 172.21.15.19:0/3232665168 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:31:35.735 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:35.675+0000 7f7c137fe640 1 --2- 172.21.15.19:0/2252805428 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f7c0c0b52e0 0x7f7c0c0b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:31:35.735 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:35.675+0000 7f7c21d9b640 1 --2- 172.21.15.19:0/3232665168 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x564e85538950 0x564e8553ad40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:31:35.735 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:35.675+0000 7f7c22d9d640 1 --2- 172.21.15.19:0/2252805428 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f7c0c0b52e0 0x7f7c0c0b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:31:35.735 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:35.675+0000 7f7c2259c640 1 -- 172.21.15.19:0/3232665168 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x564e85538950 msgr2=0x564e8553ad40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:31:35.735 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:35.675+0000 7f7c2259c640 1 --2- 172.21.15.19:0/3232665168 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x564e85538950 0x564e8553ad40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:31:35.735 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:35.675+0000 7f7c2259c640 1 -- 172.21.15.19:0/3232665168 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564e8552c0a0 msgr2=0x564e8552c480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:31:35.735 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:35.675+0000 7f7c2259c640 1 --2- 172.21.15.19:0/3232665168 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564e8552c0a0 0x564e8552c480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:31:35.736 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:35.675+0000 7f7c2259c640 1 -- 172.21.15.19:0/3232665168 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564e851f0650 con 0x564e8552c9c0 2024-09-10T22:31:35.736 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:35.675+0000 7f7c22d9d640 1 --2- 172.21.15.19:0/3232665168 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564e8552c0a0 0x564e8552c480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T22:31:35.736 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:35.675+0000 7f7c137fe640 1 -- 172.21.15.19:0/2252805428 <== mon.1 v2:172.21.15.138:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8327+0+0 (secure 0 0 0) 0x7f7c180e5e90 con 0x7f7c241045c0 2024-09-10T22:31:35.736 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:35.676+0000 7f7c2259c640 1 --2- 172.21.15.19:0/3232665168 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x564e8552c9c0 0x564e85538410 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7f7c14000c00 tx=0x7f7c14032ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3f313c8b7637a6f1 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:31:35.736 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:35.676+0000 7f7c22d9d640 1 --2- 172.21.15.19:0/2252805428 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f7c0c0b52e0 0x7f7c0c0b77a0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f7c24103a10 tx=0x7f7c1c004ab0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:31:35.736 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:35.676+0000 7f7c10ff9640 1 -- 172.21.15.19:0/3232665168 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c14035040 con 0x564e8552c9c0 2024-09-10T22:31:35.736 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:35.676+0000 7f7c10ff9640 1 -- 172.21.15.19:0/3232665168 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7c140317a0 con 0x564e8552c9c0 2024-09-10T22:31:35.736 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:35.676+0000 7f7c10ff9640 1 -- 172.21.15.19:0/3232665168 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c140049c0 con 0x564e8552c9c0 2024-09-10T22:31:35.736 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:35.677+0000 7f7c2b339740 1 -- 172.21.15.19:0/3232665168 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x564e8552c9c0 msgr2=0x564e85538410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:31:35.736 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:35.677+0000 7f7c2b339740 1 --2- 172.21.15.19:0/3232665168 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x564e8552c9c0 0x564e85538410 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7f7c14000c00 tx=0x7f7c14032ed0 comp rx=0 tx=0).stop 2024-09-10T22:31:35.736 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:35.677+0000 7f7c2b339740 1 -- 172.21.15.19:0/3232665168 shutdown_connections 2024-09-10T22:31:35.736 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:35.677+0000 7f7c2b339740 1 --2- 172.21.15.19:0/3232665168 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x564e85538950 0x564e8553ad40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:31:35.736 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:35.677+0000 7f7c2b339740 1 --2- 172.21.15.19:0/3232665168 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x564e8552c9c0 0x564e85538410 unknown :-1 s=CLOSED pgs=622 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:31:35.737 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:35.677+0000 7f7c2b339740 1 --2- 172.21.15.19:0/3232665168 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564e8552c0a0 0x564e8552c480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:31:35.737 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:35.677+0000 7f7c2b339740 1 -- 172.21.15.19:0/3232665168 >> 172.21.15.19:0/3232665168 conn(0x564e85529ed0 msgr2=0x564e8552b070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:31:35.737 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:35.677+0000 7f7c2b339740 1 -- 172.21.15.19:0/3232665168 shutdown_connections 2024-09-10T22:31:35.737 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:35.677+0000 7f7c2b339740 1 -- 172.21.15.19:0/3232665168 wait complete. 2024-09-10T22:31:35.737 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:35.677+0000 7f7c2b339740 1 -- start start 2024-09-10T22:31:35.737 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:35.677+0000 7f7c2b339740 1 Processor -- start 2024-09-10T22:31:35.737 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:35.678+0000 7f7c2b339740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x564e8552c0a0 0x564e85538230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:31:35.737 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:35.678+0000 7f7c2b339740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x564e8552c9c0 0x564e85535680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:31:35.737 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:35.678+0000 7f7c2b339740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564e85538950 0x564e85535cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:31:35.737 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:35.678+0000 7f7c2b339740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x564e852f3700 con 0x564e8552c9c0 2024-09-10T22:31:35.738 INFO:teuthology.orchestra.run.smithi019.stdout:{ 2024-09-10T22:31:35.738 INFO:teuthology.orchestra.run.smithi019.stdout: "status": "no active scrubs running", 2024-09-10T22:31:35.738 INFO:teuthology.orchestra.run.smithi019.stdout: "scrubs": {}, 2024-09-10T22:31:35.738 INFO:teuthology.orchestra.run.smithi019.stdout: "scrub_stats": { 2024-09-10T22:31:35.738 INFO:teuthology.orchestra.run.smithi019.stdout: "715ec863-8a9d-45b6-967f-59b15ce1bf12": { 2024-09-10T22:31:35.738 INFO:teuthology.orchestra.run.smithi019.stdout: "start_time": "2024-09-10T22:31:00.669516+0000", 2024-09-10T22:31:35.738 INFO:teuthology.orchestra.run.smithi019.stdout: "path": "/", 2024-09-10T22:31:35.738 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_started": 0, 2024-09-10T22:31:35.738 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_passed": 0, 2024-09-10T22:31:35.738 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_failed": 0, 2024-09-10T22:31:35.738 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_skipped": 0 2024-09-10T22:31:35.739 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:31:35.739 INFO:teuthology.orchestra.run.smithi019.stdout: "fd1f1837-dcfa-4d88-99e8-2509f36c3f98": { 2024-09-10T22:31:35.739 INFO:teuthology.orchestra.run.smithi019.stdout: "start_time": "2024-09-10T22:30:12.470477+0000", 2024-09-10T22:31:35.739 INFO:teuthology.orchestra.run.smithi019.stdout: "path": "/", 2024-09-10T22:31:35.739 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_started": 0, 2024-09-10T22:31:35.739 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_passed": 0, 2024-09-10T22:31:35.739 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_failed": 0, 2024-09-10T22:31:35.739 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_skipped": 0 2024-09-10T22:31:35.739 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:31:35.739 INFO:teuthology.orchestra.run.smithi019.stdout: "8f3bb3bf-911f-490c-9856-c80ea220dbbe": { 2024-09-10T22:31:35.739 INFO:teuthology.orchestra.run.smithi019.stdout: "start_time": "2024-09-10T22:29:25.374415+0000", 2024-09-10T22:31:35.739 INFO:teuthology.orchestra.run.smithi019.stdout: "path": "/", 2024-09-10T22:31:35.740 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_started": 0, 2024-09-10T22:31:35.740 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_passed": 0, 2024-09-10T22:31:35.740 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_failed": 0, 2024-09-10T22:31:35.740 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_skipped": 0 2024-09-10T22:31:35.740 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:31:35.740 INFO:teuthology.orchestra.run.smithi019.stdout: "eb518e3c-a71e-4f32-9ca0-ae88930ca218": { 2024-09-10T22:31:35.740 INFO:teuthology.orchestra.run.smithi019.stdout: "start_time": "2024-09-10T22:28:38.366352+0000", 2024-09-10T22:31:35.740 INFO:teuthology.orchestra.run.smithi019.stdout: "path": "/", 2024-09-10T22:31:35.740 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_started": 0, 2024-09-10T22:31:35.740 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_passed": 0, 2024-09-10T22:31:35.740 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_failed": 0, 2024-09-10T22:31:35.740 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_skipped": 0 2024-09-10T22:31:35.741 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:31:35.741 INFO:teuthology.orchestra.run.smithi019.stdout: "c12c2a04-dcd6-4673-a98e-93f665d3f5d7": { 2024-09-10T22:31:35.741 INFO:teuthology.orchestra.run.smithi019.stdout: "start_time": "2024-09-10T22:27:49.392329+0000", 2024-09-10T22:31:35.741 INFO:teuthology.orchestra.run.smithi019.stdout: "path": "/", 2024-09-10T22:31:35.741 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_started": 0, 2024-09-10T22:31:35.741 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_passed": 0, 2024-09-10T22:31:35.741 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_failed": 0, 2024-09-10T22:31:35.741 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_skipped": 0 2024-09-10T22:31:35.741 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:31:35.741 INFO:teuthology.orchestra.run.smithi019.stdout: "b38852c8-478a-42ef-8384-b2c55d5313a4": { 2024-09-10T22:31:35.741 INFO:teuthology.orchestra.run.smithi019.stdout: "start_time": "2024-09-10T22:27:00.320308+0000", 2024-09-10T22:31:35.741 INFO:teuthology.orchestra.run.smithi019.stdout: "path": "/", 2024-09-10T22:31:35.741 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_started": 0, 2024-09-10T22:31:35.742 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_passed": 0, 2024-09-10T22:31:35.742 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_failed": 0, 2024-09-10T22:31:35.742 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_skipped": 0 2024-09-10T22:31:35.742 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:31:35.742 INFO:teuthology.orchestra.run.smithi019.stdout: "9b6bfdee-303c-4c12-af56-dc85860d112a": { 2024-09-10T22:31:35.742 INFO:teuthology.orchestra.run.smithi019.stdout: "start_time": "2024-09-10T22:26:17.484162+0000", 2024-09-10T22:31:35.742 INFO:teuthology.orchestra.run.smithi019.stdout: "path": "/", 2024-09-10T22:31:35.742 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_started": 0, 2024-09-10T22:31:35.742 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_passed": 0, 2024-09-10T22:31:35.742 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_failed": 0, 2024-09-10T22:31:35.742 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_skipped": 0 2024-09-10T22:31:35.742 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-10T22:31:35.742 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-10T22:31:35.743 INFO:teuthology.orchestra.run.smithi019.stdout:} 2024-09-10T22:31:35.743 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:35.678+0000 7f7c2b339740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x564e8542d110 con 0x564e85538950 2024-09-10T22:31:35.743 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:35.678+0000 7f7c2b339740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x564e8553b570 con 0x564e8552c0a0 2024-09-10T22:31:35.743 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:35.678+0000 7f7c2b339740 10 client.0 _ll_register_callbacks cb 0x564e85446990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T22:31:35.743 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:35.678+0000 7f7c21d9b640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x564e8552c9c0 0x564e85535680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:31:35.743 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:35.678+0000 7f7c22d9d640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564e85538950 0x564e85535cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:31:35.743 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:35.678+0000 7f7c22d9d640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564e85538950 0x564e85535cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.19:46284/0 (socket says 172.21.15.19:46284) 2024-09-10T22:31:35.743 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:35.678+0000 7f7c21d9b640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x564e8552c9c0 0x564e85535680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:53612/0 (socket says 172.21.15.19:53612) 2024-09-10T22:31:35.744 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:35.678+0000 7f7c22d9d640 1 -- 172.21.15.19:0/1081564405 learned_addr learned my addr 172.21.15.19:0/1081564405 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:31:35.744 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:35.678+0000 7f7c2259c640 1 --2- 172.21.15.19:0/1081564405 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x564e8552c0a0 0x564e85538230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:31:35.744 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:35.678+0000 7f7c22d9d640 1 -- 172.21.15.19:0/1081564405 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x564e8552c0a0 msgr2=0x564e85538230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:31:35.744 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:35.678+0000 7f7c22d9d640 1 --2- 172.21.15.19:0/1081564405 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x564e8552c0a0 0x564e85538230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:31:35.744 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:35.678+0000 7f7c22d9d640 1 -- 172.21.15.19:0/1081564405 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x564e8552c9c0 msgr2=0x564e85535680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:31:35.744 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:35.678+0000 7f7c22d9d640 1 --2- 172.21.15.19:0/1081564405 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x564e8552c9c0 0x564e85535680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:31:35.744 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:35.678+0000 7f7c22d9d640 1 -- 172.21.15.19:0/1081564405 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564e8545ac40 con 0x564e85538950 2024-09-10T22:31:35.744 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:35.678+0000 7f7c21d9b640 1 --2- 172.21.15.19:0/1081564405 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x564e8552c9c0 0x564e85535680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T22:31:35.744 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:35.678+0000 7f7c22d9d640 1 --2- 172.21.15.19:0/1081564405 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564e85538950 0x564e85535cb0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f7c1c013c80 tx=0x7f7c1c004a40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ade270e3a33bcbd0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:31:35.744 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:35.678+0000 7f7c09ffb640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-09-10T22:31:35.744 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:35.679+0000 7f7c09ffb640 1 -- 172.21.15.19:0/1081564405 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c1c019070 con 0x564e85538950 2024-09-10T22:31:35.744 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:35.679+0000 7f7c09ffb640 1 -- 172.21.15.19:0/1081564405 <== mon.2 v2:172.21.15.135:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8327+0+0 (secure 0 0 0) 0x7f7c1c022420 con 0x564e85538950 2024-09-10T22:31:35.744 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:35.679+0000 7f7c2b339740 1 -- 172.21.15.19:0/1081564405 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7c140317a0 con 0x564e85538950 2024-09-10T22:31:35.745 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:35.679+0000 7f7c09ffb640 1 -- 172.21.15.19:0/1081564405 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f7c1c022620 con 0x564e85538950 2024-09-10T22:31:35.745 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:35.679+0000 7f7c2b339740 10 client.25796 fetch_fsmap learned FSMap version 27 2024-09-10T22:31:35.745 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:35.679+0000 7f7c2b339740 1 -- 172.21.15.19:0/1081564405 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x564e85546ef0 con 0x564e85538950 2024-09-10T22:31:35.745 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:35.679+0000 7f7c09ffb640 1 -- 172.21.15.19:0/1081564405 <== mon.2 v2:172.21.15.135:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7c140317a0 con 0x564e85538950 2024-09-10T22:31:35.745 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:35.679+0000 7f7c09ffb640 1 -- 172.21.15.19:0/1081564405 <== mon.2 v2:172.21.15.135:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7f7c1c01e6b0 con 0x564e85538950 2024-09-10T22:31:35.745 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:35.679+0000 7f7c2b339740 10 client.25796 fetch_fsmap finished waiting for FSMap version 27 2024-09-10T22:31:35.745 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:35.679+0000 7f7c2b339740 10 client.25796 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-10T22:31:35.745 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:35.679+0000 7f7c2b339740 20 client.25796 populate_metadata read hostname 'smithi019' 2024-09-10T22:31:35.745 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:35.679+0000 7f7c2b339740 1 --2- 172.21.15.19:0/1081564405 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x564e855483b0 0x564e8554a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:31:35.745 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:35.679+0000 7f7c2b339740 4 client.25796 mds_command: new command op to 24581 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T22:31:35.745 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:35.679+0000 7f7c2b339740 1 -- 172.21.15.19:0/1081564405 --> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564e854a4da0 con 0x564e855483b0 2024-09-10T22:31:35.745 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:35.680+0000 7f7c2259c640 1 --2- 172.21.15.19:0/1081564405 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x564e855483b0 0x564e8554a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:31:35.745 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:35.680+0000 7f7c09ffb640 10 client.25796 ms_handle_connect on v2:172.21.15.135:6838/1254769802 2024-09-10T22:31:35.746 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:35.680+0000 7f7c2259c640 1 --2- 172.21.15.19:0/1081564405 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x564e855483b0 0x564e8554a7a0 crc :-1 s=READY pgs=118 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=63281a512f10bc5e server_cookie=86fd9bd64c0fe3de in_seq=0 out_seq=0 2024-09-10T22:31:35.746 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:35.681+0000 7f7c09ffb640 1 -- 172.21.15.19:0/1081564405 <== mds.0 v2:172.21.15.135:6838/1254769802 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x564e854a4da0 con 0x564e855483b0 2024-09-10T22:31:35.746 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:35.681+0000 7f7c09ffb640 10 client.25796 handle_command_reply: tid=0 2024-09-10T22:31:35.746 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:35.681+0000 7f7c2b339740 1 client.25796 shutdown 2024-09-10T22:31:35.746 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:35.681+0000 7f7c2b339740 1 -- 172.21.15.19:0/1081564405 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564e85538950 msgr2=0x564e85535cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:31:35.746 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:35.681+0000 7f7c2b339740 1 --2- 172.21.15.19:0/1081564405 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564e85538950 0x564e85535cb0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f7c1c013c80 tx=0x7f7c1c004a40 comp rx=0 tx=0).stop 2024-09-10T22:31:35.746 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:35.681+0000 7f7c2b339740 1 -- 172.21.15.19:0/1081564405 shutdown_connections 2024-09-10T22:31:35.746 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:35.681+0000 7f7c2b339740 1 --2- 172.21.15.19:0/1081564405 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564e85538950 0x564e85535cb0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:31:35.746 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:35.681+0000 7f7c2b339740 1 --2- 172.21.15.19:0/1081564405 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x564e8552c9c0 0x564e85535680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:31:35.746 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:35.681+0000 7f7c2b339740 1 --2- 172.21.15.19:0/1081564405 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x564e855483b0 0x564e8554a7a0 crc :-1 s=READY pgs=118 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:31:35.746 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:35.681+0000 7f7c2b339740 1 --2- 172.21.15.19:0/1081564405 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x564e8552c0a0 0x564e85538230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:31:35.746 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:35.681+0000 7f7c2b339740 1 -- 172.21.15.19:0/1081564405 >> 172.21.15.19:0/1081564405 conn(0x564e85529ed0 msgr2=0x564e8552fa70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:31:35.746 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:35.681+0000 7f7c09ffb640 0 client.25796 ms_handle_reset on v2:172.21.15.135:6838/1254769802 2024-09-10T22:31:35.747 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:35.681+0000 7f7c2b339740 1 -- 172.21.15.19:0/1081564405 shutdown_connections 2024-09-10T22:31:35.747 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:35.681+0000 7f7c2b339740 1 -- 172.21.15.19:0/1081564405 wait complete. 2024-09-10T22:31:35.747 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:35.681+0000 7f7c2b339740 20 client.25796 trim_cache size 0 max 16384 2024-09-10T22:31:35.747 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:35.700+0000 7f7c2b339740 1 Processor -- start 2024-09-10T22:31:35.747 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:35.700+0000 7f7c2b339740 1 -- start start 2024-09-10T22:31:35.747 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:35.700+0000 7f7c2b339740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x564e8552c0a0 0x564e8552b000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:31:35.747 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:35.700+0000 7f7c2b339740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x564e8552c9c0 0x564e85529710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:31:35.747 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:35.700+0000 7f7c2b339740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564e85538950 0x564e85533f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:31:35.747 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:35.700+0000 7f7c2b339740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f7c241b3020 con 0x564e8552c9c0 2024-09-10T22:31:35.747 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:35.700+0000 7f7c2b339740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f7c241b08f0 con 0x564e85538950 2024-09-10T22:31:35.747 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:35.700+0000 7f7c2b339740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f7c241ae740 con 0x564e8552c0a0 2024-09-10T22:31:35.747 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:35.700+0000 7f7c21d9b640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x564e8552c9c0 0x564e85529710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:31:35.747 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:35.700+0000 7f7c21d9b640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x564e8552c9c0 0x564e85529710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:53626/0 (socket says 172.21.15.19:53626) 2024-09-10T22:31:35.748 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:35.700+0000 7f7c21d9b640 1 -- 172.21.15.19:0/961833107 learned_addr learned my addr 172.21.15.19:0/961833107 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:31:35.748 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:35.700+0000 7f7c22d9d640 1 --2- 172.21.15.19:0/961833107 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564e85538950 0x564e85533f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:31:35.748 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:35.700+0000 7f7c2259c640 1 --2- 172.21.15.19:0/961833107 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x564e8552c0a0 0x564e8552b000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:31:35.748 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:35.701+0000 7f7c21d9b640 1 -- 172.21.15.19:0/961833107 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x564e8552c0a0 msgr2=0x564e8552b000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:31:35.748 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:35.701+0000 7f7c21d9b640 1 --2- 172.21.15.19:0/961833107 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x564e8552c0a0 0x564e8552b000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:31:35.748 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:35.701+0000 7f7c21d9b640 1 -- 172.21.15.19:0/961833107 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564e85538950 msgr2=0x564e85533f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:31:35.748 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:35.701+0000 7f7c21d9b640 1 --2- 172.21.15.19:0/961833107 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564e85538950 0x564e85533f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:31:35.748 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:35.701+0000 7f7c21d9b640 1 -- 172.21.15.19:0/961833107 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564e85525790 con 0x564e8552c9c0 2024-09-10T22:31:35.748 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:35.701+0000 7f7c21d9b640 1 --2- 172.21.15.19:0/961833107 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x564e8552c9c0 0x564e85529710 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7f7c1800c6a0 tx=0x7f7c1800cf30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6f4af8f989155f06 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:31:35.748 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:35.701+0000 7f7c0bfff640 1 -- 172.21.15.19:0/961833107 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c180abd60 con 0x564e8552c9c0 2024-09-10T22:31:35.749 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:35.701+0000 7f7c0bfff640 1 -- 172.21.15.19:0/961833107 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7c180ac100 con 0x564e8552c9c0 2024-09-10T22:31:35.749 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:35.701+0000 7f7c0bfff640 1 -- 172.21.15.19:0/961833107 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c18005ab0 con 0x564e8552c9c0 2024-09-10T22:31:35.749 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:35.702+0000 7f7c2b339740 1 -- 172.21.15.19:0/961833107 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x564e8552c9c0 msgr2=0x564e85529710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:31:35.749 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:35.702+0000 7f7c2b339740 1 --2- 172.21.15.19:0/961833107 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x564e8552c9c0 0x564e85529710 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7f7c1800c6a0 tx=0x7f7c1800cf30 comp rx=0 tx=0).stop 2024-09-10T22:31:35.749 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:35.702+0000 7f7c2b339740 1 -- 172.21.15.19:0/961833107 shutdown_connections 2024-09-10T22:31:35.749 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:35.702+0000 7f7c2b339740 1 --2- 172.21.15.19:0/961833107 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564e85538950 0x564e85533f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:31:35.749 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:35.702+0000 7f7c2b339740 1 --2- 172.21.15.19:0/961833107 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x564e8552c9c0 0x564e85529710 unknown :-1 s=CLOSED pgs=623 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:31:35.749 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:35.702+0000 7f7c2b339740 1 --2- 172.21.15.19:0/961833107 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x564e8552c0a0 0x564e8552b000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:31:35.749 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:35.702+0000 7f7c2b339740 1 -- 172.21.15.19:0/961833107 >> 172.21.15.19:0/961833107 conn(0x564e85529ed0 msgr2=0x564e85530900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:31:35.749 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:35.702+0000 7f7c2b339740 1 -- 172.21.15.19:0/961833107 shutdown_connections 2024-09-10T22:31:35.749 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:35.702+0000 7f7c2b339740 1 -- 172.21.15.19:0/961833107 wait complete. 2024-09-10T22:31:35.749 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:35.703+0000 7f7c2b339740 1 -- start start 2024-09-10T22:31:35.750 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:35.703+0000 7f7c2b339740 1 Processor -- start 2024-09-10T22:31:35.750 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:35.703+0000 7f7c2b339740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x564e8552c0a0 0x564e855411d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:31:35.750 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:35.703+0000 7f7c2b339740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564e8552c9c0 0x564e8554fe10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:31:35.750 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:35.703+0000 7f7c2b339740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x564e85538950 0x564e855505a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:31:35.750 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:35.703+0000 7f7c2b339740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f7c241aedb0 con 0x564e85538950 2024-09-10T22:31:35.750 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:35.703+0000 7f7c2b339740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f7c241b0220 con 0x564e8552c9c0 2024-09-10T22:31:35.750 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:35.703+0000 7f7c2b339740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f7c241af480 con 0x564e8552c0a0 2024-09-10T22:31:35.750 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:35.703+0000 7f7c2b339740 10 client.0 _ll_register_callbacks cb 0x7f7c1c003f20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T22:31:35.750 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:35.703+0000 7f7c22d9d640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x564e85538950 0x564e855505a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:31:35.750 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:35.703+0000 7f7c22d9d640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x564e85538950 0x564e855505a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:53632/0 (socket says 172.21.15.19:53632) 2024-09-10T22:31:35.750 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:35.703+0000 7f7c2259c640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x564e8552c0a0 0x564e855411d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:31:35.750 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:35.703+0000 7f7c22d9d640 1 -- 172.21.15.19:0/3056615735 learned_addr learned my addr 172.21.15.19:0/3056615735 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:31:35.750 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:35.703+0000 7f7c21d9b640 1 --2- 172.21.15.19:0/3056615735 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564e8552c9c0 0x564e8554fe10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:31:35.751 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:35.703+0000 7f7c22d9d640 1 -- 172.21.15.19:0/3056615735 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x564e8552c0a0 msgr2=0x564e855411d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:31:35.751 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:35.703+0000 7f7c22d9d640 1 --2- 172.21.15.19:0/3056615735 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x564e8552c0a0 0x564e855411d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:31:35.751 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:35.703+0000 7f7c22d9d640 1 -- 172.21.15.19:0/3056615735 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564e8552c9c0 msgr2=0x564e8554fe10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:31:35.751 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:35.703+0000 7f7c22d9d640 1 --2- 172.21.15.19:0/3056615735 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564e8552c9c0 0x564e8554fe10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:31:35.751 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:35.704+0000 7f7c22d9d640 1 -- 172.21.15.19:0/3056615735 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564e8553fe30 con 0x564e85538950 2024-09-10T22:31:35.751 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:35.704+0000 7f7c22d9d640 1 --2- 172.21.15.19:0/3056615735 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x564e85538950 0x564e855505a0 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7f7c1c0099e0 tx=0x7f7c1c005bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f790dedc31ef1151 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:31:35.751 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:35.704+0000 7f7c09ffb640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-10T22:31:35.751 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:35.704+0000 7f7c09ffb640 1 -- 172.21.15.19:0/3056615735 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c1c019070 con 0x564e85538950 2024-09-10T22:31:35.751 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:35.704+0000 7f7c09ffb640 1 -- 172.21.15.19:0/3056615735 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8327+0+0 (secure 0 0 0) 0x7f7c1c022420 con 0x564e85538950 2024-09-10T22:31:35.751 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:35.704+0000 7f7c2b339740 1 -- 172.21.15.19:0/3056615735 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7c180ac100 con 0x564e85538950 2024-09-10T22:31:35.751 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:35.704+0000 7f7c09ffb640 1 -- 172.21.15.19:0/3056615735 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f7c1c047050 con 0x564e85538950 2024-09-10T22:31:35.751 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:35.704+0000 7f7c2b339740 10 client.16371 fetch_fsmap learned FSMap version 27 2024-09-10T22:31:35.752 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:35.704+0000 7f7c2b339740 1 -- 172.21.15.19:0/3056615735 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x564e855b5480 con 0x564e85538950 2024-09-10T22:31:35.752 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:35.705+0000 7f7c09ffb640 1 -- 172.21.15.19:0/3056615735 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7c1c027020 con 0x564e85538950 2024-09-10T22:31:35.752 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:35.705+0000 7f7c09ffb640 1 -- 172.21.15.19:0/3056615735 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7f7c1c02c400 con 0x564e85538950 2024-09-10T22:31:35.752 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:35.705+0000 7f7c2b339740 10 client.16371 fetch_fsmap finished waiting for FSMap version 27 2024-09-10T22:31:35.752 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:35.705+0000 7f7c2b339740 10 client.16371 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-10T22:31:35.752 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:35.705+0000 7f7c2b339740 20 client.16371 populate_metadata read hostname 'smithi019' 2024-09-10T22:31:35.752 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:35.705+0000 7f7c2b339740 1 --2- 172.21.15.19:0/3056615735 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x564e855b5b40 0x564e855b7f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:31:35.752 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:35.705+0000 7f7c2b339740 4 client.16371 mds_command: new command op to 24581 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-10T22:31:35.752 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:35.705+0000 7f7c2b339740 1 -- 172.21.15.19:0/3056615735 --> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] -- command(tid 0: {"prefix": "scrub status"}) -- 0x7f7c180ac100 con 0x564e855b5b40 2024-09-10T22:31:35.752 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:35.705+0000 7f7c2259c640 1 --2- 172.21.15.19:0/3056615735 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x564e855b5b40 0x564e855b7f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:31:35.752 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:35.706+0000 7f7c09ffb640 10 client.16371 ms_handle_connect on v2:172.21.15.135:6838/1254769802 2024-09-10T22:31:35.752 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:35.706+0000 7f7c2259c640 1 --2- 172.21.15.19:0/3056615735 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x564e855b5b40 0x564e855b7f30 crc :-1 s=READY pgs=119 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=418313f6831c328d server_cookie=c024146a80e3bbdd in_seq=0 out_seq=0 2024-09-10T22:31:35.752 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:35.707+0000 7f7c09ffb640 1 -- 172.21.15.19:0/3056615735 <== mds.0 v2:172.21.15.135:6838/1254769802 1 ==== command_reply(tid 0: 0 ) ==== 8+0+2078 (crc 0 0 0) 0x7f7c180ac100 con 0x564e855b5b40 2024-09-10T22:31:35.753 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:35.707+0000 7f7c09ffb640 10 client.16371 handle_command_reply: tid=0 2024-09-10T22:31:35.753 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:35.707+0000 7f7c2b339740 1 client.16371 shutdown 2024-09-10T22:31:35.753 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:35.707+0000 7f7c2b339740 1 -- 172.21.15.19:0/3056615735 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x564e85538950 msgr2=0x564e855505a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:31:35.753 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:35.707+0000 7f7c2b339740 1 --2- 172.21.15.19:0/3056615735 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x564e85538950 0x564e855505a0 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7f7c1c0099e0 tx=0x7f7c1c005bd0 comp rx=0 tx=0).stop 2024-09-10T22:31:35.753 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:35.707+0000 7f7c2b339740 1 -- 172.21.15.19:0/3056615735 shutdown_connections 2024-09-10T22:31:35.753 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:35.707+0000 7f7c2b339740 1 --2- 172.21.15.19:0/3056615735 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x564e85538950 0x564e855505a0 unknown :-1 s=CLOSED pgs=624 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:31:35.753 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:35.707+0000 7f7c2b339740 1 --2- 172.21.15.19:0/3056615735 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564e8552c9c0 0x564e8554fe10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:31:35.753 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:35.707+0000 7f7c2b339740 1 --2- 172.21.15.19:0/3056615735 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x564e855b5b40 0x564e855b7f30 crc :-1 s=READY pgs=119 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:31:35.753 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:35.707+0000 7f7c2b339740 1 --2- 172.21.15.19:0/3056615735 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x564e8552c0a0 0x564e855411d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:31:35.753 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:35.707+0000 7f7c09ffb640 0 client.16371 ms_handle_reset on v2:172.21.15.135:6838/1254769802 2024-09-10T22:31:35.753 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:35.707+0000 7f7c2b339740 1 -- 172.21.15.19:0/3056615735 >> 172.21.15.19:0/3056615735 conn(0x564e85529ed0 msgr2=0x564e85530900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:31:35.753 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:35.707+0000 7f7c2b339740 1 -- 172.21.15.19:0/3056615735 shutdown_connections 2024-09-10T22:31:35.753 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:35.707+0000 7f7c2b339740 1 -- 172.21.15.19:0/3056615735 wait complete. 2024-09-10T22:31:35.754 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:35.707+0000 7f7c2b339740 20 client.16371 trim_cache size 0 max 16384 2024-09-10T22:31:35.754 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:35.708+0000 7f7c28f64640 1 -- 172.21.15.19:0/2252805428 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f7c0c0b52e0 msgr2=0x7f7c0c0b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:31:35.754 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:35.708+0000 7f7c28f64640 1 --2- 172.21.15.19:0/2252805428 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f7c0c0b52e0 0x7f7c0c0b77a0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f7c24103a10 tx=0x7f7c1c004ab0 comp rx=0 tx=0).stop 2024-09-10T22:31:35.754 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:35.708+0000 7f7c28f64640 1 -- 172.21.15.19:0/2252805428 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7c241045c0 msgr2=0x7f7c24101e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:31:35.754 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:35.708+0000 7f7c28f64640 1 --2- 172.21.15.19:0/2252805428 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7c241045c0 0x7f7c24101e90 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f7c1800e790 tx=0x7f7c1800ec50 comp rx=0 tx=0).stop 2024-09-10T22:31:35.754 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:35.708+0000 7f7c28f64640 1 -- 172.21.15.19:0/2252805428 shutdown_connections 2024-09-10T22:31:35.754 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:35.708+0000 7f7c28f64640 1 --2- 172.21.15.19:0/2252805428 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f7c0c0b52e0 0x7f7c0c0b77a0 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:31:35.754 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:35.708+0000 7f7c28f64640 1 --2- 172.21.15.19:0/2252805428 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7c2410d100 0x7f7c241023d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:31:35.754 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:35.708+0000 7f7c28f64640 1 --2- 172.21.15.19:0/2252805428 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7c241045c0 0x7f7c24101e90 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:31:35.754 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:35.708+0000 7f7c28f64640 1 --2- 172.21.15.19:0/2252805428 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7c24103ca0 0x7f7c24101950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:31:35.754 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:35.708+0000 7f7c28f64640 1 -- 172.21.15.19:0/2252805428 >> 172.21.15.19:0/2252805428 conn(0x7f7c240fd700 msgr2=0x7f7c240fe360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:31:35.754 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:35.708+0000 7f7c28f64640 1 -- 172.21.15.19:0/2252805428 shutdown_connections 2024-09-10T22:31:35.754 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:35.708+0000 7f7c28f64640 1 -- 172.21.15.19:0/2252805428 wait complete. 2024-09-10T22:31:36.796 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-10T22:31:36.796 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 22997a4c-6fc2-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-10T22:31:37.223 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/22997a4c-6fc2-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T22:31:37.875 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:31:37 smithi138 ceph-mon[35236]: pgmap v503: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 373 MiB/s wr, 228 op/s 2024-09-10T22:31:37.924 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:31:37 smithi019 ceph-mon[31375]: pgmap v503: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 373 MiB/s wr, 228 op/s 2024-09-10T22:31:37.977 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:37.975+0000 7fe50f074640 1 -- 172.21.15.19:0/4160929383 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe508108020 msgr2=0x7fe50810e820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:31:37.977 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:37.975+0000 7fe50f074640 1 --2- 172.21.15.19:0/4160929383 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe508108020 0x7fe50810e820 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7fe500009ca0 tx=0x7fe50002a8c0 comp rx=0 tx=0).stop 2024-09-10T22:31:37.977 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:37.975+0000 7fe50f074640 1 -- 172.21.15.19:0/4160929383 shutdown_connections 2024-09-10T22:31:37.977 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:37.975+0000 7fe50f074640 1 --2- 172.21.15.19:0/4160929383 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe508108020 0x7fe50810e820 unknown :-1 s=CLOSED pgs=625 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:31:37.977 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:37.975+0000 7fe50f074640 1 --2- 172.21.15.19:0/4160929383 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe5081076a0 0x7fe508107ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:31:37.977 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:37.975+0000 7fe50f074640 1 --2- 172.21.15.19:0/4160929383 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe508101c90 0x7fe508102070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:31:37.977 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:37.975+0000 7fe50f074640 1 -- 172.21.15.19:0/4160929383 >> 172.21.15.19:0/4160929383 conn(0x7fe5080fd700 msgr2=0x7fe5080ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:31:37.977 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:37.975+0000 7fe50f074640 1 -- 172.21.15.19:0/4160929383 shutdown_connections 2024-09-10T22:31:37.977 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:37.975+0000 7fe50f074640 1 -- 172.21.15.19:0/4160929383 wait complete. 2024-09-10T22:31:37.979 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:37.976+0000 7fe50f074640 1 Processor -- start 2024-09-10T22:31:37.979 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:37.976+0000 7fe50f074640 1 -- start start 2024-09-10T22:31:37.979 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:37.976+0000 7fe50f074640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe508101c90 0x7fe5081992c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:31:37.979 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:37.976+0000 7fe50f074640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe5081076a0 0x7fe508199800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:31:37.979 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:37.976+0000 7fe50f074640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe508108020 0x7fe50819eba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:31:37.979 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:37.976+0000 7fe50f074640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fe508111ca0 con 0x7fe508101c90 2024-09-10T22:31:37.979 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:37.976+0000 7fe50f074640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fe508111b20 con 0x7fe5081076a0 2024-09-10T22:31:37.979 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:37.976+0000 7fe50f074640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7fe508111e20 con 0x7fe508108020 2024-09-10T22:31:37.980 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:37.976+0000 7fe50ce10640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe508101c90 0x7fe5081992c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:31:37.980 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:37.976+0000 7fe50ce10640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe508101c90 0x7fe5081992c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:53662/0 (socket says 172.21.15.19:53662) 2024-09-10T22:31:37.980 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:37.976+0000 7fe50ce10640 1 -- 172.21.15.19:0/3409328248 learned_addr learned my addr 172.21.15.19:0/3409328248 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:31:37.980 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:37.976+0000 7fe507fff640 1 --2- 172.21.15.19:0/3409328248 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe5081076a0 0x7fe508199800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:31:37.980 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:37.976+0000 7fe50d611640 1 --2- 172.21.15.19:0/3409328248 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe508108020 0x7fe50819eba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:31:37.980 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:37.977+0000 7fe50d611640 1 -- 172.21.15.19:0/3409328248 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe5081076a0 msgr2=0x7fe508199800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:31:37.980 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:37.977+0000 7fe50d611640 1 --2- 172.21.15.19:0/3409328248 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe5081076a0 0x7fe508199800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:31:37.980 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:37.977+0000 7fe50d611640 1 -- 172.21.15.19:0/3409328248 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe508101c90 msgr2=0x7fe5081992c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:31:37.980 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:37.977+0000 7fe50d611640 1 --2- 172.21.15.19:0/3409328248 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe508101c90 0x7fe5081992c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:31:37.980 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:37.977+0000 7fe50d611640 1 -- 172.21.15.19:0/3409328248 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe50819f370 con 0x7fe508108020 2024-09-10T22:31:37.980 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:37.977+0000 7fe50ce10640 1 --2- 172.21.15.19:0/3409328248 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe508101c90 0x7fe5081992c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T22:31:37.980 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:37.977+0000 7fe50d611640 1 --2- 172.21.15.19:0/3409328248 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe508108020 0x7fe50819eba0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fe50002ade0 tx=0x7fe500031660 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:31:37.981 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:37.977+0000 7fe505ffb640 1 -- 172.21.15.19:0/3409328248 <== mon.1 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe500003b70 con 0x7fe508108020 2024-09-10T22:31:37.981 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:37.977+0000 7fe50f074640 1 -- 172.21.15.19:0/3409328248 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe50819f600 con 0x7fe508108020 2024-09-10T22:31:37.981 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:37.977+0000 7fe505ffb640 1 -- 172.21.15.19:0/3409328248 <== mon.1 v2:172.21.15.138:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe500031910 con 0x7fe508108020 2024-09-10T22:31:37.981 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:37.977+0000 7fe505ffb640 1 -- 172.21.15.19:0/3409328248 <== mon.1 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe50002f950 con 0x7fe508108020 2024-09-10T22:31:37.981 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:37.977+0000 7fe50f074640 1 -- 172.21.15.19:0/3409328248 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe5080fdd90 con 0x7fe508108020 2024-09-10T22:31:37.981 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:37.978+0000 7fe50f074640 1 -- 172.21.15.19:0/3409328248 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe508102070 con 0x7fe508108020 2024-09-10T22:31:37.981 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:37.980+0000 7fe505ffb640 1 -- 172.21.15.19:0/3409328248 <== mon.1 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 18) ==== 153250+0+0 (secure 0 0 0) 0x7fe50002faf0 con 0x7fe508108020 2024-09-10T22:31:37.982 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:37.981+0000 7fe505ffb640 1 --2- 172.21.15.19:0/3409328248 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7fe4f40b52e0 0x7fe4f40b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:31:37.982 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:37.981+0000 7fe50ce10640 1 --2- 172.21.15.19:0/3409328248 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7fe4f40b52e0 0x7fe4f40b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:31:37.982 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:37.981+0000 7fe505ffb640 1 -- 172.21.15.19:0/3409328248 <== mon.1 v2:172.21.15.138:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8327+0+0 (secure 0 0 0) 0x7fe500106e50 con 0x7fe508108020 2024-09-10T22:31:37.983 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:37.981+0000 7fe50ce10640 1 --2- 172.21.15.19:0/3409328248 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7fe4f40b52e0 0x7fe4f40b77a0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7fe4f0009c60 tx=0x7fe4f0016040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:31:37.985 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:37.984+0000 7fe505ffb640 1 -- 172.21.15.19:0/3409328248 <== mon.1 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7fe5000cdc50 con 0x7fe508108020 2024-09-10T22:31:38.109 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:31:37 smithi135 ceph-mon[34789]: pgmap v503: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 373 MiB/s wr, 228 op/s 2024-09-10T22:31:38.245 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:38.244+0000 7fe50f074640 1 -- 172.21.15.19:0/3409328248 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe50819a3f0 con 0x7fe508108020 2024-09-10T22:31:38.246 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:38.244+0000 7fe505ffb640 1 -- 172.21.15.19:0/3409328248 <== mon.1 v2:172.21.15.138:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) ==== 94+0+11921 (secure 0 0 0) 0x7fe500003d10 con 0x7fe508108020 2024-09-10T22:31:38.246 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-10T22:31:38.247 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":27,"btime":"2024-09-10T22:29:37:724724+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14673,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6835/1835804747","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6834","nonce":1835804747},{"type":"v1","addr":"172.21.15.19:6835","nonce":1835804747}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14685,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6837/1750470490","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6836","nonce":1750470490},{"type":"v1","addr":"172.21.15.19:6837","nonce":1750470490}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14733,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6839/2642941149","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6838","nonce":2642941149},{"type":"v1","addr":"172.21.15.19:6839","nonce":2642941149}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14745,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6841/2449948682","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6840","nonce":2449948682},{"type":"v1","addr":"172.21.15.19:6841","nonce":2449948682}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24511,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.138:6833/2524811494","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6832","nonce":2524811494},{"type":"v1","addr":"172.21.15.138:6833","nonce":2524811494}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24512,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6833/3014993624","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6832","nonce":3014993624},{"type":"v1","addr":"172.21.15.135:6833","nonce":3014993624}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":27,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-10T22:24:22.733925+0000","modified":"2024-09-10T22:29:37.430699+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24581,"mds_1":24568,"mds_2":24553},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24527":{"gid":24527,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.135:6835/3715773348","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6834","nonce":3715773348},{"type":"v1","addr":"172.21.15.135:6835","nonce":3715773348}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24541":{"gid":24541,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.138:6835/933547028","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6834","nonce":933547028},{"type":"v1","addr":"172.21.15.138:6835","nonce":933547028}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24551":{"gid":24551,"name":"h","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.135:6837/3495029135","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6836","nonce":3495029135},{"type":"v1","addr":"172.21.15.135:6837","nonce":3495029135}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24553":{"gid":24553,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":10,"addr":"172.21.15.138:6837/3353290042","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6836","nonce":3353290042},{"type":"v1","addr":"172.21.15.138:6837","nonce":3353290042}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24568":{"gid":24568,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.138:6839/383637208","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6838","nonce":383637208},{"type":"v1","addr":"172.21.15.138:6839","nonce":383637208}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24581":{"gid":24581,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.135:6839/1254769802","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6838","nonce":1254769802},{"type":"v1","addr":"172.21.15.135:6839","nonce":1254769802}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24581,"qdb_cluster":[24581,24568,24553]},"id":1}]} 2024-09-10T22:31:38.247 INFO:teuthology.orchestra.run.smithi019.stderr:dumped fsmap epoch 27 2024-09-10T22:31:38.249 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:38.247+0000 7fe50f074640 1 -- 172.21.15.19:0/3409328248 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7fe4f40b52e0 msgr2=0x7fe4f40b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:31:38.249 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:38.247+0000 7fe50f074640 1 --2- 172.21.15.19:0/3409328248 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7fe4f40b52e0 0x7fe4f40b77a0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7fe4f0009c60 tx=0x7fe4f0016040 comp rx=0 tx=0).stop 2024-09-10T22:31:38.249 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:38.247+0000 7fe50f074640 1 -- 172.21.15.19:0/3409328248 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe508108020 msgr2=0x7fe50819eba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:31:38.249 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:38.247+0000 7fe50f074640 1 --2- 172.21.15.19:0/3409328248 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe508108020 0x7fe50819eba0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fe50002ade0 tx=0x7fe500031660 comp rx=0 tx=0).stop 2024-09-10T22:31:38.249 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:38.247+0000 7fe50f074640 1 -- 172.21.15.19:0/3409328248 shutdown_connections 2024-09-10T22:31:38.249 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:38.247+0000 7fe50f074640 1 --2- 172.21.15.19:0/3409328248 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7fe4f40b52e0 0x7fe4f40b77a0 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:31:38.249 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:38.247+0000 7fe50f074640 1 --2- 172.21.15.19:0/3409328248 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe508108020 0x7fe50819eba0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:31:38.249 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:38.247+0000 7fe50f074640 1 --2- 172.21.15.19:0/3409328248 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe5081076a0 0x7fe508199800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:31:38.249 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:38.247+0000 7fe50f074640 1 --2- 172.21.15.19:0/3409328248 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe508101c90 0x7fe5081992c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:31:38.249 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:38.247+0000 7fe50f074640 1 -- 172.21.15.19:0/3409328248 >> 172.21.15.19:0/3409328248 conn(0x7fe5080fd700 msgr2=0x7fe50806ae10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:31:38.249 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:38.247+0000 7fe50f074640 1 -- 172.21.15.19:0/3409328248 shutdown_connections 2024-09-10T22:31:38.250 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:38.247+0000 7fe50f074640 1 -- 172.21.15.19:0/3409328248 wait complete. 2024-09-10T22:31:38.655 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:38.653+0000 7feee37fe640 1 -- 172.21.15.19:0/3659646715 <== mds.0 v2:172.21.15.135:6838/1254769802 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x56127fbf0520 con 0x56127fc88bd0 2024-09-10T22:31:38.655 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:38.653+0000 7feee37fe640 10 client.16353 handle_command_reply: tid=0 2024-09-10T22:31:38.655 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:38.653+0000 7fef0d803740 1 client.16353 shutdown 2024-09-10T22:31:38.655 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:38.653+0000 7fef0d803740 1 -- 172.21.15.19:0/3659646715 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56127fc86190 msgr2=0x56127fc940a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:31:38.655 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:38.653+0000 7fef0d803740 1 --2- 172.21.15.19:0/3659646715 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56127fc86190 0x56127fc940a0 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x56127fc8dd10 tx=0x7feefc005df0 comp rx=0 tx=0).stop 2024-09-10T22:31:38.655 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:38.653+0000 7fef0d803740 1 -- 172.21.15.19:0/3659646715 shutdown_connections 2024-09-10T22:31:38.655 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:38.653+0000 7fef0d803740 1 --2- 172.21.15.19:0/3659646715 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56127fc86190 0x56127fc940a0 unknown :-1 s=CLOSED pgs=620 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:31:38.656 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:38.653+0000 7fef0d803740 1 --2- 172.21.15.19:0/3659646715 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56127fc83860 0x56127fc939b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:31:38.656 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:38.653+0000 7fef0d803740 1 --2- 172.21.15.19:0/3659646715 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x56127fc88bd0 0x56127fd07f70 crc :-1 s=READY pgs=117 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:31:38.656 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:38.653+0000 7fef0d803740 1 --2- 172.21.15.19:0/3659646715 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x56127fc7e9b0 0x56127fc94c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:31:38.656 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:38.653+0000 7fef0d803740 1 -- 172.21.15.19:0/3659646715 >> 172.21.15.19:0/3659646715 conn(0x56127fc79ea0 msgr2=0x56127fc7d3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:31:38.656 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:38.653+0000 7feee37fe640 0 client.16353 ms_handle_reset on v2:172.21.15.135:6838/1254769802 2024-09-10T22:31:38.656 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:38.653+0000 7fef0d803740 1 -- 172.21.15.19:0/3659646715 shutdown_connections 2024-09-10T22:31:38.656 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:38.653+0000 7fef0d803740 1 -- 172.21.15.19:0/3659646715 wait complete. 2024-09-10T22:31:38.656 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:38.653+0000 7fef0d803740 20 client.16353 trim_cache size 0 max 16384 2024-09-10T22:31:38.656 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stdout:{ 2024-09-10T22:31:38.656 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stdout: "message": "", 2024-09-10T22:31:38.657 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stdout: "return_code": 0 2024-09-10T22:31:38.657 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stdout:} 2024-09-10T22:31:38.657 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:38.654+0000 7fef0aa33640 1 -- 172.21.15.19:0/3273227286 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7feeec0b5360 msgr2=0x7feeec0b7820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:31:38.657 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:38.654+0000 7fef0aa33640 1 --2- 172.21.15.19:0/3273227286 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7feeec0b5360 0x7feeec0b7820 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7feef4006010 tx=0x7feef4005a40 comp rx=0 tx=0).stop 2024-09-10T22:31:38.658 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:38.654+0000 7fef0aa33640 1 -- 172.21.15.19:0/3273227286 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fef04103ad0 msgr2=0x7fef04075540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:31:38.658 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:38.654+0000 7fef0aa33640 1 --2- 172.21.15.19:0/3273227286 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fef04103ad0 0x7fef04075540 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7feef800d950 tx=0x7feef800de10 comp rx=0 tx=0).stop 2024-09-10T22:31:38.658 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:38.655+0000 7fef0aa33640 1 -- 172.21.15.19:0/3273227286 shutdown_connections 2024-09-10T22:31:38.658 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:38.655+0000 7fef0aa33640 1 --2- 172.21.15.19:0/3273227286 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7feeec0b5360 0x7feeec0b7820 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:31:38.658 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:38.655+0000 7fef0aa33640 1 --2- 172.21.15.19:0/3273227286 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fef04104490 0x7fef04075a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:31:38.658 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:38.655+0000 7fef0aa33640 1 --2- 172.21.15.19:0/3273227286 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fef04103ad0 0x7fef04075540 unknown :-1 s=CLOSED pgs=616 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:31:38.658 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:38.655+0000 7fef0aa33640 1 --2- 172.21.15.19:0/3273227286 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fef04102980 0x7fef04076ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:31:38.658 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:38.655+0000 7fef0aa33640 1 -- 172.21.15.19:0/3273227286 >> 172.21.15.19:0/3273227286 conn(0x7fef040fe240 msgr2=0x7fef04106e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:31:38.658 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:38.655+0000 7fef0aa33640 1 -- 172.21.15.19:0/3273227286 shutdown_connections 2024-09-10T22:31:38.658 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:38.655+0000 7fef0aa33640 1 -- 172.21.15.19:0/3273227286 wait complete. 2024-09-10T22:31:38.939 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:31:38 smithi019 ceph-mon[31375]: from='client.? 172.21.15.19:0/3409328248' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T22:31:39.031 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 22997a4c-6fc2-11ef-bcea-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-09-10T22:31:39.109 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:31:38 smithi135 ceph-mon[34789]: from='client.? 172.21.15.19:0/3409328248' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T22:31:39.125 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:31:38 smithi138 ceph-mon[35236]: from='client.? 172.21.15.19:0/3409328248' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T22:31:39.335 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/22997a4c-6fc2-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T22:31:39.925 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:39.898+0000 7f601931b640 1 -- 172.21.15.19:0/151975754 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6014108020 msgr2=0x7f601410e820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:31:39.925 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:39.898+0000 7f601931b640 1 --2- 172.21.15.19:0/151975754 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6014108020 0x7f601410e820 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7f600c009ca0 tx=0x7f600c02a8c0 comp rx=0 tx=0).stop 2024-09-10T22:31:39.925 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:39.898+0000 7f601931b640 1 -- 172.21.15.19:0/151975754 shutdown_connections 2024-09-10T22:31:39.925 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:39.898+0000 7f601931b640 1 --2- 172.21.15.19:0/151975754 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6014108020 0x7f601410e820 unknown :-1 s=CLOSED pgs=626 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:31:39.925 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:39.898+0000 7f601931b640 1 --2- 172.21.15.19:0/151975754 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f60141076a0 0x7f6014107ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:31:39.926 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:39.898+0000 7f601931b640 1 --2- 172.21.15.19:0/151975754 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f6014101c90 0x7f6014102070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:31:39.926 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:39.898+0000 7f601931b640 1 -- 172.21.15.19:0/151975754 >> 172.21.15.19:0/151975754 conn(0x7f60140fd700 msgr2=0x7f60140ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:31:39.926 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:39.898+0000 7f601931b640 1 -- 172.21.15.19:0/151975754 shutdown_connections 2024-09-10T22:31:39.926 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:39.898+0000 7f601931b640 1 -- 172.21.15.19:0/151975754 wait complete. 2024-09-10T22:31:39.926 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:39.899+0000 7f601931b640 1 Processor -- start 2024-09-10T22:31:39.926 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:39.899+0000 7f601931b640 1 -- start start 2024-09-10T22:31:39.926 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:39.899+0000 7f601931b640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6014101c90 0x7f60141992c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:31:39.926 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:39.899+0000 7f601931b640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f60141076a0 0x7f6014199800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:31:39.926 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:39.899+0000 7f601931b640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f6014108020 0x7f601419eba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:31:39.926 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:39.899+0000 7f601931b640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f6014111ce0 con 0x7f6014101c90 2024-09-10T22:31:39.926 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:39.899+0000 7f601931b640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f6014111b60 con 0x7f60141076a0 2024-09-10T22:31:39.927 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:39.899+0000 7f601931b640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f6014111e60 con 0x7f6014108020 2024-09-10T22:31:39.927 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:39.899+0000 7f600bfff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f60141076a0 0x7f6014199800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:31:39.927 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:39.899+0000 7f6012ffd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6014101c90 0x7f60141992c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:31:39.927 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:39.899+0000 7f600bfff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f60141076a0 0x7f6014199800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.19:46346/0 (socket says 172.21.15.19:46346) 2024-09-10T22:31:39.927 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:39.899+0000 7f600bfff640 1 -- 172.21.15.19:0/2925329135 learned_addr learned my addr 172.21.15.19:0/2925329135 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:31:39.927 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:39.899+0000 7f60137fe640 1 --2- 172.21.15.19:0/2925329135 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f6014108020 0x7f601419eba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:31:39.927 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:39.900+0000 7f60137fe640 1 -- 172.21.15.19:0/2925329135 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f60141076a0 msgr2=0x7f6014199800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:31:39.927 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:39.900+0000 7f60137fe640 1 --2- 172.21.15.19:0/2925329135 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f60141076a0 0x7f6014199800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:31:39.927 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:39.900+0000 7f60137fe640 1 -- 172.21.15.19:0/2925329135 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6014101c90 msgr2=0x7f60141992c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:31:39.927 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:39.900+0000 7f60137fe640 1 --2- 172.21.15.19:0/2925329135 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6014101c90 0x7f60141992c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:31:39.927 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:39.900+0000 7f60137fe640 1 -- 172.21.15.19:0/2925329135 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f601419f370 con 0x7f6014108020 2024-09-10T22:31:39.927 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:39.900+0000 7f6012ffd640 1 --2- 172.21.15.19:0/2925329135 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6014101c90 0x7f60141992c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T22:31:39.927 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:39.900+0000 7f60137fe640 1 --2- 172.21.15.19:0/2925329135 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f6014108020 0x7f601419eba0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f600c02ade0 tx=0x7f600c0316f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:31:39.928 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:39.900+0000 7f6010ff9640 1 -- 172.21.15.19:0/2925329135 <== mon.1 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f600c003b70 con 0x7f6014108020 2024-09-10T22:31:39.928 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:39.900+0000 7f601931b640 1 -- 172.21.15.19:0/2925329135 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f601419f600 con 0x7f6014108020 2024-09-10T22:31:39.928 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:39.900+0000 7f6010ff9640 1 -- 172.21.15.19:0/2925329135 <== mon.1 v2:172.21.15.138:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f600c003d10 con 0x7f6014108020 2024-09-10T22:31:39.928 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:39.900+0000 7f6010ff9640 1 -- 172.21.15.19:0/2925329135 <== mon.1 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f600c02f9e0 con 0x7f6014108020 2024-09-10T22:31:39.928 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:39.900+0000 7f601931b640 1 -- 172.21.15.19:0/2925329135 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f60140fdae0 con 0x7f6014108020 2024-09-10T22:31:39.928 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:39.903+0000 7f601b6f0740 1 Processor -- start 2024-09-10T22:31:39.928 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:39.904+0000 7f6010ff9640 1 -- 172.21.15.19:0/2925329135 <== mon.1 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 18) ==== 153250+0+0 (secure 0 0 0) 0x7f600c02fb80 con 0x7f6014108020 2024-09-10T22:31:39.928 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:39.904+0000 7f601b6f0740 1 -- start start 2024-09-10T22:31:39.928 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:39.904+0000 7f601b6f0740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56495498a0f0 0x56495498a4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:31:39.928 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:39.904+0000 7f601b6f0740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56495498aa10 0x564954996460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:31:39.928 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:39.904+0000 7f601b6f0740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5649549969a0 0x564954998d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:31:39.928 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:39.904+0000 7f601b6f0740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x564954900ea0 con 0x56495498aa10 2024-09-10T22:31:39.928 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:39.904+0000 7f601b6f0740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x5649548f02d0 con 0x56495498a0f0 2024-09-10T22:31:39.929 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:39.904+0000 7f601b6f0740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x5649548f40e0 con 0x5649549969a0 2024-09-10T22:31:39.929 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:39.904+0000 7f6012ffd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56495498aa10 0x564954996460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:31:39.929 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:39.904+0000 7f6012ffd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56495498aa10 0x564954996460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:53694/0 (socket says 172.21.15.19:53694) 2024-09-10T22:31:39.929 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:39.904+0000 7f600bfff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56495498a0f0 0x56495498a4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:31:39.929 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:39.904+0000 7f6012ffd640 1 -- 172.21.15.19:0/2852392515 learned_addr learned my addr 172.21.15.19:0/2852392515 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:31:39.929 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:39.904+0000 7f600bfff640 1 --2- 172.21.15.19:0/2852392515 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5649549969a0 0x564954998d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:31:39.929 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:39.905+0000 7f6012ffd640 1 -- 172.21.15.19:0/2852392515 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5649549969a0 msgr2=0x564954998d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:31:39.929 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:39.905+0000 7f6012ffd640 1 --2- 172.21.15.19:0/2852392515 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5649549969a0 0x564954998d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:31:39.930 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:39.905+0000 7f6012ffd640 1 -- 172.21.15.19:0/2852392515 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56495498a0f0 msgr2=0x56495498a4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:31:39.930 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:39.905+0000 7f6012ffd640 1 --2- 172.21.15.19:0/2852392515 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56495498a0f0 0x56495498a4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:31:39.930 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:39.905+0000 7f6012ffd640 1 -- 172.21.15.19:0/2852392515 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56495464e650 con 0x56495498aa10 2024-09-10T22:31:39.930 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:39.905+0000 7f600bfff640 1 --2- 172.21.15.19:0/2852392515 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56495498a0f0 0x56495498a4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T22:31:39.930 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:39.905+0000 7f6012ffd640 1 --2- 172.21.15.19:0/2852392515 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56495498aa10 0x564954996460 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7f60040115c0 tx=0x7f6004011a80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b386c749dcf33ebb server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:31:39.930 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:39.905+0000 7f60097fa640 1 -- 172.21.15.19:0/2852392515 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f600400f640 con 0x56495498aa10 2024-09-10T22:31:39.930 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:39.905+0000 7f60097fa640 1 -- 172.21.15.19:0/2852392515 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f600400fc90 con 0x56495498aa10 2024-09-10T22:31:39.930 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:39.905+0000 7f60097fa640 1 -- 172.21.15.19:0/2852392515 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6004019c50 con 0x56495498aa10 2024-09-10T22:31:39.930 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:39.906+0000 7f6010ff9640 1 --2- 172.21.15.19:0/2925329135 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f60000b5360 0x7f60000b7820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:31:39.930 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:39.906+0000 7f600bfff640 1 --2- 172.21.15.19:0/2925329135 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f60000b5360 0x7f60000b7820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:31:39.930 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:39.906+0000 7f601b6f0740 1 -- 172.21.15.19:0/2852392515 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56495498aa10 msgr2=0x564954996460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:31:39.930 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:39.906+0000 7f6010ff9640 1 -- 172.21.15.19:0/2925329135 <== mon.1 v2:172.21.15.138:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8327+0+0 (secure 0 0 0) 0x7f600c106c60 con 0x7f6014108020 2024-09-10T22:31:39.931 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:39.906+0000 7f601b6f0740 1 --2- 172.21.15.19:0/2852392515 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56495498aa10 0x564954996460 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7f60040115c0 tx=0x7f6004011a80 comp rx=0 tx=0).stop 2024-09-10T22:31:39.931 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:39.906+0000 7f601b6f0740 1 -- 172.21.15.19:0/2852392515 shutdown_connections 2024-09-10T22:31:39.931 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:39.906+0000 7f601b6f0740 1 --2- 172.21.15.19:0/2852392515 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5649549969a0 0x564954998d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:31:39.931 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:39.906+0000 7f601b6f0740 1 --2- 172.21.15.19:0/2852392515 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56495498aa10 0x564954996460 unknown :-1 s=CLOSED pgs=627 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:31:39.931 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:39.906+0000 7f601b6f0740 1 --2- 172.21.15.19:0/2852392515 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56495498a0f0 0x56495498a4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:31:39.931 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:39.906+0000 7f601b6f0740 1 -- 172.21.15.19:0/2852392515 >> 172.21.15.19:0/2852392515 conn(0x564954987f20 msgr2=0x5649549890c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:31:39.931 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:39.907+0000 7f601b6f0740 1 -- 172.21.15.19:0/2852392515 shutdown_connections 2024-09-10T22:31:39.931 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:39.907+0000 7f601b6f0740 1 -- 172.21.15.19:0/2852392515 wait complete. 2024-09-10T22:31:39.931 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:39.907+0000 7f600bfff640 1 --2- 172.21.15.19:0/2925329135 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f60000b5360 0x7f60000b7820 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f5ffc005e00 tx=0x7f5ffc005d30 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:31:39.931 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:39.907+0000 7f601b6f0740 1 -- start start 2024-09-10T22:31:39.931 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:39.907+0000 7f601b6f0740 1 Processor -- start 2024-09-10T22:31:39.931 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:39.907+0000 7f601b6f0740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56495498a0f0 0x5649549962c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:31:39.931 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:39.908+0000 7f601b6f0740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56495498aa10 0x564954993710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:31:39.932 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:39.908+0000 7f601b6f0740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5649549969a0 0x564954993d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:31:39.932 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:39.908+0000 7f601b6f0740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x564954751700 con 0x56495498aa10 2024-09-10T22:31:39.932 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:39.908+0000 7f601b6f0740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x56495488b160 con 0x56495498a0f0 2024-09-10T22:31:39.932 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:39.908+0000 7f601b6f0740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x564954999620 con 0x5649549969a0 2024-09-10T22:31:39.932 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:39.908+0000 7f601b6f0740 10 client.0 _ll_register_callbacks cb 0x5649548a49e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T22:31:39.932 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:39.908+0000 7f600bfff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56495498aa10 0x564954993710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:31:39.932 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:39.908+0000 7f60137fe640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5649549969a0 0x564954993d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:31:39.932 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:39.908+0000 7f60137fe640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5649549969a0 0x564954993d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.19:42740/0 (socket says 172.21.15.19:42740) 2024-09-10T22:31:39.932 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:39.908+0000 7f60137fe640 1 -- 172.21.15.19:0/1695748052 learned_addr learned my addr 172.21.15.19:0/1695748052 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:31:39.932 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:39.908+0000 7f60137fe640 1 -- 172.21.15.19:0/1695748052 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56495498a0f0 msgr2=0x5649549962c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:31:39.932 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:39.908+0000 7f60137fe640 1 --2- 172.21.15.19:0/1695748052 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56495498a0f0 0x5649549962c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:31:39.932 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:39.908+0000 7f60137fe640 1 -- 172.21.15.19:0/1695748052 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56495498aa10 msgr2=0x564954993710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:31:39.933 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:39.908+0000 7f60137fe640 1 --2- 172.21.15.19:0/1695748052 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56495498aa10 0x564954993710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:31:39.933 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:39.908+0000 7f60137fe640 1 -- 172.21.15.19:0/1695748052 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5649548b8c90 con 0x5649549969a0 2024-09-10T22:31:39.933 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:39.908+0000 7f60137fe640 1 --2- 172.21.15.19:0/1695748052 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5649549969a0 0x564954993d40 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f600c0cd0c0 tx=0x7f600c0ccd10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c591e8e1c65c10d4 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:31:39.933 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:39.908+0000 7f5ffa7fc640 10 client.0 ms_handle_connect on v2:172.21.15.138:3300/0 2024-09-10T22:31:39.933 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:39.909+0000 7f5ffa7fc640 1 -- 172.21.15.19:0/1695748052 <== mon.1 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f600c0cd820 con 0x5649549969a0 2024-09-10T22:31:39.933 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:39.909+0000 7f5ffa7fc640 1 -- 172.21.15.19:0/1695748052 <== mon.1 v2:172.21.15.138:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8327+0+0 (secure 0 0 0) 0x7f600c0d64c0 con 0x5649549969a0 2024-09-10T22:31:39.933 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:39.909+0000 7f601b6f0740 1 -- 172.21.15.19:0/1695748052 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f600400fc90 con 0x5649549969a0 2024-09-10T22:31:39.933 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:39.909+0000 7f5ffa7fc640 1 -- 172.21.15.19:0/1695748052 <== mon.1 v2:172.21.15.138:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f600c0cced0 con 0x5649549969a0 2024-09-10T22:31:39.933 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:39.909+0000 7f601b6f0740 10 client.25840 fetch_fsmap learned FSMap version 27 2024-09-10T22:31:39.933 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:39.909+0000 7f601b6f0740 1 -- 172.21.15.19:0/1695748052 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x5649549a4f80 con 0x5649549969a0 2024-09-10T22:31:39.933 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:39.909+0000 7f5ffa7fc640 1 -- 172.21.15.19:0/1695748052 <== mon.1 v2:172.21.15.138:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f600c036070 con 0x5649549969a0 2024-09-10T22:31:39.933 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:39.909+0000 7f5ffa7fc640 1 -- 172.21.15.19:0/1695748052 <== mon.1 v2:172.21.15.138:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7f600c0b4040 con 0x5649549969a0 2024-09-10T22:31:39.933 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:39.909+0000 7f601b6f0740 10 client.25840 fetch_fsmap finished waiting for FSMap version 27 2024-09-10T22:31:39.934 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:39.909+0000 7f601b6f0740 10 client.25840 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-10T22:31:39.934 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:39.909+0000 7f601b6f0740 20 client.25840 populate_metadata read hostname 'smithi019' 2024-09-10T22:31:39.934 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:39.909+0000 7f601b6f0740 1 --2- 172.21.15.19:0/1695748052 >> [v2:172.21.15.138:6836/3353290042,v1:172.21.15.138:6837/3353290042] conn(0x5649549a6460 0x5649549a8920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:31:39.934 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:39.909+0000 7f601b6f0740 4 client.25840 mds_command: new command op to 24553 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T22:31:39.934 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:39.909+0000 7f601b6f0740 1 -- 172.21.15.19:0/1695748052 --> [v2:172.21.15.138:6836/3353290042,v1:172.21.15.138:6837/3353290042] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f600400fc90 con 0x5649549a6460 2024-09-10T22:31:39.934 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:39.910+0000 7f6012ffd640 1 --2- 172.21.15.19:0/1695748052 >> [v2:172.21.15.138:6836/3353290042,v1:172.21.15.138:6837/3353290042] conn(0x5649549a6460 0x5649549a8920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:31:39.934 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:39.911+0000 7f5ffa7fc640 10 client.25840 ms_handle_connect on v2:172.21.15.138:6836/3353290042 2024-09-10T22:31:39.934 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:39.911+0000 7f6012ffd640 1 --2- 172.21.15.19:0/1695748052 >> [v2:172.21.15.138:6836/3353290042,v1:172.21.15.138:6837/3353290042] conn(0x5649549a6460 0x5649549a8920 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=bb900bb26da286ae server_cookie=642057c2fe43d651 in_seq=0 out_seq=0 2024-09-10T22:31:39.934 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:39.912+0000 7f5ffa7fc640 1 -- 172.21.15.19:0/1695748052 <== mds.2 v2:172.21.15.138:6836/3353290042 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x7f600400fc90 con 0x5649549a6460 2024-09-10T22:31:39.934 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:39.912+0000 7f5ffa7fc640 10 client.25840 handle_command_reply: tid=0 2024-09-10T22:31:39.934 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:39.912+0000 7f601b6f0740 1 client.25840 shutdown 2024-09-10T22:31:39.934 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:39.912+0000 7f601b6f0740 1 -- 172.21.15.19:0/1695748052 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5649549969a0 msgr2=0x564954993d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:31:39.934 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:39.912+0000 7f601b6f0740 1 --2- 172.21.15.19:0/1695748052 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5649549969a0 0x564954993d40 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f600c0cd0c0 tx=0x7f600c0ccd10 comp rx=0 tx=0).stop 2024-09-10T22:31:39.934 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:39.912+0000 7f601b6f0740 1 -- 172.21.15.19:0/1695748052 shutdown_connections 2024-09-10T22:31:39.935 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:39.912+0000 7f601b6f0740 1 --2- 172.21.15.19:0/1695748052 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5649549969a0 0x564954993d40 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:31:39.935 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:39.912+0000 7f601b6f0740 1 --2- 172.21.15.19:0/1695748052 >> [v2:172.21.15.138:6836/3353290042,v1:172.21.15.138:6837/3353290042] conn(0x5649549a6460 0x5649549a8920 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:31:39.935 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:39.912+0000 7f601b6f0740 1 --2- 172.21.15.19:0/1695748052 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56495498aa10 0x564954993710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:31:39.935 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:39.912+0000 7f5ffa7fc640 0 client.25840 ms_handle_reset on v2:172.21.15.138:6836/3353290042 2024-09-10T22:31:39.935 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:39.912+0000 7f601b6f0740 1 --2- 172.21.15.19:0/1695748052 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56495498a0f0 0x5649549962c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:31:39.935 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:39.912+0000 7f601b6f0740 1 -- 172.21.15.19:0/1695748052 >> 172.21.15.19:0/1695748052 conn(0x564954987f20 msgr2=0x56495498dac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:31:39.935 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:39.912+0000 7f601b6f0740 1 -- 172.21.15.19:0/1695748052 shutdown_connections 2024-09-10T22:31:39.935 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:39.913+0000 7f601b6f0740 1 -- 172.21.15.19:0/1695748052 wait complete. 2024-09-10T22:31:39.935 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:39.913+0000 7f601b6f0740 20 client.25840 trim_cache size 0 max 16384 2024-09-10T22:31:39.940 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:39.927+0000 7f601b6f0740 1 Processor -- start 2024-09-10T22:31:39.940 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:39.928+0000 7f601b6f0740 1 -- start start 2024-09-10T22:31:39.940 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:39.928+0000 7f601b6f0740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56495498a0f0 0x5649549a2850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:31:39.940 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:39.928+0000 7f601b6f0740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56495498aa10 0x564954997d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:31:39.940 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:39.928+0000 7f601b6f0740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5649549969a0 0x5649549982d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:31:39.940 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:39.928+0000 7f601b6f0740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f60141b3060 con 0x56495498a0f0 2024-09-10T22:31:39.940 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:39.928+0000 7f601b6f0740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f60141b0930 con 0x56495498aa10 2024-09-10T22:31:39.940 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:39.928+0000 7f601b6f0740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f60141ae780 con 0x5649549969a0 2024-09-10T22:31:39.940 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:39.928+0000 7f60137fe640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5649549969a0 0x5649549982d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:31:39.940 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:39.928+0000 7f6012ffd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56495498a0f0 0x5649549a2850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:31:39.941 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:39.928+0000 7f600bfff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56495498aa10 0x564954997d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:31:39.941 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:39.928+0000 7f600bfff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56495498aa10 0x564954997d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.19:46362/0 (socket says 172.21.15.19:46362) 2024-09-10T22:31:39.941 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:39.928+0000 7f600bfff640 1 -- 172.21.15.19:0/1844645781 learned_addr learned my addr 172.21.15.19:0/1844645781 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:31:39.941 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:39.928+0000 7f60137fe640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5649549969a0 0x5649549982d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.19:42742/0 (socket says 172.21.15.19:42742) 2024-09-10T22:31:39.941 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:39.929+0000 7f60137fe640 1 -- 172.21.15.19:0/1844645781 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56495498aa10 msgr2=0x564954997d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:31:39.941 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:39.929+0000 7f60137fe640 1 --2- 172.21.15.19:0/1844645781 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56495498aa10 0x564954997d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:31:39.941 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:39.929+0000 7f60137fe640 1 -- 172.21.15.19:0/1844645781 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56495498a0f0 msgr2=0x5649549a2850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:31:39.941 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:39.929+0000 7f60137fe640 1 --2- 172.21.15.19:0/1844645781 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56495498a0f0 0x5649549a2850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:31:39.941 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:39.929+0000 7f60137fe640 1 -- 172.21.15.19:0/1844645781 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56495498a840 con 0x5649549969a0 2024-09-10T22:31:39.941 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:39.929+0000 7f6012ffd640 1 --2- 172.21.15.19:0/1844645781 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56495498a0f0 0x5649549a2850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T22:31:39.941 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:39.929+0000 7f60137fe640 1 --2- 172.21.15.19:0/1844645781 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5649549969a0 0x5649549982d0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f600c0cd070 tx=0x7f600c02a8c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=65b7771a48fe37b server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:31:39.942 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:39.929+0000 7f6008ff9640 1 -- 172.21.15.19:0/1844645781 <== mon.1 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f600c0d6950 con 0x5649549969a0 2024-09-10T22:31:39.942 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:39.929+0000 7f6008ff9640 1 -- 172.21.15.19:0/1844645781 <== mon.1 v2:172.21.15.138:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f600c036070 con 0x5649549969a0 2024-09-10T22:31:39.942 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:39.929+0000 7f6008ff9640 1 -- 172.21.15.19:0/1844645781 <== mon.1 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f600c0cd880 con 0x5649549969a0 2024-09-10T22:31:39.942 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:39.930+0000 7f601b6f0740 1 -- 172.21.15.19:0/1844645781 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5649549969a0 msgr2=0x5649549982d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:31:39.942 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:39.930+0000 7f601b6f0740 1 --2- 172.21.15.19:0/1844645781 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5649549969a0 0x5649549982d0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f600c0cd070 tx=0x7f600c02a8c0 comp rx=0 tx=0).stop 2024-09-10T22:31:39.942 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:39.930+0000 7f601b6f0740 1 -- 172.21.15.19:0/1844645781 shutdown_connections 2024-09-10T22:31:39.942 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:39.930+0000 7f601b6f0740 1 --2- 172.21.15.19:0/1844645781 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5649549969a0 0x5649549982d0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:31:39.942 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:39.930+0000 7f601b6f0740 1 --2- 172.21.15.19:0/1844645781 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56495498aa10 0x564954997d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:31:39.942 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:39.930+0000 7f601b6f0740 1 --2- 172.21.15.19:0/1844645781 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56495498a0f0 0x5649549a2850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:31:39.942 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:39.930+0000 7f601b6f0740 1 -- 172.21.15.19:0/1844645781 >> 172.21.15.19:0/1844645781 conn(0x564954987f20 msgr2=0x56495498e970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:31:39.942 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:39.930+0000 7f601b6f0740 1 -- 172.21.15.19:0/1844645781 shutdown_connections 2024-09-10T22:31:39.942 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:39.930+0000 7f601b6f0740 1 -- 172.21.15.19:0/1844645781 wait complete. 2024-09-10T22:31:39.942 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:39.931+0000 7f601b6f0740 1 -- start start 2024-09-10T22:31:39.943 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:39.931+0000 7f601b6f0740 1 Processor -- start 2024-09-10T22:31:39.943 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:39.931+0000 7f601b6f0740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56495498a0f0 0x56495499e8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:31:39.943 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:39.931+0000 7f601b6f0740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56495498aa10 0x56495499ee00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:31:39.943 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:39.931+0000 7f601b6f0740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5649549969a0 0x564954999870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:31:39.943 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:39.931+0000 7f601b6f0740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f60141aedf0 con 0x56495498aa10 2024-09-10T22:31:39.943 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:39.931+0000 7f601b6f0740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f60141b0260 con 0x56495498a0f0 2024-09-10T22:31:39.943 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:39.931+0000 7f601b6f0740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f60141af4c0 con 0x5649549969a0 2024-09-10T22:31:39.943 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:39.931+0000 7f601b6f0740 10 client.0 _ll_register_callbacks cb 0x7f600c003ec0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T22:31:39.943 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:39.931+0000 7f6012ffd640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56495498a0f0 0x56495499e8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:31:39.943 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:39.931+0000 7f60137fe640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5649549969a0 0x564954999870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:31:39.943 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:39.931+0000 7f6012ffd640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56495498a0f0 0x56495499e8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.19:46376/0 (socket says 172.21.15.19:46376) 2024-09-10T22:31:39.943 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:39.931+0000 7f6012ffd640 1 -- 172.21.15.19:0/856795408 learned_addr learned my addr 172.21.15.19:0/856795408 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:31:39.944 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:39.931+0000 7f600bfff640 1 --2- 172.21.15.19:0/856795408 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56495498aa10 0x56495499ee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:31:39.944 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:39.932+0000 7f6012ffd640 1 -- 172.21.15.19:0/856795408 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5649549969a0 msgr2=0x564954999870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:31:39.944 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:39.932+0000 7f6012ffd640 1 --2- 172.21.15.19:0/856795408 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5649549969a0 0x564954999870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:31:39.944 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:39.932+0000 7f6012ffd640 1 -- 172.21.15.19:0/856795408 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56495498aa10 msgr2=0x56495499ee00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:31:39.944 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:39.932+0000 7f6012ffd640 1 --2- 172.21.15.19:0/856795408 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56495498aa10 0x56495499ee00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:31:39.944 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:39.932+0000 7f6012ffd640 1 -- 172.21.15.19:0/856795408 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56495499f540 con 0x56495498a0f0 2024-09-10T22:31:39.944 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:39.932+0000 7f6012ffd640 1 --2- 172.21.15.19:0/856795408 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56495498a0f0 0x56495499e8c0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f600401b040 tx=0x7f6004009ca0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=57db1d78856c8f0c server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:31:39.944 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:39.932+0000 7f5ffa7fc640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-09-10T22:31:39.945 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:39.932+0000 7f5ffa7fc640 1 -- 172.21.15.19:0/856795408 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6004009d10 con 0x56495498a0f0 2024-09-10T22:31:39.945 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:39.932+0000 7f601b6f0740 1 -- 172.21.15.19:0/856795408 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f600c036070 con 0x56495498a0f0 2024-09-10T22:31:39.945 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:39.932+0000 7f5ffa7fc640 1 -- 172.21.15.19:0/856795408 <== mon.2 v2:172.21.15.135:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8327+0+0 (secure 0 0 0) 0x7f6004016040 con 0x56495498a0f0 2024-09-10T22:31:39.945 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:39.933+0000 7f5ffa7fc640 1 -- 172.21.15.19:0/856795408 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f6004019620 con 0x56495498a0f0 2024-09-10T22:31:39.945 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:39.933+0000 7f601b6f0740 10 client.25823 fetch_fsmap learned FSMap version 27 2024-09-10T22:31:39.945 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:39.933+0000 7f601b6f0740 1 -- 172.21.15.19:0/856795408 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x564954a139b0 con 0x56495498a0f0 2024-09-10T22:31:39.945 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:39.933+0000 7f5ffa7fc640 1 -- 172.21.15.19:0/856795408 <== mon.2 v2:172.21.15.135:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f600c036070 con 0x56495498a0f0 2024-09-10T22:31:39.945 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:39.934+0000 7f5ffa7fc640 1 -- 172.21.15.19:0/856795408 <== mon.2 v2:172.21.15.135:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7f6004005360 con 0x56495498a0f0 2024-09-10T22:31:39.945 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:39.934+0000 7f601b6f0740 10 client.25823 fetch_fsmap finished waiting for FSMap version 27 2024-09-10T22:31:39.945 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:39.934+0000 7f601b6f0740 10 client.25823 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-10T22:31:39.945 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:39.934+0000 7f601b6f0740 20 client.25823 populate_metadata read hostname 'smithi019' 2024-09-10T22:31:39.945 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:39.934+0000 7f601b6f0740 1 --2- 172.21.15.19:0/856795408 >> [v2:172.21.15.138:6836/3353290042,v1:172.21.15.138:6837/3353290042] conn(0x564954a13ff0 0x564954a16410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:31:39.945 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:39.934+0000 7f601b6f0740 4 client.25823 mds_command: new command op to 24553 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-10T22:31:39.946 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:39.934+0000 7f601b6f0740 1 -- 172.21.15.19:0/856795408 --> [v2:172.21.15.138:6836/3353290042,v1:172.21.15.138:6837/3353290042] -- command(tid 0: {"prefix": "damage ls"}) -- 0x564954902df0 con 0x564954a13ff0 2024-09-10T22:31:39.946 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:39.934+0000 7f600bfff640 1 --2- 172.21.15.19:0/856795408 >> [v2:172.21.15.138:6836/3353290042,v1:172.21.15.138:6837/3353290042] conn(0x564954a13ff0 0x564954a16410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:31:39.946 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:39.935+0000 7f600bfff640 1 --2- 172.21.15.19:0/856795408 >> [v2:172.21.15.138:6836/3353290042,v1:172.21.15.138:6837/3353290042] conn(0x564954a13ff0 0x564954a16410 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=a7cc0341e6a67063 server_cookie=b43987ab8910c021 in_seq=0 out_seq=0 2024-09-10T22:31:39.946 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:39.935+0000 7f5ffa7fc640 10 client.25823 ms_handle_connect on v2:172.21.15.138:6836/3353290042 2024-09-10T22:31:39.946 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:39.935+0000 7f5ffa7fc640 1 -- 172.21.15.19:0/856795408 <== mds.2 v2:172.21.15.138:6836/3353290042 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x564954902df0 con 0x564954a13ff0 2024-09-10T22:31:39.946 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:39.935+0000 7f5ffa7fc640 10 client.25823 handle_command_reply: tid=0 2024-09-10T22:31:39.946 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:39.935+0000 7f601b6f0740 1 client.25823 shutdown 2024-09-10T22:31:39.946 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:39.935+0000 7f601b6f0740 1 -- 172.21.15.19:0/856795408 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56495498a0f0 msgr2=0x56495499e8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:31:39.946 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:39.935+0000 7f601b6f0740 1 --2- 172.21.15.19:0/856795408 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56495498a0f0 0x56495499e8c0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f600401b040 tx=0x7f6004009ca0 comp rx=0 tx=0).stop 2024-09-10T22:31:39.946 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:39.935+0000 7f601b6f0740 1 -- 172.21.15.19:0/856795408 shutdown_connections 2024-09-10T22:31:39.946 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:39.935+0000 7f601b6f0740 1 --2- 172.21.15.19:0/856795408 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5649549969a0 0x564954999870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:31:39.946 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:39.935+0000 7f601b6f0740 1 --2- 172.21.15.19:0/856795408 >> [v2:172.21.15.138:6836/3353290042,v1:172.21.15.138:6837/3353290042] conn(0x564954a13ff0 0x564954a16410 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:31:39.947 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:39.935+0000 7f601b6f0740 1 --2- 172.21.15.19:0/856795408 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56495498aa10 0x56495499ee00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:31:39.947 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:39.935+0000 7f601b6f0740 1 --2- 172.21.15.19:0/856795408 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56495498a0f0 0x56495499e8c0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:31:39.947 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:39.935+0000 7f601b6f0740 1 -- 172.21.15.19:0/856795408 >> 172.21.15.19:0/856795408 conn(0x564954987f20 msgr2=0x564954986750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:31:39.947 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:39.935+0000 7f5ffa7fc640 0 client.25823 ms_handle_reset on v2:172.21.15.138:6836/3353290042 2024-09-10T22:31:39.947 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:39.935+0000 7f601b6f0740 1 -- 172.21.15.19:0/856795408 shutdown_connections 2024-09-10T22:31:39.947 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:39.935+0000 7f601b6f0740 1 -- 172.21.15.19:0/856795408 wait complete. 2024-09-10T22:31:39.947 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:39.936+0000 7f601b6f0740 20 client.25823 trim_cache size 0 max 16384 2024-09-10T22:31:39.947 INFO:teuthology.orchestra.run.smithi019.stdout:[] 2024-09-10T22:31:39.948 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:39.936+0000 7f601931b640 1 -- 172.21.15.19:0/2925329135 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f60000b5360 msgr2=0x7f60000b7820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:31:39.948 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:39.936+0000 7f601931b640 1 --2- 172.21.15.19:0/2925329135 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f60000b5360 0x7f60000b7820 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f5ffc005e00 tx=0x7f5ffc005d30 comp rx=0 tx=0).stop 2024-09-10T22:31:39.948 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:39.936+0000 7f601931b640 1 -- 172.21.15.19:0/2925329135 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f6014108020 msgr2=0x7f601419eba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:31:39.948 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:39.936+0000 7f601931b640 1 --2- 172.21.15.19:0/2925329135 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f6014108020 0x7f601419eba0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f600c02ade0 tx=0x7f600c0316f0 comp rx=0 tx=0).stop 2024-09-10T22:31:39.948 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:39.937+0000 7f601931b640 1 -- 172.21.15.19:0/2925329135 shutdown_connections 2024-09-10T22:31:39.948 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:39.937+0000 7f601931b640 1 --2- 172.21.15.19:0/2925329135 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f60000b5360 0x7f60000b7820 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:31:39.949 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:39.937+0000 7f601931b640 1 --2- 172.21.15.19:0/2925329135 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f6014108020 0x7f601419eba0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:31:39.949 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:39.937+0000 7f601931b640 1 --2- 172.21.15.19:0/2925329135 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f60141076a0 0x7f6014199800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:31:39.949 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:39.937+0000 7f601931b640 1 --2- 172.21.15.19:0/2925329135 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6014101c90 0x7f60141992c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:31:39.949 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:39.937+0000 7f601931b640 1 -- 172.21.15.19:0/2925329135 >> 172.21.15.19:0/2925329135 conn(0x7f60140fd700 msgr2=0x7f601406ad30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:31:39.949 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:39.937+0000 7f601931b640 1 -- 172.21.15.19:0/2925329135 shutdown_connections 2024-09-10T22:31:39.949 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:39.937+0000 7f601931b640 1 -- 172.21.15.19:0/2925329135 wait complete. 2024-09-10T22:31:40.111 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:31:39 smithi135 ceph-mon[34789]: pgmap v504: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 753 KiB/s rd, 322 MiB/s wr, 215 op/s 2024-09-10T22:31:40.126 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:31:39 smithi138 ceph-mon[35236]: pgmap v504: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 753 KiB/s rd, 322 MiB/s wr, 215 op/s 2024-09-10T22:31:40.208 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:31:39 smithi019 ceph-mon[31375]: pgmap v504: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 753 KiB/s rd, 322 MiB/s wr, 215 op/s 2024-09-10T22:31:40.764 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 22997a4c-6fc2-11ef-bcea-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-09-10T22:31:41.022 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:31:40 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T22:31:41.110 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:31:40 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T22:31:41.125 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:31:40 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T22:31:41.216 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/22997a4c-6fc2-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T22:31:41.991 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:31:41 smithi019 ceph-mon[31375]: pgmap v505: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 987 KiB/s rd, 368 MiB/s wr, 273 op/s 2024-09-10T22:31:41.991 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:31:41 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T22:31:41.991 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:31:41 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T22:31:41.992 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:31:41 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:31:42.109 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:31:41 smithi135 ceph-mon[34789]: pgmap v505: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 987 KiB/s rd, 368 MiB/s wr, 273 op/s 2024-09-10T22:31:42.110 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:31:41 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T22:31:42.110 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:31:41 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T22:31:42.110 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:31:41 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:31:42.125 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:31:41 smithi138 ceph-mon[35236]: pgmap v505: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 987 KiB/s rd, 368 MiB/s wr, 273 op/s 2024-09-10T22:31:42.125 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:31:41 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T22:31:42.125 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:31:41 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T22:31:42.125 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:31:41 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:31:42.168 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:42.082+0000 7f7e7bf6c640 1 -- 172.21.15.19:0/2561743696 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7e74102150 msgr2=0x7f7e7410eea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:31:42.168 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:42.082+0000 7f7e7bf6c640 1 --2- 172.21.15.19:0/2561743696 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7e74102150 0x7f7e7410eea0 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7f7e68009900 tx=0x7f7e6802a480 comp rx=0 tx=0).stop 2024-09-10T22:31:42.169 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:42.082+0000 7f7e7bf6c640 1 -- 172.21.15.19:0/2561743696 shutdown_connections 2024-09-10T22:31:42.169 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:42.082+0000 7f7e7bf6c640 1 --2- 172.21.15.19:0/2561743696 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7e7410f3e0 0x7f7e741117d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:31:42.169 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:42.082+0000 7f7e7bf6c640 1 --2- 172.21.15.19:0/2561743696 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7e74102150 0x7f7e7410eea0 unknown :-1 s=CLOSED pgs=628 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:31:42.169 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:42.082+0000 7f7e7bf6c640 1 --2- 172.21.15.19:0/2561743696 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7e74101830 0x7f7e74101c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:31:42.169 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:42.082+0000 7f7e7bf6c640 1 -- 172.21.15.19:0/2561743696 >> 172.21.15.19:0/2561743696 conn(0x7f7e740fd700 msgr2=0x7f7e740ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:31:42.169 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:42.082+0000 7f7e7bf6c640 1 -- 172.21.15.19:0/2561743696 shutdown_connections 2024-09-10T22:31:42.169 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:42.082+0000 7f7e7bf6c640 1 -- 172.21.15.19:0/2561743696 wait complete. 2024-09-10T22:31:42.169 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:42.082+0000 7f7e7bf6c640 1 Processor -- start 2024-09-10T22:31:42.169 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:42.083+0000 7f7e7bf6c640 1 -- start start 2024-09-10T22:31:42.169 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:42.083+0000 7f7e7bf6c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7e74101830 0x7f7e7419b4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:31:42.170 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:42.083+0000 7f7e7bf6c640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7e74102150 0x7f7e7419b9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:31:42.170 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:42.083+0000 7f7e7bf6c640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7e7410f3e0 0x7f7e741a0d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:31:42.170 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:42.083+0000 7f7e7bf6c640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f7e74114f20 con 0x7f7e74101830 2024-09-10T22:31:42.170 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:42.083+0000 7f7e7bf6c640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f7e74114da0 con 0x7f7e74102150 2024-09-10T22:31:42.170 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:42.083+0000 7f7e7bf6c640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f7e741150a0 con 0x7f7e7410f3e0 2024-09-10T22:31:42.170 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:42.083+0000 7f7e79d08640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7e74101830 0x7f7e7419b4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:31:42.170 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:42.083+0000 7f7e79507640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7e74102150 0x7f7e7419b9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:31:42.170 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:42.083+0000 7f7e79507640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7e74102150 0x7f7e7419b9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.19:46394/0 (socket says 172.21.15.19:46394) 2024-09-10T22:31:42.170 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:42.083+0000 7f7e79d08640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7e74101830 0x7f7e7419b4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:53742/0 (socket says 172.21.15.19:53742) 2024-09-10T22:31:42.170 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:42.083+0000 7f7e79507640 1 -- 172.21.15.19:0/565954983 learned_addr learned my addr 172.21.15.19:0/565954983 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:31:42.170 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:42.083+0000 7f7e7a509640 1 --2- 172.21.15.19:0/565954983 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7e7410f3e0 0x7f7e741a0d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:31:42.170 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:42.083+0000 7f7e79507640 1 -- 172.21.15.19:0/565954983 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7e7410f3e0 msgr2=0x7f7e741a0d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:31:42.170 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:42.083+0000 7f7e79507640 1 --2- 172.21.15.19:0/565954983 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7e7410f3e0 0x7f7e741a0d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:31:42.171 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:42.083+0000 7f7e79507640 1 -- 172.21.15.19:0/565954983 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7e74101830 msgr2=0x7f7e7419b4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:31:42.171 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:42.083+0000 7f7e79507640 1 --2- 172.21.15.19:0/565954983 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7e74101830 0x7f7e7419b4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:31:42.171 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:42.083+0000 7f7e79507640 1 -- 172.21.15.19:0/565954983 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7e741a1560 con 0x7f7e74102150 2024-09-10T22:31:42.171 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:42.084+0000 7f7e79507640 1 --2- 172.21.15.19:0/565954983 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7e74102150 0x7f7e7419b9f0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f7e68005940 tx=0x7f7e68004270 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:31:42.171 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:42.084+0000 7f7e72ffd640 1 -- 172.21.15.19:0/565954983 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e6803f030 con 0x7f7e74102150 2024-09-10T22:31:42.171 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:42.084+0000 7f7e7bf6c640 1 -- 172.21.15.19:0/565954983 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7e741a17f0 con 0x7f7e74102150 2024-09-10T22:31:42.171 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:42.084+0000 7f7e72ffd640 1 -- 172.21.15.19:0/565954983 <== mon.2 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7e68003aa0 con 0x7f7e74102150 2024-09-10T22:31:42.171 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:42.084+0000 7f7e72ffd640 1 -- 172.21.15.19:0/565954983 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e68035070 con 0x7f7e74102150 2024-09-10T22:31:42.171 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:42.084+0000 7f7e7bf6c640 1 -- 172.21.15.19:0/565954983 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7e741a7f10 con 0x7f7e74102150 2024-09-10T22:31:42.171 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:42.087+0000 7f7e7e341740 1 Processor -- start 2024-09-10T22:31:42.171 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:42.087+0000 7f7e7e341740 1 -- start start 2024-09-10T22:31:42.171 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:42.087+0000 7f7e7e341740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55937faa14d0 0x55937faa18b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:31:42.172 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:42.087+0000 7f7e72ffd640 1 -- 172.21.15.19:0/565954983 <== mon.2 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 18) ==== 153250+0+0 (secure 0 0 0) 0x7f7e6803bcc0 con 0x7f7e74102150 2024-09-10T22:31:42.172 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:42.087+0000 7f7e7e341740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55937faa1df0 0x55937faad840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:31:42.172 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:42.087+0000 7f7e7e341740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55937faadd80 0x55937fab0170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:31:42.172 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:42.087+0000 7f7e7e341740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x55937fa17ea0 con 0x55937faadd80 2024-09-10T22:31:42.172 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:42.087+0000 7f7e7e341740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55937fa072d0 con 0x55937faa14d0 2024-09-10T22:31:42.172 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:42.087+0000 7f7e7e341740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x55937fa0b0e0 con 0x55937faa1df0 2024-09-10T22:31:42.172 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:42.088+0000 7f7e79507640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55937faadd80 0x55937fab0170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:31:42.172 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:42.088+0000 7f7e79d08640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55937faa1df0 0x55937faad840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:31:42.172 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:42.088+0000 7f7e79d08640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55937faa1df0 0x55937faad840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.19:42768/0 (socket says 172.21.15.19:42768) 2024-09-10T22:31:42.172 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:42.088+0000 7f7e79d08640 1 -- 172.21.15.19:0/444933939 learned_addr learned my addr 172.21.15.19:0/444933939 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:31:42.173 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:42.088+0000 7f7e7a509640 1 --2- 172.21.15.19:0/444933939 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55937faa14d0 0x55937faa18b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:31:42.173 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:42.088+0000 7f7e79d08640 1 -- 172.21.15.19:0/444933939 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55937faa14d0 msgr2=0x55937faa18b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:31:42.173 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:42.088+0000 7f7e79d08640 1 --2- 172.21.15.19:0/444933939 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55937faa14d0 0x55937faa18b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:31:42.173 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:42.088+0000 7f7e79d08640 1 -- 172.21.15.19:0/444933939 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55937faadd80 msgr2=0x55937fab0170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:31:42.173 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:42.088+0000 7f7e79d08640 1 --2- 172.21.15.19:0/444933939 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55937faadd80 0x55937fab0170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:31:42.173 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:42.088+0000 7f7e79d08640 1 -- 172.21.15.19:0/444933939 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55937f765650 con 0x55937faa1df0 2024-09-10T22:31:42.173 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:42.088+0000 7f7e79d08640 1 --2- 172.21.15.19:0/444933939 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55937faa1df0 0x55937faad840 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f7e640039f0 tx=0x7f7e64003eb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9bd4522fb170bd43 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:31:42.173 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:42.088+0000 7f7e72ffd640 1 --2- 172.21.15.19:0/565954983 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f7e5c0b52e0 0x7f7e5c0b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:31:42.173 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:42.088+0000 7f7e5bfff640 1 -- 172.21.15.19:0/444933939 <== mon.1 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e64004b20 con 0x55937faa1df0 2024-09-10T22:31:42.173 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:42.088+0000 7f7e5bfff640 1 -- 172.21.15.19:0/444933939 <== mon.1 v2:172.21.15.138:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7e64004cc0 con 0x55937faa1df0 2024-09-10T22:31:42.174 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:42.088+0000 7f7e5bfff640 1 -- 172.21.15.19:0/444933939 <== mon.1 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e64012650 con 0x55937faa1df0 2024-09-10T22:31:42.174 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:42.088+0000 7f7e7a509640 1 --2- 172.21.15.19:0/565954983 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f7e5c0b52e0 0x7f7e5c0b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:31:42.174 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:42.089+0000 7f7e72ffd640 1 -- 172.21.15.19:0/565954983 <== mon.2 v2:172.21.15.135:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8327+0+0 (secure 0 0 0) 0x7f7e68106580 con 0x7f7e74102150 2024-09-10T22:31:42.174 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:42.089+0000 7f7e7e341740 1 -- 172.21.15.19:0/444933939 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55937faa1df0 msgr2=0x55937faad840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:31:42.174 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:42.089+0000 7f7e7a509640 1 --2- 172.21.15.19:0/565954983 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f7e5c0b52e0 0x7f7e5c0b77a0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f7e6c009da0 tx=0x7f7e6c005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:31:42.174 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:42.089+0000 7f7e7e341740 1 --2- 172.21.15.19:0/444933939 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55937faa1df0 0x55937faad840 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f7e640039f0 tx=0x7f7e64003eb0 comp rx=0 tx=0).stop 2024-09-10T22:31:42.174 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:42.089+0000 7f7e7e341740 1 -- 172.21.15.19:0/444933939 shutdown_connections 2024-09-10T22:31:42.174 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:42.089+0000 7f7e7e341740 1 --2- 172.21.15.19:0/444933939 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55937faadd80 0x55937fab0170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:31:42.174 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:42.089+0000 7f7e7e341740 1 --2- 172.21.15.19:0/444933939 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55937faa1df0 0x55937faad840 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:31:42.174 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:42.089+0000 7f7e7e341740 1 --2- 172.21.15.19:0/444933939 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55937faa14d0 0x55937faa18b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:31:42.174 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:42.089+0000 7f7e7e341740 1 -- 172.21.15.19:0/444933939 >> 172.21.15.19:0/444933939 conn(0x55937fa9f300 msgr2=0x55937faa04a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:31:42.174 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:42.089+0000 7f7e7e341740 1 -- 172.21.15.19:0/444933939 shutdown_connections 2024-09-10T22:31:42.174 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:42.089+0000 7f7e7e341740 1 -- 172.21.15.19:0/444933939 wait complete. 2024-09-10T22:31:42.175 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:42.089+0000 7f7e7e341740 1 -- start start 2024-09-10T22:31:42.175 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:42.090+0000 7f7e7e341740 1 Processor -- start 2024-09-10T22:31:42.175 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:42.090+0000 7f7e7e341740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55937faa14d0 0x55937faad610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:31:42.175 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:42.090+0000 7f7e7e341740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55937faa1df0 0x55937faaaa60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:31:42.175 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:42.090+0000 7f7e7e341740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55937faadd80 0x55937faab000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:31:42.175 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:42.090+0000 7f7e7e341740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x55937f868700 con 0x55937faa1df0 2024-09-10T22:31:42.175 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:42.090+0000 7f7e7e341740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55937f9a2160 con 0x55937faadd80 2024-09-10T22:31:42.175 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:42.090+0000 7f7e7e341740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x55937fab0a00 con 0x55937faa14d0 2024-09-10T22:31:42.175 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:42.090+0000 7f7e7e341740 10 client.0 _ll_register_callbacks cb 0x55937f9bb9e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T22:31:42.175 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:42.090+0000 7f7e79507640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55937faa1df0 0x55937faaaa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:31:42.175 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:42.090+0000 7f7e79507640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55937faa1df0 0x55937faaaa60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:53756/0 (socket says 172.21.15.19:53756) 2024-09-10T22:31:42.175 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:42.090+0000 7f7e79507640 1 -- 172.21.15.19:0/4250251065 learned_addr learned my addr 172.21.15.19:0/4250251065 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:31:42.175 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:42.090+0000 7f7e7a509640 1 --2- 172.21.15.19:0/4250251065 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55937faadd80 0x55937faab000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:31:42.176 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:42.090+0000 7f7e79d08640 1 --2- 172.21.15.19:0/4250251065 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55937faa14d0 0x55937faad610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:31:42.176 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:42.091+0000 7f7e79507640 1 -- 172.21.15.19:0/4250251065 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55937faa14d0 msgr2=0x55937faad610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:31:42.176 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:42.091+0000 7f7e79507640 1 --2- 172.21.15.19:0/4250251065 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55937faa14d0 0x55937faad610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:31:42.176 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:42.091+0000 7f7e79507640 1 -- 172.21.15.19:0/4250251065 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55937faadd80 msgr2=0x55937faab000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:31:42.176 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:42.091+0000 7f7e79507640 1 --2- 172.21.15.19:0/4250251065 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55937faadd80 0x55937faab000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:31:42.176 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:42.091+0000 7f7e79507640 1 -- 172.21.15.19:0/4250251065 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55937f9cfc90 con 0x55937faa1df0 2024-09-10T22:31:42.176 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:42.091+0000 7f7e7a509640 1 --2- 172.21.15.19:0/4250251065 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55937faadd80 0x55937faab000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T22:31:42.176 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:42.091+0000 7f7e79507640 1 --2- 172.21.15.19:0/4250251065 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55937faa1df0 0x55937faaaa60 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7f7e68031440 tx=0x7f7e680092f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=681550aafe728570 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:31:42.176 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:42.091+0000 7f7e597fa640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-10T22:31:42.176 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:42.091+0000 7f7e597fa640 1 -- 172.21.15.19:0/4250251065 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e68049070 con 0x55937faa1df0 2024-09-10T22:31:42.176 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:42.091+0000 7f7e597fa640 1 -- 172.21.15.19:0/4250251065 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8327+0+0 (secure 0 0 0) 0x7f7e680c9000 con 0x55937faa1df0 2024-09-10T22:31:42.177 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:42.091+0000 7f7e7e341740 1 -- 172.21.15.19:0/4250251065 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7e64004cc0 con 0x55937faa1df0 2024-09-10T22:31:42.177 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:42.091+0000 7f7e597fa640 1 -- 172.21.15.19:0/4250251065 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f7e680c8c30 con 0x55937faa1df0 2024-09-10T22:31:42.177 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:42.091+0000 7f7e7e341740 10 client.16404 fetch_fsmap learned FSMap version 27 2024-09-10T22:31:42.177 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:42.091+0000 7f7e7e341740 1 -- 172.21.15.19:0/4250251065 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55937fabc2d0 con 0x55937faa1df0 2024-09-10T22:31:42.177 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:42.091+0000 7f7e597fa640 1 -- 172.21.15.19:0/4250251065 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7e64004cc0 con 0x55937faa1df0 2024-09-10T22:31:42.177 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:42.092+0000 7f7e597fa640 1 -- 172.21.15.19:0/4250251065 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7f7e680d5de0 con 0x55937faa1df0 2024-09-10T22:31:42.177 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:42.092+0000 7f7e7e341740 10 client.16404 fetch_fsmap finished waiting for FSMap version 27 2024-09-10T22:31:42.177 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:42.092+0000 7f7e7e341740 10 client.16404 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-10T22:31:42.177 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:42.092+0000 7f7e7e341740 20 client.16404 populate_metadata read hostname 'smithi019' 2024-09-10T22:31:42.177 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:42.092+0000 7f7e7e341740 1 --2- 172.21.15.19:0/4250251065 >> [v2:172.21.15.138:6838/383637208,v1:172.21.15.138:6839/383637208] conn(0x55937fabd730 0x55937fabfb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:31:42.177 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:42.092+0000 7f7e7e341740 4 client.16404 mds_command: new command op to 24568 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T22:31:42.177 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:42.092+0000 7f7e7e341740 1 -- 172.21.15.19:0/4250251065 --> [v2:172.21.15.138:6838/383637208,v1:172.21.15.138:6839/383637208] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55937fa19df0 con 0x55937fabd730 2024-09-10T22:31:42.178 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:42.092+0000 7f7e79d08640 1 --2- 172.21.15.19:0/4250251065 >> [v2:172.21.15.138:6838/383637208,v1:172.21.15.138:6839/383637208] conn(0x55937fabd730 0x55937fabfb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:31:42.178 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:42.092+0000 7f7e597fa640 10 client.16404 ms_handle_connect on v2:172.21.15.138:6838/383637208 2024-09-10T22:31:42.178 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:42.092+0000 7f7e79d08640 1 --2- 172.21.15.19:0/4250251065 >> [v2:172.21.15.138:6838/383637208,v1:172.21.15.138:6839/383637208] conn(0x55937fabd730 0x55937fabfb70 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=46c3a1479015845a server_cookie=7ae123d4ba6c20dc in_seq=0 out_seq=0 2024-09-10T22:31:42.178 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:42.093+0000 7f7e597fa640 1 -- 172.21.15.19:0/4250251065 <== mds.1 v2:172.21.15.138:6838/383637208 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55937fa19df0 con 0x55937fabd730 2024-09-10T22:31:42.178 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:42.093+0000 7f7e597fa640 10 client.16404 handle_command_reply: tid=0 2024-09-10T22:31:42.178 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:42.093+0000 7f7e7e341740 1 client.16404 shutdown 2024-09-10T22:31:42.178 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:42.093+0000 7f7e7e341740 1 -- 172.21.15.19:0/4250251065 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55937faa1df0 msgr2=0x55937faaaa60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:31:42.178 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:42.093+0000 7f7e7e341740 1 --2- 172.21.15.19:0/4250251065 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55937faa1df0 0x55937faaaa60 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7f7e68031440 tx=0x7f7e680092f0 comp rx=0 tx=0).stop 2024-09-10T22:31:42.178 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:42.093+0000 7f7e7e341740 1 -- 172.21.15.19:0/4250251065 shutdown_connections 2024-09-10T22:31:42.178 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:42.093+0000 7f7e7e341740 1 --2- 172.21.15.19:0/4250251065 >> [v2:172.21.15.138:6838/383637208,v1:172.21.15.138:6839/383637208] conn(0x55937fabd730 0x55937fabfb70 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:31:42.178 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:42.093+0000 7f7e7e341740 1 --2- 172.21.15.19:0/4250251065 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55937faadd80 0x55937faab000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:31:42.178 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:42.093+0000 7f7e7e341740 1 --2- 172.21.15.19:0/4250251065 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55937faa1df0 0x55937faaaa60 unknown :-1 s=CLOSED pgs=629 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:31:42.179 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:42.093+0000 7f7e597fa640 0 client.16404 ms_handle_reset on v2:172.21.15.138:6838/383637208 2024-09-10T22:31:42.179 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:42.093+0000 7f7e7e341740 1 --2- 172.21.15.19:0/4250251065 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55937faa14d0 0x55937faad610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:31:42.179 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:42.093+0000 7f7e7e341740 1 -- 172.21.15.19:0/4250251065 >> 172.21.15.19:0/4250251065 conn(0x55937fa9f300 msgr2=0x55937faa4e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:31:42.179 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:42.093+0000 7f7e7e341740 1 -- 172.21.15.19:0/4250251065 shutdown_connections 2024-09-10T22:31:42.179 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:42.093+0000 7f7e7e341740 1 -- 172.21.15.19:0/4250251065 wait complete. 2024-09-10T22:31:42.179 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:42.093+0000 7f7e7e341740 20 client.16404 trim_cache size 0 max 16384 2024-09-10T22:31:42.179 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:42.107+0000 7f7e7e341740 1 Processor -- start 2024-09-10T22:31:42.179 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:42.107+0000 7f7e7e341740 1 -- start start 2024-09-10T22:31:42.179 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:42.108+0000 7f7e7e341740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55937faa14d0 0x55937faa0a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:31:42.179 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:42.108+0000 7f7e7e341740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55937faa1df0 0x55937faac7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:31:42.179 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:42.108+0000 7f7e7e341740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55937faadd80 0x55937faa7c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:31:42.179 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:42.108+0000 7f7e7e341740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f7e741b2f90 con 0x55937faa1df0 2024-09-10T22:31:42.179 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:42.108+0000 7f7e7e341740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f7e741b0860 con 0x55937faa14d0 2024-09-10T22:31:42.180 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:42.108+0000 7f7e7e341740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f7e741ae6b0 con 0x55937faadd80 2024-09-10T22:31:42.180 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:42.108+0000 7f7e79507640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55937faa1df0 0x55937faac7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:31:42.180 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:42.108+0000 7f7e79507640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55937faa1df0 0x55937faac7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:53764/0 (socket says 172.21.15.19:53764) 2024-09-10T22:31:42.180 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:42.108+0000 7f7e79507640 1 -- 172.21.15.19:0/1815646269 learned_addr learned my addr 172.21.15.19:0/1815646269 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:31:42.180 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:42.108+0000 7f7e79d08640 1 --2- 172.21.15.19:0/1815646269 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55937faa14d0 0x55937faa0a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:31:42.180 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:42.108+0000 7f7e7a509640 1 --2- 172.21.15.19:0/1815646269 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55937faadd80 0x55937faa7c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:31:42.180 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:42.108+0000 7f7e79507640 1 -- 172.21.15.19:0/1815646269 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55937faadd80 msgr2=0x55937faa7c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:31:42.180 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:42.108+0000 7f7e79507640 1 --2- 172.21.15.19:0/1815646269 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55937faadd80 0x55937faa7c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:31:42.180 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:42.108+0000 7f7e79507640 1 -- 172.21.15.19:0/1815646269 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55937faa14d0 msgr2=0x55937faa0a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:31:42.180 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:42.108+0000 7f7e79507640 1 --2- 172.21.15.19:0/1815646269 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55937faa14d0 0x55937faa0a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:31:42.180 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:42.108+0000 7f7e79507640 1 -- 172.21.15.19:0/1815646269 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55937faaa810 con 0x55937faa1df0 2024-09-10T22:31:42.180 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:42.108+0000 7f7e79d08640 1 --2- 172.21.15.19:0/1815646269 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55937faa14d0 0x55937faa0a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T22:31:42.181 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:42.108+0000 7f7e79507640 1 --2- 172.21.15.19:0/1815646269 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55937faa1df0 0x55937faac7a0 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7f7e680ca000 tx=0x7f7e68009680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6c3603156b329bf5 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:31:42.181 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:42.109+0000 7f7e5b7fe640 1 -- 172.21.15.19:0/1815646269 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e68049070 con 0x55937faa1df0 2024-09-10T22:31:42.181 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:42.109+0000 7f7e5b7fe640 1 -- 172.21.15.19:0/1815646269 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7e680ccd90 con 0x55937faa1df0 2024-09-10T22:31:42.181 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:42.109+0000 7f7e5b7fe640 1 -- 172.21.15.19:0/1815646269 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e680cc500 con 0x55937faa1df0 2024-09-10T22:31:42.181 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:42.109+0000 7f7e7e341740 1 -- 172.21.15.19:0/1815646269 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55937faa1df0 msgr2=0x55937faac7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:31:42.181 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:42.109+0000 7f7e7e341740 1 --2- 172.21.15.19:0/1815646269 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55937faa1df0 0x55937faac7a0 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7f7e680ca000 tx=0x7f7e68009680 comp rx=0 tx=0).stop 2024-09-10T22:31:42.181 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:42.109+0000 7f7e7e341740 1 -- 172.21.15.19:0/1815646269 shutdown_connections 2024-09-10T22:31:42.181 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:42.109+0000 7f7e7e341740 1 --2- 172.21.15.19:0/1815646269 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55937faadd80 0x55937faa7c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:31:42.181 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:42.109+0000 7f7e7e341740 1 --2- 172.21.15.19:0/1815646269 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55937faa1df0 0x55937faac7a0 unknown :-1 s=CLOSED pgs=630 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:31:42.181 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:42.109+0000 7f7e7e341740 1 --2- 172.21.15.19:0/1815646269 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55937faa14d0 0x55937faa0a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:31:42.181 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:42.109+0000 7f7e7e341740 1 -- 172.21.15.19:0/1815646269 >> 172.21.15.19:0/1815646269 conn(0x55937fa9f300 msgr2=0x55937faac090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:31:42.181 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:42.109+0000 7f7e7e341740 1 -- 172.21.15.19:0/1815646269 shutdown_connections 2024-09-10T22:31:42.182 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:42.110+0000 7f7e7e341740 1 -- 172.21.15.19:0/1815646269 wait complete. 2024-09-10T22:31:42.182 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:42.110+0000 7f7e7e341740 1 -- start start 2024-09-10T22:31:42.182 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:42.110+0000 7f7e7e341740 1 Processor -- start 2024-09-10T22:31:42.182 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:42.110+0000 7f7e7e341740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55937faa14d0 0x55937fab2630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:31:42.182 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:42.110+0000 7f7e7e341740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55937faa1df0 0x55937fab2bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:31:42.182 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:42.110+0000 7f7e7e341740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55937faadd80 0x55937fb23650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:31:42.182 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:42.110+0000 7f7e7e341740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f7e741aed20 con 0x55937faa1df0 2024-09-10T22:31:42.182 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:42.110+0000 7f7e7e341740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f7e741b0190 con 0x55937faa14d0 2024-09-10T22:31:42.182 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:42.110+0000 7f7e7e341740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f7e741af3f0 con 0x55937faadd80 2024-09-10T22:31:42.182 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:42.111+0000 7f7e7e341740 10 client.0 _ll_register_callbacks cb 0x7f7e68109d50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T22:31:42.182 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:42.111+0000 7f7e79d08640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55937faa14d0 0x55937fab2630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:31:42.183 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:42.111+0000 7f7e7a509640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55937faadd80 0x55937fb23650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:31:42.183 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:42.111+0000 7f7e79d08640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55937faa14d0 0x55937fab2630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.19:46422/0 (socket says 172.21.15.19:46422) 2024-09-10T22:31:42.183 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:42.111+0000 7f7e79d08640 1 -- 172.21.15.19:0/1221369138 learned_addr learned my addr 172.21.15.19:0/1221369138 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:31:42.183 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:42.111+0000 7f7e79507640 1 --2- 172.21.15.19:0/1221369138 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55937faa1df0 0x55937fab2bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:31:42.183 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:42.111+0000 7f7e79d08640 1 -- 172.21.15.19:0/1221369138 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55937faadd80 msgr2=0x55937fb23650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:31:42.183 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:42.111+0000 7f7e79d08640 1 --2- 172.21.15.19:0/1221369138 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55937faadd80 0x55937fb23650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:31:42.183 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:42.111+0000 7f7e79d08640 1 -- 172.21.15.19:0/1221369138 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55937faa1df0 msgr2=0x55937fab2bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:31:42.183 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:42.111+0000 7f7e79d08640 1 --2- 172.21.15.19:0/1221369138 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55937faa1df0 0x55937fab2bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:31:42.183 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:42.111+0000 7f7e79d08640 1 -- 172.21.15.19:0/1221369138 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55937fb23d90 con 0x55937faa14d0 2024-09-10T22:31:42.183 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:42.111+0000 7f7e7a509640 1 --2- 172.21.15.19:0/1221369138 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55937faadd80 0x55937fb23650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T22:31:42.183 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:42.111+0000 7f7e79d08640 1 --2- 172.21.15.19:0/1221369138 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55937faa14d0 0x55937fab2630 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f7e640039f0 tx=0x7f7e64009240 comp rx=0 tx=0).ready entity=mon.2 client_cookie=74dfc95accbb856f server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:31:42.183 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:42.111+0000 7f7e597fa640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-09-10T22:31:42.184 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:42.111+0000 7f7e597fa640 1 -- 172.21.15.19:0/1221369138 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e64033060 con 0x55937faa14d0 2024-09-10T22:31:42.184 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:42.111+0000 7f7e7e341740 1 -- 172.21.15.19:0/1221369138 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7e680ccd90 con 0x55937faa14d0 2024-09-10T22:31:42.184 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:42.111+0000 7f7e597fa640 1 -- 172.21.15.19:0/1221369138 <== mon.2 v2:172.21.15.135:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8327+0+0 (secure 0 0 0) 0x7f7e64012450 con 0x55937faa14d0 2024-09-10T22:31:42.184 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:42.112+0000 7f7e597fa640 1 -- 172.21.15.19:0/1221369138 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f7e640099c0 con 0x55937faa14d0 2024-09-10T22:31:42.184 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:42.112+0000 7f7e7e341740 10 client.25841 fetch_fsmap learned FSMap version 27 2024-09-10T22:31:42.184 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:42.112+0000 7f7e7e341740 1 -- 172.21.15.19:0/1221369138 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55937fb2b1c0 con 0x55937faa14d0 2024-09-10T22:31:42.184 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:42.112+0000 7f7e597fa640 1 -- 172.21.15.19:0/1221369138 <== mon.2 v2:172.21.15.135:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7e680ccd90 con 0x55937faa14d0 2024-09-10T22:31:42.184 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:42.113+0000 7f7e597fa640 1 -- 172.21.15.19:0/1221369138 <== mon.2 v2:172.21.15.135:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7f7e64037030 con 0x55937faa14d0 2024-09-10T22:31:42.184 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:42.113+0000 7f7e7e341740 10 client.25841 fetch_fsmap finished waiting for FSMap version 27 2024-09-10T22:31:42.184 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:42.113+0000 7f7e7e341740 10 client.25841 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-10T22:31:42.184 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:42.113+0000 7f7e7e341740 20 client.25841 populate_metadata read hostname 'smithi019' 2024-09-10T22:31:42.184 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:42.113+0000 7f7e7e341740 1 --2- 172.21.15.19:0/1221369138 >> [v2:172.21.15.138:6838/383637208,v1:172.21.15.138:6839/383637208] conn(0x55937fb2b750 0x55937fb2db40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:31:42.185 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:42.113+0000 7f7e7e341740 4 client.25841 mds_command: new command op to 24568 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-10T22:31:42.185 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:42.113+0000 7f7e7e341740 1 -- 172.21.15.19:0/1221369138 --> [v2:172.21.15.138:6838/383637208,v1:172.21.15.138:6839/383637208] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55937fa158a0 con 0x55937fb2b750 2024-09-10T22:31:42.185 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:42.113+0000 7f7e79507640 1 --2- 172.21.15.19:0/1221369138 >> [v2:172.21.15.138:6838/383637208,v1:172.21.15.138:6839/383637208] conn(0x55937fb2b750 0x55937fb2db40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:31:42.185 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:42.114+0000 7f7e79507640 1 --2- 172.21.15.19:0/1221369138 >> [v2:172.21.15.138:6838/383637208,v1:172.21.15.138:6839/383637208] conn(0x55937fb2b750 0x55937fb2db40 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=e1a0d4f18578dbe2 server_cookie=f8d1da564f6731de in_seq=0 out_seq=0 2024-09-10T22:31:42.185 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:42.114+0000 7f7e597fa640 10 client.25841 ms_handle_connect on v2:172.21.15.138:6838/383637208 2024-09-10T22:31:42.185 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:42.114+0000 7f7e597fa640 1 -- 172.21.15.19:0/1221369138 <== mds.1 v2:172.21.15.138:6838/383637208 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55937fa158a0 con 0x55937fb2b750 2024-09-10T22:31:42.185 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:42.114+0000 7f7e597fa640 10 client.25841 handle_command_reply: tid=0 2024-09-10T22:31:42.185 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:42.114+0000 7f7e7e341740 1 client.25841 shutdown 2024-09-10T22:31:42.185 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:42.114+0000 7f7e7e341740 1 -- 172.21.15.19:0/1221369138 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55937faa14d0 msgr2=0x55937fab2630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:31:42.185 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:42.114+0000 7f7e7e341740 1 --2- 172.21.15.19:0/1221369138 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55937faa14d0 0x55937fab2630 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f7e640039f0 tx=0x7f7e64009240 comp rx=0 tx=0).stop 2024-09-10T22:31:42.185 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:42.114+0000 7f7e7e341740 1 -- 172.21.15.19:0/1221369138 shutdown_connections 2024-09-10T22:31:42.186 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:42.114+0000 7f7e7e341740 1 --2- 172.21.15.19:0/1221369138 >> [v2:172.21.15.138:6838/383637208,v1:172.21.15.138:6839/383637208] conn(0x55937fb2b750 0x55937fb2db40 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:31:42.186 INFO:teuthology.orchestra.run.smithi019.stdout:[] 2024-09-10T22:31:42.186 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:42.114+0000 7f7e7e341740 1 --2- 172.21.15.19:0/1221369138 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55937faadd80 0x55937fb23650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:31:42.186 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:42.114+0000 7f7e597fa640 0 client.25841 ms_handle_reset on v2:172.21.15.138:6838/383637208 2024-09-10T22:31:42.186 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:42.114+0000 7f7e7e341740 1 --2- 172.21.15.19:0/1221369138 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55937faa1df0 0x55937fab2bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:31:42.187 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:42.114+0000 7f7e7e341740 1 --2- 172.21.15.19:0/1221369138 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55937faa14d0 0x55937fab2630 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:31:42.187 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:42.114+0000 7f7e7e341740 1 -- 172.21.15.19:0/1221369138 >> 172.21.15.19:0/1221369138 conn(0x55937fa9f300 msgr2=0x55937faac8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:31:42.187 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:42.114+0000 7f7e7e341740 1 -- 172.21.15.19:0/1221369138 shutdown_connections 2024-09-10T22:31:42.187 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:42.114+0000 7f7e7e341740 1 -- 172.21.15.19:0/1221369138 wait complete. 2024-09-10T22:31:42.187 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:42.115+0000 7f7e7e341740 20 client.25841 trim_cache size 0 max 16384 2024-09-10T22:31:42.187 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:42.115+0000 7f7e7bf6c640 1 -- 172.21.15.19:0/565954983 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f7e5c0b52e0 msgr2=0x7f7e5c0b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:31:42.187 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:42.115+0000 7f7e7bf6c640 1 --2- 172.21.15.19:0/565954983 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f7e5c0b52e0 0x7f7e5c0b77a0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f7e6c009da0 tx=0x7f7e6c005f90 comp rx=0 tx=0).stop 2024-09-10T22:31:42.187 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:42.115+0000 7f7e7bf6c640 1 -- 172.21.15.19:0/565954983 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7e74102150 msgr2=0x7f7e7419b9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:31:42.187 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:42.115+0000 7f7e7bf6c640 1 --2- 172.21.15.19:0/565954983 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7e74102150 0x7f7e7419b9f0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f7e68005940 tx=0x7f7e68004270 comp rx=0 tx=0).stop 2024-09-10T22:31:42.187 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:42.115+0000 7f7e7bf6c640 1 -- 172.21.15.19:0/565954983 shutdown_connections 2024-09-10T22:31:42.187 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:42.115+0000 7f7e7bf6c640 1 --2- 172.21.15.19:0/565954983 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f7e5c0b52e0 0x7f7e5c0b77a0 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:31:42.187 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:42.115+0000 7f7e7bf6c640 1 --2- 172.21.15.19:0/565954983 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7e7410f3e0 0x7f7e741a0d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:31:42.187 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:42.115+0000 7f7e7bf6c640 1 --2- 172.21.15.19:0/565954983 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7e74102150 0x7f7e7419b9f0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:31:42.187 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:42.115+0000 7f7e7bf6c640 1 --2- 172.21.15.19:0/565954983 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7e74101830 0x7f7e7419b4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:31:42.188 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:42.115+0000 7f7e7bf6c640 1 -- 172.21.15.19:0/565954983 >> 172.21.15.19:0/565954983 conn(0x7f7e740fd700 msgr2=0x7f7e740ffaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:31:42.188 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:42.115+0000 7f7e7bf6c640 1 -- 172.21.15.19:0/565954983 shutdown_connections 2024-09-10T22:31:42.188 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:42.115+0000 7f7e7bf6c640 1 -- 172.21.15.19:0/565954983 wait complete. 2024-09-10T22:31:43.212 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 22997a4c-6fc2-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-10T22:31:43.610 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/22997a4c-6fc2-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T22:31:44.083 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:31:43 smithi019 ceph-mon[31375]: pgmap v506: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 870 KiB/s rd, 314 MiB/s wr, 252 op/s 2024-09-10T22:31:44.360 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:31:43 smithi135 ceph-mon[34789]: pgmap v506: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 870 KiB/s rd, 314 MiB/s wr, 252 op/s 2024-09-10T22:31:44.375 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:31:43 smithi138 ceph-mon[35236]: pgmap v506: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 870 KiB/s rd, 314 MiB/s wr, 252 op/s 2024-09-10T22:31:44.576 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:44.508+0000 7f37a0e7a640 1 -- 172.21.15.19:0/3132379106 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f379c103cd0 msgr2=0x7f379c1040b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:31:44.577 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:44.508+0000 7f37a0e7a640 1 --2- 172.21.15.19:0/3132379106 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f379c103cd0 0x7f379c1040b0 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7f378c009900 tx=0x7f378c02a410 comp rx=0 tx=0).stop 2024-09-10T22:31:44.577 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:44.508+0000 7f37a0e7a640 1 -- 172.21.15.19:0/3132379106 shutdown_connections 2024-09-10T22:31:44.577 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:44.508+0000 7f37a0e7a640 1 --2- 172.21.15.19:0/3132379106 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f379c10d130 0x7f379c10f590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:31:44.577 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:44.508+0000 7f37a0e7a640 1 --2- 172.21.15.19:0/3132379106 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f379c1045f0 0x7f379c10cae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:31:44.577 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:44.508+0000 7f37a0e7a640 1 --2- 172.21.15.19:0/3132379106 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f379c103cd0 0x7f379c1040b0 unknown :-1 s=CLOSED pgs=631 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:31:44.577 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:44.508+0000 7f37a0e7a640 1 -- 172.21.15.19:0/3132379106 >> 172.21.15.19:0/3132379106 conn(0x7f379c0fd770 msgr2=0x7f379c0ffb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:31:44.577 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:44.509+0000 7f37a0e7a640 1 -- 172.21.15.19:0/3132379106 shutdown_connections 2024-09-10T22:31:44.577 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:44.509+0000 7f37a0e7a640 1 -- 172.21.15.19:0/3132379106 wait complete. 2024-09-10T22:31:44.577 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:44.509+0000 7f37a0e7a640 1 Processor -- start 2024-09-10T22:31:44.577 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:44.509+0000 7f37a0e7a640 1 -- start start 2024-09-10T22:31:44.578 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:44.509+0000 7f37a0e7a640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f379c103cd0 0x7f379c1992b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:31:44.578 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:44.510+0000 7f37a0e7a640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f379c1045f0 0x7f379c1997f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:31:44.578 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:44.510+0000 7f37a0e7a640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f379c10d130 0x7f379c19eb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:31:44.578 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:44.510+0000 7f37a0e7a640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f379c112da0 con 0x7f379c10d130 2024-09-10T22:31:44.578 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:44.510+0000 7f37a0e7a640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f379c112c20 con 0x7f379c1045f0 2024-09-10T22:31:44.578 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:44.510+0000 7f37a0e7a640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f379c112f20 con 0x7f379c103cd0 2024-09-10T22:31:44.578 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:44.510+0000 7f379ad9d640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f379c10d130 0x7f379c19eb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:31:44.578 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:44.510+0000 7f379a59c640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f379c103cd0 0x7f379c1992b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:31:44.578 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:44.510+0000 7f379ad9d640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f379c10d130 0x7f379c19eb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:38166/0 (socket says 172.21.15.19:38166) 2024-09-10T22:31:44.578 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:44.510+0000 7f379ad9d640 1 -- 172.21.15.19:0/771599845 learned_addr learned my addr 172.21.15.19:0/771599845 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:31:44.578 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:44.510+0000 7f3793fff640 1 --2- 172.21.15.19:0/771599845 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f379c1045f0 0x7f379c1997f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:31:44.579 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:44.510+0000 7f379a59c640 1 -- 172.21.15.19:0/771599845 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f379c1045f0 msgr2=0x7f379c1997f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:31:44.579 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:44.510+0000 7f379a59c640 1 --2- 172.21.15.19:0/771599845 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f379c1045f0 0x7f379c1997f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:31:44.579 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:44.510+0000 7f379a59c640 1 -- 172.21.15.19:0/771599845 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f379c10d130 msgr2=0x7f379c19eb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:31:44.579 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:44.510+0000 7f379a59c640 1 --2- 172.21.15.19:0/771599845 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f379c10d130 0x7f379c19eb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:31:44.579 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:44.510+0000 7f379a59c640 1 -- 172.21.15.19:0/771599845 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f379c19f360 con 0x7f379c103cd0 2024-09-10T22:31:44.579 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:44.510+0000 7f379a59c640 1 --2- 172.21.15.19:0/771599845 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f379c103cd0 0x7f379c1992b0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f378c02a930 tx=0x7f378c031a20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:31:44.579 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:44.511+0000 7f37937fe640 1 -- 172.21.15.19:0/771599845 <== mon.1 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f378c03f030 con 0x7f379c103cd0 2024-09-10T22:31:44.579 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:44.511+0000 7f37a0e7a640 1 -- 172.21.15.19:0/771599845 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f379c19f5f0 con 0x7f379c103cd0 2024-09-10T22:31:44.579 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:44.511+0000 7f37937fe640 1 -- 172.21.15.19:0/771599845 <== mon.1 v2:172.21.15.138:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f378c004490 con 0x7f379c103cd0 2024-09-10T22:31:44.579 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:44.511+0000 7f37937fe640 1 -- 172.21.15.19:0/771599845 <== mon.1 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f378c035070 con 0x7f379c103cd0 2024-09-10T22:31:44.579 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:44.511+0000 7f37a0e7a640 1 -- 172.21.15.19:0/771599845 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f379c1a5d10 con 0x7f379c103cd0 2024-09-10T22:31:44.579 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:44.513+0000 7f37937fe640 1 -- 172.21.15.19:0/771599845 <== mon.1 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 18) ==== 153250+0+0 (secure 0 0 0) 0x7f378c04c060 con 0x7f379c103cd0 2024-09-10T22:31:44.579 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:44.514+0000 7f37937fe640 1 --2- 172.21.15.19:0/771599845 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f37880b52e0 0x7f37880b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:31:44.580 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:44.515+0000 7f3793fff640 1 --2- 172.21.15.19:0/771599845 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f37880b52e0 0x7f37880b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:31:44.580 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:44.515+0000 7f37937fe640 1 -- 172.21.15.19:0/771599845 <== mon.1 v2:172.21.15.138:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8327+0+0 (secure 0 0 0) 0x7f378c105aa0 con 0x7f379c103cd0 2024-09-10T22:31:44.580 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:44.515+0000 7f3793fff640 1 --2- 172.21.15.19:0/771599845 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f37880b52e0 0x7f37880b77a0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f379c10f720 tx=0x7f3784005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:31:44.580 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:44.515+0000 7f37a324f740 1 Processor -- start 2024-09-10T22:31:44.580 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:44.516+0000 7f37a324f740 1 -- start start 2024-09-10T22:31:44.580 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:44.516+0000 7f37a324f740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55f79c3044d0 0x55f79c3048b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:31:44.580 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:44.516+0000 7f37a324f740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f79c304df0 0x55f79c310840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:31:44.580 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:44.516+0000 7f37a324f740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55f79c310d80 0x55f79c313170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:31:44.580 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:44.516+0000 7f37a324f740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x55f79c27aea0 con 0x55f79c3044d0 2024-09-10T22:31:44.580 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:44.516+0000 7f37a324f740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55f79c26a2d0 con 0x55f79c304df0 2024-09-10T22:31:44.580 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:44.516+0000 7f37a324f740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x55f79c26e0e0 con 0x55f79c310d80 2024-09-10T22:31:44.580 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:44.516+0000 7f3793fff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f79c304df0 0x55f79c310840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:31:44.580 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:44.516+0000 7f3793fff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f79c304df0 0x55f79c310840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.19:60074/0 (socket says 172.21.15.19:60074) 2024-09-10T22:31:44.581 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:44.516+0000 7f3793fff640 1 -- 172.21.15.19:0/1199939361 learned_addr learned my addr 172.21.15.19:0/1199939361 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:31:44.581 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:44.516+0000 7f379a59c640 1 --2- 172.21.15.19:0/1199939361 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55f79c3044d0 0x55f79c3048b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:31:44.581 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:44.516+0000 7f379ad9d640 1 --2- 172.21.15.19:0/1199939361 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55f79c310d80 0x55f79c313170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:31:44.581 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:44.516+0000 7f3793fff640 1 -- 172.21.15.19:0/1199939361 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55f79c310d80 msgr2=0x55f79c313170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:31:44.581 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:44.516+0000 7f3793fff640 1 --2- 172.21.15.19:0/1199939361 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55f79c310d80 0x55f79c313170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:31:44.581 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:44.516+0000 7f3793fff640 1 -- 172.21.15.19:0/1199939361 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55f79c3044d0 msgr2=0x55f79c3048b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:31:44.581 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:44.516+0000 7f3793fff640 1 --2- 172.21.15.19:0/1199939361 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55f79c3044d0 0x55f79c3048b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:31:44.581 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:44.517+0000 7f3793fff640 1 -- 172.21.15.19:0/1199939361 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f79bfc8650 con 0x55f79c304df0 2024-09-10T22:31:44.581 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:44.517+0000 7f3793fff640 1 --2- 172.21.15.19:0/1199939361 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f79c304df0 0x55f79c310840 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f3784009680 tx=0x7f3784014000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9a1363727580c02f server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:31:44.581 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:44.517+0000 7f3790ff9640 1 -- 172.21.15.19:0/1199939361 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3784026430 con 0x55f79c304df0 2024-09-10T22:31:44.581 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:44.517+0000 7f3790ff9640 1 -- 172.21.15.19:0/1199939361 <== mon.2 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f378401c8c0 con 0x55f79c304df0 2024-09-10T22:31:44.582 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:44.517+0000 7f3790ff9640 1 -- 172.21.15.19:0/1199939361 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f378401d8b0 con 0x55f79c304df0 2024-09-10T22:31:44.582 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:44.518+0000 7f37a324f740 1 -- 172.21.15.19:0/1199939361 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f79c304df0 msgr2=0x55f79c310840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:31:44.582 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:44.518+0000 7f37a324f740 1 --2- 172.21.15.19:0/1199939361 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f79c304df0 0x55f79c310840 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f3784009680 tx=0x7f3784014000 comp rx=0 tx=0).stop 2024-09-10T22:31:44.582 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:44.518+0000 7f37a324f740 1 -- 172.21.15.19:0/1199939361 shutdown_connections 2024-09-10T22:31:44.582 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:44.518+0000 7f37a324f740 1 --2- 172.21.15.19:0/1199939361 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55f79c310d80 0x55f79c313170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:31:44.582 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:44.518+0000 7f37a324f740 1 --2- 172.21.15.19:0/1199939361 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f79c304df0 0x55f79c310840 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:31:44.582 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:44.518+0000 7f37a324f740 1 --2- 172.21.15.19:0/1199939361 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55f79c3044d0 0x55f79c3048b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:31:44.582 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:44.518+0000 7f37a324f740 1 -- 172.21.15.19:0/1199939361 >> 172.21.15.19:0/1199939361 conn(0x55f79c302300 msgr2=0x55f79c3034a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:31:44.583 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:44.518+0000 7f37a324f740 1 -- 172.21.15.19:0/1199939361 shutdown_connections 2024-09-10T22:31:44.583 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:44.518+0000 7f37a324f740 1 -- 172.21.15.19:0/1199939361 wait complete. 2024-09-10T22:31:44.583 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:44.519+0000 7f37a324f740 1 -- start start 2024-09-10T22:31:44.583 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:44.519+0000 7f37a324f740 1 Processor -- start 2024-09-10T22:31:44.583 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:44.519+0000 7f37a324f740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55f79c3044d0 0x55f79c310740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:31:44.583 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:44.519+0000 7f37a324f740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55f79c304df0 0x55f79c30db90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:31:44.583 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:44.519+0000 7f37a324f740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f79c310d80 0x55f79c30e260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:31:44.584 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:44.519+0000 7f37a324f740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x55f79c0cb700 con 0x55f79c3044d0 2024-09-10T22:31:44.584 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:44.519+0000 7f37a324f740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55f79c205160 con 0x55f79c310d80 2024-09-10T22:31:44.584 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:44.519+0000 7f37a324f740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x55f79c313a00 con 0x55f79c304df0 2024-09-10T22:31:44.584 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:44.520+0000 7f379a59c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55f79c3044d0 0x55f79c310740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:31:44.584 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:44.520+0000 7f37a324f740 10 client.0 _ll_register_callbacks cb 0x55f79c21e9e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T22:31:44.584 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:44.520+0000 7f3793fff640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55f79c304df0 0x55f79c30db90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:31:44.585 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:44.520+0000 7f379a59c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55f79c3044d0 0x55f79c310740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:38180/0 (socket says 172.21.15.19:38180) 2024-09-10T22:31:44.585 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:44.520+0000 7f379ad9d640 1 --2- 172.21.15.19:0/2467088189 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f79c310d80 0x55f79c30e260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:31:44.585 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:44.520+0000 7f379a59c640 1 -- 172.21.15.19:0/2467088189 learned_addr learned my addr 172.21.15.19:0/2467088189 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:31:44.585 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:44.520+0000 7f3793fff640 1 -- 172.21.15.19:0/2467088189 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f79c310d80 msgr2=0x55f79c30e260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:31:44.585 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:44.520+0000 7f3793fff640 1 --2- 172.21.15.19:0/2467088189 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f79c310d80 0x55f79c30e260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:31:44.586 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:44.520+0000 7f3793fff640 1 -- 172.21.15.19:0/2467088189 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55f79c3044d0 msgr2=0x55f79c310740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:31:44.586 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:44.520+0000 7f3793fff640 1 --2- 172.21.15.19:0/2467088189 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55f79c3044d0 0x55f79c310740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:31:44.586 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:44.520+0000 7f3793fff640 1 -- 172.21.15.19:0/2467088189 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f79c232c90 con 0x55f79c304df0 2024-09-10T22:31:44.586 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:44.520+0000 7f3793fff640 1 --2- 172.21.15.19:0/2467088189 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55f79c304df0 0x55f79c30db90 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f378400e9f0 tx=0x7f378400ee20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4058ae327ac7390d server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:31:44.586 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:44.520+0000 7f3781ffb640 10 client.0 ms_handle_connect on v2:172.21.15.138:3300/0 2024-09-10T22:31:44.586 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:44.521+0000 7f3781ffb640 1 -- 172.21.15.19:0/2467088189 <== mon.1 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3784034060 con 0x55f79c304df0 2024-09-10T22:31:44.587 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:44.521+0000 7f3781ffb640 1 -- 172.21.15.19:0/2467088189 <== mon.1 v2:172.21.15.138:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8327+0+0 (secure 0 0 0) 0x7f378401c6a0 con 0x55f79c304df0 2024-09-10T22:31:44.587 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:44.521+0000 7f37a324f740 1 -- 172.21.15.19:0/2467088189 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f378401c8c0 con 0x55f79c304df0 2024-09-10T22:31:44.587 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:44.521+0000 7f3781ffb640 1 -- 172.21.15.19:0/2467088189 <== mon.1 v2:172.21.15.138:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f378401ca70 con 0x55f79c304df0 2024-09-10T22:31:44.587 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:44.521+0000 7f37a324f740 10 client.25876 fetch_fsmap learned FSMap version 27 2024-09-10T22:31:44.587 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:44.521+0000 7f37a324f740 1 -- 172.21.15.19:0/2467088189 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55f79c31f410 con 0x55f79c304df0 2024-09-10T22:31:44.587 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:44.521+0000 7f3781ffb640 1 -- 172.21.15.19:0/2467088189 <== mon.1 v2:172.21.15.138:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f378401c8c0 con 0x55f79c304df0 2024-09-10T22:31:44.588 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:44.521+0000 7f3781ffb640 1 -- 172.21.15.19:0/2467088189 <== mon.1 v2:172.21.15.138:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7f3784038030 con 0x55f79c304df0 2024-09-10T22:31:44.588 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:44.521+0000 7f37a324f740 10 client.25876 fetch_fsmap finished waiting for FSMap version 27 2024-09-10T22:31:44.588 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:44.521+0000 7f37a324f740 10 client.25876 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-10T22:31:44.588 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:44.521+0000 7f37a324f740 20 client.25876 populate_metadata read hostname 'smithi019' 2024-09-10T22:31:44.588 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:44.521+0000 7f37a324f740 1 --2- 172.21.15.19:0/2467088189 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x55f79c320810 0x55f79c322c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:31:44.589 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:44.521+0000 7f37a324f740 4 client.25876 mds_command: new command op to 24581 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T22:31:44.589 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:44.521+0000 7f37a324f740 1 -- 172.21.15.19:0/2467088189 --> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f79c27cdf0 con 0x55f79c320810 2024-09-10T22:31:44.589 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:44.522+0000 7f379a59c640 1 --2- 172.21.15.19:0/2467088189 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x55f79c320810 0x55f79c322c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:31:44.589 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:44.522+0000 7f3781ffb640 10 client.25876 ms_handle_connect on v2:172.21.15.135:6838/1254769802 2024-09-10T22:31:44.589 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:44.522+0000 7f379a59c640 1 --2- 172.21.15.19:0/2467088189 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x55f79c320810 0x55f79c322c00 crc :-1 s=READY pgs=120 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8877795215a05f3a server_cookie=4581a57d6f2a9e6 in_seq=0 out_seq=0 2024-09-10T22:31:44.590 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:44.523+0000 7f3781ffb640 1 -- 172.21.15.19:0/2467088189 <== mds.0 v2:172.21.15.135:6838/1254769802 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55f79c27cdf0 con 0x55f79c320810 2024-09-10T22:31:44.590 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:44.523+0000 7f3781ffb640 10 client.25876 handle_command_reply: tid=0 2024-09-10T22:31:44.590 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:44.523+0000 7f37a324f740 1 client.25876 shutdown 2024-09-10T22:31:44.590 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:44.523+0000 7f37a324f740 1 -- 172.21.15.19:0/2467088189 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55f79c304df0 msgr2=0x55f79c30db90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:31:44.590 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:44.523+0000 7f37a324f740 1 --2- 172.21.15.19:0/2467088189 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55f79c304df0 0x55f79c30db90 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f378400e9f0 tx=0x7f378400ee20 comp rx=0 tx=0).stop 2024-09-10T22:31:44.590 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:44.523+0000 7f37a324f740 1 -- 172.21.15.19:0/2467088189 shutdown_connections 2024-09-10T22:31:44.591 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:44.523+0000 7f37a324f740 1 --2- 172.21.15.19:0/2467088189 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f79c310d80 0x55f79c30e260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:31:44.591 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:44.523+0000 7f37a324f740 1 --2- 172.21.15.19:0/2467088189 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x55f79c320810 0x55f79c322c00 crc :-1 s=READY pgs=120 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:31:44.591 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:44.523+0000 7f37a324f740 1 --2- 172.21.15.19:0/2467088189 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55f79c304df0 0x55f79c30db90 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:31:44.591 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:44.523+0000 7f37a324f740 1 --2- 172.21.15.19:0/2467088189 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55f79c3044d0 0x55f79c310740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:31:44.591 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:44.523+0000 7f3781ffb640 0 client.25876 ms_handle_reset on v2:172.21.15.135:6838/1254769802 2024-09-10T22:31:44.591 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:44.523+0000 7f37a324f740 1 -- 172.21.15.19:0/2467088189 >> 172.21.15.19:0/2467088189 conn(0x55f79c302300 msgr2=0x55f79c307ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:31:44.592 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:44.523+0000 7f37a324f740 1 -- 172.21.15.19:0/2467088189 shutdown_connections 2024-09-10T22:31:44.592 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:44.523+0000 7f37a324f740 1 -- 172.21.15.19:0/2467088189 wait complete. 2024-09-10T22:31:44.592 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:44.524+0000 7f37a324f740 20 client.25876 trim_cache size 0 max 16384 2024-09-10T22:31:44.592 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:44.541+0000 7f37a324f740 1 Processor -- start 2024-09-10T22:31:44.592 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:44.541+0000 7f37a324f740 1 -- start start 2024-09-10T22:31:44.593 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:44.542+0000 7f37a324f740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f79c3044d0 0x55f79c31cca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:31:44.593 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:44.542+0000 7f37a324f740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55f79c304df0 0x55f79c2fd390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:31:44.593 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:44.542+0000 7f37a324f740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55f79c310d80 0x55f79c30f8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:31:44.593 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:44.542+0000 7f37a324f740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f379c1b0e80 con 0x55f79c310d80 2024-09-10T22:31:44.593 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:44.542+0000 7f37a324f740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f379c1ae750 con 0x55f79c3044d0 2024-09-10T22:31:44.594 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:44.542+0000 7f37a324f740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f379c1ac5a0 con 0x55f79c304df0 2024-09-10T22:31:44.594 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:44.542+0000 7f379ad9d640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55f79c310d80 0x55f79c30f8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:31:44.594 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:44.542+0000 7f379a59c640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f79c3044d0 0x55f79c31cca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:31:44.594 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:44.542+0000 7f379ad9d640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55f79c310d80 0x55f79c30f8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:38196/0 (socket says 172.21.15.19:38196) 2024-09-10T22:31:44.594 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:44.542+0000 7f379ad9d640 1 -- 172.21.15.19:0/3958286696 learned_addr learned my addr 172.21.15.19:0/3958286696 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:31:44.594 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:44.542+0000 7f3793fff640 1 --2- 172.21.15.19:0/3958286696 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55f79c304df0 0x55f79c2fd390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:31:44.595 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:44.542+0000 7f379ad9d640 1 -- 172.21.15.19:0/3958286696 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55f79c304df0 msgr2=0x55f79c2fd390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:31:44.595 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:44.542+0000 7f379ad9d640 1 --2- 172.21.15.19:0/3958286696 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55f79c304df0 0x55f79c2fd390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:31:44.595 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:44.542+0000 7f379ad9d640 1 -- 172.21.15.19:0/3958286696 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f79c3044d0 msgr2=0x55f79c31cca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:31:44.595 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:44.542+0000 7f379ad9d640 1 --2- 172.21.15.19:0/3958286696 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f79c3044d0 0x55f79c31cca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:31:44.595 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:44.542+0000 7f379ad9d640 1 -- 172.21.15.19:0/3958286696 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f79c30c090 con 0x55f79c310d80 2024-09-10T22:31:44.596 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:44.542+0000 7f379a59c640 1 --2- 172.21.15.19:0/3958286696 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f79c3044d0 0x55f79c31cca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T22:31:44.596 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:44.542+0000 7f379ad9d640 1 --2- 172.21.15.19:0/3958286696 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55f79c310d80 0x55f79c30f8d0 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7f3794012710 tx=0x7f3794009500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8054c701fa599a1c server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:31:44.596 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:44.543+0000 7f3783fff640 1 -- 172.21.15.19:0/3958286696 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37940120d0 con 0x55f79c310d80 2024-09-10T22:31:44.596 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:44.543+0000 7f3783fff640 1 -- 172.21.15.19:0/3958286696 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3794021070 con 0x55f79c310d80 2024-09-10T22:31:44.596 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:44.543+0000 7f3783fff640 1 -- 172.21.15.19:0/3958286696 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3794010b10 con 0x55f79c310d80 2024-09-10T22:31:44.596 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:44.543+0000 7f37a324f740 1 -- 172.21.15.19:0/3958286696 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55f79c310d80 msgr2=0x55f79c30f8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:31:44.597 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:44.543+0000 7f37a324f740 1 --2- 172.21.15.19:0/3958286696 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55f79c310d80 0x55f79c30f8d0 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7f3794012710 tx=0x7f3794009500 comp rx=0 tx=0).stop 2024-09-10T22:31:44.597 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:44.543+0000 7f37a324f740 1 -- 172.21.15.19:0/3958286696 shutdown_connections 2024-09-10T22:31:44.597 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:44.543+0000 7f37a324f740 1 --2- 172.21.15.19:0/3958286696 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55f79c310d80 0x55f79c30f8d0 unknown :-1 s=CLOSED pgs=632 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:31:44.597 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:44.543+0000 7f37a324f740 1 --2- 172.21.15.19:0/3958286696 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55f79c304df0 0x55f79c2fd390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:31:44.597 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:44.543+0000 7f37a324f740 1 --2- 172.21.15.19:0/3958286696 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f79c3044d0 0x55f79c31cca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:31:44.597 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:44.543+0000 7f37a324f740 1 -- 172.21.15.19:0/3958286696 >> 172.21.15.19:0/3958286696 conn(0x55f79c302300 msgr2=0x55f79c30f1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:31:44.597 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:44.543+0000 7f37a324f740 1 -- 172.21.15.19:0/3958286696 shutdown_connections 2024-09-10T22:31:44.598 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:44.544+0000 7f37a324f740 1 -- 172.21.15.19:0/3958286696 wait complete. 2024-09-10T22:31:44.598 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:44.544+0000 7f37a324f740 1 -- start start 2024-09-10T22:31:44.598 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:44.544+0000 7f37a324f740 1 Processor -- start 2024-09-10T22:31:44.598 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:44.545+0000 7f37a324f740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f79c3044d0 0x55f79c321e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:31:44.598 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:44.545+0000 7f37a324f740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55f79c304df0 0x55f79c3223d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:31:44.598 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:44.545+0000 7f37a324f740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55f79c310d80 0x55f79c38c370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:31:44.599 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:44.545+0000 7f37a324f740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f379c1acc10 con 0x55f79c310d80 2024-09-10T22:31:44.599 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:44.545+0000 7f37a324f740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f379c1ae080 con 0x55f79c3044d0 2024-09-10T22:31:44.599 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:44.545+0000 7f37a324f740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f379c1ad2e0 con 0x55f79c304df0 2024-09-10T22:31:44.599 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:44.545+0000 7f37a324f740 10 client.0 _ll_register_callbacks cb 0x7f378c005760 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T22:31:44.599 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:44.545+0000 7f379a59c640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f79c3044d0 0x55f79c321e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:31:44.599 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:44.545+0000 7f379ad9d640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55f79c310d80 0x55f79c38c370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:31:44.599 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:44.545+0000 7f3793fff640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55f79c304df0 0x55f79c3223d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:31:44.600 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:44.545+0000 7f379a59c640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f79c3044d0 0x55f79c321e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.19:60104/0 (socket says 172.21.15.19:60104) 2024-09-10T22:31:44.600 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:44.545+0000 7f379a59c640 1 -- 172.21.15.19:0/2061015225 learned_addr learned my addr 172.21.15.19:0/2061015225 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:31:44.600 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:44.545+0000 7f3793fff640 1 -- 172.21.15.19:0/2061015225 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f79c3044d0 msgr2=0x55f79c321e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:31:44.600 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:44.545+0000 7f3793fff640 1 --2- 172.21.15.19:0/2061015225 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f79c3044d0 0x55f79c321e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:31:44.600 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:44.545+0000 7f3793fff640 1 -- 172.21.15.19:0/2061015225 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55f79c310d80 msgr2=0x55f79c38c370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:31:44.600 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:44.545+0000 7f3793fff640 1 --2- 172.21.15.19:0/2061015225 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55f79c310d80 0x55f79c38c370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:31:44.600 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:44.545+0000 7f3793fff640 1 -- 172.21.15.19:0/2061015225 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f79c322ca0 con 0x55f79c304df0 2024-09-10T22:31:44.600 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:44.545+0000 7f379a59c640 1 --2- 172.21.15.19:0/2061015225 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f79c3044d0 0x55f79c321e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T22:31:44.600 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:44.545+0000 7f3793fff640 1 --2- 172.21.15.19:0/2061015225 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55f79c304df0 0x55f79c3223d0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f3784004a30 tx=0x7f3784009a40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=de42f8bd84a853c0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:31:44.600 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:44.545+0000 7f3781ffb640 10 client.0 ms_handle_connect on v2:172.21.15.138:3300/0 2024-09-10T22:31:44.601 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:44.546+0000 7f3781ffb640 1 -- 172.21.15.19:0/2061015225 <== mon.1 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3784034070 con 0x55f79c304df0 2024-09-10T22:31:44.601 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:44.546+0000 7f3781ffb640 1 -- 172.21.15.19:0/2061015225 <== mon.1 v2:172.21.15.138:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8327+0+0 (secure 0 0 0) 0x7f3784009040 con 0x55f79c304df0 2024-09-10T22:31:44.601 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:44.546+0000 7f37a324f740 1 -- 172.21.15.19:0/2061015225 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3794021070 con 0x55f79c304df0 2024-09-10T22:31:44.601 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:44.546+0000 7f3781ffb640 1 -- 172.21.15.19:0/2061015225 <== mon.1 v2:172.21.15.138:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f378401c6a0 con 0x55f79c304df0 2024-09-10T22:31:44.601 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:44.546+0000 7f37a324f740 10 client.25882 fetch_fsmap learned FSMap version 27 2024-09-10T22:31:44.601 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:44.546+0000 7f37a324f740 1 -- 172.21.15.19:0/2061015225 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55f79c38d9b0 con 0x55f79c304df0 2024-09-10T22:31:44.601 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:44.546+0000 7f3781ffb640 1 -- 172.21.15.19:0/2061015225 <== mon.1 v2:172.21.15.138:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3794021070 con 0x55f79c304df0 2024-09-10T22:31:44.601 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:44.546+0000 7f3781ffb640 1 -- 172.21.15.19:0/2061015225 <== mon.1 v2:172.21.15.138:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7f3784038040 con 0x55f79c304df0 2024-09-10T22:31:44.601 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:44.546+0000 7f37a324f740 10 client.25882 fetch_fsmap finished waiting for FSMap version 27 2024-09-10T22:31:44.601 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:44.546+0000 7f37a324f740 10 client.25882 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-10T22:31:44.601 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:44.546+0000 7f37a324f740 20 client.25882 populate_metadata read hostname 'smithi019' 2024-09-10T22:31:44.602 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:44.546+0000 7f37a324f740 1 --2- 172.21.15.19:0/2061015225 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x55f79c38e050 0x55f79c390470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:31:44.602 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:44.546+0000 7f37a324f740 4 client.25882 mds_command: new command op to 24581 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-10T22:31:44.602 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:44.546+0000 7f37a324f740 1 -- 172.21.15.19:0/2061015225 --> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55f79c2788a0 con 0x55f79c38e050 2024-09-10T22:31:44.602 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:44.546+0000 7f379a59c640 1 --2- 172.21.15.19:0/2061015225 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x55f79c38e050 0x55f79c390470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:31:44.602 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:44.547+0000 7f3781ffb640 10 client.25882 ms_handle_connect on v2:172.21.15.135:6838/1254769802 2024-09-10T22:31:44.602 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:44.547+0000 7f379a59c640 1 --2- 172.21.15.19:0/2061015225 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x55f79c38e050 0x55f79c390470 crc :-1 s=READY pgs=121 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b629a26a76283a54 server_cookie=7891c429f185f60f in_seq=0 out_seq=0 2024-09-10T22:31:44.602 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:44.547+0000 7f3781ffb640 1 -- 172.21.15.19:0/2061015225 <== mds.0 v2:172.21.15.135:6838/1254769802 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55f79c2788a0 con 0x55f79c38e050 2024-09-10T22:31:44.602 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:44.547+0000 7f3781ffb640 10 client.25882 handle_command_reply: tid=0 2024-09-10T22:31:44.603 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:44.547+0000 7f37a324f740 1 client.25882 shutdown 2024-09-10T22:31:44.603 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:44.547+0000 7f37a324f740 1 -- 172.21.15.19:0/2061015225 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55f79c304df0 msgr2=0x55f79c3223d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:31:44.603 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:44.547+0000 7f37a324f740 1 --2- 172.21.15.19:0/2061015225 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55f79c304df0 0x55f79c3223d0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f3784004a30 tx=0x7f3784009a40 comp rx=0 tx=0).stop 2024-09-10T22:31:44.603 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:44.547+0000 7f37a324f740 1 -- 172.21.15.19:0/2061015225 shutdown_connections 2024-09-10T22:31:44.603 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:44.547+0000 7f37a324f740 1 --2- 172.21.15.19:0/2061015225 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55f79c310d80 0x55f79c38c370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:31:44.603 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:44.547+0000 7f37a324f740 1 --2- 172.21.15.19:0/2061015225 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x55f79c38e050 0x55f79c390470 crc :-1 s=READY pgs=121 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:31:44.603 INFO:teuthology.orchestra.run.smithi019.stdout:[] 2024-09-10T22:31:44.604 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:44.547+0000 7f37a324f740 1 --2- 172.21.15.19:0/2061015225 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55f79c304df0 0x55f79c3223d0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:31:44.604 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:44.547+0000 7f37a324f740 1 --2- 172.21.15.19:0/2061015225 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f79c3044d0 0x55f79c321e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:31:44.604 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:44.547+0000 7f3781ffb640 0 client.25882 ms_handle_reset on v2:172.21.15.135:6838/1254769802 2024-09-10T22:31:44.604 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:44.547+0000 7f37a324f740 1 -- 172.21.15.19:0/2061015225 >> 172.21.15.19:0/2061015225 conn(0x55f79c302300 msgr2=0x55f79c300c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:31:44.604 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:44.548+0000 7f37a324f740 1 -- 172.21.15.19:0/2061015225 shutdown_connections 2024-09-10T22:31:44.604 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:44.548+0000 7f37a324f740 1 -- 172.21.15.19:0/2061015225 wait complete. 2024-09-10T22:31:44.604 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:44.548+0000 7f37a324f740 20 client.25882 trim_cache size 0 max 16384 2024-09-10T22:31:44.604 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:44.548+0000 7f37a0e7a640 1 -- 172.21.15.19:0/771599845 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f37880b52e0 msgr2=0x7f37880b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:31:44.604 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:44.548+0000 7f37a0e7a640 1 --2- 172.21.15.19:0/771599845 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f37880b52e0 0x7f37880b77a0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f379c10f720 tx=0x7f3784005f90 comp rx=0 tx=0).stop 2024-09-10T22:31:44.605 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:44.548+0000 7f37a0e7a640 1 -- 172.21.15.19:0/771599845 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f379c103cd0 msgr2=0x7f379c1992b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:31:44.605 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:44.548+0000 7f37a0e7a640 1 --2- 172.21.15.19:0/771599845 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f379c103cd0 0x7f379c1992b0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f378c02a930 tx=0x7f378c031a20 comp rx=0 tx=0).stop 2024-09-10T22:31:44.605 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:44.549+0000 7f37a0e7a640 1 -- 172.21.15.19:0/771599845 shutdown_connections 2024-09-10T22:31:44.605 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:44.549+0000 7f37a0e7a640 1 --2- 172.21.15.19:0/771599845 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f37880b52e0 0x7f37880b77a0 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:31:44.605 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:44.549+0000 7f37a0e7a640 1 --2- 172.21.15.19:0/771599845 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f379c10d130 0x7f379c19eb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:31:44.605 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:44.549+0000 7f37a0e7a640 1 --2- 172.21.15.19:0/771599845 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f379c1045f0 0x7f379c1997f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:31:44.605 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:44.549+0000 7f37a0e7a640 1 --2- 172.21.15.19:0/771599845 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f379c103cd0 0x7f379c1992b0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:31:44.605 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:44.549+0000 7f37a0e7a640 1 -- 172.21.15.19:0/771599845 >> 172.21.15.19:0/771599845 conn(0x7f379c0fd770 msgr2=0x7f379c0fe410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:31:44.605 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:44.549+0000 7f37a0e7a640 1 -- 172.21.15.19:0/771599845 shutdown_connections 2024-09-10T22:31:44.605 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:44.549+0000 7f37a0e7a640 1 -- 172.21.15.19:0/771599845 wait complete. 2024-09-10T22:31:46.360 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:31:45 smithi135 ceph-mon[34789]: pgmap v507: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 680 KiB/s rd, 317 MiB/s wr, 258 op/s 2024-09-10T22:31:46.375 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:31:46 smithi138 ceph-mon[35236]: pgmap v507: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 680 KiB/s rd, 317 MiB/s wr, 258 op/s 2024-09-10T22:31:46.458 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:31:45 smithi019 ceph-mon[31375]: pgmap v507: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 680 KiB/s rd, 317 MiB/s wr, 258 op/s 2024-09-10T22:31:46.729 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-10T22:31:46.729 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 22997a4c-6fc2-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-10T22:31:47.079 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/22997a4c-6fc2-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T22:31:48.061 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:48.049+0000 7fc2fd59c640 1 -- 172.21.15.19:0/624674281 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc2f81087d0 msgr2=0x7fc2f8108c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:31:48.061 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:48.049+0000 7fc2fd59c640 1 --2- 172.21.15.19:0/624674281 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc2f81087d0 0x7fc2f8108c10 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7fc2ec009900 tx=0x7fc2ec02a410 comp rx=0 tx=0).stop 2024-09-10T22:31:48.061 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:48.049+0000 7fc2fd59c640 1 -- 172.21.15.19:0/624674281 shutdown_connections 2024-09-10T22:31:48.061 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:48.049+0000 7fc2fd59c640 1 --2- 172.21.15.19:0/624674281 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc2f8109150 0x7fc2f810f950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:31:48.061 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:48.049+0000 7fc2fd59c640 1 --2- 172.21.15.19:0/624674281 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc2f81087d0 0x7fc2f8108c10 unknown :-1 s=CLOSED pgs=633 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:31:48.061 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:48.049+0000 7fc2fd59c640 1 --2- 172.21.15.19:0/624674281 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc2f8102dc0 0x7fc2f81031a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:31:48.062 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:48.049+0000 7fc2fd59c640 1 -- 172.21.15.19:0/624674281 >> 172.21.15.19:0/624674281 conn(0x7fc2f80fe830 msgr2=0x7fc2f8100c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:31:48.062 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:48.049+0000 7fc2fd59c640 1 -- 172.21.15.19:0/624674281 shutdown_connections 2024-09-10T22:31:48.062 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:48.049+0000 7fc2fd59c640 1 -- 172.21.15.19:0/624674281 wait complete. 2024-09-10T22:31:48.062 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:48.050+0000 7fc2fd59c640 1 Processor -- start 2024-09-10T22:31:48.062 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:48.050+0000 7fc2fd59c640 1 -- start start 2024-09-10T22:31:48.062 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:48.050+0000 7fc2fd59c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc2f8102dc0 0x7fc2f81994a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:31:48.062 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:48.050+0000 7fc2fd59c640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc2f81087d0 0x7fc2f81999e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:31:48.062 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:48.050+0000 7fc2fd59c640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc2f8109150 0x7fc2f819ed80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:31:48.062 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:48.051+0000 7fc2fd59c640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fc2f8112e70 con 0x7fc2f8102dc0 2024-09-10T22:31:48.062 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:48.051+0000 7fc2fd59c640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fc2f8112cf0 con 0x7fc2f81087d0 2024-09-10T22:31:48.062 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:48.051+0000 7fc2fd59c640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7fc2f8112ff0 con 0x7fc2f8109150 2024-09-10T22:31:48.062 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:48.051+0000 7fc2f6ffd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc2f8102dc0 0x7fc2f81994a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:31:48.063 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:48.051+0000 7fc2f6ffd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc2f8102dc0 0x7fc2f81994a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:38240/0 (socket says 172.21.15.19:38240) 2024-09-10T22:31:48.063 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:48.051+0000 7fc2f6ffd640 1 -- 172.21.15.19:0/423322839 learned_addr learned my addr 172.21.15.19:0/423322839 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:31:48.063 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:48.051+0000 7fc2f77fe640 1 --2- 172.21.15.19:0/423322839 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc2f8109150 0x7fc2f819ed80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:31:48.063 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:48.051+0000 7fc2f6ffd640 1 -- 172.21.15.19:0/423322839 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc2f8109150 msgr2=0x7fc2f819ed80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:31:48.063 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:48.051+0000 7fc2f6ffd640 1 --2- 172.21.15.19:0/423322839 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc2f8109150 0x7fc2f819ed80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:31:48.063 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:48.051+0000 7fc2f6ffd640 1 -- 172.21.15.19:0/423322839 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc2f81087d0 msgr2=0x7fc2f81999e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:31:48.063 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:48.051+0000 7fc2f6ffd640 1 --2- 172.21.15.19:0/423322839 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc2f81087d0 0x7fc2f81999e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:31:48.063 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:48.051+0000 7fc2f6ffd640 1 -- 172.21.15.19:0/423322839 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc2f819f550 con 0x7fc2f8102dc0 2024-09-10T22:31:48.063 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:48.052+0000 7fc2f6ffd640 1 --2- 172.21.15.19:0/423322839 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc2f8102dc0 0x7fc2f81994a0 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7fc2e800b4a0 tx=0x7fc2e800b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:31:48.063 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:48.052+0000 7fc2dffff640 1 -- 172.21.15.19:0/423322839 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2e8014070 con 0x7fc2f8102dc0 2024-09-10T22:31:48.063 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:48.052+0000 7fc2fd59c640 1 -- 172.21.15.19:0/423322839 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc2f819f840 con 0x7fc2f8102dc0 2024-09-10T22:31:48.063 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:48.052+0000 7fc2fd59c640 1 -- 172.21.15.19:0/423322839 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc2f8075550 con 0x7fc2f8102dc0 2024-09-10T22:31:48.064 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:48.052+0000 7fc2dffff640 1 -- 172.21.15.19:0/423322839 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc2e8010ac0 con 0x7fc2f8102dc0 2024-09-10T22:31:48.064 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:48.052+0000 7fc2dffff640 1 -- 172.21.15.19:0/423322839 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2e8017c30 con 0x7fc2f8102dc0 2024-09-10T22:31:48.066 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:48.058+0000 7fc2dffff640 1 -- 172.21.15.19:0/423322839 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 18) ==== 153250+0+0 (secure 0 0 0) 0x7fc2e8019450 con 0x7fc2f8102dc0 2024-09-10T22:31:48.066 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:48.060+0000 7fc2dffff640 1 --2- 172.21.15.19:0/423322839 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7fc2e00b5360 0x7fc2e00b7820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:31:48.066 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:48.060+0000 7fc2dffff640 1 -- 172.21.15.19:0/423322839 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8327+0+0 (secure 0 0 0) 0x7fc2e80e5730 con 0x7fc2f8102dc0 2024-09-10T22:31:48.066 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:48.061+0000 7fc2ff971740 1 Processor -- start 2024-09-10T22:31:48.066 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:48.061+0000 7fc2ff971740 1 -- start start 2024-09-10T22:31:48.066 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:48.061+0000 7fc2f67fc640 1 --2- 172.21.15.19:0/423322839 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7fc2e00b5360 0x7fc2e00b7820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:31:48.066 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:48.061+0000 7fc2ff971740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5616272caee0 0x5616272cb2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:31:48.066 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:48.061+0000 7fc2ff971740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5616272cb800 0x5616272d7250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:31:48.066 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:48.061+0000 7fc2ff971740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5616272d7790 0x5616272d9b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:31:48.066 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:48.061+0000 7fc2ff971740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x561627241e60 con 0x5616272cb800 2024-09-10T22:31:48.067 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:48.061+0000 7fc2ff971740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x561627231290 con 0x5616272caee0 2024-09-10T22:31:48.067 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:48.061+0000 7fc2ff971740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x5616272350a0 con 0x5616272d7790 2024-09-10T22:31:48.067 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:48.062+0000 7fc2f67fc640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5616272cb800 0x5616272d7250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:31:48.067 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:48.062+0000 7fc2f67fc640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5616272cb800 0x5616272d7250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:38244/0 (socket says 172.21.15.19:38244) 2024-09-10T22:31:48.067 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:48.062+0000 7fc2f67fc640 1 -- 172.21.15.19:0/2050339326 learned_addr learned my addr 172.21.15.19:0/2050339326 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:31:48.067 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:48.062+0000 7fc2f67fc640 1 --2- 172.21.15.19:0/423322839 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7fc2e00b5360 0x7fc2e00b7820 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7fc2ec0096c0 tx=0x7fc2ec000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:31:48.067 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:48.063+0000 7fc2f77fe640 1 --2- 172.21.15.19:0/2050339326 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5616272d7790 0x5616272d9b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:31:48.067 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:48.063+0000 7fc2f6ffd640 1 --2- 172.21.15.19:0/2050339326 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5616272caee0 0x5616272cb2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:31:48.067 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:48.063+0000 7fc2f67fc640 1 -- 172.21.15.19:0/2050339326 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5616272d7790 msgr2=0x5616272d9b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:31:48.067 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:48.063+0000 7fc2f67fc640 1 --2- 172.21.15.19:0/2050339326 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5616272d7790 0x5616272d9b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:31:48.067 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:48.063+0000 7fc2f67fc640 1 -- 172.21.15.19:0/2050339326 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5616272caee0 msgr2=0x5616272cb2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:31:48.067 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:48.063+0000 7fc2f67fc640 1 --2- 172.21.15.19:0/2050339326 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5616272caee0 0x5616272cb2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:31:48.068 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:48.063+0000 7fc2f67fc640 1 -- 172.21.15.19:0/2050339326 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561626f8f930 con 0x5616272cb800 2024-09-10T22:31:48.068 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:48.063+0000 7fc2f6ffd640 1 --2- 172.21.15.19:0/2050339326 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5616272caee0 0x5616272cb2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T22:31:48.069 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:48.064+0000 7fc2f67fc640 1 --2- 172.21.15.19:0/2050339326 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5616272cb800 0x5616272d7250 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7fc2ec0315e0 tx=0x7fc2ec042000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dd6f62dd01cd1e82 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:31:48.069 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:48.064+0000 7fc2dd7fa640 1 -- 172.21.15.19:0/2050339326 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2ec043070 con 0x5616272cb800 2024-09-10T22:31:48.069 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:48.064+0000 7fc2dd7fa640 1 -- 172.21.15.19:0/2050339326 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc2ec04c070 con 0x5616272cb800 2024-09-10T22:31:48.069 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:48.065+0000 7fc2ff971740 1 -- 172.21.15.19:0/2050339326 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5616272cb800 msgr2=0x5616272d7250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:31:48.069 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:48.065+0000 7fc2dd7fa640 1 -- 172.21.15.19:0/2050339326 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2ec043070 con 0x5616272cb800 2024-09-10T22:31:48.069 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:48.065+0000 7fc2ff971740 1 --2- 172.21.15.19:0/2050339326 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5616272cb800 0x5616272d7250 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7fc2ec0315e0 tx=0x7fc2ec042000 comp rx=0 tx=0).stop 2024-09-10T22:31:48.069 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:48.065+0000 7fc2ff971740 1 -- 172.21.15.19:0/2050339326 shutdown_connections 2024-09-10T22:31:48.070 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:48.065+0000 7fc2ff971740 1 --2- 172.21.15.19:0/2050339326 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5616272d7790 0x5616272d9b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:31:48.070 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:48.066+0000 7fc2ff971740 1 --2- 172.21.15.19:0/2050339326 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5616272cb800 0x5616272d7250 unknown :-1 s=CLOSED pgs=635 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:31:48.070 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:48.066+0000 7fc2ff971740 1 --2- 172.21.15.19:0/2050339326 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5616272caee0 0x5616272cb2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:31:48.070 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:48.066+0000 7fc2ff971740 1 -- 172.21.15.19:0/2050339326 >> 172.21.15.19:0/2050339326 conn(0x5616272c8d10 msgr2=0x5616272c9eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:31:48.070 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:48.066+0000 7fc2ff971740 1 -- 172.21.15.19:0/2050339326 shutdown_connections 2024-09-10T22:31:48.070 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:48.066+0000 7fc2ff971740 1 -- 172.21.15.19:0/2050339326 wait complete. 2024-09-10T22:31:48.071 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:48.067+0000 7fc2ff971740 1 -- start start 2024-09-10T22:31:48.071 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:48.067+0000 7fc2ff971740 1 Processor -- start 2024-09-10T22:31:48.072 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:48.068+0000 7fc2ff971740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5616272caee0 0x5616272d7240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:31:48.072 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:48.068+0000 7fc2ff971740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5616272cb800 0x5616272d46d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:31:48.072 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:48.068+0000 7fc2ff971740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5616272d7790 0x5616272d4e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:31:48.072 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:48.068+0000 7fc2ff971740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x561627092890 con 0x5616272cb800 2024-09-10T22:31:48.072 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:48.068+0000 7fc2ff971740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x5616271cbd40 con 0x5616272d7790 2024-09-10T22:31:48.072 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:48.069+0000 7fc2ff971740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x5616272da430 con 0x5616272caee0 2024-09-10T22:31:48.072 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:48.069+0000 7fc2ff971740 10 client.0 _ll_register_callbacks cb 0x56162722fc80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T22:31:48.072 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:48.069+0000 7fc2f6ffd640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5616272caee0 0x5616272d7240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:31:48.074 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:48.069+0000 7fc2f77fe640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5616272d7790 0x5616272d4e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:31:48.074 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:48.069+0000 7fc2f77fe640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5616272d7790 0x5616272d4e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.19:60144/0 (socket says 172.21.15.19:60144) 2024-09-10T22:31:48.074 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:48.069+0000 7fc2f77fe640 1 -- 172.21.15.19:0/3350083752 learned_addr learned my addr 172.21.15.19:0/3350083752 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:31:48.074 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:48.069+0000 7fc2f67fc640 1 --2- 172.21.15.19:0/3350083752 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5616272cb800 0x5616272d46d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:31:48.074 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:48.070+0000 7fc2f67fc640 1 -- 172.21.15.19:0/3350083752 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5616272caee0 msgr2=0x5616272d7240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:31:48.074 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:48.070+0000 7fc2f67fc640 1 --2- 172.21.15.19:0/3350083752 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5616272caee0 0x5616272d7240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:31:48.074 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:48.070+0000 7fc2f67fc640 1 -- 172.21.15.19:0/3350083752 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5616272d7790 msgr2=0x5616272d4e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:31:48.075 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:48.070+0000 7fc2f67fc640 1 --2- 172.21.15.19:0/3350083752 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5616272d7790 0x5616272d4e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:31:48.075 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:48.070+0000 7fc2f67fc640 1 -- 172.21.15.19:0/3350083752 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5616272e37b0 con 0x5616272cb800 2024-09-10T22:31:48.075 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:48.070+0000 7fc2f67fc640 1 --2- 172.21.15.19:0/3350083752 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5616272cb800 0x5616272d46d0 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x5616272ce060 tx=0x7fc2ec005d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=957b1f38369354b5 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:31:48.075 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:48.070+0000 7fc2daff5640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-10T22:31:48.075 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:48.071+0000 7fc2daff5640 1 -- 172.21.15.19:0/3350083752 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2ec035040 con 0x5616272cb800 2024-09-10T22:31:48.075 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:48.071+0000 7fc2ff971740 1 -- 172.21.15.19:0/3350083752 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc2ec04c070 con 0x5616272cb800 2024-09-10T22:31:48.075 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:48.071+0000 7fc2daff5640 1 -- 172.21.15.19:0/3350083752 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8327+0+0 (secure 0 0 0) 0x7fc2ec003f80 con 0x5616272cb800 2024-09-10T22:31:48.075 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:48.071+0000 7fc2daff5640 1 -- 172.21.15.19:0/3350083752 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fc2ec0041c0 con 0x5616272cb800 2024-09-10T22:31:48.075 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:48.071+0000 7fc2ff971740 10 client.16440 fetch_fsmap learned FSMap version 27 2024-09-10T22:31:48.075 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:48.071+0000 7fc2ff971740 1 -- 172.21.15.19:0/3350083752 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x5616272e60d0 con 0x5616272cb800 2024-09-10T22:31:48.076 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:48.072+0000 7fc2daff5640 1 -- 172.21.15.19:0/3350083752 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc2ec04c070 con 0x5616272cb800 2024-09-10T22:31:48.076 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:48.072+0000 7fc2daff5640 1 -- 172.21.15.19:0/3350083752 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7fc2ec046070 con 0x5616272cb800 2024-09-10T22:31:48.076 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:48.072+0000 7fc2ff971740 10 client.16440 fetch_fsmap finished waiting for FSMap version 27 2024-09-10T22:31:48.076 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:48.072+0000 7fc2ff971740 10 client.16440 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-10T22:31:48.076 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:48.072+0000 7fc2ff971740 20 client.16440 populate_metadata read hostname 'smithi019' 2024-09-10T22:31:48.077 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:48.072+0000 7fc2ff971740 1 --2- 172.21.15.19:0/3350083752 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x5616272e7420 0x5616272e9810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:31:48.077 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:48.072+0000 7fc2ff971740 4 client.16440 mds_command: new command op to 24581 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T22:31:48.077 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:48.073+0000 7fc2ff971740 1 -- 172.21.15.19:0/3350083752 --> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x561627243db0 con 0x5616272e7420 2024-09-10T22:31:48.077 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:48.073+0000 7fc2f6ffd640 1 --2- 172.21.15.19:0/3350083752 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x5616272e7420 0x5616272e9810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:31:48.089 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:48.087+0000 7fc2daff5640 10 client.16440 ms_handle_connect on v2:172.21.15.135:6838/1254769802 2024-09-10T22:31:48.089 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:48.087+0000 7fc2f6ffd640 1 --2- 172.21.15.19:0/3350083752 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x5616272e7420 0x5616272e9810 crc :-1 s=READY pgs=122 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=583ab71f8cb2c43 server_cookie=aa47060c10a29f52 in_seq=0 out_seq=0 2024-09-10T22:31:48.096 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:48.093+0000 7fc2daff5640 1 -- 172.21.15.19:0/3350083752 <== mds.0 v2:172.21.15.135:6838/1254769802 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x561627243db0 con 0x5616272e7420 2024-09-10T22:31:48.097 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:48.093+0000 7fc2daff5640 10 client.16440 handle_command_reply: tid=0 2024-09-10T22:31:48.097 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:48.093+0000 7fc2ff971740 1 client.16440 shutdown 2024-09-10T22:31:48.097 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:48.094+0000 7fc2ff971740 1 -- 172.21.15.19:0/3350083752 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5616272cb800 msgr2=0x5616272d46d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:31:48.097 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:48.094+0000 7fc2ff971740 1 --2- 172.21.15.19:0/3350083752 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5616272cb800 0x5616272d46d0 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x5616272ce060 tx=0x7fc2ec005d50 comp rx=0 tx=0).stop 2024-09-10T22:31:48.097 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:48.094+0000 7fc2ff971740 1 -- 172.21.15.19:0/3350083752 shutdown_connections 2024-09-10T22:31:48.097 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:48.094+0000 7fc2ff971740 1 --2- 172.21.15.19:0/3350083752 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5616272d7790 0x5616272d4e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:31:48.097 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:48.094+0000 7fc2ff971740 1 --2- 172.21.15.19:0/3350083752 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5616272cb800 0x5616272d46d0 unknown :-1 s=CLOSED pgs=636 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:31:48.097 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:48.094+0000 7fc2ff971740 1 --2- 172.21.15.19:0/3350083752 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x5616272e7420 0x5616272e9810 crc :-1 s=READY pgs=122 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:31:48.097 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:48.094+0000 7fc2ff971740 1 --2- 172.21.15.19:0/3350083752 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5616272caee0 0x5616272d7240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:31:48.097 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:48.094+0000 7fc2ff971740 1 -- 172.21.15.19:0/3350083752 >> 172.21.15.19:0/3350083752 conn(0x5616272c8d10 msgr2=0x5616272c7f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:31:48.097 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:48.094+0000 7fc2daff5640 0 client.16440 ms_handle_reset on v2:172.21.15.135:6838/1254769802 2024-09-10T22:31:48.098 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:48.094+0000 7fc2ff971740 1 -- 172.21.15.19:0/3350083752 shutdown_connections 2024-09-10T22:31:48.098 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:48.094+0000 7fc2ff971740 1 -- 172.21.15.19:0/3350083752 wait complete. 2024-09-10T22:31:48.098 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:48.095+0000 7fc2ff971740 20 client.16440 trim_cache size 0 max 16384 2024-09-10T22:31:48.125 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:48.122+0000 7fc2ff971740 1 Processor -- start 2024-09-10T22:31:48.125 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:48.122+0000 7fc2ff971740 1 -- start start 2024-09-10T22:31:48.125 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:48.122+0000 7fc2ff971740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5616272caee0 0x5616272ca270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:31:48.125 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:48.122+0000 7fc2ff971740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5616272cb800 0x5616272d3df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:31:48.126 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:48.122+0000 7fc2ff971740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5616272d7790 0x5616272d4330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:31:48.126 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:48.122+0000 7fc2ff971740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fc2f81b3170 con 0x5616272caee0 2024-09-10T22:31:48.126 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:48.122+0000 7fc2ff971740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fc2f81b0a40 con 0x5616272cb800 2024-09-10T22:31:48.126 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:48.122+0000 7fc2ff971740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7fc2f81ae890 con 0x5616272d7790 2024-09-10T22:31:48.126 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:48.122+0000 7fc2f6ffd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5616272caee0 0x5616272ca270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:31:48.126 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:48.122+0000 7fc2f6ffd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5616272caee0 0x5616272ca270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:38262/0 (socket says 172.21.15.19:38262) 2024-09-10T22:31:48.126 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:48.122+0000 7fc2f6ffd640 1 -- 172.21.15.19:0/1489401194 learned_addr learned my addr 172.21.15.19:0/1489401194 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:31:48.126 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:48.122+0000 7fc2f77fe640 1 --2- 172.21.15.19:0/1489401194 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5616272d7790 0x5616272d4330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:31:48.126 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:48.122+0000 7fc2f6ffd640 1 -- 172.21.15.19:0/1489401194 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5616272d7790 msgr2=0x5616272d4330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:31:48.126 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:48.122+0000 7fc2f6ffd640 1 --2- 172.21.15.19:0/1489401194 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5616272d7790 0x5616272d4330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:31:48.126 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:48.122+0000 7fc2f6ffd640 1 -- 172.21.15.19:0/1489401194 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5616272cb800 msgr2=0x5616272d3df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:31:48.126 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:48.122+0000 7fc2f6ffd640 1 --2- 172.21.15.19:0/1489401194 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5616272cb800 0x5616272d3df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:31:48.126 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:48.122+0000 7fc2f6ffd640 1 -- 172.21.15.19:0/1489401194 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5616272c9790 con 0x5616272caee0 2024-09-10T22:31:48.127 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:48.123+0000 7fc2f6ffd640 1 --2- 172.21.15.19:0/1489401194 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5616272caee0 0x5616272ca270 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7fc2e80a9f20 tx=0x7fc2e8017650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fac18b86865bfbba server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:31:48.127 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:48.123+0000 7fc2dcff9640 1 -- 172.21.15.19:0/1489401194 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2e801e040 con 0x5616272caee0 2024-09-10T22:31:48.127 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:48.123+0000 7fc2dcff9640 1 -- 172.21.15.19:0/1489401194 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc2e80b1790 con 0x5616272caee0 2024-09-10T22:31:48.127 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:48.123+0000 7fc2dcff9640 1 -- 172.21.15.19:0/1489401194 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2e80a8f20 con 0x5616272caee0 2024-09-10T22:31:48.129 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:48.124+0000 7fc2ff971740 1 -- 172.21.15.19:0/1489401194 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5616272caee0 msgr2=0x5616272ca270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:31:48.129 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:48.124+0000 7fc2ff971740 1 --2- 172.21.15.19:0/1489401194 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5616272caee0 0x5616272ca270 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7fc2e80a9f20 tx=0x7fc2e8017650 comp rx=0 tx=0).stop 2024-09-10T22:31:48.129 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:48.124+0000 7fc2ff971740 1 -- 172.21.15.19:0/1489401194 shutdown_connections 2024-09-10T22:31:48.129 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:48.124+0000 7fc2ff971740 1 --2- 172.21.15.19:0/1489401194 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5616272d7790 0x5616272d4330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:31:48.129 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:48.124+0000 7fc2ff971740 1 --2- 172.21.15.19:0/1489401194 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5616272cb800 0x5616272d3df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:31:48.129 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:48.124+0000 7fc2ff971740 1 --2- 172.21.15.19:0/1489401194 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5616272caee0 0x5616272ca270 unknown :-1 s=CLOSED pgs=637 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:31:48.130 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:48.124+0000 7fc2ff971740 1 -- 172.21.15.19:0/1489401194 >> 172.21.15.19:0/1489401194 conn(0x5616272c8d10 msgr2=0x5616272d64e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:31:48.130 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:48.124+0000 7fc2ff971740 1 -- 172.21.15.19:0/1489401194 shutdown_connections 2024-09-10T22:31:48.130 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:48.124+0000 7fc2ff971740 1 -- 172.21.15.19:0/1489401194 wait complete. 2024-09-10T22:31:48.130 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:48.124+0000 7fc2ff971740 1 -- start start 2024-09-10T22:31:48.130 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:48.124+0000 7fc2ff971740 1 Processor -- start 2024-09-10T22:31:48.130 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:48.125+0000 7fc2ff971740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5616272caee0 0x5616272df9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:31:48.130 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:48.125+0000 7fc2ff971740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5616272cb800 0x5616272dfee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:31:48.130 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:48.125+0000 7fc2ff971740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5616272d7790 0x5616272dc6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:31:48.130 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:48.125+0000 7fc2ff971740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fc2f81aef00 con 0x5616272d7790 2024-09-10T22:31:48.130 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:48.125+0000 7fc2ff971740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fc2f81b0370 con 0x5616272caee0 2024-09-10T22:31:48.130 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:48.125+0000 7fc2ff971740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7fc2f81af5d0 con 0x5616272cb800 2024-09-10T22:31:48.130 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:48.125+0000 7fc2ff971740 10 client.0 _ll_register_callbacks cb 0x7fc2ec031530 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T22:31:48.131 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:48.125+0000 7fc2f77fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5616272d7790 0x5616272dc6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:31:48.131 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:48.125+0000 7fc2f77fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5616272d7790 0x5616272dc6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:38276/0 (socket says 172.21.15.19:38276) 2024-09-10T22:31:48.131 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:48.125+0000 7fc2f77fe640 1 -- 172.21.15.19:0/1676755104 learned_addr learned my addr 172.21.15.19:0/1676755104 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:31:48.131 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:48.125+0000 7fc2f67fc640 1 --2- 172.21.15.19:0/1676755104 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5616272cb800 0x5616272dfee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:31:48.131 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:48.126+0000 7fc2f6ffd640 1 --2- 172.21.15.19:0/1676755104 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5616272caee0 0x5616272df9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:31:48.131 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:48.126+0000 7fc2f77fe640 1 -- 172.21.15.19:0/1676755104 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5616272cb800 msgr2=0x5616272dfee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:31:48.131 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:48.126+0000 7fc2f77fe640 1 --2- 172.21.15.19:0/1676755104 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5616272cb800 0x5616272dfee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:31:48.131 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:48.126+0000 7fc2f77fe640 1 -- 172.21.15.19:0/1676755104 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5616272caee0 msgr2=0x5616272df9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:31:48.131 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:48.126+0000 7fc2f77fe640 1 --2- 172.21.15.19:0/1676755104 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5616272caee0 0x5616272df9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:31:48.131 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:48.126+0000 7fc2f77fe640 1 -- 172.21.15.19:0/1676755104 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5616272dcf10 con 0x5616272d7790 2024-09-10T22:31:48.131 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:48.126+0000 7fc2f6ffd640 1 --2- 172.21.15.19:0/1676755104 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5616272caee0 0x5616272df9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T22:31:48.131 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:48.126+0000 7fc2f77fe640 1 --2- 172.21.15.19:0/1676755104 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5616272d7790 0x5616272dc6e0 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7fc2f000ab20 tx=0x7fc2f00071d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fa16fdba8e7f9a13 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:31:48.131 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:48.126+0000 7fc2daff5640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-10T22:31:48.132 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:48.126+0000 7fc2daff5640 1 -- 172.21.15.19:0/1676755104 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2f0007db0 con 0x5616272d7790 2024-09-10T22:31:48.132 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:48.126+0000 7fc2daff5640 1 -- 172.21.15.19:0/1676755104 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8327+0+0 (secure 0 0 0) 0x7fc2f0017430 con 0x5616272d7790 2024-09-10T22:31:48.132 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:48.126+0000 7fc2ff971740 1 -- 172.21.15.19:0/1676755104 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc2e80b1790 con 0x5616272d7790 2024-09-10T22:31:48.132 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:48.127+0000 7fc2daff5640 1 -- 172.21.15.19:0/1676755104 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fc2f0017630 con 0x5616272d7790 2024-09-10T22:31:48.132 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:48.127+0000 7fc2ff971740 10 client.16446 fetch_fsmap learned FSMap version 27 2024-09-10T22:31:48.132 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:48.127+0000 7fc2ff971740 1 -- 172.21.15.19:0/1676755104 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x561627354bd0 con 0x5616272d7790 2024-09-10T22:31:48.133 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:48.127+0000 7fc2daff5640 1 -- 172.21.15.19:0/1676755104 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc2e80b1790 con 0x5616272d7790 2024-09-10T22:31:48.133 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:48.127+0000 7fc2daff5640 1 -- 172.21.15.19:0/1676755104 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7fc2f00218d0 con 0x5616272d7790 2024-09-10T22:31:48.133 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:48.127+0000 7fc2ff971740 10 client.16446 fetch_fsmap finished waiting for FSMap version 27 2024-09-10T22:31:48.133 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:48.127+0000 7fc2ff971740 10 client.16446 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-10T22:31:48.133 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:48.127+0000 7fc2ff971740 20 client.16446 populate_metadata read hostname 'smithi019' 2024-09-10T22:31:48.133 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:48.127+0000 7fc2ff971740 1 --2- 172.21.15.19:0/1676755104 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x561627355400 0x561627357820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:31:48.133 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:48.127+0000 7fc2ff971740 4 client.16446 mds_command: new command op to 24581 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-10T22:31:48.133 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:48.127+0000 7fc2ff971740 1 -- 172.21.15.19:0/1676755104 --> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x56162723f860 con 0x561627355400 2024-09-10T22:31:48.133 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:48.128+0000 7fc2f6ffd640 1 --2- 172.21.15.19:0/1676755104 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x561627355400 0x561627357820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:31:48.137 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:48.134+0000 7fc2daff5640 10 client.16446 ms_handle_connect on v2:172.21.15.135:6838/1254769802 2024-09-10T22:31:48.137 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:48.134+0000 7fc2f6ffd640 1 --2- 172.21.15.19:0/1676755104 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x561627355400 0x561627357820 crc :-1 s=READY pgs=123 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d65e55a23d1a54da server_cookie=24607f96e52f8d9d in_seq=0 out_seq=0 2024-09-10T22:31:48.146 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:48.143+0000 7fc2daff5640 1 -- 172.21.15.19:0/1676755104 <== mds.0 v2:172.21.15.135:6838/1254769802 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x56162723f860 con 0x561627355400 2024-09-10T22:31:48.146 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:48.143+0000 7fc2daff5640 10 client.16446 handle_command_reply: tid=0 2024-09-10T22:31:48.146 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:48.143+0000 7fc2ff971740 1 client.16446 shutdown 2024-09-10T22:31:48.146 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:48.143+0000 7fc2ff971740 1 -- 172.21.15.19:0/1676755104 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5616272d7790 msgr2=0x5616272dc6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:31:48.147 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:48.143+0000 7fc2ff971740 1 --2- 172.21.15.19:0/1676755104 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5616272d7790 0x5616272dc6e0 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7fc2f000ab20 tx=0x7fc2f00071d0 comp rx=0 tx=0).stop 2024-09-10T22:31:48.147 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:48.143+0000 7fc2ff971740 1 -- 172.21.15.19:0/1676755104 shutdown_connections 2024-09-10T22:31:48.147 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:48.143+0000 7fc2ff971740 1 --2- 172.21.15.19:0/1676755104 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5616272d7790 0x5616272dc6e0 unknown :-1 s=CLOSED pgs=638 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:31:48.147 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:48.143+0000 7fc2ff971740 1 --2- 172.21.15.19:0/1676755104 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x561627355400 0x561627357820 crc :-1 s=READY pgs=123 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:31:48.147 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:48.143+0000 7fc2ff971740 1 --2- 172.21.15.19:0/1676755104 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5616272cb800 0x5616272dfee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:31:48.147 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:48.143+0000 7fc2ff971740 1 --2- 172.21.15.19:0/1676755104 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5616272caee0 0x5616272df9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:31:48.147 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:48.143+0000 7fc2ff971740 1 -- 172.21.15.19:0/1676755104 >> 172.21.15.19:0/1676755104 conn(0x5616272c8d10 msgr2=0x5616272e2ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:31:48.147 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:48.143+0000 7fc2daff5640 0 client.16446 ms_handle_reset on v2:172.21.15.135:6838/1254769802 2024-09-10T22:31:48.147 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:48.143+0000 7fc2ff971740 1 -- 172.21.15.19:0/1676755104 shutdown_connections 2024-09-10T22:31:48.147 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:48.143+0000 7fc2ff971740 1 -- 172.21.15.19:0/1676755104 wait complete. 2024-09-10T22:31:48.147 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:48.143+0000 7fc2ff971740 20 client.16446 trim_cache size 0 max 16384 2024-09-10T22:31:48.148 INFO:teuthology.orchestra.run.smithi019.stdout:{ 2024-09-10T22:31:48.148 INFO:teuthology.orchestra.run.smithi019.stdout: "return_code": 0, 2024-09-10T22:31:48.148 INFO:teuthology.orchestra.run.smithi019.stdout: "scrub_tag": "0b81ea61-0b8e-4f2c-a58f-ef1019289fc9", 2024-09-10T22:31:48.148 INFO:teuthology.orchestra.run.smithi019.stdout: "mode": "asynchronous" 2024-09-10T22:31:48.148 INFO:teuthology.orchestra.run.smithi019.stdout:} 2024-09-10T22:31:48.149 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:48.144+0000 7fc2fd59c640 1 -- 172.21.15.19:0/423322839 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7fc2e00b5360 msgr2=0x7fc2e00b7820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:31:48.149 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:48.144+0000 7fc2fd59c640 1 --2- 172.21.15.19:0/423322839 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7fc2e00b5360 0x7fc2e00b7820 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7fc2ec0096c0 tx=0x7fc2ec000bc0 comp rx=0 tx=0).stop 2024-09-10T22:31:48.149 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:48.144+0000 7fc2fd59c640 1 -- 172.21.15.19:0/423322839 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc2f8102dc0 msgr2=0x7fc2f81994a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:31:48.149 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:48.144+0000 7fc2fd59c640 1 --2- 172.21.15.19:0/423322839 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc2f8102dc0 0x7fc2f81994a0 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7fc2e800b4a0 tx=0x7fc2e800b960 comp rx=0 tx=0).stop 2024-09-10T22:31:48.149 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:48.144+0000 7fc2fd59c640 1 -- 172.21.15.19:0/423322839 shutdown_connections 2024-09-10T22:31:48.150 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:48.144+0000 7fc2fd59c640 1 --2- 172.21.15.19:0/423322839 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7fc2e00b5360 0x7fc2e00b7820 secure :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7fc2ec0096c0 tx=0x7fc2ec000bc0 comp rx=0 tx=0).stop 2024-09-10T22:31:48.150 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:48.144+0000 7fc2fd59c640 1 --2- 172.21.15.19:0/423322839 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc2f8109150 0x7fc2f819ed80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:31:48.150 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:48.144+0000 7fc2fd59c640 1 --2- 172.21.15.19:0/423322839 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc2f81087d0 0x7fc2f81999e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:31:48.150 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:48.144+0000 7fc2fd59c640 1 --2- 172.21.15.19:0/423322839 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc2f8102dc0 0x7fc2f81994a0 unknown :-1 s=CLOSED pgs=634 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:31:48.150 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:48.144+0000 7fc2fd59c640 1 -- 172.21.15.19:0/423322839 >> 172.21.15.19:0/423322839 conn(0x7fc2f80fe830 msgr2=0x7fc2f8100c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:31:48.150 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:48.144+0000 7fc2fd59c640 1 -- 172.21.15.19:0/423322839 shutdown_connections 2024-09-10T22:31:48.150 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:48.144+0000 7fc2fd59c640 1 -- 172.21.15.19:0/423322839 wait complete. 2024-09-10T22:31:48.158 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:31:48 smithi019 ceph-mon[31375]: pgmap v508: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 911 KiB/s rd, 336 MiB/s wr, 266 op/s 2024-09-10T22:31:48.360 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:31:48 smithi135 ceph-mon[34789]: pgmap v508: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 911 KiB/s rd, 336 MiB/s wr, 266 op/s 2024-09-10T22:31:48.375 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:31:48 smithi138 ceph-mon[35236]: pgmap v508: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 911 KiB/s rd, 336 MiB/s wr, 266 op/s 2024-09-10T22:31:49.312 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:31:49 smithi019 ceph-mon[31375]: scrub queued for path: / 2024-09-10T22:31:49.312 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:31:49 smithi019 ceph-mon[31375]: scrub summary: idle+waiting paths [/] 2024-09-10T22:31:49.312 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:31:49 smithi019 ceph-mon[31375]: scrub summary: active paths [/] 2024-09-10T22:31:49.312 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:31:49 smithi019 ceph-mon[31375]: scrub summary: active paths [/] 2024-09-10T22:31:49.312 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:31:49 smithi019 ceph-mon[31375]: scrub summary: idle+waiting paths [/] 2024-09-10T22:31:49.313 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:31:49 smithi019 ceph-mon[31375]: scrub summary: idle+waiting paths [/] 2024-09-10T22:31:49.314 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 22997a4c-6fc2-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-10T22:31:49.359 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:31:49 smithi135 ceph-mon[34789]: scrub queued for path: / 2024-09-10T22:31:49.360 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:31:49 smithi135 ceph-mon[34789]: scrub summary: idle+waiting paths [/] 2024-09-10T22:31:49.360 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:31:49 smithi135 ceph-mon[34789]: scrub summary: active paths [/] 2024-09-10T22:31:49.360 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:31:49 smithi135 ceph-mon[34789]: scrub summary: active paths [/] 2024-09-10T22:31:49.360 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:31:49 smithi135 ceph-mon[34789]: scrub summary: idle+waiting paths [/] 2024-09-10T22:31:49.360 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:31:49 smithi135 ceph-mon[34789]: scrub summary: idle+waiting paths [/] 2024-09-10T22:31:49.375 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:31:49 smithi138 ceph-mon[35236]: scrub queued for path: / 2024-09-10T22:31:49.375 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:31:49 smithi138 ceph-mon[35236]: scrub summary: idle+waiting paths [/] 2024-09-10T22:31:49.375 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:31:49 smithi138 ceph-mon[35236]: scrub summary: active paths [/] 2024-09-10T22:31:49.375 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:31:49 smithi138 ceph-mon[35236]: scrub summary: active paths [/] 2024-09-10T22:31:49.375 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:31:49 smithi138 ceph-mon[35236]: scrub summary: idle+waiting paths [/] 2024-09-10T22:31:49.375 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:31:49 smithi138 ceph-mon[35236]: scrub summary: idle+waiting paths [/] 2024-09-10T22:31:49.587 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/22997a4c-6fc2-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T22:31:50.360 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:31:50 smithi135 ceph-mon[34789]: pgmap v509: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 466 KiB/s rd, 292 MiB/s wr, 225 op/s 2024-09-10T22:31:50.375 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:31:50 smithi138 ceph-mon[35236]: pgmap v509: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 466 KiB/s rd, 292 MiB/s wr, 225 op/s 2024-09-10T22:31:50.379 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:31:50 smithi019 ceph-mon[31375]: pgmap v509: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 466 KiB/s rd, 292 MiB/s wr, 225 op/s 2024-09-10T22:31:50.573 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:50.500+0000 7f5e58756640 1 -- 172.21.15.19:0/2353668981 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5e5010f3d0 msgr2=0x7f5e501117c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:31:50.573 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:50.500+0000 7f5e58756640 1 --2- 172.21.15.19:0/2353668981 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5e5010f3d0 0x7f5e501117c0 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7f5e48009ca0 tx=0x7f5e4802a8c0 comp rx=0 tx=0).stop 2024-09-10T22:31:50.573 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:50.501+0000 7f5e58756640 1 -- 172.21.15.19:0/2353668981 shutdown_connections 2024-09-10T22:31:50.573 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:50.501+0000 7f5e58756640 1 --2- 172.21.15.19:0/2353668981 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5e5010f3d0 0x7f5e501117c0 unknown :-1 s=CLOSED pgs=639 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:31:50.573 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:50.501+0000 7f5e58756640 1 --2- 172.21.15.19:0/2353668981 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5e50075e00 0x7f5e5010ee90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:31:50.573 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:50.501+0000 7f5e58756640 1 --2- 172.21.15.19:0/2353668981 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5e500754e0 0x7f5e500758c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:31:50.573 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:50.501+0000 7f5e58756640 1 -- 172.21.15.19:0/2353668981 >> 172.21.15.19:0/2353668981 conn(0x7f5e500fe830 msgr2=0x7f5e50100c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:31:50.573 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:50.501+0000 7f5e58756640 1 -- 172.21.15.19:0/2353668981 shutdown_connections 2024-09-10T22:31:50.574 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:50.501+0000 7f5e58756640 1 -- 172.21.15.19:0/2353668981 wait complete. 2024-09-10T22:31:50.574 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:50.501+0000 7f5e58756640 1 Processor -- start 2024-09-10T22:31:50.574 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:50.501+0000 7f5e58756640 1 -- start start 2024-09-10T22:31:50.574 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:50.502+0000 7f5e58756640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5e500754e0 0x7f5e5019b480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:31:50.574 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:50.502+0000 7f5e58756640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5e50075e00 0x7f5e5019b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:31:50.574 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:50.502+0000 7f5e58756640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5e5010f3d0 0x7f5e501a0d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:31:50.574 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:50.502+0000 7f5e58756640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f5e50114fd0 con 0x7f5e500754e0 2024-09-10T22:31:50.574 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:50.502+0000 7f5e58756640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f5e50114e50 con 0x7f5e5010f3d0 2024-09-10T22:31:50.574 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:50.502+0000 7f5e58756640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f5e50115150 con 0x7f5e50075e00 2024-09-10T22:31:50.574 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:50.502+0000 7f5e564f2640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5e500754e0 0x7f5e5019b480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:31:50.574 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:50.502+0000 7f5e564f2640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5e500754e0 0x7f5e5019b480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:38296/0 (socket says 172.21.15.19:38296) 2024-09-10T22:31:50.575 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:50.502+0000 7f5e564f2640 1 -- 172.21.15.19:0/2559335997 learned_addr learned my addr 172.21.15.19:0/2559335997 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:31:50.575 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:50.502+0000 7f5e55cf1640 1 --2- 172.21.15.19:0/2559335997 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5e50075e00 0x7f5e5019b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:31:50.575 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:50.502+0000 7f5e56cf3640 1 --2- 172.21.15.19:0/2559335997 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5e5010f3d0 0x7f5e501a0d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:31:50.575 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:50.502+0000 7f5e55cf1640 1 -- 172.21.15.19:0/2559335997 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5e5010f3d0 msgr2=0x7f5e501a0d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:31:50.575 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:50.502+0000 7f5e55cf1640 1 --2- 172.21.15.19:0/2559335997 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5e5010f3d0 0x7f5e501a0d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:31:50.575 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:50.502+0000 7f5e55cf1640 1 -- 172.21.15.19:0/2559335997 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5e500754e0 msgr2=0x7f5e5019b480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:31:50.575 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:50.502+0000 7f5e55cf1640 1 --2- 172.21.15.19:0/2559335997 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5e500754e0 0x7f5e5019b480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:31:50.575 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:50.502+0000 7f5e55cf1640 1 -- 172.21.15.19:0/2559335997 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5e501a1530 con 0x7f5e50075e00 2024-09-10T22:31:50.575 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:50.502+0000 7f5e564f2640 1 --2- 172.21.15.19:0/2559335997 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5e500754e0 0x7f5e5019b480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T22:31:50.575 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:50.502+0000 7f5e55cf1640 1 --2- 172.21.15.19:0/2559335997 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5e50075e00 0x7f5e5019b9c0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f5e4000e9f0 tx=0x7f5e4000eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:31:50.575 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:50.503+0000 7f5e477fe640 1 -- 172.21.15.19:0/2559335997 <== mon.1 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e4000cd80 con 0x7f5e50075e00 2024-09-10T22:31:50.575 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:50.503+0000 7f5e477fe640 1 -- 172.21.15.19:0/2559335997 <== mon.1 v2:172.21.15.138:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5e400035f0 con 0x7f5e50075e00 2024-09-10T22:31:50.575 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:50.503+0000 7f5e58756640 1 -- 172.21.15.19:0/2559335997 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5e501a1820 con 0x7f5e50075e00 2024-09-10T22:31:50.576 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:50.503+0000 7f5e477fe640 1 -- 172.21.15.19:0/2559335997 <== mon.1 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e40010670 con 0x7f5e50075e00 2024-09-10T22:31:50.576 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:50.503+0000 7f5e58756640 1 -- 172.21.15.19:0/2559335997 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5e501a7ee0 con 0x7f5e50075e00 2024-09-10T22:31:50.576 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:50.505+0000 7f5e477fe640 1 -- 172.21.15.19:0/2559335997 <== mon.1 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 18) ==== 153250+0+0 (secure 0 0 0) 0x7f5e40004000 con 0x7f5e50075e00 2024-09-10T22:31:50.576 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:50.506+0000 7f5e5ab2b740 1 Processor -- start 2024-09-10T22:31:50.576 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:50.506+0000 7f5e5ab2b740 1 -- start start 2024-09-10T22:31:50.576 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:50.506+0000 7f5e5ab2b740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5613ad588480 0x5613ad588860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:31:50.576 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:50.506+0000 7f5e5ab2b740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5613ad588da0 0x5613ad5947f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:31:50.576 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:50.506+0000 7f5e5ab2b740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5613ad594d30 0x5613ad597120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:31:50.576 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:50.506+0000 7f5e5ab2b740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x5613ad4fee50 con 0x5613ad588480 2024-09-10T22:31:50.576 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:50.506+0000 7f5e5ab2b740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x5613ad4ee280 con 0x5613ad588da0 2024-09-10T22:31:50.576 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:50.506+0000 7f5e5ab2b740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x5613ad4f2090 con 0x5613ad594d30 2024-09-10T22:31:50.576 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:50.506+0000 7f5e477fe640 1 --2- 172.21.15.19:0/2559335997 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f5e3c0b52e0 0x7f5e3c0b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:31:50.576 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:50.506+0000 7f5e56cf3640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5613ad588480 0x5613ad588860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:31:50.577 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:50.507+0000 7f5e56cf3640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5613ad588480 0x5613ad588860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:38306/0 (socket says 172.21.15.19:38306) 2024-09-10T22:31:50.577 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:50.507+0000 7f5e564f2640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5613ad588da0 0x5613ad5947f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:31:50.577 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:50.507+0000 7f5e56cf3640 1 -- 172.21.15.19:0/2671234041 learned_addr learned my addr 172.21.15.19:0/2671234041 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:31:50.577 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:50.507+0000 7f5e564f2640 1 -- 172.21.15.19:0/2671234041 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5613ad594d30 msgr2=0x5613ad597120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:31:50.577 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:50.507+0000 7f5e564f2640 1 --2- 172.21.15.19:0/2671234041 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5613ad594d30 0x5613ad597120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:31:50.577 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:50.507+0000 7f5e564f2640 1 -- 172.21.15.19:0/2671234041 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5613ad588480 msgr2=0x5613ad588860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:31:50.577 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:50.507+0000 7f5e477fe640 1 -- 172.21.15.19:0/2559335997 <== mon.1 v2:172.21.15.138:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8327+0+0 (secure 0 0 0) 0x7f5e400e5fa0 con 0x7f5e50075e00 2024-09-10T22:31:50.577 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:50.507+0000 7f5e564f2640 1 --2- 172.21.15.19:0/2671234041 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5613ad588480 0x5613ad588860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:31:50.577 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:50.507+0000 7f5e564f2640 1 -- 172.21.15.19:0/2671234041 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5613ad24c650 con 0x5613ad588da0 2024-09-10T22:31:50.577 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:50.507+0000 7f5e564f2640 1 --2- 172.21.15.19:0/2671234041 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5613ad588da0 0x5613ad5947f0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f5e4c011510 tx=0x7f5e4c0119d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4e719efc5134818d server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:31:50.577 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:50.507+0000 7f5e56cf3640 1 --2- 172.21.15.19:0/2559335997 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f5e3c0b52e0 0x7f5e3c0b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:31:50.577 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:50.507+0000 7f5e44ff9640 1 -- 172.21.15.19:0/2671234041 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e4c005020 con 0x5613ad588da0 2024-09-10T22:31:50.578 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:50.508+0000 7f5e44ff9640 1 -- 172.21.15.19:0/2671234041 <== mon.2 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5e4c0047a0 con 0x5613ad588da0 2024-09-10T22:31:50.578 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:50.508+0000 7f5e44ff9640 1 -- 172.21.15.19:0/2671234041 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e4c00f8e0 con 0x5613ad588da0 2024-09-10T22:31:50.578 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:50.508+0000 7f5e5ab2b740 1 -- 172.21.15.19:0/2671234041 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5613ad588da0 msgr2=0x5613ad5947f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:31:50.578 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:50.508+0000 7f5e56cf3640 1 --2- 172.21.15.19:0/2559335997 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f5e3c0b52e0 0x7f5e3c0b77a0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f5e48009430 tx=0x7f5e480095c0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:31:50.578 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:50.508+0000 7f5e5ab2b740 1 --2- 172.21.15.19:0/2671234041 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5613ad588da0 0x5613ad5947f0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f5e4c011510 tx=0x7f5e4c0119d0 comp rx=0 tx=0).stop 2024-09-10T22:31:50.578 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:50.509+0000 7f5e5ab2b740 1 -- 172.21.15.19:0/2671234041 shutdown_connections 2024-09-10T22:31:50.578 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:50.509+0000 7f5e5ab2b740 1 --2- 172.21.15.19:0/2671234041 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5613ad594d30 0x5613ad597120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:31:50.578 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:50.509+0000 7f5e5ab2b740 1 --2- 172.21.15.19:0/2671234041 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5613ad588da0 0x5613ad5947f0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:31:50.578 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:50.509+0000 7f5e5ab2b740 1 --2- 172.21.15.19:0/2671234041 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5613ad588480 0x5613ad588860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:31:50.578 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:50.509+0000 7f5e5ab2b740 1 -- 172.21.15.19:0/2671234041 >> 172.21.15.19:0/2671234041 conn(0x5613ad5862b0 msgr2=0x5613ad587450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:31:50.578 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:50.509+0000 7f5e5ab2b740 1 -- 172.21.15.19:0/2671234041 shutdown_connections 2024-09-10T22:31:50.578 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:50.509+0000 7f5e5ab2b740 1 -- 172.21.15.19:0/2671234041 wait complete. 2024-09-10T22:31:50.578 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:50.509+0000 7f5e5ab2b740 1 -- start start 2024-09-10T22:31:50.578 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:50.509+0000 7f5e5ab2b740 1 Processor -- start 2024-09-10T22:31:50.579 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:50.510+0000 7f5e5ab2b740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5613ad588480 0x5613ad594660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:31:50.579 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:50.510+0000 7f5e5ab2b740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5613ad588da0 0x5613ad591ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:31:50.579 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:50.510+0000 7f5e564f2640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5613ad588480 0x5613ad594660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:31:50.579 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:50.510+0000 7f5e564f2640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5613ad588480 0x5613ad594660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.19:48962/0 (socket says 172.21.15.19:48962) 2024-09-10T22:31:50.579 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:50.510+0000 7f5e55cf1640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5613ad588da0 0x5613ad591ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:31:50.579 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:50.510+0000 7f5e55cf1640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5613ad588da0 0x5613ad591ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:38312/0 (socket says 172.21.15.19:38312) 2024-09-10T22:31:50.579 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:50.510+0000 7f5e5ab2b740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5613ad594d30 0x5613ad592130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:31:50.579 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:50.510+0000 7f5e564f2640 1 -- 172.21.15.19:0/4120824296 learned_addr learned my addr 172.21.15.19:0/4120824296 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:31:50.579 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:50.510+0000 7f5e5ab2b740 1 -- 172.21.15.19:0/4120824296 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x5613ad34f700 con 0x5613ad588da0 2024-09-10T22:31:50.579 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:50.510+0000 7f5e5ab2b740 1 -- 172.21.15.19:0/4120824296 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x5613ad489110 con 0x5613ad594d30 2024-09-10T22:31:50.579 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:50.510+0000 7f5e5ab2b740 1 -- 172.21.15.19:0/4120824296 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x5613ad5979b0 con 0x5613ad588480 2024-09-10T22:31:50.579 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:50.510+0000 7f5e56cf3640 1 --2- 172.21.15.19:0/4120824296 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5613ad594d30 0x5613ad592130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:31:50.580 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:50.510+0000 7f5e55cf1640 1 -- 172.21.15.19:0/4120824296 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5613ad588480 msgr2=0x5613ad594660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:31:50.580 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:50.510+0000 7f5e55cf1640 1 --2- 172.21.15.19:0/4120824296 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5613ad588480 0x5613ad594660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:31:50.580 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:50.510+0000 7f5e55cf1640 1 -- 172.21.15.19:0/4120824296 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5613ad594d30 msgr2=0x5613ad592130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:31:50.580 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:50.510+0000 7f5e55cf1640 1 --2- 172.21.15.19:0/4120824296 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5613ad594d30 0x5613ad592130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:31:50.580 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:50.510+0000 7f5e5ab2b740 10 client.0 _ll_register_callbacks cb 0x5613ad4a2990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T22:31:50.580 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:50.510+0000 7f5e55cf1640 1 -- 172.21.15.19:0/4120824296 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5613ad4b6c40 con 0x5613ad588da0 2024-09-10T22:31:50.580 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:50.510+0000 7f5e5ab2b740 1 -- 172.21.15.19:0/4120824296 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5e4c0047a0 con 0x5613ad588da0 2024-09-10T22:31:50.580 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:50.511+0000 7f5e55cf1640 1 --2- 172.21.15.19:0/4120824296 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5613ad588da0 0x5613ad591ab0 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7f5e4000e9c0 tx=0x7f5e400abed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7b6ceb18e9cb8713 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:31:50.580 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:50.511+0000 7f5e39ffb640 10 client.16458 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-10T22:31:50.580 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:50.511+0000 7f5e39ffb640 1 -- 172.21.15.19:0/4120824296 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e400b1180 con 0x5613ad588da0 2024-09-10T22:31:50.580 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:50.511+0000 7f5e39ffb640 1 -- 172.21.15.19:0/4120824296 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8327+0+0 (secure 0 0 0) 0x7f5e400c7430 con 0x5613ad588da0 2024-09-10T22:31:50.581 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:50.511+0000 7f5e39ffb640 1 -- 172.21.15.19:0/4120824296 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f5e400b5c30 con 0x5613ad588da0 2024-09-10T22:31:50.581 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:50.511+0000 7f5e5ab2b740 10 client.16458 fetch_fsmap learned FSMap version 27 2024-09-10T22:31:50.581 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:50.511+0000 7f5e5ab2b740 1 -- 172.21.15.19:0/4120824296 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({fsmap=27}) -- 0x5613ad5a3230 con 0x5613ad588da0 2024-09-10T22:31:50.581 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:50.511+0000 7f5e39ffb640 1 -- 172.21.15.19:0/4120824296 <== mon.0 v2:172.21.15.19:3300/0 4 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7f5e40004320 con 0x5613ad588da0 2024-09-10T22:31:50.581 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:50.512+0000 7f5e5ab2b740 10 client.16458 fetch_fsmap finished waiting for FSMap version 27 2024-09-10T22:31:50.581 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:50.512+0000 7f5e5ab2b740 10 client.16458 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-10T22:31:50.581 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:50.512+0000 7f5e5ab2b740 20 client.16458 populate_metadata read hostname 'smithi019' 2024-09-10T22:31:50.581 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:50.512+0000 7f5e5ab2b740 1 --2- 172.21.15.19:0/4120824296 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x5613ad5a45d0 0x5613ad5a69c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:31:50.581 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:50.512+0000 7f5e5ab2b740 4 client.16458 mds_command: new command op to 24581 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T22:31:50.581 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:50.512+0000 7f5e5ab2b740 1 -- 172.21.15.19:0/4120824296 --> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5613ad500da0 con 0x5613ad5a45d0 2024-09-10T22:31:50.581 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:50.512+0000 7f5e564f2640 1 --2- 172.21.15.19:0/4120824296 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x5613ad5a45d0 0x5613ad5a69c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:31:50.581 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:50.512+0000 7f5e564f2640 1 --2- 172.21.15.19:0/4120824296 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x5613ad5a45d0 0x5613ad5a69c0 crc :-1 s=READY pgs=124 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2b4cfe01ea3d224b server_cookie=c4f04327dfd5c60 in_seq=0 out_seq=0 2024-09-10T22:31:50.581 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:50.512+0000 7f5e39ffb640 10 client.16458 ms_handle_connect on v2:172.21.15.135:6838/1254769802 2024-09-10T22:31:50.581 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:50.513+0000 7f5e39ffb640 1 -- 172.21.15.19:0/4120824296 <== mds.0 v2:172.21.15.135:6838/1254769802 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5613ad500da0 con 0x5613ad5a45d0 2024-09-10T22:31:50.582 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:50.513+0000 7f5e39ffb640 10 client.16458 handle_command_reply: tid=0 2024-09-10T22:31:50.582 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:50.513+0000 7f5e5ab2b740 1 client.16458 shutdown 2024-09-10T22:31:50.582 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:50.513+0000 7f5e5ab2b740 1 -- 172.21.15.19:0/4120824296 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5613ad588da0 msgr2=0x5613ad591ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:31:50.582 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:50.513+0000 7f5e5ab2b740 1 --2- 172.21.15.19:0/4120824296 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5613ad588da0 0x5613ad591ab0 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7f5e4000e9c0 tx=0x7f5e400abed0 comp rx=0 tx=0).stop 2024-09-10T22:31:50.582 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:50.513+0000 7f5e5ab2b740 1 -- 172.21.15.19:0/4120824296 shutdown_connections 2024-09-10T22:31:50.582 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:50.513+0000 7f5e5ab2b740 1 --2- 172.21.15.19:0/4120824296 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5613ad594d30 0x5613ad592130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:31:50.582 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:50.513+0000 7f5e5ab2b740 1 --2- 172.21.15.19:0/4120824296 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5613ad588da0 0x5613ad591ab0 unknown :-1 s=CLOSED pgs=640 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:31:50.582 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:50.513+0000 7f5e5ab2b740 1 --2- 172.21.15.19:0/4120824296 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x5613ad5a45d0 0x5613ad5a69c0 crc :-1 s=READY pgs=124 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:31:50.582 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:50.513+0000 7f5e39ffb640 0 client.16458 ms_handle_reset on v2:172.21.15.135:6838/1254769802 2024-09-10T22:31:50.582 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:50.513+0000 7f5e5ab2b740 1 --2- 172.21.15.19:0/4120824296 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5613ad588480 0x5613ad594660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:31:50.582 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:50.513+0000 7f5e5ab2b740 1 -- 172.21.15.19:0/4120824296 >> 172.21.15.19:0/4120824296 conn(0x5613ad5862b0 msgr2=0x5613ad58be50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:31:50.582 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:50.514+0000 7f5e5ab2b740 1 -- 172.21.15.19:0/4120824296 shutdown_connections 2024-09-10T22:31:50.582 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:50.514+0000 7f5e5ab2b740 1 -- 172.21.15.19:0/4120824296 wait complete. 2024-09-10T22:31:50.583 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:50.514+0000 7f5e5ab2b740 20 client.16458 trim_cache size 0 max 16384 2024-09-10T22:31:50.583 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:50.533+0000 7f5e5ab2b740 1 Processor -- start 2024-09-10T22:31:50.583 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:50.533+0000 7f5e5ab2b740 1 -- start start 2024-09-10T22:31:50.583 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:50.533+0000 7f5e5ab2b740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5613ad588480 0x5613ad5a0be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:31:50.583 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:50.533+0000 7f5e5ab2b740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5613ad588da0 0x5613ad596120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:31:50.583 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:50.533+0000 7f5e5ab2b740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5613ad594d30 0x5613ad596660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:31:50.583 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:50.533+0000 7f5e5ab2b740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f5e501b2fe0 con 0x5613ad588480 2024-09-10T22:31:50.583 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:50.533+0000 7f5e5ab2b740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f5e501b08b0 con 0x5613ad594d30 2024-09-10T22:31:50.583 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:50.533+0000 7f5e5ab2b740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f5e501ae700 con 0x5613ad588da0 2024-09-10T22:31:50.583 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:50.533+0000 7f5e55cf1640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5613ad588da0 0x5613ad596120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:31:50.583 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:50.533+0000 7f5e564f2640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5613ad588480 0x5613ad5a0be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:31:50.583 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:50.533+0000 7f5e56cf3640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5613ad594d30 0x5613ad596660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:31:50.583 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:50.533+0000 7f5e56cf3640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5613ad594d30 0x5613ad596660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.19:60216/0 (socket says 172.21.15.19:60216) 2024-09-10T22:31:50.584 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:50.533+0000 7f5e55cf1640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5613ad588da0 0x5613ad596120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.19:48974/0 (socket says 172.21.15.19:48974) 2024-09-10T22:31:50.584 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:50.533+0000 7f5e56cf3640 1 -- 172.21.15.19:0/1238115439 learned_addr learned my addr 172.21.15.19:0/1238115439 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:31:50.584 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:50.533+0000 7f5e564f2640 1 --2- 172.21.15.19:0/1238115439 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5613ad588480 0x5613ad5a0be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:38322/0 (socket says 172.21.15.19:38322) 2024-09-10T22:31:50.584 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:50.534+0000 7f5e55cf1640 1 -- 172.21.15.19:0/1238115439 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5613ad594d30 msgr2=0x5613ad596660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:31:50.584 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:50.534+0000 7f5e55cf1640 1 --2- 172.21.15.19:0/1238115439 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5613ad594d30 0x5613ad596660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:31:50.584 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:50.534+0000 7f5e55cf1640 1 -- 172.21.15.19:0/1238115439 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5613ad588480 msgr2=0x5613ad5a0be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:31:50.584 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:50.534+0000 7f5e55cf1640 1 --2- 172.21.15.19:0/1238115439 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5613ad588480 0x5613ad5a0be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:31:50.584 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:50.534+0000 7f5e55cf1640 1 -- 172.21.15.19:0/1238115439 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5613ad586d30 con 0x5613ad588da0 2024-09-10T22:31:50.584 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:50.534+0000 7f5e56cf3640 1 --2- 172.21.15.19:0/1238115439 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5613ad594d30 0x5613ad596660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T22:31:50.584 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:50.534+0000 7f5e55cf1640 1 --2- 172.21.15.19:0/1238115439 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5613ad588da0 0x5613ad596120 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f5e4000cfd0 tx=0x7f5e400b0000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4cf887f8ed6d0e87 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:31:50.584 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:50.534+0000 7f5e3bfff640 1 -- 172.21.15.19:0/1238115439 <== mon.1 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e400b1180 con 0x5613ad588da0 2024-09-10T22:31:50.584 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:50.534+0000 7f5e3bfff640 1 -- 172.21.15.19:0/1238115439 <== mon.1 v2:172.21.15.138:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5e4c0047a0 con 0x5613ad588da0 2024-09-10T22:31:50.584 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:50.534+0000 7f5e3bfff640 1 -- 172.21.15.19:0/1238115439 <== mon.1 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e400a7ff0 con 0x5613ad588da0 2024-09-10T22:31:50.584 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:50.535+0000 7f5e5ab2b740 1 -- 172.21.15.19:0/1238115439 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5613ad588da0 msgr2=0x5613ad596120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:31:50.585 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:50.535+0000 7f5e5ab2b740 1 --2- 172.21.15.19:0/1238115439 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5613ad588da0 0x5613ad596120 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f5e4000cfd0 tx=0x7f5e400b0000 comp rx=0 tx=0).stop 2024-09-10T22:31:50.585 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:50.535+0000 7f5e5ab2b740 1 -- 172.21.15.19:0/1238115439 shutdown_connections 2024-09-10T22:31:50.585 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:50.535+0000 7f5e5ab2b740 1 --2- 172.21.15.19:0/1238115439 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5613ad594d30 0x5613ad596660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:31:50.585 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:50.535+0000 7f5e5ab2b740 1 --2- 172.21.15.19:0/1238115439 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5613ad588da0 0x5613ad596120 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:31:50.585 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:50.535+0000 7f5e5ab2b740 1 --2- 172.21.15.19:0/1238115439 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5613ad588480 0x5613ad5a0be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:31:50.585 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:50.535+0000 7f5e5ab2b740 1 -- 172.21.15.19:0/1238115439 >> 172.21.15.19:0/1238115439 conn(0x5613ad5862b0 msgr2=0x5613ad586f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:31:50.585 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:50.535+0000 7f5e5ab2b740 1 -- 172.21.15.19:0/1238115439 shutdown_connections 2024-09-10T22:31:50.585 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:50.535+0000 7f5e5ab2b740 1 -- 172.21.15.19:0/1238115439 wait complete. 2024-09-10T22:31:50.585 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:50.535+0000 7f5e5ab2b740 1 -- start start 2024-09-10T22:31:50.585 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:50.535+0000 7f5e5ab2b740 1 Processor -- start 2024-09-10T22:31:50.585 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:50.536+0000 7f5e5ab2b740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5613ad588480 0x5613ad59d190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:31:50.585 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:50.536+0000 7f5e5ab2b740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5613ad588da0 0x5613ad59ac20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:31:50.586 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:50.536+0000 7f5e5ab2b740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5613ad594d30 0x5613ad59b160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:31:50.586 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:50.536+0000 7f5e5ab2b740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f5e501aed70 con 0x5613ad588480 2024-09-10T22:31:50.586 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:50.536+0000 7f5e5ab2b740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f5e501b01e0 con 0x5613ad594d30 2024-09-10T22:31:50.586 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:50.536+0000 7f5e5ab2b740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f5e501af440 con 0x5613ad588da0 2024-09-10T22:31:50.586 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:50.536+0000 7f5e5ab2b740 10 client.0 _ll_register_callbacks cb 0x7f5e400cf040 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T22:31:50.586 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:50.536+0000 7f5e564f2640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5613ad588480 0x5613ad59d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:31:50.586 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:50.536+0000 7f5e56cf3640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5613ad594d30 0x5613ad59b160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:31:50.586 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:50.536+0000 7f5e564f2640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5613ad588480 0x5613ad59d190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:38326/0 (socket says 172.21.15.19:38326) 2024-09-10T22:31:50.586 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:50.536+0000 7f5e564f2640 1 -- 172.21.15.19:0/954845725 learned_addr learned my addr 172.21.15.19:0/954845725 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:31:50.586 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:50.536+0000 7f5e55cf1640 1 --2- 172.21.15.19:0/954845725 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5613ad588da0 0x5613ad59ac20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:31:50.586 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:50.536+0000 7f5e56cf3640 1 -- 172.21.15.19:0/954845725 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5613ad588da0 msgr2=0x5613ad59ac20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:31:50.586 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:50.536+0000 7f5e56cf3640 1 --2- 172.21.15.19:0/954845725 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5613ad588da0 0x5613ad59ac20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:31:50.586 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:50.536+0000 7f5e56cf3640 1 -- 172.21.15.19:0/954845725 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5613ad588480 msgr2=0x5613ad59d190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:31:50.587 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:50.536+0000 7f5e56cf3640 1 --2- 172.21.15.19:0/954845725 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5613ad588480 0x5613ad59d190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:31:50.587 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:50.536+0000 7f5e56cf3640 1 -- 172.21.15.19:0/954845725 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5613ad59b6f0 con 0x5613ad594d30 2024-09-10T22:31:50.587 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:50.536+0000 7f5e55cf1640 1 --2- 172.21.15.19:0/954845725 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5613ad588da0 0x5613ad59ac20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T22:31:50.587 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:50.536+0000 7f5e564f2640 1 --2- 172.21.15.19:0/954845725 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5613ad588480 0x5613ad59d190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T22:31:50.587 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:50.537+0000 7f5e56cf3640 1 --2- 172.21.15.19:0/954845725 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5613ad594d30 0x5613ad59b160 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f5e4802aeb0 tx=0x7f5e4802a8c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=edaaac1489680159 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:31:50.587 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:50.537+0000 7f5e39ffb640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-09-10T22:31:50.587 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:50.537+0000 7f5e39ffb640 1 -- 172.21.15.19:0/954845725 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e48003b80 con 0x5613ad594d30 2024-09-10T22:31:50.587 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:50.537+0000 7f5e39ffb640 1 -- 172.21.15.19:0/954845725 <== mon.2 v2:172.21.15.135:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8327+0+0 (secure 0 0 0) 0x7f5e48003d20 con 0x5613ad594d30 2024-09-10T22:31:50.587 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:50.537+0000 7f5e5ab2b740 1 -- 172.21.15.19:0/954845725 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5e4c0047a0 con 0x5613ad594d30 2024-09-10T22:31:50.587 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:50.537+0000 7f5e39ffb640 1 -- 172.21.15.19:0/954845725 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f5e4802f790 con 0x5613ad594d30 2024-09-10T22:31:50.587 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:50.537+0000 7f5e5ab2b740 10 client.25880 fetch_fsmap learned FSMap version 27 2024-09-10T22:31:50.587 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:50.537+0000 7f5e5ab2b740 1 -- 172.21.15.19:0/954845725 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x5613ad612240 con 0x5613ad594d30 2024-09-10T22:31:50.587 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:50.537+0000 7f5e39ffb640 1 -- 172.21.15.19:0/954845725 <== mon.2 v2:172.21.15.135:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5e4c0047a0 con 0x5613ad594d30 2024-09-10T22:31:50.588 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:50.537+0000 7f5e39ffb640 1 -- 172.21.15.19:0/954845725 <== mon.2 v2:172.21.15.135:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7f5e48004600 con 0x5613ad594d30 2024-09-10T22:31:50.588 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:50.537+0000 7f5e5ab2b740 10 client.25880 fetch_fsmap finished waiting for FSMap version 27 2024-09-10T22:31:50.588 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:50.537+0000 7f5e5ab2b740 10 client.25880 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-10T22:31:50.588 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:50.537+0000 7f5e5ab2b740 20 client.25880 populate_metadata read hostname 'smithi019' 2024-09-10T22:31:50.588 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:50.537+0000 7f5e5ab2b740 1 --2- 172.21.15.19:0/954845725 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x5613ad5a45d0 0x5613ad6149d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:31:50.588 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:50.537+0000 7f5e5ab2b740 4 client.25880 mds_command: new command op to 24581 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-10T22:31:50.588 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:50.537+0000 7f5e5ab2b740 1 -- 172.21.15.19:0/954845725 --> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] -- command(tid 0: {"prefix": "scrub status"}) -- 0x5613ad4fc850 con 0x5613ad5a45d0 2024-09-10T22:31:50.588 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:50.538+0000 7f5e564f2640 1 --2- 172.21.15.19:0/954845725 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x5613ad5a45d0 0x5613ad6149d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:31:50.588 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:50.538+0000 7f5e564f2640 1 --2- 172.21.15.19:0/954845725 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x5613ad5a45d0 0x5613ad6149d0 crc :-1 s=READY pgs=125 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=340c0698b2daebea server_cookie=ef8ebff0cb7f9687 in_seq=0 out_seq=0 2024-09-10T22:31:50.588 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:50.538+0000 7f5e39ffb640 10 client.25880 ms_handle_connect on v2:172.21.15.135:6838/1254769802 2024-09-10T22:31:50.588 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:50.538+0000 7f5e39ffb640 1 -- 172.21.15.19:0/954845725 <== mds.0 v2:172.21.15.135:6838/1254769802 1 ==== command_reply(tid 0: 0 ) ==== 8+0+2558 (crc 0 0 0) 0x5613ad4fc850 con 0x5613ad5a45d0 2024-09-10T22:31:50.588 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:50.538+0000 7f5e39ffb640 10 client.25880 handle_command_reply: tid=0 2024-09-10T22:31:50.588 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:50.538+0000 7f5e5ab2b740 1 client.25880 shutdown 2024-09-10T22:31:50.589 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:50.538+0000 7f5e5ab2b740 1 -- 172.21.15.19:0/954845725 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5613ad594d30 msgr2=0x5613ad59b160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:31:50.589 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:50.538+0000 7f5e5ab2b740 1 --2- 172.21.15.19:0/954845725 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5613ad594d30 0x5613ad59b160 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f5e4802aeb0 tx=0x7f5e4802a8c0 comp rx=0 tx=0).stop 2024-09-10T22:31:50.589 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:50.539+0000 7f5e5ab2b740 1 -- 172.21.15.19:0/954845725 shutdown_connections 2024-09-10T22:31:50.589 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:50.539+0000 7f5e5ab2b740 1 --2- 172.21.15.19:0/954845725 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5613ad594d30 0x5613ad59b160 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:31:50.589 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:50.539+0000 7f5e5ab2b740 1 --2- 172.21.15.19:0/954845725 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x5613ad5a45d0 0x5613ad6149d0 crc :-1 s=READY pgs=125 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:31:50.589 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:50.539+0000 7f5e5ab2b740 1 --2- 172.21.15.19:0/954845725 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5613ad588da0 0x5613ad59ac20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:31:50.589 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:50.539+0000 7f5e5ab2b740 1 --2- 172.21.15.19:0/954845725 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5613ad588480 0x5613ad59d190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:31:50.589 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:50.539+0000 7f5e39ffb640 0 client.25880 ms_handle_reset on v2:172.21.15.135:6838/1254769802 2024-09-10T22:31:50.589 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:50.539+0000 7f5e5ab2b740 1 -- 172.21.15.19:0/954845725 >> 172.21.15.19:0/954845725 conn(0x5613ad5862b0 msgr2=0x5613ad58b4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:31:50.589 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:50.539+0000 7f5e5ab2b740 1 -- 172.21.15.19:0/954845725 shutdown_connections 2024-09-10T22:31:50.589 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:50.539+0000 7f5e5ab2b740 1 -- 172.21.15.19:0/954845725 wait complete. 2024-09-10T22:31:50.589 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:50.539+0000 7f5e5ab2b740 20 client.25880 trim_cache size 0 max 16384 2024-09-10T22:31:50.590 INFO:teuthology.orchestra.run.smithi019.stdout:{ 2024-09-10T22:31:50.590 INFO:teuthology.orchestra.run.smithi019.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-10T22:31:50.590 INFO:teuthology.orchestra.run.smithi019.stdout: "scrubs": { 2024-09-10T22:31:50.590 INFO:teuthology.orchestra.run.smithi019.stdout: "0b81ea61-0b8e-4f2c-a58f-ef1019289fc9": { 2024-09-10T22:31:50.590 INFO:teuthology.orchestra.run.smithi019.stdout: "path": "/", 2024-09-10T22:31:50.590 INFO:teuthology.orchestra.run.smithi019.stdout: "tag": "0b81ea61-0b8e-4f2c-a58f-ef1019289fc9", 2024-09-10T22:31:50.590 INFO:teuthology.orchestra.run.smithi019.stdout: "options": "recursive,force" 2024-09-10T22:31:50.590 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-10T22:31:50.590 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:31:50.591 INFO:teuthology.orchestra.run.smithi019.stdout: "scrub_stats": { 2024-09-10T22:31:50.591 INFO:teuthology.orchestra.run.smithi019.stdout: "0b81ea61-0b8e-4f2c-a58f-ef1019289fc9": { 2024-09-10T22:31:50.591 INFO:teuthology.orchestra.run.smithi019.stdout: "start_time": "2024-09-10T22:31:48.141568+0000", 2024-09-10T22:31:50.591 INFO:teuthology.orchestra.run.smithi019.stdout: "path": "/", 2024-09-10T22:31:50.591 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_started": 0, 2024-09-10T22:31:50.591 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_passed": 0, 2024-09-10T22:31:50.591 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_failed": 0, 2024-09-10T22:31:50.591 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_skipped": 0 2024-09-10T22:31:50.591 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:31:50.591 INFO:teuthology.orchestra.run.smithi019.stdout: "715ec863-8a9d-45b6-967f-59b15ce1bf12": { 2024-09-10T22:31:50.591 INFO:teuthology.orchestra.run.smithi019.stdout: "start_time": "2024-09-10T22:31:00.669516+0000", 2024-09-10T22:31:50.591 INFO:teuthology.orchestra.run.smithi019.stdout: "path": "/", 2024-09-10T22:31:50.591 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_started": 0, 2024-09-10T22:31:50.591 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_passed": 0, 2024-09-10T22:31:50.592 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_failed": 0, 2024-09-10T22:31:50.592 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_skipped": 0 2024-09-10T22:31:50.592 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:31:50.592 INFO:teuthology.orchestra.run.smithi019.stdout: "fd1f1837-dcfa-4d88-99e8-2509f36c3f98": { 2024-09-10T22:31:50.592 INFO:teuthology.orchestra.run.smithi019.stdout: "start_time": "2024-09-10T22:30:12.470477+0000", 2024-09-10T22:31:50.592 INFO:teuthology.orchestra.run.smithi019.stdout: "path": "/", 2024-09-10T22:31:50.592 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_started": 0, 2024-09-10T22:31:50.592 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_passed": 0, 2024-09-10T22:31:50.592 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_failed": 0, 2024-09-10T22:31:50.592 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_skipped": 0 2024-09-10T22:31:50.592 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:31:50.592 INFO:teuthology.orchestra.run.smithi019.stdout: "8f3bb3bf-911f-490c-9856-c80ea220dbbe": { 2024-09-10T22:31:50.592 INFO:teuthology.orchestra.run.smithi019.stdout: "start_time": "2024-09-10T22:29:25.374415+0000", 2024-09-10T22:31:50.593 INFO:teuthology.orchestra.run.smithi019.stdout: "path": "/", 2024-09-10T22:31:50.593 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_started": 0, 2024-09-10T22:31:50.593 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_passed": 0, 2024-09-10T22:31:50.593 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_failed": 0, 2024-09-10T22:31:50.593 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_skipped": 0 2024-09-10T22:31:50.593 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:31:50.593 INFO:teuthology.orchestra.run.smithi019.stdout: "eb518e3c-a71e-4f32-9ca0-ae88930ca218": { 2024-09-10T22:31:50.593 INFO:teuthology.orchestra.run.smithi019.stdout: "start_time": "2024-09-10T22:28:38.366352+0000", 2024-09-10T22:31:50.593 INFO:teuthology.orchestra.run.smithi019.stdout: "path": "/", 2024-09-10T22:31:50.593 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_started": 0, 2024-09-10T22:31:50.593 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_passed": 0, 2024-09-10T22:31:50.593 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_failed": 0, 2024-09-10T22:31:50.593 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_skipped": 0 2024-09-10T22:31:50.593 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:31:50.594 INFO:teuthology.orchestra.run.smithi019.stdout: "c12c2a04-dcd6-4673-a98e-93f665d3f5d7": { 2024-09-10T22:31:50.594 INFO:teuthology.orchestra.run.smithi019.stdout: "start_time": "2024-09-10T22:27:49.392329+0000", 2024-09-10T22:31:50.594 INFO:teuthology.orchestra.run.smithi019.stdout: "path": "/", 2024-09-10T22:31:50.594 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_started": 0, 2024-09-10T22:31:50.594 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_passed": 0, 2024-09-10T22:31:50.594 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_failed": 0, 2024-09-10T22:31:50.594 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_skipped": 0 2024-09-10T22:31:50.594 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:31:50.594 INFO:teuthology.orchestra.run.smithi019.stdout: "b38852c8-478a-42ef-8384-b2c55d5313a4": { 2024-09-10T22:31:50.594 INFO:teuthology.orchestra.run.smithi019.stdout: "start_time": "2024-09-10T22:27:00.320308+0000", 2024-09-10T22:31:50.594 INFO:teuthology.orchestra.run.smithi019.stdout: "path": "/", 2024-09-10T22:31:50.594 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_started": 0, 2024-09-10T22:31:50.594 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_passed": 0, 2024-09-10T22:31:50.594 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_failed": 0, 2024-09-10T22:31:50.595 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_skipped": 0 2024-09-10T22:31:50.595 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:31:50.595 INFO:teuthology.orchestra.run.smithi019.stdout: "9b6bfdee-303c-4c12-af56-dc85860d112a": { 2024-09-10T22:31:50.595 INFO:teuthology.orchestra.run.smithi019.stdout: "start_time": "2024-09-10T22:26:17.484162+0000", 2024-09-10T22:31:50.595 INFO:teuthology.orchestra.run.smithi019.stdout: "path": "/", 2024-09-10T22:31:50.595 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_started": 0, 2024-09-10T22:31:50.595 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_passed": 0, 2024-09-10T22:31:50.595 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_failed": 0, 2024-09-10T22:31:50.595 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_skipped": 0 2024-09-10T22:31:50.595 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-10T22:31:50.595 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-10T22:31:50.595 INFO:teuthology.orchestra.run.smithi019.stdout:} 2024-09-10T22:31:50.596 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:50.539+0000 7f5e58756640 1 -- 172.21.15.19:0/2559335997 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f5e3c0b52e0 msgr2=0x7f5e3c0b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:31:50.596 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:50.539+0000 7f5e58756640 1 --2- 172.21.15.19:0/2559335997 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f5e3c0b52e0 0x7f5e3c0b77a0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f5e48009430 tx=0x7f5e480095c0 comp rx=0 tx=0).stop 2024-09-10T22:31:50.596 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:50.539+0000 7f5e58756640 1 -- 172.21.15.19:0/2559335997 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5e50075e00 msgr2=0x7f5e5019b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:31:50.596 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:50.539+0000 7f5e58756640 1 --2- 172.21.15.19:0/2559335997 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5e50075e00 0x7f5e5019b9c0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f5e4000e9f0 tx=0x7f5e4000eeb0 comp rx=0 tx=0).stop 2024-09-10T22:31:50.596 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:50.540+0000 7f5e58756640 1 -- 172.21.15.19:0/2559335997 shutdown_connections 2024-09-10T22:31:50.596 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:50.540+0000 7f5e58756640 1 --2- 172.21.15.19:0/2559335997 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f5e3c0b52e0 0x7f5e3c0b77a0 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:31:50.596 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:50.540+0000 7f5e58756640 1 --2- 172.21.15.19:0/2559335997 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5e5010f3d0 0x7f5e501a0d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:31:50.596 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:50.540+0000 7f5e58756640 1 --2- 172.21.15.19:0/2559335997 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5e50075e00 0x7f5e5019b9c0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:31:50.597 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:50.540+0000 7f5e58756640 1 --2- 172.21.15.19:0/2559335997 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5e500754e0 0x7f5e5019b480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:31:50.597 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:50.540+0000 7f5e58756640 1 -- 172.21.15.19:0/2559335997 >> 172.21.15.19:0/2559335997 conn(0x7f5e500fe830 msgr2=0x7f5e50106e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:31:50.597 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:50.540+0000 7f5e58756640 1 -- 172.21.15.19:0/2559335997 shutdown_connections 2024-09-10T22:31:50.597 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:31:50.540+0000 7f5e58756640 1 -- 172.21.15.19:0/2559335997 wait complete. 2024-09-10T22:31:51.764 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:51.761+0000 7fc622384640 1 -- 172.21.15.19:0/4280986160 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc61c103ad0 msgr2=0x7fc61c103f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:31:51.764 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:51.761+0000 7fc622384640 1 --2- 172.21.15.19:0/4280986160 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc61c103ad0 0x7fc61c103f50 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fc610009860 tx=0x7fc61002a340 comp rx=0 tx=0).stop 2024-09-10T22:31:51.764 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:51.761+0000 7fc622384640 1 -- 172.21.15.19:0/4280986160 shutdown_connections 2024-09-10T22:31:51.764 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:51.761+0000 7fc622384640 1 --2- 172.21.15.19:0/4280986160 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc61c104490 0x7fc61c10ae10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:31:51.764 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:51.761+0000 7fc622384640 1 --2- 172.21.15.19:0/4280986160 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc61c103ad0 0x7fc61c103f50 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:31:51.765 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:51.761+0000 7fc622384640 1 --2- 172.21.15.19:0/4280986160 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc61c102980 0x7fc61c102d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:31:51.765 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:51.761+0000 7fc622384640 1 -- 172.21.15.19:0/4280986160 >> 172.21.15.19:0/4280986160 conn(0x7fc61c0fe240 msgr2=0x7fc61c100660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:31:51.765 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:51.761+0000 7fc622384640 1 -- 172.21.15.19:0/4280986160 shutdown_connections 2024-09-10T22:31:51.765 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:51.761+0000 7fc622384640 1 -- 172.21.15.19:0/4280986160 wait complete. 2024-09-10T22:31:51.765 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:51.761+0000 7fc622384640 1 Processor -- start 2024-09-10T22:31:51.765 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:51.762+0000 7fc622384640 1 -- start start 2024-09-10T22:31:51.767 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:51.762+0000 7fc622384640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc61c102980 0x7fc61c19af70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:31:51.767 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:51.762+0000 7fc622384640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc61c103ad0 0x7fc61c19b5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:31:51.767 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:51.762+0000 7fc622384640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc61c104490 0x7fc61c19c1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:31:51.768 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:51.762+0000 7fc622384640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fc61c10e5d0 con 0x7fc61c102980 2024-09-10T22:31:51.768 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:51.762+0000 7fc622384640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fc61c10e450 con 0x7fc61c103ad0 2024-09-10T22:31:51.768 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:51.762+0000 7fc622384640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7fc61c10e750 con 0x7fc61c104490 2024-09-10T22:31:51.768 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:51.762+0000 7fc61bfff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc61c102980 0x7fc61c19af70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:31:51.768 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:51.762+0000 7fc61b7fe640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc61c103ad0 0x7fc61c19b5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:31:51.768 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:51.762+0000 7fc61bfff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc61c102980 0x7fc61c19af70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:38348/0 (socket says 172.21.15.19:38348) 2024-09-10T22:31:51.768 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:51.762+0000 7fc61b7fe640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc61c103ad0 0x7fc61c19b5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.19:60236/0 (socket says 172.21.15.19:60236) 2024-09-10T22:31:51.769 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:51.762+0000 7fc61bfff640 1 -- 172.21.15.19:0/3162088290 learned_addr learned my addr 172.21.15.19:0/3162088290 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:31:51.769 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:51.762+0000 7fc620921640 1 --2- 172.21.15.19:0/3162088290 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc61c104490 0x7fc61c19c1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:31:51.769 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:51.762+0000 7fc61b7fe640 1 -- 172.21.15.19:0/3162088290 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc61c104490 msgr2=0x7fc61c19c1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:31:51.769 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:51.762+0000 7fc61b7fe640 1 --2- 172.21.15.19:0/3162088290 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc61c104490 0x7fc61c19c1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:31:51.769 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:51.762+0000 7fc61b7fe640 1 -- 172.21.15.19:0/3162088290 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc61c102980 msgr2=0x7fc61c19af70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:31:51.769 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:51.762+0000 7fc61b7fe640 1 --2- 172.21.15.19:0/3162088290 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc61c102980 0x7fc61c19af70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:31:51.770 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:51.762+0000 7fc61b7fe640 1 -- 172.21.15.19:0/3162088290 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc61c19cab0 con 0x7fc61c103ad0 2024-09-10T22:31:51.770 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:51.762+0000 7fc620921640 1 --2- 172.21.15.19:0/3162088290 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc61c104490 0x7fc61c19c1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T22:31:51.770 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:51.763+0000 7fc61b7fe640 1 --2- 172.21.15.19:0/3162088290 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc61c103ad0 0x7fc61c19b5c0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fc61002a860 tx=0x7fc610032d50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:31:51.770 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:51.763+0000 7fc6197fa640 1 -- 172.21.15.19:0/3162088290 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc610040020 con 0x7fc61c103ad0 2024-09-10T22:31:51.770 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:51.763+0000 7fc6197fa640 1 -- 172.21.15.19:0/3162088290 <== mon.2 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc610030d40 con 0x7fc61c103ad0 2024-09-10T22:31:51.770 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:51.763+0000 7fc622384640 1 -- 172.21.15.19:0/3162088290 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc61c19cd40 con 0x7fc61c103ad0 2024-09-10T22:31:51.771 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:51.763+0000 7fc6197fa640 1 -- 172.21.15.19:0/3162088290 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc610037040 con 0x7fc61c103ad0 2024-09-10T22:31:51.771 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:51.763+0000 7fc622384640 1 -- 172.21.15.19:0/3162088290 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc61c1a3470 con 0x7fc61c103ad0 2024-09-10T22:31:51.778 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:51.765+0000 7fc6197fa640 1 -- 172.21.15.19:0/3162088290 <== mon.2 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 18) ==== 153250+0+0 (secure 0 0 0) 0x7fc610004160 con 0x7fc61c103ad0 2024-09-10T22:31:51.779 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:51.766+0000 7fc625227740 1 Processor -- start 2024-09-10T22:31:51.779 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:51.766+0000 7fc625227740 1 -- start start 2024-09-10T22:31:51.779 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:51.766+0000 7fc625227740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c79959c860 0x55c79959ec50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:31:51.779 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:51.766+0000 7fc625227740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55c79959f190 0x55c7995a1580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:31:51.779 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:51.766+0000 7fc625227740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55c7995a1bd0 0x55c7995a4090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:31:51.779 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:51.766+0000 7fc625227740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x55c79950e6f0 con 0x55c7995a1bd0 2024-09-10T22:31:51.780 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:51.766+0000 7fc625227740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55c7994fdb20 con 0x55c79959c860 2024-09-10T22:31:51.780 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:51.766+0000 7fc625227740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x55c799501930 con 0x55c79959f190 2024-09-10T22:31:51.780 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:51.766+0000 7fc620921640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c79959c860 0x55c79959ec50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:31:51.780 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:51.766+0000 7fc620921640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c79959c860 0x55c79959ec50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.19:60246/0 (socket says 172.21.15.19:60246) 2024-09-10T22:31:51.780 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:51.766+0000 7fc620921640 1 -- 172.21.15.19:0/3382089360 learned_addr learned my addr 172.21.15.19:0/3382089360 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:31:51.780 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:51.766+0000 7fc61bfff640 1 --2- 172.21.15.19:0/3382089360 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55c79959f190 0x55c7995a1580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:31:51.781 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:51.766+0000 7fc61b7fe640 1 --2- 172.21.15.19:0/3382089360 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55c7995a1bd0 0x55c7995a4090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:31:51.781 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:51.767+0000 7fc620921640 1 -- 172.21.15.19:0/3382089360 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55c79959f190 msgr2=0x55c7995a1580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:31:51.781 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:51.767+0000 7fc620921640 1 --2- 172.21.15.19:0/3382089360 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55c79959f190 0x55c7995a1580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:31:51.781 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:51.767+0000 7fc620921640 1 -- 172.21.15.19:0/3382089360 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55c7995a1bd0 msgr2=0x55c7995a4090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:31:51.781 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:51.767+0000 7fc620921640 1 --2- 172.21.15.19:0/3382089360 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55c7995a1bd0 0x55c7995a4090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:31:51.781 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:51.767+0000 7fc620921640 1 -- 172.21.15.19:0/3382089360 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c7994c3530 con 0x55c79959c860 2024-09-10T22:31:51.781 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:51.767+0000 7fc6197fa640 1 --2- 172.21.15.19:0/3162088290 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7fc6040b52e0 0x7fc6040b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:31:51.781 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:51.767+0000 7fc61bfff640 1 --2- 172.21.15.19:0/3162088290 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7fc6040b52e0 0x7fc6040b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:31:51.781 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:51.767+0000 7fc620921640 1 --2- 172.21.15.19:0/3382089360 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c79959c860 0x55c79959ec50 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fc614009f80 tx=0x7fc61400f890 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1d84d78982b20a2d server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:31:51.781 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:51.767+0000 7fc6197fa640 1 -- 172.21.15.19:0/3162088290 <== mon.2 v2:172.21.15.135:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8327+0+0 (secure 0 0 0) 0x7fc610105f20 con 0x7fc61c103ad0 2024-09-10T22:31:51.781 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:51.767+0000 7fc6027fc640 1 -- 172.21.15.19:0/3382089360 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc61401d070 con 0x55c79959c860 2024-09-10T22:31:51.781 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:51.767+0000 7fc6027fc640 1 -- 172.21.15.19:0/3382089360 <== mon.2 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc61400caf0 con 0x55c79959c860 2024-09-10T22:31:51.782 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:51.767+0000 7fc6027fc640 1 -- 172.21.15.19:0/3382089360 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc614018bb0 con 0x55c79959c860 2024-09-10T22:31:51.782 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:51.768+0000 7fc625227740 1 -- 172.21.15.19:0/3382089360 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c79959c860 msgr2=0x55c79959ec50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:31:51.782 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:51.768+0000 7fc625227740 1 --2- 172.21.15.19:0/3382089360 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c79959c860 0x55c79959ec50 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fc614009f80 tx=0x7fc61400f890 comp rx=0 tx=0).stop 2024-09-10T22:31:51.782 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:51.768+0000 7fc61bfff640 1 --2- 172.21.15.19:0/3162088290 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7fc6040b52e0 0x7fc6040b77a0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7fc60c009620 tx=0x7fc60c005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:31:51.782 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:51.768+0000 7fc625227740 1 -- 172.21.15.19:0/3382089360 shutdown_connections 2024-09-10T22:31:51.782 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:51.768+0000 7fc625227740 1 --2- 172.21.15.19:0/3382089360 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55c7995a1bd0 0x55c7995a4090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:31:51.782 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:51.768+0000 7fc625227740 1 --2- 172.21.15.19:0/3382089360 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55c79959f190 0x55c7995a1580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:31:51.782 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:51.768+0000 7fc625227740 1 --2- 172.21.15.19:0/3382089360 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c79959c860 0x55c79959ec50 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:31:51.782 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:51.768+0000 7fc625227740 1 -- 172.21.15.19:0/3382089360 >> 172.21.15.19:0/3382089360 conn(0x55c7995979b0 msgr2=0x55c799598740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:31:51.783 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:51.768+0000 7fc625227740 1 -- 172.21.15.19:0/3382089360 shutdown_connections 2024-09-10T22:31:51.783 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:51.768+0000 7fc625227740 1 -- 172.21.15.19:0/3382089360 wait complete. 2024-09-10T22:31:51.783 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:51.769+0000 7fc625227740 1 -- start start 2024-09-10T22:31:51.783 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:51.769+0000 7fc625227740 1 Processor -- start 2024-09-10T22:31:51.783 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:51.769+0000 7fc625227740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c79959c860 0x55c7995a5ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:31:51.783 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:51.769+0000 7fc625227740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55c79959f190 0x55c7995a6590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:31:51.783 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:51.769+0000 7fc625227740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55c7995a1bd0 0x55c7995a7160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:31:51.783 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:51.769+0000 7fc625227740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x55c799435ab0 con 0x55c79959f190 2024-09-10T22:31:51.783 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:51.769+0000 7fc625227740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55c7994a3730 con 0x55c79959c860 2024-09-10T22:31:51.783 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:51.769+0000 7fc625227740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x55c7995a4bb0 con 0x55c7995a1bd0 2024-09-10T22:31:51.783 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:51.769+0000 7fc625227740 10 client.0 _ll_register_callbacks cb 0x55c7994f76b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T22:31:51.783 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:51.770+0000 7fc620921640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55c7995a1bd0 0x55c7995a7160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:31:51.784 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:51.770+0000 7fc61bfff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c79959c860 0x55c7995a5ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:31:51.784 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:51.770+0000 7fc620921640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55c7995a1bd0 0x55c7995a7160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.19:48996/0 (socket says 172.21.15.19:48996) 2024-09-10T22:31:51.784 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:51.770+0000 7fc61bfff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c79959c860 0x55c7995a5ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.19:60250/0 (socket says 172.21.15.19:60250) 2024-09-10T22:31:51.784 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:51.770+0000 7fc620921640 1 -- 172.21.15.19:0/3147155699 learned_addr learned my addr 172.21.15.19:0/3147155699 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:31:51.784 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:51.770+0000 7fc61b7fe640 1 --2- 172.21.15.19:0/3147155699 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55c79959f190 0x55c7995a6590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:31:51.784 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:51.770+0000 7fc620921640 1 -- 172.21.15.19:0/3147155699 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c79959c860 msgr2=0x55c7995a5ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:31:51.784 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:51.770+0000 7fc620921640 1 --2- 172.21.15.19:0/3147155699 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c79959c860 0x55c7995a5ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:31:51.784 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:51.770+0000 7fc620921640 1 -- 172.21.15.19:0/3147155699 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55c79959f190 msgr2=0x55c7995a6590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:31:51.784 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:51.770+0000 7fc620921640 1 --2- 172.21.15.19:0/3147155699 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55c79959f190 0x55c7995a6590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:31:51.784 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:51.770+0000 7fc620921640 1 -- 172.21.15.19:0/3147155699 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c79925f790 con 0x55c7995a1bd0 2024-09-10T22:31:51.784 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:51.770+0000 7fc620921640 1 --2- 172.21.15.19:0/3147155699 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55c7995a1bd0 0x55c7995a7160 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fc61400a010 tx=0x7fc61400c640 comp rx=0 tx=0).ready entity=mon.1 client_cookie=33ddc7b2fb4d0b3e server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:31:51.784 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:51.770+0000 7fc5fb7fe640 10 client.0 ms_handle_connect on v2:172.21.15.138:3300/0 2024-09-10T22:31:51.785 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:51.770+0000 7fc5fb7fe640 1 -- 172.21.15.19:0/3147155699 <== mon.1 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc61401d040 con 0x55c7995a1bd0 2024-09-10T22:31:51.785 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:51.771+0000 7fc5fb7fe640 1 -- 172.21.15.19:0/3147155699 <== mon.1 v2:172.21.15.138:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8327+0+0 (secure 0 0 0) 0x7fc61400c7b0 con 0x55c7995a1bd0 2024-09-10T22:31:51.785 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:51.771+0000 7fc625227740 1 -- 172.21.15.19:0/3147155699 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc61400caf0 con 0x55c7995a1bd0 2024-09-10T22:31:51.785 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:51.771+0000 7fc5fb7fe640 1 -- 172.21.15.19:0/3147155699 <== mon.1 v2:172.21.15.138:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fc614004a40 con 0x55c7995a1bd0 2024-09-10T22:31:51.785 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:51.771+0000 7fc625227740 10 client.25921 fetch_fsmap learned FSMap version 27 2024-09-10T22:31:51.785 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:51.771+0000 7fc625227740 1 -- 172.21.15.19:0/3147155699 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55c7992d8620 con 0x55c7995a1bd0 2024-09-10T22:31:51.785 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:51.771+0000 7fc5fb7fe640 1 -- 172.21.15.19:0/3147155699 <== mon.1 v2:172.21.15.138:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc61400caf0 con 0x55c7995a1bd0 2024-09-10T22:31:51.785 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:51.771+0000 7fc5fb7fe640 1 -- 172.21.15.19:0/3147155699 <== mon.1 v2:172.21.15.138:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7fc614020070 con 0x55c7995a1bd0 2024-09-10T22:31:51.785 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:51.771+0000 7fc625227740 10 client.25921 fetch_fsmap finished waiting for FSMap version 27 2024-09-10T22:31:51.785 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:51.771+0000 7fc625227740 10 client.25921 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-10T22:31:51.785 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:51.771+0000 7fc625227740 20 client.25921 populate_metadata read hostname 'smithi019' 2024-09-10T22:31:51.785 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:51.771+0000 7fc625227740 1 --2- 172.21.15.19:0/3147155699 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x55c7995b1450 0x55c7995b3840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:31:51.786 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:51.771+0000 7fc625227740 4 client.25921 mds_command: new command op to 24581 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T22:31:51.786 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:51.771+0000 7fc625227740 1 -- 172.21.15.19:0/3147155699 --> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c799510640 con 0x55c7995b1450 2024-09-10T22:31:51.786 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:51.772+0000 7fc61bfff640 1 --2- 172.21.15.19:0/3147155699 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x55c7995b1450 0x55c7995b3840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:31:51.786 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:51.772+0000 7fc61bfff640 1 --2- 172.21.15.19:0/3147155699 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x55c7995b1450 0x55c7995b3840 crc :-1 s=READY pgs=126 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a6c0028174cbb62b server_cookie=9732a77ca05b861f in_seq=0 out_seq=0 2024-09-10T22:31:51.786 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:51.772+0000 7fc5fb7fe640 10 client.25921 ms_handle_connect on v2:172.21.15.135:6838/1254769802 2024-09-10T22:31:51.786 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:51.773+0000 7fc5fb7fe640 1 -- 172.21.15.19:0/3147155699 <== mds.0 v2:172.21.15.135:6838/1254769802 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55c799510640 con 0x55c7995b1450 2024-09-10T22:31:51.786 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:51.773+0000 7fc5fb7fe640 10 client.25921 handle_command_reply: tid=0 2024-09-10T22:31:51.786 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:51.773+0000 7fc625227740 1 client.25921 shutdown 2024-09-10T22:31:51.786 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:51.773+0000 7fc625227740 1 -- 172.21.15.19:0/3147155699 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55c7995a1bd0 msgr2=0x55c7995a7160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:31:51.786 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:51.773+0000 7fc625227740 1 --2- 172.21.15.19:0/3147155699 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55c7995a1bd0 0x55c7995a7160 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fc61400a010 tx=0x7fc61400c640 comp rx=0 tx=0).stop 2024-09-10T22:31:51.786 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:51.773+0000 7fc625227740 1 -- 172.21.15.19:0/3147155699 shutdown_connections 2024-09-10T22:31:51.786 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:51.773+0000 7fc625227740 1 --2- 172.21.15.19:0/3147155699 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x55c7995b1450 0x55c7995b3840 crc :-1 s=READY pgs=126 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:31:51.787 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:51.773+0000 7fc625227740 1 --2- 172.21.15.19:0/3147155699 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55c7995a1bd0 0x55c7995a7160 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:31:51.787 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:51.773+0000 7fc5fb7fe640 0 client.25921 ms_handle_reset on v2:172.21.15.135:6838/1254769802 2024-09-10T22:31:51.787 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:51.773+0000 7fc625227740 1 --2- 172.21.15.19:0/3147155699 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55c79959f190 0x55c7995a6590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:31:51.787 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:51.773+0000 7fc625227740 1 --2- 172.21.15.19:0/3147155699 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c79959c860 0x55c7995a5ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:31:51.787 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:51.773+0000 7fc625227740 1 -- 172.21.15.19:0/3147155699 >> 172.21.15.19:0/3147155699 conn(0x55c7995979b0 msgr2=0x55c799596bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:31:51.787 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:51.773+0000 7fc625227740 1 -- 172.21.15.19:0/3147155699 shutdown_connections 2024-09-10T22:31:51.787 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:51.773+0000 7fc625227740 1 -- 172.21.15.19:0/3147155699 wait complete. 2024-09-10T22:31:51.787 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:51.773+0000 7fc625227740 20 client.25921 trim_cache size 0 max 16384 2024-09-10T22:31:51.799 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:51.796+0000 7fc625227740 1 Processor -- start 2024-09-10T22:31:51.800 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:51.796+0000 7fc625227740 1 -- start start 2024-09-10T22:31:51.800 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:51.796+0000 7fc625227740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55c79959c860 0x55c7995a1fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:31:51.800 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:51.796+0000 7fc625227740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55c79959f190 0x55c7995a24f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:31:51.800 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:51.796+0000 7fc625227740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c7995a1bd0 0x55c7995a5130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:31:51.800 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:51.796+0000 7fc625227740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fc61c1aeb90 con 0x55c79959c860 2024-09-10T22:31:51.800 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:51.796+0000 7fc625227740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fc61c1ac460 con 0x55c7995a1bd0 2024-09-10T22:31:51.800 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:51.796+0000 7fc625227740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7fc61c1aa2b0 con 0x55c79959f190 2024-09-10T22:31:51.801 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:51.796+0000 7fc61bfff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55c79959c860 0x55c7995a1fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:31:51.801 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:51.796+0000 7fc61bfff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55c79959c860 0x55c7995a1fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:38368/0 (socket says 172.21.15.19:38368) 2024-09-10T22:31:51.801 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:51.796+0000 7fc61bfff640 1 -- 172.21.15.19:0/4161648467 learned_addr learned my addr 172.21.15.19:0/4161648467 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:31:51.801 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:51.796+0000 7fc620921640 1 --2- 172.21.15.19:0/4161648467 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c7995a1bd0 0x55c7995a5130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:31:51.801 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:51.796+0000 7fc61b7fe640 1 --2- 172.21.15.19:0/4161648467 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55c79959f190 0x55c7995a24f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:31:51.801 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:51.797+0000 7fc61bfff640 1 -- 172.21.15.19:0/4161648467 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55c79959f190 msgr2=0x55c7995a24f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:31:51.801 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:51.797+0000 7fc61bfff640 1 --2- 172.21.15.19:0/4161648467 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55c79959f190 0x55c7995a24f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:31:51.801 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:51.797+0000 7fc61bfff640 1 -- 172.21.15.19:0/4161648467 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c7995a1bd0 msgr2=0x55c7995a5130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:31:51.801 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:51.797+0000 7fc61bfff640 1 --2- 172.21.15.19:0/4161648467 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c7995a1bd0 0x55c7995a5130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:31:51.801 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:51.797+0000 7fc61bfff640 1 -- 172.21.15.19:0/4161648467 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c7995a18f0 con 0x55c79959c860 2024-09-10T22:31:51.801 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:51.797+0000 7fc61bfff640 1 --2- 172.21.15.19:0/4161648467 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55c79959c860 0x55c7995a1fb0 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x55c7995b3fc0 tx=0x7fc60c01b000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fe381428ae8aa5c1 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:31:51.801 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:51.797+0000 7fc601ffb640 1 -- 172.21.15.19:0/4161648467 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc60c01fa60 con 0x55c79959c860 2024-09-10T22:31:51.802 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:51.797+0000 7fc601ffb640 1 -- 172.21.15.19:0/4161648467 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc60c0054d0 con 0x55c79959c860 2024-09-10T22:31:51.802 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:51.797+0000 7fc601ffb640 1 -- 172.21.15.19:0/4161648467 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc60c004d10 con 0x55c79959c860 2024-09-10T22:31:51.805 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:51.798+0000 7fc625227740 1 -- 172.21.15.19:0/4161648467 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55c79959c860 msgr2=0x55c7995a1fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:31:51.805 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:51.798+0000 7fc625227740 1 --2- 172.21.15.19:0/4161648467 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55c79959c860 0x55c7995a1fb0 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x55c7995b3fc0 tx=0x7fc60c01b000 comp rx=0 tx=0).stop 2024-09-10T22:31:51.805 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:51.798+0000 7fc625227740 1 -- 172.21.15.19:0/4161648467 shutdown_connections 2024-09-10T22:31:51.805 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:51.798+0000 7fc625227740 1 --2- 172.21.15.19:0/4161648467 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c7995a1bd0 0x55c7995a5130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:31:51.805 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:51.798+0000 7fc625227740 1 --2- 172.21.15.19:0/4161648467 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55c79959f190 0x55c7995a24f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:31:51.806 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:51.798+0000 7fc625227740 1 --2- 172.21.15.19:0/4161648467 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55c79959c860 0x55c7995a1fb0 unknown :-1 s=CLOSED pgs=641 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:31:51.806 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:51.798+0000 7fc625227740 1 -- 172.21.15.19:0/4161648467 >> 172.21.15.19:0/4161648467 conn(0x55c7995979b0 msgr2=0x55c79959bd50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:31:51.806 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:51.798+0000 7fc625227740 1 -- 172.21.15.19:0/4161648467 shutdown_connections 2024-09-10T22:31:51.806 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:51.798+0000 7fc625227740 1 -- 172.21.15.19:0/4161648467 wait complete. 2024-09-10T22:31:51.806 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:51.799+0000 7fc625227740 1 -- start start 2024-09-10T22:31:51.806 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:51.799+0000 7fc625227740 1 Processor -- start 2024-09-10T22:31:51.806 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:51.799+0000 7fc625227740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c79959c860 0x55c7995aaaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:31:51.806 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:51.799+0000 7fc625227740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55c79959f190 0x55c7995ab190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:31:51.806 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:51.799+0000 7fc625227740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55c7995a1bd0 0x55c7995abd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:31:51.806 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:51.799+0000 7fc625227740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fc61c1aa920 con 0x55c7995a1bd0 2024-09-10T22:31:51.806 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:51.799+0000 7fc625227740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fc61c1abd90 con 0x55c79959c860 2024-09-10T22:31:51.806 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:51.799+0000 7fc625227740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7fc61c1aaff0 con 0x55c79959f190 2024-09-10T22:31:51.806 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:51.800+0000 7fc61bfff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c79959c860 0x55c7995aaaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:31:51.807 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:51.800+0000 7fc625227740 10 client.0 _ll_register_callbacks cb 0x7fc61401b070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T22:31:51.807 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:51.800+0000 7fc61b7fe640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55c79959f190 0x55c7995ab190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:31:51.807 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:51.800+0000 7fc61bfff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c79959c860 0x55c7995aaaf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.19:60270/0 (socket says 172.21.15.19:60270) 2024-09-10T22:31:51.807 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:51.800+0000 7fc620921640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55c7995a1bd0 0x55c7995abd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:31:51.807 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:51.800+0000 7fc61bfff640 1 -- 172.21.15.19:0/1460967384 learned_addr learned my addr 172.21.15.19:0/1460967384 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:31:51.807 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:51.800+0000 7fc61b7fe640 1 -- 172.21.15.19:0/1460967384 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c79959c860 msgr2=0x55c7995aaaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:31:51.807 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:51.800+0000 7fc61b7fe640 1 --2- 172.21.15.19:0/1460967384 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c79959c860 0x55c7995aaaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:31:51.807 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:51.800+0000 7fc61b7fe640 1 -- 172.21.15.19:0/1460967384 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55c7995a1bd0 msgr2=0x55c7995abd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:31:51.807 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:51.800+0000 7fc61b7fe640 1 --2- 172.21.15.19:0/1460967384 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55c7995a1bd0 0x55c7995abd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:31:51.807 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:51.800+0000 7fc61b7fe640 1 -- 172.21.15.19:0/1460967384 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c7995ac590 con 0x55c79959f190 2024-09-10T22:31:51.807 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:51.800+0000 7fc61bfff640 1 --2- 172.21.15.19:0/1460967384 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c79959c860 0x55c7995aaaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T22:31:51.807 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:51.800+0000 7fc620921640 1 --2- 172.21.15.19:0/1460967384 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55c7995a1bd0 0x55c7995abd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T22:31:51.807 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:51.800+0000 7fc61b7fe640 1 --2- 172.21.15.19:0/1460967384 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55c79959f190 0x55c7995ab190 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fc610103a10 tx=0x7fc6100ccb60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c1fdea85826b7291 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:31:51.807 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:51.800+0000 7fc5fb7fe640 10 client.0 ms_handle_connect on v2:172.21.15.138:3300/0 2024-09-10T22:31:51.808 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:51.800+0000 7fc5fb7fe640 1 -- 172.21.15.19:0/1460967384 <== mon.1 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6100c8520 con 0x55c79959f190 2024-09-10T22:31:51.808 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:51.800+0000 7fc5fb7fe640 1 -- 172.21.15.19:0/1460967384 <== mon.1 v2:172.21.15.138:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8327+0+0 (secure 0 0 0) 0x7fc610030580 con 0x55c79959f190 2024-09-10T22:31:51.808 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:51.800+0000 7fc625227740 1 -- 172.21.15.19:0/1460967384 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc60c0054d0 con 0x55c79959f190 2024-09-10T22:31:51.808 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:51.801+0000 7fc5fb7fe640 1 -- 172.21.15.19:0/1460967384 <== mon.1 v2:172.21.15.138:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fc6100cbdf0 con 0x55c79959f190 2024-09-10T22:31:51.808 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:51.801+0000 7fc625227740 10 client.25927 fetch_fsmap learned FSMap version 27 2024-09-10T22:31:51.808 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:51.801+0000 7fc625227740 1 -- 172.21.15.19:0/1460967384 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55c7995ad9d0 con 0x55c79959f190 2024-09-10T22:31:51.808 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:51.801+0000 7fc5fb7fe640 1 -- 172.21.15.19:0/1460967384 <== mon.1 v2:172.21.15.138:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc60c0054d0 con 0x55c79959f190 2024-09-10T22:31:51.808 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:51.801+0000 7fc5fb7fe640 1 -- 172.21.15.19:0/1460967384 <== mon.1 v2:172.21.15.138:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7fc610030780 con 0x55c79959f190 2024-09-10T22:31:51.808 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:51.801+0000 7fc625227740 10 client.25927 fetch_fsmap finished waiting for FSMap version 27 2024-09-10T22:31:51.808 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:51.801+0000 7fc625227740 10 client.25927 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-10T22:31:51.808 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:51.801+0000 7fc625227740 20 client.25927 populate_metadata read hostname 'smithi019' 2024-09-10T22:31:51.808 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:51.801+0000 7fc625227740 1 --2- 172.21.15.19:0/1460967384 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x55c79961e290 0x55c7996206b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:31:51.808 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:51.801+0000 7fc625227740 4 client.25927 mds_command: new command op to 24581 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-10T22:31:51.809 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:51.801+0000 7fc625227740 1 -- 172.21.15.19:0/1460967384 --> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55c79950c0f0 con 0x55c79961e290 2024-09-10T22:31:51.809 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:51.801+0000 7fc61bfff640 1 --2- 172.21.15.19:0/1460967384 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x55c79961e290 0x55c7996206b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:31:51.809 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:51.802+0000 7fc61bfff640 1 --2- 172.21.15.19:0/1460967384 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x55c79961e290 0x55c7996206b0 crc :-1 s=READY pgs=127 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e3c03edd35c0fea2 server_cookie=e138efb1bd20d6f7 in_seq=0 out_seq=0 2024-09-10T22:31:51.809 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:51.802+0000 7fc5fb7fe640 10 client.25927 ms_handle_connect on v2:172.21.15.135:6838/1254769802 2024-09-10T22:31:51.944 INFO:tasks.cephfs.filesystem:scrub status for tag:0b81ea61-0b8e-4f2c-a58f-ef1019289fc9 - {'path': '/', 'tag': '0b81ea61-0b8e-4f2c-a58f-ef1019289fc9', 'options': 'recursive,force'} 2024-09-10T22:31:52.208 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:31:52 smithi019 ceph-mon[31375]: pgmap v510: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 811 KiB/s rd, 341 MiB/s wr, 256 op/s 2024-09-10T22:31:52.359 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:31:52 smithi135 ceph-mon[34789]: pgmap v510: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 811 KiB/s rd, 341 MiB/s wr, 256 op/s 2024-09-10T22:31:52.375 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:31:52 smithi138 ceph-mon[35236]: pgmap v510: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 811 KiB/s rd, 341 MiB/s wr, 256 op/s 2024-09-10T22:31:54.016 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:54.012+0000 7fc5fb7fe640 1 -- 172.21.15.19:0/1460967384 <== mds.0 v2:172.21.15.135:6838/1254769802 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55c79950c0f0 con 0x55c79961e290 2024-09-10T22:31:54.016 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:54.012+0000 7fc5fb7fe640 10 client.25927 handle_command_reply: tid=0 2024-09-10T22:31:54.016 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:54.012+0000 7fc625227740 1 client.25927 shutdown 2024-09-10T22:31:54.016 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:54.012+0000 7fc625227740 1 -- 172.21.15.19:0/1460967384 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55c79959f190 msgr2=0x55c7995ab190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:31:54.016 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:54.012+0000 7fc625227740 1 --2- 172.21.15.19:0/1460967384 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55c79959f190 0x55c7995ab190 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fc610103a10 tx=0x7fc6100ccb60 comp rx=0 tx=0).stop 2024-09-10T22:31:54.016 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:54.013+0000 7fc625227740 1 -- 172.21.15.19:0/1460967384 shutdown_connections 2024-09-10T22:31:54.016 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:54.013+0000 7fc625227740 1 --2- 172.21.15.19:0/1460967384 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55c7995a1bd0 0x55c7995abd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:31:54.016 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:54.013+0000 7fc625227740 1 --2- 172.21.15.19:0/1460967384 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x55c79961e290 0x55c7996206b0 crc :-1 s=READY pgs=127 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:31:54.016 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:54.013+0000 7fc625227740 1 --2- 172.21.15.19:0/1460967384 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55c79959f190 0x55c7995ab190 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:31:54.017 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:54.013+0000 7fc625227740 1 --2- 172.21.15.19:0/1460967384 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c79959c860 0x55c7995aaaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:31:54.017 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:54.013+0000 7fc625227740 1 -- 172.21.15.19:0/1460967384 >> 172.21.15.19:0/1460967384 conn(0x55c7995979b0 msgr2=0x55c7995a5130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:31:54.017 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:54.013+0000 7fc5fb7fe640 0 client.25927 ms_handle_reset on v2:172.21.15.135:6838/1254769802 2024-09-10T22:31:54.017 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:54.013+0000 7fc625227740 1 -- 172.21.15.19:0/1460967384 shutdown_connections 2024-09-10T22:31:54.017 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:54.013+0000 7fc625227740 1 -- 172.21.15.19:0/1460967384 wait complete. 2024-09-10T22:31:54.017 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:54.013+0000 7fc625227740 20 client.25927 trim_cache size 0 max 16384 2024-09-10T22:31:54.017 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stdout:{ 2024-09-10T22:31:54.017 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stdout: "message": "", 2024-09-10T22:31:54.017 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stdout: "return_code": 0 2024-09-10T22:31:54.018 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stdout:} 2024-09-10T22:31:54.019 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:54.014+0000 7fc622384640 1 -- 172.21.15.19:0/3162088290 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7fc6040b52e0 msgr2=0x7fc6040b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:31:54.019 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:54.014+0000 7fc622384640 1 --2- 172.21.15.19:0/3162088290 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7fc6040b52e0 0x7fc6040b77a0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7fc60c009620 tx=0x7fc60c005f90 comp rx=0 tx=0).stop 2024-09-10T22:31:54.019 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:54.014+0000 7fc622384640 1 -- 172.21.15.19:0/3162088290 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc61c103ad0 msgr2=0x7fc61c19b5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:31:54.019 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:54.014+0000 7fc622384640 1 --2- 172.21.15.19:0/3162088290 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc61c103ad0 0x7fc61c19b5c0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fc61002a860 tx=0x7fc610032d50 comp rx=0 tx=0).stop 2024-09-10T22:31:54.019 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:54.014+0000 7fc622384640 1 -- 172.21.15.19:0/3162088290 shutdown_connections 2024-09-10T22:31:54.019 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:54.014+0000 7fc622384640 1 --2- 172.21.15.19:0/3162088290 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7fc6040b52e0 0x7fc6040b77a0 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:31:54.020 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:54.014+0000 7fc622384640 1 --2- 172.21.15.19:0/3162088290 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc61c104490 0x7fc61c19c1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:31:54.020 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:54.014+0000 7fc622384640 1 --2- 172.21.15.19:0/3162088290 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc61c103ad0 0x7fc61c19b5c0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:31:54.020 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:54.014+0000 7fc622384640 1 --2- 172.21.15.19:0/3162088290 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc61c102980 0x7fc61c19af70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:31:54.020 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:54.014+0000 7fc622384640 1 -- 172.21.15.19:0/3162088290 >> 172.21.15.19:0/3162088290 conn(0x7fc61c0fe240 msgr2=0x7fc61c075380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:31:54.020 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:54.014+0000 7fc622384640 1 -- 172.21.15.19:0/3162088290 shutdown_connections 2024-09-10T22:31:54.020 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:31:54.014+0000 7fc622384640 1 -- 172.21.15.19:0/3162088290 wait complete. 2024-09-10T22:31:54.458 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:31:54 smithi019 ceph-mon[31375]: pgmap v511: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 577 KiB/s rd, 291 MiB/s wr, 202 op/s 2024-09-10T22:31:54.609 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:31:54 smithi135 ceph-mon[34789]: pgmap v511: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 577 KiB/s rd, 291 MiB/s wr, 202 op/s 2024-09-10T22:31:54.625 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:31:54 smithi138 ceph-mon[35236]: pgmap v511: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 577 KiB/s rd, 291 MiB/s wr, 202 op/s 2024-09-10T22:31:56.610 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:31:56 smithi135 ceph-mon[34789]: pgmap v512: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 854 KiB/s rd, 303 MiB/s wr, 202 op/s 2024-09-10T22:31:56.625 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:31:56 smithi138 ceph-mon[35236]: pgmap v512: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 854 KiB/s rd, 303 MiB/s wr, 202 op/s 2024-09-10T22:31:56.708 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:31:56 smithi019 ceph-mon[31375]: pgmap v512: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 854 KiB/s rd, 303 MiB/s wr, 202 op/s 2024-09-10T22:31:58.610 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:31:58 smithi135 ceph-mon[34789]: pgmap v513: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 855 KiB/s rd, 340 MiB/s wr, 219 op/s 2024-09-10T22:31:58.610 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:31:58 smithi135 ceph-mon[34789]: scrub summary: idle 2024-09-10T22:31:58.610 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:31:58 smithi135 ceph-mon[34789]: scrub summary: idle 2024-09-10T22:31:58.625 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:31:58 smithi138 ceph-mon[35236]: pgmap v513: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 855 KiB/s rd, 340 MiB/s wr, 219 op/s 2024-09-10T22:31:58.625 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:31:58 smithi138 ceph-mon[35236]: scrub summary: idle 2024-09-10T22:31:58.625 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:31:58 smithi138 ceph-mon[35236]: scrub summary: idle 2024-09-10T22:31:58.709 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:31:58 smithi019 ceph-mon[31375]: pgmap v513: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 855 KiB/s rd, 340 MiB/s wr, 219 op/s 2024-09-10T22:31:58.709 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:31:58 smithi019 ceph-mon[31375]: scrub summary: idle 2024-09-10T22:31:58.709 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:31:58 smithi019 ceph-mon[31375]: scrub summary: idle 2024-09-10T22:32:00.610 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:32:00 smithi135 ceph-mon[34789]: pgmap v514: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 689 KiB/s rd, 310 MiB/s wr, 198 op/s 2024-09-10T22:32:00.625 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:32:00 smithi138 ceph-mon[35236]: pgmap v514: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 689 KiB/s rd, 310 MiB/s wr, 198 op/s 2024-09-10T22:32:00.708 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:32:00 smithi019 ceph-mon[31375]: pgmap v514: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 689 KiB/s rd, 310 MiB/s wr, 198 op/s 2024-09-10T22:32:01.610 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:32:01 smithi135 ceph-mon[34789]: pgmap v515: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 903 KiB/s rd, 365 MiB/s wr, 227 op/s 2024-09-10T22:32:01.625 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:32:01 smithi138 ceph-mon[35236]: pgmap v515: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 903 KiB/s rd, 365 MiB/s wr, 227 op/s 2024-09-10T22:32:01.708 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:32:01 smithi019 ceph-mon[31375]: pgmap v515: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 903 KiB/s rd, 365 MiB/s wr, 227 op/s 2024-09-10T22:32:03.875 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:32:03 smithi138 ceph-mon[35236]: pgmap v516: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 558 KiB/s rd, 325 MiB/s wr, 190 op/s 2024-09-10T22:32:03.959 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:32:03 smithi019 ceph-mon[31375]: pgmap v516: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 558 KiB/s rd, 325 MiB/s wr, 190 op/s 2024-09-10T22:32:04.110 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:32:03 smithi135 ceph-mon[34789]: pgmap v516: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 558 KiB/s rd, 325 MiB/s wr, 190 op/s 2024-09-10T22:32:05.958 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:32:05 smithi019 ceph-mon[31375]: pgmap v517: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 686 KiB/s rd, 340 MiB/s wr, 195 op/s 2024-09-10T22:32:06.109 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:32:05 smithi135 ceph-mon[34789]: pgmap v517: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 686 KiB/s rd, 340 MiB/s wr, 195 op/s 2024-09-10T22:32:06.125 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:32:05 smithi138 ceph-mon[35236]: pgmap v517: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 686 KiB/s rd, 340 MiB/s wr, 195 op/s 2024-09-10T22:32:07.115 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:07.111+0000 7f4c4e452640 1 -- 172.21.15.19:0/381894879 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4c481029c0 msgr2=0x7f4c48102e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:32:07.115 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:07.111+0000 7f4c4e452640 1 --2- 172.21.15.19:0/381894879 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4c481029c0 0x7f4c48102e40 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7f4c30009930 tx=0x7f4c3002a420 comp rx=0 tx=0).stop 2024-09-10T22:32:07.115 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:07.111+0000 7f4c4e452640 1 -- 172.21.15.19:0/381894879 shutdown_connections 2024-09-10T22:32:07.115 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:07.111+0000 7f4c4e452640 1 --2- 172.21.15.19:0/381894879 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f4c48103380 0x7f4c48109d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:32:07.115 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:07.111+0000 7f4c4e452640 1 --2- 172.21.15.19:0/381894879 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4c481029c0 0x7f4c48102e40 unknown :-1 s=CLOSED pgs=642 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:32:07.115 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:07.111+0000 7f4c4e452640 1 --2- 172.21.15.19:0/381894879 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4c48101870 0x7f4c48101c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:32:07.115 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:07.111+0000 7f4c4e452640 1 -- 172.21.15.19:0/381894879 >> 172.21.15.19:0/381894879 conn(0x7f4c480fd130 msgr2=0x7f4c480ff550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:32:07.115 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:07.111+0000 7f4c4e452640 1 -- 172.21.15.19:0/381894879 shutdown_connections 2024-09-10T22:32:07.116 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:07.111+0000 7f4c4e452640 1 -- 172.21.15.19:0/381894879 wait complete. 2024-09-10T22:32:07.116 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:07.111+0000 7f4c4e452640 1 Processor -- start 2024-09-10T22:32:07.116 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:07.112+0000 7f4c4e452640 1 -- start start 2024-09-10T22:32:07.116 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:07.112+0000 7f4c4e452640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f4c48101870 0x7f4c48105630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:32:07.116 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:07.112+0000 7f4c4e452640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4c481029c0 0x7f4c48103e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:32:07.116 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:07.112+0000 7f4c4e452640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4c48103380 0x7f4c481043d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:32:07.116 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:07.112+0000 7f4c4e452640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f4c4810d4e0 con 0x7f4c481029c0 2024-09-10T22:32:07.116 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:07.112+0000 7f4c4e452640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f4c4810d360 con 0x7f4c48103380 2024-09-10T22:32:07.116 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:07.112+0000 7f4c4e452640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f4c4810d660 con 0x7f4c48101870 2024-09-10T22:32:07.116 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:07.112+0000 7f4c3ffff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4c481029c0 0x7f4c48103e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:32:07.116 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:07.112+0000 7f4c3ffff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4c481029c0 0x7f4c48103e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:48568/0 (socket says 172.21.15.19:48568) 2024-09-10T22:32:07.116 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:07.112+0000 7f4c3ffff640 1 -- 172.21.15.19:0/3249043378 learned_addr learned my addr 172.21.15.19:0/3249043378 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:32:07.116 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:07.112+0000 7f4c4c9ef640 1 --2- 172.21.15.19:0/3249043378 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4c48103380 0x7f4c481043d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:32:07.117 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:07.112+0000 7f4c47fff640 1 --2- 172.21.15.19:0/3249043378 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f4c48101870 0x7f4c48105630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:32:07.117 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:07.112+0000 7f4c3ffff640 1 -- 172.21.15.19:0/3249043378 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f4c48101870 msgr2=0x7f4c48105630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:32:07.117 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:07.112+0000 7f4c3ffff640 1 --2- 172.21.15.19:0/3249043378 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f4c48101870 0x7f4c48105630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:32:07.117 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:07.112+0000 7f4c3ffff640 1 -- 172.21.15.19:0/3249043378 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4c48103380 msgr2=0x7f4c481043d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:32:07.117 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:07.112+0000 7f4c3ffff640 1 --2- 172.21.15.19:0/3249043378 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4c48103380 0x7f4c481043d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:32:07.117 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:07.112+0000 7f4c3ffff640 1 -- 172.21.15.19:0/3249043378 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4c48104c40 con 0x7f4c481029c0 2024-09-10T22:32:07.117 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:07.112+0000 7f4c4c9ef640 1 --2- 172.21.15.19:0/3249043378 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4c48103380 0x7f4c481043d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T22:32:07.117 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:07.112+0000 7f4c3ffff640 1 --2- 172.21.15.19:0/3249043378 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4c481029c0 0x7f4c48103e90 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7f4c30009a50 tx=0x7f4c300042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:32:07.117 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:07.112+0000 7f4c45ffb640 1 -- 172.21.15.19:0/3249043378 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c3003f030 con 0x7f4c481029c0 2024-09-10T22:32:07.117 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:07.113+0000 7f4c45ffb640 1 -- 172.21.15.19:0/3249043378 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4c30003cb0 con 0x7f4c481029c0 2024-09-10T22:32:07.117 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:07.113+0000 7f4c4e452640 1 -- 172.21.15.19:0/3249043378 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4c481a2e20 con 0x7f4c481029c0 2024-09-10T22:32:07.117 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:07.113+0000 7f4c45ffb640 1 -- 172.21.15.19:0/3249043378 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c30035070 con 0x7f4c481029c0 2024-09-10T22:32:07.118 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:07.113+0000 7f4c4e452640 1 -- 172.21.15.19:0/3249043378 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4c481a3290 con 0x7f4c481029c0 2024-09-10T22:32:07.120 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:07.115+0000 7f4c45ffb640 1 -- 172.21.15.19:0/3249043378 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 18) ==== 153250+0+0 (secure 0 0 0) 0x7f4c3003bb90 con 0x7f4c481029c0 2024-09-10T22:32:07.121 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:07.116+0000 7f4c51221740 1 Processor -- start 2024-09-10T22:32:07.121 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:07.116+0000 7f4c51221740 1 -- start start 2024-09-10T22:32:07.121 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:07.116+0000 7f4c51221740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55f99127c860 0x55f99127ec50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:32:07.121 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:07.116+0000 7f4c51221740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f99127f190 0x55f991281580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:32:07.121 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:07.116+0000 7f4c51221740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55f991281bd0 0x55f991284090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:32:07.121 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:07.116+0000 7f4c51221740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x55f9911ee6f0 con 0x55f991281bd0 2024-09-10T22:32:07.121 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:07.116+0000 7f4c51221740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55f9911ddb20 con 0x55f99127f190 2024-09-10T22:32:07.121 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:07.116+0000 7f4c51221740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x55f9911e1930 con 0x55f99127c860 2024-09-10T22:32:07.121 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:07.116+0000 7f4c47fff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f99127f190 0x55f991281580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:32:07.121 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:07.117+0000 7f4c3ffff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55f991281bd0 0x55f991284090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:32:07.121 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:07.117+0000 7f4c4c9ef640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55f99127c860 0x55f99127ec50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:32:07.122 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:07.117+0000 7f4c4c9ef640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55f99127c860 0x55f99127ec50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.19:47774/0 (socket says 172.21.15.19:47774) 2024-09-10T22:32:07.122 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:07.117+0000 7f4c4c9ef640 1 -- 172.21.15.19:0/1173563148 learned_addr learned my addr 172.21.15.19:0/1173563148 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:32:07.122 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:07.117+0000 7f4c47fff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f99127f190 0x55f991281580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.19:52188/0 (socket says 172.21.15.19:52188) 2024-09-10T22:32:07.122 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:07.117+0000 7f4c4c9ef640 1 -- 172.21.15.19:0/1173563148 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f99127f190 msgr2=0x55f991281580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:32:07.122 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:07.117+0000 7f4c4c9ef640 1 --2- 172.21.15.19:0/1173563148 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f99127f190 0x55f991281580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:32:07.122 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:07.117+0000 7f4c4c9ef640 1 -- 172.21.15.19:0/1173563148 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55f991281bd0 msgr2=0x55f991284090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:32:07.122 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:07.117+0000 7f4c4c9ef640 1 --2- 172.21.15.19:0/1173563148 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55f991281bd0 0x55f991284090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:32:07.122 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:07.117+0000 7f4c4c9ef640 1 -- 172.21.15.19:0/1173563148 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f9911a3530 con 0x55f99127c860 2024-09-10T22:32:07.122 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:07.117+0000 7f4c45ffb640 1 --2- 172.21.15.19:0/3249043378 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f4c340b5360 0x7f4c340b7820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:32:07.122 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:07.117+0000 7f4c4c9ef640 1 --2- 172.21.15.19:0/1173563148 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55f99127c860 0x55f99127ec50 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f4c40010750 tx=0x7f4c40010c10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5a824222d181f48 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:32:07.122 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:07.118+0000 7f4c47fff640 1 --2- 172.21.15.19:0/3249043378 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f4c340b5360 0x7f4c340b7820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:32:07.122 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:07.118+0000 7f4c45ffb640 1 -- 172.21.15.19:0/3249043378 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8327+0+0 (secure 0 0 0) 0x7f4c30106800 con 0x7f4c481029c0 2024-09-10T22:32:07.122 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:07.118+0000 7f4c3e7fc640 1 -- 172.21.15.19:0/1173563148 <== mon.1 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c4000ead0 con 0x55f99127c860 2024-09-10T22:32:07.122 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:07.118+0000 7f4c3e7fc640 1 -- 172.21.15.19:0/1173563148 <== mon.1 v2:172.21.15.138:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4c40010e60 con 0x55f99127c860 2024-09-10T22:32:07.123 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:07.118+0000 7f4c3e7fc640 1 -- 172.21.15.19:0/1173563148 <== mon.1 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c40011640 con 0x55f99127c860 2024-09-10T22:32:07.123 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:07.119+0000 7f4c51221740 1 -- 172.21.15.19:0/1173563148 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55f99127c860 msgr2=0x55f99127ec50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:32:07.123 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:07.119+0000 7f4c51221740 1 --2- 172.21.15.19:0/1173563148 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55f99127c860 0x55f99127ec50 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f4c40010750 tx=0x7f4c40010c10 comp rx=0 tx=0).stop 2024-09-10T22:32:07.123 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:07.119+0000 7f4c47fff640 1 --2- 172.21.15.19:0/3249043378 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f4c340b5360 0x7f4c340b7820 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f4c38009da0 tx=0x7f4c38005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:32:07.123 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:07.119+0000 7f4c51221740 1 -- 172.21.15.19:0/1173563148 shutdown_connections 2024-09-10T22:32:07.123 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:07.119+0000 7f4c51221740 1 --2- 172.21.15.19:0/1173563148 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55f991281bd0 0x55f991284090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:32:07.123 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:07.119+0000 7f4c51221740 1 --2- 172.21.15.19:0/1173563148 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f99127f190 0x55f991281580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:32:07.123 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:07.119+0000 7f4c51221740 1 --2- 172.21.15.19:0/1173563148 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55f99127c860 0x55f99127ec50 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:32:07.123 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:07.119+0000 7f4c51221740 1 -- 172.21.15.19:0/1173563148 >> 172.21.15.19:0/1173563148 conn(0x55f9912779b0 msgr2=0x55f991278740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:32:07.123 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:07.119+0000 7f4c51221740 1 -- 172.21.15.19:0/1173563148 shutdown_connections 2024-09-10T22:32:07.123 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:07.119+0000 7f4c51221740 1 -- 172.21.15.19:0/1173563148 wait complete. 2024-09-10T22:32:07.123 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:07.119+0000 7f4c51221740 1 -- start start 2024-09-10T22:32:07.127 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:07.119+0000 7f4c51221740 1 Processor -- start 2024-09-10T22:32:07.127 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:07.120+0000 7f4c51221740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f99127c860 0x55f991285ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:32:07.127 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:07.120+0000 7f4c51221740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55f99127f190 0x55f991286570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:32:07.127 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:07.120+0000 7f4c51221740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55f991281bd0 0x55f991287140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:32:07.128 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:07.120+0000 7f4c51221740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x55f991115ab0 con 0x55f99127f190 2024-09-10T22:32:07.128 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:07.120+0000 7f4c51221740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55f991183730 con 0x55f99127c860 2024-09-10T22:32:07.128 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:07.120+0000 7f4c51221740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x55f991284bb0 con 0x55f991281bd0 2024-09-10T22:32:07.128 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:07.120+0000 7f4c51221740 10 client.0 _ll_register_callbacks cb 0x55f9911d76b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T22:32:07.128 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:07.120+0000 7f4c3ffff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55f99127f190 0x55f991286570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:32:07.128 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:07.120+0000 7f4c47fff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f99127c860 0x55f991285ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:32:07.128 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:07.120+0000 7f4c3ffff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55f99127f190 0x55f991286570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:48586/0 (socket says 172.21.15.19:48586) 2024-09-10T22:32:07.128 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:07.120+0000 7f4c3ffff640 1 -- 172.21.15.19:0/2634270169 learned_addr learned my addr 172.21.15.19:0/2634270169 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:32:07.128 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:07.120+0000 7f4c4c9ef640 1 --2- 172.21.15.19:0/2634270169 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55f991281bd0 0x55f991287140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:32:07.128 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:07.120+0000 7f4c3ffff640 1 -- 172.21.15.19:0/2634270169 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55f991281bd0 msgr2=0x55f991287140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:32:07.128 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:07.120+0000 7f4c3ffff640 1 --2- 172.21.15.19:0/2634270169 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55f991281bd0 0x55f991287140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:32:07.128 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:07.120+0000 7f4c3ffff640 1 -- 172.21.15.19:0/2634270169 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f99127c860 msgr2=0x55f991285ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:32:07.129 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:07.120+0000 7f4c3ffff640 1 --2- 172.21.15.19:0/2634270169 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f99127c860 0x55f991285ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:32:07.129 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:07.120+0000 7f4c3ffff640 1 -- 172.21.15.19:0/2634270169 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f990f3f790 con 0x55f99127f190 2024-09-10T22:32:07.129 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:07.120+0000 7f4c4c9ef640 1 --2- 172.21.15.19:0/2634270169 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55f991281bd0 0x55f991287140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T22:32:07.129 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:07.120+0000 7f4c3ffff640 1 --2- 172.21.15.19:0/2634270169 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55f99127f190 0x55f991286570 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7f4c300c95e0 tx=0x7f4c3003bf70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c7d848d4f1cd6a0d server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:32:07.129 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:07.120+0000 7f4c277fe640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-10T22:32:07.129 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:07.121+0000 7f4c277fe640 1 -- 172.21.15.19:0/2634270169 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c30049070 con 0x55f99127f190 2024-09-10T22:32:07.129 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:07.121+0000 7f4c277fe640 1 -- 172.21.15.19:0/2634270169 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8327+0+0 (secure 0 0 0) 0x7f4c300cd270 con 0x55f99127f190 2024-09-10T22:32:07.129 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:07.121+0000 7f4c51221740 1 -- 172.21.15.19:0/2634270169 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4c40010e60 con 0x55f99127f190 2024-09-10T22:32:07.129 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:07.121+0000 7f4c277fe640 1 -- 172.21.15.19:0/2634270169 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f4c300c8eb0 con 0x55f99127f190 2024-09-10T22:32:07.129 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:07.121+0000 7f4c51221740 10 client.16494 fetch_fsmap learned FSMap version 27 2024-09-10T22:32:07.129 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:07.121+0000 7f4c51221740 1 -- 172.21.15.19:0/2634270169 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55f990fb8620 con 0x55f99127f190 2024-09-10T22:32:07.129 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:07.121+0000 7f4c277fe640 1 -- 172.21.15.19:0/2634270169 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4c40010e60 con 0x55f99127f190 2024-09-10T22:32:07.129 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:07.121+0000 7f4c277fe640 1 -- 172.21.15.19:0/2634270169 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7f4c300d0070 con 0x55f99127f190 2024-09-10T22:32:07.129 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:07.121+0000 7f4c51221740 10 client.16494 fetch_fsmap finished waiting for FSMap version 27 2024-09-10T22:32:07.130 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:07.121+0000 7f4c51221740 10 client.16494 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-10T22:32:07.130 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:07.121+0000 7f4c51221740 20 client.16494 populate_metadata read hostname 'smithi019' 2024-09-10T22:32:07.130 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:07.121+0000 7f4c51221740 1 --2- 172.21.15.19:0/2634270169 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x55f991291750 0x55f991293b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:32:07.132 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:07.121+0000 7f4c51221740 4 client.16494 mds_command: new command op to 24581 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T22:32:07.132 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:07.121+0000 7f4c51221740 1 -- 172.21.15.19:0/2634270169 --> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f9911f0640 con 0x55f991291750 2024-09-10T22:32:07.132 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:07.121+0000 7f4c47fff640 1 --2- 172.21.15.19:0/2634270169 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x55f991291750 0x55f991293b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:32:07.132 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:07.122+0000 7f4c277fe640 10 client.16494 ms_handle_connect on v2:172.21.15.135:6838/1254769802 2024-09-10T22:32:07.132 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:07.122+0000 7f4c47fff640 1 --2- 172.21.15.19:0/2634270169 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x55f991291750 0x55f991293b40 crc :-1 s=READY pgs=128 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=18a05fb6af56aad0 server_cookie=9051096e2f42635f in_seq=0 out_seq=0 2024-09-10T22:32:07.132 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:07.122+0000 7f4c277fe640 1 -- 172.21.15.19:0/2634270169 <== mds.0 v2:172.21.15.135:6838/1254769802 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55f9911f0640 con 0x55f991291750 2024-09-10T22:32:07.132 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:07.122+0000 7f4c277fe640 10 client.16494 handle_command_reply: tid=0 2024-09-10T22:32:07.132 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:07.123+0000 7f4c51221740 1 client.16494 shutdown 2024-09-10T22:32:07.132 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:07.123+0000 7f4c51221740 1 -- 172.21.15.19:0/2634270169 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55f99127f190 msgr2=0x55f991286570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:32:07.133 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:07.123+0000 7f4c51221740 1 --2- 172.21.15.19:0/2634270169 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55f99127f190 0x55f991286570 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7f4c300c95e0 tx=0x7f4c3003bf70 comp rx=0 tx=0).stop 2024-09-10T22:32:07.133 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:07.123+0000 7f4c51221740 1 -- 172.21.15.19:0/2634270169 shutdown_connections 2024-09-10T22:32:07.133 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:07.123+0000 7f4c51221740 1 --2- 172.21.15.19:0/2634270169 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x55f991291750 0x55f991293b40 crc :-1 s=READY pgs=128 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:32:07.133 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:07.123+0000 7f4c51221740 1 --2- 172.21.15.19:0/2634270169 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55f991281bd0 0x55f991287140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:32:07.133 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:07.123+0000 7f4c51221740 1 --2- 172.21.15.19:0/2634270169 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55f99127f190 0x55f991286570 unknown :-1 s=CLOSED pgs=644 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:32:07.133 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:07.123+0000 7f4c51221740 1 --2- 172.21.15.19:0/2634270169 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f99127c860 0x55f991285ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:32:07.133 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:07.123+0000 7f4c51221740 1 -- 172.21.15.19:0/2634270169 >> 172.21.15.19:0/2634270169 conn(0x55f9912779b0 msgr2=0x55f991276bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:32:07.133 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:07.123+0000 7f4c277fe640 0 client.16494 ms_handle_reset on v2:172.21.15.135:6838/1254769802 2024-09-10T22:32:07.133 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:07.123+0000 7f4c51221740 1 -- 172.21.15.19:0/2634270169 shutdown_connections 2024-09-10T22:32:07.133 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:07.123+0000 7f4c51221740 1 -- 172.21.15.19:0/2634270169 wait complete. 2024-09-10T22:32:07.133 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:07.123+0000 7f4c51221740 20 client.16494 trim_cache size 0 max 16384 2024-09-10T22:32:07.141 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:07.138+0000 7f4c51221740 1 Processor -- start 2024-09-10T22:32:07.141 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:07.138+0000 7f4c51221740 1 -- start start 2024-09-10T22:32:07.141 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:07.138+0000 7f4c51221740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55f99127c860 0x55f99127aa00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:32:07.141 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:07.138+0000 7f4c51221740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55f99127f190 0x55f99127af40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:32:07.141 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:07.138+0000 7f4c51221740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f991281bd0 0x55f991285130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:32:07.141 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:07.138+0000 7f4c51221740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f4c481aeb30 con 0x55f99127c860 2024-09-10T22:32:07.141 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:07.138+0000 7f4c51221740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f4c481ac400 con 0x55f991281bd0 2024-09-10T22:32:07.141 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:07.138+0000 7f4c51221740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f4c481aa250 con 0x55f99127f190 2024-09-10T22:32:07.142 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:07.139+0000 7f4c47fff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55f99127c860 0x55f99127aa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:32:07.142 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:07.139+0000 7f4c3ffff640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55f99127f190 0x55f99127af40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:32:07.142 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:07.139+0000 7f4c4c9ef640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f991281bd0 0x55f991285130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:32:07.142 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:07.139+0000 7f4c3ffff640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55f99127f190 0x55f99127af40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.19:47782/0 (socket says 172.21.15.19:47782) 2024-09-10T22:32:07.142 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:07.139+0000 7f4c3ffff640 1 -- 172.21.15.19:0/1516820262 learned_addr learned my addr 172.21.15.19:0/1516820262 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:32:07.142 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:07.139+0000 7f4c47fff640 1 --2- 172.21.15.19:0/1516820262 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55f99127c860 0x55f99127aa00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:48600/0 (socket says 172.21.15.19:48600) 2024-09-10T22:32:07.142 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:07.139+0000 7f4c3ffff640 1 -- 172.21.15.19:0/1516820262 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f991281bd0 msgr2=0x55f991285130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:32:07.142 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:07.139+0000 7f4c3ffff640 1 --2- 172.21.15.19:0/1516820262 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f991281bd0 0x55f991285130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:32:07.142 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:07.139+0000 7f4c3ffff640 1 -- 172.21.15.19:0/1516820262 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55f99127c860 msgr2=0x55f99127aa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:32:07.142 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:07.139+0000 7f4c3ffff640 1 --2- 172.21.15.19:0/1516820262 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55f99127c860 0x55f99127aa00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:32:07.142 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:07.139+0000 7f4c3ffff640 1 -- 172.21.15.19:0/1516820262 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f991286e30 con 0x55f99127f190 2024-09-10T22:32:07.142 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:07.139+0000 7f4c47fff640 1 --2- 172.21.15.19:0/1516820262 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55f99127c860 0x55f99127aa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T22:32:07.142 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:07.139+0000 7f4c3ffff640 1 --2- 172.21.15.19:0/1516820262 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55f99127f190 0x55f99127af40 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f4c30004650 tx=0x7f4c30106b90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=87e091f3b19c21ce server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:32:07.142 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:07.139+0000 7f4c3dffb640 1 -- 172.21.15.19:0/1516820262 <== mon.1 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c30049070 con 0x55f99127f190 2024-09-10T22:32:07.143 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:07.139+0000 7f4c3dffb640 1 -- 172.21.15.19:0/1516820262 <== mon.1 v2:172.21.15.138:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4c300ccb20 con 0x55f99127f190 2024-09-10T22:32:07.143 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:07.139+0000 7f4c3dffb640 1 -- 172.21.15.19:0/1516820262 <== mon.1 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c300cc780 con 0x55f99127f190 2024-09-10T22:32:07.146 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:07.140+0000 7f4c51221740 1 -- 172.21.15.19:0/1516820262 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55f99127f190 msgr2=0x55f99127af40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:32:07.146 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:07.140+0000 7f4c51221740 1 --2- 172.21.15.19:0/1516820262 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55f99127f190 0x55f99127af40 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f4c30004650 tx=0x7f4c30106b90 comp rx=0 tx=0).stop 2024-09-10T22:32:07.146 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:07.140+0000 7f4c51221740 1 -- 172.21.15.19:0/1516820262 shutdown_connections 2024-09-10T22:32:07.146 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:07.140+0000 7f4c51221740 1 --2- 172.21.15.19:0/1516820262 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f991281bd0 0x55f991285130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:32:07.146 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:07.140+0000 7f4c51221740 1 --2- 172.21.15.19:0/1516820262 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55f99127f190 0x55f99127af40 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:32:07.146 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:07.140+0000 7f4c51221740 1 --2- 172.21.15.19:0/1516820262 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55f99127c860 0x55f99127aa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:32:07.147 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:07.140+0000 7f4c51221740 1 -- 172.21.15.19:0/1516820262 >> 172.21.15.19:0/1516820262 conn(0x55f9912779b0 msgr2=0x55f99127bcf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:32:07.147 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:07.140+0000 7f4c51221740 1 -- 172.21.15.19:0/1516820262 shutdown_connections 2024-09-10T22:32:07.147 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:07.140+0000 7f4c51221740 1 -- 172.21.15.19:0/1516820262 wait complete. 2024-09-10T22:32:07.147 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:07.140+0000 7f4c51221740 1 -- start start 2024-09-10T22:32:07.147 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:07.141+0000 7f4c51221740 1 Processor -- start 2024-09-10T22:32:07.147 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:07.141+0000 7f4c51221740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55f99127c860 0x55f99128d8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:32:07.147 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:07.141+0000 7f4c51221740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55f99127f190 0x55f99128c5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:32:07.147 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:07.141+0000 7f4c51221740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f991281bd0 0x55f99128caf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:32:07.147 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:07.141+0000 7f4c51221740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f4c481aa8c0 con 0x55f99127c860 2024-09-10T22:32:07.147 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:07.141+0000 7f4c51221740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f4c481abd30 con 0x55f991281bd0 2024-09-10T22:32:07.147 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:07.141+0000 7f4c51221740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f4c481aaf90 con 0x55f99127f190 2024-09-10T22:32:07.147 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:07.141+0000 7f4c51221740 10 client.0 _ll_register_callbacks cb 0x7f4c3010c240 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T22:32:07.147 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:07.141+0000 7f4c47fff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55f99127c860 0x55f99128d8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:32:07.148 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:07.141+0000 7f4c47fff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55f99127c860 0x55f99128d8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:48606/0 (socket says 172.21.15.19:48606) 2024-09-10T22:32:07.148 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:07.141+0000 7f4c47fff640 1 -- 172.21.15.19:0/2725702375 learned_addr learned my addr 172.21.15.19:0/2725702375 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:32:07.148 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:07.141+0000 7f4c3ffff640 1 --2- 172.21.15.19:0/2725702375 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55f99127f190 0x55f99128c5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:32:07.148 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:07.141+0000 7f4c4c9ef640 1 --2- 172.21.15.19:0/2725702375 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f991281bd0 0x55f99128caf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:32:07.148 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:07.141+0000 7f4c47fff640 1 -- 172.21.15.19:0/2725702375 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55f99127f190 msgr2=0x55f99128c5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:32:07.148 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:07.141+0000 7f4c47fff640 1 --2- 172.21.15.19:0/2725702375 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55f99127f190 0x55f99128c5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:32:07.148 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:07.141+0000 7f4c47fff640 1 -- 172.21.15.19:0/2725702375 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f991281bd0 msgr2=0x55f99128caf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:32:07.148 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:07.141+0000 7f4c47fff640 1 --2- 172.21.15.19:0/2725702375 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f991281bd0 0x55f99128caf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:32:07.148 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:07.141+0000 7f4c47fff640 1 -- 172.21.15.19:0/2725702375 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f99128d200 con 0x55f99127c860 2024-09-10T22:32:07.148 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:07.141+0000 7f4c3ffff640 1 --2- 172.21.15.19:0/2725702375 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55f99127f190 0x55f99128c5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T22:32:07.148 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:07.142+0000 7f4c277fe640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-10T22:32:07.148 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:07.141+0000 7f4c47fff640 1 --2- 172.21.15.19:0/2725702375 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55f99127c860 0x55f99128d8b0 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7f4c38009b80 tx=0x7f4c380046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f474c75bebc9817b server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:32:07.148 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:07.142+0000 7f4c277fe640 1 -- 172.21.15.19:0/2725702375 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c3801f9e0 con 0x55f99127c860 2024-09-10T22:32:07.149 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:07.142+0000 7f4c277fe640 1 -- 172.21.15.19:0/2725702375 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8327+0+0 (secure 0 0 0) 0x7f4c38018030 con 0x55f99127c860 2024-09-10T22:32:07.149 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:07.142+0000 7f4c51221740 1 -- 172.21.15.19:0/2725702375 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4c300ccb20 con 0x55f99127c860 2024-09-10T22:32:07.149 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:07.142+0000 7f4c277fe640 1 -- 172.21.15.19:0/2725702375 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f4c3801fb80 con 0x55f99127c860 2024-09-10T22:32:07.149 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:07.142+0000 7f4c51221740 10 client.16500 fetch_fsmap learned FSMap version 27 2024-09-10T22:32:07.149 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:07.142+0000 7f4c51221740 1 -- 172.21.15.19:0/2725702375 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55f9912fe6b0 con 0x55f99127c860 2024-09-10T22:32:07.149 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:07.142+0000 7f4c277fe640 1 -- 172.21.15.19:0/2725702375 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4c300ccb20 con 0x55f99127c860 2024-09-10T22:32:07.149 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:07.142+0000 7f4c277fe640 1 -- 172.21.15.19:0/2725702375 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7f4c380049c0 con 0x55f99127c860 2024-09-10T22:32:07.149 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:07.142+0000 7f4c51221740 10 client.16500 fetch_fsmap finished waiting for FSMap version 27 2024-09-10T22:32:07.149 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:07.142+0000 7f4c51221740 10 client.16500 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-10T22:32:07.149 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:07.142+0000 7f4c51221740 20 client.16500 populate_metadata read hostname 'smithi019' 2024-09-10T22:32:07.149 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:07.142+0000 7f4c51221740 1 --2- 172.21.15.19:0/2725702375 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x55f9912ff0c0 0x55f9913014e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:32:07.149 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:07.142+0000 7f4c51221740 4 client.16500 mds_command: new command op to 24581 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-10T22:32:07.149 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:07.142+0000 7f4c51221740 1 -- 172.21.15.19:0/2725702375 --> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55f9911ec0f0 con 0x55f9912ff0c0 2024-09-10T22:32:07.149 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:07.142+0000 7f4c3ffff640 1 --2- 172.21.15.19:0/2725702375 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x55f9912ff0c0 0x55f9913014e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:32:07.150 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:07.143+0000 7f4c277fe640 10 client.16500 ms_handle_connect on v2:172.21.15.135:6838/1254769802 2024-09-10T22:32:07.150 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:07.143+0000 7f4c3ffff640 1 --2- 172.21.15.19:0/2725702375 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x55f9912ff0c0 0x55f9913014e0 crc :-1 s=READY pgs=129 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b148c5a67c3018ab server_cookie=437a1082f7bea4a in_seq=0 out_seq=0 2024-09-10T22:32:07.958 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:32:07 smithi019 ceph-mon[31375]: pgmap v518: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 578 KiB/s rd, 364 MiB/s wr, 213 op/s 2024-09-10T22:32:08.109 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:32:07 smithi135 ceph-mon[34789]: pgmap v518: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 578 KiB/s rd, 364 MiB/s wr, 213 op/s 2024-09-10T22:32:08.125 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:32:07 smithi138 ceph-mon[35236]: pgmap v518: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 578 KiB/s rd, 364 MiB/s wr, 213 op/s 2024-09-10T22:32:09.450 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:09.448+0000 7f4c277fe640 1 -- 172.21.15.19:0/2725702375 <== mds.0 v2:172.21.15.135:6838/1254769802 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55f9911ec0f0 con 0x55f9912ff0c0 2024-09-10T22:32:09.450 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:09.448+0000 7f4c277fe640 10 client.16500 handle_command_reply: tid=0 2024-09-10T22:32:09.450 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:09.448+0000 7f4c51221740 1 client.16500 shutdown 2024-09-10T22:32:09.450 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:09.448+0000 7f4c51221740 1 -- 172.21.15.19:0/2725702375 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55f99127c860 msgr2=0x55f99128d8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:32:09.450 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:09.448+0000 7f4c51221740 1 --2- 172.21.15.19:0/2725702375 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55f99127c860 0x55f99128d8b0 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7f4c38009b80 tx=0x7f4c380046c0 comp rx=0 tx=0).stop 2024-09-10T22:32:09.451 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:09.448+0000 7f4c51221740 1 -- 172.21.15.19:0/2725702375 shutdown_connections 2024-09-10T22:32:09.451 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:09.448+0000 7f4c51221740 1 --2- 172.21.15.19:0/2725702375 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f991281bd0 0x55f99128caf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:32:09.451 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:09.448+0000 7f4c51221740 1 --2- 172.21.15.19:0/2725702375 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x55f9912ff0c0 0x55f9913014e0 crc :-1 s=READY pgs=129 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:32:09.451 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:09.448+0000 7f4c51221740 1 --2- 172.21.15.19:0/2725702375 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55f99127f190 0x55f99128c5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:32:09.451 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:09.448+0000 7f4c51221740 1 --2- 172.21.15.19:0/2725702375 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55f99127c860 0x55f99128d8b0 unknown :-1 s=CLOSED pgs=645 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:32:09.451 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:09.448+0000 7f4c277fe640 0 client.16500 ms_handle_reset on v2:172.21.15.135:6838/1254769802 2024-09-10T22:32:09.452 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:09.448+0000 7f4c51221740 1 -- 172.21.15.19:0/2725702375 >> 172.21.15.19:0/2725702375 conn(0x55f9912779b0 msgr2=0x55f991285130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:32:09.452 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:09.448+0000 7f4c51221740 1 -- 172.21.15.19:0/2725702375 shutdown_connections 2024-09-10T22:32:09.452 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:09.448+0000 7f4c51221740 1 -- 172.21.15.19:0/2725702375 wait complete. 2024-09-10T22:32:09.452 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:09.448+0000 7f4c51221740 20 client.16500 trim_cache size 0 max 16384 2024-09-10T22:32:09.452 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stdout:{ 2024-09-10T22:32:09.452 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stdout: "message": "", 2024-09-10T22:32:09.452 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stdout: "return_code": 0 2024-09-10T22:32:09.453 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stdout:} 2024-09-10T22:32:09.453 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:09.449+0000 7f4c4e452640 1 -- 172.21.15.19:0/3249043378 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f4c340b5360 msgr2=0x7f4c340b7820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:32:09.453 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:09.449+0000 7f4c4e452640 1 --2- 172.21.15.19:0/3249043378 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f4c340b5360 0x7f4c340b7820 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f4c38009da0 tx=0x7f4c38005f90 comp rx=0 tx=0).stop 2024-09-10T22:32:09.453 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:09.449+0000 7f4c4e452640 1 -- 172.21.15.19:0/3249043378 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4c481029c0 msgr2=0x7f4c48103e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:32:09.453 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:09.449+0000 7f4c4e452640 1 --2- 172.21.15.19:0/3249043378 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4c481029c0 0x7f4c48103e90 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7f4c30009a50 tx=0x7f4c300042f0 comp rx=0 tx=0).stop 2024-09-10T22:32:09.454 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:09.449+0000 7f4c4e452640 1 -- 172.21.15.19:0/3249043378 shutdown_connections 2024-09-10T22:32:09.454 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:09.449+0000 7f4c4e452640 1 --2- 172.21.15.19:0/3249043378 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f4c340b5360 0x7f4c340b7820 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:32:09.454 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:09.449+0000 7f4c4e452640 1 --2- 172.21.15.19:0/3249043378 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4c48103380 0x7f4c481043d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:32:09.454 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:09.449+0000 7f4c4e452640 1 --2- 172.21.15.19:0/3249043378 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4c481029c0 0x7f4c48103e90 unknown :-1 s=CLOSED pgs=643 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:32:09.454 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:09.449+0000 7f4c4e452640 1 --2- 172.21.15.19:0/3249043378 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f4c48101870 0x7f4c48105630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:32:09.454 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:09.449+0000 7f4c4e452640 1 -- 172.21.15.19:0/3249043378 >> 172.21.15.19:0/3249043378 conn(0x7f4c480fd130 msgr2=0x7f4c480feba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:32:09.454 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:09.449+0000 7f4c4e452640 1 -- 172.21.15.19:0/3249043378 shutdown_connections 2024-09-10T22:32:09.454 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:09.449+0000 7f4c4e452640 1 -- 172.21.15.19:0/3249043378 wait complete. 2024-09-10T22:32:10.109 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:32:09 smithi135 ceph-mon[34789]: pgmap v519: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 577 KiB/s rd, 318 MiB/s wr, 191 op/s 2024-09-10T22:32:10.125 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:32:09 smithi138 ceph-mon[35236]: pgmap v519: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 577 KiB/s rd, 318 MiB/s wr, 191 op/s 2024-09-10T22:32:10.208 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:32:09 smithi019 ceph-mon[31375]: pgmap v519: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 577 KiB/s rd, 318 MiB/s wr, 191 op/s 2024-09-10T22:32:12.110 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:32:11 smithi135 ceph-mon[34789]: pgmap v520: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 816 KiB/s rd, 357 MiB/s wr, 238 op/s 2024-09-10T22:32:12.125 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:32:11 smithi138 ceph-mon[35236]: pgmap v520: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 816 KiB/s rd, 357 MiB/s wr, 238 op/s 2024-09-10T22:32:12.209 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:32:11 smithi019 ceph-mon[31375]: pgmap v520: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 816 KiB/s rd, 357 MiB/s wr, 238 op/s 2024-09-10T22:32:14.209 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:32:13 smithi019 ceph-mon[31375]: pgmap v521: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 601 KiB/s rd, 305 MiB/s wr, 217 op/s 2024-09-10T22:32:14.360 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:32:13 smithi135 ceph-mon[34789]: pgmap v521: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 601 KiB/s rd, 305 MiB/s wr, 217 op/s 2024-09-10T22:32:14.375 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:32:13 smithi138 ceph-mon[35236]: pgmap v521: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 601 KiB/s rd, 305 MiB/s wr, 217 op/s 2024-09-10T22:32:16.209 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:32:15 smithi019 ceph-mon[31375]: pgmap v522: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 601 KiB/s rd, 304 MiB/s wr, 221 op/s 2024-09-10T22:32:16.361 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:32:15 smithi135 ceph-mon[34789]: pgmap v522: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 601 KiB/s rd, 304 MiB/s wr, 221 op/s 2024-09-10T22:32:16.375 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:32:15 smithi138 ceph-mon[35236]: pgmap v522: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 601 KiB/s rd, 304 MiB/s wr, 221 op/s 2024-09-10T22:32:18.360 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:32:17 smithi135 ceph-mon[34789]: pgmap v523: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 755 KiB/s rd, 325 MiB/s wr, 237 op/s 2024-09-10T22:32:18.375 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:32:17 smithi138 ceph-mon[35236]: pgmap v523: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 755 KiB/s rd, 325 MiB/s wr, 237 op/s 2024-09-10T22:32:18.458 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:32:17 smithi019 ceph-mon[31375]: pgmap v523: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 755 KiB/s rd, 325 MiB/s wr, 237 op/s 2024-09-10T22:32:20.359 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:32:19 smithi135 ceph-mon[34789]: pgmap v524: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 586 KiB/s rd, 285 MiB/s wr, 206 op/s 2024-09-10T22:32:20.375 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:32:19 smithi138 ceph-mon[35236]: pgmap v524: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 586 KiB/s rd, 285 MiB/s wr, 206 op/s 2024-09-10T22:32:20.458 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:32:19 smithi019 ceph-mon[31375]: pgmap v524: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 586 KiB/s rd, 285 MiB/s wr, 206 op/s 2024-09-10T22:32:21.946 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 22997a4c-6fc2-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-10T22:32:22.298 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/22997a4c-6fc2-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T22:32:22.360 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:32:21 smithi135 ceph-mon[34789]: pgmap v525: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 878 KiB/s rd, 334 MiB/s wr, 226 op/s 2024-09-10T22:32:22.375 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:32:21 smithi138 ceph-mon[35236]: pgmap v525: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 878 KiB/s rd, 334 MiB/s wr, 226 op/s 2024-09-10T22:32:22.447 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:32:21 smithi019 ceph-mon[31375]: pgmap v525: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 878 KiB/s rd, 334 MiB/s wr, 226 op/s 2024-09-10T22:32:22.555 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:22.553+0000 7ff76b27f640 1 -- 172.21.15.19:0/569571818 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff7641029c0 msgr2=0x7ff764102e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:32:22.555 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:22.553+0000 7ff76b27f640 1 --2- 172.21.15.19:0/569571818 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff7641029c0 0x7ff764102e40 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7ff754009930 tx=0x7ff75402a420 comp rx=0 tx=0).stop 2024-09-10T22:32:22.555 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:22.553+0000 7ff76b27f640 1 -- 172.21.15.19:0/569571818 shutdown_connections 2024-09-10T22:32:22.555 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:22.553+0000 7ff76b27f640 1 --2- 172.21.15.19:0/569571818 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff764103380 0x7ff764109d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:32:22.555 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:22.553+0000 7ff76b27f640 1 --2- 172.21.15.19:0/569571818 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff7641029c0 0x7ff764102e40 unknown :-1 s=CLOSED pgs=646 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:32:22.556 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:22.553+0000 7ff76b27f640 1 --2- 172.21.15.19:0/569571818 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff764101870 0x7ff764101c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:32:22.556 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:22.553+0000 7ff76b27f640 1 -- 172.21.15.19:0/569571818 >> 172.21.15.19:0/569571818 conn(0x7ff7640fd130 msgr2=0x7ff7640ff550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:32:22.556 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:22.553+0000 7ff76b27f640 1 -- 172.21.15.19:0/569571818 shutdown_connections 2024-09-10T22:32:22.556 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:22.553+0000 7ff76b27f640 1 -- 172.21.15.19:0/569571818 wait complete. 2024-09-10T22:32:22.558 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:22.554+0000 7ff76b27f640 1 Processor -- start 2024-09-10T22:32:22.558 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:22.554+0000 7ff76b27f640 1 -- start start 2024-09-10T22:32:22.558 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:22.554+0000 7ff76b27f640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff764101870 0x7ff764198e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:32:22.558 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:22.554+0000 7ff76b27f640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff7641029c0 0x7ff764199450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:32:22.558 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:22.554+0000 7ff76b27f640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff764103380 0x7ff76419a080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:32:22.558 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:22.554+0000 7ff76b27f640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7ff76410d530 con 0x7ff764103380 2024-09-10T22:32:22.559 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:22.554+0000 7ff76b27f640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7ff76410d3b0 con 0x7ff764101870 2024-09-10T22:32:22.559 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:22.554+0000 7ff76b27f640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7ff76410d6b0 con 0x7ff7641029c0 2024-09-10T22:32:22.559 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:22.554+0000 7ff76901b640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff764101870 0x7ff764198e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:32:22.559 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:22.554+0000 7ff76981c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff764103380 0x7ff76419a080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:32:22.559 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:22.554+0000 7ff76981c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff764103380 0x7ff76419a080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:47554/0 (socket says 172.21.15.19:47554) 2024-09-10T22:32:22.559 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:22.554+0000 7ff76901b640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff764101870 0x7ff764198e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.19:37354/0 (socket says 172.21.15.19:37354) 2024-09-10T22:32:22.559 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:22.554+0000 7ff76981c640 1 -- 172.21.15.19:0/1019252257 learned_addr learned my addr 172.21.15.19:0/1019252257 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:32:22.559 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:22.554+0000 7ff76881a640 1 --2- 172.21.15.19:0/1019252257 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff7641029c0 0x7ff764199450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:32:22.559 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:22.555+0000 7ff76981c640 1 -- 172.21.15.19:0/1019252257 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff7641029c0 msgr2=0x7ff764199450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:32:22.559 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:22.555+0000 7ff76981c640 1 --2- 172.21.15.19:0/1019252257 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff7641029c0 0x7ff764199450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:32:22.559 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:22.555+0000 7ff76981c640 1 -- 172.21.15.19:0/1019252257 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff764101870 msgr2=0x7ff764198e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:32:22.559 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:22.555+0000 7ff76981c640 1 --2- 172.21.15.19:0/1019252257 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff764101870 0x7ff764198e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:32:22.559 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:22.555+0000 7ff76981c640 1 -- 172.21.15.19:0/1019252257 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff76419a940 con 0x7ff764103380 2024-09-10T22:32:22.560 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:22.555+0000 7ff76901b640 1 --2- 172.21.15.19:0/1019252257 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff764101870 0x7ff764198e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T22:32:22.560 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:22.555+0000 7ff76981c640 1 --2- 172.21.15.19:0/1019252257 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff764103380 0x7ff76419a080 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7ff75c00efd0 tx=0x7ff75c00c6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:32:22.560 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:22.555+0000 7ff75a7fc640 1 -- 172.21.15.19:0/1019252257 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff75c003b70 con 0x7ff764103380 2024-09-10T22:32:22.560 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:22.555+0000 7ff75a7fc640 1 -- 172.21.15.19:0/1019252257 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff75c003d10 con 0x7ff764103380 2024-09-10T22:32:22.560 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:22.555+0000 7ff75a7fc640 1 -- 172.21.15.19:0/1019252257 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff75c0108a0 con 0x7ff764103380 2024-09-10T22:32:22.560 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:22.555+0000 7ff76b27f640 1 -- 172.21.15.19:0/1019252257 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff76419ac30 con 0x7ff764103380 2024-09-10T22:32:22.560 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:22.555+0000 7ff76b27f640 1 -- 172.21.15.19:0/1019252257 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff7641a1300 con 0x7ff764103380 2024-09-10T22:32:22.563 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:22.558+0000 7ff75a7fc640 1 -- 172.21.15.19:0/1019252257 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 18) ==== 153250+0+0 (secure 0 0 0) 0x7ff75c01f020 con 0x7ff764103380 2024-09-10T22:32:22.563 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:22.558+0000 7ff76e052740 1 Processor -- start 2024-09-10T22:32:22.563 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:22.558+0000 7ff76e052740 1 -- start start 2024-09-10T22:32:22.564 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:22.559+0000 7ff76e052740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x56195d7c3860 0x56195d7c5c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:32:22.564 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:22.559+0000 7ff76e052740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56195d7c6190 0x56195d7c8580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:32:22.564 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:22.559+0000 7ff76e052740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56195d7c8bd0 0x56195d7cb090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:32:22.564 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:22.559+0000 7ff76e052740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x56195d7356f0 con 0x56195d7c8bd0 2024-09-10T22:32:22.564 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:22.559+0000 7ff76e052740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x56195d724b20 con 0x56195d7c6190 2024-09-10T22:32:22.564 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:22.559+0000 7ff76e052740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x56195d728930 con 0x56195d7c3860 2024-09-10T22:32:22.564 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:22.559+0000 7ff76901b640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56195d7c6190 0x56195d7c8580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:32:22.564 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:22.559+0000 7ff76881a640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x56195d7c3860 0x56195d7c5c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:32:22.564 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:22.559+0000 7ff76901b640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56195d7c6190 0x56195d7c8580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.19:37366/0 (socket says 172.21.15.19:37366) 2024-09-10T22:32:22.564 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:22.559+0000 7ff76901b640 1 -- 172.21.15.19:0/4042627032 learned_addr learned my addr 172.21.15.19:0/4042627032 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:32:22.564 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:22.559+0000 7ff76881a640 1 --2- 172.21.15.19:0/4042627032 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56195d7c8bd0 0x56195d7cb090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:32:22.564 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:22.559+0000 7ff76901b640 1 -- 172.21.15.19:0/4042627032 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x56195d7c3860 msgr2=0x56195d7c5c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:32:22.564 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:22.559+0000 7ff76901b640 1 --2- 172.21.15.19:0/4042627032 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x56195d7c3860 0x56195d7c5c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:32:22.565 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:22.559+0000 7ff76901b640 1 -- 172.21.15.19:0/4042627032 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56195d7c8bd0 msgr2=0x56195d7cb090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:32:22.565 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:22.559+0000 7ff76901b640 1 --2- 172.21.15.19:0/4042627032 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56195d7c8bd0 0x56195d7cb090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:32:22.565 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:22.559+0000 7ff76901b640 1 -- 172.21.15.19:0/4042627032 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56195d6ea530 con 0x56195d7c6190 2024-09-10T22:32:22.565 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:22.559+0000 7ff76881a640 1 --2- 172.21.15.19:0/4042627032 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x56195d7c3860 0x56195d7c5c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T22:32:22.565 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:22.559+0000 7ff75a7fc640 1 --2- 172.21.15.19:0/1019252257 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7ff7500b5360 0x7ff7500b7820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:32:22.565 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:22.560+0000 7ff76881a640 1 --2- 172.21.15.19:0/1019252257 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7ff7500b5360 0x7ff7500b7820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:32:22.565 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:22.560+0000 7ff76901b640 1 --2- 172.21.15.19:0/4042627032 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56195d7c6190 0x56195d7c8580 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7ff7600115c0 tx=0x7ff760011a80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=acaa0564e9eafc7f server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:32:22.565 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:22.560+0000 7ff75a7fc640 1 -- 172.21.15.19:0/1019252257 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8327+0+0 (secure 0 0 0) 0x7ff75c0e5c90 con 0x7ff764103380 2024-09-10T22:32:22.565 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:22.560+0000 7ff74f7fe640 1 -- 172.21.15.19:0/4042627032 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff76000f640 con 0x56195d7c6190 2024-09-10T22:32:22.565 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:22.560+0000 7ff74f7fe640 1 -- 172.21.15.19:0/4042627032 <== mon.2 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff76000fc90 con 0x56195d7c6190 2024-09-10T22:32:22.565 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:22.560+0000 7ff74f7fe640 1 -- 172.21.15.19:0/4042627032 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff760019bf0 con 0x56195d7c6190 2024-09-10T22:32:22.566 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:22.561+0000 7ff76881a640 1 --2- 172.21.15.19:0/1019252257 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7ff7500b5360 0x7ff7500b7820 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7ff754005ab0 tx=0x7ff754005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:32:22.566 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:22.561+0000 7ff76e052740 1 -- 172.21.15.19:0/4042627032 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56195d7c6190 msgr2=0x56195d7c8580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:32:22.566 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:22.561+0000 7ff76e052740 1 --2- 172.21.15.19:0/4042627032 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56195d7c6190 0x56195d7c8580 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7ff7600115c0 tx=0x7ff760011a80 comp rx=0 tx=0).stop 2024-09-10T22:32:22.566 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:22.561+0000 7ff76e052740 1 -- 172.21.15.19:0/4042627032 shutdown_connections 2024-09-10T22:32:22.566 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:22.561+0000 7ff76e052740 1 --2- 172.21.15.19:0/4042627032 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56195d7c8bd0 0x56195d7cb090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:32:22.566 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:22.561+0000 7ff76e052740 1 --2- 172.21.15.19:0/4042627032 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56195d7c6190 0x56195d7c8580 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:32:22.566 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:22.561+0000 7ff76e052740 1 --2- 172.21.15.19:0/4042627032 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x56195d7c3860 0x56195d7c5c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:32:22.566 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:22.561+0000 7ff76e052740 1 -- 172.21.15.19:0/4042627032 >> 172.21.15.19:0/4042627032 conn(0x56195d7be9b0 msgr2=0x56195d7bf740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:32:22.566 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:22.561+0000 7ff76e052740 1 -- 172.21.15.19:0/4042627032 shutdown_connections 2024-09-10T22:32:22.566 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:22.561+0000 7ff76e052740 1 -- 172.21.15.19:0/4042627032 wait complete. 2024-09-10T22:32:22.566 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:22.562+0000 7ff76e052740 1 -- start start 2024-09-10T22:32:22.566 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:22.562+0000 7ff76e052740 1 Processor -- start 2024-09-10T22:32:22.570 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:22.562+0000 7ff76e052740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56195d7c3860 0x56195d7ccfc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:32:22.570 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:22.562+0000 7ff76e052740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x56195d7c6190 0x56195d7cd660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:32:22.570 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:22.563+0000 7ff76e052740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56195d7c8bd0 0x56195d7ce1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:32:22.570 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:22.563+0000 7ff76e052740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x56195d65cab0 con 0x56195d7c8bd0 2024-09-10T22:32:22.570 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:22.563+0000 7ff76e052740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x56195d6ca730 con 0x56195d7c3860 2024-09-10T22:32:22.570 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:22.563+0000 7ff76e052740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x56195d7cbbb0 con 0x56195d7c6190 2024-09-10T22:32:22.571 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:22.563+0000 7ff76e052740 10 client.0 _ll_register_callbacks cb 0x56195d71e6b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T22:32:22.571 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:22.563+0000 7ff76881a640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x56195d7c6190 0x56195d7cd660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:32:22.571 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:22.563+0000 7ff76881a640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x56195d7c6190 0x56195d7cd660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.19:40314/0 (socket says 172.21.15.19:40314) 2024-09-10T22:32:22.571 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:22.563+0000 7ff76881a640 1 -- 172.21.15.19:0/4212175438 learned_addr learned my addr 172.21.15.19:0/4212175438 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:32:22.571 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:22.563+0000 7ff76981c640 1 --2- 172.21.15.19:0/4212175438 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56195d7c8bd0 0x56195d7ce1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:32:22.571 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:22.563+0000 7ff76901b640 1 --2- 172.21.15.19:0/4212175438 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56195d7c3860 0x56195d7ccfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:32:22.571 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:22.563+0000 7ff76881a640 1 -- 172.21.15.19:0/4212175438 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56195d7c3860 msgr2=0x56195d7ccfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:32:22.571 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:22.563+0000 7ff76881a640 1 --2- 172.21.15.19:0/4212175438 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56195d7c3860 0x56195d7ccfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:32:22.571 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:22.563+0000 7ff76881a640 1 -- 172.21.15.19:0/4212175438 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56195d7c8bd0 msgr2=0x56195d7ce1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:32:22.571 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:22.563+0000 7ff76881a640 1 --2- 172.21.15.19:0/4212175438 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56195d7c8bd0 0x56195d7ce1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:32:22.571 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:22.563+0000 7ff76881a640 1 -- 172.21.15.19:0/4212175438 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56195d486790 con 0x56195d7c6190 2024-09-10T22:32:22.571 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:22.563+0000 7ff76881a640 1 --2- 172.21.15.19:0/4212175438 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x56195d7c6190 0x56195d7cd660 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7ff754006010 tx=0x7ff75402a420 comp rx=0 tx=0).ready entity=mon.1 client_cookie=45ddda2b38c65fb1 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:32:22.571 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:22.563+0000 7ff74cff9640 10 client.0 ms_handle_connect on v2:172.21.15.138:3300/0 2024-09-10T22:32:22.572 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:22.563+0000 7ff74cff9640 1 -- 172.21.15.19:0/4212175438 <== mon.1 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff754035040 con 0x56195d7c6190 2024-09-10T22:32:22.572 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:22.564+0000 7ff74cff9640 1 -- 172.21.15.19:0/4212175438 <== mon.1 v2:172.21.15.138:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8327+0+0 (secure 0 0 0) 0x7ff754046070 con 0x56195d7c6190 2024-09-10T22:32:22.572 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:22.564+0000 7ff76e052740 1 -- 172.21.15.19:0/4212175438 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff76000fc90 con 0x56195d7c6190 2024-09-10T22:32:22.572 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:22.564+0000 7ff74cff9640 1 -- 172.21.15.19:0/4212175438 <== mon.1 v2:172.21.15.138:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7ff75405d050 con 0x56195d7c6190 2024-09-10T22:32:22.572 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:22.564+0000 7ff76e052740 10 client.25957 fetch_fsmap learned FSMap version 27 2024-09-10T22:32:22.572 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:22.564+0000 7ff76e052740 1 -- 172.21.15.19:0/4212175438 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x56195d4ff620 con 0x56195d7c6190 2024-09-10T22:32:22.572 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:22.564+0000 7ff74cff9640 1 -- 172.21.15.19:0/4212175438 <== mon.1 v2:172.21.15.138:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff76000fc90 con 0x56195d7c6190 2024-09-10T22:32:22.572 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:22.564+0000 7ff74cff9640 1 -- 172.21.15.19:0/4212175438 <== mon.1 v2:172.21.15.138:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7ff754054600 con 0x56195d7c6190 2024-09-10T22:32:22.572 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:22.564+0000 7ff76e052740 10 client.25957 fetch_fsmap finished waiting for FSMap version 27 2024-09-10T22:32:22.572 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:22.564+0000 7ff76e052740 10 client.25957 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-10T22:32:22.572 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:22.564+0000 7ff76e052740 20 client.25957 populate_metadata read hostname 'smithi019' 2024-09-10T22:32:22.572 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:22.564+0000 7ff76e052740 1 --2- 172.21.15.19:0/4212175438 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x56195d7d8850 0x56195d7dac40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:32:22.572 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:22.564+0000 7ff76e052740 4 client.25957 mds_command: new command op to 24581 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T22:32:22.573 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:22.564+0000 7ff76e052740 1 -- 172.21.15.19:0/4212175438 --> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56195d737640 con 0x56195d7d8850 2024-09-10T22:32:22.573 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:22.564+0000 7ff76901b640 1 --2- 172.21.15.19:0/4212175438 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x56195d7d8850 0x56195d7dac40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:32:22.573 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:22.565+0000 7ff74cff9640 10 client.25957 ms_handle_connect on v2:172.21.15.135:6838/1254769802 2024-09-10T22:32:22.573 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:22.565+0000 7ff76901b640 1 --2- 172.21.15.19:0/4212175438 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x56195d7d8850 0x56195d7dac40 crc :-1 s=READY pgs=130 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3ee09540194be9f1 server_cookie=7f3c8ab1427ab691 in_seq=0 out_seq=0 2024-09-10T22:32:22.573 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:22.566+0000 7ff74cff9640 1 -- 172.21.15.19:0/4212175438 <== mds.0 v2:172.21.15.135:6838/1254769802 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x56195d737640 con 0x56195d7d8850 2024-09-10T22:32:22.573 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:22.566+0000 7ff74cff9640 10 client.25957 handle_command_reply: tid=0 2024-09-10T22:32:22.573 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:22.566+0000 7ff76e052740 1 client.25957 shutdown 2024-09-10T22:32:22.573 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:22.566+0000 7ff76e052740 1 -- 172.21.15.19:0/4212175438 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x56195d7c6190 msgr2=0x56195d7cd660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:32:22.573 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:22.566+0000 7ff76e052740 1 --2- 172.21.15.19:0/4212175438 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x56195d7c6190 0x56195d7cd660 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7ff754006010 tx=0x7ff75402a420 comp rx=0 tx=0).stop 2024-09-10T22:32:22.573 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:22.566+0000 7ff76e052740 1 -- 172.21.15.19:0/4212175438 shutdown_connections 2024-09-10T22:32:22.573 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:22.566+0000 7ff76e052740 1 --2- 172.21.15.19:0/4212175438 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56195d7c8bd0 0x56195d7ce1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:32:22.573 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:22.566+0000 7ff76e052740 1 --2- 172.21.15.19:0/4212175438 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x56195d7d8850 0x56195d7dac40 crc :-1 s=READY pgs=130 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:32:22.573 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:22.566+0000 7ff76e052740 1 --2- 172.21.15.19:0/4212175438 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x56195d7c6190 0x56195d7cd660 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:32:22.574 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:22.566+0000 7ff74cff9640 0 client.25957 ms_handle_reset on v2:172.21.15.135:6838/1254769802 2024-09-10T22:32:22.574 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:22.566+0000 7ff76e052740 1 --2- 172.21.15.19:0/4212175438 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56195d7c3860 0x56195d7ccfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:32:22.574 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:22.566+0000 7ff76e052740 1 -- 172.21.15.19:0/4212175438 >> 172.21.15.19:0/4212175438 conn(0x56195d7be9b0 msgr2=0x56195d7bdbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:32:22.574 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:22.566+0000 7ff76e052740 1 -- 172.21.15.19:0/4212175438 shutdown_connections 2024-09-10T22:32:22.574 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:22.566+0000 7ff76e052740 1 -- 172.21.15.19:0/4212175438 wait complete. 2024-09-10T22:32:22.574 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:22.567+0000 7ff76e052740 20 client.25957 trim_cache size 0 max 16384 2024-09-10T22:32:22.589 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:22.583+0000 7ff76e052740 1 Processor -- start 2024-09-10T22:32:22.589 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:22.583+0000 7ff76e052740 1 -- start start 2024-09-10T22:32:22.589 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:22.583+0000 7ff76e052740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56195d7c3860 0x56195d7c96c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:32:22.589 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:22.583+0000 7ff76e052740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x56195d7c6190 0x56195d7cc220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:32:22.589 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:22.583+0000 7ff76e052740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56195d7c8bd0 0x56195d7cc760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:32:22.589 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:22.583+0000 7ff76e052740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7ff7641ac9b0 con 0x56195d7c8bd0 2024-09-10T22:32:22.589 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:22.583+0000 7ff76e052740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7ff7641aa280 con 0x56195d7c3860 2024-09-10T22:32:22.590 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:22.583+0000 7ff76e052740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7ff7641a80d0 con 0x56195d7c6190 2024-09-10T22:32:22.590 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:22.583+0000 7ff76981c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56195d7c8bd0 0x56195d7cc760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:32:22.590 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:22.583+0000 7ff76881a640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x56195d7c6190 0x56195d7cc220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:32:22.590 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:22.583+0000 7ff76901b640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56195d7c3860 0x56195d7c96c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:32:22.590 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:22.583+0000 7ff76881a640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x56195d7c6190 0x56195d7cc220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.19:40326/0 (socket says 172.21.15.19:40326) 2024-09-10T22:32:22.590 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:22.583+0000 7ff76901b640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56195d7c3860 0x56195d7c96c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.19:37386/0 (socket says 172.21.15.19:37386) 2024-09-10T22:32:22.590 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:22.583+0000 7ff76881a640 1 -- 172.21.15.19:0/1991045116 learned_addr learned my addr 172.21.15.19:0/1991045116 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:32:22.590 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:22.583+0000 7ff76881a640 1 -- 172.21.15.19:0/1991045116 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56195d7c3860 msgr2=0x56195d7c96c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:32:22.590 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:22.583+0000 7ff76881a640 1 --2- 172.21.15.19:0/1991045116 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56195d7c3860 0x56195d7c96c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:32:22.590 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:22.583+0000 7ff76881a640 1 -- 172.21.15.19:0/1991045116 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56195d7c8bd0 msgr2=0x56195d7cc760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:32:22.590 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:22.583+0000 7ff76881a640 1 --2- 172.21.15.19:0/1991045116 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56195d7c8bd0 0x56195d7cc760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:32:22.590 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:22.583+0000 7ff76881a640 1 -- 172.21.15.19:0/1991045116 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56195d7dafb0 con 0x56195d7c6190 2024-09-10T22:32:22.591 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:22.583+0000 7ff76901b640 1 --2- 172.21.15.19:0/1991045116 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56195d7c3860 0x56195d7c96c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T22:32:22.591 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:22.584+0000 7ff76881a640 1 --2- 172.21.15.19:0/1991045116 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x56195d7c6190 0x56195d7cc220 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7ff754009340 tx=0x7ff7540039f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d9770aac46e2caeb server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:32:22.591 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:22.584+0000 7ff74effd640 1 -- 172.21.15.19:0/1991045116 <== mon.1 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff754035070 con 0x56195d7c6190 2024-09-10T22:32:22.591 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:22.584+0000 7ff74effd640 1 -- 172.21.15.19:0/1991045116 <== mon.1 v2:172.21.15.138:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff75404f070 con 0x56195d7c6190 2024-09-10T22:32:22.591 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:22.584+0000 7ff74effd640 1 -- 172.21.15.19:0/1991045116 <== mon.1 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff754031c20 con 0x56195d7c6190 2024-09-10T22:32:22.591 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:22.585+0000 7ff76e052740 1 -- 172.21.15.19:0/1991045116 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x56195d7c6190 msgr2=0x56195d7cc220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:32:22.591 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:22.585+0000 7ff76e052740 1 --2- 172.21.15.19:0/1991045116 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x56195d7c6190 0x56195d7cc220 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7ff754009340 tx=0x7ff7540039f0 comp rx=0 tx=0).stop 2024-09-10T22:32:22.591 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:22.585+0000 7ff76e052740 1 -- 172.21.15.19:0/1991045116 shutdown_connections 2024-09-10T22:32:22.591 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:22.585+0000 7ff76e052740 1 --2- 172.21.15.19:0/1991045116 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56195d7c8bd0 0x56195d7cc760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:32:22.591 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:22.585+0000 7ff76e052740 1 --2- 172.21.15.19:0/1991045116 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x56195d7c6190 0x56195d7cc220 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:32:22.591 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:22.585+0000 7ff76e052740 1 --2- 172.21.15.19:0/1991045116 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56195d7c3860 0x56195d7c96c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:32:22.591 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:22.585+0000 7ff76e052740 1 -- 172.21.15.19:0/1991045116 >> 172.21.15.19:0/1991045116 conn(0x56195d7be9b0 msgr2=0x56195d7c8fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:32:22.591 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:22.585+0000 7ff76e052740 1 -- 172.21.15.19:0/1991045116 shutdown_connections 2024-09-10T22:32:22.592 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:22.585+0000 7ff76e052740 1 -- 172.21.15.19:0/1991045116 wait complete. 2024-09-10T22:32:22.592 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:22.585+0000 7ff76e052740 1 -- start start 2024-09-10T22:32:22.592 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:22.585+0000 7ff76e052740 1 Processor -- start 2024-09-10T22:32:22.592 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:22.586+0000 7ff76e052740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x56195d7c3860 0x56195d7d4a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:32:22.592 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:22.586+0000 7ff76e052740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56195d7c6190 0x56195d7d3750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:32:22.592 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:22.586+0000 7ff76e052740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56195d7c8bd0 0x56195d7d3c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:32:22.592 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:22.586+0000 7ff76e052740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7ff7641a8740 con 0x56195d7c6190 2024-09-10T22:32:22.592 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:22.586+0000 7ff76e052740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7ff7641a9bb0 con 0x56195d7c8bd0 2024-09-10T22:32:22.592 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:22.586+0000 7ff76e052740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7ff7641a8e10 con 0x56195d7c3860 2024-09-10T22:32:22.592 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:22.586+0000 7ff76e052740 10 client.0 _ll_register_callbacks cb 0x7ff754005dc0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T22:32:22.592 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:22.586+0000 7ff76881a640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56195d7c6190 0x56195d7d3750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:32:22.592 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:22.586+0000 7ff76981c640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56195d7c8bd0 0x56195d7d3c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:32:22.592 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:22.586+0000 7ff76981c640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56195d7c8bd0 0x56195d7d3c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.19:37396/0 (socket says 172.21.15.19:37396) 2024-09-10T22:32:22.593 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:22.586+0000 7ff76901b640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x56195d7c3860 0x56195d7d4a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:32:22.593 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:22.586+0000 7ff76981c640 1 -- 172.21.15.19:0/1769470878 learned_addr learned my addr 172.21.15.19:0/1769470878 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:32:22.593 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:22.586+0000 7ff76901b640 1 -- 172.21.15.19:0/1769470878 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56195d7c8bd0 msgr2=0x56195d7d3c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:32:22.593 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:22.586+0000 7ff76901b640 1 --2- 172.21.15.19:0/1769470878 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56195d7c8bd0 0x56195d7d3c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:32:22.593 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:22.586+0000 7ff76901b640 1 -- 172.21.15.19:0/1769470878 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56195d7c6190 msgr2=0x56195d7d3750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:32:22.593 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:22.586+0000 7ff76901b640 1 --2- 172.21.15.19:0/1769470878 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56195d7c6190 0x56195d7d3750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:32:22.593 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:22.586+0000 7ff76901b640 1 -- 172.21.15.19:0/1769470878 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56195d7ce530 con 0x56195d7c3860 2024-09-10T22:32:22.593 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:22.586+0000 7ff76901b640 1 --2- 172.21.15.19:0/1769470878 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x56195d7c3860 0x56195d7d4a50 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x56195d7db4a0 tx=0x7ff760009310 comp rx=0 tx=0).ready entity=mon.1 client_cookie=795b6eb1de14da2e server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:32:22.593 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:22.586+0000 7ff74cff9640 10 client.0 ms_handle_connect on v2:172.21.15.138:3300/0 2024-09-10T22:32:22.593 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:22.587+0000 7ff74cff9640 1 -- 172.21.15.19:0/1769470878 <== mon.1 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7600052c0 con 0x56195d7c3860 2024-09-10T22:32:22.593 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:22.587+0000 7ff74cff9640 1 -- 172.21.15.19:0/1769470878 <== mon.1 v2:172.21.15.138:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8327+0+0 (secure 0 0 0) 0x7ff760016040 con 0x56195d7c3860 2024-09-10T22:32:22.593 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:22.587+0000 7ff76e052740 1 -- 172.21.15.19:0/1769470878 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff75404f070 con 0x56195d7c3860 2024-09-10T22:32:22.594 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:22.587+0000 7ff74cff9640 1 -- 172.21.15.19:0/1769470878 <== mon.1 v2:172.21.15.138:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7ff760038050 con 0x56195d7c3860 2024-09-10T22:32:22.594 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:22.587+0000 7ff76e052740 10 client.25963 fetch_fsmap learned FSMap version 27 2024-09-10T22:32:22.594 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:22.587+0000 7ff76e052740 1 -- 172.21.15.19:0/1769470878 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x56195d845700 con 0x56195d7c3860 2024-09-10T22:32:22.594 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:22.587+0000 7ff74cff9640 1 -- 172.21.15.19:0/1769470878 <== mon.1 v2:172.21.15.138:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff75404f070 con 0x56195d7c3860 2024-09-10T22:32:22.594 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:22.587+0000 7ff74cff9640 1 -- 172.21.15.19:0/1769470878 <== mon.1 v2:172.21.15.138:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7ff76000f640 con 0x56195d7c3860 2024-09-10T22:32:22.594 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:22.587+0000 7ff76e052740 10 client.25963 fetch_fsmap finished waiting for FSMap version 27 2024-09-10T22:32:22.594 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:22.587+0000 7ff76e052740 10 client.25963 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-10T22:32:22.594 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:22.587+0000 7ff76e052740 20 client.25963 populate_metadata read hostname 'smithi019' 2024-09-10T22:32:22.594 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:22.587+0000 7ff76e052740 1 --2- 172.21.15.19:0/1769470878 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x56195d845e00 0x56195d848220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:32:22.594 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:22.587+0000 7ff76e052740 4 client.25963 mds_command: new command op to 24581 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-10T22:32:22.594 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:22.587+0000 7ff76e052740 1 -- 172.21.15.19:0/1769470878 --> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] -- command(tid 0: {"prefix": "flush journal"}) -- 0x56195d7330f0 con 0x56195d845e00 2024-09-10T22:32:22.594 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:22.587+0000 7ff76881a640 1 --2- 172.21.15.19:0/1769470878 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x56195d845e00 0x56195d848220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:32:22.595 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:22.588+0000 7ff74cff9640 10 client.25963 ms_handle_connect on v2:172.21.15.135:6838/1254769802 2024-09-10T22:32:22.595 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:22.588+0000 7ff76881a640 1 --2- 172.21.15.19:0/1769470878 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x56195d845e00 0x56195d848220 crc :-1 s=READY pgs=131 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=dde23143629b3c19 server_cookie=e527efa5ad33441 in_seq=0 out_seq=0 2024-09-10T22:32:22.934 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:22.931+0000 7f6f17572640 1 -- 172.21.15.19:0/456802434 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6f10103cc0 msgr2=0x7f6f101040a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:32:22.935 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:22.931+0000 7f6f17572640 1 --2- 172.21.15.19:0/456802434 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6f10103cc0 0x7f6f101040a0 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7f6f0c009ca0 tx=0x7f6f0c02a8c0 comp rx=0 tx=0).stop 2024-09-10T22:32:22.935 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:22.931+0000 7f6f17572640 1 -- 172.21.15.19:0/456802434 shutdown_connections 2024-09-10T22:32:22.935 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:22.931+0000 7f6f17572640 1 --2- 172.21.15.19:0/456802434 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f6f1010d120 0x7f6f1010f580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:32:22.935 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:22.931+0000 7f6f17572640 1 --2- 172.21.15.19:0/456802434 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6f101045e0 0x7f6f1010cad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:32:22.935 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:22.931+0000 7f6f17572640 1 --2- 172.21.15.19:0/456802434 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6f10103cc0 0x7f6f101040a0 unknown :-1 s=CLOSED pgs=648 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:32:22.935 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:22.931+0000 7f6f17572640 1 -- 172.21.15.19:0/456802434 >> 172.21.15.19:0/456802434 conn(0x7f6f100fd700 msgr2=0x7f6f100ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:32:22.935 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:22.931+0000 7f6f17572640 1 -- 172.21.15.19:0/456802434 shutdown_connections 2024-09-10T22:32:22.935 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:22.931+0000 7f6f17572640 1 -- 172.21.15.19:0/456802434 wait complete. 2024-09-10T22:32:22.935 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:22.932+0000 7f6f17572640 1 Processor -- start 2024-09-10T22:32:22.936 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:22.932+0000 7f6f17572640 1 -- start start 2024-09-10T22:32:22.936 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:22.932+0000 7f6f17572640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6f10103cc0 0x7f6f10101970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:32:22.936 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:22.932+0000 7f6f17572640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f6f101045e0 0x7f6f10101eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:32:22.936 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:22.932+0000 7f6f17572640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6f1010d120 0x7f6f101023f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:32:22.936 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:22.932+0000 7f6f17572640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f6f10112d90 con 0x7f6f1010d120 2024-09-10T22:32:22.936 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:22.932+0000 7f6f17572640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f6f10112c10 con 0x7f6f10103cc0 2024-09-10T22:32:22.936 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:22.932+0000 7f6f17572640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f6f10112f10 con 0x7f6f101045e0 2024-09-10T22:32:22.936 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:22.933+0000 7f6f14b0d640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f6f101045e0 0x7f6f10101eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:32:22.936 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:22.933+0000 7f6f14b0d640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f6f101045e0 0x7f6f10101eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.19:40360/0 (socket says 172.21.15.19:40360) 2024-09-10T22:32:22.936 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:22.933+0000 7f6f14b0d640 1 -- 172.21.15.19:0/3792439333 learned_addr learned my addr 172.21.15.19:0/3792439333 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:32:22.936 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:22.933+0000 7f6f15b0f640 1 --2- 172.21.15.19:0/3792439333 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6f1010d120 0x7f6f101023f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:32:22.937 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:22.933+0000 7f6f14b0d640 1 -- 172.21.15.19:0/3792439333 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6f10103cc0 msgr2=0x7f6f10101970 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-10T22:32:22.937 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:22.933+0000 7f6f14b0d640 1 --2- 172.21.15.19:0/3792439333 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6f10103cc0 0x7f6f10101970 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:32:22.937 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:22.933+0000 7f6f14b0d640 1 -- 172.21.15.19:0/3792439333 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6f1010d120 msgr2=0x7f6f101023f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:32:22.937 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:22.933+0000 7f6f14b0d640 1 --2- 172.21.15.19:0/3792439333 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6f1010d120 0x7f6f101023f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:32:22.937 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:22.933+0000 7f6f14b0d640 1 -- 172.21.15.19:0/3792439333 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6f101a76a0 con 0x7f6f101045e0 2024-09-10T22:32:22.937 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:22.933+0000 7f6f15b0f640 1 --2- 172.21.15.19:0/3792439333 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6f1010d120 0x7f6f101023f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T22:32:22.938 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:22.933+0000 7f6f14b0d640 1 --2- 172.21.15.19:0/3792439333 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f6f101045e0 0x7f6f10101eb0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f6f0000e9c0 tx=0x7f6f0000ee80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:32:22.938 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:22.934+0000 7f6f067fc640 1 -- 172.21.15.19:0/3792439333 <== mon.1 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f0000ccc0 con 0x7f6f101045e0 2024-09-10T22:32:22.938 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:22.934+0000 7f6f067fc640 1 -- 172.21.15.19:0/3792439333 <== mon.1 v2:172.21.15.138:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6f000035f0 con 0x7f6f101045e0 2024-09-10T22:32:22.938 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:22.934+0000 7f6f17572640 1 -- 172.21.15.19:0/3792439333 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6f101a7990 con 0x7f6f101045e0 2024-09-10T22:32:22.938 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:22.934+0000 7f6f067fc640 1 -- 172.21.15.19:0/3792439333 <== mon.1 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f0000ce60 con 0x7f6f101045e0 2024-09-10T22:32:22.938 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:22.934+0000 7f6f17572640 1 -- 172.21.15.19:0/3792439333 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6f101a7f20 con 0x7f6f101045e0 2024-09-10T22:32:22.939 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:22.937+0000 7f6f19947740 1 Processor -- start 2024-09-10T22:32:22.939 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:22.937+0000 7f6f19947740 1 -- start start 2024-09-10T22:32:22.941 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:22.938+0000 7f6f19947740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x56182c7f20a0 0x56182c7f2480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:32:22.941 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:22.938+0000 7f6f19947740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56182c7f29c0 0x56182c806c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:32:22.941 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:22.938+0000 7f6f19947740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56182c807160 0x56182c809550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:32:22.941 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:22.938+0000 7f6f19947740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x56182c768e50 con 0x56182c7f29c0 2024-09-10T22:32:22.941 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:22.938+0000 7f6f19947740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x56182c758280 con 0x56182c807160 2024-09-10T22:32:22.942 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:22.938+0000 7f6f19947740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x56182c75c090 con 0x56182c7f20a0 2024-09-10T22:32:22.942 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:22.939+0000 7f6f067fc640 1 -- 172.21.15.19:0/3792439333 <== mon.1 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 18) ==== 153250+0+0 (secure 0 0 0) 0x7f6f00004000 con 0x7f6f101045e0 2024-09-10T22:32:22.942 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:22.939+0000 7f6f1530e640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56182c7f29c0 0x56182c806c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:32:22.942 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:22.939+0000 7f6f1530e640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56182c7f29c0 0x56182c806c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:47616/0 (socket says 172.21.15.19:47616) 2024-09-10T22:32:22.942 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:22.939+0000 7f6f1530e640 1 -- 172.21.15.19:0/3550669822 learned_addr learned my addr 172.21.15.19:0/3550669822 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:32:22.942 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:22.939+0000 7f6f14b0d640 1 --2- 172.21.15.19:0/3550669822 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56182c807160 0x56182c809550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:32:22.942 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:22.939+0000 7f6f15b0f640 1 --2- 172.21.15.19:0/3550669822 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x56182c7f20a0 0x56182c7f2480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:32:22.942 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:22.939+0000 7f6f1530e640 1 -- 172.21.15.19:0/3550669822 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x56182c7f20a0 msgr2=0x56182c7f2480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:32:22.942 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:22.939+0000 7f6f1530e640 1 --2- 172.21.15.19:0/3550669822 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x56182c7f20a0 0x56182c7f2480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:32:22.942 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:22.939+0000 7f6f1530e640 1 -- 172.21.15.19:0/3550669822 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56182c807160 msgr2=0x56182c809550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:32:22.943 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:22.940+0000 7f6f1530e640 1 --2- 172.21.15.19:0/3550669822 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56182c807160 0x56182c809550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:32:22.943 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:22.940+0000 7f6f1530e640 1 -- 172.21.15.19:0/3550669822 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56182c4b6650 con 0x56182c7f29c0 2024-09-10T22:32:22.943 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:22.940+0000 7f6f15b0f640 1 --2- 172.21.15.19:0/3550669822 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x56182c7f20a0 0x56182c7f2480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T22:32:22.944 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:22.940+0000 7f6f1530e640 1 --2- 172.21.15.19:0/3550669822 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56182c7f29c0 0x56182c806c20 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7f6f0c02ade0 tx=0x7f6f0c005ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d194c821376e2401 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:32:22.945 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:22.940+0000 7f6efb7fe640 1 -- 172.21.15.19:0/3550669822 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f0c031cf0 con 0x56182c7f29c0 2024-09-10T22:32:22.945 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:22.940+0000 7f6efb7fe640 1 -- 172.21.15.19:0/3550669822 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6f0c03f070 con 0x56182c7f29c0 2024-09-10T22:32:22.945 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:22.940+0000 7f6efb7fe640 1 -- 172.21.15.19:0/3550669822 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f0c004040 con 0x56182c7f29c0 2024-09-10T22:32:22.945 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:22.941+0000 7f6f067fc640 1 --2- 172.21.15.19:0/3792439333 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f6efc0b5360 0x7f6efc0b7820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:32:22.945 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:22.941+0000 7f6f15b0f640 1 --2- 172.21.15.19:0/3792439333 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f6efc0b5360 0x7f6efc0b7820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:32:22.945 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:22.941+0000 7f6f067fc640 1 -- 172.21.15.19:0/3792439333 <== mon.1 v2:172.21.15.138:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8327+0+0 (secure 0 0 0) 0x7f6f000e5f00 con 0x7f6f101045e0 2024-09-10T22:32:22.945 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:22.941+0000 7f6f19947740 1 -- 172.21.15.19:0/3550669822 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56182c7f29c0 msgr2=0x56182c806c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:32:22.945 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:22.941+0000 7f6f19947740 1 --2- 172.21.15.19:0/3550669822 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56182c7f29c0 0x56182c806c20 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7f6f0c02ade0 tx=0x7f6f0c005ef0 comp rx=0 tx=0).stop 2024-09-10T22:32:22.945 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:22.942+0000 7f6f19947740 1 -- 172.21.15.19:0/3550669822 shutdown_connections 2024-09-10T22:32:22.945 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:22.942+0000 7f6f19947740 1 --2- 172.21.15.19:0/3550669822 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56182c807160 0x56182c809550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:32:22.945 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:22.942+0000 7f6f19947740 1 --2- 172.21.15.19:0/3550669822 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56182c7f29c0 0x56182c806c20 unknown :-1 s=CLOSED pgs=649 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:32:22.946 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:22.942+0000 7f6f19947740 1 --2- 172.21.15.19:0/3550669822 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x56182c7f20a0 0x56182c7f2480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:32:22.946 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:22.942+0000 7f6f19947740 1 -- 172.21.15.19:0/3550669822 >> 172.21.15.19:0/3550669822 conn(0x56182c7efed0 msgr2=0x56182c7f1070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:32:22.946 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:22.942+0000 7f6f15b0f640 1 --2- 172.21.15.19:0/3792439333 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f6efc0b5360 0x7f6efc0b7820 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f6f10103a30 tx=0x7f6f08005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:32:22.946 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:22.942+0000 7f6f19947740 1 -- 172.21.15.19:0/3550669822 shutdown_connections 2024-09-10T22:32:22.946 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:22.942+0000 7f6f19947740 1 -- 172.21.15.19:0/3550669822 wait complete. 2024-09-10T22:32:22.946 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:22.942+0000 7f6f19947740 1 -- start start 2024-09-10T22:32:22.946 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:22.942+0000 7f6f19947740 1 Processor -- start 2024-09-10T22:32:22.946 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:22.943+0000 7f6f19947740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56182c7f20a0 0x56182c806a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:32:22.946 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:22.943+0000 7f6f19947740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x56182c7f29c0 0x56182c803eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:32:22.946 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:22.943+0000 7f6f19947740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56182c807160 0x56182c8044c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:32:22.947 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:22.943+0000 7f6f19947740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x56182c5b9700 con 0x56182c807160 2024-09-10T22:32:22.947 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:22.943+0000 7f6f19947740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x56182c6f3110 con 0x56182c7f20a0 2024-09-10T22:32:22.947 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:22.943+0000 7f6f19947740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x56182c809db0 con 0x56182c7f29c0 2024-09-10T22:32:22.948 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:22.943+0000 7f6f1530e640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56182c7f20a0 0x56182c806a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:32:22.948 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:22.943+0000 7f6f1530e640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56182c7f20a0 0x56182c806a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.19:37420/0 (socket says 172.21.15.19:37420) 2024-09-10T22:32:22.948 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:22.943+0000 7f6f19947740 10 client.0 _ll_register_callbacks cb 0x56182c70c990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T22:32:22.948 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:22.943+0000 7f6f1530e640 1 -- 172.21.15.19:0/3277943632 learned_addr learned my addr 172.21.15.19:0/3277943632 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:32:22.948 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:22.943+0000 7f6f15b0f640 1 --2- 172.21.15.19:0/3277943632 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56182c807160 0x56182c8044c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:32:22.948 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:22.943+0000 7f6f14b0d640 1 --2- 172.21.15.19:0/3277943632 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x56182c7f29c0 0x56182c803eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:32:22.948 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:22.944+0000 7f6f1530e640 1 -- 172.21.15.19:0/3277943632 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x56182c7f29c0 msgr2=0x56182c803eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:32:22.948 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:22.944+0000 7f6f1530e640 1 --2- 172.21.15.19:0/3277943632 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x56182c7f29c0 0x56182c803eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:32:22.948 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:22.944+0000 7f6f1530e640 1 -- 172.21.15.19:0/3277943632 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56182c807160 msgr2=0x56182c8044c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:32:22.949 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:22.944+0000 7f6f1530e640 1 --2- 172.21.15.19:0/3277943632 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56182c807160 0x56182c8044c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:32:22.949 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:22.944+0000 7f6f1530e640 1 -- 172.21.15.19:0/3277943632 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56182c720c40 con 0x56182c7f20a0 2024-09-10T22:32:22.949 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:22.944+0000 7f6f14b0d640 1 --2- 172.21.15.19:0/3277943632 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x56182c7f29c0 0x56182c803eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T22:32:22.949 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:22.944+0000 7f6f1530e640 1 --2- 172.21.15.19:0/3277943632 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56182c7f20a0 0x56182c806a60 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f6f0c009620 tx=0x7f6f0c031680 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b5747ea5907e13a8 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:32:22.949 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:22.944+0000 7f6ef8ff9640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-09-10T22:32:22.949 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:22.944+0000 7f6ef8ff9640 1 -- 172.21.15.19:0/3277943632 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f0c02f860 con 0x56182c7f20a0 2024-09-10T22:32:22.949 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:22.944+0000 7f6ef8ff9640 1 -- 172.21.15.19:0/3277943632 <== mon.2 v2:172.21.15.135:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8327+0+0 (secure 0 0 0) 0x7f6f0c02fa00 con 0x56182c7f20a0 2024-09-10T22:32:22.949 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:22.944+0000 7f6f19947740 1 -- 172.21.15.19:0/3277943632 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6f0c03f070 con 0x56182c7f20a0 2024-09-10T22:32:22.950 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:22.944+0000 7f6ef8ff9640 1 -- 172.21.15.19:0/3277943632 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f6f0c003970 con 0x56182c7f20a0 2024-09-10T22:32:22.950 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:22.944+0000 7f6f19947740 10 client.25943 fetch_fsmap learned FSMap version 27 2024-09-10T22:32:22.950 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:22.944+0000 7f6f19947740 1 -- 172.21.15.19:0/3277943632 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x56182c8156a0 con 0x56182c7f20a0 2024-09-10T22:32:22.950 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:22.945+0000 7f6ef8ff9640 1 -- 172.21.15.19:0/3277943632 <== mon.2 v2:172.21.15.135:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6f0c03f070 con 0x56182c7f20a0 2024-09-10T22:32:22.950 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:22.945+0000 7f6ef8ff9640 1 -- 172.21.15.19:0/3277943632 <== mon.2 v2:172.21.15.135:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7f6f0c055050 con 0x56182c7f20a0 2024-09-10T22:32:22.950 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:22.945+0000 7f6f19947740 10 client.25943 fetch_fsmap finished waiting for FSMap version 27 2024-09-10T22:32:22.950 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:22.945+0000 7f6f19947740 10 client.25943 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-10T22:32:22.950 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:22.945+0000 7f6f19947740 20 client.25943 populate_metadata read hostname 'smithi019' 2024-09-10T22:32:22.950 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:22.945+0000 7f6f19947740 1 --2- 172.21.15.19:0/3277943632 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x56182c8169f0 0x56182c818de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:32:22.950 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:22.945+0000 7f6f19947740 4 client.25943 mds_command: new command op to 24581 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T22:32:22.950 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:22.945+0000 7f6f19947740 1 -- 172.21.15.19:0/3277943632 --> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56182c76ada0 con 0x56182c8169f0 2024-09-10T22:32:22.950 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:22.945+0000 7f6f14b0d640 1 --2- 172.21.15.19:0/3277943632 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x56182c8169f0 0x56182c818de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:32:22.951 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:22.946+0000 7f6f14b0d640 1 --2- 172.21.15.19:0/3277943632 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x56182c8169f0 0x56182c818de0 crc :-1 s=READY pgs=132 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2bf54322b640bfdc server_cookie=aa361412dfeac5a in_seq=0 out_seq=0 2024-09-10T22:32:22.951 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:22.946+0000 7f6ef8ff9640 10 client.25943 ms_handle_connect on v2:172.21.15.135:6838/1254769802 2024-09-10T22:32:22.952 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:22.948+0000 7f6ef8ff9640 1 -- 172.21.15.19:0/3277943632 <== mds.0 v2:172.21.15.135:6838/1254769802 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x56182c76ada0 con 0x56182c8169f0 2024-09-10T22:32:22.952 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:22.948+0000 7f6ef8ff9640 10 client.25943 handle_command_reply: tid=0 2024-09-10T22:32:22.952 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:22.948+0000 7f6f19947740 1 client.25943 shutdown 2024-09-10T22:32:22.952 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:22.948+0000 7f6f19947740 1 -- 172.21.15.19:0/3277943632 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56182c7f20a0 msgr2=0x56182c806a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:32:22.952 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:22.948+0000 7f6f19947740 1 --2- 172.21.15.19:0/3277943632 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56182c7f20a0 0x56182c806a60 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f6f0c009620 tx=0x7f6f0c031680 comp rx=0 tx=0).stop 2024-09-10T22:32:22.952 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:22.948+0000 7f6f19947740 1 -- 172.21.15.19:0/3277943632 shutdown_connections 2024-09-10T22:32:22.952 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:22.948+0000 7f6f19947740 1 --2- 172.21.15.19:0/3277943632 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56182c807160 0x56182c8044c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:32:22.952 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:22.948+0000 7f6f19947740 1 --2- 172.21.15.19:0/3277943632 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x56182c8169f0 0x56182c818de0 crc :-1 s=READY pgs=132 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:32:22.952 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:22.948+0000 7f6f19947740 1 --2- 172.21.15.19:0/3277943632 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x56182c7f29c0 0x56182c803eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:32:22.953 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:22.948+0000 7f6f19947740 1 --2- 172.21.15.19:0/3277943632 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56182c7f20a0 0x56182c806a60 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:32:22.953 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:22.948+0000 7f6ef8ff9640 0 client.25943 ms_handle_reset on v2:172.21.15.135:6838/1254769802 2024-09-10T22:32:22.953 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:22.948+0000 7f6f19947740 1 -- 172.21.15.19:0/3277943632 >> 172.21.15.19:0/3277943632 conn(0x56182c7efed0 msgr2=0x56182c7f5a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:32:22.953 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:22.948+0000 7f6f19947740 1 -- 172.21.15.19:0/3277943632 shutdown_connections 2024-09-10T22:32:22.953 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:22.948+0000 7f6f19947740 1 -- 172.21.15.19:0/3277943632 wait complete. 2024-09-10T22:32:22.953 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:22.948+0000 7f6f19947740 20 client.25943 trim_cache size 0 max 16384 2024-09-10T22:32:22.970 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:22.969+0000 7f6f19947740 1 Processor -- start 2024-09-10T22:32:22.970 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:22.969+0000 7f6f19947740 1 -- start start 2024-09-10T22:32:22.971 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:22.969+0000 7f6f19947740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56182c7f20a0 0x56182c813080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:32:22.971 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:22.969+0000 7f6f19947740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x56182c7f29c0 0x56182c7ef710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:32:22.971 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:22.969+0000 7f6f19947740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56182c807160 0x56182c81be00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:32:22.971 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:22.969+0000 7f6f19947740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f6f101aec30 con 0x56182c7f20a0 2024-09-10T22:32:22.971 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:22.969+0000 7f6f19947740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f6f101ac500 con 0x56182c807160 2024-09-10T22:32:22.972 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:22.969+0000 7f6f19947740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f6f101aa350 con 0x56182c7f29c0 2024-09-10T22:32:22.972 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:22.969+0000 7f6f1530e640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56182c7f20a0 0x56182c813080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:32:22.972 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:22.969+0000 7f6f14b0d640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x56182c7f29c0 0x56182c7ef710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:32:22.972 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:22.969+0000 7f6f1530e640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56182c7f20a0 0x56182c813080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:47642/0 (socket says 172.21.15.19:47642) 2024-09-10T22:32:22.972 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:22.969+0000 7f6f1530e640 1 -- 172.21.15.19:0/1847775676 learned_addr learned my addr 172.21.15.19:0/1847775676 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:32:22.972 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:22.969+0000 7f6f15b0f640 1 --2- 172.21.15.19:0/1847775676 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56182c807160 0x56182c81be00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:32:22.972 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:22.970+0000 7f6f14b0d640 1 -- 172.21.15.19:0/1847775676 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56182c807160 msgr2=0x56182c81be00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:32:22.972 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:22.970+0000 7f6f14b0d640 1 --2- 172.21.15.19:0/1847775676 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56182c807160 0x56182c81be00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:32:22.972 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:22.970+0000 7f6f14b0d640 1 -- 172.21.15.19:0/1847775676 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56182c7f20a0 msgr2=0x56182c813080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:32:22.972 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:22.970+0000 7f6f14b0d640 1 --2- 172.21.15.19:0/1847775676 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56182c7f20a0 0x56182c813080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:32:22.972 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:22.970+0000 7f6f14b0d640 1 -- 172.21.15.19:0/1847775676 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56182c804830 con 0x56182c7f29c0 2024-09-10T22:32:22.973 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:22.970+0000 7f6f1530e640 1 --2- 172.21.15.19:0/1847775676 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56182c7f20a0 0x56182c813080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T22:32:22.974 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:22.970+0000 7f6f14b0d640 1 --2- 172.21.15.19:0/1847775676 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x56182c7f29c0 0x56182c7ef710 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f6f000e3970 tx=0x7f6f000e3870 comp rx=0 tx=0).ready entity=mon.1 client_cookie=313db00bccebbd47 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:32:22.974 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:22.970+0000 7f6efaffd640 1 -- 172.21.15.19:0/1847775676 <== mon.1 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f000e3e60 con 0x56182c7f29c0 2024-09-10T22:32:22.974 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:22.970+0000 7f6efaffd640 1 -- 172.21.15.19:0/1847775676 <== mon.1 v2:172.21.15.138:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6f000ac170 con 0x56182c7f29c0 2024-09-10T22:32:22.974 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:22.970+0000 7f6efaffd640 1 -- 172.21.15.19:0/1847775676 <== mon.1 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f00003a50 con 0x56182c7f29c0 2024-09-10T22:32:22.974 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:22.971+0000 7f6f19947740 1 -- 172.21.15.19:0/1847775676 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x56182c7f29c0 msgr2=0x56182c7ef710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:32:22.974 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:22.971+0000 7f6f19947740 1 --2- 172.21.15.19:0/1847775676 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x56182c7f29c0 0x56182c7ef710 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f6f000e3970 tx=0x7f6f000e3870 comp rx=0 tx=0).stop 2024-09-10T22:32:22.975 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:22.971+0000 7f6f19947740 1 -- 172.21.15.19:0/1847775676 shutdown_connections 2024-09-10T22:32:22.975 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:22.971+0000 7f6f19947740 1 --2- 172.21.15.19:0/1847775676 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56182c807160 0x56182c81be00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:32:22.975 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:22.971+0000 7f6f19947740 1 --2- 172.21.15.19:0/1847775676 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x56182c7f29c0 0x56182c7ef710 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:32:22.975 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:22.971+0000 7f6f19947740 1 --2- 172.21.15.19:0/1847775676 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56182c7f20a0 0x56182c813080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:32:22.975 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:22.971+0000 7f6f19947740 1 -- 172.21.15.19:0/1847775676 >> 172.21.15.19:0/1847775676 conn(0x56182c7efed0 msgr2=0x56182c7f0f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:32:22.975 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:22.972+0000 7f6f19947740 1 -- 172.21.15.19:0/1847775676 shutdown_connections 2024-09-10T22:32:22.975 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:22.972+0000 7f6f19947740 1 -- 172.21.15.19:0/1847775676 wait complete. 2024-09-10T22:32:22.975 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:22.972+0000 7f6f19947740 1 -- start start 2024-09-10T22:32:22.975 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:22.972+0000 7f6f19947740 1 Processor -- start 2024-09-10T22:32:22.975 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:22.973+0000 7f6f19947740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56182c7f20a0 0x56182c81a4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:32:22.975 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:22.973+0000 7f6f19947740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x56182c7f29c0 0x56182c81a9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:32:22.979 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:22.973+0000 7f6f19947740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56182c807160 0x56182c882560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:32:22.979 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:22.973+0000 7f6f19947740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f6f101aa9c0 con 0x56182c7f20a0 2024-09-10T22:32:22.979 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:22.973+0000 7f6f19947740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f6f101abe30 con 0x56182c807160 2024-09-10T22:32:22.979 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:22.973+0000 7f6f19947740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f6f101ab090 con 0x56182c7f29c0 2024-09-10T22:32:22.979 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:22.973+0000 7f6f19947740 10 client.0 _ll_register_callbacks cb 0x7f6f08005e30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T22:32:22.979 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:22.973+0000 7f6f1530e640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56182c7f20a0 0x56182c81a4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:32:22.979 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:22.973+0000 7f6f1530e640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56182c7f20a0 0x56182c81a4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:47644/0 (socket says 172.21.15.19:47644) 2024-09-10T22:32:22.979 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:22.973+0000 7f6f1530e640 1 -- 172.21.15.19:0/445983882 learned_addr learned my addr 172.21.15.19:0/445983882 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:32:22.979 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:22.973+0000 7f6f14b0d640 1 --2- 172.21.15.19:0/445983882 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x56182c7f29c0 0x56182c81a9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:32:22.979 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:22.973+0000 7f6f15b0f640 1 --2- 172.21.15.19:0/445983882 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56182c807160 0x56182c882560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:32:22.979 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:22.973+0000 7f6f1530e640 1 -- 172.21.15.19:0/445983882 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x56182c7f29c0 msgr2=0x56182c81a9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:32:22.980 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:22.973+0000 7f6f1530e640 1 --2- 172.21.15.19:0/445983882 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x56182c7f29c0 0x56182c81a9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:32:22.980 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:22.973+0000 7f6f1530e640 1 -- 172.21.15.19:0/445983882 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56182c807160 msgr2=0x56182c882560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:32:22.980 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:22.973+0000 7f6f1530e640 1 --2- 172.21.15.19:0/445983882 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56182c807160 0x56182c882560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:32:22.980 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:22.973+0000 7f6f1530e640 1 -- 172.21.15.19:0/445983882 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56182c882af0 con 0x56182c7f20a0 2024-09-10T22:32:22.980 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:22.973+0000 7f6f15b0f640 1 --2- 172.21.15.19:0/445983882 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56182c807160 0x56182c882560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T22:32:22.980 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:22.974+0000 7f6f1530e640 1 --2- 172.21.15.19:0/445983882 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56182c7f20a0 0x56182c81a4b0 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7f6f0c005e30 tx=0x7f6f0c000f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=87e5c81b5dd3ffbe server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:32:22.980 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:22.974+0000 7f6ef8ff9640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-10T22:32:22.980 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:22.974+0000 7f6ef8ff9640 1 -- 172.21.15.19:0/445983882 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f0c009540 con 0x56182c7f20a0 2024-09-10T22:32:22.980 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:22.974+0000 7f6ef8ff9640 1 -- 172.21.15.19:0/445983882 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8327+0+0 (secure 0 0 0) 0x7f6f0c044470 con 0x56182c7f20a0 2024-09-10T22:32:22.980 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:22.974+0000 7f6f19947740 1 -- 172.21.15.19:0/445983882 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6f000ac170 con 0x56182c7f20a0 2024-09-10T22:32:22.980 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:22.974+0000 7f6ef8ff9640 1 -- 172.21.15.19:0/445983882 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f6f0c004b40 con 0x56182c7f20a0 2024-09-10T22:32:22.981 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:22.974+0000 7f6f19947740 10 client.16536 fetch_fsmap learned FSMap version 27 2024-09-10T22:32:22.981 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:22.974+0000 7f6f19947740 1 -- 172.21.15.19:0/445983882 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x56182c883e00 con 0x56182c7f20a0 2024-09-10T22:32:22.981 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:22.975+0000 7f6ef8ff9640 1 -- 172.21.15.19:0/445983882 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6f000ac170 con 0x56182c7f20a0 2024-09-10T22:32:22.981 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:22.975+0000 7f6ef8ff9640 1 -- 172.21.15.19:0/445983882 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7f6f0c055070 con 0x56182c7f20a0 2024-09-10T22:32:22.981 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:22.975+0000 7f6f19947740 10 client.16536 fetch_fsmap finished waiting for FSMap version 27 2024-09-10T22:32:22.981 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:22.975+0000 7f6f19947740 10 client.16536 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-10T22:32:22.981 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:22.975+0000 7f6f19947740 20 client.16536 populate_metadata read hostname 'smithi019' 2024-09-10T22:32:22.981 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:22.975+0000 7f6f19947740 1 --2- 172.21.15.19:0/445983882 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x56182c884390 0x56182c8867b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:32:22.981 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:22.975+0000 7f6f19947740 4 client.16536 mds_command: new command op to 24581 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-10T22:32:22.981 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:22.975+0000 7f6f19947740 1 -- 172.21.15.19:0/445983882 --> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] -- command(tid 0: {"prefix": "scrub status"}) -- 0x56182c766850 con 0x56182c884390 2024-09-10T22:32:22.981 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:22.975+0000 7f6f14b0d640 1 --2- 172.21.15.19:0/445983882 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x56182c884390 0x56182c8867b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:32:22.981 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:22.976+0000 7f6ef8ff9640 10 client.16536 ms_handle_connect on v2:172.21.15.135:6838/1254769802 2024-09-10T22:32:22.982 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:22.976+0000 7f6f14b0d640 1 --2- 172.21.15.19:0/445983882 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x56182c884390 0x56182c8867b0 crc :-1 s=READY pgs=133 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9732bdb42bc09a50 server_cookie=e7b1bf61ee543820 in_seq=0 out_seq=0 2024-09-10T22:32:22.982 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:22.976+0000 7f6ef8ff9640 1 -- 172.21.15.19:0/445983882 <== mds.0 v2:172.21.15.135:6838/1254769802 1 ==== command_reply(tid 0: 0 ) ==== 8+0+2362 (crc 0 0 0) 0x56182c766850 con 0x56182c884390 2024-09-10T22:32:22.982 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:22.976+0000 7f6ef8ff9640 10 client.16536 handle_command_reply: tid=0 2024-09-10T22:32:22.982 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:22.976+0000 7f6f19947740 1 client.16536 shutdown 2024-09-10T22:32:22.982 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:22.976+0000 7f6f19947740 1 -- 172.21.15.19:0/445983882 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56182c7f20a0 msgr2=0x56182c81a4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:32:22.982 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:22.976+0000 7f6f19947740 1 --2- 172.21.15.19:0/445983882 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56182c7f20a0 0x56182c81a4b0 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7f6f0c005e30 tx=0x7f6f0c000f40 comp rx=0 tx=0).stop 2024-09-10T22:32:22.982 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:22.977+0000 7f6f19947740 1 -- 172.21.15.19:0/445983882 shutdown_connections 2024-09-10T22:32:22.982 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:22.977+0000 7f6f19947740 1 --2- 172.21.15.19:0/445983882 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56182c807160 0x56182c882560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:32:22.982 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:22.977+0000 7f6f19947740 1 --2- 172.21.15.19:0/445983882 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x56182c884390 0x56182c8867b0 crc :-1 s=READY pgs=133 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:32:22.982 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:22.977+0000 7f6f19947740 1 --2- 172.21.15.19:0/445983882 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x56182c7f29c0 0x56182c81a9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:32:22.982 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:22.977+0000 7f6f19947740 1 --2- 172.21.15.19:0/445983882 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56182c7f20a0 0x56182c81a4b0 unknown :-1 s=CLOSED pgs=650 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:32:22.982 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:22.977+0000 7f6f19947740 1 -- 172.21.15.19:0/445983882 >> 172.21.15.19:0/445983882 conn(0x56182c7efed0 msgr2=0x56182c8054e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:32:22.983 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:22.977+0000 7f6ef8ff9640 0 client.16536 ms_handle_reset on v2:172.21.15.135:6838/1254769802 2024-09-10T22:32:22.983 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:22.977+0000 7f6f19947740 1 -- 172.21.15.19:0/445983882 shutdown_connections 2024-09-10T22:32:22.983 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:22.977+0000 7f6f19947740 1 -- 172.21.15.19:0/445983882 wait complete. 2024-09-10T22:32:22.983 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:22.977+0000 7f6f19947740 20 client.16536 trim_cache size 0 max 16384 2024-09-10T22:32:22.983 INFO:teuthology.orchestra.run.smithi019.stdout:{ 2024-09-10T22:32:22.984 INFO:teuthology.orchestra.run.smithi019.stdout: "status": "no active scrubs running", 2024-09-10T22:32:22.984 INFO:teuthology.orchestra.run.smithi019.stdout: "scrubs": {}, 2024-09-10T22:32:22.984 INFO:teuthology.orchestra.run.smithi019.stdout: "scrub_stats": { 2024-09-10T22:32:22.984 INFO:teuthology.orchestra.run.smithi019.stdout: "0b81ea61-0b8e-4f2c-a58f-ef1019289fc9": { 2024-09-10T22:32:22.984 INFO:teuthology.orchestra.run.smithi019.stdout: "start_time": "2024-09-10T22:31:48.141568+0000", 2024-09-10T22:32:22.984 INFO:teuthology.orchestra.run.smithi019.stdout: "path": "/", 2024-09-10T22:32:22.984 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_started": 0, 2024-09-10T22:32:22.984 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_passed": 0, 2024-09-10T22:32:22.984 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_failed": 0, 2024-09-10T22:32:22.984 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_skipped": 0 2024-09-10T22:32:22.984 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:32:22.985 INFO:teuthology.orchestra.run.smithi019.stdout: "715ec863-8a9d-45b6-967f-59b15ce1bf12": { 2024-09-10T22:32:22.985 INFO:teuthology.orchestra.run.smithi019.stdout: "start_time": "2024-09-10T22:31:00.669516+0000", 2024-09-10T22:32:22.985 INFO:teuthology.orchestra.run.smithi019.stdout: "path": "/", 2024-09-10T22:32:22.985 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_started": 0, 2024-09-10T22:32:22.985 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_passed": 0, 2024-09-10T22:32:22.985 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_failed": 0, 2024-09-10T22:32:22.985 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_skipped": 0 2024-09-10T22:32:22.985 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:32:22.985 INFO:teuthology.orchestra.run.smithi019.stdout: "fd1f1837-dcfa-4d88-99e8-2509f36c3f98": { 2024-09-10T22:32:22.985 INFO:teuthology.orchestra.run.smithi019.stdout: "start_time": "2024-09-10T22:30:12.470477+0000", 2024-09-10T22:32:22.985 INFO:teuthology.orchestra.run.smithi019.stdout: "path": "/", 2024-09-10T22:32:22.986 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_started": 0, 2024-09-10T22:32:22.986 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_passed": 0, 2024-09-10T22:32:22.986 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_failed": 0, 2024-09-10T22:32:22.986 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_skipped": 0 2024-09-10T22:32:22.986 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:32:22.986 INFO:teuthology.orchestra.run.smithi019.stdout: "8f3bb3bf-911f-490c-9856-c80ea220dbbe": { 2024-09-10T22:32:22.986 INFO:teuthology.orchestra.run.smithi019.stdout: "start_time": "2024-09-10T22:29:25.374415+0000", 2024-09-10T22:32:22.986 INFO:teuthology.orchestra.run.smithi019.stdout: "path": "/", 2024-09-10T22:32:22.986 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_started": 0, 2024-09-10T22:32:22.986 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_passed": 0, 2024-09-10T22:32:22.986 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_failed": 0, 2024-09-10T22:32:22.987 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_skipped": 0 2024-09-10T22:32:22.987 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:32:22.987 INFO:teuthology.orchestra.run.smithi019.stdout: "eb518e3c-a71e-4f32-9ca0-ae88930ca218": { 2024-09-10T22:32:22.987 INFO:teuthology.orchestra.run.smithi019.stdout: "start_time": "2024-09-10T22:28:38.366352+0000", 2024-09-10T22:32:22.987 INFO:teuthology.orchestra.run.smithi019.stdout: "path": "/", 2024-09-10T22:32:22.987 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_started": 0, 2024-09-10T22:32:22.987 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_passed": 0, 2024-09-10T22:32:22.987 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_failed": 0, 2024-09-10T22:32:22.987 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_skipped": 0 2024-09-10T22:32:22.987 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:32:22.987 INFO:teuthology.orchestra.run.smithi019.stdout: "c12c2a04-dcd6-4673-a98e-93f665d3f5d7": { 2024-09-10T22:32:22.988 INFO:teuthology.orchestra.run.smithi019.stdout: "start_time": "2024-09-10T22:27:49.392329+0000", 2024-09-10T22:32:22.988 INFO:teuthology.orchestra.run.smithi019.stdout: "path": "/", 2024-09-10T22:32:22.988 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_started": 0, 2024-09-10T22:32:22.988 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_passed": 0, 2024-09-10T22:32:22.988 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_failed": 0, 2024-09-10T22:32:22.988 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_skipped": 0 2024-09-10T22:32:22.988 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:32:22.988 INFO:teuthology.orchestra.run.smithi019.stdout: "b38852c8-478a-42ef-8384-b2c55d5313a4": { 2024-09-10T22:32:22.988 INFO:teuthology.orchestra.run.smithi019.stdout: "start_time": "2024-09-10T22:27:00.320308+0000", 2024-09-10T22:32:22.988 INFO:teuthology.orchestra.run.smithi019.stdout: "path": "/", 2024-09-10T22:32:22.989 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_started": 0, 2024-09-10T22:32:22.989 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_passed": 0, 2024-09-10T22:32:22.989 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_failed": 0, 2024-09-10T22:32:22.989 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_skipped": 0 2024-09-10T22:32:22.989 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:32:22.989 INFO:teuthology.orchestra.run.smithi019.stdout: "9b6bfdee-303c-4c12-af56-dc85860d112a": { 2024-09-10T22:32:22.989 INFO:teuthology.orchestra.run.smithi019.stdout: "start_time": "2024-09-10T22:26:17.484162+0000", 2024-09-10T22:32:22.989 INFO:teuthology.orchestra.run.smithi019.stdout: "path": "/", 2024-09-10T22:32:22.989 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_started": 0, 2024-09-10T22:32:22.989 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_passed": 0, 2024-09-10T22:32:22.989 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_failed": 0, 2024-09-10T22:32:22.989 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_skipped": 0 2024-09-10T22:32:22.990 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-10T22:32:22.990 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-10T22:32:22.990 INFO:teuthology.orchestra.run.smithi019.stdout:} 2024-09-10T22:32:22.990 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:22.978+0000 7f6f17572640 1 -- 172.21.15.19:0/3792439333 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f6efc0b5360 msgr2=0x7f6efc0b7820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:32:22.991 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:22.978+0000 7f6f17572640 1 --2- 172.21.15.19:0/3792439333 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f6efc0b5360 0x7f6efc0b7820 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f6f10103a30 tx=0x7f6f08005f90 comp rx=0 tx=0).stop 2024-09-10T22:32:22.991 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:22.978+0000 7f6f17572640 1 -- 172.21.15.19:0/3792439333 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f6f101045e0 msgr2=0x7f6f10101eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:32:22.991 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:22.978+0000 7f6f17572640 1 --2- 172.21.15.19:0/3792439333 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f6f101045e0 0x7f6f10101eb0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f6f0000e9c0 tx=0x7f6f0000ee80 comp rx=0 tx=0).stop 2024-09-10T22:32:22.991 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:22.978+0000 7f6f17572640 1 -- 172.21.15.19:0/3792439333 shutdown_connections 2024-09-10T22:32:22.991 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:22.978+0000 7f6f17572640 1 --2- 172.21.15.19:0/3792439333 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f6efc0b5360 0x7f6efc0b7820 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:32:22.991 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:22.978+0000 7f6f17572640 1 --2- 172.21.15.19:0/3792439333 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6f1010d120 0x7f6f101023f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:32:22.991 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:22.978+0000 7f6f17572640 1 --2- 172.21.15.19:0/3792439333 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f6f101045e0 0x7f6f10101eb0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:32:22.991 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:22.978+0000 7f6f17572640 1 --2- 172.21.15.19:0/3792439333 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6f10103cc0 0x7f6f10101970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:32:22.991 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:22.978+0000 7f6f17572640 1 -- 172.21.15.19:0/3792439333 >> 172.21.15.19:0/3792439333 conn(0x7f6f100fd700 msgr2=0x7f6f100fe360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:32:22.991 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:22.978+0000 7f6f17572640 1 -- 172.21.15.19:0/3792439333 shutdown_connections 2024-09-10T22:32:22.991 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:22.978+0000 7f6f17572640 1 -- 172.21.15.19:0/3792439333 wait complete. 2024-09-10T22:32:23.938 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-10T22:32:23.939 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 22997a4c-6fc2-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-10T22:32:24.208 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:32:23 smithi019 ceph-mon[31375]: pgmap v526: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 574 KiB/s rd, 287 MiB/s wr, 174 op/s 2024-09-10T22:32:24.303 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/22997a4c-6fc2-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T22:32:24.360 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:32:23 smithi135 ceph-mon[34789]: pgmap v526: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 574 KiB/s rd, 287 MiB/s wr, 174 op/s 2024-09-10T22:32:24.375 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:32:23 smithi138 ceph-mon[35236]: pgmap v526: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 574 KiB/s rd, 287 MiB/s wr, 174 op/s 2024-09-10T22:32:24.858 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:24.847+0000 7f723e0d6640 1 -- 172.21.15.19:0/2060561328 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7238104550 msgr2=0x7f723810cb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:32:24.858 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:24.847+0000 7f723e0d6640 1 --2- 172.21.15.19:0/2060561328 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7238104550 0x7f723810cb30 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7f722c009900 tx=0x7f722c02a410 comp rx=0 tx=0).stop 2024-09-10T22:32:24.858 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:24.847+0000 7f723e0d6640 1 -- 172.21.15.19:0/2060561328 shutdown_connections 2024-09-10T22:32:24.858 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:24.847+0000 7f723e0d6640 1 --2- 172.21.15.19:0/2060561328 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f723810d100 0x7f723810f550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:32:24.858 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:24.847+0000 7f723e0d6640 1 --2- 172.21.15.19:0/2060561328 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7238104550 0x7f723810cb30 unknown :-1 s=CLOSED pgs=651 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:32:24.858 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:24.847+0000 7f723e0d6640 1 --2- 172.21.15.19:0/2060561328 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7238103b50 0x7f7238103f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:32:24.858 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:24.847+0000 7f723e0d6640 1 -- 172.21.15.19:0/2060561328 >> 172.21.15.19:0/2060561328 conn(0x7f72380fd700 msgr2=0x7f72380ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:32:24.858 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:24.847+0000 7f723e0d6640 1 -- 172.21.15.19:0/2060561328 shutdown_connections 2024-09-10T22:32:24.859 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:24.847+0000 7f723e0d6640 1 -- 172.21.15.19:0/2060561328 wait complete. 2024-09-10T22:32:24.859 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:24.848+0000 7f723e0d6640 1 Processor -- start 2024-09-10T22:32:24.859 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:24.848+0000 7f723e0d6640 1 -- start start 2024-09-10T22:32:24.859 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:24.848+0000 7f723e0d6640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7238103b50 0x7f72381019d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:32:24.859 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:24.848+0000 7f723e0d6640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7238104550 0x7f7238101f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:32:24.859 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:24.848+0000 7f723e0d6640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f723810d100 0x7f7238102450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:32:24.859 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:24.848+0000 7f723e0d6640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f7238112db0 con 0x7f7238103b50 2024-09-10T22:32:24.859 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:24.848+0000 7f723e0d6640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f7238112c30 con 0x7f723810d100 2024-09-10T22:32:24.859 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:24.848+0000 7f723e0d6640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f7238112f30 con 0x7f7238104550 2024-09-10T22:32:24.859 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:24.848+0000 7f72377fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7238103b50 0x7f72381019d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:32:24.859 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:24.848+0000 7f72377fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7238103b50 0x7f72381019d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:47252/0 (socket says 172.21.15.19:47252) 2024-09-10T22:32:24.859 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:24.848+0000 7f72377fe640 1 -- 172.21.15.19:0/3366376120 learned_addr learned my addr 172.21.15.19:0/3366376120 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:32:24.860 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:24.848+0000 7f7236ffd640 1 --2- 172.21.15.19:0/3366376120 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7238104550 0x7f7238101f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:32:24.860 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:24.848+0000 7f7237fff640 1 --2- 172.21.15.19:0/3366376120 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f723810d100 0x7f7238102450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:32:24.860 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:24.849+0000 7f72377fe640 1 -- 172.21.15.19:0/3366376120 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7238104550 msgr2=0x7f7238101f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:32:24.860 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:24.849+0000 7f72377fe640 1 --2- 172.21.15.19:0/3366376120 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7238104550 0x7f7238101f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:32:24.860 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:24.849+0000 7f72377fe640 1 -- 172.21.15.19:0/3366376120 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f723810d100 msgr2=0x7f7238102450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:32:24.860 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:24.849+0000 7f72377fe640 1 --2- 172.21.15.19:0/3366376120 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f723810d100 0x7f7238102450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:32:24.860 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:24.849+0000 7f72377fe640 1 -- 172.21.15.19:0/3366376120 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f72381a76a0 con 0x7f7238103b50 2024-09-10T22:32:24.860 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:24.849+0000 7f72377fe640 1 --2- 172.21.15.19:0/3366376120 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7238103b50 0x7f72381019d0 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7f722800d950 tx=0x7f722800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:32:24.860 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:24.849+0000 7f7234ff9640 1 -- 172.21.15.19:0/3366376120 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7228017070 con 0x7f7238103b50 2024-09-10T22:32:24.860 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:24.849+0000 7f723e0d6640 1 -- 172.21.15.19:0/3366376120 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f72381a7990 con 0x7f7238103b50 2024-09-10T22:32:24.860 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:24.849+0000 7f7234ff9640 1 -- 172.21.15.19:0/3366376120 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7228009c30 con 0x7f7238103b50 2024-09-10T22:32:24.860 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:24.849+0000 7f7234ff9640 1 -- 172.21.15.19:0/3366376120 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f722800f620 con 0x7f7238103b50 2024-09-10T22:32:24.861 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:24.849+0000 7f723e0d6640 1 -- 172.21.15.19:0/3366376120 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f72381a7ea0 con 0x7f7238103b50 2024-09-10T22:32:24.861 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:24.850+0000 7f723e0d6640 1 -- 172.21.15.19:0/3366376120 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7238103f30 con 0x7f7238103b50 2024-09-10T22:32:24.861 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:24.853+0000 7f7234ff9640 1 -- 172.21.15.19:0/3366376120 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 18) ==== 153250+0+0 (secure 0 0 0) 0x7f7228010460 con 0x7f7238103b50 2024-09-10T22:32:24.861 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:24.853+0000 7f7234ff9640 1 --2- 172.21.15.19:0/3366376120 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f72200b52e0 0x7f72200b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:32:24.861 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:24.853+0000 7f7236ffd640 1 --2- 172.21.15.19:0/3366376120 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f72200b52e0 0x7f72200b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:32:24.861 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:24.853+0000 7f7234ff9640 1 -- 172.21.15.19:0/3366376120 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8327+0+0 (secure 0 0 0) 0x7f72280e5820 con 0x7f7238103b50 2024-09-10T22:32:24.861 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:24.854+0000 7f7236ffd640 1 --2- 172.21.15.19:0/3366376120 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f72200b52e0 0x7f72200b77a0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f722c005ab0 tx=0x7f722c005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:32:24.861 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:24.857+0000 7f7234ff9640 1 -- 172.21.15.19:0/3366376120 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f7228009de0 con 0x7f7238103b50 2024-09-10T22:32:25.176 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:25.174+0000 7f723e0d6640 1 -- 172.21.15.19:0/3366376120 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f7238102cd0 con 0x7f7238103b50 2024-09-10T22:32:25.177 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:25.175+0000 7f7234ff9640 1 -- 172.21.15.19:0/3366376120 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) ==== 94+0+11921 (secure 0 0 0) 0x7f72280abfd0 con 0x7f7238103b50 2024-09-10T22:32:25.177 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-10T22:32:25.177 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":27,"btime":"2024-09-10T22:29:37:724724+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14673,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6835/1835804747","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6834","nonce":1835804747},{"type":"v1","addr":"172.21.15.19:6835","nonce":1835804747}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14685,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6837/1750470490","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6836","nonce":1750470490},{"type":"v1","addr":"172.21.15.19:6837","nonce":1750470490}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14733,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6839/2642941149","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6838","nonce":2642941149},{"type":"v1","addr":"172.21.15.19:6839","nonce":2642941149}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14745,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6841/2449948682","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6840","nonce":2449948682},{"type":"v1","addr":"172.21.15.19:6841","nonce":2449948682}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24511,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.138:6833/2524811494","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6832","nonce":2524811494},{"type":"v1","addr":"172.21.15.138:6833","nonce":2524811494}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24512,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6833/3014993624","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6832","nonce":3014993624},{"type":"v1","addr":"172.21.15.135:6833","nonce":3014993624}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":27,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-10T22:24:22.733925+0000","modified":"2024-09-10T22:29:37.430699+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24581,"mds_1":24568,"mds_2":24553},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24527":{"gid":24527,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.135:6835/3715773348","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6834","nonce":3715773348},{"type":"v1","addr":"172.21.15.135:6835","nonce":3715773348}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24541":{"gid":24541,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.138:6835/933547028","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6834","nonce":933547028},{"type":"v1","addr":"172.21.15.138:6835","nonce":933547028}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24551":{"gid":24551,"name":"h","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.135:6837/3495029135","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6836","nonce":3495029135},{"type":"v1","addr":"172.21.15.135:6837","nonce":3495029135}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24553":{"gid":24553,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":10,"addr":"172.21.15.138:6837/3353290042","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6836","nonce":3353290042},{"type":"v1","addr":"172.21.15.138:6837","nonce":3353290042}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24568":{"gid":24568,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.138:6839/383637208","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6838","nonce":383637208},{"type":"v1","addr":"172.21.15.138:6839","nonce":383637208}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24581":{"gid":24581,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.135:6839/1254769802","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6838","nonce":1254769802},{"type":"v1","addr":"172.21.15.135:6839","nonce":1254769802}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24581,"qdb_cluster":[24581,24568,24553]},"id":1}]} 2024-09-10T22:32:25.178 INFO:teuthology.orchestra.run.smithi019.stderr:dumped fsmap epoch 27 2024-09-10T22:32:25.180 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:25.179+0000 7f723e0d6640 1 -- 172.21.15.19:0/3366376120 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f72200b52e0 msgr2=0x7f72200b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:32:25.180 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:25.179+0000 7f723e0d6640 1 --2- 172.21.15.19:0/3366376120 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f72200b52e0 0x7f72200b77a0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f722c005ab0 tx=0x7f722c005a20 comp rx=0 tx=0).stop 2024-09-10T22:32:25.180 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:25.179+0000 7f723e0d6640 1 -- 172.21.15.19:0/3366376120 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7238103b50 msgr2=0x7f72381019d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:32:25.180 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:25.179+0000 7f723e0d6640 1 --2- 172.21.15.19:0/3366376120 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7238103b50 0x7f72381019d0 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7f722800d950 tx=0x7f722800de10 comp rx=0 tx=0).stop 2024-09-10T22:32:25.181 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:25.179+0000 7f723e0d6640 1 -- 172.21.15.19:0/3366376120 shutdown_connections 2024-09-10T22:32:25.181 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:25.179+0000 7f723e0d6640 1 --2- 172.21.15.19:0/3366376120 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f72200b52e0 0x7f72200b77a0 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:32:25.181 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:25.179+0000 7f723e0d6640 1 --2- 172.21.15.19:0/3366376120 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f723810d100 0x7f7238102450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:32:25.181 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:25.179+0000 7f723e0d6640 1 --2- 172.21.15.19:0/3366376120 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7238104550 0x7f7238101f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:32:25.181 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:25.179+0000 7f723e0d6640 1 --2- 172.21.15.19:0/3366376120 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7238103b50 0x7f72381019d0 unknown :-1 s=CLOSED pgs=652 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:32:25.181 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:25.179+0000 7f723e0d6640 1 -- 172.21.15.19:0/3366376120 >> 172.21.15.19:0/3366376120 conn(0x7f72380fd700 msgr2=0x7f72380fe3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:32:25.181 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:25.179+0000 7f723e0d6640 1 -- 172.21.15.19:0/3366376120 shutdown_connections 2024-09-10T22:32:25.181 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:25.179+0000 7f723e0d6640 1 -- 172.21.15.19:0/3366376120 wait complete. 2024-09-10T22:32:25.970 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 22997a4c-6fc2-11ef-bcea-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-09-10T22:32:26.208 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:32:26 smithi019 ceph-mon[31375]: pgmap v527: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 898 KiB/s rd, 300 MiB/s wr, 172 op/s 2024-09-10T22:32:26.208 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:32:26 smithi019 ceph-mon[31375]: from='client.? 172.21.15.19:0/3366376120' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T22:32:26.293 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/22997a4c-6fc2-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T22:32:26.360 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:32:26 smithi135 ceph-mon[34789]: pgmap v527: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 898 KiB/s rd, 300 MiB/s wr, 172 op/s 2024-09-10T22:32:26.360 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:32:26 smithi135 ceph-mon[34789]: from='client.? 172.21.15.19:0/3366376120' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T22:32:26.376 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:32:26 smithi138 ceph-mon[35236]: pgmap v527: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 898 KiB/s rd, 300 MiB/s wr, 172 op/s 2024-09-10T22:32:26.376 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:32:26 smithi138 ceph-mon[35236]: from='client.? 172.21.15.19:0/3366376120' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T22:32:27.052 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:27.050+0000 7f6b3ace2640 1 -- 172.21.15.19:0/1461311082 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6b34101c90 msgr2=0x7f6b34102070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:32:27.052 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:27.050+0000 7f6b3ace2640 1 --2- 172.21.15.19:0/1461311082 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6b34101c90 0x7f6b34102070 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7f6b24009900 tx=0x7f6b2402a410 comp rx=0 tx=0).stop 2024-09-10T22:32:27.052 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:27.050+0000 7f6b3ace2640 1 -- 172.21.15.19:0/1461311082 shutdown_connections 2024-09-10T22:32:27.052 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:27.050+0000 7f6b3ace2640 1 --2- 172.21.15.19:0/1461311082 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6b34108020 0x7f6b3410e820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:32:27.052 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:27.050+0000 7f6b3ace2640 1 --2- 172.21.15.19:0/1461311082 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f6b341076a0 0x7f6b34107ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:32:27.052 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:27.050+0000 7f6b3ace2640 1 --2- 172.21.15.19:0/1461311082 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6b34101c90 0x7f6b34102070 unknown :-1 s=CLOSED pgs=653 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:32:27.053 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:27.050+0000 7f6b3ace2640 1 -- 172.21.15.19:0/1461311082 >> 172.21.15.19:0/1461311082 conn(0x7f6b340fd700 msgr2=0x7f6b340ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:32:27.053 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:27.050+0000 7f6b3ace2640 1 -- 172.21.15.19:0/1461311082 shutdown_connections 2024-09-10T22:32:27.053 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:27.050+0000 7f6b3ace2640 1 -- 172.21.15.19:0/1461311082 wait complete. 2024-09-10T22:32:27.054 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:27.051+0000 7f6b3ace2640 1 Processor -- start 2024-09-10T22:32:27.055 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:27.051+0000 7f6b3ace2640 1 -- start start 2024-09-10T22:32:27.055 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:27.051+0000 7f6b3ace2640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6b34101c90 0x7f6b3419a110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:32:27.055 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:27.051+0000 7f6b3ace2640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6b341076a0 0x7f6b3419a650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:32:27.055 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:27.051+0000 7f6b3ace2640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f6b34108020 0x7f6b3419abd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:32:27.055 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:27.051+0000 7f6b3ace2640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f6b34111ce0 con 0x7f6b34101c90 2024-09-10T22:32:27.055 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:27.051+0000 7f6b3ace2640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f6b34111b60 con 0x7f6b341076a0 2024-09-10T22:32:27.055 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:27.051+0000 7f6b3ace2640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f6b34111e60 con 0x7f6b34108020 2024-09-10T22:32:27.055 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:27.051+0000 7f6b38a7e640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6b34101c90 0x7f6b3419a110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:32:27.055 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:27.051+0000 7f6b38a7e640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6b34101c90 0x7f6b3419a110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:47260/0 (socket says 172.21.15.19:47260) 2024-09-10T22:32:27.055 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:27.051+0000 7f6b38a7e640 1 -- 172.21.15.19:0/1353181163 learned_addr learned my addr 172.21.15.19:0/1353181163 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:32:27.055 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:27.052+0000 7f6b33fff640 1 --2- 172.21.15.19:0/1353181163 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6b341076a0 0x7f6b3419a650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:32:27.055 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:27.052+0000 7f6b3927f640 1 --2- 172.21.15.19:0/1353181163 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f6b34108020 0x7f6b3419abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:32:27.056 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:27.052+0000 7f6b38a7e640 1 -- 172.21.15.19:0/1353181163 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f6b34108020 msgr2=0x7f6b3419abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:32:27.056 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:27.052+0000 7f6b38a7e640 1 --2- 172.21.15.19:0/1353181163 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f6b34108020 0x7f6b3419abd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:32:27.056 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:27.052+0000 7f6b38a7e640 1 -- 172.21.15.19:0/1353181163 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6b341076a0 msgr2=0x7f6b3419a650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:32:27.056 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:27.052+0000 7f6b38a7e640 1 --2- 172.21.15.19:0/1353181163 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6b341076a0 0x7f6b3419a650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:32:27.056 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:27.052+0000 7f6b38a7e640 1 -- 172.21.15.19:0/1353181163 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6b341a5510 con 0x7f6b34101c90 2024-09-10T22:32:27.056 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:27.052+0000 7f6b33fff640 1 --2- 172.21.15.19:0/1353181163 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6b341076a0 0x7f6b3419a650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T22:32:27.056 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:27.052+0000 7f6b38a7e640 1 --2- 172.21.15.19:0/1353181163 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6b34101c90 0x7f6b3419a110 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7f6b24005940 tx=0x7f6b240040c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:32:27.056 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:27.052+0000 7f6b31ffb640 1 -- 172.21.15.19:0/1353181163 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b2403f030 con 0x7f6b34101c90 2024-09-10T22:32:27.056 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:27.052+0000 7f6b3ace2640 1 -- 172.21.15.19:0/1353181163 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6b341a57a0 con 0x7f6b34101c90 2024-09-10T22:32:27.056 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:27.052+0000 7f6b31ffb640 1 -- 172.21.15.19:0/1353181163 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6b240044c0 con 0x7f6b34101c90 2024-09-10T22:32:27.056 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:27.052+0000 7f6b31ffb640 1 -- 172.21.15.19:0/1353181163 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b24035070 con 0x7f6b34101c90 2024-09-10T22:32:27.056 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:27.053+0000 7f6b3ace2640 1 -- 172.21.15.19:0/1353181163 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6b341a5c80 con 0x7f6b34101c90 2024-09-10T22:32:27.059 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:27.055+0000 7f6b3d0b7740 1 Processor -- start 2024-09-10T22:32:27.059 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:27.055+0000 7f6b3d0b7740 1 -- start start 2024-09-10T22:32:27.059 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:27.056+0000 7f6b3d0b7740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x559c308684d0 0x559c308688b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:32:27.059 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:27.056+0000 7f6b3d0b7740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x559c30868df0 0x559c30878c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:32:27.059 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:27.056+0000 7f6b3d0b7740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559c30879190 0x559c3087b580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:32:27.059 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:27.056+0000 7f6b3d0b7740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x559c307deea0 con 0x559c308684d0 2024-09-10T22:32:27.059 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:27.056+0000 7f6b3d0b7740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x559c307ce2d0 con 0x559c30879190 2024-09-10T22:32:27.059 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:27.056+0000 7f6b3d0b7740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x559c307d20e0 con 0x559c30868df0 2024-09-10T22:32:27.059 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:27.056+0000 7f6b3927f640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x559c308684d0 0x559c308688b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:32:27.059 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:27.056+0000 7f6b3927f640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x559c308684d0 0x559c308688b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:47262/0 (socket says 172.21.15.19:47262) 2024-09-10T22:32:27.059 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:27.056+0000 7f6b3927f640 1 -- 172.21.15.19:0/3254455885 learned_addr learned my addr 172.21.15.19:0/3254455885 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:32:27.060 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:27.056+0000 7f6b31ffb640 1 -- 172.21.15.19:0/1353181163 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 18) ==== 153250+0+0 (secure 0 0 0) 0x7f6b2403ba20 con 0x7f6b34101c90 2024-09-10T22:32:27.060 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:27.056+0000 7f6b33fff640 1 --2- 172.21.15.19:0/3254455885 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559c30879190 0x559c3087b580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:32:27.060 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:27.056+0000 7f6b38a7e640 1 --2- 172.21.15.19:0/3254455885 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x559c30868df0 0x559c30878c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:32:27.060 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:27.056+0000 7f6b3927f640 1 -- 172.21.15.19:0/3254455885 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x559c30868df0 msgr2=0x559c30878c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:32:27.060 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:27.056+0000 7f6b3927f640 1 --2- 172.21.15.19:0/3254455885 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x559c30868df0 0x559c30878c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:32:27.060 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:27.056+0000 7f6b3927f640 1 -- 172.21.15.19:0/3254455885 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559c30879190 msgr2=0x559c3087b580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:32:27.060 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:27.056+0000 7f6b3927f640 1 --2- 172.21.15.19:0/3254455885 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559c30879190 0x559c3087b580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:32:27.060 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:27.056+0000 7f6b3927f640 1 -- 172.21.15.19:0/3254455885 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559c3052c650 con 0x559c308684d0 2024-09-10T22:32:27.060 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:27.056+0000 7f6b33fff640 1 --2- 172.21.15.19:0/3254455885 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559c30879190 0x559c3087b580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T22:32:27.060 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:27.057+0000 7f6b3927f640 1 --2- 172.21.15.19:0/3254455885 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x559c308684d0 0x559c308688b0 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7f6b2c009c50 tx=0x7f6b2c011810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d9021266ca0775dc server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:32:27.060 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:27.057+0000 7f6b2affd640 1 -- 172.21.15.19:0/3254455885 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b2c01e070 con 0x559c308684d0 2024-09-10T22:32:27.060 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:27.057+0000 7f6b2affd640 1 -- 172.21.15.19:0/3254455885 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6b2c019ae0 con 0x559c308684d0 2024-09-10T22:32:27.060 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:27.057+0000 7f6b2affd640 1 -- 172.21.15.19:0/3254455885 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b2c00e990 con 0x559c308684d0 2024-09-10T22:32:27.061 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:27.057+0000 7f6b31ffb640 1 --2- 172.21.15.19:0/1353181163 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f6b200b52e0 0x7f6b200b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:32:27.061 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:27.057+0000 7f6b38a7e640 1 --2- 172.21.15.19:0/1353181163 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f6b200b52e0 0x7f6b200b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:32:27.061 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:27.057+0000 7f6b31ffb640 1 -- 172.21.15.19:0/1353181163 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8327+0+0 (secure 0 0 0) 0x7f6b24106200 con 0x7f6b34101c90 2024-09-10T22:32:27.065 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:27.058+0000 7f6b3d0b7740 1 -- 172.21.15.19:0/3254455885 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x559c308684d0 msgr2=0x559c308688b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:32:27.065 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:27.058+0000 7f6b38a7e640 1 --2- 172.21.15.19:0/1353181163 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f6b200b52e0 0x7f6b200b77a0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f6b24104010 tx=0x7f6b2403b4f0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:32:27.065 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:27.058+0000 7f6b3d0b7740 1 --2- 172.21.15.19:0/3254455885 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x559c308684d0 0x559c308688b0 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7f6b2c009c50 tx=0x7f6b2c011810 comp rx=0 tx=0).stop 2024-09-10T22:32:27.065 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:27.058+0000 7f6b3d0b7740 1 -- 172.21.15.19:0/3254455885 shutdown_connections 2024-09-10T22:32:27.065 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:27.058+0000 7f6b3d0b7740 1 --2- 172.21.15.19:0/3254455885 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559c30879190 0x559c3087b580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:32:27.065 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:27.058+0000 7f6b3d0b7740 1 --2- 172.21.15.19:0/3254455885 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x559c30868df0 0x559c30878c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:32:27.065 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:27.058+0000 7f6b3d0b7740 1 --2- 172.21.15.19:0/3254455885 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x559c308684d0 0x559c308688b0 unknown :-1 s=CLOSED pgs=655 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:32:27.066 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:27.058+0000 7f6b3d0b7740 1 -- 172.21.15.19:0/3254455885 >> 172.21.15.19:0/3254455885 conn(0x559c30866300 msgr2=0x559c308674a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:32:27.066 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:27.058+0000 7f6b3d0b7740 1 -- 172.21.15.19:0/3254455885 shutdown_connections 2024-09-10T22:32:27.066 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:27.058+0000 7f6b3d0b7740 1 -- 172.21.15.19:0/3254455885 wait complete. 2024-09-10T22:32:27.066 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:27.058+0000 7f6b3d0b7740 1 -- start start 2024-09-10T22:32:27.066 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:27.058+0000 7f6b3d0b7740 1 Processor -- start 2024-09-10T22:32:27.066 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:27.059+0000 7f6b3d0b7740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559c308684d0 0x559c30878ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:32:27.066 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:27.059+0000 7f6b3d0b7740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x559c30868df0 0x559c30875f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:32:27.066 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:27.059+0000 7f6b3d0b7740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x559c30879190 0x559c30876590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:32:27.066 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:27.059+0000 7f6b3d0b7740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x559c3062f700 con 0x559c30879190 2024-09-10T22:32:27.066 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:27.059+0000 7f6b3d0b7740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x559c30769160 con 0x559c308684d0 2024-09-10T22:32:27.066 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:27.059+0000 7f6b3d0b7740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x559c3087be40 con 0x559c30868df0 2024-09-10T22:32:27.066 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:27.059+0000 7f6b3d0b7740 10 client.0 _ll_register_callbacks cb 0x559c307829e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T22:32:27.067 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:27.059+0000 7f6b3927f640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x559c30879190 0x559c30876590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:32:27.067 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:27.059+0000 7f6b33fff640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x559c30868df0 0x559c30875f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:32:27.067 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:27.059+0000 7f6b3927f640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x559c30879190 0x559c30876590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:47264/0 (socket says 172.21.15.19:47264) 2024-09-10T22:32:27.067 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:27.059+0000 7f6b3927f640 1 -- 172.21.15.19:0/2766240353 learned_addr learned my addr 172.21.15.19:0/2766240353 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:32:27.067 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:27.059+0000 7f6b3927f640 1 --2- 172.21.15.19:0/2766240353 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559c308684d0 0x559c30878ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:32:27.067 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:27.059+0000 7f6b33fff640 1 -- 172.21.15.19:0/2766240353 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559c308684d0 msgr2=0x559c30878ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:32:27.067 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:27.059+0000 7f6b33fff640 1 --2- 172.21.15.19:0/2766240353 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559c308684d0 0x559c30878ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:32:27.067 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:27.059+0000 7f6b33fff640 1 -- 172.21.15.19:0/2766240353 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x559c30879190 msgr2=0x559c30876590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:32:27.067 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:27.059+0000 7f6b33fff640 1 --2- 172.21.15.19:0/2766240353 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x559c30879190 0x559c30876590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:32:27.067 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:27.059+0000 7f6b33fff640 1 -- 172.21.15.19:0/2766240353 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559c30796c90 con 0x559c30868df0 2024-09-10T22:32:27.067 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:27.060+0000 7f6b33fff640 1 --2- 172.21.15.19:0/2766240353 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x559c30868df0 0x559c30875f10 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f6b3406b6d0 tx=0x7f6b1c012820 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c514a6d6095b1681 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:32:27.067 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:27.060+0000 7f6b13fff640 10 client.0 ms_handle_connect on v2:172.21.15.138:3300/0 2024-09-10T22:32:27.067 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:27.060+0000 7f6b13fff640 1 -- 172.21.15.19:0/2766240353 <== mon.1 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b1c003970 con 0x559c30868df0 2024-09-10T22:32:27.068 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:27.060+0000 7f6b13fff640 1 -- 172.21.15.19:0/2766240353 <== mon.1 v2:172.21.15.138:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8327+0+0 (secure 0 0 0) 0x7f6b1c003b10 con 0x559c30868df0 2024-09-10T22:32:27.068 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:27.060+0000 7f6b3d0b7740 1 -- 172.21.15.19:0/2766240353 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6b2c019ae0 con 0x559c30868df0 2024-09-10T22:32:27.068 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:27.060+0000 7f6b13fff640 1 -- 172.21.15.19:0/2766240353 <== mon.1 v2:172.21.15.138:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f6b1c003d10 con 0x559c30868df0 2024-09-10T22:32:27.068 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:27.060+0000 7f6b3d0b7740 10 client.25996 fetch_fsmap learned FSMap version 27 2024-09-10T22:32:27.068 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:27.060+0000 7f6b3d0b7740 1 -- 172.21.15.19:0/2766240353 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x559c30887810 con 0x559c30868df0 2024-09-10T22:32:27.068 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:27.060+0000 7f6b13fff640 1 -- 172.21.15.19:0/2766240353 <== mon.1 v2:172.21.15.138:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6b2c019ae0 con 0x559c30868df0 2024-09-10T22:32:27.068 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:27.060+0000 7f6b13fff640 1 -- 172.21.15.19:0/2766240353 <== mon.1 v2:172.21.15.138:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7f6b1c010660 con 0x559c30868df0 2024-09-10T22:32:27.068 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:27.061+0000 7f6b3d0b7740 10 client.25996 fetch_fsmap finished waiting for FSMap version 27 2024-09-10T22:32:27.068 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:27.061+0000 7f6b3d0b7740 10 client.25996 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-10T22:32:27.068 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:27.061+0000 7f6b3d0b7740 20 client.25996 populate_metadata read hostname 'smithi019' 2024-09-10T22:32:27.068 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:27.061+0000 7f6b3d0b7740 1 --2- 172.21.15.19:0/2766240353 >> [v2:172.21.15.138:6836/3353290042,v1:172.21.15.138:6837/3353290042] conn(0x559c30888d20 0x559c3088b140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:32:27.068 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:27.061+0000 7f6b3d0b7740 4 client.25996 mds_command: new command op to 24553 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T22:32:27.068 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:27.061+0000 7f6b3d0b7740 1 -- 172.21.15.19:0/2766240353 --> [v2:172.21.15.138:6836/3353290042,v1:172.21.15.138:6837/3353290042] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x559c307e0df0 con 0x559c30888d20 2024-09-10T22:32:27.069 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:27.061+0000 7f6b3927f640 1 --2- 172.21.15.19:0/2766240353 >> [v2:172.21.15.138:6836/3353290042,v1:172.21.15.138:6837/3353290042] conn(0x559c30888d20 0x559c3088b140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:32:27.069 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:27.061+0000 7f6b13fff640 10 client.25996 ms_handle_connect on v2:172.21.15.138:6836/3353290042 2024-09-10T22:32:27.069 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:27.061+0000 7f6b3927f640 1 --2- 172.21.15.19:0/2766240353 >> [v2:172.21.15.138:6836/3353290042,v1:172.21.15.138:6837/3353290042] conn(0x559c30888d20 0x559c3088b140 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=a8ac2a385b619664 server_cookie=c290312086d52cf5 in_seq=0 out_seq=0 2024-09-10T22:32:27.069 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:27.062+0000 7f6b13fff640 1 -- 172.21.15.19:0/2766240353 <== mds.2 v2:172.21.15.138:6836/3353290042 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x559c307e0df0 con 0x559c30888d20 2024-09-10T22:32:27.069 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:27.062+0000 7f6b13fff640 10 client.25996 handle_command_reply: tid=0 2024-09-10T22:32:27.069 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:27.062+0000 7f6b3d0b7740 1 client.25996 shutdown 2024-09-10T22:32:27.069 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:27.062+0000 7f6b3d0b7740 1 -- 172.21.15.19:0/2766240353 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x559c30868df0 msgr2=0x559c30875f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:32:27.069 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:27.062+0000 7f6b3d0b7740 1 --2- 172.21.15.19:0/2766240353 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x559c30868df0 0x559c30875f10 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f6b3406b6d0 tx=0x7f6b1c012820 comp rx=0 tx=0).stop 2024-09-10T22:32:27.069 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:27.062+0000 7f6b3d0b7740 1 -- 172.21.15.19:0/2766240353 shutdown_connections 2024-09-10T22:32:27.069 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:27.062+0000 7f6b3d0b7740 1 --2- 172.21.15.19:0/2766240353 >> [v2:172.21.15.138:6836/3353290042,v1:172.21.15.138:6837/3353290042] conn(0x559c30888d20 0x559c3088b140 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:32:27.069 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:27.062+0000 7f6b13fff640 0 client.25996 ms_handle_reset on v2:172.21.15.138:6836/3353290042 2024-09-10T22:32:27.069 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:27.062+0000 7f6b3d0b7740 1 --2- 172.21.15.19:0/2766240353 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x559c30879190 0x559c30876590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:32:27.070 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:27.062+0000 7f6b3d0b7740 1 --2- 172.21.15.19:0/2766240353 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x559c30868df0 0x559c30875f10 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:32:27.070 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:27.062+0000 7f6b3d0b7740 1 --2- 172.21.15.19:0/2766240353 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559c308684d0 0x559c30878ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:32:27.070 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:27.062+0000 7f6b3d0b7740 1 -- 172.21.15.19:0/2766240353 >> 172.21.15.19:0/2766240353 conn(0x559c30866300 msgr2=0x559c3086bea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:32:27.070 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:27.063+0000 7f6b3d0b7740 1 -- 172.21.15.19:0/2766240353 shutdown_connections 2024-09-10T22:32:27.070 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:27.063+0000 7f6b3d0b7740 1 -- 172.21.15.19:0/2766240353 wait complete. 2024-09-10T22:32:27.070 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:27.063+0000 7f6b3d0b7740 20 client.25996 trim_cache size 0 max 16384 2024-09-10T22:32:27.088 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:27.086+0000 7f6b3d0b7740 1 Processor -- start 2024-09-10T22:32:27.088 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:27.086+0000 7f6b3d0b7740 1 -- start start 2024-09-10T22:32:27.089 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:27.086+0000 7f6b3d0b7740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x559c308684d0 0x559c30865c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:32:27.089 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:27.086+0000 7f6b3d0b7740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559c30868df0 0x559c30885070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:32:27.089 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:27.086+0000 7f6b3d0b7740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x559c30879190 0x559c308676f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:32:27.089 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:27.086+0000 7f6b3d0b7740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f6b341aec00 con 0x559c30879190 2024-09-10T22:32:27.089 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:27.086+0000 7f6b3d0b7740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f6b341ac4d0 con 0x559c30868df0 2024-09-10T22:32:27.089 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:27.086+0000 7f6b3d0b7740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f6b341aa320 con 0x559c308684d0 2024-09-10T22:32:27.089 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:27.086+0000 7f6b33fff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559c30868df0 0x559c30885070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:32:27.089 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:27.086+0000 7f6b3927f640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x559c30879190 0x559c308676f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:32:27.090 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:27.086+0000 7f6b33fff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559c30868df0 0x559c30885070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.19:57520/0 (socket says 172.21.15.19:57520) 2024-09-10T22:32:27.090 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:27.086+0000 7f6b33fff640 1 -- 172.21.15.19:0/4068118365 learned_addr learned my addr 172.21.15.19:0/4068118365 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:32:27.090 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:27.086+0000 7f6b3927f640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x559c30879190 0x559c308676f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:47268/0 (socket says 172.21.15.19:47268) 2024-09-10T22:32:27.090 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:27.086+0000 7f6b3927f640 1 --2- 172.21.15.19:0/4068118365 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x559c308684d0 0x559c30865c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:32:27.090 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:27.086+0000 7f6b33fff640 1 -- 172.21.15.19:0/4068118365 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x559c308684d0 msgr2=0x559c30865c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:32:27.090 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:27.086+0000 7f6b33fff640 1 --2- 172.21.15.19:0/4068118365 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x559c308684d0 0x559c30865c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:32:27.090 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:27.086+0000 7f6b33fff640 1 -- 172.21.15.19:0/4068118365 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x559c30879190 msgr2=0x559c308676f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:32:27.090 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:27.086+0000 7f6b33fff640 1 --2- 172.21.15.19:0/4068118365 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x559c30879190 0x559c308676f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:32:27.090 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:27.086+0000 7f6b33fff640 1 -- 172.21.15.19:0/4068118365 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559c30876900 con 0x559c30868df0 2024-09-10T22:32:27.091 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:27.087+0000 7f6b33fff640 1 --2- 172.21.15.19:0/4068118365 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559c30868df0 0x559c30885070 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f6b1c012420 tx=0x7f6b1c005d30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=435358129c2a3881 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:32:27.091 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:27.087+0000 7f6b2a7fc640 1 -- 172.21.15.19:0/4068118365 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b1c003970 con 0x559c30868df0 2024-09-10T22:32:27.091 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:27.087+0000 7f6b2a7fc640 1 -- 172.21.15.19:0/4068118365 <== mon.2 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6b1c003b10 con 0x559c30868df0 2024-09-10T22:32:27.091 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:27.087+0000 7f6b2a7fc640 1 -- 172.21.15.19:0/4068118365 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b1c0057c0 con 0x559c30868df0 2024-09-10T22:32:27.095 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:27.088+0000 7f6b3d0b7740 1 -- 172.21.15.19:0/4068118365 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559c30868df0 msgr2=0x559c30885070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:32:27.095 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:27.088+0000 7f6b3d0b7740 1 --2- 172.21.15.19:0/4068118365 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559c30868df0 0x559c30885070 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f6b1c012420 tx=0x7f6b1c005d30 comp rx=0 tx=0).stop 2024-09-10T22:32:27.095 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:27.088+0000 7f6b3d0b7740 1 -- 172.21.15.19:0/4068118365 shutdown_connections 2024-09-10T22:32:27.095 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:27.088+0000 7f6b3d0b7740 1 --2- 172.21.15.19:0/4068118365 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x559c30879190 0x559c308676f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:32:27.095 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:27.088+0000 7f6b3d0b7740 1 --2- 172.21.15.19:0/4068118365 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559c30868df0 0x559c30885070 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:32:27.095 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:27.088+0000 7f6b3d0b7740 1 --2- 172.21.15.19:0/4068118365 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x559c308684d0 0x559c30865c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:32:27.095 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:27.088+0000 7f6b3d0b7740 1 -- 172.21.15.19:0/4068118365 >> 172.21.15.19:0/4068118365 conn(0x559c30866300 msgr2=0x559c30866fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:32:27.096 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:27.088+0000 7f6b3d0b7740 1 -- 172.21.15.19:0/4068118365 shutdown_connections 2024-09-10T22:32:27.096 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:27.088+0000 7f6b3d0b7740 1 -- 172.21.15.19:0/4068118365 wait complete. 2024-09-10T22:32:27.096 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:27.088+0000 7f6b3d0b7740 1 -- start start 2024-09-10T22:32:27.096 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:27.088+0000 7f6b3d0b7740 1 Processor -- start 2024-09-10T22:32:27.096 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:27.089+0000 7f6b3d0b7740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x559c308684d0 0x559c308810d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:32:27.096 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:27.089+0000 7f6b3d0b7740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559c30868df0 0x559c30881610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:32:27.096 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:27.089+0000 7f6b3d0b7740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x559c30879190 0x559c3087e0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:32:27.096 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:27.089+0000 7f6b3d0b7740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f6b341aa990 con 0x559c308684d0 2024-09-10T22:32:27.096 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:27.089+0000 7f6b3d0b7740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f6b341abe00 con 0x559c30868df0 2024-09-10T22:32:27.096 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:27.089+0000 7f6b3d0b7740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f6b341ab060 con 0x559c30879190 2024-09-10T22:32:27.096 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:27.089+0000 7f6b3d0b7740 10 client.0 _ll_register_callbacks cb 0x7f6b1c00f4a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T22:32:27.096 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:27.089+0000 7f6b3927f640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x559c308684d0 0x559c308810d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:32:27.097 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:27.089+0000 7f6b3927f640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x559c308684d0 0x559c308810d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:47280/0 (socket says 172.21.15.19:47280) 2024-09-10T22:32:27.097 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:27.089+0000 7f6b3927f640 1 -- 172.21.15.19:0/3964454353 learned_addr learned my addr 172.21.15.19:0/3964454353 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:32:27.097 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:27.089+0000 7f6b33fff640 1 --2- 172.21.15.19:0/3964454353 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559c30868df0 0x559c30881610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:32:27.097 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:27.089+0000 7f6b3927f640 1 --2- 172.21.15.19:0/3964454353 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x559c30879190 0x559c3087e0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:32:27.097 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:27.089+0000 7f6b3927f640 1 -- 172.21.15.19:0/3964454353 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x559c30879190 msgr2=0x559c3087e0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:32:27.097 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:27.089+0000 7f6b3927f640 1 --2- 172.21.15.19:0/3964454353 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x559c30879190 0x559c3087e0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:32:27.097 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:27.089+0000 7f6b3927f640 1 -- 172.21.15.19:0/3964454353 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559c30868df0 msgr2=0x559c30881610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:32:27.097 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:27.089+0000 7f6b3927f640 1 --2- 172.21.15.19:0/3964454353 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559c30868df0 0x559c30881610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:32:27.097 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:27.089+0000 7f6b3927f640 1 -- 172.21.15.19:0/3964454353 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559c30881e10 con 0x559c308684d0 2024-09-10T22:32:27.097 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:27.089+0000 7f6b33fff640 1 --2- 172.21.15.19:0/3964454353 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559c30868df0 0x559c30881610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T22:32:27.097 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:27.089+0000 7f6b3927f640 1 --2- 172.21.15.19:0/3964454353 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x559c308684d0 0x559c308810d0 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7f6b2c001eb0 tx=0x7f6b2c02ff90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7743714a7c79a19d server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:32:27.097 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:27.089+0000 7f6b13fff640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-10T22:32:27.097 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:27.090+0000 7f6b13fff640 1 -- 172.21.15.19:0/3964454353 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b2c01e040 con 0x559c308684d0 2024-09-10T22:32:27.098 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:27.090+0000 7f6b3d0b7740 1 -- 172.21.15.19:0/3964454353 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6b1c003b10 con 0x559c308684d0 2024-09-10T22:32:27.098 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:27.090+0000 7f6b13fff640 1 -- 172.21.15.19:0/3964454353 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8327+0+0 (secure 0 0 0) 0x7f6b2c019430 con 0x559c308684d0 2024-09-10T22:32:27.098 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:27.090+0000 7f6b13fff640 1 -- 172.21.15.19:0/3964454353 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f6b2c019630 con 0x559c308684d0 2024-09-10T22:32:27.098 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:27.090+0000 7f6b3d0b7740 10 client.16560 fetch_fsmap learned FSMap version 27 2024-09-10T22:32:27.098 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:27.090+0000 7f6b3d0b7740 1 -- 172.21.15.19:0/3964454353 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x559c308f6230 con 0x559c308684d0 2024-09-10T22:32:27.098 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:27.090+0000 7f6b13fff640 1 -- 172.21.15.19:0/3964454353 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6b1c003b10 con 0x559c308684d0 2024-09-10T22:32:27.098 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:27.090+0000 7f6b13fff640 1 -- 172.21.15.19:0/3964454353 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7f6b2c024040 con 0x559c308684d0 2024-09-10T22:32:27.098 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:27.090+0000 7f6b3d0b7740 10 client.16560 fetch_fsmap finished waiting for FSMap version 27 2024-09-10T22:32:27.098 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:27.090+0000 7f6b3d0b7740 10 client.16560 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-10T22:32:27.098 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:27.090+0000 7f6b3d0b7740 20 client.16560 populate_metadata read hostname 'smithi019' 2024-09-10T22:32:27.098 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:27.090+0000 7f6b3d0b7740 1 --2- 172.21.15.19:0/3964454353 >> [v2:172.21.15.138:6836/3353290042,v1:172.21.15.138:6837/3353290042] conn(0x559c30888d20 0x559c308f87e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:32:27.098 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:27.090+0000 7f6b3d0b7740 4 client.16560 mds_command: new command op to 24553 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-10T22:32:27.099 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:27.090+0000 7f6b3d0b7740 1 -- 172.21.15.19:0/3964454353 --> [v2:172.21.15.138:6836/3353290042,v1:172.21.15.138:6837/3353290042] -- command(tid 0: {"prefix": "damage ls"}) -- 0x559c307dc8a0 con 0x559c30888d20 2024-09-10T22:32:27.099 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:27.091+0000 7f6b33fff640 1 --2- 172.21.15.19:0/3964454353 >> [v2:172.21.15.138:6836/3353290042,v1:172.21.15.138:6837/3353290042] conn(0x559c30888d20 0x559c308f87e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:32:27.099 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:27.091+0000 7f6b33fff640 1 --2- 172.21.15.19:0/3964454353 >> [v2:172.21.15.138:6836/3353290042,v1:172.21.15.138:6837/3353290042] conn(0x559c30888d20 0x559c308f87e0 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=4101911797b44092 server_cookie=9210b083c328f387 in_seq=0 out_seq=0 2024-09-10T22:32:27.099 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:27.091+0000 7f6b13fff640 10 client.16560 ms_handle_connect on v2:172.21.15.138:6836/3353290042 2024-09-10T22:32:27.099 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:27.091+0000 7f6b13fff640 1 -- 172.21.15.19:0/3964454353 <== mds.2 v2:172.21.15.138:6836/3353290042 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x559c307dc8a0 con 0x559c30888d20 2024-09-10T22:32:27.099 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:27.091+0000 7f6b13fff640 10 client.16560 handle_command_reply: tid=0 2024-09-10T22:32:27.099 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:27.091+0000 7f6b3d0b7740 1 client.16560 shutdown 2024-09-10T22:32:27.099 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:27.091+0000 7f6b3d0b7740 1 -- 172.21.15.19:0/3964454353 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x559c308684d0 msgr2=0x559c308810d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:32:27.099 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:27.091+0000 7f6b3d0b7740 1 --2- 172.21.15.19:0/3964454353 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x559c308684d0 0x559c308810d0 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7f6b2c001eb0 tx=0x7f6b2c02ff90 comp rx=0 tx=0).stop 2024-09-10T22:32:27.099 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:27.092+0000 7f6b3d0b7740 1 -- 172.21.15.19:0/3964454353 shutdown_connections 2024-09-10T22:32:27.099 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:27.092+0000 7f6b3d0b7740 1 --2- 172.21.15.19:0/3964454353 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x559c30879190 0x559c3087e0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:32:27.099 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:27.092+0000 7f6b3d0b7740 1 --2- 172.21.15.19:0/3964454353 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559c30868df0 0x559c30881610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:32:27.100 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:27.092+0000 7f6b3d0b7740 1 --2- 172.21.15.19:0/3964454353 >> [v2:172.21.15.138:6836/3353290042,v1:172.21.15.138:6837/3353290042] conn(0x559c30888d20 0x559c308f87e0 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:32:27.100 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:27.092+0000 7f6b3d0b7740 1 --2- 172.21.15.19:0/3964454353 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x559c308684d0 0x559c308810d0 unknown :-1 s=CLOSED pgs=656 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:32:27.100 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:27.092+0000 7f6b13fff640 0 client.16560 ms_handle_reset on v2:172.21.15.138:6836/3353290042 2024-09-10T22:32:27.100 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:27.092+0000 7f6b3d0b7740 1 -- 172.21.15.19:0/3964454353 >> 172.21.15.19:0/3964454353 conn(0x559c30866300 msgr2=0x559c3086bea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:32:27.100 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:27.092+0000 7f6b3d0b7740 1 -- 172.21.15.19:0/3964454353 shutdown_connections 2024-09-10T22:32:27.100 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:27.092+0000 7f6b3d0b7740 1 -- 172.21.15.19:0/3964454353 wait complete. 2024-09-10T22:32:27.100 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:27.092+0000 7f6b3d0b7740 20 client.16560 trim_cache size 0 max 16384 2024-09-10T22:32:27.100 INFO:teuthology.orchestra.run.smithi019.stdout:[] 2024-09-10T22:32:27.101 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:27.092+0000 7f6b3ace2640 1 -- 172.21.15.19:0/1353181163 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f6b200b52e0 msgr2=0x7f6b200b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:32:27.101 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:27.092+0000 7f6b3ace2640 1 --2- 172.21.15.19:0/1353181163 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f6b200b52e0 0x7f6b200b77a0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f6b24104010 tx=0x7f6b2403b4f0 comp rx=0 tx=0).stop 2024-09-10T22:32:27.101 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:27.092+0000 7f6b3ace2640 1 -- 172.21.15.19:0/1353181163 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6b34101c90 msgr2=0x7f6b3419a110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:32:27.101 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:27.092+0000 7f6b3ace2640 1 --2- 172.21.15.19:0/1353181163 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6b34101c90 0x7f6b3419a110 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7f6b24005940 tx=0x7f6b240040c0 comp rx=0 tx=0).stop 2024-09-10T22:32:27.101 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:27.092+0000 7f6b3ace2640 1 -- 172.21.15.19:0/1353181163 shutdown_connections 2024-09-10T22:32:27.101 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:27.092+0000 7f6b3ace2640 1 --2- 172.21.15.19:0/1353181163 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f6b200b52e0 0x7f6b200b77a0 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:32:27.101 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:27.092+0000 7f6b3ace2640 1 --2- 172.21.15.19:0/1353181163 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f6b34108020 0x7f6b3419abd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:32:27.101 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:27.092+0000 7f6b3ace2640 1 --2- 172.21.15.19:0/1353181163 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6b341076a0 0x7f6b3419a650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:32:27.102 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:27.092+0000 7f6b3ace2640 1 --2- 172.21.15.19:0/1353181163 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6b34101c90 0x7f6b3419a110 unknown :-1 s=CLOSED pgs=654 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:32:27.102 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:27.092+0000 7f6b3ace2640 1 -- 172.21.15.19:0/1353181163 >> 172.21.15.19:0/1353181163 conn(0x7f6b340fd700 msgr2=0x7f6b340ffaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:32:27.102 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:27.093+0000 7f6b3ace2640 1 -- 172.21.15.19:0/1353181163 shutdown_connections 2024-09-10T22:32:27.102 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:27.093+0000 7f6b3ace2640 1 -- 172.21.15.19:0/1353181163 wait complete. 2024-09-10T22:32:28.017 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 22997a4c-6fc2-11ef-bcea-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-09-10T22:32:28.359 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:32:28 smithi135 ceph-mon[34789]: pgmap v528: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 899 KiB/s rd, 335 MiB/s wr, 190 op/s 2024-09-10T22:32:28.375 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:32:28 smithi138 ceph-mon[35236]: pgmap v528: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 899 KiB/s rd, 335 MiB/s wr, 190 op/s 2024-09-10T22:32:28.418 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/22997a4c-6fc2-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T22:32:28.458 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:32:28 smithi019 ceph-mon[31375]: pgmap v528: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 899 KiB/s rd, 335 MiB/s wr, 190 op/s 2024-09-10T22:32:29.001 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:28.991+0000 7fcf62461640 1 -- 172.21.15.19:0/2787459164 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fcf5c10d140 msgr2=0x7fcf5c10f5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:32:29.001 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:28.991+0000 7fcf62461640 1 --2- 172.21.15.19:0/2787459164 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fcf5c10d140 0x7fcf5c10f5a0 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7fcf54009ca0 tx=0x7fcf5402a8c0 comp rx=0 tx=0).stop 2024-09-10T22:32:29.002 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:28.992+0000 7fcf62461640 1 -- 172.21.15.19:0/2787459164 shutdown_connections 2024-09-10T22:32:29.002 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:28.992+0000 7fcf62461640 1 --2- 172.21.15.19:0/2787459164 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fcf5c10d140 0x7fcf5c10f5a0 unknown :-1 s=CLOSED pgs=657 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:32:29.002 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:28.992+0000 7fcf62461640 1 --2- 172.21.15.19:0/2787459164 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fcf5c104600 0x7fcf5c10caf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:32:29.002 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:28.992+0000 7fcf62461640 1 --2- 172.21.15.19:0/2787459164 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcf5c103ce0 0x7fcf5c1040c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:32:29.002 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:28.992+0000 7fcf62461640 1 -- 172.21.15.19:0/2787459164 >> 172.21.15.19:0/2787459164 conn(0x7fcf5c0fd740 msgr2=0x7fcf5c0ffb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:32:29.002 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:28.992+0000 7fcf62461640 1 -- 172.21.15.19:0/2787459164 shutdown_connections 2024-09-10T22:32:29.002 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:28.992+0000 7fcf62461640 1 -- 172.21.15.19:0/2787459164 wait complete. 2024-09-10T22:32:29.002 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:28.992+0000 7fcf62461640 1 Processor -- start 2024-09-10T22:32:29.002 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:28.992+0000 7fcf62461640 1 -- start start 2024-09-10T22:32:29.002 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:28.993+0000 7fcf62461640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fcf5c103ce0 0x7fcf5c199330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:32:29.002 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:28.993+0000 7fcf62461640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcf5c104600 0x7fcf5c199870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:32:29.002 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:28.993+0000 7fcf62461640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fcf5c10d140 0x7fcf5c19ec10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:32:29.002 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:28.993+0000 7fcf62461640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fcf5c112e00 con 0x7fcf5c103ce0 2024-09-10T22:32:29.003 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:28.993+0000 7fcf62461640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fcf5c112c80 con 0x7fcf5c104600 2024-09-10T22:32:29.003 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:28.993+0000 7fcf62461640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7fcf5c112f80 con 0x7fcf5c10d140 2024-09-10T22:32:29.003 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:28.993+0000 7fcf5bfff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fcf5c103ce0 0x7fcf5c199330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:32:29.003 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:28.993+0000 7fcf5b7fe640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcf5c104600 0x7fcf5c199870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:32:29.003 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:28.993+0000 7fcf5bfff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fcf5c103ce0 0x7fcf5c199330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:47288/0 (socket says 172.21.15.19:47288) 2024-09-10T22:32:29.003 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:28.993+0000 7fcf5bfff640 1 -- 172.21.15.19:0/2595249718 learned_addr learned my addr 172.21.15.19:0/2595249718 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:32:29.003 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:28.993+0000 7fcf609fe640 1 --2- 172.21.15.19:0/2595249718 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fcf5c10d140 0x7fcf5c19ec10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:32:29.003 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:28.993+0000 7fcf5b7fe640 1 -- 172.21.15.19:0/2595249718 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fcf5c10d140 msgr2=0x7fcf5c19ec10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:32:29.003 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:28.993+0000 7fcf5b7fe640 1 --2- 172.21.15.19:0/2595249718 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fcf5c10d140 0x7fcf5c19ec10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:32:29.003 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:28.993+0000 7fcf5b7fe640 1 -- 172.21.15.19:0/2595249718 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fcf5c103ce0 msgr2=0x7fcf5c199330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:32:29.003 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:28.993+0000 7fcf5b7fe640 1 --2- 172.21.15.19:0/2595249718 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fcf5c103ce0 0x7fcf5c199330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:32:29.003 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:28.993+0000 7fcf5b7fe640 1 -- 172.21.15.19:0/2595249718 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcf5c19f3e0 con 0x7fcf5c104600 2024-09-10T22:32:29.003 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:28.994+0000 7fcf5b7fe640 1 --2- 172.21.15.19:0/2595249718 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcf5c104600 0x7fcf5c199870 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fcf5000e9c0 tx=0x7fcf5000ee80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:32:29.004 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:28.994+0000 7fcf597fa640 1 -- 172.21.15.19:0/2595249718 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf5000ccc0 con 0x7fcf5c104600 2024-09-10T22:32:29.004 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:28.994+0000 7fcf597fa640 1 -- 172.21.15.19:0/2595249718 <== mon.2 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fcf500108e0 con 0x7fcf5c104600 2024-09-10T22:32:29.004 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:28.994+0000 7fcf62461640 1 -- 172.21.15.19:0/2595249718 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcf5c19f6d0 con 0x7fcf5c104600 2024-09-10T22:32:29.004 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:28.994+0000 7fcf597fa640 1 -- 172.21.15.19:0/2595249718 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf50018860 con 0x7fcf5c104600 2024-09-10T22:32:29.004 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:28.994+0000 7fcf62461640 1 -- 172.21.15.19:0/2595249718 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcf5c1a5d90 con 0x7fcf5c104600 2024-09-10T22:32:29.004 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:28.997+0000 7fcf597fa640 1 -- 172.21.15.19:0/2595249718 <== mon.2 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 18) ==== 153250+0+0 (secure 0 0 0) 0x7fcf50010430 con 0x7fcf5c104600 2024-09-10T22:32:29.004 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:28.997+0000 7fcf597fa640 1 --2- 172.21.15.19:0/2595249718 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7fcf440b52e0 0x7fcf440b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:32:29.004 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:28.997+0000 7fcf5bfff640 1 --2- 172.21.15.19:0/2595249718 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7fcf440b52e0 0x7fcf440b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:32:29.004 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:28.998+0000 7fcf597fa640 1 -- 172.21.15.19:0/2595249718 <== mon.2 v2:172.21.15.135:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8327+0+0 (secure 0 0 0) 0x7fcf500e5ed0 con 0x7fcf5c104600 2024-09-10T22:32:29.004 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:28.998+0000 7fcf5bfff640 1 --2- 172.21.15.19:0/2595249718 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7fcf440b52e0 0x7fcf440b77a0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7fcf4c009c90 tx=0x7fcf4c005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:32:29.004 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:28.998+0000 7fcf64836740 1 Processor -- start 2024-09-10T22:32:29.004 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:28.998+0000 7fcf64836740 1 -- start start 2024-09-10T22:32:29.005 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:28.998+0000 7fcf64836740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5590715680f0 0x5590715684d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:32:29.005 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:28.998+0000 7fcf64836740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559071568a10 0x559071574460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:32:29.005 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:28.999+0000 7fcf64836740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5590715749a0 0x559071576d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:32:29.005 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:28.999+0000 7fcf64836740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x5590714deea0 con 0x5590715680f0 2024-09-10T22:32:29.005 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:28.999+0000 7fcf64836740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x5590714ce2d0 con 0x559071568a10 2024-09-10T22:32:29.005 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:28.999+0000 7fcf64836740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x5590714d20e0 con 0x5590715749a0 2024-09-10T22:32:29.005 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:28.999+0000 7fcf5bfff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5590715680f0 0x5590715684d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:32:29.005 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:28.999+0000 7fcf5b7fe640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559071568a10 0x559071574460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:32:29.005 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:28.999+0000 7fcf5bfff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5590715680f0 0x5590715684d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:47298/0 (socket says 172.21.15.19:47298) 2024-09-10T22:32:29.005 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:28.999+0000 7fcf5bfff640 1 -- 172.21.15.19:0/1916503217 learned_addr learned my addr 172.21.15.19:0/1916503217 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:32:29.005 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:28.999+0000 7fcf609fe640 1 --2- 172.21.15.19:0/1916503217 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5590715749a0 0x559071576d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:32:29.005 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:28.999+0000 7fcf5b7fe640 1 -- 172.21.15.19:0/1916503217 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5590715749a0 msgr2=0x559071576d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:32:29.005 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:28.999+0000 7fcf5b7fe640 1 --2- 172.21.15.19:0/1916503217 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5590715749a0 0x559071576d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:32:29.006 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:28.999+0000 7fcf5b7fe640 1 -- 172.21.15.19:0/1916503217 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5590715680f0 msgr2=0x5590715684d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:32:29.006 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:28.999+0000 7fcf5b7fe640 1 --2- 172.21.15.19:0/1916503217 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5590715680f0 0x5590715684d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:32:29.006 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:28.999+0000 7fcf5b7fe640 1 -- 172.21.15.19:0/1916503217 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55907122c650 con 0x559071568a10 2024-09-10T22:32:29.006 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:28.999+0000 7fcf5b7fe640 1 --2- 172.21.15.19:0/1916503217 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559071568a10 0x559071574460 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fcf500ac2d0 tx=0x7fcf500abfe0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f7583567a2d777ea server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:32:29.006 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:29.000+0000 7fcf427fc640 1 -- 172.21.15.19:0/1916503217 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf500accd0 con 0x559071568a10 2024-09-10T22:32:29.006 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:29.000+0000 7fcf427fc640 1 -- 172.21.15.19:0/1916503217 <== mon.2 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fcf500ac5d0 con 0x559071568a10 2024-09-10T22:32:29.006 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:29.000+0000 7fcf427fc640 1 -- 172.21.15.19:0/1916503217 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf500b5930 con 0x559071568a10 2024-09-10T22:32:29.009 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:29.001+0000 7fcf64836740 1 -- 172.21.15.19:0/1916503217 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559071568a10 msgr2=0x559071574460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:32:29.009 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:29.001+0000 7fcf64836740 1 --2- 172.21.15.19:0/1916503217 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559071568a10 0x559071574460 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fcf500ac2d0 tx=0x7fcf500abfe0 comp rx=0 tx=0).stop 2024-09-10T22:32:29.009 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:29.001+0000 7fcf64836740 1 -- 172.21.15.19:0/1916503217 shutdown_connections 2024-09-10T22:32:29.010 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:29.001+0000 7fcf64836740 1 --2- 172.21.15.19:0/1916503217 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5590715749a0 0x559071576d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:32:29.010 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:29.001+0000 7fcf64836740 1 --2- 172.21.15.19:0/1916503217 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559071568a10 0x559071574460 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:32:29.010 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:29.001+0000 7fcf64836740 1 --2- 172.21.15.19:0/1916503217 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5590715680f0 0x5590715684d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:32:29.010 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:29.001+0000 7fcf64836740 1 -- 172.21.15.19:0/1916503217 >> 172.21.15.19:0/1916503217 conn(0x559071565f20 msgr2=0x5590715670c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:32:29.010 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:29.001+0000 7fcf64836740 1 -- 172.21.15.19:0/1916503217 shutdown_connections 2024-09-10T22:32:29.010 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:29.001+0000 7fcf64836740 1 -- 172.21.15.19:0/1916503217 wait complete. 2024-09-10T22:32:29.010 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:29.002+0000 7fcf64836740 1 -- start start 2024-09-10T22:32:29.010 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:29.002+0000 7fcf64836740 1 Processor -- start 2024-09-10T22:32:29.010 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:29.002+0000 7fcf64836740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5590715680f0 0x559071574370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:32:29.010 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:29.002+0000 7fcf64836740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559071568a10 0x5590715717c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:32:29.010 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:29.003+0000 7fcf64836740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5590715749a0 0x559071571eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:32:29.010 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:29.003+0000 7fcf64836740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x55907132f700 con 0x5590715749a0 2024-09-10T22:32:29.010 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:29.003+0000 7fcf64836740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x559071469160 con 0x559071568a10 2024-09-10T22:32:29.011 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:29.003+0000 7fcf64836740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x559071577620 con 0x5590715680f0 2024-09-10T22:32:29.011 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:29.003+0000 7fcf5bfff640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5590715680f0 0x559071574370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:32:29.011 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:29.003+0000 7fcf5bfff640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5590715680f0 0x559071574370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.19:43052/0 (socket says 172.21.15.19:43052) 2024-09-10T22:32:29.011 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:29.003+0000 7fcf5bfff640 1 -- 172.21.15.19:0/4179504607 learned_addr learned my addr 172.21.15.19:0/4179504607 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:32:29.011 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:29.003+0000 7fcf64836740 10 client.0 _ll_register_callbacks cb 0x5590714829e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T22:32:29.011 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:29.003+0000 7fcf5b7fe640 1 --2- 172.21.15.19:0/4179504607 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559071568a10 0x5590715717c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:32:29.011 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:29.003+0000 7fcf609fe640 1 --2- 172.21.15.19:0/4179504607 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5590715749a0 0x559071571eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:32:29.011 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:29.003+0000 7fcf5bfff640 1 -- 172.21.15.19:0/4179504607 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559071568a10 msgr2=0x5590715717c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:32:29.011 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:29.003+0000 7fcf5bfff640 1 --2- 172.21.15.19:0/4179504607 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559071568a10 0x5590715717c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:32:29.011 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:29.003+0000 7fcf5bfff640 1 -- 172.21.15.19:0/4179504607 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5590715749a0 msgr2=0x559071571eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:32:29.011 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:29.003+0000 7fcf5bfff640 1 --2- 172.21.15.19:0/4179504607 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5590715749a0 0x559071571eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:32:29.011 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:29.004+0000 7fcf5bfff640 1 -- 172.21.15.19:0/4179504607 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559071496c90 con 0x5590715680f0 2024-09-10T22:32:29.011 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:29.004+0000 7fcf5b7fe640 1 --2- 172.21.15.19:0/4179504607 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559071568a10 0x5590715717c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T22:32:29.012 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:29.004+0000 7fcf609fe640 1 --2- 172.21.15.19:0/4179504607 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5590715749a0 0x559071571eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T22:32:29.012 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:29.004+0000 7fcf5bfff640 1 --2- 172.21.15.19:0/4179504607 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5590715680f0 0x559071574370 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fcf4c011ca0 tx=0x7fcf4c004730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c3e84d3e80b0a902 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:32:29.012 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:29.004+0000 7fcf3b7fe640 10 client.0 ms_handle_connect on v2:172.21.15.138:3300/0 2024-09-10T22:32:29.012 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:29.004+0000 7fcf3b7fe640 1 -- 172.21.15.19:0/4179504607 <== mon.1 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf4c01bb10 con 0x5590715680f0 2024-09-10T22:32:29.012 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:29.004+0000 7fcf3b7fe640 1 -- 172.21.15.19:0/4179504607 <== mon.1 v2:172.21.15.138:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8327+0+0 (secure 0 0 0) 0x7fcf4c01bcb0 con 0x5590715680f0 2024-09-10T22:32:29.012 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:29.004+0000 7fcf64836740 1 -- 172.21.15.19:0/4179504607 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fcf500ac5d0 con 0x5590715680f0 2024-09-10T22:32:29.012 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:29.004+0000 7fcf3b7fe640 1 -- 172.21.15.19:0/4179504607 <== mon.1 v2:172.21.15.138:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fcf4c0343f0 con 0x5590715680f0 2024-09-10T22:32:29.012 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:29.004+0000 7fcf64836740 10 client.26014 fetch_fsmap learned FSMap version 27 2024-09-10T22:32:29.012 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:29.005+0000 7fcf64836740 1 -- 172.21.15.19:0/4179504607 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x559071583070 con 0x5590715680f0 2024-09-10T22:32:29.012 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:29.005+0000 7fcf3b7fe640 1 -- 172.21.15.19:0/4179504607 <== mon.1 v2:172.21.15.138:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fcf4c034a40 con 0x5590715680f0 2024-09-10T22:32:29.012 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:29.005+0000 7fcf3b7fe640 1 -- 172.21.15.19:0/4179504607 <== mon.1 v2:172.21.15.138:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7fcf4c029070 con 0x5590715680f0 2024-09-10T22:32:29.012 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:29.005+0000 7fcf64836740 10 client.26014 fetch_fsmap finished waiting for FSMap version 27 2024-09-10T22:32:29.013 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:29.005+0000 7fcf64836740 10 client.26014 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-10T22:32:29.013 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:29.005+0000 7fcf64836740 20 client.26014 populate_metadata read hostname 'smithi019' 2024-09-10T22:32:29.013 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:29.005+0000 7fcf64836740 1 --2- 172.21.15.19:0/4179504607 >> [v2:172.21.15.138:6838/383637208,v1:172.21.15.138:6839/383637208] conn(0x559071584580 0x559071586970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:32:29.013 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:29.005+0000 7fcf64836740 4 client.26014 mds_command: new command op to 24568 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T22:32:29.013 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:29.005+0000 7fcf64836740 1 -- 172.21.15.19:0/4179504607 --> [v2:172.21.15.138:6838/383637208,v1:172.21.15.138:6839/383637208] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7fcf500ac5d0 con 0x559071584580 2024-09-10T22:32:29.013 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:29.006+0000 7fcf5b7fe640 1 --2- 172.21.15.19:0/4179504607 >> [v2:172.21.15.138:6838/383637208,v1:172.21.15.138:6839/383637208] conn(0x559071584580 0x559071586970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:32:29.013 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:29.006+0000 7fcf5b7fe640 1 --2- 172.21.15.19:0/4179504607 >> [v2:172.21.15.138:6838/383637208,v1:172.21.15.138:6839/383637208] conn(0x559071584580 0x559071586970 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=4e34baee96e76b42 server_cookie=fc5e57c0ba30f5cb in_seq=0 out_seq=0 2024-09-10T22:32:29.013 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:29.006+0000 7fcf3b7fe640 10 client.26014 ms_handle_connect on v2:172.21.15.138:6838/383637208 2024-09-10T22:32:29.013 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:29.007+0000 7fcf3b7fe640 1 -- 172.21.15.19:0/4179504607 <== mds.1 v2:172.21.15.138:6838/383637208 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x7fcf500ac5d0 con 0x559071584580 2024-09-10T22:32:29.013 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:29.007+0000 7fcf3b7fe640 10 client.26014 handle_command_reply: tid=0 2024-09-10T22:32:29.013 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:29.007+0000 7fcf64836740 1 client.26014 shutdown 2024-09-10T22:32:29.013 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:29.007+0000 7fcf64836740 1 -- 172.21.15.19:0/4179504607 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5590715680f0 msgr2=0x559071574370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:32:29.013 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:29.007+0000 7fcf64836740 1 --2- 172.21.15.19:0/4179504607 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5590715680f0 0x559071574370 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fcf4c011ca0 tx=0x7fcf4c004730 comp rx=0 tx=0).stop 2024-09-10T22:32:29.014 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:29.007+0000 7fcf64836740 1 -- 172.21.15.19:0/4179504607 shutdown_connections 2024-09-10T22:32:29.014 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:29.007+0000 7fcf64836740 1 --2- 172.21.15.19:0/4179504607 >> [v2:172.21.15.138:6838/383637208,v1:172.21.15.138:6839/383637208] conn(0x559071584580 0x559071586970 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:32:29.014 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:29.007+0000 7fcf3b7fe640 0 client.26014 ms_handle_reset on v2:172.21.15.138:6838/383637208 2024-09-10T22:32:29.014 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:29.007+0000 7fcf64836740 1 --2- 172.21.15.19:0/4179504607 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5590715749a0 0x559071571eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:32:29.014 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:29.007+0000 7fcf64836740 1 --2- 172.21.15.19:0/4179504607 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559071568a10 0x5590715717c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:32:29.014 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:29.007+0000 7fcf64836740 1 --2- 172.21.15.19:0/4179504607 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5590715680f0 0x559071574370 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:32:29.014 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:29.007+0000 7fcf64836740 1 -- 172.21.15.19:0/4179504607 >> 172.21.15.19:0/4179504607 conn(0x559071565f20 msgr2=0x55907156bac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:32:29.014 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:29.007+0000 7fcf64836740 1 -- 172.21.15.19:0/4179504607 shutdown_connections 2024-09-10T22:32:29.014 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:29.007+0000 7fcf64836740 1 -- 172.21.15.19:0/4179504607 wait complete. 2024-09-10T22:32:29.014 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:29.007+0000 7fcf64836740 20 client.26014 trim_cache size 0 max 16384 2024-09-10T22:32:29.024 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:29.022+0000 7fcf64836740 1 Processor -- start 2024-09-10T22:32:29.024 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:29.022+0000 7fcf64836740 1 -- start start 2024-09-10T22:32:29.025 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:29.023+0000 7fcf64836740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5590715680f0 0x5590715808a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:32:29.025 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:29.023+0000 7fcf64836740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x559071568a10 0x559071570cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:32:29.025 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:29.023+0000 7fcf64836740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5590715749a0 0x559071566e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:32:29.026 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:29.023+0000 7fcf64836740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fcf5c1aedb0 con 0x559071568a10 2024-09-10T22:32:29.026 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:29.023+0000 7fcf64836740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fcf5c1ac680 con 0x5590715749a0 2024-09-10T22:32:29.026 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:29.023+0000 7fcf64836740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7fcf5c1aa4d0 con 0x5590715680f0 2024-09-10T22:32:29.026 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:29.023+0000 7fcf5b7fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x559071568a10 0x559071570cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:32:29.026 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:29.023+0000 7fcf5bfff640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5590715680f0 0x5590715808a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:32:29.026 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:29.023+0000 7fcf5bfff640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5590715680f0 0x5590715808a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.19:43054/0 (socket says 172.21.15.19:43054) 2024-09-10T22:32:29.026 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:29.023+0000 7fcf5b7fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x559071568a10 0x559071570cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:47316/0 (socket says 172.21.15.19:47316) 2024-09-10T22:32:29.026 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:29.023+0000 7fcf5bfff640 1 -- 172.21.15.19:0/4210541383 learned_addr learned my addr 172.21.15.19:0/4210541383 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:32:29.026 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:29.023+0000 7fcf609fe640 1 --2- 172.21.15.19:0/4210541383 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5590715749a0 0x559071566e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:32:29.026 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:29.023+0000 7fcf5b7fe640 1 -- 172.21.15.19:0/4210541383 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5590715680f0 msgr2=0x5590715808a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:32:29.026 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:29.023+0000 7fcf5b7fe640 1 --2- 172.21.15.19:0/4210541383 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5590715680f0 0x5590715808a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:32:29.026 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:29.023+0000 7fcf5b7fe640 1 -- 172.21.15.19:0/4210541383 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5590715749a0 msgr2=0x559071566e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:32:29.026 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:29.023+0000 7fcf5b7fe640 1 --2- 172.21.15.19:0/4210541383 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5590715749a0 0x559071566e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:32:29.027 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:29.023+0000 7fcf5b7fe640 1 -- 172.21.15.19:0/4210541383 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559071572220 con 0x559071568a10 2024-09-10T22:32:29.027 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:29.023+0000 7fcf5bfff640 1 --2- 172.21.15.19:0/4210541383 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5590715680f0 0x5590715808a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T22:32:29.027 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:29.024+0000 7fcf5b7fe640 1 --2- 172.21.15.19:0/4210541383 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x559071568a10 0x559071570cb0 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7fcf500ac510 tx=0x7fcf5000efb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2c1dcd290099f967 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:32:29.027 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:29.025+0000 7fcf41ffb640 1 -- 172.21.15.19:0/4210541383 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf500accd0 con 0x559071568a10 2024-09-10T22:32:29.027 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:29.025+0000 7fcf41ffb640 1 -- 172.21.15.19:0/4210541383 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fcf500b10b0 con 0x559071568a10 2024-09-10T22:32:29.027 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:29.025+0000 7fcf41ffb640 1 -- 172.21.15.19:0/4210541383 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf500a8180 con 0x559071568a10 2024-09-10T22:32:29.028 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:29.026+0000 7fcf64836740 1 -- 172.21.15.19:0/4210541383 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x559071568a10 msgr2=0x559071570cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:32:29.028 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:29.026+0000 7fcf64836740 1 --2- 172.21.15.19:0/4210541383 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x559071568a10 0x559071570cb0 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7fcf500ac510 tx=0x7fcf5000efb0 comp rx=0 tx=0).stop 2024-09-10T22:32:29.028 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:29.026+0000 7fcf64836740 1 -- 172.21.15.19:0/4210541383 shutdown_connections 2024-09-10T22:32:29.028 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:29.026+0000 7fcf64836740 1 --2- 172.21.15.19:0/4210541383 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5590715749a0 0x559071566e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:32:29.029 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:29.026+0000 7fcf64836740 1 --2- 172.21.15.19:0/4210541383 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x559071568a10 0x559071570cb0 unknown :-1 s=CLOSED pgs=658 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:32:29.029 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:29.026+0000 7fcf64836740 1 --2- 172.21.15.19:0/4210541383 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5590715680f0 0x5590715808a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:32:29.029 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:29.026+0000 7fcf64836740 1 -- 172.21.15.19:0/4210541383 >> 172.21.15.19:0/4210541383 conn(0x559071565f20 msgr2=0x559071570040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:32:29.029 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:29.026+0000 7fcf64836740 1 -- 172.21.15.19:0/4210541383 shutdown_connections 2024-09-10T22:32:29.029 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:29.026+0000 7fcf64836740 1 -- 172.21.15.19:0/4210541383 wait complete. 2024-09-10T22:32:29.029 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:29.027+0000 7fcf64836740 1 -- start start 2024-09-10T22:32:29.029 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:29.027+0000 7fcf64836740 1 Processor -- start 2024-09-10T22:32:29.034 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:29.027+0000 7fcf64836740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5590715680f0 0x55907157d250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:32:29.034 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:29.027+0000 7fcf64836740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559071568a10 0x55907158bfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:32:29.034 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:29.027+0000 7fcf64836740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5590715749a0 0x55907158c6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:32:29.034 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:29.027+0000 7fcf64836740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fcf5c1aab40 con 0x5590715680f0 2024-09-10T22:32:29.035 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:29.027+0000 7fcf64836740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fcf5c1abfb0 con 0x559071568a10 2024-09-10T22:32:29.035 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:29.027+0000 7fcf64836740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7fcf5c1ab210 con 0x5590715749a0 2024-09-10T22:32:29.035 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:29.027+0000 7fcf64836740 10 client.0 _ll_register_callbacks cb 0x7fcf4c009720 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T22:32:29.035 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:29.027+0000 7fcf5bfff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5590715680f0 0x55907157d250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:32:29.035 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:29.027+0000 7fcf5b7fe640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559071568a10 0x55907158bfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:32:29.035 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:29.027+0000 7fcf5bfff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5590715680f0 0x55907157d250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:47322/0 (socket says 172.21.15.19:47322) 2024-09-10T22:32:29.035 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:29.027+0000 7fcf5bfff640 1 -- 172.21.15.19:0/536810653 learned_addr learned my addr 172.21.15.19:0/536810653 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:32:29.035 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:29.027+0000 7fcf609fe640 1 --2- 172.21.15.19:0/536810653 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5590715749a0 0x55907158c6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:32:29.035 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:29.028+0000 7fcf5b7fe640 1 -- 172.21.15.19:0/536810653 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5590715749a0 msgr2=0x55907158c6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:32:29.035 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:29.028+0000 7fcf5b7fe640 1 --2- 172.21.15.19:0/536810653 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5590715749a0 0x55907158c6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:32:29.035 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:29.028+0000 7fcf5b7fe640 1 -- 172.21.15.19:0/536810653 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5590715680f0 msgr2=0x55907157d250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:32:29.035 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:29.028+0000 7fcf5b7fe640 1 --2- 172.21.15.19:0/536810653 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5590715680f0 0x55907157d250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:32:29.035 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:29.028+0000 7fcf5b7fe640 1 -- 172.21.15.19:0/536810653 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559071578cc0 con 0x559071568a10 2024-09-10T22:32:29.036 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:29.028+0000 7fcf5bfff640 1 --2- 172.21.15.19:0/536810653 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5590715680f0 0x55907157d250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T22:32:29.036 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:29.028+0000 7fcf5b7fe640 1 --2- 172.21.15.19:0/536810653 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559071568a10 0x55907158bfd0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fcf500ac560 tx=0x7fcf50009550 comp rx=0 tx=0).ready entity=mon.2 client_cookie=124d0046b1667c4d server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:32:29.036 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:29.028+0000 7fcf3b7fe640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-09-10T22:32:29.036 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:29.028+0000 7fcf3b7fe640 1 -- 172.21.15.19:0/536810653 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf500b5b60 con 0x559071568a10 2024-09-10T22:32:29.036 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:29.028+0000 7fcf3b7fe640 1 -- 172.21.15.19:0/536810653 <== mon.2 v2:172.21.15.135:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8327+0+0 (secure 0 0 0) 0x7fcf500ab830 con 0x559071568a10 2024-09-10T22:32:29.036 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:29.028+0000 7fcf64836740 1 -- 172.21.15.19:0/536810653 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fcf500b10b0 con 0x559071568a10 2024-09-10T22:32:29.036 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:29.028+0000 7fcf3b7fe640 1 -- 172.21.15.19:0/536810653 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fcf500ac5d0 con 0x559071568a10 2024-09-10T22:32:29.036 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:29.029+0000 7fcf64836740 10 client.25991 fetch_fsmap learned FSMap version 27 2024-09-10T22:32:29.036 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:29.029+0000 7fcf64836740 1 -- 172.21.15.19:0/536810653 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x5590715f1640 con 0x559071568a10 2024-09-10T22:32:29.036 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:29.029+0000 7fcf3b7fe640 1 -- 172.21.15.19:0/536810653 <== mon.2 v2:172.21.15.135:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fcf500accd0 con 0x559071568a10 2024-09-10T22:32:29.036 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:29.029+0000 7fcf3b7fe640 1 -- 172.21.15.19:0/536810653 <== mon.2 v2:172.21.15.135:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7fcf500d31e0 con 0x559071568a10 2024-09-10T22:32:29.036 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:29.029+0000 7fcf64836740 10 client.25991 fetch_fsmap finished waiting for FSMap version 27 2024-09-10T22:32:29.036 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:29.029+0000 7fcf64836740 10 client.25991 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-10T22:32:29.037 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:29.029+0000 7fcf64836740 20 client.25991 populate_metadata read hostname 'smithi019' 2024-09-10T22:32:29.037 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:29.029+0000 7fcf64836740 1 --2- 172.21.15.19:0/536810653 >> [v2:172.21.15.138:6838/383637208,v1:172.21.15.138:6839/383637208] conn(0x559071584580 0x5590715f36d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:32:29.037 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:29.029+0000 7fcf64836740 4 client.25991 mds_command: new command op to 24568 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-10T22:32:29.037 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:29.029+0000 7fcf64836740 1 -- 172.21.15.19:0/536810653 --> [v2:172.21.15.138:6838/383637208,v1:172.21.15.138:6839/383637208] -- command(tid 0: {"prefix": "damage ls"}) -- 0x7fcf500b10b0 con 0x559071584580 2024-09-10T22:32:29.037 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:29.029+0000 7fcf5bfff640 1 --2- 172.21.15.19:0/536810653 >> [v2:172.21.15.138:6838/383637208,v1:172.21.15.138:6839/383637208] conn(0x559071584580 0x5590715f36d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:32:29.037 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:29.030+0000 7fcf3b7fe640 10 client.25991 ms_handle_connect on v2:172.21.15.138:6838/383637208 2024-09-10T22:32:29.037 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:29.030+0000 7fcf5bfff640 1 --2- 172.21.15.19:0/536810653 >> [v2:172.21.15.138:6838/383637208,v1:172.21.15.138:6839/383637208] conn(0x559071584580 0x5590715f36d0 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=9a3c771d8670f0c7 server_cookie=bc882abf2d3f286f in_seq=0 out_seq=0 2024-09-10T22:32:29.037 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:29.030+0000 7fcf3b7fe640 1 -- 172.21.15.19:0/536810653 <== mds.1 v2:172.21.15.138:6838/383637208 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x7fcf500b10b0 con 0x559071584580 2024-09-10T22:32:29.037 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:29.030+0000 7fcf3b7fe640 10 client.25991 handle_command_reply: tid=0 2024-09-10T22:32:29.037 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:29.030+0000 7fcf64836740 1 client.25991 shutdown 2024-09-10T22:32:29.037 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:29.030+0000 7fcf64836740 1 -- 172.21.15.19:0/536810653 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559071568a10 msgr2=0x55907158bfd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:32:29.037 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:29.031+0000 7fcf64836740 1 --2- 172.21.15.19:0/536810653 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559071568a10 0x55907158bfd0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fcf500ac560 tx=0x7fcf50009550 comp rx=0 tx=0).stop 2024-09-10T22:32:29.037 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:29.031+0000 7fcf64836740 1 -- 172.21.15.19:0/536810653 shutdown_connections 2024-09-10T22:32:29.038 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:29.031+0000 7fcf64836740 1 --2- 172.21.15.19:0/536810653 >> [v2:172.21.15.138:6838/383637208,v1:172.21.15.138:6839/383637208] conn(0x559071584580 0x5590715f36d0 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:32:29.038 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:29.031+0000 7fcf64836740 1 --2- 172.21.15.19:0/536810653 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5590715749a0 0x55907158c6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:32:29.038 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:29.031+0000 7fcf64836740 1 --2- 172.21.15.19:0/536810653 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559071568a10 0x55907158bfd0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:32:29.038 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:29.031+0000 7fcf64836740 1 --2- 172.21.15.19:0/536810653 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5590715680f0 0x55907157d250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:32:29.038 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:29.031+0000 7fcf64836740 1 -- 172.21.15.19:0/536810653 >> 172.21.15.19:0/536810653 conn(0x559071565f20 msgr2=0x559071566e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:32:29.038 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:29.031+0000 7fcf3b7fe640 0 client.25991 ms_handle_reset on v2:172.21.15.138:6838/383637208 2024-09-10T22:32:29.038 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:29.031+0000 7fcf64836740 1 -- 172.21.15.19:0/536810653 shutdown_connections 2024-09-10T22:32:29.038 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:29.031+0000 7fcf64836740 1 -- 172.21.15.19:0/536810653 wait complete. 2024-09-10T22:32:29.038 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:29.031+0000 7fcf64836740 20 client.25991 trim_cache size 0 max 16384 2024-09-10T22:32:29.038 INFO:teuthology.orchestra.run.smithi019.stdout:[] 2024-09-10T22:32:29.039 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:29.032+0000 7fcf62461640 1 -- 172.21.15.19:0/2595249718 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7fcf440b52e0 msgr2=0x7fcf440b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:32:29.039 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:29.032+0000 7fcf62461640 1 --2- 172.21.15.19:0/2595249718 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7fcf440b52e0 0x7fcf440b77a0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7fcf4c009c90 tx=0x7fcf4c005f90 comp rx=0 tx=0).stop 2024-09-10T22:32:29.040 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:29.032+0000 7fcf62461640 1 -- 172.21.15.19:0/2595249718 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcf5c104600 msgr2=0x7fcf5c199870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:32:29.040 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:29.032+0000 7fcf62461640 1 --2- 172.21.15.19:0/2595249718 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcf5c104600 0x7fcf5c199870 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fcf5000e9c0 tx=0x7fcf5000ee80 comp rx=0 tx=0).stop 2024-09-10T22:32:29.040 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:29.032+0000 7fcf62461640 1 -- 172.21.15.19:0/2595249718 shutdown_connections 2024-09-10T22:32:29.040 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:29.032+0000 7fcf62461640 1 --2- 172.21.15.19:0/2595249718 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7fcf440b52e0 0x7fcf440b77a0 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:32:29.040 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:29.032+0000 7fcf62461640 1 --2- 172.21.15.19:0/2595249718 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fcf5c10d140 0x7fcf5c19ec10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:32:29.040 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:29.032+0000 7fcf62461640 1 --2- 172.21.15.19:0/2595249718 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcf5c104600 0x7fcf5c199870 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:32:29.040 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:29.032+0000 7fcf62461640 1 --2- 172.21.15.19:0/2595249718 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fcf5c103ce0 0x7fcf5c199330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:32:29.040 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:29.032+0000 7fcf62461640 1 -- 172.21.15.19:0/2595249718 >> 172.21.15.19:0/2595249718 conn(0x7fcf5c0fd740 msgr2=0x7fcf5c0fe3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:32:29.040 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:29.032+0000 7fcf62461640 1 -- 172.21.15.19:0/2595249718 shutdown_connections 2024-09-10T22:32:29.040 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:29.032+0000 7fcf62461640 1 -- 172.21.15.19:0/2595249718 wait complete. 2024-09-10T22:32:29.998 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 22997a4c-6fc2-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-10T22:32:30.208 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:32:30 smithi019 ceph-mon[31375]: pgmap v529: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 616 KiB/s rd, 300 MiB/s wr, 166 op/s 2024-09-10T22:32:30.293 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/22997a4c-6fc2-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T22:32:30.573 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:30.570+0000 7ff74cff9640 1 -- 172.21.15.19:0/1769470878 <== mds.0 v2:172.21.15.135:6838/1254769802 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x56195d7330f0 con 0x56195d845e00 2024-09-10T22:32:30.573 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:30.570+0000 7ff74cff9640 10 client.25963 handle_command_reply: tid=0 2024-09-10T22:32:30.573 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:30.570+0000 7ff76e052740 1 client.25963 shutdown 2024-09-10T22:32:30.573 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:30.570+0000 7ff76e052740 1 -- 172.21.15.19:0/1769470878 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x56195d7c3860 msgr2=0x56195d7d4a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:32:30.574 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:30.570+0000 7ff76e052740 1 --2- 172.21.15.19:0/1769470878 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x56195d7c3860 0x56195d7d4a50 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x56195d7db4a0 tx=0x7ff760009310 comp rx=0 tx=0).stop 2024-09-10T22:32:30.574 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:30.571+0000 7ff76e052740 1 -- 172.21.15.19:0/1769470878 shutdown_connections 2024-09-10T22:32:30.574 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:30.571+0000 7ff76e052740 1 --2- 172.21.15.19:0/1769470878 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56195d7c8bd0 0x56195d7d3c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:32:30.574 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:30.571+0000 7ff76e052740 1 --2- 172.21.15.19:0/1769470878 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56195d7c6190 0x56195d7d3750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:32:30.574 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:30.571+0000 7ff76e052740 1 --2- 172.21.15.19:0/1769470878 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x56195d845e00 0x56195d848220 crc :-1 s=READY pgs=131 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:32:30.574 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:30.571+0000 7ff76e052740 1 --2- 172.21.15.19:0/1769470878 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x56195d7c3860 0x56195d7d4a50 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:32:30.574 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:30.571+0000 7ff74cff9640 0 client.25963 ms_handle_reset on v2:172.21.15.135:6838/1254769802 2024-09-10T22:32:30.574 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:30.571+0000 7ff76e052740 1 -- 172.21.15.19:0/1769470878 >> 172.21.15.19:0/1769470878 conn(0x56195d7be9b0 msgr2=0x56195d7c29f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:32:30.575 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:30.571+0000 7ff76e052740 1 -- 172.21.15.19:0/1769470878 shutdown_connections 2024-09-10T22:32:30.575 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:30.571+0000 7ff76e052740 1 -- 172.21.15.19:0/1769470878 wait complete. 2024-09-10T22:32:30.575 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:30.571+0000 7ff76e052740 20 client.25963 trim_cache size 0 max 16384 2024-09-10T22:32:30.575 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stdout:{ 2024-09-10T22:32:30.575 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stdout: "message": "", 2024-09-10T22:32:30.575 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stdout: "return_code": 0 2024-09-10T22:32:30.575 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stdout:} 2024-09-10T22:32:30.576 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:30.572+0000 7ff76b27f640 1 -- 172.21.15.19:0/1019252257 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7ff7500b5360 msgr2=0x7ff7500b7820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:32:30.576 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:30.572+0000 7ff76b27f640 1 --2- 172.21.15.19:0/1019252257 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7ff7500b5360 0x7ff7500b7820 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7ff754005ab0 tx=0x7ff754005a20 comp rx=0 tx=0).stop 2024-09-10T22:32:30.577 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:30.572+0000 7ff76b27f640 1 -- 172.21.15.19:0/1019252257 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff764103380 msgr2=0x7ff76419a080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:32:30.577 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:30.572+0000 7ff76b27f640 1 --2- 172.21.15.19:0/1019252257 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff764103380 0x7ff76419a080 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7ff75c00efd0 tx=0x7ff75c00c6a0 comp rx=0 tx=0).stop 2024-09-10T22:32:30.577 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:30.572+0000 7ff76b27f640 1 -- 172.21.15.19:0/1019252257 shutdown_connections 2024-09-10T22:32:30.577 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:30.572+0000 7ff76b27f640 1 --2- 172.21.15.19:0/1019252257 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7ff7500b5360 0x7ff7500b7820 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:32:30.577 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:30.572+0000 7ff76b27f640 1 --2- 172.21.15.19:0/1019252257 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff764103380 0x7ff76419a080 unknown :-1 s=CLOSED pgs=647 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:32:30.577 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:30.572+0000 7ff76b27f640 1 --2- 172.21.15.19:0/1019252257 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff7641029c0 0x7ff764199450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:32:30.577 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:30.572+0000 7ff76b27f640 1 --2- 172.21.15.19:0/1019252257 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff764101870 0x7ff764198e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:32:30.577 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:30.572+0000 7ff76b27f640 1 -- 172.21.15.19:0/1019252257 >> 172.21.15.19:0/1019252257 conn(0x7ff7640fd130 msgr2=0x7ff7640febb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:32:30.577 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:30.572+0000 7ff76b27f640 1 -- 172.21.15.19:0/1019252257 shutdown_connections 2024-09-10T22:32:30.577 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:30.572+0000 7ff76b27f640 1 -- 172.21.15.19:0/1019252257 wait complete. 2024-09-10T22:32:30.610 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:32:30 smithi135 ceph-mon[34789]: pgmap v529: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 616 KiB/s rd, 300 MiB/s wr, 166 op/s 2024-09-10T22:32:30.625 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:32:30 smithi138 ceph-mon[35236]: pgmap v529: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 616 KiB/s rd, 300 MiB/s wr, 166 op/s 2024-09-10T22:32:31.099 INFO:teuthology.orchestra.run.smithi019.stdout:[] 2024-09-10T22:32:31.100 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:30.879+0000 7efd063fa640 1 -- 172.21.15.19:0/2467627239 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7efd0010f3d0 msgr2=0x7efd001117c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:32:31.100 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:30.879+0000 7efd063fa640 1 --2- 172.21.15.19:0/2467627239 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7efd0010f3d0 0x7efd001117c0 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7efcf8009ca0 tx=0x7efcf802a8c0 comp rx=0 tx=0).stop 2024-09-10T22:32:31.100 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:30.879+0000 7efd063fa640 1 -- 172.21.15.19:0/2467627239 shutdown_connections 2024-09-10T22:32:31.100 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:30.879+0000 7efd063fa640 1 --2- 172.21.15.19:0/2467627239 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7efd0010f3d0 0x7efd001117c0 unknown :-1 s=CLOSED pgs=659 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:32:31.101 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:30.879+0000 7efd063fa640 1 --2- 172.21.15.19:0/2467627239 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7efd00075de0 0x7efd0010ee90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:32:31.101 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:30.879+0000 7efd063fa640 1 --2- 172.21.15.19:0/2467627239 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efd000754c0 0x7efd000758a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:32:31.101 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:30.879+0000 7efd063fa640 1 -- 172.21.15.19:0/2467627239 >> 172.21.15.19:0/2467627239 conn(0x7efd000fe870 msgr2=0x7efd00100c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:32:31.101 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:30.880+0000 7efd063fa640 1 -- 172.21.15.19:0/2467627239 shutdown_connections 2024-09-10T22:32:31.101 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:30.880+0000 7efd063fa640 1 -- 172.21.15.19:0/2467627239 wait complete. 2024-09-10T22:32:31.101 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:30.880+0000 7efd063fa640 1 Processor -- start 2024-09-10T22:32:31.101 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:30.880+0000 7efd063fa640 1 -- start start 2024-09-10T22:32:31.101 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:30.880+0000 7efd063fa640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7efd000754c0 0x7efd0019b4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:32:31.101 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:30.880+0000 7efd063fa640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efd00075de0 0x7efd0019b9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:32:31.101 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:30.880+0000 7efd063fa640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7efd0010f3d0 0x7efd001a0d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:32:31.101 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:30.880+0000 7efd063fa640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7efd00114fd0 con 0x7efd000754c0 2024-09-10T22:32:31.101 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:30.881+0000 7efd063fa640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7efd00114e50 con 0x7efd00075de0 2024-09-10T22:32:31.101 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:30.881+0000 7efd063fa640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7efd00115150 con 0x7efd0010f3d0 2024-09-10T22:32:31.102 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:30.881+0000 7efcfffff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7efd000754c0 0x7efd0019b4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:32:31.102 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:30.881+0000 7efcf7fff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efd00075de0 0x7efd0019b9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:32:31.102 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:30.881+0000 7efcf7fff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efd00075de0 0x7efd0019b9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.19:57620/0 (socket says 172.21.15.19:57620) 2024-09-10T22:32:31.102 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:30.881+0000 7efcf7fff640 1 -- 172.21.15.19:0/3634826548 learned_addr learned my addr 172.21.15.19:0/3634826548 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:32:31.102 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:30.881+0000 7efd04997640 1 --2- 172.21.15.19:0/3634826548 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7efd0010f3d0 0x7efd001a0d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:32:31.102 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:30.881+0000 7efcf7fff640 1 -- 172.21.15.19:0/3634826548 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7efd0010f3d0 msgr2=0x7efd001a0d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:32:31.102 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:30.881+0000 7efcf7fff640 1 --2- 172.21.15.19:0/3634826548 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7efd0010f3d0 0x7efd001a0d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:32:31.102 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:30.881+0000 7efcf7fff640 1 -- 172.21.15.19:0/3634826548 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7efd000754c0 msgr2=0x7efd0019b4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:32:31.102 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:30.881+0000 7efcf7fff640 1 --2- 172.21.15.19:0/3634826548 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7efd000754c0 0x7efd0019b4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:32:31.102 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:30.881+0000 7efcf7fff640 1 -- 172.21.15.19:0/3634826548 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efd001a1550 con 0x7efd00075de0 2024-09-10T22:32:31.102 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:30.881+0000 7efd04997640 1 --2- 172.21.15.19:0/3634826548 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7efd0010f3d0 0x7efd001a0d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T22:32:31.103 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:30.881+0000 7efcf7fff640 1 --2- 172.21.15.19:0/3634826548 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efd00075de0 0x7efd0019b9e0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7efce800e9f0 tx=0x7efce800eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:32:31.103 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:30.882+0000 7efcfdffb640 1 -- 172.21.15.19:0/3634826548 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efce800cd80 con 0x7efd00075de0 2024-09-10T22:32:31.103 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:30.882+0000 7efd063fa640 1 -- 172.21.15.19:0/3634826548 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efd001a1840 con 0x7efd00075de0 2024-09-10T22:32:31.103 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:30.882+0000 7efd063fa640 1 -- 172.21.15.19:0/3634826548 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efd001a7f00 con 0x7efd00075de0 2024-09-10T22:32:31.103 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:30.882+0000 7efcfdffb640 1 -- 172.21.15.19:0/3634826548 <== mon.2 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7efce80108e0 con 0x7efd00075de0 2024-09-10T22:32:31.103 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:30.882+0000 7efcfdffb640 1 -- 172.21.15.19:0/3634826548 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efce8018980 con 0x7efd00075de0 2024-09-10T22:32:31.103 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:30.885+0000 7efd087cf740 1 Processor -- start 2024-09-10T22:32:31.103 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:30.885+0000 7efd087cf740 1 -- start start 2024-09-10T22:32:31.103 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:30.885+0000 7efcfdffb640 1 -- 172.21.15.19:0/3634826548 <== mon.2 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 18) ==== 153250+0+0 (secure 0 0 0) 0x7efce8018b20 con 0x7efd00075de0 2024-09-10T22:32:31.103 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:30.885+0000 7efd087cf740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x560d3dbb84d0 0x560d3dbb88b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:32:31.104 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:30.885+0000 7efd087cf740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x560d3dbb8df0 0x560d3dbc4840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:32:31.104 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:30.885+0000 7efd087cf740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560d3dbc4d80 0x560d3dbc7170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:32:31.104 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:30.886+0000 7efd087cf740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x560d3db2eea0 con 0x560d3dbb8df0 2024-09-10T22:32:31.104 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:30.886+0000 7efd087cf740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x560d3db1e2d0 con 0x560d3dbc4d80 2024-09-10T22:32:31.104 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:30.886+0000 7efd087cf740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x560d3db220e0 con 0x560d3dbb84d0 2024-09-10T22:32:31.104 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:30.886+0000 7efcfffff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x560d3dbb8df0 0x560d3dbc4840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:32:31.104 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:30.886+0000 7efcfffff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x560d3dbb8df0 0x560d3dbc4840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:47348/0 (socket says 172.21.15.19:47348) 2024-09-10T22:32:31.104 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:30.886+0000 7efd04997640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x560d3dbb84d0 0x560d3dbb88b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:32:31.104 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:30.886+0000 7efcfffff640 1 -- 172.21.15.19:0/2373404091 learned_addr learned my addr 172.21.15.19:0/2373404091 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:32:31.104 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:30.886+0000 7efcf7fff640 1 --2- 172.21.15.19:0/2373404091 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560d3dbc4d80 0x560d3dbc7170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:32:31.104 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:30.886+0000 7efcfffff640 1 -- 172.21.15.19:0/2373404091 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x560d3dbb84d0 msgr2=0x560d3dbb88b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:32:31.104 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:30.886+0000 7efcfffff640 1 --2- 172.21.15.19:0/2373404091 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x560d3dbb84d0 0x560d3dbb88b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:32:31.105 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:30.886+0000 7efcfffff640 1 -- 172.21.15.19:0/2373404091 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560d3dbc4d80 msgr2=0x560d3dbc7170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:32:31.105 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:30.886+0000 7efcfffff640 1 --2- 172.21.15.19:0/2373404091 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560d3dbc4d80 0x560d3dbc7170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:32:31.105 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:30.886+0000 7efcfffff640 1 -- 172.21.15.19:0/2373404091 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560d3d87c650 con 0x560d3dbb8df0 2024-09-10T22:32:31.105 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:30.886+0000 7efd04997640 1 --2- 172.21.15.19:0/2373404091 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x560d3dbb84d0 0x560d3dbb88b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T22:32:31.105 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:30.886+0000 7efcfffff640 1 --2- 172.21.15.19:0/2373404091 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x560d3dbb8df0 0x560d3dbc4840 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7efcf0009cf0 tx=0x7efcf0011810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=75b8d1cf9acea95 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:32:31.105 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:30.886+0000 7efcf67fc640 1 -- 172.21.15.19:0/2373404091 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efcf001e070 con 0x560d3dbb8df0 2024-09-10T22:32:31.105 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:30.887+0000 7efcf67fc640 1 -- 172.21.15.19:0/2373404091 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7efcf0019ae0 con 0x560d3dbb8df0 2024-09-10T22:32:31.105 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:30.887+0000 7efcf67fc640 1 -- 172.21.15.19:0/2373404091 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efcf000e9e0 con 0x560d3dbb8df0 2024-09-10T22:32:31.105 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:30.887+0000 7efcfdffb640 1 --2- 172.21.15.19:0/3634826548 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7efcec0b5360 0x7efcec0b7820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:32:31.105 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:30.887+0000 7efd04997640 1 --2- 172.21.15.19:0/3634826548 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7efcec0b5360 0x7efcec0b7820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:32:31.105 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:30.887+0000 7efcfdffb640 1 -- 172.21.15.19:0/3634826548 <== mon.2 v2:172.21.15.135:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8327+0+0 (secure 0 0 0) 0x7efce80e5e30 con 0x7efd00075de0 2024-09-10T22:32:31.105 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:30.887+0000 7efd087cf740 1 -- 172.21.15.19:0/2373404091 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x560d3dbb8df0 msgr2=0x560d3dbc4840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:32:31.105 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:30.887+0000 7efd04997640 1 --2- 172.21.15.19:0/3634826548 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7efcec0b5360 0x7efcec0b7820 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7efcf8006010 tx=0x7efcf8004a40 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:32:31.106 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:30.887+0000 7efd087cf740 1 --2- 172.21.15.19:0/2373404091 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x560d3dbb8df0 0x560d3dbc4840 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7efcf0009cf0 tx=0x7efcf0011810 comp rx=0 tx=0).stop 2024-09-10T22:32:31.106 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:30.888+0000 7efd087cf740 1 -- 172.21.15.19:0/2373404091 shutdown_connections 2024-09-10T22:32:31.106 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:30.888+0000 7efd087cf740 1 --2- 172.21.15.19:0/2373404091 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560d3dbc4d80 0x560d3dbc7170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:32:31.106 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:30.888+0000 7efd087cf740 1 --2- 172.21.15.19:0/2373404091 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x560d3dbb8df0 0x560d3dbc4840 unknown :-1 s=CLOSED pgs=660 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:32:31.106 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:30.888+0000 7efd087cf740 1 --2- 172.21.15.19:0/2373404091 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x560d3dbb84d0 0x560d3dbb88b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:32:31.106 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:30.888+0000 7efd087cf740 1 -- 172.21.15.19:0/2373404091 >> 172.21.15.19:0/2373404091 conn(0x560d3dbb6300 msgr2=0x560d3dbb74a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:32:31.106 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:30.888+0000 7efd087cf740 1 -- 172.21.15.19:0/2373404091 shutdown_connections 2024-09-10T22:32:31.106 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:30.888+0000 7efd087cf740 1 -- 172.21.15.19:0/2373404091 wait complete. 2024-09-10T22:32:31.106 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:30.888+0000 7efd087cf740 1 -- start start 2024-09-10T22:32:31.106 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:30.888+0000 7efd087cf740 1 Processor -- start 2024-09-10T22:32:31.106 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:30.888+0000 7efd087cf740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x560d3dbb84d0 0x560d3dbc4600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:32:31.106 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:30.888+0000 7efd087cf740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x560d3dbb8df0 0x560d3dbc1a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:32:31.106 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:30.888+0000 7efd087cf740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560d3dbc4d80 0x560d3dbc1ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:32:31.107 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:30.889+0000 7efd087cf740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x560d3d97f700 con 0x560d3dbb8df0 2024-09-10T22:32:31.107 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:30.889+0000 7efd087cf740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x560d3dab9160 con 0x560d3dbc4d80 2024-09-10T22:32:31.107 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:30.889+0000 7efd087cf740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x560d3dbc7a00 con 0x560d3dbb84d0 2024-09-10T22:32:31.107 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:30.889+0000 7efd087cf740 10 client.0 _ll_register_callbacks cb 0x560d3dad29e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T22:32:31.107 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:30.889+0000 7efd04997640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560d3dbc4d80 0x560d3dbc1ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:32:31.107 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:30.889+0000 7efcf7fff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x560d3dbb8df0 0x560d3dbc1a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:32:31.107 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:30.889+0000 7efcfffff640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x560d3dbb84d0 0x560d3dbc4600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:32:31.107 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:30.889+0000 7efd04997640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560d3dbc4d80 0x560d3dbc1ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.19:57636/0 (socket says 172.21.15.19:57636) 2024-09-10T22:32:31.107 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:30.889+0000 7efd04997640 1 -- 172.21.15.19:0/2841146090 learned_addr learned my addr 172.21.15.19:0/2841146090 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:32:31.107 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:30.889+0000 7efd04997640 1 -- 172.21.15.19:0/2841146090 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x560d3dbb84d0 msgr2=0x560d3dbc4600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:32:31.107 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:30.889+0000 7efd04997640 1 --2- 172.21.15.19:0/2841146090 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x560d3dbb84d0 0x560d3dbc4600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:32:31.107 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:30.889+0000 7efd04997640 1 -- 172.21.15.19:0/2841146090 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x560d3dbb8df0 msgr2=0x560d3dbc1a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:32:31.107 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:30.889+0000 7efd04997640 1 --2- 172.21.15.19:0/2841146090 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x560d3dbb8df0 0x560d3dbc1a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:32:31.108 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:30.889+0000 7efd04997640 1 -- 172.21.15.19:0/2841146090 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560d3dae6c90 con 0x560d3dbc4d80 2024-09-10T22:32:31.108 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:30.889+0000 7efd04997640 1 --2- 172.21.15.19:0/2841146090 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560d3dbc4d80 0x560d3dbc1ff0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7efcf8004af0 tx=0x7efcf802a8c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=34acaad595555b8b server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:32:31.108 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:30.889+0000 7efcdf7fe640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-09-10T22:32:31.108 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:30.889+0000 7efcdf7fe640 1 -- 172.21.15.19:0/2841146090 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efcf802f610 con 0x560d3dbc4d80 2024-09-10T22:32:31.108 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:30.890+0000 7efcdf7fe640 1 -- 172.21.15.19:0/2841146090 <== mon.2 v2:172.21.15.135:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8327+0+0 (secure 0 0 0) 0x7efcf802f7b0 con 0x560d3dbc4d80 2024-09-10T22:32:31.108 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:30.890+0000 7efd087cf740 1 -- 172.21.15.19:0/2841146090 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7efcf0019ae0 con 0x560d3dbc4d80 2024-09-10T22:32:31.108 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:30.890+0000 7efcdf7fe640 1 -- 172.21.15.19:0/2841146090 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7efcf802f9b0 con 0x560d3dbc4d80 2024-09-10T22:32:31.108 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:30.890+0000 7efd087cf740 10 client.26003 fetch_fsmap learned FSMap version 27 2024-09-10T22:32:31.108 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:30.890+0000 7efd087cf740 1 -- 172.21.15.19:0/2841146090 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x560d3dbd3360 con 0x560d3dbc4d80 2024-09-10T22:32:31.108 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:30.890+0000 7efcdf7fe640 1 -- 172.21.15.19:0/2841146090 <== mon.2 v2:172.21.15.135:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7efcf0019ae0 con 0x560d3dbc4d80 2024-09-10T22:32:31.108 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:30.890+0000 7efcdf7fe640 1 -- 172.21.15.19:0/2841146090 <== mon.2 v2:172.21.15.135:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7efcf805b020 con 0x560d3dbc4d80 2024-09-10T22:32:31.108 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:30.890+0000 7efd087cf740 10 client.26003 fetch_fsmap finished waiting for FSMap version 27 2024-09-10T22:32:31.108 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:30.890+0000 7efd087cf740 10 client.26003 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-10T22:32:31.108 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:30.890+0000 7efd087cf740 20 client.26003 populate_metadata read hostname 'smithi019' 2024-09-10T22:32:31.109 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:30.890+0000 7efd087cf740 1 --2- 172.21.15.19:0/2841146090 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x560d3dbd4810 0x560d3dbd6c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:32:31.109 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:30.890+0000 7efd087cf740 4 client.26003 mds_command: new command op to 24581 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T22:32:31.109 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:30.890+0000 7efd087cf740 1 -- 172.21.15.19:0/2841146090 --> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x560d3db30df0 con 0x560d3dbd4810 2024-09-10T22:32:31.109 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:30.890+0000 7efcfffff640 1 --2- 172.21.15.19:0/2841146090 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x560d3dbd4810 0x560d3dbd6c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:32:31.109 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:30.891+0000 7efcdf7fe640 10 client.26003 ms_handle_connect on v2:172.21.15.135:6838/1254769802 2024-09-10T22:32:31.109 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:30.891+0000 7efcfffff640 1 --2- 172.21.15.19:0/2841146090 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x560d3dbd4810 0x560d3dbd6c40 crc :-1 s=READY pgs=134 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1f951db66f4f5c4d server_cookie=17db347c113ac59 in_seq=0 out_seq=0 2024-09-10T22:32:31.109 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:30.891+0000 7efcdf7fe640 1 -- 172.21.15.19:0/2841146090 <== mds.0 v2:172.21.15.135:6838/1254769802 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x560d3db30df0 con 0x560d3dbd4810 2024-09-10T22:32:31.109 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:30.891+0000 7efcdf7fe640 10 client.26003 handle_command_reply: tid=0 2024-09-10T22:32:31.109 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:30.891+0000 7efd087cf740 1 client.26003 shutdown 2024-09-10T22:32:31.109 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:30.892+0000 7efd087cf740 1 -- 172.21.15.19:0/2841146090 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560d3dbc4d80 msgr2=0x560d3dbc1ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:32:31.109 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:30.892+0000 7efd087cf740 1 --2- 172.21.15.19:0/2841146090 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560d3dbc4d80 0x560d3dbc1ff0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7efcf8004af0 tx=0x7efcf802a8c0 comp rx=0 tx=0).stop 2024-09-10T22:32:31.109 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:30.892+0000 7efd087cf740 1 -- 172.21.15.19:0/2841146090 shutdown_connections 2024-09-10T22:32:31.109 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:30.892+0000 7efd087cf740 1 --2- 172.21.15.19:0/2841146090 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560d3dbc4d80 0x560d3dbc1ff0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:32:31.110 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:30.892+0000 7efd087cf740 1 --2- 172.21.15.19:0/2841146090 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x560d3dbb8df0 0x560d3dbc1a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:32:31.110 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:30.892+0000 7efd087cf740 1 --2- 172.21.15.19:0/2841146090 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x560d3dbd4810 0x560d3dbd6c40 crc :-1 s=READY pgs=134 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:32:31.110 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:30.892+0000 7efd087cf740 1 --2- 172.21.15.19:0/2841146090 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x560d3dbb84d0 0x560d3dbc4600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:32:31.110 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:30.892+0000 7efd087cf740 1 -- 172.21.15.19:0/2841146090 >> 172.21.15.19:0/2841146090 conn(0x560d3dbb6300 msgr2=0x560d3dbbbe70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:32:31.110 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:30.892+0000 7efcdf7fe640 0 client.26003 ms_handle_reset on v2:172.21.15.135:6838/1254769802 2024-09-10T22:32:31.110 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:30.892+0000 7efd087cf740 1 -- 172.21.15.19:0/2841146090 shutdown_connections 2024-09-10T22:32:31.110 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:30.892+0000 7efd087cf740 1 -- 172.21.15.19:0/2841146090 wait complete. 2024-09-10T22:32:31.110 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:30.892+0000 7efd087cf740 20 client.26003 trim_cache size 0 max 16384 2024-09-10T22:32:31.110 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:30.906+0000 7efd087cf740 1 Processor -- start 2024-09-10T22:32:31.110 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:30.906+0000 7efd087cf740 1 -- start start 2024-09-10T22:32:31.110 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:30.906+0000 7efd087cf740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x560d3dbb84d0 0x560d3dbbec60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:32:31.110 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:30.906+0000 7efd087cf740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560d3dbb8df0 0x560d3dbbf1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:32:31.110 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:30.906+0000 7efd087cf740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x560d3dbc4d80 0x560d3dbb4c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:32:31.111 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:30.906+0000 7efd087cf740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7efce0010fa0 con 0x560d3dbb84d0 2024-09-10T22:32:31.111 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:30.906+0000 7efd087cf740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7efce000e870 con 0x560d3dbb8df0 2024-09-10T22:32:31.111 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:30.906+0000 7efd087cf740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7efce000c6c0 con 0x560d3dbc4d80 2024-09-10T22:32:31.111 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:30.906+0000 7efcfffff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x560d3dbb84d0 0x560d3dbbec60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:32:31.111 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:30.906+0000 7efcfffff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x560d3dbb84d0 0x560d3dbbec60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:47370/0 (socket says 172.21.15.19:47370) 2024-09-10T22:32:31.111 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:30.906+0000 7efcfffff640 1 -- 172.21.15.19:0/866572017 learned_addr learned my addr 172.21.15.19:0/866572017 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:32:31.111 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:30.906+0000 7efcf7fff640 1 --2- 172.21.15.19:0/866572017 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560d3dbb8df0 0x560d3dbbf1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:32:31.111 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:30.906+0000 7efcfffff640 1 -- 172.21.15.19:0/866572017 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x560d3dbc4d80 msgr2=0x560d3dbb4c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:32:31.111 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:30.906+0000 7efd04997640 1 --2- 172.21.15.19:0/866572017 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x560d3dbc4d80 0x560d3dbb4c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:32:31.111 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:30.906+0000 7efcfffff640 1 --2- 172.21.15.19:0/866572017 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x560d3dbc4d80 0x560d3dbb4c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:32:31.111 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:30.906+0000 7efcfffff640 1 -- 172.21.15.19:0/866572017 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560d3dbb8df0 msgr2=0x560d3dbbf1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:32:31.111 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:30.906+0000 7efcfffff640 1 --2- 172.21.15.19:0/866572017 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560d3dbb8df0 0x560d3dbbf1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:32:31.111 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:30.906+0000 7efcfffff640 1 -- 172.21.15.19:0/866572017 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560d3dbb6fe0 con 0x560d3dbb84d0 2024-09-10T22:32:31.111 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:30.907+0000 7efcfffff640 1 --2- 172.21.15.19:0/866572017 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x560d3dbb84d0 0x560d3dbbec60 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7efcf0009c40 tx=0x7efcf0009ea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cc11e5c2a5c25389 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:32:31.112 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:30.907+0000 7efcf5ffb640 1 -- 172.21.15.19:0/866572017 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efcf00052b0 con 0x560d3dbb84d0 2024-09-10T22:32:31.112 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:30.907+0000 7efcf5ffb640 1 -- 172.21.15.19:0/866572017 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7efcf002f040 con 0x560d3dbb84d0 2024-09-10T22:32:31.112 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:30.907+0000 7efcf5ffb640 1 -- 172.21.15.19:0/866572017 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efcf000e590 con 0x560d3dbb84d0 2024-09-10T22:32:31.112 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:30.908+0000 7efd087cf740 1 -- 172.21.15.19:0/866572017 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x560d3dbb84d0 msgr2=0x560d3dbbec60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:32:31.112 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:30.908+0000 7efd087cf740 1 --2- 172.21.15.19:0/866572017 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x560d3dbb84d0 0x560d3dbbec60 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7efcf0009c40 tx=0x7efcf0009ea0 comp rx=0 tx=0).stop 2024-09-10T22:32:31.112 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:30.908+0000 7efd087cf740 1 -- 172.21.15.19:0/866572017 shutdown_connections 2024-09-10T22:32:31.112 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:30.908+0000 7efd087cf740 1 --2- 172.21.15.19:0/866572017 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x560d3dbc4d80 0x560d3dbb4c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:32:31.112 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:30.908+0000 7efd087cf740 1 --2- 172.21.15.19:0/866572017 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560d3dbb8df0 0x560d3dbbf1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:32:31.112 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:30.908+0000 7efd087cf740 1 --2- 172.21.15.19:0/866572017 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x560d3dbb84d0 0x560d3dbbec60 unknown :-1 s=CLOSED pgs=661 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:32:31.112 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:30.908+0000 7efd087cf740 1 -- 172.21.15.19:0/866572017 >> 172.21.15.19:0/866572017 conn(0x560d3dbb6300 msgr2=0x560d3dbc02d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:32:31.112 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:30.908+0000 7efd087cf740 1 -- 172.21.15.19:0/866572017 shutdown_connections 2024-09-10T22:32:31.112 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:30.908+0000 7efd087cf740 1 -- 172.21.15.19:0/866572017 wait complete. 2024-09-10T22:32:31.112 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:30.908+0000 7efd087cf740 1 -- start start 2024-09-10T22:32:31.113 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:30.908+0000 7efd087cf740 1 Processor -- start 2024-09-10T22:32:31.113 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:30.909+0000 7efd087cf740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x560d3dbb84d0 0x560d3dbccd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:32:31.113 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:30.909+0000 7efd087cf740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560d3dbb8df0 0x560d3dbcd270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:32:31.113 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:30.909+0000 7efd087cf740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x560d3dbc4d80 0x560d3dbc7ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:32:31.113 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:30.909+0000 7efd087cf740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7efce000cd30 con 0x560d3dbc4d80 2024-09-10T22:32:31.113 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:30.909+0000 7efd087cf740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7efce000e1a0 con 0x560d3dbb8df0 2024-09-10T22:32:31.113 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:30.909+0000 7efd087cf740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7efce000d400 con 0x560d3dbb84d0 2024-09-10T22:32:31.113 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:30.909+0000 7efd087cf740 10 client.0 _ll_register_callbacks cb 0x7efce8005e30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T22:32:31.113 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:30.909+0000 7efd04997640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x560d3dbc4d80 0x560d3dbc7ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:32:31.113 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:30.909+0000 7efcfffff640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x560d3dbb84d0 0x560d3dbccd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:32:31.113 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:30.909+0000 7efd04997640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x560d3dbc4d80 0x560d3dbc7ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:47382/0 (socket says 172.21.15.19:47382) 2024-09-10T22:32:31.113 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:30.909+0000 7efcfffff640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x560d3dbb84d0 0x560d3dbccd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.19:43120/0 (socket says 172.21.15.19:43120) 2024-09-10T22:32:31.113 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:30.909+0000 7efd04997640 1 -- 172.21.15.19:0/3836287729 learned_addr learned my addr 172.21.15.19:0/3836287729 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:32:31.114 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:30.909+0000 7efcf7fff640 1 --2- 172.21.15.19:0/3836287729 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560d3dbb8df0 0x560d3dbcd270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:32:31.114 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:30.909+0000 7efcfffff640 1 -- 172.21.15.19:0/3836287729 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560d3dbb8df0 msgr2=0x560d3dbcd270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:32:31.114 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:30.909+0000 7efcfffff640 1 --2- 172.21.15.19:0/3836287729 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560d3dbb8df0 0x560d3dbcd270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:32:31.114 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:30.909+0000 7efcfffff640 1 -- 172.21.15.19:0/3836287729 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x560d3dbc4d80 msgr2=0x560d3dbc7ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:32:31.114 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:30.909+0000 7efcfffff640 1 --2- 172.21.15.19:0/3836287729 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x560d3dbc4d80 0x560d3dbc7ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:32:31.114 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:30.909+0000 7efcfffff640 1 -- 172.21.15.19:0/3836287729 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560d3dbcdaa0 con 0x560d3dbb84d0 2024-09-10T22:32:31.114 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:30.909+0000 7efd04997640 1 --2- 172.21.15.19:0/3836287729 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x560d3dbc4d80 0x560d3dbc7ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T22:32:31.114 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:30.909+0000 7efcfffff640 1 --2- 172.21.15.19:0/3836287729 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x560d3dbb84d0 0x560d3dbccd30 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7efcf0009250 tx=0x7efcf0005c50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4d033ec16c0e7e07 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:32:31.114 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:30.909+0000 7efcdf7fe640 10 client.0 ms_handle_connect on v2:172.21.15.138:3300/0 2024-09-10T22:32:31.114 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:30.910+0000 7efcdf7fe640 1 -- 172.21.15.19:0/3836287729 <== mon.1 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efcf004c020 con 0x560d3dbb84d0 2024-09-10T22:32:31.114 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:30.910+0000 7efcdf7fe640 1 -- 172.21.15.19:0/3836287729 <== mon.1 v2:172.21.15.138:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8327+0+0 (secure 0 0 0) 0x7efcf00050b0 con 0x560d3dbb84d0 2024-09-10T22:32:31.115 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:30.910+0000 7efd087cf740 1 -- 172.21.15.19:0/3836287729 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7efcf002f040 con 0x560d3dbb84d0 2024-09-10T22:32:31.115 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:30.910+0000 7efcdf7fe640 1 -- 172.21.15.19:0/3836287729 <== mon.1 v2:172.21.15.138:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7efcf0057050 con 0x560d3dbb84d0 2024-09-10T22:32:31.115 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:30.910+0000 7efd087cf740 10 client.26035 fetch_fsmap learned FSMap version 27 2024-09-10T22:32:31.115 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:30.910+0000 7efd087cf740 1 -- 172.21.15.19:0/3836287729 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x560d3dc41d20 con 0x560d3dbb84d0 2024-09-10T22:32:31.115 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:30.910+0000 7efcdf7fe640 1 -- 172.21.15.19:0/3836287729 <== mon.1 v2:172.21.15.138:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7efcf002f040 con 0x560d3dbb84d0 2024-09-10T22:32:31.115 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:30.910+0000 7efcdf7fe640 1 -- 172.21.15.19:0/3836287729 <== mon.1 v2:172.21.15.138:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7efcf0034040 con 0x560d3dbb84d0 2024-09-10T22:32:31.115 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:30.910+0000 7efd087cf740 10 client.26035 fetch_fsmap finished waiting for FSMap version 27 2024-09-10T22:32:31.115 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:30.910+0000 7efd087cf740 10 client.26035 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-10T22:32:31.115 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:30.910+0000 7efd087cf740 20 client.26035 populate_metadata read hostname 'smithi019' 2024-09-10T22:32:31.115 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:30.910+0000 7efd087cf740 1 --2- 172.21.15.19:0/3836287729 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x560d3dc42270 0x560d3dc44690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:32:31.115 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:30.910+0000 7efd087cf740 4 client.26035 mds_command: new command op to 24581 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-10T22:32:31.115 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:30.910+0000 7efd087cf740 1 -- 172.21.15.19:0/3836287729 --> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] -- command(tid 0: {"prefix": "damage ls"}) -- 0x560d3dbb60b0 con 0x560d3dc42270 2024-09-10T22:32:31.115 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:30.910+0000 7efcf7fff640 1 --2- 172.21.15.19:0/3836287729 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x560d3dc42270 0x560d3dc44690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:32:31.115 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:30.911+0000 7efcf7fff640 1 --2- 172.21.15.19:0/3836287729 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x560d3dc42270 0x560d3dc44690 crc :-1 s=READY pgs=135 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1e65ae55d19ac7b1 server_cookie=2199c236e4d4ad04 in_seq=0 out_seq=0 2024-09-10T22:32:31.116 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:30.911+0000 7efcdf7fe640 10 client.26035 ms_handle_connect on v2:172.21.15.135:6838/1254769802 2024-09-10T22:32:31.116 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:30.912+0000 7efcdf7fe640 1 -- 172.21.15.19:0/3836287729 <== mds.0 v2:172.21.15.135:6838/1254769802 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x560d3dbb60b0 con 0x560d3dc42270 2024-09-10T22:32:31.116 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:30.912+0000 7efcdf7fe640 10 client.26035 handle_command_reply: tid=0 2024-09-10T22:32:31.116 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:30.912+0000 7efd087cf740 1 client.26035 shutdown 2024-09-10T22:32:31.116 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:30.912+0000 7efd087cf740 1 -- 172.21.15.19:0/3836287729 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x560d3dbb84d0 msgr2=0x560d3dbccd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:32:31.116 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:30.912+0000 7efd087cf740 1 --2- 172.21.15.19:0/3836287729 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x560d3dbb84d0 0x560d3dbccd30 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7efcf0009250 tx=0x7efcf0005c50 comp rx=0 tx=0).stop 2024-09-10T22:32:31.116 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:30.912+0000 7efd087cf740 1 -- 172.21.15.19:0/3836287729 shutdown_connections 2024-09-10T22:32:31.116 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:30.912+0000 7efd087cf740 1 --2- 172.21.15.19:0/3836287729 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x560d3dbc4d80 0x560d3dbc7ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:32:31.116 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:30.912+0000 7efd087cf740 1 --2- 172.21.15.19:0/3836287729 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560d3dbb8df0 0x560d3dbcd270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:32:31.116 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:30.912+0000 7efd087cf740 1 --2- 172.21.15.19:0/3836287729 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x560d3dc42270 0x560d3dc44690 crc :-1 s=READY pgs=135 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:32:31.116 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:30.912+0000 7efd087cf740 1 --2- 172.21.15.19:0/3836287729 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x560d3dbb84d0 0x560d3dbccd30 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:32:31.116 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:30.912+0000 7efcdf7fe640 0 client.26035 ms_handle_reset on v2:172.21.15.135:6838/1254769802 2024-09-10T22:32:31.116 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:30.912+0000 7efd087cf740 1 -- 172.21.15.19:0/3836287729 >> 172.21.15.19:0/3836287729 conn(0x560d3dbb6300 msgr2=0x560d3dbc3080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:32:31.117 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:30.912+0000 7efd087cf740 1 -- 172.21.15.19:0/3836287729 shutdown_connections 2024-09-10T22:32:31.117 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:30.912+0000 7efd087cf740 1 -- 172.21.15.19:0/3836287729 wait complete. 2024-09-10T22:32:31.117 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:30.912+0000 7efd087cf740 20 client.26035 trim_cache size 0 max 16384 2024-09-10T22:32:31.117 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:30.913+0000 7efd063fa640 1 -- 172.21.15.19:0/3634826548 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7efcec0b5360 msgr2=0x7efcec0b7820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:32:31.117 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:30.913+0000 7efd063fa640 1 --2- 172.21.15.19:0/3634826548 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7efcec0b5360 0x7efcec0b7820 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7efcf8006010 tx=0x7efcf8004a40 comp rx=0 tx=0).stop 2024-09-10T22:32:31.117 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:30.913+0000 7efd063fa640 1 -- 172.21.15.19:0/3634826548 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efd00075de0 msgr2=0x7efd0019b9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:32:31.117 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:30.913+0000 7efd063fa640 1 --2- 172.21.15.19:0/3634826548 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efd00075de0 0x7efd0019b9e0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7efce800e9f0 tx=0x7efce800eeb0 comp rx=0 tx=0).stop 2024-09-10T22:32:31.117 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:30.913+0000 7efd063fa640 1 -- 172.21.15.19:0/3634826548 shutdown_connections 2024-09-10T22:32:31.117 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:30.913+0000 7efd063fa640 1 --2- 172.21.15.19:0/3634826548 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7efcec0b5360 0x7efcec0b7820 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:32:31.117 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:30.913+0000 7efd063fa640 1 --2- 172.21.15.19:0/3634826548 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7efd0010f3d0 0x7efd001a0d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:32:31.117 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:30.913+0000 7efd063fa640 1 --2- 172.21.15.19:0/3634826548 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efd00075de0 0x7efd0019b9e0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:32:31.117 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:30.913+0000 7efd063fa640 1 --2- 172.21.15.19:0/3634826548 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7efd000754c0 0x7efd0019b4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:32:31.117 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:30.913+0000 7efd063fa640 1 -- 172.21.15.19:0/3634826548 >> 172.21.15.19:0/3634826548 conn(0x7efd000fe870 msgr2=0x7efd000ff470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:32:31.117 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:30.913+0000 7efd063fa640 1 -- 172.21.15.19:0/3634826548 shutdown_connections 2024-09-10T22:32:31.118 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:30.913+0000 7efd063fa640 1 -- 172.21.15.19:0/3634826548 wait complete. 2024-09-10T22:32:32.458 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:32:32 smithi019 ceph-mon[31375]: pgmap v530: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 868 KiB/s rd, 355 MiB/s wr, 195 op/s 2024-09-10T22:32:32.610 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:32:32 smithi135 ceph-mon[34789]: pgmap v530: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 868 KiB/s rd, 355 MiB/s wr, 195 op/s 2024-09-10T22:32:32.625 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:32:32 smithi138 ceph-mon[35236]: pgmap v530: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 868 KiB/s rd, 355 MiB/s wr, 195 op/s 2024-09-10T22:32:33.323 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-10T22:32:33.323 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 22997a4c-6fc2-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-10T22:32:33.658 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/22997a4c-6fc2-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T22:32:34.459 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:32:34 smithi019 ceph-mon[31375]: pgmap v531: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 577 KiB/s rd, 312 MiB/s wr, 172 op/s 2024-09-10T22:32:34.609 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:32:34 smithi135 ceph-mon[34789]: pgmap v531: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 577 KiB/s rd, 312 MiB/s wr, 172 op/s 2024-09-10T22:32:34.625 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:32:34 smithi138 ceph-mon[35236]: pgmap v531: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 577 KiB/s rd, 312 MiB/s wr, 172 op/s 2024-09-10T22:32:34.680 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:34.607+0000 7f3e32661640 1 -- 172.21.15.19:0/1515867806 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3e2c1076e0 msgr2=0x7f3e2c107b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:32:34.680 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:34.607+0000 7f3e32661640 1 --2- 172.21.15.19:0/1515867806 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3e2c1076e0 0x7f3e2c107b20 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7f3e14009900 tx=0x7f3e1402a410 comp rx=0 tx=0).stop 2024-09-10T22:32:34.680 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:34.607+0000 7f3e32661640 1 -- 172.21.15.19:0/1515867806 shutdown_connections 2024-09-10T22:32:34.680 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:34.607+0000 7f3e32661640 1 --2- 172.21.15.19:0/1515867806 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3e2c108060 0x7f3e2c10e860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:32:34.680 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:34.607+0000 7f3e32661640 1 --2- 172.21.15.19:0/1515867806 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3e2c1076e0 0x7f3e2c107b20 unknown :-1 s=CLOSED pgs=662 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:32:34.680 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:34.607+0000 7f3e32661640 1 --2- 172.21.15.19:0/1515867806 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3e2c101cd0 0x7f3e2c1020b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:32:34.681 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:34.607+0000 7f3e32661640 1 -- 172.21.15.19:0/1515867806 >> 172.21.15.19:0/1515867806 conn(0x7f3e2c0fd740 msgr2=0x7f3e2c0ffb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:32:34.681 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:34.607+0000 7f3e32661640 1 -- 172.21.15.19:0/1515867806 shutdown_connections 2024-09-10T22:32:34.681 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:34.607+0000 7f3e32661640 1 -- 172.21.15.19:0/1515867806 wait complete. 2024-09-10T22:32:34.681 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:34.608+0000 7f3e32661640 1 Processor -- start 2024-09-10T22:32:34.681 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:34.608+0000 7f3e32661640 1 -- start start 2024-09-10T22:32:34.681 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:34.608+0000 7f3e32661640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3e2c101cd0 0x7f3e2c0fdc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:32:34.681 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:34.608+0000 7f3e32661640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3e2c1076e0 0x7f3e2c0fe180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:32:34.681 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:34.608+0000 7f3e32661640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3e2c108060 0x7f3e2c0fe6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:32:34.681 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:34.608+0000 7f3e32661640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f3e2c111d00 con 0x7f3e2c1076e0 2024-09-10T22:32:34.681 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:34.608+0000 7f3e32661640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f3e2c111b80 con 0x7f3e2c101cd0 2024-09-10T22:32:34.681 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:34.608+0000 7f3e32661640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f3e2c111e80 con 0x7f3e2c108060 2024-09-10T22:32:34.681 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:34.608+0000 7f3e23fff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3e2c1076e0 0x7f3e2c0fe180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:32:34.681 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:34.608+0000 7f3e23fff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3e2c1076e0 0x7f3e2c0fe180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:44936/0 (socket says 172.21.15.19:44936) 2024-09-10T22:32:34.682 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:34.608+0000 7f3e2bfff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3e2c101cd0 0x7f3e2c0fdc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:32:34.682 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:34.608+0000 7f3e23fff640 1 -- 172.21.15.19:0/337713765 learned_addr learned my addr 172.21.15.19:0/337713765 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:32:34.682 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:34.609+0000 7f3e30bfe640 1 --2- 172.21.15.19:0/337713765 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3e2c108060 0x7f3e2c0fe6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:32:34.682 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:34.609+0000 7f3e23fff640 1 -- 172.21.15.19:0/337713765 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3e2c108060 msgr2=0x7f3e2c0fe6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:32:34.682 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:34.609+0000 7f3e23fff640 1 --2- 172.21.15.19:0/337713765 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3e2c108060 0x7f3e2c0fe6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:32:34.682 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:34.609+0000 7f3e23fff640 1 -- 172.21.15.19:0/337713765 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3e2c101cd0 msgr2=0x7f3e2c0fdc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:32:34.682 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:34.609+0000 7f3e23fff640 1 --2- 172.21.15.19:0/337713765 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3e2c101cd0 0x7f3e2c0fdc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:32:34.682 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:34.609+0000 7f3e23fff640 1 -- 172.21.15.19:0/337713765 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3e2c1a76c0 con 0x7f3e2c1076e0 2024-09-10T22:32:34.682 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:34.609+0000 7f3e2bfff640 1 --2- 172.21.15.19:0/337713765 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3e2c101cd0 0x7f3e2c0fdc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T22:32:34.682 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:34.609+0000 7f3e23fff640 1 --2- 172.21.15.19:0/337713765 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3e2c1076e0 0x7f3e2c0fe180 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7f3e14005ab0 tx=0x7f3e14003c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:32:34.682 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:34.609+0000 7f3e29ffb640 1 -- 172.21.15.19:0/337713765 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e1403f070 con 0x7f3e2c1076e0 2024-09-10T22:32:34.682 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:34.609+0000 7f3e32661640 1 -- 172.21.15.19:0/337713765 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3e2c1a7950 con 0x7f3e2c1076e0 2024-09-10T22:32:34.682 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:34.609+0000 7f3e29ffb640 1 -- 172.21.15.19:0/337713765 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3e14031b60 con 0x7f3e2c1076e0 2024-09-10T22:32:34.682 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:34.609+0000 7f3e29ffb640 1 -- 172.21.15.19:0/337713765 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e14035030 con 0x7f3e2c1076e0 2024-09-10T22:32:34.683 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:34.609+0000 7f3e32661640 1 -- 172.21.15.19:0/337713765 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3e2c1a7e80 con 0x7f3e2c1076e0 2024-09-10T22:32:34.683 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:34.612+0000 7f3e29ffb640 1 -- 172.21.15.19:0/337713765 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 18) ==== 153250+0+0 (secure 0 0 0) 0x7f3e1403b460 con 0x7f3e2c1076e0 2024-09-10T22:32:34.683 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:34.613+0000 7f3e34a36740 1 Processor -- start 2024-09-10T22:32:34.683 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:34.613+0000 7f3e34a36740 1 -- start start 2024-09-10T22:32:34.683 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:34.613+0000 7f3e34a36740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556b0c730ee0 0x556b0c7312c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:32:34.683 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:34.613+0000 7f3e34a36740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x556b0c731800 0x556b0c73d250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:32:34.683 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:34.613+0000 7f3e34a36740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x556b0c73d790 0x556b0c73fb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:32:34.683 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:34.613+0000 7f3e34a36740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x556b0c6a7e60 con 0x556b0c731800 2024-09-10T22:32:34.683 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:34.613+0000 7f3e34a36740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x556b0c697290 con 0x556b0c730ee0 2024-09-10T22:32:34.683 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:34.613+0000 7f3e34a36740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x556b0c69b0a0 con 0x556b0c73d790 2024-09-10T22:32:34.683 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:34.613+0000 7f3e29ffb640 1 --2- 172.21.15.19:0/337713765 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f3e180b5360 0x7f3e180b7820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:32:34.683 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:34.613+0000 7f3e30bfe640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556b0c730ee0 0x556b0c7312c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:32:34.683 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:34.613+0000 7f3e23fff640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x556b0c73d790 0x556b0c73fb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:32:34.684 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:34.613+0000 7f3e30bfe640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556b0c730ee0 0x556b0c7312c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.19:54168/0 (socket says 172.21.15.19:54168) 2024-09-10T22:32:34.684 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:34.613+0000 7f3e30bfe640 1 -- 172.21.15.19:0/2095482670 learned_addr learned my addr 172.21.15.19:0/2095482670 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:32:34.684 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:34.613+0000 7f3e2bfff640 1 --2- 172.21.15.19:0/2095482670 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x556b0c731800 0x556b0c73d250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:32:34.684 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:34.613+0000 7f3e30bfe640 1 --2- 172.21.15.19:0/337713765 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f3e180b5360 0x7f3e180b7820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:32:34.684 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:34.614+0000 7f3e29ffb640 1 -- 172.21.15.19:0/337713765 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8327+0+0 (secure 0 0 0) 0x7f3e141065e0 con 0x7f3e2c1076e0 2024-09-10T22:32:34.684 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:34.614+0000 7f3e30bfe640 1 -- 172.21.15.19:0/2095482670 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x556b0c73d790 msgr2=0x556b0c73fb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:32:34.684 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:34.614+0000 7f3e30bfe640 1 --2- 172.21.15.19:0/2095482670 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x556b0c73d790 0x556b0c73fb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:32:34.684 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:34.614+0000 7f3e30bfe640 1 -- 172.21.15.19:0/2095482670 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x556b0c731800 msgr2=0x556b0c73d250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:32:34.684 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:34.614+0000 7f3e30bfe640 1 --2- 172.21.15.19:0/2095482670 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x556b0c731800 0x556b0c73d250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:32:34.684 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:34.614+0000 7f3e30bfe640 1 -- 172.21.15.19:0/2095482670 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556b0c3f5930 con 0x556b0c730ee0 2024-09-10T22:32:34.684 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:34.614+0000 7f3e30bfe640 1 --2- 172.21.15.19:0/337713765 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f3e180b5360 0x7f3e180b7820 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f3e240099a0 tx=0x7f3e2401d000 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:32:34.684 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:34.614+0000 7f3e30bfe640 1 --2- 172.21.15.19:0/2095482670 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556b0c730ee0 0x556b0c7312c0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f3e24012d70 tx=0x7f3e240107a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5357541c474a41d3 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:32:34.684 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:34.614+0000 7f3e227fc640 1 -- 172.21.15.19:0/2095482670 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e24012880 con 0x556b0c730ee0 2024-09-10T22:32:34.685 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:34.614+0000 7f3e227fc640 1 -- 172.21.15.19:0/2095482670 <== mon.2 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3e24009d90 con 0x556b0c730ee0 2024-09-10T22:32:34.685 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:34.614+0000 7f3e227fc640 1 -- 172.21.15.19:0/2095482670 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e24004350 con 0x556b0c730ee0 2024-09-10T22:32:34.685 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:34.615+0000 7f3e34a36740 1 -- 172.21.15.19:0/2095482670 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556b0c730ee0 msgr2=0x556b0c7312c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:32:34.685 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:34.615+0000 7f3e34a36740 1 --2- 172.21.15.19:0/2095482670 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556b0c730ee0 0x556b0c7312c0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f3e24012d70 tx=0x7f3e240107a0 comp rx=0 tx=0).stop 2024-09-10T22:32:34.685 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:34.615+0000 7f3e34a36740 1 -- 172.21.15.19:0/2095482670 shutdown_connections 2024-09-10T22:32:34.685 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:34.615+0000 7f3e34a36740 1 --2- 172.21.15.19:0/2095482670 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x556b0c73d790 0x556b0c73fb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:32:34.685 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:34.615+0000 7f3e34a36740 1 --2- 172.21.15.19:0/2095482670 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x556b0c731800 0x556b0c73d250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:32:34.685 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:34.615+0000 7f3e34a36740 1 --2- 172.21.15.19:0/2095482670 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556b0c730ee0 0x556b0c7312c0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:32:34.685 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:34.615+0000 7f3e34a36740 1 -- 172.21.15.19:0/2095482670 >> 172.21.15.19:0/2095482670 conn(0x556b0c72ed10 msgr2=0x556b0c72feb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:32:34.685 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:34.615+0000 7f3e34a36740 1 -- 172.21.15.19:0/2095482670 shutdown_connections 2024-09-10T22:32:34.685 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:34.615+0000 7f3e34a36740 1 -- 172.21.15.19:0/2095482670 wait complete. 2024-09-10T22:32:34.685 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:34.616+0000 7f3e34a36740 1 -- start start 2024-09-10T22:32:34.685 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:34.616+0000 7f3e34a36740 1 Processor -- start 2024-09-10T22:32:34.686 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:34.616+0000 7f3e34a36740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x556b0c730ee0 0x556b0c73a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:32:34.686 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:34.616+0000 7f3e34a36740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556b0c731800 0x556b0c73ace0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:32:34.686 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:34.616+0000 7f3e34a36740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x556b0c73d790 0x556b0c73b220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:32:34.686 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:34.616+0000 7f3e34a36740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x556b0c4f8890 con 0x556b0c73d790 2024-09-10T22:32:34.686 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:34.616+0000 7f3e34a36740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x556b0c631d40 con 0x556b0c731800 2024-09-10T22:32:34.686 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:34.616+0000 7f3e34a36740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x556b0c740380 con 0x556b0c730ee0 2024-09-10T22:32:34.686 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:34.616+0000 7f3e34a36740 10 client.0 _ll_register_callbacks cb 0x556b0c695c80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T22:32:34.686 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:34.616+0000 7f3e23fff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556b0c731800 0x556b0c73ace0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:32:34.686 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:34.616+0000 7f3e23fff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556b0c731800 0x556b0c73ace0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.19:54182/0 (socket says 172.21.15.19:54182) 2024-09-10T22:32:34.686 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:34.616+0000 7f3e30bfe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x556b0c73d790 0x556b0c73b220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:32:34.686 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:34.616+0000 7f3e23fff640 1 -- 172.21.15.19:0/995155239 learned_addr learned my addr 172.21.15.19:0/995155239 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:32:34.686 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:34.616+0000 7f3e2bfff640 1 --2- 172.21.15.19:0/995155239 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x556b0c730ee0 0x556b0c73a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:32:34.686 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:34.617+0000 7f3e23fff640 1 -- 172.21.15.19:0/995155239 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x556b0c730ee0 msgr2=0x556b0c73a7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:32:34.686 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:34.617+0000 7f3e23fff640 1 --2- 172.21.15.19:0/995155239 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x556b0c730ee0 0x556b0c73a7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:32:34.687 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:34.617+0000 7f3e23fff640 1 -- 172.21.15.19:0/995155239 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x556b0c73d790 msgr2=0x556b0c73b220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:32:34.687 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:34.617+0000 7f3e23fff640 1 --2- 172.21.15.19:0/995155239 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x556b0c73d790 0x556b0c73b220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:32:34.687 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:34.617+0000 7f3e23fff640 1 -- 172.21.15.19:0/995155239 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556b0c7497b0 con 0x556b0c731800 2024-09-10T22:32:34.687 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:34.617+0000 7f3e2bfff640 1 --2- 172.21.15.19:0/995155239 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x556b0c730ee0 0x556b0c73a7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T22:32:34.687 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:34.617+0000 7f3e23fff640 1 --2- 172.21.15.19:0/995155239 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556b0c731800 0x556b0c73ace0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f3e14005ec0 tx=0x7f3e14095ee0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=69f10a0c77d30207 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:32:34.687 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:34.617+0000 7f3e0b7fe640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-09-10T22:32:34.687 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:34.617+0000 7f3e0b7fe640 1 -- 172.21.15.19:0/995155239 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e14049070 con 0x556b0c731800 2024-09-10T22:32:34.687 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:34.617+0000 7f3e0b7fe640 1 -- 172.21.15.19:0/995155239 <== mon.2 v2:172.21.15.135:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8327+0+0 (secure 0 0 0) 0x7f3e140c8fb0 con 0x556b0c731800 2024-09-10T22:32:34.687 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:34.617+0000 7f3e34a36740 1 -- 172.21.15.19:0/995155239 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3e24009d90 con 0x556b0c731800 2024-09-10T22:32:34.687 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:34.617+0000 7f3e0b7fe640 1 -- 172.21.15.19:0/995155239 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f3e140d1020 con 0x556b0c731800 2024-09-10T22:32:34.687 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:34.617+0000 7f3e34a36740 10 client.26021 fetch_fsmap learned FSMap version 27 2024-09-10T22:32:34.687 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:34.617+0000 7f3e34a36740 1 -- 172.21.15.19:0/995155239 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x556b0c74c160 con 0x556b0c731800 2024-09-10T22:32:34.687 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:34.617+0000 7f3e0b7fe640 1 -- 172.21.15.19:0/995155239 <== mon.2 v2:172.21.15.135:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3e24009d90 con 0x556b0c731800 2024-09-10T22:32:34.688 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:34.618+0000 7f3e0b7fe640 1 -- 172.21.15.19:0/995155239 <== mon.2 v2:172.21.15.135:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7f3e140d5a40 con 0x556b0c731800 2024-09-10T22:32:34.688 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:34.618+0000 7f3e34a36740 10 client.26021 fetch_fsmap finished waiting for FSMap version 27 2024-09-10T22:32:34.688 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:34.618+0000 7f3e34a36740 10 client.26021 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-10T22:32:34.688 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:34.618+0000 7f3e34a36740 20 client.26021 populate_metadata read hostname 'smithi019' 2024-09-10T22:32:34.688 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:34.618+0000 7f3e34a36740 1 --2- 172.21.15.19:0/995155239 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x556b0c74d550 0x556b0c74f980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:32:34.688 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:34.618+0000 7f3e34a36740 4 client.26021 mds_command: new command op to 24581 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T22:32:34.688 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:34.618+0000 7f3e34a36740 1 -- 172.21.15.19:0/995155239 --> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x556b0c6a9db0 con 0x556b0c74d550 2024-09-10T22:32:34.688 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:34.618+0000 7f3e2bfff640 1 --2- 172.21.15.19:0/995155239 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x556b0c74d550 0x556b0c74f980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:32:34.688 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:34.618+0000 7f3e0b7fe640 10 client.26021 ms_handle_connect on v2:172.21.15.135:6838/1254769802 2024-09-10T22:32:34.688 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:34.619+0000 7f3e2bfff640 1 --2- 172.21.15.19:0/995155239 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x556b0c74d550 0x556b0c74f980 crc :-1 s=READY pgs=136 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5a0c0b1e312cf3b server_cookie=48e2f3e6346a83d8 in_seq=0 out_seq=0 2024-09-10T22:32:34.688 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:34.620+0000 7f3e0b7fe640 1 -- 172.21.15.19:0/995155239 <== mds.0 v2:172.21.15.135:6838/1254769802 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x556b0c6a9db0 con 0x556b0c74d550 2024-09-10T22:32:34.688 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:34.620+0000 7f3e0b7fe640 10 client.26021 handle_command_reply: tid=0 2024-09-10T22:32:34.688 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:34.620+0000 7f3e34a36740 1 client.26021 shutdown 2024-09-10T22:32:34.689 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:34.620+0000 7f3e34a36740 1 -- 172.21.15.19:0/995155239 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556b0c731800 msgr2=0x556b0c73ace0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:32:34.689 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:34.620+0000 7f3e34a36740 1 --2- 172.21.15.19:0/995155239 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556b0c731800 0x556b0c73ace0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f3e14005ec0 tx=0x7f3e14095ee0 comp rx=0 tx=0).stop 2024-09-10T22:32:34.689 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:34.620+0000 7f3e34a36740 1 -- 172.21.15.19:0/995155239 shutdown_connections 2024-09-10T22:32:34.689 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:34.620+0000 7f3e34a36740 1 --2- 172.21.15.19:0/995155239 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x556b0c73d790 0x556b0c73b220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:32:34.689 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:34.620+0000 7f3e34a36740 1 --2- 172.21.15.19:0/995155239 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556b0c731800 0x556b0c73ace0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:32:34.689 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:34.620+0000 7f3e34a36740 1 --2- 172.21.15.19:0/995155239 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x556b0c74d550 0x556b0c74f980 crc :-1 s=READY pgs=136 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:32:34.689 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:34.620+0000 7f3e34a36740 1 --2- 172.21.15.19:0/995155239 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x556b0c730ee0 0x556b0c73a7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:32:34.689 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:34.620+0000 7f3e34a36740 1 -- 172.21.15.19:0/995155239 >> 172.21.15.19:0/995155239 conn(0x556b0c72ed10 msgr2=0x556b0c72df70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:32:34.689 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:34.620+0000 7f3e0b7fe640 0 client.26021 ms_handle_reset on v2:172.21.15.135:6838/1254769802 2024-09-10T22:32:34.689 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:34.620+0000 7f3e34a36740 1 -- 172.21.15.19:0/995155239 shutdown_connections 2024-09-10T22:32:34.689 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:34.620+0000 7f3e34a36740 1 -- 172.21.15.19:0/995155239 wait complete. 2024-09-10T22:32:34.689 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:34.621+0000 7f3e34a36740 20 client.26021 trim_cache size 0 max 16384 2024-09-10T22:32:34.689 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:34.653+0000 7f3e34a36740 1 Processor -- start 2024-09-10T22:32:34.690 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:34.653+0000 7f3e34a36740 1 -- start start 2024-09-10T22:32:34.690 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:34.653+0000 7f3e34a36740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556b0c730ee0 0x556b0c7379d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:32:34.690 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:34.653+0000 7f3e34a36740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x556b0c731800 0x556b0c737f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:32:34.690 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:34.653+0000 7f3e34a36740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x556b0c73d790 0x556b0c755250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:32:34.690 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:34.653+0000 7f3e34a36740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f3e2c1b2f20 con 0x556b0c731800 2024-09-10T22:32:34.690 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:34.653+0000 7f3e34a36740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f3e2c1b07f0 con 0x556b0c730ee0 2024-09-10T22:32:34.690 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:34.653+0000 7f3e34a36740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f3e2c1ae640 con 0x556b0c73d790 2024-09-10T22:32:34.690 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:34.653+0000 7f3e23fff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x556b0c731800 0x556b0c737f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:32:34.690 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:34.653+0000 7f3e23fff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x556b0c731800 0x556b0c737f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:44948/0 (socket says 172.21.15.19:44948) 2024-09-10T22:32:34.690 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:34.653+0000 7f3e23fff640 1 -- 172.21.15.19:0/425679364 learned_addr learned my addr 172.21.15.19:0/425679364 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:32:34.690 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:34.653+0000 7f3e2bfff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556b0c730ee0 0x556b0c7379d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:32:34.690 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:34.653+0000 7f3e30bfe640 1 --2- 172.21.15.19:0/425679364 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x556b0c73d790 0x556b0c755250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:32:34.690 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:34.654+0000 7f3e23fff640 1 -- 172.21.15.19:0/425679364 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x556b0c73d790 msgr2=0x556b0c755250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:32:34.691 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:34.654+0000 7f3e23fff640 1 --2- 172.21.15.19:0/425679364 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x556b0c73d790 0x556b0c755250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:32:34.691 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:34.654+0000 7f3e23fff640 1 -- 172.21.15.19:0/425679364 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556b0c730ee0 msgr2=0x556b0c7379d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:32:34.691 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:34.654+0000 7f3e23fff640 1 --2- 172.21.15.19:0/425679364 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556b0c730ee0 0x556b0c7379d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:32:34.691 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:34.654+0000 7f3e23fff640 1 -- 172.21.15.19:0/425679364 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556b0c72f790 con 0x556b0c731800 2024-09-10T22:32:34.691 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:34.654+0000 7f3e30bfe640 1 --2- 172.21.15.19:0/425679364 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x556b0c73d790 0x556b0c755250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T22:32:34.691 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:34.654+0000 7f3e23fff640 1 --2- 172.21.15.19:0/425679364 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x556b0c731800 0x556b0c737f10 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7f3e140cccd0 tx=0x7f3e14031400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e7d9061e92e12045 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:32:34.691 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:34.654+0000 7f3e21ffb640 1 -- 172.21.15.19:0/425679364 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e14049070 con 0x556b0c731800 2024-09-10T22:32:34.691 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:34.654+0000 7f3e21ffb640 1 -- 172.21.15.19:0/425679364 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3e140d62d0 con 0x556b0c731800 2024-09-10T22:32:34.691 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:34.654+0000 7f3e21ffb640 1 -- 172.21.15.19:0/425679364 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e140cd200 con 0x556b0c731800 2024-09-10T22:32:34.691 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:34.655+0000 7f3e34a36740 1 -- 172.21.15.19:0/425679364 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x556b0c731800 msgr2=0x556b0c737f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:32:34.691 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:34.655+0000 7f3e34a36740 1 --2- 172.21.15.19:0/425679364 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x556b0c731800 0x556b0c737f10 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7f3e140cccd0 tx=0x7f3e14031400 comp rx=0 tx=0).stop 2024-09-10T22:32:34.691 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:34.655+0000 7f3e34a36740 1 -- 172.21.15.19:0/425679364 shutdown_connections 2024-09-10T22:32:34.691 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:34.655+0000 7f3e34a36740 1 --2- 172.21.15.19:0/425679364 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x556b0c73d790 0x556b0c755250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:32:34.692 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:34.655+0000 7f3e34a36740 1 --2- 172.21.15.19:0/425679364 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x556b0c731800 0x556b0c737f10 unknown :-1 s=CLOSED pgs=664 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:32:34.692 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:34.655+0000 7f3e34a36740 1 --2- 172.21.15.19:0/425679364 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556b0c730ee0 0x556b0c7379d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:32:34.692 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:34.655+0000 7f3e34a36740 1 -- 172.21.15.19:0/425679364 >> 172.21.15.19:0/425679364 conn(0x556b0c72ed10 msgr2=0x556b0c739020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:32:34.692 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:34.655+0000 7f3e34a36740 1 -- 172.21.15.19:0/425679364 shutdown_connections 2024-09-10T22:32:34.692 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:34.655+0000 7f3e34a36740 1 -- 172.21.15.19:0/425679364 wait complete. 2024-09-10T22:32:34.692 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:34.655+0000 7f3e34a36740 1 -- start start 2024-09-10T22:32:34.692 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:34.656+0000 7f3e34a36740 1 Processor -- start 2024-09-10T22:32:34.692 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:34.656+0000 7f3e34a36740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x556b0c730ee0 0x556b0c745800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:32:34.692 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:34.656+0000 7f3e34a36740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x556b0c731800 0x556b0c745d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:32:34.692 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:34.656+0000 7f3e34a36740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556b0c73d790 0x556b0c7405d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:32:34.693 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:34.656+0000 7f3e34a36740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f3e2c1aecb0 con 0x556b0c731800 2024-09-10T22:32:34.693 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:34.656+0000 7f3e34a36740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f3e2c1b0120 con 0x556b0c73d790 2024-09-10T22:32:34.693 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:34.656+0000 7f3e34a36740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f3e2c1af380 con 0x556b0c730ee0 2024-09-10T22:32:34.693 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:34.656+0000 7f3e34a36740 10 client.0 _ll_register_callbacks cb 0x7f3e14009560 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T22:32:34.693 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:34.656+0000 7f3e23fff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x556b0c731800 0x556b0c745d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:32:34.693 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:34.656+0000 7f3e23fff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x556b0c731800 0x556b0c745d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:44956/0 (socket says 172.21.15.19:44956) 2024-09-10T22:32:34.693 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:34.656+0000 7f3e23fff640 1 -- 172.21.15.19:0/3072928005 learned_addr learned my addr 172.21.15.19:0/3072928005 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:32:34.693 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:34.656+0000 7f3e30bfe640 1 --2- 172.21.15.19:0/3072928005 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556b0c73d790 0x556b0c7405d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:32:34.693 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:34.656+0000 7f3e2bfff640 1 --2- 172.21.15.19:0/3072928005 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x556b0c730ee0 0x556b0c745800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:32:34.693 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:34.656+0000 7f3e23fff640 1 -- 172.21.15.19:0/3072928005 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x556b0c730ee0 msgr2=0x556b0c745800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:32:34.693 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:34.656+0000 7f3e23fff640 1 --2- 172.21.15.19:0/3072928005 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x556b0c730ee0 0x556b0c745800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:32:34.693 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:34.656+0000 7f3e23fff640 1 -- 172.21.15.19:0/3072928005 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556b0c73d790 msgr2=0x556b0c7405d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:32:34.694 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:34.657+0000 7f3e23fff640 1 --2- 172.21.15.19:0/3072928005 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556b0c73d790 0x556b0c7405d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:32:34.694 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:34.657+0000 7f3e23fff640 1 -- 172.21.15.19:0/3072928005 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556b0c740cc0 con 0x556b0c731800 2024-09-10T22:32:34.694 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:34.657+0000 7f3e2bfff640 1 --2- 172.21.15.19:0/3072928005 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x556b0c730ee0 0x556b0c745800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T22:32:34.694 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:34.657+0000 7f3e30bfe640 1 --2- 172.21.15.19:0/3072928005 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556b0c73d790 0x556b0c7405d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T22:32:34.694 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:34.657+0000 7f3e23fff640 1 --2- 172.21.15.19:0/3072928005 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x556b0c731800 0x556b0c745d40 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7f3e140c8c80 tx=0x7f3e14104120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=786357e8a2b56816 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:32:34.694 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:34.657+0000 7f3e0b7fe640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-10T22:32:34.694 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:34.657+0000 7f3e0b7fe640 1 -- 172.21.15.19:0/3072928005 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e14049070 con 0x556b0c731800 2024-09-10T22:32:34.694 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:34.657+0000 7f3e0b7fe640 1 -- 172.21.15.19:0/3072928005 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8327+0+0 (secure 0 0 0) 0x7f3e140d4ba0 con 0x556b0c731800 2024-09-10T22:32:34.694 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:34.657+0000 7f3e34a36740 1 -- 172.21.15.19:0/3072928005 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3e140d62d0 con 0x556b0c731800 2024-09-10T22:32:34.694 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:34.657+0000 7f3e0b7fe640 1 -- 172.21.15.19:0/3072928005 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f3e140d4da0 con 0x556b0c731800 2024-09-10T22:32:34.694 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:34.657+0000 7f3e34a36740 10 client.16614 fetch_fsmap learned FSMap version 27 2024-09-10T22:32:34.694 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:34.657+0000 7f3e34a36740 1 -- 172.21.15.19:0/3072928005 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x556b0c740cc0 con 0x556b0c731800 2024-09-10T22:32:34.694 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:34.657+0000 7f3e0b7fe640 1 -- 172.21.15.19:0/3072928005 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3e140d62d0 con 0x556b0c731800 2024-09-10T22:32:34.694 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:34.658+0000 7f3e0b7fe640 1 -- 172.21.15.19:0/3072928005 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7f3e140b2b60 con 0x556b0c731800 2024-09-10T22:32:34.695 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:34.658+0000 7f3e34a36740 10 client.16614 fetch_fsmap finished waiting for FSMap version 27 2024-09-10T22:32:34.695 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:34.658+0000 7f3e34a36740 10 client.16614 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-10T22:32:34.695 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:34.658+0000 7f3e34a36740 20 client.16614 populate_metadata read hostname 'smithi019' 2024-09-10T22:32:34.695 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:34.658+0000 7f3e34a36740 1 --2- 172.21.15.19:0/3072928005 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x556b0c7bb120 0x556b0c7bd540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:32:34.695 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:34.658+0000 7f3e34a36740 4 client.16614 mds_command: new command op to 24581 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-10T22:32:34.695 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:34.658+0000 7f3e34a36740 1 -- 172.21.15.19:0/3072928005 --> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x556b0c6a5860 con 0x556b0c7bb120 2024-09-10T22:32:34.695 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:34.658+0000 7f3e2bfff640 1 --2- 172.21.15.19:0/3072928005 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x556b0c7bb120 0x556b0c7bd540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:32:34.695 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:34.658+0000 7f3e2bfff640 1 --2- 172.21.15.19:0/3072928005 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x556b0c7bb120 0x556b0c7bd540 crc :-1 s=READY pgs=137 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f53bcf47fe5f907f server_cookie=99be495e508efa10 in_seq=0 out_seq=0 2024-09-10T22:32:34.695 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:34.658+0000 7f3e0b7fe640 10 client.16614 ms_handle_connect on v2:172.21.15.135:6838/1254769802 2024-09-10T22:32:34.695 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:34.661+0000 7f3e0b7fe640 1 -- 172.21.15.19:0/3072928005 <== mds.0 v2:172.21.15.135:6838/1254769802 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x556b0c6a5860 con 0x556b0c7bb120 2024-09-10T22:32:34.695 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:34.661+0000 7f3e0b7fe640 10 client.16614 handle_command_reply: tid=0 2024-09-10T22:32:34.695 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:34.661+0000 7f3e34a36740 1 client.16614 shutdown 2024-09-10T22:32:34.696 INFO:teuthology.orchestra.run.smithi019.stdout:{ 2024-09-10T22:32:34.696 INFO:teuthology.orchestra.run.smithi019.stdout: "return_code": 0, 2024-09-10T22:32:34.696 INFO:teuthology.orchestra.run.smithi019.stdout: "scrub_tag": "4c99964e-2e0e-4ffd-8cb8-99c4979ed90f", 2024-09-10T22:32:34.696 INFO:teuthology.orchestra.run.smithi019.stdout: "mode": "asynchronous" 2024-09-10T22:32:34.696 INFO:teuthology.orchestra.run.smithi019.stdout:} 2024-09-10T22:32:34.697 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:34.661+0000 7f3e34a36740 1 -- 172.21.15.19:0/3072928005 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x556b0c731800 msgr2=0x556b0c745d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:32:34.697 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:34.661+0000 7f3e34a36740 1 --2- 172.21.15.19:0/3072928005 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x556b0c731800 0x556b0c745d40 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7f3e140c8c80 tx=0x7f3e14104120 comp rx=0 tx=0).stop 2024-09-10T22:32:34.697 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:34.661+0000 7f3e34a36740 1 -- 172.21.15.19:0/3072928005 shutdown_connections 2024-09-10T22:32:34.697 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:34.661+0000 7f3e34a36740 1 --2- 172.21.15.19:0/3072928005 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556b0c73d790 0x556b0c7405d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:32:34.697 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:34.661+0000 7f3e34a36740 1 --2- 172.21.15.19:0/3072928005 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x556b0c731800 0x556b0c745d40 unknown :-1 s=CLOSED pgs=665 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:32:34.697 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:34.661+0000 7f3e34a36740 1 --2- 172.21.15.19:0/3072928005 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x556b0c7bb120 0x556b0c7bd540 crc :-1 s=READY pgs=137 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:32:34.697 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:34.661+0000 7f3e34a36740 1 --2- 172.21.15.19:0/3072928005 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x556b0c730ee0 0x556b0c745800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:32:34.697 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:34.661+0000 7f3e0b7fe640 0 client.16614 ms_handle_reset on v2:172.21.15.135:6838/1254769802 2024-09-10T22:32:34.697 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:34.661+0000 7f3e34a36740 1 -- 172.21.15.19:0/3072928005 >> 172.21.15.19:0/3072928005 conn(0x556b0c72ed10 msgr2=0x556b0c73bdd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:32:34.697 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:34.661+0000 7f3e34a36740 1 -- 172.21.15.19:0/3072928005 shutdown_connections 2024-09-10T22:32:34.697 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:34.662+0000 7f3e34a36740 1 -- 172.21.15.19:0/3072928005 wait complete. 2024-09-10T22:32:34.697 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:34.662+0000 7f3e34a36740 20 client.16614 trim_cache size 0 max 16384 2024-09-10T22:32:34.698 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:34.662+0000 7f3e32661640 1 -- 172.21.15.19:0/337713765 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f3e180b5360 msgr2=0x7f3e180b7820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:32:34.698 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:34.662+0000 7f3e32661640 1 --2- 172.21.15.19:0/337713765 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f3e180b5360 0x7f3e180b7820 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f3e240099a0 tx=0x7f3e2401d000 comp rx=0 tx=0).stop 2024-09-10T22:32:34.698 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:34.662+0000 7f3e32661640 1 -- 172.21.15.19:0/337713765 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3e2c1076e0 msgr2=0x7f3e2c0fe180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:32:34.698 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:34.662+0000 7f3e32661640 1 --2- 172.21.15.19:0/337713765 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3e2c1076e0 0x7f3e2c0fe180 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7f3e14005ab0 tx=0x7f3e14003c10 comp rx=0 tx=0).stop 2024-09-10T22:32:34.698 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:34.663+0000 7f3e32661640 1 -- 172.21.15.19:0/337713765 shutdown_connections 2024-09-10T22:32:34.698 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:34.663+0000 7f3e32661640 1 --2- 172.21.15.19:0/337713765 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f3e180b5360 0x7f3e180b7820 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:32:34.698 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:34.663+0000 7f3e32661640 1 --2- 172.21.15.19:0/337713765 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3e2c108060 0x7f3e2c0fe6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:32:34.698 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:34.663+0000 7f3e32661640 1 --2- 172.21.15.19:0/337713765 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3e2c1076e0 0x7f3e2c0fe180 unknown :-1 s=CLOSED pgs=663 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:32:34.698 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:34.663+0000 7f3e32661640 1 --2- 172.21.15.19:0/337713765 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3e2c101cd0 0x7f3e2c0fdc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:32:34.698 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:34.663+0000 7f3e32661640 1 -- 172.21.15.19:0/337713765 >> 172.21.15.19:0/337713765 conn(0x7f3e2c0fd740 msgr2=0x7f3e2c06b560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:32:34.698 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:34.663+0000 7f3e32661640 1 -- 172.21.15.19:0/337713765 shutdown_connections 2024-09-10T22:32:34.698 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:34.663+0000 7f3e32661640 1 -- 172.21.15.19:0/337713765 wait complete. 2024-09-10T22:32:35.791 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 22997a4c-6fc2-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-10T22:32:36.110 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/22997a4c-6fc2-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T22:32:36.610 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:32:36 smithi135 ceph-mon[34789]: pgmap v532: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 851 KiB/s rd, 328 MiB/s wr, 189 op/s 2024-09-10T22:32:36.610 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:32:36 smithi135 ceph-mon[34789]: scrub queued for path: / 2024-09-10T22:32:36.610 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:32:36 smithi135 ceph-mon[34789]: scrub summary: idle+waiting paths [/] 2024-09-10T22:32:36.610 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:32:36 smithi135 ceph-mon[34789]: scrub summary: active paths [/] 2024-09-10T22:32:36.610 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:32:36 smithi135 ceph-mon[34789]: scrub summary: active paths [/] 2024-09-10T22:32:36.610 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:32:36 smithi135 ceph-mon[34789]: scrub summary: idle+waiting paths [/] 2024-09-10T22:32:36.610 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:32:36 smithi135 ceph-mon[34789]: scrub summary: idle+waiting paths [/] 2024-09-10T22:32:36.614 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:32:36 smithi019 ceph-mon[31375]: pgmap v532: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 851 KiB/s rd, 328 MiB/s wr, 189 op/s 2024-09-10T22:32:36.614 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:32:36 smithi019 ceph-mon[31375]: scrub queued for path: / 2024-09-10T22:32:36.614 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:32:36 smithi019 ceph-mon[31375]: scrub summary: idle+waiting paths [/] 2024-09-10T22:32:36.614 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:32:36 smithi019 ceph-mon[31375]: scrub summary: active paths [/] 2024-09-10T22:32:36.614 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:32:36 smithi019 ceph-mon[31375]: scrub summary: active paths [/] 2024-09-10T22:32:36.614 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:32:36 smithi019 ceph-mon[31375]: scrub summary: idle+waiting paths [/] 2024-09-10T22:32:36.614 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:32:36 smithi019 ceph-mon[31375]: scrub summary: idle+waiting paths [/] 2024-09-10T22:32:36.625 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:32:36 smithi138 ceph-mon[35236]: pgmap v532: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 851 KiB/s rd, 328 MiB/s wr, 189 op/s 2024-09-10T22:32:36.625 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:32:36 smithi138 ceph-mon[35236]: scrub queued for path: / 2024-09-10T22:32:36.625 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:32:36 smithi138 ceph-mon[35236]: scrub summary: idle+waiting paths [/] 2024-09-10T22:32:36.625 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:32:36 smithi138 ceph-mon[35236]: scrub summary: active paths [/] 2024-09-10T22:32:36.626 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:32:36 smithi138 ceph-mon[35236]: scrub summary: active paths [/] 2024-09-10T22:32:36.626 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:32:36 smithi138 ceph-mon[35236]: scrub summary: idle+waiting paths [/] 2024-09-10T22:32:36.626 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:32:36 smithi138 ceph-mon[35236]: scrub summary: idle+waiting paths [/] 2024-09-10T22:32:37.075 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:36.979+0000 7fee07165640 1 -- 172.21.15.19:0/947999621 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fee00108020 msgr2=0x7fee0010e820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:32:37.075 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:36.979+0000 7fee07165640 1 --2- 172.21.15.19:0/947999621 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fee00108020 0x7fee0010e820 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7fedf8009ca0 tx=0x7fedf802a8c0 comp rx=0 tx=0).stop 2024-09-10T22:32:37.076 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:36.979+0000 7fee07165640 1 -- 172.21.15.19:0/947999621 shutdown_connections 2024-09-10T22:32:37.076 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:36.979+0000 7fee07165640 1 --2- 172.21.15.19:0/947999621 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fee00108020 0x7fee0010e820 unknown :-1 s=CLOSED pgs=666 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:32:37.076 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:36.979+0000 7fee07165640 1 --2- 172.21.15.19:0/947999621 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fee001076a0 0x7fee00107ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:32:37.076 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:36.979+0000 7fee07165640 1 --2- 172.21.15.19:0/947999621 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fee00101c90 0x7fee00102070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:32:37.076 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:36.979+0000 7fee07165640 1 -- 172.21.15.19:0/947999621 >> 172.21.15.19:0/947999621 conn(0x7fee000fd700 msgr2=0x7fee000ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:32:37.076 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:36.979+0000 7fee07165640 1 -- 172.21.15.19:0/947999621 shutdown_connections 2024-09-10T22:32:37.076 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:36.979+0000 7fee07165640 1 -- 172.21.15.19:0/947999621 wait complete. 2024-09-10T22:32:37.076 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:36.980+0000 7fee07165640 1 Processor -- start 2024-09-10T22:32:37.076 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:36.980+0000 7fee07165640 1 -- start start 2024-09-10T22:32:37.076 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:36.980+0000 7fee07165640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fee00101c90 0x7fee00199230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:32:37.076 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:36.980+0000 7fee07165640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fee001076a0 0x7fee00199770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:32:37.076 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:36.981+0000 7fee07165640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fee00108020 0x7fee0019eb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:32:37.077 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:36.981+0000 7fee07165640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fee00111ca0 con 0x7fee001076a0 2024-09-10T22:32:37.077 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:36.981+0000 7fee07165640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fee00111b20 con 0x7fee00101c90 2024-09-10T22:32:37.077 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:36.981+0000 7fee07165640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7fee00111e20 con 0x7fee00108020 2024-09-10T22:32:37.077 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:36.981+0000 7fedfffff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fee001076a0 0x7fee00199770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:32:37.077 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:36.981+0000 7fedfffff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fee001076a0 0x7fee00199770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:44968/0 (socket says 172.21.15.19:44968) 2024-09-10T22:32:37.077 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:36.981+0000 7fedfffff640 1 -- 172.21.15.19:0/3720288992 learned_addr learned my addr 172.21.15.19:0/3720288992 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:32:37.077 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:36.981+0000 7fee04f01640 1 --2- 172.21.15.19:0/3720288992 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fee00101c90 0x7fee00199230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:32:37.077 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:36.981+0000 7fee05702640 1 --2- 172.21.15.19:0/3720288992 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fee00108020 0x7fee0019eb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:32:37.077 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:36.981+0000 7fedfffff640 1 -- 172.21.15.19:0/3720288992 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fee00108020 msgr2=0x7fee0019eb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:32:37.077 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:36.981+0000 7fedfffff640 1 --2- 172.21.15.19:0/3720288992 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fee00108020 0x7fee0019eb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:32:37.077 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:36.981+0000 7fedfffff640 1 -- 172.21.15.19:0/3720288992 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fee00101c90 msgr2=0x7fee00199230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:32:37.078 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:36.981+0000 7fedfffff640 1 --2- 172.21.15.19:0/3720288992 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fee00101c90 0x7fee00199230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:32:37.078 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:36.981+0000 7fedfffff640 1 -- 172.21.15.19:0/3720288992 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fee0019f2e0 con 0x7fee001076a0 2024-09-10T22:32:37.078 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:36.981+0000 7fedfffff640 1 --2- 172.21.15.19:0/3720288992 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fee001076a0 0x7fee00199770 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7fedec00d950 tx=0x7fedec00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:32:37.078 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:36.981+0000 7fedfdffb640 1 -- 172.21.15.19:0/3720288992 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fedec017030 con 0x7fee001076a0 2024-09-10T22:32:37.078 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:36.981+0000 7fedfdffb640 1 -- 172.21.15.19:0/3720288992 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fedec004020 con 0x7fee001076a0 2024-09-10T22:32:37.078 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:36.981+0000 7fee07165640 1 -- 172.21.15.19:0/3720288992 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fee0019f5d0 con 0x7fee001076a0 2024-09-10T22:32:37.078 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:36.981+0000 7fedfdffb640 1 -- 172.21.15.19:0/3720288992 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fedec0047a0 con 0x7fee001076a0 2024-09-10T22:32:37.078 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:36.982+0000 7fee07165640 1 -- 172.21.15.19:0/3720288992 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fee001a5e60 con 0x7fee001076a0 2024-09-10T22:32:37.078 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:36.984+0000 7fedfdffb640 1 -- 172.21.15.19:0/3720288992 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 18) ==== 153250+0+0 (secure 0 0 0) 0x7fedec004940 con 0x7fee001076a0 2024-09-10T22:32:37.078 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:36.984+0000 7fee0953a740 1 Processor -- start 2024-09-10T22:32:37.078 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:36.985+0000 7fee0953a740 1 -- start start 2024-09-10T22:32:37.078 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:36.985+0000 7fee0953a740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ffea6b4480 0x55ffea6b4860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:32:37.079 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:36.985+0000 7fee0953a740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ffea6b4da0 0x55ffea6c07f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:32:37.079 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:36.985+0000 7fee0953a740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55ffea6c0d30 0x55ffea6c3120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:32:37.079 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:36.985+0000 7fee0953a740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x55ffea62ae50 con 0x55ffea6b4480 2024-09-10T22:32:37.079 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:36.985+0000 7fee0953a740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55ffea61a280 con 0x55ffea6b4da0 2024-09-10T22:32:37.079 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:36.985+0000 7fee0953a740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x55ffea61e090 con 0x55ffea6c0d30 2024-09-10T22:32:37.079 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:36.985+0000 7fee05702640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ffea6b4480 0x55ffea6b4860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:32:37.079 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:36.985+0000 7fee04f01640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ffea6b4da0 0x55ffea6c07f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:32:37.079 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:36.985+0000 7fee05702640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ffea6b4480 0x55ffea6b4860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:44974/0 (socket says 172.21.15.19:44974) 2024-09-10T22:32:37.079 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:36.985+0000 7fee05702640 1 -- 172.21.15.19:0/3509598633 learned_addr learned my addr 172.21.15.19:0/3509598633 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:32:37.079 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:36.985+0000 7fee04f01640 1 -- 172.21.15.19:0/3509598633 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55ffea6c0d30 msgr2=0x55ffea6c3120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:32:37.079 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:36.985+0000 7fedfffff640 1 --2- 172.21.15.19:0/3509598633 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55ffea6c0d30 0x55ffea6c3120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:32:37.079 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:36.985+0000 7fee04f01640 1 --2- 172.21.15.19:0/3509598633 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55ffea6c0d30 0x55ffea6c3120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:32:37.080 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:36.985+0000 7fee04f01640 1 -- 172.21.15.19:0/3509598633 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ffea6b4480 msgr2=0x55ffea6b4860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:32:37.080 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:36.985+0000 7fee04f01640 1 --2- 172.21.15.19:0/3509598633 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ffea6b4480 0x55ffea6b4860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:32:37.080 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:36.985+0000 7fee04f01640 1 -- 172.21.15.19:0/3509598633 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ffea378650 con 0x55ffea6b4da0 2024-09-10T22:32:37.080 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:36.985+0000 7fee05702640 1 --2- 172.21.15.19:0/3509598633 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ffea6b4480 0x55ffea6b4860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T22:32:37.080 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:36.985+0000 7fedfffff640 1 --2- 172.21.15.19:0/3509598633 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55ffea6c0d30 0x55ffea6c3120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T22:32:37.080 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:36.985+0000 7fedfdffb640 1 --2- 172.21.15.19:0/3720288992 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7fedf00b5360 0x7fedf00b7820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:32:37.080 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:36.986+0000 7fee05702640 1 --2- 172.21.15.19:0/3720288992 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7fedf00b5360 0x7fedf00b7820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:32:37.080 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:36.986+0000 7fee04f01640 1 --2- 172.21.15.19:0/3509598633 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ffea6b4da0 0x55ffea6c07f0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fedf4009c20 tx=0x7fedf4011810 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2c6db241f9edfdf3 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:32:37.080 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:36.986+0000 7fedfdffb640 1 -- 172.21.15.19:0/3720288992 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8327+0+0 (secure 0 0 0) 0x7fedec0e55d0 con 0x7fee001076a0 2024-09-10T22:32:37.080 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:36.986+0000 7fedeaffd640 1 -- 172.21.15.19:0/3509598633 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fedf401e070 con 0x55ffea6b4da0 2024-09-10T22:32:37.081 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:36.986+0000 7fedeaffd640 1 -- 172.21.15.19:0/3509598633 <== mon.2 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fedf4009dd0 con 0x55ffea6b4da0 2024-09-10T22:32:37.081 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:36.986+0000 7fedeaffd640 1 -- 172.21.15.19:0/3509598633 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fedf40187d0 con 0x55ffea6b4da0 2024-09-10T22:32:37.081 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:36.987+0000 7fee05702640 1 --2- 172.21.15.19:0/3720288992 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7fedf00b5360 0x7fedf00b7820 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7fedf802f500 tx=0x7fedf8005f50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:32:37.081 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:36.987+0000 7fee0953a740 1 -- 172.21.15.19:0/3509598633 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ffea6b4da0 msgr2=0x55ffea6c07f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:32:37.081 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:36.987+0000 7fee0953a740 1 --2- 172.21.15.19:0/3509598633 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ffea6b4da0 0x55ffea6c07f0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fedf4009c20 tx=0x7fedf4011810 comp rx=0 tx=0).stop 2024-09-10T22:32:37.081 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:36.987+0000 7fee0953a740 1 -- 172.21.15.19:0/3509598633 shutdown_connections 2024-09-10T22:32:37.081 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:36.987+0000 7fee0953a740 1 --2- 172.21.15.19:0/3509598633 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55ffea6c0d30 0x55ffea6c3120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:32:37.081 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:36.987+0000 7fee0953a740 1 --2- 172.21.15.19:0/3509598633 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ffea6b4da0 0x55ffea6c07f0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:32:37.081 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:36.987+0000 7fee0953a740 1 --2- 172.21.15.19:0/3509598633 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ffea6b4480 0x55ffea6b4860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:32:37.081 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:36.987+0000 7fee0953a740 1 -- 172.21.15.19:0/3509598633 >> 172.21.15.19:0/3509598633 conn(0x55ffea6b22b0 msgr2=0x55ffea6b3450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:32:37.081 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:36.987+0000 7fee0953a740 1 -- 172.21.15.19:0/3509598633 shutdown_connections 2024-09-10T22:32:37.081 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:36.987+0000 7fee0953a740 1 -- 172.21.15.19:0/3509598633 wait complete. 2024-09-10T22:32:37.081 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:36.988+0000 7fee0953a740 1 -- start start 2024-09-10T22:32:37.082 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:36.988+0000 7fee0953a740 1 Processor -- start 2024-09-10T22:32:37.082 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:36.988+0000 7fee0953a740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55ffea6b4480 0x55ffea6c05d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:32:37.082 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:36.988+0000 7fee0953a740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ffea6b4da0 0x55ffea6bda20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:32:37.082 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:36.988+0000 7fee0953a740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ffea6c0d30 0x55ffea6bdfe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:32:37.082 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:36.988+0000 7fee0953a740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x55ffea47b700 con 0x55ffea6c0d30 2024-09-10T22:32:37.082 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:36.988+0000 7fee0953a740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55ffea5b5110 con 0x55ffea6b4da0 2024-09-10T22:32:37.082 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:36.988+0000 7fee0953a740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x55ffea6c39b0 con 0x55ffea6b4480 2024-09-10T22:32:37.082 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:36.988+0000 7fee0953a740 10 client.0 _ll_register_callbacks cb 0x55ffea5ce990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T22:32:37.082 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:36.988+0000 7fee05702640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ffea6c0d30 0x55ffea6bdfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:32:37.082 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:36.988+0000 7fee04f01640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55ffea6b4480 0x55ffea6c05d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:32:37.082 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:36.988+0000 7fedfffff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ffea6b4da0 0x55ffea6bda20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:32:37.082 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:36.988+0000 7fedfffff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ffea6b4da0 0x55ffea6bda20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.19:54226/0 (socket says 172.21.15.19:54226) 2024-09-10T22:32:37.082 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:36.988+0000 7fee04f01640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55ffea6b4480 0x55ffea6c05d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.19:39656/0 (socket says 172.21.15.19:39656) 2024-09-10T22:32:37.083 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:36.988+0000 7fedfffff640 1 -- 172.21.15.19:0/707770337 learned_addr learned my addr 172.21.15.19:0/707770337 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:32:37.083 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:36.989+0000 7fedfffff640 1 -- 172.21.15.19:0/707770337 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55ffea6b4480 msgr2=0x55ffea6c05d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:32:37.083 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:36.989+0000 7fedfffff640 1 --2- 172.21.15.19:0/707770337 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55ffea6b4480 0x55ffea6c05d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:32:37.083 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:36.989+0000 7fedfffff640 1 -- 172.21.15.19:0/707770337 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ffea6c0d30 msgr2=0x55ffea6bdfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:32:37.083 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:36.989+0000 7fedfffff640 1 --2- 172.21.15.19:0/707770337 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ffea6c0d30 0x55ffea6bdfe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:32:37.083 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:36.989+0000 7fedfffff640 1 -- 172.21.15.19:0/707770337 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ffea5e2c40 con 0x55ffea6b4da0 2024-09-10T22:32:37.083 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:36.989+0000 7fedfffff640 1 --2- 172.21.15.19:0/707770337 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ffea6b4da0 0x55ffea6bda20 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fedec0a8fa0 tx=0x7fedec0ab560 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a6d035acc3a9401 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:32:37.083 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:36.989+0000 7feddffff640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-09-10T22:32:37.083 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:36.989+0000 7feddffff640 1 -- 172.21.15.19:0/707770337 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fedec0abd30 con 0x55ffea6b4da0 2024-09-10T22:32:37.083 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:36.989+0000 7feddffff640 1 -- 172.21.15.19:0/707770337 <== mon.2 v2:172.21.15.135:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8327+0+0 (secure 0 0 0) 0x7fedec0a7fa0 con 0x55ffea6b4da0 2024-09-10T22:32:37.083 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:36.989+0000 7fee0953a740 1 -- 172.21.15.19:0/707770337 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fedf4009dd0 con 0x55ffea6b4da0 2024-09-10T22:32:37.083 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:36.989+0000 7feddffff640 1 -- 172.21.15.19:0/707770337 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fedec0b0810 con 0x55ffea6b4da0 2024-09-10T22:32:37.084 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:36.989+0000 7fee0953a740 10 client.26039 fetch_fsmap learned FSMap version 27 2024-09-10T22:32:37.084 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:36.989+0000 7fee0953a740 1 -- 172.21.15.19:0/707770337 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55ffea6cf240 con 0x55ffea6b4da0 2024-09-10T22:32:37.084 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:36.989+0000 7feddffff640 1 -- 172.21.15.19:0/707770337 <== mon.2 v2:172.21.15.135:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fedf4009dd0 con 0x55ffea6b4da0 2024-09-10T22:32:37.084 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:36.990+0000 7feddffff640 1 -- 172.21.15.19:0/707770337 <== mon.2 v2:172.21.15.135:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7fedec0aaf90 con 0x55ffea6b4da0 2024-09-10T22:32:37.084 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:36.990+0000 7fee0953a740 10 client.26039 fetch_fsmap finished waiting for FSMap version 27 2024-09-10T22:32:37.084 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:36.990+0000 7fee0953a740 10 client.26039 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-10T22:32:37.084 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:36.990+0000 7fee0953a740 20 client.26039 populate_metadata read hostname 'smithi019' 2024-09-10T22:32:37.084 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:36.990+0000 7fee0953a740 1 --2- 172.21.15.19:0/707770337 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x55ffea6d0700 0x55ffea6d2b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:32:37.084 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:36.990+0000 7fee0953a740 4 client.26039 mds_command: new command op to 24581 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T22:32:37.084 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:36.990+0000 7fee0953a740 1 -- 172.21.15.19:0/707770337 --> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ffea62cda0 con 0x55ffea6d0700 2024-09-10T22:32:37.084 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:36.990+0000 7fee04f01640 1 --2- 172.21.15.19:0/707770337 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x55ffea6d0700 0x55ffea6d2b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:32:37.084 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:36.990+0000 7feddffff640 10 client.26039 ms_handle_connect on v2:172.21.15.135:6838/1254769802 2024-09-10T22:32:37.085 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:36.990+0000 7fee04f01640 1 --2- 172.21.15.19:0/707770337 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x55ffea6d0700 0x55ffea6d2b10 crc :-1 s=READY pgs=138 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=86336cf39ba06e16 server_cookie=94d360c0af9f1efe in_seq=0 out_seq=0 2024-09-10T22:32:37.085 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:36.991+0000 7feddffff640 1 -- 172.21.15.19:0/707770337 <== mds.0 v2:172.21.15.135:6838/1254769802 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55ffea62cda0 con 0x55ffea6d0700 2024-09-10T22:32:37.085 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:36.991+0000 7feddffff640 10 client.26039 handle_command_reply: tid=0 2024-09-10T22:32:37.085 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:36.991+0000 7fee0953a740 1 client.26039 shutdown 2024-09-10T22:32:37.085 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:36.991+0000 7fee0953a740 1 -- 172.21.15.19:0/707770337 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ffea6b4da0 msgr2=0x55ffea6bda20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:32:37.085 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:36.991+0000 7fee0953a740 1 --2- 172.21.15.19:0/707770337 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ffea6b4da0 0x55ffea6bda20 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fedec0a8fa0 tx=0x7fedec0ab560 comp rx=0 tx=0).stop 2024-09-10T22:32:37.085 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:36.991+0000 7fee0953a740 1 -- 172.21.15.19:0/707770337 shutdown_connections 2024-09-10T22:32:37.085 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:36.991+0000 7fee0953a740 1 --2- 172.21.15.19:0/707770337 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ffea6c0d30 0x55ffea6bdfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:32:37.085 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:36.991+0000 7fee0953a740 1 --2- 172.21.15.19:0/707770337 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ffea6b4da0 0x55ffea6bda20 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:32:37.085 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:36.991+0000 7fee0953a740 1 --2- 172.21.15.19:0/707770337 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x55ffea6d0700 0x55ffea6d2b10 crc :-1 s=READY pgs=138 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:32:37.085 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:36.991+0000 7fee0953a740 1 --2- 172.21.15.19:0/707770337 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55ffea6b4480 0x55ffea6c05d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:32:37.085 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:36.991+0000 7feddffff640 0 client.26039 ms_handle_reset on v2:172.21.15.135:6838/1254769802 2024-09-10T22:32:37.085 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:36.991+0000 7fee0953a740 1 -- 172.21.15.19:0/707770337 >> 172.21.15.19:0/707770337 conn(0x55ffea6b22b0 msgr2=0x55ffea6b7e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:32:37.086 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:36.991+0000 7fee0953a740 1 -- 172.21.15.19:0/707770337 shutdown_connections 2024-09-10T22:32:37.086 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:36.991+0000 7fee0953a740 1 -- 172.21.15.19:0/707770337 wait complete. 2024-09-10T22:32:37.086 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:36.992+0000 7fee0953a740 20 client.26039 trim_cache size 0 max 16384 2024-09-10T22:32:37.086 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:37.011+0000 7fee0953a740 1 Processor -- start 2024-09-10T22:32:37.086 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:37.011+0000 7fee0953a740 1 -- start start 2024-09-10T22:32:37.086 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:37.011+0000 7fee0953a740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55ffea6b4480 0x55ffea6ccc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:32:37.086 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:37.011+0000 7fee0953a740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ffea6b4da0 0x55ffea6b7bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:32:37.086 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:37.011+0000 7fee0953a740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ffea6c0d30 0x55ffea6b8130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:32:37.086 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:37.011+0000 7fee0953a740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fee001b0e30 con 0x55ffea6b4da0 2024-09-10T22:32:37.086 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:37.011+0000 7fee0953a740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fee001ae700 con 0x55ffea6c0d30 2024-09-10T22:32:37.086 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:37.011+0000 7fee0953a740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7fee001ac550 con 0x55ffea6b4480 2024-09-10T22:32:37.086 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:37.011+0000 7fedfffff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ffea6b4da0 0x55ffea6b7bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:32:37.086 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:37.011+0000 7fee05702640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ffea6c0d30 0x55ffea6b8130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:32:37.087 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:37.011+0000 7fee05702640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ffea6c0d30 0x55ffea6b8130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.19:54236/0 (socket says 172.21.15.19:54236) 2024-09-10T22:32:37.087 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:37.011+0000 7fee05702640 1 -- 172.21.15.19:0/1516344785 learned_addr learned my addr 172.21.15.19:0/1516344785 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:32:37.087 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:37.011+0000 7fedfffff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ffea6b4da0 0x55ffea6b7bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:44988/0 (socket says 172.21.15.19:44988) 2024-09-10T22:32:37.087 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:37.011+0000 7fee04f01640 1 --2- 172.21.15.19:0/1516344785 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55ffea6b4480 0x55ffea6ccc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:32:37.087 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:37.011+0000 7fedfffff640 1 -- 172.21.15.19:0/1516344785 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55ffea6b4480 msgr2=0x55ffea6ccc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:32:37.087 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:37.011+0000 7fedfffff640 1 --2- 172.21.15.19:0/1516344785 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55ffea6b4480 0x55ffea6ccc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:32:37.087 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:37.011+0000 7fedfffff640 1 -- 172.21.15.19:0/1516344785 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ffea6c0d30 msgr2=0x55ffea6b8130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:32:37.087 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:37.011+0000 7fedfffff640 1 --2- 172.21.15.19:0/1516344785 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ffea6c0d30 0x55ffea6b8130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:32:37.087 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:37.011+0000 7fedfffff640 1 -- 172.21.15.19:0/1516344785 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ffea6b2d30 con 0x55ffea6b4da0 2024-09-10T22:32:37.087 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:37.011+0000 7fee05702640 1 --2- 172.21.15.19:0/1516344785 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ffea6c0d30 0x55ffea6b8130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T22:32:37.087 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:37.012+0000 7fedfffff640 1 --2- 172.21.15.19:0/1516344785 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ffea6b4da0 0x55ffea6b7bf0 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7fedec0e30c0 tx=0x7fedec0ac570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=447084bfdc75aaa7 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:32:37.087 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:37.012+0000 7fedea7fc640 1 -- 172.21.15.19:0/1516344785 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fedec0abd30 con 0x55ffea6b4da0 2024-09-10T22:32:37.087 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:37.012+0000 7fedea7fc640 1 -- 172.21.15.19:0/1516344785 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fedec0b52c0 con 0x55ffea6b4da0 2024-09-10T22:32:37.087 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:37.012+0000 7fedea7fc640 1 -- 172.21.15.19:0/1516344785 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fedec0ab680 con 0x55ffea6b4da0 2024-09-10T22:32:37.088 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:37.013+0000 7fee0953a740 1 -- 172.21.15.19:0/1516344785 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ffea6b4da0 msgr2=0x55ffea6b7bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:32:37.088 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:37.013+0000 7fee0953a740 1 --2- 172.21.15.19:0/1516344785 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ffea6b4da0 0x55ffea6b7bf0 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7fedec0e30c0 tx=0x7fedec0ac570 comp rx=0 tx=0).stop 2024-09-10T22:32:37.088 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:37.013+0000 7fee0953a740 1 -- 172.21.15.19:0/1516344785 shutdown_connections 2024-09-10T22:32:37.088 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:37.013+0000 7fee0953a740 1 --2- 172.21.15.19:0/1516344785 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ffea6c0d30 0x55ffea6b8130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:32:37.088 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:37.013+0000 7fee0953a740 1 --2- 172.21.15.19:0/1516344785 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ffea6b4da0 0x55ffea6b7bf0 unknown :-1 s=CLOSED pgs=668 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:32:37.088 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:37.013+0000 7fee0953a740 1 --2- 172.21.15.19:0/1516344785 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55ffea6b4480 0x55ffea6ccc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:32:37.088 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:37.013+0000 7fee0953a740 1 -- 172.21.15.19:0/1516344785 >> 172.21.15.19:0/1516344785 conn(0x55ffea6b22b0 msgr2=0x55ffea6b74e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:32:37.088 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:37.013+0000 7fee0953a740 1 -- 172.21.15.19:0/1516344785 shutdown_connections 2024-09-10T22:32:37.088 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:37.013+0000 7fee0953a740 1 -- 172.21.15.19:0/1516344785 wait complete. 2024-09-10T22:32:37.088 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:37.013+0000 7fee0953a740 1 -- start start 2024-09-10T22:32:37.088 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:37.013+0000 7fee0953a740 1 Processor -- start 2024-09-10T22:32:37.088 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:37.014+0000 7fee0953a740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ffea6b4480 0x55ffea6c95a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:32:37.088 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:37.014+0000 7fee0953a740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ffea6b4da0 0x55ffea6c3c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:32:37.089 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:37.014+0000 7fee0953a740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55ffea6c0d30 0x55ffea6c4300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:32:37.089 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:37.014+0000 7fee0953a740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fee001acbc0 con 0x55ffea6b4480 2024-09-10T22:32:37.089 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:37.014+0000 7fee0953a740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fee001ae030 con 0x55ffea6b4da0 2024-09-10T22:32:37.089 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:37.014+0000 7fee0953a740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7fee001ad290 con 0x55ffea6c0d30 2024-09-10T22:32:37.089 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:37.014+0000 7fee0953a740 10 client.0 _ll_register_callbacks cb 0x7fedec0046c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T22:32:37.089 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:37.014+0000 7fee04f01640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ffea6b4480 0x55ffea6c95a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:32:37.089 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:37.014+0000 7fee04f01640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ffea6b4480 0x55ffea6c95a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:44990/0 (socket says 172.21.15.19:44990) 2024-09-10T22:32:37.089 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:37.014+0000 7fee04f01640 1 -- 172.21.15.19:0/537319472 learned_addr learned my addr 172.21.15.19:0/537319472 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:32:37.089 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:37.014+0000 7fedfffff640 1 --2- 172.21.15.19:0/537319472 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ffea6b4da0 0x55ffea6c3c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:32:37.089 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:37.014+0000 7fee05702640 1 --2- 172.21.15.19:0/537319472 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55ffea6c0d30 0x55ffea6c4300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:32:37.089 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:37.014+0000 7fee04f01640 1 -- 172.21.15.19:0/537319472 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55ffea6c0d30 msgr2=0x55ffea6c4300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:32:37.089 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:37.014+0000 7fee04f01640 1 --2- 172.21.15.19:0/537319472 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55ffea6c0d30 0x55ffea6c4300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:32:37.090 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:37.014+0000 7fee04f01640 1 -- 172.21.15.19:0/537319472 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ffea6b4da0 msgr2=0x55ffea6c3c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:32:37.090 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:37.014+0000 7fee04f01640 1 --2- 172.21.15.19:0/537319472 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ffea6b4da0 0x55ffea6c3c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:32:37.090 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:37.014+0000 7fee04f01640 1 -- 172.21.15.19:0/537319472 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ffea73d5e0 con 0x55ffea6b4480 2024-09-10T22:32:37.090 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:37.014+0000 7fedfffff640 1 --2- 172.21.15.19:0/537319472 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ffea6b4da0 0x55ffea6c3c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T22:32:37.090 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:37.014+0000 7fee04f01640 1 --2- 172.21.15.19:0/537319472 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ffea6b4480 0x55ffea6c95a0 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7fedf4009b40 tx=0x7fedf4009520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=14156208bf5947db server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:32:37.090 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:37.014+0000 7feddffff640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-10T22:32:37.090 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:37.014+0000 7feddffff640 1 -- 172.21.15.19:0/537319472 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fedf401e040 con 0x55ffea6b4480 2024-09-10T22:32:37.090 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:37.015+0000 7feddffff640 1 -- 172.21.15.19:0/537319472 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8327+0+0 (secure 0 0 0) 0x7fedf4005330 con 0x55ffea6b4480 2024-09-10T22:32:37.090 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:37.015+0000 7fee0953a740 1 -- 172.21.15.19:0/537319472 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fedec0b52c0 con 0x55ffea6b4480 2024-09-10T22:32:37.090 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:37.015+0000 7feddffff640 1 -- 172.21.15.19:0/537319472 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fedf4005530 con 0x55ffea6b4480 2024-09-10T22:32:37.090 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:37.015+0000 7fee0953a740 10 client.16632 fetch_fsmap learned FSMap version 27 2024-09-10T22:32:37.090 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:37.015+0000 7fee0953a740 1 -- 172.21.15.19:0/537319472 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55ffea73e7f0 con 0x55ffea6b4480 2024-09-10T22:32:37.090 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:37.015+0000 7feddffff640 1 -- 172.21.15.19:0/537319472 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fedec0b52c0 con 0x55ffea6b4480 2024-09-10T22:32:37.091 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:37.015+0000 7feddffff640 1 -- 172.21.15.19:0/537319472 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7fedf40035f0 con 0x55ffea6b4480 2024-09-10T22:32:37.091 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:37.015+0000 7fee0953a740 10 client.16632 fetch_fsmap finished waiting for FSMap version 27 2024-09-10T22:32:37.091 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:37.015+0000 7fee0953a740 10 client.16632 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-10T22:32:37.091 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:37.015+0000 7fee0953a740 20 client.16632 populate_metadata read hostname 'smithi019' 2024-09-10T22:32:37.091 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:37.015+0000 7fee0953a740 1 --2- 172.21.15.19:0/537319472 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x55ffea73ecc0 0x55ffea7410b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:32:37.091 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:37.015+0000 7fee0953a740 4 client.16632 mds_command: new command op to 24581 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-10T22:32:37.091 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:37.015+0000 7fee0953a740 1 -- 172.21.15.19:0/537319472 --> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55ffea628850 con 0x55ffea73ecc0 2024-09-10T22:32:37.091 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:37.015+0000 7fedfffff640 1 --2- 172.21.15.19:0/537319472 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x55ffea73ecc0 0x55ffea7410b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:32:37.091 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:37.016+0000 7fedfffff640 1 --2- 172.21.15.19:0/537319472 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x55ffea73ecc0 0x55ffea7410b0 crc :-1 s=READY pgs=139 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9e79c5721f3f18b3 server_cookie=346a34f8ffcf740a in_seq=0 out_seq=0 2024-09-10T22:32:37.091 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:37.016+0000 7feddffff640 10 client.16632 ms_handle_connect on v2:172.21.15.135:6838/1254769802 2024-09-10T22:32:37.091 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:37.016+0000 7feddffff640 1 -- 172.21.15.19:0/537319472 <== mds.0 v2:172.21.15.135:6838/1254769802 1 ==== command_reply(tid 0: 0 ) ==== 8+0+2842 (crc 0 0 0) 0x55ffea628850 con 0x55ffea73ecc0 2024-09-10T22:32:37.091 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:37.016+0000 7feddffff640 10 client.16632 handle_command_reply: tid=0 2024-09-10T22:32:37.091 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:37.016+0000 7fee0953a740 1 client.16632 shutdown 2024-09-10T22:32:37.091 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:37.016+0000 7fee0953a740 1 -- 172.21.15.19:0/537319472 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ffea6b4480 msgr2=0x55ffea6c95a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:32:37.092 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:37.016+0000 7fee0953a740 1 --2- 172.21.15.19:0/537319472 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ffea6b4480 0x55ffea6c95a0 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7fedf4009b40 tx=0x7fedf4009520 comp rx=0 tx=0).stop 2024-09-10T22:32:37.092 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:37.016+0000 7fee0953a740 1 -- 172.21.15.19:0/537319472 shutdown_connections 2024-09-10T22:32:37.092 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:37.016+0000 7fee0953a740 1 --2- 172.21.15.19:0/537319472 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x55ffea73ecc0 0x55ffea7410b0 crc :-1 s=READY pgs=139 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:32:37.092 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:37.016+0000 7fee0953a740 1 --2- 172.21.15.19:0/537319472 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55ffea6c0d30 0x55ffea6c4300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:32:37.092 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:37.016+0000 7fee0953a740 1 --2- 172.21.15.19:0/537319472 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ffea6b4da0 0x55ffea6c3c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:32:37.092 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:37.016+0000 7feddffff640 0 client.16632 ms_handle_reset on v2:172.21.15.135:6838/1254769802 2024-09-10T22:32:37.092 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:37.016+0000 7fee0953a740 1 --2- 172.21.15.19:0/537319472 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ffea6b4480 0x55ffea6c95a0 unknown :-1 s=CLOSED pgs=669 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:32:37.092 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:37.016+0000 7fee0953a740 1 -- 172.21.15.19:0/537319472 >> 172.21.15.19:0/537319472 conn(0x55ffea6b22b0 msgr2=0x55ffea6b7d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:32:37.092 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:37.016+0000 7fee0953a740 1 -- 172.21.15.19:0/537319472 shutdown_connections 2024-09-10T22:32:37.092 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:37.016+0000 7fee0953a740 1 -- 172.21.15.19:0/537319472 wait complete. 2024-09-10T22:32:37.092 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:37.016+0000 7fee0953a740 20 client.16632 trim_cache size 0 max 16384 2024-09-10T22:32:37.093 INFO:teuthology.orchestra.run.smithi019.stdout:{ 2024-09-10T22:32:37.093 INFO:teuthology.orchestra.run.smithi019.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-10T22:32:37.093 INFO:teuthology.orchestra.run.smithi019.stdout: "scrubs": { 2024-09-10T22:32:37.093 INFO:teuthology.orchestra.run.smithi019.stdout: "4c99964e-2e0e-4ffd-8cb8-99c4979ed90f": { 2024-09-10T22:32:37.093 INFO:teuthology.orchestra.run.smithi019.stdout: "path": "/", 2024-09-10T22:32:37.093 INFO:teuthology.orchestra.run.smithi019.stdout: "tag": "4c99964e-2e0e-4ffd-8cb8-99c4979ed90f", 2024-09-10T22:32:37.093 INFO:teuthology.orchestra.run.smithi019.stdout: "options": "recursive,force" 2024-09-10T22:32:37.093 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-10T22:32:37.093 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:32:37.093 INFO:teuthology.orchestra.run.smithi019.stdout: "scrub_stats": { 2024-09-10T22:32:37.093 INFO:teuthology.orchestra.run.smithi019.stdout: "0b81ea61-0b8e-4f2c-a58f-ef1019289fc9": { 2024-09-10T22:32:37.094 INFO:teuthology.orchestra.run.smithi019.stdout: "start_time": "2024-09-10T22:31:48.141568+0000", 2024-09-10T22:32:37.094 INFO:teuthology.orchestra.run.smithi019.stdout: "path": "/", 2024-09-10T22:32:37.094 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_started": 0, 2024-09-10T22:32:37.094 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_passed": 0, 2024-09-10T22:32:37.094 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_failed": 0, 2024-09-10T22:32:37.094 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_skipped": 0 2024-09-10T22:32:37.094 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:32:37.094 INFO:teuthology.orchestra.run.smithi019.stdout: "715ec863-8a9d-45b6-967f-59b15ce1bf12": { 2024-09-10T22:32:37.095 INFO:teuthology.orchestra.run.smithi019.stdout: "start_time": "2024-09-10T22:31:00.669516+0000", 2024-09-10T22:32:37.095 INFO:teuthology.orchestra.run.smithi019.stdout: "path": "/", 2024-09-10T22:32:37.095 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_started": 0, 2024-09-10T22:32:37.095 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_passed": 0, 2024-09-10T22:32:37.095 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_failed": 0, 2024-09-10T22:32:37.095 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_skipped": 0 2024-09-10T22:32:37.095 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:32:37.095 INFO:teuthology.orchestra.run.smithi019.stdout: "fd1f1837-dcfa-4d88-99e8-2509f36c3f98": { 2024-09-10T22:32:37.095 INFO:teuthology.orchestra.run.smithi019.stdout: "start_time": "2024-09-10T22:30:12.470477+0000", 2024-09-10T22:32:37.095 INFO:teuthology.orchestra.run.smithi019.stdout: "path": "/", 2024-09-10T22:32:37.095 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_started": 0, 2024-09-10T22:32:37.095 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_passed": 0, 2024-09-10T22:32:37.096 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_failed": 0, 2024-09-10T22:32:37.096 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_skipped": 0 2024-09-10T22:32:37.096 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:32:37.096 INFO:teuthology.orchestra.run.smithi019.stdout: "8f3bb3bf-911f-490c-9856-c80ea220dbbe": { 2024-09-10T22:32:37.096 INFO:teuthology.orchestra.run.smithi019.stdout: "start_time": "2024-09-10T22:29:25.374415+0000", 2024-09-10T22:32:37.096 INFO:teuthology.orchestra.run.smithi019.stdout: "path": "/", 2024-09-10T22:32:37.096 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_started": 0, 2024-09-10T22:32:37.096 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_passed": 0, 2024-09-10T22:32:37.096 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_failed": 0, 2024-09-10T22:32:37.096 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_skipped": 0 2024-09-10T22:32:37.096 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:32:37.096 INFO:teuthology.orchestra.run.smithi019.stdout: "eb518e3c-a71e-4f32-9ca0-ae88930ca218": { 2024-09-10T22:32:37.096 INFO:teuthology.orchestra.run.smithi019.stdout: "start_time": "2024-09-10T22:28:38.366352+0000", 2024-09-10T22:32:37.097 INFO:teuthology.orchestra.run.smithi019.stdout: "path": "/", 2024-09-10T22:32:37.097 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_started": 0, 2024-09-10T22:32:37.097 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_passed": 0, 2024-09-10T22:32:37.097 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_failed": 0, 2024-09-10T22:32:37.097 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_skipped": 0 2024-09-10T22:32:37.097 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:32:37.097 INFO:teuthology.orchestra.run.smithi019.stdout: "4c99964e-2e0e-4ffd-8cb8-99c4979ed90f": { 2024-09-10T22:32:37.097 INFO:teuthology.orchestra.run.smithi019.stdout: "start_time": "2024-09-10T22:32:34.659639+0000", 2024-09-10T22:32:37.097 INFO:teuthology.orchestra.run.smithi019.stdout: "path": "/", 2024-09-10T22:32:37.097 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_started": 0, 2024-09-10T22:32:37.097 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_passed": 0, 2024-09-10T22:32:37.097 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_failed": 0, 2024-09-10T22:32:37.097 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_skipped": 0 2024-09-10T22:32:37.098 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:32:37.098 INFO:teuthology.orchestra.run.smithi019.stdout: "c12c2a04-dcd6-4673-a98e-93f665d3f5d7": { 2024-09-10T22:32:37.098 INFO:teuthology.orchestra.run.smithi019.stdout: "start_time": "2024-09-10T22:27:49.392329+0000", 2024-09-10T22:32:37.098 INFO:teuthology.orchestra.run.smithi019.stdout: "path": "/", 2024-09-10T22:32:37.098 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_started": 0, 2024-09-10T22:32:37.098 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_passed": 0, 2024-09-10T22:32:37.098 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_failed": 0, 2024-09-10T22:32:37.098 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_skipped": 0 2024-09-10T22:32:37.098 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:32:37.098 INFO:teuthology.orchestra.run.smithi019.stdout: "b38852c8-478a-42ef-8384-b2c55d5313a4": { 2024-09-10T22:32:37.099 INFO:teuthology.orchestra.run.smithi019.stdout: "start_time": "2024-09-10T22:27:00.320308+0000", 2024-09-10T22:32:37.099 INFO:teuthology.orchestra.run.smithi019.stdout: "path": "/", 2024-09-10T22:32:37.099 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_started": 0, 2024-09-10T22:32:37.099 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_passed": 0, 2024-09-10T22:32:37.099 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_failed": 0, 2024-09-10T22:32:37.099 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_skipped": 0 2024-09-10T22:32:37.099 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:32:37.099 INFO:teuthology.orchestra.run.smithi019.stdout: "9b6bfdee-303c-4c12-af56-dc85860d112a": { 2024-09-10T22:32:37.099 INFO:teuthology.orchestra.run.smithi019.stdout: "start_time": "2024-09-10T22:26:17.484162+0000", 2024-09-10T22:32:37.099 INFO:teuthology.orchestra.run.smithi019.stdout: "path": "/", 2024-09-10T22:32:37.099 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_started": 0, 2024-09-10T22:32:37.099 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_passed": 0, 2024-09-10T22:32:37.099 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_failed": 0, 2024-09-10T22:32:37.100 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_skipped": 0 2024-09-10T22:32:37.100 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-10T22:32:37.100 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-10T22:32:37.100 INFO:teuthology.orchestra.run.smithi019.stdout:} 2024-09-10T22:32:37.100 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:37.017+0000 7fee07165640 1 -- 172.21.15.19:0/3720288992 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7fedf00b5360 msgr2=0x7fedf00b7820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:32:37.100 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:37.017+0000 7fee07165640 1 --2- 172.21.15.19:0/3720288992 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7fedf00b5360 0x7fedf00b7820 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7fedf802f500 tx=0x7fedf8005f50 comp rx=0 tx=0).stop 2024-09-10T22:32:37.100 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:37.017+0000 7fee07165640 1 -- 172.21.15.19:0/3720288992 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fee001076a0 msgr2=0x7fee00199770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:32:37.100 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:37.017+0000 7fee07165640 1 --2- 172.21.15.19:0/3720288992 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fee001076a0 0x7fee00199770 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7fedec00d950 tx=0x7fedec00de10 comp rx=0 tx=0).stop 2024-09-10T22:32:37.100 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:37.017+0000 7fee07165640 1 -- 172.21.15.19:0/3720288992 shutdown_connections 2024-09-10T22:32:37.100 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:37.017+0000 7fee07165640 1 --2- 172.21.15.19:0/3720288992 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7fedf00b5360 0x7fedf00b7820 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:32:37.100 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:37.017+0000 7fee07165640 1 --2- 172.21.15.19:0/3720288992 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fee00108020 0x7fee0019eb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:32:37.101 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:37.017+0000 7fee07165640 1 --2- 172.21.15.19:0/3720288992 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fee001076a0 0x7fee00199770 unknown :-1 s=CLOSED pgs=667 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:32:37.101 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:37.017+0000 7fee07165640 1 --2- 172.21.15.19:0/3720288992 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fee00101c90 0x7fee00199230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:32:37.101 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:37.017+0000 7fee07165640 1 -- 172.21.15.19:0/3720288992 >> 172.21.15.19:0/3720288992 conn(0x7fee000fd700 msgr2=0x7fee0006ad90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:32:37.101 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:37.017+0000 7fee07165640 1 -- 172.21.15.19:0/3720288992 shutdown_connections 2024-09-10T22:32:37.101 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:32:37.017+0000 7fee07165640 1 -- 172.21.15.19:0/3720288992 wait complete. 2024-09-10T22:32:38.292 INFO:tasks.cephfs.filesystem:scrub status for tag:4c99964e-2e0e-4ffd-8cb8-99c4979ed90f - {'path': '/', 'tag': '4c99964e-2e0e-4ffd-8cb8-99c4979ed90f', 'options': 'recursive,force'} 2024-09-10T22:32:38.609 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:32:38 smithi135 ceph-mon[34789]: pgmap v533: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 530 KiB/s rd, 356 MiB/s wr, 225 op/s 2024-09-10T22:32:38.625 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:32:38 smithi138 ceph-mon[35236]: pgmap v533: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 530 KiB/s rd, 356 MiB/s wr, 225 op/s 2024-09-10T22:32:38.709 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:32:38 smithi019 ceph-mon[31375]: pgmap v533: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 530 KiB/s rd, 356 MiB/s wr, 225 op/s 2024-09-10T22:32:39.609 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:32:39 smithi135 ceph-mon[34789]: pgmap v534: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 688 KiB/s rd, 316 MiB/s wr, 230 op/s 2024-09-10T22:32:39.625 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:32:39 smithi138 ceph-mon[35236]: pgmap v534: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 688 KiB/s rd, 316 MiB/s wr, 230 op/s 2024-09-10T22:32:39.708 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:32:39 smithi019 ceph-mon[31375]: pgmap v534: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 688 KiB/s rd, 316 MiB/s wr, 230 op/s 2024-09-10T22:32:41.875 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:32:41 smithi138 ceph-mon[35236]: pgmap v535: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 769 KiB/s rd, 355 MiB/s wr, 328 op/s 2024-09-10T22:32:41.875 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:32:41 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T22:32:41.959 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:32:41 smithi019 ceph-mon[31375]: pgmap v535: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 769 KiB/s rd, 355 MiB/s wr, 328 op/s 2024-09-10T22:32:41.960 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:32:41 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T22:32:42.110 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:32:41 smithi135 ceph-mon[34789]: pgmap v535: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 769 KiB/s rd, 355 MiB/s wr, 328 op/s 2024-09-10T22:32:42.110 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:32:41 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T22:32:42.959 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:32:42 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T22:32:42.959 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:32:42 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T22:32:42.959 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:32:42 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:32:42.959 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:32:42 smithi019 ceph-mon[31375]: scrub summary: idle 2024-09-10T22:32:42.959 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:32:42 smithi019 ceph-mon[31375]: scrub summary: idle 2024-09-10T22:32:43.110 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:32:42 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T22:32:43.110 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:32:42 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T22:32:43.110 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:32:42 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:32:43.110 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:32:42 smithi135 ceph-mon[34789]: scrub summary: idle 2024-09-10T22:32:43.110 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:32:42 smithi135 ceph-mon[34789]: scrub summary: idle 2024-09-10T22:32:43.125 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:32:42 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T22:32:43.125 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:32:42 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T22:32:43.125 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:32:42 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:32:43.125 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:32:42 smithi138 ceph-mon[35236]: scrub summary: idle 2024-09-10T22:32:43.125 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:32:42 smithi138 ceph-mon[35236]: scrub summary: idle 2024-09-10T22:32:43.740 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:43.738+0000 7f00c0033640 1 -- 172.21.15.19:0/1757757521 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f00b8102980 msgr2=0x7f00b8102d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:32:43.740 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:43.738+0000 7f00c0033640 1 --2- 172.21.15.19:0/1757757521 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f00b8102980 0x7f00b8102d80 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7f00b4009930 tx=0x7f00b402a420 comp rx=0 tx=0).stop 2024-09-10T22:32:43.740 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:43.738+0000 7f00c0033640 1 -- 172.21.15.19:0/1757757521 shutdown_connections 2024-09-10T22:32:43.740 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:43.738+0000 7f00c0033640 1 --2- 172.21.15.19:0/1757757521 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f00b8104490 0x7f00b810ae10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:32:43.740 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:43.738+0000 7f00c0033640 1 --2- 172.21.15.19:0/1757757521 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f00b8103ad0 0x7f00b8103f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:32:43.740 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:43.738+0000 7f00c0033640 1 --2- 172.21.15.19:0/1757757521 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f00b8102980 0x7f00b8102d80 unknown :-1 s=CLOSED pgs=670 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:32:43.740 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:43.738+0000 7f00c0033640 1 -- 172.21.15.19:0/1757757521 >> 172.21.15.19:0/1757757521 conn(0x7f00b80fe240 msgr2=0x7f00b8100660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:32:43.740 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:43.738+0000 7f00c0033640 1 -- 172.21.15.19:0/1757757521 shutdown_connections 2024-09-10T22:32:43.741 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:43.738+0000 7f00c0033640 1 -- 172.21.15.19:0/1757757521 wait complete. 2024-09-10T22:32:43.741 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:43.739+0000 7f00c0033640 1 Processor -- start 2024-09-10T22:32:43.741 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:43.739+0000 7f00c0033640 1 -- start start 2024-09-10T22:32:43.741 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:43.739+0000 7f00c0033640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f00b8103ad0 0x7f00b8076d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:32:43.742 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:43.740+0000 7f00c0033640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f00b8104490 0x7f00b8075560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:32:43.742 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:43.740+0000 7f00c0033640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f00b819cbc0 0x7f00b8075aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:32:43.742 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:43.740+0000 7f00c0033640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f00b810e5f0 con 0x7f00b819cbc0 2024-09-10T22:32:43.742 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:43.740+0000 7f00c0033640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f00b810e470 con 0x7f00b8104490 2024-09-10T22:32:43.742 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:43.740+0000 7f00c0033640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f00b810e770 con 0x7f00b8103ad0 2024-09-10T22:32:43.742 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:43.740+0000 7f00be5d0640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f00b819cbc0 0x7f00b8075aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:32:43.742 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:43.740+0000 7f00be5d0640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f00b819cbc0 0x7f00b8075aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:58682/0 (socket says 172.21.15.19:58682) 2024-09-10T22:32:43.743 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:43.740+0000 7f00be5d0640 1 -- 172.21.15.19:0/3140299605 learned_addr learned my addr 172.21.15.19:0/3140299605 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:32:43.743 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:43.740+0000 7f00bddcf640 1 --2- 172.21.15.19:0/3140299605 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f00b8103ad0 0x7f00b8076d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:32:43.743 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:43.741+0000 7f00bddcf640 1 -- 172.21.15.19:0/3140299605 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f00b8104490 msgr2=0x7f00b8075560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:32:43.743 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:43.741+0000 7f00bddcf640 1 --2- 172.21.15.19:0/3140299605 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f00b8104490 0x7f00b8075560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:32:43.743 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:43.741+0000 7f00bddcf640 1 -- 172.21.15.19:0/3140299605 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f00b819cbc0 msgr2=0x7f00b8075aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:32:43.743 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:43.741+0000 7f00bddcf640 1 --2- 172.21.15.19:0/3140299605 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f00b819cbc0 0x7f00b8075aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:32:43.743 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:43.741+0000 7f00bddcf640 1 -- 172.21.15.19:0/3140299605 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f00b8076330 con 0x7f00b8103ad0 2024-09-10T22:32:43.744 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:43.742+0000 7f00bddcf640 1 --2- 172.21.15.19:0/3140299605 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f00b8103ad0 0x7f00b8076d00 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f00b4008000 tx=0x7f00b4004340 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:32:43.744 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:43.742+0000 7f00aeffd640 1 -- 172.21.15.19:0/3140299605 <== mon.1 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00b403f030 con 0x7f00b8103ad0 2024-09-10T22:32:43.744 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:43.742+0000 7f00aeffd640 1 -- 172.21.15.19:0/3140299605 <== mon.1 v2:172.21.15.138:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f00b4003cb0 con 0x7f00b8103ad0 2024-09-10T22:32:43.744 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:43.742+0000 7f00aeffd640 1 -- 172.21.15.19:0/3140299605 <== mon.1 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00b4035070 con 0x7f00b8103ad0 2024-09-10T22:32:43.744 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:43.742+0000 7f00c0033640 1 -- 172.21.15.19:0/3140299605 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f00b819d010 con 0x7f00b8103ad0 2024-09-10T22:32:43.744 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:43.742+0000 7f00c0033640 1 -- 172.21.15.19:0/3140299605 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f00b819d420 con 0x7f00b8103ad0 2024-09-10T22:32:43.749 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:43.747+0000 7f00c2e07740 1 Processor -- start 2024-09-10T22:32:43.749 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:43.748+0000 7f00c2e07740 1 -- start start 2024-09-10T22:32:43.752 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:43.748+0000 7f00c2e07740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a8918904e0 0x55a891895b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:32:43.752 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:43.748+0000 7f00c2e07740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55a8918960b0 0x55a8918984e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:32:43.752 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:43.748+0000 7f00c2e07740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55a891898bf0 0x55a89189b0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:32:43.752 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:43.749+0000 7f00c2e07740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x55a8918056f0 con 0x55a891898bf0 2024-09-10T22:32:43.752 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:43.749+0000 7f00c2e07740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55a8917f4b20 con 0x55a8918904e0 2024-09-10T22:32:43.752 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:43.749+0000 7f00c2e07740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x55a8917f8930 con 0x55a8918960b0 2024-09-10T22:32:43.752 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:43.749+0000 7f00bd5ce640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55a891898bf0 0x55a89189b0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:32:43.753 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:43.749+0000 7f00bd5ce640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55a891898bf0 0x55a89189b0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:58688/0 (socket says 172.21.15.19:58688) 2024-09-10T22:32:43.753 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:43.749+0000 7f00bd5ce640 1 -- 172.21.15.19:0/3324511059 learned_addr learned my addr 172.21.15.19:0/3324511059 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:32:43.753 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:43.750+0000 7f00bd5ce640 1 -- 172.21.15.19:0/3324511059 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55a8918960b0 msgr2=0x55a8918984e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-10T22:32:43.753 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:43.750+0000 7f00bd5ce640 1 --2- 172.21.15.19:0/3324511059 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55a8918960b0 0x55a8918984e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:32:43.753 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:43.750+0000 7f00bd5ce640 1 -- 172.21.15.19:0/3324511059 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a8918904e0 msgr2=0x55a891895b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:32:43.753 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:43.750+0000 7f00aeffd640 1 -- 172.21.15.19:0/3140299605 <== mon.1 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 18) ==== 153250+0+0 (secure 0 0 0) 0x7f00b403bbd0 con 0x7f00b8103ad0 2024-09-10T22:32:43.753 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:43.750+0000 7f00bd5ce640 1 --2- 172.21.15.19:0/3324511059 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a8918904e0 0x55a891895b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:32:43.753 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:43.750+0000 7f00bd5ce640 1 -- 172.21.15.19:0/3324511059 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a8917ba530 con 0x55a891898bf0 2024-09-10T22:32:43.753 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:43.750+0000 7f00bd5ce640 1 --2- 172.21.15.19:0/3324511059 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55a891898bf0 0x55a89189b0b0 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7f00a800bb10 tx=0x7f00a800d2e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5d396cb9d53e01fd server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:32:43.754 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:43.751+0000 7f00aeffd640 1 --2- 172.21.15.19:0/3140299605 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f00a40b5360 0x7f00a40b7820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:32:43.754 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:43.752+0000 7f00aeffd640 1 -- 172.21.15.19:0/3140299605 <== mon.1 v2:172.21.15.138:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8327+0+0 (secure 0 0 0) 0x7f00b41063e0 con 0x7f00b8103ad0 2024-09-10T22:32:43.754 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:43.752+0000 7f00be5d0640 1 --2- 172.21.15.19:0/3140299605 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f00a40b5360 0x7f00a40b7820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:32:43.754 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:43.753+0000 7f00be5d0640 1 --2- 172.21.15.19:0/3140299605 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f00a40b5360 0x7f00a40b7820 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f00b0009270 tx=0x7f00b0009b00 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:32:43.766 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:43.764+0000 7f00a37fe640 1 -- 172.21.15.19:0/3324511059 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00a8027070 con 0x55a891898bf0 2024-09-10T22:32:43.766 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:43.764+0000 7f00a37fe640 1 -- 172.21.15.19:0/3324511059 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f00a800dce0 con 0x55a891898bf0 2024-09-10T22:32:43.766 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:43.765+0000 7f00a37fe640 1 -- 172.21.15.19:0/3324511059 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00a8021470 con 0x55a891898bf0 2024-09-10T22:32:43.767 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:43.766+0000 7f00c2e07740 1 -- 172.21.15.19:0/3324511059 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55a891898bf0 msgr2=0x55a89189b0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:32:43.768 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:43.766+0000 7f00c2e07740 1 --2- 172.21.15.19:0/3324511059 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55a891898bf0 0x55a89189b0b0 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7f00a800bb10 tx=0x7f00a800d2e0 comp rx=0 tx=0).stop 2024-09-10T22:32:43.768 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:43.766+0000 7f00c2e07740 1 -- 172.21.15.19:0/3324511059 shutdown_connections 2024-09-10T22:32:43.769 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:43.767+0000 7f00c2e07740 1 --2- 172.21.15.19:0/3324511059 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55a891898bf0 0x55a89189b0b0 unknown :-1 s=CLOSED pgs=671 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:32:43.769 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:43.767+0000 7f00c2e07740 1 --2- 172.21.15.19:0/3324511059 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55a8918960b0 0x55a8918984e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:32:43.769 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:43.767+0000 7f00c2e07740 1 --2- 172.21.15.19:0/3324511059 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a8918904e0 0x55a891895b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:32:43.769 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:43.767+0000 7f00c2e07740 1 -- 172.21.15.19:0/3324511059 >> 172.21.15.19:0/3324511059 conn(0x55a89188ecb0 msgr2=0x55a89188fa40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:32:43.770 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:43.768+0000 7f00c2e07740 1 -- 172.21.15.19:0/3324511059 shutdown_connections 2024-09-10T22:32:43.770 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:43.769+0000 7f00c2e07740 1 -- 172.21.15.19:0/3324511059 wait complete. 2024-09-10T22:32:43.771 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:43.770+0000 7f00c2e07740 1 -- start start 2024-09-10T22:32:43.771 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:43.770+0000 7f00c2e07740 1 Processor -- start 2024-09-10T22:32:43.773 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:43.771+0000 7f00c2e07740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a8918904e0 0x55a89189cf80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:32:43.773 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:43.772+0000 7f00c2e07740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55a8918960b0 0x55a89189d620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:32:43.774 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:43.772+0000 7f00c2e07740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55a891898bf0 0x55a89189e1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:32:43.774 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:43.772+0000 7f00c2e07740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x55a89172cab0 con 0x55a891898bf0 2024-09-10T22:32:43.774 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:43.772+0000 7f00be5d0640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55a891898bf0 0x55a89189e1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:32:43.775 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:43.772+0000 7f00be5d0640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55a891898bf0 0x55a89189e1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:58692/0 (socket says 172.21.15.19:58692) 2024-09-10T22:32:43.775 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:43.772+0000 7f00be5d0640 1 -- 172.21.15.19:0/1689985802 learned_addr learned my addr 172.21.15.19:0/1689985802 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:32:43.775 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:43.772+0000 7f00c2e07740 1 -- 172.21.15.19:0/1689985802 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55a89179a730 con 0x55a8918904e0 2024-09-10T22:32:43.775 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:43.773+0000 7f00c2e07740 1 -- 172.21.15.19:0/1689985802 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x55a89189bbd0 con 0x55a8918960b0 2024-09-10T22:32:43.775 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:43.773+0000 7f00c2e07740 10 client.0 _ll_register_callbacks cb 0x55a8917ee6b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T22:32:43.776 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:43.774+0000 7f00bd5ce640 1 --2- 172.21.15.19:0/1689985802 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55a8918960b0 0x55a89189d620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:32:43.776 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:43.774+0000 7f00bddcf640 1 --2- 172.21.15.19:0/1689985802 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a8918904e0 0x55a89189cf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:32:43.777 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:43.775+0000 7f00be5d0640 1 -- 172.21.15.19:0/1689985802 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55a8918960b0 msgr2=0x55a89189d620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:32:43.777 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:43.775+0000 7f00be5d0640 1 --2- 172.21.15.19:0/1689985802 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55a8918960b0 0x55a89189d620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:32:43.778 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:43.775+0000 7f00be5d0640 1 -- 172.21.15.19:0/1689985802 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a8918904e0 msgr2=0x55a89189cf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:32:43.778 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:43.775+0000 7f00be5d0640 1 --2- 172.21.15.19:0/1689985802 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a8918904e0 0x55a89189cf80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:32:43.778 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:43.775+0000 7f00be5d0640 1 -- 172.21.15.19:0/1689985802 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a891556790 con 0x55a891898bf0 2024-09-10T22:32:43.779 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:43.777+0000 7f00be5d0640 1 --2- 172.21.15.19:0/1689985802 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55a891898bf0 0x55a89189e1f0 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7f00b0009e20 tx=0x7f00b0009680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f8d68f68b96c00bc server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:32:43.780 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:43.778+0000 7f00a17fa640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-10T22:32:43.780 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:43.778+0000 7f00a17fa640 1 -- 172.21.15.19:0/1689985802 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00b000ece0 con 0x55a891898bf0 2024-09-10T22:32:43.780 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:43.778+0000 7f00a17fa640 1 -- 172.21.15.19:0/1689985802 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8327+0+0 (secure 0 0 0) 0x7f00b001f420 con 0x55a891898bf0 2024-09-10T22:32:43.780 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:43.778+0000 7f00c2e07740 1 -- 172.21.15.19:0/1689985802 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f00a800dce0 con 0x55a891898bf0 2024-09-10T22:32:43.781 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:43.780+0000 7f00a17fa640 1 -- 172.21.15.19:0/1689985802 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f00b001f620 con 0x55a891898bf0 2024-09-10T22:32:43.781 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:43.780+0000 7f00c2e07740 10 client.16644 fetch_fsmap learned FSMap version 27 2024-09-10T22:32:43.781 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:43.780+0000 7f00c2e07740 1 -- 172.21.15.19:0/1689985802 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55a8915cf620 con 0x55a891898bf0 2024-09-10T22:32:43.782 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:43.781+0000 7f00a17fa640 1 -- 172.21.15.19:0/1689985802 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f00b001fc70 con 0x55a891898bf0 2024-09-10T22:32:43.784 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:43.781+0000 7f00a17fa640 1 -- 172.21.15.19:0/1689985802 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7f00b0030050 con 0x55a891898bf0 2024-09-10T22:32:43.784 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:43.782+0000 7f00c2e07740 10 client.16644 fetch_fsmap finished waiting for FSMap version 27 2024-09-10T22:32:43.784 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:43.782+0000 7f00c2e07740 10 client.16644 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-10T22:32:43.784 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:43.782+0000 7f00c2e07740 20 client.16644 populate_metadata read hostname 'smithi019' 2024-09-10T22:32:43.784 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:43.782+0000 7f00c2e07740 1 --2- 172.21.15.19:0/1689985802 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x55a8918a8800 0x55a8918aac30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:32:43.785 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:43.782+0000 7f00c2e07740 4 client.16644 mds_command: new command op to 24581 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T22:32:43.785 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:43.782+0000 7f00c2e07740 1 -- 172.21.15.19:0/1689985802 --> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f00a800dce0 con 0x55a8918a8800 2024-09-10T22:32:43.785 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:43.783+0000 7f00bddcf640 1 --2- 172.21.15.19:0/1689985802 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x55a8918a8800 0x55a8918aac30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:32:43.790 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:43.788+0000 7f00bddcf640 1 --2- 172.21.15.19:0/1689985802 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x55a8918a8800 0x55a8918aac30 crc :-1 s=READY pgs=140 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=df258991b642ef96 server_cookie=4fefbe4249aa5f51 in_seq=0 out_seq=0 2024-09-10T22:32:43.794 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:43.790+0000 7f00a17fa640 10 client.16644 ms_handle_connect on v2:172.21.15.135:6838/1254769802 2024-09-10T22:32:43.794 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:43.790+0000 7f00a17fa640 1 -- 172.21.15.19:0/1689985802 <== mds.0 v2:172.21.15.135:6838/1254769802 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x7f00a800dce0 con 0x55a8918a8800 2024-09-10T22:32:43.794 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:43.790+0000 7f00a17fa640 10 client.16644 handle_command_reply: tid=0 2024-09-10T22:32:43.794 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:43.790+0000 7f00c2e07740 1 client.16644 shutdown 2024-09-10T22:32:43.794 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:43.790+0000 7f00c2e07740 1 -- 172.21.15.19:0/1689985802 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55a891898bf0 msgr2=0x55a89189e1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:32:43.794 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:43.790+0000 7f00c2e07740 1 --2- 172.21.15.19:0/1689985802 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55a891898bf0 0x55a89189e1f0 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7f00b0009e20 tx=0x7f00b0009680 comp rx=0 tx=0).stop 2024-09-10T22:32:43.795 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:43.791+0000 7f00c2e07740 1 -- 172.21.15.19:0/1689985802 shutdown_connections 2024-09-10T22:32:43.795 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:43.791+0000 7f00c2e07740 1 --2- 172.21.15.19:0/1689985802 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55a891898bf0 0x55a89189e1f0 unknown :-1 s=CLOSED pgs=672 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:32:43.795 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:43.791+0000 7f00c2e07740 1 --2- 172.21.15.19:0/1689985802 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x55a8918a8800 0x55a8918aac30 crc :-1 s=READY pgs=140 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:32:43.795 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:43.791+0000 7f00c2e07740 1 --2- 172.21.15.19:0/1689985802 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55a8918960b0 0x55a89189d620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:32:43.795 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:43.791+0000 7f00c2e07740 1 --2- 172.21.15.19:0/1689985802 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a8918904e0 0x55a89189cf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:32:43.795 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:43.791+0000 7f00c2e07740 1 -- 172.21.15.19:0/1689985802 >> 172.21.15.19:0/1689985802 conn(0x55a89188ecb0 msgr2=0x55a89188dd90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:32:43.795 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:43.791+0000 7f00a17fa640 0 client.16644 ms_handle_reset on v2:172.21.15.135:6838/1254769802 2024-09-10T22:32:43.795 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:43.791+0000 7f00c2e07740 1 -- 172.21.15.19:0/1689985802 shutdown_connections 2024-09-10T22:32:43.795 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:43.791+0000 7f00c2e07740 1 -- 172.21.15.19:0/1689985802 wait complete. 2024-09-10T22:32:43.795 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:43.791+0000 7f00c2e07740 20 client.16644 trim_cache size 0 max 16384 2024-09-10T22:32:43.816 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:43.814+0000 7f00c2e07740 1 Processor -- start 2024-09-10T22:32:43.816 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:43.814+0000 7f00c2e07740 1 -- start start 2024-09-10T22:32:43.816 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:43.814+0000 7f00c2e07740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a8918904e0 0x55a891890ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:32:43.817 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:43.814+0000 7f00c2e07740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55a8918960b0 0x55a891891020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:32:43.817 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:43.814+0000 7f00c2e07740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55a891898bf0 0x55a89188f510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:32:43.817 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:43.814+0000 7f00c2e07740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f00b8070140 con 0x55a8918960b0 2024-09-10T22:32:43.817 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:43.814+0000 7f00c2e07740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f00b806da50 con 0x55a8918904e0 2024-09-10T22:32:43.817 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:43.814+0000 7f00c2e07740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f00b81a44b0 con 0x55a891898bf0 2024-09-10T22:32:43.817 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:43.814+0000 7f00bd5ce640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55a8918960b0 0x55a891891020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:32:43.817 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:43.814+0000 7f00bd5ce640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55a8918960b0 0x55a891891020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:58708/0 (socket says 172.21.15.19:58708) 2024-09-10T22:32:43.817 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:43.815+0000 7f00bd5ce640 1 -- 172.21.15.19:0/4110350247 learned_addr learned my addr 172.21.15.19:0/4110350247 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:32:43.817 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:43.815+0000 7f00be5d0640 1 --2- 172.21.15.19:0/4110350247 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55a891898bf0 0x55a89188f510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:32:43.817 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:43.815+0000 7f00bd5ce640 1 -- 172.21.15.19:0/4110350247 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55a891898bf0 msgr2=0x55a89188f510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:32:43.817 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:43.815+0000 7f00bd5ce640 1 --2- 172.21.15.19:0/4110350247 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55a891898bf0 0x55a89188f510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:32:43.817 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:43.815+0000 7f00bd5ce640 1 -- 172.21.15.19:0/4110350247 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a8918904e0 msgr2=0x55a891890ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:32:43.818 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:43.815+0000 7f00bd5ce640 1 --2- 172.21.15.19:0/4110350247 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a8918904e0 0x55a891890ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:32:43.818 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:43.815+0000 7f00bd5ce640 1 -- 172.21.15.19:0/4110350247 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a89189bd10 con 0x55a8918960b0 2024-09-10T22:32:43.818 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:43.815+0000 7f00bd5ce640 1 --2- 172.21.15.19:0/4110350247 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55a8918960b0 0x55a891891020 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7f00a800dbc0 tx=0x7f00a800dbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6f41e396e083c904 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:32:43.819 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:43.816+0000 7f00a2ffd640 1 -- 172.21.15.19:0/4110350247 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00a8027070 con 0x55a8918960b0 2024-09-10T22:32:43.819 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:43.816+0000 7f00a2ffd640 1 -- 172.21.15.19:0/4110350247 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f00a8030030 con 0x55a8918960b0 2024-09-10T22:32:43.819 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:43.816+0000 7f00a2ffd640 1 -- 172.21.15.19:0/4110350247 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00a8021470 con 0x55a8918960b0 2024-09-10T22:32:43.819 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:43.817+0000 7f00c2e07740 1 -- 172.21.15.19:0/4110350247 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55a8918960b0 msgr2=0x55a891891020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:32:43.819 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:43.817+0000 7f00c2e07740 1 --2- 172.21.15.19:0/4110350247 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55a8918960b0 0x55a891891020 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7f00a800dbc0 tx=0x7f00a800dbf0 comp rx=0 tx=0).stop 2024-09-10T22:32:43.820 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:43.818+0000 7f00c2e07740 1 -- 172.21.15.19:0/4110350247 shutdown_connections 2024-09-10T22:32:43.820 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:43.818+0000 7f00c2e07740 1 --2- 172.21.15.19:0/4110350247 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55a891898bf0 0x55a89188f510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:32:43.820 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:43.818+0000 7f00c2e07740 1 --2- 172.21.15.19:0/4110350247 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55a8918960b0 0x55a891891020 unknown :-1 s=CLOSED pgs=673 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:32:43.820 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:43.818+0000 7f00c2e07740 1 --2- 172.21.15.19:0/4110350247 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a8918904e0 0x55a891890ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:32:43.820 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:43.818+0000 7f00c2e07740 1 -- 172.21.15.19:0/4110350247 >> 172.21.15.19:0/4110350247 conn(0x55a89188ecb0 msgr2=0x55a891895610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:32:43.820 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:43.818+0000 7f00c2e07740 1 -- 172.21.15.19:0/4110350247 shutdown_connections 2024-09-10T22:32:43.820 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:43.818+0000 7f00c2e07740 1 -- 172.21.15.19:0/4110350247 wait complete. 2024-09-10T22:32:43.820 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:43.819+0000 7f00c2e07740 1 -- start start 2024-09-10T22:32:43.821 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:43.819+0000 7f00c2e07740 1 Processor -- start 2024-09-10T22:32:43.821 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:43.820+0000 7f00c2e07740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55a8918904e0 0x55a8918a3a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:32:43.821 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:43.820+0000 7f00c2e07740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55a8918960b0 0x55a8918a3f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:32:43.822 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:43.820+0000 7f00c2e07740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a891898bf0 0x55a8918a44c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:32:43.822 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:43.820+0000 7f00c2e07740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f00b81a4b20 con 0x55a8918904e0 2024-09-10T22:32:43.822 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:43.820+0000 7f00c2e07740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f00b806d380 con 0x55a891898bf0 2024-09-10T22:32:43.822 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:43.820+0000 7f00c2e07740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f00b81a51f0 con 0x55a8918960b0 2024-09-10T22:32:43.822 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:43.820+0000 7f00c2e07740 10 client.0 _ll_register_callbacks cb 0x7f00b0009a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T22:32:43.824 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:43.820+0000 7f00bd5ce640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55a8918960b0 0x55a8918a3f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:32:43.824 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:43.820+0000 7f00bd5ce640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55a8918960b0 0x55a8918a3f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.19:58052/0 (socket says 172.21.15.19:58052) 2024-09-10T22:32:43.824 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:43.820+0000 7f00bd5ce640 1 -- 172.21.15.19:0/1447461601 learned_addr learned my addr 172.21.15.19:0/1447461601 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:32:43.824 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:43.820+0000 7f00bd5ce640 1 -- 172.21.15.19:0/1447461601 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a891898bf0 msgr2=0x55a8918a44c0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-10T22:32:43.824 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:43.820+0000 7f00bd5ce640 1 --2- 172.21.15.19:0/1447461601 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a891898bf0 0x55a8918a44c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:32:43.825 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:43.820+0000 7f00bd5ce640 1 -- 172.21.15.19:0/1447461601 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55a8918904e0 msgr2=0x55a8918a3a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:32:43.825 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:43.820+0000 7f00bd5ce640 1 --2- 172.21.15.19:0/1447461601 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55a8918904e0 0x55a8918a3a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:32:43.825 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:43.821+0000 7f00bd5ce640 1 -- 172.21.15.19:0/1447461601 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a8918a2660 con 0x55a8918960b0 2024-09-10T22:32:43.825 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:43.821+0000 7f00bd5ce640 1 --2- 172.21.15.19:0/1447461601 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55a8918960b0 0x55a8918a3f80 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f00a800b320 tx=0x7f00a800de40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ff3fe5eefb259c0b server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:32:43.825 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:43.821+0000 7f00a0ff9640 10 client.0 ms_handle_connect on v2:172.21.15.138:3300/0 2024-09-10T22:32:43.825 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:43.821+0000 7f00a0ff9640 1 -- 172.21.15.19:0/1447461601 <== mon.1 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00a8027070 con 0x55a8918960b0 2024-09-10T22:32:43.825 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:43.821+0000 7f00a0ff9640 1 -- 172.21.15.19:0/1447461601 <== mon.1 v2:172.21.15.138:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8327+0+0 (secure 0 0 0) 0x7f00a8005020 con 0x55a8918960b0 2024-09-10T22:32:43.825 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:43.822+0000 7f00c2e07740 1 -- 172.21.15.19:0/1447461601 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f00a8030030 con 0x55a8918960b0 2024-09-10T22:32:43.825 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:43.822+0000 7f00a0ff9640 1 -- 172.21.15.19:0/1447461601 <== mon.1 v2:172.21.15.138:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f00a8005220 con 0x55a8918960b0 2024-09-10T22:32:43.825 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:43.822+0000 7f00c2e07740 10 client.26080 fetch_fsmap learned FSMap version 27 2024-09-10T22:32:43.825 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:43.822+0000 7f00c2e07740 1 -- 172.21.15.19:0/1447461601 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55a891915ac0 con 0x55a8918960b0 2024-09-10T22:32:43.825 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:43.822+0000 7f00a0ff9640 1 -- 172.21.15.19:0/1447461601 <== mon.1 v2:172.21.15.138:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f00a8030030 con 0x55a8918960b0 2024-09-10T22:32:43.825 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:43.822+0000 7f00a0ff9640 1 -- 172.21.15.19:0/1447461601 <== mon.1 v2:172.21.15.138:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7f00a8003c10 con 0x55a8918960b0 2024-09-10T22:32:43.825 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:43.822+0000 7f00c2e07740 10 client.26080 fetch_fsmap finished waiting for FSMap version 27 2024-09-10T22:32:43.826 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:43.822+0000 7f00c2e07740 10 client.26080 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-10T22:32:43.826 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:43.822+0000 7f00c2e07740 20 client.26080 populate_metadata read hostname 'smithi019' 2024-09-10T22:32:43.826 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:43.822+0000 7f00c2e07740 1 --2- 172.21.15.19:0/1447461601 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x55a8919161a0 0x55a8919185c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:32:43.826 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:43.822+0000 7f00c2e07740 4 client.26080 mds_command: new command op to 24581 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-10T22:32:43.826 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:43.822+0000 7f00c2e07740 1 -- 172.21.15.19:0/1447461601 --> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55a891807640 con 0x55a8919161a0 2024-09-10T22:32:43.826 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:43.823+0000 7f00bddcf640 1 --2- 172.21.15.19:0/1447461601 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x55a8919161a0 0x55a8919185c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:32:43.827 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:43.824+0000 7f00bddcf640 1 --2- 172.21.15.19:0/1447461601 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x55a8919161a0 0x55a8919185c0 crc :-1 s=READY pgs=141 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=82d0712c7a2cce17 server_cookie=c56c51717efffa4e in_seq=0 out_seq=0 2024-09-10T22:32:43.827 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:43.824+0000 7f00a0ff9640 10 client.26080 ms_handle_connect on v2:172.21.15.135:6838/1254769802 2024-09-10T22:32:44.110 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:32:43 smithi135 ceph-mon[34789]: pgmap v536: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 517 KiB/s rd, 309 MiB/s wr, 328 op/s 2024-09-10T22:32:44.125 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:32:43 smithi138 ceph-mon[35236]: pgmap v536: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 517 KiB/s rd, 309 MiB/s wr, 328 op/s 2024-09-10T22:32:44.208 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:32:43 smithi019 ceph-mon[31375]: pgmap v536: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 517 KiB/s rd, 309 MiB/s wr, 328 op/s 2024-09-10T22:32:46.109 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:32:45 smithi135 ceph-mon[34789]: pgmap v537: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 779 KiB/s rd, 310 MiB/s wr, 372 op/s 2024-09-10T22:32:46.125 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:32:45 smithi138 ceph-mon[35236]: pgmap v537: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 779 KiB/s rd, 310 MiB/s wr, 372 op/s 2024-09-10T22:32:46.208 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:32:45 smithi019 ceph-mon[31375]: pgmap v537: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 779 KiB/s rd, 310 MiB/s wr, 372 op/s 2024-09-10T22:32:48.110 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:32:47 smithi135 ceph-mon[34789]: pgmap v538: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 507 KiB/s rd, 331 MiB/s wr, 470 op/s 2024-09-10T22:32:48.125 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:32:47 smithi138 ceph-mon[35236]: pgmap v538: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 507 KiB/s rd, 331 MiB/s wr, 470 op/s 2024-09-10T22:32:48.208 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:32:47 smithi019 ceph-mon[31375]: pgmap v538: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 507 KiB/s rd, 331 MiB/s wr, 470 op/s 2024-09-10T22:32:50.110 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:32:49 smithi135 ceph-mon[34789]: pgmap v539: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 504 KiB/s rd, 284 MiB/s wr, 475 op/s 2024-09-10T22:32:50.125 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:32:49 smithi138 ceph-mon[35236]: pgmap v539: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 504 KiB/s rd, 284 MiB/s wr, 475 op/s 2024-09-10T22:32:50.208 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:32:49 smithi019 ceph-mon[31375]: pgmap v539: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 504 KiB/s rd, 284 MiB/s wr, 475 op/s 2024-09-10T22:32:50.351 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:50.349+0000 7f00a0ff9640 1 -- 172.21.15.19:0/1447461601 <== mds.0 v2:172.21.15.135:6838/1254769802 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55a891807640 con 0x55a8919161a0 2024-09-10T22:32:50.351 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:50.349+0000 7f00a0ff9640 10 client.26080 handle_command_reply: tid=0 2024-09-10T22:32:50.351 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:50.349+0000 7f00c2e07740 1 client.26080 shutdown 2024-09-10T22:32:50.351 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:50.349+0000 7f00c2e07740 1 -- 172.21.15.19:0/1447461601 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55a8918960b0 msgr2=0x55a8918a3f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:32:50.352 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:50.349+0000 7f00c2e07740 1 --2- 172.21.15.19:0/1447461601 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55a8918960b0 0x55a8918a3f80 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f00a800b320 tx=0x7f00a800de40 comp rx=0 tx=0).stop 2024-09-10T22:32:50.352 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:50.349+0000 7f00c2e07740 1 -- 172.21.15.19:0/1447461601 shutdown_connections 2024-09-10T22:32:50.352 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:50.349+0000 7f00c2e07740 1 --2- 172.21.15.19:0/1447461601 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a891898bf0 0x55a8918a44c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:32:50.352 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:50.349+0000 7f00c2e07740 1 --2- 172.21.15.19:0/1447461601 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x55a8919161a0 0x55a8919185c0 crc :-1 s=READY pgs=141 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:32:50.352 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:50.349+0000 7f00c2e07740 1 --2- 172.21.15.19:0/1447461601 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55a8918960b0 0x55a8918a3f80 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:32:50.352 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:50.349+0000 7f00c2e07740 1 --2- 172.21.15.19:0/1447461601 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55a8918904e0 0x55a8918a3a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:32:50.352 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:50.349+0000 7f00a0ff9640 0 client.26080 ms_handle_reset on v2:172.21.15.135:6838/1254769802 2024-09-10T22:32:50.352 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:50.349+0000 7f00c2e07740 1 -- 172.21.15.19:0/1447461601 >> 172.21.15.19:0/1447461601 conn(0x55a89188ecb0 msgr2=0x55a891890ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:32:50.352 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:50.349+0000 7f00c2e07740 1 -- 172.21.15.19:0/1447461601 shutdown_connections 2024-09-10T22:32:50.352 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:50.349+0000 7f00c2e07740 1 -- 172.21.15.19:0/1447461601 wait complete. 2024-09-10T22:32:50.352 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:50.349+0000 7f00c2e07740 20 client.26080 trim_cache size 0 max 16384 2024-09-10T22:32:50.353 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stdout:{ 2024-09-10T22:32:50.353 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stdout: "message": "", 2024-09-10T22:32:50.353 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stdout: "return_code": 0 2024-09-10T22:32:50.353 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stdout:} 2024-09-10T22:32:50.354 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:50.351+0000 7f00acff9640 1 -- 172.21.15.19:0/3140299605 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f00a40b5360 msgr2=0x7f00a40b7820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:32:50.354 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:50.351+0000 7f00acff9640 1 --2- 172.21.15.19:0/3140299605 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f00a40b5360 0x7f00a40b7820 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f00b0009270 tx=0x7f00b0009b00 comp rx=0 tx=0).stop 2024-09-10T22:32:50.354 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:50.351+0000 7f00acff9640 1 -- 172.21.15.19:0/3140299605 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f00b8103ad0 msgr2=0x7f00b8076d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:32:50.354 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:50.351+0000 7f00acff9640 1 --2- 172.21.15.19:0/3140299605 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f00b8103ad0 0x7f00b8076d00 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f00b4008000 tx=0x7f00b4004340 comp rx=0 tx=0).stop 2024-09-10T22:32:50.354 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:50.351+0000 7f00acff9640 1 -- 172.21.15.19:0/3140299605 shutdown_connections 2024-09-10T22:32:50.354 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:50.351+0000 7f00acff9640 1 --2- 172.21.15.19:0/3140299605 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f00a40b5360 0x7f00a40b7820 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:32:50.354 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:50.351+0000 7f00acff9640 1 --2- 172.21.15.19:0/3140299605 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f00b819cbc0 0x7f00b8075aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:32:50.354 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:50.351+0000 7f00acff9640 1 --2- 172.21.15.19:0/3140299605 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f00b8104490 0x7f00b8075560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:32:50.354 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:50.351+0000 7f00acff9640 1 --2- 172.21.15.19:0/3140299605 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f00b8103ad0 0x7f00b8076d00 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:32:50.354 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:50.351+0000 7f00acff9640 1 -- 172.21.15.19:0/3140299605 >> 172.21.15.19:0/3140299605 conn(0x7f00b80fe240 msgr2=0x7f00b8106f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:32:50.354 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:50.351+0000 7f00acff9640 1 -- 172.21.15.19:0/3140299605 shutdown_connections 2024-09-10T22:32:50.355 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:32:50.351+0000 7f00acff9640 1 -- 172.21.15.19:0/3140299605 wait complete. 2024-09-10T22:32:52.110 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:32:51 smithi135 ceph-mon[34789]: pgmap v540: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 633 KiB/s rd, 329 MiB/s wr, 599 op/s 2024-09-10T22:32:52.125 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:32:51 smithi138 ceph-mon[35236]: pgmap v540: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 633 KiB/s rd, 329 MiB/s wr, 599 op/s 2024-09-10T22:32:52.208 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:32:51 smithi019 ceph-mon[31375]: pgmap v540: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 633 KiB/s rd, 329 MiB/s wr, 599 op/s 2024-09-10T22:32:54.111 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:32:53 smithi135 ceph-mon[34789]: pgmap v541: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 552 KiB/s rd, 286 MiB/s wr, 537 op/s 2024-09-10T22:32:54.125 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:32:53 smithi138 ceph-mon[35236]: pgmap v541: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 552 KiB/s rd, 286 MiB/s wr, 537 op/s 2024-09-10T22:32:54.208 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:32:53 smithi019 ceph-mon[31375]: pgmap v541: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 552 KiB/s rd, 286 MiB/s wr, 537 op/s 2024-09-10T22:32:56.110 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:32:55 smithi135 ceph-mon[34789]: pgmap v542: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 759 KiB/s rd, 287 MiB/s wr, 520 op/s 2024-09-10T22:32:56.125 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:32:55 smithi138 ceph-mon[35236]: pgmap v542: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 759 KiB/s rd, 287 MiB/s wr, 520 op/s 2024-09-10T22:32:56.208 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:32:55 smithi019 ceph-mon[31375]: pgmap v542: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 759 KiB/s rd, 287 MiB/s wr, 520 op/s 2024-09-10T22:32:58.125 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:32:57 smithi138 ceph-mon[35236]: pgmap v543: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 498 KiB/s rd, 318 MiB/s wr, 508 op/s 2024-09-10T22:32:58.208 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:32:57 smithi019 ceph-mon[31375]: pgmap v543: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 498 KiB/s rd, 318 MiB/s wr, 508 op/s 2024-09-10T22:32:58.360 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:32:57 smithi135 ceph-mon[34789]: pgmap v543: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 498 KiB/s rd, 318 MiB/s wr, 508 op/s 2024-09-10T22:33:00.126 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:32:59 smithi138 ceph-mon[35236]: pgmap v544: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 497 KiB/s rd, 280 MiB/s wr, 398 op/s 2024-09-10T22:33:00.208 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:32:59 smithi019 ceph-mon[31375]: pgmap v544: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 497 KiB/s rd, 280 MiB/s wr, 398 op/s 2024-09-10T22:33:00.359 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:32:59 smithi135 ceph-mon[34789]: pgmap v544: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 497 KiB/s rd, 280 MiB/s wr, 398 op/s 2024-09-10T22:33:02.125 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:33:01 smithi138 ceph-mon[35236]: pgmap v545: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 788 KiB/s rd, 335 MiB/s wr, 382 op/s 2024-09-10T22:33:02.208 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:33:01 smithi019 ceph-mon[31375]: pgmap v545: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 788 KiB/s rd, 335 MiB/s wr, 382 op/s 2024-09-10T22:33:02.360 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:33:01 smithi135 ceph-mon[34789]: pgmap v545: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 788 KiB/s rd, 335 MiB/s wr, 382 op/s 2024-09-10T22:33:03.508 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:03.505+0000 7f8a4e5c9640 1 -- 172.21.15.19:0/3368392182 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8a48102780 msgr2=0x7f8a48102c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:33:03.508 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:03.505+0000 7f8a4e5c9640 1 --2- 172.21.15.19:0/3368392182 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8a48102780 0x7f8a48102c00 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7f8a3c009900 tx=0x7f8a3c02a410 comp rx=0 tx=0).stop 2024-09-10T22:33:03.508 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:03.505+0000 7f8a4e5c9640 1 -- 172.21.15.19:0/3368392182 shutdown_connections 2024-09-10T22:33:03.508 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:03.506+0000 7f8a4e5c9640 1 --2- 172.21.15.19:0/3368392182 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f8a48103340 0x7f8a48109de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:33:03.508 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:03.506+0000 7f8a4e5c9640 1 --2- 172.21.15.19:0/3368392182 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8a48102780 0x7f8a48102c00 unknown :-1 s=CLOSED pgs=674 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:33:03.508 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:03.506+0000 7f8a4e5c9640 1 --2- 172.21.15.19:0/3368392182 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8a48101df0 0x7f8a481021f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:33:03.508 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:03.506+0000 7f8a4e5c9640 1 -- 172.21.15.19:0/3368392182 >> 172.21.15.19:0/3368392182 conn(0x7f8a480fc880 msgr2=0x7f8a480fecc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:33:03.508 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:03.506+0000 7f8a4e5c9640 1 -- 172.21.15.19:0/3368392182 shutdown_connections 2024-09-10T22:33:03.509 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:03.506+0000 7f8a4e5c9640 1 -- 172.21.15.19:0/3368392182 wait complete. 2024-09-10T22:33:03.510 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:03.506+0000 7f8a4e5c9640 1 Processor -- start 2024-09-10T22:33:03.510 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:03.507+0000 7f8a4e5c9640 1 -- start start 2024-09-10T22:33:03.511 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:03.507+0000 7f8a4e5c9640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8a48101df0 0x7f8a48198cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:33:03.511 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:03.507+0000 7f8a4e5c9640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f8a48102780 0x7f8a48199340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:33:03.511 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:03.507+0000 7f8a4e5c9640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8a48103340 0x7f8a48199f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:33:03.511 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:03.507+0000 7f8a4e5c9640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f8a4810d4f0 con 0x7f8a48101df0 2024-09-10T22:33:03.511 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:03.507+0000 7f8a4e5c9640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f8a4810d370 con 0x7f8a48103340 2024-09-10T22:33:03.511 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:03.507+0000 7f8a4e5c9640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f8a4810d670 con 0x7f8a48102780 2024-09-10T22:33:03.511 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:03.507+0000 7f8a47fff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8a48101df0 0x7f8a48198cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:33:03.511 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:03.508+0000 7f8a47fff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8a48101df0 0x7f8a48198cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:58928/0 (socket says 172.21.15.19:58928) 2024-09-10T22:33:03.511 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:03.508+0000 7f8a47fff640 1 -- 172.21.15.19:0/3490221797 learned_addr learned my addr 172.21.15.19:0/3490221797 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:33:03.511 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:03.508+0000 7f8a47fff640 1 -- 172.21.15.19:0/3490221797 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f8a48102780 msgr2=0x7f8a48199340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:33:03.511 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:03.508+0000 7f8a47fff640 1 --2- 172.21.15.19:0/3490221797 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f8a48102780 0x7f8a48199340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:33:03.511 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:03.508+0000 7f8a47fff640 1 -- 172.21.15.19:0/3490221797 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8a48103340 msgr2=0x7f8a48199f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:33:03.511 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:03.508+0000 7f8a47fff640 1 --2- 172.21.15.19:0/3490221797 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8a48103340 0x7f8a48199f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:33:03.512 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:03.508+0000 7f8a47fff640 1 -- 172.21.15.19:0/3490221797 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8a4819a830 con 0x7f8a48101df0 2024-09-10T22:33:03.512 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:03.508+0000 7f8a47fff640 1 --2- 172.21.15.19:0/3490221797 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8a48101df0 0x7f8a48198cf0 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7f8a3800e9f0 tx=0x7f8a3800eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:33:03.512 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:03.509+0000 7f8a457fa640 1 -- 172.21.15.19:0/3490221797 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a3800cd80 con 0x7f8a48101df0 2024-09-10T22:33:03.512 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:03.509+0000 7f8a457fa640 1 -- 172.21.15.19:0/3490221797 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8a380108e0 con 0x7f8a48101df0 2024-09-10T22:33:03.512 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:03.509+0000 7f8a4e5c9640 1 -- 172.21.15.19:0/3490221797 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8a4819ab20 con 0x7f8a48101df0 2024-09-10T22:33:03.512 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:03.509+0000 7f8a457fa640 1 -- 172.21.15.19:0/3490221797 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a38018980 con 0x7f8a48101df0 2024-09-10T22:33:03.512 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:03.510+0000 7f8a4e5c9640 1 -- 172.21.15.19:0/3490221797 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8a481a11f0 con 0x7f8a48101df0 2024-09-10T22:33:03.515 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:03.513+0000 7f8a457fa640 1 -- 172.21.15.19:0/3490221797 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 18) ==== 153250+0+0 (secure 0 0 0) 0x7f8a38010430 con 0x7f8a48101df0 2024-09-10T22:33:03.517 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:03.514+0000 7f8a51470740 1 Processor -- start 2024-09-10T22:33:03.517 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:03.514+0000 7f8a51470740 1 -- start start 2024-09-10T22:33:03.517 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:03.515+0000 7f8a51470740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x557217855860 0x557217857c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:33:03.517 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:03.515+0000 7f8a51470740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x557217858190 0x55721785a580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:33:03.517 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:03.515+0000 7f8a51470740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55721785abd0 0x55721785d090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:33:03.517 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:03.515+0000 7f8a51470740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x5572177c76f0 con 0x557217855860 2024-09-10T22:33:03.518 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:03.515+0000 7f8a51470740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x5572177b6b20 con 0x55721785abd0 2024-09-10T22:33:03.518 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:03.515+0000 7f8a51470740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x5572177ba930 con 0x557217858190 2024-09-10T22:33:03.518 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:03.515+0000 7f8a4cb66640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x557217855860 0x557217857c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:33:03.518 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:03.515+0000 7f8a4cb66640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x557217855860 0x557217857c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:58940/0 (socket says 172.21.15.19:58940) 2024-09-10T22:33:03.518 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:03.515+0000 7f8a4cb66640 1 -- 172.21.15.19:0/3800707593 learned_addr learned my addr 172.21.15.19:0/3800707593 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:33:03.518 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:03.515+0000 7f8a457fa640 1 --2- 172.21.15.19:0/3490221797 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f8a300b5360 0x7f8a300b7820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:33:03.518 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:03.515+0000 7f8a4cb66640 1 -- 172.21.15.19:0/3800707593 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x557217858190 msgr2=0x55721785a580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:33:03.518 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:03.515+0000 7f8a4cb66640 1 --2- 172.21.15.19:0/3800707593 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x557217858190 0x55721785a580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:33:03.519 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:03.516+0000 7f8a4cb66640 1 -- 172.21.15.19:0/3800707593 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55721785abd0 msgr2=0x55721785d090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:33:03.519 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:03.516+0000 7f8a4cb66640 1 --2- 172.21.15.19:0/3800707593 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55721785abd0 0x55721785d090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:33:03.519 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:03.516+0000 7f8a4cb66640 1 -- 172.21.15.19:0/3800707593 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55721777c530 con 0x557217855860 2024-09-10T22:33:03.519 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:03.516+0000 7f8a457fa640 1 -- 172.21.15.19:0/3490221797 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8327+0+0 (secure 0 0 0) 0x7f8a380e5ff0 con 0x7f8a48101df0 2024-09-10T22:33:03.519 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:03.516+0000 7f8a4cb66640 1 --2- 172.21.15.19:0/3490221797 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f8a300b5360 0x7f8a300b7820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:33:03.519 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:03.516+0000 7f8a4cb66640 1 --2- 172.21.15.19:0/3800707593 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x557217855860 0x557217857c50 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7f8a40007e40 tx=0x7f8a4000c6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3aee2020e346ec49 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:33:03.520 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:03.516+0000 7f8a4cb66640 1 --2- 172.21.15.19:0/3490221797 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f8a300b5360 0x7f8a300b7820 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f8a40018000 tx=0x7f8a4001a000 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:33:03.520 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:03.517+0000 7f8a2e7fc640 1 -- 172.21.15.19:0/3800707593 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a4001b040 con 0x557217855860 2024-09-10T22:33:03.520 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:03.517+0000 7f8a2e7fc640 1 -- 172.21.15.19:0/3800707593 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8a40024070 con 0x557217855860 2024-09-10T22:33:03.520 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:03.518+0000 7f8a2e7fc640 1 -- 172.21.15.19:0/3800707593 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a400116b0 con 0x557217855860 2024-09-10T22:33:03.521 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:03.518+0000 7f8a51470740 1 -- 172.21.15.19:0/3800707593 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x557217855860 msgr2=0x557217857c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:33:03.521 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:03.518+0000 7f8a51470740 1 --2- 172.21.15.19:0/3800707593 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x557217855860 0x557217857c50 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7f8a40007e40 tx=0x7f8a4000c6a0 comp rx=0 tx=0).stop 2024-09-10T22:33:03.521 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:03.518+0000 7f8a51470740 1 -- 172.21.15.19:0/3800707593 shutdown_connections 2024-09-10T22:33:03.521 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:03.518+0000 7f8a51470740 1 --2- 172.21.15.19:0/3800707593 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55721785abd0 0x55721785d090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:33:03.521 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:03.518+0000 7f8a51470740 1 --2- 172.21.15.19:0/3800707593 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x557217858190 0x55721785a580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:33:03.521 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:03.518+0000 7f8a51470740 1 --2- 172.21.15.19:0/3800707593 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x557217855860 0x557217857c50 unknown :-1 s=CLOSED pgs=676 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:33:03.522 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:03.518+0000 7f8a51470740 1 -- 172.21.15.19:0/3800707593 >> 172.21.15.19:0/3800707593 conn(0x5572178509b0 msgr2=0x557217851740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:33:03.522 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:03.518+0000 7f8a51470740 1 -- 172.21.15.19:0/3800707593 shutdown_connections 2024-09-10T22:33:03.522 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:03.519+0000 7f8a51470740 1 -- 172.21.15.19:0/3800707593 wait complete. 2024-09-10T22:33:03.522 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:03.519+0000 7f8a51470740 1 -- start start 2024-09-10T22:33:03.522 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:03.520+0000 7f8a51470740 1 Processor -- start 2024-09-10T22:33:03.523 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:03.520+0000 7f8a51470740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x557217855860 0x55721785f030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:33:03.523 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:03.520+0000 7f8a51470740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x557217858190 0x55721785f6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:33:03.524 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:03.520+0000 7f8a51470740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55721785abd0 0x5572178602a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:33:03.524 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:03.521+0000 7f8a51470740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x5572176eeab0 con 0x557217855860 2024-09-10T22:33:03.524 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:03.521+0000 7f8a51470740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55721775c730 con 0x55721785abd0 2024-09-10T22:33:03.524 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:03.521+0000 7f8a51470740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x55721785dba0 con 0x557217858190 2024-09-10T22:33:03.524 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:03.521+0000 7f8a47fff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x557217855860 0x55721785f030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:33:03.524 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:03.521+0000 7f8a47fff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x557217855860 0x55721785f030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:58952/0 (socket says 172.21.15.19:58952) 2024-09-10T22:33:03.524 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:03.521+0000 7f8a47fff640 1 -- 172.21.15.19:0/2814514291 learned_addr learned my addr 172.21.15.19:0/2814514291 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:33:03.524 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:03.521+0000 7f8a51470740 10 client.0 _ll_register_callbacks cb 0x5572177b06b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T22:33:03.524 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:03.521+0000 7f8a477fe640 1 --2- 172.21.15.19:0/2814514291 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x557217858190 0x55721785f6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:33:03.524 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:03.521+0000 7f8a47fff640 1 -- 172.21.15.19:0/2814514291 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x557217858190 msgr2=0x55721785f6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:33:03.524 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:03.521+0000 7f8a47fff640 1 --2- 172.21.15.19:0/2814514291 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x557217858190 0x55721785f6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:33:03.524 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:03.521+0000 7f8a47fff640 1 -- 172.21.15.19:0/2814514291 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55721785abd0 msgr2=0x5572178602a0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-10T22:33:03.525 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:03.521+0000 7f8a47fff640 1 --2- 172.21.15.19:0/2814514291 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55721785abd0 0x5572178602a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:33:03.525 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:03.521+0000 7f8a47fff640 1 -- 172.21.15.19:0/2814514291 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557217518790 con 0x557217855860 2024-09-10T22:33:03.525 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:03.522+0000 7f8a47fff640 1 --2- 172.21.15.19:0/2814514291 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x557217855860 0x55721785f030 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7f8a380a8d20 tx=0x7f8a380ac160 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b931e2720f4e961b server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:33:03.525 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:03.522+0000 7f8a277fe640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-10T22:33:03.526 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:03.522+0000 7f8a277fe640 1 -- 172.21.15.19:0/2814514291 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a380abbb0 con 0x557217855860 2024-09-10T22:33:03.526 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:03.522+0000 7f8a277fe640 1 -- 172.21.15.19:0/2814514291 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8327+0+0 (secure 0 0 0) 0x7f8a38018b20 con 0x557217855860 2024-09-10T22:33:03.526 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:03.523+0000 7f8a51470740 1 -- 172.21.15.19:0/2814514291 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8a40024070 con 0x557217855860 2024-09-10T22:33:03.526 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:03.523+0000 7f8a277fe640 1 -- 172.21.15.19:0/2814514291 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f8a380ac750 con 0x557217855860 2024-09-10T22:33:03.527 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:03.523+0000 7f8a51470740 10 client.16659 fetch_fsmap learned FSMap version 27 2024-09-10T22:33:03.527 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:03.523+0000 7f8a51470740 1 -- 172.21.15.19:0/2814514291 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x557217591620 con 0x557217855860 2024-09-10T22:33:03.527 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:03.523+0000 7f8a277fe640 1 -- 172.21.15.19:0/2814514291 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8a40024070 con 0x557217855860 2024-09-10T22:33:03.527 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:03.524+0000 7f8a277fe640 1 -- 172.21.15.19:0/2814514291 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7f8a380ab420 con 0x557217855860 2024-09-10T22:33:03.527 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:03.524+0000 7f8a51470740 10 client.16659 fetch_fsmap finished waiting for FSMap version 27 2024-09-10T22:33:03.527 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:03.524+0000 7f8a51470740 10 client.16659 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-10T22:33:03.527 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:03.524+0000 7f8a51470740 20 client.16659 populate_metadata read hostname 'smithi019' 2024-09-10T22:33:03.527 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:03.524+0000 7f8a51470740 1 --2- 172.21.15.19:0/2814514291 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x55721786a850 0x55721786cc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:33:03.527 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:03.524+0000 7f8a51470740 4 client.16659 mds_command: new command op to 24581 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T22:33:03.527 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:03.524+0000 7f8a51470740 1 -- 172.21.15.19:0/2814514291 --> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5572177c9640 con 0x55721786a850 2024-09-10T22:33:03.527 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:03.524+0000 7f8a477fe640 1 --2- 172.21.15.19:0/2814514291 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x55721786a850 0x55721786cc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:33:03.533 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:03.532+0000 7f8a277fe640 10 client.16659 ms_handle_connect on v2:172.21.15.135:6838/1254769802 2024-09-10T22:33:03.533 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:03.532+0000 7f8a477fe640 1 --2- 172.21.15.19:0/2814514291 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x55721786a850 0x55721786cc40 crc :-1 s=READY pgs=142 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bec828fb12d75c16 server_cookie=206eb400061cac91 in_seq=0 out_seq=0 2024-09-10T22:33:03.537 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:03.536+0000 7f8a277fe640 1 -- 172.21.15.19:0/2814514291 <== mds.0 v2:172.21.15.135:6838/1254769802 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5572177c9640 con 0x55721786a850 2024-09-10T22:33:03.537 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:03.536+0000 7f8a277fe640 10 client.16659 handle_command_reply: tid=0 2024-09-10T22:33:03.537 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:03.536+0000 7f8a51470740 1 client.16659 shutdown 2024-09-10T22:33:03.538 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:03.536+0000 7f8a51470740 1 -- 172.21.15.19:0/2814514291 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x557217855860 msgr2=0x55721785f030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:33:03.538 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:03.536+0000 7f8a51470740 1 --2- 172.21.15.19:0/2814514291 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x557217855860 0x55721785f030 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7f8a380a8d20 tx=0x7f8a380ac160 comp rx=0 tx=0).stop 2024-09-10T22:33:03.538 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:03.536+0000 7f8a51470740 1 -- 172.21.15.19:0/2814514291 shutdown_connections 2024-09-10T22:33:03.538 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:03.536+0000 7f8a51470740 1 --2- 172.21.15.19:0/2814514291 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55721785abd0 0x5572178602a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:33:03.538 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:03.536+0000 7f8a51470740 1 --2- 172.21.15.19:0/2814514291 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x55721786a850 0x55721786cc40 crc :-1 s=READY pgs=142 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:33:03.539 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:03.537+0000 7f8a51470740 1 --2- 172.21.15.19:0/2814514291 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x557217858190 0x55721785f6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:33:03.539 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:03.537+0000 7f8a277fe640 0 client.16659 ms_handle_reset on v2:172.21.15.135:6838/1254769802 2024-09-10T22:33:03.539 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:03.537+0000 7f8a51470740 1 --2- 172.21.15.19:0/2814514291 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x557217855860 0x55721785f030 unknown :-1 s=CLOSED pgs=677 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:33:03.540 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:03.537+0000 7f8a51470740 1 -- 172.21.15.19:0/2814514291 >> 172.21.15.19:0/2814514291 conn(0x5572178509b0 msgr2=0x55721784fbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:33:03.540 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:03.538+0000 7f8a51470740 1 -- 172.21.15.19:0/2814514291 shutdown_connections 2024-09-10T22:33:03.540 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:03.538+0000 7f8a51470740 1 -- 172.21.15.19:0/2814514291 wait complete. 2024-09-10T22:33:03.540 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:03.538+0000 7f8a51470740 20 client.16659 trim_cache size 0 max 16384 2024-09-10T22:33:03.571 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:03.569+0000 7f8a51470740 1 Processor -- start 2024-09-10T22:33:03.572 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:03.569+0000 7f8a51470740 1 -- start start 2024-09-10T22:33:03.572 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:03.570+0000 7f8a51470740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x557217855860 0x557217854e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:33:03.572 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:03.570+0000 7f8a51470740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557217858190 0x557217851210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:33:03.572 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:03.570+0000 7f8a51470740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55721785abd0 0x557217851750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:33:03.572 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:03.570+0000 7f8a51470740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f8a481aa790 con 0x557217855860 2024-09-10T22:33:03.572 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:03.570+0000 7f8a51470740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f8a481a8060 con 0x557217858190 2024-09-10T22:33:03.572 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:03.570+0000 7f8a51470740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f8a481a5eb0 con 0x55721785abd0 2024-09-10T22:33:03.572 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:03.570+0000 7f8a47fff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x557217855860 0x557217854e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:33:03.572 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:03.570+0000 7f8a47fff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x557217855860 0x557217854e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:58960/0 (socket says 172.21.15.19:58960) 2024-09-10T22:33:03.572 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:03.570+0000 7f8a47fff640 1 -- 172.21.15.19:0/1878701196 learned_addr learned my addr 172.21.15.19:0/1878701196 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:33:03.574 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:03.570+0000 7f8a47fff640 1 -- 172.21.15.19:0/1878701196 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55721785abd0 msgr2=0x557217851750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:33:03.574 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:03.570+0000 7f8a47fff640 1 --2- 172.21.15.19:0/1878701196 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55721785abd0 0x557217851750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:33:03.574 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:03.570+0000 7f8a47fff640 1 -- 172.21.15.19:0/1878701196 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557217858190 msgr2=0x557217851210 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-10T22:33:03.574 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:03.570+0000 7f8a47fff640 1 --2- 172.21.15.19:0/1878701196 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557217858190 0x557217851210 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:33:03.574 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:03.570+0000 7f8a47fff640 1 -- 172.21.15.19:0/1878701196 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55721785a8f0 con 0x557217855860 2024-09-10T22:33:03.574 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:03.571+0000 7f8a47fff640 1 --2- 172.21.15.19:0/1878701196 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x557217855860 0x557217854e20 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7f8a380ac450 tx=0x7f8a38018420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9223c9aa8e8df2e server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:33:03.574 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:03.571+0000 7f8a2dffb640 1 -- 172.21.15.19:0/1878701196 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a380abbb0 con 0x557217855860 2024-09-10T22:33:03.574 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:03.571+0000 7f8a2dffb640 1 -- 172.21.15.19:0/1878701196 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8a380a6e50 con 0x557217855860 2024-09-10T22:33:03.574 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:03.571+0000 7f8a2dffb640 1 -- 172.21.15.19:0/1878701196 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a380b2620 con 0x557217855860 2024-09-10T22:33:03.574 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:03.572+0000 7f8a51470740 1 -- 172.21.15.19:0/1878701196 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x557217855860 msgr2=0x557217854e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:33:03.575 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:03.572+0000 7f8a51470740 1 --2- 172.21.15.19:0/1878701196 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x557217855860 0x557217854e20 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7f8a380ac450 tx=0x7f8a38018420 comp rx=0 tx=0).stop 2024-09-10T22:33:03.575 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:03.572+0000 7f8a51470740 1 -- 172.21.15.19:0/1878701196 shutdown_connections 2024-09-10T22:33:03.575 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:03.572+0000 7f8a51470740 1 --2- 172.21.15.19:0/1878701196 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55721785abd0 0x557217851750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:33:03.575 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:03.572+0000 7f8a51470740 1 --2- 172.21.15.19:0/1878701196 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557217858190 0x557217851210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:33:03.575 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:03.572+0000 7f8a51470740 1 --2- 172.21.15.19:0/1878701196 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x557217855860 0x557217854e20 unknown :-1 s=CLOSED pgs=678 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:33:03.575 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:03.572+0000 7f8a51470740 1 -- 172.21.15.19:0/1878701196 >> 172.21.15.19:0/1878701196 conn(0x5572178509b0 msgr2=0x55721784baf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:33:03.575 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:03.572+0000 7f8a51470740 1 -- 172.21.15.19:0/1878701196 shutdown_connections 2024-09-10T22:33:03.575 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:03.572+0000 7f8a51470740 1 -- 172.21.15.19:0/1878701196 wait complete. 2024-09-10T22:33:03.575 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:03.572+0000 7f8a51470740 1 -- start start 2024-09-10T22:33:03.578 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:03.573+0000 7f8a51470740 1 Processor -- start 2024-09-10T22:33:03.578 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:03.573+0000 7f8a51470740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557217855860 0x557217864010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:33:03.578 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:03.573+0000 7f8a51470740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x557217858190 0x5572178646b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:33:03.578 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:03.573+0000 7f8a51470740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55721785abd0 0x557217865280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:33:03.578 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:03.573+0000 7f8a51470740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f8a481a6520 con 0x55721785abd0 2024-09-10T22:33:03.578 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:03.573+0000 7f8a51470740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f8a481a7990 con 0x557217855860 2024-09-10T22:33:03.579 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:03.573+0000 7f8a51470740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f8a481a6bf0 con 0x557217858190 2024-09-10T22:33:03.579 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:03.573+0000 7f8a51470740 10 client.0 _ll_register_callbacks cb 0x7f8a3800e940 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T22:33:03.579 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:03.573+0000 7f8a4cb66640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55721785abd0 0x557217865280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:33:03.579 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:03.574+0000 7f8a4cb66640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55721785abd0 0x557217865280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:58964/0 (socket says 172.21.15.19:58964) 2024-09-10T22:33:03.579 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:03.574+0000 7f8a4cb66640 1 -- 172.21.15.19:0/526043954 learned_addr learned my addr 172.21.15.19:0/526043954 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:33:03.579 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:03.574+0000 7f8a477fe640 1 --2- 172.21.15.19:0/526043954 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x557217858190 0x5572178646b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:33:03.579 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:03.574+0000 7f8a47fff640 1 --2- 172.21.15.19:0/526043954 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557217855860 0x557217864010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:33:03.579 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:03.574+0000 7f8a4cb66640 1 -- 172.21.15.19:0/526043954 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x557217858190 msgr2=0x5572178646b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:33:03.579 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:03.574+0000 7f8a4cb66640 1 --2- 172.21.15.19:0/526043954 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x557217858190 0x5572178646b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:33:03.580 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:03.574+0000 7f8a4cb66640 1 -- 172.21.15.19:0/526043954 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557217855860 msgr2=0x557217864010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:33:03.580 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:03.574+0000 7f8a4cb66640 1 --2- 172.21.15.19:0/526043954 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557217855860 0x557217864010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:33:03.580 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:03.574+0000 7f8a4cb66640 1 -- 172.21.15.19:0/526043954 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557217865ab0 con 0x55721785abd0 2024-09-10T22:33:03.580 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:03.574+0000 7f8a4cb66640 1 --2- 172.21.15.19:0/526043954 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55721785abd0 0x557217865280 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7f8a40005c10 tx=0x7f8a40007d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d4170325154641bc server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:33:03.580 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:03.574+0000 7f8a277fe640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-10T22:33:03.580 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:03.575+0000 7f8a277fe640 1 -- 172.21.15.19:0/526043954 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a4001b040 con 0x55721785abd0 2024-09-10T22:33:03.580 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:03.575+0000 7f8a277fe640 1 -- 172.21.15.19:0/526043954 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8327+0+0 (secure 0 0 0) 0x7f8a40011470 con 0x55721785abd0 2024-09-10T22:33:03.580 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:03.575+0000 7f8a51470740 1 -- 172.21.15.19:0/526043954 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8a380a6e50 con 0x55721785abd0 2024-09-10T22:33:03.580 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:03.575+0000 7f8a277fe640 1 -- 172.21.15.19:0/526043954 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f8a40007970 con 0x55721785abd0 2024-09-10T22:33:03.580 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:03.575+0000 7f8a51470740 10 client.16665 fetch_fsmap learned FSMap version 27 2024-09-10T22:33:03.580 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:03.575+0000 7f8a51470740 1 -- 172.21.15.19:0/526043954 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x557217866e50 con 0x55721785abd0 2024-09-10T22:33:03.580 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:03.576+0000 7f8a277fe640 1 -- 172.21.15.19:0/526043954 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8a380a6e50 con 0x55721785abd0 2024-09-10T22:33:03.580 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:03.576+0000 7f8a277fe640 1 -- 172.21.15.19:0/526043954 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7f8a4001e050 con 0x55721785abd0 2024-09-10T22:33:03.581 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:03.576+0000 7f8a51470740 10 client.16665 fetch_fsmap finished waiting for FSMap version 27 2024-09-10T22:33:03.581 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:03.576+0000 7f8a51470740 10 client.16665 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-10T22:33:03.581 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:03.576+0000 7f8a51470740 20 client.16665 populate_metadata read hostname 'smithi019' 2024-09-10T22:33:03.581 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:03.576+0000 7f8a51470740 1 --2- 172.21.15.19:0/526043954 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x55721786a850 0x5572178d9ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:33:03.581 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:03.577+0000 7f8a51470740 4 client.16665 mds_command: new command op to 24581 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-10T22:33:03.581 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:03.577+0000 7f8a51470740 1 -- 172.21.15.19:0/526043954 --> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5572177c50f0 con 0x55721786a850 2024-09-10T22:33:03.581 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:03.577+0000 7f8a47fff640 1 --2- 172.21.15.19:0/526043954 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x55721786a850 0x5572178d9ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:33:03.581 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:03.579+0000 7f8a277fe640 10 client.16665 ms_handle_connect on v2:172.21.15.135:6838/1254769802 2024-09-10T22:33:03.582 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:03.579+0000 7f8a47fff640 1 --2- 172.21.15.19:0/526043954 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x55721786a850 0x5572178d9ae0 crc :-1 s=READY pgs=143 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=673e5018bb0162ba server_cookie=c3ffd1e4905df316 in_seq=0 out_seq=0 2024-09-10T22:33:04.208 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:33:03 smithi019 ceph-mon[31375]: pgmap v546: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 499 KiB/s rd, 295 MiB/s wr, 229 op/s 2024-09-10T22:33:04.359 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:33:03 smithi135 ceph-mon[34789]: pgmap v546: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 499 KiB/s rd, 295 MiB/s wr, 229 op/s 2024-09-10T22:33:04.375 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:33:03 smithi138 ceph-mon[35236]: pgmap v546: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 499 KiB/s rd, 295 MiB/s wr, 229 op/s 2024-09-10T22:33:06.208 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:33:05 smithi019 ceph-mon[31375]: pgmap v547: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 740 KiB/s rd, 307 MiB/s wr, 199 op/s 2024-09-10T22:33:06.359 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:33:05 smithi135 ceph-mon[34789]: pgmap v547: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 740 KiB/s rd, 307 MiB/s wr, 199 op/s 2024-09-10T22:33:06.375 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:33:05 smithi138 ceph-mon[35236]: pgmap v547: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 740 KiB/s rd, 307 MiB/s wr, 199 op/s 2024-09-10T22:33:08.208 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:33:07 smithi019 ceph-mon[31375]: pgmap v548: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 654 KiB/s rd, 350 MiB/s wr, 223 op/s 2024-09-10T22:33:08.294 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 22997a4c-6fc2-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-10T22:33:08.360 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:33:07 smithi135 ceph-mon[34789]: pgmap v548: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 654 KiB/s rd, 350 MiB/s wr, 223 op/s 2024-09-10T22:33:08.375 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:33:07 smithi138 ceph-mon[35236]: pgmap v548: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 654 KiB/s rd, 350 MiB/s wr, 223 op/s 2024-09-10T22:33:08.642 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/22997a4c-6fc2-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T22:33:09.195 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:09.192+0000 7fb220bb2640 1 -- 172.21.15.19:0/2195781680 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb21c102de0 msgr2=0x7fb21c1031c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:33:09.196 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:09.192+0000 7fb220bb2640 1 --2- 172.21.15.19:0/2195781680 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb21c102de0 0x7fb21c1031c0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fb20c009900 tx=0x7fb20c02a410 comp rx=0 tx=0).stop 2024-09-10T22:33:09.196 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:09.193+0000 7fb220bb2640 1 -- 172.21.15.19:0/2195781680 shutdown_connections 2024-09-10T22:33:09.196 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:09.193+0000 7fb220bb2640 1 --2- 172.21.15.19:0/2195781680 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb21c109170 0x7fb21c10f970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:33:09.196 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:09.193+0000 7fb220bb2640 1 --2- 172.21.15.19:0/2195781680 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb21c1087f0 0x7fb21c108c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:33:09.196 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:09.193+0000 7fb220bb2640 1 --2- 172.21.15.19:0/2195781680 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb21c102de0 0x7fb21c1031c0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:33:09.196 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:09.193+0000 7fb220bb2640 1 -- 172.21.15.19:0/2195781680 >> 172.21.15.19:0/2195781680 conn(0x7fb21c0fe870 msgr2=0x7fb21c100c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:33:09.196 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:09.193+0000 7fb220bb2640 1 -- 172.21.15.19:0/2195781680 shutdown_connections 2024-09-10T22:33:09.196 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:09.193+0000 7fb220bb2640 1 -- 172.21.15.19:0/2195781680 wait complete. 2024-09-10T22:33:09.196 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:09.193+0000 7fb220bb2640 1 Processor -- start 2024-09-10T22:33:09.197 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:09.194+0000 7fb220bb2640 1 -- start start 2024-09-10T22:33:09.197 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:09.194+0000 7fb220bb2640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb21c102de0 0x7fb21c199360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:33:09.197 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:09.194+0000 7fb220bb2640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb21c1087f0 0x7fb21c1998a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:33:09.197 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:09.194+0000 7fb220bb2640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb21c109170 0x7fb21c19ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:33:09.197 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:09.194+0000 7fb220bb2640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fb21c112e30 con 0x7fb21c102de0 2024-09-10T22:33:09.197 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:09.194+0000 7fb220bb2640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fb21c112cb0 con 0x7fb21c1087f0 2024-09-10T22:33:09.197 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:09.194+0000 7fb220bb2640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7fb21c112fb0 con 0x7fb21c109170 2024-09-10T22:33:09.197 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:09.194+0000 7fb21a59c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb21c102de0 0x7fb21c199360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:33:09.197 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:09.194+0000 7fb21a59c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb21c102de0 0x7fb21c199360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:58976/0 (socket says 172.21.15.19:58976) 2024-09-10T22:33:09.197 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:09.194+0000 7fb21a59c640 1 -- 172.21.15.19:0/494561467 learned_addr learned my addr 172.21.15.19:0/494561467 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:33:09.197 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:09.194+0000 7fb219d9b640 1 --2- 172.21.15.19:0/494561467 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb21c1087f0 0x7fb21c1998a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:33:09.198 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:09.194+0000 7fb21ad9d640 1 --2- 172.21.15.19:0/494561467 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb21c109170 0x7fb21c19ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:33:09.199 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:09.194+0000 7fb219d9b640 1 -- 172.21.15.19:0/494561467 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb21c109170 msgr2=0x7fb21c19ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:33:09.199 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:09.194+0000 7fb219d9b640 1 --2- 172.21.15.19:0/494561467 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb21c109170 0x7fb21c19ec40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:33:09.199 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:09.194+0000 7fb219d9b640 1 -- 172.21.15.19:0/494561467 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb21c102de0 msgr2=0x7fb21c199360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:33:09.199 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:09.194+0000 7fb219d9b640 1 --2- 172.21.15.19:0/494561467 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb21c102de0 0x7fb21c199360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:33:09.199 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:09.195+0000 7fb219d9b640 1 -- 172.21.15.19:0/494561467 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb21c19f410 con 0x7fb21c1087f0 2024-09-10T22:33:09.199 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:09.195+0000 7fb21a59c640 1 --2- 172.21.15.19:0/494561467 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb21c102de0 0x7fb21c199360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T22:33:09.199 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:09.195+0000 7fb21ad9d640 1 --2- 172.21.15.19:0/494561467 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb21c109170 0x7fb21c19ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T22:33:09.199 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:09.195+0000 7fb219d9b640 1 --2- 172.21.15.19:0/494561467 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb21c1087f0 0x7fb21c1998a0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fb21000e9f0 tx=0x7fb21000eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:33:09.200 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:09.195+0000 7fb20b7fe640 1 -- 172.21.15.19:0/494561467 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb21000ccc0 con 0x7fb21c1087f0 2024-09-10T22:33:09.200 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:09.195+0000 7fb20b7fe640 1 -- 172.21.15.19:0/494561467 <== mon.2 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb2100108e0 con 0x7fb21c1087f0 2024-09-10T22:33:09.200 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:09.195+0000 7fb220bb2640 1 -- 172.21.15.19:0/494561467 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb21c19f700 con 0x7fb21c1087f0 2024-09-10T22:33:09.200 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:09.195+0000 7fb20b7fe640 1 -- 172.21.15.19:0/494561467 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb210018880 con 0x7fb21c1087f0 2024-09-10T22:33:09.200 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:09.195+0000 7fb220bb2640 1 -- 172.21.15.19:0/494561467 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb21c1a5f90 con 0x7fb21c1087f0 2024-09-10T22:33:09.202 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:09.198+0000 7fb20b7fe640 1 -- 172.21.15.19:0/494561467 <== mon.2 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 18) ==== 153250+0+0 (secure 0 0 0) 0x7fb210010430 con 0x7fb21c1087f0 2024-09-10T22:33:09.202 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:09.198+0000 7fb222f87740 1 Processor -- start 2024-09-10T22:33:09.202 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:09.198+0000 7fb222f87740 1 -- start start 2024-09-10T22:33:09.202 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:09.199+0000 7fb222f87740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a17ae86480 0x55a17ae86860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:33:09.202 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:09.199+0000 7fb222f87740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55a17ae86da0 0x55a17ae96c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:33:09.202 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:09.199+0000 7fb222f87740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55a17ae97140 0x55a17ae99530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:33:09.202 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:09.199+0000 7fb222f87740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x55a17adfce50 con 0x55a17ae97140 2024-09-10T22:33:09.202 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:09.199+0000 7fb222f87740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55a17adec280 con 0x55a17ae86480 2024-09-10T22:33:09.202 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:09.199+0000 7fb222f87740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x55a17adf0090 con 0x55a17ae86da0 2024-09-10T22:33:09.203 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:09.199+0000 7fb21ad9d640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a17ae86480 0x55a17ae86860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:33:09.203 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:09.199+0000 7fb21ad9d640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a17ae86480 0x55a17ae86860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.19:38156/0 (socket says 172.21.15.19:38156) 2024-09-10T22:33:09.203 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:09.199+0000 7fb20b7fe640 1 --2- 172.21.15.19:0/494561467 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7fb2040b5360 0x7fb2040b7820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:33:09.203 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:09.199+0000 7fb21ad9d640 1 -- 172.21.15.19:0/1227335604 learned_addr learned my addr 172.21.15.19:0/1227335604 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:33:09.203 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:09.199+0000 7fb21a59c640 1 --2- 172.21.15.19:0/1227335604 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55a17ae86da0 0x55a17ae96c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:33:09.203 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:09.200+0000 7fb20b7fe640 1 -- 172.21.15.19:0/494561467 <== mon.2 v2:172.21.15.135:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8327+0+0 (secure 0 0 0) 0x7fb2100e5ff0 con 0x7fb21c1087f0 2024-09-10T22:33:09.203 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:09.200+0000 7fb21ad9d640 1 --2- 172.21.15.19:0/494561467 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7fb2040b5360 0x7fb2040b7820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:33:09.203 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:09.200+0000 7fb21a59c640 1 -- 172.21.15.19:0/1227335604 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a17ae86480 msgr2=0x55a17ae86860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:33:09.203 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:09.200+0000 7fb21a59c640 1 --2- 172.21.15.19:0/1227335604 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a17ae86480 0x55a17ae86860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:33:09.203 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:09.200+0000 7fb21a59c640 1 -- 172.21.15.19:0/1227335604 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55a17ae97140 msgr2=0x55a17ae99530 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-10T22:33:09.204 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:09.200+0000 7fb219d9b640 1 --2- 172.21.15.19:0/1227335604 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55a17ae97140 0x55a17ae99530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:33:09.204 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:09.200+0000 7fb21a59c640 1 --2- 172.21.15.19:0/1227335604 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55a17ae97140 0x55a17ae99530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:33:09.204 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:09.200+0000 7fb21a59c640 1 -- 172.21.15.19:0/1227335604 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a17ab4a650 con 0x55a17ae86da0 2024-09-10T22:33:09.208 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:09.200+0000 7fb21a59c640 1 --2- 172.21.15.19:0/1227335604 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55a17ae86da0 0x55a17ae96c00 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fb20c004770 tx=0x7fb20c032ed0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=18c78fecc8563c94 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:33:09.208 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:09.200+0000 7fb208ff9640 1 -- 172.21.15.19:0/1227335604 <== mon.1 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb20c035040 con 0x55a17ae86da0 2024-09-10T22:33:09.208 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:09.200+0000 7fb208ff9640 1 -- 172.21.15.19:0/1227335604 <== mon.1 v2:172.21.15.138:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb20c043de0 con 0x55a17ae86da0 2024-09-10T22:33:09.208 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:09.200+0000 7fb208ff9640 1 -- 172.21.15.19:0/1227335604 <== mon.1 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb20c0053b0 con 0x55a17ae86da0 2024-09-10T22:33:09.208 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:09.201+0000 7fb219d9b640 1 --2- 172.21.15.19:0/1227335604 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55a17ae97140 0x55a17ae99530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T22:33:09.208 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:09.201+0000 7fb222f87740 1 -- 172.21.15.19:0/1227335604 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55a17ae86da0 msgr2=0x55a17ae96c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:33:09.209 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:09.201+0000 7fb222f87740 1 --2- 172.21.15.19:0/1227335604 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55a17ae86da0 0x55a17ae96c00 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fb20c004770 tx=0x7fb20c032ed0 comp rx=0 tx=0).stop 2024-09-10T22:33:09.209 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:09.201+0000 7fb21ad9d640 1 --2- 172.21.15.19:0/494561467 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7fb2040b5360 0x7fb2040b7820 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7fb214009fd0 tx=0x7fb214009ea0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:33:09.209 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:09.202+0000 7fb222f87740 1 -- 172.21.15.19:0/1227335604 shutdown_connections 2024-09-10T22:33:09.209 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:09.202+0000 7fb222f87740 1 --2- 172.21.15.19:0/1227335604 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55a17ae97140 0x55a17ae99530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:33:09.209 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:09.202+0000 7fb222f87740 1 --2- 172.21.15.19:0/1227335604 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55a17ae86da0 0x55a17ae96c00 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:33:09.209 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:09.202+0000 7fb222f87740 1 --2- 172.21.15.19:0/1227335604 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a17ae86480 0x55a17ae86860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:33:09.209 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:09.202+0000 7fb222f87740 1 -- 172.21.15.19:0/1227335604 >> 172.21.15.19:0/1227335604 conn(0x55a17ae842b0 msgr2=0x55a17ae85450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:33:09.209 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:09.202+0000 7fb222f87740 1 -- 172.21.15.19:0/1227335604 shutdown_connections 2024-09-10T22:33:09.209 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:09.202+0000 7fb222f87740 1 -- 172.21.15.19:0/1227335604 wait complete. 2024-09-10T22:33:09.209 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:09.202+0000 7fb222f87740 1 -- start start 2024-09-10T22:33:09.209 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:09.202+0000 7fb222f87740 1 Processor -- start 2024-09-10T22:33:09.209 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:09.203+0000 7fb222f87740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55a17ae86480 0x55a17ae96b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:33:09.210 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:09.203+0000 7fb222f87740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a17ae86da0 0x55a17ae8ff30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:33:09.210 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:09.203+0000 7fb222f87740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55a17ae97140 0x55a17ae90620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:33:09.210 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:09.203+0000 7fb222f87740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x55a17ac4d700 con 0x55a17ae97140 2024-09-10T22:33:09.210 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:09.203+0000 7fb222f87740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55a17ad87110 con 0x55a17ae86da0 2024-09-10T22:33:09.210 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:09.203+0000 7fb222f87740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x55a17ae8c990 con 0x55a17ae86480 2024-09-10T22:33:09.210 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:09.203+0000 7fb222f87740 10 client.0 _ll_register_callbacks cb 0x55a17ada0990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T22:33:09.210 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:09.203+0000 7fb21a59c640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55a17ae86480 0x55a17ae96b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:33:09.210 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:09.203+0000 7fb21a59c640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55a17ae86480 0x55a17ae96b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.19:51706/0 (socket says 172.21.15.19:51706) 2024-09-10T22:33:09.210 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:09.203+0000 7fb21a59c640 1 -- 172.21.15.19:0/2031095390 learned_addr learned my addr 172.21.15.19:0/2031095390 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:33:09.210 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:09.203+0000 7fb219d9b640 1 --2- 172.21.15.19:0/2031095390 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a17ae86da0 0x55a17ae8ff30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:33:09.210 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:09.203+0000 7fb21ad9d640 1 --2- 172.21.15.19:0/2031095390 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55a17ae97140 0x55a17ae90620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:33:09.210 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:09.203+0000 7fb21a59c640 1 -- 172.21.15.19:0/2031095390 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a17ae86da0 msgr2=0x55a17ae8ff30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:33:09.210 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:09.203+0000 7fb21a59c640 1 --2- 172.21.15.19:0/2031095390 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a17ae86da0 0x55a17ae8ff30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:33:09.210 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:09.203+0000 7fb21a59c640 1 -- 172.21.15.19:0/2031095390 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55a17ae97140 msgr2=0x55a17ae90620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:33:09.211 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:09.203+0000 7fb21a59c640 1 --2- 172.21.15.19:0/2031095390 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55a17ae97140 0x55a17ae90620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:33:09.211 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:09.203+0000 7fb21a59c640 1 -- 172.21.15.19:0/2031095390 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a17adb4c40 con 0x55a17ae86480 2024-09-10T22:33:09.211 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:09.204+0000 7fb21a59c640 1 --2- 172.21.15.19:0/2031095390 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55a17ae86480 0x55a17ae96b00 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fb20c031850 tx=0x7fb20c031880 comp rx=0 tx=0).ready entity=mon.1 client_cookie=441548c1926358de server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:33:09.211 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:09.204+0000 7fb201ffb640 10 client.0 ms_handle_connect on v2:172.21.15.138:3300/0 2024-09-10T22:33:09.211 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:09.204+0000 7fb201ffb640 1 -- 172.21.15.19:0/2031095390 <== mon.1 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb20c054030 con 0x55a17ae86480 2024-09-10T22:33:09.211 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:09.204+0000 7fb222f87740 1 -- 172.21.15.19:0/2031095390 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb20c043de0 con 0x55a17ae86480 2024-09-10T22:33:09.211 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:09.204+0000 7fb201ffb640 1 -- 172.21.15.19:0/2031095390 <== mon.1 v2:172.21.15.138:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8327+0+0 (secure 0 0 0) 0x7fb20c0053a0 con 0x55a17ae86480 2024-09-10T22:33:09.211 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:09.204+0000 7fb201ffb640 1 -- 172.21.15.19:0/2031095390 <== mon.1 v2:172.21.15.138:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fb20c035040 con 0x55a17ae86480 2024-09-10T22:33:09.211 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:09.204+0000 7fb222f87740 10 client.26095 fetch_fsmap learned FSMap version 27 2024-09-10T22:33:09.212 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:09.204+0000 7fb222f87740 1 -- 172.21.15.19:0/2031095390 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55a17aea1230 con 0x55a17ae86480 2024-09-10T22:33:09.212 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:09.204+0000 7fb201ffb640 1 -- 172.21.15.19:0/2031095390 <== mon.1 v2:172.21.15.138:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb20c043de0 con 0x55a17ae86480 2024-09-10T22:33:09.212 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:09.204+0000 7fb201ffb640 1 -- 172.21.15.19:0/2031095390 <== mon.1 v2:172.21.15.138:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7fb20c05b4c0 con 0x55a17ae86480 2024-09-10T22:33:09.212 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:09.204+0000 7fb222f87740 10 client.26095 fetch_fsmap finished waiting for FSMap version 27 2024-09-10T22:33:09.212 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:09.204+0000 7fb222f87740 10 client.26095 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-10T22:33:09.212 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:09.204+0000 7fb222f87740 20 client.26095 populate_metadata read hostname 'smithi019' 2024-09-10T22:33:09.212 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:09.204+0000 7fb222f87740 1 --2- 172.21.15.19:0/2031095390 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x55a17aea2580 0x55a17aea4970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:33:09.212 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:09.205+0000 7fb222f87740 4 client.26095 mds_command: new command op to 24581 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T22:33:09.212 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:09.205+0000 7fb222f87740 1 -- 172.21.15.19:0/2031095390 --> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a17adfeda0 con 0x55a17aea2580 2024-09-10T22:33:09.212 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:09.205+0000 7fb219d9b640 1 --2- 172.21.15.19:0/2031095390 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x55a17aea2580 0x55a17aea4970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:33:09.212 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:09.205+0000 7fb201ffb640 10 client.26095 ms_handle_connect on v2:172.21.15.135:6838/1254769802 2024-09-10T22:33:09.213 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:09.205+0000 7fb219d9b640 1 --2- 172.21.15.19:0/2031095390 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x55a17aea2580 0x55a17aea4970 crc :-1 s=READY pgs=144 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bdd0f4c84bac2b5a server_cookie=14561af4f0af8055 in_seq=0 out_seq=0 2024-09-10T22:33:09.213 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:09.206+0000 7fb201ffb640 1 -- 172.21.15.19:0/2031095390 <== mds.0 v2:172.21.15.135:6838/1254769802 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55a17adfeda0 con 0x55a17aea2580 2024-09-10T22:33:09.213 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:09.206+0000 7fb201ffb640 10 client.26095 handle_command_reply: tid=0 2024-09-10T22:33:09.213 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:09.206+0000 7fb222f87740 1 client.26095 shutdown 2024-09-10T22:33:09.213 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:09.206+0000 7fb222f87740 1 -- 172.21.15.19:0/2031095390 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55a17ae86480 msgr2=0x55a17ae96b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:33:09.213 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:09.206+0000 7fb222f87740 1 --2- 172.21.15.19:0/2031095390 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55a17ae86480 0x55a17ae96b00 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fb20c031850 tx=0x7fb20c031880 comp rx=0 tx=0).stop 2024-09-10T22:33:09.214 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:09.206+0000 7fb222f87740 1 -- 172.21.15.19:0/2031095390 shutdown_connections 2024-09-10T22:33:09.214 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:09.206+0000 7fb222f87740 1 --2- 172.21.15.19:0/2031095390 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55a17ae97140 0x55a17ae90620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:33:09.214 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:09.206+0000 7fb222f87740 1 --2- 172.21.15.19:0/2031095390 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a17ae86da0 0x55a17ae8ff30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:33:09.214 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:09.206+0000 7fb222f87740 1 --2- 172.21.15.19:0/2031095390 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x55a17aea2580 0x55a17aea4970 crc :-1 s=READY pgs=144 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:33:09.214 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:09.206+0000 7fb222f87740 1 --2- 172.21.15.19:0/2031095390 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55a17ae86480 0x55a17ae96b00 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:33:09.214 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:09.206+0000 7fb222f87740 1 -- 172.21.15.19:0/2031095390 >> 172.21.15.19:0/2031095390 conn(0x55a17ae842b0 msgr2=0x55a17ae89e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:33:09.214 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:09.206+0000 7fb201ffb640 0 client.26095 ms_handle_reset on v2:172.21.15.135:6838/1254769802 2024-09-10T22:33:09.214 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:09.206+0000 7fb222f87740 1 -- 172.21.15.19:0/2031095390 shutdown_connections 2024-09-10T22:33:09.214 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:09.206+0000 7fb222f87740 1 -- 172.21.15.19:0/2031095390 wait complete. 2024-09-10T22:33:09.214 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:09.207+0000 7fb222f87740 20 client.26095 trim_cache size 0 max 16384 2024-09-10T22:33:09.228 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:09.227+0000 7fb222f87740 1 Processor -- start 2024-09-10T22:33:09.228 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:09.227+0000 7fb222f87740 1 -- start start 2024-09-10T22:33:09.228 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:09.227+0000 7fb222f87740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a17ae86480 0x55a17ae8f420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:33:09.228 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:09.227+0000 7fb222f87740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55a17ae86da0 0x55a17aeaa5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:33:09.229 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:09.227+0000 7fb222f87740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55a17ae97140 0x55a17ae98010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:33:09.229 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:09.227+0000 7fb222f87740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fb21c1aeda0 con 0x55a17ae97140 2024-09-10T22:33:09.229 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:09.227+0000 7fb222f87740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fb21c1ac670 con 0x55a17ae86480 2024-09-10T22:33:09.229 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:09.227+0000 7fb222f87740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7fb21c1aa4c0 con 0x55a17ae86da0 2024-09-10T22:33:09.230 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:09.227+0000 7fb21ad9d640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55a17ae97140 0x55a17ae98010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:33:09.230 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:09.227+0000 7fb219d9b640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55a17ae86da0 0x55a17aeaa5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:33:09.230 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:09.227+0000 7fb21a59c640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a17ae86480 0x55a17ae8f420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:33:09.230 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:09.227+0000 7fb21ad9d640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55a17ae97140 0x55a17ae98010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:59006/0 (socket says 172.21.15.19:59006) 2024-09-10T22:33:09.230 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:09.227+0000 7fb219d9b640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55a17ae86da0 0x55a17aeaa5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.19:51718/0 (socket says 172.21.15.19:51718) 2024-09-10T22:33:09.230 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:09.227+0000 7fb21ad9d640 1 -- 172.21.15.19:0/2176997480 learned_addr learned my addr 172.21.15.19:0/2176997480 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:33:09.230 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:09.227+0000 7fb21a59c640 1 -- 172.21.15.19:0/2176997480 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55a17ae86da0 msgr2=0x55a17aeaa5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:33:09.230 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:09.227+0000 7fb21a59c640 1 --2- 172.21.15.19:0/2176997480 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55a17ae86da0 0x55a17aeaa5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:33:09.230 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:09.227+0000 7fb21a59c640 1 -- 172.21.15.19:0/2176997480 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55a17ae97140 msgr2=0x55a17ae98010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:33:09.231 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:09.227+0000 7fb21a59c640 1 --2- 172.21.15.19:0/2176997480 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55a17ae97140 0x55a17ae98010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:33:09.231 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:09.227+0000 7fb21a59c640 1 -- 172.21.15.19:0/2176997480 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a17ae85e60 con 0x55a17ae86480 2024-09-10T22:33:09.231 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:09.227+0000 7fb219d9b640 1 --2- 172.21.15.19:0/2176997480 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55a17ae86da0 0x55a17aeaa5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T22:33:09.231 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:09.227+0000 7fb21ad9d640 1 --2- 172.21.15.19:0/2176997480 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55a17ae97140 0x55a17ae98010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T22:33:09.231 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:09.228+0000 7fb21a59c640 1 --2- 172.21.15.19:0/2176997480 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a17ae86480 0x55a17ae8f420 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fb20c05b910 tx=0x7fb20c000bc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3ec6b1bfd2656531 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:33:09.231 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:09.228+0000 7fb203fff640 1 -- 172.21.15.19:0/2176997480 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb20c054020 con 0x55a17ae86480 2024-09-10T22:33:09.231 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:09.228+0000 7fb203fff640 1 -- 172.21.15.19:0/2176997480 <== mon.2 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb20c031da0 con 0x55a17ae86480 2024-09-10T22:33:09.231 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:09.228+0000 7fb203fff640 1 -- 172.21.15.19:0/2176997480 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb20c05b0b0 con 0x55a17ae86480 2024-09-10T22:33:09.235 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:09.229+0000 7fb222f87740 1 -- 172.21.15.19:0/2176997480 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a17ae86480 msgr2=0x55a17ae8f420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:33:09.235 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:09.229+0000 7fb222f87740 1 --2- 172.21.15.19:0/2176997480 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a17ae86480 0x55a17ae8f420 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fb20c05b910 tx=0x7fb20c000bc0 comp rx=0 tx=0).stop 2024-09-10T22:33:09.235 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:09.229+0000 7fb222f87740 1 -- 172.21.15.19:0/2176997480 shutdown_connections 2024-09-10T22:33:09.235 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:09.229+0000 7fb222f87740 1 --2- 172.21.15.19:0/2176997480 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55a17ae97140 0x55a17ae98010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:33:09.235 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:09.229+0000 7fb222f87740 1 --2- 172.21.15.19:0/2176997480 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55a17ae86da0 0x55a17aeaa5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:33:09.235 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:09.229+0000 7fb222f87740 1 --2- 172.21.15.19:0/2176997480 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a17ae86480 0x55a17ae8f420 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:33:09.235 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:09.229+0000 7fb222f87740 1 -- 172.21.15.19:0/2176997480 >> 172.21.15.19:0/2176997480 conn(0x55a17ae842b0 msgr2=0x55a17ae97520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:33:09.236 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:09.229+0000 7fb222f87740 1 -- 172.21.15.19:0/2176997480 shutdown_connections 2024-09-10T22:33:09.236 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:09.229+0000 7fb222f87740 1 -- 172.21.15.19:0/2176997480 wait complete. 2024-09-10T22:33:09.236 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:09.229+0000 7fb222f87740 1 -- start start 2024-09-10T22:33:09.236 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:09.230+0000 7fb222f87740 1 Processor -- start 2024-09-10T22:33:09.236 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:09.230+0000 7fb222f87740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55a17ae86480 0x55a17ae9c5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:33:09.236 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:09.230+0000 7fb222f87740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a17ae86da0 0x55a17ae9cb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:33:09.236 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:09.230+0000 7fb222f87740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55a17ae97140 0x55a17af070b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:33:09.236 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:09.230+0000 7fb219d9b640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a17ae86da0 0x55a17ae9cb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:33:09.236 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:09.230+0000 7fb222f87740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fb21c1aab30 con 0x55a17ae97140 2024-09-10T22:33:09.236 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:09.230+0000 7fb21ad9d640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55a17ae97140 0x55a17af070b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:33:09.236 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:09.230+0000 7fb222f87740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fb21c1abfa0 con 0x55a17ae86da0 2024-09-10T22:33:09.237 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:09.230+0000 7fb222f87740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7fb21c1ab200 con 0x55a17ae86480 2024-09-10T22:33:09.237 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:09.230+0000 7fb219d9b640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a17ae86da0 0x55a17ae9cb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.19:38182/0 (socket says 172.21.15.19:38182) 2024-09-10T22:33:09.237 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:09.230+0000 7fb219d9b640 1 -- 172.21.15.19:0/1631107198 learned_addr learned my addr 172.21.15.19:0/1631107198 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:33:09.237 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:09.230+0000 7fb21a59c640 1 --2- 172.21.15.19:0/1631107198 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55a17ae86480 0x55a17ae9c5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:33:09.237 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:09.230+0000 7fb222f87740 10 client.0 _ll_register_callbacks cb 0x7fb214009a70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T22:33:09.237 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:09.230+0000 7fb219d9b640 1 -- 172.21.15.19:0/1631107198 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55a17ae86480 msgr2=0x55a17ae9c5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:33:09.237 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:09.230+0000 7fb219d9b640 1 --2- 172.21.15.19:0/1631107198 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55a17ae86480 0x55a17ae9c5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:33:09.237 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:09.231+0000 7fb219d9b640 1 -- 172.21.15.19:0/1631107198 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55a17ae97140 msgr2=0x55a17af070b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:33:09.237 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:09.231+0000 7fb219d9b640 1 --2- 172.21.15.19:0/1631107198 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55a17ae97140 0x55a17af070b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:33:09.238 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:09.231+0000 7fb219d9b640 1 -- 172.21.15.19:0/1631107198 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a17af077f0 con 0x55a17ae86da0 2024-09-10T22:33:09.238 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:09.231+0000 7fb21ad9d640 1 --2- 172.21.15.19:0/1631107198 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55a17ae97140 0x55a17af070b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T22:33:09.238 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:09.231+0000 7fb219d9b640 1 --2- 172.21.15.19:0/1631107198 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a17ae86da0 0x55a17ae9cb60 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fb2100ac3f0 tx=0x7fb21000ce60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9cb02241ec741958 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:33:09.238 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:09.231+0000 7fb201ffb640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-09-10T22:33:09.238 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:09.231+0000 7fb201ffb640 1 -- 172.21.15.19:0/1631107198 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2100b5c80 con 0x55a17ae86da0 2024-09-10T22:33:09.238 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:09.231+0000 7fb201ffb640 1 -- 172.21.15.19:0/1631107198 <== mon.2 v2:172.21.15.135:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8327+0+0 (secure 0 0 0) 0x7fb210010a90 con 0x55a17ae86da0 2024-09-10T22:33:09.239 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:09.231+0000 7fb222f87740 1 -- 172.21.15.19:0/1631107198 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb20c031da0 con 0x55a17ae86da0 2024-09-10T22:33:09.239 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:09.231+0000 7fb201ffb640 1 -- 172.21.15.19:0/1631107198 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fb2100a8960 con 0x55a17ae86da0 2024-09-10T22:33:09.239 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:09.231+0000 7fb222f87740 10 client.26072 fetch_fsmap learned FSMap version 27 2024-09-10T22:33:09.239 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:09.231+0000 7fb222f87740 1 -- 172.21.15.19:0/1631107198 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55a17af0ec40 con 0x55a17ae86da0 2024-09-10T22:33:09.239 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:09.231+0000 7fb201ffb640 1 -- 172.21.15.19:0/1631107198 <== mon.2 v2:172.21.15.135:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb20c031da0 con 0x55a17ae86da0 2024-09-10T22:33:09.239 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:09.232+0000 7fb201ffb640 1 -- 172.21.15.19:0/1631107198 <== mon.2 v2:172.21.15.135:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7fb2100c4080 con 0x55a17ae86da0 2024-09-10T22:33:09.239 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:09.232+0000 7fb222f87740 10 client.26072 fetch_fsmap finished waiting for FSMap version 27 2024-09-10T22:33:09.240 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:09.232+0000 7fb222f87740 10 client.26072 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-10T22:33:09.240 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:09.232+0000 7fb222f87740 20 client.26072 populate_metadata read hostname 'smithi019' 2024-09-10T22:33:09.240 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:09.232+0000 7fb222f87740 1 --2- 172.21.15.19:0/1631107198 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x55a17af0f370 0x55a17af11790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:33:09.240 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:09.232+0000 7fb222f87740 4 client.26072 mds_command: new command op to 24581 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-10T22:33:09.240 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:09.232+0000 7fb222f87740 1 -- 172.21.15.19:0/1631107198 --> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55a17adfa850 con 0x55a17af0f370 2024-09-10T22:33:09.240 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:09.232+0000 7fb21a59c640 1 --2- 172.21.15.19:0/1631107198 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x55a17af0f370 0x55a17af11790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:33:09.241 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:09.232+0000 7fb21a59c640 1 --2- 172.21.15.19:0/1631107198 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x55a17af0f370 0x55a17af11790 crc :-1 s=READY pgs=145 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=52de0c449477f4e6 server_cookie=3bf60ee0bebe30d8 in_seq=0 out_seq=0 2024-09-10T22:33:09.241 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:09.232+0000 7fb201ffb640 10 client.26072 ms_handle_connect on v2:172.21.15.135:6838/1254769802 2024-09-10T22:33:09.241 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:09.233+0000 7fb201ffb640 1 -- 172.21.15.19:0/1631107198 <== mds.0 v2:172.21.15.135:6838/1254769802 1 ==== command_reply(tid 0: 0 ) ==== 8+0+2646 (crc 0 0 0) 0x55a17adfa850 con 0x55a17af0f370 2024-09-10T22:33:09.241 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:09.233+0000 7fb201ffb640 10 client.26072 handle_command_reply: tid=0 2024-09-10T22:33:09.241 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:09.233+0000 7fb222f87740 1 client.26072 shutdown 2024-09-10T22:33:09.241 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:09.233+0000 7fb222f87740 1 -- 172.21.15.19:0/1631107198 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a17ae86da0 msgr2=0x55a17ae9cb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:33:09.241 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:09.233+0000 7fb222f87740 1 --2- 172.21.15.19:0/1631107198 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a17ae86da0 0x55a17ae9cb60 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fb2100ac3f0 tx=0x7fb21000ce60 comp rx=0 tx=0).stop 2024-09-10T22:33:09.241 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:09.233+0000 7fb222f87740 1 -- 172.21.15.19:0/1631107198 shutdown_connections 2024-09-10T22:33:09.241 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:09.233+0000 7fb222f87740 1 --2- 172.21.15.19:0/1631107198 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55a17ae97140 0x55a17af070b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:33:09.241 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:09.233+0000 7fb222f87740 1 --2- 172.21.15.19:0/1631107198 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a17ae86da0 0x55a17ae9cb60 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:33:09.241 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:09.233+0000 7fb222f87740 1 --2- 172.21.15.19:0/1631107198 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x55a17af0f370 0x55a17af11790 crc :-1 s=READY pgs=145 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:33:09.241 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:09.233+0000 7fb222f87740 1 --2- 172.21.15.19:0/1631107198 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55a17ae86480 0x55a17ae9c5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:33:09.242 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:09.233+0000 7fb201ffb640 0 client.26072 ms_handle_reset on v2:172.21.15.135:6838/1254769802 2024-09-10T22:33:09.242 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:09.233+0000 7fb222f87740 1 -- 172.21.15.19:0/1631107198 >> 172.21.15.19:0/1631107198 conn(0x55a17ae842b0 msgr2=0x55a17ae852a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:33:09.242 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:09.233+0000 7fb222f87740 1 -- 172.21.15.19:0/1631107198 shutdown_connections 2024-09-10T22:33:09.242 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:09.233+0000 7fb222f87740 1 -- 172.21.15.19:0/1631107198 wait complete. 2024-09-10T22:33:09.242 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:09.233+0000 7fb222f87740 20 client.26072 trim_cache size 0 max 16384 2024-09-10T22:33:09.242 INFO:teuthology.orchestra.run.smithi019.stdout:{ 2024-09-10T22:33:09.242 INFO:teuthology.orchestra.run.smithi019.stdout: "status": "no active scrubs running", 2024-09-10T22:33:09.242 INFO:teuthology.orchestra.run.smithi019.stdout: "scrubs": {}, 2024-09-10T22:33:09.242 INFO:teuthology.orchestra.run.smithi019.stdout: "scrub_stats": { 2024-09-10T22:33:09.243 INFO:teuthology.orchestra.run.smithi019.stdout: "0b81ea61-0b8e-4f2c-a58f-ef1019289fc9": { 2024-09-10T22:33:09.243 INFO:teuthology.orchestra.run.smithi019.stdout: "start_time": "2024-09-10T22:31:48.141568+0000", 2024-09-10T22:33:09.243 INFO:teuthology.orchestra.run.smithi019.stdout: "path": "/", 2024-09-10T22:33:09.243 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_started": 0, 2024-09-10T22:33:09.243 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_passed": 0, 2024-09-10T22:33:09.243 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_failed": 0, 2024-09-10T22:33:09.243 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_skipped": 0 2024-09-10T22:33:09.243 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:33:09.243 INFO:teuthology.orchestra.run.smithi019.stdout: "715ec863-8a9d-45b6-967f-59b15ce1bf12": { 2024-09-10T22:33:09.243 INFO:teuthology.orchestra.run.smithi019.stdout: "start_time": "2024-09-10T22:31:00.669516+0000", 2024-09-10T22:33:09.243 INFO:teuthology.orchestra.run.smithi019.stdout: "path": "/", 2024-09-10T22:33:09.243 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_started": 0, 2024-09-10T22:33:09.244 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_passed": 0, 2024-09-10T22:33:09.244 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_failed": 0, 2024-09-10T22:33:09.244 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_skipped": 0 2024-09-10T22:33:09.244 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:33:09.244 INFO:teuthology.orchestra.run.smithi019.stdout: "fd1f1837-dcfa-4d88-99e8-2509f36c3f98": { 2024-09-10T22:33:09.244 INFO:teuthology.orchestra.run.smithi019.stdout: "start_time": "2024-09-10T22:30:12.470477+0000", 2024-09-10T22:33:09.244 INFO:teuthology.orchestra.run.smithi019.stdout: "path": "/", 2024-09-10T22:33:09.244 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_started": 0, 2024-09-10T22:33:09.244 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_passed": 0, 2024-09-10T22:33:09.244 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_failed": 0, 2024-09-10T22:33:09.244 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_skipped": 0 2024-09-10T22:33:09.245 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:33:09.245 INFO:teuthology.orchestra.run.smithi019.stdout: "8f3bb3bf-911f-490c-9856-c80ea220dbbe": { 2024-09-10T22:33:09.245 INFO:teuthology.orchestra.run.smithi019.stdout: "start_time": "2024-09-10T22:29:25.374415+0000", 2024-09-10T22:33:09.245 INFO:teuthology.orchestra.run.smithi019.stdout: "path": "/", 2024-09-10T22:33:09.245 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_started": 0, 2024-09-10T22:33:09.245 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_passed": 0, 2024-09-10T22:33:09.245 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_failed": 0, 2024-09-10T22:33:09.246 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_skipped": 0 2024-09-10T22:33:09.246 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:33:09.246 INFO:teuthology.orchestra.run.smithi019.stdout: "eb518e3c-a71e-4f32-9ca0-ae88930ca218": { 2024-09-10T22:33:09.246 INFO:teuthology.orchestra.run.smithi019.stdout: "start_time": "2024-09-10T22:28:38.366352+0000", 2024-09-10T22:33:09.246 INFO:teuthology.orchestra.run.smithi019.stdout: "path": "/", 2024-09-10T22:33:09.246 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_started": 0, 2024-09-10T22:33:09.246 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_passed": 0, 2024-09-10T22:33:09.247 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_failed": 0, 2024-09-10T22:33:09.247 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_skipped": 0 2024-09-10T22:33:09.247 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:33:09.247 INFO:teuthology.orchestra.run.smithi019.stdout: "4c99964e-2e0e-4ffd-8cb8-99c4979ed90f": { 2024-09-10T22:33:09.247 INFO:teuthology.orchestra.run.smithi019.stdout: "start_time": "2024-09-10T22:32:34.659639+0000", 2024-09-10T22:33:09.247 INFO:teuthology.orchestra.run.smithi019.stdout: "path": "/", 2024-09-10T22:33:09.247 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_started": 0, 2024-09-10T22:33:09.247 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_passed": 0, 2024-09-10T22:33:09.247 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_failed": 0, 2024-09-10T22:33:09.247 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_skipped": 0 2024-09-10T22:33:09.247 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:33:09.248 INFO:teuthology.orchestra.run.smithi019.stdout: "c12c2a04-dcd6-4673-a98e-93f665d3f5d7": { 2024-09-10T22:33:09.248 INFO:teuthology.orchestra.run.smithi019.stdout: "start_time": "2024-09-10T22:27:49.392329+0000", 2024-09-10T22:33:09.248 INFO:teuthology.orchestra.run.smithi019.stdout: "path": "/", 2024-09-10T22:33:09.248 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_started": 0, 2024-09-10T22:33:09.248 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_passed": 0, 2024-09-10T22:33:09.248 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_failed": 0, 2024-09-10T22:33:09.248 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_skipped": 0 2024-09-10T22:33:09.248 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:33:09.248 INFO:teuthology.orchestra.run.smithi019.stdout: "b38852c8-478a-42ef-8384-b2c55d5313a4": { 2024-09-10T22:33:09.249 INFO:teuthology.orchestra.run.smithi019.stdout: "start_time": "2024-09-10T22:27:00.320308+0000", 2024-09-10T22:33:09.249 INFO:teuthology.orchestra.run.smithi019.stdout: "path": "/", 2024-09-10T22:33:09.249 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_started": 0, 2024-09-10T22:33:09.249 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_passed": 0, 2024-09-10T22:33:09.249 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_failed": 0, 2024-09-10T22:33:09.249 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_skipped": 0 2024-09-10T22:33:09.249 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:33:09.249 INFO:teuthology.orchestra.run.smithi019.stdout: "9b6bfdee-303c-4c12-af56-dc85860d112a": { 2024-09-10T22:33:09.249 INFO:teuthology.orchestra.run.smithi019.stdout: "start_time": "2024-09-10T22:26:17.484162+0000", 2024-09-10T22:33:09.249 INFO:teuthology.orchestra.run.smithi019.stdout: "path": "/", 2024-09-10T22:33:09.249 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_started": 0, 2024-09-10T22:33:09.249 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_passed": 0, 2024-09-10T22:33:09.250 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_failed": 0, 2024-09-10T22:33:09.250 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_skipped": 0 2024-09-10T22:33:09.250 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-10T22:33:09.250 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-10T22:33:09.250 INFO:teuthology.orchestra.run.smithi019.stdout:} 2024-09-10T22:33:09.250 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:09.234+0000 7fb220bb2640 1 -- 172.21.15.19:0/494561467 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7fb2040b5360 msgr2=0x7fb2040b7820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:33:09.250 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:09.234+0000 7fb220bb2640 1 --2- 172.21.15.19:0/494561467 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7fb2040b5360 0x7fb2040b7820 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7fb214009fd0 tx=0x7fb214009ea0 comp rx=0 tx=0).stop 2024-09-10T22:33:09.251 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:09.234+0000 7fb220bb2640 1 -- 172.21.15.19:0/494561467 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb21c1087f0 msgr2=0x7fb21c1998a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:33:09.251 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:09.234+0000 7fb220bb2640 1 --2- 172.21.15.19:0/494561467 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb21c1087f0 0x7fb21c1998a0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fb21000e9f0 tx=0x7fb21000eeb0 comp rx=0 tx=0).stop 2024-09-10T22:33:09.251 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:09.234+0000 7fb220bb2640 1 -- 172.21.15.19:0/494561467 shutdown_connections 2024-09-10T22:33:09.251 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:09.234+0000 7fb220bb2640 1 --2- 172.21.15.19:0/494561467 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7fb2040b5360 0x7fb2040b7820 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:33:09.251 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:09.234+0000 7fb220bb2640 1 --2- 172.21.15.19:0/494561467 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb21c109170 0x7fb21c19ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:33:09.251 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:09.234+0000 7fb220bb2640 1 --2- 172.21.15.19:0/494561467 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb21c1087f0 0x7fb21c1998a0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:33:09.251 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:09.234+0000 7fb220bb2640 1 --2- 172.21.15.19:0/494561467 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb21c102de0 0x7fb21c199360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:33:09.251 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:09.234+0000 7fb220bb2640 1 -- 172.21.15.19:0/494561467 >> 172.21.15.19:0/494561467 conn(0x7fb21c0fe870 msgr2=0x7fb21c100210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:33:09.251 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:09.234+0000 7fb220bb2640 1 -- 172.21.15.19:0/494561467 shutdown_connections 2024-09-10T22:33:09.251 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:09.234+0000 7fb220bb2640 1 -- 172.21.15.19:0/494561467 wait complete. 2024-09-10T22:33:10.209 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:33:09 smithi019 ceph-mon[31375]: pgmap v549: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 653 KiB/s rd, 307 MiB/s wr, 208 op/s 2024-09-10T22:33:10.362 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:33:09 smithi135 ceph-mon[34789]: pgmap v549: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 653 KiB/s rd, 307 MiB/s wr, 208 op/s 2024-09-10T22:33:10.375 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-10T22:33:10.376 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 22997a4c-6fc2-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-10T22:33:10.376 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:33:09 smithi138 ceph-mon[35236]: pgmap v549: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 653 KiB/s rd, 307 MiB/s wr, 208 op/s 2024-09-10T22:33:10.423 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:10.421+0000 7f8a277fe640 1 -- 172.21.15.19:0/526043954 <== mds.0 v2:172.21.15.135:6838/1254769802 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5572177c50f0 con 0x55721786a850 2024-09-10T22:33:10.423 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:10.421+0000 7f8a277fe640 10 client.16665 handle_command_reply: tid=0 2024-09-10T22:33:10.423 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:10.422+0000 7f8a51470740 1 client.16665 shutdown 2024-09-10T22:33:10.424 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:10.423+0000 7f8a51470740 1 -- 172.21.15.19:0/526043954 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55721785abd0 msgr2=0x557217865280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:33:10.425 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:10.423+0000 7f8a51470740 1 --2- 172.21.15.19:0/526043954 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55721785abd0 0x557217865280 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7f8a40005c10 tx=0x7f8a40007d50 comp rx=0 tx=0).stop 2024-09-10T22:33:10.425 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:10.423+0000 7f8a51470740 1 -- 172.21.15.19:0/526043954 shutdown_connections 2024-09-10T22:33:10.425 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:10.423+0000 7f8a51470740 1 --2- 172.21.15.19:0/526043954 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55721785abd0 0x557217865280 unknown :-1 s=CLOSED pgs=679 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:33:10.425 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:10.423+0000 7f8a51470740 1 --2- 172.21.15.19:0/526043954 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x55721786a850 0x5572178d9ae0 crc :-1 s=READY pgs=143 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:33:10.425 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:10.423+0000 7f8a51470740 1 --2- 172.21.15.19:0/526043954 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x557217858190 0x5572178646b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:33:10.425 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:10.423+0000 7f8a51470740 1 --2- 172.21.15.19:0/526043954 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557217855860 0x557217864010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:33:10.425 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:10.423+0000 7f8a277fe640 0 client.16665 ms_handle_reset on v2:172.21.15.135:6838/1254769802 2024-09-10T22:33:10.425 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:10.423+0000 7f8a51470740 1 -- 172.21.15.19:0/526043954 >> 172.21.15.19:0/526043954 conn(0x5572178509b0 msgr2=0x557217851210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:33:10.425 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:10.423+0000 7f8a51470740 1 -- 172.21.15.19:0/526043954 shutdown_connections 2024-09-10T22:33:10.425 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:10.423+0000 7f8a51470740 1 -- 172.21.15.19:0/526043954 wait complete. 2024-09-10T22:33:10.425 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:10.423+0000 7f8a51470740 20 client.16665 trim_cache size 0 max 16384 2024-09-10T22:33:10.426 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stdout:{ 2024-09-10T22:33:10.426 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stdout: "message": "", 2024-09-10T22:33:10.426 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stdout: "return_code": 0 2024-09-10T22:33:10.426 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stdout:} 2024-09-10T22:33:10.427 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:10.424+0000 7f8a4e5c9640 1 -- 172.21.15.19:0/3490221797 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f8a300b5360 msgr2=0x7f8a300b7820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:33:10.427 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:10.424+0000 7f8a4e5c9640 1 --2- 172.21.15.19:0/3490221797 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f8a300b5360 0x7f8a300b7820 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f8a40018000 tx=0x7f8a4001a000 comp rx=0 tx=0).stop 2024-09-10T22:33:10.427 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:10.424+0000 7f8a4e5c9640 1 -- 172.21.15.19:0/3490221797 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8a48101df0 msgr2=0x7f8a48198cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:33:10.427 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:10.424+0000 7f8a4e5c9640 1 --2- 172.21.15.19:0/3490221797 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8a48101df0 0x7f8a48198cf0 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7f8a3800e9f0 tx=0x7f8a3800eeb0 comp rx=0 tx=0).stop 2024-09-10T22:33:10.427 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:10.424+0000 7f8a4e5c9640 1 -- 172.21.15.19:0/3490221797 shutdown_connections 2024-09-10T22:33:10.427 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:10.424+0000 7f8a4e5c9640 1 --2- 172.21.15.19:0/3490221797 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f8a300b5360 0x7f8a300b7820 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:33:10.427 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:10.424+0000 7f8a4e5c9640 1 --2- 172.21.15.19:0/3490221797 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8a48103340 0x7f8a48199f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:33:10.428 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:10.424+0000 7f8a4e5c9640 1 --2- 172.21.15.19:0/3490221797 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f8a48102780 0x7f8a48199340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:33:10.428 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:10.424+0000 7f8a4e5c9640 1 --2- 172.21.15.19:0/3490221797 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8a48101df0 0x7f8a48198cf0 unknown :-1 s=CLOSED pgs=675 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:33:10.428 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:10.424+0000 7f8a4e5c9640 1 -- 172.21.15.19:0/3490221797 >> 172.21.15.19:0/3490221797 conn(0x7f8a480fc880 msgr2=0x7f8a480fe250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:33:10.428 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:10.425+0000 7f8a4e5c9640 1 -- 172.21.15.19:0/3490221797 shutdown_connections 2024-09-10T22:33:10.428 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:10.425+0000 7f8a4e5c9640 1 -- 172.21.15.19:0/3490221797 wait complete. 2024-09-10T22:33:10.684 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/22997a4c-6fc2-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T22:33:11.442 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:11.416+0000 7fcd71032640 1 -- 172.21.15.19:0/3856848422 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fcd6c104550 msgr2=0x7fcd6c10cb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:33:11.442 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:11.416+0000 7fcd71032640 1 --2- 172.21.15.19:0/3856848422 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fcd6c104550 0x7fcd6c10cb30 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7fcd60009900 tx=0x7fcd6002a410 comp rx=0 tx=0).stop 2024-09-10T22:33:11.442 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:11.416+0000 7fcd71032640 1 -- 172.21.15.19:0/3856848422 shutdown_connections 2024-09-10T22:33:11.442 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:11.416+0000 7fcd71032640 1 --2- 172.21.15.19:0/3856848422 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcd6c10d100 0x7fcd6c10f550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:33:11.442 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:11.416+0000 7fcd71032640 1 --2- 172.21.15.19:0/3856848422 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fcd6c104550 0x7fcd6c10cb30 unknown :-1 s=CLOSED pgs=680 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:33:11.443 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:11.416+0000 7fcd71032640 1 --2- 172.21.15.19:0/3856848422 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fcd6c103b50 0x7fcd6c103f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:33:11.443 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:11.416+0000 7fcd71032640 1 -- 172.21.15.19:0/3856848422 >> 172.21.15.19:0/3856848422 conn(0x7fcd6c0fd700 msgr2=0x7fcd6c0ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:33:11.443 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:11.416+0000 7fcd71032640 1 -- 172.21.15.19:0/3856848422 shutdown_connections 2024-09-10T22:33:11.443 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:11.416+0000 7fcd71032640 1 -- 172.21.15.19:0/3856848422 wait complete. 2024-09-10T22:33:11.443 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:11.417+0000 7fcd71032640 1 Processor -- start 2024-09-10T22:33:11.443 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:11.418+0000 7fcd71032640 1 -- start start 2024-09-10T22:33:11.443 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:11.418+0000 7fcd71032640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcd6c103b50 0x7fcd6c1992b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:33:11.443 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:11.418+0000 7fcd71032640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fcd6c104550 0x7fcd6c1997f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:33:11.443 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:11.418+0000 7fcd71032640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fcd6c10d100 0x7fcd6c19eb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:33:11.443 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:11.418+0000 7fcd71032640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fcd6c112d60 con 0x7fcd6c10d100 2024-09-10T22:33:11.443 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:11.418+0000 7fcd71032640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fcd6c112be0 con 0x7fcd6c103b50 2024-09-10T22:33:11.443 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:11.418+0000 7fcd71032640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7fcd6c112ee0 con 0x7fcd6c104550 2024-09-10T22:33:11.444 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:11.418+0000 7fcd6b59e640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fcd6c10d100 0x7fcd6c19eb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:33:11.444 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:11.418+0000 7fcd6ad9d640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcd6c103b50 0x7fcd6c1992b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:33:11.444 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:11.418+0000 7fcd6b59e640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fcd6c10d100 0x7fcd6c19eb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:59040/0 (socket says 172.21.15.19:59040) 2024-09-10T22:33:11.444 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:11.418+0000 7fcd6b59e640 1 -- 172.21.15.19:0/490991320 learned_addr learned my addr 172.21.15.19:0/490991320 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:33:11.444 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:11.418+0000 7fcd6a59c640 1 --2- 172.21.15.19:0/490991320 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fcd6c104550 0x7fcd6c1997f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:33:11.444 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:11.419+0000 7fcd6a59c640 1 -- 172.21.15.19:0/490991320 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcd6c103b50 msgr2=0x7fcd6c1992b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:33:11.444 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:11.419+0000 7fcd6a59c640 1 --2- 172.21.15.19:0/490991320 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcd6c103b50 0x7fcd6c1992b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:33:11.444 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:11.419+0000 7fcd6a59c640 1 -- 172.21.15.19:0/490991320 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fcd6c10d100 msgr2=0x7fcd6c19eb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:33:11.444 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:11.419+0000 7fcd6a59c640 1 --2- 172.21.15.19:0/490991320 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fcd6c10d100 0x7fcd6c19eb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:33:11.444 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:11.419+0000 7fcd6a59c640 1 -- 172.21.15.19:0/490991320 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcd6c19f360 con 0x7fcd6c104550 2024-09-10T22:33:11.444 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:11.419+0000 7fcd6ad9d640 1 --2- 172.21.15.19:0/490991320 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcd6c103b50 0x7fcd6c1992b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T22:33:11.444 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:11.419+0000 7fcd6b59e640 1 --2- 172.21.15.19:0/490991320 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fcd6c10d100 0x7fcd6c19eb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T22:33:11.444 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:11.419+0000 7fcd6a59c640 1 --2- 172.21.15.19:0/490991320 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fcd6c104550 0x7fcd6c1997f0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fcd60006010 tx=0x7fcd60004060 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:33:11.445 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:11.419+0000 7fcd53fff640 1 -- 172.21.15.19:0/490991320 <== mon.1 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd6003f070 con 0x7fcd6c104550 2024-09-10T22:33:11.445 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:11.419+0000 7fcd71032640 1 -- 172.21.15.19:0/490991320 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcd6c19f5f0 con 0x7fcd6c104550 2024-09-10T22:33:11.445 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:11.419+0000 7fcd53fff640 1 -- 172.21.15.19:0/490991320 <== mon.1 v2:172.21.15.138:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fcd60003ca0 con 0x7fcd6c104550 2024-09-10T22:33:11.445 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:11.419+0000 7fcd53fff640 1 -- 172.21.15.19:0/490991320 <== mon.1 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd60035070 con 0x7fcd6c104550 2024-09-10T22:33:11.445 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:11.419+0000 7fcd71032640 1 -- 172.21.15.19:0/490991320 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcd6c1a5d10 con 0x7fcd6c104550 2024-09-10T22:33:11.445 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:11.420+0000 7fcd71032640 1 -- 172.21.15.19:0/490991320 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcd6c103f30 con 0x7fcd6c104550 2024-09-10T22:33:11.445 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:11.422+0000 7fcd53fff640 1 -- 172.21.15.19:0/490991320 <== mon.1 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 18) ==== 153250+0+0 (secure 0 0 0) 0x7fcd6004b060 con 0x7fcd6c104550 2024-09-10T22:33:11.445 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:11.423+0000 7fcd53fff640 1 --2- 172.21.15.19:0/490991320 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7fcd540b52e0 0x7fcd540b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:33:11.445 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:11.423+0000 7fcd6ad9d640 1 --2- 172.21.15.19:0/490991320 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7fcd540b52e0 0x7fcd540b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:33:11.445 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:11.423+0000 7fcd53fff640 1 -- 172.21.15.19:0/490991320 <== mon.1 v2:172.21.15.138:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8327+0+0 (secure 0 0 0) 0x7fcd60106020 con 0x7fcd6c104550 2024-09-10T22:33:11.445 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:11.424+0000 7fcd6ad9d640 1 --2- 172.21.15.19:0/490991320 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7fcd540b52e0 0x7fcd540b77a0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7fcd5c009fc0 tx=0x7fcd5c005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:33:11.445 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:11.426+0000 7fcd53fff640 1 -- 172.21.15.19:0/490991320 <== mon.1 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7fcd600cc830 con 0x7fcd6c104550 2024-09-10T22:33:11.676 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:11.674+0000 7fcd71032640 1 -- 172.21.15.19:0/490991320 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fcd6c108170 con 0x7fcd6c104550 2024-09-10T22:33:11.677 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:11.675+0000 7fcd53fff640 1 -- 172.21.15.19:0/490991320 <== mon.1 v2:172.21.15.138:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) ==== 94+0+11921 (secure 0 0 0) 0x7fcd600d1260 con 0x7fcd6c104550 2024-09-10T22:33:11.677 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-10T22:33:11.677 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":27,"btime":"2024-09-10T22:29:37:724724+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14673,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6835/1835804747","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6834","nonce":1835804747},{"type":"v1","addr":"172.21.15.19:6835","nonce":1835804747}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14685,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6837/1750470490","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6836","nonce":1750470490},{"type":"v1","addr":"172.21.15.19:6837","nonce":1750470490}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14733,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6839/2642941149","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6838","nonce":2642941149},{"type":"v1","addr":"172.21.15.19:6839","nonce":2642941149}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14745,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6841/2449948682","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6840","nonce":2449948682},{"type":"v1","addr":"172.21.15.19:6841","nonce":2449948682}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24511,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.138:6833/2524811494","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6832","nonce":2524811494},{"type":"v1","addr":"172.21.15.138:6833","nonce":2524811494}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24512,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6833/3014993624","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6832","nonce":3014993624},{"type":"v1","addr":"172.21.15.135:6833","nonce":3014993624}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":27,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-10T22:24:22.733925+0000","modified":"2024-09-10T22:29:37.430699+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24581,"mds_1":24568,"mds_2":24553},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24527":{"gid":24527,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.135:6835/3715773348","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6834","nonce":3715773348},{"type":"v1","addr":"172.21.15.135:6835","nonce":3715773348}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24541":{"gid":24541,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.138:6835/933547028","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6834","nonce":933547028},{"type":"v1","addr":"172.21.15.138:6835","nonce":933547028}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24551":{"gid":24551,"name":"h","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.135:6837/3495029135","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6836","nonce":3495029135},{"type":"v1","addr":"172.21.15.135:6837","nonce":3495029135}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24553":{"gid":24553,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":10,"addr":"172.21.15.138:6837/3353290042","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6836","nonce":3353290042},{"type":"v1","addr":"172.21.15.138:6837","nonce":3353290042}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24568":{"gid":24568,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.138:6839/383637208","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6838","nonce":383637208},{"type":"v1","addr":"172.21.15.138:6839","nonce":383637208}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24581":{"gid":24581,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.135:6839/1254769802","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6838","nonce":1254769802},{"type":"v1","addr":"172.21.15.135:6839","nonce":1254769802}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24581,"qdb_cluster":[24581,24568,24553]},"id":1}]} 2024-09-10T22:33:11.678 INFO:teuthology.orchestra.run.smithi019.stderr:dumped fsmap epoch 27 2024-09-10T22:33:11.680 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:11.678+0000 7fcd71032640 1 -- 172.21.15.19:0/490991320 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7fcd540b52e0 msgr2=0x7fcd540b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:33:11.680 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:11.678+0000 7fcd71032640 1 --2- 172.21.15.19:0/490991320 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7fcd540b52e0 0x7fcd540b77a0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7fcd5c009fc0 tx=0x7fcd5c005f90 comp rx=0 tx=0).stop 2024-09-10T22:33:11.680 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:11.678+0000 7fcd71032640 1 -- 172.21.15.19:0/490991320 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fcd6c104550 msgr2=0x7fcd6c1997f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:33:11.680 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:11.678+0000 7fcd71032640 1 --2- 172.21.15.19:0/490991320 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fcd6c104550 0x7fcd6c1997f0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fcd60006010 tx=0x7fcd60004060 comp rx=0 tx=0).stop 2024-09-10T22:33:11.680 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:11.678+0000 7fcd71032640 1 -- 172.21.15.19:0/490991320 shutdown_connections 2024-09-10T22:33:11.680 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:11.678+0000 7fcd71032640 1 --2- 172.21.15.19:0/490991320 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7fcd540b52e0 0x7fcd540b77a0 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:33:11.680 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:11.678+0000 7fcd71032640 1 --2- 172.21.15.19:0/490991320 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fcd6c10d100 0x7fcd6c19eb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:33:11.680 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:11.678+0000 7fcd71032640 1 --2- 172.21.15.19:0/490991320 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fcd6c104550 0x7fcd6c1997f0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:33:11.680 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:11.678+0000 7fcd71032640 1 --2- 172.21.15.19:0/490991320 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcd6c103b50 0x7fcd6c1992b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:33:11.680 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:11.678+0000 7fcd71032640 1 -- 172.21.15.19:0/490991320 >> 172.21.15.19:0/490991320 conn(0x7fcd6c0fd700 msgr2=0x7fcd6c0fe440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:33:11.680 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:11.678+0000 7fcd71032640 1 -- 172.21.15.19:0/490991320 shutdown_connections 2024-09-10T22:33:11.681 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:11.678+0000 7fcd71032640 1 -- 172.21.15.19:0/490991320 wait complete. 2024-09-10T22:33:12.271 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:33:11 smithi019 ceph-mon[31375]: pgmap v550: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 880 KiB/s rd, 346 MiB/s wr, 342 op/s 2024-09-10T22:33:12.272 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:33:11 smithi019 ceph-mon[31375]: from='client.? 172.21.15.19:0/490991320' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T22:33:12.360 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:33:11 smithi135 ceph-mon[34789]: pgmap v550: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 880 KiB/s rd, 346 MiB/s wr, 342 op/s 2024-09-10T22:33:12.360 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:33:11 smithi135 ceph-mon[34789]: from='client.? 172.21.15.19:0/490991320' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T22:33:12.375 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:33:11 smithi138 ceph-mon[35236]: pgmap v550: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 880 KiB/s rd, 346 MiB/s wr, 342 op/s 2024-09-10T22:33:12.375 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:33:11 smithi138 ceph-mon[35236]: from='client.? 172.21.15.19:0/490991320' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T22:33:12.844 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 22997a4c-6fc2-11ef-bcea-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-09-10T22:33:13.205 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/22997a4c-6fc2-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T22:33:14.001 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:33:13 smithi019 ceph-mon[31375]: pgmap v551: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 589 KiB/s rd, 300 MiB/s wr, 373 op/s 2024-09-10T22:33:14.178 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:14.154+0000 7f47bd4ea640 1 -- 172.21.15.19:0/2612859685 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f47b810a530 msgr2=0x7f47b810a970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:33:14.178 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:14.154+0000 7f47bd4ea640 1 --2- 172.21.15.19:0/2612859685 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f47b810a530 0x7f47b810a970 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7f47b0009ca0 tx=0x7f47b002a8b0 comp rx=0 tx=0).stop 2024-09-10T22:33:14.178 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:14.155+0000 7f47bd4ea640 1 -- 172.21.15.19:0/2612859685 shutdown_connections 2024-09-10T22:33:14.178 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:14.155+0000 7f47bd4ea640 1 --2- 172.21.15.19:0/2612859685 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f47b811c0a0 0x7f47b811e490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:33:14.178 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:14.155+0000 7f47bd4ea640 1 --2- 172.21.15.19:0/2612859685 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f47b810a530 0x7f47b810a970 unknown :-1 s=CLOSED pgs=681 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:33:14.178 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:14.155+0000 7f47bd4ea640 1 --2- 172.21.15.19:0/2612859685 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f47b810a150 0x7f47b81111b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:33:14.178 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:14.155+0000 7f47bd4ea640 1 -- 172.21.15.19:0/2612859685 >> 172.21.15.19:0/2612859685 conn(0x7f47b806cb30 msgr2=0x7f47b806cf40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:33:14.178 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:14.155+0000 7f47bd4ea640 1 -- 172.21.15.19:0/2612859685 shutdown_connections 2024-09-10T22:33:14.179 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:14.155+0000 7f47bd4ea640 1 -- 172.21.15.19:0/2612859685 wait complete. 2024-09-10T22:33:14.179 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:14.156+0000 7f47bd4ea640 1 Processor -- start 2024-09-10T22:33:14.179 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:14.156+0000 7f47bd4ea640 1 -- start start 2024-09-10T22:33:14.179 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:14.157+0000 7f47bd4ea640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f47b810a150 0x7f47b81a7f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:33:14.179 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:14.157+0000 7f47bd4ea640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f47b810a530 0x7f47b81a84b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:33:14.179 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:14.157+0000 7f47bd4ea640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f47b811c0a0 0x7f47b81ad850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:33:14.179 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:14.157+0000 7f47bd4ea640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f47b8121ac0 con 0x7f47b811c0a0 2024-09-10T22:33:14.179 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:14.157+0000 7f47bd4ea640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f47b8121940 con 0x7f47b810a150 2024-09-10T22:33:14.179 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:14.157+0000 7f47bd4ea640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f47b8121c40 con 0x7f47b810a530 2024-09-10T22:33:14.179 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:14.157+0000 7f47bcce9640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f47b811c0a0 0x7f47b81ad850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:33:14.179 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:14.158+0000 7f47bcce9640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f47b811c0a0 0x7f47b81ad850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:37226/0 (socket says 172.21.15.19:37226) 2024-09-10T22:33:14.179 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:14.158+0000 7f47bcce9640 1 -- 172.21.15.19:0/241413115 learned_addr learned my addr 172.21.15.19:0/241413115 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:33:14.180 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:14.160+0000 7f47bcce9640 1 -- 172.21.15.19:0/241413115 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f47b810a530 msgr2=0x7f47b81a84b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:33:14.180 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:14.160+0000 7f47bcce9640 1 --2- 172.21.15.19:0/241413115 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f47b810a530 0x7f47b81a84b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:33:14.180 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:14.160+0000 7f47bcce9640 1 -- 172.21.15.19:0/241413115 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f47b810a150 msgr2=0x7f47b81a7f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:33:14.180 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:14.160+0000 7f47bcce9640 1 --2- 172.21.15.19:0/241413115 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f47b810a150 0x7f47b81a7f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:33:14.180 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:14.160+0000 7f47bcce9640 1 -- 172.21.15.19:0/241413115 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f47b81ae020 con 0x7f47b811c0a0 2024-09-10T22:33:14.180 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:14.163+0000 7f47bcce9640 1 --2- 172.21.15.19:0/241413115 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f47b811c0a0 0x7f47b81ad850 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7f47a800c970 tx=0x7f47a800ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:33:14.180 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:14.164+0000 7f47b57fa640 1 -- 172.21.15.19:0/241413115 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47a8007bb0 con 0x7f47b811c0a0 2024-09-10T22:33:14.180 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:14.164+0000 7f47b57fa640 1 -- 172.21.15.19:0/241413115 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f47a8007d50 con 0x7f47b811c0a0 2024-09-10T22:33:14.180 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:14.164+0000 7f47b57fa640 1 -- 172.21.15.19:0/241413115 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47a8018770 con 0x7f47b811c0a0 2024-09-10T22:33:14.180 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:14.165+0000 7f47bd4ea640 1 -- 172.21.15.19:0/241413115 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f47b81ae310 con 0x7f47b811c0a0 2024-09-10T22:33:14.180 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:14.165+0000 7f47bd4ea640 1 -- 172.21.15.19:0/241413115 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f47b81b49d0 con 0x7f47b811c0a0 2024-09-10T22:33:14.180 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:14.172+0000 7f47c0b21740 1 Processor -- start 2024-09-10T22:33:14.180 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:14.173+0000 7f47b57fa640 1 -- 172.21.15.19:0/241413115 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 18) ==== 153250+0+0 (secure 0 0 0) 0x7f47a800f990 con 0x7f47b811c0a0 2024-09-10T22:33:14.181 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:14.173+0000 7f47c0b21740 1 -- start start 2024-09-10T22:33:14.181 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:14.175+0000 7f47c0b21740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5623e441a6a0 0x5623e441aa80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:33:14.181 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:14.175+0000 7f47c0b21740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5623e441afc0 0x5623e4426a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:33:14.181 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:14.175+0000 7f47c0b21740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5623e4426f50 0x5623e4429340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:33:14.181 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:14.175+0000 7f47c0b21740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x5623e4390ea0 con 0x5623e441afc0 2024-09-10T22:33:14.181 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:14.175+0000 7f47c0b21740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x5623e43802d0 con 0x5623e441a6a0 2024-09-10T22:33:14.181 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:14.175+0000 7f47c0b21740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x5623e43840e0 con 0x5623e4426f50 2024-09-10T22:33:14.182 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:14.178+0000 7f47b77fe640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5623e441a6a0 0x5623e441aa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:33:14.183 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:14.178+0000 7f47b77fe640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5623e4426f50 0x5623e4429340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:33:14.183 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:14.180+0000 7f47b57fa640 1 --2- 172.21.15.19:0/241413115 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f47a00b55b0 0x7f47a00b7a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:33:14.183 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:14.181+0000 7f47b57fa640 1 -- 172.21.15.19:0/241413115 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8327+0+0 (secure 0 0 0) 0x7f47a80e5d80 con 0x7f47b811c0a0 2024-09-10T22:33:14.184 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:14.181+0000 7f47b77fe640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5623e4426f50 0x5623e4429340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.19:43042/0 (socket says 172.21.15.19:43042) 2024-09-10T22:33:14.184 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:14.181+0000 7f47b77fe640 1 -- 172.21.15.19:0/4066470198 learned_addr learned my addr 172.21.15.19:0/4066470198 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:33:14.184 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:14.178+0000 7f47b7fff640 1 --2- 172.21.15.19:0/4066470198 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5623e441afc0 0x5623e4426a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:33:14.185 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:14.182+0000 7f47bcce9640 1 --2- 172.21.15.19:0/241413115 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f47a00b55b0 0x7f47a00b7a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:33:14.185 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:14.182+0000 7f47b7fff640 1 -- 172.21.15.19:0/4066470198 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5623e4426f50 msgr2=0x5623e4429340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:33:14.185 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:14.183+0000 7f47b7fff640 1 --2- 172.21.15.19:0/4066470198 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5623e4426f50 0x5623e4429340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:33:14.185 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:14.183+0000 7f47b7fff640 1 -- 172.21.15.19:0/4066470198 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5623e441a6a0 msgr2=0x5623e441aa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:33:14.185 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:14.183+0000 7f47b7fff640 1 --2- 172.21.15.19:0/4066470198 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5623e441a6a0 0x5623e441aa80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:33:14.186 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:14.183+0000 7f47b7fff640 1 -- 172.21.15.19:0/4066470198 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5623e40de650 con 0x5623e441afc0 2024-09-10T22:33:14.186 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:14.183+0000 7f47b77fe640 1 --2- 172.21.15.19:0/4066470198 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5623e4426f50 0x5623e4429340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T22:33:14.186 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:14.183+0000 7f47b7fff640 1 --2- 172.21.15.19:0/4066470198 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5623e441afc0 0x5623e4426a10 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7f47ac009750 tx=0x7f47ac009c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b0fdbd28812729f2 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:33:14.186 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:14.184+0000 7f479e7fc640 1 -- 172.21.15.19:0/4066470198 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47ac015020 con 0x5623e441afc0 2024-09-10T22:33:14.186 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:14.184+0000 7f479e7fc640 1 -- 172.21.15.19:0/4066470198 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f47ac011420 con 0x5623e441afc0 2024-09-10T22:33:14.187 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:14.185+0000 7f479e7fc640 1 -- 172.21.15.19:0/4066470198 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47ac009e60 con 0x5623e441afc0 2024-09-10T22:33:14.187 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:14.185+0000 7f47c0b21740 1 -- 172.21.15.19:0/4066470198 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5623e441afc0 msgr2=0x5623e4426a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:33:14.187 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:14.185+0000 7f47c0b21740 1 --2- 172.21.15.19:0/4066470198 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5623e441afc0 0x5623e4426a10 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7f47ac009750 tx=0x7f47ac009c10 comp rx=0 tx=0).stop 2024-09-10T22:33:14.187 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:14.185+0000 7f47bcce9640 1 --2- 172.21.15.19:0/241413115 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f47a00b55b0 0x7f47a00b7a70 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f47a80ac200 tx=0x7f47a80046c0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:33:14.187 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:14.185+0000 7f47c0b21740 1 -- 172.21.15.19:0/4066470198 shutdown_connections 2024-09-10T22:33:14.189 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:14.185+0000 7f47c0b21740 1 --2- 172.21.15.19:0/4066470198 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5623e4426f50 0x5623e4429340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:33:14.189 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:14.185+0000 7f47c0b21740 1 --2- 172.21.15.19:0/4066470198 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5623e441afc0 0x5623e4426a10 unknown :-1 s=CLOSED pgs=683 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:33:14.189 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:14.185+0000 7f47c0b21740 1 --2- 172.21.15.19:0/4066470198 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5623e441a6a0 0x5623e441aa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:33:14.189 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:14.185+0000 7f47c0b21740 1 -- 172.21.15.19:0/4066470198 >> 172.21.15.19:0/4066470198 conn(0x5623e44184d0 msgr2=0x5623e4419670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:33:14.189 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:14.186+0000 7f47c0b21740 1 -- 172.21.15.19:0/4066470198 shutdown_connections 2024-09-10T22:33:14.189 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:14.186+0000 7f47c0b21740 1 -- 172.21.15.19:0/4066470198 wait complete. 2024-09-10T22:33:14.190 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:14.186+0000 7f47c0b21740 1 -- start start 2024-09-10T22:33:14.190 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:14.187+0000 7f47c0b21740 1 Processor -- start 2024-09-10T22:33:14.190 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:14.187+0000 7f47c0b21740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5623e441a6a0 0x5623e4426720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:33:14.191 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:14.188+0000 7f47c0b21740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5623e441afc0 0x5623e4423b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:33:14.191 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:14.188+0000 7f47b77fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5623e441a6a0 0x5623e4426720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:33:14.191 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:14.188+0000 7f47b77fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5623e441a6a0 0x5623e4426720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:37232/0 (socket says 172.21.15.19:37232) 2024-09-10T22:33:14.191 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:14.188+0000 7f47b77fe640 1 -- 172.21.15.19:0/4009466447 learned_addr learned my addr 172.21.15.19:0/4009466447 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:33:14.191 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:14.188+0000 7f47c0b21740 1 --2- 172.21.15.19:0/4009466447 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5623e4426f50 0x5623e44240b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:33:14.191 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:14.188+0000 7f47c0b21740 1 -- 172.21.15.19:0/4009466447 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x5623e41e1700 con 0x5623e441a6a0 2024-09-10T22:33:14.191 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:14.188+0000 7f47c0b21740 1 -- 172.21.15.19:0/4009466447 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x5623e431b160 con 0x5623e441afc0 2024-09-10T22:33:14.191 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:14.188+0000 7f47c0b21740 1 -- 172.21.15.19:0/4009466447 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x5623e4429c70 con 0x5623e4426f50 2024-09-10T22:33:14.191 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:14.189+0000 7f47c0b21740 10 client.0 _ll_register_callbacks cb 0x5623e43349e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T22:33:14.192 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:14.189+0000 7f47b77fe640 1 -- 172.21.15.19:0/4009466447 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5623e4426f50 msgr2=0x5623e44240b0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-10T22:33:14.193 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:14.189+0000 7f47b77fe640 1 --2- 172.21.15.19:0/4009466447 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5623e4426f50 0x5623e44240b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:33:14.193 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:14.189+0000 7f47b77fe640 1 -- 172.21.15.19:0/4009466447 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5623e441afc0 msgr2=0x5623e4423b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:33:14.193 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:14.189+0000 7f47b77fe640 1 --2- 172.21.15.19:0/4009466447 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5623e441afc0 0x5623e4423b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:33:14.193 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:14.189+0000 7f47b77fe640 1 -- 172.21.15.19:0/4009466447 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5623e4348c90 con 0x5623e441a6a0 2024-09-10T22:33:14.193 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:14.190+0000 7f47b77fe640 1 --2- 172.21.15.19:0/4009466447 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5623e441a6a0 0x5623e4426720 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7f47b0030d10 tx=0x7f47b0030d40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=41cc16ae749ae262 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:33:14.193 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:14.190+0000 7f47977fe640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-10T22:33:14.193 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:14.190+0000 7f47977fe640 1 -- 172.21.15.19:0/4009466447 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47b0003d80 con 0x5623e441a6a0 2024-09-10T22:33:14.193 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:14.190+0000 7f47c0b21740 1 -- 172.21.15.19:0/4009466447 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f47ac011420 con 0x5623e441a6a0 2024-09-10T22:33:14.193 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:14.190+0000 7f47977fe640 1 -- 172.21.15.19:0/4009466447 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8327+0+0 (secure 0 0 0) 0x7f47b0004040 con 0x5623e441a6a0 2024-09-10T22:33:14.193 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:14.190+0000 7f47977fe640 1 -- 172.21.15.19:0/4009466447 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f47b0052050 con 0x5623e441a6a0 2024-09-10T22:33:14.193 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:14.191+0000 7f47c0b21740 10 client.16698 fetch_fsmap learned FSMap version 27 2024-09-10T22:33:14.193 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:14.191+0000 7f47c0b21740 1 -- 172.21.15.19:0/4009466447 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x5623e4435560 con 0x5623e441a6a0 2024-09-10T22:33:14.195 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:14.191+0000 7f47977fe640 1 -- 172.21.15.19:0/4009466447 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f47ac011420 con 0x5623e441a6a0 2024-09-10T22:33:14.195 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:14.191+0000 7f47977fe640 1 -- 172.21.15.19:0/4009466447 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7f47b0049070 con 0x5623e441a6a0 2024-09-10T22:33:14.195 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:14.191+0000 7f47c0b21740 10 client.16698 fetch_fsmap finished waiting for FSMap version 27 2024-09-10T22:33:14.195 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:14.191+0000 7f47c0b21740 10 client.16698 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-10T22:33:14.195 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:14.191+0000 7f47c0b21740 20 client.16698 populate_metadata read hostname 'smithi019' 2024-09-10T22:33:14.195 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:14.191+0000 7f47c0b21740 1 --2- 172.21.15.19:0/4009466447 >> [v2:172.21.15.138:6836/3353290042,v1:172.21.15.138:6837/3353290042] conn(0x5623e4436de0 0x5623e44392a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:33:14.195 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:14.191+0000 7f47c0b21740 4 client.16698 mds_command: new command op to 24553 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T22:33:14.195 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:14.191+0000 7f47c0b21740 1 -- 172.21.15.19:0/4009466447 --> [v2:172.21.15.138:6836/3353290042,v1:172.21.15.138:6837/3353290042] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5623e4392df0 con 0x5623e4436de0 2024-09-10T22:33:14.195 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:14.192+0000 7f47b7fff640 1 --2- 172.21.15.19:0/4009466447 >> [v2:172.21.15.138:6836/3353290042,v1:172.21.15.138:6837/3353290042] conn(0x5623e4436de0 0x5623e44392a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:33:14.200 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:14.198+0000 7f47b7fff640 1 --2- 172.21.15.19:0/4009466447 >> [v2:172.21.15.138:6836/3353290042,v1:172.21.15.138:6837/3353290042] conn(0x5623e4436de0 0x5623e44392a0 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=b2bb085adf59bfd4 server_cookie=b5fb4a56b1b0ca02 in_seq=0 out_seq=0 2024-09-10T22:33:14.200 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:14.198+0000 7f47977fe640 10 client.16698 ms_handle_connect on v2:172.21.15.138:6836/3353290042 2024-09-10T22:33:14.202 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:14.200+0000 7f47977fe640 1 -- 172.21.15.19:0/4009466447 <== mds.2 v2:172.21.15.138:6836/3353290042 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5623e4392df0 con 0x5623e4436de0 2024-09-10T22:33:14.202 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:14.201+0000 7f47977fe640 10 client.16698 handle_command_reply: tid=0 2024-09-10T22:33:14.203 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:14.201+0000 7f47c0b21740 1 client.16698 shutdown 2024-09-10T22:33:14.203 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:14.201+0000 7f47c0b21740 1 -- 172.21.15.19:0/4009466447 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5623e441a6a0 msgr2=0x5623e4426720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:33:14.203 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:14.201+0000 7f47c0b21740 1 --2- 172.21.15.19:0/4009466447 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5623e441a6a0 0x5623e4426720 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7f47b0030d10 tx=0x7f47b0030d40 comp rx=0 tx=0).stop 2024-09-10T22:33:14.204 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:14.201+0000 7f47c0b21740 1 -- 172.21.15.19:0/4009466447 shutdown_connections 2024-09-10T22:33:14.204 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:14.201+0000 7f47c0b21740 1 --2- 172.21.15.19:0/4009466447 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5623e4426f50 0x5623e44240b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:33:14.204 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:14.201+0000 7f47c0b21740 1 --2- 172.21.15.19:0/4009466447 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5623e441afc0 0x5623e4423b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:33:14.204 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:14.201+0000 7f47c0b21740 1 --2- 172.21.15.19:0/4009466447 >> [v2:172.21.15.138:6836/3353290042,v1:172.21.15.138:6837/3353290042] conn(0x5623e4436de0 0x5623e44392a0 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:33:14.204 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:14.201+0000 7f47c0b21740 1 --2- 172.21.15.19:0/4009466447 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5623e441a6a0 0x5623e4426720 secure :-1 s=CLOSED pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7f47b0030d10 tx=0x7f47b0030d40 comp rx=0 tx=0).stop 2024-09-10T22:33:14.204 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:14.201+0000 7f47c0b21740 1 -- 172.21.15.19:0/4009466447 >> 172.21.15.19:0/4009466447 conn(0x5623e44184d0 msgr2=0x5623e441e070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:33:14.204 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:14.202+0000 7f47977fe640 0 client.16698 ms_handle_reset on v2:172.21.15.138:6836/3353290042 2024-09-10T22:33:14.204 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:14.202+0000 7f47c0b21740 1 -- 172.21.15.19:0/4009466447 shutdown_connections 2024-09-10T22:33:14.204 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:14.202+0000 7f47c0b21740 1 -- 172.21.15.19:0/4009466447 wait complete. 2024-09-10T22:33:14.205 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:14.202+0000 7f47c0b21740 20 client.16698 trim_cache size 0 max 16384 2024-09-10T22:33:14.228 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:14.225+0000 7f47c0b21740 1 Processor -- start 2024-09-10T22:33:14.228 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:14.225+0000 7f47c0b21740 1 -- start start 2024-09-10T22:33:14.228 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:14.226+0000 7f47c0b21740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5623e441afc0 0x5623e4419c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:33:14.228 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:14.226+0000 7f47c0b21740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5623e4426f50 0x5623e4420d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:33:14.228 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:14.226+0000 7f47c0b21740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5623e4422c10 0x5623e44212c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:33:14.228 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:14.226+0000 7f47c0b21740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f47b81bf9d0 con 0x5623e4422c10 2024-09-10T22:33:14.228 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:14.226+0000 7f47c0b21740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f47b81bd2a0 con 0x5623e4426f50 2024-09-10T22:33:14.228 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:14.226+0000 7f47c0b21740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f47b81bb0f0 con 0x5623e441afc0 2024-09-10T22:33:14.228 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:14.226+0000 7f47b77fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5623e4422c10 0x5623e44212c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:33:14.228 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:14.226+0000 7f47b77fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5623e4422c10 0x5623e44212c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:37236/0 (socket says 172.21.15.19:37236) 2024-09-10T22:33:14.228 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:14.226+0000 7f47b77fe640 1 -- 172.21.15.19:0/534281370 learned_addr learned my addr 172.21.15.19:0/534281370 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:33:14.229 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:14.226+0000 7f47b77fe640 1 -- 172.21.15.19:0/534281370 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5623e441afc0 msgr2=0x5623e4419c80 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-10T22:33:14.229 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:14.226+0000 7f47b77fe640 1 --2- 172.21.15.19:0/534281370 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5623e441afc0 0x5623e4419c80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:33:14.229 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:14.226+0000 7f47b77fe640 1 -- 172.21.15.19:0/534281370 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5623e4426f50 msgr2=0x5623e4420d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:33:14.229 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:14.226+0000 7f47b77fe640 1 --2- 172.21.15.19:0/534281370 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5623e4426f50 0x5623e4420d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:33:14.229 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:14.226+0000 7f47b77fe640 1 -- 172.21.15.19:0/534281370 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5623e4418f50 con 0x5623e4422c10 2024-09-10T22:33:14.229 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:14.227+0000 7f47b77fe640 1 --2- 172.21.15.19:0/534281370 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5623e4422c10 0x5623e44212c0 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7f47b0030ce0 tx=0x7f47b0031ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=94bc47d75734ff7 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:33:14.231 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:14.227+0000 7f479dffb640 1 -- 172.21.15.19:0/534281370 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47b0031440 con 0x5623e4422c10 2024-09-10T22:33:14.231 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:14.227+0000 7f479dffb640 1 -- 172.21.15.19:0/534281370 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f47b0036040 con 0x5623e4422c10 2024-09-10T22:33:14.232 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:14.227+0000 7f479dffb640 1 -- 172.21.15.19:0/534281370 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47b004b920 con 0x5623e4422c10 2024-09-10T22:33:14.232 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:14.228+0000 7f47c0b21740 1 -- 172.21.15.19:0/534281370 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5623e4422c10 msgr2=0x5623e44212c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:33:14.232 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:14.228+0000 7f47c0b21740 1 --2- 172.21.15.19:0/534281370 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5623e4422c10 0x5623e44212c0 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7f47b0030ce0 tx=0x7f47b0031ce0 comp rx=0 tx=0).stop 2024-09-10T22:33:14.232 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:14.228+0000 7f47c0b21740 1 -- 172.21.15.19:0/534281370 shutdown_connections 2024-09-10T22:33:14.232 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:14.228+0000 7f47c0b21740 1 --2- 172.21.15.19:0/534281370 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5623e4422c10 0x5623e44212c0 unknown :-1 s=CLOSED pgs=685 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:33:14.232 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:14.228+0000 7f47c0b21740 1 --2- 172.21.15.19:0/534281370 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5623e4426f50 0x5623e4420d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:33:14.232 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:14.228+0000 7f47c0b21740 1 --2- 172.21.15.19:0/534281370 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5623e441afc0 0x5623e4419c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:33:14.232 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:14.228+0000 7f47c0b21740 1 -- 172.21.15.19:0/534281370 >> 172.21.15.19:0/534281370 conn(0x5623e44184d0 msgr2=0x5623e4419570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:33:14.232 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:14.228+0000 7f47c0b21740 1 -- 172.21.15.19:0/534281370 shutdown_connections 2024-09-10T22:33:14.232 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:14.228+0000 7f47c0b21740 1 -- 172.21.15.19:0/534281370 wait complete. 2024-09-10T22:33:14.232 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:14.229+0000 7f47c0b21740 1 -- start start 2024-09-10T22:33:14.232 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:14.229+0000 7f47c0b21740 1 Processor -- start 2024-09-10T22:33:14.233 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:14.229+0000 7f47c0b21740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5623e441afc0 0x5623e442b770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:33:14.233 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:14.229+0000 7f47c0b21740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5623e4422c10 0x5623e442bcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:33:14.233 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:14.229+0000 7f47c0b21740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5623e4426f50 0x5623e44a2d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:33:14.233 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:14.229+0000 7f47c0b21740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f47b81bb760 con 0x5623e4426f50 2024-09-10T22:33:14.233 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:14.229+0000 7f47c0b21740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f47b81bcbd0 con 0x5623e441afc0 2024-09-10T22:33:14.233 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:14.229+0000 7f47c0b21740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f47b81bbe30 con 0x5623e4422c10 2024-09-10T22:33:14.233 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:14.229+0000 7f47c0b21740 10 client.0 _ll_register_callbacks cb 0x7f47b0009c20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T22:33:14.233 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:14.230+0000 7f47b77fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5623e4426f50 0x5623e44a2d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:33:14.233 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:14.230+0000 7f47b77fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5623e4426f50 0x5623e44a2d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:37240/0 (socket says 172.21.15.19:37240) 2024-09-10T22:33:14.233 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:14.230+0000 7f47b77fe640 1 -- 172.21.15.19:0/2551257459 learned_addr learned my addr 172.21.15.19:0/2551257459 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:33:14.235 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:14.230+0000 7f47b77fe640 1 -- 172.21.15.19:0/2551257459 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5623e4422c10 msgr2=0x5623e442bcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:33:14.235 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:14.230+0000 7f47b77fe640 1 --2- 172.21.15.19:0/2551257459 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5623e4422c10 0x5623e442bcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:33:14.235 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:14.230+0000 7f47b77fe640 1 -- 172.21.15.19:0/2551257459 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5623e441afc0 msgr2=0x5623e442b770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:33:14.236 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:14.230+0000 7f47b77fe640 1 --2- 172.21.15.19:0/2551257459 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5623e441afc0 0x5623e442b770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:33:14.236 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:14.230+0000 7f47b77fe640 1 -- 172.21.15.19:0/2551257459 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5623e44a33b0 con 0x5623e4426f50 2024-09-10T22:33:14.236 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:14.231+0000 7f47b77fe640 1 --2- 172.21.15.19:0/2551257459 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5623e4426f50 0x5623e44a2d70 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7f47b0031fd0 tx=0x7f47b002afa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c21aed49e3388b56 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:33:14.236 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:14.231+0000 7f47977fe640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-10T22:33:14.236 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:14.231+0000 7f47977fe640 1 -- 172.21.15.19:0/2551257459 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47b0063060 con 0x5623e4426f50 2024-09-10T22:33:14.236 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:14.231+0000 7f47977fe640 1 -- 172.21.15.19:0/2551257459 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8327+0+0 (secure 0 0 0) 0x7f47b004b470 con 0x5623e4426f50 2024-09-10T22:33:14.236 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:14.231+0000 7f47c0b21740 1 -- 172.21.15.19:0/2551257459 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f47b0036040 con 0x5623e4426f50 2024-09-10T22:33:14.236 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:14.231+0000 7f47977fe640 1 -- 172.21.15.19:0/2551257459 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f47b0031b30 con 0x5623e4426f50 2024-09-10T22:33:14.236 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:14.231+0000 7f47c0b21740 10 client.16704 fetch_fsmap learned FSMap version 27 2024-09-10T22:33:14.236 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:14.231+0000 7f47c0b21740 1 -- 172.21.15.19:0/2551257459 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x5623e44a46b0 con 0x5623e4426f50 2024-09-10T22:33:14.236 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:14.232+0000 7f47977fe640 1 -- 172.21.15.19:0/2551257459 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f47b00308b0 con 0x5623e4426f50 2024-09-10T22:33:14.236 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:14.232+0000 7f47977fe640 1 -- 172.21.15.19:0/2551257459 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7f47b0049040 con 0x5623e4426f50 2024-09-10T22:33:14.236 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:14.232+0000 7f47c0b21740 10 client.16704 fetch_fsmap finished waiting for FSMap version 27 2024-09-10T22:33:14.237 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:14.232+0000 7f47c0b21740 10 client.16704 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-10T22:33:14.237 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:14.233+0000 7f47c0b21740 20 client.16704 populate_metadata read hostname 'smithi019' 2024-09-10T22:33:14.237 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:14.233+0000 7f47c0b21740 1 --2- 172.21.15.19:0/2551257459 >> [v2:172.21.15.138:6836/3353290042,v1:172.21.15.138:6837/3353290042] conn(0x5623e44a4dc0 0x5623e44a71e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:33:14.237 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:14.233+0000 7f47c0b21740 4 client.16704 mds_command: new command op to 24553 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-10T22:33:14.237 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:14.233+0000 7f47c0b21740 1 -- 172.21.15.19:0/2551257459 --> [v2:172.21.15.138:6836/3353290042,v1:172.21.15.138:6837/3353290042] -- command(tid 0: {"prefix": "damage ls"}) -- 0x7f47b0036040 con 0x5623e44a4dc0 2024-09-10T22:33:14.237 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:14.234+0000 7f47b7fff640 1 --2- 172.21.15.19:0/2551257459 >> [v2:172.21.15.138:6836/3353290042,v1:172.21.15.138:6837/3353290042] conn(0x5623e44a4dc0 0x5623e44a71e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:33:14.238 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:14.235+0000 7f47977fe640 10 client.16704 ms_handle_connect on v2:172.21.15.138:6836/3353290042 2024-09-10T22:33:14.238 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:14.235+0000 7f47b7fff640 1 --2- 172.21.15.19:0/2551257459 >> [v2:172.21.15.138:6836/3353290042,v1:172.21.15.138:6837/3353290042] conn(0x5623e44a4dc0 0x5623e44a71e0 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=cd1fab88fff2137f server_cookie=e885c5e3aaf25ee8 in_seq=0 out_seq=0 2024-09-10T22:33:14.238 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:14.236+0000 7f47977fe640 1 -- 172.21.15.19:0/2551257459 <== mds.2 v2:172.21.15.138:6836/3353290042 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x7f47b0036040 con 0x5623e44a4dc0 2024-09-10T22:33:14.238 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:14.236+0000 7f47977fe640 10 client.16704 handle_command_reply: tid=0 2024-09-10T22:33:14.238 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:14.236+0000 7f47c0b21740 1 client.16704 shutdown 2024-09-10T22:33:14.239 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:14.236+0000 7f47c0b21740 1 -- 172.21.15.19:0/2551257459 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5623e4426f50 msgr2=0x5623e44a2d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:33:14.239 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:14.237+0000 7f47c0b21740 1 --2- 172.21.15.19:0/2551257459 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5623e4426f50 0x5623e44a2d70 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7f47b0031fd0 tx=0x7f47b002afa0 comp rx=0 tx=0).stop 2024-09-10T22:33:14.239 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:14.237+0000 7f47c0b21740 1 -- 172.21.15.19:0/2551257459 shutdown_connections 2024-09-10T22:33:14.239 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:14.237+0000 7f47c0b21740 1 --2- 172.21.15.19:0/2551257459 >> [v2:172.21.15.138:6836/3353290042,v1:172.21.15.138:6837/3353290042] conn(0x5623e44a4dc0 0x5623e44a71e0 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:33:14.239 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:14.237+0000 7f47c0b21740 1 --2- 172.21.15.19:0/2551257459 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5623e4426f50 0x5623e44a2d70 unknown :-1 s=CLOSED pgs=686 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:33:14.239 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:14.237+0000 7f47c0b21740 1 --2- 172.21.15.19:0/2551257459 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5623e4422c10 0x5623e442bcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:33:14.239 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:14.237+0000 7f47c0b21740 1 --2- 172.21.15.19:0/2551257459 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5623e441afc0 0x5623e442b770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:33:14.240 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:14.237+0000 7f47c0b21740 1 -- 172.21.15.19:0/2551257459 >> 172.21.15.19:0/2551257459 conn(0x5623e44184d0 msgr2=0x5623e44251a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:33:14.240 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:14.237+0000 7f47977fe640 0 client.16704 ms_handle_reset on v2:172.21.15.138:6836/3353290042 2024-09-10T22:33:14.240 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:14.237+0000 7f47c0b21740 1 -- 172.21.15.19:0/2551257459 shutdown_connections 2024-09-10T22:33:14.240 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:14.237+0000 7f47c0b21740 1 -- 172.21.15.19:0/2551257459 wait complete. 2024-09-10T22:33:14.240 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:14.237+0000 7f47c0b21740 20 client.16704 trim_cache size 0 max 16384 2024-09-10T22:33:14.240 INFO:teuthology.orchestra.run.smithi019.stdout:[] 2024-09-10T22:33:14.241 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:14.238+0000 7f47bd4ea640 1 -- 172.21.15.19:0/241413115 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f47a00b55b0 msgr2=0x7f47a00b7a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:33:14.241 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:14.238+0000 7f47bd4ea640 1 --2- 172.21.15.19:0/241413115 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f47a00b55b0 0x7f47a00b7a70 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f47a80ac200 tx=0x7f47a80046c0 comp rx=0 tx=0).stop 2024-09-10T22:33:14.241 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:14.238+0000 7f47bd4ea640 1 -- 172.21.15.19:0/241413115 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f47b811c0a0 msgr2=0x7f47b81ad850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:33:14.241 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:14.238+0000 7f47bd4ea640 1 --2- 172.21.15.19:0/241413115 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f47b811c0a0 0x7f47b81ad850 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7f47a800c970 tx=0x7f47a800ce30 comp rx=0 tx=0).stop 2024-09-10T22:33:14.241 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:14.238+0000 7f47bd4ea640 1 -- 172.21.15.19:0/241413115 shutdown_connections 2024-09-10T22:33:14.241 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:14.238+0000 7f47bd4ea640 1 --2- 172.21.15.19:0/241413115 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f47a00b55b0 0x7f47a00b7a70 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:33:14.241 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:14.238+0000 7f47bd4ea640 1 --2- 172.21.15.19:0/241413115 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f47b811c0a0 0x7f47b81ad850 unknown :-1 s=CLOSED pgs=682 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:33:14.242 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:14.238+0000 7f47bd4ea640 1 --2- 172.21.15.19:0/241413115 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f47b810a530 0x7f47b81a84b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:33:14.242 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:14.238+0000 7f47bd4ea640 1 --2- 172.21.15.19:0/241413115 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f47b810a150 0x7f47b81a7f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:33:14.242 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:14.238+0000 7f47bd4ea640 1 -- 172.21.15.19:0/241413115 >> 172.21.15.19:0/241413115 conn(0x7f47b806cb30 msgr2=0x7f47b811c580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:33:14.242 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:14.238+0000 7f47bd4ea640 1 -- 172.21.15.19:0/241413115 shutdown_connections 2024-09-10T22:33:14.242 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:14.238+0000 7f47bd4ea640 1 -- 172.21.15.19:0/241413115 wait complete. 2024-09-10T22:33:14.360 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:33:13 smithi135 ceph-mon[34789]: pgmap v551: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 589 KiB/s rd, 300 MiB/s wr, 373 op/s 2024-09-10T22:33:14.375 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:33:13 smithi138 ceph-mon[35236]: pgmap v551: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 589 KiB/s rd, 300 MiB/s wr, 373 op/s 2024-09-10T22:33:15.347 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 22997a4c-6fc2-11ef-bcea-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-09-10T22:33:15.650 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/22997a4c-6fc2-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T22:33:16.061 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:33:15 smithi019 ceph-mon[31375]: pgmap v552: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 589 KiB/s rd, 298 MiB/s wr, 436 op/s 2024-09-10T22:33:16.320 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:16.317+0000 7f93d4aba640 1 -- 172.21.15.19:0/3891533475 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f93d0109150 msgr2=0x7f93d010f950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:33:16.320 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:16.317+0000 7f93d4aba640 1 --2- 172.21.15.19:0/3891533475 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f93d0109150 0x7f93d010f950 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7f93c8009ca0 tx=0x7f93c802a8c0 comp rx=0 tx=0).stop 2024-09-10T22:33:16.320 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:16.317+0000 7f93d4aba640 1 -- 172.21.15.19:0/3891533475 shutdown_connections 2024-09-10T22:33:16.320 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:16.317+0000 7f93d4aba640 1 --2- 172.21.15.19:0/3891533475 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f93d0109150 0x7f93d010f950 unknown :-1 s=CLOSED pgs=687 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:33:16.320 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:16.317+0000 7f93d4aba640 1 --2- 172.21.15.19:0/3891533475 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f93d01087d0 0x7f93d0108c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:33:16.320 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:16.317+0000 7f93d4aba640 1 --2- 172.21.15.19:0/3891533475 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f93d0102dc0 0x7f93d01031a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:33:16.320 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:16.317+0000 7f93d4aba640 1 -- 172.21.15.19:0/3891533475 >> 172.21.15.19:0/3891533475 conn(0x7f93d00fe830 msgr2=0x7f93d0100c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:33:16.321 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:16.317+0000 7f93d4aba640 1 -- 172.21.15.19:0/3891533475 shutdown_connections 2024-09-10T22:33:16.321 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:16.317+0000 7f93d4aba640 1 -- 172.21.15.19:0/3891533475 wait complete. 2024-09-10T22:33:16.321 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:16.318+0000 7f93d4aba640 1 Processor -- start 2024-09-10T22:33:16.321 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:16.318+0000 7f93d4aba640 1 -- start start 2024-09-10T22:33:16.321 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:16.318+0000 7f93d4aba640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f93d0102dc0 0x7f93d00754a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:33:16.321 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:16.318+0000 7f93d4aba640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f93d01087d0 0x7f93d00759e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:33:16.321 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:16.318+0000 7f93d4aba640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f93d0109150 0x7f93d0075f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:33:16.321 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:16.318+0000 7f93d4aba640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f93d0112dd0 con 0x7f93d01087d0 2024-09-10T22:33:16.321 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:16.318+0000 7f93d4aba640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f93d0112c50 con 0x7f93d0109150 2024-09-10T22:33:16.321 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:16.318+0000 7f93d4aba640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f93d0112f50 con 0x7f93d0102dc0 2024-09-10T22:33:16.321 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:16.318+0000 7f93cdd9b640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f93d01087d0 0x7f93d00759e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:33:16.322 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:16.318+0000 7f93cdd9b640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f93d01087d0 0x7f93d00759e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:37248/0 (socket says 172.21.15.19:37248) 2024-09-10T22:33:16.322 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:16.318+0000 7f93ced9d640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f93d0109150 0x7f93d0075f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:33:16.322 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:16.318+0000 7f93cdd9b640 1 -- 172.21.15.19:0/3552107739 learned_addr learned my addr 172.21.15.19:0/3552107739 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:33:16.322 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:16.318+0000 7f93ce59c640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f93d0102dc0 0x7f93d00754a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:33:16.323 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:16.319+0000 7f93cdd9b640 1 -- 172.21.15.19:0/3552107739 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f93d0102dc0 msgr2=0x7f93d00754a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:33:16.323 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:16.319+0000 7f93cdd9b640 1 --2- 172.21.15.19:0/3552107739 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f93d0102dc0 0x7f93d00754a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:33:16.323 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:16.319+0000 7f93cdd9b640 1 -- 172.21.15.19:0/3552107739 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f93d0109150 msgr2=0x7f93d0075f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:33:16.323 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:16.319+0000 7f93cdd9b640 1 --2- 172.21.15.19:0/3552107739 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f93d0109150 0x7f93d0075f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:33:16.323 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:16.319+0000 7f93cdd9b640 1 -- 172.21.15.19:0/3552107739 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f93d01a7680 con 0x7f93d01087d0 2024-09-10T22:33:16.323 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:16.319+0000 7f93ced9d640 1 --2- 172.21.15.19:0/3552107739 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f93d0109150 0x7f93d0075f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T22:33:16.323 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:16.319+0000 7f93cdd9b640 1 --2- 172.21.15.19:0/3552107739 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f93d01087d0 0x7f93d00759e0 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7f93c400d770 tx=0x7f93c400dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:33:16.324 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:16.319+0000 7f93bf7fe640 1 -- 172.21.15.19:0/3552107739 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93c4017070 con 0x7f93d01087d0 2024-09-10T22:33:16.324 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:16.319+0000 7f93bf7fe640 1 -- 172.21.15.19:0/3552107739 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f93c40054d0 con 0x7f93d01087d0 2024-09-10T22:33:16.324 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:16.319+0000 7f93d4aba640 1 -- 172.21.15.19:0/3552107739 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f93d01a7970 con 0x7f93d01087d0 2024-09-10T22:33:16.324 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:16.319+0000 7f93bf7fe640 1 -- 172.21.15.19:0/3552107739 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93c4004c30 con 0x7f93d01087d0 2024-09-10T22:33:16.324 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:16.319+0000 7f93d4aba640 1 -- 172.21.15.19:0/3552107739 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f93d01a7e60 con 0x7f93d01087d0 2024-09-10T22:33:16.326 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:16.322+0000 7f93bf7fe640 1 -- 172.21.15.19:0/3552107739 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 18) ==== 153250+0+0 (secure 0 0 0) 0x7f93c4004e10 con 0x7f93d01087d0 2024-09-10T22:33:16.326 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:16.322+0000 7f93d6e8f740 1 Processor -- start 2024-09-10T22:33:16.326 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:16.322+0000 7f93d6e8f740 1 -- start start 2024-09-10T22:33:16.326 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:16.322+0000 7f93d6e8f740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5609fcb930f0 0x5609fcb934d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:33:16.326 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:16.322+0000 7f93d6e8f740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5609fcb93a10 0x5609fcb9f460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:33:16.326 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:16.322+0000 7f93d6e8f740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5609fcb9f9a0 0x5609fcba1d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:33:16.326 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:16.322+0000 7f93d6e8f740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x5609fcb09ea0 con 0x5609fcb930f0 2024-09-10T22:33:16.326 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:16.322+0000 7f93d6e8f740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x5609fcaf92d0 con 0x5609fcb9f9a0 2024-09-10T22:33:16.326 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:16.322+0000 7f93d6e8f740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x5609fcafd0e0 con 0x5609fcb93a10 2024-09-10T22:33:16.326 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:16.323+0000 7f93ced9d640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5609fcb930f0 0x5609fcb934d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:33:16.327 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:16.323+0000 7f93cdd9b640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5609fcb9f9a0 0x5609fcba1d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:33:16.327 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:16.323+0000 7f93ced9d640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5609fcb930f0 0x5609fcb934d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:37256/0 (socket says 172.21.15.19:37256) 2024-09-10T22:33:16.327 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:16.323+0000 7f93ced9d640 1 -- 172.21.15.19:0/3118792716 learned_addr learned my addr 172.21.15.19:0/3118792716 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:33:16.327 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:16.323+0000 7f93ce59c640 1 --2- 172.21.15.19:0/3118792716 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5609fcb93a10 0x5609fcb9f460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:33:16.327 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:16.323+0000 7f93cdd9b640 1 -- 172.21.15.19:0/3118792716 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5609fcb93a10 msgr2=0x5609fcb9f460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:33:16.327 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:16.323+0000 7f93cdd9b640 1 --2- 172.21.15.19:0/3118792716 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5609fcb93a10 0x5609fcb9f460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:33:16.327 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:16.323+0000 7f93cdd9b640 1 -- 172.21.15.19:0/3118792716 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5609fcb930f0 msgr2=0x5609fcb934d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:33:16.327 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:16.323+0000 7f93cdd9b640 1 --2- 172.21.15.19:0/3118792716 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5609fcb930f0 0x5609fcb934d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:33:16.327 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:16.323+0000 7f93cdd9b640 1 -- 172.21.15.19:0/3118792716 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5609fc857650 con 0x5609fcb9f9a0 2024-09-10T22:33:16.327 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:16.323+0000 7f93ced9d640 1 --2- 172.21.15.19:0/3118792716 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5609fcb930f0 0x5609fcb934d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T22:33:16.327 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:16.323+0000 7f93bf7fe640 1 --2- 172.21.15.19:0/3552107739 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f93b80b52e0 0x7f93b80b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:33:16.327 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:16.323+0000 7f93ced9d640 1 --2- 172.21.15.19:0/3552107739 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f93b80b52e0 0x7f93b80b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:33:16.328 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:16.323+0000 7f93cdd9b640 1 --2- 172.21.15.19:0/3118792716 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5609fcb9f9a0 0x5609fcba1d90 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f93c40e3110 tx=0x7f93c40ed690 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c82f5eac9b270131 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:33:16.328 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:16.324+0000 7f93bf7fe640 1 -- 172.21.15.19:0/3552107739 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8327+0+0 (secure 0 0 0) 0x7f93c40e56a0 con 0x7f93d01087d0 2024-09-10T22:33:16.328 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:16.324+0000 7f93bcff9640 1 -- 172.21.15.19:0/3118792716 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93c40a8500 con 0x5609fcb9f9a0 2024-09-10T22:33:16.328 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:16.324+0000 7f93bcff9640 1 -- 172.21.15.19:0/3118792716 <== mon.2 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f93c40ab9c0 con 0x5609fcb9f9a0 2024-09-10T22:33:16.328 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:16.324+0000 7f93bcff9640 1 -- 172.21.15.19:0/3118792716 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93c40ab620 con 0x5609fcb9f9a0 2024-09-10T22:33:16.331 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:16.325+0000 7f93d6e8f740 1 -- 172.21.15.19:0/3118792716 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5609fcb9f9a0 msgr2=0x5609fcba1d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:33:16.331 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:16.325+0000 7f93ced9d640 1 --2- 172.21.15.19:0/3552107739 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f93b80b52e0 0x7f93b80b77a0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f93c802f500 tx=0x7f93c802f310 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:33:16.331 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:16.325+0000 7f93d6e8f740 1 --2- 172.21.15.19:0/3118792716 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5609fcb9f9a0 0x5609fcba1d90 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f93c40e3110 tx=0x7f93c40ed690 comp rx=0 tx=0).stop 2024-09-10T22:33:16.331 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:16.325+0000 7f93d6e8f740 1 -- 172.21.15.19:0/3118792716 shutdown_connections 2024-09-10T22:33:16.332 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:16.325+0000 7f93d6e8f740 1 --2- 172.21.15.19:0/3118792716 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5609fcb9f9a0 0x5609fcba1d90 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:33:16.332 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:16.325+0000 7f93d6e8f740 1 --2- 172.21.15.19:0/3118792716 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5609fcb93a10 0x5609fcb9f460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:33:16.332 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:16.325+0000 7f93d6e8f740 1 --2- 172.21.15.19:0/3118792716 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5609fcb930f0 0x5609fcb934d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:33:16.332 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:16.325+0000 7f93d6e8f740 1 -- 172.21.15.19:0/3118792716 >> 172.21.15.19:0/3118792716 conn(0x5609fcb90f20 msgr2=0x5609fcb920c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:33:16.332 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:16.325+0000 7f93d6e8f740 1 -- 172.21.15.19:0/3118792716 shutdown_connections 2024-09-10T22:33:16.332 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:16.325+0000 7f93d6e8f740 1 -- 172.21.15.19:0/3118792716 wait complete. 2024-09-10T22:33:16.332 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:16.325+0000 7f93d6e8f740 1 -- start start 2024-09-10T22:33:16.332 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:16.325+0000 7f93d6e8f740 1 Processor -- start 2024-09-10T22:33:16.332 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:16.326+0000 7f93d6e8f740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5609fcb930f0 0x5609fcb9f300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:33:16.332 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:16.326+0000 7f93d6e8f740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5609fcb93a10 0x5609fcb9c750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:33:16.332 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:16.326+0000 7f93d6e8f740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5609fcb9f9a0 0x5609fcb9cdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:33:16.332 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:16.326+0000 7f93d6e8f740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x5609fc95a700 con 0x5609fcb930f0 2024-09-10T22:33:16.333 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:16.326+0000 7f93d6e8f740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x5609fca94160 con 0x5609fcb9f9a0 2024-09-10T22:33:16.333 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:16.326+0000 7f93d6e8f740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x5609fcba2620 con 0x5609fcb93a10 2024-09-10T22:33:16.333 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:16.326+0000 7f93d6e8f740 10 client.0 _ll_register_callbacks cb 0x5609fcaad9e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T22:33:16.333 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:16.326+0000 7f93ce59c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5609fcb930f0 0x5609fcb9f300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:33:16.333 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:16.326+0000 7f93ce59c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5609fcb930f0 0x5609fcb9f300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:37262/0 (socket says 172.21.15.19:37262) 2024-09-10T22:33:16.333 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:16.326+0000 7f93ce59c640 1 -- 172.21.15.19:0/1596580027 learned_addr learned my addr 172.21.15.19:0/1596580027 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:33:16.333 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:16.326+0000 7f93ced9d640 1 --2- 172.21.15.19:0/1596580027 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5609fcb9f9a0 0x5609fcb9cdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:33:16.333 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:16.326+0000 7f93cdd9b640 1 --2- 172.21.15.19:0/1596580027 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5609fcb93a10 0x5609fcb9c750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:33:16.333 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:16.326+0000 7f93ce59c640 1 -- 172.21.15.19:0/1596580027 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5609fcb93a10 msgr2=0x5609fcb9c750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:33:16.333 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:16.326+0000 7f93ce59c640 1 --2- 172.21.15.19:0/1596580027 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5609fcb93a10 0x5609fcb9c750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:33:16.334 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:16.326+0000 7f93ce59c640 1 -- 172.21.15.19:0/1596580027 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5609fcb9f9a0 msgr2=0x5609fcb9cdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:33:16.334 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:16.326+0000 7f93ce59c640 1 --2- 172.21.15.19:0/1596580027 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5609fcb9f9a0 0x5609fcb9cdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:33:16.334 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:16.326+0000 7f93ce59c640 1 -- 172.21.15.19:0/1596580027 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5609fcac1c90 con 0x5609fcb930f0 2024-09-10T22:33:16.334 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:16.326+0000 7f93ced9d640 1 --2- 172.21.15.19:0/1596580027 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5609fcb9f9a0 0x5609fcb9cdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T22:33:16.334 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:16.327+0000 7f93ce59c640 1 --2- 172.21.15.19:0/1596580027 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5609fcb930f0 0x5609fcb9f300 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7f93c0012700 tx=0x7f93c0012bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2b5abb65761fcb9c server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:33:16.334 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:16.327+0000 7f93b5ffb640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-10T22:33:16.334 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:16.327+0000 7f93b5ffb640 1 -- 172.21.15.19:0/1596580027 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93c000f920 con 0x5609fcb930f0 2024-09-10T22:33:16.334 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:16.327+0000 7f93b5ffb640 1 -- 172.21.15.19:0/1596580027 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8327+0+0 (secure 0 0 0) 0x7f93c000fac0 con 0x5609fcb930f0 2024-09-10T22:33:16.334 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:16.327+0000 7f93d6e8f740 1 -- 172.21.15.19:0/1596580027 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f93c40ab9c0 con 0x5609fcb930f0 2024-09-10T22:33:16.334 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:16.327+0000 7f93b5ffb640 1 -- 172.21.15.19:0/1596580027 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f93c000fcc0 con 0x5609fcb930f0 2024-09-10T22:33:16.334 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:16.327+0000 7f93d6e8f740 10 client.16716 fetch_fsmap learned FSMap version 27 2024-09-10T22:33:16.334 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:16.327+0000 7f93d6e8f740 1 -- 172.21.15.19:0/1596580027 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x5609fcbae060 con 0x5609fcb930f0 2024-09-10T22:33:16.334 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:16.327+0000 7f93b5ffb640 1 -- 172.21.15.19:0/1596580027 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f93c40ab9c0 con 0x5609fcb930f0 2024-09-10T22:33:16.335 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:16.328+0000 7f93b5ffb640 1 -- 172.21.15.19:0/1596580027 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7f93c0024020 con 0x5609fcb930f0 2024-09-10T22:33:16.335 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:16.328+0000 7f93d6e8f740 10 client.16716 fetch_fsmap finished waiting for FSMap version 27 2024-09-10T22:33:16.335 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:16.328+0000 7f93d6e8f740 10 client.16716 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-10T22:33:16.335 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:16.328+0000 7f93d6e8f740 20 client.16716 populate_metadata read hostname 'smithi019' 2024-09-10T22:33:16.335 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:16.328+0000 7f93d6e8f740 1 --2- 172.21.15.19:0/1596580027 >> [v2:172.21.15.138:6838/383637208,v1:172.21.15.138:6839/383637208] conn(0x5609fcbaf530 0x5609fcbb1960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:33:16.335 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:16.328+0000 7f93d6e8f740 4 client.16716 mds_command: new command op to 24568 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T22:33:16.335 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:16.328+0000 7f93d6e8f740 1 -- 172.21.15.19:0/1596580027 --> [v2:172.21.15.138:6838/383637208,v1:172.21.15.138:6839/383637208] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5609fcb0bdf0 con 0x5609fcbaf530 2024-09-10T22:33:16.335 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:16.328+0000 7f93cdd9b640 1 --2- 172.21.15.19:0/1596580027 >> [v2:172.21.15.138:6838/383637208,v1:172.21.15.138:6839/383637208] conn(0x5609fcbaf530 0x5609fcbb1960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:33:16.335 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:16.328+0000 7f93b5ffb640 10 client.16716 ms_handle_connect on v2:172.21.15.138:6838/383637208 2024-09-10T22:33:16.335 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:16.328+0000 7f93cdd9b640 1 --2- 172.21.15.19:0/1596580027 >> [v2:172.21.15.138:6838/383637208,v1:172.21.15.138:6839/383637208] conn(0x5609fcbaf530 0x5609fcbb1960 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=9b0cced45f8cf183 server_cookie=bc5cc3096aa10ba6 in_seq=0 out_seq=0 2024-09-10T22:33:16.335 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:16.329+0000 7f93b5ffb640 1 -- 172.21.15.19:0/1596580027 <== mds.1 v2:172.21.15.138:6838/383637208 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5609fcb0bdf0 con 0x5609fcbaf530 2024-09-10T22:33:16.335 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:16.329+0000 7f93b5ffb640 10 client.16716 handle_command_reply: tid=0 2024-09-10T22:33:16.335 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:16.329+0000 7f93d6e8f740 1 client.16716 shutdown 2024-09-10T22:33:16.335 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:16.329+0000 7f93d6e8f740 1 -- 172.21.15.19:0/1596580027 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5609fcb930f0 msgr2=0x5609fcb9f300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:33:16.336 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:16.329+0000 7f93d6e8f740 1 --2- 172.21.15.19:0/1596580027 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5609fcb930f0 0x5609fcb9f300 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7f93c0012700 tx=0x7f93c0012bc0 comp rx=0 tx=0).stop 2024-09-10T22:33:16.336 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:16.329+0000 7f93d6e8f740 1 -- 172.21.15.19:0/1596580027 shutdown_connections 2024-09-10T22:33:16.336 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:16.329+0000 7f93d6e8f740 1 --2- 172.21.15.19:0/1596580027 >> [v2:172.21.15.138:6838/383637208,v1:172.21.15.138:6839/383637208] conn(0x5609fcbaf530 0x5609fcbb1960 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:33:16.336 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:16.329+0000 7f93b5ffb640 0 client.16716 ms_handle_reset on v2:172.21.15.138:6838/383637208 2024-09-10T22:33:16.336 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:16.329+0000 7f93d6e8f740 1 --2- 172.21.15.19:0/1596580027 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5609fcb9f9a0 0x5609fcb9cdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:33:16.336 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:16.329+0000 7f93d6e8f740 1 --2- 172.21.15.19:0/1596580027 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5609fcb93a10 0x5609fcb9c750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:33:16.336 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:16.329+0000 7f93d6e8f740 1 --2- 172.21.15.19:0/1596580027 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5609fcb930f0 0x5609fcb9f300 unknown :-1 s=CLOSED pgs=689 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:33:16.336 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:16.329+0000 7f93d6e8f740 1 -- 172.21.15.19:0/1596580027 >> 172.21.15.19:0/1596580027 conn(0x5609fcb90f20 msgr2=0x5609fcb96a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:33:16.336 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:16.329+0000 7f93d6e8f740 1 -- 172.21.15.19:0/1596580027 shutdown_connections 2024-09-10T22:33:16.336 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:16.330+0000 7f93d6e8f740 1 -- 172.21.15.19:0/1596580027 wait complete. 2024-09-10T22:33:16.336 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:16.330+0000 7f93d6e8f740 20 client.16716 trim_cache size 0 max 16384 2024-09-10T22:33:16.345 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:16.343+0000 7f93d6e8f740 1 Processor -- start 2024-09-10T22:33:16.345 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:16.343+0000 7f93d6e8f740 1 -- start start 2024-09-10T22:33:16.345 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:16.344+0000 7f93d6e8f740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5609fcb930f0 0x5609fcbab880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:33:16.346 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:16.344+0000 7f93d6e8f740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5609fcb93a10 0x5609fcba0d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:33:16.346 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:16.344+0000 7f93d6e8f740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5609fcb9f9a0 0x5609fcba12d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:33:16.346 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:16.344+0000 7f93d6e8f740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f93d01b2fb0 con 0x5609fcb9f9a0 2024-09-10T22:33:16.346 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:16.344+0000 7f93d6e8f740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f93d01b0880 con 0x5609fcb930f0 2024-09-10T22:33:16.346 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:16.344+0000 7f93d6e8f740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f93d01ae6d0 con 0x5609fcb93a10 2024-09-10T22:33:16.346 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:16.344+0000 7f93ced9d640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5609fcb9f9a0 0x5609fcba12d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:33:16.346 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:16.344+0000 7f93ced9d640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5609fcb9f9a0 0x5609fcba12d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:37272/0 (socket says 172.21.15.19:37272) 2024-09-10T22:33:16.346 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:16.344+0000 7f93ced9d640 1 -- 172.21.15.19:0/4055781990 learned_addr learned my addr 172.21.15.19:0/4055781990 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:33:16.346 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:16.344+0000 7f93ce59c640 1 --2- 172.21.15.19:0/4055781990 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5609fcb930f0 0x5609fcbab880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:33:16.347 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:16.344+0000 7f93cdd9b640 1 --2- 172.21.15.19:0/4055781990 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5609fcb93a10 0x5609fcba0d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:33:16.347 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:16.344+0000 7f93ced9d640 1 -- 172.21.15.19:0/4055781990 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5609fcb93a10 msgr2=0x5609fcba0d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:33:16.347 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:16.344+0000 7f93ced9d640 1 --2- 172.21.15.19:0/4055781990 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5609fcb93a10 0x5609fcba0d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:33:16.347 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:16.344+0000 7f93ced9d640 1 -- 172.21.15.19:0/4055781990 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5609fcb930f0 msgr2=0x5609fcbab880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:33:16.347 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:16.344+0000 7f93ced9d640 1 --2- 172.21.15.19:0/4055781990 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5609fcb930f0 0x5609fcbab880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:33:16.348 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:16.344+0000 7f93ced9d640 1 -- 172.21.15.19:0/4055781990 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5609fcb9d6a0 con 0x5609fcb9f9a0 2024-09-10T22:33:16.348 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:16.344+0000 7f93ce59c640 1 --2- 172.21.15.19:0/4055781990 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5609fcb930f0 0x5609fcbab880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T22:33:16.348 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:16.345+0000 7f93ced9d640 1 --2- 172.21.15.19:0/4055781990 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5609fcb9f9a0 0x5609fcba12d0 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7f93c8031a70 tx=0x7f93c8045000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cf3989ff58430768 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:33:16.348 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:16.345+0000 7f93b7fff640 1 -- 172.21.15.19:0/4055781990 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93c80041c0 con 0x5609fcb9f9a0 2024-09-10T22:33:16.348 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:16.345+0000 7f93b7fff640 1 -- 172.21.15.19:0/4055781990 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f93c8036040 con 0x5609fcb9f9a0 2024-09-10T22:33:16.348 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:16.345+0000 7f93b7fff640 1 -- 172.21.15.19:0/4055781990 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93c80305c0 con 0x5609fcb9f9a0 2024-09-10T22:33:16.350 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:16.346+0000 7f93d6e8f740 1 -- 172.21.15.19:0/4055781990 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5609fcb9f9a0 msgr2=0x5609fcba12d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:33:16.350 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:16.346+0000 7f93d6e8f740 1 --2- 172.21.15.19:0/4055781990 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5609fcb9f9a0 0x5609fcba12d0 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7f93c8031a70 tx=0x7f93c8045000 comp rx=0 tx=0).stop 2024-09-10T22:33:16.350 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:16.346+0000 7f93d6e8f740 1 -- 172.21.15.19:0/4055781990 shutdown_connections 2024-09-10T22:33:16.350 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:16.346+0000 7f93d6e8f740 1 --2- 172.21.15.19:0/4055781990 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5609fcb9f9a0 0x5609fcba12d0 unknown :-1 s=CLOSED pgs=690 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:33:16.350 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:16.346+0000 7f93d6e8f740 1 --2- 172.21.15.19:0/4055781990 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5609fcb93a10 0x5609fcba0d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:33:16.350 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:16.346+0000 7f93d6e8f740 1 --2- 172.21.15.19:0/4055781990 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5609fcb930f0 0x5609fcbab880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:33:16.350 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:16.346+0000 7f93d6e8f740 1 -- 172.21.15.19:0/4055781990 >> 172.21.15.19:0/4055781990 conn(0x5609fcb90f20 msgr2=0x5609fcb979b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:33:16.351 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:16.346+0000 7f93d6e8f740 1 -- 172.21.15.19:0/4055781990 shutdown_connections 2024-09-10T22:33:16.351 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:16.346+0000 7f93d6e8f740 1 -- 172.21.15.19:0/4055781990 wait complete. 2024-09-10T22:33:16.351 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:16.347+0000 7f93d6e8f740 1 -- start start 2024-09-10T22:33:16.351 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:16.347+0000 7f93d6e8f740 1 Processor -- start 2024-09-10T22:33:16.351 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:16.347+0000 7f93d6e8f740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5609fcb930f0 0x5609fcba78f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:33:16.351 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:16.347+0000 7f93d6e8f740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5609fcb93a10 0x5609fcba7e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:33:16.351 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:16.347+0000 7f93d6e8f740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5609fcb9f9a0 0x5609fcba28a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:33:16.351 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:16.347+0000 7f93d6e8f740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f93d01aed40 con 0x5609fcb930f0 2024-09-10T22:33:16.351 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:16.347+0000 7f93d6e8f740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f93d01b01b0 con 0x5609fcb93a10 2024-09-10T22:33:16.351 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:16.347+0000 7f93d6e8f740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f93d01af410 con 0x5609fcb9f9a0 2024-09-10T22:33:16.351 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:16.347+0000 7f93d6e8f740 10 client.0 _ll_register_callbacks cb 0x7f93c0009850 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T22:33:16.351 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:16.347+0000 7f93ce59c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5609fcb930f0 0x5609fcba78f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:33:16.351 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:16.347+0000 7f93ce59c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5609fcb930f0 0x5609fcba78f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:37286/0 (socket says 172.21.15.19:37286) 2024-09-10T22:33:16.352 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:16.348+0000 7f93ce59c640 1 -- 172.21.15.19:0/3807770038 learned_addr learned my addr 172.21.15.19:0/3807770038 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:33:16.352 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:16.348+0000 7f93cdd9b640 1 --2- 172.21.15.19:0/3807770038 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5609fcb93a10 0x5609fcba7e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:33:16.352 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:16.348+0000 7f93ce59c640 1 -- 172.21.15.19:0/3807770038 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5609fcb9f9a0 msgr2=0x5609fcba28a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:33:16.352 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:16.348+0000 7f93ce59c640 1 --2- 172.21.15.19:0/3807770038 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5609fcb9f9a0 0x5609fcba28a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:33:16.352 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:16.348+0000 7f93ce59c640 1 -- 172.21.15.19:0/3807770038 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5609fcb93a10 msgr2=0x5609fcba7e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:33:16.352 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:16.348+0000 7f93ce59c640 1 --2- 172.21.15.19:0/3807770038 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5609fcb93a10 0x5609fcba7e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:33:16.352 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:16.348+0000 7f93ce59c640 1 -- 172.21.15.19:0/3807770038 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5609fcba2de0 con 0x5609fcb930f0 2024-09-10T22:33:16.352 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:16.348+0000 7f93ce59c640 1 --2- 172.21.15.19:0/3807770038 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5609fcb930f0 0x5609fcba78f0 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7f93c00104d0 tx=0x7f93c0010550 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c00eda6d1e144000 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:33:16.352 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:16.348+0000 7f93b5ffb640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-10T22:33:16.352 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:16.348+0000 7f93b5ffb640 1 -- 172.21.15.19:0/3807770038 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93c0010b30 con 0x5609fcb930f0 2024-09-10T22:33:16.352 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:16.348+0000 7f93b5ffb640 1 -- 172.21.15.19:0/3807770038 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8327+0+0 (secure 0 0 0) 0x7f93c0010cd0 con 0x5609fcb930f0 2024-09-10T22:33:16.352 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:16.348+0000 7f93d6e8f740 1 -- 172.21.15.19:0/3807770038 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f93c8036040 con 0x5609fcb930f0 2024-09-10T22:33:16.352 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:16.349+0000 7f93b5ffb640 1 -- 172.21.15.19:0/3807770038 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f93c0030890 con 0x5609fcb930f0 2024-09-10T22:33:16.352 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:16.349+0000 7f93d6e8f740 10 client.16722 fetch_fsmap learned FSMap version 27 2024-09-10T22:33:16.353 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:16.349+0000 7f93d6e8f740 1 -- 172.21.15.19:0/3807770038 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x5609fcc1cac0 con 0x5609fcb930f0 2024-09-10T22:33:16.354 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:16.349+0000 7f93b5ffb640 1 -- 172.21.15.19:0/3807770038 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f93c8036040 con 0x5609fcb930f0 2024-09-10T22:33:16.354 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:16.349+0000 7f93b5ffb640 1 -- 172.21.15.19:0/3807770038 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7f93c0024070 con 0x5609fcb930f0 2024-09-10T22:33:16.354 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:16.349+0000 7f93d6e8f740 10 client.16722 fetch_fsmap finished waiting for FSMap version 27 2024-09-10T22:33:16.354 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:16.349+0000 7f93d6e8f740 10 client.16722 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-10T22:33:16.354 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:16.349+0000 7f93d6e8f740 20 client.16722 populate_metadata read hostname 'smithi019' 2024-09-10T22:33:16.354 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:16.349+0000 7f93d6e8f740 1 --2- 172.21.15.19:0/3807770038 >> [v2:172.21.15.138:6838/383637208,v1:172.21.15.138:6839/383637208] conn(0x5609fcc1d2c0 0x5609fcc1f6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:33:16.355 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:16.349+0000 7f93d6e8f740 4 client.16722 mds_command: new command op to 24568 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-10T22:33:16.355 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:16.349+0000 7f93d6e8f740 1 -- 172.21.15.19:0/3807770038 --> [v2:172.21.15.138:6838/383637208,v1:172.21.15.138:6839/383637208] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5609fcb078a0 con 0x5609fcc1d2c0 2024-09-10T22:33:16.355 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:16.350+0000 7f93cdd9b640 1 --2- 172.21.15.19:0/3807770038 >> [v2:172.21.15.138:6838/383637208,v1:172.21.15.138:6839/383637208] conn(0x5609fcc1d2c0 0x5609fcc1f6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:33:16.355 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:16.350+0000 7f93cdd9b640 1 --2- 172.21.15.19:0/3807770038 >> [v2:172.21.15.138:6838/383637208,v1:172.21.15.138:6839/383637208] conn(0x5609fcc1d2c0 0x5609fcc1f6e0 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=9a648de615b02065 server_cookie=4aa8c5b4f1f61880 in_seq=0 out_seq=0 2024-09-10T22:33:16.355 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:16.350+0000 7f93b5ffb640 10 client.16722 ms_handle_connect on v2:172.21.15.138:6838/383637208 2024-09-10T22:33:16.355 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:16.350+0000 7f93b5ffb640 1 -- 172.21.15.19:0/3807770038 <== mds.1 v2:172.21.15.138:6838/383637208 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5609fcb078a0 con 0x5609fcc1d2c0 2024-09-10T22:33:16.355 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:16.350+0000 7f93b5ffb640 10 client.16722 handle_command_reply: tid=0 2024-09-10T22:33:16.355 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:16.350+0000 7f93d6e8f740 1 client.16722 shutdown 2024-09-10T22:33:16.355 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:16.351+0000 7f93d6e8f740 1 -- 172.21.15.19:0/3807770038 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5609fcb930f0 msgr2=0x5609fcba78f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:33:16.355 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:16.351+0000 7f93d6e8f740 1 --2- 172.21.15.19:0/3807770038 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5609fcb930f0 0x5609fcba78f0 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7f93c00104d0 tx=0x7f93c0010550 comp rx=0 tx=0).stop 2024-09-10T22:33:16.355 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:16.351+0000 7f93d6e8f740 1 -- 172.21.15.19:0/3807770038 shutdown_connections 2024-09-10T22:33:16.355 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:16.351+0000 7f93d6e8f740 1 --2- 172.21.15.19:0/3807770038 >> [v2:172.21.15.138:6838/383637208,v1:172.21.15.138:6839/383637208] conn(0x5609fcc1d2c0 0x5609fcc1f6e0 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:33:16.355 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:16.351+0000 7f93d6e8f740 1 --2- 172.21.15.19:0/3807770038 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5609fcb9f9a0 0x5609fcba28a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:33:16.355 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:16.351+0000 7f93d6e8f740 1 --2- 172.21.15.19:0/3807770038 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5609fcb93a10 0x5609fcba7e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:33:16.356 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:16.351+0000 7f93d6e8f740 1 --2- 172.21.15.19:0/3807770038 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5609fcb930f0 0x5609fcba78f0 unknown :-1 s=CLOSED pgs=691 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:33:16.356 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:16.351+0000 7f93d6e8f740 1 -- 172.21.15.19:0/3807770038 >> 172.21.15.19:0/3807770038 conn(0x5609fcb90f20 msgr2=0x5609fcb8f750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:33:16.356 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:16.351+0000 7f93b5ffb640 0 client.16722 ms_handle_reset on v2:172.21.15.138:6838/383637208 2024-09-10T22:33:16.356 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:16.351+0000 7f93d6e8f740 1 -- 172.21.15.19:0/3807770038 shutdown_connections 2024-09-10T22:33:16.356 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:16.351+0000 7f93d6e8f740 1 -- 172.21.15.19:0/3807770038 wait complete. 2024-09-10T22:33:16.356 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:16.351+0000 7f93d6e8f740 20 client.16722 trim_cache size 0 max 16384 2024-09-10T22:33:16.356 INFO:teuthology.orchestra.run.smithi019.stdout:[] 2024-09-10T22:33:16.357 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:16.352+0000 7f93d4aba640 1 -- 172.21.15.19:0/3552107739 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f93b80b52e0 msgr2=0x7f93b80b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:33:16.357 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:16.352+0000 7f93d4aba640 1 --2- 172.21.15.19:0/3552107739 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f93b80b52e0 0x7f93b80b77a0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f93c802f500 tx=0x7f93c802f310 comp rx=0 tx=0).stop 2024-09-10T22:33:16.357 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:16.352+0000 7f93d4aba640 1 -- 172.21.15.19:0/3552107739 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f93d01087d0 msgr2=0x7f93d00759e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:33:16.357 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:16.352+0000 7f93d4aba640 1 --2- 172.21.15.19:0/3552107739 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f93d01087d0 0x7f93d00759e0 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7f93c400d770 tx=0x7f93c400dc30 comp rx=0 tx=0).stop 2024-09-10T22:33:16.357 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:16.352+0000 7f93d4aba640 1 -- 172.21.15.19:0/3552107739 shutdown_connections 2024-09-10T22:33:16.358 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:16.352+0000 7f93d4aba640 1 --2- 172.21.15.19:0/3552107739 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f93b80b52e0 0x7f93b80b77a0 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:33:16.358 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:16.352+0000 7f93d4aba640 1 --2- 172.21.15.19:0/3552107739 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f93d0109150 0x7f93d0075f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:33:16.358 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:16.352+0000 7f93d4aba640 1 --2- 172.21.15.19:0/3552107739 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f93d01087d0 0x7f93d00759e0 unknown :-1 s=CLOSED pgs=688 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:33:16.358 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:16.352+0000 7f93d4aba640 1 --2- 172.21.15.19:0/3552107739 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f93d0102dc0 0x7f93d00754a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:33:16.358 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:16.352+0000 7f93d4aba640 1 -- 172.21.15.19:0/3552107739 >> 172.21.15.19:0/3552107739 conn(0x7f93d00fe830 msgr2=0x7f93d0100c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:33:16.358 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:16.353+0000 7f93d4aba640 1 -- 172.21.15.19:0/3552107739 shutdown_connections 2024-09-10T22:33:16.358 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:16.353+0000 7f93d4aba640 1 -- 172.21.15.19:0/3552107739 wait complete. 2024-09-10T22:33:16.359 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:33:15 smithi135 ceph-mon[34789]: pgmap v552: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 589 KiB/s rd, 298 MiB/s wr, 436 op/s 2024-09-10T22:33:16.375 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:33:15 smithi138 ceph-mon[35236]: pgmap v552: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 589 KiB/s rd, 298 MiB/s wr, 436 op/s 2024-09-10T22:33:17.151 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 22997a4c-6fc2-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-10T22:33:17.499 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/22997a4c-6fc2-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T22:33:18.133 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:18.130+0000 7fd57c725640 1 -- 172.21.15.19:0/459089757 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd5741021b0 msgr2=0x7fd57410ef00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:33:18.133 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:18.130+0000 7fd57c725640 1 --2- 172.21.15.19:0/459089757 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd5741021b0 0x7fd57410ef00 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7fd570009900 tx=0x7fd57002a4a0 comp rx=0 tx=0).stop 2024-09-10T22:33:18.133 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:18.130+0000 7fd57c725640 1 -- 172.21.15.19:0/459089757 shutdown_connections 2024-09-10T22:33:18.133 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:18.130+0000 7fd57c725640 1 --2- 172.21.15.19:0/459089757 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd57410f440 0x7fd574111830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:33:18.134 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:18.130+0000 7fd57c725640 1 --2- 172.21.15.19:0/459089757 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd5741021b0 0x7fd57410ef00 unknown :-1 s=CLOSED pgs=692 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:33:18.134 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:18.130+0000 7fd57c725640 1 --2- 172.21.15.19:0/459089757 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd574101890 0x7fd574101c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:33:18.134 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:18.130+0000 7fd57c725640 1 -- 172.21.15.19:0/459089757 >> 172.21.15.19:0/459089757 conn(0x7fd5740fd700 msgr2=0x7fd5740ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:33:18.135 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:18.130+0000 7fd57c725640 1 -- 172.21.15.19:0/459089757 shutdown_connections 2024-09-10T22:33:18.135 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:18.130+0000 7fd57c725640 1 -- 172.21.15.19:0/459089757 wait complete. 2024-09-10T22:33:18.135 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:18.131+0000 7fd57c725640 1 Processor -- start 2024-09-10T22:33:18.135 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:18.131+0000 7fd57c725640 1 -- start start 2024-09-10T22:33:18.135 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:18.131+0000 7fd57c725640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd574101890 0x7fd57419b480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:33:18.135 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:18.131+0000 7fd57c725640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd5741021b0 0x7fd57419b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:33:18.135 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:18.131+0000 7fd57c725640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd57410f440 0x7fd5741a0d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:33:18.135 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:18.131+0000 7fd57c725640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fd574114f90 con 0x7fd5741021b0 2024-09-10T22:33:18.135 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:18.131+0000 7fd57c725640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fd574114e10 con 0x7fd574101890 2024-09-10T22:33:18.135 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:18.131+0000 7fd57c725640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7fd574115110 con 0x7fd57410f440 2024-09-10T22:33:18.136 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:18.132+0000 7fd579cc0640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd5741021b0 0x7fd57419b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:33:18.137 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:18.132+0000 7fd579cc0640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd5741021b0 0x7fd57419b9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:37302/0 (socket says 172.21.15.19:37302) 2024-09-10T22:33:18.137 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:18.132+0000 7fd579cc0640 1 -- 172.21.15.19:0/522297810 learned_addr learned my addr 172.21.15.19:0/522297810 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:33:18.137 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:18.132+0000 7fd57acc2640 1 --2- 172.21.15.19:0/522297810 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd57410f440 0x7fd5741a0d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:33:18.137 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:18.132+0000 7fd579cc0640 1 -- 172.21.15.19:0/522297810 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd57410f440 msgr2=0x7fd5741a0d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:33:18.137 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:18.132+0000 7fd579cc0640 1 --2- 172.21.15.19:0/522297810 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd57410f440 0x7fd5741a0d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:33:18.137 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:18.132+0000 7fd579cc0640 1 -- 172.21.15.19:0/522297810 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd574101890 msgr2=0x7fd57419b480 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-10T22:33:18.137 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:18.132+0000 7fd579cc0640 1 --2- 172.21.15.19:0/522297810 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd574101890 0x7fd57419b480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:33:18.137 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:18.132+0000 7fd579cc0640 1 -- 172.21.15.19:0/522297810 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd5741a1530 con 0x7fd5741021b0 2024-09-10T22:33:18.137 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:18.133+0000 7fd579cc0640 1 --2- 172.21.15.19:0/522297810 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd5741021b0 0x7fd57419b9c0 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7fd570006010 tx=0x7fd570031ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:33:18.137 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:18.133+0000 7fd5677fe640 1 -- 172.21.15.19:0/522297810 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd570040030 con 0x7fd5741021b0 2024-09-10T22:33:18.137 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:18.133+0000 7fd57c725640 1 -- 172.21.15.19:0/522297810 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd5741a17c0 con 0x7fd5741021b0 2024-09-10T22:33:18.137 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:18.133+0000 7fd5677fe640 1 -- 172.21.15.19:0/522297810 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd57003c8f0 con 0x7fd5741021b0 2024-09-10T22:33:18.137 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:18.133+0000 7fd5677fe640 1 -- 172.21.15.19:0/522297810 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd570044a60 con 0x7fd5741021b0 2024-09-10T22:33:18.138 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:18.133+0000 7fd57c725640 1 -- 172.21.15.19:0/522297810 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd5741a7ee0 con 0x7fd5741021b0 2024-09-10T22:33:18.140 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:18.137+0000 7fd5677fe640 1 -- 172.21.15.19:0/522297810 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 18) ==== 153250+0+0 (secure 0 0 0) 0x7fd570044c00 con 0x7fd5741021b0 2024-09-10T22:33:18.141 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:18.137+0000 7fd57eafa740 1 Processor -- start 2024-09-10T22:33:18.141 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:18.138+0000 7fd57eafa740 1 -- start start 2024-09-10T22:33:18.141 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:18.138+0000 7fd57eafa740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x558ce68104d0 0x558ce68108b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:33:18.141 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:18.138+0000 7fd57eafa740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558ce6810df0 0x558ce681c840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:33:18.142 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:18.138+0000 7fd57eafa740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x558ce681cd80 0x558ce681f170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:33:18.143 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:18.138+0000 7fd57eafa740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x558ce6786ea0 con 0x558ce681cd80 2024-09-10T22:33:18.143 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:18.138+0000 7fd57eafa740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x558ce67762d0 con 0x558ce6810df0 2024-09-10T22:33:18.143 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:18.138+0000 7fd57eafa740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x558ce677a0e0 con 0x558ce68104d0 2024-09-10T22:33:18.143 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:18.139+0000 7fd579cc0640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x558ce681cd80 0x558ce681f170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:33:18.143 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:18.139+0000 7fd579cc0640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x558ce681cd80 0x558ce681f170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:37304/0 (socket says 172.21.15.19:37304) 2024-09-10T22:33:18.143 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:18.139+0000 7fd579cc0640 1 -- 172.21.15.19:0/3572795117 learned_addr learned my addr 172.21.15.19:0/3572795117 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:33:18.143 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:18.139+0000 7fd5677fe640 1 --2- 172.21.15.19:0/522297810 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7fd5600b52e0 0x7fd5600b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:33:18.143 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:18.139+0000 7fd579cc0640 1 -- 172.21.15.19:0/3572795117 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x558ce68104d0 msgr2=0x558ce68108b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:33:18.143 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:18.139+0000 7fd579cc0640 1 --2- 172.21.15.19:0/3572795117 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x558ce68104d0 0x558ce68108b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:33:18.143 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:18.139+0000 7fd579cc0640 1 -- 172.21.15.19:0/3572795117 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558ce6810df0 msgr2=0x558ce681c840 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-10T22:33:18.143 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:18.139+0000 7fd579cc0640 1 --2- 172.21.15.19:0/3572795117 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558ce6810df0 0x558ce681c840 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:33:18.144 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:18.139+0000 7fd579cc0640 1 -- 172.21.15.19:0/3572795117 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558ce64d4650 con 0x558ce681cd80 2024-09-10T22:33:18.145 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:18.140+0000 7fd5677fe640 1 -- 172.21.15.19:0/522297810 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8327+0+0 (secure 0 0 0) 0x7fd570106680 con 0x7fd5741021b0 2024-09-10T22:33:18.145 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:18.140+0000 7fd57acc2640 1 --2- 172.21.15.19:0/522297810 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7fd5600b52e0 0x7fd5600b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:33:18.145 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:18.140+0000 7fd579cc0640 1 --2- 172.21.15.19:0/3572795117 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x558ce681cd80 0x558ce681f170 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7fd5700a4b50 tx=0x7fd5700914a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4a936ca47f36e825 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:33:18.145 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:18.140+0000 7fd564ff9640 1 -- 172.21.15.19:0/3572795117 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5700cc730 con 0x558ce681cd80 2024-09-10T22:33:18.145 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:18.140+0000 7fd564ff9640 1 -- 172.21.15.19:0/3572795117 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd5700cc8f0 con 0x558ce681cd80 2024-09-10T22:33:18.145 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:18.140+0000 7fd564ff9640 1 -- 172.21.15.19:0/3572795117 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5700cc550 con 0x558ce681cd80 2024-09-10T22:33:18.145 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:18.140+0000 7fd57acc2640 1 --2- 172.21.15.19:0/522297810 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7fd5600b52e0 0x7fd5600b77a0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7fd56c005c40 tx=0x7fd56c00a3b0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:33:18.145 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:18.141+0000 7fd57eafa740 1 -- 172.21.15.19:0/3572795117 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x558ce681cd80 msgr2=0x558ce681f170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:33:18.145 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:18.141+0000 7fd57eafa740 1 --2- 172.21.15.19:0/3572795117 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x558ce681cd80 0x558ce681f170 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7fd5700a4b50 tx=0x7fd5700914a0 comp rx=0 tx=0).stop 2024-09-10T22:33:18.145 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:18.142+0000 7fd57eafa740 1 -- 172.21.15.19:0/3572795117 shutdown_connections 2024-09-10T22:33:18.145 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:18.142+0000 7fd57eafa740 1 --2- 172.21.15.19:0/3572795117 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x558ce681cd80 0x558ce681f170 unknown :-1 s=CLOSED pgs=694 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:33:18.145 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:18.142+0000 7fd57eafa740 1 --2- 172.21.15.19:0/3572795117 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558ce6810df0 0x558ce681c840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:33:18.145 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:18.142+0000 7fd57eafa740 1 --2- 172.21.15.19:0/3572795117 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x558ce68104d0 0x558ce68108b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:33:18.146 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:18.142+0000 7fd57eafa740 1 -- 172.21.15.19:0/3572795117 >> 172.21.15.19:0/3572795117 conn(0x558ce680e300 msgr2=0x558ce680f4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:33:18.146 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:18.142+0000 7fd57eafa740 1 -- 172.21.15.19:0/3572795117 shutdown_connections 2024-09-10T22:33:18.146 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:18.142+0000 7fd57eafa740 1 -- 172.21.15.19:0/3572795117 wait complete. 2024-09-10T22:33:18.147 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:18.143+0000 7fd57eafa740 1 -- start start 2024-09-10T22:33:18.147 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:18.143+0000 7fd57eafa740 1 Processor -- start 2024-09-10T22:33:18.147 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:18.143+0000 7fd57eafa740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x558ce68104d0 0x558ce681c6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:33:18.147 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:18.143+0000 7fd57eafa740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558ce6810df0 0x558ce6819b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:33:18.147 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:18.143+0000 7fd57eafa740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x558ce681cd80 0x558ce681a180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:33:18.147 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:18.143+0000 7fd57eafa740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x558ce65d7700 con 0x558ce68104d0 2024-09-10T22:33:18.147 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:18.143+0000 7fd57eafa740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x558ce6711160 con 0x558ce6810df0 2024-09-10T22:33:18.147 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:18.143+0000 7fd57eafa740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x558ce681f7c0 con 0x558ce681cd80 2024-09-10T22:33:18.148 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:18.143+0000 7fd57eafa740 10 client.0 _ll_register_callbacks cb 0x558ce672a9e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T22:33:18.148 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:18.144+0000 7fd57a4c1640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x558ce68104d0 0x558ce681c6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:33:18.148 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:18.144+0000 7fd57a4c1640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x558ce68104d0 0x558ce681c6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:37312/0 (socket says 172.21.15.19:37312) 2024-09-10T22:33:18.148 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:18.144+0000 7fd57a4c1640 1 -- 172.21.15.19:0/394163342 learned_addr learned my addr 172.21.15.19:0/394163342 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:33:18.148 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:18.144+0000 7fd57acc2640 1 --2- 172.21.15.19:0/394163342 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x558ce681cd80 0x558ce681a180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:33:18.148 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:18.144+0000 7fd57a4c1640 1 -- 172.21.15.19:0/394163342 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x558ce681cd80 msgr2=0x558ce681a180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:33:18.148 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:18.144+0000 7fd57a4c1640 1 --2- 172.21.15.19:0/394163342 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x558ce681cd80 0x558ce681a180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:33:18.148 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:18.144+0000 7fd57a4c1640 1 -- 172.21.15.19:0/394163342 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558ce6810df0 msgr2=0x558ce6819b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:33:18.148 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:18.144+0000 7fd57a4c1640 1 --2- 172.21.15.19:0/394163342 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558ce6810df0 0x558ce6819b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:33:18.148 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:18.144+0000 7fd57a4c1640 1 -- 172.21.15.19:0/394163342 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558ce673ec90 con 0x558ce68104d0 2024-09-10T22:33:18.148 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:18.144+0000 7fd57acc2640 1 --2- 172.21.15.19:0/394163342 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x558ce681cd80 0x558ce681a180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T22:33:18.149 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:18.145+0000 7fd57a4c1640 1 --2- 172.21.15.19:0/394163342 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x558ce68104d0 0x558ce681c6d0 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7fd56800bbc0 tx=0x7fd56800d6b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5761d08ed000d691 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:33:18.150 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:18.145+0000 7fd55dffb640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-10T22:33:18.150 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:18.145+0000 7fd55dffb640 1 -- 172.21.15.19:0/394163342 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd568016070 con 0x558ce68104d0 2024-09-10T22:33:18.150 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:18.145+0000 7fd57eafa740 1 -- 172.21.15.19:0/394163342 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd5700cc8f0 con 0x558ce68104d0 2024-09-10T22:33:18.150 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:18.145+0000 7fd55dffb640 1 -- 172.21.15.19:0/394163342 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8327+0+0 (secure 0 0 0) 0x7fd568005220 con 0x558ce68104d0 2024-09-10T22:33:18.150 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:18.146+0000 7fd55dffb640 1 -- 172.21.15.19:0/394163342 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fd568021050 con 0x558ce68104d0 2024-09-10T22:33:18.150 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:18.146+0000 7fd57eafa740 10 client.16734 fetch_fsmap learned FSMap version 27 2024-09-10T22:33:18.150 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:18.146+0000 7fd57eafa740 1 -- 172.21.15.19:0/394163342 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x558ce6833900 con 0x558ce68104d0 2024-09-10T22:33:18.150 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:18.146+0000 7fd55dffb640 1 -- 172.21.15.19:0/394163342 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd568004c50 con 0x558ce68104d0 2024-09-10T22:33:18.150 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:18.146+0000 7fd55dffb640 1 -- 172.21.15.19:0/394163342 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7fd568010620 con 0x558ce68104d0 2024-09-10T22:33:18.150 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:18.146+0000 7fd57eafa740 10 client.16734 fetch_fsmap finished waiting for FSMap version 27 2024-09-10T22:33:18.150 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:18.146+0000 7fd57eafa740 10 client.16734 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-10T22:33:18.150 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:18.146+0000 7fd57eafa740 20 client.16734 populate_metadata read hostname 'smithi019' 2024-09-10T22:33:18.151 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:18.146+0000 7fd57eafa740 1 --2- 172.21.15.19:0/394163342 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x558ce6834d60 0x558ce68371c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:33:18.151 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:18.146+0000 7fd57eafa740 4 client.16734 mds_command: new command op to 24581 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T22:33:18.151 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:18.147+0000 7fd57eafa740 1 -- 172.21.15.19:0/394163342 --> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7fd5700cc8f0 con 0x558ce6834d60 2024-09-10T22:33:18.151 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:18.147+0000 7fd579cc0640 1 --2- 172.21.15.19:0/394163342 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x558ce6834d60 0x558ce68371c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:33:18.152 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:18.150+0000 7fd579cc0640 1 --2- 172.21.15.19:0/394163342 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x558ce6834d60 0x558ce68371c0 crc :-1 s=READY pgs=146 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=97560c14c710a3d9 server_cookie=b6e56ec246025485 in_seq=0 out_seq=0 2024-09-10T22:33:18.153 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:18.150+0000 7fd55dffb640 10 client.16734 ms_handle_connect on v2:172.21.15.135:6838/1254769802 2024-09-10T22:33:18.155 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:18.152+0000 7fd55dffb640 1 -- 172.21.15.19:0/394163342 <== mds.0 v2:172.21.15.135:6838/1254769802 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x7fd5700cc8f0 con 0x558ce6834d60 2024-09-10T22:33:18.155 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:18.152+0000 7fd55dffb640 10 client.16734 handle_command_reply: tid=0 2024-09-10T22:33:18.156 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:18.152+0000 7fd57eafa740 1 client.16734 shutdown 2024-09-10T22:33:18.156 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:18.153+0000 7fd57eafa740 1 -- 172.21.15.19:0/394163342 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x558ce68104d0 msgr2=0x558ce681c6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:33:18.156 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:18.153+0000 7fd57eafa740 1 --2- 172.21.15.19:0/394163342 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x558ce68104d0 0x558ce681c6d0 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7fd56800bbc0 tx=0x7fd56800d6b0 comp rx=0 tx=0).stop 2024-09-10T22:33:18.156 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:18.153+0000 7fd57eafa740 1 -- 172.21.15.19:0/394163342 shutdown_connections 2024-09-10T22:33:18.156 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:18.153+0000 7fd57eafa740 1 --2- 172.21.15.19:0/394163342 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x558ce6834d60 0x558ce68371c0 crc :-1 s=READY pgs=146 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:33:18.156 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:18.153+0000 7fd57eafa740 1 --2- 172.21.15.19:0/394163342 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x558ce681cd80 0x558ce681a180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:33:18.156 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:18.153+0000 7fd57eafa740 1 --2- 172.21.15.19:0/394163342 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558ce6810df0 0x558ce6819b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:33:18.157 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:18.153+0000 7fd57eafa740 1 --2- 172.21.15.19:0/394163342 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x558ce68104d0 0x558ce681c6d0 unknown :-1 s=CLOSED pgs=695 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:33:18.157 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:18.153+0000 7fd57eafa740 1 -- 172.21.15.19:0/394163342 >> 172.21.15.19:0/394163342 conn(0x558ce680e300 msgr2=0x558ce6813ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:33:18.157 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:18.153+0000 7fd55dffb640 0 client.16734 ms_handle_reset on v2:172.21.15.135:6838/1254769802 2024-09-10T22:33:18.157 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:18.154+0000 7fd57eafa740 1 -- 172.21.15.19:0/394163342 shutdown_connections 2024-09-10T22:33:18.157 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:18.154+0000 7fd57eafa740 1 -- 172.21.15.19:0/394163342 wait complete. 2024-09-10T22:33:18.157 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:18.154+0000 7fd57eafa740 20 client.16734 trim_cache size 0 max 16384 2024-09-10T22:33:18.178 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:18.176+0000 7fd57eafa740 1 Processor -- start 2024-09-10T22:33:18.178 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:18.176+0000 7fd57eafa740 1 -- start start 2024-09-10T22:33:18.178 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:18.176+0000 7fd57eafa740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x558ce68104d0 0x558ce6831170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:33:18.178 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:18.176+0000 7fd57eafa740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x558ce6810df0 0x558ce680d310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:33:18.178 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:18.176+0000 7fd57eafa740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558ce681cd80 0x558ce681e170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:33:18.179 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:18.176+0000 7fd57eafa740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fd5741aec70 con 0x558ce68104d0 2024-09-10T22:33:18.179 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:18.176+0000 7fd57eafa740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fd5741ac540 con 0x558ce681cd80 2024-09-10T22:33:18.179 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:18.176+0000 7fd57eafa740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7fd5741aa3b0 con 0x558ce6810df0 2024-09-10T22:33:18.179 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:18.176+0000 7fd57a4c1640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x558ce68104d0 0x558ce6831170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:33:18.179 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:18.176+0000 7fd57a4c1640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x558ce68104d0 0x558ce6831170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:37318/0 (socket says 172.21.15.19:37318) 2024-09-10T22:33:18.179 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:18.176+0000 7fd57a4c1640 1 -- 172.21.15.19:0/2894264073 learned_addr learned my addr 172.21.15.19:0/2894264073 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:33:18.179 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:18.177+0000 7fd57a4c1640 1 -- 172.21.15.19:0/2894264073 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x558ce6810df0 msgr2=0x558ce680d310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:33:18.179 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:18.177+0000 7fd57a4c1640 1 --2- 172.21.15.19:0/2894264073 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x558ce6810df0 0x558ce680d310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:33:18.179 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:18.177+0000 7fd57a4c1640 1 -- 172.21.15.19:0/2894264073 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558ce681cd80 msgr2=0x558ce681e170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:33:18.179 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:18.177+0000 7fd57a4c1640 1 --2- 172.21.15.19:0/2894264073 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558ce681cd80 0x558ce681e170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:33:18.179 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:18.177+0000 7fd57a4c1640 1 -- 172.21.15.19:0/2894264073 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558ce6810c20 con 0x558ce68104d0 2024-09-10T22:33:18.181 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:18.177+0000 7fd57a4c1640 1 --2- 172.21.15.19:0/2894264073 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x558ce68104d0 0x558ce6831170 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7fd56800b400 tx=0x7fd56800b430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e28e7ed1e8199795 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:33:18.181 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:18.177+0000 7fd55ffff640 1 -- 172.21.15.19:0/2894264073 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd568016070 con 0x558ce68104d0 2024-09-10T22:33:18.181 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:18.178+0000 7fd55ffff640 1 -- 172.21.15.19:0/2894264073 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd568005020 con 0x558ce68104d0 2024-09-10T22:33:18.181 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:18.178+0000 7fd55ffff640 1 -- 172.21.15.19:0/2894264073 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd568003ab0 con 0x558ce68104d0 2024-09-10T22:33:18.181 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:18.178+0000 7fd57eafa740 1 -- 172.21.15.19:0/2894264073 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x558ce68104d0 msgr2=0x558ce6831170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:33:18.181 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:18.178+0000 7fd57eafa740 1 --2- 172.21.15.19:0/2894264073 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x558ce68104d0 0x558ce6831170 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7fd56800b400 tx=0x7fd56800b430 comp rx=0 tx=0).stop 2024-09-10T22:33:18.181 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:18.179+0000 7fd57eafa740 1 -- 172.21.15.19:0/2894264073 shutdown_connections 2024-09-10T22:33:18.182 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:18.179+0000 7fd57eafa740 1 --2- 172.21.15.19:0/2894264073 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558ce681cd80 0x558ce681e170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:33:18.182 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:18.179+0000 7fd57eafa740 1 --2- 172.21.15.19:0/2894264073 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x558ce6810df0 0x558ce680d310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:33:18.182 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:18.179+0000 7fd57eafa740 1 --2- 172.21.15.19:0/2894264073 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x558ce68104d0 0x558ce6831170 unknown :-1 s=CLOSED pgs=696 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:33:18.182 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:18.179+0000 7fd57eafa740 1 -- 172.21.15.19:0/2894264073 >> 172.21.15.19:0/2894264073 conn(0x558ce680e300 msgr2=0x558ce680cc00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:33:18.182 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:18.179+0000 7fd57eafa740 1 -- 172.21.15.19:0/2894264073 shutdown_connections 2024-09-10T22:33:18.182 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:18.179+0000 7fd57eafa740 1 -- 172.21.15.19:0/2894264073 wait complete. 2024-09-10T22:33:18.182 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:18.179+0000 7fd57eafa740 1 -- start start 2024-09-10T22:33:18.182 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:18.179+0000 7fd57eafa740 1 Processor -- start 2024-09-10T22:33:18.186 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:18.180+0000 7fd57eafa740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558ce68104d0 0x558ce682d1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:33:18.186 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:18.180+0000 7fd57eafa740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x558ce6810df0 0x558ce682d720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:33:18.186 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:18.180+0000 7fd57eafa740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x558ce681cd80 0x558ce6828190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:33:18.186 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:18.180+0000 7fd57eafa740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fd5741aaa00 con 0x558ce6810df0 2024-09-10T22:33:18.186 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:18.180+0000 7fd57eafa740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fd5741abe70 con 0x558ce68104d0 2024-09-10T22:33:18.186 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:18.180+0000 7fd57eafa740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7fd5741ab0d0 con 0x558ce681cd80 2024-09-10T22:33:18.186 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:18.180+0000 7fd57eafa740 10 client.0 _ll_register_callbacks cb 0x7fd56800b260 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T22:33:18.186 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:18.180+0000 7fd579cc0640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x558ce6810df0 0x558ce682d720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:33:18.186 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:18.180+0000 7fd579cc0640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x558ce6810df0 0x558ce682d720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:37330/0 (socket says 172.21.15.19:37330) 2024-09-10T22:33:18.186 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:18.180+0000 7fd579cc0640 1 -- 172.21.15.19:0/2281903974 learned_addr learned my addr 172.21.15.19:0/2281903974 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:33:18.187 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:18.180+0000 7fd579cc0640 1 -- 172.21.15.19:0/2281903974 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x558ce681cd80 msgr2=0x558ce6828190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:33:18.187 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:18.180+0000 7fd579cc0640 1 --2- 172.21.15.19:0/2281903974 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x558ce681cd80 0x558ce6828190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:33:18.187 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:18.180+0000 7fd579cc0640 1 -- 172.21.15.19:0/2281903974 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558ce68104d0 msgr2=0x558ce682d1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:33:18.187 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:18.181+0000 7fd579cc0640 1 --2- 172.21.15.19:0/2281903974 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558ce68104d0 0x558ce682d1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:33:18.187 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:18.181+0000 7fd579cc0640 1 -- 172.21.15.19:0/2281903974 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558ce682dd90 con 0x558ce6810df0 2024-09-10T22:33:18.187 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:18.181+0000 7fd579cc0640 1 --2- 172.21.15.19:0/2281903974 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x558ce6810df0 0x558ce682d720 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7fd570104490 tx=0x7fd570106a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2173f8b103c91bc7 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:33:18.187 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:18.181+0000 7fd55dffb640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-10T22:33:18.187 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:18.182+0000 7fd55dffb640 1 -- 172.21.15.19:0/2281903974 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd57004a040 con 0x558ce6810df0 2024-09-10T22:33:18.187 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:18.183+0000 7fd55dffb640 1 -- 172.21.15.19:0/2281903974 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8327+0+0 (secure 0 0 0) 0x7fd5700c9050 con 0x558ce6810df0 2024-09-10T22:33:18.187 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:18.183+0000 7fd57eafa740 1 -- 172.21.15.19:0/2281903974 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd568005020 con 0x558ce6810df0 2024-09-10T22:33:18.187 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:18.183+0000 7fd55dffb640 1 -- 172.21.15.19:0/2281903974 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fd5700d0070 con 0x558ce6810df0 2024-09-10T22:33:18.187 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:18.183+0000 7fd57eafa740 10 client.16740 fetch_fsmap learned FSMap version 27 2024-09-10T22:33:18.187 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:18.183+0000 7fd57eafa740 1 -- 172.21.15.19:0/2281903974 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x558ce68a2130 con 0x558ce6810df0 2024-09-10T22:33:18.188 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:18.184+0000 7fd55dffb640 1 -- 172.21.15.19:0/2281903974 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd5700cc8f0 con 0x558ce6810df0 2024-09-10T22:33:18.188 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:18.184+0000 7fd55dffb640 1 -- 172.21.15.19:0/2281903974 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7fd5700c87f0 con 0x558ce6810df0 2024-09-10T22:33:18.188 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:18.185+0000 7fd57eafa740 10 client.16740 fetch_fsmap finished waiting for FSMap version 27 2024-09-10T22:33:18.188 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:18.185+0000 7fd57eafa740 10 client.16740 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-10T22:33:18.188 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:18.185+0000 7fd57eafa740 20 client.16740 populate_metadata read hostname 'smithi019' 2024-09-10T22:33:18.189 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:18.185+0000 7fd57eafa740 1 --2- 172.21.15.19:0/2281903974 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x558ce68a2750 0x558ce68a4b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:33:18.189 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:18.185+0000 7fd57eafa740 4 client.16740 mds_command: new command op to 24581 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-10T22:33:18.189 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:18.185+0000 7fd57eafa740 1 -- 172.21.15.19:0/2281903974 --> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] -- command(tid 0: {"prefix": "damage ls"}) -- 0x7fd568005020 con 0x558ce68a2750 2024-09-10T22:33:18.190 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:18.188+0000 7fd57a4c1640 1 --2- 172.21.15.19:0/2281903974 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x558ce68a2750 0x558ce68a4b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:33:18.196 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:18.194+0000 7fd57a4c1640 1 --2- 172.21.15.19:0/2281903974 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x558ce68a2750 0x558ce68a4b70 crc :-1 s=READY pgs=147 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fee2f102cef20b74 server_cookie=19004a5660201bcd in_seq=0 out_seq=0 2024-09-10T22:33:18.196 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:18.194+0000 7fd55dffb640 10 client.16740 ms_handle_connect on v2:172.21.15.135:6838/1254769802 2024-09-10T22:33:18.201 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:18.199+0000 7fd55dffb640 1 -- 172.21.15.19:0/2281903974 <== mds.0 v2:172.21.15.135:6838/1254769802 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x7fd568005020 con 0x558ce68a2750 2024-09-10T22:33:18.202 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:18.199+0000 7fd55dffb640 10 client.16740 handle_command_reply: tid=0 2024-09-10T22:33:18.202 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:18.199+0000 7fd57eafa740 1 client.16740 shutdown 2024-09-10T22:33:18.202 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:18.199+0000 7fd57eafa740 1 -- 172.21.15.19:0/2281903974 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x558ce6810df0 msgr2=0x558ce682d720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:33:18.202 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:18.199+0000 7fd57eafa740 1 --2- 172.21.15.19:0/2281903974 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x558ce6810df0 0x558ce682d720 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7fd570104490 tx=0x7fd570106a00 comp rx=0 tx=0).stop 2024-09-10T22:33:18.202 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:18.199+0000 7fd57eafa740 1 -- 172.21.15.19:0/2281903974 shutdown_connections 2024-09-10T22:33:18.202 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:18.200+0000 7fd57eafa740 1 --2- 172.21.15.19:0/2281903974 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x558ce68a2750 0x558ce68a4b70 crc :-1 s=READY pgs=147 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:33:18.202 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:18.200+0000 7fd55dffb640 0 client.16740 ms_handle_reset on v2:172.21.15.135:6838/1254769802 2024-09-10T22:33:18.202 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:18.200+0000 7fd57eafa740 1 --2- 172.21.15.19:0/2281903974 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x558ce681cd80 0x558ce6828190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:33:18.202 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:18.200+0000 7fd57eafa740 1 --2- 172.21.15.19:0/2281903974 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x558ce6810df0 0x558ce682d720 unknown :-1 s=CLOSED pgs=697 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:33:18.202 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:18.200+0000 7fd57eafa740 1 --2- 172.21.15.19:0/2281903974 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558ce68104d0 0x558ce682d1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:33:18.202 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:18.200+0000 7fd57eafa740 1 -- 172.21.15.19:0/2281903974 >> 172.21.15.19:0/2281903974 conn(0x558ce680e300 msgr2=0x558ce680f800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:33:18.202 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:18.200+0000 7fd57eafa740 1 -- 172.21.15.19:0/2281903974 shutdown_connections 2024-09-10T22:33:18.203 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:18.200+0000 7fd57eafa740 1 -- 172.21.15.19:0/2281903974 wait complete. 2024-09-10T22:33:18.203 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:18.200+0000 7fd57eafa740 20 client.16740 trim_cache size 0 max 16384 2024-09-10T22:33:18.203 INFO:teuthology.orchestra.run.smithi019.stdout:[] 2024-09-10T22:33:18.204 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:18.201+0000 7fd57c725640 1 -- 172.21.15.19:0/522297810 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7fd5600b52e0 msgr2=0x7fd5600b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:33:18.204 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:18.201+0000 7fd57c725640 1 --2- 172.21.15.19:0/522297810 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7fd5600b52e0 0x7fd5600b77a0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7fd56c005c40 tx=0x7fd56c00a3b0 comp rx=0 tx=0).stop 2024-09-10T22:33:18.204 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:18.201+0000 7fd57c725640 1 -- 172.21.15.19:0/522297810 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd5741021b0 msgr2=0x7fd57419b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:33:18.204 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:18.201+0000 7fd57c725640 1 --2- 172.21.15.19:0/522297810 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd5741021b0 0x7fd57419b9c0 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7fd570006010 tx=0x7fd570031ba0 comp rx=0 tx=0).stop 2024-09-10T22:33:18.204 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:18.201+0000 7fd57c725640 1 -- 172.21.15.19:0/522297810 shutdown_connections 2024-09-10T22:33:18.204 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:18.201+0000 7fd57c725640 1 --2- 172.21.15.19:0/522297810 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7fd5600b52e0 0x7fd5600b77a0 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:33:18.204 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:18.201+0000 7fd57c725640 1 --2- 172.21.15.19:0/522297810 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd57410f440 0x7fd5741a0d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:33:18.204 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:18.201+0000 7fd57c725640 1 --2- 172.21.15.19:0/522297810 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd5741021b0 0x7fd57419b9c0 unknown :-1 s=CLOSED pgs=693 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:33:18.204 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:18.201+0000 7fd57c725640 1 --2- 172.21.15.19:0/522297810 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd574101890 0x7fd57419b480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:33:18.204 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:18.201+0000 7fd57c725640 1 -- 172.21.15.19:0/522297810 >> 172.21.15.19:0/522297810 conn(0x7fd5740fd700 msgr2=0x7fd5740ffaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:33:18.204 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:18.201+0000 7fd57c725640 1 -- 172.21.15.19:0/522297810 shutdown_connections 2024-09-10T22:33:18.204 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:18.201+0000 7fd57c725640 1 -- 172.21.15.19:0/522297810 wait complete. 2024-09-10T22:33:18.360 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:33:18 smithi135 ceph-mon[34789]: pgmap v553: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 541 KiB/s rd, 315 MiB/s wr, 548 op/s 2024-09-10T22:33:18.375 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:33:18 smithi138 ceph-mon[35236]: pgmap v553: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 541 KiB/s rd, 315 MiB/s wr, 548 op/s 2024-09-10T22:33:18.458 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:33:18 smithi019 ceph-mon[31375]: pgmap v553: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 541 KiB/s rd, 315 MiB/s wr, 548 op/s 2024-09-10T22:33:19.957 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-10T22:33:19.958 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 22997a4c-6fc2-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-10T22:33:20.322 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/22997a4c-6fc2-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T22:33:20.359 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:33:20 smithi135 ceph-mon[34789]: pgmap v554: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 419 KiB/s rd, 255 MiB/s wr, 541 op/s 2024-09-10T22:33:20.375 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:33:20 smithi138 ceph-mon[35236]: pgmap v554: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 419 KiB/s rd, 255 MiB/s wr, 541 op/s 2024-09-10T22:33:20.446 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:33:20 smithi019 ceph-mon[31375]: pgmap v554: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 419 KiB/s rd, 255 MiB/s wr, 541 op/s 2024-09-10T22:33:21.258 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:21.150+0000 7f8274ee9640 1 -- 172.21.15.19:0/1473909131 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8270103ce0 msgr2=0x7f82701040c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:33:21.259 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:21.150+0000 7f8274ee9640 1 --2- 172.21.15.19:0/1473909131 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8270103ce0 0x7f82701040c0 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7f8260009900 tx=0x7f826002a410 comp rx=0 tx=0).stop 2024-09-10T22:33:21.259 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:21.150+0000 7f8274ee9640 1 -- 172.21.15.19:0/1473909131 shutdown_connections 2024-09-10T22:33:21.259 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:21.150+0000 7f8274ee9640 1 --2- 172.21.15.19:0/1473909131 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f827010d140 0x7f827010f5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:33:21.259 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:21.150+0000 7f8274ee9640 1 --2- 172.21.15.19:0/1473909131 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8270104600 0x7f827010caf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:33:21.259 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:21.150+0000 7f8274ee9640 1 --2- 172.21.15.19:0/1473909131 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8270103ce0 0x7f82701040c0 unknown :-1 s=CLOSED pgs=698 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:33:21.260 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:21.150+0000 7f8274ee9640 1 -- 172.21.15.19:0/1473909131 >> 172.21.15.19:0/1473909131 conn(0x7f82700fd700 msgr2=0x7f82700ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:33:21.260 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:21.150+0000 7f8274ee9640 1 -- 172.21.15.19:0/1473909131 shutdown_connections 2024-09-10T22:33:21.260 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:21.150+0000 7f8274ee9640 1 -- 172.21.15.19:0/1473909131 wait complete. 2024-09-10T22:33:21.260 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:21.151+0000 7f8274ee9640 1 Processor -- start 2024-09-10T22:33:21.260 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:21.151+0000 7f8274ee9640 1 -- start start 2024-09-10T22:33:21.260 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:21.151+0000 7f8274ee9640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f8270103ce0 0x7f8270199320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:33:21.261 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:21.151+0000 7f8274ee9640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8270104600 0x7f8270199860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:33:21.261 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:21.151+0000 7f8274ee9640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f827010d140 0x7f827019ec00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:33:21.261 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:21.151+0000 7f8274ee9640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f8270112db0 con 0x7f8270104600 2024-09-10T22:33:21.261 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:21.151+0000 7f8274ee9640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f8270112c30 con 0x7f827010d140 2024-09-10T22:33:21.261 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:21.151+0000 7f8274ee9640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f8270112f30 con 0x7f8270103ce0 2024-09-10T22:33:21.261 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:21.151+0000 7f826dd9b640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8270104600 0x7f8270199860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:33:21.262 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:21.151+0000 7f826dd9b640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8270104600 0x7f8270199860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:37352/0 (socket says 172.21.15.19:37352) 2024-09-10T22:33:21.262 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:21.151+0000 7f826dd9b640 1 -- 172.21.15.19:0/557064166 learned_addr learned my addr 172.21.15.19:0/557064166 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:33:21.262 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:21.151+0000 7f826e59c640 1 --2- 172.21.15.19:0/557064166 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f8270103ce0 0x7f8270199320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:33:21.262 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:21.151+0000 7f826ed9d640 1 --2- 172.21.15.19:0/557064166 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f827010d140 0x7f827019ec00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:33:21.262 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:21.152+0000 7f826dd9b640 1 -- 172.21.15.19:0/557064166 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f8270103ce0 msgr2=0x7f8270199320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:33:21.262 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:21.152+0000 7f826dd9b640 1 --2- 172.21.15.19:0/557064166 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f8270103ce0 0x7f8270199320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:33:21.263 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:21.152+0000 7f826dd9b640 1 -- 172.21.15.19:0/557064166 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f827010d140 msgr2=0x7f827019ec00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:33:21.263 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:21.152+0000 7f826dd9b640 1 --2- 172.21.15.19:0/557064166 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f827010d140 0x7f827019ec00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:33:21.263 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:21.152+0000 7f826dd9b640 1 -- 172.21.15.19:0/557064166 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f827019f3d0 con 0x7f8270104600 2024-09-10T22:33:21.263 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:21.152+0000 7f826ed9d640 1 --2- 172.21.15.19:0/557064166 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f827010d140 0x7f827019ec00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T22:33:21.263 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:21.152+0000 7f826dd9b640 1 --2- 172.21.15.19:0/557064166 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8270104600 0x7f8270199860 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7f826400e9c0 tx=0x7f826400ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:33:21.263 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:21.152+0000 7f825f7fe640 1 -- 172.21.15.19:0/557064166 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f826400ccc0 con 0x7f8270104600 2024-09-10T22:33:21.264 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:21.152+0000 7f825f7fe640 1 -- 172.21.15.19:0/557064166 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f82640035f0 con 0x7f8270104600 2024-09-10T22:33:21.264 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:21.152+0000 7f8274ee9640 1 -- 172.21.15.19:0/557064166 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f827019f6c0 con 0x7f8270104600 2024-09-10T22:33:21.264 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:21.152+0000 7f825f7fe640 1 -- 172.21.15.19:0/557064166 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f826400ce60 con 0x7f8270104600 2024-09-10T22:33:21.264 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:21.152+0000 7f8274ee9640 1 -- 172.21.15.19:0/557064166 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f82701a5f50 con 0x7f8270104600 2024-09-10T22:33:21.264 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:21.155+0000 7f82772be740 1 Processor -- start 2024-09-10T22:33:21.264 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:21.156+0000 7f82772be740 1 -- start start 2024-09-10T22:33:21.265 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:21.156+0000 7f825f7fe640 1 -- 172.21.15.19:0/557064166 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 18) ==== 153250+0+0 (secure 0 0 0) 0x7f8264004000 con 0x7f8270104600 2024-09-10T22:33:21.265 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:21.156+0000 7f82772be740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55c4949d5ee0 0x55c4949d62c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:33:21.265 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:21.156+0000 7f82772be740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55c4949d6800 0x55c4949e2250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:33:21.266 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:21.156+0000 7f82772be740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c4949e2790 0x55c4949e4b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:33:21.266 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:21.156+0000 7f82772be740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x55c49494ce60 con 0x55c4949d5ee0 2024-09-10T22:33:21.266 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:21.156+0000 7f82772be740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55c49493c290 con 0x55c4949e2790 2024-09-10T22:33:21.267 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:21.156+0000 7f82772be740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x55c4949400a0 con 0x55c4949d6800 2024-09-10T22:33:21.267 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:21.156+0000 7f826ed9d640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55c4949d5ee0 0x55c4949d62c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:33:21.267 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:21.156+0000 7f826ed9d640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55c4949d5ee0 0x55c4949d62c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:37356/0 (socket says 172.21.15.19:37356) 2024-09-10T22:33:21.267 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:21.156+0000 7f826ed9d640 1 -- 172.21.15.19:0/1511788121 learned_addr learned my addr 172.21.15.19:0/1511788121 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:33:21.267 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:21.156+0000 7f826dd9b640 1 --2- 172.21.15.19:0/1511788121 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c4949e2790 0x55c4949e4b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:33:21.267 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:21.156+0000 7f826e59c640 1 --2- 172.21.15.19:0/1511788121 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55c4949d6800 0x55c4949e2250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:33:21.268 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:21.157+0000 7f826dd9b640 1 -- 172.21.15.19:0/1511788121 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55c4949d6800 msgr2=0x55c4949e2250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:33:21.268 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:21.157+0000 7f826dd9b640 1 --2- 172.21.15.19:0/1511788121 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55c4949d6800 0x55c4949e2250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:33:21.268 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:21.157+0000 7f826dd9b640 1 -- 172.21.15.19:0/1511788121 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55c4949d5ee0 msgr2=0x55c4949d62c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:33:21.268 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:21.157+0000 7f826dd9b640 1 --2- 172.21.15.19:0/1511788121 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55c4949d5ee0 0x55c4949d62c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:33:21.268 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:21.157+0000 7f826dd9b640 1 -- 172.21.15.19:0/1511788121 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c49469a930 con 0x55c4949e2790 2024-09-10T22:33:21.268 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:21.157+0000 7f826ed9d640 1 --2- 172.21.15.19:0/1511788121 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55c4949d5ee0 0x55c4949d62c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T22:33:21.269 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:21.157+0000 7f826dd9b640 1 --2- 172.21.15.19:0/1511788121 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c4949e2790 0x55c4949e4b80 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f82640e38f0 tx=0x7f82640ee4b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fcdfd197a0f87bc server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:33:21.269 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:21.157+0000 7f825f7fe640 1 --2- 172.21.15.19:0/557064166 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f82580b5360 0x7f82580b7820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:33:21.269 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:21.157+0000 7f825cff9640 1 -- 172.21.15.19:0/1511788121 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82640f9070 con 0x55c4949e2790 2024-09-10T22:33:21.269 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:21.157+0000 7f826ed9d640 1 --2- 172.21.15.19:0/557064166 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f82580b5360 0x7f82580b7820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:33:21.269 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:21.157+0000 7f825cff9640 1 -- 172.21.15.19:0/1511788121 <== mon.2 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f82640ac0f0 con 0x55c4949e2790 2024-09-10T22:33:21.270 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:21.157+0000 7f825f7fe640 1 -- 172.21.15.19:0/557064166 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8327+0+0 (secure 0 0 0) 0x7f82640e5e80 con 0x7f8270104600 2024-09-10T22:33:21.270 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:21.157+0000 7f825cff9640 1 -- 172.21.15.19:0/1511788121 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82640ac3b0 con 0x55c4949e2790 2024-09-10T22:33:21.270 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:21.158+0000 7f82772be740 1 -- 172.21.15.19:0/1511788121 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c4949e2790 msgr2=0x55c4949e4b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:33:21.270 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:21.158+0000 7f826ed9d640 1 --2- 172.21.15.19:0/557064166 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f82580b5360 0x7f82580b7820 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f82680092f0 tx=0x7f8268009740 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:33:21.270 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:21.158+0000 7f82772be740 1 --2- 172.21.15.19:0/1511788121 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c4949e2790 0x55c4949e4b80 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f82640e38f0 tx=0x7f82640ee4b0 comp rx=0 tx=0).stop 2024-09-10T22:33:21.270 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:21.158+0000 7f82772be740 1 -- 172.21.15.19:0/1511788121 shutdown_connections 2024-09-10T22:33:21.271 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:21.158+0000 7f82772be740 1 --2- 172.21.15.19:0/1511788121 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c4949e2790 0x55c4949e4b80 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:33:21.271 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:21.158+0000 7f82772be740 1 --2- 172.21.15.19:0/1511788121 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55c4949d6800 0x55c4949e2250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:33:21.271 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:21.158+0000 7f82772be740 1 --2- 172.21.15.19:0/1511788121 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55c4949d5ee0 0x55c4949d62c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:33:21.271 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:21.158+0000 7f82772be740 1 -- 172.21.15.19:0/1511788121 >> 172.21.15.19:0/1511788121 conn(0x55c4949d3d10 msgr2=0x55c4949d4eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:33:21.271 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:21.158+0000 7f82772be740 1 -- 172.21.15.19:0/1511788121 shutdown_connections 2024-09-10T22:33:21.271 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:21.158+0000 7f82772be740 1 -- 172.21.15.19:0/1511788121 wait complete. 2024-09-10T22:33:21.272 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:21.159+0000 7f82772be740 1 -- start start 2024-09-10T22:33:21.272 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:21.159+0000 7f82772be740 1 Processor -- start 2024-09-10T22:33:21.272 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:21.159+0000 7f82772be740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55c4949d5ee0 0x55c4949df700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:33:21.272 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:21.159+0000 7f82772be740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55c4949d6800 0x55c4949dfc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:33:21.272 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:21.159+0000 7f82772be740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c4949e2790 0x55c4949e0180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:33:21.272 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:21.159+0000 7f82772be740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x55c49479d890 con 0x55c4949d5ee0 2024-09-10T22:33:21.272 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:21.159+0000 7f82772be740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55c4948d6d40 con 0x55c4949e2790 2024-09-10T22:33:21.273 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:21.159+0000 7f82772be740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x55c4949e5440 con 0x55c4949d6800 2024-09-10T22:33:21.273 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:21.159+0000 7f82772be740 10 client.0 _ll_register_callbacks cb 0x55c49493ac80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T22:33:21.273 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:21.159+0000 7f826e59c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55c4949d5ee0 0x55c4949df700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:33:21.273 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:21.159+0000 7f826e59c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55c4949d5ee0 0x55c4949df700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:37358/0 (socket says 172.21.15.19:37358) 2024-09-10T22:33:21.273 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:21.159+0000 7f826e59c640 1 -- 172.21.15.19:0/4229665808 learned_addr learned my addr 172.21.15.19:0/4229665808 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:33:21.273 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:21.159+0000 7f826dd9b640 1 --2- 172.21.15.19:0/4229665808 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55c4949d6800 0x55c4949dfc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:33:21.273 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:21.159+0000 7f826ed9d640 1 --2- 172.21.15.19:0/4229665808 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c4949e2790 0x55c4949e0180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:33:21.274 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:21.159+0000 7f826e59c640 1 -- 172.21.15.19:0/4229665808 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55c4949d6800 msgr2=0x55c4949dfc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:33:21.274 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:21.159+0000 7f826e59c640 1 --2- 172.21.15.19:0/4229665808 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55c4949d6800 0x55c4949dfc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:33:21.274 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:21.159+0000 7f826e59c640 1 -- 172.21.15.19:0/4229665808 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c4949e2790 msgr2=0x55c4949e0180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:33:21.274 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:21.159+0000 7f826e59c640 1 --2- 172.21.15.19:0/4229665808 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c4949e2790 0x55c4949e0180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:33:21.274 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:21.159+0000 7f826e59c640 1 -- 172.21.15.19:0/4229665808 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c4949ee7c0 con 0x55c4949d5ee0 2024-09-10T22:33:21.274 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:21.159+0000 7f826dd9b640 1 --2- 172.21.15.19:0/4229665808 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55c4949d6800 0x55c4949dfc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T22:33:21.275 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:21.160+0000 7f826e59c640 1 --2- 172.21.15.19:0/4229665808 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55c4949d5ee0 0x55c4949df700 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7f8260009900 tx=0x7f82600314a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6c2a4f876aef0add server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:33:21.275 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:21.160+0000 7f8255ffb640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-10T22:33:21.275 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:21.160+0000 7f8255ffb640 1 -- 172.21.15.19:0/4229665808 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8260035040 con 0x55c4949d5ee0 2024-09-10T22:33:21.275 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:21.160+0000 7f8255ffb640 1 -- 172.21.15.19:0/4229665808 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8327+0+0 (secure 0 0 0) 0x7f8260031810 con 0x55c4949d5ee0 2024-09-10T22:33:21.275 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:21.160+0000 7f82772be740 1 -- 172.21.15.19:0/4229665808 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f82640ac0f0 con 0x55c4949d5ee0 2024-09-10T22:33:21.275 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:21.160+0000 7f8255ffb640 1 -- 172.21.15.19:0/4229665808 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f8260004040 con 0x55c4949d5ee0 2024-09-10T22:33:21.275 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:21.160+0000 7f82772be740 10 client.16752 fetch_fsmap learned FSMap version 27 2024-09-10T22:33:21.275 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:21.160+0000 7f82772be740 1 -- 172.21.15.19:0/4229665808 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55c4949f1170 con 0x55c4949d5ee0 2024-09-10T22:33:21.275 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:21.160+0000 7f8255ffb640 1 -- 172.21.15.19:0/4229665808 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f82640ac0f0 con 0x55c4949d5ee0 2024-09-10T22:33:21.275 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:21.160+0000 7f8255ffb640 1 -- 172.21.15.19:0/4229665808 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7f8260004880 con 0x55c4949d5ee0 2024-09-10T22:33:21.276 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:21.160+0000 7f82772be740 10 client.16752 fetch_fsmap finished waiting for FSMap version 27 2024-09-10T22:33:21.276 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:21.160+0000 7f82772be740 10 client.16752 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-10T22:33:21.276 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:21.160+0000 7f82772be740 20 client.16752 populate_metadata read hostname 'smithi019' 2024-09-10T22:33:21.276 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:21.160+0000 7f82772be740 1 --2- 172.21.15.19:0/4229665808 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x55c4949f2630 0x55c4949f4a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:33:21.276 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:21.160+0000 7f82772be740 4 client.16752 mds_command: new command op to 24581 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T22:33:21.276 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:21.160+0000 7f82772be740 1 -- 172.21.15.19:0/4229665808 --> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c49494edb0 con 0x55c4949f2630 2024-09-10T22:33:21.276 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:21.161+0000 7f826dd9b640 1 --2- 172.21.15.19:0/4229665808 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x55c4949f2630 0x55c4949f4a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:33:21.277 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:21.161+0000 7f8255ffb640 10 client.16752 ms_handle_connect on v2:172.21.15.135:6838/1254769802 2024-09-10T22:33:21.277 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:21.161+0000 7f826dd9b640 1 --2- 172.21.15.19:0/4229665808 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x55c4949f2630 0x55c4949f4a80 crc :-1 s=READY pgs=148 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5302eb4a7d424a6 server_cookie=fa468fa5f3eb4ad7 in_seq=0 out_seq=0 2024-09-10T22:33:21.277 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:21.162+0000 7f8255ffb640 1 -- 172.21.15.19:0/4229665808 <== mds.0 v2:172.21.15.135:6838/1254769802 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55c49494edb0 con 0x55c4949f2630 2024-09-10T22:33:21.277 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:21.162+0000 7f8255ffb640 10 client.16752 handle_command_reply: tid=0 2024-09-10T22:33:21.277 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:21.162+0000 7f82772be740 1 client.16752 shutdown 2024-09-10T22:33:21.277 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:21.162+0000 7f82772be740 1 -- 172.21.15.19:0/4229665808 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55c4949d5ee0 msgr2=0x55c4949df700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:33:21.277 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:21.162+0000 7f82772be740 1 --2- 172.21.15.19:0/4229665808 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55c4949d5ee0 0x55c4949df700 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7f8260009900 tx=0x7f82600314a0 comp rx=0 tx=0).stop 2024-09-10T22:33:21.277 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:21.162+0000 7f82772be740 1 -- 172.21.15.19:0/4229665808 shutdown_connections 2024-09-10T22:33:21.277 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:21.162+0000 7f82772be740 1 --2- 172.21.15.19:0/4229665808 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c4949e2790 0x55c4949e0180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:33:21.277 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:21.162+0000 7f82772be740 1 --2- 172.21.15.19:0/4229665808 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x55c4949f2630 0x55c4949f4a80 crc :-1 s=READY pgs=148 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:33:21.277 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:21.162+0000 7f82772be740 1 --2- 172.21.15.19:0/4229665808 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55c4949d6800 0x55c4949dfc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:33:21.277 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:21.162+0000 7f82772be740 1 --2- 172.21.15.19:0/4229665808 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55c4949d5ee0 0x55c4949df700 unknown :-1 s=CLOSED pgs=700 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:33:21.277 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:21.162+0000 7f8255ffb640 0 client.16752 ms_handle_reset on v2:172.21.15.135:6838/1254769802 2024-09-10T22:33:21.278 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:21.162+0000 7f82772be740 1 -- 172.21.15.19:0/4229665808 >> 172.21.15.19:0/4229665808 conn(0x55c4949d3d10 msgr2=0x55c4949d2f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:33:21.278 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:21.162+0000 7f82772be740 1 -- 172.21.15.19:0/4229665808 shutdown_connections 2024-09-10T22:33:21.278 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:21.162+0000 7f82772be740 1 -- 172.21.15.19:0/4229665808 wait complete. 2024-09-10T22:33:21.278 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:21.162+0000 7f82772be740 20 client.16752 trim_cache size 0 max 16384 2024-09-10T22:33:21.278 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:21.192+0000 7f82772be740 1 Processor -- start 2024-09-10T22:33:21.278 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:21.193+0000 7f82772be740 1 -- start start 2024-09-10T22:33:21.278 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:21.193+0000 7f82772be740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55c4949d5ee0 0x55c4949e1440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:33:21.278 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:21.193+0000 7f82772be740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55c4949d6800 0x55c4949dc910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:33:21.278 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:21.193+0000 7f82772be740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c4949e2790 0x55c4949dce50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:33:21.278 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:21.193+0000 7f82772be740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f82701b0f30 con 0x55c4949d5ee0 2024-09-10T22:33:21.278 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:21.193+0000 7f82772be740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f82701ae800 con 0x55c4949e2790 2024-09-10T22:33:21.278 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:21.193+0000 7f82772be740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f82701ac650 con 0x55c4949d6800 2024-09-10T22:33:21.278 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:21.195+0000 7f826e59c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55c4949d5ee0 0x55c4949e1440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:33:21.279 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:21.195+0000 7f826e59c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55c4949d5ee0 0x55c4949e1440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:37366/0 (socket says 172.21.15.19:37366) 2024-09-10T22:33:21.279 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:21.195+0000 7f826e59c640 1 -- 172.21.15.19:0/2881747597 learned_addr learned my addr 172.21.15.19:0/2881747597 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:33:21.279 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:21.196+0000 7f826e59c640 1 -- 172.21.15.19:0/2881747597 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55c4949d6800 msgr2=0x55c4949dc910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:33:21.279 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:21.196+0000 7f826dd9b640 1 --2- 172.21.15.19:0/2881747597 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55c4949d6800 0x55c4949dc910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:33:21.279 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:21.196+0000 7f826e59c640 1 --2- 172.21.15.19:0/2881747597 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55c4949d6800 0x55c4949dc910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:33:21.279 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:21.196+0000 7f826e59c640 1 -- 172.21.15.19:0/2881747597 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c4949e2790 msgr2=0x55c4949dce50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:33:21.279 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:21.196+0000 7f826e59c640 1 --2- 172.21.15.19:0/2881747597 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c4949e2790 0x55c4949dce50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:33:21.279 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:21.196+0000 7f826e59c640 1 -- 172.21.15.19:0/2881747597 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c4949d9fe0 con 0x55c4949d5ee0 2024-09-10T22:33:21.280 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:21.196+0000 7f826dd9b640 1 --2- 172.21.15.19:0/2881747597 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55c4949d6800 0x55c4949dc910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T22:33:21.280 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:21.200+0000 7f826e59c640 1 --2- 172.21.15.19:0/2881747597 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55c4949d5ee0 0x55c4949e1440 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7f8260032cc0 tx=0x7f8260005c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=15b4b4123e61dcc4 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:33:21.280 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:21.200+0000 7f8257fff640 1 -- 172.21.15.19:0/2881747597 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8260054070 con 0x55c4949d5ee0 2024-09-10T22:33:21.280 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:21.200+0000 7f8257fff640 1 -- 172.21.15.19:0/2881747597 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f82600043e0 con 0x55c4949d5ee0 2024-09-10T22:33:21.280 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:21.200+0000 7f8257fff640 1 -- 172.21.15.19:0/2881747597 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8260035030 con 0x55c4949d5ee0 2024-09-10T22:33:21.280 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:21.202+0000 7f82772be740 1 -- 172.21.15.19:0/2881747597 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55c4949d5ee0 msgr2=0x55c4949e1440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:33:21.280 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:21.202+0000 7f82772be740 1 --2- 172.21.15.19:0/2881747597 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55c4949d5ee0 0x55c4949e1440 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7f8260032cc0 tx=0x7f8260005c00 comp rx=0 tx=0).stop 2024-09-10T22:33:21.280 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:21.202+0000 7f82772be740 1 -- 172.21.15.19:0/2881747597 shutdown_connections 2024-09-10T22:33:21.280 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:21.202+0000 7f82772be740 1 --2- 172.21.15.19:0/2881747597 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c4949e2790 0x55c4949dce50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:33:21.280 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:21.202+0000 7f82772be740 1 --2- 172.21.15.19:0/2881747597 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55c4949d6800 0x55c4949dc910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:33:21.280 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:21.202+0000 7f82772be740 1 --2- 172.21.15.19:0/2881747597 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55c4949d5ee0 0x55c4949e1440 unknown :-1 s=CLOSED pgs=701 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:33:21.280 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:21.202+0000 7f82772be740 1 -- 172.21.15.19:0/2881747597 >> 172.21.15.19:0/2881747597 conn(0x55c4949d3d10 msgr2=0x55c4949e0d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:33:21.280 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:21.202+0000 7f82772be740 1 -- 172.21.15.19:0/2881747597 shutdown_connections 2024-09-10T22:33:21.281 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:21.202+0000 7f82772be740 1 -- 172.21.15.19:0/2881747597 wait complete. 2024-09-10T22:33:21.281 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:21.203+0000 7f82772be740 1 -- start start 2024-09-10T22:33:21.281 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:21.203+0000 7f82772be740 1 Processor -- start 2024-09-10T22:33:21.281 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:21.203+0000 7f82772be740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55c4949d6800 0x55c4949e6ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:33:21.281 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:21.203+0000 7f82772be740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55c4949e2790 0x55c4949e7410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:33:21.281 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:21.203+0000 7f82772be740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c494a64d50 0x55c494a67140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:33:21.281 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:21.203+0000 7f82772be740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f82701accc0 con 0x55c4949e2790 2024-09-10T22:33:21.281 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:21.203+0000 7f82772be740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f82701ae130 con 0x55c494a64d50 2024-09-10T22:33:21.281 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:21.203+0000 7f82772be740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f82701ad390 con 0x55c4949d6800 2024-09-10T22:33:21.281 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:21.204+0000 7f82772be740 10 client.0 _ll_register_callbacks cb 0x7f8260005db0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T22:33:21.281 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:21.204+0000 7f826dd9b640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55c4949e2790 0x55c4949e7410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:33:21.281 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:21.204+0000 7f826dd9b640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55c4949e2790 0x55c4949e7410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:37372/0 (socket says 172.21.15.19:37372) 2024-09-10T22:33:21.282 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:21.204+0000 7f826dd9b640 1 -- 172.21.15.19:0/952358521 learned_addr learned my addr 172.21.15.19:0/952358521 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:33:21.282 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:21.204+0000 7f826dd9b640 1 -- 172.21.15.19:0/952358521 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55c4949d6800 msgr2=0x55c4949e6ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:33:21.282 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:21.204+0000 7f826dd9b640 1 --2- 172.21.15.19:0/952358521 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55c4949d6800 0x55c4949e6ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:33:21.282 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:21.204+0000 7f826dd9b640 1 -- 172.21.15.19:0/952358521 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c494a64d50 msgr2=0x55c494a67140 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-10T22:33:21.282 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:21.204+0000 7f826dd9b640 1 --2- 172.21.15.19:0/952358521 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c494a64d50 0x55c494a67140 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:33:21.282 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:21.204+0000 7f826dd9b640 1 -- 172.21.15.19:0/952358521 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c494a676b0 con 0x55c4949e2790 2024-09-10T22:33:21.282 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:21.204+0000 7f826dd9b640 1 --2- 172.21.15.19:0/952358521 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55c4949e2790 0x55c4949e7410 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7f82640058c0 tx=0x7f8264003e20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bacb70ba1980d235 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:33:21.282 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:21.204+0000 7f8255ffb640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-10T22:33:21.282 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:21.205+0000 7f8255ffb640 1 -- 172.21.15.19:0/952358521 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8264057ce0 con 0x55c4949e2790 2024-09-10T22:33:21.282 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:21.205+0000 7f8255ffb640 1 -- 172.21.15.19:0/952358521 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8327+0+0 (secure 0 0 0) 0x7f82640037a0 con 0x55c4949e2790 2024-09-10T22:33:21.282 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:21.205+0000 7f82772be740 1 -- 172.21.15.19:0/952358521 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f82600043e0 con 0x55c4949e2790 2024-09-10T22:33:21.282 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:21.205+0000 7f8255ffb640 1 -- 172.21.15.19:0/952358521 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f8264057eb0 con 0x55c4949e2790 2024-09-10T22:33:21.282 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:21.205+0000 7f82772be740 10 client.16758 fetch_fsmap learned FSMap version 27 2024-09-10T22:33:21.283 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:21.205+0000 7f82772be740 1 -- 172.21.15.19:0/952358521 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55c494a689c0 con 0x55c4949e2790 2024-09-10T22:33:21.283 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:21.205+0000 7f8255ffb640 1 -- 172.21.15.19:0/952358521 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f82600043e0 con 0x55c4949e2790 2024-09-10T22:33:21.283 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:21.205+0000 7f8255ffb640 1 -- 172.21.15.19:0/952358521 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7f82640a6ce0 con 0x55c4949e2790 2024-09-10T22:33:21.283 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:21.205+0000 7f82772be740 10 client.16758 fetch_fsmap finished waiting for FSMap version 27 2024-09-10T22:33:21.283 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:21.205+0000 7f82772be740 10 client.16758 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-10T22:33:21.283 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:21.205+0000 7f82772be740 20 client.16758 populate_metadata read hostname 'smithi019' 2024-09-10T22:33:21.283 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:21.206+0000 7f82772be740 1 --2- 172.21.15.19:0/952358521 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x55c494a68d00 0x55c494a6b110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:33:21.283 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:21.206+0000 7f82772be740 4 client.16758 mds_command: new command op to 24581 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-10T22:33:21.283 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:21.206+0000 7f82772be740 1 -- 172.21.15.19:0/952358521 --> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x55c4949f4e10 con 0x55c494a68d00 2024-09-10T22:33:21.284 INFO:teuthology.orchestra.run.smithi019.stdout:{ 2024-09-10T22:33:21.284 INFO:teuthology.orchestra.run.smithi019.stdout: "return_code": 0, 2024-09-10T22:33:21.284 INFO:teuthology.orchestra.run.smithi019.stdout: "scrub_tag": "448b10e7-494c-4a88-a9ab-186159c5dfdd", 2024-09-10T22:33:21.284 INFO:teuthology.orchestra.run.smithi019.stdout: "mode": "asynchronous" 2024-09-10T22:33:21.284 INFO:teuthology.orchestra.run.smithi019.stdout:} 2024-09-10T22:33:21.284 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:21.206+0000 7f826e59c640 1 --2- 172.21.15.19:0/952358521 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x55c494a68d00 0x55c494a6b110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:33:21.284 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:21.208+0000 7f826e59c640 1 --2- 172.21.15.19:0/952358521 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x55c494a68d00 0x55c494a6b110 crc :-1 s=READY pgs=149 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b92514ccfe5fb55c server_cookie=f0b90f94487e5b5 in_seq=0 out_seq=0 2024-09-10T22:33:21.285 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:21.208+0000 7f8255ffb640 10 client.16758 ms_handle_connect on v2:172.21.15.135:6838/1254769802 2024-09-10T22:33:21.285 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:21.210+0000 7f8255ffb640 1 -- 172.21.15.19:0/952358521 <== mds.0 v2:172.21.15.135:6838/1254769802 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55c4949f4e10 con 0x55c494a68d00 2024-09-10T22:33:21.285 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:21.210+0000 7f8255ffb640 10 client.16758 handle_command_reply: tid=0 2024-09-10T22:33:21.285 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:21.210+0000 7f82772be740 1 client.16758 shutdown 2024-09-10T22:33:21.285 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:21.211+0000 7f82772be740 1 -- 172.21.15.19:0/952358521 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55c4949e2790 msgr2=0x55c4949e7410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:33:21.285 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:21.211+0000 7f82772be740 1 --2- 172.21.15.19:0/952358521 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55c4949e2790 0x55c4949e7410 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7f82640058c0 tx=0x7f8264003e20 comp rx=0 tx=0).stop 2024-09-10T22:33:21.285 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:21.211+0000 7f82772be740 1 -- 172.21.15.19:0/952358521 shutdown_connections 2024-09-10T22:33:21.285 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:21.211+0000 7f82772be740 1 --2- 172.21.15.19:0/952358521 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c494a64d50 0x55c494a67140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:33:21.285 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:21.211+0000 7f82772be740 1 --2- 172.21.15.19:0/952358521 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55c4949e2790 0x55c4949e7410 unknown :-1 s=CLOSED pgs=702 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:33:21.285 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:21.211+0000 7f82772be740 1 --2- 172.21.15.19:0/952358521 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x55c494a68d00 0x55c494a6b110 crc :-1 s=READY pgs=149 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:33:21.285 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:21.211+0000 7f82772be740 1 --2- 172.21.15.19:0/952358521 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55c4949d6800 0x55c4949e6ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:33:21.285 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:21.211+0000 7f82772be740 1 -- 172.21.15.19:0/952358521 >> 172.21.15.19:0/952358521 conn(0x55c4949d3d10 msgr2=0x55c4949ede80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:33:21.285 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:21.211+0000 7f8255ffb640 0 client.16758 ms_handle_reset on v2:172.21.15.135:6838/1254769802 2024-09-10T22:33:21.286 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:21.211+0000 7f82772be740 1 -- 172.21.15.19:0/952358521 shutdown_connections 2024-09-10T22:33:21.286 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:21.211+0000 7f82772be740 1 -- 172.21.15.19:0/952358521 wait complete. 2024-09-10T22:33:21.286 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:21.212+0000 7f82772be740 20 client.16758 trim_cache size 0 max 16384 2024-09-10T22:33:21.286 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:21.213+0000 7f8274ee9640 1 -- 172.21.15.19:0/557064166 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f82580b5360 msgr2=0x7f82580b7820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:33:21.286 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:21.213+0000 7f8274ee9640 1 --2- 172.21.15.19:0/557064166 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f82580b5360 0x7f82580b7820 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f82680092f0 tx=0x7f8268009740 comp rx=0 tx=0).stop 2024-09-10T22:33:21.286 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:21.213+0000 7f8274ee9640 1 -- 172.21.15.19:0/557064166 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8270104600 msgr2=0x7f8270199860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:33:21.286 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:21.213+0000 7f8274ee9640 1 --2- 172.21.15.19:0/557064166 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8270104600 0x7f8270199860 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7f826400e9c0 tx=0x7f826400ee80 comp rx=0 tx=0).stop 2024-09-10T22:33:21.286 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:21.213+0000 7f8274ee9640 1 -- 172.21.15.19:0/557064166 shutdown_connections 2024-09-10T22:33:21.286 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:21.213+0000 7f8274ee9640 1 --2- 172.21.15.19:0/557064166 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f82580b5360 0x7f82580b7820 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:33:21.287 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:21.213+0000 7f8274ee9640 1 --2- 172.21.15.19:0/557064166 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f827010d140 0x7f827019ec00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:33:21.287 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:21.213+0000 7f8274ee9640 1 --2- 172.21.15.19:0/557064166 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8270104600 0x7f8270199860 unknown :-1 s=CLOSED pgs=699 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:33:21.287 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:21.213+0000 7f8274ee9640 1 --2- 172.21.15.19:0/557064166 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f8270103ce0 0x7f8270199320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:33:21.287 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:21.213+0000 7f8274ee9640 1 -- 172.21.15.19:0/557064166 >> 172.21.15.19:0/557064166 conn(0x7f82700fd700 msgr2=0x7f82700fe3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:33:21.287 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:21.214+0000 7f8274ee9640 1 -- 172.21.15.19:0/557064166 shutdown_connections 2024-09-10T22:33:21.287 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:21.214+0000 7f8274ee9640 1 -- 172.21.15.19:0/557064166 wait complete. 2024-09-10T22:33:22.315 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:33:22 smithi019 ceph-mon[31375]: pgmap v555: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 639 KiB/s rd, 295 MiB/s wr, 643 op/s 2024-09-10T22:33:22.315 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:33:22 smithi019 ceph-mon[31375]: scrub queued for path: / 2024-09-10T22:33:22.315 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:33:22 smithi019 ceph-mon[31375]: scrub summary: idle+waiting paths [/] 2024-09-10T22:33:22.315 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:33:22 smithi019 ceph-mon[31375]: scrub summary: active paths [/] 2024-09-10T22:33:22.315 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:33:22 smithi019 ceph-mon[31375]: scrub summary: active paths [/] 2024-09-10T22:33:22.315 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:33:22 smithi019 ceph-mon[31375]: scrub summary: idle+waiting paths [/] 2024-09-10T22:33:22.316 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 22997a4c-6fc2-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-10T22:33:22.360 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:33:22 smithi135 ceph-mon[34789]: pgmap v555: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 639 KiB/s rd, 295 MiB/s wr, 643 op/s 2024-09-10T22:33:22.360 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:33:22 smithi135 ceph-mon[34789]: scrub queued for path: / 2024-09-10T22:33:22.360 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:33:22 smithi135 ceph-mon[34789]: scrub summary: idle+waiting paths [/] 2024-09-10T22:33:22.360 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:33:22 smithi135 ceph-mon[34789]: scrub summary: active paths [/] 2024-09-10T22:33:22.360 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:33:22 smithi135 ceph-mon[34789]: scrub summary: active paths [/] 2024-09-10T22:33:22.360 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:33:22 smithi135 ceph-mon[34789]: scrub summary: idle+waiting paths [/] 2024-09-10T22:33:22.376 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:33:22 smithi138 ceph-mon[35236]: pgmap v555: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 639 KiB/s rd, 295 MiB/s wr, 643 op/s 2024-09-10T22:33:22.376 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:33:22 smithi138 ceph-mon[35236]: scrub queued for path: / 2024-09-10T22:33:22.376 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:33:22 smithi138 ceph-mon[35236]: scrub summary: idle+waiting paths [/] 2024-09-10T22:33:22.376 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:33:22 smithi138 ceph-mon[35236]: scrub summary: active paths [/] 2024-09-10T22:33:22.376 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:33:22 smithi138 ceph-mon[35236]: scrub summary: active paths [/] 2024-09-10T22:33:22.377 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:33:22 smithi138 ceph-mon[35236]: scrub summary: idle+waiting paths [/] 2024-09-10T22:33:22.619 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/22997a4c-6fc2-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T22:33:23.325 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:33:23 smithi019 ceph-mon[31375]: scrub summary: idle+waiting paths [/] 2024-09-10T22:33:23.360 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:33:23 smithi135 ceph-mon[34789]: scrub summary: idle+waiting paths [/] 2024-09-10T22:33:23.375 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:33:23 smithi138 ceph-mon[35236]: scrub summary: idle+waiting paths [/] 2024-09-10T22:33:23.516 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:23.483+0000 7f1143554640 1 -- 172.21.15.19:0/520347945 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f113c101cb0 msgr2=0x7f113c102090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:33:23.517 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:23.483+0000 7f1143554640 1 --2- 172.21.15.19:0/520347945 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f113c101cb0 0x7f113c102090 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7f1138009900 tx=0x7f113802a410 comp rx=0 tx=0).stop 2024-09-10T22:33:23.519 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:23.483+0000 7f1143554640 1 -- 172.21.15.19:0/520347945 shutdown_connections 2024-09-10T22:33:23.519 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:23.483+0000 7f1143554640 1 --2- 172.21.15.19:0/520347945 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f113c108040 0x7f113c10e840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:33:23.520 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:23.483+0000 7f1143554640 1 --2- 172.21.15.19:0/520347945 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f113c1076c0 0x7f113c107b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:33:23.520 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:23.483+0000 7f1143554640 1 --2- 172.21.15.19:0/520347945 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f113c101cb0 0x7f113c102090 unknown :-1 s=CLOSED pgs=703 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:33:23.520 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:23.483+0000 7f1143554640 1 -- 172.21.15.19:0/520347945 >> 172.21.15.19:0/520347945 conn(0x7f113c0fd700 msgr2=0x7f113c0ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:33:23.520 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:23.483+0000 7f1143554640 1 -- 172.21.15.19:0/520347945 shutdown_connections 2024-09-10T22:33:23.520 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:23.483+0000 7f1143554640 1 -- 172.21.15.19:0/520347945 wait complete. 2024-09-10T22:33:23.520 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:23.484+0000 7f1143554640 1 Processor -- start 2024-09-10T22:33:23.520 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:23.484+0000 7f1143554640 1 -- start start 2024-09-10T22:33:23.520 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:23.484+0000 7f1143554640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f113c101cb0 0x7f113c199260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:33:23.520 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:23.484+0000 7f1143554640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f113c1076c0 0x7f113c1997a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:33:23.520 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:23.484+0000 7f1143554640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f113c108040 0x7f113c19eb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:33:23.520 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:23.484+0000 7f1143554640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f113c111d00 con 0x7f113c101cb0 2024-09-10T22:33:23.521 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:23.484+0000 7f1143554640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f113c111b80 con 0x7f113c1076c0 2024-09-10T22:33:23.521 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:23.484+0000 7f1143554640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f113c111e80 con 0x7f113c108040 2024-09-10T22:33:23.521 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:23.485+0000 7f1141af1640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f113c108040 0x7f113c19eb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:33:23.521 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:23.485+0000 7f1141af1640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f113c108040 0x7f113c19eb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.19:40076/0 (socket says 172.21.15.19:40076) 2024-09-10T22:33:23.521 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:23.485+0000 7f1141af1640 1 -- 172.21.15.19:0/2317554069 learned_addr learned my addr 172.21.15.19:0/2317554069 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:33:23.521 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:23.485+0000 7f11412f0640 1 --2- 172.21.15.19:0/2317554069 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f113c101cb0 0x7f113c199260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:33:23.521 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:23.485+0000 7f1140aef640 1 --2- 172.21.15.19:0/2317554069 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f113c1076c0 0x7f113c1997a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:33:23.521 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:23.485+0000 7f1141af1640 1 -- 172.21.15.19:0/2317554069 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f113c1076c0 msgr2=0x7f113c1997a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:33:23.521 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:23.485+0000 7f1141af1640 1 --2- 172.21.15.19:0/2317554069 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f113c1076c0 0x7f113c1997a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:33:23.521 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:23.485+0000 7f1141af1640 1 -- 172.21.15.19:0/2317554069 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f113c101cb0 msgr2=0x7f113c199260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:33:23.522 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:23.485+0000 7f1141af1640 1 --2- 172.21.15.19:0/2317554069 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f113c101cb0 0x7f113c199260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:33:23.522 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:23.485+0000 7f1141af1640 1 -- 172.21.15.19:0/2317554069 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f113c19f310 con 0x7f113c108040 2024-09-10T22:33:23.522 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:23.485+0000 7f11412f0640 1 --2- 172.21.15.19:0/2317554069 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f113c101cb0 0x7f113c199260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T22:33:23.522 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:23.486+0000 7f1141af1640 1 --2- 172.21.15.19:0/2317554069 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f113c108040 0x7f113c19eb40 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f113400eb10 tx=0x7f113400c2d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:33:23.522 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:23.486+0000 7f11327fc640 1 -- 172.21.15.19:0/2317554069 <== mon.1 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1134004b20 con 0x7f113c108040 2024-09-10T22:33:23.522 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:23.486+0000 7f1143554640 1 -- 172.21.15.19:0/2317554069 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f113c19f600 con 0x7f113c108040 2024-09-10T22:33:23.522 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:23.486+0000 7f11327fc640 1 -- 172.21.15.19:0/2317554069 <== mon.1 v2:172.21.15.138:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1134004cc0 con 0x7f113c108040 2024-09-10T22:33:23.522 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:23.486+0000 7f11327fc640 1 -- 172.21.15.19:0/2317554069 <== mon.1 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1134010670 con 0x7f113c108040 2024-09-10T22:33:23.522 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:23.486+0000 7f1143554640 1 -- 172.21.15.19:0/2317554069 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f113c1a5cc0 con 0x7f113c108040 2024-09-10T22:33:23.522 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:23.489+0000 7f11327fc640 1 -- 172.21.15.19:0/2317554069 <== mon.1 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 18) ==== 153250+0+0 (secure 0 0 0) 0x7f1134005020 con 0x7f113c108040 2024-09-10T22:33:23.522 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:23.490+0000 7f11327fc640 1 --2- 172.21.15.19:0/2317554069 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f11280b52e0 0x7f11280b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:33:23.522 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:23.490+0000 7f11412f0640 1 --2- 172.21.15.19:0/2317554069 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f11280b52e0 0x7f11280b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:33:23.523 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:23.490+0000 7f11327fc640 1 -- 172.21.15.19:0/2317554069 <== mon.1 v2:172.21.15.138:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8327+0+0 (secure 0 0 0) 0x7f11340e6220 con 0x7f113c108040 2024-09-10T22:33:23.523 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:23.490+0000 7f1145929740 1 Processor -- start 2024-09-10T22:33:23.523 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:23.491+0000 7f1145929740 1 -- start start 2024-09-10T22:33:23.523 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:23.491+0000 7f11412f0640 1 --2- 172.21.15.19:0/2317554069 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f11280b52e0 0x7f11280b77a0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f1138031440 tx=0x7f1138005b50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:33:23.523 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:23.491+0000 7f1145929740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55cc30672f00 0x55cc306732e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:33:23.523 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:23.491+0000 7f1145929740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55cc30683850 0x55cc30683c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:33:23.523 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:23.491+0000 7f1145929740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55cc306841d0 0x55cc3068cb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:33:23.523 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:23.491+0000 7f11412f0640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55cc30672f00 0x55cc306732e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:33:23.523 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:23.491+0000 7f1145929740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x55cc305ebe50 con 0x55cc30672f00 2024-09-10T22:33:23.523 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:23.491+0000 7f1145929740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55cc305db280 con 0x55cc306841d0 2024-09-10T22:33:23.523 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:23.491+0000 7f1145929740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x55cc305df090 con 0x55cc30683850 2024-09-10T22:33:23.523 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:23.491+0000 7f11412f0640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55cc30672f00 0x55cc306732e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:57128/0 (socket says 172.21.15.19:57128) 2024-09-10T22:33:23.524 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:23.491+0000 7f11412f0640 1 -- 172.21.15.19:0/3004731960 learned_addr learned my addr 172.21.15.19:0/3004731960 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:33:23.524 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:23.491+0000 7f1140aef640 1 --2- 172.21.15.19:0/3004731960 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55cc30683850 0x55cc30683c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:33:23.524 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:23.491+0000 7f1141af1640 1 --2- 172.21.15.19:0/3004731960 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55cc306841d0 0x55cc3068cb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:33:23.524 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:23.492+0000 7f1140aef640 1 -- 172.21.15.19:0/3004731960 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55cc306841d0 msgr2=0x55cc3068cb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:33:23.524 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:23.492+0000 7f1140aef640 1 --2- 172.21.15.19:0/3004731960 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55cc306841d0 0x55cc3068cb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:33:23.524 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:23.492+0000 7f1140aef640 1 -- 172.21.15.19:0/3004731960 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55cc30672f00 msgr2=0x55cc306732e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:33:23.524 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:23.492+0000 7f1140aef640 1 --2- 172.21.15.19:0/3004731960 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55cc30672f00 0x55cc306732e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:33:23.524 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:23.492+0000 7f1140aef640 1 -- 172.21.15.19:0/3004731960 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cc30339650 con 0x55cc30683850 2024-09-10T22:33:23.524 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:23.492+0000 7f1141af1640 1 --2- 172.21.15.19:0/3004731960 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55cc306841d0 0x55cc3068cb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T22:33:23.524 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:23.492+0000 7f11412f0640 1 --2- 172.21.15.19:0/3004731960 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55cc30672f00 0x55cc306732e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T22:33:23.524 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:23.492+0000 7f1140aef640 1 --2- 172.21.15.19:0/3004731960 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55cc30683850 0x55cc30683c90 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f112c00bbc0 tx=0x7f112c0107a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=54732ec15a39e5a8 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:33:23.524 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:23.492+0000 7f11277fe640 1 -- 172.21.15.19:0/3004731960 <== mon.1 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f112c004030 con 0x55cc30683850 2024-09-10T22:33:23.525 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:23.493+0000 7f11277fe640 1 -- 172.21.15.19:0/3004731960 <== mon.1 v2:172.21.15.138:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f112c0035f0 con 0x55cc30683850 2024-09-10T22:33:23.525 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:23.493+0000 7f11277fe640 1 -- 172.21.15.19:0/3004731960 <== mon.1 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f112c011680 con 0x55cc30683850 2024-09-10T22:33:23.525 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:23.494+0000 7f1145929740 1 -- 172.21.15.19:0/3004731960 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55cc30683850 msgr2=0x55cc30683c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:33:23.525 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:23.494+0000 7f1145929740 1 --2- 172.21.15.19:0/3004731960 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55cc30683850 0x55cc30683c90 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f112c00bbc0 tx=0x7f112c0107a0 comp rx=0 tx=0).stop 2024-09-10T22:33:23.525 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:23.494+0000 7f1145929740 1 -- 172.21.15.19:0/3004731960 shutdown_connections 2024-09-10T22:33:23.525 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:23.494+0000 7f1145929740 1 --2- 172.21.15.19:0/3004731960 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55cc306841d0 0x55cc3068cb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:33:23.525 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:23.494+0000 7f1145929740 1 --2- 172.21.15.19:0/3004731960 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55cc30683850 0x55cc30683c90 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:33:23.525 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:23.494+0000 7f1145929740 1 --2- 172.21.15.19:0/3004731960 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55cc30672f00 0x55cc306732e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:33:23.525 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:23.494+0000 7f1145929740 1 -- 172.21.15.19:0/3004731960 >> 172.21.15.19:0/3004731960 conn(0x55cc30675420 msgr2=0x55cc30675800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:33:23.525 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:23.494+0000 7f1145929740 1 -- 172.21.15.19:0/3004731960 shutdown_connections 2024-09-10T22:33:23.525 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:23.494+0000 7f1145929740 1 -- 172.21.15.19:0/3004731960 wait complete. 2024-09-10T22:33:23.525 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:23.494+0000 7f1145929740 1 -- start start 2024-09-10T22:33:23.525 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:23.494+0000 7f1145929740 1 Processor -- start 2024-09-10T22:33:23.526 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:23.495+0000 7f1145929740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55cc30672f00 0x55cc3068c9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:33:23.526 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:23.495+0000 7f1145929740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55cc30683850 0x55cc30689e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:33:23.526 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:23.495+0000 7f1145929740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55cc306841d0 0x55cc3068a470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:33:23.526 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:23.495+0000 7f1145929740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x55cc3043c700 con 0x55cc30672f00 2024-09-10T22:33:23.526 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:23.495+0000 7f11412f0640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55cc30672f00 0x55cc3068c9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:33:23.526 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:23.495+0000 7f11412f0640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55cc30672f00 0x55cc3068c9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:57136/0 (socket says 172.21.15.19:57136) 2024-09-10T22:33:23.526 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:23.495+0000 7f11412f0640 1 -- 172.21.15.19:0/931696846 learned_addr learned my addr 172.21.15.19:0/931696846 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:33:23.526 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:23.495+0000 7f1145929740 1 -- 172.21.15.19:0/931696846 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55cc30576110 con 0x55cc306841d0 2024-09-10T22:33:23.526 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:23.495+0000 7f1145929740 1 -- 172.21.15.19:0/931696846 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x55cc3068d280 con 0x55cc30683850 2024-09-10T22:33:23.526 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:23.495+0000 7f1140aef640 1 --2- 172.21.15.19:0/931696846 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55cc30683850 0x55cc30689e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:33:23.526 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:23.495+0000 7f1145929740 10 client.0 _ll_register_callbacks cb 0x55cc3058f990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T22:33:23.526 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:23.496+0000 7f1141af1640 1 --2- 172.21.15.19:0/931696846 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55cc306841d0 0x55cc3068a470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:33:23.526 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:23.496+0000 7f11412f0640 1 -- 172.21.15.19:0/931696846 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55cc30683850 msgr2=0x55cc30689e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:33:23.527 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:23.496+0000 7f11412f0640 1 --2- 172.21.15.19:0/931696846 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55cc30683850 0x55cc30689e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:33:23.527 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:23.496+0000 7f11412f0640 1 -- 172.21.15.19:0/931696846 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55cc306841d0 msgr2=0x55cc3068a470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:33:23.527 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:23.496+0000 7f11412f0640 1 --2- 172.21.15.19:0/931696846 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55cc306841d0 0x55cc3068a470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:33:23.527 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:23.496+0000 7f11412f0640 1 -- 172.21.15.19:0/931696846 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cc305a3c40 con 0x55cc30672f00 2024-09-10T22:33:23.527 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:23.496+0000 7f1141af1640 1 --2- 172.21.15.19:0/931696846 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55cc306841d0 0x55cc3068a470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T22:33:23.527 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:23.496+0000 7f1124ff9640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-10T22:33:23.527 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:23.496+0000 7f11412f0640 1 --2- 172.21.15.19:0/931696846 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55cc30672f00 0x55cc3068c9f0 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7f1138000c00 tx=0x7f1138009260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5e56cb94af457f70 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:33:23.527 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:23.496+0000 7f1124ff9640 1 -- 172.21.15.19:0/931696846 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1138035040 con 0x55cc30672f00 2024-09-10T22:33:23.527 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:23.496+0000 7f1124ff9640 1 -- 172.21.15.19:0/931696846 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8327+0+0 (secure 0 0 0) 0x7f1138005040 con 0x55cc30672f00 2024-09-10T22:33:23.527 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:23.496+0000 7f1145929740 1 -- 172.21.15.19:0/931696846 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f112c0035f0 con 0x55cc30672f00 2024-09-10T22:33:23.527 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:23.497+0000 7f1124ff9640 1 -- 172.21.15.19:0/931696846 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f1138005240 con 0x55cc30672f00 2024-09-10T22:33:23.527 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:23.497+0000 7f1145929740 10 client.16770 fetch_fsmap learned FSMap version 27 2024-09-10T22:33:23.527 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:23.497+0000 7f1145929740 1 -- 172.21.15.19:0/931696846 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55cc30698b80 con 0x55cc30672f00 2024-09-10T22:33:23.528 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:23.497+0000 7f1124ff9640 1 -- 172.21.15.19:0/931696846 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f112c0035f0 con 0x55cc30672f00 2024-09-10T22:33:23.528 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:23.497+0000 7f1124ff9640 1 -- 172.21.15.19:0/931696846 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7f11380035f0 con 0x55cc30672f00 2024-09-10T22:33:23.528 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:23.497+0000 7f1145929740 10 client.16770 fetch_fsmap finished waiting for FSMap version 27 2024-09-10T22:33:23.528 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:23.498+0000 7f1145929740 10 client.16770 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-10T22:33:23.528 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:23.498+0000 7f1145929740 20 client.16770 populate_metadata read hostname 'smithi019' 2024-09-10T22:33:23.528 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:23.498+0000 7f1145929740 1 --2- 172.21.15.19:0/931696846 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x55cc3069a040 0x55cc3069c4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:33:23.528 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:23.498+0000 7f1145929740 4 client.16770 mds_command: new command op to 24581 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T22:33:23.528 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:23.498+0000 7f1145929740 1 -- 172.21.15.19:0/931696846 --> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55cc305edda0 con 0x55cc3069a040 2024-09-10T22:33:23.528 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:23.498+0000 7f1140aef640 1 --2- 172.21.15.19:0/931696846 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x55cc3069a040 0x55cc3069c4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:33:23.528 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:23.499+0000 7f1124ff9640 10 client.16770 ms_handle_connect on v2:172.21.15.135:6838/1254769802 2024-09-10T22:33:23.528 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:23.499+0000 7f1140aef640 1 --2- 172.21.15.19:0/931696846 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x55cc3069a040 0x55cc3069c4e0 crc :-1 s=READY pgs=150 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d22345874ac9d7b5 server_cookie=b44a1f7a8b8b8f08 in_seq=0 out_seq=0 2024-09-10T22:33:23.528 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:23.499+0000 7f1124ff9640 1 -- 172.21.15.19:0/931696846 <== mds.0 v2:172.21.15.135:6838/1254769802 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55cc305edda0 con 0x55cc3069a040 2024-09-10T22:33:23.528 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:23.499+0000 7f1124ff9640 10 client.16770 handle_command_reply: tid=0 2024-09-10T22:33:23.529 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:23.499+0000 7f1145929740 1 client.16770 shutdown 2024-09-10T22:33:23.529 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:23.500+0000 7f1145929740 1 -- 172.21.15.19:0/931696846 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55cc30672f00 msgr2=0x55cc3068c9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:33:23.529 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:23.500+0000 7f1145929740 1 --2- 172.21.15.19:0/931696846 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55cc30672f00 0x55cc3068c9f0 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7f1138000c00 tx=0x7f1138009260 comp rx=0 tx=0).stop 2024-09-10T22:33:23.529 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:23.500+0000 7f1145929740 1 -- 172.21.15.19:0/931696846 shutdown_connections 2024-09-10T22:33:23.529 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:23.500+0000 7f1145929740 1 --2- 172.21.15.19:0/931696846 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55cc306841d0 0x55cc3068a470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:33:23.529 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:23.500+0000 7f1145929740 1 --2- 172.21.15.19:0/931696846 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x55cc3069a040 0x55cc3069c4e0 crc :-1 s=READY pgs=150 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:33:23.529 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:23.500+0000 7f1145929740 1 --2- 172.21.15.19:0/931696846 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55cc30683850 0x55cc30689e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:33:23.529 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:23.500+0000 7f1145929740 1 --2- 172.21.15.19:0/931696846 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55cc30672f00 0x55cc3068c9f0 unknown :-1 s=CLOSED pgs=704 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:33:23.529 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:23.500+0000 7f1145929740 1 -- 172.21.15.19:0/931696846 >> 172.21.15.19:0/931696846 conn(0x55cc30675420 msgr2=0x55cc30674bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:33:23.529 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:23.500+0000 7f1124ff9640 0 client.16770 ms_handle_reset on v2:172.21.15.135:6838/1254769802 2024-09-10T22:33:23.529 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:23.500+0000 7f1145929740 1 -- 172.21.15.19:0/931696846 shutdown_connections 2024-09-10T22:33:23.529 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:23.500+0000 7f1145929740 1 -- 172.21.15.19:0/931696846 wait complete. 2024-09-10T22:33:23.529 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:23.500+0000 7f1145929740 20 client.16770 trim_cache size 0 max 16384 2024-09-10T22:33:23.534 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:23.520+0000 7f1145929740 1 Processor -- start 2024-09-10T22:33:23.534 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:23.520+0000 7f1145929740 1 -- start start 2024-09-10T22:33:23.534 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:23.520+0000 7f1145929740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55cc30672f00 0x55cc30689330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:33:23.534 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:23.520+0000 7f1145929740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55cc30683850 0x55cc30682840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:33:23.535 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:23.520+0000 7f1145929740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55cc306841d0 0x55cc3069c050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:33:23.535 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:23.520+0000 7f1145929740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f113c1aec20 con 0x55cc30683850 2024-09-10T22:33:23.535 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:23.520+0000 7f1145929740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f113c1ac4f0 con 0x55cc306841d0 2024-09-10T22:33:23.535 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:23.520+0000 7f1145929740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f113c1aa300 con 0x55cc30672f00 2024-09-10T22:33:23.535 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:23.521+0000 7f11412f0640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55cc30672f00 0x55cc30689330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:33:23.535 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:23.521+0000 7f11412f0640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55cc30672f00 0x55cc30689330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.19:40098/0 (socket says 172.21.15.19:40098) 2024-09-10T22:33:23.535 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:23.521+0000 7f11412f0640 1 -- 172.21.15.19:0/1475443817 learned_addr learned my addr 172.21.15.19:0/1475443817 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:33:23.535 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:23.521+0000 7f1140aef640 1 --2- 172.21.15.19:0/1475443817 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55cc30683850 0x55cc30682840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:33:23.535 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:23.521+0000 7f1141af1640 1 --2- 172.21.15.19:0/1475443817 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55cc306841d0 0x55cc3069c050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:33:23.535 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:23.521+0000 7f11412f0640 1 -- 172.21.15.19:0/1475443817 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55cc306841d0 msgr2=0x55cc3069c050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:33:23.535 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:23.521+0000 7f11412f0640 1 --2- 172.21.15.19:0/1475443817 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55cc306841d0 0x55cc3069c050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:33:23.535 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:23.521+0000 7f11412f0640 1 -- 172.21.15.19:0/1475443817 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55cc30683850 msgr2=0x55cc30682840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:33:23.536 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:23.521+0000 7f11412f0640 1 --2- 172.21.15.19:0/1475443817 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55cc30683850 0x55cc30682840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:33:23.536 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:23.521+0000 7f11412f0640 1 -- 172.21.15.19:0/1475443817 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cc30689bf0 con 0x55cc30672f00 2024-09-10T22:33:23.536 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:23.521+0000 7f1141af1640 1 --2- 172.21.15.19:0/1475443817 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55cc306841d0 0x55cc3069c050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T22:33:23.536 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:23.521+0000 7f1140aef640 1 --2- 172.21.15.19:0/1475443817 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55cc30683850 0x55cc30682840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T22:33:23.536 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:23.521+0000 7f11412f0640 1 --2- 172.21.15.19:0/1475443817 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55cc30672f00 0x55cc30689330 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f1138009900 tx=0x7f113802a410 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3f646e3fb77362d3 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:33:23.536 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:23.521+0000 7f1126ffd640 1 -- 172.21.15.19:0/1475443817 <== mon.1 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1138068070 con 0x55cc30672f00 2024-09-10T22:33:23.536 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:23.522+0000 7f1126ffd640 1 -- 172.21.15.19:0/1475443817 <== mon.1 v2:172.21.15.138:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1138031630 con 0x55cc30672f00 2024-09-10T22:33:23.536 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:23.522+0000 7f1126ffd640 1 -- 172.21.15.19:0/1475443817 <== mon.1 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1138005240 con 0x55cc30672f00 2024-09-10T22:33:23.536 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:23.523+0000 7f1145929740 1 -- 172.21.15.19:0/1475443817 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55cc30672f00 msgr2=0x55cc30689330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:33:23.536 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:23.523+0000 7f1145929740 1 --2- 172.21.15.19:0/1475443817 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55cc30672f00 0x55cc30689330 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f1138009900 tx=0x7f113802a410 comp rx=0 tx=0).stop 2024-09-10T22:33:23.536 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:23.523+0000 7f1145929740 1 -- 172.21.15.19:0/1475443817 shutdown_connections 2024-09-10T22:33:23.536 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:23.523+0000 7f1145929740 1 --2- 172.21.15.19:0/1475443817 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55cc306841d0 0x55cc3069c050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:33:23.536 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:23.523+0000 7f1145929740 1 --2- 172.21.15.19:0/1475443817 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55cc30683850 0x55cc30682840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:33:23.537 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:23.523+0000 7f1145929740 1 --2- 172.21.15.19:0/1475443817 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55cc30672f00 0x55cc30689330 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:33:23.537 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:23.523+0000 7f1145929740 1 -- 172.21.15.19:0/1475443817 >> 172.21.15.19:0/1475443817 conn(0x55cc30675420 msgr2=0x55cc30675800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:33:23.537 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:23.523+0000 7f1145929740 1 -- 172.21.15.19:0/1475443817 shutdown_connections 2024-09-10T22:33:23.537 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:23.523+0000 7f1145929740 1 -- 172.21.15.19:0/1475443817 wait complete. 2024-09-10T22:33:23.537 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:23.523+0000 7f1145929740 1 -- start start 2024-09-10T22:33:23.537 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:23.523+0000 7f1145929740 1 Processor -- start 2024-09-10T22:33:23.537 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:23.524+0000 7f1145929740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55cc30672f00 0x55cc306a1d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:33:23.537 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:23.524+0000 7f1145929740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55cc30683850 0x55cc306a2320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:33:23.537 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:23.524+0000 7f1145929740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55cc306841d0 0x55cc306a0b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:33:23.537 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:23.524+0000 7f1145929740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f113c1aa9b0 con 0x55cc30672f00 2024-09-10T22:33:23.537 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:23.524+0000 7f1145929740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f113c1abe20 con 0x55cc306841d0 2024-09-10T22:33:23.538 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:23.524+0000 7f1145929740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f113c1ab080 con 0x55cc30683850 2024-09-10T22:33:23.538 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:23.524+0000 7f1145929740 10 client.0 _ll_register_callbacks cb 0x7f1138009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T22:33:23.538 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:23.524+0000 7f1141af1640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55cc306841d0 0x55cc306a0b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:33:23.538 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:23.524+0000 7f11412f0640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55cc30672f00 0x55cc306a1d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:33:23.538 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:23.524+0000 7f1141af1640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55cc306841d0 0x55cc306a0b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.19:39050/0 (socket says 172.21.15.19:39050) 2024-09-10T22:33:23.538 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:23.524+0000 7f1141af1640 1 -- 172.21.15.19:0/983845326 learned_addr learned my addr 172.21.15.19:0/983845326 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:33:23.538 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:23.524+0000 7f1140aef640 1 --2- 172.21.15.19:0/983845326 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55cc30683850 0x55cc306a2320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:33:23.538 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:23.525+0000 7f1140aef640 1 -- 172.21.15.19:0/983845326 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55cc306841d0 msgr2=0x55cc306a0b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:33:23.538 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:23.525+0000 7f1140aef640 1 --2- 172.21.15.19:0/983845326 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55cc306841d0 0x55cc306a0b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:33:23.538 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:23.525+0000 7f1140aef640 1 -- 172.21.15.19:0/983845326 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55cc30672f00 msgr2=0x55cc306a1d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:33:23.538 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:23.525+0000 7f1140aef640 1 --2- 172.21.15.19:0/983845326 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55cc30672f00 0x55cc306a1d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:33:23.539 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:23.525+0000 7f1140aef640 1 -- 172.21.15.19:0/983845326 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cc306a1240 con 0x55cc30683850 2024-09-10T22:33:23.539 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:23.525+0000 7f11412f0640 1 --2- 172.21.15.19:0/983845326 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55cc30672f00 0x55cc306a1d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T22:33:23.539 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:23.525+0000 7f1140aef640 1 --2- 172.21.15.19:0/983845326 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55cc30683850 0x55cc306a2320 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f112c011010 tx=0x7f112c00b780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a566509aaad51302 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:33:23.539 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:23.525+0000 7f1124ff9640 10 client.0 ms_handle_connect on v2:172.21.15.138:3300/0 2024-09-10T22:33:23.539 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:23.526+0000 7f1124ff9640 1 -- 172.21.15.19:0/983845326 <== mon.1 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f112c005250 con 0x55cc30683850 2024-09-10T22:33:23.539 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:23.526+0000 7f1145929740 1 -- 172.21.15.19:0/983845326 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55cc305e9850 con 0x55cc30683850 2024-09-10T22:33:23.539 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:23.526+0000 7f1124ff9640 1 -- 172.21.15.19:0/983845326 <== mon.1 v2:172.21.15.138:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8327+0+0 (secure 0 0 0) 0x7f112c0053f0 con 0x55cc30683850 2024-09-10T22:33:23.539 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:23.526+0000 7f1124ff9640 1 -- 172.21.15.19:0/983845326 <== mon.1 v2:172.21.15.138:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f112c0055f0 con 0x55cc30683850 2024-09-10T22:33:23.539 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:23.526+0000 7f1145929740 10 client.26155 fetch_fsmap learned FSMap version 27 2024-09-10T22:33:23.539 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:23.526+0000 7f1145929740 1 -- 172.21.15.19:0/983845326 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55cc30707a00 con 0x55cc30683850 2024-09-10T22:33:23.539 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:23.526+0000 7f1124ff9640 1 -- 172.21.15.19:0/983845326 <== mon.1 v2:172.21.15.138:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x55cc305e9850 con 0x55cc30683850 2024-09-10T22:33:23.540 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:23.526+0000 7f1124ff9640 1 -- 172.21.15.19:0/983845326 <== mon.1 v2:172.21.15.138:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7f112c02e680 con 0x55cc30683850 2024-09-10T22:33:23.540 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:23.526+0000 7f1145929740 10 client.26155 fetch_fsmap finished waiting for FSMap version 27 2024-09-10T22:33:23.540 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:23.527+0000 7f1145929740 10 client.26155 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-10T22:33:23.540 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:23.527+0000 7f1145929740 20 client.26155 populate_metadata read hostname 'smithi019' 2024-09-10T22:33:23.540 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:23.527+0000 7f1145929740 1 --2- 172.21.15.19:0/983845326 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x55cc30707df0 0x55cc3070a1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:33:23.540 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:23.527+0000 7f1145929740 4 client.26155 mds_command: new command op to 24581 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-10T22:33:23.540 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:23.527+0000 7f1145929740 1 -- 172.21.15.19:0/983845326 --> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55cc305e6c80 con 0x55cc30707df0 2024-09-10T22:33:23.540 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:23.527+0000 7f11412f0640 1 --2- 172.21.15.19:0/983845326 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x55cc30707df0 0x55cc3070a1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:33:23.540 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:23.528+0000 7f1124ff9640 10 client.26155 ms_handle_connect on v2:172.21.15.135:6838/1254769802 2024-09-10T22:33:23.540 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:23.528+0000 7f11412f0640 1 --2- 172.21.15.19:0/983845326 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x55cc30707df0 0x55cc3070a1e0 crc :-1 s=READY pgs=151 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8eb3962da5c50f92 server_cookie=5ba57d45acf26cd7 in_seq=0 out_seq=0 2024-09-10T22:33:23.540 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:23.528+0000 7f1124ff9640 1 -- 172.21.15.19:0/983845326 <== mds.0 v2:172.21.15.135:6838/1254769802 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3126 (crc 0 0 0) 0x55cc305e6c80 con 0x55cc30707df0 2024-09-10T22:33:23.540 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:23.528+0000 7f1124ff9640 10 client.26155 handle_command_reply: tid=0 2024-09-10T22:33:23.541 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:23.528+0000 7f1145929740 1 client.26155 shutdown 2024-09-10T22:33:23.541 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:23.528+0000 7f1145929740 1 -- 172.21.15.19:0/983845326 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55cc30683850 msgr2=0x55cc306a2320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:33:23.541 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:23.528+0000 7f1145929740 1 --2- 172.21.15.19:0/983845326 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55cc30683850 0x55cc306a2320 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f112c011010 tx=0x7f112c00b780 comp rx=0 tx=0).stop 2024-09-10T22:33:23.541 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:23.529+0000 7f1145929740 1 -- 172.21.15.19:0/983845326 shutdown_connections 2024-09-10T22:33:23.541 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:23.529+0000 7f1145929740 1 --2- 172.21.15.19:0/983845326 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55cc306841d0 0x55cc306a0b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:33:23.541 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:23.529+0000 7f1145929740 1 --2- 172.21.15.19:0/983845326 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x55cc30707df0 0x55cc3070a1e0 crc :-1 s=READY pgs=151 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:33:23.541 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:23.529+0000 7f1145929740 1 --2- 172.21.15.19:0/983845326 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55cc30683850 0x55cc306a2320 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:33:23.541 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:23.529+0000 7f1145929740 1 --2- 172.21.15.19:0/983845326 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55cc30672f00 0x55cc306a1d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:33:23.541 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:23.529+0000 7f1145929740 1 -- 172.21.15.19:0/983845326 >> 172.21.15.19:0/983845326 conn(0x55cc30675420 msgr2=0x55cc30684e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:33:23.541 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:23.529+0000 7f1124ff9640 0 client.26155 ms_handle_reset on v2:172.21.15.135:6838/1254769802 2024-09-10T22:33:23.541 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:23.529+0000 7f1145929740 1 -- 172.21.15.19:0/983845326 shutdown_connections 2024-09-10T22:33:23.541 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:23.529+0000 7f1145929740 1 -- 172.21.15.19:0/983845326 wait complete. 2024-09-10T22:33:23.542 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:23.529+0000 7f1145929740 20 client.26155 trim_cache size 0 max 16384 2024-09-10T22:33:23.542 INFO:teuthology.orchestra.run.smithi019.stdout:{ 2024-09-10T22:33:23.542 INFO:teuthology.orchestra.run.smithi019.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-10T22:33:23.542 INFO:teuthology.orchestra.run.smithi019.stdout: "scrubs": { 2024-09-10T22:33:23.542 INFO:teuthology.orchestra.run.smithi019.stdout: "448b10e7-494c-4a88-a9ab-186159c5dfdd": { 2024-09-10T22:33:23.542 INFO:teuthology.orchestra.run.smithi019.stdout: "path": "/", 2024-09-10T22:33:23.542 INFO:teuthology.orchestra.run.smithi019.stdout: "tag": "448b10e7-494c-4a88-a9ab-186159c5dfdd", 2024-09-10T22:33:23.542 INFO:teuthology.orchestra.run.smithi019.stdout: "options": "recursive,force" 2024-09-10T22:33:23.542 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-10T22:33:23.542 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:33:23.543 INFO:teuthology.orchestra.run.smithi019.stdout: "scrub_stats": { 2024-09-10T22:33:23.543 INFO:teuthology.orchestra.run.smithi019.stdout: "0b81ea61-0b8e-4f2c-a58f-ef1019289fc9": { 2024-09-10T22:33:23.543 INFO:teuthology.orchestra.run.smithi019.stdout: "start_time": "2024-09-10T22:31:48.141568+0000", 2024-09-10T22:33:23.543 INFO:teuthology.orchestra.run.smithi019.stdout: "path": "/", 2024-09-10T22:33:23.543 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_started": 0, 2024-09-10T22:33:23.543 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_passed": 0, 2024-09-10T22:33:23.543 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_failed": 0, 2024-09-10T22:33:23.543 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_skipped": 0 2024-09-10T22:33:23.543 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:33:23.543 INFO:teuthology.orchestra.run.smithi019.stdout: "715ec863-8a9d-45b6-967f-59b15ce1bf12": { 2024-09-10T22:33:23.543 INFO:teuthology.orchestra.run.smithi019.stdout: "start_time": "2024-09-10T22:31:00.669516+0000", 2024-09-10T22:33:23.543 INFO:teuthology.orchestra.run.smithi019.stdout: "path": "/", 2024-09-10T22:33:23.543 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_started": 0, 2024-09-10T22:33:23.544 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_passed": 0, 2024-09-10T22:33:23.544 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_failed": 0, 2024-09-10T22:33:23.544 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_skipped": 0 2024-09-10T22:33:23.544 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:33:23.544 INFO:teuthology.orchestra.run.smithi019.stdout: "fd1f1837-dcfa-4d88-99e8-2509f36c3f98": { 2024-09-10T22:33:23.544 INFO:teuthology.orchestra.run.smithi019.stdout: "start_time": "2024-09-10T22:30:12.470477+0000", 2024-09-10T22:33:23.544 INFO:teuthology.orchestra.run.smithi019.stdout: "path": "/", 2024-09-10T22:33:23.544 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_started": 0, 2024-09-10T22:33:23.544 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_passed": 0, 2024-09-10T22:33:23.544 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_failed": 0, 2024-09-10T22:33:23.544 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_skipped": 0 2024-09-10T22:33:23.544 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:33:23.544 INFO:teuthology.orchestra.run.smithi019.stdout: "8f3bb3bf-911f-490c-9856-c80ea220dbbe": { 2024-09-10T22:33:23.545 INFO:teuthology.orchestra.run.smithi019.stdout: "start_time": "2024-09-10T22:29:25.374415+0000", 2024-09-10T22:33:23.545 INFO:teuthology.orchestra.run.smithi019.stdout: "path": "/", 2024-09-10T22:33:23.545 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_started": 0, 2024-09-10T22:33:23.545 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_passed": 0, 2024-09-10T22:33:23.545 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_failed": 0, 2024-09-10T22:33:23.545 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_skipped": 0 2024-09-10T22:33:23.545 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:33:23.545 INFO:teuthology.orchestra.run.smithi019.stdout: "eb518e3c-a71e-4f32-9ca0-ae88930ca218": { 2024-09-10T22:33:23.545 INFO:teuthology.orchestra.run.smithi019.stdout: "start_time": "2024-09-10T22:28:38.366352+0000", 2024-09-10T22:33:23.545 INFO:teuthology.orchestra.run.smithi019.stdout: "path": "/", 2024-09-10T22:33:23.545 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_started": 0, 2024-09-10T22:33:23.545 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_passed": 0, 2024-09-10T22:33:23.545 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_failed": 0, 2024-09-10T22:33:23.545 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_skipped": 0 2024-09-10T22:33:23.546 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:33:23.546 INFO:teuthology.orchestra.run.smithi019.stdout: "4c99964e-2e0e-4ffd-8cb8-99c4979ed90f": { 2024-09-10T22:33:23.546 INFO:teuthology.orchestra.run.smithi019.stdout: "start_time": "2024-09-10T22:32:34.659639+0000", 2024-09-10T22:33:23.546 INFO:teuthology.orchestra.run.smithi019.stdout: "path": "/", 2024-09-10T22:33:23.546 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_started": 0, 2024-09-10T22:33:23.546 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_passed": 0, 2024-09-10T22:33:23.546 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_failed": 0, 2024-09-10T22:33:23.546 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_skipped": 0 2024-09-10T22:33:23.546 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:33:23.546 INFO:teuthology.orchestra.run.smithi019.stdout: "c12c2a04-dcd6-4673-a98e-93f665d3f5d7": { 2024-09-10T22:33:23.546 INFO:teuthology.orchestra.run.smithi019.stdout: "start_time": "2024-09-10T22:27:49.392329+0000", 2024-09-10T22:33:23.546 INFO:teuthology.orchestra.run.smithi019.stdout: "path": "/", 2024-09-10T22:33:23.546 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_started": 0, 2024-09-10T22:33:23.546 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_passed": 0, 2024-09-10T22:33:23.547 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_failed": 0, 2024-09-10T22:33:23.547 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_skipped": 0 2024-09-10T22:33:23.547 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:33:23.547 INFO:teuthology.orchestra.run.smithi019.stdout: "b38852c8-478a-42ef-8384-b2c55d5313a4": { 2024-09-10T22:33:23.547 INFO:teuthology.orchestra.run.smithi019.stdout: "start_time": "2024-09-10T22:27:00.320308+0000", 2024-09-10T22:33:23.547 INFO:teuthology.orchestra.run.smithi019.stdout: "path": "/", 2024-09-10T22:33:23.547 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_started": 0, 2024-09-10T22:33:23.547 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_passed": 0, 2024-09-10T22:33:23.547 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_failed": 0, 2024-09-10T22:33:23.547 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_skipped": 0 2024-09-10T22:33:23.547 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:33:23.547 INFO:teuthology.orchestra.run.smithi019.stdout: "448b10e7-494c-4a88-a9ab-186159c5dfdd": { 2024-09-10T22:33:23.547 INFO:teuthology.orchestra.run.smithi019.stdout: "start_time": "2024-09-10T22:33:21.208716+0000", 2024-09-10T22:33:23.547 INFO:teuthology.orchestra.run.smithi019.stdout: "path": "/", 2024-09-10T22:33:23.548 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_started": 0, 2024-09-10T22:33:23.548 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_passed": 0, 2024-09-10T22:33:23.548 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_failed": 0, 2024-09-10T22:33:23.548 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_skipped": 0 2024-09-10T22:33:23.548 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:33:23.548 INFO:teuthology.orchestra.run.smithi019.stdout: "9b6bfdee-303c-4c12-af56-dc85860d112a": { 2024-09-10T22:33:23.548 INFO:teuthology.orchestra.run.smithi019.stdout: "start_time": "2024-09-10T22:26:17.484162+0000", 2024-09-10T22:33:23.548 INFO:teuthology.orchestra.run.smithi019.stdout: "path": "/", 2024-09-10T22:33:23.548 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_started": 0, 2024-09-10T22:33:23.548 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_passed": 0, 2024-09-10T22:33:23.548 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_failed": 0, 2024-09-10T22:33:23.548 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_skipped": 0 2024-09-10T22:33:23.548 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-10T22:33:23.548 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-10T22:33:23.549 INFO:teuthology.orchestra.run.smithi019.stdout:} 2024-09-10T22:33:23.549 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:23.530+0000 7f1143554640 1 -- 172.21.15.19:0/2317554069 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f11280b52e0 msgr2=0x7f11280b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:33:23.549 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:23.530+0000 7f1143554640 1 --2- 172.21.15.19:0/2317554069 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f11280b52e0 0x7f11280b77a0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f1138031440 tx=0x7f1138005b50 comp rx=0 tx=0).stop 2024-09-10T22:33:23.549 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:23.530+0000 7f1143554640 1 -- 172.21.15.19:0/2317554069 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f113c108040 msgr2=0x7f113c19eb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:33:23.550 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:23.530+0000 7f1143554640 1 --2- 172.21.15.19:0/2317554069 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f113c108040 0x7f113c19eb40 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f113400eb10 tx=0x7f113400c2d0 comp rx=0 tx=0).stop 2024-09-10T22:33:23.550 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:23.531+0000 7f1143554640 1 -- 172.21.15.19:0/2317554069 shutdown_connections 2024-09-10T22:33:23.550 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:23.531+0000 7f1143554640 1 --2- 172.21.15.19:0/2317554069 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f11280b52e0 0x7f11280b77a0 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:33:23.550 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:23.531+0000 7f1143554640 1 --2- 172.21.15.19:0/2317554069 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f113c108040 0x7f113c19eb40 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:33:23.550 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:23.531+0000 7f1143554640 1 --2- 172.21.15.19:0/2317554069 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f113c1076c0 0x7f113c1997a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:33:23.550 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:23.531+0000 7f1143554640 1 --2- 172.21.15.19:0/2317554069 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f113c101cb0 0x7f113c199260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:33:23.550 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:23.531+0000 7f1143554640 1 -- 172.21.15.19:0/2317554069 >> 172.21.15.19:0/2317554069 conn(0x7f113c0fd700 msgr2=0x7f113c06b530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:33:23.550 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:23.532+0000 7f1143554640 1 -- 172.21.15.19:0/2317554069 shutdown_connections 2024-09-10T22:33:23.550 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:23.532+0000 7f1143554640 1 -- 172.21.15.19:0/2317554069 wait complete. 2024-09-10T22:33:23.552 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:23.548+0000 7fe5852bd640 1 -- 172.21.15.19:0/3867396032 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe5801029b0 msgr2=0x7fe580102e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:33:23.553 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:23.548+0000 7fe5852bd640 1 --2- 172.21.15.19:0/3867396032 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe5801029b0 0x7fe580102e30 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7fe574009930 tx=0x7fe57402a420 comp rx=0 tx=0).stop 2024-09-10T22:33:23.553 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:23.548+0000 7fe5852bd640 1 -- 172.21.15.19:0/3867396032 shutdown_connections 2024-09-10T22:33:23.553 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:23.548+0000 7fe5852bd640 1 --2- 172.21.15.19:0/3867396032 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe580103370 0x7fe580109cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:33:23.553 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:23.548+0000 7fe5852bd640 1 --2- 172.21.15.19:0/3867396032 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe5801029b0 0x7fe580102e30 unknown :-1 s=CLOSED pgs=705 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:33:23.553 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:23.548+0000 7fe5852bd640 1 --2- 172.21.15.19:0/3867396032 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe580101860 0x7fe580101c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:33:23.553 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:23.548+0000 7fe5852bd640 1 -- 172.21.15.19:0/3867396032 >> 172.21.15.19:0/3867396032 conn(0x7fe5800fd140 msgr2=0x7fe5800ff560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:33:23.553 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:23.548+0000 7fe5852bd640 1 -- 172.21.15.19:0/3867396032 shutdown_connections 2024-09-10T22:33:23.553 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:23.548+0000 7fe5852bd640 1 -- 172.21.15.19:0/3867396032 wait complete. 2024-09-10T22:33:23.553 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:23.549+0000 7fe5852bd640 1 Processor -- start 2024-09-10T22:33:23.553 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:23.549+0000 7fe5852bd640 1 -- start start 2024-09-10T22:33:23.553 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:23.549+0000 7fe5852bd640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe580101860 0x7fe580105620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:33:23.553 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:23.549+0000 7fe5852bd640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe5801029b0 0x7fe580103e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:33:23.554 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:23.549+0000 7fe5852bd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe580103370 0x7fe5801043c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:33:23.554 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:23.549+0000 7fe5852bd640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fe58010d4d0 con 0x7fe580103370 2024-09-10T22:33:23.554 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:23.549+0000 7fe5852bd640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fe58010d350 con 0x7fe580101860 2024-09-10T22:33:23.554 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:23.549+0000 7fe5852bd640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7fe58010d650 con 0x7fe5801029b0 2024-09-10T22:33:23.554 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:23.549+0000 7fe57f7fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe580103370 0x7fe5801043c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:33:23.554 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:23.549+0000 7fe57effd640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe580101860 0x7fe580105620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:33:23.554 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:23.549+0000 7fe57effd640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe580101860 0x7fe580105620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.19:39076/0 (socket says 172.21.15.19:39076) 2024-09-10T22:33:23.554 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:23.549+0000 7fe57effd640 1 -- 172.21.15.19:0/3849862120 learned_addr learned my addr 172.21.15.19:0/3849862120 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:33:23.554 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:23.549+0000 7fe57f7fe640 1 --2- 172.21.15.19:0/3849862120 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe580103370 0x7fe5801043c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:57172/0 (socket says 172.21.15.19:57172) 2024-09-10T22:33:23.554 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:23.549+0000 7fe57e7fc640 1 --2- 172.21.15.19:0/3849862120 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe5801029b0 0x7fe580103e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:33:23.554 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:23.550+0000 7fe57effd640 1 -- 172.21.15.19:0/3849862120 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe5801029b0 msgr2=0x7fe580103e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:33:23.554 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:23.550+0000 7fe57effd640 1 --2- 172.21.15.19:0/3849862120 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe5801029b0 0x7fe580103e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:33:23.555 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:23.550+0000 7fe57effd640 1 -- 172.21.15.19:0/3849862120 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe580103370 msgr2=0x7fe5801043c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:33:23.555 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:23.550+0000 7fe57effd640 1 --2- 172.21.15.19:0/3849862120 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe580103370 0x7fe5801043c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:33:23.555 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:23.550+0000 7fe57effd640 1 -- 172.21.15.19:0/3849862120 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe580104c30 con 0x7fe580101860 2024-09-10T22:33:23.555 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:23.550+0000 7fe57effd640 1 --2- 172.21.15.19:0/3849862120 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe580101860 0x7fe580105620 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fe57000d950 tx=0x7fe57000de10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:33:23.555 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:23.550+0000 7fe567fff640 1 -- 172.21.15.19:0/3849862120 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe570017030 con 0x7fe580101860 2024-09-10T22:33:23.555 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:23.550+0000 7fe5852bd640 1 -- 172.21.15.19:0/3849862120 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe5801a2ef0 con 0x7fe580101860 2024-09-10T22:33:23.555 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:23.550+0000 7fe567fff640 1 -- 172.21.15.19:0/3849862120 <== mon.2 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe570004020 con 0x7fe580101860 2024-09-10T22:33:23.555 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:23.550+0000 7fe567fff640 1 -- 172.21.15.19:0/3849862120 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5700047a0 con 0x7fe580101860 2024-09-10T22:33:23.555 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:23.550+0000 7fe5852bd640 1 -- 172.21.15.19:0/3849862120 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe5801a3360 con 0x7fe580101860 2024-09-10T22:33:23.557 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:23.553+0000 7fe567fff640 1 -- 172.21.15.19:0/3849862120 <== mon.2 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 18) ==== 153250+0+0 (secure 0 0 0) 0x7fe570009a30 con 0x7fe580101860 2024-09-10T22:33:23.557 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:23.554+0000 7fe567fff640 1 --2- 172.21.15.19:0/3849862120 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7fe5680b5360 0x7fe5680b7820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:33:23.557 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:23.554+0000 7fe57e7fc640 1 --2- 172.21.15.19:0/3849862120 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7fe5680b5360 0x7fe5680b7820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:33:23.557 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:23.554+0000 7fe567fff640 1 -- 172.21.15.19:0/3849862120 <== mon.2 v2:172.21.15.135:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8327+0+0 (secure 0 0 0) 0x7fe5700e55d0 con 0x7fe580101860 2024-09-10T22:33:23.557 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:23.554+0000 7fe57e7fc640 1 --2- 172.21.15.19:0/3849862120 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7fe5680b5360 0x7fe5680b7820 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7fe574009900 tx=0x7fe574000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:33:23.557 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:23.555+0000 7fe58808f740 1 Processor -- start 2024-09-10T22:33:23.557 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:23.555+0000 7fe58808f740 1 -- start start 2024-09-10T22:33:23.558 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:23.555+0000 7fe58808f740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x560e3425a860 0x560e3425cc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:33:23.558 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:23.555+0000 7fe58808f740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560e3425d190 0x560e3425f580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:33:23.558 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:23.555+0000 7fe58808f740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x560e3425fbd0 0x560e34262090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:33:23.558 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:23.555+0000 7fe58808f740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x560e341cc6f0 con 0x560e3425fbd0 2024-09-10T22:33:23.558 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:23.555+0000 7fe58808f740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x560e341bbb20 con 0x560e3425d190 2024-09-10T22:33:23.558 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:23.555+0000 7fe58808f740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x560e341bf930 con 0x560e3425a860 2024-09-10T22:33:23.558 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:23.555+0000 7fe57e7fc640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560e3425d190 0x560e3425f580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:33:23.558 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:23.555+0000 7fe57f7fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x560e3425fbd0 0x560e34262090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:33:23.558 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:23.555+0000 7fe57e7fc640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560e3425d190 0x560e3425f580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.19:39088/0 (socket says 172.21.15.19:39088) 2024-09-10T22:33:23.558 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:23.555+0000 7fe57f7fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x560e3425fbd0 0x560e34262090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:57188/0 (socket says 172.21.15.19:57188) 2024-09-10T22:33:23.558 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:23.555+0000 7fe57e7fc640 1 -- 172.21.15.19:0/1997116518 learned_addr learned my addr 172.21.15.19:0/1997116518 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:33:23.558 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:23.555+0000 7fe57effd640 1 --2- 172.21.15.19:0/1997116518 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x560e3425a860 0x560e3425cc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:33:23.559 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:23.556+0000 7fe57effd640 1 -- 172.21.15.19:0/1997116518 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560e3425d190 msgr2=0x560e3425f580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:33:23.559 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:23.556+0000 7fe57effd640 1 --2- 172.21.15.19:0/1997116518 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560e3425d190 0x560e3425f580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:33:23.559 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:23.556+0000 7fe57effd640 1 -- 172.21.15.19:0/1997116518 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x560e3425fbd0 msgr2=0x560e34262090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:33:23.562 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:23.556+0000 7fe57effd640 1 --2- 172.21.15.19:0/1997116518 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x560e3425fbd0 0x560e34262090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:33:23.562 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:23.556+0000 7fe57effd640 1 -- 172.21.15.19:0/1997116518 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560e34181530 con 0x560e3425a860 2024-09-10T22:33:23.562 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:23.556+0000 7fe57effd640 1 --2- 172.21.15.19:0/1997116518 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x560e3425a860 0x560e3425cc50 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fe5700a8fa0 tx=0x7fe5700abc10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=36171e1cf718462a server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:33:23.562 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:23.557+0000 7fe5657fa640 1 -- 172.21.15.19:0/1997116518 <== mon.1 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5700abd30 con 0x560e3425a860 2024-09-10T22:33:23.562 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:23.557+0000 7fe5657fa640 1 -- 172.21.15.19:0/1997116518 <== mon.1 v2:172.21.15.138:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe5700b0810 con 0x560e3425a860 2024-09-10T22:33:23.562 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:23.557+0000 7fe5657fa640 1 -- 172.21.15.19:0/1997116518 <== mon.1 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5700b3b90 con 0x560e3425a860 2024-09-10T22:33:23.562 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:23.558+0000 7fe58808f740 1 -- 172.21.15.19:0/1997116518 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x560e3425a860 msgr2=0x560e3425cc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:33:23.562 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:23.558+0000 7fe58808f740 1 --2- 172.21.15.19:0/1997116518 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x560e3425a860 0x560e3425cc50 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fe5700a8fa0 tx=0x7fe5700abc10 comp rx=0 tx=0).stop 2024-09-10T22:33:23.562 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:23.558+0000 7fe58808f740 1 -- 172.21.15.19:0/1997116518 shutdown_connections 2024-09-10T22:33:23.563 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:23.558+0000 7fe58808f740 1 --2- 172.21.15.19:0/1997116518 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x560e3425fbd0 0x560e34262090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:33:23.563 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:23.558+0000 7fe58808f740 1 --2- 172.21.15.19:0/1997116518 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560e3425d190 0x560e3425f580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:33:23.563 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:23.558+0000 7fe58808f740 1 --2- 172.21.15.19:0/1997116518 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x560e3425a860 0x560e3425cc50 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:33:23.563 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:23.558+0000 7fe58808f740 1 -- 172.21.15.19:0/1997116518 >> 172.21.15.19:0/1997116518 conn(0x560e342559b0 msgr2=0x560e34256740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:33:23.563 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:23.558+0000 7fe58808f740 1 -- 172.21.15.19:0/1997116518 shutdown_connections 2024-09-10T22:33:23.563 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:23.558+0000 7fe58808f740 1 -- 172.21.15.19:0/1997116518 wait complete. 2024-09-10T22:33:23.563 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:23.558+0000 7fe58808f740 1 -- start start 2024-09-10T22:33:23.563 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:23.558+0000 7fe58808f740 1 Processor -- start 2024-09-10T22:33:23.563 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:23.559+0000 7fe58808f740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x560e3425a860 0x560e34263f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:33:23.563 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:23.559+0000 7fe58808f740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560e3425d190 0x560e342645f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:33:23.563 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:23.559+0000 7fe58808f740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x560e3425fbd0 0x560e342651c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:33:23.564 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:23.559+0000 7fe58808f740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x560e340f3ab0 con 0x560e3425a860 2024-09-10T22:33:23.564 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:23.559+0000 7fe58808f740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x560e34161730 con 0x560e3425d190 2024-09-10T22:33:23.564 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:23.559+0000 7fe58808f740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x560e34262bb0 con 0x560e3425fbd0 2024-09-10T22:33:23.564 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:23.559+0000 7fe58808f740 10 client.0 _ll_register_callbacks cb 0x560e341b56b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T22:33:23.564 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:23.559+0000 7fe57e7fc640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560e3425d190 0x560e342645f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:33:23.564 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:23.559+0000 7fe57f7fe640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x560e3425fbd0 0x560e342651c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:33:23.564 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:23.559+0000 7fe57e7fc640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560e3425d190 0x560e342645f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.19:39096/0 (socket says 172.21.15.19:39096) 2024-09-10T22:33:23.564 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:23.559+0000 7fe57e7fc640 1 -- 172.21.15.19:0/1573577955 learned_addr learned my addr 172.21.15.19:0/1573577955 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:33:23.564 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:23.559+0000 7fe57effd640 1 --2- 172.21.15.19:0/1573577955 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x560e3425a860 0x560e34263f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:33:23.564 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:23.559+0000 7fe57f7fe640 1 -- 172.21.15.19:0/1573577955 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560e3425d190 msgr2=0x560e342645f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:33:23.564 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:23.559+0000 7fe57f7fe640 1 --2- 172.21.15.19:0/1573577955 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560e3425d190 0x560e342645f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:33:23.564 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:23.559+0000 7fe57f7fe640 1 -- 172.21.15.19:0/1573577955 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x560e3425a860 msgr2=0x560e34263f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:33:23.565 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:23.559+0000 7fe57f7fe640 1 --2- 172.21.15.19:0/1573577955 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x560e3425a860 0x560e34263f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:33:23.565 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:23.559+0000 7fe57f7fe640 1 -- 172.21.15.19:0/1573577955 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560e33f1d790 con 0x560e3425fbd0 2024-09-10T22:33:23.565 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:23.560+0000 7fe57effd640 1 --2- 172.21.15.19:0/1573577955 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x560e3425a860 0x560e34263f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T22:33:23.565 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:23.560+0000 7fe57f7fe640 1 --2- 172.21.15.19:0/1573577955 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x560e3425fbd0 0x560e342651c0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fe578011ce0 tx=0x7fe57800f790 comp rx=0 tx=0).ready entity=mon.1 client_cookie=99080a9459bf74f1 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:33:23.565 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:23.560+0000 7fe562ff5640 10 client.0 ms_handle_connect on v2:172.21.15.138:3300/0 2024-09-10T22:33:23.565 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:23.560+0000 7fe562ff5640 1 -- 172.21.15.19:0/1573577955 <== mon.1 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe578009e30 con 0x560e3425fbd0 2024-09-10T22:33:23.565 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:23.560+0000 7fe562ff5640 1 -- 172.21.15.19:0/1573577955 <== mon.1 v2:172.21.15.138:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8327+0+0 (secure 0 0 0) 0x7fe578003970 con 0x560e3425fbd0 2024-09-10T22:33:23.565 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:23.560+0000 7fe58808f740 1 -- 172.21.15.19:0/1573577955 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe5700b0810 con 0x560e3425fbd0 2024-09-10T22:33:23.565 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:23.560+0000 7fe562ff5640 1 -- 172.21.15.19:0/1573577955 <== mon.1 v2:172.21.15.138:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fe578003b70 con 0x560e3425fbd0 2024-09-10T22:33:23.565 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:23.560+0000 7fe58808f740 10 client.26167 fetch_fsmap learned FSMap version 27 2024-09-10T22:33:23.565 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:23.560+0000 7fe58808f740 1 -- 172.21.15.19:0/1573577955 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x560e33f96620 con 0x560e3425fbd0 2024-09-10T22:33:23.565 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:23.561+0000 7fe562ff5640 1 -- 172.21.15.19:0/1573577955 <== mon.1 v2:172.21.15.138:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe5700b0810 con 0x560e3425fbd0 2024-09-10T22:33:23.567 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:23.561+0000 7fe562ff5640 1 -- 172.21.15.19:0/1573577955 <== mon.1 v2:172.21.15.138:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7fe578023020 con 0x560e3425fbd0 2024-09-10T22:33:23.567 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:23.561+0000 7fe58808f740 10 client.26167 fetch_fsmap finished waiting for FSMap version 27 2024-09-10T22:33:23.567 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:23.561+0000 7fe58808f740 10 client.26167 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-10T22:33:23.568 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:23.561+0000 7fe58808f740 20 client.26167 populate_metadata read hostname 'smithi019' 2024-09-10T22:33:23.568 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:23.561+0000 7fe58808f740 1 --2- 172.21.15.19:0/1573577955 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x560e3426fc60 0x560e34272100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:33:23.568 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:23.561+0000 7fe58808f740 4 client.26167 mds_command: new command op to 24581 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T22:33:23.568 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:23.561+0000 7fe58808f740 1 -- 172.21.15.19:0/1573577955 --> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x560e341ce640 con 0x560e3426fc60 2024-09-10T22:33:23.568 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:23.561+0000 7fe57effd640 1 --2- 172.21.15.19:0/1573577955 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x560e3426fc60 0x560e34272100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:33:23.568 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:23.562+0000 7fe562ff5640 10 client.26167 ms_handle_connect on v2:172.21.15.135:6838/1254769802 2024-09-10T22:33:23.568 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:23.562+0000 7fe57effd640 1 --2- 172.21.15.19:0/1573577955 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x560e3426fc60 0x560e34272100 crc :-1 s=READY pgs=152 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=96d4079d1931f0a3 server_cookie=332b3257e5404d39 in_seq=0 out_seq=0 2024-09-10T22:33:23.568 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:23.562+0000 7fe562ff5640 1 -- 172.21.15.19:0/1573577955 <== mds.0 v2:172.21.15.135:6838/1254769802 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x560e341ce640 con 0x560e3426fc60 2024-09-10T22:33:23.568 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:23.562+0000 7fe562ff5640 10 client.26167 handle_command_reply: tid=0 2024-09-10T22:33:23.568 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:23.563+0000 7fe58808f740 1 client.26167 shutdown 2024-09-10T22:33:23.568 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:23.563+0000 7fe58808f740 1 -- 172.21.15.19:0/1573577955 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x560e3425fbd0 msgr2=0x560e342651c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:33:23.568 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:23.563+0000 7fe58808f740 1 --2- 172.21.15.19:0/1573577955 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x560e3425fbd0 0x560e342651c0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fe578011ce0 tx=0x7fe57800f790 comp rx=0 tx=0).stop 2024-09-10T22:33:23.569 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:23.563+0000 7fe58808f740 1 -- 172.21.15.19:0/1573577955 shutdown_connections 2024-09-10T22:33:23.569 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:23.563+0000 7fe58808f740 1 --2- 172.21.15.19:0/1573577955 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x560e3426fc60 0x560e34272100 crc :-1 s=READY pgs=152 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:33:23.569 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:23.563+0000 7fe58808f740 1 --2- 172.21.15.19:0/1573577955 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x560e3425fbd0 0x560e342651c0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:33:23.569 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:23.563+0000 7fe58808f740 1 --2- 172.21.15.19:0/1573577955 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560e3425d190 0x560e342645f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:33:23.569 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:23.563+0000 7fe562ff5640 0 client.26167 ms_handle_reset on v2:172.21.15.135:6838/1254769802 2024-09-10T22:33:23.569 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:23.563+0000 7fe58808f740 1 --2- 172.21.15.19:0/1573577955 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x560e3425a860 0x560e34263f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:33:23.569 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:23.563+0000 7fe58808f740 1 -- 172.21.15.19:0/1573577955 >> 172.21.15.19:0/1573577955 conn(0x560e342559b0 msgr2=0x560e34254bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:33:23.569 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:23.563+0000 7fe58808f740 1 -- 172.21.15.19:0/1573577955 shutdown_connections 2024-09-10T22:33:23.569 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:23.563+0000 7fe58808f740 1 -- 172.21.15.19:0/1573577955 wait complete. 2024-09-10T22:33:23.569 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:23.563+0000 7fe58808f740 20 client.26167 trim_cache size 0 max 16384 2024-09-10T22:33:23.582 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:23.581+0000 7fe58808f740 1 Processor -- start 2024-09-10T22:33:23.583 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:23.581+0000 7fe58808f740 1 -- start start 2024-09-10T22:33:23.584 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:23.581+0000 7fe58808f740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560e3425a860 0x560e34259d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:33:23.584 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:23.582+0000 7fe58808f740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x560e3425d190 0x560e3425a290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:33:23.584 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:23.582+0000 7fe58808f740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x560e3425fbd0 0x560e3425ffe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:33:23.584 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:23.582+0000 7fe57effd640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560e3425a860 0x560e34259d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:33:23.585 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:23.582+0000 7fe57effd640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560e3425a860 0x560e34259d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.19:39112/0 (socket says 172.21.15.19:39112) 2024-09-10T22:33:23.585 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:23.582+0000 7fe57effd640 1 -- 172.21.15.19:0/805559678 learned_addr learned my addr 172.21.15.19:0/805559678 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:33:23.585 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:23.582+0000 7fe57e7fc640 1 --2- 172.21.15.19:0/805559678 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x560e3425d190 0x560e3425a290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:33:23.585 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:23.582+0000 7fe58808f740 1 -- 172.21.15.19:0/805559678 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fe5801aec40 con 0x560e3425d190 2024-09-10T22:33:23.585 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:23.582+0000 7fe57f7fe640 1 --2- 172.21.15.19:0/805559678 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x560e3425fbd0 0x560e3425ffe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:33:23.585 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:23.582+0000 7fe58808f740 1 -- 172.21.15.19:0/805559678 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fe5801ac510 con 0x560e3425a860 2024-09-10T22:33:23.585 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:23.582+0000 7fe58808f740 1 -- 172.21.15.19:0/805559678 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7fe5801aa360 con 0x560e3425fbd0 2024-09-10T22:33:23.585 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:23.582+0000 7fe57effd640 1 -- 172.21.15.19:0/805559678 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x560e3425fbd0 msgr2=0x560e3425ffe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:33:23.585 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:23.582+0000 7fe57effd640 1 --2- 172.21.15.19:0/805559678 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x560e3425fbd0 0x560e3425ffe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:33:23.585 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:23.582+0000 7fe57effd640 1 -- 172.21.15.19:0/805559678 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x560e3425d190 msgr2=0x560e3425a290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:33:23.585 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:23.582+0000 7fe57effd640 1 --2- 172.21.15.19:0/805559678 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x560e3425d190 0x560e3425a290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:33:23.585 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:23.582+0000 7fe57effd640 1 -- 172.21.15.19:0/805559678 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560e3425f8f0 con 0x560e3425a860 2024-09-10T22:33:23.585 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:23.582+0000 7fe57e7fc640 1 --2- 172.21.15.19:0/805559678 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x560e3425d190 0x560e3425a290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T22:33:23.586 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:23.583+0000 7fe57effd640 1 --2- 172.21.15.19:0/805559678 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560e3425a860 0x560e34259d50 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fe5700045f0 tx=0x7fe5700a84b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=40ee17ca1b008797 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:33:23.586 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:23.583+0000 7fe564ff9640 1 -- 172.21.15.19:0/805559678 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5700b0810 con 0x560e3425a860 2024-09-10T22:33:23.586 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:23.583+0000 7fe564ff9640 1 -- 172.21.15.19:0/805559678 <== mon.2 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe5700d2070 con 0x560e3425a860 2024-09-10T22:33:23.586 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:23.583+0000 7fe564ff9640 1 -- 172.21.15.19:0/805559678 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5700a7fa0 con 0x560e3425a860 2024-09-10T22:33:23.589 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:23.584+0000 7fe58808f740 1 -- 172.21.15.19:0/805559678 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560e3425a860 msgr2=0x560e34259d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:33:23.589 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:23.584+0000 7fe58808f740 1 --2- 172.21.15.19:0/805559678 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560e3425a860 0x560e34259d50 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fe5700045f0 tx=0x7fe5700a84b0 comp rx=0 tx=0).stop 2024-09-10T22:33:23.589 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:23.584+0000 7fe58808f740 1 -- 172.21.15.19:0/805559678 shutdown_connections 2024-09-10T22:33:23.589 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:23.584+0000 7fe58808f740 1 --2- 172.21.15.19:0/805559678 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x560e3425fbd0 0x560e3425ffe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:33:23.589 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:23.584+0000 7fe58808f740 1 --2- 172.21.15.19:0/805559678 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x560e3425d190 0x560e3425a290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:33:23.589 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:23.584+0000 7fe58808f740 1 --2- 172.21.15.19:0/805559678 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560e3425a860 0x560e34259d50 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:33:23.589 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:23.584+0000 7fe58808f740 1 -- 172.21.15.19:0/805559678 >> 172.21.15.19:0/805559678 conn(0x560e342559b0 msgr2=0x560e34256330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:33:23.589 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:23.584+0000 7fe58808f740 1 -- 172.21.15.19:0/805559678 shutdown_connections 2024-09-10T22:33:23.589 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:23.584+0000 7fe58808f740 1 -- 172.21.15.19:0/805559678 wait complete. 2024-09-10T22:33:23.589 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:23.584+0000 7fe58808f740 1 -- start start 2024-09-10T22:33:23.589 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:23.584+0000 7fe58808f740 1 Processor -- start 2024-09-10T22:33:23.590 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:23.585+0000 7fe58808f740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x560e3425a860 0x560e34268f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:33:23.590 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:23.585+0000 7fe58808f740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560e3425d190 0x560e34269620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:33:23.590 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:23.585+0000 7fe57effd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x560e3425a860 0x560e34268f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:33:23.590 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:23.585+0000 7fe58808f740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x560e3425fbd0 0x560e3426a1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:33:23.590 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:23.585+0000 7fe58808f740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fe5801aa9d0 con 0x560e3425a860 2024-09-10T22:33:23.590 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:23.585+0000 7fe57effd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x560e3425a860 0x560e34268f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:57210/0 (socket says 172.21.15.19:57210) 2024-09-10T22:33:23.590 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:23.585+0000 7fe57effd640 1 -- 172.21.15.19:0/519839908 learned_addr learned my addr 172.21.15.19:0/519839908 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:33:23.590 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:23.585+0000 7fe58808f740 1 -- 172.21.15.19:0/519839908 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fe5801abe40 con 0x560e3425d190 2024-09-10T22:33:23.590 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:23.585+0000 7fe58808f740 1 -- 172.21.15.19:0/519839908 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7fe5801ab0a0 con 0x560e3425fbd0 2024-09-10T22:33:23.590 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:23.585+0000 7fe57e7fc640 1 --2- 172.21.15.19:0/519839908 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560e3425d190 0x560e34269620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:33:23.590 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:23.585+0000 7fe58808f740 10 client.0 _ll_register_callbacks cb 0x7fe578009cc0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T22:33:23.590 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:23.585+0000 7fe57f7fe640 1 --2- 172.21.15.19:0/519839908 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x560e3425fbd0 0x560e3426a1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:33:23.590 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:23.585+0000 7fe57effd640 1 -- 172.21.15.19:0/519839908 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x560e3425fbd0 msgr2=0x560e3426a1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:33:23.591 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:23.585+0000 7fe57effd640 1 --2- 172.21.15.19:0/519839908 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x560e3425fbd0 0x560e3426a1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:33:23.591 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:23.585+0000 7fe57effd640 1 -- 172.21.15.19:0/519839908 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560e3425d190 msgr2=0x560e34269620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:33:23.591 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:23.585+0000 7fe57effd640 1 --2- 172.21.15.19:0/519839908 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560e3425d190 0x560e34269620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:33:23.591 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:23.585+0000 7fe57effd640 1 -- 172.21.15.19:0/519839908 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560e3426aa20 con 0x560e3425a860 2024-09-10T22:33:23.591 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:23.585+0000 7fe57f7fe640 1 --2- 172.21.15.19:0/519839908 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x560e3425fbd0 0x560e3426a1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T22:33:23.591 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:23.585+0000 7fe57e7fc640 1 --2- 172.21.15.19:0/519839908 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560e3425d190 0x560e34269620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T22:33:23.591 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:23.585+0000 7fe57effd640 1 --2- 172.21.15.19:0/519839908 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x560e3425a860 0x560e34268f80 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7fe5700a8300 tx=0x7fe5700b53c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d2b803e31357a54 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:33:23.591 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:23.585+0000 7fe562ff5640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-10T22:33:23.591 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:23.585+0000 7fe562ff5640 1 -- 172.21.15.19:0/519839908 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5700b0810 con 0x560e3425a860 2024-09-10T22:33:23.591 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:23.586+0000 7fe562ff5640 1 -- 172.21.15.19:0/519839908 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8327+0+0 (secure 0 0 0) 0x7fe5700a7fa0 con 0x560e3425a860 2024-09-10T22:33:23.591 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:23.586+0000 7fe58808f740 1 -- 172.21.15.19:0/519839908 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe5700d2070 con 0x560e3425a860 2024-09-10T22:33:23.591 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:23.586+0000 7fe562ff5640 1 -- 172.21.15.19:0/519839908 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fe5700041d0 con 0x560e3425a860 2024-09-10T22:33:23.591 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:23.586+0000 7fe58808f740 10 client.16794 fetch_fsmap learned FSMap version 27 2024-09-10T22:33:23.591 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:23.586+0000 7fe58808f740 1 -- 172.21.15.19:0/519839908 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x560e3426bd50 con 0x560e3425a860 2024-09-10T22:33:23.592 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:23.586+0000 7fe562ff5640 1 -- 172.21.15.19:0/519839908 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe5700d2070 con 0x560e3425a860 2024-09-10T22:33:23.592 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:23.586+0000 7fe562ff5640 1 -- 172.21.15.19:0/519839908 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7fe5700e51a0 con 0x560e3425a860 2024-09-10T22:33:23.592 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:23.586+0000 7fe58808f740 10 client.16794 fetch_fsmap finished waiting for FSMap version 27 2024-09-10T22:33:23.592 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:23.586+0000 7fe58808f740 10 client.16794 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-10T22:33:23.592 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:23.586+0000 7fe58808f740 20 client.16794 populate_metadata read hostname 'smithi019' 2024-09-10T22:33:23.592 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:23.586+0000 7fe58808f740 1 --2- 172.21.15.19:0/519839908 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x560e342dcc10 0x560e342df000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:33:23.592 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:23.586+0000 7fe58808f740 4 client.16794 mds_command: new command op to 24581 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-10T22:33:23.592 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:23.586+0000 7fe58808f740 1 -- 172.21.15.19:0/519839908 --> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] -- command(tid 0: {"prefix": "flush journal"}) -- 0x560e341ca0f0 con 0x560e342dcc10 2024-09-10T22:33:23.592 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:23.586+0000 7fe57e7fc640 1 --2- 172.21.15.19:0/519839908 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x560e342dcc10 0x560e342df000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:33:23.592 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:23.587+0000 7fe57e7fc640 1 --2- 172.21.15.19:0/519839908 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x560e342dcc10 0x560e342df000 crc :-1 s=READY pgs=153 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c2301fab4221001b server_cookie=a9ba4c0964c59289 in_seq=0 out_seq=0 2024-09-10T22:33:23.592 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:23.587+0000 7fe562ff5640 10 client.16794 ms_handle_connect on v2:172.21.15.135:6838/1254769802 2024-09-10T22:33:24.360 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:33:24 smithi135 ceph-mon[34789]: pgmap v556: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 413 KiB/s rd, 254 MiB/s wr, 542 op/s 2024-09-10T22:33:24.375 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:33:24 smithi138 ceph-mon[35236]: pgmap v556: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 413 KiB/s rd, 254 MiB/s wr, 542 op/s 2024-09-10T22:33:24.460 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:33:24 smithi019 ceph-mon[31375]: pgmap v556: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 413 KiB/s rd, 254 MiB/s wr, 542 op/s 2024-09-10T22:33:24.963 INFO:tasks.cephfs.filesystem:scrub status for tag:448b10e7-494c-4a88-a9ab-186159c5dfdd - {'path': '/', 'tag': '448b10e7-494c-4a88-a9ab-186159c5dfdd', 'options': 'recursive,force'} 2024-09-10T22:33:26.360 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:33:26 smithi135 ceph-mon[34789]: pgmap v557: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 414 KiB/s rd, 257 MiB/s wr, 528 op/s 2024-09-10T22:33:26.375 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:33:26 smithi138 ceph-mon[35236]: pgmap v557: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 414 KiB/s rd, 257 MiB/s wr, 528 op/s 2024-09-10T22:33:26.458 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:33:26 smithi019 ceph-mon[31375]: pgmap v557: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 414 KiB/s rd, 257 MiB/s wr, 528 op/s 2024-09-10T22:33:28.360 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:33:28 smithi135 ceph-mon[34789]: pgmap v558: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 725 KiB/s rd, 286 MiB/s wr, 583 op/s 2024-09-10T22:33:28.360 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:33:28 smithi135 ceph-mon[34789]: scrub summary: idle 2024-09-10T22:33:28.360 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:33:28 smithi135 ceph-mon[34789]: scrub summary: idle 2024-09-10T22:33:28.375 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:33:28 smithi138 ceph-mon[35236]: pgmap v558: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 725 KiB/s rd, 286 MiB/s wr, 583 op/s 2024-09-10T22:33:28.375 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:33:28 smithi138 ceph-mon[35236]: scrub summary: idle 2024-09-10T22:33:28.375 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:33:28 smithi138 ceph-mon[35236]: scrub summary: idle 2024-09-10T22:33:28.459 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:33:28 smithi019 ceph-mon[31375]: pgmap v558: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 725 KiB/s rd, 286 MiB/s wr, 583 op/s 2024-09-10T22:33:28.459 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:33:28 smithi019 ceph-mon[31375]: scrub summary: idle 2024-09-10T22:33:28.459 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:33:28 smithi019 ceph-mon[31375]: scrub summary: idle 2024-09-10T22:33:29.903 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:29.900+0000 7fe562ff5640 1 -- 172.21.15.19:0/519839908 <== mds.0 v2:172.21.15.135:6838/1254769802 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x560e341ca0f0 con 0x560e342dcc10 2024-09-10T22:33:29.903 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:29.900+0000 7fe562ff5640 10 client.16794 handle_command_reply: tid=0 2024-09-10T22:33:29.903 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:29.900+0000 7fe58808f740 1 client.16794 shutdown 2024-09-10T22:33:29.903 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:29.901+0000 7fe58808f740 1 -- 172.21.15.19:0/519839908 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x560e3425a860 msgr2=0x560e34268f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:33:29.903 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:29.901+0000 7fe58808f740 1 --2- 172.21.15.19:0/519839908 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x560e3425a860 0x560e34268f80 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7fe5700a8300 tx=0x7fe5700b53c0 comp rx=0 tx=0).stop 2024-09-10T22:33:29.903 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:29.901+0000 7fe58808f740 1 -- 172.21.15.19:0/519839908 shutdown_connections 2024-09-10T22:33:29.903 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:29.901+0000 7fe58808f740 1 --2- 172.21.15.19:0/519839908 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x560e342dcc10 0x560e342df000 crc :-1 s=READY pgs=153 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:33:29.903 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:29.901+0000 7fe58808f740 1 --2- 172.21.15.19:0/519839908 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x560e3425fbd0 0x560e3426a1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:33:29.903 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:29.901+0000 7fe58808f740 1 --2- 172.21.15.19:0/519839908 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560e3425d190 0x560e34269620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:33:29.903 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:29.901+0000 7fe58808f740 1 --2- 172.21.15.19:0/519839908 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x560e3425a860 0x560e34268f80 unknown :-1 s=CLOSED pgs=706 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:33:29.904 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:29.901+0000 7fe58808f740 1 -- 172.21.15.19:0/519839908 >> 172.21.15.19:0/519839908 conn(0x560e342559b0 msgr2=0x560e3425ffe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:33:29.904 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:29.901+0000 7fe562ff5640 0 client.16794 ms_handle_reset on v2:172.21.15.135:6838/1254769802 2024-09-10T22:33:29.904 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:29.901+0000 7fe58808f740 1 -- 172.21.15.19:0/519839908 shutdown_connections 2024-09-10T22:33:29.904 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:29.901+0000 7fe58808f740 1 -- 172.21.15.19:0/519839908 wait complete. 2024-09-10T22:33:29.904 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:29.901+0000 7fe58808f740 20 client.16794 trim_cache size 0 max 16384 2024-09-10T22:33:29.904 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stdout:{ 2024-09-10T22:33:29.904 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stdout: "message": "", 2024-09-10T22:33:29.904 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stdout: "return_code": 0 2024-09-10T22:33:29.904 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stdout:} 2024-09-10T22:33:29.905 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:29.902+0000 7fe5852bd640 1 -- 172.21.15.19:0/3849862120 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7fe5680b5360 msgr2=0x7fe5680b7820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:33:29.905 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:29.902+0000 7fe5852bd640 1 --2- 172.21.15.19:0/3849862120 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7fe5680b5360 0x7fe5680b7820 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7fe574009900 tx=0x7fe574000bc0 comp rx=0 tx=0).stop 2024-09-10T22:33:29.905 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:29.902+0000 7fe5852bd640 1 -- 172.21.15.19:0/3849862120 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe580101860 msgr2=0x7fe580105620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:33:29.905 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:29.902+0000 7fe5852bd640 1 --2- 172.21.15.19:0/3849862120 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe580101860 0x7fe580105620 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fe57000d950 tx=0x7fe57000de10 comp rx=0 tx=0).stop 2024-09-10T22:33:29.905 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:29.903+0000 7fe5852bd640 1 -- 172.21.15.19:0/3849862120 shutdown_connections 2024-09-10T22:33:29.905 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:29.903+0000 7fe5852bd640 1 --2- 172.21.15.19:0/3849862120 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7fe5680b5360 0x7fe5680b7820 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:33:29.906 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:29.903+0000 7fe5852bd640 1 --2- 172.21.15.19:0/3849862120 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe580103370 0x7fe5801043c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:33:29.906 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:29.903+0000 7fe5852bd640 1 --2- 172.21.15.19:0/3849862120 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe5801029b0 0x7fe580103e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:33:29.906 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:29.903+0000 7fe5852bd640 1 --2- 172.21.15.19:0/3849862120 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe580101860 0x7fe580105620 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:33:29.906 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:29.903+0000 7fe5852bd640 1 -- 172.21.15.19:0/3849862120 >> 172.21.15.19:0/3849862120 conn(0x7fe5800fd140 msgr2=0x7fe5800febb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:33:29.906 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:29.903+0000 7fe5852bd640 1 -- 172.21.15.19:0/3849862120 shutdown_connections 2024-09-10T22:33:29.906 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:29.903+0000 7fe5852bd640 1 -- 172.21.15.19:0/3849862120 wait complete. 2024-09-10T22:33:30.458 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:33:30 smithi019 ceph-mon[31375]: pgmap v559: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 533 KiB/s rd, 255 MiB/s wr, 506 op/s 2024-09-10T22:33:30.610 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:33:30 smithi135 ceph-mon[34789]: pgmap v559: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 533 KiB/s rd, 255 MiB/s wr, 506 op/s 2024-09-10T22:33:30.625 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:33:30 smithi138 ceph-mon[35236]: pgmap v559: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 533 KiB/s rd, 255 MiB/s wr, 506 op/s 2024-09-10T22:33:32.458 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:33:32 smithi019 ceph-mon[31375]: pgmap v560: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 835 KiB/s rd, 306 MiB/s wr, 625 op/s 2024-09-10T22:33:32.610 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:33:32 smithi135 ceph-mon[34789]: pgmap v560: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 835 KiB/s rd, 306 MiB/s wr, 625 op/s 2024-09-10T22:33:32.625 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:33:32 smithi138 ceph-mon[35236]: pgmap v560: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 835 KiB/s rd, 306 MiB/s wr, 625 op/s 2024-09-10T22:33:34.458 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:33:34 smithi019 ceph-mon[31375]: pgmap v561: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 615 KiB/s rd, 269 MiB/s wr, 550 op/s 2024-09-10T22:33:34.610 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:33:34 smithi135 ceph-mon[34789]: pgmap v561: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 615 KiB/s rd, 269 MiB/s wr, 550 op/s 2024-09-10T22:33:34.625 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:33:34 smithi138 ceph-mon[35236]: pgmap v561: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 615 KiB/s rd, 269 MiB/s wr, 550 op/s 2024-09-10T22:33:36.458 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:33:36 smithi019 ceph-mon[31375]: pgmap v562: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 615 KiB/s rd, 287 MiB/s wr, 548 op/s 2024-09-10T22:33:36.610 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:33:36 smithi135 ceph-mon[34789]: pgmap v562: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 615 KiB/s rd, 287 MiB/s wr, 548 op/s 2024-09-10T22:33:36.625 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:33:36 smithi138 ceph-mon[35236]: pgmap v562: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 615 KiB/s rd, 287 MiB/s wr, 548 op/s 2024-09-10T22:33:38.609 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:33:38 smithi135 ceph-mon[34789]: pgmap v563: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 824 KiB/s rd, 323 MiB/s wr, 547 op/s 2024-09-10T22:33:38.625 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:33:38 smithi138 ceph-mon[35236]: pgmap v563: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 824 KiB/s rd, 323 MiB/s wr, 547 op/s 2024-09-10T22:33:38.708 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:33:38 smithi019 ceph-mon[31375]: pgmap v563: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 824 KiB/s rd, 323 MiB/s wr, 547 op/s 2024-09-10T22:33:40.610 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:33:40 smithi135 ceph-mon[34789]: pgmap v564: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 513 KiB/s rd, 290 MiB/s wr, 456 op/s 2024-09-10T22:33:40.625 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:33:40 smithi138 ceph-mon[35236]: pgmap v564: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 513 KiB/s rd, 290 MiB/s wr, 456 op/s 2024-09-10T22:33:40.708 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:33:40 smithi019 ceph-mon[31375]: pgmap v564: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 513 KiB/s rd, 290 MiB/s wr, 456 op/s 2024-09-10T22:33:42.610 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:33:42 smithi135 ceph-mon[34789]: pgmap v565: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 646 KiB/s rd, 326 MiB/s wr, 581 op/s 2024-09-10T22:33:42.610 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:33:42 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T22:33:42.625 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:33:42 smithi138 ceph-mon[35236]: pgmap v565: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 646 KiB/s rd, 326 MiB/s wr, 581 op/s 2024-09-10T22:33:42.625 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:33:42 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T22:33:42.708 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:33:42 smithi019 ceph-mon[31375]: pgmap v565: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 646 KiB/s rd, 326 MiB/s wr, 581 op/s 2024-09-10T22:33:42.709 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:33:42 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T22:33:43.089 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:43.087+0000 7f7792fe8640 1 -- 172.21.15.19:0/2370050155 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f778c1029b0 msgr2=0x7f778c102e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:33:43.089 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:43.087+0000 7f7792fe8640 1 --2- 172.21.15.19:0/2370050155 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f778c1029b0 0x7f778c102e30 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7f7778009930 tx=0x7f777802a480 comp rx=0 tx=0).stop 2024-09-10T22:33:43.089 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:43.087+0000 7f7792fe8640 1 -- 172.21.15.19:0/2370050155 shutdown_connections 2024-09-10T22:33:43.089 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:43.087+0000 7f7792fe8640 1 --2- 172.21.15.19:0/2370050155 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f778c103370 0x7f778c109cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:33:43.089 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:43.087+0000 7f7792fe8640 1 --2- 172.21.15.19:0/2370050155 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f778c1029b0 0x7f778c102e30 unknown :-1 s=CLOSED pgs=707 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:33:43.089 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:43.087+0000 7f7792fe8640 1 --2- 172.21.15.19:0/2370050155 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f778c101860 0x7f778c101c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:33:43.089 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:43.087+0000 7f7792fe8640 1 -- 172.21.15.19:0/2370050155 >> 172.21.15.19:0/2370050155 conn(0x7f778c0fd140 msgr2=0x7f778c0ff560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:33:43.089 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:43.087+0000 7f7792fe8640 1 -- 172.21.15.19:0/2370050155 shutdown_connections 2024-09-10T22:33:43.089 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:43.087+0000 7f7792fe8640 1 -- 172.21.15.19:0/2370050155 wait complete. 2024-09-10T22:33:43.092 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:43.088+0000 7f7792fe8640 1 Processor -- start 2024-09-10T22:33:43.092 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:43.088+0000 7f7792fe8640 1 -- start start 2024-09-10T22:33:43.093 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:43.089+0000 7f7792fe8640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f778c101860 0x7f778c071cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:33:43.093 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:43.089+0000 7f7792fe8640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f778c1029b0 0x7f778c072320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:33:43.093 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:43.089+0000 7f7792fe8640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f778c103370 0x7f778c072f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:33:43.093 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:43.089+0000 7f7790d84640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f778c101860 0x7f778c071cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:33:43.093 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:43.089+0000 7f7790d84640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f778c101860 0x7f778c071cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:35548/0 (socket says 172.21.15.19:35548) 2024-09-10T22:33:43.093 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:43.089+0000 7f7790d84640 1 -- 172.21.15.19:0/3549970030 learned_addr learned my addr 172.21.15.19:0/3549970030 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:33:43.093 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:43.089+0000 7f778bfff640 1 --2- 172.21.15.19:0/3549970030 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f778c1029b0 0x7f778c072320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:33:43.093 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:43.089+0000 7f7792fe8640 1 -- 172.21.15.19:0/3549970030 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f778c10e6f0 con 0x7f778c101860 2024-09-10T22:33:43.093 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:43.089+0000 7f7792fe8640 1 -- 172.21.15.19:0/3549970030 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f778c10e570 con 0x7f778c1029b0 2024-09-10T22:33:43.093 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:43.089+0000 7f7792fe8640 1 -- 172.21.15.19:0/3549970030 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f778c10e870 con 0x7f778c103370 2024-09-10T22:33:43.093 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:43.090+0000 7f7790d84640 1 -- 172.21.15.19:0/3549970030 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f778c103370 msgr2=0x7f778c072f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:33:43.094 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:43.090+0000 7f7790d84640 1 --2- 172.21.15.19:0/3549970030 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f778c103370 0x7f778c072f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:33:43.094 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:43.090+0000 7f7790d84640 1 -- 172.21.15.19:0/3549970030 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f778c1029b0 msgr2=0x7f778c072320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:33:43.094 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:43.090+0000 7f7790d84640 1 --2- 172.21.15.19:0/3549970030 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f778c1029b0 0x7f778c072320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:33:43.094 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:43.090+0000 7f7790d84640 1 -- 172.21.15.19:0/3549970030 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f778c073810 con 0x7f778c101860 2024-09-10T22:33:43.094 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:43.090+0000 7f7790d84640 1 --2- 172.21.15.19:0/3549970030 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f778c101860 0x7f778c071cd0 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7f778000b450 tx=0x7f778000b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:33:43.094 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:43.090+0000 7f7789ffb640 1 -- 172.21.15.19:0/3549970030 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7780015020 con 0x7f778c101860 2024-09-10T22:33:43.094 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:43.090+0000 7f7789ffb640 1 -- 172.21.15.19:0/3549970030 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7780011d40 con 0x7f778c101860 2024-09-10T22:33:43.094 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:43.090+0000 7f7792fe8640 1 -- 172.21.15.19:0/3549970030 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f778c073b00 con 0x7f778c101860 2024-09-10T22:33:43.094 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:43.091+0000 7f7789ffb640 1 -- 172.21.15.19:0/3549970030 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f778000f340 con 0x7f778c101860 2024-09-10T22:33:43.094 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:43.091+0000 7f7792fe8640 1 -- 172.21.15.19:0/3549970030 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f778c074220 con 0x7f778c101860 2024-09-10T22:33:43.096 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:43.094+0000 7f7795e91740 1 Processor -- start 2024-09-10T22:33:43.097 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:43.094+0000 7f7795e91740 1 -- start start 2024-09-10T22:33:43.097 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:43.095+0000 7f7795e91740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55a10ebe2c70 0x55a10ebe5060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:33:43.097 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:43.095+0000 7f7795e91740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55a10ebe55a0 0x55a10ebe7990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:33:43.097 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:43.095+0000 7f7795e91740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a10ebe7fe0 0x55a10ebea4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:33:43.097 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:43.095+0000 7f7795e91740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x55a10eb506f0 con 0x55a10ebe55a0 2024-09-10T22:33:43.097 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:43.095+0000 7f7795e91740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55a10eb3fb20 con 0x55a10ebe7fe0 2024-09-10T22:33:43.097 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:43.095+0000 7f7795e91740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x55a10eb43930 con 0x55a10ebe2c70 2024-09-10T22:33:43.097 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:43.095+0000 7f778bfff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a10ebe7fe0 0x55a10ebea4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:33:43.097 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:43.095+0000 7f778bfff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a10ebe7fe0 0x55a10ebea4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.19:40440/0 (socket says 172.21.15.19:40440) 2024-09-10T22:33:43.097 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:43.095+0000 7f778bfff640 1 -- 172.21.15.19:0/3672532865 learned_addr learned my addr 172.21.15.19:0/3672532865 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:33:43.097 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:43.095+0000 7f7791585640 1 --2- 172.21.15.19:0/3672532865 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55a10ebe2c70 0x55a10ebe5060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:33:43.098 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:43.096+0000 7f7791585640 1 -- 172.21.15.19:0/3672532865 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a10ebe7fe0 msgr2=0x55a10ebea4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:33:43.098 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:43.096+0000 7f7791585640 1 --2- 172.21.15.19:0/3672532865 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a10ebe7fe0 0x55a10ebea4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:33:43.098 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:43.096+0000 7f7791585640 1 -- 172.21.15.19:0/3672532865 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55a10ebe55a0 msgr2=0x55a10ebe7990 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-10T22:33:43.098 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:43.096+0000 7f7791585640 1 --2- 172.21.15.19:0/3672532865 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55a10ebe55a0 0x55a10ebe7990 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:33:43.098 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:43.096+0000 7f7791585640 1 -- 172.21.15.19:0/3672532865 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a10eb05530 con 0x55a10ebe2c70 2024-09-10T22:33:43.098 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:43.096+0000 7f7791585640 1 --2- 172.21.15.19:0/3672532865 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55a10ebe2c70 0x55a10ebe5060 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f7784009cb0 tx=0x7f778400b7e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=25c761f172c18e5c server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:33:43.099 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:43.097+0000 7f7789ffb640 1 -- 172.21.15.19:0/3549970030 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 18) ==== 153250+0+0 (secure 0 0 0) 0x7f7780010590 con 0x7f778c101860 2024-09-10T22:33:43.099 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:43.097+0000 7f7776ffd640 1 -- 172.21.15.19:0/3672532865 <== mon.1 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7784018070 con 0x55a10ebe2c70 2024-09-10T22:33:43.099 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:43.097+0000 7f7776ffd640 1 -- 172.21.15.19:0/3672532865 <== mon.1 v2:172.21.15.138:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f77840119d0 con 0x55a10ebe2c70 2024-09-10T22:33:43.099 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:43.097+0000 7f7776ffd640 1 -- 172.21.15.19:0/3672532865 <== mon.1 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7784013990 con 0x55a10ebe2c70 2024-09-10T22:33:43.100 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:43.098+0000 7f7789ffb640 1 --2- 172.21.15.19:0/3549970030 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f777c0b53e0 0x7f777c0b78a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:33:43.100 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:43.099+0000 7f7795e91740 1 -- 172.21.15.19:0/3672532865 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55a10ebe2c70 msgr2=0x55a10ebe5060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:33:43.100 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:43.099+0000 7f7795e91740 1 --2- 172.21.15.19:0/3672532865 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55a10ebe2c70 0x55a10ebe5060 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f7784009cb0 tx=0x7f778400b7e0 comp rx=0 tx=0).stop 2024-09-10T22:33:43.100 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:43.099+0000 7f7789ffb640 1 -- 172.21.15.19:0/3549970030 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8327+0+0 (secure 0 0 0) 0x7f77800e5960 con 0x7f778c101860 2024-09-10T22:33:43.101 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:43.099+0000 7f7790d84640 1 --2- 172.21.15.19:0/3549970030 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f777c0b53e0 0x7f777c0b78a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:33:43.101 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:43.100+0000 7f7790d84640 1 --2- 172.21.15.19:0/3549970030 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f777c0b53e0 0x7f777c0b78a0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f7780000c00 tx=0x7f77800b5050 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:33:43.103 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:43.100+0000 7f7795e91740 1 -- 172.21.15.19:0/3672532865 shutdown_connections 2024-09-10T22:33:43.103 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:43.100+0000 7f7795e91740 1 --2- 172.21.15.19:0/3672532865 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a10ebe7fe0 0x55a10ebea4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:33:43.103 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:43.100+0000 7f7795e91740 1 --2- 172.21.15.19:0/3672532865 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55a10ebe55a0 0x55a10ebe7990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:33:43.103 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:43.100+0000 7f7795e91740 1 --2- 172.21.15.19:0/3672532865 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55a10ebe2c70 0x55a10ebe5060 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:33:43.103 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:43.100+0000 7f7795e91740 1 -- 172.21.15.19:0/3672532865 >> 172.21.15.19:0/3672532865 conn(0x55a10ebd99b0 msgr2=0x55a10ebda740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:33:43.103 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:43.101+0000 7f7795e91740 1 -- 172.21.15.19:0/3672532865 shutdown_connections 2024-09-10T22:33:43.103 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:43.101+0000 7f7795e91740 1 -- 172.21.15.19:0/3672532865 wait complete. 2024-09-10T22:33:43.103 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:43.101+0000 7f7795e91740 1 -- start start 2024-09-10T22:33:43.104 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:43.102+0000 7f7795e91740 1 Processor -- start 2024-09-10T22:33:43.107 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:43.102+0000 7f7795e91740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55a10ebe2c70 0x55a10ebec390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:33:43.107 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:43.102+0000 7f7795e91740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55a10ebe55a0 0x55a10ebeca30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:33:43.107 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:43.102+0000 7f7795e91740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a10ebe7fe0 0x55a10ebed600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:33:43.107 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:43.102+0000 7f7795e91740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x55a10ea77ab0 con 0x55a10ebe2c70 2024-09-10T22:33:43.107 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:43.102+0000 7f7795e91740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55a10eae5730 con 0x55a10ebe7fe0 2024-09-10T22:33:43.107 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:43.102+0000 7f7795e91740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x55a10ebeafc0 con 0x55a10ebe55a0 2024-09-10T22:33:43.107 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:43.102+0000 7f7795e91740 10 client.0 _ll_register_callbacks cb 0x55a10eb396b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T22:33:43.107 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:43.103+0000 7f7791585640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55a10ebe2c70 0x55a10ebec390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:33:43.108 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:43.103+0000 7f7791585640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55a10ebe2c70 0x55a10ebec390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:35552/0 (socket says 172.21.15.19:35552) 2024-09-10T22:33:43.108 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:43.103+0000 7f7791585640 1 -- 172.21.15.19:0/2721233759 learned_addr learned my addr 172.21.15.19:0/2721233759 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:33:43.108 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:43.103+0000 7f7791585640 1 --2- 172.21.15.19:0/2721233759 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a10ebe7fe0 0x55a10ebed600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:33:43.108 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:43.103+0000 7f7791585640 1 -- 172.21.15.19:0/2721233759 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55a10ebe55a0 msgr2=0x55a10ebeca30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:33:43.108 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:43.103+0000 7f7791585640 1 --2- 172.21.15.19:0/2721233759 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55a10ebe55a0 0x55a10ebeca30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:33:43.108 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:43.103+0000 7f7791585640 1 -- 172.21.15.19:0/2721233759 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a10ebe7fe0 msgr2=0x55a10ebed600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:33:43.108 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:43.103+0000 7f7791585640 1 --2- 172.21.15.19:0/2721233759 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a10ebe7fe0 0x55a10ebed600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:33:43.108 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:43.103+0000 7f7791585640 1 -- 172.21.15.19:0/2721233759 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a10e8a1790 con 0x55a10ebe2c70 2024-09-10T22:33:43.108 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:43.103+0000 7f7791585640 1 --2- 172.21.15.19:0/2721233759 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55a10ebe2c70 0x55a10ebec390 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7f77840134c0 tx=0x7f7784013410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=745e22c5cf031ed8 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:33:43.108 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:43.103+0000 7f776bfff640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-10T22:33:43.108 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:43.104+0000 7f776bfff640 1 -- 172.21.15.19:0/2721233759 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7784018040 con 0x55a10ebe2c70 2024-09-10T22:33:43.108 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:43.104+0000 7f776bfff640 1 -- 172.21.15.19:0/2721233759 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8327+0+0 (secure 0 0 0) 0x7f7784011dc0 con 0x55a10ebe2c70 2024-09-10T22:33:43.109 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:43.104+0000 7f7795e91740 1 -- 172.21.15.19:0/2721233759 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f77840119d0 con 0x55a10ebe2c70 2024-09-10T22:33:43.109 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:43.104+0000 7f776bfff640 1 -- 172.21.15.19:0/2721233759 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f7784003a10 con 0x55a10ebe2c70 2024-09-10T22:33:43.109 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:43.104+0000 7f7795e91740 10 client.16803 fetch_fsmap learned FSMap version 27 2024-09-10T22:33:43.109 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:43.104+0000 7f7795e91740 1 -- 172.21.15.19:0/2721233759 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55a10e91a620 con 0x55a10ebe2c70 2024-09-10T22:33:43.109 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:43.105+0000 7f776bfff640 1 -- 172.21.15.19:0/2721233759 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f77840119d0 con 0x55a10ebe2c70 2024-09-10T22:33:43.109 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:43.105+0000 7f776bfff640 1 -- 172.21.15.19:0/2721233759 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7f778401e050 con 0x55a10ebe2c70 2024-09-10T22:33:43.109 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:43.105+0000 7f7795e91740 10 client.16803 fetch_fsmap finished waiting for FSMap version 27 2024-09-10T22:33:43.112 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:43.105+0000 7f7795e91740 10 client.16803 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-10T22:33:43.112 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:43.105+0000 7f7795e91740 20 client.16803 populate_metadata read hostname 'smithi019' 2024-09-10T22:33:43.112 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:43.105+0000 7f7795e91740 1 --2- 172.21.15.19:0/2721233759 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x55a10ebf7a70 0x55a10ebf9e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:33:43.113 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:43.105+0000 7f7795e91740 4 client.16803 mds_command: new command op to 24581 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T22:33:43.113 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:43.105+0000 7f7795e91740 1 -- 172.21.15.19:0/2721233759 --> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a10eb52640 con 0x55a10ebf7a70 2024-09-10T22:33:43.113 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:43.105+0000 7f778bfff640 1 --2- 172.21.15.19:0/2721233759 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x55a10ebf7a70 0x55a10ebf9e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:33:43.113 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:43.105+0000 7f776bfff640 10 client.16803 ms_handle_connect on v2:172.21.15.135:6838/1254769802 2024-09-10T22:33:43.113 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:43.105+0000 7f778bfff640 1 --2- 172.21.15.19:0/2721233759 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x55a10ebf7a70 0x55a10ebf9e60 crc :-1 s=READY pgs=154 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ed1eb56841b86d6c server_cookie=a09f429fed23928d in_seq=0 out_seq=0 2024-09-10T22:33:43.114 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:43.106+0000 7f776bfff640 1 -- 172.21.15.19:0/2721233759 <== mds.0 v2:172.21.15.135:6838/1254769802 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55a10eb52640 con 0x55a10ebf7a70 2024-09-10T22:33:43.114 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:43.106+0000 7f776bfff640 10 client.16803 handle_command_reply: tid=0 2024-09-10T22:33:43.114 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:43.106+0000 7f7795e91740 1 client.16803 shutdown 2024-09-10T22:33:43.114 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:43.106+0000 7f7795e91740 1 -- 172.21.15.19:0/2721233759 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55a10ebe2c70 msgr2=0x55a10ebec390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:33:43.115 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:43.106+0000 7f7795e91740 1 --2- 172.21.15.19:0/2721233759 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55a10ebe2c70 0x55a10ebec390 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7f77840134c0 tx=0x7f7784013410 comp rx=0 tx=0).stop 2024-09-10T22:33:43.115 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:43.106+0000 7f7795e91740 1 -- 172.21.15.19:0/2721233759 shutdown_connections 2024-09-10T22:33:43.115 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:43.106+0000 7f7795e91740 1 --2- 172.21.15.19:0/2721233759 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a10ebe7fe0 0x55a10ebed600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:33:43.115 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:43.106+0000 7f7795e91740 1 --2- 172.21.15.19:0/2721233759 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x55a10ebf7a70 0x55a10ebf9e60 crc :-1 s=READY pgs=154 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:33:43.115 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:43.106+0000 7f776bfff640 0 client.16803 ms_handle_reset on v2:172.21.15.135:6838/1254769802 2024-09-10T22:33:43.115 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:43.106+0000 7f7795e91740 1 --2- 172.21.15.19:0/2721233759 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55a10ebe55a0 0x55a10ebeca30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:33:43.115 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:43.106+0000 7f7795e91740 1 --2- 172.21.15.19:0/2721233759 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55a10ebe2c70 0x55a10ebec390 unknown :-1 s=CLOSED pgs=709 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:33:43.115 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:43.106+0000 7f7795e91740 1 -- 172.21.15.19:0/2721233759 >> 172.21.15.19:0/2721233759 conn(0x55a10ebd99b0 msgr2=0x55a10ebd8bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:33:43.115 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:43.107+0000 7f7795e91740 1 -- 172.21.15.19:0/2721233759 shutdown_connections 2024-09-10T22:33:43.115 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:43.107+0000 7f7795e91740 1 -- 172.21.15.19:0/2721233759 wait complete. 2024-09-10T22:33:43.115 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:43.108+0000 7f7795e91740 20 client.16803 trim_cache size 0 max 16384 2024-09-10T22:33:43.128 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:43.124+0000 7f7795e91740 1 Processor -- start 2024-09-10T22:33:43.129 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:43.124+0000 7f7795e91740 1 -- start start 2024-09-10T22:33:43.129 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:43.125+0000 7f7795e91740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55a10ebe2c70 0x55a10ebddd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:33:43.129 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:43.125+0000 7f7795e91740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55a10ebe55a0 0x55a10ebde2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:33:43.129 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:43.125+0000 7f7795e91740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a10ebe7fe0 0x55a10ebe83c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:33:43.129 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:43.125+0000 7f7795e91740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f778c1b31e0 con 0x55a10ebe2c70 2024-09-10T22:33:43.129 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:43.125+0000 7f7795e91740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f778c1b0ab0 con 0x55a10ebe7fe0 2024-09-10T22:33:43.129 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:43.125+0000 7f7795e91740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f778c1ae900 con 0x55a10ebe55a0 2024-09-10T22:33:43.129 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:43.125+0000 7f7791585640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55a10ebe2c70 0x55a10ebddd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:33:43.130 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:43.125+0000 7f7791585640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55a10ebe2c70 0x55a10ebddd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:35562/0 (socket says 172.21.15.19:35562) 2024-09-10T22:33:43.130 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:43.125+0000 7f7791585640 1 -- 172.21.15.19:0/1559042540 learned_addr learned my addr 172.21.15.19:0/1559042540 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:33:43.130 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:43.125+0000 7f778bfff640 1 --2- 172.21.15.19:0/1559042540 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55a10ebe55a0 0x55a10ebde2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:33:43.130 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:43.125+0000 7f7791585640 1 -- 172.21.15.19:0/1559042540 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55a10ebe55a0 msgr2=0x55a10ebde2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:33:43.130 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:43.125+0000 7f7791585640 1 --2- 172.21.15.19:0/1559042540 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55a10ebe55a0 0x55a10ebde2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:33:43.130 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:43.125+0000 7f7791585640 1 -- 172.21.15.19:0/1559042540 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a10ebe7fe0 msgr2=0x55a10ebe83c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:33:43.130 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:43.125+0000 7f7791585640 1 --2- 172.21.15.19:0/1559042540 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a10ebe7fe0 0x55a10ebe83c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:33:43.130 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:43.125+0000 7f7791585640 1 -- 172.21.15.19:0/1559042540 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a10ebfa1d0 con 0x55a10ebe2c70 2024-09-10T22:33:43.130 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:43.125+0000 7f7791585640 1 --2- 172.21.15.19:0/1559042540 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55a10ebe2c70 0x55a10ebddd80 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7f77840094a0 tx=0x7f778402b5e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2b57bc8e6cda1c73 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:33:43.130 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:43.125+0000 7f77767fc640 1 -- 172.21.15.19:0/1559042540 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7784018040 con 0x55a10ebe2c70 2024-09-10T22:33:43.131 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:43.126+0000 7f77767fc640 1 -- 172.21.15.19:0/1559042540 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7784009e60 con 0x55a10ebe2c70 2024-09-10T22:33:43.131 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:43.126+0000 7f77767fc640 1 -- 172.21.15.19:0/1559042540 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77840347c0 con 0x55a10ebe2c70 2024-09-10T22:33:43.131 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:43.126+0000 7f7795e91740 1 -- 172.21.15.19:0/1559042540 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55a10ebe2c70 msgr2=0x55a10ebddd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:33:43.131 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:43.126+0000 7f7795e91740 1 --2- 172.21.15.19:0/1559042540 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55a10ebe2c70 0x55a10ebddd80 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7f77840094a0 tx=0x7f778402b5e0 comp rx=0 tx=0).stop 2024-09-10T22:33:43.131 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:43.126+0000 7f7795e91740 1 -- 172.21.15.19:0/1559042540 shutdown_connections 2024-09-10T22:33:43.131 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:43.126+0000 7f7795e91740 1 --2- 172.21.15.19:0/1559042540 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a10ebe7fe0 0x55a10ebe83c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:33:43.131 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:43.126+0000 7f7795e91740 1 --2- 172.21.15.19:0/1559042540 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55a10ebe55a0 0x55a10ebde2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:33:43.131 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:43.126+0000 7f7795e91740 1 --2- 172.21.15.19:0/1559042540 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55a10ebe2c70 0x55a10ebddd80 unknown :-1 s=CLOSED pgs=710 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:33:43.131 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:43.127+0000 7f7795e91740 1 -- 172.21.15.19:0/1559042540 >> 172.21.15.19:0/1559042540 conn(0x55a10ebd99b0 msgr2=0x55a10ebda5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:33:43.131 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:43.127+0000 7f7795e91740 1 -- 172.21.15.19:0/1559042540 shutdown_connections 2024-09-10T22:33:43.131 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:43.127+0000 7f7795e91740 1 -- 172.21.15.19:0/1559042540 wait complete. 2024-09-10T22:33:43.131 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:43.127+0000 7f7795e91740 1 -- start start 2024-09-10T22:33:43.131 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:43.127+0000 7f7795e91740 1 Processor -- start 2024-09-10T22:33:43.135 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:43.128+0000 7f7795e91740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55a10ebe2c70 0x55a10ebf1010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:33:43.135 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:43.128+0000 7f7795e91740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a10ebe55a0 0x55a10ebf16b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:33:43.135 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:43.128+0000 7f7795e91740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55a10ebe7fe0 0x55a10ebf2230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:33:43.135 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:43.128+0000 7f7795e91740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f778c1aef70 con 0x55a10ebe7fe0 2024-09-10T22:33:43.135 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:43.128+0000 7f7795e91740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f778c1b03e0 con 0x55a10ebe55a0 2024-09-10T22:33:43.135 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:43.128+0000 7f7795e91740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f778c1af640 con 0x55a10ebe2c70 2024-09-10T22:33:43.136 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:43.128+0000 7f7795e91740 10 client.0 _ll_register_callbacks cb 0x7f7784016070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T22:33:43.136 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:43.128+0000 7f7791585640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55a10ebe7fe0 0x55a10ebf2230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:33:43.136 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:43.128+0000 7f7791585640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55a10ebe7fe0 0x55a10ebf2230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:35576/0 (socket says 172.21.15.19:35576) 2024-09-10T22:33:43.136 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:43.128+0000 7f7791585640 1 -- 172.21.15.19:0/4248403107 learned_addr learned my addr 172.21.15.19:0/4248403107 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:33:43.136 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:43.128+0000 7f778bfff640 1 --2- 172.21.15.19:0/4248403107 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a10ebe55a0 0x55a10ebf16b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:33:43.136 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:43.128+0000 7f7791585640 1 --2- 172.21.15.19:0/4248403107 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55a10ebe2c70 0x55a10ebf1010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:33:43.136 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:43.128+0000 7f778bfff640 1 -- 172.21.15.19:0/4248403107 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55a10ebe2c70 msgr2=0x55a10ebf1010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:33:43.136 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:43.128+0000 7f778bfff640 1 --2- 172.21.15.19:0/4248403107 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55a10ebe2c70 0x55a10ebf1010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:33:43.136 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:43.128+0000 7f778bfff640 1 -- 172.21.15.19:0/4248403107 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55a10ebe7fe0 msgr2=0x55a10ebf2230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:33:43.136 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:43.128+0000 7f778bfff640 1 --2- 172.21.15.19:0/4248403107 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55a10ebe7fe0 0x55a10ebf2230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:33:43.136 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:43.128+0000 7f778bfff640 1 -- 172.21.15.19:0/4248403107 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a10ebf2a60 con 0x55a10ebe55a0 2024-09-10T22:33:43.136 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:43.128+0000 7f778bfff640 1 --2- 172.21.15.19:0/4248403107 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a10ebe55a0 0x55a10ebf16b0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f7778005ec0 tx=0x7f777802aa20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d4f966f0afc87f9d server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:33:43.137 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:43.128+0000 7f776bfff640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-09-10T22:33:43.137 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:43.129+0000 7f776bfff640 1 -- 172.21.15.19:0/4248403107 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7778035020 con 0x55a10ebe55a0 2024-09-10T22:33:43.137 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:43.129+0000 7f776bfff640 1 -- 172.21.15.19:0/4248403107 <== mon.2 v2:172.21.15.135:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8327+0+0 (secure 0 0 0) 0x7f7778004040 con 0x55a10ebe55a0 2024-09-10T22:33:43.137 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:43.129+0000 7f7795e91740 1 -- 172.21.15.19:0/4248403107 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7784009e60 con 0x55a10ebe55a0 2024-09-10T22:33:43.137 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:43.129+0000 7f776bfff640 1 -- 172.21.15.19:0/4248403107 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f7778004260 con 0x55a10ebe55a0 2024-09-10T22:33:43.137 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:43.129+0000 7f7795e91740 10 client.26156 fetch_fsmap learned FSMap version 27 2024-09-10T22:33:43.137 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:43.129+0000 7f7795e91740 1 -- 172.21.15.19:0/4248403107 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55a10ebf3ea0 con 0x55a10ebe55a0 2024-09-10T22:33:43.137 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:43.129+0000 7f776bfff640 1 -- 172.21.15.19:0/4248403107 <== mon.2 v2:172.21.15.135:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7784009e60 con 0x55a10ebe55a0 2024-09-10T22:33:43.137 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:43.129+0000 7f776bfff640 1 -- 172.21.15.19:0/4248403107 <== mon.2 v2:172.21.15.135:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7f7778056050 con 0x55a10ebe55a0 2024-09-10T22:33:43.137 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:43.129+0000 7f7795e91740 10 client.26156 fetch_fsmap finished waiting for FSMap version 27 2024-09-10T22:33:43.137 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:43.129+0000 7f7795e91740 10 client.26156 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-10T22:33:43.138 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:43.129+0000 7f7795e91740 20 client.26156 populate_metadata read hostname 'smithi019' 2024-09-10T22:33:43.138 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:43.129+0000 7f7795e91740 1 --2- 172.21.15.19:0/4248403107 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x55a10ec64af0 0x55a10ec66ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:33:43.138 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:43.129+0000 7f7795e91740 4 client.26156 mds_command: new command op to 24581 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-10T22:33:43.138 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:43.129+0000 7f7795e91740 1 -- 172.21.15.19:0/4248403107 --> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55a10eb4e0f0 con 0x55a10ec64af0 2024-09-10T22:33:43.138 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:43.130+0000 7f7791585640 1 --2- 172.21.15.19:0/4248403107 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x55a10ec64af0 0x55a10ec66ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:33:43.138 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:43.130+0000 7f776bfff640 10 client.26156 ms_handle_connect on v2:172.21.15.135:6838/1254769802 2024-09-10T22:33:43.138 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:43.130+0000 7f7791585640 1 --2- 172.21.15.19:0/4248403107 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x55a10ec64af0 0x55a10ec66ee0 crc :-1 s=READY pgs=155 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=423c7d4d999c2b71 server_cookie=5403c527b6fbd257 in_seq=0 out_seq=0 2024-09-10T22:33:43.459 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:33:43 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-10T22:33:43.459 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:33:43 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:smithi135", "name": "osd_memory_target"} : dispatch 2024-09-10T22:33:43.459 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:33:43 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-09-10T22:33:43.459 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:33:43 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd='[{"prefix": "config rm", "who": "osd/host:smithi135", "name": "osd_memory_target"}]': finished 2024-09-10T22:33:43.459 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:33:43 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"} : dispatch 2024-09-10T22:33:43.459 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:33:43 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"} : dispatch 2024-09-10T22:33:43.459 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:33:43 smithi019 ceph-mon[31375]: Adjusting osd_memory_target on smithi138 to 176.0M 2024-09-10T22:33:43.459 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:33:43 smithi019 ceph-mon[31375]: Unable to set osd_memory_target on smithi138 to 184574566: error parsing value: Value '184574566' is below minimum 939524096 2024-09-10T22:33:43.459 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:33:43 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-10T22:33:43.459 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:33:43 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-09-10T22:33:43.460 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:33:43 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2024-09-10T22:33:43.460 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:33:43 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"} : dispatch 2024-09-10T22:33:43.460 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:33:43 smithi019 ceph-mon[31375]: Adjusting osd_memory_target on smithi019 to 177.0M 2024-09-10T22:33:43.460 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:33:43 smithi019 ceph-mon[31375]: Unable to set osd_memory_target on smithi019 to 185686323: error parsing value: Value '185686323' is below minimum 939524096 2024-09-10T22:33:43.460 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:33:43 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T22:33:43.460 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:33:43 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T22:33:43.460 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:33:43 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:33:43.460 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:33:43 smithi019 ceph-mon[31375]: pgmap v566: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 455 KiB/s rd, 282 MiB/s wr, 510 op/s 2024-09-10T22:33:43.610 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:33:43 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-10T22:33:43.610 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:33:43 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:smithi135", "name": "osd_memory_target"} : dispatch 2024-09-10T22:33:43.610 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:33:43 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-09-10T22:33:43.610 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:33:43 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd='[{"prefix": "config rm", "who": "osd/host:smithi135", "name": "osd_memory_target"}]': finished 2024-09-10T22:33:43.611 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:33:43 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"} : dispatch 2024-09-10T22:33:43.611 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:33:43 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"} : dispatch 2024-09-10T22:33:43.611 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:33:43 smithi135 ceph-mon[34789]: Adjusting osd_memory_target on smithi138 to 176.0M 2024-09-10T22:33:43.611 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:33:43 smithi135 ceph-mon[34789]: Unable to set osd_memory_target on smithi138 to 184574566: error parsing value: Value '184574566' is below minimum 939524096 2024-09-10T22:33:43.611 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:33:43 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-10T22:33:43.611 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:33:43 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-09-10T22:33:43.611 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:33:43 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2024-09-10T22:33:43.611 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:33:43 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"} : dispatch 2024-09-10T22:33:43.611 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:33:43 smithi135 ceph-mon[34789]: Adjusting osd_memory_target on smithi019 to 177.0M 2024-09-10T22:33:43.611 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:33:43 smithi135 ceph-mon[34789]: Unable to set osd_memory_target on smithi019 to 185686323: error parsing value: Value '185686323' is below minimum 939524096 2024-09-10T22:33:43.611 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:33:43 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T22:33:43.611 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:33:43 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T22:33:43.612 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:33:43 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:33:43.612 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:33:43 smithi135 ceph-mon[34789]: pgmap v566: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 455 KiB/s rd, 282 MiB/s wr, 510 op/s 2024-09-10T22:33:43.625 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:33:43 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-10T22:33:43.625 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:33:43 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:smithi135", "name": "osd_memory_target"} : dispatch 2024-09-10T22:33:43.625 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:33:43 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-09-10T22:33:43.625 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:33:43 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd='[{"prefix": "config rm", "who": "osd/host:smithi135", "name": "osd_memory_target"}]': finished 2024-09-10T22:33:43.625 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:33:43 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"} : dispatch 2024-09-10T22:33:43.626 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:33:43 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"} : dispatch 2024-09-10T22:33:43.626 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:33:43 smithi138 ceph-mon[35236]: Adjusting osd_memory_target on smithi138 to 176.0M 2024-09-10T22:33:43.626 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:33:43 smithi138 ceph-mon[35236]: Unable to set osd_memory_target on smithi138 to 184574566: error parsing value: Value '184574566' is below minimum 939524096 2024-09-10T22:33:43.626 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:33:43 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-10T22:33:43.626 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:33:43 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-09-10T22:33:43.626 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:33:43 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2024-09-10T22:33:43.626 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:33:43 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"} : dispatch 2024-09-10T22:33:43.626 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:33:43 smithi138 ceph-mon[35236]: Adjusting osd_memory_target on smithi019 to 177.0M 2024-09-10T22:33:43.627 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:33:43 smithi138 ceph-mon[35236]: Unable to set osd_memory_target on smithi019 to 185686323: error parsing value: Value '185686323' is below minimum 939524096 2024-09-10T22:33:43.627 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:33:43 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T22:33:43.627 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:33:43 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T22:33:43.627 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:33:43 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:33:43.627 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:33:43 smithi138 ceph-mon[35236]: pgmap v566: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 455 KiB/s rd, 282 MiB/s wr, 510 op/s 2024-09-10T22:33:45.875 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:33:45 smithi138 ceph-mon[35236]: pgmap v567: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 455 KiB/s rd, 283 MiB/s wr, 544 op/s 2024-09-10T22:33:45.958 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:33:45 smithi019 ceph-mon[31375]: pgmap v567: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 455 KiB/s rd, 283 MiB/s wr, 544 op/s 2024-09-10T22:33:46.110 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:33:45 smithi135 ceph-mon[34789]: pgmap v567: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 455 KiB/s rd, 283 MiB/s wr, 544 op/s 2024-09-10T22:33:47.958 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:33:47 smithi019 ceph-mon[31375]: pgmap v568: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 718 KiB/s rd, 297 MiB/s wr, 659 op/s 2024-09-10T22:33:48.109 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:33:47 smithi135 ceph-mon[34789]: pgmap v568: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 718 KiB/s rd, 297 MiB/s wr, 659 op/s 2024-09-10T22:33:48.125 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:33:47 smithi138 ceph-mon[35236]: pgmap v568: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 718 KiB/s rd, 297 MiB/s wr, 659 op/s 2024-09-10T22:33:49.958 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:33:49 smithi019 ceph-mon[31375]: pgmap v569: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 507 KiB/s rd, 244 MiB/s wr, 644 op/s 2024-09-10T22:33:50.110 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:33:49 smithi135 ceph-mon[34789]: pgmap v569: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 507 KiB/s rd, 244 MiB/s wr, 644 op/s 2024-09-10T22:33:50.125 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:33:49 smithi138 ceph-mon[35236]: pgmap v569: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 507 KiB/s rd, 244 MiB/s wr, 644 op/s 2024-09-10T22:33:50.469 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:50.464+0000 7f776bfff640 1 -- 172.21.15.19:0/4248403107 <== mds.0 v2:172.21.15.135:6838/1254769802 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55a10eb4e0f0 con 0x55a10ec64af0 2024-09-10T22:33:50.469 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:50.464+0000 7f776bfff640 10 client.26156 handle_command_reply: tid=0 2024-09-10T22:33:50.469 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:50.464+0000 7f7795e91740 1 client.26156 shutdown 2024-09-10T22:33:50.469 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:50.465+0000 7f7795e91740 1 -- 172.21.15.19:0/4248403107 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a10ebe55a0 msgr2=0x55a10ebf16b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:33:50.470 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:50.465+0000 7f7795e91740 1 --2- 172.21.15.19:0/4248403107 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a10ebe55a0 0x55a10ebf16b0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f7778005ec0 tx=0x7f777802aa20 comp rx=0 tx=0).stop 2024-09-10T22:33:50.470 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:50.465+0000 7f7795e91740 1 -- 172.21.15.19:0/4248403107 shutdown_connections 2024-09-10T22:33:50.470 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:50.465+0000 7f7795e91740 1 --2- 172.21.15.19:0/4248403107 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55a10ebe7fe0 0x55a10ebf2230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:33:50.470 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:50.465+0000 7f7795e91740 1 --2- 172.21.15.19:0/4248403107 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a10ebe55a0 0x55a10ebf16b0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:33:50.470 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:50.465+0000 7f7795e91740 1 --2- 172.21.15.19:0/4248403107 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x55a10ec64af0 0x55a10ec66ee0 crc :-1 s=READY pgs=155 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:33:50.470 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:50.465+0000 7f7795e91740 1 --2- 172.21.15.19:0/4248403107 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55a10ebe2c70 0x55a10ebf1010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:33:50.470 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:50.465+0000 7f776bfff640 0 client.26156 ms_handle_reset on v2:172.21.15.135:6838/1254769802 2024-09-10T22:33:50.470 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:50.465+0000 7f7795e91740 1 -- 172.21.15.19:0/4248403107 >> 172.21.15.19:0/4248403107 conn(0x55a10ebd99b0 msgr2=0x55a10ebddcf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:33:50.470 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:50.465+0000 7f7795e91740 1 -- 172.21.15.19:0/4248403107 shutdown_connections 2024-09-10T22:33:50.470 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:50.465+0000 7f7795e91740 1 -- 172.21.15.19:0/4248403107 wait complete. 2024-09-10T22:33:50.470 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:50.465+0000 7f7795e91740 20 client.26156 trim_cache size 0 max 16384 2024-09-10T22:33:50.471 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stdout:{ 2024-09-10T22:33:50.471 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stdout: "message": "", 2024-09-10T22:33:50.471 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stdout: "return_code": 0 2024-09-10T22:33:50.471 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stdout:} 2024-09-10T22:33:50.472 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:50.466+0000 7f7792fe8640 1 -- 172.21.15.19:0/3549970030 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f777c0b53e0 msgr2=0x7f777c0b78a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:33:50.472 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:50.466+0000 7f7792fe8640 1 --2- 172.21.15.19:0/3549970030 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f777c0b53e0 0x7f777c0b78a0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f7780000c00 tx=0x7f77800b5050 comp rx=0 tx=0).stop 2024-09-10T22:33:50.472 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:50.466+0000 7f7792fe8640 1 -- 172.21.15.19:0/3549970030 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f778c101860 msgr2=0x7f778c071cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:33:50.472 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:50.466+0000 7f7792fe8640 1 --2- 172.21.15.19:0/3549970030 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f778c101860 0x7f778c071cd0 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7f778000b450 tx=0x7f778000b910 comp rx=0 tx=0).stop 2024-09-10T22:33:50.472 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:50.466+0000 7f7792fe8640 1 -- 172.21.15.19:0/3549970030 shutdown_connections 2024-09-10T22:33:50.472 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:50.466+0000 7f7792fe8640 1 --2- 172.21.15.19:0/3549970030 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f777c0b53e0 0x7f777c0b78a0 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:33:50.472 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:50.466+0000 7f7792fe8640 1 --2- 172.21.15.19:0/3549970030 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f778c103370 0x7f778c072f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:33:50.472 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:50.466+0000 7f7792fe8640 1 --2- 172.21.15.19:0/3549970030 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f778c1029b0 0x7f778c072320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:33:50.473 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:50.466+0000 7f7792fe8640 1 --2- 172.21.15.19:0/3549970030 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f778c101860 0x7f778c071cd0 unknown :-1 s=CLOSED pgs=708 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:33:50.473 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:50.466+0000 7f7792fe8640 1 -- 172.21.15.19:0/3549970030 >> 172.21.15.19:0/3549970030 conn(0x7f778c0fd140 msgr2=0x7f778c105e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:33:50.473 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:50.466+0000 7f7792fe8640 1 -- 172.21.15.19:0/3549970030 shutdown_connections 2024-09-10T22:33:50.473 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:33:50.466+0000 7f7792fe8640 1 -- 172.21.15.19:0/3549970030 wait complete. 2024-09-10T22:33:51.960 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:33:51 smithi019 ceph-mon[31375]: pgmap v570: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 715 KiB/s rd, 274 MiB/s wr, 774 op/s 2024-09-10T22:33:52.112 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:33:51 smithi135 ceph-mon[34789]: pgmap v570: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 715 KiB/s rd, 274 MiB/s wr, 774 op/s 2024-09-10T22:33:52.125 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:33:51 smithi138 ceph-mon[35236]: pgmap v570: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 715 KiB/s rd, 274 MiB/s wr, 774 op/s 2024-09-10T22:33:53.708 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:33:53 smithi019 ceph-mon[31375]: pgmap v571: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 582 KiB/s rd, 235 MiB/s wr, 654 op/s 2024-09-10T22:33:54.110 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:33:53 smithi135 ceph-mon[34789]: pgmap v571: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 582 KiB/s rd, 235 MiB/s wr, 654 op/s 2024-09-10T22:33:54.125 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:33:53 smithi138 ceph-mon[35236]: pgmap v571: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 582 KiB/s rd, 235 MiB/s wr, 654 op/s 2024-09-10T22:33:54.965 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 22997a4c-6fc2-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-10T22:33:55.337 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/22997a4c-6fc2-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T22:33:55.967 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:33:55 smithi019 ceph-mon[31375]: pgmap v572: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 471 KiB/s rd, 239 MiB/s wr, 648 op/s 2024-09-10T22:33:55.971 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:55.955+0000 7f108969e640 1 -- 172.21.15.19:0/3976047251 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1084104e40 msgr2=0x7f108410e860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:33:55.971 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:55.955+0000 7f108969e640 1 --2- 172.21.15.19:0/3976047251 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1084104e40 0x7f108410e860 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7f107c009ca0 tx=0x7f107c02a8c0 comp rx=0 tx=0).stop 2024-09-10T22:33:55.971 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:55.955+0000 7f108969e640 1 -- 172.21.15.19:0/3976047251 shutdown_connections 2024-09-10T22:33:55.971 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:55.955+0000 7f108969e640 1 --2- 172.21.15.19:0/3976047251 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1084104e40 0x7f108410e860 unknown :-1 s=CLOSED pgs=711 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:33:55.971 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:55.955+0000 7f108969e640 1 --2- 172.21.15.19:0/3976047251 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f10841044a0 0x7f1084104900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:33:55.971 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:55.955+0000 7f108969e640 1 --2- 172.21.15.19:0/3976047251 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f10841023c0 0x7f10841027a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:33:55.972 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:55.955+0000 7f108969e640 1 -- 172.21.15.19:0/3976047251 >> 172.21.15.19:0/3976047251 conn(0x7f1084078140 msgr2=0x7f10840ff530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:33:55.972 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:55.955+0000 7f108969e640 1 -- 172.21.15.19:0/3976047251 shutdown_connections 2024-09-10T22:33:55.972 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:55.955+0000 7f108969e640 1 -- 172.21.15.19:0/3976047251 wait complete. 2024-09-10T22:33:55.972 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:55.955+0000 7f108969e640 1 Processor -- start 2024-09-10T22:33:55.972 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:55.956+0000 7f108969e640 1 -- start start 2024-09-10T22:33:55.972 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:55.956+0000 7f108969e640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f10841023c0 0x7f1084197e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:33:55.972 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:55.956+0000 7f108969e640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f10841044a0 0x7f1084198390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:33:55.972 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:55.956+0000 7f108969e640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1084104e40 0x7f10841988d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:33:55.972 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:55.956+0000 7f108969e640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f1084111cd0 con 0x7f10841044a0 2024-09-10T22:33:55.972 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:55.956+0000 7f108969e640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f1084111b50 con 0x7f1084104e40 2024-09-10T22:33:55.972 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:55.956+0000 7f108969e640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f1084111e50 con 0x7f10841023c0 2024-09-10T22:33:55.972 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:55.956+0000 7f107bfff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f10841044a0 0x7f1084198390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:33:55.973 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:55.956+0000 7f10837fe640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1084104e40 0x7f10841988d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:33:55.973 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:55.956+0000 7f10837fe640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1084104e40 0x7f10841988d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.19:33160/0 (socket says 172.21.15.19:33160) 2024-09-10T22:33:55.973 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:55.956+0000 7f107bfff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f10841044a0 0x7f1084198390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:41988/0 (socket says 172.21.15.19:41988) 2024-09-10T22:33:55.973 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:55.956+0000 7f10837fe640 1 -- 172.21.15.19:0/3957538794 learned_addr learned my addr 172.21.15.19:0/3957538794 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:33:55.973 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:55.956+0000 7f1082ffd640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f10841023c0 0x7f1084197e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:33:55.973 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:55.956+0000 7f107bfff640 1 -- 172.21.15.19:0/3957538794 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f10841023c0 msgr2=0x7f1084197e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:33:55.973 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:55.956+0000 7f107bfff640 1 --2- 172.21.15.19:0/3957538794 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f10841023c0 0x7f1084197e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:33:55.973 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:55.956+0000 7f107bfff640 1 -- 172.21.15.19:0/3957538794 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1084104e40 msgr2=0x7f10841988d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:33:55.973 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:55.956+0000 7f107bfff640 1 --2- 172.21.15.19:0/3957538794 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1084104e40 0x7f10841988d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:33:55.973 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:55.956+0000 7f107bfff640 1 -- 172.21.15.19:0/3957538794 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f10841a7630 con 0x7f10841044a0 2024-09-10T22:33:55.973 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:55.956+0000 7f107bfff640 1 --2- 172.21.15.19:0/3957538794 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f10841044a0 0x7f1084198390 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7f106c00e9f0 tx=0x7f106c00eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:33:55.973 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:55.957+0000 7f1080ff9640 1 -- 172.21.15.19:0/3957538794 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f106c00ccc0 con 0x7f10841044a0 2024-09-10T22:33:55.973 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:55.957+0000 7f1080ff9640 1 -- 172.21.15.19:0/3957538794 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f106c0108e0 con 0x7f10841044a0 2024-09-10T22:33:55.974 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:55.957+0000 7f1080ff9640 1 -- 172.21.15.19:0/3957538794 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f106c018880 con 0x7f10841044a0 2024-09-10T22:33:55.974 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:55.957+0000 7f108969e640 1 -- 172.21.15.19:0/3957538794 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f10841a7920 con 0x7f10841044a0 2024-09-10T22:33:55.974 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:55.957+0000 7f108969e640 1 -- 172.21.15.19:0/3957538794 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f10841a7e10 con 0x7f10841044a0 2024-09-10T22:33:55.974 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:55.961+0000 7f108ba73740 1 Processor -- start 2024-09-10T22:33:55.974 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:55.961+0000 7f108ba73740 1 -- start start 2024-09-10T22:33:55.974 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:55.961+0000 7f108ba73740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x563e3afae480 0x563e3afae860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:33:55.974 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:55.961+0000 7f1080ff9640 1 -- 172.21.15.19:0/3957538794 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 18) ==== 153250+0+0 (secure 0 0 0) 0x7f106c010430 con 0x7f10841044a0 2024-09-10T22:33:55.974 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:55.961+0000 7f108ba73740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563e3afaeda0 0x563e3afba7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:33:55.974 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:55.961+0000 7f108ba73740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x563e3afbad30 0x563e3afbd120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:33:55.974 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:55.961+0000 7f108ba73740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x563e3af24e50 con 0x563e3afbad30 2024-09-10T22:33:55.974 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:55.961+0000 7f108ba73740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x563e3af14280 con 0x563e3afaeda0 2024-09-10T22:33:55.974 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:55.961+0000 7f108ba73740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x563e3af18090 con 0x563e3afae480 2024-09-10T22:33:55.975 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:55.962+0000 7f10837fe640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x563e3afae480 0x563e3afae860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:33:55.975 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:55.962+0000 7f10837fe640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x563e3afae480 0x563e3afae860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.19:56980/0 (socket says 172.21.15.19:56980) 2024-09-10T22:33:55.975 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:55.962+0000 7f10837fe640 1 -- 172.21.15.19:0/1689091757 learned_addr learned my addr 172.21.15.19:0/1689091757 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:33:55.975 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:55.962+0000 7f107bfff640 1 --2- 172.21.15.19:0/1689091757 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x563e3afbad30 0x563e3afbd120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:33:55.975 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:55.962+0000 7f1082ffd640 1 --2- 172.21.15.19:0/1689091757 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563e3afaeda0 0x563e3afba7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:33:55.975 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:55.962+0000 7f10837fe640 1 -- 172.21.15.19:0/1689091757 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563e3afaeda0 msgr2=0x563e3afba7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:33:55.975 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:55.962+0000 7f10837fe640 1 --2- 172.21.15.19:0/1689091757 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563e3afaeda0 0x563e3afba7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:33:55.975 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:55.962+0000 7f10837fe640 1 -- 172.21.15.19:0/1689091757 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x563e3afbad30 msgr2=0x563e3afbd120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:33:55.975 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:55.962+0000 7f10837fe640 1 --2- 172.21.15.19:0/1689091757 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x563e3afbad30 0x563e3afbd120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:33:55.975 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:55.962+0000 7f10837fe640 1 -- 172.21.15.19:0/1689091757 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563e3ac72650 con 0x563e3afae480 2024-09-10T22:33:55.975 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:55.962+0000 7f107bfff640 1 --2- 172.21.15.19:0/1689091757 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x563e3afbad30 0x563e3afbd120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T22:33:55.975 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:55.962+0000 7f10837fe640 1 --2- 172.21.15.19:0/1689091757 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x563e3afae480 0x563e3afae860 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f107c009a40 tx=0x7f107c02f310 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2838e14c3bbbb086 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:33:55.975 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:55.963+0000 7f10797fa640 1 -- 172.21.15.19:0/1689091757 <== mon.1 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f107c031db0 con 0x563e3afae480 2024-09-10T22:33:55.976 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:55.963+0000 7f10797fa640 1 -- 172.21.15.19:0/1689091757 <== mon.1 v2:172.21.15.138:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f107c036030 con 0x563e3afae480 2024-09-10T22:33:55.976 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:55.963+0000 7f10797fa640 1 -- 172.21.15.19:0/1689091757 <== mon.1 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f107c004330 con 0x563e3afae480 2024-09-10T22:33:55.976 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:55.963+0000 7f1080ff9640 1 --2- 172.21.15.19:0/3957538794 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f10700b52e0 0x7f10700b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:33:55.976 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:55.963+0000 7f1082ffd640 1 --2- 172.21.15.19:0/3957538794 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f10700b52e0 0x7f10700b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:33:55.976 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:55.963+0000 7f1080ff9640 1 -- 172.21.15.19:0/3957538794 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8327+0+0 (secure 0 0 0) 0x7f106c0e5eb0 con 0x7f10841044a0 2024-09-10T22:33:55.976 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:55.963+0000 7f108ba73740 1 -- 172.21.15.19:0/1689091757 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x563e3afae480 msgr2=0x563e3afae860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:33:55.976 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:55.963+0000 7f1082ffd640 1 --2- 172.21.15.19:0/3957538794 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f10700b52e0 0x7f10700b77a0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x563e3afad190 tx=0x7f107400b410 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:33:55.976 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:55.963+0000 7f108ba73740 1 --2- 172.21.15.19:0/1689091757 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x563e3afae480 0x563e3afae860 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f107c009a40 tx=0x7f107c02f310 comp rx=0 tx=0).stop 2024-09-10T22:33:55.976 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:55.964+0000 7f108ba73740 1 -- 172.21.15.19:0/1689091757 shutdown_connections 2024-09-10T22:33:55.976 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:55.964+0000 7f108ba73740 1 --2- 172.21.15.19:0/1689091757 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x563e3afbad30 0x563e3afbd120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:33:55.976 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:55.964+0000 7f108ba73740 1 --2- 172.21.15.19:0/1689091757 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563e3afaeda0 0x563e3afba7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:33:55.976 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:55.964+0000 7f108ba73740 1 --2- 172.21.15.19:0/1689091757 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x563e3afae480 0x563e3afae860 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:33:55.976 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:55.964+0000 7f108ba73740 1 -- 172.21.15.19:0/1689091757 >> 172.21.15.19:0/1689091757 conn(0x563e3afac2b0 msgr2=0x563e3afad450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:33:55.977 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:55.964+0000 7f108ba73740 1 -- 172.21.15.19:0/1689091757 shutdown_connections 2024-09-10T22:33:55.977 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:55.964+0000 7f108ba73740 1 -- 172.21.15.19:0/1689091757 wait complete. 2024-09-10T22:33:55.977 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:55.964+0000 7f108ba73740 1 -- start start 2024-09-10T22:33:55.977 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:55.964+0000 7f108ba73740 1 Processor -- start 2024-09-10T22:33:55.977 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:55.964+0000 7f108ba73740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563e3afae480 0x563e3afba5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:33:55.977 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:55.964+0000 7f108ba73740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x563e3afaeda0 0x563e3afb7a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:33:55.977 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:55.964+0000 7f108ba73740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x563e3afbad30 0x563e3afb7fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:33:55.977 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:55.964+0000 7f108ba73740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x563e3ad75700 con 0x563e3afbad30 2024-09-10T22:33:55.977 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:55.964+0000 7f108ba73740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x563e3aeaf110 con 0x563e3afae480 2024-09-10T22:33:55.977 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:55.964+0000 7f108ba73740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x563e3afbd7d0 con 0x563e3afaeda0 2024-09-10T22:33:55.977 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:55.965+0000 7f107bfff640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x563e3afaeda0 0x563e3afb7a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:33:55.977 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:55.965+0000 7f108ba73740 10 client.0 _ll_register_callbacks cb 0x563e3aec8990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T22:33:55.977 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:55.965+0000 7f107bfff640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x563e3afaeda0 0x563e3afb7a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.19:56996/0 (socket says 172.21.15.19:56996) 2024-09-10T22:33:55.978 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:55.965+0000 7f107bfff640 1 -- 172.21.15.19:0/3621699520 learned_addr learned my addr 172.21.15.19:0/3621699520 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:33:55.978 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:55.965+0000 7f10837fe640 1 --2- 172.21.15.19:0/3621699520 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x563e3afbad30 0x563e3afb7fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:33:55.978 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:55.965+0000 7f107bfff640 1 -- 172.21.15.19:0/3621699520 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563e3afae480 msgr2=0x563e3afba5c0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-10T22:33:55.978 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:55.965+0000 7f1082ffd640 1 --2- 172.21.15.19:0/3621699520 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563e3afae480 0x563e3afba5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:33:55.978 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:55.965+0000 7f107bfff640 1 --2- 172.21.15.19:0/3621699520 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563e3afae480 0x563e3afba5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:33:55.978 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:55.965+0000 7f107bfff640 1 -- 172.21.15.19:0/3621699520 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x563e3afbad30 msgr2=0x563e3afb7fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:33:55.978 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:55.965+0000 7f107bfff640 1 --2- 172.21.15.19:0/3621699520 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x563e3afbad30 0x563e3afb7fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:33:55.978 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:55.965+0000 7f107bfff640 1 -- 172.21.15.19:0/3621699520 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563e3aedcc40 con 0x563e3afaeda0 2024-09-10T22:33:55.978 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:55.965+0000 7f10837fe640 1 --2- 172.21.15.19:0/3621699520 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x563e3afbad30 0x563e3afb7fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T22:33:55.978 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:55.965+0000 7f107bfff640 1 --2- 172.21.15.19:0/3621699520 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x563e3afaeda0 0x563e3afb7a10 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f106c0a8c90 tx=0x7f106c0a8e00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c1105221a8c238b5 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:33:55.978 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:55.965+0000 7f106a7fc640 10 client.0 ms_handle_connect on v2:172.21.15.138:3300/0 2024-09-10T22:33:55.978 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:55.966+0000 7f106a7fc640 1 -- 172.21.15.19:0/3621699520 <== mon.1 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f106c0abe30 con 0x563e3afaeda0 2024-09-10T22:33:55.978 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:55.966+0000 7f106a7fc640 1 -- 172.21.15.19:0/3621699520 <== mon.1 v2:172.21.15.138:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8327+0+0 (secure 0 0 0) 0x7f106c0e9220 con 0x563e3afaeda0 2024-09-10T22:33:55.979 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:55.966+0000 7f108ba73740 1 -- 172.21.15.19:0/3621699520 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f107c036030 con 0x563e3afaeda0 2024-09-10T22:33:55.979 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:55.966+0000 7f106a7fc640 1 -- 172.21.15.19:0/3621699520 <== mon.1 v2:172.21.15.138:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f106c0ac1d0 con 0x563e3afaeda0 2024-09-10T22:33:55.979 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:55.966+0000 7f108ba73740 10 client.26191 fetch_fsmap learned FSMap version 27 2024-09-10T22:33:55.979 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:55.966+0000 7f108ba73740 1 -- 172.21.15.19:0/3621699520 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x563e3afc90d0 con 0x563e3afaeda0 2024-09-10T22:33:55.979 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:55.966+0000 7f106a7fc640 1 -- 172.21.15.19:0/3621699520 <== mon.1 v2:172.21.15.138:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f106c093e50 con 0x563e3afaeda0 2024-09-10T22:33:55.979 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:55.966+0000 7f106a7fc640 1 -- 172.21.15.19:0/3621699520 <== mon.1 v2:172.21.15.138:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7f106c0a8210 con 0x563e3afaeda0 2024-09-10T22:33:55.979 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:55.966+0000 7f108ba73740 10 client.26191 fetch_fsmap finished waiting for FSMap version 27 2024-09-10T22:33:55.979 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:55.966+0000 7f108ba73740 10 client.26191 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-10T22:33:55.979 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:55.966+0000 7f108ba73740 20 client.26191 populate_metadata read hostname 'smithi019' 2024-09-10T22:33:55.979 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:55.966+0000 7f108ba73740 1 --2- 172.21.15.19:0/3621699520 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x563e3afca490 0x563e3afcc8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:33:55.979 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:55.966+0000 7f108ba73740 4 client.26191 mds_command: new command op to 24581 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T22:33:55.979 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:55.966+0000 7f108ba73740 1 -- 172.21.15.19:0/3621699520 --> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x563e3af26da0 con 0x563e3afca490 2024-09-10T22:33:55.979 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:55.967+0000 7f1082ffd640 1 --2- 172.21.15.19:0/3621699520 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x563e3afca490 0x563e3afcc8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:33:55.980 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:55.967+0000 7f1082ffd640 1 --2- 172.21.15.19:0/3621699520 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x563e3afca490 0x563e3afcc8a0 crc :-1 s=READY pgs=156 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d26b9fce65e64585 server_cookie=f02bbb49cd7ec9e2 in_seq=0 out_seq=0 2024-09-10T22:33:55.980 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:55.967+0000 7f106a7fc640 10 client.26191 ms_handle_connect on v2:172.21.15.135:6838/1254769802 2024-09-10T22:33:55.980 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:55.968+0000 7f106a7fc640 1 -- 172.21.15.19:0/3621699520 <== mds.0 v2:172.21.15.135:6838/1254769802 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x563e3af26da0 con 0x563e3afca490 2024-09-10T22:33:55.980 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:55.968+0000 7f106a7fc640 10 client.26191 handle_command_reply: tid=0 2024-09-10T22:33:55.980 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:55.968+0000 7f108ba73740 1 client.26191 shutdown 2024-09-10T22:33:55.980 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:55.968+0000 7f108ba73740 1 -- 172.21.15.19:0/3621699520 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x563e3afaeda0 msgr2=0x563e3afb7a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:33:55.980 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:55.968+0000 7f108ba73740 1 --2- 172.21.15.19:0/3621699520 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x563e3afaeda0 0x563e3afb7a10 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f106c0a8c90 tx=0x7f106c0a8e00 comp rx=0 tx=0).stop 2024-09-10T22:33:55.980 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:55.968+0000 7f108ba73740 1 -- 172.21.15.19:0/3621699520 shutdown_connections 2024-09-10T22:33:55.980 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:55.968+0000 7f108ba73740 1 --2- 172.21.15.19:0/3621699520 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x563e3afbad30 0x563e3afb7fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:33:55.980 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:55.968+0000 7f108ba73740 1 --2- 172.21.15.19:0/3621699520 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x563e3afca490 0x563e3afcc8a0 crc :-1 s=READY pgs=156 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:33:55.980 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:55.968+0000 7f108ba73740 1 --2- 172.21.15.19:0/3621699520 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x563e3afaeda0 0x563e3afb7a10 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:33:55.980 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:55.968+0000 7f108ba73740 1 --2- 172.21.15.19:0/3621699520 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563e3afae480 0x563e3afba5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:33:55.980 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:55.968+0000 7f108ba73740 1 -- 172.21.15.19:0/3621699520 >> 172.21.15.19:0/3621699520 conn(0x563e3afac2b0 msgr2=0x563e3afb1e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:33:55.981 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:55.968+0000 7f106a7fc640 0 client.26191 ms_handle_reset on v2:172.21.15.135:6838/1254769802 2024-09-10T22:33:55.981 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:55.968+0000 7f108ba73740 1 -- 172.21.15.19:0/3621699520 shutdown_connections 2024-09-10T22:33:55.981 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:55.968+0000 7f108ba73740 1 -- 172.21.15.19:0/3621699520 wait complete. 2024-09-10T22:33:55.981 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:55.968+0000 7f108ba73740 20 client.26191 trim_cache size 0 max 16384 2024-09-10T22:33:55.990 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:55.987+0000 7f108ba73740 1 Processor -- start 2024-09-10T22:33:55.990 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:55.987+0000 7f108ba73740 1 -- start start 2024-09-10T22:33:55.991 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:55.988+0000 7f108ba73740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x563e3afae480 0x563e3afabbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:33:55.991 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:55.988+0000 7f108ba73740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563e3afaeda0 0x563e3afb9750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:33:55.991 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:55.988+0000 7f108ba73740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x563e3afbad30 0x563e3afb4c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:33:55.991 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:55.988+0000 7f108ba73740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f10841b2f60 con 0x563e3afae480 2024-09-10T22:33:55.991 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:55.988+0000 7f108ba73740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f10841b0830 con 0x563e3afaeda0 2024-09-10T22:33:55.991 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:55.988+0000 7f108ba73740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f10841ae680 con 0x563e3afbad30 2024-09-10T22:33:55.991 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:55.988+0000 7f107bfff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563e3afaeda0 0x563e3afb9750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:33:55.991 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:55.988+0000 7f107bfff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563e3afaeda0 0x563e3afb9750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.19:33174/0 (socket says 172.21.15.19:33174) 2024-09-10T22:33:55.992 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:55.988+0000 7f107bfff640 1 -- 172.21.15.19:0/1461955108 learned_addr learned my addr 172.21.15.19:0/1461955108 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:33:55.992 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:55.988+0000 7f10837fe640 1 --2- 172.21.15.19:0/1461955108 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x563e3afbad30 0x563e3afb4c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:33:55.992 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:55.988+0000 7f1082ffd640 1 --2- 172.21.15.19:0/1461955108 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x563e3afae480 0x563e3afabbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:33:55.992 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:55.988+0000 7f10837fe640 1 -- 172.21.15.19:0/1461955108 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563e3afaeda0 msgr2=0x563e3afb9750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:33:55.992 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:55.988+0000 7f10837fe640 1 --2- 172.21.15.19:0/1461955108 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563e3afaeda0 0x563e3afb9750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:33:55.992 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:55.988+0000 7f10837fe640 1 -- 172.21.15.19:0/1461955108 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x563e3afae480 msgr2=0x563e3afabbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:33:55.992 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:55.988+0000 7f10837fe640 1 --2- 172.21.15.19:0/1461955108 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x563e3afae480 0x563e3afabbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:33:55.992 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:55.988+0000 7f10837fe640 1 -- 172.21.15.19:0/1461955108 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563e3afb2730 con 0x563e3afbad30 2024-09-10T22:33:55.992 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:55.989+0000 7f10837fe640 1 --2- 172.21.15.19:0/1461955108 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x563e3afbad30 0x563e3afb4c20 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f107c004af0 tx=0x7f107c02a8c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c22ac9c1059f6c72 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:33:55.997 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:55.989+0000 7f1078ff9640 1 -- 172.21.15.19:0/1461955108 <== mon.1 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f107c04a040 con 0x563e3afbad30 2024-09-10T22:33:55.997 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:55.989+0000 7f1078ff9640 1 -- 172.21.15.19:0/1461955108 <== mon.1 v2:172.21.15.138:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f107c056070 con 0x563e3afbad30 2024-09-10T22:33:55.998 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:55.989+0000 7f1078ff9640 1 -- 172.21.15.19:0/1461955108 <== mon.1 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f107c02fa00 con 0x563e3afbad30 2024-09-10T22:33:55.998 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:55.989+0000 7f1082ffd640 1 --2- 172.21.15.19:0/1461955108 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x563e3afae480 0x563e3afabbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T22:33:55.998 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:55.990+0000 7f108ba73740 1 -- 172.21.15.19:0/1461955108 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x563e3afbad30 msgr2=0x563e3afb4c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:33:55.998 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:55.990+0000 7f108ba73740 1 --2- 172.21.15.19:0/1461955108 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x563e3afbad30 0x563e3afb4c20 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f107c004af0 tx=0x7f107c02a8c0 comp rx=0 tx=0).stop 2024-09-10T22:33:55.998 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:55.990+0000 7f108ba73740 1 -- 172.21.15.19:0/1461955108 shutdown_connections 2024-09-10T22:33:55.998 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:55.990+0000 7f108ba73740 1 --2- 172.21.15.19:0/1461955108 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x563e3afbad30 0x563e3afb4c20 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:33:55.998 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:55.990+0000 7f108ba73740 1 --2- 172.21.15.19:0/1461955108 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563e3afaeda0 0x563e3afb9750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:33:55.998 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:55.990+0000 7f108ba73740 1 --2- 172.21.15.19:0/1461955108 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x563e3afae480 0x563e3afabbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:33:55.998 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:55.990+0000 7f108ba73740 1 -- 172.21.15.19:0/1461955108 >> 172.21.15.19:0/1461955108 conn(0x563e3afac2b0 msgr2=0x563e3afb9040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:33:55.998 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:55.990+0000 7f108ba73740 1 -- 172.21.15.19:0/1461955108 shutdown_connections 2024-09-10T22:33:55.998 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:55.990+0000 7f108ba73740 1 -- 172.21.15.19:0/1461955108 wait complete. 2024-09-10T22:33:55.998 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:55.991+0000 7f108ba73740 1 -- start start 2024-09-10T22:33:55.999 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:55.991+0000 7f108ba73740 1 Processor -- start 2024-09-10T22:33:55.999 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:55.991+0000 7f108ba73740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563e3afae480 0x563e3b030690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:33:55.999 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:55.991+0000 7f108ba73740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x563e3afaeda0 0x563e3b030c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:33:55.999 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:55.991+0000 7f108ba73740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x563e3afbad30 0x563e3afbf210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:33:55.999 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:55.991+0000 7f108ba73740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f10841aecf0 con 0x563e3afbad30 2024-09-10T22:33:55.999 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:55.991+0000 7f108ba73740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f10841b0160 con 0x563e3afae480 2024-09-10T22:33:55.999 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:55.991+0000 7f108ba73740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f10841af3c0 con 0x563e3afaeda0 2024-09-10T22:33:55.999 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:55.991+0000 7f108ba73740 10 client.0 _ll_register_callbacks cb 0x7f106c0e96a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T22:33:55.999 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:55.992+0000 7f1082ffd640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563e3afae480 0x563e3b030690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:33:55.999 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:55.992+0000 7f10837fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x563e3afbad30 0x563e3afbf210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:33:55.999 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:55.992+0000 7f10837fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x563e3afbad30 0x563e3afbf210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:42036/0 (socket says 172.21.15.19:42036) 2024-09-10T22:33:55.999 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:55.992+0000 7f10837fe640 1 -- 172.21.15.19:0/318254145 learned_addr learned my addr 172.21.15.19:0/318254145 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:33:55.999 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:55.992+0000 7f107bfff640 1 --2- 172.21.15.19:0/318254145 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x563e3afaeda0 0x563e3b030c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:33:56.000 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:55.992+0000 7f1082ffd640 1 -- 172.21.15.19:0/318254145 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x563e3afaeda0 msgr2=0x563e3b030c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:33:56.000 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:55.992+0000 7f1082ffd640 1 --2- 172.21.15.19:0/318254145 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x563e3afaeda0 0x563e3b030c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:33:56.000 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:55.992+0000 7f1082ffd640 1 -- 172.21.15.19:0/318254145 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x563e3afbad30 msgr2=0x563e3afbf210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:33:56.000 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:55.992+0000 7f1082ffd640 1 --2- 172.21.15.19:0/318254145 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x563e3afbad30 0x563e3afbf210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:33:56.000 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:55.992+0000 7f1082ffd640 1 -- 172.21.15.19:0/318254145 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563e3afbfa20 con 0x563e3afae480 2024-09-10T22:33:56.000 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:55.992+0000 7f107bfff640 1 --2- 172.21.15.19:0/318254145 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x563e3afaeda0 0x563e3b030c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T22:33:56.000 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:55.992+0000 7f10837fe640 1 --2- 172.21.15.19:0/318254145 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x563e3afbad30 0x563e3afbf210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T22:33:56.000 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:55.992+0000 7f1082ffd640 1 --2- 172.21.15.19:0/318254145 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563e3afae480 0x563e3b030690 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x563e3afcd0b0 tx=0x7f1074004730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=df2bd215ef2f71c4 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:33:56.000 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:55.992+0000 7f106a7fc640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-09-10T22:33:56.000 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:55.992+0000 7f106a7fc640 1 -- 172.21.15.19:0/318254145 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1074029410 con 0x563e3afae480 2024-09-10T22:33:56.001 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:55.992+0000 7f108ba73740 1 -- 172.21.15.19:0/318254145 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f107c056070 con 0x563e3afae480 2024-09-10T22:33:56.001 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:55.992+0000 7f106a7fc640 1 -- 172.21.15.19:0/318254145 <== mon.2 v2:172.21.15.135:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8327+0+0 (secure 0 0 0) 0x7f10740295b0 con 0x563e3afae480 2024-09-10T22:33:56.001 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:55.993+0000 7f106a7fc640 1 -- 172.21.15.19:0/318254145 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f107403a050 con 0x563e3afae480 2024-09-10T22:33:56.001 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:55.993+0000 7f108ba73740 10 client.26171 fetch_fsmap learned FSMap version 27 2024-09-10T22:33:56.001 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:55.993+0000 7f108ba73740 1 -- 172.21.15.19:0/318254145 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x563e3b038010 con 0x563e3afae480 2024-09-10T22:33:56.001 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:55.993+0000 7f106a7fc640 1 -- 172.21.15.19:0/318254145 <== mon.2 v2:172.21.15.135:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f107c056070 con 0x563e3afae480 2024-09-10T22:33:56.001 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:55.993+0000 7f106a7fc640 1 -- 172.21.15.19:0/318254145 <== mon.2 v2:172.21.15.135:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7f1074010820 con 0x563e3afae480 2024-09-10T22:33:56.001 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:55.993+0000 7f108ba73740 10 client.26171 fetch_fsmap finished waiting for FSMap version 27 2024-09-10T22:33:56.001 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:55.993+0000 7f108ba73740 10 client.26171 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-10T22:33:56.001 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:55.993+0000 7f108ba73740 20 client.26171 populate_metadata read hostname 'smithi019' 2024-09-10T22:33:56.001 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:55.993+0000 7f108ba73740 1 --2- 172.21.15.19:0/318254145 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x563e3b038770 0x563e3b03ab90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:33:56.001 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:55.993+0000 7f108ba73740 4 client.26171 mds_command: new command op to 24581 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-10T22:33:56.002 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:55.993+0000 7f108ba73740 1 -- 172.21.15.19:0/318254145 --> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] -- command(tid 0: {"prefix": "scrub status"}) -- 0x563e3af22850 con 0x563e3b038770 2024-09-10T22:33:56.002 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:55.993+0000 7f107bfff640 1 --2- 172.21.15.19:0/318254145 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x563e3b038770 0x563e3b03ab90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:33:56.002 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:55.994+0000 7f106a7fc640 10 client.26171 ms_handle_connect on v2:172.21.15.135:6838/1254769802 2024-09-10T22:33:56.002 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:55.994+0000 7f107bfff640 1 --2- 172.21.15.19:0/318254145 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x563e3b038770 0x563e3b03ab90 crc :-1 s=READY pgs=157 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=47e1dfcbdcd123a7 server_cookie=e2391fb11fbe7659 in_seq=0 out_seq=0 2024-09-10T22:33:56.002 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:55.994+0000 7f106a7fc640 1 -- 172.21.15.19:0/318254145 <== mds.0 v2:172.21.15.135:6838/1254769802 1 ==== command_reply(tid 0: 0 ) ==== 8+0+2930 (crc 0 0 0) 0x563e3af22850 con 0x563e3b038770 2024-09-10T22:33:56.002 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:55.994+0000 7f106a7fc640 10 client.26171 handle_command_reply: tid=0 2024-09-10T22:33:56.002 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:55.994+0000 7f108ba73740 1 client.26171 shutdown 2024-09-10T22:33:56.002 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:55.994+0000 7f108ba73740 1 -- 172.21.15.19:0/318254145 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563e3afae480 msgr2=0x563e3b030690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:33:56.002 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:55.994+0000 7f108ba73740 1 --2- 172.21.15.19:0/318254145 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563e3afae480 0x563e3b030690 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x563e3afcd0b0 tx=0x7f1074004730 comp rx=0 tx=0).stop 2024-09-10T22:33:56.002 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:55.995+0000 7f108ba73740 1 -- 172.21.15.19:0/318254145 shutdown_connections 2024-09-10T22:33:56.002 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:55.995+0000 7f108ba73740 1 --2- 172.21.15.19:0/318254145 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x563e3afbad30 0x563e3afbf210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:33:56.002 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:55.995+0000 7f108ba73740 1 --2- 172.21.15.19:0/318254145 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x563e3b038770 0x563e3b03ab90 crc :-1 s=READY pgs=157 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:33:56.002 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:55.995+0000 7f106a7fc640 0 client.26171 ms_handle_reset on v2:172.21.15.135:6838/1254769802 2024-09-10T22:33:56.002 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:55.995+0000 7f108ba73740 1 --2- 172.21.15.19:0/318254145 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x563e3afaeda0 0x563e3b030c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:33:56.003 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:55.995+0000 7f108ba73740 1 --2- 172.21.15.19:0/318254145 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563e3afae480 0x563e3b030690 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:33:56.003 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:55.995+0000 7f108ba73740 1 -- 172.21.15.19:0/318254145 >> 172.21.15.19:0/318254145 conn(0x563e3afac2b0 msgr2=0x563e3afb9860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:33:56.003 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:55.995+0000 7f108ba73740 1 -- 172.21.15.19:0/318254145 shutdown_connections 2024-09-10T22:33:56.003 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:55.995+0000 7f108ba73740 1 -- 172.21.15.19:0/318254145 wait complete. 2024-09-10T22:33:56.003 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:55.995+0000 7f108ba73740 20 client.26171 trim_cache size 0 max 16384 2024-09-10T22:33:56.003 INFO:teuthology.orchestra.run.smithi019.stdout:{ 2024-09-10T22:33:56.003 INFO:teuthology.orchestra.run.smithi019.stdout: "status": "no active scrubs running", 2024-09-10T22:33:56.003 INFO:teuthology.orchestra.run.smithi019.stdout: "scrubs": {}, 2024-09-10T22:33:56.003 INFO:teuthology.orchestra.run.smithi019.stdout: "scrub_stats": { 2024-09-10T22:33:56.004 INFO:teuthology.orchestra.run.smithi019.stdout: "0b81ea61-0b8e-4f2c-a58f-ef1019289fc9": { 2024-09-10T22:33:56.004 INFO:teuthology.orchestra.run.smithi019.stdout: "start_time": "2024-09-10T22:31:48.141568+0000", 2024-09-10T22:33:56.004 INFO:teuthology.orchestra.run.smithi019.stdout: "path": "/", 2024-09-10T22:33:56.004 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_started": 0, 2024-09-10T22:33:56.004 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_passed": 0, 2024-09-10T22:33:56.004 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_failed": 0, 2024-09-10T22:33:56.004 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_skipped": 0 2024-09-10T22:33:56.004 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:33:56.004 INFO:teuthology.orchestra.run.smithi019.stdout: "715ec863-8a9d-45b6-967f-59b15ce1bf12": { 2024-09-10T22:33:56.004 INFO:teuthology.orchestra.run.smithi019.stdout: "start_time": "2024-09-10T22:31:00.669516+0000", 2024-09-10T22:33:56.004 INFO:teuthology.orchestra.run.smithi019.stdout: "path": "/", 2024-09-10T22:33:56.004 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_started": 0, 2024-09-10T22:33:56.004 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_passed": 0, 2024-09-10T22:33:56.005 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_failed": 0, 2024-09-10T22:33:56.005 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_skipped": 0 2024-09-10T22:33:56.005 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:33:56.005 INFO:teuthology.orchestra.run.smithi019.stdout: "fd1f1837-dcfa-4d88-99e8-2509f36c3f98": { 2024-09-10T22:33:56.005 INFO:teuthology.orchestra.run.smithi019.stdout: "start_time": "2024-09-10T22:30:12.470477+0000", 2024-09-10T22:33:56.005 INFO:teuthology.orchestra.run.smithi019.stdout: "path": "/", 2024-09-10T22:33:56.005 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_started": 0, 2024-09-10T22:33:56.005 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_passed": 0, 2024-09-10T22:33:56.005 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_failed": 0, 2024-09-10T22:33:56.005 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_skipped": 0 2024-09-10T22:33:56.005 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:33:56.005 INFO:teuthology.orchestra.run.smithi019.stdout: "8f3bb3bf-911f-490c-9856-c80ea220dbbe": { 2024-09-10T22:33:56.005 INFO:teuthology.orchestra.run.smithi019.stdout: "start_time": "2024-09-10T22:29:25.374415+0000", 2024-09-10T22:33:56.006 INFO:teuthology.orchestra.run.smithi019.stdout: "path": "/", 2024-09-10T22:33:56.006 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_started": 0, 2024-09-10T22:33:56.006 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_passed": 0, 2024-09-10T22:33:56.006 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_failed": 0, 2024-09-10T22:33:56.006 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_skipped": 0 2024-09-10T22:33:56.006 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:33:56.006 INFO:teuthology.orchestra.run.smithi019.stdout: "eb518e3c-a71e-4f32-9ca0-ae88930ca218": { 2024-09-10T22:33:56.006 INFO:teuthology.orchestra.run.smithi019.stdout: "start_time": "2024-09-10T22:28:38.366352+0000", 2024-09-10T22:33:56.006 INFO:teuthology.orchestra.run.smithi019.stdout: "path": "/", 2024-09-10T22:33:56.006 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_started": 0, 2024-09-10T22:33:56.006 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_passed": 0, 2024-09-10T22:33:56.006 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_failed": 0, 2024-09-10T22:33:56.007 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_skipped": 0 2024-09-10T22:33:56.007 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:33:56.007 INFO:teuthology.orchestra.run.smithi019.stdout: "4c99964e-2e0e-4ffd-8cb8-99c4979ed90f": { 2024-09-10T22:33:56.007 INFO:teuthology.orchestra.run.smithi019.stdout: "start_time": "2024-09-10T22:32:34.659639+0000", 2024-09-10T22:33:56.007 INFO:teuthology.orchestra.run.smithi019.stdout: "path": "/", 2024-09-10T22:33:56.007 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_started": 0, 2024-09-10T22:33:56.007 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_passed": 0, 2024-09-10T22:33:56.007 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_failed": 0, 2024-09-10T22:33:56.007 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_skipped": 0 2024-09-10T22:33:56.007 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:33:56.007 INFO:teuthology.orchestra.run.smithi019.stdout: "c12c2a04-dcd6-4673-a98e-93f665d3f5d7": { 2024-09-10T22:33:56.007 INFO:teuthology.orchestra.run.smithi019.stdout: "start_time": "2024-09-10T22:27:49.392329+0000", 2024-09-10T22:33:56.007 INFO:teuthology.orchestra.run.smithi019.stdout: "path": "/", 2024-09-10T22:33:56.007 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_started": 0, 2024-09-10T22:33:56.008 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_passed": 0, 2024-09-10T22:33:56.008 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_failed": 0, 2024-09-10T22:33:56.008 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_skipped": 0 2024-09-10T22:33:56.008 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:33:56.008 INFO:teuthology.orchestra.run.smithi019.stdout: "b38852c8-478a-42ef-8384-b2c55d5313a4": { 2024-09-10T22:33:56.008 INFO:teuthology.orchestra.run.smithi019.stdout: "start_time": "2024-09-10T22:27:00.320308+0000", 2024-09-10T22:33:56.008 INFO:teuthology.orchestra.run.smithi019.stdout: "path": "/", 2024-09-10T22:33:56.008 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_started": 0, 2024-09-10T22:33:56.008 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_passed": 0, 2024-09-10T22:33:56.008 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_failed": 0, 2024-09-10T22:33:56.008 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_skipped": 0 2024-09-10T22:33:56.008 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:33:56.009 INFO:teuthology.orchestra.run.smithi019.stdout: "448b10e7-494c-4a88-a9ab-186159c5dfdd": { 2024-09-10T22:33:56.009 INFO:teuthology.orchestra.run.smithi019.stdout: "start_time": "2024-09-10T22:33:21.208716+0000", 2024-09-10T22:33:56.009 INFO:teuthology.orchestra.run.smithi019.stdout: "path": "/", 2024-09-10T22:33:56.009 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_started": 0, 2024-09-10T22:33:56.009 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_passed": 0, 2024-09-10T22:33:56.009 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_failed": 0, 2024-09-10T22:33:56.009 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_skipped": 0 2024-09-10T22:33:56.009 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:33:56.009 INFO:teuthology.orchestra.run.smithi019.stdout: "9b6bfdee-303c-4c12-af56-dc85860d112a": { 2024-09-10T22:33:56.009 INFO:teuthology.orchestra.run.smithi019.stdout: "start_time": "2024-09-10T22:26:17.484162+0000", 2024-09-10T22:33:56.009 INFO:teuthology.orchestra.run.smithi019.stdout: "path": "/", 2024-09-10T22:33:56.009 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_started": 0, 2024-09-10T22:33:56.009 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_passed": 0, 2024-09-10T22:33:56.009 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_failed": 0, 2024-09-10T22:33:56.010 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_skipped": 0 2024-09-10T22:33:56.010 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-10T22:33:56.010 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-10T22:33:56.010 INFO:teuthology.orchestra.run.smithi019.stdout:} 2024-09-10T22:33:56.010 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:55.995+0000 7f108969e640 1 -- 172.21.15.19:0/3957538794 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f10700b52e0 msgr2=0x7f10700b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:33:56.010 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:55.995+0000 7f108969e640 1 --2- 172.21.15.19:0/3957538794 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f10700b52e0 0x7f10700b77a0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x563e3afad190 tx=0x7f107400b410 comp rx=0 tx=0).stop 2024-09-10T22:33:56.010 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:55.995+0000 7f108969e640 1 -- 172.21.15.19:0/3957538794 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f10841044a0 msgr2=0x7f1084198390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:33:56.011 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:55.995+0000 7f108969e640 1 --2- 172.21.15.19:0/3957538794 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f10841044a0 0x7f1084198390 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7f106c00e9f0 tx=0x7f106c00eeb0 comp rx=0 tx=0).stop 2024-09-10T22:33:56.011 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:55.996+0000 7f108969e640 1 -- 172.21.15.19:0/3957538794 shutdown_connections 2024-09-10T22:33:56.011 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:55.996+0000 7f108969e640 1 --2- 172.21.15.19:0/3957538794 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f10700b52e0 0x7f10700b77a0 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:33:56.011 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:55.996+0000 7f108969e640 1 --2- 172.21.15.19:0/3957538794 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1084104e40 0x7f10841988d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:33:56.011 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:55.996+0000 7f108969e640 1 --2- 172.21.15.19:0/3957538794 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f10841044a0 0x7f1084198390 unknown :-1 s=CLOSED pgs=712 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:33:56.011 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:55.996+0000 7f108969e640 1 --2- 172.21.15.19:0/3957538794 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f10841023c0 0x7f1084197e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:33:56.011 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:55.996+0000 7f108969e640 1 -- 172.21.15.19:0/3957538794 >> 172.21.15.19:0/3957538794 conn(0x7f1084078140 msgr2=0x7f1084107de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:33:56.011 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:55.996+0000 7f108969e640 1 -- 172.21.15.19:0/3957538794 shutdown_connections 2024-09-10T22:33:56.011 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:55.996+0000 7f108969e640 1 -- 172.21.15.19:0/3957538794 wait complete. 2024-09-10T22:33:56.110 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:33:55 smithi135 ceph-mon[34789]: pgmap v572: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 471 KiB/s rd, 239 MiB/s wr, 648 op/s 2024-09-10T22:33:56.125 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:33:55 smithi138 ceph-mon[35236]: pgmap v572: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 471 KiB/s rd, 239 MiB/s wr, 648 op/s 2024-09-10T22:33:57.054 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-10T22:33:57.054 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 22997a4c-6fc2-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-10T22:33:57.436 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/22997a4c-6fc2-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T22:33:57.959 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:33:57 smithi019 ceph-mon[31375]: pgmap v573: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 668 KiB/s rd, 265 MiB/s wr, 711 op/s 2024-09-10T22:33:58.110 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:33:57 smithi135 ceph-mon[34789]: pgmap v573: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 668 KiB/s rd, 265 MiB/s wr, 711 op/s 2024-09-10T22:33:58.125 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:33:57 smithi138 ceph-mon[35236]: pgmap v573: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 668 KiB/s rd, 265 MiB/s wr, 711 op/s 2024-09-10T22:33:58.128 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:58.120+0000 7f8c4df39640 1 -- 172.21.15.19:0/657663673 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8c481080c0 msgr2=0x7f8c4810e8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:33:58.128 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:58.120+0000 7f8c4df39640 1 --2- 172.21.15.19:0/657663673 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8c481080c0 0x7f8c4810e8c0 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7f8c40009ca0 tx=0x7f8c4002a8c0 comp rx=0 tx=0).stop 2024-09-10T22:33:58.128 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:58.120+0000 7f8c4df39640 1 -- 172.21.15.19:0/657663673 shutdown_connections 2024-09-10T22:33:58.128 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:58.120+0000 7f8c4df39640 1 --2- 172.21.15.19:0/657663673 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8c481080c0 0x7f8c4810e8c0 unknown :-1 s=CLOSED pgs=713 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:33:58.128 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:58.120+0000 7f8c4df39640 1 --2- 172.21.15.19:0/657663673 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8c48107740 0x7f8c48107b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:33:58.129 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:58.120+0000 7f8c4df39640 1 --2- 172.21.15.19:0/657663673 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f8c48101d30 0x7f8c48102110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:33:58.129 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:58.120+0000 7f8c4df39640 1 -- 172.21.15.19:0/657663673 >> 172.21.15.19:0/657663673 conn(0x7f8c480fd7e0 msgr2=0x7f8c480ffc00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:33:58.129 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:58.120+0000 7f8c4df39640 1 -- 172.21.15.19:0/657663673 shutdown_connections 2024-09-10T22:33:58.129 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:58.120+0000 7f8c4df39640 1 -- 172.21.15.19:0/657663673 wait complete. 2024-09-10T22:33:58.129 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:58.120+0000 7f8c4df39640 1 Processor -- start 2024-09-10T22:33:58.129 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:58.120+0000 7f8c4df39640 1 -- start start 2024-09-10T22:33:58.129 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:58.121+0000 7f8c4df39640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8c48101d30 0x7f8c48198150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:33:58.129 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:58.121+0000 7f8c4df39640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8c48107740 0x7f8c48198690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:33:58.129 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:58.121+0000 7f8c4df39640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f8c481080c0 0x7f8c4819da30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:33:58.129 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:58.121+0000 7f8c4df39640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f8c48111d80 con 0x7f8c48101d30 2024-09-10T22:33:58.129 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:58.121+0000 7f8c4df39640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f8c48111c00 con 0x7f8c48107740 2024-09-10T22:33:58.129 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:58.121+0000 7f8c4df39640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f8c48111f00 con 0x7f8c481080c0 2024-09-10T22:33:58.130 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:58.121+0000 7f8c477fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8c48101d30 0x7f8c48198150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:33:58.130 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:58.121+0000 7f8c477fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8c48101d30 0x7f8c48198150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:42054/0 (socket says 172.21.15.19:42054) 2024-09-10T22:33:58.130 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:58.121+0000 7f8c477fe640 1 -- 172.21.15.19:0/4293897952 learned_addr learned my addr 172.21.15.19:0/4293897952 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:33:58.130 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:58.121+0000 7f8c3ffff640 1 --2- 172.21.15.19:0/4293897952 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8c48107740 0x7f8c48198690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:33:58.130 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:58.121+0000 7f8c47fff640 1 --2- 172.21.15.19:0/4293897952 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f8c481080c0 0x7f8c4819da30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:33:58.130 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:58.121+0000 7f8c477fe640 1 -- 172.21.15.19:0/4293897952 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f8c481080c0 msgr2=0x7f8c4819da30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:33:58.130 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:58.121+0000 7f8c477fe640 1 --2- 172.21.15.19:0/4293897952 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f8c481080c0 0x7f8c4819da30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:33:58.130 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:58.121+0000 7f8c477fe640 1 -- 172.21.15.19:0/4293897952 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8c48107740 msgr2=0x7f8c48198690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:33:58.130 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:58.121+0000 7f8c477fe640 1 --2- 172.21.15.19:0/4293897952 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8c48107740 0x7f8c48198690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:33:58.130 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:58.121+0000 7f8c477fe640 1 -- 172.21.15.19:0/4293897952 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8c4819e200 con 0x7f8c48101d30 2024-09-10T22:33:58.130 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:58.121+0000 7f8c3ffff640 1 --2- 172.21.15.19:0/4293897952 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8c48107740 0x7f8c48198690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T22:33:58.130 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:58.122+0000 7f8c477fe640 1 --2- 172.21.15.19:0/4293897952 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8c48101d30 0x7f8c48198150 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7f8c3800eaa0 tx=0x7f8c3800eea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:33:58.130 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:58.122+0000 7f8c457fa640 1 -- 172.21.15.19:0/4293897952 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c38007aa0 con 0x7f8c48101d30 2024-09-10T22:33:58.130 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:58.122+0000 7f8c4df39640 1 -- 172.21.15.19:0/4293897952 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8c4819e4f0 con 0x7f8c48101d30 2024-09-10T22:33:58.131 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:58.122+0000 7f8c457fa640 1 -- 172.21.15.19:0/4293897952 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8c38007c40 con 0x7f8c48101d30 2024-09-10T22:33:58.131 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:58.122+0000 7f8c457fa640 1 -- 172.21.15.19:0/4293897952 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c380047a0 con 0x7f8c48101d30 2024-09-10T22:33:58.131 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:58.122+0000 7f8c4df39640 1 -- 172.21.15.19:0/4293897952 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8c4806b4a0 con 0x7f8c48101d30 2024-09-10T22:33:58.131 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:58.123+0000 7f8c4df39640 1 -- 172.21.15.19:0/4293897952 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8c48102fe0 con 0x7f8c48101d30 2024-09-10T22:33:58.131 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:58.125+0000 7f8c457fa640 1 -- 172.21.15.19:0/4293897952 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 18) ==== 153250+0+0 (secure 0 0 0) 0x7f8c38004020 con 0x7f8c48101d30 2024-09-10T22:33:58.132 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:58.126+0000 7f8c457fa640 1 --2- 172.21.15.19:0/4293897952 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f8c340b52e0 0x7f8c340b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:33:58.132 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:58.126+0000 7f8c3ffff640 1 --2- 172.21.15.19:0/4293897952 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f8c340b52e0 0x7f8c340b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:33:58.132 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:58.127+0000 7f8c457fa640 1 -- 172.21.15.19:0/4293897952 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8327+0+0 (secure 0 0 0) 0x7f8c380e7c00 con 0x7f8c48101d30 2024-09-10T22:33:58.132 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:58.127+0000 7f8c3ffff640 1 --2- 172.21.15.19:0/4293897952 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f8c340b52e0 0x7f8c340b77a0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f8c480fff40 tx=0x7f8c3000a2d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:33:58.132 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:58.129+0000 7f8c457fa640 1 -- 172.21.15.19:0/4293897952 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f8c38024030 con 0x7f8c48101d30 2024-09-10T22:33:58.433 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:58.430+0000 7f8c4df39640 1 -- 172.21.15.19:0/4293897952 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f8c48102110 con 0x7f8c48101d30 2024-09-10T22:33:58.435 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:58.432+0000 7f8c457fa640 1 -- 172.21.15.19:0/4293897952 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) ==== 94+0+11921 (secure 0 0 0) 0x7f8c380aea60 con 0x7f8c48101d30 2024-09-10T22:33:58.435 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-10T22:33:58.435 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":27,"btime":"2024-09-10T22:29:37:724724+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14673,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6835/1835804747","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6834","nonce":1835804747},{"type":"v1","addr":"172.21.15.19:6835","nonce":1835804747}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14685,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6837/1750470490","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6836","nonce":1750470490},{"type":"v1","addr":"172.21.15.19:6837","nonce":1750470490}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14733,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6839/2642941149","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6838","nonce":2642941149},{"type":"v1","addr":"172.21.15.19:6839","nonce":2642941149}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14745,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6841/2449948682","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6840","nonce":2449948682},{"type":"v1","addr":"172.21.15.19:6841","nonce":2449948682}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24511,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.138:6833/2524811494","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6832","nonce":2524811494},{"type":"v1","addr":"172.21.15.138:6833","nonce":2524811494}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24512,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6833/3014993624","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6832","nonce":3014993624},{"type":"v1","addr":"172.21.15.135:6833","nonce":3014993624}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":27,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-10T22:24:22.733925+0000","modified":"2024-09-10T22:29:37.430699+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24581,"mds_1":24568,"mds_2":24553},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24527":{"gid":24527,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.135:6835/3715773348","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6834","nonce":3715773348},{"type":"v1","addr":"172.21.15.135:6835","nonce":3715773348}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24541":{"gid":24541,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.138:6835/933547028","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6834","nonce":933547028},{"type":"v1","addr":"172.21.15.138:6835","nonce":933547028}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24551":{"gid":24551,"name":"h","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.135:6837/3495029135","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6836","nonce":3495029135},{"type":"v1","addr":"172.21.15.135:6837","nonce":3495029135}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24553":{"gid":24553,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":10,"addr":"172.21.15.138:6837/3353290042","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6836","nonce":3353290042},{"type":"v1","addr":"172.21.15.138:6837","nonce":3353290042}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24568":{"gid":24568,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.138:6839/383637208","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6838","nonce":383637208},{"type":"v1","addr":"172.21.15.138:6839","nonce":383637208}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24581":{"gid":24581,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.135:6839/1254769802","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6838","nonce":1254769802},{"type":"v1","addr":"172.21.15.135:6839","nonce":1254769802}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24581,"qdb_cluster":[24581,24568,24553]},"id":1}]} 2024-09-10T22:33:58.436 INFO:teuthology.orchestra.run.smithi019.stderr:dumped fsmap epoch 27 2024-09-10T22:33:58.439 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:58.436+0000 7f8c4df39640 1 -- 172.21.15.19:0/4293897952 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f8c340b52e0 msgr2=0x7f8c340b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:33:58.439 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:58.436+0000 7f8c4df39640 1 --2- 172.21.15.19:0/4293897952 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f8c340b52e0 0x7f8c340b77a0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f8c480fff40 tx=0x7f8c3000a2d0 comp rx=0 tx=0).stop 2024-09-10T22:33:58.440 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:58.437+0000 7f8c4df39640 1 -- 172.21.15.19:0/4293897952 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8c48101d30 msgr2=0x7f8c48198150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:33:58.440 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:58.437+0000 7f8c4df39640 1 --2- 172.21.15.19:0/4293897952 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8c48101d30 0x7f8c48198150 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7f8c3800eaa0 tx=0x7f8c3800eea0 comp rx=0 tx=0).stop 2024-09-10T22:33:58.441 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:58.438+0000 7f8c4df39640 1 -- 172.21.15.19:0/4293897952 shutdown_connections 2024-09-10T22:33:58.441 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:58.438+0000 7f8c4df39640 1 --2- 172.21.15.19:0/4293897952 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f8c340b52e0 0x7f8c340b77a0 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:33:58.441 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:58.438+0000 7f8c4df39640 1 --2- 172.21.15.19:0/4293897952 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f8c481080c0 0x7f8c4819da30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:33:58.441 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:58.438+0000 7f8c4df39640 1 --2- 172.21.15.19:0/4293897952 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8c48107740 0x7f8c48198690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:33:58.441 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:58.438+0000 7f8c4df39640 1 --2- 172.21.15.19:0/4293897952 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8c48101d30 0x7f8c48198150 unknown :-1 s=CLOSED pgs=714 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:33:58.441 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:58.438+0000 7f8c4df39640 1 -- 172.21.15.19:0/4293897952 >> 172.21.15.19:0/4293897952 conn(0x7f8c480fd7e0 msgr2=0x7f8c48100cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:33:58.442 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:58.439+0000 7f8c4df39640 1 -- 172.21.15.19:0/4293897952 shutdown_connections 2024-09-10T22:33:58.442 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:33:58.439+0000 7f8c4df39640 1 -- 172.21.15.19:0/4293897952 wait complete. 2024-09-10T22:33:59.110 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:33:58 smithi135 ceph-mon[34789]: from='client.? 172.21.15.19:0/4293897952' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T22:33:59.116 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:33:58 smithi019 ceph-mon[31375]: from='client.? 172.21.15.19:0/4293897952' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T22:33:59.125 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:33:58 smithi138 ceph-mon[35236]: from='client.? 172.21.15.19:0/4293897952' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T22:33:59.656 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 22997a4c-6fc2-11ef-bcea-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-09-10T22:33:59.958 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:33:59 smithi019 ceph-mon[31375]: pgmap v574: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 405 KiB/s rd, 233 MiB/s wr, 621 op/s 2024-09-10T22:34:00.040 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/22997a4c-6fc2-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T22:34:00.110 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:33:59 smithi135 ceph-mon[34789]: pgmap v574: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 405 KiB/s rd, 233 MiB/s wr, 621 op/s 2024-09-10T22:34:00.125 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:33:59 smithi138 ceph-mon[35236]: pgmap v574: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 405 KiB/s rd, 233 MiB/s wr, 621 op/s 2024-09-10T22:34:01.038 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:00.926+0000 7f3130986640 1 -- 172.21.15.19:0/1599001949 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f312c1087f0 msgr2=0x7f312c108c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:34:01.038 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:00.926+0000 7f3130986640 1 --2- 172.21.15.19:0/1599001949 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f312c1087f0 0x7f312c108c30 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7f3120009900 tx=0x7f312002a410 comp rx=0 tx=0).stop 2024-09-10T22:34:01.038 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:00.926+0000 7f3130986640 1 -- 172.21.15.19:0/1599001949 shutdown_connections 2024-09-10T22:34:01.039 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:00.926+0000 7f3130986640 1 --2- 172.21.15.19:0/1599001949 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f312c109170 0x7f312c10f970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:34:01.039 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:00.926+0000 7f3130986640 1 --2- 172.21.15.19:0/1599001949 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f312c1087f0 0x7f312c108c30 unknown :-1 s=CLOSED pgs=715 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:34:01.039 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:00.926+0000 7f3130986640 1 --2- 172.21.15.19:0/1599001949 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f312c102de0 0x7f312c1031c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:34:01.039 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:00.926+0000 7f3130986640 1 -- 172.21.15.19:0/1599001949 >> 172.21.15.19:0/1599001949 conn(0x7f312c0fe870 msgr2=0x7f312c100c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:34:01.039 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:00.926+0000 7f3130986640 1 -- 172.21.15.19:0/1599001949 shutdown_connections 2024-09-10T22:34:01.039 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:00.926+0000 7f3130986640 1 -- 172.21.15.19:0/1599001949 wait complete. 2024-09-10T22:34:01.039 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:00.927+0000 7f3130986640 1 Processor -- start 2024-09-10T22:34:01.039 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:00.927+0000 7f3130986640 1 -- start start 2024-09-10T22:34:01.039 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:00.927+0000 7f3130986640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f312c102de0 0x7f312c199290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:34:01.039 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:00.927+0000 7f3130986640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f312c1087f0 0x7f312c1997d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:34:01.039 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:00.927+0000 7f3130986640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f312c109170 0x7f312c19eb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:34:01.039 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:00.927+0000 7f3130986640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f312c112dc0 con 0x7f312c102de0 2024-09-10T22:34:01.040 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:00.927+0000 7f3130986640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f312c112c40 con 0x7f312c109170 2024-09-10T22:34:01.040 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:00.927+0000 7f3130986640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f312c112f40 con 0x7f312c1087f0 2024-09-10T22:34:01.040 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:00.927+0000 7f312a59c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f312c102de0 0x7f312c199290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:34:01.040 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:00.927+0000 7f312ad9d640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f312c109170 0x7f312c19eb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:34:01.040 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:00.927+0000 7f312a59c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f312c102de0 0x7f312c199290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:42074/0 (socket says 172.21.15.19:42074) 2024-09-10T22:34:01.040 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:00.927+0000 7f312a59c640 1 -- 172.21.15.19:0/831296484 learned_addr learned my addr 172.21.15.19:0/831296484 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:34:01.040 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:00.927+0000 7f312ad9d640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f312c109170 0x7f312c19eb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.19:33218/0 (socket says 172.21.15.19:33218) 2024-09-10T22:34:01.040 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:00.928+0000 7f3129d9b640 1 --2- 172.21.15.19:0/831296484 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f312c1087f0 0x7f312c1997d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:34:01.040 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:00.928+0000 7f312a59c640 1 -- 172.21.15.19:0/831296484 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f312c1087f0 msgr2=0x7f312c1997d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:34:01.040 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:00.928+0000 7f312a59c640 1 --2- 172.21.15.19:0/831296484 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f312c1087f0 0x7f312c1997d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:34:01.040 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:00.928+0000 7f312a59c640 1 -- 172.21.15.19:0/831296484 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f312c109170 msgr2=0x7f312c19eb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:34:01.041 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:00.928+0000 7f312a59c640 1 --2- 172.21.15.19:0/831296484 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f312c109170 0x7f312c19eb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:34:01.041 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:00.928+0000 7f312a59c640 1 -- 172.21.15.19:0/831296484 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f312c19f340 con 0x7f312c102de0 2024-09-10T22:34:01.041 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:00.928+0000 7f312ad9d640 1 --2- 172.21.15.19:0/831296484 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f312c109170 0x7f312c19eb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T22:34:01.041 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:00.928+0000 7f312a59c640 1 --2- 172.21.15.19:0/831296484 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f312c102de0 0x7f312c199290 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7f311c00e9f0 tx=0x7f311c00eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:34:01.041 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:00.928+0000 7f311b7fe640 1 -- 172.21.15.19:0/831296484 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f311c00cd80 con 0x7f312c102de0 2024-09-10T22:34:01.041 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:00.928+0000 7f311b7fe640 1 -- 172.21.15.19:0/831296484 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f311c0108e0 con 0x7f312c102de0 2024-09-10T22:34:01.041 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:00.928+0000 7f3130986640 1 -- 172.21.15.19:0/831296484 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f312c19f630 con 0x7f312c102de0 2024-09-10T22:34:01.041 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:00.928+0000 7f311b7fe640 1 -- 172.21.15.19:0/831296484 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f311c018860 con 0x7f312c102de0 2024-09-10T22:34:01.041 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:00.929+0000 7f3130986640 1 -- 172.21.15.19:0/831296484 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f312c1a5ec0 con 0x7f312c102de0 2024-09-10T22:34:01.041 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:00.932+0000 7f3132d5b740 1 Processor -- start 2024-09-10T22:34:01.041 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:00.932+0000 7f311b7fe640 1 -- 172.21.15.19:0/831296484 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 18) ==== 153250+0+0 (secure 0 0 0) 0x7f311c010430 con 0x7f312c102de0 2024-09-10T22:34:01.041 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:00.932+0000 7f3132d5b740 1 -- start start 2024-09-10T22:34:01.041 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:00.932+0000 7f3132d5b740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56367f49b4d0 0x56367f49b8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:34:01.042 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:00.932+0000 7f3132d5b740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56367f49bdf0 0x56367f4a7840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:34:01.042 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:00.932+0000 7f3132d5b740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x56367f4a7d80 0x56367f4aa170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:34:01.042 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:00.932+0000 7f3132d5b740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x56367f411ea0 con 0x56367f49bdf0 2024-09-10T22:34:01.042 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:00.932+0000 7f3132d5b740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x56367f4012d0 con 0x56367f49b4d0 2024-09-10T22:34:01.042 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:00.932+0000 7f3132d5b740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x56367f4050e0 con 0x56367f4a7d80 2024-09-10T22:34:01.042 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:00.932+0000 7f312ad9d640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56367f49b4d0 0x56367f49b8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:34:01.042 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:00.933+0000 7f3129d9b640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x56367f4a7d80 0x56367f4aa170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:34:01.042 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:00.933+0000 7f312ad9d640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56367f49b4d0 0x56367f49b8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.19:33230/0 (socket says 172.21.15.19:33230) 2024-09-10T22:34:01.042 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:00.933+0000 7f312ad9d640 1 -- 172.21.15.19:0/1467667047 learned_addr learned my addr 172.21.15.19:0/1467667047 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:34:01.042 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:00.933+0000 7f312a59c640 1 --2- 172.21.15.19:0/1467667047 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56367f49bdf0 0x56367f4a7840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:34:01.042 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:00.933+0000 7f312ad9d640 1 -- 172.21.15.19:0/1467667047 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x56367f4a7d80 msgr2=0x56367f4aa170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:34:01.042 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:00.933+0000 7f312ad9d640 1 --2- 172.21.15.19:0/1467667047 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x56367f4a7d80 0x56367f4aa170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:34:01.042 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:00.933+0000 7f312ad9d640 1 -- 172.21.15.19:0/1467667047 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56367f49bdf0 msgr2=0x56367f4a7840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:34:01.043 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:00.933+0000 7f312ad9d640 1 --2- 172.21.15.19:0/1467667047 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56367f49bdf0 0x56367f4a7840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:34:01.043 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:00.933+0000 7f312ad9d640 1 -- 172.21.15.19:0/1467667047 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56367f15f650 con 0x56367f49b4d0 2024-09-10T22:34:01.043 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:00.933+0000 7f3129d9b640 1 --2- 172.21.15.19:0/1467667047 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x56367f4a7d80 0x56367f4aa170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T22:34:01.043 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:00.933+0000 7f312ad9d640 1 --2- 172.21.15.19:0/1467667047 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56367f49b4d0 0x56367f49b8b0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f31240117e0 tx=0x7f3124011ca0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ae06396e7d32e523 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:34:01.043 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:00.933+0000 7f311b7fe640 1 --2- 172.21.15.19:0/831296484 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f31140b5360 0x7f31140b7820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:34:01.043 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:00.933+0000 7f312a59c640 1 --2- 172.21.15.19:0/1467667047 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56367f49bdf0 0x56367f4a7840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T22:34:01.043 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:00.934+0000 7f3118ff9640 1 -- 172.21.15.19:0/1467667047 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3124011310 con 0x56367f49b4d0 2024-09-10T22:34:01.043 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:00.934+0000 7f3118ff9640 1 -- 172.21.15.19:0/1467667047 <== mon.2 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3124003e20 con 0x56367f49b4d0 2024-09-10T22:34:01.043 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:00.934+0000 7f312a59c640 1 --2- 172.21.15.19:0/831296484 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f31140b5360 0x7f31140b7820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:34:01.043 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:00.934+0000 7f3118ff9640 1 -- 172.21.15.19:0/1467667047 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31240044f0 con 0x56367f49b4d0 2024-09-10T22:34:01.043 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:00.934+0000 7f311b7fe640 1 -- 172.21.15.19:0/831296484 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8327+0+0 (secure 0 0 0) 0x7f311c0e5e90 con 0x7f312c102de0 2024-09-10T22:34:01.043 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:00.935+0000 7f3132d5b740 1 -- 172.21.15.19:0/1467667047 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56367f49b4d0 msgr2=0x56367f49b8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:34:01.044 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:00.935+0000 7f312a59c640 1 --2- 172.21.15.19:0/831296484 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f31140b5360 0x7f31140b7820 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f311c0e3ca0 tx=0x7f311c009700 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:34:01.044 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:00.935+0000 7f3132d5b740 1 --2- 172.21.15.19:0/1467667047 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56367f49b4d0 0x56367f49b8b0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f31240117e0 tx=0x7f3124011ca0 comp rx=0 tx=0).stop 2024-09-10T22:34:01.044 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:00.935+0000 7f3132d5b740 1 -- 172.21.15.19:0/1467667047 shutdown_connections 2024-09-10T22:34:01.044 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:00.935+0000 7f3132d5b740 1 --2- 172.21.15.19:0/1467667047 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x56367f4a7d80 0x56367f4aa170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:34:01.044 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:00.935+0000 7f3132d5b740 1 --2- 172.21.15.19:0/1467667047 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56367f49bdf0 0x56367f4a7840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:34:01.044 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:00.935+0000 7f3132d5b740 1 --2- 172.21.15.19:0/1467667047 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56367f49b4d0 0x56367f49b8b0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:34:01.044 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:00.935+0000 7f3132d5b740 1 -- 172.21.15.19:0/1467667047 >> 172.21.15.19:0/1467667047 conn(0x56367f499300 msgr2=0x56367f49a4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:34:01.044 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:00.935+0000 7f3132d5b740 1 -- 172.21.15.19:0/1467667047 shutdown_connections 2024-09-10T22:34:01.044 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:00.935+0000 7f3132d5b740 1 -- 172.21.15.19:0/1467667047 wait complete. 2024-09-10T22:34:01.044 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:00.935+0000 7f3132d5b740 1 -- start start 2024-09-10T22:34:01.044 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:00.936+0000 7f3132d5b740 1 Processor -- start 2024-09-10T22:34:01.044 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:00.936+0000 7f3132d5b740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56367f49b4d0 0x56367f4a76b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:34:01.044 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:00.936+0000 7f3132d5b740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56367f49bdf0 0x56367f4a4b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:34:01.045 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:00.936+0000 7f3132d5b740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x56367f4a7d80 0x56367f4a5180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:34:01.045 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:00.936+0000 7f3132d5b740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x56367f262700 con 0x56367f49bdf0 2024-09-10T22:34:01.045 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:00.936+0000 7f3132d5b740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x56367f39c160 con 0x56367f49b4d0 2024-09-10T22:34:01.045 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:00.936+0000 7f3132d5b740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x56367f4aaa00 con 0x56367f4a7d80 2024-09-10T22:34:01.045 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:00.936+0000 7f3132d5b740 10 client.0 _ll_register_callbacks cb 0x56367f3b59e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T22:34:01.045 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:00.936+0000 7f3129d9b640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56367f49bdf0 0x56367f4a4b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:34:01.045 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:00.936+0000 7f312ad9d640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56367f49b4d0 0x56367f4a76b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:34:01.045 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:00.936+0000 7f3129d9b640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56367f49bdf0 0x56367f4a4b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:42096/0 (socket says 172.21.15.19:42096) 2024-09-10T22:34:01.045 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:00.936+0000 7f3129d9b640 1 -- 172.21.15.19:0/1410149460 learned_addr learned my addr 172.21.15.19:0/1410149460 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:34:01.045 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:00.936+0000 7f312ad9d640 1 --2- 172.21.15.19:0/1410149460 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x56367f4a7d80 0x56367f4a5180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:34:01.046 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:00.936+0000 7f3129d9b640 1 -- 172.21.15.19:0/1410149460 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x56367f4a7d80 msgr2=0x56367f4a5180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:34:01.046 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:00.936+0000 7f3129d9b640 1 --2- 172.21.15.19:0/1410149460 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x56367f4a7d80 0x56367f4a5180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:34:01.046 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:00.936+0000 7f3129d9b640 1 -- 172.21.15.19:0/1410149460 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56367f49b4d0 msgr2=0x56367f4a76b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:34:01.046 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:00.936+0000 7f3129d9b640 1 --2- 172.21.15.19:0/1410149460 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56367f49b4d0 0x56367f4a76b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:34:01.046 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:00.936+0000 7f3129d9b640 1 -- 172.21.15.19:0/1410149460 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56367f3c9c90 con 0x56367f49bdf0 2024-09-10T22:34:01.046 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:00.936+0000 7f312ad9d640 1 --2- 172.21.15.19:0/1410149460 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56367f49b4d0 0x56367f4a76b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T22:34:01.046 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:00.937+0000 7f3129d9b640 1 --2- 172.21.15.19:0/1410149460 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56367f49bdf0 0x56367f4a4b00 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7f312002a930 tx=0x7f3120032f20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=762d9cf78083c782 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:34:01.046 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:00.937+0000 7f3111ffb640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-10T22:34:01.046 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:00.937+0000 7f3111ffb640 1 -- 172.21.15.19:0/1410149460 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3120035040 con 0x56367f49bdf0 2024-09-10T22:34:01.046 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:00.937+0000 7f3111ffb640 1 -- 172.21.15.19:0/1410149460 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8327+0+0 (secure 0 0 0) 0x7f31200317a0 con 0x56367f49bdf0 2024-09-10T22:34:01.046 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:00.937+0000 7f3132d5b740 1 -- 172.21.15.19:0/1410149460 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3124003e20 con 0x56367f49bdf0 2024-09-10T22:34:01.046 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:00.937+0000 7f3111ffb640 1 -- 172.21.15.19:0/1410149460 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f3120004040 con 0x56367f49bdf0 2024-09-10T22:34:01.046 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:00.937+0000 7f3132d5b740 10 client.16842 fetch_fsmap learned FSMap version 27 2024-09-10T22:34:01.047 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:00.937+0000 7f3132d5b740 1 -- 172.21.15.19:0/1410149460 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x56367f4beaf0 con 0x56367f49bdf0 2024-09-10T22:34:01.047 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:00.937+0000 7f3111ffb640 1 -- 172.21.15.19:0/1410149460 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3124003e20 con 0x56367f49bdf0 2024-09-10T22:34:01.047 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:00.938+0000 7f3111ffb640 1 -- 172.21.15.19:0/1410149460 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7f3120004750 con 0x56367f49bdf0 2024-09-10T22:34:01.047 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:00.938+0000 7f3132d5b740 10 client.16842 fetch_fsmap finished waiting for FSMap version 27 2024-09-10T22:34:01.047 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:00.938+0000 7f3132d5b740 10 client.16842 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-10T22:34:01.047 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:00.938+0000 7f3132d5b740 20 client.16842 populate_metadata read hostname 'smithi019' 2024-09-10T22:34:01.047 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:00.938+0000 7f3132d5b740 1 --2- 172.21.15.19:0/1410149460 >> [v2:172.21.15.138:6836/3353290042,v1:172.21.15.138:6837/3353290042] conn(0x56367f4bffb0 0x56367f4c23a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:34:01.047 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:00.938+0000 7f3132d5b740 4 client.16842 mds_command: new command op to 24553 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T22:34:01.047 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:00.938+0000 7f3132d5b740 1 -- 172.21.15.19:0/1410149460 --> [v2:172.21.15.138:6836/3353290042,v1:172.21.15.138:6837/3353290042] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56367f413df0 con 0x56367f4bffb0 2024-09-10T22:34:01.047 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:00.938+0000 7f312ad9d640 1 --2- 172.21.15.19:0/1410149460 >> [v2:172.21.15.138:6836/3353290042,v1:172.21.15.138:6837/3353290042] conn(0x56367f4bffb0 0x56367f4c23a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:34:01.047 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:00.938+0000 7f312ad9d640 1 --2- 172.21.15.19:0/1410149460 >> [v2:172.21.15.138:6836/3353290042,v1:172.21.15.138:6837/3353290042] conn(0x56367f4bffb0 0x56367f4c23a0 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=e5135d1ca0423cd9 server_cookie=439e4c2d8cbe999c in_seq=0 out_seq=0 2024-09-10T22:34:01.047 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:00.938+0000 7f3111ffb640 10 client.16842 ms_handle_connect on v2:172.21.15.138:6836/3353290042 2024-09-10T22:34:01.047 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:00.939+0000 7f3111ffb640 1 -- 172.21.15.19:0/1410149460 <== mds.2 v2:172.21.15.138:6836/3353290042 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x56367f413df0 con 0x56367f4bffb0 2024-09-10T22:34:01.047 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:00.939+0000 7f3111ffb640 10 client.16842 handle_command_reply: tid=0 2024-09-10T22:34:01.048 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:00.939+0000 7f3132d5b740 1 client.16842 shutdown 2024-09-10T22:34:01.048 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:00.939+0000 7f3132d5b740 1 -- 172.21.15.19:0/1410149460 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56367f49bdf0 msgr2=0x56367f4a4b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:34:01.048 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:00.939+0000 7f3132d5b740 1 --2- 172.21.15.19:0/1410149460 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56367f49bdf0 0x56367f4a4b00 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7f312002a930 tx=0x7f3120032f20 comp rx=0 tx=0).stop 2024-09-10T22:34:01.048 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:00.939+0000 7f3132d5b740 1 -- 172.21.15.19:0/1410149460 shutdown_connections 2024-09-10T22:34:01.048 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:00.939+0000 7f3132d5b740 1 --2- 172.21.15.19:0/1410149460 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x56367f4a7d80 0x56367f4a5180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:34:01.048 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:00.939+0000 7f3132d5b740 1 --2- 172.21.15.19:0/1410149460 >> [v2:172.21.15.138:6836/3353290042,v1:172.21.15.138:6837/3353290042] conn(0x56367f4bffb0 0x56367f4c23a0 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:34:01.048 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:00.939+0000 7f3132d5b740 1 --2- 172.21.15.19:0/1410149460 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56367f49bdf0 0x56367f4a4b00 unknown :-1 s=CLOSED pgs=717 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:34:01.048 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:00.939+0000 7f3132d5b740 1 --2- 172.21.15.19:0/1410149460 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56367f49b4d0 0x56367f4a76b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:34:01.048 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:00.939+0000 7f3111ffb640 0 client.16842 ms_handle_reset on v2:172.21.15.138:6836/3353290042 2024-09-10T22:34:01.048 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:00.939+0000 7f3132d5b740 1 -- 172.21.15.19:0/1410149460 >> 172.21.15.19:0/1410149460 conn(0x56367f499300 msgr2=0x56367f49eea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:34:01.048 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:00.939+0000 7f3132d5b740 1 -- 172.21.15.19:0/1410149460 shutdown_connections 2024-09-10T22:34:01.048 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:00.940+0000 7f3132d5b740 1 -- 172.21.15.19:0/1410149460 wait complete. 2024-09-10T22:34:01.049 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:00.940+0000 7f3132d5b740 20 client.16842 trim_cache size 0 max 16384 2024-09-10T22:34:01.049 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:00.955+0000 7f3132d5b740 1 Processor -- start 2024-09-10T22:34:01.049 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:00.955+0000 7f3132d5b740 1 -- start start 2024-09-10T22:34:01.049 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:00.956+0000 7f3132d5b740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56367f49b4d0 0x56367f4a3380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:34:01.049 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:00.956+0000 7f3132d5b740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56367f49bdf0 0x56367f4a38c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:34:01.049 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:00.956+0000 7f3132d5b740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x56367f4a7d80 0x56367f4a9170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:34:01.049 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:00.956+0000 7f3132d5b740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f312c1aec80 con 0x56367f49bdf0 2024-09-10T22:34:01.049 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:00.956+0000 7f3132d5b740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f312c1ac550 con 0x56367f49b4d0 2024-09-10T22:34:01.049 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:00.956+0000 7f3132d5b740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f312c1aa3a0 con 0x56367f4a7d80 2024-09-10T22:34:01.049 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:00.956+0000 7f3129d9b640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56367f49bdf0 0x56367f4a38c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:34:01.049 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:00.956+0000 7f312ad9d640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56367f49b4d0 0x56367f4a3380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:34:01.049 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:00.956+0000 7f3129d9b640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56367f49bdf0 0x56367f4a38c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:42100/0 (socket says 172.21.15.19:42100) 2024-09-10T22:34:01.049 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:00.956+0000 7f3129d9b640 1 -- 172.21.15.19:0/2753122609 learned_addr learned my addr 172.21.15.19:0/2753122609 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:34:01.050 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:00.956+0000 7f312ad9d640 1 --2- 172.21.15.19:0/2753122609 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x56367f4a7d80 0x56367f4a9170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:34:01.050 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:00.956+0000 7f3129d9b640 1 -- 172.21.15.19:0/2753122609 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x56367f4a7d80 msgr2=0x56367f4a9170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:34:01.050 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:00.956+0000 7f3129d9b640 1 --2- 172.21.15.19:0/2753122609 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x56367f4a7d80 0x56367f4a9170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:34:01.050 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:00.956+0000 7f3129d9b640 1 -- 172.21.15.19:0/2753122609 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56367f49b4d0 msgr2=0x56367f4a3380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:34:01.050 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:00.956+0000 7f3129d9b640 1 --2- 172.21.15.19:0/2753122609 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56367f49b4d0 0x56367f4a3380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:34:01.050 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:00.956+0000 7f3129d9b640 1 -- 172.21.15.19:0/2753122609 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56367f499d80 con 0x56367f49bdf0 2024-09-10T22:34:01.050 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:00.956+0000 7f312ad9d640 1 --2- 172.21.15.19:0/2753122609 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56367f49b4d0 0x56367f4a3380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T22:34:01.050 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:00.956+0000 7f3129d9b640 1 --2- 172.21.15.19:0/2753122609 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56367f49bdf0 0x56367f4a38c0 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7f3120004ba0 tx=0x7f312002a410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b6c9f5872f08185b server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:34:01.050 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:00.957+0000 7f3113fff640 1 -- 172.21.15.19:0/2753122609 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3120035030 con 0x56367f49bdf0 2024-09-10T22:34:01.050 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:00.957+0000 7f3113fff640 1 -- 172.21.15.19:0/2753122609 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f31200048c0 con 0x56367f49bdf0 2024-09-10T22:34:01.050 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:00.957+0000 7f3113fff640 1 -- 172.21.15.19:0/2753122609 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3120004d90 con 0x56367f49bdf0 2024-09-10T22:34:01.050 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:00.957+0000 7f3132d5b740 1 -- 172.21.15.19:0/2753122609 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56367f49bdf0 msgr2=0x56367f4a38c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:34:01.050 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:00.957+0000 7f3132d5b740 1 --2- 172.21.15.19:0/2753122609 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56367f49bdf0 0x56367f4a38c0 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7f3120004ba0 tx=0x7f312002a410 comp rx=0 tx=0).stop 2024-09-10T22:34:01.051 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:00.958+0000 7f3132d5b740 1 -- 172.21.15.19:0/2753122609 shutdown_connections 2024-09-10T22:34:01.051 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:00.958+0000 7f3132d5b740 1 --2- 172.21.15.19:0/2753122609 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x56367f4a7d80 0x56367f4a9170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:34:01.051 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:00.958+0000 7f3132d5b740 1 --2- 172.21.15.19:0/2753122609 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56367f49bdf0 0x56367f4a38c0 unknown :-1 s=CLOSED pgs=718 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:34:01.051 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:00.958+0000 7f3132d5b740 1 --2- 172.21.15.19:0/2753122609 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56367f49b4d0 0x56367f4a3380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:34:01.051 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:00.958+0000 7f3132d5b740 1 -- 172.21.15.19:0/2753122609 >> 172.21.15.19:0/2753122609 conn(0x56367f499300 msgr2=0x56367f49a430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:34:01.051 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:00.958+0000 7f3132d5b740 1 -- 172.21.15.19:0/2753122609 shutdown_connections 2024-09-10T22:34:01.051 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:00.958+0000 7f3132d5b740 1 -- 172.21.15.19:0/2753122609 wait complete. 2024-09-10T22:34:01.051 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:00.958+0000 7f3132d5b740 1 -- start start 2024-09-10T22:34:01.051 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:00.958+0000 7f3132d5b740 1 Processor -- start 2024-09-10T22:34:01.051 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:00.958+0000 7f3132d5b740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56367f49b4d0 0x56367f4b8710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:34:01.051 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:00.958+0000 7f3132d5b740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x56367f49bdf0 0x56367f4b8c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:34:01.051 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:00.958+0000 7f3132d5b740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56367f4a7d80 0x56367f4b34e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:34:01.051 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:00.958+0000 7f3132d5b740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f312c1aaa10 con 0x56367f4a7d80 2024-09-10T22:34:01.051 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:00.958+0000 7f3132d5b740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f312c1abe80 con 0x56367f49b4d0 2024-09-10T22:34:01.051 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:00.958+0000 7f3132d5b740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f312c1ab0e0 con 0x56367f49bdf0 2024-09-10T22:34:01.052 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:00.958+0000 7f3132d5b740 10 client.0 _ll_register_callbacks cb 0x7f3120009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T22:34:01.052 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:00.959+0000 7f312ad9d640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56367f49b4d0 0x56367f4b8710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:34:01.052 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:00.959+0000 7f312ad9d640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56367f4a7d80 0x56367f4b34e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:34:01.052 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:00.959+0000 7f312ad9d640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56367f4a7d80 0x56367f4b34e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:42114/0 (socket says 172.21.15.19:42114) 2024-09-10T22:34:01.052 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:00.959+0000 7f312ad9d640 1 -- 172.21.15.19:0/2566613214 learned_addr learned my addr 172.21.15.19:0/2566613214 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:34:01.052 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:00.959+0000 7f3129d9b640 1 --2- 172.21.15.19:0/2566613214 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x56367f49bdf0 0x56367f4b8c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:34:01.052 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:00.959+0000 7f312ad9d640 1 -- 172.21.15.19:0/2566613214 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x56367f49bdf0 msgr2=0x56367f4b8c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:34:01.052 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:00.959+0000 7f312ad9d640 1 --2- 172.21.15.19:0/2566613214 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x56367f49bdf0 0x56367f4b8c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:34:01.052 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:00.959+0000 7f312ad9d640 1 -- 172.21.15.19:0/2566613214 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56367f49b4d0 msgr2=0x56367f4b8710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:34:01.052 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:00.959+0000 7f312ad9d640 1 --2- 172.21.15.19:0/2566613214 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56367f49b4d0 0x56367f4b8710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:34:01.052 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:00.959+0000 7f312ad9d640 1 -- 172.21.15.19:0/2566613214 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56367f494990 con 0x56367f4a7d80 2024-09-10T22:34:01.052 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:00.959+0000 7f312ad9d640 1 --2- 172.21.15.19:0/2566613214 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56367f4a7d80 0x56367f4b34e0 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7f3124009730 tx=0x7f3124009500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8577724e340748fe server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:34:01.052 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:00.959+0000 7f3111ffb640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-10T22:34:01.053 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:00.959+0000 7f3111ffb640 1 -- 172.21.15.19:0/2566613214 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f312400fdd0 con 0x56367f4a7d80 2024-09-10T22:34:01.053 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:00.959+0000 7f3111ffb640 1 -- 172.21.15.19:0/2566613214 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8327+0+0 (secure 0 0 0) 0x7f3124005270 con 0x56367f4a7d80 2024-09-10T22:34:01.053 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:00.959+0000 7f3132d5b740 1 -- 172.21.15.19:0/2566613214 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f31200048c0 con 0x56367f4a7d80 2024-09-10T22:34:01.053 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:00.960+0000 7f3111ffb640 1 -- 172.21.15.19:0/2566613214 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f3124005470 con 0x56367f4a7d80 2024-09-10T22:34:01.053 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:00.960+0000 7f3132d5b740 10 client.16848 fetch_fsmap learned FSMap version 27 2024-09-10T22:34:01.053 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:00.960+0000 7f3132d5b740 1 -- 172.21.15.19:0/2566613214 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x56367f52d5b0 con 0x56367f4a7d80 2024-09-10T22:34:01.053 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:00.960+0000 7f3111ffb640 1 -- 172.21.15.19:0/2566613214 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f31200048c0 con 0x56367f4a7d80 2024-09-10T22:34:01.053 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:00.960+0000 7f3111ffb640 1 -- 172.21.15.19:0/2566613214 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7f3124028040 con 0x56367f4a7d80 2024-09-10T22:34:01.053 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:00.960+0000 7f3132d5b740 10 client.16848 fetch_fsmap finished waiting for FSMap version 27 2024-09-10T22:34:01.053 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:00.960+0000 7f3132d5b740 10 client.16848 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-10T22:34:01.053 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:00.960+0000 7f3132d5b740 20 client.16848 populate_metadata read hostname 'smithi019' 2024-09-10T22:34:01.053 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:00.960+0000 7f3132d5b740 1 --2- 172.21.15.19:0/2566613214 >> [v2:172.21.15.138:6836/3353290042,v1:172.21.15.138:6837/3353290042] conn(0x56367f52db00 0x56367f52ff20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:34:01.054 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:00.960+0000 7f3132d5b740 4 client.16848 mds_command: new command op to 24553 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-10T22:34:01.054 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:00.960+0000 7f3132d5b740 1 -- 172.21.15.19:0/2566613214 --> [v2:172.21.15.138:6836/3353290042,v1:172.21.15.138:6837/3353290042] -- command(tid 0: {"prefix": "damage ls"}) -- 0x56367f40f8a0 con 0x56367f52db00 2024-09-10T22:34:01.054 INFO:teuthology.orchestra.run.smithi019.stdout:[] 2024-09-10T22:34:01.054 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:00.960+0000 7f3129d9b640 1 --2- 172.21.15.19:0/2566613214 >> [v2:172.21.15.138:6836/3353290042,v1:172.21.15.138:6837/3353290042] conn(0x56367f52db00 0x56367f52ff20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:34:01.054 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:00.961+0000 7f3129d9b640 1 --2- 172.21.15.19:0/2566613214 >> [v2:172.21.15.138:6836/3353290042,v1:172.21.15.138:6837/3353290042] conn(0x56367f52db00 0x56367f52ff20 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=b42b9792632c8dd9 server_cookie=15f680a1fd146d02 in_seq=0 out_seq=0 2024-09-10T22:34:01.055 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:00.961+0000 7f3111ffb640 10 client.16848 ms_handle_connect on v2:172.21.15.138:6836/3353290042 2024-09-10T22:34:01.055 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:00.961+0000 7f3111ffb640 1 -- 172.21.15.19:0/2566613214 <== mds.2 v2:172.21.15.138:6836/3353290042 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x56367f40f8a0 con 0x56367f52db00 2024-09-10T22:34:01.055 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:00.961+0000 7f3111ffb640 10 client.16848 handle_command_reply: tid=0 2024-09-10T22:34:01.055 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:00.961+0000 7f3132d5b740 1 client.16848 shutdown 2024-09-10T22:34:01.055 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:00.961+0000 7f3132d5b740 1 -- 172.21.15.19:0/2566613214 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56367f4a7d80 msgr2=0x56367f4b34e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:34:01.055 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:00.961+0000 7f3132d5b740 1 --2- 172.21.15.19:0/2566613214 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56367f4a7d80 0x56367f4b34e0 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7f3124009730 tx=0x7f3124009500 comp rx=0 tx=0).stop 2024-09-10T22:34:01.055 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:00.961+0000 7f3132d5b740 1 -- 172.21.15.19:0/2566613214 shutdown_connections 2024-09-10T22:34:01.055 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:00.961+0000 7f3132d5b740 1 --2- 172.21.15.19:0/2566613214 >> [v2:172.21.15.138:6836/3353290042,v1:172.21.15.138:6837/3353290042] conn(0x56367f52db00 0x56367f52ff20 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:34:01.055 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:00.961+0000 7f3132d5b740 1 --2- 172.21.15.19:0/2566613214 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56367f4a7d80 0x56367f4b34e0 unknown :-1 s=CLOSED pgs=719 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:34:01.055 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:00.961+0000 7f3111ffb640 0 client.16848 ms_handle_reset on v2:172.21.15.138:6836/3353290042 2024-09-10T22:34:01.055 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:00.961+0000 7f3132d5b740 1 --2- 172.21.15.19:0/2566613214 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x56367f49bdf0 0x56367f4b8c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:34:01.055 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:00.961+0000 7f3132d5b740 1 --2- 172.21.15.19:0/2566613214 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56367f49b4d0 0x56367f4b8710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:34:01.055 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:00.961+0000 7f3132d5b740 1 -- 172.21.15.19:0/2566613214 >> 172.21.15.19:0/2566613214 conn(0x56367f499300 msgr2=0x56367f49a3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:34:01.055 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:00.961+0000 7f3132d5b740 1 -- 172.21.15.19:0/2566613214 shutdown_connections 2024-09-10T22:34:01.056 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:00.961+0000 7f3132d5b740 1 -- 172.21.15.19:0/2566613214 wait complete. 2024-09-10T22:34:01.056 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:00.962+0000 7f3132d5b740 20 client.16848 trim_cache size 0 max 16384 2024-09-10T22:34:01.056 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:00.962+0000 7f3130986640 1 -- 172.21.15.19:0/831296484 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f31140b5360 msgr2=0x7f31140b7820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:34:01.056 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:00.962+0000 7f3130986640 1 --2- 172.21.15.19:0/831296484 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f31140b5360 0x7f31140b7820 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f311c0e3ca0 tx=0x7f311c009700 comp rx=0 tx=0).stop 2024-09-10T22:34:01.056 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:00.962+0000 7f3130986640 1 -- 172.21.15.19:0/831296484 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f312c102de0 msgr2=0x7f312c199290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:34:01.056 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:00.962+0000 7f3130986640 1 --2- 172.21.15.19:0/831296484 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f312c102de0 0x7f312c199290 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7f311c00e9f0 tx=0x7f311c00eeb0 comp rx=0 tx=0).stop 2024-09-10T22:34:01.056 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:00.962+0000 7f3130986640 1 -- 172.21.15.19:0/831296484 shutdown_connections 2024-09-10T22:34:01.056 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:00.962+0000 7f3130986640 1 --2- 172.21.15.19:0/831296484 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f31140b5360 0x7f31140b7820 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:34:01.056 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:00.962+0000 7f3130986640 1 --2- 172.21.15.19:0/831296484 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f312c109170 0x7f312c19eb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:34:01.057 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:00.962+0000 7f3130986640 1 --2- 172.21.15.19:0/831296484 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f312c1087f0 0x7f312c1997d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:34:01.057 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:00.963+0000 7f3130986640 1 --2- 172.21.15.19:0/831296484 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f312c102de0 0x7f312c199290 unknown :-1 s=CLOSED pgs=716 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:34:01.057 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:00.963+0000 7f3130986640 1 -- 172.21.15.19:0/831296484 >> 172.21.15.19:0/831296484 conn(0x7f312c0fe870 msgr2=0x7f312c100c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:34:01.057 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:00.963+0000 7f3130986640 1 -- 172.21.15.19:0/831296484 shutdown_connections 2024-09-10T22:34:01.057 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:00.963+0000 7f3130986640 1 -- 172.21.15.19:0/831296484 wait complete. 2024-09-10T22:34:01.958 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:34:01 smithi019 ceph-mon[31375]: pgmap v575: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 683 KiB/s rd, 278 MiB/s wr, 771 op/s 2024-09-10T22:34:02.110 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:34:01 smithi135 ceph-mon[34789]: pgmap v575: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 683 KiB/s rd, 278 MiB/s wr, 771 op/s 2024-09-10T22:34:02.125 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:34:01 smithi138 ceph-mon[35236]: pgmap v575: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 683 KiB/s rd, 278 MiB/s wr, 771 op/s 2024-09-10T22:34:02.192 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 22997a4c-6fc2-11ef-bcea-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-09-10T22:34:02.542 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/22997a4c-6fc2-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T22:34:03.580 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:03.545+0000 7f2046ec5640 1 -- 172.21.15.19:0/262537466 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f204010a150 msgr2=0x7f20401111b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:34:03.581 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:03.545+0000 7f2046ec5640 1 --2- 172.21.15.19:0/262537466 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f204010a150 0x7f20401111b0 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7f2038009ca0 tx=0x7f203802a960 comp rx=0 tx=0).stop 2024-09-10T22:34:03.581 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:03.545+0000 7f2046ec5640 1 -- 172.21.15.19:0/262537466 shutdown_connections 2024-09-10T22:34:03.581 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:03.545+0000 7f2046ec5640 1 --2- 172.21.15.19:0/262537466 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f204011c0a0 0x7f204011e490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:34:03.581 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:03.545+0000 7f2046ec5640 1 --2- 172.21.15.19:0/262537466 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f204010a530 0x7f204010a930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:34:03.581 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:03.545+0000 7f2046ec5640 1 --2- 172.21.15.19:0/262537466 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f204010a150 0x7f20401111b0 unknown :-1 s=CLOSED pgs=720 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:34:03.581 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:03.545+0000 7f2046ec5640 1 -- 172.21.15.19:0/262537466 >> 172.21.15.19:0/262537466 conn(0x7f204006dfc0 msgr2=0x7f204006e3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:34:03.581 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:03.546+0000 7f2046ec5640 1 -- 172.21.15.19:0/262537466 shutdown_connections 2024-09-10T22:34:03.581 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:03.546+0000 7f2046ec5640 1 -- 172.21.15.19:0/262537466 wait complete. 2024-09-10T22:34:03.581 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:03.547+0000 7f2046ec5640 1 Processor -- start 2024-09-10T22:34:03.581 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:03.547+0000 7f2046ec5640 1 -- start start 2024-09-10T22:34:03.581 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:03.548+0000 7f2046ec5640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f204010a150 0x7f20401a81a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:34:03.581 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:03.548+0000 7f2046ec5640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f204010a530 0x7f20401a86e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:34:03.582 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:03.548+0000 7f2046ec5640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f204011c0a0 0x7f20401ada80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:34:03.582 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:03.548+0000 7f2046ec5640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f2040121c90 con 0x7f204010a150 2024-09-10T22:34:03.582 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:03.548+0000 7f2046ec5640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f2040121b10 con 0x7f204010a530 2024-09-10T22:34:03.582 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:03.548+0000 7f2046ec5640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f2040121e10 con 0x7f204011c0a0 2024-09-10T22:34:03.582 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:03.549+0000 7f2045462640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f204011c0a0 0x7f20401ada80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:34:03.582 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:03.549+0000 7f2045462640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f204011c0a0 0x7f20401ada80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.19:46740/0 (socket says 172.21.15.19:46740) 2024-09-10T22:34:03.582 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:03.549+0000 7f2045462640 1 -- 172.21.15.19:0/14437698 learned_addr learned my addr 172.21.15.19:0/14437698 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:34:03.582 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:03.549+0000 7f2044c61640 1 --2- 172.21.15.19:0/14437698 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f204010a150 0x7f20401a81a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:34:03.582 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:03.549+0000 7f2045462640 1 -- 172.21.15.19:0/14437698 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f204010a530 msgr2=0x7f20401a86e0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-10T22:34:03.582 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:03.549+0000 7f2045462640 1 --2- 172.21.15.19:0/14437698 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f204010a530 0x7f20401a86e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:34:03.582 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:03.549+0000 7f2045462640 1 -- 172.21.15.19:0/14437698 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f204010a150 msgr2=0x7f20401a81a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:34:03.583 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:03.549+0000 7f2045462640 1 --2- 172.21.15.19:0/14437698 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f204010a150 0x7f20401a81a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:34:03.583 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:03.550+0000 7f2045462640 1 -- 172.21.15.19:0/14437698 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f20401ae250 con 0x7f204011c0a0 2024-09-10T22:34:03.583 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:03.550+0000 7f2045462640 1 --2- 172.21.15.19:0/14437698 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f204011c0a0 0x7f20401ada80 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f2034009fd0 tx=0x7f203400b8e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:34:03.583 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:03.551+0000 7f203dffb640 1 -- 172.21.15.19:0/14437698 <== mon.1 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2034011830 con 0x7f204011c0a0 2024-09-10T22:34:03.583 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:03.551+0000 7f203dffb640 1 -- 172.21.15.19:0/14437698 <== mon.1 v2:172.21.15.138:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2034016070 con 0x7f204011c0a0 2024-09-10T22:34:03.583 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:03.552+0000 7f2046ec5640 1 -- 172.21.15.19:0/14437698 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f20401ae540 con 0x7f204011c0a0 2024-09-10T22:34:03.583 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:03.552+0000 7f2046ec5640 1 -- 172.21.15.19:0/14437698 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f20401b4c80 con 0x7f204011c0a0 2024-09-10T22:34:03.583 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:03.553+0000 7f203dffb640 1 -- 172.21.15.19:0/14437698 <== mon.1 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2034010de0 con 0x7f204011c0a0 2024-09-10T22:34:03.583 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:03.556+0000 7f204929a740 1 Processor -- start 2024-09-10T22:34:03.583 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:03.557+0000 7f203dffb640 1 -- 172.21.15.19:0/14437698 <== mon.1 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 18) ==== 153250+0+0 (secure 0 0 0) 0x7f2034010380 con 0x7f204011c0a0 2024-09-10T22:34:03.583 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:03.557+0000 7f204929a740 1 -- start start 2024-09-10T22:34:03.583 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:03.557+0000 7f204929a740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x564dfd7754d0 0x564dfd7758b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:34:03.583 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:03.557+0000 7f204929a740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564dfd775df0 0x564dfd781840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:34:03.583 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:03.557+0000 7f204929a740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x564dfd781d80 0x564dfd784170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:34:03.584 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:03.557+0000 7f204929a740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x564dfd6ebea0 con 0x564dfd7754d0 2024-09-10T22:34:03.584 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:03.557+0000 7f204929a740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x564dfd6db2d0 con 0x564dfd775df0 2024-09-10T22:34:03.584 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:03.557+0000 7f204929a740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x564dfd6df0e0 con 0x564dfd781d80 2024-09-10T22:34:03.587 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:03.557+0000 7f203ffff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x564dfd7754d0 0x564dfd7758b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:34:03.587 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:03.557+0000 7f203ffff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x564dfd7754d0 0x564dfd7758b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:38890/0 (socket says 172.21.15.19:38890) 2024-09-10T22:34:03.587 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:03.557+0000 7f203ffff640 1 -- 172.21.15.19:0/2792061799 learned_addr learned my addr 172.21.15.19:0/2792061799 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:34:03.587 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:03.558+0000 7f2044c61640 1 --2- 172.21.15.19:0/2792061799 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564dfd775df0 0x564dfd781840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:34:03.588 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:03.558+0000 7f203ffff640 1 --2- 172.21.15.19:0/2792061799 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x564dfd781d80 0x564dfd784170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:34:03.588 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:03.558+0000 7f203ffff640 1 -- 172.21.15.19:0/2792061799 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x564dfd781d80 msgr2=0x564dfd784170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:34:03.588 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:03.558+0000 7f203ffff640 1 --2- 172.21.15.19:0/2792061799 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x564dfd781d80 0x564dfd784170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:34:03.588 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:03.558+0000 7f203ffff640 1 -- 172.21.15.19:0/2792061799 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564dfd775df0 msgr2=0x564dfd781840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:34:03.588 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:03.558+0000 7f203ffff640 1 --2- 172.21.15.19:0/2792061799 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564dfd775df0 0x564dfd781840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:34:03.588 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:03.558+0000 7f203ffff640 1 -- 172.21.15.19:0/2792061799 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564dfd439650 con 0x564dfd7754d0 2024-09-10T22:34:03.588 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:03.558+0000 7f203ffff640 1 --2- 172.21.15.19:0/2792061799 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x564dfd7754d0 0x564dfd7758b0 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7f2030009ce0 tx=0x7f2030009240 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5362facbc0f43f1a server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:34:03.588 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:03.558+0000 7f2026ffd640 1 -- 172.21.15.19:0/2792061799 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f203000c050 con 0x564dfd7754d0 2024-09-10T22:34:03.588 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:03.558+0000 7f2026ffd640 1 -- 172.21.15.19:0/2792061799 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2030010040 con 0x564dfd7754d0 2024-09-10T22:34:03.589 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:03.558+0000 7f2026ffd640 1 -- 172.21.15.19:0/2792061799 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f203000f040 con 0x564dfd7754d0 2024-09-10T22:34:03.589 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:03.558+0000 7f203dffb640 1 --2- 172.21.15.19:0/14437698 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f20280b52c0 0x7f20280b7780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:34:03.589 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:03.559+0000 7f2044c61640 1 --2- 172.21.15.19:0/14437698 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f20280b52c0 0x7f20280b7780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:34:03.589 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:03.559+0000 7f203dffb640 1 -- 172.21.15.19:0/14437698 <== mon.1 v2:172.21.15.138:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8327+0+0 (secure 0 0 0) 0x7f20340e4d20 con 0x7f204011c0a0 2024-09-10T22:34:03.589 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:03.559+0000 7f204929a740 1 -- 172.21.15.19:0/2792061799 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x564dfd7754d0 msgr2=0x564dfd7758b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:34:03.589 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:03.559+0000 7f204929a740 1 --2- 172.21.15.19:0/2792061799 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x564dfd7754d0 0x564dfd7758b0 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7f2030009ce0 tx=0x7f2030009240 comp rx=0 tx=0).stop 2024-09-10T22:34:03.589 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:03.559+0000 7f2044c61640 1 --2- 172.21.15.19:0/14437698 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f20280b52c0 0x7f20280b7780 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f203802aed0 tx=0x7f203802ae60 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:34:03.589 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:03.559+0000 7f204929a740 1 -- 172.21.15.19:0/2792061799 shutdown_connections 2024-09-10T22:34:03.589 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:03.559+0000 7f204929a740 1 --2- 172.21.15.19:0/2792061799 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x564dfd781d80 0x564dfd784170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:34:03.589 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:03.559+0000 7f204929a740 1 --2- 172.21.15.19:0/2792061799 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564dfd775df0 0x564dfd781840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:34:03.589 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:03.559+0000 7f204929a740 1 --2- 172.21.15.19:0/2792061799 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x564dfd7754d0 0x564dfd7758b0 unknown :-1 s=CLOSED pgs=721 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:34:03.589 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:03.559+0000 7f204929a740 1 -- 172.21.15.19:0/2792061799 >> 172.21.15.19:0/2792061799 conn(0x564dfd773300 msgr2=0x564dfd7744a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:34:03.589 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:03.559+0000 7f204929a740 1 -- 172.21.15.19:0/2792061799 shutdown_connections 2024-09-10T22:34:03.590 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:03.559+0000 7f204929a740 1 -- 172.21.15.19:0/2792061799 wait complete. 2024-09-10T22:34:03.590 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:03.560+0000 7f204929a740 1 -- start start 2024-09-10T22:34:03.590 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:03.560+0000 7f204929a740 1 Processor -- start 2024-09-10T22:34:03.590 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:03.561+0000 7f204929a740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x564dfd7754d0 0x564dfd781640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:34:03.590 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:03.561+0000 7f204929a740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564dfd775df0 0x564dfd77ea90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:34:03.590 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:03.561+0000 7f204929a740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x564dfd781d80 0x564dfd77f070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:34:03.590 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:03.561+0000 7f204929a740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x564dfd53c700 con 0x564dfd7754d0 2024-09-10T22:34:03.590 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:03.561+0000 7f204929a740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x564dfd676160 con 0x564dfd775df0 2024-09-10T22:34:03.590 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:03.561+0000 7f204929a740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x564dfd784a00 con 0x564dfd781d80 2024-09-10T22:34:03.590 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:03.561+0000 7f204929a740 10 client.0 _ll_register_callbacks cb 0x564dfd68f9e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T22:34:03.590 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:03.561+0000 7f2045462640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x564dfd781d80 0x564dfd77f070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:34:03.591 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:03.561+0000 7f2045462640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x564dfd781d80 0x564dfd77f070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.19:46756/0 (socket says 172.21.15.19:46756) 2024-09-10T22:34:03.591 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:03.561+0000 7f2045462640 1 -- 172.21.15.19:0/4150230867 learned_addr learned my addr 172.21.15.19:0/4150230867 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:34:03.591 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:03.561+0000 7f2044c61640 1 --2- 172.21.15.19:0/4150230867 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x564dfd7754d0 0x564dfd781640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:34:03.591 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:03.561+0000 7f203ffff640 1 --2- 172.21.15.19:0/4150230867 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564dfd775df0 0x564dfd77ea90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:34:03.591 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:03.561+0000 7f2045462640 1 -- 172.21.15.19:0/4150230867 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564dfd775df0 msgr2=0x564dfd77ea90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:34:03.591 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:03.561+0000 7f2045462640 1 --2- 172.21.15.19:0/4150230867 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564dfd775df0 0x564dfd77ea90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:34:03.591 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:03.561+0000 7f2045462640 1 -- 172.21.15.19:0/4150230867 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x564dfd7754d0 msgr2=0x564dfd781640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:34:03.591 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:03.562+0000 7f2045462640 1 --2- 172.21.15.19:0/4150230867 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x564dfd7754d0 0x564dfd781640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:34:03.591 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:03.562+0000 7f2045462640 1 -- 172.21.15.19:0/4150230867 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564dfd6a3c90 con 0x564dfd781d80 2024-09-10T22:34:03.591 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:03.562+0000 7f2044c61640 1 --2- 172.21.15.19:0/4150230867 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x564dfd7754d0 0x564dfd781640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T22:34:03.591 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:03.562+0000 7f2045462640 1 --2- 172.21.15.19:0/4150230867 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x564dfd781d80 0x564dfd77f070 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f20340a86f0 tx=0x7f20340aad20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d9b62efa28b733b8 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:34:03.591 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:03.562+0000 7f201ffff640 10 client.0 ms_handle_connect on v2:172.21.15.138:3300/0 2024-09-10T22:34:03.591 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:03.562+0000 7f201ffff640 1 -- 172.21.15.19:0/4150230867 <== mon.1 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20340cce60 con 0x564dfd781d80 2024-09-10T22:34:03.592 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:03.562+0000 7f201ffff640 1 -- 172.21.15.19:0/4150230867 <== mon.1 v2:172.21.15.138:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8327+0+0 (secure 0 0 0) 0x7f20340aa6e0 con 0x564dfd781d80 2024-09-10T22:34:03.592 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:03.562+0000 7f204929a740 1 -- 172.21.15.19:0/4150230867 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2030010040 con 0x564dfd781d80 2024-09-10T22:34:03.592 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:03.562+0000 7f201ffff640 1 -- 172.21.15.19:0/4150230867 <== mon.1 v2:172.21.15.138:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f20340abb80 con 0x564dfd781d80 2024-09-10T22:34:03.592 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:03.563+0000 7f204929a740 10 client.26227 fetch_fsmap learned FSMap version 27 2024-09-10T22:34:03.592 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:03.563+0000 7f204929a740 1 -- 172.21.15.19:0/4150230867 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x564dfd790330 con 0x564dfd781d80 2024-09-10T22:34:03.592 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:03.563+0000 7f201ffff640 1 -- 172.21.15.19:0/4150230867 <== mon.1 v2:172.21.15.138:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2030010040 con 0x564dfd781d80 2024-09-10T22:34:03.592 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:03.563+0000 7f201ffff640 1 -- 172.21.15.19:0/4150230867 <== mon.1 v2:172.21.15.138:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7f20340d21b0 con 0x564dfd781d80 2024-09-10T22:34:03.592 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:03.563+0000 7f204929a740 10 client.26227 fetch_fsmap finished waiting for FSMap version 27 2024-09-10T22:34:03.592 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:03.563+0000 7f204929a740 10 client.26227 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-10T22:34:03.593 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:03.563+0000 7f204929a740 20 client.26227 populate_metadata read hostname 'smithi019' 2024-09-10T22:34:03.593 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:03.563+0000 7f204929a740 1 --2- 172.21.15.19:0/4150230867 >> [v2:172.21.15.138:6838/383637208,v1:172.21.15.138:6839/383637208] conn(0x564dfd791790 0x564dfd793b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:34:03.593 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:03.563+0000 7f204929a740 4 client.26227 mds_command: new command op to 24568 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T22:34:03.593 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:03.563+0000 7f204929a740 1 -- 172.21.15.19:0/4150230867 --> [v2:172.21.15.138:6838/383637208,v1:172.21.15.138:6839/383637208] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564dfd6eddf0 con 0x564dfd791790 2024-09-10T22:34:03.593 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:03.563+0000 7f2044c61640 1 --2- 172.21.15.19:0/4150230867 >> [v2:172.21.15.138:6838/383637208,v1:172.21.15.138:6839/383637208] conn(0x564dfd791790 0x564dfd793b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:34:03.593 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:03.564+0000 7f201ffff640 10 client.26227 ms_handle_connect on v2:172.21.15.138:6838/383637208 2024-09-10T22:34:03.593 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:03.564+0000 7f2044c61640 1 --2- 172.21.15.19:0/4150230867 >> [v2:172.21.15.138:6838/383637208,v1:172.21.15.138:6839/383637208] conn(0x564dfd791790 0x564dfd793b80 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=f511a371ddc06278 server_cookie=1c214283a6a724aa in_seq=0 out_seq=0 2024-09-10T22:34:03.593 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:03.565+0000 7f201ffff640 1 -- 172.21.15.19:0/4150230867 <== mds.1 v2:172.21.15.138:6838/383637208 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x564dfd6eddf0 con 0x564dfd791790 2024-09-10T22:34:03.593 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:03.565+0000 7f201ffff640 10 client.26227 handle_command_reply: tid=0 2024-09-10T22:34:03.593 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:03.565+0000 7f204929a740 1 client.26227 shutdown 2024-09-10T22:34:03.593 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:03.565+0000 7f204929a740 1 -- 172.21.15.19:0/4150230867 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x564dfd781d80 msgr2=0x564dfd77f070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:34:03.593 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:03.565+0000 7f204929a740 1 --2- 172.21.15.19:0/4150230867 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x564dfd781d80 0x564dfd77f070 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f20340a86f0 tx=0x7f20340aad20 comp rx=0 tx=0).stop 2024-09-10T22:34:03.594 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:03.565+0000 7f204929a740 1 -- 172.21.15.19:0/4150230867 shutdown_connections 2024-09-10T22:34:03.594 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:03.565+0000 7f204929a740 1 --2- 172.21.15.19:0/4150230867 >> [v2:172.21.15.138:6838/383637208,v1:172.21.15.138:6839/383637208] conn(0x564dfd791790 0x564dfd793b80 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:34:03.594 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:03.565+0000 7f204929a740 1 --2- 172.21.15.19:0/4150230867 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x564dfd781d80 0x564dfd77f070 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:34:03.594 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:03.565+0000 7f204929a740 1 --2- 172.21.15.19:0/4150230867 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564dfd775df0 0x564dfd77ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:34:03.594 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:03.565+0000 7f201ffff640 0 client.26227 ms_handle_reset on v2:172.21.15.138:6838/383637208 2024-09-10T22:34:03.594 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:03.565+0000 7f204929a740 1 --2- 172.21.15.19:0/4150230867 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x564dfd7754d0 0x564dfd781640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:34:03.594 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:03.565+0000 7f204929a740 1 -- 172.21.15.19:0/4150230867 >> 172.21.15.19:0/4150230867 conn(0x564dfd773300 msgr2=0x564dfd778e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:34:03.594 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:03.565+0000 7f204929a740 1 -- 172.21.15.19:0/4150230867 shutdown_connections 2024-09-10T22:34:03.594 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:03.565+0000 7f204929a740 1 -- 172.21.15.19:0/4150230867 wait complete. 2024-09-10T22:34:03.594 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:03.565+0000 7f204929a740 20 client.26227 trim_cache size 0 max 16384 2024-09-10T22:34:03.595 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:03.581+0000 7f204929a740 1 Processor -- start 2024-09-10T22:34:03.595 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:03.581+0000 7f204929a740 1 -- start start 2024-09-10T22:34:03.595 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:03.581+0000 7f204929a740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x564dfd7754d0 0x564dfd78dc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:34:03.595 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:03.581+0000 7f204929a740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x564dfd775df0 0x564dfd7840a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:34:03.595 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:03.581+0000 7f204929a740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564dfd781d80 0x564dfd7807d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:34:03.595 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:03.581+0000 7f204929a740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f20401bfa80 con 0x564dfd7754d0 2024-09-10T22:34:03.595 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:03.581+0000 7f204929a740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f20401bd350 con 0x564dfd781d80 2024-09-10T22:34:03.595 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:03.581+0000 7f204929a740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f20401bb1a0 con 0x564dfd775df0 2024-09-10T22:34:03.595 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:03.582+0000 7f2044c61640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x564dfd7754d0 0x564dfd78dc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:34:03.595 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:03.582+0000 7f2044c61640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x564dfd7754d0 0x564dfd78dc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:38918/0 (socket says 172.21.15.19:38918) 2024-09-10T22:34:03.595 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:03.582+0000 7f2045462640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564dfd781d80 0x564dfd7807d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:34:03.596 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:03.582+0000 7f2044c61640 1 -- 172.21.15.19:0/1943325040 learned_addr learned my addr 172.21.15.19:0/1943325040 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:34:03.596 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:03.582+0000 7f203ffff640 1 --2- 172.21.15.19:0/1943325040 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x564dfd775df0 0x564dfd7840a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:34:03.596 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:03.582+0000 7f2044c61640 1 -- 172.21.15.19:0/1943325040 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x564dfd775df0 msgr2=0x564dfd7840a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:34:03.596 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:03.582+0000 7f2044c61640 1 --2- 172.21.15.19:0/1943325040 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x564dfd775df0 0x564dfd7840a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:34:03.596 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:03.582+0000 7f2044c61640 1 -- 172.21.15.19:0/1943325040 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564dfd781d80 msgr2=0x564dfd7807d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:34:03.596 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:03.582+0000 7f2044c61640 1 --2- 172.21.15.19:0/1943325040 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564dfd781d80 0x564dfd7807d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:34:03.596 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:03.582+0000 7f2044c61640 1 -- 172.21.15.19:0/1943325040 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564dfd781110 con 0x564dfd7754d0 2024-09-10T22:34:03.596 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:03.582+0000 7f203ffff640 1 --2- 172.21.15.19:0/1943325040 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x564dfd775df0 0x564dfd7840a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T22:34:03.596 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:03.582+0000 7f2044c61640 1 --2- 172.21.15.19:0/1943325040 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x564dfd7754d0 0x564dfd78dc60 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7f2038009bf0 tx=0x7f2038041000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=577173d055108c10 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:34:03.596 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:03.582+0000 7f20267fc640 1 -- 172.21.15.19:0/1943325040 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2038034040 con 0x564dfd7754d0 2024-09-10T22:34:03.596 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:03.582+0000 7f20267fc640 1 -- 172.21.15.19:0/1943325040 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2038059920 con 0x564dfd7754d0 2024-09-10T22:34:03.596 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:03.582+0000 7f20267fc640 1 -- 172.21.15.19:0/1943325040 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20380398f0 con 0x564dfd7754d0 2024-09-10T22:34:03.597 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:03.583+0000 7f204929a740 1 -- 172.21.15.19:0/1943325040 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x564dfd7754d0 msgr2=0x564dfd78dc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:34:03.597 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:03.583+0000 7f204929a740 1 --2- 172.21.15.19:0/1943325040 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x564dfd7754d0 0x564dfd78dc60 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7f2038009bf0 tx=0x7f2038041000 comp rx=0 tx=0).stop 2024-09-10T22:34:03.597 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:03.583+0000 7f204929a740 1 -- 172.21.15.19:0/1943325040 shutdown_connections 2024-09-10T22:34:03.597 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:03.583+0000 7f204929a740 1 --2- 172.21.15.19:0/1943325040 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564dfd781d80 0x564dfd7807d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:34:03.597 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:03.583+0000 7f204929a740 1 --2- 172.21.15.19:0/1943325040 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x564dfd775df0 0x564dfd7840a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:34:03.597 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:03.583+0000 7f204929a740 1 --2- 172.21.15.19:0/1943325040 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x564dfd7754d0 0x564dfd78dc60 unknown :-1 s=CLOSED pgs=722 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:34:03.597 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:03.583+0000 7f204929a740 1 -- 172.21.15.19:0/1943325040 >> 172.21.15.19:0/1943325040 conn(0x564dfd773300 msgr2=0x564dfd7800c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:34:03.597 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:03.583+0000 7f204929a740 1 -- 172.21.15.19:0/1943325040 shutdown_connections 2024-09-10T22:34:03.597 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:03.583+0000 7f204929a740 1 -- 172.21.15.19:0/1943325040 wait complete. 2024-09-10T22:34:03.597 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:03.584+0000 7f204929a740 1 -- start start 2024-09-10T22:34:03.598 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:03.584+0000 7f204929a740 1 Processor -- start 2024-09-10T22:34:03.598 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:03.584+0000 7f204929a740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x564dfd7754d0 0x564dfd789eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:34:03.598 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:03.584+0000 7f204929a740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564dfd775df0 0x564dfd78a3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:34:03.598 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:03.584+0000 7f204929a740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x564dfd781d80 0x564dfd784c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:34:03.598 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:03.584+0000 7f204929a740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f20401bb810 con 0x564dfd781d80 2024-09-10T22:34:03.598 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:03.584+0000 7f204929a740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f20401bcc80 con 0x564dfd775df0 2024-09-10T22:34:03.598 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:03.584+0000 7f204929a740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f20401bbee0 con 0x564dfd7754d0 2024-09-10T22:34:03.598 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:03.584+0000 7f204929a740 10 client.0 _ll_register_callbacks cb 0x7f20340a7b50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T22:34:03.598 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:03.584+0000 7f203ffff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564dfd775df0 0x564dfd78a3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:34:03.598 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:03.584+0000 7f2045462640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x564dfd781d80 0x564dfd784c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:34:03.599 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:03.584+0000 7f203ffff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564dfd775df0 0x564dfd78a3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.19:43202/0 (socket says 172.21.15.19:43202) 2024-09-10T22:34:03.599 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:03.584+0000 7f203ffff640 1 -- 172.21.15.19:0/2912828651 learned_addr learned my addr 172.21.15.19:0/2912828651 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:34:03.599 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:03.585+0000 7f2044c61640 1 --2- 172.21.15.19:0/2912828651 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x564dfd7754d0 0x564dfd789eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:34:03.599 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:03.585+0000 7f203ffff640 1 -- 172.21.15.19:0/2912828651 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x564dfd7754d0 msgr2=0x564dfd789eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:34:03.599 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:03.585+0000 7f203ffff640 1 --2- 172.21.15.19:0/2912828651 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x564dfd7754d0 0x564dfd789eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:34:03.599 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:03.585+0000 7f203ffff640 1 -- 172.21.15.19:0/2912828651 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x564dfd781d80 msgr2=0x564dfd784c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:34:03.599 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:03.585+0000 7f203ffff640 1 --2- 172.21.15.19:0/2912828651 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x564dfd781d80 0x564dfd784c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:34:03.599 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:03.585+0000 7f203ffff640 1 -- 172.21.15.19:0/2912828651 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564dfd7852c0 con 0x564dfd775df0 2024-09-10T22:34:03.599 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:03.585+0000 7f2045462640 1 --2- 172.21.15.19:0/2912828651 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x564dfd781d80 0x564dfd784c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T22:34:03.599 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:03.585+0000 7f203ffff640 1 --2- 172.21.15.19:0/2912828651 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564dfd775df0 0x564dfd78a3f0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f2030003740 tx=0x7f20300098f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=117750f21ae98f85 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:34:03.600 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:03.585+0000 7f201ffff640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-09-10T22:34:03.603 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:03.585+0000 7f201ffff640 1 -- 172.21.15.19:0/2912828651 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f203000c040 con 0x564dfd775df0 2024-09-10T22:34:03.603 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:03.585+0000 7f201ffff640 1 -- 172.21.15.19:0/2912828651 <== mon.2 v2:172.21.15.135:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8327+0+0 (secure 0 0 0) 0x7f2030016630 con 0x564dfd775df0 2024-09-10T22:34:03.603 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:03.585+0000 7f204929a740 1 -- 172.21.15.19:0/2912828651 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2038059920 con 0x564dfd775df0 2024-09-10T22:34:03.603 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:03.586+0000 7f201ffff640 1 -- 172.21.15.19:0/2912828651 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f2030034050 con 0x564dfd775df0 2024-09-10T22:34:03.603 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:03.586+0000 7f204929a740 10 client.26204 fetch_fsmap learned FSMap version 27 2024-09-10T22:34:03.603 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:03.586+0000 7f204929a740 1 -- 172.21.15.19:0/2912828651 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x564dfd7fef70 con 0x564dfd775df0 2024-09-10T22:34:03.603 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:03.586+0000 7f201ffff640 1 -- 172.21.15.19:0/2912828651 <== mon.2 v2:172.21.15.135:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2038059920 con 0x564dfd775df0 2024-09-10T22:34:03.603 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:03.586+0000 7f201ffff640 1 -- 172.21.15.19:0/2912828651 <== mon.2 v2:172.21.15.135:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7f203002b8b0 con 0x564dfd775df0 2024-09-10T22:34:03.603 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:03.586+0000 7f204929a740 10 client.26204 fetch_fsmap finished waiting for FSMap version 27 2024-09-10T22:34:03.603 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:03.586+0000 7f204929a740 10 client.26204 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-10T22:34:03.603 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:03.586+0000 7f204929a740 20 client.26204 populate_metadata read hostname 'smithi019' 2024-09-10T22:34:03.603 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:03.586+0000 7f204929a740 1 --2- 172.21.15.19:0/2912828651 >> [v2:172.21.15.138:6838/383637208,v1:172.21.15.138:6839/383637208] conn(0x564dfd7ff4e0 0x564dfd801900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:34:03.604 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:03.586+0000 7f204929a740 4 client.26204 mds_command: new command op to 24568 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-10T22:34:03.604 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:03.586+0000 7f204929a740 1 -- 172.21.15.19:0/2912828651 --> [v2:172.21.15.138:6838/383637208,v1:172.21.15.138:6839/383637208] -- command(tid 0: {"prefix": "damage ls"}) -- 0x564dfd6e98a0 con 0x564dfd7ff4e0 2024-09-10T22:34:03.604 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:03.586+0000 7f2044c61640 1 --2- 172.21.15.19:0/2912828651 >> [v2:172.21.15.138:6838/383637208,v1:172.21.15.138:6839/383637208] conn(0x564dfd7ff4e0 0x564dfd801900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:34:03.604 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:03.587+0000 7f201ffff640 10 client.26204 ms_handle_connect on v2:172.21.15.138:6838/383637208 2024-09-10T22:34:03.604 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:03.587+0000 7f2044c61640 1 --2- 172.21.15.19:0/2912828651 >> [v2:172.21.15.138:6838/383637208,v1:172.21.15.138:6839/383637208] conn(0x564dfd7ff4e0 0x564dfd801900 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=3d583d8fe3033dd9 server_cookie=c2db37b700e41843 in_seq=0 out_seq=0 2024-09-10T22:34:03.604 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:03.587+0000 7f201ffff640 1 -- 172.21.15.19:0/2912828651 <== mds.1 v2:172.21.15.138:6838/383637208 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x564dfd6e98a0 con 0x564dfd7ff4e0 2024-09-10T22:34:03.604 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:03.587+0000 7f201ffff640 10 client.26204 handle_command_reply: tid=0 2024-09-10T22:34:03.604 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:03.587+0000 7f204929a740 1 client.26204 shutdown 2024-09-10T22:34:03.604 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:03.587+0000 7f204929a740 1 -- 172.21.15.19:0/2912828651 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564dfd775df0 msgr2=0x564dfd78a3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:34:03.604 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:03.587+0000 7f204929a740 1 --2- 172.21.15.19:0/2912828651 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564dfd775df0 0x564dfd78a3f0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f2030003740 tx=0x7f20300098f0 comp rx=0 tx=0).stop 2024-09-10T22:34:03.604 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:03.587+0000 7f204929a740 1 -- 172.21.15.19:0/2912828651 shutdown_connections 2024-09-10T22:34:03.604 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:03.587+0000 7f204929a740 1 --2- 172.21.15.19:0/2912828651 >> [v2:172.21.15.138:6838/383637208,v1:172.21.15.138:6839/383637208] conn(0x564dfd7ff4e0 0x564dfd801900 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:34:03.604 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:03.588+0000 7f204929a740 1 --2- 172.21.15.19:0/2912828651 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x564dfd781d80 0x564dfd784c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:34:03.605 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:03.588+0000 7f201ffff640 0 client.26204 ms_handle_reset on v2:172.21.15.138:6838/383637208 2024-09-10T22:34:03.605 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:03.588+0000 7f204929a740 1 --2- 172.21.15.19:0/2912828651 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564dfd775df0 0x564dfd78a3f0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:34:03.605 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:03.588+0000 7f204929a740 1 --2- 172.21.15.19:0/2912828651 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x564dfd7754d0 0x564dfd789eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:34:03.605 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:03.588+0000 7f204929a740 1 -- 172.21.15.19:0/2912828651 >> 172.21.15.19:0/2912828651 conn(0x564dfd773300 msgr2=0x564dfd7808e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:34:03.605 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:03.588+0000 7f204929a740 1 -- 172.21.15.19:0/2912828651 shutdown_connections 2024-09-10T22:34:03.605 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:03.588+0000 7f204929a740 1 -- 172.21.15.19:0/2912828651 wait complete. 2024-09-10T22:34:03.605 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:03.588+0000 7f204929a740 20 client.26204 trim_cache size 0 max 16384 2024-09-10T22:34:03.605 INFO:teuthology.orchestra.run.smithi019.stdout:[] 2024-09-10T22:34:03.606 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:03.589+0000 7f2046ec5640 1 -- 172.21.15.19:0/14437698 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f20280b52c0 msgr2=0x7f20280b7780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:34:03.606 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:03.589+0000 7f2046ec5640 1 --2- 172.21.15.19:0/14437698 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f20280b52c0 0x7f20280b7780 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f203802aed0 tx=0x7f203802ae60 comp rx=0 tx=0).stop 2024-09-10T22:34:03.606 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:03.589+0000 7f2046ec5640 1 -- 172.21.15.19:0/14437698 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f204011c0a0 msgr2=0x7f20401ada80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:34:03.606 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:03.589+0000 7f2046ec5640 1 --2- 172.21.15.19:0/14437698 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f204011c0a0 0x7f20401ada80 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f2034009fd0 tx=0x7f203400b8e0 comp rx=0 tx=0).stop 2024-09-10T22:34:03.606 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:03.589+0000 7f2046ec5640 1 -- 172.21.15.19:0/14437698 shutdown_connections 2024-09-10T22:34:03.606 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:03.589+0000 7f2046ec5640 1 --2- 172.21.15.19:0/14437698 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f20280b52c0 0x7f20280b7780 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:34:03.607 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:03.589+0000 7f2046ec5640 1 --2- 172.21.15.19:0/14437698 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f204011c0a0 0x7f20401ada80 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:34:03.607 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:03.589+0000 7f2046ec5640 1 --2- 172.21.15.19:0/14437698 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f204010a530 0x7f20401a86e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:34:03.607 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:03.589+0000 7f2046ec5640 1 --2- 172.21.15.19:0/14437698 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f204010a150 0x7f20401a81a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:34:03.607 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:03.589+0000 7f2046ec5640 1 -- 172.21.15.19:0/14437698 >> 172.21.15.19:0/14437698 conn(0x7f204006dfc0 msgr2=0x7f204011c6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:34:03.607 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:03.589+0000 7f2046ec5640 1 -- 172.21.15.19:0/14437698 shutdown_connections 2024-09-10T22:34:03.607 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:03.589+0000 7f2046ec5640 1 -- 172.21.15.19:0/14437698 wait complete. 2024-09-10T22:34:03.615 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:03.613+0000 7f3025952640 1 -- 172.21.15.19:0/1758731406 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f302006bc90 msgr2=0x7f3020105540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:34:03.615 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:03.613+0000 7f3025952640 1 --2- 172.21.15.19:0/1758731406 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f302006bc90 0x7f3020105540 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f3010009900 tx=0x7f301002a410 comp rx=0 tx=0).stop 2024-09-10T22:34:03.615 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:03.613+0000 7f3025952640 1 -- 172.21.15.19:0/1758731406 shutdown_connections 2024-09-10T22:34:03.615 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:03.613+0000 7f3025952640 1 --2- 172.21.15.19:0/1758731406 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3020108680 0x7f302010ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:34:03.616 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:03.613+0000 7f3025952640 1 --2- 172.21.15.19:0/1758731406 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3020105ad0 0x7f3020107f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:34:03.616 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:03.613+0000 7f3025952640 1 --2- 172.21.15.19:0/1758731406 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f302006bc90 0x7f3020105540 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:34:03.616 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:03.613+0000 7f3025952640 1 -- 172.21.15.19:0/1758731406 >> 172.21.15.19:0/1758731406 conn(0x7f30200fd130 msgr2=0x7f30200ff550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:34:03.616 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:03.613+0000 7f3025952640 1 -- 172.21.15.19:0/1758731406 shutdown_connections 2024-09-10T22:34:03.616 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:03.613+0000 7f3025952640 1 -- 172.21.15.19:0/1758731406 wait complete. 2024-09-10T22:34:03.618 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:03.614+0000 7f3025952640 1 Processor -- start 2024-09-10T22:34:03.618 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:03.614+0000 7f3025952640 1 -- start start 2024-09-10T22:34:03.618 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:03.614+0000 7f3025952640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f302006bc90 0x7f302019af50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:34:03.618 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:03.614+0000 7f3025952640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3020105ad0 0x7f302019b5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:34:03.618 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:03.614+0000 7f3025952640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3020108680 0x7f302019c1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:34:03.618 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:03.614+0000 7f3025952640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f302010e5d0 con 0x7f3020105ad0 2024-09-10T22:34:03.618 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:03.614+0000 7f3025952640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f302010e450 con 0x7f3020108680 2024-09-10T22:34:03.619 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:03.614+0000 7f3025952640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f302010e750 con 0x7f302006bc90 2024-09-10T22:34:03.619 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:03.614+0000 7f301effd640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f302006bc90 0x7f302019af50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:34:03.619 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:03.615+0000 7f301effd640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f302006bc90 0x7f302019af50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.19:46792/0 (socket says 172.21.15.19:46792) 2024-09-10T22:34:03.619 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:03.614+0000 7f3017fff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3020105ad0 0x7f302019b5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:34:03.619 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:03.615+0000 7f301effd640 1 -- 172.21.15.19:0/1851742094 learned_addr learned my addr 172.21.15.19:0/1851742094 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:34:03.619 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:03.615+0000 7f301f7fe640 1 --2- 172.21.15.19:0/1851742094 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3020108680 0x7f302019c1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:34:03.619 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:03.615+0000 7f301effd640 1 -- 172.21.15.19:0/1851742094 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3020108680 msgr2=0x7f302019c1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:34:03.619 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:03.615+0000 7f301effd640 1 --2- 172.21.15.19:0/1851742094 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3020108680 0x7f302019c1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:34:03.619 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:03.615+0000 7f301effd640 1 -- 172.21.15.19:0/1851742094 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3020105ad0 msgr2=0x7f302019b5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:34:03.619 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:03.615+0000 7f301effd640 1 --2- 172.21.15.19:0/1851742094 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3020105ad0 0x7f302019b5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:34:03.619 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:03.615+0000 7f301effd640 1 -- 172.21.15.19:0/1851742094 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f302019ca90 con 0x7f302006bc90 2024-09-10T22:34:03.620 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:03.615+0000 7f301effd640 1 --2- 172.21.15.19:0/1851742094 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f302006bc90 0x7f302019af50 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f3010005940 tx=0x7f30100042f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:34:03.620 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:03.615+0000 7f3024950640 1 -- 172.21.15.19:0/1851742094 <== mon.1 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f301003f030 con 0x7f302006bc90 2024-09-10T22:34:03.620 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:03.616+0000 7f3025952640 1 -- 172.21.15.19:0/1851742094 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f302019cd20 con 0x7f302006bc90 2024-09-10T22:34:03.620 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:03.616+0000 7f3025952640 1 -- 172.21.15.19:0/1851742094 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f30201a3450 con 0x7f302006bc90 2024-09-10T22:34:03.620 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:03.616+0000 7f3024950640 1 -- 172.21.15.19:0/1851742094 <== mon.1 v2:172.21.15.138:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3010003cb0 con 0x7f302006bc90 2024-09-10T22:34:03.620 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:03.616+0000 7f3024950640 1 -- 172.21.15.19:0/1851742094 <== mon.1 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3010035070 con 0x7f302006bc90 2024-09-10T22:34:03.622 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:03.619+0000 7f3024950640 1 -- 172.21.15.19:0/1851742094 <== mon.1 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 18) ==== 153250+0+0 (secure 0 0 0) 0x7f301003b960 con 0x7f302006bc90 2024-09-10T22:34:03.622 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:03.619+0000 7f30287fc740 1 Processor -- start 2024-09-10T22:34:03.623 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:03.619+0000 7f30287fc740 1 -- start start 2024-09-10T22:34:03.623 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:03.619+0000 7f3024950640 1 --2- 172.21.15.19:0/1851742094 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f300c0b53e0 0x7f300c0b78a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:34:03.623 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:03.619+0000 7f30287fc740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x564caf8f2860 0x564caf8f4c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:34:03.623 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:03.619+0000 7f30287fc740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x564caf8f5190 0x564caf8f7580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:34:03.623 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:03.619+0000 7f30287fc740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564caf8f7bd0 0x564caf8fa090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:34:03.623 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:03.619+0000 7f30287fc740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x564caf8646f0 con 0x564caf8f2860 2024-09-10T22:34:03.623 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:03.619+0000 7f30287fc740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x564caf853b20 con 0x564caf8f7bd0 2024-09-10T22:34:03.623 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:03.620+0000 7f30287fc740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x564caf857930 con 0x564caf8f5190 2024-09-10T22:34:03.623 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:03.620+0000 7f3017fff640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x564caf8f5190 0x564caf8f7580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:34:03.623 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:03.620+0000 7f301f7fe640 1 --2- 172.21.15.19:0/1851742094 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f300c0b53e0 0x7f300c0b78a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:34:03.623 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:03.620+0000 7f3017fff640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x564caf8f5190 0x564caf8f7580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.19:46796/0 (socket says 172.21.15.19:46796) 2024-09-10T22:34:03.624 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:03.620+0000 7f3024950640 1 -- 172.21.15.19:0/1851742094 <== mon.1 v2:172.21.15.138:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8327+0+0 (secure 0 0 0) 0x7f30101062a0 con 0x7f302006bc90 2024-09-10T22:34:03.624 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:03.620+0000 7f301effd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x564caf8f2860 0x564caf8f4c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:34:03.624 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:03.620+0000 7f3017fff640 1 -- 172.21.15.19:0/2082308059 learned_addr learned my addr 172.21.15.19:0/2082308059 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:34:03.624 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:03.620+0000 7f301f7fe640 1 --2- 172.21.15.19:0/2082308059 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564caf8f7bd0 0x564caf8fa090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:34:03.624 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:03.620+0000 7f301effd640 1 -- 172.21.15.19:0/2082308059 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x564caf8f5190 msgr2=0x564caf8f7580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:34:03.624 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:03.620+0000 7f301effd640 1 --2- 172.21.15.19:0/2082308059 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x564caf8f5190 0x564caf8f7580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:34:03.624 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:03.620+0000 7f301effd640 1 -- 172.21.15.19:0/2082308059 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564caf8f7bd0 msgr2=0x564caf8fa090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:34:03.624 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:03.620+0000 7f301effd640 1 --2- 172.21.15.19:0/2082308059 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564caf8f7bd0 0x564caf8fa090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:34:03.624 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:03.620+0000 7f301effd640 1 -- 172.21.15.19:0/2082308059 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564caf819530 con 0x564caf8f2860 2024-09-10T22:34:03.624 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:03.620+0000 7f301f7fe640 1 --2- 172.21.15.19:0/2082308059 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564caf8f7bd0 0x564caf8fa090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T22:34:03.625 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:03.620+0000 7f301f7fe640 1 --2- 172.21.15.19:0/1851742094 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f300c0b53e0 0x7f300c0b78a0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f3018009fd0 tx=0x7f3018013770 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:34:03.625 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:03.621+0000 7f301effd640 1 --2- 172.21.15.19:0/2082308059 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x564caf8f2860 0x564caf8f4c50 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7f30100cc750 tx=0x7f30100cc820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=16c4960cad9c5fc4 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:34:03.625 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:03.621+0000 7f3015ffb640 1 -- 172.21.15.19:0/2082308059 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3010049070 con 0x564caf8f2860 2024-09-10T22:34:03.625 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:03.621+0000 7f3015ffb640 1 -- 172.21.15.19:0/2082308059 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f30100cc560 con 0x564caf8f2860 2024-09-10T22:34:03.625 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:03.621+0000 7f3015ffb640 1 -- 172.21.15.19:0/2082308059 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30100d5f30 con 0x564caf8f2860 2024-09-10T22:34:03.628 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:03.622+0000 7f30287fc740 1 -- 172.21.15.19:0/2082308059 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x564caf8f2860 msgr2=0x564caf8f4c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:34:03.628 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:03.622+0000 7f30287fc740 1 --2- 172.21.15.19:0/2082308059 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x564caf8f2860 0x564caf8f4c50 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7f30100cc750 tx=0x7f30100cc820 comp rx=0 tx=0).stop 2024-09-10T22:34:03.629 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:03.622+0000 7f30287fc740 1 -- 172.21.15.19:0/2082308059 shutdown_connections 2024-09-10T22:34:03.629 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:03.622+0000 7f30287fc740 1 --2- 172.21.15.19:0/2082308059 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564caf8f7bd0 0x564caf8fa090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:34:03.629 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:03.622+0000 7f30287fc740 1 --2- 172.21.15.19:0/2082308059 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x564caf8f5190 0x564caf8f7580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:34:03.629 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:03.622+0000 7f30287fc740 1 --2- 172.21.15.19:0/2082308059 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x564caf8f2860 0x564caf8f4c50 unknown :-1 s=CLOSED pgs=723 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:34:03.629 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:03.622+0000 7f30287fc740 1 -- 172.21.15.19:0/2082308059 >> 172.21.15.19:0/2082308059 conn(0x564caf8ed9b0 msgr2=0x564caf8ee740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:34:03.629 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:03.622+0000 7f30287fc740 1 -- 172.21.15.19:0/2082308059 shutdown_connections 2024-09-10T22:34:03.629 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:03.622+0000 7f30287fc740 1 -- 172.21.15.19:0/2082308059 wait complete. 2024-09-10T22:34:03.629 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:03.622+0000 7f30287fc740 1 -- start start 2024-09-10T22:34:03.629 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:03.623+0000 7f30287fc740 1 Processor -- start 2024-09-10T22:34:03.629 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:03.624+0000 7f30287fc740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x564caf8f2860 0x564caf8fbaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:34:03.629 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:03.624+0000 7f30287fc740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x564caf8f5190 0x564caf8fc140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:34:03.630 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:03.624+0000 7f30287fc740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564caf8f7bd0 0x564caf8fcd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:34:03.630 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:03.624+0000 7f30287fc740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x564caf78bab0 con 0x564caf8f5190 2024-09-10T22:34:03.630 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:03.624+0000 7f30287fc740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x564caf7f9730 con 0x564caf8f7bd0 2024-09-10T22:34:03.630 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:03.624+0000 7f30287fc740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x564caf8646f0 con 0x564caf8f2860 2024-09-10T22:34:03.630 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:03.624+0000 7f301effd640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x564caf8f2860 0x564caf8fbaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:34:03.630 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:03.624+0000 7f301effd640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x564caf8f2860 0x564caf8fbaa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.19:46802/0 (socket says 172.21.15.19:46802) 2024-09-10T22:34:03.630 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:03.624+0000 7f301effd640 1 -- 172.21.15.19:0/1161299041 learned_addr learned my addr 172.21.15.19:0/1161299041 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:34:03.630 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:03.624+0000 7f301f7fe640 1 --2- 172.21.15.19:0/1161299041 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564caf8f7bd0 0x564caf8fcd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:34:03.630 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:03.624+0000 7f3017fff640 1 --2- 172.21.15.19:0/1161299041 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x564caf8f5190 0x564caf8fc140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:34:03.630 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:03.624+0000 7f30287fc740 10 client.0 _ll_register_callbacks cb 0x564caf84d6b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T22:34:03.630 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:03.625+0000 7f301effd640 1 -- 172.21.15.19:0/1161299041 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564caf8f7bd0 msgr2=0x564caf8fcd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:34:03.631 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:03.625+0000 7f301effd640 1 --2- 172.21.15.19:0/1161299041 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564caf8f7bd0 0x564caf8fcd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:34:03.631 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:03.625+0000 7f301effd640 1 -- 172.21.15.19:0/1161299041 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x564caf8f5190 msgr2=0x564caf8fc140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:34:03.631 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:03.625+0000 7f301effd640 1 --2- 172.21.15.19:0/1161299041 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x564caf8f5190 0x564caf8fc140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:34:03.631 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:03.625+0000 7f301effd640 1 -- 172.21.15.19:0/1161299041 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564caf5b5790 con 0x564caf8f2860 2024-09-10T22:34:03.631 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:03.625+0000 7f3017fff640 1 --2- 172.21.15.19:0/1161299041 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x564caf8f5190 0x564caf8fc140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T22:34:03.631 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:03.625+0000 7f301effd640 1 --2- 172.21.15.19:0/1161299041 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x564caf8f2860 0x564caf8fbaa0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f3010005c40 tx=0x7f30100c8f70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f4a9f278b037cf14 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:34:03.631 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:03.625+0000 7f2ffeffd640 10 client.0 ms_handle_connect on v2:172.21.15.138:3300/0 2024-09-10T22:34:03.631 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:03.625+0000 7f2ffeffd640 1 -- 172.21.15.19:0/1161299041 <== mon.1 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3010049070 con 0x564caf8f2860 2024-09-10T22:34:03.631 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:03.625+0000 7f2ffeffd640 1 -- 172.21.15.19:0/1161299041 <== mon.1 v2:172.21.15.138:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8327+0+0 (secure 0 0 0) 0x7f30100d11b0 con 0x564caf8f2860 2024-09-10T22:34:03.631 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:03.625+0000 7f30287fc740 1 -- 172.21.15.19:0/1161299041 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f30100cc560 con 0x564caf8f2860 2024-09-10T22:34:03.631 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:03.626+0000 7f2ffeffd640 1 -- 172.21.15.19:0/1161299041 <== mon.1 v2:172.21.15.138:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f30100c81c0 con 0x564caf8f2860 2024-09-10T22:34:03.632 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:03.626+0000 7f30287fc740 10 client.26245 fetch_fsmap learned FSMap version 27 2024-09-10T22:34:03.632 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:03.626+0000 7f30287fc740 1 -- 172.21.15.19:0/1161299041 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x564caf62e620 con 0x564caf8f2860 2024-09-10T22:34:03.632 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:03.626+0000 7f2ffeffd640 1 -- 172.21.15.19:0/1161299041 <== mon.1 v2:172.21.15.138:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f30100cc560 con 0x564caf8f2860 2024-09-10T22:34:03.632 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:03.626+0000 7f2ffeffd640 1 -- 172.21.15.19:0/1161299041 <== mon.1 v2:172.21.15.138:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7f30100f6170 con 0x564caf8f2860 2024-09-10T22:34:03.632 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:03.626+0000 7f30287fc740 10 client.26245 fetch_fsmap finished waiting for FSMap version 27 2024-09-10T22:34:03.632 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:03.626+0000 7f30287fc740 10 client.26245 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-10T22:34:03.632 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:03.626+0000 7f30287fc740 20 client.26245 populate_metadata read hostname 'smithi019' 2024-09-10T22:34:03.632 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:03.626+0000 7f30287fc740 1 --2- 172.21.15.19:0/1161299041 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x564caf9071d0 0x564caf9095c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:34:03.632 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:03.626+0000 7f30287fc740 4 client.26245 mds_command: new command op to 24581 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T22:34:03.632 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:03.626+0000 7f30287fc740 1 -- 172.21.15.19:0/1161299041 --> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564caf866640 con 0x564caf9071d0 2024-09-10T22:34:03.632 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:03.627+0000 7f3017fff640 1 --2- 172.21.15.19:0/1161299041 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x564caf9071d0 0x564caf9095c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:34:03.633 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:03.627+0000 7f3017fff640 1 --2- 172.21.15.19:0/1161299041 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x564caf9071d0 0x564caf9095c0 crc :-1 s=READY pgs=158 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b44e221f1a0e8019 server_cookie=ea1f769d46ce62ab in_seq=0 out_seq=0 2024-09-10T22:34:03.633 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:03.627+0000 7f2ffeffd640 10 client.26245 ms_handle_connect on v2:172.21.15.135:6838/1254769802 2024-09-10T22:34:03.634 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:03.628+0000 7f2ffeffd640 1 -- 172.21.15.19:0/1161299041 <== mds.0 v2:172.21.15.135:6838/1254769802 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x564caf866640 con 0x564caf9071d0 2024-09-10T22:34:03.634 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:03.628+0000 7f2ffeffd640 10 client.26245 handle_command_reply: tid=0 2024-09-10T22:34:03.634 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:03.628+0000 7f30287fc740 1 client.26245 shutdown 2024-09-10T22:34:03.634 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:03.629+0000 7f30287fc740 1 -- 172.21.15.19:0/1161299041 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x564caf8f2860 msgr2=0x564caf8fbaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:34:03.634 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:03.629+0000 7f30287fc740 1 --2- 172.21.15.19:0/1161299041 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x564caf8f2860 0x564caf8fbaa0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f3010005c40 tx=0x7f30100c8f70 comp rx=0 tx=0).stop 2024-09-10T22:34:03.634 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:03.629+0000 7f30287fc740 1 -- 172.21.15.19:0/1161299041 shutdown_connections 2024-09-10T22:34:03.635 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:03.629+0000 7f30287fc740 1 --2- 172.21.15.19:0/1161299041 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564caf8f7bd0 0x564caf8fcd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:34:03.635 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:03.629+0000 7f30287fc740 1 --2- 172.21.15.19:0/1161299041 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x564caf8f5190 0x564caf8fc140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:34:03.635 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:03.629+0000 7f30287fc740 1 --2- 172.21.15.19:0/1161299041 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x564caf9071d0 0x564caf9095c0 crc :-1 s=READY pgs=158 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:34:03.635 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:03.629+0000 7f2ffeffd640 0 client.26245 ms_handle_reset on v2:172.21.15.135:6838/1254769802 2024-09-10T22:34:03.635 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:03.629+0000 7f30287fc740 1 --2- 172.21.15.19:0/1161299041 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x564caf8f2860 0x564caf8fbaa0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:34:03.635 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:03.629+0000 7f30287fc740 1 -- 172.21.15.19:0/1161299041 >> 172.21.15.19:0/1161299041 conn(0x564caf8ed9b0 msgr2=0x564caf8ecbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:34:03.635 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:03.629+0000 7f30287fc740 1 -- 172.21.15.19:0/1161299041 shutdown_connections 2024-09-10T22:34:03.635 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:03.629+0000 7f30287fc740 1 -- 172.21.15.19:0/1161299041 wait complete. 2024-09-10T22:34:03.635 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:03.629+0000 7f30287fc740 20 client.26245 trim_cache size 0 max 16384 2024-09-10T22:34:03.648 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:03.645+0000 7f30287fc740 1 Processor -- start 2024-09-10T22:34:03.649 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:03.645+0000 7f30287fc740 1 -- start start 2024-09-10T22:34:03.649 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:03.646+0000 7f30287fc740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x564caf8f2860 0x564caf8fb640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:34:03.649 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:03.646+0000 7f301effd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x564caf8f2860 0x564caf8fb640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:34:03.649 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:03.646+0000 7f301effd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x564caf8f2860 0x564caf8fb640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:38978/0 (socket says 172.21.15.19:38978) 2024-09-10T22:34:03.649 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:03.646+0000 7f301effd640 1 -- 172.21.15.19:0/3758849830 learned_addr learned my addr 172.21.15.19:0/3758849830 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:34:03.649 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:03.646+0000 7f30287fc740 1 --2- 172.21.15.19:0/3758849830 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x564caf8f5190 0x564caf8f1d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:34:03.649 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:03.646+0000 7f30287fc740 1 --2- 172.21.15.19:0/3758849830 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564caf8f7bd0 0x564caf8f2290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:34:03.649 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:03.646+0000 7f30287fc740 1 -- 172.21.15.19:0/3758849830 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f3000010ef0 con 0x564caf8f2860 2024-09-10T22:34:03.649 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:03.646+0000 7f30287fc740 1 -- 172.21.15.19:0/3758849830 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f300000e7c0 con 0x564caf8f7bd0 2024-09-10T22:34:03.650 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:03.646+0000 7f30287fc740 1 -- 172.21.15.19:0/3758849830 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f300000c610 con 0x564caf8f5190 2024-09-10T22:34:03.650 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:03.646+0000 7f3017fff640 1 --2- 172.21.15.19:0/3758849830 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x564caf8f5190 0x564caf8f1d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:34:03.650 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:03.646+0000 7f301f7fe640 1 --2- 172.21.15.19:0/3758849830 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564caf8f7bd0 0x564caf8f2290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:34:03.650 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:03.646+0000 7f301effd640 1 -- 172.21.15.19:0/3758849830 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x564caf8f5190 msgr2=0x564caf8f1d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:34:03.650 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:03.646+0000 7f301effd640 1 --2- 172.21.15.19:0/3758849830 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x564caf8f5190 0x564caf8f1d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:34:03.650 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:03.646+0000 7f301effd640 1 -- 172.21.15.19:0/3758849830 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564caf8f7bd0 msgr2=0x564caf8f2290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:34:03.650 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:03.646+0000 7f301effd640 1 --2- 172.21.15.19:0/3758849830 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564caf8f7bd0 0x564caf8f2290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:34:03.650 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:03.646+0000 7f301effd640 1 -- 172.21.15.19:0/3758849830 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564caf8f4fc0 con 0x564caf8f2860 2024-09-10T22:34:03.650 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:03.647+0000 7f301effd640 1 --2- 172.21.15.19:0/3758849830 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x564caf8f2860 0x564caf8fb640 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7f30100ccc10 tx=0x7f30100cc820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=17ce73068689ed73 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:34:03.650 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:03.647+0000 7f30157fa640 1 -- 172.21.15.19:0/3758849830 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3010049020 con 0x564caf8f2860 2024-09-10T22:34:03.650 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:03.647+0000 7f30157fa640 1 -- 172.21.15.19:0/3758849830 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f30100cc560 con 0x564caf8f2860 2024-09-10T22:34:03.651 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:03.647+0000 7f30157fa640 1 -- 172.21.15.19:0/3758849830 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30100d11b0 con 0x564caf8f2860 2024-09-10T22:34:03.654 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:03.647+0000 7f30287fc740 1 -- 172.21.15.19:0/3758849830 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x564caf8f2860 msgr2=0x564caf8fb640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:34:03.654 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:03.648+0000 7f30287fc740 1 --2- 172.21.15.19:0/3758849830 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x564caf8f2860 0x564caf8fb640 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7f30100ccc10 tx=0x7f30100cc820 comp rx=0 tx=0).stop 2024-09-10T22:34:03.655 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:03.648+0000 7f30287fc740 1 -- 172.21.15.19:0/3758849830 shutdown_connections 2024-09-10T22:34:03.655 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:03.648+0000 7f30287fc740 1 --2- 172.21.15.19:0/3758849830 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564caf8f7bd0 0x564caf8f2290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:34:03.655 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:03.648+0000 7f30287fc740 1 --2- 172.21.15.19:0/3758849830 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x564caf8f5190 0x564caf8f1d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:34:03.655 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:03.648+0000 7f30287fc740 1 --2- 172.21.15.19:0/3758849830 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x564caf8f2860 0x564caf8fb640 unknown :-1 s=CLOSED pgs=724 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:34:03.655 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:03.648+0000 7f30287fc740 1 -- 172.21.15.19:0/3758849830 >> 172.21.15.19:0/3758849830 conn(0x564caf8ed9b0 msgr2=0x564caf8e8af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:34:03.655 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:03.648+0000 7f30287fc740 1 -- 172.21.15.19:0/3758849830 shutdown_connections 2024-09-10T22:34:03.655 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:03.648+0000 7f30287fc740 1 -- 172.21.15.19:0/3758849830 wait complete. 2024-09-10T22:34:03.656 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:03.648+0000 7f30287fc740 1 -- start start 2024-09-10T22:34:03.656 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:03.648+0000 7f30287fc740 1 Processor -- start 2024-09-10T22:34:03.656 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:03.648+0000 7f30287fc740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x564caf8f2860 0x564caf9030a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:34:03.656 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:03.648+0000 7f30287fc740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564caf8f5190 0x564caf903740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:34:03.656 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:03.648+0000 7f30287fc740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x564caf8f7bd0 0x564caf901de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:34:03.656 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:03.648+0000 7f30287fc740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f300000cc80 con 0x564caf8f7bd0 2024-09-10T22:34:03.656 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:03.648+0000 7f30287fc740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f300000e0f0 con 0x564caf8f5190 2024-09-10T22:34:03.656 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:03.648+0000 7f30287fc740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f300000d350 con 0x564caf8f2860 2024-09-10T22:34:03.656 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:03.648+0000 7f30287fc740 10 client.0 _ll_register_callbacks cb 0x7f3018013640 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T22:34:03.656 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:03.649+0000 7f301f7fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x564caf8f7bd0 0x564caf901de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:34:03.656 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:03.649+0000 7f301f7fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x564caf8f7bd0 0x564caf901de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:38992/0 (socket says 172.21.15.19:38992) 2024-09-10T22:34:03.657 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:03.649+0000 7f3017fff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564caf8f5190 0x564caf903740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:34:03.657 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:03.649+0000 7f301f7fe640 1 -- 172.21.15.19:0/1220280377 learned_addr learned my addr 172.21.15.19:0/1220280377 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:34:03.657 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:03.649+0000 7f301effd640 1 --2- 172.21.15.19:0/1220280377 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x564caf8f2860 0x564caf9030a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:34:03.657 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:03.649+0000 7f301f7fe640 1 -- 172.21.15.19:0/1220280377 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x564caf8f2860 msgr2=0x564caf9030a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:34:03.657 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:03.649+0000 7f301f7fe640 1 --2- 172.21.15.19:0/1220280377 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x564caf8f2860 0x564caf9030a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:34:03.657 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:03.649+0000 7f301f7fe640 1 -- 172.21.15.19:0/1220280377 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564caf8f5190 msgr2=0x564caf903740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:34:03.657 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:03.649+0000 7f301f7fe640 1 --2- 172.21.15.19:0/1220280377 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564caf8f5190 0x564caf903740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:34:03.657 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:03.649+0000 7f301f7fe640 1 -- 172.21.15.19:0/1220280377 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564caf8f78f0 con 0x564caf8f7bd0 2024-09-10T22:34:03.657 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:03.649+0000 7f301f7fe640 1 --2- 172.21.15.19:0/1220280377 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x564caf8f7bd0 0x564caf901de0 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7f3018003bf0 tx=0x7f301801d000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=354051cece754cc2 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:34:03.657 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:03.649+0000 7f2ffeffd640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-10T22:34:03.657 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:03.649+0000 7f2ffeffd640 1 -- 172.21.15.19:0/1220280377 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3018012070 con 0x564caf8f7bd0 2024-09-10T22:34:03.658 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:03.649+0000 7f2ffeffd640 1 -- 172.21.15.19:0/1220280377 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8327+0+0 (secure 0 0 0) 0x7f3018012210 con 0x564caf8f7bd0 2024-09-10T22:34:03.658 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:03.649+0000 7f30287fc740 1 -- 172.21.15.19:0/1220280377 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f30100cc560 con 0x564caf8f7bd0 2024-09-10T22:34:03.658 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:03.649+0000 7f2ffeffd640 1 -- 172.21.15.19:0/1220280377 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f3018010430 con 0x564caf8f7bd0 2024-09-10T22:34:03.658 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:03.649+0000 7f30287fc740 10 client.16884 fetch_fsmap learned FSMap version 27 2024-09-10T22:34:03.658 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:03.649+0000 7f30287fc740 1 -- 172.21.15.19:0/1220280377 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x564caf901350 con 0x564caf8f7bd0 2024-09-10T22:34:03.658 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:03.650+0000 7f2ffeffd640 1 -- 172.21.15.19:0/1220280377 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f30100cc560 con 0x564caf8f7bd0 2024-09-10T22:34:03.658 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:03.650+0000 7f2ffeffd640 1 -- 172.21.15.19:0/1220280377 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7f3018032020 con 0x564caf8f7bd0 2024-09-10T22:34:03.658 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:03.650+0000 7f30287fc740 10 client.16884 fetch_fsmap finished waiting for FSMap version 27 2024-09-10T22:34:03.658 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:03.650+0000 7f30287fc740 10 client.16884 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-10T22:34:03.659 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:03.650+0000 7f30287fc740 20 client.16884 populate_metadata read hostname 'smithi019' 2024-09-10T22:34:03.659 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:03.650+0000 7f30287fc740 1 --2- 172.21.15.19:0/1220280377 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x564caf974510 0x564caf976930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:34:03.659 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:03.650+0000 7f30287fc740 4 client.16884 mds_command: new command op to 24581 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-10T22:34:03.659 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:03.650+0000 7f30287fc740 1 -- 172.21.15.19:0/1220280377 --> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] -- command(tid 0: {"prefix": "flush journal"}) -- 0x564caf8620f0 con 0x564caf974510 2024-09-10T22:34:03.659 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:03.650+0000 7f301effd640 1 --2- 172.21.15.19:0/1220280377 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x564caf974510 0x564caf976930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:34:03.659 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:03.650+0000 7f301effd640 1 --2- 172.21.15.19:0/1220280377 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x564caf974510 0x564caf976930 crc :-1 s=READY pgs=159 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=629e42fc7e083fe4 server_cookie=575f4c6805a6ae48 in_seq=0 out_seq=0 2024-09-10T22:34:03.659 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:03.650+0000 7f2ffeffd640 10 client.16884 ms_handle_connect on v2:172.21.15.135:6838/1254769802 2024-09-10T22:34:04.359 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:34:04 smithi135 ceph-mon[34789]: pgmap v576: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 475 KiB/s rd, 240 MiB/s wr, 673 op/s 2024-09-10T22:34:04.375 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:34:04 smithi138 ceph-mon[35236]: pgmap v576: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 475 KiB/s rd, 240 MiB/s wr, 673 op/s 2024-09-10T22:34:04.458 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:34:04 smithi019 ceph-mon[31375]: pgmap v576: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 475 KiB/s rd, 240 MiB/s wr, 673 op/s 2024-09-10T22:34:04.736 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 22997a4c-6fc2-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-10T22:34:05.047 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/22997a4c-6fc2-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T22:34:06.057 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:05.985+0000 7fbc08af7640 1 -- 172.21.15.19:0/323452212 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbc04103ca0 msgr2=0x7fbc04104080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:34:06.057 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:05.985+0000 7fbc08af7640 1 --2- 172.21.15.19:0/323452212 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbc04103ca0 0x7fbc04104080 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7fbbf4009900 tx=0x7fbbf402a410 comp rx=0 tx=0).stop 2024-09-10T22:34:06.057 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:05.985+0000 7fbc08af7640 1 -- 172.21.15.19:0/323452212 shutdown_connections 2024-09-10T22:34:06.057 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:05.985+0000 7fbc08af7640 1 --2- 172.21.15.19:0/323452212 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fbc0410d100 0x7fbc0410f560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:34:06.057 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:05.985+0000 7fbc08af7640 1 --2- 172.21.15.19:0/323452212 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbc041045c0 0x7fbc0410cab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:34:06.057 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:05.985+0000 7fbc08af7640 1 --2- 172.21.15.19:0/323452212 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbc04103ca0 0x7fbc04104080 unknown :-1 s=CLOSED pgs=726 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:34:06.058 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:05.985+0000 7fbc08af7640 1 -- 172.21.15.19:0/323452212 >> 172.21.15.19:0/323452212 conn(0x7fbc040fd700 msgr2=0x7fbc040ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:34:06.058 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:05.985+0000 7fbc08af7640 1 -- 172.21.15.19:0/323452212 shutdown_connections 2024-09-10T22:34:06.058 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:05.985+0000 7fbc08af7640 1 -- 172.21.15.19:0/323452212 wait complete. 2024-09-10T22:34:06.058 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:05.986+0000 7fbc08af7640 1 Processor -- start 2024-09-10T22:34:06.058 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:05.986+0000 7fbc08af7640 1 -- start start 2024-09-10T22:34:06.058 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:05.986+0000 7fbc08af7640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbc04103ca0 0x7fbc0419b440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:34:06.058 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:05.986+0000 7fbc08af7640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbc041045c0 0x7fbc0419b980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:34:06.058 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:05.986+0000 7fbc08af7640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fbc0410d100 0x7fbc041a0d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:34:06.058 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:05.986+0000 7fbc08af7640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fbc04112d70 con 0x7fbc041045c0 2024-09-10T22:34:06.058 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:05.986+0000 7fbc08af7640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fbc04112bf0 con 0x7fbc04103ca0 2024-09-10T22:34:06.058 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:05.986+0000 7fbc08af7640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7fbc04112ef0 con 0x7fbc0410d100 2024-09-10T22:34:06.058 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:05.986+0000 7fbbfbfff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbc041045c0 0x7fbc0419b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:34:06.059 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:05.986+0000 7fbbfbfff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbc041045c0 0x7fbc0419b980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:39006/0 (socket says 172.21.15.19:39006) 2024-09-10T22:34:06.059 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:05.986+0000 7fbbfbfff640 1 -- 172.21.15.19:0/707218468 learned_addr learned my addr 172.21.15.19:0/707218468 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:34:06.059 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:05.986+0000 7fbc02d9d640 1 --2- 172.21.15.19:0/707218468 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fbc0410d100 0x7fbc041a0d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:34:06.059 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:05.986+0000 7fbc0259c640 1 --2- 172.21.15.19:0/707218468 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbc04103ca0 0x7fbc0419b440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:34:06.059 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:05.987+0000 7fbbfbfff640 1 -- 172.21.15.19:0/707218468 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fbc0410d100 msgr2=0x7fbc041a0d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:34:06.059 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:05.987+0000 7fbbfbfff640 1 --2- 172.21.15.19:0/707218468 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fbc0410d100 0x7fbc041a0d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:34:06.059 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:05.987+0000 7fbbfbfff640 1 -- 172.21.15.19:0/707218468 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbc04103ca0 msgr2=0x7fbc0419b440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:34:06.059 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:05.987+0000 7fbbfbfff640 1 --2- 172.21.15.19:0/707218468 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbc04103ca0 0x7fbc0419b440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:34:06.059 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:05.987+0000 7fbbfbfff640 1 -- 172.21.15.19:0/707218468 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbc041a14f0 con 0x7fbc041045c0 2024-09-10T22:34:06.059 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:05.987+0000 7fbbfbfff640 1 --2- 172.21.15.19:0/707218468 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbc041045c0 0x7fbc0419b980 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7fbbec00e9c0 tx=0x7fbbec00ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:34:06.059 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:05.987+0000 7fbbfb7fe640 1 -- 172.21.15.19:0/707218468 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbbec00ccc0 con 0x7fbc041045c0 2024-09-10T22:34:06.059 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:05.987+0000 7fbc08af7640 1 -- 172.21.15.19:0/707218468 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbc041a17e0 con 0x7fbc041045c0 2024-09-10T22:34:06.059 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:05.987+0000 7fbbfb7fe640 1 -- 172.21.15.19:0/707218468 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbbec0035f0 con 0x7fbc041045c0 2024-09-10T22:34:06.060 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:05.987+0000 7fbbfb7fe640 1 -- 172.21.15.19:0/707218468 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbbec00ce60 con 0x7fbc041045c0 2024-09-10T22:34:06.060 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:05.987+0000 7fbc08af7640 1 -- 172.21.15.19:0/707218468 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbc041a7ea0 con 0x7fbc041045c0 2024-09-10T22:34:06.060 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:05.990+0000 7fbc0aecc740 1 Processor -- start 2024-09-10T22:34:06.060 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:05.990+0000 7fbc0aecc740 1 -- start start 2024-09-10T22:34:06.060 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:05.990+0000 7fbbfb7fe640 1 -- 172.21.15.19:0/707218468 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 18) ==== 153250+0+0 (secure 0 0 0) 0x7fbbec004000 con 0x7fbc041045c0 2024-09-10T22:34:06.060 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:05.990+0000 7fbc0aecc740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55589697c0f0 0x55589697c4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:34:06.060 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:05.990+0000 7fbc0aecc740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55589697ca10 0x555896988460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:34:06.060 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:05.990+0000 7fbc0aecc740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5558969889a0 0x55589698ad90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:34:06.060 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:05.990+0000 7fbc0aecc740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x5558968f2ea0 con 0x55589697c0f0 2024-09-10T22:34:06.060 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:05.990+0000 7fbc0aecc740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x5558968e22d0 con 0x5558969889a0 2024-09-10T22:34:06.060 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:05.990+0000 7fbc0aecc740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x5558968e60e0 con 0x55589697ca10 2024-09-10T22:34:06.061 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:05.991+0000 7fbc0259c640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55589697ca10 0x555896988460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:34:06.061 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:05.991+0000 7fbc0259c640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55589697ca10 0x555896988460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.19:46848/0 (socket says 172.21.15.19:46848) 2024-09-10T22:34:06.061 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:05.991+0000 7fbc02d9d640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55589697c0f0 0x55589697c4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:34:06.061 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:05.991+0000 7fbc0259c640 1 -- 172.21.15.19:0/2573367334 learned_addr learned my addr 172.21.15.19:0/2573367334 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:34:06.061 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:05.991+0000 7fbbfbfff640 1 --2- 172.21.15.19:0/2573367334 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5558969889a0 0x55589698ad90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:34:06.061 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:05.991+0000 7fbc0259c640 1 -- 172.21.15.19:0/2573367334 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5558969889a0 msgr2=0x55589698ad90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:34:06.061 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:05.991+0000 7fbc0259c640 1 --2- 172.21.15.19:0/2573367334 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5558969889a0 0x55589698ad90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:34:06.061 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:05.991+0000 7fbc0259c640 1 -- 172.21.15.19:0/2573367334 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55589697c0f0 msgr2=0x55589697c4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:34:06.061 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:05.991+0000 7fbc0259c640 1 --2- 172.21.15.19:0/2573367334 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55589697c0f0 0x55589697c4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:34:06.061 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:05.991+0000 7fbc0259c640 1 -- 172.21.15.19:0/2573367334 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555896640650 con 0x55589697ca10 2024-09-10T22:34:06.061 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:05.991+0000 7fbc0259c640 1 --2- 172.21.15.19:0/2573367334 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55589697ca10 0x555896988460 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fbbf4009900 tx=0x7fbbf4032b20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=24aa8ab85e48ea18 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:34:06.061 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:05.992+0000 7fbbf8ff9640 1 -- 172.21.15.19:0/2573367334 <== mon.1 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbbf4040070 con 0x55589697ca10 2024-09-10T22:34:06.061 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:05.992+0000 7fbbf8ff9640 1 -- 172.21.15.19:0/2573367334 <== mon.1 v2:172.21.15.138:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbbf4004030 con 0x55589697ca10 2024-09-10T22:34:06.062 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:05.992+0000 7fbbf8ff9640 1 -- 172.21.15.19:0/2573367334 <== mon.1 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbbf4035040 con 0x55589697ca10 2024-09-10T22:34:06.062 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:05.992+0000 7fbbfb7fe640 1 --2- 172.21.15.19:0/707218468 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7fbbf00b52e0 0x7fbbf00b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:34:06.062 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:05.992+0000 7fbc02d9d640 1 --2- 172.21.15.19:0/707218468 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7fbbf00b52e0 0x7fbbf00b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:34:06.062 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:05.992+0000 7fbbfb7fe640 1 -- 172.21.15.19:0/707218468 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8327+0+0 (secure 0 0 0) 0x7fbbec0e5ed0 con 0x7fbc041045c0 2024-09-10T22:34:06.062 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:05.993+0000 7fbc0aecc740 1 -- 172.21.15.19:0/2573367334 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55589697ca10 msgr2=0x555896988460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:34:06.062 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:05.993+0000 7fbc02d9d640 1 --2- 172.21.15.19:0/707218468 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7fbbf00b52e0 0x7fbbf00b77a0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7fbbfc005fd0 tx=0x7fbbfc009500 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:34:06.062 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:05.993+0000 7fbc0aecc740 1 --2- 172.21.15.19:0/2573367334 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55589697ca10 0x555896988460 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fbbf4009900 tx=0x7fbbf4032b20 comp rx=0 tx=0).stop 2024-09-10T22:34:06.062 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:05.993+0000 7fbc0aecc740 1 -- 172.21.15.19:0/2573367334 shutdown_connections 2024-09-10T22:34:06.062 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:05.993+0000 7fbc0aecc740 1 --2- 172.21.15.19:0/2573367334 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5558969889a0 0x55589698ad90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:34:06.062 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:05.993+0000 7fbc0aecc740 1 --2- 172.21.15.19:0/2573367334 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55589697ca10 0x555896988460 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:34:06.062 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:05.993+0000 7fbc0aecc740 1 --2- 172.21.15.19:0/2573367334 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55589697c0f0 0x55589697c4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:34:06.062 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:05.993+0000 7fbc0aecc740 1 -- 172.21.15.19:0/2573367334 >> 172.21.15.19:0/2573367334 conn(0x555896979f20 msgr2=0x55589697b0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:34:06.062 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:05.993+0000 7fbc0aecc740 1 -- 172.21.15.19:0/2573367334 shutdown_connections 2024-09-10T22:34:06.063 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:05.993+0000 7fbc0aecc740 1 -- 172.21.15.19:0/2573367334 wait complete. 2024-09-10T22:34:06.063 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:05.993+0000 7fbc0aecc740 1 -- start start 2024-09-10T22:34:06.063 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:05.993+0000 7fbc0aecc740 1 Processor -- start 2024-09-10T22:34:06.063 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:05.994+0000 7fbc0aecc740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55589697c0f0 0x555896988240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:34:06.063 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:05.994+0000 7fbc0aecc740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55589697ca10 0x555896985690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:34:06.063 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:05.994+0000 7fbc0aecc740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5558969889a0 0x555896985c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:34:06.063 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:05.994+0000 7fbc0aecc740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x555896743700 con 0x55589697c0f0 2024-09-10T22:34:06.063 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:05.994+0000 7fbc0aecc740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55589687d160 con 0x55589697ca10 2024-09-10T22:34:06.063 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:05.994+0000 7fbc0aecc740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x55589698b5c0 con 0x5558969889a0 2024-09-10T22:34:06.063 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:05.994+0000 7fbc0aecc740 10 client.0 _ll_register_callbacks cb 0x5558968969e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T22:34:06.063 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:05.994+0000 7fbc0259c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55589697c0f0 0x555896988240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:34:06.064 INFO:teuthology.orchestra.run.smithi019.stdout:[] 2024-09-10T22:34:06.064 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:05.994+0000 7fbbfbfff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55589697ca10 0x555896985690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:34:06.064 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:05.994+0000 7fbc0259c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55589697c0f0 0x555896988240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:39024/0 (socket says 172.21.15.19:39024) 2024-09-10T22:34:06.064 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:05.994+0000 7fbc0259c640 1 -- 172.21.15.19:0/427701119 learned_addr learned my addr 172.21.15.19:0/427701119 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:34:06.064 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:05.994+0000 7fbc02d9d640 1 --2- 172.21.15.19:0/427701119 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5558969889a0 0x555896985c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:34:06.064 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:05.994+0000 7fbbfbfff640 1 -- 172.21.15.19:0/427701119 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5558969889a0 msgr2=0x555896985c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:34:06.065 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:05.994+0000 7fbbfbfff640 1 --2- 172.21.15.19:0/427701119 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5558969889a0 0x555896985c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:34:06.065 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:05.994+0000 7fbbfbfff640 1 -- 172.21.15.19:0/427701119 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55589697c0f0 msgr2=0x555896988240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:34:06.065 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:05.994+0000 7fbbfbfff640 1 --2- 172.21.15.19:0/427701119 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55589697c0f0 0x555896988240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:34:06.065 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:05.994+0000 7fbbfbfff640 1 -- 172.21.15.19:0/427701119 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5558968aac90 con 0x55589697ca10 2024-09-10T22:34:06.065 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:05.994+0000 7fbc0259c640 1 --2- 172.21.15.19:0/427701119 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55589697c0f0 0x555896988240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T22:34:06.065 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:05.995+0000 7fbbfbfff640 1 --2- 172.21.15.19:0/427701119 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55589697ca10 0x555896985690 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fbbec0e39c0 tx=0x7fbbec0a85d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9eb130a68b1ff399 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:34:06.065 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:05.995+0000 7fbbe9ffb640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-09-10T22:34:06.065 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:05.995+0000 7fbbe9ffb640 1 -- 172.21.15.19:0/427701119 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbbec0ac140 con 0x55589697ca10 2024-09-10T22:34:06.065 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:05.995+0000 7fbbe9ffb640 1 -- 172.21.15.19:0/427701119 <== mon.2 v2:172.21.15.135:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8327+0+0 (secure 0 0 0) 0x7fbbec004320 con 0x55589697ca10 2024-09-10T22:34:06.065 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:05.995+0000 7fbc0aecc740 1 -- 172.21.15.19:0/427701119 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbbf4004030 con 0x55589697ca10 2024-09-10T22:34:06.065 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:05.995+0000 7fbbe9ffb640 1 -- 172.21.15.19:0/427701119 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fbbec0acd30 con 0x55589697ca10 2024-09-10T22:34:06.066 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:05.995+0000 7fbc0aecc740 10 client.26234 fetch_fsmap learned FSMap version 27 2024-09-10T22:34:06.066 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:05.995+0000 7fbc0aecc740 1 -- 172.21.15.19:0/427701119 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x555896996eb0 con 0x55589697ca10 2024-09-10T22:34:06.066 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:05.995+0000 7fbbe9ffb640 1 -- 172.21.15.19:0/427701119 <== mon.2 v2:172.21.15.135:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbbf4004030 con 0x55589697ca10 2024-09-10T22:34:06.066 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:05.995+0000 7fbbe9ffb640 1 -- 172.21.15.19:0/427701119 <== mon.2 v2:172.21.15.135:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7fbbec0a80a0 con 0x55589697ca10 2024-09-10T22:34:06.066 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:05.995+0000 7fbc0aecc740 10 client.26234 fetch_fsmap finished waiting for FSMap version 27 2024-09-10T22:34:06.066 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:05.995+0000 7fbc0aecc740 10 client.26234 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-10T22:34:06.066 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:05.995+0000 7fbc0aecc740 20 client.26234 populate_metadata read hostname 'smithi019' 2024-09-10T22:34:06.066 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:05.995+0000 7fbc0aecc740 1 --2- 172.21.15.19:0/427701119 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x555896998370 0x55589699a7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:34:06.066 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:05.995+0000 7fbc0aecc740 4 client.26234 mds_command: new command op to 24581 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T22:34:06.066 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:05.995+0000 7fbc0aecc740 1 -- 172.21.15.19:0/427701119 --> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5558968f4df0 con 0x555896998370 2024-09-10T22:34:06.066 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:05.996+0000 7fbc0259c640 1 --2- 172.21.15.19:0/427701119 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x555896998370 0x55589699a7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:34:06.066 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:05.996+0000 7fbc0259c640 1 --2- 172.21.15.19:0/427701119 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x555896998370 0x55589699a7e0 crc :-1 s=READY pgs=160 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=767755b7cf5db0f3 server_cookie=366f0b7c0efa80fa in_seq=0 out_seq=0 2024-09-10T22:34:06.066 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:05.996+0000 7fbbe9ffb640 10 client.26234 ms_handle_connect on v2:172.21.15.135:6838/1254769802 2024-09-10T22:34:06.067 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:05.997+0000 7fbbe9ffb640 1 -- 172.21.15.19:0/427701119 <== mds.0 v2:172.21.15.135:6838/1254769802 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5558968f4df0 con 0x555896998370 2024-09-10T22:34:06.067 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:05.997+0000 7fbbe9ffb640 10 client.26234 handle_command_reply: tid=0 2024-09-10T22:34:06.067 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:05.997+0000 7fbc0aecc740 1 client.26234 shutdown 2024-09-10T22:34:06.067 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:05.997+0000 7fbc0aecc740 1 -- 172.21.15.19:0/427701119 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55589697ca10 msgr2=0x555896985690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:34:06.067 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:05.997+0000 7fbc0aecc740 1 --2- 172.21.15.19:0/427701119 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55589697ca10 0x555896985690 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fbbec0e39c0 tx=0x7fbbec0a85d0 comp rx=0 tx=0).stop 2024-09-10T22:34:06.067 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:05.997+0000 7fbc0aecc740 1 -- 172.21.15.19:0/427701119 shutdown_connections 2024-09-10T22:34:06.067 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:05.997+0000 7fbc0aecc740 1 --2- 172.21.15.19:0/427701119 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x555896998370 0x55589699a7e0 crc :-1 s=READY pgs=160 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:34:06.067 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:05.997+0000 7fbc0aecc740 1 --2- 172.21.15.19:0/427701119 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5558969889a0 0x555896985c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:34:06.067 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:05.997+0000 7fbbe9ffb640 0 client.26234 ms_handle_reset on v2:172.21.15.135:6838/1254769802 2024-09-10T22:34:06.067 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:05.997+0000 7fbc0aecc740 1 --2- 172.21.15.19:0/427701119 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55589697ca10 0x555896985690 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:34:06.067 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:05.997+0000 7fbc0aecc740 1 --2- 172.21.15.19:0/427701119 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55589697c0f0 0x555896988240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:34:06.067 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:05.997+0000 7fbc0aecc740 1 -- 172.21.15.19:0/427701119 >> 172.21.15.19:0/427701119 conn(0x555896979f20 msgr2=0x55589697fa90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:34:06.067 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:05.997+0000 7fbc0aecc740 1 -- 172.21.15.19:0/427701119 shutdown_connections 2024-09-10T22:34:06.068 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:05.997+0000 7fbc0aecc740 1 -- 172.21.15.19:0/427701119 wait complete. 2024-09-10T22:34:06.068 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:05.997+0000 7fbc0aecc740 20 client.26234 trim_cache size 0 max 16384 2024-09-10T22:34:06.068 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:06.011+0000 7fbc0aecc740 1 Processor -- start 2024-09-10T22:34:06.068 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:06.011+0000 7fbc0aecc740 1 -- start start 2024-09-10T22:34:06.068 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:06.011+0000 7fbc0aecc740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55589697c0f0 0x555896979760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:34:06.068 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:06.011+0000 7fbc0aecc740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55589697ca10 0x5558969828a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:34:06.068 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:06.011+0000 7fbc0aecc740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5558969889a0 0x555896982de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:34:06.068 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:06.011+0000 7fbc0aecc740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fbc041b2fd0 con 0x5558969889a0 2024-09-10T22:34:06.068 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:06.011+0000 7fbc0aecc740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fbc041b08a0 con 0x55589697c0f0 2024-09-10T22:34:06.068 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:06.011+0000 7fbc0aecc740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7fbc041ae6f0 con 0x55589697ca10 2024-09-10T22:34:06.068 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:06.011+0000 7fbc02d9d640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5558969889a0 0x555896982de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:34:06.068 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:06.011+0000 7fbc02d9d640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5558969889a0 0x555896982de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:39038/0 (socket says 172.21.15.19:39038) 2024-09-10T22:34:06.068 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:06.011+0000 7fbc02d9d640 1 -- 172.21.15.19:0/2773559563 learned_addr learned my addr 172.21.15.19:0/2773559563 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:34:06.069 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:06.011+0000 7fbbfbfff640 1 --2- 172.21.15.19:0/2773559563 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55589697ca10 0x5558969828a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:34:06.069 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:06.011+0000 7fbc0259c640 1 --2- 172.21.15.19:0/2773559563 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55589697c0f0 0x555896979760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:34:06.069 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:06.011+0000 7fbbfbfff640 1 -- 172.21.15.19:0/2773559563 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55589697c0f0 msgr2=0x555896979760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:34:06.069 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:06.011+0000 7fbbfbfff640 1 --2- 172.21.15.19:0/2773559563 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55589697c0f0 0x555896979760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:34:06.069 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:06.011+0000 7fbbfbfff640 1 -- 172.21.15.19:0/2773559563 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5558969889a0 msgr2=0x555896982de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:34:06.069 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:06.011+0000 7fbbfbfff640 1 --2- 172.21.15.19:0/2773559563 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5558969889a0 0x555896982de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:34:06.069 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:06.011+0000 7fbbfbfff640 1 -- 172.21.15.19:0/2773559563 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555896983b90 con 0x55589697ca10 2024-09-10T22:34:06.069 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:06.012+0000 7fbbfbfff640 1 --2- 172.21.15.19:0/2773559563 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55589697ca10 0x5558969828a0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fbbec0e3ce0 tx=0x7fbbec0e96a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e9c3c9bbc2d7049e server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:34:06.069 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:06.012+0000 7fbbebfff640 1 -- 172.21.15.19:0/2773559563 <== mon.1 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbbec0abf80 con 0x55589697ca10 2024-09-10T22:34:06.069 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:06.012+0000 7fbbebfff640 1 -- 172.21.15.19:0/2773559563 <== mon.1 v2:172.21.15.138:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbbec0ac140 con 0x55589697ca10 2024-09-10T22:34:06.069 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:06.012+0000 7fbbebfff640 1 -- 172.21.15.19:0/2773559563 <== mon.1 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbbec0e90c0 con 0x55589697ca10 2024-09-10T22:34:06.069 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:06.013+0000 7fbc0aecc740 1 -- 172.21.15.19:0/2773559563 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55589697ca10 msgr2=0x5558969828a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:34:06.069 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:06.013+0000 7fbc0aecc740 1 --2- 172.21.15.19:0/2773559563 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55589697ca10 0x5558969828a0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fbbec0e3ce0 tx=0x7fbbec0e96a0 comp rx=0 tx=0).stop 2024-09-10T22:34:06.070 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:06.013+0000 7fbc0aecc740 1 -- 172.21.15.19:0/2773559563 shutdown_connections 2024-09-10T22:34:06.070 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:06.013+0000 7fbc0aecc740 1 --2- 172.21.15.19:0/2773559563 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5558969889a0 0x555896982de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:34:06.070 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:06.013+0000 7fbc0aecc740 1 --2- 172.21.15.19:0/2773559563 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55589697ca10 0x5558969828a0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:34:06.070 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:06.013+0000 7fbc0aecc740 1 --2- 172.21.15.19:0/2773559563 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55589697c0f0 0x555896979760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:34:06.070 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:06.013+0000 7fbc0aecc740 1 -- 172.21.15.19:0/2773559563 >> 172.21.15.19:0/2773559563 conn(0x555896979f20 msgr2=0x555896980910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:34:06.070 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:06.013+0000 7fbc0aecc740 1 -- 172.21.15.19:0/2773559563 shutdown_connections 2024-09-10T22:34:06.070 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:06.013+0000 7fbc0aecc740 1 -- 172.21.15.19:0/2773559563 wait complete. 2024-09-10T22:34:06.070 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:06.013+0000 7fbc0aecc740 1 -- start start 2024-09-10T22:34:06.070 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:06.013+0000 7fbc0aecc740 1 Processor -- start 2024-09-10T22:34:06.070 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:06.013+0000 7fbc0aecc740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55589697c0f0 0x55589698cff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:34:06.070 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:06.013+0000 7fbc0aecc740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55589697ca10 0x55589698d530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:34:06.070 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:06.013+0000 7fbc0aecc740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5558969889a0 0x555896a04280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:34:06.070 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:06.013+0000 7fbc0aecc740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fbc041aed60 con 0x55589697ca10 2024-09-10T22:34:06.070 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:06.013+0000 7fbc0aecc740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fbc041b01d0 con 0x5558969889a0 2024-09-10T22:34:06.071 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:06.013+0000 7fbc0aecc740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7fbc041af430 con 0x55589697c0f0 2024-09-10T22:34:06.071 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:06.014+0000 7fbc0aecc740 10 client.0 _ll_register_callbacks cb 0x7fbbec0046c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T22:34:06.071 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:06.014+0000 7fbbfbfff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55589697ca10 0x55589698d530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:34:06.071 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:06.014+0000 7fbbfbfff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55589697ca10 0x55589698d530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:39042/0 (socket says 172.21.15.19:39042) 2024-09-10T22:34:06.071 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:06.014+0000 7fbc0259c640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55589697c0f0 0x55589698cff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:34:06.071 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:06.014+0000 7fbbfbfff640 1 -- 172.21.15.19:0/3638049109 learned_addr learned my addr 172.21.15.19:0/3638049109 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:34:06.071 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:06.014+0000 7fbc02d9d640 1 --2- 172.21.15.19:0/3638049109 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5558969889a0 0x555896a04280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:34:06.071 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:06.014+0000 7fbbfbfff640 1 -- 172.21.15.19:0/3638049109 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55589697c0f0 msgr2=0x55589698cff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:34:06.071 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:06.014+0000 7fbbfbfff640 1 --2- 172.21.15.19:0/3638049109 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55589697c0f0 0x55589698cff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:34:06.071 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:06.014+0000 7fbbfbfff640 1 -- 172.21.15.19:0/3638049109 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5558969889a0 msgr2=0x555896a04280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:34:06.071 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:06.014+0000 7fbbfbfff640 1 --2- 172.21.15.19:0/3638049109 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5558969889a0 0x555896a04280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:34:06.071 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:06.014+0000 7fbbfbfff640 1 -- 172.21.15.19:0/3638049109 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555896a04920 con 0x55589697ca10 2024-09-10T22:34:06.071 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:06.014+0000 7fbc0259c640 1 --2- 172.21.15.19:0/3638049109 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55589697c0f0 0x55589698cff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T22:34:06.072 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:06.014+0000 7fbc02d9d640 1 --2- 172.21.15.19:0/3638049109 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5558969889a0 0x555896a04280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T22:34:06.072 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:06.014+0000 7fbbfbfff640 1 --2- 172.21.15.19:0/3638049109 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55589697ca10 0x55589698d530 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7fbbec0a98a0 tx=0x7fbbec0ab7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=247951a59fd9f30d server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:34:06.072 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:06.014+0000 7fbbe9ffb640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-10T22:34:06.072 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:06.014+0000 7fbbe9ffb640 1 -- 172.21.15.19:0/3638049109 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbbec0d3040 con 0x55589697ca10 2024-09-10T22:34:06.072 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:06.014+0000 7fbbe9ffb640 1 -- 172.21.15.19:0/3638049109 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8327+0+0 (secure 0 0 0) 0x7fbbec0a7f80 con 0x55589697ca10 2024-09-10T22:34:06.072 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:06.014+0000 7fbc0aecc740 1 -- 172.21.15.19:0/3638049109 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbbec0ac140 con 0x55589697ca10 2024-09-10T22:34:06.072 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:06.014+0000 7fbbe9ffb640 1 -- 172.21.15.19:0/3638049109 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fbbec0abf80 con 0x55589697ca10 2024-09-10T22:34:06.072 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:06.015+0000 7fbc0aecc740 10 client.16902 fetch_fsmap learned FSMap version 27 2024-09-10T22:34:06.072 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:06.015+0000 7fbc0aecc740 1 -- 172.21.15.19:0/3638049109 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x555896a04920 con 0x55589697ca10 2024-09-10T22:34:06.072 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:06.015+0000 7fbbe9ffb640 1 -- 172.21.15.19:0/3638049109 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbbec0ac140 con 0x55589697ca10 2024-09-10T22:34:06.072 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:06.015+0000 7fbbe9ffb640 1 -- 172.21.15.19:0/3638049109 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7fbbec0b22a0 con 0x55589697ca10 2024-09-10T22:34:06.072 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:06.015+0000 7fbc0aecc740 10 client.16902 fetch_fsmap finished waiting for FSMap version 27 2024-09-10T22:34:06.072 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:06.015+0000 7fbc0aecc740 10 client.16902 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-10T22:34:06.073 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:06.015+0000 7fbc0aecc740 20 client.16902 populate_metadata read hostname 'smithi019' 2024-09-10T22:34:06.073 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:06.015+0000 7fbc0aecc740 1 --2- 172.21.15.19:0/3638049109 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x555896a05ef0 0x555896a08310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:34:06.073 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:06.015+0000 7fbc0aecc740 4 client.16902 mds_command: new command op to 24581 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-10T22:34:06.073 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:06.015+0000 7fbc0aecc740 1 -- 172.21.15.19:0/3638049109 --> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5558968f08a0 con 0x555896a05ef0 2024-09-10T22:34:06.073 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:06.015+0000 7fbc0259c640 1 --2- 172.21.15.19:0/3638049109 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x555896a05ef0 0x555896a08310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:34:06.073 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:06.016+0000 7fbbe9ffb640 10 client.16902 ms_handle_connect on v2:172.21.15.135:6838/1254769802 2024-09-10T22:34:06.073 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:06.016+0000 7fbc0259c640 1 --2- 172.21.15.19:0/3638049109 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x555896a05ef0 0x555896a08310 crc :-1 s=READY pgs=161 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=81796d2f8ffb2e95 server_cookie=7f551dd35cdfa47e in_seq=0 out_seq=0 2024-09-10T22:34:06.073 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:06.016+0000 7fbbe9ffb640 1 -- 172.21.15.19:0/3638049109 <== mds.0 v2:172.21.15.135:6838/1254769802 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5558968f08a0 con 0x555896a05ef0 2024-09-10T22:34:06.073 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:06.016+0000 7fbbe9ffb640 10 client.16902 handle_command_reply: tid=0 2024-09-10T22:34:06.073 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:06.016+0000 7fbc0aecc740 1 client.16902 shutdown 2024-09-10T22:34:06.073 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:06.016+0000 7fbc0aecc740 1 -- 172.21.15.19:0/3638049109 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55589697ca10 msgr2=0x55589698d530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:34:06.073 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:06.016+0000 7fbc0aecc740 1 --2- 172.21.15.19:0/3638049109 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55589697ca10 0x55589698d530 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7fbbec0a98a0 tx=0x7fbbec0ab7e0 comp rx=0 tx=0).stop 2024-09-10T22:34:06.073 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:06.016+0000 7fbc0aecc740 1 -- 172.21.15.19:0/3638049109 shutdown_connections 2024-09-10T22:34:06.074 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:06.016+0000 7fbc0aecc740 1 --2- 172.21.15.19:0/3638049109 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5558969889a0 0x555896a04280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:34:06.074 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:06.016+0000 7fbc0aecc740 1 --2- 172.21.15.19:0/3638049109 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55589697ca10 0x55589698d530 unknown :-1 s=CLOSED pgs=728 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:34:06.074 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:06.016+0000 7fbc0aecc740 1 --2- 172.21.15.19:0/3638049109 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x555896a05ef0 0x555896a08310 crc :-1 s=READY pgs=161 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:34:06.074 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:06.016+0000 7fbc0aecc740 1 --2- 172.21.15.19:0/3638049109 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55589697c0f0 0x55589698cff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:34:06.074 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:06.016+0000 7fbbe9ffb640 0 client.16902 ms_handle_reset on v2:172.21.15.135:6838/1254769802 2024-09-10T22:34:06.074 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:06.016+0000 7fbc0aecc740 1 -- 172.21.15.19:0/3638049109 >> 172.21.15.19:0/3638049109 conn(0x555896979f20 msgr2=0x55589697ac00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:34:06.074 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:06.016+0000 7fbc0aecc740 1 -- 172.21.15.19:0/3638049109 shutdown_connections 2024-09-10T22:34:06.074 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:06.016+0000 7fbc0aecc740 1 -- 172.21.15.19:0/3638049109 wait complete. 2024-09-10T22:34:06.074 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:06.016+0000 7fbc0aecc740 20 client.16902 trim_cache size 0 max 16384 2024-09-10T22:34:06.074 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:06.017+0000 7fbc08af7640 1 -- 172.21.15.19:0/707218468 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7fbbf00b52e0 msgr2=0x7fbbf00b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:34:06.074 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:06.017+0000 7fbc08af7640 1 --2- 172.21.15.19:0/707218468 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7fbbf00b52e0 0x7fbbf00b77a0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7fbbfc005fd0 tx=0x7fbbfc009500 comp rx=0 tx=0).stop 2024-09-10T22:34:06.074 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:06.017+0000 7fbc08af7640 1 -- 172.21.15.19:0/707218468 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbc041045c0 msgr2=0x7fbc0419b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:34:06.074 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:06.017+0000 7fbc08af7640 1 --2- 172.21.15.19:0/707218468 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbc041045c0 0x7fbc0419b980 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7fbbec00e9c0 tx=0x7fbbec00ee80 comp rx=0 tx=0).stop 2024-09-10T22:34:06.075 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:06.017+0000 7fbc08af7640 1 -- 172.21.15.19:0/707218468 shutdown_connections 2024-09-10T22:34:06.075 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:06.017+0000 7fbc08af7640 1 --2- 172.21.15.19:0/707218468 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7fbbf00b52e0 0x7fbbf00b77a0 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:34:06.075 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:06.017+0000 7fbc08af7640 1 --2- 172.21.15.19:0/707218468 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fbc0410d100 0x7fbc041a0d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:34:06.075 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:06.017+0000 7fbc08af7640 1 --2- 172.21.15.19:0/707218468 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbc041045c0 0x7fbc0419b980 unknown :-1 s=CLOSED pgs=727 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:34:06.075 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:06.017+0000 7fbc08af7640 1 --2- 172.21.15.19:0/707218468 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbc04103ca0 0x7fbc0419b440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:34:06.075 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:06.017+0000 7fbc08af7640 1 -- 172.21.15.19:0/707218468 >> 172.21.15.19:0/707218468 conn(0x7fbc040fd700 msgr2=0x7fbc0410f350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:34:06.075 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:06.017+0000 7fbc08af7640 1 -- 172.21.15.19:0/707218468 shutdown_connections 2024-09-10T22:34:06.075 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:06.017+0000 7fbc08af7640 1 -- 172.21.15.19:0/707218468 wait complete. 2024-09-10T22:34:06.209 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:34:06 smithi019 ceph-mon[31375]: pgmap v577: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 475 KiB/s rd, 259 MiB/s wr, 676 op/s 2024-09-10T22:34:06.360 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:34:06 smithi135 ceph-mon[34789]: pgmap v577: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 475 KiB/s rd, 259 MiB/s wr, 676 op/s 2024-09-10T22:34:06.375 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:34:06 smithi138 ceph-mon[35236]: pgmap v577: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 475 KiB/s rd, 259 MiB/s wr, 676 op/s 2024-09-10T22:34:08.208 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:34:08 smithi019 ceph-mon[31375]: pgmap v578: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 743 KiB/s rd, 314 MiB/s wr, 700 op/s 2024-09-10T22:34:08.260 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-10T22:34:08.260 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 22997a4c-6fc2-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-10T22:34:08.360 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:34:08 smithi135 ceph-mon[34789]: pgmap v578: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 743 KiB/s rd, 314 MiB/s wr, 700 op/s 2024-09-10T22:34:08.375 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:34:08 smithi138 ceph-mon[35236]: pgmap v578: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 743 KiB/s rd, 314 MiB/s wr, 700 op/s 2024-09-10T22:34:08.586 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/22997a4c-6fc2-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T22:34:09.476 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:09.441+0000 7fc57022b640 1 -- 172.21.15.19:0/2590700984 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc5680754c0 msgr2=0x7fc5680758a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:34:09.476 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:09.441+0000 7fc57022b640 1 --2- 172.21.15.19:0/2590700984 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc5680754c0 0x7fc5680758a0 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7fc564009900 tx=0x7fc56402a410 comp rx=0 tx=0).stop 2024-09-10T22:34:09.476 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:09.441+0000 7fc57022b640 1 -- 172.21.15.19:0/2590700984 shutdown_connections 2024-09-10T22:34:09.476 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:09.441+0000 7fc57022b640 1 --2- 172.21.15.19:0/2590700984 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc56810f3f0 0x7fc5681117e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:34:09.477 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:09.441+0000 7fc57022b640 1 --2- 172.21.15.19:0/2590700984 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc568075de0 0x7fc56810eeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:34:09.477 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:09.441+0000 7fc57022b640 1 --2- 172.21.15.19:0/2590700984 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc5680754c0 0x7fc5680758a0 unknown :-1 s=CLOSED pgs=729 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:34:09.477 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:09.441+0000 7fc57022b640 1 -- 172.21.15.19:0/2590700984 >> 172.21.15.19:0/2590700984 conn(0x7fc5680fe870 msgr2=0x7fc568100c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:34:09.477 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:09.441+0000 7fc57022b640 1 -- 172.21.15.19:0/2590700984 shutdown_connections 2024-09-10T22:34:09.477 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:09.441+0000 7fc57022b640 1 -- 172.21.15.19:0/2590700984 wait complete. 2024-09-10T22:34:09.477 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:09.442+0000 7fc57022b640 1 Processor -- start 2024-09-10T22:34:09.477 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:09.442+0000 7fc57022b640 1 -- start start 2024-09-10T22:34:09.477 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:09.442+0000 7fc57022b640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc5680754c0 0x7fc56819b4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:34:09.477 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:09.442+0000 7fc57022b640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc568075de0 0x7fc56819ba30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:34:09.477 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:09.442+0000 7fc57022b640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc56810f3f0 0x7fc5681a0dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:34:09.477 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:09.442+0000 7fc57022b640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fc568115020 con 0x7fc5680754c0 2024-09-10T22:34:09.477 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:09.442+0000 7fc57022b640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fc568114ea0 con 0x7fc56810f3f0 2024-09-10T22:34:09.478 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:09.442+0000 7fc57022b640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7fc5681151a0 con 0x7fc568075de0 2024-09-10T22:34:09.478 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:09.442+0000 7fc56dfc7640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc5680754c0 0x7fc56819b4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:34:09.478 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:09.442+0000 7fc56dfc7640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc5680754c0 0x7fc56819b4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:39056/0 (socket says 172.21.15.19:39056) 2024-09-10T22:34:09.478 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:09.442+0000 7fc56d7c6640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc568075de0 0x7fc56819ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:34:09.478 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:09.442+0000 7fc56dfc7640 1 -- 172.21.15.19:0/938605766 learned_addr learned my addr 172.21.15.19:0/938605766 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:34:09.478 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:09.442+0000 7fc56e7c8640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc56810f3f0 0x7fc5681a0dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:34:09.478 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:09.443+0000 7fc56d7c6640 1 -- 172.21.15.19:0/938605766 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc56810f3f0 msgr2=0x7fc5681a0dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:34:09.478 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:09.443+0000 7fc56d7c6640 1 --2- 172.21.15.19:0/938605766 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc56810f3f0 0x7fc5681a0dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:34:09.478 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:09.443+0000 7fc56d7c6640 1 -- 172.21.15.19:0/938605766 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc5680754c0 msgr2=0x7fc56819b4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:34:09.478 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:09.443+0000 7fc56d7c6640 1 --2- 172.21.15.19:0/938605766 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc5680754c0 0x7fc56819b4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:34:09.478 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:09.443+0000 7fc56d7c6640 1 -- 172.21.15.19:0/938605766 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc5681a15a0 con 0x7fc568075de0 2024-09-10T22:34:09.478 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:09.443+0000 7fc56e7c8640 1 --2- 172.21.15.19:0/938605766 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc56810f3f0 0x7fc5681a0dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T22:34:09.478 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:09.443+0000 7fc56dfc7640 1 --2- 172.21.15.19:0/938605766 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc5680754c0 0x7fc56819b4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T22:34:09.479 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:09.443+0000 7fc56d7c6640 1 --2- 172.21.15.19:0/938605766 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc568075de0 0x7fc56819ba30 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fc55800d6d0 tx=0x7fc55800db90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:34:09.479 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:09.443+0000 7fc55effd640 1 -- 172.21.15.19:0/938605766 <== mon.1 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc558017070 con 0x7fc568075de0 2024-09-10T22:34:09.479 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:09.443+0000 7fc55effd640 1 -- 172.21.15.19:0/938605766 <== mon.1 v2:172.21.15.138:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc558009820 con 0x7fc568075de0 2024-09-10T22:34:09.479 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:09.443+0000 7fc57022b640 1 -- 172.21.15.19:0/938605766 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc5681a1890 con 0x7fc568075de0 2024-09-10T22:34:09.479 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:09.443+0000 7fc55effd640 1 -- 172.21.15.19:0/938605766 <== mon.1 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc558004c40 con 0x7fc568075de0 2024-09-10T22:34:09.479 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:09.443+0000 7fc57022b640 1 -- 172.21.15.19:0/938605766 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc5681a7f50 con 0x7fc568075de0 2024-09-10T22:34:09.479 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:09.447+0000 7fc572600740 1 Processor -- start 2024-09-10T22:34:09.479 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:09.447+0000 7fc572600740 1 -- start start 2024-09-10T22:34:09.479 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:09.447+0000 7fc55effd640 1 -- 172.21.15.19:0/938605766 <== mon.1 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 18) ==== 153250+0+0 (secure 0 0 0) 0x7fc558005220 con 0x7fc568075de0 2024-09-10T22:34:09.479 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:09.447+0000 7fc572600740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560a4b018ee0 0x560a4b0192c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:34:09.479 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:09.447+0000 7fc572600740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x560a4b019800 0x560a4b025250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:34:09.479 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:09.447+0000 7fc572600740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x560a4b025790 0x560a4b027b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:34:09.479 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:09.447+0000 7fc572600740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x560a4af8fe60 con 0x560a4b019800 2024-09-10T22:34:09.480 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:09.447+0000 7fc572600740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x560a4af7f290 con 0x560a4b018ee0 2024-09-10T22:34:09.480 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:09.447+0000 7fc572600740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x560a4af830a0 con 0x560a4b025790 2024-09-10T22:34:09.480 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:09.447+0000 7fc56dfc7640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x560a4b019800 0x560a4b025250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:34:09.480 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:09.447+0000 7fc56dfc7640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x560a4b019800 0x560a4b025250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:39066/0 (socket says 172.21.15.19:39066) 2024-09-10T22:34:09.480 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:09.447+0000 7fc56dfc7640 1 -- 172.21.15.19:0/3783413481 learned_addr learned my addr 172.21.15.19:0/3783413481 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:34:09.480 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:09.447+0000 7fc56d7c6640 1 --2- 172.21.15.19:0/3783413481 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x560a4b025790 0x560a4b027b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:34:09.480 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:09.447+0000 7fc56e7c8640 1 --2- 172.21.15.19:0/3783413481 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560a4b018ee0 0x560a4b0192c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:34:09.480 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:09.448+0000 7fc56e7c8640 1 -- 172.21.15.19:0/3783413481 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x560a4b025790 msgr2=0x560a4b027b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:34:09.480 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:09.448+0000 7fc56e7c8640 1 --2- 172.21.15.19:0/3783413481 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x560a4b025790 0x560a4b027b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:34:09.480 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:09.448+0000 7fc56e7c8640 1 -- 172.21.15.19:0/3783413481 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x560a4b019800 msgr2=0x560a4b025250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:34:09.480 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:09.448+0000 7fc56e7c8640 1 --2- 172.21.15.19:0/3783413481 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x560a4b019800 0x560a4b025250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:34:09.480 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:09.448+0000 7fc56e7c8640 1 -- 172.21.15.19:0/3783413481 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560a4acdd930 con 0x560a4b018ee0 2024-09-10T22:34:09.480 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:09.448+0000 7fc56dfc7640 1 --2- 172.21.15.19:0/3783413481 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x560a4b019800 0x560a4b025250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T22:34:09.481 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:09.448+0000 7fc55effd640 1 --2- 172.21.15.19:0/938605766 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7fc5540b52e0 0x7fc5540b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:34:09.481 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:09.448+0000 7fc56e7c8640 1 --2- 172.21.15.19:0/3783413481 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560a4b018ee0 0x560a4b0192c0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fc56806c9c0 tx=0x7fc560011bf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=755e81f9c9d640e7 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:34:09.481 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:09.448+0000 7fc56dfc7640 1 --2- 172.21.15.19:0/938605766 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7fc5540b52e0 0x7fc5540b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:34:09.481 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:09.448+0000 7fc553fff640 1 -- 172.21.15.19:0/3783413481 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc560004d20 con 0x560a4b018ee0 2024-09-10T22:34:09.481 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:09.448+0000 7fc55effd640 1 -- 172.21.15.19:0/938605766 <== mon.1 v2:172.21.15.138:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8327+0+0 (secure 0 0 0) 0x7fc5580e5680 con 0x7fc568075de0 2024-09-10T22:34:09.481 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:09.448+0000 7fc553fff640 1 -- 172.21.15.19:0/3783413481 <== mon.2 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc560005020 con 0x560a4b018ee0 2024-09-10T22:34:09.481 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:09.448+0000 7fc553fff640 1 -- 172.21.15.19:0/3783413481 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc560019690 con 0x560a4b018ee0 2024-09-10T22:34:09.481 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:09.449+0000 7fc572600740 1 -- 172.21.15.19:0/3783413481 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560a4b018ee0 msgr2=0x560a4b0192c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:34:09.481 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:09.449+0000 7fc56dfc7640 1 --2- 172.21.15.19:0/938605766 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7fc5540b52e0 0x7fc5540b77a0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x560a4b01c060 tx=0x7fc564005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:34:09.481 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:09.449+0000 7fc572600740 1 --2- 172.21.15.19:0/3783413481 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560a4b018ee0 0x560a4b0192c0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fc56806c9c0 tx=0x7fc560011bf0 comp rx=0 tx=0).stop 2024-09-10T22:34:09.481 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:09.449+0000 7fc572600740 1 -- 172.21.15.19:0/3783413481 shutdown_connections 2024-09-10T22:34:09.481 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:09.449+0000 7fc572600740 1 --2- 172.21.15.19:0/3783413481 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x560a4b025790 0x560a4b027b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:34:09.481 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:09.449+0000 7fc572600740 1 --2- 172.21.15.19:0/3783413481 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x560a4b019800 0x560a4b025250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:34:09.482 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:09.449+0000 7fc572600740 1 --2- 172.21.15.19:0/3783413481 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560a4b018ee0 0x560a4b0192c0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:34:09.482 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:09.449+0000 7fc572600740 1 -- 172.21.15.19:0/3783413481 >> 172.21.15.19:0/3783413481 conn(0x560a4b016d10 msgr2=0x560a4b017eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:34:09.482 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:09.449+0000 7fc572600740 1 -- 172.21.15.19:0/3783413481 shutdown_connections 2024-09-10T22:34:09.482 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:09.449+0000 7fc572600740 1 -- 172.21.15.19:0/3783413481 wait complete. 2024-09-10T22:34:09.482 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:09.450+0000 7fc572600740 1 -- start start 2024-09-10T22:34:09.482 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:09.450+0000 7fc572600740 1 Processor -- start 2024-09-10T22:34:09.482 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:09.450+0000 7fc572600740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x560a4b018ee0 0x560a4b0226f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:34:09.482 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:09.450+0000 7fc572600740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560a4b019800 0x560a4b022c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:34:09.482 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:09.450+0000 7fc572600740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x560a4b025790 0x560a4b023170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:34:09.482 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:09.450+0000 7fc572600740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x560a4ade0890 con 0x560a4b025790 2024-09-10T22:34:09.482 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:09.450+0000 7fc572600740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x560a4af19d40 con 0x560a4b019800 2024-09-10T22:34:09.482 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:09.450+0000 7fc572600740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x560a4b028440 con 0x560a4b018ee0 2024-09-10T22:34:09.482 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:09.451+0000 7fc572600740 10 client.0 _ll_register_callbacks cb 0x560a4af7dc80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T22:34:09.483 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:09.451+0000 7fc56dfc7640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x560a4b018ee0 0x560a4b0226f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:34:09.483 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:09.451+0000 7fc56e7c8640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x560a4b025790 0x560a4b023170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:34:09.483 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:09.451+0000 7fc56dfc7640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x560a4b018ee0 0x560a4b0226f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.19:46900/0 (socket says 172.21.15.19:46900) 2024-09-10T22:34:09.483 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:09.451+0000 7fc56dfc7640 1 -- 172.21.15.19:0/1663022703 learned_addr learned my addr 172.21.15.19:0/1663022703 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:34:09.483 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:09.451+0000 7fc56d7c6640 1 --2- 172.21.15.19:0/1663022703 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560a4b019800 0x560a4b022c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:34:09.483 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:09.451+0000 7fc56dfc7640 1 -- 172.21.15.19:0/1663022703 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560a4b019800 msgr2=0x560a4b022c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:34:09.483 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:09.451+0000 7fc56dfc7640 1 --2- 172.21.15.19:0/1663022703 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560a4b019800 0x560a4b022c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:34:09.483 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:09.451+0000 7fc56dfc7640 1 -- 172.21.15.19:0/1663022703 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x560a4b025790 msgr2=0x560a4b023170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:34:09.483 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:09.451+0000 7fc56dfc7640 1 --2- 172.21.15.19:0/1663022703 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x560a4b025790 0x560a4b023170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:34:09.483 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:09.451+0000 7fc56dfc7640 1 -- 172.21.15.19:0/1663022703 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560a4b0317f0 con 0x560a4b018ee0 2024-09-10T22:34:09.483 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:09.451+0000 7fc56e7c8640 1 --2- 172.21.15.19:0/1663022703 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x560a4b025790 0x560a4b023170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T22:34:09.483 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:09.451+0000 7fc56dfc7640 1 --2- 172.21.15.19:0/1663022703 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x560a4b018ee0 0x560a4b0226f0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fc5640096c0 tx=0x7fc564009260 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3c2bd09150657f94 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:34:09.483 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:09.451+0000 7fc5517fa640 10 client.0 ms_handle_connect on v2:172.21.15.138:3300/0 2024-09-10T22:34:09.484 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:09.451+0000 7fc5517fa640 1 -- 172.21.15.19:0/1663022703 <== mon.1 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc564035040 con 0x560a4b018ee0 2024-09-10T22:34:09.484 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:09.451+0000 7fc5517fa640 1 -- 172.21.15.19:0/1663022703 <== mon.1 v2:172.21.15.138:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8327+0+0 (secure 0 0 0) 0x7fc5640318b0 con 0x560a4b018ee0 2024-09-10T22:34:09.484 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:09.451+0000 7fc572600740 1 -- 172.21.15.19:0/1663022703 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc560005020 con 0x560a4b018ee0 2024-09-10T22:34:09.484 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:09.452+0000 7fc5517fa640 1 -- 172.21.15.19:0/1663022703 <== mon.1 v2:172.21.15.138:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fc564031ab0 con 0x560a4b018ee0 2024-09-10T22:34:09.484 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:09.452+0000 7fc572600740 10 client.26281 fetch_fsmap learned FSMap version 27 2024-09-10T22:34:09.484 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:09.452+0000 7fc572600740 1 -- 172.21.15.19:0/1663022703 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x560a4b0341a0 con 0x560a4b018ee0 2024-09-10T22:34:09.484 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:09.452+0000 7fc5517fa640 1 -- 172.21.15.19:0/1663022703 <== mon.1 v2:172.21.15.138:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc560005020 con 0x560a4b018ee0 2024-09-10T22:34:09.484 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:09.452+0000 7fc5517fa640 1 -- 172.21.15.19:0/1663022703 <== mon.1 v2:172.21.15.138:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7fc564044030 con 0x560a4b018ee0 2024-09-10T22:34:09.484 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:09.452+0000 7fc572600740 10 client.26281 fetch_fsmap finished waiting for FSMap version 27 2024-09-10T22:34:09.484 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:09.452+0000 7fc572600740 10 client.26281 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-10T22:34:09.484 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:09.452+0000 7fc572600740 20 client.26281 populate_metadata read hostname 'smithi019' 2024-09-10T22:34:09.484 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:09.452+0000 7fc572600740 1 --2- 172.21.15.19:0/1663022703 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x560a4b0357f0 0x560a4b037be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:34:09.484 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:09.452+0000 7fc572600740 4 client.26281 mds_command: new command op to 24581 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T22:34:09.485 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:09.452+0000 7fc572600740 1 -- 172.21.15.19:0/1663022703 --> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x560a4af91db0 con 0x560a4b0357f0 2024-09-10T22:34:09.485 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:09.452+0000 7fc56d7c6640 1 --2- 172.21.15.19:0/1663022703 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x560a4b0357f0 0x560a4b037be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:34:09.485 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:09.453+0000 7fc5517fa640 10 client.26281 ms_handle_connect on v2:172.21.15.135:6838/1254769802 2024-09-10T22:34:09.485 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:09.453+0000 7fc56d7c6640 1 --2- 172.21.15.19:0/1663022703 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x560a4b0357f0 0x560a4b037be0 crc :-1 s=READY pgs=162 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6a207acdcc3c5d01 server_cookie=1362a0699298b088 in_seq=0 out_seq=0 2024-09-10T22:34:09.485 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:09.453+0000 7fc5517fa640 1 -- 172.21.15.19:0/1663022703 <== mds.0 v2:172.21.15.135:6838/1254769802 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x7fc558085e50 con 0x560a4b0357f0 2024-09-10T22:34:09.485 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:09.453+0000 7fc5517fa640 10 client.26281 handle_command_reply: tid=0 2024-09-10T22:34:09.485 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:09.453+0000 7fc572600740 1 client.26281 shutdown 2024-09-10T22:34:09.485 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:09.454+0000 7fc572600740 1 -- 172.21.15.19:0/1663022703 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x560a4b018ee0 msgr2=0x560a4b0226f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:34:09.485 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:09.454+0000 7fc572600740 1 --2- 172.21.15.19:0/1663022703 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x560a4b018ee0 0x560a4b0226f0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fc5640096c0 tx=0x7fc564009260 comp rx=0 tx=0).stop 2024-09-10T22:34:09.485 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:09.454+0000 7fc572600740 1 -- 172.21.15.19:0/1663022703 shutdown_connections 2024-09-10T22:34:09.485 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:09.454+0000 7fc572600740 1 --2- 172.21.15.19:0/1663022703 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x560a4b025790 0x560a4b023170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:34:09.485 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:09.454+0000 7fc572600740 1 --2- 172.21.15.19:0/1663022703 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560a4b019800 0x560a4b022c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:34:09.485 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:09.454+0000 7fc572600740 1 --2- 172.21.15.19:0/1663022703 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x560a4b0357f0 0x560a4b037be0 crc :-1 s=READY pgs=162 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:34:09.485 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:09.454+0000 7fc572600740 1 --2- 172.21.15.19:0/1663022703 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x560a4b018ee0 0x560a4b0226f0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:34:09.486 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:09.454+0000 7fc5517fa640 0 client.26281 ms_handle_reset on v2:172.21.15.135:6838/1254769802 2024-09-10T22:34:09.486 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:09.454+0000 7fc572600740 1 -- 172.21.15.19:0/1663022703 >> 172.21.15.19:0/1663022703 conn(0x560a4b016d10 msgr2=0x560a4b015f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:34:09.486 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:09.455+0000 7fc572600740 1 -- 172.21.15.19:0/1663022703 shutdown_connections 2024-09-10T22:34:09.486 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:09.455+0000 7fc572600740 1 -- 172.21.15.19:0/1663022703 wait complete. 2024-09-10T22:34:09.486 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:09.455+0000 7fc572600740 20 client.26281 trim_cache size 0 max 16384 2024-09-10T22:34:09.486 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:09.473+0000 7fc572600740 1 Processor -- start 2024-09-10T22:34:09.486 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:09.473+0000 7fc572600740 1 -- start start 2024-09-10T22:34:09.486 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:09.473+0000 7fc572600740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x560a4b018ee0 0x560a4b020220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:34:09.486 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:09.473+0000 7fc572600740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x560a4b019800 0x560a4b017c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:34:09.486 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:09.473+0000 7fc572600740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560a4b025790 0x560a4b018160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:34:09.486 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:09.473+0000 7fc572600740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fc5681b3100 con 0x560a4b019800 2024-09-10T22:34:09.486 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:09.473+0000 7fc572600740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fc5681b09d0 con 0x560a4b025790 2024-09-10T22:34:09.486 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:09.473+0000 7fc572600740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7fc5681ae820 con 0x560a4b018ee0 2024-09-10T22:34:09.487 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:09.473+0000 7fc56d7c6640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x560a4b019800 0x560a4b017c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:34:09.487 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:09.473+0000 7fc56d7c6640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x560a4b019800 0x560a4b017c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:39094/0 (socket says 172.21.15.19:39094) 2024-09-10T22:34:09.487 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:09.473+0000 7fc56d7c6640 1 -- 172.21.15.19:0/2209186869 learned_addr learned my addr 172.21.15.19:0/2209186869 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:34:09.487 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:09.473+0000 7fc56e7c8640 1 --2- 172.21.15.19:0/2209186869 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560a4b025790 0x560a4b018160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:34:09.487 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:09.473+0000 7fc56dfc7640 1 --2- 172.21.15.19:0/2209186869 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x560a4b018ee0 0x560a4b020220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:34:09.487 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:09.474+0000 7fc56d7c6640 1 -- 172.21.15.19:0/2209186869 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x560a4b018ee0 msgr2=0x560a4b020220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:34:09.487 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:09.474+0000 7fc56d7c6640 1 --2- 172.21.15.19:0/2209186869 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x560a4b018ee0 0x560a4b020220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:34:09.487 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:09.474+0000 7fc56d7c6640 1 -- 172.21.15.19:0/2209186869 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560a4b025790 msgr2=0x560a4b018160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:34:09.487 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:09.474+0000 7fc56d7c6640 1 --2- 172.21.15.19:0/2209186869 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560a4b025790 0x560a4b018160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:34:09.487 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:09.474+0000 7fc56d7c6640 1 -- 172.21.15.19:0/2209186869 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560a4b019630 con 0x560a4b019800 2024-09-10T22:34:09.487 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:09.474+0000 7fc56e7c8640 1 --2- 172.21.15.19:0/2209186869 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560a4b025790 0x560a4b018160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T22:34:09.487 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:09.474+0000 7fc56dfc7640 1 --2- 172.21.15.19:0/2209186869 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x560a4b018ee0 0x560a4b020220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T22:34:09.487 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:09.474+0000 7fc56d7c6640 1 --2- 172.21.15.19:0/2209186869 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x560a4b019800 0x560a4b017c20 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7fc558009610 tx=0x7fc5580e7b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b4a6e3439e8c0281 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:34:09.487 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:09.474+0000 7fc5537fe640 1 -- 172.21.15.19:0/2209186869 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc558020040 con 0x560a4b019800 2024-09-10T22:34:09.488 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:09.474+0000 7fc5537fe640 1 -- 172.21.15.19:0/2209186869 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x560a4af91db0 con 0x560a4b019800 2024-09-10T22:34:09.488 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:09.474+0000 7fc5537fe640 1 -- 172.21.15.19:0/2209186869 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc558009cd0 con 0x560a4b019800 2024-09-10T22:34:09.491 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:09.475+0000 7fc572600740 1 -- 172.21.15.19:0/2209186869 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x560a4b019800 msgr2=0x560a4b017c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:34:09.491 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:09.475+0000 7fc572600740 1 --2- 172.21.15.19:0/2209186869 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x560a4b019800 0x560a4b017c20 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7fc558009610 tx=0x7fc5580e7b60 comp rx=0 tx=0).stop 2024-09-10T22:34:09.492 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:09.475+0000 7fc572600740 1 -- 172.21.15.19:0/2209186869 shutdown_connections 2024-09-10T22:34:09.492 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:09.475+0000 7fc572600740 1 --2- 172.21.15.19:0/2209186869 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560a4b025790 0x560a4b018160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:34:09.492 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:09.475+0000 7fc572600740 1 --2- 172.21.15.19:0/2209186869 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x560a4b019800 0x560a4b017c20 unknown :-1 s=CLOSED pgs=730 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:34:09.492 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:09.475+0000 7fc572600740 1 --2- 172.21.15.19:0/2209186869 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x560a4b018ee0 0x560a4b020220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:34:09.492 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:09.475+0000 7fc572600740 1 -- 172.21.15.19:0/2209186869 >> 172.21.15.19:0/2209186869 conn(0x560a4b016d10 msgr2=0x560a4b01fb10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:34:09.492 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:09.475+0000 7fc572600740 1 -- 172.21.15.19:0/2209186869 shutdown_connections 2024-09-10T22:34:09.492 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:09.475+0000 7fc572600740 1 -- 172.21.15.19:0/2209186869 wait complete. 2024-09-10T22:34:09.492 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:09.476+0000 7fc572600740 1 -- start start 2024-09-10T22:34:09.492 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:09.476+0000 7fc572600740 1 Processor -- start 2024-09-10T22:34:09.493 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:09.476+0000 7fc572600740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x560a4b018ee0 0x560a4b02d9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:34:09.493 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:09.476+0000 7fc572600740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560a4b025790 0x560a4b02df60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:34:09.493 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:09.476+0000 7fc572600740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x560a4b030690 0x560a4b030b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:34:09.493 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:09.476+0000 7fc572600740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fc5681aee90 con 0x560a4b018ee0 2024-09-10T22:34:09.493 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:09.476+0000 7fc572600740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fc5681b0300 con 0x560a4b025790 2024-09-10T22:34:09.493 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:09.476+0000 7fc572600740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7fc5681af560 con 0x560a4b030690 2024-09-10T22:34:09.493 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:09.476+0000 7fc572600740 10 client.0 _ll_register_callbacks cb 0x7fc564005e40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T22:34:09.493 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:09.476+0000 7fc56dfc7640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x560a4b018ee0 0x560a4b02d9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:34:09.493 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:09.477+0000 7fc56dfc7640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x560a4b018ee0 0x560a4b02d9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:39108/0 (socket says 172.21.15.19:39108) 2024-09-10T22:34:09.493 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:09.477+0000 7fc56d7c6640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560a4b025790 0x560a4b02df60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:34:09.493 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:09.477+0000 7fc56dfc7640 1 -- 172.21.15.19:0/775901203 learned_addr learned my addr 172.21.15.19:0/775901203 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:34:09.493 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:09.477+0000 7fc56e7c8640 1 --2- 172.21.15.19:0/775901203 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x560a4b030690 0x560a4b030b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:34:09.493 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:09.477+0000 7fc56dfc7640 1 -- 172.21.15.19:0/775901203 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x560a4b030690 msgr2=0x560a4b030b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:34:09.494 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:09.477+0000 7fc56dfc7640 1 --2- 172.21.15.19:0/775901203 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x560a4b030690 0x560a4b030b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:34:09.494 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:09.477+0000 7fc56dfc7640 1 -- 172.21.15.19:0/775901203 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560a4b025790 msgr2=0x560a4b02df60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:34:09.494 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:09.477+0000 7fc56dfc7640 1 --2- 172.21.15.19:0/775901203 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560a4b025790 0x560a4b02df60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:34:09.494 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:09.477+0000 7fc56dfc7640 1 -- 172.21.15.19:0/775901203 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560a4b031310 con 0x560a4b018ee0 2024-09-10T22:34:09.494 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:09.477+0000 7fc56d7c6640 1 --2- 172.21.15.19:0/775901203 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560a4b025790 0x560a4b02df60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T22:34:09.494 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:09.477+0000 7fc56dfc7640 1 --2- 172.21.15.19:0/775901203 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x560a4b018ee0 0x560a4b02d9e0 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7fc564042040 tx=0x7fc56403db00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=487381f80ce6ca9a server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:34:09.494 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:09.477+0000 7fc5517fa640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-10T22:34:09.494 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:09.477+0000 7fc5517fa640 1 -- 172.21.15.19:0/775901203 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc564005850 con 0x560a4b018ee0 2024-09-10T22:34:09.494 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:09.477+0000 7fc5517fa640 1 -- 172.21.15.19:0/775901203 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8327+0+0 (secure 0 0 0) 0x7fc564051470 con 0x560a4b018ee0 2024-09-10T22:34:09.494 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:09.477+0000 7fc572600740 1 -- 172.21.15.19:0/775901203 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x560a4af91db0 con 0x560a4b018ee0 2024-09-10T22:34:09.494 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:09.477+0000 7fc5517fa640 1 -- 172.21.15.19:0/775901203 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fc564051670 con 0x560a4b018ee0 2024-09-10T22:34:09.494 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:09.478+0000 7fc572600740 10 client.16920 fetch_fsmap learned FSMap version 27 2024-09-10T22:34:09.494 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:09.478+0000 7fc572600740 1 -- 172.21.15.19:0/775901203 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x560a4b0a3520 con 0x560a4b018ee0 2024-09-10T22:34:09.494 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:09.478+0000 7fc5517fa640 1 -- 172.21.15.19:0/775901203 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x560a4af91db0 con 0x560a4b018ee0 2024-09-10T22:34:09.495 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:09.478+0000 7fc5517fa640 1 -- 172.21.15.19:0/775901203 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7fc564044040 con 0x560a4b018ee0 2024-09-10T22:34:09.495 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:09.478+0000 7fc572600740 10 client.16920 fetch_fsmap finished waiting for FSMap version 27 2024-09-10T22:34:09.495 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:09.478+0000 7fc572600740 10 client.16920 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-10T22:34:09.495 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:09.478+0000 7fc572600740 20 client.16920 populate_metadata read hostname 'smithi019' 2024-09-10T22:34:09.495 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:09.478+0000 7fc572600740 1 --2- 172.21.15.19:0/775901203 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x560a4b0a3c40 0x560a4b0a6060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:34:09.495 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:09.478+0000 7fc572600740 4 client.16920 mds_command: new command op to 24581 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-10T22:34:09.495 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:09.478+0000 7fc572600740 1 -- 172.21.15.19:0/775901203 --> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x560a4af8d860 con 0x560a4b0a3c40 2024-09-10T22:34:09.495 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:09.478+0000 7fc56d7c6640 1 --2- 172.21.15.19:0/775901203 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x560a4b0a3c40 0x560a4b0a6060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:34:09.495 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:09.479+0000 7fc56d7c6640 1 --2- 172.21.15.19:0/775901203 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x560a4b0a3c40 0x560a4b0a6060 crc :-1 s=READY pgs=163 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cd27a12694eeab8e server_cookie=6cccfb54d7dedd6b in_seq=0 out_seq=0 2024-09-10T22:34:09.495 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:09.479+0000 7fc5517fa640 10 client.16920 ms_handle_connect on v2:172.21.15.135:6838/1254769802 2024-09-10T22:34:09.495 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:09.480+0000 7fc5517fa640 1 -- 172.21.15.19:0/775901203 <== mds.0 v2:172.21.15.135:6838/1254769802 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x560a4af8d860 con 0x560a4b0a3c40 2024-09-10T22:34:09.495 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:09.480+0000 7fc5517fa640 10 client.16920 handle_command_reply: tid=0 2024-09-10T22:34:09.495 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:09.480+0000 7fc572600740 1 client.16920 shutdown 2024-09-10T22:34:09.496 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:09.481+0000 7fc572600740 1 -- 172.21.15.19:0/775901203 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x560a4b018ee0 msgr2=0x560a4b02d9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:34:09.496 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:09.481+0000 7fc572600740 1 --2- 172.21.15.19:0/775901203 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x560a4b018ee0 0x560a4b02d9e0 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7fc564042040 tx=0x7fc56403db00 comp rx=0 tx=0).stop 2024-09-10T22:34:09.496 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:09.481+0000 7fc572600740 1 -- 172.21.15.19:0/775901203 shutdown_connections 2024-09-10T22:34:09.496 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:09.481+0000 7fc572600740 1 --2- 172.21.15.19:0/775901203 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x560a4b0a3c40 0x560a4b0a6060 crc :-1 s=READY pgs=163 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:34:09.496 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:09.481+0000 7fc572600740 1 --2- 172.21.15.19:0/775901203 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x560a4b030690 0x560a4b030b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:34:09.496 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:09.481+0000 7fc572600740 1 --2- 172.21.15.19:0/775901203 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560a4b025790 0x560a4b02df60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:34:09.496 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:09.481+0000 7fc5517fa640 0 client.16920 ms_handle_reset on v2:172.21.15.135:6838/1254769802 2024-09-10T22:34:09.496 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:09.481+0000 7fc572600740 1 --2- 172.21.15.19:0/775901203 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x560a4b018ee0 0x560a4b02d9e0 unknown :-1 s=CLOSED pgs=731 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:34:09.496 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:09.481+0000 7fc572600740 1 -- 172.21.15.19:0/775901203 >> 172.21.15.19:0/775901203 conn(0x560a4b016d10 msgr2=0x560a4b017c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:34:09.496 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:09.481+0000 7fc572600740 1 -- 172.21.15.19:0/775901203 shutdown_connections 2024-09-10T22:34:09.496 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:09.481+0000 7fc572600740 1 -- 172.21.15.19:0/775901203 wait complete. 2024-09-10T22:34:09.496 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:09.481+0000 7fc572600740 20 client.16920 trim_cache size 0 max 16384 2024-09-10T22:34:09.497 INFO:teuthology.orchestra.run.smithi019.stdout:{ 2024-09-10T22:34:09.497 INFO:teuthology.orchestra.run.smithi019.stdout: "return_code": 0, 2024-09-10T22:34:09.497 INFO:teuthology.orchestra.run.smithi019.stdout: "scrub_tag": "9efe684b-7583-402e-a46e-e262a37e1af5", 2024-09-10T22:34:09.497 INFO:teuthology.orchestra.run.smithi019.stdout: "mode": "asynchronous" 2024-09-10T22:34:09.497 INFO:teuthology.orchestra.run.smithi019.stdout:} 2024-09-10T22:34:09.498 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:09.482+0000 7fc57022b640 1 -- 172.21.15.19:0/938605766 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7fc5540b52e0 msgr2=0x7fc5540b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:34:09.498 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:09.482+0000 7fc57022b640 1 --2- 172.21.15.19:0/938605766 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7fc5540b52e0 0x7fc5540b77a0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x560a4b01c060 tx=0x7fc564005a20 comp rx=0 tx=0).stop 2024-09-10T22:34:09.498 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:09.482+0000 7fc57022b640 1 -- 172.21.15.19:0/938605766 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc568075de0 msgr2=0x7fc56819ba30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:34:09.498 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:09.482+0000 7fc57022b640 1 --2- 172.21.15.19:0/938605766 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc568075de0 0x7fc56819ba30 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fc55800d6d0 tx=0x7fc55800db90 comp rx=0 tx=0).stop 2024-09-10T22:34:09.498 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:09.482+0000 7fc57022b640 1 -- 172.21.15.19:0/938605766 shutdown_connections 2024-09-10T22:34:09.498 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:09.482+0000 7fc57022b640 1 --2- 172.21.15.19:0/938605766 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7fc5540b52e0 0x7fc5540b77a0 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:34:09.498 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:09.482+0000 7fc57022b640 1 --2- 172.21.15.19:0/938605766 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc56810f3f0 0x7fc5681a0dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:34:09.498 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:09.482+0000 7fc57022b640 1 --2- 172.21.15.19:0/938605766 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc568075de0 0x7fc56819ba30 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:34:09.499 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:09.482+0000 7fc57022b640 1 --2- 172.21.15.19:0/938605766 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc5680754c0 0x7fc56819b4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:34:09.499 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:09.482+0000 7fc57022b640 1 -- 172.21.15.19:0/938605766 >> 172.21.15.19:0/938605766 conn(0x7fc5680fe870 msgr2=0x7fc5681115d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:34:09.499 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:09.482+0000 7fc57022b640 1 -- 172.21.15.19:0/938605766 shutdown_connections 2024-09-10T22:34:09.499 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:09.482+0000 7fc57022b640 1 -- 172.21.15.19:0/938605766 wait complete. 2024-09-10T22:34:10.208 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:34:10 smithi019 ceph-mon[31375]: pgmap v579: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 546 KiB/s rd, 266 MiB/s wr, 567 op/s 2024-09-10T22:34:10.209 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:34:10 smithi019 ceph-mon[31375]: scrub queued for path: / 2024-09-10T22:34:10.209 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:34:10 smithi019 ceph-mon[31375]: scrub summary: idle+waiting paths [/] 2024-09-10T22:34:10.209 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:34:10 smithi019 ceph-mon[31375]: scrub summary: active paths [/] 2024-09-10T22:34:10.209 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:34:10 smithi019 ceph-mon[31375]: scrub summary: active paths [/] 2024-09-10T22:34:10.209 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:34:10 smithi019 ceph-mon[31375]: scrub summary: idle+waiting paths [/] 2024-09-10T22:34:10.274 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:10.272+0000 7f2ffeffd640 1 -- 172.21.15.19:0/1220280377 <== mds.0 v2:172.21.15.135:6838/1254769802 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x564caf8620f0 con 0x564caf974510 2024-09-10T22:34:10.275 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:10.272+0000 7f2ffeffd640 10 client.16884 handle_command_reply: tid=0 2024-09-10T22:34:10.275 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:10.272+0000 7f30287fc740 1 client.16884 shutdown 2024-09-10T22:34:10.275 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:10.272+0000 7f30287fc740 1 -- 172.21.15.19:0/1220280377 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x564caf8f7bd0 msgr2=0x564caf901de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:34:10.275 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:10.272+0000 7f30287fc740 1 --2- 172.21.15.19:0/1220280377 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x564caf8f7bd0 0x564caf901de0 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7f3018003bf0 tx=0x7f301801d000 comp rx=0 tx=0).stop 2024-09-10T22:34:10.275 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:10.272+0000 7f30287fc740 1 -- 172.21.15.19:0/1220280377 shutdown_connections 2024-09-10T22:34:10.275 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:10.272+0000 7f30287fc740 1 --2- 172.21.15.19:0/1220280377 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x564caf8f7bd0 0x564caf901de0 unknown :-1 s=CLOSED pgs=725 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:34:10.275 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:10.272+0000 7f30287fc740 1 --2- 172.21.15.19:0/1220280377 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564caf8f5190 0x564caf903740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:34:10.275 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:10.272+0000 7f30287fc740 1 --2- 172.21.15.19:0/1220280377 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x564caf974510 0x564caf976930 crc :-1 s=READY pgs=159 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:34:10.275 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:10.272+0000 7f30287fc740 1 --2- 172.21.15.19:0/1220280377 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x564caf8f2860 0x564caf9030a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:34:10.275 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:10.272+0000 7f2ffeffd640 0 client.16884 ms_handle_reset on v2:172.21.15.135:6838/1254769802 2024-09-10T22:34:10.275 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:10.272+0000 7f30287fc740 1 -- 172.21.15.19:0/1220280377 >> 172.21.15.19:0/1220280377 conn(0x564caf8ed9b0 msgr2=0x564caf8fb640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:34:10.276 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:10.273+0000 7f30287fc740 1 -- 172.21.15.19:0/1220280377 shutdown_connections 2024-09-10T22:34:10.276 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:10.273+0000 7f30287fc740 1 -- 172.21.15.19:0/1220280377 wait complete. 2024-09-10T22:34:10.276 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:10.273+0000 7f30287fc740 20 client.16884 trim_cache size 0 max 16384 2024-09-10T22:34:10.276 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stdout:{ 2024-09-10T22:34:10.276 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stdout: "message": "", 2024-09-10T22:34:10.276 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stdout: "return_code": 0 2024-09-10T22:34:10.276 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stdout:} 2024-09-10T22:34:10.277 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:10.274+0000 7f3025952640 1 -- 172.21.15.19:0/1851742094 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f300c0b53e0 msgr2=0x7f300c0b78a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:34:10.277 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:10.274+0000 7f3025952640 1 --2- 172.21.15.19:0/1851742094 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f300c0b53e0 0x7f300c0b78a0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f3018009fd0 tx=0x7f3018013770 comp rx=0 tx=0).stop 2024-09-10T22:34:10.277 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:10.274+0000 7f3025952640 1 -- 172.21.15.19:0/1851742094 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f302006bc90 msgr2=0x7f302019af50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:34:10.277 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:10.274+0000 7f3025952640 1 --2- 172.21.15.19:0/1851742094 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f302006bc90 0x7f302019af50 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f3010005940 tx=0x7f30100042f0 comp rx=0 tx=0).stop 2024-09-10T22:34:10.277 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:10.274+0000 7f3025952640 1 -- 172.21.15.19:0/1851742094 shutdown_connections 2024-09-10T22:34:10.278 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:10.274+0000 7f3025952640 1 --2- 172.21.15.19:0/1851742094 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f300c0b53e0 0x7f300c0b78a0 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:34:10.278 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:10.274+0000 7f3025952640 1 --2- 172.21.15.19:0/1851742094 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3020108680 0x7f302019c1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:34:10.278 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:10.274+0000 7f3025952640 1 --2- 172.21.15.19:0/1851742094 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3020105ad0 0x7f302019b5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:34:10.278 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:10.274+0000 7f3025952640 1 --2- 172.21.15.19:0/1851742094 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f302006bc90 0x7f302019af50 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:34:10.278 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:10.274+0000 7f3025952640 1 -- 172.21.15.19:0/1851742094 >> 172.21.15.19:0/1851742094 conn(0x7f30200fd130 msgr2=0x7f3020103d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:34:10.278 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:10.274+0000 7f3025952640 1 -- 172.21.15.19:0/1851742094 shutdown_connections 2024-09-10T22:34:10.278 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:10.274+0000 7f3025952640 1 -- 172.21.15.19:0/1851742094 wait complete. 2024-09-10T22:34:10.283 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 22997a4c-6fc2-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-10T22:34:10.360 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:34:10 smithi135 ceph-mon[34789]: pgmap v579: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 546 KiB/s rd, 266 MiB/s wr, 567 op/s 2024-09-10T22:34:10.360 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:34:10 smithi135 ceph-mon[34789]: scrub queued for path: / 2024-09-10T22:34:10.360 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:34:10 smithi135 ceph-mon[34789]: scrub summary: idle+waiting paths [/] 2024-09-10T22:34:10.361 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:34:10 smithi135 ceph-mon[34789]: scrub summary: active paths [/] 2024-09-10T22:34:10.361 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:34:10 smithi135 ceph-mon[34789]: scrub summary: active paths [/] 2024-09-10T22:34:10.361 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:34:10 smithi135 ceph-mon[34789]: scrub summary: idle+waiting paths [/] 2024-09-10T22:34:10.375 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:34:10 smithi138 ceph-mon[35236]: pgmap v579: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 546 KiB/s rd, 266 MiB/s wr, 567 op/s 2024-09-10T22:34:10.375 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:34:10 smithi138 ceph-mon[35236]: scrub queued for path: / 2024-09-10T22:34:10.375 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:34:10 smithi138 ceph-mon[35236]: scrub summary: idle+waiting paths [/] 2024-09-10T22:34:10.375 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:34:10 smithi138 ceph-mon[35236]: scrub summary: active paths [/] 2024-09-10T22:34:10.375 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:34:10 smithi138 ceph-mon[35236]: scrub summary: active paths [/] 2024-09-10T22:34:10.375 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:34:10 smithi138 ceph-mon[35236]: scrub summary: idle+waiting paths [/] 2024-09-10T22:34:10.774 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/22997a4c-6fc2-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T22:34:11.209 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:34:11 smithi019 ceph-mon[31375]: scrub summary: idle+waiting paths [/] 2024-09-10T22:34:11.360 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:34:11 smithi135 ceph-mon[34789]: scrub summary: idle+waiting paths [/] 2024-09-10T22:34:11.375 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:34:11 smithi138 ceph-mon[35236]: scrub summary: idle+waiting paths [/] 2024-09-10T22:34:11.777 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:11.663+0000 7f59c0232640 1 -- 172.21.15.19:0/3707268078 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f59b8103ca0 msgr2=0x7f59b8104080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:34:11.777 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:11.663+0000 7f59c0232640 1 --2- 172.21.15.19:0/3707268078 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f59b8103ca0 0x7f59b8104080 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7f59a8009ca0 tx=0x7f59a802a8c0 comp rx=0 tx=0).stop 2024-09-10T22:34:11.777 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:11.663+0000 7f59c0232640 1 -- 172.21.15.19:0/3707268078 shutdown_connections 2024-09-10T22:34:11.777 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:11.663+0000 7f59c0232640 1 --2- 172.21.15.19:0/3707268078 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f59b810d100 0x7f59b810f560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:34:11.777 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:11.663+0000 7f59c0232640 1 --2- 172.21.15.19:0/3707268078 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f59b81045c0 0x7f59b810cab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:34:11.777 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:11.663+0000 7f59c0232640 1 --2- 172.21.15.19:0/3707268078 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f59b8103ca0 0x7f59b8104080 unknown :-1 s=CLOSED pgs=732 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:34:11.777 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:11.663+0000 7f59c0232640 1 -- 172.21.15.19:0/3707268078 >> 172.21.15.19:0/3707268078 conn(0x7f59b80fd700 msgr2=0x7f59b80ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:34:11.777 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:11.663+0000 7f59c0232640 1 -- 172.21.15.19:0/3707268078 shutdown_connections 2024-09-10T22:34:11.777 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:11.663+0000 7f59c0232640 1 -- 172.21.15.19:0/3707268078 wait complete. 2024-09-10T22:34:11.778 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:11.664+0000 7f59c0232640 1 Processor -- start 2024-09-10T22:34:11.778 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:11.664+0000 7f59c0232640 1 -- start start 2024-09-10T22:34:11.778 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:11.664+0000 7f59c0232640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f59b8103ca0 0x7f59b8199260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:34:11.778 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:11.664+0000 7f59c0232640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f59b81045c0 0x7f59b81997a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:34:11.778 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:11.664+0000 7f59c0232640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f59b810d100 0x7f59b819eb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:34:11.778 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:11.664+0000 7f59c0232640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f59b8112d70 con 0x7f59b81045c0 2024-09-10T22:34:11.778 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:11.664+0000 7f59c0232640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f59b8112bf0 con 0x7f59b810d100 2024-09-10T22:34:11.778 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:11.664+0000 7f59c0232640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f59b8112ef0 con 0x7f59b8103ca0 2024-09-10T22:34:11.778 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:11.664+0000 7f59bd7cd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f59b81045c0 0x7f59b81997a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:34:11.778 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:11.664+0000 7f59bd7cd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f59b81045c0 0x7f59b81997a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:39116/0 (socket says 172.21.15.19:39116) 2024-09-10T22:34:11.778 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:11.664+0000 7f59bd7cd640 1 -- 172.21.15.19:0/3163861274 learned_addr learned my addr 172.21.15.19:0/3163861274 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:34:11.778 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:11.664+0000 7f59be7cf640 1 --2- 172.21.15.19:0/3163861274 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f59b810d100 0x7f59b819eb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:34:11.778 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:11.664+0000 7f59bdfce640 1 --2- 172.21.15.19:0/3163861274 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f59b8103ca0 0x7f59b8199260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:34:11.779 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:11.665+0000 7f59bd7cd640 1 -- 172.21.15.19:0/3163861274 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f59b8103ca0 msgr2=0x7f59b8199260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:34:11.779 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:11.665+0000 7f59bd7cd640 1 --2- 172.21.15.19:0/3163861274 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f59b8103ca0 0x7f59b8199260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:34:11.779 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:11.665+0000 7f59bd7cd640 1 -- 172.21.15.19:0/3163861274 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f59b810d100 msgr2=0x7f59b819eb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:34:11.779 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:11.665+0000 7f59bd7cd640 1 --2- 172.21.15.19:0/3163861274 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f59b810d100 0x7f59b819eb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:34:11.779 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:11.665+0000 7f59bd7cd640 1 -- 172.21.15.19:0/3163861274 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f59b819f310 con 0x7f59b81045c0 2024-09-10T22:34:11.779 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:11.665+0000 7f59be7cf640 1 --2- 172.21.15.19:0/3163861274 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f59b810d100 0x7f59b819eb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T22:34:11.779 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:11.665+0000 7f59bd7cd640 1 --2- 172.21.15.19:0/3163861274 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f59b81045c0 0x7f59b81997a0 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7f59ac00e9c0 tx=0x7f59ac00edc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:34:11.779 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:11.665+0000 7f59b6ffd640 1 -- 172.21.15.19:0/3163861274 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59ac00cd80 con 0x7f59b81045c0 2024-09-10T22:34:11.779 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:11.665+0000 7f59b6ffd640 1 -- 172.21.15.19:0/3163861274 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f59ac0096c0 con 0x7f59b81045c0 2024-09-10T22:34:11.779 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:11.665+0000 7f59c0232640 1 -- 172.21.15.19:0/3163861274 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f59b819f600 con 0x7f59b81045c0 2024-09-10T22:34:11.779 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:11.665+0000 7f59b6ffd640 1 -- 172.21.15.19:0/3163861274 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59ac018840 con 0x7f59b81045c0 2024-09-10T22:34:11.779 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:11.665+0000 7f59c0232640 1 -- 172.21.15.19:0/3163861274 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f59b81a5cc0 con 0x7f59b81045c0 2024-09-10T22:34:11.780 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:11.668+0000 7f59c2607740 1 Processor -- start 2024-09-10T22:34:11.780 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:11.668+0000 7f59c2607740 1 -- start start 2024-09-10T22:34:11.780 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:11.668+0000 7f59b6ffd640 1 -- 172.21.15.19:0/3163861274 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 18) ==== 153250+0+0 (secure 0 0 0) 0x7f59ac010b20 con 0x7f59b81045c0 2024-09-10T22:34:11.780 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:11.668+0000 7f59c2607740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x563ac28f50a0 0x563ac28f5480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:34:11.780 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:11.668+0000 7f59c2607740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563ac28f59c0 0x563ac2901410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:34:11.780 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:11.668+0000 7f59c2607740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x563ac2901950 0x563ac2903d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:34:11.780 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:11.668+0000 7f59c2607740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x563ac286be50 con 0x563ac28f50a0 2024-09-10T22:34:11.780 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:11.668+0000 7f59c2607740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x563ac285b280 con 0x563ac28f59c0 2024-09-10T22:34:11.780 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:11.668+0000 7f59c2607740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x563ac285f090 con 0x563ac2901950 2024-09-10T22:34:11.780 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:11.668+0000 7f59be7cf640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x563ac28f50a0 0x563ac28f5480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:34:11.780 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:11.668+0000 7f59be7cf640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x563ac28f50a0 0x563ac28f5480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:39122/0 (socket says 172.21.15.19:39122) 2024-09-10T22:34:11.780 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:11.668+0000 7f59be7cf640 1 -- 172.21.15.19:0/2732086860 learned_addr learned my addr 172.21.15.19:0/2732086860 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:34:11.781 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:11.669+0000 7f59bdfce640 1 --2- 172.21.15.19:0/2732086860 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563ac28f59c0 0x563ac2901410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:34:11.781 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:11.669+0000 7f59bd7cd640 1 --2- 172.21.15.19:0/2732086860 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x563ac2901950 0x563ac2903d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:34:11.781 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:11.669+0000 7f59be7cf640 1 -- 172.21.15.19:0/2732086860 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x563ac2901950 msgr2=0x563ac2903d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:34:11.781 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:11.669+0000 7f59be7cf640 1 --2- 172.21.15.19:0/2732086860 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x563ac2901950 0x563ac2903d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:34:11.781 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:11.669+0000 7f59be7cf640 1 -- 172.21.15.19:0/2732086860 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563ac28f59c0 msgr2=0x563ac2901410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:34:11.781 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:11.669+0000 7f59be7cf640 1 --2- 172.21.15.19:0/2732086860 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563ac28f59c0 0x563ac2901410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:34:11.781 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:11.669+0000 7f59be7cf640 1 -- 172.21.15.19:0/2732086860 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563ac25b9650 con 0x563ac28f50a0 2024-09-10T22:34:11.782 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:11.669+0000 7f59be7cf640 1 --2- 172.21.15.19:0/2732086860 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x563ac28f50a0 0x563ac28f5480 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7f59b0011540 tx=0x7f59b0011a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b50213ca62bd1ee5 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:34:11.782 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:11.669+0000 7f599ffff640 1 -- 172.21.15.19:0/2732086860 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59b000f5c0 con 0x563ac28f50a0 2024-09-10T22:34:11.782 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:11.669+0000 7f599ffff640 1 -- 172.21.15.19:0/2732086860 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f59b000fc10 con 0x563ac28f50a0 2024-09-10T22:34:11.782 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:11.669+0000 7f599ffff640 1 -- 172.21.15.19:0/2732086860 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59b0019c50 con 0x563ac28f50a0 2024-09-10T22:34:11.782 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:11.670+0000 7f59b6ffd640 1 --2- 172.21.15.19:0/3163861274 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f59a00b52e0 0x7f59a00b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:34:11.782 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:11.670+0000 7f59bdfce640 1 --2- 172.21.15.19:0/3163861274 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f59a00b52e0 0x7f59a00b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:34:11.782 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:11.670+0000 7f59b6ffd640 1 -- 172.21.15.19:0/3163861274 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8327+0+0 (secure 0 0 0) 0x7f59ac0e5e70 con 0x7f59b81045c0 2024-09-10T22:34:11.782 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:11.670+0000 7f59c2607740 1 -- 172.21.15.19:0/2732086860 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x563ac28f50a0 msgr2=0x563ac28f5480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:34:11.782 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:11.670+0000 7f59c2607740 1 --2- 172.21.15.19:0/2732086860 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x563ac28f50a0 0x563ac28f5480 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7f59b0011540 tx=0x7f59b0011a00 comp rx=0 tx=0).stop 2024-09-10T22:34:11.782 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:11.670+0000 7f59c2607740 1 -- 172.21.15.19:0/2732086860 shutdown_connections 2024-09-10T22:34:11.782 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:11.670+0000 7f59bdfce640 1 --2- 172.21.15.19:0/3163861274 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f59a00b52e0 0x7f59a00b77a0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x563ac28f3db0 tx=0x7f59a8009360 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:34:11.782 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:11.670+0000 7f59c2607740 1 --2- 172.21.15.19:0/2732086860 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x563ac2901950 0x563ac2903d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:34:11.783 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:11.670+0000 7f59c2607740 1 --2- 172.21.15.19:0/2732086860 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563ac28f59c0 0x563ac2901410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:34:11.783 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:11.670+0000 7f59c2607740 1 --2- 172.21.15.19:0/2732086860 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x563ac28f50a0 0x563ac28f5480 unknown :-1 s=CLOSED pgs=734 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:34:11.783 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:11.670+0000 7f59c2607740 1 -- 172.21.15.19:0/2732086860 >> 172.21.15.19:0/2732086860 conn(0x563ac28f2ed0 msgr2=0x563ac28f4070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:34:11.783 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:11.671+0000 7f59c2607740 1 -- 172.21.15.19:0/2732086860 shutdown_connections 2024-09-10T22:34:11.783 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:11.671+0000 7f59c2607740 1 -- 172.21.15.19:0/2732086860 wait complete. 2024-09-10T22:34:11.783 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:11.671+0000 7f59c2607740 1 -- start start 2024-09-10T22:34:11.783 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:11.671+0000 7f59c2607740 1 Processor -- start 2024-09-10T22:34:11.783 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:11.671+0000 7f59c2607740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563ac28f50a0 0x563ac2901260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:34:11.783 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:11.671+0000 7f59c2607740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x563ac28f59c0 0x563ac28fe6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:34:11.783 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:11.671+0000 7f59c2607740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x563ac2901950 0x563ac28fece0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:34:11.783 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:11.671+0000 7f59c2607740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x563ac26bc700 con 0x563ac28f59c0 2024-09-10T22:34:11.783 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:11.671+0000 7f59c2607740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x563ac27f6110 con 0x563ac28f50a0 2024-09-10T22:34:11.783 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:11.671+0000 7f59c2607740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x563ac29045d0 con 0x563ac2901950 2024-09-10T22:34:11.784 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:11.672+0000 7f59c2607740 10 client.0 _ll_register_callbacks cb 0x563ac280f990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T22:34:11.784 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:11.672+0000 7f59be7cf640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x563ac2901950 0x563ac28fece0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:34:11.784 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:11.672+0000 7f59bd7cd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x563ac28f59c0 0x563ac28fe6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:34:11.784 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:11.672+0000 7f59bd7cd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x563ac28f59c0 0x563ac28fe6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:39124/0 (socket says 172.21.15.19:39124) 2024-09-10T22:34:11.784 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:11.672+0000 7f59bd7cd640 1 -- 172.21.15.19:0/3824747424 learned_addr learned my addr 172.21.15.19:0/3824747424 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:34:11.784 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:11.672+0000 7f59bdfce640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563ac28f50a0 0x563ac2901260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:34:11.784 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:11.672+0000 7f59be7cf640 1 -- 172.21.15.19:0/3824747424 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563ac28f50a0 msgr2=0x563ac2901260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:34:11.784 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:11.672+0000 7f59be7cf640 1 --2- 172.21.15.19:0/3824747424 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563ac28f50a0 0x563ac2901260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:34:11.784 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:11.672+0000 7f59be7cf640 1 -- 172.21.15.19:0/3824747424 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x563ac28f59c0 msgr2=0x563ac28fe6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:34:11.784 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:11.672+0000 7f59be7cf640 1 --2- 172.21.15.19:0/3824747424 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x563ac28f59c0 0x563ac28fe6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:34:11.784 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:11.672+0000 7f59be7cf640 1 -- 172.21.15.19:0/3824747424 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563ac2823c40 con 0x563ac2901950 2024-09-10T22:34:11.784 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:11.672+0000 7f59bd7cd640 1 --2- 172.21.15.19:0/3824747424 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x563ac28f59c0 0x563ac28fe6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T22:34:11.785 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:11.672+0000 7f59be7cf640 1 --2- 172.21.15.19:0/3824747424 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x563ac2901950 0x563ac28fece0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f59b001b040 tx=0x7f59b0005750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e2f6781dbab98bf8 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:34:11.785 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:11.672+0000 7f599d7fa640 10 client.0 ms_handle_connect on v2:172.21.15.138:3300/0 2024-09-10T22:34:11.785 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:11.673+0000 7f599d7fa640 1 -- 172.21.15.19:0/3824747424 <== mon.1 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59b002e060 con 0x563ac2901950 2024-09-10T22:34:11.785 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:11.673+0000 7f59c2607740 1 -- 172.21.15.19:0/3824747424 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f59b000fc10 con 0x563ac2901950 2024-09-10T22:34:11.785 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:11.673+0000 7f599d7fa640 1 -- 172.21.15.19:0/3824747424 <== mon.1 v2:172.21.15.138:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8327+0+0 (secure 0 0 0) 0x7f59b0004390 con 0x563ac2901950 2024-09-10T22:34:11.785 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:11.673+0000 7f599d7fa640 1 -- 172.21.15.19:0/3824747424 <== mon.1 v2:172.21.15.138:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f59b000f5c0 con 0x563ac2901950 2024-09-10T22:34:11.785 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:11.673+0000 7f59c2607740 10 client.26299 fetch_fsmap learned FSMap version 27 2024-09-10T22:34:11.785 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:11.673+0000 7f59c2607740 1 -- 172.21.15.19:0/3824747424 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x563ac290ff90 con 0x563ac2901950 2024-09-10T22:34:11.785 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:11.673+0000 7f599d7fa640 1 -- 172.21.15.19:0/3824747424 <== mon.1 v2:172.21.15.138:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f59b000fc10 con 0x563ac2901950 2024-09-10T22:34:11.785 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:11.673+0000 7f599d7fa640 1 -- 172.21.15.19:0/3824747424 <== mon.1 v2:172.21.15.138:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7f59b0032030 con 0x563ac2901950 2024-09-10T22:34:11.785 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:11.673+0000 7f59c2607740 10 client.26299 fetch_fsmap finished waiting for FSMap version 27 2024-09-10T22:34:11.785 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:11.673+0000 7f59c2607740 10 client.26299 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-10T22:34:11.785 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:11.673+0000 7f59c2607740 20 client.26299 populate_metadata read hostname 'smithi019' 2024-09-10T22:34:11.786 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:11.673+0000 7f59c2607740 1 --2- 172.21.15.19:0/3824747424 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x563ac2911350 0x563ac2913740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:34:11.786 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:11.673+0000 7f59c2607740 4 client.26299 mds_command: new command op to 24581 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T22:34:11.786 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:11.673+0000 7f59c2607740 1 -- 172.21.15.19:0/3824747424 --> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x563ac286dda0 con 0x563ac2911350 2024-09-10T22:34:11.786 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:11.674+0000 7f59bdfce640 1 --2- 172.21.15.19:0/3824747424 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x563ac2911350 0x563ac2913740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:34:11.786 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:11.674+0000 7f59bdfce640 1 --2- 172.21.15.19:0/3824747424 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x563ac2911350 0x563ac2913740 crc :-1 s=READY pgs=164 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c93a04885b1a87db server_cookie=b8e9d75f9cd12c9e in_seq=0 out_seq=0 2024-09-10T22:34:11.786 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:11.674+0000 7f599d7fa640 10 client.26299 ms_handle_connect on v2:172.21.15.135:6838/1254769802 2024-09-10T22:34:11.786 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:11.675+0000 7f599d7fa640 1 -- 172.21.15.19:0/3824747424 <== mds.0 v2:172.21.15.135:6838/1254769802 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x563ac286dda0 con 0x563ac2911350 2024-09-10T22:34:11.786 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:11.675+0000 7f599d7fa640 10 client.26299 handle_command_reply: tid=0 2024-09-10T22:34:11.786 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:11.675+0000 7f59c2607740 1 client.26299 shutdown 2024-09-10T22:34:11.786 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:11.675+0000 7f59c2607740 1 -- 172.21.15.19:0/3824747424 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x563ac2901950 msgr2=0x563ac28fece0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:34:11.786 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:11.675+0000 7f59c2607740 1 --2- 172.21.15.19:0/3824747424 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x563ac2901950 0x563ac28fece0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f59b001b040 tx=0x7f59b0005750 comp rx=0 tx=0).stop 2024-09-10T22:34:11.786 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:11.675+0000 7f59c2607740 1 -- 172.21.15.19:0/3824747424 shutdown_connections 2024-09-10T22:34:11.786 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:11.675+0000 7f59c2607740 1 --2- 172.21.15.19:0/3824747424 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x563ac2911350 0x563ac2913740 crc :-1 s=READY pgs=164 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:34:11.787 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:11.675+0000 7f59c2607740 1 --2- 172.21.15.19:0/3824747424 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x563ac2901950 0x563ac28fece0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:34:11.787 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:11.675+0000 7f59c2607740 1 --2- 172.21.15.19:0/3824747424 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x563ac28f59c0 0x563ac28fe6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:34:11.787 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:11.675+0000 7f599d7fa640 0 client.26299 ms_handle_reset on v2:172.21.15.135:6838/1254769802 2024-09-10T22:34:11.787 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:11.675+0000 7f59c2607740 1 --2- 172.21.15.19:0/3824747424 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563ac28f50a0 0x563ac2901260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:34:11.787 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:11.675+0000 7f59c2607740 1 -- 172.21.15.19:0/3824747424 >> 172.21.15.19:0/3824747424 conn(0x563ac28f2ed0 msgr2=0x563ac28f8a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:34:11.787 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:11.675+0000 7f59c2607740 1 -- 172.21.15.19:0/3824747424 shutdown_connections 2024-09-10T22:34:11.787 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:11.675+0000 7f59c2607740 1 -- 172.21.15.19:0/3824747424 wait complete. 2024-09-10T22:34:11.787 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:11.676+0000 7f59c2607740 20 client.26299 trim_cache size 0 max 16384 2024-09-10T22:34:11.787 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:11.693+0000 7f59c2607740 1 Processor -- start 2024-09-10T22:34:11.787 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:11.693+0000 7f59c2607740 1 -- start start 2024-09-10T22:34:11.787 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:11.694+0000 7f59c2607740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x563ac28f50a0 0x563ac290d860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:34:11.787 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:11.694+0000 7f59c2607740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563ac28f59c0 0x563ac28fdbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:34:11.788 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:11.694+0000 7f59c2607740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x563ac2901950 0x563ac2902d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:34:11.788 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:11.694+0000 7f59c2607740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f59b81aed00 con 0x563ac28f50a0 2024-09-10T22:34:11.788 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:11.694+0000 7f59c2607740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f59b81ac5d0 con 0x563ac28f59c0 2024-09-10T22:34:11.788 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:11.694+0000 7f59c2607740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f59b81aa420 con 0x563ac2901950 2024-09-10T22:34:11.788 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:11.694+0000 7f59bdfce640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x563ac28f50a0 0x563ac290d860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:34:11.788 INFO:teuthology.orchestra.run.smithi019.stdout:{ 2024-09-10T22:34:11.788 INFO:teuthology.orchestra.run.smithi019.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-10T22:34:11.788 INFO:teuthology.orchestra.run.smithi019.stdout: "scrubs": { 2024-09-10T22:34:11.789 INFO:teuthology.orchestra.run.smithi019.stdout: "9efe684b-7583-402e-a46e-e262a37e1af5": { 2024-09-10T22:34:11.789 INFO:teuthology.orchestra.run.smithi019.stdout: "path": "/", 2024-09-10T22:34:11.789 INFO:teuthology.orchestra.run.smithi019.stdout: "tag": "9efe684b-7583-402e-a46e-e262a37e1af5", 2024-09-10T22:34:11.789 INFO:teuthology.orchestra.run.smithi019.stdout: "options": "recursive,force" 2024-09-10T22:34:11.789 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-10T22:34:11.789 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:34:11.789 INFO:teuthology.orchestra.run.smithi019.stdout: "scrub_stats": { 2024-09-10T22:34:11.789 INFO:teuthology.orchestra.run.smithi019.stdout: "0b81ea61-0b8e-4f2c-a58f-ef1019289fc9": { 2024-09-10T22:34:11.789 INFO:teuthology.orchestra.run.smithi019.stdout: "start_time": "2024-09-10T22:31:48.141568+0000", 2024-09-10T22:34:11.789 INFO:teuthology.orchestra.run.smithi019.stdout: "path": "/", 2024-09-10T22:34:11.789 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_started": 0, 2024-09-10T22:34:11.789 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_passed": 0, 2024-09-10T22:34:11.789 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_failed": 0, 2024-09-10T22:34:11.790 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_skipped": 0 2024-09-10T22:34:11.790 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:34:11.790 INFO:teuthology.orchestra.run.smithi019.stdout: "715ec863-8a9d-45b6-967f-59b15ce1bf12": { 2024-09-10T22:34:11.790 INFO:teuthology.orchestra.run.smithi019.stdout: "start_time": "2024-09-10T22:31:00.669516+0000", 2024-09-10T22:34:11.790 INFO:teuthology.orchestra.run.smithi019.stdout: "path": "/", 2024-09-10T22:34:11.790 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_started": 0, 2024-09-10T22:34:11.790 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_passed": 0, 2024-09-10T22:34:11.790 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_failed": 0, 2024-09-10T22:34:11.790 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_skipped": 0 2024-09-10T22:34:11.790 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:34:11.790 INFO:teuthology.orchestra.run.smithi019.stdout: "fd1f1837-dcfa-4d88-99e8-2509f36c3f98": { 2024-09-10T22:34:11.790 INFO:teuthology.orchestra.run.smithi019.stdout: "start_time": "2024-09-10T22:30:12.470477+0000", 2024-09-10T22:34:11.790 INFO:teuthology.orchestra.run.smithi019.stdout: "path": "/", 2024-09-10T22:34:11.790 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_started": 0, 2024-09-10T22:34:11.791 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_passed": 0, 2024-09-10T22:34:11.791 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_failed": 0, 2024-09-10T22:34:11.791 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_skipped": 0 2024-09-10T22:34:11.791 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:34:11.791 INFO:teuthology.orchestra.run.smithi019.stdout: "8f3bb3bf-911f-490c-9856-c80ea220dbbe": { 2024-09-10T22:34:11.791 INFO:teuthology.orchestra.run.smithi019.stdout: "start_time": "2024-09-10T22:29:25.374415+0000", 2024-09-10T22:34:11.791 INFO:teuthology.orchestra.run.smithi019.stdout: "path": "/", 2024-09-10T22:34:11.791 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_started": 0, 2024-09-10T22:34:11.791 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_passed": 0, 2024-09-10T22:34:11.791 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_failed": 0, 2024-09-10T22:34:11.791 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_skipped": 0 2024-09-10T22:34:11.791 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:34:11.791 INFO:teuthology.orchestra.run.smithi019.stdout: "eb518e3c-a71e-4f32-9ca0-ae88930ca218": { 2024-09-10T22:34:11.791 INFO:teuthology.orchestra.run.smithi019.stdout: "start_time": "2024-09-10T22:28:38.366352+0000", 2024-09-10T22:34:11.792 INFO:teuthology.orchestra.run.smithi019.stdout: "path": "/", 2024-09-10T22:34:11.792 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_started": 0, 2024-09-10T22:34:11.792 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_passed": 0, 2024-09-10T22:34:11.792 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_failed": 0, 2024-09-10T22:34:11.792 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_skipped": 0 2024-09-10T22:34:11.792 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:34:11.792 INFO:teuthology.orchestra.run.smithi019.stdout: "9efe684b-7583-402e-a46e-e262a37e1af5": { 2024-09-10T22:34:11.792 INFO:teuthology.orchestra.run.smithi019.stdout: "start_time": "2024-09-10T22:34:09.479768+0000", 2024-09-10T22:34:11.792 INFO:teuthology.orchestra.run.smithi019.stdout: "path": "/", 2024-09-10T22:34:11.792 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_started": 0, 2024-09-10T22:34:11.792 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_passed": 0, 2024-09-10T22:34:11.792 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_failed": 0, 2024-09-10T22:34:11.792 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_skipped": 0 2024-09-10T22:34:11.792 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:34:11.793 INFO:teuthology.orchestra.run.smithi019.stdout: "4c99964e-2e0e-4ffd-8cb8-99c4979ed90f": { 2024-09-10T22:34:11.793 INFO:teuthology.orchestra.run.smithi019.stdout: "start_time": "2024-09-10T22:32:34.659639+0000", 2024-09-10T22:34:11.793 INFO:teuthology.orchestra.run.smithi019.stdout: "path": "/", 2024-09-10T22:34:11.793 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_started": 0, 2024-09-10T22:34:11.793 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_passed": 0, 2024-09-10T22:34:11.793 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_failed": 0, 2024-09-10T22:34:11.793 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_skipped": 0 2024-09-10T22:34:11.793 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:34:11.793 INFO:teuthology.orchestra.run.smithi019.stdout: "c12c2a04-dcd6-4673-a98e-93f665d3f5d7": { 2024-09-10T22:34:11.793 INFO:teuthology.orchestra.run.smithi019.stdout: "start_time": "2024-09-10T22:27:49.392329+0000", 2024-09-10T22:34:11.793 INFO:teuthology.orchestra.run.smithi019.stdout: "path": "/", 2024-09-10T22:34:11.793 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_started": 0, 2024-09-10T22:34:11.793 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_passed": 0, 2024-09-10T22:34:11.793 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_failed": 0, 2024-09-10T22:34:11.794 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_skipped": 0 2024-09-10T22:34:11.794 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:34:11.794 INFO:teuthology.orchestra.run.smithi019.stdout: "b38852c8-478a-42ef-8384-b2c55d5313a4": { 2024-09-10T22:34:11.794 INFO:teuthology.orchestra.run.smithi019.stdout: "start_time": "2024-09-10T22:27:00.320308+0000", 2024-09-10T22:34:11.794 INFO:teuthology.orchestra.run.smithi019.stdout: "path": "/", 2024-09-10T22:34:11.794 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_started": 0, 2024-09-10T22:34:11.794 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_passed": 0, 2024-09-10T22:34:11.794 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_failed": 0, 2024-09-10T22:34:11.794 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_skipped": 0 2024-09-10T22:34:11.794 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:34:11.794 INFO:teuthology.orchestra.run.smithi019.stdout: "448b10e7-494c-4a88-a9ab-186159c5dfdd": { 2024-09-10T22:34:11.794 INFO:teuthology.orchestra.run.smithi019.stdout: "start_time": "2024-09-10T22:33:21.208716+0000", 2024-09-10T22:34:11.794 INFO:teuthology.orchestra.run.smithi019.stdout: "path": "/", 2024-09-10T22:34:11.795 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_started": 0, 2024-09-10T22:34:11.795 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_passed": 0, 2024-09-10T22:34:11.795 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_failed": 0, 2024-09-10T22:34:11.795 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_skipped": 0 2024-09-10T22:34:11.795 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:34:11.795 INFO:teuthology.orchestra.run.smithi019.stdout: "9b6bfdee-303c-4c12-af56-dc85860d112a": { 2024-09-10T22:34:11.795 INFO:teuthology.orchestra.run.smithi019.stdout: "start_time": "2024-09-10T22:26:17.484162+0000", 2024-09-10T22:34:11.795 INFO:teuthology.orchestra.run.smithi019.stdout: "path": "/", 2024-09-10T22:34:11.795 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_started": 0, 2024-09-10T22:34:11.795 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_passed": 0, 2024-09-10T22:34:11.795 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_failed": 0, 2024-09-10T22:34:11.795 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_skipped": 0 2024-09-10T22:34:11.795 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-10T22:34:11.795 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-10T22:34:11.796 INFO:teuthology.orchestra.run.smithi019.stdout:} 2024-09-10T22:34:11.796 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:11.694+0000 7f59bdfce640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x563ac28f50a0 0x563ac290d860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:39134/0 (socket says 172.21.15.19:39134) 2024-09-10T22:34:11.796 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:11.694+0000 7f59be7cf640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x563ac2901950 0x563ac2902d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:34:11.796 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:11.694+0000 7f59bdfce640 1 -- 172.21.15.19:0/1200184577 learned_addr learned my addr 172.21.15.19:0/1200184577 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:34:11.796 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:11.694+0000 7f59bd7cd640 1 --2- 172.21.15.19:0/1200184577 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563ac28f59c0 0x563ac28fdbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:34:11.796 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:11.694+0000 7f59be7cf640 1 -- 172.21.15.19:0/1200184577 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563ac28f59c0 msgr2=0x563ac28fdbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:34:11.796 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:11.694+0000 7f59be7cf640 1 --2- 172.21.15.19:0/1200184577 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563ac28f59c0 0x563ac28fdbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:34:11.796 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:11.694+0000 7f59be7cf640 1 -- 172.21.15.19:0/1200184577 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x563ac28f50a0 msgr2=0x563ac290d860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:34:11.797 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:11.694+0000 7f59be7cf640 1 --2- 172.21.15.19:0/1200184577 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x563ac28f50a0 0x563ac290d860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:34:11.797 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:11.694+0000 7f59be7cf640 1 -- 172.21.15.19:0/1200184577 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563ac2913a70 con 0x563ac2901950 2024-09-10T22:34:11.797 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:11.694+0000 7f59bd7cd640 1 --2- 172.21.15.19:0/1200184577 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563ac28f59c0 0x563ac28fdbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T22:34:11.797 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:11.694+0000 7f59be7cf640 1 --2- 172.21.15.19:0/1200184577 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x563ac2901950 0x563ac2902d40 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f59b0000c00 tx=0x7f59b0011f00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ee272515df4ec0c8 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:34:11.797 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:11.694+0000 7f599f7fe640 1 -- 172.21.15.19:0/1200184577 <== mon.1 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59b002e070 con 0x563ac2901950 2024-09-10T22:34:11.797 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:11.695+0000 7f599f7fe640 1 -- 172.21.15.19:0/1200184577 <== mon.1 v2:172.21.15.138:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f59b0004390 con 0x563ac2901950 2024-09-10T22:34:11.797 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:11.695+0000 7f599f7fe640 1 -- 172.21.15.19:0/1200184577 <== mon.1 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59b00113a0 con 0x563ac2901950 2024-09-10T22:34:11.797 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:11.695+0000 7f59c2607740 1 -- 172.21.15.19:0/1200184577 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x563ac2901950 msgr2=0x563ac2902d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:34:11.797 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:11.695+0000 7f59c2607740 1 --2- 172.21.15.19:0/1200184577 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x563ac2901950 0x563ac2902d40 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f59b0000c00 tx=0x7f59b0011f00 comp rx=0 tx=0).stop 2024-09-10T22:34:11.797 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:11.695+0000 7f59c2607740 1 -- 172.21.15.19:0/1200184577 shutdown_connections 2024-09-10T22:34:11.797 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:11.695+0000 7f59c2607740 1 --2- 172.21.15.19:0/1200184577 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x563ac2901950 0x563ac2902d40 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:34:11.797 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:11.695+0000 7f59c2607740 1 --2- 172.21.15.19:0/1200184577 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563ac28f59c0 0x563ac28fdbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:34:11.797 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:11.695+0000 7f59c2607740 1 --2- 172.21.15.19:0/1200184577 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x563ac28f50a0 0x563ac290d860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:34:11.798 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:11.695+0000 7f59c2607740 1 -- 172.21.15.19:0/1200184577 >> 172.21.15.19:0/1200184577 conn(0x563ac28f2ed0 msgr2=0x563ac28fe460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:34:11.798 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:11.695+0000 7f59c2607740 1 -- 172.21.15.19:0/1200184577 shutdown_connections 2024-09-10T22:34:11.798 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:11.695+0000 7f59c2607740 1 -- 172.21.15.19:0/1200184577 wait complete. 2024-09-10T22:34:11.798 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:11.696+0000 7f59c2607740 1 -- start start 2024-09-10T22:34:11.798 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:11.696+0000 7f59c2607740 1 Processor -- start 2024-09-10T22:34:11.798 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:11.696+0000 7f59c2607740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x563ac28f50a0 0x563ac290a300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:34:11.798 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:11.696+0000 7f59c2607740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563ac28f59c0 0x563ac2902e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:34:11.798 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:11.696+0000 7f59c2607740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x563ac2901950 0x563ac29035e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:34:11.798 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:11.696+0000 7f59c2607740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f59b81aaa90 con 0x563ac28f50a0 2024-09-10T22:34:11.798 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:11.696+0000 7f59c2607740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f59b81abf00 con 0x563ac28f59c0 2024-09-10T22:34:11.798 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:11.696+0000 7f59c2607740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f59b81ab160 con 0x563ac2901950 2024-09-10T22:34:11.798 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:11.696+0000 7f59c2607740 10 client.0 _ll_register_callbacks cb 0x7f59ac005e30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T22:34:11.798 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:11.696+0000 7f59bdfce640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x563ac28f50a0 0x563ac290a300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:34:11.798 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:11.696+0000 7f59bdfce640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x563ac28f50a0 0x563ac290a300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:39142/0 (socket says 172.21.15.19:39142) 2024-09-10T22:34:11.799 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:11.696+0000 7f59bdfce640 1 -- 172.21.15.19:0/2667151815 learned_addr learned my addr 172.21.15.19:0/2667151815 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:34:11.799 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:11.696+0000 7f59bd7cd640 1 --2- 172.21.15.19:0/2667151815 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563ac28f59c0 0x563ac2902e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:34:11.799 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:11.696+0000 7f59be7cf640 1 --2- 172.21.15.19:0/2667151815 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x563ac2901950 0x563ac29035e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:34:11.799 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:11.697+0000 7f59bdfce640 1 -- 172.21.15.19:0/2667151815 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x563ac2901950 msgr2=0x563ac29035e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:34:11.799 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:11.697+0000 7f59bdfce640 1 --2- 172.21.15.19:0/2667151815 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x563ac2901950 0x563ac29035e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:34:11.799 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:11.697+0000 7f59bdfce640 1 -- 172.21.15.19:0/2667151815 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563ac28f59c0 msgr2=0x563ac2902e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:34:11.799 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:11.697+0000 7f59bdfce640 1 --2- 172.21.15.19:0/2667151815 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563ac28f59c0 0x563ac2902e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:34:11.799 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:11.697+0000 7f59bdfce640 1 -- 172.21.15.19:0/2667151815 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563ac2908ef0 con 0x563ac28f50a0 2024-09-10T22:34:11.799 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:11.697+0000 7f59bdfce640 1 --2- 172.21.15.19:0/2667151815 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x563ac28f50a0 0x563ac290a300 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7f59a8031610 tx=0x7f59a80095c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7506f5066366e7aa server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:34:11.799 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:11.697+0000 7f599d7fa640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-10T22:34:11.799 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:11.697+0000 7f599d7fa640 1 -- 172.21.15.19:0/2667151815 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59a80318b0 con 0x563ac28f50a0 2024-09-10T22:34:11.799 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:11.697+0000 7f599d7fa640 1 -- 172.21.15.19:0/2667151815 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8327+0+0 (secure 0 0 0) 0x7f59a8003970 con 0x563ac28f50a0 2024-09-10T22:34:11.800 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:11.697+0000 7f59c2607740 1 -- 172.21.15.19:0/2667151815 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f59b0004390 con 0x563ac28f50a0 2024-09-10T22:34:11.800 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:11.697+0000 7f599d7fa640 1 -- 172.21.15.19:0/2667151815 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f59a8063050 con 0x563ac28f50a0 2024-09-10T22:34:11.800 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:11.697+0000 7f59c2607740 10 client.16938 fetch_fsmap learned FSMap version 27 2024-09-10T22:34:11.800 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:11.697+0000 7f59c2607740 1 -- 172.21.15.19:0/2667151815 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x563ac297e400 con 0x563ac28f50a0 2024-09-10T22:34:11.800 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:11.698+0000 7f599d7fa640 1 -- 172.21.15.19:0/2667151815 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f59b0004390 con 0x563ac28f50a0 2024-09-10T22:34:11.800 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:11.698+0000 7f599d7fa640 1 -- 172.21.15.19:0/2667151815 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7f59a802f660 con 0x563ac28f50a0 2024-09-10T22:34:11.800 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:11.698+0000 7f59c2607740 10 client.16938 fetch_fsmap finished waiting for FSMap version 27 2024-09-10T22:34:11.800 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:11.698+0000 7f59c2607740 10 client.16938 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-10T22:34:11.800 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:11.698+0000 7f59c2607740 20 client.16938 populate_metadata read hostname 'smithi019' 2024-09-10T22:34:11.800 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:11.698+0000 7f59c2607740 1 --2- 172.21.15.19:0/2667151815 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x563ac297eb60 0x563ac2980f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:34:11.800 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:11.698+0000 7f59c2607740 4 client.16938 mds_command: new command op to 24581 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-10T22:34:11.800 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:11.698+0000 7f59c2607740 1 -- 172.21.15.19:0/2667151815 --> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] -- command(tid 0: {"prefix": "scrub status"}) -- 0x563ac2869850 con 0x563ac297eb60 2024-09-10T22:34:11.801 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:11.698+0000 7f59bd7cd640 1 --2- 172.21.15.19:0/2667151815 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x563ac297eb60 0x563ac2980f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:34:11.801 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:11.698+0000 7f599d7fa640 10 client.16938 ms_handle_connect on v2:172.21.15.135:6838/1254769802 2024-09-10T22:34:11.801 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:11.698+0000 7f59bd7cd640 1 --2- 172.21.15.19:0/2667151815 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x563ac297eb60 0x563ac2980f80 crc :-1 s=READY pgs=165 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=164d185c65c0b8c4 server_cookie=7c5fe9d10861513c in_seq=0 out_seq=0 2024-09-10T22:34:11.801 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:11.699+0000 7f599d7fa640 1 -- 172.21.15.19:0/2667151815 <== mds.0 v2:172.21.15.135:6838/1254769802 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3410 (crc 0 0 0) 0x563ac2869850 con 0x563ac297eb60 2024-09-10T22:34:11.801 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:11.699+0000 7f599d7fa640 10 client.16938 handle_command_reply: tid=0 2024-09-10T22:34:11.801 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:11.699+0000 7f59c2607740 1 client.16938 shutdown 2024-09-10T22:34:11.801 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:11.699+0000 7f59c2607740 1 -- 172.21.15.19:0/2667151815 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x563ac28f50a0 msgr2=0x563ac290a300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:34:11.801 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:11.699+0000 7f59c2607740 1 --2- 172.21.15.19:0/2667151815 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x563ac28f50a0 0x563ac290a300 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7f59a8031610 tx=0x7f59a80095c0 comp rx=0 tx=0).stop 2024-09-10T22:34:11.801 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:11.699+0000 7f59c2607740 1 -- 172.21.15.19:0/2667151815 shutdown_connections 2024-09-10T22:34:11.801 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:11.699+0000 7f59c2607740 1 --2- 172.21.15.19:0/2667151815 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x563ac297eb60 0x563ac2980f80 crc :-1 s=READY pgs=165 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:34:11.801 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:11.699+0000 7f59c2607740 1 --2- 172.21.15.19:0/2667151815 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x563ac2901950 0x563ac29035e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:34:11.801 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:11.699+0000 7f59c2607740 1 --2- 172.21.15.19:0/2667151815 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563ac28f59c0 0x563ac2902e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:34:11.801 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:11.699+0000 7f59c2607740 1 --2- 172.21.15.19:0/2667151815 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x563ac28f50a0 0x563ac290a300 unknown :-1 s=CLOSED pgs=735 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:34:11.801 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:11.699+0000 7f599d7fa640 0 client.16938 ms_handle_reset on v2:172.21.15.135:6838/1254769802 2024-09-10T22:34:11.802 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:11.699+0000 7f59c2607740 1 -- 172.21.15.19:0/2667151815 >> 172.21.15.19:0/2667151815 conn(0x563ac28f2ed0 msgr2=0x563ac28f1700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:34:11.802 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:11.699+0000 7f59c2607740 1 -- 172.21.15.19:0/2667151815 shutdown_connections 2024-09-10T22:34:11.802 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:11.699+0000 7f59c2607740 1 -- 172.21.15.19:0/2667151815 wait complete. 2024-09-10T22:34:11.802 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:11.699+0000 7f59c2607740 20 client.16938 trim_cache size 0 max 16384 2024-09-10T22:34:11.802 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:11.700+0000 7f59c0232640 1 -- 172.21.15.19:0/3163861274 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f59a00b52e0 msgr2=0x7f59a00b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:34:11.802 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:11.700+0000 7f59c0232640 1 --2- 172.21.15.19:0/3163861274 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f59a00b52e0 0x7f59a00b77a0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x563ac28f3db0 tx=0x7f59a8009360 comp rx=0 tx=0).stop 2024-09-10T22:34:11.802 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:11.700+0000 7f59c0232640 1 -- 172.21.15.19:0/3163861274 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f59b81045c0 msgr2=0x7f59b81997a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:34:11.802 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:11.700+0000 7f59c0232640 1 --2- 172.21.15.19:0/3163861274 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f59b81045c0 0x7f59b81997a0 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7f59ac00e9c0 tx=0x7f59ac00edc0 comp rx=0 tx=0).stop 2024-09-10T22:34:11.802 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:11.700+0000 7f59c0232640 1 -- 172.21.15.19:0/3163861274 shutdown_connections 2024-09-10T22:34:11.802 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:11.700+0000 7f59c0232640 1 --2- 172.21.15.19:0/3163861274 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f59a00b52e0 0x7f59a00b77a0 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:34:11.802 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:11.700+0000 7f59c0232640 1 --2- 172.21.15.19:0/3163861274 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f59b810d100 0x7f59b819eb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:34:11.802 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:11.700+0000 7f59c0232640 1 --2- 172.21.15.19:0/3163861274 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f59b81045c0 0x7f59b81997a0 unknown :-1 s=CLOSED pgs=733 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:34:11.802 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:11.700+0000 7f59c0232640 1 --2- 172.21.15.19:0/3163861274 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f59b8103ca0 0x7f59b8199260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:34:11.803 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:11.700+0000 7f59c0232640 1 -- 172.21.15.19:0/3163861274 >> 172.21.15.19:0/3163861274 conn(0x7f59b80fd700 msgr2=0x7f59b80fe300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:34:11.803 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:11.700+0000 7f59c0232640 1 -- 172.21.15.19:0/3163861274 shutdown_connections 2024-09-10T22:34:11.803 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:11.700+0000 7f59c0232640 1 -- 172.21.15.19:0/3163861274 wait complete. 2024-09-10T22:34:12.360 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:34:12 smithi135 ceph-mon[34789]: pgmap v580: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 879 KiB/s rd, 298 MiB/s wr, 684 op/s 2024-09-10T22:34:12.375 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:34:12 smithi138 ceph-mon[35236]: pgmap v580: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 879 KiB/s rd, 298 MiB/s wr, 684 op/s 2024-09-10T22:34:12.431 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:34:12 smithi019 ceph-mon[31375]: pgmap v580: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 879 KiB/s rd, 298 MiB/s wr, 684 op/s 2024-09-10T22:34:12.979 INFO:tasks.cephfs.filesystem:scrub status for tag:9efe684b-7583-402e-a46e-e262a37e1af5 - {'path': '/', 'tag': '9efe684b-7583-402e-a46e-e262a37e1af5', 'options': 'recursive,force'} 2024-09-10T22:34:14.321 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:34:14 smithi019 ceph-mon[31375]: pgmap v581: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 602 KiB/s rd, 261 MiB/s wr, 588 op/s 2024-09-10T22:34:14.359 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:34:14 smithi135 ceph-mon[34789]: pgmap v581: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 602 KiB/s rd, 261 MiB/s wr, 588 op/s 2024-09-10T22:34:14.375 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:34:14 smithi138 ceph-mon[35236]: pgmap v581: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 602 KiB/s rd, 261 MiB/s wr, 588 op/s 2024-09-10T22:34:16.459 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:34:16 smithi019 ceph-mon[31375]: pgmap v582: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 603 KiB/s rd, 266 MiB/s wr, 642 op/s 2024-09-10T22:34:16.609 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:34:16 smithi135 ceph-mon[34789]: pgmap v582: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 603 KiB/s rd, 266 MiB/s wr, 642 op/s 2024-09-10T22:34:16.625 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:34:16 smithi138 ceph-mon[35236]: pgmap v582: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 603 KiB/s rd, 266 MiB/s wr, 642 op/s 2024-09-10T22:34:18.459 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:34:18 smithi019 ceph-mon[31375]: pgmap v583: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 685 KiB/s rd, 284 MiB/s wr, 855 op/s 2024-09-10T22:34:18.459 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:34:18 smithi019 ceph-mon[31375]: scrub summary: idle 2024-09-10T22:34:18.459 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:34:18 smithi019 ceph-mon[31375]: scrub summary: idle 2024-09-10T22:34:18.610 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:34:18 smithi135 ceph-mon[34789]: pgmap v583: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 685 KiB/s rd, 284 MiB/s wr, 855 op/s 2024-09-10T22:34:18.610 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:34:18 smithi135 ceph-mon[34789]: scrub summary: idle 2024-09-10T22:34:18.610 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:34:18 smithi135 ceph-mon[34789]: scrub summary: idle 2024-09-10T22:34:18.625 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:34:18 smithi138 ceph-mon[35236]: pgmap v583: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 685 KiB/s rd, 284 MiB/s wr, 855 op/s 2024-09-10T22:34:18.625 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:34:18 smithi138 ceph-mon[35236]: scrub summary: idle 2024-09-10T22:34:18.625 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:34:18 smithi138 ceph-mon[35236]: scrub summary: idle 2024-09-10T22:34:20.461 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:34:20 smithi019 ceph-mon[31375]: pgmap v584: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 417 KiB/s rd, 205 MiB/s wr, 792 op/s 2024-09-10T22:34:20.610 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:34:20 smithi135 ceph-mon[34789]: pgmap v584: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 417 KiB/s rd, 205 MiB/s wr, 792 op/s 2024-09-10T22:34:20.625 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:34:20 smithi138 ceph-mon[35236]: pgmap v584: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 417 KiB/s rd, 205 MiB/s wr, 792 op/s 2024-09-10T22:34:22.458 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:34:22 smithi019 ceph-mon[31375]: pgmap v585: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 638 KiB/s rd, 253 MiB/s wr, 980 op/s 2024-09-10T22:34:22.610 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:34:22 smithi135 ceph-mon[34789]: pgmap v585: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 638 KiB/s rd, 253 MiB/s wr, 980 op/s 2024-09-10T22:34:22.625 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:34:22 smithi138 ceph-mon[35236]: pgmap v585: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 638 KiB/s rd, 253 MiB/s wr, 980 op/s 2024-09-10T22:34:23.396 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:23.394+0000 7f5350e2b640 1 -- 172.21.15.19:0/2534732237 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f534c103380 msgr2=0x7f534c109d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:34:23.397 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:23.394+0000 7f5350e2b640 1 --2- 172.21.15.19:0/2534732237 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f534c103380 0x7f534c109d00 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f5344009cd0 tx=0x7f534402a8e0 comp rx=0 tx=0).stop 2024-09-10T22:34:23.397 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:23.394+0000 7f5350e2b640 1 -- 172.21.15.19:0/2534732237 shutdown_connections 2024-09-10T22:34:23.397 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:23.394+0000 7f5350e2b640 1 --2- 172.21.15.19:0/2534732237 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f534c103380 0x7f534c109d00 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:34:23.397 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:23.394+0000 7f5350e2b640 1 --2- 172.21.15.19:0/2534732237 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f534c1029c0 0x7f534c102e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:34:23.397 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:23.394+0000 7f5350e2b640 1 --2- 172.21.15.19:0/2534732237 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f534c101870 0x7f534c101c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:34:23.397 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:23.395+0000 7f5350e2b640 1 -- 172.21.15.19:0/2534732237 >> 172.21.15.19:0/2534732237 conn(0x7f534c0fd130 msgr2=0x7f534c0ff550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:34:23.397 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:23.395+0000 7f5350e2b640 1 -- 172.21.15.19:0/2534732237 shutdown_connections 2024-09-10T22:34:23.397 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:23.395+0000 7f5350e2b640 1 -- 172.21.15.19:0/2534732237 wait complete. 2024-09-10T22:34:23.399 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:23.395+0000 7f5350e2b640 1 Processor -- start 2024-09-10T22:34:23.399 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:23.395+0000 7f5350e2b640 1 -- start start 2024-09-10T22:34:23.399 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:23.396+0000 7f5350e2b640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f534c101870 0x7f534c06b900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:34:23.399 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:23.396+0000 7f5350e2b640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f534c1029c0 0x7f534c19fea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:34:23.399 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:23.396+0000 7f5350e2b640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f534c103380 0x7f534c1a23f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:34:23.399 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:23.396+0000 7f5350e2b640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f534c10d4e0 con 0x7f534c1029c0 2024-09-10T22:34:23.399 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:23.396+0000 7f5350e2b640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f534c10d360 con 0x7f534c103380 2024-09-10T22:34:23.399 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:23.396+0000 7f5350e2b640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f534c10d660 con 0x7f534c101870 2024-09-10T22:34:23.400 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:23.396+0000 7f534a59c640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f534c101870 0x7f534c06b900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:34:23.400 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:23.396+0000 7f5343fff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f534c1029c0 0x7f534c19fea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:34:23.400 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:23.396+0000 7f534ad9d640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f534c103380 0x7f534c1a23f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:34:23.400 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:23.396+0000 7f534a59c640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f534c101870 0x7f534c06b900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.19:44232/0 (socket says 172.21.15.19:44232) 2024-09-10T22:34:23.400 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:23.396+0000 7f534a59c640 1 -- 172.21.15.19:0/702839343 learned_addr learned my addr 172.21.15.19:0/702839343 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:34:23.400 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:23.396+0000 7f534a59c640 1 -- 172.21.15.19:0/702839343 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f534c103380 msgr2=0x7f534c1a23f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:34:23.400 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:23.396+0000 7f534a59c640 1 --2- 172.21.15.19:0/702839343 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f534c103380 0x7f534c1a23f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:34:23.400 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:23.396+0000 7f534a59c640 1 -- 172.21.15.19:0/702839343 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f534c1029c0 msgr2=0x7f534c19fea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:34:23.400 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:23.396+0000 7f534a59c640 1 --2- 172.21.15.19:0/702839343 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f534c1029c0 0x7f534c19fea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:34:23.400 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:23.396+0000 7f534a59c640 1 -- 172.21.15.19:0/702839343 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f534c1a2b70 con 0x7f534c101870 2024-09-10T22:34:23.400 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:23.396+0000 7f534a59c640 1 --2- 172.21.15.19:0/702839343 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f534c101870 0x7f534c06b900 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f533c00e9f0 tx=0x7f533c00edf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:34:23.400 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:23.396+0000 7f53437fe640 1 -- 172.21.15.19:0/702839343 <== mon.1 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f533c00cd80 con 0x7f534c101870 2024-09-10T22:34:23.400 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:23.396+0000 7f53437fe640 1 -- 172.21.15.19:0/702839343 <== mon.1 v2:172.21.15.138:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f533c0054d0 con 0x7f534c101870 2024-09-10T22:34:23.401 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:23.396+0000 7f5350e2b640 1 -- 172.21.15.19:0/702839343 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f534c1a2e60 con 0x7f534c101870 2024-09-10T22:34:23.401 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:23.396+0000 7f53437fe640 1 -- 172.21.15.19:0/702839343 <== mon.1 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f533c010690 con 0x7f534c101870 2024-09-10T22:34:23.401 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:23.397+0000 7f5350e2b640 1 -- 172.21.15.19:0/702839343 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f534c1a32c0 con 0x7f534c101870 2024-09-10T22:34:23.401 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:23.399+0000 7f53437fe640 1 -- 172.21.15.19:0/702839343 <== mon.1 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 18) ==== 153250+0+0 (secure 0 0 0) 0x7f533c004e90 con 0x7f534c101870 2024-09-10T22:34:23.402 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:23.400+0000 7f53437fe640 1 --2- 172.21.15.19:0/702839343 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f53380b52e0 0x7f53380b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:34:23.402 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:23.400+0000 7f5343fff640 1 --2- 172.21.15.19:0/702839343 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f53380b52e0 0x7f53380b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:34:23.402 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:23.400+0000 7f53437fe640 1 -- 172.21.15.19:0/702839343 <== mon.1 v2:172.21.15.138:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8327+0+0 (secure 0 0 0) 0x7f533c0e6070 con 0x7f534c101870 2024-09-10T22:34:23.404 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:23.400+0000 7f5343fff640 1 --2- 172.21.15.19:0/702839343 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f53380b52e0 0x7f53380b77a0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f5334009bd0 tx=0x7f5334005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:34:23.404 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:23.401+0000 7f5353bf3740 1 Processor -- start 2024-09-10T22:34:23.404 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:23.401+0000 7f5353bf3740 1 -- start start 2024-09-10T22:34:23.404 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:23.401+0000 7f5353bf3740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b54936b860 0x55b54936dc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:34:23.404 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:23.401+0000 7f5353bf3740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55b54936e190 0x55b549370580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:34:23.404 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:23.401+0000 7f5353bf3740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55b549370bd0 0x55b549373090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:34:23.404 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:23.401+0000 7f5353bf3740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x55b5492dd6f0 con 0x55b549370bd0 2024-09-10T22:34:23.404 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:23.401+0000 7f5353bf3740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55b5492ccb20 con 0x55b54936b860 2024-09-10T22:34:23.404 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:23.401+0000 7f5353bf3740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x55b5492d0930 con 0x55b54936e190 2024-09-10T22:34:23.405 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:23.402+0000 7f534ad9d640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55b549370bd0 0x55b549373090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:34:23.405 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:23.402+0000 7f534a59c640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b54936b860 0x55b54936dc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:34:23.405 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:23.402+0000 7f534a59c640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b54936b860 0x55b54936dc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.19:55656/0 (socket says 172.21.15.19:55656) 2024-09-10T22:34:23.405 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:23.402+0000 7f534ad9d640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55b549370bd0 0x55b549373090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:50776/0 (socket says 172.21.15.19:50776) 2024-09-10T22:34:23.405 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:23.402+0000 7f534a59c640 1 -- 172.21.15.19:0/3995378980 learned_addr learned my addr 172.21.15.19:0/3995378980 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:34:23.405 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:23.402+0000 7f5343fff640 1 --2- 172.21.15.19:0/3995378980 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55b54936e190 0x55b549370580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:34:23.405 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:23.402+0000 7f534a59c640 1 -- 172.21.15.19:0/3995378980 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55b54936e190 msgr2=0x55b549370580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:34:23.405 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:23.402+0000 7f534a59c640 1 --2- 172.21.15.19:0/3995378980 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55b54936e190 0x55b549370580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:34:23.405 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:23.402+0000 7f534a59c640 1 -- 172.21.15.19:0/3995378980 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55b549370bd0 msgr2=0x55b549373090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:34:23.405 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:23.402+0000 7f534a59c640 1 --2- 172.21.15.19:0/3995378980 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55b549370bd0 0x55b549373090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:34:23.405 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:23.402+0000 7f534a59c640 1 -- 172.21.15.19:0/3995378980 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b549292530 con 0x55b54936b860 2024-09-10T22:34:23.406 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:23.402+0000 7f534ad9d640 1 --2- 172.21.15.19:0/3995378980 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55b549370bd0 0x55b549373090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T22:34:23.406 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:23.402+0000 7f534a59c640 1 --2- 172.21.15.19:0/3995378980 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b54936b860 0x55b54936dc50 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f533c0ac700 tx=0x7f533c0ac0c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bc6adc0ca5811138 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:34:23.406 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:23.402+0000 7f5340ff9640 1 -- 172.21.15.19:0/3995378980 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f533c0ace70 con 0x55b54936b860 2024-09-10T22:34:23.406 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:23.402+0000 7f5340ff9640 1 -- 172.21.15.19:0/3995378980 <== mon.2 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f533c0ac770 con 0x55b54936b860 2024-09-10T22:34:23.406 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:23.402+0000 7f5340ff9640 1 -- 172.21.15.19:0/3995378980 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f533c0b5870 con 0x55b54936b860 2024-09-10T22:34:23.410 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:23.403+0000 7f5353bf3740 1 -- 172.21.15.19:0/3995378980 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b54936b860 msgr2=0x55b54936dc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:34:23.410 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:23.403+0000 7f5353bf3740 1 --2- 172.21.15.19:0/3995378980 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b54936b860 0x55b54936dc50 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f533c0ac700 tx=0x7f533c0ac0c0 comp rx=0 tx=0).stop 2024-09-10T22:34:23.410 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:23.403+0000 7f5353bf3740 1 -- 172.21.15.19:0/3995378980 shutdown_connections 2024-09-10T22:34:23.411 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:23.403+0000 7f5353bf3740 1 --2- 172.21.15.19:0/3995378980 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55b549370bd0 0x55b549373090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:34:23.411 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:23.403+0000 7f5353bf3740 1 --2- 172.21.15.19:0/3995378980 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55b54936e190 0x55b549370580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:34:23.411 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:23.403+0000 7f5353bf3740 1 --2- 172.21.15.19:0/3995378980 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b54936b860 0x55b54936dc50 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:34:23.411 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:23.404+0000 7f5353bf3740 1 -- 172.21.15.19:0/3995378980 >> 172.21.15.19:0/3995378980 conn(0x55b5493669b0 msgr2=0x55b549367740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:34:23.411 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:23.404+0000 7f5353bf3740 1 -- 172.21.15.19:0/3995378980 shutdown_connections 2024-09-10T22:34:23.411 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:23.404+0000 7f5353bf3740 1 -- 172.21.15.19:0/3995378980 wait complete. 2024-09-10T22:34:23.411 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:23.404+0000 7f5353bf3740 1 -- start start 2024-09-10T22:34:23.411 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:23.404+0000 7f5353bf3740 1 Processor -- start 2024-09-10T22:34:23.411 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:23.405+0000 7f5353bf3740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b54936b860 0x55b549374ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:34:23.411 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:23.405+0000 7f5353bf3740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55b54936e190 0x55b549375590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:34:23.411 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:23.405+0000 7f5353bf3740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55b549370bd0 0x55b549376160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:34:23.411 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:23.405+0000 7f5353bf3740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x55b549204ab0 con 0x55b54936e190 2024-09-10T22:34:23.411 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:23.405+0000 7f5353bf3740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55b549272730 con 0x55b54936b860 2024-09-10T22:34:23.412 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:23.405+0000 7f5353bf3740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x55b549373bb0 con 0x55b549370bd0 2024-09-10T22:34:23.412 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:23.405+0000 7f5353bf3740 10 client.0 _ll_register_callbacks cb 0x55b5492c66b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T22:34:23.412 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:23.405+0000 7f534a59c640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b54936b860 0x55b549374ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:34:23.412 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:23.405+0000 7f5343fff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55b54936e190 0x55b549375590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:34:23.412 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:23.405+0000 7f534a59c640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b54936b860 0x55b549374ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.19:55672/0 (socket says 172.21.15.19:55672) 2024-09-10T22:34:23.412 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:23.405+0000 7f534a59c640 1 -- 172.21.15.19:0/4167259200 learned_addr learned my addr 172.21.15.19:0/4167259200 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:34:23.412 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:23.405+0000 7f534ad9d640 1 --2- 172.21.15.19:0/4167259200 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55b549370bd0 0x55b549376160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:34:23.412 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:23.405+0000 7f534a59c640 1 -- 172.21.15.19:0/4167259200 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55b549370bd0 msgr2=0x55b549376160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:34:23.412 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:23.405+0000 7f534a59c640 1 --2- 172.21.15.19:0/4167259200 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55b549370bd0 0x55b549376160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:34:23.412 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:23.405+0000 7f534a59c640 1 -- 172.21.15.19:0/4167259200 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55b54936e190 msgr2=0x55b549375590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:34:23.412 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:23.405+0000 7f534a59c640 1 --2- 172.21.15.19:0/4167259200 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55b54936e190 0x55b549375590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:34:23.412 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:23.405+0000 7f534a59c640 1 -- 172.21.15.19:0/4167259200 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b54902e790 con 0x55b54936b860 2024-09-10T22:34:23.412 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:23.405+0000 7f534ad9d640 1 --2- 172.21.15.19:0/4167259200 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55b549370bd0 0x55b549376160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T22:34:23.413 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:23.405+0000 7f534a59c640 1 --2- 172.21.15.19:0/4167259200 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b54936b860 0x55b549374ef0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f533c0ac470 tx=0x7f533c009330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=29953cf36354e6d7 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:34:23.413 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:23.405+0000 7f5331ffb640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-09-10T22:34:23.413 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:23.406+0000 7f5331ffb640 1 -- 172.21.15.19:0/4167259200 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f533c097020 con 0x55b54936b860 2024-09-10T22:34:23.413 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:23.406+0000 7f5331ffb640 1 -- 172.21.15.19:0/4167259200 <== mon.2 v2:172.21.15.135:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8327+0+0 (secure 0 0 0) 0x7f533c0ab9d0 con 0x55b54936b860 2024-09-10T22:34:23.413 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:23.406+0000 7f5353bf3740 1 -- 172.21.15.19:0/4167259200 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f533c0ac770 con 0x55b54936b860 2024-09-10T22:34:23.413 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:23.406+0000 7f5331ffb640 1 -- 172.21.15.19:0/4167259200 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f533c005320 con 0x55b54936b860 2024-09-10T22:34:23.413 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:23.406+0000 7f5353bf3740 10 client.26288 fetch_fsmap learned FSMap version 27 2024-09-10T22:34:23.413 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:23.406+0000 7f5353bf3740 1 -- 172.21.15.19:0/4167259200 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55b5490a7620 con 0x55b54936b860 2024-09-10T22:34:23.413 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:23.406+0000 7f5331ffb640 1 -- 172.21.15.19:0/4167259200 <== mon.2 v2:172.21.15.135:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f533c0ac770 con 0x55b54936b860 2024-09-10T22:34:23.413 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:23.406+0000 7f5331ffb640 1 -- 172.21.15.19:0/4167259200 <== mon.2 v2:172.21.15.135:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7f533c0c3030 con 0x55b54936b860 2024-09-10T22:34:23.413 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:23.406+0000 7f5353bf3740 10 client.26288 fetch_fsmap finished waiting for FSMap version 27 2024-09-10T22:34:23.413 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:23.406+0000 7f5353bf3740 10 client.26288 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-10T22:34:23.413 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:23.406+0000 7f5353bf3740 20 client.26288 populate_metadata read hostname 'smithi019' 2024-09-10T22:34:23.414 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:23.406+0000 7f5353bf3740 1 --2- 172.21.15.19:0/4167259200 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x55b549380390 0x55b549382780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:34:23.414 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:23.406+0000 7f5353bf3740 4 client.26288 mds_command: new command op to 24581 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T22:34:23.414 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:23.406+0000 7f5353bf3740 1 -- 172.21.15.19:0/4167259200 --> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b5492df640 con 0x55b549380390 2024-09-10T22:34:23.414 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:23.407+0000 7f5343fff640 1 --2- 172.21.15.19:0/4167259200 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x55b549380390 0x55b549382780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:34:23.414 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:23.407+0000 7f5343fff640 1 --2- 172.21.15.19:0/4167259200 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x55b549380390 0x55b549382780 crc :-1 s=READY pgs=166 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f3e1315a3b5d5ff5 server_cookie=729236b77045754f in_seq=0 out_seq=0 2024-09-10T22:34:23.414 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:23.407+0000 7f5331ffb640 10 client.26288 ms_handle_connect on v2:172.21.15.135:6838/1254769802 2024-09-10T22:34:23.414 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:23.408+0000 7f5331ffb640 1 -- 172.21.15.19:0/4167259200 <== mds.0 v2:172.21.15.135:6838/1254769802 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55b5492df640 con 0x55b549380390 2024-09-10T22:34:23.414 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:23.408+0000 7f5331ffb640 10 client.26288 handle_command_reply: tid=0 2024-09-10T22:34:23.414 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:23.408+0000 7f5353bf3740 1 client.26288 shutdown 2024-09-10T22:34:23.414 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:23.408+0000 7f5353bf3740 1 -- 172.21.15.19:0/4167259200 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b54936b860 msgr2=0x55b549374ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:34:23.414 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:23.408+0000 7f5353bf3740 1 --2- 172.21.15.19:0/4167259200 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b54936b860 0x55b549374ef0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f533c0ac470 tx=0x7f533c009330 comp rx=0 tx=0).stop 2024-09-10T22:34:23.414 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:23.408+0000 7f5353bf3740 1 -- 172.21.15.19:0/4167259200 shutdown_connections 2024-09-10T22:34:23.415 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:23.408+0000 7f5353bf3740 1 --2- 172.21.15.19:0/4167259200 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x55b549380390 0x55b549382780 crc :-1 s=READY pgs=166 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:34:23.415 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:23.408+0000 7f5353bf3740 1 --2- 172.21.15.19:0/4167259200 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55b549370bd0 0x55b549376160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:34:23.415 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:23.408+0000 7f5353bf3740 1 --2- 172.21.15.19:0/4167259200 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55b54936e190 0x55b549375590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:34:23.415 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:23.408+0000 7f5353bf3740 1 --2- 172.21.15.19:0/4167259200 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b54936b860 0x55b549374ef0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:34:23.415 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:23.408+0000 7f5331ffb640 0 client.26288 ms_handle_reset on v2:172.21.15.135:6838/1254769802 2024-09-10T22:34:23.415 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:23.408+0000 7f5353bf3740 1 -- 172.21.15.19:0/4167259200 >> 172.21.15.19:0/4167259200 conn(0x55b5493669b0 msgr2=0x55b549365bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:34:23.415 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:23.408+0000 7f5353bf3740 1 -- 172.21.15.19:0/4167259200 shutdown_connections 2024-09-10T22:34:23.415 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:23.408+0000 7f5353bf3740 1 -- 172.21.15.19:0/4167259200 wait complete. 2024-09-10T22:34:23.415 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:23.408+0000 7f5353bf3740 20 client.26288 trim_cache size 0 max 16384 2024-09-10T22:34:23.426 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:23.424+0000 7f5353bf3740 1 Processor -- start 2024-09-10T22:34:23.426 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:23.424+0000 7f5353bf3740 1 -- start start 2024-09-10T22:34:23.426 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:23.424+0000 7f5353bf3740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55b54936b860 0x55b549373f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:34:23.426 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:23.424+0000 7f5353bf3740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55b54936e190 0x55b549374490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:34:23.427 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:23.424+0000 7f5353bf3740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b549370bd0 0x55b549370fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:34:23.427 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:23.424+0000 7f5353bf3740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f534c1aebd0 con 0x55b54936b860 2024-09-10T22:34:23.427 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:23.424+0000 7f5353bf3740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f534c1ac4a0 con 0x55b549370bd0 2024-09-10T22:34:23.427 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:23.424+0000 7f5353bf3740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f534c1aa2f0 con 0x55b54936e190 2024-09-10T22:34:23.427 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:23.424+0000 7f534a59c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55b54936b860 0x55b549373f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:34:23.427 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:23.424+0000 7f5343fff640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55b54936e190 0x55b549374490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:34:23.427 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:23.424+0000 7f534ad9d640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b549370bd0 0x55b549370fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:34:23.427 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:23.424+0000 7f534a59c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55b54936b860 0x55b549373f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:50796/0 (socket says 172.21.15.19:50796) 2024-09-10T22:34:23.427 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:23.424+0000 7f534a59c640 1 -- 172.21.15.19:0/2618642520 learned_addr learned my addr 172.21.15.19:0/2618642520 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:34:23.427 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:23.424+0000 7f5343fff640 1 -- 172.21.15.19:0/2618642520 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b549370bd0 msgr2=0x55b549370fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:34:23.428 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:23.424+0000 7f5343fff640 1 --2- 172.21.15.19:0/2618642520 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b549370bd0 0x55b549370fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:34:23.428 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:23.424+0000 7f5343fff640 1 -- 172.21.15.19:0/2618642520 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55b54936b860 msgr2=0x55b549373f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:34:23.428 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:23.424+0000 7f5343fff640 1 --2- 172.21.15.19:0/2618642520 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55b54936b860 0x55b549373f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:34:23.428 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:23.424+0000 7f5343fff640 1 -- 172.21.15.19:0/2618642520 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b549382af0 con 0x55b54936e190 2024-09-10T22:34:23.428 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:23.424+0000 7f534a59c640 1 --2- 172.21.15.19:0/2618642520 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55b54936b860 0x55b549373f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T22:34:23.428 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:23.425+0000 7f5343fff640 1 --2- 172.21.15.19:0/2618642520 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55b54936e190 0x55b549374490 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x55b5492ccc70 tx=0x7f5334014000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=29a0a5333cf987bd server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:34:23.428 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:23.425+0000 7f5333fff640 1 -- 172.21.15.19:0/2618642520 <== mon.1 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5334035070 con 0x55b54936e190 2024-09-10T22:34:23.428 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:23.425+0000 7f5333fff640 1 -- 172.21.15.19:0/2618642520 <== mon.1 v2:172.21.15.138:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5334003e40 con 0x55b54936e190 2024-09-10T22:34:23.428 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:23.425+0000 7f5333fff640 1 -- 172.21.15.19:0/2618642520 <== mon.1 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f533401d780 con 0x55b54936e190 2024-09-10T22:34:23.432 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:23.426+0000 7f5353bf3740 1 -- 172.21.15.19:0/2618642520 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55b54936e190 msgr2=0x55b549374490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:34:23.432 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:23.426+0000 7f5353bf3740 1 --2- 172.21.15.19:0/2618642520 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55b54936e190 0x55b549374490 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x55b5492ccc70 tx=0x7f5334014000 comp rx=0 tx=0).stop 2024-09-10T22:34:23.432 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:23.426+0000 7f5353bf3740 1 -- 172.21.15.19:0/2618642520 shutdown_connections 2024-09-10T22:34:23.432 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:23.426+0000 7f5353bf3740 1 --2- 172.21.15.19:0/2618642520 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b549370bd0 0x55b549370fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:34:23.432 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:23.426+0000 7f5353bf3740 1 --2- 172.21.15.19:0/2618642520 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55b54936e190 0x55b549374490 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:34:23.432 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:23.426+0000 7f5353bf3740 1 --2- 172.21.15.19:0/2618642520 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55b54936b860 0x55b549373f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:34:23.432 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:23.426+0000 7f5353bf3740 1 -- 172.21.15.19:0/2618642520 >> 172.21.15.19:0/2618642520 conn(0x55b5493669b0 msgr2=0x55b54936ad50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:34:23.432 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:23.426+0000 7f5353bf3740 1 -- 172.21.15.19:0/2618642520 shutdown_connections 2024-09-10T22:34:23.432 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:23.427+0000 7f5353bf3740 1 -- 172.21.15.19:0/2618642520 wait complete. 2024-09-10T22:34:23.433 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:23.427+0000 7f5353bf3740 1 -- start start 2024-09-10T22:34:23.433 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:23.427+0000 7f5353bf3740 1 Processor -- start 2024-09-10T22:34:23.433 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:23.427+0000 7f5353bf3740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b54936b860 0x55b54937c690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:34:23.433 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:23.427+0000 7f5353bf3740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55b54936e190 0x55b54937b390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:34:23.433 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:23.427+0000 7f5353bf3740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55b549370bd0 0x55b54937b8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:34:23.433 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:23.427+0000 7f5353bf3740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f534c1aa960 con 0x55b549370bd0 2024-09-10T22:34:23.433 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:23.427+0000 7f5353bf3740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f534c1abdd0 con 0x55b54936b860 2024-09-10T22:34:23.433 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:23.427+0000 7f5353bf3740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f534c1ab030 con 0x55b54936e190 2024-09-10T22:34:23.433 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:23.428+0000 7f5353bf3740 10 client.0 _ll_register_callbacks cb 0x7f533c0d2070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T22:34:23.433 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:23.428+0000 7f534a59c640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b54936b860 0x55b54937c690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:34:23.433 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:23.428+0000 7f534a59c640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b54936b860 0x55b54937c690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.19:55688/0 (socket says 172.21.15.19:55688) 2024-09-10T22:34:23.433 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:23.428+0000 7f534a59c640 1 -- 172.21.15.19:0/1907616574 learned_addr learned my addr 172.21.15.19:0/1907616574 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:34:23.433 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:23.428+0000 7f534ad9d640 1 --2- 172.21.15.19:0/1907616574 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55b549370bd0 0x55b54937b8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:34:23.434 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:23.428+0000 7f5343fff640 1 --2- 172.21.15.19:0/1907616574 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55b54936e190 0x55b54937b390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:34:23.434 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:23.428+0000 7f534a59c640 1 -- 172.21.15.19:0/1907616574 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55b54936e190 msgr2=0x55b54937b390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:34:23.434 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:23.428+0000 7f534a59c640 1 --2- 172.21.15.19:0/1907616574 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55b54936e190 0x55b54937b390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:34:23.434 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:23.428+0000 7f534a59c640 1 -- 172.21.15.19:0/1907616574 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55b549370bd0 msgr2=0x55b54937b8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:34:23.434 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:23.428+0000 7f534a59c640 1 --2- 172.21.15.19:0/1907616574 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55b549370bd0 0x55b54937b8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:34:23.434 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:23.428+0000 7f534a59c640 1 -- 172.21.15.19:0/1907616574 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b5493764d0 con 0x55b54936b860 2024-09-10T22:34:23.434 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:23.428+0000 7f534a59c640 1 --2- 172.21.15.19:0/1907616574 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b54936b860 0x55b54937c690 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f533c00c6a0 tx=0x7f533c004990 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e642d5b3c2b05eb6 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:34:23.434 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:23.428+0000 7f5331ffb640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-09-10T22:34:23.434 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:23.428+0000 7f5331ffb640 1 -- 172.21.15.19:0/1907616574 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f533c005680 con 0x55b54936b860 2024-09-10T22:34:23.434 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:23.428+0000 7f5331ffb640 1 -- 172.21.15.19:0/1907616574 <== mon.2 v2:172.21.15.135:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8327+0+0 (secure 0 0 0) 0x7f533c0cf580 con 0x55b54936b860 2024-09-10T22:34:23.434 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:23.428+0000 7f5353bf3740 1 -- 172.21.15.19:0/1907616574 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5334003e40 con 0x55b54936b860 2024-09-10T22:34:23.434 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:23.428+0000 7f5331ffb640 1 -- 172.21.15.19:0/1907616574 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f533c0cfac0 con 0x55b54936b860 2024-09-10T22:34:23.434 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:23.429+0000 7f5353bf3740 10 client.26294 fetch_fsmap learned FSMap version 27 2024-09-10T22:34:23.435 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:23.429+0000 7f5353bf3740 1 -- 172.21.15.19:0/1907616574 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55b54937aa00 con 0x55b54936b860 2024-09-10T22:34:23.435 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:23.429+0000 7f5331ffb640 1 -- 172.21.15.19:0/1907616574 <== mon.2 v2:172.21.15.135:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5334003e40 con 0x55b54936b860 2024-09-10T22:34:23.435 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:23.429+0000 7f5331ffb640 1 -- 172.21.15.19:0/1907616574 <== mon.2 v2:172.21.15.135:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7f533c0c3040 con 0x55b54936b860 2024-09-10T22:34:23.435 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:23.429+0000 7f5353bf3740 10 client.26294 fetch_fsmap finished waiting for FSMap version 27 2024-09-10T22:34:23.435 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:23.429+0000 7f5353bf3740 10 client.26294 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-10T22:34:23.435 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:23.429+0000 7f5353bf3740 20 client.26294 populate_metadata read hostname 'smithi019' 2024-09-10T22:34:23.435 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:23.429+0000 7f5353bf3740 1 --2- 172.21.15.19:0/1907616574 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x55b5493ed400 0x55b5493ef7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:34:23.435 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:23.429+0000 7f5353bf3740 4 client.26294 mds_command: new command op to 24581 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-10T22:34:23.435 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:23.429+0000 7f5353bf3740 1 -- 172.21.15.19:0/1907616574 --> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55b5492db0f0 con 0x55b5493ed400 2024-09-10T22:34:23.435 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:23.429+0000 7f5343fff640 1 --2- 172.21.15.19:0/1907616574 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x55b5493ed400 0x55b5493ef7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:34:23.435 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:23.430+0000 7f5331ffb640 10 client.26294 ms_handle_connect on v2:172.21.15.135:6838/1254769802 2024-09-10T22:34:23.435 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:23.430+0000 7f5343fff640 1 --2- 172.21.15.19:0/1907616574 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x55b5493ed400 0x55b5493ef7f0 crc :-1 s=READY pgs=167 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cef92937d420f6fb server_cookie=d03d6c70a042501c in_seq=0 out_seq=0 2024-09-10T22:34:24.460 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:34:24 smithi019 ceph-mon[31375]: pgmap v586: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 304 KiB/s rd, 223 MiB/s wr, 868 op/s 2024-09-10T22:34:24.610 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:34:24 smithi135 ceph-mon[34789]: pgmap v586: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 304 KiB/s rd, 223 MiB/s wr, 868 op/s 2024-09-10T22:34:24.625 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:34:24 smithi138 ceph-mon[35236]: pgmap v586: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 304 KiB/s rd, 223 MiB/s wr, 868 op/s 2024-09-10T22:34:26.609 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:34:26 smithi135 ceph-mon[34789]: pgmap v587: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 304 KiB/s rd, 226 MiB/s wr, 835 op/s 2024-09-10T22:34:26.625 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:34:26 smithi138 ceph-mon[35236]: pgmap v587: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 304 KiB/s rd, 226 MiB/s wr, 835 op/s 2024-09-10T22:34:26.708 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:34:26 smithi019 ceph-mon[31375]: pgmap v587: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 304 KiB/s rd, 226 MiB/s wr, 835 op/s 2024-09-10T22:34:28.610 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:34:28 smithi135 ceph-mon[34789]: pgmap v588: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 402 KiB/s rd, 261 MiB/s wr, 870 op/s 2024-09-10T22:34:28.625 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:34:28 smithi138 ceph-mon[35236]: pgmap v588: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 402 KiB/s rd, 261 MiB/s wr, 870 op/s 2024-09-10T22:34:28.709 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:34:28 smithi019 ceph-mon[31375]: pgmap v588: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 402 KiB/s rd, 261 MiB/s wr, 870 op/s 2024-09-10T22:34:29.708 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:34:29 smithi019 ceph-mon[31375]: pgmap v589: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 661 KiB/s rd, 212 MiB/s wr, 637 op/s 2024-09-10T22:34:29.860 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:34:29 smithi135 ceph-mon[34789]: pgmap v589: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 661 KiB/s rd, 212 MiB/s wr, 637 op/s 2024-09-10T22:34:29.875 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:34:29 smithi138 ceph-mon[35236]: pgmap v589: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 661 KiB/s rd, 212 MiB/s wr, 637 op/s 2024-09-10T22:34:31.076 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:31.074+0000 7f5331ffb640 1 -- 172.21.15.19:0/1907616574 <== mds.0 v2:172.21.15.135:6838/1254769802 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55b5492db0f0 con 0x55b5493ed400 2024-09-10T22:34:31.076 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:31.074+0000 7f5331ffb640 10 client.26294 handle_command_reply: tid=0 2024-09-10T22:34:31.076 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:31.074+0000 7f5353bf3740 1 client.26294 shutdown 2024-09-10T22:34:31.077 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:31.075+0000 7f5353bf3740 1 -- 172.21.15.19:0/1907616574 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b54936b860 msgr2=0x55b54937c690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:34:31.077 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:31.075+0000 7f5353bf3740 1 --2- 172.21.15.19:0/1907616574 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b54936b860 0x55b54937c690 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f533c00c6a0 tx=0x7f533c004990 comp rx=0 tx=0).stop 2024-09-10T22:34:31.077 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:31.075+0000 7f5353bf3740 1 -- 172.21.15.19:0/1907616574 shutdown_connections 2024-09-10T22:34:31.077 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:31.075+0000 7f5353bf3740 1 --2- 172.21.15.19:0/1907616574 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55b549370bd0 0x55b54937b8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:34:31.078 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:31.075+0000 7f5353bf3740 1 --2- 172.21.15.19:0/1907616574 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x55b5493ed400 0x55b5493ef7f0 crc :-1 s=READY pgs=167 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:34:31.078 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:31.075+0000 7f5353bf3740 1 --2- 172.21.15.19:0/1907616574 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55b54936e190 0x55b54937b390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:34:31.078 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:31.075+0000 7f5353bf3740 1 --2- 172.21.15.19:0/1907616574 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b54936b860 0x55b54937c690 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:34:31.078 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:31.075+0000 7f5331ffb640 0 client.26294 ms_handle_reset on v2:172.21.15.135:6838/1254769802 2024-09-10T22:34:31.078 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:31.075+0000 7f5353bf3740 1 -- 172.21.15.19:0/1907616574 >> 172.21.15.19:0/1907616574 conn(0x55b5493669b0 msgr2=0x55b54936ad50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:34:31.078 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:31.075+0000 7f5353bf3740 1 -- 172.21.15.19:0/1907616574 shutdown_connections 2024-09-10T22:34:31.078 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:31.075+0000 7f5353bf3740 1 -- 172.21.15.19:0/1907616574 wait complete. 2024-09-10T22:34:31.078 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:31.076+0000 7f5353bf3740 20 client.26294 trim_cache size 0 max 16384 2024-09-10T22:34:31.078 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stdout:{ 2024-09-10T22:34:31.079 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stdout: "message": "", 2024-09-10T22:34:31.079 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stdout: "return_code": 0 2024-09-10T22:34:31.079 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stdout:} 2024-09-10T22:34:31.079 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:31.077+0000 7f5350e2b640 1 -- 172.21.15.19:0/702839343 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f53380b52e0 msgr2=0x7f53380b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:34:31.080 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:31.077+0000 7f5350e2b640 1 --2- 172.21.15.19:0/702839343 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f53380b52e0 0x7f53380b77a0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f5334009bd0 tx=0x7f5334005f90 comp rx=0 tx=0).stop 2024-09-10T22:34:31.080 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:31.077+0000 7f5350e2b640 1 -- 172.21.15.19:0/702839343 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f534c101870 msgr2=0x7f534c06b900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:34:31.080 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:31.077+0000 7f5350e2b640 1 --2- 172.21.15.19:0/702839343 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f534c101870 0x7f534c06b900 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f533c00e9f0 tx=0x7f533c00edf0 comp rx=0 tx=0).stop 2024-09-10T22:34:31.080 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:31.077+0000 7f5350e2b640 1 -- 172.21.15.19:0/702839343 shutdown_connections 2024-09-10T22:34:31.080 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:31.077+0000 7f5350e2b640 1 --2- 172.21.15.19:0/702839343 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f53380b52e0 0x7f53380b77a0 secure :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f5334009bd0 tx=0x7f5334005f90 comp rx=0 tx=0).stop 2024-09-10T22:34:31.080 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:31.077+0000 7f5350e2b640 1 --2- 172.21.15.19:0/702839343 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f534c103380 0x7f534c1a23f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:34:31.080 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:31.077+0000 7f5350e2b640 1 --2- 172.21.15.19:0/702839343 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f534c1029c0 0x7f534c19fea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:34:31.080 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:31.077+0000 7f5350e2b640 1 --2- 172.21.15.19:0/702839343 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f534c101870 0x7f534c06b900 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:34:31.080 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:31.077+0000 7f5350e2b640 1 -- 172.21.15.19:0/702839343 >> 172.21.15.19:0/702839343 conn(0x7f534c0fd130 msgr2=0x7f534c105d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:34:31.080 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:31.077+0000 7f5350e2b640 1 -- 172.21.15.19:0/702839343 shutdown_connections 2024-09-10T22:34:31.080 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:31.077+0000 7f5350e2b640 1 -- 172.21.15.19:0/702839343 wait complete. 2024-09-10T22:34:32.110 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:34:31 smithi135 ceph-mon[34789]: pgmap v590: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 662 KiB/s rd, 260 MiB/s wr, 807 op/s 2024-09-10T22:34:32.125 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:34:31 smithi138 ceph-mon[35236]: pgmap v590: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 662 KiB/s rd, 260 MiB/s wr, 807 op/s 2024-09-10T22:34:32.208 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:34:31 smithi019 ceph-mon[31375]: pgmap v590: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 662 KiB/s rd, 260 MiB/s wr, 807 op/s 2024-09-10T22:34:34.128 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:34:33 smithi135 ceph-mon[34789]: pgmap v591: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 441 KiB/s rd, 221 MiB/s wr, 667 op/s 2024-09-10T22:34:34.545 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:34:33 smithi019 ceph-mon[31375]: pgmap v591: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 441 KiB/s rd, 221 MiB/s wr, 667 op/s 2024-09-10T22:34:34.545 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:34:33 smithi138 ceph-mon[35236]: pgmap v591: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 441 KiB/s rd, 221 MiB/s wr, 667 op/s 2024-09-10T22:34:36.110 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:34:35 smithi135 ceph-mon[34789]: pgmap v592: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 783 KiB/s rd, 225 MiB/s wr, 657 op/s 2024-09-10T22:34:36.125 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:34:35 smithi138 ceph-mon[35236]: pgmap v592: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 783 KiB/s rd, 225 MiB/s wr, 657 op/s 2024-09-10T22:34:36.208 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:34:35 smithi019 ceph-mon[31375]: pgmap v592: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 783 KiB/s rd, 225 MiB/s wr, 657 op/s 2024-09-10T22:34:38.113 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:34:37 smithi135 ceph-mon[34789]: pgmap v593: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 784 KiB/s rd, 258 MiB/s wr, 709 op/s 2024-09-10T22:34:38.125 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:34:37 smithi138 ceph-mon[35236]: pgmap v593: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 784 KiB/s rd, 258 MiB/s wr, 709 op/s 2024-09-10T22:34:38.208 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:34:37 smithi019 ceph-mon[31375]: pgmap v593: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 784 KiB/s rd, 258 MiB/s wr, 709 op/s 2024-09-10T22:34:40.208 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:34:39 smithi019 ceph-mon[31375]: pgmap v594: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 685 KiB/s rd, 219 MiB/s wr, 652 op/s 2024-09-10T22:34:40.360 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:34:39 smithi135 ceph-mon[34789]: pgmap v594: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 685 KiB/s rd, 219 MiB/s wr, 652 op/s 2024-09-10T22:34:40.375 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:34:39 smithi138 ceph-mon[35236]: pgmap v594: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 685 KiB/s rd, 219 MiB/s wr, 652 op/s 2024-09-10T22:34:42.360 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:34:41 smithi135 ceph-mon[34789]: pgmap v595: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 553 KiB/s rd, 272 MiB/s wr, 955 op/s 2024-09-10T22:34:42.375 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:34:41 smithi138 ceph-mon[35236]: pgmap v595: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 553 KiB/s rd, 272 MiB/s wr, 955 op/s 2024-09-10T22:34:42.458 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:34:41 smithi019 ceph-mon[31375]: pgmap v595: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 553 KiB/s rd, 272 MiB/s wr, 955 op/s 2024-09-10T22:34:42.980 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 22997a4c-6fc2-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-10T22:34:43.302 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/22997a4c-6fc2-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T22:34:43.360 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:34:42 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T22:34:43.375 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:34:42 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T22:34:43.428 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:34:42 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T22:34:44.057 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:44.053+0000 7fc1583aa640 1 -- 172.21.15.19:0/3312767532 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc1501076a0 msgr2=0x7fc150107ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:34:44.057 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:44.053+0000 7fc1583aa640 1 --2- 172.21.15.19:0/3312767532 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc1501076a0 0x7fc150107ae0 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7fc140009900 tx=0x7fc14002a410 comp rx=0 tx=0).stop 2024-09-10T22:34:44.057 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:44.053+0000 7fc1583aa640 1 -- 172.21.15.19:0/3312767532 shutdown_connections 2024-09-10T22:34:44.057 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:44.053+0000 7fc1583aa640 1 --2- 172.21.15.19:0/3312767532 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc150108020 0x7fc15010e820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:34:44.057 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:44.053+0000 7fc1583aa640 1 --2- 172.21.15.19:0/3312767532 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc1501076a0 0x7fc150107ae0 unknown :-1 s=CLOSED pgs=736 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:34:44.057 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:44.053+0000 7fc1583aa640 1 --2- 172.21.15.19:0/3312767532 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc150101c90 0x7fc150102070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:34:44.058 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:44.053+0000 7fc1583aa640 1 -- 172.21.15.19:0/3312767532 >> 172.21.15.19:0/3312767532 conn(0x7fc1500fd700 msgr2=0x7fc1500ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:34:44.058 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:44.053+0000 7fc1583aa640 1 -- 172.21.15.19:0/3312767532 shutdown_connections 2024-09-10T22:34:44.058 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:44.053+0000 7fc1583aa640 1 -- 172.21.15.19:0/3312767532 wait complete. 2024-09-10T22:34:44.058 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:44.054+0000 7fc1583aa640 1 Processor -- start 2024-09-10T22:34:44.058 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:44.054+0000 7fc1583aa640 1 -- start start 2024-09-10T22:34:44.058 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:44.054+0000 7fc1583aa640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc150101c90 0x7fc1501992b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:34:44.058 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:44.054+0000 7fc1583aa640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc1501076a0 0x7fc1501997f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:34:44.058 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:44.054+0000 7fc1583aa640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc150108020 0x7fc15019eb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:34:44.058 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:44.054+0000 7fc1583aa640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fc150111d30 con 0x7fc150101c90 2024-09-10T22:34:44.058 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:44.054+0000 7fc1583aa640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fc150111bb0 con 0x7fc1501076a0 2024-09-10T22:34:44.058 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:44.054+0000 7fc1583aa640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7fc150111eb0 con 0x7fc150108020 2024-09-10T22:34:44.058 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:44.054+0000 7fc156146640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc150101c90 0x7fc1501992b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:34:44.059 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:44.054+0000 7fc156146640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc150101c90 0x7fc1501992b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:49452/0 (socket says 172.21.15.19:49452) 2024-09-10T22:34:44.059 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:44.054+0000 7fc156146640 1 -- 172.21.15.19:0/1708603567 learned_addr learned my addr 172.21.15.19:0/1708603567 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:34:44.059 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:44.054+0000 7fc156947640 1 --2- 172.21.15.19:0/1708603567 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc150108020 0x7fc15019eb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:34:44.059 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:44.054+0000 7fc155945640 1 --2- 172.21.15.19:0/1708603567 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc1501076a0 0x7fc1501997f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:34:44.059 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:44.055+0000 7fc156146640 1 -- 172.21.15.19:0/1708603567 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc150108020 msgr2=0x7fc15019eb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:34:44.059 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:44.055+0000 7fc156146640 1 --2- 172.21.15.19:0/1708603567 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc150108020 0x7fc15019eb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:34:44.059 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:44.055+0000 7fc156146640 1 -- 172.21.15.19:0/1708603567 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc1501076a0 msgr2=0x7fc1501997f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:34:44.059 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:44.055+0000 7fc156146640 1 --2- 172.21.15.19:0/1708603567 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc1501076a0 0x7fc1501997f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:34:44.059 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:44.055+0000 7fc156146640 1 -- 172.21.15.19:0/1708603567 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc15019f360 con 0x7fc150101c90 2024-09-10T22:34:44.059 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:44.055+0000 7fc155945640 1 --2- 172.21.15.19:0/1708603567 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc1501076a0 0x7fc1501997f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T22:34:44.059 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:44.055+0000 7fc156146640 1 --2- 172.21.15.19:0/1708603567 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc150101c90 0x7fc1501992b0 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7fc14c00d950 tx=0x7fc14c00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:34:44.059 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:44.055+0000 7fc1477fe640 1 -- 172.21.15.19:0/1708603567 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc14c017030 con 0x7fc150101c90 2024-09-10T22:34:44.059 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:44.055+0000 7fc1583aa640 1 -- 172.21.15.19:0/1708603567 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc15019f650 con 0x7fc150101c90 2024-09-10T22:34:44.060 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:44.055+0000 7fc1477fe640 1 -- 172.21.15.19:0/1708603567 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc14c004020 con 0x7fc150101c90 2024-09-10T22:34:44.060 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:44.055+0000 7fc1477fe640 1 -- 172.21.15.19:0/1708603567 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc14c0047a0 con 0x7fc150101c90 2024-09-10T22:34:44.060 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:44.055+0000 7fc1583aa640 1 -- 172.21.15.19:0/1708603567 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc1501a5d10 con 0x7fc150101c90 2024-09-10T22:34:44.062 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:44.058+0000 7fc15a77f740 1 Processor -- start 2024-09-10T22:34:44.062 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:44.058+0000 7fc15a77f740 1 -- start start 2024-09-10T22:34:44.062 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:44.058+0000 7fc1477fe640 1 -- 172.21.15.19:0/1708603567 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 18) ==== 153250+0+0 (secure 0 0 0) 0x7fc14c009a30 con 0x7fc150101c90 2024-09-10T22:34:44.062 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:44.058+0000 7fc15a77f740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d8542d9480 0x55d8542d9860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:34:44.063 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:44.058+0000 7fc15a77f740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d8542d9da0 0x55d8542e57f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:34:44.063 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:44.059+0000 7fc15a77f740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55d8542e5d30 0x55d8542e8120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:34:44.063 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:44.059+0000 7fc15a77f740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x55d85424fe50 con 0x55d8542d9480 2024-09-10T22:34:44.063 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:44.059+0000 7fc15a77f740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55d85423f280 con 0x55d8542d9da0 2024-09-10T22:34:44.063 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:44.059+0000 7fc15a77f740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x55d854243090 con 0x55d8542e5d30 2024-09-10T22:34:44.063 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:44.059+0000 7fc156947640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d8542d9480 0x55d8542d9860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:34:44.063 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:44.059+0000 7fc156947640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d8542d9480 0x55d8542d9860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:49462/0 (socket says 172.21.15.19:49462) 2024-09-10T22:34:44.063 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:44.059+0000 7fc156947640 1 -- 172.21.15.19:0/4080747388 learned_addr learned my addr 172.21.15.19:0/4080747388 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:34:44.063 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:44.059+0000 7fc155945640 1 --2- 172.21.15.19:0/4080747388 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55d8542e5d30 0x55d8542e8120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:34:44.063 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:44.059+0000 7fc156947640 1 -- 172.21.15.19:0/4080747388 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55d8542e5d30 msgr2=0x55d8542e8120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:34:44.063 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:44.059+0000 7fc156947640 1 --2- 172.21.15.19:0/4080747388 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55d8542e5d30 0x55d8542e8120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:34:44.063 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:44.059+0000 7fc156947640 1 -- 172.21.15.19:0/4080747388 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d8542d9da0 msgr2=0x55d8542e57f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:34:44.064 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:44.059+0000 7fc156947640 1 --2- 172.21.15.19:0/4080747388 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d8542d9da0 0x55d8542e57f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:34:44.064 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:44.059+0000 7fc156947640 1 -- 172.21.15.19:0/4080747388 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d853f9d650 con 0x55d8542d9480 2024-09-10T22:34:44.064 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:44.059+0000 7fc155945640 1 --2- 172.21.15.19:0/4080747388 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55d8542e5d30 0x55d8542e8120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T22:34:44.064 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:44.059+0000 7fc156947640 1 --2- 172.21.15.19:0/4080747388 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d8542d9480 0x55d8542d9860 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7fc148009f70 tx=0x7fc148010800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9485ddbc6f2bf1e1 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:34:44.064 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:44.060+0000 7fc1477fe640 1 --2- 172.21.15.19:0/1708603567 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7fc13c0b52e0 0x7fc13c0b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:34:44.064 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:44.060+0000 7fc144de6640 1 -- 172.21.15.19:0/4080747388 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc148016070 con 0x55d8542d9480 2024-09-10T22:34:44.064 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:44.060+0000 7fc156146640 1 --2- 172.21.15.19:0/1708603567 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7fc13c0b52e0 0x7fc13c0b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:34:44.064 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:44.060+0000 7fc144de6640 1 -- 172.21.15.19:0/4080747388 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc148004d20 con 0x55d8542d9480 2024-09-10T22:34:44.064 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:44.060+0000 7fc144de6640 1 -- 172.21.15.19:0/4080747388 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc148012790 con 0x55d8542d9480 2024-09-10T22:34:44.064 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:44.060+0000 7fc1477fe640 1 -- 172.21.15.19:0/1708603567 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8327+0+0 (secure 0 0 0) 0x7fc14c0e5710 con 0x7fc150101c90 2024-09-10T22:34:44.064 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:44.061+0000 7fc15a77f740 1 -- 172.21.15.19:0/4080747388 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d8542d9480 msgr2=0x55d8542d9860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:34:44.064 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:44.061+0000 7fc156146640 1 --2- 172.21.15.19:0/1708603567 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7fc13c0b52e0 0x7fc13c0b77a0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7fc14c0a90e0 tx=0x7fc14c0dc2e0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:34:44.065 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:44.061+0000 7fc15a77f740 1 --2- 172.21.15.19:0/4080747388 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d8542d9480 0x55d8542d9860 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7fc148009f70 tx=0x7fc148010800 comp rx=0 tx=0).stop 2024-09-10T22:34:44.065 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:44.061+0000 7fc15a77f740 1 -- 172.21.15.19:0/4080747388 shutdown_connections 2024-09-10T22:34:44.065 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:44.061+0000 7fc15a77f740 1 --2- 172.21.15.19:0/4080747388 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55d8542e5d30 0x55d8542e8120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:34:44.065 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:44.061+0000 7fc15a77f740 1 --2- 172.21.15.19:0/4080747388 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d8542d9da0 0x55d8542e57f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:34:44.065 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:44.061+0000 7fc15a77f740 1 --2- 172.21.15.19:0/4080747388 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d8542d9480 0x55d8542d9860 unknown :-1 s=CLOSED pgs=738 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:34:44.065 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:44.061+0000 7fc15a77f740 1 -- 172.21.15.19:0/4080747388 >> 172.21.15.19:0/4080747388 conn(0x55d8542d72b0 msgr2=0x55d8542d8450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:34:44.065 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:44.061+0000 7fc15a77f740 1 -- 172.21.15.19:0/4080747388 shutdown_connections 2024-09-10T22:34:44.065 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:44.061+0000 7fc15a77f740 1 -- 172.21.15.19:0/4080747388 wait complete. 2024-09-10T22:34:44.067 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:44.061+0000 7fc15a77f740 1 -- start start 2024-09-10T22:34:44.067 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:44.061+0000 7fc15a77f740 1 Processor -- start 2024-09-10T22:34:44.067 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:44.062+0000 7fc15a77f740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d8542d9480 0x55d8542e55f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:34:44.067 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:44.062+0000 7fc15a77f740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55d8542d9da0 0x55d8542e2a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:34:44.067 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:44.062+0000 7fc15a77f740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d8542e5d30 0x55d8542e3020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:34:44.067 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:44.062+0000 7fc15a77f740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x55d8540a0700 con 0x55d8542d9480 2024-09-10T22:34:44.067 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:44.062+0000 7fc15a77f740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55d8541da110 con 0x55d8542e5d30 2024-09-10T22:34:44.067 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:44.062+0000 7fc15a77f740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x55d8542e89b0 con 0x55d8542d9da0 2024-09-10T22:34:44.067 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:44.062+0000 7fc15a77f740 10 client.0 _ll_register_callbacks cb 0x55d8541f3990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T22:34:44.067 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:44.062+0000 7fc155945640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55d8542d9da0 0x55d8542e2a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:34:44.067 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:44.062+0000 7fc155945640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55d8542d9da0 0x55d8542e2a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.19:58040/0 (socket says 172.21.15.19:58040) 2024-09-10T22:34:44.067 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:44.062+0000 7fc155945640 1 -- 172.21.15.19:0/1373239133 learned_addr learned my addr 172.21.15.19:0/1373239133 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:34:44.068 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:44.062+0000 7fc156947640 1 --2- 172.21.15.19:0/1373239133 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d8542d9480 0x55d8542e55f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:34:44.068 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:44.062+0000 7fc155945640 1 -- 172.21.15.19:0/1373239133 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d8542e5d30 msgr2=0x55d8542e3020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:34:44.068 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:44.062+0000 7fc155945640 1 --2- 172.21.15.19:0/1373239133 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d8542e5d30 0x55d8542e3020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:34:44.068 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:44.062+0000 7fc155945640 1 -- 172.21.15.19:0/1373239133 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d8542d9480 msgr2=0x55d8542e55f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:34:44.068 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:44.062+0000 7fc155945640 1 --2- 172.21.15.19:0/1373239133 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d8542d9480 0x55d8542e55f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:34:44.068 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:44.062+0000 7fc155945640 1 -- 172.21.15.19:0/1373239133 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d854207c40 con 0x55d8542d9da0 2024-09-10T22:34:44.068 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:44.062+0000 7fc156947640 1 --2- 172.21.15.19:0/1373239133 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d8542d9480 0x55d8542e55f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T22:34:44.068 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:44.063+0000 7fc155945640 1 --2- 172.21.15.19:0/1373239133 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55d8542d9da0 0x55d8542e2a40 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fc140009230 tx=0x7fc1400052d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ab642ec84ee89ace server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:34:44.068 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:44.063+0000 7fc139ffb640 10 client.0 ms_handle_connect on v2:172.21.15.138:3300/0 2024-09-10T22:34:44.137 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:44.135+0000 7fc139ffb640 1 -- 172.21.15.19:0/1373239133 <== mon.1 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc140035030 con 0x55d8542d9da0 2024-09-10T22:34:44.138 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:44.135+0000 7fc139ffb640 1 -- 172.21.15.19:0/1373239133 <== mon.1 v2:172.21.15.138:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8327+0+0 (secure 0 0 0) 0x7fc1400048c0 con 0x55d8542d9da0 2024-09-10T22:34:44.138 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:44.135+0000 7fc15a77f740 1 -- 172.21.15.19:0/1373239133 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc148004d20 con 0x55d8542d9da0 2024-09-10T22:34:44.138 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:44.135+0000 7fc139ffb640 1 -- 172.21.15.19:0/1373239133 <== mon.1 v2:172.21.15.138:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fc140005d50 con 0x55d8542d9da0 2024-09-10T22:34:44.138 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:44.135+0000 7fc15a77f740 10 client.26332 fetch_fsmap learned FSMap version 27 2024-09-10T22:34:44.138 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:44.135+0000 7fc15a77f740 1 -- 172.21.15.19:0/1373239133 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55d8542f4250 con 0x55d8542d9da0 2024-09-10T22:34:44.138 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:44.135+0000 7fc139ffb640 1 -- 172.21.15.19:0/1373239133 <== mon.1 v2:172.21.15.138:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc148004d20 con 0x55d8542d9da0 2024-09-10T22:34:44.138 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:44.136+0000 7fc139ffb640 1 -- 172.21.15.19:0/1373239133 <== mon.1 v2:172.21.15.138:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7fc14004c050 con 0x55d8542d9da0 2024-09-10T22:34:44.138 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:44.136+0000 7fc15a77f740 10 client.26332 fetch_fsmap finished waiting for FSMap version 27 2024-09-10T22:34:44.138 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:44.136+0000 7fc15a77f740 10 client.26332 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-10T22:34:44.138 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:44.136+0000 7fc15a77f740 20 client.26332 populate_metadata read hostname 'smithi019' 2024-09-10T22:34:44.138 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:44.136+0000 7fc15a77f740 1 --2- 172.21.15.19:0/1373239133 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x55d8542f56b0 0x55d8542f7b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:34:44.138 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:44.136+0000 7fc15a77f740 4 client.26332 mds_command: new command op to 24581 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T22:34:44.139 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:44.136+0000 7fc15a77f740 1 -- 172.21.15.19:0/1373239133 --> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d854251da0 con 0x55d8542f56b0 2024-09-10T22:34:44.139 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:44.136+0000 7fc156947640 1 --2- 172.21.15.19:0/1373239133 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x55d8542f56b0 0x55d8542f7b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:34:44.140 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:44.136+0000 7fc139ffb640 10 client.26332 ms_handle_connect on v2:172.21.15.135:6838/1254769802 2024-09-10T22:34:44.140 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:44.136+0000 7fc156947640 1 --2- 172.21.15.19:0/1373239133 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x55d8542f56b0 0x55d8542f7b30 crc :-1 s=READY pgs=168 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9a6ffa9ff1a0bc35 server_cookie=7e4743f3f8614a4e in_seq=0 out_seq=0 2024-09-10T22:34:44.140 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:44.137+0000 7fc139ffb640 1 -- 172.21.15.19:0/1373239133 <== mds.0 v2:172.21.15.135:6838/1254769802 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55d854251da0 con 0x55d8542f56b0 2024-09-10T22:34:44.140 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:44.137+0000 7fc139ffb640 10 client.26332 handle_command_reply: tid=0 2024-09-10T22:34:44.140 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:44.137+0000 7fc15a77f740 1 client.26332 shutdown 2024-09-10T22:34:44.140 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:44.137+0000 7fc15a77f740 1 -- 172.21.15.19:0/1373239133 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55d8542d9da0 msgr2=0x55d8542e2a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:34:44.140 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:44.137+0000 7fc15a77f740 1 --2- 172.21.15.19:0/1373239133 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55d8542d9da0 0x55d8542e2a40 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fc140009230 tx=0x7fc1400052d0 comp rx=0 tx=0).stop 2024-09-10T22:34:44.140 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:44.137+0000 7fc15a77f740 1 -- 172.21.15.19:0/1373239133 shutdown_connections 2024-09-10T22:34:44.140 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:44.137+0000 7fc15a77f740 1 --2- 172.21.15.19:0/1373239133 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d8542e5d30 0x55d8542e3020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:34:44.140 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:44.137+0000 7fc15a77f740 1 --2- 172.21.15.19:0/1373239133 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x55d8542f56b0 0x55d8542f7b30 crc :-1 s=READY pgs=168 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:34:44.140 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:44.137+0000 7fc15a77f740 1 --2- 172.21.15.19:0/1373239133 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55d8542d9da0 0x55d8542e2a40 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:34:44.141 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:44.137+0000 7fc139ffb640 0 client.26332 ms_handle_reset on v2:172.21.15.135:6838/1254769802 2024-09-10T22:34:44.141 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:44.137+0000 7fc15a77f740 1 --2- 172.21.15.19:0/1373239133 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d8542d9480 0x55d8542e55f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:34:44.141 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:44.137+0000 7fc15a77f740 1 -- 172.21.15.19:0/1373239133 >> 172.21.15.19:0/1373239133 conn(0x55d8542d72b0 msgr2=0x55d8542dce20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:34:44.141 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:44.137+0000 7fc15a77f740 1 -- 172.21.15.19:0/1373239133 shutdown_connections 2024-09-10T22:34:44.141 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:44.138+0000 7fc15a77f740 1 -- 172.21.15.19:0/1373239133 wait complete. 2024-09-10T22:34:44.141 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:44.138+0000 7fc15a77f740 20 client.26332 trim_cache size 0 max 16384 2024-09-10T22:34:44.178 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:44.176+0000 7fc15a77f740 1 Processor -- start 2024-09-10T22:34:44.178 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:44.176+0000 7fc15a77f740 1 -- start start 2024-09-10T22:34:44.178 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:44.176+0000 7fc15a77f740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d8542d9480 0x55d8542d8a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:34:44.179 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:44.176+0000 7fc15a77f740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55d8542d9da0 0x55d8542d6bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:34:44.179 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:44.176+0000 7fc15a77f740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d8542e5d30 0x55d8542e7120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:34:44.179 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:44.176+0000 7fc15a77f740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fc1501b0e90 con 0x55d8542e5d30 2024-09-10T22:34:44.179 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:44.176+0000 7fc15a77f740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fc1501ae760 con 0x55d8542d9480 2024-09-10T22:34:44.179 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:44.176+0000 7fc15a77f740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7fc1501ac5b0 con 0x55d8542d9da0 2024-09-10T22:34:44.179 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:44.176+0000 7fc156947640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d8542e5d30 0x55d8542e7120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:34:44.179 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:44.176+0000 7fc156947640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d8542e5d30 0x55d8542e7120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:49482/0 (socket says 172.21.15.19:49482) 2024-09-10T22:34:44.179 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:44.176+0000 7fc156947640 1 -- 172.21.15.19:0/2212085212 learned_addr learned my addr 172.21.15.19:0/2212085212 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:34:44.179 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:44.177+0000 7fc156947640 1 --2- 172.21.15.19:0/2212085212 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d8542d9480 0x55d8542d8a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:34:44.179 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:44.177+0000 7fc155945640 1 --2- 172.21.15.19:0/2212085212 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55d8542d9da0 0x55d8542d6bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:34:44.179 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:44.177+0000 7fc156947640 1 -- 172.21.15.19:0/2212085212 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55d8542d9da0 msgr2=0x55d8542d6bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:34:44.179 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:44.177+0000 7fc156947640 1 --2- 172.21.15.19:0/2212085212 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55d8542d9da0 0x55d8542d6bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:34:44.180 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:44.177+0000 7fc156947640 1 -- 172.21.15.19:0/2212085212 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d8542d9480 msgr2=0x55d8542d8a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:34:44.180 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:44.177+0000 7fc156947640 1 --2- 172.21.15.19:0/2212085212 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d8542d9480 0x55d8542d8a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:34:44.180 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:44.177+0000 7fc156947640 1 -- 172.21.15.19:0/2212085212 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d8542e0f40 con 0x55d8542e5d30 2024-09-10T22:34:44.184 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:44.177+0000 7fc156947640 1 --2- 172.21.15.19:0/2212085212 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d8542e5d30 0x55d8542e7120 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7fc148006010 tx=0x7fc148012450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4015066048584014 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:34:44.184 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:44.177+0000 7fc13bfff640 1 -- 172.21.15.19:0/2212085212 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc148016030 con 0x55d8542e5d30 2024-09-10T22:34:44.184 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:44.177+0000 7fc13bfff640 1 -- 172.21.15.19:0/2212085212 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc148005730 con 0x55d8542e5d30 2024-09-10T22:34:44.184 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:44.177+0000 7fc13bfff640 1 -- 172.21.15.19:0/2212085212 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc148012d90 con 0x55d8542e5d30 2024-09-10T22:34:44.184 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:44.178+0000 7fc15a77f740 1 -- 172.21.15.19:0/2212085212 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d8542e5d30 msgr2=0x55d8542e7120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:34:44.184 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:44.178+0000 7fc15a77f740 1 --2- 172.21.15.19:0/2212085212 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d8542e5d30 0x55d8542e7120 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7fc148006010 tx=0x7fc148012450 comp rx=0 tx=0).stop 2024-09-10T22:34:44.184 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:44.178+0000 7fc15a77f740 1 -- 172.21.15.19:0/2212085212 shutdown_connections 2024-09-10T22:34:44.184 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:44.178+0000 7fc15a77f740 1 --2- 172.21.15.19:0/2212085212 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d8542e5d30 0x55d8542e7120 unknown :-1 s=CLOSED pgs=739 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:34:44.184 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:44.178+0000 7fc15a77f740 1 --2- 172.21.15.19:0/2212085212 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55d8542d9da0 0x55d8542d6bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:34:44.185 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:44.178+0000 7fc15a77f740 1 --2- 172.21.15.19:0/2212085212 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d8542d9480 0x55d8542d8a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:34:44.185 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:44.178+0000 7fc15a77f740 1 -- 172.21.15.19:0/2212085212 >> 172.21.15.19:0/2212085212 conn(0x55d8542d72b0 msgr2=0x55d8542d8370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:34:44.185 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:44.178+0000 7fc15a77f740 1 -- 172.21.15.19:0/2212085212 shutdown_connections 2024-09-10T22:34:44.185 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:44.178+0000 7fc15a77f740 1 -- 172.21.15.19:0/2212085212 wait complete. 2024-09-10T22:34:44.185 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:44.178+0000 7fc15a77f740 1 -- start start 2024-09-10T22:34:44.185 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:44.179+0000 7fc15a77f740 1 Processor -- start 2024-09-10T22:34:44.185 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:44.179+0000 7fc15a77f740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55d8542d9480 0x55d8542ee200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:34:44.185 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:44.179+0000 7fc15a77f740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d8542d9da0 0x55d8542e8c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:34:44.185 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:44.179+0000 7fc15a77f740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d8542e5d30 0x55d8542e9170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:34:44.185 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:44.179+0000 7fc15a77f740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fc1501acc20 con 0x55d8542d9da0 2024-09-10T22:34:44.186 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:44.179+0000 7fc15a77f740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fc1501ae090 con 0x55d8542e5d30 2024-09-10T22:34:44.186 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:44.179+0000 7fc15a77f740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7fc1501ad2f0 con 0x55d8542d9480 2024-09-10T22:34:44.186 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:44.179+0000 7fc15a77f740 10 client.0 _ll_register_callbacks cb 0x7fc140009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T22:34:44.186 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:44.179+0000 7fc156947640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55d8542d9480 0x55d8542ee200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:34:44.186 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:44.179+0000 7fc156947640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d8542e5d30 0x55d8542e9170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:34:44.186 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:44.179+0000 7fc156947640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55d8542d9480 0x55d8542ee200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.19:58054/0 (socket says 172.21.15.19:58054) 2024-09-10T22:34:44.186 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:44.179+0000 7fc156947640 1 -- 172.21.15.19:0/1627049300 learned_addr learned my addr 172.21.15.19:0/1627049300 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:34:44.186 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:44.180+0000 7fc155945640 1 --2- 172.21.15.19:0/1627049300 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d8542d9da0 0x55d8542e8c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:34:44.186 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:44.180+0000 7fc156947640 1 -- 172.21.15.19:0/1627049300 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d8542e5d30 msgr2=0x55d8542e9170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:34:44.186 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:44.180+0000 7fc156947640 1 --2- 172.21.15.19:0/1627049300 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d8542e5d30 0x55d8542e9170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:34:44.187 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:44.180+0000 7fc156947640 1 -- 172.21.15.19:0/1627049300 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d8542d9da0 msgr2=0x55d8542e8c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:34:44.187 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:44.180+0000 7fc156947640 1 --2- 172.21.15.19:0/1627049300 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d8542d9da0 0x55d8542e8c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:34:44.187 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:44.180+0000 7fc156947640 1 -- 172.21.15.19:0/1627049300 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d8542e9780 con 0x55d8542d9480 2024-09-10T22:34:44.187 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:44.180+0000 7fc155945640 1 --2- 172.21.15.19:0/1627049300 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d8542d9da0 0x55d8542e8c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T22:34:44.187 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:44.180+0000 7fc156947640 1 --2- 172.21.15.19:0/1627049300 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55d8542d9480 0x55d8542ee200 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fc148009a80 tx=0x7fc148000f40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e0cc636a11f7b35d server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:34:44.187 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:44.180+0000 7fc139ffb640 10 client.0 ms_handle_connect on v2:172.21.15.138:3300/0 2024-09-10T22:34:44.187 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:44.180+0000 7fc139ffb640 1 -- 172.21.15.19:0/1627049300 <== mon.1 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc148016070 con 0x55d8542d9480 2024-09-10T22:34:44.187 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:44.180+0000 7fc139ffb640 1 -- 172.21.15.19:0/1627049300 <== mon.1 v2:172.21.15.138:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8327+0+0 (secure 0 0 0) 0x7fc148012b10 con 0x55d8542d9480 2024-09-10T22:34:44.187 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:44.180+0000 7fc15a77f740 1 -- 172.21.15.19:0/1627049300 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc148005730 con 0x55d8542d9480 2024-09-10T22:34:44.187 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:44.180+0000 7fc139ffb640 1 -- 172.21.15.19:0/1627049300 <== mon.1 v2:172.21.15.138:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fc148005080 con 0x55d8542d9480 2024-09-10T22:34:44.187 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:44.180+0000 7fc15a77f740 10 client.26338 fetch_fsmap learned FSMap version 27 2024-09-10T22:34:44.187 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:44.180+0000 7fc15a77f740 1 -- 172.21.15.19:0/1627049300 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55d854363460 con 0x55d8542d9480 2024-09-10T22:34:44.187 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:44.181+0000 7fc139ffb640 1 -- 172.21.15.19:0/1627049300 <== mon.1 v2:172.21.15.138:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc148005730 con 0x55d8542d9480 2024-09-10T22:34:44.188 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:44.181+0000 7fc139ffb640 1 -- 172.21.15.19:0/1627049300 <== mon.1 v2:172.21.15.138:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7fc14802e040 con 0x55d8542d9480 2024-09-10T22:34:44.188 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:44.181+0000 7fc15a77f740 10 client.26338 fetch_fsmap finished waiting for FSMap version 27 2024-09-10T22:34:44.188 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:44.181+0000 7fc15a77f740 10 client.26338 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-10T22:34:44.188 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:44.181+0000 7fc15a77f740 20 client.26338 populate_metadata read hostname 'smithi019' 2024-09-10T22:34:44.188 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:44.181+0000 7fc15a77f740 1 --2- 172.21.15.19:0/1627049300 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x55d8543639a0 0x55d854365dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:34:44.188 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:44.181+0000 7fc15a77f740 4 client.26338 mds_command: new command op to 24581 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-10T22:34:44.188 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:44.181+0000 7fc15a77f740 1 -- 172.21.15.19:0/1627049300 --> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55d85424d850 con 0x55d8543639a0 2024-09-10T22:34:44.188 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:44.181+0000 7fc155945640 1 --2- 172.21.15.19:0/1627049300 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x55d8543639a0 0x55d854365dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:34:44.188 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:44.182+0000 7fc139ffb640 10 client.26338 ms_handle_connect on v2:172.21.15.135:6838/1254769802 2024-09-10T22:34:44.188 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:44.182+0000 7fc155945640 1 --2- 172.21.15.19:0/1627049300 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x55d8543639a0 0x55d854365dc0 crc :-1 s=READY pgs=169 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c46d5f3b3f5c1207 server_cookie=50b261529b5eb2b8 in_seq=0 out_seq=0 2024-09-10T22:34:44.188 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:44.182+0000 7fc139ffb640 1 -- 172.21.15.19:0/1627049300 <== mds.0 v2:172.21.15.135:6838/1254769802 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3214 (crc 0 0 0) 0x55d85424d850 con 0x55d8543639a0 2024-09-10T22:34:44.188 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:44.182+0000 7fc139ffb640 10 client.26338 handle_command_reply: tid=0 2024-09-10T22:34:44.188 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:44.182+0000 7fc15a77f740 1 client.26338 shutdown 2024-09-10T22:34:44.189 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:44.182+0000 7fc15a77f740 1 -- 172.21.15.19:0/1627049300 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55d8542d9480 msgr2=0x55d8542ee200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:34:44.189 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:44.182+0000 7fc15a77f740 1 --2- 172.21.15.19:0/1627049300 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55d8542d9480 0x55d8542ee200 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fc148009a80 tx=0x7fc148000f40 comp rx=0 tx=0).stop 2024-09-10T22:34:44.189 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:44.182+0000 7fc15a77f740 1 -- 172.21.15.19:0/1627049300 shutdown_connections 2024-09-10T22:34:44.189 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:44.182+0000 7fc15a77f740 1 --2- 172.21.15.19:0/1627049300 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d8542e5d30 0x55d8542e9170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:34:44.189 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:44.182+0000 7fc15a77f740 1 --2- 172.21.15.19:0/1627049300 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d8542d9da0 0x55d8542e8c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:34:44.189 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:44.182+0000 7fc15a77f740 1 --2- 172.21.15.19:0/1627049300 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x55d8543639a0 0x55d854365dc0 crc :-1 s=READY pgs=169 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:34:44.189 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:44.182+0000 7fc139ffb640 0 client.26338 ms_handle_reset on v2:172.21.15.135:6838/1254769802 2024-09-10T22:34:44.189 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:44.182+0000 7fc15a77f740 1 --2- 172.21.15.19:0/1627049300 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55d8542d9480 0x55d8542ee200 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:34:44.189 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:44.182+0000 7fc15a77f740 1 -- 172.21.15.19:0/1627049300 >> 172.21.15.19:0/1627049300 conn(0x55d8542d72b0 msgr2=0x55d8542e1190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:34:44.189 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:44.182+0000 7fc15a77f740 1 -- 172.21.15.19:0/1627049300 shutdown_connections 2024-09-10T22:34:44.189 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:44.182+0000 7fc15a77f740 1 -- 172.21.15.19:0/1627049300 wait complete. 2024-09-10T22:34:44.189 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:44.182+0000 7fc15a77f740 20 client.26338 trim_cache size 0 max 16384 2024-09-10T22:34:44.190 INFO:teuthology.orchestra.run.smithi019.stdout:{ 2024-09-10T22:34:44.190 INFO:teuthology.orchestra.run.smithi019.stdout: "status": "no active scrubs running", 2024-09-10T22:34:44.190 INFO:teuthology.orchestra.run.smithi019.stdout: "scrubs": {}, 2024-09-10T22:34:44.190 INFO:teuthology.orchestra.run.smithi019.stdout: "scrub_stats": { 2024-09-10T22:34:44.190 INFO:teuthology.orchestra.run.smithi019.stdout: "0b81ea61-0b8e-4f2c-a58f-ef1019289fc9": { 2024-09-10T22:34:44.190 INFO:teuthology.orchestra.run.smithi019.stdout: "start_time": "2024-09-10T22:31:48.141568+0000", 2024-09-10T22:34:44.190 INFO:teuthology.orchestra.run.smithi019.stdout: "path": "/", 2024-09-10T22:34:44.191 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_started": 0, 2024-09-10T22:34:44.191 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_passed": 0, 2024-09-10T22:34:44.191 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_failed": 0, 2024-09-10T22:34:44.191 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_skipped": 0 2024-09-10T22:34:44.191 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:34:44.191 INFO:teuthology.orchestra.run.smithi019.stdout: "715ec863-8a9d-45b6-967f-59b15ce1bf12": { 2024-09-10T22:34:44.191 INFO:teuthology.orchestra.run.smithi019.stdout: "start_time": "2024-09-10T22:31:00.669516+0000", 2024-09-10T22:34:44.191 INFO:teuthology.orchestra.run.smithi019.stdout: "path": "/", 2024-09-10T22:34:44.191 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_started": 0, 2024-09-10T22:34:44.191 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_passed": 0, 2024-09-10T22:34:44.191 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_failed": 0, 2024-09-10T22:34:44.191 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_skipped": 0 2024-09-10T22:34:44.191 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:34:44.191 INFO:teuthology.orchestra.run.smithi019.stdout: "fd1f1837-dcfa-4d88-99e8-2509f36c3f98": { 2024-09-10T22:34:44.192 INFO:teuthology.orchestra.run.smithi019.stdout: "start_time": "2024-09-10T22:30:12.470477+0000", 2024-09-10T22:34:44.192 INFO:teuthology.orchestra.run.smithi019.stdout: "path": "/", 2024-09-10T22:34:44.192 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_started": 0, 2024-09-10T22:34:44.192 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_passed": 0, 2024-09-10T22:34:44.192 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_failed": 0, 2024-09-10T22:34:44.192 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_skipped": 0 2024-09-10T22:34:44.192 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:34:44.192 INFO:teuthology.orchestra.run.smithi019.stdout: "8f3bb3bf-911f-490c-9856-c80ea220dbbe": { 2024-09-10T22:34:44.192 INFO:teuthology.orchestra.run.smithi019.stdout: "start_time": "2024-09-10T22:29:25.374415+0000", 2024-09-10T22:34:44.192 INFO:teuthology.orchestra.run.smithi019.stdout: "path": "/", 2024-09-10T22:34:44.192 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_started": 0, 2024-09-10T22:34:44.192 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_passed": 0, 2024-09-10T22:34:44.192 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_failed": 0, 2024-09-10T22:34:44.193 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_skipped": 0 2024-09-10T22:34:44.193 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:34:44.193 INFO:teuthology.orchestra.run.smithi019.stdout: "eb518e3c-a71e-4f32-9ca0-ae88930ca218": { 2024-09-10T22:34:44.193 INFO:teuthology.orchestra.run.smithi019.stdout: "start_time": "2024-09-10T22:28:38.366352+0000", 2024-09-10T22:34:44.193 INFO:teuthology.orchestra.run.smithi019.stdout: "path": "/", 2024-09-10T22:34:44.193 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_started": 0, 2024-09-10T22:34:44.193 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_passed": 0, 2024-09-10T22:34:44.193 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_failed": 0, 2024-09-10T22:34:44.193 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_skipped": 0 2024-09-10T22:34:44.193 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:34:44.193 INFO:teuthology.orchestra.run.smithi019.stdout: "9efe684b-7583-402e-a46e-e262a37e1af5": { 2024-09-10T22:34:44.193 INFO:teuthology.orchestra.run.smithi019.stdout: "start_time": "2024-09-10T22:34:09.479768+0000", 2024-09-10T22:34:44.193 INFO:teuthology.orchestra.run.smithi019.stdout: "path": "/", 2024-09-10T22:34:44.193 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_started": 0, 2024-09-10T22:34:44.194 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_passed": 0, 2024-09-10T22:34:44.194 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_failed": 0, 2024-09-10T22:34:44.194 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_skipped": 0 2024-09-10T22:34:44.194 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:34:44.194 INFO:teuthology.orchestra.run.smithi019.stdout: "4c99964e-2e0e-4ffd-8cb8-99c4979ed90f": { 2024-09-10T22:34:44.194 INFO:teuthology.orchestra.run.smithi019.stdout: "start_time": "2024-09-10T22:32:34.659639+0000", 2024-09-10T22:34:44.194 INFO:teuthology.orchestra.run.smithi019.stdout: "path": "/", 2024-09-10T22:34:44.194 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_started": 0, 2024-09-10T22:34:44.194 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_passed": 0, 2024-09-10T22:34:44.194 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_failed": 0, 2024-09-10T22:34:44.194 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_skipped": 0 2024-09-10T22:34:44.194 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:34:44.194 INFO:teuthology.orchestra.run.smithi019.stdout: "c12c2a04-dcd6-4673-a98e-93f665d3f5d7": { 2024-09-10T22:34:44.194 INFO:teuthology.orchestra.run.smithi019.stdout: "start_time": "2024-09-10T22:27:49.392329+0000", 2024-09-10T22:34:44.194 INFO:teuthology.orchestra.run.smithi019.stdout: "path": "/", 2024-09-10T22:34:44.195 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_started": 0, 2024-09-10T22:34:44.195 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_passed": 0, 2024-09-10T22:34:44.195 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_failed": 0, 2024-09-10T22:34:44.195 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_skipped": 0 2024-09-10T22:34:44.195 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:34:44.195 INFO:teuthology.orchestra.run.smithi019.stdout: "b38852c8-478a-42ef-8384-b2c55d5313a4": { 2024-09-10T22:34:44.195 INFO:teuthology.orchestra.run.smithi019.stdout: "start_time": "2024-09-10T22:27:00.320308+0000", 2024-09-10T22:34:44.195 INFO:teuthology.orchestra.run.smithi019.stdout: "path": "/", 2024-09-10T22:34:44.195 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_started": 0, 2024-09-10T22:34:44.195 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_passed": 0, 2024-09-10T22:34:44.195 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_failed": 0, 2024-09-10T22:34:44.195 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_skipped": 0 2024-09-10T22:34:44.195 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:34:44.196 INFO:teuthology.orchestra.run.smithi019.stdout: "448b10e7-494c-4a88-a9ab-186159c5dfdd": { 2024-09-10T22:34:44.196 INFO:teuthology.orchestra.run.smithi019.stdout: "start_time": "2024-09-10T22:33:21.208716+0000", 2024-09-10T22:34:44.196 INFO:teuthology.orchestra.run.smithi019.stdout: "path": "/", 2024-09-10T22:34:44.196 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_started": 0, 2024-09-10T22:34:44.196 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_passed": 0, 2024-09-10T22:34:44.196 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_failed": 0, 2024-09-10T22:34:44.196 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_skipped": 0 2024-09-10T22:34:44.196 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:34:44.196 INFO:teuthology.orchestra.run.smithi019.stdout: "9b6bfdee-303c-4c12-af56-dc85860d112a": { 2024-09-10T22:34:44.196 INFO:teuthology.orchestra.run.smithi019.stdout: "start_time": "2024-09-10T22:26:17.484162+0000", 2024-09-10T22:34:44.196 INFO:teuthology.orchestra.run.smithi019.stdout: "path": "/", 2024-09-10T22:34:44.196 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_started": 0, 2024-09-10T22:34:44.197 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_passed": 0, 2024-09-10T22:34:44.197 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_failed": 0, 2024-09-10T22:34:44.197 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_skipped": 0 2024-09-10T22:34:44.197 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-10T22:34:44.197 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-10T22:34:44.197 INFO:teuthology.orchestra.run.smithi019.stdout:} 2024-09-10T22:34:44.198 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:44.183+0000 7fc1583aa640 1 -- 172.21.15.19:0/1708603567 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7fc13c0b52e0 msgr2=0x7fc13c0b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:34:44.198 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:44.183+0000 7fc1583aa640 1 --2- 172.21.15.19:0/1708603567 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7fc13c0b52e0 0x7fc13c0b77a0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7fc14c0a90e0 tx=0x7fc14c0dc2e0 comp rx=0 tx=0).stop 2024-09-10T22:34:44.198 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:44.183+0000 7fc1583aa640 1 -- 172.21.15.19:0/1708603567 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc150101c90 msgr2=0x7fc1501992b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:34:44.198 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:44.183+0000 7fc1583aa640 1 --2- 172.21.15.19:0/1708603567 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc150101c90 0x7fc1501992b0 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7fc14c00d950 tx=0x7fc14c00de10 comp rx=0 tx=0).stop 2024-09-10T22:34:44.198 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:44.183+0000 7fc1583aa640 1 -- 172.21.15.19:0/1708603567 shutdown_connections 2024-09-10T22:34:44.198 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:44.183+0000 7fc1583aa640 1 --2- 172.21.15.19:0/1708603567 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7fc13c0b52e0 0x7fc13c0b77a0 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:34:44.198 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:44.183+0000 7fc1583aa640 1 --2- 172.21.15.19:0/1708603567 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc150108020 0x7fc15019eb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:34:44.198 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:44.183+0000 7fc1583aa640 1 --2- 172.21.15.19:0/1708603567 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc1501076a0 0x7fc1501997f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:34:44.198 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:44.183+0000 7fc1583aa640 1 --2- 172.21.15.19:0/1708603567 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc150101c90 0x7fc1501992b0 unknown :-1 s=CLOSED pgs=737 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:34:44.198 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:44.183+0000 7fc1583aa640 1 -- 172.21.15.19:0/1708603567 >> 172.21.15.19:0/1708603567 conn(0x7fc1500fd700 msgr2=0x7fc15006ad90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:34:44.198 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:44.183+0000 7fc1583aa640 1 -- 172.21.15.19:0/1708603567 shutdown_connections 2024-09-10T22:34:44.198 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:44.183+0000 7fc1583aa640 1 -- 172.21.15.19:0/1708603567 wait complete. 2024-09-10T22:34:44.229 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:44.227+0000 7fcc5ea2b640 1 -- 172.21.15.19:0/3360290841 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcc58075ac0 msgr2=0x7fcc58075f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:34:44.230 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:44.227+0000 7fcc5ea2b640 1 --2- 172.21.15.19:0/3360290841 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcc58075ac0 0x7fcc58075f40 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fcc4c009860 tx=0x7fcc4c02a340 comp rx=0 tx=0).stop 2024-09-10T22:34:44.230 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:44.227+0000 7fcc5ea2b640 1 -- 172.21.15.19:0/3360290841 shutdown_connections 2024-09-10T22:34:44.230 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:44.227+0000 7fcc5ea2b640 1 --2- 172.21.15.19:0/3360290841 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fcc5810a910 0x7fcc5810cd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:34:44.230 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:44.227+0000 7fcc5ea2b640 1 --2- 172.21.15.19:0/3360290841 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcc58075ac0 0x7fcc58075f40 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:34:44.230 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:44.227+0000 7fcc5ea2b640 1 --2- 172.21.15.19:0/3360290841 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fcc58076f30 0x7fcc58075580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:34:44.230 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:44.227+0000 7fcc5ea2b640 1 -- 172.21.15.19:0/3360290841 >> 172.21.15.19:0/3360290841 conn(0x7fcc580fe250 msgr2=0x7fcc58100670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:34:44.230 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:44.227+0000 7fcc5ea2b640 1 -- 172.21.15.19:0/3360290841 shutdown_connections 2024-09-10T22:34:44.230 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:44.227+0000 7fcc5ea2b640 1 -- 172.21.15.19:0/3360290841 wait complete. 2024-09-10T22:34:44.232 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:44.228+0000 7fcc5ea2b640 1 Processor -- start 2024-09-10T22:34:44.232 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:44.228+0000 7fcc5ea2b640 1 -- start start 2024-09-10T22:34:44.232 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:44.229+0000 7fcc5ea2b640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fcc58075ac0 0x7fcc5819af90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:34:44.232 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:44.229+0000 7fcc5ea2b640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcc58076f30 0x7fcc5819b5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:34:44.232 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:44.229+0000 7fcc5ea2b640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fcc5810a910 0x7fcc5819c210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:34:44.232 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:44.229+0000 7fcc5ea2b640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fcc581107e0 con 0x7fcc58075ac0 2024-09-10T22:34:44.232 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:44.229+0000 7fcc5ea2b640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fcc58110660 con 0x7fcc58076f30 2024-09-10T22:34:44.232 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:44.229+0000 7fcc5ea2b640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7fcc58110960 con 0x7fcc5810a910 2024-09-10T22:34:44.232 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:44.229+0000 7fcc57fff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fcc58075ac0 0x7fcc5819af90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:34:44.233 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:44.229+0000 7fcc57fff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fcc58075ac0 0x7fcc5819af90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:49518/0 (socket says 172.21.15.19:49518) 2024-09-10T22:34:44.233 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:44.229+0000 7fcc57fff640 1 -- 172.21.15.19:0/2826106109 learned_addr learned my addr 172.21.15.19:0/2826106109 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:34:44.233 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:44.229+0000 7fcc5cfc8640 1 --2- 172.21.15.19:0/2826106109 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fcc5810a910 0x7fcc5819c210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:34:44.233 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:44.229+0000 7fcc577fe640 1 --2- 172.21.15.19:0/2826106109 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcc58076f30 0x7fcc5819b5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:34:44.233 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:44.230+0000 7fcc57fff640 1 -- 172.21.15.19:0/2826106109 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fcc5810a910 msgr2=0x7fcc5819c210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:34:44.233 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:44.230+0000 7fcc57fff640 1 --2- 172.21.15.19:0/2826106109 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fcc5810a910 0x7fcc5819c210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:34:44.233 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:44.230+0000 7fcc57fff640 1 -- 172.21.15.19:0/2826106109 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcc58076f30 msgr2=0x7fcc5819b5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:34:44.233 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:44.230+0000 7fcc57fff640 1 --2- 172.21.15.19:0/2826106109 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcc58076f30 0x7fcc5819b5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:34:44.233 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:44.230+0000 7fcc57fff640 1 -- 172.21.15.19:0/2826106109 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcc5819cad0 con 0x7fcc58075ac0 2024-09-10T22:34:44.233 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:44.230+0000 7fcc577fe640 1 --2- 172.21.15.19:0/2826106109 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcc58076f30 0x7fcc5819b5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T22:34:44.233 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:44.230+0000 7fcc57fff640 1 --2- 172.21.15.19:0/2826106109 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fcc58075ac0 0x7fcc5819af90 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7fcc4800e9c0 tx=0x7fcc4800ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:34:44.233 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:44.230+0000 7fcc557fa640 1 -- 172.21.15.19:0/2826106109 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc4800cde0 con 0x7fcc58075ac0 2024-09-10T22:34:44.233 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:44.230+0000 7fcc557fa640 1 -- 172.21.15.19:0/2826106109 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fcc480035f0 con 0x7fcc58075ac0 2024-09-10T22:34:44.234 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:44.230+0000 7fcc557fa640 1 -- 172.21.15.19:0/2826106109 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc48010690 con 0x7fcc58075ac0 2024-09-10T22:34:44.234 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:44.230+0000 7fcc5ea2b640 1 -- 172.21.15.19:0/2826106109 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcc5819cdc0 con 0x7fcc58075ac0 2024-09-10T22:34:44.234 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:44.230+0000 7fcc5ea2b640 1 -- 172.21.15.19:0/2826106109 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcc581a3490 con 0x7fcc58075ac0 2024-09-10T22:34:44.234 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:44.233+0000 7fcc617f3740 1 Processor -- start 2024-09-10T22:34:44.234 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:44.233+0000 7fcc617f3740 1 -- start start 2024-09-10T22:34:44.236 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:44.233+0000 7fcc557fa640 1 -- 172.21.15.19:0/2826106109 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 18) ==== 153250+0+0 (secure 0 0 0) 0x7fcc48004000 con 0x7fcc58075ac0 2024-09-10T22:34:44.236 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:44.233+0000 7fcc617f3740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x561ff1cc1860 0x561ff1cc3c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:34:44.236 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:44.233+0000 7fcc617f3740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561ff1cc4190 0x561ff1cc6580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:34:44.236 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:44.233+0000 7fcc617f3740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x561ff1cc6bd0 0x561ff1cc9090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:34:44.237 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:44.234+0000 7fcc617f3740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x561ff1c336f0 con 0x561ff1cc6bd0 2024-09-10T22:34:44.237 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:44.234+0000 7fcc617f3740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x561ff1c22b20 con 0x561ff1cc4190 2024-09-10T22:34:44.237 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:44.234+0000 7fcc617f3740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x561ff1c26930 con 0x561ff1cc1860 2024-09-10T22:34:44.237 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:44.234+0000 7fcc57fff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561ff1cc4190 0x561ff1cc6580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:34:44.237 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:44.234+0000 7fcc577fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x561ff1cc6bd0 0x561ff1cc9090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:34:44.237 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:44.234+0000 7fcc5cfc8640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x561ff1cc1860 0x561ff1cc3c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:34:44.237 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:44.234+0000 7fcc577fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x561ff1cc6bd0 0x561ff1cc9090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:49526/0 (socket says 172.21.15.19:49526) 2024-09-10T22:34:44.237 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:44.234+0000 7fcc5cfc8640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x561ff1cc1860 0x561ff1cc3c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.19:58078/0 (socket says 172.21.15.19:58078) 2024-09-10T22:34:44.237 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:44.234+0000 7fcc57fff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561ff1cc4190 0x561ff1cc6580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.19:56324/0 (socket says 172.21.15.19:56324) 2024-09-10T22:34:44.237 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:44.234+0000 7fcc577fe640 1 -- 172.21.15.19:0/1309014541 learned_addr learned my addr 172.21.15.19:0/1309014541 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:34:44.237 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:44.234+0000 7fcc577fe640 1 -- 172.21.15.19:0/1309014541 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x561ff1cc1860 msgr2=0x561ff1cc3c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:34:44.237 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:44.234+0000 7fcc577fe640 1 --2- 172.21.15.19:0/1309014541 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x561ff1cc1860 0x561ff1cc3c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:34:44.238 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:44.234+0000 7fcc577fe640 1 -- 172.21.15.19:0/1309014541 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561ff1cc4190 msgr2=0x561ff1cc6580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:34:44.238 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:44.234+0000 7fcc577fe640 1 --2- 172.21.15.19:0/1309014541 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561ff1cc4190 0x561ff1cc6580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:34:44.238 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:44.234+0000 7fcc577fe640 1 -- 172.21.15.19:0/1309014541 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561ff1be8530 con 0x561ff1cc6bd0 2024-09-10T22:34:44.238 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:44.234+0000 7fcc5cfc8640 1 --2- 172.21.15.19:0/1309014541 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x561ff1cc1860 0x561ff1cc3c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T22:34:44.238 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:44.234+0000 7fcc577fe640 1 --2- 172.21.15.19:0/1309014541 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x561ff1cc6bd0 0x561ff1cc9090 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7fcc4c009780 tx=0x7fcc4c005da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1eb20675f8c5664 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:34:44.238 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:44.234+0000 7fcc557fa640 1 --2- 172.21.15.19:0/2826106109 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7fcc400b52e0 0x7fcc400b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:34:44.238 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:44.234+0000 7fcc3e7fc640 1 -- 172.21.15.19:0/1309014541 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc4c040020 con 0x561ff1cc6bd0 2024-09-10T22:34:44.238 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:44.234+0000 7fcc5cfc8640 1 --2- 172.21.15.19:0/2826106109 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7fcc400b52e0 0x7fcc400b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:34:44.238 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:44.235+0000 7fcc557fa640 1 -- 172.21.15.19:0/2826106109 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8327+0+0 (secure 0 0 0) 0x7fcc480e6020 con 0x7fcc58075ac0 2024-09-10T22:34:44.238 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:44.235+0000 7fcc3e7fc640 1 -- 172.21.15.19:0/1309014541 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fcc4c038040 con 0x561ff1cc6bd0 2024-09-10T22:34:44.238 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:44.235+0000 7fcc3e7fc640 1 -- 172.21.15.19:0/1309014541 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc4c037070 con 0x561ff1cc6bd0 2024-09-10T22:34:44.242 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:44.235+0000 7fcc617f3740 1 -- 172.21.15.19:0/1309014541 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x561ff1cc6bd0 msgr2=0x561ff1cc9090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:34:44.242 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:44.235+0000 7fcc5cfc8640 1 --2- 172.21.15.19:0/2826106109 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7fcc400b52e0 0x7fcc400b77a0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7fcc50009fd0 tx=0x7fcc50009500 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:34:44.242 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:44.235+0000 7fcc617f3740 1 --2- 172.21.15.19:0/1309014541 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x561ff1cc6bd0 0x561ff1cc9090 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7fcc4c009780 tx=0x7fcc4c005da0 comp rx=0 tx=0).stop 2024-09-10T22:34:44.242 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:44.235+0000 7fcc617f3740 1 -- 172.21.15.19:0/1309014541 shutdown_connections 2024-09-10T22:34:44.242 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:44.235+0000 7fcc617f3740 1 --2- 172.21.15.19:0/1309014541 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x561ff1cc6bd0 0x561ff1cc9090 unknown :-1 s=CLOSED pgs=741 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:34:44.242 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:44.235+0000 7fcc617f3740 1 --2- 172.21.15.19:0/1309014541 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561ff1cc4190 0x561ff1cc6580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:34:44.243 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:44.235+0000 7fcc617f3740 1 --2- 172.21.15.19:0/1309014541 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x561ff1cc1860 0x561ff1cc3c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:34:44.243 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:44.235+0000 7fcc617f3740 1 -- 172.21.15.19:0/1309014541 >> 172.21.15.19:0/1309014541 conn(0x561ff1cbc9b0 msgr2=0x561ff1cbd740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:34:44.243 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:44.235+0000 7fcc617f3740 1 -- 172.21.15.19:0/1309014541 shutdown_connections 2024-09-10T22:34:44.243 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:44.235+0000 7fcc617f3740 1 -- 172.21.15.19:0/1309014541 wait complete. 2024-09-10T22:34:44.243 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:44.236+0000 7fcc617f3740 1 -- start start 2024-09-10T22:34:44.243 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:44.236+0000 7fcc617f3740 1 Processor -- start 2024-09-10T22:34:44.243 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:44.236+0000 7fcc617f3740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x561ff1cc1860 0x561ff1ccae70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:34:44.243 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:44.236+0000 7fcc617f3740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561ff1cc4190 0x561ff1ccb510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:34:44.243 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:44.236+0000 7fcc617f3740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x561ff1cc6bd0 0x561ff1ccc0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:34:44.243 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:44.236+0000 7fcc617f3740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x561ff1b5aab0 con 0x561ff1cc1860 2024-09-10T22:34:44.243 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:44.236+0000 7fcc617f3740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x561ff1bc8730 con 0x561ff1cc4190 2024-09-10T22:34:44.243 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:44.236+0000 7fcc617f3740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x561ff1cc9b50 con 0x561ff1cc6bd0 2024-09-10T22:34:44.244 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:44.236+0000 7fcc617f3740 10 client.0 _ll_register_callbacks cb 0x561ff1c1c6b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T22:34:44.244 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:44.236+0000 7fcc57fff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x561ff1cc1860 0x561ff1ccae70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:34:44.244 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:44.236+0000 7fcc5cfc8640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x561ff1cc6bd0 0x561ff1ccc0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:34:44.244 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:44.236+0000 7fcc57fff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x561ff1cc1860 0x561ff1ccae70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:49528/0 (socket says 172.21.15.19:49528) 2024-09-10T22:34:44.244 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:44.236+0000 7fcc57fff640 1 -- 172.21.15.19:0/1071761609 learned_addr learned my addr 172.21.15.19:0/1071761609 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:34:44.244 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:44.236+0000 7fcc577fe640 1 --2- 172.21.15.19:0/1071761609 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561ff1cc4190 0x561ff1ccb510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:34:44.244 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:44.237+0000 7fcc5cfc8640 1 -- 172.21.15.19:0/1071761609 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561ff1cc4190 msgr2=0x561ff1ccb510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:34:44.244 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:44.237+0000 7fcc5cfc8640 1 --2- 172.21.15.19:0/1071761609 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561ff1cc4190 0x561ff1ccb510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:34:44.244 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:44.237+0000 7fcc5cfc8640 1 -- 172.21.15.19:0/1071761609 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x561ff1cc1860 msgr2=0x561ff1ccae70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:34:44.244 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:44.237+0000 7fcc5cfc8640 1 --2- 172.21.15.19:0/1071761609 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x561ff1cc1860 0x561ff1ccae70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:34:44.244 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:44.237+0000 7fcc5cfc8640 1 -- 172.21.15.19:0/1071761609 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561ff1984790 con 0x561ff1cc6bd0 2024-09-10T22:34:44.244 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:44.237+0000 7fcc5cfc8640 1 --2- 172.21.15.19:0/1071761609 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x561ff1cc6bd0 0x561ff1ccc0e0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fcc50005fd0 tx=0x7fcc50004ab0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=765dce7c37c9aa8 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:34:44.244 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:44.237+0000 7fcc377fe640 10 client.0 ms_handle_connect on v2:172.21.15.138:3300/0 2024-09-10T22:34:44.244 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:44.237+0000 7fcc377fe640 1 -- 172.21.15.19:0/1071761609 <== mon.1 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc50011e90 con 0x561ff1cc6bd0 2024-09-10T22:34:44.245 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:44.237+0000 7fcc617f3740 1 -- 172.21.15.19:0/1071761609 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fcc4c038040 con 0x561ff1cc6bd0 2024-09-10T22:34:44.245 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:44.237+0000 7fcc377fe640 1 -- 172.21.15.19:0/1071761609 <== mon.1 v2:172.21.15.138:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8327+0+0 (secure 0 0 0) 0x7fcc50004b20 con 0x561ff1cc6bd0 2024-09-10T22:34:44.245 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:44.237+0000 7fcc377fe640 1 -- 172.21.15.19:0/1071761609 <== mon.1 v2:172.21.15.138:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fcc50004d60 con 0x561ff1cc6bd0 2024-09-10T22:34:44.245 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:44.237+0000 7fcc617f3740 10 client.26350 fetch_fsmap learned FSMap version 27 2024-09-10T22:34:44.245 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:44.237+0000 7fcc617f3740 1 -- 172.21.15.19:0/1071761609 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x561ff19fd620 con 0x561ff1cc6bd0 2024-09-10T22:34:44.245 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:44.237+0000 7fcc377fe640 1 -- 172.21.15.19:0/1071761609 <== mon.1 v2:172.21.15.138:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fcc4c038040 con 0x561ff1cc6bd0 2024-09-10T22:34:44.245 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:44.238+0000 7fcc377fe640 1 -- 172.21.15.19:0/1071761609 <== mon.1 v2:172.21.15.138:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7fcc5002f020 con 0x561ff1cc6bd0 2024-09-10T22:34:44.245 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:44.238+0000 7fcc617f3740 10 client.26350 fetch_fsmap finished waiting for FSMap version 27 2024-09-10T22:34:44.245 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:44.238+0000 7fcc617f3740 10 client.26350 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-10T22:34:44.245 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:44.238+0000 7fcc617f3740 20 client.26350 populate_metadata read hostname 'smithi019' 2024-09-10T22:34:44.245 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:44.238+0000 7fcc617f3740 1 --2- 172.21.15.19:0/1071761609 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x561ff1cd6760 0x561ff1cd8be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:34:44.245 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:44.238+0000 7fcc617f3740 4 client.26350 mds_command: new command op to 24581 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T22:34:44.245 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:44.238+0000 7fcc617f3740 1 -- 172.21.15.19:0/1071761609 --> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x561ff1c35640 con 0x561ff1cd6760 2024-09-10T22:34:44.246 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:44.238+0000 7fcc57fff640 1 --2- 172.21.15.19:0/1071761609 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x561ff1cd6760 0x561ff1cd8be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:34:44.246 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:44.238+0000 7fcc377fe640 10 client.26350 ms_handle_connect on v2:172.21.15.135:6838/1254769802 2024-09-10T22:34:44.246 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:44.238+0000 7fcc57fff640 1 --2- 172.21.15.19:0/1071761609 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x561ff1cd6760 0x561ff1cd8be0 crc :-1 s=READY pgs=170 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=38a78b469cb4134a server_cookie=40fa5b9de5415d46 in_seq=0 out_seq=0 2024-09-10T22:34:44.246 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:44.239+0000 7fcc377fe640 1 -- 172.21.15.19:0/1071761609 <== mds.0 v2:172.21.15.135:6838/1254769802 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x561ff1c35640 con 0x561ff1cd6760 2024-09-10T22:34:44.246 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:44.239+0000 7fcc377fe640 10 client.26350 handle_command_reply: tid=0 2024-09-10T22:34:44.246 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:44.239+0000 7fcc617f3740 1 client.26350 shutdown 2024-09-10T22:34:44.246 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:44.239+0000 7fcc617f3740 1 -- 172.21.15.19:0/1071761609 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x561ff1cc6bd0 msgr2=0x561ff1ccc0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:34:44.246 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:44.239+0000 7fcc617f3740 1 --2- 172.21.15.19:0/1071761609 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x561ff1cc6bd0 0x561ff1ccc0e0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fcc50005fd0 tx=0x7fcc50004ab0 comp rx=0 tx=0).stop 2024-09-10T22:34:44.246 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:44.239+0000 7fcc617f3740 1 -- 172.21.15.19:0/1071761609 shutdown_connections 2024-09-10T22:34:44.246 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:44.239+0000 7fcc617f3740 1 --2- 172.21.15.19:0/1071761609 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x561ff1cd6760 0x561ff1cd8be0 crc :-1 s=READY pgs=170 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:34:44.246 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:44.239+0000 7fcc617f3740 1 --2- 172.21.15.19:0/1071761609 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x561ff1cc6bd0 0x561ff1ccc0e0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:34:44.246 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:44.239+0000 7fcc617f3740 1 --2- 172.21.15.19:0/1071761609 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561ff1cc4190 0x561ff1ccb510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:34:44.246 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:44.239+0000 7fcc617f3740 1 --2- 172.21.15.19:0/1071761609 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x561ff1cc1860 0x561ff1ccae70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:34:44.246 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:44.239+0000 7fcc617f3740 1 -- 172.21.15.19:0/1071761609 >> 172.21.15.19:0/1071761609 conn(0x561ff1cbc9b0 msgr2=0x561ff1cbbbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:34:44.246 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:44.239+0000 7fcc377fe640 0 client.26350 ms_handle_reset on v2:172.21.15.135:6838/1254769802 2024-09-10T22:34:44.247 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:44.239+0000 7fcc617f3740 1 -- 172.21.15.19:0/1071761609 shutdown_connections 2024-09-10T22:34:44.247 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:44.239+0000 7fcc617f3740 1 -- 172.21.15.19:0/1071761609 wait complete. 2024-09-10T22:34:44.247 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:44.240+0000 7fcc617f3740 20 client.26350 trim_cache size 0 max 16384 2024-09-10T22:34:44.257 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:44.254+0000 7fcc617f3740 1 Processor -- start 2024-09-10T22:34:44.257 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:44.254+0000 7fcc617f3740 1 -- start start 2024-09-10T22:34:44.257 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:44.255+0000 7fcc617f3740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561ff1cc1860 0x561ff1ccb510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:34:44.257 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:44.255+0000 7fcc617f3740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x561ff1cc4190 0x561ff1cc0d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:34:44.257 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:44.255+0000 7fcc617f3740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x561ff1cc6bd0 0x561ff1cc1290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:34:44.257 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:44.255+0000 7fcc617f3740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fcc581aec90 con 0x561ff1cc6bd0 2024-09-10T22:34:44.258 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:44.255+0000 7fcc617f3740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fcc581ac560 con 0x561ff1cc1860 2024-09-10T22:34:44.258 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:44.255+0000 7fcc617f3740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7fcc581aa3b0 con 0x561ff1cc4190 2024-09-10T22:34:44.258 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:44.255+0000 7fcc5cfc8640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x561ff1cc6bd0 0x561ff1cc1290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:34:44.258 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:44.255+0000 7fcc57fff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561ff1cc1860 0x561ff1ccb510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:34:44.258 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:44.255+0000 7fcc57fff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561ff1cc1860 0x561ff1ccb510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.19:56340/0 (socket says 172.21.15.19:56340) 2024-09-10T22:34:44.258 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:44.255+0000 7fcc5cfc8640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x561ff1cc6bd0 0x561ff1cc1290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:49540/0 (socket says 172.21.15.19:49540) 2024-09-10T22:34:44.258 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:44.255+0000 7fcc57fff640 1 -- 172.21.15.19:0/753939188 learned_addr learned my addr 172.21.15.19:0/753939188 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:34:44.258 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:44.255+0000 7fcc577fe640 1 --2- 172.21.15.19:0/753939188 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x561ff1cc4190 0x561ff1cc0d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:34:44.258 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:44.255+0000 7fcc57fff640 1 -- 172.21.15.19:0/753939188 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x561ff1cc4190 msgr2=0x561ff1cc0d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:34:44.258 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:44.255+0000 7fcc57fff640 1 --2- 172.21.15.19:0/753939188 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x561ff1cc4190 0x561ff1cc0d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:34:44.258 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:44.255+0000 7fcc57fff640 1 -- 172.21.15.19:0/753939188 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x561ff1cc6bd0 msgr2=0x561ff1cc1290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:34:44.258 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:44.255+0000 7fcc57fff640 1 --2- 172.21.15.19:0/753939188 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x561ff1cc6bd0 0x561ff1cc1290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:34:44.259 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:44.255+0000 7fcc57fff640 1 -- 172.21.15.19:0/753939188 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561ff1cc68f0 con 0x561ff1cc1860 2024-09-10T22:34:44.259 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:44.255+0000 7fcc5cfc8640 1 --2- 172.21.15.19:0/753939188 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x561ff1cc6bd0 0x561ff1cc1290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T22:34:44.259 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:44.255+0000 7fcc57fff640 1 --2- 172.21.15.19:0/753939188 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561ff1cc1860 0x561ff1ccb510 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fcc480e3b10 tx=0x7fcc480a8720 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9c8d262bfb57f8d8 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:34:44.259 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:44.255+0000 7fcc3dffb640 1 -- 172.21.15.19:0/753939188 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc480abef0 con 0x561ff1cc1860 2024-09-10T22:34:44.259 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:44.256+0000 7fcc3dffb640 1 -- 172.21.15.19:0/753939188 <== mon.2 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fcc480ac290 con 0x561ff1cc1860 2024-09-10T22:34:44.259 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:44.256+0000 7fcc3dffb640 1 -- 172.21.15.19:0/753939188 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc480b5d10 con 0x561ff1cc1860 2024-09-10T22:34:44.262 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:44.256+0000 7fcc617f3740 1 -- 172.21.15.19:0/753939188 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561ff1cc1860 msgr2=0x561ff1ccb510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:34:44.262 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:44.256+0000 7fcc617f3740 1 --2- 172.21.15.19:0/753939188 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561ff1cc1860 0x561ff1ccb510 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fcc480e3b10 tx=0x7fcc480a8720 comp rx=0 tx=0).stop 2024-09-10T22:34:44.262 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:44.256+0000 7fcc617f3740 1 -- 172.21.15.19:0/753939188 shutdown_connections 2024-09-10T22:34:44.263 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:44.256+0000 7fcc617f3740 1 --2- 172.21.15.19:0/753939188 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x561ff1cc6bd0 0x561ff1cc1290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:34:44.263 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:44.256+0000 7fcc617f3740 1 --2- 172.21.15.19:0/753939188 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x561ff1cc4190 0x561ff1cc0d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:34:44.263 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:44.256+0000 7fcc617f3740 1 --2- 172.21.15.19:0/753939188 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561ff1cc1860 0x561ff1ccb510 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:34:44.263 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:44.256+0000 7fcc617f3740 1 -- 172.21.15.19:0/753939188 >> 172.21.15.19:0/753939188 conn(0x561ff1cbc9b0 msgr2=0x561ff1cbd2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:34:44.263 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:44.256+0000 7fcc617f3740 1 -- 172.21.15.19:0/753939188 shutdown_connections 2024-09-10T22:34:44.263 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:44.256+0000 7fcc617f3740 1 -- 172.21.15.19:0/753939188 wait complete. 2024-09-10T22:34:44.263 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:44.257+0000 7fcc617f3740 1 -- start start 2024-09-10T22:34:44.263 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:44.257+0000 7fcc617f3740 1 Processor -- start 2024-09-10T22:34:44.263 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:44.257+0000 7fcc617f3740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x561ff1cc1860 0x561ff1cd2ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:34:44.263 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:44.257+0000 7fcc617f3740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x561ff1cc4190 0x561ff1cd17e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:34:44.263 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:44.257+0000 7fcc617f3740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561ff1cc6bd0 0x561ff1cd1e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:34:44.263 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:44.257+0000 7fcc617f3740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fcc581aaa20 con 0x561ff1cc1860 2024-09-10T22:34:44.263 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:44.257+0000 7fcc617f3740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fcc581abe90 con 0x561ff1cc6bd0 2024-09-10T22:34:44.264 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:44.257+0000 7fcc617f3740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7fcc581ab0f0 con 0x561ff1cc4190 2024-09-10T22:34:44.264 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:44.257+0000 7fcc617f3740 10 client.0 _ll_register_callbacks cb 0x7fcc50009be0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T22:34:44.264 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:44.257+0000 7fcc57fff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x561ff1cc1860 0x561ff1cd2ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:34:44.264 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:44.257+0000 7fcc57fff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x561ff1cc1860 0x561ff1cd2ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:49542/0 (socket says 172.21.15.19:49542) 2024-09-10T22:34:44.264 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:44.257+0000 7fcc57fff640 1 -- 172.21.15.19:0/3148755644 learned_addr learned my addr 172.21.15.19:0/3148755644 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:34:44.264 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:44.257+0000 7fcc577fe640 1 --2- 172.21.15.19:0/3148755644 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x561ff1cc4190 0x561ff1cd17e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:34:44.264 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:44.257+0000 7fcc5cfc8640 1 --2- 172.21.15.19:0/3148755644 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561ff1cc6bd0 0x561ff1cd1e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:34:44.264 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:44.258+0000 7fcc57fff640 1 -- 172.21.15.19:0/3148755644 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x561ff1cc4190 msgr2=0x561ff1cd17e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:34:44.264 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:44.258+0000 7fcc57fff640 1 --2- 172.21.15.19:0/3148755644 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x561ff1cc4190 0x561ff1cd17e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:34:44.264 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:44.258+0000 7fcc57fff640 1 -- 172.21.15.19:0/3148755644 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561ff1cc6bd0 msgr2=0x561ff1cd1e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:34:44.264 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:44.258+0000 7fcc57fff640 1 --2- 172.21.15.19:0/3148755644 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561ff1cc6bd0 0x561ff1cd1e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:34:44.264 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:44.258+0000 7fcc57fff640 1 -- 172.21.15.19:0/3148755644 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561ff1cd0300 con 0x561ff1cc1860 2024-09-10T22:34:44.264 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:44.258+0000 7fcc5cfc8640 1 --2- 172.21.15.19:0/3148755644 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561ff1cc6bd0 0x561ff1cd1e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T22:34:44.265 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:44.258+0000 7fcc57fff640 1 --2- 172.21.15.19:0/3148755644 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x561ff1cc1860 0x561ff1cd2ae0 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7fcc480e9760 tx=0x7fcc48004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fa2e8aa1a268cb97 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:34:44.265 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:44.258+0000 7fcc377fe640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-10T22:34:44.265 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:44.258+0000 7fcc377fe640 1 -- 172.21.15.19:0/3148755644 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc480ac780 con 0x561ff1cc1860 2024-09-10T22:34:44.265 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:44.258+0000 7fcc377fe640 1 -- 172.21.15.19:0/3148755644 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8327+0+0 (secure 0 0 0) 0x7fcc480037a0 con 0x561ff1cc1860 2024-09-10T22:34:44.265 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:44.258+0000 7fcc617f3740 1 -- 172.21.15.19:0/3148755644 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fcc480ac290 con 0x561ff1cc1860 2024-09-10T22:34:44.265 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:44.258+0000 7fcc377fe640 1 -- 172.21.15.19:0/3148755644 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fcc480ace80 con 0x561ff1cc1860 2024-09-10T22:34:44.265 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:44.258+0000 7fcc617f3740 10 client.16989 fetch_fsmap learned FSMap version 27 2024-09-10T22:34:44.265 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:44.258+0000 7fcc617f3740 1 -- 172.21.15.19:0/3148755644 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x561ff1d438b0 con 0x561ff1cc1860 2024-09-10T22:34:44.265 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:44.258+0000 7fcc377fe640 1 -- 172.21.15.19:0/3148755644 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fcc480ac290 con 0x561ff1cc1860 2024-09-10T22:34:44.265 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:44.258+0000 7fcc377fe640 1 -- 172.21.15.19:0/3148755644 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7fcc480a8160 con 0x561ff1cc1860 2024-09-10T22:34:44.265 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:44.259+0000 7fcc617f3740 10 client.16989 fetch_fsmap finished waiting for FSMap version 27 2024-09-10T22:34:44.265 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:44.259+0000 7fcc617f3740 10 client.16989 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-10T22:34:44.265 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:44.259+0000 7fcc617f3740 20 client.16989 populate_metadata read hostname 'smithi019' 2024-09-10T22:34:44.266 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:44.259+0000 7fcc617f3740 1 --2- 172.21.15.19:0/3148755644 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x561ff1d441e0 0x561ff1d46600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:34:44.266 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:44.259+0000 7fcc617f3740 4 client.16989 mds_command: new command op to 24581 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-10T22:34:44.266 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:44.259+0000 7fcc617f3740 1 -- 172.21.15.19:0/3148755644 --> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] -- command(tid 0: {"prefix": "flush journal"}) -- 0x561ff1c310f0 con 0x561ff1d441e0 2024-09-10T22:34:44.266 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:44.259+0000 7fcc577fe640 1 --2- 172.21.15.19:0/3148755644 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x561ff1d441e0 0x561ff1d46600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:34:44.266 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:44.259+0000 7fcc577fe640 1 --2- 172.21.15.19:0/3148755644 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x561ff1d441e0 0x561ff1d46600 crc :-1 s=READY pgs=171 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=60cb1dbeeaf0c018 server_cookie=c0c74924b40c2848 in_seq=0 out_seq=0 2024-09-10T22:34:44.266 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:44.259+0000 7fcc377fe640 10 client.16989 ms_handle_connect on v2:172.21.15.135:6838/1254769802 2024-09-10T22:34:44.360 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:34:44 smithi135 ceph-mon[34789]: pgmap v596: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 552 KiB/s rd, 242 MiB/s wr, 827 op/s 2024-09-10T22:34:44.360 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:34:44 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T22:34:44.360 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:34:44 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T22:34:44.360 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:34:44 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:34:44.375 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:34:44 smithi138 ceph-mon[35236]: pgmap v596: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 552 KiB/s rd, 242 MiB/s wr, 827 op/s 2024-09-10T22:34:44.375 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:34:44 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T22:34:44.375 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:34:44 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T22:34:44.375 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:34:44 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:34:44.459 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:34:44 smithi019 ceph-mon[31375]: pgmap v596: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 552 KiB/s rd, 242 MiB/s wr, 827 op/s 2024-09-10T22:34:44.459 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:34:44 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T22:34:44.459 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:34:44 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T22:34:44.459 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:34:44 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:34:45.232 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-10T22:34:45.232 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 22997a4c-6fc2-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-10T22:34:45.514 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/22997a4c-6fc2-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T22:34:46.063 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:46.035+0000 7f671fcf4640 1 -- 172.21.15.19:0/2526833926 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f671810d130 msgr2=0x7f671810f590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:34:46.063 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:46.035+0000 7f671fcf4640 1 --2- 172.21.15.19:0/2526833926 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f671810d130 0x7f671810f590 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7f6710009ca0 tx=0x7f671002a8c0 comp rx=0 tx=0).stop 2024-09-10T22:34:46.064 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:46.035+0000 7f671fcf4640 1 -- 172.21.15.19:0/2526833926 shutdown_connections 2024-09-10T22:34:46.064 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:46.035+0000 7f671fcf4640 1 --2- 172.21.15.19:0/2526833926 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f671810d130 0x7f671810f590 unknown :-1 s=CLOSED pgs=743 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:34:46.064 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:46.035+0000 7f671fcf4640 1 --2- 172.21.15.19:0/2526833926 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f67181045f0 0x7f671810cae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:34:46.064 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:46.035+0000 7f671fcf4640 1 --2- 172.21.15.19:0/2526833926 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f6718103cd0 0x7f67181040b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:34:46.064 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:46.035+0000 7f671fcf4640 1 -- 172.21.15.19:0/2526833926 >> 172.21.15.19:0/2526833926 conn(0x7f67180fd770 msgr2=0x7f67180ffb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:34:46.064 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:46.035+0000 7f671fcf4640 1 -- 172.21.15.19:0/2526833926 shutdown_connections 2024-09-10T22:34:46.064 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:46.035+0000 7f671fcf4640 1 -- 172.21.15.19:0/2526833926 wait complete. 2024-09-10T22:34:46.064 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:46.036+0000 7f671fcf4640 1 Processor -- start 2024-09-10T22:34:46.064 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:46.036+0000 7f671fcf4640 1 -- start start 2024-09-10T22:34:46.064 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:46.036+0000 7f671fcf4640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6718103cd0 0x7f671819b480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:34:46.064 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:46.036+0000 7f671fcf4640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f67181045f0 0x7f671819b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:34:46.065 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:46.036+0000 7f671fcf4640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f671810d130 0x7f67181a0d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:34:46.065 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:46.036+0000 7f671fcf4640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f6718112da0 con 0x7f6718103cd0 2024-09-10T22:34:46.065 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:46.036+0000 7f671fcf4640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f6718112c20 con 0x7f671810d130 2024-09-10T22:34:46.065 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:46.036+0000 7f671fcf4640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f6718112f20 con 0x7f67181045f0 2024-09-10T22:34:46.065 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:46.036+0000 7f671da90640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6718103cd0 0x7f671819b480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:34:46.065 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:46.037+0000 7f671da90640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6718103cd0 0x7f671819b480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:49556/0 (socket says 172.21.15.19:49556) 2024-09-10T22:34:46.065 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:46.037+0000 7f671da90640 1 -- 172.21.15.19:0/1072310518 learned_addr learned my addr 172.21.15.19:0/1072310518 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:34:46.065 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:46.037+0000 7f671e291640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f671810d130 0x7f67181a0d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:34:46.065 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:46.037+0000 7f671d28f640 1 --2- 172.21.15.19:0/1072310518 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f67181045f0 0x7f671819b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:34:46.065 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:46.037+0000 7f671da90640 1 -- 172.21.15.19:0/1072310518 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f67181045f0 msgr2=0x7f671819b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:34:46.065 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:46.037+0000 7f671da90640 1 --2- 172.21.15.19:0/1072310518 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f67181045f0 0x7f671819b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:34:46.065 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:46.037+0000 7f671da90640 1 -- 172.21.15.19:0/1072310518 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f671810d130 msgr2=0x7f67181a0d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:34:46.066 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:46.037+0000 7f671da90640 1 --2- 172.21.15.19:0/1072310518 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f671810d130 0x7f67181a0d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:34:46.066 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:46.037+0000 7f671da90640 1 -- 172.21.15.19:0/1072310518 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f67181a1530 con 0x7f6718103cd0 2024-09-10T22:34:46.066 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:46.037+0000 7f671d28f640 1 --2- 172.21.15.19:0/1072310518 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f67181045f0 0x7f671819b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T22:34:46.066 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:46.037+0000 7f671da90640 1 --2- 172.21.15.19:0/1072310518 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6718103cd0 0x7f671819b480 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7f671400d950 tx=0x7f671400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:34:46.066 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:46.037+0000 7f670effd640 1 -- 172.21.15.19:0/1072310518 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6714017030 con 0x7f6718103cd0 2024-09-10T22:34:46.066 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:46.037+0000 7f671fcf4640 1 -- 172.21.15.19:0/1072310518 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f67181a1820 con 0x7f6718103cd0 2024-09-10T22:34:46.066 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:46.037+0000 7f670effd640 1 -- 172.21.15.19:0/1072310518 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6714004020 con 0x7f6718103cd0 2024-09-10T22:34:46.066 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:46.038+0000 7f670effd640 1 -- 172.21.15.19:0/1072310518 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67140047a0 con 0x7f6718103cd0 2024-09-10T22:34:46.066 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:46.038+0000 7f671fcf4640 1 -- 172.21.15.19:0/1072310518 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f67181a80b0 con 0x7f6718103cd0 2024-09-10T22:34:46.066 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:46.039+0000 7f671fcf4640 1 -- 172.21.15.19:0/1072310518 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f67181040b0 con 0x7f6718103cd0 2024-09-10T22:34:46.066 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:46.040+0000 7f670effd640 1 -- 172.21.15.19:0/1072310518 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 18) ==== 153250+0+0 (secure 0 0 0) 0x7f6714009a30 con 0x7f6718103cd0 2024-09-10T22:34:46.066 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:46.041+0000 7f670effd640 1 --2- 172.21.15.19:0/1072310518 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f67040b52e0 0x7f67040b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:34:46.066 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:46.041+0000 7f671d28f640 1 --2- 172.21.15.19:0/1072310518 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f67040b52e0 0x7f67040b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:34:46.067 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:46.041+0000 7f670effd640 1 -- 172.21.15.19:0/1072310518 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8327+0+0 (secure 0 0 0) 0x7f67140e5cc0 con 0x7f6718103cd0 2024-09-10T22:34:46.067 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:46.042+0000 7f671d28f640 1 --2- 172.21.15.19:0/1072310518 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f67040b52e0 0x7f67040b77a0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f671810e7c0 tx=0x7f6708005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:34:46.067 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:46.044+0000 7f670effd640 1 -- 172.21.15.19:0/1072310518 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f67140acb20 con 0x7f6718103cd0 2024-09-10T22:34:46.208 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:34:46 smithi019 ceph-mon[31375]: pgmap v597: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 826 KiB/s rd, 264 MiB/s wr, 833 op/s 2024-09-10T22:34:46.361 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:34:46 smithi135 ceph-mon[34789]: pgmap v597: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 826 KiB/s rd, 264 MiB/s wr, 833 op/s 2024-09-10T22:34:46.375 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:34:46 smithi138 ceph-mon[35236]: pgmap v597: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 826 KiB/s rd, 264 MiB/s wr, 833 op/s 2024-09-10T22:34:46.390 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:46.389+0000 7f671fcf4640 1 -- 172.21.15.19:0/1072310518 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f671819c5b0 con 0x7f6718103cd0 2024-09-10T22:34:46.392 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:46.390+0000 7f670effd640 1 -- 172.21.15.19:0/1072310518 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) ==== 94+0+11921 (secure 0 0 0) 0x7f671819c5b0 con 0x7f6718103cd0 2024-09-10T22:34:46.393 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-10T22:34:46.393 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":27,"btime":"2024-09-10T22:29:37:724724+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14673,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6835/1835804747","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6834","nonce":1835804747},{"type":"v1","addr":"172.21.15.19:6835","nonce":1835804747}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14685,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6837/1750470490","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6836","nonce":1750470490},{"type":"v1","addr":"172.21.15.19:6837","nonce":1750470490}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14733,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6839/2642941149","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6838","nonce":2642941149},{"type":"v1","addr":"172.21.15.19:6839","nonce":2642941149}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14745,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6841/2449948682","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6840","nonce":2449948682},{"type":"v1","addr":"172.21.15.19:6841","nonce":2449948682}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24511,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.138:6833/2524811494","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6832","nonce":2524811494},{"type":"v1","addr":"172.21.15.138:6833","nonce":2524811494}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24512,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6833/3014993624","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6832","nonce":3014993624},{"type":"v1","addr":"172.21.15.135:6833","nonce":3014993624}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":27,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-10T22:24:22.733925+0000","modified":"2024-09-10T22:29:37.430699+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24581,"mds_1":24568,"mds_2":24553},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24527":{"gid":24527,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.135:6835/3715773348","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6834","nonce":3715773348},{"type":"v1","addr":"172.21.15.135:6835","nonce":3715773348}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24541":{"gid":24541,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.138:6835/933547028","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6834","nonce":933547028},{"type":"v1","addr":"172.21.15.138:6835","nonce":933547028}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24551":{"gid":24551,"name":"h","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.135:6837/3495029135","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6836","nonce":3495029135},{"type":"v1","addr":"172.21.15.135:6837","nonce":3495029135}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24553":{"gid":24553,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":10,"addr":"172.21.15.138:6837/3353290042","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6836","nonce":3353290042},{"type":"v1","addr":"172.21.15.138:6837","nonce":3353290042}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24568":{"gid":24568,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.138:6839/383637208","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6838","nonce":383637208},{"type":"v1","addr":"172.21.15.138:6839","nonce":383637208}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24581":{"gid":24581,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.135:6839/1254769802","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6838","nonce":1254769802},{"type":"v1","addr":"172.21.15.135:6839","nonce":1254769802}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24581,"qdb_cluster":[24581,24568,24553]},"id":1}]} 2024-09-10T22:34:46.393 INFO:teuthology.orchestra.run.smithi019.stderr:dumped fsmap epoch 27 2024-09-10T22:34:46.401 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:46.399+0000 7f671fcf4640 1 -- 172.21.15.19:0/1072310518 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f67040b52e0 msgr2=0x7f67040b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:34:46.401 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:46.399+0000 7f671fcf4640 1 --2- 172.21.15.19:0/1072310518 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f67040b52e0 0x7f67040b77a0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f671810e7c0 tx=0x7f6708005f90 comp rx=0 tx=0).stop 2024-09-10T22:34:46.401 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:46.399+0000 7f671fcf4640 1 -- 172.21.15.19:0/1072310518 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6718103cd0 msgr2=0x7f671819b480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:34:46.402 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:46.399+0000 7f671fcf4640 1 --2- 172.21.15.19:0/1072310518 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6718103cd0 0x7f671819b480 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7f671400d950 tx=0x7f671400de10 comp rx=0 tx=0).stop 2024-09-10T22:34:46.402 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:46.399+0000 7f671fcf4640 1 -- 172.21.15.19:0/1072310518 shutdown_connections 2024-09-10T22:34:46.402 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:46.399+0000 7f671fcf4640 1 --2- 172.21.15.19:0/1072310518 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f67040b52e0 0x7f67040b77a0 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:34:46.402 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:46.399+0000 7f671fcf4640 1 --2- 172.21.15.19:0/1072310518 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f671810d130 0x7f67181a0d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:34:46.402 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:46.399+0000 7f671fcf4640 1 --2- 172.21.15.19:0/1072310518 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f67181045f0 0x7f671819b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:34:46.402 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:46.399+0000 7f671fcf4640 1 --2- 172.21.15.19:0/1072310518 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6718103cd0 0x7f671819b480 unknown :-1 s=CLOSED pgs=744 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:34:46.402 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:46.399+0000 7f671fcf4640 1 -- 172.21.15.19:0/1072310518 >> 172.21.15.19:0/1072310518 conn(0x7f67180fd770 msgr2=0x7f671810f390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:34:46.403 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:46.400+0000 7f671fcf4640 1 -- 172.21.15.19:0/1072310518 shutdown_connections 2024-09-10T22:34:46.403 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:46.400+0000 7f671fcf4640 1 -- 172.21.15.19:0/1072310518 wait complete. 2024-09-10T22:34:47.189 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 22997a4c-6fc2-11ef-bcea-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-09-10T22:34:47.360 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:34:47 smithi135 ceph-mon[34789]: from='client.? 172.21.15.19:0/1072310518' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T22:34:47.375 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:34:47 smithi138 ceph-mon[35236]: from='client.? 172.21.15.19:0/1072310518' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T22:34:47.458 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:34:47 smithi019 ceph-mon[31375]: from='client.? 172.21.15.19:0/1072310518' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T22:34:47.562 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/22997a4c-6fc2-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T22:34:48.214 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:48.125+0000 7efd0ab43640 1 -- 172.21.15.19:0/1918391480 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7efd04103ca0 msgr2=0x7efd04104080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:34:48.214 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:48.125+0000 7efd0ab43640 1 --2- 172.21.15.19:0/1918391480 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7efd04103ca0 0x7efd04104080 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7efcf8009900 tx=0x7efcf802a410 comp rx=0 tx=0).stop 2024-09-10T22:34:48.214 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:48.125+0000 7efd0ab43640 1 -- 172.21.15.19:0/1918391480 shutdown_connections 2024-09-10T22:34:48.215 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:48.125+0000 7efd0ab43640 1 --2- 172.21.15.19:0/1918391480 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7efd0410d100 0x7efd0410f560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:34:48.215 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:48.125+0000 7efd0ab43640 1 --2- 172.21.15.19:0/1918391480 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efd041045c0 0x7efd0410cab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:34:48.215 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:48.125+0000 7efd0ab43640 1 --2- 172.21.15.19:0/1918391480 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7efd04103ca0 0x7efd04104080 unknown :-1 s=CLOSED pgs=745 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:34:48.215 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:48.125+0000 7efd0ab43640 1 -- 172.21.15.19:0/1918391480 >> 172.21.15.19:0/1918391480 conn(0x7efd040fd700 msgr2=0x7efd040ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:34:48.215 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:48.126+0000 7efd0ab43640 1 -- 172.21.15.19:0/1918391480 shutdown_connections 2024-09-10T22:34:48.215 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:48.126+0000 7efd0ab43640 1 -- 172.21.15.19:0/1918391480 wait complete. 2024-09-10T22:34:48.215 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:48.126+0000 7efd0ab43640 1 Processor -- start 2024-09-10T22:34:48.215 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:48.126+0000 7efd0ab43640 1 -- start start 2024-09-10T22:34:48.215 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:48.127+0000 7efd0ab43640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7efd04103ca0 0x7efd04199290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:34:48.215 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:48.127+0000 7efd0ab43640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efd041045c0 0x7efd041997d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:34:48.215 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:48.127+0000 7efd0ab43640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7efd0410d100 0x7efd0419eb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:34:48.215 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:48.127+0000 7efd0ab43640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7efd04112dc0 con 0x7efd0410d100 2024-09-10T22:34:48.216 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:48.127+0000 7efd0ab43640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7efd04112c40 con 0x7efd041045c0 2024-09-10T22:34:48.216 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:48.127+0000 7efd0ab43640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7efd04112f40 con 0x7efd04103ca0 2024-09-10T22:34:48.216 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:48.127+0000 7efd03fff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efd041045c0 0x7efd041997d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:34:48.216 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:48.127+0000 7efd090e0640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7efd0410d100 0x7efd0419eb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:34:48.216 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:48.127+0000 7efd03fff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efd041045c0 0x7efd041997d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.19:56392/0 (socket says 172.21.15.19:56392) 2024-09-10T22:34:48.216 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:48.127+0000 7efd03fff640 1 -- 172.21.15.19:0/64313062 learned_addr learned my addr 172.21.15.19:0/64313062 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:34:48.216 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:48.127+0000 7efd088df640 1 --2- 172.21.15.19:0/64313062 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7efd04103ca0 0x7efd04199290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:34:48.216 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:48.127+0000 7efd03fff640 1 -- 172.21.15.19:0/64313062 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7efd04103ca0 msgr2=0x7efd04199290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:34:48.216 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:48.127+0000 7efd03fff640 1 --2- 172.21.15.19:0/64313062 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7efd04103ca0 0x7efd04199290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:34:48.216 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:48.127+0000 7efd03fff640 1 -- 172.21.15.19:0/64313062 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7efd0410d100 msgr2=0x7efd0419eb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:34:48.216 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:48.127+0000 7efd03fff640 1 --2- 172.21.15.19:0/64313062 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7efd0410d100 0x7efd0419eb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:34:48.216 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:48.127+0000 7efd03fff640 1 -- 172.21.15.19:0/64313062 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efd0419f340 con 0x7efd041045c0 2024-09-10T22:34:48.217 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:48.127+0000 7efd090e0640 1 --2- 172.21.15.19:0/64313062 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7efd0410d100 0x7efd0419eb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T22:34:48.217 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:48.127+0000 7efd088df640 1 --2- 172.21.15.19:0/64313062 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7efd04103ca0 0x7efd04199290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T22:34:48.217 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:48.128+0000 7efd03fff640 1 --2- 172.21.15.19:0/64313062 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efd041045c0 0x7efd041997d0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7efcf000e9c0 tx=0x7efcf000ee80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:34:48.217 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:48.128+0000 7efd01ffb640 1 -- 172.21.15.19:0/64313062 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efcf000ccc0 con 0x7efd041045c0 2024-09-10T22:34:48.217 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:48.128+0000 7efd01ffb640 1 -- 172.21.15.19:0/64313062 <== mon.2 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7efcf00035f0 con 0x7efd041045c0 2024-09-10T22:34:48.217 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:48.128+0000 7efd01ffb640 1 -- 172.21.15.19:0/64313062 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efcf000ce60 con 0x7efd041045c0 2024-09-10T22:34:48.217 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:48.128+0000 7efd0ab43640 1 -- 172.21.15.19:0/64313062 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efd0419f630 con 0x7efd041045c0 2024-09-10T22:34:48.217 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:48.128+0000 7efd0ab43640 1 -- 172.21.15.19:0/64313062 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efd041a5ec0 con 0x7efd041045c0 2024-09-10T22:34:48.217 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:48.130+0000 7efd01ffb640 1 -- 172.21.15.19:0/64313062 <== mon.2 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 18) ==== 153250+0+0 (secure 0 0 0) 0x7efcf0004020 con 0x7efd041045c0 2024-09-10T22:34:48.217 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:48.131+0000 7efd0cf18740 1 Processor -- start 2024-09-10T22:34:48.217 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:48.131+0000 7efd0cf18740 1 -- start start 2024-09-10T22:34:48.217 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:48.131+0000 7efd0cf18740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564b686d90f0 0x564b686d94d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:34:48.217 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:48.132+0000 7efd0cf18740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x564b686d9a10 0x564b686e5460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:34:48.218 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:48.132+0000 7efd0cf18740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x564b686e59a0 0x564b686e7d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:34:48.218 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:48.132+0000 7efd0cf18740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x564b6864fea0 con 0x564b686d9a10 2024-09-10T22:34:48.218 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:48.132+0000 7efd0cf18740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x564b6863f2d0 con 0x564b686d90f0 2024-09-10T22:34:48.218 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:48.132+0000 7efd0cf18740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x564b686430e0 con 0x564b686e59a0 2024-09-10T22:34:48.218 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:48.132+0000 7efd090e0640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564b686d90f0 0x564b686d94d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:34:48.218 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:48.132+0000 7efd03fff640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x564b686e59a0 0x564b686e7d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:34:48.218 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:48.132+0000 7efd090e0640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564b686d90f0 0x564b686d94d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.19:56406/0 (socket says 172.21.15.19:56406) 2024-09-10T22:34:48.218 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:48.132+0000 7efd090e0640 1 -- 172.21.15.19:0/498759775 learned_addr learned my addr 172.21.15.19:0/498759775 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:34:48.218 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:48.132+0000 7efd088df640 1 --2- 172.21.15.19:0/498759775 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x564b686d9a10 0x564b686e5460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:34:48.218 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:48.132+0000 7efd01ffb640 1 --2- 172.21.15.19:0/64313062 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7efcf40b5360 0x7efcf40b7820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:34:48.219 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:48.132+0000 7efd090e0640 1 --2- 172.21.15.19:0/64313062 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7efcf40b5360 0x7efcf40b7820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:34:48.219 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:48.132+0000 7efd03fff640 1 -- 172.21.15.19:0/498759775 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564b686d90f0 msgr2=0x564b686d94d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:34:48.219 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:48.132+0000 7efd03fff640 1 --2- 172.21.15.19:0/498759775 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564b686d90f0 0x564b686d94d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:34:48.219 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:48.132+0000 7efd03fff640 1 -- 172.21.15.19:0/498759775 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x564b686d9a10 msgr2=0x564b686e5460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:34:48.219 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:48.132+0000 7efd03fff640 1 --2- 172.21.15.19:0/498759775 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x564b686d9a10 0x564b686e5460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:34:48.219 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:48.132+0000 7efd03fff640 1 -- 172.21.15.19:0/498759775 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564b6839d650 con 0x564b686e59a0 2024-09-10T22:34:48.219 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:48.132+0000 7efd090e0640 1 --2- 172.21.15.19:0/498759775 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564b686d90f0 0x564b686d94d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T22:34:48.219 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:48.132+0000 7efd01ffb640 1 -- 172.21.15.19:0/64313062 <== mon.2 v2:172.21.15.135:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8327+0+0 (secure 0 0 0) 0x7efcf00e5e60 con 0x7efd041045c0 2024-09-10T22:34:48.219 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:48.133+0000 7efd03fff640 1 --2- 172.21.15.19:0/498759775 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x564b686e59a0 0x564b686e7d90 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7efcf00e3950 tx=0x7efcf0020000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c8909cae79fdf429 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:34:48.219 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:48.133+0000 7efd090e0640 1 --2- 172.21.15.19:0/64313062 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7efcf40b5360 0x7efcf40b7820 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7efcfc009fd0 tx=0x7efcfc004ab0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:34:48.220 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:48.133+0000 7efceeffd640 1 -- 172.21.15.19:0/498759775 <== mon.1 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efcf001c1c0 con 0x564b686e59a0 2024-09-10T22:34:48.220 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:48.133+0000 7efceeffd640 1 -- 172.21.15.19:0/498759775 <== mon.1 v2:172.21.15.138:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7efcf00ac0d0 con 0x564b686e59a0 2024-09-10T22:34:48.220 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:48.133+0000 7efceeffd640 1 -- 172.21.15.19:0/498759775 <== mon.1 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efcf000a250 con 0x564b686e59a0 2024-09-10T22:34:48.220 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:48.134+0000 7efd0cf18740 1 -- 172.21.15.19:0/498759775 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x564b686e59a0 msgr2=0x564b686e7d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:34:48.220 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:48.134+0000 7efd0cf18740 1 --2- 172.21.15.19:0/498759775 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x564b686e59a0 0x564b686e7d90 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7efcf00e3950 tx=0x7efcf0020000 comp rx=0 tx=0).stop 2024-09-10T22:34:48.220 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:48.134+0000 7efd0cf18740 1 -- 172.21.15.19:0/498759775 shutdown_connections 2024-09-10T22:34:48.220 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:48.134+0000 7efd0cf18740 1 --2- 172.21.15.19:0/498759775 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x564b686e59a0 0x564b686e7d90 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:34:48.220 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:48.134+0000 7efd0cf18740 1 --2- 172.21.15.19:0/498759775 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x564b686d9a10 0x564b686e5460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:34:48.220 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:48.134+0000 7efd0cf18740 1 --2- 172.21.15.19:0/498759775 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564b686d90f0 0x564b686d94d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:34:48.220 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:48.134+0000 7efd0cf18740 1 -- 172.21.15.19:0/498759775 >> 172.21.15.19:0/498759775 conn(0x564b686d6f20 msgr2=0x564b686d80c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:34:48.220 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:48.134+0000 7efd0cf18740 1 -- 172.21.15.19:0/498759775 shutdown_connections 2024-09-10T22:34:48.220 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:48.134+0000 7efd0cf18740 1 -- 172.21.15.19:0/498759775 wait complete. 2024-09-10T22:34:48.220 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:48.134+0000 7efd0cf18740 1 -- start start 2024-09-10T22:34:48.221 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:48.135+0000 7efd0cf18740 1 Processor -- start 2024-09-10T22:34:48.221 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:48.135+0000 7efd0cf18740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564b686d90f0 0x564b686e52b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:34:48.221 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:48.135+0000 7efd0cf18740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x564b686d9a10 0x564b686e2700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:34:48.221 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:48.135+0000 7efd0cf18740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x564b686e59a0 0x564b686e2d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:34:48.221 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:48.135+0000 7efd0cf18740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x564b684a0700 con 0x564b686e59a0 2024-09-10T22:34:48.221 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:48.135+0000 7efd0cf18740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x564b685da160 con 0x564b686d90f0 2024-09-10T22:34:48.221 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:48.135+0000 7efd0cf18740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x564b686ec9d0 con 0x564b686d9a10 2024-09-10T22:34:48.221 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:48.135+0000 7efd0cf18740 10 client.0 _ll_register_callbacks cb 0x564b685f39e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T22:34:48.221 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:48.135+0000 7efd03fff640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x564b686d9a10 0x564b686e2700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:34:48.221 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:48.135+0000 7efd090e0640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x564b686e59a0 0x564b686e2d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:34:48.222 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:48.135+0000 7efd03fff640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x564b686d9a10 0x564b686e2700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.19:58164/0 (socket says 172.21.15.19:58164) 2024-09-10T22:34:48.222 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:48.135+0000 7efd03fff640 1 -- 172.21.15.19:0/4194390654 learned_addr learned my addr 172.21.15.19:0/4194390654 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:34:48.222 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:48.135+0000 7efd088df640 1 --2- 172.21.15.19:0/4194390654 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564b686d90f0 0x564b686e52b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:34:48.222 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:48.136+0000 7efd03fff640 1 -- 172.21.15.19:0/4194390654 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564b686d90f0 msgr2=0x564b686e52b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:34:48.222 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:48.136+0000 7efd03fff640 1 --2- 172.21.15.19:0/4194390654 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564b686d90f0 0x564b686e52b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:34:48.222 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:48.136+0000 7efd03fff640 1 -- 172.21.15.19:0/4194390654 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x564b686e59a0 msgr2=0x564b686e2d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:34:48.222 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:48.136+0000 7efd03fff640 1 --2- 172.21.15.19:0/4194390654 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x564b686e59a0 0x564b686e2d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:34:48.222 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:48.136+0000 7efd03fff640 1 -- 172.21.15.19:0/4194390654 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564b68607c90 con 0x564b686d9a10 2024-09-10T22:34:48.222 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:48.136+0000 7efd03fff640 1 --2- 172.21.15.19:0/4194390654 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x564b686d9a10 0x564b686e2700 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7efcf00a8b90 tx=0x7efcf0009740 comp rx=0 tx=0).ready entity=mon.1 client_cookie=508aa7183b96ee26 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:34:48.222 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:48.136+0000 7efce3fff640 10 client.0 ms_handle_connect on v2:172.21.15.138:3300/0 2024-09-10T22:34:48.222 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:48.136+0000 7efce3fff640 1 -- 172.21.15.19:0/4194390654 <== mon.1 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efcf000a900 con 0x564b686d9a10 2024-09-10T22:34:48.222 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:48.136+0000 7efce3fff640 1 -- 172.21.15.19:0/4194390654 <== mon.1 v2:172.21.15.138:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8327+0+0 (secure 0 0 0) 0x7efcf0003a50 con 0x564b686d9a10 2024-09-10T22:34:48.223 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:48.136+0000 7efd0cf18740 1 -- 172.21.15.19:0/4194390654 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7efcf00ac0d0 con 0x564b686d9a10 2024-09-10T22:34:48.223 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:48.136+0000 7efce3fff640 1 -- 172.21.15.19:0/4194390654 <== mon.1 v2:172.21.15.138:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7efcf00ac5c0 con 0x564b686d9a10 2024-09-10T22:34:48.223 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:48.136+0000 7efd0cf18740 10 client.26374 fetch_fsmap learned FSMap version 27 2024-09-10T22:34:48.223 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:48.137+0000 7efd0cf18740 1 -- 172.21.15.19:0/4194390654 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x564b686f8330 con 0x564b686d9a10 2024-09-10T22:34:48.223 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:48.137+0000 7efce3fff640 1 -- 172.21.15.19:0/4194390654 <== mon.1 v2:172.21.15.138:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7efcf00b10a0 con 0x564b686d9a10 2024-09-10T22:34:48.223 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:48.137+0000 7efce3fff640 1 -- 172.21.15.19:0/4194390654 <== mon.1 v2:172.21.15.138:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7efcf00a8110 con 0x564b686d9a10 2024-09-10T22:34:48.223 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:48.137+0000 7efd0cf18740 10 client.26374 fetch_fsmap finished waiting for FSMap version 27 2024-09-10T22:34:48.223 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:48.137+0000 7efd0cf18740 10 client.26374 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-10T22:34:48.223 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:48.137+0000 7efd0cf18740 20 client.26374 populate_metadata read hostname 'smithi019' 2024-09-10T22:34:48.224 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:48.137+0000 7efd0cf18740 1 --2- 172.21.15.19:0/4194390654 >> [v2:172.21.15.138:6836/3353290042,v1:172.21.15.138:6837/3353290042] conn(0x564b686f9680 0x564b686fba70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:34:48.224 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:48.137+0000 7efd0cf18740 4 client.26374 mds_command: new command op to 24553 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T22:34:48.224 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:48.137+0000 7efd0cf18740 1 -- 172.21.15.19:0/4194390654 --> [v2:172.21.15.138:6836/3353290042,v1:172.21.15.138:6837/3353290042] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7efcf00ac0d0 con 0x564b686f9680 2024-09-10T22:34:48.224 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:48.137+0000 7efd088df640 1 --2- 172.21.15.19:0/4194390654 >> [v2:172.21.15.138:6836/3353290042,v1:172.21.15.138:6837/3353290042] conn(0x564b686f9680 0x564b686fba70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:34:48.224 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:48.138+0000 7efce3fff640 10 client.26374 ms_handle_connect on v2:172.21.15.138:6836/3353290042 2024-09-10T22:34:48.224 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:48.138+0000 7efd088df640 1 --2- 172.21.15.19:0/4194390654 >> [v2:172.21.15.138:6836/3353290042,v1:172.21.15.138:6837/3353290042] conn(0x564b686f9680 0x564b686fba70 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=66352c6ac124c7 server_cookie=968bae427e8eccb0 in_seq=0 out_seq=0 2024-09-10T22:34:48.224 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:48.138+0000 7efce3fff640 1 -- 172.21.15.19:0/4194390654 <== mds.2 v2:172.21.15.138:6836/3353290042 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x7efcf00ac0d0 con 0x564b686f9680 2024-09-10T22:34:48.224 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:48.138+0000 7efce3fff640 10 client.26374 handle_command_reply: tid=0 2024-09-10T22:34:48.224 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:48.138+0000 7efd0cf18740 1 client.26374 shutdown 2024-09-10T22:34:48.224 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:48.139+0000 7efd0cf18740 1 -- 172.21.15.19:0/4194390654 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x564b686d9a10 msgr2=0x564b686e2700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:34:48.224 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:48.139+0000 7efd0cf18740 1 --2- 172.21.15.19:0/4194390654 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x564b686d9a10 0x564b686e2700 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7efcf00a8b90 tx=0x7efcf0009740 comp rx=0 tx=0).stop 2024-09-10T22:34:48.224 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:48.139+0000 7efd0cf18740 1 -- 172.21.15.19:0/4194390654 shutdown_connections 2024-09-10T22:34:48.225 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:48.139+0000 7efd0cf18740 1 --2- 172.21.15.19:0/4194390654 >> [v2:172.21.15.138:6836/3353290042,v1:172.21.15.138:6837/3353290042] conn(0x564b686f9680 0x564b686fba70 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:34:48.225 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:48.139+0000 7efd0cf18740 1 --2- 172.21.15.19:0/4194390654 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x564b686e59a0 0x564b686e2d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:34:48.225 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:48.139+0000 7efd0cf18740 1 --2- 172.21.15.19:0/4194390654 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x564b686d9a10 0x564b686e2700 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:34:48.225 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:48.139+0000 7efce3fff640 0 client.26374 ms_handle_reset on v2:172.21.15.138:6836/3353290042 2024-09-10T22:34:48.225 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:48.139+0000 7efd0cf18740 1 --2- 172.21.15.19:0/4194390654 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564b686d90f0 0x564b686e52b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:34:48.225 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:48.139+0000 7efd0cf18740 1 -- 172.21.15.19:0/4194390654 >> 172.21.15.19:0/4194390654 conn(0x564b686d6f20 msgr2=0x564b686dcac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:34:48.225 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:48.139+0000 7efd0cf18740 1 -- 172.21.15.19:0/4194390654 shutdown_connections 2024-09-10T22:34:48.225 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:48.139+0000 7efd0cf18740 1 -- 172.21.15.19:0/4194390654 wait complete. 2024-09-10T22:34:48.225 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:48.139+0000 7efd0cf18740 20 client.26374 trim_cache size 0 max 16384 2024-09-10T22:34:48.226 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:48.154+0000 7efd0cf18740 1 Processor -- start 2024-09-10T22:34:48.226 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:48.154+0000 7efd0cf18740 1 -- start start 2024-09-10T22:34:48.226 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:48.155+0000 7efd0cf18740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x564b686d90f0 0x564b686d85e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:34:48.226 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:48.155+0000 7efd0cf18740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564b686d9a10 0x564b686dd030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:34:48.226 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:48.155+0000 7efd0cf18740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x564b686e59a0 0x564b686d5e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:34:48.226 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:48.155+0000 7efd090e0640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x564b686e59a0 0x564b686d5e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:34:48.226 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:48.155+0000 7efd03fff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564b686d9a10 0x564b686dd030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:34:48.226 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:48.155+0000 7efd088df640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x564b686d90f0 0x564b686d85e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:34:48.226 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:48.155+0000 7efd090e0640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x564b686e59a0 0x564b686d5e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:49598/0 (socket says 172.21.15.19:49598) 2024-09-10T22:34:48.226 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:48.155+0000 7efd088df640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x564b686d90f0 0x564b686d85e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.19:58170/0 (socket says 172.21.15.19:58170) 2024-09-10T22:34:48.226 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:48.155+0000 7efd088df640 1 -- 172.21.15.19:0/415379826 learned_addr learned my addr 172.21.15.19:0/415379826 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:34:48.226 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:48.155+0000 7efd03fff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564b686d9a10 0x564b686dd030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.19:56420/0 (socket says 172.21.15.19:56420) 2024-09-10T22:34:48.226 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:48.155+0000 7efd0cf18740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7efd041aec10 con 0x564b686e59a0 2024-09-10T22:34:48.227 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:48.155+0000 7efd0cf18740 1 -- 172.21.15.19:0/415379826 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7efd041ac4e0 con 0x564b686d9a10 2024-09-10T22:34:48.227 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:48.155+0000 7efd0cf18740 1 -- 172.21.15.19:0/415379826 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7efd041aa330 con 0x564b686d90f0 2024-09-10T22:34:48.227 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:48.155+0000 7efd088df640 1 -- 172.21.15.19:0/415379826 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564b686d9a10 msgr2=0x564b686dd030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:34:48.227 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:48.155+0000 7efd088df640 1 --2- 172.21.15.19:0/415379826 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564b686d9a10 0x564b686dd030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:34:48.227 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:48.155+0000 7efd088df640 1 -- 172.21.15.19:0/415379826 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x564b686e59a0 msgr2=0x564b686d5e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:34:48.227 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:48.155+0000 7efd088df640 1 --2- 172.21.15.19:0/415379826 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x564b686e59a0 0x564b686d5e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:34:48.227 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:48.155+0000 7efd088df640 1 -- 172.21.15.19:0/415379826 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564b686e24b0 con 0x564b686d90f0 2024-09-10T22:34:48.227 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:48.155+0000 7efd03fff640 1 --2- 172.21.15.19:0/415379826 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564b686d9a10 0x564b686dd030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T22:34:48.227 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:48.156+0000 7efd088df640 1 --2- 172.21.15.19:0/415379826 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x564b686d90f0 0x564b686d85e0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7efcf8009900 tx=0x7efcf80095d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3642d0dd6032737c server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:34:48.227 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:48.156+0000 7efcee7fc640 1 -- 172.21.15.19:0/415379826 <== mon.1 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efcf8035040 con 0x564b686d90f0 2024-09-10T22:34:48.227 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:48.156+0000 7efcee7fc640 1 -- 172.21.15.19:0/415379826 <== mon.1 v2:172.21.15.138:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7efcf8005610 con 0x564b686d90f0 2024-09-10T22:34:48.227 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:48.156+0000 7efcee7fc640 1 -- 172.21.15.19:0/415379826 <== mon.1 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efcf8003850 con 0x564b686d90f0 2024-09-10T22:34:48.227 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:48.157+0000 7efd0cf18740 1 -- 172.21.15.19:0/415379826 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x564b686d90f0 msgr2=0x564b686d85e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:34:48.228 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:48.157+0000 7efd0cf18740 1 --2- 172.21.15.19:0/415379826 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x564b686d90f0 0x564b686d85e0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7efcf8009900 tx=0x7efcf80095d0 comp rx=0 tx=0).stop 2024-09-10T22:34:48.228 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:48.157+0000 7efd0cf18740 1 -- 172.21.15.19:0/415379826 shutdown_connections 2024-09-10T22:34:48.228 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:48.157+0000 7efd0cf18740 1 --2- 172.21.15.19:0/415379826 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x564b686e59a0 0x564b686d5e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:34:48.228 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:48.157+0000 7efd0cf18740 1 --2- 172.21.15.19:0/415379826 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564b686d9a10 0x564b686dd030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:34:48.228 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:48.157+0000 7efd0cf18740 1 --2- 172.21.15.19:0/415379826 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x564b686d90f0 0x564b686d85e0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:34:48.228 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:48.157+0000 7efd0cf18740 1 -- 172.21.15.19:0/415379826 >> 172.21.15.19:0/415379826 conn(0x564b686d6f20 msgr2=0x564b686d5750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:34:48.228 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:48.157+0000 7efd0cf18740 1 -- 172.21.15.19:0/415379826 shutdown_connections 2024-09-10T22:34:48.228 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:48.157+0000 7efd0cf18740 1 -- 172.21.15.19:0/415379826 wait complete. 2024-09-10T22:34:48.228 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:48.157+0000 7efd0cf18740 1 -- start start 2024-09-10T22:34:48.228 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:48.157+0000 7efd0cf18740 1 Processor -- start 2024-09-10T22:34:48.228 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:48.158+0000 7efd0cf18740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564b686d90f0 0x564b686fefb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:34:48.228 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:48.158+0000 7efd0cf18740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x564b686d9a10 0x564b686fb490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:34:48.228 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:48.158+0000 7efd0cf18740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x564b686e59a0 0x564b686fb9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:34:48.229 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:48.158+0000 7efd0cf18740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7efd041aa9a0 con 0x564b686d9a10 2024-09-10T22:34:48.229 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:48.158+0000 7efd0cf18740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7efd041abe10 con 0x564b686d90f0 2024-09-10T22:34:48.229 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:48.158+0000 7efd0cf18740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7efd041ab070 con 0x564b686e59a0 2024-09-10T22:34:48.229 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:48.158+0000 7efd0cf18740 10 client.0 _ll_register_callbacks cb 0x7efcfc0093a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T22:34:48.229 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:48.158+0000 7efd03fff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x564b686d9a10 0x564b686fb490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:34:48.229 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:48.158+0000 7efd090e0640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x564b686e59a0 0x564b686fb9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:34:48.229 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:48.158+0000 7efd088df640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564b686d90f0 0x564b686fefb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:34:48.229 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:48.158+0000 7efd090e0640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x564b686e59a0 0x564b686fb9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.19:58186/0 (socket says 172.21.15.19:58186) 2024-09-10T22:34:48.229 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:48.158+0000 7efd088df640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564b686d90f0 0x564b686fefb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.19:56422/0 (socket says 172.21.15.19:56422) 2024-09-10T22:34:48.229 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:48.158+0000 7efd090e0640 1 -- 172.21.15.19:0/3392728680 learned_addr learned my addr 172.21.15.19:0/3392728680 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:34:48.229 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:48.158+0000 7efd03fff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x564b686d9a10 0x564b686fb490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:49602/0 (socket says 172.21.15.19:49602) 2024-09-10T22:34:48.229 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:48.158+0000 7efd090e0640 1 -- 172.21.15.19:0/3392728680 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564b686d90f0 msgr2=0x564b686fefb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:34:48.230 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:48.158+0000 7efd090e0640 1 --2- 172.21.15.19:0/3392728680 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564b686d90f0 0x564b686fefb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:34:48.230 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:48.158+0000 7efd090e0640 1 -- 172.21.15.19:0/3392728680 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x564b686d9a10 msgr2=0x564b686fb490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:34:48.230 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:48.158+0000 7efd090e0640 1 --2- 172.21.15.19:0/3392728680 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x564b686d9a10 0x564b686fb490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:34:48.230 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:48.158+0000 7efd090e0640 1 -- 172.21.15.19:0/3392728680 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564b686fbf60 con 0x564b686e59a0 2024-09-10T22:34:48.230 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:48.158+0000 7efd090e0640 1 --2- 172.21.15.19:0/3392728680 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x564b686e59a0 0x564b686fb9d0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7efcfc013880 tx=0x7efcfc004a40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9e6c7f495081d5cb server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:34:48.230 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:48.158+0000 7efce3fff640 10 client.0 ms_handle_connect on v2:172.21.15.138:3300/0 2024-09-10T22:34:48.230 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:48.159+0000 7efce3fff640 1 -- 172.21.15.19:0/3392728680 <== mon.1 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efcfc019070 con 0x564b686e59a0 2024-09-10T22:34:48.230 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:48.159+0000 7efce3fff640 1 -- 172.21.15.19:0/3392728680 <== mon.1 v2:172.21.15.138:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8327+0+0 (secure 0 0 0) 0x7efcfc010430 con 0x564b686e59a0 2024-09-10T22:34:48.230 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:48.159+0000 7efd0cf18740 1 -- 172.21.15.19:0/3392728680 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7efcf8005610 con 0x564b686e59a0 2024-09-10T22:34:48.230 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:48.159+0000 7efce3fff640 1 -- 172.21.15.19:0/3392728680 <== mon.1 v2:172.21.15.138:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7efcfc010630 con 0x564b686e59a0 2024-09-10T22:34:48.230 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:48.159+0000 7efd0cf18740 10 client.26380 fetch_fsmap learned FSMap version 27 2024-09-10T22:34:48.230 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:48.159+0000 7efd0cf18740 1 -- 172.21.15.19:0/3392728680 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x564b68767010 con 0x564b686e59a0 2024-09-10T22:34:48.230 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:48.159+0000 7efce3fff640 1 -- 172.21.15.19:0/3392728680 <== mon.1 v2:172.21.15.138:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7efcf8005610 con 0x564b686e59a0 2024-09-10T22:34:48.230 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:48.159+0000 7efce3fff640 1 -- 172.21.15.19:0/3392728680 <== mon.1 v2:172.21.15.138:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7efcfc02d790 con 0x564b686e59a0 2024-09-10T22:34:48.231 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:48.159+0000 7efd0cf18740 10 client.26380 fetch_fsmap finished waiting for FSMap version 27 2024-09-10T22:34:48.231 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:48.159+0000 7efd0cf18740 10 client.26380 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-10T22:34:48.231 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:48.159+0000 7efd0cf18740 20 client.26380 populate_metadata read hostname 'smithi019' 2024-09-10T22:34:48.231 INFO:teuthology.orchestra.run.smithi019.stdout:[] 2024-09-10T22:34:48.231 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:48.159+0000 7efd0cf18740 1 --2- 172.21.15.19:0/3392728680 >> [v2:172.21.15.138:6836/3353290042,v1:172.21.15.138:6837/3353290042] conn(0x564b687677f0 0x564b68769c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:34:48.231 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:48.159+0000 7efd0cf18740 4 client.26380 mds_command: new command op to 24553 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-10T22:34:48.231 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:48.159+0000 7efd0cf18740 1 -- 172.21.15.19:0/3392728680 --> [v2:172.21.15.138:6836/3353290042,v1:172.21.15.138:6837/3353290042] -- command(tid 0: {"prefix": "damage ls"}) -- 0x564b68651df0 con 0x564b687677f0 2024-09-10T22:34:48.231 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:48.159+0000 7efd088df640 1 --2- 172.21.15.19:0/3392728680 >> [v2:172.21.15.138:6836/3353290042,v1:172.21.15.138:6837/3353290042] conn(0x564b687677f0 0x564b68769c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:34:48.232 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:48.160+0000 7efce3fff640 10 client.26380 ms_handle_connect on v2:172.21.15.138:6836/3353290042 2024-09-10T22:34:48.232 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:48.160+0000 7efd088df640 1 --2- 172.21.15.19:0/3392728680 >> [v2:172.21.15.138:6836/3353290042,v1:172.21.15.138:6837/3353290042] conn(0x564b687677f0 0x564b68769c10 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=11292c64879e95ce server_cookie=3b488b07c21e086c in_seq=0 out_seq=0 2024-09-10T22:34:48.232 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:48.160+0000 7efce3fff640 1 -- 172.21.15.19:0/3392728680 <== mds.2 v2:172.21.15.138:6836/3353290042 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x564b68651df0 con 0x564b687677f0 2024-09-10T22:34:48.232 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:48.160+0000 7efce3fff640 10 client.26380 handle_command_reply: tid=0 2024-09-10T22:34:48.232 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:48.160+0000 7efd0cf18740 1 client.26380 shutdown 2024-09-10T22:34:48.232 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:48.160+0000 7efd0cf18740 1 -- 172.21.15.19:0/3392728680 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x564b686e59a0 msgr2=0x564b686fb9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:34:48.232 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:48.160+0000 7efd0cf18740 1 --2- 172.21.15.19:0/3392728680 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x564b686e59a0 0x564b686fb9d0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7efcfc013880 tx=0x7efcfc004a40 comp rx=0 tx=0).stop 2024-09-10T22:34:48.232 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:48.160+0000 7efd0cf18740 1 -- 172.21.15.19:0/3392728680 shutdown_connections 2024-09-10T22:34:48.232 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:48.160+0000 7efd0cf18740 1 --2- 172.21.15.19:0/3392728680 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x564b686e59a0 0x564b686fb9d0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:34:48.232 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:48.160+0000 7efd0cf18740 1 --2- 172.21.15.19:0/3392728680 >> [v2:172.21.15.138:6836/3353290042,v1:172.21.15.138:6837/3353290042] conn(0x564b687677f0 0x564b68769c10 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:34:48.232 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:48.160+0000 7efd0cf18740 1 --2- 172.21.15.19:0/3392728680 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x564b686d9a10 0x564b686fb490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:34:48.232 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:48.160+0000 7efce3fff640 0 client.26380 ms_handle_reset on v2:172.21.15.138:6836/3353290042 2024-09-10T22:34:48.233 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:48.160+0000 7efd0cf18740 1 --2- 172.21.15.19:0/3392728680 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564b686d90f0 0x564b686fefb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:34:48.233 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:48.160+0000 7efd0cf18740 1 -- 172.21.15.19:0/3392728680 >> 172.21.15.19:0/3392728680 conn(0x564b686d6f20 msgr2=0x564b686d84d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:34:48.233 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:48.161+0000 7efd0cf18740 1 -- 172.21.15.19:0/3392728680 shutdown_connections 2024-09-10T22:34:48.233 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:48.161+0000 7efd0cf18740 1 -- 172.21.15.19:0/3392728680 wait complete. 2024-09-10T22:34:48.233 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:48.161+0000 7efd0cf18740 20 client.26380 trim_cache size 0 max 16384 2024-09-10T22:34:48.233 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:48.161+0000 7efd0ab43640 1 -- 172.21.15.19:0/64313062 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7efcf40b5360 msgr2=0x7efcf40b7820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:34:48.233 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:48.161+0000 7efd0ab43640 1 --2- 172.21.15.19:0/64313062 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7efcf40b5360 0x7efcf40b7820 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7efcfc009fd0 tx=0x7efcfc004ab0 comp rx=0 tx=0).stop 2024-09-10T22:34:48.233 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:48.161+0000 7efd0ab43640 1 -- 172.21.15.19:0/64313062 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efd041045c0 msgr2=0x7efd041997d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:34:48.233 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:48.161+0000 7efd0ab43640 1 --2- 172.21.15.19:0/64313062 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efd041045c0 0x7efd041997d0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7efcf000e9c0 tx=0x7efcf000ee80 comp rx=0 tx=0).stop 2024-09-10T22:34:48.233 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:48.162+0000 7efd0ab43640 1 -- 172.21.15.19:0/64313062 shutdown_connections 2024-09-10T22:34:48.233 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:48.162+0000 7efd0ab43640 1 --2- 172.21.15.19:0/64313062 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7efcf40b5360 0x7efcf40b7820 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:34:48.233 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:48.162+0000 7efd0ab43640 1 --2- 172.21.15.19:0/64313062 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7efd0410d100 0x7efd0419eb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:34:48.233 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:48.162+0000 7efd0ab43640 1 --2- 172.21.15.19:0/64313062 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efd041045c0 0x7efd041997d0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:34:48.233 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:48.162+0000 7efd0ab43640 1 --2- 172.21.15.19:0/64313062 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7efd04103ca0 0x7efd04199290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:34:48.234 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:48.162+0000 7efd0ab43640 1 -- 172.21.15.19:0/64313062 >> 172.21.15.19:0/64313062 conn(0x7efd040fd700 msgr2=0x7efd040fe300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:34:48.234 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:48.162+0000 7efd0ab43640 1 -- 172.21.15.19:0/64313062 shutdown_connections 2024-09-10T22:34:48.234 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:48.162+0000 7efd0ab43640 1 -- 172.21.15.19:0/64313062 wait complete. 2024-09-10T22:34:48.375 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:34:48 smithi138 ceph-mon[35236]: pgmap v598: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 485 KiB/s rd, 305 MiB/s wr, 938 op/s 2024-09-10T22:34:48.459 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:34:48 smithi019 ceph-mon[31375]: pgmap v598: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 485 KiB/s rd, 305 MiB/s wr, 938 op/s 2024-09-10T22:34:48.610 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:34:48 smithi135 ceph-mon[34789]: pgmap v598: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 485 KiB/s rd, 305 MiB/s wr, 938 op/s 2024-09-10T22:34:49.000 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 22997a4c-6fc2-11ef-bcea-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-09-10T22:34:49.385 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/22997a4c-6fc2-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T22:34:49.630 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:49.628+0000 7fcc377fe640 1 -- 172.21.15.19:0/3148755644 <== mds.0 v2:172.21.15.135:6838/1254769802 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x561ff1c310f0 con 0x561ff1d441e0 2024-09-10T22:34:49.630 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:49.628+0000 7fcc377fe640 10 client.16989 handle_command_reply: tid=0 2024-09-10T22:34:49.630 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:49.628+0000 7fcc617f3740 1 client.16989 shutdown 2024-09-10T22:34:49.631 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:49.630+0000 7fcc617f3740 1 -- 172.21.15.19:0/3148755644 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x561ff1cc1860 msgr2=0x561ff1cd2ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:34:49.631 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:49.630+0000 7fcc617f3740 1 --2- 172.21.15.19:0/3148755644 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x561ff1cc1860 0x561ff1cd2ae0 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7fcc480e9760 tx=0x7fcc48004730 comp rx=0 tx=0).stop 2024-09-10T22:34:49.631 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:49.630+0000 7fcc617f3740 1 -- 172.21.15.19:0/3148755644 shutdown_connections 2024-09-10T22:34:49.632 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:49.630+0000 7fcc617f3740 1 --2- 172.21.15.19:0/3148755644 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561ff1cc6bd0 0x561ff1cd1e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:34:49.632 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:49.630+0000 7fcc617f3740 1 --2- 172.21.15.19:0/3148755644 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x561ff1d441e0 0x561ff1d46600 crc :-1 s=READY pgs=171 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:34:49.632 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:49.630+0000 7fcc617f3740 1 --2- 172.21.15.19:0/3148755644 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x561ff1cc4190 0x561ff1cd17e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:34:49.632 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:49.630+0000 7fcc617f3740 1 --2- 172.21.15.19:0/3148755644 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x561ff1cc1860 0x561ff1cd2ae0 unknown :-1 s=CLOSED pgs=742 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:34:49.632 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:49.630+0000 7fcc617f3740 1 -- 172.21.15.19:0/3148755644 >> 172.21.15.19:0/3148755644 conn(0x561ff1cbc9b0 msgr2=0x561ff1cc6fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:34:49.632 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:49.630+0000 7fcc377fe640 0 client.16989 ms_handle_reset on v2:172.21.15.135:6838/1254769802 2024-09-10T22:34:49.633 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:49.630+0000 7fcc617f3740 1 -- 172.21.15.19:0/3148755644 shutdown_connections 2024-09-10T22:34:49.633 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:49.631+0000 7fcc617f3740 1 -- 172.21.15.19:0/3148755644 wait complete. 2024-09-10T22:34:49.633 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:49.631+0000 7fcc617f3740 20 client.16989 trim_cache size 0 max 16384 2024-09-10T22:34:49.635 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stdout:{ 2024-09-10T22:34:49.635 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stdout: "message": "", 2024-09-10T22:34:49.635 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stdout: "return_code": 0 2024-09-10T22:34:49.635 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stdout:} 2024-09-10T22:34:49.636 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:49.634+0000 7fcc5ea2b640 1 -- 172.21.15.19:0/2826106109 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7fcc400b52e0 msgr2=0x7fcc400b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:34:49.636 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:49.634+0000 7fcc5ea2b640 1 --2- 172.21.15.19:0/2826106109 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7fcc400b52e0 0x7fcc400b77a0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7fcc50009fd0 tx=0x7fcc50009500 comp rx=0 tx=0).stop 2024-09-10T22:34:49.636 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:49.634+0000 7fcc5ea2b640 1 -- 172.21.15.19:0/2826106109 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fcc58075ac0 msgr2=0x7fcc5819af90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:34:49.636 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:49.634+0000 7fcc5ea2b640 1 --2- 172.21.15.19:0/2826106109 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fcc58075ac0 0x7fcc5819af90 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7fcc4800e9c0 tx=0x7fcc4800ee80 comp rx=0 tx=0).stop 2024-09-10T22:34:49.637 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:49.635+0000 7fcc5ea2b640 1 -- 172.21.15.19:0/2826106109 shutdown_connections 2024-09-10T22:34:49.637 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:49.635+0000 7fcc5ea2b640 1 --2- 172.21.15.19:0/2826106109 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7fcc400b52e0 0x7fcc400b77a0 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:34:49.637 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:49.635+0000 7fcc5ea2b640 1 --2- 172.21.15.19:0/2826106109 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fcc5810a910 0x7fcc5819c210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:34:49.637 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:49.635+0000 7fcc5ea2b640 1 --2- 172.21.15.19:0/2826106109 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcc58076f30 0x7fcc5819b5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:34:49.637 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:49.635+0000 7fcc5ea2b640 1 --2- 172.21.15.19:0/2826106109 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fcc58075ac0 0x7fcc5819af90 unknown :-1 s=CLOSED pgs=740 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:34:49.637 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:49.635+0000 7fcc5ea2b640 1 -- 172.21.15.19:0/2826106109 >> 172.21.15.19:0/2826106109 conn(0x7fcc580fe250 msgr2=0x7fcc580fe8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:34:49.637 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:49.635+0000 7fcc5ea2b640 1 -- 172.21.15.19:0/2826106109 shutdown_connections 2024-09-10T22:34:49.637 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:34:49.635+0000 7fcc5ea2b640 1 -- 172.21.15.19:0/2826106109 wait complete. 2024-09-10T22:34:50.024 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:50.008+0000 7fbcdc715640 1 -- 172.21.15.19:0/572645612 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbcd4101c90 msgr2=0x7fbcd4102070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:34:50.024 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:50.008+0000 7fbcdc715640 1 --2- 172.21.15.19:0/572645612 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbcd4101c90 0x7fbcd4102070 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7fbcd0009900 tx=0x7fbcd002a410 comp rx=0 tx=0).stop 2024-09-10T22:34:50.024 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:50.008+0000 7fbcdc715640 1 -- 172.21.15.19:0/572645612 shutdown_connections 2024-09-10T22:34:50.025 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:50.008+0000 7fbcdc715640 1 --2- 172.21.15.19:0/572645612 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fbcd4108020 0x7fbcd410e820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:34:50.025 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:50.008+0000 7fbcdc715640 1 --2- 172.21.15.19:0/572645612 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbcd41076a0 0x7fbcd4107ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:34:50.025 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:50.008+0000 7fbcdc715640 1 --2- 172.21.15.19:0/572645612 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbcd4101c90 0x7fbcd4102070 unknown :-1 s=CLOSED pgs=746 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:34:50.025 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:50.008+0000 7fbcdc715640 1 -- 172.21.15.19:0/572645612 >> 172.21.15.19:0/572645612 conn(0x7fbcd40fd700 msgr2=0x7fbcd40ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:34:50.025 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:50.008+0000 7fbcdc715640 1 -- 172.21.15.19:0/572645612 shutdown_connections 2024-09-10T22:34:50.025 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:50.008+0000 7fbcdc715640 1 -- 172.21.15.19:0/572645612 wait complete. 2024-09-10T22:34:50.025 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:50.009+0000 7fbcdc715640 1 Processor -- start 2024-09-10T22:34:50.025 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:50.009+0000 7fbcdc715640 1 -- start start 2024-09-10T22:34:50.025 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:50.009+0000 7fbcdc715640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbcd4101c90 0x7fbcd40fdc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:34:50.025 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:50.009+0000 7fbcdc715640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fbcd41076a0 0x7fbcd40fe140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:34:50.026 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:50.009+0000 7fbcdc715640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbcd4108020 0x7fbcd40fe680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:34:50.026 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:50.009+0000 7fbcdc715640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fbcd4111ce0 con 0x7fbcd4101c90 2024-09-10T22:34:50.026 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:50.009+0000 7fbcdc715640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fbcd4111b60 con 0x7fbcd4108020 2024-09-10T22:34:50.026 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:50.009+0000 7fbcdc715640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7fbcd4111e60 con 0x7fbcd41076a0 2024-09-10T22:34:50.026 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:50.010+0000 7fbcda4b1640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbcd4101c90 0x7fbcd40fdc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:34:50.026 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:50.010+0000 7fbcd9cb0640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fbcd41076a0 0x7fbcd40fe140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:34:50.026 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:50.010+0000 7fbcda4b1640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbcd4101c90 0x7fbcd40fdc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:49614/0 (socket says 172.21.15.19:49614) 2024-09-10T22:34:50.026 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:50.010+0000 7fbcda4b1640 1 -- 172.21.15.19:0/3441941197 learned_addr learned my addr 172.21.15.19:0/3441941197 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:34:50.026 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:50.010+0000 7fbcdacb2640 1 --2- 172.21.15.19:0/3441941197 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbcd4108020 0x7fbcd40fe680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:34:50.026 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:50.010+0000 7fbcda4b1640 1 -- 172.21.15.19:0/3441941197 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fbcd41076a0 msgr2=0x7fbcd40fe140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:34:50.026 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:50.010+0000 7fbcda4b1640 1 --2- 172.21.15.19:0/3441941197 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fbcd41076a0 0x7fbcd40fe140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:34:50.026 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:50.010+0000 7fbcda4b1640 1 -- 172.21.15.19:0/3441941197 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbcd4108020 msgr2=0x7fbcd40fe680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:34:50.027 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:50.010+0000 7fbcda4b1640 1 --2- 172.21.15.19:0/3441941197 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbcd4108020 0x7fbcd40fe680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:34:50.027 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:50.010+0000 7fbcda4b1640 1 -- 172.21.15.19:0/3441941197 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbcd41a76d0 con 0x7fbcd4101c90 2024-09-10T22:34:50.027 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:50.010+0000 7fbcdacb2640 1 --2- 172.21.15.19:0/3441941197 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbcd4108020 0x7fbcd40fe680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T22:34:50.027 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:50.010+0000 7fbcd9cb0640 1 --2- 172.21.15.19:0/3441941197 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fbcd41076a0 0x7fbcd40fe140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T22:34:50.027 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:50.010+0000 7fbcda4b1640 1 --2- 172.21.15.19:0/3441941197 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbcd4101c90 0x7fbcd40fdc00 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7fbcd0005940 tx=0x7fbcd0004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:34:50.027 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:50.010+0000 7fbccb7fe640 1 -- 172.21.15.19:0/3441941197 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbcd003f030 con 0x7fbcd4101c90 2024-09-10T22:34:50.027 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:50.011+0000 7fbcdc715640 1 -- 172.21.15.19:0/3441941197 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbcd41a7960 con 0x7fbcd4101c90 2024-09-10T22:34:50.027 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:50.011+0000 7fbccb7fe640 1 -- 172.21.15.19:0/3441941197 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbcd0003aa0 con 0x7fbcd4101c90 2024-09-10T22:34:50.027 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:50.011+0000 7fbccb7fe640 1 -- 172.21.15.19:0/3441941197 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbcd0035070 con 0x7fbcd4101c90 2024-09-10T22:34:50.027 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:50.011+0000 7fbcdc715640 1 -- 172.21.15.19:0/3441941197 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbcd41a7e90 con 0x7fbcd4101c90 2024-09-10T22:34:50.027 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:50.013+0000 7fbcdeaea740 1 Processor -- start 2024-09-10T22:34:50.027 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:50.014+0000 7fbcdeaea740 1 -- start start 2024-09-10T22:34:50.028 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:50.014+0000 7fbcdeaea740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5607198e04d0 0x5607198e08b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:34:50.028 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:50.014+0000 7fbccb7fe640 1 -- 172.21.15.19:0/3441941197 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 18) ==== 153250+0+0 (secure 0 0 0) 0x7fbcd00035f0 con 0x7fbcd4101c90 2024-09-10T22:34:50.028 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:50.014+0000 7fbcdeaea740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5607198e0df0 0x5607198ec840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:34:50.028 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:50.014+0000 7fbcdeaea740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5607198ecd80 0x5607198ef170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:34:50.028 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:50.014+0000 7fbcdeaea740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x560719856ea0 con 0x5607198ecd80 2024-09-10T22:34:50.028 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:50.014+0000 7fbcdeaea740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x5607198462d0 con 0x5607198e0df0 2024-09-10T22:34:50.028 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:50.014+0000 7fbcdeaea740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x56071984a0e0 con 0x5607198e04d0 2024-09-10T22:34:50.028 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:50.014+0000 7fbcd9cb0640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5607198ecd80 0x5607198ef170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:34:50.028 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:50.014+0000 7fbcda4b1640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5607198e0df0 0x5607198ec840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:34:50.028 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:50.014+0000 7fbcd9cb0640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5607198ecd80 0x5607198ef170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:49620/0 (socket says 172.21.15.19:49620) 2024-09-10T22:34:50.028 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:50.014+0000 7fbcd9cb0640 1 -- 172.21.15.19:0/3171373028 learned_addr learned my addr 172.21.15.19:0/3171373028 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:34:50.028 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:50.014+0000 7fbcdacb2640 1 --2- 172.21.15.19:0/3171373028 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5607198e04d0 0x5607198e08b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:34:50.029 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:50.015+0000 7fbcd9cb0640 1 -- 172.21.15.19:0/3171373028 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5607198e04d0 msgr2=0x5607198e08b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:34:50.029 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:50.015+0000 7fbcd9cb0640 1 --2- 172.21.15.19:0/3171373028 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5607198e04d0 0x5607198e08b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:34:50.029 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:50.015+0000 7fbcd9cb0640 1 -- 172.21.15.19:0/3171373028 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5607198e0df0 msgr2=0x5607198ec840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:34:50.029 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:50.015+0000 7fbcd9cb0640 1 --2- 172.21.15.19:0/3171373028 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5607198e0df0 0x5607198ec840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:34:50.029 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:50.015+0000 7fbcd9cb0640 1 -- 172.21.15.19:0/3171373028 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5607195a4650 con 0x5607198ecd80 2024-09-10T22:34:50.029 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:50.015+0000 7fbcda4b1640 1 --2- 172.21.15.19:0/3171373028 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5607198e0df0 0x5607198ec840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T22:34:50.029 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:50.015+0000 7fbcdacb2640 1 --2- 172.21.15.19:0/3171373028 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5607198e04d0 0x5607198e08b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T22:34:50.029 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:50.015+0000 7fbcd9cb0640 1 --2- 172.21.15.19:0/3171373028 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5607198ecd80 0x5607198ef170 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7fbcc400bba0 tx=0x7fbcc400d710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=99e9c8411f0fd0db server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:34:50.029 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:50.015+0000 7fbcc8ff9640 1 -- 172.21.15.19:0/3171373028 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbcc4024070 con 0x5607198ecd80 2024-09-10T22:34:50.029 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:50.015+0000 7fbcc8ff9640 1 -- 172.21.15.19:0/3171373028 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbcc400bc90 con 0x5607198ecd80 2024-09-10T22:34:50.029 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:50.015+0000 7fbcc8ff9640 1 -- 172.21.15.19:0/3171373028 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbcc401e5d0 con 0x5607198ecd80 2024-09-10T22:34:50.029 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:50.015+0000 7fbccb7fe640 1 --2- 172.21.15.19:0/3441941197 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7fbcc00b52e0 0x7fbcc00b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:34:50.030 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:50.015+0000 7fbccb7fe640 1 -- 172.21.15.19:0/3441941197 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8327+0+0 (secure 0 0 0) 0x7fbcd0106310 con 0x7fbcd4101c90 2024-09-10T22:34:50.030 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:50.016+0000 7fbcdacb2640 1 --2- 172.21.15.19:0/3441941197 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7fbcc00b52e0 0x7fbcc00b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:34:50.030 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:50.016+0000 7fbcdacb2640 1 --2- 172.21.15.19:0/3441941197 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7fbcc00b52e0 0x7fbcc00b77a0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7fbccc009fd0 tx=0x7fbccc009500 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:34:50.030 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:50.016+0000 7fbcdeaea740 1 -- 172.21.15.19:0/3171373028 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5607198ecd80 msgr2=0x5607198ef170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:34:50.030 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:50.016+0000 7fbcdeaea740 1 --2- 172.21.15.19:0/3171373028 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5607198ecd80 0x5607198ef170 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7fbcc400bba0 tx=0x7fbcc400d710 comp rx=0 tx=0).stop 2024-09-10T22:34:50.030 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:50.016+0000 7fbcdeaea740 1 -- 172.21.15.19:0/3171373028 shutdown_connections 2024-09-10T22:34:50.030 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:50.016+0000 7fbcdeaea740 1 --2- 172.21.15.19:0/3171373028 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5607198ecd80 0x5607198ef170 unknown :-1 s=CLOSED pgs=748 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:34:50.030 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:50.016+0000 7fbcdeaea740 1 --2- 172.21.15.19:0/3171373028 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5607198e0df0 0x5607198ec840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:34:50.030 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:50.016+0000 7fbcdeaea740 1 --2- 172.21.15.19:0/3171373028 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5607198e04d0 0x5607198e08b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:34:50.030 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:50.016+0000 7fbcdeaea740 1 -- 172.21.15.19:0/3171373028 >> 172.21.15.19:0/3171373028 conn(0x5607198de300 msgr2=0x5607198df4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:34:50.030 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:50.017+0000 7fbcdeaea740 1 -- 172.21.15.19:0/3171373028 shutdown_connections 2024-09-10T22:34:50.031 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:50.017+0000 7fbcdeaea740 1 -- 172.21.15.19:0/3171373028 wait complete. 2024-09-10T22:34:50.031 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:50.017+0000 7fbcdeaea740 1 -- start start 2024-09-10T22:34:50.031 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:50.017+0000 7fbcdeaea740 1 Processor -- start 2024-09-10T22:34:50.031 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:50.018+0000 7fbcdeaea740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5607198e04d0 0x5607198ec670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:34:50.031 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:50.018+0000 7fbcdeaea740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5607198e0df0 0x5607198e9ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:34:50.031 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:50.018+0000 7fbcdeaea740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5607198ecd80 0x5607198ea0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:34:50.031 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:50.018+0000 7fbcdeaea740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x5607196a7700 con 0x5607198e04d0 2024-09-10T22:34:50.031 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:50.018+0000 7fbcdeaea740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x5607197e1160 con 0x5607198ecd80 2024-09-10T22:34:50.031 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:50.018+0000 7fbcdeaea740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x5607198efa00 con 0x5607198e0df0 2024-09-10T22:34:50.031 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:50.018+0000 7fbcdeaea740 10 client.0 _ll_register_callbacks cb 0x5607197fa9e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T22:34:50.031 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:50.018+0000 7fbcd9cb0640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5607198e0df0 0x5607198e9ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:34:50.031 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:50.018+0000 7fbcda4b1640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5607198e04d0 0x5607198ec670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:34:50.032 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:50.018+0000 7fbcd9cb0640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5607198e0df0 0x5607198e9ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.19:58228/0 (socket says 172.21.15.19:58228) 2024-09-10T22:34:50.032 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:50.018+0000 7fbcd9cb0640 1 -- 172.21.15.19:0/1192528311 learned_addr learned my addr 172.21.15.19:0/1192528311 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:34:50.032 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:50.018+0000 7fbcdacb2640 1 --2- 172.21.15.19:0/1192528311 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5607198ecd80 0x5607198ea0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:34:50.032 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:50.018+0000 7fbcd9cb0640 1 -- 172.21.15.19:0/1192528311 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5607198ecd80 msgr2=0x5607198ea0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:34:50.032 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:50.018+0000 7fbcd9cb0640 1 --2- 172.21.15.19:0/1192528311 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5607198ecd80 0x5607198ea0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:34:50.032 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:50.018+0000 7fbcd9cb0640 1 -- 172.21.15.19:0/1192528311 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5607198e04d0 msgr2=0x5607198ec670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:34:50.032 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:50.018+0000 7fbcd9cb0640 1 --2- 172.21.15.19:0/1192528311 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5607198e04d0 0x5607198ec670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:34:50.032 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:50.018+0000 7fbcd9cb0640 1 -- 172.21.15.19:0/1192528311 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56071980ec90 con 0x5607198e0df0 2024-09-10T22:34:50.032 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:50.019+0000 7fbcd9cb0640 1 --2- 172.21.15.19:0/1192528311 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5607198e0df0 0x5607198e9ac0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fbcc4022040 tx=0x7fbcc400be40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=328099bde7d96206 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:34:50.032 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:50.019+0000 7fbcbdffb640 10 client.0 ms_handle_connect on v2:172.21.15.138:3300/0 2024-09-10T22:34:50.032 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:50.019+0000 7fbcbdffb640 1 -- 172.21.15.19:0/1192528311 <== mon.1 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbcc4024070 con 0x5607198e0df0 2024-09-10T22:34:50.032 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:50.019+0000 7fbcdeaea740 1 -- 172.21.15.19:0/1192528311 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbcc400bc90 con 0x5607198e0df0 2024-09-10T22:34:50.033 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:50.019+0000 7fbcbdffb640 1 -- 172.21.15.19:0/1192528311 <== mon.1 v2:172.21.15.138:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8327+0+0 (secure 0 0 0) 0x7fbcc4005040 con 0x5607198e0df0 2024-09-10T22:34:50.033 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:50.019+0000 7fbcbdffb640 1 -- 172.21.15.19:0/1192528311 <== mon.1 v2:172.21.15.138:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fbcc4005240 con 0x5607198e0df0 2024-09-10T22:34:50.033 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:50.019+0000 7fbcdeaea740 10 client.26392 fetch_fsmap learned FSMap version 27 2024-09-10T22:34:50.033 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:50.019+0000 7fbcdeaea740 1 -- 172.21.15.19:0/1192528311 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x5607198fb390 con 0x5607198e0df0 2024-09-10T22:34:50.033 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:50.019+0000 7fbcbdffb640 1 -- 172.21.15.19:0/1192528311 <== mon.1 v2:172.21.15.138:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbcc400bc90 con 0x5607198e0df0 2024-09-10T22:34:50.033 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:50.019+0000 7fbcbdffb640 1 -- 172.21.15.19:0/1192528311 <== mon.1 v2:172.21.15.138:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7fbcc4004750 con 0x5607198e0df0 2024-09-10T22:34:50.033 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:50.019+0000 7fbcdeaea740 10 client.26392 fetch_fsmap finished waiting for FSMap version 27 2024-09-10T22:34:50.033 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:50.019+0000 7fbcdeaea740 10 client.26392 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-10T22:34:50.033 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:50.019+0000 7fbcdeaea740 20 client.26392 populate_metadata read hostname 'smithi019' 2024-09-10T22:34:50.033 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:50.019+0000 7fbcdeaea740 1 --2- 172.21.15.19:0/1192528311 >> [v2:172.21.15.138:6838/383637208,v1:172.21.15.138:6839/383637208] conn(0x5607198fc7f0 0x5607198febe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:34:50.033 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:50.019+0000 7fbcdeaea740 4 client.26392 mds_command: new command op to 24568 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T22:34:50.033 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:50.020+0000 7fbcdeaea740 1 -- 172.21.15.19:0/1192528311 --> [v2:172.21.15.138:6838/383637208,v1:172.21.15.138:6839/383637208] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x560719858df0 con 0x5607198fc7f0 2024-09-10T22:34:50.034 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:50.020+0000 7fbcda4b1640 1 --2- 172.21.15.19:0/1192528311 >> [v2:172.21.15.138:6838/383637208,v1:172.21.15.138:6839/383637208] conn(0x5607198fc7f0 0x5607198febe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:34:50.034 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:50.020+0000 7fbcbdffb640 10 client.26392 ms_handle_connect on v2:172.21.15.138:6838/383637208 2024-09-10T22:34:50.034 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:50.020+0000 7fbcda4b1640 1 --2- 172.21.15.19:0/1192528311 >> [v2:172.21.15.138:6838/383637208,v1:172.21.15.138:6839/383637208] conn(0x5607198fc7f0 0x5607198febe0 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=bbe99bea5c52df3a server_cookie=1fe494b3b02b7a66 in_seq=0 out_seq=0 2024-09-10T22:34:50.034 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:50.021+0000 7fbcbdffb640 1 -- 172.21.15.19:0/1192528311 <== mds.1 v2:172.21.15.138:6838/383637208 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x560719858df0 con 0x5607198fc7f0 2024-09-10T22:34:50.034 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:50.021+0000 7fbcbdffb640 10 client.26392 handle_command_reply: tid=0 2024-09-10T22:34:50.034 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:50.021+0000 7fbcdeaea740 1 client.26392 shutdown 2024-09-10T22:34:50.034 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:50.021+0000 7fbcdeaea740 1 -- 172.21.15.19:0/1192528311 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5607198e0df0 msgr2=0x5607198e9ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:34:50.034 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:50.021+0000 7fbcdeaea740 1 --2- 172.21.15.19:0/1192528311 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5607198e0df0 0x5607198e9ac0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fbcc4022040 tx=0x7fbcc400be40 comp rx=0 tx=0).stop 2024-09-10T22:34:50.034 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:50.022+0000 7fbcdeaea740 1 -- 172.21.15.19:0/1192528311 shutdown_connections 2024-09-10T22:34:50.034 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:50.022+0000 7fbcdeaea740 1 --2- 172.21.15.19:0/1192528311 >> [v2:172.21.15.138:6838/383637208,v1:172.21.15.138:6839/383637208] conn(0x5607198fc7f0 0x5607198febe0 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:34:50.034 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:50.022+0000 7fbcdeaea740 1 --2- 172.21.15.19:0/1192528311 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5607198ecd80 0x5607198ea0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:34:50.035 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:50.022+0000 7fbcdeaea740 1 --2- 172.21.15.19:0/1192528311 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5607198e0df0 0x5607198e9ac0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:34:50.035 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:50.022+0000 7fbcdeaea740 1 --2- 172.21.15.19:0/1192528311 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5607198e04d0 0x5607198ec670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:34:50.035 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:50.022+0000 7fbcdeaea740 1 -- 172.21.15.19:0/1192528311 >> 172.21.15.19:0/1192528311 conn(0x5607198de300 msgr2=0x5607198e3e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:34:50.035 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:50.022+0000 7fbcbdffb640 0 client.26392 ms_handle_reset on v2:172.21.15.138:6838/383637208 2024-09-10T22:34:50.035 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:50.022+0000 7fbcdeaea740 1 -- 172.21.15.19:0/1192528311 shutdown_connections 2024-09-10T22:34:50.035 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:50.022+0000 7fbcdeaea740 1 -- 172.21.15.19:0/1192528311 wait complete. 2024-09-10T22:34:50.035 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:50.022+0000 7fbcdeaea740 20 client.26392 trim_cache size 0 max 16384 2024-09-10T22:34:50.039 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:50.036+0000 7fbcdeaea740 1 Processor -- start 2024-09-10T22:34:50.039 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:50.036+0000 7fbcdeaea740 1 -- start start 2024-09-10T22:34:50.040 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:50.036+0000 7fbcdeaea740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5607198e04d0 0x5607198ddc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:34:50.040 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:50.036+0000 7fbcdeaea740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5607198e0df0 0x5607198eb800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:34:50.040 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:50.036+0000 7fbcdeaea740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5607198ecd80 0x5607198e6cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:34:50.040 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:50.037+0000 7fbcdeaea740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fbcd41aec30 con 0x5607198ecd80 2024-09-10T22:34:50.040 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:50.037+0000 7fbcdeaea740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fbcd41ac500 con 0x5607198e04d0 2024-09-10T22:34:50.040 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:50.037+0000 7fbcdeaea740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7fbcd41aa350 con 0x5607198e0df0 2024-09-10T22:34:50.040 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:50.037+0000 7fbcd9cb0640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5607198e0df0 0x5607198eb800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:34:50.040 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:50.037+0000 7fbcd9cb0640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5607198e0df0 0x5607198eb800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.19:58234/0 (socket says 172.21.15.19:58234) 2024-09-10T22:34:50.040 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:50.037+0000 7fbcd9cb0640 1 -- 172.21.15.19:0/3078711281 learned_addr learned my addr 172.21.15.19:0/3078711281 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:34:50.041 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:50.037+0000 7fbcdacb2640 1 --2- 172.21.15.19:0/3078711281 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5607198ecd80 0x5607198e6cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:34:50.041 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:50.037+0000 7fbcda4b1640 1 --2- 172.21.15.19:0/3078711281 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5607198e04d0 0x5607198ddc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:34:50.041 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:50.037+0000 7fbcd9cb0640 1 -- 172.21.15.19:0/3078711281 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5607198e04d0 msgr2=0x5607198ddc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:34:50.041 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:50.037+0000 7fbcd9cb0640 1 --2- 172.21.15.19:0/3078711281 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5607198e04d0 0x5607198ddc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:34:50.041 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:50.037+0000 7fbcd9cb0640 1 -- 172.21.15.19:0/3078711281 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5607198ecd80 msgr2=0x5607198e6cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:34:50.041 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:50.037+0000 7fbcd9cb0640 1 --2- 172.21.15.19:0/3078711281 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5607198ecd80 0x5607198e6cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:34:50.041 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:50.037+0000 7fbcd9cb0640 1 -- 172.21.15.19:0/3078711281 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5607198e47e0 con 0x5607198e0df0 2024-09-10T22:34:50.041 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:50.037+0000 7fbcdacb2640 1 --2- 172.21.15.19:0/3078711281 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5607198ecd80 0x5607198e6cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T22:34:50.041 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:50.037+0000 7fbcd9cb0640 1 --2- 172.21.15.19:0/3078711281 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5607198e0df0 0x5607198eb800 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fbcc400b3d0 tx=0x7fbcc4021fd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=40ed9930da1362b7 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:34:50.041 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:50.038+0000 7fbcbffff640 1 -- 172.21.15.19:0/3078711281 <== mon.1 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbcc4024070 con 0x5607198e0df0 2024-09-10T22:34:50.042 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:50.038+0000 7fbcbffff640 1 -- 172.21.15.19:0/3078711281 <== mon.1 v2:172.21.15.138:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbcc400bc90 con 0x5607198e0df0 2024-09-10T22:34:50.042 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:50.038+0000 7fbcbffff640 1 -- 172.21.15.19:0/3078711281 <== mon.1 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbcc40053e0 con 0x5607198e0df0 2024-09-10T22:34:50.046 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:50.038+0000 7fbcdeaea740 1 -- 172.21.15.19:0/3078711281 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5607198e0df0 msgr2=0x5607198eb800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:34:50.046 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:50.038+0000 7fbcdeaea740 1 --2- 172.21.15.19:0/3078711281 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5607198e0df0 0x5607198eb800 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fbcc400b3d0 tx=0x7fbcc4021fd0 comp rx=0 tx=0).stop 2024-09-10T22:34:50.046 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:50.038+0000 7fbcdeaea740 1 -- 172.21.15.19:0/3078711281 shutdown_connections 2024-09-10T22:34:50.046 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:50.038+0000 7fbcdeaea740 1 --2- 172.21.15.19:0/3078711281 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5607198ecd80 0x5607198e6cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:34:50.046 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:50.038+0000 7fbcdeaea740 1 --2- 172.21.15.19:0/3078711281 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5607198e0df0 0x5607198eb800 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:34:50.046 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:50.038+0000 7fbcdeaea740 1 --2- 172.21.15.19:0/3078711281 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5607198e04d0 0x5607198ddc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:34:50.046 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:50.038+0000 7fbcdeaea740 1 -- 172.21.15.19:0/3078711281 >> 172.21.15.19:0/3078711281 conn(0x5607198de300 msgr2=0x5607198eb0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:34:50.046 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:50.039+0000 7fbcdeaea740 1 -- 172.21.15.19:0/3078711281 shutdown_connections 2024-09-10T22:34:50.046 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:50.039+0000 7fbcdeaea740 1 -- 172.21.15.19:0/3078711281 wait complete. 2024-09-10T22:34:50.047 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:50.039+0000 7fbcdeaea740 1 -- start start 2024-09-10T22:34:50.047 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:50.039+0000 7fbcdeaea740 1 Processor -- start 2024-09-10T22:34:50.047 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:50.039+0000 7fbcdeaea740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5607198e04d0 0x5607198f0cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:34:50.047 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:50.039+0000 7fbcdeaea740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5607198e0df0 0x5607198f1200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:34:50.047 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:50.039+0000 7fbcdeaea740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5607198ecd80 0x5607198f1740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:34:50.047 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:50.039+0000 7fbcdeaea740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fbcd41aa9c0 con 0x5607198ecd80 2024-09-10T22:34:50.047 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:50.039+0000 7fbcdeaea740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fbcd41abe30 con 0x5607198e04d0 2024-09-10T22:34:50.047 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:50.039+0000 7fbcdeaea740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7fbcd41ab090 con 0x5607198e0df0 2024-09-10T22:34:50.047 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:50.039+0000 7fbcdeaea740 10 client.0 _ll_register_callbacks cb 0x7fbcc4022070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T22:34:50.047 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:50.040+0000 7fbcd9cb0640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5607198e0df0 0x5607198f1200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:34:50.047 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:50.040+0000 7fbcda4b1640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5607198e04d0 0x5607198f0cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:34:50.048 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:50.040+0000 7fbcd9cb0640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5607198e0df0 0x5607198f1200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.19:58248/0 (socket says 172.21.15.19:58248) 2024-09-10T22:34:50.048 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:50.040+0000 7fbcda4b1640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5607198e04d0 0x5607198f0cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.19:56476/0 (socket says 172.21.15.19:56476) 2024-09-10T22:34:50.048 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:50.040+0000 7fbcd9cb0640 1 -- 172.21.15.19:0/1915247349 learned_addr learned my addr 172.21.15.19:0/1915247349 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:34:50.048 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:50.040+0000 7fbcdacb2640 1 --2- 172.21.15.19:0/1915247349 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5607198ecd80 0x5607198f1740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:34:50.048 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:50.040+0000 7fbcd9cb0640 1 -- 172.21.15.19:0/1915247349 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5607198e04d0 msgr2=0x5607198f0cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:34:50.048 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:50.040+0000 7fbcd9cb0640 1 --2- 172.21.15.19:0/1915247349 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5607198e04d0 0x5607198f0cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:34:50.048 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:50.040+0000 7fbcd9cb0640 1 -- 172.21.15.19:0/1915247349 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5607198ecd80 msgr2=0x5607198f1740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:34:50.048 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:50.040+0000 7fbcd9cb0640 1 --2- 172.21.15.19:0/1915247349 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5607198ecd80 0x5607198f1740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:34:50.048 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:50.040+0000 7fbcd9cb0640 1 -- 172.21.15.19:0/1915247349 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5607199684f0 con 0x5607198e0df0 2024-09-10T22:34:50.048 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:50.040+0000 7fbcd9cb0640 1 --2- 172.21.15.19:0/1915247349 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5607198e0df0 0x5607198f1200 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fbcc4016c60 tx=0x7fbcc402a580 comp rx=0 tx=0).ready entity=mon.1 client_cookie=336117ad892f58a7 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:34:50.048 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:50.040+0000 7fbcbdffb640 10 client.0 ms_handle_connect on v2:172.21.15.138:3300/0 2024-09-10T22:34:50.048 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:50.040+0000 7fbcbdffb640 1 -- 172.21.15.19:0/1915247349 <== mon.1 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbcc4024070 con 0x5607198e0df0 2024-09-10T22:34:50.049 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:50.040+0000 7fbcbdffb640 1 -- 172.21.15.19:0/1915247349 <== mon.1 v2:172.21.15.138:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8327+0+0 (secure 0 0 0) 0x7fbcc4005bb0 con 0x5607198e0df0 2024-09-10T22:34:50.049 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:50.040+0000 7fbcdeaea740 1 -- 172.21.15.19:0/1915247349 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbcc400bc90 con 0x5607198e0df0 2024-09-10T22:34:50.049 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:50.041+0000 7fbcbdffb640 1 -- 172.21.15.19:0/1915247349 <== mon.1 v2:172.21.15.138:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fbcc4041040 con 0x5607198e0df0 2024-09-10T22:34:50.049 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:50.041+0000 7fbcdeaea740 10 client.26398 fetch_fsmap learned FSMap version 27 2024-09-10T22:34:50.049 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:50.041+0000 7fbcdeaea740 1 -- 172.21.15.19:0/1915247349 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x5607199697f0 con 0x5607198e0df0 2024-09-10T22:34:50.049 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:50.041+0000 7fbcbdffb640 1 -- 172.21.15.19:0/1915247349 <== mon.1 v2:172.21.15.138:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbcc400bc90 con 0x5607198e0df0 2024-09-10T22:34:50.049 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:50.041+0000 7fbcbdffb640 1 -- 172.21.15.19:0/1915247349 <== mon.1 v2:172.21.15.138:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7fbcc404d020 con 0x5607198e0df0 2024-09-10T22:34:50.049 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:50.041+0000 7fbcdeaea740 10 client.26398 fetch_fsmap finished waiting for FSMap version 27 2024-09-10T22:34:50.049 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:50.041+0000 7fbcdeaea740 10 client.26398 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-10T22:34:50.049 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:50.041+0000 7fbcdeaea740 20 client.26398 populate_metadata read hostname 'smithi019' 2024-09-10T22:34:50.049 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:50.041+0000 7fbcdeaea740 1 --2- 172.21.15.19:0/1915247349 >> [v2:172.21.15.138:6838/383637208,v1:172.21.15.138:6839/383637208] conn(0x560719969e70 0x56071996c290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:34:50.049 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:50.041+0000 7fbcdeaea740 4 client.26398 mds_command: new command op to 24568 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-10T22:34:50.049 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:50.041+0000 7fbcdeaea740 1 -- 172.21.15.19:0/1915247349 --> [v2:172.21.15.138:6838/383637208,v1:172.21.15.138:6839/383637208] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5607198548a0 con 0x560719969e70 2024-09-10T22:34:50.050 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:50.041+0000 7fbcda4b1640 1 --2- 172.21.15.19:0/1915247349 >> [v2:172.21.15.138:6838/383637208,v1:172.21.15.138:6839/383637208] conn(0x560719969e70 0x56071996c290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:34:50.050 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:50.042+0000 7fbcbdffb640 10 client.26398 ms_handle_connect on v2:172.21.15.138:6838/383637208 2024-09-10T22:34:50.050 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:50.042+0000 7fbcda4b1640 1 --2- 172.21.15.19:0/1915247349 >> [v2:172.21.15.138:6838/383637208,v1:172.21.15.138:6839/383637208] conn(0x560719969e70 0x56071996c290 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=240715920a169a75 server_cookie=f1cc065e4c3ffcfa in_seq=0 out_seq=0 2024-09-10T22:34:50.050 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:50.042+0000 7fbcbdffb640 1 -- 172.21.15.19:0/1915247349 <== mds.1 v2:172.21.15.138:6838/383637208 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5607198548a0 con 0x560719969e70 2024-09-10T22:34:50.050 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:50.042+0000 7fbcbdffb640 10 client.26398 handle_command_reply: tid=0 2024-09-10T22:34:50.050 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:50.042+0000 7fbcdeaea740 1 client.26398 shutdown 2024-09-10T22:34:50.050 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:50.042+0000 7fbcdeaea740 1 -- 172.21.15.19:0/1915247349 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5607198e0df0 msgr2=0x5607198f1200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:34:50.050 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:50.042+0000 7fbcdeaea740 1 --2- 172.21.15.19:0/1915247349 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5607198e0df0 0x5607198f1200 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fbcc4016c60 tx=0x7fbcc402a580 comp rx=0 tx=0).stop 2024-09-10T22:34:50.050 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:50.042+0000 7fbcdeaea740 1 -- 172.21.15.19:0/1915247349 shutdown_connections 2024-09-10T22:34:50.050 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:50.042+0000 7fbcdeaea740 1 --2- 172.21.15.19:0/1915247349 >> [v2:172.21.15.138:6838/383637208,v1:172.21.15.138:6839/383637208] conn(0x560719969e70 0x56071996c290 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:34:50.050 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:50.042+0000 7fbcdeaea740 1 --2- 172.21.15.19:0/1915247349 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5607198ecd80 0x5607198f1740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:34:50.050 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:50.042+0000 7fbcdeaea740 1 --2- 172.21.15.19:0/1915247349 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5607198e0df0 0x5607198f1200 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:34:50.050 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:50.042+0000 7fbcbdffb640 0 client.26398 ms_handle_reset on v2:172.21.15.138:6838/383637208 2024-09-10T22:34:50.051 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:50.042+0000 7fbcdeaea740 1 --2- 172.21.15.19:0/1915247349 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5607198e04d0 0x5607198f0cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:34:50.051 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:50.042+0000 7fbcdeaea740 1 -- 172.21.15.19:0/1915247349 >> 172.21.15.19:0/1915247349 conn(0x5607198de300 msgr2=0x5607198eb910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:34:50.051 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:50.042+0000 7fbcdeaea740 1 -- 172.21.15.19:0/1915247349 shutdown_connections 2024-09-10T22:34:50.051 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:50.042+0000 7fbcdeaea740 1 -- 172.21.15.19:0/1915247349 wait complete. 2024-09-10T22:34:50.051 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:50.043+0000 7fbcdeaea740 20 client.26398 trim_cache size 0 max 16384 2024-09-10T22:34:50.051 INFO:teuthology.orchestra.run.smithi019.stdout:[] 2024-09-10T22:34:50.052 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:50.043+0000 7fbcdc715640 1 -- 172.21.15.19:0/3441941197 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7fbcc00b52e0 msgr2=0x7fbcc00b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:34:50.052 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:50.043+0000 7fbcdc715640 1 --2- 172.21.15.19:0/3441941197 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7fbcc00b52e0 0x7fbcc00b77a0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7fbccc009fd0 tx=0x7fbccc009500 comp rx=0 tx=0).stop 2024-09-10T22:34:50.053 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:50.043+0000 7fbcdc715640 1 -- 172.21.15.19:0/3441941197 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbcd4101c90 msgr2=0x7fbcd40fdc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:34:50.053 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:50.043+0000 7fbcdc715640 1 --2- 172.21.15.19:0/3441941197 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbcd4101c90 0x7fbcd40fdc00 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7fbcd0005940 tx=0x7fbcd0004270 comp rx=0 tx=0).stop 2024-09-10T22:34:50.053 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:50.043+0000 7fbcdc715640 1 -- 172.21.15.19:0/3441941197 shutdown_connections 2024-09-10T22:34:50.053 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:50.043+0000 7fbcdc715640 1 --2- 172.21.15.19:0/3441941197 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7fbcc00b52e0 0x7fbcc00b77a0 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:34:50.053 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:50.043+0000 7fbcdc715640 1 --2- 172.21.15.19:0/3441941197 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbcd4108020 0x7fbcd40fe680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:34:50.053 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:50.043+0000 7fbcdc715640 1 --2- 172.21.15.19:0/3441941197 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fbcd41076a0 0x7fbcd40fe140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:34:50.053 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:50.043+0000 7fbcdc715640 1 --2- 172.21.15.19:0/3441941197 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbcd4101c90 0x7fbcd40fdc00 unknown :-1 s=CLOSED pgs=747 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:34:50.053 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:50.043+0000 7fbcdc715640 1 -- 172.21.15.19:0/3441941197 >> 172.21.15.19:0/3441941197 conn(0x7fbcd40fd700 msgr2=0x7fbcd406ad90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:34:50.053 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:50.043+0000 7fbcdc715640 1 -- 172.21.15.19:0/3441941197 shutdown_connections 2024-09-10T22:34:50.053 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:50.043+0000 7fbcdc715640 1 -- 172.21.15.19:0/3441941197 wait complete. 2024-09-10T22:34:50.393 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:34:50 smithi019 ceph-mon[31375]: pgmap v599: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 484 KiB/s rd, 251 MiB/s wr, 818 op/s 2024-09-10T22:34:50.609 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:34:50 smithi135 ceph-mon[34789]: pgmap v599: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 484 KiB/s rd, 251 MiB/s wr, 818 op/s 2024-09-10T22:34:50.625 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:34:50 smithi138 ceph-mon[35236]: pgmap v599: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 484 KiB/s rd, 251 MiB/s wr, 818 op/s 2024-09-10T22:34:50.854 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 22997a4c-6fc2-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-10T22:34:51.187 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/22997a4c-6fc2-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T22:34:51.742 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:51.709+0000 7f9b820b8640 1 -- 172.21.15.19:0/1993465598 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9b7c10f3f0 msgr2=0x7f9b7c1117e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:34:51.742 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:51.709+0000 7f9b820b8640 1 --2- 172.21.15.19:0/1993465598 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9b7c10f3f0 0x7f9b7c1117e0 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7f9b74009900 tx=0x7f9b7402a410 comp rx=0 tx=0).stop 2024-09-10T22:34:51.742 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:51.709+0000 7f9b820b8640 1 -- 172.21.15.19:0/1993465598 shutdown_connections 2024-09-10T22:34:51.742 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:51.709+0000 7f9b820b8640 1 --2- 172.21.15.19:0/1993465598 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9b7c10f3f0 0x7f9b7c1117e0 unknown :-1 s=CLOSED pgs=749 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:34:51.743 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:51.709+0000 7f9b820b8640 1 --2- 172.21.15.19:0/1993465598 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f9b7c075de0 0x7f9b7c10eeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:34:51.743 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:51.709+0000 7f9b820b8640 1 --2- 172.21.15.19:0/1993465598 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9b7c0754c0 0x7f9b7c0758a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:34:51.743 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:51.709+0000 7f9b820b8640 1 -- 172.21.15.19:0/1993465598 >> 172.21.15.19:0/1993465598 conn(0x7f9b7c0fe830 msgr2=0x7f9b7c100c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:34:51.743 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:51.709+0000 7f9b820b8640 1 -- 172.21.15.19:0/1993465598 shutdown_connections 2024-09-10T22:34:51.743 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:51.709+0000 7f9b820b8640 1 -- 172.21.15.19:0/1993465598 wait complete. 2024-09-10T22:34:51.743 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:51.709+0000 7f9b820b8640 1 Processor -- start 2024-09-10T22:34:51.743 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:51.709+0000 7f9b820b8640 1 -- start start 2024-09-10T22:34:51.743 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:51.710+0000 7f9b820b8640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9b7c0754c0 0x7f9b7c19b490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:34:51.743 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:51.710+0000 7f9b820b8640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9b7c075de0 0x7f9b7c19b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:34:51.743 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:51.710+0000 7f9b820b8640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f9b7c10f3f0 0x7f9b7c1a0d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:34:51.743 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:51.710+0000 7f9b820b8640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f9b7c114fc0 con 0x7f9b7c0754c0 2024-09-10T22:34:51.743 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:51.710+0000 7f9b820b8640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f9b7c114e40 con 0x7f9b7c075de0 2024-09-10T22:34:51.743 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:51.710+0000 7f9b820b8640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f9b7c115140 con 0x7f9b7c10f3f0 2024-09-10T22:34:51.744 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:51.710+0000 7f9b7b7fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9b7c0754c0 0x7f9b7c19b490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:34:51.744 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:51.710+0000 7f9b7b7fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9b7c0754c0 0x7f9b7c19b490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:49646/0 (socket says 172.21.15.19:49646) 2024-09-10T22:34:51.744 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:51.710+0000 7f9b72ffd640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9b7c075de0 0x7f9b7c19b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:34:51.744 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:51.710+0000 7f9b7b7fe640 1 -- 172.21.15.19:0/2565574273 learned_addr learned my addr 172.21.15.19:0/2565574273 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:34:51.744 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:51.710+0000 7f9b7bfff640 1 --2- 172.21.15.19:0/2565574273 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f9b7c10f3f0 0x7f9b7c1a0d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:34:51.744 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:51.710+0000 7f9b72ffd640 1 -- 172.21.15.19:0/2565574273 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f9b7c10f3f0 msgr2=0x7f9b7c1a0d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:34:51.744 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:51.710+0000 7f9b72ffd640 1 --2- 172.21.15.19:0/2565574273 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f9b7c10f3f0 0x7f9b7c1a0d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:34:51.744 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:51.710+0000 7f9b72ffd640 1 -- 172.21.15.19:0/2565574273 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9b7c0754c0 msgr2=0x7f9b7c19b490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:34:51.744 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:51.710+0000 7f9b72ffd640 1 --2- 172.21.15.19:0/2565574273 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9b7c0754c0 0x7f9b7c19b490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:34:51.744 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:51.710+0000 7f9b72ffd640 1 -- 172.21.15.19:0/2565574273 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9b7c1a1540 con 0x7f9b7c075de0 2024-09-10T22:34:51.744 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:51.710+0000 7f9b7b7fe640 1 --2- 172.21.15.19:0/2565574273 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9b7c0754c0 0x7f9b7c19b490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T22:34:51.744 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:51.711+0000 7f9b72ffd640 1 --2- 172.21.15.19:0/2565574273 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9b7c075de0 0x7f9b7c19b9d0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f9b6400d720 tx=0x7f9b6400dbe0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:34:51.744 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:51.711+0000 7f9b797fa640 1 -- 172.21.15.19:0/2565574273 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b64017070 con 0x7f9b7c075de0 2024-09-10T22:34:51.745 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:51.711+0000 7f9b820b8640 1 -- 172.21.15.19:0/2565574273 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9b7c1a1830 con 0x7f9b7c075de0 2024-09-10T22:34:51.745 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:51.711+0000 7f9b797fa640 1 -- 172.21.15.19:0/2565574273 <== mon.2 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9b6400de30 con 0x7f9b7c075de0 2024-09-10T22:34:51.745 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:51.711+0000 7f9b797fa640 1 -- 172.21.15.19:0/2565574273 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b640047a0 con 0x7f9b7c075de0 2024-09-10T22:34:51.745 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:51.711+0000 7f9b820b8640 1 -- 172.21.15.19:0/2565574273 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9b7c1a7ef0 con 0x7f9b7c075de0 2024-09-10T22:34:51.745 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:51.713+0000 7f9b797fa640 1 -- 172.21.15.19:0/2565574273 <== mon.2 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 18) ==== 153250+0+0 (secure 0 0 0) 0x7f9b640099d0 con 0x7f9b7c075de0 2024-09-10T22:34:51.745 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:51.713+0000 7f9b8448d740 1 Processor -- start 2024-09-10T22:34:51.745 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:51.714+0000 7f9b8448d740 1 -- start start 2024-09-10T22:34:51.745 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:51.714+0000 7f9b8448d740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5569bdda14d0 0x5569bdda18b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:34:51.745 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:51.714+0000 7f9b8448d740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5569bdda1df0 0x5569bddad840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:34:51.745 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:51.714+0000 7f9b8448d740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5569bddadd80 0x5569bddb0170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:34:51.745 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:51.714+0000 7f9b8448d740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x5569bdd17ea0 con 0x5569bdda1df0 2024-09-10T22:34:51.745 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:51.714+0000 7f9b8448d740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x5569bdd072d0 con 0x5569bddadd80 2024-09-10T22:34:51.745 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:51.714+0000 7f9b8448d740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x5569bdd0b0e0 con 0x5569bdda14d0 2024-09-10T22:34:51.746 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:51.714+0000 7f9b7b7fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5569bdda1df0 0x5569bddad840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:34:51.746 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:51.714+0000 7f9b7b7fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5569bdda1df0 0x5569bddad840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:49656/0 (socket says 172.21.15.19:49656) 2024-09-10T22:34:51.746 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:51.714+0000 7f9b7b7fe640 1 -- 172.21.15.19:0/1642792079 learned_addr learned my addr 172.21.15.19:0/1642792079 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:34:51.746 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:51.714+0000 7f9b72ffd640 1 --2- 172.21.15.19:0/1642792079 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5569bddadd80 0x5569bddb0170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:34:51.746 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:51.714+0000 7f9b7bfff640 1 --2- 172.21.15.19:0/1642792079 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5569bdda14d0 0x5569bdda18b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:34:51.746 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:51.714+0000 7f9b7b7fe640 1 -- 172.21.15.19:0/1642792079 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5569bdda14d0 msgr2=0x5569bdda18b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:34:51.746 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:51.714+0000 7f9b7b7fe640 1 --2- 172.21.15.19:0/1642792079 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5569bdda14d0 0x5569bdda18b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:34:51.746 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:51.714+0000 7f9b7b7fe640 1 -- 172.21.15.19:0/1642792079 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5569bddadd80 msgr2=0x5569bddb0170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:34:51.746 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:51.714+0000 7f9b7b7fe640 1 --2- 172.21.15.19:0/1642792079 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5569bddadd80 0x5569bddb0170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:34:51.746 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:51.714+0000 7f9b7b7fe640 1 -- 172.21.15.19:0/1642792079 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5569bda65650 con 0x5569bdda1df0 2024-09-10T22:34:51.746 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:51.714+0000 7f9b797fa640 1 --2- 172.21.15.19:0/2565574273 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f9b680b52e0 0x7f9b680b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:34:51.746 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:51.715+0000 7f9b7b7fe640 1 --2- 172.21.15.19:0/1642792079 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5569bdda1df0 0x5569bddad840 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7f9b6c00f8d0 tx=0x7f9b6c00fd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d81d890915aca5c5 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:34:51.747 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:51.715+0000 7f9b797fa640 1 -- 172.21.15.19:0/2565574273 <== mon.2 v2:172.21.15.135:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8327+0+0 (secure 0 0 0) 0x7f9b640e5800 con 0x7f9b7c075de0 2024-09-10T22:34:51.747 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:51.715+0000 7f9b71ffb640 1 -- 172.21.15.19:0/1642792079 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b6c011c20 con 0x5569bdda1df0 2024-09-10T22:34:51.747 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:51.715+0000 7f9b71ffb640 1 -- 172.21.15.19:0/1642792079 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9b6c011dc0 con 0x5569bdda1df0 2024-09-10T22:34:51.747 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:51.715+0000 7f9b71ffb640 1 -- 172.21.15.19:0/1642792079 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b6c018700 con 0x5569bdda1df0 2024-09-10T22:34:51.747 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:51.715+0000 7f9b7bfff640 1 --2- 172.21.15.19:0/2565574273 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f9b680b52e0 0x7f9b680b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:34:51.747 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:51.716+0000 7f9b8448d740 1 -- 172.21.15.19:0/1642792079 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5569bdda1df0 msgr2=0x5569bddad840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:34:51.747 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:51.716+0000 7f9b8448d740 1 --2- 172.21.15.19:0/1642792079 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5569bdda1df0 0x5569bddad840 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7f9b6c00f8d0 tx=0x7f9b6c00fd90 comp rx=0 tx=0).stop 2024-09-10T22:34:51.747 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:51.716+0000 7f9b7bfff640 1 --2- 172.21.15.19:0/2565574273 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f9b680b52e0 0x7f9b680b77a0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f9b74005940 tx=0x7f9b740058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:34:51.747 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:51.716+0000 7f9b8448d740 1 -- 172.21.15.19:0/1642792079 shutdown_connections 2024-09-10T22:34:51.747 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:51.716+0000 7f9b8448d740 1 --2- 172.21.15.19:0/1642792079 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5569bddadd80 0x5569bddb0170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:34:51.747 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:51.716+0000 7f9b8448d740 1 --2- 172.21.15.19:0/1642792079 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5569bdda1df0 0x5569bddad840 unknown :-1 s=CLOSED pgs=750 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:34:51.747 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:51.716+0000 7f9b8448d740 1 --2- 172.21.15.19:0/1642792079 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5569bdda14d0 0x5569bdda18b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:34:51.747 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:51.716+0000 7f9b8448d740 1 -- 172.21.15.19:0/1642792079 >> 172.21.15.19:0/1642792079 conn(0x5569bdd9f300 msgr2=0x5569bdda04a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:34:51.747 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:51.716+0000 7f9b8448d740 1 -- 172.21.15.19:0/1642792079 shutdown_connections 2024-09-10T22:34:51.748 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:51.716+0000 7f9b8448d740 1 -- 172.21.15.19:0/1642792079 wait complete. 2024-09-10T22:34:51.748 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:51.716+0000 7f9b8448d740 1 -- start start 2024-09-10T22:34:51.748 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:51.717+0000 7f9b8448d740 1 Processor -- start 2024-09-10T22:34:51.748 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:51.717+0000 7f9b8448d740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5569bdda14d0 0x5569bddad5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:34:51.748 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:51.717+0000 7f9b8448d740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5569bdda1df0 0x5569bddaaa40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:34:51.748 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:51.717+0000 7f9b8448d740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5569bddadd80 0x5569bddaafc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:34:51.748 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:51.717+0000 7f9b8448d740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x5569bdb68700 con 0x5569bddadd80 2024-09-10T22:34:51.748 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:51.717+0000 7f9b8448d740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x5569bdca2160 con 0x5569bdda14d0 2024-09-10T22:34:51.748 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:51.717+0000 7f9b8448d740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x5569bddb0a00 con 0x5569bdda1df0 2024-09-10T22:34:51.748 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:51.717+0000 7f9b8448d740 10 client.0 _ll_register_callbacks cb 0x5569bdcbb9e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T22:34:51.748 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:51.717+0000 7f9b7bfff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5569bddadd80 0x5569bddaafc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:34:51.748 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:51.717+0000 7f9b7bfff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5569bddadd80 0x5569bddaafc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:49670/0 (socket says 172.21.15.19:49670) 2024-09-10T22:34:51.748 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:51.717+0000 7f9b7bfff640 1 -- 172.21.15.19:0/1949030105 learned_addr learned my addr 172.21.15.19:0/1949030105 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:34:51.749 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:51.717+0000 7f9b7b7fe640 1 --2- 172.21.15.19:0/1949030105 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5569bdda14d0 0x5569bddad5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:34:51.749 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:51.717+0000 7f9b72ffd640 1 --2- 172.21.15.19:0/1949030105 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5569bdda1df0 0x5569bddaaa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:34:51.749 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:51.717+0000 7f9b7bfff640 1 -- 172.21.15.19:0/1949030105 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5569bdda1df0 msgr2=0x5569bddaaa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:34:51.749 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:51.717+0000 7f9b7bfff640 1 --2- 172.21.15.19:0/1949030105 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5569bdda1df0 0x5569bddaaa40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:34:51.749 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:51.718+0000 7f9b7bfff640 1 -- 172.21.15.19:0/1949030105 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5569bdda14d0 msgr2=0x5569bddad5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:34:51.749 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:51.718+0000 7f9b7bfff640 1 --2- 172.21.15.19:0/1949030105 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5569bdda14d0 0x5569bddad5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:34:51.749 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:51.718+0000 7f9b7bfff640 1 -- 172.21.15.19:0/1949030105 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5569bdccfc90 con 0x5569bddadd80 2024-09-10T22:34:51.749 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:51.718+0000 7f9b7b7fe640 1 --2- 172.21.15.19:0/1949030105 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5569bdda14d0 0x5569bddad5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T22:34:51.749 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:51.718+0000 7f9b7bfff640 1 --2- 172.21.15.19:0/1949030105 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5569bddadd80 0x5569bddaafc0 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7f9b74031440 tx=0x7f9b74009260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eda88a0af15f4e18 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:34:51.749 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:51.718+0000 7f9b5affd640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-10T22:34:51.749 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:51.718+0000 7f9b5affd640 1 -- 172.21.15.19:0/1949030105 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b7404d030 con 0x5569bddadd80 2024-09-10T22:34:51.749 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:51.718+0000 7f9b8448d740 1 -- 172.21.15.19:0/1949030105 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9b6c011dc0 con 0x5569bddadd80 2024-09-10T22:34:51.749 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:51.718+0000 7f9b5affd640 1 -- 172.21.15.19:0/1949030105 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8327+0+0 (secure 0 0 0) 0x7f9b74004310 con 0x5569bddadd80 2024-09-10T22:34:51.749 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:51.718+0000 7f9b5affd640 1 -- 172.21.15.19:0/1949030105 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f9b74035040 con 0x5569bddadd80 2024-09-10T22:34:51.750 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:51.718+0000 7f9b8448d740 10 client.17043 fetch_fsmap learned FSMap version 27 2024-09-10T22:34:51.750 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:51.718+0000 7f9b8448d740 1 -- 172.21.15.19:0/1949030105 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x5569bddbc2e0 con 0x5569bddadd80 2024-09-10T22:34:51.750 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:51.718+0000 7f9b5affd640 1 -- 172.21.15.19:0/1949030105 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9b6c011dc0 con 0x5569bddadd80 2024-09-10T22:34:51.750 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:51.718+0000 7f9b5affd640 1 -- 172.21.15.19:0/1949030105 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7f9b7403d5e0 con 0x5569bddadd80 2024-09-10T22:34:51.750 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:51.719+0000 7f9b8448d740 10 client.17043 fetch_fsmap finished waiting for FSMap version 27 2024-09-10T22:34:51.750 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:51.719+0000 7f9b8448d740 10 client.17043 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-10T22:34:51.750 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:51.719+0000 7f9b8448d740 20 client.17043 populate_metadata read hostname 'smithi019' 2024-09-10T22:34:51.750 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:51.719+0000 7f9b8448d740 1 --2- 172.21.15.19:0/1949030105 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x5569bddbd840 0x5569bddbfc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:34:51.750 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:51.719+0000 7f9b8448d740 4 client.17043 mds_command: new command op to 24581 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T22:34:51.750 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:51.719+0000 7f9b8448d740 1 -- 172.21.15.19:0/1949030105 --> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5569bdd19df0 con 0x5569bddbd840 2024-09-10T22:34:51.750 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:51.719+0000 7f9b7b7fe640 1 --2- 172.21.15.19:0/1949030105 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x5569bddbd840 0x5569bddbfc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:34:51.750 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:51.719+0000 7f9b7b7fe640 1 --2- 172.21.15.19:0/1949030105 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x5569bddbd840 0x5569bddbfc70 crc :-1 s=READY pgs=172 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2b6f07b05f083a5f server_cookie=c826111655c29026 in_seq=0 out_seq=0 2024-09-10T22:34:51.750 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:51.719+0000 7f9b5affd640 10 client.17043 ms_handle_connect on v2:172.21.15.135:6838/1254769802 2024-09-10T22:34:51.751 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:51.720+0000 7f9b5affd640 1 -- 172.21.15.19:0/1949030105 <== mds.0 v2:172.21.15.135:6838/1254769802 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5569bdd19df0 con 0x5569bddbd840 2024-09-10T22:34:51.751 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:51.720+0000 7f9b5affd640 10 client.17043 handle_command_reply: tid=0 2024-09-10T22:34:51.751 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:51.720+0000 7f9b8448d740 1 client.17043 shutdown 2024-09-10T22:34:51.751 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:51.720+0000 7f9b8448d740 1 -- 172.21.15.19:0/1949030105 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5569bddadd80 msgr2=0x5569bddaafc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:34:51.751 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:51.720+0000 7f9b8448d740 1 --2- 172.21.15.19:0/1949030105 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5569bddadd80 0x5569bddaafc0 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7f9b74031440 tx=0x7f9b74009260 comp rx=0 tx=0).stop 2024-09-10T22:34:51.751 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:51.720+0000 7f9b8448d740 1 -- 172.21.15.19:0/1949030105 shutdown_connections 2024-09-10T22:34:51.751 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:51.720+0000 7f9b8448d740 1 --2- 172.21.15.19:0/1949030105 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5569bddadd80 0x5569bddaafc0 unknown :-1 s=CLOSED pgs=751 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:34:51.751 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:51.720+0000 7f9b8448d740 1 --2- 172.21.15.19:0/1949030105 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x5569bddbd840 0x5569bddbfc70 crc :-1 s=READY pgs=172 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:34:51.751 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:51.720+0000 7f9b8448d740 1 --2- 172.21.15.19:0/1949030105 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5569bdda1df0 0x5569bddaaa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:34:51.751 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:51.720+0000 7f9b8448d740 1 --2- 172.21.15.19:0/1949030105 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5569bdda14d0 0x5569bddad5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:34:51.751 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:51.720+0000 7f9b8448d740 1 -- 172.21.15.19:0/1949030105 >> 172.21.15.19:0/1949030105 conn(0x5569bdd9f300 msgr2=0x5569bdda4ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:34:51.751 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:51.720+0000 7f9b5affd640 0 client.17043 ms_handle_reset on v2:172.21.15.135:6838/1254769802 2024-09-10T22:34:51.751 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:51.720+0000 7f9b8448d740 1 -- 172.21.15.19:0/1949030105 shutdown_connections 2024-09-10T22:34:51.751 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:51.720+0000 7f9b8448d740 1 -- 172.21.15.19:0/1949030105 wait complete. 2024-09-10T22:34:51.752 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:51.720+0000 7f9b8448d740 20 client.17043 trim_cache size 0 max 16384 2024-09-10T22:34:51.752 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:51.734+0000 7f9b8448d740 1 Processor -- start 2024-09-10T22:34:51.752 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:51.735+0000 7f9b8448d740 1 -- start start 2024-09-10T22:34:51.752 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:51.735+0000 7f9b8448d740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5569bdda14d0 0x5569bddb9c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:34:51.752 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:51.735+0000 7f9b8448d740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5569bdda1df0 0x5569bddbf850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:34:51.752 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:51.735+0000 7f9b8448d740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5569bddadd80 0x5569bddaf170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:34:51.752 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:51.735+0000 7f9b8448d740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f9b7c1b2ff0 con 0x5569bdda1df0 2024-09-10T22:34:51.752 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:51.735+0000 7f9b8448d740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f9b7c1b08c0 con 0x5569bddadd80 2024-09-10T22:34:51.752 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:51.735+0000 7f9b8448d740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f9b7c1ae710 con 0x5569bdda14d0 2024-09-10T22:34:51.752 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:51.735+0000 7f9b72ffd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5569bdda1df0 0x5569bddbf850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:34:51.752 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:51.735+0000 7f9b72ffd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5569bdda1df0 0x5569bddbf850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:49674/0 (socket says 172.21.15.19:49674) 2024-09-10T22:34:51.752 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:51.735+0000 7f9b72ffd640 1 -- 172.21.15.19:0/2310044709 learned_addr learned my addr 172.21.15.19:0/2310044709 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:34:51.752 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:51.735+0000 7f9b7bfff640 1 --2- 172.21.15.19:0/2310044709 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5569bddadd80 0x5569bddaf170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:34:51.753 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:51.735+0000 7f9b7b7fe640 1 --2- 172.21.15.19:0/2310044709 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5569bdda14d0 0x5569bddb9c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:34:51.753 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:51.735+0000 7f9b72ffd640 1 -- 172.21.15.19:0/2310044709 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5569bdda14d0 msgr2=0x5569bddb9c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:34:51.753 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:51.735+0000 7f9b72ffd640 1 --2- 172.21.15.19:0/2310044709 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5569bdda14d0 0x5569bddb9c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:34:51.753 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:51.735+0000 7f9b72ffd640 1 -- 172.21.15.19:0/2310044709 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5569bddadd80 msgr2=0x5569bddaf170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:34:51.753 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:51.735+0000 7f9b72ffd640 1 --2- 172.21.15.19:0/2310044709 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5569bddadd80 0x5569bddaf170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:34:51.753 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:51.735+0000 7f9b72ffd640 1 -- 172.21.15.19:0/2310044709 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5569bdda8f40 con 0x5569bdda1df0 2024-09-10T22:34:51.753 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:51.735+0000 7f9b72ffd640 1 --2- 172.21.15.19:0/2310044709 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5569bdda1df0 0x5569bddbf850 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7f9b640eb2f0 tx=0x7f9b640eb550 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1110ecee182299f4 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:34:51.753 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:51.736+0000 7f9b717fa640 1 -- 172.21.15.19:0/2310044709 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b640abd30 con 0x5569bdda1df0 2024-09-10T22:34:51.753 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:51.736+0000 7f9b717fa640 1 -- 172.21.15.19:0/2310044709 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9b64005020 con 0x5569bdda1df0 2024-09-10T22:34:51.753 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:51.736+0000 7f9b717fa640 1 -- 172.21.15.19:0/2310044709 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b640ab6d0 con 0x5569bdda1df0 2024-09-10T22:34:51.753 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:51.736+0000 7f9b8448d740 1 -- 172.21.15.19:0/2310044709 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5569bdda1df0 msgr2=0x5569bddbf850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:34:51.753 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:51.736+0000 7f9b8448d740 1 --2- 172.21.15.19:0/2310044709 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5569bdda1df0 0x5569bddbf850 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7f9b640eb2f0 tx=0x7f9b640eb550 comp rx=0 tx=0).stop 2024-09-10T22:34:51.753 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:51.736+0000 7f9b8448d740 1 -- 172.21.15.19:0/2310044709 shutdown_connections 2024-09-10T22:34:51.753 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:51.736+0000 7f9b8448d740 1 --2- 172.21.15.19:0/2310044709 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5569bddadd80 0x5569bddaf170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:34:51.754 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:51.736+0000 7f9b8448d740 1 --2- 172.21.15.19:0/2310044709 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5569bdda1df0 0x5569bddbf850 unknown :-1 s=CLOSED pgs=752 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:34:51.754 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:51.736+0000 7f9b8448d740 1 --2- 172.21.15.19:0/2310044709 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5569bdda14d0 0x5569bddb9c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:34:51.754 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:51.736+0000 7f9b8448d740 1 -- 172.21.15.19:0/2310044709 >> 172.21.15.19:0/2310044709 conn(0x5569bdd9f300 msgr2=0x5569bddaaa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:34:51.754 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:51.736+0000 7f9b8448d740 1 -- 172.21.15.19:0/2310044709 shutdown_connections 2024-09-10T22:34:51.754 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:51.737+0000 7f9b8448d740 1 -- 172.21.15.19:0/2310044709 wait complete. 2024-09-10T22:34:51.754 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:51.737+0000 7f9b8448d740 1 -- start start 2024-09-10T22:34:51.754 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:51.737+0000 7f9b8448d740 1 Processor -- start 2024-09-10T22:34:51.754 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:51.737+0000 7f9b8448d740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5569bdda14d0 0x5569bddb5cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:34:51.754 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:51.737+0000 7f9b8448d740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5569bdda1df0 0x5569bddb6210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:34:51.754 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:51.737+0000 7f9b8448d740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5569bddadd80 0x5569bddb0c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:34:51.754 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:51.737+0000 7f9b8448d740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f9b7c1aed80 con 0x5569bdda14d0 2024-09-10T22:34:51.754 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:51.737+0000 7f9b8448d740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f9b7c1b01f0 con 0x5569bdda1df0 2024-09-10T22:34:51.754 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:51.737+0000 7f9b8448d740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f9b7c1af450 con 0x5569bddadd80 2024-09-10T22:34:51.755 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:51.737+0000 7f9b8448d740 10 client.0 _ll_register_callbacks cb 0x7f9b74005710 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T22:34:51.755 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:51.737+0000 7f9b7b7fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5569bdda14d0 0x5569bddb5cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:34:51.755 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:51.737+0000 7f9b7b7fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5569bdda14d0 0x5569bddb5cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:49676/0 (socket says 172.21.15.19:49676) 2024-09-10T22:34:51.755 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:51.737+0000 7f9b7b7fe640 1 -- 172.21.15.19:0/2925003314 learned_addr learned my addr 172.21.15.19:0/2925003314 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:34:51.755 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:51.737+0000 7f9b72ffd640 1 --2- 172.21.15.19:0/2925003314 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5569bdda1df0 0x5569bddb6210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:34:51.755 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:51.738+0000 7f9b7bfff640 1 --2- 172.21.15.19:0/2925003314 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5569bddadd80 0x5569bddb0c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:34:51.755 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:51.738+0000 7f9b7b7fe640 1 -- 172.21.15.19:0/2925003314 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5569bddadd80 msgr2=0x5569bddb0c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:34:51.755 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:51.738+0000 7f9b7b7fe640 1 --2- 172.21.15.19:0/2925003314 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5569bddadd80 0x5569bddb0c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:34:51.755 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:51.738+0000 7f9b7b7fe640 1 -- 172.21.15.19:0/2925003314 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5569bdda1df0 msgr2=0x5569bddb6210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:34:51.755 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:51.738+0000 7f9b7b7fe640 1 --2- 172.21.15.19:0/2925003314 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5569bdda1df0 0x5569bddb6210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:34:51.755 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:51.738+0000 7f9b7b7fe640 1 -- 172.21.15.19:0/2925003314 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5569bddb6950 con 0x5569bdda14d0 2024-09-10T22:34:51.755 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:51.738+0000 7f9b72ffd640 1 --2- 172.21.15.19:0/2925003314 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5569bdda1df0 0x5569bddb6210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T22:34:51.755 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:51.738+0000 7f9b7b7fe640 1 --2- 172.21.15.19:0/2925003314 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5569bdda14d0 0x5569bddb5cd0 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7f9b6c011810 tx=0x7f9b6c0096c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8c7637ed98cd0ec6 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:34:51.755 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:51.738+0000 7f9b5affd640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-10T22:34:51.756 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:51.738+0000 7f9b5affd640 1 -- 172.21.15.19:0/2925003314 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b6c02f070 con 0x5569bdda14d0 2024-09-10T22:34:51.756 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:51.738+0000 7f9b5affd640 1 -- 172.21.15.19:0/2925003314 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8327+0+0 (secure 0 0 0) 0x7f9b6c003ce0 con 0x5569bdda14d0 2024-09-10T22:34:51.756 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:51.738+0000 7f9b8448d740 1 -- 172.21.15.19:0/2925003314 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5569bdd158a0 con 0x5569bdda14d0 2024-09-10T22:34:51.756 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:51.738+0000 7f9b5affd640 1 -- 172.21.15.19:0/2925003314 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f9b6c03b050 con 0x5569bdda14d0 2024-09-10T22:34:51.756 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:51.738+0000 7f9b8448d740 10 client.17049 fetch_fsmap learned FSMap version 27 2024-09-10T22:34:51.756 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:51.738+0000 7f9b8448d740 1 -- 172.21.15.19:0/2925003314 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x5569bde2ac70 con 0x5569bdda14d0 2024-09-10T22:34:51.756 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:51.739+0000 7f9b5affd640 1 -- 172.21.15.19:0/2925003314 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x5569bdd158a0 con 0x5569bdda14d0 2024-09-10T22:34:51.756 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:51.739+0000 7f9b5affd640 1 -- 172.21.15.19:0/2925003314 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7f9b6c019420 con 0x5569bdda14d0 2024-09-10T22:34:51.756 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:51.739+0000 7f9b8448d740 10 client.17049 fetch_fsmap finished waiting for FSMap version 27 2024-09-10T22:34:51.757 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:51.739+0000 7f9b8448d740 10 client.17049 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-10T22:34:51.757 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:51.739+0000 7f9b8448d740 20 client.17049 populate_metadata read hostname 'smithi019' 2024-09-10T22:34:51.757 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:51.739+0000 7f9b8448d740 1 --2- 172.21.15.19:0/2925003314 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x5569bde2b200 0x5569bde2d620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:34:51.757 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:51.739+0000 7f9b8448d740 4 client.17049 mds_command: new command op to 24581 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-10T22:34:51.757 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:51.739+0000 7f9b8448d740 1 -- 172.21.15.19:0/2925003314 --> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5569bdd12cd0 con 0x5569bde2b200 2024-09-10T22:34:51.757 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:51.739+0000 7f9b72ffd640 1 --2- 172.21.15.19:0/2925003314 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x5569bde2b200 0x5569bde2d620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:34:51.757 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:51.740+0000 7f9b5affd640 10 client.17049 ms_handle_connect on v2:172.21.15.135:6838/1254769802 2024-09-10T22:34:51.757 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:51.740+0000 7f9b72ffd640 1 --2- 172.21.15.19:0/2925003314 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x5569bde2b200 0x5569bde2d620 crc :-1 s=READY pgs=173 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=264fd11d6b1535a0 server_cookie=ad4b65662cb1406e in_seq=0 out_seq=0 2024-09-10T22:34:51.757 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:51.740+0000 7f9b5affd640 1 -- 172.21.15.19:0/2925003314 <== mds.0 v2:172.21.15.135:6838/1254769802 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5569bdd12cd0 con 0x5569bde2b200 2024-09-10T22:34:51.758 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:51.740+0000 7f9b5affd640 10 client.17049 handle_command_reply: tid=0 2024-09-10T22:34:51.758 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:51.740+0000 7f9b8448d740 1 client.17049 shutdown 2024-09-10T22:34:51.758 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:51.740+0000 7f9b8448d740 1 -- 172.21.15.19:0/2925003314 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5569bdda14d0 msgr2=0x5569bddb5cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:34:51.758 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:51.740+0000 7f9b8448d740 1 --2- 172.21.15.19:0/2925003314 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5569bdda14d0 0x5569bddb5cd0 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7f9b6c011810 tx=0x7f9b6c0096c0 comp rx=0 tx=0).stop 2024-09-10T22:34:51.758 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:51.740+0000 7f9b8448d740 1 -- 172.21.15.19:0/2925003314 shutdown_connections 2024-09-10T22:34:51.758 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:51.740+0000 7f9b8448d740 1 --2- 172.21.15.19:0/2925003314 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x5569bde2b200 0x5569bde2d620 crc :-1 s=READY pgs=173 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:34:51.758 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:51.740+0000 7f9b5affd640 0 client.17049 ms_handle_reset on v2:172.21.15.135:6838/1254769802 2024-09-10T22:34:51.758 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:51.740+0000 7f9b8448d740 1 --2- 172.21.15.19:0/2925003314 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5569bddadd80 0x5569bddb0c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:34:51.758 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:51.740+0000 7f9b8448d740 1 --2- 172.21.15.19:0/2925003314 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5569bdda1df0 0x5569bddb6210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:34:51.758 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:51.740+0000 7f9b8448d740 1 --2- 172.21.15.19:0/2925003314 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5569bdda14d0 0x5569bddb5cd0 unknown :-1 s=CLOSED pgs=753 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:34:51.759 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:51.740+0000 7f9b8448d740 1 -- 172.21.15.19:0/2925003314 >> 172.21.15.19:0/2925003314 conn(0x5569bdd9f300 msgr2=0x5569bddac070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:34:51.759 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:51.740+0000 7f9b8448d740 1 -- 172.21.15.19:0/2925003314 shutdown_connections 2024-09-10T22:34:51.759 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:51.740+0000 7f9b8448d740 1 -- 172.21.15.19:0/2925003314 wait complete. 2024-09-10T22:34:51.759 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:51.740+0000 7f9b8448d740 20 client.17049 trim_cache size 0 max 16384 2024-09-10T22:34:51.759 INFO:teuthology.orchestra.run.smithi019.stdout:[] 2024-09-10T22:34:51.760 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:51.741+0000 7f9b820b8640 1 -- 172.21.15.19:0/2565574273 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f9b680b52e0 msgr2=0x7f9b680b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:34:51.760 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:51.741+0000 7f9b820b8640 1 --2- 172.21.15.19:0/2565574273 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f9b680b52e0 0x7f9b680b77a0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f9b74005940 tx=0x7f9b740058d0 comp rx=0 tx=0).stop 2024-09-10T22:34:51.760 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:51.741+0000 7f9b820b8640 1 -- 172.21.15.19:0/2565574273 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9b7c075de0 msgr2=0x7f9b7c19b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:34:51.760 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:51.741+0000 7f9b820b8640 1 --2- 172.21.15.19:0/2565574273 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9b7c075de0 0x7f9b7c19b9d0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f9b6400d720 tx=0x7f9b6400dbe0 comp rx=0 tx=0).stop 2024-09-10T22:34:51.760 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:51.741+0000 7f9b820b8640 1 -- 172.21.15.19:0/2565574273 shutdown_connections 2024-09-10T22:34:51.760 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:51.741+0000 7f9b820b8640 1 --2- 172.21.15.19:0/2565574273 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f9b680b52e0 0x7f9b680b77a0 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:34:51.760 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:51.741+0000 7f9b820b8640 1 --2- 172.21.15.19:0/2565574273 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f9b7c10f3f0 0x7f9b7c1a0d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:34:51.760 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:51.741+0000 7f9b820b8640 1 --2- 172.21.15.19:0/2565574273 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9b7c075de0 0x7f9b7c19b9d0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:34:51.760 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:51.741+0000 7f9b820b8640 1 --2- 172.21.15.19:0/2565574273 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9b7c0754c0 0x7f9b7c19b490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:34:51.760 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:51.741+0000 7f9b820b8640 1 -- 172.21.15.19:0/2565574273 >> 172.21.15.19:0/2565574273 conn(0x7f9b7c0fe830 msgr2=0x7f9b7c1115e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:34:51.761 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:51.741+0000 7f9b820b8640 1 -- 172.21.15.19:0/2565574273 shutdown_connections 2024-09-10T22:34:51.761 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:51.741+0000 7f9b820b8640 1 -- 172.21.15.19:0/2565574273 wait complete. 2024-09-10T22:34:52.453 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:34:52 smithi019 ceph-mon[31375]: pgmap v600: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 728 KiB/s rd, 278 MiB/s wr, 736 op/s 2024-09-10T22:34:52.610 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:34:52 smithi135 ceph-mon[34789]: pgmap v600: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 728 KiB/s rd, 278 MiB/s wr, 736 op/s 2024-09-10T22:34:52.625 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:34:52 smithi138 ceph-mon[35236]: pgmap v600: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 728 KiB/s rd, 278 MiB/s wr, 736 op/s 2024-09-10T22:34:53.485 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-10T22:34:53.486 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 22997a4c-6fc2-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-10T22:34:53.831 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/22997a4c-6fc2-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T22:34:54.427 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:54.416+0000 7f0c7b61b640 1 -- 172.21.15.19:0/3936670343 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0c741045c0 msgr2=0x7f0c7410cab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:34:54.428 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:54.416+0000 7f0c7b61b640 1 --2- 172.21.15.19:0/3936670343 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0c741045c0 0x7f0c7410cab0 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 crypto rx=0x7f0c68009900 tx=0x7f0c6802a410 comp rx=0 tx=0).stop 2024-09-10T22:34:54.428 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:54.416+0000 7f0c7b61b640 1 -- 172.21.15.19:0/3936670343 shutdown_connections 2024-09-10T22:34:54.428 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:54.416+0000 7f0c7b61b640 1 --2- 172.21.15.19:0/3936670343 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f0c7410d100 0x7f0c7410f560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:34:54.428 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:54.416+0000 7f0c7b61b640 1 --2- 172.21.15.19:0/3936670343 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0c741045c0 0x7f0c7410cab0 unknown :-1 s=CLOSED pgs=754 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:34:54.428 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:54.416+0000 7f0c7b61b640 1 --2- 172.21.15.19:0/3936670343 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0c74103ca0 0x7f0c74104080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:34:54.428 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:54.416+0000 7f0c7b61b640 1 -- 172.21.15.19:0/3936670343 >> 172.21.15.19:0/3936670343 conn(0x7f0c740fd700 msgr2=0x7f0c740ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:34:54.428 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:54.416+0000 7f0c7b61b640 1 -- 172.21.15.19:0/3936670343 shutdown_connections 2024-09-10T22:34:54.429 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:54.416+0000 7f0c7b61b640 1 -- 172.21.15.19:0/3936670343 wait complete. 2024-09-10T22:34:54.429 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:54.417+0000 7f0c7b61b640 1 Processor -- start 2024-09-10T22:34:54.429 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:54.417+0000 7f0c7b61b640 1 -- start start 2024-09-10T22:34:54.429 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:54.417+0000 7f0c7b61b640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0c74103ca0 0x7f0c741992c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:34:54.429 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:54.417+0000 7f0c7b61b640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f0c741045c0 0x7f0c74199800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:34:54.429 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:54.417+0000 7f0c7b61b640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0c7410d100 0x7f0c7419eba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:34:54.429 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:54.417+0000 7f0c7b61b640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f0c74112d70 con 0x7f0c7410d100 2024-09-10T22:34:54.429 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:54.417+0000 7f0c7b61b640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f0c74112bf0 con 0x7f0c74103ca0 2024-09-10T22:34:54.429 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:54.417+0000 7f0c7b61b640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f0c74112ef0 con 0x7f0c741045c0 2024-09-10T22:34:54.429 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:54.417+0000 7f0c79bb8640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0c7410d100 0x7f0c7419eba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:34:54.429 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:54.417+0000 7f0c79bb8640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0c7410d100 0x7f0c7419eba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:33438/0 (socket says 172.21.15.19:33438) 2024-09-10T22:34:54.430 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:54.417+0000 7f0c79bb8640 1 -- 172.21.15.19:0/1259474304 learned_addr learned my addr 172.21.15.19:0/1259474304 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:34:54.430 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:54.417+0000 7f0c793b7640 1 --2- 172.21.15.19:0/1259474304 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0c74103ca0 0x7f0c741992c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:34:54.430 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:54.417+0000 7f0c78bb6640 1 --2- 172.21.15.19:0/1259474304 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f0c741045c0 0x7f0c74199800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:34:54.430 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:54.418+0000 7f0c79bb8640 1 -- 172.21.15.19:0/1259474304 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f0c741045c0 msgr2=0x7f0c74199800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:34:54.430 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:54.418+0000 7f0c79bb8640 1 --2- 172.21.15.19:0/1259474304 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f0c741045c0 0x7f0c74199800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:34:54.430 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:54.418+0000 7f0c79bb8640 1 -- 172.21.15.19:0/1259474304 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0c74103ca0 msgr2=0x7f0c741992c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:34:54.430 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:54.418+0000 7f0c79bb8640 1 --2- 172.21.15.19:0/1259474304 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0c74103ca0 0x7f0c741992c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:34:54.430 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:54.418+0000 7f0c79bb8640 1 -- 172.21.15.19:0/1259474304 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0c7419f370 con 0x7f0c7410d100 2024-09-10T22:34:54.430 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:54.418+0000 7f0c793b7640 1 --2- 172.21.15.19:0/1259474304 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0c74103ca0 0x7f0c741992c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T22:34:54.430 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:54.418+0000 7f0c79bb8640 1 --2- 172.21.15.19:0/1259474304 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0c7410d100 0x7f0c7419eba0 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7f0c6c00e970 tx=0x7f0c6c00ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:34:54.430 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:54.418+0000 7f0c727fc640 1 -- 172.21.15.19:0/1259474304 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c6c00ccc0 con 0x7f0c7410d100 2024-09-10T22:34:54.430 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:54.418+0000 7f0c727fc640 1 -- 172.21.15.19:0/1259474304 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0c6c00ce60 con 0x7f0c7410d100 2024-09-10T22:34:54.431 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:54.418+0000 7f0c7b61b640 1 -- 172.21.15.19:0/1259474304 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0c7419f660 con 0x7f0c7410d100 2024-09-10T22:34:54.431 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:54.418+0000 7f0c727fc640 1 -- 172.21.15.19:0/1259474304 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c6c010430 con 0x7f0c7410d100 2024-09-10T22:34:54.431 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:54.418+0000 7f0c7b61b640 1 -- 172.21.15.19:0/1259474304 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0c741a5d20 con 0x7f0c7410d100 2024-09-10T22:34:54.431 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:54.421+0000 7f0c727fc640 1 -- 172.21.15.19:0/1259474304 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 18) ==== 153250+0+0 (secure 0 0 0) 0x7f0c6c004f90 con 0x7f0c7410d100 2024-09-10T22:34:54.431 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:54.421+0000 7f0c7d9f0740 1 Processor -- start 2024-09-10T22:34:54.431 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:54.421+0000 7f0c7d9f0740 1 -- start start 2024-09-10T22:34:54.431 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:54.421+0000 7f0c7d9f0740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x564ef9063ee0 0x564ef90642c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:34:54.431 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:54.421+0000 7f0c7d9f0740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564ef9064800 0x564ef9070250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:34:54.431 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:54.421+0000 7f0c7d9f0740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x564ef9070790 0x564ef9072b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:34:54.431 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:54.421+0000 7f0c7d9f0740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x564ef8fdae60 con 0x564ef9063ee0 2024-09-10T22:34:54.431 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:54.421+0000 7f0c7d9f0740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x564ef8fca290 con 0x564ef9064800 2024-09-10T22:34:54.431 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:54.421+0000 7f0c7d9f0740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x564ef8fce0a0 con 0x564ef9070790 2024-09-10T22:34:54.431 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:54.421+0000 7f0c78bb6640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x564ef9063ee0 0x564ef90642c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:34:54.431 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:54.421+0000 7f0c78bb6640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x564ef9063ee0 0x564ef90642c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:33442/0 (socket says 172.21.15.19:33442) 2024-09-10T22:34:54.432 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:54.421+0000 7f0c78bb6640 1 -- 172.21.15.19:0/4241464340 learned_addr learned my addr 172.21.15.19:0/4241464340 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:34:54.432 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:54.421+0000 7f0c793b7640 1 --2- 172.21.15.19:0/4241464340 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564ef9064800 0x564ef9070250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:34:54.432 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:54.422+0000 7f0c78bb6640 1 --2- 172.21.15.19:0/4241464340 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x564ef9070790 0x564ef9072b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:34:54.432 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:54.422+0000 7f0c793b7640 1 -- 172.21.15.19:0/4241464340 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x564ef9070790 msgr2=0x564ef9072b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:34:54.432 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:54.422+0000 7f0c793b7640 1 --2- 172.21.15.19:0/4241464340 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x564ef9070790 0x564ef9072b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:34:54.432 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:54.422+0000 7f0c793b7640 1 -- 172.21.15.19:0/4241464340 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x564ef9063ee0 msgr2=0x564ef90642c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:34:54.432 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:54.422+0000 7f0c793b7640 1 --2- 172.21.15.19:0/4241464340 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x564ef9063ee0 0x564ef90642c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:34:54.432 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:54.422+0000 7f0c793b7640 1 -- 172.21.15.19:0/4241464340 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564ef8d28930 con 0x564ef9064800 2024-09-10T22:34:54.432 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:54.422+0000 7f0c727fc640 1 --2- 172.21.15.19:0/1259474304 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f0c5c0b52e0 0x7f0c5c0b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:34:54.432 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:54.422+0000 7f0c793b7640 1 --2- 172.21.15.19:0/4241464340 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564ef9064800 0x564ef9070250 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f0c64005fd0 tx=0x7f0c64011c70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ec1f1e9eadadb9a7 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:34:54.433 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:54.422+0000 7f0c78bb6640 1 --2- 172.21.15.19:0/1259474304 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f0c5c0b52e0 0x7f0c5c0b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:34:54.433 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:54.422+0000 7f0c727fc640 1 -- 172.21.15.19:0/1259474304 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8327+0+0 (secure 0 0 0) 0x7f0c6c0e6010 con 0x7f0c7410d100 2024-09-10T22:34:54.433 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:54.422+0000 7f0c5b7fe640 1 -- 172.21.15.19:0/4241464340 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c64003c30 con 0x564ef9064800 2024-09-10T22:34:54.433 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:54.422+0000 7f0c5b7fe640 1 -- 172.21.15.19:0/4241464340 <== mon.2 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0c64003dd0 con 0x564ef9064800 2024-09-10T22:34:54.433 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:54.422+0000 7f0c5b7fe640 1 -- 172.21.15.19:0/4241464340 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c640193e0 con 0x564ef9064800 2024-09-10T22:34:54.433 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:54.423+0000 7f0c7d9f0740 1 -- 172.21.15.19:0/4241464340 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564ef9064800 msgr2=0x564ef9070250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:34:54.433 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:54.423+0000 7f0c78bb6640 1 --2- 172.21.15.19:0/1259474304 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f0c5c0b52e0 0x7f0c5c0b77a0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x564ef9063e90 tx=0x7f0c68041040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:34:54.433 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:54.423+0000 7f0c7d9f0740 1 --2- 172.21.15.19:0/4241464340 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564ef9064800 0x564ef9070250 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f0c64005fd0 tx=0x7f0c64011c70 comp rx=0 tx=0).stop 2024-09-10T22:34:54.433 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:54.423+0000 7f0c7d9f0740 1 -- 172.21.15.19:0/4241464340 shutdown_connections 2024-09-10T22:34:54.433 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:54.423+0000 7f0c7d9f0740 1 --2- 172.21.15.19:0/4241464340 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x564ef9070790 0x564ef9072b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:34:54.433 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:54.423+0000 7f0c7d9f0740 1 --2- 172.21.15.19:0/4241464340 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564ef9064800 0x564ef9070250 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:34:54.433 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:54.423+0000 7f0c7d9f0740 1 --2- 172.21.15.19:0/4241464340 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x564ef9063ee0 0x564ef90642c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:34:54.434 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:54.423+0000 7f0c7d9f0740 1 -- 172.21.15.19:0/4241464340 >> 172.21.15.19:0/4241464340 conn(0x564ef9061d10 msgr2=0x564ef9062eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:34:54.434 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:54.423+0000 7f0c7d9f0740 1 -- 172.21.15.19:0/4241464340 shutdown_connections 2024-09-10T22:34:54.434 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:54.423+0000 7f0c7d9f0740 1 -- 172.21.15.19:0/4241464340 wait complete. 2024-09-10T22:34:54.434 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:54.424+0000 7f0c7d9f0740 1 -- start start 2024-09-10T22:34:54.434 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:54.424+0000 7f0c7d9f0740 1 Processor -- start 2024-09-10T22:34:54.434 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:54.424+0000 7f0c7d9f0740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x564ef9063ee0 0x564ef906ff50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:34:54.434 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:54.424+0000 7f0c7d9f0740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564ef9064800 0x564ef9069380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:34:54.434 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:54.424+0000 7f0c7d9f0740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x564ef9070790 0x564ef90698c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:34:54.434 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:54.424+0000 7f0c7d9f0740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x564ef8e2b890 con 0x564ef9070790 2024-09-10T22:34:54.434 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:54.424+0000 7f0c7d9f0740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x564ef8f64d40 con 0x564ef9064800 2024-09-10T22:34:54.434 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:54.424+0000 7f0c7d9f0740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x564ef9077790 con 0x564ef9063ee0 2024-09-10T22:34:54.434 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:54.424+0000 7f0c7d9f0740 10 client.0 _ll_register_callbacks cb 0x564ef8fc8c80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T22:34:54.434 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:54.424+0000 7f0c79bb8640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x564ef9070790 0x564ef90698c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:34:54.434 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:54.424+0000 7f0c793b7640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x564ef9063ee0 0x564ef906ff50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:34:54.435 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:54.424+0000 7f0c79bb8640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x564ef9070790 0x564ef90698c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:33458/0 (socket says 172.21.15.19:33458) 2024-09-10T22:34:54.435 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:54.424+0000 7f0c79bb8640 1 -- 172.21.15.19:0/4161024433 learned_addr learned my addr 172.21.15.19:0/4161024433 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:34:54.435 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:54.424+0000 7f0c78bb6640 1 --2- 172.21.15.19:0/4161024433 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564ef9064800 0x564ef9069380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:34:54.435 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:54.425+0000 7f0c79bb8640 1 -- 172.21.15.19:0/4161024433 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x564ef9063ee0 msgr2=0x564ef906ff50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:34:54.435 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:54.425+0000 7f0c79bb8640 1 --2- 172.21.15.19:0/4161024433 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x564ef9063ee0 0x564ef906ff50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:34:54.435 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:54.425+0000 7f0c79bb8640 1 -- 172.21.15.19:0/4161024433 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564ef9064800 msgr2=0x564ef9069380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:34:54.435 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:54.425+0000 7f0c79bb8640 1 --2- 172.21.15.19:0/4161024433 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564ef9064800 0x564ef9069380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:34:54.435 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:54.425+0000 7f0c79bb8640 1 -- 172.21.15.19:0/4161024433 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564ef906a0a0 con 0x564ef9070790 2024-09-10T22:34:54.435 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:54.425+0000 7f0c793b7640 1 --2- 172.21.15.19:0/4161024433 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x564ef9063ee0 0x564ef906ff50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T22:34:54.436 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:54.425+0000 7f0c79bb8640 1 --2- 172.21.15.19:0/4161024433 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x564ef9070790 0x564ef90698c0 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7f0c6c0a8050 tx=0x7f0c6c0ac010 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3ea5d6f578f08706 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:34:54.436 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:54.425+0000 7f0c58ff9640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-10T22:34:54.436 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:54.425+0000 7f0c58ff9640 1 -- 172.21.15.19:0/4161024433 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c6c0b1020 con 0x564ef9070790 2024-09-10T22:34:54.436 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:54.425+0000 7f0c58ff9640 1 -- 172.21.15.19:0/4161024433 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8327+0+0 (secure 0 0 0) 0x7f0c6c0ab9d0 con 0x564ef9070790 2024-09-10T22:34:54.436 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:54.425+0000 7f0c7d9f0740 1 -- 172.21.15.19:0/4161024433 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0c64003dd0 con 0x564ef9070790 2024-09-10T22:34:54.436 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:54.425+0000 7f0c58ff9640 1 -- 172.21.15.19:0/4161024433 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f0c6c0ace70 con 0x564ef9070790 2024-09-10T22:34:54.436 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:54.425+0000 7f0c7d9f0740 10 client.17061 fetch_fsmap learned FSMap version 27 2024-09-10T22:34:54.436 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:54.425+0000 7f0c7d9f0740 1 -- 172.21.15.19:0/4161024433 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x564ef9087a30 con 0x564ef9070790 2024-09-10T22:34:54.436 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:54.425+0000 7f0c58ff9640 1 -- 172.21.15.19:0/4161024433 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0c64003dd0 con 0x564ef9070790 2024-09-10T22:34:54.436 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:54.426+0000 7f0c58ff9640 1 -- 172.21.15.19:0/4161024433 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7f0c6c0c3050 con 0x564ef9070790 2024-09-10T22:34:54.436 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:54.426+0000 7f0c7d9f0740 10 client.17061 fetch_fsmap finished waiting for FSMap version 27 2024-09-10T22:34:54.436 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:54.426+0000 7f0c7d9f0740 10 client.17061 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-10T22:34:54.436 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:54.426+0000 7f0c7d9f0740 20 client.17061 populate_metadata read hostname 'smithi019' 2024-09-10T22:34:54.437 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:54.426+0000 7f0c7d9f0740 1 --2- 172.21.15.19:0/4161024433 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x564ef9088e20 0x564ef908b2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:34:54.437 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:54.426+0000 7f0c7d9f0740 4 client.17061 mds_command: new command op to 24581 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T22:34:54.437 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:54.426+0000 7f0c7d9f0740 1 -- 172.21.15.19:0/4161024433 --> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564ef8fdcdb0 con 0x564ef9088e20 2024-09-10T22:34:54.437 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:54.426+0000 7f0c793b7640 1 --2- 172.21.15.19:0/4161024433 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x564ef9088e20 0x564ef908b2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:34:54.438 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:54.426+0000 7f0c793b7640 1 --2- 172.21.15.19:0/4161024433 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x564ef9088e20 0x564ef908b2a0 crc :-1 s=READY pgs=174 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=53f30bdd2354e197 server_cookie=87afe5fcbb8b0736 in_seq=0 out_seq=0 2024-09-10T22:34:54.438 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:54.426+0000 7f0c58ff9640 10 client.17061 ms_handle_connect on v2:172.21.15.135:6838/1254769802 2024-09-10T22:34:54.438 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:54.427+0000 7f0c58ff9640 1 -- 172.21.15.19:0/4161024433 <== mds.0 v2:172.21.15.135:6838/1254769802 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x564ef8fdcdb0 con 0x564ef9088e20 2024-09-10T22:34:54.438 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:54.427+0000 7f0c58ff9640 10 client.17061 handle_command_reply: tid=0 2024-09-10T22:34:54.438 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:54.427+0000 7f0c7d9f0740 1 client.17061 shutdown 2024-09-10T22:34:54.438 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:54.427+0000 7f0c7d9f0740 1 -- 172.21.15.19:0/4161024433 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x564ef9070790 msgr2=0x564ef90698c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:34:54.439 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:54.427+0000 7f0c7d9f0740 1 --2- 172.21.15.19:0/4161024433 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x564ef9070790 0x564ef90698c0 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7f0c6c0a8050 tx=0x7f0c6c0ac010 comp rx=0 tx=0).stop 2024-09-10T22:34:54.439 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:54.427+0000 7f0c7d9f0740 1 -- 172.21.15.19:0/4161024433 shutdown_connections 2024-09-10T22:34:54.439 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:54.427+0000 7f0c7d9f0740 1 --2- 172.21.15.19:0/4161024433 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x564ef9070790 0x564ef90698c0 unknown :-1 s=CLOSED pgs=756 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:34:54.439 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:54.427+0000 7f0c7d9f0740 1 --2- 172.21.15.19:0/4161024433 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564ef9064800 0x564ef9069380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:34:54.439 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:54.427+0000 7f0c7d9f0740 1 --2- 172.21.15.19:0/4161024433 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x564ef9088e20 0x564ef908b2a0 crc :-1 s=READY pgs=174 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:34:54.439 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:54.427+0000 7f0c7d9f0740 1 --2- 172.21.15.19:0/4161024433 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x564ef9063ee0 0x564ef906ff50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:34:54.439 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:54.427+0000 7f0c7d9f0740 1 -- 172.21.15.19:0/4161024433 >> 172.21.15.19:0/4161024433 conn(0x564ef9061d10 msgr2=0x564ef9060f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:34:54.439 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:54.427+0000 7f0c58ff9640 0 client.17061 ms_handle_reset on v2:172.21.15.135:6838/1254769802 2024-09-10T22:34:54.439 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:54.428+0000 7f0c7d9f0740 1 -- 172.21.15.19:0/4161024433 shutdown_connections 2024-09-10T22:34:54.439 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:54.428+0000 7f0c7d9f0740 1 -- 172.21.15.19:0/4161024433 wait complete. 2024-09-10T22:34:54.439 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:54.428+0000 7f0c7d9f0740 20 client.17061 trim_cache size 0 max 16384 2024-09-10T22:34:54.449 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:54.446+0000 7f0c7d9f0740 1 Processor -- start 2024-09-10T22:34:54.449 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:54.446+0000 7f0c7d9f0740 1 -- start start 2024-09-10T22:34:54.450 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:54.447+0000 7f0c7d9f0740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x564ef9063ee0 0x564ef90762d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:34:54.450 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:54.447+0000 7f0c7d9f0740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x564ef9064800 0x564ef9090b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:34:54.450 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:54.447+0000 7f0c7d9f0740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564ef9070790 0x564ef90910b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:34:54.450 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:54.447+0000 7f0c7d9f0740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f0c741aecb0 con 0x564ef9063ee0 2024-09-10T22:34:54.450 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:54.447+0000 7f0c7d9f0740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f0c741ac580 con 0x564ef9070790 2024-09-10T22:34:54.450 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:54.447+0000 7f0c7d9f0740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f0c741aa3d0 con 0x564ef9064800 2024-09-10T22:34:54.450 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:54.447+0000 7f0c793b7640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x564ef9063ee0 0x564ef90762d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:34:54.450 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:54.447+0000 7f0c793b7640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x564ef9063ee0 0x564ef90762d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:33472/0 (socket says 172.21.15.19:33472) 2024-09-10T22:34:54.450 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:54.447+0000 7f0c793b7640 1 -- 172.21.15.19:0/2295946058 learned_addr learned my addr 172.21.15.19:0/2295946058 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:34:54.451 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:54.447+0000 7f0c79bb8640 1 --2- 172.21.15.19:0/2295946058 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564ef9070790 0x564ef90910b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:34:54.451 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:54.447+0000 7f0c78bb6640 1 --2- 172.21.15.19:0/2295946058 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x564ef9064800 0x564ef9090b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:34:54.451 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:54.447+0000 7f0c79bb8640 1 -- 172.21.15.19:0/2295946058 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x564ef9064800 msgr2=0x564ef9090b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:34:54.451 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:54.447+0000 7f0c79bb8640 1 --2- 172.21.15.19:0/2295946058 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x564ef9064800 0x564ef9090b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:34:54.451 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:54.447+0000 7f0c79bb8640 1 -- 172.21.15.19:0/2295946058 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x564ef9063ee0 msgr2=0x564ef90762d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:34:54.451 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:54.447+0000 7f0c79bb8640 1 --2- 172.21.15.19:0/2295946058 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x564ef9063ee0 0x564ef90762d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:34:54.451 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:54.447+0000 7f0c79bb8640 1 -- 172.21.15.19:0/2295946058 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564ef90630d0 con 0x564ef9070790 2024-09-10T22:34:54.451 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:54.447+0000 7f0c793b7640 1 --2- 172.21.15.19:0/2295946058 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x564ef9063ee0 0x564ef90762d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T22:34:54.451 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:54.448+0000 7f0c79bb8640 1 --2- 172.21.15.19:0/2295946058 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564ef9070790 0x564ef90910b0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f0c6c0e3e20 tx=0x7f0c6c00c7d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b81c7b6ecb684521 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:34:54.451 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:54.448+0000 7f0c5affd640 1 -- 172.21.15.19:0/2295946058 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c6c0ac770 con 0x564ef9070790 2024-09-10T22:34:54.451 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:54.448+0000 7f0c5affd640 1 -- 172.21.15.19:0/2295946058 <== mon.2 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0c6c0b1040 con 0x564ef9070790 2024-09-10T22:34:54.451 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:54.448+0000 7f0c5affd640 1 -- 172.21.15.19:0/2295946058 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c6c0b5d00 con 0x564ef9070790 2024-09-10T22:34:54.455 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:54.449+0000 7f0c7d9f0740 1 -- 172.21.15.19:0/2295946058 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564ef9070790 msgr2=0x564ef90910b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:34:54.455 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:54.449+0000 7f0c7d9f0740 1 --2- 172.21.15.19:0/2295946058 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564ef9070790 0x564ef90910b0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f0c6c0e3e20 tx=0x7f0c6c00c7d0 comp rx=0 tx=0).stop 2024-09-10T22:34:54.455 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:54.449+0000 7f0c7d9f0740 1 -- 172.21.15.19:0/2295946058 shutdown_connections 2024-09-10T22:34:54.455 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:54.449+0000 7f0c7d9f0740 1 --2- 172.21.15.19:0/2295946058 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564ef9070790 0x564ef90910b0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:34:54.455 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:54.449+0000 7f0c7d9f0740 1 --2- 172.21.15.19:0/2295946058 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x564ef9064800 0x564ef9090b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:34:54.455 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:54.449+0000 7f0c7d9f0740 1 --2- 172.21.15.19:0/2295946058 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x564ef9063ee0 0x564ef90762d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:34:54.455 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:54.449+0000 7f0c7d9f0740 1 -- 172.21.15.19:0/2295946058 >> 172.21.15.19:0/2295946058 conn(0x564ef9061d10 msgr2=0x564ef9075bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:34:54.456 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:54.449+0000 7f0c7d9f0740 1 -- 172.21.15.19:0/2295946058 shutdown_connections 2024-09-10T22:34:54.456 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:54.449+0000 7f0c7d9f0740 1 -- 172.21.15.19:0/2295946058 wait complete. 2024-09-10T22:34:54.456 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:54.449+0000 7f0c7d9f0740 1 -- start start 2024-09-10T22:34:54.456 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:54.450+0000 7f0c7d9f0740 1 Processor -- start 2024-09-10T22:34:54.456 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:54.450+0000 7f0c7d9f0740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x564ef9063ee0 0x564ef9085de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:34:54.456 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:54.450+0000 7f0c7d9f0740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564ef9064800 0x564ef9082300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:34:54.456 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:54.450+0000 7f0c7d9f0740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x564ef9070790 0x564ef9082a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:34:54.456 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:54.450+0000 7f0c7d9f0740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f0c741aaa40 con 0x564ef9063ee0 2024-09-10T22:34:54.456 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:54.450+0000 7f0c7d9f0740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f0c741abeb0 con 0x564ef9064800 2024-09-10T22:34:54.456 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:54.450+0000 7f0c7d9f0740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f0c741ab110 con 0x564ef9070790 2024-09-10T22:34:54.456 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:54.450+0000 7f0c7d9f0740 10 client.0 _ll_register_callbacks cb 0x7f0c6c009720 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T22:34:54.457 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:54.450+0000 7f0c793b7640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x564ef9063ee0 0x564ef9085de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:34:54.457 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:54.450+0000 7f0c793b7640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x564ef9063ee0 0x564ef9085de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:33480/0 (socket says 172.21.15.19:33480) 2024-09-10T22:34:54.457 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:54.450+0000 7f0c793b7640 1 -- 172.21.15.19:0/3453731793 learned_addr learned my addr 172.21.15.19:0/3453731793 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:34:54.457 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:54.450+0000 7f0c78bb6640 1 --2- 172.21.15.19:0/3453731793 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564ef9064800 0x564ef9082300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:34:54.457 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:54.450+0000 7f0c79bb8640 1 --2- 172.21.15.19:0/3453731793 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x564ef9070790 0x564ef9082a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:34:54.457 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:54.451+0000 7f0c79bb8640 1 -- 172.21.15.19:0/3453731793 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564ef9064800 msgr2=0x564ef9082300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:34:54.457 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:54.451+0000 7f0c79bb8640 1 --2- 172.21.15.19:0/3453731793 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564ef9064800 0x564ef9082300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:34:54.457 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:54.451+0000 7f0c79bb8640 1 -- 172.21.15.19:0/3453731793 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x564ef9063ee0 msgr2=0x564ef9085de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:34:54.457 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:54.451+0000 7f0c79bb8640 1 --2- 172.21.15.19:0/3453731793 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x564ef9063ee0 0x564ef9085de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:34:54.457 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:54.451+0000 7f0c79bb8640 1 -- 172.21.15.19:0/3453731793 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564ef90f5d80 con 0x564ef9070790 2024-09-10T22:34:54.457 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:54.451+0000 7f0c793b7640 1 --2- 172.21.15.19:0/3453731793 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x564ef9063ee0 0x564ef9085de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T22:34:54.457 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:54.451+0000 7f0c79bb8640 1 --2- 172.21.15.19:0/3453731793 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x564ef9070790 0x564ef9082a90 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f0c6c0e3e20 tx=0x7f0c6c0ac010 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f86276d7af4ab35b server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:34:54.457 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:54.451+0000 7f0c58ff9640 10 client.0 ms_handle_connect on v2:172.21.15.138:3300/0 2024-09-10T22:34:54.458 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:54.451+0000 7f0c58ff9640 1 -- 172.21.15.19:0/3453731793 <== mon.1 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c6c0cb020 con 0x564ef9070790 2024-09-10T22:34:54.458 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:54.451+0000 7f0c58ff9640 1 -- 172.21.15.19:0/3453731793 <== mon.1 v2:172.21.15.138:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8327+0+0 (secure 0 0 0) 0x7f0c6c0cfac0 con 0x564ef9070790 2024-09-10T22:34:54.458 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:54.451+0000 7f0c7d9f0740 1 -- 172.21.15.19:0/3453731793 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0c6c0b1040 con 0x564ef9070790 2024-09-10T22:34:54.458 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:54.451+0000 7f0c58ff9640 1 -- 172.21.15.19:0/3453731793 <== mon.1 v2:172.21.15.138:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f0c6c08f050 con 0x564ef9070790 2024-09-10T22:34:54.458 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:54.451+0000 7f0c7d9f0740 10 client.26434 fetch_fsmap learned FSMap version 27 2024-09-10T22:34:54.458 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:54.451+0000 7f0c7d9f0740 1 -- 172.21.15.19:0/3453731793 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x564ef90f70c0 con 0x564ef9070790 2024-09-10T22:34:54.458 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:54.452+0000 7f0c58ff9640 1 -- 172.21.15.19:0/3453731793 <== mon.1 v2:172.21.15.138:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0c6c0b1040 con 0x564ef9070790 2024-09-10T22:34:54.458 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:54.452+0000 7f0c58ff9640 1 -- 172.21.15.19:0/3453731793 <== mon.1 v2:172.21.15.138:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7f0c6c0c3030 con 0x564ef9070790 2024-09-10T22:34:54.458 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:54.452+0000 7f0c7d9f0740 10 client.26434 fetch_fsmap finished waiting for FSMap version 27 2024-09-10T22:34:54.458 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:54.452+0000 7f0c7d9f0740 10 client.26434 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-10T22:34:54.458 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:54.452+0000 7f0c7d9f0740 20 client.26434 populate_metadata read hostname 'smithi019' 2024-09-10T22:34:54.458 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:54.452+0000 7f0c7d9f0740 1 --2- 172.21.15.19:0/3453731793 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x564ef90f7540 0x564ef90f9930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:34:54.458 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:54.452+0000 7f0c7d9f0740 4 client.26434 mds_command: new command op to 24581 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-10T22:34:54.459 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:54.452+0000 7f0c7d9f0740 1 -- 172.21.15.19:0/3453731793 --> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x564ef8fd8860 con 0x564ef90f7540 2024-09-10T22:34:54.459 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:54.452+0000 7f0c793b7640 1 --2- 172.21.15.19:0/3453731793 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x564ef90f7540 0x564ef90f9930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:34:54.459 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:54.452+0000 7f0c58ff9640 10 client.26434 ms_handle_connect on v2:172.21.15.135:6838/1254769802 2024-09-10T22:34:54.459 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:54.452+0000 7f0c793b7640 1 --2- 172.21.15.19:0/3453731793 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x564ef90f7540 0x564ef90f9930 crc :-1 s=READY pgs=175 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2dea6be13af8046f server_cookie=c328972faf1c5ae7 in_seq=0 out_seq=0 2024-09-10T22:34:54.460 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:54.454+0000 7f0c58ff9640 1 -- 172.21.15.19:0/3453731793 <== mds.0 v2:172.21.15.135:6838/1254769802 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x564ef8fd8860 con 0x564ef90f7540 2024-09-10T22:34:54.460 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:54.454+0000 7f0c58ff9640 10 client.26434 handle_command_reply: tid=0 2024-09-10T22:34:54.460 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:54.454+0000 7f0c7d9f0740 1 client.26434 shutdown 2024-09-10T22:34:54.460 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:54.454+0000 7f0c7d9f0740 1 -- 172.21.15.19:0/3453731793 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x564ef9070790 msgr2=0x564ef9082a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:34:54.460 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:54.454+0000 7f0c7d9f0740 1 --2- 172.21.15.19:0/3453731793 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x564ef9070790 0x564ef9082a90 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f0c6c0e3e20 tx=0x7f0c6c0ac010 comp rx=0 tx=0).stop 2024-09-10T22:34:54.460 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:54.454+0000 7f0c7d9f0740 1 -- 172.21.15.19:0/3453731793 shutdown_connections 2024-09-10T22:34:54.460 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:54.454+0000 7f0c7d9f0740 1 --2- 172.21.15.19:0/3453731793 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x564ef90f7540 0x564ef90f9930 crc :-1 s=READY pgs=175 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:34:54.460 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:54.454+0000 7f0c7d9f0740 1 --2- 172.21.15.19:0/3453731793 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x564ef9070790 0x564ef9082a90 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:34:54.461 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:54.454+0000 7f0c7d9f0740 1 --2- 172.21.15.19:0/3453731793 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564ef9064800 0x564ef9082300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:34:54.461 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:54.454+0000 7f0c58ff9640 0 client.26434 ms_handle_reset on v2:172.21.15.135:6838/1254769802 2024-09-10T22:34:54.461 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:54.454+0000 7f0c7d9f0740 1 --2- 172.21.15.19:0/3453731793 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x564ef9063ee0 0x564ef9085de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:34:54.461 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:54.454+0000 7f0c7d9f0740 1 -- 172.21.15.19:0/3453731793 >> 172.21.15.19:0/3453731793 conn(0x564ef9061d10 msgr2=0x564ef9060750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:34:54.461 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:54.454+0000 7f0c7d9f0740 1 -- 172.21.15.19:0/3453731793 shutdown_connections 2024-09-10T22:34:54.461 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:54.454+0000 7f0c7d9f0740 1 -- 172.21.15.19:0/3453731793 wait complete. 2024-09-10T22:34:54.461 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:54.454+0000 7f0c7d9f0740 20 client.26434 trim_cache size 0 max 16384 2024-09-10T22:34:54.461 INFO:teuthology.orchestra.run.smithi019.stdout:{ 2024-09-10T22:34:54.462 INFO:teuthology.orchestra.run.smithi019.stdout: "return_code": 0, 2024-09-10T22:34:54.462 INFO:teuthology.orchestra.run.smithi019.stdout: "scrub_tag": "a77606c2-7618-413e-8aba-f9783ecbf435", 2024-09-10T22:34:54.462 INFO:teuthology.orchestra.run.smithi019.stdout: "mode": "asynchronous" 2024-09-10T22:34:54.462 INFO:teuthology.orchestra.run.smithi019.stdout:} 2024-09-10T22:34:54.463 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:54.455+0000 7f0c7b61b640 1 -- 172.21.15.19:0/1259474304 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f0c5c0b52e0 msgr2=0x7f0c5c0b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:34:54.463 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:54.455+0000 7f0c7b61b640 1 --2- 172.21.15.19:0/1259474304 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f0c5c0b52e0 0x7f0c5c0b77a0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x564ef9063e90 tx=0x7f0c68041040 comp rx=0 tx=0).stop 2024-09-10T22:34:54.463 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:54.455+0000 7f0c7b61b640 1 -- 172.21.15.19:0/1259474304 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0c7410d100 msgr2=0x7f0c7419eba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:34:54.463 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:54.455+0000 7f0c7b61b640 1 --2- 172.21.15.19:0/1259474304 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0c7410d100 0x7f0c7419eba0 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7f0c6c00e970 tx=0x7f0c6c00ed70 comp rx=0 tx=0).stop 2024-09-10T22:34:54.463 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:54.455+0000 7f0c7b61b640 1 -- 172.21.15.19:0/1259474304 shutdown_connections 2024-09-10T22:34:54.463 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:54.455+0000 7f0c7b61b640 1 --2- 172.21.15.19:0/1259474304 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f0c5c0b52e0 0x7f0c5c0b77a0 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:34:54.463 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:54.455+0000 7f0c7b61b640 1 --2- 172.21.15.19:0/1259474304 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0c7410d100 0x7f0c7419eba0 unknown :-1 s=CLOSED pgs=755 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:34:54.463 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:54.455+0000 7f0c7b61b640 1 --2- 172.21.15.19:0/1259474304 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f0c741045c0 0x7f0c74199800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:34:54.464 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:54.455+0000 7f0c7b61b640 1 --2- 172.21.15.19:0/1259474304 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0c74103ca0 0x7f0c741992c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:34:54.464 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:54.455+0000 7f0c7b61b640 1 -- 172.21.15.19:0/1259474304 >> 172.21.15.19:0/1259474304 conn(0x7f0c740fd700 msgr2=0x7f0c740fe400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:34:54.464 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:54.455+0000 7f0c7b61b640 1 -- 172.21.15.19:0/1259474304 shutdown_connections 2024-09-10T22:34:54.464 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:54.455+0000 7f0c7b61b640 1 -- 172.21.15.19:0/1259474304 wait complete. 2024-09-10T22:34:54.609 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:34:54 smithi135 ceph-mon[34789]: pgmap v601: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 518 KiB/s rd, 241 MiB/s wr, 403 op/s 2024-09-10T22:34:54.625 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:34:54 smithi138 ceph-mon[35236]: pgmap v601: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 518 KiB/s rd, 241 MiB/s wr, 403 op/s 2024-09-10T22:34:54.708 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:34:54 smithi019 ceph-mon[31375]: pgmap v601: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 518 KiB/s rd, 241 MiB/s wr, 403 op/s 2024-09-10T22:34:55.384 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 22997a4c-6fc2-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-10T22:34:55.610 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:34:55 smithi135 ceph-mon[34789]: scrub queued for path: / 2024-09-10T22:34:55.610 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:34:55 smithi135 ceph-mon[34789]: scrub summary: idle+waiting paths [/] 2024-09-10T22:34:55.610 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:34:55 smithi135 ceph-mon[34789]: scrub summary: active paths [/] 2024-09-10T22:34:55.610 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:34:55 smithi135 ceph-mon[34789]: scrub summary: active paths [/] 2024-09-10T22:34:55.610 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:34:55 smithi135 ceph-mon[34789]: scrub summary: idle+waiting paths [/] 2024-09-10T22:34:55.625 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:34:55 smithi138 ceph-mon[35236]: scrub queued for path: / 2024-09-10T22:34:55.625 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:34:55 smithi138 ceph-mon[35236]: scrub summary: idle+waiting paths [/] 2024-09-10T22:34:55.625 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:34:55 smithi138 ceph-mon[35236]: scrub summary: active paths [/] 2024-09-10T22:34:55.625 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:34:55 smithi138 ceph-mon[35236]: scrub summary: active paths [/] 2024-09-10T22:34:55.625 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:34:55 smithi138 ceph-mon[35236]: scrub summary: idle+waiting paths [/] 2024-09-10T22:34:55.662 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/22997a4c-6fc2-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T22:34:55.708 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:34:55 smithi019 ceph-mon[31375]: scrub queued for path: / 2024-09-10T22:34:55.709 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:34:55 smithi019 ceph-mon[31375]: scrub summary: idle+waiting paths [/] 2024-09-10T22:34:55.709 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:34:55 smithi019 ceph-mon[31375]: scrub summary: active paths [/] 2024-09-10T22:34:55.709 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:34:55 smithi019 ceph-mon[31375]: scrub summary: active paths [/] 2024-09-10T22:34:55.709 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:34:55 smithi019 ceph-mon[31375]: scrub summary: idle+waiting paths [/] 2024-09-10T22:34:56.242 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:56.237+0000 7fcbf6b5a640 1 -- 172.21.15.19:0/3061700806 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fcbf0101ca0 msgr2=0x7fcbf0102080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:34:56.242 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:56.237+0000 7fcbf6b5a640 1 --2- 172.21.15.19:0/3061700806 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fcbf0101ca0 0x7fcbf0102080 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7fcbe4009900 tx=0x7fcbe402a410 comp rx=0 tx=0).stop 2024-09-10T22:34:56.242 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:56.237+0000 7fcbf6b5a640 1 -- 172.21.15.19:0/3061700806 shutdown_connections 2024-09-10T22:34:56.242 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:56.237+0000 7fcbf6b5a640 1 --2- 172.21.15.19:0/3061700806 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fcbf0108030 0x7fcbf010e830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:34:56.242 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:56.237+0000 7fcbf6b5a640 1 --2- 172.21.15.19:0/3061700806 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcbf01076b0 0x7fcbf0107af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:34:56.242 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:56.237+0000 7fcbf6b5a640 1 --2- 172.21.15.19:0/3061700806 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fcbf0101ca0 0x7fcbf0102080 unknown :-1 s=CLOSED pgs=757 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:34:56.243 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:56.237+0000 7fcbf6b5a640 1 -- 172.21.15.19:0/3061700806 >> 172.21.15.19:0/3061700806 conn(0x7fcbf00fd730 msgr2=0x7fcbf00ffb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:34:56.243 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:56.237+0000 7fcbf6b5a640 1 -- 172.21.15.19:0/3061700806 shutdown_connections 2024-09-10T22:34:56.243 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:56.237+0000 7fcbf6b5a640 1 -- 172.21.15.19:0/3061700806 wait complete. 2024-09-10T22:34:56.243 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:56.237+0000 7fcbf6b5a640 1 Processor -- start 2024-09-10T22:34:56.243 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:56.238+0000 7fcbf6b5a640 1 -- start start 2024-09-10T22:34:56.243 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:56.238+0000 7fcbf6b5a640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fcbf0101ca0 0x7fcbf0199250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:34:56.243 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:56.238+0000 7fcbf6b5a640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcbf01076b0 0x7fcbf0199790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:34:56.243 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:56.238+0000 7fcbf6b5a640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fcbf0108030 0x7fcbf019eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:34:56.243 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:56.238+0000 7fcbf6b5a640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fcbf0111cf0 con 0x7fcbf0101ca0 2024-09-10T22:34:56.243 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:56.238+0000 7fcbf6b5a640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fcbf0111b70 con 0x7fcbf01076b0 2024-09-10T22:34:56.243 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:56.238+0000 7fcbf6b5a640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7fcbf0111e70 con 0x7fcbf0108030 2024-09-10T22:34:56.243 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:56.238+0000 7fcbf48f6640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fcbf0101ca0 0x7fcbf0199250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:34:56.244 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:56.238+0000 7fcbf48f6640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fcbf0101ca0 0x7fcbf0199250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:33502/0 (socket says 172.21.15.19:33502) 2024-09-10T22:34:56.244 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:56.238+0000 7fcbf48f6640 1 -- 172.21.15.19:0/3159404317 learned_addr learned my addr 172.21.15.19:0/3159404317 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:34:56.244 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:56.238+0000 7fcbeffff640 1 --2- 172.21.15.19:0/3159404317 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcbf01076b0 0x7fcbf0199790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:34:56.244 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:56.238+0000 7fcbf50f7640 1 --2- 172.21.15.19:0/3159404317 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fcbf0108030 0x7fcbf019eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:34:56.244 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:56.238+0000 7fcbf48f6640 1 -- 172.21.15.19:0/3159404317 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fcbf0108030 msgr2=0x7fcbf019eb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:34:56.244 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:56.238+0000 7fcbf48f6640 1 --2- 172.21.15.19:0/3159404317 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fcbf0108030 0x7fcbf019eb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:34:56.244 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:56.238+0000 7fcbf48f6640 1 -- 172.21.15.19:0/3159404317 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcbf01076b0 msgr2=0x7fcbf0199790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:34:56.244 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:56.238+0000 7fcbf48f6640 1 --2- 172.21.15.19:0/3159404317 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcbf01076b0 0x7fcbf0199790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:34:56.244 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:56.238+0000 7fcbf48f6640 1 -- 172.21.15.19:0/3159404317 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcbf019f300 con 0x7fcbf0101ca0 2024-09-10T22:34:56.244 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:56.239+0000 7fcbf48f6640 1 --2- 172.21.15.19:0/3159404317 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fcbf0101ca0 0x7fcbf0199250 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7fcbe4005940 tx=0x7fcbe40042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:34:56.244 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:56.239+0000 7fcbedffb640 1 -- 172.21.15.19:0/3159404317 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcbe403f030 con 0x7fcbf0101ca0 2024-09-10T22:34:56.244 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:56.239+0000 7fcbf6b5a640 1 -- 172.21.15.19:0/3159404317 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcbf019f590 con 0x7fcbf0101ca0 2024-09-10T22:34:56.244 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:56.239+0000 7fcbedffb640 1 -- 172.21.15.19:0/3159404317 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fcbe4003cb0 con 0x7fcbf0101ca0 2024-09-10T22:34:56.245 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:56.239+0000 7fcbedffb640 1 -- 172.21.15.19:0/3159404317 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcbe4035070 con 0x7fcbf0101ca0 2024-09-10T22:34:56.245 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:56.239+0000 7fcbf6b5a640 1 -- 172.21.15.19:0/3159404317 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcbf01a5cb0 con 0x7fcbf0101ca0 2024-09-10T22:34:56.247 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:56.242+0000 7fcbf8f2f740 1 Processor -- start 2024-09-10T22:34:56.247 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:56.243+0000 7fcbf8f2f740 1 -- start start 2024-09-10T22:34:56.247 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:56.243+0000 7fcbf8f2f740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55b0f084a480 0x55b0f084a860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:34:56.247 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:56.243+0000 7fcbf8f2f740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55b0f084ada0 0x55b0f085ac00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:34:56.247 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:56.243+0000 7fcbf8f2f740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b0f085b140 0x55b0f085d530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:34:56.247 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:56.243+0000 7fcbf8f2f740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x55b0f07c0e50 con 0x55b0f084ada0 2024-09-10T22:34:56.247 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:56.243+0000 7fcbf8f2f740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55b0f07b0280 con 0x55b0f085b140 2024-09-10T22:34:56.247 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:56.243+0000 7fcbf8f2f740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x55b0f07b4090 con 0x55b0f084a480 2024-09-10T22:34:56.247 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:56.243+0000 7fcbedffb640 1 -- 172.21.15.19:0/3159404317 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 18) ==== 153250+0+0 (secure 0 0 0) 0x7fcbe403bbf0 con 0x7fcbf0101ca0 2024-09-10T22:34:56.248 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:56.243+0000 7fcbf50f7640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55b0f084a480 0x55b0f084a860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:34:56.248 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:56.243+0000 7fcbf50f7640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55b0f084a480 0x55b0f084a860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.19:54458/0 (socket says 172.21.15.19:54458) 2024-09-10T22:34:56.248 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:56.243+0000 7fcbf50f7640 1 -- 172.21.15.19:0/1209701391 learned_addr learned my addr 172.21.15.19:0/1209701391 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:34:56.248 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:56.243+0000 7fcbeffff640 1 --2- 172.21.15.19:0/1209701391 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b0f085b140 0x55b0f085d530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:34:56.248 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:56.243+0000 7fcbf48f6640 1 --2- 172.21.15.19:0/1209701391 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55b0f084ada0 0x55b0f085ac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:34:56.248 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:56.244+0000 7fcbeffff640 1 -- 172.21.15.19:0/1209701391 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55b0f084a480 msgr2=0x55b0f084a860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:34:56.248 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:56.244+0000 7fcbeffff640 1 --2- 172.21.15.19:0/1209701391 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55b0f084a480 0x55b0f084a860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:34:56.248 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:56.244+0000 7fcbeffff640 1 -- 172.21.15.19:0/1209701391 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55b0f084ada0 msgr2=0x55b0f085ac00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:34:56.248 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:56.244+0000 7fcbeffff640 1 --2- 172.21.15.19:0/1209701391 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55b0f084ada0 0x55b0f085ac00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:34:56.248 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:56.244+0000 7fcbeffff640 1 -- 172.21.15.19:0/1209701391 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b0f050e650 con 0x55b0f085b140 2024-09-10T22:34:56.248 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:56.244+0000 7fcbeffff640 1 --2- 172.21.15.19:0/1209701391 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b0f085b140 0x55b0f085d530 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fcbdc00bbc0 tx=0x7fcbdc0107a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3985f7892e65a88d server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:34:56.248 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:56.244+0000 7fcbdaffd640 1 -- 172.21.15.19:0/1209701391 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcbdc004030 con 0x55b0f085b140 2024-09-10T22:34:56.249 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:56.244+0000 7fcbdaffd640 1 -- 172.21.15.19:0/1209701391 <== mon.2 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fcbdc0035f0 con 0x55b0f085b140 2024-09-10T22:34:56.249 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:56.244+0000 7fcbdaffd640 1 -- 172.21.15.19:0/1209701391 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcbdc011680 con 0x55b0f085b140 2024-09-10T22:34:56.249 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:56.244+0000 7fcbedffb640 1 --2- 172.21.15.19:0/3159404317 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7fcbe00b52e0 0x7fcbe00b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:34:56.249 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:56.245+0000 7fcbf50f7640 1 --2- 172.21.15.19:0/3159404317 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7fcbe00b52e0 0x7fcbe00b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:34:56.249 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:56.245+0000 7fcbedffb640 1 -- 172.21.15.19:0/3159404317 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8327+0+0 (secure 0 0 0) 0x7fcbe41067a0 con 0x7fcbf0101ca0 2024-09-10T22:34:56.249 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:56.245+0000 7fcbf8f2f740 1 -- 172.21.15.19:0/1209701391 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b0f085b140 msgr2=0x55b0f085d530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:34:56.249 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:56.245+0000 7fcbf8f2f740 1 --2- 172.21.15.19:0/1209701391 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b0f085b140 0x55b0f085d530 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fcbdc00bbc0 tx=0x7fcbdc0107a0 comp rx=0 tx=0).stop 2024-09-10T22:34:56.249 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:56.245+0000 7fcbf8f2f740 1 -- 172.21.15.19:0/1209701391 shutdown_connections 2024-09-10T22:34:56.249 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:56.245+0000 7fcbf8f2f740 1 --2- 172.21.15.19:0/1209701391 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b0f085b140 0x55b0f085d530 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:34:56.249 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:56.245+0000 7fcbf8f2f740 1 --2- 172.21.15.19:0/1209701391 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55b0f084ada0 0x55b0f085ac00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:34:56.249 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:56.245+0000 7fcbf8f2f740 1 --2- 172.21.15.19:0/1209701391 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55b0f084a480 0x55b0f084a860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:34:56.249 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:56.245+0000 7fcbf8f2f740 1 -- 172.21.15.19:0/1209701391 >> 172.21.15.19:0/1209701391 conn(0x55b0f08482b0 msgr2=0x55b0f0849450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:34:56.249 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:56.245+0000 7fcbf8f2f740 1 -- 172.21.15.19:0/1209701391 shutdown_connections 2024-09-10T22:34:56.249 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:56.245+0000 7fcbf50f7640 1 --2- 172.21.15.19:0/3159404317 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7fcbe00b52e0 0x7fcbe00b77a0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7fcbe8005f40 tx=0x7fcbe8009600 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:34:56.250 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:56.245+0000 7fcbf8f2f740 1 -- 172.21.15.19:0/1209701391 wait complete. 2024-09-10T22:34:56.250 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:56.245+0000 7fcbf8f2f740 1 -- start start 2024-09-10T22:34:56.250 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:56.246+0000 7fcbf8f2f740 1 Processor -- start 2024-09-10T22:34:56.256 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:56.246+0000 7fcbf8f2f740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55b0f084a480 0x55b0f085a960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:34:56.256 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:56.246+0000 7fcbf8f2f740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55b0f084ada0 0x55b0f0857e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:34:56.256 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:56.246+0000 7fcbf8f2f740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b0f085b140 0x55b0f0858340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:34:56.256 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:56.246+0000 7fcbf8f2f740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x55b0f0611700 con 0x55b0f084a480 2024-09-10T22:34:56.256 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:56.246+0000 7fcbf8f2f740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55b0f074b110 con 0x55b0f085b140 2024-09-10T22:34:56.256 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:56.246+0000 7fcbf8f2f740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x55b0f085ddf0 con 0x55b0f084ada0 2024-09-10T22:34:56.257 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:56.246+0000 7fcbf48f6640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55b0f084a480 0x55b0f085a960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:34:56.257 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:56.246+0000 7fcbf8f2f740 10 client.0 _ll_register_callbacks cb 0x55b0f0764990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T22:34:56.257 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:56.246+0000 7fcbf48f6640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55b0f084a480 0x55b0f085a960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:33518/0 (socket says 172.21.15.19:33518) 2024-09-10T22:34:56.257 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:56.246+0000 7fcbf48f6640 1 -- 172.21.15.19:0/2104802248 learned_addr learned my addr 172.21.15.19:0/2104802248 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:34:56.257 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:56.246+0000 7fcbf50f7640 1 --2- 172.21.15.19:0/2104802248 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b0f085b140 0x55b0f0858340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:34:56.257 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:56.246+0000 7fcbeffff640 1 --2- 172.21.15.19:0/2104802248 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55b0f084ada0 0x55b0f0857e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:34:56.257 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:56.246+0000 7fcbf48f6640 1 -- 172.21.15.19:0/2104802248 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55b0f084ada0 msgr2=0x55b0f0857e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:34:56.257 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:56.246+0000 7fcbf48f6640 1 --2- 172.21.15.19:0/2104802248 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55b0f084ada0 0x55b0f0857e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:34:56.258 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:56.246+0000 7fcbf48f6640 1 -- 172.21.15.19:0/2104802248 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b0f085b140 msgr2=0x55b0f0858340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:34:56.258 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:56.246+0000 7fcbf48f6640 1 --2- 172.21.15.19:0/2104802248 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b0f085b140 0x55b0f0858340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:34:56.258 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:56.246+0000 7fcbf48f6640 1 -- 172.21.15.19:0/2104802248 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b0f0778c40 con 0x55b0f084a480 2024-09-10T22:34:56.258 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:56.246+0000 7fcbf50f7640 1 --2- 172.21.15.19:0/2104802248 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b0f085b140 0x55b0f0858340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T22:34:56.258 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:56.247+0000 7fcbf48f6640 1 --2- 172.21.15.19:0/2104802248 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55b0f084a480 0x55b0f085a960 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7fcbe40c9520 tx=0x7fcbe403b6b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8615574f2ddafeea server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:34:56.258 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:56.247+0000 7fcbcffff640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-10T22:34:56.258 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:56.247+0000 7fcbcffff640 1 -- 172.21.15.19:0/2104802248 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcbe4049070 con 0x55b0f084a480 2024-09-10T22:34:56.258 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:56.247+0000 7fcbcffff640 1 -- 172.21.15.19:0/2104802248 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8327+0+0 (secure 0 0 0) 0x7fcbe40cd1b0 con 0x55b0f084a480 2024-09-10T22:34:56.258 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:56.247+0000 7fcbf8f2f740 1 -- 172.21.15.19:0/2104802248 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fcbdc0035f0 con 0x55b0f084a480 2024-09-10T22:34:56.259 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:56.247+0000 7fcbcffff640 1 -- 172.21.15.19:0/2104802248 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fcbe40cc6c0 con 0x55b0f084a480 2024-09-10T22:34:56.259 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:56.247+0000 7fcbf8f2f740 10 client.17079 fetch_fsmap learned FSMap version 27 2024-09-10T22:34:56.259 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:56.247+0000 7fcbf8f2f740 1 -- 172.21.15.19:0/2104802248 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55b0f0869690 con 0x55b0f084a480 2024-09-10T22:34:56.259 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:56.247+0000 7fcbcffff640 1 -- 172.21.15.19:0/2104802248 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fcbdc0035f0 con 0x55b0f084a480 2024-09-10T22:34:56.259 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:56.247+0000 7fcbcffff640 1 -- 172.21.15.19:0/2104802248 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7fcbe40b8180 con 0x55b0f084a480 2024-09-10T22:34:56.259 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:56.248+0000 7fcbf8f2f740 10 client.17079 fetch_fsmap finished waiting for FSMap version 27 2024-09-10T22:34:56.259 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:56.248+0000 7fcbf8f2f740 10 client.17079 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-10T22:34:56.259 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:56.248+0000 7fcbf8f2f740 20 client.17079 populate_metadata read hostname 'smithi019' 2024-09-10T22:34:56.260 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:56.248+0000 7fcbf8f2f740 1 --2- 172.21.15.19:0/2104802248 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x55b0f086ab40 0x55b0f086cf90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:34:56.260 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:56.248+0000 7fcbf8f2f740 4 client.17079 mds_command: new command op to 24581 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T22:34:56.260 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:56.248+0000 7fcbf8f2f740 1 -- 172.21.15.19:0/2104802248 --> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b0f07c2da0 con 0x55b0f086ab40 2024-09-10T22:34:56.260 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:56.248+0000 7fcbeffff640 1 --2- 172.21.15.19:0/2104802248 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x55b0f086ab40 0x55b0f086cf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:34:56.260 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:56.248+0000 7fcbeffff640 1 --2- 172.21.15.19:0/2104802248 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x55b0f086ab40 0x55b0f086cf90 crc :-1 s=READY pgs=176 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9458673f9e65ba90 server_cookie=ccfd6e73f0caac4a in_seq=0 out_seq=0 2024-09-10T22:34:56.260 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:56.248+0000 7fcbcffff640 10 client.17079 ms_handle_connect on v2:172.21.15.135:6838/1254769802 2024-09-10T22:34:56.260 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:56.249+0000 7fcbcffff640 1 -- 172.21.15.19:0/2104802248 <== mds.0 v2:172.21.15.135:6838/1254769802 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55b0f07c2da0 con 0x55b0f086ab40 2024-09-10T22:34:56.260 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:56.249+0000 7fcbcffff640 10 client.17079 handle_command_reply: tid=0 2024-09-10T22:34:56.261 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:56.249+0000 7fcbf8f2f740 1 client.17079 shutdown 2024-09-10T22:34:56.261 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:56.249+0000 7fcbf8f2f740 1 -- 172.21.15.19:0/2104802248 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55b0f084a480 msgr2=0x55b0f085a960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:34:56.261 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:56.249+0000 7fcbf8f2f740 1 --2- 172.21.15.19:0/2104802248 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55b0f084a480 0x55b0f085a960 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7fcbe40c9520 tx=0x7fcbe403b6b0 comp rx=0 tx=0).stop 2024-09-10T22:34:56.261 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:56.249+0000 7fcbf8f2f740 1 -- 172.21.15.19:0/2104802248 shutdown_connections 2024-09-10T22:34:56.261 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:56.249+0000 7fcbf8f2f740 1 --2- 172.21.15.19:0/2104802248 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b0f085b140 0x55b0f0858340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:34:56.261 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:56.249+0000 7fcbf8f2f740 1 --2- 172.21.15.19:0/2104802248 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x55b0f086ab40 0x55b0f086cf90 crc :-1 s=READY pgs=176 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:34:56.261 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:56.249+0000 7fcbf8f2f740 1 --2- 172.21.15.19:0/2104802248 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55b0f084ada0 0x55b0f0857e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:34:56.261 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:56.249+0000 7fcbf8f2f740 1 --2- 172.21.15.19:0/2104802248 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55b0f084a480 0x55b0f085a960 unknown :-1 s=CLOSED pgs=759 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:34:56.262 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:56.249+0000 7fcbf8f2f740 1 -- 172.21.15.19:0/2104802248 >> 172.21.15.19:0/2104802248 conn(0x55b0f08482b0 msgr2=0x55b0f08473d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:34:56.262 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:56.249+0000 7fcbcffff640 0 client.17079 ms_handle_reset on v2:172.21.15.135:6838/1254769802 2024-09-10T22:34:56.262 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:56.249+0000 7fcbf8f2f740 1 -- 172.21.15.19:0/2104802248 shutdown_connections 2024-09-10T22:34:56.262 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:56.249+0000 7fcbf8f2f740 1 -- 172.21.15.19:0/2104802248 wait complete. 2024-09-10T22:34:56.262 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:56.249+0000 7fcbf8f2f740 20 client.17079 trim_cache size 0 max 16384 2024-09-10T22:34:56.270 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:56.268+0000 7fcbf8f2f740 1 Processor -- start 2024-09-10T22:34:56.270 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:56.268+0000 7fcbf8f2f740 1 -- start start 2024-09-10T22:34:56.270 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:56.268+0000 7fcbf8f2f740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55b0f084a480 0x55b0f0856680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:34:56.270 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:56.268+0000 7fcbf8f2f740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b0f084ada0 0x55b0f0856bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:34:56.270 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:56.268+0000 7fcbf8f2f740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55b0f085b140 0x55b0f0872860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:34:56.270 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:56.268+0000 7fcbf8f2f740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fcbf01aec00 con 0x55b0f085b140 2024-09-10T22:34:56.270 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:56.268+0000 7fcbf8f2f740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fcbf01ac4d0 con 0x55b0f084ada0 2024-09-10T22:34:56.270 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:56.268+0000 7fcbf8f2f740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7fcbf01aa320 con 0x55b0f084a480 2024-09-10T22:34:56.270 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:56.268+0000 7fcbf50f7640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55b0f085b140 0x55b0f0872860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:34:56.270 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:56.268+0000 7fcbf50f7640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55b0f085b140 0x55b0f0872860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:33530/0 (socket says 172.21.15.19:33530) 2024-09-10T22:34:56.271 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:56.268+0000 7fcbf50f7640 1 -- 172.21.15.19:0/2626884251 learned_addr learned my addr 172.21.15.19:0/2626884251 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:34:56.271 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:56.268+0000 7fcbf48f6640 1 --2- 172.21.15.19:0/2626884251 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55b0f084a480 0x55b0f0856680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:34:56.271 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:56.268+0000 7fcbeffff640 1 --2- 172.21.15.19:0/2626884251 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b0f084ada0 0x55b0f0856bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:34:56.271 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:56.268+0000 7fcbf50f7640 1 -- 172.21.15.19:0/2626884251 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55b0f084a480 msgr2=0x55b0f0856680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:34:56.271 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:56.268+0000 7fcbf50f7640 1 --2- 172.21.15.19:0/2626884251 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55b0f084a480 0x55b0f0856680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:34:56.271 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:56.268+0000 7fcbf50f7640 1 -- 172.21.15.19:0/2626884251 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b0f084ada0 msgr2=0x55b0f0856bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:34:56.271 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:56.268+0000 7fcbf50f7640 1 --2- 172.21.15.19:0/2626884251 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b0f084ada0 0x55b0f0856bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:34:56.271 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:56.268+0000 7fcbf50f7640 1 -- 172.21.15.19:0/2626884251 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b0f0857bb0 con 0x55b0f085b140 2024-09-10T22:34:56.271 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:56.268+0000 7fcbf48f6640 1 --2- 172.21.15.19:0/2626884251 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55b0f084a480 0x55b0f0856680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T22:34:56.275 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:56.269+0000 7fcbf50f7640 1 --2- 172.21.15.19:0/2626884251 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55b0f085b140 0x55b0f0872860 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7fcbe8003b20 tx=0x7fcbe8016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fffec0addc409505 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:34:56.275 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:56.269+0000 7fcbda7fc640 1 -- 172.21.15.19:0/2626884251 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcbe8011660 con 0x55b0f085b140 2024-09-10T22:34:56.275 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:56.269+0000 7fcbda7fc640 1 -- 172.21.15.19:0/2626884251 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fcbe8025070 con 0x55b0f085b140 2024-09-10T22:34:56.275 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:56.269+0000 7fcbda7fc640 1 -- 172.21.15.19:0/2626884251 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcbe8021a40 con 0x55b0f085b140 2024-09-10T22:34:56.276 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:56.270+0000 7fcbf8f2f740 1 -- 172.21.15.19:0/2626884251 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55b0f085b140 msgr2=0x55b0f0872860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:34:56.276 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:56.270+0000 7fcbf8f2f740 1 --2- 172.21.15.19:0/2626884251 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55b0f085b140 0x55b0f0872860 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7fcbe8003b20 tx=0x7fcbe8016000 comp rx=0 tx=0).stop 2024-09-10T22:34:56.276 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:56.270+0000 7fcbf8f2f740 1 -- 172.21.15.19:0/2626884251 shutdown_connections 2024-09-10T22:34:56.276 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:56.270+0000 7fcbf8f2f740 1 --2- 172.21.15.19:0/2626884251 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55b0f085b140 0x55b0f0872860 unknown :-1 s=CLOSED pgs=760 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:34:56.276 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:56.270+0000 7fcbf8f2f740 1 --2- 172.21.15.19:0/2626884251 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b0f084ada0 0x55b0f0856bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:34:56.276 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:56.270+0000 7fcbf8f2f740 1 --2- 172.21.15.19:0/2626884251 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55b0f084a480 0x55b0f0856680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:34:56.276 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:56.270+0000 7fcbf8f2f740 1 -- 172.21.15.19:0/2626884251 >> 172.21.15.19:0/2626884251 conn(0x55b0f08482b0 msgr2=0x55b0f085ce60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:34:56.276 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:56.270+0000 7fcbf8f2f740 1 -- 172.21.15.19:0/2626884251 shutdown_connections 2024-09-10T22:34:56.276 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:56.270+0000 7fcbf8f2f740 1 -- 172.21.15.19:0/2626884251 wait complete. 2024-09-10T22:34:56.276 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:56.270+0000 7fcbf8f2f740 1 -- start start 2024-09-10T22:34:56.276 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:56.270+0000 7fcbf8f2f740 1 Processor -- start 2024-09-10T22:34:56.276 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:56.271+0000 7fcbf8f2f740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55b0f084a480 0x55b0f0863290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:34:56.276 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:56.271+0000 7fcbf8f2f740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b0f084ada0 0x55b0f08637f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:34:56.277 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:56.271+0000 7fcbf8f2f740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55b0f085b140 0x55b0f0860080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:34:56.277 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:56.271+0000 7fcbf8f2f740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fcbf01aa990 con 0x55b0f085b140 2024-09-10T22:34:56.277 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:56.271+0000 7fcbf8f2f740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fcbf01abe00 con 0x55b0f084ada0 2024-09-10T22:34:56.277 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:56.271+0000 7fcbf8f2f740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7fcbf01ab060 con 0x55b0f084a480 2024-09-10T22:34:56.277 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:56.271+0000 7fcbf8f2f740 10 client.0 _ll_register_callbacks cb 0x7fcbe4005780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T22:34:56.277 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:56.271+0000 7fcbf50f7640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55b0f085b140 0x55b0f0860080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:34:56.277 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:56.271+0000 7fcbf50f7640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55b0f085b140 0x55b0f0860080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:33536/0 (socket says 172.21.15.19:33536) 2024-09-10T22:34:56.277 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:56.271+0000 7fcbf50f7640 1 -- 172.21.15.19:0/622470288 learned_addr learned my addr 172.21.15.19:0/622470288 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:34:56.277 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:56.271+0000 7fcbeffff640 1 --2- 172.21.15.19:0/622470288 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b0f084ada0 0x55b0f08637f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:34:56.277 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:56.271+0000 7fcbf48f6640 1 --2- 172.21.15.19:0/622470288 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55b0f084a480 0x55b0f0863290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:34:56.277 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:56.271+0000 7fcbeffff640 1 -- 172.21.15.19:0/622470288 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55b0f084a480 msgr2=0x55b0f0863290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:34:56.277 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:56.271+0000 7fcbeffff640 1 --2- 172.21.15.19:0/622470288 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55b0f084a480 0x55b0f0863290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:34:56.277 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:56.271+0000 7fcbeffff640 1 -- 172.21.15.19:0/622470288 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55b0f085b140 msgr2=0x55b0f0860080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:34:56.278 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:56.271+0000 7fcbeffff640 1 --2- 172.21.15.19:0/622470288 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55b0f085b140 0x55b0f0860080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:34:56.278 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:56.271+0000 7fcbeffff640 1 -- 172.21.15.19:0/622470288 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b0f0860810 con 0x55b0f084ada0 2024-09-10T22:34:56.278 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:56.271+0000 7fcbf48f6640 1 --2- 172.21.15.19:0/622470288 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55b0f084a480 0x55b0f0863290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T22:34:56.278 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:56.271+0000 7fcbf50f7640 1 --2- 172.21.15.19:0/622470288 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55b0f085b140 0x55b0f0860080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T22:34:56.278 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:56.271+0000 7fcbeffff640 1 --2- 172.21.15.19:0/622470288 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b0f084ada0 0x55b0f08637f0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fcbdc005d00 tx=0x7fcbdc00bfa0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=79768f8147b684c5 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:34:56.278 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:56.271+0000 7fcbcffff640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-09-10T22:34:56.278 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:56.272+0000 7fcbcffff640 1 -- 172.21.15.19:0/622470288 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcbdc005450 con 0x55b0f084ada0 2024-09-10T22:34:56.278 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:56.272+0000 7fcbf8f2f740 1 -- 172.21.15.19:0/622470288 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fcbe8025070 con 0x55b0f084ada0 2024-09-10T22:34:56.278 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:56.272+0000 7fcbcffff640 1 -- 172.21.15.19:0/622470288 <== mon.2 v2:172.21.15.135:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8327+0+0 (secure 0 0 0) 0x7fcbdc0055f0 con 0x55b0f084ada0 2024-09-10T22:34:56.278 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:56.272+0000 7fcbcffff640 1 -- 172.21.15.19:0/622470288 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fcbdc0035f0 con 0x55b0f084ada0 2024-09-10T22:34:56.278 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:56.272+0000 7fcbf8f2f740 10 client.26417 fetch_fsmap learned FSMap version 27 2024-09-10T22:34:56.278 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:56.272+0000 7fcbf8f2f740 1 -- 172.21.15.19:0/622470288 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55b0f08d8500 con 0x55b0f084ada0 2024-09-10T22:34:56.278 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:56.272+0000 7fcbcffff640 1 -- 172.21.15.19:0/622470288 <== mon.2 v2:172.21.15.135:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fcbe8025070 con 0x55b0f084ada0 2024-09-10T22:34:56.278 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:56.272+0000 7fcbcffff640 1 -- 172.21.15.19:0/622470288 <== mon.2 v2:172.21.15.135:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7fcbdc037930 con 0x55b0f084ada0 2024-09-10T22:34:56.279 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:56.272+0000 7fcbf8f2f740 10 client.26417 fetch_fsmap finished waiting for FSMap version 27 2024-09-10T22:34:56.279 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:56.272+0000 7fcbf8f2f740 10 client.26417 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-10T22:34:56.279 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:56.272+0000 7fcbf8f2f740 20 client.26417 populate_metadata read hostname 'smithi019' 2024-09-10T22:34:56.279 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:56.272+0000 7fcbf8f2f740 1 --2- 172.21.15.19:0/622470288 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x55b0f08d8950 0x55b0f08dad40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:34:56.279 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:56.272+0000 7fcbf8f2f740 4 client.26417 mds_command: new command op to 24581 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-10T22:34:56.279 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:56.272+0000 7fcbf8f2f740 1 -- 172.21.15.19:0/622470288 --> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55b0f07be850 con 0x55b0f08d8950 2024-09-10T22:34:56.279 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:56.273+0000 7fcbf48f6640 1 --2- 172.21.15.19:0/622470288 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x55b0f08d8950 0x55b0f08dad40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:34:56.279 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:56.273+0000 7fcbf48f6640 1 --2- 172.21.15.19:0/622470288 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x55b0f08d8950 0x55b0f08dad40 crc :-1 s=READY pgs=177 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1c5352bb536c3b68 server_cookie=fc6f2a895aea7d51 in_seq=0 out_seq=0 2024-09-10T22:34:56.280 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:56.273+0000 7fcbcffff640 10 client.26417 ms_handle_connect on v2:172.21.15.135:6838/1254769802 2024-09-10T22:34:56.280 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:56.273+0000 7fcbcffff640 1 -- 172.21.15.19:0/622470288 <== mds.0 v2:172.21.15.135:6838/1254769802 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3694 (crc 0 0 0) 0x55b0f07be850 con 0x55b0f08d8950 2024-09-10T22:34:56.280 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:56.273+0000 7fcbcffff640 10 client.26417 handle_command_reply: tid=0 2024-09-10T22:34:56.280 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:56.273+0000 7fcbf8f2f740 1 client.26417 shutdown 2024-09-10T22:34:56.280 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:56.273+0000 7fcbf8f2f740 1 -- 172.21.15.19:0/622470288 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b0f084ada0 msgr2=0x55b0f08637f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:34:56.280 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:56.273+0000 7fcbf8f2f740 1 --2- 172.21.15.19:0/622470288 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b0f084ada0 0x55b0f08637f0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fcbdc005d00 tx=0x7fcbdc00bfa0 comp rx=0 tx=0).stop 2024-09-10T22:34:56.280 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:56.274+0000 7fcbf8f2f740 1 -- 172.21.15.19:0/622470288 shutdown_connections 2024-09-10T22:34:56.280 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:56.274+0000 7fcbf8f2f740 1 --2- 172.21.15.19:0/622470288 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55b0f085b140 0x55b0f0860080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:34:56.280 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:56.274+0000 7fcbf8f2f740 1 --2- 172.21.15.19:0/622470288 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b0f084ada0 0x55b0f08637f0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:34:56.280 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:56.274+0000 7fcbf8f2f740 1 --2- 172.21.15.19:0/622470288 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x55b0f08d8950 0x55b0f08dad40 crc :-1 s=READY pgs=177 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:34:56.280 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:56.274+0000 7fcbf8f2f740 1 --2- 172.21.15.19:0/622470288 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55b0f084a480 0x55b0f0863290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:34:56.280 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:56.274+0000 7fcbcffff640 0 client.26417 ms_handle_reset on v2:172.21.15.135:6838/1254769802 2024-09-10T22:34:56.280 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:56.274+0000 7fcbf8f2f740 1 -- 172.21.15.19:0/622470288 >> 172.21.15.19:0/622470288 conn(0x55b0f08482b0 msgr2=0x55b0f085ce60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:34:56.281 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:56.274+0000 7fcbf8f2f740 1 -- 172.21.15.19:0/622470288 shutdown_connections 2024-09-10T22:34:56.281 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:56.274+0000 7fcbf8f2f740 1 -- 172.21.15.19:0/622470288 wait complete. 2024-09-10T22:34:56.281 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:56.274+0000 7fcbf8f2f740 20 client.26417 trim_cache size 0 max 16384 2024-09-10T22:34:56.281 INFO:teuthology.orchestra.run.smithi019.stdout:{ 2024-09-10T22:34:56.281 INFO:teuthology.orchestra.run.smithi019.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-10T22:34:56.281 INFO:teuthology.orchestra.run.smithi019.stdout: "scrubs": { 2024-09-10T22:34:56.281 INFO:teuthology.orchestra.run.smithi019.stdout: "a77606c2-7618-413e-8aba-f9783ecbf435": { 2024-09-10T22:34:56.281 INFO:teuthology.orchestra.run.smithi019.stdout: "path": "/", 2024-09-10T22:34:56.282 INFO:teuthology.orchestra.run.smithi019.stdout: "tag": "a77606c2-7618-413e-8aba-f9783ecbf435", 2024-09-10T22:34:56.282 INFO:teuthology.orchestra.run.smithi019.stdout: "options": "recursive,force" 2024-09-10T22:34:56.282 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-10T22:34:56.282 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:34:56.282 INFO:teuthology.orchestra.run.smithi019.stdout: "scrub_stats": { 2024-09-10T22:34:56.282 INFO:teuthology.orchestra.run.smithi019.stdout: "a77606c2-7618-413e-8aba-f9783ecbf435": { 2024-09-10T22:34:56.282 INFO:teuthology.orchestra.run.smithi019.stdout: "start_time": "2024-09-10T22:34:54.453894+0000", 2024-09-10T22:34:56.282 INFO:teuthology.orchestra.run.smithi019.stdout: "path": "/", 2024-09-10T22:34:56.282 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_started": 0, 2024-09-10T22:34:56.282 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_passed": 0, 2024-09-10T22:34:56.282 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_failed": 0, 2024-09-10T22:34:56.282 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_skipped": 0 2024-09-10T22:34:56.282 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:34:56.283 INFO:teuthology.orchestra.run.smithi019.stdout: "0b81ea61-0b8e-4f2c-a58f-ef1019289fc9": { 2024-09-10T22:34:56.283 INFO:teuthology.orchestra.run.smithi019.stdout: "start_time": "2024-09-10T22:31:48.141568+0000", 2024-09-10T22:34:56.283 INFO:teuthology.orchestra.run.smithi019.stdout: "path": "/", 2024-09-10T22:34:56.283 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_started": 0, 2024-09-10T22:34:56.283 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_passed": 0, 2024-09-10T22:34:56.283 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_failed": 0, 2024-09-10T22:34:56.283 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_skipped": 0 2024-09-10T22:34:56.283 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:34:56.283 INFO:teuthology.orchestra.run.smithi019.stdout: "715ec863-8a9d-45b6-967f-59b15ce1bf12": { 2024-09-10T22:34:56.283 INFO:teuthology.orchestra.run.smithi019.stdout: "start_time": "2024-09-10T22:31:00.669516+0000", 2024-09-10T22:34:56.283 INFO:teuthology.orchestra.run.smithi019.stdout: "path": "/", 2024-09-10T22:34:56.283 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_started": 0, 2024-09-10T22:34:56.283 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_passed": 0, 2024-09-10T22:34:56.283 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_failed": 0, 2024-09-10T22:34:56.284 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_skipped": 0 2024-09-10T22:34:56.284 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:34:56.284 INFO:teuthology.orchestra.run.smithi019.stdout: "fd1f1837-dcfa-4d88-99e8-2509f36c3f98": { 2024-09-10T22:34:56.284 INFO:teuthology.orchestra.run.smithi019.stdout: "start_time": "2024-09-10T22:30:12.470477+0000", 2024-09-10T22:34:56.284 INFO:teuthology.orchestra.run.smithi019.stdout: "path": "/", 2024-09-10T22:34:56.284 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_started": 0, 2024-09-10T22:34:56.284 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_passed": 0, 2024-09-10T22:34:56.284 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_failed": 0, 2024-09-10T22:34:56.284 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_skipped": 0 2024-09-10T22:34:56.284 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:34:56.284 INFO:teuthology.orchestra.run.smithi019.stdout: "8f3bb3bf-911f-490c-9856-c80ea220dbbe": { 2024-09-10T22:34:56.284 INFO:teuthology.orchestra.run.smithi019.stdout: "start_time": "2024-09-10T22:29:25.374415+0000", 2024-09-10T22:34:56.284 INFO:teuthology.orchestra.run.smithi019.stdout: "path": "/", 2024-09-10T22:34:56.285 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_started": 0, 2024-09-10T22:34:56.285 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_passed": 0, 2024-09-10T22:34:56.285 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_failed": 0, 2024-09-10T22:34:56.285 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_skipped": 0 2024-09-10T22:34:56.285 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:34:56.285 INFO:teuthology.orchestra.run.smithi019.stdout: "eb518e3c-a71e-4f32-9ca0-ae88930ca218": { 2024-09-10T22:34:56.285 INFO:teuthology.orchestra.run.smithi019.stdout: "start_time": "2024-09-10T22:28:38.366352+0000", 2024-09-10T22:34:56.285 INFO:teuthology.orchestra.run.smithi019.stdout: "path": "/", 2024-09-10T22:34:56.285 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_started": 0, 2024-09-10T22:34:56.285 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_passed": 0, 2024-09-10T22:34:56.285 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_failed": 0, 2024-09-10T22:34:56.285 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_skipped": 0 2024-09-10T22:34:56.285 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:34:56.286 INFO:teuthology.orchestra.run.smithi019.stdout: "9efe684b-7583-402e-a46e-e262a37e1af5": { 2024-09-10T22:34:56.286 INFO:teuthology.orchestra.run.smithi019.stdout: "start_time": "2024-09-10T22:34:09.479768+0000", 2024-09-10T22:34:56.286 INFO:teuthology.orchestra.run.smithi019.stdout: "path": "/", 2024-09-10T22:34:56.286 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_started": 0, 2024-09-10T22:34:56.286 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_passed": 0, 2024-09-10T22:34:56.286 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_failed": 0, 2024-09-10T22:34:56.286 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_skipped": 0 2024-09-10T22:34:56.286 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:34:56.286 INFO:teuthology.orchestra.run.smithi019.stdout: "4c99964e-2e0e-4ffd-8cb8-99c4979ed90f": { 2024-09-10T22:34:56.286 INFO:teuthology.orchestra.run.smithi019.stdout: "start_time": "2024-09-10T22:32:34.659639+0000", 2024-09-10T22:34:56.286 INFO:teuthology.orchestra.run.smithi019.stdout: "path": "/", 2024-09-10T22:34:56.286 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_started": 0, 2024-09-10T22:34:56.286 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_passed": 0, 2024-09-10T22:34:56.287 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_failed": 0, 2024-09-10T22:34:56.287 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_skipped": 0 2024-09-10T22:34:56.287 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:34:56.287 INFO:teuthology.orchestra.run.smithi019.stdout: "c12c2a04-dcd6-4673-a98e-93f665d3f5d7": { 2024-09-10T22:34:56.287 INFO:teuthology.orchestra.run.smithi019.stdout: "start_time": "2024-09-10T22:27:49.392329+0000", 2024-09-10T22:34:56.287 INFO:teuthology.orchestra.run.smithi019.stdout: "path": "/", 2024-09-10T22:34:56.287 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_started": 0, 2024-09-10T22:34:56.287 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_passed": 0, 2024-09-10T22:34:56.287 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_failed": 0, 2024-09-10T22:34:56.287 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_skipped": 0 2024-09-10T22:34:56.287 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:34:56.287 INFO:teuthology.orchestra.run.smithi019.stdout: "b38852c8-478a-42ef-8384-b2c55d5313a4": { 2024-09-10T22:34:56.287 INFO:teuthology.orchestra.run.smithi019.stdout: "start_time": "2024-09-10T22:27:00.320308+0000", 2024-09-10T22:34:56.288 INFO:teuthology.orchestra.run.smithi019.stdout: "path": "/", 2024-09-10T22:34:56.288 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_started": 0, 2024-09-10T22:34:56.288 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_passed": 0, 2024-09-10T22:34:56.288 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_failed": 0, 2024-09-10T22:34:56.288 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_skipped": 0 2024-09-10T22:34:56.288 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:34:56.288 INFO:teuthology.orchestra.run.smithi019.stdout: "448b10e7-494c-4a88-a9ab-186159c5dfdd": { 2024-09-10T22:34:56.288 INFO:teuthology.orchestra.run.smithi019.stdout: "start_time": "2024-09-10T22:33:21.208716+0000", 2024-09-10T22:34:56.288 INFO:teuthology.orchestra.run.smithi019.stdout: "path": "/", 2024-09-10T22:34:56.288 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_started": 0, 2024-09-10T22:34:56.288 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_passed": 0, 2024-09-10T22:34:56.288 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_failed": 0, 2024-09-10T22:34:56.288 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_skipped": 0 2024-09-10T22:34:56.289 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:34:56.289 INFO:teuthology.orchestra.run.smithi019.stdout: "9b6bfdee-303c-4c12-af56-dc85860d112a": { 2024-09-10T22:34:56.289 INFO:teuthology.orchestra.run.smithi019.stdout: "start_time": "2024-09-10T22:26:17.484162+0000", 2024-09-10T22:34:56.289 INFO:teuthology.orchestra.run.smithi019.stdout: "path": "/", 2024-09-10T22:34:56.289 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_started": 0, 2024-09-10T22:34:56.289 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_passed": 0, 2024-09-10T22:34:56.289 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_failed": 0, 2024-09-10T22:34:56.289 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_skipped": 0 2024-09-10T22:34:56.289 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-10T22:34:56.289 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-10T22:34:56.289 INFO:teuthology.orchestra.run.smithi019.stdout:} 2024-09-10T22:34:56.290 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:56.274+0000 7fcbf6b5a640 1 -- 172.21.15.19:0/3159404317 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7fcbe00b52e0 msgr2=0x7fcbe00b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:34:56.290 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:56.274+0000 7fcbf6b5a640 1 --2- 172.21.15.19:0/3159404317 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7fcbe00b52e0 0x7fcbe00b77a0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7fcbe8005f40 tx=0x7fcbe8009600 comp rx=0 tx=0).stop 2024-09-10T22:34:56.290 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:56.274+0000 7fcbf6b5a640 1 -- 172.21.15.19:0/3159404317 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fcbf0101ca0 msgr2=0x7fcbf0199250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:34:56.290 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:56.274+0000 7fcbf6b5a640 1 --2- 172.21.15.19:0/3159404317 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fcbf0101ca0 0x7fcbf0199250 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7fcbe4005940 tx=0x7fcbe40042f0 comp rx=0 tx=0).stop 2024-09-10T22:34:56.290 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:56.275+0000 7fcbf6b5a640 1 -- 172.21.15.19:0/3159404317 shutdown_connections 2024-09-10T22:34:56.290 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:56.275+0000 7fcbf6b5a640 1 --2- 172.21.15.19:0/3159404317 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7fcbe00b52e0 0x7fcbe00b77a0 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:34:56.290 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:56.275+0000 7fcbf6b5a640 1 --2- 172.21.15.19:0/3159404317 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fcbf0108030 0x7fcbf019eb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:34:56.290 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:56.275+0000 7fcbf6b5a640 1 --2- 172.21.15.19:0/3159404317 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcbf01076b0 0x7fcbf0199790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:34:56.290 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:56.275+0000 7fcbf6b5a640 1 --2- 172.21.15.19:0/3159404317 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fcbf0101ca0 0x7fcbf0199250 unknown :-1 s=CLOSED pgs=758 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:34:56.290 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:56.275+0000 7fcbf6b5a640 1 -- 172.21.15.19:0/3159404317 >> 172.21.15.19:0/3159404317 conn(0x7fcbf00fd730 msgr2=0x7fcbf006b370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:34:56.291 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:56.275+0000 7fcbf6b5a640 1 -- 172.21.15.19:0/3159404317 shutdown_connections 2024-09-10T22:34:56.291 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:34:56.275+0000 7fcbf6b5a640 1 -- 172.21.15.19:0/3159404317 wait complete. 2024-09-10T22:34:56.459 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:34:56 smithi019 ceph-mon[31375]: pgmap v602: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 518 KiB/s rd, 242 MiB/s wr, 325 op/s 2024-09-10T22:34:56.459 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:34:56 smithi019 ceph-mon[31375]: scrub summary: idle+waiting paths [/] 2024-09-10T22:34:56.609 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:34:56 smithi135 ceph-mon[34789]: pgmap v602: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 518 KiB/s rd, 242 MiB/s wr, 325 op/s 2024-09-10T22:34:56.610 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:34:56 smithi135 ceph-mon[34789]: scrub summary: idle+waiting paths [/] 2024-09-10T22:34:56.625 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:34:56 smithi138 ceph-mon[35236]: pgmap v602: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 518 KiB/s rd, 242 MiB/s wr, 325 op/s 2024-09-10T22:34:56.625 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:34:56 smithi138 ceph-mon[35236]: scrub summary: idle+waiting paths [/] 2024-09-10T22:34:57.063 INFO:tasks.cephfs.filesystem:scrub status for tag:a77606c2-7618-413e-8aba-f9783ecbf435 - {'path': '/', 'tag': 'a77606c2-7618-413e-8aba-f9783ecbf435', 'options': 'recursive,force'} 2024-09-10T22:34:58.610 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:34:58 smithi135 ceph-mon[34789]: pgmap v603: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 549 KiB/s rd, 259 MiB/s wr, 266 op/s 2024-09-10T22:34:58.625 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:34:58 smithi138 ceph-mon[35236]: pgmap v603: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 549 KiB/s rd, 259 MiB/s wr, 266 op/s 2024-09-10T22:34:58.708 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:34:58 smithi019 ceph-mon[31375]: pgmap v603: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 549 KiB/s rd, 259 MiB/s wr, 266 op/s 2024-09-10T22:34:59.630 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:34:59 smithi138 ceph-mon[35236]: pgmap v604: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 548 KiB/s rd, 195 MiB/s wr, 93 op/s 2024-09-10T22:34:59.709 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:34:59 smithi019 ceph-mon[31375]: pgmap v604: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 548 KiB/s rd, 195 MiB/s wr, 93 op/s 2024-09-10T22:34:59.860 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:34:59 smithi135 ceph-mon[34789]: pgmap v604: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 548 KiB/s rd, 195 MiB/s wr, 93 op/s 2024-09-10T22:35:01.959 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:35:01 smithi019 ceph-mon[31375]: pgmap v605: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 729 KiB/s rd, 247 MiB/s wr, 110 op/s 2024-09-10T22:35:02.110 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:35:01 smithi135 ceph-mon[34789]: pgmap v605: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 729 KiB/s rd, 247 MiB/s wr, 110 op/s 2024-09-10T22:35:02.125 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:35:01 smithi138 ceph-mon[35236]: pgmap v605: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 729 KiB/s rd, 247 MiB/s wr, 110 op/s 2024-09-10T22:35:02.746 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:02.743+0000 7ff155c7c640 1 -- 172.21.15.19:0/544903681 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff1501029b0 msgr2=0x7ff150102e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:35:02.746 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:02.743+0000 7ff155c7c640 1 --2- 172.21.15.19:0/544903681 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff1501029b0 0x7ff150102e30 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7ff144009930 tx=0x7ff14402a420 comp rx=0 tx=0).stop 2024-09-10T22:35:02.746 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:02.743+0000 7ff155c7c640 1 -- 172.21.15.19:0/544903681 shutdown_connections 2024-09-10T22:35:02.746 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:02.743+0000 7ff155c7c640 1 --2- 172.21.15.19:0/544903681 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff150103370 0x7ff150109cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:35:02.746 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:02.743+0000 7ff155c7c640 1 --2- 172.21.15.19:0/544903681 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff1501029b0 0x7ff150102e30 unknown :-1 s=CLOSED pgs=761 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:35:02.746 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:02.743+0000 7ff155c7c640 1 --2- 172.21.15.19:0/544903681 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff150101860 0x7ff150101c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:35:02.746 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:02.743+0000 7ff155c7c640 1 -- 172.21.15.19:0/544903681 >> 172.21.15.19:0/544903681 conn(0x7ff1500fd140 msgr2=0x7ff1500ff560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:35:02.746 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:02.744+0000 7ff155c7c640 1 -- 172.21.15.19:0/544903681 shutdown_connections 2024-09-10T22:35:02.746 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:02.744+0000 7ff155c7c640 1 -- 172.21.15.19:0/544903681 wait complete. 2024-09-10T22:35:02.747 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:02.744+0000 7ff155c7c640 1 Processor -- start 2024-09-10T22:35:02.747 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:02.744+0000 7ff155c7c640 1 -- start start 2024-09-10T22:35:02.748 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:02.745+0000 7ff155c7c640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff150101860 0x7ff150197c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:35:02.749 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:02.745+0000 7ff155c7c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff1501029b0 0x7ff1501982e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:35:02.749 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:02.745+0000 7ff155c7c640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff150103370 0x7ff150198f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:35:02.749 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:02.745+0000 7ff155c7c640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7ff15010d4d0 con 0x7ff1501029b0 2024-09-10T22:35:02.749 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:02.745+0000 7ff155c7c640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7ff15010d350 con 0x7ff150103370 2024-09-10T22:35:02.749 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:02.745+0000 7ff155c7c640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7ff15010d650 con 0x7ff150101860 2024-09-10T22:35:02.749 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:02.745+0000 7ff14f7fe640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff150101860 0x7ff150197c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:35:02.749 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:02.745+0000 7ff14effd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff1501029b0 0x7ff1501982e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:35:02.749 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:02.745+0000 7ff14ffff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff150103370 0x7ff150198f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:35:02.749 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:02.745+0000 7ff14f7fe640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff150101860 0x7ff150197c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.19:54508/0 (socket says 172.21.15.19:54508) 2024-09-10T22:35:02.749 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:02.745+0000 7ff14f7fe640 1 -- 172.21.15.19:0/3632810654 learned_addr learned my addr 172.21.15.19:0/3632810654 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:35:02.749 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:02.745+0000 7ff14f7fe640 1 -- 172.21.15.19:0/3632810654 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff150103370 msgr2=0x7ff150198f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:35:02.750 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:02.745+0000 7ff14f7fe640 1 --2- 172.21.15.19:0/3632810654 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff150103370 0x7ff150198f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:35:02.750 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:02.745+0000 7ff14f7fe640 1 -- 172.21.15.19:0/3632810654 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff1501029b0 msgr2=0x7ff1501982e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:35:02.750 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:02.745+0000 7ff14f7fe640 1 --2- 172.21.15.19:0/3632810654 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff1501029b0 0x7ff1501982e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:35:02.750 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:02.745+0000 7ff14f7fe640 1 -- 172.21.15.19:0/3632810654 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff1501997d0 con 0x7ff150101860 2024-09-10T22:35:02.750 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:02.745+0000 7ff14ffff640 1 --2- 172.21.15.19:0/3632810654 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff150103370 0x7ff150198f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T22:35:02.750 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:02.745+0000 7ff14f7fe640 1 --2- 172.21.15.19:0/3632810654 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff150101860 0x7ff150197c90 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7ff14000d770 tx=0x7ff14000dc30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:35:02.750 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:02.746+0000 7ff14cff9640 1 -- 172.21.15.19:0/3632810654 <== mon.1 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff140017070 con 0x7ff150101860 2024-09-10T22:35:02.750 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:02.746+0000 7ff14cff9640 1 -- 172.21.15.19:0/3632810654 <== mon.1 v2:172.21.15.138:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff1400054d0 con 0x7ff150101860 2024-09-10T22:35:02.750 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:02.746+0000 7ff155c7c640 1 -- 172.21.15.19:0/3632810654 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff150199ac0 con 0x7ff150101860 2024-09-10T22:35:02.750 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:02.746+0000 7ff14cff9640 1 -- 172.21.15.19:0/3632810654 <== mon.1 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff140004c30 con 0x7ff150101860 2024-09-10T22:35:02.750 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:02.746+0000 7ff155c7c640 1 -- 172.21.15.19:0/3632810654 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff1501a0190 con 0x7ff150101860 2024-09-10T22:35:02.756 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:02.748+0000 7ff14cff9640 1 -- 172.21.15.19:0/3632810654 <== mon.1 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 18) ==== 153250+0+0 (secure 0 0 0) 0x7ff140004e10 con 0x7ff150101860 2024-09-10T22:35:02.756 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:02.749+0000 7ff158a4a740 1 Processor -- start 2024-09-10T22:35:02.756 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:02.749+0000 7ff158a4a740 1 -- start start 2024-09-10T22:35:02.757 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:02.749+0000 7ff14cff9640 1 --2- 172.21.15.19:0/3632810654 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7ff1380b52e0 0x7ff1380b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:35:02.757 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:02.749+0000 7ff158a4a740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5652b99ca860 0x5652b99ccc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:35:02.757 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:02.749+0000 7ff158a4a740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5652b99cd190 0x5652b99cf580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:35:02.757 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:02.749+0000 7ff158a4a740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5652b99cfbd0 0x5652b99d2090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:35:02.757 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:02.749+0000 7ff158a4a740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x5652b993c6f0 con 0x5652b99cd190 2024-09-10T22:35:02.757 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:02.749+0000 7ff158a4a740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x5652b992bb20 con 0x5652b99cfbd0 2024-09-10T22:35:02.757 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:02.749+0000 7ff158a4a740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x5652b992f930 con 0x5652b99ca860 2024-09-10T22:35:02.757 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:02.750+0000 7ff14f7fe640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5652b99ca860 0x5652b99ccc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:35:02.757 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:02.750+0000 7ff14effd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5652b99cd190 0x5652b99cf580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:35:02.757 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:02.750+0000 7ff14ffff640 1 --2- 172.21.15.19:0/3632810654 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7ff1380b52e0 0x7ff1380b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:35:02.758 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:02.750+0000 7ff14f7fe640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5652b99ca860 0x5652b99ccc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.19:54516/0 (socket says 172.21.15.19:54516) 2024-09-10T22:35:02.758 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:02.750+0000 7ff14effd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5652b99cd190 0x5652b99cf580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:33560/0 (socket says 172.21.15.19:33560) 2024-09-10T22:35:02.758 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:02.750+0000 7ff14f7fe640 1 -- 172.21.15.19:0/2286844425 learned_addr learned my addr 172.21.15.19:0/2286844425 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:35:02.758 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:02.750+0000 7ff14cff9640 1 -- 172.21.15.19:0/3632810654 <== mon.1 v2:172.21.15.138:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8327+0+0 (secure 0 0 0) 0x7ff1400e56a0 con 0x7ff150101860 2024-09-10T22:35:02.758 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:02.750+0000 7ff14ffff640 1 --2- 172.21.15.19:0/2286844425 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5652b99cfbd0 0x5652b99d2090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:35:02.758 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:02.750+0000 7ff14f7fe640 1 -- 172.21.15.19:0/2286844425 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5652b99cfbd0 msgr2=0x5652b99d2090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:35:02.758 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:02.750+0000 7ff14f7fe640 1 --2- 172.21.15.19:0/2286844425 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5652b99cfbd0 0x5652b99d2090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:35:02.758 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:02.750+0000 7ff14f7fe640 1 -- 172.21.15.19:0/2286844425 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5652b99cd190 msgr2=0x5652b99cf580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:35:02.758 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:02.750+0000 7ff14f7fe640 1 --2- 172.21.15.19:0/2286844425 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5652b99cd190 0x5652b99cf580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:35:02.758 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:02.750+0000 7ff14f7fe640 1 -- 172.21.15.19:0/2286844425 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5652b98f1530 con 0x5652b99ca860 2024-09-10T22:35:02.758 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:02.750+0000 7ff14ffff640 1 --2- 172.21.15.19:0/2286844425 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5652b99cfbd0 0x5652b99d2090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T22:35:02.759 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:02.750+0000 7ff14f7fe640 1 --2- 172.21.15.19:0/2286844425 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5652b99ca860 0x5652b99ccc50 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7ff140015040 tx=0x7ff1400ab8c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=260d28fbbbc73587 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:35:02.759 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:02.750+0000 7ff14ffff640 1 --2- 172.21.15.19:0/3632810654 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7ff1380b52e0 0x7ff1380b77a0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7ff148009fd0 tx=0x7ff148005bd0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:35:02.759 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:02.750+0000 7ff135ffb640 1 -- 172.21.15.19:0/2286844425 <== mon.1 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff140020070 con 0x5652b99ca860 2024-09-10T22:35:02.759 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:02.750+0000 7ff135ffb640 1 -- 172.21.15.19:0/2286844425 <== mon.1 v2:172.21.15.138:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff1400ab9c0 con 0x5652b99ca860 2024-09-10T22:35:02.759 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:02.750+0000 7ff135ffb640 1 -- 172.21.15.19:0/2286844425 <== mon.1 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff140005130 con 0x5652b99ca860 2024-09-10T22:35:02.759 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:02.751+0000 7ff158a4a740 1 -- 172.21.15.19:0/2286844425 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5652b99ca860 msgr2=0x5652b99ccc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:35:02.759 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:02.751+0000 7ff158a4a740 1 --2- 172.21.15.19:0/2286844425 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5652b99ca860 0x5652b99ccc50 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7ff140015040 tx=0x7ff1400ab8c0 comp rx=0 tx=0).stop 2024-09-10T22:35:02.759 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:02.751+0000 7ff158a4a740 1 -- 172.21.15.19:0/2286844425 shutdown_connections 2024-09-10T22:35:02.759 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:02.751+0000 7ff158a4a740 1 --2- 172.21.15.19:0/2286844425 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5652b99cfbd0 0x5652b99d2090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:35:02.759 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:02.751+0000 7ff158a4a740 1 --2- 172.21.15.19:0/2286844425 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5652b99cd190 0x5652b99cf580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:35:02.759 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:02.751+0000 7ff158a4a740 1 --2- 172.21.15.19:0/2286844425 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5652b99ca860 0x5652b99ccc50 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:35:02.759 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:02.751+0000 7ff158a4a740 1 -- 172.21.15.19:0/2286844425 >> 172.21.15.19:0/2286844425 conn(0x5652b99c59b0 msgr2=0x5652b99c6740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:35:02.760 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:02.751+0000 7ff158a4a740 1 -- 172.21.15.19:0/2286844425 shutdown_connections 2024-09-10T22:35:02.760 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:02.751+0000 7ff158a4a740 1 -- 172.21.15.19:0/2286844425 wait complete. 2024-09-10T22:35:02.760 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:02.751+0000 7ff158a4a740 1 -- start start 2024-09-10T22:35:02.760 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:02.752+0000 7ff158a4a740 1 Processor -- start 2024-09-10T22:35:02.760 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:02.752+0000 7ff158a4a740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5652b99ca860 0x5652b99d3e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:35:02.760 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:02.752+0000 7ff158a4a740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5652b99cd190 0x5652b99d4500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:35:02.760 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:02.752+0000 7ff158a4a740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5652b99cfbd0 0x5652b99d50d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:35:02.760 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:02.752+0000 7ff158a4a740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x5652b9863ab0 con 0x5652b99cd190 2024-09-10T22:35:02.760 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:02.752+0000 7ff158a4a740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x5652b98d1730 con 0x5652b99ca860 2024-09-10T22:35:02.760 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:02.752+0000 7ff158a4a740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x5652b99d2b50 con 0x5652b99cfbd0 2024-09-10T22:35:02.760 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:02.752+0000 7ff158a4a740 10 client.0 _ll_register_callbacks cb 0x5652b99256b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T22:35:02.761 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:02.752+0000 7ff14effd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5652b99cd190 0x5652b99d4500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:35:02.761 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:02.752+0000 7ff14f7fe640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5652b99ca860 0x5652b99d3e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:35:02.761 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:02.752+0000 7ff14effd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5652b99cd190 0x5652b99d4500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:33570/0 (socket says 172.21.15.19:33570) 2024-09-10T22:35:02.761 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:02.752+0000 7ff14effd640 1 -- 172.21.15.19:0/109156289 learned_addr learned my addr 172.21.15.19:0/109156289 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:35:02.761 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:02.752+0000 7ff14ffff640 1 --2- 172.21.15.19:0/109156289 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5652b99cfbd0 0x5652b99d50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:35:02.761 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:02.752+0000 7ff14effd640 1 -- 172.21.15.19:0/109156289 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5652b99cfbd0 msgr2=0x5652b99d50d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:35:02.761 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:02.752+0000 7ff14effd640 1 --2- 172.21.15.19:0/109156289 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5652b99cfbd0 0x5652b99d50d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:35:02.761 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:02.752+0000 7ff14effd640 1 -- 172.21.15.19:0/109156289 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5652b99ca860 msgr2=0x5652b99d3e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:35:02.761 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:02.752+0000 7ff14effd640 1 --2- 172.21.15.19:0/109156289 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5652b99ca860 0x5652b99d3e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:35:02.761 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:02.753+0000 7ff14effd640 1 -- 172.21.15.19:0/109156289 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5652b968d790 con 0x5652b99cd190 2024-09-10T22:35:02.761 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:02.753+0000 7ff14f7fe640 1 --2- 172.21.15.19:0/109156289 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5652b99ca860 0x5652b99d3e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T22:35:02.761 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:02.753+0000 7ff14ffff640 1 --2- 172.21.15.19:0/109156289 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5652b99cfbd0 0x5652b99d50d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T22:35:02.762 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:02.753+0000 7ff14effd640 1 --2- 172.21.15.19:0/109156289 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5652b99cd190 0x5652b99d4500 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7ff144000c00 tx=0x7ff144031ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dc37995f9b91e821 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:35:02.762 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:02.753+0000 7ff12effd640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-10T22:35:02.762 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:02.753+0000 7ff12effd640 1 -- 172.21.15.19:0/109156289 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff144035040 con 0x5652b99cd190 2024-09-10T22:35:02.762 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:02.753+0000 7ff12effd640 1 -- 172.21.15.19:0/109156289 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8327+0+0 (secure 0 0 0) 0x7ff144004240 con 0x5652b99cd190 2024-09-10T22:35:02.762 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:02.753+0000 7ff158a4a740 1 -- 172.21.15.19:0/109156289 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff1400ab9c0 con 0x5652b99cd190 2024-09-10T22:35:02.762 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:02.753+0000 7ff12effd640 1 -- 172.21.15.19:0/109156289 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7ff14404f050 con 0x5652b99cd190 2024-09-10T22:35:02.762 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:02.753+0000 7ff158a4a740 10 client.17097 fetch_fsmap learned FSMap version 27 2024-09-10T22:35:02.762 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:02.753+0000 7ff158a4a740 1 -- 172.21.15.19:0/109156289 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x5652b9706620 con 0x5652b99cd190 2024-09-10T22:35:02.762 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:02.753+0000 7ff12effd640 1 -- 172.21.15.19:0/109156289 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff1400ab9c0 con 0x5652b99cd190 2024-09-10T22:35:02.762 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:02.754+0000 7ff12effd640 1 -- 172.21.15.19:0/109156289 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7ff144044020 con 0x5652b99cd190 2024-09-10T22:35:02.762 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:02.754+0000 7ff158a4a740 10 client.17097 fetch_fsmap finished waiting for FSMap version 27 2024-09-10T22:35:02.762 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:02.754+0000 7ff158a4a740 10 client.17097 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-10T22:35:02.762 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:02.754+0000 7ff158a4a740 20 client.17097 populate_metadata read hostname 'smithi019' 2024-09-10T22:35:02.763 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:02.754+0000 7ff158a4a740 1 --2- 172.21.15.19:0/109156289 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x5652b99df7b0 0x5652b99e1ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:35:02.763 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:02.754+0000 7ff158a4a740 4 client.17097 mds_command: new command op to 24581 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T22:35:02.763 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:02.754+0000 7ff158a4a740 1 -- 172.21.15.19:0/109156289 --> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5652b993e640 con 0x5652b99df7b0 2024-09-10T22:35:02.763 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:02.754+0000 7ff14f7fe640 1 --2- 172.21.15.19:0/109156289 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x5652b99df7b0 0x5652b99e1ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:35:02.763 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:02.755+0000 7ff12effd640 10 client.17097 ms_handle_connect on v2:172.21.15.135:6838/1254769802 2024-09-10T22:35:02.763 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:02.755+0000 7ff14f7fe640 1 --2- 172.21.15.19:0/109156289 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x5652b99df7b0 0x5652b99e1ba0 crc :-1 s=READY pgs=178 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8e32f91030318c07 server_cookie=4fbbf0ae387df4ae in_seq=0 out_seq=0 2024-09-10T22:35:02.764 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:02.755+0000 7ff12effd640 1 -- 172.21.15.19:0/109156289 <== mds.0 v2:172.21.15.135:6838/1254769802 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5652b993e640 con 0x5652b99df7b0 2024-09-10T22:35:02.764 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:02.755+0000 7ff12effd640 10 client.17097 handle_command_reply: tid=0 2024-09-10T22:35:02.764 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:02.755+0000 7ff158a4a740 1 client.17097 shutdown 2024-09-10T22:35:02.764 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:02.755+0000 7ff158a4a740 1 -- 172.21.15.19:0/109156289 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5652b99cd190 msgr2=0x5652b99d4500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:35:02.764 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:02.755+0000 7ff158a4a740 1 --2- 172.21.15.19:0/109156289 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5652b99cd190 0x5652b99d4500 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7ff144000c00 tx=0x7ff144031ef0 comp rx=0 tx=0).stop 2024-09-10T22:35:02.764 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:02.756+0000 7ff158a4a740 1 -- 172.21.15.19:0/109156289 shutdown_connections 2024-09-10T22:35:02.764 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:02.756+0000 7ff158a4a740 1 --2- 172.21.15.19:0/109156289 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x5652b99df7b0 0x5652b99e1ba0 crc :-1 s=READY pgs=178 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:35:02.764 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:02.756+0000 7ff158a4a740 1 --2- 172.21.15.19:0/109156289 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5652b99cfbd0 0x5652b99d50d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:35:02.765 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:02.756+0000 7ff158a4a740 1 --2- 172.21.15.19:0/109156289 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5652b99cd190 0x5652b99d4500 unknown :-1 s=CLOSED pgs=762 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:35:02.765 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:02.756+0000 7ff158a4a740 1 --2- 172.21.15.19:0/109156289 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5652b99ca860 0x5652b99d3e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:35:02.765 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:02.756+0000 7ff12effd640 0 client.17097 ms_handle_reset on v2:172.21.15.135:6838/1254769802 2024-09-10T22:35:02.765 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:02.756+0000 7ff158a4a740 1 -- 172.21.15.19:0/109156289 >> 172.21.15.19:0/109156289 conn(0x5652b99c59b0 msgr2=0x5652b99c4bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:35:02.765 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:02.756+0000 7ff158a4a740 1 -- 172.21.15.19:0/109156289 shutdown_connections 2024-09-10T22:35:02.765 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:02.756+0000 7ff158a4a740 1 -- 172.21.15.19:0/109156289 wait complete. 2024-09-10T22:35:02.765 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:02.756+0000 7ff158a4a740 20 client.17097 trim_cache size 0 max 16384 2024-09-10T22:35:02.779 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:02.772+0000 7ff158a4a740 1 Processor -- start 2024-09-10T22:35:02.779 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:02.772+0000 7ff158a4a740 1 -- start start 2024-09-10T22:35:02.779 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:02.772+0000 7ff158a4a740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5652b99ca860 0x5652b99c0d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:35:02.779 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:02.772+0000 7ff158a4a740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5652b99cd190 0x5652b99d4570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:35:02.779 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:02.772+0000 7ff158a4a740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5652b99cfbd0 0x5652b99d30a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:35:02.779 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:02.772+0000 7ff158a4a740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7ff1501aa520 con 0x5652b99ca860 2024-09-10T22:35:02.779 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:02.772+0000 7ff158a4a740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7ff1501a7df0 con 0x5652b99cd190 2024-09-10T22:35:02.780 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:02.772+0000 7ff158a4a740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7ff1501a5cf0 con 0x5652b99cfbd0 2024-09-10T22:35:02.780 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:02.773+0000 7ff14f7fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5652b99ca860 0x5652b99c0d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:35:02.780 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:02.773+0000 7ff14f7fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5652b99ca860 0x5652b99c0d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:33580/0 (socket says 172.21.15.19:33580) 2024-09-10T22:35:02.780 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:02.773+0000 7ff14f7fe640 1 -- 172.21.15.19:0/255574751 learned_addr learned my addr 172.21.15.19:0/255574751 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:35:02.780 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:02.773+0000 7ff14ffff640 1 --2- 172.21.15.19:0/255574751 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5652b99cfbd0 0x5652b99d30a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:35:02.780 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:02.773+0000 7ff14effd640 1 --2- 172.21.15.19:0/255574751 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5652b99cd190 0x5652b99d4570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:35:02.780 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:02.773+0000 7ff14f7fe640 1 -- 172.21.15.19:0/255574751 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5652b99cfbd0 msgr2=0x5652b99d30a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:35:02.780 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:02.773+0000 7ff14f7fe640 1 --2- 172.21.15.19:0/255574751 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5652b99cfbd0 0x5652b99d30a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:35:02.780 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:02.773+0000 7ff14f7fe640 1 -- 172.21.15.19:0/255574751 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5652b99cd190 msgr2=0x5652b99d4570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:35:02.780 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:02.773+0000 7ff14f7fe640 1 --2- 172.21.15.19:0/255574751 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5652b99cd190 0x5652b99d4570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:35:02.780 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:02.773+0000 7ff14f7fe640 1 -- 172.21.15.19:0/255574751 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5652b99cf8f0 con 0x5652b99ca860 2024-09-10T22:35:02.781 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:02.773+0000 7ff14effd640 1 --2- 172.21.15.19:0/255574751 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5652b99cd190 0x5652b99d4570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T22:35:02.781 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:02.773+0000 7ff14f7fe640 1 --2- 172.21.15.19:0/255574751 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5652b99ca860 0x5652b99c0d20 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7ff1400057a0 tx=0x7ff140009f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1784f62856663afc server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:35:02.781 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:02.773+0000 7ff1357fa640 1 -- 172.21.15.19:0/255574751 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff140020040 con 0x5652b99ca860 2024-09-10T22:35:02.781 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:02.773+0000 7ff1357fa640 1 -- 172.21.15.19:0/255574751 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff1400ab9c0 con 0x5652b99ca860 2024-09-10T22:35:02.781 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:02.773+0000 7ff1357fa640 1 -- 172.21.15.19:0/255574751 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff140005130 con 0x5652b99ca860 2024-09-10T22:35:02.781 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:02.774+0000 7ff158a4a740 1 -- 172.21.15.19:0/255574751 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5652b99ca860 msgr2=0x5652b99c0d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:35:02.781 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:02.774+0000 7ff158a4a740 1 --2- 172.21.15.19:0/255574751 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5652b99ca860 0x5652b99c0d20 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7ff1400057a0 tx=0x7ff140009f90 comp rx=0 tx=0).stop 2024-09-10T22:35:02.781 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:02.774+0000 7ff158a4a740 1 -- 172.21.15.19:0/255574751 shutdown_connections 2024-09-10T22:35:02.781 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:02.774+0000 7ff158a4a740 1 --2- 172.21.15.19:0/255574751 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5652b99cfbd0 0x5652b99d30a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:35:02.781 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:02.774+0000 7ff158a4a740 1 --2- 172.21.15.19:0/255574751 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5652b99cd190 0x5652b99d4570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:35:02.781 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:02.774+0000 7ff158a4a740 1 --2- 172.21.15.19:0/255574751 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5652b99ca860 0x5652b99c0d20 unknown :-1 s=CLOSED pgs=763 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:35:02.781 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:02.774+0000 7ff158a4a740 1 -- 172.21.15.19:0/255574751 >> 172.21.15.19:0/255574751 conn(0x5652b99c59b0 msgr2=0x5652b99d3e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:35:02.782 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:02.774+0000 7ff158a4a740 1 -- 172.21.15.19:0/255574751 shutdown_connections 2024-09-10T22:35:02.782 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:02.774+0000 7ff158a4a740 1 -- 172.21.15.19:0/255574751 wait complete. 2024-09-10T22:35:02.782 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:02.774+0000 7ff158a4a740 1 -- start start 2024-09-10T22:35:02.782 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:02.775+0000 7ff158a4a740 1 Processor -- start 2024-09-10T22:35:02.782 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:02.775+0000 7ff158a4a740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5652b99ca860 0x5652b99dab60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:35:02.782 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:02.775+0000 7ff158a4a740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5652b99cd190 0x5652b99db0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:35:02.782 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:02.775+0000 7ff158a4a740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5652b99cfbd0 0x5652b99db5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:35:02.782 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:02.775+0000 7ff158a4a740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7ff1501a62b0 con 0x5652b99cfbd0 2024-09-10T22:35:02.782 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:02.775+0000 7ff158a4a740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7ff1501a7720 con 0x5652b99cd190 2024-09-10T22:35:02.782 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:02.775+0000 7ff158a4a740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7ff1501a6980 con 0x5652b99ca860 2024-09-10T22:35:02.782 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:02.775+0000 7ff158a4a740 10 client.0 _ll_register_callbacks cb 0x7ff144009640 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T22:35:02.782 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:02.775+0000 7ff14ffff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5652b99cfbd0 0x5652b99db5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:35:02.783 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:02.775+0000 7ff14ffff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5652b99cfbd0 0x5652b99db5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:33596/0 (socket says 172.21.15.19:33596) 2024-09-10T22:35:02.783 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:02.775+0000 7ff14ffff640 1 -- 172.21.15.19:0/539879980 learned_addr learned my addr 172.21.15.19:0/539879980 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:35:02.783 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:02.775+0000 7ff14effd640 1 --2- 172.21.15.19:0/539879980 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5652b99cd190 0x5652b99db0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:35:02.783 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:02.775+0000 7ff14f7fe640 1 --2- 172.21.15.19:0/539879980 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5652b99ca860 0x5652b99dab60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:35:02.783 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:02.775+0000 7ff14ffff640 1 -- 172.21.15.19:0/539879980 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5652b99ca860 msgr2=0x5652b99dab60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:35:02.783 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:02.775+0000 7ff14ffff640 1 --2- 172.21.15.19:0/539879980 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5652b99ca860 0x5652b99dab60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:35:02.783 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:02.775+0000 7ff14ffff640 1 -- 172.21.15.19:0/539879980 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5652b99cd190 msgr2=0x5652b99db0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:35:02.783 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:02.775+0000 7ff14ffff640 1 --2- 172.21.15.19:0/539879980 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5652b99cd190 0x5652b99db0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:35:02.783 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:02.775+0000 7ff14ffff640 1 -- 172.21.15.19:0/539879980 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5652b99d9920 con 0x5652b99cfbd0 2024-09-10T22:35:02.783 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:02.775+0000 7ff14f7fe640 1 --2- 172.21.15.19:0/539879980 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5652b99ca860 0x5652b99dab60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T22:35:02.783 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:02.775+0000 7ff14ffff640 1 --2- 172.21.15.19:0/539879980 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5652b99cfbd0 0x5652b99db5e0 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7ff150198a10 tx=0x7ff148004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4974466c3ba6f129 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:35:02.783 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:02.775+0000 7ff12effd640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-10T22:35:02.783 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:02.776+0000 7ff12effd640 1 -- 172.21.15.19:0/539879980 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff148030060 con 0x5652b99cfbd0 2024-09-10T22:35:02.783 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:02.776+0000 7ff12effd640 1 -- 172.21.15.19:0/539879980 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8327+0+0 (secure 0 0 0) 0x7ff148011d90 con 0x5652b99cfbd0 2024-09-10T22:35:02.784 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:02.776+0000 7ff158a4a740 1 -- 172.21.15.19:0/539879980 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff1400ab9c0 con 0x5652b99cfbd0 2024-09-10T22:35:02.784 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:02.776+0000 7ff12effd640 1 -- 172.21.15.19:0/539879980 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7ff14802b470 con 0x5652b99cfbd0 2024-09-10T22:35:02.784 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:02.776+0000 7ff158a4a740 10 client.17103 fetch_fsmap learned FSMap version 27 2024-09-10T22:35:02.784 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:02.776+0000 7ff158a4a740 1 -- 172.21.15.19:0/539879980 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x5652b9a4ccd0 con 0x5652b99cfbd0 2024-09-10T22:35:02.784 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:02.776+0000 7ff12effd640 1 -- 172.21.15.19:0/539879980 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff1400ab9c0 con 0x5652b99cfbd0 2024-09-10T22:35:02.784 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:02.776+0000 7ff12effd640 1 -- 172.21.15.19:0/539879980 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7ff148034030 con 0x5652b99cfbd0 2024-09-10T22:35:02.784 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:02.776+0000 7ff158a4a740 10 client.17103 fetch_fsmap finished waiting for FSMap version 27 2024-09-10T22:35:02.784 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:02.776+0000 7ff158a4a740 10 client.17103 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-10T22:35:02.784 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:02.776+0000 7ff158a4a740 20 client.17103 populate_metadata read hostname 'smithi019' 2024-09-10T22:35:02.784 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:02.776+0000 7ff158a4a740 1 --2- 172.21.15.19:0/539879980 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x5652b9a4d6e0 0x5652b9a4fb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:35:02.784 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:02.776+0000 7ff158a4a740 4 client.17103 mds_command: new command op to 24581 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-10T22:35:02.784 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:02.776+0000 7ff158a4a740 1 -- 172.21.15.19:0/539879980 --> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5652b993a0f0 con 0x5652b9a4d6e0 2024-09-10T22:35:02.784 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:02.776+0000 7ff14f7fe640 1 --2- 172.21.15.19:0/539879980 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x5652b9a4d6e0 0x5652b9a4fb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:35:02.785 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:02.777+0000 7ff12effd640 10 client.17103 ms_handle_connect on v2:172.21.15.135:6838/1254769802 2024-09-10T22:35:02.785 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:02.777+0000 7ff14f7fe640 1 --2- 172.21.15.19:0/539879980 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x5652b9a4d6e0 0x5652b9a4fb00 crc :-1 s=READY pgs=179 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ae2cad35358ef02b server_cookie=a614a40d11ecca4e in_seq=0 out_seq=0 2024-09-10T22:35:02.958 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:35:02 smithi019 ceph-mon[31375]: scrub summary: idle 2024-09-10T22:35:02.959 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:35:02 smithi019 ceph-mon[31375]: scrub summary: idle 2024-09-10T22:35:03.112 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:35:02 smithi135 ceph-mon[34789]: scrub summary: idle 2024-09-10T22:35:03.112 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:35:02 smithi135 ceph-mon[34789]: scrub summary: idle 2024-09-10T22:35:03.125 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:35:02 smithi138 ceph-mon[35236]: scrub summary: idle 2024-09-10T22:35:03.125 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:35:02 smithi138 ceph-mon[35236]: scrub summary: idle 2024-09-10T22:35:03.958 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:35:03 smithi019 ceph-mon[31375]: pgmap v606: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 486 KiB/s rd, 218 MiB/s wr, 91 op/s 2024-09-10T22:35:04.110 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:35:03 smithi135 ceph-mon[34789]: pgmap v606: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 486 KiB/s rd, 218 MiB/s wr, 91 op/s 2024-09-10T22:35:04.125 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:35:03 smithi138 ceph-mon[35236]: pgmap v606: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 486 KiB/s rd, 218 MiB/s wr, 91 op/s 2024-09-10T22:35:05.958 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:35:05 smithi019 ceph-mon[31375]: pgmap v607: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 648 KiB/s rd, 222 MiB/s wr, 105 op/s 2024-09-10T22:35:06.110 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:35:05 smithi135 ceph-mon[34789]: pgmap v607: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 648 KiB/s rd, 222 MiB/s wr, 105 op/s 2024-09-10T22:35:06.125 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:35:05 smithi138 ceph-mon[35236]: pgmap v607: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 648 KiB/s rd, 222 MiB/s wr, 105 op/s 2024-09-10T22:35:08.110 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:35:07 smithi135 ceph-mon[34789]: pgmap v608: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 720 KiB/s rd, 258 MiB/s wr, 166 op/s 2024-09-10T22:35:08.125 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:35:07 smithi138 ceph-mon[35236]: pgmap v608: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 720 KiB/s rd, 258 MiB/s wr, 166 op/s 2024-09-10T22:35:08.209 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:35:07 smithi019 ceph-mon[31375]: pgmap v608: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 720 KiB/s rd, 258 MiB/s wr, 166 op/s 2024-09-10T22:35:10.110 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:35:09 smithi135 ceph-mon[34789]: pgmap v609: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 415 KiB/s rd, 211 MiB/s wr, 164 op/s 2024-09-10T22:35:10.125 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:35:09 smithi138 ceph-mon[35236]: pgmap v609: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 415 KiB/s rd, 211 MiB/s wr, 164 op/s 2024-09-10T22:35:10.208 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:35:09 smithi019 ceph-mon[31375]: pgmap v609: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 415 KiB/s rd, 211 MiB/s wr, 164 op/s 2024-09-10T22:35:11.115 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:11.113+0000 7ff12effd640 1 -- 172.21.15.19:0/539879980 <== mds.0 v2:172.21.15.135:6838/1254769802 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5652b993a0f0 con 0x5652b9a4d6e0 2024-09-10T22:35:11.115 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:11.113+0000 7ff12effd640 10 client.17103 handle_command_reply: tid=0 2024-09-10T22:35:11.115 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:11.113+0000 7ff158a4a740 1 client.17103 shutdown 2024-09-10T22:35:11.115 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:11.113+0000 7ff158a4a740 1 -- 172.21.15.19:0/539879980 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5652b99cfbd0 msgr2=0x5652b99db5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:35:11.115 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:11.113+0000 7ff158a4a740 1 --2- 172.21.15.19:0/539879980 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5652b99cfbd0 0x5652b99db5e0 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7ff150198a10 tx=0x7ff148004ab0 comp rx=0 tx=0).stop 2024-09-10T22:35:11.115 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:11.113+0000 7ff158a4a740 1 -- 172.21.15.19:0/539879980 shutdown_connections 2024-09-10T22:35:11.116 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:11.113+0000 7ff158a4a740 1 --2- 172.21.15.19:0/539879980 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5652b99cfbd0 0x5652b99db5e0 unknown :-1 s=CLOSED pgs=764 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:35:11.116 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:11.113+0000 7ff158a4a740 1 --2- 172.21.15.19:0/539879980 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5652b99cd190 0x5652b99db0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:35:11.116 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:11.113+0000 7ff158a4a740 1 --2- 172.21.15.19:0/539879980 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x5652b9a4d6e0 0x5652b9a4fb00 crc :-1 s=READY pgs=179 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:35:11.116 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:11.113+0000 7ff158a4a740 1 --2- 172.21.15.19:0/539879980 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5652b99ca860 0x5652b99dab60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:35:11.116 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:11.113+0000 7ff158a4a740 1 -- 172.21.15.19:0/539879980 >> 172.21.15.19:0/539879980 conn(0x5652b99c59b0 msgr2=0x5652b99d30a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:35:11.116 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:11.113+0000 7ff12effd640 0 client.17103 ms_handle_reset on v2:172.21.15.135:6838/1254769802 2024-09-10T22:35:11.116 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:11.113+0000 7ff158a4a740 1 -- 172.21.15.19:0/539879980 shutdown_connections 2024-09-10T22:35:11.116 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:11.113+0000 7ff158a4a740 1 -- 172.21.15.19:0/539879980 wait complete. 2024-09-10T22:35:11.116 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:11.113+0000 7ff158a4a740 20 client.17103 trim_cache size 0 max 16384 2024-09-10T22:35:11.116 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stdout:{ 2024-09-10T22:35:11.117 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stdout: "message": "", 2024-09-10T22:35:11.117 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stdout: "return_code": 0 2024-09-10T22:35:11.117 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stdout:} 2024-09-10T22:35:11.117 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:11.114+0000 7ff155c7c640 1 -- 172.21.15.19:0/3632810654 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7ff1380b52e0 msgr2=0x7ff1380b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:35:11.117 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:11.114+0000 7ff155c7c640 1 --2- 172.21.15.19:0/3632810654 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7ff1380b52e0 0x7ff1380b77a0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7ff148009fd0 tx=0x7ff148005bd0 comp rx=0 tx=0).stop 2024-09-10T22:35:11.118 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:11.114+0000 7ff155c7c640 1 -- 172.21.15.19:0/3632810654 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff150101860 msgr2=0x7ff150197c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:35:11.118 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:11.114+0000 7ff155c7c640 1 --2- 172.21.15.19:0/3632810654 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff150101860 0x7ff150197c90 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7ff14000d770 tx=0x7ff14000dc30 comp rx=0 tx=0).stop 2024-09-10T22:35:11.118 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:11.114+0000 7ff155c7c640 1 -- 172.21.15.19:0/3632810654 shutdown_connections 2024-09-10T22:35:11.118 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:11.114+0000 7ff155c7c640 1 --2- 172.21.15.19:0/3632810654 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7ff1380b52e0 0x7ff1380b77a0 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:35:11.118 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:11.114+0000 7ff155c7c640 1 --2- 172.21.15.19:0/3632810654 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff150103370 0x7ff150198f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:35:11.118 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:11.114+0000 7ff155c7c640 1 --2- 172.21.15.19:0/3632810654 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff1501029b0 0x7ff1501982e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:35:11.118 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:11.114+0000 7ff155c7c640 1 --2- 172.21.15.19:0/3632810654 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff150101860 0x7ff150197c90 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:35:11.118 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:11.114+0000 7ff155c7c640 1 -- 172.21.15.19:0/3632810654 >> 172.21.15.19:0/3632810654 conn(0x7ff1500fd140 msgr2=0x7ff150103d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:35:11.118 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:11.114+0000 7ff155c7c640 1 -- 172.21.15.19:0/3632810654 shutdown_connections 2024-09-10T22:35:11.118 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:11.114+0000 7ff155c7c640 1 -- 172.21.15.19:0/3632810654 wait complete. 2024-09-10T22:35:12.125 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:35:11 smithi138 ceph-mon[35236]: pgmap v610: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 416 KiB/s rd, 257 MiB/s wr, 296 op/s 2024-09-10T22:35:12.208 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:35:11 smithi019 ceph-mon[31375]: pgmap v610: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 416 KiB/s rd, 257 MiB/s wr, 296 op/s 2024-09-10T22:35:12.360 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:35:11 smithi135 ceph-mon[34789]: pgmap v610: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 416 KiB/s rd, 257 MiB/s wr, 296 op/s 2024-09-10T22:35:14.208 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:35:13 smithi019 ceph-mon[31375]: pgmap v611: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 435 KiB/s rd, 222 MiB/s wr, 348 op/s 2024-09-10T22:35:14.360 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:35:13 smithi135 ceph-mon[34789]: pgmap v611: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 435 KiB/s rd, 222 MiB/s wr, 348 op/s 2024-09-10T22:35:14.375 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:35:13 smithi138 ceph-mon[35236]: pgmap v611: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 435 KiB/s rd, 222 MiB/s wr, 348 op/s 2024-09-10T22:35:16.208 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:35:15 smithi019 ceph-mon[31375]: pgmap v612: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 511 KiB/s rd, 228 MiB/s wr, 438 op/s 2024-09-10T22:35:16.360 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:35:15 smithi135 ceph-mon[34789]: pgmap v612: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 511 KiB/s rd, 228 MiB/s wr, 438 op/s 2024-09-10T22:35:16.375 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:35:15 smithi138 ceph-mon[35236]: pgmap v612: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 511 KiB/s rd, 228 MiB/s wr, 438 op/s 2024-09-10T22:35:18.208 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:35:17 smithi019 ceph-mon[31375]: pgmap v613: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 421 KiB/s rd, 261 MiB/s wr, 653 op/s 2024-09-10T22:35:18.360 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:35:17 smithi135 ceph-mon[34789]: pgmap v613: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 421 KiB/s rd, 261 MiB/s wr, 653 op/s 2024-09-10T22:35:18.375 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:35:17 smithi138 ceph-mon[35236]: pgmap v613: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 421 KiB/s rd, 261 MiB/s wr, 653 op/s 2024-09-10T22:35:20.208 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:35:19 smithi019 ceph-mon[31375]: pgmap v614: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 531 KiB/s rd, 207 MiB/s wr, 630 op/s 2024-09-10T22:35:20.360 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:35:19 smithi135 ceph-mon[34789]: pgmap v614: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 531 KiB/s rd, 207 MiB/s wr, 630 op/s 2024-09-10T22:35:20.375 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:35:19 smithi138 ceph-mon[35236]: pgmap v614: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 531 KiB/s rd, 207 MiB/s wr, 630 op/s 2024-09-10T22:35:22.208 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:35:21 smithi019 ceph-mon[31375]: pgmap v615: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 531 KiB/s rd, 242 MiB/s wr, 844 op/s 2024-09-10T22:35:22.359 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:35:21 smithi135 ceph-mon[34789]: pgmap v615: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 531 KiB/s rd, 242 MiB/s wr, 844 op/s 2024-09-10T22:35:22.375 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:35:21 smithi138 ceph-mon[35236]: pgmap v615: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 531 KiB/s rd, 242 MiB/s wr, 844 op/s 2024-09-10T22:35:24.209 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:35:23 smithi019 ceph-mon[31375]: pgmap v616: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 531 KiB/s rd, 222 MiB/s wr, 897 op/s 2024-09-10T22:35:24.309 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:24.307+0000 7fdcd8fc6640 1 -- 172.21.15.19:0/1755674863 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdcd406bef0 msgr2=0x7fdcd41055c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:35:24.310 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:24.307+0000 7fdcd8fc6640 1 --2- 172.21.15.19:0/1755674863 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdcd406bef0 0x7fdcd41055c0 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x7fdcc4009900 tx=0x7fdcc402a410 comp rx=0 tx=0).stop 2024-09-10T22:35:24.310 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:24.307+0000 7fdcd8fc6640 1 -- 172.21.15.19:0/1755674863 shutdown_connections 2024-09-10T22:35:24.310 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:24.307+0000 7fdcd8fc6640 1 --2- 172.21.15.19:0/1755674863 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fdcd41086b0 0x7fdcd410ab70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:35:24.310 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:24.307+0000 7fdcd8fc6640 1 --2- 172.21.15.19:0/1755674863 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdcd4105b00 0x7fdcd4107f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:35:24.310 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:24.307+0000 7fdcd8fc6640 1 --2- 172.21.15.19:0/1755674863 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdcd406bef0 0x7fdcd41055c0 unknown :-1 s=CLOSED pgs=765 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:35:24.310 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:24.307+0000 7fdcd8fc6640 1 -- 172.21.15.19:0/1755674863 >> 172.21.15.19:0/1755674863 conn(0x7fdcd40fd150 msgr2=0x7fdcd40ff570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:35:24.310 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:24.307+0000 7fdcd8fc6640 1 -- 172.21.15.19:0/1755674863 shutdown_connections 2024-09-10T22:35:24.310 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:24.307+0000 7fdcd8fc6640 1 -- 172.21.15.19:0/1755674863 wait complete. 2024-09-10T22:35:24.312 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:24.308+0000 7fdcd8fc6640 1 Processor -- start 2024-09-10T22:35:24.313 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:24.309+0000 7fdcd8fc6640 1 -- start start 2024-09-10T22:35:24.313 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:24.309+0000 7fdcd8fc6640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdcd406bef0 0x7fdcd4198de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:35:24.313 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:24.309+0000 7fdcd8fc6640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fdcd4105b00 0x7fdcd4199430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:35:24.313 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:24.309+0000 7fdcd8fc6640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdcd41086b0 0x7fdcd419a060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:35:24.313 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:24.309+0000 7fdcd8fc6640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fdcd410e630 con 0x7fdcd406bef0 2024-09-10T22:35:24.313 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:24.309+0000 7fdcd8fc6640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fdcd410e4b0 con 0x7fdcd41086b0 2024-09-10T22:35:24.313 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:24.309+0000 7fdcd8fc6640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7fdcd410e7b0 con 0x7fdcd4105b00 2024-09-10T22:35:24.313 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:24.309+0000 7fdcd259c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdcd406bef0 0x7fdcd4198de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:35:24.313 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:24.309+0000 7fdcd259c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdcd406bef0 0x7fdcd4198de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:38464/0 (socket says 172.21.15.19:38464) 2024-09-10T22:35:24.313 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:24.309+0000 7fdcd259c640 1 -- 172.21.15.19:0/2657722690 learned_addr learned my addr 172.21.15.19:0/2657722690 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:35:24.313 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:24.309+0000 7fdcd2d9d640 1 --2- 172.21.15.19:0/2657722690 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdcd41086b0 0x7fdcd419a060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:35:24.314 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:24.309+0000 7fdccbfff640 1 --2- 172.21.15.19:0/2657722690 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fdcd4105b00 0x7fdcd4199430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:35:24.314 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:24.309+0000 7fdcd259c640 1 -- 172.21.15.19:0/2657722690 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fdcd4105b00 msgr2=0x7fdcd4199430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:35:24.314 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:24.309+0000 7fdcd259c640 1 --2- 172.21.15.19:0/2657722690 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fdcd4105b00 0x7fdcd4199430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:35:24.314 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:24.309+0000 7fdcd259c640 1 -- 172.21.15.19:0/2657722690 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdcd41086b0 msgr2=0x7fdcd419a060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:35:24.314 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:24.309+0000 7fdcd259c640 1 --2- 172.21.15.19:0/2657722690 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdcd41086b0 0x7fdcd419a060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:35:24.314 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:24.309+0000 7fdcd259c640 1 -- 172.21.15.19:0/2657722690 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdcd419a920 con 0x7fdcd406bef0 2024-09-10T22:35:24.314 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:24.309+0000 7fdcd2d9d640 1 --2- 172.21.15.19:0/2657722690 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdcd41086b0 0x7fdcd419a060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T22:35:24.314 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:24.310+0000 7fdcd259c640 1 --2- 172.21.15.19:0/2657722690 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdcd406bef0 0x7fdcd4198de0 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7fdcc4005940 tx=0x7fdcc40042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:35:24.314 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:24.310+0000 7fdccb7fe640 1 -- 172.21.15.19:0/2657722690 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdcc403f030 con 0x7fdcd406bef0 2024-09-10T22:35:24.314 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:24.310+0000 7fdccb7fe640 1 -- 172.21.15.19:0/2657722690 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fdcc4003cb0 con 0x7fdcd406bef0 2024-09-10T22:35:24.314 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:24.310+0000 7fdcd8fc6640 1 -- 172.21.15.19:0/2657722690 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdcd419abb0 con 0x7fdcd406bef0 2024-09-10T22:35:24.314 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:24.310+0000 7fdccb7fe640 1 -- 172.21.15.19:0/2657722690 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdcc4035070 con 0x7fdcd406bef0 2024-09-10T22:35:24.314 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:24.310+0000 7fdcd8fc6640 1 -- 172.21.15.19:0/2657722690 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdcd41a12e0 con 0x7fdcd406bef0 2024-09-10T22:35:24.321 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:24.313+0000 7fdccb7fe640 1 -- 172.21.15.19:0/2657722690 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 18) ==== 153250+0+0 (secure 0 0 0) 0x7fdcc403bbe0 con 0x7fdcd406bef0 2024-09-10T22:35:24.321 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:24.313+0000 7fdcdbe6d740 1 Processor -- start 2024-09-10T22:35:24.321 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:24.313+0000 7fdcdbe6d740 1 -- start start 2024-09-10T22:35:24.322 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:24.313+0000 7fdcdbe6d740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x558fd370a860 0x558fd370cc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:35:24.322 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:24.313+0000 7fdcdbe6d740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x558fd370d190 0x558fd370f580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:35:24.322 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:24.313+0000 7fdcdbe6d740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558fd370fbd0 0x558fd3712090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:35:24.322 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:24.313+0000 7fdcdbe6d740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x558fd367c6f0 con 0x558fd370d190 2024-09-10T22:35:24.322 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:24.313+0000 7fdcdbe6d740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x558fd366bb20 con 0x558fd370fbd0 2024-09-10T22:35:24.322 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:24.313+0000 7fdcdbe6d740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x558fd366f930 con 0x558fd370a860 2024-09-10T22:35:24.322 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:24.314+0000 7fdcd259c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x558fd370d190 0x558fd370f580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:35:24.323 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:24.314+0000 7fdcd259c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x558fd370d190 0x558fd370f580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:38466/0 (socket says 172.21.15.19:38466) 2024-09-10T22:35:24.323 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:24.314+0000 7fdcd259c640 1 -- 172.21.15.19:0/1036836687 learned_addr learned my addr 172.21.15.19:0/1036836687 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:35:24.323 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:24.314+0000 7fdccbfff640 1 --2- 172.21.15.19:0/1036836687 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558fd370fbd0 0x558fd3712090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:35:24.323 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:24.314+0000 7fdcd2d9d640 1 --2- 172.21.15.19:0/1036836687 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x558fd370a860 0x558fd370cc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:35:24.323 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:24.314+0000 7fdccbfff640 1 -- 172.21.15.19:0/1036836687 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x558fd370a860 msgr2=0x558fd370cc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:35:24.323 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:24.314+0000 7fdccbfff640 1 --2- 172.21.15.19:0/1036836687 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x558fd370a860 0x558fd370cc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:35:24.323 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:24.314+0000 7fdccbfff640 1 -- 172.21.15.19:0/1036836687 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x558fd370d190 msgr2=0x558fd370f580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:35:24.323 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:24.314+0000 7fdccbfff640 1 --2- 172.21.15.19:0/1036836687 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x558fd370d190 0x558fd370f580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:35:24.323 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:24.314+0000 7fdccbfff640 1 -- 172.21.15.19:0/1036836687 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558fd3631530 con 0x558fd370fbd0 2024-09-10T22:35:24.323 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:24.314+0000 7fdccb7fe640 1 --2- 172.21.15.19:0/2657722690 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7fdcc00b52e0 0x7fdcc00b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:35:24.323 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:24.314+0000 7fdcd2d9d640 1 --2- 172.21.15.19:0/1036836687 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x558fd370a860 0x558fd370cc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T22:35:24.324 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:24.314+0000 7fdccbfff640 1 --2- 172.21.15.19:0/1036836687 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558fd370fbd0 0x558fd3712090 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fdcbc009bf0 tx=0x7fdcbc011810 comp rx=0 tx=0).ready entity=mon.2 client_cookie=10086dc9f29e6c7d server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:35:24.324 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:24.314+0000 7fdcd2d9d640 1 --2- 172.21.15.19:0/2657722690 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7fdcc00b52e0 0x7fdcc00b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:35:24.324 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:24.314+0000 7fdccb7fe640 1 -- 172.21.15.19:0/2657722690 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8327+0+0 (secure 0 0 0) 0x7fdcc4106340 con 0x7fdcd406bef0 2024-09-10T22:35:24.324 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:24.314+0000 7fdcc8ff9640 1 -- 172.21.15.19:0/1036836687 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdcbc009da0 con 0x558fd370fbd0 2024-09-10T22:35:24.324 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:24.315+0000 7fdcc8ff9640 1 -- 172.21.15.19:0/1036836687 <== mon.2 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fdcbc005020 con 0x558fd370fbd0 2024-09-10T22:35:24.324 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:24.315+0000 7fdcc8ff9640 1 -- 172.21.15.19:0/1036836687 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdcbc004a90 con 0x558fd370fbd0 2024-09-10T22:35:24.324 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:24.315+0000 7fdcdbe6d740 1 -- 172.21.15.19:0/1036836687 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558fd370fbd0 msgr2=0x558fd3712090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:35:24.324 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:24.315+0000 7fdcd2d9d640 1 --2- 172.21.15.19:0/2657722690 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7fdcc00b52e0 0x7fdcc00b77a0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7fdcd4199b60 tx=0x7fdccc009500 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:35:24.324 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:24.315+0000 7fdcdbe6d740 1 --2- 172.21.15.19:0/1036836687 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558fd370fbd0 0x558fd3712090 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fdcbc009bf0 tx=0x7fdcbc011810 comp rx=0 tx=0).stop 2024-09-10T22:35:24.324 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:24.315+0000 7fdcdbe6d740 1 -- 172.21.15.19:0/1036836687 shutdown_connections 2024-09-10T22:35:24.324 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:24.316+0000 7fdcdbe6d740 1 --2- 172.21.15.19:0/1036836687 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558fd370fbd0 0x558fd3712090 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:35:24.325 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:24.316+0000 7fdcdbe6d740 1 --2- 172.21.15.19:0/1036836687 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x558fd370d190 0x558fd370f580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:35:24.325 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:24.316+0000 7fdcdbe6d740 1 --2- 172.21.15.19:0/1036836687 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x558fd370a860 0x558fd370cc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:35:24.325 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:24.316+0000 7fdcdbe6d740 1 -- 172.21.15.19:0/1036836687 >> 172.21.15.19:0/1036836687 conn(0x558fd37059b0 msgr2=0x558fd3706740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:35:24.325 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:24.316+0000 7fdcdbe6d740 1 -- 172.21.15.19:0/1036836687 shutdown_connections 2024-09-10T22:35:24.325 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:24.316+0000 7fdcdbe6d740 1 -- 172.21.15.19:0/1036836687 wait complete. 2024-09-10T22:35:24.326 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:24.316+0000 7fdcdbe6d740 1 -- start start 2024-09-10T22:35:24.326 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:24.316+0000 7fdcdbe6d740 1 Processor -- start 2024-09-10T22:35:24.326 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:24.317+0000 7fdcdbe6d740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x558fd370a860 0x558fd3713e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:35:24.326 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:24.317+0000 7fdcdbe6d740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x558fd370d190 0x558fd3714500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:35:24.326 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:24.317+0000 7fdcd259c640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x558fd370a860 0x558fd3713e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:35:24.326 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:24.317+0000 7fdcd259c640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x558fd370a860 0x558fd3713e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.19:43598/0 (socket says 172.21.15.19:43598) 2024-09-10T22:35:24.326 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:24.317+0000 7fdccbfff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x558fd370d190 0x558fd3714500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:35:24.326 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:24.317+0000 7fdccbfff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x558fd370d190 0x558fd3714500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:38480/0 (socket says 172.21.15.19:38480) 2024-09-10T22:35:24.326 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:24.317+0000 7fdcd259c640 1 -- 172.21.15.19:0/308846644 learned_addr learned my addr 172.21.15.19:0/308846644 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:35:24.327 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:24.317+0000 7fdcdbe6d740 1 --2- 172.21.15.19:0/308846644 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558fd370fbd0 0x558fd37150d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:35:24.327 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:24.317+0000 7fdcdbe6d740 1 -- 172.21.15.19:0/308846644 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x558fd35a3ab0 con 0x558fd370d190 2024-09-10T22:35:24.327 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:24.317+0000 7fdcdbe6d740 1 -- 172.21.15.19:0/308846644 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x558fd3611730 con 0x558fd370fbd0 2024-09-10T22:35:24.327 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:24.317+0000 7fdcdbe6d740 1 -- 172.21.15.19:0/308846644 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x558fd3712bb0 con 0x558fd370a860 2024-09-10T22:35:24.327 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:24.317+0000 7fdcdbe6d740 10 client.0 _ll_register_callbacks cb 0x558fd36656b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T22:35:24.327 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:24.317+0000 7fdcd2d9d640 1 --2- 172.21.15.19:0/308846644 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558fd370fbd0 0x558fd37150d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:35:24.327 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:24.317+0000 7fdcd259c640 1 -- 172.21.15.19:0/308846644 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558fd370fbd0 msgr2=0x558fd37150d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:35:24.327 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:24.317+0000 7fdcd259c640 1 --2- 172.21.15.19:0/308846644 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558fd370fbd0 0x558fd37150d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:35:24.327 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:24.318+0000 7fdcd259c640 1 -- 172.21.15.19:0/308846644 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x558fd370d190 msgr2=0x558fd3714500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:35:24.327 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:24.318+0000 7fdcd259c640 1 --2- 172.21.15.19:0/308846644 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x558fd370d190 0x558fd3714500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:35:24.327 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:24.318+0000 7fdcd259c640 1 -- 172.21.15.19:0/308846644 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558fd33cd790 con 0x558fd370a860 2024-09-10T22:35:24.327 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:24.318+0000 7fdcd2d9d640 1 --2- 172.21.15.19:0/308846644 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558fd370fbd0 0x558fd37150d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T22:35:24.327 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:24.318+0000 7fdcd259c640 1 --2- 172.21.15.19:0/308846644 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x558fd370a860 0x558fd3713e60 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fdcc4032af0 tx=0x7fdcc4031980 comp rx=0 tx=0).ready entity=mon.1 client_cookie=871db96344785ac server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:35:24.328 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:24.318+0000 7fdcb9ffb640 10 client.0 ms_handle_connect on v2:172.21.15.138:3300/0 2024-09-10T22:35:24.328 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:24.318+0000 7fdcb9ffb640 1 -- 172.21.15.19:0/308846644 <== mon.1 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdcc4049030 con 0x558fd370a860 2024-09-10T22:35:24.328 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:24.318+0000 7fdcb9ffb640 1 -- 172.21.15.19:0/308846644 <== mon.1 v2:172.21.15.138:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8327+0+0 (secure 0 0 0) 0x7fdcc40ccdb0 con 0x558fd370a860 2024-09-10T22:35:24.328 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:24.318+0000 7fdcdbe6d740 1 -- 172.21.15.19:0/308846644 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fdcbc005020 con 0x558fd370a860 2024-09-10T22:35:24.328 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:24.318+0000 7fdcb9ffb640 1 -- 172.21.15.19:0/308846644 <== mon.1 v2:172.21.15.138:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fdcc40c89f0 con 0x558fd370a860 2024-09-10T22:35:24.328 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:24.318+0000 7fdcdbe6d740 10 client.26482 fetch_fsmap learned FSMap version 27 2024-09-10T22:35:24.328 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:24.318+0000 7fdcdbe6d740 1 -- 172.21.15.19:0/308846644 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x558fd3446620 con 0x558fd370a860 2024-09-10T22:35:24.328 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:24.318+0000 7fdcb9ffb640 1 -- 172.21.15.19:0/308846644 <== mon.1 v2:172.21.15.138:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fdcbc005020 con 0x558fd370a860 2024-09-10T22:35:24.328 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:24.319+0000 7fdcb9ffb640 1 -- 172.21.15.19:0/308846644 <== mon.1 v2:172.21.15.138:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7fdcc40d1150 con 0x558fd370a860 2024-09-10T22:35:24.328 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:24.319+0000 7fdcdbe6d740 10 client.26482 fetch_fsmap finished waiting for FSMap version 27 2024-09-10T22:35:24.328 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:24.319+0000 7fdcdbe6d740 10 client.26482 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-10T22:35:24.328 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:24.319+0000 7fdcdbe6d740 20 client.26482 populate_metadata read hostname 'smithi019' 2024-09-10T22:35:24.329 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:24.319+0000 7fdcdbe6d740 1 --2- 172.21.15.19:0/308846644 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x558fd371f700 0x558fd3721bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:35:24.329 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:24.319+0000 7fdcdbe6d740 4 client.26482 mds_command: new command op to 24581 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T22:35:24.329 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:24.319+0000 7fdcdbe6d740 1 -- 172.21.15.19:0/308846644 --> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x558fd367e640 con 0x558fd371f700 2024-09-10T22:35:24.329 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:24.319+0000 7fdccbfff640 1 --2- 172.21.15.19:0/308846644 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x558fd371f700 0x558fd3721bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:35:24.329 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:24.320+0000 7fdccbfff640 1 --2- 172.21.15.19:0/308846644 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x558fd371f700 0x558fd3721bc0 crc :-1 s=READY pgs=180 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3055eb0370196e64 server_cookie=4b5f4b3c0d0cc741 in_seq=0 out_seq=0 2024-09-10T22:35:24.330 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:24.320+0000 7fdcb9ffb640 10 client.26482 ms_handle_connect on v2:172.21.15.135:6838/1254769802 2024-09-10T22:35:24.332 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:24.320+0000 7fdcb9ffb640 1 -- 172.21.15.19:0/308846644 <== mds.0 v2:172.21.15.135:6838/1254769802 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x558fd367e640 con 0x558fd371f700 2024-09-10T22:35:24.332 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:24.320+0000 7fdcb9ffb640 10 client.26482 handle_command_reply: tid=0 2024-09-10T22:35:24.332 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:24.320+0000 7fdcdbe6d740 1 client.26482 shutdown 2024-09-10T22:35:24.332 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:24.321+0000 7fdcdbe6d740 1 -- 172.21.15.19:0/308846644 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x558fd370a860 msgr2=0x558fd3713e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:35:24.332 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:24.321+0000 7fdcdbe6d740 1 --2- 172.21.15.19:0/308846644 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x558fd370a860 0x558fd3713e60 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fdcc4032af0 tx=0x7fdcc4031980 comp rx=0 tx=0).stop 2024-09-10T22:35:24.332 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:24.321+0000 7fdcdbe6d740 1 -- 172.21.15.19:0/308846644 shutdown_connections 2024-09-10T22:35:24.332 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:24.321+0000 7fdcdbe6d740 1 --2- 172.21.15.19:0/308846644 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558fd370fbd0 0x558fd37150d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:35:24.332 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:24.321+0000 7fdcdbe6d740 1 --2- 172.21.15.19:0/308846644 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x558fd370d190 0x558fd3714500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:35:24.332 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:24.321+0000 7fdcdbe6d740 1 --2- 172.21.15.19:0/308846644 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x558fd371f700 0x558fd3721bc0 crc :-1 s=READY pgs=180 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:35:24.332 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:24.321+0000 7fdcdbe6d740 1 --2- 172.21.15.19:0/308846644 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x558fd370a860 0x558fd3713e60 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:35:24.332 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:24.321+0000 7fdcb9ffb640 0 client.26482 ms_handle_reset on v2:172.21.15.135:6838/1254769802 2024-09-10T22:35:24.333 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:24.321+0000 7fdcdbe6d740 1 -- 172.21.15.19:0/308846644 >> 172.21.15.19:0/308846644 conn(0x558fd37059b0 msgr2=0x558fd3704bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:35:24.333 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:24.322+0000 7fdcdbe6d740 1 -- 172.21.15.19:0/308846644 shutdown_connections 2024-09-10T22:35:24.333 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:24.322+0000 7fdcdbe6d740 1 -- 172.21.15.19:0/308846644 wait complete. 2024-09-10T22:35:24.333 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:24.322+0000 7fdcdbe6d740 20 client.26482 trim_cache size 0 max 16384 2024-09-10T22:35:24.340 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:24.337+0000 7fdcdbe6d740 1 Processor -- start 2024-09-10T22:35:24.340 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:24.337+0000 7fdcdbe6d740 1 -- start start 2024-09-10T22:35:24.340 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:24.337+0000 7fdcdbe6d740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558fd370a860 0x558fd3706450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:35:24.340 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:24.337+0000 7fdcdbe6d740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x558fd370d190 0x558fd3706990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:35:24.340 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:24.337+0000 7fdcdbe6d740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x558fd370fbd0 0x558fd370ffb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:35:24.340 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:24.337+0000 7fdcdbe6d740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fdcd41ac9b0 con 0x558fd370fbd0 2024-09-10T22:35:24.340 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:24.337+0000 7fdcdbe6d740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fdcd41aa280 con 0x558fd370a860 2024-09-10T22:35:24.341 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:24.337+0000 7fdcdbe6d740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7fdcd41a80d0 con 0x558fd370d190 2024-09-10T22:35:24.341 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:24.337+0000 7fdcd259c640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558fd370a860 0x558fd3706450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:35:24.341 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:24.337+0000 7fdccbfff640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x558fd370d190 0x558fd3706990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:35:24.341 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:24.337+0000 7fdcd259c640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558fd370a860 0x558fd3706450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.19:59978/0 (socket says 172.21.15.19:59978) 2024-09-10T22:35:24.342 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:24.337+0000 7fdcd259c640 1 -- 172.21.15.19:0/2942053072 learned_addr learned my addr 172.21.15.19:0/2942053072 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:35:24.342 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:24.337+0000 7fdccbfff640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x558fd370d190 0x558fd3706990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.19:43610/0 (socket says 172.21.15.19:43610) 2024-09-10T22:35:24.342 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:24.337+0000 7fdcd2d9d640 1 --2- 172.21.15.19:0/2942053072 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x558fd370fbd0 0x558fd370ffb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:35:24.342 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:24.338+0000 7fdccbfff640 1 -- 172.21.15.19:0/2942053072 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558fd370a860 msgr2=0x558fd3706450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:35:24.342 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:24.338+0000 7fdccbfff640 1 --2- 172.21.15.19:0/2942053072 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558fd370a860 0x558fd3706450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:35:24.342 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:24.338+0000 7fdccbfff640 1 -- 172.21.15.19:0/2942053072 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x558fd370fbd0 msgr2=0x558fd370ffb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:35:24.342 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:24.338+0000 7fdccbfff640 1 --2- 172.21.15.19:0/2942053072 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x558fd370fbd0 0x558fd370ffb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:35:24.342 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:24.338+0000 7fdccbfff640 1 -- 172.21.15.19:0/2942053072 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558fd3715440 con 0x558fd370d190 2024-09-10T22:35:24.342 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:24.338+0000 7fdcd259c640 1 --2- 172.21.15.19:0/2942053072 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558fd370a860 0x558fd3706450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T22:35:24.342 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:24.338+0000 7fdccbfff640 1 --2- 172.21.15.19:0/2942053072 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x558fd370d190 0x558fd3706990 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fdcbc009700 tx=0x7fdcbc005f90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=47e54dae9f0a1049 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:35:24.342 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:24.338+0000 7fdcbbfff640 1 -- 172.21.15.19:0/2942053072 <== mon.1 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdcbc030020 con 0x558fd370d190 2024-09-10T22:35:24.342 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:24.338+0000 7fdcbbfff640 1 -- 172.21.15.19:0/2942053072 <== mon.1 v2:172.21.15.138:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fdcbc005440 con 0x558fd370d190 2024-09-10T22:35:24.343 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:24.338+0000 7fdcbbfff640 1 -- 172.21.15.19:0/2942053072 <== mon.1 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdcbc005010 con 0x558fd370d190 2024-09-10T22:35:24.347 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:24.339+0000 7fdcdbe6d740 1 -- 172.21.15.19:0/2942053072 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x558fd370d190 msgr2=0x558fd3706990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:35:24.347 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:24.339+0000 7fdcdbe6d740 1 --2- 172.21.15.19:0/2942053072 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x558fd370d190 0x558fd3706990 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fdcbc009700 tx=0x7fdcbc005f90 comp rx=0 tx=0).stop 2024-09-10T22:35:24.347 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:24.339+0000 7fdcdbe6d740 1 -- 172.21.15.19:0/2942053072 shutdown_connections 2024-09-10T22:35:24.348 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:24.339+0000 7fdcdbe6d740 1 --2- 172.21.15.19:0/2942053072 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x558fd370fbd0 0x558fd370ffb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:35:24.348 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:24.339+0000 7fdcdbe6d740 1 --2- 172.21.15.19:0/2942053072 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x558fd370d190 0x558fd3706990 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:35:24.348 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:24.339+0000 7fdcdbe6d740 1 --2- 172.21.15.19:0/2942053072 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558fd370a860 0x558fd3706450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:35:24.348 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:24.339+0000 7fdcdbe6d740 1 -- 172.21.15.19:0/2942053072 >> 172.21.15.19:0/2942053072 conn(0x558fd37059b0 msgr2=0x558fd3712f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:35:24.348 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:24.339+0000 7fdcdbe6d740 1 -- 172.21.15.19:0/2942053072 shutdown_connections 2024-09-10T22:35:24.348 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:24.339+0000 7fdcdbe6d740 1 -- 172.21.15.19:0/2942053072 wait complete. 2024-09-10T22:35:24.348 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:24.339+0000 7fdcdbe6d740 1 -- start start 2024-09-10T22:35:24.348 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:24.339+0000 7fdcdbe6d740 1 Processor -- start 2024-09-10T22:35:24.348 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:24.340+0000 7fdcdbe6d740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558fd370a860 0x558fd3718dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:35:24.348 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:24.340+0000 7fdcdbe6d740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x558fd370d190 0x558fd3719470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:35:24.348 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:24.340+0000 7fdcdbe6d740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x558fd370fbd0 0x558fd371a040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:35:24.348 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:24.340+0000 7fdcdbe6d740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fdcd41a8740 con 0x558fd370fbd0 2024-09-10T22:35:24.348 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:24.340+0000 7fdcdbe6d740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fdcd41a9bb0 con 0x558fd370a860 2024-09-10T22:35:24.349 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:24.340+0000 7fdcdbe6d740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7fdcd41a8e10 con 0x558fd370d190 2024-09-10T22:35:24.349 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:24.340+0000 7fdcdbe6d740 10 client.0 _ll_register_callbacks cb 0x7fdcc4005b70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T22:35:24.349 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:24.340+0000 7fdccbfff640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x558fd370d190 0x558fd3719470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:35:24.349 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:24.340+0000 7fdcd2d9d640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x558fd370fbd0 0x558fd371a040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:35:24.349 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:24.340+0000 7fdccbfff640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x558fd370d190 0x558fd3719470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.19:43624/0 (socket says 172.21.15.19:43624) 2024-09-10T22:35:24.349 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:24.340+0000 7fdccbfff640 1 -- 172.21.15.19:0/2319312200 learned_addr learned my addr 172.21.15.19:0/2319312200 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:35:24.350 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:24.340+0000 7fdcd259c640 1 --2- 172.21.15.19:0/2319312200 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558fd370a860 0x558fd3718dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:35:24.350 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:24.340+0000 7fdccbfff640 1 -- 172.21.15.19:0/2319312200 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558fd370a860 msgr2=0x558fd3718dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:35:24.350 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:24.340+0000 7fdccbfff640 1 --2- 172.21.15.19:0/2319312200 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558fd370a860 0x558fd3718dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:35:24.350 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:24.340+0000 7fdccbfff640 1 -- 172.21.15.19:0/2319312200 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x558fd370fbd0 msgr2=0x558fd371a040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:35:24.350 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:24.340+0000 7fdccbfff640 1 --2- 172.21.15.19:0/2319312200 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x558fd370fbd0 0x558fd371a040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:35:24.350 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:24.340+0000 7fdccbfff640 1 -- 172.21.15.19:0/2319312200 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558fd371a870 con 0x558fd370d190 2024-09-10T22:35:24.350 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:24.341+0000 7fdccbfff640 1 --2- 172.21.15.19:0/2319312200 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x558fd370d190 0x558fd3719470 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fdcbc000c00 tx=0x7fdcbc0055f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5f2e01820e139f74 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:35:24.350 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:24.341+0000 7fdcb9ffb640 10 client.0 ms_handle_connect on v2:172.21.15.138:3300/0 2024-09-10T22:35:24.350 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:24.341+0000 7fdcb9ffb640 1 -- 172.21.15.19:0/2319312200 <== mon.1 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdcbc03b070 con 0x558fd370d190 2024-09-10T22:35:24.350 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:24.341+0000 7fdcb9ffb640 1 -- 172.21.15.19:0/2319312200 <== mon.1 v2:172.21.15.138:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8327+0+0 (secure 0 0 0) 0x7fdcbc004f60 con 0x558fd370d190 2024-09-10T22:35:24.350 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:24.341+0000 7fdcdbe6d740 1 -- 172.21.15.19:0/2319312200 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fdcbc005440 con 0x558fd370d190 2024-09-10T22:35:24.351 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:24.341+0000 7fdcb9ffb640 1 -- 172.21.15.19:0/2319312200 <== mon.1 v2:172.21.15.138:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fdcbc047050 con 0x558fd370d190 2024-09-10T22:35:24.351 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:24.341+0000 7fdcdbe6d740 10 client.26488 fetch_fsmap learned FSMap version 27 2024-09-10T22:35:24.351 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:24.341+0000 7fdcdbe6d740 1 -- 172.21.15.19:0/2319312200 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x558fd371bbe0 con 0x558fd370d190 2024-09-10T22:35:24.351 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:24.341+0000 7fdcb9ffb640 1 -- 172.21.15.19:0/2319312200 <== mon.1 v2:172.21.15.138:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fdcbc005440 con 0x558fd370d190 2024-09-10T22:35:24.351 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:24.342+0000 7fdcb9ffb640 1 -- 172.21.15.19:0/2319312200 <== mon.1 v2:172.21.15.138:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7fdcbc035720 con 0x558fd370d190 2024-09-10T22:35:24.351 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:24.342+0000 7fdcdbe6d740 10 client.26488 fetch_fsmap finished waiting for FSMap version 27 2024-09-10T22:35:24.351 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:24.342+0000 7fdcdbe6d740 10 client.26488 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-10T22:35:24.351 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:24.342+0000 7fdcdbe6d740 20 client.26488 populate_metadata read hostname 'smithi019' 2024-09-10T22:35:24.351 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:24.342+0000 7fdcdbe6d740 1 --2- 172.21.15.19:0/2319312200 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x558fd3790c60 0x558fd3793050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:35:24.351 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:24.342+0000 7fdcdbe6d740 4 client.26488 mds_command: new command op to 24581 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-10T22:35:24.351 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:24.342+0000 7fdcdbe6d740 1 -- 172.21.15.19:0/2319312200 --> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] -- command(tid 0: {"prefix": "flush journal"}) -- 0x558fd367a0f0 con 0x558fd3790c60 2024-09-10T22:35:24.351 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:24.342+0000 7fdcd259c640 1 --2- 172.21.15.19:0/2319312200 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x558fd3790c60 0x558fd3793050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:35:24.352 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:24.342+0000 7fdcd259c640 1 --2- 172.21.15.19:0/2319312200 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x558fd3790c60 0x558fd3793050 crc :-1 s=READY pgs=181 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fd659911bcb64b43 server_cookie=ac9a0ffd3ab9d45e in_seq=0 out_seq=0 2024-09-10T22:35:24.352 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:24.342+0000 7fdcb9ffb640 10 client.26488 ms_handle_connect on v2:172.21.15.135:6838/1254769802 2024-09-10T22:35:24.360 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:35:23 smithi135 ceph-mon[34789]: pgmap v616: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 531 KiB/s rd, 222 MiB/s wr, 897 op/s 2024-09-10T22:35:24.376 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:35:23 smithi138 ceph-mon[35236]: pgmap v616: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 531 KiB/s rd, 222 MiB/s wr, 897 op/s 2024-09-10T22:35:26.360 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:35:26 smithi135 ceph-mon[34789]: pgmap v617: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 514 KiB/s rd, 224 MiB/s wr, 997 op/s 2024-09-10T22:35:26.375 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:35:25 smithi138 ceph-mon[35236]: pgmap v617: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 514 KiB/s rd, 224 MiB/s wr, 997 op/s 2024-09-10T22:35:26.459 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:35:25 smithi019 ceph-mon[31375]: pgmap v617: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 514 KiB/s rd, 224 MiB/s wr, 997 op/s 2024-09-10T22:35:27.065 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 22997a4c-6fc2-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-10T22:35:27.350 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/22997a4c-6fc2-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T22:35:28.077 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:35:28 smithi019 ceph-mon[31375]: pgmap v618: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 439 KiB/s rd, 249 MiB/s wr, 1.26k op/s 2024-09-10T22:35:28.128 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:28.075+0000 7f14620f5640 1 -- 172.21.15.19:0/765347076 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f145c108020 msgr2=0x7f145c10e820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:35:28.128 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:28.075+0000 7f14620f5640 1 --2- 172.21.15.19:0/765347076 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f145c108020 0x7f145c10e820 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7f1454009900 tx=0x7f145402a410 comp rx=0 tx=0).stop 2024-09-10T22:35:28.128 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:28.075+0000 7f14620f5640 1 -- 172.21.15.19:0/765347076 shutdown_connections 2024-09-10T22:35:28.128 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:28.075+0000 7f14620f5640 1 --2- 172.21.15.19:0/765347076 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f145c108020 0x7f145c10e820 unknown :-1 s=CLOSED pgs=767 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:35:28.128 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:28.075+0000 7f14620f5640 1 --2- 172.21.15.19:0/765347076 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f145c1076a0 0x7f145c107ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:35:28.128 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:28.075+0000 7f14620f5640 1 --2- 172.21.15.19:0/765347076 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f145c101c90 0x7f145c102070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:35:28.128 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:28.075+0000 7f14620f5640 1 -- 172.21.15.19:0/765347076 >> 172.21.15.19:0/765347076 conn(0x7f145c0fd6c0 msgr2=0x7f145c0ffae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:35:28.129 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:28.075+0000 7f14620f5640 1 -- 172.21.15.19:0/765347076 shutdown_connections 2024-09-10T22:35:28.129 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:28.075+0000 7f14620f5640 1 -- 172.21.15.19:0/765347076 wait complete. 2024-09-10T22:35:28.129 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:28.076+0000 7f14620f5640 1 Processor -- start 2024-09-10T22:35:28.129 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:28.076+0000 7f14620f5640 1 -- start start 2024-09-10T22:35:28.129 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:28.076+0000 7f14620f5640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f145c101c90 0x7f145c1980f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:35:28.129 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:28.076+0000 7f14620f5640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f145c1076a0 0x7f145c198630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:35:28.129 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:28.076+0000 7f14620f5640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f145c108020 0x7f145c19d9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:35:28.129 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:28.076+0000 7f14620f5640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f145c111ca0 con 0x7f145c108020 2024-09-10T22:35:28.129 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:28.076+0000 7f14620f5640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f145c111b20 con 0x7f145c101c90 2024-09-10T22:35:28.129 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:28.076+0000 7f14620f5640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f145c111e20 con 0x7f145c1076a0 2024-09-10T22:35:28.129 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:28.076+0000 7f145b7fe640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f145c101c90 0x7f145c1980f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:35:28.129 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:28.076+0000 7f145bfff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f145c108020 0x7f145c19d9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:35:28.130 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:28.076+0000 7f145b7fe640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f145c101c90 0x7f145c1980f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.19:59992/0 (socket says 172.21.15.19:59992) 2024-09-10T22:35:28.130 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:28.076+0000 7f145b7fe640 1 -- 172.21.15.19:0/2472953445 learned_addr learned my addr 172.21.15.19:0/2472953445 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:35:28.130 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:28.076+0000 7f145affd640 1 --2- 172.21.15.19:0/2472953445 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f145c1076a0 0x7f145c198630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:35:28.130 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:28.077+0000 7f145b7fe640 1 -- 172.21.15.19:0/2472953445 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f145c1076a0 msgr2=0x7f145c198630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:35:28.130 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:28.077+0000 7f145b7fe640 1 --2- 172.21.15.19:0/2472953445 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f145c1076a0 0x7f145c198630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:35:28.130 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:28.077+0000 7f145b7fe640 1 -- 172.21.15.19:0/2472953445 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f145c108020 msgr2=0x7f145c19d9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:35:28.130 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:28.077+0000 7f145b7fe640 1 --2- 172.21.15.19:0/2472953445 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f145c108020 0x7f145c19d9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:35:28.130 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:28.077+0000 7f145b7fe640 1 -- 172.21.15.19:0/2472953445 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f145c19e1a0 con 0x7f145c101c90 2024-09-10T22:35:28.130 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:28.077+0000 7f145affd640 1 --2- 172.21.15.19:0/2472953445 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f145c1076a0 0x7f145c198630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T22:35:28.130 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:28.077+0000 7f145b7fe640 1 --2- 172.21.15.19:0/2472953445 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f145c101c90 0x7f145c1980f0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f144c00ebc0 tx=0x7f144c00c6a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:35:28.130 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:28.077+0000 7f1458ff9640 1 -- 172.21.15.19:0/2472953445 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f144c010630 con 0x7f145c101c90 2024-09-10T22:35:28.130 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:28.077+0000 7f14620f5640 1 -- 172.21.15.19:0/2472953445 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f145c19e490 con 0x7f145c101c90 2024-09-10T22:35:28.130 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:28.077+0000 7f1458ff9640 1 -- 172.21.15.19:0/2472953445 <== mon.2 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f144c010c80 con 0x7f145c101c90 2024-09-10T22:35:28.131 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:28.077+0000 7f1458ff9640 1 -- 172.21.15.19:0/2472953445 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f144c018b60 con 0x7f145c101c90 2024-09-10T22:35:28.131 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:28.077+0000 7f14620f5640 1 -- 172.21.15.19:0/2472953445 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f145c06b6a0 con 0x7f145c101c90 2024-09-10T22:35:28.131 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:28.080+0000 7f1458ff9640 1 -- 172.21.15.19:0/2472953445 <== mon.2 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 18) ==== 153250+0+0 (secure 0 0 0) 0x7f144c0107d0 con 0x7f145c101c90 2024-09-10T22:35:28.131 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:28.080+0000 7f14644ca740 1 Processor -- start 2024-09-10T22:35:28.131 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:28.080+0000 7f14644ca740 1 -- start start 2024-09-10T22:35:28.131 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:28.081+0000 7f14644ca740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x563b1f6d0480 0x563b1f6d0860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:35:28.131 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:28.081+0000 7f14644ca740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x563b1f6d0da0 0x563b1f6dc7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:35:28.131 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:28.081+0000 7f14644ca740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563b1f6dcd30 0x563b1f6df120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:35:28.131 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:28.081+0000 7f14644ca740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x563b1f646e50 con 0x563b1f6d0480 2024-09-10T22:35:28.132 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:28.081+0000 7f14644ca740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x563b1f636280 con 0x563b1f6dcd30 2024-09-10T22:35:28.132 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:28.081+0000 7f14644ca740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x563b1f63a090 con 0x563b1f6d0da0 2024-09-10T22:35:28.132 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:28.081+0000 7f1458ff9640 1 --2- 172.21.15.19:0/2472953445 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f14480b52e0 0x7f14480b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:35:28.132 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:28.081+0000 7f145bfff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x563b1f6d0480 0x563b1f6d0860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:35:28.132 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:28.081+0000 7f145b7fe640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x563b1f6d0da0 0x563b1f6dc7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:35:28.132 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:28.081+0000 7f145affd640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563b1f6dcd30 0x563b1f6df120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:35:28.132 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:28.081+0000 7f145b7fe640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x563b1f6d0da0 0x563b1f6dc7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.19:43640/0 (socket says 172.21.15.19:43640) 2024-09-10T22:35:28.132 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:28.081+0000 7f145b7fe640 1 -- 172.21.15.19:0/127772304 learned_addr learned my addr 172.21.15.19:0/127772304 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:35:28.132 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:28.081+0000 7f145bfff640 1 --2- 172.21.15.19:0/2472953445 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f14480b52e0 0x7f14480b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:35:28.132 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:28.081+0000 7f145affd640 1 -- 172.21.15.19:0/127772304 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x563b1f6d0da0 msgr2=0x563b1f6dc7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:35:28.132 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:28.081+0000 7f145affd640 1 --2- 172.21.15.19:0/127772304 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x563b1f6d0da0 0x563b1f6dc7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:35:28.132 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:28.081+0000 7f145affd640 1 -- 172.21.15.19:0/127772304 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x563b1f6d0480 msgr2=0x563b1f6d0860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:35:28.132 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:28.081+0000 7f145affd640 1 --2- 172.21.15.19:0/127772304 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x563b1f6d0480 0x563b1f6d0860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:35:28.132 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:28.081+0000 7f145affd640 1 -- 172.21.15.19:0/127772304 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563b1f394650 con 0x563b1f6dcd30 2024-09-10T22:35:28.133 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:28.081+0000 7f1458ff9640 1 -- 172.21.15.19:0/2472953445 <== mon.2 v2:172.21.15.135:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8327+0+0 (secure 0 0 0) 0x7f144c0e6240 con 0x7f145c101c90 2024-09-10T22:35:28.133 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:28.081+0000 7f145b7fe640 1 --2- 172.21.15.19:0/127772304 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x563b1f6d0da0 0x563b1f6dc7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T22:35:28.133 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:28.082+0000 7f145affd640 1 --2- 172.21.15.19:0/127772304 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563b1f6dcd30 0x563b1f6df120 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f1444009fa0 tx=0x7f14440118d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4ee93c3a293e6e4e server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:35:28.133 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:28.082+0000 7f145bfff640 1 --2- 172.21.15.19:0/2472953445 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f14480b52e0 0x7f14480b77a0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f1454006010 tx=0x7f14540058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:35:28.133 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:28.082+0000 7f1451ffb640 1 -- 172.21.15.19:0/127772304 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1444004310 con 0x563b1f6dcd30 2024-09-10T22:35:28.133 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:28.082+0000 7f1451ffb640 1 -- 172.21.15.19:0/127772304 <== mon.2 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f14440044b0 con 0x563b1f6dcd30 2024-09-10T22:35:28.133 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:28.082+0000 7f1451ffb640 1 -- 172.21.15.19:0/127772304 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14440035f0 con 0x563b1f6dcd30 2024-09-10T22:35:28.133 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:28.082+0000 7f14644ca740 1 -- 172.21.15.19:0/127772304 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563b1f6dcd30 msgr2=0x563b1f6df120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:35:28.133 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:28.082+0000 7f14644ca740 1 --2- 172.21.15.19:0/127772304 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563b1f6dcd30 0x563b1f6df120 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f1444009fa0 tx=0x7f14440118d0 comp rx=0 tx=0).stop 2024-09-10T22:35:28.133 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:28.082+0000 7f14644ca740 1 -- 172.21.15.19:0/127772304 shutdown_connections 2024-09-10T22:35:28.133 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:28.082+0000 7f14644ca740 1 --2- 172.21.15.19:0/127772304 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563b1f6dcd30 0x563b1f6df120 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:35:28.134 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:28.082+0000 7f14644ca740 1 --2- 172.21.15.19:0/127772304 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x563b1f6d0da0 0x563b1f6dc7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:35:28.134 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:28.082+0000 7f14644ca740 1 --2- 172.21.15.19:0/127772304 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x563b1f6d0480 0x563b1f6d0860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:35:28.134 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:28.083+0000 7f14644ca740 1 -- 172.21.15.19:0/127772304 >> 172.21.15.19:0/127772304 conn(0x563b1f6ce2b0 msgr2=0x563b1f6cf450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:35:28.134 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:28.083+0000 7f14644ca740 1 -- 172.21.15.19:0/127772304 shutdown_connections 2024-09-10T22:35:28.134 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:28.083+0000 7f14644ca740 1 -- 172.21.15.19:0/127772304 wait complete. 2024-09-10T22:35:28.134 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:28.083+0000 7f14644ca740 1 -- start start 2024-09-10T22:35:28.134 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:28.083+0000 7f14644ca740 1 Processor -- start 2024-09-10T22:35:28.134 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:28.083+0000 7f14644ca740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x563b1f6d0480 0x563b1f6dc640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:35:28.134 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:28.083+0000 7f14644ca740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563b1f6d0da0 0x563b1f6d9a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:35:28.134 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:28.083+0000 7f14644ca740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x563b1f6dcd30 0x563b1f6da0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:35:28.134 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:28.083+0000 7f14644ca740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x563b1f497700 con 0x563b1f6dcd30 2024-09-10T22:35:28.135 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:28.083+0000 7f14644ca740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x563b1f5d1110 con 0x563b1f6d0da0 2024-09-10T22:35:28.135 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:28.083+0000 7f14644ca740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x563b1f6df9b0 con 0x563b1f6d0480 2024-09-10T22:35:28.135 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:28.083+0000 7f14644ca740 10 client.0 _ll_register_callbacks cb 0x563b1f5ea990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T22:35:28.135 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:28.084+0000 7f145bfff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x563b1f6dcd30 0x563b1f6da0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:35:28.135 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:28.084+0000 7f145affd640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563b1f6d0da0 0x563b1f6d9a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:35:28.135 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:28.084+0000 7f145bfff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x563b1f6dcd30 0x563b1f6da0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:38524/0 (socket says 172.21.15.19:38524) 2024-09-10T22:35:28.135 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:28.084+0000 7f145affd640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563b1f6d0da0 0x563b1f6d9a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.19:60020/0 (socket says 172.21.15.19:60020) 2024-09-10T22:35:28.135 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:28.084+0000 7f145bfff640 1 -- 172.21.15.19:0/758163138 learned_addr learned my addr 172.21.15.19:0/758163138 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:35:28.136 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:28.084+0000 7f145b7fe640 1 --2- 172.21.15.19:0/758163138 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x563b1f6d0480 0x563b1f6dc640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:35:28.136 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:28.084+0000 7f145bfff640 1 -- 172.21.15.19:0/758163138 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x563b1f6d0480 msgr2=0x563b1f6dc640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:35:28.136 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:28.084+0000 7f145bfff640 1 --2- 172.21.15.19:0/758163138 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x563b1f6d0480 0x563b1f6dc640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:35:28.136 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:28.084+0000 7f145bfff640 1 -- 172.21.15.19:0/758163138 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563b1f6d0da0 msgr2=0x563b1f6d9a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:35:28.136 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:28.084+0000 7f145bfff640 1 --2- 172.21.15.19:0/758163138 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563b1f6d0da0 0x563b1f6d9a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:35:28.136 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:28.084+0000 7f145bfff640 1 -- 172.21.15.19:0/758163138 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563b1f5fec40 con 0x563b1f6dcd30 2024-09-10T22:35:28.136 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:28.084+0000 7f145affd640 1 --2- 172.21.15.19:0/758163138 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563b1f6d0da0 0x563b1f6d9a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T22:35:28.136 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:28.084+0000 7f145bfff640 1 --2- 172.21.15.19:0/758163138 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x563b1f6dcd30 0x563b1f6da0c0 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7f1454009900 tx=0x7f1454009260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d792f8e305db883b server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:35:28.136 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:28.084+0000 7f143affd640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-10T22:35:28.136 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:28.084+0000 7f143affd640 1 -- 172.21.15.19:0/758163138 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f145404e070 con 0x563b1f6dcd30 2024-09-10T22:35:28.136 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:28.084+0000 7f143affd640 1 -- 172.21.15.19:0/758163138 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8327+0+0 (secure 0 0 0) 0x7f1454004260 con 0x563b1f6dcd30 2024-09-10T22:35:28.136 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:28.084+0000 7f14644ca740 1 -- 172.21.15.19:0/758163138 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f14440044b0 con 0x563b1f6dcd30 2024-09-10T22:35:28.137 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:28.085+0000 7f143affd640 1 -- 172.21.15.19:0/758163138 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f1454035040 con 0x563b1f6dcd30 2024-09-10T22:35:28.137 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:28.085+0000 7f14644ca740 10 client.17133 fetch_fsmap learned FSMap version 27 2024-09-10T22:35:28.137 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:28.085+0000 7f14644ca740 1 -- 172.21.15.19:0/758163138 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x563b1f6eb310 con 0x563b1f6dcd30 2024-09-10T22:35:28.137 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:28.085+0000 7f143affd640 1 -- 172.21.15.19:0/758163138 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f14440044b0 con 0x563b1f6dcd30 2024-09-10T22:35:28.137 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:28.085+0000 7f143affd640 1 -- 172.21.15.19:0/758163138 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7f145405a020 con 0x563b1f6dcd30 2024-09-10T22:35:28.137 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:28.085+0000 7f14644ca740 10 client.17133 fetch_fsmap finished waiting for FSMap version 27 2024-09-10T22:35:28.137 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:28.085+0000 7f14644ca740 10 client.17133 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-10T22:35:28.137 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:28.085+0000 7f14644ca740 20 client.17133 populate_metadata read hostname 'smithi019' 2024-09-10T22:35:28.137 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:28.085+0000 7f14644ca740 1 --2- 172.21.15.19:0/758163138 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x563b1f6ec7e0 0x563b1f6eec30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:35:28.137 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:28.085+0000 7f14644ca740 4 client.17133 mds_command: new command op to 24581 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T22:35:28.137 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:28.085+0000 7f14644ca740 1 -- 172.21.15.19:0/758163138 --> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x563b1f648da0 con 0x563b1f6ec7e0 2024-09-10T22:35:28.137 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:28.085+0000 7f145b7fe640 1 --2- 172.21.15.19:0/758163138 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x563b1f6ec7e0 0x563b1f6eec30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:35:28.137 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:28.086+0000 7f143affd640 10 client.17133 ms_handle_connect on v2:172.21.15.135:6838/1254769802 2024-09-10T22:35:28.137 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:28.086+0000 7f145b7fe640 1 --2- 172.21.15.19:0/758163138 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x563b1f6ec7e0 0x563b1f6eec30 crc :-1 s=READY pgs=182 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7d644c459207a71a server_cookie=db79d6e2ca31b83c in_seq=0 out_seq=0 2024-09-10T22:35:28.138 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:28.087+0000 7f143affd640 1 -- 172.21.15.19:0/758163138 <== mds.0 v2:172.21.15.135:6838/1254769802 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x563b1f648da0 con 0x563b1f6ec7e0 2024-09-10T22:35:28.138 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:28.087+0000 7f143affd640 10 client.17133 handle_command_reply: tid=0 2024-09-10T22:35:28.138 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:28.087+0000 7f14644ca740 1 client.17133 shutdown 2024-09-10T22:35:28.138 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:28.087+0000 7f14644ca740 1 -- 172.21.15.19:0/758163138 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x563b1f6dcd30 msgr2=0x563b1f6da0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:35:28.138 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:28.087+0000 7f14644ca740 1 --2- 172.21.15.19:0/758163138 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x563b1f6dcd30 0x563b1f6da0c0 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7f1454009900 tx=0x7f1454009260 comp rx=0 tx=0).stop 2024-09-10T22:35:28.138 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:28.087+0000 7f14644ca740 1 -- 172.21.15.19:0/758163138 shutdown_connections 2024-09-10T22:35:28.138 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:28.087+0000 7f14644ca740 1 --2- 172.21.15.19:0/758163138 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x563b1f6dcd30 0x563b1f6da0c0 unknown :-1 s=CLOSED pgs=768 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:35:28.138 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:28.087+0000 7f14644ca740 1 --2- 172.21.15.19:0/758163138 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563b1f6d0da0 0x563b1f6d9a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:35:28.138 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:28.087+0000 7f14644ca740 1 --2- 172.21.15.19:0/758163138 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x563b1f6ec7e0 0x563b1f6eec30 crc :-1 s=READY pgs=182 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:35:28.138 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:28.087+0000 7f143affd640 0 client.17133 ms_handle_reset on v2:172.21.15.135:6838/1254769802 2024-09-10T22:35:28.138 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:28.087+0000 7f14644ca740 1 --2- 172.21.15.19:0/758163138 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x563b1f6d0480 0x563b1f6dc640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:35:28.139 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:28.087+0000 7f14644ca740 1 -- 172.21.15.19:0/758163138 >> 172.21.15.19:0/758163138 conn(0x563b1f6ce2b0 msgr2=0x563b1f6d3e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:35:28.139 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:28.087+0000 7f14644ca740 1 -- 172.21.15.19:0/758163138 shutdown_connections 2024-09-10T22:35:28.139 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:28.087+0000 7f14644ca740 1 -- 172.21.15.19:0/758163138 wait complete. 2024-09-10T22:35:28.139 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:28.087+0000 7f14644ca740 20 client.17133 trim_cache size 0 max 16384 2024-09-10T22:35:28.139 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:28.107+0000 7f14644ca740 1 Processor -- start 2024-09-10T22:35:28.139 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:28.108+0000 7f14644ca740 1 -- start start 2024-09-10T22:35:28.139 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:28.108+0000 7f14644ca740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x563b1f6d0480 0x563b1f6e8be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:35:28.139 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:28.108+0000 7f14644ca740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x563b1f6d0da0 0x563b1f6de120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:35:28.139 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:28.108+0000 7f14644ca740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563b1f6dcd30 0x563b1f6de660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:35:28.139 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:28.108+0000 7f14644ca740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f145c1aebc0 con 0x563b1f6d0480 2024-09-10T22:35:28.139 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:28.108+0000 7f14644ca740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f145c1ac490 con 0x563b1f6dcd30 2024-09-10T22:35:28.139 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:28.108+0000 7f14644ca740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f145c1aa2e0 con 0x563b1f6d0da0 2024-09-10T22:35:28.140 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:28.108+0000 7f145b7fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x563b1f6d0480 0x563b1f6e8be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:35:28.140 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:28.108+0000 7f145affd640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x563b1f6d0da0 0x563b1f6de120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:35:28.140 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:28.108+0000 7f145bfff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563b1f6dcd30 0x563b1f6de660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:35:28.140 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:28.108+0000 7f145b7fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x563b1f6d0480 0x563b1f6e8be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:38536/0 (socket says 172.21.15.19:38536) 2024-09-10T22:35:28.140 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:28.108+0000 7f145b7fe640 1 -- 172.21.15.19:0/3551243887 learned_addr learned my addr 172.21.15.19:0/3551243887 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:35:28.140 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:28.108+0000 7f145bfff640 1 -- 172.21.15.19:0/3551243887 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x563b1f6d0da0 msgr2=0x563b1f6de120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:35:28.140 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:28.108+0000 7f145bfff640 1 --2- 172.21.15.19:0/3551243887 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x563b1f6d0da0 0x563b1f6de120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:35:28.140 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:28.108+0000 7f145bfff640 1 -- 172.21.15.19:0/3551243887 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x563b1f6d0480 msgr2=0x563b1f6e8be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:35:28.140 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:28.108+0000 7f145bfff640 1 --2- 172.21.15.19:0/3551243887 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x563b1f6d0480 0x563b1f6e8be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:35:28.140 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:28.108+0000 7f145bfff640 1 -- 172.21.15.19:0/3551243887 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563b1f6d9840 con 0x563b1f6dcd30 2024-09-10T22:35:28.140 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:28.108+0000 7f145bfff640 1 --2- 172.21.15.19:0/3551243887 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563b1f6dcd30 0x563b1f6de660 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f1454009230 tx=0x7f1454032f00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=38739b30f9d5ac5e server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:35:28.140 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:28.109+0000 7f14517fa640 1 -- 172.21.15.19:0/3551243887 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f145404e040 con 0x563b1f6dcd30 2024-09-10T22:35:28.140 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:28.109+0000 7f14517fa640 1 -- 172.21.15.19:0/3551243887 <== mon.2 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f14540318f0 con 0x563b1f6dcd30 2024-09-10T22:35:28.141 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:28.109+0000 7f14517fa640 1 -- 172.21.15.19:0/3551243887 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14540044c0 con 0x563b1f6dcd30 2024-09-10T22:35:28.141 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:28.109+0000 7f14644ca740 1 -- 172.21.15.19:0/3551243887 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563b1f6dcd30 msgr2=0x563b1f6de660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:35:28.141 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:28.109+0000 7f14644ca740 1 --2- 172.21.15.19:0/3551243887 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563b1f6dcd30 0x563b1f6de660 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f1454009230 tx=0x7f1454032f00 comp rx=0 tx=0).stop 2024-09-10T22:35:28.141 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:28.109+0000 7f14644ca740 1 -- 172.21.15.19:0/3551243887 shutdown_connections 2024-09-10T22:35:28.141 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:28.109+0000 7f14644ca740 1 --2- 172.21.15.19:0/3551243887 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563b1f6dcd30 0x563b1f6de660 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:35:28.141 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:28.109+0000 7f14644ca740 1 --2- 172.21.15.19:0/3551243887 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x563b1f6d0da0 0x563b1f6de120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:35:28.141 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:28.109+0000 7f14644ca740 1 --2- 172.21.15.19:0/3551243887 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x563b1f6d0480 0x563b1f6e8be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:35:28.141 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:28.109+0000 7f14644ca740 1 -- 172.21.15.19:0/3551243887 >> 172.21.15.19:0/3551243887 conn(0x563b1f6ce2b0 msgr2=0x563b1f6cf1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:35:28.142 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:28.109+0000 7f14644ca740 1 -- 172.21.15.19:0/3551243887 shutdown_connections 2024-09-10T22:35:28.142 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:28.109+0000 7f14644ca740 1 -- 172.21.15.19:0/3551243887 wait complete. 2024-09-10T22:35:28.142 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:28.110+0000 7f14644ca740 1 -- start start 2024-09-10T22:35:28.142 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:28.110+0000 7f14644ca740 1 Processor -- start 2024-09-10T22:35:28.142 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:28.110+0000 7f14644ca740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563b1f6d0480 0x563b1f6f4540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:35:28.142 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:28.110+0000 7f14644ca740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x563b1f6d0da0 0x563b1f6f4a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:35:28.142 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:28.110+0000 7f14644ca740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x563b1f6dcd30 0x563b1f6e4010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:35:28.142 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:28.110+0000 7f14644ca740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f145c1aa950 con 0x563b1f6d0da0 2024-09-10T22:35:28.142 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:28.110+0000 7f14644ca740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f145c1abdc0 con 0x563b1f6d0480 2024-09-10T22:35:28.142 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:28.110+0000 7f14644ca740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f145c1ab020 con 0x563b1f6dcd30 2024-09-10T22:35:28.142 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:28.110+0000 7f14644ca740 10 client.0 _ll_register_callbacks cb 0x7f1454009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T22:35:28.142 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:28.110+0000 7f145affd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x563b1f6d0da0 0x563b1f6f4a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:35:28.143 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:28.110+0000 7f145affd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x563b1f6d0da0 0x563b1f6f4a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:38544/0 (socket says 172.21.15.19:38544) 2024-09-10T22:35:28.143 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:28.110+0000 7f145affd640 1 -- 172.21.15.19:0/2925975041 learned_addr learned my addr 172.21.15.19:0/2925975041 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:35:28.143 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:28.111+0000 7f145bfff640 1 --2- 172.21.15.19:0/2925975041 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x563b1f6dcd30 0x563b1f6e4010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:35:28.143 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:28.111+0000 7f145b7fe640 1 --2- 172.21.15.19:0/2925975041 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563b1f6d0480 0x563b1f6f4540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:35:28.143 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:28.111+0000 7f145affd640 1 -- 172.21.15.19:0/2925975041 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x563b1f6dcd30 msgr2=0x563b1f6e4010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:35:28.143 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:28.111+0000 7f145affd640 1 --2- 172.21.15.19:0/2925975041 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x563b1f6dcd30 0x563b1f6e4010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:35:28.143 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:28.111+0000 7f145affd640 1 -- 172.21.15.19:0/2925975041 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563b1f6d0480 msgr2=0x563b1f6f4540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:35:28.143 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:28.111+0000 7f145affd640 1 --2- 172.21.15.19:0/2925975041 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563b1f6d0480 0x563b1f6f4540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:35:28.143 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:28.111+0000 7f145affd640 1 -- 172.21.15.19:0/2925975041 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563b1f6e45d0 con 0x563b1f6d0da0 2024-09-10T22:35:28.143 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:28.111+0000 7f145affd640 1 --2- 172.21.15.19:0/2925975041 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x563b1f6d0da0 0x563b1f6f4a80 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7f1444009f70 tx=0x7f1444004420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c78e7327941fa8b server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:35:28.143 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:28.111+0000 7f143affd640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-10T22:35:28.143 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:28.111+0000 7f143affd640 1 -- 172.21.15.19:0/2925975041 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f144401d040 con 0x563b1f6d0da0 2024-09-10T22:35:28.143 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:28.111+0000 7f143affd640 1 -- 172.21.15.19:0/2925975041 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8327+0+0 (secure 0 0 0) 0x7f14440035f0 con 0x563b1f6d0da0 2024-09-10T22:35:28.144 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:28.111+0000 7f14644ca740 1 -- 172.21.15.19:0/2925975041 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f14540318f0 con 0x563b1f6d0da0 2024-09-10T22:35:28.144 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:28.111+0000 7f143affd640 1 -- 172.21.15.19:0/2925975041 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f1444036050 con 0x563b1f6d0da0 2024-09-10T22:35:28.144 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:28.111+0000 7f14644ca740 10 client.17139 fetch_fsmap learned FSMap version 27 2024-09-10T22:35:28.144 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:28.111+0000 7f14644ca740 1 -- 172.21.15.19:0/2925975041 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x563b1f75dfd0 con 0x563b1f6d0da0 2024-09-10T22:35:28.144 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:28.112+0000 7f143affd640 1 -- 172.21.15.19:0/2925975041 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f14540318f0 con 0x563b1f6d0da0 2024-09-10T22:35:28.144 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:28.112+0000 7f143affd640 1 -- 172.21.15.19:0/2925975041 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7f144402b020 con 0x563b1f6d0da0 2024-09-10T22:35:28.144 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:28.112+0000 7f14644ca740 10 client.17139 fetch_fsmap finished waiting for FSMap version 27 2024-09-10T22:35:28.144 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:28.112+0000 7f14644ca740 10 client.17139 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-10T22:35:28.144 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:28.112+0000 7f14644ca740 20 client.17139 populate_metadata read hostname 'smithi019' 2024-09-10T22:35:28.144 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:28.112+0000 7f14644ca740 1 --2- 172.21.15.19:0/2925975041 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x563b1f75e4b0 0x563b1f7608d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:35:28.144 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:28.112+0000 7f14644ca740 4 client.17139 mds_command: new command op to 24581 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-10T22:35:28.144 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:28.112+0000 7f14644ca740 1 -- 172.21.15.19:0/2925975041 --> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] -- command(tid 0: {"prefix": "scrub status"}) -- 0x563b1f644850 con 0x563b1f75e4b0 2024-09-10T22:35:28.145 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:28.112+0000 7f145b7fe640 1 --2- 172.21.15.19:0/2925975041 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x563b1f75e4b0 0x563b1f7608d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:35:28.145 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:28.112+0000 7f145b7fe640 1 --2- 172.21.15.19:0/2925975041 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x563b1f75e4b0 0x563b1f7608d0 crc :-1 s=READY pgs=183 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5fa9def61433ff7b server_cookie=83d4f343140bed23 in_seq=0 out_seq=0 2024-09-10T22:35:28.145 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:28.112+0000 7f143affd640 10 client.17139 ms_handle_connect on v2:172.21.15.135:6838/1254769802 2024-09-10T22:35:28.145 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:28.113+0000 7f143affd640 1 -- 172.21.15.19:0/2925975041 <== mds.0 v2:172.21.15.135:6838/1254769802 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3498 (crc 0 0 0) 0x7f144c095dc0 con 0x563b1f75e4b0 2024-09-10T22:35:28.145 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:28.113+0000 7f143affd640 10 client.17139 handle_command_reply: tid=0 2024-09-10T22:35:28.145 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:28.113+0000 7f14644ca740 1 client.17139 shutdown 2024-09-10T22:35:28.145 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:28.113+0000 7f14644ca740 1 -- 172.21.15.19:0/2925975041 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x563b1f6d0da0 msgr2=0x563b1f6f4a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:35:28.145 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:28.113+0000 7f14644ca740 1 --2- 172.21.15.19:0/2925975041 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x563b1f6d0da0 0x563b1f6f4a80 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7f1444009f70 tx=0x7f1444004420 comp rx=0 tx=0).stop 2024-09-10T22:35:28.145 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:28.113+0000 7f14644ca740 1 -- 172.21.15.19:0/2925975041 shutdown_connections 2024-09-10T22:35:28.145 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:28.113+0000 7f14644ca740 1 --2- 172.21.15.19:0/2925975041 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x563b1f75e4b0 0x563b1f7608d0 crc :-1 s=READY pgs=183 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:35:28.145 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:28.113+0000 7f14644ca740 1 --2- 172.21.15.19:0/2925975041 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x563b1f6dcd30 0x563b1f6e4010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:35:28.145 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:28.113+0000 7f14644ca740 1 --2- 172.21.15.19:0/2925975041 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x563b1f6d0da0 0x563b1f6f4a80 unknown :-1 s=CLOSED pgs=769 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:35:28.146 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:28.113+0000 7f14644ca740 1 --2- 172.21.15.19:0/2925975041 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563b1f6d0480 0x563b1f6f4540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:35:28.146 INFO:teuthology.orchestra.run.smithi019.stdout:{ 2024-09-10T22:35:28.146 INFO:teuthology.orchestra.run.smithi019.stdout: "status": "no active scrubs running", 2024-09-10T22:35:28.146 INFO:teuthology.orchestra.run.smithi019.stdout: "scrubs": {}, 2024-09-10T22:35:28.146 INFO:teuthology.orchestra.run.smithi019.stdout: "scrub_stats": { 2024-09-10T22:35:28.146 INFO:teuthology.orchestra.run.smithi019.stdout: "a77606c2-7618-413e-8aba-f9783ecbf435": { 2024-09-10T22:35:28.146 INFO:teuthology.orchestra.run.smithi019.stdout: "start_time": "2024-09-10T22:34:54.453894+0000", 2024-09-10T22:35:28.146 INFO:teuthology.orchestra.run.smithi019.stdout: "path": "/", 2024-09-10T22:35:28.146 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_started": 0, 2024-09-10T22:35:28.147 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_passed": 0, 2024-09-10T22:35:28.147 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_failed": 0, 2024-09-10T22:35:28.147 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_skipped": 0 2024-09-10T22:35:28.147 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:35:28.147 INFO:teuthology.orchestra.run.smithi019.stdout: "0b81ea61-0b8e-4f2c-a58f-ef1019289fc9": { 2024-09-10T22:35:28.147 INFO:teuthology.orchestra.run.smithi019.stdout: "start_time": "2024-09-10T22:31:48.141568+0000", 2024-09-10T22:35:28.147 INFO:teuthology.orchestra.run.smithi019.stdout: "path": "/", 2024-09-10T22:35:28.147 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_started": 0, 2024-09-10T22:35:28.147 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_passed": 0, 2024-09-10T22:35:28.147 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_failed": 0, 2024-09-10T22:35:28.147 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_skipped": 0 2024-09-10T22:35:28.147 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:35:28.147 INFO:teuthology.orchestra.run.smithi019.stdout: "715ec863-8a9d-45b6-967f-59b15ce1bf12": { 2024-09-10T22:35:28.148 INFO:teuthology.orchestra.run.smithi019.stdout: "start_time": "2024-09-10T22:31:00.669516+0000", 2024-09-10T22:35:28.148 INFO:teuthology.orchestra.run.smithi019.stdout: "path": "/", 2024-09-10T22:35:28.148 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_started": 0, 2024-09-10T22:35:28.148 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_passed": 0, 2024-09-10T22:35:28.148 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_failed": 0, 2024-09-10T22:35:28.148 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_skipped": 0 2024-09-10T22:35:28.148 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:35:28.148 INFO:teuthology.orchestra.run.smithi019.stdout: "fd1f1837-dcfa-4d88-99e8-2509f36c3f98": { 2024-09-10T22:35:28.148 INFO:teuthology.orchestra.run.smithi019.stdout: "start_time": "2024-09-10T22:30:12.470477+0000", 2024-09-10T22:35:28.148 INFO:teuthology.orchestra.run.smithi019.stdout: "path": "/", 2024-09-10T22:35:28.148 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_started": 0, 2024-09-10T22:35:28.148 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_passed": 0, 2024-09-10T22:35:28.148 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_failed": 0, 2024-09-10T22:35:28.148 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_skipped": 0 2024-09-10T22:35:28.149 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:35:28.149 INFO:teuthology.orchestra.run.smithi019.stdout: "8f3bb3bf-911f-490c-9856-c80ea220dbbe": { 2024-09-10T22:35:28.149 INFO:teuthology.orchestra.run.smithi019.stdout: "start_time": "2024-09-10T22:29:25.374415+0000", 2024-09-10T22:35:28.149 INFO:teuthology.orchestra.run.smithi019.stdout: "path": "/", 2024-09-10T22:35:28.149 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_started": 0, 2024-09-10T22:35:28.149 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_passed": 0, 2024-09-10T22:35:28.149 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_failed": 0, 2024-09-10T22:35:28.149 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_skipped": 0 2024-09-10T22:35:28.149 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:35:28.149 INFO:teuthology.orchestra.run.smithi019.stdout: "eb518e3c-a71e-4f32-9ca0-ae88930ca218": { 2024-09-10T22:35:28.149 INFO:teuthology.orchestra.run.smithi019.stdout: "start_time": "2024-09-10T22:28:38.366352+0000", 2024-09-10T22:35:28.149 INFO:teuthology.orchestra.run.smithi019.stdout: "path": "/", 2024-09-10T22:35:28.150 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_started": 0, 2024-09-10T22:35:28.150 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_passed": 0, 2024-09-10T22:35:28.150 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_failed": 0, 2024-09-10T22:35:28.150 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_skipped": 0 2024-09-10T22:35:28.150 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:35:28.150 INFO:teuthology.orchestra.run.smithi019.stdout: "9efe684b-7583-402e-a46e-e262a37e1af5": { 2024-09-10T22:35:28.150 INFO:teuthology.orchestra.run.smithi019.stdout: "start_time": "2024-09-10T22:34:09.479768+0000", 2024-09-10T22:35:28.150 INFO:teuthology.orchestra.run.smithi019.stdout: "path": "/", 2024-09-10T22:35:28.150 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_started": 0, 2024-09-10T22:35:28.150 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_passed": 0, 2024-09-10T22:35:28.150 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_failed": 0, 2024-09-10T22:35:28.150 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_skipped": 0 2024-09-10T22:35:28.150 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:35:28.150 INFO:teuthology.orchestra.run.smithi019.stdout: "4c99964e-2e0e-4ffd-8cb8-99c4979ed90f": { 2024-09-10T22:35:28.150 INFO:teuthology.orchestra.run.smithi019.stdout: "start_time": "2024-09-10T22:32:34.659639+0000", 2024-09-10T22:35:28.151 INFO:teuthology.orchestra.run.smithi019.stdout: "path": "/", 2024-09-10T22:35:28.151 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_started": 0, 2024-09-10T22:35:28.151 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_passed": 0, 2024-09-10T22:35:28.151 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_failed": 0, 2024-09-10T22:35:28.151 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_skipped": 0 2024-09-10T22:35:28.151 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:35:28.151 INFO:teuthology.orchestra.run.smithi019.stdout: "c12c2a04-dcd6-4673-a98e-93f665d3f5d7": { 2024-09-10T22:35:28.151 INFO:teuthology.orchestra.run.smithi019.stdout: "start_time": "2024-09-10T22:27:49.392329+0000", 2024-09-10T22:35:28.151 INFO:teuthology.orchestra.run.smithi019.stdout: "path": "/", 2024-09-10T22:35:28.151 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_started": 0, 2024-09-10T22:35:28.151 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_passed": 0, 2024-09-10T22:35:28.151 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_failed": 0, 2024-09-10T22:35:28.151 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_skipped": 0 2024-09-10T22:35:28.151 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:35:28.152 INFO:teuthology.orchestra.run.smithi019.stdout: "b38852c8-478a-42ef-8384-b2c55d5313a4": { 2024-09-10T22:35:28.152 INFO:teuthology.orchestra.run.smithi019.stdout: "start_time": "2024-09-10T22:27:00.320308+0000", 2024-09-10T22:35:28.152 INFO:teuthology.orchestra.run.smithi019.stdout: "path": "/", 2024-09-10T22:35:28.152 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_started": 0, 2024-09-10T22:35:28.152 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_passed": 0, 2024-09-10T22:35:28.152 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_failed": 0, 2024-09-10T22:35:28.152 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_skipped": 0 2024-09-10T22:35:28.152 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:35:28.152 INFO:teuthology.orchestra.run.smithi019.stdout: "448b10e7-494c-4a88-a9ab-186159c5dfdd": { 2024-09-10T22:35:28.152 INFO:teuthology.orchestra.run.smithi019.stdout: "start_time": "2024-09-10T22:33:21.208716+0000", 2024-09-10T22:35:28.152 INFO:teuthology.orchestra.run.smithi019.stdout: "path": "/", 2024-09-10T22:35:28.152 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_started": 0, 2024-09-10T22:35:28.152 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_passed": 0, 2024-09-10T22:35:28.152 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_failed": 0, 2024-09-10T22:35:28.152 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_skipped": 0 2024-09-10T22:35:28.153 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:35:28.153 INFO:teuthology.orchestra.run.smithi019.stdout: "9b6bfdee-303c-4c12-af56-dc85860d112a": { 2024-09-10T22:35:28.153 INFO:teuthology.orchestra.run.smithi019.stdout: "start_time": "2024-09-10T22:26:17.484162+0000", 2024-09-10T22:35:28.153 INFO:teuthology.orchestra.run.smithi019.stdout: "path": "/", 2024-09-10T22:35:28.153 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_started": 0, 2024-09-10T22:35:28.153 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_passed": 0, 2024-09-10T22:35:28.153 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_failed": 0, 2024-09-10T22:35:28.153 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_skipped": 0 2024-09-10T22:35:28.153 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-10T22:35:28.153 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-10T22:35:28.153 INFO:teuthology.orchestra.run.smithi019.stdout:} 2024-09-10T22:35:28.154 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:28.113+0000 7f143affd640 0 client.17139 ms_handle_reset on v2:172.21.15.135:6838/1254769802 2024-09-10T22:35:28.154 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:28.113+0000 7f14644ca740 1 -- 172.21.15.19:0/2925975041 >> 172.21.15.19:0/2925975041 conn(0x563b1f6ce2b0 msgr2=0x563b1f6ccbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:35:28.154 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:28.113+0000 7f14644ca740 1 -- 172.21.15.19:0/2925975041 shutdown_connections 2024-09-10T22:35:28.154 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:28.113+0000 7f14644ca740 1 -- 172.21.15.19:0/2925975041 wait complete. 2024-09-10T22:35:28.154 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:28.113+0000 7f14644ca740 20 client.17139 trim_cache size 0 max 16384 2024-09-10T22:35:28.154 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:28.114+0000 7f14620f5640 1 -- 172.21.15.19:0/2472953445 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f14480b52e0 msgr2=0x7f14480b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:35:28.154 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:28.114+0000 7f14620f5640 1 --2- 172.21.15.19:0/2472953445 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f14480b52e0 0x7f14480b77a0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f1454006010 tx=0x7f14540058d0 comp rx=0 tx=0).stop 2024-09-10T22:35:28.154 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:28.114+0000 7f14620f5640 1 -- 172.21.15.19:0/2472953445 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f145c101c90 msgr2=0x7f145c1980f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:35:28.154 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:28.114+0000 7f14620f5640 1 --2- 172.21.15.19:0/2472953445 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f145c101c90 0x7f145c1980f0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f144c00ebc0 tx=0x7f144c00c6a0 comp rx=0 tx=0).stop 2024-09-10T22:35:28.154 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:28.114+0000 7f14620f5640 1 -- 172.21.15.19:0/2472953445 shutdown_connections 2024-09-10T22:35:28.154 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:28.114+0000 7f14620f5640 1 --2- 172.21.15.19:0/2472953445 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f14480b52e0 0x7f14480b77a0 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:35:28.154 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:28.114+0000 7f14620f5640 1 --2- 172.21.15.19:0/2472953445 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f145c108020 0x7f145c19d9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:35:28.155 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:28.114+0000 7f14620f5640 1 --2- 172.21.15.19:0/2472953445 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f145c1076a0 0x7f145c198630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:35:28.155 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:28.114+0000 7f14620f5640 1 --2- 172.21.15.19:0/2472953445 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f145c101c90 0x7f145c1980f0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:35:28.155 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:28.114+0000 7f14620f5640 1 -- 172.21.15.19:0/2472953445 >> 172.21.15.19:0/2472953445 conn(0x7f145c0fd6c0 msgr2=0x7f145c0ffab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:35:28.155 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:28.114+0000 7f14620f5640 1 -- 172.21.15.19:0/2472953445 shutdown_connections 2024-09-10T22:35:28.155 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:28.114+0000 7f14620f5640 1 -- 172.21.15.19:0/2472953445 wait complete. 2024-09-10T22:35:28.360 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:35:28 smithi135 ceph-mon[34789]: pgmap v618: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 439 KiB/s rd, 249 MiB/s wr, 1.26k op/s 2024-09-10T22:35:28.375 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:35:28 smithi138 ceph-mon[35236]: pgmap v618: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 439 KiB/s rd, 249 MiB/s wr, 1.26k op/s 2024-09-10T22:35:29.190 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-10T22:35:29.190 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 22997a4c-6fc2-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-10T22:35:29.528 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/22997a4c-6fc2-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T22:35:30.204 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:35:30 smithi019 ceph-mon[31375]: pgmap v619: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 457 KiB/s rd, 192 MiB/s wr, 1.07k op/s 2024-09-10T22:35:30.246 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:30.201+0000 7f0e91c40640 1 -- 172.21.15.19:0/1543334730 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0e8c108020 msgr2=0x7f0e8c10e820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:35:30.246 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:30.201+0000 7f0e91c40640 1 --2- 172.21.15.19:0/1543334730 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0e8c108020 0x7f0e8c10e820 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7f0e84009ca0 tx=0x7f0e8402a8e0 comp rx=0 tx=0).stop 2024-09-10T22:35:30.246 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:30.201+0000 7f0e91c40640 1 -- 172.21.15.19:0/1543334730 shutdown_connections 2024-09-10T22:35:30.246 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:30.201+0000 7f0e91c40640 1 --2- 172.21.15.19:0/1543334730 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0e8c108020 0x7f0e8c10e820 unknown :-1 s=CLOSED pgs=770 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:35:30.247 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:30.201+0000 7f0e91c40640 1 --2- 172.21.15.19:0/1543334730 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0e8c1076a0 0x7f0e8c107ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:35:30.247 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:30.201+0000 7f0e91c40640 1 --2- 172.21.15.19:0/1543334730 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f0e8c101c90 0x7f0e8c102070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:35:30.247 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:30.201+0000 7f0e91c40640 1 -- 172.21.15.19:0/1543334730 >> 172.21.15.19:0/1543334730 conn(0x7f0e8c0fd700 msgr2=0x7f0e8c0ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:35:30.247 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:30.201+0000 7f0e91c40640 1 -- 172.21.15.19:0/1543334730 shutdown_connections 2024-09-10T22:35:30.247 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:30.201+0000 7f0e91c40640 1 -- 172.21.15.19:0/1543334730 wait complete. 2024-09-10T22:35:30.247 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:30.202+0000 7f0e91c40640 1 Processor -- start 2024-09-10T22:35:30.247 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:30.202+0000 7f0e91c40640 1 -- start start 2024-09-10T22:35:30.247 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:30.203+0000 7f0e91c40640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0e8c101c90 0x7f0e8c06ce60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:35:30.247 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:30.203+0000 7f0e91c40640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0e8c1076a0 0x7f0e8c06d3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:35:30.247 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:30.203+0000 7f0e91c40640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f0e8c108020 0x7f0e8c072740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:35:30.247 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:30.203+0000 7f0e91c40640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f0e8c111d30 con 0x7f0e8c1076a0 2024-09-10T22:35:30.247 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:30.203+0000 7f0e91c40640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f0e8c111bb0 con 0x7f0e8c101c90 2024-09-10T22:35:30.247 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:30.203+0000 7f0e91c40640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f0e8c111eb0 con 0x7f0e8c108020 2024-09-10T22:35:30.248 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:30.203+0000 7f0e83fff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0e8c1076a0 0x7f0e8c06d3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:35:30.248 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:30.203+0000 7f0e83fff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0e8c1076a0 0x7f0e8c06d3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:38560/0 (socket says 172.21.15.19:38560) 2024-09-10T22:35:30.248 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:30.203+0000 7f0e83fff640 1 -- 172.21.15.19:0/822062501 learned_addr learned my addr 172.21.15.19:0/822062501 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:35:30.248 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:30.203+0000 7f0e8b7fe640 1 --2- 172.21.15.19:0/822062501 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0e8c101c90 0x7f0e8c06ce60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:35:30.248 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:30.203+0000 7f0e83fff640 1 -- 172.21.15.19:0/822062501 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f0e8c108020 msgr2=0x7f0e8c072740 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-10T22:35:30.248 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:30.204+0000 7f0e83fff640 1 --2- 172.21.15.19:0/822062501 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f0e8c108020 0x7f0e8c072740 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:35:30.248 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:30.204+0000 7f0e83fff640 1 -- 172.21.15.19:0/822062501 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0e8c101c90 msgr2=0x7f0e8c06ce60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:35:30.248 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:30.204+0000 7f0e83fff640 1 --2- 172.21.15.19:0/822062501 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0e8c101c90 0x7f0e8c06ce60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:35:30.248 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:30.204+0000 7f0e83fff640 1 -- 172.21.15.19:0/822062501 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0e8c072ec0 con 0x7f0e8c1076a0 2024-09-10T22:35:30.248 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:30.204+0000 7f0e8b7fe640 1 --2- 172.21.15.19:0/822062501 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0e8c101c90 0x7f0e8c06ce60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T22:35:30.248 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:30.204+0000 7f0e83fff640 1 --2- 172.21.15.19:0/822062501 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0e8c1076a0 0x7f0e8c06d3a0 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7f0e7400d950 tx=0x7f0e7400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:35:30.248 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:30.204+0000 7f0e897fa640 1 -- 172.21.15.19:0/822062501 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e74017070 con 0x7f0e8c1076a0 2024-09-10T22:35:30.249 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:30.204+0000 7f0e91c40640 1 -- 172.21.15.19:0/822062501 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0e8c0731b0 con 0x7f0e8c1076a0 2024-09-10T22:35:30.249 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:30.204+0000 7f0e91c40640 1 -- 172.21.15.19:0/822062501 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0e8c073930 con 0x7f0e8c1076a0 2024-09-10T22:35:30.249 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:30.204+0000 7f0e897fa640 1 -- 172.21.15.19:0/822062501 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0e74009c30 con 0x7f0e8c1076a0 2024-09-10T22:35:30.249 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:30.205+0000 7f0e897fa640 1 -- 172.21.15.19:0/822062501 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e7400f620 con 0x7f0e8c1076a0 2024-09-10T22:35:30.249 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:30.207+0000 7f0e91c40640 1 -- 172.21.15.19:0/822062501 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0e6c0052c0 con 0x7f0e8c1076a0 2024-09-10T22:35:30.249 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:30.209+0000 7f0e897fa640 1 -- 172.21.15.19:0/822062501 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 18) ==== 153250+0+0 (secure 0 0 0) 0x7f0e7400f7c0 con 0x7f0e8c1076a0 2024-09-10T22:35:30.249 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:30.211+0000 7f0e897fa640 1 --2- 172.21.15.19:0/822062501 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f0e780b52e0 0x7f0e780b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:35:30.249 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:30.212+0000 7f0e897fa640 1 -- 172.21.15.19:0/822062501 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8327+0+0 (secure 0 0 0) 0x7f0e740e56d0 con 0x7f0e8c1076a0 2024-09-10T22:35:30.249 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:30.212+0000 7f0e8b7fe640 1 --2- 172.21.15.19:0/822062501 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f0e780b52e0 0x7f0e780b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:35:30.249 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:30.214+0000 7f0e8b7fe640 1 --2- 172.21.15.19:0/822062501 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f0e780b52e0 0x7f0e780b77a0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f0e7c006fd0 tx=0x7f0e7c0090e0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:35:30.249 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:30.219+0000 7f0e897fa640 1 -- 172.21.15.19:0/822062501 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f0e740ac530 con 0x7f0e8c1076a0 2024-09-10T22:35:30.360 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:35:30 smithi135 ceph-mon[34789]: pgmap v619: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 457 KiB/s rd, 192 MiB/s wr, 1.07k op/s 2024-09-10T22:35:30.375 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:35:30 smithi138 ceph-mon[35236]: pgmap v619: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 457 KiB/s rd, 192 MiB/s wr, 1.07k op/s 2024-09-10T22:35:30.564 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:30.563+0000 7f0e91c40640 1 -- 172.21.15.19:0/822062501 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f0e6c0055b0 con 0x7f0e8c1076a0 2024-09-10T22:35:30.565 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:30.563+0000 7f0e897fa640 1 -- 172.21.15.19:0/822062501 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) ==== 94+0+11921 (secure 0 0 0) 0x7f0e74009de0 con 0x7f0e8c1076a0 2024-09-10T22:35:30.565 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-10T22:35:30.566 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":27,"btime":"2024-09-10T22:29:37:724724+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14673,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6835/1835804747","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6834","nonce":1835804747},{"type":"v1","addr":"172.21.15.19:6835","nonce":1835804747}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14685,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6837/1750470490","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6836","nonce":1750470490},{"type":"v1","addr":"172.21.15.19:6837","nonce":1750470490}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14733,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6839/2642941149","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6838","nonce":2642941149},{"type":"v1","addr":"172.21.15.19:6839","nonce":2642941149}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14745,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6841/2449948682","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6840","nonce":2449948682},{"type":"v1","addr":"172.21.15.19:6841","nonce":2449948682}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24511,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.138:6833/2524811494","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6832","nonce":2524811494},{"type":"v1","addr":"172.21.15.138:6833","nonce":2524811494}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24512,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6833/3014993624","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6832","nonce":3014993624},{"type":"v1","addr":"172.21.15.135:6833","nonce":3014993624}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":27,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-10T22:24:22.733925+0000","modified":"2024-09-10T22:29:37.430699+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24581,"mds_1":24568,"mds_2":24553},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24527":{"gid":24527,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.135:6835/3715773348","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6834","nonce":3715773348},{"type":"v1","addr":"172.21.15.135:6835","nonce":3715773348}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24541":{"gid":24541,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.138:6835/933547028","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6834","nonce":933547028},{"type":"v1","addr":"172.21.15.138:6835","nonce":933547028}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24551":{"gid":24551,"name":"h","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.135:6837/3495029135","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6836","nonce":3495029135},{"type":"v1","addr":"172.21.15.135:6837","nonce":3495029135}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24553":{"gid":24553,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":10,"addr":"172.21.15.138:6837/3353290042","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6836","nonce":3353290042},{"type":"v1","addr":"172.21.15.138:6837","nonce":3353290042}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24568":{"gid":24568,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.138:6839/383637208","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6838","nonce":383637208},{"type":"v1","addr":"172.21.15.138:6839","nonce":383637208}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24581":{"gid":24581,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.135:6839/1254769802","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6838","nonce":1254769802},{"type":"v1","addr":"172.21.15.135:6839","nonce":1254769802}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24581,"qdb_cluster":[24581,24568,24553]},"id":1}]} 2024-09-10T22:35:30.566 INFO:teuthology.orchestra.run.smithi019.stderr:dumped fsmap epoch 27 2024-09-10T22:35:30.567 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:30.566+0000 7f0e91c40640 1 -- 172.21.15.19:0/822062501 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f0e780b52e0 msgr2=0x7f0e780b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:35:30.567 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:30.566+0000 7f0e91c40640 1 --2- 172.21.15.19:0/822062501 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f0e780b52e0 0x7f0e780b77a0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f0e7c006fd0 tx=0x7f0e7c0090e0 comp rx=0 tx=0).stop 2024-09-10T22:35:30.567 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:30.566+0000 7f0e91c40640 1 -- 172.21.15.19:0/822062501 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0e8c1076a0 msgr2=0x7f0e8c06d3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:35:30.568 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:30.566+0000 7f0e91c40640 1 --2- 172.21.15.19:0/822062501 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0e8c1076a0 0x7f0e8c06d3a0 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7f0e7400d950 tx=0x7f0e7400de10 comp rx=0 tx=0).stop 2024-09-10T22:35:30.568 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:30.566+0000 7f0e91c40640 1 -- 172.21.15.19:0/822062501 shutdown_connections 2024-09-10T22:35:30.568 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:30.566+0000 7f0e91c40640 1 --2- 172.21.15.19:0/822062501 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f0e780b52e0 0x7f0e780b77a0 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:35:30.568 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:30.566+0000 7f0e91c40640 1 --2- 172.21.15.19:0/822062501 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f0e8c108020 0x7f0e8c072740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:35:30.568 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:30.566+0000 7f0e91c40640 1 --2- 172.21.15.19:0/822062501 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0e8c1076a0 0x7f0e8c06d3a0 unknown :-1 s=CLOSED pgs=771 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:35:30.568 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:30.566+0000 7f0e91c40640 1 --2- 172.21.15.19:0/822062501 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0e8c101c90 0x7f0e8c06ce60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:35:30.568 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:30.566+0000 7f0e91c40640 1 -- 172.21.15.19:0/822062501 >> 172.21.15.19:0/822062501 conn(0x7f0e8c0fd700 msgr2=0x7f0e8c100b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:35:30.568 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:30.566+0000 7f0e91c40640 1 -- 172.21.15.19:0/822062501 shutdown_connections 2024-09-10T22:35:30.568 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:30.566+0000 7f0e91c40640 1 -- 172.21.15.19:0/822062501 wait complete. 2024-09-10T22:35:31.359 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:35:31 smithi135 ceph-mon[34789]: from='client.? 172.21.15.19:0/822062501' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T22:35:31.375 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:35:31 smithi138 ceph-mon[35236]: from='client.? 172.21.15.19:0/822062501' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T22:35:31.399 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:35:31 smithi019 ceph-mon[31375]: from='client.? 172.21.15.19:0/822062501' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T22:35:31.433 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 22997a4c-6fc2-11ef-bcea-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-09-10T22:35:31.786 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/22997a4c-6fc2-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T22:35:31.887 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:31.885+0000 7fdcb9ffb640 1 -- 172.21.15.19:0/2319312200 <== mds.0 v2:172.21.15.135:6838/1254769802 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x558fd367a0f0 con 0x558fd3790c60 2024-09-10T22:35:31.887 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:31.885+0000 7fdcb9ffb640 10 client.26488 handle_command_reply: tid=0 2024-09-10T22:35:31.887 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:31.885+0000 7fdcdbe6d740 1 client.26488 shutdown 2024-09-10T22:35:31.887 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:31.885+0000 7fdcdbe6d740 1 -- 172.21.15.19:0/2319312200 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x558fd370d190 msgr2=0x558fd3719470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:35:31.887 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:31.885+0000 7fdcdbe6d740 1 --2- 172.21.15.19:0/2319312200 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x558fd370d190 0x558fd3719470 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fdcbc000c00 tx=0x7fdcbc0055f0 comp rx=0 tx=0).stop 2024-09-10T22:35:31.887 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:31.885+0000 7fdcdbe6d740 1 -- 172.21.15.19:0/2319312200 shutdown_connections 2024-09-10T22:35:31.887 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:31.885+0000 7fdcdbe6d740 1 --2- 172.21.15.19:0/2319312200 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x558fd370fbd0 0x558fd371a040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:35:31.887 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:31.885+0000 7fdcdbe6d740 1 --2- 172.21.15.19:0/2319312200 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x558fd3790c60 0x558fd3793050 crc :-1 s=READY pgs=181 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:35:31.888 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:31.885+0000 7fdcdbe6d740 1 --2- 172.21.15.19:0/2319312200 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x558fd370d190 0x558fd3719470 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:35:31.888 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:31.885+0000 7fdcb9ffb640 0 client.26488 ms_handle_reset on v2:172.21.15.135:6838/1254769802 2024-09-10T22:35:31.888 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:31.885+0000 7fdcdbe6d740 1 --2- 172.21.15.19:0/2319312200 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558fd370a860 0x558fd3718dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:35:31.888 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:31.885+0000 7fdcdbe6d740 1 -- 172.21.15.19:0/2319312200 >> 172.21.15.19:0/2319312200 conn(0x558fd37059b0 msgr2=0x558fd3706450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:35:31.888 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:31.885+0000 7fdcdbe6d740 1 -- 172.21.15.19:0/2319312200 shutdown_connections 2024-09-10T22:35:31.888 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:31.885+0000 7fdcdbe6d740 1 -- 172.21.15.19:0/2319312200 wait complete. 2024-09-10T22:35:31.888 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:31.885+0000 7fdcdbe6d740 20 client.26488 trim_cache size 0 max 16384 2024-09-10T22:35:31.888 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stdout:{ 2024-09-10T22:35:31.888 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stdout: "message": "", 2024-09-10T22:35:31.888 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stdout: "return_code": 0 2024-09-10T22:35:31.889 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stdout:} 2024-09-10T22:35:31.890 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:31.886+0000 7fdcd8fc6640 1 -- 172.21.15.19:0/2657722690 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7fdcc00b52e0 msgr2=0x7fdcc00b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:35:31.890 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:31.886+0000 7fdcd8fc6640 1 --2- 172.21.15.19:0/2657722690 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7fdcc00b52e0 0x7fdcc00b77a0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7fdcd4199b60 tx=0x7fdccc009500 comp rx=0 tx=0).stop 2024-09-10T22:35:31.890 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:31.886+0000 7fdcd8fc6640 1 -- 172.21.15.19:0/2657722690 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdcd406bef0 msgr2=0x7fdcd4198de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:35:31.890 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:31.886+0000 7fdcd8fc6640 1 --2- 172.21.15.19:0/2657722690 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdcd406bef0 0x7fdcd4198de0 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7fdcc4005940 tx=0x7fdcc40042f0 comp rx=0 tx=0).stop 2024-09-10T22:35:31.890 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:31.886+0000 7fdcd8fc6640 1 -- 172.21.15.19:0/2657722690 shutdown_connections 2024-09-10T22:35:31.890 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:31.886+0000 7fdcd8fc6640 1 --2- 172.21.15.19:0/2657722690 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7fdcc00b52e0 0x7fdcc00b77a0 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:35:31.890 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:31.886+0000 7fdcd8fc6640 1 --2- 172.21.15.19:0/2657722690 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdcd41086b0 0x7fdcd419a060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:35:31.890 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:31.886+0000 7fdcd8fc6640 1 --2- 172.21.15.19:0/2657722690 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fdcd4105b00 0x7fdcd4199430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:35:31.890 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:31.886+0000 7fdcd8fc6640 1 --2- 172.21.15.19:0/2657722690 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdcd406bef0 0x7fdcd4198de0 unknown :-1 s=CLOSED pgs=766 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:35:31.890 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:31.886+0000 7fdcd8fc6640 1 -- 172.21.15.19:0/2657722690 >> 172.21.15.19:0/2657722690 conn(0x7fdcd40fd150 msgr2=0x7fdcd4103dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:35:31.891 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:31.886+0000 7fdcd8fc6640 1 -- 172.21.15.19:0/2657722690 shutdown_connections 2024-09-10T22:35:31.891 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:31.886+0000 7fdcd8fc6640 1 -- 172.21.15.19:0/2657722690 wait complete. 2024-09-10T22:35:32.206 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:35:32 smithi019 ceph-mon[31375]: pgmap v620: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 302 KiB/s rd, 232 MiB/s wr, 1.22k op/s 2024-09-10T22:35:32.350 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:32.348+0000 7f6321156640 1 -- 172.21.15.19:0/3970864374 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f631c102de0 msgr2=0x7f631c1031c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:35:32.351 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:32.348+0000 7f6321156640 1 --2- 172.21.15.19:0/3970864374 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f631c102de0 0x7f631c1031c0 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x7f630c009900 tx=0x7f630c02a410 comp rx=0 tx=0).stop 2024-09-10T22:35:32.351 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:32.348+0000 7f6321156640 1 -- 172.21.15.19:0/3970864374 shutdown_connections 2024-09-10T22:35:32.351 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:32.348+0000 7f6321156640 1 --2- 172.21.15.19:0/3970864374 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f631c109170 0x7f631c10f970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:35:32.351 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:32.348+0000 7f6321156640 1 --2- 172.21.15.19:0/3970864374 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f631c1087f0 0x7f631c108c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:35:32.351 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:32.348+0000 7f6321156640 1 --2- 172.21.15.19:0/3970864374 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f631c102de0 0x7f631c1031c0 unknown :-1 s=CLOSED pgs=772 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:35:32.351 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:32.348+0000 7f6321156640 1 -- 172.21.15.19:0/3970864374 >> 172.21.15.19:0/3970864374 conn(0x7f631c0fe830 msgr2=0x7f631c100c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:35:32.351 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:32.349+0000 7f6321156640 1 -- 172.21.15.19:0/3970864374 shutdown_connections 2024-09-10T22:35:32.351 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:32.349+0000 7f6321156640 1 -- 172.21.15.19:0/3970864374 wait complete. 2024-09-10T22:35:32.353 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:32.349+0000 7f6321156640 1 Processor -- start 2024-09-10T22:35:32.353 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:32.350+0000 7f6321156640 1 -- start start 2024-09-10T22:35:32.353 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:32.350+0000 7f6321156640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f631c102de0 0x7f631c1992f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:35:32.353 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:32.350+0000 7f6321156640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f631c1087f0 0x7f631c199830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:35:32.353 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:32.350+0000 7f6321156640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f631c109170 0x7f631c19ebd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:35:32.353 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:32.350+0000 7f6321156640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f631c112e40 con 0x7f631c109170 2024-09-10T22:35:32.354 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:32.350+0000 7f6321156640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f631c112cc0 con 0x7f631c1087f0 2024-09-10T22:35:32.354 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:32.350+0000 7f6321156640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f631c112fc0 con 0x7f631c102de0 2024-09-10T22:35:32.354 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:32.350+0000 7f631b59e640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f631c109170 0x7f631c19ebd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:35:32.354 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:32.350+0000 7f631ad9d640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f631c102de0 0x7f631c1992f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:35:32.354 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:32.350+0000 7f631a59c640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f631c1087f0 0x7f631c199830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:35:32.354 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:32.350+0000 7f631b59e640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f631c109170 0x7f631c19ebd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:38568/0 (socket says 172.21.15.19:38568) 2024-09-10T22:35:32.354 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:32.350+0000 7f631a59c640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f631c1087f0 0x7f631c199830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.19:60084/0 (socket says 172.21.15.19:60084) 2024-09-10T22:35:32.354 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:32.350+0000 7f631b59e640 1 -- 172.21.15.19:0/3477557211 learned_addr learned my addr 172.21.15.19:0/3477557211 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:35:32.354 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:32.351+0000 7f631b59e640 1 -- 172.21.15.19:0/3477557211 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f631c102de0 msgr2=0x7f631c1992f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:35:32.354 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:32.351+0000 7f631b59e640 1 --2- 172.21.15.19:0/3477557211 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f631c102de0 0x7f631c1992f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:35:32.354 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:32.351+0000 7f631b59e640 1 -- 172.21.15.19:0/3477557211 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f631c1087f0 msgr2=0x7f631c199830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:35:32.354 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:32.351+0000 7f631b59e640 1 --2- 172.21.15.19:0/3477557211 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f631c1087f0 0x7f631c199830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:35:32.354 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:32.351+0000 7f631b59e640 1 -- 172.21.15.19:0/3477557211 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f631c19f3a0 con 0x7f631c109170 2024-09-10T22:35:32.355 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:32.351+0000 7f631a59c640 1 --2- 172.21.15.19:0/3477557211 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f631c1087f0 0x7f631c199830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T22:35:32.355 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:32.351+0000 7f631b59e640 1 --2- 172.21.15.19:0/3477557211 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f631c109170 0x7f631c19ebd0 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7f6314009fd0 tx=0x7f631400b260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:35:32.355 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:32.351+0000 7f6303fff640 1 -- 172.21.15.19:0/3477557211 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6314017070 con 0x7f631c109170 2024-09-10T22:35:32.355 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:32.351+0000 7f6321156640 1 -- 172.21.15.19:0/3477557211 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f631c19f690 con 0x7f631c109170 2024-09-10T22:35:32.355 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:32.351+0000 7f6303fff640 1 -- 172.21.15.19:0/3477557211 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6314003e20 con 0x7f631c109170 2024-09-10T22:35:32.355 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:32.351+0000 7f6303fff640 1 -- 172.21.15.19:0/3477557211 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6314010460 con 0x7f631c109170 2024-09-10T22:35:32.355 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:32.351+0000 7f6321156640 1 -- 172.21.15.19:0/3477557211 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f631c1a5d50 con 0x7f631c109170 2024-09-10T22:35:32.357 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:32.354+0000 7f632352b740 1 Processor -- start 2024-09-10T22:35:32.358 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:32.354+0000 7f6303fff640 1 -- 172.21.15.19:0/3477557211 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 18) ==== 153250+0+0 (secure 0 0 0) 0x7f6314003970 con 0x7f631c109170 2024-09-10T22:35:32.358 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:32.354+0000 7f632352b740 1 -- start start 2024-09-10T22:35:32.358 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:32.355+0000 7f632352b740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55563b7ad0f0 0x55563b7ad4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:35:32.358 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:32.355+0000 7f632352b740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55563b7ada10 0x55563b7b9460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:35:32.358 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:32.355+0000 7f632352b740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55563b7b99a0 0x55563b7bbd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:35:32.358 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:32.355+0000 7f632352b740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x55563b723ea0 con 0x55563b7b99a0 2024-09-10T22:35:32.358 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:32.355+0000 7f632352b740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55563b7132d0 con 0x55563b7ad0f0 2024-09-10T22:35:32.358 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:32.355+0000 7f632352b740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x55563b7170e0 con 0x55563b7ada10 2024-09-10T22:35:32.358 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:32.355+0000 7f631ad9d640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55563b7ada10 0x55563b7b9460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:35:32.358 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:32.355+0000 7f631ad9d640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55563b7ada10 0x55563b7b9460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.19:43712/0 (socket says 172.21.15.19:43712) 2024-09-10T22:35:32.358 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:32.355+0000 7f631ad9d640 1 -- 172.21.15.19:0/1299922665 learned_addr learned my addr 172.21.15.19:0/1299922665 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:35:32.358 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:32.355+0000 7f631a59c640 1 --2- 172.21.15.19:0/1299922665 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55563b7b99a0 0x55563b7bbd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:35:32.359 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:32.355+0000 7f631a59c640 1 --2- 172.21.15.19:0/1299922665 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55563b7ad0f0 0x55563b7ad4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:35:32.359 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:32.355+0000 7f631ad9d640 1 -- 172.21.15.19:0/1299922665 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55563b7ad0f0 msgr2=0x55563b7ad4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:35:32.359 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:32.355+0000 7f631ad9d640 1 --2- 172.21.15.19:0/1299922665 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55563b7ad0f0 0x55563b7ad4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:35:32.359 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:32.355+0000 7f6303fff640 1 --2- 172.21.15.19:0/3477557211 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f63040b52e0 0x7f63040b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:35:32.359 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:32.356+0000 7f631ad9d640 1 -- 172.21.15.19:0/1299922665 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55563b7b99a0 msgr2=0x55563b7bbd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:35:32.359 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:32.356+0000 7f631b59e640 1 --2- 172.21.15.19:0/3477557211 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f63040b52e0 0x7f63040b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:35:32.359 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:32.356+0000 7f6303fff640 1 -- 172.21.15.19:0/3477557211 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8327+0+0 (secure 0 0 0) 0x7f63140e5920 con 0x7f631c109170 2024-09-10T22:35:32.359 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:32.356+0000 7f631ad9d640 1 --2- 172.21.15.19:0/1299922665 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55563b7b99a0 0x55563b7bbd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:35:32.359 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:32.356+0000 7f631ad9d640 1 -- 172.21.15.19:0/1299922665 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55563b471650 con 0x55563b7ada10 2024-09-10T22:35:32.359 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:32.356+0000 7f631b59e640 1 --2- 172.21.15.19:0/3477557211 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f63040b52e0 0x7f63040b77a0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f631400dfd0 tx=0x7f6314004480 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:35:32.359 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:32.356+0000 7f631a59c640 1 --2- 172.21.15.19:0/1299922665 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55563b7b99a0 0x55563b7bbd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T22:35:32.360 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:35:32 smithi135 ceph-mon[34789]: pgmap v620: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 302 KiB/s rd, 232 MiB/s wr, 1.22k op/s 2024-09-10T22:35:32.363 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:32.357+0000 7f631ad9d640 1 --2- 172.21.15.19:0/1299922665 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55563b7ada10 0x55563b7b9460 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f630c000c00 tx=0x7f630c004170 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4253937d70a2e3c3 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:35:32.363 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:32.357+0000 7f63017fa640 1 -- 172.21.15.19:0/1299922665 <== mon.1 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f630c035040 con 0x55563b7ada10 2024-09-10T22:35:32.363 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:32.357+0000 7f63017fa640 1 -- 172.21.15.19:0/1299922665 <== mon.1 v2:172.21.15.138:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f630c0054f0 con 0x55563b7ada10 2024-09-10T22:35:32.363 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:32.357+0000 7f63017fa640 1 -- 172.21.15.19:0/1299922665 <== mon.1 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f630c0035f0 con 0x55563b7ada10 2024-09-10T22:35:32.363 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:32.358+0000 7f632352b740 1 -- 172.21.15.19:0/1299922665 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55563b7ada10 msgr2=0x55563b7b9460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:35:32.363 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:32.358+0000 7f632352b740 1 --2- 172.21.15.19:0/1299922665 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55563b7ada10 0x55563b7b9460 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f630c000c00 tx=0x7f630c004170 comp rx=0 tx=0).stop 2024-09-10T22:35:32.363 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:32.358+0000 7f632352b740 1 -- 172.21.15.19:0/1299922665 shutdown_connections 2024-09-10T22:35:32.363 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:32.358+0000 7f632352b740 1 --2- 172.21.15.19:0/1299922665 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55563b7b99a0 0x55563b7bbd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:35:32.363 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:32.358+0000 7f632352b740 1 --2- 172.21.15.19:0/1299922665 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55563b7ada10 0x55563b7b9460 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:35:32.363 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:32.358+0000 7f632352b740 1 --2- 172.21.15.19:0/1299922665 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55563b7ad0f0 0x55563b7ad4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:35:32.363 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:32.358+0000 7f632352b740 1 -- 172.21.15.19:0/1299922665 >> 172.21.15.19:0/1299922665 conn(0x55563b7aaf20 msgr2=0x55563b7ac0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:35:32.364 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:32.358+0000 7f632352b740 1 -- 172.21.15.19:0/1299922665 shutdown_connections 2024-09-10T22:35:32.364 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:32.358+0000 7f632352b740 1 -- 172.21.15.19:0/1299922665 wait complete. 2024-09-10T22:35:32.364 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:32.358+0000 7f632352b740 1 -- start start 2024-09-10T22:35:32.364 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:32.358+0000 7f632352b740 1 Processor -- start 2024-09-10T22:35:32.364 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:32.359+0000 7f632352b740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55563b7ad0f0 0x55563b7b8eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:35:32.364 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:32.359+0000 7f632352b740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55563b7ada10 0x55563b7b9450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:35:32.364 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:32.359+0000 7f632352b740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55563b7b99a0 0x55563b7b2530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:35:32.364 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:32.359+0000 7f632352b740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x55563b574700 con 0x55563b7b99a0 2024-09-10T22:35:32.364 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:32.359+0000 7f632352b740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55563b6ae160 con 0x55563b7ada10 2024-09-10T22:35:32.364 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:32.359+0000 7f632352b740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x55563b7c09d0 con 0x55563b7ad0f0 2024-09-10T22:35:32.364 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:32.359+0000 7f632352b740 10 client.0 _ll_register_callbacks cb 0x55563b6c79e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T22:35:32.364 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:32.359+0000 7f631a59c640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55563b7ad0f0 0x55563b7b8eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:35:32.364 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:32.359+0000 7f631ad9d640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55563b7ada10 0x55563b7b9450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:35:32.365 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:32.359+0000 7f631a59c640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55563b7ad0f0 0x55563b7b8eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.19:43716/0 (socket says 172.21.15.19:43716) 2024-09-10T22:35:32.365 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:32.359+0000 7f631ad9d640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55563b7ada10 0x55563b7b9450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.19:60100/0 (socket says 172.21.15.19:60100) 2024-09-10T22:35:32.365 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:32.359+0000 7f631a59c640 1 -- 172.21.15.19:0/1679056075 learned_addr learned my addr 172.21.15.19:0/1679056075 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:35:32.365 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:32.359+0000 7f631a59c640 1 --2- 172.21.15.19:0/1679056075 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55563b7b99a0 0x55563b7b2530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:35:32.365 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:32.359+0000 7f631ad9d640 1 -- 172.21.15.19:0/1679056075 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55563b7ad0f0 msgr2=0x55563b7b8eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:35:32.365 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:32.359+0000 7f631ad9d640 1 --2- 172.21.15.19:0/1679056075 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55563b7ad0f0 0x55563b7b8eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:35:32.365 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:32.359+0000 7f631ad9d640 1 -- 172.21.15.19:0/1679056075 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55563b7b99a0 msgr2=0x55563b7b2530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:35:32.365 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:32.359+0000 7f631ad9d640 1 --2- 172.21.15.19:0/1679056075 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55563b7b99a0 0x55563b7b2530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:35:32.365 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:32.359+0000 7f631ad9d640 1 -- 172.21.15.19:0/1679056075 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55563b6dbc90 con 0x55563b7ada10 2024-09-10T22:35:32.365 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:32.360+0000 7f631ad9d640 1 --2- 172.21.15.19:0/1679056075 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55563b7ada10 0x55563b7b9450 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f630c005ab0 tx=0x7f630c0045d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=246536c3d04887a4 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:35:32.365 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:32.360+0000 7f62feff5640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-09-10T22:35:32.365 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:32.360+0000 7f62feff5640 1 -- 172.21.15.19:0/1679056075 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f630c035040 con 0x55563b7ada10 2024-09-10T22:35:32.365 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:32.360+0000 7f632352b740 1 -- 172.21.15.19:0/1679056075 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f630c0054f0 con 0x55563b7ada10 2024-09-10T22:35:32.365 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:32.360+0000 7f62feff5640 1 -- 172.21.15.19:0/1679056075 <== mon.2 v2:172.21.15.135:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8327+0+0 (secure 0 0 0) 0x7f630c004e70 con 0x55563b7ada10 2024-09-10T22:35:32.366 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:32.360+0000 7f62feff5640 1 -- 172.21.15.19:0/1679056075 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f630c009520 con 0x55563b7ada10 2024-09-10T22:35:32.366 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:32.360+0000 7f632352b740 10 client.26486 fetch_fsmap learned FSMap version 27 2024-09-10T22:35:32.366 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:32.360+0000 7f632352b740 1 -- 172.21.15.19:0/1679056075 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55563b7d0720 con 0x55563b7ada10 2024-09-10T22:35:32.366 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:32.360+0000 7f62feff5640 1 -- 172.21.15.19:0/1679056075 <== mon.2 v2:172.21.15.135:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f630c0054f0 con 0x55563b7ada10 2024-09-10T22:35:32.366 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:32.360+0000 7f62feff5640 1 -- 172.21.15.19:0/1679056075 <== mon.2 v2:172.21.15.135:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7f630c04c070 con 0x55563b7ada10 2024-09-10T22:35:32.366 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:32.360+0000 7f632352b740 10 client.26486 fetch_fsmap finished waiting for FSMap version 27 2024-09-10T22:35:32.366 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:32.360+0000 7f632352b740 10 client.26486 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-10T22:35:32.366 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:32.360+0000 7f632352b740 20 client.26486 populate_metadata read hostname 'smithi019' 2024-09-10T22:35:32.366 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:32.360+0000 7f632352b740 1 --2- 172.21.15.19:0/1679056075 >> [v2:172.21.15.138:6836/3353290042,v1:172.21.15.138:6837/3353290042] conn(0x55563b7d1a70 0x55563b7d3e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:35:32.366 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:32.360+0000 7f632352b740 4 client.26486 mds_command: new command op to 24553 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T22:35:32.366 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:32.360+0000 7f632352b740 1 -- 172.21.15.19:0/1679056075 --> [v2:172.21.15.138:6836/3353290042,v1:172.21.15.138:6837/3353290042] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55563b725df0 con 0x55563b7d1a70 2024-09-10T22:35:32.366 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:32.361+0000 7f631a59c640 1 --2- 172.21.15.19:0/1679056075 >> [v2:172.21.15.138:6836/3353290042,v1:172.21.15.138:6837/3353290042] conn(0x55563b7d1a70 0x55563b7d3e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:35:32.366 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:32.361+0000 7f62feff5640 10 client.26486 ms_handle_connect on v2:172.21.15.138:6836/3353290042 2024-09-10T22:35:32.367 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:32.361+0000 7f631a59c640 1 --2- 172.21.15.19:0/1679056075 >> [v2:172.21.15.138:6836/3353290042,v1:172.21.15.138:6837/3353290042] conn(0x55563b7d1a70 0x55563b7d3e60 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=40caa185eb3b4a25 server_cookie=6e2260a96d6866b6 in_seq=0 out_seq=0 2024-09-10T22:35:32.368 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:32.362+0000 7f62feff5640 1 -- 172.21.15.19:0/1679056075 <== mds.2 v2:172.21.15.138:6836/3353290042 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55563b725df0 con 0x55563b7d1a70 2024-09-10T22:35:32.368 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:32.362+0000 7f62feff5640 10 client.26486 handle_command_reply: tid=0 2024-09-10T22:35:32.368 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:32.362+0000 7f632352b740 1 client.26486 shutdown 2024-09-10T22:35:32.368 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:32.363+0000 7f632352b740 1 -- 172.21.15.19:0/1679056075 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55563b7ada10 msgr2=0x55563b7b9450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:35:32.368 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:32.363+0000 7f632352b740 1 --2- 172.21.15.19:0/1679056075 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55563b7ada10 0x55563b7b9450 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f630c005ab0 tx=0x7f630c0045d0 comp rx=0 tx=0).stop 2024-09-10T22:35:32.368 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:32.363+0000 7f632352b740 1 -- 172.21.15.19:0/1679056075 shutdown_connections 2024-09-10T22:35:32.368 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:32.363+0000 7f632352b740 1 --2- 172.21.15.19:0/1679056075 >> [v2:172.21.15.138:6836/3353290042,v1:172.21.15.138:6837/3353290042] conn(0x55563b7d1a70 0x55563b7d3e60 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:35:32.368 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:32.363+0000 7f632352b740 1 --2- 172.21.15.19:0/1679056075 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55563b7b99a0 0x55563b7b2530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:35:32.368 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:32.363+0000 7f632352b740 1 --2- 172.21.15.19:0/1679056075 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55563b7ada10 0x55563b7b9450 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:35:32.369 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:32.363+0000 7f632352b740 1 --2- 172.21.15.19:0/1679056075 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55563b7ad0f0 0x55563b7b8eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:35:32.369 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:32.363+0000 7f62feff5640 0 client.26486 ms_handle_reset on v2:172.21.15.138:6836/3353290042 2024-09-10T22:35:32.369 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:32.363+0000 7f632352b740 1 -- 172.21.15.19:0/1679056075 >> 172.21.15.19:0/1679056075 conn(0x55563b7aaf20 msgr2=0x55563b7b0a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:35:32.369 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:32.363+0000 7f632352b740 1 -- 172.21.15.19:0/1679056075 shutdown_connections 2024-09-10T22:35:32.369 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:32.363+0000 7f632352b740 1 -- 172.21.15.19:0/1679056075 wait complete. 2024-09-10T22:35:32.369 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:32.363+0000 7f632352b740 20 client.26486 trim_cache size 0 max 16384 2024-09-10T22:35:32.375 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:35:32 smithi138 ceph-mon[35236]: pgmap v620: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 302 KiB/s rd, 232 MiB/s wr, 1.22k op/s 2024-09-10T22:35:32.379 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:32.377+0000 7f632352b740 1 Processor -- start 2024-09-10T22:35:32.379 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:32.377+0000 7f632352b740 1 -- start start 2024-09-10T22:35:32.379 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:32.377+0000 7f632352b740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55563b7ad0f0 0x55563b7abc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:35:32.379 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:32.377+0000 7f632352b740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55563b7ada10 0x55563b7ac140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:35:32.379 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:32.377+0000 7f632352b740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55563b7b99a0 0x55563b7bad90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:35:32.379 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:32.377+0000 7f632352b740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f631c1aec10 con 0x55563b7b99a0 2024-09-10T22:35:32.380 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:32.377+0000 7f632352b740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f631c1ac4e0 con 0x55563b7ad0f0 2024-09-10T22:35:32.380 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:32.377+0000 7f632352b740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f631c1aa330 con 0x55563b7ada10 2024-09-10T22:35:32.380 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:32.378+0000 7f631ad9d640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55563b7ada10 0x55563b7ac140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:35:32.380 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:32.378+0000 7f631a59c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55563b7b99a0 0x55563b7bad90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:35:32.380 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:32.378+0000 7f631ad9d640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55563b7ada10 0x55563b7ac140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.19:43722/0 (socket says 172.21.15.19:43722) 2024-09-10T22:35:32.380 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:32.378+0000 7f631ad9d640 1 -- 172.21.15.19:0/3722566222 learned_addr learned my addr 172.21.15.19:0/3722566222 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:35:32.380 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:32.378+0000 7f631a59c640 1 --2- 172.21.15.19:0/3722566222 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55563b7ad0f0 0x55563b7abc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:35:32.382 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:32.378+0000 7f631ad9d640 1 -- 172.21.15.19:0/3722566222 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55563b7ad0f0 msgr2=0x55563b7abc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:35:32.382 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:32.378+0000 7f631ad9d640 1 --2- 172.21.15.19:0/3722566222 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55563b7ad0f0 0x55563b7abc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:35:32.382 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:32.378+0000 7f631ad9d640 1 -- 172.21.15.19:0/3722566222 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55563b7b99a0 msgr2=0x55563b7bad90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:35:32.382 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:32.378+0000 7f631ad9d640 1 --2- 172.21.15.19:0/3722566222 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55563b7b99a0 0x55563b7bad90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:35:32.382 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:32.378+0000 7f631ad9d640 1 -- 172.21.15.19:0/3722566222 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55563b7ad840 con 0x55563b7ada10 2024-09-10T22:35:32.382 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:32.378+0000 7f631ad9d640 1 --2- 172.21.15.19:0/3722566222 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55563b7ada10 0x55563b7ac140 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f630c009230 tx=0x7f630c005fd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6e49356f57833a1a server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:35:32.382 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:32.378+0000 7f6300ff9640 1 -- 172.21.15.19:0/3722566222 <== mon.1 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f630c035040 con 0x55563b7ada10 2024-09-10T22:35:32.382 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:32.379+0000 7f6300ff9640 1 -- 172.21.15.19:0/3722566222 <== mon.1 v2:172.21.15.138:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f630c031cc0 con 0x55563b7ada10 2024-09-10T22:35:32.382 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:32.379+0000 7f6300ff9640 1 -- 172.21.15.19:0/3722566222 <== mon.1 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f630c003be0 con 0x55563b7ada10 2024-09-10T22:35:32.382 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:32.379+0000 7f632352b740 1 -- 172.21.15.19:0/3722566222 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55563b7ada10 msgr2=0x55563b7ac140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:35:32.382 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:32.379+0000 7f632352b740 1 --2- 172.21.15.19:0/3722566222 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55563b7ada10 0x55563b7ac140 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f630c009230 tx=0x7f630c005fd0 comp rx=0 tx=0).stop 2024-09-10T22:35:32.382 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:32.379+0000 7f632352b740 1 -- 172.21.15.19:0/3722566222 shutdown_connections 2024-09-10T22:35:32.383 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:32.379+0000 7f632352b740 1 --2- 172.21.15.19:0/3722566222 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55563b7b99a0 0x55563b7bad90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:35:32.383 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:32.379+0000 7f632352b740 1 --2- 172.21.15.19:0/3722566222 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55563b7ada10 0x55563b7ac140 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:35:32.383 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:32.379+0000 7f632352b740 1 --2- 172.21.15.19:0/3722566222 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55563b7ad0f0 0x55563b7abc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:35:32.383 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:32.380+0000 7f632352b740 1 -- 172.21.15.19:0/3722566222 >> 172.21.15.19:0/3722566222 conn(0x55563b7aaf20 msgr2=0x55563b7b8eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:35:32.383 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:32.380+0000 7f632352b740 1 -- 172.21.15.19:0/3722566222 shutdown_connections 2024-09-10T22:35:32.383 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:32.380+0000 7f632352b740 1 -- 172.21.15.19:0/3722566222 wait complete. 2024-09-10T22:35:32.383 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:32.380+0000 7f632352b740 1 -- start start 2024-09-10T22:35:32.383 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:32.380+0000 7f632352b740 1 Processor -- start 2024-09-10T22:35:32.386 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:32.381+0000 7f632352b740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55563b7ad0f0 0x55563b7cac10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:35:32.386 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:32.381+0000 7f632352b740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55563b7ada10 0x55563b7cb150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:35:32.386 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:32.381+0000 7f632352b740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55563b7b99a0 0x55563b83d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:35:32.386 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:32.381+0000 7f632352b740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f631c1aa9a0 con 0x55563b7ada10 2024-09-10T22:35:32.387 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:32.381+0000 7f632352b740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f631c1abe10 con 0x55563b7b99a0 2024-09-10T22:35:32.387 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:32.381+0000 7f632352b740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f631c1ab070 con 0x55563b7ad0f0 2024-09-10T22:35:32.387 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:32.381+0000 7f632352b740 10 client.0 _ll_register_callbacks cb 0x7f6310009c00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T22:35:32.387 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:32.381+0000 7f631a59c640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55563b7ad0f0 0x55563b7cac10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:35:32.387 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:32.381+0000 7f631ad9d640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55563b7ada10 0x55563b7cb150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:35:32.387 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:32.381+0000 7f631a59c640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55563b7ad0f0 0x55563b7cac10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.19:43728/0 (socket says 172.21.15.19:43728) 2024-09-10T22:35:32.387 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:32.381+0000 7f631a59c640 1 -- 172.21.15.19:0/2170256352 learned_addr learned my addr 172.21.15.19:0/2170256352 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:35:32.387 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:32.381+0000 7f631a59c640 1 --2- 172.21.15.19:0/2170256352 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55563b7b99a0 0x55563b83d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:35:32.387 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:32.381+0000 7f631a59c640 1 -- 172.21.15.19:0/2170256352 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55563b7b99a0 msgr2=0x55563b83d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:35:32.387 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:32.381+0000 7f631a59c640 1 --2- 172.21.15.19:0/2170256352 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55563b7b99a0 0x55563b83d5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:35:32.387 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:32.381+0000 7f631a59c640 1 -- 172.21.15.19:0/2170256352 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55563b7ada10 msgr2=0x55563b7cb150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:35:32.387 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:32.381+0000 7f631a59c640 1 --2- 172.21.15.19:0/2170256352 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55563b7ada10 0x55563b7cb150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:35:32.387 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:32.381+0000 7f631a59c640 1 -- 172.21.15.19:0/2170256352 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55563b83db90 con 0x55563b7ad0f0 2024-09-10T22:35:32.388 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:32.382+0000 7f631a59c640 1 --2- 172.21.15.19:0/2170256352 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55563b7ad0f0 0x55563b7cac10 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f6310013430 tx=0x7f6310004730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=74b66753139b16f4 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:35:32.388 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:32.382+0000 7f62feff5640 10 client.0 ms_handle_connect on v2:172.21.15.138:3300/0 2024-09-10T22:35:32.388 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:32.382+0000 7f62feff5640 1 -- 172.21.15.19:0/2170256352 <== mon.1 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f631001c040 con 0x55563b7ad0f0 2024-09-10T22:35:32.388 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:32.382+0000 7f62feff5640 1 -- 172.21.15.19:0/2170256352 <== mon.1 v2:172.21.15.138:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8327+0+0 (secure 0 0 0) 0x7f6310014aa0 con 0x55563b7ad0f0 2024-09-10T22:35:32.388 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:32.382+0000 7f632352b740 1 -- 172.21.15.19:0/2170256352 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f630c031cc0 con 0x55563b7ad0f0 2024-09-10T22:35:32.388 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:32.382+0000 7f62feff5640 1 -- 172.21.15.19:0/2170256352 <== mon.1 v2:172.21.15.138:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f6310014ca0 con 0x55563b7ad0f0 2024-09-10T22:35:32.388 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:32.382+0000 7f632352b740 10 client.26524 fetch_fsmap learned FSMap version 27 2024-09-10T22:35:32.388 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:32.382+0000 7f632352b740 1 -- 172.21.15.19:0/2170256352 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55563b83ee90 con 0x55563b7ad0f0 2024-09-10T22:35:32.388 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:32.382+0000 7f62feff5640 1 -- 172.21.15.19:0/2170256352 <== mon.1 v2:172.21.15.138:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f630c031cc0 con 0x55563b7ad0f0 2024-09-10T22:35:32.388 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:32.382+0000 7f62feff5640 1 -- 172.21.15.19:0/2170256352 <== mon.1 v2:172.21.15.138:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7f6310034020 con 0x55563b7ad0f0 2024-09-10T22:35:32.388 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:32.382+0000 7f632352b740 10 client.26524 fetch_fsmap finished waiting for FSMap version 27 2024-09-10T22:35:32.388 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:32.382+0000 7f632352b740 10 client.26524 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-10T22:35:32.388 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:32.382+0000 7f632352b740 20 client.26524 populate_metadata read hostname 'smithi019' 2024-09-10T22:35:32.389 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:32.382+0000 7f632352b740 1 --2- 172.21.15.19:0/2170256352 >> [v2:172.21.15.138:6836/3353290042,v1:172.21.15.138:6837/3353290042] conn(0x55563b83f640 0x55563b841a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:35:32.389 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:32.383+0000 7f632352b740 4 client.26524 mds_command: new command op to 24553 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-10T22:35:32.389 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:32.383+0000 7f632352b740 1 -- 172.21.15.19:0/2170256352 --> [v2:172.21.15.138:6836/3353290042,v1:172.21.15.138:6837/3353290042] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55563b7218a0 con 0x55563b83f640 2024-09-10T22:35:32.389 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:32.383+0000 7f631ad9d640 1 --2- 172.21.15.19:0/2170256352 >> [v2:172.21.15.138:6836/3353290042,v1:172.21.15.138:6837/3353290042] conn(0x55563b83f640 0x55563b841a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:35:32.389 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:32.383+0000 7f62feff5640 10 client.26524 ms_handle_connect on v2:172.21.15.138:6836/3353290042 2024-09-10T22:35:32.389 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:32.383+0000 7f631ad9d640 1 --2- 172.21.15.19:0/2170256352 >> [v2:172.21.15.138:6836/3353290042,v1:172.21.15.138:6837/3353290042] conn(0x55563b83f640 0x55563b841a60 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=5186c0ae058e1685 server_cookie=62435429db893d88 in_seq=0 out_seq=0 2024-09-10T22:35:32.389 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:32.383+0000 7f62feff5640 1 -- 172.21.15.19:0/2170256352 <== mds.2 v2:172.21.15.138:6836/3353290042 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55563b7218a0 con 0x55563b83f640 2024-09-10T22:35:32.389 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:32.383+0000 7f62feff5640 10 client.26524 handle_command_reply: tid=0 2024-09-10T22:35:32.389 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:32.383+0000 7f632352b740 1 client.26524 shutdown 2024-09-10T22:35:32.389 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:32.384+0000 7f632352b740 1 -- 172.21.15.19:0/2170256352 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55563b7ad0f0 msgr2=0x55563b7cac10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:35:32.389 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:32.384+0000 7f632352b740 1 --2- 172.21.15.19:0/2170256352 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55563b7ad0f0 0x55563b7cac10 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f6310013430 tx=0x7f6310004730 comp rx=0 tx=0).stop 2024-09-10T22:35:32.389 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:32.384+0000 7f632352b740 1 -- 172.21.15.19:0/2170256352 shutdown_connections 2024-09-10T22:35:32.389 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:32.384+0000 7f632352b740 1 --2- 172.21.15.19:0/2170256352 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55563b7b99a0 0x55563b83d5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:35:32.390 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:32.384+0000 7f632352b740 1 --2- 172.21.15.19:0/2170256352 >> [v2:172.21.15.138:6836/3353290042,v1:172.21.15.138:6837/3353290042] conn(0x55563b83f640 0x55563b841a60 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:35:32.390 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:32.384+0000 7f632352b740 1 --2- 172.21.15.19:0/2170256352 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55563b7ada10 0x55563b7cb150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:35:32.390 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:32.384+0000 7f632352b740 1 --2- 172.21.15.19:0/2170256352 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55563b7ad0f0 0x55563b7cac10 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:35:32.390 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:32.384+0000 7f632352b740 1 -- 172.21.15.19:0/2170256352 >> 172.21.15.19:0/2170256352 conn(0x55563b7aaf20 msgr2=0x55563b7abc00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:35:32.390 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:32.384+0000 7f62feff5640 0 client.26524 ms_handle_reset on v2:172.21.15.138:6836/3353290042 2024-09-10T22:35:32.390 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:32.384+0000 7f632352b740 1 -- 172.21.15.19:0/2170256352 shutdown_connections 2024-09-10T22:35:32.390 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:32.384+0000 7f632352b740 1 -- 172.21.15.19:0/2170256352 wait complete. 2024-09-10T22:35:32.390 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:32.384+0000 7f632352b740 20 client.26524 trim_cache size 0 max 16384 2024-09-10T22:35:32.390 INFO:teuthology.orchestra.run.smithi019.stdout:[] 2024-09-10T22:35:32.391 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:32.385+0000 7f6321156640 1 -- 172.21.15.19:0/3477557211 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f63040b52e0 msgr2=0x7f63040b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:35:32.391 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:32.385+0000 7f6321156640 1 --2- 172.21.15.19:0/3477557211 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f63040b52e0 0x7f63040b77a0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f631400dfd0 tx=0x7f6314004480 comp rx=0 tx=0).stop 2024-09-10T22:35:32.391 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:32.385+0000 7f6321156640 1 -- 172.21.15.19:0/3477557211 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f631c109170 msgr2=0x7f631c19ebd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:35:32.391 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:32.385+0000 7f6321156640 1 --2- 172.21.15.19:0/3477557211 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f631c109170 0x7f631c19ebd0 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7f6314009fd0 tx=0x7f631400b260 comp rx=0 tx=0).stop 2024-09-10T22:35:32.391 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:32.385+0000 7f6321156640 1 -- 172.21.15.19:0/3477557211 shutdown_connections 2024-09-10T22:35:32.391 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:32.385+0000 7f6321156640 1 --2- 172.21.15.19:0/3477557211 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f63040b52e0 0x7f63040b77a0 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:35:32.392 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:32.385+0000 7f6321156640 1 --2- 172.21.15.19:0/3477557211 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f631c109170 0x7f631c19ebd0 unknown :-1 s=CLOSED pgs=773 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:35:32.392 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:32.385+0000 7f6321156640 1 --2- 172.21.15.19:0/3477557211 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f631c1087f0 0x7f631c199830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:35:32.392 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:32.385+0000 7f6321156640 1 --2- 172.21.15.19:0/3477557211 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f631c102de0 0x7f631c1992f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:35:32.392 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:32.385+0000 7f6321156640 1 -- 172.21.15.19:0/3477557211 >> 172.21.15.19:0/3477557211 conn(0x7f631c0fe830 msgr2=0x7f631c100c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:35:32.392 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:32.385+0000 7f6321156640 1 -- 172.21.15.19:0/3477557211 shutdown_connections 2024-09-10T22:35:32.392 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:32.385+0000 7f6321156640 1 -- 172.21.15.19:0/3477557211 wait complete. 2024-09-10T22:35:33.400 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 22997a4c-6fc2-11ef-bcea-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-09-10T22:35:33.776 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/22997a4c-6fc2-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T22:35:34.208 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:35:34 smithi019 ceph-mon[31375]: pgmap v621: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 302 KiB/s rd, 210 MiB/s wr, 1.02k op/s 2024-09-10T22:35:34.360 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:35:34 smithi135 ceph-mon[34789]: pgmap v621: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 302 KiB/s rd, 210 MiB/s wr, 1.02k op/s 2024-09-10T22:35:34.375 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:35:34 smithi138 ceph-mon[35236]: pgmap v621: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 302 KiB/s rd, 210 MiB/s wr, 1.02k op/s 2024-09-10T22:35:34.610 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:34.608+0000 7f1bf42c6640 1 -- 172.21.15.19:0/3456348977 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1bec103cd0 msgr2=0x7f1bec1040b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:35:34.610 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:34.608+0000 7f1bf42c6640 1 --2- 172.21.15.19:0/3456348977 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1bec103cd0 0x7f1bec1040b0 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x7f1be8009900 tx=0x7f1be802a410 comp rx=0 tx=0).stop 2024-09-10T22:35:34.610 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:34.608+0000 7f1bf42c6640 1 -- 172.21.15.19:0/3456348977 shutdown_connections 2024-09-10T22:35:34.610 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:34.608+0000 7f1bf42c6640 1 --2- 172.21.15.19:0/3456348977 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f1bec10d130 0x7f1bec10f590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:35:34.611 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:34.608+0000 7f1bf42c6640 1 --2- 172.21.15.19:0/3456348977 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1bec1045f0 0x7f1bec10cae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:35:34.611 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:34.608+0000 7f1bf42c6640 1 --2- 172.21.15.19:0/3456348977 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1bec103cd0 0x7f1bec1040b0 unknown :-1 s=CLOSED pgs=774 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:35:34.611 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:34.608+0000 7f1bf42c6640 1 -- 172.21.15.19:0/3456348977 >> 172.21.15.19:0/3456348977 conn(0x7f1bec0fd770 msgr2=0x7f1bec0ffb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:35:34.611 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:34.608+0000 7f1bf42c6640 1 -- 172.21.15.19:0/3456348977 shutdown_connections 2024-09-10T22:35:34.611 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:34.608+0000 7f1bf42c6640 1 -- 172.21.15.19:0/3456348977 wait complete. 2024-09-10T22:35:34.611 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:34.609+0000 7f1bf42c6640 1 Processor -- start 2024-09-10T22:35:34.611 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:34.609+0000 7f1bf42c6640 1 -- start start 2024-09-10T22:35:34.613 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:34.609+0000 7f1bf42c6640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f1bec103cd0 0x7f1bec101980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:35:34.613 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:34.609+0000 7f1bf42c6640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1bec1045f0 0x7f1bec101ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:35:34.613 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:34.609+0000 7f1bf42c6640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1bec10d130 0x7f1bec102400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:35:34.613 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:34.609+0000 7f1bf42c6640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f1bec112da0 con 0x7f1bec1045f0 2024-09-10T22:35:34.613 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:34.609+0000 7f1bf42c6640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f1bec112c20 con 0x7f1bec10d130 2024-09-10T22:35:34.613 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:34.609+0000 7f1bf42c6640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f1bec112f20 con 0x7f1bec103cd0 2024-09-10T22:35:34.613 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:34.609+0000 7f1bf1861640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1bec1045f0 0x7f1bec101ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:35:34.613 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:34.609+0000 7f1bf1861640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1bec1045f0 0x7f1bec101ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:57174/0 (socket says 172.21.15.19:57174) 2024-09-10T22:35:34.613 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:34.609+0000 7f1bf1861640 1 -- 172.21.15.19:0/599784790 learned_addr learned my addr 172.21.15.19:0/599784790 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:35:34.613 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:34.609+0000 7f1bf2863640 1 --2- 172.21.15.19:0/599784790 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1bec10d130 0x7f1bec102400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:35:34.613 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:34.610+0000 7f1bf2062640 1 --2- 172.21.15.19:0/599784790 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f1bec103cd0 0x7f1bec101980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:35:34.614 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:34.610+0000 7f1bf2863640 1 -- 172.21.15.19:0/599784790 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f1bec103cd0 msgr2=0x7f1bec101980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:35:34.614 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:34.610+0000 7f1bf2863640 1 --2- 172.21.15.19:0/599784790 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f1bec103cd0 0x7f1bec101980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:35:34.614 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:34.610+0000 7f1bf2863640 1 -- 172.21.15.19:0/599784790 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1bec1045f0 msgr2=0x7f1bec101ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:35:34.614 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:34.610+0000 7f1bf2863640 1 --2- 172.21.15.19:0/599784790 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1bec1045f0 0x7f1bec101ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:35:34.614 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:34.610+0000 7f1bf2863640 1 -- 172.21.15.19:0/599784790 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1bec1a76b0 con 0x7f1bec10d130 2024-09-10T22:35:34.614 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:34.610+0000 7f1bf1861640 1 --2- 172.21.15.19:0/599784790 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1bec1045f0 0x7f1bec101ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T22:35:34.614 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:34.610+0000 7f1bf2863640 1 --2- 172.21.15.19:0/599784790 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1bec10d130 0x7f1bec102400 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f1be4009fd0 tx=0x7f1be400ef10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:35:34.614 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:34.610+0000 7f1be37fe640 1 -- 172.21.15.19:0/599784790 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1be400ce20 con 0x7f1bec10d130 2024-09-10T22:35:34.614 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:34.610+0000 7f1be37fe640 1 -- 172.21.15.19:0/599784790 <== mon.2 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1be4005020 con 0x7f1bec10d130 2024-09-10T22:35:34.614 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:34.610+0000 7f1be37fe640 1 -- 172.21.15.19:0/599784790 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1be4010690 con 0x7f1bec10d130 2024-09-10T22:35:34.614 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:34.610+0000 7f1bf42c6640 1 -- 172.21.15.19:0/599784790 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1bec1a79a0 con 0x7f1bec10d130 2024-09-10T22:35:34.614 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:34.611+0000 7f1bf42c6640 1 -- 172.21.15.19:0/599784790 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1bec1a7e90 con 0x7f1bec10d130 2024-09-10T22:35:34.616 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:34.614+0000 7f1be37fe640 1 -- 172.21.15.19:0/599784790 <== mon.2 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 18) ==== 153250+0+0 (secure 0 0 0) 0x7f1be40054d0 con 0x7f1bec10d130 2024-09-10T22:35:34.616 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:34.614+0000 7f1bf669b740 1 Processor -- start 2024-09-10T22:35:34.616 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:34.614+0000 7f1bf669b740 1 -- start start 2024-09-10T22:35:34.617 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:34.615+0000 7f1bf669b740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55cb884a84d0 0x55cb884a88b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:35:34.617 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:34.615+0000 7f1bf669b740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55cb884a8df0 0x55cb884b4840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:35:34.617 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:34.615+0000 7f1bf669b740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55cb884b4d80 0x55cb884b7170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:35:34.617 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:34.615+0000 7f1bf669b740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x55cb8841eea0 con 0x55cb884b4d80 2024-09-10T22:35:34.617 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:34.615+0000 7f1bf669b740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55cb8840e2d0 con 0x55cb884a8df0 2024-09-10T22:35:34.617 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:34.615+0000 7f1bf669b740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x55cb884120e0 con 0x55cb884a84d0 2024-09-10T22:35:34.617 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:34.615+0000 7f1bf2062640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55cb884a8df0 0x55cb884b4840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:35:34.617 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:34.615+0000 7f1bf1861640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55cb884a84d0 0x55cb884a88b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:35:34.617 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:34.615+0000 7f1bf2062640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55cb884a8df0 0x55cb884b4840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.19:54392/0 (socket says 172.21.15.19:54392) 2024-09-10T22:35:34.618 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:34.615+0000 7f1bf2062640 1 -- 172.21.15.19:0/3267909284 learned_addr learned my addr 172.21.15.19:0/3267909284 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:35:34.618 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:34.615+0000 7f1bf1861640 1 --2- 172.21.15.19:0/3267909284 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55cb884b4d80 0x55cb884b7170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:35:34.618 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:34.615+0000 7f1bf2062640 1 -- 172.21.15.19:0/3267909284 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55cb884a84d0 msgr2=0x55cb884a88b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:35:34.618 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:34.615+0000 7f1bf2062640 1 --2- 172.21.15.19:0/3267909284 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55cb884a84d0 0x55cb884a88b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:35:34.618 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:34.615+0000 7f1bf2062640 1 -- 172.21.15.19:0/3267909284 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55cb884b4d80 msgr2=0x55cb884b7170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:35:34.618 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:34.615+0000 7f1bf2062640 1 --2- 172.21.15.19:0/3267909284 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55cb884b4d80 0x55cb884b7170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:35:34.618 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:34.615+0000 7f1bf2062640 1 -- 172.21.15.19:0/3267909284 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cb8816c650 con 0x55cb884a8df0 2024-09-10T22:35:34.618 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:34.615+0000 7f1bf1861640 1 --2- 172.21.15.19:0/3267909284 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55cb884a84d0 0x55cb884a88b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T22:35:34.621 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:34.616+0000 7f1bf2062640 1 --2- 172.21.15.19:0/3267909284 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55cb884a8df0 0x55cb884b4840 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f1be8009900 tx=0x7f1be8032b20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2cbbe16b12a99b1d server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:35:34.621 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:34.616+0000 7f1be37fe640 1 --2- 172.21.15.19:0/599784790 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f1bd80b5360 0x7f1bd80b7820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:35:34.621 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:34.616+0000 7f1be0de6640 1 -- 172.21.15.19:0/3267909284 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1be8040070 con 0x55cb884a8df0 2024-09-10T22:35:34.621 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:34.616+0000 7f1be0de6640 1 -- 172.21.15.19:0/3267909284 <== mon.2 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1be8004030 con 0x55cb884a8df0 2024-09-10T22:35:34.621 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:34.616+0000 7f1be0de6640 1 -- 172.21.15.19:0/3267909284 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1be8035040 con 0x55cb884a8df0 2024-09-10T22:35:34.621 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:34.616+0000 7f1bf1861640 1 --2- 172.21.15.19:0/599784790 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f1bd80b5360 0x7f1bd80b7820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:35:34.621 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:34.616+0000 7f1be37fe640 1 -- 172.21.15.19:0/599784790 <== mon.2 v2:172.21.15.135:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8327+0+0 (secure 0 0 0) 0x7f1be40e6270 con 0x7f1bec10d130 2024-09-10T22:35:34.621 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:34.617+0000 7f1bf669b740 1 -- 172.21.15.19:0/3267909284 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55cb884a8df0 msgr2=0x55cb884b4840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:35:34.621 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:34.617+0000 7f1bf1861640 1 --2- 172.21.15.19:0/599784790 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f1bd80b5360 0x7f1bd80b7820 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f1bdc009fd0 tx=0x7f1bdc005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:35:34.622 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:34.617+0000 7f1bf669b740 1 --2- 172.21.15.19:0/3267909284 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55cb884a8df0 0x55cb884b4840 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f1be8009900 tx=0x7f1be8032b20 comp rx=0 tx=0).stop 2024-09-10T22:35:34.622 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:34.617+0000 7f1bf669b740 1 -- 172.21.15.19:0/3267909284 shutdown_connections 2024-09-10T22:35:34.622 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:34.617+0000 7f1bf669b740 1 --2- 172.21.15.19:0/3267909284 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55cb884b4d80 0x55cb884b7170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:35:34.622 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:34.617+0000 7f1bf669b740 1 --2- 172.21.15.19:0/3267909284 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55cb884a8df0 0x55cb884b4840 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:35:34.622 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:34.617+0000 7f1bf669b740 1 --2- 172.21.15.19:0/3267909284 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55cb884a84d0 0x55cb884a88b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:35:34.622 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:34.617+0000 7f1bf669b740 1 -- 172.21.15.19:0/3267909284 >> 172.21.15.19:0/3267909284 conn(0x55cb884a6300 msgr2=0x55cb884a74a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:35:34.622 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:34.617+0000 7f1bf669b740 1 -- 172.21.15.19:0/3267909284 shutdown_connections 2024-09-10T22:35:34.622 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:34.617+0000 7f1bf669b740 1 -- 172.21.15.19:0/3267909284 wait complete. 2024-09-10T22:35:34.622 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:34.618+0000 7f1bf669b740 1 -- start start 2024-09-10T22:35:34.622 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:34.618+0000 7f1bf669b740 1 Processor -- start 2024-09-10T22:35:34.622 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:34.618+0000 7f1bf669b740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55cb884a84d0 0x55cb884b4640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:35:34.622 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:34.618+0000 7f1bf669b740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55cb884a8df0 0x55cb884b1a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:35:34.622 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:34.618+0000 7f1bf669b740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55cb884b4d80 0x55cb884b2070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:35:34.623 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:34.618+0000 7f1bf669b740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x55cb8826f700 con 0x55cb884a8df0 2024-09-10T22:35:34.623 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:34.618+0000 7f1bf669b740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55cb883a9160 con 0x55cb884b4d80 2024-09-10T22:35:34.623 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:34.618+0000 7f1bf669b740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x55cb884b79a0 con 0x55cb884a84d0 2024-09-10T22:35:34.623 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:34.618+0000 7f1bf669b740 10 client.0 _ll_register_callbacks cb 0x55cb883c29e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T22:35:34.623 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:34.618+0000 7f1bf1861640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55cb884a8df0 0x55cb884b1a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:35:34.623 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:34.618+0000 7f1bf1861640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55cb884a8df0 0x55cb884b1a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:57200/0 (socket says 172.21.15.19:57200) 2024-09-10T22:35:34.624 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:34.618+0000 7f1bf1861640 1 -- 172.21.15.19:0/2377007794 learned_addr learned my addr 172.21.15.19:0/2377007794 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:35:34.624 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:34.618+0000 7f1bf2062640 1 --2- 172.21.15.19:0/2377007794 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55cb884a84d0 0x55cb884b4640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:35:34.624 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:34.619+0000 7f1bf2863640 1 --2- 172.21.15.19:0/2377007794 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55cb884b4d80 0x55cb884b2070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:35:34.624 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:34.619+0000 7f1bf1861640 1 -- 172.21.15.19:0/2377007794 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55cb884a84d0 msgr2=0x55cb884b4640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:35:34.624 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:34.619+0000 7f1bf1861640 1 --2- 172.21.15.19:0/2377007794 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55cb884a84d0 0x55cb884b4640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:35:34.624 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:34.619+0000 7f1bf1861640 1 -- 172.21.15.19:0/2377007794 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55cb884b4d80 msgr2=0x55cb884b2070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:35:34.624 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:34.619+0000 7f1bf1861640 1 --2- 172.21.15.19:0/2377007794 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55cb884b4d80 0x55cb884b2070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:35:34.624 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:34.619+0000 7f1bf1861640 1 -- 172.21.15.19:0/2377007794 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cb883d6c90 con 0x55cb884a8df0 2024-09-10T22:35:34.624 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:34.619+0000 7f1bf2062640 1 --2- 172.21.15.19:0/2377007794 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55cb884a84d0 0x55cb884b4640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T22:35:34.624 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:34.619+0000 7f1bf1861640 1 --2- 172.21.15.19:0/2377007794 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55cb884a8df0 0x55cb884b1a90 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 crypto rx=0x7f1bdc010e40 tx=0x7f1bdc004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c0e8225d0cb2dc3f server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:35:34.624 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:34.619+0000 7f1bd5ffb640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-10T22:35:34.624 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:34.619+0000 7f1bd5ffb640 1 -- 172.21.15.19:0/2377007794 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1bdc030060 con 0x55cb884a8df0 2024-09-10T22:35:34.625 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:34.619+0000 7f1bd5ffb640 1 -- 172.21.15.19:0/2377007794 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8327+0+0 (secure 0 0 0) 0x7f1bdc01a050 con 0x55cb884a8df0 2024-09-10T22:35:34.625 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:34.619+0000 7f1bf669b740 1 -- 172.21.15.19:0/2377007794 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1be8004030 con 0x55cb884a8df0 2024-09-10T22:35:34.625 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:34.619+0000 7f1bd5ffb640 1 -- 172.21.15.19:0/2377007794 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f1bdc023e50 con 0x55cb884a8df0 2024-09-10T22:35:34.625 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:34.619+0000 7f1bf669b740 10 client.17175 fetch_fsmap learned FSMap version 27 2024-09-10T22:35:34.625 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:34.619+0000 7f1bf669b740 1 -- 172.21.15.19:0/2377007794 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55cb884c33b0 con 0x55cb884a8df0 2024-09-10T22:35:34.628 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:34.620+0000 7f1bd5ffb640 1 -- 172.21.15.19:0/2377007794 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1be8004030 con 0x55cb884a8df0 2024-09-10T22:35:34.628 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:34.620+0000 7f1bd5ffb640 1 -- 172.21.15.19:0/2377007794 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7f1bdc034030 con 0x55cb884a8df0 2024-09-10T22:35:34.628 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:34.621+0000 7f1bf669b740 10 client.17175 fetch_fsmap finished waiting for FSMap version 27 2024-09-10T22:35:34.628 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:34.621+0000 7f1bf669b740 10 client.17175 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-10T22:35:34.628 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:34.621+0000 7f1bf669b740 20 client.17175 populate_metadata read hostname 'smithi019' 2024-09-10T22:35:34.628 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:34.621+0000 7f1bf669b740 1 --2- 172.21.15.19:0/2377007794 >> [v2:172.21.15.138:6838/383637208,v1:172.21.15.138:6839/383637208] conn(0x55cb884c4870 0x55cb884c6d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:35:34.628 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:34.621+0000 7f1bf669b740 4 client.17175 mds_command: new command op to 24568 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T22:35:34.628 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:34.621+0000 7f1bf669b740 1 -- 172.21.15.19:0/2377007794 --> [v2:172.21.15.138:6838/383637208,v1:172.21.15.138:6839/383637208] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55cb88420df0 con 0x55cb884c4870 2024-09-10T22:35:34.629 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:34.621+0000 7f1bf2062640 1 --2- 172.21.15.19:0/2377007794 >> [v2:172.21.15.138:6838/383637208,v1:172.21.15.138:6839/383637208] conn(0x55cb884c4870 0x55cb884c6d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:35:34.629 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:34.621+0000 7f1bf2062640 1 --2- 172.21.15.19:0/2377007794 >> [v2:172.21.15.138:6838/383637208,v1:172.21.15.138:6839/383637208] conn(0x55cb884c4870 0x55cb884c6d00 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=d31192ed81476a25 server_cookie=526c97c2e50e0283 in_seq=0 out_seq=0 2024-09-10T22:35:34.629 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:34.621+0000 7f1bd5ffb640 10 client.17175 ms_handle_connect on v2:172.21.15.138:6838/383637208 2024-09-10T22:35:34.629 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:34.622+0000 7f1bd5ffb640 1 -- 172.21.15.19:0/2377007794 <== mds.1 v2:172.21.15.138:6838/383637208 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55cb88420df0 con 0x55cb884c4870 2024-09-10T22:35:34.629 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:34.622+0000 7f1bd5ffb640 10 client.17175 handle_command_reply: tid=0 2024-09-10T22:35:34.629 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:34.622+0000 7f1bf669b740 1 client.17175 shutdown 2024-09-10T22:35:34.629 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:34.622+0000 7f1bf669b740 1 -- 172.21.15.19:0/2377007794 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55cb884a8df0 msgr2=0x55cb884b1a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:35:34.629 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:34.622+0000 7f1bf669b740 1 --2- 172.21.15.19:0/2377007794 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55cb884a8df0 0x55cb884b1a90 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 crypto rx=0x7f1bdc010e40 tx=0x7f1bdc004730 comp rx=0 tx=0).stop 2024-09-10T22:35:34.629 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:34.622+0000 7f1bf669b740 1 -- 172.21.15.19:0/2377007794 shutdown_connections 2024-09-10T22:35:34.630 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:34.622+0000 7f1bf669b740 1 --2- 172.21.15.19:0/2377007794 >> [v2:172.21.15.138:6838/383637208,v1:172.21.15.138:6839/383637208] conn(0x55cb884c4870 0x55cb884c6d00 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:35:34.630 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:34.622+0000 7f1bf669b740 1 --2- 172.21.15.19:0/2377007794 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55cb884b4d80 0x55cb884b2070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:35:34.630 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:34.622+0000 7f1bf669b740 1 --2- 172.21.15.19:0/2377007794 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55cb884a8df0 0x55cb884b1a90 unknown :-1 s=CLOSED pgs=775 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:35:34.630 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:34.622+0000 7f1bd5ffb640 0 client.17175 ms_handle_reset on v2:172.21.15.138:6838/383637208 2024-09-10T22:35:34.630 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:34.622+0000 7f1bf669b740 1 --2- 172.21.15.19:0/2377007794 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55cb884a84d0 0x55cb884b4640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:35:34.630 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:34.622+0000 7f1bf669b740 1 -- 172.21.15.19:0/2377007794 >> 172.21.15.19:0/2377007794 conn(0x55cb884a6300 msgr2=0x55cb884abe70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:35:34.630 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:34.623+0000 7f1bf669b740 1 -- 172.21.15.19:0/2377007794 shutdown_connections 2024-09-10T22:35:34.630 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:34.623+0000 7f1bf669b740 1 -- 172.21.15.19:0/2377007794 wait complete. 2024-09-10T22:35:34.630 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:34.623+0000 7f1bf669b740 20 client.17175 trim_cache size 0 max 16384 2024-09-10T22:35:34.640 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:34.638+0000 7f1bf669b740 1 Processor -- start 2024-09-10T22:35:34.640 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:34.638+0000 7f1bf669b740 1 -- start start 2024-09-10T22:35:34.640 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:34.638+0000 7f1bf669b740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55cb884a84d0 0x55cb884a5d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:35:34.641 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:34.638+0000 7f1bf669b740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55cb884b4d80 0x55cb884c0c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:35:34.641 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:34.638+0000 7f1bf669b740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55cb884b0a20 0x55cb884a1320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:35:34.641 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:34.638+0000 7f1bf669b740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f1bec1b3050 con 0x55cb884b0a20 2024-09-10T22:35:34.641 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:34.638+0000 7f1bf669b740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f1bec1b0920 con 0x55cb884b4d80 2024-09-10T22:35:34.641 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:34.638+0000 7f1bf669b740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f1bec1ae770 con 0x55cb884a84d0 2024-09-10T22:35:34.641 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:34.638+0000 7f1bf1861640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55cb884b4d80 0x55cb884c0c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:35:34.641 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:34.639+0000 7f1bf1861640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55cb884b4d80 0x55cb884c0c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.19:54412/0 (socket says 172.21.15.19:54412) 2024-09-10T22:35:34.641 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:34.639+0000 7f1bf1861640 1 -- 172.21.15.19:0/3294807983 learned_addr learned my addr 172.21.15.19:0/3294807983 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:35:34.641 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:34.639+0000 7f1bf2863640 1 --2- 172.21.15.19:0/3294807983 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55cb884b0a20 0x55cb884a1320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:35:34.641 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:34.639+0000 7f1bf2062640 1 --2- 172.21.15.19:0/3294807983 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55cb884a84d0 0x55cb884a5d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:35:34.641 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:34.639+0000 7f1bf1861640 1 -- 172.21.15.19:0/3294807983 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55cb884a84d0 msgr2=0x55cb884a5d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:35:34.641 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:34.639+0000 7f1bf1861640 1 --2- 172.21.15.19:0/3294807983 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55cb884a84d0 0x55cb884a5d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:35:34.642 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:34.639+0000 7f1bf1861640 1 -- 172.21.15.19:0/3294807983 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55cb884b0a20 msgr2=0x55cb884a1320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:35:34.642 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:34.639+0000 7f1bf1861640 1 --2- 172.21.15.19:0/3294807983 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55cb884b0a20 0x55cb884a1320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:35:34.642 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:34.639+0000 7f1bf1861640 1 -- 172.21.15.19:0/3294807983 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cb884a6fe0 con 0x55cb884b4d80 2024-09-10T22:35:34.642 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:34.639+0000 7f1bf1861640 1 --2- 172.21.15.19:0/3294807983 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55cb884b4d80 0x55cb884c0c80 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f1bdc0058c0 tx=0x7f1bdc011220 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d32b6ca9432b8e98 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:35:34.647 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:34.639+0000 7f1bd7fff640 1 -- 172.21.15.19:0/3294807983 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1bdc01f910 con 0x55cb884b4d80 2024-09-10T22:35:34.647 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:34.639+0000 7f1bd7fff640 1 -- 172.21.15.19:0/3294807983 <== mon.2 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1bdc020610 con 0x55cb884b4d80 2024-09-10T22:35:34.647 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:34.639+0000 7f1bd7fff640 1 -- 172.21.15.19:0/3294807983 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1bdc035650 con 0x55cb884b4d80 2024-09-10T22:35:34.647 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:34.640+0000 7f1bf669b740 1 -- 172.21.15.19:0/3294807983 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55cb884b4d80 msgr2=0x55cb884c0c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:35:34.648 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:34.640+0000 7f1bf669b740 1 --2- 172.21.15.19:0/3294807983 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55cb884b4d80 0x55cb884c0c80 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f1bdc0058c0 tx=0x7f1bdc011220 comp rx=0 tx=0).stop 2024-09-10T22:35:34.648 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:34.640+0000 7f1bf669b740 1 -- 172.21.15.19:0/3294807983 shutdown_connections 2024-09-10T22:35:34.648 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:34.640+0000 7f1bf669b740 1 --2- 172.21.15.19:0/3294807983 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55cb884b0a20 0x55cb884a1320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:35:34.648 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:34.640+0000 7f1bf669b740 1 --2- 172.21.15.19:0/3294807983 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55cb884b4d80 0x55cb884c0c80 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:35:34.648 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:34.640+0000 7f1bf669b740 1 --2- 172.21.15.19:0/3294807983 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55cb884a84d0 0x55cb884a5d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:35:34.648 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:34.640+0000 7f1bf669b740 1 -- 172.21.15.19:0/3294807983 >> 172.21.15.19:0/3294807983 conn(0x55cb884a6300 msgr2=0x55cb884b0310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:35:34.648 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:34.640+0000 7f1bf669b740 1 -- 172.21.15.19:0/3294807983 shutdown_connections 2024-09-10T22:35:34.648 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:34.640+0000 7f1bf669b740 1 -- 172.21.15.19:0/3294807983 wait complete. 2024-09-10T22:35:34.648 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:34.640+0000 7f1bf669b740 1 -- start start 2024-09-10T22:35:34.649 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:34.641+0000 7f1bf669b740 1 Processor -- start 2024-09-10T22:35:34.649 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:34.641+0000 7f1bf669b740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55cb884a84d0 0x55cb884b9510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:35:34.649 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:34.641+0000 7f1bf669b740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55cb884b0a20 0x55cb884b9ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:35:34.649 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:34.641+0000 7f1bf669b740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55cb884b4d80 0x55cb88530810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:35:34.649 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:34.641+0000 7f1bf669b740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f1bec1aede0 con 0x55cb884b4d80 2024-09-10T22:35:34.649 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:34.641+0000 7f1bf669b740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f1bec1b0250 con 0x55cb884b0a20 2024-09-10T22:35:34.649 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:34.641+0000 7f1bf669b740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f1bec1af4b0 con 0x55cb884a84d0 2024-09-10T22:35:34.649 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:34.641+0000 7f1bf1861640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55cb884b0a20 0x55cb884b9ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:35:34.649 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:34.641+0000 7f1bf2062640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55cb884a84d0 0x55cb884b9510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:35:34.649 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:34.641+0000 7f1bf1861640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55cb884b0a20 0x55cb884b9ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.19:54414/0 (socket says 172.21.15.19:54414) 2024-09-10T22:35:34.649 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:34.641+0000 7f1bf1861640 1 -- 172.21.15.19:0/1524429899 learned_addr learned my addr 172.21.15.19:0/1524429899 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:35:34.649 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:34.641+0000 7f1bf669b740 10 client.0 _ll_register_callbacks cb 0x7f1bdc009db0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T22:35:34.649 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:34.641+0000 7f1bf2863640 1 --2- 172.21.15.19:0/1524429899 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55cb884b4d80 0x55cb88530810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:35:34.650 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:34.642+0000 7f1bf2062640 1 -- 172.21.15.19:0/1524429899 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55cb884b0a20 msgr2=0x55cb884b9ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:35:34.650 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:34.642+0000 7f1bf2062640 1 --2- 172.21.15.19:0/1524429899 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55cb884b0a20 0x55cb884b9ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:35:34.650 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:34.642+0000 7f1bf2062640 1 -- 172.21.15.19:0/1524429899 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55cb884b4d80 msgr2=0x55cb88530810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:35:34.650 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:34.642+0000 7f1bf2062640 1 --2- 172.21.15.19:0/1524429899 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55cb884b4d80 0x55cb88530810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:35:34.650 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:34.642+0000 7f1bf2062640 1 -- 172.21.15.19:0/1524429899 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cb88530f50 con 0x55cb884a84d0 2024-09-10T22:35:34.650 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:34.642+0000 7f1bf1861640 1 --2- 172.21.15.19:0/1524429899 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55cb884b0a20 0x55cb884b9ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T22:35:34.650 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:34.642+0000 7f1bf2062640 1 --2- 172.21.15.19:0/1524429899 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55cb884a84d0 0x55cb884b9510 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f1be8006010 tx=0x7f1be8032e60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c2d04fbbe9075704 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:35:34.650 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:34.642+0000 7f1bd5ffb640 10 client.0 ms_handle_connect on v2:172.21.15.138:3300/0 2024-09-10T22:35:34.650 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:34.642+0000 7f1bd5ffb640 1 -- 172.21.15.19:0/1524429899 <== mon.1 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1be8035040 con 0x55cb884a84d0 2024-09-10T22:35:34.650 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:34.642+0000 7f1bd5ffb640 1 -- 172.21.15.19:0/1524429899 <== mon.1 v2:172.21.15.138:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8327+0+0 (secure 0 0 0) 0x7f1be80318b0 con 0x55cb884a84d0 2024-09-10T22:35:34.650 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:34.642+0000 7f1bf669b740 1 -- 172.21.15.19:0/1524429899 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1bdc020610 con 0x55cb884a84d0 2024-09-10T22:35:34.650 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:34.642+0000 7f1bd5ffb640 1 -- 172.21.15.19:0/1524429899 <== mon.1 v2:172.21.15.138:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f1be8040040 con 0x55cb884a84d0 2024-09-10T22:35:34.650 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:34.643+0000 7f1bf669b740 10 client.26542 fetch_fsmap learned FSMap version 27 2024-09-10T22:35:34.650 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:34.643+0000 7f1bf669b740 1 -- 172.21.15.19:0/1524429899 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55cb88532230 con 0x55cb884a84d0 2024-09-10T22:35:34.651 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:34.643+0000 7f1bd5ffb640 1 -- 172.21.15.19:0/1524429899 <== mon.1 v2:172.21.15.138:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1be8009520 con 0x55cb884a84d0 2024-09-10T22:35:34.651 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:34.643+0000 7f1bd5ffb640 1 -- 172.21.15.19:0/1524429899 <== mon.1 v2:172.21.15.138:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7f1be8004750 con 0x55cb884a84d0 2024-09-10T22:35:34.651 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:34.643+0000 7f1bf669b740 10 client.26542 fetch_fsmap finished waiting for FSMap version 27 2024-09-10T22:35:34.651 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:34.643+0000 7f1bf669b740 10 client.26542 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-10T22:35:34.651 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:34.643+0000 7f1bf669b740 20 client.26542 populate_metadata read hostname 'smithi019' 2024-09-10T22:35:34.651 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:34.643+0000 7f1bf669b740 1 --2- 172.21.15.19:0/1524429899 >> [v2:172.21.15.138:6838/383637208,v1:172.21.15.138:6839/383637208] conn(0x55cb885328a0 0x55cb88534c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:35:34.651 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:34.643+0000 7f1bf669b740 4 client.26542 mds_command: new command op to 24568 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-10T22:35:34.651 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:34.643+0000 7f1bf669b740 1 -- 172.21.15.19:0/1524429899 --> [v2:172.21.15.138:6838/383637208,v1:172.21.15.138:6839/383637208] -- command(tid 0: {"prefix": "damage ls"}) -- 0x7f1bdc020610 con 0x55cb885328a0 2024-09-10T22:35:34.651 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:34.643+0000 7f1bf1861640 1 --2- 172.21.15.19:0/1524429899 >> [v2:172.21.15.138:6838/383637208,v1:172.21.15.138:6839/383637208] conn(0x55cb885328a0 0x55cb88534c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:35:34.651 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:34.644+0000 7f1bd5ffb640 10 client.26542 ms_handle_connect on v2:172.21.15.138:6838/383637208 2024-09-10T22:35:34.651 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:34.644+0000 7f1bf1861640 1 --2- 172.21.15.19:0/1524429899 >> [v2:172.21.15.138:6838/383637208,v1:172.21.15.138:6839/383637208] conn(0x55cb885328a0 0x55cb88534c90 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=84cd500ef353251a server_cookie=f01fba58a58aef86 in_seq=0 out_seq=0 2024-09-10T22:35:34.651 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:34.644+0000 7f1bd5ffb640 1 -- 172.21.15.19:0/1524429899 <== mds.1 v2:172.21.15.138:6838/383637208 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x7f1bdc020610 con 0x55cb885328a0 2024-09-10T22:35:34.652 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:34.644+0000 7f1bd5ffb640 10 client.26542 handle_command_reply: tid=0 2024-09-10T22:35:34.652 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:34.644+0000 7f1bf669b740 1 client.26542 shutdown 2024-09-10T22:35:34.652 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:34.644+0000 7f1bf669b740 1 -- 172.21.15.19:0/1524429899 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55cb884a84d0 msgr2=0x55cb884b9510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:35:34.652 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:34.644+0000 7f1bf669b740 1 --2- 172.21.15.19:0/1524429899 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55cb884a84d0 0x55cb884b9510 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f1be8006010 tx=0x7f1be8032e60 comp rx=0 tx=0).stop 2024-09-10T22:35:34.652 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:34.644+0000 7f1bf669b740 1 -- 172.21.15.19:0/1524429899 shutdown_connections 2024-09-10T22:35:34.652 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:34.644+0000 7f1bf669b740 1 --2- 172.21.15.19:0/1524429899 >> [v2:172.21.15.138:6838/383637208,v1:172.21.15.138:6839/383637208] conn(0x55cb885328a0 0x55cb88534c90 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:35:34.652 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:34.644+0000 7f1bf669b740 1 --2- 172.21.15.19:0/1524429899 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55cb884b4d80 0x55cb88530810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:35:34.652 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:34.644+0000 7f1bf669b740 1 --2- 172.21.15.19:0/1524429899 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55cb884b0a20 0x55cb884b9ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:35:34.652 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:34.644+0000 7f1bf669b740 1 --2- 172.21.15.19:0/1524429899 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55cb884a84d0 0x55cb884b9510 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:35:34.652 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:34.644+0000 7f1bf669b740 1 -- 172.21.15.19:0/1524429899 >> 172.21.15.19:0/1524429899 conn(0x55cb884a6300 msgr2=0x55cb884b30c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:35:34.652 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:34.644+0000 7f1bd5ffb640 0 client.26542 ms_handle_reset on v2:172.21.15.138:6838/383637208 2024-09-10T22:35:34.653 INFO:teuthology.orchestra.run.smithi019.stdout:[] 2024-09-10T22:35:34.654 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:34.644+0000 7f1bf669b740 1 -- 172.21.15.19:0/1524429899 shutdown_connections 2024-09-10T22:35:34.654 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:34.644+0000 7f1bf669b740 1 -- 172.21.15.19:0/1524429899 wait complete. 2024-09-10T22:35:34.654 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:34.644+0000 7f1bf669b740 20 client.26542 trim_cache size 0 max 16384 2024-09-10T22:35:34.654 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:34.645+0000 7f1bf42c6640 1 -- 172.21.15.19:0/599784790 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f1bd80b5360 msgr2=0x7f1bd80b7820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:35:34.654 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:34.645+0000 7f1bf42c6640 1 --2- 172.21.15.19:0/599784790 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f1bd80b5360 0x7f1bd80b7820 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f1bdc009fd0 tx=0x7f1bdc005f90 comp rx=0 tx=0).stop 2024-09-10T22:35:34.655 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:34.645+0000 7f1bf42c6640 1 -- 172.21.15.19:0/599784790 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1bec10d130 msgr2=0x7f1bec102400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:35:34.655 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:34.645+0000 7f1bf42c6640 1 --2- 172.21.15.19:0/599784790 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1bec10d130 0x7f1bec102400 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f1be4009fd0 tx=0x7f1be400ef10 comp rx=0 tx=0).stop 2024-09-10T22:35:34.655 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:34.645+0000 7f1bf42c6640 1 -- 172.21.15.19:0/599784790 shutdown_connections 2024-09-10T22:35:34.655 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:34.645+0000 7f1bf42c6640 1 --2- 172.21.15.19:0/599784790 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f1bd80b5360 0x7f1bd80b7820 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:35:34.655 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:34.645+0000 7f1bf42c6640 1 --2- 172.21.15.19:0/599784790 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1bec10d130 0x7f1bec102400 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:35:34.655 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:34.645+0000 7f1bf42c6640 1 --2- 172.21.15.19:0/599784790 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1bec1045f0 0x7f1bec101ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:35:34.655 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:34.645+0000 7f1bf42c6640 1 --2- 172.21.15.19:0/599784790 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f1bec103cd0 0x7f1bec101980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:35:34.655 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:34.645+0000 7f1bf42c6640 1 -- 172.21.15.19:0/599784790 >> 172.21.15.19:0/599784790 conn(0x7f1bec0fd770 msgr2=0x7f1bec0fe3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:35:34.655 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:34.645+0000 7f1bf42c6640 1 -- 172.21.15.19:0/599784790 shutdown_connections 2024-09-10T22:35:34.655 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:34.645+0000 7f1bf42c6640 1 -- 172.21.15.19:0/599784790 wait complete. 2024-09-10T22:35:35.901 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 22997a4c-6fc2-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-10T22:35:36.234 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/22997a4c-6fc2-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T22:35:36.459 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:35:36 smithi019 ceph-mon[31375]: pgmap v622: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 454 KiB/s rd, 204 MiB/s wr, 842 op/s 2024-09-10T22:35:36.609 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:35:36 smithi135 ceph-mon[34789]: pgmap v622: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 454 KiB/s rd, 204 MiB/s wr, 842 op/s 2024-09-10T22:35:36.625 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:35:36 smithi138 ceph-mon[35236]: pgmap v622: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 454 KiB/s rd, 204 MiB/s wr, 842 op/s 2024-09-10T22:35:37.173 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:37.163+0000 7f4174800640 1 -- 172.21.15.19:0/4147934616 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f416c101c90 msgr2=0x7f416c102070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:35:37.173 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:37.163+0000 7f4174800640 1 --2- 172.21.15.19:0/4147934616 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f416c101c90 0x7f416c102070 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x7f4160009900 tx=0x7f416002a410 comp rx=0 tx=0).stop 2024-09-10T22:35:37.173 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:37.163+0000 7f4174800640 1 -- 172.21.15.19:0/4147934616 shutdown_connections 2024-09-10T22:35:37.173 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:37.163+0000 7f4174800640 1 --2- 172.21.15.19:0/4147934616 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f416c108020 0x7f416c10e820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:35:37.173 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:37.163+0000 7f4174800640 1 --2- 172.21.15.19:0/4147934616 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f416c1076a0 0x7f416c107ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:35:37.174 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:37.163+0000 7f4174800640 1 --2- 172.21.15.19:0/4147934616 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f416c101c90 0x7f416c102070 unknown :-1 s=CLOSED pgs=776 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:35:37.174 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:37.163+0000 7f4174800640 1 -- 172.21.15.19:0/4147934616 >> 172.21.15.19:0/4147934616 conn(0x7f416c0fd700 msgr2=0x7f416c0ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:35:37.174 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:37.163+0000 7f4174800640 1 -- 172.21.15.19:0/4147934616 shutdown_connections 2024-09-10T22:35:37.174 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:37.163+0000 7f4174800640 1 -- 172.21.15.19:0/4147934616 wait complete. 2024-09-10T22:35:37.174 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:37.164+0000 7f4174800640 1 Processor -- start 2024-09-10T22:35:37.174 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:37.164+0000 7f4174800640 1 -- start start 2024-09-10T22:35:37.174 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:37.164+0000 7f4174800640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f416c101c90 0x7f416c0fdc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:35:37.174 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:37.164+0000 7f4174800640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f416c1076a0 0x7f416c0fe140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:35:37.174 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:37.164+0000 7f4174800640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f416c108020 0x7f416c0fe680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:35:37.174 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:37.164+0000 7f4174800640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f416c111d20 con 0x7f416c101c90 2024-09-10T22:35:37.174 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:37.164+0000 7f4174800640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f416c111ba0 con 0x7f416c108020 2024-09-10T22:35:37.174 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:37.164+0000 7f4174800640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f416c111ea0 con 0x7f416c1076a0 2024-09-10T22:35:37.174 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:37.164+0000 7f417259c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f416c101c90 0x7f416c0fdc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:35:37.175 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:37.164+0000 7f417259c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f416c101c90 0x7f416c0fdc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:57246/0 (socket says 172.21.15.19:57246) 2024-09-10T22:35:37.175 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:37.164+0000 7f417259c640 1 -- 172.21.15.19:0/3650282959 learned_addr learned my addr 172.21.15.19:0/3650282959 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:35:37.175 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:37.164+0000 7f4172d9d640 1 --2- 172.21.15.19:0/3650282959 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f416c108020 0x7f416c0fe680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:35:37.175 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:37.164+0000 7f417259c640 1 -- 172.21.15.19:0/3650282959 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f416c1076a0 msgr2=0x7f416c0fe140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:35:37.175 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:37.164+0000 7f417259c640 1 --2- 172.21.15.19:0/3650282959 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f416c1076a0 0x7f416c0fe140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:35:37.175 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:37.165+0000 7f417259c640 1 -- 172.21.15.19:0/3650282959 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f416c108020 msgr2=0x7f416c0fe680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:35:37.175 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:37.165+0000 7f417259c640 1 --2- 172.21.15.19:0/3650282959 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f416c108020 0x7f416c0fe680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:35:37.175 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:37.165+0000 7f417259c640 1 -- 172.21.15.19:0/3650282959 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f416c1a7880 con 0x7f416c101c90 2024-09-10T22:35:37.175 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:37.165+0000 7f4172d9d640 1 --2- 172.21.15.19:0/3650282959 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f416c108020 0x7f416c0fe680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T22:35:37.175 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:37.165+0000 7f417259c640 1 --2- 172.21.15.19:0/3650282959 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f416c101c90 0x7f416c0fdc00 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7f4160006010 tx=0x7f41600042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:35:37.175 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:37.165+0000 7f415f7fe640 1 -- 172.21.15.19:0/3650282959 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f416003f030 con 0x7f416c101c90 2024-09-10T22:35:37.175 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:37.165+0000 7f415f7fe640 1 -- 172.21.15.19:0/3650282959 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4160003800 con 0x7f416c101c90 2024-09-10T22:35:37.175 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:37.165+0000 7f415f7fe640 1 -- 172.21.15.19:0/3650282959 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4160035070 con 0x7f416c101c90 2024-09-10T22:35:37.176 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:37.165+0000 7f4174800640 1 -- 172.21.15.19:0/3650282959 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f416c1a7b10 con 0x7f416c101c90 2024-09-10T22:35:37.176 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:37.165+0000 7f4174800640 1 -- 172.21.15.19:0/3650282959 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f416c1a7fa0 con 0x7f416c101c90 2024-09-10T22:35:37.176 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:37.168+0000 7f415f7fe640 1 -- 172.21.15.19:0/3650282959 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 18) ==== 153250+0+0 (secure 0 0 0) 0x7f4160031b10 con 0x7f416c101c90 2024-09-10T22:35:37.176 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:37.169+0000 7f4176bd5740 1 Processor -- start 2024-09-10T22:35:37.176 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:37.170+0000 7f4176bd5740 1 -- start start 2024-09-10T22:35:37.176 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:37.170+0000 7f415f7fe640 1 --2- 172.21.15.19:0/3650282959 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f41580b5360 0x7f41580b7820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:35:37.176 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:37.170+0000 7f4176bd5740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x558b2175a4d0 0x558b2175a8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:35:37.176 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:37.170+0000 7f4176bd5740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x558b2175adf0 0x558b21766840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:35:37.176 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:37.170+0000 7f4176bd5740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558b21766d80 0x558b21769170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:35:37.176 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:37.170+0000 7f4176bd5740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x558b216d0ea0 con 0x558b2175adf0 2024-09-10T22:35:37.176 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:37.170+0000 7f4176bd5740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x558b216c02d0 con 0x558b21766d80 2024-09-10T22:35:37.176 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:37.170+0000 7f4176bd5740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x558b216c40e0 con 0x558b2175a4d0 2024-09-10T22:35:37.176 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:37.170+0000 7f4172d9d640 1 --2- 172.21.15.19:0/3650282959 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f41580b5360 0x7f41580b7820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:35:37.177 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:37.170+0000 7f4171d9b640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x558b2175adf0 0x558b21766840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:35:37.177 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:37.171+0000 7f417259c640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x558b2175a4d0 0x558b2175a8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:35:37.177 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:37.171+0000 7f4171d9b640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x558b2175adf0 0x558b21766840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:57250/0 (socket says 172.21.15.19:57250) 2024-09-10T22:35:37.177 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:37.171+0000 7f4171d9b640 1 -- 172.21.15.19:0/2547646228 learned_addr learned my addr 172.21.15.19:0/2547646228 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:35:37.177 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:37.172+0000 7f415f7fe640 1 -- 172.21.15.19:0/3650282959 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8327+0+0 (secure 0 0 0) 0x7f41601066d0 con 0x7f416c101c90 2024-09-10T22:35:37.180 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:37.172+0000 7f4172d9d640 1 --2- 172.21.15.19:0/3650282959 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f41580b5360 0x7f41580b7820 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f416c0ffcc0 tx=0x7f416800c690 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:35:37.180 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:37.172+0000 7f4172d9d640 1 --2- 172.21.15.19:0/2547646228 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558b21766d80 0x558b21769170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:35:37.180 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:37.172+0000 7f4171d9b640 1 -- 172.21.15.19:0/2547646228 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x558b2175a4d0 msgr2=0x558b2175a8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:35:37.180 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:37.172+0000 7f4171d9b640 1 --2- 172.21.15.19:0/2547646228 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x558b2175a4d0 0x558b2175a8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:35:37.180 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:37.172+0000 7f4171d9b640 1 -- 172.21.15.19:0/2547646228 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558b21766d80 msgr2=0x558b21769170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:35:37.180 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:37.172+0000 7f4171d9b640 1 --2- 172.21.15.19:0/2547646228 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558b21766d80 0x558b21769170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:35:37.180 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:37.172+0000 7f4171d9b640 1 -- 172.21.15.19:0/2547646228 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558b2141e650 con 0x558b2175adf0 2024-09-10T22:35:37.180 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:37.172+0000 7f4172d9d640 1 --2- 172.21.15.19:0/2547646228 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558b21766d80 0x558b21769170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T22:35:37.181 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:37.172+0000 7f4171d9b640 1 --2- 172.21.15.19:0/2547646228 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x558b2175adf0 0x558b21766840 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7f41640097f0 tx=0x7f4164009cb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8b37a6bab869fbc1 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:35:37.181 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:37.173+0000 7f415cff9640 1 -- 172.21.15.19:0/2547646228 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4164015020 con 0x558b2175adf0 2024-09-10T22:35:37.181 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:37.173+0000 7f415cff9640 1 -- 172.21.15.19:0/2547646228 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4164011420 con 0x558b2175adf0 2024-09-10T22:35:37.181 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:37.173+0000 7f415cff9640 1 -- 172.21.15.19:0/2547646228 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41640105e0 con 0x558b2175adf0 2024-09-10T22:35:37.181 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:37.174+0000 7f4176bd5740 1 -- 172.21.15.19:0/2547646228 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x558b2175adf0 msgr2=0x558b21766840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:35:37.181 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:37.174+0000 7f4176bd5740 1 --2- 172.21.15.19:0/2547646228 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x558b2175adf0 0x558b21766840 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7f41640097f0 tx=0x7f4164009cb0 comp rx=0 tx=0).stop 2024-09-10T22:35:37.181 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:37.174+0000 7f4176bd5740 1 -- 172.21.15.19:0/2547646228 shutdown_connections 2024-09-10T22:35:37.181 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:37.174+0000 7f4176bd5740 1 --2- 172.21.15.19:0/2547646228 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558b21766d80 0x558b21769170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:35:37.181 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:37.174+0000 7f4176bd5740 1 --2- 172.21.15.19:0/2547646228 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x558b2175adf0 0x558b21766840 unknown :-1 s=CLOSED pgs=778 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:35:37.181 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:37.174+0000 7f4176bd5740 1 --2- 172.21.15.19:0/2547646228 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x558b2175a4d0 0x558b2175a8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:35:37.181 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:37.174+0000 7f4176bd5740 1 -- 172.21.15.19:0/2547646228 >> 172.21.15.19:0/2547646228 conn(0x558b21758300 msgr2=0x558b217594a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:35:37.181 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:37.174+0000 7f4176bd5740 1 -- 172.21.15.19:0/2547646228 shutdown_connections 2024-09-10T22:35:37.181 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:37.175+0000 7f4176bd5740 1 -- 172.21.15.19:0/2547646228 wait complete. 2024-09-10T22:35:37.182 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:37.175+0000 7f4176bd5740 1 -- start start 2024-09-10T22:35:37.182 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:37.175+0000 7f4176bd5740 1 Processor -- start 2024-09-10T22:35:37.182 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:37.176+0000 7f4176bd5740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x558b2175a4d0 0x558b21766710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:35:37.182 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:37.176+0000 7f4176bd5740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558b2175adf0 0x558b21763b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:35:37.182 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:37.176+0000 7f4176bd5740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x558b21766d80 0x558b21764230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:35:37.182 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:37.176+0000 7f4176bd5740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x558b21521700 con 0x558b2175a4d0 2024-09-10T22:35:37.182 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:37.176+0000 7f4176bd5740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x558b2165b160 con 0x558b2175adf0 2024-09-10T22:35:37.182 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:37.176+0000 7f4176bd5740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x558b21769a00 con 0x558b21766d80 2024-09-10T22:35:37.182 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:37.176+0000 7f417259c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x558b2175a4d0 0x558b21766710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:35:37.182 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:37.176+0000 7f4176bd5740 10 client.0 _ll_register_callbacks cb 0x558b216749e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T22:35:37.182 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:37.176+0000 7f417259c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x558b2175a4d0 0x558b21766710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:57262/0 (socket says 172.21.15.19:57262) 2024-09-10T22:35:37.182 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:37.176+0000 7f417259c640 1 -- 172.21.15.19:0/2288622147 learned_addr learned my addr 172.21.15.19:0/2288622147 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:35:37.182 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:37.176+0000 7f4172d9d640 1 --2- 172.21.15.19:0/2288622147 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x558b21766d80 0x558b21764230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:35:37.183 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:37.176+0000 7f417259c640 1 -- 172.21.15.19:0/2288622147 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x558b21766d80 msgr2=0x558b21764230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:35:37.183 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:37.176+0000 7f417259c640 1 --2- 172.21.15.19:0/2288622147 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x558b21766d80 0x558b21764230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:35:37.183 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:37.176+0000 7f417259c640 1 -- 172.21.15.19:0/2288622147 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558b2175adf0 msgr2=0x558b21763b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:35:37.183 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:37.176+0000 7f417259c640 1 --2- 172.21.15.19:0/2288622147 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558b2175adf0 0x558b21763b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:35:37.183 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:37.176+0000 7f417259c640 1 -- 172.21.15.19:0/2288622147 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558b21688c90 con 0x558b2175a4d0 2024-09-10T22:35:37.183 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:37.177+0000 7f417259c640 1 --2- 172.21.15.19:0/2288622147 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x558b2175a4d0 0x558b21766710 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x7f41600ccd60 tx=0x7f41600044e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f778367c0ca503d2 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:35:37.183 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:37.177+0000 7f4155ffb640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-10T22:35:37.183 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:37.177+0000 7f4155ffb640 1 -- 172.21.15.19:0/2288622147 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4160049040 con 0x558b2175a4d0 2024-09-10T22:35:37.183 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:37.177+0000 7f4155ffb640 1 -- 172.21.15.19:0/2288622147 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8327+0+0 (secure 0 0 0) 0x7f41600c9040 con 0x558b2175a4d0 2024-09-10T22:35:37.183 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:37.177+0000 7f4176bd5740 1 -- 172.21.15.19:0/2288622147 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4164011420 con 0x558b2175a4d0 2024-09-10T22:35:37.183 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:37.177+0000 7f4155ffb640 1 -- 172.21.15.19:0/2288622147 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f41600cc8e0 con 0x558b2175a4d0 2024-09-10T22:35:37.183 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:37.177+0000 7f4176bd5740 10 client.17193 fetch_fsmap learned FSMap version 27 2024-09-10T22:35:37.183 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:37.177+0000 7f4176bd5740 1 -- 172.21.15.19:0/2288622147 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x558b2177db50 con 0x558b2175a4d0 2024-09-10T22:35:37.184 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:37.178+0000 7f4155ffb640 1 -- 172.21.15.19:0/2288622147 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4164011420 con 0x558b2175a4d0 2024-09-10T22:35:37.184 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:37.178+0000 7f4155ffb640 1 -- 172.21.15.19:0/2288622147 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7f41600cd030 con 0x558b2175a4d0 2024-09-10T22:35:37.184 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:37.178+0000 7f4176bd5740 10 client.17193 fetch_fsmap finished waiting for FSMap version 27 2024-09-10T22:35:37.184 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:37.178+0000 7f4176bd5740 10 client.17193 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-10T22:35:37.184 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:37.178+0000 7f4176bd5740 20 client.17193 populate_metadata read hostname 'smithi019' 2024-09-10T22:35:37.184 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:37.178+0000 7f4176bd5740 1 --2- 172.21.15.19:0/2288622147 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x558b2177efb0 0x558b217813e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:35:37.184 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:37.178+0000 7f4176bd5740 4 client.17193 mds_command: new command op to 24581 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T22:35:37.184 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:37.178+0000 7f4176bd5740 1 -- 172.21.15.19:0/2288622147 --> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x558b216d2df0 con 0x558b2177efb0 2024-09-10T22:35:37.185 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:37.179+0000 7f4171d9b640 1 --2- 172.21.15.19:0/2288622147 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x558b2177efb0 0x558b217813e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:35:37.185 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:37.180+0000 7f4155ffb640 10 client.17193 ms_handle_connect on v2:172.21.15.135:6838/1254769802 2024-09-10T22:35:37.186 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:37.180+0000 7f4171d9b640 1 --2- 172.21.15.19:0/2288622147 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x558b2177efb0 0x558b217813e0 crc :-1 s=READY pgs=184 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=13781ac4166c29e server_cookie=e47a762a35e162a3 in_seq=0 out_seq=0 2024-09-10T22:35:37.186 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:37.182+0000 7f4155ffb640 1 -- 172.21.15.19:0/2288622147 <== mds.0 v2:172.21.15.135:6838/1254769802 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x558b216d2df0 con 0x558b2177efb0 2024-09-10T22:35:37.186 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:37.182+0000 7f4155ffb640 10 client.17193 handle_command_reply: tid=0 2024-09-10T22:35:37.186 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:37.182+0000 7f4176bd5740 1 client.17193 shutdown 2024-09-10T22:35:37.186 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:37.182+0000 7f4176bd5740 1 -- 172.21.15.19:0/2288622147 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x558b2175a4d0 msgr2=0x558b21766710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:35:37.186 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:37.182+0000 7f4176bd5740 1 --2- 172.21.15.19:0/2288622147 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x558b2175a4d0 0x558b21766710 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x7f41600ccd60 tx=0x7f41600044e0 comp rx=0 tx=0).stop 2024-09-10T22:35:37.186 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:37.182+0000 7f4176bd5740 1 -- 172.21.15.19:0/2288622147 shutdown_connections 2024-09-10T22:35:37.186 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:37.182+0000 7f4176bd5740 1 --2- 172.21.15.19:0/2288622147 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x558b2177efb0 0x558b217813e0 crc :-1 s=READY pgs=184 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:35:37.186 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:37.182+0000 7f4176bd5740 1 --2- 172.21.15.19:0/2288622147 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x558b21766d80 0x558b21764230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:35:37.186 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:37.182+0000 7f4176bd5740 1 --2- 172.21.15.19:0/2288622147 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558b2175adf0 0x558b21763b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:35:37.186 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:37.182+0000 7f4176bd5740 1 --2- 172.21.15.19:0/2288622147 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x558b2175a4d0 0x558b21766710 unknown :-1 s=CLOSED pgs=779 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:35:37.186 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:37.182+0000 7f4176bd5740 1 -- 172.21.15.19:0/2288622147 >> 172.21.15.19:0/2288622147 conn(0x558b21758300 msgr2=0x558b2175dea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:35:37.186 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:37.182+0000 7f4155ffb640 0 client.17193 ms_handle_reset on v2:172.21.15.135:6838/1254769802 2024-09-10T22:35:37.186 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:37.182+0000 7f4176bd5740 1 -- 172.21.15.19:0/2288622147 shutdown_connections 2024-09-10T22:35:37.187 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:37.182+0000 7f4176bd5740 1 -- 172.21.15.19:0/2288622147 wait complete. 2024-09-10T22:35:37.187 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:37.182+0000 7f4176bd5740 20 client.17193 trim_cache size 0 max 16384 2024-09-10T22:35:37.203 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:37.201+0000 7f4176bd5740 1 Processor -- start 2024-09-10T22:35:37.203 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:37.201+0000 7f4176bd5740 1 -- start start 2024-09-10T22:35:37.203 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:37.201+0000 7f4176bd5740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x558b2175a4d0 0x558b21760d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:35:37.203 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:37.201+0000 7f4176bd5740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x558b2175adf0 0x558b217612b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:35:37.203 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:37.201+0000 7f4176bd5740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558b21766d80 0x558b21786cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:35:37.203 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:37.201+0000 7f4176bd5740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f416c1aed20 con 0x558b2175adf0 2024-09-10T22:35:37.203 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:37.201+0000 7f4176bd5740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f416c1ac5f0 con 0x558b21766d80 2024-09-10T22:35:37.203 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:37.201+0000 7f4176bd5740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f416c1aa460 con 0x558b2175a4d0 2024-09-10T22:35:37.204 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:37.201+0000 7f4171d9b640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x558b2175adf0 0x558b217612b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:35:37.204 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:37.201+0000 7f4171d9b640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x558b2175adf0 0x558b217612b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:57276/0 (socket says 172.21.15.19:57276) 2024-09-10T22:35:37.204 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:37.201+0000 7f417259c640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x558b2175a4d0 0x558b21760d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:35:37.204 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:37.201+0000 7f4171d9b640 1 -- 172.21.15.19:0/3220812582 learned_addr learned my addr 172.21.15.19:0/3220812582 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:35:37.206 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:37.202+0000 7f417259c640 1 -- 172.21.15.19:0/3220812582 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558b21766d80 msgr2=0x558b21786cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:35:37.206 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:37.202+0000 7f417259c640 1 --2- 172.21.15.19:0/3220812582 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558b21766d80 0x558b21786cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:35:37.207 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:37.202+0000 7f417259c640 1 -- 172.21.15.19:0/3220812582 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x558b2175adf0 msgr2=0x558b217612b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:35:37.207 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:37.202+0000 7f417259c640 1 --2- 172.21.15.19:0/3220812582 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x558b2175adf0 0x558b217612b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:35:37.207 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:37.202+0000 7f417259c640 1 -- 172.21.15.19:0/3220812582 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558b217645a0 con 0x558b2175a4d0 2024-09-10T22:35:37.207 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:37.202+0000 7f4171d9b640 1 --2- 172.21.15.19:0/3220812582 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x558b2175adf0 0x558b217612b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T22:35:37.207 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:37.202+0000 7f417259c640 1 --2- 172.21.15.19:0/3220812582 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x558b2175a4d0 0x558b21760d70 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f41600cca80 tx=0x7f4160003c20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ae07b6fb40e01541 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:35:37.207 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:37.202+0000 7f4157fff640 1 -- 172.21.15.19:0/3220812582 <== mon.1 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4160049070 con 0x558b2175a4d0 2024-09-10T22:35:37.207 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:37.202+0000 7f4157fff640 1 -- 172.21.15.19:0/3220812582 <== mon.1 v2:172.21.15.138:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4160104050 con 0x558b2175a4d0 2024-09-10T22:35:37.207 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:37.202+0000 7f4157fff640 1 -- 172.21.15.19:0/3220812582 <== mon.1 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41600cd030 con 0x558b2175a4d0 2024-09-10T22:35:37.207 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:37.203+0000 7f4176bd5740 1 -- 172.21.15.19:0/3220812582 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x558b2175a4d0 msgr2=0x558b21760d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:35:37.207 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:37.203+0000 7f4176bd5740 1 --2- 172.21.15.19:0/3220812582 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x558b2175a4d0 0x558b21760d70 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f41600cca80 tx=0x7f4160003c20 comp rx=0 tx=0).stop 2024-09-10T22:35:37.207 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:37.203+0000 7f4176bd5740 1 -- 172.21.15.19:0/3220812582 shutdown_connections 2024-09-10T22:35:37.207 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:37.203+0000 7f4176bd5740 1 --2- 172.21.15.19:0/3220812582 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558b21766d80 0x558b21786cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:35:37.208 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:37.203+0000 7f4176bd5740 1 --2- 172.21.15.19:0/3220812582 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x558b2175adf0 0x558b217612b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:35:37.208 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:37.203+0000 7f4176bd5740 1 --2- 172.21.15.19:0/3220812582 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x558b2175a4d0 0x558b21760d70 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:35:37.208 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:37.203+0000 7f4176bd5740 1 -- 172.21.15.19:0/3220812582 >> 172.21.15.19:0/3220812582 conn(0x558b21758300 msgr2=0x558b217623e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:35:37.208 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:37.203+0000 7f4176bd5740 1 -- 172.21.15.19:0/3220812582 shutdown_connections 2024-09-10T22:35:37.208 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:37.203+0000 7f4176bd5740 1 -- 172.21.15.19:0/3220812582 wait complete. 2024-09-10T22:35:37.208 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:37.204+0000 7f4176bd5740 1 -- start start 2024-09-10T22:35:37.208 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:37.204+0000 7f4176bd5740 1 Processor -- start 2024-09-10T22:35:37.208 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:37.204+0000 7f4176bd5740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558b2175a4d0 0x558b2176ee80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:35:37.208 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:37.204+0000 7f4176bd5740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x558b2175adf0 0x558b2176f3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:35:37.208 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:37.204+0000 7f4176bd5740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x558b21766d80 0x558b21769c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:35:37.208 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:37.204+0000 7f4176bd5740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f416c1aaab0 con 0x558b21766d80 2024-09-10T22:35:37.208 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:37.204+0000 7f4176bd5740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f416c1abf20 con 0x558b2175a4d0 2024-09-10T22:35:37.208 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:37.204+0000 7f4176bd5740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f416c1ab180 con 0x558b2175adf0 2024-09-10T22:35:37.209 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:37.205+0000 7f4176bd5740 10 client.0 _ll_register_callbacks cb 0x7f41600c9510 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T22:35:37.209 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:37.205+0000 7f4172d9d640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x558b21766d80 0x558b21769c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:35:37.209 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:37.205+0000 7f4172d9d640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x558b21766d80 0x558b21769c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:57290/0 (socket says 172.21.15.19:57290) 2024-09-10T22:35:37.209 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:37.205+0000 7f4171d9b640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x558b2175adf0 0x558b2176f3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:35:37.209 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:37.205+0000 7f4172d9d640 1 -- 172.21.15.19:0/3141102048 learned_addr learned my addr 172.21.15.19:0/3141102048 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:35:37.209 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:37.205+0000 7f417259c640 1 --2- 172.21.15.19:0/3141102048 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558b2175a4d0 0x558b2176ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:35:37.209 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:37.205+0000 7f4172d9d640 1 -- 172.21.15.19:0/3141102048 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x558b2175adf0 msgr2=0x558b2176f3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:35:37.209 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:37.205+0000 7f4172d9d640 1 --2- 172.21.15.19:0/3141102048 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x558b2175adf0 0x558b2176f3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:35:37.209 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:37.205+0000 7f4172d9d640 1 -- 172.21.15.19:0/3141102048 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558b2175a4d0 msgr2=0x558b2176ee80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:35:37.209 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:37.205+0000 7f4172d9d640 1 --2- 172.21.15.19:0/3141102048 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558b2175a4d0 0x558b2176ee80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:35:37.209 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:37.205+0000 7f4172d9d640 1 -- 172.21.15.19:0/3141102048 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558b2176a340 con 0x558b21766d80 2024-09-10T22:35:37.212 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:37.205+0000 7f4172d9d640 1 --2- 172.21.15.19:0/3141102048 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x558b21766d80 0x558b21769c50 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x7f4168011e00 tx=0x7f4168004b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e3c45dbf52bf91fa server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:35:37.212 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:37.205+0000 7f4155ffb640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-10T22:35:37.212 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:37.206+0000 7f4155ffb640 1 -- 172.21.15.19:0/3141102048 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4168022070 con 0x558b21766d80 2024-09-10T22:35:37.212 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:37.206+0000 7f4155ffb640 1 -- 172.21.15.19:0/3141102048 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8327+0+0 (secure 0 0 0) 0x7f416800fd20 con 0x558b21766d80 2024-09-10T22:35:37.212 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:37.206+0000 7f4176bd5740 1 -- 172.21.15.19:0/3141102048 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4160104050 con 0x558b21766d80 2024-09-10T22:35:37.212 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:37.206+0000 7f4155ffb640 1 -- 172.21.15.19:0/3141102048 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f416802e050 con 0x558b21766d80 2024-09-10T22:35:37.212 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:37.206+0000 7f4176bd5740 10 client.17199 fetch_fsmap learned FSMap version 27 2024-09-10T22:35:37.212 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:37.206+0000 7f4176bd5740 1 -- 172.21.15.19:0/3141102048 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x558b217ec910 con 0x558b21766d80 2024-09-10T22:35:37.213 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:37.206+0000 7f4155ffb640 1 -- 172.21.15.19:0/3141102048 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4160104050 con 0x558b21766d80 2024-09-10T22:35:37.213 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:37.207+0000 7f4155ffb640 1 -- 172.21.15.19:0/3141102048 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7f41680103c0 con 0x558b21766d80 2024-09-10T22:35:37.213 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:37.207+0000 7f4176bd5740 10 client.17199 fetch_fsmap finished waiting for FSMap version 27 2024-09-10T22:35:37.213 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:37.207+0000 7f4176bd5740 10 client.17199 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-10T22:35:37.213 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:37.207+0000 7f4176bd5740 20 client.17199 populate_metadata read hostname 'smithi019' 2024-09-10T22:35:37.213 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:37.207+0000 7f4176bd5740 1 --2- 172.21.15.19:0/3141102048 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x558b217ed0c0 0x558b217ef4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:35:37.213 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:37.207+0000 7f4176bd5740 4 client.17199 mds_command: new command op to 24581 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-10T22:35:37.213 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:37.207+0000 7f4176bd5740 1 -- 172.21.15.19:0/3141102048 --> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] -- command(tid 0: {"prefix": "damage ls"}) -- 0x558b216ce8a0 con 0x558b217ed0c0 2024-09-10T22:35:37.213 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:37.207+0000 7f417259c640 1 --2- 172.21.15.19:0/3141102048 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x558b217ed0c0 0x558b217ef4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:35:37.213 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:37.208+0000 7f417259c640 1 --2- 172.21.15.19:0/3141102048 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x558b217ed0c0 0x558b217ef4e0 crc :-1 s=READY pgs=185 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6745f56d26d16aaf server_cookie=eb8f3a58e2462c7d in_seq=0 out_seq=0 2024-09-10T22:35:37.213 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:37.208+0000 7f4155ffb640 10 client.17199 ms_handle_connect on v2:172.21.15.135:6838/1254769802 2024-09-10T22:35:37.213 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:37.208+0000 7f4155ffb640 1 -- 172.21.15.19:0/3141102048 <== mds.0 v2:172.21.15.135:6838/1254769802 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x558b216ce8a0 con 0x558b217ed0c0 2024-09-10T22:35:37.213 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:37.208+0000 7f4155ffb640 10 client.17199 handle_command_reply: tid=0 2024-09-10T22:35:37.214 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:37.208+0000 7f4176bd5740 1 client.17199 shutdown 2024-09-10T22:35:37.214 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:37.208+0000 7f4176bd5740 1 -- 172.21.15.19:0/3141102048 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x558b21766d80 msgr2=0x558b21769c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:35:37.214 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:37.208+0000 7f4176bd5740 1 --2- 172.21.15.19:0/3141102048 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x558b21766d80 0x558b21769c50 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x7f4168011e00 tx=0x7f4168004b50 comp rx=0 tx=0).stop 2024-09-10T22:35:37.214 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:37.209+0000 7f4176bd5740 1 -- 172.21.15.19:0/3141102048 shutdown_connections 2024-09-10T22:35:37.214 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:37.209+0000 7f4176bd5740 1 --2- 172.21.15.19:0/3141102048 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x558b21766d80 0x558b21769c50 unknown :-1 s=CLOSED pgs=780 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:35:37.214 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:37.209+0000 7f4176bd5740 1 --2- 172.21.15.19:0/3141102048 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x558b217ed0c0 0x558b217ef4e0 crc :-1 s=READY pgs=185 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:35:37.214 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:37.209+0000 7f4176bd5740 1 --2- 172.21.15.19:0/3141102048 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x558b2175adf0 0x558b2176f3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:35:37.214 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:37.209+0000 7f4176bd5740 1 --2- 172.21.15.19:0/3141102048 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558b2175a4d0 0x558b2176ee80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:35:37.214 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:37.209+0000 7f4155ffb640 0 client.17199 ms_handle_reset on v2:172.21.15.135:6838/1254769802 2024-09-10T22:35:37.214 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:37.209+0000 7f4176bd5740 1 -- 172.21.15.19:0/3141102048 >> 172.21.15.19:0/3141102048 conn(0x558b21758300 msgr2=0x558b21765190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:35:37.214 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:37.209+0000 7f4176bd5740 1 -- 172.21.15.19:0/3141102048 shutdown_connections 2024-09-10T22:35:37.214 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:37.209+0000 7f4176bd5740 1 -- 172.21.15.19:0/3141102048 wait complete. 2024-09-10T22:35:37.214 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:37.209+0000 7f4176bd5740 20 client.17199 trim_cache size 0 max 16384 2024-09-10T22:35:37.215 INFO:teuthology.orchestra.run.smithi019.stdout:[] 2024-09-10T22:35:37.215 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:37.210+0000 7f4174800640 1 -- 172.21.15.19:0/3650282959 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f41580b5360 msgr2=0x7f41580b7820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:35:37.216 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:37.210+0000 7f4174800640 1 --2- 172.21.15.19:0/3650282959 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f41580b5360 0x7f41580b7820 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f416c0ffcc0 tx=0x7f416800c690 comp rx=0 tx=0).stop 2024-09-10T22:35:37.216 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:37.210+0000 7f4174800640 1 -- 172.21.15.19:0/3650282959 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f416c101c90 msgr2=0x7f416c0fdc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:35:37.216 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:37.210+0000 7f4174800640 1 --2- 172.21.15.19:0/3650282959 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f416c101c90 0x7f416c0fdc00 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7f4160006010 tx=0x7f41600042f0 comp rx=0 tx=0).stop 2024-09-10T22:35:37.216 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:37.210+0000 7f4174800640 1 -- 172.21.15.19:0/3650282959 shutdown_connections 2024-09-10T22:35:37.216 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:37.210+0000 7f4174800640 1 --2- 172.21.15.19:0/3650282959 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f41580b5360 0x7f41580b7820 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:35:37.216 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:37.210+0000 7f4174800640 1 --2- 172.21.15.19:0/3650282959 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f416c108020 0x7f416c0fe680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:35:37.216 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:37.210+0000 7f4174800640 1 --2- 172.21.15.19:0/3650282959 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f416c1076a0 0x7f416c0fe140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:35:37.216 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:37.210+0000 7f4174800640 1 --2- 172.21.15.19:0/3650282959 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f416c101c90 0x7f416c0fdc00 unknown :-1 s=CLOSED pgs=777 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:35:37.216 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:37.210+0000 7f4174800640 1 -- 172.21.15.19:0/3650282959 >> 172.21.15.19:0/3650282959 conn(0x7f416c0fd700 msgr2=0x7f416c06ae50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:35:37.216 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:37.210+0000 7f4174800640 1 -- 172.21.15.19:0/3650282959 shutdown_connections 2024-09-10T22:35:37.216 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:37.210+0000 7f4174800640 1 -- 172.21.15.19:0/3650282959 wait complete. 2024-09-10T22:35:38.458 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:35:38 smithi019 ceph-mon[31375]: pgmap v623: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 446 KiB/s rd, 241 MiB/s wr, 689 op/s 2024-09-10T22:35:38.610 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:35:38 smithi135 ceph-mon[34789]: pgmap v623: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 446 KiB/s rd, 241 MiB/s wr, 689 op/s 2024-09-10T22:35:38.625 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:35:38 smithi138 ceph-mon[35236]: pgmap v623: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 446 KiB/s rd, 241 MiB/s wr, 689 op/s 2024-09-10T22:35:39.283 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-10T22:35:39.283 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 22997a4c-6fc2-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-10T22:35:39.622 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/22997a4c-6fc2-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T22:35:40.398 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:35:40 smithi019 ceph-mon[31375]: pgmap v624: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 445 KiB/s rd, 198 MiB/s wr, 327 op/s 2024-09-10T22:35:40.592 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:40.526+0000 7feb9d030640 1 -- 172.21.15.19:0/856941445 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7feb98105590 msgr2=0x7feb981059d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:35:40.592 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:40.526+0000 7feb9d030640 1 --2- 172.21.15.19:0/856941445 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7feb98105590 0x7feb981059d0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7feb8c009860 tx=0x7feb8c02a340 comp rx=0 tx=0).stop 2024-09-10T22:35:40.592 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:40.526+0000 7feb9d030640 1 -- 172.21.15.19:0/856941445 shutdown_connections 2024-09-10T22:35:40.592 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:40.526+0000 7feb9d030640 1 --2- 172.21.15.19:0/856941445 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7feb98105f10 0x7feb9810f950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:35:40.592 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:40.526+0000 7feb9d030640 1 --2- 172.21.15.19:0/856941445 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7feb98105590 0x7feb981059d0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:35:40.592 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:40.526+0000 7feb9d030640 1 --2- 172.21.15.19:0/856941445 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7feb981011e0 0x7feb981015c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:35:40.592 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:40.526+0000 7feb9d030640 1 -- 172.21.15.19:0/856941445 >> 172.21.15.19:0/856941445 conn(0x7feb98078100 msgr2=0x7feb980ff4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:35:40.592 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:40.526+0000 7feb9d030640 1 -- 172.21.15.19:0/856941445 shutdown_connections 2024-09-10T22:35:40.592 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:40.526+0000 7feb9d030640 1 -- 172.21.15.19:0/856941445 wait complete. 2024-09-10T22:35:40.593 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:40.527+0000 7feb9d030640 1 Processor -- start 2024-09-10T22:35:40.593 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:40.527+0000 7feb9d030640 1 -- start start 2024-09-10T22:35:40.593 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:40.527+0000 7feb9d030640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7feb981011e0 0x7feb9819b470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:35:40.593 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:40.527+0000 7feb9d030640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7feb98105590 0x7feb9819b9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:35:40.593 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:40.527+0000 7feb9d030640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7feb98105f10 0x7feb981a0d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:35:40.593 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:40.527+0000 7feb9d030640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7feb98112dd0 con 0x7feb98105590 2024-09-10T22:35:40.593 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:40.527+0000 7feb9d030640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7feb98112c50 con 0x7feb98105f10 2024-09-10T22:35:40.593 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:40.527+0000 7feb9d030640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7feb98112f50 con 0x7feb981011e0 2024-09-10T22:35:40.593 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:40.528+0000 7feb9659c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7feb98105590 0x7feb9819b9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:35:40.593 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:40.528+0000 7feb9659c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7feb98105590 0x7feb9819b9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:57310/0 (socket says 172.21.15.19:57310) 2024-09-10T22:35:40.593 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:40.528+0000 7feb9659c640 1 -- 172.21.15.19:0/253124785 learned_addr learned my addr 172.21.15.19:0/253124785 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:35:40.594 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:40.528+0000 7feb9759e640 1 --2- 172.21.15.19:0/253124785 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7feb98105f10 0x7feb981a0d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:35:40.594 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:40.528+0000 7feb96d9d640 1 --2- 172.21.15.19:0/253124785 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7feb981011e0 0x7feb9819b470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:35:40.594 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:40.528+0000 7feb9659c640 1 -- 172.21.15.19:0/253124785 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7feb981011e0 msgr2=0x7feb9819b470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:35:40.594 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:40.528+0000 7feb9659c640 1 --2- 172.21.15.19:0/253124785 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7feb981011e0 0x7feb9819b470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:35:40.594 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:40.528+0000 7feb9659c640 1 -- 172.21.15.19:0/253124785 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7feb98105f10 msgr2=0x7feb981a0d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:35:40.594 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:40.528+0000 7feb9659c640 1 --2- 172.21.15.19:0/253124785 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7feb98105f10 0x7feb981a0d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:35:40.594 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:40.528+0000 7feb9659c640 1 -- 172.21.15.19:0/253124785 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feb981a1520 con 0x7feb98105590 2024-09-10T22:35:40.594 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:40.528+0000 7feb9659c640 1 --2- 172.21.15.19:0/253124785 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7feb98105590 0x7feb9819b9b0 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7feb8c035040 tx=0x7feb8c032d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:35:40.594 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:40.529+0000 7feb7ffff640 1 -- 172.21.15.19:0/253124785 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb8c037040 con 0x7feb98105590 2024-09-10T22:35:40.594 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:40.529+0000 7feb7ffff640 1 -- 172.21.15.19:0/253124785 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7feb8c041070 con 0x7feb98105590 2024-09-10T22:35:40.594 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:40.529+0000 7feb7ffff640 1 -- 172.21.15.19:0/253124785 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb8c0035f0 con 0x7feb98105590 2024-09-10T22:35:40.594 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:40.529+0000 7feb9d030640 1 -- 172.21.15.19:0/253124785 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feb981a17b0 con 0x7feb98105590 2024-09-10T22:35:40.594 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:40.529+0000 7feb9d030640 1 -- 172.21.15.19:0/253124785 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feb981a7ed0 con 0x7feb98105590 2024-09-10T22:35:40.595 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:40.531+0000 7feb7ffff640 1 -- 172.21.15.19:0/253124785 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 18) ==== 153250+0+0 (secure 0 0 0) 0x7feb8c004050 con 0x7feb98105590 2024-09-10T22:35:40.595 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:40.531+0000 7feb9f405740 1 Processor -- start 2024-09-10T22:35:40.595 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:40.531+0000 7feb9f405740 1 -- start start 2024-09-10T22:35:40.595 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:40.532+0000 7feb9f405740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5580f59baee0 0x5580f59bb2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:35:40.595 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:40.532+0000 7feb9f405740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5580f59bb800 0x5580f59c7250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:35:40.595 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:40.532+0000 7feb9f405740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5580f59c7790 0x5580f59c9b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:35:40.595 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:40.532+0000 7feb9f405740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x5580f5931e60 con 0x5580f59bb800 2024-09-10T22:35:40.595 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:40.532+0000 7feb9f405740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x5580f5921290 con 0x5580f59baee0 2024-09-10T22:35:40.595 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:40.532+0000 7feb9f405740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x5580f59250a0 con 0x5580f59c7790 2024-09-10T22:35:40.595 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:40.532+0000 7feb96d9d640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5580f59bb800 0x5580f59c7250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:35:40.595 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:40.532+0000 7feb96d9d640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5580f59bb800 0x5580f59c7250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:57322/0 (socket says 172.21.15.19:57322) 2024-09-10T22:35:40.595 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:40.532+0000 7feb96d9d640 1 -- 172.21.15.19:0/327565958 learned_addr learned my addr 172.21.15.19:0/327565958 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:35:40.595 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:40.532+0000 7feb9759e640 1 --2- 172.21.15.19:0/327565958 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5580f59baee0 0x5580f59bb2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:35:40.596 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:40.532+0000 7feb9659c640 1 --2- 172.21.15.19:0/327565958 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5580f59c7790 0x5580f59c9b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:35:40.596 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:40.532+0000 7feb96d9d640 1 -- 172.21.15.19:0/327565958 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5580f59c7790 msgr2=0x5580f59c9b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:35:40.596 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:40.532+0000 7feb96d9d640 1 --2- 172.21.15.19:0/327565958 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5580f59c7790 0x5580f59c9b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:35:40.596 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:40.532+0000 7feb96d9d640 1 -- 172.21.15.19:0/327565958 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5580f59baee0 msgr2=0x5580f59bb2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:35:40.596 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:40.532+0000 7feb96d9d640 1 --2- 172.21.15.19:0/327565958 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5580f59baee0 0x5580f59bb2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:35:40.596 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:40.532+0000 7feb96d9d640 1 -- 172.21.15.19:0/327565958 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5580f567f930 con 0x5580f59bb800 2024-09-10T22:35:40.596 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:40.532+0000 7feb9759e640 1 --2- 172.21.15.19:0/327565958 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5580f59baee0 0x5580f59bb2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T22:35:40.596 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:40.532+0000 7feb7ffff640 1 --2- 172.21.15.19:0/253124785 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7feb800b52e0 0x7feb800b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:35:40.596 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:40.532+0000 7feb96d9d640 1 --2- 172.21.15.19:0/327565958 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5580f59bb800 0x5580f59c7250 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7feb88009d00 tx=0x7feb88011810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bd5d420cf5c48e30 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:35:40.596 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:40.532+0000 7feb9759e640 1 --2- 172.21.15.19:0/253124785 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7feb800b52e0 0x7feb800b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:35:40.596 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:40.533+0000 7feb7ffff640 1 -- 172.21.15.19:0/253124785 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8327+0+0 (secure 0 0 0) 0x7feb8c105800 con 0x7feb98105590 2024-09-10T22:35:40.596 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:40.533+0000 7feb7d7fa640 1 -- 172.21.15.19:0/327565958 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb8801e070 con 0x5580f59bb800 2024-09-10T22:35:40.596 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:40.533+0000 7feb7d7fa640 1 -- 172.21.15.19:0/327565958 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7feb88019ae0 con 0x5580f59bb800 2024-09-10T22:35:40.597 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:40.533+0000 7feb7d7fa640 1 -- 172.21.15.19:0/327565958 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb8800eab0 con 0x5580f59bb800 2024-09-10T22:35:40.597 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:40.533+0000 7feb9759e640 1 --2- 172.21.15.19:0/253124785 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7feb800b52e0 0x7feb800b77a0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7feb90005fd0 tx=0x7feb90009500 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:35:40.597 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:40.533+0000 7feb9f405740 1 -- 172.21.15.19:0/327565958 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5580f59bb800 msgr2=0x5580f59c7250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:35:40.597 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:40.533+0000 7feb9f405740 1 --2- 172.21.15.19:0/327565958 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5580f59bb800 0x5580f59c7250 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7feb88009d00 tx=0x7feb88011810 comp rx=0 tx=0).stop 2024-09-10T22:35:40.597 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:40.534+0000 7feb9f405740 1 -- 172.21.15.19:0/327565958 shutdown_connections 2024-09-10T22:35:40.597 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:40.534+0000 7feb9f405740 1 --2- 172.21.15.19:0/327565958 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5580f59c7790 0x5580f59c9b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:35:40.597 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:40.534+0000 7feb9f405740 1 --2- 172.21.15.19:0/327565958 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5580f59bb800 0x5580f59c7250 unknown :-1 s=CLOSED pgs=782 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:35:40.597 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:40.534+0000 7feb9f405740 1 --2- 172.21.15.19:0/327565958 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5580f59baee0 0x5580f59bb2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:35:40.597 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:40.534+0000 7feb9f405740 1 -- 172.21.15.19:0/327565958 >> 172.21.15.19:0/327565958 conn(0x5580f59b8d10 msgr2=0x5580f59b9eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:35:40.597 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:40.534+0000 7feb9f405740 1 -- 172.21.15.19:0/327565958 shutdown_connections 2024-09-10T22:35:40.597 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:40.534+0000 7feb9f405740 1 -- 172.21.15.19:0/327565958 wait complete. 2024-09-10T22:35:40.597 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:40.534+0000 7feb9f405740 1 -- start start 2024-09-10T22:35:40.597 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:40.534+0000 7feb9f405740 1 Processor -- start 2024-09-10T22:35:40.598 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:40.534+0000 7feb9f405740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5580f59baee0 0x5580f59c4840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:35:40.598 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:40.534+0000 7feb9f405740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5580f59bb800 0x5580f59c4d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:35:40.598 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:40.534+0000 7feb9f405740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5580f59c7790 0x5580f59c52c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:35:40.598 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:40.534+0000 7feb9f405740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x5580f5782890 con 0x5580f59c7790 2024-09-10T22:35:40.598 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:40.534+0000 7feb9f405740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x5580f58bbd40 con 0x5580f59bb800 2024-09-10T22:35:40.598 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:40.534+0000 7feb9f405740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x5580f59ca440 con 0x5580f59baee0 2024-09-10T22:35:40.598 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:40.534+0000 7feb9f405740 10 client.0 _ll_register_callbacks cb 0x5580f591fc80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T22:35:40.598 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:40.535+0000 7feb9659c640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5580f59bb800 0x5580f59c4d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:35:40.598 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:40.535+0000 7feb9759e640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5580f59c7790 0x5580f59c52c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:35:40.598 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:40.535+0000 7feb96d9d640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5580f59baee0 0x5580f59c4840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:35:40.598 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:40.535+0000 7feb9659c640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5580f59bb800 0x5580f59c4d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.19:54512/0 (socket says 172.21.15.19:54512) 2024-09-10T22:35:40.598 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:40.535+0000 7feb9659c640 1 -- 172.21.15.19:0/1553713178 learned_addr learned my addr 172.21.15.19:0/1553713178 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:35:40.598 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:40.535+0000 7feb9759e640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5580f59c7790 0x5580f59c52c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:57338/0 (socket says 172.21.15.19:57338) 2024-09-10T22:35:40.599 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:40.535+0000 7feb9659c640 1 -- 172.21.15.19:0/1553713178 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5580f59baee0 msgr2=0x5580f59c4840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:35:40.599 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:40.535+0000 7feb9659c640 1 --2- 172.21.15.19:0/1553713178 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5580f59baee0 0x5580f59c4840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:35:40.599 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:40.535+0000 7feb9659c640 1 -- 172.21.15.19:0/1553713178 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5580f59c7790 msgr2=0x5580f59c52c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:35:40.599 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:40.535+0000 7feb9659c640 1 --2- 172.21.15.19:0/1553713178 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5580f59c7790 0x5580f59c52c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:35:40.599 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:40.535+0000 7feb9659c640 1 -- 172.21.15.19:0/1553713178 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5580f59d3920 con 0x5580f59bb800 2024-09-10T22:35:40.599 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:40.535+0000 7feb96d9d640 1 --2- 172.21.15.19:0/1553713178 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5580f59baee0 0x5580f59c4840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T22:35:40.599 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:40.535+0000 7feb9659c640 1 --2- 172.21.15.19:0/1553713178 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5580f59bb800 0x5580f59c4d80 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7feb8c02a930 tx=0x7feb8c009550 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ff89fd637a910184 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:35:40.599 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:40.535+0000 7feb7aff5640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-09-10T22:35:40.599 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:40.535+0000 7feb7aff5640 1 -- 172.21.15.19:0/1553713178 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb8c0cbd30 con 0x5580f59bb800 2024-09-10T22:35:40.599 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:40.535+0000 7feb9f405740 1 -- 172.21.15.19:0/1553713178 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7feb88019ae0 con 0x5580f59bb800 2024-09-10T22:35:40.599 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:40.535+0000 7feb7aff5640 1 -- 172.21.15.19:0/1553713178 <== mon.2 v2:172.21.15.135:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8327+0+0 (secure 0 0 0) 0x7feb8c0d5060 con 0x5580f59bb800 2024-09-10T22:35:40.599 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:40.535+0000 7feb7aff5640 1 -- 172.21.15.19:0/1553713178 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7feb8c0cb6d0 con 0x5580f59bb800 2024-09-10T22:35:40.599 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:40.535+0000 7feb9f405740 10 client.26525 fetch_fsmap learned FSMap version 27 2024-09-10T22:35:40.600 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:40.536+0000 7feb9f405740 1 -- 172.21.15.19:0/1553713178 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x5580f59d62b0 con 0x5580f59bb800 2024-09-10T22:35:40.600 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:40.536+0000 7feb7aff5640 1 -- 172.21.15.19:0/1553713178 <== mon.2 v2:172.21.15.135:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7feb88019ae0 con 0x5580f59bb800 2024-09-10T22:35:40.600 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:40.536+0000 7feb7aff5640 1 -- 172.21.15.19:0/1553713178 <== mon.2 v2:172.21.15.135:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7feb8c0c78b0 con 0x5580f59bb800 2024-09-10T22:35:40.600 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:40.536+0000 7feb9f405740 10 client.26525 fetch_fsmap finished waiting for FSMap version 27 2024-09-10T22:35:40.600 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:40.536+0000 7feb9f405740 10 client.26525 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-10T22:35:40.600 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:40.536+0000 7feb9f405740 20 client.26525 populate_metadata read hostname 'smithi019' 2024-09-10T22:35:40.600 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:40.536+0000 7feb9f405740 1 --2- 172.21.15.19:0/1553713178 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x5580f59d76c0 0x5580f59d9b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:35:40.600 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:40.536+0000 7feb9f405740 4 client.26525 mds_command: new command op to 24581 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T22:35:40.600 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:40.536+0000 7feb9f405740 1 -- 172.21.15.19:0/1553713178 --> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5580f5933db0 con 0x5580f59d76c0 2024-09-10T22:35:40.600 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:40.536+0000 7feb96d9d640 1 --2- 172.21.15.19:0/1553713178 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x5580f59d76c0 0x5580f59d9b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:35:40.600 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:40.537+0000 7feb7aff5640 10 client.26525 ms_handle_connect on v2:172.21.15.135:6838/1254769802 2024-09-10T22:35:40.600 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:40.537+0000 7feb96d9d640 1 --2- 172.21.15.19:0/1553713178 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x5580f59d76c0 0x5580f59d9b30 crc :-1 s=READY pgs=186 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=acfaa1c0c13b01c4 server_cookie=32ae8bfdf818ac1 in_seq=0 out_seq=0 2024-09-10T22:35:40.601 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:40.537+0000 7feb7aff5640 1 -- 172.21.15.19:0/1553713178 <== mds.0 v2:172.21.15.135:6838/1254769802 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5580f5933db0 con 0x5580f59d76c0 2024-09-10T22:35:40.601 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:40.537+0000 7feb7aff5640 10 client.26525 handle_command_reply: tid=0 2024-09-10T22:35:40.601 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:40.537+0000 7feb9f405740 1 client.26525 shutdown 2024-09-10T22:35:40.601 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:40.537+0000 7feb9f405740 1 -- 172.21.15.19:0/1553713178 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5580f59bb800 msgr2=0x5580f59c4d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:35:40.601 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:40.537+0000 7feb9f405740 1 --2- 172.21.15.19:0/1553713178 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5580f59bb800 0x5580f59c4d80 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7feb8c02a930 tx=0x7feb8c009550 comp rx=0 tx=0).stop 2024-09-10T22:35:40.601 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:40.537+0000 7feb9f405740 1 -- 172.21.15.19:0/1553713178 shutdown_connections 2024-09-10T22:35:40.601 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:40.537+0000 7feb9f405740 1 --2- 172.21.15.19:0/1553713178 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5580f59c7790 0x5580f59c52c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:35:40.601 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:40.537+0000 7feb9f405740 1 --2- 172.21.15.19:0/1553713178 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5580f59bb800 0x5580f59c4d80 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:35:40.601 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:40.537+0000 7feb9f405740 1 --2- 172.21.15.19:0/1553713178 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x5580f59d76c0 0x5580f59d9b30 crc :-1 s=READY pgs=186 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:35:40.601 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:40.538+0000 7feb9f405740 1 --2- 172.21.15.19:0/1553713178 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5580f59baee0 0x5580f59c4840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:35:40.601 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:40.538+0000 7feb7aff5640 0 client.26525 ms_handle_reset on v2:172.21.15.135:6838/1254769802 2024-09-10T22:35:40.601 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:40.538+0000 7feb9f405740 1 -- 172.21.15.19:0/1553713178 >> 172.21.15.19:0/1553713178 conn(0x5580f59b8d10 msgr2=0x5580f59b7f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:35:40.601 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:40.538+0000 7feb9f405740 1 -- 172.21.15.19:0/1553713178 shutdown_connections 2024-09-10T22:35:40.602 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:40.538+0000 7feb9f405740 1 -- 172.21.15.19:0/1553713178 wait complete. 2024-09-10T22:35:40.602 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:40.538+0000 7feb9f405740 20 client.26525 trim_cache size 0 max 16384 2024-09-10T22:35:40.602 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:40.556+0000 7feb9f405740 1 Processor -- start 2024-09-10T22:35:40.602 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:40.556+0000 7feb9f405740 1 -- start start 2024-09-10T22:35:40.602 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:40.556+0000 7feb9f405740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5580f59baee0 0x5580f59c2370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:35:40.602 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:40.557+0000 7feb9f405740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5580f59bb800 0x5580f59b99f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:35:40.602 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:40.557+0000 7feb9f405740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5580f59c7790 0x5580f59b9f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:35:40.602 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:40.557+0000 7feb9f405740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7feb981b2f40 con 0x5580f59c7790 2024-09-10T22:35:40.602 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:40.557+0000 7feb9f405740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7feb981b0810 con 0x5580f59bb800 2024-09-10T22:35:40.602 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:40.557+0000 7feb9f405740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7feb981ae660 con 0x5580f59baee0 2024-09-10T22:35:40.602 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:40.557+0000 7feb9759e640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5580f59c7790 0x5580f59b9f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:35:40.602 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:40.557+0000 7feb9759e640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5580f59c7790 0x5580f59b9f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:57342/0 (socket says 172.21.15.19:57342) 2024-09-10T22:35:40.602 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:40.557+0000 7feb9759e640 1 -- 172.21.15.19:0/4242655076 learned_addr learned my addr 172.21.15.19:0/4242655076 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:35:40.603 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:40.557+0000 7feb96d9d640 1 --2- 172.21.15.19:0/4242655076 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5580f59baee0 0x5580f59c2370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:35:40.603 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:40.557+0000 7feb9659c640 1 --2- 172.21.15.19:0/4242655076 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5580f59bb800 0x5580f59b99f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:35:40.603 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:40.557+0000 7feb96d9d640 1 -- 172.21.15.19:0/4242655076 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5580f59bb800 msgr2=0x5580f59b99f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:35:40.603 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:40.557+0000 7feb96d9d640 1 --2- 172.21.15.19:0/4242655076 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5580f59bb800 0x5580f59b99f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:35:40.603 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:40.557+0000 7feb96d9d640 1 -- 172.21.15.19:0/4242655076 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5580f59c7790 msgr2=0x5580f59b9f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:35:40.603 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:40.557+0000 7feb96d9d640 1 --2- 172.21.15.19:0/4242655076 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5580f59c7790 0x5580f59b9f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:35:40.603 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:40.557+0000 7feb96d9d640 1 -- 172.21.15.19:0/4242655076 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5580f59c37a0 con 0x5580f59baee0 2024-09-10T22:35:40.603 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:40.557+0000 7feb96d9d640 1 --2- 172.21.15.19:0/4242655076 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5580f59baee0 0x5580f59c2370 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7feb88000c00 tx=0x7feb88012f90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1d90d40d28609462 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:35:40.603 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:40.557+0000 7feb7cff9640 1 -- 172.21.15.19:0/4242655076 <== mon.1 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb88030070 con 0x5580f59baee0 2024-09-10T22:35:40.603 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:40.557+0000 7feb7cff9640 1 -- 172.21.15.19:0/4242655076 <== mon.1 v2:172.21.15.138:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7feb880097e0 con 0x5580f59baee0 2024-09-10T22:35:40.603 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:40.557+0000 7feb7cff9640 1 -- 172.21.15.19:0/4242655076 <== mon.1 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb8801e040 con 0x5580f59baee0 2024-09-10T22:35:40.603 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:40.558+0000 7feb9f405740 1 -- 172.21.15.19:0/4242655076 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5580f59baee0 msgr2=0x5580f59c2370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:35:40.603 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:40.558+0000 7feb9f405740 1 --2- 172.21.15.19:0/4242655076 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5580f59baee0 0x5580f59c2370 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7feb88000c00 tx=0x7feb88012f90 comp rx=0 tx=0).stop 2024-09-10T22:35:40.603 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:40.558+0000 7feb9f405740 1 -- 172.21.15.19:0/4242655076 shutdown_connections 2024-09-10T22:35:40.604 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:40.558+0000 7feb9f405740 1 --2- 172.21.15.19:0/4242655076 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5580f59c7790 0x5580f59b9f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:35:40.604 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:40.558+0000 7feb9f405740 1 --2- 172.21.15.19:0/4242655076 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5580f59bb800 0x5580f59b99f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:35:40.604 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:40.558+0000 7feb9f405740 1 --2- 172.21.15.19:0/4242655076 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5580f59baee0 0x5580f59c2370 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:35:40.604 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:40.558+0000 7feb9f405740 1 -- 172.21.15.19:0/4242655076 >> 172.21.15.19:0/4242655076 conn(0x5580f59b8d10 msgr2=0x5580f59c1c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:35:40.604 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:40.558+0000 7feb9f405740 1 -- 172.21.15.19:0/4242655076 shutdown_connections 2024-09-10T22:35:40.604 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:40.558+0000 7feb9f405740 1 -- 172.21.15.19:0/4242655076 wait complete. 2024-09-10T22:35:40.604 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:40.558+0000 7feb9f405740 1 -- start start 2024-09-10T22:35:40.604 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:40.559+0000 7feb9f405740 1 Processor -- start 2024-09-10T22:35:40.604 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:40.559+0000 7feb9f405740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5580f59baee0 0x5580f59cf6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:35:40.604 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:40.559+0000 7feb9f405740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5580f59bb800 0x5580f59cfc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:35:40.604 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:40.559+0000 7feb9f405740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5580f59c7790 0x5580f59ca690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:35:40.604 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:40.559+0000 7feb9f405740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7feb981aecd0 con 0x5580f59bb800 2024-09-10T22:35:40.604 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:40.559+0000 7feb9f405740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7feb981b0140 con 0x5580f59baee0 2024-09-10T22:35:40.605 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:40.559+0000 7feb9f405740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7feb981af3a0 con 0x5580f59c7790 2024-09-10T22:35:40.605 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:40.559+0000 7feb9f405740 10 client.0 _ll_register_callbacks cb 0x7feb8c0057a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T22:35:40.605 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:40.559+0000 7feb9659c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5580f59bb800 0x5580f59cfc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:35:40.605 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:40.559+0000 7feb9659c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5580f59bb800 0x5580f59cfc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:57344/0 (socket says 172.21.15.19:57344) 2024-09-10T22:35:40.605 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:40.559+0000 7feb9659c640 1 -- 172.21.15.19:0/3523917370 learned_addr learned my addr 172.21.15.19:0/3523917370 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:35:40.605 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:40.559+0000 7feb96d9d640 1 --2- 172.21.15.19:0/3523917370 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5580f59baee0 0x5580f59cf6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:35:40.605 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:40.559+0000 7feb9659c640 1 -- 172.21.15.19:0/3523917370 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5580f59c7790 msgr2=0x5580f59ca690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:35:40.605 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:40.559+0000 7feb9659c640 1 --2- 172.21.15.19:0/3523917370 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5580f59c7790 0x5580f59ca690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:35:40.605 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:40.559+0000 7feb9659c640 1 -- 172.21.15.19:0/3523917370 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5580f59baee0 msgr2=0x5580f59cf6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:35:40.605 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:40.559+0000 7feb9659c640 1 --2- 172.21.15.19:0/3523917370 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5580f59baee0 0x5580f59cf6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:35:40.605 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:40.559+0000 7feb9659c640 1 -- 172.21.15.19:0/3523917370 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5580f59d0450 con 0x5580f59bb800 2024-09-10T22:35:40.605 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:40.559+0000 7feb96d9d640 1 --2- 172.21.15.19:0/3523917370 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5580f59baee0 0x5580f59cf6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T22:35:40.605 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:40.560+0000 7feb9659c640 1 --2- 172.21.15.19:0/3523917370 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5580f59bb800 0x5580f59cfc20 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x7feb8c0d0ad0 tx=0x7feb8c0303b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=34e4ce0edf95f6e4 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:35:40.606 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:40.560+0000 7feb7aff5640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-10T22:35:40.606 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:40.560+0000 7feb7aff5640 1 -- 172.21.15.19:0/3523917370 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb8c0cb8b0 con 0x5580f59bb800 2024-09-10T22:35:40.606 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:40.560+0000 7feb7aff5640 1 -- 172.21.15.19:0/3523917370 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8327+0+0 (secure 0 0 0) 0x7feb8c0d5260 con 0x5580f59bb800 2024-09-10T22:35:40.606 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:40.560+0000 7feb9f405740 1 -- 172.21.15.19:0/3523917370 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7feb880097e0 con 0x5580f59bb800 2024-09-10T22:35:40.606 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:40.560+0000 7feb7aff5640 1 -- 172.21.15.19:0/3523917370 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7feb8c0cbd30 con 0x5580f59bb800 2024-09-10T22:35:40.606 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:40.560+0000 7feb9f405740 10 client.17217 fetch_fsmap learned FSMap version 27 2024-09-10T22:35:40.606 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:40.560+0000 7feb9f405740 1 -- 172.21.15.19:0/3523917370 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x5580f5a44bb0 con 0x5580f59bb800 2024-09-10T22:35:40.606 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:40.560+0000 7feb7aff5640 1 -- 172.21.15.19:0/3523917370 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7feb880097e0 con 0x5580f59bb800 2024-09-10T22:35:40.606 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:40.560+0000 7feb7aff5640 1 -- 172.21.15.19:0/3523917370 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7feb8c0b71a0 con 0x5580f59bb800 2024-09-10T22:35:40.606 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:40.560+0000 7feb9f405740 10 client.17217 fetch_fsmap finished waiting for FSMap version 27 2024-09-10T22:35:40.606 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:40.560+0000 7feb9f405740 10 client.17217 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-10T22:35:40.606 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:40.560+0000 7feb9f405740 20 client.17217 populate_metadata read hostname 'smithi019' 2024-09-10T22:35:40.606 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:40.560+0000 7feb9f405740 1 --2- 172.21.15.19:0/3523917370 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x5580f5a45110 0x5580f5a47530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:35:40.607 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:40.560+0000 7feb9f405740 4 client.17217 mds_command: new command op to 24581 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-10T22:35:40.607 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:40.560+0000 7feb9f405740 1 -- 172.21.15.19:0/3523917370 --> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x5580f592f860 con 0x5580f5a45110 2024-09-10T22:35:40.607 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:40.561+0000 7feb96d9d640 1 --2- 172.21.15.19:0/3523917370 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x5580f5a45110 0x5580f5a47530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:35:40.607 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:40.561+0000 7feb7aff5640 10 client.17217 ms_handle_connect on v2:172.21.15.135:6838/1254769802 2024-09-10T22:35:40.607 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:40.561+0000 7feb96d9d640 1 --2- 172.21.15.19:0/3523917370 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x5580f5a45110 0x5580f5a47530 crc :-1 s=READY pgs=187 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f486da9e30de1a47 server_cookie=276504ee94ba2426 in_seq=0 out_seq=0 2024-09-10T22:35:40.607 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:40.563+0000 7feb7aff5640 1 -- 172.21.15.19:0/3523917370 <== mds.0 v2:172.21.15.135:6838/1254769802 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x5580f592f860 con 0x5580f5a45110 2024-09-10T22:35:40.607 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:40.563+0000 7feb7aff5640 10 client.17217 handle_command_reply: tid=0 2024-09-10T22:35:40.607 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:40.563+0000 7feb9f405740 1 client.17217 shutdown 2024-09-10T22:35:40.607 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:40.563+0000 7feb9f405740 1 -- 172.21.15.19:0/3523917370 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5580f59bb800 msgr2=0x5580f59cfc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:35:40.607 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:40.563+0000 7feb9f405740 1 --2- 172.21.15.19:0/3523917370 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5580f59bb800 0x5580f59cfc20 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x7feb8c0d0ad0 tx=0x7feb8c0303b0 comp rx=0 tx=0).stop 2024-09-10T22:35:40.607 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:40.563+0000 7feb9f405740 1 -- 172.21.15.19:0/3523917370 shutdown_connections 2024-09-10T22:35:40.607 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:40.563+0000 7feb9f405740 1 --2- 172.21.15.19:0/3523917370 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x5580f5a45110 0x5580f5a47530 crc :-1 s=READY pgs=187 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:35:40.607 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:40.563+0000 7feb9f405740 1 --2- 172.21.15.19:0/3523917370 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5580f59c7790 0x5580f59ca690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:35:40.608 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:40.563+0000 7feb9f405740 1 --2- 172.21.15.19:0/3523917370 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5580f59bb800 0x5580f59cfc20 unknown :-1 s=CLOSED pgs=783 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:35:40.608 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:40.563+0000 7feb9f405740 1 --2- 172.21.15.19:0/3523917370 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5580f59baee0 0x5580f59cf6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:35:40.608 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:40.563+0000 7feb9f405740 1 -- 172.21.15.19:0/3523917370 >> 172.21.15.19:0/3523917370 conn(0x5580f59b8d10 msgr2=0x5580f59c47b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:35:40.608 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:40.563+0000 7feb7aff5640 0 client.17217 ms_handle_reset on v2:172.21.15.135:6838/1254769802 2024-09-10T22:35:40.608 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:40.563+0000 7feb9f405740 1 -- 172.21.15.19:0/3523917370 shutdown_connections 2024-09-10T22:35:40.608 INFO:teuthology.orchestra.run.smithi019.stdout:{ 2024-09-10T22:35:40.608 INFO:teuthology.orchestra.run.smithi019.stdout: "return_code": 0, 2024-09-10T22:35:40.608 INFO:teuthology.orchestra.run.smithi019.stdout: "scrub_tag": "1a6e9f60-01cc-4339-aff0-9ef63cbda443", 2024-09-10T22:35:40.608 INFO:teuthology.orchestra.run.smithi019.stdout: "mode": "asynchronous" 2024-09-10T22:35:40.608 INFO:teuthology.orchestra.run.smithi019.stdout:} 2024-09-10T22:35:40.609 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:40.563+0000 7feb9f405740 1 -- 172.21.15.19:0/3523917370 wait complete. 2024-09-10T22:35:40.609 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:40.563+0000 7feb9f405740 20 client.17217 trim_cache size 0 max 16384 2024-09-10T22:35:40.609 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:40.564+0000 7feb9d030640 1 -- 172.21.15.19:0/253124785 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7feb800b52e0 msgr2=0x7feb800b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:35:40.609 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:40.564+0000 7feb9d030640 1 --2- 172.21.15.19:0/253124785 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7feb800b52e0 0x7feb800b77a0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7feb90005fd0 tx=0x7feb90009500 comp rx=0 tx=0).stop 2024-09-10T22:35:40.609 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:40.564+0000 7feb9d030640 1 -- 172.21.15.19:0/253124785 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7feb98105590 msgr2=0x7feb9819b9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:35:40.609 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:40.564+0000 7feb9d030640 1 --2- 172.21.15.19:0/253124785 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7feb98105590 0x7feb9819b9b0 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7feb8c035040 tx=0x7feb8c032d50 comp rx=0 tx=0).stop 2024-09-10T22:35:40.609 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:40.564+0000 7feb9d030640 1 -- 172.21.15.19:0/253124785 shutdown_connections 2024-09-10T22:35:40.609 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:40.564+0000 7feb9d030640 1 --2- 172.21.15.19:0/253124785 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7feb800b52e0 0x7feb800b77a0 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:35:40.609 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:40.564+0000 7feb9d030640 1 --2- 172.21.15.19:0/253124785 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7feb98105f10 0x7feb981a0d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:35:40.609 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:40.564+0000 7feb9d030640 1 --2- 172.21.15.19:0/253124785 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7feb98105590 0x7feb9819b9b0 unknown :-1 s=CLOSED pgs=781 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:35:40.610 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:40.564+0000 7feb9d030640 1 --2- 172.21.15.19:0/253124785 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7feb981011e0 0x7feb9819b470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:35:40.610 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:40.564+0000 7feb9d030640 1 -- 172.21.15.19:0/253124785 >> 172.21.15.19:0/253124785 conn(0x7feb98078100 msgr2=0x7feb98108ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:35:40.610 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:40.564+0000 7feb9d030640 1 -- 172.21.15.19:0/253124785 shutdown_connections 2024-09-10T22:35:40.610 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:40.564+0000 7feb9d030640 1 -- 172.21.15.19:0/253124785 wait complete. 2024-09-10T22:35:40.610 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:35:40 smithi135 ceph-mon[34789]: pgmap v624: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 445 KiB/s rd, 198 MiB/s wr, 327 op/s 2024-09-10T22:35:40.625 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:35:40 smithi138 ceph-mon[35236]: pgmap v624: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 445 KiB/s rd, 198 MiB/s wr, 327 op/s 2024-09-10T22:35:41.209 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:35:41 smithi019 ceph-mon[31375]: scrub summary: active paths [/] 2024-09-10T22:35:41.209 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:35:41 smithi019 ceph-mon[31375]: scrub summary: idle+waiting paths [/] 2024-09-10T22:35:41.575 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 22997a4c-6fc2-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-10T22:35:41.610 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:35:41 smithi135 ceph-mon[34789]: scrub summary: active paths [/] 2024-09-10T22:35:41.610 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:35:41 smithi135 ceph-mon[34789]: scrub summary: idle+waiting paths [/] 2024-09-10T22:35:41.625 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:35:41 smithi138 ceph-mon[35236]: scrub summary: active paths [/] 2024-09-10T22:35:41.625 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:35:41 smithi138 ceph-mon[35236]: scrub summary: idle+waiting paths [/] 2024-09-10T22:35:41.846 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/22997a4c-6fc2-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T22:35:42.357 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:35:42 smithi019 ceph-mon[31375]: scrub queued for path: / 2024-09-10T22:35:42.357 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:35:42 smithi019 ceph-mon[31375]: scrub summary: idle+waiting paths [/] 2024-09-10T22:35:42.357 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:35:42 smithi019 ceph-mon[31375]: scrub summary: active paths [/] 2024-09-10T22:35:42.357 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:35:42 smithi019 ceph-mon[31375]: pgmap v625: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 498 KiB/s rd, 242 MiB/s wr, 296 op/s 2024-09-10T22:35:42.357 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:35:42 smithi019 ceph-mon[31375]: scrub summary: idle+waiting paths [/] 2024-09-10T22:35:42.610 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:35:42 smithi135 ceph-mon[34789]: scrub queued for path: / 2024-09-10T22:35:42.610 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:35:42 smithi135 ceph-mon[34789]: scrub summary: idle+waiting paths [/] 2024-09-10T22:35:42.610 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:35:42 smithi135 ceph-mon[34789]: scrub summary: active paths [/] 2024-09-10T22:35:42.610 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:35:42 smithi135 ceph-mon[34789]: pgmap v625: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 498 KiB/s rd, 242 MiB/s wr, 296 op/s 2024-09-10T22:35:42.610 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:35:42 smithi135 ceph-mon[34789]: scrub summary: idle+waiting paths [/] 2024-09-10T22:35:42.625 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:35:42 smithi138 ceph-mon[35236]: scrub queued for path: / 2024-09-10T22:35:42.625 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:35:42 smithi138 ceph-mon[35236]: scrub summary: idle+waiting paths [/] 2024-09-10T22:35:42.625 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:35:42 smithi138 ceph-mon[35236]: scrub summary: active paths [/] 2024-09-10T22:35:42.625 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:35:42 smithi138 ceph-mon[35236]: pgmap v625: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 498 KiB/s rd, 242 MiB/s wr, 296 op/s 2024-09-10T22:35:42.626 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:35:42 smithi138 ceph-mon[35236]: scrub summary: idle+waiting paths [/] 2024-09-10T22:35:42.835 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:42.729+0000 7fb52c19e640 1 -- 172.21.15.19:0/3917495590 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb524109170 msgr2=0x7fb52410f970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:35:42.835 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:42.729+0000 7fb52c19e640 1 --2- 172.21.15.19:0/3917495590 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb524109170 0x7fb52410f970 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 crypto rx=0x7fb51c009ca0 tx=0x7fb51c02a8c0 comp rx=0 tx=0).stop 2024-09-10T22:35:42.835 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:42.729+0000 7fb52c19e640 1 -- 172.21.15.19:0/3917495590 shutdown_connections 2024-09-10T22:35:42.835 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:42.729+0000 7fb52c19e640 1 --2- 172.21.15.19:0/3917495590 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb524109170 0x7fb52410f970 unknown :-1 s=CLOSED pgs=784 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:35:42.835 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:42.729+0000 7fb52c19e640 1 --2- 172.21.15.19:0/3917495590 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb5241087f0 0x7fb524108c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:35:42.835 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:42.729+0000 7fb52c19e640 1 --2- 172.21.15.19:0/3917495590 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb524102de0 0x7fb5241031c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:35:42.835 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:42.729+0000 7fb52c19e640 1 -- 172.21.15.19:0/3917495590 >> 172.21.15.19:0/3917495590 conn(0x7fb5240fe830 msgr2=0x7fb524100c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:35:42.835 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:42.730+0000 7fb52c19e640 1 -- 172.21.15.19:0/3917495590 shutdown_connections 2024-09-10T22:35:42.836 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:42.730+0000 7fb52c19e640 1 -- 172.21.15.19:0/3917495590 wait complete. 2024-09-10T22:35:42.836 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:42.730+0000 7fb52c19e640 1 Processor -- start 2024-09-10T22:35:42.836 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:42.730+0000 7fb52c19e640 1 -- start start 2024-09-10T22:35:42.836 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:42.731+0000 7fb52c19e640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb524102de0 0x7fb524076f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:35:42.836 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:42.731+0000 7fb52c19e640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb5241087f0 0x7fb5240754a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:35:42.836 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:42.731+0000 7fb52c19e640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb524109170 0x7fb524075ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:35:42.836 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:42.731+0000 7fb52c19e640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fb524112e30 con 0x7fb524109170 2024-09-10T22:35:42.836 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:42.731+0000 7fb52c19e640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fb524112cb0 con 0x7fb524102de0 2024-09-10T22:35:42.836 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:42.731+0000 7fb52c19e640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7fb524112fb0 con 0x7fb5241087f0 2024-09-10T22:35:42.836 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:42.731+0000 7fb529f3a640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb524102de0 0x7fb524076f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:35:42.836 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:42.731+0000 7fb52a73b640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb524109170 0x7fb524075ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:35:42.836 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:42.731+0000 7fb529f3a640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb524102de0 0x7fb524076f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.19:54528/0 (socket says 172.21.15.19:54528) 2024-09-10T22:35:42.836 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:42.731+0000 7fb52a73b640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb524109170 0x7fb524075ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:57374/0 (socket says 172.21.15.19:57374) 2024-09-10T22:35:42.837 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:42.731+0000 7fb529f3a640 1 -- 172.21.15.19:0/2556223956 learned_addr learned my addr 172.21.15.19:0/2556223956 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:35:42.837 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:42.731+0000 7fb529739640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb5241087f0 0x7fb5240754a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:35:42.837 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:42.731+0000 7fb529f3a640 1 -- 172.21.15.19:0/2556223956 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb5241087f0 msgr2=0x7fb5240754a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:35:42.837 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:42.731+0000 7fb529f3a640 1 --2- 172.21.15.19:0/2556223956 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb5241087f0 0x7fb5240754a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:35:42.837 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:42.731+0000 7fb529f3a640 1 -- 172.21.15.19:0/2556223956 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb524109170 msgr2=0x7fb524075ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:35:42.837 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:42.731+0000 7fb529f3a640 1 --2- 172.21.15.19:0/2556223956 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb524109170 0x7fb524075ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:35:42.837 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:42.731+0000 7fb529f3a640 1 -- 172.21.15.19:0/2556223956 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb5241abb80 con 0x7fb524102de0 2024-09-10T22:35:42.837 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:42.732+0000 7fb529f3a640 1 --2- 172.21.15.19:0/2556223956 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb524102de0 0x7fb524076f50 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fb52000e9f0 tx=0x7fb52000eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:35:42.838 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:42.732+0000 7fb51affd640 1 -- 172.21.15.19:0/2556223956 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb52000cd80 con 0x7fb524102de0 2024-09-10T22:35:42.838 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:42.732+0000 7fb51affd640 1 -- 172.21.15.19:0/2556223956 <== mon.2 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb5200108e0 con 0x7fb524102de0 2024-09-10T22:35:42.838 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:42.732+0000 7fb51affd640 1 -- 172.21.15.19:0/2556223956 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb520018980 con 0x7fb524102de0 2024-09-10T22:35:42.838 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:42.732+0000 7fb52c19e640 1 -- 172.21.15.19:0/2556223956 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb5241abd50 con 0x7fb524102de0 2024-09-10T22:35:42.838 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:42.732+0000 7fb52c19e640 1 -- 172.21.15.19:0/2556223956 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb5241ac250 con 0x7fb524102de0 2024-09-10T22:35:42.839 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:42.735+0000 7fb52e573740 1 Processor -- start 2024-09-10T22:35:42.839 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:42.735+0000 7fb52e573740 1 -- start start 2024-09-10T22:35:42.839 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:42.735+0000 7fb51affd640 1 -- 172.21.15.19:0/2556223956 <== mon.2 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 18) ==== 153250+0+0 (secure 0 0 0) 0x7fb520010430 con 0x7fb524102de0 2024-09-10T22:35:42.839 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:42.736+0000 7fb52e573740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557da6fe7480 0x557da6fe7860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:35:42.839 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:42.736+0000 7fb52e573740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x557da6fe7da0 0x557da6ff37f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:35:42.839 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:42.736+0000 7fb52e573740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x557da6ff3d30 0x557da6ff6120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:35:42.840 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:42.736+0000 7fb52e573740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x557da6f5de50 con 0x557da6ff3d30 2024-09-10T22:35:42.840 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:42.736+0000 7fb52e573740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x557da6f4d280 con 0x557da6fe7480 2024-09-10T22:35:42.840 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:42.736+0000 7fb52e573740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x557da6f51090 con 0x557da6fe7da0 2024-09-10T22:35:42.840 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:42.736+0000 7fb529f3a640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x557da6fe7da0 0x557da6ff37f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:35:42.840 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:42.736+0000 7fb52a73b640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557da6fe7480 0x557da6fe7860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:35:42.841 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:42.736+0000 7fb52a73b640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557da6fe7480 0x557da6fe7860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.19:54544/0 (socket says 172.21.15.19:54544) 2024-09-10T22:35:42.841 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:42.736+0000 7fb52a73b640 1 -- 172.21.15.19:0/206068127 learned_addr learned my addr 172.21.15.19:0/206068127 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:35:42.841 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:42.736+0000 7fb529f3a640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x557da6fe7da0 0x557da6ff37f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.19:33848/0 (socket says 172.21.15.19:33848) 2024-09-10T22:35:42.841 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:42.736+0000 7fb529739640 1 --2- 172.21.15.19:0/206068127 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x557da6ff3d30 0x557da6ff6120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:35:42.841 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:42.736+0000 7fb52a73b640 1 -- 172.21.15.19:0/206068127 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x557da6fe7da0 msgr2=0x557da6ff37f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:35:42.841 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:42.736+0000 7fb52a73b640 1 --2- 172.21.15.19:0/206068127 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x557da6fe7da0 0x557da6ff37f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:35:42.841 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:42.736+0000 7fb52a73b640 1 -- 172.21.15.19:0/206068127 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x557da6ff3d30 msgr2=0x557da6ff6120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:35:42.841 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:42.736+0000 7fb52a73b640 1 --2- 172.21.15.19:0/206068127 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x557da6ff3d30 0x557da6ff6120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:35:42.841 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:42.736+0000 7fb52a73b640 1 -- 172.21.15.19:0/206068127 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557da6cab650 con 0x557da6fe7480 2024-09-10T22:35:42.842 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:42.736+0000 7fb529f3a640 1 --2- 172.21.15.19:0/206068127 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x557da6fe7da0 0x557da6ff37f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T22:35:42.842 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:42.736+0000 7fb52a73b640 1 --2- 172.21.15.19:0/206068127 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557da6fe7480 0x557da6fe7860 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fb51c005fa0 tx=0x7fb51c009800 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2691d621c6bbb50b server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:35:42.842 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:42.737+0000 7fb51affd640 1 --2- 172.21.15.19:0/2556223956 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7fb5100b5360 0x7fb5100b7820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:35:42.842 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:42.737+0000 7fb50ffff640 1 -- 172.21.15.19:0/206068127 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb51c031cf0 con 0x557da6fe7480 2024-09-10T22:35:42.842 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:42.737+0000 7fb529f3a640 1 --2- 172.21.15.19:0/2556223956 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7fb5100b5360 0x7fb5100b7820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:35:42.842 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:42.737+0000 7fb50ffff640 1 -- 172.21.15.19:0/206068127 <== mon.2 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb51c036030 con 0x557da6fe7480 2024-09-10T22:35:42.842 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:42.737+0000 7fb50ffff640 1 -- 172.21.15.19:0/206068127 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb51c004240 con 0x557da6fe7480 2024-09-10T22:35:42.842 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:42.737+0000 7fb51affd640 1 -- 172.21.15.19:0/2556223956 <== mon.2 v2:172.21.15.135:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8327+0+0 (secure 0 0 0) 0x7fb5200e5ea0 con 0x7fb524102de0 2024-09-10T22:35:42.842 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:42.737+0000 7fb529f3a640 1 --2- 172.21.15.19:0/2556223956 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7fb5100b5360 0x7fb5100b7820 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7fb5200e3cb0 tx=0x7fb5200e9980 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:35:42.842 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:42.738+0000 7fb52e573740 1 -- 172.21.15.19:0/206068127 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557da6fe7480 msgr2=0x557da6fe7860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:35:42.842 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:42.738+0000 7fb52e573740 1 --2- 172.21.15.19:0/206068127 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557da6fe7480 0x557da6fe7860 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fb51c005fa0 tx=0x7fb51c009800 comp rx=0 tx=0).stop 2024-09-10T22:35:42.842 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:42.738+0000 7fb52e573740 1 -- 172.21.15.19:0/206068127 shutdown_connections 2024-09-10T22:35:42.843 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:42.738+0000 7fb52e573740 1 --2- 172.21.15.19:0/206068127 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x557da6ff3d30 0x557da6ff6120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:35:42.843 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:42.738+0000 7fb52e573740 1 --2- 172.21.15.19:0/206068127 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x557da6fe7da0 0x557da6ff37f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:35:42.843 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:42.738+0000 7fb52e573740 1 --2- 172.21.15.19:0/206068127 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557da6fe7480 0x557da6fe7860 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:35:42.843 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:42.738+0000 7fb52e573740 1 -- 172.21.15.19:0/206068127 >> 172.21.15.19:0/206068127 conn(0x557da6fe52b0 msgr2=0x557da6fe6450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:35:42.843 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:42.738+0000 7fb52e573740 1 -- 172.21.15.19:0/206068127 shutdown_connections 2024-09-10T22:35:42.843 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:42.738+0000 7fb52e573740 1 -- 172.21.15.19:0/206068127 wait complete. 2024-09-10T22:35:42.843 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:42.738+0000 7fb52e573740 1 -- start start 2024-09-10T22:35:42.843 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:42.738+0000 7fb52e573740 1 Processor -- start 2024-09-10T22:35:42.843 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:42.739+0000 7fb52e573740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557da6fe7480 0x557da6ff35b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:35:42.843 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:42.739+0000 7fb52e573740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x557da6fe7da0 0x557da6ff0a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:35:42.843 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:42.739+0000 7fb52e573740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x557da6ff3d30 0x557da6ff0fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:35:42.843 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:42.739+0000 7fb52e573740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x557da6dae700 con 0x557da6fe7da0 2024-09-10T22:35:42.843 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:42.739+0000 7fb52e573740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x557da6ee8110 con 0x557da6fe7480 2024-09-10T22:35:42.843 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:42.739+0000 7fb52e573740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x557da6ff67d0 con 0x557da6ff3d30 2024-09-10T22:35:42.843 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:42.739+0000 7fb52e573740 10 client.0 _ll_register_callbacks cb 0x557da6f01990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T22:35:42.844 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:42.739+0000 7fb529739640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x557da6fe7da0 0x557da6ff0a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:35:42.844 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:42.739+0000 7fb52a73b640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557da6fe7480 0x557da6ff35b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:35:42.844 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:42.739+0000 7fb529739640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x557da6fe7da0 0x557da6ff0a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:57382/0 (socket says 172.21.15.19:57382) 2024-09-10T22:35:42.844 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:42.739+0000 7fb529739640 1 -- 172.21.15.19:0/1749159697 learned_addr learned my addr 172.21.15.19:0/1749159697 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:35:42.844 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:42.739+0000 7fb52a73b640 1 --2- 172.21.15.19:0/1749159697 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x557da6ff3d30 0x557da6ff0fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:35:42.844 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:42.739+0000 7fb529739640 1 -- 172.21.15.19:0/1749159697 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x557da6ff3d30 msgr2=0x557da6ff0fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:35:42.844 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:42.739+0000 7fb529739640 1 --2- 172.21.15.19:0/1749159697 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x557da6ff3d30 0x557da6ff0fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:35:42.844 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:42.739+0000 7fb529739640 1 -- 172.21.15.19:0/1749159697 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557da6fe7480 msgr2=0x557da6ff35b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:35:42.844 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:42.739+0000 7fb529739640 1 --2- 172.21.15.19:0/1749159697 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557da6fe7480 0x557da6ff35b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:35:42.844 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:42.739+0000 7fb529739640 1 -- 172.21.15.19:0/1749159697 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557da6f15c40 con 0x557da6fe7da0 2024-09-10T22:35:42.844 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:42.739+0000 7fb52a73b640 1 --2- 172.21.15.19:0/1749159697 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x557da6ff3d30 0x557da6ff0fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T22:35:42.844 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:42.739+0000 7fb529739640 1 --2- 172.21.15.19:0/1749159697 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x557da6fe7da0 0x557da6ff0a00 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7fb51400bea0 tx=0x7fb51400bf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=41c4809a909f51d server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:35:42.844 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:42.739+0000 7fb50d7fa640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-10T22:35:42.845 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:42.740+0000 7fb50d7fa640 1 -- 172.21.15.19:0/1749159697 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb514004020 con 0x557da6fe7da0 2024-09-10T22:35:42.845 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:42.740+0000 7fb50d7fa640 1 -- 172.21.15.19:0/1749159697 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8327+0+0 (secure 0 0 0) 0x7fb5140041c0 con 0x557da6fe7da0 2024-09-10T22:35:42.845 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:42.740+0000 7fb52e573740 1 -- 172.21.15.19:0/1749159697 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb51c036030 con 0x557da6fe7da0 2024-09-10T22:35:42.845 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:42.740+0000 7fb50d7fa640 1 -- 172.21.15.19:0/1749159697 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fb5140043c0 con 0x557da6fe7da0 2024-09-10T22:35:42.845 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:42.740+0000 7fb52e573740 10 client.17229 fetch_fsmap learned FSMap version 27 2024-09-10T22:35:42.845 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:42.740+0000 7fb52e573740 1 -- 172.21.15.19:0/1749159697 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x557da70020d0 con 0x557da6fe7da0 2024-09-10T22:35:42.845 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:42.740+0000 7fb50d7fa640 1 -- 172.21.15.19:0/1749159697 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb51c036030 con 0x557da6fe7da0 2024-09-10T22:35:42.845 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:42.740+0000 7fb50d7fa640 1 -- 172.21.15.19:0/1749159697 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7fb5140039c0 con 0x557da6fe7da0 2024-09-10T22:35:42.845 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:42.740+0000 7fb52e573740 10 client.17229 fetch_fsmap finished waiting for FSMap version 27 2024-09-10T22:35:42.845 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:42.740+0000 7fb52e573740 10 client.17229 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-10T22:35:42.845 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:42.740+0000 7fb52e573740 20 client.17229 populate_metadata read hostname 'smithi019' 2024-09-10T22:35:42.845 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:42.740+0000 7fb52e573740 1 --2- 172.21.15.19:0/1749159697 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x557da7003630 0x557da7005a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:35:42.845 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:42.741+0000 7fb52e573740 4 client.17229 mds_command: new command op to 24581 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T22:35:42.845 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:42.741+0000 7fb52e573740 1 -- 172.21.15.19:0/1749159697 --> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x557da6f5fda0 con 0x557da7003630 2024-09-10T22:35:42.846 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:42.741+0000 7fb52a73b640 1 --2- 172.21.15.19:0/1749159697 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x557da7003630 0x557da7005a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:35:42.846 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:42.741+0000 7fb52a73b640 1 --2- 172.21.15.19:0/1749159697 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x557da7003630 0x557da7005a40 crc :-1 s=READY pgs=188 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6589a38b487b1793 server_cookie=78eae45326be7eea in_seq=0 out_seq=0 2024-09-10T22:35:42.846 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:42.741+0000 7fb50d7fa640 10 client.17229 ms_handle_connect on v2:172.21.15.135:6838/1254769802 2024-09-10T22:35:42.846 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:42.742+0000 7fb50d7fa640 1 -- 172.21.15.19:0/1749159697 <== mds.0 v2:172.21.15.135:6838/1254769802 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x557da6f5fda0 con 0x557da7003630 2024-09-10T22:35:42.846 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:42.742+0000 7fb50d7fa640 10 client.17229 handle_command_reply: tid=0 2024-09-10T22:35:42.846 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:42.742+0000 7fb52e573740 1 client.17229 shutdown 2024-09-10T22:35:42.846 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:42.742+0000 7fb52e573740 1 -- 172.21.15.19:0/1749159697 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x557da6fe7da0 msgr2=0x557da6ff0a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:35:42.846 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:42.742+0000 7fb52e573740 1 --2- 172.21.15.19:0/1749159697 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x557da6fe7da0 0x557da6ff0a00 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7fb51400bea0 tx=0x7fb51400bf90 comp rx=0 tx=0).stop 2024-09-10T22:35:42.846 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:42.742+0000 7fb52e573740 1 -- 172.21.15.19:0/1749159697 shutdown_connections 2024-09-10T22:35:42.846 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:42.742+0000 7fb52e573740 1 --2- 172.21.15.19:0/1749159697 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x557da7003630 0x557da7005a40 crc :-1 s=READY pgs=188 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:35:42.846 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:42.742+0000 7fb52e573740 1 --2- 172.21.15.19:0/1749159697 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x557da6ff3d30 0x557da6ff0fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:35:42.846 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:42.742+0000 7fb52e573740 1 --2- 172.21.15.19:0/1749159697 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x557da6fe7da0 0x557da6ff0a00 unknown :-1 s=CLOSED pgs=785 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:35:42.846 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:42.742+0000 7fb50d7fa640 0 client.17229 ms_handle_reset on v2:172.21.15.135:6838/1254769802 2024-09-10T22:35:42.847 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:42.742+0000 7fb52e573740 1 --2- 172.21.15.19:0/1749159697 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557da6fe7480 0x557da6ff35b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:35:42.847 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:42.742+0000 7fb52e573740 1 -- 172.21.15.19:0/1749159697 >> 172.21.15.19:0/1749159697 conn(0x557da6fe52b0 msgr2=0x557da6feae20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:35:42.847 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:42.742+0000 7fb52e573740 1 -- 172.21.15.19:0/1749159697 shutdown_connections 2024-09-10T22:35:42.847 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:42.742+0000 7fb52e573740 1 -- 172.21.15.19:0/1749159697 wait complete. 2024-09-10T22:35:42.847 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:42.742+0000 7fb52e573740 20 client.17229 trim_cache size 0 max 16384 2024-09-10T22:35:42.847 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:42.778+0000 7fb52e573740 1 Processor -- start 2024-09-10T22:35:42.847 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:42.778+0000 7fb52e573740 1 -- start start 2024-09-10T22:35:42.847 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:42.778+0000 7fb52e573740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x557da6fe7480 0x557da6ff2740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:35:42.847 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:42.778+0000 7fb52e573740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x557da6fe7da0 0x557da6fedc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:35:42.847 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:42.779+0000 7fb52e573740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557da6ff3d30 0x557da6fee150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:35:42.847 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:42.779+0000 7fb52e573740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fb5241b73a0 con 0x557da6fe7480 2024-09-10T22:35:42.847 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:42.779+0000 7fb52e573740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fb5241b4c70 con 0x557da6ff3d30 2024-09-10T22:35:42.847 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:42.779+0000 7fb52e573740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7fb5241b2ac0 con 0x557da6fe7da0 2024-09-10T22:35:42.848 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:42.779+0000 7fb52a73b640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x557da6fe7480 0x557da6ff2740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:35:42.848 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:42.779+0000 7fb52a73b640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x557da6fe7480 0x557da6ff2740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:57398/0 (socket says 172.21.15.19:57398) 2024-09-10T22:35:42.848 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:42.779+0000 7fb52a73b640 1 -- 172.21.15.19:0/1860147065 learned_addr learned my addr 172.21.15.19:0/1860147065 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:35:42.848 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:42.779+0000 7fb529739640 1 --2- 172.21.15.19:0/1860147065 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x557da6fe7da0 0x557da6fedc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:35:42.848 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:42.779+0000 7fb52a73b640 1 --2- 172.21.15.19:0/1860147065 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557da6ff3d30 0x557da6fee150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:35:42.848 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:42.779+0000 7fb52a73b640 1 -- 172.21.15.19:0/1860147065 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x557da6fe7da0 msgr2=0x557da6fedc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:35:42.848 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:42.779+0000 7fb52a73b640 1 --2- 172.21.15.19:0/1860147065 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x557da6fe7da0 0x557da6fedc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:35:42.848 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:42.779+0000 7fb52a73b640 1 -- 172.21.15.19:0/1860147065 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557da6ff3d30 msgr2=0x557da6fee150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:35:42.848 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:42.779+0000 7fb52a73b640 1 --2- 172.21.15.19:0/1860147065 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557da6ff3d30 0x557da6fee150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:35:42.848 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:42.779+0000 7fb52a73b640 1 -- 172.21.15.19:0/1860147065 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557da6fe5d30 con 0x557da6fe7480 2024-09-10T22:35:42.848 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:42.779+0000 7fb529739640 1 --2- 172.21.15.19:0/1860147065 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x557da6fe7da0 0x557da6fedc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T22:35:42.848 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:42.779+0000 7fb52a73b640 1 --2- 172.21.15.19:0/1860147065 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x557da6fe7480 0x557da6ff2740 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 crypto rx=0x7fb51c009870 tx=0x7fb51c0093a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6e5ad1505f5e6c36 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:35:42.848 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:42.779+0000 7fb50f7fe640 1 -- 172.21.15.19:0/1860147065 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb51c031af0 con 0x557da6fe7480 2024-09-10T22:35:42.849 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:42.780+0000 7fb50f7fe640 1 -- 172.21.15.19:0/1860147065 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb51c058070 con 0x557da6fe7480 2024-09-10T22:35:42.849 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:42.780+0000 7fb50f7fe640 1 -- 172.21.15.19:0/1860147065 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb51c0042a0 con 0x557da6fe7480 2024-09-10T22:35:42.849 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:42.780+0000 7fb52e573740 1 -- 172.21.15.19:0/1860147065 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x557da6fe7480 msgr2=0x557da6ff2740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:35:42.849 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:42.781+0000 7fb52e573740 1 --2- 172.21.15.19:0/1860147065 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x557da6fe7480 0x557da6ff2740 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 crypto rx=0x7fb51c009870 tx=0x7fb51c0093a0 comp rx=0 tx=0).stop 2024-09-10T22:35:42.849 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:42.781+0000 7fb52e573740 1 -- 172.21.15.19:0/1860147065 shutdown_connections 2024-09-10T22:35:42.849 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:42.781+0000 7fb52e573740 1 --2- 172.21.15.19:0/1860147065 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557da6ff3d30 0x557da6fee150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:35:42.849 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:42.781+0000 7fb52e573740 1 --2- 172.21.15.19:0/1860147065 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x557da6fe7da0 0x557da6fedc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:35:42.849 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:42.781+0000 7fb52e573740 1 --2- 172.21.15.19:0/1860147065 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x557da6fe7480 0x557da6ff2740 unknown :-1 s=CLOSED pgs=786 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:35:42.849 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:42.781+0000 7fb52e573740 1 -- 172.21.15.19:0/1860147065 >> 172.21.15.19:0/1860147065 conn(0x557da6fe52b0 msgr2=0x557da6ff2030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:35:42.849 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:42.781+0000 7fb52e573740 1 -- 172.21.15.19:0/1860147065 shutdown_connections 2024-09-10T22:35:42.849 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:42.781+0000 7fb52e573740 1 -- 172.21.15.19:0/1860147065 wait complete. 2024-09-10T22:35:42.850 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:42.781+0000 7fb52e573740 1 -- start start 2024-09-10T22:35:42.850 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:42.781+0000 7fb52e573740 1 Processor -- start 2024-09-10T22:35:42.850 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:42.781+0000 7fb52e573740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557da6fe7480 0x557da6ff82f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:35:42.850 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:42.781+0000 7fb52e573740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x557da6fe7da0 0x557da6ff8890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:35:42.850 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:42.781+0000 7fb52e573740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x557da6ff3d30 0x557da7069520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:35:42.850 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:42.781+0000 7fb52e573740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fb5241b3130 con 0x557da6ff3d30 2024-09-10T22:35:42.850 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:42.781+0000 7fb52e573740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fb5241b45a0 con 0x557da6fe7480 2024-09-10T22:35:42.850 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:42.781+0000 7fb52e573740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7fb5241b3800 con 0x557da6fe7da0 2024-09-10T22:35:42.850 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:42.782+0000 7fb52e573740 10 client.0 _ll_register_callbacks cb 0x7fb51400bab0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T22:35:42.850 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:42.782+0000 7fb52a73b640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557da6fe7480 0x557da6ff82f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:35:42.850 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:42.782+0000 7fb52a73b640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x557da6ff3d30 0x557da7069520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:35:42.850 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:42.782+0000 7fb52a73b640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x557da6ff3d30 0x557da7069520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:57402/0 (socket says 172.21.15.19:57402) 2024-09-10T22:35:42.851 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:42.782+0000 7fb52a73b640 1 -- 172.21.15.19:0/3915758612 learned_addr learned my addr 172.21.15.19:0/3915758612 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:35:42.851 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:42.782+0000 7fb529739640 1 --2- 172.21.15.19:0/3915758612 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x557da6fe7da0 0x557da6ff8890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:35:42.851 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:42.782+0000 7fb52a73b640 1 -- 172.21.15.19:0/3915758612 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x557da6fe7da0 msgr2=0x557da6ff8890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:35:42.851 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:42.782+0000 7fb52a73b640 1 --2- 172.21.15.19:0/3915758612 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x557da6fe7da0 0x557da6ff8890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:35:42.851 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:42.782+0000 7fb52a73b640 1 -- 172.21.15.19:0/3915758612 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557da6fe7480 msgr2=0x557da6ff82f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:35:42.851 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:42.782+0000 7fb52a73b640 1 --2- 172.21.15.19:0/3915758612 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557da6fe7480 0x557da6ff82f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:35:42.851 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:42.782+0000 7fb52a73b640 1 -- 172.21.15.19:0/3915758612 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557da7069c60 con 0x557da6ff3d30 2024-09-10T22:35:42.851 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:42.782+0000 7fb529739640 1 --2- 172.21.15.19:0/3915758612 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x557da6fe7da0 0x557da6ff8890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T22:35:42.851 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:42.782+0000 7fb52a73b640 1 --2- 172.21.15.19:0/3915758612 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x557da6ff3d30 0x557da7069520 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x7fb51c005e30 tx=0x7fb51c003f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=acf2b380b005633c server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:35:42.851 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:42.782+0000 7fb50d7fa640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-10T22:35:42.852 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:42.782+0000 7fb50d7fa640 1 -- 172.21.15.19:0/3915758612 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb51c031660 con 0x557da6ff3d30 2024-09-10T22:35:42.852 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:42.782+0000 7fb50d7fa640 1 -- 172.21.15.19:0/3915758612 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8327+0+0 (secure 0 0 0) 0x7fb51c04a030 con 0x557da6ff3d30 2024-09-10T22:35:42.852 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:42.782+0000 7fb52e573740 1 -- 172.21.15.19:0/3915758612 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb51c058070 con 0x557da6ff3d30 2024-09-10T22:35:42.852 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:42.783+0000 7fb50d7fa640 1 -- 172.21.15.19:0/3915758612 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fb51c031800 con 0x557da6ff3d30 2024-09-10T22:35:42.852 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:42.783+0000 7fb52e573740 10 client.17235 fetch_fsmap learned FSMap version 27 2024-09-10T22:35:42.852 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:42.783+0000 7fb52e573740 1 -- 172.21.15.19:0/3915758612 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x557da7070fd0 con 0x557da6ff3d30 2024-09-10T22:35:42.852 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:42.783+0000 7fb50d7fa640 1 -- 172.21.15.19:0/3915758612 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb51c058070 con 0x557da6ff3d30 2024-09-10T22:35:42.852 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:42.783+0000 7fb50d7fa640 1 -- 172.21.15.19:0/3915758612 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7fb51c043070 con 0x557da6ff3d30 2024-09-10T22:35:42.852 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:42.783+0000 7fb52e573740 10 client.17235 fetch_fsmap finished waiting for FSMap version 27 2024-09-10T22:35:42.852 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:42.783+0000 7fb52e573740 10 client.17235 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-10T22:35:42.852 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:42.783+0000 7fb52e573740 20 client.17235 populate_metadata read hostname 'smithi019' 2024-09-10T22:35:42.852 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:42.783+0000 7fb52e573740 1 --2- 172.21.15.19:0/3915758612 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x557da70713e0 0x557da7073800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:35:42.853 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:42.783+0000 7fb52e573740 4 client.17235 mds_command: new command op to 24581 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-10T22:35:42.853 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:42.783+0000 7fb52e573740 1 -- 172.21.15.19:0/3915758612 --> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] -- command(tid 0: {"prefix": "scrub status"}) -- 0x557da6f5b850 con 0x557da70713e0 2024-09-10T22:35:42.853 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:42.783+0000 7fb529739640 1 --2- 172.21.15.19:0/3915758612 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x557da70713e0 0x557da7073800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:35:42.853 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:42.784+0000 7fb529739640 1 --2- 172.21.15.19:0/3915758612 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x557da70713e0 0x557da7073800 crc :-1 s=READY pgs=189 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=84e98035e81cc3d7 server_cookie=a55d033d658ddd71 in_seq=0 out_seq=0 2024-09-10T22:35:42.853 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:42.784+0000 7fb50d7fa640 10 client.17235 ms_handle_connect on v2:172.21.15.135:6838/1254769802 2024-09-10T22:35:42.853 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:42.784+0000 7fb50d7fa640 1 -- 172.21.15.19:0/3915758612 <== mds.0 v2:172.21.15.135:6838/1254769802 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3978 (crc 0 0 0) 0x557da6f5b850 con 0x557da70713e0 2024-09-10T22:35:42.853 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:42.784+0000 7fb50d7fa640 10 client.17235 handle_command_reply: tid=0 2024-09-10T22:35:42.853 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:42.784+0000 7fb52e573740 1 client.17235 shutdown 2024-09-10T22:35:42.853 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:42.784+0000 7fb52e573740 1 -- 172.21.15.19:0/3915758612 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x557da6ff3d30 msgr2=0x557da7069520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:35:42.853 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:42.784+0000 7fb52e573740 1 --2- 172.21.15.19:0/3915758612 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x557da6ff3d30 0x557da7069520 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x7fb51c005e30 tx=0x7fb51c003f90 comp rx=0 tx=0).stop 2024-09-10T22:35:42.853 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:42.784+0000 7fb52e573740 1 -- 172.21.15.19:0/3915758612 shutdown_connections 2024-09-10T22:35:42.853 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:42.784+0000 7fb52e573740 1 --2- 172.21.15.19:0/3915758612 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x557da6ff3d30 0x557da7069520 unknown :-1 s=CLOSED pgs=787 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:35:42.853 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:42.784+0000 7fb52e573740 1 --2- 172.21.15.19:0/3915758612 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x557da70713e0 0x557da7073800 crc :-1 s=READY pgs=189 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:35:42.854 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:42.784+0000 7fb52e573740 1 --2- 172.21.15.19:0/3915758612 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x557da6fe7da0 0x557da6ff8890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:35:42.854 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:42.784+0000 7fb52e573740 1 --2- 172.21.15.19:0/3915758612 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557da6fe7480 0x557da6ff82f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:35:42.854 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:42.784+0000 7fb50d7fa640 0 client.17235 ms_handle_reset on v2:172.21.15.135:6838/1254769802 2024-09-10T22:35:42.854 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:42.784+0000 7fb52e573740 1 -- 172.21.15.19:0/3915758612 >> 172.21.15.19:0/3915758612 conn(0x557da6fe52b0 msgr2=0x557da6ff2850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:35:42.854 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:42.784+0000 7fb52e573740 1 -- 172.21.15.19:0/3915758612 shutdown_connections 2024-09-10T22:35:42.854 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:42.784+0000 7fb52e573740 1 -- 172.21.15.19:0/3915758612 wait complete. 2024-09-10T22:35:42.854 INFO:teuthology.orchestra.run.smithi019.stdout:{ 2024-09-10T22:35:42.854 INFO:teuthology.orchestra.run.smithi019.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-10T22:35:42.854 INFO:teuthology.orchestra.run.smithi019.stdout: "scrubs": { 2024-09-10T22:35:42.855 INFO:teuthology.orchestra.run.smithi019.stdout: "1a6e9f60-01cc-4339-aff0-9ef63cbda443": { 2024-09-10T22:35:42.855 INFO:teuthology.orchestra.run.smithi019.stdout: "path": "/", 2024-09-10T22:35:42.855 INFO:teuthology.orchestra.run.smithi019.stdout: "tag": "1a6e9f60-01cc-4339-aff0-9ef63cbda443", 2024-09-10T22:35:42.855 INFO:teuthology.orchestra.run.smithi019.stdout: "options": "recursive,force" 2024-09-10T22:35:42.855 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-10T22:35:42.855 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:35:42.855 INFO:teuthology.orchestra.run.smithi019.stdout: "scrub_stats": { 2024-09-10T22:35:42.855 INFO:teuthology.orchestra.run.smithi019.stdout: "1a6e9f60-01cc-4339-aff0-9ef63cbda443": { 2024-09-10T22:35:42.856 INFO:teuthology.orchestra.run.smithi019.stdout: "start_time": "2024-09-10T22:35:40.561000+0000", 2024-09-10T22:35:42.856 INFO:teuthology.orchestra.run.smithi019.stdout: "path": "/", 2024-09-10T22:35:42.856 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_started": 0, 2024-09-10T22:35:42.856 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_passed": 0, 2024-09-10T22:35:42.856 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_failed": 0, 2024-09-10T22:35:42.856 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_skipped": 0 2024-09-10T22:35:42.856 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:35:42.856 INFO:teuthology.orchestra.run.smithi019.stdout: "a77606c2-7618-413e-8aba-f9783ecbf435": { 2024-09-10T22:35:42.856 INFO:teuthology.orchestra.run.smithi019.stdout: "start_time": "2024-09-10T22:34:54.453894+0000", 2024-09-10T22:35:42.856 INFO:teuthology.orchestra.run.smithi019.stdout: "path": "/", 2024-09-10T22:35:42.856 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_started": 0, 2024-09-10T22:35:42.856 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_passed": 0, 2024-09-10T22:35:42.857 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_failed": 0, 2024-09-10T22:35:42.857 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_skipped": 0 2024-09-10T22:35:42.857 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:35:42.857 INFO:teuthology.orchestra.run.smithi019.stdout: "0b81ea61-0b8e-4f2c-a58f-ef1019289fc9": { 2024-09-10T22:35:42.857 INFO:teuthology.orchestra.run.smithi019.stdout: "start_time": "2024-09-10T22:31:48.141568+0000", 2024-09-10T22:35:42.857 INFO:teuthology.orchestra.run.smithi019.stdout: "path": "/", 2024-09-10T22:35:42.857 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_started": 0, 2024-09-10T22:35:42.857 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_passed": 0, 2024-09-10T22:35:42.857 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_failed": 0, 2024-09-10T22:35:42.857 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_skipped": 0 2024-09-10T22:35:42.857 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:35:42.858 INFO:teuthology.orchestra.run.smithi019.stdout: "715ec863-8a9d-45b6-967f-59b15ce1bf12": { 2024-09-10T22:35:42.858 INFO:teuthology.orchestra.run.smithi019.stdout: "start_time": "2024-09-10T22:31:00.669516+0000", 2024-09-10T22:35:42.858 INFO:teuthology.orchestra.run.smithi019.stdout: "path": "/", 2024-09-10T22:35:42.858 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_started": 0, 2024-09-10T22:35:42.858 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_passed": 0, 2024-09-10T22:35:42.858 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_failed": 0, 2024-09-10T22:35:42.858 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_skipped": 0 2024-09-10T22:35:42.858 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:35:42.858 INFO:teuthology.orchestra.run.smithi019.stdout: "fd1f1837-dcfa-4d88-99e8-2509f36c3f98": { 2024-09-10T22:35:42.858 INFO:teuthology.orchestra.run.smithi019.stdout: "start_time": "2024-09-10T22:30:12.470477+0000", 2024-09-10T22:35:42.858 INFO:teuthology.orchestra.run.smithi019.stdout: "path": "/", 2024-09-10T22:35:42.859 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_started": 0, 2024-09-10T22:35:42.859 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_passed": 0, 2024-09-10T22:35:42.859 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_failed": 0, 2024-09-10T22:35:42.859 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_skipped": 0 2024-09-10T22:35:42.859 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:35:42.859 INFO:teuthology.orchestra.run.smithi019.stdout: "8f3bb3bf-911f-490c-9856-c80ea220dbbe": { 2024-09-10T22:35:42.859 INFO:teuthology.orchestra.run.smithi019.stdout: "start_time": "2024-09-10T22:29:25.374415+0000", 2024-09-10T22:35:42.859 INFO:teuthology.orchestra.run.smithi019.stdout: "path": "/", 2024-09-10T22:35:42.859 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_started": 0, 2024-09-10T22:35:42.859 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_passed": 0, 2024-09-10T22:35:42.859 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_failed": 0, 2024-09-10T22:35:42.859 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_skipped": 0 2024-09-10T22:35:42.860 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:35:42.860 INFO:teuthology.orchestra.run.smithi019.stdout: "eb518e3c-a71e-4f32-9ca0-ae88930ca218": { 2024-09-10T22:35:42.860 INFO:teuthology.orchestra.run.smithi019.stdout: "start_time": "2024-09-10T22:28:38.366352+0000", 2024-09-10T22:35:42.860 INFO:teuthology.orchestra.run.smithi019.stdout: "path": "/", 2024-09-10T22:35:42.860 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_started": 0, 2024-09-10T22:35:42.860 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_passed": 0, 2024-09-10T22:35:42.860 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_failed": 0, 2024-09-10T22:35:42.860 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_skipped": 0 2024-09-10T22:35:42.860 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:35:42.860 INFO:teuthology.orchestra.run.smithi019.stdout: "9efe684b-7583-402e-a46e-e262a37e1af5": { 2024-09-10T22:35:42.860 INFO:teuthology.orchestra.run.smithi019.stdout: "start_time": "2024-09-10T22:34:09.479768+0000", 2024-09-10T22:35:42.860 INFO:teuthology.orchestra.run.smithi019.stdout: "path": "/", 2024-09-10T22:35:42.861 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_started": 0, 2024-09-10T22:35:42.861 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_passed": 0, 2024-09-10T22:35:42.861 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_failed": 0, 2024-09-10T22:35:42.861 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_skipped": 0 2024-09-10T22:35:42.861 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:35:42.861 INFO:teuthology.orchestra.run.smithi019.stdout: "4c99964e-2e0e-4ffd-8cb8-99c4979ed90f": { 2024-09-10T22:35:42.861 INFO:teuthology.orchestra.run.smithi019.stdout: "start_time": "2024-09-10T22:32:34.659639+0000", 2024-09-10T22:35:42.862 INFO:teuthology.orchestra.run.smithi019.stdout: "path": "/", 2024-09-10T22:35:42.862 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_started": 0, 2024-09-10T22:35:42.862 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_passed": 0, 2024-09-10T22:35:42.862 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_failed": 0, 2024-09-10T22:35:42.862 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_skipped": 0 2024-09-10T22:35:42.862 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:35:42.862 INFO:teuthology.orchestra.run.smithi019.stdout: "c12c2a04-dcd6-4673-a98e-93f665d3f5d7": { 2024-09-10T22:35:42.862 INFO:teuthology.orchestra.run.smithi019.stdout: "start_time": "2024-09-10T22:27:49.392329+0000", 2024-09-10T22:35:42.862 INFO:teuthology.orchestra.run.smithi019.stdout: "path": "/", 2024-09-10T22:35:42.862 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_started": 0, 2024-09-10T22:35:42.862 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_passed": 0, 2024-09-10T22:35:42.863 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_failed": 0, 2024-09-10T22:35:42.863 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_skipped": 0 2024-09-10T22:35:42.863 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:35:42.863 INFO:teuthology.orchestra.run.smithi019.stdout: "b38852c8-478a-42ef-8384-b2c55d5313a4": { 2024-09-10T22:35:42.863 INFO:teuthology.orchestra.run.smithi019.stdout: "start_time": "2024-09-10T22:27:00.320308+0000", 2024-09-10T22:35:42.863 INFO:teuthology.orchestra.run.smithi019.stdout: "path": "/", 2024-09-10T22:35:42.863 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_started": 0, 2024-09-10T22:35:42.863 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_passed": 0, 2024-09-10T22:35:42.863 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_failed": 0, 2024-09-10T22:35:42.863 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_skipped": 0 2024-09-10T22:35:42.863 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:35:42.863 INFO:teuthology.orchestra.run.smithi019.stdout: "448b10e7-494c-4a88-a9ab-186159c5dfdd": { 2024-09-10T22:35:42.864 INFO:teuthology.orchestra.run.smithi019.stdout: "start_time": "2024-09-10T22:33:21.208716+0000", 2024-09-10T22:35:42.864 INFO:teuthology.orchestra.run.smithi019.stdout: "path": "/", 2024-09-10T22:35:42.864 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_started": 0, 2024-09-10T22:35:42.864 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_passed": 0, 2024-09-10T22:35:42.864 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_failed": 0, 2024-09-10T22:35:42.864 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_skipped": 0 2024-09-10T22:35:42.864 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:35:42.864 INFO:teuthology.orchestra.run.smithi019.stdout: "9b6bfdee-303c-4c12-af56-dc85860d112a": { 2024-09-10T22:35:42.864 INFO:teuthology.orchestra.run.smithi019.stdout: "start_time": "2024-09-10T22:26:17.484162+0000", 2024-09-10T22:35:42.864 INFO:teuthology.orchestra.run.smithi019.stdout: "path": "/", 2024-09-10T22:35:42.864 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_started": 0, 2024-09-10T22:35:42.865 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_passed": 0, 2024-09-10T22:35:42.865 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_failed": 0, 2024-09-10T22:35:42.865 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_skipped": 0 2024-09-10T22:35:42.865 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-10T22:35:42.865 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-10T22:35:42.865 INFO:teuthology.orchestra.run.smithi019.stdout:} 2024-09-10T22:35:42.865 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:42.784+0000 7fb52e573740 20 client.17235 trim_cache size 0 max 16384 2024-09-10T22:35:42.865 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:42.785+0000 7fb52c19e640 1 -- 172.21.15.19:0/2556223956 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7fb5100b5360 msgr2=0x7fb5100b7820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:35:42.865 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:42.785+0000 7fb52c19e640 1 --2- 172.21.15.19:0/2556223956 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7fb5100b5360 0x7fb5100b7820 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7fb5200e3cb0 tx=0x7fb5200e9980 comp rx=0 tx=0).stop 2024-09-10T22:35:42.865 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:42.785+0000 7fb52c19e640 1 -- 172.21.15.19:0/2556223956 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb524102de0 msgr2=0x7fb524076f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:35:42.866 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:42.785+0000 7fb52c19e640 1 --2- 172.21.15.19:0/2556223956 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb524102de0 0x7fb524076f50 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fb52000e9f0 tx=0x7fb52000eeb0 comp rx=0 tx=0).stop 2024-09-10T22:35:42.866 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:42.785+0000 7fb52c19e640 1 -- 172.21.15.19:0/2556223956 shutdown_connections 2024-09-10T22:35:42.866 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:42.785+0000 7fb52c19e640 1 --2- 172.21.15.19:0/2556223956 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7fb5100b5360 0x7fb5100b7820 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:35:42.866 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:42.785+0000 7fb52c19e640 1 --2- 172.21.15.19:0/2556223956 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb524109170 0x7fb524075ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:35:42.866 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:42.785+0000 7fb52c19e640 1 --2- 172.21.15.19:0/2556223956 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb5241087f0 0x7fb5240754a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:35:42.866 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:42.785+0000 7fb52c19e640 1 --2- 172.21.15.19:0/2556223956 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb524102de0 0x7fb524076f50 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:35:42.866 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:42.785+0000 7fb52c19e640 1 -- 172.21.15.19:0/2556223956 >> 172.21.15.19:0/2556223956 conn(0x7fb5240fe830 msgr2=0x7fb524100c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:35:42.866 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:42.785+0000 7fb52c19e640 1 -- 172.21.15.19:0/2556223956 shutdown_connections 2024-09-10T22:35:42.866 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:35:42.785+0000 7fb52c19e640 1 -- 172.21.15.19:0/2556223956 wait complete. 2024-09-10T22:35:44.022 INFO:tasks.cephfs.filesystem:scrub status for tag:1a6e9f60-01cc-4339-aff0-9ef63cbda443 - {'path': '/', 'tag': '1a6e9f60-01cc-4339-aff0-9ef63cbda443', 'options': 'recursive,force'} 2024-09-10T22:35:44.458 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:35:44 smithi019 ceph-mon[31375]: pgmap v626: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 551 KiB/s rd, 219 MiB/s wr, 110 op/s 2024-09-10T22:35:44.458 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:35:44 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T22:35:44.610 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:35:44 smithi135 ceph-mon[34789]: pgmap v626: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 551 KiB/s rd, 219 MiB/s wr, 110 op/s 2024-09-10T22:35:44.610 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:35:44 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T22:35:44.625 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:35:44 smithi138 ceph-mon[35236]: pgmap v626: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 551 KiB/s rd, 219 MiB/s wr, 110 op/s 2024-09-10T22:35:44.625 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:35:44 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T22:35:44.984 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:44.980+0000 7f6d004e6640 1 -- 172.21.15.19:0/3824324691 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6cf81086a0 msgr2=0x7f6cf810ab60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:35:44.984 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:44.980+0000 7f6d004e6640 1 --2- 172.21.15.19:0/3824324691 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6cf81086a0 0x7f6cf810ab60 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x7f6cf0009ca0 tx=0x7f6cf002a8c0 comp rx=0 tx=0).stop 2024-09-10T22:35:44.984 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:44.980+0000 7f6d004e6640 1 -- 172.21.15.19:0/3824324691 shutdown_connections 2024-09-10T22:35:44.984 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:44.980+0000 7f6d004e6640 1 --2- 172.21.15.19:0/3824324691 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6cf81086a0 0x7f6cf810ab60 unknown :-1 s=CLOSED pgs=788 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:35:44.984 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:44.980+0000 7f6d004e6640 1 --2- 172.21.15.19:0/3824324691 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6cf8105af0 0x7f6cf8107f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:35:44.984 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:44.981+0000 7f6d004e6640 1 --2- 172.21.15.19:0/3824324691 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f6cf806bf50 0x7f6cf8105560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:35:44.984 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:44.981+0000 7f6d004e6640 1 -- 172.21.15.19:0/3824324691 >> 172.21.15.19:0/3824324691 conn(0x7f6cf80fd150 msgr2=0x7f6cf80ff570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:35:44.984 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:44.981+0000 7f6d004e6640 1 -- 172.21.15.19:0/3824324691 shutdown_connections 2024-09-10T22:35:44.984 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:44.981+0000 7f6d004e6640 1 -- 172.21.15.19:0/3824324691 wait complete. 2024-09-10T22:35:44.985 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:44.981+0000 7f6d004e6640 1 Processor -- start 2024-09-10T22:35:44.985 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:44.981+0000 7f6d004e6640 1 -- start start 2024-09-10T22:35:44.985 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:44.981+0000 7f6d004e6640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6cf806bf50 0x7f6cf8102ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:35:44.985 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:44.981+0000 7f6d004e6640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f6cf8105af0 0x7f6cf8101500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:35:44.985 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:44.981+0000 7f6d004e6640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6cf81086a0 0x7f6cf8101a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:35:44.985 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:44.981+0000 7f6d004e6640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f6cf810e5d0 con 0x7f6cf81086a0 2024-09-10T22:35:44.985 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:44.981+0000 7f6d004e6640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f6cf810e450 con 0x7f6cf806bf50 2024-09-10T22:35:44.985 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:44.981+0000 7f6d004e6640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f6cf810e750 con 0x7f6cf8105af0 2024-09-10T22:35:44.985 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:44.981+0000 7f6cfea83640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6cf81086a0 0x7f6cf8101a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:35:44.985 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:44.981+0000 7f6cfea83640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6cf81086a0 0x7f6cf8101a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:47814/0 (socket says 172.21.15.19:47814) 2024-09-10T22:35:44.985 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:44.981+0000 7f6cfea83640 1 -- 172.21.15.19:0/2572708710 learned_addr learned my addr 172.21.15.19:0/2572708710 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:35:44.985 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:44.982+0000 7f6cfe282640 1 --2- 172.21.15.19:0/2572708710 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6cf806bf50 0x7f6cf8102ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:35:44.986 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:44.982+0000 7f6cfda81640 1 --2- 172.21.15.19:0/2572708710 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f6cf8105af0 0x7f6cf8101500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:35:44.986 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:44.982+0000 7f6cfea83640 1 -- 172.21.15.19:0/2572708710 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f6cf8105af0 msgr2=0x7f6cf8101500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:35:44.986 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:44.982+0000 7f6cfea83640 1 --2- 172.21.15.19:0/2572708710 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f6cf8105af0 0x7f6cf8101500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:35:44.986 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:44.982+0000 7f6cfea83640 1 -- 172.21.15.19:0/2572708710 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6cf806bf50 msgr2=0x7f6cf8102ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:35:44.986 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:44.982+0000 7f6cfea83640 1 --2- 172.21.15.19:0/2572708710 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6cf806bf50 0x7f6cf8102ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:35:44.986 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:44.982+0000 7f6cfea83640 1 -- 172.21.15.19:0/2572708710 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6cf81022b0 con 0x7f6cf81086a0 2024-09-10T22:35:44.986 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:44.982+0000 7f6cfea83640 1 --2- 172.21.15.19:0/2572708710 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6cf81086a0 0x7f6cf8101a40 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x7f6cf00097b0 tx=0x7f6cf0031840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:35:44.986 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:44.982+0000 7f6cef7fe640 1 -- 172.21.15.19:0/2572708710 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6cf0003bf0 con 0x7f6cf81086a0 2024-09-10T22:35:44.986 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:44.982+0000 7f6d004e6640 1 -- 172.21.15.19:0/2572708710 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6cf81a2d80 con 0x7f6cf81086a0 2024-09-10T22:35:44.986 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:44.982+0000 7f6d004e6640 1 -- 172.21.15.19:0/2572708710 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6cf81a3250 con 0x7f6cf81086a0 2024-09-10T22:35:44.986 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:44.982+0000 7f6cef7fe640 1 -- 172.21.15.19:0/2572708710 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6cf0003d90 con 0x7f6cf81086a0 2024-09-10T22:35:44.986 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:44.982+0000 7f6cef7fe640 1 -- 172.21.15.19:0/2572708710 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6cf002fc70 con 0x7f6cf81086a0 2024-09-10T22:35:44.989 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:44.985+0000 7f6d032b4740 1 Processor -- start 2024-09-10T22:35:44.989 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:44.985+0000 7f6cef7fe640 1 -- 172.21.15.19:0/2572708710 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 18) ==== 153250+0+0 (secure 0 0 0) 0x7f6cf0004040 con 0x7f6cf81086a0 2024-09-10T22:35:44.989 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:44.985+0000 7f6d032b4740 1 -- start start 2024-09-10T22:35:44.989 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:44.985+0000 7f6d032b4740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5583a54d4860 0x5583a54d6c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:35:44.989 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:44.985+0000 7f6d032b4740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5583a54d7190 0x5583a54d9580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:35:44.990 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:44.985+0000 7f6d032b4740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5583a54d9bd0 0x5583a54dc090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:35:44.990 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:44.985+0000 7f6d032b4740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x5583a54466f0 con 0x5583a54d7190 2024-09-10T22:35:44.990 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:44.985+0000 7f6d032b4740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x5583a5435b20 con 0x5583a54d4860 2024-09-10T22:35:44.990 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:44.985+0000 7f6d032b4740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x5583a5439930 con 0x5583a54d9bd0 2024-09-10T22:35:44.990 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:44.986+0000 7f6cfe282640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5583a54d7190 0x5583a54d9580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:35:44.990 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:44.986+0000 7f6cfe282640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5583a54d7190 0x5583a54d9580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:47824/0 (socket says 172.21.15.19:47824) 2024-09-10T22:35:44.990 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:44.986+0000 7f6cfe282640 1 -- 172.21.15.19:0/2756887748 learned_addr learned my addr 172.21.15.19:0/2756887748 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:35:44.990 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:44.986+0000 7f6cfda81640 1 --2- 172.21.15.19:0/2756887748 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5583a54d4860 0x5583a54d6c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:35:44.990 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:44.986+0000 7f6cfda81640 1 --2- 172.21.15.19:0/2756887748 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5583a54d9bd0 0x5583a54dc090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:35:44.990 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:44.986+0000 7f6cfda81640 1 -- 172.21.15.19:0/2756887748 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5583a54d9bd0 msgr2=0x5583a54dc090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:35:44.990 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:44.986+0000 7f6cfda81640 1 --2- 172.21.15.19:0/2756887748 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5583a54d9bd0 0x5583a54dc090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:35:44.990 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:44.986+0000 7f6cfda81640 1 -- 172.21.15.19:0/2756887748 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5583a54d7190 msgr2=0x5583a54d9580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:35:44.990 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:44.986+0000 7f6cfda81640 1 --2- 172.21.15.19:0/2756887748 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5583a54d7190 0x5583a54d9580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:35:44.991 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:44.986+0000 7f6cfda81640 1 -- 172.21.15.19:0/2756887748 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5583a53fb530 con 0x5583a54d4860 2024-09-10T22:35:44.991 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:44.986+0000 7f6cfe282640 1 --2- 172.21.15.19:0/2756887748 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5583a54d7190 0x5583a54d9580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T22:35:44.991 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:44.986+0000 7f6cef7fe640 1 --2- 172.21.15.19:0/2572708710 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f6ce40b52e0 0x7f6ce40b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:35:44.991 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:44.986+0000 7f6cfda81640 1 --2- 172.21.15.19:0/2756887748 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5583a54d4860 0x5583a54d6c50 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f6ce8009ef0 tx=0x7f6ce80096c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b4ebacb1e581c839 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:35:44.991 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:44.986+0000 7f6cfe282640 1 --2- 172.21.15.19:0/2572708710 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f6ce40b52e0 0x7f6ce40b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:35:44.991 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:44.986+0000 7f6cef7fe640 1 -- 172.21.15.19:0/2572708710 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8327+0+0 (secure 0 0 0) 0x7f6cf01071f0 con 0x7f6cf81086a0 2024-09-10T22:35:44.991 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:44.986+0000 7f6cecbfe640 1 -- 172.21.15.19:0/2756887748 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ce8004050 con 0x5583a54d4860 2024-09-10T22:35:44.991 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:44.986+0000 7f6cecbfe640 1 -- 172.21.15.19:0/2756887748 <== mon.2 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6ce80054d0 con 0x5583a54d4860 2024-09-10T22:35:44.991 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:44.986+0000 7f6cecbfe640 1 -- 172.21.15.19:0/2756887748 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ce8004ca0 con 0x5583a54d4860 2024-09-10T22:35:44.991 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:44.987+0000 7f6d032b4740 1 -- 172.21.15.19:0/2756887748 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5583a54d4860 msgr2=0x5583a54d6c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:35:44.991 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:44.987+0000 7f6cfe282640 1 --2- 172.21.15.19:0/2572708710 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f6ce40b52e0 0x7f6ce40b77a0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f6cf400bfd0 tx=0x7f6cf400b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:35:44.991 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:44.987+0000 7f6d032b4740 1 --2- 172.21.15.19:0/2756887748 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5583a54d4860 0x5583a54d6c50 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f6ce8009ef0 tx=0x7f6ce80096c0 comp rx=0 tx=0).stop 2024-09-10T22:35:44.991 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:44.987+0000 7f6d032b4740 1 -- 172.21.15.19:0/2756887748 shutdown_connections 2024-09-10T22:35:44.992 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:44.987+0000 7f6d032b4740 1 --2- 172.21.15.19:0/2756887748 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5583a54d9bd0 0x5583a54dc090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:35:44.992 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:44.987+0000 7f6d032b4740 1 --2- 172.21.15.19:0/2756887748 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5583a54d7190 0x5583a54d9580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:35:44.992 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:44.987+0000 7f6d032b4740 1 --2- 172.21.15.19:0/2756887748 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5583a54d4860 0x5583a54d6c50 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:35:44.992 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:44.987+0000 7f6d032b4740 1 -- 172.21.15.19:0/2756887748 >> 172.21.15.19:0/2756887748 conn(0x5583a54cf9b0 msgr2=0x5583a54d0740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:35:44.992 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:44.987+0000 7f6d032b4740 1 -- 172.21.15.19:0/2756887748 shutdown_connections 2024-09-10T22:35:44.992 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:44.987+0000 7f6d032b4740 1 -- 172.21.15.19:0/2756887748 wait complete. 2024-09-10T22:35:44.992 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:44.988+0000 7f6d032b4740 1 -- start start 2024-09-10T22:35:44.992 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:44.988+0000 7f6d032b4740 1 Processor -- start 2024-09-10T22:35:44.996 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:44.988+0000 7f6d032b4740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5583a54d4860 0x5583a54ddef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:35:44.996 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:44.988+0000 7f6d032b4740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5583a54d7190 0x5583a54de590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:35:44.996 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:44.988+0000 7f6d032b4740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5583a54d9bd0 0x5583a54df160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:35:44.996 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:44.988+0000 7f6d032b4740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x5583a536dab0 con 0x5583a54d7190 2024-09-10T22:35:44.996 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:44.988+0000 7f6d032b4740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x5583a53db730 con 0x5583a54d4860 2024-09-10T22:35:44.997 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:44.988+0000 7f6d032b4740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x5583a54dcbb0 con 0x5583a54d9bd0 2024-09-10T22:35:44.997 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:44.988+0000 7f6d032b4740 10 client.0 _ll_register_callbacks cb 0x5583a542f6b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T22:35:44.997 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:44.988+0000 7f6cfda81640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5583a54d7190 0x5583a54de590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:35:44.997 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:44.988+0000 7f6cfda81640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5583a54d7190 0x5583a54de590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:47826/0 (socket says 172.21.15.19:47826) 2024-09-10T22:35:44.997 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:44.988+0000 7f6cfda81640 1 -- 172.21.15.19:0/1179929819 learned_addr learned my addr 172.21.15.19:0/1179929819 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:35:44.997 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:44.988+0000 7f6cfe282640 1 --2- 172.21.15.19:0/1179929819 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5583a54d4860 0x5583a54ddef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:35:44.997 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:44.988+0000 7f6cfea83640 1 --2- 172.21.15.19:0/1179929819 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5583a54d9bd0 0x5583a54df160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:35:44.997 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:44.989+0000 7f6cfda81640 1 -- 172.21.15.19:0/1179929819 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5583a54d9bd0 msgr2=0x5583a54df160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:35:44.997 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:44.989+0000 7f6cfda81640 1 --2- 172.21.15.19:0/1179929819 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5583a54d9bd0 0x5583a54df160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:35:44.997 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:44.989+0000 7f6cfda81640 1 -- 172.21.15.19:0/1179929819 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5583a54d4860 msgr2=0x5583a54ddef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:35:44.997 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:44.989+0000 7f6cfda81640 1 --2- 172.21.15.19:0/1179929819 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5583a54d4860 0x5583a54ddef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:35:44.998 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:44.989+0000 7f6cfda81640 1 -- 172.21.15.19:0/1179929819 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5583a5197790 con 0x5583a54d7190 2024-09-10T22:35:44.998 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:44.989+0000 7f6cfe282640 1 --2- 172.21.15.19:0/1179929819 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5583a54d4860 0x5583a54ddef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T22:35:44.998 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:44.989+0000 7f6cfea83640 1 --2- 172.21.15.19:0/1179929819 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5583a54d9bd0 0x5583a54df160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T22:35:44.998 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:44.989+0000 7f6cfda81640 1 --2- 172.21.15.19:0/1179929819 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5583a54d7190 0x5583a54de590 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 crypto rx=0x7f6ce80097c0 tx=0x7f6ce8005700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a513283b05228892 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:35:44.998 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:44.989+0000 7f6ce1ffb640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-10T22:35:44.998 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:44.989+0000 7f6ce1ffb640 1 -- 172.21.15.19:0/1179929819 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ce801e460 con 0x5583a54d7190 2024-09-10T22:35:44.998 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:44.989+0000 7f6ce1ffb640 1 -- 172.21.15.19:0/1179929819 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8327+0+0 (secure 0 0 0) 0x7f6ce801e600 con 0x5583a54d7190 2024-09-10T22:35:44.998 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:44.989+0000 7f6d032b4740 1 -- 172.21.15.19:0/1179929819 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6ce80054d0 con 0x5583a54d7190 2024-09-10T22:35:44.998 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:44.989+0000 7f6ce1ffb640 1 -- 172.21.15.19:0/1179929819 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f6ce801e800 con 0x5583a54d7190 2024-09-10T22:35:44.998 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:44.989+0000 7f6d032b4740 10 client.17247 fetch_fsmap learned FSMap version 27 2024-09-10T22:35:44.998 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:44.989+0000 7f6d032b4740 1 -- 172.21.15.19:0/1179929819 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x5583a5210620 con 0x5583a54d7190 2024-09-10T22:35:44.998 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:44.989+0000 7f6ce1ffb640 1 -- 172.21.15.19:0/1179929819 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6ce80054d0 con 0x5583a54d7190 2024-09-10T22:35:44.998 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:44.990+0000 7f6ce1ffb640 1 -- 172.21.15.19:0/1179929819 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7f6ce8030020 con 0x5583a54d7190 2024-09-10T22:35:44.999 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:44.990+0000 7f6d032b4740 10 client.17247 fetch_fsmap finished waiting for FSMap version 27 2024-09-10T22:35:44.999 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:44.990+0000 7f6d032b4740 10 client.17247 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-10T22:35:44.999 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:44.990+0000 7f6d032b4740 20 client.17247 populate_metadata read hostname 'smithi019' 2024-09-10T22:35:44.999 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:44.990+0000 7f6d032b4740 1 --2- 172.21.15.19:0/1179929819 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x5583a54e95b0 0x5583a54eb9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:35:44.999 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:44.990+0000 7f6d032b4740 4 client.17247 mds_command: new command op to 24581 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T22:35:44.999 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:44.990+0000 7f6d032b4740 1 -- 172.21.15.19:0/1179929819 --> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5583a5448640 con 0x5583a54e95b0 2024-09-10T22:35:44.999 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:44.990+0000 7f6cfe282640 1 --2- 172.21.15.19:0/1179929819 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x5583a54e95b0 0x5583a54eb9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:35:44.999 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:44.990+0000 7f6ce1ffb640 10 client.17247 ms_handle_connect on v2:172.21.15.135:6838/1254769802 2024-09-10T22:35:44.999 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:44.990+0000 7f6cfe282640 1 --2- 172.21.15.19:0/1179929819 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x5583a54e95b0 0x5583a54eb9d0 crc :-1 s=READY pgs=190 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fbf5bfd316368239 server_cookie=9a717acdb6a75383 in_seq=0 out_seq=0 2024-09-10T22:35:44.999 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:44.991+0000 7f6ce1ffb640 1 -- 172.21.15.19:0/1179929819 <== mds.0 v2:172.21.15.135:6838/1254769802 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5583a5448640 con 0x5583a54e95b0 2024-09-10T22:35:44.999 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:44.991+0000 7f6ce1ffb640 10 client.17247 handle_command_reply: tid=0 2024-09-10T22:35:44.999 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:44.991+0000 7f6d032b4740 1 client.17247 shutdown 2024-09-10T22:35:44.999 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:44.991+0000 7f6d032b4740 1 -- 172.21.15.19:0/1179929819 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5583a54d7190 msgr2=0x5583a54de590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:35:45.000 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:44.991+0000 7f6d032b4740 1 --2- 172.21.15.19:0/1179929819 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5583a54d7190 0x5583a54de590 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 crypto rx=0x7f6ce80097c0 tx=0x7f6ce8005700 comp rx=0 tx=0).stop 2024-09-10T22:35:45.000 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:44.991+0000 7f6d032b4740 1 -- 172.21.15.19:0/1179929819 shutdown_connections 2024-09-10T22:35:45.000 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:44.991+0000 7f6d032b4740 1 --2- 172.21.15.19:0/1179929819 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x5583a54e95b0 0x5583a54eb9d0 crc :-1 s=READY pgs=190 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:35:45.000 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:44.991+0000 7f6d032b4740 1 --2- 172.21.15.19:0/1179929819 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5583a54d9bd0 0x5583a54df160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:35:45.000 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:44.991+0000 7f6d032b4740 1 --2- 172.21.15.19:0/1179929819 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5583a54d7190 0x5583a54de590 unknown :-1 s=CLOSED pgs=790 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:35:45.000 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:44.991+0000 7f6d032b4740 1 --2- 172.21.15.19:0/1179929819 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5583a54d4860 0x5583a54ddef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:35:45.000 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:44.991+0000 7f6ce1ffb640 0 client.17247 ms_handle_reset on v2:172.21.15.135:6838/1254769802 2024-09-10T22:35:45.000 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:44.991+0000 7f6d032b4740 1 -- 172.21.15.19:0/1179929819 >> 172.21.15.19:0/1179929819 conn(0x5583a54cf9b0 msgr2=0x5583a54cebf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:35:45.000 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:44.991+0000 7f6d032b4740 1 -- 172.21.15.19:0/1179929819 shutdown_connections 2024-09-10T22:35:45.000 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:44.991+0000 7f6d032b4740 1 -- 172.21.15.19:0/1179929819 wait complete. 2024-09-10T22:35:45.000 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:44.991+0000 7f6d032b4740 20 client.17247 trim_cache size 0 max 16384 2024-09-10T22:35:45.013 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:45.007+0000 7f6d032b4740 1 Processor -- start 2024-09-10T22:35:45.013 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:45.007+0000 7f6d032b4740 1 -- start start 2024-09-10T22:35:45.013 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:45.007+0000 7f6d032b4740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5583a54d4860 0x5583a54ddef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:35:45.013 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:45.007+0000 7f6d032b4740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5583a54d7190 0x5583a54de430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:35:45.013 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:45.007+0000 7f6d032b4740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5583a54d9bd0 0x5583a54dd130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:35:45.014 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:45.007+0000 7f6d032b4740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f6cf81aeb30 con 0x5583a54d9bd0 2024-09-10T22:35:45.014 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:45.007+0000 7f6d032b4740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f6cf81ac400 con 0x5583a54d7190 2024-09-10T22:35:45.014 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:45.007+0000 7f6d032b4740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f6cf81aa250 con 0x5583a54d4860 2024-09-10T22:35:45.014 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:45.008+0000 7f6cfea83640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5583a54d9bd0 0x5583a54dd130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:35:45.014 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:45.008+0000 7f6cfea83640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5583a54d9bd0 0x5583a54dd130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:47840/0 (socket says 172.21.15.19:47840) 2024-09-10T22:35:45.014 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:45.008+0000 7f6cfea83640 1 -- 172.21.15.19:0/3835848767 learned_addr learned my addr 172.21.15.19:0/3835848767 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:35:45.014 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:45.008+0000 7f6cfe282640 1 --2- 172.21.15.19:0/3835848767 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5583a54d4860 0x5583a54ddef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:35:45.014 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:45.008+0000 7f6cfda81640 1 --2- 172.21.15.19:0/3835848767 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5583a54d7190 0x5583a54de430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:35:45.014 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:45.008+0000 7f6cfea83640 1 -- 172.21.15.19:0/3835848767 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5583a54d4860 msgr2=0x5583a54ddef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:35:45.014 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:45.008+0000 7f6cfea83640 1 --2- 172.21.15.19:0/3835848767 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5583a54d4860 0x5583a54ddef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:35:45.014 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:45.008+0000 7f6cfea83640 1 -- 172.21.15.19:0/3835848767 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5583a54d7190 msgr2=0x5583a54de430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:35:45.014 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:45.008+0000 7f6cfea83640 1 --2- 172.21.15.19:0/3835848767 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5583a54d7190 0x5583a54de430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:35:45.014 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:45.008+0000 7f6cfea83640 1 -- 172.21.15.19:0/3835848767 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5583a54cb0b0 con 0x5583a54d9bd0 2024-09-10T22:35:45.015 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:45.008+0000 7f6cfea83640 1 --2- 172.21.15.19:0/3835848767 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5583a54d9bd0 0x5583a54dd130 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7f6cf0031a20 tx=0x7f6cf0104b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2ec5da2543d2b0f8 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:35:45.015 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:45.008+0000 7f6ce3fff640 1 -- 172.21.15.19:0/3835848767 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6cf00cd0c0 con 0x5583a54d9bd0 2024-09-10T22:35:45.015 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:45.008+0000 7f6ce3fff640 1 -- 172.21.15.19:0/3835848767 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6cf0036030 con 0x5583a54d9bd0 2024-09-10T22:35:45.015 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:45.008+0000 7f6ce3fff640 1 -- 172.21.15.19:0/3835848767 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6cf00c90c0 con 0x5583a54d9bd0 2024-09-10T22:35:45.015 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:45.009+0000 7f6d032b4740 1 -- 172.21.15.19:0/3835848767 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5583a54d9bd0 msgr2=0x5583a54dd130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:35:45.015 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:45.009+0000 7f6d032b4740 1 --2- 172.21.15.19:0/3835848767 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5583a54d9bd0 0x5583a54dd130 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7f6cf0031a20 tx=0x7f6cf0104b60 comp rx=0 tx=0).stop 2024-09-10T22:35:45.015 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:45.009+0000 7f6d032b4740 1 -- 172.21.15.19:0/3835848767 shutdown_connections 2024-09-10T22:35:45.015 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:45.009+0000 7f6d032b4740 1 --2- 172.21.15.19:0/3835848767 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5583a54d9bd0 0x5583a54dd130 unknown :-1 s=CLOSED pgs=791 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:35:45.015 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:45.009+0000 7f6d032b4740 1 --2- 172.21.15.19:0/3835848767 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5583a54d7190 0x5583a54de430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:35:45.015 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:45.009+0000 7f6d032b4740 1 --2- 172.21.15.19:0/3835848767 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5583a54d4860 0x5583a54ddef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:35:45.015 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:45.009+0000 7f6d032b4740 1 -- 172.21.15.19:0/3835848767 >> 172.21.15.19:0/3835848767 conn(0x5583a54cf9b0 msgr2=0x5583a54d3cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:35:45.015 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:45.009+0000 7f6d032b4740 1 -- 172.21.15.19:0/3835848767 shutdown_connections 2024-09-10T22:35:45.015 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:45.009+0000 7f6d032b4740 1 -- 172.21.15.19:0/3835848767 wait complete. 2024-09-10T22:35:45.016 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:45.009+0000 7f6d032b4740 1 -- start start 2024-09-10T22:35:45.016 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:45.010+0000 7f6d032b4740 1 Processor -- start 2024-09-10T22:35:45.016 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:45.010+0000 7f6d032b4740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5583a54d4860 0x5583a54e2de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:35:45.016 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:45.010+0000 7f6d032b4740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5583a54d7190 0x5583a54e3480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:35:45.016 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:45.010+0000 7f6d032b4740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5583a54d9bd0 0x5583a54e4050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:35:45.016 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:45.010+0000 7f6d032b4740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f6cf81aa8c0 con 0x5583a54d7190 2024-09-10T22:35:45.016 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:45.010+0000 7f6d032b4740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f6cf81abd30 con 0x5583a54d4860 2024-09-10T22:35:45.016 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:45.010+0000 7f6d032b4740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f6cf81aaf90 con 0x5583a54d9bd0 2024-09-10T22:35:45.016 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:45.010+0000 7f6d032b4740 10 client.0 _ll_register_callbacks cb 0x7f6cf400b770 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T22:35:45.016 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:45.010+0000 7f6cfda81640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5583a54d7190 0x5583a54e3480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:35:45.016 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:45.010+0000 7f6cfda81640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5583a54d7190 0x5583a54e3480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:47854/0 (socket says 172.21.15.19:47854) 2024-09-10T22:35:45.016 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:45.010+0000 7f6cfda81640 1 -- 172.21.15.19:0/935472570 learned_addr learned my addr 172.21.15.19:0/935472570 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:35:45.017 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:45.010+0000 7f6cfea83640 1 --2- 172.21.15.19:0/935472570 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5583a54d9bd0 0x5583a54e4050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:35:45.017 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:45.010+0000 7f6cfe282640 1 --2- 172.21.15.19:0/935472570 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5583a54d4860 0x5583a54e2de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:35:45.017 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:45.010+0000 7f6cfda81640 1 -- 172.21.15.19:0/935472570 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5583a54d9bd0 msgr2=0x5583a54e4050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:35:45.017 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:45.010+0000 7f6cfda81640 1 --2- 172.21.15.19:0/935472570 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5583a54d9bd0 0x5583a54e4050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:35:45.017 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:45.010+0000 7f6cfda81640 1 -- 172.21.15.19:0/935472570 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5583a54d4860 msgr2=0x5583a54e2de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:35:45.017 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:45.010+0000 7f6cfda81640 1 --2- 172.21.15.19:0/935472570 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5583a54d4860 0x5583a54e2de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:35:45.017 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:45.010+0000 7f6cfda81640 1 -- 172.21.15.19:0/935472570 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5583a54df4d0 con 0x5583a54d7190 2024-09-10T22:35:45.017 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:45.010+0000 7f6cfe282640 1 --2- 172.21.15.19:0/935472570 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5583a54d4860 0x5583a54e2de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T22:35:45.017 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:45.010+0000 7f6cfda81640 1 --2- 172.21.15.19:0/935472570 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5583a54d7190 0x5583a54e3480 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7f6ce8009460 tx=0x7f6ce801e770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=465697d7a4bc798a server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:35:45.017 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:45.010+0000 7f6ce1ffb640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-10T22:35:45.017 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:45.010+0000 7f6ce1ffb640 1 -- 172.21.15.19:0/935472570 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ce8037030 con 0x5583a54d7190 2024-09-10T22:35:45.017 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:45.011+0000 7f6ce1ffb640 1 -- 172.21.15.19:0/935472570 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8327+0+0 (secure 0 0 0) 0x7f6ce801e9a0 con 0x5583a54d7190 2024-09-10T22:35:45.017 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:45.011+0000 7f6d032b4740 1 -- 172.21.15.19:0/935472570 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6cf0036030 con 0x5583a54d7190 2024-09-10T22:35:45.018 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:45.011+0000 7f6ce1ffb640 1 -- 172.21.15.19:0/935472570 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f6ce8041050 con 0x5583a54d7190 2024-09-10T22:35:45.018 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:45.011+0000 7f6d032b4740 10 client.17253 fetch_fsmap learned FSMap version 27 2024-09-10T22:35:45.018 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:45.011+0000 7f6d032b4740 1 -- 172.21.15.19:0/935472570 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x5583a54e5a70 con 0x5583a54d7190 2024-09-10T22:35:45.018 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:45.011+0000 7f6ce1ffb640 1 -- 172.21.15.19:0/935472570 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6cf0036030 con 0x5583a54d7190 2024-09-10T22:35:45.018 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:45.011+0000 7f6ce1ffb640 1 -- 172.21.15.19:0/935472570 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7f6ce8030040 con 0x5583a54d7190 2024-09-10T22:35:45.018 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:45.011+0000 7f6d032b4740 10 client.17253 fetch_fsmap finished waiting for FSMap version 27 2024-09-10T22:35:45.018 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:45.011+0000 7f6d032b4740 10 client.17253 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-10T22:35:45.018 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:45.011+0000 7f6d032b4740 20 client.17253 populate_metadata read hostname 'smithi019' 2024-09-10T22:35:45.018 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:45.011+0000 7f6d032b4740 1 --2- 172.21.15.19:0/935472570 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x5583a55566b0 0x5583a5558aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:35:45.018 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:45.011+0000 7f6d032b4740 4 client.17253 mds_command: new command op to 24581 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-10T22:35:45.018 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:45.011+0000 7f6d032b4740 1 -- 172.21.15.19:0/935472570 --> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5583a54440f0 con 0x5583a55566b0 2024-09-10T22:35:45.018 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:45.011+0000 7f6cfe282640 1 --2- 172.21.15.19:0/935472570 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x5583a55566b0 0x5583a5558aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:35:45.018 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:45.012+0000 7f6ce1ffb640 10 client.17253 ms_handle_connect on v2:172.21.15.135:6838/1254769802 2024-09-10T22:35:45.019 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:45.012+0000 7f6cfe282640 1 --2- 172.21.15.19:0/935472570 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x5583a55566b0 0x5583a5558aa0 crc :-1 s=READY pgs=191 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f9debac533fb709 server_cookie=f92b187813fe4c68 in_seq=0 out_seq=0 2024-09-10T22:35:45.610 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:35:45 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T22:35:45.610 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:35:45 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T22:35:45.610 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:35:45 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:35:45.625 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:35:45 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T22:35:45.625 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:35:45 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T22:35:45.625 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:35:45 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:35:45.708 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:35:45 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T22:35:45.708 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:35:45 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T22:35:45.709 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:35:45 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:35:46.610 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:35:46 smithi135 ceph-mon[34789]: pgmap v627: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 551 KiB/s rd, 222 MiB/s wr, 124 op/s 2024-09-10T22:35:46.625 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:35:46 smithi138 ceph-mon[35236]: pgmap v627: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 551 KiB/s rd, 222 MiB/s wr, 124 op/s 2024-09-10T22:35:46.708 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:35:46 smithi019 ceph-mon[31375]: pgmap v627: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 551 KiB/s rd, 222 MiB/s wr, 124 op/s 2024-09-10T22:35:48.610 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:35:48 smithi135 ceph-mon[34789]: pgmap v628: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 558 KiB/s rd, 252 MiB/s wr, 325 op/s 2024-09-10T22:35:48.610 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:35:48 smithi135 ceph-mon[34789]: scrub summary: idle 2024-09-10T22:35:48.610 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:35:48 smithi135 ceph-mon[34789]: scrub summary: idle 2024-09-10T22:35:48.625 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:35:48 smithi138 ceph-mon[35236]: pgmap v628: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 558 KiB/s rd, 252 MiB/s wr, 325 op/s 2024-09-10T22:35:48.625 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:35:48 smithi138 ceph-mon[35236]: scrub summary: idle 2024-09-10T22:35:48.625 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:35:48 smithi138 ceph-mon[35236]: scrub summary: idle 2024-09-10T22:35:48.708 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:35:48 smithi019 ceph-mon[31375]: pgmap v628: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 558 KiB/s rd, 252 MiB/s wr, 325 op/s 2024-09-10T22:35:48.708 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:35:48 smithi019 ceph-mon[31375]: scrub summary: idle 2024-09-10T22:35:48.709 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:35:48 smithi019 ceph-mon[31375]: scrub summary: idle 2024-09-10T22:35:50.610 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:35:50 smithi135 ceph-mon[34789]: pgmap v629: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 383 KiB/s rd, 194 MiB/s wr, 351 op/s 2024-09-10T22:35:50.625 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:35:50 smithi138 ceph-mon[35236]: pgmap v629: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 383 KiB/s rd, 194 MiB/s wr, 351 op/s 2024-09-10T22:35:50.708 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:35:50 smithi019 ceph-mon[31375]: pgmap v629: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 383 KiB/s rd, 194 MiB/s wr, 351 op/s 2024-09-10T22:35:52.610 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:35:52 smithi135 ceph-mon[34789]: pgmap v630: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 455 KiB/s rd, 225 MiB/s wr, 618 op/s 2024-09-10T22:35:52.625 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:35:52 smithi138 ceph-mon[35236]: pgmap v630: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 455 KiB/s rd, 225 MiB/s wr, 618 op/s 2024-09-10T22:35:52.709 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:35:52 smithi019 ceph-mon[31375]: pgmap v630: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 455 KiB/s rd, 225 MiB/s wr, 618 op/s 2024-09-10T22:35:52.718 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:52.715+0000 7f6ce1ffb640 1 -- 172.21.15.19:0/935472570 <== mds.0 v2:172.21.15.135:6838/1254769802 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5583a54440f0 con 0x5583a55566b0 2024-09-10T22:35:52.718 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:52.715+0000 7f6ce1ffb640 10 client.17253 handle_command_reply: tid=0 2024-09-10T22:35:52.718 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:52.715+0000 7f6d032b4740 1 client.17253 shutdown 2024-09-10T22:35:52.719 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:52.716+0000 7f6d032b4740 1 -- 172.21.15.19:0/935472570 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5583a54d7190 msgr2=0x5583a54e3480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:35:52.719 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:52.716+0000 7f6d032b4740 1 --2- 172.21.15.19:0/935472570 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5583a54d7190 0x5583a54e3480 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7f6ce8009460 tx=0x7f6ce801e770 comp rx=0 tx=0).stop 2024-09-10T22:35:52.719 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:52.716+0000 7f6d032b4740 1 -- 172.21.15.19:0/935472570 shutdown_connections 2024-09-10T22:35:52.719 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:52.716+0000 7f6d032b4740 1 --2- 172.21.15.19:0/935472570 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x5583a55566b0 0x5583a5558aa0 crc :-1 s=READY pgs=191 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:35:52.719 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:52.716+0000 7f6d032b4740 1 --2- 172.21.15.19:0/935472570 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5583a54d9bd0 0x5583a54e4050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:35:52.719 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:52.716+0000 7f6d032b4740 1 --2- 172.21.15.19:0/935472570 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5583a54d7190 0x5583a54e3480 unknown :-1 s=CLOSED pgs=792 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:35:52.719 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:52.716+0000 7f6d032b4740 1 --2- 172.21.15.19:0/935472570 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5583a54d4860 0x5583a54e2de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:35:52.719 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:52.716+0000 7f6ce1ffb640 0 client.17253 ms_handle_reset on v2:172.21.15.135:6838/1254769802 2024-09-10T22:35:52.719 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:52.716+0000 7f6d032b4740 1 -- 172.21.15.19:0/935472570 >> 172.21.15.19:0/935472570 conn(0x5583a54cf9b0 msgr2=0x5583a54ce3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:35:52.719 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:52.716+0000 7f6d032b4740 1 -- 172.21.15.19:0/935472570 shutdown_connections 2024-09-10T22:35:52.719 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:52.716+0000 7f6d032b4740 1 -- 172.21.15.19:0/935472570 wait complete. 2024-09-10T22:35:52.719 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:52.716+0000 7f6d032b4740 20 client.17253 trim_cache size 0 max 16384 2024-09-10T22:35:52.720 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stdout:{ 2024-09-10T22:35:52.720 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stdout: "message": "", 2024-09-10T22:35:52.720 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stdout: "return_code": 0 2024-09-10T22:35:52.720 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stdout:} 2024-09-10T22:35:52.721 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:52.717+0000 7f6d004e6640 1 -- 172.21.15.19:0/2572708710 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f6ce40b52e0 msgr2=0x7f6ce40b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:35:52.721 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:52.717+0000 7f6d004e6640 1 --2- 172.21.15.19:0/2572708710 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f6ce40b52e0 0x7f6ce40b77a0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f6cf400bfd0 tx=0x7f6cf400b390 comp rx=0 tx=0).stop 2024-09-10T22:35:52.721 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:52.717+0000 7f6d004e6640 1 -- 172.21.15.19:0/2572708710 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6cf81086a0 msgr2=0x7f6cf8101a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:35:52.721 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:52.717+0000 7f6d004e6640 1 --2- 172.21.15.19:0/2572708710 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6cf81086a0 0x7f6cf8101a40 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x7f6cf00097b0 tx=0x7f6cf0031840 comp rx=0 tx=0).stop 2024-09-10T22:35:52.721 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:52.717+0000 7f6d004e6640 1 -- 172.21.15.19:0/2572708710 shutdown_connections 2024-09-10T22:35:52.721 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:52.717+0000 7f6d004e6640 1 --2- 172.21.15.19:0/2572708710 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f6ce40b52e0 0x7f6ce40b77a0 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:35:52.721 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:52.717+0000 7f6d004e6640 1 --2- 172.21.15.19:0/2572708710 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6cf81086a0 0x7f6cf8101a40 unknown :-1 s=CLOSED pgs=789 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:35:52.721 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:52.717+0000 7f6d004e6640 1 --2- 172.21.15.19:0/2572708710 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f6cf8105af0 0x7f6cf8101500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:35:52.721 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:52.717+0000 7f6d004e6640 1 --2- 172.21.15.19:0/2572708710 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6cf806bf50 0x7f6cf8102ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:35:52.721 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:52.717+0000 7f6d004e6640 1 -- 172.21.15.19:0/2572708710 >> 172.21.15.19:0/2572708710 conn(0x7f6cf80fd150 msgr2=0x7f6cf8103e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:35:52.722 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:52.717+0000 7f6d004e6640 1 -- 172.21.15.19:0/2572708710 shutdown_connections 2024-09-10T22:35:52.722 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:35:52.717+0000 7f6d004e6640 1 -- 172.21.15.19:0/2572708710 wait complete. 2024-09-10T22:35:54.610 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:35:54 smithi135 ceph-mon[34789]: pgmap v631: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 419 KiB/s rd, 202 MiB/s wr, 805 op/s 2024-09-10T22:35:54.625 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:35:54 smithi138 ceph-mon[35236]: pgmap v631: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 419 KiB/s rd, 202 MiB/s wr, 805 op/s 2024-09-10T22:35:54.708 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:35:54 smithi019 ceph-mon[31375]: pgmap v631: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 419 KiB/s rd, 202 MiB/s wr, 805 op/s 2024-09-10T22:35:55.708 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:35:55 smithi019 ceph-mon[31375]: pgmap v632: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 340 KiB/s rd, 203 MiB/s wr, 980 op/s 2024-09-10T22:35:55.860 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:35:55 smithi135 ceph-mon[34789]: pgmap v632: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 340 KiB/s rd, 203 MiB/s wr, 980 op/s 2024-09-10T22:35:55.875 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:35:55 smithi138 ceph-mon[35236]: pgmap v632: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 340 KiB/s rd, 203 MiB/s wr, 980 op/s 2024-09-10T22:35:57.958 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:35:57 smithi019 ceph-mon[31375]: pgmap v633: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 495 KiB/s rd, 226 MiB/s wr, 1.24k op/s 2024-09-10T22:35:58.109 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:35:57 smithi135 ceph-mon[34789]: pgmap v633: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 495 KiB/s rd, 226 MiB/s wr, 1.24k op/s 2024-09-10T22:35:58.125 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:35:57 smithi138 ceph-mon[35236]: pgmap v633: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 495 KiB/s rd, 226 MiB/s wr, 1.24k op/s 2024-09-10T22:35:59.959 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:35:59 smithi019 ceph-mon[31375]: pgmap v634: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 336 KiB/s rd, 174 MiB/s wr, 1.08k op/s 2024-09-10T22:36:00.109 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:35:59 smithi135 ceph-mon[34789]: pgmap v634: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 336 KiB/s rd, 174 MiB/s wr, 1.08k op/s 2024-09-10T22:36:00.125 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:35:59 smithi138 ceph-mon[35236]: pgmap v634: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 336 KiB/s rd, 174 MiB/s wr, 1.08k op/s 2024-09-10T22:36:01.959 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:36:01 smithi019 ceph-mon[31375]: pgmap v635: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 451 KiB/s rd, 214 MiB/s wr, 1.24k op/s 2024-09-10T22:36:02.110 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:36:01 smithi135 ceph-mon[34789]: pgmap v635: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 451 KiB/s rd, 214 MiB/s wr, 1.24k op/s 2024-09-10T22:36:02.125 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:36:01 smithi138 ceph-mon[35236]: pgmap v635: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 451 KiB/s rd, 214 MiB/s wr, 1.24k op/s 2024-09-10T22:36:03.958 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:36:03 smithi019 ceph-mon[31375]: pgmap v636: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 423 KiB/s rd, 196 MiB/s wr, 1.08k op/s 2024-09-10T22:36:04.110 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:36:03 smithi135 ceph-mon[34789]: pgmap v636: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 423 KiB/s rd, 196 MiB/s wr, 1.08k op/s 2024-09-10T22:36:04.125 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:36:03 smithi138 ceph-mon[35236]: pgmap v636: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 423 KiB/s rd, 196 MiB/s wr, 1.08k op/s 2024-09-10T22:36:05.862 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:05.858+0000 7f8c2fdd3640 1 -- 172.21.15.19:0/1594431656 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f8c281029c0 msgr2=0x7f8c28102e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:36:05.863 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:05.858+0000 7f8c2fdd3640 1 --2- 172.21.15.19:0/1594431656 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f8c281029c0 0x7f8c28102e40 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f8c18009930 tx=0x7f8c1802a420 comp rx=0 tx=0).stop 2024-09-10T22:36:05.863 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:05.858+0000 7f8c2fdd3640 1 -- 172.21.15.19:0/1594431656 shutdown_connections 2024-09-10T22:36:05.863 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:05.858+0000 7f8c2fdd3640 1 --2- 172.21.15.19:0/1594431656 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8c28103380 0x7f8c28109d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:36:05.863 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:05.858+0000 7f8c2fdd3640 1 --2- 172.21.15.19:0/1594431656 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f8c281029c0 0x7f8c28102e40 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:36:05.863 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:05.858+0000 7f8c2fdd3640 1 --2- 172.21.15.19:0/1594431656 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8c28101870 0x7f8c28101c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:36:05.863 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:05.858+0000 7f8c2fdd3640 1 -- 172.21.15.19:0/1594431656 >> 172.21.15.19:0/1594431656 conn(0x7f8c280fd130 msgr2=0x7f8c280ff550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:36:05.863 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:05.858+0000 7f8c2fdd3640 1 -- 172.21.15.19:0/1594431656 shutdown_connections 2024-09-10T22:36:05.863 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:05.858+0000 7f8c2fdd3640 1 -- 172.21.15.19:0/1594431656 wait complete. 2024-09-10T22:36:05.863 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:05.859+0000 7f8c2fdd3640 1 Processor -- start 2024-09-10T22:36:05.863 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:05.859+0000 7f8c2fdd3640 1 -- start start 2024-09-10T22:36:05.864 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:05.859+0000 7f8c2fdd3640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8c28101870 0x7f8c28198da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:36:05.864 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:05.859+0000 7f8c2fdd3640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8c281029c0 0x7f8c281993f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:36:05.864 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:05.859+0000 7f8c2fdd3640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f8c28103380 0x7f8c2819a020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:36:05.864 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:05.859+0000 7f8c2fdd3640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f8c2810d4c0 con 0x7f8c28101870 2024-09-10T22:36:05.864 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:05.859+0000 7f8c2fdd3640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f8c2810d340 con 0x7f8c281029c0 2024-09-10T22:36:05.864 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:05.859+0000 7f8c2fdd3640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f8c2810d640 con 0x7f8c28103380 2024-09-10T22:36:05.864 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:05.859+0000 7f8c2db6f640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8c28101870 0x7f8c28198da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:36:05.864 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:05.859+0000 7f8c2d36e640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8c281029c0 0x7f8c281993f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:36:05.864 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:05.860+0000 7f8c2db6f640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8c28101870 0x7f8c28198da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:42078/0 (socket says 172.21.15.19:42078) 2024-09-10T22:36:05.864 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:05.860+0000 7f8c2d36e640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8c281029c0 0x7f8c281993f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.19:60508/0 (socket says 172.21.15.19:60508) 2024-09-10T22:36:05.864 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:05.860+0000 7f8c2db6f640 1 -- 172.21.15.19:0/3315920169 learned_addr learned my addr 172.21.15.19:0/3315920169 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:36:05.864 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:05.860+0000 7f8c2e370640 1 --2- 172.21.15.19:0/3315920169 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f8c28103380 0x7f8c2819a020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:36:05.865 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:05.860+0000 7f8c2db6f640 1 -- 172.21.15.19:0/3315920169 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f8c28103380 msgr2=0x7f8c2819a020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:36:05.865 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:05.860+0000 7f8c2db6f640 1 --2- 172.21.15.19:0/3315920169 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f8c28103380 0x7f8c2819a020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:36:05.865 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:05.860+0000 7f8c2db6f640 1 -- 172.21.15.19:0/3315920169 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8c281029c0 msgr2=0x7f8c281993f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:36:05.865 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:05.860+0000 7f8c2db6f640 1 --2- 172.21.15.19:0/3315920169 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8c281029c0 0x7f8c281993f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:36:05.865 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:05.860+0000 7f8c2db6f640 1 -- 172.21.15.19:0/3315920169 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8c2819a8e0 con 0x7f8c28101870 2024-09-10T22:36:05.865 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:05.860+0000 7f8c2e370640 1 --2- 172.21.15.19:0/3315920169 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f8c28103380 0x7f8c2819a020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T22:36:05.865 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:05.860+0000 7f8c2db6f640 1 --2- 172.21.15.19:0/3315920169 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8c28101870 0x7f8c28198da0 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 crypto rx=0x7f8c2400d950 tx=0x7f8c2400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:36:05.865 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:05.860+0000 7f8c1effd640 1 -- 172.21.15.19:0/3315920169 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c24017030 con 0x7f8c28101870 2024-09-10T22:36:05.865 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:05.860+0000 7f8c2fdd3640 1 -- 172.21.15.19:0/3315920169 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8c2819abd0 con 0x7f8c28101870 2024-09-10T22:36:05.865 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:05.860+0000 7f8c1effd640 1 -- 172.21.15.19:0/3315920169 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8c24004020 con 0x7f8c28101870 2024-09-10T22:36:05.865 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:05.860+0000 7f8c1effd640 1 -- 172.21.15.19:0/3315920169 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c240047a0 con 0x7f8c28101870 2024-09-10T22:36:05.865 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:05.860+0000 7f8c2fdd3640 1 -- 172.21.15.19:0/3315920169 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8c281a12a0 con 0x7f8c28101870 2024-09-10T22:36:05.871 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:05.863+0000 7f8c1effd640 1 -- 172.21.15.19:0/3315920169 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 18) ==== 153250+0+0 (secure 0 0 0) 0x7f8c24009a30 con 0x7f8c28101870 2024-09-10T22:36:05.871 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:05.863+0000 7f8c32c7d740 1 Processor -- start 2024-09-10T22:36:05.871 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:05.864+0000 7f8c32c7d740 1 -- start start 2024-09-10T22:36:05.871 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:05.864+0000 7f8c32c7d740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5619f792f860 0x5619f7931c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:36:05.871 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:05.864+0000 7f8c32c7d740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5619f7932190 0x5619f7934580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:36:05.871 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:05.864+0000 7f8c32c7d740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5619f7934bd0 0x5619f7937090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:36:05.872 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:05.864+0000 7f8c32c7d740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x5619f78a16f0 con 0x5619f792f860 2024-09-10T22:36:05.872 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:05.864+0000 7f8c32c7d740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x5619f7890b20 con 0x5619f7934bd0 2024-09-10T22:36:05.872 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:05.864+0000 7f8c32c7d740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x5619f7894930 con 0x5619f7932190 2024-09-10T22:36:05.872 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:05.864+0000 7f8c2e370640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5619f792f860 0x5619f7931c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:36:05.872 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:05.864+0000 7f8c2d36e640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5619f7934bd0 0x5619f7937090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:36:05.872 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:05.864+0000 7f8c2d36e640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5619f7934bd0 0x5619f7937090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.19:60514/0 (socket says 172.21.15.19:60514) 2024-09-10T22:36:05.872 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:05.864+0000 7f8c2d36e640 1 -- 172.21.15.19:0/977490732 learned_addr learned my addr 172.21.15.19:0/977490732 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:36:05.872 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:05.864+0000 7f8c2e370640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5619f792f860 0x5619f7931c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:42090/0 (socket says 172.21.15.19:42090) 2024-09-10T22:36:05.872 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:05.864+0000 7f8c2db6f640 1 --2- 172.21.15.19:0/977490732 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5619f7932190 0x5619f7934580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:36:05.872 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:05.864+0000 7f8c2d36e640 1 -- 172.21.15.19:0/977490732 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5619f7932190 msgr2=0x5619f7934580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:36:05.872 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:05.864+0000 7f8c2d36e640 1 --2- 172.21.15.19:0/977490732 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5619f7932190 0x5619f7934580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:36:05.872 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:05.865+0000 7f8c2d36e640 1 -- 172.21.15.19:0/977490732 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5619f792f860 msgr2=0x5619f7931c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:36:05.872 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:05.865+0000 7f8c2d36e640 1 --2- 172.21.15.19:0/977490732 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5619f792f860 0x5619f7931c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:36:05.873 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:05.865+0000 7f8c2d36e640 1 -- 172.21.15.19:0/977490732 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5619f7856530 con 0x5619f7934bd0 2024-09-10T22:36:05.873 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:05.865+0000 7f8c2db6f640 1 --2- 172.21.15.19:0/977490732 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5619f7932190 0x5619f7934580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T22:36:05.873 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:05.865+0000 7f8c1effd640 1 --2- 172.21.15.19:0/3315920169 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f8c140b52e0 0x7f8c140b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:36:05.873 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:05.865+0000 7f8c2e370640 1 --2- 172.21.15.19:0/3315920169 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f8c140b52e0 0x7f8c140b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:36:05.873 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:05.865+0000 7f8c2d36e640 1 --2- 172.21.15.19:0/977490732 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5619f7934bd0 0x5619f7937090 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f8c1802a940 tx=0x7f8c18031b10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a2a8c36160c5d113 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:36:05.873 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:05.865+0000 7f8c1effd640 1 -- 172.21.15.19:0/3315920169 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8327+0+0 (secure 0 0 0) 0x7f8c240e5750 con 0x7f8c28101870 2024-09-10T22:36:05.873 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:05.865+0000 7f8c13fff640 1 -- 172.21.15.19:0/977490732 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c18035030 con 0x5619f7934bd0 2024-09-10T22:36:05.873 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:05.865+0000 7f8c13fff640 1 -- 172.21.15.19:0/977490732 <== mon.2 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8c18040070 con 0x5619f7934bd0 2024-09-10T22:36:05.873 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:05.865+0000 7f8c13fff640 1 -- 172.21.15.19:0/977490732 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c180039e0 con 0x5619f7934bd0 2024-09-10T22:36:05.873 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:05.866+0000 7f8c32c7d740 1 -- 172.21.15.19:0/977490732 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5619f7934bd0 msgr2=0x5619f7937090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:36:05.873 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:05.866+0000 7f8c32c7d740 1 --2- 172.21.15.19:0/977490732 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5619f7934bd0 0x5619f7937090 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f8c1802a940 tx=0x7f8c18031b10 comp rx=0 tx=0).stop 2024-09-10T22:36:05.873 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:05.866+0000 7f8c2e370640 1 --2- 172.21.15.19:0/3315920169 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f8c140b52e0 0x7f8c140b77a0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f8c28199b20 tx=0x7f8c20009500 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:36:05.873 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:05.866+0000 7f8c32c7d740 1 -- 172.21.15.19:0/977490732 shutdown_connections 2024-09-10T22:36:05.874 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:05.866+0000 7f8c32c7d740 1 --2- 172.21.15.19:0/977490732 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5619f7934bd0 0x5619f7937090 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:36:05.874 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:05.866+0000 7f8c32c7d740 1 --2- 172.21.15.19:0/977490732 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5619f7932190 0x5619f7934580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:36:05.874 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:05.866+0000 7f8c32c7d740 1 --2- 172.21.15.19:0/977490732 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5619f792f860 0x5619f7931c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:36:05.874 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:05.866+0000 7f8c32c7d740 1 -- 172.21.15.19:0/977490732 >> 172.21.15.19:0/977490732 conn(0x5619f792a9b0 msgr2=0x5619f792b740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:36:05.874 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:05.866+0000 7f8c32c7d740 1 -- 172.21.15.19:0/977490732 shutdown_connections 2024-09-10T22:36:05.874 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:05.866+0000 7f8c32c7d740 1 -- 172.21.15.19:0/977490732 wait complete. 2024-09-10T22:36:05.874 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:05.866+0000 7f8c32c7d740 1 -- start start 2024-09-10T22:36:05.874 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:05.867+0000 7f8c32c7d740 1 Processor -- start 2024-09-10T22:36:05.874 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:05.867+0000 7f8c32c7d740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5619f792f860 0x5619f7938e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:36:05.874 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:05.867+0000 7f8c32c7d740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5619f7932190 0x5619f79394e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:36:05.874 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:05.867+0000 7f8c32c7d740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5619f7934bd0 0x5619f793a0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:36:05.874 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:05.867+0000 7f8c32c7d740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x5619f77c8ab0 con 0x5619f792f860 2024-09-10T22:36:05.874 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:05.867+0000 7f8c32c7d740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x5619f7836730 con 0x5619f7932190 2024-09-10T22:36:05.875 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:05.867+0000 7f8c32c7d740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x5619f7937b50 con 0x5619f7934bd0 2024-09-10T22:36:05.875 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:05.867+0000 7f8c32c7d740 10 client.0 _ll_register_callbacks cb 0x5619f788a6b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T22:36:05.875 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:05.867+0000 7f8c2db6f640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5619f792f860 0x5619f7938e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:36:05.875 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:05.867+0000 7f8c2d36e640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5619f7932190 0x5619f79394e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:36:05.875 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:05.867+0000 7f8c2e370640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5619f7934bd0 0x5619f793a0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:36:05.875 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:05.867+0000 7f8c2db6f640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5619f792f860 0x5619f7938e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:42098/0 (socket says 172.21.15.19:42098) 2024-09-10T22:36:05.875 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:05.867+0000 7f8c2db6f640 1 -- 172.21.15.19:0/1475397844 learned_addr learned my addr 172.21.15.19:0/1475397844 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:36:05.875 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:05.867+0000 7f8c2d36e640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5619f7932190 0x5619f79394e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.19:60524/0 (socket says 172.21.15.19:60524) 2024-09-10T22:36:05.875 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:05.868+0000 7f8c2d36e640 1 -- 172.21.15.19:0/1475397844 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5619f7934bd0 msgr2=0x5619f793a0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:36:05.875 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:05.868+0000 7f8c2d36e640 1 --2- 172.21.15.19:0/1475397844 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5619f7934bd0 0x5619f793a0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:36:05.875 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:05.868+0000 7f8c2d36e640 1 -- 172.21.15.19:0/1475397844 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5619f792f860 msgr2=0x5619f7938e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:36:05.875 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:05.868+0000 7f8c2d36e640 1 --2- 172.21.15.19:0/1475397844 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5619f792f860 0x5619f7938e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:36:05.875 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:05.868+0000 7f8c2d36e640 1 -- 172.21.15.19:0/1475397844 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5619f75f2790 con 0x5619f7932190 2024-09-10T22:36:05.876 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:05.868+0000 7f8c2db6f640 1 --2- 172.21.15.19:0/1475397844 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5619f792f860 0x5619f7938e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T22:36:05.876 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:05.868+0000 7f8c2d36e640 1 --2- 172.21.15.19:0/1475397844 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5619f7932190 0x5619f79394e0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f8c18000c00 tx=0x7f8c180317d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4e38499269ec92ae server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:36:05.876 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:05.868+0000 7f8c117fa640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-09-10T22:36:05.876 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:05.868+0000 7f8c117fa640 1 -- 172.21.15.19:0/1475397844 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c18035030 con 0x5619f7932190 2024-09-10T22:36:05.876 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:05.868+0000 7f8c32c7d740 1 -- 172.21.15.19:0/1475397844 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8c18040070 con 0x5619f7932190 2024-09-10T22:36:05.876 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:05.868+0000 7f8c117fa640 1 -- 172.21.15.19:0/1475397844 <== mon.2 v2:172.21.15.135:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8327+0+0 (secure 0 0 0) 0x7f8c18003760 con 0x5619f7932190 2024-09-10T22:36:05.876 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:05.868+0000 7f8c117fa640 1 -- 172.21.15.19:0/1475397844 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f8c18003960 con 0x5619f7932190 2024-09-10T22:36:05.876 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:05.868+0000 7f8c32c7d740 10 client.26576 fetch_fsmap learned FSMap version 27 2024-09-10T22:36:05.876 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:05.868+0000 7f8c32c7d740 1 -- 172.21.15.19:0/1475397844 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x5619f766b620 con 0x5619f7932190 2024-09-10T22:36:05.876 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:05.868+0000 7f8c117fa640 1 -- 172.21.15.19:0/1475397844 <== mon.2 v2:172.21.15.135:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8c18040070 con 0x5619f7932190 2024-09-10T22:36:05.876 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:05.869+0000 7f8c117fa640 1 -- 172.21.15.19:0/1475397844 <== mon.2 v2:172.21.15.135:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7f8c18056020 con 0x5619f7932190 2024-09-10T22:36:05.876 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:05.869+0000 7f8c32c7d740 10 client.26576 fetch_fsmap finished waiting for FSMap version 27 2024-09-10T22:36:05.876 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:05.869+0000 7f8c32c7d740 10 client.26576 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-10T22:36:05.877 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:05.869+0000 7f8c32c7d740 20 client.26576 populate_metadata read hostname 'smithi019' 2024-09-10T22:36:05.877 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:05.869+0000 7f8c32c7d740 1 --2- 172.21.15.19:0/1475397844 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x5619f79442e0 0x5619f79466d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:36:05.877 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:05.869+0000 7f8c32c7d740 4 client.26576 mds_command: new command op to 24581 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T22:36:05.877 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:05.869+0000 7f8c32c7d740 1 -- 172.21.15.19:0/1475397844 --> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5619f78a3640 con 0x5619f79442e0 2024-09-10T22:36:05.877 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:05.869+0000 7f8c2db6f640 1 --2- 172.21.15.19:0/1475397844 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x5619f79442e0 0x5619f79466d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:36:05.877 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:05.869+0000 7f8c2db6f640 1 --2- 172.21.15.19:0/1475397844 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x5619f79442e0 0x5619f79466d0 crc :-1 s=READY pgs=192 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2e18afdbf522a62 server_cookie=37f872d4d094ed48 in_seq=0 out_seq=0 2024-09-10T22:36:05.877 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:05.869+0000 7f8c117fa640 10 client.26576 ms_handle_connect on v2:172.21.15.135:6838/1254769802 2024-09-10T22:36:05.882 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:05.870+0000 7f8c117fa640 1 -- 172.21.15.19:0/1475397844 <== mds.0 v2:172.21.15.135:6838/1254769802 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5619f78a3640 con 0x5619f79442e0 2024-09-10T22:36:05.882 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:05.870+0000 7f8c117fa640 10 client.26576 handle_command_reply: tid=0 2024-09-10T22:36:05.882 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:05.870+0000 7f8c32c7d740 1 client.26576 shutdown 2024-09-10T22:36:05.882 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:05.870+0000 7f8c32c7d740 1 -- 172.21.15.19:0/1475397844 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5619f7932190 msgr2=0x5619f79394e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:36:05.882 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:05.870+0000 7f8c32c7d740 1 --2- 172.21.15.19:0/1475397844 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5619f7932190 0x5619f79394e0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f8c18000c00 tx=0x7f8c180317d0 comp rx=0 tx=0).stop 2024-09-10T22:36:05.882 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:05.870+0000 7f8c32c7d740 1 -- 172.21.15.19:0/1475397844 shutdown_connections 2024-09-10T22:36:05.882 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:05.870+0000 7f8c32c7d740 1 --2- 172.21.15.19:0/1475397844 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x5619f79442e0 0x5619f79466d0 crc :-1 s=READY pgs=192 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:36:05.882 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:05.871+0000 7f8c32c7d740 1 --2- 172.21.15.19:0/1475397844 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5619f7934bd0 0x5619f793a0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:36:05.882 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:05.871+0000 7f8c117fa640 0 client.26576 ms_handle_reset on v2:172.21.15.135:6838/1254769802 2024-09-10T22:36:05.882 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:05.871+0000 7f8c32c7d740 1 --2- 172.21.15.19:0/1475397844 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5619f7932190 0x5619f79394e0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:36:05.882 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:05.871+0000 7f8c32c7d740 1 --2- 172.21.15.19:0/1475397844 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5619f792f860 0x5619f7938e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:36:05.883 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:05.871+0000 7f8c32c7d740 1 -- 172.21.15.19:0/1475397844 >> 172.21.15.19:0/1475397844 conn(0x5619f792a9b0 msgr2=0x5619f7929bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:36:05.883 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:05.871+0000 7f8c32c7d740 1 -- 172.21.15.19:0/1475397844 shutdown_connections 2024-09-10T22:36:05.883 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:05.871+0000 7f8c32c7d740 1 -- 172.21.15.19:0/1475397844 wait complete. 2024-09-10T22:36:05.883 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:05.871+0000 7f8c32c7d740 20 client.26576 trim_cache size 0 max 16384 2024-09-10T22:36:05.888 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:05.886+0000 7f8c32c7d740 1 Processor -- start 2024-09-10T22:36:05.889 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:05.886+0000 7f8c32c7d740 1 -- start start 2024-09-10T22:36:05.889 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:05.886+0000 7f8c32c7d740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5619f792f860 0x5619f793a090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:36:05.889 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:05.886+0000 7f8c32c7d740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5619f7932190 0x5619f792ecf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:36:05.889 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:05.886+0000 7f8c32c7d740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5619f7934bd0 0x5619f792f230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:36:05.889 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:05.886+0000 7f8c32c7d740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f8c281ac9b0 con 0x5619f792f860 2024-09-10T22:36:05.889 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:05.886+0000 7f8c32c7d740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f8c281aa280 con 0x5619f7934bd0 2024-09-10T22:36:05.889 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:05.886+0000 7f8c32c7d740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f8c281a80d0 con 0x5619f7932190 2024-09-10T22:36:05.889 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:05.886+0000 7f8c2e370640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5619f7934bd0 0x5619f792f230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:36:05.889 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:05.887+0000 7f8c2e370640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5619f7934bd0 0x5619f792f230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.19:60540/0 (socket says 172.21.15.19:60540) 2024-09-10T22:36:05.889 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:05.887+0000 7f8c2e370640 1 -- 172.21.15.19:0/4182004375 learned_addr learned my addr 172.21.15.19:0/4182004375 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:36:05.889 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:05.887+0000 7f8c2d36e640 1 --2- 172.21.15.19:0/4182004375 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5619f7932190 0x5619f792ecf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:36:05.889 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:05.887+0000 7f8c2db6f640 1 --2- 172.21.15.19:0/4182004375 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5619f792f860 0x5619f793a090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:36:05.890 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:05.887+0000 7f8c2e370640 1 -- 172.21.15.19:0/4182004375 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5619f7932190 msgr2=0x5619f792ecf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:36:05.890 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:05.887+0000 7f8c2e370640 1 --2- 172.21.15.19:0/4182004375 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5619f7932190 0x5619f792ecf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:36:05.890 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:05.887+0000 7f8c2e370640 1 -- 172.21.15.19:0/4182004375 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5619f792f860 msgr2=0x5619f793a090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:36:05.890 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:05.887+0000 7f8c2e370640 1 --2- 172.21.15.19:0/4182004375 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5619f792f860 0x5619f793a090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:36:05.890 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:05.887+0000 7f8c2e370640 1 -- 172.21.15.19:0/4182004375 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5619f79262d0 con 0x5619f7934bd0 2024-09-10T22:36:05.890 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:05.887+0000 7f8c2db6f640 1 --2- 172.21.15.19:0/4182004375 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5619f792f860 0x5619f793a090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T22:36:05.890 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:05.887+0000 7f8c2e370640 1 --2- 172.21.15.19:0/4182004375 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5619f7934bd0 0x5619f792f230 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f8c20010950 tx=0x7f8c20019000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=582a68372f97e794 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:36:05.890 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:05.887+0000 7f8c137fe640 1 -- 172.21.15.19:0/4182004375 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c20004b20 con 0x5619f7934bd0 2024-09-10T22:36:05.890 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:05.887+0000 7f8c137fe640 1 -- 172.21.15.19:0/4182004375 <== mon.2 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8c2001ee50 con 0x5619f7934bd0 2024-09-10T22:36:05.890 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:05.887+0000 7f8c137fe640 1 -- 172.21.15.19:0/4182004375 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c200057e0 con 0x5619f7934bd0 2024-09-10T22:36:05.894 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:05.888+0000 7f8c32c7d740 1 -- 172.21.15.19:0/4182004375 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5619f7934bd0 msgr2=0x5619f792f230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:36:05.894 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:05.888+0000 7f8c32c7d740 1 --2- 172.21.15.19:0/4182004375 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5619f7934bd0 0x5619f792f230 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f8c20010950 tx=0x7f8c20019000 comp rx=0 tx=0).stop 2024-09-10T22:36:05.894 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:05.888+0000 7f8c32c7d740 1 -- 172.21.15.19:0/4182004375 shutdown_connections 2024-09-10T22:36:05.894 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:05.888+0000 7f8c32c7d740 1 --2- 172.21.15.19:0/4182004375 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5619f7934bd0 0x5619f792f230 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:36:05.894 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:05.888+0000 7f8c32c7d740 1 --2- 172.21.15.19:0/4182004375 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5619f7932190 0x5619f792ecf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:36:05.894 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:05.888+0000 7f8c32c7d740 1 --2- 172.21.15.19:0/4182004375 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5619f792f860 0x5619f793a090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:36:05.894 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:05.888+0000 7f8c32c7d740 1 -- 172.21.15.19:0/4182004375 >> 172.21.15.19:0/4182004375 conn(0x5619f792a9b0 msgr2=0x5619f7934fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:36:05.894 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:05.888+0000 7f8c32c7d740 1 -- 172.21.15.19:0/4182004375 shutdown_connections 2024-09-10T22:36:05.894 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:05.888+0000 7f8c32c7d740 1 -- 172.21.15.19:0/4182004375 wait complete. 2024-09-10T22:36:05.894 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:05.889+0000 7f8c32c7d740 1 -- start start 2024-09-10T22:36:05.895 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:05.889+0000 7f8c32c7d740 1 Processor -- start 2024-09-10T22:36:05.895 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:05.889+0000 7f8c32c7d740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5619f792f860 0x5619f7940490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:36:05.895 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:05.889+0000 7f8c32c7d740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5619f7932190 0x5619f7940b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:36:05.895 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:05.889+0000 7f8c32c7d740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5619f7934bd0 0x5619f793c2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:36:05.895 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:05.889+0000 7f8c32c7d740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f8c281a8740 con 0x5619f7934bd0 2024-09-10T22:36:05.895 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:05.889+0000 7f8c32c7d740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f8c281a9bb0 con 0x5619f7932190 2024-09-10T22:36:05.895 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:05.889+0000 7f8c32c7d740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f8c281a8e10 con 0x5619f792f860 2024-09-10T22:36:05.895 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:05.889+0000 7f8c32c7d740 10 client.0 _ll_register_callbacks cb 0x7f8c20009920 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T22:36:05.895 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:05.889+0000 7f8c2db6f640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5619f792f860 0x5619f7940490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:36:05.895 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:05.889+0000 7f8c2db6f640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5619f792f860 0x5619f7940490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.19:54716/0 (socket says 172.21.15.19:54716) 2024-09-10T22:36:05.895 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:05.889+0000 7f8c2db6f640 1 -- 172.21.15.19:0/971129604 learned_addr learned my addr 172.21.15.19:0/971129604 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:36:05.895 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:05.889+0000 7f8c2e370640 1 --2- 172.21.15.19:0/971129604 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5619f7934bd0 0x5619f793c2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:36:05.896 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:05.889+0000 7f8c2d36e640 1 --2- 172.21.15.19:0/971129604 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5619f7932190 0x5619f7940b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:36:05.896 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:05.890+0000 7f8c2db6f640 1 -- 172.21.15.19:0/971129604 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5619f7932190 msgr2=0x5619f7940b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:36:05.896 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:05.890+0000 7f8c2db6f640 1 --2- 172.21.15.19:0/971129604 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5619f7932190 0x5619f7940b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:36:05.896 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:05.890+0000 7f8c2db6f640 1 -- 172.21.15.19:0/971129604 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5619f7934bd0 msgr2=0x5619f793c2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:36:05.896 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:05.890+0000 7f8c2db6f640 1 --2- 172.21.15.19:0/971129604 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5619f7934bd0 0x5619f793c2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:36:05.896 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:05.890+0000 7f8c2db6f640 1 -- 172.21.15.19:0/971129604 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5619f793cb50 con 0x5619f792f860 2024-09-10T22:36:05.896 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:05.890+0000 7f8c2db6f640 1 --2- 172.21.15.19:0/971129604 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5619f792f860 0x5619f7940490 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f8c240e3240 tx=0x7f8c240e5a50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1b266055fc64385c server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:36:05.896 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:05.890+0000 7f8c117fa640 10 client.0 ms_handle_connect on v2:172.21.15.138:3300/0 2024-09-10T22:36:05.896 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:05.890+0000 7f8c117fa640 1 -- 172.21.15.19:0/971129604 <== mon.1 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c240abeb0 con 0x5619f792f860 2024-09-10T22:36:05.896 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:05.890+0000 7f8c117fa640 1 -- 172.21.15.19:0/971129604 <== mon.1 v2:172.21.15.138:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8327+0+0 (secure 0 0 0) 0x7f8c24097170 con 0x5619f792f860 2024-09-10T22:36:05.896 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:05.890+0000 7f8c32c7d740 1 -- 172.21.15.19:0/971129604 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8c2001ee50 con 0x5619f792f860 2024-09-10T22:36:05.896 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:05.890+0000 7f8c117fa640 1 -- 172.21.15.19:0/971129604 <== mon.1 v2:172.21.15.138:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f8c240b0990 con 0x5619f792f860 2024-09-10T22:36:05.897 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:05.890+0000 7f8c32c7d740 10 client.26623 fetch_fsmap learned FSMap version 27 2024-09-10T22:36:05.897 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:05.890+0000 7f8c32c7d740 1 -- 172.21.15.19:0/971129604 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x5619f79b5540 con 0x5619f792f860 2024-09-10T22:36:05.897 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:05.890+0000 7f8c117fa640 1 -- 172.21.15.19:0/971129604 <== mon.1 v2:172.21.15.138:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8c2001ee50 con 0x5619f792f860 2024-09-10T22:36:05.897 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:05.890+0000 7f8c117fa640 1 -- 172.21.15.19:0/971129604 <== mon.1 v2:172.21.15.138:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7f8c240930b0 con 0x5619f792f860 2024-09-10T22:36:05.897 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:05.891+0000 7f8c32c7d740 10 client.26623 fetch_fsmap finished waiting for FSMap version 27 2024-09-10T22:36:05.897 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:05.891+0000 7f8c32c7d740 10 client.26623 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-10T22:36:05.897 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:05.891+0000 7f8c32c7d740 20 client.26623 populate_metadata read hostname 'smithi019' 2024-09-10T22:36:05.897 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:05.891+0000 7f8c32c7d740 1 --2- 172.21.15.19:0/971129604 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x5619f79442e0 0x5619f79b7df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:36:05.897 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:05.891+0000 7f8c32c7d740 4 client.26623 mds_command: new command op to 24581 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-10T22:36:05.897 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:05.891+0000 7f8c32c7d740 1 -- 172.21.15.19:0/971129604 --> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5619f789f0f0 con 0x5619f79442e0 2024-09-10T22:36:05.897 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:05.891+0000 7f8c2d36e640 1 --2- 172.21.15.19:0/971129604 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x5619f79442e0 0x5619f79b7df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:36:05.897 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:05.891+0000 7f8c117fa640 10 client.26623 ms_handle_connect on v2:172.21.15.135:6838/1254769802 2024-09-10T22:36:05.897 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:05.891+0000 7f8c2d36e640 1 --2- 172.21.15.19:0/971129604 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x5619f79442e0 0x5619f79b7df0 crc :-1 s=READY pgs=193 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ba5e373e15837e47 server_cookie=a005c64ab626225e in_seq=0 out_seq=0 2024-09-10T22:36:05.958 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:36:05 smithi019 ceph-mon[31375]: pgmap v637: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 315 KiB/s rd, 194 MiB/s wr, 1.03k op/s 2024-09-10T22:36:06.110 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:36:05 smithi135 ceph-mon[34789]: pgmap v637: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 315 KiB/s rd, 194 MiB/s wr, 1.03k op/s 2024-09-10T22:36:06.125 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:36:05 smithi138 ceph-mon[35236]: pgmap v637: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 315 KiB/s rd, 194 MiB/s wr, 1.03k op/s 2024-09-10T22:36:08.110 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:36:07 smithi135 ceph-mon[34789]: pgmap v638: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 615 KiB/s rd, 227 MiB/s wr, 1.09k op/s 2024-09-10T22:36:08.125 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:36:07 smithi138 ceph-mon[35236]: pgmap v638: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 615 KiB/s rd, 227 MiB/s wr, 1.09k op/s 2024-09-10T22:36:08.208 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:36:07 smithi019 ceph-mon[31375]: pgmap v638: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 615 KiB/s rd, 227 MiB/s wr, 1.09k op/s 2024-09-10T22:36:10.098 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:10.096+0000 7f8c117fa640 1 -- 172.21.15.19:0/971129604 <== mds.0 v2:172.21.15.135:6838/1254769802 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5619f789f0f0 con 0x5619f79442e0 2024-09-10T22:36:10.098 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:10.096+0000 7f8c117fa640 10 client.26623 handle_command_reply: tid=0 2024-09-10T22:36:10.098 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:10.096+0000 7f8c32c7d740 1 client.26623 shutdown 2024-09-10T22:36:10.098 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:10.096+0000 7f8c32c7d740 1 -- 172.21.15.19:0/971129604 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5619f792f860 msgr2=0x5619f7940490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:36:10.098 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:10.096+0000 7f8c32c7d740 1 --2- 172.21.15.19:0/971129604 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5619f792f860 0x5619f7940490 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f8c240e3240 tx=0x7f8c240e5a50 comp rx=0 tx=0).stop 2024-09-10T22:36:10.098 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:10.096+0000 7f8c32c7d740 1 -- 172.21.15.19:0/971129604 shutdown_connections 2024-09-10T22:36:10.098 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:10.096+0000 7f8c32c7d740 1 --2- 172.21.15.19:0/971129604 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5619f7934bd0 0x5619f793c2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:36:10.099 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:10.096+0000 7f8c32c7d740 1 --2- 172.21.15.19:0/971129604 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5619f7932190 0x5619f7940b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:36:10.099 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:10.096+0000 7f8c32c7d740 1 --2- 172.21.15.19:0/971129604 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x5619f79442e0 0x5619f79b7df0 crc :-1 s=READY pgs=193 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:36:10.099 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:10.096+0000 7f8c32c7d740 1 --2- 172.21.15.19:0/971129604 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5619f792f860 0x5619f7940490 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:36:10.099 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:10.096+0000 7f8c117fa640 0 client.26623 ms_handle_reset on v2:172.21.15.135:6838/1254769802 2024-09-10T22:36:10.099 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:10.096+0000 7f8c32c7d740 1 -- 172.21.15.19:0/971129604 >> 172.21.15.19:0/971129604 conn(0x5619f792a9b0 msgr2=0x5619f79293d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:36:10.099 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:10.096+0000 7f8c32c7d740 1 -- 172.21.15.19:0/971129604 shutdown_connections 2024-09-10T22:36:10.099 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:10.096+0000 7f8c32c7d740 1 -- 172.21.15.19:0/971129604 wait complete. 2024-09-10T22:36:10.099 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:10.096+0000 7f8c32c7d740 20 client.26623 trim_cache size 0 max 16384 2024-09-10T22:36:10.099 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stdout:{ 2024-09-10T22:36:10.100 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stdout: "message": "", 2024-09-10T22:36:10.100 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stdout: "return_code": 0 2024-09-10T22:36:10.100 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stdout:} 2024-09-10T22:36:10.100 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:10.097+0000 7f8c2fdd3640 1 -- 172.21.15.19:0/3315920169 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f8c140b52e0 msgr2=0x7f8c140b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:36:10.100 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:10.097+0000 7f8c2fdd3640 1 --2- 172.21.15.19:0/3315920169 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f8c140b52e0 0x7f8c140b77a0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f8c28199b20 tx=0x7f8c20009500 comp rx=0 tx=0).stop 2024-09-10T22:36:10.101 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:10.097+0000 7f8c2fdd3640 1 -- 172.21.15.19:0/3315920169 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8c28101870 msgr2=0x7f8c28198da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:36:10.101 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:10.097+0000 7f8c2fdd3640 1 --2- 172.21.15.19:0/3315920169 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8c28101870 0x7f8c28198da0 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 crypto rx=0x7f8c2400d950 tx=0x7f8c2400de10 comp rx=0 tx=0).stop 2024-09-10T22:36:10.101 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:10.097+0000 7f8c2fdd3640 1 -- 172.21.15.19:0/3315920169 shutdown_connections 2024-09-10T22:36:10.101 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:10.097+0000 7f8c2fdd3640 1 --2- 172.21.15.19:0/3315920169 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f8c140b52e0 0x7f8c140b77a0 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:36:10.101 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:10.097+0000 7f8c2fdd3640 1 --2- 172.21.15.19:0/3315920169 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f8c28103380 0x7f8c2819a020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:36:10.101 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:10.097+0000 7f8c2fdd3640 1 --2- 172.21.15.19:0/3315920169 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8c281029c0 0x7f8c281993f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:36:10.101 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:10.097+0000 7f8c2fdd3640 1 --2- 172.21.15.19:0/3315920169 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8c28101870 0x7f8c28198da0 unknown :-1 s=CLOSED pgs=793 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:36:10.101 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:10.097+0000 7f8c2fdd3640 1 -- 172.21.15.19:0/3315920169 >> 172.21.15.19:0/3315920169 conn(0x7f8c280fd130 msgr2=0x7f8c280febb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:36:10.101 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:10.097+0000 7f8c2fdd3640 1 -- 172.21.15.19:0/3315920169 shutdown_connections 2024-09-10T22:36:10.101 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:10.097+0000 7f8c2fdd3640 1 -- 172.21.15.19:0/3315920169 wait complete. 2024-09-10T22:36:10.110 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:36:09 smithi135 ceph-mon[34789]: pgmap v639: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 459 KiB/s rd, 189 MiB/s wr, 785 op/s 2024-09-10T22:36:10.125 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:36:09 smithi138 ceph-mon[35236]: pgmap v639: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 459 KiB/s rd, 189 MiB/s wr, 785 op/s 2024-09-10T22:36:10.208 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:36:09 smithi019 ceph-mon[31375]: pgmap v639: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 459 KiB/s rd, 189 MiB/s wr, 785 op/s 2024-09-10T22:36:12.011 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:36:11 smithi019 ceph-mon[31375]: pgmap v640: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 643 KiB/s rd, 233 MiB/s wr, 762 op/s 2024-09-10T22:36:12.110 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:36:11 smithi135 ceph-mon[34789]: pgmap v640: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 643 KiB/s rd, 233 MiB/s wr, 762 op/s 2024-09-10T22:36:12.125 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:36:11 smithi138 ceph-mon[35236]: pgmap v640: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 643 KiB/s rd, 233 MiB/s wr, 762 op/s 2024-09-10T22:36:13.958 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:36:13 smithi019 ceph-mon[31375]: pgmap v641: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 528 KiB/s rd, 216 MiB/s wr, 563 op/s 2024-09-10T22:36:14.024 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 22997a4c-6fc2-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-10T22:36:14.110 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:36:13 smithi135 ceph-mon[34789]: pgmap v641: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 528 KiB/s rd, 216 MiB/s wr, 563 op/s 2024-09-10T22:36:14.125 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:36:13 smithi138 ceph-mon[35236]: pgmap v641: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 528 KiB/s rd, 216 MiB/s wr, 563 op/s 2024-09-10T22:36:14.383 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/22997a4c-6fc2-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T22:36:14.961 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:14.942+0000 7f4613437640 1 -- 172.21.15.19:0/3313740083 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f460c109170 msgr2=0x7f460c10f970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:36:14.961 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:14.942+0000 7f4613437640 1 --2- 172.21.15.19:0/3313740083 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f460c109170 0x7f460c10f970 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 crypto rx=0x7f4608009900 tx=0x7f460802a410 comp rx=0 tx=0).stop 2024-09-10T22:36:14.961 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:14.943+0000 7f4613437640 1 -- 172.21.15.19:0/3313740083 shutdown_connections 2024-09-10T22:36:14.961 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:14.943+0000 7f4613437640 1 --2- 172.21.15.19:0/3313740083 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f460c109170 0x7f460c10f970 unknown :-1 s=CLOSED pgs=794 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:36:14.961 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:14.943+0000 7f4613437640 1 --2- 172.21.15.19:0/3313740083 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f460c1087f0 0x7f460c108c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:36:14.961 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:14.943+0000 7f4613437640 1 --2- 172.21.15.19:0/3313740083 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f460c102de0 0x7f460c1031c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:36:14.961 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:14.943+0000 7f4613437640 1 -- 172.21.15.19:0/3313740083 >> 172.21.15.19:0/3313740083 conn(0x7f460c0fe830 msgr2=0x7f460c100c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:36:14.961 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:14.943+0000 7f4613437640 1 -- 172.21.15.19:0/3313740083 shutdown_connections 2024-09-10T22:36:14.961 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:14.943+0000 7f4613437640 1 -- 172.21.15.19:0/3313740083 wait complete. 2024-09-10T22:36:14.962 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:14.943+0000 7f4613437640 1 Processor -- start 2024-09-10T22:36:14.962 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:14.943+0000 7f4613437640 1 -- start start 2024-09-10T22:36:14.962 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:14.944+0000 7f4613437640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f460c102de0 0x7f460c199220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:36:14.962 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:14.944+0000 7f4613437640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f460c1087f0 0x7f460c199760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:36:14.962 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:14.944+0000 7f4613437640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f460c109170 0x7f460c19eb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:36:14.962 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:14.944+0000 7f4613437640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f460c112e30 con 0x7f460c1087f0 2024-09-10T22:36:14.962 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:14.944+0000 7f4613437640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f460c112cb0 con 0x7f460c109170 2024-09-10T22:36:14.962 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:14.944+0000 7f4613437640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f460c112fb0 con 0x7f460c102de0 2024-09-10T22:36:14.962 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:14.944+0000 7f46109d2640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f460c1087f0 0x7f460c199760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:36:14.962 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:14.944+0000 7f46109d2640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f460c1087f0 0x7f460c199760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:46708/0 (socket says 172.21.15.19:46708) 2024-09-10T22:36:14.963 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:14.944+0000 7f46109d2640 1 -- 172.21.15.19:0/3286452666 learned_addr learned my addr 172.21.15.19:0/3286452666 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:36:14.963 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:14.944+0000 7f46119d4640 1 --2- 172.21.15.19:0/3286452666 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f460c109170 0x7f460c19eb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:36:14.963 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:14.944+0000 7f46111d3640 1 --2- 172.21.15.19:0/3286452666 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f460c102de0 0x7f460c199220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:36:14.963 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:14.944+0000 7f46119d4640 1 -- 172.21.15.19:0/3286452666 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f460c102de0 msgr2=0x7f460c199220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:36:14.963 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:14.944+0000 7f46119d4640 1 --2- 172.21.15.19:0/3286452666 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f460c102de0 0x7f460c199220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:36:14.963 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:14.944+0000 7f46119d4640 1 -- 172.21.15.19:0/3286452666 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f460c1087f0 msgr2=0x7f460c199760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:36:14.963 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:14.944+0000 7f46119d4640 1 --2- 172.21.15.19:0/3286452666 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f460c1087f0 0x7f460c199760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:36:14.963 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:14.944+0000 7f46119d4640 1 -- 172.21.15.19:0/3286452666 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f460c19f2d0 con 0x7f460c109170 2024-09-10T22:36:14.963 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:14.944+0000 7f46109d2640 1 --2- 172.21.15.19:0/3286452666 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f460c1087f0 0x7f460c199760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T22:36:14.963 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:14.944+0000 7f46111d3640 1 --2- 172.21.15.19:0/3286452666 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f460c102de0 0x7f460c199220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T22:36:14.964 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:14.945+0000 7f46119d4640 1 --2- 172.21.15.19:0/3286452666 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f460c109170 0x7f460c19eb00 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f4608005940 tx=0x7f4608031a10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:36:14.964 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:14.945+0000 7f45fe7fc640 1 -- 172.21.15.19:0/3286452666 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f460803f030 con 0x7f460c109170 2024-09-10T22:36:14.964 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:14.945+0000 7f45fe7fc640 1 -- 172.21.15.19:0/3286452666 <== mon.2 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f46080043d0 con 0x7f460c109170 2024-09-10T22:36:14.964 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:14.945+0000 7f4613437640 1 -- 172.21.15.19:0/3286452666 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f460c19f560 con 0x7f460c109170 2024-09-10T22:36:14.964 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:14.945+0000 7f45fe7fc640 1 -- 172.21.15.19:0/3286452666 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4608035070 con 0x7f460c109170 2024-09-10T22:36:14.964 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:14.945+0000 7f4613437640 1 -- 172.21.15.19:0/3286452666 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f460c075380 con 0x7f460c109170 2024-09-10T22:36:14.964 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:14.949+0000 7f45fe7fc640 1 -- 172.21.15.19:0/3286452666 <== mon.2 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 18) ==== 153250+0+0 (secure 0 0 0) 0x7f4608003c30 con 0x7f460c109170 2024-09-10T22:36:14.964 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:14.949+0000 7f461580c740 1 Processor -- start 2024-09-10T22:36:14.964 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:14.950+0000 7f461580c740 1 -- start start 2024-09-10T22:36:14.964 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:14.950+0000 7f461580c740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55b14a0d3c90 0x55b14a0d4070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:36:14.964 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:14.950+0000 7f461580c740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55b14a0d45b0 0x55b14a0e0000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:36:14.964 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:14.950+0000 7f461580c740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b14a0e0540 0x55b14a0e2930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:36:14.964 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:14.950+0000 7f461580c740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x55b14a041e50 con 0x55b14a0d3c90 2024-09-10T22:36:14.965 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:14.950+0000 7f461580c740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55b14a031280 con 0x55b14a0e0540 2024-09-10T22:36:14.965 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:14.950+0000 7f461580c740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x55b14a035090 con 0x55b14a0d45b0 2024-09-10T22:36:14.965 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:14.950+0000 7f46111d3640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55b14a0d45b0 0x55b14a0e0000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:36:14.965 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:14.950+0000 7f46111d3640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55b14a0d45b0 0x55b14a0e0000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.19:55126/0 (socket says 172.21.15.19:55126) 2024-09-10T22:36:14.965 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:14.950+0000 7f46111d3640 1 -- 172.21.15.19:0/2171747814 learned_addr learned my addr 172.21.15.19:0/2171747814 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:36:14.965 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:14.950+0000 7f46109d2640 1 --2- 172.21.15.19:0/2171747814 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55b14a0d3c90 0x55b14a0d4070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:36:14.965 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:14.951+0000 7f46109d2640 1 --2- 172.21.15.19:0/2171747814 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b14a0e0540 0x55b14a0e2930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:36:14.965 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:14.951+0000 7f46111d3640 1 -- 172.21.15.19:0/2171747814 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b14a0e0540 msgr2=0x55b14a0e2930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:36:14.965 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:14.951+0000 7f46111d3640 1 --2- 172.21.15.19:0/2171747814 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b14a0e0540 0x55b14a0e2930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:36:14.965 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:14.951+0000 7f46111d3640 1 -- 172.21.15.19:0/2171747814 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55b14a0d3c90 msgr2=0x55b14a0d4070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:36:14.965 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:14.951+0000 7f46111d3640 1 --2- 172.21.15.19:0/2171747814 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55b14a0d3c90 0x55b14a0d4070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:36:14.965 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:14.951+0000 7f46111d3640 1 -- 172.21.15.19:0/2171747814 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b149d8f650 con 0x55b14a0d45b0 2024-09-10T22:36:14.965 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:14.951+0000 7f46111d3640 1 --2- 172.21.15.19:0/2171747814 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55b14a0d45b0 0x55b14a0e0000 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f4604005f40 tx=0x7f4604009500 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bb8e9edab286c9e2 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:36:14.966 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:14.952+0000 7f45f77fe640 1 -- 172.21.15.19:0/2171747814 <== mon.1 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f460400cab0 con 0x55b14a0d45b0 2024-09-10T22:36:14.966 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:14.952+0000 7f45f77fe640 1 -- 172.21.15.19:0/2171747814 <== mon.1 v2:172.21.15.138:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f460400ee60 con 0x55b14a0d45b0 2024-09-10T22:36:14.966 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:14.952+0000 7f45f77fe640 1 -- 172.21.15.19:0/2171747814 <== mon.1 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4604010430 con 0x55b14a0d45b0 2024-09-10T22:36:14.966 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:14.952+0000 7f45fe7fc640 1 --2- 172.21.15.19:0/3286452666 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f45f80b52e0 0x7f45f80b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:36:14.966 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:14.952+0000 7f46109d2640 1 --2- 172.21.15.19:0/3286452666 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f45f80b52e0 0x7f45f80b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:36:14.966 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:14.952+0000 7f45fe7fc640 1 -- 172.21.15.19:0/3286452666 <== mon.2 v2:172.21.15.135:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8327+0+0 (secure 0 0 0) 0x7f4608105d50 con 0x7f460c109170 2024-09-10T22:36:14.966 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:14.953+0000 7f46109d2640 1 --2- 172.21.15.19:0/3286452666 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f45f80b52e0 0x7f45f80b77a0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f46000097f0 tx=0x7f4600015040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:36:14.966 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:14.953+0000 7f461580c740 1 -- 172.21.15.19:0/2171747814 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55b14a0d45b0 msgr2=0x55b14a0e0000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:36:14.966 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:14.953+0000 7f461580c740 1 --2- 172.21.15.19:0/2171747814 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55b14a0d45b0 0x55b14a0e0000 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f4604005f40 tx=0x7f4604009500 comp rx=0 tx=0).stop 2024-09-10T22:36:14.966 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:14.953+0000 7f461580c740 1 -- 172.21.15.19:0/2171747814 shutdown_connections 2024-09-10T22:36:14.966 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:14.953+0000 7f461580c740 1 --2- 172.21.15.19:0/2171747814 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b14a0e0540 0x55b14a0e2930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:36:14.967 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:14.953+0000 7f461580c740 1 --2- 172.21.15.19:0/2171747814 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55b14a0d45b0 0x55b14a0e0000 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:36:14.967 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:14.953+0000 7f461580c740 1 --2- 172.21.15.19:0/2171747814 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55b14a0d3c90 0x55b14a0d4070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:36:14.967 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:14.953+0000 7f461580c740 1 -- 172.21.15.19:0/2171747814 >> 172.21.15.19:0/2171747814 conn(0x55b14a0d1ac0 msgr2=0x55b14a0d2c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:36:14.967 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:14.953+0000 7f461580c740 1 -- 172.21.15.19:0/2171747814 shutdown_connections 2024-09-10T22:36:14.967 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:14.953+0000 7f461580c740 1 -- 172.21.15.19:0/2171747814 wait complete. 2024-09-10T22:36:14.967 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:14.954+0000 7f461580c740 1 -- start start 2024-09-10T22:36:14.968 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:14.954+0000 7f461580c740 1 Processor -- start 2024-09-10T22:36:14.968 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:14.954+0000 7f461580c740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55b14a0d3c90 0x55b14a0dfdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:36:14.968 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:14.954+0000 7f461580c740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b14a0d45b0 0x55b14a0dd200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:36:14.968 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:14.955+0000 7f461580c740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55b14a0e0540 0x55b14a0dd780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:36:14.968 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:14.955+0000 7f461580c740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x55b149e92700 con 0x55b14a0e0540 2024-09-10T22:36:14.968 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:14.955+0000 7f461580c740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55b149fcc110 con 0x55b14a0d45b0 2024-09-10T22:36:14.969 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:14.955+0000 7f461580c740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x55b14a0f41d0 con 0x55b14a0d3c90 2024-09-10T22:36:14.969 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:14.955+0000 7f461580c740 10 client.0 _ll_register_callbacks cb 0x55b149fe5990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T22:36:14.969 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:14.955+0000 7f46111d3640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55b14a0d3c90 0x55b14a0dfdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:36:14.969 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:14.955+0000 7f46111d3640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55b14a0d3c90 0x55b14a0dfdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.19:55132/0 (socket says 172.21.15.19:55132) 2024-09-10T22:36:14.969 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:14.955+0000 7f46111d3640 1 -- 172.21.15.19:0/2921131629 learned_addr learned my addr 172.21.15.19:0/2921131629 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:36:14.969 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:14.955+0000 7f46111d3640 1 -- 172.21.15.19:0/2921131629 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b14a0d45b0 msgr2=0x55b14a0dd200 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-10T22:36:14.970 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:14.955+0000 7f46111d3640 1 --2- 172.21.15.19:0/2921131629 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b14a0d45b0 0x55b14a0dd200 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:36:14.970 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:14.955+0000 7f46111d3640 1 -- 172.21.15.19:0/2921131629 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55b14a0e0540 msgr2=0x55b14a0dd780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:36:14.970 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:14.955+0000 7f46111d3640 1 --2- 172.21.15.19:0/2921131629 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55b14a0e0540 0x55b14a0dd780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:36:14.970 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:14.955+0000 7f46111d3640 1 -- 172.21.15.19:0/2921131629 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b149ff9c40 con 0x55b14a0d3c90 2024-09-10T22:36:14.970 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:14.956+0000 7f46111d3640 1 --2- 172.21.15.19:0/2921131629 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55b14a0d3c90 0x55b14a0dfdb0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f4604006010 tx=0x7f4604019f70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c706988167f5b693 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:36:14.970 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:14.956+0000 7f45f4ff9640 10 client.0 ms_handle_connect on v2:172.21.15.138:3300/0 2024-09-10T22:36:14.970 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:14.957+0000 7f45f4ff9640 1 -- 172.21.15.19:0/2921131629 <== mon.1 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4604003b80 con 0x55b14a0d3c90 2024-09-10T22:36:14.970 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:14.957+0000 7f45f4ff9640 1 -- 172.21.15.19:0/2921131629 <== mon.1 v2:172.21.15.138:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8327+0+0 (secure 0 0 0) 0x7f4604003d20 con 0x55b14a0d3c90 2024-09-10T22:36:14.971 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:14.957+0000 7f461580c740 1 -- 172.21.15.19:0/2921131629 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f460400ee60 con 0x55b14a0d3c90 2024-09-10T22:36:14.974 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:14.959+0000 7f45f4ff9640 1 -- 172.21.15.19:0/2921131629 <== mon.1 v2:172.21.15.138:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f460400c8b0 con 0x55b14a0d3c90 2024-09-10T22:36:14.974 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:14.960+0000 7f461580c740 10 client.26635 fetch_fsmap learned FSMap version 27 2024-09-10T22:36:14.974 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:14.960+0000 7f461580c740 1 -- 172.21.15.19:0/2921131629 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55b14a0ffab0 con 0x55b14a0d3c90 2024-09-10T22:36:14.974 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:14.961+0000 7f45f4ff9640 1 -- 172.21.15.19:0/2921131629 <== mon.1 v2:172.21.15.138:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4604029070 con 0x55b14a0d3c90 2024-09-10T22:36:14.974 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:14.962+0000 7f45f4ff9640 1 -- 172.21.15.19:0/2921131629 <== mon.1 v2:172.21.15.138:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7f4604004050 con 0x55b14a0d3c90 2024-09-10T22:36:14.975 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:14.962+0000 7f461580c740 10 client.26635 fetch_fsmap finished waiting for FSMap version 27 2024-09-10T22:36:14.975 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:14.962+0000 7f461580c740 10 client.26635 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-10T22:36:14.975 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:14.962+0000 7f461580c740 20 client.26635 populate_metadata read hostname 'smithi019' 2024-09-10T22:36:14.975 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:14.962+0000 7f461580c740 1 --2- 172.21.15.19:0/2921131629 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x55b14a100e00 0x55b14a1031f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:36:14.975 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:14.963+0000 7f461580c740 4 client.26635 mds_command: new command op to 24581 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T22:36:14.975 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:14.963+0000 7f461580c740 1 -- 172.21.15.19:0/2921131629 --> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f460400ee60 con 0x55b14a100e00 2024-09-10T22:36:14.975 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:14.963+0000 7f46109d2640 1 --2- 172.21.15.19:0/2921131629 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x55b14a100e00 0x55b14a1031f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:36:14.976 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:14.965+0000 7f45f4ff9640 10 client.26635 ms_handle_connect on v2:172.21.15.135:6838/1254769802 2024-09-10T22:36:14.976 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:14.965+0000 7f46109d2640 1 --2- 172.21.15.19:0/2921131629 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x55b14a100e00 0x55b14a1031f0 crc :-1 s=READY pgs=194 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ec6b7024d1751e57 server_cookie=47f88a557ca30da3 in_seq=0 out_seq=0 2024-09-10T22:36:14.976 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:14.966+0000 7f45f4ff9640 1 -- 172.21.15.19:0/2921131629 <== mds.0 v2:172.21.15.135:6838/1254769802 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x7f460400ee60 con 0x55b14a100e00 2024-09-10T22:36:14.976 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:14.966+0000 7f45f4ff9640 10 client.26635 handle_command_reply: tid=0 2024-09-10T22:36:14.976 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:14.966+0000 7f461580c740 1 client.26635 shutdown 2024-09-10T22:36:14.976 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:14.966+0000 7f461580c740 1 -- 172.21.15.19:0/2921131629 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55b14a0d3c90 msgr2=0x55b14a0dfdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:36:14.976 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:14.966+0000 7f461580c740 1 --2- 172.21.15.19:0/2921131629 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55b14a0d3c90 0x55b14a0dfdb0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f4604006010 tx=0x7f4604019f70 comp rx=0 tx=0).stop 2024-09-10T22:36:14.976 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:14.966+0000 7f461580c740 1 -- 172.21.15.19:0/2921131629 shutdown_connections 2024-09-10T22:36:14.976 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:14.966+0000 7f461580c740 1 --2- 172.21.15.19:0/2921131629 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55b14a0e0540 0x55b14a0dd780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:36:14.976 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:14.967+0000 7f461580c740 1 --2- 172.21.15.19:0/2921131629 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b14a0d45b0 0x55b14a0dd200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:36:14.976 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:14.967+0000 7f461580c740 1 --2- 172.21.15.19:0/2921131629 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x55b14a100e00 0x55b14a1031f0 crc :-1 s=READY pgs=194 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:36:14.977 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:14.967+0000 7f45f4ff9640 0 client.26635 ms_handle_reset on v2:172.21.15.135:6838/1254769802 2024-09-10T22:36:14.977 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:14.967+0000 7f461580c740 1 --2- 172.21.15.19:0/2921131629 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55b14a0d3c90 0x55b14a0dfdb0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:36:14.977 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:14.967+0000 7f461580c740 1 -- 172.21.15.19:0/2921131629 >> 172.21.15.19:0/2921131629 conn(0x55b14a0d1ac0 msgr2=0x55b14a0c83d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:36:14.977 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:14.967+0000 7f461580c740 1 -- 172.21.15.19:0/2921131629 shutdown_connections 2024-09-10T22:36:14.977 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:14.967+0000 7f461580c740 1 -- 172.21.15.19:0/2921131629 wait complete. 2024-09-10T22:36:14.977 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:14.967+0000 7f461580c740 20 client.26635 trim_cache size 0 max 16384 2024-09-10T22:36:15.000 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:14.997+0000 7f461580c740 1 Processor -- start 2024-09-10T22:36:15.000 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:14.997+0000 7f461580c740 1 -- start start 2024-09-10T22:36:15.000 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:14.998+0000 7f461580c740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b14a0d3c90 0x55b14a0fd430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:36:15.000 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:14.998+0000 7f461580c740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55b14a0d45b0 0x55b14a0da410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:36:15.002 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:14.998+0000 7f461580c740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55b14a0e0540 0x55b14a0da950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:36:15.002 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:14.999+0000 7f46109d2640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55b14a0d45b0 0x55b14a0da410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:36:15.002 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:14.999+0000 7f46109d2640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55b14a0d45b0 0x55b14a0da410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:46726/0 (socket says 172.21.15.19:46726) 2024-09-10T22:36:15.002 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:14.999+0000 7f46111d3640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b14a0d3c90 0x55b14a0fd430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:36:15.002 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:14.999+0000 7f46111d3640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b14a0d3c90 0x55b14a0fd430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.19:48920/0 (socket says 172.21.15.19:48920) 2024-09-10T22:36:15.002 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:15.000+0000 7f46109d2640 1 -- 172.21.15.19:0/2991420514 learned_addr learned my addr 172.21.15.19:0/2991420514 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:36:15.002 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:15.000+0000 7f461580c740 1 -- 172.21.15.19:0/2991420514 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f460c1a6530 con 0x55b14a0d45b0 2024-09-10T22:36:15.002 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:15.000+0000 7f461580c740 1 -- 172.21.15.19:0/2991420514 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f460c0734f0 con 0x55b14a0d3c90 2024-09-10T22:36:15.002 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:15.000+0000 7f46119d4640 1 --2- 172.21.15.19:0/2991420514 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55b14a0e0540 0x55b14a0da950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:36:15.003 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:15.000+0000 7f461580c740 1 -- 172.21.15.19:0/2991420514 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f460c071340 con 0x55b14a0e0540 2024-09-10T22:36:15.004 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:15.001+0000 7f46109d2640 1 -- 172.21.15.19:0/2991420514 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55b14a0e0540 msgr2=0x55b14a0da950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:36:15.004 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:15.001+0000 7f46109d2640 1 --2- 172.21.15.19:0/2991420514 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55b14a0e0540 0x55b14a0da950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:36:15.004 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:15.001+0000 7f46109d2640 1 -- 172.21.15.19:0/2991420514 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b14a0d3c90 msgr2=0x55b14a0fd430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:36:15.004 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:15.001+0000 7f46109d2640 1 --2- 172.21.15.19:0/2991420514 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b14a0d3c90 0x55b14a0fd430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:36:15.004 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:15.001+0000 7f46109d2640 1 -- 172.21.15.19:0/2991420514 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b14a0d43e0 con 0x55b14a0d45b0 2024-09-10T22:36:15.005 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:15.002+0000 7f46109d2640 1 --2- 172.21.15.19:0/2991420514 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55b14a0d45b0 0x55b14a0da410 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x7f4600009fd0 tx=0x7f4600004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac36fbd9eac818db server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:36:15.005 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:15.003+0000 7f45f6ffd640 1 -- 172.21.15.19:0/2991420514 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f460002e070 con 0x55b14a0d45b0 2024-09-10T22:36:15.005 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:15.003+0000 7f45f6ffd640 1 -- 172.21.15.19:0/2991420514 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4600010d50 con 0x55b14a0d45b0 2024-09-10T22:36:15.005 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:15.003+0000 7f45f6ffd640 1 -- 172.21.15.19:0/2991420514 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4600022410 con 0x55b14a0d45b0 2024-09-10T22:36:15.007 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:15.004+0000 7f461580c740 1 -- 172.21.15.19:0/2991420514 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55b14a0d45b0 msgr2=0x55b14a0da410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:36:15.007 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:15.004+0000 7f461580c740 1 --2- 172.21.15.19:0/2991420514 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55b14a0d45b0 0x55b14a0da410 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x7f4600009fd0 tx=0x7f4600004730 comp rx=0 tx=0).stop 2024-09-10T22:36:15.007 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:15.005+0000 7f461580c740 1 -- 172.21.15.19:0/2991420514 shutdown_connections 2024-09-10T22:36:15.007 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:15.005+0000 7f461580c740 1 --2- 172.21.15.19:0/2991420514 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55b14a0e0540 0x55b14a0da950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:36:15.007 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:15.005+0000 7f461580c740 1 --2- 172.21.15.19:0/2991420514 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55b14a0d45b0 0x55b14a0da410 unknown :-1 s=CLOSED pgs=795 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:36:15.007 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:15.005+0000 7f461580c740 1 --2- 172.21.15.19:0/2991420514 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b14a0d3c90 0x55b14a0fd430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:36:15.007 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:15.005+0000 7f461580c740 1 -- 172.21.15.19:0/2991420514 >> 172.21.15.19:0/2991420514 conn(0x55b14a0d1ac0 msgr2=0x55b14a0d8450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:36:15.008 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:15.006+0000 7f461580c740 1 -- 172.21.15.19:0/2991420514 shutdown_connections 2024-09-10T22:36:15.008 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:15.006+0000 7f461580c740 1 -- 172.21.15.19:0/2991420514 wait complete. 2024-09-10T22:36:15.009 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:15.007+0000 7f461580c740 1 -- start start 2024-09-10T22:36:15.009 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:15.007+0000 7f461580c740 1 Processor -- start 2024-09-10T22:36:15.011 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:15.008+0000 7f461580c740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55b14a0d3c90 0x55b14a0f5750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:36:15.011 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:15.008+0000 7f461580c740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b14a0d45b0 0x55b14a0f5c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:36:15.011 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:15.008+0000 7f461580c740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55b14a0e0540 0x55b14a16cba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:36:15.011 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:15.008+0000 7f46119d4640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55b14a0e0540 0x55b14a16cba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:36:15.011 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:15.008+0000 7f46119d4640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55b14a0e0540 0x55b14a16cba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:46728/0 (socket says 172.21.15.19:46728) 2024-09-10T22:36:15.011 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:15.008+0000 7f46119d4640 1 -- 172.21.15.19:0/503666611 learned_addr learned my addr 172.21.15.19:0/503666611 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:36:15.011 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:15.009+0000 7f461580c740 1 -- 172.21.15.19:0/503666611 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f460c0719b0 con 0x55b14a0e0540 2024-09-10T22:36:15.011 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:15.009+0000 7f461580c740 1 -- 172.21.15.19:0/503666611 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f460c072e20 con 0x55b14a0d45b0 2024-09-10T22:36:15.012 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:15.009+0000 7f461580c740 1 -- 172.21.15.19:0/503666611 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f460c072080 con 0x55b14a0d3c90 2024-09-10T22:36:15.012 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:15.009+0000 7f46111d3640 1 --2- 172.21.15.19:0/503666611 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55b14a0d3c90 0x55b14a0f5750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:36:15.012 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:15.009+0000 7f46109d2640 1 --2- 172.21.15.19:0/503666611 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b14a0d45b0 0x55b14a0f5c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:36:15.012 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:15.009+0000 7f461580c740 10 client.0 _ll_register_callbacks cb 0x7f4600009c30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T22:36:15.012 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:15.009+0000 7f46119d4640 1 -- 172.21.15.19:0/503666611 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55b14a0d3c90 msgr2=0x55b14a0f5750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:36:15.012 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:15.009+0000 7f46119d4640 1 --2- 172.21.15.19:0/503666611 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55b14a0d3c90 0x55b14a0f5750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:36:15.013 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:15.009+0000 7f46119d4640 1 -- 172.21.15.19:0/503666611 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b14a0d45b0 msgr2=0x55b14a0f5c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:36:15.013 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:15.009+0000 7f46119d4640 1 --2- 172.21.15.19:0/503666611 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b14a0d45b0 0x55b14a0f5c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:36:15.013 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:15.009+0000 7f46119d4640 1 -- 172.21.15.19:0/503666611 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b14a0e0120 con 0x55b14a0e0540 2024-09-10T22:36:15.013 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:15.010+0000 7f46119d4640 1 --2- 172.21.15.19:0/503666611 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55b14a0e0540 0x55b14a16cba0 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7f4608103b60 tx=0x7f46080cbcd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d9e9f503b62abfe server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:36:15.013 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:15.010+0000 7f45f4ff9640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-10T22:36:15.013 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:15.010+0000 7f45f4ff9640 1 -- 172.21.15.19:0/503666611 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4608049070 con 0x55b14a0e0540 2024-09-10T22:36:15.013 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:15.010+0000 7f45f4ff9640 1 -- 172.21.15.19:0/503666611 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8327+0+0 (secure 0 0 0) 0x7f46080cc9c0 con 0x55b14a0e0540 2024-09-10T22:36:15.014 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:15.010+0000 7f461580c740 1 -- 172.21.15.19:0/503666611 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4600010d50 con 0x55b14a0e0540 2024-09-10T22:36:15.014 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:15.011+0000 7f45f4ff9640 1 -- 172.21.15.19:0/503666611 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f46080d0f90 con 0x55b14a0e0540 2024-09-10T22:36:15.014 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:15.011+0000 7f461580c740 10 client.17286 fetch_fsmap learned FSMap version 27 2024-09-10T22:36:15.014 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:15.011+0000 7f461580c740 1 -- 172.21.15.19:0/503666611 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55b14a16e0a0 con 0x55b14a0e0540 2024-09-10T22:36:15.014 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:15.011+0000 7f45f4ff9640 1 -- 172.21.15.19:0/503666611 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4600010d50 con 0x55b14a0e0540 2024-09-10T22:36:15.014 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:15.012+0000 7f45f4ff9640 1 -- 172.21.15.19:0/503666611 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7f46080f3220 con 0x55b14a0e0540 2024-09-10T22:36:15.015 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:15.012+0000 7f461580c740 10 client.17286 fetch_fsmap finished waiting for FSMap version 27 2024-09-10T22:36:15.015 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:15.012+0000 7f461580c740 10 client.17286 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-10T22:36:15.015 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:15.012+0000 7f461580c740 20 client.17286 populate_metadata read hostname 'smithi019' 2024-09-10T22:36:15.015 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:15.012+0000 7f461580c740 1 --2- 172.21.15.19:0/503666611 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x55b14a100e00 0x55b14a170810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:36:15.015 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:15.012+0000 7f461580c740 4 client.17286 mds_command: new command op to 24581 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-10T22:36:15.015 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:15.012+0000 7f461580c740 1 -- 172.21.15.19:0/503666611 --> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55b14a043da0 con 0x55b14a100e00 2024-09-10T22:36:15.015 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:15.013+0000 7f46111d3640 1 --2- 172.21.15.19:0/503666611 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x55b14a100e00 0x55b14a170810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:36:15.018 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:15.015+0000 7f46111d3640 1 --2- 172.21.15.19:0/503666611 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x55b14a100e00 0x55b14a170810 crc :-1 s=READY pgs=195 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8a98ab2cafbb9a12 server_cookie=4c54f16b88192078 in_seq=0 out_seq=0 2024-09-10T22:36:15.018 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:15.015+0000 7f45f4ff9640 10 client.17286 ms_handle_connect on v2:172.21.15.135:6838/1254769802 2024-09-10T22:36:15.018 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:15.016+0000 7f45f4ff9640 1 -- 172.21.15.19:0/503666611 <== mds.0 v2:172.21.15.135:6838/1254769802 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3782 (crc 0 0 0) 0x55b14a043da0 con 0x55b14a100e00 2024-09-10T22:36:15.018 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:15.016+0000 7f45f4ff9640 10 client.17286 handle_command_reply: tid=0 2024-09-10T22:36:15.018 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:15.016+0000 7f461580c740 1 client.17286 shutdown 2024-09-10T22:36:15.018 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:15.016+0000 7f461580c740 1 -- 172.21.15.19:0/503666611 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55b14a0e0540 msgr2=0x55b14a16cba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:36:15.018 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:15.016+0000 7f461580c740 1 --2- 172.21.15.19:0/503666611 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55b14a0e0540 0x55b14a16cba0 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7f4608103b60 tx=0x7f46080cbcd0 comp rx=0 tx=0).stop 2024-09-10T22:36:15.018 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:15.016+0000 7f461580c740 1 -- 172.21.15.19:0/503666611 shutdown_connections 2024-09-10T22:36:15.018 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:15.016+0000 7f461580c740 1 --2- 172.21.15.19:0/503666611 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55b14a0e0540 0x55b14a16cba0 unknown :-1 s=CLOSED pgs=796 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:36:15.018 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:15.016+0000 7f461580c740 1 --2- 172.21.15.19:0/503666611 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b14a0d45b0 0x55b14a0f5c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:36:15.019 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:15.016+0000 7f461580c740 1 --2- 172.21.15.19:0/503666611 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x55b14a100e00 0x55b14a170810 crc :-1 s=READY pgs=195 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:36:15.019 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:15.016+0000 7f461580c740 1 --2- 172.21.15.19:0/503666611 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55b14a0d3c90 0x55b14a0f5750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:36:15.019 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:15.016+0000 7f461580c740 1 -- 172.21.15.19:0/503666611 >> 172.21.15.19:0/503666611 conn(0x55b14a0d1ac0 msgr2=0x55b14a0de830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:36:15.019 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:15.016+0000 7f45f4ff9640 0 client.17286 ms_handle_reset on v2:172.21.15.135:6838/1254769802 2024-09-10T22:36:15.020 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:15.017+0000 7f461580c740 1 -- 172.21.15.19:0/503666611 shutdown_connections 2024-09-10T22:36:15.020 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:15.017+0000 7f461580c740 1 -- 172.21.15.19:0/503666611 wait complete. 2024-09-10T22:36:15.020 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:15.017+0000 7f461580c740 20 client.17286 trim_cache size 0 max 16384 2024-09-10T22:36:15.020 INFO:teuthology.orchestra.run.smithi019.stdout:{ 2024-09-10T22:36:15.020 INFO:teuthology.orchestra.run.smithi019.stdout: "status": "no active scrubs running", 2024-09-10T22:36:15.021 INFO:teuthology.orchestra.run.smithi019.stdout: "scrubs": {}, 2024-09-10T22:36:15.021 INFO:teuthology.orchestra.run.smithi019.stdout: "scrub_stats": { 2024-09-10T22:36:15.021 INFO:teuthology.orchestra.run.smithi019.stdout: "1a6e9f60-01cc-4339-aff0-9ef63cbda443": { 2024-09-10T22:36:15.021 INFO:teuthology.orchestra.run.smithi019.stdout: "start_time": "2024-09-10T22:35:40.561000+0000", 2024-09-10T22:36:15.021 INFO:teuthology.orchestra.run.smithi019.stdout: "path": "/", 2024-09-10T22:36:15.021 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_started": 0, 2024-09-10T22:36:15.021 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_passed": 0, 2024-09-10T22:36:15.021 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_failed": 0, 2024-09-10T22:36:15.021 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_skipped": 0 2024-09-10T22:36:15.021 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:36:15.022 INFO:teuthology.orchestra.run.smithi019.stdout: "a77606c2-7618-413e-8aba-f9783ecbf435": { 2024-09-10T22:36:15.022 INFO:teuthology.orchestra.run.smithi019.stdout: "start_time": "2024-09-10T22:34:54.453894+0000", 2024-09-10T22:36:15.022 INFO:teuthology.orchestra.run.smithi019.stdout: "path": "/", 2024-09-10T22:36:15.022 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_started": 0, 2024-09-10T22:36:15.022 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_passed": 0, 2024-09-10T22:36:15.022 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_failed": 0, 2024-09-10T22:36:15.022 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_skipped": 0 2024-09-10T22:36:15.022 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:36:15.022 INFO:teuthology.orchestra.run.smithi019.stdout: "0b81ea61-0b8e-4f2c-a58f-ef1019289fc9": { 2024-09-10T22:36:15.022 INFO:teuthology.orchestra.run.smithi019.stdout: "start_time": "2024-09-10T22:31:48.141568+0000", 2024-09-10T22:36:15.022 INFO:teuthology.orchestra.run.smithi019.stdout: "path": "/", 2024-09-10T22:36:15.023 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_started": 0, 2024-09-10T22:36:15.023 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_passed": 0, 2024-09-10T22:36:15.023 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_failed": 0, 2024-09-10T22:36:15.023 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_skipped": 0 2024-09-10T22:36:15.023 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:36:15.023 INFO:teuthology.orchestra.run.smithi019.stdout: "715ec863-8a9d-45b6-967f-59b15ce1bf12": { 2024-09-10T22:36:15.023 INFO:teuthology.orchestra.run.smithi019.stdout: "start_time": "2024-09-10T22:31:00.669516+0000", 2024-09-10T22:36:15.023 INFO:teuthology.orchestra.run.smithi019.stdout: "path": "/", 2024-09-10T22:36:15.023 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_started": 0, 2024-09-10T22:36:15.023 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_passed": 0, 2024-09-10T22:36:15.023 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_failed": 0, 2024-09-10T22:36:15.023 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_skipped": 0 2024-09-10T22:36:15.023 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:36:15.024 INFO:teuthology.orchestra.run.smithi019.stdout: "fd1f1837-dcfa-4d88-99e8-2509f36c3f98": { 2024-09-10T22:36:15.024 INFO:teuthology.orchestra.run.smithi019.stdout: "start_time": "2024-09-10T22:30:12.470477+0000", 2024-09-10T22:36:15.024 INFO:teuthology.orchestra.run.smithi019.stdout: "path": "/", 2024-09-10T22:36:15.024 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_started": 0, 2024-09-10T22:36:15.024 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_passed": 0, 2024-09-10T22:36:15.024 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_failed": 0, 2024-09-10T22:36:15.024 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_skipped": 0 2024-09-10T22:36:15.024 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:36:15.024 INFO:teuthology.orchestra.run.smithi019.stdout: "8f3bb3bf-911f-490c-9856-c80ea220dbbe": { 2024-09-10T22:36:15.024 INFO:teuthology.orchestra.run.smithi019.stdout: "start_time": "2024-09-10T22:29:25.374415+0000", 2024-09-10T22:36:15.024 INFO:teuthology.orchestra.run.smithi019.stdout: "path": "/", 2024-09-10T22:36:15.024 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_started": 0, 2024-09-10T22:36:15.024 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_passed": 0, 2024-09-10T22:36:15.025 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_failed": 0, 2024-09-10T22:36:15.025 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_skipped": 0 2024-09-10T22:36:15.025 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:36:15.025 INFO:teuthology.orchestra.run.smithi019.stdout: "eb518e3c-a71e-4f32-9ca0-ae88930ca218": { 2024-09-10T22:36:15.025 INFO:teuthology.orchestra.run.smithi019.stdout: "start_time": "2024-09-10T22:28:38.366352+0000", 2024-09-10T22:36:15.025 INFO:teuthology.orchestra.run.smithi019.stdout: "path": "/", 2024-09-10T22:36:15.025 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_started": 0, 2024-09-10T22:36:15.025 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_passed": 0, 2024-09-10T22:36:15.025 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_failed": 0, 2024-09-10T22:36:15.025 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_skipped": 0 2024-09-10T22:36:15.025 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:36:15.025 INFO:teuthology.orchestra.run.smithi019.stdout: "9efe684b-7583-402e-a46e-e262a37e1af5": { 2024-09-10T22:36:15.025 INFO:teuthology.orchestra.run.smithi019.stdout: "start_time": "2024-09-10T22:34:09.479768+0000", 2024-09-10T22:36:15.026 INFO:teuthology.orchestra.run.smithi019.stdout: "path": "/", 2024-09-10T22:36:15.026 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_started": 0, 2024-09-10T22:36:15.026 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_passed": 0, 2024-09-10T22:36:15.026 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_failed": 0, 2024-09-10T22:36:15.026 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_skipped": 0 2024-09-10T22:36:15.026 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:36:15.026 INFO:teuthology.orchestra.run.smithi019.stdout: "4c99964e-2e0e-4ffd-8cb8-99c4979ed90f": { 2024-09-10T22:36:15.026 INFO:teuthology.orchestra.run.smithi019.stdout: "start_time": "2024-09-10T22:32:34.659639+0000", 2024-09-10T22:36:15.026 INFO:teuthology.orchestra.run.smithi019.stdout: "path": "/", 2024-09-10T22:36:15.026 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_started": 0, 2024-09-10T22:36:15.026 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_passed": 0, 2024-09-10T22:36:15.026 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_failed": 0, 2024-09-10T22:36:15.026 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_skipped": 0 2024-09-10T22:36:15.027 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:36:15.027 INFO:teuthology.orchestra.run.smithi019.stdout: "c12c2a04-dcd6-4673-a98e-93f665d3f5d7": { 2024-09-10T22:36:15.027 INFO:teuthology.orchestra.run.smithi019.stdout: "start_time": "2024-09-10T22:27:49.392329+0000", 2024-09-10T22:36:15.027 INFO:teuthology.orchestra.run.smithi019.stdout: "path": "/", 2024-09-10T22:36:15.027 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_started": 0, 2024-09-10T22:36:15.027 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_passed": 0, 2024-09-10T22:36:15.027 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_failed": 0, 2024-09-10T22:36:15.027 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_skipped": 0 2024-09-10T22:36:15.027 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:36:15.027 INFO:teuthology.orchestra.run.smithi019.stdout: "b38852c8-478a-42ef-8384-b2c55d5313a4": { 2024-09-10T22:36:15.027 INFO:teuthology.orchestra.run.smithi019.stdout: "start_time": "2024-09-10T22:27:00.320308+0000", 2024-09-10T22:36:15.027 INFO:teuthology.orchestra.run.smithi019.stdout: "path": "/", 2024-09-10T22:36:15.027 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_started": 0, 2024-09-10T22:36:15.028 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_passed": 0, 2024-09-10T22:36:15.028 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_failed": 0, 2024-09-10T22:36:15.028 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_skipped": 0 2024-09-10T22:36:15.028 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:36:15.028 INFO:teuthology.orchestra.run.smithi019.stdout: "448b10e7-494c-4a88-a9ab-186159c5dfdd": { 2024-09-10T22:36:15.028 INFO:teuthology.orchestra.run.smithi019.stdout: "start_time": "2024-09-10T22:33:21.208716+0000", 2024-09-10T22:36:15.028 INFO:teuthology.orchestra.run.smithi019.stdout: "path": "/", 2024-09-10T22:36:15.028 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_started": 0, 2024-09-10T22:36:15.028 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_passed": 0, 2024-09-10T22:36:15.028 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_failed": 0, 2024-09-10T22:36:15.028 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_skipped": 0 2024-09-10T22:36:15.029 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:36:15.029 INFO:teuthology.orchestra.run.smithi019.stdout: "9b6bfdee-303c-4c12-af56-dc85860d112a": { 2024-09-10T22:36:15.029 INFO:teuthology.orchestra.run.smithi019.stdout: "start_time": "2024-09-10T22:26:17.484162+0000", 2024-09-10T22:36:15.029 INFO:teuthology.orchestra.run.smithi019.stdout: "path": "/", 2024-09-10T22:36:15.029 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_started": 0, 2024-09-10T22:36:15.029 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_passed": 0, 2024-09-10T22:36:15.029 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_failed": 0, 2024-09-10T22:36:15.029 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_skipped": 0 2024-09-10T22:36:15.029 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-10T22:36:15.029 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-10T22:36:15.029 INFO:teuthology.orchestra.run.smithi019.stdout:} 2024-09-10T22:36:15.030 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:15.018+0000 7f4613437640 1 -- 172.21.15.19:0/3286452666 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f45f80b52e0 msgr2=0x7f45f80b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:36:15.030 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:15.018+0000 7f4613437640 1 --2- 172.21.15.19:0/3286452666 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f45f80b52e0 0x7f45f80b77a0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f46000097f0 tx=0x7f4600015040 comp rx=0 tx=0).stop 2024-09-10T22:36:15.030 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:15.018+0000 7f4613437640 1 -- 172.21.15.19:0/3286452666 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f460c109170 msgr2=0x7f460c19eb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:36:15.030 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:15.018+0000 7f4613437640 1 --2- 172.21.15.19:0/3286452666 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f460c109170 0x7f460c19eb00 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f4608005940 tx=0x7f4608031a10 comp rx=0 tx=0).stop 2024-09-10T22:36:15.030 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:15.018+0000 7f4613437640 1 -- 172.21.15.19:0/3286452666 shutdown_connections 2024-09-10T22:36:15.030 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:15.018+0000 7f4613437640 1 --2- 172.21.15.19:0/3286452666 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f45f80b52e0 0x7f45f80b77a0 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:36:15.030 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:15.018+0000 7f4613437640 1 --2- 172.21.15.19:0/3286452666 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f460c109170 0x7f460c19eb00 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:36:15.030 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:15.018+0000 7f4613437640 1 --2- 172.21.15.19:0/3286452666 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f460c1087f0 0x7f460c199760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:36:15.031 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:15.018+0000 7f4613437640 1 --2- 172.21.15.19:0/3286452666 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f460c102de0 0x7f460c199220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:36:15.031 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:15.018+0000 7f4613437640 1 -- 172.21.15.19:0/3286452666 >> 172.21.15.19:0/3286452666 conn(0x7f460c0fe830 msgr2=0x7f460c100c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:36:15.031 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:15.018+0000 7f4613437640 1 -- 172.21.15.19:0/3286452666 shutdown_connections 2024-09-10T22:36:15.031 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:15.018+0000 7f4613437640 1 -- 172.21.15.19:0/3286452666 wait complete. 2024-09-10T22:36:15.958 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:36:15 smithi019 ceph-mon[31375]: pgmap v642: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 642 KiB/s rd, 229 MiB/s wr, 464 op/s 2024-09-10T22:36:16.006 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-10T22:36:16.006 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 22997a4c-6fc2-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-10T22:36:16.110 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:36:15 smithi135 ceph-mon[34789]: pgmap v642: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 642 KiB/s rd, 229 MiB/s wr, 464 op/s 2024-09-10T22:36:16.125 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:36:15 smithi138 ceph-mon[35236]: pgmap v642: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 642 KiB/s rd, 229 MiB/s wr, 464 op/s 2024-09-10T22:36:16.357 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/22997a4c-6fc2-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T22:36:17.079 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:17.035+0000 7f22c9663640 1 -- 172.21.15.19:0/1784307003 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f22c410d140 msgr2=0x7f22c410f5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:36:17.079 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:17.035+0000 7f22c9663640 1 --2- 172.21.15.19:0/1784307003 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f22c410d140 0x7f22c410f5a0 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x7f22bc009ca0 tx=0x7f22bc02a8c0 comp rx=0 tx=0).stop 2024-09-10T22:36:17.079 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:17.035+0000 7f22c9663640 1 -- 172.21.15.19:0/1784307003 shutdown_connections 2024-09-10T22:36:17.079 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:17.035+0000 7f22c9663640 1 --2- 172.21.15.19:0/1784307003 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f22c410d140 0x7f22c410f5a0 unknown :-1 s=CLOSED pgs=797 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:36:17.079 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:17.035+0000 7f22c9663640 1 --2- 172.21.15.19:0/1784307003 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f22c4104600 0x7f22c410caf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:36:17.079 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:17.035+0000 7f22c9663640 1 --2- 172.21.15.19:0/1784307003 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f22c4103ce0 0x7f22c41040c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:36:17.079 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:17.035+0000 7f22c9663640 1 -- 172.21.15.19:0/1784307003 >> 172.21.15.19:0/1784307003 conn(0x7f22c40fd700 msgr2=0x7f22c40ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:36:17.079 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:17.036+0000 7f22c9663640 1 -- 172.21.15.19:0/1784307003 shutdown_connections 2024-09-10T22:36:17.080 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:17.036+0000 7f22c9663640 1 -- 172.21.15.19:0/1784307003 wait complete. 2024-09-10T22:36:17.080 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:17.036+0000 7f22c9663640 1 Processor -- start 2024-09-10T22:36:17.080 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:17.036+0000 7f22c9663640 1 -- start start 2024-09-10T22:36:17.080 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:17.036+0000 7f22c9663640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f22c4103ce0 0x7f22c419b460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:36:17.080 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:17.036+0000 7f22c9663640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f22c4104600 0x7f22c419b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:36:17.080 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:17.036+0000 7f22c9663640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f22c410d140 0x7f22c41a0d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:36:17.080 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:17.036+0000 7f22c9663640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f22c4112db0 con 0x7f22c4103ce0 2024-09-10T22:36:17.080 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:17.036+0000 7f22c9663640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f22c4112c30 con 0x7f22c410d140 2024-09-10T22:36:17.080 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:17.036+0000 7f22c9663640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f22c4112f30 con 0x7f22c4104600 2024-09-10T22:36:17.080 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:17.037+0000 7f22c2ffd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f22c4103ce0 0x7f22c419b460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:36:17.080 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:17.037+0000 7f22c37fe640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f22c410d140 0x7f22c41a0d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:36:17.080 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:17.037+0000 7f22c2ffd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f22c4103ce0 0x7f22c419b460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:46760/0 (socket says 172.21.15.19:46760) 2024-09-10T22:36:17.081 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:17.037+0000 7f22bbfff640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f22c4104600 0x7f22c419b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:36:17.081 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:17.037+0000 7f22c2ffd640 1 -- 172.21.15.19:0/3474548366 learned_addr learned my addr 172.21.15.19:0/3474548366 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:36:17.081 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:17.037+0000 7f22c37fe640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f22c410d140 0x7f22c41a0d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.19:48950/0 (socket says 172.21.15.19:48950) 2024-09-10T22:36:17.081 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:17.037+0000 7f22bbfff640 1 -- 172.21.15.19:0/3474548366 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f22c410d140 msgr2=0x7f22c41a0d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:36:17.081 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:17.037+0000 7f22bbfff640 1 --2- 172.21.15.19:0/3474548366 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f22c410d140 0x7f22c41a0d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:36:17.081 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:17.037+0000 7f22bbfff640 1 -- 172.21.15.19:0/3474548366 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f22c4103ce0 msgr2=0x7f22c419b460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:36:17.081 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:17.037+0000 7f22bbfff640 1 --2- 172.21.15.19:0/3474548366 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f22c4103ce0 0x7f22c419b460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:36:17.081 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:17.037+0000 7f22bbfff640 1 -- 172.21.15.19:0/3474548366 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f22c41a1510 con 0x7f22c4104600 2024-09-10T22:36:17.081 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:17.037+0000 7f22c2ffd640 1 --2- 172.21.15.19:0/3474548366 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f22c4103ce0 0x7f22c419b460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T22:36:17.081 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:17.037+0000 7f22bbfff640 1 --2- 172.21.15.19:0/3474548366 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f22c4104600 0x7f22c419b9a0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f22ac00e770 tx=0x7f22ac00ec30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:36:17.081 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:17.037+0000 7f22c0ff9640 1 -- 172.21.15.19:0/3474548366 <== mon.1 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22ac00ccc0 con 0x7f22c4104600 2024-09-10T22:36:17.081 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:17.037+0000 7f22c9663640 1 -- 172.21.15.19:0/3474548366 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f22c41a1800 con 0x7f22c4104600 2024-09-10T22:36:17.081 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:17.037+0000 7f22c0ff9640 1 -- 172.21.15.19:0/3474548366 <== mon.1 v2:172.21.15.138:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f22ac00ee80 con 0x7f22c4104600 2024-09-10T22:36:17.082 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:17.038+0000 7f22c0ff9640 1 -- 172.21.15.19:0/3474548366 <== mon.1 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22ac003e40 con 0x7f22c4104600 2024-09-10T22:36:17.082 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:17.038+0000 7f22c9663640 1 -- 172.21.15.19:0/3474548366 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f22c41a7ec0 con 0x7f22c4104600 2024-09-10T22:36:17.082 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:17.038+0000 7f22c9663640 1 -- 172.21.15.19:0/3474548366 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f22c41040c0 con 0x7f22c4104600 2024-09-10T22:36:17.082 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:17.040+0000 7f22c0ff9640 1 -- 172.21.15.19:0/3474548366 <== mon.1 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 18) ==== 153250+0+0 (secure 0 0 0) 0x7f22ac004000 con 0x7f22c4104600 2024-09-10T22:36:17.082 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:17.041+0000 7f22c0ff9640 1 --2- 172.21.15.19:0/3474548366 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f22b00b52e0 0x7f22b00b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:36:17.082 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:17.041+0000 7f22c2ffd640 1 --2- 172.21.15.19:0/3474548366 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f22b00b52e0 0x7f22b00b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:36:17.082 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:17.041+0000 7f22c0ff9640 1 -- 172.21.15.19:0/3474548366 <== mon.1 v2:172.21.15.138:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8327+0+0 (secure 0 0 0) 0x7f22ac0e5ec0 con 0x7f22c4104600 2024-09-10T22:36:17.082 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:17.041+0000 7f22c2ffd640 1 --2- 172.21.15.19:0/3474548366 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f22b00b52e0 0x7f22b00b77a0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f22b4011500 tx=0x7f22b4005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:36:17.082 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:17.044+0000 7f22c0ff9640 1 -- 172.21.15.19:0/3474548366 <== mon.1 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f22ac0accc0 con 0x7f22c4104600 2024-09-10T22:36:17.284 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:17.282+0000 7f22c9663640 1 -- 172.21.15.19:0/3474548366 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f22c41a8280 con 0x7f22c4104600 2024-09-10T22:36:17.284 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:17.283+0000 7f22c0ff9640 1 -- 172.21.15.19:0/3474548366 <== mon.1 v2:172.21.15.138:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) ==== 94+0+11921 (secure 0 0 0) 0x7f22ac0ac5c0 con 0x7f22c4104600 2024-09-10T22:36:17.285 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-10T22:36:17.285 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":27,"btime":"2024-09-10T22:29:37:724724+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14673,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6835/1835804747","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6834","nonce":1835804747},{"type":"v1","addr":"172.21.15.19:6835","nonce":1835804747}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14685,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6837/1750470490","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6836","nonce":1750470490},{"type":"v1","addr":"172.21.15.19:6837","nonce":1750470490}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14733,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6839/2642941149","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6838","nonce":2642941149},{"type":"v1","addr":"172.21.15.19:6839","nonce":2642941149}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14745,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6841/2449948682","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6840","nonce":2449948682},{"type":"v1","addr":"172.21.15.19:6841","nonce":2449948682}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24511,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.138:6833/2524811494","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6832","nonce":2524811494},{"type":"v1","addr":"172.21.15.138:6833","nonce":2524811494}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24512,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6833/3014993624","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6832","nonce":3014993624},{"type":"v1","addr":"172.21.15.135:6833","nonce":3014993624}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":27,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-10T22:24:22.733925+0000","modified":"2024-09-10T22:29:37.430699+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24581,"mds_1":24568,"mds_2":24553},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24527":{"gid":24527,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.135:6835/3715773348","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6834","nonce":3715773348},{"type":"v1","addr":"172.21.15.135:6835","nonce":3715773348}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24541":{"gid":24541,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.138:6835/933547028","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6834","nonce":933547028},{"type":"v1","addr":"172.21.15.138:6835","nonce":933547028}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24551":{"gid":24551,"name":"h","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.135:6837/3495029135","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6836","nonce":3495029135},{"type":"v1","addr":"172.21.15.135:6837","nonce":3495029135}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24553":{"gid":24553,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":10,"addr":"172.21.15.138:6837/3353290042","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6836","nonce":3353290042},{"type":"v1","addr":"172.21.15.138:6837","nonce":3353290042}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24568":{"gid":24568,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.138:6839/383637208","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6838","nonce":383637208},{"type":"v1","addr":"172.21.15.138:6839","nonce":383637208}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24581":{"gid":24581,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.135:6839/1254769802","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6838","nonce":1254769802},{"type":"v1","addr":"172.21.15.135:6839","nonce":1254769802}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24581,"qdb_cluster":[24581,24568,24553]},"id":1}]} 2024-09-10T22:36:17.285 INFO:teuthology.orchestra.run.smithi019.stderr:dumped fsmap epoch 27 2024-09-10T22:36:17.287 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:17.285+0000 7f22c9663640 1 -- 172.21.15.19:0/3474548366 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f22b00b52e0 msgr2=0x7f22b00b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:36:17.287 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:17.285+0000 7f22c9663640 1 --2- 172.21.15.19:0/3474548366 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f22b00b52e0 0x7f22b00b77a0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f22b4011500 tx=0x7f22b4005f90 comp rx=0 tx=0).stop 2024-09-10T22:36:17.287 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:17.285+0000 7f22c9663640 1 -- 172.21.15.19:0/3474548366 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f22c4104600 msgr2=0x7f22c419b9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:36:17.287 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:17.285+0000 7f22c9663640 1 --2- 172.21.15.19:0/3474548366 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f22c4104600 0x7f22c419b9a0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f22ac00e770 tx=0x7f22ac00ec30 comp rx=0 tx=0).stop 2024-09-10T22:36:17.287 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:17.285+0000 7f22c9663640 1 -- 172.21.15.19:0/3474548366 shutdown_connections 2024-09-10T22:36:17.287 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:17.285+0000 7f22c9663640 1 --2- 172.21.15.19:0/3474548366 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f22b00b52e0 0x7f22b00b77a0 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:36:17.287 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:17.285+0000 7f22c9663640 1 --2- 172.21.15.19:0/3474548366 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f22c410d140 0x7f22c41a0d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:36:17.287 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:17.285+0000 7f22c9663640 1 --2- 172.21.15.19:0/3474548366 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f22c4104600 0x7f22c419b9a0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:36:17.287 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:17.285+0000 7f22c9663640 1 --2- 172.21.15.19:0/3474548366 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f22c4103ce0 0x7f22c419b460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:36:17.287 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:17.285+0000 7f22c9663640 1 -- 172.21.15.19:0/3474548366 >> 172.21.15.19:0/3474548366 conn(0x7f22c40fd700 msgr2=0x7f22c410f390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:36:17.287 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:17.285+0000 7f22c9663640 1 -- 172.21.15.19:0/3474548366 shutdown_connections 2024-09-10T22:36:17.287 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:17.285+0000 7f22c9663640 1 -- 172.21.15.19:0/3474548366 wait complete. 2024-09-10T22:36:17.999 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 22997a4c-6fc2-11ef-bcea-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-09-10T22:36:18.022 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:36:17 smithi019 ceph-mon[31375]: pgmap v643: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 692 KiB/s rd, 268 MiB/s wr, 359 op/s 2024-09-10T22:36:18.022 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:36:17 smithi019 ceph-mon[31375]: from='client.? 172.21.15.19:0/3474548366' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T22:36:18.110 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:36:17 smithi135 ceph-mon[34789]: pgmap v643: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 692 KiB/s rd, 268 MiB/s wr, 359 op/s 2024-09-10T22:36:18.110 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:36:17 smithi135 ceph-mon[34789]: from='client.? 172.21.15.19:0/3474548366' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T22:36:18.125 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:36:17 smithi138 ceph-mon[35236]: pgmap v643: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 692 KiB/s rd, 268 MiB/s wr, 359 op/s 2024-09-10T22:36:18.125 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:36:17 smithi138 ceph-mon[35236]: from='client.? 172.21.15.19:0/3474548366' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T22:36:18.351 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/22997a4c-6fc2-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T22:36:19.107 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:18.945+0000 7f035c622640 1 -- 172.21.15.19:0/2021247424 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0354108020 msgr2=0x7f035410e820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:36:19.107 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:18.945+0000 7f035c622640 1 --2- 172.21.15.19:0/2021247424 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0354108020 0x7f035410e820 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x7f034c009ca0 tx=0x7f034c02a8c0 comp rx=0 tx=0).stop 2024-09-10T22:36:19.107 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:18.945+0000 7f035c622640 1 -- 172.21.15.19:0/2021247424 shutdown_connections 2024-09-10T22:36:19.107 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:18.945+0000 7f035c622640 1 --2- 172.21.15.19:0/2021247424 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0354108020 0x7f035410e820 unknown :-1 s=CLOSED pgs=798 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:36:19.107 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:18.945+0000 7f035c622640 1 --2- 172.21.15.19:0/2021247424 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f03541076a0 0x7f0354107ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:36:19.107 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:18.945+0000 7f035c622640 1 --2- 172.21.15.19:0/2021247424 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0354101c90 0x7f0354102070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:36:19.107 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:18.945+0000 7f035c622640 1 -- 172.21.15.19:0/2021247424 >> 172.21.15.19:0/2021247424 conn(0x7f03540fd700 msgr2=0x7f03540ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:36:19.107 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:18.945+0000 7f035c622640 1 -- 172.21.15.19:0/2021247424 shutdown_connections 2024-09-10T22:36:19.107 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:18.945+0000 7f035c622640 1 -- 172.21.15.19:0/2021247424 wait complete. 2024-09-10T22:36:19.107 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:18.946+0000 7f035c622640 1 Processor -- start 2024-09-10T22:36:19.107 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:18.946+0000 7f035c622640 1 -- start start 2024-09-10T22:36:19.108 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:18.946+0000 7f035c622640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0354101c90 0x7f0354199250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:36:19.108 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:18.946+0000 7f035c622640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f03541076a0 0x7f0354199790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:36:19.108 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:18.946+0000 7f035c622640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f0354108020 0x7f035419eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:36:19.108 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:18.946+0000 7f035c622640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f0354111ca0 con 0x7f03541076a0 2024-09-10T22:36:19.108 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:18.946+0000 7f035c622640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f0354111b20 con 0x7f0354101c90 2024-09-10T22:36:19.108 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:18.946+0000 7f035c622640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f0354111e20 con 0x7f0354108020 2024-09-10T22:36:19.108 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:18.946+0000 7f0359bbd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f03541076a0 0x7f0354199790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:36:19.108 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:18.946+0000 7f0359bbd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f03541076a0 0x7f0354199790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:46782/0 (socket says 172.21.15.19:46782) 2024-09-10T22:36:19.108 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:18.946+0000 7f0359bbd640 1 -- 172.21.15.19:0/3823777112 learned_addr learned my addr 172.21.15.19:0/3823777112 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:36:19.108 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:18.946+0000 7f035abbf640 1 --2- 172.21.15.19:0/3823777112 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f0354108020 0x7f035419eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:36:19.108 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:18.946+0000 7f035a3be640 1 --2- 172.21.15.19:0/3823777112 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0354101c90 0x7f0354199250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:36:19.108 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:18.947+0000 7f0359bbd640 1 -- 172.21.15.19:0/3823777112 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f0354108020 msgr2=0x7f035419eb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:36:19.109 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:18.947+0000 7f0359bbd640 1 --2- 172.21.15.19:0/3823777112 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f0354108020 0x7f035419eb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:36:19.109 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:18.947+0000 7f0359bbd640 1 -- 172.21.15.19:0/3823777112 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0354101c90 msgr2=0x7f0354199250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:36:19.109 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:18.947+0000 7f0359bbd640 1 --2- 172.21.15.19:0/3823777112 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0354101c90 0x7f0354199250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:36:19.109 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:18.947+0000 7f0359bbd640 1 -- 172.21.15.19:0/3823777112 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f035419f300 con 0x7f03541076a0 2024-09-10T22:36:19.109 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:18.947+0000 7f035abbf640 1 --2- 172.21.15.19:0/3823777112 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f0354108020 0x7f035419eb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T22:36:19.109 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:18.947+0000 7f0359bbd640 1 --2- 172.21.15.19:0/3823777112 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f03541076a0 0x7f0354199790 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x7f034400e9f0 tx=0x7f034400edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:36:19.109 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:18.947+0000 7f034b7fe640 1 -- 172.21.15.19:0/3823777112 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f034400cd80 con 0x7f03541076a0 2024-09-10T22:36:19.109 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:18.947+0000 7f035c622640 1 -- 172.21.15.19:0/3823777112 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f035419f5f0 con 0x7f03541076a0 2024-09-10T22:36:19.109 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:18.947+0000 7f034b7fe640 1 -- 172.21.15.19:0/3823777112 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f03440054d0 con 0x7f03541076a0 2024-09-10T22:36:19.110 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:18.947+0000 7f034b7fe640 1 -- 172.21.15.19:0/3823777112 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0344010690 con 0x7f03541076a0 2024-09-10T22:36:19.110 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:18.947+0000 7f035c622640 1 -- 172.21.15.19:0/3823777112 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f03541a5cb0 con 0x7f03541076a0 2024-09-10T22:36:19.110 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:18.950+0000 7f035e9f7740 1 Processor -- start 2024-09-10T22:36:19.110 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:18.950+0000 7f035e9f7740 1 -- start start 2024-09-10T22:36:19.110 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:18.950+0000 7f035e9f7740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x556f4b42d0f0 0x556f4b42d4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:36:19.110 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:18.950+0000 7f035e9f7740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x556f4b42da10 0x556f4b439460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:36:19.110 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:18.950+0000 7f035e9f7740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556f4b4399a0 0x556f4b43bd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:36:19.110 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:18.950+0000 7f034b7fe640 1 -- 172.21.15.19:0/3823777112 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 18) ==== 153250+0+0 (secure 0 0 0) 0x7f0344004e90 con 0x7f03541076a0 2024-09-10T22:36:19.110 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:18.951+0000 7f035e9f7740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x556f4b3a3ea0 con 0x556f4b42da10 2024-09-10T22:36:19.111 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:18.951+0000 7f035e9f7740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x556f4b3932d0 con 0x556f4b4399a0 2024-09-10T22:36:19.111 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:18.951+0000 7f035e9f7740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x556f4b3970e0 con 0x556f4b42d0f0 2024-09-10T22:36:19.111 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:18.951+0000 7f035abbf640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x556f4b42d0f0 0x556f4b42d4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:36:19.111 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:18.951+0000 7f035a3be640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x556f4b42da10 0x556f4b439460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:36:19.111 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:18.951+0000 7f035abbf640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x556f4b42d0f0 0x556f4b42d4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.19:55206/0 (socket says 172.21.15.19:55206) 2024-09-10T22:36:19.111 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:18.951+0000 7f035abbf640 1 -- 172.21.15.19:0/2473516381 learned_addr learned my addr 172.21.15.19:0/2473516381 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:36:19.111 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:18.951+0000 7f0359bbd640 1 --2- 172.21.15.19:0/2473516381 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556f4b4399a0 0x556f4b43bd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:36:19.111 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:18.951+0000 7f035a3be640 1 -- 172.21.15.19:0/2473516381 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x556f4b42d0f0 msgr2=0x556f4b42d4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:36:19.111 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:18.951+0000 7f035a3be640 1 --2- 172.21.15.19:0/2473516381 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x556f4b42d0f0 0x556f4b42d4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:36:19.111 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:18.951+0000 7f035a3be640 1 -- 172.21.15.19:0/2473516381 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556f4b4399a0 msgr2=0x556f4b43bd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:36:19.111 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:18.951+0000 7f035a3be640 1 --2- 172.21.15.19:0/2473516381 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556f4b4399a0 0x556f4b43bd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:36:19.111 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:18.951+0000 7f035a3be640 1 -- 172.21.15.19:0/2473516381 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556f4b0f1650 con 0x556f4b42da10 2024-09-10T22:36:19.111 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:18.951+0000 7f035a3be640 1 --2- 172.21.15.19:0/2473516381 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x556f4b42da10 0x556f4b439460 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x7f0350009c20 tx=0x7f0350011810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4f4694f588a20761 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:36:19.112 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:18.951+0000 7f0348ff9640 1 -- 172.21.15.19:0/2473516381 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f035001e070 con 0x556f4b42da10 2024-09-10T22:36:19.112 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:18.952+0000 7f0348ff9640 1 -- 172.21.15.19:0/2473516381 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0350009dd0 con 0x556f4b42da10 2024-09-10T22:36:19.112 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:18.952+0000 7f0348ff9640 1 -- 172.21.15.19:0/2473516381 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0350018710 con 0x556f4b42da10 2024-09-10T22:36:19.112 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:18.952+0000 7f034b7fe640 1 --2- 172.21.15.19:0/3823777112 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f03400b52e0 0x7f03400b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:36:19.112 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:18.952+0000 7f035abbf640 1 --2- 172.21.15.19:0/3823777112 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f03400b52e0 0x7f03400b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:36:19.112 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:18.952+0000 7f034b7fe640 1 -- 172.21.15.19:0/3823777112 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8327+0+0 (secure 0 0 0) 0x7f03440e6040 con 0x7f03541076a0 2024-09-10T22:36:19.112 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:18.952+0000 7f035e9f7740 1 -- 172.21.15.19:0/2473516381 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x556f4b42da10 msgr2=0x556f4b439460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:36:19.112 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:18.952+0000 7f035e9f7740 1 --2- 172.21.15.19:0/2473516381 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x556f4b42da10 0x556f4b439460 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x7f0350009c20 tx=0x7f0350011810 comp rx=0 tx=0).stop 2024-09-10T22:36:19.112 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:18.952+0000 7f035abbf640 1 --2- 172.21.15.19:0/3823777112 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f03400b52e0 0x7f03400b77a0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f034c005fe0 tx=0x7f034c005ef0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:36:19.112 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:18.953+0000 7f035e9f7740 1 -- 172.21.15.19:0/2473516381 shutdown_connections 2024-09-10T22:36:19.112 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:18.953+0000 7f035e9f7740 1 --2- 172.21.15.19:0/2473516381 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556f4b4399a0 0x556f4b43bd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:36:19.113 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:18.953+0000 7f035e9f7740 1 --2- 172.21.15.19:0/2473516381 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x556f4b42da10 0x556f4b439460 unknown :-1 s=CLOSED pgs=800 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:36:19.113 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:18.953+0000 7f035e9f7740 1 --2- 172.21.15.19:0/2473516381 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x556f4b42d0f0 0x556f4b42d4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:36:19.113 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:18.953+0000 7f035e9f7740 1 -- 172.21.15.19:0/2473516381 >> 172.21.15.19:0/2473516381 conn(0x556f4b42af20 msgr2=0x556f4b42c0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:36:19.113 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:18.953+0000 7f035e9f7740 1 -- 172.21.15.19:0/2473516381 shutdown_connections 2024-09-10T22:36:19.113 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:18.953+0000 7f035e9f7740 1 -- 172.21.15.19:0/2473516381 wait complete. 2024-09-10T22:36:19.113 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:18.953+0000 7f035e9f7740 1 -- start start 2024-09-10T22:36:19.113 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:18.953+0000 7f035e9f7740 1 Processor -- start 2024-09-10T22:36:19.113 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:18.953+0000 7f035e9f7740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556f4b42d0f0 0x556f4b439220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:36:19.113 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:18.954+0000 7f035e9f7740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x556f4b42da10 0x556f4b436670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:36:19.113 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:18.954+0000 7f035e9f7740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x556f4b4399a0 0x556f4b436c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:36:19.113 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:18.954+0000 7f035e9f7740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x556f4b1f4700 con 0x556f4b42da10 2024-09-10T22:36:19.114 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:18.954+0000 7f035e9f7740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x556f4b32e160 con 0x556f4b42d0f0 2024-09-10T22:36:19.114 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:18.954+0000 7f035e9f7740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x556f4b43c620 con 0x556f4b4399a0 2024-09-10T22:36:19.114 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:18.954+0000 7f035e9f7740 10 client.0 _ll_register_callbacks cb 0x556f4b3479e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T22:36:19.114 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:18.954+0000 7f0359bbd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x556f4b42da10 0x556f4b436670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:36:19.114 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:18.954+0000 7f0359bbd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x556f4b42da10 0x556f4b436670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:46788/0 (socket says 172.21.15.19:46788) 2024-09-10T22:36:19.114 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:18.954+0000 7f0359bbd640 1 -- 172.21.15.19:0/3096076688 learned_addr learned my addr 172.21.15.19:0/3096076688 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:36:19.114 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:18.954+0000 7f035a3be640 1 --2- 172.21.15.19:0/3096076688 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556f4b42d0f0 0x556f4b439220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:36:19.114 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:18.954+0000 7f035abbf640 1 --2- 172.21.15.19:0/3096076688 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x556f4b4399a0 0x556f4b436c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:36:19.114 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:18.954+0000 7f0359bbd640 1 -- 172.21.15.19:0/3096076688 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x556f4b4399a0 msgr2=0x556f4b436c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:36:19.114 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:18.954+0000 7f0359bbd640 1 --2- 172.21.15.19:0/3096076688 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x556f4b4399a0 0x556f4b436c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:36:19.114 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:18.954+0000 7f0359bbd640 1 -- 172.21.15.19:0/3096076688 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556f4b42d0f0 msgr2=0x556f4b439220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:36:19.114 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:18.954+0000 7f0359bbd640 1 --2- 172.21.15.19:0/3096076688 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556f4b42d0f0 0x556f4b439220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:36:19.115 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:18.954+0000 7f0359bbd640 1 -- 172.21.15.19:0/3096076688 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556f4b35bc90 con 0x556f4b42da10 2024-09-10T22:36:19.115 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:18.954+0000 7f0359bbd640 1 --2- 172.21.15.19:0/3096076688 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x556f4b42da10 0x556f4b436670 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 crypto rx=0x7f034400c6a0 tx=0x7f03440e9710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9e0e60a18b9d4280 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:36:19.115 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:18.954+0000 7f033dffb640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-10T22:36:19.115 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:18.954+0000 7f033dffb640 1 -- 172.21.15.19:0/3096076688 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03440ac570 con 0x556f4b42da10 2024-09-10T22:36:19.115 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:18.954+0000 7f033dffb640 1 -- 172.21.15.19:0/3096076688 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8327+0+0 (secure 0 0 0) 0x7f03440e8110 con 0x556f4b42da10 2024-09-10T22:36:19.115 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:18.954+0000 7f035e9f7740 1 -- 172.21.15.19:0/3096076688 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0350009dd0 con 0x556f4b42da10 2024-09-10T22:36:19.115 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:18.955+0000 7f033dffb640 1 -- 172.21.15.19:0/3096076688 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f03440abf10 con 0x556f4b42da10 2024-09-10T22:36:19.115 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:18.955+0000 7f035e9f7740 10 client.17304 fetch_fsmap learned FSMap version 27 2024-09-10T22:36:19.115 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:18.955+0000 7f035e9f7740 1 -- 172.21.15.19:0/3096076688 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x556f4b447f20 con 0x556f4b42da10 2024-09-10T22:36:19.115 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:18.955+0000 7f033dffb640 1 -- 172.21.15.19:0/3096076688 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0350009dd0 con 0x556f4b42da10 2024-09-10T22:36:19.115 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:18.955+0000 7f033dffb640 1 -- 172.21.15.19:0/3096076688 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7f03440b58a0 con 0x556f4b42da10 2024-09-10T22:36:19.115 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:18.955+0000 7f035e9f7740 10 client.17304 fetch_fsmap finished waiting for FSMap version 27 2024-09-10T22:36:19.115 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:18.955+0000 7f035e9f7740 10 client.17304 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-10T22:36:19.116 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:18.955+0000 7f035e9f7740 20 client.17304 populate_metadata read hostname 'smithi019' 2024-09-10T22:36:19.116 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:18.955+0000 7f035e9f7740 1 --2- 172.21.15.19:0/3096076688 >> [v2:172.21.15.138:6836/3353290042,v1:172.21.15.138:6837/3353290042] conn(0x556f4b4497a0 0x556f4b44bb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:36:19.116 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:18.955+0000 7f035e9f7740 4 client.17304 mds_command: new command op to 24553 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T22:36:19.116 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:18.955+0000 7f035e9f7740 1 -- 172.21.15.19:0/3096076688 --> [v2:172.21.15.138:6836/3353290042,v1:172.21.15.138:6837/3353290042] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x556f4b3a5df0 con 0x556f4b4497a0 2024-09-10T22:36:19.116 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:18.955+0000 7f035a3be640 1 --2- 172.21.15.19:0/3096076688 >> [v2:172.21.15.138:6836/3353290042,v1:172.21.15.138:6837/3353290042] conn(0x556f4b4497a0 0x556f4b44bb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:36:19.116 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:18.956+0000 7f033dffb640 10 client.17304 ms_handle_connect on v2:172.21.15.138:6836/3353290042 2024-09-10T22:36:19.116 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:18.956+0000 7f035a3be640 1 --2- 172.21.15.19:0/3096076688 >> [v2:172.21.15.138:6836/3353290042,v1:172.21.15.138:6837/3353290042] conn(0x556f4b4497a0 0x556f4b44bb90 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=ab27d3bbdadf2519 server_cookie=fd5369596909165b in_seq=0 out_seq=0 2024-09-10T22:36:19.116 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:18.956+0000 7f033dffb640 1 -- 172.21.15.19:0/3096076688 <== mds.2 v2:172.21.15.138:6836/3353290042 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x556f4b3a5df0 con 0x556f4b4497a0 2024-09-10T22:36:19.116 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:18.956+0000 7f033dffb640 10 client.17304 handle_command_reply: tid=0 2024-09-10T22:36:19.116 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:18.956+0000 7f035e9f7740 1 client.17304 shutdown 2024-09-10T22:36:19.116 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:18.957+0000 7f035e9f7740 1 -- 172.21.15.19:0/3096076688 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x556f4b42da10 msgr2=0x556f4b436670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:36:19.117 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:18.957+0000 7f035e9f7740 1 --2- 172.21.15.19:0/3096076688 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x556f4b42da10 0x556f4b436670 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 crypto rx=0x7f034400c6a0 tx=0x7f03440e9710 comp rx=0 tx=0).stop 2024-09-10T22:36:19.117 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:18.957+0000 7f035e9f7740 1 -- 172.21.15.19:0/3096076688 shutdown_connections 2024-09-10T22:36:19.117 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:18.957+0000 7f035e9f7740 1 --2- 172.21.15.19:0/3096076688 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x556f4b4399a0 0x556f4b436c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:36:19.117 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:18.957+0000 7f035e9f7740 1 --2- 172.21.15.19:0/3096076688 >> [v2:172.21.15.138:6836/3353290042,v1:172.21.15.138:6837/3353290042] conn(0x556f4b4497a0 0x556f4b44bb90 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:36:19.117 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:18.957+0000 7f035e9f7740 1 --2- 172.21.15.19:0/3096076688 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x556f4b42da10 0x556f4b436670 unknown :-1 s=CLOSED pgs=801 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:36:19.117 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:18.957+0000 7f035e9f7740 1 --2- 172.21.15.19:0/3096076688 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556f4b42d0f0 0x556f4b439220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:36:19.117 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:18.957+0000 7f033dffb640 0 client.17304 ms_handle_reset on v2:172.21.15.138:6836/3353290042 2024-09-10T22:36:19.117 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:18.957+0000 7f035e9f7740 1 -- 172.21.15.19:0/3096076688 >> 172.21.15.19:0/3096076688 conn(0x556f4b42af20 msgr2=0x556f4b430ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:36:19.117 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:18.957+0000 7f035e9f7740 1 -- 172.21.15.19:0/3096076688 shutdown_connections 2024-09-10T22:36:19.117 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:18.957+0000 7f035e9f7740 1 -- 172.21.15.19:0/3096076688 wait complete. 2024-09-10T22:36:19.117 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:18.957+0000 7f035e9f7740 20 client.17304 trim_cache size 0 max 16384 2024-09-10T22:36:19.117 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:18.971+0000 7f035e9f7740 1 Processor -- start 2024-09-10T22:36:19.117 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:18.971+0000 7f035e9f7740 1 -- start start 2024-09-10T22:36:19.118 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:18.971+0000 7f035e9f7740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556f4b42d0f0 0x556f4b434ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:36:19.118 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:18.971+0000 7f035e9f7740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x556f4b42da10 0x556f4b435430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:36:19.118 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:18.971+0000 7f035e9f7740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x556f4b4399a0 0x556f4b43ad90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:36:19.118 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:18.971+0000 7f035e9f7740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f03541aebe0 con 0x556f4b42da10 2024-09-10T22:36:19.118 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:18.971+0000 7f035e9f7740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f03541ac4b0 con 0x556f4b42d0f0 2024-09-10T22:36:19.118 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:18.971+0000 7f035e9f7740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f03541aa300 con 0x556f4b4399a0 2024-09-10T22:36:19.118 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:18.972+0000 7f035a3be640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556f4b42d0f0 0x556f4b434ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:36:19.118 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:18.972+0000 7f0359bbd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x556f4b42da10 0x556f4b435430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:36:19.118 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:18.972+0000 7f035a3be640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556f4b42d0f0 0x556f4b434ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.19:49002/0 (socket says 172.21.15.19:49002) 2024-09-10T22:36:19.119 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:18.972+0000 7f035a3be640 1 -- 172.21.15.19:0/2335461720 learned_addr learned my addr 172.21.15.19:0/2335461720 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:36:19.119 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:18.972+0000 7f035abbf640 1 --2- 172.21.15.19:0/2335461720 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x556f4b4399a0 0x556f4b43ad90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:36:19.119 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:18.972+0000 7f035a3be640 1 -- 172.21.15.19:0/2335461720 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x556f4b4399a0 msgr2=0x556f4b43ad90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:36:19.119 INFO:teuthology.orchestra.run.smithi019.stdout:[] 2024-09-10T22:36:19.119 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:18.972+0000 7f035a3be640 1 --2- 172.21.15.19:0/2335461720 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x556f4b4399a0 0x556f4b43ad90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:36:19.120 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:18.972+0000 7f035a3be640 1 -- 172.21.15.19:0/2335461720 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x556f4b42da10 msgr2=0x556f4b435430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:36:19.120 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:18.972+0000 7f035a3be640 1 --2- 172.21.15.19:0/2335461720 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x556f4b42da10 0x556f4b435430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:36:19.120 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:18.972+0000 7f035a3be640 1 -- 172.21.15.19:0/2335461720 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556f4b42bc00 con 0x556f4b42d0f0 2024-09-10T22:36:19.120 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:18.972+0000 7f0359bbd640 1 --2- 172.21.15.19:0/2335461720 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x556f4b42da10 0x556f4b435430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T22:36:19.120 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:18.972+0000 7f035a3be640 1 --2- 172.21.15.19:0/2335461720 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556f4b42d0f0 0x556f4b434ef0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f0350000c00 tx=0x7f0350005d30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8638fdb87651160e server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:36:19.120 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:18.972+0000 7f033ffff640 1 -- 172.21.15.19:0/2335461720 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0350032070 con 0x556f4b42d0f0 2024-09-10T22:36:19.121 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:18.972+0000 7f033ffff640 1 -- 172.21.15.19:0/2335461720 <== mon.2 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0350009430 con 0x556f4b42d0f0 2024-09-10T22:36:19.121 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:18.972+0000 7f033ffff640 1 -- 172.21.15.19:0/2335461720 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f035001e040 con 0x556f4b42d0f0 2024-09-10T22:36:19.121 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:18.973+0000 7f035e9f7740 1 -- 172.21.15.19:0/2335461720 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556f4b42d0f0 msgr2=0x556f4b434ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:36:19.121 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:18.973+0000 7f035e9f7740 1 --2- 172.21.15.19:0/2335461720 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556f4b42d0f0 0x556f4b434ef0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f0350000c00 tx=0x7f0350005d30 comp rx=0 tx=0).stop 2024-09-10T22:36:19.121 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:18.973+0000 7f035e9f7740 1 -- 172.21.15.19:0/2335461720 shutdown_connections 2024-09-10T22:36:19.121 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:18.973+0000 7f035e9f7740 1 --2- 172.21.15.19:0/2335461720 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x556f4b4399a0 0x556f4b43ad90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:36:19.121 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:18.973+0000 7f035e9f7740 1 --2- 172.21.15.19:0/2335461720 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x556f4b42da10 0x556f4b435430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:36:19.121 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:18.973+0000 7f035e9f7740 1 --2- 172.21.15.19:0/2335461720 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556f4b42d0f0 0x556f4b434ef0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:36:19.121 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:18.973+0000 7f035e9f7740 1 -- 172.21.15.19:0/2335461720 >> 172.21.15.19:0/2335461720 conn(0x556f4b42af20 msgr2=0x556f4b431950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:36:19.121 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:18.973+0000 7f035e9f7740 1 -- 172.21.15.19:0/2335461720 shutdown_connections 2024-09-10T22:36:19.121 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:18.973+0000 7f035e9f7740 1 -- 172.21.15.19:0/2335461720 wait complete. 2024-09-10T22:36:19.121 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:18.974+0000 7f035e9f7740 1 -- start start 2024-09-10T22:36:19.122 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:18.974+0000 7f035e9f7740 1 Processor -- start 2024-09-10T22:36:19.122 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:18.974+0000 7f035e9f7740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556f4b42d0f0 0x556f4b4af6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:36:19.122 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:18.974+0000 7f035e9f7740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x556f4b42da10 0x556f4b4afc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:36:19.122 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:18.974+0000 7f035e9f7740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x556f4b4399a0 0x556f4b44b4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:36:19.122 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:18.974+0000 7f035e9f7740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f03541aa970 con 0x556f4b42da10 2024-09-10T22:36:19.122 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:18.974+0000 7f035e9f7740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f03541abde0 con 0x556f4b42d0f0 2024-09-10T22:36:19.122 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:18.974+0000 7f035e9f7740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f03541ab040 con 0x556f4b4399a0 2024-09-10T22:36:19.122 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:18.974+0000 7f035e9f7740 10 client.0 _ll_register_callbacks cb 0x7f034400e940 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T22:36:19.122 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:18.974+0000 7f0359bbd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x556f4b42da10 0x556f4b4afc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:36:19.122 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:18.974+0000 7f035a3be640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556f4b42d0f0 0x556f4b4af6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:36:19.122 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:18.974+0000 7f035a3be640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556f4b42d0f0 0x556f4b4af6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.19:49014/0 (socket says 172.21.15.19:49014) 2024-09-10T22:36:19.122 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:18.974+0000 7f0359bbd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x556f4b42da10 0x556f4b4afc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:46800/0 (socket says 172.21.15.19:46800) 2024-09-10T22:36:19.122 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:18.974+0000 7f035a3be640 1 -- 172.21.15.19:0/3113141875 learned_addr learned my addr 172.21.15.19:0/3113141875 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:36:19.122 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:18.974+0000 7f035abbf640 1 --2- 172.21.15.19:0/3113141875 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x556f4b4399a0 0x556f4b44b4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:36:19.123 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:18.974+0000 7f0359bbd640 1 -- 172.21.15.19:0/3113141875 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x556f4b4399a0 msgr2=0x556f4b44b4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:36:19.123 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:18.975+0000 7f0359bbd640 1 --2- 172.21.15.19:0/3113141875 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x556f4b4399a0 0x556f4b44b4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:36:19.123 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:18.975+0000 7f0359bbd640 1 -- 172.21.15.19:0/3113141875 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556f4b42d0f0 msgr2=0x556f4b4af6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:36:19.123 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:18.975+0000 7f0359bbd640 1 --2- 172.21.15.19:0/3113141875 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556f4b42d0f0 0x556f4b4af6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:36:19.123 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:18.975+0000 7f0359bbd640 1 -- 172.21.15.19:0/3113141875 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556f4b44bcc0 con 0x556f4b42da10 2024-09-10T22:36:19.123 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:18.975+0000 7f0359bbd640 1 --2- 172.21.15.19:0/3113141875 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x556f4b42da10 0x556f4b4afc70 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7f03440b11f0 tx=0x7f03440e9600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2f82067d44e991d server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:36:19.123 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:18.975+0000 7f033dffb640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-10T22:36:19.123 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:18.975+0000 7f033dffb640 1 -- 172.21.15.19:0/3113141875 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03440ac0f0 con 0x556f4b42da10 2024-09-10T22:36:19.123 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:18.975+0000 7f033dffb640 1 -- 172.21.15.19:0/3113141875 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8327+0+0 (secure 0 0 0) 0x7f03440aba00 con 0x556f4b42da10 2024-09-10T22:36:19.124 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:18.975+0000 7f035e9f7740 1 -- 172.21.15.19:0/3113141875 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0350009430 con 0x556f4b42da10 2024-09-10T22:36:19.124 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:18.975+0000 7f033dffb640 1 -- 172.21.15.19:0/3113141875 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f03440ac570 con 0x556f4b42da10 2024-09-10T22:36:19.124 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:18.975+0000 7f035e9f7740 10 client.17310 fetch_fsmap learned FSMap version 27 2024-09-10T22:36:19.124 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:18.975+0000 7f035e9f7740 1 -- 172.21.15.19:0/3113141875 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x556f4b4b7000 con 0x556f4b42da10 2024-09-10T22:36:19.124 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:18.975+0000 7f033dffb640 1 -- 172.21.15.19:0/3113141875 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0350009430 con 0x556f4b42da10 2024-09-10T22:36:19.124 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:18.976+0000 7f033dffb640 1 -- 172.21.15.19:0/3113141875 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7f03440a80f0 con 0x556f4b42da10 2024-09-10T22:36:19.124 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:18.976+0000 7f035e9f7740 10 client.17310 fetch_fsmap finished waiting for FSMap version 27 2024-09-10T22:36:19.124 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:18.976+0000 7f035e9f7740 10 client.17310 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-10T22:36:19.125 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:18.976+0000 7f035e9f7740 20 client.17310 populate_metadata read hostname 'smithi019' 2024-09-10T22:36:19.125 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:18.976+0000 7f035e9f7740 1 --2- 172.21.15.19:0/3113141875 >> [v2:172.21.15.138:6836/3353290042,v1:172.21.15.138:6837/3353290042] conn(0x556f4b4b7720 0x556f4b4b9b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:36:19.125 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:18.976+0000 7f035e9f7740 4 client.17310 mds_command: new command op to 24553 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-10T22:36:19.125 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:18.976+0000 7f035e9f7740 1 -- 172.21.15.19:0/3113141875 --> [v2:172.21.15.138:6836/3353290042,v1:172.21.15.138:6837/3353290042] -- command(tid 0: {"prefix": "damage ls"}) -- 0x556f4b3a18a0 con 0x556f4b4b7720 2024-09-10T22:36:19.125 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:18.976+0000 7f035a3be640 1 --2- 172.21.15.19:0/3113141875 >> [v2:172.21.15.138:6836/3353290042,v1:172.21.15.138:6837/3353290042] conn(0x556f4b4b7720 0x556f4b4b9b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:36:19.125 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:18.976+0000 7f035a3be640 1 --2- 172.21.15.19:0/3113141875 >> [v2:172.21.15.138:6836/3353290042,v1:172.21.15.138:6837/3353290042] conn(0x556f4b4b7720 0x556f4b4b9b40 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=c463fa71ee11d33e server_cookie=38d337e482a8d323 in_seq=0 out_seq=0 2024-09-10T22:36:19.125 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:18.976+0000 7f033dffb640 10 client.17310 ms_handle_connect on v2:172.21.15.138:6836/3353290042 2024-09-10T22:36:19.125 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:18.977+0000 7f033dffb640 1 -- 172.21.15.19:0/3113141875 <== mds.2 v2:172.21.15.138:6836/3353290042 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x556f4b3a18a0 con 0x556f4b4b7720 2024-09-10T22:36:19.125 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:18.977+0000 7f033dffb640 10 client.17310 handle_command_reply: tid=0 2024-09-10T22:36:19.125 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:18.977+0000 7f035e9f7740 1 client.17310 shutdown 2024-09-10T22:36:19.125 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:18.977+0000 7f035e9f7740 1 -- 172.21.15.19:0/3113141875 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x556f4b42da10 msgr2=0x556f4b4afc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:36:19.125 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:18.977+0000 7f035e9f7740 1 --2- 172.21.15.19:0/3113141875 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x556f4b42da10 0x556f4b4afc70 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7f03440b11f0 tx=0x7f03440e9600 comp rx=0 tx=0).stop 2024-09-10T22:36:19.125 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:18.977+0000 7f035e9f7740 1 -- 172.21.15.19:0/3113141875 shutdown_connections 2024-09-10T22:36:19.126 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:18.977+0000 7f035e9f7740 1 --2- 172.21.15.19:0/3113141875 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x556f4b4399a0 0x556f4b44b4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:36:19.126 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:18.977+0000 7f035e9f7740 1 --2- 172.21.15.19:0/3113141875 >> [v2:172.21.15.138:6836/3353290042,v1:172.21.15.138:6837/3353290042] conn(0x556f4b4b7720 0x556f4b4b9b40 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:36:19.126 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:18.977+0000 7f035e9f7740 1 --2- 172.21.15.19:0/3113141875 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x556f4b42da10 0x556f4b4afc70 unknown :-1 s=CLOSED pgs=802 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:36:19.126 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:18.977+0000 7f035e9f7740 1 --2- 172.21.15.19:0/3113141875 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556f4b42d0f0 0x556f4b4af6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:36:19.126 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:18.977+0000 7f033dffb640 0 client.17310 ms_handle_reset on v2:172.21.15.138:6836/3353290042 2024-09-10T22:36:19.126 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:18.977+0000 7f035e9f7740 1 -- 172.21.15.19:0/3113141875 >> 172.21.15.19:0/3113141875 conn(0x556f4b42af20 msgr2=0x556f4b434e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:36:19.126 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:18.977+0000 7f035e9f7740 1 -- 172.21.15.19:0/3113141875 shutdown_connections 2024-09-10T22:36:19.126 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:18.977+0000 7f035e9f7740 1 -- 172.21.15.19:0/3113141875 wait complete. 2024-09-10T22:36:19.126 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:18.977+0000 7f035e9f7740 20 client.17310 trim_cache size 0 max 16384 2024-09-10T22:36:19.127 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:18.978+0000 7f035c622640 1 -- 172.21.15.19:0/3823777112 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f03400b52e0 msgr2=0x7f03400b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:36:19.127 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:18.978+0000 7f035c622640 1 --2- 172.21.15.19:0/3823777112 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f03400b52e0 0x7f03400b77a0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f034c005fe0 tx=0x7f034c005ef0 comp rx=0 tx=0).stop 2024-09-10T22:36:19.127 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:18.978+0000 7f035c622640 1 -- 172.21.15.19:0/3823777112 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f03541076a0 msgr2=0x7f0354199790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:36:19.127 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:18.978+0000 7f035c622640 1 --2- 172.21.15.19:0/3823777112 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f03541076a0 0x7f0354199790 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x7f034400e9f0 tx=0x7f034400edf0 comp rx=0 tx=0).stop 2024-09-10T22:36:19.127 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:18.978+0000 7f035c622640 1 -- 172.21.15.19:0/3823777112 shutdown_connections 2024-09-10T22:36:19.127 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:18.978+0000 7f035c622640 1 --2- 172.21.15.19:0/3823777112 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f03400b52e0 0x7f03400b77a0 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:36:19.127 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:18.978+0000 7f035c622640 1 --2- 172.21.15.19:0/3823777112 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f0354108020 0x7f035419eb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:36:19.127 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:18.978+0000 7f035c622640 1 --2- 172.21.15.19:0/3823777112 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f03541076a0 0x7f0354199790 unknown :-1 s=CLOSED pgs=799 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:36:19.127 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:18.978+0000 7f035c622640 1 --2- 172.21.15.19:0/3823777112 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0354101c90 0x7f0354199250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:36:19.127 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:18.978+0000 7f035c622640 1 -- 172.21.15.19:0/3823777112 >> 172.21.15.19:0/3823777112 conn(0x7f03540fd700 msgr2=0x7f035406ad90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:36:19.127 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:18.978+0000 7f035c622640 1 -- 172.21.15.19:0/3823777112 shutdown_connections 2024-09-10T22:36:19.128 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:18.978+0000 7f035c622640 1 -- 172.21.15.19:0/3823777112 wait complete. 2024-09-10T22:36:19.943 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 22997a4c-6fc2-11ef-bcea-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-09-10T22:36:20.208 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:36:19 smithi019 ceph-mon[31375]: pgmap v644: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 392 KiB/s rd, 218 MiB/s wr, 147 op/s 2024-09-10T22:36:20.257 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/22997a4c-6fc2-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T22:36:20.359 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:36:19 smithi135 ceph-mon[34789]: pgmap v644: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 392 KiB/s rd, 218 MiB/s wr, 147 op/s 2024-09-10T22:36:20.375 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:36:19 smithi138 ceph-mon[35236]: pgmap v644: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 392 KiB/s rd, 218 MiB/s wr, 147 op/s 2024-09-10T22:36:20.884 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:20.869+0000 7f97495c8640 1 -- 172.21.15.19:0/2367602895 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9744101cc0 msgr2=0x7f97441020a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:36:20.885 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:20.869+0000 7f97495c8640 1 --2- 172.21.15.19:0/2367602895 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9744101cc0 0x7f97441020a0 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 crypto rx=0x7f9734009900 tx=0x7f973402a410 comp rx=0 tx=0).stop 2024-09-10T22:36:20.885 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:20.869+0000 7f97495c8640 1 -- 172.21.15.19:0/2367602895 shutdown_connections 2024-09-10T22:36:20.885 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:20.869+0000 7f97495c8640 1 --2- 172.21.15.19:0/2367602895 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f9744108050 0x7f974410e850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:36:20.885 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:20.869+0000 7f97495c8640 1 --2- 172.21.15.19:0/2367602895 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f97441076d0 0x7f9744107b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:36:20.885 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:20.869+0000 7f97495c8640 1 --2- 172.21.15.19:0/2367602895 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9744101cc0 0x7f97441020a0 unknown :-1 s=CLOSED pgs=803 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:36:20.885 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:20.869+0000 7f97495c8640 1 -- 172.21.15.19:0/2367602895 >> 172.21.15.19:0/2367602895 conn(0x7f97440fd6f0 msgr2=0x7f97440ffb10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:36:20.885 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:20.869+0000 7f97495c8640 1 -- 172.21.15.19:0/2367602895 shutdown_connections 2024-09-10T22:36:20.885 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:20.869+0000 7f97495c8640 1 -- 172.21.15.19:0/2367602895 wait complete. 2024-09-10T22:36:20.885 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:20.870+0000 7f97495c8640 1 Processor -- start 2024-09-10T22:36:20.885 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:20.870+0000 7f97495c8640 1 -- start start 2024-09-10T22:36:20.886 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:20.870+0000 7f97495c8640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9744101cc0 0x7f9744199fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:36:20.886 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:20.870+0000 7f97495c8640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f97441076d0 0x7f974419a520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:36:20.886 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:20.870+0000 7f97495c8640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9744108050 0x7f97441a5060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:36:20.886 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:20.870+0000 7f97495c8640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f9744111d10 con 0x7f9744101cc0 2024-09-10T22:36:20.886 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:20.870+0000 7f97495c8640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f9744111b90 con 0x7f9744108050 2024-09-10T22:36:20.886 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:20.870+0000 7f97495c8640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f9744111e90 con 0x7f97441076d0 2024-09-10T22:36:20.886 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:20.870+0000 7f97427fc640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f97441076d0 0x7f974419a520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:36:20.886 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:20.870+0000 7f97427fc640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f97441076d0 0x7f974419a520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.19:55244/0 (socket says 172.21.15.19:55244) 2024-09-10T22:36:20.886 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:20.870+0000 7f97437fe640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9744108050 0x7f97441a5060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:36:20.886 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:20.870+0000 7f97427fc640 1 -- 172.21.15.19:0/2184272560 learned_addr learned my addr 172.21.15.19:0/2184272560 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:36:20.886 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:20.870+0000 7f9742ffd640 1 --2- 172.21.15.19:0/2184272560 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9744101cc0 0x7f9744199fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:36:20.886 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:20.871+0000 7f97437fe640 1 -- 172.21.15.19:0/2184272560 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f97441076d0 msgr2=0x7f974419a520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:36:20.886 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:20.871+0000 7f97437fe640 1 --2- 172.21.15.19:0/2184272560 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f97441076d0 0x7f974419a520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:36:20.887 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:20.871+0000 7f97437fe640 1 -- 172.21.15.19:0/2184272560 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9744101cc0 msgr2=0x7f9744199fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:36:20.887 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:20.871+0000 7f97437fe640 1 --2- 172.21.15.19:0/2184272560 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9744101cc0 0x7f9744199fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:36:20.887 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:20.871+0000 7f97437fe640 1 -- 172.21.15.19:0/2184272560 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f97441a55a0 con 0x7f9744108050 2024-09-10T22:36:20.887 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:20.871+0000 7f97427fc640 1 --2- 172.21.15.19:0/2184272560 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f97441076d0 0x7f974419a520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T22:36:20.887 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:20.871+0000 7f97437fe640 1 --2- 172.21.15.19:0/2184272560 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9744108050 0x7f97441a5060 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f973c00e940 tx=0x7f973c00ee00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:36:20.887 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:20.871+0000 7f972bfff640 1 -- 172.21.15.19:0/2184272560 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f973c004d20 con 0x7f9744108050 2024-09-10T22:36:20.887 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:20.871+0000 7f972bfff640 1 -- 172.21.15.19:0/2184272560 <== mon.2 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f973c005020 con 0x7f9744108050 2024-09-10T22:36:20.887 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:20.871+0000 7f97495c8640 1 -- 172.21.15.19:0/2184272560 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f97441a5770 con 0x7f9744108050 2024-09-10T22:36:20.887 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:20.871+0000 7f972bfff640 1 -- 172.21.15.19:0/2184272560 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f973c0116d0 con 0x7f9744108050 2024-09-10T22:36:20.888 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:20.871+0000 7f97495c8640 1 -- 172.21.15.19:0/2184272560 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f97441a5c50 con 0x7f9744108050 2024-09-10T22:36:20.888 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:20.874+0000 7f972bfff640 1 -- 172.21.15.19:0/2184272560 <== mon.2 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 18) ==== 153250+0+0 (secure 0 0 0) 0x7f973c00f040 con 0x7f9744108050 2024-09-10T22:36:20.888 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:20.874+0000 7f974b99d740 1 Processor -- start 2024-09-10T22:36:20.888 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:20.874+0000 7f974b99d740 1 -- start start 2024-09-10T22:36:20.888 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:20.874+0000 7f974b99d740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55c7dd8164d0 0x55c7dd8168b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:36:20.888 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:20.875+0000 7f974b99d740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55c7dd816df0 0x55c7dd822840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:36:20.888 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:20.875+0000 7f974b99d740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c7dd822d80 0x55c7dd825170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:36:20.888 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:20.875+0000 7f974b99d740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x55c7dd78cea0 con 0x55c7dd8164d0 2024-09-10T22:36:20.888 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:20.875+0000 7f974b99d740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55c7dd77c2d0 con 0x55c7dd822d80 2024-09-10T22:36:20.888 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:20.875+0000 7f974b99d740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x55c7dd7800e0 con 0x55c7dd816df0 2024-09-10T22:36:20.888 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:20.875+0000 7f97427fc640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55c7dd8164d0 0x55c7dd8168b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:36:20.888 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:20.875+0000 7f97427fc640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55c7dd8164d0 0x55c7dd8168b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:46844/0 (socket says 172.21.15.19:46844) 2024-09-10T22:36:20.888 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:20.875+0000 7f97427fc640 1 -- 172.21.15.19:0/3993844087 learned_addr learned my addr 172.21.15.19:0/3993844087 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:36:20.889 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:20.875+0000 7f97427fc640 1 --2- 172.21.15.19:0/3993844087 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c7dd822d80 0x55c7dd825170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:36:20.889 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:20.875+0000 7f9742ffd640 1 --2- 172.21.15.19:0/3993844087 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55c7dd816df0 0x55c7dd822840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:36:20.889 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:20.875+0000 7f972bfff640 1 --2- 172.21.15.19:0/2184272560 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f972c0b52e0 0x7f972c0b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:36:20.889 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:20.875+0000 7f97427fc640 1 -- 172.21.15.19:0/3993844087 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55c7dd816df0 msgr2=0x55c7dd822840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:36:20.889 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:20.875+0000 7f97427fc640 1 --2- 172.21.15.19:0/3993844087 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55c7dd816df0 0x55c7dd822840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:36:20.889 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:20.875+0000 7f97427fc640 1 -- 172.21.15.19:0/3993844087 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c7dd822d80 msgr2=0x55c7dd825170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:36:20.889 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:20.875+0000 7f97427fc640 1 --2- 172.21.15.19:0/3993844087 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c7dd822d80 0x55c7dd825170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:36:20.889 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:20.875+0000 7f97427fc640 1 -- 172.21.15.19:0/3993844087 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c7dd4da650 con 0x55c7dd8164d0 2024-09-10T22:36:20.889 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:20.875+0000 7f972bfff640 1 -- 172.21.15.19:0/2184272560 <== mon.2 v2:172.21.15.135:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8327+0+0 (secure 0 0 0) 0x7f973c0e5c90 con 0x7f9744108050 2024-09-10T22:36:20.889 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:20.875+0000 7f97427fc640 1 --2- 172.21.15.19:0/3993844087 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55c7dd8164d0 0x55c7dd8168b0 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 crypto rx=0x7f9738012c70 tx=0x7f9738005f30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=61264246a8fae7c6 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:36:20.889 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:20.875+0000 7f97437fe640 1 --2- 172.21.15.19:0/2184272560 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f972c0b52e0 0x7f972c0b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:36:20.889 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:20.876+0000 7f97297fa640 1 -- 172.21.15.19:0/3993844087 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9738012e20 con 0x55c7dd8164d0 2024-09-10T22:36:20.889 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:20.876+0000 7f97297fa640 1 -- 172.21.15.19:0/3993844087 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f973800ebe0 con 0x55c7dd8164d0 2024-09-10T22:36:20.890 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:20.876+0000 7f97297fa640 1 -- 172.21.15.19:0/3993844087 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9738003c00 con 0x55c7dd8164d0 2024-09-10T22:36:20.890 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:20.876+0000 7f974b99d740 1 -- 172.21.15.19:0/3993844087 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55c7dd8164d0 msgr2=0x55c7dd8168b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:36:20.890 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:20.876+0000 7f97437fe640 1 --2- 172.21.15.19:0/2184272560 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f972c0b52e0 0x7f972c0b77a0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f973c000f80 tx=0x7f973c005f50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:36:20.890 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:20.876+0000 7f974b99d740 1 --2- 172.21.15.19:0/3993844087 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55c7dd8164d0 0x55c7dd8168b0 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 crypto rx=0x7f9738012c70 tx=0x7f9738005f30 comp rx=0 tx=0).stop 2024-09-10T22:36:20.890 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:20.877+0000 7f974b99d740 1 -- 172.21.15.19:0/3993844087 shutdown_connections 2024-09-10T22:36:20.890 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:20.877+0000 7f974b99d740 1 --2- 172.21.15.19:0/3993844087 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c7dd822d80 0x55c7dd825170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:36:20.890 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:20.877+0000 7f974b99d740 1 --2- 172.21.15.19:0/3993844087 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55c7dd816df0 0x55c7dd822840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:36:20.890 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:20.877+0000 7f974b99d740 1 --2- 172.21.15.19:0/3993844087 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55c7dd8164d0 0x55c7dd8168b0 unknown :-1 s=CLOSED pgs=804 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:36:20.890 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:20.877+0000 7f974b99d740 1 -- 172.21.15.19:0/3993844087 >> 172.21.15.19:0/3993844087 conn(0x55c7dd814300 msgr2=0x55c7dd8154a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:36:20.890 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:20.877+0000 7f974b99d740 1 -- 172.21.15.19:0/3993844087 shutdown_connections 2024-09-10T22:36:20.890 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:20.877+0000 7f974b99d740 1 -- 172.21.15.19:0/3993844087 wait complete. 2024-09-10T22:36:20.890 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:20.877+0000 7f974b99d740 1 -- start start 2024-09-10T22:36:20.890 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:20.877+0000 7f974b99d740 1 Processor -- start 2024-09-10T22:36:20.891 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:20.877+0000 7f974b99d740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55c7dd8164d0 0x55c7dd822640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:36:20.891 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:20.877+0000 7f974b99d740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c7dd816df0 0x55c7dd81fa90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:36:20.891 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:20.877+0000 7f974b99d740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55c7dd822d80 0x55c7dd820070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:36:20.891 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:20.877+0000 7f974b99d740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x55c7dd5dd700 con 0x55c7dd822d80 2024-09-10T22:36:20.891 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:20.877+0000 7f974b99d740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55c7dd717160 con 0x55c7dd816df0 2024-09-10T22:36:20.891 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:20.877+0000 7f974b99d740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x55c7dd8259a0 con 0x55c7dd8164d0 2024-09-10T22:36:20.891 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:20.877+0000 7f974b99d740 10 client.0 _ll_register_callbacks cb 0x55c7dd7309e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T22:36:20.891 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:20.878+0000 7f97427fc640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55c7dd822d80 0x55c7dd820070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:36:20.891 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:20.878+0000 7f97427fc640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55c7dd822d80 0x55c7dd820070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:46850/0 (socket says 172.21.15.19:46850) 2024-09-10T22:36:20.891 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:20.878+0000 7f97427fc640 1 -- 172.21.15.19:0/3432344795 learned_addr learned my addr 172.21.15.19:0/3432344795 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:36:20.891 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:20.878+0000 7f9742ffd640 1 --2- 172.21.15.19:0/3432344795 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c7dd816df0 0x55c7dd81fa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:36:20.891 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:20.878+0000 7f97427fc640 1 --2- 172.21.15.19:0/3432344795 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55c7dd8164d0 0x55c7dd822640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:36:20.892 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:20.878+0000 7f9742ffd640 1 -- 172.21.15.19:0/3432344795 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55c7dd8164d0 msgr2=0x55c7dd822640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:36:20.892 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:20.878+0000 7f9742ffd640 1 --2- 172.21.15.19:0/3432344795 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55c7dd8164d0 0x55c7dd822640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:36:20.892 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:20.878+0000 7f9742ffd640 1 -- 172.21.15.19:0/3432344795 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55c7dd822d80 msgr2=0x55c7dd820070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:36:20.892 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:20.878+0000 7f9742ffd640 1 --2- 172.21.15.19:0/3432344795 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55c7dd822d80 0x55c7dd820070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:36:20.892 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:20.878+0000 7f9742ffd640 1 -- 172.21.15.19:0/3432344795 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c7dd744c90 con 0x55c7dd816df0 2024-09-10T22:36:20.892 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:20.878+0000 7f97427fc640 1 --2- 172.21.15.19:0/3432344795 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55c7dd822d80 0x55c7dd820070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T22:36:20.892 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:20.878+0000 7f9742ffd640 1 --2- 172.21.15.19:0/3432344795 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c7dd816df0 0x55c7dd81fa90 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f9734009230 tx=0x7f97340314a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2928a08fafe8857f server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:36:20.892 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:20.878+0000 7f9726ff5640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-09-10T22:36:20.892 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:20.878+0000 7f9726ff5640 1 -- 172.21.15.19:0/3432344795 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9734035040 con 0x55c7dd816df0 2024-09-10T22:36:20.892 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:20.878+0000 7f9726ff5640 1 -- 172.21.15.19:0/3432344795 <== mon.2 v2:172.21.15.135:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8327+0+0 (secure 0 0 0) 0x7f9734004040 con 0x55c7dd816df0 2024-09-10T22:36:20.892 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:20.878+0000 7f974b99d740 1 -- 172.21.15.19:0/3432344795 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f973800ebe0 con 0x55c7dd816df0 2024-09-10T22:36:20.892 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:20.879+0000 7f9726ff5640 1 -- 172.21.15.19:0/3432344795 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f97340318d0 con 0x55c7dd816df0 2024-09-10T22:36:20.892 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:20.879+0000 7f974b99d740 10 client.26633 fetch_fsmap learned FSMap version 27 2024-09-10T22:36:20.893 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:20.879+0000 7f974b99d740 1 -- 172.21.15.19:0/3432344795 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55c7dd8312a0 con 0x55c7dd816df0 2024-09-10T22:36:20.893 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:20.879+0000 7f9726ff5640 1 -- 172.21.15.19:0/3432344795 <== mon.2 v2:172.21.15.135:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f973800ebe0 con 0x55c7dd816df0 2024-09-10T22:36:20.893 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:20.879+0000 7f9726ff5640 1 -- 172.21.15.19:0/3432344795 <== mon.2 v2:172.21.15.135:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7f9734004870 con 0x55c7dd816df0 2024-09-10T22:36:20.893 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:20.879+0000 7f974b99d740 10 client.26633 fetch_fsmap finished waiting for FSMap version 27 2024-09-10T22:36:20.893 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:20.879+0000 7f974b99d740 10 client.26633 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-10T22:36:20.893 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:20.879+0000 7f974b99d740 20 client.26633 populate_metadata read hostname 'smithi019' 2024-09-10T22:36:20.893 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:20.879+0000 7f974b99d740 1 --2- 172.21.15.19:0/3432344795 >> [v2:172.21.15.138:6838/383637208,v1:172.21.15.138:6839/383637208] conn(0x55c7dd8327b0 0x55c7dd834ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:36:20.893 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:20.879+0000 7f974b99d740 4 client.26633 mds_command: new command op to 24568 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T22:36:20.893 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:20.879+0000 7f974b99d740 1 -- 172.21.15.19:0/3432344795 --> [v2:172.21.15.138:6838/383637208,v1:172.21.15.138:6839/383637208] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c7dd78edf0 con 0x55c7dd8327b0 2024-09-10T22:36:20.893 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:20.879+0000 7f97427fc640 1 --2- 172.21.15.19:0/3432344795 >> [v2:172.21.15.138:6838/383637208,v1:172.21.15.138:6839/383637208] conn(0x55c7dd8327b0 0x55c7dd834ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:36:20.893 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:20.880+0000 7f97427fc640 1 --2- 172.21.15.19:0/3432344795 >> [v2:172.21.15.138:6838/383637208,v1:172.21.15.138:6839/383637208] conn(0x55c7dd8327b0 0x55c7dd834ba0 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=70d4b4ad75f2bea2 server_cookie=abe7f13961802cf in_seq=0 out_seq=0 2024-09-10T22:36:20.893 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:20.880+0000 7f9726ff5640 10 client.26633 ms_handle_connect on v2:172.21.15.138:6838/383637208 2024-09-10T22:36:20.894 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:20.880+0000 7f9726ff5640 1 -- 172.21.15.19:0/3432344795 <== mds.1 v2:172.21.15.138:6838/383637208 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55c7dd78edf0 con 0x55c7dd8327b0 2024-09-10T22:36:20.894 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:20.880+0000 7f9726ff5640 10 client.26633 handle_command_reply: tid=0 2024-09-10T22:36:20.894 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:20.880+0000 7f974b99d740 1 client.26633 shutdown 2024-09-10T22:36:20.894 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:20.881+0000 7f974b99d740 1 -- 172.21.15.19:0/3432344795 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c7dd816df0 msgr2=0x55c7dd81fa90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:36:20.894 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:20.881+0000 7f974b99d740 1 --2- 172.21.15.19:0/3432344795 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c7dd816df0 0x55c7dd81fa90 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f9734009230 tx=0x7f97340314a0 comp rx=0 tx=0).stop 2024-09-10T22:36:20.894 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:20.881+0000 7f974b99d740 1 -- 172.21.15.19:0/3432344795 shutdown_connections 2024-09-10T22:36:20.894 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:20.881+0000 7f974b99d740 1 --2- 172.21.15.19:0/3432344795 >> [v2:172.21.15.138:6838/383637208,v1:172.21.15.138:6839/383637208] conn(0x55c7dd8327b0 0x55c7dd834ba0 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:36:20.894 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:20.881+0000 7f974b99d740 1 --2- 172.21.15.19:0/3432344795 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55c7dd822d80 0x55c7dd820070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:36:20.894 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:20.881+0000 7f9726ff5640 0 client.26633 ms_handle_reset on v2:172.21.15.138:6838/383637208 2024-09-10T22:36:20.894 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:20.881+0000 7f974b99d740 1 --2- 172.21.15.19:0/3432344795 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c7dd816df0 0x55c7dd81fa90 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:36:20.894 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:20.881+0000 7f974b99d740 1 --2- 172.21.15.19:0/3432344795 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55c7dd8164d0 0x55c7dd822640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:36:20.894 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:20.881+0000 7f974b99d740 1 -- 172.21.15.19:0/3432344795 >> 172.21.15.19:0/3432344795 conn(0x55c7dd814300 msgr2=0x55c7dd819ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:36:20.894 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:20.881+0000 7f974b99d740 1 -- 172.21.15.19:0/3432344795 shutdown_connections 2024-09-10T22:36:20.894 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:20.881+0000 7f974b99d740 1 -- 172.21.15.19:0/3432344795 wait complete. 2024-09-10T22:36:20.895 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:20.881+0000 7f974b99d740 20 client.26633 trim_cache size 0 max 16384 2024-09-10T22:36:20.898 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:20.896+0000 7f974b99d740 1 Processor -- start 2024-09-10T22:36:20.898 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:20.896+0000 7f974b99d740 1 -- start start 2024-09-10T22:36:20.898 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:20.896+0000 7f974b99d740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55c7dd8164d0 0x55c7dd813c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:36:20.899 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:20.896+0000 7f974b99d740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55c7dd816df0 0x55c7dd8217d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:36:20.899 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:20.896+0000 7f974b99d740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c7dd822d80 0x55c7dd824170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:36:20.899 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:20.896+0000 7f974b99d740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f97441b0db0 con 0x55c7dd816df0 2024-09-10T22:36:20.899 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:20.896+0000 7f974b99d740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f97441ae680 con 0x55c7dd822d80 2024-09-10T22:36:20.899 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:20.896+0000 7f974b99d740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f97441ac4d0 con 0x55c7dd8164d0 2024-09-10T22:36:20.899 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:20.896+0000 7f9742ffd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55c7dd816df0 0x55c7dd8217d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:36:20.899 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:20.896+0000 7f9742ffd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55c7dd816df0 0x55c7dd8217d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:46856/0 (socket says 172.21.15.19:46856) 2024-09-10T22:36:20.899 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:20.896+0000 7f9742ffd640 1 -- 172.21.15.19:0/3051967294 learned_addr learned my addr 172.21.15.19:0/3051967294 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:36:20.899 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:20.896+0000 7f97427fc640 1 --2- 172.21.15.19:0/3051967294 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55c7dd8164d0 0x55c7dd813c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:36:20.899 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:20.896+0000 7f97427fc640 1 --2- 172.21.15.19:0/3051967294 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c7dd822d80 0x55c7dd824170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:36:20.900 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:20.896+0000 7f9742ffd640 1 -- 172.21.15.19:0/3051967294 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55c7dd8164d0 msgr2=0x55c7dd813c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:36:20.900 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:20.896+0000 7f9742ffd640 1 --2- 172.21.15.19:0/3051967294 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55c7dd8164d0 0x55c7dd813c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:36:20.900 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:20.896+0000 7f9742ffd640 1 -- 172.21.15.19:0/3051967294 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c7dd822d80 msgr2=0x55c7dd824170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:36:20.900 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:20.896+0000 7f9742ffd640 1 --2- 172.21.15.19:0/3051967294 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c7dd822d80 0x55c7dd824170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:36:20.900 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:20.896+0000 7f9742ffd640 1 -- 172.21.15.19:0/3051967294 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c7dd81df90 con 0x55c7dd816df0 2024-09-10T22:36:20.900 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:20.896+0000 7f97427fc640 1 --2- 172.21.15.19:0/3051967294 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55c7dd8164d0 0x55c7dd813c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T22:36:20.900 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:20.897+0000 7f9742ffd640 1 --2- 172.21.15.19:0/3051967294 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55c7dd816df0 0x55c7dd8217d0 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 crypto rx=0x7f9734009a20 tx=0x7f973402a410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3245102b5f3da5f0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:36:20.900 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:20.897+0000 7f9728ff9640 1 -- 172.21.15.19:0/3051967294 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9734035030 con 0x55c7dd816df0 2024-09-10T22:36:20.900 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:20.897+0000 7f9728ff9640 1 -- 172.21.15.19:0/3051967294 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9734031a70 con 0x55c7dd816df0 2024-09-10T22:36:20.900 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:20.897+0000 7f9728ff9640 1 -- 172.21.15.19:0/3051967294 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9734005040 con 0x55c7dd816df0 2024-09-10T22:36:20.904 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:20.898+0000 7f974b99d740 1 -- 172.21.15.19:0/3051967294 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55c7dd816df0 msgr2=0x55c7dd8217d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:36:20.904 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:20.898+0000 7f974b99d740 1 --2- 172.21.15.19:0/3051967294 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55c7dd816df0 0x55c7dd8217d0 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 crypto rx=0x7f9734009a20 tx=0x7f973402a410 comp rx=0 tx=0).stop 2024-09-10T22:36:20.904 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:20.898+0000 7f974b99d740 1 -- 172.21.15.19:0/3051967294 shutdown_connections 2024-09-10T22:36:20.904 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:20.898+0000 7f974b99d740 1 --2- 172.21.15.19:0/3051967294 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c7dd822d80 0x55c7dd824170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:36:20.905 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:20.898+0000 7f974b99d740 1 --2- 172.21.15.19:0/3051967294 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55c7dd816df0 0x55c7dd8217d0 unknown :-1 s=CLOSED pgs=805 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:36:20.905 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:20.898+0000 7f974b99d740 1 --2- 172.21.15.19:0/3051967294 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55c7dd8164d0 0x55c7dd813c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:36:20.905 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:20.898+0000 7f974b99d740 1 -- 172.21.15.19:0/3051967294 >> 172.21.15.19:0/3051967294 conn(0x55c7dd814300 msgr2=0x55c7dd8210c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:36:20.905 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:20.898+0000 7f974b99d740 1 -- 172.21.15.19:0/3051967294 shutdown_connections 2024-09-10T22:36:20.905 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:20.898+0000 7f974b99d740 1 -- 172.21.15.19:0/3051967294 wait complete. 2024-09-10T22:36:20.905 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:20.898+0000 7f974b99d740 1 -- start start 2024-09-10T22:36:20.905 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:20.898+0000 7f974b99d740 1 Processor -- start 2024-09-10T22:36:20.905 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:20.898+0000 7f974b99d740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55c7dd8164d0 0x55c7dd82ac30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:36:20.905 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:20.898+0000 7f974b99d740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c7dd816df0 0x55c7dd82b170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:36:20.905 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:20.898+0000 7f974b99d740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55c7dd822d80 0x55c7dd81bcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:36:20.905 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:20.898+0000 7f974b99d740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f97441acb40 con 0x55c7dd822d80 2024-09-10T22:36:20.905 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:20.898+0000 7f974b99d740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f97441adfb0 con 0x55c7dd816df0 2024-09-10T22:36:20.905 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:20.898+0000 7f974b99d740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f97441ad210 con 0x55c7dd8164d0 2024-09-10T22:36:20.906 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:20.898+0000 7f974b99d740 10 client.0 _ll_register_callbacks cb 0x7f9734009560 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T22:36:20.906 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:20.899+0000 7f97427fc640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55c7dd822d80 0x55c7dd81bcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:36:20.906 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:20.899+0000 7f9742ffd640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c7dd816df0 0x55c7dd82b170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:36:20.906 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:20.899+0000 7f97427fc640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55c7dd822d80 0x55c7dd81bcb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:46858/0 (socket says 172.21.15.19:46858) 2024-09-10T22:36:20.906 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:20.899+0000 7f9742ffd640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c7dd816df0 0x55c7dd82b170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.19:49062/0 (socket says 172.21.15.19:49062) 2024-09-10T22:36:20.906 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:20.899+0000 7f97427fc640 1 -- 172.21.15.19:0/4247597600 learned_addr learned my addr 172.21.15.19:0/4247597600 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:36:20.906 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:20.899+0000 7f97427fc640 1 --2- 172.21.15.19:0/4247597600 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55c7dd8164d0 0x55c7dd82ac30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:36:20.906 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:20.899+0000 7f9742ffd640 1 -- 172.21.15.19:0/4247597600 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55c7dd8164d0 msgr2=0x55c7dd82ac30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:36:20.906 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:20.899+0000 7f9742ffd640 1 --2- 172.21.15.19:0/4247597600 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55c7dd8164d0 0x55c7dd82ac30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:36:20.906 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:20.899+0000 7f9742ffd640 1 -- 172.21.15.19:0/4247597600 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55c7dd822d80 msgr2=0x55c7dd81bcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:36:20.906 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:20.899+0000 7f9742ffd640 1 --2- 172.21.15.19:0/4247597600 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55c7dd822d80 0x55c7dd81bcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:36:20.906 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:20.899+0000 7f9742ffd640 1 -- 172.21.15.19:0/4247597600 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c7dd81c1f0 con 0x55c7dd816df0 2024-09-10T22:36:20.906 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:20.899+0000 7f97427fc640 1 --2- 172.21.15.19:0/4247597600 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55c7dd822d80 0x55c7dd81bcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T22:36:20.907 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:20.899+0000 7f9742ffd640 1 --2- 172.21.15.19:0/4247597600 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c7dd816df0 0x55c7dd82b170 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f9734004ce0 tx=0x7f9734005010 comp rx=0 tx=0).ready entity=mon.2 client_cookie=dfc7546fafd72e68 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:36:20.907 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:20.899+0000 7f9726ff5640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-09-10T22:36:20.907 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:20.899+0000 7f9726ff5640 1 -- 172.21.15.19:0/4247597600 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9734035070 con 0x55c7dd816df0 2024-09-10T22:36:20.907 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:20.899+0000 7f9726ff5640 1 -- 172.21.15.19:0/4247597600 <== mon.2 v2:172.21.15.135:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8327+0+0 (secure 0 0 0) 0x7f97340316d0 con 0x55c7dd816df0 2024-09-10T22:36:20.907 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:20.900+0000 7f974b99d740 1 -- 172.21.15.19:0/4247597600 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9734031a70 con 0x55c7dd816df0 2024-09-10T22:36:20.907 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:20.900+0000 7f9726ff5640 1 -- 172.21.15.19:0/4247597600 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f9734005410 con 0x55c7dd816df0 2024-09-10T22:36:20.907 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:20.900+0000 7f974b99d740 10 client.26639 fetch_fsmap learned FSMap version 27 2024-09-10T22:36:20.907 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:20.900+0000 7f974b99d740 1 -- 172.21.15.19:0/4247597600 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55c7dd81d4f0 con 0x55c7dd816df0 2024-09-10T22:36:20.907 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:20.900+0000 7f9726ff5640 1 -- 172.21.15.19:0/4247597600 <== mon.2 v2:172.21.15.135:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9734031a70 con 0x55c7dd816df0 2024-09-10T22:36:20.907 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:20.900+0000 7f9726ff5640 1 -- 172.21.15.19:0/4247597600 <== mon.2 v2:172.21.15.135:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7f9734046c70 con 0x55c7dd816df0 2024-09-10T22:36:20.907 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:20.900+0000 7f974b99d740 10 client.26639 fetch_fsmap finished waiting for FSMap version 27 2024-09-10T22:36:20.907 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:20.900+0000 7f974b99d740 10 client.26639 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-10T22:36:20.908 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:20.900+0000 7f974b99d740 20 client.26639 populate_metadata read hostname 'smithi019' 2024-09-10T22:36:20.908 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:20.900+0000 7f974b99d740 1 --2- 172.21.15.19:0/4247597600 >> [v2:172.21.15.138:6838/383637208,v1:172.21.15.138:6839/383637208] conn(0x55c7dd8327b0 0x55c7dd8a2690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:36:20.908 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:20.900+0000 7f974b99d740 4 client.26639 mds_command: new command op to 24568 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-10T22:36:20.908 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:20.900+0000 7f974b99d740 1 -- 172.21.15.19:0/4247597600 --> [v2:172.21.15.138:6838/383637208,v1:172.21.15.138:6839/383637208] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55c7dd78a8a0 con 0x55c7dd8327b0 2024-09-10T22:36:20.908 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:20.900+0000 7f97427fc640 1 --2- 172.21.15.19:0/4247597600 >> [v2:172.21.15.138:6838/383637208,v1:172.21.15.138:6839/383637208] conn(0x55c7dd8327b0 0x55c7dd8a2690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:36:20.908 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:20.901+0000 7f97427fc640 1 --2- 172.21.15.19:0/4247597600 >> [v2:172.21.15.138:6838/383637208,v1:172.21.15.138:6839/383637208] conn(0x55c7dd8327b0 0x55c7dd8a2690 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=fa8428c08b121c3f server_cookie=3845721d4d78d20c in_seq=0 out_seq=0 2024-09-10T22:36:20.908 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:20.901+0000 7f9726ff5640 10 client.26639 ms_handle_connect on v2:172.21.15.138:6838/383637208 2024-09-10T22:36:20.908 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:20.901+0000 7f9726ff5640 1 -- 172.21.15.19:0/4247597600 <== mds.1 v2:172.21.15.138:6838/383637208 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55c7dd78a8a0 con 0x55c7dd8327b0 2024-09-10T22:36:20.908 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:20.901+0000 7f9726ff5640 10 client.26639 handle_command_reply: tid=0 2024-09-10T22:36:20.908 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:20.901+0000 7f974b99d740 1 client.26639 shutdown 2024-09-10T22:36:20.908 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:20.901+0000 7f974b99d740 1 -- 172.21.15.19:0/4247597600 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c7dd816df0 msgr2=0x55c7dd82b170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:36:20.908 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:20.901+0000 7f974b99d740 1 --2- 172.21.15.19:0/4247597600 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c7dd816df0 0x55c7dd82b170 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f9734004ce0 tx=0x7f9734005010 comp rx=0 tx=0).stop 2024-09-10T22:36:20.908 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:20.901+0000 7f974b99d740 1 -- 172.21.15.19:0/4247597600 shutdown_connections 2024-09-10T22:36:20.908 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:20.901+0000 7f974b99d740 1 --2- 172.21.15.19:0/4247597600 >> [v2:172.21.15.138:6838/383637208,v1:172.21.15.138:6839/383637208] conn(0x55c7dd8327b0 0x55c7dd8a2690 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:36:20.909 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:20.901+0000 7f974b99d740 1 --2- 172.21.15.19:0/4247597600 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55c7dd822d80 0x55c7dd81bcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:36:20.909 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:20.901+0000 7f974b99d740 1 --2- 172.21.15.19:0/4247597600 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c7dd816df0 0x55c7dd82b170 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:36:20.909 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:20.901+0000 7f974b99d740 1 --2- 172.21.15.19:0/4247597600 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55c7dd8164d0 0x55c7dd82ac30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:36:20.909 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:20.901+0000 7f9726ff5640 0 client.26639 ms_handle_reset on v2:172.21.15.138:6838/383637208 2024-09-10T22:36:20.909 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:20.901+0000 7f974b99d740 1 -- 172.21.15.19:0/4247597600 >> 172.21.15.19:0/4247597600 conn(0x55c7dd814300 msgr2=0x55c7dd8218e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:36:20.909 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:20.901+0000 7f974b99d740 1 -- 172.21.15.19:0/4247597600 shutdown_connections 2024-09-10T22:36:20.909 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:20.901+0000 7f974b99d740 1 -- 172.21.15.19:0/4247597600 wait complete. 2024-09-10T22:36:20.909 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:20.901+0000 7f974b99d740 20 client.26639 trim_cache size 0 max 16384 2024-09-10T22:36:20.909 INFO:teuthology.orchestra.run.smithi019.stdout:[] 2024-09-10T22:36:20.910 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:20.902+0000 7f97495c8640 1 -- 172.21.15.19:0/2184272560 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f972c0b52e0 msgr2=0x7f972c0b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:36:20.910 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:20.902+0000 7f97495c8640 1 --2- 172.21.15.19:0/2184272560 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f972c0b52e0 0x7f972c0b77a0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f973c000f80 tx=0x7f973c005f50 comp rx=0 tx=0).stop 2024-09-10T22:36:20.910 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:20.902+0000 7f97495c8640 1 -- 172.21.15.19:0/2184272560 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9744108050 msgr2=0x7f97441a5060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:36:20.910 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:20.902+0000 7f97495c8640 1 --2- 172.21.15.19:0/2184272560 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9744108050 0x7f97441a5060 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f973c00e940 tx=0x7f973c00ee00 comp rx=0 tx=0).stop 2024-09-10T22:36:20.910 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:20.902+0000 7f97495c8640 1 -- 172.21.15.19:0/2184272560 shutdown_connections 2024-09-10T22:36:20.910 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:20.902+0000 7f97495c8640 1 --2- 172.21.15.19:0/2184272560 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f972c0b52e0 0x7f972c0b77a0 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:36:20.910 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:20.902+0000 7f97495c8640 1 --2- 172.21.15.19:0/2184272560 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9744108050 0x7f97441a5060 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:36:20.911 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:20.902+0000 7f97495c8640 1 --2- 172.21.15.19:0/2184272560 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f97441076d0 0x7f974419a520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:36:20.911 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:20.902+0000 7f97495c8640 1 --2- 172.21.15.19:0/2184272560 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9744101cc0 0x7f9744199fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:36:20.911 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:20.902+0000 7f97495c8640 1 -- 172.21.15.19:0/2184272560 >> 172.21.15.19:0/2184272560 conn(0x7f97440fd6f0 msgr2=0x7f97440feef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:36:20.911 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:20.902+0000 7f97495c8640 1 -- 172.21.15.19:0/2184272560 shutdown_connections 2024-09-10T22:36:20.911 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:20.902+0000 7f97495c8640 1 -- 172.21.15.19:0/2184272560 wait complete. 2024-09-10T22:36:21.739 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 22997a4c-6fc2-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-10T22:36:22.032 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/22997a4c-6fc2-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T22:36:22.358 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:36:22 smithi019 ceph-mon[31375]: pgmap v645: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 393 KiB/s rd, 245 MiB/s wr, 324 op/s 2024-09-10T22:36:22.359 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:36:22 smithi135 ceph-mon[34789]: pgmap v645: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 393 KiB/s rd, 245 MiB/s wr, 324 op/s 2024-09-10T22:36:22.375 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:36:22 smithi138 ceph-mon[35236]: pgmap v645: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 393 KiB/s rd, 245 MiB/s wr, 324 op/s 2024-09-10T22:36:22.642 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:22.640+0000 7ff255bf2640 1 -- 172.21.15.19:0/278844872 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff250108020 msgr2=0x7ff25010e820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:36:22.642 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:22.640+0000 7ff255bf2640 1 --2- 172.21.15.19:0/278844872 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff250108020 0x7ff25010e820 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x7ff248009ca0 tx=0x7ff24802a8f0 comp rx=0 tx=0).stop 2024-09-10T22:36:22.643 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:22.641+0000 7ff255bf2640 1 -- 172.21.15.19:0/278844872 shutdown_connections 2024-09-10T22:36:22.643 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:22.641+0000 7ff255bf2640 1 --2- 172.21.15.19:0/278844872 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff250108020 0x7ff25010e820 unknown :-1 s=CLOSED pgs=806 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:36:22.643 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:22.641+0000 7ff255bf2640 1 --2- 172.21.15.19:0/278844872 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff2501076a0 0x7ff250107ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:36:22.643 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:22.641+0000 7ff255bf2640 1 --2- 172.21.15.19:0/278844872 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff250101c90 0x7ff250102070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:36:22.643 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:22.641+0000 7ff255bf2640 1 -- 172.21.15.19:0/278844872 >> 172.21.15.19:0/278844872 conn(0x7ff2500fd700 msgr2=0x7ff2500ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:36:22.643 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:22.641+0000 7ff255bf2640 1 -- 172.21.15.19:0/278844872 shutdown_connections 2024-09-10T22:36:22.643 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:22.641+0000 7ff255bf2640 1 -- 172.21.15.19:0/278844872 wait complete. 2024-09-10T22:36:22.644 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:22.642+0000 7ff255bf2640 1 Processor -- start 2024-09-10T22:36:22.644 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:22.642+0000 7ff255bf2640 1 -- start start 2024-09-10T22:36:22.644 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:22.642+0000 7ff255bf2640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff250101c90 0x7ff250199410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:36:22.644 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:22.642+0000 7ff255bf2640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff2501076a0 0x7ff250199950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:36:22.645 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:22.642+0000 7ff255bf2640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff250108020 0x7ff25019ecf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:36:22.645 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:22.642+0000 7ff255bf2640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7ff250111d90 con 0x7ff2501076a0 2024-09-10T22:36:22.645 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:22.642+0000 7ff255bf2640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7ff250111c10 con 0x7ff250101c90 2024-09-10T22:36:22.645 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:22.642+0000 7ff255bf2640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7ff250111f10 con 0x7ff250108020 2024-09-10T22:36:22.645 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:22.643+0000 7ff24effd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff2501076a0 0x7ff250199950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:36:22.645 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:22.643+0000 7ff24effd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff2501076a0 0x7ff250199950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:46864/0 (socket says 172.21.15.19:46864) 2024-09-10T22:36:22.648 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:22.643+0000 7ff24effd640 1 -- 172.21.15.19:0/1180138688 learned_addr learned my addr 172.21.15.19:0/1180138688 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:36:22.648 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:22.643+0000 7ff24ffff640 1 --2- 172.21.15.19:0/1180138688 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff250108020 0x7ff25019ecf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:36:22.648 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:22.643+0000 7ff24f7fe640 1 --2- 172.21.15.19:0/1180138688 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff250101c90 0x7ff250199410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:36:22.648 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:22.644+0000 7ff24effd640 1 -- 172.21.15.19:0/1180138688 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff250108020 msgr2=0x7ff25019ecf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:36:22.648 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:22.644+0000 7ff24effd640 1 --2- 172.21.15.19:0/1180138688 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff250108020 0x7ff25019ecf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:36:22.648 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:22.644+0000 7ff24effd640 1 -- 172.21.15.19:0/1180138688 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff250101c90 msgr2=0x7ff250199410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:36:22.648 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:22.644+0000 7ff24effd640 1 --2- 172.21.15.19:0/1180138688 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff250101c90 0x7ff250199410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:36:22.648 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:22.644+0000 7ff24effd640 1 -- 172.21.15.19:0/1180138688 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff25019f2e0 con 0x7ff2501076a0 2024-09-10T22:36:22.649 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:22.644+0000 7ff24effd640 1 --2- 172.21.15.19:0/1180138688 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff2501076a0 0x7ff250199950 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 crypto rx=0x7ff24400b4a0 tx=0x7ff24400b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:36:22.649 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:22.644+0000 7ff24cff9640 1 -- 172.21.15.19:0/1180138688 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff244014070 con 0x7ff2501076a0 2024-09-10T22:36:22.649 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:22.645+0000 7ff255bf2640 1 -- 172.21.15.19:0/1180138688 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff25019f5d0 con 0x7ff2501076a0 2024-09-10T22:36:22.649 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:22.645+0000 7ff255bf2640 1 -- 172.21.15.19:0/1180138688 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff2501a3e60 con 0x7ff2501076a0 2024-09-10T22:36:22.649 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:22.647+0000 7ff24cff9640 1 -- 172.21.15.19:0/1180138688 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff244010ac0 con 0x7ff2501076a0 2024-09-10T22:36:22.649 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:22.647+0000 7ff24cff9640 1 -- 172.21.15.19:0/1180138688 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff24401e060 con 0x7ff2501076a0 2024-09-10T22:36:22.654 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:22.651+0000 7ff257fc7740 1 Processor -- start 2024-09-10T22:36:22.655 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:22.653+0000 7ff257fc7740 1 -- start start 2024-09-10T22:36:22.656 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:22.653+0000 7ff257fc7740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x562d27be44d0 0x562d27be48b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:36:22.656 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:22.653+0000 7ff257fc7740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562d27be4df0 0x562d27bf0840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:36:22.657 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:22.653+0000 7ff257fc7740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x562d27bf0d80 0x562d27bf3170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:36:22.657 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:22.653+0000 7ff257fc7740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x562d27b5aea0 con 0x562d27be44d0 2024-09-10T22:36:22.657 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:22.653+0000 7ff257fc7740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x562d27b4a2d0 con 0x562d27be4df0 2024-09-10T22:36:22.658 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:22.653+0000 7ff257fc7740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x562d27b4e0e0 con 0x562d27bf0d80 2024-09-10T22:36:22.658 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:22.654+0000 7ff24ffff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x562d27be44d0 0x562d27be48b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:36:22.658 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:22.654+0000 7ff24ffff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x562d27be44d0 0x562d27be48b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:46872/0 (socket says 172.21.15.19:46872) 2024-09-10T22:36:22.659 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:22.654+0000 7ff24ffff640 1 -- 172.21.15.19:0/967024300 learned_addr learned my addr 172.21.15.19:0/967024300 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:36:22.659 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:22.655+0000 7ff24ffff640 1 -- 172.21.15.19:0/967024300 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x562d27bf0d80 msgr2=0x562d27bf3170 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-10T22:36:22.659 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:22.655+0000 7ff24ffff640 1 --2- 172.21.15.19:0/967024300 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x562d27bf0d80 0x562d27bf3170 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:36:22.659 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:22.655+0000 7ff24ffff640 1 -- 172.21.15.19:0/967024300 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562d27be4df0 msgr2=0x562d27bf0840 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-10T22:36:22.659 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:22.655+0000 7ff24ffff640 1 --2- 172.21.15.19:0/967024300 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562d27be4df0 0x562d27bf0840 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:36:22.659 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:22.655+0000 7ff24ffff640 1 -- 172.21.15.19:0/967024300 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562d278a8650 con 0x562d27be44d0 2024-09-10T22:36:22.659 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:22.655+0000 7ff24ffff640 1 --2- 172.21.15.19:0/967024300 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x562d27be44d0 0x562d27be48b0 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 crypto rx=0x7ff2480098c0 tx=0x7ff2480098f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f4dbf36755261fb8 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:36:22.659 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:22.656+0000 7ff24cff9640 1 -- 172.21.15.19:0/1180138688 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 18) ==== 153250+0+0 (secure 0 0 0) 0x7ff244017ab0 con 0x7ff2501076a0 2024-09-10T22:36:22.662 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:22.660+0000 7ff235ffb640 1 -- 172.21.15.19:0/967024300 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff248031b20 con 0x562d27be44d0 2024-09-10T22:36:22.662 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:22.660+0000 7ff235ffb640 1 -- 172.21.15.19:0/967024300 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff248036040 con 0x562d27be44d0 2024-09-10T22:36:22.663 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:22.660+0000 7ff235ffb640 1 -- 172.21.15.19:0/967024300 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff24802fe30 con 0x562d27be44d0 2024-09-10T22:36:22.663 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:22.661+0000 7ff257fc7740 1 -- 172.21.15.19:0/967024300 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x562d27be44d0 msgr2=0x562d27be48b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:36:22.663 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:22.661+0000 7ff257fc7740 1 --2- 172.21.15.19:0/967024300 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x562d27be44d0 0x562d27be48b0 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 crypto rx=0x7ff2480098c0 tx=0x7ff2480098f0 comp rx=0 tx=0).stop 2024-09-10T22:36:22.664 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:22.661+0000 7ff24cff9640 1 --2- 172.21.15.19:0/1180138688 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7ff2380b5360 0x7ff2380b7820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:36:22.665 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:22.662+0000 7ff257fc7740 1 -- 172.21.15.19:0/967024300 shutdown_connections 2024-09-10T22:36:22.665 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:22.662+0000 7ff257fc7740 1 --2- 172.21.15.19:0/967024300 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x562d27bf0d80 0x562d27bf3170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:36:22.665 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:22.662+0000 7ff257fc7740 1 --2- 172.21.15.19:0/967024300 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562d27be4df0 0x562d27bf0840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:36:22.665 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:22.662+0000 7ff257fc7740 1 --2- 172.21.15.19:0/967024300 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x562d27be44d0 0x562d27be48b0 unknown :-1 s=CLOSED pgs=808 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:36:22.665 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:22.662+0000 7ff257fc7740 1 -- 172.21.15.19:0/967024300 >> 172.21.15.19:0/967024300 conn(0x562d27be2300 msgr2=0x562d27be34a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:36:22.665 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:22.662+0000 7ff24ffff640 1 --2- 172.21.15.19:0/1180138688 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7ff2380b5360 0x7ff2380b7820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:36:22.666 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:22.664+0000 7ff24ffff640 1 --2- 172.21.15.19:0/1180138688 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7ff2380b5360 0x7ff2380b7820 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7ff24802f4a0 tx=0x7ff24803c040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:36:22.666 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:22.664+0000 7ff257fc7740 1 -- 172.21.15.19:0/967024300 shutdown_connections 2024-09-10T22:36:22.667 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:22.664+0000 7ff24cff9640 1 -- 172.21.15.19:0/1180138688 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8327+0+0 (secure 0 0 0) 0x7ff2440e50b0 con 0x7ff2501076a0 2024-09-10T22:36:22.667 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:22.664+0000 7ff257fc7740 1 -- 172.21.15.19:0/967024300 wait complete. 2024-09-10T22:36:22.667 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:22.665+0000 7ff257fc7740 1 -- start start 2024-09-10T22:36:22.667 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:22.665+0000 7ff257fc7740 1 Processor -- start 2024-09-10T22:36:22.668 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:22.666+0000 7ff257fc7740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x562d27be44d0 0x562d27bf0500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:36:22.668 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:22.666+0000 7ff257fc7740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x562d27be4df0 0x562d27bed950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:36:22.668 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:22.666+0000 7ff257fc7740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562d27bf0d80 0x562d27bede90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:36:22.668 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:22.666+0000 7ff257fc7740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x562d279ab700 con 0x562d27be4df0 2024-09-10T22:36:22.668 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:22.666+0000 7ff257fc7740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x562d27ae5160 con 0x562d27bf0d80 2024-09-10T22:36:22.668 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:22.666+0000 7ff257fc7740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x562d27c049f0 con 0x562d27be44d0 2024-09-10T22:36:22.668 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:22.666+0000 7ff257fc7740 10 client.0 _ll_register_callbacks cb 0x562d27afe9e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T22:36:22.669 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:22.666+0000 7ff24effd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x562d27be4df0 0x562d27bed950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:36:22.669 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:22.666+0000 7ff24effd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x562d27be4df0 0x562d27bed950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:46884/0 (socket says 172.21.15.19:46884) 2024-09-10T22:36:22.669 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:22.666+0000 7ff24effd640 1 -- 172.21.15.19:0/778882503 learned_addr learned my addr 172.21.15.19:0/778882503 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:36:22.669 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:22.666+0000 7ff24effd640 1 -- 172.21.15.19:0/778882503 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x562d27be44d0 msgr2=0x562d27bf0500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:36:22.669 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:22.666+0000 7ff24effd640 1 --2- 172.21.15.19:0/778882503 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x562d27be44d0 0x562d27bf0500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:36:22.671 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:22.667+0000 7ff24effd640 1 -- 172.21.15.19:0/778882503 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562d27bf0d80 msgr2=0x562d27bede90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:36:22.671 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:22.667+0000 7ff24effd640 1 --2- 172.21.15.19:0/778882503 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562d27bf0d80 0x562d27bede90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:36:22.671 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:22.667+0000 7ff24effd640 1 -- 172.21.15.19:0/778882503 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562d27b12c90 con 0x562d27be4df0 2024-09-10T22:36:22.671 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:22.667+0000 7ff24effd640 1 --2- 172.21.15.19:0/778882503 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x562d27be4df0 0x562d27bed950 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 crypto rx=0x7ff24400b470 tx=0x7ff2440047d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=217978c0d5e80ec7 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:36:22.671 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:22.667+0000 7ff22effd640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-10T22:36:22.671 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:22.667+0000 7ff22effd640 1 -- 172.21.15.19:0/778882503 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2440ab7b0 con 0x562d27be4df0 2024-09-10T22:36:22.672 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:22.667+0000 7ff22effd640 1 -- 172.21.15.19:0/778882503 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8327+0+0 (secure 0 0 0) 0x7ff2440b48b0 con 0x562d27be4df0 2024-09-10T22:36:22.672 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:22.668+0000 7ff257fc7740 1 -- 172.21.15.19:0/778882503 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff248036040 con 0x562d27be4df0 2024-09-10T22:36:22.672 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:22.668+0000 7ff22effd640 1 -- 172.21.15.19:0/778882503 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7ff2440b0290 con 0x562d27be4df0 2024-09-10T22:36:22.672 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:22.668+0000 7ff257fc7740 10 client.17340 fetch_fsmap learned FSMap version 27 2024-09-10T22:36:22.672 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:22.668+0000 7ff257fc7740 1 -- 172.21.15.19:0/778882503 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x562d27c102e0 con 0x562d27be4df0 2024-09-10T22:36:22.672 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:22.668+0000 7ff22effd640 1 -- 172.21.15.19:0/778882503 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff248036040 con 0x562d27be4df0 2024-09-10T22:36:22.672 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:22.669+0000 7ff22effd640 1 -- 172.21.15.19:0/778882503 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7ff2440aaba0 con 0x562d27be4df0 2024-09-10T22:36:22.672 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:22.669+0000 7ff257fc7740 10 client.17340 fetch_fsmap finished waiting for FSMap version 27 2024-09-10T22:36:22.672 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:22.669+0000 7ff257fc7740 10 client.17340 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-10T22:36:22.672 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:22.669+0000 7ff257fc7740 20 client.17340 populate_metadata read hostname 'smithi019' 2024-09-10T22:36:22.672 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:22.669+0000 7ff257fc7740 1 --2- 172.21.15.19:0/778882503 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x562d27c11b90 0x562d27c13ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:36:22.672 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:22.669+0000 7ff257fc7740 4 client.17340 mds_command: new command op to 24581 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T22:36:22.673 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:22.669+0000 7ff257fc7740 1 -- 172.21.15.19:0/778882503 --> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562d27b5cdf0 con 0x562d27c11b90 2024-09-10T22:36:22.675 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:22.673+0000 7ff24f7fe640 1 --2- 172.21.15.19:0/778882503 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x562d27c11b90 0x562d27c13ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:36:22.678 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:22.677+0000 7ff22effd640 10 client.17340 ms_handle_connect on v2:172.21.15.135:6838/1254769802 2024-09-10T22:36:22.678 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:22.677+0000 7ff24f7fe640 1 --2- 172.21.15.19:0/778882503 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x562d27c11b90 0x562d27c13ff0 crc :-1 s=READY pgs=196 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=79b985021eb27f54 server_cookie=6529f565b6b58fda in_seq=0 out_seq=0 2024-09-10T22:36:22.687 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:22.685+0000 7ff22effd640 1 -- 172.21.15.19:0/778882503 <== mds.0 v2:172.21.15.135:6838/1254769802 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x562d27b5cdf0 con 0x562d27c11b90 2024-09-10T22:36:22.687 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:22.685+0000 7ff22effd640 10 client.17340 handle_command_reply: tid=0 2024-09-10T22:36:22.687 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:22.685+0000 7ff257fc7740 1 client.17340 shutdown 2024-09-10T22:36:22.687 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:22.685+0000 7ff257fc7740 1 -- 172.21.15.19:0/778882503 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x562d27be4df0 msgr2=0x562d27bed950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:36:22.688 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:22.685+0000 7ff257fc7740 1 --2- 172.21.15.19:0/778882503 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x562d27be4df0 0x562d27bed950 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 crypto rx=0x7ff24400b470 tx=0x7ff2440047d0 comp rx=0 tx=0).stop 2024-09-10T22:36:22.688 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:22.685+0000 7ff257fc7740 1 -- 172.21.15.19:0/778882503 shutdown_connections 2024-09-10T22:36:22.688 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:22.685+0000 7ff257fc7740 1 --2- 172.21.15.19:0/778882503 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562d27bf0d80 0x562d27bede90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:36:22.688 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:22.685+0000 7ff257fc7740 1 --2- 172.21.15.19:0/778882503 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x562d27be4df0 0x562d27bed950 unknown :-1 s=CLOSED pgs=809 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:36:22.688 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:22.685+0000 7ff257fc7740 1 --2- 172.21.15.19:0/778882503 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x562d27c11b90 0x562d27c13ff0 crc :-1 s=READY pgs=196 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:36:22.688 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:22.685+0000 7ff257fc7740 1 --2- 172.21.15.19:0/778882503 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x562d27be44d0 0x562d27bf0500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:36:22.688 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:22.685+0000 7ff22effd640 0 client.17340 ms_handle_reset on v2:172.21.15.135:6838/1254769802 2024-09-10T22:36:22.688 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:22.685+0000 7ff257fc7740 1 -- 172.21.15.19:0/778882503 >> 172.21.15.19:0/778882503 conn(0x562d27be2300 msgr2=0x562d27be7e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:36:22.688 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:22.685+0000 7ff257fc7740 1 -- 172.21.15.19:0/778882503 shutdown_connections 2024-09-10T22:36:22.688 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:22.685+0000 7ff257fc7740 1 -- 172.21.15.19:0/778882503 wait complete. 2024-09-10T22:36:22.688 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:22.686+0000 7ff257fc7740 20 client.17340 trim_cache size 0 max 16384 2024-09-10T22:36:22.705 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:22.703+0000 7ff257fc7740 1 Processor -- start 2024-09-10T22:36:22.705 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:22.703+0000 7ff257fc7740 1 -- start start 2024-09-10T22:36:22.705 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:22.703+0000 7ff257fc7740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x562d27be44d0 0x562d27be3b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:36:22.707 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:22.704+0000 7ff257fc7740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x562d27be4df0 0x562d27bed700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:36:22.707 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:22.704+0000 7ff24f7fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x562d27be44d0 0x562d27be3b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:36:22.707 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:22.704+0000 7ff24f7fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x562d27be44d0 0x562d27be3b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:46886/0 (socket says 172.21.15.19:46886) 2024-09-10T22:36:22.707 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:22.704+0000 7ff24f7fe640 1 -- 172.21.15.19:0/2405564561 learned_addr learned my addr 172.21.15.19:0/2405564561 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:36:22.707 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:22.704+0000 7ff257fc7740 1 --2- 172.21.15.19:0/2405564561 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562d27bf0d80 0x562d27bedc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:36:22.707 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:22.704+0000 7ff257fc7740 1 -- 172.21.15.19:0/2405564561 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7ff23c010e10 con 0x562d27be44d0 2024-09-10T22:36:22.707 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:22.704+0000 7ff257fc7740 1 -- 172.21.15.19:0/2405564561 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7ff23c00e6e0 con 0x562d27bf0d80 2024-09-10T22:36:22.707 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:22.704+0000 7ff257fc7740 1 -- 172.21.15.19:0/2405564561 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7ff23c00c530 con 0x562d27be4df0 2024-09-10T22:36:22.707 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:22.704+0000 7ff24f7fe640 1 -- 172.21.15.19:0/2405564561 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x562d27be4df0 msgr2=0x562d27bed700 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-10T22:36:22.707 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:22.704+0000 7ff24f7fe640 1 --2- 172.21.15.19:0/2405564561 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x562d27be4df0 0x562d27bed700 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:36:22.707 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:22.704+0000 7ff24f7fe640 1 -- 172.21.15.19:0/2405564561 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562d27bf0d80 msgr2=0x562d27bedc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:36:22.708 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:22.704+0000 7ff24f7fe640 1 --2- 172.21.15.19:0/2405564561 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562d27bf0d80 0x562d27bedc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:36:22.708 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:22.704+0000 7ff24f7fe640 1 -- 172.21.15.19:0/2405564561 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562d27c14670 con 0x562d27be44d0 2024-09-10T22:36:22.708 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:22.705+0000 7ff24f7fe640 1 --2- 172.21.15.19:0/2405564561 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x562d27be44d0 0x562d27be3b40 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 crypto rx=0x7ff2400099b0 tx=0x7ff240015780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=49da9cbc3766d4b2 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:36:22.708 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:22.705+0000 7ff2357fa640 1 -- 172.21.15.19:0/2405564561 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff240020070 con 0x562d27be44d0 2024-09-10T22:36:22.708 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:22.705+0000 7ff2357fa640 1 -- 172.21.15.19:0/2405564561 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff240009c40 con 0x562d27be44d0 2024-09-10T22:36:22.708 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:22.705+0000 7ff2357fa640 1 -- 172.21.15.19:0/2405564561 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff24001c660 con 0x562d27be44d0 2024-09-10T22:36:22.709 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:22.706+0000 7ff257fc7740 1 -- 172.21.15.19:0/2405564561 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x562d27be44d0 msgr2=0x562d27be3b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:36:22.709 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:22.706+0000 7ff257fc7740 1 --2- 172.21.15.19:0/2405564561 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x562d27be44d0 0x562d27be3b40 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 crypto rx=0x7ff2400099b0 tx=0x7ff240015780 comp rx=0 tx=0).stop 2024-09-10T22:36:22.709 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:22.706+0000 7ff257fc7740 1 -- 172.21.15.19:0/2405564561 shutdown_connections 2024-09-10T22:36:22.709 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:22.706+0000 7ff257fc7740 1 --2- 172.21.15.19:0/2405564561 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562d27bf0d80 0x562d27bedc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:36:22.709 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:22.706+0000 7ff257fc7740 1 --2- 172.21.15.19:0/2405564561 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x562d27be4df0 0x562d27bed700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:36:22.709 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:22.706+0000 7ff257fc7740 1 --2- 172.21.15.19:0/2405564561 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x562d27be44d0 0x562d27be3b40 unknown :-1 s=CLOSED pgs=810 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:36:22.709 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:22.707+0000 7ff257fc7740 1 -- 172.21.15.19:0/2405564561 >> 172.21.15.19:0/2405564561 conn(0x562d27be2300 msgr2=0x562d27be3430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:36:22.709 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:22.707+0000 7ff257fc7740 1 -- 172.21.15.19:0/2405564561 shutdown_connections 2024-09-10T22:36:22.710 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:22.707+0000 7ff257fc7740 1 -- 172.21.15.19:0/2405564561 wait complete. 2024-09-10T22:36:22.710 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:22.708+0000 7ff257fc7740 1 -- start start 2024-09-10T22:36:22.713 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:22.708+0000 7ff257fc7740 1 Processor -- start 2024-09-10T22:36:22.713 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:22.708+0000 7ff257fc7740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x562d27be44d0 0x562d27c064b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:36:22.713 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:22.708+0000 7ff257fc7740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x562d27be4df0 0x562d27c06a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:36:22.713 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:22.708+0000 7ff257fc7740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562d27bf0d80 0x562d27c7db00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:36:22.713 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:22.708+0000 7ff257fc7740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7ff23c00cba0 con 0x562d27be44d0 2024-09-10T22:36:22.714 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:22.708+0000 7ff257fc7740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7ff23c00e010 con 0x562d27bf0d80 2024-09-10T22:36:22.714 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:22.708+0000 7ff257fc7740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7ff23c00d270 con 0x562d27be4df0 2024-09-10T22:36:22.714 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:22.708+0000 7ff257fc7740 10 client.0 _ll_register_callbacks cb 0x7ff2440ab100 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T22:36:22.714 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:22.708+0000 7ff24f7fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x562d27be44d0 0x562d27c064b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:36:22.714 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:22.708+0000 7ff24f7fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x562d27be44d0 0x562d27c064b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:46890/0 (socket says 172.21.15.19:46890) 2024-09-10T22:36:22.714 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:22.708+0000 7ff24f7fe640 1 -- 172.21.15.19:0/1426247021 learned_addr learned my addr 172.21.15.19:0/1426247021 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:36:22.714 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:22.709+0000 7ff24effd640 1 --2- 172.21.15.19:0/1426247021 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x562d27be4df0 0x562d27c06a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:36:22.714 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:22.709+0000 7ff24ffff640 1 --2- 172.21.15.19:0/1426247021 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562d27bf0d80 0x562d27c7db00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:36:22.714 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:22.709+0000 7ff24f7fe640 1 -- 172.21.15.19:0/1426247021 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x562d27be4df0 msgr2=0x562d27c06a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:36:22.714 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:22.709+0000 7ff24f7fe640 1 --2- 172.21.15.19:0/1426247021 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x562d27be4df0 0x562d27c06a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:36:22.715 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:22.709+0000 7ff24f7fe640 1 -- 172.21.15.19:0/1426247021 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562d27bf0d80 msgr2=0x562d27c7db00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:36:22.715 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:22.709+0000 7ff24f7fe640 1 --2- 172.21.15.19:0/1426247021 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562d27bf0d80 0x562d27c7db00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:36:22.715 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:22.709+0000 7ff24f7fe640 1 -- 172.21.15.19:0/1426247021 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562d27c7e240 con 0x562d27be44d0 2024-09-10T22:36:22.715 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:22.709+0000 7ff24f7fe640 1 --2- 172.21.15.19:0/1426247021 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x562d27be44d0 0x562d27c064b0 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 crypto rx=0x7ff240009140 tx=0x7ff240005ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b2833aaec0f947e3 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:36:22.715 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:22.709+0000 7ff22effd640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-10T22:36:22.715 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:22.709+0000 7ff22effd640 1 -- 172.21.15.19:0/1426247021 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff240029020 con 0x562d27be44d0 2024-09-10T22:36:22.715 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:22.709+0000 7ff22effd640 1 -- 172.21.15.19:0/1426247021 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8327+0+0 (secure 0 0 0) 0x7ff240016620 con 0x562d27be44d0 2024-09-10T22:36:22.715 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:22.709+0000 7ff257fc7740 1 -- 172.21.15.19:0/1426247021 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff240009c40 con 0x562d27be44d0 2024-09-10T22:36:22.715 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:22.710+0000 7ff22effd640 1 -- 172.21.15.19:0/1426247021 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7ff240034050 con 0x562d27be44d0 2024-09-10T22:36:22.715 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:22.710+0000 7ff257fc7740 10 client.17346 fetch_fsmap learned FSMap version 27 2024-09-10T22:36:22.715 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:22.710+0000 7ff257fc7740 1 -- 172.21.15.19:0/1426247021 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x562d27c7f540 con 0x562d27be44d0 2024-09-10T22:36:22.715 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:22.710+0000 7ff22effd640 1 -- 172.21.15.19:0/1426247021 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff240009c40 con 0x562d27be44d0 2024-09-10T22:36:22.715 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:22.710+0000 7ff22effd640 1 -- 172.21.15.19:0/1426247021 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7ff24001b040 con 0x562d27be44d0 2024-09-10T22:36:22.716 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:22.710+0000 7ff257fc7740 10 client.17346 fetch_fsmap finished waiting for FSMap version 27 2024-09-10T22:36:22.716 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:22.710+0000 7ff257fc7740 10 client.17346 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-10T22:36:22.716 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:22.710+0000 7ff257fc7740 20 client.17346 populate_metadata read hostname 'smithi019' 2024-09-10T22:36:22.716 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:22.710+0000 7ff257fc7740 1 --2- 172.21.15.19:0/1426247021 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x562d27c7fc30 0x562d27c82050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:36:22.716 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:22.710+0000 7ff257fc7740 4 client.17346 mds_command: new command op to 24581 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-10T22:36:22.716 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:22.710+0000 7ff257fc7740 1 -- 172.21.15.19:0/1426247021 --> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] -- command(tid 0: {"prefix": "damage ls"}) -- 0x562d27b588a0 con 0x562d27c7fc30 2024-09-10T22:36:22.716 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:22.710+0000 7ff24effd640 1 --2- 172.21.15.19:0/1426247021 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x562d27c7fc30 0x562d27c82050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:36:22.716 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:22.711+0000 7ff22effd640 10 client.17346 ms_handle_connect on v2:172.21.15.135:6838/1254769802 2024-09-10T22:36:22.716 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:22.711+0000 7ff24effd640 1 --2- 172.21.15.19:0/1426247021 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x562d27c7fc30 0x562d27c82050 crc :-1 s=READY pgs=197 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=dd987b781545ce20 server_cookie=eb3b87c7f5b45b3d in_seq=0 out_seq=0 2024-09-10T22:36:22.716 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:22.711+0000 7ff22effd640 1 -- 172.21.15.19:0/1426247021 <== mds.0 v2:172.21.15.135:6838/1254769802 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x562d27b588a0 con 0x562d27c7fc30 2024-09-10T22:36:22.716 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:22.711+0000 7ff22effd640 10 client.17346 handle_command_reply: tid=0 2024-09-10T22:36:22.716 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:22.711+0000 7ff257fc7740 1 client.17346 shutdown 2024-09-10T22:36:22.716 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:22.711+0000 7ff257fc7740 1 -- 172.21.15.19:0/1426247021 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x562d27be44d0 msgr2=0x562d27c064b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:36:22.717 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:22.711+0000 7ff257fc7740 1 --2- 172.21.15.19:0/1426247021 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x562d27be44d0 0x562d27c064b0 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 crypto rx=0x7ff240009140 tx=0x7ff240005ba0 comp rx=0 tx=0).stop 2024-09-10T22:36:22.717 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:22.711+0000 7ff257fc7740 1 -- 172.21.15.19:0/1426247021 shutdown_connections 2024-09-10T22:36:22.717 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:22.711+0000 7ff257fc7740 1 --2- 172.21.15.19:0/1426247021 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562d27bf0d80 0x562d27c7db00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:36:22.717 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:22.711+0000 7ff257fc7740 1 --2- 172.21.15.19:0/1426247021 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x562d27c7fc30 0x562d27c82050 crc :-1 s=READY pgs=197 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:36:22.717 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:22.711+0000 7ff257fc7740 1 --2- 172.21.15.19:0/1426247021 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x562d27be4df0 0x562d27c06a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:36:22.717 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:22.711+0000 7ff257fc7740 1 --2- 172.21.15.19:0/1426247021 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x562d27be44d0 0x562d27c064b0 unknown :-1 s=CLOSED pgs=811 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:36:22.717 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:22.711+0000 7ff257fc7740 1 -- 172.21.15.19:0/1426247021 >> 172.21.15.19:0/1426247021 conn(0x562d27be2300 msgr2=0x562d27bed700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:36:22.717 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:22.711+0000 7ff22effd640 0 client.17346 ms_handle_reset on v2:172.21.15.135:6838/1254769802 2024-09-10T22:36:22.717 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:22.711+0000 7ff257fc7740 1 -- 172.21.15.19:0/1426247021 shutdown_connections 2024-09-10T22:36:22.718 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:22.711+0000 7ff257fc7740 1 -- 172.21.15.19:0/1426247021 wait complete. 2024-09-10T22:36:22.718 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:22.711+0000 7ff257fc7740 20 client.17346 trim_cache size 0 max 16384 2024-09-10T22:36:22.718 INFO:teuthology.orchestra.run.smithi019.stdout:[] 2024-09-10T22:36:22.719 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:22.712+0000 7ff255bf2640 1 -- 172.21.15.19:0/1180138688 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7ff2380b5360 msgr2=0x7ff2380b7820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:36:22.719 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:22.712+0000 7ff255bf2640 1 --2- 172.21.15.19:0/1180138688 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7ff2380b5360 0x7ff2380b7820 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7ff24802f4a0 tx=0x7ff24803c040 comp rx=0 tx=0).stop 2024-09-10T22:36:22.719 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:22.712+0000 7ff255bf2640 1 -- 172.21.15.19:0/1180138688 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff2501076a0 msgr2=0x7ff250199950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:36:22.719 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:22.712+0000 7ff255bf2640 1 --2- 172.21.15.19:0/1180138688 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff2501076a0 0x7ff250199950 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 crypto rx=0x7ff24400b4a0 tx=0x7ff24400b960 comp rx=0 tx=0).stop 2024-09-10T22:36:22.720 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:22.712+0000 7ff255bf2640 1 -- 172.21.15.19:0/1180138688 shutdown_connections 2024-09-10T22:36:22.720 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:22.712+0000 7ff255bf2640 1 --2- 172.21.15.19:0/1180138688 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7ff2380b5360 0x7ff2380b7820 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:36:22.720 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:22.712+0000 7ff255bf2640 1 --2- 172.21.15.19:0/1180138688 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff250108020 0x7ff25019ecf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:36:22.720 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:22.712+0000 7ff255bf2640 1 --2- 172.21.15.19:0/1180138688 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff2501076a0 0x7ff250199950 unknown :-1 s=CLOSED pgs=807 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:36:22.720 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:22.712+0000 7ff255bf2640 1 --2- 172.21.15.19:0/1180138688 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff250101c90 0x7ff250199410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:36:22.720 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:22.712+0000 7ff255bf2640 1 -- 172.21.15.19:0/1180138688 >> 172.21.15.19:0/1180138688 conn(0x7ff2500fd700 msgr2=0x7ff25006adf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:36:22.720 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:22.712+0000 7ff255bf2640 1 -- 172.21.15.19:0/1180138688 shutdown_connections 2024-09-10T22:36:22.720 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:22.712+0000 7ff255bf2640 1 -- 172.21.15.19:0/1180138688 wait complete. 2024-09-10T22:36:23.263 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:23.258+0000 7f6111a7f640 1 -- 172.21.15.19:0/803336565 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f610c103380 msgr2=0x7f610c109d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:36:23.263 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:23.258+0000 7f6111a7f640 1 --2- 172.21.15.19:0/803336565 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f610c103380 0x7f610c109d00 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 crypto rx=0x7f6104009cd0 tx=0x7f610402a8e0 comp rx=0 tx=0).stop 2024-09-10T22:36:23.263 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:23.258+0000 7f6111a7f640 1 -- 172.21.15.19:0/803336565 shutdown_connections 2024-09-10T22:36:23.264 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:23.258+0000 7f6111a7f640 1 --2- 172.21.15.19:0/803336565 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f610c103380 0x7f610c109d00 unknown :-1 s=CLOSED pgs=812 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:36:23.264 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:23.258+0000 7f6111a7f640 1 --2- 172.21.15.19:0/803336565 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f610c1029c0 0x7f610c102e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:36:23.264 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:23.258+0000 7f6111a7f640 1 --2- 172.21.15.19:0/803336565 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f610c101870 0x7f610c101c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:36:23.264 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:23.258+0000 7f6111a7f640 1 -- 172.21.15.19:0/803336565 >> 172.21.15.19:0/803336565 conn(0x7f610c0fd150 msgr2=0x7f610c0ff570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:36:23.264 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:23.258+0000 7f6111a7f640 1 -- 172.21.15.19:0/803336565 shutdown_connections 2024-09-10T22:36:23.265 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:23.258+0000 7f6111a7f640 1 -- 172.21.15.19:0/803336565 wait complete. 2024-09-10T22:36:23.265 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:23.258+0000 7f6111a7f640 1 Processor -- start 2024-09-10T22:36:23.265 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:23.259+0000 7f6111a7f640 1 -- start start 2024-09-10T22:36:23.265 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:23.259+0000 7f6111a7f640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f610c101870 0x7f610c198d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:36:23.265 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:23.259+0000 7f6111a7f640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f610c1029c0 0x7f610c199370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:36:23.265 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:23.259+0000 7f6111a7f640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f610c103380 0x7f610c199fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:36:23.265 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:23.259+0000 7f6111a7f640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f610c10d510 con 0x7f610c103380 2024-09-10T22:36:23.265 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:23.259+0000 7f6111a7f640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f610c10d390 con 0x7f610c1029c0 2024-09-10T22:36:23.265 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:23.259+0000 7f6111a7f640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f610c10d690 con 0x7f610c101870 2024-09-10T22:36:23.266 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:23.259+0000 7f610bfff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f610c103380 0x7f610c199fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:36:23.266 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:23.259+0000 7f610bfff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f610c103380 0x7f610c199fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:46912/0 (socket says 172.21.15.19:46912) 2024-09-10T22:36:23.266 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:23.259+0000 7f610bfff640 1 -- 172.21.15.19:0/1061381595 learned_addr learned my addr 172.21.15.19:0/1061381595 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:36:23.266 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:23.259+0000 7f610affd640 1 --2- 172.21.15.19:0/1061381595 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f610c1029c0 0x7f610c199370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:36:23.266 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:23.259+0000 7f610b7fe640 1 --2- 172.21.15.19:0/1061381595 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f610c101870 0x7f610c198d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:36:23.266 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:23.259+0000 7f610bfff640 1 -- 172.21.15.19:0/1061381595 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f610c101870 msgr2=0x7f610c198d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:36:23.266 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:23.259+0000 7f610bfff640 1 --2- 172.21.15.19:0/1061381595 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f610c101870 0x7f610c198d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:36:23.266 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:23.260+0000 7f610bfff640 1 -- 172.21.15.19:0/1061381595 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f610c1029c0 msgr2=0x7f610c199370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:36:23.266 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:23.260+0000 7f610bfff640 1 --2- 172.21.15.19:0/1061381595 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f610c1029c0 0x7f610c199370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:36:23.267 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:23.260+0000 7f610bfff640 1 -- 172.21.15.19:0/1061381595 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f610c19a860 con 0x7f610c103380 2024-09-10T22:36:23.267 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:23.260+0000 7f610bfff640 1 --2- 172.21.15.19:0/1061381595 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f610c103380 0x7f610c199fa0 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 crypto rx=0x7f610402ae00 tx=0x7f6104003ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:36:23.267 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:23.260+0000 7f6108ff9640 1 -- 172.21.15.19:0/1061381595 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6104004040 con 0x7f610c103380 2024-09-10T22:36:23.267 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:23.260+0000 7f6111a7f640 1 -- 172.21.15.19:0/1061381595 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f610c19aaf0 con 0x7f610c103380 2024-09-10T22:36:23.267 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:23.260+0000 7f6108ff9640 1 -- 172.21.15.19:0/1061381595 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6104004690 con 0x7f610c103380 2024-09-10T22:36:23.267 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:23.260+0000 7f6108ff9640 1 -- 172.21.15.19:0/1061381595 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6104030de0 con 0x7f610c103380 2024-09-10T22:36:23.267 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:23.260+0000 7f6111a7f640 1 -- 172.21.15.19:0/1061381595 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f610c1a1220 con 0x7f610c103380 2024-09-10T22:36:23.274 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:23.263+0000 7f6108ff9640 1 -- 172.21.15.19:0/1061381595 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 18) ==== 153250+0+0 (secure 0 0 0) 0x7f6104030070 con 0x7f610c103380 2024-09-10T22:36:23.274 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:23.263+0000 7f611484f740 1 Processor -- start 2024-09-10T22:36:23.274 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:23.263+0000 7f611484f740 1 -- start start 2024-09-10T22:36:23.275 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:23.263+0000 7f611484f740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563d6929d860 0x563d6929fc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:36:23.275 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:23.263+0000 7f611484f740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x563d692a0190 0x563d692a2580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:36:23.275 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:23.263+0000 7f611484f740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x563d692a2bd0 0x563d692a5090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:36:23.275 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:23.263+0000 7f611484f740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x563d6920f6f0 con 0x563d692a0190 2024-09-10T22:36:23.275 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:23.263+0000 7f611484f740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x563d691feb20 con 0x563d6929d860 2024-09-10T22:36:23.275 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:23.263+0000 7f611484f740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x563d69202930 con 0x563d692a2bd0 2024-09-10T22:36:23.276 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:23.263+0000 7f610b7fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x563d692a0190 0x563d692a2580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:36:23.276 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:23.263+0000 7f610affd640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563d6929d860 0x563d6929fc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:36:23.276 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:23.263+0000 7f610b7fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x563d692a0190 0x563d692a2580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:46926/0 (socket says 172.21.15.19:46926) 2024-09-10T22:36:23.276 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:23.263+0000 7f610affd640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563d6929d860 0x563d6929fc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.19:49130/0 (socket says 172.21.15.19:49130) 2024-09-10T22:36:23.276 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:23.263+0000 7f610b7fe640 1 -- 172.21.15.19:0/4182478962 learned_addr learned my addr 172.21.15.19:0/4182478962 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:36:23.276 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:23.263+0000 7f610affd640 1 --2- 172.21.15.19:0/4182478962 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x563d692a2bd0 0x563d692a5090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:36:23.276 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:23.264+0000 7f610b7fe640 1 -- 172.21.15.19:0/4182478962 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x563d692a2bd0 msgr2=0x563d692a5090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:36:23.276 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:23.264+0000 7f610b7fe640 1 --2- 172.21.15.19:0/4182478962 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x563d692a2bd0 0x563d692a5090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:36:23.276 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:23.264+0000 7f610b7fe640 1 -- 172.21.15.19:0/4182478962 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563d6929d860 msgr2=0x563d6929fc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:36:23.276 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:23.264+0000 7f610b7fe640 1 --2- 172.21.15.19:0/4182478962 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563d6929d860 0x563d6929fc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:36:23.276 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:23.264+0000 7f610b7fe640 1 -- 172.21.15.19:0/4182478962 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563d691c4530 con 0x563d692a0190 2024-09-10T22:36:23.276 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:23.264+0000 7f610affd640 1 --2- 172.21.15.19:0/4182478962 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563d6929d860 0x563d6929fc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T22:36:23.277 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:23.264+0000 7f610b7fe640 1 --2- 172.21.15.19:0/4182478962 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x563d692a0190 0x563d692a2580 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 crypto rx=0x7f6100009cf0 tx=0x7f6100011810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8a119f616da94fda server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:36:23.277 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:23.264+0000 7f6108ff9640 1 --2- 172.21.15.19:0/1061381595 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f60f40b52e0 0x7f60f40b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:36:23.277 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:23.264+0000 7f60f1ffb640 1 -- 172.21.15.19:0/4182478962 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6100004230 con 0x563d692a0190 2024-09-10T22:36:23.277 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:23.264+0000 7f610affd640 1 --2- 172.21.15.19:0/1061381595 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f60f40b52e0 0x7f60f40b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:36:23.277 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:23.264+0000 7f60f1ffb640 1 -- 172.21.15.19:0/4182478962 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f61000043d0 con 0x563d692a0190 2024-09-10T22:36:23.277 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:23.264+0000 7f60f1ffb640 1 -- 172.21.15.19:0/4182478962 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61000197c0 con 0x563d692a0190 2024-09-10T22:36:23.277 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:23.264+0000 7f6108ff9640 1 -- 172.21.15.19:0/1061381595 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8327+0+0 (secure 0 0 0) 0x7f610402e030 con 0x7f610c103380 2024-09-10T22:36:23.277 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:23.265+0000 7f611484f740 1 -- 172.21.15.19:0/4182478962 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x563d692a0190 msgr2=0x563d692a2580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:36:23.277 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:23.265+0000 7f610affd640 1 --2- 172.21.15.19:0/1061381595 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f60f40b52e0 0x7f60f40b77a0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f60fc009fd0 tx=0x7f60fc0096c0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:36:23.277 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:23.265+0000 7f611484f740 1 --2- 172.21.15.19:0/4182478962 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x563d692a0190 0x563d692a2580 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 crypto rx=0x7f6100009cf0 tx=0x7f6100011810 comp rx=0 tx=0).stop 2024-09-10T22:36:23.277 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:23.265+0000 7f611484f740 1 -- 172.21.15.19:0/4182478962 shutdown_connections 2024-09-10T22:36:23.277 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:23.265+0000 7f611484f740 1 --2- 172.21.15.19:0/4182478962 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x563d692a2bd0 0x563d692a5090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:36:23.278 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:23.265+0000 7f611484f740 1 --2- 172.21.15.19:0/4182478962 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x563d692a0190 0x563d692a2580 unknown :-1 s=CLOSED pgs=814 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:36:23.278 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:23.265+0000 7f611484f740 1 --2- 172.21.15.19:0/4182478962 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563d6929d860 0x563d6929fc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:36:23.278 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:23.265+0000 7f611484f740 1 -- 172.21.15.19:0/4182478962 >> 172.21.15.19:0/4182478962 conn(0x563d692989b0 msgr2=0x563d69299740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:36:23.278 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:23.265+0000 7f611484f740 1 -- 172.21.15.19:0/4182478962 shutdown_connections 2024-09-10T22:36:23.278 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:23.265+0000 7f611484f740 1 -- 172.21.15.19:0/4182478962 wait complete. 2024-09-10T22:36:23.278 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:23.265+0000 7f611484f740 1 -- start start 2024-09-10T22:36:23.278 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:23.266+0000 7f611484f740 1 Processor -- start 2024-09-10T22:36:23.278 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:23.266+0000 7f611484f740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x563d6929d860 0x563d692a6ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:36:23.278 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:23.266+0000 7f611484f740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563d692a0190 0x563d692a7590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:36:23.278 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:23.266+0000 7f611484f740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x563d692a2bd0 0x563d692a8160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:36:23.278 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:23.266+0000 7f611484f740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x563d69136ab0 con 0x563d692a2bd0 2024-09-10T22:36:23.278 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:23.266+0000 7f611484f740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x563d691a4730 con 0x563d692a0190 2024-09-10T22:36:23.278 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:23.266+0000 7f611484f740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x563d692a5bb0 con 0x563d6929d860 2024-09-10T22:36:23.278 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:23.266+0000 7f611484f740 10 client.0 _ll_register_callbacks cb 0x563d691f86b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T22:36:23.279 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:23.266+0000 7f610b7fe640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x563d6929d860 0x563d692a6ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:36:23.279 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:23.266+0000 7f610bfff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x563d692a2bd0 0x563d692a8160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:36:23.279 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:23.266+0000 7f610b7fe640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x563d6929d860 0x563d692a6ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.19:55358/0 (socket says 172.21.15.19:55358) 2024-09-10T22:36:23.279 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:23.266+0000 7f610b7fe640 1 -- 172.21.15.19:0/3411694971 learned_addr learned my addr 172.21.15.19:0/3411694971 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:36:23.279 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:23.266+0000 7f610affd640 1 --2- 172.21.15.19:0/3411694971 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563d692a0190 0x563d692a7590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:36:23.279 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:23.266+0000 7f610b7fe640 1 -- 172.21.15.19:0/3411694971 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563d692a0190 msgr2=0x563d692a7590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:36:23.279 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:23.266+0000 7f610b7fe640 1 --2- 172.21.15.19:0/3411694971 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563d692a0190 0x563d692a7590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:36:23.279 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:23.266+0000 7f610b7fe640 1 -- 172.21.15.19:0/3411694971 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x563d692a2bd0 msgr2=0x563d692a8160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:36:23.279 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:23.266+0000 7f610b7fe640 1 --2- 172.21.15.19:0/3411694971 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x563d692a2bd0 0x563d692a8160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:36:23.280 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:23.266+0000 7f610b7fe640 1 -- 172.21.15.19:0/3411694971 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563d68f60790 con 0x563d6929d860 2024-09-10T22:36:23.280 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:23.267+0000 7f610b7fe640 1 --2- 172.21.15.19:0/3411694971 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x563d6929d860 0x563d692a6ef0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f610001b040 tx=0x7f61000038a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4619c894f5198893 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:36:23.280 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:23.267+0000 7f60eaffd640 10 client.0 ms_handle_connect on v2:172.21.15.138:3300/0 2024-09-10T22:36:23.280 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:23.267+0000 7f60eaffd640 1 -- 172.21.15.19:0/3411694971 <== mon.1 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6100027070 con 0x563d6929d860 2024-09-10T22:36:23.280 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:23.267+0000 7f60eaffd640 1 -- 172.21.15.19:0/3411694971 <== mon.1 v2:172.21.15.138:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8327+0+0 (secure 0 0 0) 0x7f6100005240 con 0x563d6929d860 2024-09-10T22:36:23.280 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:23.267+0000 7f611484f740 1 -- 172.21.15.19:0/3411694971 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f61000043d0 con 0x563d6929d860 2024-09-10T22:36:23.280 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:23.267+0000 7f60eaffd640 1 -- 172.21.15.19:0/3411694971 <== mon.1 v2:172.21.15.138:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f6100033050 con 0x563d6929d860 2024-09-10T22:36:23.280 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:23.267+0000 7f611484f740 10 client.26701 fetch_fsmap learned FSMap version 27 2024-09-10T22:36:23.280 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:23.267+0000 7f611484f740 1 -- 172.21.15.19:0/3411694971 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x563d68fd9620 con 0x563d6929d860 2024-09-10T22:36:23.281 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:23.267+0000 7f60eaffd640 1 -- 172.21.15.19:0/3411694971 <== mon.1 v2:172.21.15.138:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f61000043d0 con 0x563d6929d860 2024-09-10T22:36:23.281 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:23.268+0000 7f60eaffd640 1 -- 172.21.15.19:0/3411694971 <== mon.1 v2:172.21.15.138:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7f6100004c90 con 0x563d6929d860 2024-09-10T22:36:23.281 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:23.268+0000 7f611484f740 10 client.26701 fetch_fsmap finished waiting for FSMap version 27 2024-09-10T22:36:23.281 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:23.268+0000 7f611484f740 10 client.26701 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-10T22:36:23.281 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:23.268+0000 7f611484f740 20 client.26701 populate_metadata read hostname 'smithi019' 2024-09-10T22:36:23.281 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:23.268+0000 7f611484f740 1 --2- 172.21.15.19:0/3411694971 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x563d692b6980 0x563d692b8dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:36:23.281 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:23.268+0000 7f611484f740 4 client.26701 mds_command: new command op to 24581 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T22:36:23.281 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:23.268+0000 7f611484f740 1 -- 172.21.15.19:0/3411694971 --> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x563d69211640 con 0x563d692b6980 2024-09-10T22:36:23.281 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:23.268+0000 7f610affd640 1 --2- 172.21.15.19:0/3411694971 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x563d692b6980 0x563d692b8dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:36:23.281 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:23.268+0000 7f60eaffd640 10 client.26701 ms_handle_connect on v2:172.21.15.135:6838/1254769802 2024-09-10T22:36:23.282 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:23.268+0000 7f610affd640 1 --2- 172.21.15.19:0/3411694971 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x563d692b6980 0x563d692b8dd0 crc :-1 s=READY pgs=198 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4bd10369df2d9c4 server_cookie=fa58e1c8593eb063 in_seq=0 out_seq=0 2024-09-10T22:36:23.282 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:23.269+0000 7f60eaffd640 1 -- 172.21.15.19:0/3411694971 <== mds.0 v2:172.21.15.135:6838/1254769802 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x563d69211640 con 0x563d692b6980 2024-09-10T22:36:23.282 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:23.269+0000 7f60eaffd640 10 client.26701 handle_command_reply: tid=0 2024-09-10T22:36:23.282 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:23.269+0000 7f611484f740 1 client.26701 shutdown 2024-09-10T22:36:23.282 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:23.269+0000 7f611484f740 1 -- 172.21.15.19:0/3411694971 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x563d6929d860 msgr2=0x563d692a6ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:36:23.282 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:23.269+0000 7f611484f740 1 --2- 172.21.15.19:0/3411694971 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x563d6929d860 0x563d692a6ef0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f610001b040 tx=0x7f61000038a0 comp rx=0 tx=0).stop 2024-09-10T22:36:23.282 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:23.269+0000 7f611484f740 1 -- 172.21.15.19:0/3411694971 shutdown_connections 2024-09-10T22:36:23.282 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:23.269+0000 7f611484f740 1 --2- 172.21.15.19:0/3411694971 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x563d692a2bd0 0x563d692a8160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:36:23.282 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:23.269+0000 7f611484f740 1 --2- 172.21.15.19:0/3411694971 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563d692a0190 0x563d692a7590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:36:23.282 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:23.269+0000 7f611484f740 1 --2- 172.21.15.19:0/3411694971 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x563d692b6980 0x563d692b8dd0 crc :-1 s=READY pgs=198 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:36:23.282 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:23.269+0000 7f611484f740 1 --2- 172.21.15.19:0/3411694971 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x563d6929d860 0x563d692a6ef0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:36:23.282 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:23.269+0000 7f60eaffd640 0 client.26701 ms_handle_reset on v2:172.21.15.135:6838/1254769802 2024-09-10T22:36:23.282 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:23.269+0000 7f611484f740 1 -- 172.21.15.19:0/3411694971 >> 172.21.15.19:0/3411694971 conn(0x563d692989b0 msgr2=0x563d69297bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:36:23.282 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:23.269+0000 7f611484f740 1 -- 172.21.15.19:0/3411694971 shutdown_connections 2024-09-10T22:36:23.283 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:23.270+0000 7f611484f740 1 -- 172.21.15.19:0/3411694971 wait complete. 2024-09-10T22:36:23.283 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:23.270+0000 7f611484f740 20 client.26701 trim_cache size 0 max 16384 2024-09-10T22:36:23.291 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:23.289+0000 7f611484f740 1 Processor -- start 2024-09-10T22:36:23.292 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:23.289+0000 7f611484f740 1 -- start start 2024-09-10T22:36:23.292 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:23.289+0000 7f611484f740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x563d6929d860 0x563d69297ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:36:23.292 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:23.289+0000 7f611484f740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x563d692a0190 0x563d6929a7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:36:23.292 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:23.289+0000 7f611484f740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563d692a2bd0 0x563d6929ad20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:36:23.292 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:23.289+0000 7f611484f740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f610c1aa760 con 0x563d692a0190 2024-09-10T22:36:23.292 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:23.289+0000 7f611484f740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f610c1a8030 con 0x563d692a2bd0 2024-09-10T22:36:23.292 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:23.289+0000 7f611484f740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f610c1a5e80 con 0x563d6929d860 2024-09-10T22:36:23.292 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:23.289+0000 7f610affd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x563d692a0190 0x563d6929a7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:36:23.292 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:23.289+0000 7f610b7fe640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x563d6929d860 0x563d69297ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:36:23.292 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:23.289+0000 7f610b7fe640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x563d6929d860 0x563d69297ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.19:55366/0 (socket says 172.21.15.19:55366) 2024-09-10T22:36:23.292 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:23.289+0000 7f610affd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x563d692a0190 0x563d6929a7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:46942/0 (socket says 172.21.15.19:46942) 2024-09-10T22:36:23.292 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:23.289+0000 7f610b7fe640 1 -- 172.21.15.19:0/1559858414 learned_addr learned my addr 172.21.15.19:0/1559858414 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:36:23.293 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:23.289+0000 7f610bfff640 1 --2- 172.21.15.19:0/1559858414 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563d692a2bd0 0x563d6929ad20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:36:23.293 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:23.289+0000 7f610b7fe640 1 -- 172.21.15.19:0/1559858414 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563d692a2bd0 msgr2=0x563d6929ad20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:36:23.293 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:23.289+0000 7f610b7fe640 1 --2- 172.21.15.19:0/1559858414 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563d692a2bd0 0x563d6929ad20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:36:23.293 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:23.289+0000 7f610b7fe640 1 -- 172.21.15.19:0/1559858414 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x563d692a0190 msgr2=0x563d6929a7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:36:23.293 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:23.289+0000 7f610b7fe640 1 --2- 172.21.15.19:0/1559858414 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x563d692a0190 0x563d6929a7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:36:23.293 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:23.289+0000 7f610b7fe640 1 -- 172.21.15.19:0/1559858414 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563d692a84d0 con 0x563d6929d860 2024-09-10T22:36:23.293 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:23.289+0000 7f610affd640 1 --2- 172.21.15.19:0/1559858414 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x563d692a0190 0x563d6929a7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T22:36:23.293 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:23.290+0000 7f610b7fe640 1 --2- 172.21.15.19:0/1559858414 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x563d6929d860 0x563d69297ae0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f6100009250 tx=0x7f6100005f90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ce4c172b11dd1787 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:36:23.293 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:23.290+0000 7f60f17fa640 1 -- 172.21.15.19:0/1559858414 <== mon.1 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6100030020 con 0x563d6929d860 2024-09-10T22:36:23.293 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:23.290+0000 7f60f17fa640 1 -- 172.21.15.19:0/1559858414 <== mon.1 v2:172.21.15.138:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6100003910 con 0x563d6929d860 2024-09-10T22:36:23.294 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:23.290+0000 7f60f17fa640 1 -- 172.21.15.19:0/1559858414 <== mon.1 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6100027040 con 0x563d6929d860 2024-09-10T22:36:23.296 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:23.291+0000 7f611484f740 1 -- 172.21.15.19:0/1559858414 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x563d6929d860 msgr2=0x563d69297ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:36:23.296 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:23.291+0000 7f611484f740 1 --2- 172.21.15.19:0/1559858414 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x563d6929d860 0x563d69297ae0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f6100009250 tx=0x7f6100005f90 comp rx=0 tx=0).stop 2024-09-10T22:36:23.296 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:23.291+0000 7f611484f740 1 -- 172.21.15.19:0/1559858414 shutdown_connections 2024-09-10T22:36:23.297 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:23.291+0000 7f611484f740 1 --2- 172.21.15.19:0/1559858414 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563d692a2bd0 0x563d6929ad20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:36:23.297 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:23.291+0000 7f611484f740 1 --2- 172.21.15.19:0/1559858414 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x563d692a0190 0x563d6929a7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:36:23.297 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:23.291+0000 7f611484f740 1 --2- 172.21.15.19:0/1559858414 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x563d6929d860 0x563d69297ae0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:36:23.297 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:23.291+0000 7f611484f740 1 -- 172.21.15.19:0/1559858414 >> 172.21.15.19:0/1559858414 conn(0x563d692989b0 msgr2=0x563d692973d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:36:23.297 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:23.291+0000 7f611484f740 1 -- 172.21.15.19:0/1559858414 shutdown_connections 2024-09-10T22:36:23.297 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:23.291+0000 7f611484f740 1 -- 172.21.15.19:0/1559858414 wait complete. 2024-09-10T22:36:23.297 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:23.291+0000 7f611484f740 1 -- start start 2024-09-10T22:36:23.297 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:23.291+0000 7f611484f740 1 Processor -- start 2024-09-10T22:36:23.297 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:23.292+0000 7f611484f740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x563d6929d860 0x563d692ae970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:36:23.297 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:23.292+0000 7f611484f740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x563d692a0190 0x563d692ad670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:36:23.297 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:23.292+0000 7f611484f740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563d692a2bd0 0x563d692adbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:36:23.297 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:23.292+0000 7f611484f740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f610c1a64f0 con 0x563d6929d860 2024-09-10T22:36:23.298 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:23.292+0000 7f611484f740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f610c1a7960 con 0x563d692a2bd0 2024-09-10T22:36:23.298 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:23.292+0000 7f611484f740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f610c1a6bc0 con 0x563d692a0190 2024-09-10T22:36:23.298 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:23.292+0000 7f611484f740 10 client.0 _ll_register_callbacks cb 0x7f60fc009a10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T22:36:23.298 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:23.292+0000 7f610affd640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x563d692a0190 0x563d692ad670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:36:23.298 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:23.292+0000 7f610bfff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563d692a2bd0 0x563d692adbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:36:23.298 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:23.292+0000 7f610b7fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x563d6929d860 0x563d692ae970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:36:23.298 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:23.292+0000 7f610affd640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x563d692a0190 0x563d692ad670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.19:55380/0 (socket says 172.21.15.19:55380) 2024-09-10T22:36:23.298 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:23.292+0000 7f610bfff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563d692a2bd0 0x563d692adbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.19:49166/0 (socket says 172.21.15.19:49166) 2024-09-10T22:36:23.298 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:23.292+0000 7f610affd640 1 -- 172.21.15.19:0/2624842566 learned_addr learned my addr 172.21.15.19:0/2624842566 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:36:23.298 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:23.292+0000 7f610affd640 1 -- 172.21.15.19:0/2624842566 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563d692a2bd0 msgr2=0x563d692adbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:36:23.298 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:23.292+0000 7f610affd640 1 --2- 172.21.15.19:0/2624842566 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563d692a2bd0 0x563d692adbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:36:23.298 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:23.292+0000 7f610affd640 1 -- 172.21.15.19:0/2624842566 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x563d6929d860 msgr2=0x563d692ae970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:36:23.298 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:23.292+0000 7f610affd640 1 --2- 172.21.15.19:0/2624842566 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x563d6929d860 0x563d692ae970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:36:23.299 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:23.292+0000 7f610affd640 1 -- 172.21.15.19:0/2624842566 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563d692ae3e0 con 0x563d692a0190 2024-09-10T22:36:23.299 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:23.292+0000 7f610affd640 1 --2- 172.21.15.19:0/2624842566 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x563d692a0190 0x563d692ad670 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x563d692b9640 tx=0x7f60fc004730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=54e25ef3e007ac33 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:36:23.299 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:23.292+0000 7f60eaffd640 10 client.0 ms_handle_connect on v2:172.21.15.138:3300/0 2024-09-10T22:36:23.299 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:23.292+0000 7f60eaffd640 1 -- 172.21.15.19:0/2624842566 <== mon.1 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60fc011e50 con 0x563d692a0190 2024-09-10T22:36:23.299 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:23.293+0000 7f611484f740 1 -- 172.21.15.19:0/2624842566 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6100003910 con 0x563d692a0190 2024-09-10T22:36:23.299 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:23.293+0000 7f60eaffd640 1 -- 172.21.15.19:0/2624842566 <== mon.1 v2:172.21.15.138:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8327+0+0 (secure 0 0 0) 0x7f60fc01a070 con 0x563d692a0190 2024-09-10T22:36:23.299 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:23.293+0000 7f60eaffd640 1 -- 172.21.15.19:0/2624842566 <== mon.1 v2:172.21.15.138:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f60fc005020 con 0x563d692a0190 2024-09-10T22:36:23.299 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:23.293+0000 7f611484f740 10 client.26707 fetch_fsmap learned FSMap version 27 2024-09-10T22:36:23.299 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:23.293+0000 7f611484f740 1 -- 172.21.15.19:0/2624842566 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x563d693239d0 con 0x563d692a0190 2024-09-10T22:36:23.299 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:23.293+0000 7f60eaffd640 1 -- 172.21.15.19:0/2624842566 <== mon.1 v2:172.21.15.138:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6100003910 con 0x563d692a0190 2024-09-10T22:36:23.299 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:23.293+0000 7f60eaffd640 1 -- 172.21.15.19:0/2624842566 <== mon.1 v2:172.21.15.138:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7f60fc039020 con 0x563d692a0190 2024-09-10T22:36:23.299 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:23.293+0000 7f611484f740 10 client.26707 fetch_fsmap finished waiting for FSMap version 27 2024-09-10T22:36:23.299 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:23.293+0000 7f611484f740 10 client.26707 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-10T22:36:23.300 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:23.293+0000 7f611484f740 20 client.26707 populate_metadata read hostname 'smithi019' 2024-09-10T22:36:23.300 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:23.293+0000 7f611484f740 1 --2- 172.21.15.19:0/2624842566 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x563d693242b0 0x563d693266d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:36:23.300 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:23.293+0000 7f611484f740 4 client.26707 mds_command: new command op to 24581 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-10T22:36:23.300 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:23.293+0000 7f611484f740 1 -- 172.21.15.19:0/2624842566 --> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] -- command(tid 0: {"prefix": "flush journal"}) -- 0x563d6920d0f0 con 0x563d693242b0 2024-09-10T22:36:23.300 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:23.293+0000 7f610b7fe640 1 --2- 172.21.15.19:0/2624842566 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x563d693242b0 0x563d693266d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:36:23.300 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:23.294+0000 7f60eaffd640 10 client.26707 ms_handle_connect on v2:172.21.15.135:6838/1254769802 2024-09-10T22:36:23.300 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:23.294+0000 7f610b7fe640 1 --2- 172.21.15.19:0/2624842566 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x563d693242b0 0x563d693266d0 crc :-1 s=READY pgs=199 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2f7caebe8776b293 server_cookie=5479b619b35f4ec4 in_seq=0 out_seq=0 2024-09-10T22:36:24.361 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:36:24 smithi135 ceph-mon[34789]: pgmap v646: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 386 KiB/s rd, 223 MiB/s wr, 476 op/s 2024-09-10T22:36:24.375 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:36:24 smithi138 ceph-mon[35236]: pgmap v646: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 386 KiB/s rd, 223 MiB/s wr, 476 op/s 2024-09-10T22:36:24.458 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:36:24 smithi019 ceph-mon[31375]: pgmap v646: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 386 KiB/s rd, 223 MiB/s wr, 476 op/s 2024-09-10T22:36:25.020 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-10T22:36:25.020 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 22997a4c-6fc2-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-10T22:36:25.301 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/22997a4c-6fc2-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T22:36:26.312 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:26.219+0000 7fc8b503d640 1 -- 172.21.15.19:0/3818281237 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc8b0101810 msgr2=0x7fc8b0101bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:36:26.312 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:26.219+0000 7fc8b503d640 1 --2- 172.21.15.19:0/3818281237 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc8b0101810 0x7fc8b0101bf0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fc8a0009900 tx=0x7fc8a002a410 comp rx=0 tx=0).stop 2024-09-10T22:36:26.312 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:26.219+0000 7fc8b503d640 1 -- 172.21.15.19:0/3818281237 shutdown_connections 2024-09-10T22:36:26.312 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:26.219+0000 7fc8b503d640 1 --2- 172.21.15.19:0/3818281237 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc8b010d250 0x7fc8b010f640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:36:26.312 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:26.219+0000 7fc8b503d640 1 --2- 172.21.15.19:0/3818281237 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc8b010a920 0x7fc8b010cd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:36:26.312 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:26.219+0000 7fc8b503d640 1 --2- 172.21.15.19:0/3818281237 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc8b0101810 0x7fc8b0101bf0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:36:26.312 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:26.219+0000 7fc8b503d640 1 -- 172.21.15.19:0/3818281237 >> 172.21.15.19:0/3818281237 conn(0x7fc8b0076f50 msgr2=0x7fc8b0077360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:36:26.313 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:26.219+0000 7fc8b503d640 1 -- 172.21.15.19:0/3818281237 shutdown_connections 2024-09-10T22:36:26.313 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:26.219+0000 7fc8b503d640 1 -- 172.21.15.19:0/3818281237 wait complete. 2024-09-10T22:36:26.313 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:26.220+0000 7fc8b503d640 1 Processor -- start 2024-09-10T22:36:26.313 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:26.220+0000 7fc8b503d640 1 -- start start 2024-09-10T22:36:26.313 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:26.221+0000 7fc8b503d640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc8b0101810 0x7fc8b0199280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:36:26.313 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:26.221+0000 7fc8b503d640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc8b010a920 0x7fc8b01997c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:36:26.313 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:26.221+0000 7fc8b503d640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc8b010d250 0x7fc8b019eb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:36:26.313 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:26.221+0000 7fc8b503d640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fc8b0112d90 con 0x7fc8b010d250 2024-09-10T22:36:26.313 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:26.221+0000 7fc8b503d640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fc8b0112c10 con 0x7fc8b010a920 2024-09-10T22:36:26.313 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:26.221+0000 7fc8b503d640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7fc8b0112f10 con 0x7fc8b0101810 2024-09-10T22:36:26.313 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:26.221+0000 7fc8aed9d640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc8b0101810 0x7fc8b0199280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:36:26.314 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:26.221+0000 7fc8ae59c640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc8b010a920 0x7fc8b01997c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:36:26.314 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:26.221+0000 7fc8af59e640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc8b010d250 0x7fc8b019eb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:36:26.314 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:26.221+0000 7fc8aed9d640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc8b0101810 0x7fc8b0199280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.19:58646/0 (socket says 172.21.15.19:58646) 2024-09-10T22:36:26.314 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:26.221+0000 7fc8ae59c640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc8b010a920 0x7fc8b01997c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.19:53192/0 (socket says 172.21.15.19:53192) 2024-09-10T22:36:26.314 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:26.221+0000 7fc8aed9d640 1 -- 172.21.15.19:0/2202024950 learned_addr learned my addr 172.21.15.19:0/2202024950 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:36:26.314 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:26.221+0000 7fc8ae59c640 1 -- 172.21.15.19:0/2202024950 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc8b0101810 msgr2=0x7fc8b0199280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:36:26.314 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:26.221+0000 7fc8ae59c640 1 --2- 172.21.15.19:0/2202024950 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc8b0101810 0x7fc8b0199280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:36:26.314 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:26.221+0000 7fc8ae59c640 1 -- 172.21.15.19:0/2202024950 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc8b010d250 msgr2=0x7fc8b019eb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:36:26.314 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:26.221+0000 7fc8ae59c640 1 --2- 172.21.15.19:0/2202024950 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc8b010d250 0x7fc8b019eb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:36:26.315 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:26.221+0000 7fc8ae59c640 1 -- 172.21.15.19:0/2202024950 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc8b019f330 con 0x7fc8b010a920 2024-09-10T22:36:26.315 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:26.221+0000 7fc8af59e640 1 --2- 172.21.15.19:0/2202024950 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc8b010d250 0x7fc8b019eb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T22:36:26.315 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:26.222+0000 7fc8ae59c640 1 --2- 172.21.15.19:0/2202024950 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc8b010a920 0x7fc8b01997c0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fc8a400e9f0 tx=0x7fc8a400eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:36:26.315 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:26.222+0000 7fc897fff640 1 -- 172.21.15.19:0/2202024950 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8a400ccc0 con 0x7fc8b010a920 2024-09-10T22:36:26.315 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:26.222+0000 7fc897fff640 1 -- 172.21.15.19:0/2202024950 <== mon.2 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc8a4005020 con 0x7fc8b010a920 2024-09-10T22:36:26.315 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:26.222+0000 7fc8b503d640 1 -- 172.21.15.19:0/2202024950 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc8b019f620 con 0x7fc8b010a920 2024-09-10T22:36:26.315 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:26.222+0000 7fc897fff640 1 -- 172.21.15.19:0/2202024950 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8a4004a00 con 0x7fc8b010a920 2024-09-10T22:36:26.315 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:26.222+0000 7fc8b503d640 1 -- 172.21.15.19:0/2202024950 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc8b01a5ce0 con 0x7fc8b010a920 2024-09-10T22:36:26.315 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:26.225+0000 7fc8b7412740 1 Processor -- start 2024-09-10T22:36:26.315 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:26.225+0000 7fc8b7412740 1 -- start start 2024-09-10T22:36:26.315 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:26.225+0000 7fc8b7412740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55921d603ee0 0x55921d6042c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:36:26.315 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:26.225+0000 7fc897fff640 1 -- 172.21.15.19:0/2202024950 <== mon.2 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 18) ==== 153250+0+0 (secure 0 0 0) 0x7fc8a4004ba0 con 0x7fc8b010a920 2024-09-10T22:36:26.315 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:26.225+0000 7fc8b7412740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55921d604800 0x55921d610250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:36:26.315 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:26.225+0000 7fc8b7412740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55921d610790 0x55921d612b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:36:26.316 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:26.225+0000 7fc8b7412740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x55921d57ae60 con 0x55921d610790 2024-09-10T22:36:26.316 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:26.225+0000 7fc8b7412740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55921d56a290 con 0x55921d603ee0 2024-09-10T22:36:26.316 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:26.225+0000 7fc8b7412740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x55921d56e0a0 con 0x55921d604800 2024-09-10T22:36:26.316 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:26.226+0000 7fc8ae59c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55921d610790 0x55921d612b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:36:26.316 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:26.226+0000 7fc8aed9d640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55921d604800 0x55921d610250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:36:26.316 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:26.226+0000 7fc8ae59c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55921d610790 0x55921d612b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:43304/0 (socket says 172.21.15.19:43304) 2024-09-10T22:36:26.316 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:26.226+0000 7fc8ae59c640 1 -- 172.21.15.19:0/3331172067 learned_addr learned my addr 172.21.15.19:0/3331172067 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:36:26.316 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:26.226+0000 7fc8af59e640 1 --2- 172.21.15.19:0/3331172067 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55921d603ee0 0x55921d6042c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:36:26.316 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:26.226+0000 7fc8aed9d640 1 -- 172.21.15.19:0/3331172067 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55921d603ee0 msgr2=0x55921d6042c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:36:26.316 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:26.226+0000 7fc8aed9d640 1 --2- 172.21.15.19:0/3331172067 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55921d603ee0 0x55921d6042c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:36:26.316 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:26.226+0000 7fc8aed9d640 1 -- 172.21.15.19:0/3331172067 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55921d610790 msgr2=0x55921d612b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:36:26.316 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:26.226+0000 7fc8aed9d640 1 --2- 172.21.15.19:0/3331172067 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55921d610790 0x55921d612b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:36:26.316 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:26.226+0000 7fc8aed9d640 1 -- 172.21.15.19:0/3331172067 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55921d2c8930 con 0x55921d604800 2024-09-10T22:36:26.317 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:26.226+0000 7fc8aed9d640 1 --2- 172.21.15.19:0/3331172067 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55921d604800 0x55921d610250 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fc8a0004770 tx=0x7fc8a0031b10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=74460e82f5aefa61 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:36:26.317 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:26.226+0000 7fc897fff640 1 --2- 172.21.15.19:0/2202024950 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7fc8980b5360 0x7fc8980b7820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:36:26.317 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:26.226+0000 7fc8957fa640 1 -- 172.21.15.19:0/3331172067 <== mon.1 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8a0035040 con 0x55921d604800 2024-09-10T22:36:26.317 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:26.226+0000 7fc8957fa640 1 -- 172.21.15.19:0/3331172067 <== mon.1 v2:172.21.15.138:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc8a0031760 con 0x55921d604800 2024-09-10T22:36:26.317 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:26.226+0000 7fc8957fa640 1 -- 172.21.15.19:0/3331172067 <== mon.1 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8a00047a0 con 0x55921d604800 2024-09-10T22:36:26.317 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:26.226+0000 7fc8af59e640 1 --2- 172.21.15.19:0/2202024950 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7fc8980b5360 0x7fc8980b7820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:36:26.317 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:26.227+0000 7fc897fff640 1 -- 172.21.15.19:0/2202024950 <== mon.2 v2:172.21.15.135:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8327+0+0 (secure 0 0 0) 0x7fc8a40e5b90 con 0x7fc8b010a920 2024-09-10T22:36:26.317 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:26.227+0000 7fc8af59e640 1 --2- 172.21.15.19:0/2202024950 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7fc8980b5360 0x7fc8980b7820 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7fc8a8009fd0 tx=0x7fc8a8009500 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:36:26.317 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:26.227+0000 7fc8b7412740 1 -- 172.21.15.19:0/3331172067 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55921d604800 msgr2=0x55921d610250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:36:26.317 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:26.227+0000 7fc8b7412740 1 --2- 172.21.15.19:0/3331172067 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55921d604800 0x55921d610250 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fc8a0004770 tx=0x7fc8a0031b10 comp rx=0 tx=0).stop 2024-09-10T22:36:26.317 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:26.228+0000 7fc8b7412740 1 -- 172.21.15.19:0/3331172067 shutdown_connections 2024-09-10T22:36:26.317 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:26.228+0000 7fc8b7412740 1 --2- 172.21.15.19:0/3331172067 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55921d610790 0x55921d612b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:36:26.317 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:26.228+0000 7fc8b7412740 1 --2- 172.21.15.19:0/3331172067 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55921d604800 0x55921d610250 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:36:26.318 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:26.228+0000 7fc8b7412740 1 --2- 172.21.15.19:0/3331172067 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55921d603ee0 0x55921d6042c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:36:26.318 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:26.228+0000 7fc8b7412740 1 -- 172.21.15.19:0/3331172067 >> 172.21.15.19:0/3331172067 conn(0x55921d601d10 msgr2=0x55921d602eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:36:26.318 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:26.228+0000 7fc8b7412740 1 -- 172.21.15.19:0/3331172067 shutdown_connections 2024-09-10T22:36:26.318 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:26.228+0000 7fc8b7412740 1 -- 172.21.15.19:0/3331172067 wait complete. 2024-09-10T22:36:26.318 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:26.228+0000 7fc8b7412740 1 -- start start 2024-09-10T22:36:26.318 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:26.228+0000 7fc8b7412740 1 Processor -- start 2024-09-10T22:36:26.318 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:26.228+0000 7fc8b7412740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55921d603ee0 0x55921d60d720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:36:26.318 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:26.228+0000 7fc8b7412740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55921d604800 0x55921d60dc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:36:26.318 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:26.228+0000 7fc8b7412740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55921d610790 0x55921d60e1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:36:26.318 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:26.228+0000 7fc8b7412740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x55921d3cb890 con 0x55921d610790 2024-09-10T22:36:26.318 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:26.228+0000 7fc8b7412740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55921d504d40 con 0x55921d604800 2024-09-10T22:36:26.318 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:26.228+0000 7fc8b7412740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x55921d6133e0 con 0x55921d603ee0 2024-09-10T22:36:26.319 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:26.228+0000 7fc8b7412740 10 client.0 _ll_register_callbacks cb 0x55921d568c80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T22:36:26.319 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:26.229+0000 7fc8af59e640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55921d610790 0x55921d60e1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:36:26.319 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:26.229+0000 7fc8af59e640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55921d610790 0x55921d60e1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:43314/0 (socket says 172.21.15.19:43314) 2024-09-10T22:36:26.319 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:26.229+0000 7fc8ae59c640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55921d604800 0x55921d60dc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:36:26.319 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:26.229+0000 7fc8af59e640 1 -- 172.21.15.19:0/942740773 learned_addr learned my addr 172.21.15.19:0/942740773 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:36:26.319 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:26.229+0000 7fc8aed9d640 1 --2- 172.21.15.19:0/942740773 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55921d603ee0 0x55921d60d720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:36:26.319 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:26.229+0000 7fc8af59e640 1 -- 172.21.15.19:0/942740773 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55921d603ee0 msgr2=0x55921d60d720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:36:26.319 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:26.229+0000 7fc8af59e640 1 --2- 172.21.15.19:0/942740773 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55921d603ee0 0x55921d60d720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:36:26.319 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:26.229+0000 7fc8af59e640 1 -- 172.21.15.19:0/942740773 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55921d604800 msgr2=0x55921d60dc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:36:26.319 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:26.229+0000 7fc8af59e640 1 --2- 172.21.15.19:0/942740773 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55921d604800 0x55921d60dc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:36:26.319 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:26.229+0000 7fc8af59e640 1 -- 172.21.15.19:0/942740773 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55921d61c7c0 con 0x55921d610790 2024-09-10T22:36:26.319 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:26.229+0000 7fc8ae59c640 1 --2- 172.21.15.19:0/942740773 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55921d604800 0x55921d60dc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T22:36:26.320 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:26.229+0000 7fc8af59e640 1 --2- 172.21.15.19:0/942740773 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55921d610790 0x55921d60e1a0 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 crypto rx=0x7fc8a8003e50 tx=0x7fc8a8004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=503c1fd5f5ad0ec2 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:36:26.320 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:26.229+0000 7fc892ff5640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-10T22:36:26.320 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:26.229+0000 7fc892ff5640 1 -- 172.21.15.19:0/942740773 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8a8004550 con 0x55921d610790 2024-09-10T22:36:26.320 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:26.229+0000 7fc892ff5640 1 -- 172.21.15.19:0/942740773 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8327+0+0 (secure 0 0 0) 0x7fc8a8018030 con 0x55921d610790 2024-09-10T22:36:26.320 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:26.229+0000 7fc8b7412740 1 -- 172.21.15.19:0/942740773 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc8a0031760 con 0x55921d610790 2024-09-10T22:36:26.320 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:26.230+0000 7fc892ff5640 1 -- 172.21.15.19:0/942740773 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fc8a80046f0 con 0x55921d610790 2024-09-10T22:36:26.320 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:26.230+0000 7fc8b7412740 10 client.17376 fetch_fsmap learned FSMap version 27 2024-09-10T22:36:26.320 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:26.230+0000 7fc8b7412740 1 -- 172.21.15.19:0/942740773 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55921d61f1d0 con 0x55921d610790 2024-09-10T22:36:26.320 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:26.230+0000 7fc892ff5640 1 -- 172.21.15.19:0/942740773 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc8a0031760 con 0x55921d610790 2024-09-10T22:36:26.320 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:26.230+0000 7fc892ff5640 1 -- 172.21.15.19:0/942740773 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7fc8a8030020 con 0x55921d610790 2024-09-10T22:36:26.320 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:26.230+0000 7fc8b7412740 10 client.17376 fetch_fsmap finished waiting for FSMap version 27 2024-09-10T22:36:26.320 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:26.230+0000 7fc8b7412740 10 client.17376 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-10T22:36:26.321 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:26.230+0000 7fc8b7412740 20 client.17376 populate_metadata read hostname 'smithi019' 2024-09-10T22:36:26.321 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:26.230+0000 7fc8b7412740 1 --2- 172.21.15.19:0/942740773 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x55921d620650 0x55921d622a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:36:26.321 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:26.230+0000 7fc8b7412740 4 client.17376 mds_command: new command op to 24581 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T22:36:26.321 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:26.230+0000 7fc8b7412740 1 -- 172.21.15.19:0/942740773 --> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55921d57cdb0 con 0x55921d620650 2024-09-10T22:36:26.321 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:26.230+0000 7fc8aed9d640 1 --2- 172.21.15.19:0/942740773 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x55921d620650 0x55921d622a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:36:26.321 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:26.231+0000 7fc8aed9d640 1 --2- 172.21.15.19:0/942740773 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x55921d620650 0x55921d622a90 crc :-1 s=READY pgs=200 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=89af947aa5bdf3af server_cookie=cdf7f7aaed6d7c31 in_seq=0 out_seq=0 2024-09-10T22:36:26.321 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:26.231+0000 7fc892ff5640 10 client.17376 ms_handle_connect on v2:172.21.15.135:6838/1254769802 2024-09-10T22:36:26.321 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:26.231+0000 7fc892ff5640 1 -- 172.21.15.19:0/942740773 <== mds.0 v2:172.21.15.135:6838/1254769802 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55921d57cdb0 con 0x55921d620650 2024-09-10T22:36:26.321 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:26.231+0000 7fc892ff5640 10 client.17376 handle_command_reply: tid=0 2024-09-10T22:36:26.321 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:26.231+0000 7fc8b7412740 1 client.17376 shutdown 2024-09-10T22:36:26.321 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:26.232+0000 7fc8b7412740 1 -- 172.21.15.19:0/942740773 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55921d610790 msgr2=0x55921d60e1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:36:26.321 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:26.232+0000 7fc8b7412740 1 --2- 172.21.15.19:0/942740773 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55921d610790 0x55921d60e1a0 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 crypto rx=0x7fc8a8003e50 tx=0x7fc8a8004ab0 comp rx=0 tx=0).stop 2024-09-10T22:36:26.321 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:26.232+0000 7fc8b7412740 1 -- 172.21.15.19:0/942740773 shutdown_connections 2024-09-10T22:36:26.322 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:26.232+0000 7fc8b7412740 1 --2- 172.21.15.19:0/942740773 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55921d610790 0x55921d60e1a0 unknown :-1 s=CLOSED pgs=815 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:36:26.322 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:26.232+0000 7fc8b7412740 1 --2- 172.21.15.19:0/942740773 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55921d604800 0x55921d60dc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:36:26.322 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:26.232+0000 7fc8b7412740 1 --2- 172.21.15.19:0/942740773 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x55921d620650 0x55921d622a90 crc :-1 s=READY pgs=200 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:36:26.322 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:26.232+0000 7fc8b7412740 1 --2- 172.21.15.19:0/942740773 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55921d603ee0 0x55921d60d720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:36:26.322 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:26.232+0000 7fc892ff5640 0 client.17376 ms_handle_reset on v2:172.21.15.135:6838/1254769802 2024-09-10T22:36:26.322 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:26.232+0000 7fc8b7412740 1 -- 172.21.15.19:0/942740773 >> 172.21.15.19:0/942740773 conn(0x55921d601d10 msgr2=0x55921d600f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:36:26.322 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:26.232+0000 7fc8b7412740 1 -- 172.21.15.19:0/942740773 shutdown_connections 2024-09-10T22:36:26.322 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:26.232+0000 7fc8b7412740 1 -- 172.21.15.19:0/942740773 wait complete. 2024-09-10T22:36:26.322 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:26.232+0000 7fc8b7412740 20 client.17376 trim_cache size 0 max 16384 2024-09-10T22:36:26.322 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:26.254+0000 7fc8b7412740 1 Processor -- start 2024-09-10T22:36:26.322 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:26.254+0000 7fc8b7412740 1 -- start start 2024-09-10T22:36:26.322 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:26.254+0000 7fc8b7412740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55921d603ee0 0x55921d60b1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:36:26.323 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:26.254+0000 7fc8b7412740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55921d604800 0x55921d6283b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:36:26.323 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:26.254+0000 7fc8b7412740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55921d610790 0x55921d6288f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:36:26.323 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:26.254+0000 7fc8b7412740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fc8b01b0e00 con 0x55921d604800 2024-09-10T22:36:26.323 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:26.254+0000 7fc8b7412740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fc8b01ae6d0 con 0x55921d603ee0 2024-09-10T22:36:26.323 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:26.254+0000 7fc8b7412740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7fc8b01ac520 con 0x55921d610790 2024-09-10T22:36:26.323 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:26.254+0000 7fc8ae59c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55921d604800 0x55921d6283b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:36:26.323 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:26.254+0000 7fc8ae59c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55921d604800 0x55921d6283b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:43324/0 (socket says 172.21.15.19:43324) 2024-09-10T22:36:26.323 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:26.254+0000 7fc8ae59c640 1 -- 172.21.15.19:0/2137664813 learned_addr learned my addr 172.21.15.19:0/2137664813 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:36:26.323 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:26.254+0000 7fc8aed9d640 1 --2- 172.21.15.19:0/2137664813 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55921d603ee0 0x55921d60b1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:36:26.323 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:26.254+0000 7fc8af59e640 1 --2- 172.21.15.19:0/2137664813 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55921d610790 0x55921d6288f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:36:26.323 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:26.254+0000 7fc8ae59c640 1 -- 172.21.15.19:0/2137664813 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55921d610790 msgr2=0x55921d6288f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:36:26.323 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:26.254+0000 7fc8ae59c640 1 --2- 172.21.15.19:0/2137664813 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55921d610790 0x55921d6288f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:36:26.323 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:26.254+0000 7fc8ae59c640 1 -- 172.21.15.19:0/2137664813 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55921d603ee0 msgr2=0x55921d60b1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:36:26.323 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:26.254+0000 7fc8ae59c640 1 --2- 172.21.15.19:0/2137664813 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55921d603ee0 0x55921d60b1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:36:26.324 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:26.254+0000 7fc8ae59c640 1 -- 172.21.15.19:0/2137664813 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55921d601b40 con 0x55921d604800 2024-09-10T22:36:26.324 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:26.254+0000 7fc8aed9d640 1 --2- 172.21.15.19:0/2137664813 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55921d603ee0 0x55921d60b1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T22:36:26.324 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:26.255+0000 7fc8ae59c640 1 --2- 172.21.15.19:0/2137664813 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55921d604800 0x55921d6283b0 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 crypto rx=0x7fc8a40e3680 tx=0x7fc8a40e9670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5cae4816f9460150 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:36:26.324 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:26.255+0000 7fc894ff9640 1 -- 172.21.15.19:0/2137664813 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8a401c070 con 0x55921d604800 2024-09-10T22:36:26.324 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:36:26 smithi019 ceph-mon[31375]: pgmap v647: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 385 KiB/s rd, 218 MiB/s wr, 609 op/s 2024-09-10T22:36:26.324 INFO:teuthology.orchestra.run.smithi019.stdout:{ 2024-09-10T22:36:26.325 INFO:teuthology.orchestra.run.smithi019.stdout: "return_code": 0, 2024-09-10T22:36:26.325 INFO:teuthology.orchestra.run.smithi019.stdout: "scrub_tag": "abfbdc16-212b-47f2-b921-c2a1cae322e5", 2024-09-10T22:36:26.325 INFO:teuthology.orchestra.run.smithi019.stdout: "mode": "asynchronous" 2024-09-10T22:36:26.325 INFO:teuthology.orchestra.run.smithi019.stdout:} 2024-09-10T22:36:26.325 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:26.255+0000 7fc894ff9640 1 -- 172.21.15.19:0/2137664813 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc8a40ea040 con 0x55921d604800 2024-09-10T22:36:26.325 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:26.255+0000 7fc894ff9640 1 -- 172.21.15.19:0/2137664813 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8a40ac9f0 con 0x55921d604800 2024-09-10T22:36:26.325 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:26.255+0000 7fc8b7412740 1 -- 172.21.15.19:0/2137664813 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55921d604800 msgr2=0x55921d6283b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:36:26.325 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:26.255+0000 7fc8b7412740 1 --2- 172.21.15.19:0/2137664813 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55921d604800 0x55921d6283b0 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 crypto rx=0x7fc8a40e3680 tx=0x7fc8a40e9670 comp rx=0 tx=0).stop 2024-09-10T22:36:26.325 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:26.256+0000 7fc8b7412740 1 -- 172.21.15.19:0/2137664813 shutdown_connections 2024-09-10T22:36:26.326 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:26.256+0000 7fc8b7412740 1 --2- 172.21.15.19:0/2137664813 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55921d610790 0x55921d6288f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:36:26.326 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:26.256+0000 7fc8b7412740 1 --2- 172.21.15.19:0/2137664813 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55921d604800 0x55921d6283b0 unknown :-1 s=CLOSED pgs=816 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:36:26.326 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:26.256+0000 7fc8b7412740 1 --2- 172.21.15.19:0/2137664813 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55921d603ee0 0x55921d60b1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:36:26.326 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:26.256+0000 7fc8b7412740 1 -- 172.21.15.19:0/2137664813 >> 172.21.15.19:0/2137664813 conn(0x55921d601d10 msgr2=0x55921d603210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:36:26.326 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:26.256+0000 7fc8b7412740 1 -- 172.21.15.19:0/2137664813 shutdown_connections 2024-09-10T22:36:26.326 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:26.256+0000 7fc8b7412740 1 -- 172.21.15.19:0/2137664813 wait complete. 2024-09-10T22:36:26.326 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:26.256+0000 7fc8b7412740 1 -- start start 2024-09-10T22:36:26.326 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:26.256+0000 7fc8b7412740 1 Processor -- start 2024-09-10T22:36:26.326 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:26.256+0000 7fc8b7412740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55921d603ee0 0x55921d614920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:36:26.326 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:26.256+0000 7fc8b7412740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55921d604800 0x55921d614e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:36:26.327 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:26.256+0000 7fc8b7412740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55921d610790 0x55921d68c5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:36:26.327 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:26.256+0000 7fc8b7412740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fc8b01acb90 con 0x55921d603ee0 2024-09-10T22:36:26.327 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:26.256+0000 7fc8b7412740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fc8b01ae000 con 0x55921d604800 2024-09-10T22:36:26.327 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:26.256+0000 7fc8b7412740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7fc8b01ad260 con 0x55921d610790 2024-09-10T22:36:26.327 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:26.256+0000 7fc8b7412740 10 client.0 _ll_register_callbacks cb 0x7fc8a8012070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T22:36:26.327 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:26.256+0000 7fc8aed9d640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55921d603ee0 0x55921d614920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:36:26.327 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:26.256+0000 7fc8aed9d640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55921d603ee0 0x55921d614920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:43326/0 (socket says 172.21.15.19:43326) 2024-09-10T22:36:26.327 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:26.256+0000 7fc8aed9d640 1 -- 172.21.15.19:0/2707203376 learned_addr learned my addr 172.21.15.19:0/2707203376 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:36:26.327 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:26.257+0000 7fc8af59e640 1 --2- 172.21.15.19:0/2707203376 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55921d610790 0x55921d68c5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:36:26.327 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:26.257+0000 7fc8ae59c640 1 --2- 172.21.15.19:0/2707203376 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55921d604800 0x55921d614e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:36:26.327 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:26.257+0000 7fc8aed9d640 1 -- 172.21.15.19:0/2707203376 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55921d610790 msgr2=0x55921d68c5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:36:26.328 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:26.257+0000 7fc8aed9d640 1 --2- 172.21.15.19:0/2707203376 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55921d610790 0x55921d68c5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:36:26.328 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:26.257+0000 7fc8aed9d640 1 -- 172.21.15.19:0/2707203376 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55921d604800 msgr2=0x55921d614e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:36:26.328 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:26.257+0000 7fc8aed9d640 1 --2- 172.21.15.19:0/2707203376 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55921d604800 0x55921d614e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:36:26.328 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:26.257+0000 7fc8aed9d640 1 -- 172.21.15.19:0/2707203376 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55921d602790 con 0x55921d603ee0 2024-09-10T22:36:26.328 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:26.257+0000 7fc8ae59c640 1 --2- 172.21.15.19:0/2707203376 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55921d604800 0x55921d614e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T22:36:26.328 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:26.257+0000 7fc8af59e640 1 --2- 172.21.15.19:0/2707203376 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55921d610790 0x55921d68c5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T22:36:26.328 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:26.257+0000 7fc8aed9d640 1 --2- 172.21.15.19:0/2707203376 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55921d603ee0 0x55921d614920 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 crypto rx=0x7fc8a0006010 tx=0x7fc8a0005d70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=960c7ff5451a02ec server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:36:26.328 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:26.257+0000 7fc892ff5640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-10T22:36:26.328 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:26.257+0000 7fc892ff5640 1 -- 172.21.15.19:0/2707203376 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8a0035040 con 0x55921d603ee0 2024-09-10T22:36:26.328 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:26.257+0000 7fc8b7412740 1 -- 172.21.15.19:0/2707203376 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc8a40ea040 con 0x55921d603ee0 2024-09-10T22:36:26.328 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:26.257+0000 7fc892ff5640 1 -- 172.21.15.19:0/2707203376 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8327+0+0 (secure 0 0 0) 0x7fc8a0004040 con 0x55921d603ee0 2024-09-10T22:36:26.329 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:26.257+0000 7fc892ff5640 1 -- 172.21.15.19:0/2707203376 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fc8a0004240 con 0x55921d603ee0 2024-09-10T22:36:26.329 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:26.257+0000 7fc8b7412740 10 client.17382 fetch_fsmap learned FSMap version 27 2024-09-10T22:36:26.329 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:26.257+0000 7fc8b7412740 1 -- 172.21.15.19:0/2707203376 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55921d68da80 con 0x55921d603ee0 2024-09-10T22:36:26.329 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:26.258+0000 7fc892ff5640 1 -- 172.21.15.19:0/2707203376 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc8a40ea040 con 0x55921d603ee0 2024-09-10T22:36:26.329 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:26.258+0000 7fc892ff5640 1 -- 172.21.15.19:0/2707203376 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7fc8a0055070 con 0x55921d603ee0 2024-09-10T22:36:26.329 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:26.258+0000 7fc8b7412740 10 client.17382 fetch_fsmap finished waiting for FSMap version 27 2024-09-10T22:36:26.329 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:26.258+0000 7fc8b7412740 10 client.17382 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-10T22:36:26.329 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:26.258+0000 7fc8b7412740 20 client.17382 populate_metadata read hostname 'smithi019' 2024-09-10T22:36:26.329 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:26.258+0000 7fc8b7412740 1 --2- 172.21.15.19:0/2707203376 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x55921d68ddc0 0x55921d6901b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:36:26.329 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:26.258+0000 7fc8b7412740 4 client.17382 mds_command: new command op to 24581 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-10T22:36:26.330 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:26.258+0000 7fc8b7412740 1 -- 172.21.15.19:0/2707203376 --> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x55921d578860 con 0x55921d68ddc0 2024-09-10T22:36:26.330 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:26.258+0000 7fc8ae59c640 1 --2- 172.21.15.19:0/2707203376 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x55921d68ddc0 0x55921d6901b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:36:26.330 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:26.258+0000 7fc8ae59c640 1 --2- 172.21.15.19:0/2707203376 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x55921d68ddc0 0x55921d6901b0 crc :-1 s=READY pgs=201 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=98129d91fc05a9bc server_cookie=3066532b5a240205 in_seq=0 out_seq=0 2024-09-10T22:36:26.330 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:26.258+0000 7fc892ff5640 10 client.17382 ms_handle_connect on v2:172.21.15.135:6838/1254769802 2024-09-10T22:36:26.330 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:26.260+0000 7fc892ff5640 1 -- 172.21.15.19:0/2707203376 <== mds.0 v2:172.21.15.135:6838/1254769802 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55921d578860 con 0x55921d68ddc0 2024-09-10T22:36:26.330 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:26.260+0000 7fc892ff5640 10 client.17382 handle_command_reply: tid=0 2024-09-10T22:36:26.330 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:26.260+0000 7fc8b7412740 1 client.17382 shutdown 2024-09-10T22:36:26.330 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:26.261+0000 7fc8b7412740 1 -- 172.21.15.19:0/2707203376 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55921d603ee0 msgr2=0x55921d614920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:36:26.330 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:26.261+0000 7fc8b7412740 1 --2- 172.21.15.19:0/2707203376 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55921d603ee0 0x55921d614920 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 crypto rx=0x7fc8a0006010 tx=0x7fc8a0005d70 comp rx=0 tx=0).stop 2024-09-10T22:36:26.330 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:26.261+0000 7fc8b7412740 1 -- 172.21.15.19:0/2707203376 shutdown_connections 2024-09-10T22:36:26.330 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:26.261+0000 7fc8b7412740 1 --2- 172.21.15.19:0/2707203376 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x55921d68ddc0 0x55921d6901b0 crc :-1 s=READY pgs=201 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:36:26.330 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:26.261+0000 7fc892ff5640 0 client.17382 ms_handle_reset on v2:172.21.15.135:6838/1254769802 2024-09-10T22:36:26.330 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:26.261+0000 7fc8b7412740 1 --2- 172.21.15.19:0/2707203376 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55921d610790 0x55921d68c5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:36:26.331 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:26.261+0000 7fc8b7412740 1 --2- 172.21.15.19:0/2707203376 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55921d604800 0x55921d614e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:36:26.331 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:26.261+0000 7fc8b7412740 1 --2- 172.21.15.19:0/2707203376 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55921d603ee0 0x55921d614920 unknown :-1 s=CLOSED pgs=817 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:36:26.331 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:26.261+0000 7fc8b7412740 1 -- 172.21.15.19:0/2707203376 >> 172.21.15.19:0/2707203376 conn(0x55921d601d10 msgr2=0x55921d60ed50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:36:26.331 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:26.261+0000 7fc8b7412740 1 -- 172.21.15.19:0/2707203376 shutdown_connections 2024-09-10T22:36:26.331 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:26.261+0000 7fc8b7412740 1 -- 172.21.15.19:0/2707203376 wait complete. 2024-09-10T22:36:26.331 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:26.261+0000 7fc8b7412740 20 client.17382 trim_cache size 0 max 16384 2024-09-10T22:36:26.331 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:26.262+0000 7fc8b503d640 1 -- 172.21.15.19:0/2202024950 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7fc8980b5360 msgr2=0x7fc8980b7820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:36:26.331 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:26.262+0000 7fc8b503d640 1 --2- 172.21.15.19:0/2202024950 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7fc8980b5360 0x7fc8980b7820 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7fc8a8009fd0 tx=0x7fc8a8009500 comp rx=0 tx=0).stop 2024-09-10T22:36:26.331 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:26.262+0000 7fc8b503d640 1 -- 172.21.15.19:0/2202024950 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc8b010a920 msgr2=0x7fc8b01997c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:36:26.331 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:26.262+0000 7fc8b503d640 1 --2- 172.21.15.19:0/2202024950 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc8b010a920 0x7fc8b01997c0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fc8a400e9f0 tx=0x7fc8a400eeb0 comp rx=0 tx=0).stop 2024-09-10T22:36:26.331 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:26.262+0000 7fc8b503d640 1 -- 172.21.15.19:0/2202024950 shutdown_connections 2024-09-10T22:36:26.331 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:26.262+0000 7fc8b503d640 1 --2- 172.21.15.19:0/2202024950 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7fc8980b5360 0x7fc8980b7820 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:36:26.331 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:26.262+0000 7fc8b503d640 1 --2- 172.21.15.19:0/2202024950 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc8b010d250 0x7fc8b019eb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:36:26.332 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:26.262+0000 7fc8b503d640 1 --2- 172.21.15.19:0/2202024950 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc8b010a920 0x7fc8b01997c0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:36:26.332 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:26.262+0000 7fc8b503d640 1 --2- 172.21.15.19:0/2202024950 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc8b0101810 0x7fc8b0199280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:36:26.332 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:26.262+0000 7fc8b503d640 1 -- 172.21.15.19:0/2202024950 >> 172.21.15.19:0/2202024950 conn(0x7fc8b0076f50 msgr2=0x7fc8b01005a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:36:26.332 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:26.262+0000 7fc8b503d640 1 -- 172.21.15.19:0/2202024950 shutdown_connections 2024-09-10T22:36:26.332 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:26.262+0000 7fc8b503d640 1 -- 172.21.15.19:0/2202024950 wait complete. 2024-09-10T22:36:26.359 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:36:26 smithi135 ceph-mon[34789]: pgmap v647: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 385 KiB/s rd, 218 MiB/s wr, 609 op/s 2024-09-10T22:36:26.375 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:36:26 smithi138 ceph-mon[35236]: pgmap v647: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 385 KiB/s rd, 218 MiB/s wr, 609 op/s 2024-09-10T22:36:27.090 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 22997a4c-6fc2-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-10T22:36:27.300 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:27.298+0000 7f60eaffd640 1 -- 172.21.15.19:0/2624842566 <== mds.0 v2:172.21.15.135:6838/1254769802 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x563d6920d0f0 con 0x563d693242b0 2024-09-10T22:36:27.300 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:27.298+0000 7f60eaffd640 10 client.26707 handle_command_reply: tid=0 2024-09-10T22:36:27.300 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:27.299+0000 7f611484f740 1 client.26707 shutdown 2024-09-10T22:36:27.301 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:27.299+0000 7f611484f740 1 -- 172.21.15.19:0/2624842566 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x563d692a0190 msgr2=0x563d692ad670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:36:27.301 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:27.299+0000 7f611484f740 1 --2- 172.21.15.19:0/2624842566 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x563d692a0190 0x563d692ad670 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x563d692b9640 tx=0x7f60fc004730 comp rx=0 tx=0).stop 2024-09-10T22:36:27.302 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:27.299+0000 7f611484f740 1 -- 172.21.15.19:0/2624842566 shutdown_connections 2024-09-10T22:36:27.302 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:27.299+0000 7f611484f740 1 --2- 172.21.15.19:0/2624842566 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563d692a2bd0 0x563d692adbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:36:27.302 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:27.299+0000 7f611484f740 1 --2- 172.21.15.19:0/2624842566 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x563d693242b0 0x563d693266d0 crc :-1 s=READY pgs=199 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:36:27.302 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:27.299+0000 7f611484f740 1 --2- 172.21.15.19:0/2624842566 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x563d692a0190 0x563d692ad670 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:36:27.302 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:27.299+0000 7f611484f740 1 --2- 172.21.15.19:0/2624842566 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x563d6929d860 0x563d692ae970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:36:27.302 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:27.299+0000 7f611484f740 1 -- 172.21.15.19:0/2624842566 >> 172.21.15.19:0/2624842566 conn(0x563d692989b0 msgr2=0x563d69297bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:36:27.302 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:27.299+0000 7f60eaffd640 0 client.26707 ms_handle_reset on v2:172.21.15.135:6838/1254769802 2024-09-10T22:36:27.302 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:27.299+0000 7f611484f740 1 -- 172.21.15.19:0/2624842566 shutdown_connections 2024-09-10T22:36:27.302 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:27.300+0000 7f611484f740 1 -- 172.21.15.19:0/2624842566 wait complete. 2024-09-10T22:36:27.302 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:27.300+0000 7f611484f740 20 client.26707 trim_cache size 0 max 16384 2024-09-10T22:36:27.303 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stdout:{ 2024-09-10T22:36:27.303 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stdout: "message": "", 2024-09-10T22:36:27.303 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stdout: "return_code": 0 2024-09-10T22:36:27.303 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stdout:} 2024-09-10T22:36:27.303 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:27.301+0000 7f6111a7f640 1 -- 172.21.15.19:0/1061381595 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f60f40b52e0 msgr2=0x7f60f40b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:36:27.304 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:27.301+0000 7f6111a7f640 1 --2- 172.21.15.19:0/1061381595 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f60f40b52e0 0x7f60f40b77a0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f60fc009fd0 tx=0x7f60fc0096c0 comp rx=0 tx=0).stop 2024-09-10T22:36:27.304 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:27.301+0000 7f6111a7f640 1 -- 172.21.15.19:0/1061381595 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f610c103380 msgr2=0x7f610c199fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:36:27.304 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:27.301+0000 7f6111a7f640 1 --2- 172.21.15.19:0/1061381595 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f610c103380 0x7f610c199fa0 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 crypto rx=0x7f610402ae00 tx=0x7f6104003ba0 comp rx=0 tx=0).stop 2024-09-10T22:36:27.304 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:27.301+0000 7f6111a7f640 1 -- 172.21.15.19:0/1061381595 shutdown_connections 2024-09-10T22:36:27.304 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:27.301+0000 7f6111a7f640 1 --2- 172.21.15.19:0/1061381595 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f60f40b52e0 0x7f60f40b77a0 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:36:27.304 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:27.301+0000 7f6111a7f640 1 --2- 172.21.15.19:0/1061381595 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f610c103380 0x7f610c199fa0 unknown :-1 s=CLOSED pgs=813 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:36:27.304 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:27.301+0000 7f6111a7f640 1 --2- 172.21.15.19:0/1061381595 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f610c1029c0 0x7f610c199370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:36:27.304 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:27.301+0000 7f6111a7f640 1 --2- 172.21.15.19:0/1061381595 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f610c101870 0x7f610c198d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:36:27.304 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:27.301+0000 7f6111a7f640 1 -- 172.21.15.19:0/1061381595 >> 172.21.15.19:0/1061381595 conn(0x7f610c0fd150 msgr2=0x7f610c0feb00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:36:27.304 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:27.302+0000 7f6111a7f640 1 -- 172.21.15.19:0/1061381595 shutdown_connections 2024-09-10T22:36:27.304 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:27.302+0000 7f6111a7f640 1 -- 172.21.15.19:0/1061381595 wait complete. 2024-09-10T22:36:27.360 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:36:27 smithi135 ceph-mon[34789]: scrub queued for path: / 2024-09-10T22:36:27.360 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:36:27 smithi135 ceph-mon[34789]: scrub summary: idle+waiting paths [/] 2024-09-10T22:36:27.360 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:36:27 smithi135 ceph-mon[34789]: scrub summary: active paths [/] 2024-09-10T22:36:27.361 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:36:27 smithi135 ceph-mon[34789]: scrub summary: active paths [/] 2024-09-10T22:36:27.361 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:36:27 smithi135 ceph-mon[34789]: scrub summary: idle+waiting paths [/] 2024-09-10T22:36:27.375 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:36:27 smithi138 ceph-mon[35236]: scrub queued for path: / 2024-09-10T22:36:27.375 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:36:27 smithi138 ceph-mon[35236]: scrub summary: idle+waiting paths [/] 2024-09-10T22:36:27.375 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:36:27 smithi138 ceph-mon[35236]: scrub summary: active paths [/] 2024-09-10T22:36:27.375 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:36:27 smithi138 ceph-mon[35236]: scrub summary: active paths [/] 2024-09-10T22:36:27.375 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:36:27 smithi138 ceph-mon[35236]: scrub summary: idle+waiting paths [/] 2024-09-10T22:36:27.466 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:36:27 smithi019 ceph-mon[31375]: scrub queued for path: / 2024-09-10T22:36:27.466 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:36:27 smithi019 ceph-mon[31375]: scrub summary: idle+waiting paths [/] 2024-09-10T22:36:27.466 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:36:27 smithi019 ceph-mon[31375]: scrub summary: active paths [/] 2024-09-10T22:36:27.466 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:36:27 smithi019 ceph-mon[31375]: scrub summary: active paths [/] 2024-09-10T22:36:27.466 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:36:27 smithi019 ceph-mon[31375]: scrub summary: idle+waiting paths [/] 2024-09-10T22:36:27.489 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/22997a4c-6fc2-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T22:36:28.360 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:36:28 smithi135 ceph-mon[34789]: pgmap v648: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 345 KiB/s rd, 232 MiB/s wr, 862 op/s 2024-09-10T22:36:28.360 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:36:28 smithi135 ceph-mon[34789]: scrub summary: idle+waiting paths [/] 2024-09-10T22:36:28.372 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:36:28 smithi019 ceph-mon[31375]: pgmap v648: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 345 KiB/s rd, 232 MiB/s wr, 862 op/s 2024-09-10T22:36:28.372 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:36:28 smithi019 ceph-mon[31375]: scrub summary: idle+waiting paths [/] 2024-09-10T22:36:28.375 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:36:28 smithi138 ceph-mon[35236]: pgmap v648: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 345 KiB/s rd, 232 MiB/s wr, 862 op/s 2024-09-10T22:36:28.375 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:36:28 smithi138 ceph-mon[35236]: scrub summary: idle+waiting paths [/] 2024-09-10T22:36:28.617 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:28.462+0000 7f8202875640 1 -- 172.21.15.19:0/560669453 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f81fc101cc0 msgr2=0x7f81fc1020a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:36:28.618 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:28.462+0000 7f8202875640 1 --2- 172.21.15.19:0/560669453 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f81fc101cc0 0x7f81fc1020a0 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 crypto rx=0x7f81ec009900 tx=0x7f81ec02a410 comp rx=0 tx=0).stop 2024-09-10T22:36:28.618 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:28.462+0000 7f8202875640 1 -- 172.21.15.19:0/560669453 shutdown_connections 2024-09-10T22:36:28.618 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:28.462+0000 7f8202875640 1 --2- 172.21.15.19:0/560669453 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f81fc108050 0x7f81fc10e850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:36:28.618 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:28.462+0000 7f8202875640 1 --2- 172.21.15.19:0/560669453 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f81fc1076d0 0x7f81fc107b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:36:28.618 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:28.462+0000 7f8202875640 1 --2- 172.21.15.19:0/560669453 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f81fc101cc0 0x7f81fc1020a0 unknown :-1 s=CLOSED pgs=818 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:36:28.618 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:28.462+0000 7f8202875640 1 -- 172.21.15.19:0/560669453 >> 172.21.15.19:0/560669453 conn(0x7f81fc0fd770 msgr2=0x7f81fc0ffb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:36:28.618 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:28.462+0000 7f8202875640 1 -- 172.21.15.19:0/560669453 shutdown_connections 2024-09-10T22:36:28.618 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:28.462+0000 7f8202875640 1 -- 172.21.15.19:0/560669453 wait complete. 2024-09-10T22:36:28.618 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:28.462+0000 7f8202875640 1 Processor -- start 2024-09-10T22:36:28.618 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:28.462+0000 7f8202875640 1 -- start start 2024-09-10T22:36:28.618 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:28.463+0000 7f8202875640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f81fc101cc0 0x7f81fc198290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:36:28.618 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:28.463+0000 7f8202875640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f81fc1076d0 0x7f81fc1987d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:36:28.619 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:28.463+0000 7f8202875640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f81fc108050 0x7f81fc19db70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:36:28.619 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:28.463+0000 7f8202875640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f81fc111d60 con 0x7f81fc101cc0 2024-09-10T22:36:28.619 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:28.463+0000 7f8202875640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f81fc111be0 con 0x7f81fc108050 2024-09-10T22:36:28.619 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:28.463+0000 7f8202875640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f81fc111ee0 con 0x7f81fc1076d0 2024-09-10T22:36:28.619 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:28.463+0000 7f81fbfff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f81fc101cc0 0x7f81fc198290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:36:28.619 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:28.463+0000 7f81f3fff640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f81fc1076d0 0x7f81fc1987d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:36:28.619 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:28.463+0000 7f81fbfff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f81fc101cc0 0x7f81fc198290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:43346/0 (socket says 172.21.15.19:43346) 2024-09-10T22:36:28.619 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:28.463+0000 7f81fbfff640 1 -- 172.21.15.19:0/1886629121 learned_addr learned my addr 172.21.15.19:0/1886629121 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:36:28.619 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:28.463+0000 7f8200e12640 1 --2- 172.21.15.19:0/1886629121 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f81fc108050 0x7f81fc19db70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:36:28.619 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:28.463+0000 7f81fbfff640 1 -- 172.21.15.19:0/1886629121 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f81fc1076d0 msgr2=0x7f81fc1987d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:36:28.619 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:28.463+0000 7f81fbfff640 1 --2- 172.21.15.19:0/1886629121 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f81fc1076d0 0x7f81fc1987d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:36:28.619 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:28.463+0000 7f81fbfff640 1 -- 172.21.15.19:0/1886629121 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f81fc108050 msgr2=0x7f81fc19db70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:36:28.619 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:28.463+0000 7f81fbfff640 1 --2- 172.21.15.19:0/1886629121 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f81fc108050 0x7f81fc19db70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:36:28.620 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:28.463+0000 7f81fbfff640 1 -- 172.21.15.19:0/1886629121 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f81fc19e340 con 0x7f81fc101cc0 2024-09-10T22:36:28.620 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:28.463+0000 7f81fbfff640 1 --2- 172.21.15.19:0/1886629121 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f81fc101cc0 0x7f81fc198290 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 crypto rx=0x7f81ec005ab0 tx=0x7f81ec003cd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:36:28.620 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:28.464+0000 7f81f9ffb640 1 -- 172.21.15.19:0/1886629121 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81ec035070 con 0x7f81fc101cc0 2024-09-10T22:36:28.620 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:28.464+0000 7f81f9ffb640 1 -- 172.21.15.19:0/1886629121 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f81ec003e40 con 0x7f81fc101cc0 2024-09-10T22:36:28.620 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:28.464+0000 7f8202875640 1 -- 172.21.15.19:0/1886629121 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f81fc19e5d0 con 0x7f81fc101cc0 2024-09-10T22:36:28.620 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:28.464+0000 7f81f9ffb640 1 -- 172.21.15.19:0/1886629121 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81ec038bf0 con 0x7f81fc101cc0 2024-09-10T22:36:28.620 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:28.464+0000 7f8202875640 1 -- 172.21.15.19:0/1886629121 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f81fc06b2d0 con 0x7f81fc101cc0 2024-09-10T22:36:28.620 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:28.466+0000 7f81f9ffb640 1 -- 172.21.15.19:0/1886629121 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 18) ==== 153250+0+0 (secure 0 0 0) 0x7f81ec0316b0 con 0x7f81fc101cc0 2024-09-10T22:36:28.620 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:28.466+0000 7f8204c4a740 1 Processor -- start 2024-09-10T22:36:28.620 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:28.467+0000 7f8204c4a740 1 -- start start 2024-09-10T22:36:28.620 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:28.467+0000 7f8204c4a740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f6ced320a0 0x55f6ced32480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:36:28.620 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:28.467+0000 7f8204c4a740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55f6ced329c0 0x55f6ced42820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:36:28.620 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:28.467+0000 7f8204c4a740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55f6ced42d60 0x55f6ced45150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:36:28.621 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:28.467+0000 7f8204c4a740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x55f6ceca8e50 con 0x55f6ced42d60 2024-09-10T22:36:28.621 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:28.467+0000 7f8204c4a740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55f6cec98280 con 0x55f6ced320a0 2024-09-10T22:36:28.621 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:28.467+0000 7f8204c4a740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x55f6cec9c090 con 0x55f6ced329c0 2024-09-10T22:36:28.621 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:28.467+0000 7f81f3fff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55f6ced42d60 0x55f6ced45150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:36:28.621 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:28.467+0000 7f81f3fff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55f6ced42d60 0x55f6ced45150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:43360/0 (socket says 172.21.15.19:43360) 2024-09-10T22:36:28.621 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:28.467+0000 7f81fbfff640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55f6ced329c0 0x55f6ced42820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:36:28.621 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:28.467+0000 7f81f3fff640 1 -- 172.21.15.19:0/2072727270 learned_addr learned my addr 172.21.15.19:0/2072727270 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:36:28.621 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:28.467+0000 7f8200e12640 1 --2- 172.21.15.19:0/2072727270 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f6ced320a0 0x55f6ced32480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:36:28.621 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:28.467+0000 7f81f3fff640 1 -- 172.21.15.19:0/2072727270 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55f6ced329c0 msgr2=0x55f6ced42820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:36:28.621 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:28.467+0000 7f81f3fff640 1 --2- 172.21.15.19:0/2072727270 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55f6ced329c0 0x55f6ced42820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:36:28.621 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:28.467+0000 7f81f9ffb640 1 --2- 172.21.15.19:0/1886629121 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f81e80b5360 0x7f81e80b7820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:36:28.621 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:28.467+0000 7f81f3fff640 1 -- 172.21.15.19:0/2072727270 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f6ced320a0 msgr2=0x55f6ced32480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:36:28.622 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:28.467+0000 7f81f3fff640 1 --2- 172.21.15.19:0/2072727270 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f6ced320a0 0x55f6ced32480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:36:28.622 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:28.467+0000 7f81f3fff640 1 -- 172.21.15.19:0/2072727270 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f6ce9f6650 con 0x55f6ced42d60 2024-09-10T22:36:28.622 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:28.468+0000 7f8200e12640 1 --2- 172.21.15.19:0/1886629121 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f81e80b5360 0x7f81e80b7820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:36:28.622 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:28.468+0000 7f81f9ffb640 1 -- 172.21.15.19:0/1886629121 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8327+0+0 (secure 0 0 0) 0x7f81ec107c20 con 0x7f81fc101cc0 2024-09-10T22:36:28.622 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:28.468+0000 7f81f3fff640 1 --2- 172.21.15.19:0/2072727270 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55f6ced42d60 0x55f6ced45150 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 crypto rx=0x7f81e400bce0 tx=0x7f81e40107a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cbf9d8b2501f5cd1 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:36:28.622 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:28.468+0000 7f81f27fc640 1 -- 172.21.15.19:0/2072727270 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81e4004030 con 0x55f6ced42d60 2024-09-10T22:36:28.622 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:28.468+0000 7f81f27fc640 1 -- 172.21.15.19:0/2072727270 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f81e40041d0 con 0x55f6ced42d60 2024-09-10T22:36:28.622 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:28.468+0000 7f81f27fc640 1 -- 172.21.15.19:0/2072727270 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81e40116a0 con 0x55f6ced42d60 2024-09-10T22:36:28.622 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:28.469+0000 7f8204c4a740 1 -- 172.21.15.19:0/2072727270 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55f6ced42d60 msgr2=0x55f6ced45150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:36:28.622 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:28.469+0000 7f8200e12640 1 --2- 172.21.15.19:0/1886629121 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f81e80b5360 0x7f81e80b7820 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f81f4005fd0 tx=0x7f81f4004a40 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:36:28.622 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:28.469+0000 7f8204c4a740 1 --2- 172.21.15.19:0/2072727270 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55f6ced42d60 0x55f6ced45150 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 crypto rx=0x7f81e400bce0 tx=0x7f81e40107a0 comp rx=0 tx=0).stop 2024-09-10T22:36:28.622 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:28.469+0000 7f8204c4a740 1 -- 172.21.15.19:0/2072727270 shutdown_connections 2024-09-10T22:36:28.623 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:28.469+0000 7f8204c4a740 1 --2- 172.21.15.19:0/2072727270 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55f6ced42d60 0x55f6ced45150 unknown :-1 s=CLOSED pgs=820 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:36:28.623 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:28.469+0000 7f8204c4a740 1 --2- 172.21.15.19:0/2072727270 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55f6ced329c0 0x55f6ced42820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:36:28.623 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:28.469+0000 7f8204c4a740 1 --2- 172.21.15.19:0/2072727270 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f6ced320a0 0x55f6ced32480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:36:28.623 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:28.469+0000 7f8204c4a740 1 -- 172.21.15.19:0/2072727270 >> 172.21.15.19:0/2072727270 conn(0x55f6ced2fed0 msgr2=0x55f6ced31070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:36:28.623 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:28.469+0000 7f8204c4a740 1 -- 172.21.15.19:0/2072727270 shutdown_connections 2024-09-10T22:36:28.623 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:28.469+0000 7f8204c4a740 1 -- 172.21.15.19:0/2072727270 wait complete. 2024-09-10T22:36:28.623 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:28.469+0000 7f8204c4a740 1 -- start start 2024-09-10T22:36:28.623 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:28.469+0000 7f8204c4a740 1 Processor -- start 2024-09-10T22:36:28.623 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:28.470+0000 7f8204c4a740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f6ced320a0 0x55f6ced42690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:36:28.623 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:28.470+0000 7f8204c4a740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55f6ced329c0 0x55f6ced3fae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:36:28.623 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:28.470+0000 7f8204c4a740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55f6ced42d60 0x55f6ced40160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:36:28.623 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:28.470+0000 7f8204c4a740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x55f6ceaf9700 con 0x55f6ced42d60 2024-09-10T22:36:28.623 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:28.470+0000 7f8204c4a740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55f6cec33110 con 0x55f6ced320a0 2024-09-10T22:36:28.624 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:28.470+0000 7f8204c4a740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x55f6ced45a10 con 0x55f6ced329c0 2024-09-10T22:36:28.624 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:28.470+0000 7f8204c4a740 10 client.0 _ll_register_callbacks cb 0x55f6cec4c990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T22:36:28.624 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:28.470+0000 7f8200e12640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55f6ced42d60 0x55f6ced40160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:36:28.624 INFO:teuthology.orchestra.run.smithi019.stdout:{ 2024-09-10T22:36:28.624 INFO:teuthology.orchestra.run.smithi019.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-10T22:36:28.624 INFO:teuthology.orchestra.run.smithi019.stdout: "scrubs": { 2024-09-10T22:36:28.624 INFO:teuthology.orchestra.run.smithi019.stdout: "abfbdc16-212b-47f2-b921-c2a1cae322e5": { 2024-09-10T22:36:28.624 INFO:teuthology.orchestra.run.smithi019.stdout: "path": "/", 2024-09-10T22:36:28.625 INFO:teuthology.orchestra.run.smithi019.stdout: "tag": "abfbdc16-212b-47f2-b921-c2a1cae322e5", 2024-09-10T22:36:28.625 INFO:teuthology.orchestra.run.smithi019.stdout: "options": "recursive,force" 2024-09-10T22:36:28.625 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-10T22:36:28.625 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:36:28.625 INFO:teuthology.orchestra.run.smithi019.stdout: "scrub_stats": { 2024-09-10T22:36:28.625 INFO:teuthology.orchestra.run.smithi019.stdout: "abfbdc16-212b-47f2-b921-c2a1cae322e5": { 2024-09-10T22:36:28.625 INFO:teuthology.orchestra.run.smithi019.stdout: "start_time": "2024-09-10T22:36:26.258118+0000", 2024-09-10T22:36:28.625 INFO:teuthology.orchestra.run.smithi019.stdout: "path": "/", 2024-09-10T22:36:28.625 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_started": 0, 2024-09-10T22:36:28.625 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_passed": 0, 2024-09-10T22:36:28.625 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_failed": 0, 2024-09-10T22:36:28.625 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_skipped": 0 2024-09-10T22:36:28.625 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:36:28.626 INFO:teuthology.orchestra.run.smithi019.stdout: "9b6bfdee-303c-4c12-af56-dc85860d112a": { 2024-09-10T22:36:28.626 INFO:teuthology.orchestra.run.smithi019.stdout: "start_time": "2024-09-10T22:26:17.484162+0000", 2024-09-10T22:36:28.626 INFO:teuthology.orchestra.run.smithi019.stdout: "path": "/", 2024-09-10T22:36:28.626 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_started": 0, 2024-09-10T22:36:28.626 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_passed": 0, 2024-09-10T22:36:28.626 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_failed": 0, 2024-09-10T22:36:28.626 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_skipped": 0 2024-09-10T22:36:28.626 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:36:28.626 INFO:teuthology.orchestra.run.smithi019.stdout: "b38852c8-478a-42ef-8384-b2c55d5313a4": { 2024-09-10T22:36:28.626 INFO:teuthology.orchestra.run.smithi019.stdout: "start_time": "2024-09-10T22:27:00.320308+0000", 2024-09-10T22:36:28.626 INFO:teuthology.orchestra.run.smithi019.stdout: "path": "/", 2024-09-10T22:36:28.626 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_started": 0, 2024-09-10T22:36:28.627 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_passed": 0, 2024-09-10T22:36:28.627 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_failed": 0, 2024-09-10T22:36:28.627 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_skipped": 0 2024-09-10T22:36:28.627 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:36:28.627 INFO:teuthology.orchestra.run.smithi019.stdout: "c12c2a04-dcd6-4673-a98e-93f665d3f5d7": { 2024-09-10T22:36:28.627 INFO:teuthology.orchestra.run.smithi019.stdout: "start_time": "2024-09-10T22:27:49.392329+0000", 2024-09-10T22:36:28.627 INFO:teuthology.orchestra.run.smithi019.stdout: "path": "/", 2024-09-10T22:36:28.627 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_started": 0, 2024-09-10T22:36:28.627 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_passed": 0, 2024-09-10T22:36:28.627 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_failed": 0, 2024-09-10T22:36:28.627 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_skipped": 0 2024-09-10T22:36:28.627 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:36:28.628 INFO:teuthology.orchestra.run.smithi019.stdout: "4c99964e-2e0e-4ffd-8cb8-99c4979ed90f": { 2024-09-10T22:36:28.628 INFO:teuthology.orchestra.run.smithi019.stdout: "start_time": "2024-09-10T22:32:34.659639+0000", 2024-09-10T22:36:28.628 INFO:teuthology.orchestra.run.smithi019.stdout: "path": "/", 2024-09-10T22:36:28.628 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_started": 0, 2024-09-10T22:36:28.628 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_passed": 0, 2024-09-10T22:36:28.628 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_failed": 0, 2024-09-10T22:36:28.628 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_skipped": 0 2024-09-10T22:36:28.628 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:36:28.628 INFO:teuthology.orchestra.run.smithi019.stdout: "9efe684b-7583-402e-a46e-e262a37e1af5": { 2024-09-10T22:36:28.628 INFO:teuthology.orchestra.run.smithi019.stdout: "start_time": "2024-09-10T22:34:09.479768+0000", 2024-09-10T22:36:28.628 INFO:teuthology.orchestra.run.smithi019.stdout: "path": "/", 2024-09-10T22:36:28.628 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_started": 0, 2024-09-10T22:36:28.628 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_passed": 0, 2024-09-10T22:36:28.629 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_failed": 0, 2024-09-10T22:36:28.629 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_skipped": 0 2024-09-10T22:36:28.629 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:36:28.629 INFO:teuthology.orchestra.run.smithi019.stdout: "eb518e3c-a71e-4f32-9ca0-ae88930ca218": { 2024-09-10T22:36:28.629 INFO:teuthology.orchestra.run.smithi019.stdout: "start_time": "2024-09-10T22:28:38.366352+0000", 2024-09-10T22:36:28.629 INFO:teuthology.orchestra.run.smithi019.stdout: "path": "/", 2024-09-10T22:36:28.629 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_started": 0, 2024-09-10T22:36:28.629 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_passed": 0, 2024-09-10T22:36:28.629 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_failed": 0, 2024-09-10T22:36:28.629 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_skipped": 0 2024-09-10T22:36:28.629 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:36:28.629 INFO:teuthology.orchestra.run.smithi019.stdout: "8f3bb3bf-911f-490c-9856-c80ea220dbbe": { 2024-09-10T22:36:28.629 INFO:teuthology.orchestra.run.smithi019.stdout: "start_time": "2024-09-10T22:29:25.374415+0000", 2024-09-10T22:36:28.630 INFO:teuthology.orchestra.run.smithi019.stdout: "path": "/", 2024-09-10T22:36:28.630 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_started": 0, 2024-09-10T22:36:28.630 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_passed": 0, 2024-09-10T22:36:28.630 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_failed": 0, 2024-09-10T22:36:28.630 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_skipped": 0 2024-09-10T22:36:28.630 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:36:28.630 INFO:teuthology.orchestra.run.smithi019.stdout: "fd1f1837-dcfa-4d88-99e8-2509f36c3f98": { 2024-09-10T22:36:28.630 INFO:teuthology.orchestra.run.smithi019.stdout: "start_time": "2024-09-10T22:30:12.470477+0000", 2024-09-10T22:36:28.630 INFO:teuthology.orchestra.run.smithi019.stdout: "path": "/", 2024-09-10T22:36:28.630 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_started": 0, 2024-09-10T22:36:28.630 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_passed": 0, 2024-09-10T22:36:28.630 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_failed": 0, 2024-09-10T22:36:28.631 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_skipped": 0 2024-09-10T22:36:28.631 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:36:28.631 INFO:teuthology.orchestra.run.smithi019.stdout: "715ec863-8a9d-45b6-967f-59b15ce1bf12": { 2024-09-10T22:36:28.631 INFO:teuthology.orchestra.run.smithi019.stdout: "start_time": "2024-09-10T22:31:00.669516+0000", 2024-09-10T22:36:28.631 INFO:teuthology.orchestra.run.smithi019.stdout: "path": "/", 2024-09-10T22:36:28.631 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_started": 0, 2024-09-10T22:36:28.631 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_passed": 0, 2024-09-10T22:36:28.631 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_failed": 0, 2024-09-10T22:36:28.631 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_skipped": 0 2024-09-10T22:36:28.631 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:36:28.631 INFO:teuthology.orchestra.run.smithi019.stdout: "0b81ea61-0b8e-4f2c-a58f-ef1019289fc9": { 2024-09-10T22:36:28.631 INFO:teuthology.orchestra.run.smithi019.stdout: "start_time": "2024-09-10T22:31:48.141568+0000", 2024-09-10T22:36:28.631 INFO:teuthology.orchestra.run.smithi019.stdout: "path": "/", 2024-09-10T22:36:28.631 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_started": 0, 2024-09-10T22:36:28.632 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_passed": 0, 2024-09-10T22:36:28.632 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_failed": 0, 2024-09-10T22:36:28.632 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_skipped": 0 2024-09-10T22:36:28.632 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:36:28.632 INFO:teuthology.orchestra.run.smithi019.stdout: "a77606c2-7618-413e-8aba-f9783ecbf435": { 2024-09-10T22:36:28.632 INFO:teuthology.orchestra.run.smithi019.stdout: "start_time": "2024-09-10T22:34:54.453894+0000", 2024-09-10T22:36:28.632 INFO:teuthology.orchestra.run.smithi019.stdout: "path": "/", 2024-09-10T22:36:28.632 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_started": 0, 2024-09-10T22:36:28.632 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_passed": 0, 2024-09-10T22:36:28.632 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_failed": 0, 2024-09-10T22:36:28.632 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_skipped": 0 2024-09-10T22:36:28.632 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:36:28.632 INFO:teuthology.orchestra.run.smithi019.stdout: "448b10e7-494c-4a88-a9ab-186159c5dfdd": { 2024-09-10T22:36:28.633 INFO:teuthology.orchestra.run.smithi019.stdout: "start_time": "2024-09-10T22:33:21.208716+0000", 2024-09-10T22:36:28.633 INFO:teuthology.orchestra.run.smithi019.stdout: "path": "/", 2024-09-10T22:36:28.633 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_started": 0, 2024-09-10T22:36:28.633 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_passed": 0, 2024-09-10T22:36:28.633 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_failed": 0, 2024-09-10T22:36:28.633 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_skipped": 0 2024-09-10T22:36:28.633 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:36:28.633 INFO:teuthology.orchestra.run.smithi019.stdout: "1a6e9f60-01cc-4339-aff0-9ef63cbda443": { 2024-09-10T22:36:28.633 INFO:teuthology.orchestra.run.smithi019.stdout: "start_time": "2024-09-10T22:35:40.561000+0000", 2024-09-10T22:36:28.633 INFO:teuthology.orchestra.run.smithi019.stdout: "path": "/", 2024-09-10T22:36:28.633 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_started": 0, 2024-09-10T22:36:28.633 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_passed": 0, 2024-09-10T22:36:28.633 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_failed": 0, 2024-09-10T22:36:28.634 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_skipped": 0 2024-09-10T22:36:28.634 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-10T22:36:28.634 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-10T22:36:28.634 INFO:teuthology.orchestra.run.smithi019.stdout:} 2024-09-10T22:36:28.634 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:28.470+0000 7f81fbfff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f6ced320a0 0x55f6ced42690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:36:28.634 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:28.470+0000 7f8200e12640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55f6ced42d60 0x55f6ced40160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:43374/0 (socket says 172.21.15.19:43374) 2024-09-10T22:36:28.634 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:28.470+0000 7f8200e12640 1 -- 172.21.15.19:0/2918694610 learned_addr learned my addr 172.21.15.19:0/2918694610 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:36:28.635 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:28.470+0000 7f81fbfff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f6ced320a0 0x55f6ced42690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.19:53272/0 (socket says 172.21.15.19:53272) 2024-09-10T22:36:28.635 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:28.470+0000 7f81f3fff640 1 --2- 172.21.15.19:0/2918694610 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55f6ced329c0 0x55f6ced3fae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:36:28.635 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:28.470+0000 7f8200e12640 1 -- 172.21.15.19:0/2918694610 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55f6ced329c0 msgr2=0x55f6ced3fae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:36:28.635 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:28.470+0000 7f8200e12640 1 --2- 172.21.15.19:0/2918694610 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55f6ced329c0 0x55f6ced3fae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:36:28.635 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:28.470+0000 7f8200e12640 1 -- 172.21.15.19:0/2918694610 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f6ced320a0 msgr2=0x55f6ced42690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:36:28.635 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:28.470+0000 7f8200e12640 1 --2- 172.21.15.19:0/2918694610 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f6ced320a0 0x55f6ced42690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:36:28.635 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:28.470+0000 7f8200e12640 1 -- 172.21.15.19:0/2918694610 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f6cec60c40 con 0x55f6ced42d60 2024-09-10T22:36:28.635 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:28.470+0000 7f81f3fff640 1 --2- 172.21.15.19:0/2918694610 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55f6ced329c0 0x55f6ced3fae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T22:36:28.635 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:28.470+0000 7f81fbfff640 1 --2- 172.21.15.19:0/2918694610 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f6ced320a0 0x55f6ced42690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T22:36:28.635 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:28.470+0000 7f8200e12640 1 --2- 172.21.15.19:0/2918694610 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55f6ced42d60 0x55f6ced40160 secure :-1 s=READY pgs=821 cs=0 l=1 rev1=1 crypto rx=0x7f81f40126f0 tx=0x7f81f4004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ea5ea6832e94ed68 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:36:28.635 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:28.470+0000 7f81db7fe640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-10T22:36:28.635 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:28.471+0000 7f81db7fe640 1 -- 172.21.15.19:0/2918694610 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81f40107d0 con 0x55f6ced42d60 2024-09-10T22:36:28.635 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:28.471+0000 7f81db7fe640 1 -- 172.21.15.19:0/2918694610 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8327+0+0 (secure 0 0 0) 0x7f81f4010970 con 0x55f6ced42d60 2024-09-10T22:36:28.636 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:28.471+0000 7f8204c4a740 1 -- 172.21.15.19:0/2918694610 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f81e40041d0 con 0x55f6ced42d60 2024-09-10T22:36:28.636 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:28.471+0000 7f81db7fe640 1 -- 172.21.15.19:0/2918694610 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f81f4010b70 con 0x55f6ced42d60 2024-09-10T22:36:28.636 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:28.471+0000 7f8204c4a740 10 client.17394 fetch_fsmap learned FSMap version 27 2024-09-10T22:36:28.636 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:28.471+0000 7f8204c4a740 1 -- 172.21.15.19:0/2918694610 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55f6ced513e0 con 0x55f6ced42d60 2024-09-10T22:36:28.636 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:28.471+0000 7f81db7fe640 1 -- 172.21.15.19:0/2918694610 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f81e40041d0 con 0x55f6ced42d60 2024-09-10T22:36:28.636 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:28.471+0000 7f81db7fe640 1 -- 172.21.15.19:0/2918694610 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7f81f400f040 con 0x55f6ced42d60 2024-09-10T22:36:28.636 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:28.471+0000 7f8204c4a740 10 client.17394 fetch_fsmap finished waiting for FSMap version 27 2024-09-10T22:36:28.636 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:28.471+0000 7f8204c4a740 10 client.17394 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-10T22:36:28.636 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:28.471+0000 7f8204c4a740 20 client.17394 populate_metadata read hostname 'smithi019' 2024-09-10T22:36:28.636 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:28.471+0000 7f8204c4a740 1 --2- 172.21.15.19:0/2918694610 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x55f6ced52940 0x55f6ced54d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:36:28.636 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:28.471+0000 7f8204c4a740 4 client.17394 mds_command: new command op to 24581 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T22:36:28.636 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:28.471+0000 7f8204c4a740 1 -- 172.21.15.19:0/2918694610 --> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f6cecaada0 con 0x55f6ced52940 2024-09-10T22:36:28.637 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:28.471+0000 7f81fbfff640 1 --2- 172.21.15.19:0/2918694610 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x55f6ced52940 0x55f6ced54d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:36:28.637 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:28.472+0000 7f81db7fe640 10 client.17394 ms_handle_connect on v2:172.21.15.135:6838/1254769802 2024-09-10T22:36:28.637 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:28.472+0000 7f81fbfff640 1 --2- 172.21.15.19:0/2918694610 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x55f6ced52940 0x55f6ced54d80 crc :-1 s=READY pgs=202 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=406e99a538992162 server_cookie=8f5eae61e49cecef in_seq=0 out_seq=0 2024-09-10T22:36:28.637 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:28.472+0000 7f81db7fe640 1 -- 172.21.15.19:0/2918694610 <== mds.0 v2:172.21.15.135:6838/1254769802 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55f6cecaada0 con 0x55f6ced52940 2024-09-10T22:36:28.637 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:28.472+0000 7f81db7fe640 10 client.17394 handle_command_reply: tid=0 2024-09-10T22:36:28.637 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:28.472+0000 7f8204c4a740 1 client.17394 shutdown 2024-09-10T22:36:28.637 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:28.473+0000 7f8204c4a740 1 -- 172.21.15.19:0/2918694610 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55f6ced42d60 msgr2=0x55f6ced40160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:36:28.637 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:28.473+0000 7f8204c4a740 1 --2- 172.21.15.19:0/2918694610 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55f6ced42d60 0x55f6ced40160 secure :-1 s=READY pgs=821 cs=0 l=1 rev1=1 crypto rx=0x7f81f40126f0 tx=0x7f81f4004ab0 comp rx=0 tx=0).stop 2024-09-10T22:36:28.637 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:28.473+0000 7f8204c4a740 1 -- 172.21.15.19:0/2918694610 shutdown_connections 2024-09-10T22:36:28.637 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:28.473+0000 7f8204c4a740 1 --2- 172.21.15.19:0/2918694610 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55f6ced42d60 0x55f6ced40160 unknown :-1 s=CLOSED pgs=821 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:36:28.637 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:28.473+0000 7f8204c4a740 1 --2- 172.21.15.19:0/2918694610 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x55f6ced52940 0x55f6ced54d80 crc :-1 s=READY pgs=202 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:36:28.637 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:28.473+0000 7f8204c4a740 1 --2- 172.21.15.19:0/2918694610 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55f6ced329c0 0x55f6ced3fae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:36:28.637 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:28.473+0000 7f8204c4a740 1 --2- 172.21.15.19:0/2918694610 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f6ced320a0 0x55f6ced42690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:36:28.638 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:28.473+0000 7f8204c4a740 1 -- 172.21.15.19:0/2918694610 >> 172.21.15.19:0/2918694610 conn(0x55f6ced2fed0 msgr2=0x55f6ced35a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:36:28.638 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:28.473+0000 7f81db7fe640 0 client.17394 ms_handle_reset on v2:172.21.15.135:6838/1254769802 2024-09-10T22:36:28.638 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:28.473+0000 7f8204c4a740 1 -- 172.21.15.19:0/2918694610 shutdown_connections 2024-09-10T22:36:28.638 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:28.473+0000 7f8204c4a740 1 -- 172.21.15.19:0/2918694610 wait complete. 2024-09-10T22:36:28.638 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:28.473+0000 7f8204c4a740 20 client.17394 trim_cache size 0 max 16384 2024-09-10T22:36:28.638 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:28.506+0000 7f8204c4a740 1 Processor -- start 2024-09-10T22:36:28.638 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:28.506+0000 7f8204c4a740 1 -- start start 2024-09-10T22:36:28.638 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:28.506+0000 7f8204c4a740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f6ced320a0 0x55f6ced2f710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:36:28.638 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:28.506+0000 7f8204c4a740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55f6ced329c0 0x55f6ced4ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:36:28.638 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:28.506+0000 7f8204c4a740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55f6ced42d60 0x55f6ced30d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:36:28.638 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:28.506+0000 7f8204c4a740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f81fc1aecc0 con 0x55f6ced329c0 2024-09-10T22:36:28.638 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:28.506+0000 7f8204c4a740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f81fc1ac590 con 0x55f6ced320a0 2024-09-10T22:36:28.639 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:28.506+0000 7f8204c4a740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f81fc1aa3e0 con 0x55f6ced42d60 2024-09-10T22:36:28.639 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:28.507+0000 7f81fbfff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f6ced320a0 0x55f6ced2f710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:36:28.639 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:28.507+0000 7f81f3fff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55f6ced329c0 0x55f6ced4ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:36:28.639 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:28.507+0000 7f81f3fff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55f6ced329c0 0x55f6ced4ec40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:43388/0 (socket says 172.21.15.19:43388) 2024-09-10T22:36:28.639 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:28.507+0000 7f81f3fff640 1 -- 172.21.15.19:0/237711380 learned_addr learned my addr 172.21.15.19:0/237711380 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:36:28.639 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:28.507+0000 7f8200e12640 1 --2- 172.21.15.19:0/237711380 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55f6ced42d60 0x55f6ced30d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:36:28.639 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:28.507+0000 7f81f3fff640 1 -- 172.21.15.19:0/237711380 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55f6ced42d60 msgr2=0x55f6ced30d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:36:28.639 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:28.507+0000 7f81f3fff640 1 --2- 172.21.15.19:0/237711380 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55f6ced42d60 0x55f6ced30d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:36:28.639 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:28.507+0000 7f81f3fff640 1 -- 172.21.15.19:0/237711380 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f6ced320a0 msgr2=0x55f6ced2f710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:36:28.639 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:28.507+0000 7f81f3fff640 1 --2- 172.21.15.19:0/237711380 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f6ced320a0 0x55f6ced2f710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:36:28.639 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:28.507+0000 7f81f3fff640 1 -- 172.21.15.19:0/237711380 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f6ced3dfe0 con 0x55f6ced329c0 2024-09-10T22:36:28.639 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:28.507+0000 7f81fbfff640 1 --2- 172.21.15.19:0/237711380 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f6ced320a0 0x55f6ced2f710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T22:36:28.639 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:28.507+0000 7f8200e12640 1 --2- 172.21.15.19:0/237711380 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55f6ced42d60 0x55f6ced30d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T22:36:28.640 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:28.508+0000 7f81f3fff640 1 --2- 172.21.15.19:0/237711380 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55f6ced329c0 0x55f6ced4ec40 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 crypto rx=0x7f81e400bce0 tx=0x7f81e400bbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=70b4261b4394d24d server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:36:28.640 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:28.509+0000 7f81f1ffb640 1 -- 172.21.15.19:0/237711380 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81e402a070 con 0x55f6ced329c0 2024-09-10T22:36:28.640 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:28.509+0000 7f81f1ffb640 1 -- 172.21.15.19:0/237711380 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f81e4005040 con 0x55f6ced329c0 2024-09-10T22:36:28.640 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:28.509+0000 7f81f1ffb640 1 -- 172.21.15.19:0/237711380 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81e4025880 con 0x55f6ced329c0 2024-09-10T22:36:28.640 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:28.510+0000 7f8204c4a740 1 -- 172.21.15.19:0/237711380 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55f6ced329c0 msgr2=0x55f6ced4ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:36:28.640 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:28.510+0000 7f8204c4a740 1 --2- 172.21.15.19:0/237711380 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55f6ced329c0 0x55f6ced4ec40 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 crypto rx=0x7f81e400bce0 tx=0x7f81e400bbb0 comp rx=0 tx=0).stop 2024-09-10T22:36:28.640 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:28.510+0000 7f8204c4a740 1 -- 172.21.15.19:0/237711380 shutdown_connections 2024-09-10T22:36:28.640 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:28.510+0000 7f8204c4a740 1 --2- 172.21.15.19:0/237711380 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55f6ced42d60 0x55f6ced30d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:36:28.640 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:28.510+0000 7f8204c4a740 1 --2- 172.21.15.19:0/237711380 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55f6ced329c0 0x55f6ced4ec40 unknown :-1 s=CLOSED pgs=822 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:36:28.640 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:28.510+0000 7f8204c4a740 1 --2- 172.21.15.19:0/237711380 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f6ced320a0 0x55f6ced2f710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:36:28.640 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:28.510+0000 7f8204c4a740 1 -- 172.21.15.19:0/237711380 >> 172.21.15.19:0/237711380 conn(0x55f6ced2fed0 msgr2=0x55f6ced54950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:36:28.640 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:28.511+0000 7f8204c4a740 1 -- 172.21.15.19:0/237711380 shutdown_connections 2024-09-10T22:36:28.640 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:28.511+0000 7f8204c4a740 1 -- 172.21.15.19:0/237711380 wait complete. 2024-09-10T22:36:28.641 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:28.511+0000 7f8204c4a740 1 -- start start 2024-09-10T22:36:28.641 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:28.512+0000 7f8204c4a740 1 Processor -- start 2024-09-10T22:36:28.641 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:28.512+0000 7f8204c4a740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55f6ced320a0 0x55f6ced39270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:36:28.641 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:28.512+0000 7f8204c4a740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f6ced329c0 0x55f6ced397b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:36:28.641 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:28.513+0000 7f8204c4a740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55f6ced42d60 0x55f6ced49c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:36:28.641 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:28.513+0000 7f81fbfff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55f6ced320a0 0x55f6ced39270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:36:28.641 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:28.513+0000 7f81fbfff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55f6ced320a0 0x55f6ced39270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:43394/0 (socket says 172.21.15.19:43394) 2024-09-10T22:36:28.641 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:28.513+0000 7f81fbfff640 1 -- 172.21.15.19:0/683485544 learned_addr learned my addr 172.21.15.19:0/683485544 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:36:28.641 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:28.513+0000 7f8204c4a740 1 -- 172.21.15.19:0/683485544 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f81fc1aaa50 con 0x55f6ced320a0 2024-09-10T22:36:28.641 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:28.513+0000 7f81f3fff640 1 --2- 172.21.15.19:0/683485544 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f6ced329c0 0x55f6ced397b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:36:28.641 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:28.513+0000 7f8204c4a740 1 -- 172.21.15.19:0/683485544 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f81fc1abec0 con 0x55f6ced329c0 2024-09-10T22:36:28.641 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:28.513+0000 7f8204c4a740 1 -- 172.21.15.19:0/683485544 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f81fc1ab120 con 0x55f6ced42d60 2024-09-10T22:36:28.641 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:28.513+0000 7f8204c4a740 10 client.0 _ll_register_callbacks cb 0x7f81f4004860 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T22:36:28.642 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:28.514+0000 7f8200e12640 1 --2- 172.21.15.19:0/683485544 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55f6ced42d60 0x55f6ced49c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:36:28.642 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:28.514+0000 7f81fbfff640 1 -- 172.21.15.19:0/683485544 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55f6ced42d60 msgr2=0x55f6ced49c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:36:28.642 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:28.514+0000 7f81fbfff640 1 --2- 172.21.15.19:0/683485544 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55f6ced42d60 0x55f6ced49c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:36:28.642 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:28.514+0000 7f81fbfff640 1 -- 172.21.15.19:0/683485544 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f6ced329c0 msgr2=0x55f6ced397b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:36:28.642 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:28.514+0000 7f81fbfff640 1 --2- 172.21.15.19:0/683485544 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f6ced329c0 0x55f6ced397b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:36:28.642 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:28.514+0000 7f81fbfff640 1 -- 172.21.15.19:0/683485544 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f6ced4a1d0 con 0x55f6ced320a0 2024-09-10T22:36:28.642 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:28.514+0000 7f8200e12640 1 --2- 172.21.15.19:0/683485544 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55f6ced42d60 0x55f6ced49c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T22:36:28.642 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:28.514+0000 7f81f3fff640 1 --2- 172.21.15.19:0/683485544 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f6ced329c0 0x55f6ced397b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T22:36:28.642 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:28.514+0000 7f81fbfff640 1 --2- 172.21.15.19:0/683485544 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55f6ced320a0 0x55f6ced39270 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 crypto rx=0x7f81ec0ce310 tx=0x7f81ec109350 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f145e55d8296ef26 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:36:28.642 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:28.514+0000 7f81db7fe640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-10T22:36:28.642 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:28.515+0000 7f81db7fe640 1 -- 172.21.15.19:0/683485544 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81ec031e60 con 0x55f6ced320a0 2024-09-10T22:36:28.642 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:28.515+0000 7f81db7fe640 1 -- 172.21.15.19:0/683485544 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8327+0+0 (secure 0 0 0) 0x7f81ec038d90 con 0x55f6ced320a0 2024-09-10T22:36:28.643 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:28.515+0000 7f8204c4a740 1 -- 172.21.15.19:0/683485544 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f81e4005040 con 0x55f6ced320a0 2024-09-10T22:36:28.643 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:28.516+0000 7f81db7fe640 1 -- 172.21.15.19:0/683485544 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f81ec0ce150 con 0x55f6ced320a0 2024-09-10T22:36:28.643 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:28.516+0000 7f8204c4a740 10 client.17400 fetch_fsmap learned FSMap version 27 2024-09-10T22:36:28.643 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:28.516+0000 7f8204c4a740 1 -- 172.21.15.19:0/683485544 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55f6ced4b430 con 0x55f6ced320a0 2024-09-10T22:36:28.643 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:28.517+0000 7f81db7fe640 1 -- 172.21.15.19:0/683485544 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f81ec0d7250 con 0x55f6ced320a0 2024-09-10T22:36:28.643 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:28.517+0000 7f81db7fe640 1 -- 172.21.15.19:0/683485544 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7f81ec0f51a0 con 0x55f6ced320a0 2024-09-10T22:36:28.643 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:28.517+0000 7f8204c4a740 10 client.17400 fetch_fsmap finished waiting for FSMap version 27 2024-09-10T22:36:28.643 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:28.517+0000 7f8204c4a740 10 client.17400 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-10T22:36:28.643 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:28.517+0000 7f8204c4a740 20 client.17400 populate_metadata read hostname 'smithi019' 2024-09-10T22:36:28.643 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:28.517+0000 7f8204c4a740 1 --2- 172.21.15.19:0/683485544 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x55f6ced4b830 0x55f6cedc6050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:36:28.643 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:28.517+0000 7f8204c4a740 4 client.17400 mds_command: new command op to 24581 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-10T22:36:28.643 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:28.517+0000 7f8204c4a740 1 -- 172.21.15.19:0/683485544 --> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] -- command(tid 0: {"prefix": "scrub status"}) -- 0x7f81e4005040 con 0x55f6ced4b830 2024-09-10T22:36:28.643 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:28.518+0000 7f81f3fff640 1 --2- 172.21.15.19:0/683485544 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x55f6ced4b830 0x55f6cedc6050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:36:28.643 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:28.519+0000 7f81f3fff640 1 --2- 172.21.15.19:0/683485544 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x55f6ced4b830 0x55f6cedc6050 crc :-1 s=READY pgs=203 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bd57d50b2d6b473c server_cookie=8b5143c95b300f32 in_seq=0 out_seq=0 2024-09-10T22:36:28.643 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:28.519+0000 7f81db7fe640 10 client.17400 ms_handle_connect on v2:172.21.15.135:6838/1254769802 2024-09-10T22:36:28.644 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:28.519+0000 7f81db7fe640 1 -- 172.21.15.19:0/683485544 <== mds.0 v2:172.21.15.135:6838/1254769802 1 ==== command_reply(tid 0: 0 ) ==== 8+0+4262 (crc 0 0 0) 0x7f81e4005040 con 0x55f6ced4b830 2024-09-10T22:36:28.644 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:28.519+0000 7f81db7fe640 10 client.17400 handle_command_reply: tid=0 2024-09-10T22:36:28.644 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:28.519+0000 7f8204c4a740 1 client.17400 shutdown 2024-09-10T22:36:28.644 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:28.520+0000 7f8204c4a740 1 -- 172.21.15.19:0/683485544 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55f6ced320a0 msgr2=0x55f6ced39270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:36:28.644 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:28.520+0000 7f8204c4a740 1 --2- 172.21.15.19:0/683485544 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55f6ced320a0 0x55f6ced39270 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 crypto rx=0x7f81ec0ce310 tx=0x7f81ec109350 comp rx=0 tx=0).stop 2024-09-10T22:36:28.644 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:28.520+0000 7f8204c4a740 1 -- 172.21.15.19:0/683485544 shutdown_connections 2024-09-10T22:36:28.644 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:28.520+0000 7f8204c4a740 1 --2- 172.21.15.19:0/683485544 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x55f6ced4b830 0x55f6cedc6050 crc :-1 s=READY pgs=203 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:36:28.644 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:28.520+0000 7f8204c4a740 1 --2- 172.21.15.19:0/683485544 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55f6ced42d60 0x55f6ced49c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:36:28.644 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:28.520+0000 7f81db7fe640 0 client.17400 ms_handle_reset on v2:172.21.15.135:6838/1254769802 2024-09-10T22:36:28.644 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:28.520+0000 7f8204c4a740 1 --2- 172.21.15.19:0/683485544 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f6ced329c0 0x55f6ced397b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:36:28.644 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:28.520+0000 7f8204c4a740 1 --2- 172.21.15.19:0/683485544 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55f6ced320a0 0x55f6ced39270 unknown :-1 s=CLOSED pgs=823 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:36:28.644 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:28.520+0000 7f8204c4a740 1 -- 172.21.15.19:0/683485544 >> 172.21.15.19:0/683485544 conn(0x55f6ced2fed0 msgr2=0x55f6ced43c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:36:28.644 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:28.521+0000 7f8204c4a740 1 -- 172.21.15.19:0/683485544 shutdown_connections 2024-09-10T22:36:28.645 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:28.522+0000 7f8204c4a740 1 -- 172.21.15.19:0/683485544 wait complete. 2024-09-10T22:36:28.645 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:28.522+0000 7f8204c4a740 20 client.17400 trim_cache size 0 max 16384 2024-09-10T22:36:28.645 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:28.523+0000 7f8202875640 1 -- 172.21.15.19:0/1886629121 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f81e80b5360 msgr2=0x7f81e80b7820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:36:28.645 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:28.523+0000 7f8202875640 1 --2- 172.21.15.19:0/1886629121 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f81e80b5360 0x7f81e80b7820 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f81f4005fd0 tx=0x7f81f4004a40 comp rx=0 tx=0).stop 2024-09-10T22:36:28.645 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:28.523+0000 7f8202875640 1 -- 172.21.15.19:0/1886629121 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f81fc101cc0 msgr2=0x7f81fc198290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:36:28.645 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:28.523+0000 7f8202875640 1 --2- 172.21.15.19:0/1886629121 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f81fc101cc0 0x7f81fc198290 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 crypto rx=0x7f81ec005ab0 tx=0x7f81ec003cd0 comp rx=0 tx=0).stop 2024-09-10T22:36:28.645 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:28.524+0000 7f8202875640 1 -- 172.21.15.19:0/1886629121 shutdown_connections 2024-09-10T22:36:28.645 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:28.524+0000 7f8202875640 1 --2- 172.21.15.19:0/1886629121 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f81e80b5360 0x7f81e80b7820 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:36:28.645 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:28.524+0000 7f8202875640 1 --2- 172.21.15.19:0/1886629121 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f81fc108050 0x7f81fc19db70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:36:28.645 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:28.524+0000 7f8202875640 1 --2- 172.21.15.19:0/1886629121 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f81fc1076d0 0x7f81fc1987d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:36:28.645 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:28.524+0000 7f8202875640 1 --2- 172.21.15.19:0/1886629121 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f81fc101cc0 0x7f81fc198290 unknown :-1 s=CLOSED pgs=819 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:36:28.645 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:28.524+0000 7f8202875640 1 -- 172.21.15.19:0/1886629121 >> 172.21.15.19:0/1886629121 conn(0x7f81fc0fd770 msgr2=0x7f81fc105a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:36:28.645 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:28.527+0000 7f8202875640 1 -- 172.21.15.19:0/1886629121 shutdown_connections 2024-09-10T22:36:28.645 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:36:28.528+0000 7f8202875640 1 -- 172.21.15.19:0/1886629121 wait complete. 2024-09-10T22:36:29.652 INFO:tasks.cephfs.filesystem:scrub status for tag:abfbdc16-212b-47f2-b921-c2a1cae322e5 - {'path': '/', 'tag': 'abfbdc16-212b-47f2-b921-c2a1cae322e5', 'options': 'recursive,force'} 2024-09-10T22:36:30.360 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:36:30 smithi135 ceph-mon[34789]: pgmap v649: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 296 KiB/s rd, 172 MiB/s wr, 856 op/s 2024-09-10T22:36:30.375 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:36:30 smithi138 ceph-mon[35236]: pgmap v649: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 296 KiB/s rd, 172 MiB/s wr, 856 op/s 2024-09-10T22:36:30.458 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:36:30 smithi019 ceph-mon[31375]: pgmap v649: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 296 KiB/s rd, 172 MiB/s wr, 856 op/s 2024-09-10T22:36:32.360 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:36:32 smithi135 ceph-mon[34789]: pgmap v650: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 540 KiB/s rd, 201 MiB/s wr, 1.04k op/s 2024-09-10T22:36:32.375 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:36:32 smithi138 ceph-mon[35236]: pgmap v650: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 540 KiB/s rd, 201 MiB/s wr, 1.04k op/s 2024-09-10T22:36:32.458 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:36:32 smithi019 ceph-mon[31375]: pgmap v650: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 540 KiB/s rd, 201 MiB/s wr, 1.04k op/s 2024-09-10T22:36:33.360 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:36:33 smithi135 ceph-mon[34789]: scrub summary: idle 2024-09-10T22:36:33.360 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:36:33 smithi135 ceph-mon[34789]: scrub summary: idle 2024-09-10T22:36:33.375 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:36:33 smithi138 ceph-mon[35236]: scrub summary: idle 2024-09-10T22:36:33.375 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:36:33 smithi138 ceph-mon[35236]: scrub summary: idle 2024-09-10T22:36:33.458 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:36:33 smithi019 ceph-mon[31375]: scrub summary: idle 2024-09-10T22:36:33.459 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:36:33 smithi019 ceph-mon[31375]: scrub summary: idle 2024-09-10T22:36:34.375 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:36:34 smithi138 ceph-mon[35236]: pgmap v651: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 541 KiB/s rd, 186 MiB/s wr, 968 op/s 2024-09-10T22:36:34.459 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:36:34 smithi019 ceph-mon[31375]: pgmap v651: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 541 KiB/s rd, 186 MiB/s wr, 968 op/s 2024-09-10T22:36:34.610 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:36:34 smithi135 ceph-mon[34789]: pgmap v651: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 541 KiB/s rd, 186 MiB/s wr, 968 op/s 2024-09-10T22:36:36.458 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:36:36 smithi019 ceph-mon[31375]: pgmap v652: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 364 KiB/s rd, 181 MiB/s wr, 935 op/s 2024-09-10T22:36:36.610 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:36:36 smithi135 ceph-mon[34789]: pgmap v652: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 364 KiB/s rd, 181 MiB/s wr, 935 op/s 2024-09-10T22:36:36.625 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:36:36 smithi138 ceph-mon[35236]: pgmap v652: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 364 KiB/s rd, 181 MiB/s wr, 935 op/s 2024-09-10T22:36:38.458 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:36:38 smithi019 ceph-mon[31375]: pgmap v653: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 547 KiB/s rd, 207 MiB/s wr, 1.08k op/s 2024-09-10T22:36:38.610 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:36:38 smithi135 ceph-mon[34789]: pgmap v653: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 547 KiB/s rd, 207 MiB/s wr, 1.08k op/s 2024-09-10T22:36:38.625 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:36:38 smithi138 ceph-mon[35236]: pgmap v653: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 547 KiB/s rd, 207 MiB/s wr, 1.08k op/s 2024-09-10T22:36:40.439 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:40.437+0000 7f8eaa59f640 1 -- 172.21.15.19:0/887948563 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8ea4105920 msgr2=0x7f8ea4107d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:36:40.439 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:40.437+0000 7f8eaa59f640 1 --2- 172.21.15.19:0/887948563 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8ea4105920 0x7f8ea4107d70 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 crypto rx=0x7f8e94009900 tx=0x7f8e9402a3f0 comp rx=0 tx=0).stop 2024-09-10T22:36:40.439 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:40.437+0000 7f8eaa59f640 1 -- 172.21.15.19:0/887948563 shutdown_connections 2024-09-10T22:36:40.439 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:40.437+0000 7f8eaa59f640 1 --2- 172.21.15.19:0/887948563 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8ea41084b0 0x7f8ea410a970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:36:40.440 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:40.437+0000 7f8eaa59f640 1 --2- 172.21.15.19:0/887948563 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8ea4105920 0x7f8ea4107d70 unknown :-1 s=CLOSED pgs=824 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:36:40.440 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:40.437+0000 7f8eaa59f640 1 --2- 172.21.15.19:0/887948563 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f8ea406b3f0 0x7f8ea41053e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:36:40.440 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:40.437+0000 7f8eaa59f640 1 -- 172.21.15.19:0/887948563 >> 172.21.15.19:0/887948563 conn(0x7f8ea40fcf30 msgr2=0x7f8ea40ff370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:36:40.440 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:40.437+0000 7f8eaa59f640 1 -- 172.21.15.19:0/887948563 shutdown_connections 2024-09-10T22:36:40.440 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:40.437+0000 7f8eaa59f640 1 -- 172.21.15.19:0/887948563 wait complete. 2024-09-10T22:36:40.442 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:40.438+0000 7f8eaa59f640 1 Processor -- start 2024-09-10T22:36:40.442 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:40.438+0000 7f8eaa59f640 1 -- start start 2024-09-10T22:36:40.442 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:40.438+0000 7f8eaa59f640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8ea406b3f0 0x7f8ea4198ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:36:40.442 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:40.438+0000 7f8eaa59f640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8ea4105920 0x7f8ea41991f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:36:40.442 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:40.438+0000 7f8eaa59f640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f8ea41084b0 0x7f8ea4199e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:36:40.442 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:40.438+0000 7f8eaa59f640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f8ea410e3e0 con 0x7f8ea4105920 2024-09-10T22:36:40.442 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:40.438+0000 7f8eaa59f640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f8ea410e260 con 0x7f8ea406b3f0 2024-09-10T22:36:40.442 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:40.438+0000 7f8eaa59f640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f8ea410e560 con 0x7f8ea41084b0 2024-09-10T22:36:40.443 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:40.438+0000 7f8ea8d9c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8ea4105920 0x7f8ea41991f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:36:40.443 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:40.438+0000 7f8ea9d9e640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f8ea41084b0 0x7f8ea4199e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:36:40.443 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:40.438+0000 7f8ea9d9e640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f8ea41084b0 0x7f8ea4199e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.19:53048/0 (socket says 172.21.15.19:53048) 2024-09-10T22:36:40.443 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:40.438+0000 7f8ea9d9e640 1 -- 172.21.15.19:0/987321181 learned_addr learned my addr 172.21.15.19:0/987321181 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:36:40.443 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:40.438+0000 7f8ea8d9c640 1 --2- 172.21.15.19:0/987321181 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8ea4105920 0x7f8ea41991f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:54998/0 (socket says 172.21.15.19:54998) 2024-09-10T22:36:40.443 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:40.439+0000 7f8ea959d640 1 --2- 172.21.15.19:0/987321181 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8ea406b3f0 0x7f8ea4198ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:36:40.443 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:40.439+0000 7f8ea9d9e640 1 -- 172.21.15.19:0/987321181 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8ea406b3f0 msgr2=0x7f8ea4198ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:36:40.443 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:40.439+0000 7f8ea9d9e640 1 --2- 172.21.15.19:0/987321181 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8ea406b3f0 0x7f8ea4198ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:36:40.443 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:40.439+0000 7f8ea9d9e640 1 -- 172.21.15.19:0/987321181 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8ea4105920 msgr2=0x7f8ea41991f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:36:40.443 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:40.439+0000 7f8ea9d9e640 1 --2- 172.21.15.19:0/987321181 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8ea4105920 0x7f8ea41991f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:36:40.443 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:40.439+0000 7f8ea9d9e640 1 -- 172.21.15.19:0/987321181 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8ea419a6e0 con 0x7f8ea41084b0 2024-09-10T22:36:40.443 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:40.439+0000 7f8ea9d9e640 1 --2- 172.21.15.19:0/987321181 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f8ea41084b0 0x7f8ea4199e20 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f8e9c00eb10 tx=0x7f8e9c00c2d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:36:40.443 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:40.439+0000 7f8e9a7fc640 1 -- 172.21.15.19:0/987321181 <== mon.1 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e9c004b20 con 0x7f8ea41084b0 2024-09-10T22:36:40.444 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:40.439+0000 7f8eaa59f640 1 -- 172.21.15.19:0/987321181 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8ea419a9d0 con 0x7f8ea41084b0 2024-09-10T22:36:40.444 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:40.439+0000 7f8e9a7fc640 1 -- 172.21.15.19:0/987321181 <== mon.1 v2:172.21.15.138:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8e9c004cc0 con 0x7f8ea41084b0 2024-09-10T22:36:40.444 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:40.439+0000 7f8e9a7fc640 1 -- 172.21.15.19:0/987321181 <== mon.1 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e9c010670 con 0x7f8ea41084b0 2024-09-10T22:36:40.444 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:40.439+0000 7f8eaa59f640 1 -- 172.21.15.19:0/987321181 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8ea41a10a0 con 0x7f8ea41084b0 2024-09-10T22:36:40.450 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:40.442+0000 7f8eae5ce740 1 Processor -- start 2024-09-10T22:36:40.450 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:40.442+0000 7f8e9a7fc640 1 -- 172.21.15.19:0/987321181 <== mon.1 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 18) ==== 153250+0+0 (secure 0 0 0) 0x7f8e9c005020 con 0x7f8ea41084b0 2024-09-10T22:36:40.450 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:40.442+0000 7f8eae5ce740 1 -- start start 2024-09-10T22:36:40.450 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:40.442+0000 7f8eae5ce740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55880dc1de70 0x55880dc20260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:36:40.450 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:40.442+0000 7f8eae5ce740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55880dc207a0 0x55880dc22b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:36:40.450 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:40.442+0000 7f8eae5ce740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55880dc231e0 0x55880dc256a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:36:40.450 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:40.442+0000 7f8eae5ce740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x55880db8b6f0 con 0x55880dc207a0 2024-09-10T22:36:40.451 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:40.442+0000 7f8eae5ce740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55880db7ab20 con 0x55880dc231e0 2024-09-10T22:36:40.451 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:40.442+0000 7f8eae5ce740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x55880db7e930 con 0x55880dc1de70 2024-09-10T22:36:40.451 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:40.442+0000 7f8ea959d640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55880dc207a0 0x55880dc22b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:36:40.451 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:40.442+0000 7f8ea959d640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55880dc207a0 0x55880dc22b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:55008/0 (socket says 172.21.15.19:55008) 2024-09-10T22:36:40.451 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:40.442+0000 7f8ea959d640 1 -- 172.21.15.19:0/2569817598 learned_addr learned my addr 172.21.15.19:0/2569817598 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:36:40.451 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:40.442+0000 7f8ea8d9c640 1 --2- 172.21.15.19:0/2569817598 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55880dc1de70 0x55880dc20260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:36:40.451 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:40.443+0000 7f8ea8d9c640 1 --2- 172.21.15.19:0/2569817598 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55880dc231e0 0x55880dc256a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:36:40.451 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:40.443+0000 7f8ea959d640 1 -- 172.21.15.19:0/2569817598 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55880dc1de70 msgr2=0x55880dc20260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:36:40.451 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:40.443+0000 7f8ea959d640 1 --2- 172.21.15.19:0/2569817598 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55880dc1de70 0x55880dc20260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:36:40.451 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:40.443+0000 7f8ea959d640 1 -- 172.21.15.19:0/2569817598 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55880dc231e0 msgr2=0x55880dc256a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:36:40.451 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:40.443+0000 7f8ea959d640 1 --2- 172.21.15.19:0/2569817598 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55880dc231e0 0x55880dc256a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:36:40.451 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:40.443+0000 7f8ea959d640 1 -- 172.21.15.19:0/2569817598 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55880db40530 con 0x55880dc207a0 2024-09-10T22:36:40.451 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:40.443+0000 7f8ea8d9c640 1 --2- 172.21.15.19:0/2569817598 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55880dc1de70 0x55880dc20260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T22:36:40.452 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:40.443+0000 7f8e9a7fc640 1 --2- 172.21.15.19:0/987321181 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f8e900b52e0 0x7f8e900b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:36:40.452 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:40.443+0000 7f8ea959d640 1 --2- 172.21.15.19:0/2569817598 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55880dc207a0 0x55880dc22b90 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 crypto rx=0x7f8ea000ad70 tx=0x7f8ea000f790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2c97a200fbbc0854 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:36:40.452 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:40.443+0000 7f8ea8d9c640 1 --2- 172.21.15.19:0/987321181 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f8e900b52e0 0x7f8e900b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:36:40.452 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:40.443+0000 7f8e9a7fc640 1 -- 172.21.15.19:0/987321181 <== mon.1 v2:172.21.15.138:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8327+0+0 (secure 0 0 0) 0x7f8e9c0e6160 con 0x7f8ea41084b0 2024-09-10T22:36:40.452 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:40.443+0000 7f8e8f7fe640 1 -- 172.21.15.19:0/2569817598 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ea001d070 con 0x55880dc207a0 2024-09-10T22:36:40.452 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:40.443+0000 7f8e8f7fe640 1 -- 172.21.15.19:0/2569817598 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8ea0010cf0 con 0x55880dc207a0 2024-09-10T22:36:40.452 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:40.443+0000 7f8e8f7fe640 1 -- 172.21.15.19:0/2569817598 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ea0018c20 con 0x55880dc207a0 2024-09-10T22:36:40.452 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:40.444+0000 7f8eae5ce740 1 -- 172.21.15.19:0/2569817598 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55880dc207a0 msgr2=0x55880dc22b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:36:40.452 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:40.444+0000 7f8eae5ce740 1 --2- 172.21.15.19:0/2569817598 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55880dc207a0 0x55880dc22b90 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 crypto rx=0x7f8ea000ad70 tx=0x7f8ea000f790 comp rx=0 tx=0).stop 2024-09-10T22:36:40.452 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:40.444+0000 7f8ea8d9c640 1 --2- 172.21.15.19:0/987321181 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f8e900b52e0 0x7f8e900b77a0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f8e94009230 tx=0x7f8e940314a0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:36:40.452 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:40.444+0000 7f8eae5ce740 1 -- 172.21.15.19:0/2569817598 shutdown_connections 2024-09-10T22:36:40.452 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:40.444+0000 7f8eae5ce740 1 --2- 172.21.15.19:0/2569817598 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55880dc231e0 0x55880dc256a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:36:40.453 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:40.444+0000 7f8eae5ce740 1 --2- 172.21.15.19:0/2569817598 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55880dc207a0 0x55880dc22b90 unknown :-1 s=CLOSED pgs=825 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:36:40.453 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:40.444+0000 7f8eae5ce740 1 --2- 172.21.15.19:0/2569817598 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55880dc1de70 0x55880dc20260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:36:40.453 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:40.444+0000 7f8eae5ce740 1 -- 172.21.15.19:0/2569817598 >> 172.21.15.19:0/2569817598 conn(0x55880dc14bb0 msgr2=0x55880dc15940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:36:40.453 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:40.444+0000 7f8eae5ce740 1 -- 172.21.15.19:0/2569817598 shutdown_connections 2024-09-10T22:36:40.453 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:40.444+0000 7f8eae5ce740 1 -- 172.21.15.19:0/2569817598 wait complete. 2024-09-10T22:36:40.453 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:40.445+0000 7f8eae5ce740 1 -- start start 2024-09-10T22:36:40.453 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:40.445+0000 7f8eae5ce740 1 Processor -- start 2024-09-10T22:36:40.453 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:40.445+0000 7f8eae5ce740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55880dc1de70 0x55880dc27500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:36:40.453 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:40.445+0000 7f8eae5ce740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55880dc207a0 0x55880dc27ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:36:40.453 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:40.445+0000 7f8eae5ce740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55880dc231e0 0x55880dc28770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:36:40.453 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:40.445+0000 7f8eae5ce740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x55880dab2ab0 con 0x55880dc207a0 2024-09-10T22:36:40.453 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:40.445+0000 7f8eae5ce740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55880db20730 con 0x55880dc1de70 2024-09-10T22:36:40.453 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:40.445+0000 7f8eae5ce740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x55880dc261c0 con 0x55880dc231e0 2024-09-10T22:36:40.453 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:40.445+0000 7f8eae5ce740 10 client.0 _ll_register_callbacks cb 0x55880db746b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T22:36:40.454 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:40.445+0000 7f8ea8d9c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55880dc207a0 0x55880dc27ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:36:40.454 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:40.445+0000 7f8ea8d9c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55880dc207a0 0x55880dc27ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:55012/0 (socket says 172.21.15.19:55012) 2024-09-10T22:36:40.454 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:40.445+0000 7f8ea959d640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55880dc1de70 0x55880dc27500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:36:40.454 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:40.445+0000 7f8ea8d9c640 1 -- 172.21.15.19:0/1686153788 learned_addr learned my addr 172.21.15.19:0/1686153788 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:36:40.454 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:40.445+0000 7f8ea9d9e640 1 --2- 172.21.15.19:0/1686153788 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55880dc231e0 0x55880dc28770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:36:40.454 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:40.446+0000 7f8ea959d640 1 -- 172.21.15.19:0/1686153788 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55880dc231e0 msgr2=0x55880dc28770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:36:40.454 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:40.446+0000 7f8ea959d640 1 --2- 172.21.15.19:0/1686153788 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55880dc231e0 0x55880dc28770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:36:40.454 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:40.446+0000 7f8ea959d640 1 -- 172.21.15.19:0/1686153788 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55880dc207a0 msgr2=0x55880dc27ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:36:40.454 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:40.446+0000 7f8ea959d640 1 --2- 172.21.15.19:0/1686153788 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55880dc207a0 0x55880dc27ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:36:40.454 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:40.446+0000 7f8ea959d640 1 -- 172.21.15.19:0/1686153788 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55880d8dc790 con 0x55880dc1de70 2024-09-10T22:36:40.454 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:40.446+0000 7f8ea8d9c640 1 --2- 172.21.15.19:0/1686153788 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55880dc207a0 0x55880dc27ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T22:36:40.454 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:40.446+0000 7f8ea959d640 1 --2- 172.21.15.19:0/1686153788 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55880dc1de70 0x55880dc27500 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f8ea000a2a0 tx=0x7f8ea0010ea0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c43bd44dd6f260ad server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:36:40.454 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:40.446+0000 7f8e8cff9640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-09-10T22:36:40.454 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:40.446+0000 7f8e8cff9640 1 -- 172.21.15.19:0/1686153788 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ea001d070 con 0x55880dc1de70 2024-09-10T22:36:40.455 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:40.446+0000 7f8e8cff9640 1 -- 172.21.15.19:0/1686153788 <== mon.2 v2:172.21.15.135:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8327+0+0 (secure 0 0 0) 0x7f8ea0018db0 con 0x55880dc1de70 2024-09-10T22:36:40.455 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:40.446+0000 7f8eae5ce740 1 -- 172.21.15.19:0/1686153788 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8ea0010cf0 con 0x55880dc1de70 2024-09-10T22:36:40.455 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:40.446+0000 7f8e8cff9640 1 -- 172.21.15.19:0/1686153788 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f8ea000ae60 con 0x55880dc1de70 2024-09-10T22:36:40.455 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:40.446+0000 7f8eae5ce740 10 client.26711 fetch_fsmap learned FSMap version 27 2024-09-10T22:36:40.455 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:40.446+0000 7f8eae5ce740 1 -- 172.21.15.19:0/1686153788 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55880d955620 con 0x55880dc1de70 2024-09-10T22:36:40.455 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:40.446+0000 7f8e8cff9640 1 -- 172.21.15.19:0/1686153788 <== mon.2 v2:172.21.15.135:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8ea0010cf0 con 0x55880dc1de70 2024-09-10T22:36:40.455 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:40.447+0000 7f8e8cff9640 1 -- 172.21.15.19:0/1686153788 <== mon.2 v2:172.21.15.135:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7f8ea0004c40 con 0x55880dc1de70 2024-09-10T22:36:40.455 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:40.447+0000 7f8eae5ce740 10 client.26711 fetch_fsmap finished waiting for FSMap version 27 2024-09-10T22:36:40.455 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:40.447+0000 7f8eae5ce740 10 client.26711 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-10T22:36:40.455 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:40.447+0000 7f8eae5ce740 20 client.26711 populate_metadata read hostname 'smithi019' 2024-09-10T22:36:40.455 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:40.447+0000 7f8eae5ce740 1 --2- 172.21.15.19:0/1686153788 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x55880dc32ab0 0x55880dc34ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:36:40.455 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:40.447+0000 7f8eae5ce740 4 client.26711 mds_command: new command op to 24581 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T22:36:40.455 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:40.447+0000 7f8eae5ce740 1 -- 172.21.15.19:0/1686153788 --> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55880db8d640 con 0x55880dc32ab0 2024-09-10T22:36:40.456 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:40.447+0000 7f8ea8d9c640 1 --2- 172.21.15.19:0/1686153788 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x55880dc32ab0 0x55880dc34ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:36:40.456 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:40.447+0000 7f8e8cff9640 10 client.26711 ms_handle_connect on v2:172.21.15.135:6838/1254769802 2024-09-10T22:36:40.456 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:40.447+0000 7f8ea8d9c640 1 --2- 172.21.15.19:0/1686153788 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x55880dc32ab0 0x55880dc34ea0 crc :-1 s=READY pgs=204 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cfcdec7a718c708e server_cookie=b24011ea4fb2f151 in_seq=0 out_seq=0 2024-09-10T22:36:40.456 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:40.448+0000 7f8e8cff9640 1 -- 172.21.15.19:0/1686153788 <== mds.0 v2:172.21.15.135:6838/1254769802 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55880db8d640 con 0x55880dc32ab0 2024-09-10T22:36:40.456 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:40.448+0000 7f8e8cff9640 10 client.26711 handle_command_reply: tid=0 2024-09-10T22:36:40.456 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:40.448+0000 7f8eae5ce740 1 client.26711 shutdown 2024-09-10T22:36:40.456 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:40.448+0000 7f8eae5ce740 1 -- 172.21.15.19:0/1686153788 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55880dc1de70 msgr2=0x55880dc27500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:36:40.456 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:40.448+0000 7f8eae5ce740 1 --2- 172.21.15.19:0/1686153788 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55880dc1de70 0x55880dc27500 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f8ea000a2a0 tx=0x7f8ea0010ea0 comp rx=0 tx=0).stop 2024-09-10T22:36:40.456 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:40.448+0000 7f8eae5ce740 1 -- 172.21.15.19:0/1686153788 shutdown_connections 2024-09-10T22:36:40.456 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:40.448+0000 7f8eae5ce740 1 --2- 172.21.15.19:0/1686153788 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x55880dc32ab0 0x55880dc34ea0 crc :-1 s=READY pgs=204 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:36:40.456 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:40.448+0000 7f8eae5ce740 1 --2- 172.21.15.19:0/1686153788 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55880dc231e0 0x55880dc28770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:36:40.456 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:40.448+0000 7f8eae5ce740 1 --2- 172.21.15.19:0/1686153788 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55880dc207a0 0x55880dc27ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:36:40.456 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:40.448+0000 7f8eae5ce740 1 --2- 172.21.15.19:0/1686153788 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55880dc1de70 0x55880dc27500 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:36:40.457 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:40.448+0000 7f8e8cff9640 0 client.26711 ms_handle_reset on v2:172.21.15.135:6838/1254769802 2024-09-10T22:36:40.457 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:40.448+0000 7f8eae5ce740 1 -- 172.21.15.19:0/1686153788 >> 172.21.15.19:0/1686153788 conn(0x55880dc14bb0 msgr2=0x55880dc13c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:36:40.457 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:40.448+0000 7f8eae5ce740 1 -- 172.21.15.19:0/1686153788 shutdown_connections 2024-09-10T22:36:40.457 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:40.448+0000 7f8eae5ce740 1 -- 172.21.15.19:0/1686153788 wait complete. 2024-09-10T22:36:40.457 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:40.448+0000 7f8eae5ce740 20 client.26711 trim_cache size 0 max 16384 2024-09-10T22:36:40.458 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:36:40 smithi019 ceph-mon[31375]: pgmap v654: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 429 KiB/s rd, 166 MiB/s wr, 839 op/s 2024-09-10T22:36:40.470 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:40.464+0000 7f8eae5ce740 1 Processor -- start 2024-09-10T22:36:40.470 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:40.464+0000 7f8eae5ce740 1 -- start start 2024-09-10T22:36:40.470 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:40.464+0000 7f8eae5ce740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55880dc1de70 0x55880dc13b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:36:40.470 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:40.464+0000 7f8eae5ce740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55880dc207a0 0x55880dc179f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:36:40.470 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:40.464+0000 7f8eae5ce740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55880dc231e0 0x55880dc17f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:36:40.470 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:40.464+0000 7f8eae5ce740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f8ea41aa580 con 0x55880dc207a0 2024-09-10T22:36:40.471 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:40.464+0000 7f8eae5ce740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f8ea41a7e50 con 0x55880dc1de70 2024-09-10T22:36:40.471 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:40.464+0000 7f8eae5ce740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f8ea41a5ca0 con 0x55880dc231e0 2024-09-10T22:36:40.471 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:40.464+0000 7f8ea8d9c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55880dc207a0 0x55880dc179f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:36:40.471 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:40.464+0000 7f8ea959d640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55880dc1de70 0x55880dc13b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:36:40.471 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:40.464+0000 7f8ea8d9c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55880dc207a0 0x55880dc179f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:55024/0 (socket says 172.21.15.19:55024) 2024-09-10T22:36:40.471 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:40.464+0000 7f8ea8d9c640 1 -- 172.21.15.19:0/4263398832 learned_addr learned my addr 172.21.15.19:0/4263398832 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:36:40.471 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:40.464+0000 7f8ea9d9e640 1 --2- 172.21.15.19:0/4263398832 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55880dc231e0 0x55880dc17f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:36:40.471 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:40.464+0000 7f8ea959d640 1 -- 172.21.15.19:0/4263398832 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55880dc231e0 msgr2=0x55880dc17f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:36:40.471 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:40.464+0000 7f8ea959d640 1 --2- 172.21.15.19:0/4263398832 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55880dc231e0 0x55880dc17f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:36:40.471 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:40.464+0000 7f8ea959d640 1 -- 172.21.15.19:0/4263398832 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55880dc207a0 msgr2=0x55880dc179f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:36:40.471 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:40.464+0000 7f8ea959d640 1 --2- 172.21.15.19:0/4263398832 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55880dc207a0 0x55880dc179f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:36:40.471 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:40.464+0000 7f8ea959d640 1 -- 172.21.15.19:0/4263398832 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55880dc260a0 con 0x55880dc1de70 2024-09-10T22:36:40.471 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:40.464+0000 7f8ea9d9e640 1 --2- 172.21.15.19:0/4263398832 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55880dc231e0 0x55880dc17f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T22:36:40.472 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:40.464+0000 7f8ea8d9c640 1 --2- 172.21.15.19:0/4263398832 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55880dc207a0 0x55880dc179f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T22:36:40.472 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:40.465+0000 7f8ea959d640 1 --2- 172.21.15.19:0/4263398832 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55880dc1de70 0x55880dc13b80 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f8ea000f7d0 tx=0x7f8ea000fcb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ac72ba178e668f5f server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:36:40.472 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:40.465+0000 7f8e8effd640 1 -- 172.21.15.19:0/4263398832 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ea001d050 con 0x55880dc1de70 2024-09-10T22:36:40.472 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:40.465+0000 7f8e8effd640 1 -- 172.21.15.19:0/4263398832 <== mon.2 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8ea0027070 con 0x55880dc1de70 2024-09-10T22:36:40.472 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:40.465+0000 7f8e8effd640 1 -- 172.21.15.19:0/4263398832 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ea0005160 con 0x55880dc1de70 2024-09-10T22:36:40.472 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:40.466+0000 7f8eae5ce740 1 -- 172.21.15.19:0/4263398832 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55880dc1de70 msgr2=0x55880dc13b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:36:40.472 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:40.466+0000 7f8eae5ce740 1 --2- 172.21.15.19:0/4263398832 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55880dc1de70 0x55880dc13b80 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f8ea000f7d0 tx=0x7f8ea000fcb0 comp rx=0 tx=0).stop 2024-09-10T22:36:40.472 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:40.466+0000 7f8eae5ce740 1 -- 172.21.15.19:0/4263398832 shutdown_connections 2024-09-10T22:36:40.472 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:40.466+0000 7f8eae5ce740 1 --2- 172.21.15.19:0/4263398832 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55880dc231e0 0x55880dc17f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:36:40.472 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:40.466+0000 7f8eae5ce740 1 --2- 172.21.15.19:0/4263398832 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55880dc207a0 0x55880dc179f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:36:40.472 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:40.466+0000 7f8eae5ce740 1 --2- 172.21.15.19:0/4263398832 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55880dc1de70 0x55880dc13b80 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:36:40.472 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:40.466+0000 7f8eae5ce740 1 -- 172.21.15.19:0/4263398832 >> 172.21.15.19:0/4263398832 conn(0x55880dc14bb0 msgr2=0x55880dc13470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:36:40.473 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:40.466+0000 7f8eae5ce740 1 -- 172.21.15.19:0/4263398832 shutdown_connections 2024-09-10T22:36:40.473 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:40.466+0000 7f8eae5ce740 1 -- 172.21.15.19:0/4263398832 wait complete. 2024-09-10T22:36:40.473 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:40.466+0000 7f8eae5ce740 1 -- start start 2024-09-10T22:36:40.473 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:40.466+0000 7f8eae5ce740 1 Processor -- start 2024-09-10T22:36:40.473 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:40.466+0000 7f8eae5ce740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55880dc1de70 0x55880dc2e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:36:40.473 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:40.466+0000 7f8eae5ce740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55880dc207a0 0x55880dc2f090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:36:40.473 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:40.466+0000 7f8eae5ce740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55880dc231e0 0x55880dc97c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:36:40.473 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:40.466+0000 7f8eae5ce740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f8ea41a6310 con 0x55880dc207a0 2024-09-10T22:36:40.473 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:40.466+0000 7f8eae5ce740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f8ea41a7780 con 0x55880dc231e0 2024-09-10T22:36:40.473 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:40.466+0000 7f8eae5ce740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f8ea41a69e0 con 0x55880dc1de70 2024-09-10T22:36:40.473 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:40.466+0000 7f8eae5ce740 10 client.0 _ll_register_callbacks cb 0x7f8ea001b070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T22:36:40.473 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:40.467+0000 7f8ea8d9c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55880dc207a0 0x55880dc2f090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:36:40.473 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:40.467+0000 7f8ea9d9e640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55880dc231e0 0x55880dc97c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:36:40.474 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:40.467+0000 7f8ea8d9c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55880dc207a0 0x55880dc2f090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:55034/0 (socket says 172.21.15.19:55034) 2024-09-10T22:36:40.474 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:40.467+0000 7f8ea8d9c640 1 -- 172.21.15.19:0/3838905759 learned_addr learned my addr 172.21.15.19:0/3838905759 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:36:40.474 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:40.467+0000 7f8ea959d640 1 --2- 172.21.15.19:0/3838905759 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55880dc1de70 0x55880dc2e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:36:40.474 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:40.467+0000 7f8ea9d9e640 1 -- 172.21.15.19:0/3838905759 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55880dc1de70 msgr2=0x55880dc2e9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:36:40.474 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:40.467+0000 7f8ea9d9e640 1 --2- 172.21.15.19:0/3838905759 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55880dc1de70 0x55880dc2e9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:36:40.474 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:40.467+0000 7f8ea9d9e640 1 -- 172.21.15.19:0/3838905759 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55880dc207a0 msgr2=0x55880dc2f090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:36:40.474 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:40.467+0000 7f8ea9d9e640 1 --2- 172.21.15.19:0/3838905759 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55880dc207a0 0x55880dc2f090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:36:40.474 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:40.467+0000 7f8ea9d9e640 1 -- 172.21.15.19:0/3838905759 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55880dc984b0 con 0x55880dc231e0 2024-09-10T22:36:40.474 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:40.467+0000 7f8ea8d9c640 1 --2- 172.21.15.19:0/3838905759 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55880dc207a0 0x55880dc2f090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T22:36:40.474 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:40.467+0000 7f8ea9d9e640 1 --2- 172.21.15.19:0/3838905759 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55880dc231e0 0x55880dc97c80 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f8e9c0e3c00 tx=0x7f8e9c005630 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3d2c6b0ce99f5ace server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:36:40.474 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:40.467+0000 7f8e8cff9640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-09-10T22:36:40.474 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:40.467+0000 7f8e8cff9640 1 -- 172.21.15.19:0/3838905759 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e9c0ac3d0 con 0x55880dc231e0 2024-09-10T22:36:40.474 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:40.467+0000 7f8e8cff9640 1 -- 172.21.15.19:0/3838905759 <== mon.2 v2:172.21.15.135:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8327+0+0 (secure 0 0 0) 0x7f8e9c0abb20 con 0x55880dc231e0 2024-09-10T22:36:40.475 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:40.467+0000 7f8eae5ce740 1 -- 172.21.15.19:0/3838905759 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8ea0027070 con 0x55880dc231e0 2024-09-10T22:36:40.475 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:40.467+0000 7f8e8cff9640 1 -- 172.21.15.19:0/3838905759 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f8e9c0acfc0 con 0x55880dc231e0 2024-09-10T22:36:40.475 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:40.467+0000 7f8eae5ce740 10 client.26717 fetch_fsmap learned FSMap version 27 2024-09-10T22:36:40.475 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:40.467+0000 7f8eae5ce740 1 -- 172.21.15.19:0/3838905759 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55880dc9f900 con 0x55880dc231e0 2024-09-10T22:36:40.475 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:40.468+0000 7f8e8cff9640 1 -- 172.21.15.19:0/3838905759 <== mon.2 v2:172.21.15.135:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8ea0027070 con 0x55880dc231e0 2024-09-10T22:36:40.475 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:40.468+0000 7f8e8cff9640 1 -- 172.21.15.19:0/3838905759 <== mon.2 v2:172.21.15.135:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7f8e9c0ab590 con 0x55880dc231e0 2024-09-10T22:36:40.475 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:40.468+0000 7f8eae5ce740 10 client.26717 fetch_fsmap finished waiting for FSMap version 27 2024-09-10T22:36:40.475 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:40.468+0000 7f8eae5ce740 10 client.26717 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-10T22:36:40.475 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:40.468+0000 7f8eae5ce740 20 client.26717 populate_metadata read hostname 'smithi019' 2024-09-10T22:36:40.475 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:40.468+0000 7f8eae5ce740 1 --2- 172.21.15.19:0/3838905759 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x55880dca02b0 0x55880dca26d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:36:40.475 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:40.468+0000 7f8eae5ce740 4 client.26717 mds_command: new command op to 24581 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-10T22:36:40.475 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:40.468+0000 7f8eae5ce740 1 -- 172.21.15.19:0/3838905759 --> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55880db890f0 con 0x55880dca02b0 2024-09-10T22:36:40.475 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:40.468+0000 7f8ea959d640 1 --2- 172.21.15.19:0/3838905759 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x55880dca02b0 0x55880dca26d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:36:40.475 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:40.468+0000 7f8e8cff9640 10 client.26717 ms_handle_connect on v2:172.21.15.135:6838/1254769802 2024-09-10T22:36:40.476 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:40.468+0000 7f8ea959d640 1 --2- 172.21.15.19:0/3838905759 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x55880dca02b0 0x55880dca26d0 crc :-1 s=READY pgs=205 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1e6f987be749e8b7 server_cookie=6c88c6e8dd5471ed in_seq=0 out_seq=0 2024-09-10T22:36:40.610 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:36:40 smithi135 ceph-mon[34789]: pgmap v654: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 429 KiB/s rd, 166 MiB/s wr, 839 op/s 2024-09-10T22:36:40.625 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:36:40 smithi138 ceph-mon[35236]: pgmap v654: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 429 KiB/s rd, 166 MiB/s wr, 839 op/s 2024-09-10T22:36:42.458 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:36:42 smithi019 ceph-mon[31375]: pgmap v655: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 571 KiB/s rd, 202 MiB/s wr, 836 op/s 2024-09-10T22:36:42.609 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:36:42 smithi135 ceph-mon[34789]: pgmap v655: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 571 KiB/s rd, 202 MiB/s wr, 836 op/s 2024-09-10T22:36:42.625 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:36:42 smithi138 ceph-mon[35236]: pgmap v655: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 571 KiB/s rd, 202 MiB/s wr, 836 op/s 2024-09-10T22:36:44.610 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:36:44 smithi135 ceph-mon[34789]: pgmap v656: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 327 KiB/s rd, 190 MiB/s wr, 624 op/s 2024-09-10T22:36:44.625 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:36:44 smithi138 ceph-mon[35236]: pgmap v656: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 327 KiB/s rd, 190 MiB/s wr, 624 op/s 2024-09-10T22:36:44.708 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:36:44 smithi019 ceph-mon[31375]: pgmap v656: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 327 KiB/s rd, 190 MiB/s wr, 624 op/s 2024-09-10T22:36:45.375 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:36:45 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T22:36:45.390 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:36:45 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T22:36:45.430 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:36:45 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T22:36:46.610 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:36:46 smithi135 ceph-mon[34789]: pgmap v657: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 326 KiB/s rd, 197 MiB/s wr, 513 op/s 2024-09-10T22:36:46.610 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:36:46 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:36:46.610 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:36:46 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:36:46.610 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:36:46 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:36:46.610 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:36:46 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:36:46.610 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:36:46 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:36:46.610 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:36:46 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:36:46.625 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:36:46 smithi138 ceph-mon[35236]: pgmap v657: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 326 KiB/s rd, 197 MiB/s wr, 513 op/s 2024-09-10T22:36:46.625 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:36:46 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:36:46.625 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:36:46 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:36:46.625 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:36:46 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:36:46.625 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:36:46 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:36:46.625 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:36:46 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:36:46.625 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:36:46 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:36:46.708 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:36:46 smithi019 ceph-mon[31375]: pgmap v657: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 326 KiB/s rd, 197 MiB/s wr, 513 op/s 2024-09-10T22:36:46.709 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:36:46 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:36:46.709 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:36:46 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:36:46.709 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:36:46 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:36:46.709 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:36:46 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:36:46.709 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:36:46 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:36:46.709 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:36:46 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:36:47.610 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:36:47 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T22:36:47.610 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:36:47 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T22:36:47.610 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:36:47 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:36:47.625 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:36:47 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T22:36:47.625 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:36:47 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T22:36:47.625 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:36:47 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:36:47.708 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:36:47 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T22:36:47.709 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:36:47 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T22:36:47.709 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:36:47 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:36:48.610 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:36:48 smithi135 ceph-mon[34789]: pgmap v658: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 444 KiB/s rd, 233 MiB/s wr, 433 op/s 2024-09-10T22:36:48.625 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:36:48 smithi138 ceph-mon[35236]: pgmap v658: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 444 KiB/s rd, 233 MiB/s wr, 433 op/s 2024-09-10T22:36:48.708 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:36:48 smithi019 ceph-mon[31375]: pgmap v658: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 444 KiB/s rd, 233 MiB/s wr, 433 op/s 2024-09-10T22:36:50.610 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:36:50 smithi135 ceph-mon[34789]: pgmap v659: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 262 KiB/s rd, 192 MiB/s wr, 201 op/s 2024-09-10T22:36:50.625 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:36:50 smithi138 ceph-mon[35236]: pgmap v659: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 262 KiB/s rd, 192 MiB/s wr, 201 op/s 2024-09-10T22:36:50.708 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:36:50 smithi019 ceph-mon[31375]: pgmap v659: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 262 KiB/s rd, 192 MiB/s wr, 201 op/s 2024-09-10T22:36:51.667 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:51.664+0000 7f8e8cff9640 1 -- 172.21.15.19:0/3838905759 <== mds.0 v2:172.21.15.135:6838/1254769802 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55880db890f0 con 0x55880dca02b0 2024-09-10T22:36:51.667 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:51.664+0000 7f8e8cff9640 10 client.26717 handle_command_reply: tid=0 2024-09-10T22:36:51.667 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:51.664+0000 7f8eae5ce740 1 client.26717 shutdown 2024-09-10T22:36:51.667 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:51.665+0000 7f8eae5ce740 1 -- 172.21.15.19:0/3838905759 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55880dc231e0 msgr2=0x55880dc97c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:36:51.667 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:51.665+0000 7f8eae5ce740 1 --2- 172.21.15.19:0/3838905759 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55880dc231e0 0x55880dc97c80 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f8e9c0e3c00 tx=0x7f8e9c005630 comp rx=0 tx=0).stop 2024-09-10T22:36:51.667 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:51.665+0000 7f8eae5ce740 1 -- 172.21.15.19:0/3838905759 shutdown_connections 2024-09-10T22:36:51.667 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:51.665+0000 7f8eae5ce740 1 --2- 172.21.15.19:0/3838905759 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55880dc231e0 0x55880dc97c80 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:36:51.667 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:51.665+0000 7f8eae5ce740 1 --2- 172.21.15.19:0/3838905759 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55880dc207a0 0x55880dc2f090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:36:51.668 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:51.665+0000 7f8eae5ce740 1 --2- 172.21.15.19:0/3838905759 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x55880dca02b0 0x55880dca26d0 crc :-1 s=READY pgs=205 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:36:51.668 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:51.665+0000 7f8eae5ce740 1 --2- 172.21.15.19:0/3838905759 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55880dc1de70 0x55880dc2e9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:36:51.668 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:51.665+0000 7f8eae5ce740 1 -- 172.21.15.19:0/3838905759 >> 172.21.15.19:0/3838905759 conn(0x55880dc14bb0 msgr2=0x55880dc13470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:36:51.668 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:51.665+0000 7f8e8cff9640 0 client.26717 ms_handle_reset on v2:172.21.15.135:6838/1254769802 2024-09-10T22:36:51.668 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:51.665+0000 7f8eae5ce740 1 -- 172.21.15.19:0/3838905759 shutdown_connections 2024-09-10T22:36:51.668 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:51.665+0000 7f8eae5ce740 1 -- 172.21.15.19:0/3838905759 wait complete. 2024-09-10T22:36:51.668 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:51.665+0000 7f8eae5ce740 20 client.26717 trim_cache size 0 max 16384 2024-09-10T22:36:51.668 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stdout:{ 2024-09-10T22:36:51.668 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stdout: "message": "", 2024-09-10T22:36:51.669 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stdout: "return_code": 0 2024-09-10T22:36:51.669 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stdout:} 2024-09-10T22:36:51.669 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:51.666+0000 7f8eaa59f640 1 -- 172.21.15.19:0/987321181 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f8e900b52e0 msgr2=0x7f8e900b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:36:51.669 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:51.666+0000 7f8eaa59f640 1 --2- 172.21.15.19:0/987321181 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f8e900b52e0 0x7f8e900b77a0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f8e94009230 tx=0x7f8e940314a0 comp rx=0 tx=0).stop 2024-09-10T22:36:51.669 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:51.666+0000 7f8eaa59f640 1 -- 172.21.15.19:0/987321181 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f8ea41084b0 msgr2=0x7f8ea4199e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:36:51.669 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:51.666+0000 7f8eaa59f640 1 --2- 172.21.15.19:0/987321181 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f8ea41084b0 0x7f8ea4199e20 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f8e9c00eb10 tx=0x7f8e9c00c2d0 comp rx=0 tx=0).stop 2024-09-10T22:36:51.670 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:51.666+0000 7f8eaa59f640 1 -- 172.21.15.19:0/987321181 shutdown_connections 2024-09-10T22:36:51.670 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:51.666+0000 7f8eaa59f640 1 --2- 172.21.15.19:0/987321181 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f8e900b52e0 0x7f8e900b77a0 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:36:51.670 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:51.666+0000 7f8eaa59f640 1 --2- 172.21.15.19:0/987321181 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f8ea41084b0 0x7f8ea4199e20 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:36:51.670 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:51.666+0000 7f8eaa59f640 1 --2- 172.21.15.19:0/987321181 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8ea4105920 0x7f8ea41991f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:36:51.670 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:51.666+0000 7f8eaa59f640 1 --2- 172.21.15.19:0/987321181 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8ea406b3f0 0x7f8ea4198ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:36:51.670 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:51.666+0000 7f8eaa59f640 1 -- 172.21.15.19:0/987321181 >> 172.21.15.19:0/987321181 conn(0x7f8ea40fcf30 msgr2=0x7f8ea4103c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:36:51.670 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:51.666+0000 7f8eaa59f640 1 -- 172.21.15.19:0/987321181 shutdown_connections 2024-09-10T22:36:51.670 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:36:51.666+0000 7f8eaa59f640 1 -- 172.21.15.19:0/987321181 wait complete. 2024-09-10T22:36:52.610 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:36:52 smithi135 ceph-mon[34789]: pgmap v660: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 493 KiB/s rd, 225 MiB/s wr, 452 op/s 2024-09-10T22:36:52.625 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:36:52 smithi138 ceph-mon[35236]: pgmap v660: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 493 KiB/s rd, 225 MiB/s wr, 452 op/s 2024-09-10T22:36:52.708 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:36:52 smithi019 ceph-mon[31375]: pgmap v660: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 493 KiB/s rd, 225 MiB/s wr, 452 op/s 2024-09-10T22:36:54.610 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:36:54 smithi135 ceph-mon[34789]: pgmap v661: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 350 KiB/s rd, 204 MiB/s wr, 583 op/s 2024-09-10T22:36:54.625 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:36:54 smithi138 ceph-mon[35236]: pgmap v661: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 350 KiB/s rd, 204 MiB/s wr, 583 op/s 2024-09-10T22:36:54.708 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:36:54 smithi019 ceph-mon[31375]: pgmap v661: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 350 KiB/s rd, 204 MiB/s wr, 583 op/s 2024-09-10T22:36:56.610 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:36:56 smithi135 ceph-mon[34789]: pgmap v662: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 461 KiB/s rd, 204 MiB/s wr, 761 op/s 2024-09-10T22:36:56.625 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:36:56 smithi138 ceph-mon[35236]: pgmap v662: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 461 KiB/s rd, 204 MiB/s wr, 761 op/s 2024-09-10T22:36:56.708 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:36:56 smithi019 ceph-mon[31375]: pgmap v662: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 461 KiB/s rd, 204 MiB/s wr, 761 op/s 2024-09-10T22:36:58.610 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:36:58 smithi135 ceph-mon[34789]: pgmap v663: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 462 KiB/s rd, 221 MiB/s wr, 1.08k op/s 2024-09-10T22:36:58.625 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:36:58 smithi138 ceph-mon[35236]: pgmap v663: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 462 KiB/s rd, 221 MiB/s wr, 1.08k op/s 2024-09-10T22:36:58.708 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:36:58 smithi019 ceph-mon[31375]: pgmap v663: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 462 KiB/s rd, 221 MiB/s wr, 1.08k op/s 2024-09-10T22:36:59.653 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 22997a4c-6fc2-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-10T22:36:59.987 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/22997a4c-6fc2-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T22:37:00.458 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:37:00 smithi019 ceph-mon[31375]: pgmap v664: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 344 KiB/s rd, 167 MiB/s wr, 1.08k op/s 2024-09-10T22:37:00.610 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:37:00 smithi135 ceph-mon[34789]: pgmap v664: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 344 KiB/s rd, 167 MiB/s wr, 1.08k op/s 2024-09-10T22:37:00.625 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:37:00 smithi138 ceph-mon[35236]: pgmap v664: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 344 KiB/s rd, 167 MiB/s wr, 1.08k op/s 2024-09-10T22:37:00.625 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:00.623+0000 7f2dcd164640 1 -- 172.21.15.19:0/1395281243 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2dc8101c90 msgr2=0x7f2dc8102070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:37:00.625 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:00.623+0000 7f2dcd164640 1 --2- 172.21.15.19:0/1395281243 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2dc8101c90 0x7f2dc8102070 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 crypto rx=0x7f2db8009900 tx=0x7f2db802a410 comp rx=0 tx=0).stop 2024-09-10T22:37:00.625 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:00.623+0000 7f2dcd164640 1 -- 172.21.15.19:0/1395281243 shutdown_connections 2024-09-10T22:37:00.626 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:00.623+0000 7f2dcd164640 1 --2- 172.21.15.19:0/1395281243 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2dc8108020 0x7f2dc810e820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:37:00.626 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:00.623+0000 7f2dcd164640 1 --2- 172.21.15.19:0/1395281243 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f2dc81076a0 0x7f2dc8107ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:37:00.626 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:00.623+0000 7f2dcd164640 1 --2- 172.21.15.19:0/1395281243 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2dc8101c90 0x7f2dc8102070 unknown :-1 s=CLOSED pgs=826 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:37:00.626 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:00.623+0000 7f2dcd164640 1 -- 172.21.15.19:0/1395281243 >> 172.21.15.19:0/1395281243 conn(0x7f2dc80fd700 msgr2=0x7f2dc80ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:37:00.626 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:00.623+0000 7f2dcd164640 1 -- 172.21.15.19:0/1395281243 shutdown_connections 2024-09-10T22:37:00.626 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:00.623+0000 7f2dcd164640 1 -- 172.21.15.19:0/1395281243 wait complete. 2024-09-10T22:37:00.627 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:00.625+0000 7f2dcd164640 1 Processor -- start 2024-09-10T22:37:00.627 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:00.625+0000 7f2dcd164640 1 -- start start 2024-09-10T22:37:00.627 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:00.625+0000 7f2dcd164640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2dc8101c90 0x7f2dc819a0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:37:00.627 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:00.625+0000 7f2dcd164640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f2dc81076a0 0x7f2dc819a5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:37:00.627 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:00.625+0000 7f2dcd164640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2dc8108020 0x7f2dc819ab60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:37:00.627 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:00.625+0000 7f2dc6d9d640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2dc8101c90 0x7f2dc819a0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:37:00.627 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:00.625+0000 7f2dcd164640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f2dc8111ca0 con 0x7f2dc8108020 2024-09-10T22:37:00.627 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:00.625+0000 7f2dc6d9d640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2dc8101c90 0x7f2dc819a0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.19:50846/0 (socket says 172.21.15.19:50846) 2024-09-10T22:37:00.627 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:00.625+0000 7f2dc6d9d640 1 -- 172.21.15.19:0/387820727 learned_addr learned my addr 172.21.15.19:0/387820727 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:37:00.627 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:00.625+0000 7f2dcd164640 1 -- 172.21.15.19:0/387820727 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f2dc8111b20 con 0x7f2dc8101c90 2024-09-10T22:37:00.627 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:00.625+0000 7f2dc759e640 1 --2- 172.21.15.19:0/387820727 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2dc8108020 0x7f2dc819ab60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:37:00.628 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:00.625+0000 7f2dbffff640 1 --2- 172.21.15.19:0/387820727 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f2dc81076a0 0x7f2dc819a5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:37:00.628 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:00.626+0000 7f2dcd164640 1 -- 172.21.15.19:0/387820727 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f2dc8111e20 con 0x7f2dc81076a0 2024-09-10T22:37:00.629 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:00.626+0000 7f2dc759e640 1 -- 172.21.15.19:0/387820727 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f2dc81076a0 msgr2=0x7f2dc819a5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:37:00.629 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:00.626+0000 7f2dc759e640 1 --2- 172.21.15.19:0/387820727 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f2dc81076a0 0x7f2dc819a5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:37:00.629 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:00.626+0000 7f2dc759e640 1 -- 172.21.15.19:0/387820727 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2dc8101c90 msgr2=0x7f2dc819a0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:37:00.629 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:00.626+0000 7f2dc759e640 1 --2- 172.21.15.19:0/387820727 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2dc8101c90 0x7f2dc819a0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:37:00.629 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:00.626+0000 7f2dc759e640 1 -- 172.21.15.19:0/387820727 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2dc81a54a0 con 0x7f2dc8108020 2024-09-10T22:37:00.629 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:00.626+0000 7f2dc6d9d640 1 --2- 172.21.15.19:0/387820727 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2dc8101c90 0x7f2dc819a0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T22:37:00.629 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:00.627+0000 7f2dc759e640 1 --2- 172.21.15.19:0/387820727 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2dc8108020 0x7f2dc819ab60 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 crypto rx=0x7f2dc0009d10 tx=0x7f2dc0007590 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:37:00.629 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:00.627+0000 7f2dc4d99640 1 -- 172.21.15.19:0/387820727 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2dc0009e60 con 0x7f2dc8108020 2024-09-10T22:37:00.629 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:00.627+0000 7f2dcd164640 1 -- 172.21.15.19:0/387820727 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2dc8197ef0 con 0x7f2dc8108020 2024-09-10T22:37:00.630 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:00.627+0000 7f2dcd164640 1 -- 172.21.15.19:0/387820727 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2dc8198430 con 0x7f2dc8108020 2024-09-10T22:37:00.630 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:00.627+0000 7f2dc4d99640 1 -- 172.21.15.19:0/387820727 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2dc000f410 con 0x7f2dc8108020 2024-09-10T22:37:00.630 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:00.628+0000 7f2dc4d99640 1 -- 172.21.15.19:0/387820727 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2dc00104e0 con 0x7f2dc8108020 2024-09-10T22:37:00.632 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:00.631+0000 7f2dcf539740 1 Processor -- start 2024-09-10T22:37:00.633 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:00.632+0000 7f2dc4d99640 1 -- 172.21.15.19:0/387820727 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 18) ==== 153250+0+0 (secure 0 0 0) 0x7f2dc0010030 con 0x7f2dc8108020 2024-09-10T22:37:00.633 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:00.632+0000 7f2dcf539740 1 -- start start 2024-09-10T22:37:00.634 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:00.632+0000 7f2dcf539740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56417888f480 0x56417888f860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:37:00.635 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:00.632+0000 7f2dcf539740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x56417888fda0 0x56417889b7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:37:00.635 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:00.632+0000 7f2dcf539740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56417889bd30 0x56417889e120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:37:00.635 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:00.632+0000 7f2dcf539740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x564178805e50 con 0x56417888f480 2024-09-10T22:37:00.635 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:00.632+0000 7f2dcf539740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x5641787f5280 con 0x56417889bd30 2024-09-10T22:37:00.635 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:00.632+0000 7f2dcf539740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x5641787f9090 con 0x56417888fda0 2024-09-10T22:37:00.635 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:00.632+0000 7f2dc6d9d640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x56417888fda0 0x56417889b7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:37:00.635 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:00.632+0000 7f2dbffff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56417888f480 0x56417888f860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:37:00.635 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:00.632+0000 7f2dbffff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56417888f480 0x56417888f860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:49104/0 (socket says 172.21.15.19:49104) 2024-09-10T22:37:00.635 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:00.632+0000 7f2dbffff640 1 -- 172.21.15.19:0/3903450585 learned_addr learned my addr 172.21.15.19:0/3903450585 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:37:00.635 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:00.632+0000 7f2dbffff640 1 --2- 172.21.15.19:0/3903450585 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56417889bd30 0x56417889e120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:37:00.635 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:00.633+0000 7f2dc6d9d640 1 -- 172.21.15.19:0/3903450585 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56417889bd30 msgr2=0x56417889e120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:37:00.635 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:00.633+0000 7f2dc6d9d640 1 --2- 172.21.15.19:0/3903450585 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56417889bd30 0x56417889e120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:37:00.636 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:00.633+0000 7f2dc6d9d640 1 -- 172.21.15.19:0/3903450585 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56417888f480 msgr2=0x56417888f860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:37:00.636 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:00.633+0000 7f2dc6d9d640 1 --2- 172.21.15.19:0/3903450585 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56417888f480 0x56417888f860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:37:00.636 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:00.633+0000 7f2dc6d9d640 1 -- 172.21.15.19:0/3903450585 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564178553650 con 0x56417888fda0 2024-09-10T22:37:00.638 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:00.633+0000 7f2dc6d9d640 1 --2- 172.21.15.19:0/3903450585 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x56417888fda0 0x56417889b7f0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f2db8004770 tx=0x7f2db803fb90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=deb882194bec1cd1 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:37:00.638 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:00.634+0000 7f2dbd7fa640 1 -- 172.21.15.19:0/3903450585 <== mon.1 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2db8035040 con 0x56417888fda0 2024-09-10T22:37:00.638 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:00.634+0000 7f2dbd7fa640 1 -- 172.21.15.19:0/3903450585 <== mon.1 v2:172.21.15.138:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2db8004030 con 0x56417888fda0 2024-09-10T22:37:00.638 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:00.634+0000 7f2dbd7fa640 1 -- 172.21.15.19:0/3903450585 <== mon.1 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2db8005480 con 0x56417888fda0 2024-09-10T22:37:00.638 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:00.634+0000 7f2dc4d99640 1 --2- 172.21.15.19:0/387820727 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f2db40b53e0 0x7f2db40b78a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:37:00.638 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:00.634+0000 7f2dcf539740 1 -- 172.21.15.19:0/3903450585 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x56417888fda0 msgr2=0x56417889b7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:37:00.638 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:00.634+0000 7f2dcf539740 1 --2- 172.21.15.19:0/3903450585 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x56417888fda0 0x56417889b7f0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f2db8004770 tx=0x7f2db803fb90 comp rx=0 tx=0).stop 2024-09-10T22:37:00.638 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:00.635+0000 7f2dcf539740 1 -- 172.21.15.19:0/3903450585 shutdown_connections 2024-09-10T22:37:00.638 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:00.635+0000 7f2dcf539740 1 --2- 172.21.15.19:0/3903450585 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56417889bd30 0x56417889e120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:37:00.638 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:00.635+0000 7f2dcf539740 1 --2- 172.21.15.19:0/3903450585 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x56417888fda0 0x56417889b7f0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:37:00.639 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:00.635+0000 7f2dcf539740 1 --2- 172.21.15.19:0/3903450585 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56417888f480 0x56417888f860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:37:00.639 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:00.635+0000 7f2dcf539740 1 -- 172.21.15.19:0/3903450585 >> 172.21.15.19:0/3903450585 conn(0x56417888d2b0 msgr2=0x56417888e450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:37:00.639 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:00.635+0000 7f2dc4d99640 1 -- 172.21.15.19:0/387820727 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8327+0+0 (secure 0 0 0) 0x7f2dc00e5a80 con 0x7f2dc8108020 2024-09-10T22:37:00.639 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:00.635+0000 7f2dbffff640 1 --2- 172.21.15.19:0/387820727 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f2db40b53e0 0x7f2db40b78a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:37:00.639 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:00.635+0000 7f2dcf539740 1 -- 172.21.15.19:0/3903450585 shutdown_connections 2024-09-10T22:37:00.639 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:00.635+0000 7f2dcf539740 1 -- 172.21.15.19:0/3903450585 wait complete. 2024-09-10T22:37:00.639 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:00.635+0000 7f2dcf539740 1 -- start start 2024-09-10T22:37:00.639 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:00.636+0000 7f2dcf539740 1 Processor -- start 2024-09-10T22:37:00.639 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:00.636+0000 7f2dbffff640 1 --2- 172.21.15.19:0/387820727 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f2db40b53e0 0x7f2db40b78a0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f2db00058a0 tx=0x7f2db000b750 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:37:00.639 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:00.636+0000 7f2dcf539740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56417888f480 0x56417889b500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:37:00.639 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:00.636+0000 7f2dcf539740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x56417888fda0 0x564178898950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:37:00.639 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:00.636+0000 7f2dcf539740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56417889bd30 0x564178898e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:37:00.641 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:00.636+0000 7f2dcf539740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x564178656700 con 0x56417889bd30 2024-09-10T22:37:00.641 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:00.636+0000 7f2dcf539740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x564178790110 con 0x56417888f480 2024-09-10T22:37:00.641 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:00.636+0000 7f2dcf539740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x56417889e990 con 0x56417888fda0 2024-09-10T22:37:00.641 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:00.636+0000 7f2dc6d9d640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56417888f480 0x56417889b500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:37:00.641 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:00.636+0000 7f2dc6d9d640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56417888f480 0x56417889b500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.19:50864/0 (socket says 172.21.15.19:50864) 2024-09-10T22:37:00.642 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:00.636+0000 7f2dc6d9d640 1 -- 172.21.15.19:0/3521137437 learned_addr learned my addr 172.21.15.19:0/3521137437 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:37:00.642 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:00.636+0000 7f2dcf539740 10 client.0 _ll_register_callbacks cb 0x5641787a9990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T22:37:00.642 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:00.636+0000 7f2dbffff640 1 --2- 172.21.15.19:0/3521137437 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x56417888fda0 0x564178898950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:37:00.642 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:00.637+0000 7f2dc759e640 1 --2- 172.21.15.19:0/3521137437 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56417889bd30 0x564178898e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:37:00.642 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:00.637+0000 7f2dc6d9d640 1 -- 172.21.15.19:0/3521137437 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x56417888fda0 msgr2=0x564178898950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:37:00.642 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:00.637+0000 7f2dc6d9d640 1 --2- 172.21.15.19:0/3521137437 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x56417888fda0 0x564178898950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:37:00.642 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:00.637+0000 7f2dc6d9d640 1 -- 172.21.15.19:0/3521137437 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56417889bd30 msgr2=0x564178898e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:37:00.642 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:00.637+0000 7f2dc6d9d640 1 --2- 172.21.15.19:0/3521137437 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56417889bd30 0x564178898e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:37:00.642 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:00.637+0000 7f2dc6d9d640 1 -- 172.21.15.19:0/3521137437 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5641787bdc40 con 0x56417888f480 2024-09-10T22:37:00.642 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:00.637+0000 7f2dc759e640 1 --2- 172.21.15.19:0/3521137437 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56417889bd30 0x564178898e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T22:37:00.642 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:00.637+0000 7f2dc6d9d640 1 --2- 172.21.15.19:0/3521137437 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56417888f480 0x56417889b500 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f2db8031440 tx=0x7f2db8032f60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=731f2ba8ba5bd82f server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:37:00.644 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:00.637+0000 7f2dae7fc640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-09-10T22:37:00.644 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:00.637+0000 7f2dae7fc640 1 -- 172.21.15.19:0/3521137437 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2db8057060 con 0x56417888f480 2024-09-10T22:37:00.644 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:00.637+0000 7f2dae7fc640 1 -- 172.21.15.19:0/3521137437 <== mon.2 v2:172.21.15.135:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8327+0+0 (secure 0 0 0) 0x7f2db8005410 con 0x56417888f480 2024-09-10T22:37:00.644 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:00.637+0000 7f2dcf539740 1 -- 172.21.15.19:0/3521137437 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2db8004030 con 0x56417888f480 2024-09-10T22:37:00.644 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:00.637+0000 7f2dae7fc640 1 -- 172.21.15.19:0/3521137437 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f2db8035040 con 0x56417888f480 2024-09-10T22:37:00.644 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:00.637+0000 7f2dcf539740 10 client.26729 fetch_fsmap learned FSMap version 27 2024-09-10T22:37:00.644 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:00.637+0000 7f2dcf539740 1 -- 172.21.15.19:0/3521137437 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x5641788bb210 con 0x56417888f480 2024-09-10T22:37:00.644 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:00.638+0000 7f2dae7fc640 1 -- 172.21.15.19:0/3521137437 <== mon.2 v2:172.21.15.135:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2db8031910 con 0x56417888f480 2024-09-10T22:37:00.644 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:00.638+0000 7f2dae7fc640 1 -- 172.21.15.19:0/3521137437 <== mon.2 v2:172.21.15.135:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7f2db8051070 con 0x56417888f480 2024-09-10T22:37:00.644 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:00.638+0000 7f2dcf539740 10 client.26729 fetch_fsmap finished waiting for FSMap version 27 2024-09-10T22:37:00.645 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:00.638+0000 7f2dcf539740 10 client.26729 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-10T22:37:00.645 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:00.638+0000 7f2dcf539740 20 client.26729 populate_metadata read hostname 'smithi019' 2024-09-10T22:37:00.646 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:00.638+0000 7f2dcf539740 1 --2- 172.21.15.19:0/3521137437 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x5641788bc560 0x5641788be950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:37:00.646 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:00.638+0000 7f2dcf539740 4 client.26729 mds_command: new command op to 24581 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T22:37:00.646 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:00.638+0000 7f2dcf539740 1 -- 172.21.15.19:0/3521137437 --> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f2db8004030 con 0x5641788bc560 2024-09-10T22:37:00.646 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:00.638+0000 7f2dbffff640 1 --2- 172.21.15.19:0/3521137437 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x5641788bc560 0x5641788be950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:37:00.646 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:00.638+0000 7f2dae7fc640 10 client.26729 ms_handle_connect on v2:172.21.15.135:6838/1254769802 2024-09-10T22:37:00.646 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:00.638+0000 7f2dbffff640 1 --2- 172.21.15.19:0/3521137437 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x5641788bc560 0x5641788be950 crc :-1 s=READY pgs=206 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e25b56ef2be72868 server_cookie=fe8dadb294daa5fd in_seq=0 out_seq=0 2024-09-10T22:37:00.646 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:00.639+0000 7f2dae7fc640 1 -- 172.21.15.19:0/3521137437 <== mds.0 v2:172.21.15.135:6838/1254769802 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x7f2db8004030 con 0x5641788bc560 2024-09-10T22:37:00.646 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:00.639+0000 7f2dae7fc640 10 client.26729 handle_command_reply: tid=0 2024-09-10T22:37:00.646 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:00.639+0000 7f2dcf539740 1 client.26729 shutdown 2024-09-10T22:37:00.647 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:00.639+0000 7f2dcf539740 1 -- 172.21.15.19:0/3521137437 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56417888f480 msgr2=0x56417889b500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:37:00.647 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:00.639+0000 7f2dcf539740 1 --2- 172.21.15.19:0/3521137437 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56417888f480 0x56417889b500 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f2db8031440 tx=0x7f2db8032f60 comp rx=0 tx=0).stop 2024-09-10T22:37:00.647 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:00.639+0000 7f2dcf539740 1 -- 172.21.15.19:0/3521137437 shutdown_connections 2024-09-10T22:37:00.648 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:00.639+0000 7f2dcf539740 1 --2- 172.21.15.19:0/3521137437 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56417889bd30 0x564178898e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:37:00.648 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:00.639+0000 7f2dcf539740 1 --2- 172.21.15.19:0/3521137437 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x5641788bc560 0x5641788be950 crc :-1 s=READY pgs=206 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:37:00.648 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:00.639+0000 7f2dcf539740 1 --2- 172.21.15.19:0/3521137437 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x56417888fda0 0x564178898950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:37:00.648 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:00.639+0000 7f2dcf539740 1 --2- 172.21.15.19:0/3521137437 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56417888f480 0x56417889b500 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:37:00.648 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:00.639+0000 7f2dae7fc640 0 client.26729 ms_handle_reset on v2:172.21.15.135:6838/1254769802 2024-09-10T22:37:00.648 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:00.639+0000 7f2dcf539740 1 -- 172.21.15.19:0/3521137437 >> 172.21.15.19:0/3521137437 conn(0x56417888d2b0 msgr2=0x564178892e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:37:00.648 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:00.639+0000 7f2dcf539740 1 -- 172.21.15.19:0/3521137437 shutdown_connections 2024-09-10T22:37:00.648 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:00.639+0000 7f2dcf539740 1 -- 172.21.15.19:0/3521137437 wait complete. 2024-09-10T22:37:00.648 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:00.640+0000 7f2dcf539740 20 client.26729 trim_cache size 0 max 16384 2024-09-10T22:37:00.660 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:00.659+0000 7f2dcf539740 1 Processor -- start 2024-09-10T22:37:00.660 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:00.659+0000 7f2dcf539740 1 -- start start 2024-09-10T22:37:00.660 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:00.659+0000 7f2dcf539740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56417888f480 0x56417888cbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:37:00.662 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:00.659+0000 7f2dcf539740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56417888fda0 0x56417889a690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:37:00.662 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:00.659+0000 7f2dcf539740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x56417889bd30 0x564178895b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:37:00.662 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:00.659+0000 7f2dc6d9d640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56417888f480 0x56417888cbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:37:00.662 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:00.659+0000 7f2dcf539740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f2da8010ee0 con 0x56417888f480 2024-09-10T22:37:00.662 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:00.659+0000 7f2dcf539740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f2da800e7b0 con 0x56417888fda0 2024-09-10T22:37:00.662 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:00.659+0000 7f2dcf539740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f2da800c600 con 0x56417889bd30 2024-09-10T22:37:00.662 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:00.659+0000 7f2dc6d9d640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56417888f480 0x56417888cbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:49134/0 (socket says 172.21.15.19:49134) 2024-09-10T22:37:00.663 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:00.659+0000 7f2dc6d9d640 1 -- 172.21.15.19:0/3339245212 learned_addr learned my addr 172.21.15.19:0/3339245212 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:37:00.663 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:00.659+0000 7f2dbffff640 1 --2- 172.21.15.19:0/3339245212 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56417888fda0 0x56417889a690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:37:00.663 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:00.660+0000 7f2dc759e640 1 --2- 172.21.15.19:0/3339245212 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x56417889bd30 0x564178895b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:37:00.663 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:00.660+0000 7f2dbffff640 1 -- 172.21.15.19:0/3339245212 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x56417889bd30 msgr2=0x564178895b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:37:00.663 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:00.660+0000 7f2dbffff640 1 --2- 172.21.15.19:0/3339245212 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x56417889bd30 0x564178895b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:37:00.663 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:00.660+0000 7f2dbffff640 1 -- 172.21.15.19:0/3339245212 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56417888f480 msgr2=0x56417888cbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:37:00.663 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:00.660+0000 7f2dbffff640 1 --2- 172.21.15.19:0/3339245212 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56417888f480 0x56417888cbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:37:00.663 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:00.660+0000 7f2dbffff640 1 -- 172.21.15.19:0/3339245212 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56417888dd30 con 0x56417888fda0 2024-09-10T22:37:00.663 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:00.660+0000 7f2dbffff640 1 --2- 172.21.15.19:0/3339245212 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56417888fda0 0x56417889a690 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x5641788bef20 tx=0x7f2db00046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=58b33e345ca63a42 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:37:00.663 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:00.660+0000 7f2dbcff9640 1 -- 172.21.15.19:0/3339245212 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2db0004270 con 0x56417888fda0 2024-09-10T22:37:00.663 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:00.660+0000 7f2dbcff9640 1 -- 172.21.15.19:0/3339245212 <== mon.2 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2db00054d0 con 0x56417888fda0 2024-09-10T22:37:00.663 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:00.660+0000 7f2dbcff9640 1 -- 172.21.15.19:0/3339245212 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2db0004d30 con 0x56417888fda0 2024-09-10T22:37:00.665 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:00.661+0000 7f2dcf539740 1 -- 172.21.15.19:0/3339245212 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56417888fda0 msgr2=0x56417889a690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:37:00.665 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:00.661+0000 7f2dcf539740 1 --2- 172.21.15.19:0/3339245212 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56417888fda0 0x56417889a690 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x5641788bef20 tx=0x7f2db00046c0 comp rx=0 tx=0).stop 2024-09-10T22:37:00.665 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:00.661+0000 7f2dcf539740 1 -- 172.21.15.19:0/3339245212 shutdown_connections 2024-09-10T22:37:00.665 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:00.661+0000 7f2dcf539740 1 --2- 172.21.15.19:0/3339245212 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x56417889bd30 0x564178895b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:37:00.665 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:00.661+0000 7f2dcf539740 1 --2- 172.21.15.19:0/3339245212 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56417888fda0 0x56417889a690 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:37:00.665 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:00.661+0000 7f2dcf539740 1 --2- 172.21.15.19:0/3339245212 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56417888f480 0x56417888cbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:37:00.665 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:00.661+0000 7f2dcf539740 1 -- 172.21.15.19:0/3339245212 >> 172.21.15.19:0/3339245212 conn(0x56417888d2b0 msgr2=0x564178899f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:37:00.666 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:00.662+0000 7f2dcf539740 1 -- 172.21.15.19:0/3339245212 shutdown_connections 2024-09-10T22:37:00.666 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:00.662+0000 7f2dcf539740 1 -- 172.21.15.19:0/3339245212 wait complete. 2024-09-10T22:37:00.666 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:00.662+0000 7f2dcf539740 1 -- start start 2024-09-10T22:37:00.666 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:00.662+0000 7f2dcf539740 1 Processor -- start 2024-09-10T22:37:00.666 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:00.662+0000 7f2dcf539740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56417888f480 0x5641788a0010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:37:00.666 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:00.662+0000 7f2dcf539740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56417888fda0 0x5641788a0550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:37:00.666 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:00.663+0000 7f2dcf539740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x56417889bd30 0x5641789281b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:37:00.666 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:00.663+0000 7f2dcf539740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f2da800cc70 con 0x56417888f480 2024-09-10T22:37:00.666 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:00.663+0000 7f2dcf539740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f2da800e0e0 con 0x56417888fda0 2024-09-10T22:37:00.666 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:00.663+0000 7f2dcf539740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f2da800d340 con 0x56417889bd30 2024-09-10T22:37:00.666 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:00.663+0000 7f2dbffff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56417888fda0 0x5641788a0550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:37:00.666 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:00.663+0000 7f2dbffff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56417888fda0 0x5641788a0550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.19:50882/0 (socket says 172.21.15.19:50882) 2024-09-10T22:37:00.666 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:00.663+0000 7f2dbffff640 1 -- 172.21.15.19:0/1090888173 learned_addr learned my addr 172.21.15.19:0/1090888173 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:37:00.667 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:00.663+0000 7f2dcf539740 10 client.0 _ll_register_callbacks cb 0x7f2db000ba80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T22:37:00.667 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:00.663+0000 7f2dc6d9d640 1 --2- 172.21.15.19:0/1090888173 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56417888f480 0x5641788a0010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:37:00.667 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:00.663+0000 7f2dbffff640 1 -- 172.21.15.19:0/1090888173 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x56417889bd30 msgr2=0x5641789281b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:37:00.667 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:00.663+0000 7f2dbffff640 1 --2- 172.21.15.19:0/1090888173 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x56417889bd30 0x5641789281b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:37:00.667 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:00.663+0000 7f2dbffff640 1 -- 172.21.15.19:0/1090888173 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56417888f480 msgr2=0x5641788a0010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:37:00.667 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:00.663+0000 7f2dbffff640 1 --2- 172.21.15.19:0/1090888173 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56417888f480 0x5641788a0010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:37:00.667 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:00.663+0000 7f2dbffff640 1 -- 172.21.15.19:0/1090888173 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5641789286f0 con 0x56417888fda0 2024-09-10T22:37:00.667 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:00.663+0000 7f2dbffff640 1 --2- 172.21.15.19:0/1090888173 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56417888fda0 0x5641788a0550 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f2db0005d00 tx=0x7f2db00043a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ff49f9eca6514b server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:37:00.667 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:00.663+0000 7f2dae7fc640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-09-10T22:37:00.667 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:00.664+0000 7f2dae7fc640 1 -- 172.21.15.19:0/1090888173 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2db003a060 con 0x56417888fda0 2024-09-10T22:37:00.667 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:00.664+0000 7f2dae7fc640 1 -- 172.21.15.19:0/1090888173 <== mon.2 v2:172.21.15.135:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8327+0+0 (secure 0 0 0) 0x7f2db00051a0 con 0x56417888fda0 2024-09-10T22:37:00.667 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:00.664+0000 7f2dcf539740 1 -- 172.21.15.19:0/1090888173 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5641788bed40 con 0x56417888fda0 2024-09-10T22:37:00.669 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:00.664+0000 7f2dae7fc640 1 -- 172.21.15.19:0/1090888173 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f2db00053a0 con 0x56417888fda0 2024-09-10T22:37:00.669 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:00.664+0000 7f2dcf539740 10 client.26735 fetch_fsmap learned FSMap version 27 2024-09-10T22:37:00.669 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:00.664+0000 7f2dcf539740 1 -- 172.21.15.19:0/1090888173 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x564178929880 con 0x56417888fda0 2024-09-10T22:37:00.669 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:00.664+0000 7f2dae7fc640 1 -- 172.21.15.19:0/1090888173 <== mon.2 v2:172.21.15.135:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2db0005540 con 0x56417888fda0 2024-09-10T22:37:00.670 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:00.664+0000 7f2dae7fc640 1 -- 172.21.15.19:0/1090888173 <== mon.2 v2:172.21.15.135:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7f2db003e030 con 0x56417888fda0 2024-09-10T22:37:00.670 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:00.664+0000 7f2dcf539740 10 client.26735 fetch_fsmap finished waiting for FSMap version 27 2024-09-10T22:37:00.670 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:00.664+0000 7f2dcf539740 10 client.26735 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-10T22:37:00.670 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:00.664+0000 7f2dcf539740 20 client.26735 populate_metadata read hostname 'smithi019' 2024-09-10T22:37:00.670 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:00.664+0000 7f2dcf539740 1 --2- 172.21.15.19:0/1090888173 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x564178929f80 0x56417892c3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:37:00.670 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:00.664+0000 7f2dcf539740 4 client.26735 mds_command: new command op to 24581 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-10T22:37:00.670 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:00.664+0000 7f2dcf539740 1 -- 172.21.15.19:0/1090888173 --> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] -- command(tid 0: {"prefix": "scrub status"}) -- 0x5641788bed40 con 0x564178929f80 2024-09-10T22:37:00.670 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:00.665+0000 7f2dc6d9d640 1 --2- 172.21.15.19:0/1090888173 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x564178929f80 0x56417892c3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:37:00.670 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:00.665+0000 7f2dae7fc640 10 client.26735 ms_handle_connect on v2:172.21.15.135:6838/1254769802 2024-09-10T22:37:00.670 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:00.665+0000 7f2dc6d9d640 1 --2- 172.21.15.19:0/1090888173 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x564178929f80 0x56417892c3a0 crc :-1 s=READY pgs=207 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=25348bc3a4b61a79 server_cookie=960b3ff820fecb23 in_seq=0 out_seq=0 2024-09-10T22:37:00.670 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:00.665+0000 7f2dae7fc640 1 -- 172.21.15.19:0/1090888173 <== mds.0 v2:172.21.15.135:6838/1254769802 1 ==== command_reply(tid 0: 0 ) ==== 8+0+4066 (crc 0 0 0) 0x5641788bed40 con 0x564178929f80 2024-09-10T22:37:00.670 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:00.665+0000 7f2dae7fc640 10 client.26735 handle_command_reply: tid=0 2024-09-10T22:37:00.670 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:00.665+0000 7f2dcf539740 1 client.26735 shutdown 2024-09-10T22:37:00.670 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:00.665+0000 7f2dcf539740 1 -- 172.21.15.19:0/1090888173 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56417888fda0 msgr2=0x5641788a0550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:37:00.671 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:00.665+0000 7f2dcf539740 1 --2- 172.21.15.19:0/1090888173 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56417888fda0 0x5641788a0550 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f2db0005d00 tx=0x7f2db00043a0 comp rx=0 tx=0).stop 2024-09-10T22:37:00.671 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:00.666+0000 7f2dcf539740 1 -- 172.21.15.19:0/1090888173 shutdown_connections 2024-09-10T22:37:00.671 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:00.666+0000 7f2dcf539740 1 --2- 172.21.15.19:0/1090888173 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x564178929f80 0x56417892c3a0 crc :-1 s=READY pgs=207 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:37:00.671 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:00.666+0000 7f2dcf539740 1 --2- 172.21.15.19:0/1090888173 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x56417889bd30 0x5641789281b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:37:00.671 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:00.666+0000 7f2dcf539740 1 --2- 172.21.15.19:0/1090888173 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56417888fda0 0x5641788a0550 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:37:00.671 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:00.666+0000 7f2dcf539740 1 --2- 172.21.15.19:0/1090888173 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56417888f480 0x5641788a0010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:37:00.671 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:00.666+0000 7f2dcf539740 1 -- 172.21.15.19:0/1090888173 >> 172.21.15.19:0/1090888173 conn(0x56417888d2b0 msgr2=0x56417888e940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:37:00.671 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:00.666+0000 7f2dae7fc640 0 client.26735 ms_handle_reset on v2:172.21.15.135:6838/1254769802 2024-09-10T22:37:00.671 INFO:teuthology.orchestra.run.smithi019.stdout:{ 2024-09-10T22:37:00.671 INFO:teuthology.orchestra.run.smithi019.stdout: "status": "no active scrubs running", 2024-09-10T22:37:00.672 INFO:teuthology.orchestra.run.smithi019.stdout: "scrubs": {}, 2024-09-10T22:37:00.672 INFO:teuthology.orchestra.run.smithi019.stdout: "scrub_stats": { 2024-09-10T22:37:00.672 INFO:teuthology.orchestra.run.smithi019.stdout: "abfbdc16-212b-47f2-b921-c2a1cae322e5": { 2024-09-10T22:37:00.672 INFO:teuthology.orchestra.run.smithi019.stdout: "start_time": "2024-09-10T22:36:26.258118+0000", 2024-09-10T22:37:00.672 INFO:teuthology.orchestra.run.smithi019.stdout: "path": "/", 2024-09-10T22:37:00.672 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_started": 0, 2024-09-10T22:37:00.672 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_passed": 0, 2024-09-10T22:37:00.672 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_failed": 0, 2024-09-10T22:37:00.672 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_skipped": 0 2024-09-10T22:37:00.672 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:00.672 INFO:teuthology.orchestra.run.smithi019.stdout: "9b6bfdee-303c-4c12-af56-dc85860d112a": { 2024-09-10T22:37:00.672 INFO:teuthology.orchestra.run.smithi019.stdout: "start_time": "2024-09-10T22:26:17.484162+0000", 2024-09-10T22:37:00.673 INFO:teuthology.orchestra.run.smithi019.stdout: "path": "/", 2024-09-10T22:37:00.673 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_started": 0, 2024-09-10T22:37:00.673 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_passed": 0, 2024-09-10T22:37:00.673 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_failed": 0, 2024-09-10T22:37:00.673 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_skipped": 0 2024-09-10T22:37:00.673 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:00.673 INFO:teuthology.orchestra.run.smithi019.stdout: "b38852c8-478a-42ef-8384-b2c55d5313a4": { 2024-09-10T22:37:00.673 INFO:teuthology.orchestra.run.smithi019.stdout: "start_time": "2024-09-10T22:27:00.320308+0000", 2024-09-10T22:37:00.673 INFO:teuthology.orchestra.run.smithi019.stdout: "path": "/", 2024-09-10T22:37:00.673 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_started": 0, 2024-09-10T22:37:00.673 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_passed": 0, 2024-09-10T22:37:00.673 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_failed": 0, 2024-09-10T22:37:00.673 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_skipped": 0 2024-09-10T22:37:00.674 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:00.674 INFO:teuthology.orchestra.run.smithi019.stdout: "c12c2a04-dcd6-4673-a98e-93f665d3f5d7": { 2024-09-10T22:37:00.674 INFO:teuthology.orchestra.run.smithi019.stdout: "start_time": "2024-09-10T22:27:49.392329+0000", 2024-09-10T22:37:00.674 INFO:teuthology.orchestra.run.smithi019.stdout: "path": "/", 2024-09-10T22:37:00.674 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_started": 0, 2024-09-10T22:37:00.674 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_passed": 0, 2024-09-10T22:37:00.674 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_failed": 0, 2024-09-10T22:37:00.674 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_skipped": 0 2024-09-10T22:37:00.674 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:00.674 INFO:teuthology.orchestra.run.smithi019.stdout: "4c99964e-2e0e-4ffd-8cb8-99c4979ed90f": { 2024-09-10T22:37:00.674 INFO:teuthology.orchestra.run.smithi019.stdout: "start_time": "2024-09-10T22:32:34.659639+0000", 2024-09-10T22:37:00.674 INFO:teuthology.orchestra.run.smithi019.stdout: "path": "/", 2024-09-10T22:37:00.674 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_started": 0, 2024-09-10T22:37:00.674 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_passed": 0, 2024-09-10T22:37:00.675 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_failed": 0, 2024-09-10T22:37:00.675 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_skipped": 0 2024-09-10T22:37:00.675 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:00.675 INFO:teuthology.orchestra.run.smithi019.stdout: "9efe684b-7583-402e-a46e-e262a37e1af5": { 2024-09-10T22:37:00.675 INFO:teuthology.orchestra.run.smithi019.stdout: "start_time": "2024-09-10T22:34:09.479768+0000", 2024-09-10T22:37:00.675 INFO:teuthology.orchestra.run.smithi019.stdout: "path": "/", 2024-09-10T22:37:00.675 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_started": 0, 2024-09-10T22:37:00.675 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_passed": 0, 2024-09-10T22:37:00.675 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_failed": 0, 2024-09-10T22:37:00.675 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_skipped": 0 2024-09-10T22:37:00.675 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:00.675 INFO:teuthology.orchestra.run.smithi019.stdout: "eb518e3c-a71e-4f32-9ca0-ae88930ca218": { 2024-09-10T22:37:00.675 INFO:teuthology.orchestra.run.smithi019.stdout: "start_time": "2024-09-10T22:28:38.366352+0000", 2024-09-10T22:37:00.676 INFO:teuthology.orchestra.run.smithi019.stdout: "path": "/", 2024-09-10T22:37:00.676 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_started": 0, 2024-09-10T22:37:00.676 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_passed": 0, 2024-09-10T22:37:00.676 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_failed": 0, 2024-09-10T22:37:00.676 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_skipped": 0 2024-09-10T22:37:00.676 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:00.676 INFO:teuthology.orchestra.run.smithi019.stdout: "8f3bb3bf-911f-490c-9856-c80ea220dbbe": { 2024-09-10T22:37:00.676 INFO:teuthology.orchestra.run.smithi019.stdout: "start_time": "2024-09-10T22:29:25.374415+0000", 2024-09-10T22:37:00.676 INFO:teuthology.orchestra.run.smithi019.stdout: "path": "/", 2024-09-10T22:37:00.676 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_started": 0, 2024-09-10T22:37:00.676 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_passed": 0, 2024-09-10T22:37:00.676 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_failed": 0, 2024-09-10T22:37:00.676 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_skipped": 0 2024-09-10T22:37:00.677 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:00.677 INFO:teuthology.orchestra.run.smithi019.stdout: "fd1f1837-dcfa-4d88-99e8-2509f36c3f98": { 2024-09-10T22:37:00.677 INFO:teuthology.orchestra.run.smithi019.stdout: "start_time": "2024-09-10T22:30:12.470477+0000", 2024-09-10T22:37:00.677 INFO:teuthology.orchestra.run.smithi019.stdout: "path": "/", 2024-09-10T22:37:00.677 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_started": 0, 2024-09-10T22:37:00.677 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_passed": 0, 2024-09-10T22:37:00.677 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_failed": 0, 2024-09-10T22:37:00.677 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_skipped": 0 2024-09-10T22:37:00.677 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:00.677 INFO:teuthology.orchestra.run.smithi019.stdout: "715ec863-8a9d-45b6-967f-59b15ce1bf12": { 2024-09-10T22:37:00.677 INFO:teuthology.orchestra.run.smithi019.stdout: "start_time": "2024-09-10T22:31:00.669516+0000", 2024-09-10T22:37:00.677 INFO:teuthology.orchestra.run.smithi019.stdout: "path": "/", 2024-09-10T22:37:00.677 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_started": 0, 2024-09-10T22:37:00.677 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_passed": 0, 2024-09-10T22:37:00.678 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_failed": 0, 2024-09-10T22:37:00.678 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_skipped": 0 2024-09-10T22:37:00.678 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:00.678 INFO:teuthology.orchestra.run.smithi019.stdout: "0b81ea61-0b8e-4f2c-a58f-ef1019289fc9": { 2024-09-10T22:37:00.678 INFO:teuthology.orchestra.run.smithi019.stdout: "start_time": "2024-09-10T22:31:48.141568+0000", 2024-09-10T22:37:00.678 INFO:teuthology.orchestra.run.smithi019.stdout: "path": "/", 2024-09-10T22:37:00.678 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_started": 0, 2024-09-10T22:37:00.678 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_passed": 0, 2024-09-10T22:37:00.678 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_failed": 0, 2024-09-10T22:37:00.678 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_skipped": 0 2024-09-10T22:37:00.678 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:00.678 INFO:teuthology.orchestra.run.smithi019.stdout: "a77606c2-7618-413e-8aba-f9783ecbf435": { 2024-09-10T22:37:00.679 INFO:teuthology.orchestra.run.smithi019.stdout: "start_time": "2024-09-10T22:34:54.453894+0000", 2024-09-10T22:37:00.679 INFO:teuthology.orchestra.run.smithi019.stdout: "path": "/", 2024-09-10T22:37:00.679 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_started": 0, 2024-09-10T22:37:00.679 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_passed": 0, 2024-09-10T22:37:00.679 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_failed": 0, 2024-09-10T22:37:00.679 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_skipped": 0 2024-09-10T22:37:00.679 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:00.679 INFO:teuthology.orchestra.run.smithi019.stdout: "448b10e7-494c-4a88-a9ab-186159c5dfdd": { 2024-09-10T22:37:00.679 INFO:teuthology.orchestra.run.smithi019.stdout: "start_time": "2024-09-10T22:33:21.208716+0000", 2024-09-10T22:37:00.679 INFO:teuthology.orchestra.run.smithi019.stdout: "path": "/", 2024-09-10T22:37:00.679 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_started": 0, 2024-09-10T22:37:00.679 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_passed": 0, 2024-09-10T22:37:00.679 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_failed": 0, 2024-09-10T22:37:00.679 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_skipped": 0 2024-09-10T22:37:00.680 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:00.680 INFO:teuthology.orchestra.run.smithi019.stdout: "1a6e9f60-01cc-4339-aff0-9ef63cbda443": { 2024-09-10T22:37:00.680 INFO:teuthology.orchestra.run.smithi019.stdout: "start_time": "2024-09-10T22:35:40.561000+0000", 2024-09-10T22:37:00.680 INFO:teuthology.orchestra.run.smithi019.stdout: "path": "/", 2024-09-10T22:37:00.680 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_started": 0, 2024-09-10T22:37:00.680 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_passed": 0, 2024-09-10T22:37:00.680 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_failed": 0, 2024-09-10T22:37:00.680 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_skipped": 0 2024-09-10T22:37:00.680 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-10T22:37:00.680 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-10T22:37:00.680 INFO:teuthology.orchestra.run.smithi019.stdout:} 2024-09-10T22:37:00.681 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:00.666+0000 7f2dcf539740 1 -- 172.21.15.19:0/1090888173 shutdown_connections 2024-09-10T22:37:00.681 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:00.666+0000 7f2dcf539740 1 -- 172.21.15.19:0/1090888173 wait complete. 2024-09-10T22:37:00.681 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:00.666+0000 7f2dcf539740 20 client.26735 trim_cache size 0 max 16384 2024-09-10T22:37:00.681 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:00.666+0000 7f2dcd164640 1 -- 172.21.15.19:0/387820727 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f2db40b53e0 msgr2=0x7f2db40b78a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:37:00.681 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:00.666+0000 7f2dcd164640 1 --2- 172.21.15.19:0/387820727 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f2db40b53e0 0x7f2db40b78a0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f2db00058a0 tx=0x7f2db000b750 comp rx=0 tx=0).stop 2024-09-10T22:37:00.682 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:00.666+0000 7f2dcd164640 1 -- 172.21.15.19:0/387820727 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2dc8108020 msgr2=0x7f2dc819ab60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:37:00.682 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:00.666+0000 7f2dcd164640 1 --2- 172.21.15.19:0/387820727 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2dc8108020 0x7f2dc819ab60 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 crypto rx=0x7f2dc0009d10 tx=0x7f2dc0007590 comp rx=0 tx=0).stop 2024-09-10T22:37:00.682 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:00.667+0000 7f2dcd164640 1 -- 172.21.15.19:0/387820727 shutdown_connections 2024-09-10T22:37:00.682 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:00.667+0000 7f2dcd164640 1 --2- 172.21.15.19:0/387820727 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f2db40b53e0 0x7f2db40b78a0 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:37:00.682 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:00.667+0000 7f2dcd164640 1 --2- 172.21.15.19:0/387820727 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2dc8108020 0x7f2dc819ab60 unknown :-1 s=CLOSED pgs=827 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:37:00.682 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:00.667+0000 7f2dcd164640 1 --2- 172.21.15.19:0/387820727 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f2dc81076a0 0x7f2dc819a5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:37:00.682 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:00.667+0000 7f2dcd164640 1 --2- 172.21.15.19:0/387820727 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2dc8101c90 0x7f2dc819a0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:37:00.682 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:00.667+0000 7f2dcd164640 1 -- 172.21.15.19:0/387820727 >> 172.21.15.19:0/387820727 conn(0x7f2dc80fd700 msgr2=0x7f2dc80ffaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:37:00.682 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:00.667+0000 7f2dcd164640 1 -- 172.21.15.19:0/387820727 shutdown_connections 2024-09-10T22:37:00.682 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:00.667+0000 7f2dcd164640 1 -- 172.21.15.19:0/387820727 wait complete. 2024-09-10T22:37:01.586 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-10T22:37:01.586 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 22997a4c-6fc2-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-10T22:37:01.899 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/22997a4c-6fc2-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T22:37:02.377 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:37:02 smithi019 ceph-mon[31375]: pgmap v665: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 365 KiB/s rd, 199 MiB/s wr, 1.28k op/s 2024-09-10T22:37:02.512 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:02.510+0000 7f887affe640 1 -- 172.21.15.19:0/2588362188 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8874103cd0 msgr2=0x7f88741040b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:37:02.512 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:02.510+0000 7f887affe640 1 --2- 172.21.15.19:0/2588362188 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8874103cd0 0x7f88741040b0 secure :-1 s=READY pgs=828 cs=0 l=1 rev1=1 crypto rx=0x7f8868009900 tx=0x7f886802a410 comp rx=0 tx=0).stop 2024-09-10T22:37:02.512 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:02.510+0000 7f887affe640 1 -- 172.21.15.19:0/2588362188 shutdown_connections 2024-09-10T22:37:02.513 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:02.510+0000 7f887affe640 1 --2- 172.21.15.19:0/2588362188 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f887410d130 0x7f887410f590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:37:02.513 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:02.510+0000 7f887affe640 1 --2- 172.21.15.19:0/2588362188 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f88741045f0 0x7f887410cae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:37:02.513 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:02.510+0000 7f887affe640 1 --2- 172.21.15.19:0/2588362188 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8874103cd0 0x7f88741040b0 unknown :-1 s=CLOSED pgs=828 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:37:02.513 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:02.510+0000 7f887affe640 1 -- 172.21.15.19:0/2588362188 >> 172.21.15.19:0/2588362188 conn(0x7f88740fd770 msgr2=0x7f88740ffb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:37:02.513 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:02.510+0000 7f887affe640 1 -- 172.21.15.19:0/2588362188 shutdown_connections 2024-09-10T22:37:02.513 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:02.510+0000 7f887affe640 1 -- 172.21.15.19:0/2588362188 wait complete. 2024-09-10T22:37:02.513 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:02.511+0000 7f887affe640 1 Processor -- start 2024-09-10T22:37:02.513 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:02.511+0000 7f887affe640 1 -- start start 2024-09-10T22:37:02.514 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:02.511+0000 7f887affe640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f8874103cd0 0x7f88741992e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:37:02.514 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:02.511+0000 7f887affe640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f88741045f0 0x7f8874199820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:37:02.514 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:02.511+0000 7f887affe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f887410d130 0x7f887419ebc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:37:02.514 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:02.511+0000 7f887affe640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f8874112df0 con 0x7f887410d130 2024-09-10T22:37:02.514 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:02.511+0000 7f887affe640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f8874112c70 con 0x7f88741045f0 2024-09-10T22:37:02.515 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:02.511+0000 7f887affe640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f8874112f70 con 0x7f8874103cd0 2024-09-10T22:37:02.515 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:02.512+0000 7f8878d9a640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f8874103cd0 0x7f88741992e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:37:02.515 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:02.512+0000 7f887959b640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f887410d130 0x7f887419ebc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:37:02.515 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:02.512+0000 7f8878d9a640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f8874103cd0 0x7f88741992e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.19:59526/0 (socket says 172.21.15.19:59526) 2024-09-10T22:37:02.515 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:02.512+0000 7f8878d9a640 1 -- 172.21.15.19:0/1571837590 learned_addr learned my addr 172.21.15.19:0/1571837590 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:37:02.515 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:02.512+0000 7f8873fff640 1 --2- 172.21.15.19:0/1571837590 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f88741045f0 0x7f8874199820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:37:02.515 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:02.512+0000 7f8873fff640 1 -- 172.21.15.19:0/1571837590 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f8874103cd0 msgr2=0x7f88741992e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:37:02.515 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:02.512+0000 7f8873fff640 1 --2- 172.21.15.19:0/1571837590 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f8874103cd0 0x7f88741992e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:37:02.515 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:02.512+0000 7f8873fff640 1 -- 172.21.15.19:0/1571837590 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f887410d130 msgr2=0x7f887419ebc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:37:02.515 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:02.512+0000 7f8873fff640 1 --2- 172.21.15.19:0/1571837590 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f887410d130 0x7f887419ebc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:37:02.515 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:02.512+0000 7f8873fff640 1 -- 172.21.15.19:0/1571837590 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f887419f390 con 0x7f88741045f0 2024-09-10T22:37:02.515 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:02.512+0000 7f8873fff640 1 --2- 172.21.15.19:0/1571837590 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f88741045f0 0x7f8874199820 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f886000e770 tx=0x7f886000ec30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:37:02.515 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:02.512+0000 7f8871ffb640 1 -- 172.21.15.19:0/1571837590 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f886000ccc0 con 0x7f88741045f0 2024-09-10T22:37:02.515 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:02.512+0000 7f8871ffb640 1 -- 172.21.15.19:0/1571837590 <== mon.2 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f886000ee80 con 0x7f88741045f0 2024-09-10T22:37:02.516 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:02.512+0000 7f8871ffb640 1 -- 172.21.15.19:0/1571837590 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8860003e40 con 0x7f88741045f0 2024-09-10T22:37:02.516 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:02.513+0000 7f887affe640 1 -- 172.21.15.19:0/1571837590 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f887419f680 con 0x7f88741045f0 2024-09-10T22:37:02.516 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:02.513+0000 7f887affe640 1 -- 172.21.15.19:0/1571837590 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f88741a5d40 con 0x7f88741045f0 2024-09-10T22:37:02.516 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:02.514+0000 7f887affe640 1 -- 172.21.15.19:0/1571837590 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f88741040b0 con 0x7f88741045f0 2024-09-10T22:37:02.517 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:02.515+0000 7f8871ffb640 1 -- 172.21.15.19:0/1571837590 <== mon.2 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 18) ==== 153250+0+0 (secure 0 0 0) 0x7f8860004000 con 0x7f88741045f0 2024-09-10T22:37:02.517 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:02.516+0000 7f8871ffb640 1 --2- 172.21.15.19:0/1571837590 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f88640b5360 0x7f88640b7820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:37:02.518 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:02.516+0000 7f8878d9a640 1 --2- 172.21.15.19:0/1571837590 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f88640b5360 0x7f88640b7820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:37:02.518 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:02.516+0000 7f8871ffb640 1 -- 172.21.15.19:0/1571837590 <== mon.2 v2:172.21.15.135:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8327+0+0 (secure 0 0 0) 0x7f88600e5e70 con 0x7f88741045f0 2024-09-10T22:37:02.518 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:02.517+0000 7f8878d9a640 1 --2- 172.21.15.19:0/1571837590 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f88640b5360 0x7f88640b7820 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f88680096c0 tx=0x7f8868005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:37:02.522 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:02.520+0000 7f8871ffb640 1 -- 172.21.15.19:0/1571837590 <== mon.2 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f88600accd0 con 0x7f88741045f0 2024-09-10T22:37:02.610 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:37:02 smithi135 ceph-mon[34789]: pgmap v665: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 365 KiB/s rd, 199 MiB/s wr, 1.28k op/s 2024-09-10T22:37:02.625 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:37:02 smithi138 ceph-mon[35236]: pgmap v665: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 365 KiB/s rd, 199 MiB/s wr, 1.28k op/s 2024-09-10T22:37:02.757 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:02.756+0000 7f887affe640 1 -- 172.21.15.19:0/1571837590 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f887402e5c0 con 0x7f88741045f0 2024-09-10T22:37:02.758 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:02.757+0000 7f8871ffb640 1 -- 172.21.15.19:0/1571837590 <== mon.2 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) ==== 94+0+11921 (secure 0 0 0) 0x7f88600ac5d0 con 0x7f88741045f0 2024-09-10T22:37:02.759 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-10T22:37:02.759 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":27,"btime":"2024-09-10T22:29:37:724724+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14673,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6835/1835804747","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6834","nonce":1835804747},{"type":"v1","addr":"172.21.15.19:6835","nonce":1835804747}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14685,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6837/1750470490","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6836","nonce":1750470490},{"type":"v1","addr":"172.21.15.19:6837","nonce":1750470490}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14733,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6839/2642941149","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6838","nonce":2642941149},{"type":"v1","addr":"172.21.15.19:6839","nonce":2642941149}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14745,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6841/2449948682","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6840","nonce":2449948682},{"type":"v1","addr":"172.21.15.19:6841","nonce":2449948682}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24511,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.138:6833/2524811494","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6832","nonce":2524811494},{"type":"v1","addr":"172.21.15.138:6833","nonce":2524811494}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24512,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6833/3014993624","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6832","nonce":3014993624},{"type":"v1","addr":"172.21.15.135:6833","nonce":3014993624}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":27,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-10T22:24:22.733925+0000","modified":"2024-09-10T22:29:37.430699+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24581,"mds_1":24568,"mds_2":24553},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24527":{"gid":24527,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.135:6835/3715773348","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6834","nonce":3715773348},{"type":"v1","addr":"172.21.15.135:6835","nonce":3715773348}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24541":{"gid":24541,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.138:6835/933547028","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6834","nonce":933547028},{"type":"v1","addr":"172.21.15.138:6835","nonce":933547028}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24551":{"gid":24551,"name":"h","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.135:6837/3495029135","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6836","nonce":3495029135},{"type":"v1","addr":"172.21.15.135:6837","nonce":3495029135}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24553":{"gid":24553,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":10,"addr":"172.21.15.138:6837/3353290042","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6836","nonce":3353290042},{"type":"v1","addr":"172.21.15.138:6837","nonce":3353290042}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24568":{"gid":24568,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.138:6839/383637208","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6838","nonce":383637208},{"type":"v1","addr":"172.21.15.138:6839","nonce":383637208}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24581":{"gid":24581,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.135:6839/1254769802","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6838","nonce":1254769802},{"type":"v1","addr":"172.21.15.135:6839","nonce":1254769802}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24581,"qdb_cluster":[24581,24568,24553]},"id":1}]} 2024-09-10T22:37:02.759 INFO:teuthology.orchestra.run.smithi019.stderr:dumped fsmap epoch 27 2024-09-10T22:37:02.762 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:02.760+0000 7f887affe640 1 -- 172.21.15.19:0/1571837590 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f88640b5360 msgr2=0x7f88640b7820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:37:02.762 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:02.760+0000 7f887affe640 1 --2- 172.21.15.19:0/1571837590 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f88640b5360 0x7f88640b7820 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f88680096c0 tx=0x7f8868005a20 comp rx=0 tx=0).stop 2024-09-10T22:37:02.762 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:02.760+0000 7f887affe640 1 -- 172.21.15.19:0/1571837590 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f88741045f0 msgr2=0x7f8874199820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:37:02.762 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:02.760+0000 7f887affe640 1 --2- 172.21.15.19:0/1571837590 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f88741045f0 0x7f8874199820 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f886000e770 tx=0x7f886000ec30 comp rx=0 tx=0).stop 2024-09-10T22:37:02.763 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:02.761+0000 7f887affe640 1 -- 172.21.15.19:0/1571837590 shutdown_connections 2024-09-10T22:37:02.763 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:02.761+0000 7f887affe640 1 --2- 172.21.15.19:0/1571837590 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f88640b5360 0x7f88640b7820 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:37:02.763 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:02.761+0000 7f887affe640 1 --2- 172.21.15.19:0/1571837590 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f887410d130 0x7f887419ebc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:37:02.763 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:02.761+0000 7f887affe640 1 --2- 172.21.15.19:0/1571837590 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f88741045f0 0x7f8874199820 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:37:02.763 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:02.761+0000 7f887affe640 1 --2- 172.21.15.19:0/1571837590 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f8874103cd0 0x7f88741992e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:37:02.763 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:02.761+0000 7f887affe640 1 -- 172.21.15.19:0/1571837590 >> 172.21.15.19:0/1571837590 conn(0x7f88740fd770 msgr2=0x7f88740fe3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:37:02.763 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:02.761+0000 7f887affe640 1 -- 172.21.15.19:0/1571837590 shutdown_connections 2024-09-10T22:37:02.763 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:02.761+0000 7f887affe640 1 -- 172.21.15.19:0/1571837590 wait complete. 2024-09-10T22:37:03.499 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:37:03 smithi019 ceph-mon[31375]: from='client.? 172.21.15.19:0/1571837590' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T22:37:03.500 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 22997a4c-6fc2-11ef-bcea-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-09-10T22:37:03.609 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:37:03 smithi135 ceph-mon[34789]: from='client.? 172.21.15.19:0/1571837590' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T22:37:03.625 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:37:03 smithi138 ceph-mon[35236]: from='client.? 172.21.15.19:0/1571837590' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T22:37:03.807 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/22997a4c-6fc2-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T22:37:04.544 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:04.540+0000 7f496476b640 1 -- 172.21.15.19:0/3052960181 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f495c1023b0 msgr2=0x7f495c106880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:37:04.544 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:04.540+0000 7f496476b640 1 --2- 172.21.15.19:0/3052960181 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f495c1023b0 0x7f495c106880 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f494c009900 tx=0x7f494c02a400 comp rx=0 tx=0).stop 2024-09-10T22:37:04.544 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:04.540+0000 7f496476b640 1 -- 172.21.15.19:0/3052960181 shutdown_connections 2024-09-10T22:37:04.544 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:04.540+0000 7f496476b640 1 --2- 172.21.15.19:0/3052960181 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f495c106ed0 0x7f495c107320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:37:04.545 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:04.540+0000 7f496476b640 1 --2- 172.21.15.19:0/3052960181 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f495c1023b0 0x7f495c106880 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:37:04.545 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:04.540+0000 7f496476b640 1 --2- 172.21.15.19:0/3052960181 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f495c101a90 0x7f495c101e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:37:04.545 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:04.540+0000 7f496476b640 1 -- 172.21.15.19:0/3052960181 >> 172.21.15.19:0/3052960181 conn(0x7f495c0fd700 msgr2=0x7f495c0ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:37:04.545 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:04.540+0000 7f496476b640 1 -- 172.21.15.19:0/3052960181 shutdown_connections 2024-09-10T22:37:04.545 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:04.541+0000 7f496476b640 1 -- 172.21.15.19:0/3052960181 wait complete. 2024-09-10T22:37:04.545 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:37:04 smithi019 ceph-mon[31375]: pgmap v666: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 134 KiB/s rd, 172 MiB/s wr, 1.08k op/s 2024-09-10T22:37:04.546 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:04.543+0000 7f496476b640 1 Processor -- start 2024-09-10T22:37:04.548 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:04.544+0000 7f496476b640 1 -- start start 2024-09-10T22:37:04.548 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:04.544+0000 7f496476b640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f495c101a90 0x7f495c19f8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:37:04.548 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:04.545+0000 7f496476b640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f495c1023b0 0x7f495c19fe00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:37:04.548 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:04.545+0000 7f496476b640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f495c106ed0 0x7f495c1a51a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:37:04.548 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:04.545+0000 7f496476b640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f495c119390 con 0x7f495c1023b0 2024-09-10T22:37:04.548 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:04.545+0000 7f496476b640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f495c119210 con 0x7f495c106ed0 2024-09-10T22:37:04.548 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:04.545+0000 7f496476b640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f495c119510 con 0x7f495c101a90 2024-09-10T22:37:04.549 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:04.546+0000 7f4962507640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f495c101a90 0x7f495c19f8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:37:04.549 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:04.546+0000 7f4962507640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f495c101a90 0x7f495c19f8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.19:51756/0 (socket says 172.21.15.19:51756) 2024-09-10T22:37:04.549 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:04.546+0000 7f4962507640 1 -- 172.21.15.19:0/4179638818 learned_addr learned my addr 172.21.15.19:0/4179638818 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:37:04.549 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:04.546+0000 7f4961d06640 1 --2- 172.21.15.19:0/4179638818 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f495c1023b0 0x7f495c19fe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:37:04.550 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:04.547+0000 7f4961d06640 1 -- 172.21.15.19:0/4179638818 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f495c101a90 msgr2=0x7f495c19f8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:37:04.550 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:04.547+0000 7f4961d06640 1 --2- 172.21.15.19:0/4179638818 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f495c101a90 0x7f495c19f8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:37:04.550 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:04.548+0000 7f4961d06640 1 -- 172.21.15.19:0/4179638818 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f495c106ed0 msgr2=0x7f495c1a51a0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-10T22:37:04.550 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:04.548+0000 7f4961d06640 1 --2- 172.21.15.19:0/4179638818 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f495c106ed0 0x7f495c1a51a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:37:04.550 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:04.548+0000 7f4961d06640 1 -- 172.21.15.19:0/4179638818 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f495c1a5970 con 0x7f495c1023b0 2024-09-10T22:37:04.550 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:04.548+0000 7f4961d06640 1 --2- 172.21.15.19:0/4179638818 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f495c1023b0 0x7f495c19fe00 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 crypto rx=0x7f494c02a920 tx=0x7f494c003b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:37:04.551 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:04.549+0000 7f49537fe640 1 -- 172.21.15.19:0/4179638818 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f494c03f070 con 0x7f495c1023b0 2024-09-10T22:37:04.552 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:04.550+0000 7f49537fe640 1 -- 172.21.15.19:0/4179638818 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f494c031b50 con 0x7f495c1023b0 2024-09-10T22:37:04.552 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:04.550+0000 7f496476b640 1 -- 172.21.15.19:0/4179638818 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f495c1a5c00 con 0x7f495c1023b0 2024-09-10T22:37:04.552 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:04.550+0000 7f496476b640 1 -- 172.21.15.19:0/4179638818 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f495c06cb70 con 0x7f495c1023b0 2024-09-10T22:37:04.552 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:04.550+0000 7f49537fe640 1 -- 172.21.15.19:0/4179638818 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f494c035030 con 0x7f495c1023b0 2024-09-10T22:37:04.558 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:04.554+0000 7f4966b40740 1 Processor -- start 2024-09-10T22:37:04.558 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:04.554+0000 7f4966b40740 1 -- start start 2024-09-10T22:37:04.558 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:04.555+0000 7f4966b40740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ece36490f0 0x55ece36494d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:37:04.559 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:04.555+0000 7f4966b40740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55ece3649a10 0x55ece3655460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:37:04.559 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:04.555+0000 7f4966b40740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ece36559a0 0x55ece3657d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:37:04.559 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:04.555+0000 7f4966b40740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x55ece35bfea0 con 0x55ece36559a0 2024-09-10T22:37:04.559 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:04.555+0000 7f4966b40740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55ece35af2d0 con 0x55ece36490f0 2024-09-10T22:37:04.559 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:04.555+0000 7f4966b40740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x55ece35b30e0 con 0x55ece3649a10 2024-09-10T22:37:04.559 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:04.556+0000 7f4962d08640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ece36490f0 0x55ece36494d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:37:04.559 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:04.556+0000 7f4962d08640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ece36490f0 0x55ece36494d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.19:40368/0 (socket says 172.21.15.19:40368) 2024-09-10T22:37:04.559 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:04.556+0000 7f4962d08640 1 -- 172.21.15.19:0/4280333738 learned_addr learned my addr 172.21.15.19:0/4280333738 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:37:04.559 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:04.557+0000 7f4962507640 1 --2- 172.21.15.19:0/4280333738 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55ece3649a10 0x55ece3655460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:37:04.559 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:04.557+0000 7f4962d08640 1 -- 172.21.15.19:0/4280333738 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55ece3649a10 msgr2=0x55ece3655460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:37:04.559 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:04.557+0000 7f4962d08640 1 --2- 172.21.15.19:0/4280333738 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55ece3649a10 0x55ece3655460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:37:04.560 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:04.557+0000 7f4962d08640 1 -- 172.21.15.19:0/4280333738 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ece36559a0 msgr2=0x55ece3657d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:37:04.560 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:04.557+0000 7f4962d08640 1 --2- 172.21.15.19:0/4280333738 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ece36559a0 0x55ece3657d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:37:04.560 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:04.557+0000 7f4962d08640 1 -- 172.21.15.19:0/4280333738 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ece330d650 con 0x55ece36490f0 2024-09-10T22:37:04.561 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:04.558+0000 7f4962d08640 1 --2- 172.21.15.19:0/4280333738 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ece36490f0 0x55ece36494d0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f4954009e30 tx=0x7f495400e720 comp rx=0 tx=0).ready entity=mon.2 client_cookie=37afc15b88c0735e server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:37:04.561 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:04.559+0000 7f49537fe640 1 -- 172.21.15.19:0/4179638818 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 18) ==== 153250+0+0 (secure 0 0 0) 0x7f494c0316a0 con 0x7f495c1023b0 2024-09-10T22:37:04.563 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:04.561+0000 7f4950ff9640 1 -- 172.21.15.19:0/4280333738 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4954004d20 con 0x55ece36490f0 2024-09-10T22:37:04.563 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:04.561+0000 7f4950ff9640 1 -- 172.21.15.19:0/4280333738 <== mon.2 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f495400ee70 con 0x55ece36490f0 2024-09-10T22:37:04.563 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:04.561+0000 7f4950ff9640 1 -- 172.21.15.19:0/4280333738 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4954010760 con 0x55ece36490f0 2024-09-10T22:37:04.566 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:04.562+0000 7f49537fe640 1 --2- 172.21.15.19:0/4179638818 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f49480b5430 0x7f49480b78f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:37:04.566 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:04.562+0000 7f4962507640 1 --2- 172.21.15.19:0/4179638818 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f49480b5430 0x7f49480b78f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:37:04.566 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:04.563+0000 7f4966b40740 1 -- 172.21.15.19:0/4280333738 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ece36490f0 msgr2=0x55ece36494d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:37:04.566 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:04.563+0000 7f4966b40740 1 --2- 172.21.15.19:0/4280333738 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ece36490f0 0x55ece36494d0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f4954009e30 tx=0x7f495400e720 comp rx=0 tx=0).stop 2024-09-10T22:37:04.566 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:04.563+0000 7f4966b40740 1 -- 172.21.15.19:0/4280333738 shutdown_connections 2024-09-10T22:37:04.566 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:04.563+0000 7f4966b40740 1 --2- 172.21.15.19:0/4280333738 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ece36559a0 0x55ece3657d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:37:04.566 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:04.563+0000 7f4966b40740 1 --2- 172.21.15.19:0/4280333738 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55ece3649a10 0x55ece3655460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:37:04.566 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:04.563+0000 7f4966b40740 1 --2- 172.21.15.19:0/4280333738 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ece36490f0 0x55ece36494d0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:37:04.566 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:04.563+0000 7f4966b40740 1 -- 172.21.15.19:0/4280333738 >> 172.21.15.19:0/4280333738 conn(0x55ece3646f20 msgr2=0x55ece36480c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:37:04.567 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:04.563+0000 7f49537fe640 1 -- 172.21.15.19:0/4179638818 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8327+0+0 (secure 0 0 0) 0x7f494c108330 con 0x7f495c1023b0 2024-09-10T22:37:04.567 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:04.563+0000 7f4962507640 1 --2- 172.21.15.19:0/4179638818 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f49480b5430 0x7f49480b78f0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x55ece3647e00 tx=0x7f4958005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:37:04.567 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:04.564+0000 7f4966b40740 1 -- 172.21.15.19:0/4280333738 shutdown_connections 2024-09-10T22:37:04.567 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:04.564+0000 7f4966b40740 1 -- 172.21.15.19:0/4280333738 wait complete. 2024-09-10T22:37:04.567 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:04.564+0000 7f4966b40740 1 -- start start 2024-09-10T22:37:04.567 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:04.564+0000 7f4966b40740 1 Processor -- start 2024-09-10T22:37:04.568 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:04.565+0000 7f4966b40740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55ece36490f0 0x55ece36551d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:37:04.568 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:04.565+0000 7f4966b40740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ece3649a10 0x55ece3652620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:37:04.568 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:04.565+0000 7f4966b40740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ece36559a0 0x55ece3652b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:37:04.568 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:04.565+0000 7f4966b40740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x55ece3410700 con 0x55ece3649a10 2024-09-10T22:37:04.569 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:04.565+0000 7f4966b40740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55ece354a160 con 0x55ece36559a0 2024-09-10T22:37:04.569 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:04.565+0000 7f4966b40740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x55ece3658670 con 0x55ece36490f0 2024-09-10T22:37:04.569 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:04.565+0000 7f4966b40740 10 client.0 _ll_register_callbacks cb 0x55ece35639e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T22:37:04.569 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:04.566+0000 7f4961d06640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ece3649a10 0x55ece3652620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:37:04.569 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:04.566+0000 7f4961d06640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ece3649a10 0x55ece3652620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:46148/0 (socket says 172.21.15.19:46148) 2024-09-10T22:37:04.569 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:04.566+0000 7f4961d06640 1 -- 172.21.15.19:0/1867625962 learned_addr learned my addr 172.21.15.19:0/1867625962 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:37:04.569 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:04.566+0000 7f4962507640 1 --2- 172.21.15.19:0/1867625962 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55ece36490f0 0x55ece36551d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:37:04.570 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:04.568+0000 7f4961d06640 1 -- 172.21.15.19:0/1867625962 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55ece36490f0 msgr2=0x55ece36551d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:37:04.570 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:04.568+0000 7f4961d06640 1 --2- 172.21.15.19:0/1867625962 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55ece36490f0 0x55ece36551d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:37:04.570 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:04.568+0000 7f4961d06640 1 -- 172.21.15.19:0/1867625962 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ece36559a0 msgr2=0x55ece3652b60 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-10T22:37:04.570 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:04.568+0000 7f4961d06640 1 --2- 172.21.15.19:0/1867625962 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ece36559a0 0x55ece3652b60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:37:04.570 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:04.568+0000 7f4961d06640 1 -- 172.21.15.19:0/1867625962 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ece3577c90 con 0x55ece3649a10 2024-09-10T22:37:04.570 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:04.569+0000 7f4961d06640 1 --2- 172.21.15.19:0/1867625962 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ece3649a10 0x55ece3652620 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 crypto rx=0x7f494c0cbd00 tx=0x7f494c0ca930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=544d55da714afdbb server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:37:04.571 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:04.569+0000 7f4945ffb640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-10T22:37:04.571 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:04.569+0000 7f4945ffb640 1 -- 172.21.15.19:0/1867625962 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f494c0ce200 con 0x55ece3649a10 2024-09-10T22:37:04.571 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:04.570+0000 7f4966b40740 1 -- 172.21.15.19:0/1867625962 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f495400ee70 con 0x55ece3649a10 2024-09-10T22:37:04.572 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:04.570+0000 7f4945ffb640 1 -- 172.21.15.19:0/1867625962 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8327+0+0 (secure 0 0 0) 0x7f494c0cad00 con 0x55ece3649a10 2024-09-10T22:37:04.572 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:04.570+0000 7f4945ffb640 1 -- 172.21.15.19:0/1867625962 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f494c0ce5a0 con 0x55ece3649a10 2024-09-10T22:37:04.572 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:04.571+0000 7f4966b40740 10 client.17448 fetch_fsmap learned FSMap version 27 2024-09-10T22:37:04.572 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:04.571+0000 7f4966b40740 1 -- 172.21.15.19:0/1867625962 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55ece3674f80 con 0x55ece3649a10 2024-09-10T22:37:04.573 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:04.571+0000 7f4945ffb640 1 -- 172.21.15.19:0/1867625962 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f495400ee70 con 0x55ece3649a10 2024-09-10T22:37:04.574 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:04.572+0000 7f4945ffb640 1 -- 172.21.15.19:0/1867625962 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7f494c0d7b90 con 0x55ece3649a10 2024-09-10T22:37:04.574 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:04.572+0000 7f4966b40740 10 client.17448 fetch_fsmap finished waiting for FSMap version 27 2024-09-10T22:37:04.574 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:04.572+0000 7f4966b40740 10 client.17448 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-10T22:37:04.575 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:04.572+0000 7f4966b40740 20 client.17448 populate_metadata read hostname 'smithi019' 2024-09-10T22:37:04.575 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:04.572+0000 7f4966b40740 1 --2- 172.21.15.19:0/1867625962 >> [v2:172.21.15.138:6836/3353290042,v1:172.21.15.138:6837/3353290042] conn(0x55ece36765d0 0x55ece3678a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:37:04.575 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:04.572+0000 7f4966b40740 4 client.17448 mds_command: new command op to 24553 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T22:37:04.575 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:04.572+0000 7f4966b40740 1 -- 172.21.15.19:0/1867625962 --> [v2:172.21.15.138:6836/3353290042,v1:172.21.15.138:6837/3353290042] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ece35c1df0 con 0x55ece36765d0 2024-09-10T22:37:04.575 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:04.574+0000 7f4962507640 1 --2- 172.21.15.19:0/1867625962 >> [v2:172.21.15.138:6836/3353290042,v1:172.21.15.138:6837/3353290042] conn(0x55ece36765d0 0x55ece3678a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:37:04.578 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:04.576+0000 7f4945ffb640 10 client.17448 ms_handle_connect on v2:172.21.15.138:6836/3353290042 2024-09-10T22:37:04.578 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:04.576+0000 7f4962507640 1 --2- 172.21.15.19:0/1867625962 >> [v2:172.21.15.138:6836/3353290042,v1:172.21.15.138:6837/3353290042] conn(0x55ece36765d0 0x55ece3678a30 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=fa775012f47ab18b server_cookie=c49708259cd6e57b in_seq=0 out_seq=0 2024-09-10T22:37:04.585 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:04.583+0000 7f4945ffb640 1 -- 172.21.15.19:0/1867625962 <== mds.2 v2:172.21.15.138:6836/3353290042 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55ece35c1df0 con 0x55ece36765d0 2024-09-10T22:37:04.586 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:04.583+0000 7f4945ffb640 10 client.17448 handle_command_reply: tid=0 2024-09-10T22:37:04.586 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:04.583+0000 7f4966b40740 1 client.17448 shutdown 2024-09-10T22:37:04.586 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:04.584+0000 7f4966b40740 1 -- 172.21.15.19:0/1867625962 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ece3649a10 msgr2=0x55ece3652620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:37:04.586 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:04.584+0000 7f4966b40740 1 --2- 172.21.15.19:0/1867625962 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ece3649a10 0x55ece3652620 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 crypto rx=0x7f494c0cbd00 tx=0x7f494c0ca930 comp rx=0 tx=0).stop 2024-09-10T22:37:04.586 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:04.584+0000 7f4966b40740 1 -- 172.21.15.19:0/1867625962 shutdown_connections 2024-09-10T22:37:04.586 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:04.584+0000 7f4966b40740 1 --2- 172.21.15.19:0/1867625962 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ece36559a0 0x55ece3652b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:37:04.586 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:04.584+0000 7f4966b40740 1 --2- 172.21.15.19:0/1867625962 >> [v2:172.21.15.138:6836/3353290042,v1:172.21.15.138:6837/3353290042] conn(0x55ece36765d0 0x55ece3678a30 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:37:04.586 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:04.584+0000 7f4966b40740 1 --2- 172.21.15.19:0/1867625962 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ece3649a10 0x55ece3652620 unknown :-1 s=CLOSED pgs=830 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:37:04.586 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:04.584+0000 7f4966b40740 1 --2- 172.21.15.19:0/1867625962 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55ece36490f0 0x55ece36551d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:37:04.586 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:04.584+0000 7f4966b40740 1 -- 172.21.15.19:0/1867625962 >> 172.21.15.19:0/1867625962 conn(0x55ece3646f20 msgr2=0x55ece364ca90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:37:04.586 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:04.584+0000 7f4945ffb640 0 client.17448 ms_handle_reset on v2:172.21.15.138:6836/3353290042 2024-09-10T22:37:04.586 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:04.584+0000 7f4966b40740 1 -- 172.21.15.19:0/1867625962 shutdown_connections 2024-09-10T22:37:04.586 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:04.584+0000 7f4966b40740 1 -- 172.21.15.19:0/1867625962 wait complete. 2024-09-10T22:37:04.587 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:04.584+0000 7f4966b40740 20 client.17448 trim_cache size 0 max 16384 2024-09-10T22:37:04.606 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:04.604+0000 7f4966b40740 1 Processor -- start 2024-09-10T22:37:04.606 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:04.604+0000 7f4966b40740 1 -- start start 2024-09-10T22:37:04.606 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:04.604+0000 7f4966b40740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ece36490f0 0x55ece3641f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:37:04.606 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:04.604+0000 7f4966b40740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ece3649a10 0x55ece3650ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:37:04.606 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:04.604+0000 7f4966b40740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55ece36559a0 0x55ece36513e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:37:04.606 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:04.604+0000 7f4966b40740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f4940011030 con 0x55ece3649a10 2024-09-10T22:37:04.606 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:04.604+0000 7f4966b40740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f494000e900 con 0x55ece36490f0 2024-09-10T22:37:04.606 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:04.604+0000 7f4966b40740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f494000c750 con 0x55ece36559a0 2024-09-10T22:37:04.607 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:04.604+0000 7f4961d06640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ece3649a10 0x55ece3650ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:37:04.607 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:04.604+0000 7f4961d06640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ece3649a10 0x55ece3650ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:46162/0 (socket says 172.21.15.19:46162) 2024-09-10T22:37:04.607 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:04.604+0000 7f4961d06640 1 -- 172.21.15.19:0/2578624634 learned_addr learned my addr 172.21.15.19:0/2578624634 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:37:04.607 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:04.604+0000 7f4962507640 1 --2- 172.21.15.19:0/2578624634 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ece36490f0 0x55ece3641f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:37:04.607 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:04.605+0000 7f4962d08640 1 --2- 172.21.15.19:0/2578624634 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55ece36559a0 0x55ece36513e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:37:04.607 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:04.605+0000 7f4961d06640 1 -- 172.21.15.19:0/2578624634 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55ece36559a0 msgr2=0x55ece36513e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:37:04.607 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:04.605+0000 7f4961d06640 1 --2- 172.21.15.19:0/2578624634 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55ece36559a0 0x55ece36513e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:37:04.608 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:04.605+0000 7f4961d06640 1 -- 172.21.15.19:0/2578624634 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ece36490f0 msgr2=0x55ece3641f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:37:04.608 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:04.605+0000 7f4961d06640 1 --2- 172.21.15.19:0/2578624634 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ece36490f0 0x55ece3641f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:37:04.608 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:04.605+0000 7f4961d06640 1 -- 172.21.15.19:0/2578624634 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ece3647c00 con 0x55ece3649a10 2024-09-10T22:37:04.608 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:04.605+0000 7f4961d06640 1 --2- 172.21.15.19:0/2578624634 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ece3649a10 0x55ece3650ea0 secure :-1 s=READY pgs=831 cs=0 l=1 rev1=1 crypto rx=0x7f494c0ce790 tx=0x7f494c0d3440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b7393fe24240281b server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:37:04.608 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:04.605+0000 7f4947fff640 1 -- 172.21.15.19:0/2578624634 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f494c0ce200 con 0x55ece3649a10 2024-09-10T22:37:04.608 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:04.605+0000 7f4947fff640 1 -- 172.21.15.19:0/2578624634 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f494c0cf190 con 0x55ece3649a10 2024-09-10T22:37:04.608 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:04.605+0000 7f4947fff640 1 -- 172.21.15.19:0/2578624634 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f494c0cb0e0 con 0x55ece3649a10 2024-09-10T22:37:04.609 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:04.606+0000 7f4966b40740 1 -- 172.21.15.19:0/2578624634 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ece3649a10 msgr2=0x55ece3650ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:37:04.609 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:04.607+0000 7f4966b40740 1 --2- 172.21.15.19:0/2578624634 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ece3649a10 0x55ece3650ea0 secure :-1 s=READY pgs=831 cs=0 l=1 rev1=1 crypto rx=0x7f494c0ce790 tx=0x7f494c0d3440 comp rx=0 tx=0).stop 2024-09-10T22:37:04.609 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:04.607+0000 7f4966b40740 1 -- 172.21.15.19:0/2578624634 shutdown_connections 2024-09-10T22:37:04.609 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:04.607+0000 7f4966b40740 1 --2- 172.21.15.19:0/2578624634 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55ece36559a0 0x55ece36513e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:37:04.609 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:04.607+0000 7f4966b40740 1 --2- 172.21.15.19:0/2578624634 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ece3649a10 0x55ece3650ea0 unknown :-1 s=CLOSED pgs=831 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:37:04.609 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:04.607+0000 7f4966b40740 1 --2- 172.21.15.19:0/2578624634 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ece36490f0 0x55ece3641f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:37:04.609 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:04.607+0000 7f4966b40740 1 -- 172.21.15.19:0/2578624634 >> 172.21.15.19:0/2578624634 conn(0x55ece3646f20 msgr2=0x55ece364d8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:37:04.610 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:37:04 smithi135 ceph-mon[34789]: pgmap v666: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 134 KiB/s rd, 172 MiB/s wr, 1.08k op/s 2024-09-10T22:37:04.610 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:04.608+0000 7f4966b40740 1 -- 172.21.15.19:0/2578624634 shutdown_connections 2024-09-10T22:37:04.610 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:04.608+0000 7f4966b40740 1 -- 172.21.15.19:0/2578624634 wait complete. 2024-09-10T22:37:04.610 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:04.609+0000 7f4966b40740 1 -- start start 2024-09-10T22:37:04.611 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:04.609+0000 7f4966b40740 1 Processor -- start 2024-09-10T22:37:04.612 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:04.610+0000 7f4966b40740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55ece36490f0 0x55ece365db80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:37:04.612 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:04.610+0000 7f4966b40740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ece3649a10 0x55ece365e0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:37:04.613 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:04.610+0000 7f4966b40740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ece36559a0 0x55ece3658950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:37:04.613 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:04.610+0000 7f4966b40740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f494000cdc0 con 0x55ece36559a0 2024-09-10T22:37:04.613 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:04.610+0000 7f4966b40740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f494000e230 con 0x55ece3649a10 2024-09-10T22:37:04.613 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:04.610+0000 7f4966b40740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f494000d490 con 0x55ece36490f0 2024-09-10T22:37:04.613 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:04.610+0000 7f4966b40740 10 client.0 _ll_register_callbacks cb 0x7f494c009880 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T22:37:04.613 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:04.610+0000 7f4961d06640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ece3649a10 0x55ece365e0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:37:04.613 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:04.610+0000 7f4961d06640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ece3649a10 0x55ece365e0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.19:40392/0 (socket says 172.21.15.19:40392) 2024-09-10T22:37:04.613 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:04.610+0000 7f4961d06640 1 -- 172.21.15.19:0/1750510832 learned_addr learned my addr 172.21.15.19:0/1750510832 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:37:04.613 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:04.610+0000 7f4962d08640 1 --2- 172.21.15.19:0/1750510832 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ece36559a0 0x55ece3658950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:37:04.613 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:04.610+0000 7f4961d06640 1 -- 172.21.15.19:0/1750510832 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55ece36490f0 msgr2=0x55ece365db80 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-10T22:37:04.613 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:04.610+0000 7f4961d06640 1 --2- 172.21.15.19:0/1750510832 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55ece36490f0 0x55ece365db80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:37:04.613 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:04.610+0000 7f4961d06640 1 -- 172.21.15.19:0/1750510832 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ece36559a0 msgr2=0x55ece3658950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:37:04.613 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:04.610+0000 7f4961d06640 1 --2- 172.21.15.19:0/1750510832 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ece36559a0 0x55ece3658950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:37:04.614 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:04.611+0000 7f4961d06640 1 -- 172.21.15.19:0/1750510832 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ece3658f60 con 0x55ece3649a10 2024-09-10T22:37:04.615 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:04.611+0000 7f4961d06640 1 --2- 172.21.15.19:0/1750510832 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ece3649a10 0x55ece365e0c0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f494c0ce740 tx=0x7f494c0ca930 comp rx=0 tx=0).ready entity=mon.2 client_cookie=42a98ae70717a6c0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:37:04.615 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:04.611+0000 7f4945ffb640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-09-10T22:37:04.615 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:04.611+0000 7f4945ffb640 1 -- 172.21.15.19:0/1750510832 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f494c0ce200 con 0x55ece3649a10 2024-09-10T22:37:04.615 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:04.611+0000 7f4945ffb640 1 -- 172.21.15.19:0/1750510832 <== mon.2 v2:172.21.15.135:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8327+0+0 (secure 0 0 0) 0x7f494c0cdcf0 con 0x55ece3649a10 2024-09-10T22:37:04.615 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:04.611+0000 7f4966b40740 1 -- 172.21.15.19:0/1750510832 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f494c0cf190 con 0x55ece3649a10 2024-09-10T22:37:04.615 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:04.611+0000 7f4945ffb640 1 -- 172.21.15.19:0/1750510832 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f494c0d7da0 con 0x55ece3649a10 2024-09-10T22:37:04.615 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:04.611+0000 7f4966b40740 10 client.26753 fetch_fsmap learned FSMap version 27 2024-09-10T22:37:04.615 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:04.611+0000 7f4966b40740 1 -- 172.21.15.19:0/1750510832 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55ece3658f60 con 0x55ece3649a10 2024-09-10T22:37:04.615 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:04.612+0000 7f4945ffb640 1 -- 172.21.15.19:0/1750510832 <== mon.2 v2:172.21.15.135:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f494c0cf190 con 0x55ece3649a10 2024-09-10T22:37:04.615 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:04.612+0000 7f4945ffb640 1 -- 172.21.15.19:0/1750510832 <== mon.2 v2:172.21.15.135:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7f494c0ca3e0 con 0x55ece3649a10 2024-09-10T22:37:04.615 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:04.612+0000 7f4966b40740 10 client.26753 fetch_fsmap finished waiting for FSMap version 27 2024-09-10T22:37:04.615 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:04.612+0000 7f4966b40740 10 client.26753 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-10T22:37:04.615 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:04.612+0000 7f4966b40740 20 client.26753 populate_metadata read hostname 'smithi019' 2024-09-10T22:37:04.616 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:04.612+0000 7f4966b40740 1 --2- 172.21.15.19:0/1750510832 >> [v2:172.21.15.138:6836/3353290042,v1:172.21.15.138:6837/3353290042] conn(0x55ece36e3ef0 0x55ece36e62e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:37:04.616 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:04.612+0000 7f4966b40740 4 client.26753 mds_command: new command op to 24553 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-10T22:37:04.616 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:04.612+0000 7f4966b40740 1 -- 172.21.15.19:0/1750510832 --> [v2:172.21.15.138:6836/3353290042,v1:172.21.15.138:6837/3353290042] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55ece35bd8a0 con 0x55ece36e3ef0 2024-09-10T22:37:04.616 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:04.612+0000 7f4962507640 1 --2- 172.21.15.19:0/1750510832 >> [v2:172.21.15.138:6836/3353290042,v1:172.21.15.138:6837/3353290042] conn(0x55ece36e3ef0 0x55ece36e62e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:37:04.616 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:04.613+0000 7f4962507640 1 --2- 172.21.15.19:0/1750510832 >> [v2:172.21.15.138:6836/3353290042,v1:172.21.15.138:6837/3353290042] conn(0x55ece36e3ef0 0x55ece36e62e0 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=e7b7bf9e822f3f23 server_cookie=b86f5987cb0343b0 in_seq=0 out_seq=0 2024-09-10T22:37:04.616 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:04.613+0000 7f4945ffb640 10 client.26753 ms_handle_connect on v2:172.21.15.138:6836/3353290042 2024-09-10T22:37:04.617 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:04.613+0000 7f4945ffb640 1 -- 172.21.15.19:0/1750510832 <== mds.2 v2:172.21.15.138:6836/3353290042 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55ece35bd8a0 con 0x55ece36e3ef0 2024-09-10T22:37:04.617 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:04.613+0000 7f4945ffb640 10 client.26753 handle_command_reply: tid=0 2024-09-10T22:37:04.617 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:04.613+0000 7f4966b40740 1 client.26753 shutdown 2024-09-10T22:37:04.617 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:04.614+0000 7f4966b40740 1 -- 172.21.15.19:0/1750510832 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ece3649a10 msgr2=0x55ece365e0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:37:04.617 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:04.614+0000 7f4966b40740 1 --2- 172.21.15.19:0/1750510832 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ece3649a10 0x55ece365e0c0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f494c0ce740 tx=0x7f494c0ca930 comp rx=0 tx=0).stop 2024-09-10T22:37:04.617 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:04.614+0000 7f4966b40740 1 -- 172.21.15.19:0/1750510832 shutdown_connections 2024-09-10T22:37:04.617 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:04.614+0000 7f4966b40740 1 --2- 172.21.15.19:0/1750510832 >> [v2:172.21.15.138:6836/3353290042,v1:172.21.15.138:6837/3353290042] conn(0x55ece36e3ef0 0x55ece36e62e0 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:37:04.618 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:04.614+0000 7f4966b40740 1 --2- 172.21.15.19:0/1750510832 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ece36559a0 0x55ece3658950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:37:04.618 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:04.614+0000 7f4966b40740 1 --2- 172.21.15.19:0/1750510832 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ece3649a10 0x55ece365e0c0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:37:04.618 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:04.614+0000 7f4966b40740 1 --2- 172.21.15.19:0/1750510832 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55ece36490f0 0x55ece365db80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:37:04.618 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:04.614+0000 7f4966b40740 1 -- 172.21.15.19:0/1750510832 >> 172.21.15.19:0/1750510832 conn(0x55ece3646f20 msgr2=0x55ece3660920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:37:04.618 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:04.615+0000 7f4945ffb640 0 client.26753 ms_handle_reset on v2:172.21.15.138:6836/3353290042 2024-09-10T22:37:04.618 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:04.615+0000 7f4966b40740 1 -- 172.21.15.19:0/1750510832 shutdown_connections 2024-09-10T22:37:04.618 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:04.615+0000 7f4966b40740 1 -- 172.21.15.19:0/1750510832 wait complete. 2024-09-10T22:37:04.618 INFO:teuthology.orchestra.run.smithi019.stdout:[] 2024-09-10T22:37:04.618 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:04.615+0000 7f4966b40740 20 client.26753 trim_cache size 0 max 16384 2024-09-10T22:37:04.621 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:04.619+0000 7f496476b640 1 -- 172.21.15.19:0/4179638818 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f49480b5430 msgr2=0x7f49480b78f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:37:04.621 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:04.619+0000 7f496476b640 1 --2- 172.21.15.19:0/4179638818 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f49480b5430 0x7f49480b78f0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x55ece3647e00 tx=0x7f4958005f90 comp rx=0 tx=0).stop 2024-09-10T22:37:04.621 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:04.619+0000 7f496476b640 1 -- 172.21.15.19:0/4179638818 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f495c1023b0 msgr2=0x7f495c19fe00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:37:04.621 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:04.619+0000 7f496476b640 1 --2- 172.21.15.19:0/4179638818 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f495c1023b0 0x7f495c19fe00 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 crypto rx=0x7f494c02a920 tx=0x7f494c003b60 comp rx=0 tx=0).stop 2024-09-10T22:37:04.622 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:04.621+0000 7f496476b640 1 -- 172.21.15.19:0/4179638818 shutdown_connections 2024-09-10T22:37:04.623 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:04.621+0000 7f496476b640 1 --2- 172.21.15.19:0/4179638818 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f49480b5430 0x7f49480b78f0 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:37:04.623 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:04.621+0000 7f496476b640 1 --2- 172.21.15.19:0/4179638818 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f495c106ed0 0x7f495c1a51a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:37:04.623 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:04.621+0000 7f496476b640 1 --2- 172.21.15.19:0/4179638818 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f495c1023b0 0x7f495c19fe00 unknown :-1 s=CLOSED pgs=829 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:37:04.623 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:04.621+0000 7f496476b640 1 --2- 172.21.15.19:0/4179638818 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f495c101a90 0x7f495c19f8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:37:04.623 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:04.621+0000 7f496476b640 1 -- 172.21.15.19:0/4179638818 >> 172.21.15.19:0/4179638818 conn(0x7f495c0fd700 msgr2=0x7f495c1047c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:37:04.624 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:04.622+0000 7f496476b640 1 -- 172.21.15.19:0/4179638818 shutdown_connections 2024-09-10T22:37:04.624 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:04.622+0000 7f496476b640 1 -- 172.21.15.19:0/4179638818 wait complete. 2024-09-10T22:37:04.625 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:37:04 smithi138 ceph-mon[35236]: pgmap v666: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 134 KiB/s rd, 172 MiB/s wr, 1.08k op/s 2024-09-10T22:37:04.779 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:37:04.777+0000 7f06d04e6640 1 -- 172.21.15.19:0/1340845169 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f06c8101860 msgr2=0x7f06c8101c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:37:04.779 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:37:04.777+0000 7f06d04e6640 1 --2- 172.21.15.19:0/1340845169 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f06c8101860 0x7f06c8101c60 secure :-1 s=READY pgs=832 cs=0 l=1 rev1=1 crypto rx=0x7f06c4009930 tx=0x7f06c402a420 comp rx=0 tx=0).stop 2024-09-10T22:37:04.780 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:37:04.778+0000 7f06d04e6640 1 -- 172.21.15.19:0/1340845169 shutdown_connections 2024-09-10T22:37:04.780 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:37:04.778+0000 7f06d04e6640 1 --2- 172.21.15.19:0/1340845169 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f06c8103370 0x7f06c8109cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:37:04.780 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:37:04.778+0000 7f06d04e6640 1 --2- 172.21.15.19:0/1340845169 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f06c81029b0 0x7f06c8102e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:37:04.780 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:37:04.778+0000 7f06d04e6640 1 --2- 172.21.15.19:0/1340845169 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f06c8101860 0x7f06c8101c60 unknown :-1 s=CLOSED pgs=832 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:37:04.780 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:37:04.778+0000 7f06d04e6640 1 -- 172.21.15.19:0/1340845169 >> 172.21.15.19:0/1340845169 conn(0x7f06c80fd140 msgr2=0x7f06c80ff560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:37:04.780 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:37:04.778+0000 7f06d04e6640 1 -- 172.21.15.19:0/1340845169 shutdown_connections 2024-09-10T22:37:04.780 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:37:04.778+0000 7f06d04e6640 1 -- 172.21.15.19:0/1340845169 wait complete. 2024-09-10T22:37:04.782 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:37:04.778+0000 7f06d04e6640 1 Processor -- start 2024-09-10T22:37:04.783 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:37:04.779+0000 7f06d04e6640 1 -- start start 2024-09-10T22:37:04.783 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:37:04.779+0000 7f06d04e6640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f06c8101860 0x7f06c8197cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:37:04.783 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:37:04.779+0000 7f06d04e6640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f06c81029b0 0x7f06c8198320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:37:04.783 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:37:04.779+0000 7f06d04e6640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f06c8103370 0x7f06c8198f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:37:04.783 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:37:04.779+0000 7f06d04e6640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f06c810d4d0 con 0x7f06c8103370 2024-09-10T22:37:04.783 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:37:04.779+0000 7f06d04e6640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f06c810d350 con 0x7f06c8101860 2024-09-10T22:37:04.783 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:37:04.779+0000 7f06d04e6640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f06c810d650 con 0x7f06c81029b0 2024-09-10T22:37:04.783 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:37:04.779+0000 7f06cea83640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f06c8103370 0x7f06c8198f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:37:04.783 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:37:04.779+0000 7f06ce282640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f06c8101860 0x7f06c8197cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:37:04.783 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:37:04.779+0000 7f06cea83640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f06c8103370 0x7f06c8198f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:46196/0 (socket says 172.21.15.19:46196) 2024-09-10T22:37:04.783 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:37:04.779+0000 7f06cea83640 1 -- 172.21.15.19:0/2758579244 learned_addr learned my addr 172.21.15.19:0/2758579244 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:37:04.783 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:37:04.779+0000 7f06cda81640 1 --2- 172.21.15.19:0/2758579244 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f06c81029b0 0x7f06c8198320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:37:04.783 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:37:04.779+0000 7f06ce282640 1 -- 172.21.15.19:0/2758579244 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f06c81029b0 msgr2=0x7f06c8198320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:37:04.784 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:37:04.779+0000 7f06ce282640 1 --2- 172.21.15.19:0/2758579244 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f06c81029b0 0x7f06c8198320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:37:04.784 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:37:04.779+0000 7f06ce282640 1 -- 172.21.15.19:0/2758579244 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f06c8103370 msgr2=0x7f06c8198f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:37:04.784 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:37:04.779+0000 7f06ce282640 1 --2- 172.21.15.19:0/2758579244 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f06c8103370 0x7f06c8198f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:37:04.784 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:37:04.779+0000 7f06ce282640 1 -- 172.21.15.19:0/2758579244 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f06c8199810 con 0x7f06c8101860 2024-09-10T22:37:04.785 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:37:04.779+0000 7f06cea83640 1 --2- 172.21.15.19:0/2758579244 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f06c8103370 0x7f06c8198f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T22:37:04.785 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:37:04.780+0000 7f06ce282640 1 --2- 172.21.15.19:0/2758579244 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f06c8101860 0x7f06c8197cd0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f06c4009230 tx=0x7f06c40042f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:37:04.785 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:37:04.780+0000 7f06bf7fe640 1 -- 172.21.15.19:0/2758579244 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06c403f030 con 0x7f06c8101860 2024-09-10T22:37:04.785 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:37:04.780+0000 7f06bf7fe640 1 -- 172.21.15.19:0/2758579244 <== mon.2 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f06c4031910 con 0x7f06c8101860 2024-09-10T22:37:04.785 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:37:04.780+0000 7f06d04e6640 1 -- 172.21.15.19:0/2758579244 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f06c8199aa0 con 0x7f06c8101860 2024-09-10T22:37:04.785 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:37:04.780+0000 7f06bf7fe640 1 -- 172.21.15.19:0/2758579244 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06c4035070 con 0x7f06c8101860 2024-09-10T22:37:04.785 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:37:04.780+0000 7f06d04e6640 1 -- 172.21.15.19:0/2758579244 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f06c81a01d0 con 0x7f06c8101860 2024-09-10T22:37:04.790 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:37:04.783+0000 7f06bf7fe640 1 -- 172.21.15.19:0/2758579244 <== mon.2 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 18) ==== 153250+0+0 (secure 0 0 0) 0x7f06c403b9c0 con 0x7f06c8101860 2024-09-10T22:37:04.790 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:37:04.783+0000 7f06d32bb740 1 Processor -- start 2024-09-10T22:37:04.790 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:37:04.783+0000 7f06d32bb740 1 -- start start 2024-09-10T22:37:04.790 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:37:04.784+0000 7f06d32bb740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5574e9c55300 0x5574e9c55700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:37:04.790 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:37:04.784+0000 7f06d32bb740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5574e9c55c40 0x5574e9c560c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:37:04.790 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:37:04.784+0000 7f06d32bb740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5574e9c56600 0x5574e9c56ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:37:04.790 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:37:04.784+0000 7f06d32bb740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x5574e9bcc6f0 con 0x5574e9c56600 2024-09-10T22:37:04.790 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:37:04.784+0000 7f06d32bb740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x5574e9bbbb20 con 0x5574e9c55300 2024-09-10T22:37:04.791 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:37:04.784+0000 7f06d32bb740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x5574e9bbf930 con 0x5574e9c55c40 2024-09-10T22:37:04.791 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:37:04.784+0000 7f06ce282640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5574e9c55c40 0x5574e9c560c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:37:04.791 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:37:04.784+0000 7f06cea83640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5574e9c55300 0x5574e9c55700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:37:04.791 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:37:04.784+0000 7f06cda81640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5574e9c56600 0x5574e9c56ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:37:04.791 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:37:04.784+0000 7f06cea83640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5574e9c55300 0x5574e9c55700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.19:40418/0 (socket says 172.21.15.19:40418) 2024-09-10T22:37:04.791 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:37:04.784+0000 7f06cea83640 1 -- 172.21.15.19:0/503193162 learned_addr learned my addr 172.21.15.19:0/503193162 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:37:04.791 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:37:04.784+0000 7f06ce282640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5574e9c55c40 0x5574e9c560c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.19:51814/0 (socket says 172.21.15.19:51814) 2024-09-10T22:37:04.791 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:37:04.784+0000 7f06cea83640 1 -- 172.21.15.19:0/503193162 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5574e9c55c40 msgr2=0x5574e9c560c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:37:04.791 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:37:04.784+0000 7f06cea83640 1 --2- 172.21.15.19:0/503193162 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5574e9c55c40 0x5574e9c560c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:37:04.791 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:37:04.784+0000 7f06cea83640 1 -- 172.21.15.19:0/503193162 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5574e9c56600 msgr2=0x5574e9c56ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:37:04.791 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:37:04.784+0000 7f06cea83640 1 --2- 172.21.15.19:0/503193162 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5574e9c56600 0x5574e9c56ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:37:04.791 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:37:04.784+0000 7f06bf7fe640 1 --2- 172.21.15.19:0/2758579244 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f06b40b52e0 0x7f06b40b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:37:04.791 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:37:04.784+0000 7f06cea83640 1 -- 172.21.15.19:0/503193162 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5574e9b81530 con 0x5574e9c55300 2024-09-10T22:37:04.792 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:37:04.784+0000 7f06ce282640 1 --2- 172.21.15.19:0/2758579244 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f06b40b52e0 0x7f06b40b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:37:04.792 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:37:04.785+0000 7f06cea83640 1 --2- 172.21.15.19:0/503193162 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5574e9c55300 0x5574e9c55700 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f06c000e800 tx=0x7f06c000ecc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ae2ffe13e8e66da5 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:37:04.792 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:37:04.785+0000 7f06bf7fe640 1 -- 172.21.15.19:0/2758579244 <== mon.2 v2:172.21.15.135:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8327+0+0 (secure 0 0 0) 0x7f06c4106380 con 0x7f06c8101860 2024-09-10T22:37:04.792 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:37:04.785+0000 7f06bcbfe640 1 -- 172.21.15.19:0/503193162 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06c0004d20 con 0x5574e9c55300 2024-09-10T22:37:04.792 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:37:04.785+0000 7f06bcbfe640 1 -- 172.21.15.19:0/503193162 <== mon.2 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f06c0005020 con 0x5574e9c55300 2024-09-10T22:37:04.792 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:37:04.785+0000 7f06bcbfe640 1 -- 172.21.15.19:0/503193162 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06c001a5c0 con 0x5574e9c55300 2024-09-10T22:37:04.792 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:37:04.786+0000 7f06ce282640 1 --2- 172.21.15.19:0/2758579244 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f06b40b52e0 0x7f06b40b77a0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f06c4109fd0 tx=0x7f06c4109e60 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:37:04.792 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:37:04.786+0000 7f06d32bb740 1 -- 172.21.15.19:0/503193162 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5574e9c55300 msgr2=0x5574e9c55700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:37:04.792 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:37:04.786+0000 7f06d32bb740 1 --2- 172.21.15.19:0/503193162 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5574e9c55300 0x5574e9c55700 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f06c000e800 tx=0x7f06c000ecc0 comp rx=0 tx=0).stop 2024-09-10T22:37:04.792 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:37:04.786+0000 7f06d32bb740 1 -- 172.21.15.19:0/503193162 shutdown_connections 2024-09-10T22:37:04.792 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:37:04.786+0000 7f06d32bb740 1 --2- 172.21.15.19:0/503193162 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5574e9c56600 0x5574e9c56ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:37:04.792 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:37:04.786+0000 7f06d32bb740 1 --2- 172.21.15.19:0/503193162 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5574e9c55c40 0x5574e9c560c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:37:04.792 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:37:04.786+0000 7f06d32bb740 1 --2- 172.21.15.19:0/503193162 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5574e9c55300 0x5574e9c55700 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:37:04.792 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:37:04.786+0000 7f06d32bb740 1 -- 172.21.15.19:0/503193162 >> 172.21.15.19:0/503193162 conn(0x5574e9c57bc0 msgr2=0x5574e9c58950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:37:04.793 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:37:04.786+0000 7f06d32bb740 1 -- 172.21.15.19:0/503193162 shutdown_connections 2024-09-10T22:37:04.793 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:37:04.786+0000 7f06d32bb740 1 -- 172.21.15.19:0/503193162 wait complete. 2024-09-10T22:37:04.793 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:37:04.786+0000 7f06d32bb740 1 -- start start 2024-09-10T22:37:04.793 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:37:04.786+0000 7f06d32bb740 1 Processor -- start 2024-09-10T22:37:04.793 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:37:04.786+0000 7f06d32bb740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5574e9c55300 0x5574e9c68370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:37:04.793 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:37:04.786+0000 7f06d32bb740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5574e9c55c40 0x5574e9c68a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:37:04.793 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:37:04.786+0000 7f06d32bb740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5574e9c56600 0x5574e9c69570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:37:04.793 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:37:04.786+0000 7f06d32bb740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x5574e9af3ab0 con 0x5574e9c55300 2024-09-10T22:37:04.793 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:37:04.786+0000 7f06d32bb740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x5574e9b61730 con 0x5574e9c56600 2024-09-10T22:37:04.793 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:37:04.786+0000 7f06d32bb740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x5574e9c67000 con 0x5574e9c55c40 2024-09-10T22:37:04.793 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:37:04.787+0000 7f06d32bb740 10 client.0 _ll_register_callbacks cb 0x5574e9bb56b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T22:37:04.793 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:37:04.787+0000 7f06cea83640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5574e9c55300 0x5574e9c68370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:37:04.794 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:37:04.787+0000 7f06cda81640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5574e9c55c40 0x5574e9c68a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:37:04.794 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:37:04.787+0000 7f06cea83640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5574e9c55300 0x5574e9c68370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:46216/0 (socket says 172.21.15.19:46216) 2024-09-10T22:37:04.794 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:37:04.787+0000 7f06cea83640 1 -- 172.21.15.19:0/3218862504 learned_addr learned my addr 172.21.15.19:0/3218862504 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:37:04.794 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:37:04.787+0000 7f06cda81640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5574e9c55c40 0x5574e9c68a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.19:51820/0 (socket says 172.21.15.19:51820) 2024-09-10T22:37:04.794 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:37:04.787+0000 7f06cea83640 1 --2- 172.21.15.19:0/3218862504 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5574e9c56600 0x5574e9c69570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:37:04.794 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:37:04.787+0000 7f06cea83640 1 -- 172.21.15.19:0/3218862504 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5574e9c55c40 msgr2=0x5574e9c68a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:37:04.794 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:37:04.787+0000 7f06cea83640 1 --2- 172.21.15.19:0/3218862504 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5574e9c55c40 0x5574e9c68a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:37:04.794 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:37:04.787+0000 7f06cea83640 1 -- 172.21.15.19:0/3218862504 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5574e9c56600 msgr2=0x5574e9c69570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:37:04.794 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:37:04.787+0000 7f06cea83640 1 --2- 172.21.15.19:0/3218862504 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5574e9c56600 0x5574e9c69570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:37:04.794 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:37:04.787+0000 7f06cea83640 1 -- 172.21.15.19:0/3218862504 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5574e991d790 con 0x5574e9c55300 2024-09-10T22:37:04.794 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:37:04.787+0000 7f06cda81640 1 --2- 172.21.15.19:0/3218862504 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5574e9c55c40 0x5574e9c68a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T22:37:04.794 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:37:04.787+0000 7f06cea83640 1 --2- 172.21.15.19:0/3218862504 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5574e9c55300 0x5574e9c68370 secure :-1 s=READY pgs=833 cs=0 l=1 rev1=1 crypto rx=0x7f06c0004e40 tx=0x7f06c00056e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5d51166b77eae3e4 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:37:04.795 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:37:04.787+0000 7f06b1ffb640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-10T22:37:04.795 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:37:04.787+0000 7f06b1ffb640 1 -- 172.21.15.19:0/3218862504 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06c002d020 con 0x5574e9c55300 2024-09-10T22:37:04.795 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:37:04.787+0000 7f06d32bb740 1 -- 172.21.15.19:0/3218862504 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f06c0005020 con 0x5574e9c55300 2024-09-10T22:37:04.795 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:37:04.787+0000 7f06b1ffb640 1 -- 172.21.15.19:0/3218862504 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8327+0+0 (secure 0 0 0) 0x7f06c0011c20 con 0x5574e9c55300 2024-09-10T22:37:04.795 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:37:04.788+0000 7f06b1ffb640 1 -- 172.21.15.19:0/3218862504 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f06c0020040 con 0x5574e9c55300 2024-09-10T22:37:04.795 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:37:04.788+0000 7f06d32bb740 10 client.17466 fetch_fsmap learned FSMap version 27 2024-09-10T22:37:04.795 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:37:04.788+0000 7f06d32bb740 1 -- 172.21.15.19:0/3218862504 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x5574e9996620 con 0x5574e9c55300 2024-09-10T22:37:04.795 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:37:04.788+0000 7f06b1ffb640 1 -- 172.21.15.19:0/3218862504 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f06c0005020 con 0x5574e9c55300 2024-09-10T22:37:04.795 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:37:04.788+0000 7f06b1ffb640 1 -- 172.21.15.19:0/3218862504 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7f06c0031030 con 0x5574e9c55300 2024-09-10T22:37:04.795 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:37:04.788+0000 7f06d32bb740 10 client.17466 fetch_fsmap finished waiting for FSMap version 27 2024-09-10T22:37:04.795 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:37:04.788+0000 7f06d32bb740 10 client.17466 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-10T22:37:04.795 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:37:04.788+0000 7f06d32bb740 20 client.17466 populate_metadata read hostname 'smithi019' 2024-09-10T22:37:04.795 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:37:04.788+0000 7f06d32bb740 1 --2- 172.21.15.19:0/3218862504 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x5574e9c73980 0x5574e9c75d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:37:04.795 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:37:04.788+0000 7f06d32bb740 4 client.17466 mds_command: new command op to 24581 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T22:37:04.796 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:37:04.788+0000 7f06d32bb740 1 -- 172.21.15.19:0/3218862504 --> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5574e9bce640 con 0x5574e9c73980 2024-09-10T22:37:04.796 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:37:04.788+0000 7f06cda81640 1 --2- 172.21.15.19:0/3218862504 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x5574e9c73980 0x5574e9c75d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:37:04.796 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:37:04.789+0000 7f06cda81640 1 --2- 172.21.15.19:0/3218862504 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x5574e9c73980 0x5574e9c75d70 crc :-1 s=READY pgs=208 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=65247b3e679e09e9 server_cookie=7cae74dc503c6560 in_seq=0 out_seq=0 2024-09-10T22:37:04.796 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:37:04.789+0000 7f06b1ffb640 10 client.17466 ms_handle_connect on v2:172.21.15.135:6838/1254769802 2024-09-10T22:37:04.797 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:37:04.789+0000 7f06b1ffb640 1 -- 172.21.15.19:0/3218862504 <== mds.0 v2:172.21.15.135:6838/1254769802 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5574e9bce640 con 0x5574e9c73980 2024-09-10T22:37:04.797 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:37:04.789+0000 7f06b1ffb640 10 client.17466 handle_command_reply: tid=0 2024-09-10T22:37:04.797 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:37:04.789+0000 7f06d32bb740 1 client.17466 shutdown 2024-09-10T22:37:04.797 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:37:04.790+0000 7f06d32bb740 1 -- 172.21.15.19:0/3218862504 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5574e9c55300 msgr2=0x5574e9c68370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:37:04.797 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:37:04.790+0000 7f06d32bb740 1 --2- 172.21.15.19:0/3218862504 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5574e9c55300 0x5574e9c68370 secure :-1 s=READY pgs=833 cs=0 l=1 rev1=1 crypto rx=0x7f06c0004e40 tx=0x7f06c00056e0 comp rx=0 tx=0).stop 2024-09-10T22:37:04.797 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:37:04.790+0000 7f06d32bb740 1 -- 172.21.15.19:0/3218862504 shutdown_connections 2024-09-10T22:37:04.797 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:37:04.790+0000 7f06d32bb740 1 --2- 172.21.15.19:0/3218862504 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5574e9c56600 0x5574e9c69570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:37:04.798 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:37:04.790+0000 7f06d32bb740 1 --2- 172.21.15.19:0/3218862504 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x5574e9c73980 0x5574e9c75d70 crc :-1 s=READY pgs=208 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:37:04.798 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:37:04.790+0000 7f06b1ffb640 0 client.17466 ms_handle_reset on v2:172.21.15.135:6838/1254769802 2024-09-10T22:37:04.798 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:37:04.790+0000 7f06d32bb740 1 --2- 172.21.15.19:0/3218862504 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5574e9c55c40 0x5574e9c68a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:37:04.798 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:37:04.790+0000 7f06d32bb740 1 --2- 172.21.15.19:0/3218862504 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5574e9c55300 0x5574e9c68370 unknown :-1 s=CLOSED pgs=833 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:37:04.798 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:37:04.790+0000 7f06d32bb740 1 -- 172.21.15.19:0/3218862504 >> 172.21.15.19:0/3218862504 conn(0x5574e9c57bc0 msgr2=0x5574e9c54bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:37:04.798 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:37:04.790+0000 7f06d32bb740 1 -- 172.21.15.19:0/3218862504 shutdown_connections 2024-09-10T22:37:04.798 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:37:04.790+0000 7f06d32bb740 1 -- 172.21.15.19:0/3218862504 wait complete. 2024-09-10T22:37:04.798 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:37:04.790+0000 7f06d32bb740 20 client.17466 trim_cache size 0 max 16384 2024-09-10T22:37:04.812 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:37:04.809+0000 7f06d32bb740 1 Processor -- start 2024-09-10T22:37:04.812 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:37:04.809+0000 7f06d32bb740 1 -- start start 2024-09-10T22:37:04.812 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:37:04.809+0000 7f06d32bb740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5574e9c55300 0x5574e9c58b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:37:04.812 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:37:04.809+0000 7f06d32bb740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5574e9c55c40 0x5574e9c543d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:37:04.812 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:37:04.809+0000 7f06d32bb740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5574e9c56600 0x5574e9c54910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:37:04.812 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:37:04.809+0000 7f06d32bb740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f06c81aa770 con 0x5574e9c55300 2024-09-10T22:37:04.812 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:37:04.809+0000 7f06d32bb740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f06c81a8040 con 0x5574e9c55c40 2024-09-10T22:37:04.812 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:37:04.809+0000 7f06d32bb740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f06c81a5e90 con 0x5574e9c56600 2024-09-10T22:37:04.812 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:37:04.809+0000 7f06cea83640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5574e9c55300 0x5574e9c58b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:37:04.812 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:37:04.809+0000 7f06cea83640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5574e9c55300 0x5574e9c58b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:46220/0 (socket says 172.21.15.19:46220) 2024-09-10T22:37:04.813 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:37:04.809+0000 7f06cea83640 1 -- 172.21.15.19:0/744631964 learned_addr learned my addr 172.21.15.19:0/744631964 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:37:04.813 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:37:04.809+0000 7f06cda81640 1 --2- 172.21.15.19:0/744631964 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5574e9c55c40 0x5574e9c543d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:37:04.813 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:37:04.809+0000 7f06cea83640 1 --2- 172.21.15.19:0/744631964 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5574e9c56600 0x5574e9c54910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:37:04.813 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:37:04.810+0000 7f06cea83640 1 -- 172.21.15.19:0/744631964 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5574e9c56600 msgr2=0x5574e9c54910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:37:04.813 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:37:04.810+0000 7f06cea83640 1 --2- 172.21.15.19:0/744631964 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5574e9c56600 0x5574e9c54910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:37:04.813 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:37:04.810+0000 7f06cea83640 1 -- 172.21.15.19:0/744631964 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5574e9c55c40 msgr2=0x5574e9c543d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:37:04.813 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:37:04.810+0000 7f06cea83640 1 --2- 172.21.15.19:0/744631964 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5574e9c55c40 0x5574e9c543d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:37:04.813 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:37:04.810+0000 7f06cea83640 1 -- 172.21.15.19:0/744631964 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5574e9c686e0 con 0x5574e9c55300 2024-09-10T22:37:04.813 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:37:04.810+0000 7f06cda81640 1 --2- 172.21.15.19:0/744631964 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5574e9c55c40 0x5574e9c543d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T22:37:04.813 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:37:04.810+0000 7f06cea83640 1 --2- 172.21.15.19:0/744631964 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5574e9c55300 0x5574e9c58b30 secure :-1 s=READY pgs=834 cs=0 l=1 rev1=1 crypto rx=0x7f06c0009980 tx=0x7f06c000ecc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=21ab3e9edc8bdb26 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:37:04.813 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:37:04.810+0000 7f06b3fff640 1 -- 172.21.15.19:0/744631964 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06c002d070 con 0x5574e9c55300 2024-09-10T22:37:04.813 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:37:04.810+0000 7f06b3fff640 1 -- 172.21.15.19:0/744631964 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f06c0005890 con 0x5574e9c55300 2024-09-10T22:37:04.813 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:37:04.810+0000 7f06b3fff640 1 -- 172.21.15.19:0/744631964 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06c0029b80 con 0x5574e9c55300 2024-09-10T22:37:04.817 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:37:04.811+0000 7f06d32bb740 1 -- 172.21.15.19:0/744631964 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5574e9c55300 msgr2=0x5574e9c58b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:37:04.817 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:37:04.811+0000 7f06d32bb740 1 --2- 172.21.15.19:0/744631964 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5574e9c55300 0x5574e9c58b30 secure :-1 s=READY pgs=834 cs=0 l=1 rev1=1 crypto rx=0x7f06c0009980 tx=0x7f06c000ecc0 comp rx=0 tx=0).stop 2024-09-10T22:37:04.817 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:37:04.811+0000 7f06d32bb740 1 -- 172.21.15.19:0/744631964 shutdown_connections 2024-09-10T22:37:04.817 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:37:04.811+0000 7f06d32bb740 1 --2- 172.21.15.19:0/744631964 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5574e9c56600 0x5574e9c54910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:37:04.817 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:37:04.811+0000 7f06d32bb740 1 --2- 172.21.15.19:0/744631964 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5574e9c55c40 0x5574e9c543d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:37:04.817 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:37:04.811+0000 7f06d32bb740 1 --2- 172.21.15.19:0/744631964 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5574e9c55300 0x5574e9c58b30 unknown :-1 s=CLOSED pgs=834 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:37:04.817 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:37:04.811+0000 7f06d32bb740 1 -- 172.21.15.19:0/744631964 >> 172.21.15.19:0/744631964 conn(0x5574e9c57bc0 msgr2=0x5574e9c58420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:37:04.818 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:37:04.811+0000 7f06d32bb740 1 -- 172.21.15.19:0/744631964 shutdown_connections 2024-09-10T22:37:04.818 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:37:04.811+0000 7f06d32bb740 1 -- 172.21.15.19:0/744631964 wait complete. 2024-09-10T22:37:04.818 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:37:04.811+0000 7f06d32bb740 1 -- start start 2024-09-10T22:37:04.818 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:37:04.811+0000 7f06d32bb740 1 Processor -- start 2024-09-10T22:37:04.818 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:37:04.812+0000 7f06d32bb740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5574e9c55300 0x5574e9c6fae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:37:04.818 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:37:04.812+0000 7f06d32bb740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5574e9c55c40 0x5574e9c6b880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:37:04.818 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:37:04.812+0000 7f06d32bb740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5574e9c56600 0x5574e9c6bdc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:37:04.818 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:37:04.812+0000 7f06d32bb740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f06c81a6500 con 0x5574e9c55300 2024-09-10T22:37:04.818 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:37:04.812+0000 7f06d32bb740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f06c81a7970 con 0x5574e9c56600 2024-09-10T22:37:04.818 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:37:04.812+0000 7f06d32bb740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f06c81a6bd0 con 0x5574e9c55c40 2024-09-10T22:37:04.818 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:37:04.812+0000 7f06d32bb740 10 client.0 _ll_register_callbacks cb 0x7f06b8009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T22:37:04.818 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:37:04.812+0000 7f06cea83640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5574e9c55300 0x5574e9c6fae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:37:04.818 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:37:04.812+0000 7f06cea83640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5574e9c55300 0x5574e9c6fae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:46222/0 (socket says 172.21.15.19:46222) 2024-09-10T22:37:04.819 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:37:04.812+0000 7f06cea83640 1 -- 172.21.15.19:0/1190076842 learned_addr learned my addr 172.21.15.19:0/1190076842 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:37:04.819 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:37:04.812+0000 7f06cda81640 1 --2- 172.21.15.19:0/1190076842 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5574e9c55c40 0x5574e9c6b880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:37:04.819 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:37:04.812+0000 7f06cea83640 1 --2- 172.21.15.19:0/1190076842 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5574e9c56600 0x5574e9c6bdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:37:04.819 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:37:04.812+0000 7f06cda81640 1 -- 172.21.15.19:0/1190076842 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5574e9c56600 msgr2=0x5574e9c6bdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:37:04.819 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:37:04.812+0000 7f06cda81640 1 --2- 172.21.15.19:0/1190076842 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5574e9c56600 0x5574e9c6bdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:37:04.819 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:37:04.812+0000 7f06cda81640 1 -- 172.21.15.19:0/1190076842 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5574e9c55300 msgr2=0x5574e9c6fae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:37:04.819 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:37:04.812+0000 7f06cda81640 1 --2- 172.21.15.19:0/1190076842 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5574e9c55300 0x5574e9c6fae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:37:04.819 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:37:04.812+0000 7f06cda81640 1 -- 172.21.15.19:0/1190076842 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5574e9c698e0 con 0x5574e9c55c40 2024-09-10T22:37:04.819 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:37:04.813+0000 7f06cda81640 1 --2- 172.21.15.19:0/1190076842 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5574e9c55c40 0x5574e9c6b880 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x5574e9c765c0 tx=0x7f06b8012e30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=591b44c8b6161f1a server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:37:04.819 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:37:04.813+0000 7f06b1ffb640 10 client.0 ms_handle_connect on v2:172.21.15.138:3300/0 2024-09-10T22:37:04.819 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:37:04.813+0000 7f06b1ffb640 1 -- 172.21.15.19:0/1190076842 <== mon.1 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06b802b060 con 0x5574e9c55c40 2024-09-10T22:37:04.819 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:37:04.813+0000 7f06d32bb740 1 -- 172.21.15.19:0/1190076842 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f06c0005890 con 0x5574e9c55c40 2024-09-10T22:37:04.819 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:37:04.813+0000 7f06b1ffb640 1 -- 172.21.15.19:0/1190076842 <== mon.1 v2:172.21.15.138:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8327+0+0 (secure 0 0 0) 0x7f06b8004230 con 0x5574e9c55c40 2024-09-10T22:37:04.819 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:37:04.813+0000 7f06b1ffb640 1 -- 172.21.15.19:0/1190076842 <== mon.1 v2:172.21.15.138:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f06b8004430 con 0x5574e9c55c40 2024-09-10T22:37:04.819 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:37:04.813+0000 7f06d32bb740 10 client.26803 fetch_fsmap learned FSMap version 27 2024-09-10T22:37:04.820 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:37:04.813+0000 7f06d32bb740 1 -- 172.21.15.19:0/1190076842 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x5574e9ce0880 con 0x5574e9c55c40 2024-09-10T22:37:04.820 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:37:04.813+0000 7f06b1ffb640 1 -- 172.21.15.19:0/1190076842 <== mon.1 v2:172.21.15.138:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f06c0005890 con 0x5574e9c55c40 2024-09-10T22:37:04.820 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:37:04.813+0000 7f06b1ffb640 1 -- 172.21.15.19:0/1190076842 <== mon.1 v2:172.21.15.138:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7f06b802f030 con 0x5574e9c55c40 2024-09-10T22:37:04.820 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:37:04.813+0000 7f06d32bb740 10 client.26803 fetch_fsmap finished waiting for FSMap version 27 2024-09-10T22:37:04.820 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:37:04.813+0000 7f06d32bb740 10 client.26803 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-10T22:37:04.820 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:37:04.813+0000 7f06d32bb740 20 client.26803 populate_metadata read hostname 'smithi019' 2024-09-10T22:37:04.820 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:37:04.813+0000 7f06d32bb740 1 --2- 172.21.15.19:0/1190076842 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x5574e9c73980 0x5574e9ce3160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:37:04.820 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:37:04.813+0000 7f06d32bb740 4 client.26803 mds_command: new command op to 24581 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-10T22:37:04.820 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:37:04.813+0000 7f06d32bb740 1 -- 172.21.15.19:0/1190076842 --> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5574e9bca0f0 con 0x5574e9c73980 2024-09-10T22:37:04.820 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:37:04.814+0000 7f06cea83640 1 --2- 172.21.15.19:0/1190076842 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x5574e9c73980 0x5574e9ce3160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:37:04.820 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:37:04.814+0000 7f06b1ffb640 10 client.26803 ms_handle_connect on v2:172.21.15.135:6838/1254769802 2024-09-10T22:37:04.820 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:37:04.814+0000 7f06cea83640 1 --2- 172.21.15.19:0/1190076842 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x5574e9c73980 0x5574e9ce3160 crc :-1 s=READY pgs=209 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9d9631d468ec921d server_cookie=7005a67445d17654 in_seq=0 out_seq=0 2024-09-10T22:37:05.410 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 22997a4c-6fc2-11ef-bcea-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-09-10T22:37:05.732 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/22997a4c-6fc2-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T22:37:06.342 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:06.321+0000 7f3104976640 1 -- 172.21.15.19:0/1809354023 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f31001076d0 msgr2=0x7f3100107b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:37:06.343 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:06.321+0000 7f3104976640 1 --2- 172.21.15.19:0/1809354023 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f31001076d0 0x7f3100107b10 secure :-1 s=READY pgs=835 cs=0 l=1 rev1=1 crypto rx=0x7f30f4009900 tx=0x7f30f402a410 comp rx=0 tx=0).stop 2024-09-10T22:37:06.343 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:06.321+0000 7f3104976640 1 -- 172.21.15.19:0/1809354023 shutdown_connections 2024-09-10T22:37:06.343 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:06.321+0000 7f3104976640 1 --2- 172.21.15.19:0/1809354023 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3100108050 0x7f310010e850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:37:06.343 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:06.321+0000 7f3104976640 1 --2- 172.21.15.19:0/1809354023 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f31001076d0 0x7f3100107b10 unknown :-1 s=CLOSED pgs=835 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:37:06.343 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:06.321+0000 7f3104976640 1 --2- 172.21.15.19:0/1809354023 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3100101cc0 0x7f31001020a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:37:06.343 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:06.321+0000 7f3104976640 1 -- 172.21.15.19:0/1809354023 >> 172.21.15.19:0/1809354023 conn(0x7f31000fd770 msgr2=0x7f31000ffb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:37:06.343 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:06.321+0000 7f3104976640 1 -- 172.21.15.19:0/1809354023 shutdown_connections 2024-09-10T22:37:06.343 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:06.321+0000 7f3104976640 1 -- 172.21.15.19:0/1809354023 wait complete. 2024-09-10T22:37:06.343 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:06.322+0000 7f3104976640 1 Processor -- start 2024-09-10T22:37:06.343 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:06.322+0000 7f3104976640 1 -- start start 2024-09-10T22:37:06.343 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:06.322+0000 7f3104976640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3100101cc0 0x7f31001992c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:37:06.343 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:06.322+0000 7f3104976640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f31001076d0 0x7f3100199800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:37:06.343 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:06.322+0000 7f3104976640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3100108050 0x7f310019eba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:37:06.344 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:06.322+0000 7f3104976640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f3100111cf0 con 0x7f3100101cc0 2024-09-10T22:37:06.344 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:06.322+0000 7f3104976640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f3100111b70 con 0x7f3100108050 2024-09-10T22:37:06.344 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:06.322+0000 7f3104976640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f3100111e70 con 0x7f31001076d0 2024-09-10T22:37:06.344 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:06.322+0000 7f30fe59c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3100101cc0 0x7f31001992c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:37:06.344 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:06.322+0000 7f30fe59c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3100101cc0 0x7f31001992c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:46244/0 (socket says 172.21.15.19:46244) 2024-09-10T22:37:06.344 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:06.322+0000 7f30fe59c640 1 -- 172.21.15.19:0/1880257589 learned_addr learned my addr 172.21.15.19:0/1880257589 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:37:06.344 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:06.322+0000 7f30fed9d640 1 --2- 172.21.15.19:0/1880257589 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3100108050 0x7f310019eba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:37:06.344 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:06.322+0000 7f30fdd9b640 1 --2- 172.21.15.19:0/1880257589 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f31001076d0 0x7f3100199800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:37:06.344 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:06.322+0000 7f30fe59c640 1 -- 172.21.15.19:0/1880257589 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f31001076d0 msgr2=0x7f3100199800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:37:06.344 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:06.322+0000 7f30fe59c640 1 --2- 172.21.15.19:0/1880257589 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f31001076d0 0x7f3100199800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:37:06.344 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:06.322+0000 7f30fe59c640 1 -- 172.21.15.19:0/1880257589 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3100108050 msgr2=0x7f310019eba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:37:06.344 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:06.322+0000 7f30fe59c640 1 --2- 172.21.15.19:0/1880257589 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3100108050 0x7f310019eba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:37:06.344 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:06.322+0000 7f30fe59c640 1 -- 172.21.15.19:0/1880257589 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f310019f370 con 0x7f3100101cc0 2024-09-10T22:37:06.345 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:06.322+0000 7f30fdd9b640 1 --2- 172.21.15.19:0/1880257589 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f31001076d0 0x7f3100199800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T22:37:06.345 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:06.323+0000 7f30fe59c640 1 --2- 172.21.15.19:0/1880257589 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3100101cc0 0x7f31001992c0 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 crypto rx=0x7f30f000e9f0 tx=0x7f30f000eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:37:06.345 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:06.323+0000 7f30ef7fe640 1 -- 172.21.15.19:0/1880257589 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30f000cd80 con 0x7f3100101cc0 2024-09-10T22:37:06.345 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:06.323+0000 7f30ef7fe640 1 -- 172.21.15.19:0/1880257589 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f30f00108e0 con 0x7f3100101cc0 2024-09-10T22:37:06.345 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:06.323+0000 7f3104976640 1 -- 172.21.15.19:0/1880257589 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f310019f660 con 0x7f3100101cc0 2024-09-10T22:37:06.345 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:06.323+0000 7f30ef7fe640 1 -- 172.21.15.19:0/1880257589 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30f0018980 con 0x7f3100101cc0 2024-09-10T22:37:06.345 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:06.323+0000 7f3104976640 1 -- 172.21.15.19:0/1880257589 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f31001a5ef0 con 0x7f3100101cc0 2024-09-10T22:37:06.345 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:06.325+0000 7f30ef7fe640 1 -- 172.21.15.19:0/1880257589 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 18) ==== 153250+0+0 (secure 0 0 0) 0x7f30f0010430 con 0x7f3100101cc0 2024-09-10T22:37:06.345 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:06.326+0000 7f3106d4b740 1 Processor -- start 2024-09-10T22:37:06.345 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:06.326+0000 7f3106d4b740 1 -- start start 2024-09-10T22:37:06.345 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:06.326+0000 7f3106d4b740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ce431dd4d0 0x55ce431dd8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:37:06.345 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:06.326+0000 7f3106d4b740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ce431dddf0 0x55ce431e9840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:37:06.345 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:06.326+0000 7f3106d4b740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55ce431e9d80 0x55ce431ec170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:37:06.346 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:06.326+0000 7f3106d4b740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x55ce43153ea0 con 0x55ce431dddf0 2024-09-10T22:37:06.346 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:06.326+0000 7f3106d4b740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55ce431432d0 con 0x55ce431dd4d0 2024-09-10T22:37:06.346 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:06.326+0000 7f3106d4b740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x55ce431470e0 con 0x55ce431e9d80 2024-09-10T22:37:06.346 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:06.326+0000 7f30fe59c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ce431dddf0 0x55ce431e9840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:37:06.346 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:06.326+0000 7f30fe59c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ce431dddf0 0x55ce431e9840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:46260/0 (socket says 172.21.15.19:46260) 2024-09-10T22:37:06.346 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:06.326+0000 7f30fe59c640 1 -- 172.21.15.19:0/60578070 learned_addr learned my addr 172.21.15.19:0/60578070 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:37:06.346 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:06.326+0000 7f30fdd9b640 1 --2- 172.21.15.19:0/60578070 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55ce431e9d80 0x55ce431ec170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:37:06.346 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:06.327+0000 7f30fed9d640 1 --2- 172.21.15.19:0/60578070 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ce431dd4d0 0x55ce431dd8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:37:06.346 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:06.327+0000 7f30fe59c640 1 -- 172.21.15.19:0/60578070 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55ce431e9d80 msgr2=0x55ce431ec170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:37:06.346 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:06.327+0000 7f30fe59c640 1 --2- 172.21.15.19:0/60578070 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55ce431e9d80 0x55ce431ec170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:37:06.346 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:06.327+0000 7f30fe59c640 1 -- 172.21.15.19:0/60578070 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ce431dd4d0 msgr2=0x55ce431dd8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:37:06.346 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:06.327+0000 7f30fe59c640 1 --2- 172.21.15.19:0/60578070 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ce431dd4d0 0x55ce431dd8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:37:06.346 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:06.327+0000 7f30fe59c640 1 -- 172.21.15.19:0/60578070 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ce42ea1650 con 0x55ce431dddf0 2024-09-10T22:37:06.347 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:06.327+0000 7f30ef7fe640 1 --2- 172.21.15.19:0/1880257589 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f30e80b5360 0x7f30e80b7820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:37:06.347 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:06.327+0000 7f30fe59c640 1 --2- 172.21.15.19:0/60578070 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ce431dddf0 0x55ce431e9840 secure :-1 s=READY pgs=837 cs=0 l=1 rev1=1 crypto rx=0x7f30f00e9fd0 tx=0x7f30f00ee5f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5f7b2c0ca126cb4c server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:37:06.347 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:06.327+0000 7f30fed9d640 1 --2- 172.21.15.19:0/1880257589 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f30e80b5360 0x7f30e80b7820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:37:06.347 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:06.327+0000 7f30ecff9640 1 -- 172.21.15.19:0/60578070 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30f00a8cf0 con 0x55ce431dddf0 2024-09-10T22:37:06.347 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:06.328+0000 7f30ef7fe640 1 -- 172.21.15.19:0/1880257589 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8327+0+0 (secure 0 0 0) 0x7f30f00e5f40 con 0x7f3100101cc0 2024-09-10T22:37:06.347 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:06.328+0000 7f30ecff9640 1 -- 172.21.15.19:0/60578070 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f30f00ac1b0 con 0x55ce431dddf0 2024-09-10T22:37:06.347 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:06.328+0000 7f30ecff9640 1 -- 172.21.15.19:0/60578070 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30f00cf140 con 0x55ce431dddf0 2024-09-10T22:37:06.347 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:06.329+0000 7f3106d4b740 1 -- 172.21.15.19:0/60578070 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ce431dddf0 msgr2=0x55ce431e9840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:37:06.347 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:06.329+0000 7f30fed9d640 1 --2- 172.21.15.19:0/1880257589 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f30e80b5360 0x7f30e80b7820 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f30f8005fd0 tx=0x7f30f8009500 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:37:06.347 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:06.329+0000 7f3106d4b740 1 --2- 172.21.15.19:0/60578070 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ce431dddf0 0x55ce431e9840 secure :-1 s=READY pgs=837 cs=0 l=1 rev1=1 crypto rx=0x7f30f00e9fd0 tx=0x7f30f00ee5f0 comp rx=0 tx=0).stop 2024-09-10T22:37:06.347 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:06.329+0000 7f3106d4b740 1 -- 172.21.15.19:0/60578070 shutdown_connections 2024-09-10T22:37:06.347 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:06.329+0000 7f3106d4b740 1 --2- 172.21.15.19:0/60578070 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55ce431e9d80 0x55ce431ec170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:37:06.347 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:06.329+0000 7f3106d4b740 1 --2- 172.21.15.19:0/60578070 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ce431dddf0 0x55ce431e9840 unknown :-1 s=CLOSED pgs=837 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:37:06.348 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:06.329+0000 7f3106d4b740 1 --2- 172.21.15.19:0/60578070 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ce431dd4d0 0x55ce431dd8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:37:06.348 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:06.329+0000 7f3106d4b740 1 -- 172.21.15.19:0/60578070 >> 172.21.15.19:0/60578070 conn(0x55ce431db300 msgr2=0x55ce431dc4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:37:06.348 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:06.329+0000 7f3106d4b740 1 -- 172.21.15.19:0/60578070 shutdown_connections 2024-09-10T22:37:06.348 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:06.329+0000 7f3106d4b740 1 -- 172.21.15.19:0/60578070 wait complete. 2024-09-10T22:37:06.348 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:06.329+0000 7f3106d4b740 1 -- start start 2024-09-10T22:37:06.348 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:06.329+0000 7f3106d4b740 1 Processor -- start 2024-09-10T22:37:06.348 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:06.330+0000 7f3106d4b740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ce431dd4d0 0x55ce431e9700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:37:06.348 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:06.330+0000 7f3106d4b740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ce431dddf0 0x55ce431e6b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:37:06.348 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:06.330+0000 7f3106d4b740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55ce431e9d80 0x55ce431e7220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:37:06.348 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:06.330+0000 7f3106d4b740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x55ce42fa4700 con 0x55ce431dddf0 2024-09-10T22:37:06.348 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:06.330+0000 7f3106d4b740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55ce430de160 con 0x55ce431dd4d0 2024-09-10T22:37:06.348 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:06.330+0000 7f3106d4b740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x55ce431eca00 con 0x55ce431e9d80 2024-09-10T22:37:06.348 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:06.330+0000 7f3106d4b740 10 client.0 _ll_register_callbacks cb 0x55ce430f79e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T22:37:06.349 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:06.330+0000 7f30fdd9b640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ce431dddf0 0x55ce431e6b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:37:06.349 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:06.330+0000 7f30fed9d640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55ce431e9d80 0x55ce431e7220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:37:06.349 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:06.330+0000 7f30fed9d640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55ce431e9d80 0x55ce431e7220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.19:51870/0 (socket says 172.21.15.19:51870) 2024-09-10T22:37:06.349 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:06.330+0000 7f30fdd9b640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ce431dddf0 0x55ce431e6b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:46264/0 (socket says 172.21.15.19:46264) 2024-09-10T22:37:06.349 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:06.330+0000 7f30fed9d640 1 -- 172.21.15.19:0/2743268825 learned_addr learned my addr 172.21.15.19:0/2743268825 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:37:06.349 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:06.330+0000 7f30fe59c640 1 --2- 172.21.15.19:0/2743268825 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ce431dd4d0 0x55ce431e9700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:37:06.349 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:06.330+0000 7f30fed9d640 1 -- 172.21.15.19:0/2743268825 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ce431dd4d0 msgr2=0x55ce431e9700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:37:06.349 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:06.330+0000 7f30fed9d640 1 --2- 172.21.15.19:0/2743268825 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ce431dd4d0 0x55ce431e9700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:37:06.349 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:06.330+0000 7f30fed9d640 1 -- 172.21.15.19:0/2743268825 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ce431dddf0 msgr2=0x55ce431e6b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:37:06.349 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:06.330+0000 7f30fed9d640 1 --2- 172.21.15.19:0/2743268825 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ce431dddf0 0x55ce431e6b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:37:06.349 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:06.330+0000 7f30fed9d640 1 -- 172.21.15.19:0/2743268825 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ce4310bc90 con 0x55ce431e9d80 2024-09-10T22:37:06.349 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:06.331+0000 7f30fed9d640 1 --2- 172.21.15.19:0/2743268825 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55ce431e9d80 0x55ce431e7220 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f30f8003f40 tx=0x7f30f8004ab0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=866e3324c008cb7c server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:37:06.349 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:06.331+0000 7f30e5ffb640 10 client.0 ms_handle_connect on v2:172.21.15.138:3300/0 2024-09-10T22:37:06.350 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:06.331+0000 7f30e5ffb640 1 -- 172.21.15.19:0/2743268825 <== mon.1 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30f800f830 con 0x55ce431e9d80 2024-09-10T22:37:06.350 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:06.331+0000 7f30e5ffb640 1 -- 172.21.15.19:0/2743268825 <== mon.1 v2:172.21.15.138:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8327+0+0 (secure 0 0 0) 0x7f30f800f9d0 con 0x55ce431e9d80 2024-09-10T22:37:06.350 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:06.331+0000 7f3106d4b740 1 -- 172.21.15.19:0/2743268825 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f30f00ac1b0 con 0x55ce431e9d80 2024-09-10T22:37:06.350 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:06.331+0000 7f30e5ffb640 1 -- 172.21.15.19:0/2743268825 <== mon.1 v2:172.21.15.138:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f30f800fbd0 con 0x55ce431e9d80 2024-09-10T22:37:06.350 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:06.331+0000 7f3106d4b740 10 client.26815 fetch_fsmap learned FSMap version 27 2024-09-10T22:37:06.350 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:06.331+0000 7f3106d4b740 1 -- 172.21.15.19:0/2743268825 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55ce431f8490 con 0x55ce431e9d80 2024-09-10T22:37:06.350 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:06.331+0000 7f30e5ffb640 1 -- 172.21.15.19:0/2743268825 <== mon.1 v2:172.21.15.138:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f30f00ac1b0 con 0x55ce431e9d80 2024-09-10T22:37:06.350 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:06.331+0000 7f30e5ffb640 1 -- 172.21.15.19:0/2743268825 <== mon.1 v2:172.21.15.138:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7f30f8030020 con 0x55ce431e9d80 2024-09-10T22:37:06.350 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:06.331+0000 7f3106d4b740 10 client.26815 fetch_fsmap finished waiting for FSMap version 27 2024-09-10T22:37:06.350 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:06.331+0000 7f3106d4b740 10 client.26815 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-10T22:37:06.350 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:06.331+0000 7f3106d4b740 20 client.26815 populate_metadata read hostname 'smithi019' 2024-09-10T22:37:06.350 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:06.331+0000 7f3106d4b740 1 --2- 172.21.15.19:0/2743268825 >> [v2:172.21.15.138:6838/383637208,v1:172.21.15.138:6839/383637208] conn(0x55ce431f9940 0x55ce431fbda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:37:06.350 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:06.331+0000 7f3106d4b740 4 client.26815 mds_command: new command op to 24568 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T22:37:06.351 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:06.331+0000 7f3106d4b740 1 -- 172.21.15.19:0/2743268825 --> [v2:172.21.15.138:6838/383637208,v1:172.21.15.138:6839/383637208] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ce43155df0 con 0x55ce431f9940 2024-09-10T22:37:06.351 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:06.332+0000 7f30fe59c640 1 --2- 172.21.15.19:0/2743268825 >> [v2:172.21.15.138:6838/383637208,v1:172.21.15.138:6839/383637208] conn(0x55ce431f9940 0x55ce431fbda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:37:06.351 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:06.332+0000 7f30fe59c640 1 --2- 172.21.15.19:0/2743268825 >> [v2:172.21.15.138:6838/383637208,v1:172.21.15.138:6839/383637208] conn(0x55ce431f9940 0x55ce431fbda0 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=fd01404cc647d2ea server_cookie=9dc8eb736c931aa in_seq=0 out_seq=0 2024-09-10T22:37:06.351 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:06.332+0000 7f30e5ffb640 10 client.26815 ms_handle_connect on v2:172.21.15.138:6838/383637208 2024-09-10T22:37:06.351 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:06.333+0000 7f30e5ffb640 1 -- 172.21.15.19:0/2743268825 <== mds.1 v2:172.21.15.138:6838/383637208 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55ce43155df0 con 0x55ce431f9940 2024-09-10T22:37:06.351 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:06.333+0000 7f30e5ffb640 10 client.26815 handle_command_reply: tid=0 2024-09-10T22:37:06.351 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:06.333+0000 7f3106d4b740 1 client.26815 shutdown 2024-09-10T22:37:06.351 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:06.333+0000 7f3106d4b740 1 -- 172.21.15.19:0/2743268825 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55ce431e9d80 msgr2=0x55ce431e7220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:37:06.351 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:06.333+0000 7f3106d4b740 1 --2- 172.21.15.19:0/2743268825 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55ce431e9d80 0x55ce431e7220 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f30f8003f40 tx=0x7f30f8004ab0 comp rx=0 tx=0).stop 2024-09-10T22:37:06.351 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:06.333+0000 7f3106d4b740 1 -- 172.21.15.19:0/2743268825 shutdown_connections 2024-09-10T22:37:06.351 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:06.333+0000 7f3106d4b740 1 --2- 172.21.15.19:0/2743268825 >> [v2:172.21.15.138:6838/383637208,v1:172.21.15.138:6839/383637208] conn(0x55ce431f9940 0x55ce431fbda0 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:37:06.351 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:06.333+0000 7f3106d4b740 1 --2- 172.21.15.19:0/2743268825 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55ce431e9d80 0x55ce431e7220 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:37:06.351 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:06.333+0000 7f3106d4b740 1 --2- 172.21.15.19:0/2743268825 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ce431dddf0 0x55ce431e6b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:37:06.352 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:06.333+0000 7f30e5ffb640 0 client.26815 ms_handle_reset on v2:172.21.15.138:6838/383637208 2024-09-10T22:37:06.352 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:06.333+0000 7f3106d4b740 1 --2- 172.21.15.19:0/2743268825 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ce431dd4d0 0x55ce431e9700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:37:06.352 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:06.333+0000 7f3106d4b740 1 -- 172.21.15.19:0/2743268825 >> 172.21.15.19:0/2743268825 conn(0x55ce431db300 msgr2=0x55ce431e0ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:37:06.352 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:06.333+0000 7f3106d4b740 1 -- 172.21.15.19:0/2743268825 shutdown_connections 2024-09-10T22:37:06.352 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:06.333+0000 7f3106d4b740 1 -- 172.21.15.19:0/2743268825 wait complete. 2024-09-10T22:37:06.352 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:06.333+0000 7f3106d4b740 20 client.26815 trim_cache size 0 max 16384 2024-09-10T22:37:06.357 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:06.347+0000 7f3106d4b740 1 Processor -- start 2024-09-10T22:37:06.357 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:06.347+0000 7f3106d4b740 1 -- start start 2024-09-10T22:37:06.357 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:06.347+0000 7f3106d4b740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ce431dd4d0 0x55ce431e6060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:37:06.357 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:06.347+0000 7f3106d4b740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ce431dddf0 0x55ce431da310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:37:06.357 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:06.347+0000 7f3106d4b740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55ce431e9d80 0x55ce431eb170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:37:06.358 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:06.347+0000 7f3106d4b740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f31001b0f10 con 0x55ce431dd4d0 2024-09-10T22:37:06.358 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:06.347+0000 7f3106d4b740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f31001ae7e0 con 0x55ce431dddf0 2024-09-10T22:37:06.358 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:06.347+0000 7f3106d4b740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f31001ac630 con 0x55ce431e9d80 2024-09-10T22:37:06.358 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:06.347+0000 7f30fe59c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ce431dd4d0 0x55ce431e6060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:37:06.358 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:06.347+0000 7f30fe59c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ce431dd4d0 0x55ce431e6060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:46266/0 (socket says 172.21.15.19:46266) 2024-09-10T22:37:06.358 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:06.347+0000 7f30fe59c640 1 -- 172.21.15.19:0/150445576 learned_addr learned my addr 172.21.15.19:0/150445576 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:37:06.358 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:06.347+0000 7f30fed9d640 1 --2- 172.21.15.19:0/150445576 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55ce431e9d80 0x55ce431eb170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:37:06.358 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:06.347+0000 7f30fdd9b640 1 --2- 172.21.15.19:0/150445576 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ce431dddf0 0x55ce431da310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:37:06.358 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:06.348+0000 7f30fe59c640 1 -- 172.21.15.19:0/150445576 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55ce431e9d80 msgr2=0x55ce431eb170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:37:06.358 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:06.348+0000 7f30fe59c640 1 --2- 172.21.15.19:0/150445576 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55ce431e9d80 0x55ce431eb170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:37:06.358 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:06.348+0000 7f30fe59c640 1 -- 172.21.15.19:0/150445576 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ce431dddf0 msgr2=0x55ce431da310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:37:06.358 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:06.348+0000 7f30fe59c640 1 --2- 172.21.15.19:0/150445576 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ce431dddf0 0x55ce431da310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:37:06.358 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:06.348+0000 7f30fe59c640 1 -- 172.21.15.19:0/150445576 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ce431e9a70 con 0x55ce431dd4d0 2024-09-10T22:37:06.358 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:06.348+0000 7f30fe59c640 1 --2- 172.21.15.19:0/150445576 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ce431dd4d0 0x55ce431e6060 secure :-1 s=READY pgs=838 cs=0 l=1 rev1=1 crypto rx=0x7f30f00e3a30 tx=0x7f30f00e82e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b91554016a29d7f9 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:37:06.359 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:06.348+0000 7f30e7fff640 1 -- 172.21.15.19:0/150445576 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30f00cf310 con 0x55ce431dd4d0 2024-09-10T22:37:06.359 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:06.348+0000 7f30e7fff640 1 -- 172.21.15.19:0/150445576 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f30f00ac1b0 con 0x55ce431dd4d0 2024-09-10T22:37:06.359 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:06.348+0000 7f30e7fff640 1 -- 172.21.15.19:0/150445576 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30f00cde60 con 0x55ce431dd4d0 2024-09-10T22:37:06.359 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:06.349+0000 7f3106d4b740 1 -- 172.21.15.19:0/150445576 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ce431dd4d0 msgr2=0x55ce431e6060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:37:06.359 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:06.349+0000 7f3106d4b740 1 --2- 172.21.15.19:0/150445576 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ce431dd4d0 0x55ce431e6060 secure :-1 s=READY pgs=838 cs=0 l=1 rev1=1 crypto rx=0x7f30f00e3a30 tx=0x7f30f00e82e0 comp rx=0 tx=0).stop 2024-09-10T22:37:06.359 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:06.349+0000 7f3106d4b740 1 -- 172.21.15.19:0/150445576 shutdown_connections 2024-09-10T22:37:06.359 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:06.349+0000 7f3106d4b740 1 --2- 172.21.15.19:0/150445576 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55ce431e9d80 0x55ce431eb170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:37:06.359 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:06.349+0000 7f3106d4b740 1 --2- 172.21.15.19:0/150445576 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ce431dddf0 0x55ce431da310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:37:06.359 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:06.349+0000 7f3106d4b740 1 --2- 172.21.15.19:0/150445576 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ce431dd4d0 0x55ce431e6060 unknown :-1 s=CLOSED pgs=838 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:37:06.359 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:06.349+0000 7f3106d4b740 1 -- 172.21.15.19:0/150445576 >> 172.21.15.19:0/150445576 conn(0x55ce431db300 msgr2=0x55ce431d9c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:37:06.359 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:06.349+0000 7f3106d4b740 1 -- 172.21.15.19:0/150445576 shutdown_connections 2024-09-10T22:37:06.359 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:06.349+0000 7f3106d4b740 1 -- 172.21.15.19:0/150445576 wait complete. 2024-09-10T22:37:06.359 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:06.349+0000 7f3106d4b740 1 -- start start 2024-09-10T22:37:06.360 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:06.349+0000 7f3106d4b740 1 Processor -- start 2024-09-10T22:37:06.360 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:06.350+0000 7f3106d4b740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ce431dd4d0 0x55ce431f1d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:37:06.360 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:06.350+0000 7f3106d4b740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55ce431dddf0 0x55ce431f2240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:37:06.360 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:06.350+0000 7f3106d4b740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ce431e9d80 0x55ce431eccb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:37:06.360 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:06.350+0000 7f3106d4b740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f31001acca0 con 0x55ce431e9d80 2024-09-10T22:37:06.360 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:06.350+0000 7f3106d4b740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f31001ae110 con 0x55ce431dd4d0 2024-09-10T22:37:06.360 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:06.350+0000 7f3106d4b740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f31001ad370 con 0x55ce431dddf0 2024-09-10T22:37:06.360 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:06.350+0000 7f3106d4b740 10 client.0 _ll_register_callbacks cb 0x7f30f8009e00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T22:37:06.360 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:06.350+0000 7f30fe59c640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ce431dd4d0 0x55ce431f1d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:37:06.360 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:06.350+0000 7f30fe59c640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ce431dd4d0 0x55ce431f1d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.19:40498/0 (socket says 172.21.15.19:40498) 2024-09-10T22:37:06.360 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:06.350+0000 7f30fe59c640 1 -- 172.21.15.19:0/843242592 learned_addr learned my addr 172.21.15.19:0/843242592 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:37:06.360 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:06.350+0000 7f30fdd9b640 1 --2- 172.21.15.19:0/843242592 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55ce431dddf0 0x55ce431f2240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:37:06.360 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:06.350+0000 7f30fe59c640 1 -- 172.21.15.19:0/843242592 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55ce431dddf0 msgr2=0x55ce431f2240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:37:06.361 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:06.350+0000 7f30fe59c640 1 --2- 172.21.15.19:0/843242592 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55ce431dddf0 0x55ce431f2240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:37:06.361 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:06.350+0000 7f30fe59c640 1 -- 172.21.15.19:0/843242592 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ce431e9d80 msgr2=0x55ce431eccb0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-10T22:37:06.361 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:06.350+0000 7f30fe59c640 1 --2- 172.21.15.19:0/843242592 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ce431e9d80 0x55ce431eccb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:37:06.361 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:06.350+0000 7f30fe59c640 1 -- 172.21.15.19:0/843242592 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ce431ed1f0 con 0x55ce431dd4d0 2024-09-10T22:37:06.361 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:06.351+0000 7f30fe59c640 1 --2- 172.21.15.19:0/843242592 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ce431dd4d0 0x55ce431f1d00 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f30f00a9910 tx=0x7f30f000cf20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=22ae9203db2ea662 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:37:06.361 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:06.351+0000 7f30e5ffb640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-09-10T22:37:06.361 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:06.351+0000 7f30e5ffb640 1 -- 172.21.15.19:0/843242592 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30f00abe10 con 0x55ce431dd4d0 2024-09-10T22:37:06.361 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:06.351+0000 7f30e5ffb640 1 -- 172.21.15.19:0/843242592 <== mon.2 v2:172.21.15.135:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8327+0+0 (secure 0 0 0) 0x7f30f00eee20 con 0x55ce431dd4d0 2024-09-10T22:37:06.361 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:06.351+0000 7f3106d4b740 1 -- 172.21.15.19:0/843242592 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f30f00ac1b0 con 0x55ce431dd4d0 2024-09-10T22:37:06.361 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:06.351+0000 7f30e5ffb640 1 -- 172.21.15.19:0/843242592 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f30f00abff0 con 0x55ce431dd4d0 2024-09-10T22:37:06.361 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:06.351+0000 7f3106d4b740 10 client.26789 fetch_fsmap learned FSMap version 27 2024-09-10T22:37:06.361 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:06.351+0000 7f3106d4b740 1 -- 172.21.15.19:0/843242592 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55ce43267030 con 0x55ce431dd4d0 2024-09-10T22:37:06.362 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:06.351+0000 7f30e5ffb640 1 -- 172.21.15.19:0/843242592 <== mon.2 v2:172.21.15.135:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f30f00ac1b0 con 0x55ce431dd4d0 2024-09-10T22:37:06.362 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:06.351+0000 7f30e5ffb640 1 -- 172.21.15.19:0/843242592 <== mon.2 v2:172.21.15.135:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7f30f00a8910 con 0x55ce431dd4d0 2024-09-10T22:37:06.362 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:06.351+0000 7f3106d4b740 10 client.26789 fetch_fsmap finished waiting for FSMap version 27 2024-09-10T22:37:06.362 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:06.352+0000 7f3106d4b740 10 client.26789 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-10T22:37:06.362 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:06.352+0000 7f3106d4b740 20 client.26789 populate_metadata read hostname 'smithi019' 2024-09-10T22:37:06.362 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:06.352+0000 7f3106d4b740 1 --2- 172.21.15.19:0/843242592 >> [v2:172.21.15.138:6838/383637208,v1:172.21.15.138:6839/383637208] conn(0x55ce432670d0 0x55ce432694c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:37:06.362 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:06.352+0000 7f3106d4b740 4 client.26789 mds_command: new command op to 24568 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-10T22:37:06.362 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:06.352+0000 7f3106d4b740 1 -- 172.21.15.19:0/843242592 --> [v2:172.21.15.138:6838/383637208,v1:172.21.15.138:6839/383637208] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55ce431518a0 con 0x55ce432670d0 2024-09-10T22:37:06.362 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:06.352+0000 7f30fdd9b640 1 --2- 172.21.15.19:0/843242592 >> [v2:172.21.15.138:6838/383637208,v1:172.21.15.138:6839/383637208] conn(0x55ce432670d0 0x55ce432694c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:37:06.362 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:06.352+0000 7f30fdd9b640 1 --2- 172.21.15.19:0/843242592 >> [v2:172.21.15.138:6838/383637208,v1:172.21.15.138:6839/383637208] conn(0x55ce432670d0 0x55ce432694c0 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=c3b365f15f0923e4 server_cookie=2878553946657a49 in_seq=0 out_seq=0 2024-09-10T22:37:06.362 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:06.352+0000 7f30e5ffb640 10 client.26789 ms_handle_connect on v2:172.21.15.138:6838/383637208 2024-09-10T22:37:06.362 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:06.352+0000 7f30e5ffb640 1 -- 172.21.15.19:0/843242592 <== mds.1 v2:172.21.15.138:6838/383637208 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55ce431518a0 con 0x55ce432670d0 2024-09-10T22:37:06.362 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:06.352+0000 7f30e5ffb640 10 client.26789 handle_command_reply: tid=0 2024-09-10T22:37:06.362 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:06.352+0000 7f3106d4b740 1 client.26789 shutdown 2024-09-10T22:37:06.363 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:06.353+0000 7f3106d4b740 1 -- 172.21.15.19:0/843242592 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ce431dd4d0 msgr2=0x55ce431f1d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:37:06.363 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:06.353+0000 7f3106d4b740 1 --2- 172.21.15.19:0/843242592 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ce431dd4d0 0x55ce431f1d00 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f30f00a9910 tx=0x7f30f000cf20 comp rx=0 tx=0).stop 2024-09-10T22:37:06.363 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:06.353+0000 7f3106d4b740 1 -- 172.21.15.19:0/843242592 shutdown_connections 2024-09-10T22:37:06.363 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:06.353+0000 7f3106d4b740 1 --2- 172.21.15.19:0/843242592 >> [v2:172.21.15.138:6838/383637208,v1:172.21.15.138:6839/383637208] conn(0x55ce432670d0 0x55ce432694c0 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:37:06.363 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:06.353+0000 7f3106d4b740 1 --2- 172.21.15.19:0/843242592 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ce431e9d80 0x55ce431eccb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:37:06.363 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:06.353+0000 7f3106d4b740 1 --2- 172.21.15.19:0/843242592 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55ce431dddf0 0x55ce431f2240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:37:06.363 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:06.353+0000 7f3106d4b740 1 --2- 172.21.15.19:0/843242592 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ce431dd4d0 0x55ce431f1d00 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:37:06.363 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:06.353+0000 7f3106d4b740 1 -- 172.21.15.19:0/843242592 >> 172.21.15.19:0/843242592 conn(0x55ce431db300 msgr2=0x55ce431d9c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:37:06.363 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:06.353+0000 7f30e5ffb640 0 client.26789 ms_handle_reset on v2:172.21.15.138:6838/383637208 2024-09-10T22:37:06.363 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:06.353+0000 7f3106d4b740 1 -- 172.21.15.19:0/843242592 shutdown_connections 2024-09-10T22:37:06.363 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:06.353+0000 7f3106d4b740 1 -- 172.21.15.19:0/843242592 wait complete. 2024-09-10T22:37:06.363 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:06.353+0000 7f3106d4b740 20 client.26789 trim_cache size 0 max 16384 2024-09-10T22:37:06.364 INFO:teuthology.orchestra.run.smithi019.stdout:[] 2024-09-10T22:37:06.364 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:06.354+0000 7f3104976640 1 -- 172.21.15.19:0/1880257589 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f30e80b5360 msgr2=0x7f30e80b7820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:37:06.364 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:06.354+0000 7f3104976640 1 --2- 172.21.15.19:0/1880257589 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f30e80b5360 0x7f30e80b7820 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f30f8005fd0 tx=0x7f30f8009500 comp rx=0 tx=0).stop 2024-09-10T22:37:06.364 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:06.354+0000 7f3104976640 1 -- 172.21.15.19:0/1880257589 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3100101cc0 msgr2=0x7f31001992c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:37:06.364 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:06.354+0000 7f3104976640 1 --2- 172.21.15.19:0/1880257589 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3100101cc0 0x7f31001992c0 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 crypto rx=0x7f30f000e9f0 tx=0x7f30f000eeb0 comp rx=0 tx=0).stop 2024-09-10T22:37:06.365 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:06.354+0000 7f3104976640 1 -- 172.21.15.19:0/1880257589 shutdown_connections 2024-09-10T22:37:06.365 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:06.354+0000 7f3104976640 1 --2- 172.21.15.19:0/1880257589 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f30e80b5360 0x7f30e80b7820 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:37:06.365 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:06.354+0000 7f3104976640 1 --2- 172.21.15.19:0/1880257589 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3100108050 0x7f310019eba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:37:06.365 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:06.354+0000 7f3104976640 1 --2- 172.21.15.19:0/1880257589 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f31001076d0 0x7f3100199800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:37:06.365 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:06.354+0000 7f3104976640 1 --2- 172.21.15.19:0/1880257589 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3100101cc0 0x7f31001992c0 unknown :-1 s=CLOSED pgs=836 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:37:06.365 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:06.354+0000 7f3104976640 1 -- 172.21.15.19:0/1880257589 >> 172.21.15.19:0/1880257589 conn(0x7f31000fd770 msgr2=0x7f310006b5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:37:06.365 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:06.354+0000 7f3104976640 1 -- 172.21.15.19:0/1880257589 shutdown_connections 2024-09-10T22:37:06.365 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:06.354+0000 7f3104976640 1 -- 172.21.15.19:0/1880257589 wait complete. 2024-09-10T22:37:06.610 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:37:06 smithi135 ceph-mon[34789]: pgmap v667: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 455 KiB/s rd, 174 MiB/s wr, 1.03k op/s 2024-09-10T22:37:06.625 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:37:06 smithi138 ceph-mon[35236]: pgmap v667: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 455 KiB/s rd, 174 MiB/s wr, 1.03k op/s 2024-09-10T22:37:06.708 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:37:06 smithi019 ceph-mon[31375]: pgmap v667: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 455 KiB/s rd, 174 MiB/s wr, 1.03k op/s 2024-09-10T22:37:07.194 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 22997a4c-6fc2-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-10T22:37:07.544 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/22997a4c-6fc2-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T22:37:08.106 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:08.088+0000 7f2156751640 1 -- 172.21.15.19:0/2775307436 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2150109150 msgr2=0x7f215010f950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:37:08.106 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:08.088+0000 7f2156751640 1 --2- 172.21.15.19:0/2775307436 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2150109150 0x7f215010f950 secure :-1 s=READY pgs=839 cs=0 l=1 rev1=1 crypto rx=0x7f2148009ca0 tx=0x7f214802a8c0 comp rx=0 tx=0).stop 2024-09-10T22:37:08.106 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:08.088+0000 7f2156751640 1 -- 172.21.15.19:0/2775307436 shutdown_connections 2024-09-10T22:37:08.106 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:08.088+0000 7f2156751640 1 --2- 172.21.15.19:0/2775307436 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2150109150 0x7f215010f950 unknown :-1 s=CLOSED pgs=839 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:37:08.106 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:08.088+0000 7f2156751640 1 --2- 172.21.15.19:0/2775307436 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f21501087d0 0x7f2150108c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:37:08.106 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:08.088+0000 7f2156751640 1 --2- 172.21.15.19:0/2775307436 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f2150102dc0 0x7f21501031a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:37:08.107 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:08.088+0000 7f2156751640 1 -- 172.21.15.19:0/2775307436 >> 172.21.15.19:0/2775307436 conn(0x7f21500fe830 msgr2=0x7f2150100c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:37:08.107 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:08.088+0000 7f2156751640 1 -- 172.21.15.19:0/2775307436 shutdown_connections 2024-09-10T22:37:08.107 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:08.088+0000 7f2156751640 1 -- 172.21.15.19:0/2775307436 wait complete. 2024-09-10T22:37:08.107 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:08.089+0000 7f2156751640 1 Processor -- start 2024-09-10T22:37:08.107 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:08.089+0000 7f2156751640 1 -- start start 2024-09-10T22:37:08.107 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:08.089+0000 7f2156751640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2150102dc0 0x7f2150199300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:37:08.107 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:08.089+0000 7f2156751640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f21501087d0 0x7f2150199840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:37:08.107 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:08.089+0000 7f2156751640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f2150109150 0x7f215019ebe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:37:08.107 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:08.089+0000 7f2156751640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f2150112e10 con 0x7f21501087d0 2024-09-10T22:37:08.107 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:08.089+0000 7f2156751640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f2150112c90 con 0x7f2150102dc0 2024-09-10T22:37:08.107 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:08.089+0000 7f2156751640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f2150112f90 con 0x7f2150109150 2024-09-10T22:37:08.107 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:08.089+0000 7f2147fff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f21501087d0 0x7f2150199840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:37:08.107 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:08.089+0000 7f214ffff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2150102dc0 0x7f2150199300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:37:08.108 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:08.089+0000 7f214ffff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2150102dc0 0x7f2150199300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.19:40518/0 (socket says 172.21.15.19:40518) 2024-09-10T22:37:08.108 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:08.089+0000 7f2147fff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f21501087d0 0x7f2150199840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:46284/0 (socket says 172.21.15.19:46284) 2024-09-10T22:37:08.108 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:08.089+0000 7f214ffff640 1 -- 172.21.15.19:0/744382835 learned_addr learned my addr 172.21.15.19:0/744382835 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:37:08.108 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:08.089+0000 7f2154cee640 1 --2- 172.21.15.19:0/744382835 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f2150109150 0x7f215019ebe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:37:08.108 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:08.089+0000 7f214ffff640 1 -- 172.21.15.19:0/744382835 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f2150109150 msgr2=0x7f215019ebe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:37:08.108 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:08.089+0000 7f214ffff640 1 --2- 172.21.15.19:0/744382835 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f2150109150 0x7f215019ebe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:37:08.108 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:08.089+0000 7f214ffff640 1 -- 172.21.15.19:0/744382835 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f21501087d0 msgr2=0x7f2150199840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:37:08.108 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:08.089+0000 7f214ffff640 1 --2- 172.21.15.19:0/744382835 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f21501087d0 0x7f2150199840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:37:08.108 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:08.090+0000 7f214ffff640 1 -- 172.21.15.19:0/744382835 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f215019f3b0 con 0x7f2150102dc0 2024-09-10T22:37:08.108 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:08.090+0000 7f214ffff640 1 --2- 172.21.15.19:0/744382835 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2150102dc0 0x7f2150199300 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f214000e9f0 tx=0x7f214000edf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:37:08.108 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:08.090+0000 7f214dffb640 1 -- 172.21.15.19:0/744382835 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f214000cd80 con 0x7f2150102dc0 2024-09-10T22:37:08.108 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:08.090+0000 7f2156751640 1 -- 172.21.15.19:0/744382835 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f215019f6a0 con 0x7f2150102dc0 2024-09-10T22:37:08.108 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:08.090+0000 7f2154cee640 1 --2- 172.21.15.19:0/744382835 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f2150109150 0x7f215019ebe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T22:37:08.108 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:08.090+0000 7f214dffb640 1 -- 172.21.15.19:0/744382835 <== mon.2 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f21400054d0 con 0x7f2150102dc0 2024-09-10T22:37:08.108 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:08.090+0000 7f2156751640 1 -- 172.21.15.19:0/744382835 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f21501a5d60 con 0x7f2150102dc0 2024-09-10T22:37:08.109 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:08.090+0000 7f214dffb640 1 -- 172.21.15.19:0/744382835 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2140010690 con 0x7f2150102dc0 2024-09-10T22:37:08.109 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:08.093+0000 7f214dffb640 1 -- 172.21.15.19:0/744382835 <== mon.2 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 18) ==== 153250+0+0 (secure 0 0 0) 0x7f2140004e80 con 0x7f2150102dc0 2024-09-10T22:37:08.109 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:08.093+0000 7f2158b26740 1 Processor -- start 2024-09-10T22:37:08.109 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:08.093+0000 7f2158b26740 1 -- start start 2024-09-10T22:37:08.109 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:08.093+0000 7f2158b26740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560acff3f0f0 0x560acff3f4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:37:08.109 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:08.093+0000 7f2158b26740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x560acff3fa10 0x560acff4f870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:37:08.109 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:08.093+0000 7f2158b26740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x560acff4fdb0 0x560acff521a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:37:08.109 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:08.093+0000 7f2158b26740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x560acfeb5ea0 con 0x560acff3fa10 2024-09-10T22:37:08.109 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:08.093+0000 7f2158b26740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x560acfea52d0 con 0x560acff3f0f0 2024-09-10T22:37:08.109 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:08.093+0000 7f2158b26740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x560acfea90e0 con 0x560acff4fdb0 2024-09-10T22:37:08.109 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:08.093+0000 7f214ffff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x560acff3fa10 0x560acff4f870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:37:08.109 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:08.093+0000 7f214ffff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x560acff3fa10 0x560acff4f870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:46298/0 (socket says 172.21.15.19:46298) 2024-09-10T22:37:08.109 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:08.093+0000 7f214ffff640 1 -- 172.21.15.19:0/3282514788 learned_addr learned my addr 172.21.15.19:0/3282514788 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:37:08.110 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:08.093+0000 7f2154cee640 1 --2- 172.21.15.19:0/3282514788 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560acff3f0f0 0x560acff3f4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:37:08.110 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:08.093+0000 7f2147fff640 1 --2- 172.21.15.19:0/3282514788 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x560acff4fdb0 0x560acff521a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:37:08.110 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:08.094+0000 7f2154cee640 1 -- 172.21.15.19:0/3282514788 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x560acff4fdb0 msgr2=0x560acff521a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:37:08.110 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:08.094+0000 7f2154cee640 1 --2- 172.21.15.19:0/3282514788 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x560acff4fdb0 0x560acff521a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:37:08.110 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:08.094+0000 7f2154cee640 1 -- 172.21.15.19:0/3282514788 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x560acff3fa10 msgr2=0x560acff4f870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:37:08.110 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:08.094+0000 7f2154cee640 1 --2- 172.21.15.19:0/3282514788 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x560acff3fa10 0x560acff4f870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:37:08.110 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:08.094+0000 7f2154cee640 1 -- 172.21.15.19:0/3282514788 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560acfc03650 con 0x560acff3f0f0 2024-09-10T22:37:08.110 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:08.094+0000 7f2154cee640 1 --2- 172.21.15.19:0/3282514788 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560acff3f0f0 0x560acff3f4d0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f214802ade0 tx=0x7f2148009360 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4f8997d4e6793ac1 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:37:08.110 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:08.094+0000 7f214dffb640 1 --2- 172.21.15.19:0/744382835 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f213c0b52e0 0x7f213c0b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:37:08.110 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:08.094+0000 7f21467fc640 1 -- 172.21.15.19:0/3282514788 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2148031cf0 con 0x560acff3f0f0 2024-09-10T22:37:08.110 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:08.095+0000 7f214ffff640 1 --2- 172.21.15.19:0/744382835 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f213c0b52e0 0x7f213c0b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:37:08.110 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:08.095+0000 7f21467fc640 1 -- 172.21.15.19:0/3282514788 <== mon.2 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2148036040 con 0x560acff3f0f0 2024-09-10T22:37:08.111 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:08.095+0000 7f21467fc640 1 -- 172.21.15.19:0/3282514788 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21480042a0 con 0x560acff3f0f0 2024-09-10T22:37:08.111 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:08.095+0000 7f214dffb640 1 -- 172.21.15.19:0/744382835 <== mon.2 v2:172.21.15.135:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8327+0+0 (secure 0 0 0) 0x7f21400e60e0 con 0x7f2150102dc0 2024-09-10T22:37:08.111 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:08.095+0000 7f2158b26740 1 -- 172.21.15.19:0/3282514788 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560acff3f0f0 msgr2=0x560acff3f4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:37:08.111 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:08.095+0000 7f214ffff640 1 --2- 172.21.15.19:0/744382835 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f213c0b52e0 0x7f213c0b77a0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f214000cff0 tx=0x7f21400e9b20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:37:08.111 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:08.095+0000 7f2158b26740 1 --2- 172.21.15.19:0/3282514788 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560acff3f0f0 0x560acff3f4d0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f214802ade0 tx=0x7f2148009360 comp rx=0 tx=0).stop 2024-09-10T22:37:08.111 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:08.096+0000 7f2158b26740 1 -- 172.21.15.19:0/3282514788 shutdown_connections 2024-09-10T22:37:08.111 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:08.096+0000 7f2158b26740 1 --2- 172.21.15.19:0/3282514788 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x560acff4fdb0 0x560acff521a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:37:08.111 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:08.096+0000 7f2158b26740 1 --2- 172.21.15.19:0/3282514788 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x560acff3fa10 0x560acff4f870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:37:08.111 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:08.096+0000 7f2158b26740 1 --2- 172.21.15.19:0/3282514788 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560acff3f0f0 0x560acff3f4d0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:37:08.111 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:08.096+0000 7f2158b26740 1 -- 172.21.15.19:0/3282514788 >> 172.21.15.19:0/3282514788 conn(0x560acff3cf20 msgr2=0x560acff3e0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:37:08.111 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:08.096+0000 7f2158b26740 1 -- 172.21.15.19:0/3282514788 shutdown_connections 2024-09-10T22:37:08.111 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:08.096+0000 7f2158b26740 1 -- 172.21.15.19:0/3282514788 wait complete. 2024-09-10T22:37:08.111 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:08.096+0000 7f2158b26740 1 -- start start 2024-09-10T22:37:08.111 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:08.096+0000 7f2158b26740 1 Processor -- start 2024-09-10T22:37:08.112 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:08.097+0000 7f2158b26740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560acff3f0f0 0x560acff4f660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:37:08.112 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:08.097+0000 7f2158b26740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x560acff3fa10 0x560acff4cb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:37:08.112 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:08.097+0000 7f2158b26740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x560acff4fdb0 0x560acff4d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:37:08.112 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:08.097+0000 7f2158b26740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x560acfd06700 con 0x560acff4fdb0 2024-09-10T22:37:08.112 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:08.097+0000 7f2158b26740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x560acfe40160 con 0x560acff3f0f0 2024-09-10T22:37:08.112 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:08.097+0000 7f2158b26740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x560acff52a00 con 0x560acff3fa10 2024-09-10T22:37:08.112 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:08.097+0000 7f2158b26740 10 client.0 _ll_register_callbacks cb 0x560acfe599e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T22:37:08.112 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:08.097+0000 7f2154cee640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x560acff4fdb0 0x560acff4d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:37:08.112 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:08.097+0000 7f2154cee640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x560acff4fdb0 0x560acff4d0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:46308/0 (socket says 172.21.15.19:46308) 2024-09-10T22:37:08.112 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:08.097+0000 7f2154cee640 1 -- 172.21.15.19:0/1471117878 learned_addr learned my addr 172.21.15.19:0/1471117878 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:37:08.112 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:08.097+0000 7f2147fff640 1 --2- 172.21.15.19:0/1471117878 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x560acff3fa10 0x560acff4cb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:37:08.112 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:08.097+0000 7f2154cee640 1 --2- 172.21.15.19:0/1471117878 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560acff3f0f0 0x560acff4f660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:37:08.112 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:08.097+0000 7f2154cee640 1 -- 172.21.15.19:0/1471117878 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x560acff3fa10 msgr2=0x560acff4cb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:37:08.113 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:08.097+0000 7f2154cee640 1 --2- 172.21.15.19:0/1471117878 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x560acff3fa10 0x560acff4cb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:37:08.113 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:08.097+0000 7f2154cee640 1 -- 172.21.15.19:0/1471117878 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560acff3f0f0 msgr2=0x560acff4f660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:37:08.113 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:08.097+0000 7f2154cee640 1 --2- 172.21.15.19:0/1471117878 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560acff3f0f0 0x560acff4f660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:37:08.113 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:08.097+0000 7f2154cee640 1 -- 172.21.15.19:0/1471117878 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560acfe6dc90 con 0x560acff4fdb0 2024-09-10T22:37:08.113 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:08.097+0000 7f2154cee640 1 --2- 172.21.15.19:0/1471117878 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x560acff4fdb0 0x560acff4d0c0 secure :-1 s=READY pgs=840 cs=0 l=1 rev1=1 crypto rx=0x7f214802f470 tx=0x7f214803e040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bb652efd724e1b30 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:37:08.113 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:08.098+0000 7f212f7fe640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-10T22:37:08.113 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:08.098+0000 7f212f7fe640 1 -- 172.21.15.19:0/1471117878 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2148059060 con 0x560acff4fdb0 2024-09-10T22:37:08.113 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:08.098+0000 7f212f7fe640 1 -- 172.21.15.19:0/1471117878 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8327+0+0 (secure 0 0 0) 0x7f2148031cf0 con 0x560acff4fdb0 2024-09-10T22:37:08.113 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:08.098+0000 7f2158b26740 1 -- 172.21.15.19:0/1471117878 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2148036040 con 0x560acff4fdb0 2024-09-10T22:37:08.113 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:08.098+0000 7f212f7fe640 1 -- 172.21.15.19:0/1471117878 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f2148004b40 con 0x560acff4fdb0 2024-09-10T22:37:08.113 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:08.098+0000 7f2158b26740 10 client.17499 fetch_fsmap learned FSMap version 27 2024-09-10T22:37:08.113 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:08.098+0000 7f2158b26740 1 -- 172.21.15.19:0/1471117878 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x560acff5e2f0 con 0x560acff4fdb0 2024-09-10T22:37:08.113 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:08.098+0000 7f212f7fe640 1 -- 172.21.15.19:0/1471117878 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2148036040 con 0x560acff4fdb0 2024-09-10T22:37:08.113 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:08.099+0000 7f212f7fe640 1 -- 172.21.15.19:0/1471117878 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7f21480045c0 con 0x560acff4fdb0 2024-09-10T22:37:08.114 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:08.099+0000 7f2158b26740 10 client.17499 fetch_fsmap finished waiting for FSMap version 27 2024-09-10T22:37:08.114 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:08.099+0000 7f2158b26740 10 client.17499 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-10T22:37:08.114 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:08.099+0000 7f2158b26740 20 client.17499 populate_metadata read hostname 'smithi019' 2024-09-10T22:37:08.114 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:08.099+0000 7f2158b26740 1 --2- 172.21.15.19:0/1471117878 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x560acff5f640 0x560acff61a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:37:08.114 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:08.099+0000 7f2158b26740 4 client.17499 mds_command: new command op to 24581 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T22:37:08.114 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:08.099+0000 7f2158b26740 1 -- 172.21.15.19:0/1471117878 --> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x560acfeb7df0 con 0x560acff5f640 2024-09-10T22:37:08.114 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:08.099+0000 7f2147fff640 1 --2- 172.21.15.19:0/1471117878 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x560acff5f640 0x560acff61a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:37:08.114 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:08.099+0000 7f212f7fe640 10 client.17499 ms_handle_connect on v2:172.21.15.135:6838/1254769802 2024-09-10T22:37:08.114 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:08.099+0000 7f2147fff640 1 --2- 172.21.15.19:0/1471117878 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x560acff5f640 0x560acff61a30 crc :-1 s=READY pgs=210 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fdddb7c557250621 server_cookie=500018be2cb1b994 in_seq=0 out_seq=0 2024-09-10T22:37:08.114 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:08.100+0000 7f212f7fe640 1 -- 172.21.15.19:0/1471117878 <== mds.0 v2:172.21.15.135:6838/1254769802 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x560acfeb7df0 con 0x560acff5f640 2024-09-10T22:37:08.114 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:08.100+0000 7f212f7fe640 10 client.17499 handle_command_reply: tid=0 2024-09-10T22:37:08.114 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:08.100+0000 7f2158b26740 1 client.17499 shutdown 2024-09-10T22:37:08.114 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:08.100+0000 7f2158b26740 1 -- 172.21.15.19:0/1471117878 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x560acff4fdb0 msgr2=0x560acff4d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:37:08.114 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:08.100+0000 7f2158b26740 1 --2- 172.21.15.19:0/1471117878 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x560acff4fdb0 0x560acff4d0c0 secure :-1 s=READY pgs=840 cs=0 l=1 rev1=1 crypto rx=0x7f214802f470 tx=0x7f214803e040 comp rx=0 tx=0).stop 2024-09-10T22:37:08.115 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:08.101+0000 7f2158b26740 1 -- 172.21.15.19:0/1471117878 shutdown_connections 2024-09-10T22:37:08.115 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:08.101+0000 7f2158b26740 1 --2- 172.21.15.19:0/1471117878 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x560acff4fdb0 0x560acff4d0c0 unknown :-1 s=CLOSED pgs=840 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:37:08.115 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:08.101+0000 7f2158b26740 1 --2- 172.21.15.19:0/1471117878 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x560acff5f640 0x560acff61a30 crc :-1 s=READY pgs=210 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:37:08.115 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:08.101+0000 7f2158b26740 1 --2- 172.21.15.19:0/1471117878 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x560acff3fa10 0x560acff4cb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:37:08.115 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:08.101+0000 7f2158b26740 1 --2- 172.21.15.19:0/1471117878 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560acff3f0f0 0x560acff4f660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:37:08.115 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:08.101+0000 7f2158b26740 1 -- 172.21.15.19:0/1471117878 >> 172.21.15.19:0/1471117878 conn(0x560acff3cf20 msgr2=0x560acff42a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:37:08.115 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:08.101+0000 7f212f7fe640 0 client.17499 ms_handle_reset on v2:172.21.15.135:6838/1254769802 2024-09-10T22:37:08.115 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:08.101+0000 7f2158b26740 1 -- 172.21.15.19:0/1471117878 shutdown_connections 2024-09-10T22:37:08.115 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:08.101+0000 7f2158b26740 1 -- 172.21.15.19:0/1471117878 wait complete. 2024-09-10T22:37:08.115 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:08.101+0000 7f2158b26740 20 client.17499 trim_cache size 0 max 16384 2024-09-10T22:37:08.124 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:08.123+0000 7f2158b26740 1 Processor -- start 2024-09-10T22:37:08.125 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:08.123+0000 7f2158b26740 1 -- start start 2024-09-10T22:37:08.125 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:08.123+0000 7f2158b26740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x560acff3f0f0 0x560acff3c760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:37:08.125 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:08.124+0000 7f2158b26740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x560acff3fa10 0x560acff3e6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:37:08.126 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:08.124+0000 7f2154cee640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x560acff3f0f0 0x560acff3c760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:37:08.126 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:08.124+0000 7f2158b26740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560acff4fdb0 0x560acff42230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:37:08.126 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:08.124+0000 7f2158b26740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f21501aed50 con 0x560acff3f0f0 2024-09-10T22:37:08.126 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:08.124+0000 7f2158b26740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f21501ac620 con 0x560acff4fdb0 2024-09-10T22:37:08.127 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:08.124+0000 7f2158b26740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f21501aa470 con 0x560acff3fa10 2024-09-10T22:37:08.127 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:08.124+0000 7f2154cee640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x560acff3f0f0 0x560acff3c760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:46312/0 (socket says 172.21.15.19:46312) 2024-09-10T22:37:08.127 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:08.124+0000 7f2154cee640 1 -- 172.21.15.19:0/3611751699 learned_addr learned my addr 172.21.15.19:0/3611751699 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:37:08.129 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:08.125+0000 7f2154cee640 1 -- 172.21.15.19:0/3611751699 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x560acff3fa10 msgr2=0x560acff3e6a0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-10T22:37:08.130 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:08.125+0000 7f2154cee640 1 --2- 172.21.15.19:0/3611751699 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x560acff3fa10 0x560acff3e6a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:37:08.130 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:08.125+0000 7f2154cee640 1 -- 172.21.15.19:0/3611751699 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560acff4fdb0 msgr2=0x560acff42230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:37:08.130 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:08.125+0000 7f2154cee640 1 --2- 172.21.15.19:0/3611751699 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560acff4fdb0 0x560acff42230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:37:08.130 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:08.125+0000 7f2154cee640 1 -- 172.21.15.19:0/3611751699 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560acff4b000 con 0x560acff3f0f0 2024-09-10T22:37:08.130 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:08.126+0000 7f2154cee640 1 --2- 172.21.15.19:0/3611751699 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x560acff3f0f0 0x560acff3c760 secure :-1 s=READY pgs=841 cs=0 l=1 rev1=1 crypto rx=0x7f214802f590 tx=0x7f21480095c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3e252b7e7c01111c server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:37:08.130 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:08.127+0000 7f2145ffb640 1 -- 172.21.15.19:0/3611751699 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2148059070 con 0x560acff3f0f0 2024-09-10T22:37:08.130 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:08.127+0000 7f2145ffb640 1 -- 172.21.15.19:0/3611751699 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2148063070 con 0x560acff3f0f0 2024-09-10T22:37:08.130 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:08.128+0000 7f2145ffb640 1 -- 172.21.15.19:0/3611751699 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2148031450 con 0x560acff3f0f0 2024-09-10T22:37:08.131 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:08.128+0000 7f2158b26740 1 -- 172.21.15.19:0/3611751699 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x560acff3f0f0 msgr2=0x560acff3c760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:37:08.131 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:08.128+0000 7f2158b26740 1 --2- 172.21.15.19:0/3611751699 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x560acff3f0f0 0x560acff3c760 secure :-1 s=READY pgs=841 cs=0 l=1 rev1=1 crypto rx=0x7f214802f590 tx=0x7f21480095c0 comp rx=0 tx=0).stop 2024-09-10T22:37:08.133 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:08.128+0000 7f2158b26740 1 -- 172.21.15.19:0/3611751699 shutdown_connections 2024-09-10T22:37:08.133 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:08.128+0000 7f2158b26740 1 --2- 172.21.15.19:0/3611751699 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560acff4fdb0 0x560acff42230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:37:08.133 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:08.128+0000 7f2158b26740 1 --2- 172.21.15.19:0/3611751699 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x560acff3fa10 0x560acff3e6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:37:08.133 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:08.128+0000 7f2158b26740 1 --2- 172.21.15.19:0/3611751699 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x560acff3f0f0 0x560acff3c760 unknown :-1 s=CLOSED pgs=841 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:37:08.133 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:08.128+0000 7f2158b26740 1 -- 172.21.15.19:0/3611751699 >> 172.21.15.19:0/3611751699 conn(0x560acff3cf20 msgr2=0x560acff3df90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:37:08.133 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:08.129+0000 7f2158b26740 1 -- 172.21.15.19:0/3611751699 shutdown_connections 2024-09-10T22:37:08.133 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:08.129+0000 7f2158b26740 1 -- 172.21.15.19:0/3611751699 wait complete. 2024-09-10T22:37:08.133 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:08.130+0000 7f2158b26740 1 -- start start 2024-09-10T22:37:08.135 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:08.130+0000 7f2158b26740 1 Processor -- start 2024-09-10T22:37:08.135 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:08.130+0000 7f2158b26740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x560acff3f0f0 0x560acff64a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:37:08.135 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:08.130+0000 7f2158b26740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560acff3fa10 0x560acff64fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:37:08.135 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:08.130+0000 7f2158b26740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x560acff4fdb0 0x560acff5fa20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:37:08.135 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:08.130+0000 7f2158b26740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f21501aaae0 con 0x560acff4fdb0 2024-09-10T22:37:08.135 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:08.130+0000 7f2158b26740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f21501abf50 con 0x560acff3fa10 2024-09-10T22:37:08.135 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:08.130+0000 7f2158b26740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f21501ab1b0 con 0x560acff3f0f0 2024-09-10T22:37:08.135 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:08.131+0000 7f2158b26740 10 client.0 _ll_register_callbacks cb 0x7f21400e99f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T22:37:08.135 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:08.131+0000 7f2154cee640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x560acff4fdb0 0x560acff5fa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:37:08.135 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:08.131+0000 7f2154cee640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x560acff4fdb0 0x560acff5fa20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:46316/0 (socket says 172.21.15.19:46316) 2024-09-10T22:37:08.135 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:08.131+0000 7f2154cee640 1 -- 172.21.15.19:0/2408764799 learned_addr learned my addr 172.21.15.19:0/2408764799 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:37:08.135 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:08.131+0000 7f2147fff640 1 --2- 172.21.15.19:0/2408764799 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560acff3fa10 0x560acff64fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:37:08.136 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:08.132+0000 7f2154cee640 1 --2- 172.21.15.19:0/2408764799 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x560acff3f0f0 0x560acff64a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:37:08.136 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:08.132+0000 7f2147fff640 1 -- 172.21.15.19:0/2408764799 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x560acff3f0f0 msgr2=0x560acff64a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:37:08.136 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:08.132+0000 7f2147fff640 1 --2- 172.21.15.19:0/2408764799 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x560acff3f0f0 0x560acff64a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:37:08.136 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:08.132+0000 7f2147fff640 1 -- 172.21.15.19:0/2408764799 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x560acff4fdb0 msgr2=0x560acff5fa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:37:08.136 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:08.132+0000 7f2147fff640 1 --2- 172.21.15.19:0/2408764799 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x560acff4fdb0 0x560acff5fa20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:37:08.137 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:08.132+0000 7f2147fff640 1 -- 172.21.15.19:0/2408764799 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560acff657e0 con 0x560acff3fa10 2024-09-10T22:37:08.137 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:08.133+0000 7f2154cee640 1 --2- 172.21.15.19:0/2408764799 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x560acff3f0f0 0x560acff64a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T22:37:08.137 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:08.135+0000 7f2147fff640 1 --2- 172.21.15.19:0/2408764799 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560acff3fa10 0x560acff64fb0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x560acff3df40 tx=0x7f2138004410 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1e128d1aaf91fb4e server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:37:08.137 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:08.135+0000 7f212f7fe640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-09-10T22:37:08.138 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:08.136+0000 7f212f7fe640 1 -- 172.21.15.19:0/2408764799 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2138029060 con 0x560acff3fa10 2024-09-10T22:37:08.138 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:08.136+0000 7f212f7fe640 1 -- 172.21.15.19:0/2408764799 <== mon.2 v2:172.21.15.135:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8327+0+0 (secure 0 0 0) 0x7f2138010430 con 0x560acff3fa10 2024-09-10T22:37:08.138 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:08.136+0000 7f2158b26740 1 -- 172.21.15.19:0/2408764799 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2148063070 con 0x560acff3fa10 2024-09-10T22:37:08.139 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:08.137+0000 7f212f7fe640 1 -- 172.21.15.19:0/2408764799 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f2138005020 con 0x560acff3fa10 2024-09-10T22:37:08.139 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:08.137+0000 7f2158b26740 10 client.26804 fetch_fsmap learned FSMap version 27 2024-09-10T22:37:08.139 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:08.137+0000 7f2158b26740 1 -- 172.21.15.19:0/2408764799 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x560acffd0fc0 con 0x560acff3fa10 2024-09-10T22:37:08.140 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:08.137+0000 7f212f7fe640 1 -- 172.21.15.19:0/2408764799 <== mon.2 v2:172.21.15.135:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2148063070 con 0x560acff3fa10 2024-09-10T22:37:08.140 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:08.138+0000 7f212f7fe640 1 -- 172.21.15.19:0/2408764799 <== mon.2 v2:172.21.15.135:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7f2138023030 con 0x560acff3fa10 2024-09-10T22:37:08.140 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:08.138+0000 7f2158b26740 10 client.26804 fetch_fsmap finished waiting for FSMap version 27 2024-09-10T22:37:08.140 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:08.138+0000 7f2158b26740 10 client.26804 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-10T22:37:08.140 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:08.138+0000 7f2158b26740 20 client.26804 populate_metadata read hostname 'smithi019' 2024-09-10T22:37:08.140 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:08.138+0000 7f2158b26740 1 --2- 172.21.15.19:0/2408764799 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x560acffd16e0 0x560acffd3ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:37:08.141 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:08.138+0000 7f2158b26740 4 client.26804 mds_command: new command op to 24581 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-10T22:37:08.141 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:08.138+0000 7f2158b26740 1 -- 172.21.15.19:0/2408764799 --> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] -- command(tid 0: {"prefix": "damage ls"}) -- 0x560acfeb38a0 con 0x560acffd16e0 2024-09-10T22:37:08.141 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:08.139+0000 7f2154cee640 1 --2- 172.21.15.19:0/2408764799 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x560acffd16e0 0x560acffd3ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:37:08.142 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:08.140+0000 7f212f7fe640 10 client.26804 ms_handle_connect on v2:172.21.15.135:6838/1254769802 2024-09-10T22:37:08.142 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:08.140+0000 7f2154cee640 1 --2- 172.21.15.19:0/2408764799 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x560acffd16e0 0x560acffd3ad0 crc :-1 s=READY pgs=211 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3dd516c16a3e5b28 server_cookie=4e68d978d1991f01 in_seq=0 out_seq=0 2024-09-10T22:37:08.143 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:08.142+0000 7f212f7fe640 1 -- 172.21.15.19:0/2408764799 <== mds.0 v2:172.21.15.135:6838/1254769802 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x560acfeb38a0 con 0x560acffd16e0 2024-09-10T22:37:08.143 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:08.142+0000 7f212f7fe640 10 client.26804 handle_command_reply: tid=0 2024-09-10T22:37:08.144 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:08.142+0000 7f2158b26740 1 client.26804 shutdown 2024-09-10T22:37:08.145 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:08.142+0000 7f2158b26740 1 -- 172.21.15.19:0/2408764799 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560acff3fa10 msgr2=0x560acff64fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:37:08.145 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:08.142+0000 7f2158b26740 1 --2- 172.21.15.19:0/2408764799 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560acff3fa10 0x560acff64fb0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x560acff3df40 tx=0x7f2138004410 comp rx=0 tx=0).stop 2024-09-10T22:37:08.145 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:08.142+0000 7f2158b26740 1 -- 172.21.15.19:0/2408764799 shutdown_connections 2024-09-10T22:37:08.145 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:08.142+0000 7f2158b26740 1 --2- 172.21.15.19:0/2408764799 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x560acff4fdb0 0x560acff5fa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:37:08.145 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:08.142+0000 7f2158b26740 1 --2- 172.21.15.19:0/2408764799 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560acff3fa10 0x560acff64fb0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:37:08.145 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:08.142+0000 7f2158b26740 1 --2- 172.21.15.19:0/2408764799 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x560acffd16e0 0x560acffd3ad0 crc :-1 s=READY pgs=211 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:37:08.145 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:08.143+0000 7f2158b26740 1 --2- 172.21.15.19:0/2408764799 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x560acff3f0f0 0x560acff64a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:37:08.145 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:08.143+0000 7f212f7fe640 0 client.26804 ms_handle_reset on v2:172.21.15.135:6838/1254769802 2024-09-10T22:37:08.145 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:08.143+0000 7f2158b26740 1 -- 172.21.15.19:0/2408764799 >> 172.21.15.19:0/2408764799 conn(0x560acff3cf20 msgr2=0x560acff42230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:37:08.145 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:08.143+0000 7f2158b26740 1 -- 172.21.15.19:0/2408764799 shutdown_connections 2024-09-10T22:37:08.146 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:08.143+0000 7f2158b26740 1 -- 172.21.15.19:0/2408764799 wait complete. 2024-09-10T22:37:08.146 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:08.143+0000 7f2158b26740 20 client.26804 trim_cache size 0 max 16384 2024-09-10T22:37:08.146 INFO:teuthology.orchestra.run.smithi019.stdout:[] 2024-09-10T22:37:08.146 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:08.144+0000 7f2156751640 1 -- 172.21.15.19:0/744382835 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f213c0b52e0 msgr2=0x7f213c0b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:37:08.146 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:08.144+0000 7f2156751640 1 --2- 172.21.15.19:0/744382835 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f213c0b52e0 0x7f213c0b77a0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f214000cff0 tx=0x7f21400e9b20 comp rx=0 tx=0).stop 2024-09-10T22:37:08.146 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:08.144+0000 7f2156751640 1 -- 172.21.15.19:0/744382835 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2150102dc0 msgr2=0x7f2150199300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:37:08.146 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:08.144+0000 7f2156751640 1 --2- 172.21.15.19:0/744382835 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2150102dc0 0x7f2150199300 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f214000e9f0 tx=0x7f214000edf0 comp rx=0 tx=0).stop 2024-09-10T22:37:08.146 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:08.144+0000 7f2156751640 1 -- 172.21.15.19:0/744382835 shutdown_connections 2024-09-10T22:37:08.147 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:08.144+0000 7f2156751640 1 --2- 172.21.15.19:0/744382835 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f213c0b52e0 0x7f213c0b77a0 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:37:08.147 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:08.144+0000 7f2156751640 1 --2- 172.21.15.19:0/744382835 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f2150109150 0x7f215019ebe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:37:08.147 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:08.144+0000 7f2156751640 1 --2- 172.21.15.19:0/744382835 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f21501087d0 0x7f2150199840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:37:08.147 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:08.144+0000 7f2156751640 1 --2- 172.21.15.19:0/744382835 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2150102dc0 0x7f2150199300 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:37:08.147 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:08.144+0000 7f2156751640 1 -- 172.21.15.19:0/744382835 >> 172.21.15.19:0/744382835 conn(0x7f21500fe830 msgr2=0x7f2150100c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:37:08.147 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:08.145+0000 7f2156751640 1 -- 172.21.15.19:0/744382835 shutdown_connections 2024-09-10T22:37:08.147 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:08.145+0000 7f2156751640 1 -- 172.21.15.19:0/744382835 wait complete. 2024-09-10T22:37:08.610 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:37:08 smithi135 ceph-mon[34789]: pgmap v668: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 356 KiB/s rd, 203 MiB/s wr, 1.14k op/s 2024-09-10T22:37:08.625 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:37:08 smithi138 ceph-mon[35236]: pgmap v668: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 356 KiB/s rd, 203 MiB/s wr, 1.14k op/s 2024-09-10T22:37:08.708 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:37:08 smithi019 ceph-mon[31375]: pgmap v668: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 356 KiB/s rd, 203 MiB/s wr, 1.14k op/s 2024-09-10T22:37:09.904 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-10T22:37:09.905 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 22997a4c-6fc2-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-10T22:37:10.177 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/22997a4c-6fc2-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T22:37:10.575 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:37:10 smithi019 ceph-mon[31375]: pgmap v669: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 355 KiB/s rd, 165 MiB/s wr, 826 op/s 2024-09-10T22:37:10.625 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:37:10 smithi138 ceph-mon[35236]: pgmap v669: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 355 KiB/s rd, 165 MiB/s wr, 826 op/s 2024-09-10T22:37:10.857 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:10.832+0000 7fbf163ba640 1 -- 172.21.15.19:0/1601986758 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbf10101c90 msgr2=0x7fbf10102070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:37:10.858 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:10.832+0000 7fbf163ba640 1 --2- 172.21.15.19:0/1601986758 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbf10101c90 0x7fbf10102070 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 crypto rx=0x7fbf00009900 tx=0x7fbf0002a410 comp rx=0 tx=0).stop 2024-09-10T22:37:10.858 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:10.832+0000 7fbf163ba640 1 -- 172.21.15.19:0/1601986758 shutdown_connections 2024-09-10T22:37:10.858 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:10.832+0000 7fbf163ba640 1 --2- 172.21.15.19:0/1601986758 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbf10108020 0x7fbf1010e820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:37:10.858 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:10.832+0000 7fbf163ba640 1 --2- 172.21.15.19:0/1601986758 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fbf101076a0 0x7fbf10107ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:37:10.858 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:10.832+0000 7fbf163ba640 1 --2- 172.21.15.19:0/1601986758 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbf10101c90 0x7fbf10102070 unknown :-1 s=CLOSED pgs=842 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:37:10.858 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:10.832+0000 7fbf163ba640 1 -- 172.21.15.19:0/1601986758 >> 172.21.15.19:0/1601986758 conn(0x7fbf100fd700 msgr2=0x7fbf100ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:37:10.858 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:10.832+0000 7fbf163ba640 1 -- 172.21.15.19:0/1601986758 shutdown_connections 2024-09-10T22:37:10.858 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:10.832+0000 7fbf163ba640 1 -- 172.21.15.19:0/1601986758 wait complete. 2024-09-10T22:37:10.858 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:10.833+0000 7fbf163ba640 1 Processor -- start 2024-09-10T22:37:10.858 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:10.833+0000 7fbf163ba640 1 -- start start 2024-09-10T22:37:10.859 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:10.833+0000 7fbf163ba640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbf10101c90 0x7fbf10197ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:37:10.859 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:10.833+0000 7fbf163ba640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbf101076a0 0x7fbf101983e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:37:10.859 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:10.833+0000 7fbf163ba640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fbf10108020 0x7fbf1019cef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:37:10.859 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:10.833+0000 7fbf163ba640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fbf10111ce0 con 0x7fbf101076a0 2024-09-10T22:37:10.859 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:10.833+0000 7fbf163ba640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fbf10111b60 con 0x7fbf10101c90 2024-09-10T22:37:10.859 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:10.833+0000 7fbf163ba640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7fbf10111e60 con 0x7fbf10108020 2024-09-10T22:37:10.859 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:10.833+0000 7fbf0f7fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbf101076a0 0x7fbf101983e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:37:10.859 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:10.833+0000 7fbf0ffff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbf10101c90 0x7fbf10197ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:37:10.859 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:10.833+0000 7fbf0f7fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbf101076a0 0x7fbf101983e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:46328/0 (socket says 172.21.15.19:46328) 2024-09-10T22:37:10.859 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:10.833+0000 7fbf0f7fe640 1 -- 172.21.15.19:0/2451415879 learned_addr learned my addr 172.21.15.19:0/2451415879 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:37:10.859 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:10.833+0000 7fbf14957640 1 --2- 172.21.15.19:0/2451415879 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fbf10108020 0x7fbf1019cef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:37:10.860 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:10.834+0000 7fbf0ffff640 1 -- 172.21.15.19:0/2451415879 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fbf10108020 msgr2=0x7fbf1019cef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:37:10.860 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:10.834+0000 7fbf0ffff640 1 --2- 172.21.15.19:0/2451415879 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fbf10108020 0x7fbf1019cef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:37:10.860 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:10.834+0000 7fbf0ffff640 1 -- 172.21.15.19:0/2451415879 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbf101076a0 msgr2=0x7fbf101983e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:37:10.860 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:10.834+0000 7fbf0ffff640 1 --2- 172.21.15.19:0/2451415879 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbf101076a0 0x7fbf101983e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:37:10.860 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:10.834+0000 7fbf0ffff640 1 -- 172.21.15.19:0/2451415879 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbf1019d430 con 0x7fbf10101c90 2024-09-10T22:37:10.860 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:10.834+0000 7fbf14957640 1 --2- 172.21.15.19:0/2451415879 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fbf10108020 0x7fbf1019cef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T22:37:10.860 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:10.834+0000 7fbf0ffff640 1 --2- 172.21.15.19:0/2451415879 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbf10101c90 0x7fbf10197ea0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fbf0002a930 tx=0x7fbf00004270 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:37:10.860 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:10.834+0000 7fbf0d7fa640 1 -- 172.21.15.19:0/2451415879 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf0003f030 con 0x7fbf10101c90 2024-09-10T22:37:10.860 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:10.834+0000 7fbf0d7fa640 1 -- 172.21.15.19:0/2451415879 <== mon.2 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbf00003aa0 con 0x7fbf10101c90 2024-09-10T22:37:10.860 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:10.834+0000 7fbf163ba640 1 -- 172.21.15.19:0/2451415879 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbf1019d6c0 con 0x7fbf10101c90 2024-09-10T22:37:10.860 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:10.834+0000 7fbf0d7fa640 1 -- 172.21.15.19:0/2451415879 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf00035070 con 0x7fbf10101c90 2024-09-10T22:37:10.861 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:10.834+0000 7fbf163ba640 1 -- 172.21.15.19:0/2451415879 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbf1019dba0 con 0x7fbf10101c90 2024-09-10T22:37:10.861 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:10.837+0000 7fbf0d7fa640 1 -- 172.21.15.19:0/2451415879 <== mon.2 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 18) ==== 153250+0+0 (secure 0 0 0) 0x7fbf0003a3c0 con 0x7fbf10101c90 2024-09-10T22:37:10.861 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:10.837+0000 7fbf1878f740 1 Processor -- start 2024-09-10T22:37:10.861 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:10.837+0000 7fbf1878f740 1 -- start start 2024-09-10T22:37:10.861 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:10.838+0000 7fbf1878f740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563b561c9ee0 0x563b561ca2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:37:10.861 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:10.838+0000 7fbf1878f740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x563b561ca800 0x563b561d6250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:37:10.861 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:10.838+0000 7fbf1878f740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x563b561d6790 0x563b561d8b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:37:10.861 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:10.838+0000 7fbf1878f740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x563b56140e60 con 0x563b561ca800 2024-09-10T22:37:10.861 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:10.838+0000 7fbf1878f740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x563b56130290 con 0x563b561c9ee0 2024-09-10T22:37:10.861 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:10.838+0000 7fbf1878f740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x563b561340a0 con 0x563b561d6790 2024-09-10T22:37:10.861 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:10.838+0000 7fbf0ffff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x563b561ca800 0x563b561d6250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:37:10.862 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:10.838+0000 7fbf14957640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563b561c9ee0 0x563b561ca2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:37:10.862 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:10.838+0000 7fbf0ffff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x563b561ca800 0x563b561d6250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:46334/0 (socket says 172.21.15.19:46334) 2024-09-10T22:37:10.862 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:10.838+0000 7fbf0ffff640 1 -- 172.21.15.19:0/1554645599 learned_addr learned my addr 172.21.15.19:0/1554645599 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:37:10.862 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:10.838+0000 7fbf0f7fe640 1 --2- 172.21.15.19:0/1554645599 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x563b561d6790 0x563b561d8b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:37:10.862 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:10.838+0000 7fbf0ffff640 1 -- 172.21.15.19:0/1554645599 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x563b561d6790 msgr2=0x563b561d8b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:37:10.862 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:10.838+0000 7fbf0ffff640 1 --2- 172.21.15.19:0/1554645599 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x563b561d6790 0x563b561d8b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:37:10.862 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:10.838+0000 7fbf0ffff640 1 -- 172.21.15.19:0/1554645599 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563b561c9ee0 msgr2=0x563b561ca2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:37:10.862 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:10.838+0000 7fbf0ffff640 1 --2- 172.21.15.19:0/1554645599 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563b561c9ee0 0x563b561ca2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:37:10.862 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:10.838+0000 7fbf0ffff640 1 -- 172.21.15.19:0/1554645599 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563b55e8e930 con 0x563b561ca800 2024-09-10T22:37:10.862 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:10.838+0000 7fbf14957640 1 --2- 172.21.15.19:0/1554645599 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563b561c9ee0 0x563b561ca2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T22:37:10.862 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:10.838+0000 7fbf0d7fa640 1 --2- 172.21.15.19:0/2451415879 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7fbef80b52e0 0x7fbef80b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:37:10.863 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:10.839+0000 7fbf14957640 1 --2- 172.21.15.19:0/2451415879 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7fbef80b52e0 0x7fbef80b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:37:10.863 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:10.839+0000 7fbf0ffff640 1 --2- 172.21.15.19:0/1554645599 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x563b561ca800 0x563b561d6250 secure :-1 s=READY pgs=843 cs=0 l=1 rev1=1 crypto rx=0x7fbf0010c6e0 tx=0x7fbf0010c7d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2daf432ce40a242b server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:37:10.863 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:10.839+0000 7fbf0d7fa640 1 -- 172.21.15.19:0/2451415879 <== mon.2 v2:172.21.15.135:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8327+0+0 (secure 0 0 0) 0x7fbf001065b0 con 0x7fbf10101c90 2024-09-10T22:37:10.863 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:10.839+0000 7fbef67fc640 1 -- 172.21.15.19:0/1554645599 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf00049070 con 0x563b561ca800 2024-09-10T22:37:10.863 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:10.839+0000 7fbef67fc640 1 -- 172.21.15.19:0/1554645599 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbf000cc870 con 0x563b561ca800 2024-09-10T22:37:10.863 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:10.839+0000 7fbef67fc640 1 -- 172.21.15.19:0/1554645599 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf000c8c00 con 0x563b561ca800 2024-09-10T22:37:10.863 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:10.840+0000 7fbf1878f740 1 -- 172.21.15.19:0/1554645599 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x563b561ca800 msgr2=0x563b561d6250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:37:10.863 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:10.840+0000 7fbf14957640 1 --2- 172.21.15.19:0/2451415879 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7fbef80b52e0 0x7fbef80b77a0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7fbf08005fd0 tx=0x7fbf080096a0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:37:10.863 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:10.840+0000 7fbf1878f740 1 --2- 172.21.15.19:0/1554645599 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x563b561ca800 0x563b561d6250 secure :-1 s=READY pgs=843 cs=0 l=1 rev1=1 crypto rx=0x7fbf0010c6e0 tx=0x7fbf0010c7d0 comp rx=0 tx=0).stop 2024-09-10T22:37:10.863 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:10.840+0000 7fbf1878f740 1 -- 172.21.15.19:0/1554645599 shutdown_connections 2024-09-10T22:37:10.864 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:10.840+0000 7fbf1878f740 1 --2- 172.21.15.19:0/1554645599 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x563b561d6790 0x563b561d8b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:37:10.864 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:10.840+0000 7fbf1878f740 1 --2- 172.21.15.19:0/1554645599 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x563b561ca800 0x563b561d6250 unknown :-1 s=CLOSED pgs=843 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:37:10.864 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:10.840+0000 7fbf1878f740 1 --2- 172.21.15.19:0/1554645599 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563b561c9ee0 0x563b561ca2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:37:10.864 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:10.840+0000 7fbf1878f740 1 -- 172.21.15.19:0/1554645599 >> 172.21.15.19:0/1554645599 conn(0x563b561c7d10 msgr2=0x563b561c8eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:37:10.864 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:10.840+0000 7fbf1878f740 1 -- 172.21.15.19:0/1554645599 shutdown_connections 2024-09-10T22:37:10.864 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:10.840+0000 7fbf1878f740 1 -- 172.21.15.19:0/1554645599 wait complete. 2024-09-10T22:37:10.864 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:10.840+0000 7fbf1878f740 1 -- start start 2024-09-10T22:37:10.864 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:10.840+0000 7fbf1878f740 1 Processor -- start 2024-09-10T22:37:10.864 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:10.841+0000 7fbf1878f740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x563b561c9ee0 0x563b561d3740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:37:10.864 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:10.841+0000 7fbf1878f740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x563b561ca800 0x563b561d3c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:37:10.865 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:10.841+0000 7fbf1878f740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563b561d6790 0x563b561d41c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:37:10.865 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:10.841+0000 7fbf1878f740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x563b55f91890 con 0x563b561c9ee0 2024-09-10T22:37:10.865 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:10.841+0000 7fbf1878f740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x563b560cad40 con 0x563b561d6790 2024-09-10T22:37:10.865 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:10.841+0000 7fbf1878f740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x563b561d9200 con 0x563b561ca800 2024-09-10T22:37:10.865 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:10.841+0000 7fbf1878f740 10 client.0 _ll_register_callbacks cb 0x563b5612ec80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T22:37:10.865 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:10.841+0000 7fbf0ffff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x563b561c9ee0 0x563b561d3740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:37:10.865 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:10.841+0000 7fbf0ffff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x563b561c9ee0 0x563b561d3740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:46340/0 (socket says 172.21.15.19:46340) 2024-09-10T22:37:10.865 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:10.841+0000 7fbf0ffff640 1 -- 172.21.15.19:0/2572370791 learned_addr learned my addr 172.21.15.19:0/2572370791 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:37:10.865 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:10.841+0000 7fbf14957640 1 --2- 172.21.15.19:0/2572370791 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563b561d6790 0x563b561d41c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:37:10.865 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:10.841+0000 7fbf0f7fe640 1 --2- 172.21.15.19:0/2572370791 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x563b561ca800 0x563b561d3c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:37:10.865 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:10.841+0000 7fbf0ffff640 1 -- 172.21.15.19:0/2572370791 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x563b561ca800 msgr2=0x563b561d3c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:37:10.866 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:10.841+0000 7fbf0ffff640 1 --2- 172.21.15.19:0/2572370791 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x563b561ca800 0x563b561d3c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:37:10.866 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:10.841+0000 7fbf0ffff640 1 -- 172.21.15.19:0/2572370791 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563b561d6790 msgr2=0x563b561d41c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:37:10.866 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:10.841+0000 7fbf0ffff640 1 --2- 172.21.15.19:0/2572370791 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563b561d6790 0x563b561d41c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:37:10.866 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:10.841+0000 7fbf0ffff640 1 -- 172.21.15.19:0/2572370791 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563b561e2520 con 0x563b561c9ee0 2024-09-10T22:37:10.866 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:10.841+0000 7fbf0ffff640 1 --2- 172.21.15.19:0/2572370791 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x563b561c9ee0 0x563b561d3740 secure :-1 s=READY pgs=844 cs=0 l=1 rev1=1 crypto rx=0x7fbf0010c900 tx=0x7fbf00003f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d53670e87d8707e6 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:37:10.866 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:10.841+0000 7fbeef7fe640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-10T22:37:10.866 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:10.841+0000 7fbeef7fe640 1 -- 172.21.15.19:0/2572370791 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf00049070 con 0x563b561c9ee0 2024-09-10T22:37:10.866 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:10.842+0000 7fbeef7fe640 1 -- 172.21.15.19:0/2572370791 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8327+0+0 (secure 0 0 0) 0x7fbf00104100 con 0x563b561c9ee0 2024-09-10T22:37:10.866 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:10.842+0000 7fbf1878f740 1 -- 172.21.15.19:0/2572370791 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbf000cc870 con 0x563b561c9ee0 2024-09-10T22:37:10.866 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:10.842+0000 7fbeef7fe640 1 -- 172.21.15.19:0/2572370791 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fbf000cc4d0 con 0x563b561c9ee0 2024-09-10T22:37:10.866 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:10.842+0000 7fbf1878f740 10 client.17517 fetch_fsmap learned FSMap version 27 2024-09-10T22:37:10.867 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:10.842+0000 7fbf1878f740 1 -- 172.21.15.19:0/2572370791 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x563b561e4eb0 con 0x563b561c9ee0 2024-09-10T22:37:10.867 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:10.842+0000 7fbeef7fe640 1 -- 172.21.15.19:0/2572370791 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbf000cc870 con 0x563b561c9ee0 2024-09-10T22:37:10.867 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:10.842+0000 7fbeef7fe640 1 -- 172.21.15.19:0/2572370791 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7fbf000ccfc0 con 0x563b561c9ee0 2024-09-10T22:37:10.867 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:10.842+0000 7fbf1878f740 10 client.17517 fetch_fsmap finished waiting for FSMap version 27 2024-09-10T22:37:10.867 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:10.842+0000 7fbf1878f740 10 client.17517 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-10T22:37:10.867 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:10.842+0000 7fbf1878f740 20 client.17517 populate_metadata read hostname 'smithi019' 2024-09-10T22:37:10.867 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:10.842+0000 7fbf1878f740 1 --2- 172.21.15.19:0/2572370791 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x563b561e6200 0x563b561e85f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:37:10.867 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:10.842+0000 7fbf1878f740 4 client.17517 mds_command: new command op to 24581 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T22:37:10.868 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:10.842+0000 7fbf1878f740 1 -- 172.21.15.19:0/2572370791 --> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x563b56142db0 con 0x563b561e6200 2024-09-10T22:37:10.868 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:10.842+0000 7fbf0f7fe640 1 --2- 172.21.15.19:0/2572370791 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x563b561e6200 0x563b561e85f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:37:10.868 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:10.843+0000 7fbeef7fe640 10 client.17517 ms_handle_connect on v2:172.21.15.135:6838/1254769802 2024-09-10T22:37:10.868 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:10.843+0000 7fbf0f7fe640 1 --2- 172.21.15.19:0/2572370791 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x563b561e6200 0x563b561e85f0 crc :-1 s=READY pgs=212 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d63b40ebbf5cf475 server_cookie=7b2b2424adf92848 in_seq=0 out_seq=0 2024-09-10T22:37:10.868 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:10.843+0000 7fbeef7fe640 1 -- 172.21.15.19:0/2572370791 <== mds.0 v2:172.21.15.135:6838/1254769802 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x563b56142db0 con 0x563b561e6200 2024-09-10T22:37:10.868 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:10.843+0000 7fbeef7fe640 10 client.17517 handle_command_reply: tid=0 2024-09-10T22:37:10.868 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:10.843+0000 7fbf1878f740 1 client.17517 shutdown 2024-09-10T22:37:10.868 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:10.844+0000 7fbf1878f740 1 -- 172.21.15.19:0/2572370791 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x563b561c9ee0 msgr2=0x563b561d3740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:37:10.868 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:10.844+0000 7fbf1878f740 1 --2- 172.21.15.19:0/2572370791 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x563b561c9ee0 0x563b561d3740 secure :-1 s=READY pgs=844 cs=0 l=1 rev1=1 crypto rx=0x7fbf0010c900 tx=0x7fbf00003f50 comp rx=0 tx=0).stop 2024-09-10T22:37:10.868 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:10.844+0000 7fbf1878f740 1 -- 172.21.15.19:0/2572370791 shutdown_connections 2024-09-10T22:37:10.868 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:10.844+0000 7fbf1878f740 1 --2- 172.21.15.19:0/2572370791 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563b561d6790 0x563b561d41c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:37:10.869 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:10.844+0000 7fbf1878f740 1 --2- 172.21.15.19:0/2572370791 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x563b561e6200 0x563b561e85f0 crc :-1 s=READY pgs=212 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:37:10.869 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:10.844+0000 7fbf1878f740 1 --2- 172.21.15.19:0/2572370791 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x563b561ca800 0x563b561d3c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:37:10.869 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:10.844+0000 7fbf1878f740 1 --2- 172.21.15.19:0/2572370791 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x563b561c9ee0 0x563b561d3740 unknown :-1 s=CLOSED pgs=844 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:37:10.869 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:10.844+0000 7fbf1878f740 1 -- 172.21.15.19:0/2572370791 >> 172.21.15.19:0/2572370791 conn(0x563b561c7d10 msgr2=0x563b561c6f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:37:10.869 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:10.844+0000 7fbeef7fe640 0 client.17517 ms_handle_reset on v2:172.21.15.135:6838/1254769802 2024-09-10T22:37:10.869 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:10.844+0000 7fbf1878f740 1 -- 172.21.15.19:0/2572370791 shutdown_connections 2024-09-10T22:37:10.869 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:10.844+0000 7fbf1878f740 1 -- 172.21.15.19:0/2572370791 wait complete. 2024-09-10T22:37:10.869 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:10.844+0000 7fbf1878f740 20 client.17517 trim_cache size 0 max 16384 2024-09-10T22:37:10.870 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:37:10 smithi135 ceph-mon[34789]: pgmap v669: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 355 KiB/s rd, 165 MiB/s wr, 826 op/s 2024-09-10T22:37:10.875 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:10.863+0000 7fbf1878f740 1 Processor -- start 2024-09-10T22:37:10.875 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:10.863+0000 7fbf1878f740 1 -- start start 2024-09-10T22:37:10.876 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:10.863+0000 7fbf1878f740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x563b561c9ee0 0x563b561d3c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:37:10.876 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:10.863+0000 7fbf1878f740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563b561ca800 0x563b561d4180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:37:10.876 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:10.863+0000 7fbf1878f740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x563b561d6790 0x563b561d0970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:37:10.876 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:10.863+0000 7fbf1878f740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fbf101b7460 con 0x563b561c9ee0 2024-09-10T22:37:10.876 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:10.863+0000 7fbf1878f740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fbf101b4d30 con 0x563b561ca800 2024-09-10T22:37:10.876 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:10.863+0000 7fbf1878f740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7fbf101b2b80 con 0x563b561d6790 2024-09-10T22:37:10.876 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:10.864+0000 7fbf0ffff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x563b561c9ee0 0x563b561d3c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:37:10.876 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:10.864+0000 7fbf0f7fe640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563b561ca800 0x563b561d4180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:37:10.876 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:10.864+0000 7fbf14957640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x563b561d6790 0x563b561d0970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:37:10.876 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:10.864+0000 7fbf0ffff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x563b561c9ee0 0x563b561d3c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:46352/0 (socket says 172.21.15.19:46352) 2024-09-10T22:37:10.876 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:10.864+0000 7fbf0f7fe640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563b561ca800 0x563b561d4180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.19:40614/0 (socket says 172.21.15.19:40614) 2024-09-10T22:37:10.877 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:10.864+0000 7fbf0ffff640 1 -- 172.21.15.19:0/2301740651 learned_addr learned my addr 172.21.15.19:0/2301740651 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:37:10.877 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:10.864+0000 7fbf0ffff640 1 -- 172.21.15.19:0/2301740651 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x563b561d6790 msgr2=0x563b561d0970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:37:10.877 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:10.864+0000 7fbf0ffff640 1 --2- 172.21.15.19:0/2301740651 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x563b561d6790 0x563b561d0970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:37:10.877 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:10.864+0000 7fbf0ffff640 1 -- 172.21.15.19:0/2301740651 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563b561ca800 msgr2=0x563b561d4180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:37:10.877 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:10.864+0000 7fbf0ffff640 1 --2- 172.21.15.19:0/2301740651 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563b561ca800 0x563b561d4180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:37:10.877 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:10.864+0000 7fbf0ffff640 1 -- 172.21.15.19:0/2301740651 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563b561c7b40 con 0x563b561c9ee0 2024-09-10T22:37:10.877 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:10.864+0000 7fbf14957640 1 --2- 172.21.15.19:0/2301740651 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x563b561d6790 0x563b561d0970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T22:37:10.877 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:10.864+0000 7fbf0f7fe640 1 --2- 172.21.15.19:0/2301740651 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563b561ca800 0x563b561d4180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T22:37:10.877 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:10.864+0000 7fbf0ffff640 1 --2- 172.21.15.19:0/2301740651 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x563b561c9ee0 0x563b561d3c40 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 crypto rx=0x7fbf000c9330 tx=0x7fbf0003b6b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7cf2cc37dcb17899 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:37:10.877 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:10.864+0000 7fbef5ffb640 1 -- 172.21.15.19:0/2301740651 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf00049070 con 0x563b561c9ee0 2024-09-10T22:37:10.877 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:10.864+0000 7fbef5ffb640 1 -- 172.21.15.19:0/2301740651 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbf00109dc0 con 0x563b561c9ee0 2024-09-10T22:37:10.878 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:10.864+0000 7fbef5ffb640 1 -- 172.21.15.19:0/2301740651 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf000cc6b0 con 0x563b561c9ee0 2024-09-10T22:37:10.878 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:10.865+0000 7fbf1878f740 1 -- 172.21.15.19:0/2301740651 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x563b561c9ee0 msgr2=0x563b561d3c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:37:10.878 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:10.865+0000 7fbf1878f740 1 --2- 172.21.15.19:0/2301740651 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x563b561c9ee0 0x563b561d3c40 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 crypto rx=0x7fbf000c9330 tx=0x7fbf0003b6b0 comp rx=0 tx=0).stop 2024-09-10T22:37:10.878 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:10.865+0000 7fbf1878f740 1 -- 172.21.15.19:0/2301740651 shutdown_connections 2024-09-10T22:37:10.878 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:10.865+0000 7fbf1878f740 1 --2- 172.21.15.19:0/2301740651 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x563b561d6790 0x563b561d0970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:37:10.878 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:10.865+0000 7fbf1878f740 1 --2- 172.21.15.19:0/2301740651 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563b561ca800 0x563b561d4180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:37:10.878 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:10.865+0000 7fbf1878f740 1 --2- 172.21.15.19:0/2301740651 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x563b561c9ee0 0x563b561d3c40 unknown :-1 s=CLOSED pgs=845 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:37:10.878 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:10.865+0000 7fbf1878f740 1 -- 172.21.15.19:0/2301740651 >> 172.21.15.19:0/2301740651 conn(0x563b561c7d10 msgr2=0x563b561d5590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:37:10.878 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:10.865+0000 7fbf1878f740 1 -- 172.21.15.19:0/2301740651 shutdown_connections 2024-09-10T22:37:10.878 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:10.865+0000 7fbf1878f740 1 -- 172.21.15.19:0/2301740651 wait complete. 2024-09-10T22:37:10.878 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:10.866+0000 7fbf1878f740 1 -- start start 2024-09-10T22:37:10.879 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:10.866+0000 7fbf1878f740 1 Processor -- start 2024-09-10T22:37:10.879 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:10.866+0000 7fbf1878f740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563b561c9ee0 0x563b561de820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:37:10.879 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:10.866+0000 7fbf1878f740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x563b561ca800 0x563b561deda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:37:10.879 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:10.866+0000 7fbf1878f740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x563b561d6790 0x563b561db5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:37:10.879 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:10.866+0000 7fbf1878f740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fbf101b31f0 con 0x563b561d6790 2024-09-10T22:37:10.879 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:10.866+0000 7fbf1878f740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fbf101b4660 con 0x563b561c9ee0 2024-09-10T22:37:10.879 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:10.866+0000 7fbf1878f740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7fbf101b38c0 con 0x563b561ca800 2024-09-10T22:37:10.879 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:10.866+0000 7fbf1878f740 10 client.0 _ll_register_callbacks cb 0x7fbf08009e90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T22:37:10.879 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:10.866+0000 7fbf0ffff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563b561c9ee0 0x563b561de820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:37:10.879 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:10.866+0000 7fbf0ffff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563b561c9ee0 0x563b561de820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.19:40626/0 (socket says 172.21.15.19:40626) 2024-09-10T22:37:10.880 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:10.867+0000 7fbf0ffff640 1 -- 172.21.15.19:0/3596237529 learned_addr learned my addr 172.21.15.19:0/3596237529 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:37:10.880 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:10.867+0000 7fbf14957640 1 --2- 172.21.15.19:0/3596237529 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x563b561d6790 0x563b561db5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:37:10.880 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:10.867+0000 7fbf0f7fe640 1 --2- 172.21.15.19:0/3596237529 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x563b561ca800 0x563b561deda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:37:10.880 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:10.867+0000 7fbf0ffff640 1 -- 172.21.15.19:0/3596237529 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x563b561ca800 msgr2=0x563b561deda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:37:10.880 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:10.867+0000 7fbf0ffff640 1 --2- 172.21.15.19:0/3596237529 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x563b561ca800 0x563b561deda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:37:10.880 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:10.867+0000 7fbf0ffff640 1 -- 172.21.15.19:0/3596237529 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x563b561d6790 msgr2=0x563b561db5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:37:10.880 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:10.867+0000 7fbf0ffff640 1 --2- 172.21.15.19:0/3596237529 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x563b561d6790 0x563b561db5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:37:10.880 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:10.867+0000 7fbf0ffff640 1 -- 172.21.15.19:0/3596237529 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563b561dbdb0 con 0x563b561c9ee0 2024-09-10T22:37:10.880 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:10.867+0000 7fbf0f7fe640 1 --2- 172.21.15.19:0/3596237529 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x563b561ca800 0x563b561deda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T22:37:10.880 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:10.867+0000 7fbf14957640 1 --2- 172.21.15.19:0/3596237529 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x563b561d6790 0x563b561db5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T22:37:10.880 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:10.867+0000 7fbf0ffff640 1 --2- 172.21.15.19:0/3596237529 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563b561c9ee0 0x563b561de820 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fbf00009320 tx=0x7fbf0010c7d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ea542c4c4f037477 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:37:10.881 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:10.867+0000 7fbeef7fe640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-09-10T22:37:10.881 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:10.867+0000 7fbeef7fe640 1 -- 172.21.15.19:0/3596237529 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf00049070 con 0x563b561c9ee0 2024-09-10T22:37:10.881 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:10.867+0000 7fbeef7fe640 1 -- 172.21.15.19:0/3596237529 <== mon.2 v2:172.21.15.135:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8327+0+0 (secure 0 0 0) 0x7fbf000d5db0 con 0x563b561c9ee0 2024-09-10T22:37:10.881 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:10.867+0000 7fbf1878f740 1 -- 172.21.15.19:0/3596237529 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbf00109dc0 con 0x563b561c9ee0 2024-09-10T22:37:10.881 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:10.867+0000 7fbeef7fe640 1 -- 172.21.15.19:0/3596237529 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fbf000ccb30 con 0x563b561c9ee0 2024-09-10T22:37:10.881 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:10.868+0000 7fbf1878f740 10 client.26822 fetch_fsmap learned FSMap version 27 2024-09-10T22:37:10.881 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:10.868+0000 7fbf1878f740 1 -- 172.21.15.19:0/3596237529 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x563b561dbdb0 con 0x563b561c9ee0 2024-09-10T22:37:10.881 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:10.868+0000 7fbeef7fe640 1 -- 172.21.15.19:0/3596237529 <== mon.2 v2:172.21.15.135:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbf00109dc0 con 0x563b561c9ee0 2024-09-10T22:37:10.881 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:10.868+0000 7fbeef7fe640 1 -- 172.21.15.19:0/3596237529 <== mon.2 v2:172.21.15.135:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7fbf0010c1b0 con 0x563b561c9ee0 2024-09-10T22:37:10.881 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:10.868+0000 7fbf1878f740 10 client.26822 fetch_fsmap finished waiting for FSMap version 27 2024-09-10T22:37:10.881 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:10.868+0000 7fbf1878f740 10 client.26822 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-10T22:37:10.882 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:10.868+0000 7fbf1878f740 20 client.26822 populate_metadata read hostname 'smithi019' 2024-09-10T22:37:10.882 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:10.868+0000 7fbf1878f740 1 --2- 172.21.15.19:0/3596237529 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x563b56253f10 0x563b56256330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:37:10.882 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:10.868+0000 7fbf1878f740 4 client.26822 mds_command: new command op to 24581 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-10T22:37:10.882 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:10.868+0000 7fbf1878f740 1 -- 172.21.15.19:0/3596237529 --> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x563b5613e860 con 0x563b56253f10 2024-09-10T22:37:10.882 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:10.868+0000 7fbf0f7fe640 1 --2- 172.21.15.19:0/3596237529 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x563b56253f10 0x563b56256330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:37:10.882 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:10.869+0000 7fbeef7fe640 10 client.26822 ms_handle_connect on v2:172.21.15.135:6838/1254769802 2024-09-10T22:37:10.882 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:10.869+0000 7fbf0f7fe640 1 --2- 172.21.15.19:0/3596237529 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x563b56253f10 0x563b56256330 crc :-1 s=READY pgs=213 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2426656e990185d2 server_cookie=d217347c1a9407d5 in_seq=0 out_seq=0 2024-09-10T22:37:10.882 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:10.870+0000 7fbeef7fe640 1 -- 172.21.15.19:0/3596237529 <== mds.0 v2:172.21.15.135:6838/1254769802 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x563b5613e860 con 0x563b56253f10 2024-09-10T22:37:10.882 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:10.870+0000 7fbeef7fe640 10 client.26822 handle_command_reply: tid=0 2024-09-10T22:37:10.882 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:10.870+0000 7fbf1878f740 1 client.26822 shutdown 2024-09-10T22:37:10.882 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:10.870+0000 7fbf1878f740 1 -- 172.21.15.19:0/3596237529 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563b561c9ee0 msgr2=0x563b561de820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:37:10.883 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:10.870+0000 7fbf1878f740 1 --2- 172.21.15.19:0/3596237529 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563b561c9ee0 0x563b561de820 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fbf00009320 tx=0x7fbf0010c7d0 comp rx=0 tx=0).stop 2024-09-10T22:37:10.883 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:10.870+0000 7fbf1878f740 1 -- 172.21.15.19:0/3596237529 shutdown_connections 2024-09-10T22:37:10.883 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:10.870+0000 7fbf1878f740 1 --2- 172.21.15.19:0/3596237529 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x563b561d6790 0x563b561db5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:37:10.883 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:10.870+0000 7fbf1878f740 1 --2- 172.21.15.19:0/3596237529 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x563b56253f10 0x563b56256330 crc :-1 s=READY pgs=213 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:37:10.883 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:10.870+0000 7fbf1878f740 1 --2- 172.21.15.19:0/3596237529 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x563b561ca800 0x563b561deda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:37:10.883 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:10.870+0000 7fbf1878f740 1 --2- 172.21.15.19:0/3596237529 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563b561c9ee0 0x563b561de820 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:37:10.883 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:10.870+0000 7fbf1878f740 1 -- 172.21.15.19:0/3596237529 >> 172.21.15.19:0/3596237529 conn(0x563b561c7d10 msgr2=0x563b561e13e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:37:10.883 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:10.870+0000 7fbeef7fe640 0 client.26822 ms_handle_reset on v2:172.21.15.135:6838/1254769802 2024-09-10T22:37:10.883 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:10.871+0000 7fbf1878f740 1 -- 172.21.15.19:0/3596237529 shutdown_connections 2024-09-10T22:37:10.883 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:10.871+0000 7fbf1878f740 1 -- 172.21.15.19:0/3596237529 wait complete. 2024-09-10T22:37:10.883 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:10.871+0000 7fbf1878f740 20 client.26822 trim_cache size 0 max 16384 2024-09-10T22:37:10.884 INFO:teuthology.orchestra.run.smithi019.stdout:{ 2024-09-10T22:37:10.884 INFO:teuthology.orchestra.run.smithi019.stdout: "return_code": 0, 2024-09-10T22:37:10.884 INFO:teuthology.orchestra.run.smithi019.stdout: "scrub_tag": "97894c69-c36c-4d46-9917-57199df72044", 2024-09-10T22:37:10.884 INFO:teuthology.orchestra.run.smithi019.stdout: "mode": "asynchronous" 2024-09-10T22:37:10.884 INFO:teuthology.orchestra.run.smithi019.stdout:} 2024-09-10T22:37:10.885 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:10.871+0000 7fbf163ba640 1 -- 172.21.15.19:0/2451415879 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7fbef80b52e0 msgr2=0x7fbef80b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:37:10.885 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:10.871+0000 7fbf163ba640 1 --2- 172.21.15.19:0/2451415879 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7fbef80b52e0 0x7fbef80b77a0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7fbf08005fd0 tx=0x7fbf080096a0 comp rx=0 tx=0).stop 2024-09-10T22:37:10.885 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:10.871+0000 7fbf163ba640 1 -- 172.21.15.19:0/2451415879 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbf10101c90 msgr2=0x7fbf10197ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:37:10.885 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:10.871+0000 7fbf163ba640 1 --2- 172.21.15.19:0/2451415879 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbf10101c90 0x7fbf10197ea0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fbf0002a930 tx=0x7fbf00004270 comp rx=0 tx=0).stop 2024-09-10T22:37:10.885 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:10.872+0000 7fbf163ba640 1 -- 172.21.15.19:0/2451415879 shutdown_connections 2024-09-10T22:37:10.885 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:10.872+0000 7fbf163ba640 1 --2- 172.21.15.19:0/2451415879 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7fbef80b52e0 0x7fbef80b77a0 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:37:10.885 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:10.872+0000 7fbf163ba640 1 --2- 172.21.15.19:0/2451415879 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fbf10108020 0x7fbf1019cef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:37:10.885 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:10.872+0000 7fbf163ba640 1 --2- 172.21.15.19:0/2451415879 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbf101076a0 0x7fbf101983e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:37:10.885 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:10.872+0000 7fbf163ba640 1 --2- 172.21.15.19:0/2451415879 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbf10101c90 0x7fbf10197ea0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:37:10.885 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:10.872+0000 7fbf163ba640 1 -- 172.21.15.19:0/2451415879 >> 172.21.15.19:0/2451415879 conn(0x7fbf100fd700 msgr2=0x7fbf100ffaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:37:10.886 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:10.872+0000 7fbf163ba640 1 -- 172.21.15.19:0/2451415879 shutdown_connections 2024-09-10T22:37:10.886 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:10.872+0000 7fbf163ba640 1 -- 172.21.15.19:0/2451415879 wait complete. 2024-09-10T22:37:11.262 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:37:11.259+0000 7f06b1ffb640 1 -- 172.21.15.19:0/1190076842 <== mds.0 v2:172.21.15.135:6838/1254769802 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5574e9bca0f0 con 0x5574e9c73980 2024-09-10T22:37:11.262 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:37:11.259+0000 7f06b1ffb640 10 client.26803 handle_command_reply: tid=0 2024-09-10T22:37:11.262 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:37:11.259+0000 7f06d32bb740 1 client.26803 shutdown 2024-09-10T22:37:11.262 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:37:11.260+0000 7f06d32bb740 1 -- 172.21.15.19:0/1190076842 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5574e9c55c40 msgr2=0x5574e9c6b880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:37:11.263 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:37:11.260+0000 7f06d32bb740 1 --2- 172.21.15.19:0/1190076842 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5574e9c55c40 0x5574e9c6b880 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x5574e9c765c0 tx=0x7f06b8012e30 comp rx=0 tx=0).stop 2024-09-10T22:37:11.263 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:37:11.260+0000 7f06d32bb740 1 -- 172.21.15.19:0/1190076842 shutdown_connections 2024-09-10T22:37:11.263 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:37:11.260+0000 7f06d32bb740 1 --2- 172.21.15.19:0/1190076842 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5574e9c56600 0x5574e9c6bdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:37:11.263 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:37:11.260+0000 7f06d32bb740 1 --2- 172.21.15.19:0/1190076842 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x5574e9c73980 0x5574e9ce3160 crc :-1 s=READY pgs=209 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:37:11.263 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:37:11.260+0000 7f06d32bb740 1 --2- 172.21.15.19:0/1190076842 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x5574e9c55c40 0x5574e9c6b880 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:37:11.263 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:37:11.260+0000 7f06d32bb740 1 --2- 172.21.15.19:0/1190076842 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5574e9c55300 0x5574e9c6fae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:37:11.263 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:37:11.260+0000 7f06d32bb740 1 -- 172.21.15.19:0/1190076842 >> 172.21.15.19:0/1190076842 conn(0x5574e9c57bc0 msgr2=0x5574e9c54bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:37:11.263 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:37:11.260+0000 7f06b1ffb640 0 client.26803 ms_handle_reset on v2:172.21.15.135:6838/1254769802 2024-09-10T22:37:11.263 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:37:11.260+0000 7f06d32bb740 1 -- 172.21.15.19:0/1190076842 shutdown_connections 2024-09-10T22:37:11.263 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:37:11.260+0000 7f06d32bb740 1 -- 172.21.15.19:0/1190076842 wait complete. 2024-09-10T22:37:11.263 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:37:11.260+0000 7f06d32bb740 20 client.26803 trim_cache size 0 max 16384 2024-09-10T22:37:11.264 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stdout:{ 2024-09-10T22:37:11.264 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stdout: "message": "", 2024-09-10T22:37:11.264 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stdout: "return_code": 0 2024-09-10T22:37:11.264 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stdout:} 2024-09-10T22:37:11.264 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:37:11.261+0000 7f06d04e6640 1 -- 172.21.15.19:0/2758579244 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f06b40b52e0 msgr2=0x7f06b40b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:37:11.265 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:37:11.261+0000 7f06d04e6640 1 --2- 172.21.15.19:0/2758579244 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f06b40b52e0 0x7f06b40b77a0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f06c4109fd0 tx=0x7f06c4109e60 comp rx=0 tx=0).stop 2024-09-10T22:37:11.265 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:37:11.261+0000 7f06d04e6640 1 -- 172.21.15.19:0/2758579244 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f06c8101860 msgr2=0x7f06c8197cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:37:11.265 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:37:11.261+0000 7f06d04e6640 1 --2- 172.21.15.19:0/2758579244 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f06c8101860 0x7f06c8197cd0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f06c4009230 tx=0x7f06c40042f0 comp rx=0 tx=0).stop 2024-09-10T22:37:11.265 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:37:11.261+0000 7f06d04e6640 1 -- 172.21.15.19:0/2758579244 shutdown_connections 2024-09-10T22:37:11.265 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:37:11.261+0000 7f06d04e6640 1 --2- 172.21.15.19:0/2758579244 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f06b40b52e0 0x7f06b40b77a0 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:37:11.265 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:37:11.261+0000 7f06d04e6640 1 --2- 172.21.15.19:0/2758579244 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f06c8103370 0x7f06c8198f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:37:11.265 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:37:11.261+0000 7f06d04e6640 1 --2- 172.21.15.19:0/2758579244 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f06c81029b0 0x7f06c8198320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:37:11.265 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:37:11.261+0000 7f06d04e6640 1 --2- 172.21.15.19:0/2758579244 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f06c8101860 0x7f06c8197cd0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:37:11.265 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:37:11.261+0000 7f06d04e6640 1 -- 172.21.15.19:0/2758579244 >> 172.21.15.19:0/2758579244 conn(0x7f06c80fd140 msgr2=0x7f06c8105dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:37:11.265 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:37:11.261+0000 7f06d04e6640 1 -- 172.21.15.19:0/2758579244 shutdown_connections 2024-09-10T22:37:11.265 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-10T22:37:11.261+0000 7f06d04e6640 1 -- 172.21.15.19:0/2758579244 wait complete. 2024-09-10T22:37:11.706 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 22997a4c-6fc2-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-10T22:37:11.709 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:37:11 smithi019 ceph-mon[31375]: pgmap v670: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 543 KiB/s rd, 204 MiB/s wr, 813 op/s 2024-09-10T22:37:11.875 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:37:11 smithi138 ceph-mon[35236]: pgmap v670: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 543 KiB/s rd, 204 MiB/s wr, 813 op/s 2024-09-10T22:37:12.026 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/22997a4c-6fc2-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T22:37:12.110 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:37:11 smithi135 ceph-mon[34789]: pgmap v670: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 543 KiB/s rd, 204 MiB/s wr, 813 op/s 2024-09-10T22:37:12.588 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:12.585+0000 7f3e1ed9b640 1 -- 172.21.15.19:0/68399922 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3e18103ca0 msgr2=0x7f3e18104080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:37:12.589 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:12.585+0000 7f3e1ed9b640 1 --2- 172.21.15.19:0/68399922 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3e18103ca0 0x7f3e18104080 secure :-1 s=READY pgs=846 cs=0 l=1 rev1=1 crypto rx=0x7f3e0c009900 tx=0x7f3e0c02a440 comp rx=0 tx=0).stop 2024-09-10T22:37:12.589 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:12.585+0000 7f3e1ed9b640 1 -- 172.21.15.19:0/68399922 shutdown_connections 2024-09-10T22:37:12.589 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:12.585+0000 7f3e1ed9b640 1 --2- 172.21.15.19:0/68399922 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3e1810d100 0x7f3e1810f560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:37:12.589 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:12.585+0000 7f3e1ed9b640 1 --2- 172.21.15.19:0/68399922 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3e181045c0 0x7f3e1810cab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:37:12.589 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:12.585+0000 7f3e1ed9b640 1 --2- 172.21.15.19:0/68399922 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3e18103ca0 0x7f3e18104080 unknown :-1 s=CLOSED pgs=846 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:37:12.589 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:12.585+0000 7f3e1ed9b640 1 -- 172.21.15.19:0/68399922 >> 172.21.15.19:0/68399922 conn(0x7f3e180fd700 msgr2=0x7f3e180ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:37:12.589 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:12.585+0000 7f3e1ed9b640 1 -- 172.21.15.19:0/68399922 shutdown_connections 2024-09-10T22:37:12.589 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:12.585+0000 7f3e1ed9b640 1 -- 172.21.15.19:0/68399922 wait complete. 2024-09-10T22:37:12.589 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:12.586+0000 7f3e1ed9b640 1 Processor -- start 2024-09-10T22:37:12.589 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:12.586+0000 7f3e1ed9b640 1 -- start start 2024-09-10T22:37:12.589 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:12.586+0000 7f3e1ed9b640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3e18103ca0 0x7f3e18101950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:37:12.589 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:12.586+0000 7f3e1ed9b640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3e181045c0 0x7f3e18101e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:37:12.590 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:12.586+0000 7f3e1ed9b640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3e1810d100 0x7f3e181023d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:37:12.590 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:12.586+0000 7f3e1ed9b640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f3e18112e70 con 0x7f3e18103ca0 2024-09-10T22:37:12.590 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:12.586+0000 7f3e1ed9b640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f3e18112cf0 con 0x7f3e1810d100 2024-09-10T22:37:12.590 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:12.586+0000 7f3e1ed9b640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f3e18112ff0 con 0x7f3e181045c0 2024-09-10T22:37:12.590 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:12.586+0000 7f3e1cb37640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3e18103ca0 0x7f3e18101950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:37:12.590 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:12.586+0000 7f3e1cb37640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3e18103ca0 0x7f3e18101950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:46386/0 (socket says 172.21.15.19:46386) 2024-09-10T22:37:12.590 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:12.586+0000 7f3e1cb37640 1 -- 172.21.15.19:0/2889052315 learned_addr learned my addr 172.21.15.19:0/2889052315 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:37:12.590 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:12.587+0000 7f3e1cb37640 1 -- 172.21.15.19:0/2889052315 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3e181045c0 msgr2=0x7f3e18101e90 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-10T22:37:12.590 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:12.587+0000 7f3e1cb37640 1 --2- 172.21.15.19:0/2889052315 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3e181045c0 0x7f3e18101e90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:37:12.590 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:12.587+0000 7f3e1cb37640 1 -- 172.21.15.19:0/2889052315 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3e1810d100 msgr2=0x7f3e181023d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:37:12.590 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:12.587+0000 7f3e1cb37640 1 --2- 172.21.15.19:0/2889052315 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3e1810d100 0x7f3e181023d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:37:12.590 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:12.587+0000 7f3e1cb37640 1 -- 172.21.15.19:0/2889052315 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3e181a7860 con 0x7f3e18103ca0 2024-09-10T22:37:12.591 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:12.587+0000 7f3e1cb37640 1 --2- 172.21.15.19:0/2889052315 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3e18103ca0 0x7f3e18101950 secure :-1 s=READY pgs=847 cs=0 l=1 rev1=1 crypto rx=0x7f3e0c005940 tx=0x7f3e0c004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:37:12.591 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:12.587+0000 7f3e15ffb640 1 -- 172.21.15.19:0/2889052315 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e0c03f030 con 0x7f3e18103ca0 2024-09-10T22:37:12.591 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:12.587+0000 7f3e1ed9b640 1 -- 172.21.15.19:0/2889052315 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3e18199150 con 0x7f3e18103ca0 2024-09-10T22:37:12.592 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:12.588+0000 7f3e15ffb640 1 -- 172.21.15.19:0/2889052315 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3e0c003aa0 con 0x7f3e18103ca0 2024-09-10T22:37:12.592 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:12.588+0000 7f3e15ffb640 1 -- 172.21.15.19:0/2889052315 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e0c035070 con 0x7f3e18103ca0 2024-09-10T22:37:12.592 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:12.588+0000 7f3e1ed9b640 1 -- 172.21.15.19:0/2889052315 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3e18199700 con 0x7f3e18103ca0 2024-09-10T22:37:12.593 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:12.592+0000 7f3e15ffb640 1 -- 172.21.15.19:0/2889052315 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 18) ==== 153250+0+0 (secure 0 0 0) 0x7f3e0c04c060 con 0x7f3e18103ca0 2024-09-10T22:37:12.594 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:12.593+0000 7f3e15ffb640 1 --2- 172.21.15.19:0/2889052315 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f3e080b5360 0x7f3e080b7820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:37:12.595 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:12.593+0000 7f3e15ffb640 1 -- 172.21.15.19:0/2889052315 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8327+0+0 (secure 0 0 0) 0x7f3e0c106030 con 0x7f3e18103ca0 2024-09-10T22:37:12.595 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:12.593+0000 7f3e17fff640 1 --2- 172.21.15.19:0/2889052315 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f3e080b5360 0x7f3e080b7820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:37:12.595 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:12.594+0000 7f3e21170740 1 Processor -- start 2024-09-10T22:37:12.595 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:12.594+0000 7f3e21170740 1 -- start start 2024-09-10T22:37:12.597 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:12.594+0000 7f3e21170740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55872ea97480 0x55872ea97860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:37:12.597 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:12.594+0000 7f3e21170740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55872ea97da0 0x55872eaa37f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:37:12.597 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:12.594+0000 7f3e21170740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55872eaa3d30 0x55872eaa6120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:37:12.598 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:12.594+0000 7f3e21170740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x55872ea0de50 con 0x55872eaa3d30 2024-09-10T22:37:12.598 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:12.594+0000 7f3e21170740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55872e9fd280 con 0x55872ea97da0 2024-09-10T22:37:12.598 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:12.594+0000 7f3e21170740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x55872ea01090 con 0x55872ea97480 2024-09-10T22:37:12.598 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:12.594+0000 7f3e17fff640 1 --2- 172.21.15.19:0/2889052315 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f3e080b5360 0x7f3e080b7820 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f3e18103440 tx=0x7f3e04006c70 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:37:12.598 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:12.595+0000 7f3e1d338640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55872eaa3d30 0x55872eaa6120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:37:12.598 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:12.595+0000 7f3e1d338640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55872eaa3d30 0x55872eaa6120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:46398/0 (socket says 172.21.15.19:46398) 2024-09-10T22:37:12.598 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:12.595+0000 7f3e1d338640 1 -- 172.21.15.19:0/937467690 learned_addr learned my addr 172.21.15.19:0/937467690 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:37:12.598 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:12.595+0000 7f3e1d338640 1 -- 172.21.15.19:0/937467690 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55872ea97480 msgr2=0x55872ea97860 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-10T22:37:12.598 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:12.595+0000 7f3e1d338640 1 --2- 172.21.15.19:0/937467690 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55872ea97480 0x55872ea97860 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:37:12.598 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:12.595+0000 7f3e1d338640 1 -- 172.21.15.19:0/937467690 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55872ea97da0 msgr2=0x55872eaa37f0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-10T22:37:12.599 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:12.595+0000 7f3e1d338640 1 --2- 172.21.15.19:0/937467690 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55872ea97da0 0x55872eaa37f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:37:12.599 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:12.595+0000 7f3e1d338640 1 -- 172.21.15.19:0/937467690 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55872e75b650 con 0x55872eaa3d30 2024-09-10T22:37:12.599 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:12.596+0000 7f3e1d338640 1 --2- 172.21.15.19:0/937467690 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55872eaa3d30 0x55872eaa6120 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 crypto rx=0x7f3e10009cf0 tx=0x7f3e1000b420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=94ee72ed11bee3d1 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:37:12.599 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:12.596+0000 7f3e02ffd640 1 -- 172.21.15.19:0/937467690 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e1000bd40 con 0x55872eaa3d30 2024-09-10T22:37:12.599 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:12.596+0000 7f3e02ffd640 1 -- 172.21.15.19:0/937467690 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3e10017070 con 0x55872eaa3d30 2024-09-10T22:37:12.599 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:12.596+0000 7f3e02ffd640 1 -- 172.21.15.19:0/937467690 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e10011590 con 0x55872eaa3d30 2024-09-10T22:37:12.600 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:12.597+0000 7f3e21170740 1 -- 172.21.15.19:0/937467690 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55872eaa3d30 msgr2=0x55872eaa6120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:37:12.600 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:12.597+0000 7f3e21170740 1 --2- 172.21.15.19:0/937467690 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55872eaa3d30 0x55872eaa6120 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 crypto rx=0x7f3e10009cf0 tx=0x7f3e1000b420 comp rx=0 tx=0).stop 2024-09-10T22:37:12.600 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:12.597+0000 7f3e21170740 1 -- 172.21.15.19:0/937467690 shutdown_connections 2024-09-10T22:37:12.600 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:12.597+0000 7f3e21170740 1 --2- 172.21.15.19:0/937467690 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55872eaa3d30 0x55872eaa6120 unknown :-1 s=CLOSED pgs=848 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:37:12.600 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:12.597+0000 7f3e21170740 1 --2- 172.21.15.19:0/937467690 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55872ea97da0 0x55872eaa37f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:37:12.600 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:12.597+0000 7f3e21170740 1 --2- 172.21.15.19:0/937467690 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55872ea97480 0x55872ea97860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:37:12.600 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:12.597+0000 7f3e21170740 1 -- 172.21.15.19:0/937467690 >> 172.21.15.19:0/937467690 conn(0x55872ea952b0 msgr2=0x55872ea96450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:37:12.600 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:12.598+0000 7f3e21170740 1 -- 172.21.15.19:0/937467690 shutdown_connections 2024-09-10T22:37:12.600 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:12.598+0000 7f3e21170740 1 -- 172.21.15.19:0/937467690 wait complete. 2024-09-10T22:37:12.601 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:12.598+0000 7f3e21170740 1 -- start start 2024-09-10T22:37:12.601 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:12.598+0000 7f3e21170740 1 Processor -- start 2024-09-10T22:37:12.603 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:12.599+0000 7f3e21170740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55872ea97480 0x55872eaa3620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:37:12.603 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:12.599+0000 7f3e21170740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55872ea97da0 0x55872eaa0a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:37:12.603 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:12.599+0000 7f3e21170740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55872eaa3d30 0x55872eaa10a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:37:12.603 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:12.599+0000 7f3e21170740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x55872e85e700 con 0x55872eaa3d30 2024-09-10T22:37:12.603 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:12.599+0000 7f3e21170740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55872e998110 con 0x55872ea97da0 2024-09-10T22:37:12.603 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:12.599+0000 7f3e21170740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x55872eaa69b0 con 0x55872ea97480 2024-09-10T22:37:12.603 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:12.599+0000 7f3e1d338640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55872eaa3d30 0x55872eaa10a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:37:12.603 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:12.599+0000 7f3e21170740 10 client.0 _ll_register_callbacks cb 0x55872e9b1990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T22:37:12.603 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:12.599+0000 7f3e1d338640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55872eaa3d30 0x55872eaa10a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:46414/0 (socket says 172.21.15.19:46414) 2024-09-10T22:37:12.603 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:12.599+0000 7f3e1d338640 1 -- 172.21.15.19:0/1945032925 learned_addr learned my addr 172.21.15.19:0/1945032925 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:37:12.603 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:12.599+0000 7f3e1d338640 1 -- 172.21.15.19:0/1945032925 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55872ea97480 msgr2=0x55872eaa3620 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-10T22:37:12.604 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:12.599+0000 7f3e1d338640 1 --2- 172.21.15.19:0/1945032925 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55872ea97480 0x55872eaa3620 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:37:12.604 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:12.599+0000 7f3e1d338640 1 -- 172.21.15.19:0/1945032925 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55872ea97da0 msgr2=0x55872eaa0a70 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-10T22:37:12.604 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:12.599+0000 7f3e1d338640 1 --2- 172.21.15.19:0/1945032925 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55872ea97da0 0x55872eaa0a70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:37:12.604 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:12.600+0000 7f3e1d338640 1 -- 172.21.15.19:0/1945032925 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55872e9c5c40 con 0x55872eaa3d30 2024-09-10T22:37:12.604 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:12.600+0000 7f3e1d338640 1 --2- 172.21.15.19:0/1945032925 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55872eaa3d30 0x55872eaa10a0 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 crypto rx=0x7f3e1000d010 tx=0x7f3e10012750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=869bbc489a61e95 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:37:12.604 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:12.600+0000 7f3df7fff640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-10T22:37:12.604 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:12.600+0000 7f3df7fff640 1 -- 172.21.15.19:0/1945032925 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e10003c10 con 0x55872eaa3d30 2024-09-10T22:37:12.604 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:12.600+0000 7f3df7fff640 1 -- 172.21.15.19:0/1945032925 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8327+0+0 (secure 0 0 0) 0x7f3e10003db0 con 0x55872eaa3d30 2024-09-10T22:37:12.604 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:12.600+0000 7f3e21170740 1 -- 172.21.15.19:0/1945032925 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3e10017070 con 0x55872eaa3d30 2024-09-10T22:37:12.604 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:12.601+0000 7f3df7fff640 1 -- 172.21.15.19:0/1945032925 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f3e10004020 con 0x55872eaa3d30 2024-09-10T22:37:12.604 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:12.601+0000 7f3e21170740 10 client.17535 fetch_fsmap learned FSMap version 27 2024-09-10T22:37:12.604 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:12.601+0000 7f3e21170740 1 -- 172.21.15.19:0/1945032925 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55872eab2310 con 0x55872eaa3d30 2024-09-10T22:37:12.605 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:12.601+0000 7f3df7fff640 1 -- 172.21.15.19:0/1945032925 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3e10004670 con 0x55872eaa3d30 2024-09-10T22:37:12.605 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:12.602+0000 7f3df7fff640 1 -- 172.21.15.19:0/1945032925 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7f3e1002e050 con 0x55872eaa3d30 2024-09-10T22:37:12.605 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:12.602+0000 7f3e21170740 10 client.17535 fetch_fsmap finished waiting for FSMap version 27 2024-09-10T22:37:12.605 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:12.602+0000 7f3e21170740 10 client.17535 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-10T22:37:12.605 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:12.602+0000 7f3e21170740 20 client.17535 populate_metadata read hostname 'smithi019' 2024-09-10T22:37:12.605 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:12.603+0000 7f3e21170740 1 --2- 172.21.15.19:0/1945032925 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x55872eab36c0 0x55872eab5ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:37:12.606 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:12.603+0000 7f3e21170740 4 client.17535 mds_command: new command op to 24581 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T22:37:12.606 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:12.603+0000 7f3e21170740 1 -- 172.21.15.19:0/1945032925 --> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f3e10017070 con 0x55872eab36c0 2024-09-10T22:37:12.606 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:12.605+0000 7f3e1cb37640 1 --2- 172.21.15.19:0/1945032925 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x55872eab36c0 0x55872eab5ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:37:12.611 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:12.610+0000 7f3df7fff640 10 client.17535 ms_handle_connect on v2:172.21.15.135:6838/1254769802 2024-09-10T22:37:12.611 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:12.610+0000 7f3e1cb37640 1 --2- 172.21.15.19:0/1945032925 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x55872eab36c0 0x55872eab5ab0 crc :-1 s=READY pgs=214 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bfa6bdc5b951ff03 server_cookie=b4580b0caf1d9ef0 in_seq=0 out_seq=0 2024-09-10T22:37:12.615 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:12.613+0000 7f3df7fff640 1 -- 172.21.15.19:0/1945032925 <== mds.0 v2:172.21.15.135:6838/1254769802 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x7f3e10017070 con 0x55872eab36c0 2024-09-10T22:37:12.615 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:12.613+0000 7f3df7fff640 10 client.17535 handle_command_reply: tid=0 2024-09-10T22:37:12.615 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:12.613+0000 7f3e21170740 1 client.17535 shutdown 2024-09-10T22:37:12.615 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:12.614+0000 7f3e21170740 1 -- 172.21.15.19:0/1945032925 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55872eaa3d30 msgr2=0x55872eaa10a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:37:12.616 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:12.614+0000 7f3e21170740 1 --2- 172.21.15.19:0/1945032925 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55872eaa3d30 0x55872eaa10a0 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 crypto rx=0x7f3e1000d010 tx=0x7f3e10012750 comp rx=0 tx=0).stop 2024-09-10T22:37:12.617 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:12.615+0000 7f3e21170740 1 -- 172.21.15.19:0/1945032925 shutdown_connections 2024-09-10T22:37:12.617 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:12.615+0000 7f3e21170740 1 --2- 172.21.15.19:0/1945032925 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55872eaa3d30 0x55872eaa10a0 unknown :-1 s=CLOSED pgs=849 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:37:12.617 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:12.615+0000 7f3e21170740 1 --2- 172.21.15.19:0/1945032925 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55872ea97da0 0x55872eaa0a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:37:12.617 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:12.615+0000 7f3e21170740 1 --2- 172.21.15.19:0/1945032925 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x55872eab36c0 0x55872eab5ab0 crc :-1 s=READY pgs=214 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:37:12.617 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:12.615+0000 7f3e21170740 1 --2- 172.21.15.19:0/1945032925 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55872ea97480 0x55872eaa3620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:37:12.617 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:12.615+0000 7f3e21170740 1 -- 172.21.15.19:0/1945032925 >> 172.21.15.19:0/1945032925 conn(0x55872ea952b0 msgr2=0x55872ea9ae20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:37:12.618 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:12.615+0000 7f3df7fff640 0 client.17535 ms_handle_reset on v2:172.21.15.135:6838/1254769802 2024-09-10T22:37:12.618 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:12.615+0000 7f3e21170740 1 -- 172.21.15.19:0/1945032925 shutdown_connections 2024-09-10T22:37:12.618 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:12.615+0000 7f3e21170740 1 -- 172.21.15.19:0/1945032925 wait complete. 2024-09-10T22:37:12.618 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:12.616+0000 7f3e21170740 20 client.17535 trim_cache size 0 max 16384 2024-09-10T22:37:12.639 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:12.637+0000 7f3e21170740 1 Processor -- start 2024-09-10T22:37:12.639 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:12.637+0000 7f3e21170740 1 -- start start 2024-09-10T22:37:12.639 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:12.638+0000 7f3e21170740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55872ea97480 0x55872eaafc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:37:12.640 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:12.638+0000 7f3e21170740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55872ea97da0 0x55872eaa27b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:37:12.640 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:12.638+0000 7f3e21170740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55872eaa3d30 0x55872eaa2cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:37:12.640 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:12.638+0000 7f3e21170740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f3e181b7500 con 0x55872eaa3d30 2024-09-10T22:37:12.640 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:12.638+0000 7f3e21170740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f3e181b4dd0 con 0x55872ea97da0 2024-09-10T22:37:12.640 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:12.638+0000 7f3e21170740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f3e181b2c20 con 0x55872ea97480 2024-09-10T22:37:12.640 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:12.638+0000 7f3e1d338640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55872eaa3d30 0x55872eaa2cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:37:12.640 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:12.638+0000 7f3e17fff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55872ea97da0 0x55872eaa27b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:37:12.640 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:12.638+0000 7f3e1cb37640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55872ea97480 0x55872eaafc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:37:12.640 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:12.638+0000 7f3e1cb37640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55872ea97480 0x55872eaafc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.19:52032/0 (socket says 172.21.15.19:52032) 2024-09-10T22:37:12.640 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:12.638+0000 7f3e1cb37640 1 -- 172.21.15.19:0/3094397169 learned_addr learned my addr 172.21.15.19:0/3094397169 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:37:12.640 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:12.638+0000 7f3e1d338640 1 --2- 172.21.15.19:0/3094397169 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55872eaa3d30 0x55872eaa2cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:46430/0 (socket says 172.21.15.19:46430) 2024-09-10T22:37:12.640 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:12.638+0000 7f3e17fff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55872ea97da0 0x55872eaa27b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.19:40662/0 (socket says 172.21.15.19:40662) 2024-09-10T22:37:12.647 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:12.638+0000 7f3e1cb37640 1 -- 172.21.15.19:0/3094397169 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55872ea97da0 msgr2=0x55872eaa27b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:37:12.647 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:12.638+0000 7f3e1cb37640 1 --2- 172.21.15.19:0/3094397169 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55872ea97da0 0x55872eaa27b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:37:12.647 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:12.638+0000 7f3e1cb37640 1 -- 172.21.15.19:0/3094397169 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55872eaa3d30 msgr2=0x55872eaa2cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:37:12.647 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:12.638+0000 7f3e1cb37640 1 --2- 172.21.15.19:0/3094397169 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55872eaa3d30 0x55872eaa2cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:37:12.647 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:12.638+0000 7f3e1cb37640 1 -- 172.21.15.19:0/3094397169 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55872ea97bd0 con 0x55872ea97480 2024-09-10T22:37:12.647 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:12.638+0000 7f3e1d338640 1 --2- 172.21.15.19:0/3094397169 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55872eaa3d30 0x55872eaa2cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T22:37:12.647 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:12.638+0000 7f3e1cb37640 1 --2- 172.21.15.19:0/3094397169 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55872ea97480 0x55872eaafc10 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f3e0c0cc7c0 tx=0x7f3e0c103f90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ac9506b3a584889a server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:37:12.648 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:12.639+0000 7f3e027fc640 1 -- 172.21.15.19:0/3094397169 <== mon.1 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e0c049040 con 0x55872ea97480 2024-09-10T22:37:12.648 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:12.639+0000 7f3e027fc640 1 -- 172.21.15.19:0/3094397169 <== mon.1 v2:172.21.15.138:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3e0c0d1070 con 0x55872ea97480 2024-09-10T22:37:12.648 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:12.639+0000 7f3e027fc640 1 -- 172.21.15.19:0/3094397169 <== mon.1 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e0c003c50 con 0x55872ea97480 2024-09-10T22:37:12.648 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:12.639+0000 7f3e21170740 1 -- 172.21.15.19:0/3094397169 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55872ea97480 msgr2=0x55872eaafc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:37:12.648 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:12.639+0000 7f3e21170740 1 --2- 172.21.15.19:0/3094397169 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55872ea97480 0x55872eaafc10 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f3e0c0cc7c0 tx=0x7f3e0c103f90 comp rx=0 tx=0).stop 2024-09-10T22:37:12.648 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:12.639+0000 7f3e21170740 1 -- 172.21.15.19:0/3094397169 shutdown_connections 2024-09-10T22:37:12.648 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:12.639+0000 7f3e21170740 1 --2- 172.21.15.19:0/3094397169 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55872eaa3d30 0x55872eaa2cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:37:12.648 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:12.639+0000 7f3e21170740 1 --2- 172.21.15.19:0/3094397169 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55872ea97da0 0x55872eaa27b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:37:12.648 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:12.639+0000 7f3e21170740 1 --2- 172.21.15.19:0/3094397169 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55872ea97480 0x55872eaafc10 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:37:12.648 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:12.639+0000 7f3e21170740 1 -- 172.21.15.19:0/3094397169 >> 172.21.15.19:0/3094397169 conn(0x55872ea952b0 msgr2=0x55872eaa20a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:37:12.648 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:12.640+0000 7f3e21170740 1 -- 172.21.15.19:0/3094397169 shutdown_connections 2024-09-10T22:37:12.648 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:12.640+0000 7f3e21170740 1 -- 172.21.15.19:0/3094397169 wait complete. 2024-09-10T22:37:12.648 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:12.640+0000 7f3e21170740 1 -- start start 2024-09-10T22:37:12.649 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:12.640+0000 7f3e21170740 1 Processor -- start 2024-09-10T22:37:12.649 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:12.640+0000 7f3e21170740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55872ea97480 0x55872eaac170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:37:12.649 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:12.640+0000 7f3e21170740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55872ea97da0 0x55872eaa86a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:37:12.649 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:12.640+0000 7f3e21170740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55872eaa3d30 0x55872eaa8be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:37:12.649 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:12.640+0000 7f3e21170740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f3e181b3290 con 0x55872eaa3d30 2024-09-10T22:37:12.649 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:12.640+0000 7f3e21170740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f3e181b4700 con 0x55872ea97da0 2024-09-10T22:37:12.649 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:12.640+0000 7f3e21170740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f3e181b3960 con 0x55872ea97480 2024-09-10T22:37:12.649 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:12.640+0000 7f3e21170740 10 client.0 _ll_register_callbacks cb 0x7f3e10009bc0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T22:37:12.649 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:12.641+0000 7f3e1cb37640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55872ea97480 0x55872eaac170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:37:12.649 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:12.641+0000 7f3e17fff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55872ea97da0 0x55872eaa86a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:37:12.649 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:12.641+0000 7f3e1cb37640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55872ea97480 0x55872eaac170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.19:52044/0 (socket says 172.21.15.19:52044) 2024-09-10T22:37:12.649 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:12.641+0000 7f3e1cb37640 1 -- 172.21.15.19:0/2846683854 learned_addr learned my addr 172.21.15.19:0/2846683854 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:37:12.649 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:12.641+0000 7f3e1d338640 1 --2- 172.21.15.19:0/2846683854 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55872eaa3d30 0x55872eaa8be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:37:12.650 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:12.641+0000 7f3e1cb37640 1 -- 172.21.15.19:0/2846683854 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55872ea97da0 msgr2=0x55872eaa86a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:37:12.650 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:12.641+0000 7f3e1cb37640 1 --2- 172.21.15.19:0/2846683854 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55872ea97da0 0x55872eaa86a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:37:12.650 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:12.641+0000 7f3e1cb37640 1 -- 172.21.15.19:0/2846683854 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55872eaa3d30 msgr2=0x55872eaa8be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:37:12.650 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:12.641+0000 7f3e1cb37640 1 --2- 172.21.15.19:0/2846683854 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55872eaa3d30 0x55872eaa8be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:37:12.650 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:12.641+0000 7f3e1cb37640 1 -- 172.21.15.19:0/2846683854 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55872eaa3990 con 0x55872ea97480 2024-09-10T22:37:12.650 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:12.641+0000 7f3e1cb37640 1 --2- 172.21.15.19:0/2846683854 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55872ea97480 0x55872eaac170 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f3e0c0cc620 tx=0x7f3e0c005e60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5c3c59c98b6575f4 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:37:12.650 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:12.641+0000 7f3df7fff640 10 client.0 ms_handle_connect on v2:172.21.15.138:3300/0 2024-09-10T22:37:12.650 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:12.641+0000 7f3df7fff640 1 -- 172.21.15.19:0/2846683854 <== mon.1 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e0c049040 con 0x55872ea97480 2024-09-10T22:37:12.650 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:12.641+0000 7f3df7fff640 1 -- 172.21.15.19:0/2846683854 <== mon.1 v2:172.21.15.138:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8327+0+0 (secure 0 0 0) 0x7f3e0c07c180 con 0x55872ea97480 2024-09-10T22:37:12.650 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:12.641+0000 7f3e21170740 1 -- 172.21.15.19:0/2846683854 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3e0c0d1070 con 0x55872ea97480 2024-09-10T22:37:12.650 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:12.641+0000 7f3df7fff640 1 -- 172.21.15.19:0/2846683854 <== mon.1 v2:172.21.15.138:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f3e0c0cc830 con 0x55872ea97480 2024-09-10T22:37:12.650 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:12.641+0000 7f3e21170740 10 client.26854 fetch_fsmap learned FSMap version 27 2024-09-10T22:37:12.650 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:12.642+0000 7f3e21170740 1 -- 172.21.15.19:0/2846683854 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55872eb210a0 con 0x55872ea97480 2024-09-10T22:37:12.651 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:12.642+0000 7f3df7fff640 1 -- 172.21.15.19:0/2846683854 <== mon.1 v2:172.21.15.138:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3e0c0d1070 con 0x55872ea97480 2024-09-10T22:37:12.651 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:12.642+0000 7f3df7fff640 1 -- 172.21.15.19:0/2846683854 <== mon.1 v2:172.21.15.138:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7f3e0c0d5930 con 0x55872ea97480 2024-09-10T22:37:12.651 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:12.642+0000 7f3e21170740 10 client.26854 fetch_fsmap finished waiting for FSMap version 27 2024-09-10T22:37:12.651 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:12.642+0000 7f3e21170740 10 client.26854 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-10T22:37:12.651 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:12.642+0000 7f3e21170740 20 client.26854 populate_metadata read hostname 'smithi019' 2024-09-10T22:37:12.651 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:12.642+0000 7f3e21170740 1 --2- 172.21.15.19:0/2846683854 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x55872eb21770 0x55872eb23b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:37:12.651 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:12.642+0000 7f3e21170740 4 client.26854 mds_command: new command op to 24581 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-10T22:37:12.651 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:12.642+0000 7f3e21170740 1 -- 172.21.15.19:0/2846683854 --> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55872ea0fda0 con 0x55872eb21770 2024-09-10T22:37:12.651 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:12.643+0000 7f3e17fff640 1 --2- 172.21.15.19:0/2846683854 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x55872eb21770 0x55872eb23b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:37:12.651 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:12.643+0000 7f3e17fff640 1 --2- 172.21.15.19:0/2846683854 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x55872eb21770 0x55872eb23b90 crc :-1 s=READY pgs=215 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b02d333c0e4b453f server_cookie=977c9f1a0f72b272 in_seq=0 out_seq=0 2024-09-10T22:37:12.651 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:12.643+0000 7f3df7fff640 10 client.26854 ms_handle_connect on v2:172.21.15.135:6838/1254769802 2024-09-10T22:37:12.651 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:12.643+0000 7f3df7fff640 1 -- 172.21.15.19:0/2846683854 <== mds.0 v2:172.21.15.135:6838/1254769802 1 ==== command_reply(tid 0: 0 ) ==== 8+0+4546 (crc 0 0 0) 0x55872ea0fda0 con 0x55872eb21770 2024-09-10T22:37:12.651 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:12.643+0000 7f3df7fff640 10 client.26854 handle_command_reply: tid=0 2024-09-10T22:37:12.651 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:12.643+0000 7f3e21170740 1 client.26854 shutdown 2024-09-10T22:37:12.652 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:12.643+0000 7f3e21170740 1 -- 172.21.15.19:0/2846683854 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55872ea97480 msgr2=0x55872eaac170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:37:12.652 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:12.643+0000 7f3e21170740 1 --2- 172.21.15.19:0/2846683854 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55872ea97480 0x55872eaac170 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f3e0c0cc620 tx=0x7f3e0c005e60 comp rx=0 tx=0).stop 2024-09-10T22:37:12.652 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:12.643+0000 7f3e21170740 1 -- 172.21.15.19:0/2846683854 shutdown_connections 2024-09-10T22:37:12.652 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:12.643+0000 7f3e21170740 1 --2- 172.21.15.19:0/2846683854 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55872eaa3d30 0x55872eaa8be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:37:12.652 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:12.643+0000 7f3e21170740 1 --2- 172.21.15.19:0/2846683854 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55872ea97da0 0x55872eaa86a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:37:12.652 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:12.643+0000 7f3e21170740 1 --2- 172.21.15.19:0/2846683854 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x55872eb21770 0x55872eb23b90 crc :-1 s=READY pgs=215 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:37:12.652 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:12.644+0000 7f3df7fff640 0 client.26854 ms_handle_reset on v2:172.21.15.135:6838/1254769802 2024-09-10T22:37:12.652 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:12.644+0000 7f3e21170740 1 --2- 172.21.15.19:0/2846683854 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55872ea97480 0x55872eaac170 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:37:12.652 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:12.644+0000 7f3e21170740 1 -- 172.21.15.19:0/2846683854 >> 172.21.15.19:0/2846683854 conn(0x55872ea952b0 msgr2=0x55872eaa28c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:37:12.652 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:12.644+0000 7f3e21170740 1 -- 172.21.15.19:0/2846683854 shutdown_connections 2024-09-10T22:37:12.652 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:12.644+0000 7f3e21170740 1 -- 172.21.15.19:0/2846683854 wait complete. 2024-09-10T22:37:12.652 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:12.644+0000 7f3e21170740 20 client.26854 trim_cache size 0 max 16384 2024-09-10T22:37:12.653 INFO:teuthology.orchestra.run.smithi019.stdout:{ 2024-09-10T22:37:12.653 INFO:teuthology.orchestra.run.smithi019.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-10T22:37:12.653 INFO:teuthology.orchestra.run.smithi019.stdout: "scrubs": { 2024-09-10T22:37:12.653 INFO:teuthology.orchestra.run.smithi019.stdout: "97894c69-c36c-4d46-9917-57199df72044": { 2024-09-10T22:37:12.653 INFO:teuthology.orchestra.run.smithi019.stdout: "path": "/", 2024-09-10T22:37:12.653 INFO:teuthology.orchestra.run.smithi019.stdout: "tag": "97894c69-c36c-4d46-9917-57199df72044", 2024-09-10T22:37:12.653 INFO:teuthology.orchestra.run.smithi019.stdout: "options": "recursive,force" 2024-09-10T22:37:12.653 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-10T22:37:12.653 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:12.654 INFO:teuthology.orchestra.run.smithi019.stdout: "scrub_stats": { 2024-09-10T22:37:12.654 INFO:teuthology.orchestra.run.smithi019.stdout: "abfbdc16-212b-47f2-b921-c2a1cae322e5": { 2024-09-10T22:37:12.654 INFO:teuthology.orchestra.run.smithi019.stdout: "start_time": "2024-09-10T22:36:26.258118+0000", 2024-09-10T22:37:12.654 INFO:teuthology.orchestra.run.smithi019.stdout: "path": "/", 2024-09-10T22:37:12.654 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_started": 0, 2024-09-10T22:37:12.654 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_passed": 0, 2024-09-10T22:37:12.654 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_failed": 0, 2024-09-10T22:37:12.654 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_skipped": 0 2024-09-10T22:37:12.654 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:12.654 INFO:teuthology.orchestra.run.smithi019.stdout: "9b6bfdee-303c-4c12-af56-dc85860d112a": { 2024-09-10T22:37:12.654 INFO:teuthology.orchestra.run.smithi019.stdout: "start_time": "2024-09-10T22:26:17.484162+0000", 2024-09-10T22:37:12.654 INFO:teuthology.orchestra.run.smithi019.stdout: "path": "/", 2024-09-10T22:37:12.654 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_started": 0, 2024-09-10T22:37:12.654 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_passed": 0, 2024-09-10T22:37:12.654 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_failed": 0, 2024-09-10T22:37:12.655 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_skipped": 0 2024-09-10T22:37:12.655 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:12.655 INFO:teuthology.orchestra.run.smithi019.stdout: "b38852c8-478a-42ef-8384-b2c55d5313a4": { 2024-09-10T22:37:12.655 INFO:teuthology.orchestra.run.smithi019.stdout: "start_time": "2024-09-10T22:27:00.320308+0000", 2024-09-10T22:37:12.655 INFO:teuthology.orchestra.run.smithi019.stdout: "path": "/", 2024-09-10T22:37:12.655 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_started": 0, 2024-09-10T22:37:12.655 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_passed": 0, 2024-09-10T22:37:12.655 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_failed": 0, 2024-09-10T22:37:12.655 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_skipped": 0 2024-09-10T22:37:12.655 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:12.655 INFO:teuthology.orchestra.run.smithi019.stdout: "c12c2a04-dcd6-4673-a98e-93f665d3f5d7": { 2024-09-10T22:37:12.655 INFO:teuthology.orchestra.run.smithi019.stdout: "start_time": "2024-09-10T22:27:49.392329+0000", 2024-09-10T22:37:12.655 INFO:teuthology.orchestra.run.smithi019.stdout: "path": "/", 2024-09-10T22:37:12.655 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_started": 0, 2024-09-10T22:37:12.655 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_passed": 0, 2024-09-10T22:37:12.656 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_failed": 0, 2024-09-10T22:37:12.656 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_skipped": 0 2024-09-10T22:37:12.656 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:12.656 INFO:teuthology.orchestra.run.smithi019.stdout: "4c99964e-2e0e-4ffd-8cb8-99c4979ed90f": { 2024-09-10T22:37:12.656 INFO:teuthology.orchestra.run.smithi019.stdout: "start_time": "2024-09-10T22:32:34.659639+0000", 2024-09-10T22:37:12.656 INFO:teuthology.orchestra.run.smithi019.stdout: "path": "/", 2024-09-10T22:37:12.656 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_started": 0, 2024-09-10T22:37:12.656 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_passed": 0, 2024-09-10T22:37:12.656 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_failed": 0, 2024-09-10T22:37:12.656 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_skipped": 0 2024-09-10T22:37:12.656 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:12.656 INFO:teuthology.orchestra.run.smithi019.stdout: "9efe684b-7583-402e-a46e-e262a37e1af5": { 2024-09-10T22:37:12.656 INFO:teuthology.orchestra.run.smithi019.stdout: "start_time": "2024-09-10T22:34:09.479768+0000", 2024-09-10T22:37:12.657 INFO:teuthology.orchestra.run.smithi019.stdout: "path": "/", 2024-09-10T22:37:12.657 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_started": 0, 2024-09-10T22:37:12.657 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_passed": 0, 2024-09-10T22:37:12.657 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_failed": 0, 2024-09-10T22:37:12.657 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_skipped": 0 2024-09-10T22:37:12.657 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:12.657 INFO:teuthology.orchestra.run.smithi019.stdout: "eb518e3c-a71e-4f32-9ca0-ae88930ca218": { 2024-09-10T22:37:12.657 INFO:teuthology.orchestra.run.smithi019.stdout: "start_time": "2024-09-10T22:28:38.366352+0000", 2024-09-10T22:37:12.657 INFO:teuthology.orchestra.run.smithi019.stdout: "path": "/", 2024-09-10T22:37:12.657 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_started": 0, 2024-09-10T22:37:12.657 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_passed": 0, 2024-09-10T22:37:12.657 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_failed": 0, 2024-09-10T22:37:12.657 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_skipped": 0 2024-09-10T22:37:12.657 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:12.658 INFO:teuthology.orchestra.run.smithi019.stdout: "8f3bb3bf-911f-490c-9856-c80ea220dbbe": { 2024-09-10T22:37:12.658 INFO:teuthology.orchestra.run.smithi019.stdout: "start_time": "2024-09-10T22:29:25.374415+0000", 2024-09-10T22:37:12.658 INFO:teuthology.orchestra.run.smithi019.stdout: "path": "/", 2024-09-10T22:37:12.658 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_started": 0, 2024-09-10T22:37:12.658 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_passed": 0, 2024-09-10T22:37:12.658 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_failed": 0, 2024-09-10T22:37:12.658 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_skipped": 0 2024-09-10T22:37:12.658 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:12.658 INFO:teuthology.orchestra.run.smithi019.stdout: "fd1f1837-dcfa-4d88-99e8-2509f36c3f98": { 2024-09-10T22:37:12.658 INFO:teuthology.orchestra.run.smithi019.stdout: "start_time": "2024-09-10T22:30:12.470477+0000", 2024-09-10T22:37:12.658 INFO:teuthology.orchestra.run.smithi019.stdout: "path": "/", 2024-09-10T22:37:12.658 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_started": 0, 2024-09-10T22:37:12.658 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_passed": 0, 2024-09-10T22:37:12.658 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_failed": 0, 2024-09-10T22:37:12.659 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_skipped": 0 2024-09-10T22:37:12.659 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:12.659 INFO:teuthology.orchestra.run.smithi019.stdout: "715ec863-8a9d-45b6-967f-59b15ce1bf12": { 2024-09-10T22:37:12.659 INFO:teuthology.orchestra.run.smithi019.stdout: "start_time": "2024-09-10T22:31:00.669516+0000", 2024-09-10T22:37:12.659 INFO:teuthology.orchestra.run.smithi019.stdout: "path": "/", 2024-09-10T22:37:12.659 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_started": 0, 2024-09-10T22:37:12.659 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_passed": 0, 2024-09-10T22:37:12.659 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_failed": 0, 2024-09-10T22:37:12.659 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_skipped": 0 2024-09-10T22:37:12.659 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:12.659 INFO:teuthology.orchestra.run.smithi019.stdout: "0b81ea61-0b8e-4f2c-a58f-ef1019289fc9": { 2024-09-10T22:37:12.659 INFO:teuthology.orchestra.run.smithi019.stdout: "start_time": "2024-09-10T22:31:48.141568+0000", 2024-09-10T22:37:12.659 INFO:teuthology.orchestra.run.smithi019.stdout: "path": "/", 2024-09-10T22:37:12.659 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_started": 0, 2024-09-10T22:37:12.659 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_passed": 0, 2024-09-10T22:37:12.660 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_failed": 0, 2024-09-10T22:37:12.660 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_skipped": 0 2024-09-10T22:37:12.660 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:12.660 INFO:teuthology.orchestra.run.smithi019.stdout: "97894c69-c36c-4d46-9917-57199df72044": { 2024-09-10T22:37:12.660 INFO:teuthology.orchestra.run.smithi019.stdout: "start_time": "2024-09-10T22:37:10.869260+0000", 2024-09-10T22:37:12.660 INFO:teuthology.orchestra.run.smithi019.stdout: "path": "/", 2024-09-10T22:37:12.660 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_started": 0, 2024-09-10T22:37:12.660 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_passed": 0, 2024-09-10T22:37:12.660 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_failed": 0, 2024-09-10T22:37:12.660 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_skipped": 0 2024-09-10T22:37:12.660 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:12.660 INFO:teuthology.orchestra.run.smithi019.stdout: "a77606c2-7618-413e-8aba-f9783ecbf435": { 2024-09-10T22:37:12.660 INFO:teuthology.orchestra.run.smithi019.stdout: "start_time": "2024-09-10T22:34:54.453894+0000", 2024-09-10T22:37:12.661 INFO:teuthology.orchestra.run.smithi019.stdout: "path": "/", 2024-09-10T22:37:12.661 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_started": 0, 2024-09-10T22:37:12.661 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_passed": 0, 2024-09-10T22:37:12.661 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_failed": 0, 2024-09-10T22:37:12.661 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_skipped": 0 2024-09-10T22:37:12.661 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:12.661 INFO:teuthology.orchestra.run.smithi019.stdout: "448b10e7-494c-4a88-a9ab-186159c5dfdd": { 2024-09-10T22:37:12.661 INFO:teuthology.orchestra.run.smithi019.stdout: "start_time": "2024-09-10T22:33:21.208716+0000", 2024-09-10T22:37:12.661 INFO:teuthology.orchestra.run.smithi019.stdout: "path": "/", 2024-09-10T22:37:12.661 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_started": 0, 2024-09-10T22:37:12.661 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_passed": 0, 2024-09-10T22:37:12.661 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_failed": 0, 2024-09-10T22:37:12.661 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_skipped": 0 2024-09-10T22:37:12.661 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:12.662 INFO:teuthology.orchestra.run.smithi019.stdout: "1a6e9f60-01cc-4339-aff0-9ef63cbda443": { 2024-09-10T22:37:12.662 INFO:teuthology.orchestra.run.smithi019.stdout: "start_time": "2024-09-10T22:35:40.561000+0000", 2024-09-10T22:37:12.662 INFO:teuthology.orchestra.run.smithi019.stdout: "path": "/", 2024-09-10T22:37:12.662 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_started": 0, 2024-09-10T22:37:12.662 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_passed": 0, 2024-09-10T22:37:12.662 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_failed": 0, 2024-09-10T22:37:12.662 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_skipped": 0 2024-09-10T22:37:12.662 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-10T22:37:12.662 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-10T22:37:12.662 INFO:teuthology.orchestra.run.smithi019.stdout:} 2024-09-10T22:37:12.663 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:12.644+0000 7f3e1ed9b640 1 -- 172.21.15.19:0/2889052315 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f3e080b5360 msgr2=0x7f3e080b7820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:37:12.663 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:12.644+0000 7f3e1ed9b640 1 --2- 172.21.15.19:0/2889052315 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f3e080b5360 0x7f3e080b7820 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f3e18103440 tx=0x7f3e04006c70 comp rx=0 tx=0).stop 2024-09-10T22:37:12.663 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:12.644+0000 7f3e1ed9b640 1 -- 172.21.15.19:0/2889052315 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3e18103ca0 msgr2=0x7f3e18101950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:37:12.663 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:12.644+0000 7f3e1ed9b640 1 --2- 172.21.15.19:0/2889052315 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3e18103ca0 0x7f3e18101950 secure :-1 s=READY pgs=847 cs=0 l=1 rev1=1 crypto rx=0x7f3e0c005940 tx=0x7f3e0c004270 comp rx=0 tx=0).stop 2024-09-10T22:37:12.663 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:12.645+0000 7f3e1ed9b640 1 -- 172.21.15.19:0/2889052315 shutdown_connections 2024-09-10T22:37:12.663 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:12.645+0000 7f3e1ed9b640 1 --2- 172.21.15.19:0/2889052315 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f3e080b5360 0x7f3e080b7820 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:37:12.663 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:12.645+0000 7f3e1ed9b640 1 --2- 172.21.15.19:0/2889052315 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3e1810d100 0x7f3e181023d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:37:12.664 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:12.645+0000 7f3e1ed9b640 1 --2- 172.21.15.19:0/2889052315 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3e181045c0 0x7f3e18101e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:37:12.664 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:12.645+0000 7f3e1ed9b640 1 --2- 172.21.15.19:0/2889052315 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3e18103ca0 0x7f3e18101950 unknown :-1 s=CLOSED pgs=847 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:37:12.664 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:12.645+0000 7f3e1ed9b640 1 -- 172.21.15.19:0/2889052315 >> 172.21.15.19:0/2889052315 conn(0x7f3e180fd700 msgr2=0x7f3e180fe3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:37:12.664 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:12.645+0000 7f3e1ed9b640 1 -- 172.21.15.19:0/2889052315 shutdown_connections 2024-09-10T22:37:12.664 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:12.645+0000 7f3e1ed9b640 1 -- 172.21.15.19:0/2889052315 wait complete. 2024-09-10T22:37:12.708 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:37:12 smithi019 ceph-mon[31375]: scrub queued for path: / 2024-09-10T22:37:12.708 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:37:12 smithi019 ceph-mon[31375]: scrub summary: idle+waiting paths [/] 2024-09-10T22:37:12.708 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:37:12 smithi019 ceph-mon[31375]: scrub summary: active paths [/] 2024-09-10T22:37:12.709 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:37:12 smithi019 ceph-mon[31375]: scrub summary: active paths [/] 2024-09-10T22:37:12.709 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:37:12 smithi019 ceph-mon[31375]: scrub summary: idle+waiting paths [/] 2024-09-10T22:37:12.709 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:37:12 smithi019 ceph-mon[31375]: scrub summary: idle+waiting paths [/] 2024-09-10T22:37:12.763 INFO:tasks.workunit.client.0.smithi019.stdout:stopping iogen 2024-09-10T22:37:12.764 INFO:tasks.workunit.client.0.smithi019.stderr:+ echo 'stopping iogen' 2024-09-10T22:37:12.764 INFO:tasks.workunit.client.0.smithi019.stderr:+ ./iogen -k 2024-09-10T22:37:12.765 INFO:tasks.workunit.client.0.smithi019.stdout:OK 2024-09-10T22:37:12.765 INFO:tasks.workunit.client.0.smithi019.stderr:+ echo OK 2024-09-10T22:37:12.860 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:37:12 smithi135 ceph-mon[34789]: scrub queued for path: / 2024-09-10T22:37:12.860 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:37:12 smithi135 ceph-mon[34789]: scrub summary: idle+waiting paths [/] 2024-09-10T22:37:12.860 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:37:12 smithi135 ceph-mon[34789]: scrub summary: active paths [/] 2024-09-10T22:37:12.860 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:37:12 smithi135 ceph-mon[34789]: scrub summary: active paths [/] 2024-09-10T22:37:12.860 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:37:12 smithi135 ceph-mon[34789]: scrub summary: idle+waiting paths [/] 2024-09-10T22:37:12.860 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:37:12 smithi135 ceph-mon[34789]: scrub summary: idle+waiting paths [/] 2024-09-10T22:37:12.875 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:37:12 smithi138 ceph-mon[35236]: scrub queued for path: / 2024-09-10T22:37:12.875 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:37:12 smithi138 ceph-mon[35236]: scrub summary: idle+waiting paths [/] 2024-09-10T22:37:12.875 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:37:12 smithi138 ceph-mon[35236]: scrub summary: active paths [/] 2024-09-10T22:37:12.875 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:37:12 smithi138 ceph-mon[35236]: scrub summary: active paths [/] 2024-09-10T22:37:12.875 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:37:12 smithi138 ceph-mon[35236]: scrub summary: idle+waiting paths [/] 2024-09-10T22:37:12.875 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:37:12 smithi138 ceph-mon[35236]: scrub summary: idle+waiting paths [/] 2024-09-10T22:37:13.530 INFO:tasks.cephfs.filesystem:scrub status for tag:97894c69-c36c-4d46-9917-57199df72044 - {'path': '/', 'tag': '97894c69-c36c-4d46-9917-57199df72044', 'options': 'recursive,force'} 2024-09-10T22:37:13.860 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:37:13 smithi135 ceph-mon[34789]: pgmap v671: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 524 KiB/s rd, 191 MiB/s wr, 570 op/s 2024-09-10T22:37:13.875 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:37:13 smithi138 ceph-mon[35236]: pgmap v671: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 524 KiB/s rd, 191 MiB/s wr, 570 op/s 2024-09-10T22:37:13.958 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:37:13 smithi019 ceph-mon[31375]: pgmap v671: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 524 KiB/s rd, 191 MiB/s wr, 570 op/s 2024-09-10T22:37:15.305 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-10T22:37:15.306 DEBUG:teuthology.orchestra.run.smithi019:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-10T22:37:15.510 INFO:tasks.workunit:Stopping ['suites/iogen.sh'] on client.0... 2024-09-10T22:37:15.511 DEBUG:teuthology.orchestra.run.smithi019:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-09-10T22:37:15.814 DEBUG:teuthology.parallel:result is None 2024-09-10T22:37:15.814 DEBUG:teuthology.orchestra.run.smithi019:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-09-10T22:37:15.848 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-09-10T22:37:15.849 DEBUG:teuthology.run_tasks:Unwinding manager background_exec 2024-09-10T22:37:15.861 INFO:teuthology.task.background_exec:Stopping background command on ubuntu@smithi019.front.sepia.ceph.com 2024-09-10T22:37:15.899 DEBUG:teuthology.run_tasks:Unwinding manager fwd_scrub 2024-09-10T22:37:15.910 INFO:tasks.fwd_scrub:joining ForwardScrubbers 2024-09-10T22:37:15.958 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:37:15 smithi019 ceph-mon[31375]: pgmap v672: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 525 KiB/s rd, 212 MiB/s wr, 526 op/s 2024-09-10T22:37:16.110 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:37:15 smithi135 ceph-mon[34789]: pgmap v672: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 525 KiB/s rd, 212 MiB/s wr, 526 op/s 2024-09-10T22:37:16.125 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:37:15 smithi138 ceph-mon[35236]: pgmap v672: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 525 KiB/s rd, 212 MiB/s wr, 526 op/s 2024-09-10T22:37:17.958 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:37:17 smithi019 ceph-mon[31375]: pgmap v673: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 380 KiB/s rd, 241 MiB/s wr, 476 op/s 2024-09-10T22:37:17.959 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:37:17 smithi019 ceph-mon[31375]: scrub summary: idle 2024-09-10T22:37:17.959 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:37:17 smithi019 ceph-mon[31375]: scrub summary: idle 2024-09-10T22:37:18.110 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:37:17 smithi135 ceph-mon[34789]: pgmap v673: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 380 KiB/s rd, 241 MiB/s wr, 476 op/s 2024-09-10T22:37:18.110 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:37:17 smithi135 ceph-mon[34789]: scrub summary: idle 2024-09-10T22:37:18.110 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:37:17 smithi135 ceph-mon[34789]: scrub summary: idle 2024-09-10T22:37:18.125 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:37:17 smithi138 ceph-mon[35236]: pgmap v673: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 380 KiB/s rd, 241 MiB/s wr, 476 op/s 2024-09-10T22:37:18.125 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:37:17 smithi138 ceph-mon[35236]: scrub summary: idle 2024-09-10T22:37:18.125 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:37:17 smithi138 ceph-mon[35236]: scrub summary: idle 2024-09-10T22:37:19.958 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:37:19 smithi019 ceph-mon[31375]: pgmap v674: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 368 KiB/s rd, 188 MiB/s wr, 182 op/s 2024-09-10T22:37:19.958 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:37:19 smithi019 ceph-mon[31375]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-09-10T22:37:20.110 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:37:19 smithi135 ceph-mon[34789]: pgmap v674: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 368 KiB/s rd, 188 MiB/s wr, 182 op/s 2024-09-10T22:37:20.110 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:37:19 smithi135 ceph-mon[34789]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-09-10T22:37:20.125 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:37:19 smithi138 ceph-mon[35236]: pgmap v674: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 368 KiB/s rd, 188 MiB/s wr, 182 op/s 2024-09-10T22:37:20.125 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:37:19 smithi138 ceph-mon[35236]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-09-10T22:37:21.958 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:37:21 smithi019 ceph-mon[31375]: pgmap v675: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 472 KiB/s rd, 182 MiB/s wr, 171 op/s 2024-09-10T22:37:22.110 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:37:21 smithi135 ceph-mon[34789]: pgmap v675: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 472 KiB/s rd, 182 MiB/s wr, 171 op/s 2024-09-10T22:37:22.125 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:37:21 smithi138 ceph-mon[35236]: pgmap v675: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 472 KiB/s rd, 182 MiB/s wr, 171 op/s 2024-09-10T22:37:23.958 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:37:23 smithi019 ceph-mon[31375]: pgmap v676: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 284 KiB/s rd, 139 MiB/s wr, 169 op/s 2024-09-10T22:37:24.110 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:37:23 smithi135 ceph-mon[34789]: pgmap v676: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 284 KiB/s rd, 139 MiB/s wr, 169 op/s 2024-09-10T22:37:24.125 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:37:23 smithi138 ceph-mon[35236]: pgmap v676: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 284 KiB/s rd, 139 MiB/s wr, 169 op/s 2024-09-10T22:37:25.958 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:37:25 smithi019 ceph-mon[31375]: pgmap v677: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 283 KiB/s rd, 114 MiB/s wr, 217 op/s 2024-09-10T22:37:26.110 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:37:25 smithi135 ceph-mon[34789]: pgmap v677: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 283 KiB/s rd, 114 MiB/s wr, 217 op/s 2024-09-10T22:37:26.125 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:37:25 smithi138 ceph-mon[35236]: pgmap v677: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 283 KiB/s rd, 114 MiB/s wr, 217 op/s 2024-09-10T22:37:27.960 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:37:27 smithi019 ceph-mon[31375]: pgmap v678: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 284 KiB/s rd, 89 MiB/s wr, 287 op/s 2024-09-10T22:37:28.110 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:37:27 smithi135 ceph-mon[34789]: pgmap v678: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 284 KiB/s rd, 89 MiB/s wr, 287 op/s 2024-09-10T22:37:28.125 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:37:27 smithi138 ceph-mon[35236]: pgmap v678: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 284 KiB/s rd, 89 MiB/s wr, 287 op/s 2024-09-10T22:37:30.110 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:37:29 smithi135 ceph-mon[34789]: pgmap v679: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 107 KiB/s rd, 35 MiB/s wr, 226 op/s 2024-09-10T22:37:30.125 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:37:29 smithi138 ceph-mon[35236]: pgmap v679: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 107 KiB/s rd, 35 MiB/s wr, 226 op/s 2024-09-10T22:37:30.208 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:37:29 smithi019 ceph-mon[31375]: pgmap v679: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 107 KiB/s rd, 35 MiB/s wr, 226 op/s 2024-09-10T22:37:32.110 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:37:31 smithi135 ceph-mon[34789]: pgmap v680: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 108 KiB/s rd, 41 MiB/s wr, 324 op/s 2024-09-10T22:37:32.125 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:37:31 smithi138 ceph-mon[35236]: pgmap v680: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 108 KiB/s rd, 41 MiB/s wr, 324 op/s 2024-09-10T22:37:32.208 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:37:31 smithi019 ceph-mon[31375]: pgmap v680: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 108 KiB/s rd, 41 MiB/s wr, 324 op/s 2024-09-10T22:37:34.110 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:37:33 smithi135 ceph-mon[34789]: pgmap v681: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 41 MiB/s wr, 354 op/s 2024-09-10T22:37:34.125 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:37:33 smithi138 ceph-mon[35236]: pgmap v681: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 41 MiB/s wr, 354 op/s 2024-09-10T22:37:34.208 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:37:33 smithi019 ceph-mon[31375]: pgmap v681: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 41 MiB/s wr, 354 op/s 2024-09-10T22:37:36.110 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:37:35 smithi135 ceph-mon[34789]: pgmap v682: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 42 MiB/s wr, 350 op/s 2024-09-10T22:37:36.125 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:37:35 smithi138 ceph-mon[35236]: pgmap v682: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 42 MiB/s wr, 350 op/s 2024-09-10T22:37:36.208 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:37:35 smithi019 ceph-mon[31375]: pgmap v682: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 42 MiB/s wr, 350 op/s 2024-09-10T22:37:38.110 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:37:37 smithi135 ceph-mon[34789]: pgmap v683: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 49 MiB/s wr, 387 op/s 2024-09-10T22:37:38.125 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:37:37 smithi138 ceph-mon[35236]: pgmap v683: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 49 MiB/s wr, 387 op/s 2024-09-10T22:37:38.208 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:37:37 smithi019 ceph-mon[31375]: pgmap v683: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 49 MiB/s wr, 387 op/s 2024-09-10T22:37:40.110 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:37:39 smithi135 ceph-mon[34789]: pgmap v684: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 38 MiB/s wr, 299 op/s 2024-09-10T22:37:40.125 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:37:39 smithi138 ceph-mon[35236]: pgmap v684: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 38 MiB/s wr, 299 op/s 2024-09-10T22:37:40.209 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:37:39 smithi019 ceph-mon[31375]: pgmap v684: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 38 MiB/s wr, 299 op/s 2024-09-10T22:37:42.011 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:37:41 smithi019 ceph-mon[31375]: pgmap v685: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 49 MiB/s wr, 361 op/s 2024-09-10T22:37:42.110 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:37:41 smithi135 ceph-mon[34789]: pgmap v685: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 49 MiB/s wr, 361 op/s 2024-09-10T22:37:42.125 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:37:41 smithi138 ceph-mon[35236]: pgmap v685: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 49 MiB/s wr, 361 op/s 2024-09-10T22:37:43.532 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 22997a4c-6fc2-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-10T22:37:43.809 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/22997a4c-6fc2-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T22:37:43.930 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:37:43 smithi019 ceph-mon[31375]: pgmap v686: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 40 MiB/s wr, 260 op/s 2024-09-10T22:37:44.110 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:37:43 smithi135 ceph-mon[34789]: pgmap v686: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 40 MiB/s wr, 260 op/s 2024-09-10T22:37:44.125 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:37:43 smithi138 ceph-mon[35236]: pgmap v686: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 40 MiB/s wr, 260 op/s 2024-09-10T22:37:44.415 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:44.412+0000 7fc717109640 1 -- 172.21.15.19:0/3587103297 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc710102dc0 msgr2=0x7fc7101031a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:37:44.416 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:44.412+0000 7fc717109640 1 --2- 172.21.15.19:0/3587103297 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc710102dc0 0x7fc7101031a0 secure :-1 s=READY pgs=850 cs=0 l=1 rev1=1 crypto rx=0x7fc708009ca0 tx=0x7fc70802a8c0 comp rx=0 tx=0).stop 2024-09-10T22:37:44.416 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:44.412+0000 7fc717109640 1 -- 172.21.15.19:0/3587103297 shutdown_connections 2024-09-10T22:37:44.416 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:44.412+0000 7fc717109640 1 --2- 172.21.15.19:0/3587103297 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc710109150 0x7fc71010f950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:37:44.416 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:44.412+0000 7fc717109640 1 --2- 172.21.15.19:0/3587103297 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc7101087d0 0x7fc710108c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:37:44.416 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:44.412+0000 7fc717109640 1 --2- 172.21.15.19:0/3587103297 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc710102dc0 0x7fc7101031a0 unknown :-1 s=CLOSED pgs=850 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:37:44.416 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:44.412+0000 7fc717109640 1 -- 172.21.15.19:0/3587103297 >> 172.21.15.19:0/3587103297 conn(0x7fc7100fe830 msgr2=0x7fc710100c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:37:44.416 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:44.412+0000 7fc717109640 1 -- 172.21.15.19:0/3587103297 shutdown_connections 2024-09-10T22:37:44.416 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:44.412+0000 7fc717109640 1 -- 172.21.15.19:0/3587103297 wait complete. 2024-09-10T22:37:44.416 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:44.412+0000 7fc717109640 1 Processor -- start 2024-09-10T22:37:44.416 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:44.413+0000 7fc717109640 1 -- start start 2024-09-10T22:37:44.417 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:44.413+0000 7fc717109640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc710102dc0 0x7fc7100754a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:37:44.417 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:44.413+0000 7fc717109640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc7101087d0 0x7fc7100759e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:37:44.417 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:44.413+0000 7fc717109640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc710109150 0x7fc710075f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:37:44.417 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:44.413+0000 7fc717109640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fc710112e10 con 0x7fc7101087d0 2024-09-10T22:37:44.417 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:44.413+0000 7fc717109640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fc710112c90 con 0x7fc710109150 2024-09-10T22:37:44.417 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:44.413+0000 7fc717109640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7fc710112f90 con 0x7fc710102dc0 2024-09-10T22:37:44.417 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:44.413+0000 7fc70ffff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc7101087d0 0x7fc7100759e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:37:44.417 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:44.413+0000 7fc70ffff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc7101087d0 0x7fc7100759e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:59406/0 (socket says 172.21.15.19:59406) 2024-09-10T22:37:44.417 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:44.413+0000 7fc70ffff640 1 -- 172.21.15.19:0/3138691472 learned_addr learned my addr 172.21.15.19:0/3138691472 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:37:44.417 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:44.413+0000 7fc714ea5640 1 --2- 172.21.15.19:0/3138691472 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc710102dc0 0x7fc7100754a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:37:44.417 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:44.413+0000 7fc7156a6640 1 --2- 172.21.15.19:0/3138691472 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc710109150 0x7fc710075f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:37:44.417 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:44.413+0000 7fc70ffff640 1 -- 172.21.15.19:0/3138691472 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc710102dc0 msgr2=0x7fc7100754a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:37:44.417 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:44.413+0000 7fc70ffff640 1 --2- 172.21.15.19:0/3138691472 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc710102dc0 0x7fc7100754a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:37:44.418 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:44.413+0000 7fc70ffff640 1 -- 172.21.15.19:0/3138691472 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc710109150 msgr2=0x7fc710075f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:37:44.418 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:44.413+0000 7fc70ffff640 1 --2- 172.21.15.19:0/3138691472 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc710109150 0x7fc710075f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:37:44.418 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:44.413+0000 7fc70ffff640 1 -- 172.21.15.19:0/3138691472 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc7101a76c0 con 0x7fc7101087d0 2024-09-10T22:37:44.418 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:44.413+0000 7fc7156a6640 1 --2- 172.21.15.19:0/3138691472 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc710109150 0x7fc710075f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T22:37:44.418 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:44.413+0000 7fc70ffff640 1 --2- 172.21.15.19:0/3138691472 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc7101087d0 0x7fc7100759e0 secure :-1 s=READY pgs=851 cs=0 l=1 rev1=1 crypto rx=0x7fc70400d770 tx=0x7fc70400dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:37:44.418 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:44.414+0000 7fc70dffb640 1 -- 172.21.15.19:0/3138691472 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc704017070 con 0x7fc7101087d0 2024-09-10T22:37:44.418 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:44.414+0000 7fc717109640 1 -- 172.21.15.19:0/3138691472 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc7101a79b0 con 0x7fc7101087d0 2024-09-10T22:37:44.418 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:44.414+0000 7fc70dffb640 1 -- 172.21.15.19:0/3138691472 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc7040054d0 con 0x7fc7101087d0 2024-09-10T22:37:44.418 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:44.414+0000 7fc70dffb640 1 -- 172.21.15.19:0/3138691472 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc704004c30 con 0x7fc7101087d0 2024-09-10T22:37:44.418 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:44.414+0000 7fc717109640 1 -- 172.21.15.19:0/3138691472 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc7101a7ef0 con 0x7fc7101087d0 2024-09-10T22:37:44.420 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:44.417+0000 7fc7194de740 1 Processor -- start 2024-09-10T22:37:44.420 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:44.417+0000 7fc7194de740 1 -- start start 2024-09-10T22:37:44.421 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:44.417+0000 7fc70dffb640 1 -- 172.21.15.19:0/3138691472 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 18) ==== 153250+0+0 (secure 0 0 0) 0x7fc704004e10 con 0x7fc7101087d0 2024-09-10T22:37:44.421 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:44.417+0000 7fc7194de740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55baddf5b480 0x55baddf5b860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:37:44.421 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:44.417+0000 7fc7194de740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55baddf5bda0 0x55baddf677f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:37:44.421 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:44.417+0000 7fc7194de740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55baddf67d30 0x55baddf6a120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:37:44.421 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:44.417+0000 7fc7194de740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x55badded1e50 con 0x55baddf67d30 2024-09-10T22:37:44.421 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:44.417+0000 7fc7194de740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55baddec1280 con 0x55baddf5bda0 2024-09-10T22:37:44.421 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:44.417+0000 7fc7194de740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x55baddec5090 con 0x55baddf5b480 2024-09-10T22:37:44.421 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:44.418+0000 7fc70ffff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55baddf67d30 0x55baddf6a120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:37:44.421 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:44.418+0000 7fc70ffff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55baddf67d30 0x55baddf6a120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:59414/0 (socket says 172.21.15.19:59414) 2024-09-10T22:37:44.421 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:44.418+0000 7fc70ffff640 1 -- 172.21.15.19:0/3560400731 learned_addr learned my addr 172.21.15.19:0/3560400731 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:37:44.421 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:44.418+0000 7fc7156a6640 1 --2- 172.21.15.19:0/3560400731 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55baddf5b480 0x55baddf5b860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:37:44.421 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:44.418+0000 7fc714ea5640 1 --2- 172.21.15.19:0/3560400731 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55baddf5bda0 0x55baddf677f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:37:44.422 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:44.418+0000 7fc70ffff640 1 -- 172.21.15.19:0/3560400731 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55baddf5b480 msgr2=0x55baddf5b860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:37:44.422 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:44.418+0000 7fc70ffff640 1 --2- 172.21.15.19:0/3560400731 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55baddf5b480 0x55baddf5b860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:37:44.422 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:44.418+0000 7fc70ffff640 1 -- 172.21.15.19:0/3560400731 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55baddf5bda0 msgr2=0x55baddf677f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:37:44.422 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:44.418+0000 7fc70ffff640 1 --2- 172.21.15.19:0/3560400731 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55baddf5bda0 0x55baddf677f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:37:44.422 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:44.418+0000 7fc70ffff640 1 -- 172.21.15.19:0/3560400731 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55baddc1f650 con 0x55baddf67d30 2024-09-10T22:37:44.422 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:44.418+0000 7fc714ea5640 1 --2- 172.21.15.19:0/3560400731 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55baddf5bda0 0x55baddf677f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T22:37:44.422 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:44.418+0000 7fc70dffb640 1 --2- 172.21.15.19:0/3138691472 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7fc6f80b52e0 0x7fc6f80b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:37:44.422 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:44.418+0000 7fc70ffff640 1 --2- 172.21.15.19:0/3560400731 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55baddf67d30 0x55baddf6a120 secure :-1 s=READY pgs=852 cs=0 l=1 rev1=1 crypto rx=0x7fc7040ebc10 tx=0x7fc7040ed690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e5c3a9328a277dea server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:37:44.422 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:44.418+0000 7fc7156a6640 1 --2- 172.21.15.19:0/3138691472 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7fc6f80b52e0 0x7fc6f80b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:37:44.422 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:44.418+0000 7fc70dffb640 1 -- 172.21.15.19:0/3138691472 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8327+0+0 (secure 0 0 0) 0x7fc7040e5750 con 0x7fc7101087d0 2024-09-10T22:37:44.422 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:44.418+0000 7fc6f6ffd640 1 -- 172.21.15.19:0/3560400731 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7040de020 con 0x55baddf67d30 2024-09-10T22:37:44.422 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:44.419+0000 7fc6f6ffd640 1 -- 172.21.15.19:0/3560400731 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc7040ab9c0 con 0x55baddf67d30 2024-09-10T22:37:44.422 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:44.419+0000 7fc6f6ffd640 1 -- 172.21.15.19:0/3560400731 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7040a7d50 con 0x55baddf67d30 2024-09-10T22:37:44.426 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:44.419+0000 7fc7156a6640 1 --2- 172.21.15.19:0/3138691472 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7fc6f80b52e0 0x7fc6f80b77a0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7fc710077560 tx=0x7fc70000b550 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:37:44.426 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:44.419+0000 7fc7194de740 1 -- 172.21.15.19:0/3560400731 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55baddf67d30 msgr2=0x55baddf6a120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:37:44.426 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:44.419+0000 7fc7194de740 1 --2- 172.21.15.19:0/3560400731 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55baddf67d30 0x55baddf6a120 secure :-1 s=READY pgs=852 cs=0 l=1 rev1=1 crypto rx=0x7fc7040ebc10 tx=0x7fc7040ed690 comp rx=0 tx=0).stop 2024-09-10T22:37:44.426 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:44.419+0000 7fc7194de740 1 -- 172.21.15.19:0/3560400731 shutdown_connections 2024-09-10T22:37:44.426 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:44.419+0000 7fc7194de740 1 --2- 172.21.15.19:0/3560400731 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55baddf67d30 0x55baddf6a120 unknown :-1 s=CLOSED pgs=852 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:37:44.426 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:44.419+0000 7fc7194de740 1 --2- 172.21.15.19:0/3560400731 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55baddf5bda0 0x55baddf677f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:37:44.427 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:44.419+0000 7fc7194de740 1 --2- 172.21.15.19:0/3560400731 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55baddf5b480 0x55baddf5b860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:37:44.427 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:44.419+0000 7fc7194de740 1 -- 172.21.15.19:0/3560400731 >> 172.21.15.19:0/3560400731 conn(0x55baddf592b0 msgr2=0x55baddf5a450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:37:44.427 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:44.419+0000 7fc7194de740 1 -- 172.21.15.19:0/3560400731 shutdown_connections 2024-09-10T22:37:44.427 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:44.419+0000 7fc7194de740 1 -- 172.21.15.19:0/3560400731 wait complete. 2024-09-10T22:37:44.427 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:44.420+0000 7fc7194de740 1 -- start start 2024-09-10T22:37:44.427 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:44.420+0000 7fc7194de740 1 Processor -- start 2024-09-10T22:37:44.427 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:44.420+0000 7fc7194de740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55baddf5b480 0x55baddf675c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:37:44.427 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:44.420+0000 7fc7194de740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55baddf5bda0 0x55baddf64a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:37:44.427 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:44.420+0000 7fc7194de740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55baddf67d30 0x55baddf64fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:37:44.427 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:44.420+0000 7fc7194de740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x55baddd22700 con 0x55baddf5b480 2024-09-10T22:37:44.427 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:44.420+0000 7fc7194de740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55badde5c110 con 0x55baddf67d30 2024-09-10T22:37:44.427 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:44.420+0000 7fc7194de740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x55baddf6a9b0 con 0x55baddf5bda0 2024-09-10T22:37:44.428 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:44.420+0000 7fc7194de740 10 client.0 _ll_register_callbacks cb 0x55badde75990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T22:37:44.428 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:44.420+0000 7fc714ea5640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55baddf5b480 0x55baddf675c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:37:44.428 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:44.420+0000 7fc714ea5640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55baddf5b480 0x55baddf675c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:59420/0 (socket says 172.21.15.19:59420) 2024-09-10T22:37:44.428 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:44.420+0000 7fc714ea5640 1 -- 172.21.15.19:0/432609666 learned_addr learned my addr 172.21.15.19:0/432609666 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:37:44.428 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:44.421+0000 7fc70ffff640 1 --2- 172.21.15.19:0/432609666 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55baddf5bda0 0x55baddf64a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:37:44.428 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:44.421+0000 7fc7156a6640 1 --2- 172.21.15.19:0/432609666 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55baddf67d30 0x55baddf64fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:37:44.428 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:44.421+0000 7fc714ea5640 1 -- 172.21.15.19:0/432609666 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55baddf5bda0 msgr2=0x55baddf64a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:37:44.428 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:44.421+0000 7fc714ea5640 1 --2- 172.21.15.19:0/432609666 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55baddf5bda0 0x55baddf64a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:37:44.428 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:44.421+0000 7fc714ea5640 1 -- 172.21.15.19:0/432609666 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55baddf67d30 msgr2=0x55baddf64fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:37:44.428 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:44.421+0000 7fc714ea5640 1 --2- 172.21.15.19:0/432609666 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55baddf67d30 0x55baddf64fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:37:44.428 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:44.421+0000 7fc714ea5640 1 -- 172.21.15.19:0/432609666 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55badde89c40 con 0x55baddf5b480 2024-09-10T22:37:44.428 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:44.421+0000 7fc70ffff640 1 --2- 172.21.15.19:0/432609666 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55baddf5bda0 0x55baddf64a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T22:37:44.428 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:44.421+0000 7fc714ea5640 1 --2- 172.21.15.19:0/432609666 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55baddf5b480 0x55baddf675c0 secure :-1 s=READY pgs=853 cs=0 l=1 rev1=1 crypto rx=0x7fc708009ca0 tx=0x7fc70802f380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f13839ab7fc737a4 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:37:44.429 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:44.421+0000 7fc6effff640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-10T22:37:44.429 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:44.421+0000 7fc6effff640 1 -- 172.21.15.19:0/432609666 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc708031720 con 0x55baddf5b480 2024-09-10T22:37:44.429 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:44.421+0000 7fc6effff640 1 -- 172.21.15.19:0/432609666 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8327+0+0 (secure 0 0 0) 0x7fc7080318c0 con 0x55baddf5b480 2024-09-10T22:37:44.429 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:44.421+0000 7fc7194de740 1 -- 172.21.15.19:0/432609666 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc7040ab9c0 con 0x55baddf5b480 2024-09-10T22:37:44.429 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:44.421+0000 7fc6effff640 1 -- 172.21.15.19:0/432609666 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fc708004b40 con 0x55baddf5b480 2024-09-10T22:37:44.429 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:44.421+0000 7fc7194de740 10 client.17553 fetch_fsmap learned FSMap version 28 2024-09-10T22:37:44.429 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:44.421+0000 7fc7194de740 1 -- 172.21.15.19:0/432609666 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55baddf762b0 con 0x55baddf5b480 2024-09-10T22:37:44.429 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:44.422+0000 7fc6effff640 1 -- 172.21.15.19:0/432609666 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc7040ab9c0 con 0x55baddf5b480 2024-09-10T22:37:44.429 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:44.422+0000 7fc6effff640 1 -- 172.21.15.19:0/432609666 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 28) ==== 8350+0+0 (secure 0 0 0) 0x7fc7080044f0 con 0x55baddf5b480 2024-09-10T22:37:44.429 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:44.422+0000 7fc7194de740 10 client.17553 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T22:37:44.429 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:44.422+0000 7fc7194de740 10 client.17553 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-10T22:37:44.429 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:44.422+0000 7fc7194de740 20 client.17553 populate_metadata read hostname 'smithi019' 2024-09-10T22:37:44.429 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:44.422+0000 7fc7194de740 1 --2- 172.21.15.19:0/432609666 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x55baddf77810 0x55baddf79c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:37:44.430 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:44.422+0000 7fc7194de740 4 client.17553 mds_command: new command op to 24581 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T22:37:44.430 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:44.422+0000 7fc7194de740 1 -- 172.21.15.19:0/432609666 --> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55badded3da0 con 0x55baddf77810 2024-09-10T22:37:44.430 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:44.422+0000 7fc70ffff640 1 --2- 172.21.15.19:0/432609666 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x55baddf77810 0x55baddf79c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:37:44.430 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:44.423+0000 7fc6effff640 10 client.17553 ms_handle_connect on v2:172.21.15.135:6838/1254769802 2024-09-10T22:37:44.430 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:44.423+0000 7fc70ffff640 1 --2- 172.21.15.19:0/432609666 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x55baddf77810 0x55baddf79c80 crc :-1 s=READY pgs=216 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6427753c24674652 server_cookie=24180a133c1b4ad0 in_seq=0 out_seq=0 2024-09-10T22:37:44.430 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:44.423+0000 7fc6effff640 1 -- 172.21.15.19:0/432609666 <== mds.0 v2:172.21.15.135:6838/1254769802 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55badded3da0 con 0x55baddf77810 2024-09-10T22:37:44.430 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:44.423+0000 7fc6effff640 10 client.17553 handle_command_reply: tid=0 2024-09-10T22:37:44.430 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:44.423+0000 7fc7194de740 1 client.17553 shutdown 2024-09-10T22:37:44.430 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:44.424+0000 7fc7194de740 1 -- 172.21.15.19:0/432609666 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55baddf5b480 msgr2=0x55baddf675c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:37:44.430 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:44.424+0000 7fc7194de740 1 --2- 172.21.15.19:0/432609666 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55baddf5b480 0x55baddf675c0 secure :-1 s=READY pgs=853 cs=0 l=1 rev1=1 crypto rx=0x7fc708009ca0 tx=0x7fc70802f380 comp rx=0 tx=0).stop 2024-09-10T22:37:44.430 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:44.424+0000 7fc7194de740 1 -- 172.21.15.19:0/432609666 shutdown_connections 2024-09-10T22:37:44.430 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:44.424+0000 7fc7194de740 1 --2- 172.21.15.19:0/432609666 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55baddf67d30 0x55baddf64fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:37:44.430 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:44.424+0000 7fc7194de740 1 --2- 172.21.15.19:0/432609666 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x55baddf77810 0x55baddf79c80 crc :-1 s=READY pgs=216 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:37:44.430 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:44.424+0000 7fc7194de740 1 --2- 172.21.15.19:0/432609666 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55baddf5bda0 0x55baddf64a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:37:44.431 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:44.424+0000 7fc6effff640 0 client.17553 ms_handle_reset on v2:172.21.15.135:6838/1254769802 2024-09-10T22:37:44.431 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:44.424+0000 7fc7194de740 1 --2- 172.21.15.19:0/432609666 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55baddf5b480 0x55baddf675c0 unknown :-1 s=CLOSED pgs=853 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:37:44.431 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:44.424+0000 7fc7194de740 1 -- 172.21.15.19:0/432609666 >> 172.21.15.19:0/432609666 conn(0x55baddf592b0 msgr2=0x55baddf5ee20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:37:44.431 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:44.424+0000 7fc7194de740 1 -- 172.21.15.19:0/432609666 shutdown_connections 2024-09-10T22:37:44.431 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:44.424+0000 7fc7194de740 1 -- 172.21.15.19:0/432609666 wait complete. 2024-09-10T22:37:44.431 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:44.424+0000 7fc7194de740 20 client.17553 trim_cache size 0 max 16384 2024-09-10T22:37:44.444 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:44.441+0000 7fc7194de740 1 Processor -- start 2024-09-10T22:37:44.444 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:44.441+0000 7fc7194de740 1 -- start start 2024-09-10T22:37:44.444 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:44.442+0000 7fc7194de740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55baddf5b480 0x55baddf63f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:37:44.444 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:44.442+0000 7fc7194de740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55baddf5bda0 0x55baddf61c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:37:44.444 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:44.442+0000 7fc7194de740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55baddf67d30 0x55baddf62160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:37:44.444 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:44.442+0000 7fc7194de740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fc7101b3050 con 0x55baddf5b480 2024-09-10T22:37:44.444 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:44.442+0000 7fc7194de740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fc7101b08f0 con 0x55baddf5bda0 2024-09-10T22:37:44.444 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:44.442+0000 7fc7194de740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7fc7101ae790 con 0x55baddf67d30 2024-09-10T22:37:44.444 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:44.442+0000 7fc714ea5640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55baddf5b480 0x55baddf63f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:37:44.444 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:44.442+0000 7fc714ea5640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55baddf5b480 0x55baddf63f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:59432/0 (socket says 172.21.15.19:59432) 2024-09-10T22:37:44.444 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:44.442+0000 7fc714ea5640 1 -- 172.21.15.19:0/1135984019 learned_addr learned my addr 172.21.15.19:0/1135984019 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:37:44.444 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:44.442+0000 7fc70ffff640 1 --2- 172.21.15.19:0/1135984019 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55baddf5bda0 0x55baddf61c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:37:44.445 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:44.442+0000 7fc7156a6640 1 --2- 172.21.15.19:0/1135984019 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55baddf67d30 0x55baddf62160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:37:44.445 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:44.442+0000 7fc714ea5640 1 -- 172.21.15.19:0/1135984019 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55baddf67d30 msgr2=0x55baddf62160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:37:44.445 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:44.442+0000 7fc714ea5640 1 --2- 172.21.15.19:0/1135984019 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55baddf67d30 0x55baddf62160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:37:44.445 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:44.442+0000 7fc714ea5640 1 -- 172.21.15.19:0/1135984019 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55baddf5bda0 msgr2=0x55baddf61c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:37:44.445 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:44.442+0000 7fc714ea5640 1 --2- 172.21.15.19:0/1135984019 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55baddf5bda0 0x55baddf61c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:37:44.445 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:44.442+0000 7fc714ea5640 1 -- 172.21.15.19:0/1135984019 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55baddf647c0 con 0x55baddf5b480 2024-09-10T22:37:44.445 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:44.442+0000 7fc714ea5640 1 --2- 172.21.15.19:0/1135984019 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55baddf5b480 0x55baddf63f20 secure :-1 s=READY pgs=854 cs=0 l=1 rev1=1 crypto rx=0x7fc708006010 tx=0x7fc70802a8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4e6decd8ebfd695 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:37:44.447 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:44.442+0000 7fc6f67fc640 1 -- 172.21.15.19:0/1135984019 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc708053020 con 0x55baddf5b480 2024-09-10T22:37:44.448 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:44.443+0000 7fc6f67fc640 1 -- 172.21.15.19:0/1135984019 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc708036050 con 0x55baddf5b480 2024-09-10T22:37:44.448 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:44.443+0000 7fc6f67fc640 1 -- 172.21.15.19:0/1135984019 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc708030a70 con 0x55baddf5b480 2024-09-10T22:37:44.448 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:44.443+0000 7fc7194de740 1 -- 172.21.15.19:0/1135984019 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55baddf5b480 msgr2=0x55baddf63f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:37:44.448 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:44.443+0000 7fc7194de740 1 --2- 172.21.15.19:0/1135984019 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55baddf5b480 0x55baddf63f20 secure :-1 s=READY pgs=854 cs=0 l=1 rev1=1 crypto rx=0x7fc708006010 tx=0x7fc70802a8c0 comp rx=0 tx=0).stop 2024-09-10T22:37:44.448 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:44.443+0000 7fc7194de740 1 -- 172.21.15.19:0/1135984019 shutdown_connections 2024-09-10T22:37:44.448 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:44.443+0000 7fc7194de740 1 --2- 172.21.15.19:0/1135984019 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55baddf67d30 0x55baddf62160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:37:44.448 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:44.443+0000 7fc7194de740 1 --2- 172.21.15.19:0/1135984019 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55baddf5bda0 0x55baddf61c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:37:44.448 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:44.443+0000 7fc7194de740 1 --2- 172.21.15.19:0/1135984019 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55baddf5b480 0x55baddf63f20 unknown :-1 s=CLOSED pgs=854 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:37:44.449 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:44.443+0000 7fc7194de740 1 -- 172.21.15.19:0/1135984019 >> 172.21.15.19:0/1135984019 conn(0x55baddf592b0 msgr2=0x55baddf66860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:37:44.449 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:44.443+0000 7fc7194de740 1 -- 172.21.15.19:0/1135984019 shutdown_connections 2024-09-10T22:37:44.449 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:44.443+0000 7fc7194de740 1 -- 172.21.15.19:0/1135984019 wait complete. 2024-09-10T22:37:44.449 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:44.444+0000 7fc7194de740 1 -- start start 2024-09-10T22:37:44.449 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:44.444+0000 7fc7194de740 1 Processor -- start 2024-09-10T22:37:44.449 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:44.444+0000 7fc7194de740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55baddf5b480 0x55baddf6be70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:37:44.449 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:44.444+0000 7fc7194de740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55baddf5bda0 0x55baddf6c3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:37:44.449 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:44.444+0000 7fc7194de740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55baddf67d30 0x55baddf6c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:37:44.449 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:44.444+0000 7fc7194de740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fc7101aee00 con 0x55baddf5bda0 2024-09-10T22:37:44.449 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:44.444+0000 7fc7194de740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fc7101b0220 con 0x55baddf67d30 2024-09-10T22:37:44.449 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:44.444+0000 7fc7194de740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7fc7101af480 con 0x55baddf5b480 2024-09-10T22:37:44.450 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:44.444+0000 7fc7194de740 10 client.0 _ll_register_callbacks cb 0x7fc70802afc0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T22:37:44.450 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:44.444+0000 7fc70ffff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55baddf5bda0 0x55baddf6c3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:37:44.450 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:44.444+0000 7fc70ffff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55baddf5bda0 0x55baddf6c3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:59438/0 (socket says 172.21.15.19:59438) 2024-09-10T22:37:44.450 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:44.444+0000 7fc70ffff640 1 -- 172.21.15.19:0/2472337410 learned_addr learned my addr 172.21.15.19:0/2472337410 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:37:44.450 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:44.444+0000 7fc714ea5640 1 --2- 172.21.15.19:0/2472337410 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55baddf5b480 0x55baddf6be70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:37:44.450 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:44.445+0000 7fc7156a6640 1 --2- 172.21.15.19:0/2472337410 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55baddf67d30 0x55baddf6c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:37:44.450 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:44.445+0000 7fc70ffff640 1 -- 172.21.15.19:0/2472337410 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55baddf5b480 msgr2=0x55baddf6be70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:37:44.450 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:44.445+0000 7fc70ffff640 1 --2- 172.21.15.19:0/2472337410 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55baddf5b480 0x55baddf6be70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:37:44.450 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:44.445+0000 7fc70ffff640 1 -- 172.21.15.19:0/2472337410 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55baddf67d30 msgr2=0x55baddf6c8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:37:44.450 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:44.445+0000 7fc70ffff640 1 --2- 172.21.15.19:0/2472337410 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55baddf67d30 0x55baddf6c8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:37:44.450 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:44.445+0000 7fc70ffff640 1 -- 172.21.15.19:0/2472337410 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55baddfe39f0 con 0x55baddf5bda0 2024-09-10T22:37:44.450 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:44.445+0000 7fc70ffff640 1 --2- 172.21.15.19:0/2472337410 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55baddf5bda0 0x55baddf6c3b0 secure :-1 s=READY pgs=855 cs=0 l=1 rev1=1 crypto rx=0x7fc70400d740 tx=0x7fc7040a8500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8236738100dab766 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:37:44.450 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:44.445+0000 7fc6effff640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-10T22:37:44.450 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:44.445+0000 7fc6effff640 1 -- 172.21.15.19:0/2472337410 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc70405b070 con 0x55baddf5bda0 2024-09-10T22:37:44.451 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:44.445+0000 7fc6effff640 1 -- 172.21.15.19:0/2472337410 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8327+0+0 (secure 0 0 0) 0x7fc704009c30 con 0x55baddf5bda0 2024-09-10T22:37:44.451 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:44.445+0000 7fc7194de740 1 -- 172.21.15.19:0/2472337410 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc708036050 con 0x55baddf5bda0 2024-09-10T22:37:44.451 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:44.445+0000 7fc6effff640 1 -- 172.21.15.19:0/2472337410 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fc704020040 con 0x55baddf5bda0 2024-09-10T22:37:44.451 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:44.445+0000 7fc7194de740 10 client.17559 fetch_fsmap learned FSMap version 28 2024-09-10T22:37:44.451 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:44.445+0000 7fc7194de740 1 -- 172.21.15.19:0/2472337410 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55baddfe4d30 con 0x55baddf5bda0 2024-09-10T22:37:44.451 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:44.446+0000 7fc6effff640 1 -- 172.21.15.19:0/2472337410 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc708036050 con 0x55baddf5bda0 2024-09-10T22:37:44.451 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:44.446+0000 7fc6effff640 1 -- 172.21.15.19:0/2472337410 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 28) ==== 8350+0+0 (secure 0 0 0) 0x7fc7040a8120 con 0x55baddf5bda0 2024-09-10T22:37:44.451 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:44.446+0000 7fc7194de740 10 client.17559 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T22:37:44.451 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:44.446+0000 7fc7194de740 10 client.17559 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-10T22:37:44.451 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:44.446+0000 7fc7194de740 20 client.17559 populate_metadata read hostname 'smithi019' 2024-09-10T22:37:44.451 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:44.446+0000 7fc7194de740 1 --2- 172.21.15.19:0/2472337410 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x55baddf77810 0x55baddfe7020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:37:44.451 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:44.446+0000 7fc7194de740 4 client.17559 mds_command: new command op to 24581 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-10T22:37:44.451 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:44.446+0000 7fc7194de740 1 -- 172.21.15.19:0/2472337410 --> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55baddecf850 con 0x55baddf77810 2024-09-10T22:37:44.452 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:44.446+0000 7fc714ea5640 1 --2- 172.21.15.19:0/2472337410 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x55baddf77810 0x55baddfe7020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:37:44.453 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:44.447+0000 7fc6effff640 10 client.17559 ms_handle_connect on v2:172.21.15.135:6838/1254769802 2024-09-10T22:37:44.453 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:44.447+0000 7fc714ea5640 1 --2- 172.21.15.19:0/2472337410 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x55baddf77810 0x55baddfe7020 crc :-1 s=READY pgs=217 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f00040d90145920b server_cookie=8eb7cd9a4f59dc19 in_seq=0 out_seq=0 2024-09-10T22:37:44.453 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:44.447+0000 7fc6effff640 1 -- 172.21.15.19:0/2472337410 <== mds.0 v2:172.21.15.135:6838/1254769802 1 ==== command_reply(tid 0: 0 ) ==== 8+0+4350 (crc 0 0 0) 0x55baddecf850 con 0x55baddf77810 2024-09-10T22:37:44.453 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:44.447+0000 7fc6effff640 10 client.17559 handle_command_reply: tid=0 2024-09-10T22:37:44.453 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:44.447+0000 7fc7194de740 1 client.17559 shutdown 2024-09-10T22:37:44.453 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:44.447+0000 7fc7194de740 1 -- 172.21.15.19:0/2472337410 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55baddf5bda0 msgr2=0x55baddf6c3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:37:44.453 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:44.447+0000 7fc7194de740 1 --2- 172.21.15.19:0/2472337410 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55baddf5bda0 0x55baddf6c3b0 secure :-1 s=READY pgs=855 cs=0 l=1 rev1=1 crypto rx=0x7fc70400d740 tx=0x7fc7040a8500 comp rx=0 tx=0).stop 2024-09-10T22:37:44.453 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:44.447+0000 7fc7194de740 1 -- 172.21.15.19:0/2472337410 shutdown_connections 2024-09-10T22:37:44.453 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:44.447+0000 7fc7194de740 1 --2- 172.21.15.19:0/2472337410 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55baddf67d30 0x55baddf6c8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:37:44.453 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:44.447+0000 7fc7194de740 1 --2- 172.21.15.19:0/2472337410 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55baddf5bda0 0x55baddf6c3b0 unknown :-1 s=CLOSED pgs=855 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:37:44.453 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:44.447+0000 7fc7194de740 1 --2- 172.21.15.19:0/2472337410 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x55baddf77810 0x55baddfe7020 crc :-1 s=READY pgs=217 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:37:44.454 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:44.447+0000 7fc7194de740 1 --2- 172.21.15.19:0/2472337410 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55baddf5b480 0x55baddf6be70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:37:44.454 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:44.447+0000 7fc7194de740 1 -- 172.21.15.19:0/2472337410 >> 172.21.15.19:0/2472337410 conn(0x55baddf592b0 msgr2=0x55baddf72c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:37:44.454 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:44.447+0000 7fc6effff640 0 client.17559 ms_handle_reset on v2:172.21.15.135:6838/1254769802 2024-09-10T22:37:44.454 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:44.447+0000 7fc7194de740 1 -- 172.21.15.19:0/2472337410 shutdown_connections 2024-09-10T22:37:44.454 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:44.447+0000 7fc7194de740 1 -- 172.21.15.19:0/2472337410 wait complete. 2024-09-10T22:37:44.454 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:44.447+0000 7fc7194de740 20 client.17559 trim_cache size 0 max 16384 2024-09-10T22:37:44.454 INFO:teuthology.orchestra.run.smithi019.stdout:{ 2024-09-10T22:37:44.454 INFO:teuthology.orchestra.run.smithi019.stdout: "status": "no active scrubs running", 2024-09-10T22:37:44.454 INFO:teuthology.orchestra.run.smithi019.stdout: "scrubs": {}, 2024-09-10T22:37:44.455 INFO:teuthology.orchestra.run.smithi019.stdout: "scrub_stats": { 2024-09-10T22:37:44.455 INFO:teuthology.orchestra.run.smithi019.stdout: "abfbdc16-212b-47f2-b921-c2a1cae322e5": { 2024-09-10T22:37:44.455 INFO:teuthology.orchestra.run.smithi019.stdout: "start_time": "2024-09-10T22:36:26.258118+0000", 2024-09-10T22:37:44.455 INFO:teuthology.orchestra.run.smithi019.stdout: "path": "/", 2024-09-10T22:37:44.455 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_started": 0, 2024-09-10T22:37:44.455 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_passed": 0, 2024-09-10T22:37:44.455 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_failed": 0, 2024-09-10T22:37:44.455 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_skipped": 0 2024-09-10T22:37:44.455 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:44.455 INFO:teuthology.orchestra.run.smithi019.stdout: "9b6bfdee-303c-4c12-af56-dc85860d112a": { 2024-09-10T22:37:44.455 INFO:teuthology.orchestra.run.smithi019.stdout: "start_time": "2024-09-10T22:26:17.484162+0000", 2024-09-10T22:37:44.455 INFO:teuthology.orchestra.run.smithi019.stdout: "path": "/", 2024-09-10T22:37:44.455 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_started": 0, 2024-09-10T22:37:44.456 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_passed": 0, 2024-09-10T22:37:44.456 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_failed": 0, 2024-09-10T22:37:44.456 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_skipped": 0 2024-09-10T22:37:44.456 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:44.456 INFO:teuthology.orchestra.run.smithi019.stdout: "b38852c8-478a-42ef-8384-b2c55d5313a4": { 2024-09-10T22:37:44.456 INFO:teuthology.orchestra.run.smithi019.stdout: "start_time": "2024-09-10T22:27:00.320308+0000", 2024-09-10T22:37:44.456 INFO:teuthology.orchestra.run.smithi019.stdout: "path": "/", 2024-09-10T22:37:44.456 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_started": 0, 2024-09-10T22:37:44.456 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_passed": 0, 2024-09-10T22:37:44.456 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_failed": 0, 2024-09-10T22:37:44.456 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_skipped": 0 2024-09-10T22:37:44.456 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:44.457 INFO:teuthology.orchestra.run.smithi019.stdout: "c12c2a04-dcd6-4673-a98e-93f665d3f5d7": { 2024-09-10T22:37:44.457 INFO:teuthology.orchestra.run.smithi019.stdout: "start_time": "2024-09-10T22:27:49.392329+0000", 2024-09-10T22:37:44.457 INFO:teuthology.orchestra.run.smithi019.stdout: "path": "/", 2024-09-10T22:37:44.457 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_started": 0, 2024-09-10T22:37:44.457 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_passed": 0, 2024-09-10T22:37:44.457 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_failed": 0, 2024-09-10T22:37:44.457 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_skipped": 0 2024-09-10T22:37:44.457 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:44.457 INFO:teuthology.orchestra.run.smithi019.stdout: "4c99964e-2e0e-4ffd-8cb8-99c4979ed90f": { 2024-09-10T22:37:44.457 INFO:teuthology.orchestra.run.smithi019.stdout: "start_time": "2024-09-10T22:32:34.659639+0000", 2024-09-10T22:37:44.457 INFO:teuthology.orchestra.run.smithi019.stdout: "path": "/", 2024-09-10T22:37:44.457 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_started": 0, 2024-09-10T22:37:44.457 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_passed": 0, 2024-09-10T22:37:44.458 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_failed": 0, 2024-09-10T22:37:44.458 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_skipped": 0 2024-09-10T22:37:44.458 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:44.458 INFO:teuthology.orchestra.run.smithi019.stdout: "9efe684b-7583-402e-a46e-e262a37e1af5": { 2024-09-10T22:37:44.458 INFO:teuthology.orchestra.run.smithi019.stdout: "start_time": "2024-09-10T22:34:09.479768+0000", 2024-09-10T22:37:44.458 INFO:teuthology.orchestra.run.smithi019.stdout: "path": "/", 2024-09-10T22:37:44.458 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_started": 0, 2024-09-10T22:37:44.458 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_passed": 0, 2024-09-10T22:37:44.458 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_failed": 0, 2024-09-10T22:37:44.458 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_skipped": 0 2024-09-10T22:37:44.458 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:44.458 INFO:teuthology.orchestra.run.smithi019.stdout: "eb518e3c-a71e-4f32-9ca0-ae88930ca218": { 2024-09-10T22:37:44.458 INFO:teuthology.orchestra.run.smithi019.stdout: "start_time": "2024-09-10T22:28:38.366352+0000", 2024-09-10T22:37:44.458 INFO:teuthology.orchestra.run.smithi019.stdout: "path": "/", 2024-09-10T22:37:44.459 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_started": 0, 2024-09-10T22:37:44.459 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_passed": 0, 2024-09-10T22:37:44.459 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_failed": 0, 2024-09-10T22:37:44.459 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_skipped": 0 2024-09-10T22:37:44.459 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:44.459 INFO:teuthology.orchestra.run.smithi019.stdout: "8f3bb3bf-911f-490c-9856-c80ea220dbbe": { 2024-09-10T22:37:44.459 INFO:teuthology.orchestra.run.smithi019.stdout: "start_time": "2024-09-10T22:29:25.374415+0000", 2024-09-10T22:37:44.459 INFO:teuthology.orchestra.run.smithi019.stdout: "path": "/", 2024-09-10T22:37:44.459 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_started": 0, 2024-09-10T22:37:44.459 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_passed": 0, 2024-09-10T22:37:44.459 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_failed": 0, 2024-09-10T22:37:44.459 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_skipped": 0 2024-09-10T22:37:44.459 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:44.460 INFO:teuthology.orchestra.run.smithi019.stdout: "fd1f1837-dcfa-4d88-99e8-2509f36c3f98": { 2024-09-10T22:37:44.460 INFO:teuthology.orchestra.run.smithi019.stdout: "start_time": "2024-09-10T22:30:12.470477+0000", 2024-09-10T22:37:44.460 INFO:teuthology.orchestra.run.smithi019.stdout: "path": "/", 2024-09-10T22:37:44.460 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_started": 0, 2024-09-10T22:37:44.460 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_passed": 0, 2024-09-10T22:37:44.460 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_failed": 0, 2024-09-10T22:37:44.460 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_skipped": 0 2024-09-10T22:37:44.460 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:44.460 INFO:teuthology.orchestra.run.smithi019.stdout: "715ec863-8a9d-45b6-967f-59b15ce1bf12": { 2024-09-10T22:37:44.460 INFO:teuthology.orchestra.run.smithi019.stdout: "start_time": "2024-09-10T22:31:00.669516+0000", 2024-09-10T22:37:44.460 INFO:teuthology.orchestra.run.smithi019.stdout: "path": "/", 2024-09-10T22:37:44.460 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_started": 0, 2024-09-10T22:37:44.460 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_passed": 0, 2024-09-10T22:37:44.460 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_failed": 0, 2024-09-10T22:37:44.461 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_skipped": 0 2024-09-10T22:37:44.461 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:44.461 INFO:teuthology.orchestra.run.smithi019.stdout: "0b81ea61-0b8e-4f2c-a58f-ef1019289fc9": { 2024-09-10T22:37:44.461 INFO:teuthology.orchestra.run.smithi019.stdout: "start_time": "2024-09-10T22:31:48.141568+0000", 2024-09-10T22:37:44.461 INFO:teuthology.orchestra.run.smithi019.stdout: "path": "/", 2024-09-10T22:37:44.461 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_started": 0, 2024-09-10T22:37:44.461 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_passed": 0, 2024-09-10T22:37:44.461 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_failed": 0, 2024-09-10T22:37:44.461 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_skipped": 0 2024-09-10T22:37:44.461 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:44.461 INFO:teuthology.orchestra.run.smithi019.stdout: "97894c69-c36c-4d46-9917-57199df72044": { 2024-09-10T22:37:44.461 INFO:teuthology.orchestra.run.smithi019.stdout: "start_time": "2024-09-10T22:37:10.869260+0000", 2024-09-10T22:37:44.461 INFO:teuthology.orchestra.run.smithi019.stdout: "path": "/", 2024-09-10T22:37:44.462 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_started": 0, 2024-09-10T22:37:44.462 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_passed": 0, 2024-09-10T22:37:44.462 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_failed": 0, 2024-09-10T22:37:44.462 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_skipped": 0 2024-09-10T22:37:44.462 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:44.462 INFO:teuthology.orchestra.run.smithi019.stdout: "a77606c2-7618-413e-8aba-f9783ecbf435": { 2024-09-10T22:37:44.462 INFO:teuthology.orchestra.run.smithi019.stdout: "start_time": "2024-09-10T22:34:54.453894+0000", 2024-09-10T22:37:44.462 INFO:teuthology.orchestra.run.smithi019.stdout: "path": "/", 2024-09-10T22:37:44.462 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_started": 0, 2024-09-10T22:37:44.462 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_passed": 0, 2024-09-10T22:37:44.462 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_failed": 0, 2024-09-10T22:37:44.462 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_skipped": 0 2024-09-10T22:37:44.462 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:44.462 INFO:teuthology.orchestra.run.smithi019.stdout: "448b10e7-494c-4a88-a9ab-186159c5dfdd": { 2024-09-10T22:37:44.462 INFO:teuthology.orchestra.run.smithi019.stdout: "start_time": "2024-09-10T22:33:21.208716+0000", 2024-09-10T22:37:44.463 INFO:teuthology.orchestra.run.smithi019.stdout: "path": "/", 2024-09-10T22:37:44.463 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_started": 0, 2024-09-10T22:37:44.463 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_passed": 0, 2024-09-10T22:37:44.463 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_failed": 0, 2024-09-10T22:37:44.463 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_skipped": 0 2024-09-10T22:37:44.463 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:44.463 INFO:teuthology.orchestra.run.smithi019.stdout: "1a6e9f60-01cc-4339-aff0-9ef63cbda443": { 2024-09-10T22:37:44.463 INFO:teuthology.orchestra.run.smithi019.stdout: "start_time": "2024-09-10T22:35:40.561000+0000", 2024-09-10T22:37:44.463 INFO:teuthology.orchestra.run.smithi019.stdout: "path": "/", 2024-09-10T22:37:44.463 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_started": 0, 2024-09-10T22:37:44.463 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_passed": 0, 2024-09-10T22:37:44.463 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_failed": 0, 2024-09-10T22:37:44.463 INFO:teuthology.orchestra.run.smithi019.stdout: "uninline_skipped": 0 2024-09-10T22:37:44.463 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-10T22:37:44.464 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-10T22:37:44.464 INFO:teuthology.orchestra.run.smithi019.stdout:} 2024-09-10T22:37:44.464 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:44.448+0000 7fc717109640 1 -- 172.21.15.19:0/3138691472 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7fc6f80b52e0 msgr2=0x7fc6f80b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:37:44.464 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:44.448+0000 7fc717109640 1 --2- 172.21.15.19:0/3138691472 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7fc6f80b52e0 0x7fc6f80b77a0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7fc710077560 tx=0x7fc70000b550 comp rx=0 tx=0).stop 2024-09-10T22:37:44.464 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:44.448+0000 7fc717109640 1 -- 172.21.15.19:0/3138691472 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc7101087d0 msgr2=0x7fc7100759e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:37:44.464 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:44.448+0000 7fc717109640 1 --2- 172.21.15.19:0/3138691472 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc7101087d0 0x7fc7100759e0 secure :-1 s=READY pgs=851 cs=0 l=1 rev1=1 crypto rx=0x7fc70400d770 tx=0x7fc70400dc30 comp rx=0 tx=0).stop 2024-09-10T22:37:44.465 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:44.448+0000 7fc717109640 1 -- 172.21.15.19:0/3138691472 shutdown_connections 2024-09-10T22:37:44.465 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:44.448+0000 7fc717109640 1 --2- 172.21.15.19:0/3138691472 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7fc6f80b52e0 0x7fc6f80b77a0 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:37:44.465 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:44.448+0000 7fc717109640 1 --2- 172.21.15.19:0/3138691472 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc710109150 0x7fc710075f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:37:44.465 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:44.448+0000 7fc717109640 1 --2- 172.21.15.19:0/3138691472 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc7101087d0 0x7fc7100759e0 unknown :-1 s=CLOSED pgs=851 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:37:44.465 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:44.448+0000 7fc717109640 1 --2- 172.21.15.19:0/3138691472 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc710102dc0 0x7fc7100754a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:37:44.465 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:44.448+0000 7fc717109640 1 -- 172.21.15.19:0/3138691472 >> 172.21.15.19:0/3138691472 conn(0x7fc7100fe830 msgr2=0x7fc710100c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:37:44.465 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:44.448+0000 7fc717109640 1 -- 172.21.15.19:0/3138691472 shutdown_connections 2024-09-10T22:37:44.465 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:44.448+0000 7fc717109640 1 -- 172.21.15.19:0/3138691472 wait complete. 2024-09-10T22:37:45.337 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-10T22:37:45.337 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 22997a4c-6fc2-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-10T22:37:45.604 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/22997a4c-6fc2-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T22:37:46.047 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:37:45 smithi019 ceph-mon[31375]: pgmap v687: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 41 MiB/s wr, 224 op/s 2024-09-10T22:37:46.109 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:37:45 smithi135 ceph-mon[34789]: pgmap v687: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 41 MiB/s wr, 224 op/s 2024-09-10T22:37:46.125 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:37:45 smithi138 ceph-mon[35236]: pgmap v687: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 41 MiB/s wr, 224 op/s 2024-09-10T22:37:46.395 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:46.281+0000 7fc0c87c1640 1 -- 172.21.15.19:0/2909212703 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc0c0102de0 msgr2=0x7fc0c01031c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:37:46.395 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:46.281+0000 7fc0c87c1640 1 --2- 172.21.15.19:0/2909212703 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc0c0102de0 0x7fc0c01031c0 secure :-1 s=READY pgs=856 cs=0 l=1 rev1=1 crypto rx=0x7fc0bc009900 tx=0x7fc0bc02a410 comp rx=0 tx=0).stop 2024-09-10T22:37:46.395 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:46.281+0000 7fc0c87c1640 1 -- 172.21.15.19:0/2909212703 shutdown_connections 2024-09-10T22:37:46.395 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:46.281+0000 7fc0c87c1640 1 --2- 172.21.15.19:0/2909212703 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc0c0109170 0x7fc0c010f970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:37:46.395 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:46.281+0000 7fc0c87c1640 1 --2- 172.21.15.19:0/2909212703 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc0c01087f0 0x7fc0c0108c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:37:46.395 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:46.281+0000 7fc0c87c1640 1 --2- 172.21.15.19:0/2909212703 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc0c0102de0 0x7fc0c01031c0 unknown :-1 s=CLOSED pgs=856 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:37:46.395 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:46.281+0000 7fc0c87c1640 1 -- 172.21.15.19:0/2909212703 >> 172.21.15.19:0/2909212703 conn(0x7fc0c00fe870 msgr2=0x7fc0c0100c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:37:46.395 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:46.281+0000 7fc0c87c1640 1 -- 172.21.15.19:0/2909212703 shutdown_connections 2024-09-10T22:37:46.395 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:46.281+0000 7fc0c87c1640 1 -- 172.21.15.19:0/2909212703 wait complete. 2024-09-10T22:37:46.396 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:46.282+0000 7fc0c87c1640 1 Processor -- start 2024-09-10T22:37:46.396 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:46.282+0000 7fc0c87c1640 1 -- start start 2024-09-10T22:37:46.396 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:46.282+0000 7fc0c87c1640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc0c0102de0 0x7fc0c0199320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:37:46.396 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:46.282+0000 7fc0c87c1640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc0c01087f0 0x7fc0c0199860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:37:46.396 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:46.282+0000 7fc0c87c1640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc0c0109170 0x7fc0c019ec00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:37:46.396 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:46.282+0000 7fc0c87c1640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fc0c0112e30 con 0x7fc0c01087f0 2024-09-10T22:37:46.396 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:46.282+0000 7fc0c87c1640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fc0c0112cb0 con 0x7fc0c0102de0 2024-09-10T22:37:46.396 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:46.282+0000 7fc0c87c1640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7fc0c0112fb0 con 0x7fc0c0109170 2024-09-10T22:37:46.396 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:46.282+0000 7fc0c5d5c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc0c01087f0 0x7fc0c0199860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:37:46.396 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:46.282+0000 7fc0c5d5c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc0c01087f0 0x7fc0c0199860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:59452/0 (socket says 172.21.15.19:59452) 2024-09-10T22:37:46.396 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:46.282+0000 7fc0c5d5c640 1 -- 172.21.15.19:0/1062921210 learned_addr learned my addr 172.21.15.19:0/1062921210 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:37:46.396 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:46.282+0000 7fc0c655d640 1 --2- 172.21.15.19:0/1062921210 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc0c0102de0 0x7fc0c0199320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:37:46.397 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:46.282+0000 7fc0c6d5e640 1 --2- 172.21.15.19:0/1062921210 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc0c0109170 0x7fc0c019ec00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:37:46.397 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:46.282+0000 7fc0c5d5c640 1 -- 172.21.15.19:0/1062921210 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc0c0109170 msgr2=0x7fc0c019ec00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:37:46.397 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:46.282+0000 7fc0c5d5c640 1 --2- 172.21.15.19:0/1062921210 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc0c0109170 0x7fc0c019ec00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:37:46.397 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:46.282+0000 7fc0c5d5c640 1 -- 172.21.15.19:0/1062921210 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc0c0102de0 msgr2=0x7fc0c0199320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:37:46.397 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:46.282+0000 7fc0c5d5c640 1 --2- 172.21.15.19:0/1062921210 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc0c0102de0 0x7fc0c0199320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:37:46.397 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:46.282+0000 7fc0c5d5c640 1 -- 172.21.15.19:0/1062921210 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc0c019f3d0 con 0x7fc0c01087f0 2024-09-10T22:37:46.397 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:46.282+0000 7fc0c6d5e640 1 --2- 172.21.15.19:0/1062921210 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc0c0109170 0x7fc0c019ec00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T22:37:46.397 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:46.283+0000 7fc0c5d5c640 1 --2- 172.21.15.19:0/1062921210 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc0c01087f0 0x7fc0c0199860 secure :-1 s=READY pgs=857 cs=0 l=1 rev1=1 crypto rx=0x7fc0b000d950 tx=0x7fc0b000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:37:46.397 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:46.283+0000 7fc0b77fe640 1 -- 172.21.15.19:0/1062921210 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0b0017030 con 0x7fc0c01087f0 2024-09-10T22:37:46.397 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:46.283+0000 7fc0c87c1640 1 -- 172.21.15.19:0/1062921210 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc0c019f6c0 con 0x7fc0c01087f0 2024-09-10T22:37:46.397 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:46.283+0000 7fc0b77fe640 1 -- 172.21.15.19:0/1062921210 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc0b0004020 con 0x7fc0c01087f0 2024-09-10T22:37:46.397 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:46.283+0000 7fc0b77fe640 1 -- 172.21.15.19:0/1062921210 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0b00047a0 con 0x7fc0c01087f0 2024-09-10T22:37:46.398 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:46.283+0000 7fc0c87c1640 1 -- 172.21.15.19:0/1062921210 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc0c01a5f50 con 0x7fc0c01087f0 2024-09-10T22:37:46.398 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:46.284+0000 7fc0c87c1640 1 -- 172.21.15.19:0/1062921210 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc0c01031c0 con 0x7fc0c01087f0 2024-09-10T22:37:46.398 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:46.285+0000 7fc0b77fe640 1 -- 172.21.15.19:0/1062921210 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 18) ==== 153250+0+0 (secure 0 0 0) 0x7fc0b0009a30 con 0x7fc0c01087f0 2024-09-10T22:37:46.398 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:46.286+0000 7fc0b77fe640 1 --2- 172.21.15.19:0/1062921210 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7fc0ac0b5360 0x7fc0ac0b7820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:37:46.398 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:46.286+0000 7fc0c655d640 1 --2- 172.21.15.19:0/1062921210 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7fc0ac0b5360 0x7fc0ac0b7820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:37:46.398 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:46.286+0000 7fc0b77fe640 1 -- 172.21.15.19:0/1062921210 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8327+0+0 (secure 0 0 0) 0x7fc0b00e5670 con 0x7fc0c01087f0 2024-09-10T22:37:46.398 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:46.287+0000 7fc0c655d640 1 --2- 172.21.15.19:0/1062921210 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7fc0ac0b5360 0x7fc0ac0b7820 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7fc0bc031440 tx=0x7fc0bc005b50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:37:46.398 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:46.290+0000 7fc0b77fe640 1 -- 172.21.15.19:0/1062921210 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7fc0b00ac470 con 0x7fc0c01087f0 2024-09-10T22:37:46.519 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:46.517+0000 7fc0c87c1640 1 -- 172.21.15.19:0/1062921210 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc0c019a450 con 0x7fc0c01087f0 2024-09-10T22:37:46.519 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:46.518+0000 7fc0b77fe640 1 -- 172.21.15.19:0/1062921210 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+11922 (secure 0 0 0) 0x7fc0b00abd70 con 0x7fc0c01087f0 2024-09-10T22:37:46.520 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-10T22:37:46.520 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":28,"btime":"2024-09-10T22:37:18:681285+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14673,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6835/1835804747","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6834","nonce":1835804747},{"type":"v1","addr":"172.21.15.19:6835","nonce":1835804747}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14685,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6837/1750470490","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6836","nonce":1750470490},{"type":"v1","addr":"172.21.15.19:6837","nonce":1750470490}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14733,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6839/2642941149","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6838","nonce":2642941149},{"type":"v1","addr":"172.21.15.19:6839","nonce":2642941149}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14745,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6841/2449948682","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6840","nonce":2449948682},{"type":"v1","addr":"172.21.15.19:6841","nonce":2449948682}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24511,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.138:6833/2524811494","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6832","nonce":2524811494},{"type":"v1","addr":"172.21.15.138:6833","nonce":2524811494}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24512,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6833/3014993624","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6832","nonce":3014993624},{"type":"v1","addr":"172.21.15.135:6833","nonce":3014993624}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":28,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-10T22:24:22.733925+0000","modified":"2024-09-10T22:37:18.535834+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24581,"mds_1":24568,"mds_2":24553},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24527":{"gid":24527,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.135:6835/3715773348","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6834","nonce":3715773348},{"type":"v1","addr":"172.21.15.135:6835","nonce":3715773348}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24541":{"gid":24541,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.138:6835/933547028","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6834","nonce":933547028},{"type":"v1","addr":"172.21.15.138:6835","nonce":933547028}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24551":{"gid":24551,"name":"h","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.135:6837/3495029135","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6836","nonce":3495029135},{"type":"v1","addr":"172.21.15.135:6837","nonce":3495029135}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24553":{"gid":24553,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":10,"addr":"172.21.15.138:6837/3353290042","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6836","nonce":3353290042},{"type":"v1","addr":"172.21.15.138:6837","nonce":3353290042}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24568":{"gid":24568,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.138:6839/383637208","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6838","nonce":383637208},{"type":"v1","addr":"172.21.15.138:6839","nonce":383637208}]},"join_fscid":-1,"export_targets":[0],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24581":{"gid":24581,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.135:6839/1254769802","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6838","nonce":1254769802},{"type":"v1","addr":"172.21.15.135:6839","nonce":1254769802}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24581,"qdb_cluster":[24553,24568,24581]},"id":1}]} 2024-09-10T22:37:46.520 INFO:teuthology.orchestra.run.smithi019.stderr:dumped fsmap epoch 28 2024-09-10T22:37:46.521 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:46.520+0000 7fc0c87c1640 1 -- 172.21.15.19:0/1062921210 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7fc0ac0b5360 msgr2=0x7fc0ac0b7820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:37:46.521 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:46.520+0000 7fc0c87c1640 1 --2- 172.21.15.19:0/1062921210 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7fc0ac0b5360 0x7fc0ac0b7820 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7fc0bc031440 tx=0x7fc0bc005b50 comp rx=0 tx=0).stop 2024-09-10T22:37:46.522 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:46.520+0000 7fc0c87c1640 1 -- 172.21.15.19:0/1062921210 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc0c01087f0 msgr2=0x7fc0c0199860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:37:46.522 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:46.520+0000 7fc0c87c1640 1 --2- 172.21.15.19:0/1062921210 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc0c01087f0 0x7fc0c0199860 secure :-1 s=READY pgs=857 cs=0 l=1 rev1=1 crypto rx=0x7fc0b000d950 tx=0x7fc0b000de10 comp rx=0 tx=0).stop 2024-09-10T22:37:46.522 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:46.520+0000 7fc0c87c1640 1 -- 172.21.15.19:0/1062921210 shutdown_connections 2024-09-10T22:37:46.522 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:46.520+0000 7fc0c87c1640 1 --2- 172.21.15.19:0/1062921210 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7fc0ac0b5360 0x7fc0ac0b7820 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:37:46.522 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:46.520+0000 7fc0c87c1640 1 --2- 172.21.15.19:0/1062921210 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc0c0109170 0x7fc0c019ec00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:37:46.522 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:46.520+0000 7fc0c87c1640 1 --2- 172.21.15.19:0/1062921210 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc0c01087f0 0x7fc0c0199860 unknown :-1 s=CLOSED pgs=857 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:37:46.522 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:46.520+0000 7fc0c87c1640 1 --2- 172.21.15.19:0/1062921210 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc0c0102de0 0x7fc0c0199320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:37:46.522 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:46.520+0000 7fc0c87c1640 1 -- 172.21.15.19:0/1062921210 >> 172.21.15.19:0/1062921210 conn(0x7fc0c00fe870 msgr2=0x7fc0c0100c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:37:46.522 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:46.520+0000 7fc0c87c1640 1 -- 172.21.15.19:0/1062921210 shutdown_connections 2024-09-10T22:37:46.522 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:46.520+0000 7fc0c87c1640 1 -- 172.21.15.19:0/1062921210 wait complete. 2024-09-10T22:37:47.110 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:37:46 smithi135 ceph-mon[34789]: from='client.? 172.21.15.19:0/1062921210' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T22:37:47.110 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:37:46 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T22:37:47.125 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:37:46 smithi138 ceph-mon[35236]: from='client.? 172.21.15.19:0/1062921210' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T22:37:47.125 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:37:46 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T22:37:47.208 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:37:46 smithi019 ceph-mon[31375]: from='client.? 172.21.15.19:0/1062921210' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T22:37:47.208 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:37:46 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T22:37:47.380 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 22997a4c-6fc2-11ef-bcea-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-09-10T22:37:47.645 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/22997a4c-6fc2-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T22:37:48.063 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:37:47 smithi019 ceph-mon[31375]: pgmap v688: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 48 MiB/s wr, 195 op/s 2024-09-10T22:37:48.063 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:37:47 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:37:48.063 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:37:47 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:37:48.063 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:37:47 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:37:48.063 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:37:47 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:37:48.063 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:37:47 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:37:48.063 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:37:47 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:37:48.063 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:37:47 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T22:37:48.064 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:37:47 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T22:37:48.064 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:37:47 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:37:48.162 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:48.145+0000 7f407c4c8640 1 -- 172.21.15.19:0/3185025861 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4074101cd0 msgr2=0x7f40741020b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:37:48.162 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:48.145+0000 7f407c4c8640 1 --2- 172.21.15.19:0/3185025861 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4074101cd0 0x7f40741020b0 secure :-1 s=READY pgs=858 cs=0 l=1 rev1=1 crypto rx=0x7f4070009ca0 tx=0x7f407002a8c0 comp rx=0 tx=0).stop 2024-09-10T22:37:48.163 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:48.145+0000 7f407c4c8640 1 -- 172.21.15.19:0/3185025861 shutdown_connections 2024-09-10T22:37:48.163 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:48.145+0000 7f407c4c8640 1 --2- 172.21.15.19:0/3185025861 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f4074108060 0x7f407410e860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:37:48.163 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:48.145+0000 7f407c4c8640 1 --2- 172.21.15.19:0/3185025861 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f40741076e0 0x7f4074107b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:37:48.163 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:48.145+0000 7f407c4c8640 1 --2- 172.21.15.19:0/3185025861 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4074101cd0 0x7f40741020b0 unknown :-1 s=CLOSED pgs=858 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:37:48.163 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:48.145+0000 7f407c4c8640 1 -- 172.21.15.19:0/3185025861 >> 172.21.15.19:0/3185025861 conn(0x7f40740fd720 msgr2=0x7f40740ffb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:37:48.163 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:48.145+0000 7f407c4c8640 1 -- 172.21.15.19:0/3185025861 shutdown_connections 2024-09-10T22:37:48.163 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:48.145+0000 7f407c4c8640 1 -- 172.21.15.19:0/3185025861 wait complete. 2024-09-10T22:37:48.163 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:48.146+0000 7f407c4c8640 1 Processor -- start 2024-09-10T22:37:48.163 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:48.146+0000 7f407c4c8640 1 -- start start 2024-09-10T22:37:48.163 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:48.146+0000 7f407c4c8640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f4074101cd0 0x7f40741992e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:37:48.163 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:48.146+0000 7f407c4c8640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f40741076e0 0x7f4074199820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:37:48.164 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:48.146+0000 7f407c4c8640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4074108060 0x7f407419ebc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:37:48.164 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:48.146+0000 7f407c4c8640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f4074112e70 con 0x7f40741076e0 2024-09-10T22:37:48.164 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:48.146+0000 7f407c4c8640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f4074112cf0 con 0x7f4074108060 2024-09-10T22:37:48.164 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:48.146+0000 7f407c4c8640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f4074112ff0 con 0x7f4074101cd0 2024-09-10T22:37:48.164 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:48.146+0000 7f407a264640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f4074101cd0 0x7f40741992e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:37:48.164 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:48.146+0000 7f4079a63640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f40741076e0 0x7f4074199820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:37:48.164 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:48.146+0000 7f407a264640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f4074101cd0 0x7f40741992e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.19:51826/0 (socket says 172.21.15.19:51826) 2024-09-10T22:37:48.164 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:48.147+0000 7f407a264640 1 -- 172.21.15.19:0/4264368252 learned_addr learned my addr 172.21.15.19:0/4264368252 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:37:48.164 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:48.147+0000 7f407aa65640 1 --2- 172.21.15.19:0/4264368252 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4074108060 0x7f407419ebc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:37:48.164 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:48.147+0000 7f4079a63640 1 -- 172.21.15.19:0/4264368252 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f4074101cd0 msgr2=0x7f40741992e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:37:48.164 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:48.147+0000 7f4079a63640 1 --2- 172.21.15.19:0/4264368252 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f4074101cd0 0x7f40741992e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:37:48.164 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:48.147+0000 7f4079a63640 1 -- 172.21.15.19:0/4264368252 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4074108060 msgr2=0x7f407419ebc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:37:48.164 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:48.147+0000 7f4079a63640 1 --2- 172.21.15.19:0/4264368252 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4074108060 0x7f407419ebc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:37:48.165 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:48.147+0000 7f4079a63640 1 -- 172.21.15.19:0/4264368252 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f407419f390 con 0x7f40741076e0 2024-09-10T22:37:48.165 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:48.147+0000 7f407a264640 1 --2- 172.21.15.19:0/4264368252 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f4074101cd0 0x7f40741992e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T22:37:48.165 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:48.147+0000 7f4079a63640 1 --2- 172.21.15.19:0/4264368252 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f40741076e0 0x7f4074199820 secure :-1 s=READY pgs=859 cs=0 l=1 rev1=1 crypto rx=0x7f4068005fd0 tx=0x7f406800dde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:37:48.165 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:48.147+0000 7f40677fe640 1 -- 172.21.15.19:0/4264368252 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4068009c30 con 0x7f40741076e0 2024-09-10T22:37:48.165 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:48.147+0000 7f407c4c8640 1 -- 172.21.15.19:0/4264368252 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f407419f680 con 0x7f40741076e0 2024-09-10T22:37:48.165 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:48.147+0000 7f40677fe640 1 -- 172.21.15.19:0/4264368252 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4068009dd0 con 0x7f40741076e0 2024-09-10T22:37:48.165 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:48.147+0000 7f40677fe640 1 -- 172.21.15.19:0/4264368252 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4068010460 con 0x7f40741076e0 2024-09-10T22:37:48.165 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:48.147+0000 7f407c4c8640 1 -- 172.21.15.19:0/4264368252 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f40741a5f10 con 0x7f40741076e0 2024-09-10T22:37:48.165 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:48.150+0000 7f407e89d740 1 Processor -- start 2024-09-10T22:37:48.165 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:48.150+0000 7f40677fe640 1 -- 172.21.15.19:0/4264368252 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 18) ==== 153250+0+0 (secure 0 0 0) 0x7f4068003e80 con 0x7f40741076e0 2024-09-10T22:37:48.165 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:48.150+0000 7f407e89d740 1 -- start start 2024-09-10T22:37:48.165 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:48.150+0000 7f407e89d740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x564bae7e90f0 0x564bae7e94d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:37:48.165 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:48.150+0000 7f407e89d740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564bae7e9a10 0x564bae7f5460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:37:48.166 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:48.150+0000 7f407e89d740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x564bae7f59a0 0x564bae7f7d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:37:48.166 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:48.150+0000 7f407e89d740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x564bae75fea0 con 0x564bae7f59a0 2024-09-10T22:37:48.166 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:48.150+0000 7f407e89d740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x564bae74f2d0 con 0x564bae7e9a10 2024-09-10T22:37:48.166 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:48.150+0000 7f407e89d740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x564bae7530e0 con 0x564bae7e90f0 2024-09-10T22:37:48.166 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:48.151+0000 7f4079a63640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x564bae7f59a0 0x564bae7f7d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:37:48.166 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:48.151+0000 7f407aa65640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x564bae7e90f0 0x564bae7e94d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:37:48.166 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:48.151+0000 7f4079a63640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x564bae7f59a0 0x564bae7f7d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:59496/0 (socket says 172.21.15.19:59496) 2024-09-10T22:37:48.166 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:48.151+0000 7f407aa65640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x564bae7e90f0 0x564bae7e94d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.19:51836/0 (socket says 172.21.15.19:51836) 2024-09-10T22:37:48.166 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:48.151+0000 7f4079a63640 1 -- 172.21.15.19:0/3832259194 learned_addr learned my addr 172.21.15.19:0/3832259194 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:37:48.166 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:48.151+0000 7f407a264640 1 --2- 172.21.15.19:0/3832259194 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564bae7e9a10 0x564bae7f5460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:37:48.166 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:48.151+0000 7f40677fe640 1 --2- 172.21.15.19:0/4264368252 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f40600b52e0 0x7f40600b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:37:48.166 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:48.151+0000 7f407aa65640 1 -- 172.21.15.19:0/3832259194 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564bae7e9a10 msgr2=0x564bae7f5460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:37:48.167 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:48.151+0000 7f407aa65640 1 --2- 172.21.15.19:0/3832259194 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564bae7e9a10 0x564bae7f5460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:37:48.167 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:48.151+0000 7f407aa65640 1 -- 172.21.15.19:0/3832259194 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x564bae7f59a0 msgr2=0x564bae7f7d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:37:48.167 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:48.151+0000 7f407aa65640 1 --2- 172.21.15.19:0/3832259194 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x564bae7f59a0 0x564bae7f7d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:37:48.167 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:48.151+0000 7f407aa65640 1 -- 172.21.15.19:0/3832259194 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564bae4ad650 con 0x564bae7e90f0 2024-09-10T22:37:48.167 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:48.151+0000 7f40677fe640 1 -- 172.21.15.19:0/4264368252 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8327+0+0 (secure 0 0 0) 0x7f40680e5810 con 0x7f40741076e0 2024-09-10T22:37:48.167 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:48.151+0000 7f407aa65640 1 --2- 172.21.15.19:0/4264368252 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f40600b52e0 0x7f40600b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:37:48.167 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:48.151+0000 7f407aa65640 1 --2- 172.21.15.19:0/3832259194 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x564bae7e90f0 0x564bae7e94d0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f406c00aa30 tx=0x7f406c00aef0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1276c4269cb4bb38 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:37:48.167 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:48.152+0000 7f4064ff9640 1 -- 172.21.15.19:0/3832259194 <== mon.1 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f406c01a7c0 con 0x564bae7e90f0 2024-09-10T22:37:48.167 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:48.152+0000 7f4064ff9640 1 -- 172.21.15.19:0/3832259194 <== mon.1 v2:172.21.15.138:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f406c010e00 con 0x564bae7e90f0 2024-09-10T22:37:48.167 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:48.152+0000 7f4064ff9640 1 -- 172.21.15.19:0/3832259194 <== mon.1 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f406c018cc0 con 0x564bae7e90f0 2024-09-10T22:37:48.167 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:48.152+0000 7f407e89d740 1 -- 172.21.15.19:0/3832259194 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x564bae7e90f0 msgr2=0x564bae7e94d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:37:48.167 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:48.152+0000 7f407aa65640 1 --2- 172.21.15.19:0/4264368252 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f40600b52e0 0x7f40600b77a0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f406c010010 tx=0x7f406c020000 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:37:48.167 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:48.152+0000 7f407e89d740 1 --2- 172.21.15.19:0/3832259194 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x564bae7e90f0 0x564bae7e94d0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f406c00aa30 tx=0x7f406c00aef0 comp rx=0 tx=0).stop 2024-09-10T22:37:48.168 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:48.152+0000 7f407e89d740 1 -- 172.21.15.19:0/3832259194 shutdown_connections 2024-09-10T22:37:48.168 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:48.152+0000 7f407e89d740 1 --2- 172.21.15.19:0/3832259194 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x564bae7f59a0 0x564bae7f7d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:37:48.168 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:48.152+0000 7f407e89d740 1 --2- 172.21.15.19:0/3832259194 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564bae7e9a10 0x564bae7f5460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:37:48.168 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:48.152+0000 7f407e89d740 1 --2- 172.21.15.19:0/3832259194 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x564bae7e90f0 0x564bae7e94d0 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:37:48.168 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:48.152+0000 7f407e89d740 1 -- 172.21.15.19:0/3832259194 >> 172.21.15.19:0/3832259194 conn(0x564bae7e6f20 msgr2=0x564bae7e80c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:37:48.168 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:48.153+0000 7f407e89d740 1 -- 172.21.15.19:0/3832259194 shutdown_connections 2024-09-10T22:37:48.168 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:48.153+0000 7f407e89d740 1 -- 172.21.15.19:0/3832259194 wait complete. 2024-09-10T22:37:48.168 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:48.153+0000 7f407e89d740 1 -- start start 2024-09-10T22:37:48.168 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:48.153+0000 7f407e89d740 1 Processor -- start 2024-09-10T22:37:48.168 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:48.153+0000 7f407e89d740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x564bae7e90f0 0x564bae7f5280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:37:48.168 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:48.153+0000 7f407e89d740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564bae7e9a10 0x564bae7f26d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:37:48.168 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:48.153+0000 7f407e89d740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x564bae7f59a0 0x564bae7f2d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:37:48.168 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:48.153+0000 7f407e89d740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x564bae5b0700 con 0x564bae7f59a0 2024-09-10T22:37:48.169 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:48.153+0000 7f407e89d740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x564bae6ea160 con 0x564bae7e9a10 2024-09-10T22:37:48.169 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:48.153+0000 7f407e89d740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x564bae7f8620 con 0x564bae7e90f0 2024-09-10T22:37:48.169 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:48.153+0000 7f407e89d740 10 client.0 _ll_register_callbacks cb 0x564bae7039e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T22:37:48.169 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:48.153+0000 7f407aa65640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x564bae7f59a0 0x564bae7f2d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:37:48.169 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:48.153+0000 7f407a264640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x564bae7e90f0 0x564bae7f5280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:37:48.169 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:48.153+0000 7f407aa65640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x564bae7f59a0 0x564bae7f2d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:59506/0 (socket says 172.21.15.19:59506) 2024-09-10T22:37:48.169 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:48.153+0000 7f407a264640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x564bae7e90f0 0x564bae7f5280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.19:51842/0 (socket says 172.21.15.19:51842) 2024-09-10T22:37:48.169 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:48.153+0000 7f407aa65640 1 -- 172.21.15.19:0/3089743294 learned_addr learned my addr 172.21.15.19:0/3089743294 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:37:48.169 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:48.153+0000 7f4079a63640 1 --2- 172.21.15.19:0/3089743294 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564bae7e9a10 0x564bae7f26d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:37:48.169 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:48.154+0000 7f407a264640 1 -- 172.21.15.19:0/3089743294 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564bae7e9a10 msgr2=0x564bae7f26d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:37:48.169 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:48.154+0000 7f407a264640 1 --2- 172.21.15.19:0/3089743294 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564bae7e9a10 0x564bae7f26d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:37:48.169 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:48.154+0000 7f407a264640 1 -- 172.21.15.19:0/3089743294 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x564bae7f59a0 msgr2=0x564bae7f2d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:37:48.170 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:48.154+0000 7f407a264640 1 --2- 172.21.15.19:0/3089743294 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x564bae7f59a0 0x564bae7f2d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:37:48.170 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:48.154+0000 7f407a264640 1 -- 172.21.15.19:0/3089743294 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564bae717c90 con 0x564bae7e90f0 2024-09-10T22:37:48.170 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:48.154+0000 7f4079a63640 1 --2- 172.21.15.19:0/3089743294 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564bae7e9a10 0x564bae7f26d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T22:37:48.170 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:48.154+0000 7f407aa65640 1 --2- 172.21.15.19:0/3089743294 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x564bae7f59a0 0x564bae7f2d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T22:37:48.170 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:48.154+0000 7f407a264640 1 --2- 172.21.15.19:0/3089743294 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x564bae7e90f0 0x564bae7f5280 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f4070006010 tx=0x7f4070031a50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=511def40441683f3 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:37:48.170 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:48.154+0000 7f405dffb640 10 client.0 ms_handle_connect on v2:172.21.15.138:3300/0 2024-09-10T22:37:48.170 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:48.154+0000 7f405dffb640 1 -- 172.21.15.19:0/3089743294 <== mon.1 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f407004b060 con 0x564bae7e90f0 2024-09-10T22:37:48.170 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:48.154+0000 7f407e89d740 1 -- 172.21.15.19:0/3089743294 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f406c010e00 con 0x564bae7e90f0 2024-09-10T22:37:48.170 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:48.154+0000 7f405dffb640 1 -- 172.21.15.19:0/3089743294 <== mon.1 v2:172.21.15.138:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8327+0+0 (secure 0 0 0) 0x7f4070003c40 con 0x564bae7e90f0 2024-09-10T22:37:48.170 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:48.154+0000 7f405dffb640 1 -- 172.21.15.19:0/3089743294 <== mon.1 v2:172.21.15.138:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f4070003e40 con 0x564bae7e90f0 2024-09-10T22:37:48.170 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:48.154+0000 7f407e89d740 10 client.26887 fetch_fsmap learned FSMap version 28 2024-09-10T22:37:48.170 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:48.154+0000 7f407e89d740 1 -- 172.21.15.19:0/3089743294 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x564bae803f90 con 0x564bae7e90f0 2024-09-10T22:37:48.170 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:48.155+0000 7f405dffb640 1 -- 172.21.15.19:0/3089743294 <== mon.1 v2:172.21.15.138:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f406c010e00 con 0x564bae7e90f0 2024-09-10T22:37:48.171 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:48.155+0000 7f405dffb640 1 -- 172.21.15.19:0/3089743294 <== mon.1 v2:172.21.15.138:3300/0 5 ==== fsmap(e 28) ==== 8350+0+0 (secure 0 0 0) 0x7f407002f9b0 con 0x564bae7e90f0 2024-09-10T22:37:48.171 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:48.155+0000 7f407e89d740 10 client.26887 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T22:37:48.171 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:48.155+0000 7f407e89d740 10 client.26887 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-10T22:37:48.171 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:48.155+0000 7f407e89d740 20 client.26887 populate_metadata read hostname 'smithi019' 2024-09-10T22:37:48.171 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:48.155+0000 7f407e89d740 1 --2- 172.21.15.19:0/3089743294 >> [v2:172.21.15.138:6836/3353290042,v1:172.21.15.138:6837/3353290042] conn(0x564bae805410 0x564bae807860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:37:48.171 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:48.155+0000 7f407e89d740 4 client.26887 mds_command: new command op to 24553 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T22:37:48.171 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:48.155+0000 7f407e89d740 1 -- 172.21.15.19:0/3089743294 --> [v2:172.21.15.138:6836/3353290042,v1:172.21.15.138:6837/3353290042] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564bae761df0 con 0x564bae805410 2024-09-10T22:37:48.171 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:48.155+0000 7f4079a63640 1 --2- 172.21.15.19:0/3089743294 >> [v2:172.21.15.138:6836/3353290042,v1:172.21.15.138:6837/3353290042] conn(0x564bae805410 0x564bae807860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:37:48.171 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:48.155+0000 7f405dffb640 10 client.26887 ms_handle_connect on v2:172.21.15.138:6836/3353290042 2024-09-10T22:37:48.171 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:48.155+0000 7f4079a63640 1 --2- 172.21.15.19:0/3089743294 >> [v2:172.21.15.138:6836/3353290042,v1:172.21.15.138:6837/3353290042] conn(0x564bae805410 0x564bae807860 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=1e2db7f19e586290 server_cookie=74fd2312da209cbd in_seq=0 out_seq=0 2024-09-10T22:37:48.171 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:48.156+0000 7f405dffb640 1 -- 172.21.15.19:0/3089743294 <== mds.2 v2:172.21.15.138:6836/3353290042 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x564bae761df0 con 0x564bae805410 2024-09-10T22:37:48.171 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:48.156+0000 7f405dffb640 10 client.26887 handle_command_reply: tid=0 2024-09-10T22:37:48.171 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:48.156+0000 7f407e89d740 1 client.26887 shutdown 2024-09-10T22:37:48.172 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:48.156+0000 7f407e89d740 1 -- 172.21.15.19:0/3089743294 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x564bae7e90f0 msgr2=0x564bae7f5280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:37:48.172 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:48.156+0000 7f407e89d740 1 --2- 172.21.15.19:0/3089743294 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x564bae7e90f0 0x564bae7f5280 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f4070006010 tx=0x7f4070031a50 comp rx=0 tx=0).stop 2024-09-10T22:37:48.172 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:48.156+0000 7f407e89d740 1 -- 172.21.15.19:0/3089743294 shutdown_connections 2024-09-10T22:37:48.172 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:48.156+0000 7f407e89d740 1 --2- 172.21.15.19:0/3089743294 >> [v2:172.21.15.138:6836/3353290042,v1:172.21.15.138:6837/3353290042] conn(0x564bae805410 0x564bae807860 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:37:48.172 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:48.156+0000 7f407e89d740 1 --2- 172.21.15.19:0/3089743294 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x564bae7f59a0 0x564bae7f2d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:37:48.172 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:48.156+0000 7f407e89d740 1 --2- 172.21.15.19:0/3089743294 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564bae7e9a10 0x564bae7f26d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:37:48.172 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:48.156+0000 7f405dffb640 0 client.26887 ms_handle_reset on v2:172.21.15.138:6836/3353290042 2024-09-10T22:37:48.172 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:48.156+0000 7f407e89d740 1 --2- 172.21.15.19:0/3089743294 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x564bae7e90f0 0x564bae7f5280 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:37:48.172 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:48.156+0000 7f407e89d740 1 -- 172.21.15.19:0/3089743294 >> 172.21.15.19:0/3089743294 conn(0x564bae7e6f20 msgr2=0x564bae7ecac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:37:48.172 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:48.156+0000 7f407e89d740 1 -- 172.21.15.19:0/3089743294 shutdown_connections 2024-09-10T22:37:48.172 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:48.156+0000 7f407e89d740 1 -- 172.21.15.19:0/3089743294 wait complete. 2024-09-10T22:37:48.172 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:48.157+0000 7f407e89d740 20 client.26887 trim_cache size 0 max 16384 2024-09-10T22:37:48.177 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:48.170+0000 7f407e89d740 1 Processor -- start 2024-09-10T22:37:48.177 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:48.170+0000 7f407e89d740 1 -- start start 2024-09-10T22:37:48.177 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:48.170+0000 7f407e89d740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564bae7e90f0 0x564bae7e6760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:37:48.177 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:48.170+0000 7f407e89d740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x564bae7e9a10 0x564bae7f4410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:37:48.177 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:48.170+0000 7f407e89d740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x564bae7f59a0 0x564bae7fdc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:37:48.178 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:48.170+0000 7f407e89d740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f40741b0ec0 con 0x564bae7f59a0 2024-09-10T22:37:48.178 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:48.170+0000 7f407e89d740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f40741ae760 con 0x564bae7e90f0 2024-09-10T22:37:48.178 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:48.170+0000 7f407e89d740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f40741ac5b0 con 0x564bae7e9a10 2024-09-10T22:37:48.178 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:48.170+0000 7f407aa65640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x564bae7f59a0 0x564bae7fdc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:37:48.178 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:48.170+0000 7f407aa65640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x564bae7f59a0 0x564bae7fdc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:59516/0 (socket says 172.21.15.19:59516) 2024-09-10T22:37:48.178 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:48.170+0000 7f407aa65640 1 -- 172.21.15.19:0/1827840878 learned_addr learned my addr 172.21.15.19:0/1827840878 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:37:48.178 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:48.170+0000 7f4079a63640 1 --2- 172.21.15.19:0/1827840878 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x564bae7e9a10 0x564bae7f4410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:37:48.178 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:48.171+0000 7f407a264640 1 --2- 172.21.15.19:0/1827840878 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564bae7e90f0 0x564bae7e6760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:37:48.178 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:48.171+0000 7f4079a63640 1 -- 172.21.15.19:0/1827840878 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564bae7e90f0 msgr2=0x564bae7e6760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:37:48.178 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:48.171+0000 7f4079a63640 1 --2- 172.21.15.19:0/1827840878 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564bae7e90f0 0x564bae7e6760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:37:48.178 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:48.171+0000 7f4079a63640 1 -- 172.21.15.19:0/1827840878 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x564bae7f59a0 msgr2=0x564bae7fdc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:37:48.178 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:48.171+0000 7f4079a63640 1 --2- 172.21.15.19:0/1827840878 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x564bae7f59a0 0x564bae7fdc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:37:48.178 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:48.171+0000 7f4079a63640 1 -- 172.21.15.19:0/1827840878 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564bae7f4eb0 con 0x564bae7e9a10 2024-09-10T22:37:48.179 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:48.171+0000 7f407aa65640 1 --2- 172.21.15.19:0/1827840878 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x564bae7f59a0 0x564bae7fdc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T22:37:48.179 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:48.171+0000 7f4079a63640 1 --2- 172.21.15.19:0/1827840878 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x564bae7e9a10 0x564bae7f4410 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f4068009610 tx=0x7f40680eb550 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a43d40d351e36ba6 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:37:48.179 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:48.171+0000 7f405ffff640 1 -- 172.21.15.19:0/1827840878 <== mon.1 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4068020040 con 0x564bae7e9a10 2024-09-10T22:37:48.179 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:48.171+0000 7f405ffff640 1 -- 172.21.15.19:0/1827840878 <== mon.1 v2:172.21.15.138:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f40680035f0 con 0x564bae7e9a10 2024-09-10T22:37:48.179 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:48.171+0000 7f405ffff640 1 -- 172.21.15.19:0/1827840878 <== mon.1 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40680b5500 con 0x564bae7e9a10 2024-09-10T22:37:48.179 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:48.172+0000 7f407e89d740 1 -- 172.21.15.19:0/1827840878 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x564bae7e9a10 msgr2=0x564bae7f4410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:37:48.179 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:48.172+0000 7f407e89d740 1 --2- 172.21.15.19:0/1827840878 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x564bae7e9a10 0x564bae7f4410 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f4068009610 tx=0x7f40680eb550 comp rx=0 tx=0).stop 2024-09-10T22:37:48.179 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:48.172+0000 7f407e89d740 1 -- 172.21.15.19:0/1827840878 shutdown_connections 2024-09-10T22:37:48.179 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:48.172+0000 7f407e89d740 1 --2- 172.21.15.19:0/1827840878 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x564bae7f59a0 0x564bae7fdc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:37:48.179 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:48.172+0000 7f407e89d740 1 --2- 172.21.15.19:0/1827840878 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x564bae7e9a10 0x564bae7f4410 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:37:48.179 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:48.172+0000 7f407e89d740 1 --2- 172.21.15.19:0/1827840878 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564bae7e90f0 0x564bae7e6760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:37:48.179 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:48.172+0000 7f407e89d740 1 -- 172.21.15.19:0/1827840878 >> 172.21.15.19:0/1827840878 conn(0x564bae7e6f20 msgr2=0x564bae7f3d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:37:48.179 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:48.172+0000 7f407e89d740 1 -- 172.21.15.19:0/1827840878 shutdown_connections 2024-09-10T22:37:48.179 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:48.172+0000 7f407e89d740 1 -- 172.21.15.19:0/1827840878 wait complete. 2024-09-10T22:37:48.180 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:48.172+0000 7f407e89d740 1 -- start start 2024-09-10T22:37:48.180 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:48.173+0000 7f407e89d740 1 Processor -- start 2024-09-10T22:37:48.180 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:48.173+0000 7f407e89d740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x564bae7e90f0 0x564bae80d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:37:48.180 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:48.173+0000 7f407e89d740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x564bae7e9a10 0x564bae80c170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:37:48.180 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:48.173+0000 7f407e89d740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564bae7f59a0 0x564bae80c6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:37:48.180 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:48.173+0000 7f407e89d740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f40741acc20 con 0x564bae7e9a10 2024-09-10T22:37:48.180 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:48.173+0000 7f407e89d740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f40741ae090 con 0x564bae7f59a0 2024-09-10T22:37:48.180 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:48.173+0000 7f407e89d740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f40741ad2f0 con 0x564bae7e90f0 2024-09-10T22:37:48.180 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:48.173+0000 7f407e89d740 10 client.0 _ll_register_callbacks cb 0x7f40700098c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T22:37:48.180 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:48.173+0000 7f4079a63640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x564bae7e9a10 0x564bae80c170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:37:48.180 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:48.173+0000 7f4079a63640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x564bae7e9a10 0x564bae80c170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:59524/0 (socket says 172.21.15.19:59524) 2024-09-10T22:37:48.180 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:48.173+0000 7f4079a63640 1 -- 172.21.15.19:0/1454257542 learned_addr learned my addr 172.21.15.19:0/1454257542 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:37:48.181 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:48.173+0000 7f407aa65640 1 --2- 172.21.15.19:0/1454257542 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564bae7f59a0 0x564bae80c6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:37:48.181 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:48.173+0000 7f407a264640 1 --2- 172.21.15.19:0/1454257542 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x564bae7e90f0 0x564bae80d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:37:48.181 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:48.173+0000 7f4079a63640 1 -- 172.21.15.19:0/1454257542 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x564bae7e90f0 msgr2=0x564bae80d6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:37:48.181 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:48.173+0000 7f4079a63640 1 --2- 172.21.15.19:0/1454257542 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x564bae7e90f0 0x564bae80d6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:37:48.181 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:48.173+0000 7f4079a63640 1 -- 172.21.15.19:0/1454257542 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564bae7f59a0 msgr2=0x564bae80c6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:37:48.181 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:48.173+0000 7f4079a63640 1 --2- 172.21.15.19:0/1454257542 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564bae7f59a0 0x564bae80c6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:37:48.181 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:48.173+0000 7f4079a63640 1 -- 172.21.15.19:0/1454257542 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564bae80cc40 con 0x564bae7e9a10 2024-09-10T22:37:48.181 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:48.174+0000 7f4079a63640 1 --2- 172.21.15.19:0/1454257542 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x564bae7e9a10 0x564bae80c170 secure :-1 s=READY pgs=860 cs=0 l=1 rev1=1 crypto rx=0x7f40680a85f0 tx=0x7f40680aba00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=85dfee4749ab8a63 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:37:48.181 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:48.174+0000 7f405dffb640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-10T22:37:48.181 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:48.174+0000 7f405dffb640 1 -- 172.21.15.19:0/1454257542 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4068020030 con 0x564bae7e9a10 2024-09-10T22:37:48.181 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:48.174+0000 7f405dffb640 1 -- 172.21.15.19:0/1454257542 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8327+0+0 (secure 0 0 0) 0x7f40680043a0 con 0x564bae7e9a10 2024-09-10T22:37:48.181 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:48.174+0000 7f407e89d740 1 -- 172.21.15.19:0/1454257542 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x564bae75d8a0 con 0x564bae7e9a10 2024-09-10T22:37:48.181 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:48.174+0000 7f405dffb640 1 -- 172.21.15.19:0/1454257542 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f40680ab790 con 0x564bae7e9a10 2024-09-10T22:37:48.182 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:48.174+0000 7f407e89d740 10 client.17583 fetch_fsmap learned FSMap version 28 2024-09-10T22:37:48.182 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:48.174+0000 7f407e89d740 1 -- 172.21.15.19:0/1454257542 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x564bae877180 con 0x564bae7e9a10 2024-09-10T22:37:48.182 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:48.174+0000 7f405dffb640 1 -- 172.21.15.19:0/1454257542 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x564bae75d8a0 con 0x564bae7e9a10 2024-09-10T22:37:48.182 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:48.174+0000 7f405dffb640 1 -- 172.21.15.19:0/1454257542 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 28) ==== 8350+0+0 (secure 0 0 0) 0x7f4068097280 con 0x564bae7e9a10 2024-09-10T22:37:48.182 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:48.174+0000 7f407e89d740 10 client.17583 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T22:37:48.182 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:48.174+0000 7f407e89d740 10 client.17583 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-10T22:37:48.182 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:48.174+0000 7f407e89d740 20 client.17583 populate_metadata read hostname 'smithi019' 2024-09-10T22:37:48.182 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:48.174+0000 7f407e89d740 1 --2- 172.21.15.19:0/1454257542 >> [v2:172.21.15.138:6836/3353290042,v1:172.21.15.138:6837/3353290042] conn(0x564bae877790 0x564bae879bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:37:48.182 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:48.174+0000 7f407e89d740 4 client.17583 mds_command: new command op to 24553 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-10T22:37:48.182 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:48.174+0000 7f407e89d740 1 -- 172.21.15.19:0/1454257542 --> [v2:172.21.15.138:6836/3353290042,v1:172.21.15.138:6837/3353290042] -- command(tid 0: {"prefix": "damage ls"}) -- 0x564bae75acd0 con 0x564bae877790 2024-09-10T22:37:48.182 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:48.175+0000 7f407a264640 1 --2- 172.21.15.19:0/1454257542 >> [v2:172.21.15.138:6836/3353290042,v1:172.21.15.138:6837/3353290042] conn(0x564bae877790 0x564bae879bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:37:48.182 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:48.175+0000 7f407a264640 1 --2- 172.21.15.19:0/1454257542 >> [v2:172.21.15.138:6836/3353290042,v1:172.21.15.138:6837/3353290042] conn(0x564bae877790 0x564bae879bb0 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=992852e7e81717b5 server_cookie=c8119aa8d73e4bea in_seq=0 out_seq=0 2024-09-10T22:37:48.182 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:48.175+0000 7f405dffb640 10 client.17583 ms_handle_connect on v2:172.21.15.138:6836/3353290042 2024-09-10T22:37:48.182 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:48.175+0000 7f405dffb640 1 -- 172.21.15.19:0/1454257542 <== mds.2 v2:172.21.15.138:6836/3353290042 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x564bae75acd0 con 0x564bae877790 2024-09-10T22:37:48.183 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:48.175+0000 7f405dffb640 10 client.17583 handle_command_reply: tid=0 2024-09-10T22:37:48.183 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:48.175+0000 7f407e89d740 1 client.17583 shutdown 2024-09-10T22:37:48.183 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:48.175+0000 7f407e89d740 1 -- 172.21.15.19:0/1454257542 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x564bae7e9a10 msgr2=0x564bae80c170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:37:48.183 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:48.175+0000 7f407e89d740 1 --2- 172.21.15.19:0/1454257542 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x564bae7e9a10 0x564bae80c170 secure :-1 s=READY pgs=860 cs=0 l=1 rev1=1 crypto rx=0x7f40680a85f0 tx=0x7f40680aba00 comp rx=0 tx=0).stop 2024-09-10T22:37:48.183 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:48.175+0000 7f407e89d740 1 -- 172.21.15.19:0/1454257542 shutdown_connections 2024-09-10T22:37:48.183 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:48.175+0000 7f407e89d740 1 --2- 172.21.15.19:0/1454257542 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564bae7f59a0 0x564bae80c6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:37:48.183 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:48.175+0000 7f407e89d740 1 --2- 172.21.15.19:0/1454257542 >> [v2:172.21.15.138:6836/3353290042,v1:172.21.15.138:6837/3353290042] conn(0x564bae877790 0x564bae879bb0 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:37:48.183 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:48.175+0000 7f407e89d740 1 --2- 172.21.15.19:0/1454257542 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x564bae7e9a10 0x564bae80c170 unknown :-1 s=CLOSED pgs=860 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:37:48.183 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:48.175+0000 7f407e89d740 1 --2- 172.21.15.19:0/1454257542 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x564bae7e90f0 0x564bae80d6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:37:48.183 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:48.175+0000 7f407e89d740 1 -- 172.21.15.19:0/1454257542 >> 172.21.15.19:0/1454257542 conn(0x564bae7e6f20 msgr2=0x564bae7f4520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:37:48.183 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:48.175+0000 7f405dffb640 0 client.17583 ms_handle_reset on v2:172.21.15.138:6836/3353290042 2024-09-10T22:37:48.183 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:48.175+0000 7f407e89d740 1 -- 172.21.15.19:0/1454257542 shutdown_connections 2024-09-10T22:37:48.183 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:48.175+0000 7f407e89d740 1 -- 172.21.15.19:0/1454257542 wait complete. 2024-09-10T22:37:48.184 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:48.176+0000 7f407e89d740 20 client.17583 trim_cache size 0 max 16384 2024-09-10T22:37:48.184 INFO:teuthology.orchestra.run.smithi019.stdout:[] 2024-09-10T22:37:48.184 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:48.176+0000 7f407c4c8640 1 -- 172.21.15.19:0/4264368252 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f40600b52e0 msgr2=0x7f40600b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:37:48.185 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:48.176+0000 7f407c4c8640 1 --2- 172.21.15.19:0/4264368252 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f40600b52e0 0x7f40600b77a0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f406c010010 tx=0x7f406c020000 comp rx=0 tx=0).stop 2024-09-10T22:37:48.185 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:48.176+0000 7f407c4c8640 1 -- 172.21.15.19:0/4264368252 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f40741076e0 msgr2=0x7f4074199820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:37:48.185 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:48.176+0000 7f407c4c8640 1 --2- 172.21.15.19:0/4264368252 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f40741076e0 0x7f4074199820 secure :-1 s=READY pgs=859 cs=0 l=1 rev1=1 crypto rx=0x7f4068005fd0 tx=0x7f406800dde0 comp rx=0 tx=0).stop 2024-09-10T22:37:48.185 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:48.176+0000 7f407c4c8640 1 -- 172.21.15.19:0/4264368252 shutdown_connections 2024-09-10T22:37:48.185 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:48.176+0000 7f407c4c8640 1 --2- 172.21.15.19:0/4264368252 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f40600b52e0 0x7f40600b77a0 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:37:48.185 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:48.176+0000 7f407c4c8640 1 --2- 172.21.15.19:0/4264368252 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4074108060 0x7f407419ebc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:37:48.185 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:48.176+0000 7f407c4c8640 1 --2- 172.21.15.19:0/4264368252 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f40741076e0 0x7f4074199820 unknown :-1 s=CLOSED pgs=859 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:37:48.185 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:48.176+0000 7f407c4c8640 1 --2- 172.21.15.19:0/4264368252 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f4074101cd0 0x7f40741992e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:37:48.185 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:48.176+0000 7f407c4c8640 1 -- 172.21.15.19:0/4264368252 >> 172.21.15.19:0/4264368252 conn(0x7f40740fd720 msgr2=0x7f40740ffb10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:37:48.185 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:48.176+0000 7f407c4c8640 1 -- 172.21.15.19:0/4264368252 shutdown_connections 2024-09-10T22:37:48.185 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:48.176+0000 7f407c4c8640 1 -- 172.21.15.19:0/4264368252 wait complete. 2024-09-10T22:37:48.360 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:37:47 smithi135 ceph-mon[34789]: pgmap v688: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 48 MiB/s wr, 195 op/s 2024-09-10T22:37:48.360 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:37:47 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:37:48.360 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:37:47 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:37:48.360 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:37:47 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:37:48.360 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:37:47 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:37:48.360 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:37:47 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:37:48.360 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:37:47 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:37:48.360 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:37:47 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T22:37:48.360 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:37:47 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T22:37:48.361 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:37:47 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:37:48.375 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:37:47 smithi138 ceph-mon[35236]: pgmap v688: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 48 MiB/s wr, 195 op/s 2024-09-10T22:37:48.375 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:37:47 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:37:48.375 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:37:47 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:37:48.375 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:37:47 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:37:48.375 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:37:47 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:37:48.375 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:37:47 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:37:48.375 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:37:47 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:37:48.375 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:37:47 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T22:37:48.375 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:37:47 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T22:37:48.376 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:37:47 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' 2024-09-10T22:37:48.969 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 22997a4c-6fc2-11ef-bcea-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-09-10T22:37:49.235 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/22997a4c-6fc2-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T22:37:49.879 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:49.862+0000 7eff9ad7b640 1 -- 172.21.15.19:0/2818912096 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7eff94103ca0 msgr2=0x7eff94104080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:37:49.879 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:49.862+0000 7eff9ad7b640 1 --2- 172.21.15.19:0/2818912096 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7eff94103ca0 0x7eff94104080 secure :-1 s=READY pgs=861 cs=0 l=1 rev1=1 crypto rx=0x7eff84009900 tx=0x7eff8402a410 comp rx=0 tx=0).stop 2024-09-10T22:37:49.880 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:49.862+0000 7eff9ad7b640 1 -- 172.21.15.19:0/2818912096 shutdown_connections 2024-09-10T22:37:49.880 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:49.862+0000 7eff9ad7b640 1 --2- 172.21.15.19:0/2818912096 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7eff9410d100 0x7eff9410f560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:37:49.880 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:49.862+0000 7eff9ad7b640 1 --2- 172.21.15.19:0/2818912096 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7eff941045c0 0x7eff9410cab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:37:49.880 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:49.862+0000 7eff9ad7b640 1 --2- 172.21.15.19:0/2818912096 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7eff94103ca0 0x7eff94104080 unknown :-1 s=CLOSED pgs=861 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:37:49.880 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:49.862+0000 7eff9ad7b640 1 -- 172.21.15.19:0/2818912096 >> 172.21.15.19:0/2818912096 conn(0x7eff940fd700 msgr2=0x7eff940ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:37:49.880 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:49.862+0000 7eff9ad7b640 1 -- 172.21.15.19:0/2818912096 shutdown_connections 2024-09-10T22:37:49.880 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:49.862+0000 7eff9ad7b640 1 -- 172.21.15.19:0/2818912096 wait complete. 2024-09-10T22:37:49.880 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:49.862+0000 7eff9ad7b640 1 Processor -- start 2024-09-10T22:37:49.880 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:49.862+0000 7eff9ad7b640 1 -- start start 2024-09-10T22:37:49.880 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:49.863+0000 7eff9ad7b640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7eff94103ca0 0x7eff94101950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:37:49.880 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:49.863+0000 7eff9ad7b640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7eff941045c0 0x7eff94101e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:37:49.880 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:49.863+0000 7eff9ad7b640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7eff9410d100 0x7eff941023d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:37:49.881 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:49.863+0000 7eff9ad7b640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7eff94112d70 con 0x7eff94103ca0 2024-09-10T22:37:49.881 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:49.863+0000 7eff9ad7b640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7eff94112bf0 con 0x7eff9410d100 2024-09-10T22:37:49.881 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:49.863+0000 7eff9ad7b640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7eff94112ef0 con 0x7eff941045c0 2024-09-10T22:37:49.881 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:49.863+0000 7eff98b17640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7eff94103ca0 0x7eff94101950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:37:49.881 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:49.863+0000 7eff98b17640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7eff94103ca0 0x7eff94101950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:59534/0 (socket says 172.21.15.19:59534) 2024-09-10T22:37:49.881 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:49.863+0000 7eff98b17640 1 -- 172.21.15.19:0/3157429256 learned_addr learned my addr 172.21.15.19:0/3157429256 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:37:49.881 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:49.863+0000 7eff99318640 1 --2- 172.21.15.19:0/3157429256 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7eff9410d100 0x7eff941023d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:37:49.881 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:49.863+0000 7eff93fff640 1 --2- 172.21.15.19:0/3157429256 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7eff941045c0 0x7eff94101e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:37:49.881 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:49.863+0000 7eff98b17640 1 -- 172.21.15.19:0/3157429256 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7eff941045c0 msgr2=0x7eff94101e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:37:49.881 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:49.863+0000 7eff98b17640 1 --2- 172.21.15.19:0/3157429256 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7eff941045c0 0x7eff94101e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:37:49.881 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:49.863+0000 7eff98b17640 1 -- 172.21.15.19:0/3157429256 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7eff9410d100 msgr2=0x7eff941023d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:37:49.881 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:49.863+0000 7eff98b17640 1 --2- 172.21.15.19:0/3157429256 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7eff9410d100 0x7eff941023d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:37:49.881 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:49.863+0000 7eff98b17640 1 -- 172.21.15.19:0/3157429256 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7eff941a76a0 con 0x7eff94103ca0 2024-09-10T22:37:49.882 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:49.863+0000 7eff99318640 1 --2- 172.21.15.19:0/3157429256 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7eff9410d100 0x7eff941023d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T22:37:49.882 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:49.863+0000 7eff98b17640 1 --2- 172.21.15.19:0/3157429256 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7eff94103ca0 0x7eff94101950 secure :-1 s=READY pgs=862 cs=0 l=1 rev1=1 crypto rx=0x7eff84005940 tx=0x7eff840042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:37:49.882 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:49.863+0000 7eff91ffb640 1 -- 172.21.15.19:0/3157429256 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff8403f030 con 0x7eff94103ca0 2024-09-10T22:37:49.882 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:49.863+0000 7eff91ffb640 1 -- 172.21.15.19:0/3157429256 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7eff84003cb0 con 0x7eff94103ca0 2024-09-10T22:37:49.882 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:49.863+0000 7eff91ffb640 1 -- 172.21.15.19:0/3157429256 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff84035070 con 0x7eff94103ca0 2024-09-10T22:37:49.882 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:49.863+0000 7eff9ad7b640 1 -- 172.21.15.19:0/3157429256 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7eff941a7930 con 0x7eff94103ca0 2024-09-10T22:37:49.882 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:49.864+0000 7eff9ad7b640 1 -- 172.21.15.19:0/3157429256 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7eff941a7e60 con 0x7eff94103ca0 2024-09-10T22:37:49.882 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:49.866+0000 7eff9d150740 1 Processor -- start 2024-09-10T22:37:49.882 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:49.866+0000 7eff91ffb640 1 -- 172.21.15.19:0/3157429256 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 18) ==== 153250+0+0 (secure 0 0 0) 0x7eff8403bbf0 con 0x7eff94103ca0 2024-09-10T22:37:49.882 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:49.866+0000 7eff9d150740 1 -- start start 2024-09-10T22:37:49.882 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:49.866+0000 7eff9d150740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x556bbf45d0f0 0x556bbf45d4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:37:49.882 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:49.866+0000 7eff9d150740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556bbf45da10 0x556bbf469460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:37:49.882 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:49.866+0000 7eff9d150740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x556bbf4699a0 0x556bbf46bd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:37:49.883 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:49.866+0000 7eff9d150740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x556bbf3d3ea0 con 0x556bbf4699a0 2024-09-10T22:37:49.883 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:49.866+0000 7eff9d150740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x556bbf3c32d0 con 0x556bbf45da10 2024-09-10T22:37:49.883 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:49.866+0000 7eff9d150740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x556bbf3c70e0 con 0x556bbf45d0f0 2024-09-10T22:37:49.883 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:49.867+0000 7eff93fff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x556bbf4699a0 0x556bbf46bd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:37:49.883 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:49.867+0000 7eff93fff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x556bbf4699a0 0x556bbf46bd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:59546/0 (socket says 172.21.15.19:59546) 2024-09-10T22:37:49.883 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:49.867+0000 7eff93fff640 1 -- 172.21.15.19:0/3180777310 learned_addr learned my addr 172.21.15.19:0/3180777310 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:37:49.883 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:49.867+0000 7eff98b17640 1 --2- 172.21.15.19:0/3180777310 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556bbf45da10 0x556bbf469460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:37:49.883 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:49.867+0000 7eff99318640 1 --2- 172.21.15.19:0/3180777310 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x556bbf45d0f0 0x556bbf45d4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:37:49.883 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:49.867+0000 7eff93fff640 1 -- 172.21.15.19:0/3180777310 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x556bbf45d0f0 msgr2=0x556bbf45d4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:37:49.883 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:49.867+0000 7eff93fff640 1 --2- 172.21.15.19:0/3180777310 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x556bbf45d0f0 0x556bbf45d4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:37:49.883 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:49.867+0000 7eff93fff640 1 -- 172.21.15.19:0/3180777310 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556bbf45da10 msgr2=0x556bbf469460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:37:49.883 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:49.867+0000 7eff93fff640 1 --2- 172.21.15.19:0/3180777310 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556bbf45da10 0x556bbf469460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:37:49.884 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:49.867+0000 7eff93fff640 1 -- 172.21.15.19:0/3180777310 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556bbf121650 con 0x556bbf4699a0 2024-09-10T22:37:49.884 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:49.867+0000 7eff98b17640 1 --2- 172.21.15.19:0/3180777310 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556bbf45da10 0x556bbf469460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T22:37:49.884 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:49.867+0000 7eff91ffb640 1 --2- 172.21.15.19:0/3157429256 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7eff7c0b5360 0x7eff7c0b7820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:37:49.884 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:49.867+0000 7eff99318640 1 --2- 172.21.15.19:0/3157429256 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7eff7c0b5360 0x7eff7c0b7820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:37:49.884 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:49.867+0000 7eff93fff640 1 --2- 172.21.15.19:0/3180777310 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x556bbf4699a0 0x556bbf46bd90 secure :-1 s=READY pgs=863 cs=0 l=1 rev1=1 crypto rx=0x7eff8800bc60 tx=0x7eff880107a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=22a07ce1224be2db server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:37:49.884 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:49.867+0000 7eff91ffb640 1 -- 172.21.15.19:0/3157429256 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8327+0+0 (secure 0 0 0) 0x7eff84106750 con 0x7eff94103ca0 2024-09-10T22:37:49.884 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:49.867+0000 7eff7affd640 1 -- 172.21.15.19:0/3180777310 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff88004220 con 0x556bbf4699a0 2024-09-10T22:37:49.884 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:49.867+0000 7eff7affd640 1 -- 172.21.15.19:0/3180777310 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7eff8800be10 con 0x556bbf4699a0 2024-09-10T22:37:49.884 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:49.867+0000 7eff7affd640 1 -- 172.21.15.19:0/3180777310 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff88004ce0 con 0x556bbf4699a0 2024-09-10T22:37:49.884 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:49.868+0000 7eff9d150740 1 -- 172.21.15.19:0/3180777310 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x556bbf4699a0 msgr2=0x556bbf46bd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:37:49.884 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:49.868+0000 7eff99318640 1 --2- 172.21.15.19:0/3157429256 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7eff7c0b5360 0x7eff7c0b7820 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7eff94103a10 tx=0x7eff8c009820 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:37:49.884 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:49.868+0000 7eff9d150740 1 --2- 172.21.15.19:0/3180777310 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x556bbf4699a0 0x556bbf46bd90 secure :-1 s=READY pgs=863 cs=0 l=1 rev1=1 crypto rx=0x7eff8800bc60 tx=0x7eff880107a0 comp rx=0 tx=0).stop 2024-09-10T22:37:49.885 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:49.868+0000 7eff9d150740 1 -- 172.21.15.19:0/3180777310 shutdown_connections 2024-09-10T22:37:49.885 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:49.868+0000 7eff9d150740 1 --2- 172.21.15.19:0/3180777310 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x556bbf4699a0 0x556bbf46bd90 unknown :-1 s=CLOSED pgs=863 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:37:49.885 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:49.868+0000 7eff9d150740 1 --2- 172.21.15.19:0/3180777310 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556bbf45da10 0x556bbf469460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:37:49.885 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:49.868+0000 7eff9d150740 1 --2- 172.21.15.19:0/3180777310 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x556bbf45d0f0 0x556bbf45d4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:37:49.885 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:49.868+0000 7eff9d150740 1 -- 172.21.15.19:0/3180777310 >> 172.21.15.19:0/3180777310 conn(0x556bbf45af20 msgr2=0x556bbf45c0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:37:49.885 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:49.868+0000 7eff9d150740 1 -- 172.21.15.19:0/3180777310 shutdown_connections 2024-09-10T22:37:49.885 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:49.868+0000 7eff9d150740 1 -- 172.21.15.19:0/3180777310 wait complete. 2024-09-10T22:37:49.885 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:49.869+0000 7eff9d150740 1 -- start start 2024-09-10T22:37:49.885 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:49.869+0000 7eff9d150740 1 Processor -- start 2024-09-10T22:37:49.885 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:49.869+0000 7eff9d150740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x556bbf45d0f0 0x556bbf469210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:37:49.885 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:49.869+0000 7eff9d150740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556bbf45da10 0x556bbf466660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:37:49.885 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:49.869+0000 7eff9d150740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x556bbf4699a0 0x556bbf466be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:37:49.885 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:49.869+0000 7eff9d150740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x556bbf224700 con 0x556bbf45d0f0 2024-09-10T22:37:49.886 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:49.869+0000 7eff9d150740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x556bbf35e160 con 0x556bbf45da10 2024-09-10T22:37:49.886 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:49.869+0000 7eff9d150740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x556bbf46c620 con 0x556bbf4699a0 2024-09-10T22:37:49.886 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:49.869+0000 7eff9d150740 10 client.0 _ll_register_callbacks cb 0x556bbf3779e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T22:37:49.886 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:49.869+0000 7eff98b17640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x556bbf45d0f0 0x556bbf469210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:37:49.886 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:49.869+0000 7eff98b17640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x556bbf45d0f0 0x556bbf469210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:59554/0 (socket says 172.21.15.19:59554) 2024-09-10T22:37:49.886 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:49.869+0000 7eff98b17640 1 -- 172.21.15.19:0/4050981205 learned_addr learned my addr 172.21.15.19:0/4050981205 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:37:49.886 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:49.869+0000 7eff93fff640 1 --2- 172.21.15.19:0/4050981205 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556bbf45da10 0x556bbf466660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:37:49.886 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:49.869+0000 7eff99318640 1 --2- 172.21.15.19:0/4050981205 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x556bbf4699a0 0x556bbf466be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:37:49.886 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:49.869+0000 7eff98b17640 1 -- 172.21.15.19:0/4050981205 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x556bbf4699a0 msgr2=0x556bbf466be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:37:49.886 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:49.870+0000 7eff98b17640 1 --2- 172.21.15.19:0/4050981205 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x556bbf4699a0 0x556bbf466be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:37:49.886 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:49.870+0000 7eff98b17640 1 -- 172.21.15.19:0/4050981205 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556bbf45da10 msgr2=0x556bbf466660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:37:49.886 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:49.870+0000 7eff98b17640 1 --2- 172.21.15.19:0/4050981205 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556bbf45da10 0x556bbf466660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:37:49.887 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:49.870+0000 7eff98b17640 1 -- 172.21.15.19:0/4050981205 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556bbf38bc90 con 0x556bbf45d0f0 2024-09-10T22:37:49.887 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:49.870+0000 7eff98b17640 1 --2- 172.21.15.19:0/4050981205 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x556bbf45d0f0 0x556bbf469210 secure :-1 s=READY pgs=864 cs=0 l=1 rev1=1 crypto rx=0x7eff840ca120 tx=0x7eff8402a410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d2067e76889a99ad server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:37:49.887 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:49.870+0000 7eff73fff640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-10T22:37:49.887 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:49.870+0000 7eff73fff640 1 -- 172.21.15.19:0/4050981205 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff84049070 con 0x556bbf45d0f0 2024-09-10T22:37:49.887 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:49.870+0000 7eff73fff640 1 -- 172.21.15.19:0/4050981205 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8327+0+0 (secure 0 0 0) 0x7eff840cd310 con 0x556bbf45d0f0 2024-09-10T22:37:49.887 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:49.870+0000 7eff9d150740 1 -- 172.21.15.19:0/4050981205 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7eff8800be10 con 0x556bbf45d0f0 2024-09-10T22:37:49.887 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:49.870+0000 7eff73fff640 1 -- 172.21.15.19:0/4050981205 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7eff840cc800 con 0x556bbf45d0f0 2024-09-10T22:37:49.887 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:49.870+0000 7eff9d150740 10 client.17595 fetch_fsmap learned FSMap version 28 2024-09-10T22:37:49.887 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:49.870+0000 7eff9d150740 1 -- 172.21.15.19:0/4050981205 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x556bbf477f30 con 0x556bbf45d0f0 2024-09-10T22:37:49.887 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:49.870+0000 7eff73fff640 1 -- 172.21.15.19:0/4050981205 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7eff8800be10 con 0x556bbf45d0f0 2024-09-10T22:37:49.888 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:49.870+0000 7eff73fff640 1 -- 172.21.15.19:0/4050981205 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 28) ==== 8350+0+0 (secure 0 0 0) 0x7eff840d5fb0 con 0x556bbf45d0f0 2024-09-10T22:37:49.888 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:49.870+0000 7eff9d150740 10 client.17595 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T22:37:49.888 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:49.870+0000 7eff9d150740 10 client.17595 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-10T22:37:49.888 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:49.870+0000 7eff9d150740 20 client.17595 populate_metadata read hostname 'smithi019' 2024-09-10T22:37:49.888 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:49.870+0000 7eff9d150740 1 --2- 172.21.15.19:0/4050981205 >> [v2:172.21.15.138:6838/383637208,v1:172.21.15.138:6839/383637208] conn(0x556bbf479430 0x556bbf47b8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:37:49.888 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:49.870+0000 7eff9d150740 4 client.17595 mds_command: new command op to 24568 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T22:37:49.888 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:49.870+0000 7eff9d150740 1 -- 172.21.15.19:0/4050981205 --> [v2:172.21.15.138:6838/383637208,v1:172.21.15.138:6839/383637208] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x556bbf3d5df0 con 0x556bbf479430 2024-09-10T22:37:49.888 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:49.871+0000 7eff93fff640 1 --2- 172.21.15.19:0/4050981205 >> [v2:172.21.15.138:6838/383637208,v1:172.21.15.138:6839/383637208] conn(0x556bbf479430 0x556bbf47b8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:37:49.888 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:49.871+0000 7eff93fff640 1 --2- 172.21.15.19:0/4050981205 >> [v2:172.21.15.138:6838/383637208,v1:172.21.15.138:6839/383637208] conn(0x556bbf479430 0x556bbf47b8c0 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=5b5eaadb5acd1a45 server_cookie=324d88c43766cd33 in_seq=0 out_seq=0 2024-09-10T22:37:49.888 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:49.871+0000 7eff73fff640 10 client.17595 ms_handle_connect on v2:172.21.15.138:6838/383637208 2024-09-10T22:37:49.888 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:49.872+0000 7eff73fff640 1 -- 172.21.15.19:0/4050981205 <== mds.1 v2:172.21.15.138:6838/383637208 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x556bbf3d5df0 con 0x556bbf479430 2024-09-10T22:37:49.889 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:49.872+0000 7eff73fff640 10 client.17595 handle_command_reply: tid=0 2024-09-10T22:37:49.889 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:49.872+0000 7eff9d150740 1 client.17595 shutdown 2024-09-10T22:37:49.889 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:49.872+0000 7eff9d150740 1 -- 172.21.15.19:0/4050981205 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x556bbf45d0f0 msgr2=0x556bbf469210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:37:49.889 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:49.872+0000 7eff9d150740 1 --2- 172.21.15.19:0/4050981205 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x556bbf45d0f0 0x556bbf469210 secure :-1 s=READY pgs=864 cs=0 l=1 rev1=1 crypto rx=0x7eff840ca120 tx=0x7eff8402a410 comp rx=0 tx=0).stop 2024-09-10T22:37:49.889 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:49.872+0000 7eff9d150740 1 -- 172.21.15.19:0/4050981205 shutdown_connections 2024-09-10T22:37:49.889 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:49.872+0000 7eff9d150740 1 --2- 172.21.15.19:0/4050981205 >> [v2:172.21.15.138:6838/383637208,v1:172.21.15.138:6839/383637208] conn(0x556bbf479430 0x556bbf47b8c0 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:37:49.889 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:49.872+0000 7eff9d150740 1 --2- 172.21.15.19:0/4050981205 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x556bbf4699a0 0x556bbf466be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:37:49.889 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:49.872+0000 7eff9d150740 1 --2- 172.21.15.19:0/4050981205 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556bbf45da10 0x556bbf466660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:37:49.890 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:49.872+0000 7eff9d150740 1 --2- 172.21.15.19:0/4050981205 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x556bbf45d0f0 0x556bbf469210 unknown :-1 s=CLOSED pgs=864 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:37:49.890 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:49.872+0000 7eff73fff640 0 client.17595 ms_handle_reset on v2:172.21.15.138:6838/383637208 2024-09-10T22:37:49.890 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:49.872+0000 7eff9d150740 1 -- 172.21.15.19:0/4050981205 >> 172.21.15.19:0/4050981205 conn(0x556bbf45af20 msgr2=0x556bbf460a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:37:49.890 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:49.872+0000 7eff9d150740 1 -- 172.21.15.19:0/4050981205 shutdown_connections 2024-09-10T22:37:49.890 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:49.872+0000 7eff9d150740 1 -- 172.21.15.19:0/4050981205 wait complete. 2024-09-10T22:37:49.890 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:49.872+0000 7eff9d150740 20 client.17595 trim_cache size 0 max 16384 2024-09-10T22:37:49.895 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:49.885+0000 7eff9d150740 1 Processor -- start 2024-09-10T22:37:49.895 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:49.886+0000 7eff9d150740 1 -- start start 2024-09-10T22:37:49.895 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:49.886+0000 7eff9d150740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556bbf45d0f0 0x556bbf465b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:37:49.895 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:49.886+0000 7eff9d150740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x556bbf45da10 0x556bbf46bc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:37:49.896 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:49.886+0000 7eff9d150740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x556bbf4699a0 0x556bbf464ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:37:49.896 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:49.886+0000 7eff9d150740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7eff941b2fa0 con 0x556bbf4699a0 2024-09-10T22:37:49.896 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:49.886+0000 7eff9d150740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7eff941b0840 con 0x556bbf45d0f0 2024-09-10T22:37:49.896 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:49.886+0000 7eff9d150740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7eff941ae690 con 0x556bbf45da10 2024-09-10T22:37:49.896 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:49.886+0000 7eff99318640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x556bbf4699a0 0x556bbf464ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:37:49.896 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:49.886+0000 7eff99318640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x556bbf4699a0 0x556bbf464ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:59568/0 (socket says 172.21.15.19:59568) 2024-09-10T22:37:49.896 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:49.886+0000 7eff99318640 1 -- 172.21.15.19:0/67805592 learned_addr learned my addr 172.21.15.19:0/67805592 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:37:49.896 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:49.886+0000 7eff98b17640 1 --2- 172.21.15.19:0/67805592 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556bbf45d0f0 0x556bbf465b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:37:49.896 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:49.886+0000 7eff93fff640 1 --2- 172.21.15.19:0/67805592 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x556bbf45da10 0x556bbf46bc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:37:49.896 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:49.886+0000 7eff99318640 1 -- 172.21.15.19:0/67805592 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x556bbf45da10 msgr2=0x556bbf46bc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:37:49.896 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:49.886+0000 7eff99318640 1 --2- 172.21.15.19:0/67805592 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x556bbf45da10 0x556bbf46bc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:37:49.897 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:49.886+0000 7eff99318640 1 -- 172.21.15.19:0/67805592 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556bbf45d0f0 msgr2=0x556bbf465b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:37:49.897 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:49.886+0000 7eff99318640 1 --2- 172.21.15.19:0/67805592 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556bbf45d0f0 0x556bbf465b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:37:49.897 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:49.886+0000 7eff99318640 1 -- 172.21.15.19:0/67805592 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556bbf466f50 con 0x556bbf4699a0 2024-09-10T22:37:49.897 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:49.886+0000 7eff99318640 1 --2- 172.21.15.19:0/67805592 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x556bbf4699a0 0x556bbf464ee0 secure :-1 s=READY pgs=865 cs=0 l=1 rev1=1 crypto rx=0x7eff8c0117b0 tx=0x7eff8c016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d1f4d90dfbdc4fe6 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:37:49.897 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:49.887+0000 7eff7a7fc640 1 -- 172.21.15.19:0/67805592 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff8c011e40 con 0x556bbf4699a0 2024-09-10T22:37:49.897 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:49.887+0000 7eff7a7fc640 1 -- 172.21.15.19:0/67805592 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7eff8c01d8e0 con 0x556bbf4699a0 2024-09-10T22:37:49.897 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:49.887+0000 7eff7a7fc640 1 -- 172.21.15.19:0/67805592 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff8c0209d0 con 0x556bbf4699a0 2024-09-10T22:37:49.897 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:49.887+0000 7eff9d150740 1 -- 172.21.15.19:0/67805592 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x556bbf4699a0 msgr2=0x556bbf464ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:37:49.897 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:49.887+0000 7eff9d150740 1 --2- 172.21.15.19:0/67805592 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x556bbf4699a0 0x556bbf464ee0 secure :-1 s=READY pgs=865 cs=0 l=1 rev1=1 crypto rx=0x7eff8c0117b0 tx=0x7eff8c016000 comp rx=0 tx=0).stop 2024-09-10T22:37:49.897 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:49.887+0000 7eff9d150740 1 -- 172.21.15.19:0/67805592 shutdown_connections 2024-09-10T22:37:49.897 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:49.887+0000 7eff9d150740 1 --2- 172.21.15.19:0/67805592 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x556bbf4699a0 0x556bbf464ee0 unknown :-1 s=CLOSED pgs=865 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:37:49.897 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:49.887+0000 7eff9d150740 1 --2- 172.21.15.19:0/67805592 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x556bbf45da10 0x556bbf46bc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:37:49.897 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:49.887+0000 7eff9d150740 1 --2- 172.21.15.19:0/67805592 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556bbf45d0f0 0x556bbf465b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:37:49.898 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:49.887+0000 7eff9d150740 1 -- 172.21.15.19:0/67805592 >> 172.21.15.19:0/67805592 conn(0x556bbf45af20 msgr2=0x556bbf45bfc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:37:49.898 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:49.887+0000 7eff9d150740 1 -- 172.21.15.19:0/67805592 shutdown_connections 2024-09-10T22:37:49.898 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:49.887+0000 7eff9d150740 1 -- 172.21.15.19:0/67805592 wait complete. 2024-09-10T22:37:49.898 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:49.888+0000 7eff9d150740 1 -- start start 2024-09-10T22:37:49.898 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:49.888+0000 7eff9d150740 1 Processor -- start 2024-09-10T22:37:49.898 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:49.888+0000 7eff9d150740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x556bbf45d0f0 0x556bbf471920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:37:49.898 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:49.888+0000 7eff9d150740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556bbf45da10 0x556bbf471e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:37:49.898 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:49.888+0000 7eff9d150740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x556bbf4699a0 0x556bbf46c8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:37:49.898 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:49.888+0000 7eff9d150740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7eff941aed00 con 0x556bbf4699a0 2024-09-10T22:37:49.898 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:49.888+0000 7eff9d150740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7eff941b0170 con 0x556bbf45da10 2024-09-10T22:37:49.898 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:49.888+0000 7eff9d150740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7eff941af3d0 con 0x556bbf45d0f0 2024-09-10T22:37:49.898 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:49.888+0000 7eff9d150740 10 client.0 _ll_register_callbacks cb 0x7eff8403bf10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T22:37:49.898 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:49.888+0000 7eff99318640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x556bbf4699a0 0x556bbf46c8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:37:49.899 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:49.888+0000 7eff93fff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556bbf45da10 0x556bbf471e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:37:49.899 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:49.888+0000 7eff99318640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x556bbf4699a0 0x556bbf46c8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:59580/0 (socket says 172.21.15.19:59580) 2024-09-10T22:37:49.899 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:49.888+0000 7eff99318640 1 -- 172.21.15.19:0/884244350 learned_addr learned my addr 172.21.15.19:0/884244350 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:37:49.899 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:49.889+0000 7eff98b17640 1 --2- 172.21.15.19:0/884244350 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x556bbf45d0f0 0x556bbf471920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:37:49.899 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:49.889+0000 7eff99318640 1 -- 172.21.15.19:0/884244350 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x556bbf45d0f0 msgr2=0x556bbf471920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:37:49.899 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:49.889+0000 7eff99318640 1 --2- 172.21.15.19:0/884244350 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x556bbf45d0f0 0x556bbf471920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:37:49.899 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:49.889+0000 7eff99318640 1 -- 172.21.15.19:0/884244350 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556bbf45da10 msgr2=0x556bbf471e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:37:49.899 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:49.889+0000 7eff99318640 1 --2- 172.21.15.19:0/884244350 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556bbf45da10 0x556bbf471e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:37:49.899 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:49.889+0000 7eff99318640 1 -- 172.21.15.19:0/884244350 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556bbf4725f0 con 0x556bbf4699a0 2024-09-10T22:37:49.899 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:49.889+0000 7eff93fff640 1 --2- 172.21.15.19:0/884244350 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556bbf45da10 0x556bbf471e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T22:37:49.899 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:49.889+0000 7eff99318640 1 --2- 172.21.15.19:0/884244350 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x556bbf4699a0 0x556bbf46c8d0 secure :-1 s=READY pgs=866 cs=0 l=1 rev1=1 crypto rx=0x7eff8c020630 tx=0x7eff8c01dd40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e08e92a4de444986 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:37:49.899 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:49.889+0000 7eff73fff640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-10T22:37:49.899 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:49.889+0000 7eff73fff640 1 -- 172.21.15.19:0/884244350 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff8c011e40 con 0x556bbf4699a0 2024-09-10T22:37:49.900 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:49.889+0000 7eff73fff640 1 -- 172.21.15.19:0/884244350 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8327+0+0 (secure 0 0 0) 0x7eff8c02f070 con 0x556bbf4699a0 2024-09-10T22:37:49.900 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:49.889+0000 7eff9d150740 1 -- 172.21.15.19:0/884244350 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7eff8c01d8e0 con 0x556bbf4699a0 2024-09-10T22:37:49.900 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:49.889+0000 7eff73fff640 1 -- 172.21.15.19:0/884244350 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7eff8c004c50 con 0x556bbf4699a0 2024-09-10T22:37:49.900 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:49.889+0000 7eff9d150740 10 client.17601 fetch_fsmap learned FSMap version 28 2024-09-10T22:37:49.900 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:49.889+0000 7eff9d150740 1 -- 172.21.15.19:0/884244350 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x556bbf4e6920 con 0x556bbf4699a0 2024-09-10T22:37:49.900 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:49.890+0000 7eff73fff640 1 -- 172.21.15.19:0/884244350 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7eff8c01d8e0 con 0x556bbf4699a0 2024-09-10T22:37:49.900 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:49.890+0000 7eff73fff640 1 -- 172.21.15.19:0/884244350 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 28) ==== 8350+0+0 (secure 0 0 0) 0x7eff8c00f040 con 0x556bbf4699a0 2024-09-10T22:37:49.900 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:49.890+0000 7eff9d150740 10 client.17601 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T22:37:49.900 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:49.890+0000 7eff9d150740 10 client.17601 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-10T22:37:49.900 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:49.890+0000 7eff9d150740 20 client.17601 populate_metadata read hostname 'smithi019' 2024-09-10T22:37:49.900 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:49.890+0000 7eff9d150740 1 --2- 172.21.15.19:0/884244350 >> [v2:172.21.15.138:6838/383637208,v1:172.21.15.138:6839/383637208] conn(0x556bbf4e7010 0x556bbf4e9430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:37:49.900 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:49.890+0000 7eff9d150740 4 client.17601 mds_command: new command op to 24568 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-10T22:37:49.900 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:49.890+0000 7eff9d150740 1 -- 172.21.15.19:0/884244350 --> [v2:172.21.15.138:6838/383637208,v1:172.21.15.138:6839/383637208] -- command(tid 0: {"prefix": "damage ls"}) -- 0x556bbf3d18a0 con 0x556bbf4e7010 2024-09-10T22:37:49.901 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:49.890+0000 7eff98b17640 1 --2- 172.21.15.19:0/884244350 >> [v2:172.21.15.138:6838/383637208,v1:172.21.15.138:6839/383637208] conn(0x556bbf4e7010 0x556bbf4e9430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:37:49.901 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:49.890+0000 7eff98b17640 1 --2- 172.21.15.19:0/884244350 >> [v2:172.21.15.138:6838/383637208,v1:172.21.15.138:6839/383637208] conn(0x556bbf4e7010 0x556bbf4e9430 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=14d5726f3f4279c1 server_cookie=b6ce76bf7e751a8f in_seq=0 out_seq=0 2024-09-10T22:37:49.901 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:49.890+0000 7eff73fff640 10 client.17601 ms_handle_connect on v2:172.21.15.138:6838/383637208 2024-09-10T22:37:49.901 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:49.891+0000 7eff73fff640 1 -- 172.21.15.19:0/884244350 <== mds.1 v2:172.21.15.138:6838/383637208 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x556bbf3d18a0 con 0x556bbf4e7010 2024-09-10T22:37:49.901 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:49.891+0000 7eff73fff640 10 client.17601 handle_command_reply: tid=0 2024-09-10T22:37:49.901 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:49.891+0000 7eff9d150740 1 client.17601 shutdown 2024-09-10T22:37:49.901 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:49.891+0000 7eff9d150740 1 -- 172.21.15.19:0/884244350 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x556bbf4699a0 msgr2=0x556bbf46c8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:37:49.901 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:49.891+0000 7eff9d150740 1 --2- 172.21.15.19:0/884244350 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x556bbf4699a0 0x556bbf46c8d0 secure :-1 s=READY pgs=866 cs=0 l=1 rev1=1 crypto rx=0x7eff8c020630 tx=0x7eff8c01dd40 comp rx=0 tx=0).stop 2024-09-10T22:37:49.901 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:49.891+0000 7eff9d150740 1 -- 172.21.15.19:0/884244350 shutdown_connections 2024-09-10T22:37:49.901 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:49.891+0000 7eff9d150740 1 --2- 172.21.15.19:0/884244350 >> [v2:172.21.15.138:6838/383637208,v1:172.21.15.138:6839/383637208] conn(0x556bbf4e7010 0x556bbf4e9430 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:37:49.901 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:49.891+0000 7eff9d150740 1 --2- 172.21.15.19:0/884244350 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x556bbf4699a0 0x556bbf46c8d0 unknown :-1 s=CLOSED pgs=866 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:37:49.901 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:49.891+0000 7eff9d150740 1 --2- 172.21.15.19:0/884244350 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556bbf45da10 0x556bbf471e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:37:49.901 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:49.891+0000 7eff73fff640 0 client.17601 ms_handle_reset on v2:172.21.15.138:6838/383637208 2024-09-10T22:37:49.902 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:49.891+0000 7eff9d150740 1 --2- 172.21.15.19:0/884244350 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x556bbf45d0f0 0x556bbf471920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:37:49.902 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:49.891+0000 7eff9d150740 1 -- 172.21.15.19:0/884244350 >> 172.21.15.19:0/884244350 conn(0x556bbf45af20 msgr2=0x556bbf464ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:37:49.902 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:49.891+0000 7eff9d150740 1 -- 172.21.15.19:0/884244350 shutdown_connections 2024-09-10T22:37:49.902 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:49.891+0000 7eff9d150740 1 -- 172.21.15.19:0/884244350 wait complete. 2024-09-10T22:37:49.902 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:49.891+0000 7eff9d150740 20 client.17601 trim_cache size 0 max 16384 2024-09-10T22:37:49.902 INFO:teuthology.orchestra.run.smithi019.stdout:[] 2024-09-10T22:37:49.903 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:49.892+0000 7eff9ad7b640 1 -- 172.21.15.19:0/3157429256 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7eff7c0b5360 msgr2=0x7eff7c0b7820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:37:49.903 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:49.892+0000 7eff9ad7b640 1 --2- 172.21.15.19:0/3157429256 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7eff7c0b5360 0x7eff7c0b7820 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7eff94103a10 tx=0x7eff8c009820 comp rx=0 tx=0).stop 2024-09-10T22:37:49.903 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:49.892+0000 7eff9ad7b640 1 -- 172.21.15.19:0/3157429256 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7eff94103ca0 msgr2=0x7eff94101950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:37:49.903 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:49.892+0000 7eff9ad7b640 1 --2- 172.21.15.19:0/3157429256 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7eff94103ca0 0x7eff94101950 secure :-1 s=READY pgs=862 cs=0 l=1 rev1=1 crypto rx=0x7eff84005940 tx=0x7eff840042f0 comp rx=0 tx=0).stop 2024-09-10T22:37:49.903 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:49.892+0000 7eff9ad7b640 1 -- 172.21.15.19:0/3157429256 shutdown_connections 2024-09-10T22:37:49.903 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:49.892+0000 7eff9ad7b640 1 --2- 172.21.15.19:0/3157429256 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7eff7c0b5360 0x7eff7c0b7820 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:37:49.903 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:49.892+0000 7eff9ad7b640 1 --2- 172.21.15.19:0/3157429256 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7eff9410d100 0x7eff941023d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:37:49.903 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:49.892+0000 7eff9ad7b640 1 --2- 172.21.15.19:0/3157429256 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7eff941045c0 0x7eff94101e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:37:49.903 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:49.892+0000 7eff9ad7b640 1 --2- 172.21.15.19:0/3157429256 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7eff94103ca0 0x7eff94101950 unknown :-1 s=CLOSED pgs=862 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:37:49.903 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:49.892+0000 7eff9ad7b640 1 -- 172.21.15.19:0/3157429256 >> 172.21.15.19:0/3157429256 conn(0x7eff940fd700 msgr2=0x7eff940fe300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:37:49.904 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:49.892+0000 7eff9ad7b640 1 -- 172.21.15.19:0/3157429256 shutdown_connections 2024-09-10T22:37:49.904 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:49.892+0000 7eff9ad7b640 1 -- 172.21.15.19:0/3157429256 wait complete. 2024-09-10T22:37:50.208 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:37:49 smithi019 ceph-mon[31375]: pgmap v689: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 35 MiB/s wr, 101 op/s 2024-09-10T22:37:50.360 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:37:49 smithi135 ceph-mon[34789]: pgmap v689: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 35 MiB/s wr, 101 op/s 2024-09-10T22:37:50.375 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:37:50 smithi138 ceph-mon[35236]: pgmap v689: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 35 MiB/s wr, 101 op/s 2024-09-10T22:37:50.650 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 22997a4c-6fc2-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-10T22:37:50.957 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/22997a4c-6fc2-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T22:37:51.530 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:51.515+0000 7f1c58605640 1 -- 172.21.15.19:0/1357097103 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1c501076c0 msgr2=0x7f1c50107b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:37:51.531 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:51.515+0000 7f1c58605640 1 --2- 172.21.15.19:0/1357097103 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1c501076c0 0x7f1c50107b00 secure :-1 s=READY pgs=867 cs=0 l=1 rev1=1 crypto rx=0x7f1c40009900 tx=0x7f1c4002a410 comp rx=0 tx=0).stop 2024-09-10T22:37:51.531 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:51.515+0000 7f1c58605640 1 -- 172.21.15.19:0/1357097103 shutdown_connections 2024-09-10T22:37:51.531 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:51.515+0000 7f1c58605640 1 --2- 172.21.15.19:0/1357097103 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f1c50108040 0x7f1c5010e840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:37:51.531 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:51.515+0000 7f1c58605640 1 --2- 172.21.15.19:0/1357097103 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1c501076c0 0x7f1c50107b00 unknown :-1 s=CLOSED pgs=867 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:37:51.531 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:51.515+0000 7f1c58605640 1 --2- 172.21.15.19:0/1357097103 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1c50101cb0 0x7f1c50102090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:37:51.531 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:51.515+0000 7f1c58605640 1 -- 172.21.15.19:0/1357097103 >> 172.21.15.19:0/1357097103 conn(0x7f1c500fd700 msgr2=0x7f1c500ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:37:51.531 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:51.515+0000 7f1c58605640 1 -- 172.21.15.19:0/1357097103 shutdown_connections 2024-09-10T22:37:51.531 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:51.515+0000 7f1c58605640 1 -- 172.21.15.19:0/1357097103 wait complete. 2024-09-10T22:37:51.531 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:51.516+0000 7f1c58605640 1 Processor -- start 2024-09-10T22:37:51.531 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:51.516+0000 7f1c58605640 1 -- start start 2024-09-10T22:37:51.531 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:51.516+0000 7f1c58605640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1c50101cb0 0x7f1c50199290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:37:51.532 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:51.516+0000 7f1c58605640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1c501076c0 0x7f1c501997d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:37:51.532 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:51.516+0000 7f1c58605640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f1c50108040 0x7f1c5019eb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:37:51.532 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:51.516+0000 7f1c58605640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f1c50111ce0 con 0x7f1c501076c0 2024-09-10T22:37:51.532 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:51.516+0000 7f1c58605640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f1c50111b60 con 0x7f1c50101cb0 2024-09-10T22:37:51.532 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:51.516+0000 7f1c58605640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f1c50111e60 con 0x7f1c50108040 2024-09-10T22:37:51.532 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:51.516+0000 7f1c55ba0640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1c501076c0 0x7f1c501997d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:37:51.532 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:51.516+0000 7f1c55ba0640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1c501076c0 0x7f1c501997d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:59596/0 (socket says 172.21.15.19:59596) 2024-09-10T22:37:51.532 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:51.516+0000 7f1c55ba0640 1 -- 172.21.15.19:0/1015811177 learned_addr learned my addr 172.21.15.19:0/1015811177 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:37:51.532 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:51.516+0000 7f1c563a1640 1 --2- 172.21.15.19:0/1015811177 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1c50101cb0 0x7f1c50199290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:37:51.532 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:51.516+0000 7f1c56ba2640 1 --2- 172.21.15.19:0/1015811177 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f1c50108040 0x7f1c5019eb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:37:51.532 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:51.516+0000 7f1c55ba0640 1 -- 172.21.15.19:0/1015811177 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f1c50108040 msgr2=0x7f1c5019eb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:37:51.532 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:51.516+0000 7f1c55ba0640 1 --2- 172.21.15.19:0/1015811177 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f1c50108040 0x7f1c5019eb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:37:51.533 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:51.516+0000 7f1c55ba0640 1 -- 172.21.15.19:0/1015811177 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1c50101cb0 msgr2=0x7f1c50199290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:37:51.533 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:51.516+0000 7f1c55ba0640 1 --2- 172.21.15.19:0/1015811177 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1c50101cb0 0x7f1c50199290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:37:51.533 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:51.517+0000 7f1c55ba0640 1 -- 172.21.15.19:0/1015811177 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1c5019f340 con 0x7f1c501076c0 2024-09-10T22:37:51.533 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:51.517+0000 7f1c563a1640 1 --2- 172.21.15.19:0/1015811177 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1c50101cb0 0x7f1c50199290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T22:37:51.533 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:51.517+0000 7f1c55ba0640 1 --2- 172.21.15.19:0/1015811177 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1c501076c0 0x7f1c501997d0 secure :-1 s=READY pgs=868 cs=0 l=1 rev1=1 crypto rx=0x7f1c40005ab0 tx=0x7f1c40003cd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:37:51.533 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:51.517+0000 7f1c477fe640 1 -- 172.21.15.19:0/1015811177 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c4003f070 con 0x7f1c501076c0 2024-09-10T22:37:51.533 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:51.517+0000 7f1c477fe640 1 -- 172.21.15.19:0/1015811177 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1c40031d60 con 0x7f1c501076c0 2024-09-10T22:37:51.533 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:51.517+0000 7f1c58605640 1 -- 172.21.15.19:0/1015811177 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1c5019f5d0 con 0x7f1c501076c0 2024-09-10T22:37:51.533 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:51.517+0000 7f1c477fe640 1 -- 172.21.15.19:0/1015811177 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c40035030 con 0x7f1c501076c0 2024-09-10T22:37:51.533 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:51.517+0000 7f1c58605640 1 -- 172.21.15.19:0/1015811177 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1c501a5cf0 con 0x7f1c501076c0 2024-09-10T22:37:51.533 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:51.520+0000 7f1c5a9da740 1 Processor -- start 2024-09-10T22:37:51.533 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:51.520+0000 7f1c477fe640 1 -- 172.21.15.19:0/1015811177 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 18) ==== 153250+0+0 (secure 0 0 0) 0x7f1c4003b560 con 0x7f1c501076c0 2024-09-10T22:37:51.533 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:51.520+0000 7f1c5a9da740 1 -- start start 2024-09-10T22:37:51.533 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:51.520+0000 7f1c5a9da740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55e8c5e8b4d0 0x55e8c5e8b8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:37:51.534 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:51.520+0000 7f1c5a9da740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e8c5e8bdf0 0x55e8c5e97840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:37:51.534 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:51.520+0000 7f1c5a9da740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55e8c5e97d80 0x55e8c5e9a170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:37:51.534 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:51.520+0000 7f1c5a9da740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x55e8c5e01ea0 con 0x55e8c5e97d80 2024-09-10T22:37:51.534 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:51.520+0000 7f1c5a9da740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55e8c5df12d0 con 0x55e8c5e8bdf0 2024-09-10T22:37:51.534 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:51.520+0000 7f1c5a9da740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x55e8c5df50e0 con 0x55e8c5e8b4d0 2024-09-10T22:37:51.534 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:51.521+0000 7f1c55ba0640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55e8c5e97d80 0x55e8c5e9a170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:37:51.534 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:51.521+0000 7f1c563a1640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e8c5e8bdf0 0x55e8c5e97840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:37:51.534 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:51.521+0000 7f1c563a1640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e8c5e8bdf0 0x55e8c5e97840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.19:42388/0 (socket says 172.21.15.19:42388) 2024-09-10T22:37:51.534 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:51.521+0000 7f1c563a1640 1 -- 172.21.15.19:0/992272761 learned_addr learned my addr 172.21.15.19:0/992272761 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:37:51.534 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:51.521+0000 7f1c56ba2640 1 --2- 172.21.15.19:0/992272761 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55e8c5e8b4d0 0x55e8c5e8b8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:37:51.534 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:51.521+0000 7f1c563a1640 1 -- 172.21.15.19:0/992272761 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55e8c5e8b4d0 msgr2=0x55e8c5e8b8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:37:51.534 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:51.521+0000 7f1c563a1640 1 --2- 172.21.15.19:0/992272761 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55e8c5e8b4d0 0x55e8c5e8b8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:37:51.535 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:51.521+0000 7f1c563a1640 1 -- 172.21.15.19:0/992272761 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55e8c5e97d80 msgr2=0x55e8c5e9a170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:37:51.535 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:51.521+0000 7f1c563a1640 1 --2- 172.21.15.19:0/992272761 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55e8c5e97d80 0x55e8c5e9a170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:37:51.535 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:51.521+0000 7f1c563a1640 1 -- 172.21.15.19:0/992272761 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e8c5b4f650 con 0x55e8c5e8bdf0 2024-09-10T22:37:51.535 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:51.521+0000 7f1c477fe640 1 --2- 172.21.15.19:0/1015811177 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f1c3c0b5360 0x7f1c3c0b7820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:37:51.535 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:51.521+0000 7f1c563a1640 1 --2- 172.21.15.19:0/992272761 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e8c5e8bdf0 0x55e8c5e97840 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f1c4c010580 tx=0x7f1c4c010a40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ccceffd4a0c3137f server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:37:51.535 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:51.521+0000 7f1c56ba2640 1 --2- 172.21.15.19:0/1015811177 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f1c3c0b5360 0x7f1c3c0b7820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:37:51.535 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:51.521+0000 7f1c44ff9640 1 -- 172.21.15.19:0/992272761 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c4c011760 con 0x55e8c5e8bdf0 2024-09-10T22:37:51.535 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:51.521+0000 7f1c477fe640 1 -- 172.21.15.19:0/1015811177 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8327+0+0 (secure 0 0 0) 0x7f1c401066e0 con 0x7f1c501076c0 2024-09-10T22:37:51.535 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:51.521+0000 7f1c44ff9640 1 -- 172.21.15.19:0/992272761 <== mon.2 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1c4c011db0 con 0x55e8c5e8bdf0 2024-09-10T22:37:51.535 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:51.522+0000 7f1c44ff9640 1 -- 172.21.15.19:0/992272761 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c4c01ce30 con 0x55e8c5e8bdf0 2024-09-10T22:37:51.535 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:51.522+0000 7f1c5a9da740 1 -- 172.21.15.19:0/992272761 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e8c5e8bdf0 msgr2=0x55e8c5e97840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:37:51.535 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:51.522+0000 7f1c56ba2640 1 --2- 172.21.15.19:0/1015811177 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f1c3c0b5360 0x7f1c3c0b7820 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f1c48005fd0 tx=0x7f1c480096a0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:37:51.535 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:51.522+0000 7f1c5a9da740 1 --2- 172.21.15.19:0/992272761 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e8c5e8bdf0 0x55e8c5e97840 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f1c4c010580 tx=0x7f1c4c010a40 comp rx=0 tx=0).stop 2024-09-10T22:37:51.535 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:51.522+0000 7f1c5a9da740 1 -- 172.21.15.19:0/992272761 shutdown_connections 2024-09-10T22:37:51.535 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:51.522+0000 7f1c5a9da740 1 --2- 172.21.15.19:0/992272761 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55e8c5e97d80 0x55e8c5e9a170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:37:51.536 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:51.522+0000 7f1c5a9da740 1 --2- 172.21.15.19:0/992272761 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e8c5e8bdf0 0x55e8c5e97840 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:37:51.536 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:51.522+0000 7f1c5a9da740 1 --2- 172.21.15.19:0/992272761 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55e8c5e8b4d0 0x55e8c5e8b8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:37:51.536 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:51.522+0000 7f1c5a9da740 1 -- 172.21.15.19:0/992272761 >> 172.21.15.19:0/992272761 conn(0x55e8c5e89300 msgr2=0x55e8c5e8a4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:37:51.536 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:51.522+0000 7f1c5a9da740 1 -- 172.21.15.19:0/992272761 shutdown_connections 2024-09-10T22:37:51.536 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:51.522+0000 7f1c5a9da740 1 -- 172.21.15.19:0/992272761 wait complete. 2024-09-10T22:37:51.536 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:51.523+0000 7f1c5a9da740 1 -- start start 2024-09-10T22:37:51.536 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:51.523+0000 7f1c5a9da740 1 Processor -- start 2024-09-10T22:37:51.536 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:51.523+0000 7f1c5a9da740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e8c5e8b4d0 0x55e8c5e97610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:37:51.536 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:51.523+0000 7f1c5a9da740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55e8c5e8bdf0 0x55e8c5e94a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:37:51.536 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:51.523+0000 7f1c5a9da740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55e8c5e97d80 0x55e8c5e95000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:37:51.536 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:51.523+0000 7f1c5a9da740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x55e8c5c52700 con 0x55e8c5e97d80 2024-09-10T22:37:51.536 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:51.523+0000 7f1c5a9da740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55e8c5d8c160 con 0x55e8c5e8b4d0 2024-09-10T22:37:51.536 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:51.523+0000 7f1c5a9da740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x55e8c5e9aa50 con 0x55e8c5e8bdf0 2024-09-10T22:37:51.537 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:51.523+0000 7f1c5a9da740 10 client.0 _ll_register_callbacks cb 0x55e8c5da59e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T22:37:51.537 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:51.523+0000 7f1c563a1640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e8c5e8b4d0 0x55e8c5e97610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:37:51.537 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:51.523+0000 7f1c56ba2640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55e8c5e97d80 0x55e8c5e95000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:37:51.537 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:51.523+0000 7f1c55ba0640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55e8c5e8bdf0 0x55e8c5e94a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:37:51.537 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:51.523+0000 7f1c563a1640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e8c5e8b4d0 0x55e8c5e97610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.19:42392/0 (socket says 172.21.15.19:42392) 2024-09-10T22:37:51.537 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:51.523+0000 7f1c56ba2640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55e8c5e97d80 0x55e8c5e95000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:59612/0 (socket says 172.21.15.19:59612) 2024-09-10T22:37:51.537 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:51.523+0000 7f1c563a1640 1 -- 172.21.15.19:0/4276762974 learned_addr learned my addr 172.21.15.19:0/4276762974 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:37:51.537 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:51.524+0000 7f1c563a1640 1 -- 172.21.15.19:0/4276762974 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55e8c5e8bdf0 msgr2=0x55e8c5e94a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:37:51.537 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:51.524+0000 7f1c563a1640 1 --2- 172.21.15.19:0/4276762974 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55e8c5e8bdf0 0x55e8c5e94a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:37:51.537 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:51.524+0000 7f1c563a1640 1 -- 172.21.15.19:0/4276762974 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55e8c5e97d80 msgr2=0x55e8c5e95000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:37:51.537 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:51.524+0000 7f1c563a1640 1 --2- 172.21.15.19:0/4276762974 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55e8c5e97d80 0x55e8c5e95000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:37:51.537 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:51.524+0000 7f1c563a1640 1 -- 172.21.15.19:0/4276762974 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e8c5db9c90 con 0x55e8c5e8b4d0 2024-09-10T22:37:51.538 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:51.524+0000 7f1c55ba0640 1 --2- 172.21.15.19:0/4276762974 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55e8c5e8bdf0 0x55e8c5e94a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T22:37:51.538 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:51.524+0000 7f1c563a1640 1 --2- 172.21.15.19:0/4276762974 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e8c5e8b4d0 0x55e8c5e97610 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f1c4c01cb10 tx=0x7f1c4c01cde0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bd8858a28ec7d7b9 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:37:51.538 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:51.524+0000 7f1c39ffb640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-09-10T22:37:51.538 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:51.524+0000 7f1c39ffb640 1 -- 172.21.15.19:0/4276762974 <== mon.2 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c4c02b060 con 0x55e8c5e8b4d0 2024-09-10T22:37:51.538 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:51.524+0000 7f1c5a9da740 1 -- 172.21.15.19:0/4276762974 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1c4c011db0 con 0x55e8c5e8b4d0 2024-09-10T22:37:51.538 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:51.524+0000 7f1c39ffb640 1 -- 172.21.15.19:0/4276762974 <== mon.2 v2:172.21.15.135:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8327+0+0 (secure 0 0 0) 0x7f1c4c01c690 con 0x55e8c5e8b4d0 2024-09-10T22:37:51.538 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:51.524+0000 7f1c39ffb640 1 -- 172.21.15.19:0/4276762974 <== mon.2 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f1c4c011560 con 0x55e8c5e8b4d0 2024-09-10T22:37:51.538 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:51.524+0000 7f1c5a9da740 10 client.26900 fetch_fsmap learned FSMap version 28 2024-09-10T22:37:51.538 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:51.524+0000 7f1c5a9da740 1 -- 172.21.15.19:0/4276762974 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55e8c5ea6350 con 0x55e8c5e8b4d0 2024-09-10T22:37:51.538 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:51.524+0000 7f1c39ffb640 1 -- 172.21.15.19:0/4276762974 <== mon.2 v2:172.21.15.135:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1c4c011db0 con 0x55e8c5e8b4d0 2024-09-10T22:37:51.538 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:51.525+0000 7f1c39ffb640 1 -- 172.21.15.19:0/4276762974 <== mon.2 v2:172.21.15.135:3300/0 5 ==== fsmap(e 28) ==== 8350+0+0 (secure 0 0 0) 0x7f1c4c02f030 con 0x55e8c5e8b4d0 2024-09-10T22:37:51.539 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:51.525+0000 7f1c5a9da740 10 client.26900 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T22:37:51.539 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:51.525+0000 7f1c5a9da740 10 client.26900 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-10T22:37:51.539 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:51.525+0000 7f1c5a9da740 20 client.26900 populate_metadata read hostname 'smithi019' 2024-09-10T22:37:51.539 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:51.525+0000 7f1c5a9da740 1 --2- 172.21.15.19:0/4276762974 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x55e8c5ea77b0 0x55e8c5ea9ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:37:51.539 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:51.525+0000 7f1c5a9da740 4 client.26900 mds_command: new command op to 24581 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T22:37:51.539 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:51.525+0000 7f1c5a9da740 1 -- 172.21.15.19:0/4276762974 --> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e8c5e03df0 con 0x55e8c5ea77b0 2024-09-10T22:37:51.539 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:51.525+0000 7f1c55ba0640 1 --2- 172.21.15.19:0/4276762974 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x55e8c5ea77b0 0x55e8c5ea9ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:37:51.539 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:51.525+0000 7f1c55ba0640 1 --2- 172.21.15.19:0/4276762974 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x55e8c5ea77b0 0x55e8c5ea9ba0 crc :-1 s=READY pgs=218 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c5220d91e8ccbb41 server_cookie=5fbc18a36cfc328f in_seq=0 out_seq=0 2024-09-10T22:37:51.539 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:51.525+0000 7f1c39ffb640 10 client.26900 ms_handle_connect on v2:172.21.15.135:6838/1254769802 2024-09-10T22:37:51.539 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:51.526+0000 7f1c39ffb640 1 -- 172.21.15.19:0/4276762974 <== mds.0 v2:172.21.15.135:6838/1254769802 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55e8c5e03df0 con 0x55e8c5ea77b0 2024-09-10T22:37:51.539 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:51.526+0000 7f1c39ffb640 10 client.26900 handle_command_reply: tid=0 2024-09-10T22:37:51.539 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:51.526+0000 7f1c5a9da740 1 client.26900 shutdown 2024-09-10T22:37:51.539 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:51.526+0000 7f1c5a9da740 1 -- 172.21.15.19:0/4276762974 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e8c5e8b4d0 msgr2=0x55e8c5e97610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:37:51.539 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:51.526+0000 7f1c5a9da740 1 --2- 172.21.15.19:0/4276762974 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e8c5e8b4d0 0x55e8c5e97610 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f1c4c01cb10 tx=0x7f1c4c01cde0 comp rx=0 tx=0).stop 2024-09-10T22:37:51.539 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:51.526+0000 7f1c5a9da740 1 -- 172.21.15.19:0/4276762974 shutdown_connections 2024-09-10T22:37:51.540 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:51.526+0000 7f1c5a9da740 1 --2- 172.21.15.19:0/4276762974 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55e8c5e97d80 0x55e8c5e95000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:37:51.540 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:51.526+0000 7f1c5a9da740 1 --2- 172.21.15.19:0/4276762974 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x55e8c5ea77b0 0x55e8c5ea9ba0 crc :-1 s=READY pgs=218 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:37:51.540 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:51.526+0000 7f1c5a9da740 1 --2- 172.21.15.19:0/4276762974 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55e8c5e8bdf0 0x55e8c5e94a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:37:51.540 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:51.526+0000 7f1c5a9da740 1 --2- 172.21.15.19:0/4276762974 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e8c5e8b4d0 0x55e8c5e97610 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:37:51.540 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:51.526+0000 7f1c5a9da740 1 -- 172.21.15.19:0/4276762974 >> 172.21.15.19:0/4276762974 conn(0x55e8c5e89300 msgr2=0x55e8c5e8ee70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:37:51.540 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:51.526+0000 7f1c39ffb640 0 client.26900 ms_handle_reset on v2:172.21.15.135:6838/1254769802 2024-09-10T22:37:51.540 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:51.526+0000 7f1c5a9da740 1 -- 172.21.15.19:0/4276762974 shutdown_connections 2024-09-10T22:37:51.540 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:51.526+0000 7f1c5a9da740 1 -- 172.21.15.19:0/4276762974 wait complete. 2024-09-10T22:37:51.540 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:51.527+0000 7f1c5a9da740 20 client.26900 trim_cache size 0 max 16384 2024-09-10T22:37:51.542 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:51.540+0000 7f1c5a9da740 1 Processor -- start 2024-09-10T22:37:51.542 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:51.540+0000 7f1c5a9da740 1 -- start start 2024-09-10T22:37:51.542 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:51.540+0000 7f1c5a9da740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55e8c5e8b4d0 0x55e8c5e8a8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:37:51.542 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:51.540+0000 7f1c5a9da740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e8c5e8bdf0 0x55e8c5e91c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:37:51.542 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:51.540+0000 7f1c5a9da740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55e8c5e97d80 0x55e8c5e921b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:37:51.543 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:51.540+0000 7f1c5a9da740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f1c501b0e60 con 0x55e8c5e97d80 2024-09-10T22:37:51.543 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:51.540+0000 7f1c5a9da740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f1c501ae700 con 0x55e8c5e8bdf0 2024-09-10T22:37:51.543 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:51.540+0000 7f1c5a9da740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f1c501ac550 con 0x55e8c5e8b4d0 2024-09-10T22:37:51.543 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:51.541+0000 7f1c56ba2640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55e8c5e97d80 0x55e8c5e921b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:37:51.543 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:51.541+0000 7f1c563a1640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55e8c5e8b4d0 0x55e8c5e8a8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:37:51.543 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:51.541+0000 7f1c55ba0640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e8c5e8bdf0 0x55e8c5e91c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:37:51.543 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:51.541+0000 7f1c563a1640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55e8c5e8b4d0 0x55e8c5e8a8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.19:51930/0 (socket says 172.21.15.19:51930) 2024-09-10T22:37:51.543 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:51.541+0000 7f1c56ba2640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55e8c5e97d80 0x55e8c5e921b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:59624/0 (socket says 172.21.15.19:59624) 2024-09-10T22:37:51.543 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:51.541+0000 7f1c563a1640 1 -- 172.21.15.19:0/1785360693 learned_addr learned my addr 172.21.15.19:0/1785360693 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:37:51.543 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:51.541+0000 7f1c563a1640 1 -- 172.21.15.19:0/1785360693 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e8c5e8bdf0 msgr2=0x55e8c5e91c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:37:51.543 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:51.541+0000 7f1c563a1640 1 --2- 172.21.15.19:0/1785360693 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e8c5e8bdf0 0x55e8c5e91c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:37:51.543 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:51.541+0000 7f1c563a1640 1 -- 172.21.15.19:0/1785360693 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55e8c5e97d80 msgr2=0x55e8c5e921b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:37:51.543 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:51.541+0000 7f1c563a1640 1 --2- 172.21.15.19:0/1785360693 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55e8c5e97d80 0x55e8c5e921b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:37:51.543 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:51.541+0000 7f1c563a1640 1 -- 172.21.15.19:0/1785360693 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e8c5e94810 con 0x55e8c5e8b4d0 2024-09-10T22:37:51.544 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:51.541+0000 7f1c55ba0640 1 --2- 172.21.15.19:0/1785360693 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e8c5e8bdf0 0x55e8c5e91c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T22:37:51.547 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:51.541+0000 7f1c563a1640 1 --2- 172.21.15.19:0/1785360693 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55e8c5e8b4d0 0x55e8c5e8a8f0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f1c4c01cb80 tx=0x7f1c4c010a40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8088e5b3351f4e21 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:37:51.547 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:51.541+0000 7f1c3bfff640 1 -- 172.21.15.19:0/1785360693 <== mon.1 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c4c02b030 con 0x55e8c5e8b4d0 2024-09-10T22:37:51.547 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:51.541+0000 7f1c3bfff640 1 -- 172.21.15.19:0/1785360693 <== mon.1 v2:172.21.15.138:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1c4c005520 con 0x55e8c5e8b4d0 2024-09-10T22:37:51.548 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:51.541+0000 7f1c3bfff640 1 -- 172.21.15.19:0/1785360693 <== mon.1 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c4c01c690 con 0x55e8c5e8b4d0 2024-09-10T22:37:51.548 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:51.542+0000 7f1c5a9da740 1 -- 172.21.15.19:0/1785360693 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55e8c5e8b4d0 msgr2=0x55e8c5e8a8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:37:51.548 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:51.542+0000 7f1c5a9da740 1 --2- 172.21.15.19:0/1785360693 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55e8c5e8b4d0 0x55e8c5e8a8f0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f1c4c01cb80 tx=0x7f1c4c010a40 comp rx=0 tx=0).stop 2024-09-10T22:37:51.548 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:51.542+0000 7f1c5a9da740 1 -- 172.21.15.19:0/1785360693 shutdown_connections 2024-09-10T22:37:51.548 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:51.542+0000 7f1c5a9da740 1 --2- 172.21.15.19:0/1785360693 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55e8c5e97d80 0x55e8c5e921b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:37:51.548 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:51.542+0000 7f1c5a9da740 1 --2- 172.21.15.19:0/1785360693 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e8c5e8bdf0 0x55e8c5e91c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:37:51.548 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:51.542+0000 7f1c5a9da740 1 --2- 172.21.15.19:0/1785360693 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55e8c5e8b4d0 0x55e8c5e8a8f0 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:37:51.548 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:51.542+0000 7f1c5a9da740 1 -- 172.21.15.19:0/1785360693 >> 172.21.15.19:0/1785360693 conn(0x55e8c5e89300 msgr2=0x55e8c5e8a1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:37:51.548 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:51.542+0000 7f1c5a9da740 1 -- 172.21.15.19:0/1785360693 shutdown_connections 2024-09-10T22:37:51.548 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:51.542+0000 7f1c5a9da740 1 -- 172.21.15.19:0/1785360693 wait complete. 2024-09-10T22:37:51.548 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:51.542+0000 7f1c5a9da740 1 -- start start 2024-09-10T22:37:51.548 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:51.543+0000 7f1c5a9da740 1 Processor -- start 2024-09-10T22:37:51.548 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:51.543+0000 7f1c5a9da740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55e8c5e8b4d0 0x55e8c5ea01b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:37:51.549 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:51.543+0000 7f1c5a9da740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e8c5e8bdf0 0x55e8c5ea0730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:37:51.549 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:51.543+0000 7f1c5a9da740 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55e8c5e97d80 0x55e8c5e9b8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:37:51.549 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:51.543+0000 7f1c5a9da740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f1c501acbc0 con 0x55e8c5e8b4d0 2024-09-10T22:37:51.549 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:51.543+0000 7f1c5a9da740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f1c501ae030 con 0x55e8c5e8bdf0 2024-09-10T22:37:51.549 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:51.543+0000 7f1c5a9da740 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f1c501ad290 con 0x55e8c5e97d80 2024-09-10T22:37:51.549 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:51.543+0000 7f1c5a9da740 10 client.0 _ll_register_callbacks cb 0x7f1c4010c420 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T22:37:51.549 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:51.543+0000 7f1c563a1640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55e8c5e8b4d0 0x55e8c5ea01b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:37:51.549 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:51.543+0000 7f1c563a1640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55e8c5e8b4d0 0x55e8c5ea01b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:59630/0 (socket says 172.21.15.19:59630) 2024-09-10T22:37:51.549 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:51.543+0000 7f1c563a1640 1 -- 172.21.15.19:0/862852146 learned_addr learned my addr 172.21.15.19:0/862852146 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:37:51.549 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:51.543+0000 7f1c56ba2640 1 --2- 172.21.15.19:0/862852146 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55e8c5e97d80 0x55e8c5e9b8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:37:51.549 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:51.543+0000 7f1c55ba0640 1 --2- 172.21.15.19:0/862852146 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e8c5e8bdf0 0x55e8c5ea0730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:37:51.549 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:51.543+0000 7f1c563a1640 1 -- 172.21.15.19:0/862852146 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55e8c5e97d80 msgr2=0x55e8c5e9b8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:37:51.549 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:51.543+0000 7f1c563a1640 1 --2- 172.21.15.19:0/862852146 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55e8c5e97d80 0x55e8c5e9b8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:37:51.550 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:51.543+0000 7f1c563a1640 1 -- 172.21.15.19:0/862852146 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e8c5e8bdf0 msgr2=0x55e8c5ea0730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:37:51.550 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:51.543+0000 7f1c563a1640 1 --2- 172.21.15.19:0/862852146 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e8c5e8bdf0 0x55e8c5ea0730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:37:51.550 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:51.543+0000 7f1c563a1640 1 -- 172.21.15.19:0/862852146 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e8c5e9c0e0 con 0x55e8c5e8b4d0 2024-09-10T22:37:51.550 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:51.543+0000 7f1c55ba0640 1 --2- 172.21.15.19:0/862852146 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e8c5e8bdf0 0x55e8c5ea0730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T22:37:51.550 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:51.543+0000 7f1c563a1640 1 --2- 172.21.15.19:0/862852146 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55e8c5e8b4d0 0x55e8c5ea01b0 secure :-1 s=READY pgs=869 cs=0 l=1 rev1=1 crypto rx=0x7f1c4c026870 tx=0x7f1c4c0058f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=72fcb3ed8d204958 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:37:51.550 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:51.543+0000 7f1c39ffb640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-10T22:37:51.550 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:51.544+0000 7f1c39ffb640 1 -- 172.21.15.19:0/862852146 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c4c03c070 con 0x55e8c5e8b4d0 2024-09-10T22:37:51.550 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:51.544+0000 7f1c39ffb640 1 -- 172.21.15.19:0/862852146 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8327+0+0 (secure 0 0 0) 0x7f1c4c026470 con 0x55e8c5e8b4d0 2024-09-10T22:37:51.550 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:51.544+0000 7f1c5a9da740 1 -- 172.21.15.19:0/862852146 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1c4c005520 con 0x55e8c5e8b4d0 2024-09-10T22:37:51.550 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:51.544+0000 7f1c39ffb640 1 -- 172.21.15.19:0/862852146 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f1c4c02b070 con 0x55e8c5e8b4d0 2024-09-10T22:37:51.550 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:51.544+0000 7f1c5a9da740 10 client.17619 fetch_fsmap learned FSMap version 28 2024-09-10T22:37:51.550 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:51.544+0000 7f1c5a9da740 1 -- 172.21.15.19:0/862852146 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55e8c5f140f0 con 0x55e8c5e8b4d0 2024-09-10T22:37:51.550 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:51.544+0000 7f1c39ffb640 1 -- 172.21.15.19:0/862852146 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1c4c005520 con 0x55e8c5e8b4d0 2024-09-10T22:37:51.551 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:51.544+0000 7f1c39ffb640 1 -- 172.21.15.19:0/862852146 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 28) ==== 8350+0+0 (secure 0 0 0) 0x7f1c4c03f030 con 0x55e8c5e8b4d0 2024-09-10T22:37:51.551 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:51.544+0000 7f1c5a9da740 10 client.17619 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T22:37:51.551 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:51.544+0000 7f1c5a9da740 10 client.17619 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-10T22:37:51.551 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:51.544+0000 7f1c5a9da740 20 client.17619 populate_metadata read hostname 'smithi019' 2024-09-10T22:37:51.551 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:51.544+0000 7f1c5a9da740 1 --2- 172.21.15.19:0/862852146 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x55e8c5f147a0 0x55e8c5f16bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:37:51.551 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:51.544+0000 7f1c5a9da740 4 client.17619 mds_command: new command op to 24581 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-10T22:37:51.551 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:51.544+0000 7f1c5a9da740 1 -- 172.21.15.19:0/862852146 --> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55e8c5dff8a0 con 0x55e8c5f147a0 2024-09-10T22:37:51.551 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:51.545+0000 7f1c55ba0640 1 --2- 172.21.15.19:0/862852146 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x55e8c5f147a0 0x55e8c5f16bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:37:51.551 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:51.545+0000 7f1c55ba0640 1 --2- 172.21.15.19:0/862852146 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x55e8c5f147a0 0x55e8c5f16bc0 crc :-1 s=READY pgs=219 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f4ddc81045801394 server_cookie=b3d16edfa64930be in_seq=0 out_seq=0 2024-09-10T22:37:51.551 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:51.545+0000 7f1c39ffb640 10 client.17619 ms_handle_connect on v2:172.21.15.135:6838/1254769802 2024-09-10T22:37:51.551 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:51.545+0000 7f1c39ffb640 1 -- 172.21.15.19:0/862852146 <== mds.0 v2:172.21.15.135:6838/1254769802 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55e8c5dff8a0 con 0x55e8c5f147a0 2024-09-10T22:37:51.551 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:51.545+0000 7f1c39ffb640 10 client.17619 handle_command_reply: tid=0 2024-09-10T22:37:51.551 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:51.545+0000 7f1c5a9da740 1 client.17619 shutdown 2024-09-10T22:37:51.552 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:51.545+0000 7f1c5a9da740 1 -- 172.21.15.19:0/862852146 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55e8c5e8b4d0 msgr2=0x55e8c5ea01b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:37:51.552 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:51.545+0000 7f1c5a9da740 1 --2- 172.21.15.19:0/862852146 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55e8c5e8b4d0 0x55e8c5ea01b0 secure :-1 s=READY pgs=869 cs=0 l=1 rev1=1 crypto rx=0x7f1c4c026870 tx=0x7f1c4c0058f0 comp rx=0 tx=0).stop 2024-09-10T22:37:51.552 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:51.545+0000 7f1c5a9da740 1 -- 172.21.15.19:0/862852146 shutdown_connections 2024-09-10T22:37:51.552 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:51.545+0000 7f1c5a9da740 1 --2- 172.21.15.19:0/862852146 >> [v2:172.21.15.135:6838/1254769802,v1:172.21.15.135:6839/1254769802] conn(0x55e8c5f147a0 0x55e8c5f16bc0 crc :-1 s=READY pgs=219 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:37:51.552 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:51.545+0000 7f1c5a9da740 1 --2- 172.21.15.19:0/862852146 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55e8c5e97d80 0x55e8c5e9b8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:37:51.552 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:51.545+0000 7f1c5a9da740 1 --2- 172.21.15.19:0/862852146 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e8c5e8bdf0 0x55e8c5ea0730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:37:51.552 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:51.545+0000 7f1c5a9da740 1 --2- 172.21.15.19:0/862852146 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55e8c5e8b4d0 0x55e8c5ea01b0 unknown :-1 s=CLOSED pgs=869 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:37:51.552 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:51.545+0000 7f1c5a9da740 1 -- 172.21.15.19:0/862852146 >> 172.21.15.19:0/862852146 conn(0x55e8c5e89300 msgr2=0x55e8c5e96090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:37:51.552 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:51.545+0000 7f1c39ffb640 0 client.17619 ms_handle_reset on v2:172.21.15.135:6838/1254769802 2024-09-10T22:37:51.552 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:51.546+0000 7f1c5a9da740 1 -- 172.21.15.19:0/862852146 shutdown_connections 2024-09-10T22:37:51.552 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:51.546+0000 7f1c5a9da740 1 -- 172.21.15.19:0/862852146 wait complete. 2024-09-10T22:37:51.552 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:51.546+0000 7f1c5a9da740 20 client.17619 trim_cache size 0 max 16384 2024-09-10T22:37:51.553 INFO:teuthology.orchestra.run.smithi019.stdout:[] 2024-09-10T22:37:51.553 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:51.546+0000 7f1c58605640 1 -- 172.21.15.19:0/1015811177 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f1c3c0b5360 msgr2=0x7f1c3c0b7820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:37:51.553 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:51.546+0000 7f1c58605640 1 --2- 172.21.15.19:0/1015811177 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f1c3c0b5360 0x7f1c3c0b7820 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f1c48005fd0 tx=0x7f1c480096a0 comp rx=0 tx=0).stop 2024-09-10T22:37:51.553 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:51.546+0000 7f1c58605640 1 -- 172.21.15.19:0/1015811177 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1c501076c0 msgr2=0x7f1c501997d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:37:51.553 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:51.546+0000 7f1c58605640 1 --2- 172.21.15.19:0/1015811177 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1c501076c0 0x7f1c501997d0 secure :-1 s=READY pgs=868 cs=0 l=1 rev1=1 crypto rx=0x7f1c40005ab0 tx=0x7f1c40003cd0 comp rx=0 tx=0).stop 2024-09-10T22:37:51.553 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:51.546+0000 7f1c58605640 1 -- 172.21.15.19:0/1015811177 shutdown_connections 2024-09-10T22:37:51.554 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:51.546+0000 7f1c58605640 1 --2- 172.21.15.19:0/1015811177 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f1c3c0b5360 0x7f1c3c0b7820 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:37:51.554 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:51.546+0000 7f1c58605640 1 --2- 172.21.15.19:0/1015811177 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f1c50108040 0x7f1c5019eb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:37:51.554 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:51.546+0000 7f1c58605640 1 --2- 172.21.15.19:0/1015811177 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1c501076c0 0x7f1c501997d0 unknown :-1 s=CLOSED pgs=868 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:37:51.554 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:51.546+0000 7f1c58605640 1 --2- 172.21.15.19:0/1015811177 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1c50101cb0 0x7f1c50199290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:37:51.554 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:51.546+0000 7f1c58605640 1 -- 172.21.15.19:0/1015811177 >> 172.21.15.19:0/1015811177 conn(0x7f1c500fd700 msgr2=0x7f1c50104ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:37:51.554 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:51.546+0000 7f1c58605640 1 -- 172.21.15.19:0/1015811177 shutdown_connections 2024-09-10T22:37:51.554 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:51.546+0000 7f1c58605640 1 -- 172.21.15.19:0/1015811177 wait complete. 2024-09-10T22:37:52.208 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:37:52 smithi019 ceph-mon[31375]: pgmap v690: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 47 MiB/s wr, 94 op/s 2024-09-10T22:37:52.247 ERROR:tasks.fwd_scrub.fs.[cephfs]:exception: Traceback (most recent call last): File "/home/teuthworker/src/github.com_ceph_ceph-c_8f219c476cb4f26fc5719c661c0323719a45cb30/qa/tasks/fwd_scrub.py", line 35, in _run self.do_scrub() File "/home/teuthworker/src/github.com_ceph_ceph-c_8f219c476cb4f26fc5719c661c0323719a45cb30/qa/tasks/fwd_scrub.py", line 49, in do_scrub self.sleep_unless_stopped(self.sleep_between_iterations) File "/home/teuthworker/src/github.com_ceph_ceph-c_8f219c476cb4f26fc5719c661c0323719a45cb30/qa/tasks/thrasher.py", line 50, in sleep_unless_stopped raise self.Stopped() tasks.thrasher.ThrasherGreenlet.Stopped 2024-09-10T22:37:52.248 INFO:tasks.fwd_scrub:done joining 2024-09-10T22:37:52.248 DEBUG:teuthology.run_tasks:Unwinding manager check-counter 2024-09-10T22:37:52.258 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-10T22:37:52.360 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:37:52 smithi135 ceph-mon[34789]: pgmap v690: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 47 MiB/s wr, 94 op/s 2024-09-10T22:37:52.366 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:52.361+0000 7f762b3ca640 1 -- 172.21.15.19:0/3901236357 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f76241086d0 msgr2=0x7f762410ab90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:37:52.366 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:52.361+0000 7f762b3ca640 1 --2- 172.21.15.19:0/3901236357 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f76241086d0 0x7f762410ab90 secure :-1 s=READY pgs=870 cs=0 l=1 rev1=1 crypto rx=0x7f7614009900 tx=0x7f761402a410 comp rx=0 tx=0).stop 2024-09-10T22:37:52.366 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:52.361+0000 7f762b3ca640 1 -- 172.21.15.19:0/3901236357 shutdown_connections 2024-09-10T22:37:52.366 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:52.361+0000 7f762b3ca640 1 --2- 172.21.15.19:0/3901236357 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f76241086d0 0x7f762410ab90 unknown :-1 s=CLOSED pgs=870 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:37:52.366 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:52.361+0000 7f762b3ca640 1 --2- 172.21.15.19:0/3901236357 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7624105b60 0x7f7624107f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:37:52.366 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:52.361+0000 7f762b3ca640 1 --2- 172.21.15.19:0/3901236357 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f762406be20 0x7f7624105620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:37:52.366 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:52.361+0000 7f762b3ca640 1 -- 172.21.15.19:0/3901236357 >> 172.21.15.19:0/3901236357 conn(0x7f76240fd190 msgr2=0x7f76240ff5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:37:52.366 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:52.361+0000 7f762b3ca640 1 -- 172.21.15.19:0/3901236357 shutdown_connections 2024-09-10T22:37:52.367 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:52.361+0000 7f762b3ca640 1 -- 172.21.15.19:0/3901236357 wait complete. 2024-09-10T22:37:52.367 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:52.362+0000 7f762b3ca640 1 Processor -- start 2024-09-10T22:37:52.367 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:52.362+0000 7f762b3ca640 1 -- start start 2024-09-10T22:37:52.367 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:52.362+0000 7f762b3ca640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f762406be20 0x7f7624102d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:37:52.367 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:52.362+0000 7f762b3ca640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7624105b60 0x7f76241015c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:37:52.367 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:52.362+0000 7f762b3ca640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f76241086d0 0x7f7624101b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:37:52.367 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:52.362+0000 7f762b3ca640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f762410e630 con 0x7f76241086d0 2024-09-10T22:37:52.367 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:52.362+0000 7f762b3ca640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f762410e4b0 con 0x7f7624105b60 2024-09-10T22:37:52.367 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:52.362+0000 7f762b3ca640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f762410e7b0 con 0x7f762406be20 2024-09-10T22:37:52.367 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:52.362+0000 7f7629967640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f76241086d0 0x7f7624101b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:37:52.367 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:52.362+0000 7f7629967640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f76241086d0 0x7f7624101b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:59654/0 (socket says 172.21.15.19:59654) 2024-09-10T22:37:52.367 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:52.362+0000 7f7629967640 1 -- 172.21.15.19:0/955888135 learned_addr learned my addr 172.21.15.19:0/955888135 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:37:52.367 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:52.362+0000 7f7628965640 1 --2- 172.21.15.19:0/955888135 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7624105b60 0x7f76241015c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:37:52.367 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:52.363+0000 7f7629166640 1 --2- 172.21.15.19:0/955888135 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f762406be20 0x7f7624102d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:37:52.368 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:52.363+0000 7f7629967640 1 -- 172.21.15.19:0/955888135 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f762406be20 msgr2=0x7f7624102d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:37:52.368 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:52.363+0000 7f7629967640 1 --2- 172.21.15.19:0/955888135 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f762406be20 0x7f7624102d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:37:52.368 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:52.363+0000 7f7629967640 1 -- 172.21.15.19:0/955888135 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7624105b60 msgr2=0x7f76241015c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:37:52.368 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:52.363+0000 7f7629967640 1 --2- 172.21.15.19:0/955888135 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7624105b60 0x7f76241015c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:37:52.368 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:52.363+0000 7f7629967640 1 -- 172.21.15.19:0/955888135 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7624102370 con 0x7f76241086d0 2024-09-10T22:37:52.368 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:52.363+0000 7f7629967640 1 --2- 172.21.15.19:0/955888135 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f76241086d0 0x7f7624101b00 secure :-1 s=READY pgs=871 cs=0 l=1 rev1=1 crypto rx=0x7f7614031500 tx=0x7f76140042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:37:52.368 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:52.363+0000 7f76227fc640 1 -- 172.21.15.19:0/955888135 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f761403f030 con 0x7f76241086d0 2024-09-10T22:37:52.368 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:52.363+0000 7f76227fc640 1 -- 172.21.15.19:0/955888135 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7614003cb0 con 0x7f76241086d0 2024-09-10T22:37:52.368 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:52.363+0000 7f762b3ca640 1 -- 172.21.15.19:0/955888135 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f76241a2d40 con 0x7f76241086d0 2024-09-10T22:37:52.368 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:52.363+0000 7f76227fc640 1 -- 172.21.15.19:0/955888135 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7614035070 con 0x7f76241086d0 2024-09-10T22:37:52.368 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:52.363+0000 7f762b3ca640 1 -- 172.21.15.19:0/955888135 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f76241a31b0 con 0x7f76241086d0 2024-09-10T22:37:52.369 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:52.364+0000 7f762b3ca640 1 -- 172.21.15.19:0/955888135 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f76240fec80 con 0x7f76241086d0 2024-09-10T22:37:52.369 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:52.366+0000 7f76227fc640 1 -- 172.21.15.19:0/955888135 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 18) ==== 153250+0+0 (secure 0 0 0) 0x7f761403bc70 con 0x7f76241086d0 2024-09-10T22:37:52.369 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:52.366+0000 7f76227fc640 1 --2- 172.21.15.19:0/955888135 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f760c0b52e0 0x7f760c0b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:37:52.369 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:52.367+0000 7f7629166640 1 --2- 172.21.15.19:0/955888135 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f760c0b52e0 0x7f760c0b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:37:52.370 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:52.367+0000 7f76227fc640 1 -- 172.21.15.19:0/955888135 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8327+0+0 (secure 0 0 0) 0x7f7614106a30 con 0x7f76241086d0 2024-09-10T22:37:52.370 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:52.367+0000 7f7629166640 1 --2- 172.21.15.19:0/955888135 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f760c0b52e0 0x7f760c0b77a0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f761c009b60 tx=0x7f761c005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:37:52.372 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:52.369+0000 7f76227fc640 1 -- 172.21.15.19:0/955888135 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f76140cd890 con 0x7f76241086d0 2024-09-10T22:37:52.375 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:37:52 smithi138 ceph-mon[35236]: pgmap v690: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 47 MiB/s wr, 94 op/s 2024-09-10T22:37:52.557 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:52.555+0000 7f762b3ca640 1 -- 172.21.15.19:0/955888135 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f762402e7c0 con 0x7f76241086d0 2024-09-10T22:37:52.559 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:52.556+0000 7f76227fc640 1 -- 172.21.15.19:0/955888135 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v77) ==== 74+0+22854 (secure 0 0 0) 0x7f76140cd190 con 0x7f76241086d0 2024-09-10T22:37:52.559 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-10T22:37:52.559 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":77,"fsid":"22997a4c-6fc2-11ef-bcea-c7b262605968","created":"2024-09-10T22:16:16.754696+0000","modified":"2024-09-10T22:26:05.946930+0000","last_up_change":"2024-09-10T22:23:32.417392+0000","last_in_change":"2024-09-10T22:23:09.614371+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T22:19:50.731662+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-10T22:24:18.740121+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"73","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-10T22:24:20.795178+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"73","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"783d96cb-0a8a-47f3-8eab-77cd731a64bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6802","nonce":234761879},{"type":"v1","addr":"172.21.15.19:6803","nonce":234761879}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6804","nonce":234761879},{"type":"v1","addr":"172.21.15.19:6805","nonce":234761879}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6808","nonce":234761879},{"type":"v1","addr":"172.21.15.19:6809","nonce":234761879}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6806","nonce":234761879},{"type":"v1","addr":"172.21.15.19:6807","nonce":234761879}]},"public_addr":"172.21.15.19:6803/234761879","cluster_addr":"172.21.15.19:6805/234761879","heartbeat_back_addr":"172.21.15.19:6809/234761879","heartbeat_front_addr":"172.21.15.19:6807/234761879","state":["exists","up"]},{"osd":1,"uuid":"41043581-e0cf-43b5-bae0-0d95e2ef8156","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6800","nonce":1803526886},{"type":"v1","addr":"172.21.15.135:6801","nonce":1803526886}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6802","nonce":1803526886},{"type":"v1","addr":"172.21.15.135:6803","nonce":1803526886}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6806","nonce":1803526886},{"type":"v1","addr":"172.21.15.135:6807","nonce":1803526886}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6804","nonce":1803526886},{"type":"v1","addr":"172.21.15.135:6805","nonce":1803526886}]},"public_addr":"172.21.15.135:6801/1803526886","cluster_addr":"172.21.15.135:6803/1803526886","heartbeat_back_addr":"172.21.15.135:6807/1803526886","heartbeat_front_addr":"172.21.15.135:6805/1803526886","state":["exists","up"]},{"osd":2,"uuid":"a9b14a06-bbdc-4501-96e2-fb5f7127ca16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6800","nonce":2747418770},{"type":"v1","addr":"172.21.15.138:6801","nonce":2747418770}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6802","nonce":2747418770},{"type":"v1","addr":"172.21.15.138:6803","nonce":2747418770}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6806","nonce":2747418770},{"type":"v1","addr":"172.21.15.138:6807","nonce":2747418770}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6804","nonce":2747418770},{"type":"v1","addr":"172.21.15.138:6805","nonce":2747418770}]},"public_addr":"172.21.15.138:6801/2747418770","cluster_addr":"172.21.15.138:6803/2747418770","heartbeat_back_addr":"172.21.15.138:6807/2747418770","heartbeat_front_addr":"172.21.15.138:6805/2747418770","state":["exists","up"]},{"osd":3,"uuid":"a46268da-8666-4cfa-b11a-30eb12e271be","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":23,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6810","nonce":1889857224},{"type":"v1","addr":"172.21.15.19:6811","nonce":1889857224}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6812","nonce":1889857224},{"type":"v1","addr":"172.21.15.19:6813","nonce":1889857224}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6816","nonce":1889857224},{"type":"v1","addr":"172.21.15.19:6817","nonce":1889857224}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6814","nonce":1889857224},{"type":"v1","addr":"172.21.15.19:6815","nonce":1889857224}]},"public_addr":"172.21.15.19:6811/1889857224","cluster_addr":"172.21.15.19:6813/1889857224","heartbeat_back_addr":"172.21.15.19:6817/1889857224","heartbeat_front_addr":"172.21.15.19:6815/1889857224","state":["exists","up"]},{"osd":4,"uuid":"c58df06f-2de2-4655-88e7-ac6a3531839a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":29,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6808","nonce":436311825},{"type":"v1","addr":"172.21.15.135:6809","nonce":436311825}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6810","nonce":436311825},{"type":"v1","addr":"172.21.15.135:6811","nonce":436311825}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6814","nonce":436311825},{"type":"v1","addr":"172.21.15.135:6815","nonce":436311825}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6812","nonce":436311825},{"type":"v1","addr":"172.21.15.135:6813","nonce":436311825}]},"public_addr":"172.21.15.135:6809/436311825","cluster_addr":"172.21.15.135:6811/436311825","heartbeat_back_addr":"172.21.15.135:6815/436311825","heartbeat_front_addr":"172.21.15.135:6813/436311825","state":["exists","up"]},{"osd":5,"uuid":"c0900b0c-aef4-498d-a01b-a891bdb51122","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6808","nonce":1086764290},{"type":"v1","addr":"172.21.15.138:6809","nonce":1086764290}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6810","nonce":1086764290},{"type":"v1","addr":"172.21.15.138:6811","nonce":1086764290}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6814","nonce":1086764290},{"type":"v1","addr":"172.21.15.138:6815","nonce":1086764290}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6812","nonce":1086764290},{"type":"v1","addr":"172.21.15.138:6813","nonce":1086764290}]},"public_addr":"172.21.15.138:6809/1086764290","cluster_addr":"172.21.15.138:6811/1086764290","heartbeat_back_addr":"172.21.15.138:6815/1086764290","heartbeat_front_addr":"172.21.15.138:6813/1086764290","state":["exists","up"]},{"osd":6,"uuid":"f79cb310-8073-4ee5-80a6-87a290600321","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":40,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6818","nonce":406328354},{"type":"v1","addr":"172.21.15.19:6819","nonce":406328354}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6820","nonce":406328354},{"type":"v1","addr":"172.21.15.19:6821","nonce":406328354}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6824","nonce":406328354},{"type":"v1","addr":"172.21.15.19:6825","nonce":406328354}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6822","nonce":406328354},{"type":"v1","addr":"172.21.15.19:6823","nonce":406328354}]},"public_addr":"172.21.15.19:6819/406328354","cluster_addr":"172.21.15.19:6821/406328354","heartbeat_back_addr":"172.21.15.19:6825/406328354","heartbeat_front_addr":"172.21.15.19:6823/406328354","state":["exists","up"]},{"osd":7,"uuid":"cc76476a-92f3-489c-be9e-29cbbf39539e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6816","nonce":1096613674},{"type":"v1","addr":"172.21.15.135:6817","nonce":1096613674}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6818","nonce":1096613674},{"type":"v1","addr":"172.21.15.135:6819","nonce":1096613674}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6822","nonce":1096613674},{"type":"v1","addr":"172.21.15.135:6823","nonce":1096613674}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6820","nonce":1096613674},{"type":"v1","addr":"172.21.15.135:6821","nonce":1096613674}]},"public_addr":"172.21.15.135:6817/1096613674","cluster_addr":"172.21.15.135:6819/1096613674","heartbeat_back_addr":"172.21.15.135:6823/1096613674","heartbeat_front_addr":"172.21.15.135:6821/1096613674","state":["exists","up"]},{"osd":8,"uuid":"5323a006-a6e8-4403-9c51-65f46298d5c4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6816","nonce":3020394729},{"type":"v1","addr":"172.21.15.138:6817","nonce":3020394729}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6818","nonce":3020394729},{"type":"v1","addr":"172.21.15.138:6819","nonce":3020394729}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6822","nonce":3020394729},{"type":"v1","addr":"172.21.15.138:6823","nonce":3020394729}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6820","nonce":3020394729},{"type":"v1","addr":"172.21.15.138:6821","nonce":3020394729}]},"public_addr":"172.21.15.138:6817/3020394729","cluster_addr":"172.21.15.138:6819/3020394729","heartbeat_back_addr":"172.21.15.138:6823/3020394729","heartbeat_front_addr":"172.21.15.138:6821/3020394729","state":["exists","up"]},{"osd":9,"uuid":"b869ac42-c46e-442c-8b5b-f81c018e663c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":57,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6826","nonce":1488680899},{"type":"v1","addr":"172.21.15.19:6827","nonce":1488680899}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6828","nonce":1488680899},{"type":"v1","addr":"172.21.15.19:6829","nonce":1488680899}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6832","nonce":1488680899},{"type":"v1","addr":"172.21.15.19:6833","nonce":1488680899}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6830","nonce":1488680899},{"type":"v1","addr":"172.21.15.19:6831","nonce":1488680899}]},"public_addr":"172.21.15.19:6827/1488680899","cluster_addr":"172.21.15.19:6829/1488680899","heartbeat_back_addr":"172.21.15.19:6833/1488680899","heartbeat_front_addr":"172.21.15.19:6831/1488680899","state":["exists","up"]},{"osd":10,"uuid":"b8a2d69a-6821-4c69-b7eb-c0cfc8164614","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":62,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6824","nonce":3812626754},{"type":"v1","addr":"172.21.15.135:6825","nonce":3812626754}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6826","nonce":3812626754},{"type":"v1","addr":"172.21.15.135:6827","nonce":3812626754}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6830","nonce":3812626754},{"type":"v1","addr":"172.21.15.135:6831","nonce":3812626754}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6828","nonce":3812626754},{"type":"v1","addr":"172.21.15.135:6829","nonce":3812626754}]},"public_addr":"172.21.15.135:6825/3812626754","cluster_addr":"172.21.15.135:6827/3812626754","heartbeat_back_addr":"172.21.15.135:6831/3812626754","heartbeat_front_addr":"172.21.15.135:6829/3812626754","state":["exists","up"]},{"osd":11,"uuid":"a9264ab2-5843-44d2-aba8-1e12708e99d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6824","nonce":1098434807},{"type":"v1","addr":"172.21.15.138:6825","nonce":1098434807}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6826","nonce":1098434807},{"type":"v1","addr":"172.21.15.138:6827","nonce":1098434807}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6830","nonce":1098434807},{"type":"v1","addr":"172.21.15.138:6831","nonce":1098434807}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6828","nonce":1098434807},{"type":"v1","addr":"172.21.15.138:6829","nonce":1098434807}]},"public_addr":"172.21.15.138:6825/1098434807","cluster_addr":"172.21.15.138:6827/1098434807","heartbeat_back_addr":"172.21.15.138:6831/1098434807","heartbeat_front_addr":"172.21.15.138:6829/1098434807","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:18:58.008025+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:19:22.475890+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:19:47.124147+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:20:12.438853+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:20:37.195177+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:21:02.474248+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:21:27.087207+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:21:52.119211+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:22:16.569989+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:22:41.680986+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:23:06.391885+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:23:30.695460+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.0","mappings":[{"from":8,"to":4}]},{"pgid":"2.c","mappings":[{"from":2,"to":4}]},{"pgid":"2.d","mappings":[{"from":5,"to":11}]},{"pgid":"2.16","mappings":[{"from":2,"to":6}]},{"pgid":"2.17","mappings":[{"from":5,"to":1}]},{"pgid":"2.1a","mappings":[{"from":8,"to":1}]},{"pgid":"2.1d","mappings":[{"from":2,"to":4}]},{"pgid":"2.1f","mappings":[{"from":7,"to":11}]},{"pgid":"3.13","mappings":[{"from":4,"to":9}]},{"pgid":"3.1b","mappings":[{"from":4,"to":8}]},{"pgid":"3.21","mappings":[{"from":5,"to":9}]},{"pgid":"3.38","mappings":[{"from":3,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.19:0/2099468127":"2024-09-11T22:17:04.260826+0000","172.21.15.19:0/538724915":"2024-09-11T22:17:04.260826+0000","172.21.15.19:0/3504695777":"2024-09-11T22:17:04.260826+0000","172.21.15.19:0/1401613792":"2024-09-11T22:16:39.069638+0000","172.21.15.19:6801/3005924425":"2024-09-11T22:17:04.260826+0000","172.21.15.19:6800/3005924425":"2024-09-11T22:17:04.260826+0000","172.21.15.19:0/104917892":"2024-09-11T22:16:39.069638+0000","172.21.15.19:0/1778305990":"2024-09-11T22:16:39.069638+0000","172.21.15.19:6801/535670059":"2024-09-11T22:16:39.069638+0000","172.21.15.19:6800/535670059":"2024-09-11T22:16:39.069638+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T22:37:52.561 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:52.558+0000 7f762b3ca640 1 -- 172.21.15.19:0/955888135 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f760c0b52e0 msgr2=0x7f760c0b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:37:52.561 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:52.558+0000 7f762b3ca640 1 --2- 172.21.15.19:0/955888135 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f760c0b52e0 0x7f760c0b77a0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f761c009b60 tx=0x7f761c005f90 comp rx=0 tx=0).stop 2024-09-10T22:37:52.561 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:52.558+0000 7f762b3ca640 1 -- 172.21.15.19:0/955888135 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f76241086d0 msgr2=0x7f7624101b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:37:52.561 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:52.558+0000 7f762b3ca640 1 --2- 172.21.15.19:0/955888135 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f76241086d0 0x7f7624101b00 secure :-1 s=READY pgs=871 cs=0 l=1 rev1=1 crypto rx=0x7f7614031500 tx=0x7f76140042f0 comp rx=0 tx=0).stop 2024-09-10T22:37:52.561 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:52.558+0000 7f762b3ca640 1 -- 172.21.15.19:0/955888135 shutdown_connections 2024-09-10T22:37:52.561 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:52.558+0000 7f762b3ca640 1 --2- 172.21.15.19:0/955888135 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f760c0b52e0 0x7f760c0b77a0 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:37:52.561 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:52.558+0000 7f762b3ca640 1 --2- 172.21.15.19:0/955888135 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f76241086d0 0x7f7624101b00 unknown :-1 s=CLOSED pgs=871 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:37:52.561 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:52.558+0000 7f762b3ca640 1 --2- 172.21.15.19:0/955888135 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7624105b60 0x7f76241015c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:37:52.561 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:52.558+0000 7f762b3ca640 1 --2- 172.21.15.19:0/955888135 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f762406be20 0x7f7624102d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:37:52.562 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:52.558+0000 7f762b3ca640 1 -- 172.21.15.19:0/955888135 >> 172.21.15.19:0/955888135 conn(0x7f76240fd190 msgr2=0x7f7624103e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:37:52.562 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:52.558+0000 7f762b3ca640 1 -- 172.21.15.19:0/955888135 shutdown_connections 2024-09-10T22:37:52.562 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:52.558+0000 7f762b3ca640 1 -- 172.21.15.19:0/955888135 wait complete. 2024-09-10T22:37:52.573 INFO:tasks.check_counter.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-10T22:19:50.731662+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-10T22:24:18.740121+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '73', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-09-10T22:24:20.795178+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '73', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-10T22:37:52.573 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-10T22:37:52.683 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:52.678+0000 7ff93202a640 1 -- 172.21.15.19:0/769866360 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff92c1086a0 msgr2=0x7ff92c10ab60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:37:52.683 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:52.678+0000 7ff93202a640 1 --2- 172.21.15.19:0/769866360 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff92c1086a0 0x7ff92c10ab60 secure :-1 s=READY pgs=872 cs=0 l=1 rev1=1 crypto rx=0x7ff924009ca0 tx=0x7ff92402a8c0 comp rx=0 tx=0).stop 2024-09-10T22:37:52.683 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:52.678+0000 7ff93202a640 1 -- 172.21.15.19:0/769866360 shutdown_connections 2024-09-10T22:37:52.683 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:52.678+0000 7ff93202a640 1 --2- 172.21.15.19:0/769866360 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff92c1086a0 0x7ff92c10ab60 unknown :-1 s=CLOSED pgs=872 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:37:52.683 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:52.678+0000 7ff93202a640 1 --2- 172.21.15.19:0/769866360 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff92c105af0 0x7ff92c107f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:37:52.684 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:52.678+0000 7ff93202a640 1 --2- 172.21.15.19:0/769866360 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff92c06bea0 0x7ff92c105560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:37:52.684 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:52.678+0000 7ff93202a640 1 -- 172.21.15.19:0/769866360 >> 172.21.15.19:0/769866360 conn(0x7ff92c0fd150 msgr2=0x7ff92c0ff570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:37:52.684 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:52.678+0000 7ff93202a640 1 -- 172.21.15.19:0/769866360 shutdown_connections 2024-09-10T22:37:52.684 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:52.678+0000 7ff93202a640 1 -- 172.21.15.19:0/769866360 wait complete. 2024-09-10T22:37:52.684 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:52.679+0000 7ff93202a640 1 Processor -- start 2024-09-10T22:37:52.684 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:52.679+0000 7ff93202a640 1 -- start start 2024-09-10T22:37:52.684 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:52.679+0000 7ff93202a640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff92c06bea0 0x7ff92c198dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:37:52.684 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:52.679+0000 7ff93202a640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff92c105af0 0x7ff92c199420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:37:52.684 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:52.679+0000 7ff93202a640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff92c1086a0 0x7ff92c199fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:37:52.684 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:52.679+0000 7ff93202a640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7ff92c10e5f0 con 0x7ff92c1086a0 2024-09-10T22:37:52.684 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:52.679+0000 7ff93202a640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7ff92c10e470 con 0x7ff92c105af0 2024-09-10T22:37:52.684 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:52.679+0000 7ff93202a640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7ff92c10e770 con 0x7ff92c06bea0 2024-09-10T22:37:52.685 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:52.679+0000 7ff92bfff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff92c1086a0 0x7ff92c199fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:37:52.685 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:52.679+0000 7ff92bfff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff92c1086a0 0x7ff92c199fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:59674/0 (socket says 172.21.15.19:59674) 2024-09-10T22:37:52.685 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:52.679+0000 7ff92bfff640 1 -- 172.21.15.19:0/748514417 learned_addr learned my addr 172.21.15.19:0/748514417 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:37:52.685 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:52.679+0000 7ff923fff640 1 --2- 172.21.15.19:0/748514417 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff92c105af0 0x7ff92c199420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:37:52.685 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:52.680+0000 7ff92b7fe640 1 --2- 172.21.15.19:0/748514417 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff92c06bea0 0x7ff92c198dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:37:52.685 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:52.680+0000 7ff92bfff640 1 -- 172.21.15.19:0/748514417 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff92c06bea0 msgr2=0x7ff92c198dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:37:52.685 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:52.680+0000 7ff92bfff640 1 --2- 172.21.15.19:0/748514417 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff92c06bea0 0x7ff92c198dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:37:52.685 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:52.680+0000 7ff92bfff640 1 -- 172.21.15.19:0/748514417 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff92c105af0 msgr2=0x7ff92c199420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:37:52.685 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:52.680+0000 7ff92bfff640 1 --2- 172.21.15.19:0/748514417 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff92c105af0 0x7ff92c199420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:37:52.685 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:52.680+0000 7ff92bfff640 1 -- 172.21.15.19:0/748514417 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff92c19a8a0 con 0x7ff92c1086a0 2024-09-10T22:37:52.685 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:52.680+0000 7ff92bfff640 1 --2- 172.21.15.19:0/748514417 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff92c1086a0 0x7ff92c199fe0 secure :-1 s=READY pgs=873 cs=0 l=1 rev1=1 crypto rx=0x7ff924005e30 tx=0x7ff92402f400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:37:52.685 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:52.680+0000 7ff9297fa640 1 -- 172.21.15.19:0/748514417 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff924003c70 con 0x7ff92c1086a0 2024-09-10T22:37:52.685 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:52.680+0000 7ff93202a640 1 -- 172.21.15.19:0/748514417 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff92c19ab30 con 0x7ff92c1086a0 2024-09-10T22:37:52.686 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:52.680+0000 7ff9297fa640 1 -- 172.21.15.19:0/748514417 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff924003e10 con 0x7ff92c1086a0 2024-09-10T22:37:52.686 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:52.680+0000 7ff9297fa640 1 -- 172.21.15.19:0/748514417 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff92402fc00 con 0x7ff92c1086a0 2024-09-10T22:37:52.686 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:52.680+0000 7ff93202a640 1 -- 172.21.15.19:0/748514417 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff92c1a1260 con 0x7ff92c1086a0 2024-09-10T22:37:52.686 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:52.681+0000 7ff93202a640 1 -- 172.21.15.19:0/748514417 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff92c0fec40 con 0x7ff92c1086a0 2024-09-10T22:37:52.687 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:52.683+0000 7ff9297fa640 1 -- 172.21.15.19:0/748514417 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 18) ==== 153250+0+0 (secure 0 0 0) 0x7ff924004040 con 0x7ff92c1086a0 2024-09-10T22:37:52.687 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:52.683+0000 7ff9297fa640 1 --2- 172.21.15.19:0/748514417 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7ff9180b52e0 0x7ff9180b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:37:52.687 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:52.683+0000 7ff9297fa640 1 -- 172.21.15.19:0/748514417 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8327+0+0 (secure 0 0 0) 0x7ff924107170 con 0x7ff92c1086a0 2024-09-10T22:37:52.687 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:52.683+0000 7ff92b7fe640 1 --2- 172.21.15.19:0/748514417 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7ff9180b52e0 0x7ff9180b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:37:52.687 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:52.684+0000 7ff92b7fe640 1 --2- 172.21.15.19:0/748514417 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7ff9180b52e0 0x7ff9180b77a0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7ff91c005fd0 tx=0x7ff91c005e20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:37:52.689 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:52.686+0000 7ff9297fa640 1 -- 172.21.15.19:0/748514417 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7ff9240cdfd0 con 0x7ff92c1086a0 2024-09-10T22:37:52.873 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:52.870+0000 7ff93202a640 1 -- 172.21.15.19:0/748514417 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7ff92c02e5c0 con 0x7ff92c1086a0 2024-09-10T22:37:52.873 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:52.871+0000 7ff9297fa640 1 -- 172.21.15.19:0/748514417 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v77) ==== 93+0+10 (secure 0 0 0) 0x7ff9240098b0 con 0x7ff92c1086a0 2024-09-10T22:37:52.874 INFO:teuthology.orchestra.run.smithi019.stdout:pg_num: 1 2024-09-10T22:37:52.876 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:52.873+0000 7ff93202a640 1 -- 172.21.15.19:0/748514417 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7ff9180b52e0 msgr2=0x7ff9180b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:37:52.876 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:52.873+0000 7ff93202a640 1 --2- 172.21.15.19:0/748514417 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7ff9180b52e0 0x7ff9180b77a0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7ff91c005fd0 tx=0x7ff91c005e20 comp rx=0 tx=0).stop 2024-09-10T22:37:52.876 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:52.873+0000 7ff93202a640 1 -- 172.21.15.19:0/748514417 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff92c1086a0 msgr2=0x7ff92c199fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:37:52.876 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:52.873+0000 7ff93202a640 1 --2- 172.21.15.19:0/748514417 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff92c1086a0 0x7ff92c199fe0 secure :-1 s=READY pgs=873 cs=0 l=1 rev1=1 crypto rx=0x7ff924005e30 tx=0x7ff92402f400 comp rx=0 tx=0).stop 2024-09-10T22:37:52.876 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:52.873+0000 7ff93202a640 1 -- 172.21.15.19:0/748514417 shutdown_connections 2024-09-10T22:37:52.876 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:52.873+0000 7ff93202a640 1 --2- 172.21.15.19:0/748514417 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7ff9180b52e0 0x7ff9180b77a0 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:37:52.876 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:52.873+0000 7ff93202a640 1 --2- 172.21.15.19:0/748514417 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff92c1086a0 0x7ff92c199fe0 unknown :-1 s=CLOSED pgs=873 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:37:52.876 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:52.873+0000 7ff93202a640 1 --2- 172.21.15.19:0/748514417 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff92c105af0 0x7ff92c199420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:37:52.877 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:52.873+0000 7ff93202a640 1 --2- 172.21.15.19:0/748514417 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff92c06bea0 0x7ff92c198dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:37:52.877 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:52.873+0000 7ff93202a640 1 -- 172.21.15.19:0/748514417 >> 172.21.15.19:0/748514417 conn(0x7ff92c0fd150 msgr2=0x7ff92c103eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:37:52.877 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:52.873+0000 7ff93202a640 1 -- 172.21.15.19:0/748514417 shutdown_connections 2024-09-10T22:37:52.877 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:52.873+0000 7ff93202a640 1 -- 172.21.15.19:0/748514417 wait complete. 2024-09-10T22:37:52.887 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-10T22:37:52.997 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:52.992+0000 7fb8225ad640 1 -- 172.21.15.19:0/4231092431 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb81c1029b0 msgr2=0x7fb81c102e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:37:52.997 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:52.992+0000 7fb8225ad640 1 --2- 172.21.15.19:0/4231092431 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb81c1029b0 0x7fb81c102e30 secure :-1 s=READY pgs=874 cs=0 l=1 rev1=1 crypto rx=0x7fb810009930 tx=0x7fb81002a420 comp rx=0 tx=0).stop 2024-09-10T22:37:52.997 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:52.992+0000 7fb8225ad640 1 -- 172.21.15.19:0/4231092431 shutdown_connections 2024-09-10T22:37:52.997 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:52.992+0000 7fb8225ad640 1 --2- 172.21.15.19:0/4231092431 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb81c103370 0x7fb81c109cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:37:52.997 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:52.992+0000 7fb8225ad640 1 --2- 172.21.15.19:0/4231092431 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb81c1029b0 0x7fb81c102e30 unknown :-1 s=CLOSED pgs=874 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:37:52.997 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:52.992+0000 7fb8225ad640 1 --2- 172.21.15.19:0/4231092431 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb81c101860 0x7fb81c101c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:37:52.998 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:52.992+0000 7fb8225ad640 1 -- 172.21.15.19:0/4231092431 >> 172.21.15.19:0/4231092431 conn(0x7fb81c0fd140 msgr2=0x7fb81c0ff560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:37:52.998 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:52.992+0000 7fb8225ad640 1 -- 172.21.15.19:0/4231092431 shutdown_connections 2024-09-10T22:37:52.998 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:52.992+0000 7fb8225ad640 1 -- 172.21.15.19:0/4231092431 wait complete. 2024-09-10T22:37:52.998 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:52.992+0000 7fb8225ad640 1 Processor -- start 2024-09-10T22:37:52.998 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:52.992+0000 7fb8225ad640 1 -- start start 2024-09-10T22:37:52.998 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:52.993+0000 7fb8225ad640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb81c101860 0x7fb81c198da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:37:52.998 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:52.993+0000 7fb8225ad640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb81c1029b0 0x7fb81c1993f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:37:52.998 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:52.993+0000 7fb8225ad640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb81c103370 0x7fb81c19a020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:37:52.998 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:52.993+0000 7fb8225ad640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fb81c10e600 con 0x7fb81c101860 2024-09-10T22:37:52.998 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:52.993+0000 7fb8225ad640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fb81c10e480 con 0x7fb81c103370 2024-09-10T22:37:52.998 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:52.993+0000 7fb8225ad640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7fb81c10e780 con 0x7fb81c1029b0 2024-09-10T22:37:52.998 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:52.993+0000 7fb81bfff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb81c101860 0x7fb81c198da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:37:52.998 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:52.993+0000 7fb81bfff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb81c101860 0x7fb81c198da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:59698/0 (socket says 172.21.15.19:59698) 2024-09-10T22:37:52.998 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:52.993+0000 7fb81bfff640 1 -- 172.21.15.19:0/539153365 learned_addr learned my addr 172.21.15.19:0/539153365 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:37:52.999 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:52.993+0000 7fb81b7fe640 1 --2- 172.21.15.19:0/539153365 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb81c1029b0 0x7fb81c1993f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:37:52.999 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:52.993+0000 7fb820b4a640 1 --2- 172.21.15.19:0/539153365 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb81c103370 0x7fb81c19a020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:37:52.999 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:52.993+0000 7fb81bfff640 1 -- 172.21.15.19:0/539153365 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb81c1029b0 msgr2=0x7fb81c1993f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:37:52.999 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:52.993+0000 7fb81bfff640 1 --2- 172.21.15.19:0/539153365 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb81c1029b0 0x7fb81c1993f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:37:52.999 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:52.993+0000 7fb81bfff640 1 -- 172.21.15.19:0/539153365 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb81c103370 msgr2=0x7fb81c19a020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:37:52.999 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:52.993+0000 7fb81bfff640 1 --2- 172.21.15.19:0/539153365 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb81c103370 0x7fb81c19a020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:37:52.999 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:52.993+0000 7fb81bfff640 1 -- 172.21.15.19:0/539153365 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb81c19a8e0 con 0x7fb81c101860 2024-09-10T22:37:52.999 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:52.993+0000 7fb820b4a640 1 --2- 172.21.15.19:0/539153365 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb81c103370 0x7fb81c19a020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T22:37:52.999 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:52.993+0000 7fb81bfff640 1 --2- 172.21.15.19:0/539153365 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb81c101860 0x7fb81c198da0 secure :-1 s=READY pgs=875 cs=0 l=1 rev1=1 crypto rx=0x7fb80c00d770 tx=0x7fb80c00dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:37:52.999 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:52.993+0000 7fb8197fa640 1 -- 172.21.15.19:0/539153365 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb80c017070 con 0x7fb81c101860 2024-09-10T22:37:52.999 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:52.993+0000 7fb8197fa640 1 -- 172.21.15.19:0/539153365 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb80c0054d0 con 0x7fb81c101860 2024-09-10T22:37:52.999 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:52.993+0000 7fb8225ad640 1 -- 172.21.15.19:0/539153365 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb81c19abd0 con 0x7fb81c101860 2024-09-10T22:37:52.999 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:52.993+0000 7fb8197fa640 1 -- 172.21.15.19:0/539153365 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb80c004c30 con 0x7fb81c101860 2024-09-10T22:37:52.999 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:52.994+0000 7fb8225ad640 1 -- 172.21.15.19:0/539153365 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb81c1a12a0 con 0x7fb81c101860 2024-09-10T22:37:53.000 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:52.994+0000 7fb8225ad640 1 -- 172.21.15.19:0/539153365 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb81c108bd0 con 0x7fb81c101860 2024-09-10T22:37:53.000 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:52.997+0000 7fb8197fa640 1 -- 172.21.15.19:0/539153365 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 18) ==== 153250+0+0 (secure 0 0 0) 0x7fb80c004dd0 con 0x7fb81c101860 2024-09-10T22:37:53.000 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:52.997+0000 7fb8197fa640 1 --2- 172.21.15.19:0/539153365 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7fb8040b52e0 0x7fb8040b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:37:53.000 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:52.998+0000 7fb81b7fe640 1 --2- 172.21.15.19:0/539153365 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7fb8040b52e0 0x7fb8040b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:37:53.001 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:52.998+0000 7fb8197fa640 1 -- 172.21.15.19:0/539153365 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8327+0+0 (secure 0 0 0) 0x7fb80c0e5bc0 con 0x7fb81c101860 2024-09-10T22:37:53.001 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:52.998+0000 7fb81b7fe640 1 --2- 172.21.15.19:0/539153365 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7fb8040b52e0 0x7fb8040b77a0 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7fb810000c00 tx=0x7fb8100314a0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:37:53.002 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:53.000+0000 7fb8197fa640 1 -- 172.21.15.19:0/539153365 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7fb80c0aca20 con 0x7fb81c101860 2024-09-10T22:37:53.189 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:53.186+0000 7fb8225ad640 1 -- 172.21.15.19:0/539153365 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7fb81c063d50 con 0x7fb81c101860 2024-09-10T22:37:53.189 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:53.187+0000 7fb8197fa640 1 -- 172.21.15.19:0/539153365 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v77) ==== 104+0+11 (secure 0 0 0) 0x7fb80c0ac320 con 0x7fb81c101860 2024-09-10T22:37:53.190 INFO:teuthology.orchestra.run.smithi019.stdout:pg_num: 32 2024-09-10T22:37:53.192 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:53.189+0000 7fb8225ad640 1 -- 172.21.15.19:0/539153365 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7fb8040b52e0 msgr2=0x7fb8040b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:37:53.192 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:53.189+0000 7fb8225ad640 1 --2- 172.21.15.19:0/539153365 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7fb8040b52e0 0x7fb8040b77a0 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7fb810000c00 tx=0x7fb8100314a0 comp rx=0 tx=0).stop 2024-09-10T22:37:53.192 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:53.189+0000 7fb8225ad640 1 -- 172.21.15.19:0/539153365 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb81c101860 msgr2=0x7fb81c198da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:37:53.192 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:53.189+0000 7fb8225ad640 1 --2- 172.21.15.19:0/539153365 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb81c101860 0x7fb81c198da0 secure :-1 s=READY pgs=875 cs=0 l=1 rev1=1 crypto rx=0x7fb80c00d770 tx=0x7fb80c00dc30 comp rx=0 tx=0).stop 2024-09-10T22:37:53.192 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:53.189+0000 7fb8225ad640 1 -- 172.21.15.19:0/539153365 shutdown_connections 2024-09-10T22:37:53.193 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:53.189+0000 7fb8225ad640 1 --2- 172.21.15.19:0/539153365 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7fb8040b52e0 0x7fb8040b77a0 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:37:53.193 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:53.189+0000 7fb8225ad640 1 --2- 172.21.15.19:0/539153365 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb81c103370 0x7fb81c19a020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:37:53.193 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:53.189+0000 7fb8225ad640 1 --2- 172.21.15.19:0/539153365 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb81c1029b0 0x7fb81c1993f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:37:53.193 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:53.189+0000 7fb8225ad640 1 --2- 172.21.15.19:0/539153365 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb81c101860 0x7fb81c198da0 unknown :-1 s=CLOSED pgs=875 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:37:53.193 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:53.189+0000 7fb8225ad640 1 -- 172.21.15.19:0/539153365 >> 172.21.15.19:0/539153365 conn(0x7fb81c0fd140 msgr2=0x7fb81c105da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:37:53.193 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:53.190+0000 7fb8225ad640 1 -- 172.21.15.19:0/539153365 shutdown_connections 2024-09-10T22:37:53.193 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:53.190+0000 7fb8225ad640 1 -- 172.21.15.19:0/539153365 wait complete. 2024-09-10T22:37:53.202 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:37:53 smithi019 ceph-mon[31375]: from='client.? 172.21.15.19:0/955888135' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-10T22:37:53.202 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:37:53 smithi019 ceph-mon[31375]: from='client.? 172.21.15.19:0/748514417' entity='client.admin' cmd={"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} : dispatch 2024-09-10T22:37:53.203 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-10T22:37:53.312 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:53.307+0000 7fd907047640 1 -- 172.21.15.19:0/1437121423 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd90006be00 msgr2=0x7fd900105600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:37:53.312 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:53.307+0000 7fd907047640 1 --2- 172.21.15.19:0/1437121423 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd90006be00 0x7fd900105600 secure :-1 s=READY pgs=876 cs=0 l=1 rev1=1 crypto rx=0x7fd8f4009900 tx=0x7fd8f402a410 comp rx=0 tx=0).stop 2024-09-10T22:37:53.312 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:53.307+0000 7fd907047640 1 -- 172.21.15.19:0/1437121423 shutdown_connections 2024-09-10T22:37:53.312 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:53.307+0000 7fd907047640 1 --2- 172.21.15.19:0/1437121423 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd9001086b0 0x7fd90010ab70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:37:53.313 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:53.307+0000 7fd907047640 1 --2- 172.21.15.19:0/1437121423 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd900105b40 0x7fd900107f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:37:53.313 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:53.307+0000 7fd907047640 1 --2- 172.21.15.19:0/1437121423 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd90006be00 0x7fd900105600 unknown :-1 s=CLOSED pgs=876 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:37:53.313 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:53.307+0000 7fd907047640 1 -- 172.21.15.19:0/1437121423 >> 172.21.15.19:0/1437121423 conn(0x7fd9000fd150 msgr2=0x7fd9000ff570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:37:53.313 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:53.307+0000 7fd907047640 1 -- 172.21.15.19:0/1437121423 shutdown_connections 2024-09-10T22:37:53.313 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:53.307+0000 7fd907047640 1 -- 172.21.15.19:0/1437121423 wait complete. 2024-09-10T22:37:53.313 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:53.308+0000 7fd907047640 1 Processor -- start 2024-09-10T22:37:53.313 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:53.308+0000 7fd907047640 1 -- start start 2024-09-10T22:37:53.313 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:53.308+0000 7fd907047640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd90006be00 0x7fd900198e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:37:53.313 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:53.308+0000 7fd907047640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd900105b40 0x7fd900199470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:37:53.313 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:53.308+0000 7fd907047640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd9001086b0 0x7fd90019a0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:37:53.313 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:53.308+0000 7fd907047640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fd90010e690 con 0x7fd9001086b0 2024-09-10T22:37:53.313 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:53.308+0000 7fd907047640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fd90010e510 con 0x7fd900105b40 2024-09-10T22:37:53.314 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:53.308+0000 7fd907047640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7fd90010e810 con 0x7fd90006be00 2024-09-10T22:37:53.314 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:53.308+0000 7fd9055e4640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd9001086b0 0x7fd90019a0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:37:53.314 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:53.308+0000 7fd9055e4640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd9001086b0 0x7fd90019a0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:59716/0 (socket says 172.21.15.19:59716) 2024-09-10T22:37:53.314 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:53.308+0000 7fd9055e4640 1 -- 172.21.15.19:0/3275384586 learned_addr learned my addr 172.21.15.19:0/3275384586 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:37:53.314 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:53.308+0000 7fd904de3640 1 --2- 172.21.15.19:0/3275384586 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd90006be00 0x7fd900198e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:37:53.314 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:53.309+0000 7fd8fffff640 1 --2- 172.21.15.19:0/3275384586 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd900105b40 0x7fd900199470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:37:53.314 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:53.309+0000 7fd9055e4640 1 -- 172.21.15.19:0/3275384586 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd90006be00 msgr2=0x7fd900198e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:37:53.314 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:53.309+0000 7fd9055e4640 1 --2- 172.21.15.19:0/3275384586 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd90006be00 0x7fd900198e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:37:53.314 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:53.309+0000 7fd9055e4640 1 -- 172.21.15.19:0/3275384586 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd900105b40 msgr2=0x7fd900199470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:37:53.314 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:53.309+0000 7fd9055e4640 1 --2- 172.21.15.19:0/3275384586 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd900105b40 0x7fd900199470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:37:53.314 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:53.309+0000 7fd9055e4640 1 -- 172.21.15.19:0/3275384586 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd90019a960 con 0x7fd9001086b0 2024-09-10T22:37:53.314 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:53.309+0000 7fd9055e4640 1 --2- 172.21.15.19:0/3275384586 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd9001086b0 0x7fd90019a0a0 secure :-1 s=READY pgs=877 cs=0 l=1 rev1=1 crypto rx=0x7fd8f800b970 tx=0x7fd8f800be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:37:53.314 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:53.309+0000 7fd8fdffb640 1 -- 172.21.15.19:0/3275384586 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8f8019070 con 0x7fd9001086b0 2024-09-10T22:37:53.315 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:53.309+0000 7fd8fdffb640 1 -- 172.21.15.19:0/3275384586 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd8f8014440 con 0x7fd9001086b0 2024-09-10T22:37:53.315 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:53.309+0000 7fd907047640 1 -- 172.21.15.19:0/3275384586 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd90019ac50 con 0x7fd9001086b0 2024-09-10T22:37:53.315 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:53.309+0000 7fd8fdffb640 1 -- 172.21.15.19:0/3275384586 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8f80075d0 con 0x7fd9001086b0 2024-09-10T22:37:53.315 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:53.309+0000 7fd907047640 1 -- 172.21.15.19:0/3275384586 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd9001a1320 con 0x7fd9001086b0 2024-09-10T22:37:53.315 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:53.310+0000 7fd907047640 1 -- 172.21.15.19:0/3275384586 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd9000fec40 con 0x7fd9001086b0 2024-09-10T22:37:53.315 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:53.313+0000 7fd8fdffb640 1 -- 172.21.15.19:0/3275384586 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 18) ==== 153250+0+0 (secure 0 0 0) 0x7fd8f800cb40 con 0x7fd9001086b0 2024-09-10T22:37:53.316 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:53.313+0000 7fd8fdffb640 1 --2- 172.21.15.19:0/3275384586 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7fd8f00b52e0 0x7fd8f00b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:37:53.316 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:53.313+0000 7fd8fdffb640 1 -- 172.21.15.19:0/3275384586 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8327+0+0 (secure 0 0 0) 0x7fd8f80e58f0 con 0x7fd9001086b0 2024-09-10T22:37:53.316 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:53.313+0000 7fd904de3640 1 --2- 172.21.15.19:0/3275384586 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7fd8f00b52e0 0x7fd8f00b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:37:53.316 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:53.314+0000 7fd904de3640 1 --2- 172.21.15.19:0/3275384586 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7fd8f00b52e0 0x7fd8f00b77a0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7fd8f4000c00 tx=0x7fd8f40314a0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:37:53.319 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:53.316+0000 7fd8fdffb640 1 -- 172.21.15.19:0/3275384586 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7fd8f80ac750 con 0x7fd9001086b0 2024-09-10T22:37:53.360 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:37:53 smithi135 ceph-mon[34789]: from='client.? 172.21.15.19:0/955888135' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-10T22:37:53.360 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:37:53 smithi135 ceph-mon[34789]: from='client.? 172.21.15.19:0/748514417' entity='client.admin' cmd={"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} : dispatch 2024-09-10T22:37:53.375 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:37:53 smithi138 ceph-mon[35236]: from='client.? 172.21.15.19:0/955888135' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-10T22:37:53.375 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:37:53 smithi138 ceph-mon[35236]: from='client.? 172.21.15.19:0/748514417' entity='client.admin' cmd={"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} : dispatch 2024-09-10T22:37:53.505 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:53.503+0000 7fd907047640 1 -- 172.21.15.19:0/3275384586 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7fd90002e850 con 0x7fd9001086b0 2024-09-10T22:37:53.506 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:53.503+0000 7fd8fdffb640 1 -- 172.21.15.19:0/3275384586 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v77) ==== 100+0+11 (secure 0 0 0) 0x7fd8f80ac050 con 0x7fd9001086b0 2024-09-10T22:37:53.506 INFO:teuthology.orchestra.run.smithi019.stdout:pg_num: 64 2024-09-10T22:37:53.508 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:53.505+0000 7fd907047640 1 -- 172.21.15.19:0/3275384586 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7fd8f00b52e0 msgr2=0x7fd8f00b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:37:53.508 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:53.505+0000 7fd907047640 1 --2- 172.21.15.19:0/3275384586 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7fd8f00b52e0 0x7fd8f00b77a0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7fd8f4000c00 tx=0x7fd8f40314a0 comp rx=0 tx=0).stop 2024-09-10T22:37:53.508 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:53.505+0000 7fd907047640 1 -- 172.21.15.19:0/3275384586 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd9001086b0 msgr2=0x7fd90019a0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:37:53.508 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:53.505+0000 7fd907047640 1 --2- 172.21.15.19:0/3275384586 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd9001086b0 0x7fd90019a0a0 secure :-1 s=READY pgs=877 cs=0 l=1 rev1=1 crypto rx=0x7fd8f800b970 tx=0x7fd8f800be30 comp rx=0 tx=0).stop 2024-09-10T22:37:53.508 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:53.505+0000 7fd907047640 1 -- 172.21.15.19:0/3275384586 shutdown_connections 2024-09-10T22:37:53.508 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:53.505+0000 7fd907047640 1 --2- 172.21.15.19:0/3275384586 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7fd8f00b52e0 0x7fd8f00b77a0 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:37:53.508 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:53.505+0000 7fd907047640 1 --2- 172.21.15.19:0/3275384586 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd9001086b0 0x7fd90019a0a0 unknown :-1 s=CLOSED pgs=877 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:37:53.509 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:53.505+0000 7fd907047640 1 --2- 172.21.15.19:0/3275384586 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd900105b40 0x7fd900199470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:37:53.509 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:53.505+0000 7fd907047640 1 --2- 172.21.15.19:0/3275384586 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd90006be00 0x7fd900198e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:37:53.509 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:53.505+0000 7fd907047640 1 -- 172.21.15.19:0/3275384586 >> 172.21.15.19:0/3275384586 conn(0x7fd9000fd150 msgr2=0x7fd900103eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:37:53.509 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:53.505+0000 7fd907047640 1 -- 172.21.15.19:0/3275384586 shutdown_connections 2024-09-10T22:37:53.509 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:53.505+0000 7fd907047640 1 -- 172.21.15.19:0/3275384586 wait complete. 2024-09-10T22:37:53.519 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json-pretty 2024-09-10T22:37:53.626 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:53.621+0000 7fee5dff3640 1 -- 172.21.15.19:0/3631827713 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fee58105b20 msgr2=0x7fee58107f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:37:53.626 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:53.621+0000 7fee5dff3640 1 --2- 172.21.15.19:0/3631827713 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fee58105b20 0x7fee58107f90 secure :-1 s=READY pgs=878 cs=0 l=1 rev1=1 crypto rx=0x7fee4c009900 tx=0x7fee4c02a410 comp rx=0 tx=0).stop 2024-09-10T22:37:53.626 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:53.621+0000 7fee5dff3640 1 -- 172.21.15.19:0/3631827713 shutdown_connections 2024-09-10T22:37:53.626 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:53.621+0000 7fee5dff3640 1 --2- 172.21.15.19:0/3631827713 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fee581086d0 0x7fee5810ab90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:37:53.626 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:53.621+0000 7fee5dff3640 1 --2- 172.21.15.19:0/3631827713 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fee58105b20 0x7fee58107f90 unknown :-1 s=CLOSED pgs=878 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:37:53.626 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:53.621+0000 7fee5dff3640 1 --2- 172.21.15.19:0/3631827713 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fee5806be60 0x7fee581055e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:37:53.626 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:53.621+0000 7fee5dff3640 1 -- 172.21.15.19:0/3631827713 >> 172.21.15.19:0/3631827713 conn(0x7fee580fd190 msgr2=0x7fee580ff5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:37:53.626 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:53.621+0000 7fee5dff3640 1 -- 172.21.15.19:0/3631827713 shutdown_connections 2024-09-10T22:37:53.626 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:53.621+0000 7fee5dff3640 1 -- 172.21.15.19:0/3631827713 wait complete. 2024-09-10T22:37:53.626 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:53.621+0000 7fee5dff3640 1 Processor -- start 2024-09-10T22:37:53.626 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:53.621+0000 7fee5dff3640 1 -- start start 2024-09-10T22:37:53.627 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:53.622+0000 7fee5dff3640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fee5806be60 0x7fee58198d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:37:53.627 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:53.622+0000 7fee5dff3640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fee58105b20 0x7fee581993d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:37:53.627 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:53.622+0000 7fee5dff3640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fee581086d0 0x7fee5819a000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:37:53.627 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:53.622+0000 7fee5dff3640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fee5810e600 con 0x7fee58105b20 2024-09-10T22:37:53.627 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:53.622+0000 7fee5dff3640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fee5810e480 con 0x7fee5806be60 2024-09-10T22:37:53.627 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:53.622+0000 7fee5dff3640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7fee5810e780 con 0x7fee581086d0 2024-09-10T22:37:53.627 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:53.622+0000 7fee56ffd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fee58105b20 0x7fee581993d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:37:53.627 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:53.622+0000 7fee56ffd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fee58105b20 0x7fee581993d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:49572/0 (socket says 172.21.15.19:49572) 2024-09-10T22:37:53.627 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:53.622+0000 7fee56ffd640 1 -- 172.21.15.19:0/2086064970 learned_addr learned my addr 172.21.15.19:0/2086064970 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:37:53.627 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:53.622+0000 7fee577fe640 1 --2- 172.21.15.19:0/2086064970 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fee5806be60 0x7fee58198d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:37:53.627 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:53.622+0000 7fee57fff640 1 --2- 172.21.15.19:0/2086064970 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fee581086d0 0x7fee5819a000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:37:53.627 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:53.622+0000 7fee56ffd640 1 -- 172.21.15.19:0/2086064970 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fee581086d0 msgr2=0x7fee5819a000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:37:53.628 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:53.622+0000 7fee56ffd640 1 --2- 172.21.15.19:0/2086064970 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fee581086d0 0x7fee5819a000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:37:53.628 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:53.622+0000 7fee56ffd640 1 -- 172.21.15.19:0/2086064970 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fee5806be60 msgr2=0x7fee58198d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:37:53.628 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:53.622+0000 7fee56ffd640 1 --2- 172.21.15.19:0/2086064970 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fee5806be60 0x7fee58198d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:37:53.628 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:53.622+0000 7fee56ffd640 1 -- 172.21.15.19:0/2086064970 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fee5819a8c0 con 0x7fee58105b20 2024-09-10T22:37:53.628 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:53.622+0000 7fee57fff640 1 --2- 172.21.15.19:0/2086064970 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fee581086d0 0x7fee5819a000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T22:37:53.628 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:53.622+0000 7fee577fe640 1 --2- 172.21.15.19:0/2086064970 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fee5806be60 0x7fee58198d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T22:37:53.628 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:53.622+0000 7fee56ffd640 1 --2- 172.21.15.19:0/2086064970 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fee58105b20 0x7fee581993d0 secure :-1 s=READY pgs=879 cs=0 l=1 rev1=1 crypto rx=0x7fee4c006010 tx=0x7fee4c0042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:37:53.628 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:53.622+0000 7fee54ff9640 1 -- 172.21.15.19:0/2086064970 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee4c03f030 con 0x7fee58105b20 2024-09-10T22:37:53.628 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:53.622+0000 7fee5dff3640 1 -- 172.21.15.19:0/2086064970 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fee5819ab50 con 0x7fee58105b20 2024-09-10T22:37:53.628 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:53.623+0000 7fee54ff9640 1 -- 172.21.15.19:0/2086064970 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fee4c003cb0 con 0x7fee58105b20 2024-09-10T22:37:53.628 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:53.623+0000 7fee54ff9640 1 -- 172.21.15.19:0/2086064970 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee4c035070 con 0x7fee58105b20 2024-09-10T22:37:53.628 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:53.623+0000 7fee5dff3640 1 -- 172.21.15.19:0/2086064970 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fee581a1280 con 0x7fee58105b20 2024-09-10T22:37:53.628 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:53.623+0000 7fee5dff3640 1 -- 172.21.15.19:0/2086064970 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fee580fec80 con 0x7fee58105b20 2024-09-10T22:37:53.629 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:53.625+0000 7fee54ff9640 1 -- 172.21.15.19:0/2086064970 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 18) ==== 153250+0+0 (secure 0 0 0) 0x7fee4c03bbd0 con 0x7fee58105b20 2024-09-10T22:37:53.629 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:53.626+0000 7fee54ff9640 1 --2- 172.21.15.19:0/2086064970 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7fee400b52e0 0x7fee400b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:37:53.629 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:53.626+0000 7fee54ff9640 1 -- 172.21.15.19:0/2086064970 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8327+0+0 (secure 0 0 0) 0x7fee4c106a50 con 0x7fee58105b20 2024-09-10T22:37:53.629 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:53.626+0000 7fee577fe640 1 --2- 172.21.15.19:0/2086064970 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7fee400b52e0 0x7fee400b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:37:53.629 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:53.626+0000 7fee577fe640 1 --2- 172.21.15.19:0/2086064970 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7fee400b52e0 0x7fee400b77a0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7fee480058c0 tx=0x7fee48005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:37:53.631 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:53.629+0000 7fee54ff9640 1 -- 172.21.15.19:0/2086064970 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7fee4c0cd850 con 0x7fee58105b20 2024-09-10T22:37:53.870 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:53.867+0000 7fee5dff3640 1 -- 172.21.15.19:0/2086064970 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json-pretty"} v 0) -- 0x7fee58063d50 con 0x7fee58105b20 2024-09-10T22:37:53.878 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:53.875+0000 7fee54ff9640 1 -- 172.21.15.19:0/2086064970 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json-pretty"}]=0 v18) ==== 81+0+827944 (secure 0 0 0) 0x7fee4c0cd150 con 0x7fee58105b20 2024-09-10T22:37:53.888 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-10T22:37:53.888 INFO:teuthology.orchestra.run.smithi019.stdout:{ 2024-09-10T22:37:53.888 INFO:teuthology.orchestra.run.smithi019.stdout: "epoch": 18, 2024-09-10T22:37:53.888 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-10T22:37:53.888 INFO:teuthology.orchestra.run.smithi019.stdout: "active_gid": 14150, 2024-09-10T22:37:53.888 INFO:teuthology.orchestra.run.smithi019.stdout: "active_name": "x", 2024-09-10T22:37:53.888 INFO:teuthology.orchestra.run.smithi019.stdout: "active_addrs": { 2024-09-10T22:37:53.888 INFO:teuthology.orchestra.run.smithi019.stdout: "addrvec": [ 2024-09-10T22:37:53.889 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-10T22:37:53.889 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "v2", 2024-09-10T22:37:53.889 INFO:teuthology.orchestra.run.smithi019.stdout: "addr": "172.21.15.19:6800", 2024-09-10T22:37:53.889 INFO:teuthology.orchestra.run.smithi019.stdout: "nonce": 2119495487 2024-09-10T22:37:53.889 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:53.889 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-10T22:37:53.889 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "v1", 2024-09-10T22:37:53.889 INFO:teuthology.orchestra.run.smithi019.stdout: "addr": "172.21.15.19:6801", 2024-09-10T22:37:53.889 INFO:teuthology.orchestra.run.smithi019.stdout: "nonce": 2119495487 2024-09-10T22:37:53.889 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-10T22:37:53.889 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-10T22:37:53.889 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:53.889 INFO:teuthology.orchestra.run.smithi019.stdout: "active_addr": "172.21.15.19:6801/2119495487", 2024-09-10T22:37:53.890 INFO:teuthology.orchestra.run.smithi019.stdout: "active_change": "2024-09-10T22:17:04.260933+0000", 2024-09-10T22:37:53.890 INFO:teuthology.orchestra.run.smithi019.stdout: "active_mgr_features": 4540719139924082687, 2024-09-10T22:37:53.890 INFO:teuthology.orchestra.run.smithi019.stdout: "available": true, 2024-09-10T22:37:53.890 INFO:teuthology.orchestra.run.smithi019.stdout: "standbys": [ 2024-09-10T22:37:53.890 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-10T22:37:53.890 INFO:teuthology.orchestra.run.smithi019.stdout: "gid": 24112, 2024-09-10T22:37:53.890 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "z", 2024-09-10T22:37:53.890 INFO:teuthology.orchestra.run.smithi019.stdout: "mgr_features": 4540719139924082687, 2024-09-10T22:37:53.890 INFO:teuthology.orchestra.run.smithi019.stdout: "available_modules": [ 2024-09-10T22:37:53.890 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-10T22:37:53.890 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "alerts", 2024-09-10T22:37:53.890 INFO:teuthology.orchestra.run.smithi019.stdout: "can_run": true, 2024-09-10T22:37:53.890 INFO:teuthology.orchestra.run.smithi019.stdout: "error_string": "", 2024-09-10T22:37:53.891 INFO:teuthology.orchestra.run.smithi019.stdout: "module_options": { 2024-09-10T22:37:53.891 INFO:teuthology.orchestra.run.smithi019.stdout: "interval": { 2024-09-10T22:37:53.891 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "interval", 2024-09-10T22:37:53.891 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "secs", 2024-09-10T22:37:53.891 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:53.891 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:53.891 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "60", 2024-09-10T22:37:53.891 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:53.891 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:53.891 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:53.891 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "How frequently to reexamine health status", 2024-09-10T22:37:53.891 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:53.891 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:53.891 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:53.892 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:53.892 INFO:teuthology.orchestra.run.smithi019.stdout: "log_level": { 2024-09-10T22:37:53.892 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_level", 2024-09-10T22:37:53.892 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-10T22:37:53.892 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:53.892 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:53.892 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-10T22:37:53.892 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:53.892 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:53.892 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-10T22:37:53.892 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-10T22:37:53.892 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-10T22:37:53.892 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-10T22:37:53.893 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-10T22:37:53.893 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-10T22:37:53.893 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-10T22:37:53.893 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-10T22:37:53.893 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:53.893 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:53.893 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:53.893 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:53.893 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:53.893 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster": { 2024-09-10T22:37:53.893 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster", 2024-09-10T22:37:53.893 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-10T22:37:53.893 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:53.893 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:53.894 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-10T22:37:53.894 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:53.894 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:53.894 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:53.894 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:53.894 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:53.894 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:53.894 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:53.894 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:53.894 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster_level": { 2024-09-10T22:37:53.894 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster_level", 2024-09-10T22:37:53.894 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-10T22:37:53.894 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:53.895 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:53.895 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "info", 2024-09-10T22:37:53.895 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:53.895 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:53.895 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-10T22:37:53.895 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-10T22:37:53.895 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-10T22:37:53.895 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-10T22:37:53.895 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-10T22:37:53.895 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-10T22:37:53.895 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-10T22:37:53.895 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-10T22:37:53.895 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:53.896 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:53.896 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:53.896 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:53.896 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:53.896 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_file": { 2024-09-10T22:37:53.896 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_file", 2024-09-10T22:37:53.896 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-10T22:37:53.896 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:53.896 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:53.896 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-10T22:37:53.896 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:53.896 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:53.897 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:53.897 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:53.897 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:53.897 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:53.897 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:53.897 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:53.897 INFO:teuthology.orchestra.run.smithi019.stdout: "smtp_destination": { 2024-09-10T22:37:53.897 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "smtp_destination", 2024-09-10T22:37:53.897 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-10T22:37:53.897 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:53.897 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:53.897 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-10T22:37:53.898 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:53.898 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:53.898 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:53.898 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "Email address to send alerts to, use commas to separate multiple", 2024-09-10T22:37:53.898 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:53.898 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:53.898 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:53.898 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:53.898 INFO:teuthology.orchestra.run.smithi019.stdout: "smtp_from_name": { 2024-09-10T22:37:53.898 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "smtp_from_name", 2024-09-10T22:37:53.898 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-10T22:37:53.898 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:53.898 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:53.899 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "Ceph", 2024-09-10T22:37:53.899 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:53.899 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:53.899 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:53.899 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "Email From: name", 2024-09-10T22:37:53.899 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:53.899 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:53.899 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:53.899 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:53.899 INFO:teuthology.orchestra.run.smithi019.stdout: "smtp_host": { 2024-09-10T22:37:53.899 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "smtp_host", 2024-09-10T22:37:53.899 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-10T22:37:53.899 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:53.900 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:53.900 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-10T22:37:53.900 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:53.900 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:53.900 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:53.900 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "SMTP server", 2024-09-10T22:37:53.900 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:53.900 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:53.900 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:53.900 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:53.900 INFO:teuthology.orchestra.run.smithi019.stdout: "smtp_password": { 2024-09-10T22:37:53.900 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "smtp_password", 2024-09-10T22:37:53.900 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-10T22:37:53.901 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:53.901 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:53.901 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-10T22:37:53.901 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:53.901 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:53.901 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:53.901 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "Password to authenticate with", 2024-09-10T22:37:53.901 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:53.901 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:53.901 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:53.901 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:53.901 INFO:teuthology.orchestra.run.smithi019.stdout: "smtp_port": { 2024-09-10T22:37:53.901 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "smtp_port", 2024-09-10T22:37:53.902 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "int", 2024-09-10T22:37:53.902 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:53.902 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:53.902 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "465", 2024-09-10T22:37:53.902 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:53.902 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:53.902 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:53.902 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "SMTP port", 2024-09-10T22:37:53.902 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:53.902 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:53.902 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:53.902 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:53.903 INFO:teuthology.orchestra.run.smithi019.stdout: "smtp_sender": { 2024-09-10T22:37:53.903 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "smtp_sender", 2024-09-10T22:37:53.903 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-10T22:37:53.903 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:53.903 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:53.903 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-10T22:37:53.903 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:53.903 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:53.903 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:53.903 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "SMTP envelope sender", 2024-09-10T22:37:53.903 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:53.903 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:53.904 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:53.904 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:53.904 INFO:teuthology.orchestra.run.smithi019.stdout: "smtp_ssl": { 2024-09-10T22:37:53.904 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "smtp_ssl", 2024-09-10T22:37:53.904 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-10T22:37:53.904 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:53.904 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:53.904 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "True", 2024-09-10T22:37:53.904 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:53.904 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:53.904 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:53.904 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "Use SSL to connect to SMTP server", 2024-09-10T22:37:53.904 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:53.905 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:53.905 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:53.905 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:53.905 INFO:teuthology.orchestra.run.smithi019.stdout: "smtp_user": { 2024-09-10T22:37:53.905 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "smtp_user", 2024-09-10T22:37:53.905 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-10T22:37:53.905 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:53.905 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:53.905 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-10T22:37:53.905 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:53.905 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:53.905 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:53.905 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "User to authenticate as", 2024-09-10T22:37:53.906 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:53.906 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:53.906 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:53.906 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:53.906 INFO:teuthology.orchestra.run.smithi019.stdout: "sqlite3_killpoint": { 2024-09-10T22:37:53.906 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "sqlite3_killpoint", 2024-09-10T22:37:53.906 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "int", 2024-09-10T22:37:53.906 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "dev", 2024-09-10T22:37:53.906 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:53.906 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "0", 2024-09-10T22:37:53.906 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:53.906 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:53.907 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:53.907 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:53.907 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:53.907 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:53.907 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:53.907 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-10T22:37:53.907 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-10T22:37:53.907 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:53.907 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-10T22:37:53.907 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "balancer", 2024-09-10T22:37:53.907 INFO:teuthology.orchestra.run.smithi019.stdout: "can_run": true, 2024-09-10T22:37:53.907 INFO:teuthology.orchestra.run.smithi019.stdout: "error_string": "", 2024-09-10T22:37:53.907 INFO:teuthology.orchestra.run.smithi019.stdout: "module_options": { 2024-09-10T22:37:53.907 INFO:teuthology.orchestra.run.smithi019.stdout: "active": { 2024-09-10T22:37:53.908 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "active", 2024-09-10T22:37:53.908 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-10T22:37:53.908 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:53.908 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:53.908 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "True", 2024-09-10T22:37:53.908 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:53.908 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:53.908 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:53.908 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "automatically balance PGs across cluster", 2024-09-10T22:37:53.908 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:53.908 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:53.908 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:53.908 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:53.909 INFO:teuthology.orchestra.run.smithi019.stdout: "begin_time": { 2024-09-10T22:37:53.909 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "begin_time", 2024-09-10T22:37:53.909 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-10T22:37:53.909 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:53.909 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:53.909 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "0000", 2024-09-10T22:37:53.909 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:53.909 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:53.909 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:53.909 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "beginning time of day to automatically balance", 2024-09-10T22:37:53.909 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-10T22:37:53.909 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:53.909 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:53.910 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:53.910 INFO:teuthology.orchestra.run.smithi019.stdout: "begin_weekday": { 2024-09-10T22:37:53.910 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "begin_weekday", 2024-09-10T22:37:53.910 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "uint", 2024-09-10T22:37:53.910 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:53.910 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:53.910 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "0", 2024-09-10T22:37:53.910 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "0", 2024-09-10T22:37:53.910 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "6", 2024-09-10T22:37:53.910 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:53.910 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2024-09-10T22:37:53.910 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-10T22:37:53.910 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:53.911 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:53.911 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:53.911 INFO:teuthology.orchestra.run.smithi019.stdout: "crush_compat_max_iterations": { 2024-09-10T22:37:53.911 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "crush_compat_max_iterations", 2024-09-10T22:37:53.911 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "uint", 2024-09-10T22:37:53.911 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:53.911 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:53.911 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "25", 2024-09-10T22:37:53.911 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "1", 2024-09-10T22:37:53.911 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "250", 2024-09-10T22:37:53.911 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:53.911 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "maximum number of iterations to attempt optimization", 2024-09-10T22:37:53.911 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:53.911 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:53.912 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:53.912 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:53.912 INFO:teuthology.orchestra.run.smithi019.stdout: "crush_compat_metrics": { 2024-09-10T22:37:53.912 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "crush_compat_metrics", 2024-09-10T22:37:53.912 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-10T22:37:53.912 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:53.912 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:53.912 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "pgs,objects,bytes", 2024-09-10T22:37:53.912 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:53.912 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:53.912 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:53.912 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "metrics with which to calculate OSD utilization", 2024-09-10T22:37:53.912 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2024-09-10T22:37:53.913 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:53.913 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:53.913 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:53.913 INFO:teuthology.orchestra.run.smithi019.stdout: "crush_compat_step": { 2024-09-10T22:37:53.913 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "crush_compat_step", 2024-09-10T22:37:53.913 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "float", 2024-09-10T22:37:53.913 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:53.913 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:53.913 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "0.5", 2024-09-10T22:37:53.913 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "0.001", 2024-09-10T22:37:53.913 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "0.999", 2024-09-10T22:37:53.913 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:53.913 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "aggressiveness of optimization", 2024-09-10T22:37:53.914 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2024-09-10T22:37:53.914 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:53.914 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:53.914 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:53.914 INFO:teuthology.orchestra.run.smithi019.stdout: "end_time": { 2024-09-10T22:37:53.914 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "end_time", 2024-09-10T22:37:53.914 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-10T22:37:53.914 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:53.914 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:53.914 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "2359", 2024-09-10T22:37:53.914 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:53.914 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:53.914 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:53.914 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "ending time of day to automatically balance", 2024-09-10T22:37:53.915 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-10T22:37:53.915 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:53.915 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:53.915 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:53.915 INFO:teuthology.orchestra.run.smithi019.stdout: "end_weekday": { 2024-09-10T22:37:53.915 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "end_weekday", 2024-09-10T22:37:53.915 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "uint", 2024-09-10T22:37:53.915 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:53.915 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:53.915 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "0", 2024-09-10T22:37:53.915 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "0", 2024-09-10T22:37:53.915 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "6", 2024-09-10T22:37:53.915 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:53.915 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2024-09-10T22:37:53.916 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-10T22:37:53.916 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:53.916 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:53.916 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:53.916 INFO:teuthology.orchestra.run.smithi019.stdout: "log_level": { 2024-09-10T22:37:53.916 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_level", 2024-09-10T22:37:53.916 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-10T22:37:53.916 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:53.916 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:53.916 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-10T22:37:53.916 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:53.916 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:53.916 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-10T22:37:53.916 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-10T22:37:53.917 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-10T22:37:53.917 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-10T22:37:53.917 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-10T22:37:53.917 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-10T22:37:53.917 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-10T22:37:53.917 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-10T22:37:53.917 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:53.917 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:53.917 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:53.917 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:53.917 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:53.917 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster": { 2024-09-10T22:37:53.917 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster", 2024-09-10T22:37:53.918 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-10T22:37:53.918 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:53.918 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:53.918 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-10T22:37:53.918 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:53.918 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:53.918 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:53.918 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:53.918 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:53.918 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:53.918 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:53.918 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:53.918 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster_level": { 2024-09-10T22:37:53.918 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster_level", 2024-09-10T22:37:53.919 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-10T22:37:53.919 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:53.919 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:53.919 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "info", 2024-09-10T22:37:53.919 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:53.919 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:53.919 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-10T22:37:53.919 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-10T22:37:53.919 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-10T22:37:53.919 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-10T22:37:53.919 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-10T22:37:53.919 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-10T22:37:53.919 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-10T22:37:53.919 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-10T22:37:53.920 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:53.920 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:53.920 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:53.920 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:53.920 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:53.920 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_file": { 2024-09-10T22:37:53.920 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_file", 2024-09-10T22:37:53.920 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-10T22:37:53.920 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:53.920 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:53.920 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-10T22:37:53.920 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:53.920 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:53.921 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:53.921 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:53.921 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:53.921 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:53.921 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:53.921 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:53.921 INFO:teuthology.orchestra.run.smithi019.stdout: "min_score": { 2024-09-10T22:37:53.921 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "min_score", 2024-09-10T22:37:53.921 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "float", 2024-09-10T22:37:53.921 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:53.921 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:53.921 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "0", 2024-09-10T22:37:53.921 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:53.921 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:53.922 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:53.922 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "minimum score, below which no optimization is attempted", 2024-09-10T22:37:53.922 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:53.922 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:53.922 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:53.922 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:53.922 INFO:teuthology.orchestra.run.smithi019.stdout: "mode": { 2024-09-10T22:37:53.922 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "mode", 2024-09-10T22:37:53.922 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-10T22:37:53.922 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:53.922 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:53.922 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "upmap", 2024-09-10T22:37:53.922 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:53.922 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:53.923 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-10T22:37:53.923 INFO:teuthology.orchestra.run.smithi019.stdout: "crush-compat", 2024-09-10T22:37:53.923 INFO:teuthology.orchestra.run.smithi019.stdout: "none", 2024-09-10T22:37:53.923 INFO:teuthology.orchestra.run.smithi019.stdout: "read", 2024-09-10T22:37:53.923 INFO:teuthology.orchestra.run.smithi019.stdout: "upmap", 2024-09-10T22:37:53.923 INFO:teuthology.orchestra.run.smithi019.stdout: "upmap-read" 2024-09-10T22:37:53.923 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-10T22:37:53.923 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "Balancer mode", 2024-09-10T22:37:53.923 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:53.923 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:53.923 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:53.923 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:53.923 INFO:teuthology.orchestra.run.smithi019.stdout: "pool_ids": { 2024-09-10T22:37:53.923 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "pool_ids", 2024-09-10T22:37:53.924 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-10T22:37:53.924 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:53.924 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:53.924 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-10T22:37:53.924 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:53.924 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:53.924 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:53.924 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "pools which the automatic balancing will be limited to", 2024-09-10T22:37:53.924 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:53.924 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:53.924 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:53.924 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:53.924 INFO:teuthology.orchestra.run.smithi019.stdout: "sleep_interval": { 2024-09-10T22:37:53.925 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "sleep_interval", 2024-09-10T22:37:53.925 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "secs", 2024-09-10T22:37:53.925 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:53.925 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:53.925 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "60", 2024-09-10T22:37:53.925 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:53.925 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:53.925 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:53.925 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "how frequently to wake up and attempt optimization", 2024-09-10T22:37:53.925 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:53.925 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:53.925 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:53.925 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:53.925 INFO:teuthology.orchestra.run.smithi019.stdout: "sqlite3_killpoint": { 2024-09-10T22:37:53.926 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "sqlite3_killpoint", 2024-09-10T22:37:53.926 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "int", 2024-09-10T22:37:53.926 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "dev", 2024-09-10T22:37:53.926 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:53.926 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "0", 2024-09-10T22:37:53.926 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:53.926 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:53.926 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:53.926 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:53.926 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:53.926 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:53.926 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:53.926 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:53.927 INFO:teuthology.orchestra.run.smithi019.stdout: "upmap_max_deviation": { 2024-09-10T22:37:53.927 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "upmap_max_deviation", 2024-09-10T22:37:53.927 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "int", 2024-09-10T22:37:53.927 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:53.927 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:53.927 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "5", 2024-09-10T22:37:53.927 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "1", 2024-09-10T22:37:53.927 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:53.927 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:53.927 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "deviation below which no optimization is attempted", 2024-09-10T22:37:53.927 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2024-09-10T22:37:53.927 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:53.927 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:53.927 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:53.928 INFO:teuthology.orchestra.run.smithi019.stdout: "upmap_max_optimizations": { 2024-09-10T22:37:53.928 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "upmap_max_optimizations", 2024-09-10T22:37:53.928 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "uint", 2024-09-10T22:37:53.928 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:53.928 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:53.928 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "10", 2024-09-10T22:37:53.928 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:53.928 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:53.928 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:53.928 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "maximum upmap optimizations to make per attempt", 2024-09-10T22:37:53.928 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:53.928 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:53.928 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:53.928 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-10T22:37:53.929 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-10T22:37:53.929 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:53.929 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-10T22:37:53.929 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "cephadm", 2024-09-10T22:37:53.929 INFO:teuthology.orchestra.run.smithi019.stdout: "can_run": true, 2024-09-10T22:37:53.929 INFO:teuthology.orchestra.run.smithi019.stdout: "error_string": "", 2024-09-10T22:37:53.929 INFO:teuthology.orchestra.run.smithi019.stdout: "module_options": { 2024-09-10T22:37:53.929 INFO:teuthology.orchestra.run.smithi019.stdout: "agent_down_multiplier": { 2024-09-10T22:37:53.929 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "agent_down_multiplier", 2024-09-10T22:37:53.929 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "float", 2024-09-10T22:37:53.929 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:53.929 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-10T22:37:53.929 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "3.0", 2024-09-10T22:37:53.929 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:53.930 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:53.930 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:53.930 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2024-09-10T22:37:53.930 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:53.930 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:53.930 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:53.930 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:53.930 INFO:teuthology.orchestra.run.smithi019.stdout: "agent_refresh_rate": { 2024-09-10T22:37:53.930 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "agent_refresh_rate", 2024-09-10T22:37:53.930 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "secs", 2024-09-10T22:37:53.930 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:53.930 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-10T22:37:53.930 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "20", 2024-09-10T22:37:53.931 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:53.931 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:53.931 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:53.931 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2024-09-10T22:37:53.931 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:53.931 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:53.931 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:53.931 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:53.931 INFO:teuthology.orchestra.run.smithi019.stdout: "agent_starting_port": { 2024-09-10T22:37:53.931 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "agent_starting_port", 2024-09-10T22:37:53.931 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "int", 2024-09-10T22:37:53.931 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:53.931 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-10T22:37:53.931 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "4721", 2024-09-10T22:37:53.932 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:53.932 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:53.932 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:53.932 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2024-09-10T22:37:53.932 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:53.932 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:53.932 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:53.932 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:53.932 INFO:teuthology.orchestra.run.smithi019.stdout: "allow_ptrace": { 2024-09-10T22:37:53.932 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "allow_ptrace", 2024-09-10T22:37:53.932 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-10T22:37:53.932 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:53.933 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-10T22:37:53.933 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-10T22:37:53.933 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:53.933 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:53.933 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:53.933 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2024-09-10T22:37:53.933 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2024-09-10T22:37:53.933 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:53.933 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:53.933 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:53.933 INFO:teuthology.orchestra.run.smithi019.stdout: "autotune_interval": { 2024-09-10T22:37:53.933 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "autotune_interval", 2024-09-10T22:37:53.933 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "secs", 2024-09-10T22:37:53.934 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:53.934 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-10T22:37:53.934 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "600", 2024-09-10T22:37:53.934 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:53.934 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:53.934 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:53.934 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "how frequently to autotune daemon memory", 2024-09-10T22:37:53.934 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:53.934 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:53.934 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:53.934 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:53.934 INFO:teuthology.orchestra.run.smithi019.stdout: "autotune_memory_target_ratio": { 2024-09-10T22:37:53.934 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "autotune_memory_target_ratio", 2024-09-10T22:37:53.935 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "float", 2024-09-10T22:37:53.935 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:53.935 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-10T22:37:53.935 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "0.7", 2024-09-10T22:37:53.935 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:53.935 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:53.935 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:53.935 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2024-09-10T22:37:53.935 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:53.935 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:53.935 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:53.935 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:53.935 INFO:teuthology.orchestra.run.smithi019.stdout: "cephadm_log_destination": { 2024-09-10T22:37:53.935 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "cephadm_log_destination", 2024-09-10T22:37:53.935 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-10T22:37:53.936 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:53.936 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-10T22:37:53.936 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-10T22:37:53.936 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:53.936 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:53.936 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-10T22:37:53.936 INFO:teuthology.orchestra.run.smithi019.stdout: "file", 2024-09-10T22:37:53.936 INFO:teuthology.orchestra.run.smithi019.stdout: "file,syslog", 2024-09-10T22:37:53.936 INFO:teuthology.orchestra.run.smithi019.stdout: "syslog" 2024-09-10T22:37:53.936 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-10T22:37:53.936 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "Destination for cephadm command's persistent logging", 2024-09-10T22:37:53.936 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:53.936 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:53.937 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:53.937 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:53.937 INFO:teuthology.orchestra.run.smithi019.stdout: "cgroups_split": { 2024-09-10T22:37:53.937 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "cgroups_split", 2024-09-10T22:37:53.937 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-10T22:37:53.937 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:53.940 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-10T22:37:53.940 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "True", 2024-09-10T22:37:53.940 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:53.940 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:53.940 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:53.940 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2024-09-10T22:37:53.940 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:53.940 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:53.941 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:53.941 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:53.941 INFO:teuthology.orchestra.run.smithi019.stdout: "config_checks_enabled": { 2024-09-10T22:37:53.941 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "config_checks_enabled", 2024-09-10T22:37:53.941 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-10T22:37:53.941 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:53.941 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-10T22:37:53.941 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-10T22:37:53.941 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:53.941 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:53.941 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:53.941 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2024-09-10T22:37:53.941 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:53.941 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:53.942 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:53.942 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:53.942 INFO:teuthology.orchestra.run.smithi019.stdout: "config_dashboard": { 2024-09-10T22:37:53.942 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "config_dashboard", 2024-09-10T22:37:53.942 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-10T22:37:53.942 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:53.942 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-10T22:37:53.942 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "True", 2024-09-10T22:37:53.942 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:53.942 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:53.942 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:53.942 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2024-09-10T22:37:53.942 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:53.942 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:53.943 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:53.943 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:53.943 INFO:teuthology.orchestra.run.smithi019.stdout: "container_image_alertmanager": { 2024-09-10T22:37:53.943 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "container_image_alertmanager", 2024-09-10T22:37:53.943 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-10T22:37:53.943 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:53.943 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-10T22:37:53.943 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.27.0", 2024-09-10T22:37:53.943 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:53.943 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:53.943 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:53.943 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "Prometheus container image", 2024-09-10T22:37:53.943 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:53.944 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:53.944 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:53.944 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:53.944 INFO:teuthology.orchestra.run.smithi019.stdout: "container_image_base": { 2024-09-10T22:37:53.944 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "container_image_base", 2024-09-10T22:37:53.944 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-10T22:37:53.944 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:53.944 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:53.944 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "quay.io/ceph/ceph", 2024-09-10T22:37:53.944 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:53.944 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:53.944 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:53.944 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "Container image name, without the tag", 2024-09-10T22:37:53.945 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:53.945 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:53.945 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:53.945 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:53.945 INFO:teuthology.orchestra.run.smithi019.stdout: "container_image_elasticsearch": { 2024-09-10T22:37:53.945 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "container_image_elasticsearch", 2024-09-10T22:37:53.945 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-10T22:37:53.945 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:53.945 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-10T22:37:53.945 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2024-09-10T22:37:53.945 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:53.945 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:53.946 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:53.946 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "elasticsearch container image", 2024-09-10T22:37:53.946 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:53.946 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:53.946 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:53.946 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:53.946 INFO:teuthology.orchestra.run.smithi019.stdout: "container_image_grafana": { 2024-09-10T22:37:53.946 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "container_image_grafana", 2024-09-10T22:37:53.946 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-10T22:37:53.946 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:53.946 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-10T22:37:53.946 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "quay.io/ceph/grafana:10.4.0", 2024-09-10T22:37:53.946 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:53.947 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:53.947 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:53.947 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "Prometheus container image", 2024-09-10T22:37:53.947 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:53.947 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:53.947 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:53.947 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:53.947 INFO:teuthology.orchestra.run.smithi019.stdout: "container_image_haproxy": { 2024-09-10T22:37:53.947 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "container_image_haproxy", 2024-09-10T22:37:53.947 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-10T22:37:53.947 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:53.947 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-10T22:37:53.947 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2024-09-10T22:37:53.948 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:53.948 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:53.948 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:53.948 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "HAproxy container image", 2024-09-10T22:37:53.948 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:53.948 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:53.948 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:53.948 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:53.948 INFO:teuthology.orchestra.run.smithi019.stdout: "container_image_jaeger_agent": { 2024-09-10T22:37:53.948 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "container_image_jaeger_agent", 2024-09-10T22:37:53.948 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-10T22:37:53.948 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:53.949 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-10T22:37:53.949 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2024-09-10T22:37:53.949 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:53.949 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:53.949 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:53.949 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "Jaeger agent container image", 2024-09-10T22:37:53.949 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:53.949 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:53.949 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:53.949 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:53.949 INFO:teuthology.orchestra.run.smithi019.stdout: "container_image_jaeger_collector": { 2024-09-10T22:37:53.949 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "container_image_jaeger_collector", 2024-09-10T22:37:53.949 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-10T22:37:53.950 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:53.950 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-10T22:37:53.950 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2024-09-10T22:37:53.950 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:53.950 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:53.950 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:53.950 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "Jaeger collector container image", 2024-09-10T22:37:53.950 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:53.950 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:53.950 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:53.950 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:53.950 INFO:teuthology.orchestra.run.smithi019.stdout: "container_image_jaeger_query": { 2024-09-10T22:37:53.950 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "container_image_jaeger_query", 2024-09-10T22:37:53.950 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-10T22:37:53.951 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:53.951 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-10T22:37:53.951 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2024-09-10T22:37:53.951 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:53.951 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:53.951 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:53.951 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "Jaeger query container image", 2024-09-10T22:37:53.951 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:53.951 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:53.951 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:53.951 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:53.951 INFO:teuthology.orchestra.run.smithi019.stdout: "container_image_keepalived": { 2024-09-10T22:37:53.951 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "container_image_keepalived", 2024-09-10T22:37:53.952 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-10T22:37:53.952 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:53.952 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-10T22:37:53.952 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2024-09-10T22:37:53.952 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:53.952 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:53.952 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:53.952 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "Keepalived container image", 2024-09-10T22:37:53.952 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:53.952 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:53.952 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:53.952 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:53.952 INFO:teuthology.orchestra.run.smithi019.stdout: "container_image_loki": { 2024-09-10T22:37:53.952 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "container_image_loki", 2024-09-10T22:37:53.953 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-10T22:37:53.953 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:53.953 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-10T22:37:53.953 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "docker.io/grafana/loki:3.0.0", 2024-09-10T22:37:53.953 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:53.953 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:53.953 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:53.953 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "Loki container image", 2024-09-10T22:37:53.953 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:53.953 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:53.953 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:53.953 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:53.953 INFO:teuthology.orchestra.run.smithi019.stdout: "container_image_nginx": { 2024-09-10T22:37:53.954 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "container_image_nginx", 2024-09-10T22:37:53.954 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-10T22:37:53.954 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:53.954 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-10T22:37:53.954 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "quay.io/ceph/nginx:1.26.1", 2024-09-10T22:37:53.954 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:53.954 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:53.954 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:53.954 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "Nginx container image", 2024-09-10T22:37:53.954 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:53.954 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:53.954 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:53.954 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:53.954 INFO:teuthology.orchestra.run.smithi019.stdout: "container_image_node_exporter": { 2024-09-10T22:37:53.955 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "container_image_node_exporter", 2024-09-10T22:37:53.955 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-10T22:37:53.955 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:53.955 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-10T22:37:53.955 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.7.0", 2024-09-10T22:37:53.955 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:53.955 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:53.955 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:53.955 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "Prometheus container image", 2024-09-10T22:37:53.955 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:53.955 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:53.955 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:53.955 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:53.956 INFO:teuthology.orchestra.run.smithi019.stdout: "container_image_nvmeof": { 2024-09-10T22:37:53.956 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "container_image_nvmeof", 2024-09-10T22:37:53.956 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-10T22:37:53.956 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:53.956 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-10T22:37:53.956 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "quay.io/ceph/nvmeof:1.2.17", 2024-09-10T22:37:53.956 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:53.956 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:53.956 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:53.956 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "Nvme-of container image", 2024-09-10T22:37:53.956 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:53.956 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:53.956 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:53.957 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:53.957 INFO:teuthology.orchestra.run.smithi019.stdout: "container_image_oauth2_proxy": { 2024-09-10T22:37:53.957 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "container_image_oauth2_proxy", 2024-09-10T22:37:53.957 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-10T22:37:53.957 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:53.957 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-10T22:37:53.957 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "quay.io/oauth2-proxy/oauth2-proxy:v7.6.0", 2024-09-10T22:37:53.957 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:53.957 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:53.957 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:53.957 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "oauth2-proxy container image", 2024-09-10T22:37:53.957 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:53.957 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:53.957 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:53.958 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:53.958 INFO:teuthology.orchestra.run.smithi019.stdout: "container_image_prometheus": { 2024-09-10T22:37:53.958 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "container_image_prometheus", 2024-09-10T22:37:53.958 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-10T22:37:53.958 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:53.958 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-10T22:37:53.958 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "quay.io/prometheus/prometheus:v2.51.0", 2024-09-10T22:37:53.958 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:53.958 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:53.958 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:53.958 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "Prometheus container image", 2024-09-10T22:37:53.958 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:53.959 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:53.959 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:53.959 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:53.959 INFO:teuthology.orchestra.run.smithi019.stdout: "container_image_promtail": { 2024-09-10T22:37:53.959 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "container_image_promtail", 2024-09-10T22:37:53.959 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-10T22:37:53.959 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:53.959 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-10T22:37:53.959 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "docker.io/grafana/promtail:3.0.0", 2024-09-10T22:37:53.959 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:53.959 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:53.959 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:53.959 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "Promtail container image", 2024-09-10T22:37:53.960 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:53.960 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:53.960 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:53.960 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:53.960 INFO:teuthology.orchestra.run.smithi019.stdout: "container_image_samba": { 2024-09-10T22:37:53.960 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "container_image_samba", 2024-09-10T22:37:53.960 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-10T22:37:53.960 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:53.960 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-10T22:37:53.960 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "quay.io/samba.org/samba-server:devbuilds-centos-amd64", 2024-09-10T22:37:53.960 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:53.960 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:53.961 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:53.961 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "Samba/SMB container image", 2024-09-10T22:37:53.961 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:53.961 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:53.961 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:53.961 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:53.961 INFO:teuthology.orchestra.run.smithi019.stdout: "container_image_samba_metrics": { 2024-09-10T22:37:53.961 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "container_image_samba_metrics", 2024-09-10T22:37:53.961 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-10T22:37:53.961 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:53.961 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-10T22:37:53.961 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "quay.io/samba.org/samba-metrics:latest", 2024-09-10T22:37:53.961 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:53.962 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:53.962 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:53.962 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "Samba/SMB metrics exporter container image", 2024-09-10T22:37:53.962 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:53.962 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:53.962 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:53.962 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:53.962 INFO:teuthology.orchestra.run.smithi019.stdout: "container_image_snmp_gateway": { 2024-09-10T22:37:53.962 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "container_image_snmp_gateway", 2024-09-10T22:37:53.962 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-10T22:37:53.962 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:53.962 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-10T22:37:53.962 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2024-09-10T22:37:53.962 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:53.963 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:53.963 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:53.963 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "SNMP Gateway container image", 2024-09-10T22:37:53.963 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:53.963 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:53.963 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:53.963 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:53.963 INFO:teuthology.orchestra.run.smithi019.stdout: "container_init": { 2024-09-10T22:37:53.963 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "container_init", 2024-09-10T22:37:53.963 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-10T22:37:53.963 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:53.963 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-10T22:37:53.963 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "True", 2024-09-10T22:37:53.963 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:53.964 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:53.964 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:53.964 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "Run podman/docker with `--init`", 2024-09-10T22:37:53.964 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:53.964 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:53.964 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:53.964 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:53.964 INFO:teuthology.orchestra.run.smithi019.stdout: "daemon_cache_timeout": { 2024-09-10T22:37:53.964 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "daemon_cache_timeout", 2024-09-10T22:37:53.964 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "secs", 2024-09-10T22:37:53.964 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:53.964 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-10T22:37:53.965 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "600", 2024-09-10T22:37:53.965 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:53.965 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:53.965 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:53.965 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "seconds to cache service (daemon) inventory", 2024-09-10T22:37:53.965 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:53.965 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:53.965 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:53.965 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:53.965 INFO:teuthology.orchestra.run.smithi019.stdout: "default_cephadm_command_timeout": { 2024-09-10T22:37:53.965 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "default_cephadm_command_timeout", 2024-09-10T22:37:53.965 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "int", 2024-09-10T22:37:53.965 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:53.965 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-10T22:37:53.966 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "900", 2024-09-10T22:37:53.966 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:53.966 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:53.966 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:53.966 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2024-09-10T22:37:53.966 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:53.966 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:53.966 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:53.966 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:53.966 INFO:teuthology.orchestra.run.smithi019.stdout: "default_registry": { 2024-09-10T22:37:53.966 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "default_registry", 2024-09-10T22:37:53.966 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-10T22:37:53.966 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:53.966 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-10T22:37:53.967 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "docker.io", 2024-09-10T22:37:53.967 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:53.967 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:53.967 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:53.967 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2024-09-10T22:37:53.967 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:53.967 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:53.967 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:53.967 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:53.967 INFO:teuthology.orchestra.run.smithi019.stdout: "device_cache_timeout": { 2024-09-10T22:37:53.967 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "device_cache_timeout", 2024-09-10T22:37:53.967 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "secs", 2024-09-10T22:37:53.967 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:53.968 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-10T22:37:53.968 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "1800", 2024-09-10T22:37:53.968 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:53.968 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:53.968 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:53.968 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "seconds to cache device inventory", 2024-09-10T22:37:53.968 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:53.968 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:53.968 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:53.968 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:53.968 INFO:teuthology.orchestra.run.smithi019.stdout: "device_enhanced_scan": { 2024-09-10T22:37:53.968 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "device_enhanced_scan", 2024-09-10T22:37:53.968 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-10T22:37:53.969 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:53.969 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-10T22:37:53.969 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-10T22:37:53.969 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:53.969 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:53.969 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:53.969 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "Use libstoragemgmt during device scans", 2024-09-10T22:37:53.969 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:53.969 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:53.969 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:53.969 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:53.969 INFO:teuthology.orchestra.run.smithi019.stdout: "facts_cache_timeout": { 2024-09-10T22:37:53.969 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "facts_cache_timeout", 2024-09-10T22:37:53.970 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "secs", 2024-09-10T22:37:53.970 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:53.970 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-10T22:37:53.970 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "60", 2024-09-10T22:37:53.970 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:53.970 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:53.970 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:53.970 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "seconds to cache host facts data", 2024-09-10T22:37:53.970 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:53.970 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:53.970 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:53.970 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:53.970 INFO:teuthology.orchestra.run.smithi019.stdout: "grafana_dashboards_path": { 2024-09-10T22:37:53.970 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "grafana_dashboards_path", 2024-09-10T22:37:53.971 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-10T22:37:53.971 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:53.971 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-10T22:37:53.971 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "/etc/grafana/dashboards/ceph-dashboard/", 2024-09-10T22:37:53.971 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:53.971 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:53.971 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:53.971 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "location of dashboards to include in grafana deployments", 2024-09-10T22:37:53.971 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:53.971 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:53.971 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:53.971 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:53.972 INFO:teuthology.orchestra.run.smithi019.stdout: "host_check_interval": { 2024-09-10T22:37:53.972 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "host_check_interval", 2024-09-10T22:37:53.972 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "secs", 2024-09-10T22:37:53.972 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:53.972 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-10T22:37:53.972 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "600", 2024-09-10T22:37:53.972 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:53.972 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:53.972 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:53.972 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "how frequently to perform a host check", 2024-09-10T22:37:53.972 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:53.972 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:53.972 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:53.973 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:53.973 INFO:teuthology.orchestra.run.smithi019.stdout: "hw_monitoring": { 2024-09-10T22:37:53.973 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "hw_monitoring", 2024-09-10T22:37:53.973 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-10T22:37:53.973 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:53.973 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-10T22:37:53.973 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-10T22:37:53.973 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:53.973 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:53.973 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:53.973 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "Deploy hw monitoring daemon on every host.", 2024-09-10T22:37:53.973 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:53.973 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:53.974 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:53.974 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:53.974 INFO:teuthology.orchestra.run.smithi019.stdout: "inventory_list_all": { 2024-09-10T22:37:53.974 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "inventory_list_all", 2024-09-10T22:37:53.974 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-10T22:37:53.974 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:53.974 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-10T22:37:53.974 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-10T22:37:53.974 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:53.974 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:53.974 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:53.974 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2024-09-10T22:37:53.974 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:53.975 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:53.975 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:53.975 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:53.975 INFO:teuthology.orchestra.run.smithi019.stdout: "log_level": { 2024-09-10T22:37:53.975 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_level", 2024-09-10T22:37:53.975 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-10T22:37:53.975 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:53.975 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:53.975 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-10T22:37:53.975 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:53.975 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:53.975 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-10T22:37:53.975 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-10T22:37:53.975 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-10T22:37:53.975 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-10T22:37:53.976 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-10T22:37:53.976 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-10T22:37:53.976 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-10T22:37:53.976 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-10T22:37:53.976 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:53.976 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:53.976 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:53.976 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:53.976 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:53.976 INFO:teuthology.orchestra.run.smithi019.stdout: "log_refresh_metadata": { 2024-09-10T22:37:53.976 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_refresh_metadata", 2024-09-10T22:37:53.976 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-10T22:37:53.976 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:53.977 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-10T22:37:53.977 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-10T22:37:53.977 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:53.977 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:53.977 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:53.977 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2024-09-10T22:37:53.977 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:53.977 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:53.977 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:53.977 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:53.977 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster": { 2024-09-10T22:37:53.977 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster", 2024-09-10T22:37:53.977 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-10T22:37:53.977 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:53.978 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-10T22:37:53.978 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "True", 2024-09-10T22:37:53.978 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:53.978 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:53.978 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:53.978 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2024-09-10T22:37:53.978 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:53.978 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:53.978 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:53.978 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:53.978 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster_level": { 2024-09-10T22:37:53.978 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster_level", 2024-09-10T22:37:53.978 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-10T22:37:53.978 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:53.979 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:53.979 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "info", 2024-09-10T22:37:53.979 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:53.979 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:53.979 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-10T22:37:53.979 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-10T22:37:53.979 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-10T22:37:53.979 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-10T22:37:53.979 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-10T22:37:53.979 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-10T22:37:53.979 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-10T22:37:53.979 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-10T22:37:53.979 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:53.980 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:53.980 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:53.980 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:53.980 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:53.980 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_file": { 2024-09-10T22:37:53.980 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_file", 2024-09-10T22:37:53.980 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-10T22:37:53.980 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:53.980 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:53.980 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-10T22:37:53.980 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:53.980 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:53.980 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:53.981 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:53.981 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:53.981 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:53.981 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:53.981 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:53.981 INFO:teuthology.orchestra.run.smithi019.stdout: "manage_etc_ceph_ceph_conf": { 2024-09-10T22:37:53.981 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "manage_etc_ceph_ceph_conf", 2024-09-10T22:37:53.981 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-10T22:37:53.981 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:53.981 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-10T22:37:53.981 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-10T22:37:53.981 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:53.981 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:53.981 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:53.982 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2024-09-10T22:37:53.982 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:53.982 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:53.982 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:53.982 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:53.982 INFO:teuthology.orchestra.run.smithi019.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2024-09-10T22:37:53.982 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2024-09-10T22:37:53.982 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-10T22:37:53.982 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:53.982 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-10T22:37:53.982 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "*", 2024-09-10T22:37:53.982 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:53.982 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:53.983 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:53.983 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2024-09-10T22:37:53.983 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:53.983 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:53.983 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:53.983 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:53.983 INFO:teuthology.orchestra.run.smithi019.stdout: "max_count_per_host": { 2024-09-10T22:37:53.983 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "max_count_per_host", 2024-09-10T22:37:53.983 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "int", 2024-09-10T22:37:53.983 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:53.983 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-10T22:37:53.983 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "10", 2024-09-10T22:37:53.983 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:53.983 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:53.983 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:53.984 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "max number of daemons per service per host", 2024-09-10T22:37:53.984 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:53.984 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:53.984 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:53.984 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:53.984 INFO:teuthology.orchestra.run.smithi019.stdout: "max_osd_draining_count": { 2024-09-10T22:37:53.984 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "max_osd_draining_count", 2024-09-10T22:37:53.984 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "int", 2024-09-10T22:37:53.984 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:53.984 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-10T22:37:53.984 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "10", 2024-09-10T22:37:53.984 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:53.985 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:53.985 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:53.985 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2024-09-10T22:37:53.985 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:53.985 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:53.985 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:53.985 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:53.985 INFO:teuthology.orchestra.run.smithi019.stdout: "migration_current": { 2024-09-10T22:37:53.985 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "migration_current", 2024-09-10T22:37:53.985 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "int", 2024-09-10T22:37:53.985 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:53.985 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-10T22:37:53.985 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-10T22:37:53.985 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:53.986 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:53.986 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:53.986 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "internal - do not modify", 2024-09-10T22:37:53.986 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:53.986 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:53.986 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:53.986 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:53.986 INFO:teuthology.orchestra.run.smithi019.stdout: "mode": { 2024-09-10T22:37:53.986 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "mode", 2024-09-10T22:37:53.986 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-10T22:37:53.986 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:53.986 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-10T22:37:53.986 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "root", 2024-09-10T22:37:53.986 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:53.987 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:53.987 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-10T22:37:53.987 INFO:teuthology.orchestra.run.smithi019.stdout: "cephadm-package", 2024-09-10T22:37:53.987 INFO:teuthology.orchestra.run.smithi019.stdout: "root" 2024-09-10T22:37:53.987 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-10T22:37:53.987 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "mode for remote execution of cephadm", 2024-09-10T22:37:53.987 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:53.987 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:53.987 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:53.987 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:53.987 INFO:teuthology.orchestra.run.smithi019.stdout: "oob_default_addr": { 2024-09-10T22:37:53.987 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "oob_default_addr", 2024-09-10T22:37:53.987 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-10T22:37:53.987 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:53.988 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-10T22:37:53.988 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "169.254.1.1", 2024-09-10T22:37:53.988 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:53.988 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:53.988 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:53.988 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "Default address for RedFish API (oob management).", 2024-09-10T22:37:53.988 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:53.988 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:53.988 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:53.988 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:53.988 INFO:teuthology.orchestra.run.smithi019.stdout: "prometheus_alerts_path": { 2024-09-10T22:37:53.988 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "prometheus_alerts_path", 2024-09-10T22:37:53.988 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-10T22:37:53.988 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:53.989 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-10T22:37:53.989 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2024-09-10T22:37:53.989 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:53.989 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:53.989 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:53.989 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "location of alerts to include in prometheus deployments", 2024-09-10T22:37:53.989 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:53.989 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:53.989 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:53.989 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:53.989 INFO:teuthology.orchestra.run.smithi019.stdout: "registry_insecure": { 2024-09-10T22:37:53.989 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "registry_insecure", 2024-09-10T22:37:53.989 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-10T22:37:53.990 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:53.990 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-10T22:37:53.990 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-10T22:37:53.990 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:53.990 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:53.990 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:53.990 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2024-09-10T22:37:53.990 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:53.990 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:53.990 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:53.990 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:53.990 INFO:teuthology.orchestra.run.smithi019.stdout: "registry_password": { 2024-09-10T22:37:53.990 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "registry_password", 2024-09-10T22:37:53.990 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-10T22:37:53.991 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:53.991 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-10T22:37:53.991 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-10T22:37:53.991 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:53.991 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:53.991 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:53.991 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2024-09-10T22:37:53.991 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:53.991 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:53.991 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:53.991 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:53.991 INFO:teuthology.orchestra.run.smithi019.stdout: "registry_url": { 2024-09-10T22:37:53.992 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "registry_url", 2024-09-10T22:37:53.992 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-10T22:37:53.992 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:53.992 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-10T22:37:53.992 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-10T22:37:53.992 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:53.992 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:53.992 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:53.992 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2024-09-10T22:37:53.992 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:53.992 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:53.992 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:53.992 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:53.993 INFO:teuthology.orchestra.run.smithi019.stdout: "registry_username": { 2024-09-10T22:37:53.993 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "registry_username", 2024-09-10T22:37:53.993 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-10T22:37:53.993 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:53.993 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-10T22:37:53.993 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-10T22:37:53.993 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:53.993 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:53.993 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:53.993 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2024-09-10T22:37:53.993 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:53.993 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:53.993 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:53.994 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:53.994 INFO:teuthology.orchestra.run.smithi019.stdout: "secure_monitoring_stack": { 2024-09-10T22:37:53.994 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "secure_monitoring_stack", 2024-09-10T22:37:53.994 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-10T22:37:53.994 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:53.994 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-10T22:37:53.994 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-10T22:37:53.994 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:53.994 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:53.994 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:53.994 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2024-09-10T22:37:53.994 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:53.994 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:53.994 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:53.995 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:53.995 INFO:teuthology.orchestra.run.smithi019.stdout: "service_discovery_port": { 2024-09-10T22:37:53.995 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "service_discovery_port", 2024-09-10T22:37:53.995 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "int", 2024-09-10T22:37:53.995 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:53.995 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-10T22:37:53.995 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "8765", 2024-09-10T22:37:53.995 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:53.995 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:53.995 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:53.995 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "cephadm service discovery port", 2024-09-10T22:37:53.995 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:53.995 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:53.995 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:53.996 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:53.996 INFO:teuthology.orchestra.run.smithi019.stdout: "sqlite3_killpoint": { 2024-09-10T22:37:53.996 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "sqlite3_killpoint", 2024-09-10T22:37:53.996 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "int", 2024-09-10T22:37:53.996 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "dev", 2024-09-10T22:37:53.996 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:53.996 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "0", 2024-09-10T22:37:53.996 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:53.996 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:53.996 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:53.996 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:53.996 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:53.996 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:53.997 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:53.997 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:53.997 INFO:teuthology.orchestra.run.smithi019.stdout: "ssh_config_file": { 2024-09-10T22:37:53.997 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "ssh_config_file", 2024-09-10T22:37:53.997 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-10T22:37:53.997 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:53.997 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-10T22:37:53.997 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-10T22:37:53.997 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:53.997 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:53.997 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:53.997 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "customized SSH config file to connect to managed hosts", 2024-09-10T22:37:53.997 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:53.998 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:53.998 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:53.998 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:53.998 INFO:teuthology.orchestra.run.smithi019.stdout: "use_agent": { 2024-09-10T22:37:53.998 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "use_agent", 2024-09-10T22:37:53.998 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-10T22:37:53.998 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:53.998 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-10T22:37:53.998 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-10T22:37:53.998 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:53.998 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:53.998 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:53.998 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2024-09-10T22:37:53.999 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:53.999 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:53.999 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:53.999 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:53.999 INFO:teuthology.orchestra.run.smithi019.stdout: "use_repo_digest": { 2024-09-10T22:37:53.999 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "use_repo_digest", 2024-09-10T22:37:53.999 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-10T22:37:53.999 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:53.999 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-10T22:37:53.999 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "True", 2024-09-10T22:37:53.999 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:53.999 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:53.999 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:53.999 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2024-09-10T22:37:54.000 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.000 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.000 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.000 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.000 INFO:teuthology.orchestra.run.smithi019.stdout: "warn_on_failed_host_check": { 2024-09-10T22:37:54.000 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "warn_on_failed_host_check", 2024-09-10T22:37:54.000 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-10T22:37:54.000 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.000 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-10T22:37:54.000 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "True", 2024-09-10T22:37:54.000 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.000 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.000 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.001 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "raise a health warning if the host check fails", 2024-09-10T22:37:54.001 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.001 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.001 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.001 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.001 INFO:teuthology.orchestra.run.smithi019.stdout: "warn_on_stray_daemons": { 2024-09-10T22:37:54.001 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "warn_on_stray_daemons", 2024-09-10T22:37:54.001 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-10T22:37:54.001 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.001 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-10T22:37:54.001 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "True", 2024-09-10T22:37:54.001 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.001 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.001 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.002 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2024-09-10T22:37:54.002 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.002 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.002 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.002 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.002 INFO:teuthology.orchestra.run.smithi019.stdout: "warn_on_stray_hosts": { 2024-09-10T22:37:54.002 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "warn_on_stray_hosts", 2024-09-10T22:37:54.002 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-10T22:37:54.002 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.002 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-10T22:37:54.002 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "True", 2024-09-10T22:37:54.002 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.002 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.003 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.003 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2024-09-10T22:37:54.003 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.003 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.003 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.003 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-10T22:37:54.003 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-10T22:37:54.003 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.003 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-10T22:37:54.003 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "crash", 2024-09-10T22:37:54.003 INFO:teuthology.orchestra.run.smithi019.stdout: "can_run": true, 2024-09-10T22:37:54.003 INFO:teuthology.orchestra.run.smithi019.stdout: "error_string": "", 2024-09-10T22:37:54.003 INFO:teuthology.orchestra.run.smithi019.stdout: "module_options": { 2024-09-10T22:37:54.003 INFO:teuthology.orchestra.run.smithi019.stdout: "log_level": { 2024-09-10T22:37:54.004 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_level", 2024-09-10T22:37:54.004 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-10T22:37:54.004 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.004 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:54.004 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-10T22:37:54.004 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.004 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.004 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-10T22:37:54.004 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-10T22:37:54.004 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-10T22:37:54.004 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-10T22:37:54.004 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-10T22:37:54.004 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-10T22:37:54.004 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-10T22:37:54.005 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-10T22:37:54.005 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:54.005 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.005 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.005 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.005 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.005 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster": { 2024-09-10T22:37:54.005 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster", 2024-09-10T22:37:54.005 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-10T22:37:54.005 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.005 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:54.005 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-10T22:37:54.005 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.006 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.006 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.006 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:54.006 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.006 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.006 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.006 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.006 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster_level": { 2024-09-10T22:37:54.006 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster_level", 2024-09-10T22:37:54.006 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-10T22:37:54.006 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.006 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:54.006 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "info", 2024-09-10T22:37:54.006 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.007 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.007 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-10T22:37:54.007 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-10T22:37:54.007 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-10T22:37:54.007 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-10T22:37:54.007 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-10T22:37:54.007 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-10T22:37:54.007 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-10T22:37:54.007 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-10T22:37:54.007 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:54.007 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.007 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.007 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.008 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.008 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_file": { 2024-09-10T22:37:54.008 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_file", 2024-09-10T22:37:54.008 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-10T22:37:54.008 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.008 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:54.008 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-10T22:37:54.008 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.008 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.008 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.008 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:54.008 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.008 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.008 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.009 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.009 INFO:teuthology.orchestra.run.smithi019.stdout: "retain_interval": { 2024-09-10T22:37:54.009 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "retain_interval", 2024-09-10T22:37:54.009 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "secs", 2024-09-10T22:37:54.009 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.009 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:54.009 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "31536000", 2024-09-10T22:37:54.009 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.009 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.009 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.009 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "how long to retain crashes before pruning them", 2024-09-10T22:37:54.009 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.009 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.010 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.010 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.010 INFO:teuthology.orchestra.run.smithi019.stdout: "sqlite3_killpoint": { 2024-09-10T22:37:54.010 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "sqlite3_killpoint", 2024-09-10T22:37:54.010 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "int", 2024-09-10T22:37:54.010 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "dev", 2024-09-10T22:37:54.010 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:54.010 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "0", 2024-09-10T22:37:54.010 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.010 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.010 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.010 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:54.010 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.010 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.011 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.011 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.011 INFO:teuthology.orchestra.run.smithi019.stdout: "warn_recent_interval": { 2024-09-10T22:37:54.011 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "warn_recent_interval", 2024-09-10T22:37:54.011 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "secs", 2024-09-10T22:37:54.011 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.011 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:54.011 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "1209600", 2024-09-10T22:37:54.011 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.011 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.011 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.011 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "time interval in which to warn about recent crashes", 2024-09-10T22:37:54.011 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.012 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.012 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.012 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-10T22:37:54.012 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-10T22:37:54.012 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.012 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-10T22:37:54.012 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "dashboard", 2024-09-10T22:37:54.012 INFO:teuthology.orchestra.run.smithi019.stdout: "can_run": true, 2024-09-10T22:37:54.012 INFO:teuthology.orchestra.run.smithi019.stdout: "error_string": "", 2024-09-10T22:37:54.012 INFO:teuthology.orchestra.run.smithi019.stdout: "module_options": { 2024-09-10T22:37:54.012 INFO:teuthology.orchestra.run.smithi019.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2024-09-10T22:37:54.012 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2024-09-10T22:37:54.012 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "int", 2024-09-10T22:37:54.013 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.013 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-10T22:37:54.013 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "10", 2024-09-10T22:37:54.013 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.013 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.013 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.013 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:54.013 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.013 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.013 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.013 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.013 INFO:teuthology.orchestra.run.smithi019.stdout: "ALERTMANAGER_API_HOST": { 2024-09-10T22:37:54.013 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "ALERTMANAGER_API_HOST", 2024-09-10T22:37:54.013 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-10T22:37:54.014 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.014 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-10T22:37:54.014 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-10T22:37:54.014 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.014 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.014 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.014 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:54.014 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.014 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.014 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.014 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.014 INFO:teuthology.orchestra.run.smithi019.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2024-09-10T22:37:54.014 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2024-09-10T22:37:54.015 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-10T22:37:54.015 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.015 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-10T22:37:54.015 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "True", 2024-09-10T22:37:54.015 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.015 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.015 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.015 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:54.015 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.015 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.015 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.015 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.015 INFO:teuthology.orchestra.run.smithi019.stdout: "AUDIT_API_ENABLED": { 2024-09-10T22:37:54.015 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "AUDIT_API_ENABLED", 2024-09-10T22:37:54.016 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-10T22:37:54.016 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.016 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-10T22:37:54.016 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-10T22:37:54.016 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.016 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.016 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.016 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:54.016 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.016 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.016 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.016 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.016 INFO:teuthology.orchestra.run.smithi019.stdout: "AUDIT_API_LOG_PAYLOAD": { 2024-09-10T22:37:54.017 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2024-09-10T22:37:54.017 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-10T22:37:54.017 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.017 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-10T22:37:54.017 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "True", 2024-09-10T22:37:54.017 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.017 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.017 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.017 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:54.017 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.017 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.017 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.017 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.017 INFO:teuthology.orchestra.run.smithi019.stdout: "ENABLE_BROWSABLE_API": { 2024-09-10T22:37:54.018 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "ENABLE_BROWSABLE_API", 2024-09-10T22:37:54.018 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-10T22:37:54.018 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.018 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-10T22:37:54.018 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "True", 2024-09-10T22:37:54.018 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.018 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.018 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.018 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:54.018 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.018 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.018 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.018 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.018 INFO:teuthology.orchestra.run.smithi019.stdout: "FEATURE_TOGGLE_CEPHFS": { 2024-09-10T22:37:54.019 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2024-09-10T22:37:54.019 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-10T22:37:54.019 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.019 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-10T22:37:54.019 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "True", 2024-09-10T22:37:54.019 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.019 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.019 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.019 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:54.019 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.019 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.019 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.019 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.020 INFO:teuthology.orchestra.run.smithi019.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2024-09-10T22:37:54.020 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2024-09-10T22:37:54.020 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-10T22:37:54.020 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.020 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-10T22:37:54.020 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "True", 2024-09-10T22:37:54.020 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.020 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.020 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.020 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:54.020 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.020 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.020 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.020 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.021 INFO:teuthology.orchestra.run.smithi019.stdout: "FEATURE_TOGGLE_ISCSI": { 2024-09-10T22:37:54.021 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2024-09-10T22:37:54.021 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-10T22:37:54.021 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.021 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-10T22:37:54.021 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "True", 2024-09-10T22:37:54.021 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.021 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.021 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.021 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:54.021 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.021 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.021 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.021 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.022 INFO:teuthology.orchestra.run.smithi019.stdout: "FEATURE_TOGGLE_MIRRORING": { 2024-09-10T22:37:54.022 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2024-09-10T22:37:54.022 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-10T22:37:54.022 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.022 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-10T22:37:54.022 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "True", 2024-09-10T22:37:54.022 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.022 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.022 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.022 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:54.022 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.022 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.022 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.023 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.023 INFO:teuthology.orchestra.run.smithi019.stdout: "FEATURE_TOGGLE_NFS": { 2024-09-10T22:37:54.023 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "FEATURE_TOGGLE_NFS", 2024-09-10T22:37:54.023 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-10T22:37:54.023 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.023 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-10T22:37:54.023 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "True", 2024-09-10T22:37:54.023 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.023 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.023 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.023 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:54.023 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.023 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.023 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.024 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.024 INFO:teuthology.orchestra.run.smithi019.stdout: "FEATURE_TOGGLE_RBD": { 2024-09-10T22:37:54.024 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "FEATURE_TOGGLE_RBD", 2024-09-10T22:37:54.024 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-10T22:37:54.024 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.024 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-10T22:37:54.024 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "True", 2024-09-10T22:37:54.024 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.024 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.024 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.024 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:54.024 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.024 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.025 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.025 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.025 INFO:teuthology.orchestra.run.smithi019.stdout: "FEATURE_TOGGLE_RGW": { 2024-09-10T22:37:54.025 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "FEATURE_TOGGLE_RGW", 2024-09-10T22:37:54.025 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-10T22:37:54.025 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.025 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-10T22:37:54.025 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "True", 2024-09-10T22:37:54.025 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.025 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.025 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.025 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:54.025 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.026 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.026 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.026 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.026 INFO:teuthology.orchestra.run.smithi019.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2024-09-10T22:37:54.026 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2024-09-10T22:37:54.026 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-10T22:37:54.026 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.026 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-10T22:37:54.026 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-10T22:37:54.026 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.026 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.026 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.026 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:54.026 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.027 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.027 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.027 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.027 INFO:teuthology.orchestra.run.smithi019.stdout: "GRAFANA_API_PASSWORD": { 2024-09-10T22:37:54.027 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "GRAFANA_API_PASSWORD", 2024-09-10T22:37:54.027 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-10T22:37:54.027 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.027 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-10T22:37:54.027 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "admin", 2024-09-10T22:37:54.027 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.027 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.027 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.027 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:54.027 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.028 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.028 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.028 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.028 INFO:teuthology.orchestra.run.smithi019.stdout: "GRAFANA_API_SSL_VERIFY": { 2024-09-10T22:37:54.028 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2024-09-10T22:37:54.028 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-10T22:37:54.028 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.028 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-10T22:37:54.028 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "True", 2024-09-10T22:37:54.028 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.028 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.028 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.028 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:54.029 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.029 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.029 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.029 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.029 INFO:teuthology.orchestra.run.smithi019.stdout: "GRAFANA_API_URL": { 2024-09-10T22:37:54.029 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "GRAFANA_API_URL", 2024-09-10T22:37:54.029 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-10T22:37:54.029 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.029 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-10T22:37:54.029 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-10T22:37:54.029 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.029 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.029 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.029 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:54.030 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.030 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.030 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.030 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.030 INFO:teuthology.orchestra.run.smithi019.stdout: "GRAFANA_API_USERNAME": { 2024-09-10T22:37:54.030 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "GRAFANA_API_USERNAME", 2024-09-10T22:37:54.030 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-10T22:37:54.030 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.030 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-10T22:37:54.030 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "admin", 2024-09-10T22:37:54.030 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.030 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.030 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.031 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:54.031 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.031 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.031 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.031 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.031 INFO:teuthology.orchestra.run.smithi019.stdout: "GRAFANA_FRONTEND_API_URL": { 2024-09-10T22:37:54.031 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2024-09-10T22:37:54.031 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-10T22:37:54.031 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.031 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-10T22:37:54.031 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-10T22:37:54.031 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.031 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.031 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.032 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:54.032 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.032 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.032 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.032 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.032 INFO:teuthology.orchestra.run.smithi019.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2024-09-10T22:37:54.032 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2024-09-10T22:37:54.032 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-10T22:37:54.032 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.032 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-10T22:37:54.032 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-10T22:37:54.032 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.032 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.033 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.033 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:54.033 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.033 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.033 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.033 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.033 INFO:teuthology.orchestra.run.smithi019.stdout: "ISCSI_API_SSL_VERIFICATION": { 2024-09-10T22:37:54.033 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2024-09-10T22:37:54.033 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-10T22:37:54.033 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.033 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-10T22:37:54.033 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "True", 2024-09-10T22:37:54.033 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.033 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.034 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.034 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:54.034 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.034 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.034 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.034 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.034 INFO:teuthology.orchestra.run.smithi019.stdout: "ISSUE_TRACKER_API_KEY": { 2024-09-10T22:37:54.034 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "ISSUE_TRACKER_API_KEY", 2024-09-10T22:37:54.034 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-10T22:37:54.034 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.034 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-10T22:37:54.034 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-10T22:37:54.034 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.034 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.035 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.035 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:54.035 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.035 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.035 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.035 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.035 INFO:teuthology.orchestra.run.smithi019.stdout: "MANAGED_BY_CLUSTERS": { 2024-09-10T22:37:54.035 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "MANAGED_BY_CLUSTERS", 2024-09-10T22:37:54.035 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-10T22:37:54.035 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.035 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-10T22:37:54.035 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "[]", 2024-09-10T22:37:54.035 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.036 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.036 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.036 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:54.036 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.036 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.036 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.036 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.036 INFO:teuthology.orchestra.run.smithi019.stdout: "MULTICLUSTER_CONFIG": { 2024-09-10T22:37:54.036 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "MULTICLUSTER_CONFIG", 2024-09-10T22:37:54.036 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-10T22:37:54.036 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.036 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-10T22:37:54.036 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "{}", 2024-09-10T22:37:54.036 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.037 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.037 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.037 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:54.037 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.037 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.037 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.037 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.037 INFO:teuthology.orchestra.run.smithi019.stdout: "PROMETHEUS_API_HOST": { 2024-09-10T22:37:54.037 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "PROMETHEUS_API_HOST", 2024-09-10T22:37:54.037 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-10T22:37:54.037 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.037 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-10T22:37:54.037 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-10T22:37:54.038 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.038 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.038 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.038 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:54.038 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.038 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.038 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.038 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.038 INFO:teuthology.orchestra.run.smithi019.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2024-09-10T22:37:54.038 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2024-09-10T22:37:54.038 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-10T22:37:54.038 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.038 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-10T22:37:54.039 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "True", 2024-09-10T22:37:54.039 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.039 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.039 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.039 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:54.039 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.039 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.039 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.039 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.039 INFO:teuthology.orchestra.run.smithi019.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2024-09-10T22:37:54.039 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2024-09-10T22:37:54.039 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-10T22:37:54.039 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.040 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-10T22:37:54.040 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-10T22:37:54.040 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.040 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.040 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.040 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:54.040 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.040 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.040 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.040 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.040 INFO:teuthology.orchestra.run.smithi019.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2024-09-10T22:37:54.040 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2024-09-10T22:37:54.040 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-10T22:37:54.041 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.041 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-10T22:37:54.041 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-10T22:37:54.041 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.041 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.041 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.041 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:54.041 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.041 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.041 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.041 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.041 INFO:teuthology.orchestra.run.smithi019.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2024-09-10T22:37:54.041 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2024-09-10T22:37:54.041 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-10T22:37:54.042 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.042 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-10T22:37:54.042 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "True", 2024-09-10T22:37:54.042 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.042 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.042 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.042 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:54.042 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.042 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.042 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.042 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.042 INFO:teuthology.orchestra.run.smithi019.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2024-09-10T22:37:54.043 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2024-09-10T22:37:54.043 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-10T22:37:54.043 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.043 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-10T22:37:54.043 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "True", 2024-09-10T22:37:54.043 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.043 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.043 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.043 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:54.043 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.043 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.043 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.043 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.044 INFO:teuthology.orchestra.run.smithi019.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2024-09-10T22:37:54.044 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2024-09-10T22:37:54.044 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-10T22:37:54.044 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.044 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-10T22:37:54.044 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-10T22:37:54.044 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.044 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.044 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.044 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:54.044 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.044 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.044 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.045 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.045 INFO:teuthology.orchestra.run.smithi019.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2024-09-10T22:37:54.045 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2024-09-10T22:37:54.045 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-10T22:37:54.045 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.045 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-10T22:37:54.045 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-10T22:37:54.045 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.045 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.045 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.045 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:54.045 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.045 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.046 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.046 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.046 INFO:teuthology.orchestra.run.smithi019.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2024-09-10T22:37:54.046 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2024-09-10T22:37:54.046 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-10T22:37:54.046 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.046 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-10T22:37:54.046 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-10T22:37:54.046 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.046 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.046 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.046 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:54.046 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.046 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.047 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.047 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.047 INFO:teuthology.orchestra.run.smithi019.stdout: "PWD_POLICY_ENABLED": { 2024-09-10T22:37:54.047 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "PWD_POLICY_ENABLED", 2024-09-10T22:37:54.047 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-10T22:37:54.047 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.047 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-10T22:37:54.047 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "True", 2024-09-10T22:37:54.047 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.047 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.047 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.047 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:54.047 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.048 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.048 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.048 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.048 INFO:teuthology.orchestra.run.smithi019.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2024-09-10T22:37:54.048 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2024-09-10T22:37:54.048 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-10T22:37:54.048 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.048 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-10T22:37:54.048 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2024-09-10T22:37:54.048 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.048 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.048 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.048 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:54.049 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.049 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.049 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.049 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.049 INFO:teuthology.orchestra.run.smithi019.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2024-09-10T22:37:54.049 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2024-09-10T22:37:54.049 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "int", 2024-09-10T22:37:54.049 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.049 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-10T22:37:54.049 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "10", 2024-09-10T22:37:54.049 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.049 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.049 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.050 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:54.050 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.050 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.050 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.050 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.050 INFO:teuthology.orchestra.run.smithi019.stdout: "PWD_POLICY_MIN_LENGTH": { 2024-09-10T22:37:54.050 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2024-09-10T22:37:54.050 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "int", 2024-09-10T22:37:54.050 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.050 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-10T22:37:54.050 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "8", 2024-09-10T22:37:54.050 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.050 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.051 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.051 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:54.051 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.051 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.051 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.051 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.051 INFO:teuthology.orchestra.run.smithi019.stdout: "REST_REQUESTS_TIMEOUT": { 2024-09-10T22:37:54.051 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "REST_REQUESTS_TIMEOUT", 2024-09-10T22:37:54.051 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "int", 2024-09-10T22:37:54.051 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.051 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-10T22:37:54.051 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "45", 2024-09-10T22:37:54.051 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.051 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.052 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.052 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:54.052 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.052 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.052 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.052 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.052 INFO:teuthology.orchestra.run.smithi019.stdout: "RGW_API_ACCESS_KEY": { 2024-09-10T22:37:54.052 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "RGW_API_ACCESS_KEY", 2024-09-10T22:37:54.052 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-10T22:37:54.052 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.052 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-10T22:37:54.053 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-10T22:37:54.053 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.053 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.053 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.053 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:54.053 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.053 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.053 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.053 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.053 INFO:teuthology.orchestra.run.smithi019.stdout: "RGW_API_ADMIN_RESOURCE": { 2024-09-10T22:37:54.053 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2024-09-10T22:37:54.053 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-10T22:37:54.053 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.054 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-10T22:37:54.054 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "admin", 2024-09-10T22:37:54.054 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.054 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.054 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.054 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:54.054 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.054 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.054 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.054 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.054 INFO:teuthology.orchestra.run.smithi019.stdout: "RGW_API_SECRET_KEY": { 2024-09-10T22:37:54.054 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "RGW_API_SECRET_KEY", 2024-09-10T22:37:54.054 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-10T22:37:54.054 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.055 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-10T22:37:54.055 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-10T22:37:54.055 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.055 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.055 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.055 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:54.055 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.055 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.055 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.055 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.055 INFO:teuthology.orchestra.run.smithi019.stdout: "RGW_API_SSL_VERIFY": { 2024-09-10T22:37:54.055 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "RGW_API_SSL_VERIFY", 2024-09-10T22:37:54.055 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-10T22:37:54.056 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.056 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-10T22:37:54.056 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "True", 2024-09-10T22:37:54.056 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.056 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.056 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.056 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:54.056 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.056 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.056 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.056 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.056 INFO:teuthology.orchestra.run.smithi019.stdout: "UNSAFE_TLS_v1_2": { 2024-09-10T22:37:54.056 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "UNSAFE_TLS_v1_2", 2024-09-10T22:37:54.057 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-10T22:37:54.057 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.057 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-10T22:37:54.057 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-10T22:37:54.057 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.057 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.057 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.057 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:54.057 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.057 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.057 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.057 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.057 INFO:teuthology.orchestra.run.smithi019.stdout: "USER_PWD_EXPIRATION_SPAN": { 2024-09-10T22:37:54.058 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2024-09-10T22:37:54.058 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "int", 2024-09-10T22:37:54.058 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.058 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-10T22:37:54.058 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "0", 2024-09-10T22:37:54.058 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.058 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.058 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.058 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:54.058 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.058 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.058 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.058 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.059 INFO:teuthology.orchestra.run.smithi019.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2024-09-10T22:37:54.059 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2024-09-10T22:37:54.059 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "int", 2024-09-10T22:37:54.059 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.059 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-10T22:37:54.059 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "10", 2024-09-10T22:37:54.059 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.059 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.059 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.059 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:54.059 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.059 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.059 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.059 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.060 INFO:teuthology.orchestra.run.smithi019.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2024-09-10T22:37:54.060 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2024-09-10T22:37:54.060 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "int", 2024-09-10T22:37:54.060 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.060 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-10T22:37:54.060 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "5", 2024-09-10T22:37:54.060 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.060 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.060 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.060 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:54.060 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.060 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.060 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.061 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.061 INFO:teuthology.orchestra.run.smithi019.stdout: "cross_origin_url": { 2024-09-10T22:37:54.061 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "cross_origin_url", 2024-09-10T22:37:54.061 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-10T22:37:54.061 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.061 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-10T22:37:54.061 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-10T22:37:54.061 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.061 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.061 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.061 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:54.061 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.061 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.062 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.062 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.062 INFO:teuthology.orchestra.run.smithi019.stdout: "crt_file": { 2024-09-10T22:37:54.062 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "crt_file", 2024-09-10T22:37:54.062 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-10T22:37:54.062 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.062 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-10T22:37:54.062 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-10T22:37:54.062 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.062 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.062 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.062 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:54.062 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.062 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.063 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.063 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.063 INFO:teuthology.orchestra.run.smithi019.stdout: "debug": { 2024-09-10T22:37:54.063 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "debug", 2024-09-10T22:37:54.063 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-10T22:37:54.063 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.063 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-10T22:37:54.063 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-10T22:37:54.063 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.063 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.063 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.063 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "Enable/disable debug options", 2024-09-10T22:37:54.063 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.064 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.064 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.064 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.064 INFO:teuthology.orchestra.run.smithi019.stdout: "jwt_token_ttl": { 2024-09-10T22:37:54.064 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "jwt_token_ttl", 2024-09-10T22:37:54.064 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "int", 2024-09-10T22:37:54.064 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.064 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-10T22:37:54.064 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "28800", 2024-09-10T22:37:54.064 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.064 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.064 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.064 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:54.065 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.065 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.065 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.065 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.065 INFO:teuthology.orchestra.run.smithi019.stdout: "key_file": { 2024-09-10T22:37:54.065 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "key_file", 2024-09-10T22:37:54.065 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-10T22:37:54.065 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.065 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-10T22:37:54.065 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-10T22:37:54.065 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.065 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.065 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.066 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:54.066 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.066 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.066 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.066 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.066 INFO:teuthology.orchestra.run.smithi019.stdout: "log_level": { 2024-09-10T22:37:54.066 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_level", 2024-09-10T22:37:54.066 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-10T22:37:54.066 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.066 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:54.066 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-10T22:37:54.066 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.066 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.067 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-10T22:37:54.067 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-10T22:37:54.067 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-10T22:37:54.067 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-10T22:37:54.067 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-10T22:37:54.067 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-10T22:37:54.067 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-10T22:37:54.067 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-10T22:37:54.067 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:54.067 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.067 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.067 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.067 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.068 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster": { 2024-09-10T22:37:54.068 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster", 2024-09-10T22:37:54.068 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-10T22:37:54.068 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.068 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:54.068 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-10T22:37:54.068 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.068 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.068 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.068 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:54.068 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.068 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.068 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.069 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.069 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster_level": { 2024-09-10T22:37:54.069 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster_level", 2024-09-10T22:37:54.069 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-10T22:37:54.069 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.069 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:54.069 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "info", 2024-09-10T22:37:54.069 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.069 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.069 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-10T22:37:54.069 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-10T22:37:54.069 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-10T22:37:54.069 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-10T22:37:54.070 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-10T22:37:54.070 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-10T22:37:54.070 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-10T22:37:54.070 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-10T22:37:54.070 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:54.070 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.070 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.070 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.070 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.070 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_file": { 2024-09-10T22:37:54.070 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_file", 2024-09-10T22:37:54.070 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-10T22:37:54.070 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.070 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:54.071 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-10T22:37:54.071 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.071 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.071 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.071 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:54.071 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.071 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.071 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.071 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.071 INFO:teuthology.orchestra.run.smithi019.stdout: "motd": { 2024-09-10T22:37:54.071 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "motd", 2024-09-10T22:37:54.071 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-10T22:37:54.071 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.072 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-10T22:37:54.072 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-10T22:37:54.072 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.072 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.072 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.072 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "The message of the day", 2024-09-10T22:37:54.072 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.072 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.072 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.072 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.072 INFO:teuthology.orchestra.run.smithi019.stdout: "redirect_resolve_ip_addr": { 2024-09-10T22:37:54.072 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "redirect_resolve_ip_addr", 2024-09-10T22:37:54.073 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-10T22:37:54.073 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.073 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-10T22:37:54.073 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-10T22:37:54.073 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.073 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.073 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.073 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:54.073 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.073 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.073 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.073 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.073 INFO:teuthology.orchestra.run.smithi019.stdout: "server_addr": { 2024-09-10T22:37:54.074 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "server_addr", 2024-09-10T22:37:54.074 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-10T22:37:54.074 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.074 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-10T22:37:54.074 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "::", 2024-09-10T22:37:54.074 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.074 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.074 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.074 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:54.074 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.074 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.074 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.074 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.075 INFO:teuthology.orchestra.run.smithi019.stdout: "server_port": { 2024-09-10T22:37:54.075 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "server_port", 2024-09-10T22:37:54.075 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "int", 2024-09-10T22:37:54.075 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.075 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-10T22:37:54.075 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "8080", 2024-09-10T22:37:54.075 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.075 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.075 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.075 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:54.075 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.075 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.075 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.075 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.076 INFO:teuthology.orchestra.run.smithi019.stdout: "sqlite3_killpoint": { 2024-09-10T22:37:54.076 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "sqlite3_killpoint", 2024-09-10T22:37:54.076 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "int", 2024-09-10T22:37:54.076 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "dev", 2024-09-10T22:37:54.076 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:54.076 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "0", 2024-09-10T22:37:54.076 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.076 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.076 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.076 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:54.076 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.076 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.076 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.077 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.077 INFO:teuthology.orchestra.run.smithi019.stdout: "ssl": { 2024-09-10T22:37:54.077 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "ssl", 2024-09-10T22:37:54.077 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-10T22:37:54.077 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.077 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-10T22:37:54.077 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "True", 2024-09-10T22:37:54.077 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.077 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.077 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.077 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:54.077 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.077 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.078 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.078 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.078 INFO:teuthology.orchestra.run.smithi019.stdout: "ssl_server_port": { 2024-09-10T22:37:54.078 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "ssl_server_port", 2024-09-10T22:37:54.078 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "int", 2024-09-10T22:37:54.078 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.078 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-10T22:37:54.078 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "8443", 2024-09-10T22:37:54.078 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.078 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.078 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.078 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:54.078 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.078 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.079 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.079 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.079 INFO:teuthology.orchestra.run.smithi019.stdout: "standby_behaviour": { 2024-09-10T22:37:54.079 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "standby_behaviour", 2024-09-10T22:37:54.079 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-10T22:37:54.079 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.079 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-10T22:37:54.079 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "redirect", 2024-09-10T22:37:54.079 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.079 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.079 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-10T22:37:54.079 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-10T22:37:54.079 INFO:teuthology.orchestra.run.smithi019.stdout: "redirect" 2024-09-10T22:37:54.080 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-10T22:37:54.080 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:54.080 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.080 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.080 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.080 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.080 INFO:teuthology.orchestra.run.smithi019.stdout: "standby_error_status_code": { 2024-09-10T22:37:54.080 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "standby_error_status_code", 2024-09-10T22:37:54.080 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "int", 2024-09-10T22:37:54.080 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.080 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-10T22:37:54.080 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "500", 2024-09-10T22:37:54.080 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "400", 2024-09-10T22:37:54.081 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "599", 2024-09-10T22:37:54.081 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.081 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:54.081 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.081 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.081 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.081 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.081 INFO:teuthology.orchestra.run.smithi019.stdout: "url_prefix": { 2024-09-10T22:37:54.081 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "url_prefix", 2024-09-10T22:37:54.081 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-10T22:37:54.081 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.081 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-10T22:37:54.082 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-10T22:37:54.082 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.082 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.082 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.082 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:54.082 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.082 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.082 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.082 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-10T22:37:54.082 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-10T22:37:54.082 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.082 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-10T22:37:54.082 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "devicehealth", 2024-09-10T22:37:54.083 INFO:teuthology.orchestra.run.smithi019.stdout: "can_run": true, 2024-09-10T22:37:54.083 INFO:teuthology.orchestra.run.smithi019.stdout: "error_string": "", 2024-09-10T22:37:54.083 INFO:teuthology.orchestra.run.smithi019.stdout: "module_options": { 2024-09-10T22:37:54.083 INFO:teuthology.orchestra.run.smithi019.stdout: "enable_monitoring": { 2024-09-10T22:37:54.083 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "enable_monitoring", 2024-09-10T22:37:54.083 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-10T22:37:54.083 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.083 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:54.083 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "True", 2024-09-10T22:37:54.083 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.083 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.083 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.083 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "monitor device health metrics", 2024-09-10T22:37:54.084 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.084 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.084 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.084 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.084 INFO:teuthology.orchestra.run.smithi019.stdout: "log_level": { 2024-09-10T22:37:54.084 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_level", 2024-09-10T22:37:54.084 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-10T22:37:54.084 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.084 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:54.084 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-10T22:37:54.084 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.084 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.084 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-10T22:37:54.085 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-10T22:37:54.085 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-10T22:37:54.085 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-10T22:37:54.085 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-10T22:37:54.085 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-10T22:37:54.085 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-10T22:37:54.085 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-10T22:37:54.085 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:54.085 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.085 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.085 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.085 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.085 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster": { 2024-09-10T22:37:54.086 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster", 2024-09-10T22:37:54.086 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-10T22:37:54.086 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.086 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:54.086 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-10T22:37:54.086 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.086 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.086 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.086 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:54.086 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.086 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.086 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.087 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.087 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster_level": { 2024-09-10T22:37:54.087 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster_level", 2024-09-10T22:37:54.087 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-10T22:37:54.087 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.087 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:54.087 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "info", 2024-09-10T22:37:54.087 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.087 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.087 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-10T22:37:54.087 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-10T22:37:54.087 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-10T22:37:54.087 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-10T22:37:54.088 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-10T22:37:54.088 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-10T22:37:54.088 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-10T22:37:54.088 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-10T22:37:54.088 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:54.088 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.088 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.088 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.088 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.088 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_file": { 2024-09-10T22:37:54.088 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_file", 2024-09-10T22:37:54.088 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-10T22:37:54.088 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.088 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:54.089 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-10T22:37:54.089 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.089 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.089 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.089 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:54.089 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.089 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.089 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.089 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.089 INFO:teuthology.orchestra.run.smithi019.stdout: "mark_out_threshold": { 2024-09-10T22:37:54.089 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "mark_out_threshold", 2024-09-10T22:37:54.089 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "secs", 2024-09-10T22:37:54.089 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.090 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:54.090 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "2419200", 2024-09-10T22:37:54.090 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.090 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.090 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.090 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "automatically mark OSD if it may fail before this long", 2024-09-10T22:37:54.090 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.090 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.090 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.090 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.090 INFO:teuthology.orchestra.run.smithi019.stdout: "pool_name": { 2024-09-10T22:37:54.090 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "pool_name", 2024-09-10T22:37:54.090 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-10T22:37:54.091 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.091 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:54.091 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "device_health_metrics", 2024-09-10T22:37:54.091 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.091 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.091 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.091 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "name of pool in which to store device health metrics", 2024-09-10T22:37:54.091 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.091 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.091 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.091 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.091 INFO:teuthology.orchestra.run.smithi019.stdout: "retention_period": { 2024-09-10T22:37:54.091 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "retention_period", 2024-09-10T22:37:54.092 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "secs", 2024-09-10T22:37:54.092 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.092 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:54.092 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "15552000", 2024-09-10T22:37:54.092 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.092 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.092 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.092 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "how long to retain device health metrics", 2024-09-10T22:37:54.092 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.092 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.092 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.092 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.092 INFO:teuthology.orchestra.run.smithi019.stdout: "scrape_frequency": { 2024-09-10T22:37:54.092 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "scrape_frequency", 2024-09-10T22:37:54.093 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "secs", 2024-09-10T22:37:54.093 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.093 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:54.093 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "86400", 2024-09-10T22:37:54.093 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.093 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.093 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.093 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "how frequently to scrape device health metrics", 2024-09-10T22:37:54.093 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.093 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.093 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.093 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.094 INFO:teuthology.orchestra.run.smithi019.stdout: "self_heal": { 2024-09-10T22:37:54.094 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "self_heal", 2024-09-10T22:37:54.094 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-10T22:37:54.094 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.094 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:54.094 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "True", 2024-09-10T22:37:54.094 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.094 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.094 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.094 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "preemptively heal cluster around devices that may fail", 2024-09-10T22:37:54.094 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.094 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.094 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.095 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.095 INFO:teuthology.orchestra.run.smithi019.stdout: "sleep_interval": { 2024-09-10T22:37:54.095 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "sleep_interval", 2024-09-10T22:37:54.095 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "secs", 2024-09-10T22:37:54.095 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.095 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:54.095 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "600", 2024-09-10T22:37:54.095 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.095 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.095 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.095 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "how frequently to wake up and check device health", 2024-09-10T22:37:54.095 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.095 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.096 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.096 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.096 INFO:teuthology.orchestra.run.smithi019.stdout: "sqlite3_killpoint": { 2024-09-10T22:37:54.096 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "sqlite3_killpoint", 2024-09-10T22:37:54.096 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "int", 2024-09-10T22:37:54.096 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "dev", 2024-09-10T22:37:54.096 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:54.096 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "0", 2024-09-10T22:37:54.096 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.096 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.096 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.096 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:54.097 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.097 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.097 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.097 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.097 INFO:teuthology.orchestra.run.smithi019.stdout: "warn_threshold": { 2024-09-10T22:37:54.097 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "warn_threshold", 2024-09-10T22:37:54.097 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "secs", 2024-09-10T22:37:54.097 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.097 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:54.097 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "7257600", 2024-09-10T22:37:54.097 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.097 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.097 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.097 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "raise health warning if OSD may fail before this long", 2024-09-10T22:37:54.098 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.098 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.098 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.098 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-10T22:37:54.098 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-10T22:37:54.098 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.098 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-10T22:37:54.098 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "diskprediction_local", 2024-09-10T22:37:54.098 INFO:teuthology.orchestra.run.smithi019.stdout: "can_run": true, 2024-09-10T22:37:54.098 INFO:teuthology.orchestra.run.smithi019.stdout: "error_string": "", 2024-09-10T22:37:54.098 INFO:teuthology.orchestra.run.smithi019.stdout: "module_options": { 2024-09-10T22:37:54.098 INFO:teuthology.orchestra.run.smithi019.stdout: "log_level": { 2024-09-10T22:37:54.098 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_level", 2024-09-10T22:37:54.099 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-10T22:37:54.099 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.099 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:54.099 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-10T22:37:54.099 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.099 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.099 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-10T22:37:54.099 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-10T22:37:54.099 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-10T22:37:54.099 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-10T22:37:54.099 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-10T22:37:54.099 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-10T22:37:54.099 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-10T22:37:54.099 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-10T22:37:54.100 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:54.100 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.100 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.100 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.100 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.100 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster": { 2024-09-10T22:37:54.100 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster", 2024-09-10T22:37:54.100 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-10T22:37:54.100 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.100 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:54.100 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-10T22:37:54.100 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.100 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.101 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.101 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:54.101 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.101 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.101 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.101 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.101 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster_level": { 2024-09-10T22:37:54.101 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster_level", 2024-09-10T22:37:54.101 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-10T22:37:54.101 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.101 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:54.101 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "info", 2024-09-10T22:37:54.101 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.101 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.102 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-10T22:37:54.102 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-10T22:37:54.102 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-10T22:37:54.102 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-10T22:37:54.102 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-10T22:37:54.102 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-10T22:37:54.102 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-10T22:37:54.102 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-10T22:37:54.102 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:54.102 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.102 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.102 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.102 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.103 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_file": { 2024-09-10T22:37:54.103 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_file", 2024-09-10T22:37:54.103 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-10T22:37:54.103 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.103 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:54.103 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-10T22:37:54.103 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.103 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.103 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.103 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:54.103 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.103 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.103 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.104 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.104 INFO:teuthology.orchestra.run.smithi019.stdout: "predict_interval": { 2024-09-10T22:37:54.104 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "predict_interval", 2024-09-10T22:37:54.104 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-10T22:37:54.104 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.104 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-10T22:37:54.104 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "86400", 2024-09-10T22:37:54.104 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.104 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.104 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.104 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:54.104 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.104 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.105 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.105 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.105 INFO:teuthology.orchestra.run.smithi019.stdout: "predictor_model": { 2024-09-10T22:37:54.105 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "predictor_model", 2024-09-10T22:37:54.105 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-10T22:37:54.105 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.105 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-10T22:37:54.105 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "prophetstor", 2024-09-10T22:37:54.105 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.105 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.105 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.105 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:54.105 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.106 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.106 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.106 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.106 INFO:teuthology.orchestra.run.smithi019.stdout: "sleep_interval": { 2024-09-10T22:37:54.106 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "sleep_interval", 2024-09-10T22:37:54.106 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-10T22:37:54.106 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.106 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-10T22:37:54.106 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "600", 2024-09-10T22:37:54.106 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.106 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.106 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.106 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:54.107 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.107 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.107 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.107 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.107 INFO:teuthology.orchestra.run.smithi019.stdout: "sqlite3_killpoint": { 2024-09-10T22:37:54.107 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "sqlite3_killpoint", 2024-09-10T22:37:54.107 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "int", 2024-09-10T22:37:54.107 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "dev", 2024-09-10T22:37:54.107 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:54.107 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "0", 2024-09-10T22:37:54.107 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.107 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.107 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.108 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:54.108 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.108 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.108 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.108 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-10T22:37:54.108 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-10T22:37:54.108 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.108 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-10T22:37:54.108 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "influx", 2024-09-10T22:37:54.108 INFO:teuthology.orchestra.run.smithi019.stdout: "can_run": false, 2024-09-10T22:37:54.108 INFO:teuthology.orchestra.run.smithi019.stdout: "error_string": "influxdb python module not found", 2024-09-10T22:37:54.108 INFO:teuthology.orchestra.run.smithi019.stdout: "module_options": { 2024-09-10T22:37:54.108 INFO:teuthology.orchestra.run.smithi019.stdout: "batch_size": { 2024-09-10T22:37:54.109 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "batch_size", 2024-09-10T22:37:54.109 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "int", 2024-09-10T22:37:54.109 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.109 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-10T22:37:54.109 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "5000", 2024-09-10T22:37:54.109 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.109 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.109 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.109 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2024-09-10T22:37:54.109 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.109 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.109 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.109 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.110 INFO:teuthology.orchestra.run.smithi019.stdout: "database": { 2024-09-10T22:37:54.110 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "database", 2024-09-10T22:37:54.110 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-10T22:37:54.110 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.110 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-10T22:37:54.110 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "ceph", 2024-09-10T22:37:54.110 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.110 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.110 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.110 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2024-09-10T22:37:54.110 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.110 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.111 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.111 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.111 INFO:teuthology.orchestra.run.smithi019.stdout: "hostname": { 2024-09-10T22:37:54.111 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "hostname", 2024-09-10T22:37:54.111 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-10T22:37:54.111 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.111 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-10T22:37:54.111 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-10T22:37:54.111 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.111 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.111 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.111 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "InfluxDB server hostname", 2024-09-10T22:37:54.112 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.112 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.112 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.112 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.112 INFO:teuthology.orchestra.run.smithi019.stdout: "interval": { 2024-09-10T22:37:54.112 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "interval", 2024-09-10T22:37:54.112 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "secs", 2024-09-10T22:37:54.112 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.112 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-10T22:37:54.112 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "30", 2024-09-10T22:37:54.112 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "5", 2024-09-10T22:37:54.112 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.112 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.113 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2024-09-10T22:37:54.113 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.113 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.113 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.113 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.113 INFO:teuthology.orchestra.run.smithi019.stdout: "log_level": { 2024-09-10T22:37:54.113 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_level", 2024-09-10T22:37:54.113 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-10T22:37:54.113 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.113 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:54.113 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-10T22:37:54.113 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.113 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.114 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-10T22:37:54.114 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-10T22:37:54.114 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-10T22:37:54.114 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-10T22:37:54.114 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-10T22:37:54.114 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-10T22:37:54.114 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-10T22:37:54.114 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-10T22:37:54.114 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:54.114 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.114 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.114 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.114 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.115 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster": { 2024-09-10T22:37:54.115 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster", 2024-09-10T22:37:54.115 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-10T22:37:54.115 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.115 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:54.115 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-10T22:37:54.115 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.115 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.115 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.115 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:54.115 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.115 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.115 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.116 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.116 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster_level": { 2024-09-10T22:37:54.116 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster_level", 2024-09-10T22:37:54.116 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-10T22:37:54.116 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.116 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:54.116 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "info", 2024-09-10T22:37:54.116 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.116 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.116 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-10T22:37:54.116 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-10T22:37:54.116 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-10T22:37:54.117 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-10T22:37:54.117 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-10T22:37:54.117 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-10T22:37:54.117 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-10T22:37:54.117 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-10T22:37:54.117 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:54.117 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.117 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.117 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.117 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.117 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_file": { 2024-09-10T22:37:54.117 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_file", 2024-09-10T22:37:54.117 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-10T22:37:54.117 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.118 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:54.118 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-10T22:37:54.118 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.118 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.118 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.118 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:54.118 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.118 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.118 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.118 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.118 INFO:teuthology.orchestra.run.smithi019.stdout: "password": { 2024-09-10T22:37:54.118 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "password", 2024-09-10T22:37:54.118 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-10T22:37:54.118 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.118 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-10T22:37:54.119 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-10T22:37:54.119 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.119 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.119 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.119 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "password of InfluxDB server user", 2024-09-10T22:37:54.119 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.119 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.119 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.119 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.119 INFO:teuthology.orchestra.run.smithi019.stdout: "port": { 2024-09-10T22:37:54.119 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "port", 2024-09-10T22:37:54.119 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "int", 2024-09-10T22:37:54.119 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.119 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-10T22:37:54.119 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "8086", 2024-09-10T22:37:54.120 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.120 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.120 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.120 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "InfluxDB server port", 2024-09-10T22:37:54.120 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.120 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.120 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.120 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.120 INFO:teuthology.orchestra.run.smithi019.stdout: "sqlite3_killpoint": { 2024-09-10T22:37:54.120 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "sqlite3_killpoint", 2024-09-10T22:37:54.120 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "int", 2024-09-10T22:37:54.120 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "dev", 2024-09-10T22:37:54.120 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:54.120 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "0", 2024-09-10T22:37:54.121 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.121 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.121 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.121 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:54.121 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.121 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.121 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.121 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.121 INFO:teuthology.orchestra.run.smithi019.stdout: "ssl": { 2024-09-10T22:37:54.121 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "ssl", 2024-09-10T22:37:54.121 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-10T22:37:54.121 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.121 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-10T22:37:54.122 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "false", 2024-09-10T22:37:54.122 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.122 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.122 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.122 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2024-09-10T22:37:54.122 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.122 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.122 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.122 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.122 INFO:teuthology.orchestra.run.smithi019.stdout: "threads": { 2024-09-10T22:37:54.122 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "threads", 2024-09-10T22:37:54.122 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "int", 2024-09-10T22:37:54.122 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.122 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-10T22:37:54.122 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "5", 2024-09-10T22:37:54.123 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "1", 2024-09-10T22:37:54.123 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "32", 2024-09-10T22:37:54.123 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.123 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2024-09-10T22:37:54.123 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.123 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.123 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.123 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.123 INFO:teuthology.orchestra.run.smithi019.stdout: "username": { 2024-09-10T22:37:54.123 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "username", 2024-09-10T22:37:54.123 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-10T22:37:54.123 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.123 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-10T22:37:54.123 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-10T22:37:54.123 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.124 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.124 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.124 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "username of InfluxDB server user", 2024-09-10T22:37:54.124 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.124 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.124 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.124 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.124 INFO:teuthology.orchestra.run.smithi019.stdout: "verify_ssl": { 2024-09-10T22:37:54.124 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "verify_ssl", 2024-09-10T22:37:54.124 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-10T22:37:54.124 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.124 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-10T22:37:54.124 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "true", 2024-09-10T22:37:54.124 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.125 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.125 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.125 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2024-09-10T22:37:54.125 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.125 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.125 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.125 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-10T22:37:54.125 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-10T22:37:54.125 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.125 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-10T22:37:54.125 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "insights", 2024-09-10T22:37:54.125 INFO:teuthology.orchestra.run.smithi019.stdout: "can_run": true, 2024-09-10T22:37:54.125 INFO:teuthology.orchestra.run.smithi019.stdout: "error_string": "", 2024-09-10T22:37:54.126 INFO:teuthology.orchestra.run.smithi019.stdout: "module_options": { 2024-09-10T22:37:54.126 INFO:teuthology.orchestra.run.smithi019.stdout: "log_level": { 2024-09-10T22:37:54.126 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_level", 2024-09-10T22:37:54.126 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-10T22:37:54.126 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.126 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:54.126 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-10T22:37:54.126 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.126 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.126 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-10T22:37:54.126 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-10T22:37:54.126 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-10T22:37:54.126 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-10T22:37:54.126 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-10T22:37:54.127 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-10T22:37:54.127 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-10T22:37:54.127 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-10T22:37:54.127 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:54.127 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.127 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.127 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.127 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.127 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster": { 2024-09-10T22:37:54.127 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster", 2024-09-10T22:37:54.127 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-10T22:37:54.127 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.127 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:54.127 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-10T22:37:54.128 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.128 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.128 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.128 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:54.128 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.128 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.128 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.128 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.128 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster_level": { 2024-09-10T22:37:54.128 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster_level", 2024-09-10T22:37:54.128 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-10T22:37:54.128 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.128 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:54.128 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "info", 2024-09-10T22:37:54.129 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.129 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.129 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-10T22:37:54.129 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-10T22:37:54.129 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-10T22:37:54.129 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-10T22:37:54.129 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-10T22:37:54.129 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-10T22:37:54.129 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-10T22:37:54.129 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-10T22:37:54.129 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:54.129 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.129 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.129 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.130 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.130 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_file": { 2024-09-10T22:37:54.130 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_file", 2024-09-10T22:37:54.130 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-10T22:37:54.130 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.130 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:54.130 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-10T22:37:54.130 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.130 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.130 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.130 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:54.130 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.130 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.130 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.130 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.131 INFO:teuthology.orchestra.run.smithi019.stdout: "sqlite3_killpoint": { 2024-09-10T22:37:54.131 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "sqlite3_killpoint", 2024-09-10T22:37:54.131 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "int", 2024-09-10T22:37:54.131 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "dev", 2024-09-10T22:37:54.131 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:54.131 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "0", 2024-09-10T22:37:54.131 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.131 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.131 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.131 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:54.131 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.131 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.131 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.131 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-10T22:37:54.131 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-10T22:37:54.132 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.132 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-10T22:37:54.132 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "iostat", 2024-09-10T22:37:54.132 INFO:teuthology.orchestra.run.smithi019.stdout: "can_run": true, 2024-09-10T22:37:54.132 INFO:teuthology.orchestra.run.smithi019.stdout: "error_string": "", 2024-09-10T22:37:54.132 INFO:teuthology.orchestra.run.smithi019.stdout: "module_options": { 2024-09-10T22:37:54.132 INFO:teuthology.orchestra.run.smithi019.stdout: "log_level": { 2024-09-10T22:37:54.132 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_level", 2024-09-10T22:37:54.132 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-10T22:37:54.132 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.132 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:54.132 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-10T22:37:54.132 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.132 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.132 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-10T22:37:54.133 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-10T22:37:54.133 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-10T22:37:54.133 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-10T22:37:54.133 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-10T22:37:54.133 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-10T22:37:54.133 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-10T22:37:54.133 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-10T22:37:54.133 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:54.133 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.133 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.133 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.133 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.133 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster": { 2024-09-10T22:37:54.134 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster", 2024-09-10T22:37:54.134 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-10T22:37:54.134 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.134 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:54.134 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-10T22:37:54.134 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.134 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.134 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.134 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:54.134 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.134 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.134 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.134 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.135 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster_level": { 2024-09-10T22:37:54.135 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster_level", 2024-09-10T22:37:54.135 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-10T22:37:54.135 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.135 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:54.135 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "info", 2024-09-10T22:37:54.135 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.135 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.135 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-10T22:37:54.135 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-10T22:37:54.135 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-10T22:37:54.135 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-10T22:37:54.135 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-10T22:37:54.135 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-10T22:37:54.136 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-10T22:37:54.136 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-10T22:37:54.136 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:54.136 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.136 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.136 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.136 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.136 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_file": { 2024-09-10T22:37:54.136 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_file", 2024-09-10T22:37:54.136 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-10T22:37:54.136 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.136 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:54.136 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-10T22:37:54.137 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.137 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.137 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.137 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:54.137 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.137 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.137 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.137 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.137 INFO:teuthology.orchestra.run.smithi019.stdout: "sqlite3_killpoint": { 2024-09-10T22:37:54.137 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "sqlite3_killpoint", 2024-09-10T22:37:54.137 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "int", 2024-09-10T22:37:54.137 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "dev", 2024-09-10T22:37:54.138 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:54.138 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "0", 2024-09-10T22:37:54.138 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.138 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.138 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.138 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:54.138 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.138 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.138 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.138 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-10T22:37:54.138 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-10T22:37:54.138 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.138 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-10T22:37:54.138 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "k8sevents", 2024-09-10T22:37:54.139 INFO:teuthology.orchestra.run.smithi019.stdout: "can_run": true, 2024-09-10T22:37:54.139 INFO:teuthology.orchestra.run.smithi019.stdout: "error_string": "", 2024-09-10T22:37:54.139 INFO:teuthology.orchestra.run.smithi019.stdout: "module_options": { 2024-09-10T22:37:54.139 INFO:teuthology.orchestra.run.smithi019.stdout: "ceph_event_retention_days": { 2024-09-10T22:37:54.139 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "ceph_event_retention_days", 2024-09-10T22:37:54.139 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "int", 2024-09-10T22:37:54.139 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.139 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-10T22:37:54.139 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "7", 2024-09-10T22:37:54.139 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.139 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.139 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.139 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "Days to hold ceph event information within local cache", 2024-09-10T22:37:54.140 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.140 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.140 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.140 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.140 INFO:teuthology.orchestra.run.smithi019.stdout: "config_check_secs": { 2024-09-10T22:37:54.140 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "config_check_secs", 2024-09-10T22:37:54.140 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "int", 2024-09-10T22:37:54.140 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.140 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-10T22:37:54.140 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "10", 2024-09-10T22:37:54.140 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "10", 2024-09-10T22:37:54.140 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.140 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.141 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2024-09-10T22:37:54.141 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.141 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.141 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.141 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.141 INFO:teuthology.orchestra.run.smithi019.stdout: "log_level": { 2024-09-10T22:37:54.141 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_level", 2024-09-10T22:37:54.141 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-10T22:37:54.141 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.141 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:54.141 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-10T22:37:54.141 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.141 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.142 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-10T22:37:54.142 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-10T22:37:54.142 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-10T22:37:54.142 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-10T22:37:54.142 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-10T22:37:54.142 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-10T22:37:54.142 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-10T22:37:54.142 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-10T22:37:54.142 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:54.142 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.142 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.142 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.142 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.142 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster": { 2024-09-10T22:37:54.142 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster", 2024-09-10T22:37:54.143 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-10T22:37:54.143 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.143 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:54.143 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-10T22:37:54.143 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.143 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.143 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.143 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:54.143 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.143 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.143 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.143 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.143 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster_level": { 2024-09-10T22:37:54.143 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster_level", 2024-09-10T22:37:54.144 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-10T22:37:54.144 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.144 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:54.144 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "info", 2024-09-10T22:37:54.144 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.144 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.144 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-10T22:37:54.144 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-10T22:37:54.144 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-10T22:37:54.144 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-10T22:37:54.144 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-10T22:37:54.144 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-10T22:37:54.145 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-10T22:37:54.145 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-10T22:37:54.145 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:54.145 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.145 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.145 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.145 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.145 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_file": { 2024-09-10T22:37:54.145 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_file", 2024-09-10T22:37:54.145 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-10T22:37:54.145 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.145 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:54.145 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-10T22:37:54.145 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.146 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.146 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.146 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:54.146 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.146 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.146 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.146 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.146 INFO:teuthology.orchestra.run.smithi019.stdout: "sqlite3_killpoint": { 2024-09-10T22:37:54.146 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "sqlite3_killpoint", 2024-09-10T22:37:54.146 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "int", 2024-09-10T22:37:54.148 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "dev", 2024-09-10T22:37:54.148 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:54.148 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "0", 2024-09-10T22:37:54.148 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.148 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.148 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.148 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:54.148 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.148 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.148 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.149 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-10T22:37:54.149 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-10T22:37:54.149 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.149 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-10T22:37:54.149 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "localpool", 2024-09-10T22:37:54.149 INFO:teuthology.orchestra.run.smithi019.stdout: "can_run": true, 2024-09-10T22:37:54.149 INFO:teuthology.orchestra.run.smithi019.stdout: "error_string": "", 2024-09-10T22:37:54.149 INFO:teuthology.orchestra.run.smithi019.stdout: "module_options": { 2024-09-10T22:37:54.149 INFO:teuthology.orchestra.run.smithi019.stdout: "failure_domain": { 2024-09-10T22:37:54.149 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "failure_domain", 2024-09-10T22:37:54.149 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-10T22:37:54.149 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.149 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:54.149 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "host", 2024-09-10T22:37:54.150 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.150 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.150 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.150 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "failure domain for any created local pool", 2024-09-10T22:37:54.150 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2024-09-10T22:37:54.150 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.150 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.150 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.150 INFO:teuthology.orchestra.run.smithi019.stdout: "log_level": { 2024-09-10T22:37:54.150 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_level", 2024-09-10T22:37:54.150 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-10T22:37:54.150 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.150 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:54.151 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-10T22:37:54.151 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.151 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.151 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-10T22:37:54.151 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-10T22:37:54.151 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-10T22:37:54.151 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-10T22:37:54.151 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-10T22:37:54.151 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-10T22:37:54.151 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-10T22:37:54.151 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-10T22:37:54.151 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:54.151 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.151 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.152 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.152 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.152 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster": { 2024-09-10T22:37:54.152 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster", 2024-09-10T22:37:54.152 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-10T22:37:54.152 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.152 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:54.152 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-10T22:37:54.152 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.152 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.152 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.152 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:54.152 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.153 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.153 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.153 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.153 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster_level": { 2024-09-10T22:37:54.153 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster_level", 2024-09-10T22:37:54.153 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-10T22:37:54.153 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.153 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:54.153 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "info", 2024-09-10T22:37:54.153 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.153 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.153 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-10T22:37:54.154 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-10T22:37:54.154 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-10T22:37:54.154 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-10T22:37:54.154 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-10T22:37:54.154 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-10T22:37:54.154 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-10T22:37:54.154 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-10T22:37:54.154 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:54.154 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.154 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.154 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.154 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.154 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_file": { 2024-09-10T22:37:54.154 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_file", 2024-09-10T22:37:54.155 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-10T22:37:54.155 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.155 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:54.155 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-10T22:37:54.155 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.155 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.155 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.155 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:54.155 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.155 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.155 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.155 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.155 INFO:teuthology.orchestra.run.smithi019.stdout: "min_size": { 2024-09-10T22:37:54.156 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "min_size", 2024-09-10T22:37:54.156 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "int", 2024-09-10T22:37:54.156 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.156 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:54.156 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-10T22:37:54.156 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.156 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.156 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.156 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "default min_size for any created local pool", 2024-09-10T22:37:54.156 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2024-09-10T22:37:54.156 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.156 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.156 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.157 INFO:teuthology.orchestra.run.smithi019.stdout: "num_rep": { 2024-09-10T22:37:54.157 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "num_rep", 2024-09-10T22:37:54.157 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "int", 2024-09-10T22:37:54.157 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.157 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:54.157 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "3", 2024-09-10T22:37:54.157 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.157 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.157 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.157 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "default replica count for any created local pool", 2024-09-10T22:37:54.157 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.157 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.157 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.158 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.158 INFO:teuthology.orchestra.run.smithi019.stdout: "pg_num": { 2024-09-10T22:37:54.158 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "pg_num", 2024-09-10T22:37:54.158 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "int", 2024-09-10T22:37:54.158 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.158 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:54.158 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "128", 2024-09-10T22:37:54.158 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.158 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.158 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.158 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "default pg_num for any created local pool", 2024-09-10T22:37:54.158 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.158 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.158 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.159 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.159 INFO:teuthology.orchestra.run.smithi019.stdout: "prefix": { 2024-09-10T22:37:54.159 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "prefix", 2024-09-10T22:37:54.159 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-10T22:37:54.159 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.159 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:54.159 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-10T22:37:54.159 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.159 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.159 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.159 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "name prefix for any created local pool", 2024-09-10T22:37:54.159 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.159 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.160 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.160 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.160 INFO:teuthology.orchestra.run.smithi019.stdout: "sqlite3_killpoint": { 2024-09-10T22:37:54.160 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "sqlite3_killpoint", 2024-09-10T22:37:54.160 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "int", 2024-09-10T22:37:54.160 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "dev", 2024-09-10T22:37:54.160 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:54.160 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "0", 2024-09-10T22:37:54.160 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.160 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.160 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.160 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:54.160 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.161 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.161 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.161 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.161 INFO:teuthology.orchestra.run.smithi019.stdout: "subtree": { 2024-09-10T22:37:54.161 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "subtree", 2024-09-10T22:37:54.161 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-10T22:37:54.161 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.161 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:54.161 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "rack", 2024-09-10T22:37:54.161 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.161 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.161 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.161 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "CRUSH level for which to create a local pool", 2024-09-10T22:37:54.162 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2024-09-10T22:37:54.162 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.162 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.162 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-10T22:37:54.162 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-10T22:37:54.162 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.162 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-10T22:37:54.162 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "mds_autoscaler", 2024-09-10T22:37:54.162 INFO:teuthology.orchestra.run.smithi019.stdout: "can_run": true, 2024-09-10T22:37:54.162 INFO:teuthology.orchestra.run.smithi019.stdout: "error_string": "", 2024-09-10T22:37:54.162 INFO:teuthology.orchestra.run.smithi019.stdout: "module_options": { 2024-09-10T22:37:54.162 INFO:teuthology.orchestra.run.smithi019.stdout: "log_level": { 2024-09-10T22:37:54.162 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_level", 2024-09-10T22:37:54.163 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-10T22:37:54.163 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.163 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:54.163 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-10T22:37:54.163 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.163 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.163 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-10T22:37:54.163 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-10T22:37:54.163 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-10T22:37:54.163 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-10T22:37:54.163 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-10T22:37:54.163 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-10T22:37:54.163 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-10T22:37:54.163 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-10T22:37:54.164 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:54.164 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.164 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.164 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.164 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.164 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster": { 2024-09-10T22:37:54.164 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster", 2024-09-10T22:37:54.164 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-10T22:37:54.164 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.164 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:54.164 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-10T22:37:54.164 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.165 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.165 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.165 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:54.165 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.165 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.165 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.165 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.165 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster_level": { 2024-09-10T22:37:54.165 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster_level", 2024-09-10T22:37:54.165 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-10T22:37:54.165 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.165 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:54.165 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "info", 2024-09-10T22:37:54.166 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.166 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.166 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-10T22:37:54.166 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-10T22:37:54.166 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-10T22:37:54.166 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-10T22:37:54.166 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-10T22:37:54.166 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-10T22:37:54.166 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-10T22:37:54.166 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-10T22:37:54.166 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:54.166 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.166 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.167 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.167 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.167 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_file": { 2024-09-10T22:37:54.167 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_file", 2024-09-10T22:37:54.167 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-10T22:37:54.167 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.167 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:54.167 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-10T22:37:54.167 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.167 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.167 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.167 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:54.168 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.168 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.168 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.168 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.168 INFO:teuthology.orchestra.run.smithi019.stdout: "sqlite3_killpoint": { 2024-09-10T22:37:54.168 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "sqlite3_killpoint", 2024-09-10T22:37:54.168 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "int", 2024-09-10T22:37:54.168 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "dev", 2024-09-10T22:37:54.168 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:54.168 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "0", 2024-09-10T22:37:54.168 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.168 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.169 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.169 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:54.169 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.169 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.169 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.169 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-10T22:37:54.169 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-10T22:37:54.169 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.169 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-10T22:37:54.169 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "mirroring", 2024-09-10T22:37:54.169 INFO:teuthology.orchestra.run.smithi019.stdout: "can_run": true, 2024-09-10T22:37:54.169 INFO:teuthology.orchestra.run.smithi019.stdout: "error_string": "", 2024-09-10T22:37:54.169 INFO:teuthology.orchestra.run.smithi019.stdout: "module_options": { 2024-09-10T22:37:54.169 INFO:teuthology.orchestra.run.smithi019.stdout: "log_level": { 2024-09-10T22:37:54.170 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_level", 2024-09-10T22:37:54.170 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-10T22:37:54.170 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.170 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:54.170 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-10T22:37:54.170 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.170 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.170 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-10T22:37:54.170 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-10T22:37:54.170 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-10T22:37:54.170 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-10T22:37:54.170 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-10T22:37:54.170 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-10T22:37:54.171 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-10T22:37:54.171 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-10T22:37:54.171 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:54.171 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.171 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.171 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.171 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.171 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster": { 2024-09-10T22:37:54.171 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster", 2024-09-10T22:37:54.171 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-10T22:37:54.171 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.171 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:54.171 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-10T22:37:54.171 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.172 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.172 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.172 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:54.172 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.172 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.172 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.172 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.172 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster_level": { 2024-09-10T22:37:54.172 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster_level", 2024-09-10T22:37:54.172 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-10T22:37:54.172 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.172 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:54.172 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "info", 2024-09-10T22:37:54.173 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.173 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.173 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-10T22:37:54.173 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-10T22:37:54.173 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-10T22:37:54.173 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-10T22:37:54.173 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-10T22:37:54.173 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-10T22:37:54.173 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-10T22:37:54.173 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-10T22:37:54.173 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:54.173 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.174 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.174 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.174 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.174 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_file": { 2024-09-10T22:37:54.174 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_file", 2024-09-10T22:37:54.174 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-10T22:37:54.174 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.174 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:54.174 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-10T22:37:54.174 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.174 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.174 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.174 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:54.174 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.175 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.175 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.175 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.175 INFO:teuthology.orchestra.run.smithi019.stdout: "sqlite3_killpoint": { 2024-09-10T22:37:54.175 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "sqlite3_killpoint", 2024-09-10T22:37:54.175 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "int", 2024-09-10T22:37:54.175 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "dev", 2024-09-10T22:37:54.175 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:54.175 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "0", 2024-09-10T22:37:54.175 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.175 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.175 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.175 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:54.175 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.176 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.176 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.176 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-10T22:37:54.176 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-10T22:37:54.176 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.176 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-10T22:37:54.176 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "nfs", 2024-09-10T22:37:54.176 INFO:teuthology.orchestra.run.smithi019.stdout: "can_run": true, 2024-09-10T22:37:54.176 INFO:teuthology.orchestra.run.smithi019.stdout: "error_string": "", 2024-09-10T22:37:54.176 INFO:teuthology.orchestra.run.smithi019.stdout: "module_options": { 2024-09-10T22:37:54.176 INFO:teuthology.orchestra.run.smithi019.stdout: "log_level": { 2024-09-10T22:37:54.176 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_level", 2024-09-10T22:37:54.176 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-10T22:37:54.177 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.177 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:54.177 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-10T22:37:54.177 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.177 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.177 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-10T22:37:54.177 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-10T22:37:54.177 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-10T22:37:54.177 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-10T22:37:54.177 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-10T22:37:54.177 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-10T22:37:54.177 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-10T22:37:54.177 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-10T22:37:54.177 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:54.178 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.178 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.178 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.178 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.178 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster": { 2024-09-10T22:37:54.178 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster", 2024-09-10T22:37:54.178 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-10T22:37:54.178 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.178 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:54.178 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-10T22:37:54.178 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.178 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.178 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.178 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:54.178 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.179 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.179 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.179 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.179 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster_level": { 2024-09-10T22:37:54.179 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster_level", 2024-09-10T22:37:54.179 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-10T22:37:54.179 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.179 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:54.179 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "info", 2024-09-10T22:37:54.179 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.179 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.179 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-10T22:37:54.179 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-10T22:37:54.180 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-10T22:37:54.180 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-10T22:37:54.180 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-10T22:37:54.180 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-10T22:37:54.180 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-10T22:37:54.180 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-10T22:37:54.180 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:54.180 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.180 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.180 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.180 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.180 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_file": { 2024-09-10T22:37:54.180 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_file", 2024-09-10T22:37:54.180 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-10T22:37:54.181 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.181 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:54.181 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-10T22:37:54.181 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.181 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.181 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.181 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:54.181 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.181 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.181 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.181 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.181 INFO:teuthology.orchestra.run.smithi019.stdout: "sqlite3_killpoint": { 2024-09-10T22:37:54.181 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "sqlite3_killpoint", 2024-09-10T22:37:54.182 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "int", 2024-09-10T22:37:54.182 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "dev", 2024-09-10T22:37:54.182 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:54.182 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "0", 2024-09-10T22:37:54.182 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.182 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.182 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.182 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:54.182 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.182 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.182 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.182 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-10T22:37:54.182 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-10T22:37:54.183 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.183 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-10T22:37:54.183 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "orchestrator", 2024-09-10T22:37:54.183 INFO:teuthology.orchestra.run.smithi019.stdout: "can_run": true, 2024-09-10T22:37:54.183 INFO:teuthology.orchestra.run.smithi019.stdout: "error_string": "", 2024-09-10T22:37:54.183 INFO:teuthology.orchestra.run.smithi019.stdout: "module_options": { 2024-09-10T22:37:54.183 INFO:teuthology.orchestra.run.smithi019.stdout: "fail_fs": { 2024-09-10T22:37:54.183 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "fail_fs", 2024-09-10T22:37:54.183 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-10T22:37:54.183 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.183 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-10T22:37:54.183 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-10T22:37:54.183 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.183 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.184 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.184 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2024-09-10T22:37:54.184 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.184 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.184 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.184 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.184 INFO:teuthology.orchestra.run.smithi019.stdout: "log_level": { 2024-09-10T22:37:54.184 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_level", 2024-09-10T22:37:54.184 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-10T22:37:54.184 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.184 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:54.184 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-10T22:37:54.184 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.184 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.185 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-10T22:37:54.185 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-10T22:37:54.185 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-10T22:37:54.185 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-10T22:37:54.185 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-10T22:37:54.185 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-10T22:37:54.185 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-10T22:37:54.185 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-10T22:37:54.185 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:54.185 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.185 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.185 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.185 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.186 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster": { 2024-09-10T22:37:54.186 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster", 2024-09-10T22:37:54.186 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-10T22:37:54.186 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.186 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:54.186 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-10T22:37:54.186 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.186 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.186 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.186 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:54.186 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.186 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.186 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.187 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.187 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster_level": { 2024-09-10T22:37:54.187 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster_level", 2024-09-10T22:37:54.187 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-10T22:37:54.187 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.187 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:54.187 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "info", 2024-09-10T22:37:54.187 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.187 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.187 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-10T22:37:54.187 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-10T22:37:54.187 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-10T22:37:54.187 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-10T22:37:54.187 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-10T22:37:54.188 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-10T22:37:54.188 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-10T22:37:54.188 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-10T22:37:54.188 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:54.188 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.188 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.188 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.188 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.188 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_file": { 2024-09-10T22:37:54.188 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_file", 2024-09-10T22:37:54.188 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-10T22:37:54.188 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.188 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:54.188 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-10T22:37:54.189 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.189 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.189 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.189 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:54.189 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.189 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.189 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.189 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.189 INFO:teuthology.orchestra.run.smithi019.stdout: "orchestrator": { 2024-09-10T22:37:54.189 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "orchestrator", 2024-09-10T22:37:54.189 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-10T22:37:54.189 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.189 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:54.189 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-10T22:37:54.190 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.190 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.190 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-10T22:37:54.190 INFO:teuthology.orchestra.run.smithi019.stdout: "cephadm", 2024-09-10T22:37:54.190 INFO:teuthology.orchestra.run.smithi019.stdout: "rook", 2024-09-10T22:37:54.190 INFO:teuthology.orchestra.run.smithi019.stdout: "test_orchestrator" 2024-09-10T22:37:54.190 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-10T22:37:54.190 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "Orchestrator backend", 2024-09-10T22:37:54.190 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.190 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.190 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.190 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.190 INFO:teuthology.orchestra.run.smithi019.stdout: "sqlite3_killpoint": { 2024-09-10T22:37:54.190 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "sqlite3_killpoint", 2024-09-10T22:37:54.191 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "int", 2024-09-10T22:37:54.191 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "dev", 2024-09-10T22:37:54.191 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:54.191 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "0", 2024-09-10T22:37:54.191 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.191 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.191 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.191 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:54.191 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.191 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.191 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.191 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-10T22:37:54.191 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-10T22:37:54.191 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.192 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-10T22:37:54.192 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "osd_perf_query", 2024-09-10T22:37:54.192 INFO:teuthology.orchestra.run.smithi019.stdout: "can_run": true, 2024-09-10T22:37:54.192 INFO:teuthology.orchestra.run.smithi019.stdout: "error_string": "", 2024-09-10T22:37:54.192 INFO:teuthology.orchestra.run.smithi019.stdout: "module_options": { 2024-09-10T22:37:54.192 INFO:teuthology.orchestra.run.smithi019.stdout: "log_level": { 2024-09-10T22:37:54.192 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_level", 2024-09-10T22:37:54.192 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-10T22:37:54.192 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.192 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:54.192 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-10T22:37:54.192 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.192 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.192 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-10T22:37:54.193 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-10T22:37:54.193 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-10T22:37:54.193 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-10T22:37:54.193 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-10T22:37:54.193 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-10T22:37:54.193 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-10T22:37:54.193 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-10T22:37:54.193 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:54.193 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.193 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.193 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.193 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.193 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster": { 2024-09-10T22:37:54.193 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster", 2024-09-10T22:37:54.194 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-10T22:37:54.194 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.194 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:54.194 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-10T22:37:54.194 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.194 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.194 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.194 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:54.194 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.194 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.194 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.194 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.194 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster_level": { 2024-09-10T22:37:54.194 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster_level", 2024-09-10T22:37:54.195 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-10T22:37:54.195 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.195 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:54.195 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "info", 2024-09-10T22:37:54.195 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.195 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.195 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-10T22:37:54.195 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-10T22:37:54.195 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-10T22:37:54.195 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-10T22:37:54.195 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-10T22:37:54.195 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-10T22:37:54.195 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-10T22:37:54.195 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-10T22:37:54.196 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:54.196 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.196 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.196 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.196 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.196 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_file": { 2024-09-10T22:37:54.196 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_file", 2024-09-10T22:37:54.196 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-10T22:37:54.196 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.196 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:54.196 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-10T22:37:54.196 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.197 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.197 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.197 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:54.197 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.197 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.197 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.197 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.197 INFO:teuthology.orchestra.run.smithi019.stdout: "sqlite3_killpoint": { 2024-09-10T22:37:54.197 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "sqlite3_killpoint", 2024-09-10T22:37:54.197 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "int", 2024-09-10T22:37:54.197 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "dev", 2024-09-10T22:37:54.197 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:54.197 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "0", 2024-09-10T22:37:54.197 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.198 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.198 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.198 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:54.198 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.198 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.198 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.198 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-10T22:37:54.198 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-10T22:37:54.198 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.198 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-10T22:37:54.198 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "osd_support", 2024-09-10T22:37:54.198 INFO:teuthology.orchestra.run.smithi019.stdout: "can_run": true, 2024-09-10T22:37:54.198 INFO:teuthology.orchestra.run.smithi019.stdout: "error_string": "", 2024-09-10T22:37:54.198 INFO:teuthology.orchestra.run.smithi019.stdout: "module_options": { 2024-09-10T22:37:54.199 INFO:teuthology.orchestra.run.smithi019.stdout: "log_level": { 2024-09-10T22:37:54.199 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_level", 2024-09-10T22:37:54.199 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-10T22:37:54.199 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.199 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:54.199 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-10T22:37:54.199 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.199 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.199 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-10T22:37:54.199 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-10T22:37:54.199 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-10T22:37:54.199 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-10T22:37:54.199 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-10T22:37:54.200 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-10T22:37:54.200 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-10T22:37:54.200 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-10T22:37:54.200 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:54.200 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.200 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.200 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.200 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.200 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster": { 2024-09-10T22:37:54.200 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster", 2024-09-10T22:37:54.200 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-10T22:37:54.200 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.201 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:54.201 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-10T22:37:54.201 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.201 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.201 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.201 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:54.201 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.201 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.201 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.201 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.201 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster_level": { 2024-09-10T22:37:54.201 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster_level", 2024-09-10T22:37:54.201 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-10T22:37:54.202 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.202 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:54.202 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "info", 2024-09-10T22:37:54.202 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.202 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.202 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-10T22:37:54.202 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-10T22:37:54.202 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-10T22:37:54.202 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-10T22:37:54.202 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-10T22:37:54.202 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-10T22:37:54.202 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-10T22:37:54.203 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-10T22:37:54.203 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:54.203 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.203 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.203 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.203 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.203 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_file": { 2024-09-10T22:37:54.203 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_file", 2024-09-10T22:37:54.203 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-10T22:37:54.203 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.203 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:54.203 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-10T22:37:54.203 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.204 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.204 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.204 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:54.204 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.204 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.204 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.204 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.204 INFO:teuthology.orchestra.run.smithi019.stdout: "sqlite3_killpoint": { 2024-09-10T22:37:54.204 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "sqlite3_killpoint", 2024-09-10T22:37:54.204 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "int", 2024-09-10T22:37:54.204 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "dev", 2024-09-10T22:37:54.204 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:54.205 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "0", 2024-09-10T22:37:54.205 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.205 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.205 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.205 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:54.205 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.205 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.205 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.205 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-10T22:37:54.205 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-10T22:37:54.205 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.205 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-10T22:37:54.205 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "pg_autoscaler", 2024-09-10T22:37:54.206 INFO:teuthology.orchestra.run.smithi019.stdout: "can_run": true, 2024-09-10T22:37:54.206 INFO:teuthology.orchestra.run.smithi019.stdout: "error_string": "", 2024-09-10T22:37:54.206 INFO:teuthology.orchestra.run.smithi019.stdout: "module_options": { 2024-09-10T22:37:54.206 INFO:teuthology.orchestra.run.smithi019.stdout: "log_level": { 2024-09-10T22:37:54.206 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_level", 2024-09-10T22:37:54.206 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-10T22:37:54.206 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.206 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:54.206 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-10T22:37:54.206 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.206 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.206 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-10T22:37:54.206 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-10T22:37:54.207 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-10T22:37:54.207 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-10T22:37:54.207 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-10T22:37:54.207 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-10T22:37:54.207 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-10T22:37:54.207 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-10T22:37:54.207 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:54.207 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.207 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.207 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.207 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.207 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster": { 2024-09-10T22:37:54.207 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster", 2024-09-10T22:37:54.208 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-10T22:37:54.208 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.208 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:54.208 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-10T22:37:54.208 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.208 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.208 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.208 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:54.208 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.208 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.208 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.208 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.208 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster_level": { 2024-09-10T22:37:54.209 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster_level", 2024-09-10T22:37:54.209 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-10T22:37:54.209 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.209 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:54.209 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "info", 2024-09-10T22:37:54.209 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.209 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.209 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-10T22:37:54.209 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-10T22:37:54.209 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-10T22:37:54.209 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-10T22:37:54.209 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-10T22:37:54.209 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-10T22:37:54.209 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-10T22:37:54.210 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-10T22:37:54.210 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:54.210 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.210 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.210 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.210 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.210 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_file": { 2024-09-10T22:37:54.210 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_file", 2024-09-10T22:37:54.210 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-10T22:37:54.210 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.210 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:54.210 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-10T22:37:54.210 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.210 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.210 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.211 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:54.211 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.211 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.211 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.211 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.211 INFO:teuthology.orchestra.run.smithi019.stdout: "sleep_interval": { 2024-09-10T22:37:54.211 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "sleep_interval", 2024-09-10T22:37:54.211 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "secs", 2024-09-10T22:37:54.211 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.211 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-10T22:37:54.211 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "60", 2024-09-10T22:37:54.211 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.211 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.212 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.212 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:54.212 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.212 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.212 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.212 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.212 INFO:teuthology.orchestra.run.smithi019.stdout: "sqlite3_killpoint": { 2024-09-10T22:37:54.212 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "sqlite3_killpoint", 2024-09-10T22:37:54.212 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "int", 2024-09-10T22:37:54.212 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "dev", 2024-09-10T22:37:54.212 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:54.212 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "0", 2024-09-10T22:37:54.212 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.213 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.213 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.213 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:54.213 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.213 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.213 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.213 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.213 INFO:teuthology.orchestra.run.smithi019.stdout: "threshold": { 2024-09-10T22:37:54.213 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "threshold", 2024-09-10T22:37:54.213 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "float", 2024-09-10T22:37:54.213 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.213 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-10T22:37:54.213 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "3.0", 2024-09-10T22:37:54.213 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "1.0", 2024-09-10T22:37:54.214 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.214 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.214 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "scaling threshold", 2024-09-10T22:37:54.214 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2024-09-10T22:37:54.214 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.214 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.214 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-10T22:37:54.214 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-10T22:37:54.214 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.214 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-10T22:37:54.214 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "progress", 2024-09-10T22:37:54.214 INFO:teuthology.orchestra.run.smithi019.stdout: "can_run": true, 2024-09-10T22:37:54.214 INFO:teuthology.orchestra.run.smithi019.stdout: "error_string": "", 2024-09-10T22:37:54.214 INFO:teuthology.orchestra.run.smithi019.stdout: "module_options": { 2024-09-10T22:37:54.214 INFO:teuthology.orchestra.run.smithi019.stdout: "allow_pg_recovery_event": { 2024-09-10T22:37:54.215 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "allow_pg_recovery_event", 2024-09-10T22:37:54.215 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-10T22:37:54.215 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.215 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:54.215 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-10T22:37:54.215 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.215 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.215 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.215 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "allow the module to show pg recovery progress", 2024-09-10T22:37:54.215 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.215 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.215 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.215 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.215 INFO:teuthology.orchestra.run.smithi019.stdout: "enabled": { 2024-09-10T22:37:54.216 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "enabled", 2024-09-10T22:37:54.216 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-10T22:37:54.216 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.216 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-10T22:37:54.216 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "True", 2024-09-10T22:37:54.216 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.216 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.216 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.216 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:54.216 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.216 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.216 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.217 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.217 INFO:teuthology.orchestra.run.smithi019.stdout: "log_level": { 2024-09-10T22:37:54.217 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_level", 2024-09-10T22:37:54.217 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-10T22:37:54.217 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.217 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:54.217 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-10T22:37:54.217 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.217 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.217 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-10T22:37:54.217 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-10T22:37:54.217 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-10T22:37:54.217 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-10T22:37:54.218 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-10T22:37:54.218 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-10T22:37:54.218 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-10T22:37:54.218 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-10T22:37:54.218 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:54.218 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.218 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.218 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.218 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.218 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster": { 2024-09-10T22:37:54.218 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster", 2024-09-10T22:37:54.218 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-10T22:37:54.218 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.218 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:54.219 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-10T22:37:54.219 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.219 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.219 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.219 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:54.219 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.219 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.219 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.219 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.219 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster_level": { 2024-09-10T22:37:54.219 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster_level", 2024-09-10T22:37:54.219 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-10T22:37:54.219 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.219 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:54.219 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "info", 2024-09-10T22:37:54.220 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.220 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.220 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-10T22:37:54.220 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-10T22:37:54.220 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-10T22:37:54.220 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-10T22:37:54.220 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-10T22:37:54.220 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-10T22:37:54.220 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-10T22:37:54.220 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-10T22:37:54.220 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:54.220 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.220 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.221 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.221 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.221 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_file": { 2024-09-10T22:37:54.221 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_file", 2024-09-10T22:37:54.221 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-10T22:37:54.221 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.221 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:54.221 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-10T22:37:54.221 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.221 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.221 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.221 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:54.221 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.221 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.222 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.222 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.222 INFO:teuthology.orchestra.run.smithi019.stdout: "max_completed_events": { 2024-09-10T22:37:54.222 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "max_completed_events", 2024-09-10T22:37:54.222 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "int", 2024-09-10T22:37:54.222 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.222 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:54.222 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "50", 2024-09-10T22:37:54.222 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.222 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.222 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.222 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "number of past completed events to remember", 2024-09-10T22:37:54.222 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.222 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.223 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.223 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.223 INFO:teuthology.orchestra.run.smithi019.stdout: "sleep_interval": { 2024-09-10T22:37:54.223 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "sleep_interval", 2024-09-10T22:37:54.223 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "secs", 2024-09-10T22:37:54.223 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.223 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:54.223 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "5", 2024-09-10T22:37:54.223 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.223 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.223 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.223 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "how long the module is going to sleep", 2024-09-10T22:37:54.223 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.224 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.224 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.224 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.224 INFO:teuthology.orchestra.run.smithi019.stdout: "sqlite3_killpoint": { 2024-09-10T22:37:54.224 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "sqlite3_killpoint", 2024-09-10T22:37:54.224 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "int", 2024-09-10T22:37:54.224 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "dev", 2024-09-10T22:37:54.224 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:54.224 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "0", 2024-09-10T22:37:54.224 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.224 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.224 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.224 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:54.224 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.225 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.225 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.225 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-10T22:37:54.225 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-10T22:37:54.225 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.225 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-10T22:37:54.225 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "prometheus", 2024-09-10T22:37:54.225 INFO:teuthology.orchestra.run.smithi019.stdout: "can_run": true, 2024-09-10T22:37:54.225 INFO:teuthology.orchestra.run.smithi019.stdout: "error_string": "", 2024-09-10T22:37:54.225 INFO:teuthology.orchestra.run.smithi019.stdout: "module_options": { 2024-09-10T22:37:54.225 INFO:teuthology.orchestra.run.smithi019.stdout: "cache": { 2024-09-10T22:37:54.226 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "cache", 2024-09-10T22:37:54.226 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-10T22:37:54.226 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.226 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-10T22:37:54.226 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "True", 2024-09-10T22:37:54.226 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.226 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.226 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.226 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:54.226 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.226 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.226 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.227 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.227 INFO:teuthology.orchestra.run.smithi019.stdout: "exclude_perf_counters": { 2024-09-10T22:37:54.227 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "exclude_perf_counters", 2024-09-10T22:37:54.227 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-10T22:37:54.227 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.227 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:54.227 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "True", 2024-09-10T22:37:54.227 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.227 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.227 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.227 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "Do not include perf-counters in the metrics output", 2024-09-10T22:37:54.227 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2024-09-10T22:37:54.227 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.228 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.228 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.228 INFO:teuthology.orchestra.run.smithi019.stdout: "log_level": { 2024-09-10T22:37:54.228 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_level", 2024-09-10T22:37:54.228 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-10T22:37:54.228 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.228 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:54.228 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-10T22:37:54.228 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.228 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.228 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-10T22:37:54.228 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-10T22:37:54.229 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-10T22:37:54.229 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-10T22:37:54.229 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-10T22:37:54.229 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-10T22:37:54.229 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-10T22:37:54.229 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-10T22:37:54.229 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:54.229 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.229 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.229 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.229 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.229 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster": { 2024-09-10T22:37:54.229 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster", 2024-09-10T22:37:54.230 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-10T22:37:54.230 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.230 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:54.230 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-10T22:37:54.230 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.230 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.230 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.230 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:54.230 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.230 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.230 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.230 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.230 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster_level": { 2024-09-10T22:37:54.231 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster_level", 2024-09-10T22:37:54.231 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-10T22:37:54.231 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.231 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:54.231 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "info", 2024-09-10T22:37:54.231 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.231 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.231 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-10T22:37:54.231 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-10T22:37:54.231 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-10T22:37:54.231 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-10T22:37:54.231 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-10T22:37:54.231 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-10T22:37:54.232 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-10T22:37:54.232 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-10T22:37:54.232 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:54.232 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.232 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.232 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.232 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.232 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_file": { 2024-09-10T22:37:54.232 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_file", 2024-09-10T22:37:54.232 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-10T22:37:54.232 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.232 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:54.233 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-10T22:37:54.233 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.233 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.233 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.233 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:54.233 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.233 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.233 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.233 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.233 INFO:teuthology.orchestra.run.smithi019.stdout: "rbd_stats_pools": { 2024-09-10T22:37:54.233 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "rbd_stats_pools", 2024-09-10T22:37:54.233 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-10T22:37:54.233 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.234 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-10T22:37:54.234 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-10T22:37:54.234 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.234 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.234 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.234 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:54.234 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.234 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.234 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.234 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.234 INFO:teuthology.orchestra.run.smithi019.stdout: "rbd_stats_pools_refresh_interval": { 2024-09-10T22:37:54.234 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "rbd_stats_pools_refresh_interval", 2024-09-10T22:37:54.234 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "int", 2024-09-10T22:37:54.234 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.235 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-10T22:37:54.235 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "300", 2024-09-10T22:37:54.235 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.235 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.235 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.235 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:54.235 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.235 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.235 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.235 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.235 INFO:teuthology.orchestra.run.smithi019.stdout: "scrape_interval": { 2024-09-10T22:37:54.235 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "scrape_interval", 2024-09-10T22:37:54.235 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "float", 2024-09-10T22:37:54.236 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.236 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-10T22:37:54.236 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "15.0", 2024-09-10T22:37:54.236 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.236 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.236 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.236 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:54.236 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.236 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.236 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.236 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.236 INFO:teuthology.orchestra.run.smithi019.stdout: "server_addr": { 2024-09-10T22:37:54.236 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "server_addr", 2024-09-10T22:37:54.237 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-10T22:37:54.237 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.237 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-10T22:37:54.237 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "::", 2024-09-10T22:37:54.237 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.237 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.237 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.237 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2024-09-10T22:37:54.237 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.237 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.237 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.237 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.237 INFO:teuthology.orchestra.run.smithi019.stdout: "server_port": { 2024-09-10T22:37:54.238 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "server_port", 2024-09-10T22:37:54.238 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "int", 2024-09-10T22:37:54.238 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.238 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:54.238 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "9283", 2024-09-10T22:37:54.238 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.238 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.238 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.238 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "the port on which the module listens for HTTP requests", 2024-09-10T22:37:54.238 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.238 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.238 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.238 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.238 INFO:teuthology.orchestra.run.smithi019.stdout: "sqlite3_killpoint": { 2024-09-10T22:37:54.239 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "sqlite3_killpoint", 2024-09-10T22:37:54.239 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "int", 2024-09-10T22:37:54.239 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "dev", 2024-09-10T22:37:54.239 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:54.239 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "0", 2024-09-10T22:37:54.239 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.239 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.239 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.239 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:54.239 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.239 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.239 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.239 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.240 INFO:teuthology.orchestra.run.smithi019.stdout: "stale_cache_strategy": { 2024-09-10T22:37:54.240 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "stale_cache_strategy", 2024-09-10T22:37:54.240 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-10T22:37:54.240 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.240 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-10T22:37:54.240 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "log", 2024-09-10T22:37:54.240 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.240 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.240 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.240 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:54.240 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.240 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.240 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.240 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.241 INFO:teuthology.orchestra.run.smithi019.stdout: "standby_behaviour": { 2024-09-10T22:37:54.241 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "standby_behaviour", 2024-09-10T22:37:54.241 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-10T22:37:54.241 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.241 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:54.241 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "default", 2024-09-10T22:37:54.241 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.241 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.241 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-10T22:37:54.241 INFO:teuthology.orchestra.run.smithi019.stdout: "default", 2024-09-10T22:37:54.241 INFO:teuthology.orchestra.run.smithi019.stdout: "error" 2024-09-10T22:37:54.241 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-10T22:37:54.242 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:54.242 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.242 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.242 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.242 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.242 INFO:teuthology.orchestra.run.smithi019.stdout: "standby_error_status_code": { 2024-09-10T22:37:54.242 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "standby_error_status_code", 2024-09-10T22:37:54.242 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "int", 2024-09-10T22:37:54.242 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.242 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:54.242 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "500", 2024-09-10T22:37:54.242 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "400", 2024-09-10T22:37:54.242 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "599", 2024-09-10T22:37:54.242 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.243 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:54.243 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.243 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.243 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.243 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-10T22:37:54.243 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-10T22:37:54.243 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.243 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-10T22:37:54.243 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "rbd_support", 2024-09-10T22:37:54.243 INFO:teuthology.orchestra.run.smithi019.stdout: "can_run": true, 2024-09-10T22:37:54.243 INFO:teuthology.orchestra.run.smithi019.stdout: "error_string": "", 2024-09-10T22:37:54.243 INFO:teuthology.orchestra.run.smithi019.stdout: "module_options": { 2024-09-10T22:37:54.243 INFO:teuthology.orchestra.run.smithi019.stdout: "log_level": { 2024-09-10T22:37:54.244 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_level", 2024-09-10T22:37:54.244 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-10T22:37:54.244 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.244 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:54.244 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-10T22:37:54.244 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.244 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.244 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-10T22:37:54.244 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-10T22:37:54.244 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-10T22:37:54.244 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-10T22:37:54.244 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-10T22:37:54.244 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-10T22:37:54.244 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-10T22:37:54.245 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-10T22:37:54.245 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:54.245 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.245 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.245 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.245 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.245 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster": { 2024-09-10T22:37:54.245 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster", 2024-09-10T22:37:54.245 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-10T22:37:54.245 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.245 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:54.245 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-10T22:37:54.246 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.246 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.246 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.246 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:54.246 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.246 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.246 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.246 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.246 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster_level": { 2024-09-10T22:37:54.246 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster_level", 2024-09-10T22:37:54.246 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-10T22:37:54.246 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.246 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:54.246 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "info", 2024-09-10T22:37:54.247 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.247 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.247 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-10T22:37:54.247 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-10T22:37:54.247 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-10T22:37:54.247 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-10T22:37:54.247 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-10T22:37:54.247 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-10T22:37:54.247 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-10T22:37:54.247 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-10T22:37:54.247 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:54.247 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.247 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.247 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.248 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.248 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_file": { 2024-09-10T22:37:54.248 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_file", 2024-09-10T22:37:54.248 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-10T22:37:54.248 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.248 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:54.248 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-10T22:37:54.248 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.248 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.248 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.248 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:54.248 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.248 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.249 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.249 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.249 INFO:teuthology.orchestra.run.smithi019.stdout: "max_concurrent_snap_create": { 2024-09-10T22:37:54.249 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "max_concurrent_snap_create", 2024-09-10T22:37:54.249 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "int", 2024-09-10T22:37:54.249 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.249 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-10T22:37:54.249 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "10", 2024-09-10T22:37:54.249 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.249 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.249 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.249 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:54.249 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.250 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.250 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.250 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.250 INFO:teuthology.orchestra.run.smithi019.stdout: "mirror_snapshot_schedule": { 2024-09-10T22:37:54.250 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "mirror_snapshot_schedule", 2024-09-10T22:37:54.250 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-10T22:37:54.250 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.250 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-10T22:37:54.250 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-10T22:37:54.250 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.250 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.250 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.250 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:54.250 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.251 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.251 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.251 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.251 INFO:teuthology.orchestra.run.smithi019.stdout: "sqlite3_killpoint": { 2024-09-10T22:37:54.251 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "sqlite3_killpoint", 2024-09-10T22:37:54.251 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "int", 2024-09-10T22:37:54.251 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "dev", 2024-09-10T22:37:54.251 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:54.251 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "0", 2024-09-10T22:37:54.251 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.251 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.251 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.251 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:54.251 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.252 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.252 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.252 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.252 INFO:teuthology.orchestra.run.smithi019.stdout: "trash_purge_schedule": { 2024-09-10T22:37:54.252 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "trash_purge_schedule", 2024-09-10T22:37:54.252 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-10T22:37:54.252 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.252 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-10T22:37:54.252 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-10T22:37:54.252 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.252 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.252 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.252 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:54.253 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.253 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.253 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.253 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-10T22:37:54.253 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-10T22:37:54.253 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.253 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-10T22:37:54.253 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "restful", 2024-09-10T22:37:54.253 INFO:teuthology.orchestra.run.smithi019.stdout: "can_run": true, 2024-09-10T22:37:54.253 INFO:teuthology.orchestra.run.smithi019.stdout: "error_string": "", 2024-09-10T22:37:54.253 INFO:teuthology.orchestra.run.smithi019.stdout: "module_options": { 2024-09-10T22:37:54.253 INFO:teuthology.orchestra.run.smithi019.stdout: "enable_auth": { 2024-09-10T22:37:54.253 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "enable_auth", 2024-09-10T22:37:54.254 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-10T22:37:54.254 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.254 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-10T22:37:54.254 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "True", 2024-09-10T22:37:54.254 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.254 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.254 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.254 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:54.254 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.254 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.254 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.254 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.254 INFO:teuthology.orchestra.run.smithi019.stdout: "key_file": { 2024-09-10T22:37:54.254 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "key_file", 2024-09-10T22:37:54.255 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-10T22:37:54.255 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.255 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-10T22:37:54.255 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-10T22:37:54.255 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.255 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.255 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.255 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:54.255 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.255 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.255 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.255 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.255 INFO:teuthology.orchestra.run.smithi019.stdout: "log_level": { 2024-09-10T22:37:54.255 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_level", 2024-09-10T22:37:54.255 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-10T22:37:54.256 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.256 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:54.256 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-10T22:37:54.256 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.256 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.256 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-10T22:37:54.256 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-10T22:37:54.256 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-10T22:37:54.256 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-10T22:37:54.256 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-10T22:37:54.256 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-10T22:37:54.256 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-10T22:37:54.256 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-10T22:37:54.256 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:54.257 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.257 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.257 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.257 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.257 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster": { 2024-09-10T22:37:54.257 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster", 2024-09-10T22:37:54.257 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-10T22:37:54.257 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.257 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:54.257 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-10T22:37:54.257 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.257 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.257 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.258 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:54.258 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.258 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.258 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.258 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.258 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster_level": { 2024-09-10T22:37:54.258 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster_level", 2024-09-10T22:37:54.258 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-10T22:37:54.258 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.258 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:54.258 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "info", 2024-09-10T22:37:54.258 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.258 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.259 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-10T22:37:54.259 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-10T22:37:54.259 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-10T22:37:54.259 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-10T22:37:54.259 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-10T22:37:54.259 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-10T22:37:54.259 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-10T22:37:54.259 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-10T22:37:54.259 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:54.259 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.259 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.259 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.259 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.259 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_file": { 2024-09-10T22:37:54.260 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_file", 2024-09-10T22:37:54.260 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-10T22:37:54.260 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.260 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:54.260 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-10T22:37:54.260 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.260 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.260 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.260 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:54.260 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.260 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.260 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.260 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.261 INFO:teuthology.orchestra.run.smithi019.stdout: "max_requests": { 2024-09-10T22:37:54.261 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "max_requests", 2024-09-10T22:37:54.261 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "int", 2024-09-10T22:37:54.261 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.261 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-10T22:37:54.261 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "500", 2024-09-10T22:37:54.261 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.261 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.261 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.261 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number.if un-finished request is removed, error message will be logged in the ceph-mgr log.", 2024-09-10T22:37:54.261 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.261 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.261 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.262 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.262 INFO:teuthology.orchestra.run.smithi019.stdout: "server_addr": { 2024-09-10T22:37:54.262 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "server_addr", 2024-09-10T22:37:54.262 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-10T22:37:54.262 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.262 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-10T22:37:54.262 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-10T22:37:54.262 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.262 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.262 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.262 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:54.262 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.262 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.262 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.263 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.263 INFO:teuthology.orchestra.run.smithi019.stdout: "server_port": { 2024-09-10T22:37:54.263 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "server_port", 2024-09-10T22:37:54.263 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-10T22:37:54.263 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.263 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-10T22:37:54.263 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-10T22:37:54.263 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.263 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.263 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.263 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:54.263 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.263 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.264 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.264 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.264 INFO:teuthology.orchestra.run.smithi019.stdout: "sqlite3_killpoint": { 2024-09-10T22:37:54.264 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "sqlite3_killpoint", 2024-09-10T22:37:54.264 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "int", 2024-09-10T22:37:54.264 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "dev", 2024-09-10T22:37:54.264 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:54.264 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "0", 2024-09-10T22:37:54.264 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.264 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.264 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.264 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:54.265 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.265 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.265 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.265 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-10T22:37:54.265 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-10T22:37:54.265 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.265 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-10T22:37:54.265 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "rgw", 2024-09-10T22:37:54.265 INFO:teuthology.orchestra.run.smithi019.stdout: "can_run": true, 2024-09-10T22:37:54.265 INFO:teuthology.orchestra.run.smithi019.stdout: "error_string": "", 2024-09-10T22:37:54.265 INFO:teuthology.orchestra.run.smithi019.stdout: "module_options": { 2024-09-10T22:37:54.265 INFO:teuthology.orchestra.run.smithi019.stdout: "log_level": { 2024-09-10T22:37:54.265 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_level", 2024-09-10T22:37:54.266 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-10T22:37:54.266 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.266 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:54.266 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-10T22:37:54.266 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.266 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.266 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-10T22:37:54.266 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-10T22:37:54.266 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-10T22:37:54.266 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-10T22:37:54.266 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-10T22:37:54.266 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-10T22:37:54.266 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-10T22:37:54.266 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-10T22:37:54.267 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:54.267 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.267 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.267 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.267 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.267 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster": { 2024-09-10T22:37:54.267 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster", 2024-09-10T22:37:54.267 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-10T22:37:54.267 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.267 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:54.267 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-10T22:37:54.267 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.267 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.268 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.268 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:54.268 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.268 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.268 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.268 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.268 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster_level": { 2024-09-10T22:37:54.268 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster_level", 2024-09-10T22:37:54.268 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-10T22:37:54.268 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.268 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:54.269 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "info", 2024-09-10T22:37:54.269 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.269 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.269 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-10T22:37:54.269 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-10T22:37:54.269 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-10T22:37:54.269 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-10T22:37:54.269 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-10T22:37:54.269 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-10T22:37:54.269 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-10T22:37:54.269 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-10T22:37:54.269 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:54.269 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.269 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.270 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.270 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.270 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_file": { 2024-09-10T22:37:54.270 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_file", 2024-09-10T22:37:54.270 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-10T22:37:54.270 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.270 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:54.270 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-10T22:37:54.270 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.270 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.270 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.270 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:54.271 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.271 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.271 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.271 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.271 INFO:teuthology.orchestra.run.smithi019.stdout: "secondary_zone_period_retry_limit": { 2024-09-10T22:37:54.271 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "secondary_zone_period_retry_limit", 2024-09-10T22:37:54.271 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "int", 2024-09-10T22:37:54.271 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.271 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-10T22:37:54.271 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "5", 2024-09-10T22:37:54.271 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.271 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.271 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.272 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "RGW module period update retry limit for secondary site", 2024-09-10T22:37:54.272 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.272 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.272 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.272 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.272 INFO:teuthology.orchestra.run.smithi019.stdout: "sqlite3_killpoint": { 2024-09-10T22:37:54.272 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "sqlite3_killpoint", 2024-09-10T22:37:54.272 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "int", 2024-09-10T22:37:54.272 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "dev", 2024-09-10T22:37:54.272 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:54.272 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "0", 2024-09-10T22:37:54.272 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.273 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.273 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.273 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:54.273 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.273 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.273 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.273 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-10T22:37:54.273 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-10T22:37:54.273 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.273 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-10T22:37:54.273 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "rook", 2024-09-10T22:37:54.273 INFO:teuthology.orchestra.run.smithi019.stdout: "can_run": true, 2024-09-10T22:37:54.273 INFO:teuthology.orchestra.run.smithi019.stdout: "error_string": "", 2024-09-10T22:37:54.274 INFO:teuthology.orchestra.run.smithi019.stdout: "module_options": { 2024-09-10T22:37:54.274 INFO:teuthology.orchestra.run.smithi019.stdout: "log_level": { 2024-09-10T22:37:54.274 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_level", 2024-09-10T22:37:54.274 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-10T22:37:54.274 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.274 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:54.274 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-10T22:37:54.274 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.274 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.274 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-10T22:37:54.274 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-10T22:37:54.274 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-10T22:37:54.274 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-10T22:37:54.274 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-10T22:37:54.275 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-10T22:37:54.275 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-10T22:37:54.275 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-10T22:37:54.275 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:54.275 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.275 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.275 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.275 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.275 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster": { 2024-09-10T22:37:54.275 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster", 2024-09-10T22:37:54.275 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-10T22:37:54.275 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.275 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:54.276 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-10T22:37:54.276 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.276 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.276 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.276 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:54.276 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.276 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.276 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.276 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.276 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster_level": { 2024-09-10T22:37:54.276 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster_level", 2024-09-10T22:37:54.276 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-10T22:37:54.276 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.277 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:54.277 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "info", 2024-09-10T22:37:54.277 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.277 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.277 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-10T22:37:54.277 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-10T22:37:54.277 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-10T22:37:54.277 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-10T22:37:54.277 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-10T22:37:54.277 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-10T22:37:54.277 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-10T22:37:54.277 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-10T22:37:54.277 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:54.278 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.278 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.278 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.278 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.278 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_file": { 2024-09-10T22:37:54.278 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_file", 2024-09-10T22:37:54.278 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-10T22:37:54.278 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.278 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:54.278 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-10T22:37:54.278 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.278 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.278 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.278 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:54.279 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.279 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.279 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.279 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.279 INFO:teuthology.orchestra.run.smithi019.stdout: "sqlite3_killpoint": { 2024-09-10T22:37:54.279 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "sqlite3_killpoint", 2024-09-10T22:37:54.279 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "int", 2024-09-10T22:37:54.279 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "dev", 2024-09-10T22:37:54.279 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:54.279 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "0", 2024-09-10T22:37:54.279 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.279 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.279 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.280 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:54.280 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.280 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.280 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.280 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.280 INFO:teuthology.orchestra.run.smithi019.stdout: "storage_class": { 2024-09-10T22:37:54.280 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "storage_class", 2024-09-10T22:37:54.280 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-10T22:37:54.280 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.280 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-10T22:37:54.280 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "local", 2024-09-10T22:37:54.280 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.280 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.281 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.281 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "storage class name for LSO-discovered PVs", 2024-09-10T22:37:54.281 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.281 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.281 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.281 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-10T22:37:54.281 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-10T22:37:54.281 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.281 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-10T22:37:54.281 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "selftest", 2024-09-10T22:37:54.281 INFO:teuthology.orchestra.run.smithi019.stdout: "can_run": true, 2024-09-10T22:37:54.281 INFO:teuthology.orchestra.run.smithi019.stdout: "error_string": "", 2024-09-10T22:37:54.281 INFO:teuthology.orchestra.run.smithi019.stdout: "module_options": { 2024-09-10T22:37:54.282 INFO:teuthology.orchestra.run.smithi019.stdout: "log_level": { 2024-09-10T22:37:54.282 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_level", 2024-09-10T22:37:54.282 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-10T22:37:54.282 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.282 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:54.282 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-10T22:37:54.282 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.282 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.282 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-10T22:37:54.282 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-10T22:37:54.282 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-10T22:37:54.282 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-10T22:37:54.282 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-10T22:37:54.283 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-10T22:37:54.283 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-10T22:37:54.283 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-10T22:37:54.283 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:54.283 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.283 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.283 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.283 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.283 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster": { 2024-09-10T22:37:54.283 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster", 2024-09-10T22:37:54.283 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-10T22:37:54.283 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.284 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:54.284 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-10T22:37:54.284 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.284 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.284 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.284 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:54.284 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.284 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.284 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.284 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.284 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster_level": { 2024-09-10T22:37:54.284 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster_level", 2024-09-10T22:37:54.284 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-10T22:37:54.285 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.285 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:54.285 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "info", 2024-09-10T22:37:54.285 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.285 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.285 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-10T22:37:54.285 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-10T22:37:54.285 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-10T22:37:54.285 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-10T22:37:54.285 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-10T22:37:54.285 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-10T22:37:54.285 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-10T22:37:54.286 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-10T22:37:54.286 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:54.286 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.286 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.286 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.286 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.286 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_file": { 2024-09-10T22:37:54.286 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_file", 2024-09-10T22:37:54.286 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-10T22:37:54.286 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.286 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:54.286 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-10T22:37:54.287 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.287 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.287 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.287 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:54.287 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.287 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.287 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.287 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.287 INFO:teuthology.orchestra.run.smithi019.stdout: "roption1": { 2024-09-10T22:37:54.287 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "roption1", 2024-09-10T22:37:54.287 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-10T22:37:54.287 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.287 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-10T22:37:54.288 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-10T22:37:54.288 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.288 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.288 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.288 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:54.288 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.288 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.288 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.288 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.288 INFO:teuthology.orchestra.run.smithi019.stdout: "roption2": { 2024-09-10T22:37:54.288 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "roption2", 2024-09-10T22:37:54.288 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-10T22:37:54.289 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.289 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-10T22:37:54.289 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "xyz", 2024-09-10T22:37:54.289 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.289 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.289 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.289 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:54.289 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.289 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.289 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.289 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.289 INFO:teuthology.orchestra.run.smithi019.stdout: "rwoption1": { 2024-09-10T22:37:54.289 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "rwoption1", 2024-09-10T22:37:54.289 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-10T22:37:54.290 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.290 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-10T22:37:54.290 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-10T22:37:54.290 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.290 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.290 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.290 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:54.290 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.290 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.290 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.290 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.290 INFO:teuthology.orchestra.run.smithi019.stdout: "rwoption2": { 2024-09-10T22:37:54.290 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "rwoption2", 2024-09-10T22:37:54.290 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "int", 2024-09-10T22:37:54.291 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.291 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-10T22:37:54.291 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-10T22:37:54.291 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.291 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.291 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.291 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:54.291 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.291 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.291 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.291 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.291 INFO:teuthology.orchestra.run.smithi019.stdout: "rwoption3": { 2024-09-10T22:37:54.291 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "rwoption3", 2024-09-10T22:37:54.291 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "float", 2024-09-10T22:37:54.292 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.292 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-10T22:37:54.292 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-10T22:37:54.292 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.292 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.292 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.292 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:54.292 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.292 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.292 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.292 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.292 INFO:teuthology.orchestra.run.smithi019.stdout: "rwoption4": { 2024-09-10T22:37:54.292 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "rwoption4", 2024-09-10T22:37:54.292 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-10T22:37:54.293 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.293 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-10T22:37:54.293 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-10T22:37:54.293 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.293 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.293 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.293 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:54.293 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.293 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.293 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.293 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.293 INFO:teuthology.orchestra.run.smithi019.stdout: "rwoption5": { 2024-09-10T22:37:54.293 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "rwoption5", 2024-09-10T22:37:54.294 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-10T22:37:54.294 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.294 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-10T22:37:54.294 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-10T22:37:54.294 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.294 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.294 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.294 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:54.294 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.294 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.294 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.294 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.294 INFO:teuthology.orchestra.run.smithi019.stdout: "rwoption6": { 2024-09-10T22:37:54.294 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "rwoption6", 2024-09-10T22:37:54.295 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-10T22:37:54.295 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.295 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-10T22:37:54.295 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "True", 2024-09-10T22:37:54.295 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.295 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.295 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.295 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:54.295 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.295 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.295 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.295 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.295 INFO:teuthology.orchestra.run.smithi019.stdout: "rwoption7": { 2024-09-10T22:37:54.295 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "rwoption7", 2024-09-10T22:37:54.296 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "int", 2024-09-10T22:37:54.296 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.296 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-10T22:37:54.296 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-10T22:37:54.296 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "1", 2024-09-10T22:37:54.296 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "42", 2024-09-10T22:37:54.296 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.296 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:54.296 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.296 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.296 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.296 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.296 INFO:teuthology.orchestra.run.smithi019.stdout: "sqlite3_killpoint": { 2024-09-10T22:37:54.297 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "sqlite3_killpoint", 2024-09-10T22:37:54.297 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "int", 2024-09-10T22:37:54.297 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "dev", 2024-09-10T22:37:54.297 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:54.297 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "0", 2024-09-10T22:37:54.297 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.297 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.297 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.297 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:54.297 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.297 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.297 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.297 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.297 INFO:teuthology.orchestra.run.smithi019.stdout: "testkey": { 2024-09-10T22:37:54.298 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "testkey", 2024-09-10T22:37:54.298 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-10T22:37:54.298 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.298 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-10T22:37:54.298 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-10T22:37:54.298 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.298 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.298 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.298 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:54.298 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.298 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.298 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.298 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.299 INFO:teuthology.orchestra.run.smithi019.stdout: "testlkey": { 2024-09-10T22:37:54.299 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "testlkey", 2024-09-10T22:37:54.299 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-10T22:37:54.299 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.299 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-10T22:37:54.299 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-10T22:37:54.299 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.299 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.299 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.299 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:54.299 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.299 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.299 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.299 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.300 INFO:teuthology.orchestra.run.smithi019.stdout: "testnewline": { 2024-09-10T22:37:54.300 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "testnewline", 2024-09-10T22:37:54.300 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-10T22:37:54.300 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.300 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-10T22:37:54.300 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-10T22:37:54.300 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.300 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.300 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.300 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:54.300 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.300 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.300 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.301 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-10T22:37:54.301 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-10T22:37:54.301 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.301 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-10T22:37:54.301 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "smb", 2024-09-10T22:37:54.301 INFO:teuthology.orchestra.run.smithi019.stdout: "can_run": true, 2024-09-10T22:37:54.301 INFO:teuthology.orchestra.run.smithi019.stdout: "error_string": "", 2024-09-10T22:37:54.301 INFO:teuthology.orchestra.run.smithi019.stdout: "module_options": { 2024-09-10T22:37:54.301 INFO:teuthology.orchestra.run.smithi019.stdout: "internal_store_backend": { 2024-09-10T22:37:54.301 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "internal_store_backend", 2024-09-10T22:37:54.301 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-10T22:37:54.301 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "dev", 2024-09-10T22:37:54.301 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-10T22:37:54.301 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-10T22:37:54.302 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.302 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.302 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.302 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "set internal store backend. for develoment and testing only", 2024-09-10T22:37:54.302 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.302 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.302 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.302 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.302 INFO:teuthology.orchestra.run.smithi019.stdout: "log_level": { 2024-09-10T22:37:54.302 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_level", 2024-09-10T22:37:54.302 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-10T22:37:54.302 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.302 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:54.302 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-10T22:37:54.303 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.303 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.303 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-10T22:37:54.303 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-10T22:37:54.303 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-10T22:37:54.303 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-10T22:37:54.303 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-10T22:37:54.303 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-10T22:37:54.303 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-10T22:37:54.303 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-10T22:37:54.303 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:54.303 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.303 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.304 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.304 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.304 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster": { 2024-09-10T22:37:54.304 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster", 2024-09-10T22:37:54.304 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-10T22:37:54.304 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.304 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:54.304 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-10T22:37:54.304 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.304 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.304 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.304 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:54.305 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.305 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.305 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.305 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.305 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster_level": { 2024-09-10T22:37:54.305 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster_level", 2024-09-10T22:37:54.305 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-10T22:37:54.305 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.305 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:54.305 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "info", 2024-09-10T22:37:54.305 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.305 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.305 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-10T22:37:54.306 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-10T22:37:54.306 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-10T22:37:54.306 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-10T22:37:54.306 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-10T22:37:54.306 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-10T22:37:54.306 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-10T22:37:54.306 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-10T22:37:54.306 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:54.306 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.306 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.306 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.306 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.306 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_file": { 2024-09-10T22:37:54.306 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_file", 2024-09-10T22:37:54.307 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-10T22:37:54.307 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.307 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:54.307 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-10T22:37:54.307 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.307 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.307 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.307 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:54.307 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.307 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.307 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.307 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.307 INFO:teuthology.orchestra.run.smithi019.stdout: "sqlite3_killpoint": { 2024-09-10T22:37:54.307 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "sqlite3_killpoint", 2024-09-10T22:37:54.307 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "int", 2024-09-10T22:37:54.308 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "dev", 2024-09-10T22:37:54.308 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:54.308 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "0", 2024-09-10T22:37:54.308 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.308 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.308 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.308 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:54.308 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.308 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.308 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.308 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.308 INFO:teuthology.orchestra.run.smithi019.stdout: "update_orchestration": { 2024-09-10T22:37:54.308 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "update_orchestration", 2024-09-10T22:37:54.309 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-10T22:37:54.309 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.309 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-10T22:37:54.309 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "True", 2024-09-10T22:37:54.309 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.309 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.309 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.309 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "automatically update orchestration when smb resources are changed", 2024-09-10T22:37:54.309 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.309 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.309 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.309 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-10T22:37:54.309 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-10T22:37:54.310 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.310 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-10T22:37:54.310 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "snap_schedule", 2024-09-10T22:37:54.310 INFO:teuthology.orchestra.run.smithi019.stdout: "can_run": true, 2024-09-10T22:37:54.310 INFO:teuthology.orchestra.run.smithi019.stdout: "error_string": "", 2024-09-10T22:37:54.310 INFO:teuthology.orchestra.run.smithi019.stdout: "module_options": { 2024-09-10T22:37:54.310 INFO:teuthology.orchestra.run.smithi019.stdout: "allow_m_granularity": { 2024-09-10T22:37:54.310 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "allow_m_granularity", 2024-09-10T22:37:54.310 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-10T22:37:54.310 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.310 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:54.310 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-10T22:37:54.311 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.311 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.311 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.311 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "allow minute scheduled snapshots", 2024-09-10T22:37:54.311 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.311 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.311 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.311 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.311 INFO:teuthology.orchestra.run.smithi019.stdout: "dump_on_update": { 2024-09-10T22:37:54.311 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "dump_on_update", 2024-09-10T22:37:54.311 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-10T22:37:54.311 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.311 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:54.311 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-10T22:37:54.312 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.312 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.312 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.312 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "dump database to debug log on update", 2024-09-10T22:37:54.312 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.312 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.312 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.312 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.312 INFO:teuthology.orchestra.run.smithi019.stdout: "log_level": { 2024-09-10T22:37:54.312 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_level", 2024-09-10T22:37:54.312 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-10T22:37:54.312 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.313 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:54.313 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-10T22:37:54.313 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.313 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.313 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-10T22:37:54.313 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-10T22:37:54.313 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-10T22:37:54.313 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-10T22:37:54.313 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-10T22:37:54.313 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-10T22:37:54.313 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-10T22:37:54.313 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-10T22:37:54.314 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:54.314 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.314 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.314 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.314 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.314 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster": { 2024-09-10T22:37:54.314 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster", 2024-09-10T22:37:54.314 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-10T22:37:54.314 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.314 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:54.314 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-10T22:37:54.314 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.314 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.315 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.315 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:54.315 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.315 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.315 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.315 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.315 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster_level": { 2024-09-10T22:37:54.315 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster_level", 2024-09-10T22:37:54.315 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-10T22:37:54.315 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.315 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:54.315 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "info", 2024-09-10T22:37:54.315 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.316 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.316 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-10T22:37:54.316 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-10T22:37:54.316 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-10T22:37:54.316 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-10T22:37:54.316 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-10T22:37:54.316 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-10T22:37:54.316 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-10T22:37:54.316 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-10T22:37:54.316 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:54.316 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.316 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.317 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.317 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.317 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_file": { 2024-09-10T22:37:54.317 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_file", 2024-09-10T22:37:54.317 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-10T22:37:54.317 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.317 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:54.317 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-10T22:37:54.317 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.317 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.317 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.317 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:54.317 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.318 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.318 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.318 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.318 INFO:teuthology.orchestra.run.smithi019.stdout: "sqlite3_killpoint": { 2024-09-10T22:37:54.318 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "sqlite3_killpoint", 2024-09-10T22:37:54.318 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "int", 2024-09-10T22:37:54.318 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "dev", 2024-09-10T22:37:54.318 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:54.318 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "0", 2024-09-10T22:37:54.318 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.318 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.318 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.318 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:54.319 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.319 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.319 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.319 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-10T22:37:54.319 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-10T22:37:54.319 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.319 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-10T22:37:54.319 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "stats", 2024-09-10T22:37:54.319 INFO:teuthology.orchestra.run.smithi019.stdout: "can_run": true, 2024-09-10T22:37:54.319 INFO:teuthology.orchestra.run.smithi019.stdout: "error_string": "", 2024-09-10T22:37:54.319 INFO:teuthology.orchestra.run.smithi019.stdout: "module_options": { 2024-09-10T22:37:54.319 INFO:teuthology.orchestra.run.smithi019.stdout: "log_level": { 2024-09-10T22:37:54.319 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_level", 2024-09-10T22:37:54.319 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-10T22:37:54.320 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.320 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:54.320 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-10T22:37:54.320 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.320 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.320 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-10T22:37:54.320 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-10T22:37:54.320 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-10T22:37:54.320 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-10T22:37:54.320 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-10T22:37:54.320 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-10T22:37:54.320 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-10T22:37:54.321 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-10T22:37:54.321 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:54.321 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.321 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.321 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.321 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.321 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster": { 2024-09-10T22:37:54.321 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster", 2024-09-10T22:37:54.321 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-10T22:37:54.321 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.321 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:54.321 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-10T22:37:54.321 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.322 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.322 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.322 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:54.322 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.322 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.322 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.322 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.322 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster_level": { 2024-09-10T22:37:54.322 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster_level", 2024-09-10T22:37:54.322 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-10T22:37:54.322 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.322 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:54.322 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "info", 2024-09-10T22:37:54.322 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.323 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.323 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-10T22:37:54.323 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-10T22:37:54.323 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-10T22:37:54.323 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-10T22:37:54.323 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-10T22:37:54.323 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-10T22:37:54.323 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-10T22:37:54.323 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-10T22:37:54.323 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:54.323 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.323 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.323 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.323 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.324 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_file": { 2024-09-10T22:37:54.324 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_file", 2024-09-10T22:37:54.324 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-10T22:37:54.324 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.324 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:54.324 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-10T22:37:54.324 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.324 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.324 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.324 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:54.324 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.324 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.324 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.325 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.325 INFO:teuthology.orchestra.run.smithi019.stdout: "sqlite3_killpoint": { 2024-09-10T22:37:54.325 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "sqlite3_killpoint", 2024-09-10T22:37:54.325 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "int", 2024-09-10T22:37:54.325 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "dev", 2024-09-10T22:37:54.325 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:54.325 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "0", 2024-09-10T22:37:54.325 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.325 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.325 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.325 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:54.325 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.325 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.326 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.326 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-10T22:37:54.326 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-10T22:37:54.326 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.326 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-10T22:37:54.326 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "status", 2024-09-10T22:37:54.326 INFO:teuthology.orchestra.run.smithi019.stdout: "can_run": true, 2024-09-10T22:37:54.326 INFO:teuthology.orchestra.run.smithi019.stdout: "error_string": "", 2024-09-10T22:37:54.326 INFO:teuthology.orchestra.run.smithi019.stdout: "module_options": { 2024-09-10T22:37:54.326 INFO:teuthology.orchestra.run.smithi019.stdout: "log_level": { 2024-09-10T22:37:54.326 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_level", 2024-09-10T22:37:54.326 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-10T22:37:54.326 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.326 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:54.326 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-10T22:37:54.327 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.327 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.327 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-10T22:37:54.327 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-10T22:37:54.327 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-10T22:37:54.327 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-10T22:37:54.327 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-10T22:37:54.327 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-10T22:37:54.327 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-10T22:37:54.327 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-10T22:37:54.327 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:54.327 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.327 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.328 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.328 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.328 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster": { 2024-09-10T22:37:54.328 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster", 2024-09-10T22:37:54.328 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-10T22:37:54.328 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.328 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:54.328 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-10T22:37:54.328 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.328 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.328 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.328 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:54.328 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.329 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.329 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.329 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.329 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster_level": { 2024-09-10T22:37:54.329 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster_level", 2024-09-10T22:37:54.329 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-10T22:37:54.329 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.329 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:54.329 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "info", 2024-09-10T22:37:54.329 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.329 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.329 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-10T22:37:54.329 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-10T22:37:54.329 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-10T22:37:54.330 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-10T22:37:54.330 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-10T22:37:54.330 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-10T22:37:54.330 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-10T22:37:54.330 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-10T22:37:54.330 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:54.330 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.330 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.330 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.330 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.330 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_file": { 2024-09-10T22:37:54.330 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_file", 2024-09-10T22:37:54.330 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-10T22:37:54.331 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.331 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:54.331 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-10T22:37:54.331 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.331 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.331 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.331 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:54.331 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.331 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.331 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.331 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.331 INFO:teuthology.orchestra.run.smithi019.stdout: "sqlite3_killpoint": { 2024-09-10T22:37:54.331 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "sqlite3_killpoint", 2024-09-10T22:37:54.332 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "int", 2024-09-10T22:37:54.332 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "dev", 2024-09-10T22:37:54.332 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:54.332 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "0", 2024-09-10T22:37:54.332 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.332 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.332 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.332 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:54.332 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.332 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.332 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.332 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-10T22:37:54.332 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-10T22:37:54.333 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.333 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-10T22:37:54.333 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "telegraf", 2024-09-10T22:37:54.333 INFO:teuthology.orchestra.run.smithi019.stdout: "can_run": true, 2024-09-10T22:37:54.333 INFO:teuthology.orchestra.run.smithi019.stdout: "error_string": "", 2024-09-10T22:37:54.333 INFO:teuthology.orchestra.run.smithi019.stdout: "module_options": { 2024-09-10T22:37:54.333 INFO:teuthology.orchestra.run.smithi019.stdout: "address": { 2024-09-10T22:37:54.333 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "address", 2024-09-10T22:37:54.333 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-10T22:37:54.333 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.333 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-10T22:37:54.333 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2024-09-10T22:37:54.333 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.334 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.334 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.334 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:54.334 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.334 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.334 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.334 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.334 INFO:teuthology.orchestra.run.smithi019.stdout: "interval": { 2024-09-10T22:37:54.334 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "interval", 2024-09-10T22:37:54.334 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "secs", 2024-09-10T22:37:54.334 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.334 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-10T22:37:54.335 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "15", 2024-09-10T22:37:54.335 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.335 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.335 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.335 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:54.335 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.335 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.335 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.335 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.335 INFO:teuthology.orchestra.run.smithi019.stdout: "log_level": { 2024-09-10T22:37:54.335 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_level", 2024-09-10T22:37:54.335 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-10T22:37:54.335 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.335 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:54.336 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-10T22:37:54.336 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.336 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.336 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-10T22:37:54.336 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-10T22:37:54.336 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-10T22:37:54.336 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-10T22:37:54.336 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-10T22:37:54.336 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-10T22:37:54.336 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-10T22:37:54.336 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-10T22:37:54.336 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:54.337 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.337 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.337 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.337 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.337 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster": { 2024-09-10T22:37:54.337 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster", 2024-09-10T22:37:54.337 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-10T22:37:54.337 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.337 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:54.337 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-10T22:37:54.337 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.337 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.337 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.338 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:54.338 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.338 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.338 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.338 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.338 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster_level": { 2024-09-10T22:37:54.338 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster_level", 2024-09-10T22:37:54.338 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-10T22:37:54.338 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.338 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:54.338 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "info", 2024-09-10T22:37:54.338 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.338 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.338 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-10T22:37:54.339 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-10T22:37:54.339 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-10T22:37:54.339 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-10T22:37:54.339 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-10T22:37:54.339 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-10T22:37:54.339 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-10T22:37:54.339 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-10T22:37:54.339 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:54.339 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.339 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.339 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.339 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.339 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_file": { 2024-09-10T22:37:54.339 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_file", 2024-09-10T22:37:54.340 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-10T22:37:54.340 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.340 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:54.340 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-10T22:37:54.340 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.340 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.340 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.340 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:54.340 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.340 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.340 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.340 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.340 INFO:teuthology.orchestra.run.smithi019.stdout: "sqlite3_killpoint": { 2024-09-10T22:37:54.341 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "sqlite3_killpoint", 2024-09-10T22:37:54.341 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "int", 2024-09-10T22:37:54.341 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "dev", 2024-09-10T22:37:54.341 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:54.341 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "0", 2024-09-10T22:37:54.341 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.341 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.341 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.341 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:54.341 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.341 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.341 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.341 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-10T22:37:54.342 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-10T22:37:54.342 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.342 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-10T22:37:54.342 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "telemetry", 2024-09-10T22:37:54.342 INFO:teuthology.orchestra.run.smithi019.stdout: "can_run": true, 2024-09-10T22:37:54.342 INFO:teuthology.orchestra.run.smithi019.stdout: "error_string": "", 2024-09-10T22:37:54.342 INFO:teuthology.orchestra.run.smithi019.stdout: "module_options": { 2024-09-10T22:37:54.342 INFO:teuthology.orchestra.run.smithi019.stdout: "channel_basic": { 2024-09-10T22:37:54.342 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "channel_basic", 2024-09-10T22:37:54.342 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-10T22:37:54.342 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.342 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-10T22:37:54.342 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "True", 2024-09-10T22:37:54.343 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.343 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.343 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.343 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "Share basic cluster information (size, version)", 2024-09-10T22:37:54.343 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.343 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.343 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.343 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.343 INFO:teuthology.orchestra.run.smithi019.stdout: "channel_crash": { 2024-09-10T22:37:54.343 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "channel_crash", 2024-09-10T22:37:54.343 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-10T22:37:54.343 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.343 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-10T22:37:54.344 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "True", 2024-09-10T22:37:54.344 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.344 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.344 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.344 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2024-09-10T22:37:54.344 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.344 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.344 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.344 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.344 INFO:teuthology.orchestra.run.smithi019.stdout: "channel_device": { 2024-09-10T22:37:54.344 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "channel_device", 2024-09-10T22:37:54.344 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-10T22:37:54.344 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.345 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-10T22:37:54.345 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "True", 2024-09-10T22:37:54.345 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.345 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.345 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.345 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2024-09-10T22:37:54.345 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.345 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.345 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.345 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.345 INFO:teuthology.orchestra.run.smithi019.stdout: "channel_ident": { 2024-09-10T22:37:54.345 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "channel_ident", 2024-09-10T22:37:54.345 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-10T22:37:54.346 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.346 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-10T22:37:54.346 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-10T22:37:54.346 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.346 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.346 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.346 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2024-09-10T22:37:54.346 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.346 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.346 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.346 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.346 INFO:teuthology.orchestra.run.smithi019.stdout: "channel_perf": { 2024-09-10T22:37:54.346 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "channel_perf", 2024-09-10T22:37:54.347 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-10T22:37:54.347 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.347 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-10T22:37:54.347 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-10T22:37:54.347 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.347 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.347 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.347 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "Share various performance metrics of a cluster", 2024-09-10T22:37:54.347 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.347 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.347 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.347 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.347 INFO:teuthology.orchestra.run.smithi019.stdout: "contact": { 2024-09-10T22:37:54.347 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "contact", 2024-09-10T22:37:54.348 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-10T22:37:54.348 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.348 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-10T22:37:54.348 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-10T22:37:54.348 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.348 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.348 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.348 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:54.348 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.348 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.348 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.348 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.349 INFO:teuthology.orchestra.run.smithi019.stdout: "description": { 2024-09-10T22:37:54.349 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "description", 2024-09-10T22:37:54.349 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-10T22:37:54.349 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.349 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-10T22:37:54.349 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-10T22:37:54.349 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.349 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.349 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.349 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:54.349 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.349 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.349 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.349 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.350 INFO:teuthology.orchestra.run.smithi019.stdout: "device_url": { 2024-09-10T22:37:54.350 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "device_url", 2024-09-10T22:37:54.350 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-10T22:37:54.350 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.350 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-10T22:37:54.350 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "https://telemetry.ceph.com/device", 2024-09-10T22:37:54.350 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.350 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.350 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.350 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:54.350 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.350 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.350 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.351 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.351 INFO:teuthology.orchestra.run.smithi019.stdout: "enabled": { 2024-09-10T22:37:54.351 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "enabled", 2024-09-10T22:37:54.351 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-10T22:37:54.351 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.352 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-10T22:37:54.352 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-10T22:37:54.352 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.352 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.352 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.352 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:54.352 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.352 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.352 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.352 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.353 INFO:teuthology.orchestra.run.smithi019.stdout: "interval": { 2024-09-10T22:37:54.353 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "interval", 2024-09-10T22:37:54.353 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "int", 2024-09-10T22:37:54.353 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.353 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-10T22:37:54.353 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "24", 2024-09-10T22:37:54.353 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "8", 2024-09-10T22:37:54.353 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.353 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.353 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:54.353 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.353 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.353 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.353 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.354 INFO:teuthology.orchestra.run.smithi019.stdout: "last_opt_revision": { 2024-09-10T22:37:54.354 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "last_opt_revision", 2024-09-10T22:37:54.354 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "int", 2024-09-10T22:37:54.354 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.354 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-10T22:37:54.354 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "1", 2024-09-10T22:37:54.354 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.354 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.354 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.354 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:54.354 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.354 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.354 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.355 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.355 INFO:teuthology.orchestra.run.smithi019.stdout: "leaderboard": { 2024-09-10T22:37:54.355 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "leaderboard", 2024-09-10T22:37:54.355 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-10T22:37:54.355 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.355 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-10T22:37:54.355 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-10T22:37:54.355 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.355 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.355 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.355 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:54.355 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.355 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.355 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.356 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.356 INFO:teuthology.orchestra.run.smithi019.stdout: "leaderboard_description": { 2024-09-10T22:37:54.356 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "leaderboard_description", 2024-09-10T22:37:54.356 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-10T22:37:54.356 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.356 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-10T22:37:54.356 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-10T22:37:54.356 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.356 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.356 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.356 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:54.356 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.356 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.357 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.357 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.357 INFO:teuthology.orchestra.run.smithi019.stdout: "log_level": { 2024-09-10T22:37:54.357 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_level", 2024-09-10T22:37:54.357 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-10T22:37:54.357 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.357 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:54.357 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-10T22:37:54.357 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.357 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.357 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-10T22:37:54.357 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-10T22:37:54.358 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-10T22:37:54.358 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-10T22:37:54.358 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-10T22:37:54.358 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-10T22:37:54.358 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-10T22:37:54.358 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-10T22:37:54.358 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:54.358 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.358 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.358 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.358 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.358 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster": { 2024-09-10T22:37:54.358 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster", 2024-09-10T22:37:54.359 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-10T22:37:54.359 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.359 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:54.359 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-10T22:37:54.359 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.359 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.359 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.359 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:54.359 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.359 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.359 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.359 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.359 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster_level": { 2024-09-10T22:37:54.360 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster_level", 2024-09-10T22:37:54.360 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-10T22:37:54.360 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.360 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:54.360 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "info", 2024-09-10T22:37:54.360 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.360 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.360 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-10T22:37:54.360 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-10T22:37:54.360 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-10T22:37:54.360 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-10T22:37:54.360 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-10T22:37:54.360 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-10T22:37:54.361 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-10T22:37:54.361 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-10T22:37:54.361 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:54.361 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.361 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.361 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.361 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.361 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_file": { 2024-09-10T22:37:54.361 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_file", 2024-09-10T22:37:54.361 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-10T22:37:54.361 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.361 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:54.361 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-10T22:37:54.362 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.362 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.362 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.362 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:54.362 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.362 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.362 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.362 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.362 INFO:teuthology.orchestra.run.smithi019.stdout: "organization": { 2024-09-10T22:37:54.362 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "organization", 2024-09-10T22:37:54.362 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-10T22:37:54.362 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.362 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-10T22:37:54.362 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-10T22:37:54.363 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.363 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.363 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.363 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:54.363 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.363 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.363 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.363 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.363 INFO:teuthology.orchestra.run.smithi019.stdout: "proxy": { 2024-09-10T22:37:54.363 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "proxy", 2024-09-10T22:37:54.363 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-10T22:37:54.363 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.363 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-10T22:37:54.364 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-10T22:37:54.364 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.364 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.364 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.364 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:54.364 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.364 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.364 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.364 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.364 INFO:teuthology.orchestra.run.smithi019.stdout: "sqlite3_killpoint": { 2024-09-10T22:37:54.364 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "sqlite3_killpoint", 2024-09-10T22:37:54.364 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "int", 2024-09-10T22:37:54.364 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "dev", 2024-09-10T22:37:54.365 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:54.365 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "0", 2024-09-10T22:37:54.365 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.365 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.365 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.365 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:54.365 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.365 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.365 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.365 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.365 INFO:teuthology.orchestra.run.smithi019.stdout: "url": { 2024-09-10T22:37:54.365 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "url", 2024-09-10T22:37:54.365 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-10T22:37:54.366 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.366 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-10T22:37:54.366 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "https://telemetry.ceph.com/report", 2024-09-10T22:37:54.366 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.366 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.366 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.366 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:54.366 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.366 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.366 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.366 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-10T22:37:54.366 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-10T22:37:54.366 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.367 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-10T22:37:54.367 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "test_orchestrator", 2024-09-10T22:37:54.367 INFO:teuthology.orchestra.run.smithi019.stdout: "can_run": true, 2024-09-10T22:37:54.367 INFO:teuthology.orchestra.run.smithi019.stdout: "error_string": "", 2024-09-10T22:37:54.367 INFO:teuthology.orchestra.run.smithi019.stdout: "module_options": { 2024-09-10T22:37:54.367 INFO:teuthology.orchestra.run.smithi019.stdout: "log_level": { 2024-09-10T22:37:54.367 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_level", 2024-09-10T22:37:54.367 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-10T22:37:54.367 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.367 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:54.367 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-10T22:37:54.367 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.367 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.367 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-10T22:37:54.368 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-10T22:37:54.368 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-10T22:37:54.368 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-10T22:37:54.368 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-10T22:37:54.368 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-10T22:37:54.368 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-10T22:37:54.368 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-10T22:37:54.368 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:54.368 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.368 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.368 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.368 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.368 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster": { 2024-09-10T22:37:54.368 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster", 2024-09-10T22:37:54.369 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-10T22:37:54.369 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.369 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:54.369 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-10T22:37:54.369 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.369 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.369 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.369 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:54.369 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.369 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.369 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.369 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.369 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster_level": { 2024-09-10T22:37:54.370 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster_level", 2024-09-10T22:37:54.370 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-10T22:37:54.370 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.370 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:54.370 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "info", 2024-09-10T22:37:54.370 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.370 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.370 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-10T22:37:54.370 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-10T22:37:54.370 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-10T22:37:54.370 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-10T22:37:54.370 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-10T22:37:54.370 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-10T22:37:54.370 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-10T22:37:54.371 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-10T22:37:54.371 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:54.371 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.371 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.371 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.371 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.371 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_file": { 2024-09-10T22:37:54.371 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_file", 2024-09-10T22:37:54.371 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-10T22:37:54.371 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.371 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:54.371 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-10T22:37:54.371 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.372 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.372 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.372 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:54.372 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.372 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.372 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.372 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.372 INFO:teuthology.orchestra.run.smithi019.stdout: "sqlite3_killpoint": { 2024-09-10T22:37:54.372 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "sqlite3_killpoint", 2024-09-10T22:37:54.372 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "int", 2024-09-10T22:37:54.372 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "dev", 2024-09-10T22:37:54.372 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:54.372 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "0", 2024-09-10T22:37:54.373 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.373 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.373 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.373 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:54.373 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.373 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.373 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.373 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-10T22:37:54.373 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-10T22:37:54.373 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.373 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-10T22:37:54.373 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "volumes", 2024-09-10T22:37:54.373 INFO:teuthology.orchestra.run.smithi019.stdout: "can_run": true, 2024-09-10T22:37:54.374 INFO:teuthology.orchestra.run.smithi019.stdout: "error_string": "", 2024-09-10T22:37:54.374 INFO:teuthology.orchestra.run.smithi019.stdout: "module_options": { 2024-09-10T22:37:54.374 INFO:teuthology.orchestra.run.smithi019.stdout: "log_level": { 2024-09-10T22:37:54.374 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_level", 2024-09-10T22:37:54.374 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-10T22:37:54.374 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.374 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:54.374 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-10T22:37:54.374 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.374 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.374 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-10T22:37:54.374 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-10T22:37:54.374 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-10T22:37:54.375 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-10T22:37:54.375 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-10T22:37:54.375 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-10T22:37:54.375 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-10T22:37:54.375 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-10T22:37:54.375 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:54.375 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.375 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.375 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.375 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.375 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster": { 2024-09-10T22:37:54.375 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster", 2024-09-10T22:37:54.375 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-10T22:37:54.376 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.376 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:54.376 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-10T22:37:54.376 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.376 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.376 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.376 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:54.376 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.376 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.376 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.376 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.376 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster_level": { 2024-09-10T22:37:54.376 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster_level", 2024-09-10T22:37:54.377 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-10T22:37:54.377 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.377 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:54.377 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "info", 2024-09-10T22:37:54.377 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.377 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.377 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-10T22:37:54.377 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-10T22:37:54.377 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-10T22:37:54.377 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-10T22:37:54.377 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-10T22:37:54.377 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-10T22:37:54.377 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-10T22:37:54.378 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-10T22:37:54.378 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:54.378 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.378 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.378 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.378 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.378 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_file": { 2024-09-10T22:37:54.378 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_file", 2024-09-10T22:37:54.378 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-10T22:37:54.378 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.378 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:54.378 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-10T22:37:54.378 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.379 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.379 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.379 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:54.379 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.379 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.379 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.379 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.379 INFO:teuthology.orchestra.run.smithi019.stdout: "max_concurrent_clones": { 2024-09-10T22:37:54.379 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "max_concurrent_clones", 2024-09-10T22:37:54.379 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "int", 2024-09-10T22:37:54.379 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.379 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-10T22:37:54.379 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "4", 2024-09-10T22:37:54.380 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.380 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.380 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.380 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "Number of asynchronous cloner threads", 2024-09-10T22:37:54.380 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.380 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.380 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.380 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.380 INFO:teuthology.orchestra.run.smithi019.stdout: "periodic_async_work": { 2024-09-10T22:37:54.380 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "periodic_async_work", 2024-09-10T22:37:54.380 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-10T22:37:54.380 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.381 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-10T22:37:54.381 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-10T22:37:54.381 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.381 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.381 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.381 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "Periodically check for async work", 2024-09-10T22:37:54.381 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.381 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.381 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.381 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.381 INFO:teuthology.orchestra.run.smithi019.stdout: "snapshot_clone_delay": { 2024-09-10T22:37:54.381 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "snapshot_clone_delay", 2024-09-10T22:37:54.381 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "int", 2024-09-10T22:37:54.382 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.382 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-10T22:37:54.382 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "0", 2024-09-10T22:37:54.382 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.382 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.382 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.382 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2024-09-10T22:37:54.382 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.382 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.382 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.382 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.382 INFO:teuthology.orchestra.run.smithi019.stdout: "snapshot_clone_no_wait": { 2024-09-10T22:37:54.382 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "snapshot_clone_no_wait", 2024-09-10T22:37:54.383 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-10T22:37:54.383 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.383 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-10T22:37:54.383 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "True", 2024-09-10T22:37:54.383 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.383 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.383 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.383 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "Reject subvolume clone request when cloner threads are busy", 2024-09-10T22:37:54.383 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.383 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.383 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.383 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.383 INFO:teuthology.orchestra.run.smithi019.stdout: "sqlite3_killpoint": { 2024-09-10T22:37:54.384 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "sqlite3_killpoint", 2024-09-10T22:37:54.384 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "int", 2024-09-10T22:37:54.384 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "dev", 2024-09-10T22:37:54.384 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:54.384 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "0", 2024-09-10T22:37:54.384 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.384 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.384 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.384 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:54.384 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.384 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.384 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.385 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-10T22:37:54.385 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-10T22:37:54.385 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.385 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-10T22:37:54.385 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "zabbix", 2024-09-10T22:37:54.385 INFO:teuthology.orchestra.run.smithi019.stdout: "can_run": true, 2024-09-10T22:37:54.385 INFO:teuthology.orchestra.run.smithi019.stdout: "error_string": "", 2024-09-10T22:37:54.385 INFO:teuthology.orchestra.run.smithi019.stdout: "module_options": { 2024-09-10T22:37:54.385 INFO:teuthology.orchestra.run.smithi019.stdout: "discovery_interval": { 2024-09-10T22:37:54.385 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "discovery_interval", 2024-09-10T22:37:54.385 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "uint", 2024-09-10T22:37:54.385 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.385 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-10T22:37:54.385 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "100", 2024-09-10T22:37:54.386 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.386 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.386 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.386 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:54.386 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.386 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.386 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.386 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.386 INFO:teuthology.orchestra.run.smithi019.stdout: "identifier": { 2024-09-10T22:37:54.386 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "identifier", 2024-09-10T22:37:54.386 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-10T22:37:54.386 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.387 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-10T22:37:54.387 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-10T22:37:54.387 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.387 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.387 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.387 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:54.387 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.387 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.387 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.387 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.387 INFO:teuthology.orchestra.run.smithi019.stdout: "interval": { 2024-09-10T22:37:54.387 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "interval", 2024-09-10T22:37:54.387 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "secs", 2024-09-10T22:37:54.388 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.388 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-10T22:37:54.388 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "60", 2024-09-10T22:37:54.388 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.388 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.388 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.388 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:54.388 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.388 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.388 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.388 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.388 INFO:teuthology.orchestra.run.smithi019.stdout: "log_level": { 2024-09-10T22:37:54.388 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_level", 2024-09-10T22:37:54.389 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-10T22:37:54.389 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.389 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:54.389 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-10T22:37:54.389 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.389 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.389 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-10T22:37:54.389 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-10T22:37:54.389 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-10T22:37:54.389 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-10T22:37:54.389 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-10T22:37:54.389 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-10T22:37:54.389 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-10T22:37:54.390 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-10T22:37:54.390 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:54.390 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.390 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.390 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.390 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.390 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster": { 2024-09-10T22:37:54.390 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster", 2024-09-10T22:37:54.390 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-10T22:37:54.390 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.390 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:54.390 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-10T22:37:54.390 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.391 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.391 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.391 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:54.391 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.391 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.391 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.391 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.391 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster_level": { 2024-09-10T22:37:54.391 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster_level", 2024-09-10T22:37:54.391 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-10T22:37:54.391 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.391 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:54.391 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "info", 2024-09-10T22:37:54.392 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.392 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.392 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-10T22:37:54.392 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-10T22:37:54.392 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-10T22:37:54.392 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-10T22:37:54.392 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-10T22:37:54.392 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-10T22:37:54.392 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-10T22:37:54.392 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-10T22:37:54.392 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:54.392 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.392 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.393 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.393 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.393 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_file": { 2024-09-10T22:37:54.393 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_file", 2024-09-10T22:37:54.393 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-10T22:37:54.393 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.393 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:54.393 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-10T22:37:54.393 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.393 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.393 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.393 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:54.394 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.394 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.394 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.394 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.394 INFO:teuthology.orchestra.run.smithi019.stdout: "sqlite3_killpoint": { 2024-09-10T22:37:54.394 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "sqlite3_killpoint", 2024-09-10T22:37:54.394 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "int", 2024-09-10T22:37:54.394 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "dev", 2024-09-10T22:37:54.394 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:54.394 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "0", 2024-09-10T22:37:54.394 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.394 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.394 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.394 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:54.395 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.395 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.395 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.395 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.395 INFO:teuthology.orchestra.run.smithi019.stdout: "zabbix_host": { 2024-09-10T22:37:54.395 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "zabbix_host", 2024-09-10T22:37:54.395 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-10T22:37:54.395 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.395 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-10T22:37:54.395 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-10T22:37:54.395 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.395 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.395 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.396 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:54.396 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.396 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.396 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.396 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.396 INFO:teuthology.orchestra.run.smithi019.stdout: "zabbix_port": { 2024-09-10T22:37:54.396 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "zabbix_port", 2024-09-10T22:37:54.396 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "int", 2024-09-10T22:37:54.396 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.396 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-10T22:37:54.396 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "10051", 2024-09-10T22:37:54.396 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.396 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.396 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.397 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:54.397 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.397 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.397 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.397 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.397 INFO:teuthology.orchestra.run.smithi019.stdout: "zabbix_sender": { 2024-09-10T22:37:54.397 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "zabbix_sender", 2024-09-10T22:37:54.397 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-10T22:37:54.397 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.397 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-10T22:37:54.397 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "/usr/bin/zabbix_sender", 2024-09-10T22:37:54.397 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.397 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.398 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.398 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:54.398 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.398 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.398 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.398 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-10T22:37:54.398 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-10T22:37:54.398 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-10T22:37:54.398 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-10T22:37:54.398 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.398 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-10T22:37:54.398 INFO:teuthology.orchestra.run.smithi019.stdout: "gid": 24125, 2024-09-10T22:37:54.398 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "y", 2024-09-10T22:37:54.399 INFO:teuthology.orchestra.run.smithi019.stdout: "mgr_features": 4540719139924082687, 2024-09-10T22:37:54.399 INFO:teuthology.orchestra.run.smithi019.stdout: "available_modules": [ 2024-09-10T22:37:54.399 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-10T22:37:54.399 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "alerts", 2024-09-10T22:37:54.399 INFO:teuthology.orchestra.run.smithi019.stdout: "can_run": true, 2024-09-10T22:37:54.399 INFO:teuthology.orchestra.run.smithi019.stdout: "error_string": "", 2024-09-10T22:37:54.399 INFO:teuthology.orchestra.run.smithi019.stdout: "module_options": { 2024-09-10T22:37:54.399 INFO:teuthology.orchestra.run.smithi019.stdout: "interval": { 2024-09-10T22:37:54.399 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "interval", 2024-09-10T22:37:54.399 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "secs", 2024-09-10T22:37:54.399 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.399 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:54.399 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "60", 2024-09-10T22:37:54.399 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.400 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.400 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.400 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "How frequently to reexamine health status", 2024-09-10T22:37:54.400 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.400 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.400 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.400 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.400 INFO:teuthology.orchestra.run.smithi019.stdout: "log_level": { 2024-09-10T22:37:54.400 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_level", 2024-09-10T22:37:54.400 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-10T22:37:54.400 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.400 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:54.400 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-10T22:37:54.401 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.401 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.401 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-10T22:37:54.401 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-10T22:37:54.401 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-10T22:37:54.401 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-10T22:37:54.401 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-10T22:37:54.401 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-10T22:37:54.401 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-10T22:37:54.401 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-10T22:37:54.401 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:54.401 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.401 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.402 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.402 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.402 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster": { 2024-09-10T22:37:54.402 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster", 2024-09-10T22:37:54.402 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-10T22:37:54.402 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.402 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:54.402 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-10T22:37:54.402 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.402 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.402 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.402 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:54.402 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.403 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.403 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.403 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.403 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster_level": { 2024-09-10T22:37:54.403 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster_level", 2024-09-10T22:37:54.403 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-10T22:37:54.403 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.403 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:54.403 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "info", 2024-09-10T22:37:54.403 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.403 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.403 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-10T22:37:54.403 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-10T22:37:54.404 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-10T22:37:54.404 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-10T22:37:54.404 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-10T22:37:54.404 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-10T22:37:54.404 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-10T22:37:54.404 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-10T22:37:54.404 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:54.404 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.404 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.404 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.404 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.404 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_file": { 2024-09-10T22:37:54.404 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_file", 2024-09-10T22:37:54.405 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-10T22:37:54.405 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.405 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:54.405 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-10T22:37:54.405 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.405 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.405 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.405 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:54.405 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.405 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.405 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.405 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.405 INFO:teuthology.orchestra.run.smithi019.stdout: "smtp_destination": { 2024-09-10T22:37:54.406 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "smtp_destination", 2024-09-10T22:37:54.406 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-10T22:37:54.406 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.406 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:54.406 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-10T22:37:54.406 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.406 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.406 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.406 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "Email address to send alerts to, use commas to separate multiple", 2024-09-10T22:37:54.406 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.406 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.406 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.406 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.406 INFO:teuthology.orchestra.run.smithi019.stdout: "smtp_from_name": { 2024-09-10T22:37:54.407 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "smtp_from_name", 2024-09-10T22:37:54.407 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-10T22:37:54.407 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.407 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:54.407 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "Ceph", 2024-09-10T22:37:54.407 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.407 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.407 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.407 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "Email From: name", 2024-09-10T22:37:54.407 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.407 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.407 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.407 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.408 INFO:teuthology.orchestra.run.smithi019.stdout: "smtp_host": { 2024-09-10T22:37:54.408 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "smtp_host", 2024-09-10T22:37:54.408 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-10T22:37:54.408 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.408 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:54.408 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-10T22:37:54.408 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.408 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.408 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.408 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "SMTP server", 2024-09-10T22:37:54.408 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.408 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.408 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.409 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.409 INFO:teuthology.orchestra.run.smithi019.stdout: "smtp_password": { 2024-09-10T22:37:54.409 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "smtp_password", 2024-09-10T22:37:54.409 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-10T22:37:54.409 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.409 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:54.409 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-10T22:37:54.409 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.409 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.409 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.409 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "Password to authenticate with", 2024-09-10T22:37:54.409 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.409 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.410 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.410 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.410 INFO:teuthology.orchestra.run.smithi019.stdout: "smtp_port": { 2024-09-10T22:37:54.410 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "smtp_port", 2024-09-10T22:37:54.410 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "int", 2024-09-10T22:37:54.410 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.410 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:54.410 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "465", 2024-09-10T22:37:54.410 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.410 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.410 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.410 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "SMTP port", 2024-09-10T22:37:54.410 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.410 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.411 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.411 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.411 INFO:teuthology.orchestra.run.smithi019.stdout: "smtp_sender": { 2024-09-10T22:37:54.411 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "smtp_sender", 2024-09-10T22:37:54.411 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-10T22:37:54.411 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.411 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:54.411 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-10T22:37:54.411 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.411 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.411 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.411 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "SMTP envelope sender", 2024-09-10T22:37:54.411 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.412 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.412 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.412 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.412 INFO:teuthology.orchestra.run.smithi019.stdout: "smtp_ssl": { 2024-09-10T22:37:54.412 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "smtp_ssl", 2024-09-10T22:37:54.412 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-10T22:37:54.412 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.412 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:54.412 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "True", 2024-09-10T22:37:54.412 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.412 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.412 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.412 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "Use SSL to connect to SMTP server", 2024-09-10T22:37:54.413 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.413 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.413 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.413 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.413 INFO:teuthology.orchestra.run.smithi019.stdout: "smtp_user": { 2024-09-10T22:37:54.413 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "smtp_user", 2024-09-10T22:37:54.413 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-10T22:37:54.413 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.413 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:54.413 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-10T22:37:54.413 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.413 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.413 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.413 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "User to authenticate as", 2024-09-10T22:37:54.414 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.414 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.414 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.414 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.414 INFO:teuthology.orchestra.run.smithi019.stdout: "sqlite3_killpoint": { 2024-09-10T22:37:54.414 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "sqlite3_killpoint", 2024-09-10T22:37:54.414 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "int", 2024-09-10T22:37:54.414 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "dev", 2024-09-10T22:37:54.414 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:54.414 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "0", 2024-09-10T22:37:54.414 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.414 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.414 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.415 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:54.415 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.415 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.415 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.415 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-10T22:37:54.415 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-10T22:37:54.415 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.415 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-10T22:37:54.415 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "balancer", 2024-09-10T22:37:54.415 INFO:teuthology.orchestra.run.smithi019.stdout: "can_run": true, 2024-09-10T22:37:54.415 INFO:teuthology.orchestra.run.smithi019.stdout: "error_string": "", 2024-09-10T22:37:54.415 INFO:teuthology.orchestra.run.smithi019.stdout: "module_options": { 2024-09-10T22:37:54.415 INFO:teuthology.orchestra.run.smithi019.stdout: "active": { 2024-09-10T22:37:54.416 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "active", 2024-09-10T22:37:54.416 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-10T22:37:54.416 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.416 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:54.416 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "True", 2024-09-10T22:37:54.416 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.416 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.416 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.416 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "automatically balance PGs across cluster", 2024-09-10T22:37:54.416 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.416 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.416 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.417 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.417 INFO:teuthology.orchestra.run.smithi019.stdout: "begin_time": { 2024-09-10T22:37:54.417 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "begin_time", 2024-09-10T22:37:54.417 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-10T22:37:54.417 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.417 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:54.417 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "0000", 2024-09-10T22:37:54.417 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.417 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.417 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.417 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "beginning time of day to automatically balance", 2024-09-10T22:37:54.417 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-10T22:37:54.417 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.418 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.418 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.418 INFO:teuthology.orchestra.run.smithi019.stdout: "begin_weekday": { 2024-09-10T22:37:54.418 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "begin_weekday", 2024-09-10T22:37:54.418 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "uint", 2024-09-10T22:37:54.418 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.418 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:54.418 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "0", 2024-09-10T22:37:54.418 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "0", 2024-09-10T22:37:54.418 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "6", 2024-09-10T22:37:54.418 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.418 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2024-09-10T22:37:54.418 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-10T22:37:54.419 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.419 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.419 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.419 INFO:teuthology.orchestra.run.smithi019.stdout: "crush_compat_max_iterations": { 2024-09-10T22:37:54.419 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "crush_compat_max_iterations", 2024-09-10T22:37:54.419 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "uint", 2024-09-10T22:37:54.419 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.419 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:54.419 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "25", 2024-09-10T22:37:54.419 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "1", 2024-09-10T22:37:54.419 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "250", 2024-09-10T22:37:54.419 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.419 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "maximum number of iterations to attempt optimization", 2024-09-10T22:37:54.419 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.420 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.420 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.420 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.420 INFO:teuthology.orchestra.run.smithi019.stdout: "crush_compat_metrics": { 2024-09-10T22:37:54.420 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "crush_compat_metrics", 2024-09-10T22:37:54.420 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-10T22:37:54.420 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.420 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:54.420 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "pgs,objects,bytes", 2024-09-10T22:37:54.420 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.420 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.420 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.421 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "metrics with which to calculate OSD utilization", 2024-09-10T22:37:54.421 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2024-09-10T22:37:54.421 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.421 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.421 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.421 INFO:teuthology.orchestra.run.smithi019.stdout: "crush_compat_step": { 2024-09-10T22:37:54.421 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "crush_compat_step", 2024-09-10T22:37:54.421 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "float", 2024-09-10T22:37:54.421 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.421 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:54.421 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "0.5", 2024-09-10T22:37:54.421 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "0.001", 2024-09-10T22:37:54.421 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "0.999", 2024-09-10T22:37:54.422 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.422 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "aggressiveness of optimization", 2024-09-10T22:37:54.422 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2024-09-10T22:37:54.422 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.422 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.422 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.422 INFO:teuthology.orchestra.run.smithi019.stdout: "end_time": { 2024-09-10T22:37:54.422 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "end_time", 2024-09-10T22:37:54.422 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-10T22:37:54.422 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.422 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:54.422 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "2359", 2024-09-10T22:37:54.422 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.423 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.423 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.423 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "ending time of day to automatically balance", 2024-09-10T22:37:54.423 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-10T22:37:54.423 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.423 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.423 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.423 INFO:teuthology.orchestra.run.smithi019.stdout: "end_weekday": { 2024-09-10T22:37:54.423 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "end_weekday", 2024-09-10T22:37:54.423 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "uint", 2024-09-10T22:37:54.423 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.423 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:54.423 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "0", 2024-09-10T22:37:54.423 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "0", 2024-09-10T22:37:54.424 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "6", 2024-09-10T22:37:54.424 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.424 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2024-09-10T22:37:54.424 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-10T22:37:54.424 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.424 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.424 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.424 INFO:teuthology.orchestra.run.smithi019.stdout: "log_level": { 2024-09-10T22:37:54.424 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_level", 2024-09-10T22:37:54.424 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-10T22:37:54.424 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.424 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:54.424 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-10T22:37:54.425 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.425 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.425 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-10T22:37:54.425 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-10T22:37:54.425 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-10T22:37:54.425 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-10T22:37:54.425 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-10T22:37:54.425 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-10T22:37:54.425 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-10T22:37:54.425 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-10T22:37:54.425 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:54.425 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.425 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.426 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.426 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.426 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster": { 2024-09-10T22:37:54.426 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster", 2024-09-10T22:37:54.426 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-10T22:37:54.426 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.426 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:54.426 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-10T22:37:54.426 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.426 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.426 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.426 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:54.426 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.426 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.427 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.427 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.427 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster_level": { 2024-09-10T22:37:54.427 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster_level", 2024-09-10T22:37:54.427 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-10T22:37:54.427 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.427 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:54.427 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "info", 2024-09-10T22:37:54.427 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.427 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.427 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-10T22:37:54.427 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-10T22:37:54.427 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-10T22:37:54.428 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-10T22:37:54.428 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-10T22:37:54.428 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-10T22:37:54.428 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-10T22:37:54.428 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-10T22:37:54.428 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:54.428 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.428 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.428 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.428 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.428 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_file": { 2024-09-10T22:37:54.428 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_file", 2024-09-10T22:37:54.428 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-10T22:37:54.429 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.429 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:54.429 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-10T22:37:54.429 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.429 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.429 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.429 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:54.429 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.429 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.429 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.429 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.429 INFO:teuthology.orchestra.run.smithi019.stdout: "min_score": { 2024-09-10T22:37:54.429 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "min_score", 2024-09-10T22:37:54.430 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "float", 2024-09-10T22:37:54.430 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.430 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:54.430 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "0", 2024-09-10T22:37:54.430 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.430 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.430 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.430 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "minimum score, below which no optimization is attempted", 2024-09-10T22:37:54.430 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.430 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.430 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.430 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.430 INFO:teuthology.orchestra.run.smithi019.stdout: "mode": { 2024-09-10T22:37:54.431 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "mode", 2024-09-10T22:37:54.431 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-10T22:37:54.431 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.431 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:54.431 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "upmap", 2024-09-10T22:37:54.431 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.431 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.431 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-10T22:37:54.431 INFO:teuthology.orchestra.run.smithi019.stdout: "crush-compat", 2024-09-10T22:37:54.431 INFO:teuthology.orchestra.run.smithi019.stdout: "none", 2024-09-10T22:37:54.431 INFO:teuthology.orchestra.run.smithi019.stdout: "read", 2024-09-10T22:37:54.431 INFO:teuthology.orchestra.run.smithi019.stdout: "upmap", 2024-09-10T22:37:54.431 INFO:teuthology.orchestra.run.smithi019.stdout: "upmap-read" 2024-09-10T22:37:54.432 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-10T22:37:54.432 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "Balancer mode", 2024-09-10T22:37:54.432 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.432 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.432 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.432 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.432 INFO:teuthology.orchestra.run.smithi019.stdout: "pool_ids": { 2024-09-10T22:37:54.432 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "pool_ids", 2024-09-10T22:37:54.432 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-10T22:37:54.432 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.432 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:54.432 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-10T22:37:54.433 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.433 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.433 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.433 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "pools which the automatic balancing will be limited to", 2024-09-10T22:37:54.433 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.433 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.433 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.433 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.433 INFO:teuthology.orchestra.run.smithi019.stdout: "sleep_interval": { 2024-09-10T22:37:54.433 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "sleep_interval", 2024-09-10T22:37:54.433 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "secs", 2024-09-10T22:37:54.433 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.434 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:54.434 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "60", 2024-09-10T22:37:54.434 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.434 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.434 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.434 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "how frequently to wake up and attempt optimization", 2024-09-10T22:37:54.434 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.434 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.434 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.434 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.434 INFO:teuthology.orchestra.run.smithi019.stdout: "sqlite3_killpoint": { 2024-09-10T22:37:54.434 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "sqlite3_killpoint", 2024-09-10T22:37:54.434 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "int", 2024-09-10T22:37:54.435 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "dev", 2024-09-10T22:37:54.435 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:54.435 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "0", 2024-09-10T22:37:54.435 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.435 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.435 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.435 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:54.435 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.435 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.435 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.435 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.435 INFO:teuthology.orchestra.run.smithi019.stdout: "upmap_max_deviation": { 2024-09-10T22:37:54.435 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "upmap_max_deviation", 2024-09-10T22:37:54.436 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "int", 2024-09-10T22:37:54.436 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.436 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:54.436 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "5", 2024-09-10T22:37:54.436 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "1", 2024-09-10T22:37:54.436 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.436 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.436 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "deviation below which no optimization is attempted", 2024-09-10T22:37:54.436 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2024-09-10T22:37:54.436 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.436 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.436 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.437 INFO:teuthology.orchestra.run.smithi019.stdout: "upmap_max_optimizations": { 2024-09-10T22:37:54.437 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "upmap_max_optimizations", 2024-09-10T22:37:54.437 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "uint", 2024-09-10T22:37:54.437 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.437 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:54.437 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "10", 2024-09-10T22:37:54.437 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.437 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.437 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.437 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "maximum upmap optimizations to make per attempt", 2024-09-10T22:37:54.437 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.437 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.437 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.438 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-10T22:37:54.438 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-10T22:37:54.438 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.438 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-10T22:37:54.438 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "cephadm", 2024-09-10T22:37:54.438 INFO:teuthology.orchestra.run.smithi019.stdout: "can_run": true, 2024-09-10T22:37:54.438 INFO:teuthology.orchestra.run.smithi019.stdout: "error_string": "", 2024-09-10T22:37:54.438 INFO:teuthology.orchestra.run.smithi019.stdout: "module_options": { 2024-09-10T22:37:54.438 INFO:teuthology.orchestra.run.smithi019.stdout: "agent_down_multiplier": { 2024-09-10T22:37:54.438 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "agent_down_multiplier", 2024-09-10T22:37:54.438 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "float", 2024-09-10T22:37:54.438 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.438 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-10T22:37:54.439 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "3.0", 2024-09-10T22:37:54.439 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.439 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.439 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.439 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2024-09-10T22:37:54.439 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.439 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.439 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.439 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.439 INFO:teuthology.orchestra.run.smithi019.stdout: "agent_refresh_rate": { 2024-09-10T22:37:54.439 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "agent_refresh_rate", 2024-09-10T22:37:54.439 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "secs", 2024-09-10T22:37:54.439 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.440 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-10T22:37:54.440 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "20", 2024-09-10T22:37:54.440 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.440 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.440 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.440 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2024-09-10T22:37:54.440 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.440 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.440 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.440 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.440 INFO:teuthology.orchestra.run.smithi019.stdout: "agent_starting_port": { 2024-09-10T22:37:54.440 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "agent_starting_port", 2024-09-10T22:37:54.440 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "int", 2024-09-10T22:37:54.440 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.441 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-10T22:37:54.441 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "4721", 2024-09-10T22:37:54.441 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.441 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.441 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.441 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2024-09-10T22:37:54.441 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.441 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.441 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.441 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.441 INFO:teuthology.orchestra.run.smithi019.stdout: "allow_ptrace": { 2024-09-10T22:37:54.441 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "allow_ptrace", 2024-09-10T22:37:54.441 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-10T22:37:54.442 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.442 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-10T22:37:54.442 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-10T22:37:54.442 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.442 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.442 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.442 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2024-09-10T22:37:54.442 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2024-09-10T22:37:54.442 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.442 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.442 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.442 INFO:teuthology.orchestra.run.smithi019.stdout: "autotune_interval": { 2024-09-10T22:37:54.443 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "autotune_interval", 2024-09-10T22:37:54.443 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "secs", 2024-09-10T22:37:54.443 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.443 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-10T22:37:54.443 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "600", 2024-09-10T22:37:54.443 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.443 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.443 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.443 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "how frequently to autotune daemon memory", 2024-09-10T22:37:54.443 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.443 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.443 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.443 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.444 INFO:teuthology.orchestra.run.smithi019.stdout: "autotune_memory_target_ratio": { 2024-09-10T22:37:54.444 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "autotune_memory_target_ratio", 2024-09-10T22:37:54.444 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "float", 2024-09-10T22:37:54.444 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.444 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-10T22:37:54.444 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "0.7", 2024-09-10T22:37:54.444 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.444 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.444 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.444 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2024-09-10T22:37:54.444 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.444 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.444 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.445 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.445 INFO:teuthology.orchestra.run.smithi019.stdout: "cephadm_log_destination": { 2024-09-10T22:37:54.445 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "cephadm_log_destination", 2024-09-10T22:37:54.445 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-10T22:37:54.445 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.445 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-10T22:37:54.445 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-10T22:37:54.445 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.445 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.445 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-10T22:37:54.445 INFO:teuthology.orchestra.run.smithi019.stdout: "file", 2024-09-10T22:37:54.445 INFO:teuthology.orchestra.run.smithi019.stdout: "file,syslog", 2024-09-10T22:37:54.446 INFO:teuthology.orchestra.run.smithi019.stdout: "syslog" 2024-09-10T22:37:54.446 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-10T22:37:54.446 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "Destination for cephadm command's persistent logging", 2024-09-10T22:37:54.446 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.446 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.446 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.446 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.446 INFO:teuthology.orchestra.run.smithi019.stdout: "cgroups_split": { 2024-09-10T22:37:54.446 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "cgroups_split", 2024-09-10T22:37:54.446 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-10T22:37:54.446 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.446 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-10T22:37:54.446 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "True", 2024-09-10T22:37:54.447 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.447 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.447 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.447 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2024-09-10T22:37:54.447 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.447 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.447 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.447 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.447 INFO:teuthology.orchestra.run.smithi019.stdout: "config_checks_enabled": { 2024-09-10T22:37:54.447 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "config_checks_enabled", 2024-09-10T22:37:54.447 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-10T22:37:54.447 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.447 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-10T22:37:54.448 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-10T22:37:54.448 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.448 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.448 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.448 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2024-09-10T22:37:54.448 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.448 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.448 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.448 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.448 INFO:teuthology.orchestra.run.smithi019.stdout: "config_dashboard": { 2024-09-10T22:37:54.448 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "config_dashboard", 2024-09-10T22:37:54.448 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-10T22:37:54.448 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.449 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-10T22:37:54.449 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "True", 2024-09-10T22:37:54.449 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.449 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.449 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.449 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2024-09-10T22:37:54.449 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.449 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.449 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.449 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.449 INFO:teuthology.orchestra.run.smithi019.stdout: "container_image_alertmanager": { 2024-09-10T22:37:54.449 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "container_image_alertmanager", 2024-09-10T22:37:54.449 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-10T22:37:54.449 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.450 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-10T22:37:54.450 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.27.0", 2024-09-10T22:37:54.450 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.450 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.450 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.450 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "Prometheus container image", 2024-09-10T22:37:54.450 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.450 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.450 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.450 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.450 INFO:teuthology.orchestra.run.smithi019.stdout: "container_image_base": { 2024-09-10T22:37:54.450 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "container_image_base", 2024-09-10T22:37:54.450 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-10T22:37:54.451 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.451 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:54.451 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "quay.io/ceph/ceph", 2024-09-10T22:37:54.451 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.451 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.451 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.451 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "Container image name, without the tag", 2024-09-10T22:37:54.451 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.451 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.451 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.451 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.451 INFO:teuthology.orchestra.run.smithi019.stdout: "container_image_elasticsearch": { 2024-09-10T22:37:54.451 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "container_image_elasticsearch", 2024-09-10T22:37:54.452 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-10T22:37:54.452 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.452 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-10T22:37:54.452 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2024-09-10T22:37:54.452 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.452 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.452 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.452 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "elasticsearch container image", 2024-09-10T22:37:54.452 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.452 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.452 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.452 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.452 INFO:teuthology.orchestra.run.smithi019.stdout: "container_image_grafana": { 2024-09-10T22:37:54.453 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "container_image_grafana", 2024-09-10T22:37:54.453 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-10T22:37:54.453 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.453 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-10T22:37:54.453 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "quay.io/ceph/grafana:10.4.0", 2024-09-10T22:37:54.453 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.453 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.453 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.453 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "Prometheus container image", 2024-09-10T22:37:54.453 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.453 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.453 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.453 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.453 INFO:teuthology.orchestra.run.smithi019.stdout: "container_image_haproxy": { 2024-09-10T22:37:54.454 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "container_image_haproxy", 2024-09-10T22:37:54.454 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-10T22:37:54.454 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.454 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-10T22:37:54.454 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2024-09-10T22:37:54.454 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.454 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.454 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.454 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "HAproxy container image", 2024-09-10T22:37:54.454 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.454 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.454 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.454 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.455 INFO:teuthology.orchestra.run.smithi019.stdout: "container_image_jaeger_agent": { 2024-09-10T22:37:54.455 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "container_image_jaeger_agent", 2024-09-10T22:37:54.455 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-10T22:37:54.455 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.455 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-10T22:37:54.455 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2024-09-10T22:37:54.455 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.455 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.455 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.455 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "Jaeger agent container image", 2024-09-10T22:37:54.455 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.455 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.455 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.456 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.456 INFO:teuthology.orchestra.run.smithi019.stdout: "container_image_jaeger_collector": { 2024-09-10T22:37:54.456 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "container_image_jaeger_collector", 2024-09-10T22:37:54.456 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-10T22:37:54.456 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.456 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-10T22:37:54.456 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2024-09-10T22:37:54.456 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.456 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.456 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.456 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "Jaeger collector container image", 2024-09-10T22:37:54.456 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.456 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.457 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.457 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.457 INFO:teuthology.orchestra.run.smithi019.stdout: "container_image_jaeger_query": { 2024-09-10T22:37:54.457 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "container_image_jaeger_query", 2024-09-10T22:37:54.457 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-10T22:37:54.457 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.457 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-10T22:37:54.457 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2024-09-10T22:37:54.457 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.457 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.457 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.457 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "Jaeger query container image", 2024-09-10T22:37:54.458 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.458 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.458 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.458 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.458 INFO:teuthology.orchestra.run.smithi019.stdout: "container_image_keepalived": { 2024-09-10T22:37:54.458 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "container_image_keepalived", 2024-09-10T22:37:54.458 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-10T22:37:54.458 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.458 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-10T22:37:54.458 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2024-09-10T22:37:54.458 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.458 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.458 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.458 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "Keepalived container image", 2024-09-10T22:37:54.458 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.459 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.459 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.459 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.459 INFO:teuthology.orchestra.run.smithi019.stdout: "container_image_loki": { 2024-09-10T22:37:54.459 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "container_image_loki", 2024-09-10T22:37:54.459 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-10T22:37:54.459 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.459 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-10T22:37:54.459 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "docker.io/grafana/loki:3.0.0", 2024-09-10T22:37:54.459 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.459 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.459 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.460 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "Loki container image", 2024-09-10T22:37:54.460 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.460 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.460 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.460 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.460 INFO:teuthology.orchestra.run.smithi019.stdout: "container_image_nginx": { 2024-09-10T22:37:54.460 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "container_image_nginx", 2024-09-10T22:37:54.460 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-10T22:37:54.460 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.460 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-10T22:37:54.460 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "quay.io/ceph/nginx:1.26.1", 2024-09-10T22:37:54.460 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.460 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.461 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.461 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "Nginx container image", 2024-09-10T22:37:54.461 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.461 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.461 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.461 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.461 INFO:teuthology.orchestra.run.smithi019.stdout: "container_image_node_exporter": { 2024-09-10T22:37:54.461 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "container_image_node_exporter", 2024-09-10T22:37:54.461 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-10T22:37:54.461 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.461 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-10T22:37:54.461 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.7.0", 2024-09-10T22:37:54.461 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.462 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.462 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.462 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "Prometheus container image", 2024-09-10T22:37:54.462 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.462 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.462 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.462 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.462 INFO:teuthology.orchestra.run.smithi019.stdout: "container_image_nvmeof": { 2024-09-10T22:37:54.462 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "container_image_nvmeof", 2024-09-10T22:37:54.462 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-10T22:37:54.462 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.462 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-10T22:37:54.462 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "quay.io/ceph/nvmeof:1.2.17", 2024-09-10T22:37:54.463 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.463 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.463 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.463 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "Nvme-of container image", 2024-09-10T22:37:54.463 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.463 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.463 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.463 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.463 INFO:teuthology.orchestra.run.smithi019.stdout: "container_image_oauth2_proxy": { 2024-09-10T22:37:54.463 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "container_image_oauth2_proxy", 2024-09-10T22:37:54.463 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-10T22:37:54.463 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.463 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-10T22:37:54.463 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "quay.io/oauth2-proxy/oauth2-proxy:v7.6.0", 2024-09-10T22:37:54.463 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.464 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.464 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.464 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "oauth2-proxy container image", 2024-09-10T22:37:54.464 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.464 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.464 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.464 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.464 INFO:teuthology.orchestra.run.smithi019.stdout: "container_image_prometheus": { 2024-09-10T22:37:54.464 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "container_image_prometheus", 2024-09-10T22:37:54.464 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-10T22:37:54.464 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.464 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-10T22:37:54.464 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "quay.io/prometheus/prometheus:v2.51.0", 2024-09-10T22:37:54.464 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.465 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.465 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.465 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "Prometheus container image", 2024-09-10T22:37:54.465 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.465 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.465 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.465 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.465 INFO:teuthology.orchestra.run.smithi019.stdout: "container_image_promtail": { 2024-09-10T22:37:54.465 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "container_image_promtail", 2024-09-10T22:37:54.465 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-10T22:37:54.465 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.465 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-10T22:37:54.466 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "docker.io/grafana/promtail:3.0.0", 2024-09-10T22:37:54.466 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.466 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.466 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.466 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "Promtail container image", 2024-09-10T22:37:54.466 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.466 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.466 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.466 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.466 INFO:teuthology.orchestra.run.smithi019.stdout: "container_image_samba": { 2024-09-10T22:37:54.466 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "container_image_samba", 2024-09-10T22:37:54.466 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-10T22:37:54.466 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.466 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-10T22:37:54.467 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "quay.io/samba.org/samba-server:devbuilds-centos-amd64", 2024-09-10T22:37:54.467 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.467 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.467 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.467 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "Samba/SMB container image", 2024-09-10T22:37:54.467 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.467 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.467 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.467 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.467 INFO:teuthology.orchestra.run.smithi019.stdout: "container_image_samba_metrics": { 2024-09-10T22:37:54.467 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "container_image_samba_metrics", 2024-09-10T22:37:54.467 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-10T22:37:54.467 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.467 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-10T22:37:54.468 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "quay.io/samba.org/samba-metrics:latest", 2024-09-10T22:37:54.468 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.468 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.468 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.468 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "Samba/SMB metrics exporter container image", 2024-09-10T22:37:54.468 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.468 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.468 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.468 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.468 INFO:teuthology.orchestra.run.smithi019.stdout: "container_image_snmp_gateway": { 2024-09-10T22:37:54.468 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "container_image_snmp_gateway", 2024-09-10T22:37:54.468 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-10T22:37:54.468 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.469 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-10T22:37:54.469 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2024-09-10T22:37:54.469 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.469 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.469 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.469 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "SNMP Gateway container image", 2024-09-10T22:37:54.469 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.469 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.469 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.469 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.469 INFO:teuthology.orchestra.run.smithi019.stdout: "container_init": { 2024-09-10T22:37:54.469 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "container_init", 2024-09-10T22:37:54.469 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-10T22:37:54.470 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.470 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-10T22:37:54.470 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "True", 2024-09-10T22:37:54.470 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.470 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.470 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.470 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "Run podman/docker with `--init`", 2024-09-10T22:37:54.470 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.470 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.470 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.470 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.470 INFO:teuthology.orchestra.run.smithi019.stdout: "daemon_cache_timeout": { 2024-09-10T22:37:54.470 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "daemon_cache_timeout", 2024-09-10T22:37:54.471 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "secs", 2024-09-10T22:37:54.471 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.471 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-10T22:37:54.471 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "600", 2024-09-10T22:37:54.471 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.471 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.471 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.471 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "seconds to cache service (daemon) inventory", 2024-09-10T22:37:54.471 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.471 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.471 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.471 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.471 INFO:teuthology.orchestra.run.smithi019.stdout: "default_cephadm_command_timeout": { 2024-09-10T22:37:54.471 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "default_cephadm_command_timeout", 2024-09-10T22:37:54.472 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "int", 2024-09-10T22:37:54.472 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.472 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-10T22:37:54.472 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "900", 2024-09-10T22:37:54.472 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.472 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.472 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.472 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2024-09-10T22:37:54.472 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.472 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.472 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.472 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.473 INFO:teuthology.orchestra.run.smithi019.stdout: "default_registry": { 2024-09-10T22:37:54.473 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "default_registry", 2024-09-10T22:37:54.473 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-10T22:37:54.473 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.473 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-10T22:37:54.473 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "docker.io", 2024-09-10T22:37:54.473 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.473 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.473 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.473 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2024-09-10T22:37:54.473 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.473 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.473 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.474 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.474 INFO:teuthology.orchestra.run.smithi019.stdout: "device_cache_timeout": { 2024-09-10T22:37:54.474 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "device_cache_timeout", 2024-09-10T22:37:54.474 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "secs", 2024-09-10T22:37:54.474 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.474 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-10T22:37:54.474 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "1800", 2024-09-10T22:37:54.474 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.474 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.474 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.474 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "seconds to cache device inventory", 2024-09-10T22:37:54.474 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.474 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.475 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.475 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.475 INFO:teuthology.orchestra.run.smithi019.stdout: "device_enhanced_scan": { 2024-09-10T22:37:54.475 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "device_enhanced_scan", 2024-09-10T22:37:54.475 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-10T22:37:54.475 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.475 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-10T22:37:54.475 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-10T22:37:54.475 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.475 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.475 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.475 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "Use libstoragemgmt during device scans", 2024-09-10T22:37:54.475 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.476 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.476 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.476 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.476 INFO:teuthology.orchestra.run.smithi019.stdout: "facts_cache_timeout": { 2024-09-10T22:37:54.476 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "facts_cache_timeout", 2024-09-10T22:37:54.476 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "secs", 2024-09-10T22:37:54.476 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.476 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-10T22:37:54.476 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "60", 2024-09-10T22:37:54.476 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.476 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.476 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.476 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "seconds to cache host facts data", 2024-09-10T22:37:54.477 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.477 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.477 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.477 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.477 INFO:teuthology.orchestra.run.smithi019.stdout: "grafana_dashboards_path": { 2024-09-10T22:37:54.477 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "grafana_dashboards_path", 2024-09-10T22:37:54.477 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-10T22:37:54.477 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.477 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-10T22:37:54.477 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "/etc/grafana/dashboards/ceph-dashboard/", 2024-09-10T22:37:54.477 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.477 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.477 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.478 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "location of dashboards to include in grafana deployments", 2024-09-10T22:37:54.478 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.478 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.478 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.478 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.478 INFO:teuthology.orchestra.run.smithi019.stdout: "host_check_interval": { 2024-09-10T22:37:54.478 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "host_check_interval", 2024-09-10T22:37:54.478 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "secs", 2024-09-10T22:37:54.478 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.478 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-10T22:37:54.478 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "600", 2024-09-10T22:37:54.478 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.478 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.478 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.479 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "how frequently to perform a host check", 2024-09-10T22:37:54.479 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.479 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.479 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.479 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.479 INFO:teuthology.orchestra.run.smithi019.stdout: "hw_monitoring": { 2024-09-10T22:37:54.479 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "hw_monitoring", 2024-09-10T22:37:54.479 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-10T22:37:54.479 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.479 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-10T22:37:54.479 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-10T22:37:54.479 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.479 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.479 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.480 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "Deploy hw monitoring daemon on every host.", 2024-09-10T22:37:54.480 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.480 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.480 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.480 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.480 INFO:teuthology.orchestra.run.smithi019.stdout: "inventory_list_all": { 2024-09-10T22:37:54.480 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "inventory_list_all", 2024-09-10T22:37:54.480 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-10T22:37:54.480 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.480 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-10T22:37:54.480 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-10T22:37:54.480 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.480 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.481 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.481 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2024-09-10T22:37:54.481 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.481 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.481 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.481 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.481 INFO:teuthology.orchestra.run.smithi019.stdout: "log_level": { 2024-09-10T22:37:54.481 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_level", 2024-09-10T22:37:54.481 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-10T22:37:54.481 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.481 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:54.481 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-10T22:37:54.482 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.482 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.482 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-10T22:37:54.482 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-10T22:37:54.482 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-10T22:37:54.482 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-10T22:37:54.482 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-10T22:37:54.482 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-10T22:37:54.482 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-10T22:37:54.482 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-10T22:37:54.482 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:54.482 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.482 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.482 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.483 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.483 INFO:teuthology.orchestra.run.smithi019.stdout: "log_refresh_metadata": { 2024-09-10T22:37:54.483 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_refresh_metadata", 2024-09-10T22:37:54.483 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-10T22:37:54.483 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.483 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-10T22:37:54.483 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-10T22:37:54.483 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.483 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.483 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.483 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2024-09-10T22:37:54.483 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.483 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.484 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.484 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.484 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster": { 2024-09-10T22:37:54.484 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster", 2024-09-10T22:37:54.484 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-10T22:37:54.484 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.484 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-10T22:37:54.484 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "True", 2024-09-10T22:37:54.484 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.484 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.484 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.484 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2024-09-10T22:37:54.484 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.485 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.485 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.485 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.485 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster_level": { 2024-09-10T22:37:54.485 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster_level", 2024-09-10T22:37:54.485 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-10T22:37:54.485 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.485 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:54.485 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "info", 2024-09-10T22:37:54.485 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.485 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.485 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-10T22:37:54.486 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-10T22:37:54.486 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-10T22:37:54.486 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-10T22:37:54.486 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-10T22:37:54.486 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-10T22:37:54.486 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-10T22:37:54.486 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-10T22:37:54.486 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:54.486 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.486 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.486 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.486 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.486 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_file": { 2024-09-10T22:37:54.486 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_file", 2024-09-10T22:37:54.487 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-10T22:37:54.487 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.487 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:54.487 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-10T22:37:54.487 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.487 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.487 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.487 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:54.487 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.487 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.487 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.487 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.487 INFO:teuthology.orchestra.run.smithi019.stdout: "manage_etc_ceph_ceph_conf": { 2024-09-10T22:37:54.487 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "manage_etc_ceph_ceph_conf", 2024-09-10T22:37:54.488 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-10T22:37:54.488 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.488 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-10T22:37:54.488 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-10T22:37:54.488 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.488 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.488 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.488 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2024-09-10T22:37:54.488 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.488 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.488 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.488 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.488 INFO:teuthology.orchestra.run.smithi019.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2024-09-10T22:37:54.489 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2024-09-10T22:37:54.489 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-10T22:37:54.489 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.489 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-10T22:37:54.489 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "*", 2024-09-10T22:37:54.489 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.489 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.489 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.489 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2024-09-10T22:37:54.489 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.489 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.489 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.489 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.490 INFO:teuthology.orchestra.run.smithi019.stdout: "max_count_per_host": { 2024-09-10T22:37:54.490 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "max_count_per_host", 2024-09-10T22:37:54.490 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "int", 2024-09-10T22:37:54.490 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.490 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-10T22:37:54.490 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "10", 2024-09-10T22:37:54.490 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.490 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.490 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.490 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "max number of daemons per service per host", 2024-09-10T22:37:54.490 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.490 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.490 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.491 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.491 INFO:teuthology.orchestra.run.smithi019.stdout: "max_osd_draining_count": { 2024-09-10T22:37:54.491 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "max_osd_draining_count", 2024-09-10T22:37:54.491 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "int", 2024-09-10T22:37:54.491 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.491 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-10T22:37:54.491 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "10", 2024-09-10T22:37:54.491 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.491 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.491 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.491 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2024-09-10T22:37:54.491 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.491 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.492 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.492 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.492 INFO:teuthology.orchestra.run.smithi019.stdout: "migration_current": { 2024-09-10T22:37:54.492 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "migration_current", 2024-09-10T22:37:54.492 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "int", 2024-09-10T22:37:54.492 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.492 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-10T22:37:54.492 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-10T22:37:54.492 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.492 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.492 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.492 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "internal - do not modify", 2024-09-10T22:37:54.492 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.493 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.493 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.493 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.493 INFO:teuthology.orchestra.run.smithi019.stdout: "mode": { 2024-09-10T22:37:54.493 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "mode", 2024-09-10T22:37:54.493 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-10T22:37:54.493 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.493 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-10T22:37:54.493 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "root", 2024-09-10T22:37:54.493 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.493 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.493 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-10T22:37:54.493 INFO:teuthology.orchestra.run.smithi019.stdout: "cephadm-package", 2024-09-10T22:37:54.494 INFO:teuthology.orchestra.run.smithi019.stdout: "root" 2024-09-10T22:37:54.494 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-10T22:37:54.494 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "mode for remote execution of cephadm", 2024-09-10T22:37:54.494 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.494 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.494 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.494 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.494 INFO:teuthology.orchestra.run.smithi019.stdout: "oob_default_addr": { 2024-09-10T22:37:54.494 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "oob_default_addr", 2024-09-10T22:37:54.494 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-10T22:37:54.494 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.494 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-10T22:37:54.494 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "169.254.1.1", 2024-09-10T22:37:54.495 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.495 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.495 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.495 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "Default address for RedFish API (oob management).", 2024-09-10T22:37:54.495 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.495 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.495 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.495 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.495 INFO:teuthology.orchestra.run.smithi019.stdout: "prometheus_alerts_path": { 2024-09-10T22:37:54.495 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "prometheus_alerts_path", 2024-09-10T22:37:54.495 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-10T22:37:54.495 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.496 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-10T22:37:54.496 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2024-09-10T22:37:54.496 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.496 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.496 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.496 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "location of alerts to include in prometheus deployments", 2024-09-10T22:37:54.496 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.496 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.496 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.496 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.496 INFO:teuthology.orchestra.run.smithi019.stdout: "registry_insecure": { 2024-09-10T22:37:54.496 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "registry_insecure", 2024-09-10T22:37:54.496 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-10T22:37:54.497 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.497 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-10T22:37:54.497 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-10T22:37:54.497 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.497 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.497 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.497 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2024-09-10T22:37:54.497 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.497 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.497 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.497 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.497 INFO:teuthology.orchestra.run.smithi019.stdout: "registry_password": { 2024-09-10T22:37:54.497 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "registry_password", 2024-09-10T22:37:54.497 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-10T22:37:54.498 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.498 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-10T22:37:54.498 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-10T22:37:54.498 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.498 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.498 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.498 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2024-09-10T22:37:54.498 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.498 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.498 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.498 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.498 INFO:teuthology.orchestra.run.smithi019.stdout: "registry_url": { 2024-09-10T22:37:54.498 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "registry_url", 2024-09-10T22:37:54.498 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-10T22:37:54.499 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.499 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-10T22:37:54.499 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-10T22:37:54.499 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.499 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.499 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.499 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2024-09-10T22:37:54.499 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.499 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.499 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.499 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.499 INFO:teuthology.orchestra.run.smithi019.stdout: "registry_username": { 2024-09-10T22:37:54.499 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "registry_username", 2024-09-10T22:37:54.499 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-10T22:37:54.500 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.500 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-10T22:37:54.500 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-10T22:37:54.500 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.500 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.500 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.500 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2024-09-10T22:37:54.500 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.500 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.500 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.500 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.500 INFO:teuthology.orchestra.run.smithi019.stdout: "secure_monitoring_stack": { 2024-09-10T22:37:54.500 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "secure_monitoring_stack", 2024-09-10T22:37:54.501 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-10T22:37:54.501 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.501 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-10T22:37:54.501 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-10T22:37:54.501 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.501 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.501 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.501 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2024-09-10T22:37:54.501 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.501 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.501 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.501 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.501 INFO:teuthology.orchestra.run.smithi019.stdout: "service_discovery_port": { 2024-09-10T22:37:54.501 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "service_discovery_port", 2024-09-10T22:37:54.502 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "int", 2024-09-10T22:37:54.502 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.502 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-10T22:37:54.502 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "8765", 2024-09-10T22:37:54.502 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.502 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.502 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.502 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "cephadm service discovery port", 2024-09-10T22:37:54.502 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.502 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.502 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.502 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.502 INFO:teuthology.orchestra.run.smithi019.stdout: "sqlite3_killpoint": { 2024-09-10T22:37:54.502 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "sqlite3_killpoint", 2024-09-10T22:37:54.502 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "int", 2024-09-10T22:37:54.503 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "dev", 2024-09-10T22:37:54.503 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:54.503 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "0", 2024-09-10T22:37:54.503 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.503 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.503 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.503 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:54.503 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.503 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.503 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.503 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.503 INFO:teuthology.orchestra.run.smithi019.stdout: "ssh_config_file": { 2024-09-10T22:37:54.503 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "ssh_config_file", 2024-09-10T22:37:54.503 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-10T22:37:54.504 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.504 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-10T22:37:54.504 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-10T22:37:54.504 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.504 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.504 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.504 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "customized SSH config file to connect to managed hosts", 2024-09-10T22:37:54.504 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.504 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.504 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.504 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.504 INFO:teuthology.orchestra.run.smithi019.stdout: "use_agent": { 2024-09-10T22:37:54.504 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "use_agent", 2024-09-10T22:37:54.505 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-10T22:37:54.505 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.505 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-10T22:37:54.505 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-10T22:37:54.505 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.505 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.505 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.505 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2024-09-10T22:37:54.505 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.505 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.505 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.505 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.505 INFO:teuthology.orchestra.run.smithi019.stdout: "use_repo_digest": { 2024-09-10T22:37:54.506 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "use_repo_digest", 2024-09-10T22:37:54.506 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-10T22:37:54.506 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.506 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-10T22:37:54.506 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "True", 2024-09-10T22:37:54.506 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.506 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.506 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.506 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2024-09-10T22:37:54.506 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.506 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.506 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.506 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.506 INFO:teuthology.orchestra.run.smithi019.stdout: "warn_on_failed_host_check": { 2024-09-10T22:37:54.507 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "warn_on_failed_host_check", 2024-09-10T22:37:54.507 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-10T22:37:54.507 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.507 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-10T22:37:54.507 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "True", 2024-09-10T22:37:54.507 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.507 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.507 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.507 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "raise a health warning if the host check fails", 2024-09-10T22:37:54.507 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.507 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.507 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.507 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.507 INFO:teuthology.orchestra.run.smithi019.stdout: "warn_on_stray_daemons": { 2024-09-10T22:37:54.508 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "warn_on_stray_daemons", 2024-09-10T22:37:54.508 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-10T22:37:54.508 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.508 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-10T22:37:54.508 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "True", 2024-09-10T22:37:54.508 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.508 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.508 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.508 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2024-09-10T22:37:54.508 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.508 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.508 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.508 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.508 INFO:teuthology.orchestra.run.smithi019.stdout: "warn_on_stray_hosts": { 2024-09-10T22:37:54.509 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "warn_on_stray_hosts", 2024-09-10T22:37:54.509 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-10T22:37:54.509 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.509 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-10T22:37:54.509 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "True", 2024-09-10T22:37:54.509 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.509 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.509 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.509 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2024-09-10T22:37:54.509 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.509 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.509 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.509 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-10T22:37:54.509 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-10T22:37:54.510 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.510 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-10T22:37:54.510 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "crash", 2024-09-10T22:37:54.510 INFO:teuthology.orchestra.run.smithi019.stdout: "can_run": true, 2024-09-10T22:37:54.510 INFO:teuthology.orchestra.run.smithi019.stdout: "error_string": "", 2024-09-10T22:37:54.510 INFO:teuthology.orchestra.run.smithi019.stdout: "module_options": { 2024-09-10T22:37:54.510 INFO:teuthology.orchestra.run.smithi019.stdout: "log_level": { 2024-09-10T22:37:54.510 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_level", 2024-09-10T22:37:54.510 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-10T22:37:54.510 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.510 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:54.510 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-10T22:37:54.510 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.510 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.510 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-10T22:37:54.511 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-10T22:37:54.511 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-10T22:37:54.511 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-10T22:37:54.511 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-10T22:37:54.511 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-10T22:37:54.511 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-10T22:37:54.511 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-10T22:37:54.511 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:54.511 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.511 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.511 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.511 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.511 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster": { 2024-09-10T22:37:54.511 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster", 2024-09-10T22:37:54.512 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-10T22:37:54.512 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.512 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:54.512 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-10T22:37:54.512 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.512 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.512 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.512 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:54.512 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.512 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.512 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.512 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.512 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster_level": { 2024-09-10T22:37:54.513 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster_level", 2024-09-10T22:37:54.513 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-10T22:37:54.513 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.513 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:54.513 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "info", 2024-09-10T22:37:54.513 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.513 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.513 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-10T22:37:54.513 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-10T22:37:54.513 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-10T22:37:54.513 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-10T22:37:54.513 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-10T22:37:54.513 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-10T22:37:54.514 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-10T22:37:54.514 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-10T22:37:54.514 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:54.514 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.514 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.514 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.514 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.514 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_file": { 2024-09-10T22:37:54.514 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_file", 2024-09-10T22:37:54.514 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-10T22:37:54.514 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.514 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:54.514 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-10T22:37:54.514 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.515 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.515 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.515 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:54.515 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.515 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.515 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.515 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.515 INFO:teuthology.orchestra.run.smithi019.stdout: "retain_interval": { 2024-09-10T22:37:54.515 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "retain_interval", 2024-09-10T22:37:54.515 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "secs", 2024-09-10T22:37:54.515 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.515 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:54.515 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "31536000", 2024-09-10T22:37:54.515 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.516 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.516 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.516 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "how long to retain crashes before pruning them", 2024-09-10T22:37:54.516 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.516 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.516 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.516 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.516 INFO:teuthology.orchestra.run.smithi019.stdout: "sqlite3_killpoint": { 2024-09-10T22:37:54.516 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "sqlite3_killpoint", 2024-09-10T22:37:54.516 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "int", 2024-09-10T22:37:54.516 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "dev", 2024-09-10T22:37:54.516 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:54.516 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "0", 2024-09-10T22:37:54.517 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.517 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.517 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.517 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:54.517 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.517 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.517 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.517 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.517 INFO:teuthology.orchestra.run.smithi019.stdout: "warn_recent_interval": { 2024-09-10T22:37:54.517 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "warn_recent_interval", 2024-09-10T22:37:54.517 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "secs", 2024-09-10T22:37:54.517 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.517 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:54.518 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "1209600", 2024-09-10T22:37:54.518 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.518 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.518 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.518 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "time interval in which to warn about recent crashes", 2024-09-10T22:37:54.518 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.518 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.518 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.518 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-10T22:37:54.518 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-10T22:37:54.518 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.518 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-10T22:37:54.518 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "dashboard", 2024-09-10T22:37:54.518 INFO:teuthology.orchestra.run.smithi019.stdout: "can_run": true, 2024-09-10T22:37:54.519 INFO:teuthology.orchestra.run.smithi019.stdout: "error_string": "", 2024-09-10T22:37:54.519 INFO:teuthology.orchestra.run.smithi019.stdout: "module_options": { 2024-09-10T22:37:54.519 INFO:teuthology.orchestra.run.smithi019.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2024-09-10T22:37:54.519 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2024-09-10T22:37:54.519 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "int", 2024-09-10T22:37:54.519 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.519 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-10T22:37:54.519 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "10", 2024-09-10T22:37:54.519 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.519 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.519 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.519 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:54.519 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.520 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.520 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.520 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.520 INFO:teuthology.orchestra.run.smithi019.stdout: "ALERTMANAGER_API_HOST": { 2024-09-10T22:37:54.520 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "ALERTMANAGER_API_HOST", 2024-09-10T22:37:54.520 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-10T22:37:54.520 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.520 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-10T22:37:54.520 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-10T22:37:54.520 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.520 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.520 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.520 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:54.521 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.521 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.521 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.521 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.521 INFO:teuthology.orchestra.run.smithi019.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2024-09-10T22:37:54.521 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2024-09-10T22:37:54.521 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-10T22:37:54.521 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.521 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-10T22:37:54.521 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "True", 2024-09-10T22:37:54.521 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.521 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.521 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.522 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:54.522 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.522 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.522 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.522 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.522 INFO:teuthology.orchestra.run.smithi019.stdout: "AUDIT_API_ENABLED": { 2024-09-10T22:37:54.522 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "AUDIT_API_ENABLED", 2024-09-10T22:37:54.522 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-10T22:37:54.522 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.522 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-10T22:37:54.522 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-10T22:37:54.522 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.522 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.523 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.523 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:54.523 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.523 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.523 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.523 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.523 INFO:teuthology.orchestra.run.smithi019.stdout: "AUDIT_API_LOG_PAYLOAD": { 2024-09-10T22:37:54.523 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2024-09-10T22:37:54.523 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-10T22:37:54.523 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.523 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-10T22:37:54.523 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "True", 2024-09-10T22:37:54.523 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.524 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.524 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.524 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:54.524 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.524 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.524 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.524 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.524 INFO:teuthology.orchestra.run.smithi019.stdout: "ENABLE_BROWSABLE_API": { 2024-09-10T22:37:54.524 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "ENABLE_BROWSABLE_API", 2024-09-10T22:37:54.524 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-10T22:37:54.524 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.524 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-10T22:37:54.524 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "True", 2024-09-10T22:37:54.525 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.525 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.525 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.525 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:54.525 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.525 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.525 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.525 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.525 INFO:teuthology.orchestra.run.smithi019.stdout: "FEATURE_TOGGLE_CEPHFS": { 2024-09-10T22:37:54.525 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2024-09-10T22:37:54.525 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-10T22:37:54.525 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.526 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-10T22:37:54.526 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "True", 2024-09-10T22:37:54.526 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.526 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.526 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.526 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:54.526 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.526 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.526 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.526 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.526 INFO:teuthology.orchestra.run.smithi019.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2024-09-10T22:37:54.526 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2024-09-10T22:37:54.526 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-10T22:37:54.527 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.527 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-10T22:37:54.527 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "True", 2024-09-10T22:37:54.527 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.527 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.527 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.527 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:54.527 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.527 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.527 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.527 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.527 INFO:teuthology.orchestra.run.smithi019.stdout: "FEATURE_TOGGLE_ISCSI": { 2024-09-10T22:37:54.527 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2024-09-10T22:37:54.528 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-10T22:37:54.528 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.528 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-10T22:37:54.528 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "True", 2024-09-10T22:37:54.528 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.528 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.528 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.528 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:54.528 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.528 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.528 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.528 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.528 INFO:teuthology.orchestra.run.smithi019.stdout: "FEATURE_TOGGLE_MIRRORING": { 2024-09-10T22:37:54.529 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2024-09-10T22:37:54.529 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-10T22:37:54.529 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.529 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-10T22:37:54.529 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "True", 2024-09-10T22:37:54.529 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.529 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.529 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.529 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:54.529 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.529 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.529 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.530 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.530 INFO:teuthology.orchestra.run.smithi019.stdout: "FEATURE_TOGGLE_NFS": { 2024-09-10T22:37:54.530 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "FEATURE_TOGGLE_NFS", 2024-09-10T22:37:54.530 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-10T22:37:54.530 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.530 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-10T22:37:54.530 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "True", 2024-09-10T22:37:54.530 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.530 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.530 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.530 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:54.530 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.530 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.530 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.530 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.531 INFO:teuthology.orchestra.run.smithi019.stdout: "FEATURE_TOGGLE_RBD": { 2024-09-10T22:37:54.531 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "FEATURE_TOGGLE_RBD", 2024-09-10T22:37:54.531 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-10T22:37:54.531 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.531 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-10T22:37:54.531 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "True", 2024-09-10T22:37:54.531 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.531 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.531 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.531 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:54.531 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.531 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.531 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.531 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.532 INFO:teuthology.orchestra.run.smithi019.stdout: "FEATURE_TOGGLE_RGW": { 2024-09-10T22:37:54.532 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "FEATURE_TOGGLE_RGW", 2024-09-10T22:37:54.532 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-10T22:37:54.532 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.532 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-10T22:37:54.532 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "True", 2024-09-10T22:37:54.532 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.532 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.532 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.532 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:54.532 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.532 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.532 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.533 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.533 INFO:teuthology.orchestra.run.smithi019.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2024-09-10T22:37:54.533 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2024-09-10T22:37:54.533 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-10T22:37:54.533 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.533 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-10T22:37:54.533 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-10T22:37:54.533 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.533 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.533 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.533 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:54.533 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.533 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.533 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.534 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.534 INFO:teuthology.orchestra.run.smithi019.stdout: "GRAFANA_API_PASSWORD": { 2024-09-10T22:37:54.534 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "GRAFANA_API_PASSWORD", 2024-09-10T22:37:54.534 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-10T22:37:54.534 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.534 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-10T22:37:54.534 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "admin", 2024-09-10T22:37:54.534 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.534 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.534 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.534 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:54.534 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.534 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.534 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.534 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.535 INFO:teuthology.orchestra.run.smithi019.stdout: "GRAFANA_API_SSL_VERIFY": { 2024-09-10T22:37:54.535 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2024-09-10T22:37:54.535 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-10T22:37:54.535 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.535 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-10T22:37:54.535 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "True", 2024-09-10T22:37:54.535 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.535 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.535 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.535 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:54.535 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.535 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.535 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.536 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.536 INFO:teuthology.orchestra.run.smithi019.stdout: "GRAFANA_API_URL": { 2024-09-10T22:37:54.536 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "GRAFANA_API_URL", 2024-09-10T22:37:54.536 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-10T22:37:54.536 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.536 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-10T22:37:54.536 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-10T22:37:54.536 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.536 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.536 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.536 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:54.536 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.536 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.537 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.537 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.537 INFO:teuthology.orchestra.run.smithi019.stdout: "GRAFANA_API_USERNAME": { 2024-09-10T22:37:54.537 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "GRAFANA_API_USERNAME", 2024-09-10T22:37:54.537 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-10T22:37:54.537 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.537 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-10T22:37:54.537 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "admin", 2024-09-10T22:37:54.537 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.537 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.537 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.537 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:54.537 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.537 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.538 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.538 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.538 INFO:teuthology.orchestra.run.smithi019.stdout: "GRAFANA_FRONTEND_API_URL": { 2024-09-10T22:37:54.538 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2024-09-10T22:37:54.538 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-10T22:37:54.538 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.538 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-10T22:37:54.538 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-10T22:37:54.538 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.538 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.538 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.538 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:54.538 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.539 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.539 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.539 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.539 INFO:teuthology.orchestra.run.smithi019.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2024-09-10T22:37:54.539 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2024-09-10T22:37:54.539 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-10T22:37:54.539 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.539 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-10T22:37:54.539 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-10T22:37:54.539 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.539 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.539 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.539 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:54.539 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.540 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.540 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.540 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.540 INFO:teuthology.orchestra.run.smithi019.stdout: "ISCSI_API_SSL_VERIFICATION": { 2024-09-10T22:37:54.540 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2024-09-10T22:37:54.540 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-10T22:37:54.540 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.540 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-10T22:37:54.540 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "True", 2024-09-10T22:37:54.540 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.540 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.540 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.540 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:54.541 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.541 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.541 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.541 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.541 INFO:teuthology.orchestra.run.smithi019.stdout: "ISSUE_TRACKER_API_KEY": { 2024-09-10T22:37:54.541 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "ISSUE_TRACKER_API_KEY", 2024-09-10T22:37:54.541 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-10T22:37:54.541 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.541 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-10T22:37:54.541 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-10T22:37:54.541 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.541 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.541 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.542 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:54.542 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.542 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.542 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.542 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.542 INFO:teuthology.orchestra.run.smithi019.stdout: "MANAGED_BY_CLUSTERS": { 2024-09-10T22:37:54.542 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "MANAGED_BY_CLUSTERS", 2024-09-10T22:37:54.542 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-10T22:37:54.542 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.542 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-10T22:37:54.542 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "[]", 2024-09-10T22:37:54.542 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.542 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.543 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.543 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:54.543 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.543 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.543 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.543 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.543 INFO:teuthology.orchestra.run.smithi019.stdout: "MULTICLUSTER_CONFIG": { 2024-09-10T22:37:54.543 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "MULTICLUSTER_CONFIG", 2024-09-10T22:37:54.543 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-10T22:37:54.543 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.543 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-10T22:37:54.543 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "{}", 2024-09-10T22:37:54.543 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.543 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.544 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.544 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:54.544 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.544 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.544 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.544 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.544 INFO:teuthology.orchestra.run.smithi019.stdout: "PROMETHEUS_API_HOST": { 2024-09-10T22:37:54.544 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "PROMETHEUS_API_HOST", 2024-09-10T22:37:54.544 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-10T22:37:54.544 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.544 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-10T22:37:54.544 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-10T22:37:54.544 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.544 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.545 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.545 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:54.545 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.545 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.545 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.545 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.545 INFO:teuthology.orchestra.run.smithi019.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2024-09-10T22:37:54.545 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2024-09-10T22:37:54.545 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-10T22:37:54.545 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.545 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-10T22:37:54.545 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "True", 2024-09-10T22:37:54.545 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.546 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.546 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.546 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:54.546 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.546 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.546 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.546 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.546 INFO:teuthology.orchestra.run.smithi019.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2024-09-10T22:37:54.546 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2024-09-10T22:37:54.546 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-10T22:37:54.546 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.546 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-10T22:37:54.546 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-10T22:37:54.546 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.547 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.547 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.547 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:54.547 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.547 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.547 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.547 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.547 INFO:teuthology.orchestra.run.smithi019.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2024-09-10T22:37:54.547 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2024-09-10T22:37:54.547 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-10T22:37:54.547 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.547 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-10T22:37:54.547 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-10T22:37:54.548 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.548 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.548 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.548 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:54.548 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.548 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.548 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.548 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.548 INFO:teuthology.orchestra.run.smithi019.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2024-09-10T22:37:54.548 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2024-09-10T22:37:54.548 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-10T22:37:54.548 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.548 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-10T22:37:54.549 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "True", 2024-09-10T22:37:54.549 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.549 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.549 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.549 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:54.549 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.549 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.549 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.549 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.549 INFO:teuthology.orchestra.run.smithi019.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2024-09-10T22:37:54.549 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2024-09-10T22:37:54.549 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-10T22:37:54.550 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.550 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-10T22:37:54.550 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "True", 2024-09-10T22:37:54.550 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.550 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.550 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.550 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:54.550 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.550 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.550 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.550 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.550 INFO:teuthology.orchestra.run.smithi019.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2024-09-10T22:37:54.550 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2024-09-10T22:37:54.551 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-10T22:37:54.551 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.551 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-10T22:37:54.551 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-10T22:37:54.551 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.551 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.551 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.551 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:54.551 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.551 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.551 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.551 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.551 INFO:teuthology.orchestra.run.smithi019.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2024-09-10T22:37:54.551 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2024-09-10T22:37:54.551 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-10T22:37:54.552 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.552 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-10T22:37:54.552 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-10T22:37:54.552 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.552 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.552 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.552 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:54.552 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.552 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.552 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.552 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.552 INFO:teuthology.orchestra.run.smithi019.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2024-09-10T22:37:54.552 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2024-09-10T22:37:54.553 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-10T22:37:54.553 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.553 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-10T22:37:54.556 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-10T22:37:54.556 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.556 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.556 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.557 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:54.557 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.557 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.557 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.557 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.557 INFO:teuthology.orchestra.run.smithi019.stdout: "PWD_POLICY_ENABLED": { 2024-09-10T22:37:54.557 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "PWD_POLICY_ENABLED", 2024-09-10T22:37:54.557 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-10T22:37:54.557 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.557 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-10T22:37:54.557 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "True", 2024-09-10T22:37:54.557 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.557 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.557 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.558 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:54.558 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.558 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.558 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.558 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.558 INFO:teuthology.orchestra.run.smithi019.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2024-09-10T22:37:54.558 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2024-09-10T22:37:54.558 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-10T22:37:54.558 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.558 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-10T22:37:54.558 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2024-09-10T22:37:54.558 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.558 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.558 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.559 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:54.559 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.559 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.559 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.559 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.559 INFO:teuthology.orchestra.run.smithi019.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2024-09-10T22:37:54.559 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2024-09-10T22:37:54.559 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "int", 2024-09-10T22:37:54.559 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.559 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-10T22:37:54.559 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "10", 2024-09-10T22:37:54.559 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.559 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.560 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.560 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:54.560 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.560 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.560 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.560 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.560 INFO:teuthology.orchestra.run.smithi019.stdout: "PWD_POLICY_MIN_LENGTH": { 2024-09-10T22:37:54.560 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2024-09-10T22:37:54.560 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "int", 2024-09-10T22:37:54.560 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.560 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-10T22:37:54.560 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "8", 2024-09-10T22:37:54.560 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.560 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.561 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.561 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:54.561 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.561 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.561 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.561 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.561 INFO:teuthology.orchestra.run.smithi019.stdout: "REST_REQUESTS_TIMEOUT": { 2024-09-10T22:37:54.561 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "REST_REQUESTS_TIMEOUT", 2024-09-10T22:37:54.561 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "int", 2024-09-10T22:37:54.561 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.561 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-10T22:37:54.561 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "45", 2024-09-10T22:37:54.561 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.561 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.562 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.562 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:54.562 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.562 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.562 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.562 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.562 INFO:teuthology.orchestra.run.smithi019.stdout: "RGW_API_ACCESS_KEY": { 2024-09-10T22:37:54.562 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "RGW_API_ACCESS_KEY", 2024-09-10T22:37:54.562 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-10T22:37:54.562 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.562 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-10T22:37:54.562 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-10T22:37:54.562 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.563 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.563 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.563 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:54.563 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.563 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.563 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.563 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.563 INFO:teuthology.orchestra.run.smithi019.stdout: "RGW_API_ADMIN_RESOURCE": { 2024-09-10T22:37:54.563 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2024-09-10T22:37:54.563 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-10T22:37:54.563 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.563 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-10T22:37:54.563 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "admin", 2024-09-10T22:37:54.563 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.563 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.564 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.564 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:54.564 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.564 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.564 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.564 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.564 INFO:teuthology.orchestra.run.smithi019.stdout: "RGW_API_SECRET_KEY": { 2024-09-10T22:37:54.564 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "RGW_API_SECRET_KEY", 2024-09-10T22:37:54.564 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-10T22:37:54.564 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.564 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-10T22:37:54.564 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-10T22:37:54.564 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.564 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.565 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.565 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:54.565 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.565 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.565 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.565 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.565 INFO:teuthology.orchestra.run.smithi019.stdout: "RGW_API_SSL_VERIFY": { 2024-09-10T22:37:54.565 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "RGW_API_SSL_VERIFY", 2024-09-10T22:37:54.565 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-10T22:37:54.565 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.565 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-10T22:37:54.565 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "True", 2024-09-10T22:37:54.565 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.565 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.566 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.566 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:54.566 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.566 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.566 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.566 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.566 INFO:teuthology.orchestra.run.smithi019.stdout: "UNSAFE_TLS_v1_2": { 2024-09-10T22:37:54.566 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "UNSAFE_TLS_v1_2", 2024-09-10T22:37:54.566 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-10T22:37:54.566 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.566 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-10T22:37:54.566 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-10T22:37:54.567 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.567 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.567 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.567 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:54.567 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.567 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.567 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.567 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.567 INFO:teuthology.orchestra.run.smithi019.stdout: "USER_PWD_EXPIRATION_SPAN": { 2024-09-10T22:37:54.567 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2024-09-10T22:37:54.567 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "int", 2024-09-10T22:37:54.567 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.567 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-10T22:37:54.568 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "0", 2024-09-10T22:37:54.568 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.568 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.568 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.568 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:54.568 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.568 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.568 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.568 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.568 INFO:teuthology.orchestra.run.smithi019.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2024-09-10T22:37:54.568 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2024-09-10T22:37:54.568 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "int", 2024-09-10T22:37:54.568 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.568 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-10T22:37:54.569 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "10", 2024-09-10T22:37:54.569 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.569 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.569 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.569 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:54.569 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.569 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.569 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.569 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.569 INFO:teuthology.orchestra.run.smithi019.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2024-09-10T22:37:54.569 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2024-09-10T22:37:54.569 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "int", 2024-09-10T22:37:54.569 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.570 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-10T22:37:54.570 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "5", 2024-09-10T22:37:54.570 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.570 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.570 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.570 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:54.570 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.570 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.570 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.570 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.570 INFO:teuthology.orchestra.run.smithi019.stdout: "cross_origin_url": { 2024-09-10T22:37:54.570 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "cross_origin_url", 2024-09-10T22:37:54.570 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-10T22:37:54.571 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.571 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-10T22:37:54.571 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-10T22:37:54.571 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.571 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.571 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.571 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:54.571 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.571 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.571 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.571 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.571 INFO:teuthology.orchestra.run.smithi019.stdout: "crt_file": { 2024-09-10T22:37:54.572 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "crt_file", 2024-09-10T22:37:54.572 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-10T22:37:54.572 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.572 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-10T22:37:54.572 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-10T22:37:54.572 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.572 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.572 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.572 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:54.572 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.572 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.572 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.572 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.573 INFO:teuthology.orchestra.run.smithi019.stdout: "debug": { 2024-09-10T22:37:54.573 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "debug", 2024-09-10T22:37:54.573 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-10T22:37:54.573 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.573 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-10T22:37:54.573 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-10T22:37:54.573 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.573 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.573 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.573 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "Enable/disable debug options", 2024-09-10T22:37:54.573 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.573 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.573 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.574 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.574 INFO:teuthology.orchestra.run.smithi019.stdout: "jwt_token_ttl": { 2024-09-10T22:37:54.574 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "jwt_token_ttl", 2024-09-10T22:37:54.574 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "int", 2024-09-10T22:37:54.574 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.574 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-10T22:37:54.574 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "28800", 2024-09-10T22:37:54.574 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.574 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.574 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.574 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:54.574 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.574 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.575 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.575 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.575 INFO:teuthology.orchestra.run.smithi019.stdout: "key_file": { 2024-09-10T22:37:54.575 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "key_file", 2024-09-10T22:37:54.575 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-10T22:37:54.575 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.575 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-10T22:37:54.575 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-10T22:37:54.575 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.575 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.575 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.575 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:54.575 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.575 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.576 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.576 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.576 INFO:teuthology.orchestra.run.smithi019.stdout: "log_level": { 2024-09-10T22:37:54.576 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_level", 2024-09-10T22:37:54.576 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-10T22:37:54.576 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.576 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:54.576 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-10T22:37:54.576 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.576 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.576 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-10T22:37:54.576 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-10T22:37:54.576 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-10T22:37:54.577 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-10T22:37:54.577 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-10T22:37:54.577 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-10T22:37:54.577 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-10T22:37:54.577 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-10T22:37:54.577 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:54.577 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.577 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.577 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.577 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.577 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster": { 2024-09-10T22:37:54.577 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster", 2024-09-10T22:37:54.577 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-10T22:37:54.578 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.578 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:54.578 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-10T22:37:54.578 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.578 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.578 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.578 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:54.578 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.578 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.578 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.578 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.578 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster_level": { 2024-09-10T22:37:54.578 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster_level", 2024-09-10T22:37:54.578 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-10T22:37:54.579 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.579 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:54.579 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "info", 2024-09-10T22:37:54.579 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.579 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.579 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-10T22:37:54.579 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-10T22:37:54.579 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-10T22:37:54.579 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-10T22:37:54.579 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-10T22:37:54.579 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-10T22:37:54.579 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-10T22:37:54.579 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-10T22:37:54.580 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:54.580 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.580 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.580 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.580 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.580 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_file": { 2024-09-10T22:37:54.580 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_file", 2024-09-10T22:37:54.580 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-10T22:37:54.580 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.580 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:54.580 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-10T22:37:54.580 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.580 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.581 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.581 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:54.581 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.581 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.581 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.581 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.581 INFO:teuthology.orchestra.run.smithi019.stdout: "motd": { 2024-09-10T22:37:54.581 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "motd", 2024-09-10T22:37:54.581 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-10T22:37:54.581 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.581 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-10T22:37:54.581 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-10T22:37:54.581 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.582 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.582 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.582 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "The message of the day", 2024-09-10T22:37:54.582 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.582 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.582 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.582 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.582 INFO:teuthology.orchestra.run.smithi019.stdout: "redirect_resolve_ip_addr": { 2024-09-10T22:37:54.582 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "redirect_resolve_ip_addr", 2024-09-10T22:37:54.582 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-10T22:37:54.582 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.582 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-10T22:37:54.582 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-10T22:37:54.583 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.583 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.583 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.583 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:54.583 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.583 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.583 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.583 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.583 INFO:teuthology.orchestra.run.smithi019.stdout: "server_addr": { 2024-09-10T22:37:54.583 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "server_addr", 2024-09-10T22:37:54.583 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-10T22:37:54.583 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.583 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-10T22:37:54.584 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "::", 2024-09-10T22:37:54.584 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.584 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.584 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.584 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:54.584 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.584 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.584 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.584 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.584 INFO:teuthology.orchestra.run.smithi019.stdout: "server_port": { 2024-09-10T22:37:54.584 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "server_port", 2024-09-10T22:37:54.584 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "int", 2024-09-10T22:37:54.584 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.585 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-10T22:37:54.585 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "8080", 2024-09-10T22:37:54.585 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.585 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.585 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.585 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:54.585 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.585 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.585 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.585 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.585 INFO:teuthology.orchestra.run.smithi019.stdout: "sqlite3_killpoint": { 2024-09-10T22:37:54.585 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "sqlite3_killpoint", 2024-09-10T22:37:54.585 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "int", 2024-09-10T22:37:54.585 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "dev", 2024-09-10T22:37:54.586 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:54.586 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "0", 2024-09-10T22:37:54.586 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.586 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.586 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.586 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:54.586 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.586 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.586 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.586 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.586 INFO:teuthology.orchestra.run.smithi019.stdout: "ssl": { 2024-09-10T22:37:54.586 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "ssl", 2024-09-10T22:37:54.586 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-10T22:37:54.587 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.587 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-10T22:37:54.587 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "True", 2024-09-10T22:37:54.587 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.587 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.587 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.587 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:54.587 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.587 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.587 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.587 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.587 INFO:teuthology.orchestra.run.smithi019.stdout: "ssl_server_port": { 2024-09-10T22:37:54.587 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "ssl_server_port", 2024-09-10T22:37:54.587 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "int", 2024-09-10T22:37:54.588 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.588 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-10T22:37:54.588 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "8443", 2024-09-10T22:37:54.588 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.588 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.588 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.588 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:54.588 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.588 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.588 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.588 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.588 INFO:teuthology.orchestra.run.smithi019.stdout: "standby_behaviour": { 2024-09-10T22:37:54.588 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "standby_behaviour", 2024-09-10T22:37:54.589 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-10T22:37:54.589 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.589 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-10T22:37:54.589 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "redirect", 2024-09-10T22:37:54.589 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.589 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.589 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-10T22:37:54.589 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-10T22:37:54.589 INFO:teuthology.orchestra.run.smithi019.stdout: "redirect" 2024-09-10T22:37:54.589 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-10T22:37:54.589 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:54.589 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.589 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.590 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.590 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.590 INFO:teuthology.orchestra.run.smithi019.stdout: "standby_error_status_code": { 2024-09-10T22:37:54.590 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "standby_error_status_code", 2024-09-10T22:37:54.590 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "int", 2024-09-10T22:37:54.590 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.590 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-10T22:37:54.590 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "500", 2024-09-10T22:37:54.590 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "400", 2024-09-10T22:37:54.590 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "599", 2024-09-10T22:37:54.590 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.590 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:54.590 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.591 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.591 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.591 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.591 INFO:teuthology.orchestra.run.smithi019.stdout: "url_prefix": { 2024-09-10T22:37:54.591 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "url_prefix", 2024-09-10T22:37:54.591 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-10T22:37:54.591 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.591 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-10T22:37:54.591 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-10T22:37:54.591 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.591 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.591 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.591 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:54.592 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.592 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.592 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.592 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-10T22:37:54.592 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-10T22:37:54.592 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.592 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-10T22:37:54.592 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "devicehealth", 2024-09-10T22:37:54.592 INFO:teuthology.orchestra.run.smithi019.stdout: "can_run": true, 2024-09-10T22:37:54.592 INFO:teuthology.orchestra.run.smithi019.stdout: "error_string": "", 2024-09-10T22:37:54.592 INFO:teuthology.orchestra.run.smithi019.stdout: "module_options": { 2024-09-10T22:37:54.592 INFO:teuthology.orchestra.run.smithi019.stdout: "enable_monitoring": { 2024-09-10T22:37:54.592 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "enable_monitoring", 2024-09-10T22:37:54.593 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-10T22:37:54.593 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.593 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:54.593 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "True", 2024-09-10T22:37:54.593 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.593 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.593 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.593 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "monitor device health metrics", 2024-09-10T22:37:54.593 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.593 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.593 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.593 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.593 INFO:teuthology.orchestra.run.smithi019.stdout: "log_level": { 2024-09-10T22:37:54.594 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_level", 2024-09-10T22:37:54.594 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-10T22:37:54.594 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.594 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:54.594 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-10T22:37:54.594 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.594 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.594 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-10T22:37:54.594 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-10T22:37:54.594 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-10T22:37:54.594 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-10T22:37:54.594 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-10T22:37:54.595 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-10T22:37:54.595 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-10T22:37:54.595 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-10T22:37:54.595 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:54.595 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.595 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.595 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.595 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.595 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster": { 2024-09-10T22:37:54.595 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster", 2024-09-10T22:37:54.595 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-10T22:37:54.595 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.596 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:54.596 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-10T22:37:54.596 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.596 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.596 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.596 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:54.596 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.596 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.596 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.596 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.596 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster_level": { 2024-09-10T22:37:54.596 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster_level", 2024-09-10T22:37:54.597 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-10T22:37:54.597 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.597 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:54.597 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "info", 2024-09-10T22:37:54.597 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.597 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.597 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-10T22:37:54.597 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-10T22:37:54.597 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-10T22:37:54.597 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-10T22:37:54.597 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-10T22:37:54.597 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-10T22:37:54.597 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-10T22:37:54.598 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-10T22:37:54.598 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:54.598 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.598 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.598 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.598 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.598 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_file": { 2024-09-10T22:37:54.598 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_file", 2024-09-10T22:37:54.598 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-10T22:37:54.598 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.598 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:54.598 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-10T22:37:54.598 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.599 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.599 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.599 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:54.599 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.599 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.599 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.599 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.599 INFO:teuthology.orchestra.run.smithi019.stdout: "mark_out_threshold": { 2024-09-10T22:37:54.599 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "mark_out_threshold", 2024-09-10T22:37:54.599 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "secs", 2024-09-10T22:37:54.599 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.599 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:54.599 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "2419200", 2024-09-10T22:37:54.600 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.600 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.600 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.600 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "automatically mark OSD if it may fail before this long", 2024-09-10T22:37:54.600 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.600 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.600 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.600 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.600 INFO:teuthology.orchestra.run.smithi019.stdout: "pool_name": { 2024-09-10T22:37:54.600 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "pool_name", 2024-09-10T22:37:54.600 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-10T22:37:54.600 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.601 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:54.601 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "device_health_metrics", 2024-09-10T22:37:54.601 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.601 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.601 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.601 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "name of pool in which to store device health metrics", 2024-09-10T22:37:54.601 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.601 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.601 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.601 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.601 INFO:teuthology.orchestra.run.smithi019.stdout: "retention_period": { 2024-09-10T22:37:54.601 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "retention_period", 2024-09-10T22:37:54.601 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "secs", 2024-09-10T22:37:54.602 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.602 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:54.602 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "15552000", 2024-09-10T22:37:54.602 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.602 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.602 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.602 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "how long to retain device health metrics", 2024-09-10T22:37:54.602 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.602 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.602 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.602 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.602 INFO:teuthology.orchestra.run.smithi019.stdout: "scrape_frequency": { 2024-09-10T22:37:54.602 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "scrape_frequency", 2024-09-10T22:37:54.603 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "secs", 2024-09-10T22:37:54.603 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.603 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:54.603 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "86400", 2024-09-10T22:37:54.603 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.603 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.603 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.603 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "how frequently to scrape device health metrics", 2024-09-10T22:37:54.603 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.603 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.603 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.603 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.603 INFO:teuthology.orchestra.run.smithi019.stdout: "self_heal": { 2024-09-10T22:37:54.604 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "self_heal", 2024-09-10T22:37:54.604 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-10T22:37:54.604 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.604 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:54.604 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "True", 2024-09-10T22:37:54.604 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.604 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.604 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.604 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "preemptively heal cluster around devices that may fail", 2024-09-10T22:37:54.604 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.604 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.604 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.604 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.605 INFO:teuthology.orchestra.run.smithi019.stdout: "sleep_interval": { 2024-09-10T22:37:54.605 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "sleep_interval", 2024-09-10T22:37:54.605 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "secs", 2024-09-10T22:37:54.605 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.605 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:54.605 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "600", 2024-09-10T22:37:54.605 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.605 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.605 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.605 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "how frequently to wake up and check device health", 2024-09-10T22:37:54.605 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.605 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.606 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.606 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.606 INFO:teuthology.orchestra.run.smithi019.stdout: "sqlite3_killpoint": { 2024-09-10T22:37:54.606 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "sqlite3_killpoint", 2024-09-10T22:37:54.606 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "int", 2024-09-10T22:37:54.606 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "dev", 2024-09-10T22:37:54.606 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:54.606 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "0", 2024-09-10T22:37:54.606 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.606 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.606 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.606 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:54.606 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.606 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.607 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.607 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.607 INFO:teuthology.orchestra.run.smithi019.stdout: "warn_threshold": { 2024-09-10T22:37:54.607 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "warn_threshold", 2024-09-10T22:37:54.607 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "secs", 2024-09-10T22:37:54.607 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.607 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:54.607 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "7257600", 2024-09-10T22:37:54.607 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.607 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.607 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.607 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "raise health warning if OSD may fail before this long", 2024-09-10T22:37:54.607 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.608 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.608 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.608 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-10T22:37:54.608 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-10T22:37:54.608 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.608 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-10T22:37:54.608 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "diskprediction_local", 2024-09-10T22:37:54.608 INFO:teuthology.orchestra.run.smithi019.stdout: "can_run": true, 2024-09-10T22:37:54.608 INFO:teuthology.orchestra.run.smithi019.stdout: "error_string": "", 2024-09-10T22:37:54.608 INFO:teuthology.orchestra.run.smithi019.stdout: "module_options": { 2024-09-10T22:37:54.608 INFO:teuthology.orchestra.run.smithi019.stdout: "log_level": { 2024-09-10T22:37:54.608 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_level", 2024-09-10T22:37:54.608 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-10T22:37:54.609 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.609 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:54.609 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-10T22:37:54.609 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.609 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.609 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-10T22:37:54.609 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-10T22:37:54.609 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-10T22:37:54.609 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-10T22:37:54.609 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-10T22:37:54.609 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-10T22:37:54.609 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-10T22:37:54.609 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-10T22:37:54.610 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:54.610 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.610 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.610 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.610 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.610 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster": { 2024-09-10T22:37:54.610 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster", 2024-09-10T22:37:54.610 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-10T22:37:54.610 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.610 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:54.610 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-10T22:37:54.610 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.610 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.610 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.611 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:54.611 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.611 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.611 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.611 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.611 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster_level": { 2024-09-10T22:37:54.611 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster_level", 2024-09-10T22:37:54.611 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-10T22:37:54.611 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.611 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:54.611 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "info", 2024-09-10T22:37:54.611 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.611 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.611 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-10T22:37:54.612 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-10T22:37:54.612 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-10T22:37:54.612 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-10T22:37:54.612 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-10T22:37:54.612 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-10T22:37:54.612 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-10T22:37:54.612 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-10T22:37:54.612 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:54.612 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.612 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.612 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.612 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.612 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_file": { 2024-09-10T22:37:54.612 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_file", 2024-09-10T22:37:54.613 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-10T22:37:54.613 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.613 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:54.613 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-10T22:37:54.613 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.613 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.613 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.613 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:54.613 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.613 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.613 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.613 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.613 INFO:teuthology.orchestra.run.smithi019.stdout: "predict_interval": { 2024-09-10T22:37:54.614 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "predict_interval", 2024-09-10T22:37:54.614 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-10T22:37:54.614 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.614 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-10T22:37:54.614 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "86400", 2024-09-10T22:37:54.614 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.614 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.614 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.614 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:54.614 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.614 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.614 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.615 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.615 INFO:teuthology.orchestra.run.smithi019.stdout: "predictor_model": { 2024-09-10T22:37:54.615 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "predictor_model", 2024-09-10T22:37:54.615 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-10T22:37:54.615 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.615 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-10T22:37:54.615 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "prophetstor", 2024-09-10T22:37:54.615 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.615 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.615 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.615 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:54.615 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.615 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.616 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.616 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.616 INFO:teuthology.orchestra.run.smithi019.stdout: "sleep_interval": { 2024-09-10T22:37:54.616 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "sleep_interval", 2024-09-10T22:37:54.616 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-10T22:37:54.616 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.616 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-10T22:37:54.616 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "600", 2024-09-10T22:37:54.616 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.616 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.616 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.616 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:54.617 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.617 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.617 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.617 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.617 INFO:teuthology.orchestra.run.smithi019.stdout: "sqlite3_killpoint": { 2024-09-10T22:37:54.617 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "sqlite3_killpoint", 2024-09-10T22:37:54.617 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "int", 2024-09-10T22:37:54.617 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "dev", 2024-09-10T22:37:54.617 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:54.617 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "0", 2024-09-10T22:37:54.617 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.617 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.617 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.618 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:54.618 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.618 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.618 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.618 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-10T22:37:54.618 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-10T22:37:54.618 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.618 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-10T22:37:54.618 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "influx", 2024-09-10T22:37:54.618 INFO:teuthology.orchestra.run.smithi019.stdout: "can_run": false, 2024-09-10T22:37:54.618 INFO:teuthology.orchestra.run.smithi019.stdout: "error_string": "influxdb python module not found", 2024-09-10T22:37:54.618 INFO:teuthology.orchestra.run.smithi019.stdout: "module_options": { 2024-09-10T22:37:54.618 INFO:teuthology.orchestra.run.smithi019.stdout: "batch_size": { 2024-09-10T22:37:54.619 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "batch_size", 2024-09-10T22:37:54.619 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "int", 2024-09-10T22:37:54.619 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.619 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-10T22:37:54.619 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "5000", 2024-09-10T22:37:54.619 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.619 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.619 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.619 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2024-09-10T22:37:54.619 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.619 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.619 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.619 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.619 INFO:teuthology.orchestra.run.smithi019.stdout: "database": { 2024-09-10T22:37:54.620 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "database", 2024-09-10T22:37:54.620 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-10T22:37:54.620 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.620 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-10T22:37:54.620 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "ceph", 2024-09-10T22:37:54.620 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.620 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.620 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.620 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2024-09-10T22:37:54.620 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.620 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.620 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.621 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.621 INFO:teuthology.orchestra.run.smithi019.stdout: "hostname": { 2024-09-10T22:37:54.621 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "hostname", 2024-09-10T22:37:54.621 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-10T22:37:54.621 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.621 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-10T22:37:54.621 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-10T22:37:54.621 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.621 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.621 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.621 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "InfluxDB server hostname", 2024-09-10T22:37:54.621 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.621 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.622 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.622 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.622 INFO:teuthology.orchestra.run.smithi019.stdout: "interval": { 2024-09-10T22:37:54.622 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "interval", 2024-09-10T22:37:54.622 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "secs", 2024-09-10T22:37:54.622 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.622 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-10T22:37:54.622 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "30", 2024-09-10T22:37:54.622 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "5", 2024-09-10T22:37:54.622 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.622 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.622 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2024-09-10T22:37:54.622 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.623 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.623 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.623 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.623 INFO:teuthology.orchestra.run.smithi019.stdout: "log_level": { 2024-09-10T22:37:54.623 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_level", 2024-09-10T22:37:54.623 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-10T22:37:54.623 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.623 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:54.623 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-10T22:37:54.623 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.623 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.623 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-10T22:37:54.623 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-10T22:37:54.623 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-10T22:37:54.624 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-10T22:37:54.624 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-10T22:37:54.624 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-10T22:37:54.624 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-10T22:37:54.624 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-10T22:37:54.624 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:54.624 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.624 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.624 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.624 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.624 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster": { 2024-09-10T22:37:54.624 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster", 2024-09-10T22:37:54.624 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-10T22:37:54.625 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.625 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:54.625 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-10T22:37:54.625 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.625 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.625 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.625 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:54.625 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.625 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.625 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.625 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.625 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster_level": { 2024-09-10T22:37:54.625 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster_level", 2024-09-10T22:37:54.625 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-10T22:37:54.626 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.626 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:54.626 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "info", 2024-09-10T22:37:54.626 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.626 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.626 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-10T22:37:54.626 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-10T22:37:54.626 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-10T22:37:54.626 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-10T22:37:54.626 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-10T22:37:54.626 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-10T22:37:54.626 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-10T22:37:54.626 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-10T22:37:54.626 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:54.627 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.627 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.627 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.627 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.627 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_file": { 2024-09-10T22:37:54.627 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_file", 2024-09-10T22:37:54.627 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-10T22:37:54.627 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.627 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:54.627 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-10T22:37:54.627 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.627 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.627 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.627 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:54.628 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.628 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.628 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.628 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.628 INFO:teuthology.orchestra.run.smithi019.stdout: "password": { 2024-09-10T22:37:54.628 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "password", 2024-09-10T22:37:54.628 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-10T22:37:54.628 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.628 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-10T22:37:54.628 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-10T22:37:54.628 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.628 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.628 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.628 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "password of InfluxDB server user", 2024-09-10T22:37:54.629 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.629 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.629 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.629 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.629 INFO:teuthology.orchestra.run.smithi019.stdout: "port": { 2024-09-10T22:37:54.629 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "port", 2024-09-10T22:37:54.629 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "int", 2024-09-10T22:37:54.629 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.629 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-10T22:37:54.629 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "8086", 2024-09-10T22:37:54.629 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.629 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.629 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.630 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "InfluxDB server port", 2024-09-10T22:37:54.630 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.630 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.630 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.630 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.630 INFO:teuthology.orchestra.run.smithi019.stdout: "sqlite3_killpoint": { 2024-09-10T22:37:54.630 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "sqlite3_killpoint", 2024-09-10T22:37:54.630 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "int", 2024-09-10T22:37:54.630 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "dev", 2024-09-10T22:37:54.630 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:54.630 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "0", 2024-09-10T22:37:54.630 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.630 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.631 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.631 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:54.631 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.631 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.631 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.631 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.631 INFO:teuthology.orchestra.run.smithi019.stdout: "ssl": { 2024-09-10T22:37:54.631 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "ssl", 2024-09-10T22:37:54.631 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-10T22:37:54.631 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.631 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-10T22:37:54.631 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "false", 2024-09-10T22:37:54.631 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.631 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.632 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.632 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2024-09-10T22:37:54.632 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.632 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.632 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.632 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.632 INFO:teuthology.orchestra.run.smithi019.stdout: "threads": { 2024-09-10T22:37:54.632 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "threads", 2024-09-10T22:37:54.632 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "int", 2024-09-10T22:37:54.632 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.632 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-10T22:37:54.632 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "5", 2024-09-10T22:37:54.633 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "1", 2024-09-10T22:37:54.633 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "32", 2024-09-10T22:37:54.633 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.633 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2024-09-10T22:37:54.633 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.633 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.633 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.633 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.633 INFO:teuthology.orchestra.run.smithi019.stdout: "username": { 2024-09-10T22:37:54.633 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "username", 2024-09-10T22:37:54.633 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-10T22:37:54.633 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.633 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-10T22:37:54.634 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-10T22:37:54.634 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.634 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.634 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.634 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "username of InfluxDB server user", 2024-09-10T22:37:54.634 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.634 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.634 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.634 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.634 INFO:teuthology.orchestra.run.smithi019.stdout: "verify_ssl": { 2024-09-10T22:37:54.634 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "verify_ssl", 2024-09-10T22:37:54.634 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-10T22:37:54.634 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.634 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-10T22:37:54.635 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "true", 2024-09-10T22:37:54.635 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.635 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.635 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.635 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2024-09-10T22:37:54.635 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.635 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.635 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.635 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-10T22:37:54.635 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-10T22:37:54.635 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.635 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-10T22:37:54.635 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "insights", 2024-09-10T22:37:54.636 INFO:teuthology.orchestra.run.smithi019.stdout: "can_run": true, 2024-09-10T22:37:54.636 INFO:teuthology.orchestra.run.smithi019.stdout: "error_string": "", 2024-09-10T22:37:54.636 INFO:teuthology.orchestra.run.smithi019.stdout: "module_options": { 2024-09-10T22:37:54.636 INFO:teuthology.orchestra.run.smithi019.stdout: "log_level": { 2024-09-10T22:37:54.636 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_level", 2024-09-10T22:37:54.636 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-10T22:37:54.636 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.636 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:54.636 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-10T22:37:54.636 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.636 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.636 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-10T22:37:54.636 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-10T22:37:54.637 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-10T22:37:54.637 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-10T22:37:54.637 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-10T22:37:54.637 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-10T22:37:54.637 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-10T22:37:54.637 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-10T22:37:54.637 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:54.637 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.637 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.637 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.637 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.637 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster": { 2024-09-10T22:37:54.637 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster", 2024-09-10T22:37:54.638 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-10T22:37:54.638 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.638 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:54.638 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-10T22:37:54.638 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.638 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.638 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.638 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:54.638 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.638 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.638 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.638 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.638 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster_level": { 2024-09-10T22:37:54.639 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster_level", 2024-09-10T22:37:54.639 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-10T22:37:54.639 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.639 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:54.639 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "info", 2024-09-10T22:37:54.639 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.639 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.639 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-10T22:37:54.639 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-10T22:37:54.639 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-10T22:37:54.639 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-10T22:37:54.639 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-10T22:37:54.639 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-10T22:37:54.639 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-10T22:37:54.640 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-10T22:37:54.640 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:54.640 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.640 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.640 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.640 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.640 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_file": { 2024-09-10T22:37:54.640 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_file", 2024-09-10T22:37:54.640 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-10T22:37:54.640 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.640 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:54.640 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-10T22:37:54.640 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.641 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.641 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.641 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:54.641 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.641 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.641 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.641 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.641 INFO:teuthology.orchestra.run.smithi019.stdout: "sqlite3_killpoint": { 2024-09-10T22:37:54.641 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "sqlite3_killpoint", 2024-09-10T22:37:54.641 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "int", 2024-09-10T22:37:54.641 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "dev", 2024-09-10T22:37:54.641 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:54.641 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "0", 2024-09-10T22:37:54.641 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.642 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.642 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.642 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:54.642 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.642 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.642 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.642 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-10T22:37:54.642 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-10T22:37:54.642 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.642 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-10T22:37:54.642 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "iostat", 2024-09-10T22:37:54.642 INFO:teuthology.orchestra.run.smithi019.stdout: "can_run": true, 2024-09-10T22:37:54.643 INFO:teuthology.orchestra.run.smithi019.stdout: "error_string": "", 2024-09-10T22:37:54.643 INFO:teuthology.orchestra.run.smithi019.stdout: "module_options": { 2024-09-10T22:37:54.643 INFO:teuthology.orchestra.run.smithi019.stdout: "log_level": { 2024-09-10T22:37:54.643 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_level", 2024-09-10T22:37:54.643 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-10T22:37:54.643 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.643 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:54.643 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-10T22:37:54.643 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.643 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.643 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-10T22:37:54.643 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-10T22:37:54.643 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-10T22:37:54.644 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-10T22:37:54.644 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-10T22:37:54.644 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-10T22:37:54.644 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-10T22:37:54.644 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-10T22:37:54.644 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:54.644 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.644 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.644 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.644 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.644 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster": { 2024-09-10T22:37:54.644 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster", 2024-09-10T22:37:54.644 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-10T22:37:54.645 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.645 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:54.645 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-10T22:37:54.645 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.645 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.645 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.645 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:54.645 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.645 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.645 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.645 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.645 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster_level": { 2024-09-10T22:37:54.645 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster_level", 2024-09-10T22:37:54.646 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-10T22:37:54.646 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.646 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:54.646 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "info", 2024-09-10T22:37:54.646 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.646 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.646 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-10T22:37:54.646 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-10T22:37:54.646 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-10T22:37:54.646 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-10T22:37:54.646 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-10T22:37:54.646 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-10T22:37:54.646 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-10T22:37:54.646 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-10T22:37:54.647 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:54.647 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.647 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.647 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.647 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.647 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_file": { 2024-09-10T22:37:54.647 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_file", 2024-09-10T22:37:54.647 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-10T22:37:54.647 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.647 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:54.647 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-10T22:37:54.647 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.647 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.648 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.648 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:54.648 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.648 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.648 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.648 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.648 INFO:teuthology.orchestra.run.smithi019.stdout: "sqlite3_killpoint": { 2024-09-10T22:37:54.648 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "sqlite3_killpoint", 2024-09-10T22:37:54.648 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "int", 2024-09-10T22:37:54.648 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "dev", 2024-09-10T22:37:54.648 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:54.648 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "0", 2024-09-10T22:37:54.648 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.648 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.649 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.649 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:54.649 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.649 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.649 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.649 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-10T22:37:54.649 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-10T22:37:54.649 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.649 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-10T22:37:54.649 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "k8sevents", 2024-09-10T22:37:54.649 INFO:teuthology.orchestra.run.smithi019.stdout: "can_run": true, 2024-09-10T22:37:54.649 INFO:teuthology.orchestra.run.smithi019.stdout: "error_string": "", 2024-09-10T22:37:54.649 INFO:teuthology.orchestra.run.smithi019.stdout: "module_options": { 2024-09-10T22:37:54.650 INFO:teuthology.orchestra.run.smithi019.stdout: "ceph_event_retention_days": { 2024-09-10T22:37:54.650 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "ceph_event_retention_days", 2024-09-10T22:37:54.650 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "int", 2024-09-10T22:37:54.650 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.650 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-10T22:37:54.650 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "7", 2024-09-10T22:37:54.650 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.650 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.650 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.650 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "Days to hold ceph event information within local cache", 2024-09-10T22:37:54.650 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.650 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.651 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.651 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.651 INFO:teuthology.orchestra.run.smithi019.stdout: "config_check_secs": { 2024-09-10T22:37:54.651 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "config_check_secs", 2024-09-10T22:37:54.651 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "int", 2024-09-10T22:37:54.651 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.651 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-10T22:37:54.651 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "10", 2024-09-10T22:37:54.651 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "10", 2024-09-10T22:37:54.651 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.651 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.651 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2024-09-10T22:37:54.651 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.651 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.652 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.652 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.652 INFO:teuthology.orchestra.run.smithi019.stdout: "log_level": { 2024-09-10T22:37:54.652 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_level", 2024-09-10T22:37:54.652 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-10T22:37:54.652 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.652 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:54.652 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-10T22:37:54.652 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.652 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.652 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-10T22:37:54.652 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-10T22:37:54.652 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-10T22:37:54.653 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-10T22:37:54.653 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-10T22:37:54.653 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-10T22:37:54.653 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-10T22:37:54.653 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-10T22:37:54.653 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:54.653 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.653 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.653 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.653 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.653 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster": { 2024-09-10T22:37:54.653 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster", 2024-09-10T22:37:54.653 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-10T22:37:54.654 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.654 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:54.654 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-10T22:37:54.654 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.654 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.654 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.654 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:54.654 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.654 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.654 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.654 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.654 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster_level": { 2024-09-10T22:37:54.654 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster_level", 2024-09-10T22:37:54.655 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-10T22:37:54.655 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.655 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:54.655 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "info", 2024-09-10T22:37:54.655 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.655 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.655 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-10T22:37:54.655 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-10T22:37:54.655 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-10T22:37:54.655 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-10T22:37:54.655 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-10T22:37:54.655 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-10T22:37:54.655 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-10T22:37:54.656 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-10T22:37:54.656 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:54.656 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.656 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.656 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.656 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.656 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_file": { 2024-09-10T22:37:54.656 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_file", 2024-09-10T22:37:54.656 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-10T22:37:54.656 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.656 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:54.656 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-10T22:37:54.656 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.657 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.657 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.657 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:54.657 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.657 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.657 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.657 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.657 INFO:teuthology.orchestra.run.smithi019.stdout: "sqlite3_killpoint": { 2024-09-10T22:37:54.657 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "sqlite3_killpoint", 2024-09-10T22:37:54.657 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "int", 2024-09-10T22:37:54.657 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "dev", 2024-09-10T22:37:54.657 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:54.657 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "0", 2024-09-10T22:37:54.657 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.658 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.658 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.658 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:54.658 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.658 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.658 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.658 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-10T22:37:54.658 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-10T22:37:54.658 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.658 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-10T22:37:54.658 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "localpool", 2024-09-10T22:37:54.658 INFO:teuthology.orchestra.run.smithi019.stdout: "can_run": true, 2024-09-10T22:37:54.658 INFO:teuthology.orchestra.run.smithi019.stdout: "error_string": "", 2024-09-10T22:37:54.658 INFO:teuthology.orchestra.run.smithi019.stdout: "module_options": { 2024-09-10T22:37:54.659 INFO:teuthology.orchestra.run.smithi019.stdout: "failure_domain": { 2024-09-10T22:37:54.659 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "failure_domain", 2024-09-10T22:37:54.659 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-10T22:37:54.659 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.659 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:54.659 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "host", 2024-09-10T22:37:54.659 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.659 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.659 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.659 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "failure domain for any created local pool", 2024-09-10T22:37:54.659 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2024-09-10T22:37:54.659 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.659 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.659 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.660 INFO:teuthology.orchestra.run.smithi019.stdout: "log_level": { 2024-09-10T22:37:54.660 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_level", 2024-09-10T22:37:54.660 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-10T22:37:54.660 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.660 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:54.660 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-10T22:37:54.660 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.660 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.660 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-10T22:37:54.660 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-10T22:37:54.660 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-10T22:37:54.660 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-10T22:37:54.660 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-10T22:37:54.661 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-10T22:37:54.661 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-10T22:37:54.661 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-10T22:37:54.661 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:54.661 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.661 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.661 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.661 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.661 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster": { 2024-09-10T22:37:54.661 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster", 2024-09-10T22:37:54.661 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-10T22:37:54.661 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.661 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:54.661 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-10T22:37:54.662 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.662 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.662 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.662 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:54.662 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.662 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.662 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.662 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.662 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster_level": { 2024-09-10T22:37:54.662 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster_level", 2024-09-10T22:37:54.662 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-10T22:37:54.662 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.662 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:54.662 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "info", 2024-09-10T22:37:54.663 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.663 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.663 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-10T22:37:54.663 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-10T22:37:54.663 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-10T22:37:54.663 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-10T22:37:54.663 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-10T22:37:54.663 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-10T22:37:54.663 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-10T22:37:54.663 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-10T22:37:54.663 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:54.663 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.663 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.663 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.664 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.664 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_file": { 2024-09-10T22:37:54.664 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_file", 2024-09-10T22:37:54.664 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-10T22:37:54.664 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.664 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:54.664 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-10T22:37:54.664 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.664 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.664 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.664 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:54.664 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.664 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.664 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.665 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.665 INFO:teuthology.orchestra.run.smithi019.stdout: "min_size": { 2024-09-10T22:37:54.665 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "min_size", 2024-09-10T22:37:54.665 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "int", 2024-09-10T22:37:54.665 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.665 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:54.665 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-10T22:37:54.665 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.665 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.665 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.665 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "default min_size for any created local pool", 2024-09-10T22:37:54.665 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2024-09-10T22:37:54.665 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.665 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.665 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.666 INFO:teuthology.orchestra.run.smithi019.stdout: "num_rep": { 2024-09-10T22:37:54.666 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "num_rep", 2024-09-10T22:37:54.666 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "int", 2024-09-10T22:37:54.666 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.666 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:54.666 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "3", 2024-09-10T22:37:54.666 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.666 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.666 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.666 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "default replica count for any created local pool", 2024-09-10T22:37:54.666 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.666 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.667 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.667 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.667 INFO:teuthology.orchestra.run.smithi019.stdout: "pg_num": { 2024-09-10T22:37:54.667 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "pg_num", 2024-09-10T22:37:54.667 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "int", 2024-09-10T22:37:54.667 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.667 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:54.667 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "128", 2024-09-10T22:37:54.667 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.667 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.667 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.667 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "default pg_num for any created local pool", 2024-09-10T22:37:54.667 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.668 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.668 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.668 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.668 INFO:teuthology.orchestra.run.smithi019.stdout: "prefix": { 2024-09-10T22:37:54.668 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "prefix", 2024-09-10T22:37:54.668 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-10T22:37:54.668 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.668 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:54.668 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-10T22:37:54.668 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.668 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.668 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.668 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "name prefix for any created local pool", 2024-09-10T22:37:54.668 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.669 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.669 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.669 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.669 INFO:teuthology.orchestra.run.smithi019.stdout: "sqlite3_killpoint": { 2024-09-10T22:37:54.669 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "sqlite3_killpoint", 2024-09-10T22:37:54.669 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "int", 2024-09-10T22:37:54.669 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "dev", 2024-09-10T22:37:54.669 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:54.669 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "0", 2024-09-10T22:37:54.669 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.669 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.669 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.669 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:54.670 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.670 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.670 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.670 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.670 INFO:teuthology.orchestra.run.smithi019.stdout: "subtree": { 2024-09-10T22:37:54.670 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "subtree", 2024-09-10T22:37:54.670 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-10T22:37:54.670 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.670 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:54.670 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "rack", 2024-09-10T22:37:54.670 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.670 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.670 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.671 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "CRUSH level for which to create a local pool", 2024-09-10T22:37:54.671 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2024-09-10T22:37:54.671 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.671 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.671 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-10T22:37:54.671 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-10T22:37:54.671 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.671 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-10T22:37:54.671 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "mds_autoscaler", 2024-09-10T22:37:54.671 INFO:teuthology.orchestra.run.smithi019.stdout: "can_run": true, 2024-09-10T22:37:54.671 INFO:teuthology.orchestra.run.smithi019.stdout: "error_string": "", 2024-09-10T22:37:54.671 INFO:teuthology.orchestra.run.smithi019.stdout: "module_options": { 2024-09-10T22:37:54.671 INFO:teuthology.orchestra.run.smithi019.stdout: "log_level": { 2024-09-10T22:37:54.672 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_level", 2024-09-10T22:37:54.672 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-10T22:37:54.672 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.672 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:54.672 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-10T22:37:54.672 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.672 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.672 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-10T22:37:54.672 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-10T22:37:54.672 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-10T22:37:54.672 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-10T22:37:54.672 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-10T22:37:54.672 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-10T22:37:54.673 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-10T22:37:54.673 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-10T22:37:54.673 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:54.673 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.673 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.673 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.673 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.673 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster": { 2024-09-10T22:37:54.673 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster", 2024-09-10T22:37:54.673 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-10T22:37:54.673 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.673 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:54.673 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-10T22:37:54.674 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.674 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.674 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.674 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:54.674 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.674 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.674 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.674 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.674 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster_level": { 2024-09-10T22:37:54.674 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster_level", 2024-09-10T22:37:54.674 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-10T22:37:54.674 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.674 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:54.675 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "info", 2024-09-10T22:37:54.675 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.675 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.675 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-10T22:37:54.675 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-10T22:37:54.675 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-10T22:37:54.675 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-10T22:37:54.675 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-10T22:37:54.675 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-10T22:37:54.675 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-10T22:37:54.675 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-10T22:37:54.675 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:54.675 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.676 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.676 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.676 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.676 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_file": { 2024-09-10T22:37:54.676 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_file", 2024-09-10T22:37:54.676 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-10T22:37:54.676 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.676 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:54.676 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-10T22:37:54.676 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.676 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.676 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.676 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:54.676 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.677 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.677 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.677 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.677 INFO:teuthology.orchestra.run.smithi019.stdout: "sqlite3_killpoint": { 2024-09-10T22:37:54.677 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "sqlite3_killpoint", 2024-09-10T22:37:54.677 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "int", 2024-09-10T22:37:54.677 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "dev", 2024-09-10T22:37:54.677 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:54.677 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "0", 2024-09-10T22:37:54.677 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.677 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.677 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.677 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:54.678 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.678 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.678 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.678 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-10T22:37:54.678 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-10T22:37:54.678 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.678 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-10T22:37:54.678 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "mirroring", 2024-09-10T22:37:54.678 INFO:teuthology.orchestra.run.smithi019.stdout: "can_run": true, 2024-09-10T22:37:54.678 INFO:teuthology.orchestra.run.smithi019.stdout: "error_string": "", 2024-09-10T22:37:54.678 INFO:teuthology.orchestra.run.smithi019.stdout: "module_options": { 2024-09-10T22:37:54.678 INFO:teuthology.orchestra.run.smithi019.stdout: "log_level": { 2024-09-10T22:37:54.678 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_level", 2024-09-10T22:37:54.678 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-10T22:37:54.678 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.679 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:54.679 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-10T22:37:54.679 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.679 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.679 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-10T22:37:54.679 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-10T22:37:54.679 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-10T22:37:54.679 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-10T22:37:54.679 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-10T22:37:54.679 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-10T22:37:54.679 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-10T22:37:54.679 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-10T22:37:54.679 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:54.680 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.680 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.680 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.680 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.680 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster": { 2024-09-10T22:37:54.680 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster", 2024-09-10T22:37:54.680 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-10T22:37:54.680 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.680 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:54.680 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-10T22:37:54.680 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.680 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.681 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.681 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:54.681 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.681 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.681 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.681 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.681 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster_level": { 2024-09-10T22:37:54.681 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster_level", 2024-09-10T22:37:54.681 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-10T22:37:54.681 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.681 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:54.681 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "info", 2024-09-10T22:37:54.682 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.682 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.682 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-10T22:37:54.682 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-10T22:37:54.682 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-10T22:37:54.682 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-10T22:37:54.682 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-10T22:37:54.682 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-10T22:37:54.682 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-10T22:37:54.682 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-10T22:37:54.682 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:54.682 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.682 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.682 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.683 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.683 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_file": { 2024-09-10T22:37:54.683 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_file", 2024-09-10T22:37:54.683 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-10T22:37:54.683 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.683 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:54.683 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-10T22:37:54.683 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.683 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.683 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.683 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:54.683 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.683 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.684 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.684 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.684 INFO:teuthology.orchestra.run.smithi019.stdout: "sqlite3_killpoint": { 2024-09-10T22:37:54.684 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "sqlite3_killpoint", 2024-09-10T22:37:54.684 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "int", 2024-09-10T22:37:54.684 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "dev", 2024-09-10T22:37:54.684 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:54.684 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "0", 2024-09-10T22:37:54.684 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.684 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.684 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.684 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:54.684 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.685 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.685 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.685 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-10T22:37:54.685 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-10T22:37:54.685 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.685 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-10T22:37:54.685 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "nfs", 2024-09-10T22:37:54.685 INFO:teuthology.orchestra.run.smithi019.stdout: "can_run": true, 2024-09-10T22:37:54.685 INFO:teuthology.orchestra.run.smithi019.stdout: "error_string": "", 2024-09-10T22:37:54.685 INFO:teuthology.orchestra.run.smithi019.stdout: "module_options": { 2024-09-10T22:37:54.685 INFO:teuthology.orchestra.run.smithi019.stdout: "log_level": { 2024-09-10T22:37:54.685 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_level", 2024-09-10T22:37:54.685 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-10T22:37:54.686 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.686 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:54.686 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-10T22:37:54.686 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.686 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.686 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-10T22:37:54.686 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-10T22:37:54.686 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-10T22:37:54.686 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-10T22:37:54.686 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-10T22:37:54.686 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-10T22:37:54.686 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-10T22:37:54.686 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-10T22:37:54.686 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:54.687 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.687 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.687 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.687 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.687 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster": { 2024-09-10T22:37:54.687 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster", 2024-09-10T22:37:54.687 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-10T22:37:54.687 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.687 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:54.687 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-10T22:37:54.687 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.687 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.688 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.688 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:54.688 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.688 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.688 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.688 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.688 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster_level": { 2024-09-10T22:37:54.688 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster_level", 2024-09-10T22:37:54.688 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-10T22:37:54.688 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.688 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:54.688 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "info", 2024-09-10T22:37:54.688 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.688 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.689 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-10T22:37:54.689 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-10T22:37:54.689 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-10T22:37:54.689 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-10T22:37:54.689 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-10T22:37:54.689 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-10T22:37:54.689 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-10T22:37:54.689 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-10T22:37:54.689 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:54.689 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.689 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.689 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.689 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.690 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_file": { 2024-09-10T22:37:54.690 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_file", 2024-09-10T22:37:54.690 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-10T22:37:54.690 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.690 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:54.690 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-10T22:37:54.690 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.690 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.690 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.690 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:54.690 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.690 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.690 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.691 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.691 INFO:teuthology.orchestra.run.smithi019.stdout: "sqlite3_killpoint": { 2024-09-10T22:37:54.691 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "sqlite3_killpoint", 2024-09-10T22:37:54.691 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "int", 2024-09-10T22:37:54.691 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "dev", 2024-09-10T22:37:54.691 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:54.691 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "0", 2024-09-10T22:37:54.691 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.691 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.691 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.691 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:54.691 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.691 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.691 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.692 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-10T22:37:54.692 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-10T22:37:54.692 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.692 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-10T22:37:54.692 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "orchestrator", 2024-09-10T22:37:54.692 INFO:teuthology.orchestra.run.smithi019.stdout: "can_run": true, 2024-09-10T22:37:54.692 INFO:teuthology.orchestra.run.smithi019.stdout: "error_string": "", 2024-09-10T22:37:54.692 INFO:teuthology.orchestra.run.smithi019.stdout: "module_options": { 2024-09-10T22:37:54.692 INFO:teuthology.orchestra.run.smithi019.stdout: "fail_fs": { 2024-09-10T22:37:54.692 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "fail_fs", 2024-09-10T22:37:54.692 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-10T22:37:54.692 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.692 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-10T22:37:54.693 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-10T22:37:54.693 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.693 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.693 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.693 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2024-09-10T22:37:54.693 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.693 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.693 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.693 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.693 INFO:teuthology.orchestra.run.smithi019.stdout: "log_level": { 2024-09-10T22:37:54.693 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_level", 2024-09-10T22:37:54.693 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-10T22:37:54.693 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.694 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:54.694 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-10T22:37:54.694 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.694 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.694 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-10T22:37:54.694 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-10T22:37:54.694 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-10T22:37:54.694 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-10T22:37:54.694 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-10T22:37:54.694 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-10T22:37:54.694 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-10T22:37:54.694 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-10T22:37:54.694 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:54.694 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.695 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.695 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.695 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.695 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster": { 2024-09-10T22:37:54.695 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster", 2024-09-10T22:37:54.695 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-10T22:37:54.695 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.695 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:54.695 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-10T22:37:54.695 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.695 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.695 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.696 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:54.696 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.696 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.696 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.696 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.696 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster_level": { 2024-09-10T22:37:54.696 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster_level", 2024-09-10T22:37:54.696 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-10T22:37:54.696 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.696 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:54.696 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "info", 2024-09-10T22:37:54.696 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.696 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.696 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-10T22:37:54.697 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-10T22:37:54.697 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-10T22:37:54.697 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-10T22:37:54.697 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-10T22:37:54.697 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-10T22:37:54.697 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-10T22:37:54.697 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-10T22:37:54.697 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:54.697 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.697 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.697 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.697 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.697 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_file": { 2024-09-10T22:37:54.698 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_file", 2024-09-10T22:37:54.698 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-10T22:37:54.698 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.698 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:54.698 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-10T22:37:54.698 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.698 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.698 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.698 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:54.698 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.698 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.698 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.698 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.699 INFO:teuthology.orchestra.run.smithi019.stdout: "orchestrator": { 2024-09-10T22:37:54.699 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "orchestrator", 2024-09-10T22:37:54.699 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-10T22:37:54.699 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.699 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:54.699 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-10T22:37:54.699 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.699 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.699 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-10T22:37:54.699 INFO:teuthology.orchestra.run.smithi019.stdout: "cephadm", 2024-09-10T22:37:54.699 INFO:teuthology.orchestra.run.smithi019.stdout: "rook", 2024-09-10T22:37:54.699 INFO:teuthology.orchestra.run.smithi019.stdout: "test_orchestrator" 2024-09-10T22:37:54.699 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-10T22:37:54.700 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "Orchestrator backend", 2024-09-10T22:37:54.700 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.700 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.700 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.700 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.700 INFO:teuthology.orchestra.run.smithi019.stdout: "sqlite3_killpoint": { 2024-09-10T22:37:54.700 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "sqlite3_killpoint", 2024-09-10T22:37:54.700 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "int", 2024-09-10T22:37:54.700 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "dev", 2024-09-10T22:37:54.700 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:54.700 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "0", 2024-09-10T22:37:54.701 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.701 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.701 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.701 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:54.701 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.701 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.701 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.701 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-10T22:37:54.701 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-10T22:37:54.701 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.701 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-10T22:37:54.701 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "osd_perf_query", 2024-09-10T22:37:54.701 INFO:teuthology.orchestra.run.smithi019.stdout: "can_run": true, 2024-09-10T22:37:54.701 INFO:teuthology.orchestra.run.smithi019.stdout: "error_string": "", 2024-09-10T22:37:54.702 INFO:teuthology.orchestra.run.smithi019.stdout: "module_options": { 2024-09-10T22:37:54.702 INFO:teuthology.orchestra.run.smithi019.stdout: "log_level": { 2024-09-10T22:37:54.702 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_level", 2024-09-10T22:37:54.702 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-10T22:37:54.702 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.702 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:54.702 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-10T22:37:54.702 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.702 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.702 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-10T22:37:54.702 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-10T22:37:54.702 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-10T22:37:54.702 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-10T22:37:54.703 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-10T22:37:54.703 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-10T22:37:54.703 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-10T22:37:54.703 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-10T22:37:54.703 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:54.703 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.703 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.703 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.703 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.703 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster": { 2024-09-10T22:37:54.703 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster", 2024-09-10T22:37:54.703 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-10T22:37:54.703 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.704 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:54.704 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-10T22:37:54.704 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.704 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.704 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.704 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:54.704 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.704 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.704 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.704 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.704 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster_level": { 2024-09-10T22:37:54.704 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster_level", 2024-09-10T22:37:54.704 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-10T22:37:54.705 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.705 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:54.705 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "info", 2024-09-10T22:37:54.705 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.705 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.705 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-10T22:37:54.705 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-10T22:37:54.705 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-10T22:37:54.705 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-10T22:37:54.705 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-10T22:37:54.705 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-10T22:37:54.705 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-10T22:37:54.705 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-10T22:37:54.706 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:54.706 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.706 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.706 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.706 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.706 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_file": { 2024-09-10T22:37:54.706 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_file", 2024-09-10T22:37:54.706 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-10T22:37:54.706 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.706 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:54.706 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-10T22:37:54.706 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.706 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.706 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.707 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:54.707 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.707 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.707 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.707 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.707 INFO:teuthology.orchestra.run.smithi019.stdout: "sqlite3_killpoint": { 2024-09-10T22:37:54.707 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "sqlite3_killpoint", 2024-09-10T22:37:54.707 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "int", 2024-09-10T22:37:54.707 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "dev", 2024-09-10T22:37:54.707 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:54.707 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "0", 2024-09-10T22:37:54.707 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.707 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.707 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.708 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:54.708 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.708 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.708 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.708 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-10T22:37:54.708 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-10T22:37:54.708 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.708 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-10T22:37:54.708 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "osd_support", 2024-09-10T22:37:54.708 INFO:teuthology.orchestra.run.smithi019.stdout: "can_run": true, 2024-09-10T22:37:54.708 INFO:teuthology.orchestra.run.smithi019.stdout: "error_string": "", 2024-09-10T22:37:54.708 INFO:teuthology.orchestra.run.smithi019.stdout: "module_options": { 2024-09-10T22:37:54.708 INFO:teuthology.orchestra.run.smithi019.stdout: "log_level": { 2024-09-10T22:37:54.709 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_level", 2024-09-10T22:37:54.709 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-10T22:37:54.709 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.709 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:54.709 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-10T22:37:54.709 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.709 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.709 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-10T22:37:54.709 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-10T22:37:54.709 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-10T22:37:54.709 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-10T22:37:54.709 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-10T22:37:54.709 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-10T22:37:54.709 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-10T22:37:54.710 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-10T22:37:54.710 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:54.710 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.710 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.710 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.710 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.710 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster": { 2024-09-10T22:37:54.710 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster", 2024-09-10T22:37:54.710 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-10T22:37:54.710 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.710 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:54.710 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-10T22:37:54.710 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.710 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.711 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.711 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:54.711 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.711 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.711 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.711 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.711 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster_level": { 2024-09-10T22:37:54.711 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster_level", 2024-09-10T22:37:54.711 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-10T22:37:54.711 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.711 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:54.711 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "info", 2024-09-10T22:37:54.711 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.711 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.712 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-10T22:37:54.712 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-10T22:37:54.712 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-10T22:37:54.712 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-10T22:37:54.712 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-10T22:37:54.712 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-10T22:37:54.712 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-10T22:37:54.712 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-10T22:37:54.712 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:54.712 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.712 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.712 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.712 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.712 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_file": { 2024-09-10T22:37:54.713 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_file", 2024-09-10T22:37:54.713 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-10T22:37:54.713 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.713 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:54.713 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-10T22:37:54.713 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.713 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.713 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.713 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:54.713 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.713 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.713 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.713 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.713 INFO:teuthology.orchestra.run.smithi019.stdout: "sqlite3_killpoint": { 2024-09-10T22:37:54.714 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "sqlite3_killpoint", 2024-09-10T22:37:54.714 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "int", 2024-09-10T22:37:54.714 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "dev", 2024-09-10T22:37:54.714 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:54.714 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "0", 2024-09-10T22:37:54.714 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.714 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.714 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.714 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:54.714 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.714 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.714 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.715 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-10T22:37:54.715 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-10T22:37:54.715 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.715 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-10T22:37:54.715 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "pg_autoscaler", 2024-09-10T22:37:54.715 INFO:teuthology.orchestra.run.smithi019.stdout: "can_run": true, 2024-09-10T22:37:54.715 INFO:teuthology.orchestra.run.smithi019.stdout: "error_string": "", 2024-09-10T22:37:54.715 INFO:teuthology.orchestra.run.smithi019.stdout: "module_options": { 2024-09-10T22:37:54.715 INFO:teuthology.orchestra.run.smithi019.stdout: "log_level": { 2024-09-10T22:37:54.715 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_level", 2024-09-10T22:37:54.715 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-10T22:37:54.715 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.715 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:54.715 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-10T22:37:54.716 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.716 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.716 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-10T22:37:54.716 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-10T22:37:54.716 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-10T22:37:54.716 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-10T22:37:54.716 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-10T22:37:54.716 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-10T22:37:54.716 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-10T22:37:54.716 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-10T22:37:54.716 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:54.716 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.716 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.717 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.717 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.717 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster": { 2024-09-10T22:37:54.717 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster", 2024-09-10T22:37:54.717 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-10T22:37:54.717 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.717 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:54.717 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-10T22:37:54.717 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.717 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.717 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.717 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:54.717 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.718 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.718 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.718 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.718 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster_level": { 2024-09-10T22:37:54.718 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster_level", 2024-09-10T22:37:54.718 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-10T22:37:54.718 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.718 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:54.718 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "info", 2024-09-10T22:37:54.718 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.718 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.718 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-10T22:37:54.718 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-10T22:37:54.718 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-10T22:37:54.719 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-10T22:37:54.719 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-10T22:37:54.719 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-10T22:37:54.719 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-10T22:37:54.719 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-10T22:37:54.719 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:54.719 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.719 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.719 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.719 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.719 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_file": { 2024-09-10T22:37:54.719 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_file", 2024-09-10T22:37:54.719 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-10T22:37:54.719 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.720 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:54.720 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-10T22:37:54.720 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.720 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.720 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.720 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:54.720 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.720 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.720 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.720 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.720 INFO:teuthology.orchestra.run.smithi019.stdout: "sleep_interval": { 2024-09-10T22:37:54.720 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "sleep_interval", 2024-09-10T22:37:54.720 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "secs", 2024-09-10T22:37:54.721 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.721 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-10T22:37:54.721 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "60", 2024-09-10T22:37:54.721 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.721 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.721 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.721 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:54.721 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.721 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.721 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.721 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.721 INFO:teuthology.orchestra.run.smithi019.stdout: "sqlite3_killpoint": { 2024-09-10T22:37:54.721 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "sqlite3_killpoint", 2024-09-10T22:37:54.722 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "int", 2024-09-10T22:37:54.722 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "dev", 2024-09-10T22:37:54.722 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:54.722 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "0", 2024-09-10T22:37:54.722 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.722 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.722 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.722 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:54.722 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.722 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.722 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.722 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.722 INFO:teuthology.orchestra.run.smithi019.stdout: "threshold": { 2024-09-10T22:37:54.723 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "threshold", 2024-09-10T22:37:54.723 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "float", 2024-09-10T22:37:54.723 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.723 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-10T22:37:54.723 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "3.0", 2024-09-10T22:37:54.723 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "1.0", 2024-09-10T22:37:54.723 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.723 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.723 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "scaling threshold", 2024-09-10T22:37:54.723 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2024-09-10T22:37:54.723 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.723 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.723 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-10T22:37:54.724 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-10T22:37:54.724 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.724 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-10T22:37:54.724 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "progress", 2024-09-10T22:37:54.724 INFO:teuthology.orchestra.run.smithi019.stdout: "can_run": true, 2024-09-10T22:37:54.724 INFO:teuthology.orchestra.run.smithi019.stdout: "error_string": "", 2024-09-10T22:37:54.724 INFO:teuthology.orchestra.run.smithi019.stdout: "module_options": { 2024-09-10T22:37:54.724 INFO:teuthology.orchestra.run.smithi019.stdout: "allow_pg_recovery_event": { 2024-09-10T22:37:54.724 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "allow_pg_recovery_event", 2024-09-10T22:37:54.724 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-10T22:37:54.724 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.724 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:54.724 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-10T22:37:54.724 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.725 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.725 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.725 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "allow the module to show pg recovery progress", 2024-09-10T22:37:54.725 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.725 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.725 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.725 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.725 INFO:teuthology.orchestra.run.smithi019.stdout: "enabled": { 2024-09-10T22:37:54.725 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "enabled", 2024-09-10T22:37:54.725 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-10T22:37:54.725 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.725 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-10T22:37:54.725 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "True", 2024-09-10T22:37:54.726 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.726 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.726 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.726 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:54.726 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.726 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.726 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.726 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.726 INFO:teuthology.orchestra.run.smithi019.stdout: "log_level": { 2024-09-10T22:37:54.726 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_level", 2024-09-10T22:37:54.726 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-10T22:37:54.726 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.727 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:54.727 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-10T22:37:54.727 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.727 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.727 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-10T22:37:54.727 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-10T22:37:54.727 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-10T22:37:54.727 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-10T22:37:54.727 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-10T22:37:54.727 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-10T22:37:54.727 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-10T22:37:54.727 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-10T22:37:54.727 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:54.728 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.728 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.728 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.728 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.728 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster": { 2024-09-10T22:37:54.728 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster", 2024-09-10T22:37:54.728 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-10T22:37:54.728 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.728 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:54.728 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-10T22:37:54.728 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.728 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.729 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.729 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:54.729 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.729 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.729 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.729 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.729 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster_level": { 2024-09-10T22:37:54.729 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster_level", 2024-09-10T22:37:54.729 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-10T22:37:54.729 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.729 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:54.729 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "info", 2024-09-10T22:37:54.729 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.730 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.730 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-10T22:37:54.730 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-10T22:37:54.730 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-10T22:37:54.730 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-10T22:37:54.730 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-10T22:37:54.730 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-10T22:37:54.730 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-10T22:37:54.730 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-10T22:37:54.730 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:54.730 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.730 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.730 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.731 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.731 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_file": { 2024-09-10T22:37:54.731 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_file", 2024-09-10T22:37:54.731 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-10T22:37:54.731 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.731 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:54.731 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-10T22:37:54.731 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.731 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.731 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.731 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:54.731 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.731 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.732 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.732 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.732 INFO:teuthology.orchestra.run.smithi019.stdout: "max_completed_events": { 2024-09-10T22:37:54.732 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "max_completed_events", 2024-09-10T22:37:54.732 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "int", 2024-09-10T22:37:54.732 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.732 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:54.732 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "50", 2024-09-10T22:37:54.732 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.732 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.732 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.732 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "number of past completed events to remember", 2024-09-10T22:37:54.733 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.733 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.733 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.733 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.733 INFO:teuthology.orchestra.run.smithi019.stdout: "sleep_interval": { 2024-09-10T22:37:54.733 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "sleep_interval", 2024-09-10T22:37:54.733 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "secs", 2024-09-10T22:37:54.733 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.733 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:54.733 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "5", 2024-09-10T22:37:54.733 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.733 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.733 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.734 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "how long the module is going to sleep", 2024-09-10T22:37:54.734 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.734 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.734 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.734 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.734 INFO:teuthology.orchestra.run.smithi019.stdout: "sqlite3_killpoint": { 2024-09-10T22:37:54.734 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "sqlite3_killpoint", 2024-09-10T22:37:54.734 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "int", 2024-09-10T22:37:54.734 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "dev", 2024-09-10T22:37:54.734 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:54.734 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "0", 2024-09-10T22:37:54.734 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.734 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.735 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.735 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:54.735 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.735 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.735 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.735 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-10T22:37:54.735 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-10T22:37:54.735 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.735 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-10T22:37:54.735 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "prometheus", 2024-09-10T22:37:54.735 INFO:teuthology.orchestra.run.smithi019.stdout: "can_run": true, 2024-09-10T22:37:54.735 INFO:teuthology.orchestra.run.smithi019.stdout: "error_string": "", 2024-09-10T22:37:54.735 INFO:teuthology.orchestra.run.smithi019.stdout: "module_options": { 2024-09-10T22:37:54.735 INFO:teuthology.orchestra.run.smithi019.stdout: "cache": { 2024-09-10T22:37:54.736 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "cache", 2024-09-10T22:37:54.736 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-10T22:37:54.736 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.736 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-10T22:37:54.736 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "True", 2024-09-10T22:37:54.736 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.736 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.736 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.736 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:54.736 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.736 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.736 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.736 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.737 INFO:teuthology.orchestra.run.smithi019.stdout: "exclude_perf_counters": { 2024-09-10T22:37:54.737 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "exclude_perf_counters", 2024-09-10T22:37:54.737 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-10T22:37:54.737 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.737 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:54.737 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "True", 2024-09-10T22:37:54.737 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.737 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.737 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.737 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "Do not include perf-counters in the metrics output", 2024-09-10T22:37:54.737 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2024-09-10T22:37:54.737 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.737 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.737 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.738 INFO:teuthology.orchestra.run.smithi019.stdout: "log_level": { 2024-09-10T22:37:54.738 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_level", 2024-09-10T22:37:54.738 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-10T22:37:54.738 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.738 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:54.738 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-10T22:37:54.738 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.738 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.738 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-10T22:37:54.738 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-10T22:37:54.738 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-10T22:37:54.738 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-10T22:37:54.739 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-10T22:37:54.739 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-10T22:37:54.739 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-10T22:37:54.739 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-10T22:37:54.739 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:54.739 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.739 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.739 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.739 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.739 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster": { 2024-09-10T22:37:54.739 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster", 2024-09-10T22:37:54.739 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-10T22:37:54.739 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.739 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:54.740 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-10T22:37:54.740 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.740 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.740 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.740 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:54.740 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.740 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.740 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.740 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.740 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster_level": { 2024-09-10T22:37:54.740 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster_level", 2024-09-10T22:37:54.740 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-10T22:37:54.740 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.740 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:54.741 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "info", 2024-09-10T22:37:54.741 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.741 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.741 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-10T22:37:54.741 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-10T22:37:54.741 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-10T22:37:54.741 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-10T22:37:54.741 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-10T22:37:54.741 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-10T22:37:54.741 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-10T22:37:54.741 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-10T22:37:54.741 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:54.741 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.741 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.742 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.742 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.742 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_file": { 2024-09-10T22:37:54.742 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_file", 2024-09-10T22:37:54.742 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-10T22:37:54.742 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.742 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:54.742 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-10T22:37:54.742 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.742 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.742 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.742 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:54.742 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.743 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.743 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.743 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.743 INFO:teuthology.orchestra.run.smithi019.stdout: "rbd_stats_pools": { 2024-09-10T22:37:54.743 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "rbd_stats_pools", 2024-09-10T22:37:54.743 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-10T22:37:54.743 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.743 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-10T22:37:54.743 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-10T22:37:54.743 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.743 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.743 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.743 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:54.744 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.744 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.744 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.744 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.744 INFO:teuthology.orchestra.run.smithi019.stdout: "rbd_stats_pools_refresh_interval": { 2024-09-10T22:37:54.744 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "rbd_stats_pools_refresh_interval", 2024-09-10T22:37:54.744 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "int", 2024-09-10T22:37:54.744 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.744 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-10T22:37:54.744 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "300", 2024-09-10T22:37:54.744 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.744 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.744 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.745 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:54.745 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.745 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.745 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.745 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.745 INFO:teuthology.orchestra.run.smithi019.stdout: "scrape_interval": { 2024-09-10T22:37:54.745 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "scrape_interval", 2024-09-10T22:37:54.745 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "float", 2024-09-10T22:37:54.745 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.745 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-10T22:37:54.745 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "15.0", 2024-09-10T22:37:54.745 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.745 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.746 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.746 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:54.746 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.746 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.746 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.746 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.746 INFO:teuthology.orchestra.run.smithi019.stdout: "server_addr": { 2024-09-10T22:37:54.746 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "server_addr", 2024-09-10T22:37:54.746 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-10T22:37:54.746 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.746 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-10T22:37:54.746 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "::", 2024-09-10T22:37:54.746 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.747 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.747 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.747 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2024-09-10T22:37:54.747 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.747 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.747 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.747 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.747 INFO:teuthology.orchestra.run.smithi019.stdout: "server_port": { 2024-09-10T22:37:54.747 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "server_port", 2024-09-10T22:37:54.747 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "int", 2024-09-10T22:37:54.747 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.747 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:54.747 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "9283", 2024-09-10T22:37:54.748 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.748 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.748 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.748 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "the port on which the module listens for HTTP requests", 2024-09-10T22:37:54.748 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.748 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.748 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.748 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.748 INFO:teuthology.orchestra.run.smithi019.stdout: "sqlite3_killpoint": { 2024-09-10T22:37:54.748 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "sqlite3_killpoint", 2024-09-10T22:37:54.748 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "int", 2024-09-10T22:37:54.748 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "dev", 2024-09-10T22:37:54.748 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:54.748 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "0", 2024-09-10T22:37:54.749 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.749 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.749 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.749 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:54.749 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.749 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.749 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.749 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.749 INFO:teuthology.orchestra.run.smithi019.stdout: "stale_cache_strategy": { 2024-09-10T22:37:54.749 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "stale_cache_strategy", 2024-09-10T22:37:54.749 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-10T22:37:54.749 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.749 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-10T22:37:54.750 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "log", 2024-09-10T22:37:54.750 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.750 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.750 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.750 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:54.750 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.750 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.750 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.750 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.750 INFO:teuthology.orchestra.run.smithi019.stdout: "standby_behaviour": { 2024-09-10T22:37:54.750 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "standby_behaviour", 2024-09-10T22:37:54.750 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-10T22:37:54.750 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.751 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:54.751 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "default", 2024-09-10T22:37:54.751 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.751 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.751 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-10T22:37:54.751 INFO:teuthology.orchestra.run.smithi019.stdout: "default", 2024-09-10T22:37:54.751 INFO:teuthology.orchestra.run.smithi019.stdout: "error" 2024-09-10T22:37:54.751 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-10T22:37:54.751 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:54.751 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.751 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.751 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.751 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.751 INFO:teuthology.orchestra.run.smithi019.stdout: "standby_error_status_code": { 2024-09-10T22:37:54.752 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "standby_error_status_code", 2024-09-10T22:37:54.752 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "int", 2024-09-10T22:37:54.752 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.752 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:54.752 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "500", 2024-09-10T22:37:54.752 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "400", 2024-09-10T22:37:54.752 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "599", 2024-09-10T22:37:54.752 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.752 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:54.752 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.752 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.752 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.752 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-10T22:37:54.753 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-10T22:37:54.753 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.753 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-10T22:37:54.753 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "rbd_support", 2024-09-10T22:37:54.753 INFO:teuthology.orchestra.run.smithi019.stdout: "can_run": true, 2024-09-10T22:37:54.753 INFO:teuthology.orchestra.run.smithi019.stdout: "error_string": "", 2024-09-10T22:37:54.753 INFO:teuthology.orchestra.run.smithi019.stdout: "module_options": { 2024-09-10T22:37:54.753 INFO:teuthology.orchestra.run.smithi019.stdout: "log_level": { 2024-09-10T22:37:54.753 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_level", 2024-09-10T22:37:54.753 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-10T22:37:54.753 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.753 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:54.754 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-10T22:37:54.754 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.754 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.754 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-10T22:37:54.754 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-10T22:37:54.754 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-10T22:37:54.754 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-10T22:37:54.754 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-10T22:37:54.754 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-10T22:37:54.754 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-10T22:37:54.754 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-10T22:37:54.754 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:54.754 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.755 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.755 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.755 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.755 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster": { 2024-09-10T22:37:54.755 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster", 2024-09-10T22:37:54.755 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-10T22:37:54.755 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.755 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:54.755 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-10T22:37:54.755 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.755 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.755 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.755 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:54.756 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.756 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.756 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.756 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.756 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster_level": { 2024-09-10T22:37:54.756 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster_level", 2024-09-10T22:37:54.756 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-10T22:37:54.756 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.756 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:54.756 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "info", 2024-09-10T22:37:54.756 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.756 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.756 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-10T22:37:54.757 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-10T22:37:54.757 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-10T22:37:54.757 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-10T22:37:54.757 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-10T22:37:54.757 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-10T22:37:54.757 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-10T22:37:54.757 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-10T22:37:54.757 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:54.757 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.757 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.757 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.757 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.757 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_file": { 2024-09-10T22:37:54.758 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_file", 2024-09-10T22:37:54.758 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-10T22:37:54.758 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.758 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:54.758 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-10T22:37:54.758 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.758 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.758 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.758 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:54.758 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.758 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.758 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.758 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.758 INFO:teuthology.orchestra.run.smithi019.stdout: "max_concurrent_snap_create": { 2024-09-10T22:37:54.759 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "max_concurrent_snap_create", 2024-09-10T22:37:54.759 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "int", 2024-09-10T22:37:54.759 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.759 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-10T22:37:54.759 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "10", 2024-09-10T22:37:54.759 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.759 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.759 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.759 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:54.759 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.759 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.759 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.759 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.760 INFO:teuthology.orchestra.run.smithi019.stdout: "mirror_snapshot_schedule": { 2024-09-10T22:37:54.760 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "mirror_snapshot_schedule", 2024-09-10T22:37:54.760 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-10T22:37:54.760 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.760 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-10T22:37:54.760 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-10T22:37:54.760 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.760 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.760 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.760 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:54.760 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.760 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.761 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.761 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.761 INFO:teuthology.orchestra.run.smithi019.stdout: "sqlite3_killpoint": { 2024-09-10T22:37:54.764 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "sqlite3_killpoint", 2024-09-10T22:37:54.764 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "int", 2024-09-10T22:37:54.764 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "dev", 2024-09-10T22:37:54.764 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:54.764 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "0", 2024-09-10T22:37:54.764 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.764 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.764 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.764 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:54.764 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.764 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.765 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.765 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.765 INFO:teuthology.orchestra.run.smithi019.stdout: "trash_purge_schedule": { 2024-09-10T22:37:54.765 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "trash_purge_schedule", 2024-09-10T22:37:54.765 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-10T22:37:54.765 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.765 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-10T22:37:54.765 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-10T22:37:54.765 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.765 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.765 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.765 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:54.765 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.766 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.766 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.766 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-10T22:37:54.766 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-10T22:37:54.766 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.766 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-10T22:37:54.766 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "restful", 2024-09-10T22:37:54.766 INFO:teuthology.orchestra.run.smithi019.stdout: "can_run": true, 2024-09-10T22:37:54.766 INFO:teuthology.orchestra.run.smithi019.stdout: "error_string": "", 2024-09-10T22:37:54.766 INFO:teuthology.orchestra.run.smithi019.stdout: "module_options": { 2024-09-10T22:37:54.766 INFO:teuthology.orchestra.run.smithi019.stdout: "enable_auth": { 2024-09-10T22:37:54.766 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "enable_auth", 2024-09-10T22:37:54.766 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-10T22:37:54.767 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.767 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-10T22:37:54.767 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "True", 2024-09-10T22:37:54.767 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.767 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.767 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.767 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:54.767 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.767 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.767 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.767 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.767 INFO:teuthology.orchestra.run.smithi019.stdout: "key_file": { 2024-09-10T22:37:54.767 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "key_file", 2024-09-10T22:37:54.768 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-10T22:37:54.768 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.768 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-10T22:37:54.768 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-10T22:37:54.768 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.768 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.768 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.768 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:54.768 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.768 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.768 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.768 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.768 INFO:teuthology.orchestra.run.smithi019.stdout: "log_level": { 2024-09-10T22:37:54.768 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_level", 2024-09-10T22:37:54.769 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-10T22:37:54.769 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.769 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:54.769 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-10T22:37:54.769 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.769 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.769 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-10T22:37:54.769 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-10T22:37:54.769 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-10T22:37:54.769 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-10T22:37:54.769 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-10T22:37:54.769 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-10T22:37:54.769 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-10T22:37:54.770 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-10T22:37:54.770 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:54.770 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.770 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.770 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.770 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.770 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster": { 2024-09-10T22:37:54.770 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster", 2024-09-10T22:37:54.770 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-10T22:37:54.770 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.770 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:54.770 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-10T22:37:54.770 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.771 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.771 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.771 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:54.771 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.771 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.771 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.771 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.771 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster_level": { 2024-09-10T22:37:54.771 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster_level", 2024-09-10T22:37:54.771 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-10T22:37:54.771 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.771 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:54.771 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "info", 2024-09-10T22:37:54.772 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.772 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.772 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-10T22:37:54.772 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-10T22:37:54.772 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-10T22:37:54.772 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-10T22:37:54.772 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-10T22:37:54.772 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-10T22:37:54.772 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-10T22:37:54.772 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-10T22:37:54.772 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:54.772 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.773 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.773 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.773 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.773 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_file": { 2024-09-10T22:37:54.773 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_file", 2024-09-10T22:37:54.773 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-10T22:37:54.773 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.773 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:54.773 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-10T22:37:54.773 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.773 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.773 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.773 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:54.773 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.774 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.774 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.774 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.774 INFO:teuthology.orchestra.run.smithi019.stdout: "max_requests": { 2024-09-10T22:37:54.774 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "max_requests", 2024-09-10T22:37:54.774 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "int", 2024-09-10T22:37:54.774 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.774 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-10T22:37:54.774 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "500", 2024-09-10T22:37:54.774 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.774 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.774 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.774 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number.if un-finished request is removed, error message will be logged in the ceph-mgr log.", 2024-09-10T22:37:54.775 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.775 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.775 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.775 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.775 INFO:teuthology.orchestra.run.smithi019.stdout: "server_addr": { 2024-09-10T22:37:54.775 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "server_addr", 2024-09-10T22:37:54.775 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-10T22:37:54.775 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.775 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-10T22:37:54.775 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-10T22:37:54.775 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.775 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.775 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.776 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:54.776 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.776 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.776 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.776 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.776 INFO:teuthology.orchestra.run.smithi019.stdout: "server_port": { 2024-09-10T22:37:54.776 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "server_port", 2024-09-10T22:37:54.776 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-10T22:37:54.776 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.776 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-10T22:37:54.776 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-10T22:37:54.776 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.776 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.777 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.777 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:54.777 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.777 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.777 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.777 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.777 INFO:teuthology.orchestra.run.smithi019.stdout: "sqlite3_killpoint": { 2024-09-10T22:37:54.777 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "sqlite3_killpoint", 2024-09-10T22:37:54.777 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "int", 2024-09-10T22:37:54.777 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "dev", 2024-09-10T22:37:54.777 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:54.777 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "0", 2024-09-10T22:37:54.777 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.778 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.778 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.778 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:54.778 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.778 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.778 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.778 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-10T22:37:54.778 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-10T22:37:54.778 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.778 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-10T22:37:54.778 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "rgw", 2024-09-10T22:37:54.778 INFO:teuthology.orchestra.run.smithi019.stdout: "can_run": true, 2024-09-10T22:37:54.778 INFO:teuthology.orchestra.run.smithi019.stdout: "error_string": "", 2024-09-10T22:37:54.779 INFO:teuthology.orchestra.run.smithi019.stdout: "module_options": { 2024-09-10T22:37:54.779 INFO:teuthology.orchestra.run.smithi019.stdout: "log_level": { 2024-09-10T22:37:54.779 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_level", 2024-09-10T22:37:54.779 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-10T22:37:54.779 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.779 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:54.779 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-10T22:37:54.779 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.779 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.779 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-10T22:37:54.779 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-10T22:37:54.779 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-10T22:37:54.779 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-10T22:37:54.779 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-10T22:37:54.780 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-10T22:37:54.780 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-10T22:37:54.780 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-10T22:37:54.780 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:54.780 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.780 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.780 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.780 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.780 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster": { 2024-09-10T22:37:54.780 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster", 2024-09-10T22:37:54.780 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-10T22:37:54.780 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.780 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:54.781 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-10T22:37:54.781 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.781 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.781 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.781 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:54.781 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.781 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.781 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.781 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.781 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster_level": { 2024-09-10T22:37:54.781 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster_level", 2024-09-10T22:37:54.781 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-10T22:37:54.781 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.782 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:54.782 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "info", 2024-09-10T22:37:54.782 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.782 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.782 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-10T22:37:54.782 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-10T22:37:54.782 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-10T22:37:54.782 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-10T22:37:54.782 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-10T22:37:54.782 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-10T22:37:54.782 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-10T22:37:54.782 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-10T22:37:54.782 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:54.782 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.783 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.783 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.783 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.783 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_file": { 2024-09-10T22:37:54.783 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_file", 2024-09-10T22:37:54.783 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-10T22:37:54.783 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.783 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:54.783 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-10T22:37:54.783 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.783 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.783 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.783 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:54.783 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.784 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.784 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.784 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.784 INFO:teuthology.orchestra.run.smithi019.stdout: "secondary_zone_period_retry_limit": { 2024-09-10T22:37:54.784 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "secondary_zone_period_retry_limit", 2024-09-10T22:37:54.784 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "int", 2024-09-10T22:37:54.784 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.784 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-10T22:37:54.784 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "5", 2024-09-10T22:37:54.784 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.784 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.784 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.784 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "RGW module period update retry limit for secondary site", 2024-09-10T22:37:54.785 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.785 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.785 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.785 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.785 INFO:teuthology.orchestra.run.smithi019.stdout: "sqlite3_killpoint": { 2024-09-10T22:37:54.785 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "sqlite3_killpoint", 2024-09-10T22:37:54.785 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "int", 2024-09-10T22:37:54.785 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "dev", 2024-09-10T22:37:54.785 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:54.785 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "0", 2024-09-10T22:37:54.785 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.785 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.786 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.786 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:54.786 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.786 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.786 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.786 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-10T22:37:54.786 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-10T22:37:54.786 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.786 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-10T22:37:54.786 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "rook", 2024-09-10T22:37:54.786 INFO:teuthology.orchestra.run.smithi019.stdout: "can_run": true, 2024-09-10T22:37:54.786 INFO:teuthology.orchestra.run.smithi019.stdout: "error_string": "", 2024-09-10T22:37:54.786 INFO:teuthology.orchestra.run.smithi019.stdout: "module_options": { 2024-09-10T22:37:54.787 INFO:teuthology.orchestra.run.smithi019.stdout: "log_level": { 2024-09-10T22:37:54.787 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_level", 2024-09-10T22:37:54.787 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-10T22:37:54.787 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.787 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:54.787 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-10T22:37:54.787 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.787 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.787 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-10T22:37:54.787 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-10T22:37:54.787 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-10T22:37:54.787 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-10T22:37:54.787 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-10T22:37:54.788 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-10T22:37:54.788 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-10T22:37:54.788 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-10T22:37:54.788 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:54.788 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.788 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.788 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.788 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.788 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster": { 2024-09-10T22:37:54.788 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster", 2024-09-10T22:37:54.788 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-10T22:37:54.788 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.789 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:54.789 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-10T22:37:54.789 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.789 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.789 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.789 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:54.789 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.789 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.789 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.789 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.789 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster_level": { 2024-09-10T22:37:54.789 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster_level", 2024-09-10T22:37:54.789 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-10T22:37:54.790 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.790 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:54.790 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "info", 2024-09-10T22:37:54.790 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.790 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.790 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-10T22:37:54.790 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-10T22:37:54.790 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-10T22:37:54.790 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-10T22:37:54.790 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-10T22:37:54.790 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-10T22:37:54.790 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-10T22:37:54.790 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-10T22:37:54.791 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:54.791 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.791 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.791 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.791 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.791 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_file": { 2024-09-10T22:37:54.791 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_file", 2024-09-10T22:37:54.791 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-10T22:37:54.791 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.791 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:54.791 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-10T22:37:54.791 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.791 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.792 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.792 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:54.792 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.792 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.792 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.792 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.792 INFO:teuthology.orchestra.run.smithi019.stdout: "sqlite3_killpoint": { 2024-09-10T22:37:54.792 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "sqlite3_killpoint", 2024-09-10T22:37:54.792 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "int", 2024-09-10T22:37:54.792 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "dev", 2024-09-10T22:37:54.792 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:54.792 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "0", 2024-09-10T22:37:54.792 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.793 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.793 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.793 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:54.793 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.793 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.793 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.793 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.793 INFO:teuthology.orchestra.run.smithi019.stdout: "storage_class": { 2024-09-10T22:37:54.793 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "storage_class", 2024-09-10T22:37:54.793 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-10T22:37:54.793 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.793 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-10T22:37:54.793 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "local", 2024-09-10T22:37:54.793 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.794 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.794 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.794 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "storage class name for LSO-discovered PVs", 2024-09-10T22:37:54.794 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.794 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.794 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.794 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-10T22:37:54.794 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-10T22:37:54.794 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.794 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-10T22:37:54.794 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "selftest", 2024-09-10T22:37:54.794 INFO:teuthology.orchestra.run.smithi019.stdout: "can_run": true, 2024-09-10T22:37:54.794 INFO:teuthology.orchestra.run.smithi019.stdout: "error_string": "", 2024-09-10T22:37:54.795 INFO:teuthology.orchestra.run.smithi019.stdout: "module_options": { 2024-09-10T22:37:54.795 INFO:teuthology.orchestra.run.smithi019.stdout: "log_level": { 2024-09-10T22:37:54.795 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_level", 2024-09-10T22:37:54.795 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-10T22:37:54.795 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.795 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:54.795 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-10T22:37:54.795 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.795 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.795 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-10T22:37:54.795 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-10T22:37:54.795 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-10T22:37:54.795 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-10T22:37:54.796 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-10T22:37:54.796 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-10T22:37:54.796 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-10T22:37:54.796 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-10T22:37:54.796 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:54.796 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.796 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.796 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.796 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.796 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster": { 2024-09-10T22:37:54.796 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster", 2024-09-10T22:37:54.796 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-10T22:37:54.796 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.797 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:54.797 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-10T22:37:54.797 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.797 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.797 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.797 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:54.797 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.797 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.797 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.797 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.797 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster_level": { 2024-09-10T22:37:54.797 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster_level", 2024-09-10T22:37:54.797 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-10T22:37:54.798 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.798 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:54.798 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "info", 2024-09-10T22:37:54.798 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.798 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.798 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-10T22:37:54.798 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-10T22:37:54.798 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-10T22:37:54.798 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-10T22:37:54.798 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-10T22:37:54.798 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-10T22:37:54.798 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-10T22:37:54.798 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-10T22:37:54.799 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:54.799 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.799 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.799 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.799 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.799 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_file": { 2024-09-10T22:37:54.799 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_file", 2024-09-10T22:37:54.799 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-10T22:37:54.799 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.799 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:54.799 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-10T22:37:54.799 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.799 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.800 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.800 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:54.800 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.800 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.800 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.800 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.800 INFO:teuthology.orchestra.run.smithi019.stdout: "roption1": { 2024-09-10T22:37:54.800 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "roption1", 2024-09-10T22:37:54.800 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-10T22:37:54.800 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.800 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-10T22:37:54.800 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-10T22:37:54.801 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.801 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.801 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.801 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:54.801 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.801 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.801 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.801 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.801 INFO:teuthology.orchestra.run.smithi019.stdout: "roption2": { 2024-09-10T22:37:54.801 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "roption2", 2024-09-10T22:37:54.801 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-10T22:37:54.801 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.801 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-10T22:37:54.802 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "xyz", 2024-09-10T22:37:54.802 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.802 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.802 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.802 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:54.802 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.802 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.802 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.802 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.802 INFO:teuthology.orchestra.run.smithi019.stdout: "rwoption1": { 2024-09-10T22:37:54.802 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "rwoption1", 2024-09-10T22:37:54.802 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-10T22:37:54.802 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.802 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-10T22:37:54.803 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-10T22:37:54.803 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.803 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.803 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.803 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:54.803 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.803 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.803 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.803 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.803 INFO:teuthology.orchestra.run.smithi019.stdout: "rwoption2": { 2024-09-10T22:37:54.803 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "rwoption2", 2024-09-10T22:37:54.803 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "int", 2024-09-10T22:37:54.803 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.804 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-10T22:37:54.804 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-10T22:37:54.804 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.804 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.804 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.804 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:54.804 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.804 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.804 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.804 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.804 INFO:teuthology.orchestra.run.smithi019.stdout: "rwoption3": { 2024-09-10T22:37:54.804 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "rwoption3", 2024-09-10T22:37:54.805 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "float", 2024-09-10T22:37:54.805 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.805 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-10T22:37:54.805 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-10T22:37:54.805 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.805 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.805 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.805 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:54.805 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.805 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.805 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.805 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.805 INFO:teuthology.orchestra.run.smithi019.stdout: "rwoption4": { 2024-09-10T22:37:54.806 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "rwoption4", 2024-09-10T22:37:54.806 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-10T22:37:54.806 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.806 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-10T22:37:54.806 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-10T22:37:54.806 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.806 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.806 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.806 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:54.806 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.806 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.806 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.806 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.807 INFO:teuthology.orchestra.run.smithi019.stdout: "rwoption5": { 2024-09-10T22:37:54.807 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "rwoption5", 2024-09-10T22:37:54.807 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-10T22:37:54.807 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.807 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-10T22:37:54.807 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-10T22:37:54.807 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.807 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.807 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.807 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:54.807 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.807 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.807 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.808 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.808 INFO:teuthology.orchestra.run.smithi019.stdout: "rwoption6": { 2024-09-10T22:37:54.808 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "rwoption6", 2024-09-10T22:37:54.808 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-10T22:37:54.808 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.808 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-10T22:37:54.808 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "True", 2024-09-10T22:37:54.808 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.808 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.808 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.808 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:54.808 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.809 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.809 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.809 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.809 INFO:teuthology.orchestra.run.smithi019.stdout: "rwoption7": { 2024-09-10T22:37:54.809 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "rwoption7", 2024-09-10T22:37:54.809 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "int", 2024-09-10T22:37:54.809 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.809 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-10T22:37:54.809 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-10T22:37:54.809 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "1", 2024-09-10T22:37:54.809 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "42", 2024-09-10T22:37:54.809 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.809 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:54.810 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.810 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.810 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.810 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.810 INFO:teuthology.orchestra.run.smithi019.stdout: "sqlite3_killpoint": { 2024-09-10T22:37:54.810 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "sqlite3_killpoint", 2024-09-10T22:37:54.810 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "int", 2024-09-10T22:37:54.810 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "dev", 2024-09-10T22:37:54.810 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:54.810 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "0", 2024-09-10T22:37:54.810 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.810 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.810 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.810 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:54.811 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.811 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.811 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.811 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.811 INFO:teuthology.orchestra.run.smithi019.stdout: "testkey": { 2024-09-10T22:37:54.811 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "testkey", 2024-09-10T22:37:54.811 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-10T22:37:54.811 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.811 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-10T22:37:54.811 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-10T22:37:54.811 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.811 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.811 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.812 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:54.812 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.812 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.812 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.812 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.812 INFO:teuthology.orchestra.run.smithi019.stdout: "testlkey": { 2024-09-10T22:37:54.812 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "testlkey", 2024-09-10T22:37:54.812 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-10T22:37:54.812 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.812 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-10T22:37:54.812 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-10T22:37:54.812 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.812 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.813 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.813 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:54.813 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.813 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.813 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.813 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.813 INFO:teuthology.orchestra.run.smithi019.stdout: "testnewline": { 2024-09-10T22:37:54.813 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "testnewline", 2024-09-10T22:37:54.813 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-10T22:37:54.813 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.813 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-10T22:37:54.813 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-10T22:37:54.813 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.814 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.814 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.814 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:54.814 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.814 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.814 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.814 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-10T22:37:54.814 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-10T22:37:54.814 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.814 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-10T22:37:54.814 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "smb", 2024-09-10T22:37:54.814 INFO:teuthology.orchestra.run.smithi019.stdout: "can_run": true, 2024-09-10T22:37:54.814 INFO:teuthology.orchestra.run.smithi019.stdout: "error_string": "", 2024-09-10T22:37:54.815 INFO:teuthology.orchestra.run.smithi019.stdout: "module_options": { 2024-09-10T22:37:54.815 INFO:teuthology.orchestra.run.smithi019.stdout: "internal_store_backend": { 2024-09-10T22:37:54.815 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "internal_store_backend", 2024-09-10T22:37:54.815 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-10T22:37:54.815 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "dev", 2024-09-10T22:37:54.815 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-10T22:37:54.815 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-10T22:37:54.815 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.815 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.815 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.815 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "set internal store backend. for develoment and testing only", 2024-09-10T22:37:54.815 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.815 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.816 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.816 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.816 INFO:teuthology.orchestra.run.smithi019.stdout: "log_level": { 2024-09-10T22:37:54.816 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_level", 2024-09-10T22:37:54.816 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-10T22:37:54.816 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.816 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:54.816 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-10T22:37:54.816 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.816 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.816 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-10T22:37:54.816 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-10T22:37:54.816 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-10T22:37:54.817 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-10T22:37:54.817 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-10T22:37:54.817 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-10T22:37:54.817 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-10T22:37:54.817 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-10T22:37:54.817 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:54.817 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.817 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.817 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.817 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.817 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster": { 2024-09-10T22:37:54.817 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster", 2024-09-10T22:37:54.817 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-10T22:37:54.818 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.818 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:54.818 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-10T22:37:54.818 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.818 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.818 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.818 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:54.818 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.818 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.818 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.818 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.818 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster_level": { 2024-09-10T22:37:54.818 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster_level", 2024-09-10T22:37:54.819 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-10T22:37:54.819 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.819 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:54.819 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "info", 2024-09-10T22:37:54.819 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.819 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.819 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-10T22:37:54.819 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-10T22:37:54.819 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-10T22:37:54.819 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-10T22:37:54.819 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-10T22:37:54.819 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-10T22:37:54.819 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-10T22:37:54.819 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-10T22:37:54.820 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:54.820 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.820 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.820 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.820 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.820 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_file": { 2024-09-10T22:37:54.820 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_file", 2024-09-10T22:37:54.820 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-10T22:37:54.820 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.820 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:54.820 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-10T22:37:54.820 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.820 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.821 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.821 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:54.821 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.821 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.821 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.821 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.821 INFO:teuthology.orchestra.run.smithi019.stdout: "sqlite3_killpoint": { 2024-09-10T22:37:54.821 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "sqlite3_killpoint", 2024-09-10T22:37:54.821 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "int", 2024-09-10T22:37:54.821 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "dev", 2024-09-10T22:37:54.821 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:54.821 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "0", 2024-09-10T22:37:54.821 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.822 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.822 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.822 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:54.822 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.822 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.822 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.822 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.822 INFO:teuthology.orchestra.run.smithi019.stdout: "update_orchestration": { 2024-09-10T22:37:54.822 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "update_orchestration", 2024-09-10T22:37:54.822 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-10T22:37:54.822 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.822 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-10T22:37:54.823 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "True", 2024-09-10T22:37:54.823 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.823 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.823 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.823 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "automatically update orchestration when smb resources are changed", 2024-09-10T22:37:54.823 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.823 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.823 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.823 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-10T22:37:54.823 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-10T22:37:54.823 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.823 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-10T22:37:54.823 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "snap_schedule", 2024-09-10T22:37:54.823 INFO:teuthology.orchestra.run.smithi019.stdout: "can_run": true, 2024-09-10T22:37:54.824 INFO:teuthology.orchestra.run.smithi019.stdout: "error_string": "", 2024-09-10T22:37:54.824 INFO:teuthology.orchestra.run.smithi019.stdout: "module_options": { 2024-09-10T22:37:54.824 INFO:teuthology.orchestra.run.smithi019.stdout: "allow_m_granularity": { 2024-09-10T22:37:54.824 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "allow_m_granularity", 2024-09-10T22:37:54.824 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-10T22:37:54.824 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.824 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:54.824 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-10T22:37:54.824 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.824 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.824 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.824 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "allow minute scheduled snapshots", 2024-09-10T22:37:54.824 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.825 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.825 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.825 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.825 INFO:teuthology.orchestra.run.smithi019.stdout: "dump_on_update": { 2024-09-10T22:37:54.825 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "dump_on_update", 2024-09-10T22:37:54.825 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-10T22:37:54.825 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.825 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:54.825 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-10T22:37:54.825 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.825 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.825 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.825 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "dump database to debug log on update", 2024-09-10T22:37:54.826 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.826 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.826 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.826 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.826 INFO:teuthology.orchestra.run.smithi019.stdout: "log_level": { 2024-09-10T22:37:54.826 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_level", 2024-09-10T22:37:54.826 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-10T22:37:54.826 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.826 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:54.826 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-10T22:37:54.826 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.826 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.826 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-10T22:37:54.827 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-10T22:37:54.827 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-10T22:37:54.827 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-10T22:37:54.827 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-10T22:37:54.827 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-10T22:37:54.827 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-10T22:37:54.827 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-10T22:37:54.827 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:54.827 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.827 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.827 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.827 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.827 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster": { 2024-09-10T22:37:54.827 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster", 2024-09-10T22:37:54.828 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-10T22:37:54.828 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.828 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:54.828 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-10T22:37:54.828 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.828 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.828 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.828 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:54.828 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.828 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.828 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.828 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.828 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster_level": { 2024-09-10T22:37:54.829 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster_level", 2024-09-10T22:37:54.829 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-10T22:37:54.829 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.829 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:54.829 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "info", 2024-09-10T22:37:54.829 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.829 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.829 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-10T22:37:54.829 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-10T22:37:54.829 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-10T22:37:54.829 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-10T22:37:54.829 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-10T22:37:54.829 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-10T22:37:54.829 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-10T22:37:54.830 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-10T22:37:54.830 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:54.830 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.830 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.830 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.830 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.830 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_file": { 2024-09-10T22:37:54.830 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_file", 2024-09-10T22:37:54.830 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-10T22:37:54.830 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.830 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:54.830 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-10T22:37:54.831 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.831 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.831 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.831 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:54.831 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.831 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.831 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.831 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.831 INFO:teuthology.orchestra.run.smithi019.stdout: "sqlite3_killpoint": { 2024-09-10T22:37:54.831 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "sqlite3_killpoint", 2024-09-10T22:37:54.831 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "int", 2024-09-10T22:37:54.831 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "dev", 2024-09-10T22:37:54.831 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:54.831 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "0", 2024-09-10T22:37:54.832 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.832 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.832 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.832 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:54.832 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.832 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.832 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.832 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-10T22:37:54.832 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-10T22:37:54.832 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.832 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-10T22:37:54.832 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "stats", 2024-09-10T22:37:54.832 INFO:teuthology.orchestra.run.smithi019.stdout: "can_run": true, 2024-09-10T22:37:54.833 INFO:teuthology.orchestra.run.smithi019.stdout: "error_string": "", 2024-09-10T22:37:54.833 INFO:teuthology.orchestra.run.smithi019.stdout: "module_options": { 2024-09-10T22:37:54.833 INFO:teuthology.orchestra.run.smithi019.stdout: "log_level": { 2024-09-10T22:37:54.833 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_level", 2024-09-10T22:37:54.833 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-10T22:37:54.833 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.833 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:54.833 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-10T22:37:54.833 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.833 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.833 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-10T22:37:54.833 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-10T22:37:54.833 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-10T22:37:54.834 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-10T22:37:54.834 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-10T22:37:54.834 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-10T22:37:54.834 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-10T22:37:54.834 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-10T22:37:54.834 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:54.834 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.834 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.834 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.834 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.834 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster": { 2024-09-10T22:37:54.834 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster", 2024-09-10T22:37:54.834 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-10T22:37:54.835 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.835 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:54.835 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-10T22:37:54.835 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.835 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.835 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.835 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:54.835 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.835 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.835 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.835 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.835 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster_level": { 2024-09-10T22:37:54.835 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster_level", 2024-09-10T22:37:54.836 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-10T22:37:54.836 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.836 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:54.836 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "info", 2024-09-10T22:37:54.836 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.836 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.836 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-10T22:37:54.836 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-10T22:37:54.836 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-10T22:37:54.836 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-10T22:37:54.836 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-10T22:37:54.836 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-10T22:37:54.837 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-10T22:37:54.837 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-10T22:37:54.837 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:54.837 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.837 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.837 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.837 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.837 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_file": { 2024-09-10T22:37:54.837 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_file", 2024-09-10T22:37:54.837 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-10T22:37:54.837 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.837 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:54.837 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-10T22:37:54.837 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.838 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.838 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.838 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:54.838 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.838 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.838 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.838 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.838 INFO:teuthology.orchestra.run.smithi019.stdout: "sqlite3_killpoint": { 2024-09-10T22:37:54.838 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "sqlite3_killpoint", 2024-09-10T22:37:54.838 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "int", 2024-09-10T22:37:54.838 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "dev", 2024-09-10T22:37:54.838 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:54.838 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "0", 2024-09-10T22:37:54.839 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.839 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.839 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.839 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:54.839 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.839 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.839 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.839 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-10T22:37:54.839 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-10T22:37:54.839 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.839 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-10T22:37:54.839 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "status", 2024-09-10T22:37:54.839 INFO:teuthology.orchestra.run.smithi019.stdout: "can_run": true, 2024-09-10T22:37:54.840 INFO:teuthology.orchestra.run.smithi019.stdout: "error_string": "", 2024-09-10T22:37:54.840 INFO:teuthology.orchestra.run.smithi019.stdout: "module_options": { 2024-09-10T22:37:54.840 INFO:teuthology.orchestra.run.smithi019.stdout: "log_level": { 2024-09-10T22:37:54.840 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_level", 2024-09-10T22:37:54.840 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-10T22:37:54.840 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.840 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:54.840 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-10T22:37:54.840 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.840 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.840 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-10T22:37:54.840 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-10T22:37:54.840 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-10T22:37:54.841 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-10T22:37:54.841 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-10T22:37:54.841 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-10T22:37:54.841 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-10T22:37:54.841 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-10T22:37:54.841 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:54.841 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.841 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.841 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.841 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.841 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster": { 2024-09-10T22:37:54.841 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster", 2024-09-10T22:37:54.841 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-10T22:37:54.842 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.842 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:54.842 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-10T22:37:54.842 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.842 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.842 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.842 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:54.842 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.842 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.842 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.842 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.842 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster_level": { 2024-09-10T22:37:54.842 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster_level", 2024-09-10T22:37:54.842 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-10T22:37:54.843 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.843 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:54.843 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "info", 2024-09-10T22:37:54.843 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.843 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.843 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-10T22:37:54.843 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-10T22:37:54.843 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-10T22:37:54.843 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-10T22:37:54.843 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-10T22:37:54.843 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-10T22:37:54.843 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-10T22:37:54.843 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-10T22:37:54.844 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:54.844 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.844 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.844 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.844 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.844 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_file": { 2024-09-10T22:37:54.844 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_file", 2024-09-10T22:37:54.844 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-10T22:37:54.844 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.844 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:54.844 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-10T22:37:54.844 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.844 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.845 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.845 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:54.845 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.845 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.845 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.845 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.845 INFO:teuthology.orchestra.run.smithi019.stdout: "sqlite3_killpoint": { 2024-09-10T22:37:54.845 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "sqlite3_killpoint", 2024-09-10T22:37:54.845 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "int", 2024-09-10T22:37:54.845 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "dev", 2024-09-10T22:37:54.845 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:54.845 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "0", 2024-09-10T22:37:54.845 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.846 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.846 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.846 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:54.846 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.846 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.846 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.846 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-10T22:37:54.846 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-10T22:37:54.846 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.846 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-10T22:37:54.846 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "telegraf", 2024-09-10T22:37:54.846 INFO:teuthology.orchestra.run.smithi019.stdout: "can_run": true, 2024-09-10T22:37:54.846 INFO:teuthology.orchestra.run.smithi019.stdout: "error_string": "", 2024-09-10T22:37:54.847 INFO:teuthology.orchestra.run.smithi019.stdout: "module_options": { 2024-09-10T22:37:54.847 INFO:teuthology.orchestra.run.smithi019.stdout: "address": { 2024-09-10T22:37:54.847 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "address", 2024-09-10T22:37:54.847 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-10T22:37:54.847 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.847 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-10T22:37:54.847 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2024-09-10T22:37:54.847 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.847 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.847 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.847 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:54.847 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.847 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.848 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.848 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.848 INFO:teuthology.orchestra.run.smithi019.stdout: "interval": { 2024-09-10T22:37:54.848 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "interval", 2024-09-10T22:37:54.848 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "secs", 2024-09-10T22:37:54.848 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.848 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-10T22:37:54.848 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "15", 2024-09-10T22:37:54.848 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.848 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.848 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.848 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:54.848 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.849 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.849 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.849 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.849 INFO:teuthology.orchestra.run.smithi019.stdout: "log_level": { 2024-09-10T22:37:54.849 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_level", 2024-09-10T22:37:54.849 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-10T22:37:54.849 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.849 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:54.849 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-10T22:37:54.849 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.849 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.849 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-10T22:37:54.849 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-10T22:37:54.850 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-10T22:37:54.850 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-10T22:37:54.850 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-10T22:37:54.850 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-10T22:37:54.850 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-10T22:37:54.850 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-10T22:37:54.850 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:54.850 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.850 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.850 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.850 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.850 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster": { 2024-09-10T22:37:54.850 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster", 2024-09-10T22:37:54.851 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-10T22:37:54.851 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.851 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:54.851 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-10T22:37:54.851 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.851 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.851 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.851 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:54.851 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.851 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.851 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.851 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.851 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster_level": { 2024-09-10T22:37:54.852 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster_level", 2024-09-10T22:37:54.852 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-10T22:37:54.852 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.852 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:54.852 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "info", 2024-09-10T22:37:54.852 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.852 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.852 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-10T22:37:54.852 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-10T22:37:54.852 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-10T22:37:54.852 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-10T22:37:54.852 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-10T22:37:54.852 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-10T22:37:54.853 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-10T22:37:54.853 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-10T22:37:54.853 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:54.853 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.853 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.853 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.853 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.853 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_file": { 2024-09-10T22:37:54.853 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_file", 2024-09-10T22:37:54.853 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-10T22:37:54.853 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.853 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:54.853 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-10T22:37:54.854 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.854 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.854 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.854 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:54.854 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.854 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.854 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.854 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.854 INFO:teuthology.orchestra.run.smithi019.stdout: "sqlite3_killpoint": { 2024-09-10T22:37:54.854 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "sqlite3_killpoint", 2024-09-10T22:37:54.854 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "int", 2024-09-10T22:37:54.854 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "dev", 2024-09-10T22:37:54.854 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:54.855 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "0", 2024-09-10T22:37:54.855 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.855 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.855 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.855 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:54.855 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.855 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.855 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.855 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-10T22:37:54.855 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-10T22:37:54.855 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.855 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-10T22:37:54.855 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "telemetry", 2024-09-10T22:37:54.855 INFO:teuthology.orchestra.run.smithi019.stdout: "can_run": true, 2024-09-10T22:37:54.856 INFO:teuthology.orchestra.run.smithi019.stdout: "error_string": "", 2024-09-10T22:37:54.856 INFO:teuthology.orchestra.run.smithi019.stdout: "module_options": { 2024-09-10T22:37:54.856 INFO:teuthology.orchestra.run.smithi019.stdout: "channel_basic": { 2024-09-10T22:37:54.856 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "channel_basic", 2024-09-10T22:37:54.856 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-10T22:37:54.856 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.856 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-10T22:37:54.856 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "True", 2024-09-10T22:37:54.856 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.856 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.856 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.856 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "Share basic cluster information (size, version)", 2024-09-10T22:37:54.856 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.857 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.857 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.857 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.857 INFO:teuthology.orchestra.run.smithi019.stdout: "channel_crash": { 2024-09-10T22:37:54.857 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "channel_crash", 2024-09-10T22:37:54.857 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-10T22:37:54.857 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.857 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-10T22:37:54.857 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "True", 2024-09-10T22:37:54.857 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.857 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.857 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.857 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2024-09-10T22:37:54.857 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.858 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.858 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.858 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.858 INFO:teuthology.orchestra.run.smithi019.stdout: "channel_device": { 2024-09-10T22:37:54.858 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "channel_device", 2024-09-10T22:37:54.858 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-10T22:37:54.858 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.858 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-10T22:37:54.858 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "True", 2024-09-10T22:37:54.858 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.858 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.858 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.858 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2024-09-10T22:37:54.859 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.859 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.859 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.859 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.859 INFO:teuthology.orchestra.run.smithi019.stdout: "channel_ident": { 2024-09-10T22:37:54.859 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "channel_ident", 2024-09-10T22:37:54.859 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-10T22:37:54.859 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.859 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-10T22:37:54.859 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-10T22:37:54.859 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.859 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.860 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.860 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2024-09-10T22:37:54.860 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.860 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.860 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.860 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.860 INFO:teuthology.orchestra.run.smithi019.stdout: "channel_perf": { 2024-09-10T22:37:54.860 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "channel_perf", 2024-09-10T22:37:54.860 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-10T22:37:54.860 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.860 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-10T22:37:54.860 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-10T22:37:54.860 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.861 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.861 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.861 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "Share various performance metrics of a cluster", 2024-09-10T22:37:54.861 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.861 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.861 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.861 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.861 INFO:teuthology.orchestra.run.smithi019.stdout: "contact": { 2024-09-10T22:37:54.861 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "contact", 2024-09-10T22:37:54.861 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-10T22:37:54.861 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.861 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-10T22:37:54.861 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-10T22:37:54.861 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.862 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.862 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.862 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:54.862 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.862 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.862 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.862 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.862 INFO:teuthology.orchestra.run.smithi019.stdout: "description": { 2024-09-10T22:37:54.862 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "description", 2024-09-10T22:37:54.862 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-10T22:37:54.862 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.862 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-10T22:37:54.863 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-10T22:37:54.863 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.863 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.863 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.863 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:54.863 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.863 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.863 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.863 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.863 INFO:teuthology.orchestra.run.smithi019.stdout: "device_url": { 2024-09-10T22:37:54.863 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "device_url", 2024-09-10T22:37:54.863 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-10T22:37:54.863 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.864 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-10T22:37:54.864 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "https://telemetry.ceph.com/device", 2024-09-10T22:37:54.864 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.864 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.864 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.864 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:54.864 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.864 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.864 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.864 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.864 INFO:teuthology.orchestra.run.smithi019.stdout: "enabled": { 2024-09-10T22:37:54.864 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "enabled", 2024-09-10T22:37:54.864 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-10T22:37:54.865 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.865 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-10T22:37:54.865 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-10T22:37:54.865 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.865 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.865 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.865 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:54.865 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.865 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.865 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.865 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.865 INFO:teuthology.orchestra.run.smithi019.stdout: "interval": { 2024-09-10T22:37:54.865 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "interval", 2024-09-10T22:37:54.866 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "int", 2024-09-10T22:37:54.866 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.866 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-10T22:37:54.866 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "24", 2024-09-10T22:37:54.866 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "8", 2024-09-10T22:37:54.866 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.866 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.866 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:54.866 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.866 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.866 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.866 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.866 INFO:teuthology.orchestra.run.smithi019.stdout: "last_opt_revision": { 2024-09-10T22:37:54.867 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "last_opt_revision", 2024-09-10T22:37:54.867 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "int", 2024-09-10T22:37:54.867 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.867 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-10T22:37:54.867 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "1", 2024-09-10T22:37:54.867 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.867 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.867 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.867 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:54.867 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.867 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.867 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.867 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.868 INFO:teuthology.orchestra.run.smithi019.stdout: "leaderboard": { 2024-09-10T22:37:54.868 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "leaderboard", 2024-09-10T22:37:54.868 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-10T22:37:54.868 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.868 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-10T22:37:54.868 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-10T22:37:54.868 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.868 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.868 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.868 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:54.868 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.868 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.868 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.868 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.869 INFO:teuthology.orchestra.run.smithi019.stdout: "leaderboard_description": { 2024-09-10T22:37:54.869 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "leaderboard_description", 2024-09-10T22:37:54.869 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-10T22:37:54.869 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.869 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-10T22:37:54.869 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-10T22:37:54.869 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.869 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.869 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.869 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:54.869 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.869 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.869 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.870 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.870 INFO:teuthology.orchestra.run.smithi019.stdout: "log_level": { 2024-09-10T22:37:54.870 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_level", 2024-09-10T22:37:54.870 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-10T22:37:54.870 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.870 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:54.870 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-10T22:37:54.870 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.870 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.870 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-10T22:37:54.870 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-10T22:37:54.870 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-10T22:37:54.870 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-10T22:37:54.870 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-10T22:37:54.871 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-10T22:37:54.871 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-10T22:37:54.871 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-10T22:37:54.871 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:54.871 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.871 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.871 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.871 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.871 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster": { 2024-09-10T22:37:54.871 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster", 2024-09-10T22:37:54.871 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-10T22:37:54.871 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.871 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:54.872 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-10T22:37:54.872 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.872 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.872 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.872 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:54.872 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.872 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.872 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.872 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.872 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster_level": { 2024-09-10T22:37:54.872 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster_level", 2024-09-10T22:37:54.872 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-10T22:37:54.873 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.873 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:54.873 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "info", 2024-09-10T22:37:54.873 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.873 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.873 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-10T22:37:54.873 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-10T22:37:54.873 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-10T22:37:54.873 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-10T22:37:54.873 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-10T22:37:54.873 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-10T22:37:54.873 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-10T22:37:54.873 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-10T22:37:54.874 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:54.874 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.874 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.874 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.874 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.874 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_file": { 2024-09-10T22:37:54.874 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_file", 2024-09-10T22:37:54.874 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-10T22:37:54.874 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.874 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:54.874 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-10T22:37:54.874 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.874 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.875 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.875 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:54.875 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.875 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.875 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.875 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.875 INFO:teuthology.orchestra.run.smithi019.stdout: "organization": { 2024-09-10T22:37:54.875 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "organization", 2024-09-10T22:37:54.875 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-10T22:37:54.875 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.875 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-10T22:37:54.875 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-10T22:37:54.875 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.876 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.876 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.876 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:54.876 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.876 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.876 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.876 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.876 INFO:teuthology.orchestra.run.smithi019.stdout: "proxy": { 2024-09-10T22:37:54.876 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "proxy", 2024-09-10T22:37:54.876 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-10T22:37:54.876 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.876 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-10T22:37:54.876 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-10T22:37:54.876 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.877 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.877 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.877 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:54.877 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.877 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.877 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.877 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.877 INFO:teuthology.orchestra.run.smithi019.stdout: "sqlite3_killpoint": { 2024-09-10T22:37:54.877 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "sqlite3_killpoint", 2024-09-10T22:37:54.877 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "int", 2024-09-10T22:37:54.877 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "dev", 2024-09-10T22:37:54.877 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:54.878 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "0", 2024-09-10T22:37:54.878 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.878 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.878 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.878 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:54.878 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.878 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.878 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.878 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.878 INFO:teuthology.orchestra.run.smithi019.stdout: "url": { 2024-09-10T22:37:54.878 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "url", 2024-09-10T22:37:54.878 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-10T22:37:54.878 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.879 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-10T22:37:54.879 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "https://telemetry.ceph.com/report", 2024-09-10T22:37:54.879 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.879 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.879 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.879 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:54.879 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.879 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.879 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.879 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-10T22:37:54.879 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-10T22:37:54.879 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.879 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-10T22:37:54.880 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "test_orchestrator", 2024-09-10T22:37:54.880 INFO:teuthology.orchestra.run.smithi019.stdout: "can_run": true, 2024-09-10T22:37:54.880 INFO:teuthology.orchestra.run.smithi019.stdout: "error_string": "", 2024-09-10T22:37:54.880 INFO:teuthology.orchestra.run.smithi019.stdout: "module_options": { 2024-09-10T22:37:54.880 INFO:teuthology.orchestra.run.smithi019.stdout: "log_level": { 2024-09-10T22:37:54.880 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_level", 2024-09-10T22:37:54.880 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-10T22:37:54.880 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.880 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:54.880 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-10T22:37:54.880 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.880 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.880 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-10T22:37:54.881 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-10T22:37:54.881 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-10T22:37:54.881 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-10T22:37:54.881 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-10T22:37:54.881 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-10T22:37:54.881 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-10T22:37:54.881 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-10T22:37:54.881 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:54.881 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.881 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.881 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.881 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.881 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster": { 2024-09-10T22:37:54.882 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster", 2024-09-10T22:37:54.882 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-10T22:37:54.882 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.882 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:54.882 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-10T22:37:54.882 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.882 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.882 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.882 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:54.882 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.882 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.882 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.882 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.883 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster_level": { 2024-09-10T22:37:54.883 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster_level", 2024-09-10T22:37:54.883 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-10T22:37:54.883 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.883 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:54.883 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "info", 2024-09-10T22:37:54.883 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.883 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.883 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-10T22:37:54.883 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-10T22:37:54.883 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-10T22:37:54.883 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-10T22:37:54.883 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-10T22:37:54.884 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-10T22:37:54.884 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-10T22:37:54.884 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-10T22:37:54.884 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:54.884 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.884 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.884 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.884 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.884 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_file": { 2024-09-10T22:37:54.884 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_file", 2024-09-10T22:37:54.884 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-10T22:37:54.884 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.884 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:54.885 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-10T22:37:54.885 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.885 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.885 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.885 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:54.885 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.885 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.885 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.885 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.885 INFO:teuthology.orchestra.run.smithi019.stdout: "sqlite3_killpoint": { 2024-09-10T22:37:54.885 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "sqlite3_killpoint", 2024-09-10T22:37:54.885 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "int", 2024-09-10T22:37:54.885 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "dev", 2024-09-10T22:37:54.886 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:54.886 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "0", 2024-09-10T22:37:54.886 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.886 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.886 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.886 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:54.886 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.886 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.886 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.886 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-10T22:37:54.886 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-10T22:37:54.886 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.886 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-10T22:37:54.887 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "volumes", 2024-09-10T22:37:54.887 INFO:teuthology.orchestra.run.smithi019.stdout: "can_run": true, 2024-09-10T22:37:54.887 INFO:teuthology.orchestra.run.smithi019.stdout: "error_string": "", 2024-09-10T22:37:54.887 INFO:teuthology.orchestra.run.smithi019.stdout: "module_options": { 2024-09-10T22:37:54.887 INFO:teuthology.orchestra.run.smithi019.stdout: "log_level": { 2024-09-10T22:37:54.887 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_level", 2024-09-10T22:37:54.887 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-10T22:37:54.887 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.887 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:54.887 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-10T22:37:54.887 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.887 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.887 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-10T22:37:54.887 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-10T22:37:54.888 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-10T22:37:54.888 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-10T22:37:54.888 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-10T22:37:54.888 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-10T22:37:54.888 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-10T22:37:54.888 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-10T22:37:54.888 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:54.888 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.888 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.888 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.888 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.888 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster": { 2024-09-10T22:37:54.888 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster", 2024-09-10T22:37:54.889 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-10T22:37:54.889 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.889 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:54.889 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-10T22:37:54.889 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.889 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.889 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.889 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:54.889 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.889 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.889 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.889 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.890 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster_level": { 2024-09-10T22:37:54.890 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster_level", 2024-09-10T22:37:54.890 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-10T22:37:54.890 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.890 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:54.890 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "info", 2024-09-10T22:37:54.890 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.890 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.890 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-10T22:37:54.890 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-10T22:37:54.890 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-10T22:37:54.890 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-10T22:37:54.890 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-10T22:37:54.891 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-10T22:37:54.891 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-10T22:37:54.891 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-10T22:37:54.891 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:54.891 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.891 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.891 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.891 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.891 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_file": { 2024-09-10T22:37:54.891 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_file", 2024-09-10T22:37:54.891 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-10T22:37:54.891 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.891 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:54.892 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-10T22:37:54.892 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.892 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.892 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.892 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:54.892 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.892 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.892 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.892 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.892 INFO:teuthology.orchestra.run.smithi019.stdout: "max_concurrent_clones": { 2024-09-10T22:37:54.892 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "max_concurrent_clones", 2024-09-10T22:37:54.892 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "int", 2024-09-10T22:37:54.892 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.893 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-10T22:37:54.893 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "4", 2024-09-10T22:37:54.893 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.893 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.893 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.893 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "Number of asynchronous cloner threads", 2024-09-10T22:37:54.893 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.893 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.893 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.893 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.893 INFO:teuthology.orchestra.run.smithi019.stdout: "periodic_async_work": { 2024-09-10T22:37:54.893 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "periodic_async_work", 2024-09-10T22:37:54.893 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-10T22:37:54.894 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.894 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-10T22:37:54.894 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-10T22:37:54.894 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.894 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.894 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.894 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "Periodically check for async work", 2024-09-10T22:37:54.894 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.894 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.894 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.894 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.894 INFO:teuthology.orchestra.run.smithi019.stdout: "snapshot_clone_delay": { 2024-09-10T22:37:54.894 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "snapshot_clone_delay", 2024-09-10T22:37:54.895 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "int", 2024-09-10T22:37:54.895 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.895 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-10T22:37:54.895 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "0", 2024-09-10T22:37:54.895 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.895 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.895 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.895 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2024-09-10T22:37:54.895 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.895 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.895 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.895 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.895 INFO:teuthology.orchestra.run.smithi019.stdout: "snapshot_clone_no_wait": { 2024-09-10T22:37:54.895 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "snapshot_clone_no_wait", 2024-09-10T22:37:54.896 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-10T22:37:54.896 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.896 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-10T22:37:54.896 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "True", 2024-09-10T22:37:54.896 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.896 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.896 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.896 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "Reject subvolume clone request when cloner threads are busy", 2024-09-10T22:37:54.896 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.896 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.896 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.896 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.897 INFO:teuthology.orchestra.run.smithi019.stdout: "sqlite3_killpoint": { 2024-09-10T22:37:54.897 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "sqlite3_killpoint", 2024-09-10T22:37:54.897 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "int", 2024-09-10T22:37:54.897 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "dev", 2024-09-10T22:37:54.897 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:54.897 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "0", 2024-09-10T22:37:54.897 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.897 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.897 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.897 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:54.897 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.897 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.897 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.897 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-10T22:37:54.898 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-10T22:37:54.898 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.898 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-10T22:37:54.898 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "zabbix", 2024-09-10T22:37:54.898 INFO:teuthology.orchestra.run.smithi019.stdout: "can_run": true, 2024-09-10T22:37:54.898 INFO:teuthology.orchestra.run.smithi019.stdout: "error_string": "", 2024-09-10T22:37:54.898 INFO:teuthology.orchestra.run.smithi019.stdout: "module_options": { 2024-09-10T22:37:54.898 INFO:teuthology.orchestra.run.smithi019.stdout: "discovery_interval": { 2024-09-10T22:37:54.898 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "discovery_interval", 2024-09-10T22:37:54.898 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "uint", 2024-09-10T22:37:54.898 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.898 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-10T22:37:54.898 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "100", 2024-09-10T22:37:54.899 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.899 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.899 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.899 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:54.899 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.899 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.899 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.899 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.899 INFO:teuthology.orchestra.run.smithi019.stdout: "identifier": { 2024-09-10T22:37:54.899 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "identifier", 2024-09-10T22:37:54.899 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-10T22:37:54.899 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.899 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-10T22:37:54.900 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-10T22:37:54.900 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.900 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.900 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.900 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:54.900 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.900 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.900 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.900 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.900 INFO:teuthology.orchestra.run.smithi019.stdout: "interval": { 2024-09-10T22:37:54.900 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "interval", 2024-09-10T22:37:54.900 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "secs", 2024-09-10T22:37:54.900 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.901 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-10T22:37:54.901 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "60", 2024-09-10T22:37:54.901 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.901 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.901 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.901 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:54.901 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.901 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.901 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.901 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.901 INFO:teuthology.orchestra.run.smithi019.stdout: "log_level": { 2024-09-10T22:37:54.901 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_level", 2024-09-10T22:37:54.901 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-10T22:37:54.902 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.902 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:54.902 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-10T22:37:54.902 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.902 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.902 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-10T22:37:54.902 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-10T22:37:54.902 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-10T22:37:54.902 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-10T22:37:54.902 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-10T22:37:54.902 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-10T22:37:54.902 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-10T22:37:54.902 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-10T22:37:54.902 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:54.903 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.903 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.903 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.903 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.903 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster": { 2024-09-10T22:37:54.903 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster", 2024-09-10T22:37:54.903 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-10T22:37:54.903 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.903 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:54.903 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-10T22:37:54.903 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.903 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.903 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.904 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:54.904 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.904 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.904 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.904 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.904 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster_level": { 2024-09-10T22:37:54.904 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster_level", 2024-09-10T22:37:54.904 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-10T22:37:54.904 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.904 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:54.904 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "info", 2024-09-10T22:37:54.904 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.904 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.905 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-10T22:37:54.905 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-10T22:37:54.905 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-10T22:37:54.905 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-10T22:37:54.905 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-10T22:37:54.905 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-10T22:37:54.905 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-10T22:37:54.905 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-10T22:37:54.905 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:54.905 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.905 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.905 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.905 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.906 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_file": { 2024-09-10T22:37:54.906 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_file", 2024-09-10T22:37:54.906 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-10T22:37:54.906 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.906 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:54.906 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-10T22:37:54.906 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.906 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.906 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.906 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:54.906 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.906 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.906 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.907 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.907 INFO:teuthology.orchestra.run.smithi019.stdout: "sqlite3_killpoint": { 2024-09-10T22:37:54.907 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "sqlite3_killpoint", 2024-09-10T22:37:54.907 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "int", 2024-09-10T22:37:54.907 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "dev", 2024-09-10T22:37:54.907 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:54.907 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "0", 2024-09-10T22:37:54.907 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.907 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.907 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.907 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:54.907 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.907 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.908 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.908 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.908 INFO:teuthology.orchestra.run.smithi019.stdout: "zabbix_host": { 2024-09-10T22:37:54.908 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "zabbix_host", 2024-09-10T22:37:54.908 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-10T22:37:54.908 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.908 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-10T22:37:54.908 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-10T22:37:54.908 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.908 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.908 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.908 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:54.909 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.909 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.909 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.909 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.909 INFO:teuthology.orchestra.run.smithi019.stdout: "zabbix_port": { 2024-09-10T22:37:54.909 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "zabbix_port", 2024-09-10T22:37:54.909 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "int", 2024-09-10T22:37:54.909 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.909 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-10T22:37:54.909 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "10051", 2024-09-10T22:37:54.909 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.909 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.909 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.910 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:54.910 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.910 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.910 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.910 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.910 INFO:teuthology.orchestra.run.smithi019.stdout: "zabbix_sender": { 2024-09-10T22:37:54.910 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "zabbix_sender", 2024-09-10T22:37:54.910 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-10T22:37:54.910 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.910 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-10T22:37:54.910 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "/usr/bin/zabbix_sender", 2024-09-10T22:37:54.910 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.910 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.910 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.911 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:54.911 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.911 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.911 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.911 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-10T22:37:54.911 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-10T22:37:54.911 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-10T22:37:54.911 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-10T22:37:54.911 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-10T22:37:54.911 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-10T22:37:54.911 INFO:teuthology.orchestra.run.smithi019.stdout: "modules": [ 2024-09-10T22:37:54.911 INFO:teuthology.orchestra.run.smithi019.stdout: "cephadm", 2024-09-10T22:37:54.911 INFO:teuthology.orchestra.run.smithi019.stdout: "dashboard", 2024-09-10T22:37:54.911 INFO:teuthology.orchestra.run.smithi019.stdout: "iostat", 2024-09-10T22:37:54.912 INFO:teuthology.orchestra.run.smithi019.stdout: "nfs", 2024-09-10T22:37:54.912 INFO:teuthology.orchestra.run.smithi019.stdout: "restful" 2024-09-10T22:37:54.912 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-10T22:37:54.912 INFO:teuthology.orchestra.run.smithi019.stdout: "available_modules": [ 2024-09-10T22:37:54.912 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-10T22:37:54.912 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "alerts", 2024-09-10T22:37:54.912 INFO:teuthology.orchestra.run.smithi019.stdout: "can_run": true, 2024-09-10T22:37:54.912 INFO:teuthology.orchestra.run.smithi019.stdout: "error_string": "", 2024-09-10T22:37:54.912 INFO:teuthology.orchestra.run.smithi019.stdout: "module_options": { 2024-09-10T22:37:54.912 INFO:teuthology.orchestra.run.smithi019.stdout: "interval": { 2024-09-10T22:37:54.912 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "interval", 2024-09-10T22:37:54.912 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "secs", 2024-09-10T22:37:54.912 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.913 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:54.913 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "60", 2024-09-10T22:37:54.913 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.913 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.913 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.913 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "How frequently to reexamine health status", 2024-09-10T22:37:54.913 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.913 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.913 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.913 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.913 INFO:teuthology.orchestra.run.smithi019.stdout: "log_level": { 2024-09-10T22:37:54.913 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_level", 2024-09-10T22:37:54.913 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-10T22:37:54.914 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.914 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:54.914 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-10T22:37:54.914 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.914 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.914 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-10T22:37:54.914 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-10T22:37:54.914 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-10T22:37:54.914 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-10T22:37:54.914 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-10T22:37:54.914 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-10T22:37:54.914 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-10T22:37:54.914 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-10T22:37:54.915 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:54.915 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.915 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.915 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.915 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.915 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster": { 2024-09-10T22:37:54.915 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster", 2024-09-10T22:37:54.915 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-10T22:37:54.915 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.915 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:54.915 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-10T22:37:54.915 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.915 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.915 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.916 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:54.916 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.916 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.916 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.916 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.916 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster_level": { 2024-09-10T22:37:54.916 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster_level", 2024-09-10T22:37:54.916 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-10T22:37:54.916 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.916 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:54.916 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "info", 2024-09-10T22:37:54.916 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.916 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.917 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-10T22:37:54.917 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-10T22:37:54.917 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-10T22:37:54.917 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-10T22:37:54.917 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-10T22:37:54.917 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-10T22:37:54.917 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-10T22:37:54.917 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-10T22:37:54.917 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:54.917 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.917 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.917 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.917 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.918 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_file": { 2024-09-10T22:37:54.918 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_file", 2024-09-10T22:37:54.918 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-10T22:37:54.918 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.918 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:54.918 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-10T22:37:54.918 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.918 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.918 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.918 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:54.918 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.918 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.918 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.919 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.919 INFO:teuthology.orchestra.run.smithi019.stdout: "smtp_destination": { 2024-09-10T22:37:54.919 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "smtp_destination", 2024-09-10T22:37:54.919 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-10T22:37:54.919 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.919 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:54.919 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-10T22:37:54.919 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.919 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.919 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.919 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "Email address to send alerts to, use commas to separate multiple", 2024-09-10T22:37:54.919 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.919 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.920 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.920 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.920 INFO:teuthology.orchestra.run.smithi019.stdout: "smtp_from_name": { 2024-09-10T22:37:54.920 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "smtp_from_name", 2024-09-10T22:37:54.920 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-10T22:37:54.920 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.920 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:54.920 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "Ceph", 2024-09-10T22:37:54.920 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.920 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.920 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.920 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "Email From: name", 2024-09-10T22:37:54.920 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.921 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.921 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.921 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.921 INFO:teuthology.orchestra.run.smithi019.stdout: "smtp_host": { 2024-09-10T22:37:54.921 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "smtp_host", 2024-09-10T22:37:54.921 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-10T22:37:54.921 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.921 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:54.921 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-10T22:37:54.921 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.921 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.921 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.921 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "SMTP server", 2024-09-10T22:37:54.922 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.922 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.922 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.922 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.922 INFO:teuthology.orchestra.run.smithi019.stdout: "smtp_password": { 2024-09-10T22:37:54.922 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "smtp_password", 2024-09-10T22:37:54.922 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-10T22:37:54.922 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.922 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:54.922 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-10T22:37:54.922 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.922 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.922 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.923 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "Password to authenticate with", 2024-09-10T22:37:54.923 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.923 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.923 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.923 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.923 INFO:teuthology.orchestra.run.smithi019.stdout: "smtp_port": { 2024-09-10T22:37:54.923 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "smtp_port", 2024-09-10T22:37:54.923 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "int", 2024-09-10T22:37:54.923 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.923 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:54.923 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "465", 2024-09-10T22:37:54.923 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.923 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.923 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.924 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "SMTP port", 2024-09-10T22:37:54.924 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.924 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.924 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.924 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.924 INFO:teuthology.orchestra.run.smithi019.stdout: "smtp_sender": { 2024-09-10T22:37:54.924 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "smtp_sender", 2024-09-10T22:37:54.924 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-10T22:37:54.924 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.924 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:54.924 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-10T22:37:54.924 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.924 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.925 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.925 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "SMTP envelope sender", 2024-09-10T22:37:54.925 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.925 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.925 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.925 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.925 INFO:teuthology.orchestra.run.smithi019.stdout: "smtp_ssl": { 2024-09-10T22:37:54.925 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "smtp_ssl", 2024-09-10T22:37:54.925 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-10T22:37:54.925 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.925 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:54.925 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "True", 2024-09-10T22:37:54.925 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.926 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.926 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.926 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "Use SSL to connect to SMTP server", 2024-09-10T22:37:54.926 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.926 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.926 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.926 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.926 INFO:teuthology.orchestra.run.smithi019.stdout: "smtp_user": { 2024-09-10T22:37:54.926 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "smtp_user", 2024-09-10T22:37:54.926 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-10T22:37:54.926 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.926 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:54.926 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-10T22:37:54.926 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.927 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.927 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.927 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "User to authenticate as", 2024-09-10T22:37:54.927 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.927 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.927 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.927 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.927 INFO:teuthology.orchestra.run.smithi019.stdout: "sqlite3_killpoint": { 2024-09-10T22:37:54.927 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "sqlite3_killpoint", 2024-09-10T22:37:54.927 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "int", 2024-09-10T22:37:54.927 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "dev", 2024-09-10T22:37:54.927 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:54.927 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "0", 2024-09-10T22:37:54.928 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.928 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.928 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.928 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:54.928 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.928 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.928 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.928 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-10T22:37:54.928 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-10T22:37:54.928 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.928 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-10T22:37:54.928 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "balancer", 2024-09-10T22:37:54.928 INFO:teuthology.orchestra.run.smithi019.stdout: "can_run": true, 2024-09-10T22:37:54.929 INFO:teuthology.orchestra.run.smithi019.stdout: "error_string": "", 2024-09-10T22:37:54.929 INFO:teuthology.orchestra.run.smithi019.stdout: "module_options": { 2024-09-10T22:37:54.929 INFO:teuthology.orchestra.run.smithi019.stdout: "active": { 2024-09-10T22:37:54.929 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "active", 2024-09-10T22:37:54.929 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-10T22:37:54.929 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.929 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:54.929 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "True", 2024-09-10T22:37:54.929 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.929 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.929 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.929 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "automatically balance PGs across cluster", 2024-09-10T22:37:54.929 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.930 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.930 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.930 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.930 INFO:teuthology.orchestra.run.smithi019.stdout: "begin_time": { 2024-09-10T22:37:54.930 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "begin_time", 2024-09-10T22:37:54.930 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-10T22:37:54.930 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.930 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:54.930 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "0000", 2024-09-10T22:37:54.930 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.930 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.930 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.930 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "beginning time of day to automatically balance", 2024-09-10T22:37:54.931 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-10T22:37:54.931 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.931 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.931 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.931 INFO:teuthology.orchestra.run.smithi019.stdout: "begin_weekday": { 2024-09-10T22:37:54.931 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "begin_weekday", 2024-09-10T22:37:54.931 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "uint", 2024-09-10T22:37:54.931 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.931 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:54.931 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "0", 2024-09-10T22:37:54.931 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "0", 2024-09-10T22:37:54.931 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "6", 2024-09-10T22:37:54.931 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.931 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2024-09-10T22:37:54.932 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-10T22:37:54.932 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.932 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.932 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.932 INFO:teuthology.orchestra.run.smithi019.stdout: "crush_compat_max_iterations": { 2024-09-10T22:37:54.932 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "crush_compat_max_iterations", 2024-09-10T22:37:54.932 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "uint", 2024-09-10T22:37:54.932 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.932 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:54.932 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "25", 2024-09-10T22:37:54.932 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "1", 2024-09-10T22:37:54.932 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "250", 2024-09-10T22:37:54.932 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.933 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "maximum number of iterations to attempt optimization", 2024-09-10T22:37:54.933 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.933 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.933 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.933 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.933 INFO:teuthology.orchestra.run.smithi019.stdout: "crush_compat_metrics": { 2024-09-10T22:37:54.933 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "crush_compat_metrics", 2024-09-10T22:37:54.933 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-10T22:37:54.933 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.933 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:54.933 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "pgs,objects,bytes", 2024-09-10T22:37:54.933 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.933 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.933 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.934 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "metrics with which to calculate OSD utilization", 2024-09-10T22:37:54.934 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2024-09-10T22:37:54.934 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.934 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.934 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.934 INFO:teuthology.orchestra.run.smithi019.stdout: "crush_compat_step": { 2024-09-10T22:37:54.934 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "crush_compat_step", 2024-09-10T22:37:54.934 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "float", 2024-09-10T22:37:54.934 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.934 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:54.934 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "0.5", 2024-09-10T22:37:54.934 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "0.001", 2024-09-10T22:37:54.934 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "0.999", 2024-09-10T22:37:54.935 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.935 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "aggressiveness of optimization", 2024-09-10T22:37:54.935 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2024-09-10T22:37:54.935 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.935 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.935 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.935 INFO:teuthology.orchestra.run.smithi019.stdout: "end_time": { 2024-09-10T22:37:54.935 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "end_time", 2024-09-10T22:37:54.935 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-10T22:37:54.935 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.935 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:54.935 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "2359", 2024-09-10T22:37:54.935 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.935 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.936 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.936 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "ending time of day to automatically balance", 2024-09-10T22:37:54.936 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-10T22:37:54.936 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.936 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.936 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.936 INFO:teuthology.orchestra.run.smithi019.stdout: "end_weekday": { 2024-09-10T22:37:54.936 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "end_weekday", 2024-09-10T22:37:54.936 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "uint", 2024-09-10T22:37:54.936 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.936 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:54.936 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "0", 2024-09-10T22:37:54.937 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "0", 2024-09-10T22:37:54.937 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "6", 2024-09-10T22:37:54.937 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.937 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2024-09-10T22:37:54.937 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-10T22:37:54.937 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.937 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.937 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.937 INFO:teuthology.orchestra.run.smithi019.stdout: "log_level": { 2024-09-10T22:37:54.937 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_level", 2024-09-10T22:37:54.937 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-10T22:37:54.937 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.937 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:54.938 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-10T22:37:54.938 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.938 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.938 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-10T22:37:54.938 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-10T22:37:54.938 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-10T22:37:54.938 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-10T22:37:54.938 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-10T22:37:54.938 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-10T22:37:54.938 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-10T22:37:54.938 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-10T22:37:54.938 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:54.938 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.939 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.939 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.939 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.939 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster": { 2024-09-10T22:37:54.939 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster", 2024-09-10T22:37:54.939 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-10T22:37:54.939 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.939 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:54.939 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-10T22:37:54.939 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.939 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.939 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.939 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:54.940 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.940 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.940 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.940 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.940 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster_level": { 2024-09-10T22:37:54.940 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster_level", 2024-09-10T22:37:54.940 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-10T22:37:54.940 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.940 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:54.940 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "info", 2024-09-10T22:37:54.940 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.940 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.940 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-10T22:37:54.941 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-10T22:37:54.941 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-10T22:37:54.941 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-10T22:37:54.941 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-10T22:37:54.941 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-10T22:37:54.941 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-10T22:37:54.941 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-10T22:37:54.941 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:54.941 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.941 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.941 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.941 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.941 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_file": { 2024-09-10T22:37:54.942 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_file", 2024-09-10T22:37:54.942 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-10T22:37:54.942 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.942 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:54.942 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-10T22:37:54.942 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.942 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.942 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.942 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:54.942 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.942 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.942 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.942 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.943 INFO:teuthology.orchestra.run.smithi019.stdout: "min_score": { 2024-09-10T22:37:54.943 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "min_score", 2024-09-10T22:37:54.943 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "float", 2024-09-10T22:37:54.943 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.943 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:54.943 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "0", 2024-09-10T22:37:54.943 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.943 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.943 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.943 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "minimum score, below which no optimization is attempted", 2024-09-10T22:37:54.943 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.943 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.943 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.944 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.944 INFO:teuthology.orchestra.run.smithi019.stdout: "mode": { 2024-09-10T22:37:54.944 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "mode", 2024-09-10T22:37:54.944 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-10T22:37:54.944 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.944 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:54.944 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "upmap", 2024-09-10T22:37:54.944 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.944 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.944 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-10T22:37:54.944 INFO:teuthology.orchestra.run.smithi019.stdout: "crush-compat", 2024-09-10T22:37:54.944 INFO:teuthology.orchestra.run.smithi019.stdout: "none", 2024-09-10T22:37:54.944 INFO:teuthology.orchestra.run.smithi019.stdout: "read", 2024-09-10T22:37:54.945 INFO:teuthology.orchestra.run.smithi019.stdout: "upmap", 2024-09-10T22:37:54.945 INFO:teuthology.orchestra.run.smithi019.stdout: "upmap-read" 2024-09-10T22:37:54.945 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-10T22:37:54.945 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "Balancer mode", 2024-09-10T22:37:54.945 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.945 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.945 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.945 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.945 INFO:teuthology.orchestra.run.smithi019.stdout: "pool_ids": { 2024-09-10T22:37:54.945 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "pool_ids", 2024-09-10T22:37:54.945 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-10T22:37:54.945 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.945 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:54.945 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-10T22:37:54.946 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.946 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.946 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.946 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "pools which the automatic balancing will be limited to", 2024-09-10T22:37:54.946 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.946 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.946 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.946 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.946 INFO:teuthology.orchestra.run.smithi019.stdout: "sleep_interval": { 2024-09-10T22:37:54.946 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "sleep_interval", 2024-09-10T22:37:54.946 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "secs", 2024-09-10T22:37:54.946 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.946 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:54.947 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "60", 2024-09-10T22:37:54.947 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.947 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.947 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.947 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "how frequently to wake up and attempt optimization", 2024-09-10T22:37:54.947 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.947 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.947 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.947 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.947 INFO:teuthology.orchestra.run.smithi019.stdout: "sqlite3_killpoint": { 2024-09-10T22:37:54.947 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "sqlite3_killpoint", 2024-09-10T22:37:54.947 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "int", 2024-09-10T22:37:54.947 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "dev", 2024-09-10T22:37:54.948 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:54.948 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "0", 2024-09-10T22:37:54.948 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.948 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.948 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.948 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:54.948 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.948 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.948 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.948 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.948 INFO:teuthology.orchestra.run.smithi019.stdout: "upmap_max_deviation": { 2024-09-10T22:37:54.948 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "upmap_max_deviation", 2024-09-10T22:37:54.948 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "int", 2024-09-10T22:37:54.949 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.949 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:54.949 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "5", 2024-09-10T22:37:54.949 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "1", 2024-09-10T22:37:54.949 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.949 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.949 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "deviation below which no optimization is attempted", 2024-09-10T22:37:54.949 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2024-09-10T22:37:54.949 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.949 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.949 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.949 INFO:teuthology.orchestra.run.smithi019.stdout: "upmap_max_optimizations": { 2024-09-10T22:37:54.949 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "upmap_max_optimizations", 2024-09-10T22:37:54.949 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "uint", 2024-09-10T22:37:54.950 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.950 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:54.950 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "10", 2024-09-10T22:37:54.950 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.950 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.950 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.950 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "maximum upmap optimizations to make per attempt", 2024-09-10T22:37:54.950 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.950 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.950 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.950 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-10T22:37:54.950 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-10T22:37:54.950 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.951 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-10T22:37:54.951 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "cephadm", 2024-09-10T22:37:54.951 INFO:teuthology.orchestra.run.smithi019.stdout: "can_run": true, 2024-09-10T22:37:54.951 INFO:teuthology.orchestra.run.smithi019.stdout: "error_string": "", 2024-09-10T22:37:54.951 INFO:teuthology.orchestra.run.smithi019.stdout: "module_options": { 2024-09-10T22:37:54.951 INFO:teuthology.orchestra.run.smithi019.stdout: "agent_down_multiplier": { 2024-09-10T22:37:54.951 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "agent_down_multiplier", 2024-09-10T22:37:54.951 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "float", 2024-09-10T22:37:54.951 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.951 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-10T22:37:54.951 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "3.0", 2024-09-10T22:37:54.951 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.951 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.952 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.952 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2024-09-10T22:37:54.952 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.952 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.952 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.952 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.952 INFO:teuthology.orchestra.run.smithi019.stdout: "agent_refresh_rate": { 2024-09-10T22:37:54.952 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "agent_refresh_rate", 2024-09-10T22:37:54.952 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "secs", 2024-09-10T22:37:54.952 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.952 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-10T22:37:54.952 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "20", 2024-09-10T22:37:54.952 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.952 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.953 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.953 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2024-09-10T22:37:54.953 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.953 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.953 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.953 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.953 INFO:teuthology.orchestra.run.smithi019.stdout: "agent_starting_port": { 2024-09-10T22:37:54.953 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "agent_starting_port", 2024-09-10T22:37:54.953 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "int", 2024-09-10T22:37:54.953 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.953 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-10T22:37:54.953 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "4721", 2024-09-10T22:37:54.953 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.954 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.954 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.954 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2024-09-10T22:37:54.954 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.954 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.954 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.954 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.954 INFO:teuthology.orchestra.run.smithi019.stdout: "allow_ptrace": { 2024-09-10T22:37:54.954 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "allow_ptrace", 2024-09-10T22:37:54.954 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-10T22:37:54.954 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.954 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-10T22:37:54.955 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-10T22:37:54.955 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.955 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.955 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.955 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2024-09-10T22:37:54.955 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2024-09-10T22:37:54.955 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.955 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.955 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.955 INFO:teuthology.orchestra.run.smithi019.stdout: "autotune_interval": { 2024-09-10T22:37:54.955 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "autotune_interval", 2024-09-10T22:37:54.955 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "secs", 2024-09-10T22:37:54.955 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.955 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-10T22:37:54.956 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "600", 2024-09-10T22:37:54.956 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.956 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.956 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.956 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "how frequently to autotune daemon memory", 2024-09-10T22:37:54.956 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.956 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.956 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.956 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.956 INFO:teuthology.orchestra.run.smithi019.stdout: "autotune_memory_target_ratio": { 2024-09-10T22:37:54.956 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "autotune_memory_target_ratio", 2024-09-10T22:37:54.956 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "float", 2024-09-10T22:37:54.956 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.957 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-10T22:37:54.957 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "0.7", 2024-09-10T22:37:54.957 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.957 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.957 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.957 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2024-09-10T22:37:54.957 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.957 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.957 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.957 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.957 INFO:teuthology.orchestra.run.smithi019.stdout: "cephadm_log_destination": { 2024-09-10T22:37:54.957 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "cephadm_log_destination", 2024-09-10T22:37:54.957 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-10T22:37:54.958 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.958 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-10T22:37:54.958 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-10T22:37:54.958 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.958 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.958 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-10T22:37:54.958 INFO:teuthology.orchestra.run.smithi019.stdout: "file", 2024-09-10T22:37:54.958 INFO:teuthology.orchestra.run.smithi019.stdout: "file,syslog", 2024-09-10T22:37:54.958 INFO:teuthology.orchestra.run.smithi019.stdout: "syslog" 2024-09-10T22:37:54.958 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-10T22:37:54.958 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "Destination for cephadm command's persistent logging", 2024-09-10T22:37:54.958 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.958 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.959 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.959 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.959 INFO:teuthology.orchestra.run.smithi019.stdout: "cgroups_split": { 2024-09-10T22:37:54.959 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "cgroups_split", 2024-09-10T22:37:54.959 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-10T22:37:54.959 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.959 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-10T22:37:54.959 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "True", 2024-09-10T22:37:54.959 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.959 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.959 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.959 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2024-09-10T22:37:54.959 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.960 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.960 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.960 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.960 INFO:teuthology.orchestra.run.smithi019.stdout: "config_checks_enabled": { 2024-09-10T22:37:54.960 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "config_checks_enabled", 2024-09-10T22:37:54.960 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-10T22:37:54.960 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.960 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-10T22:37:54.960 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-10T22:37:54.960 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.960 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.960 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.960 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2024-09-10T22:37:54.961 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.961 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.961 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.961 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.961 INFO:teuthology.orchestra.run.smithi019.stdout: "config_dashboard": { 2024-09-10T22:37:54.961 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "config_dashboard", 2024-09-10T22:37:54.961 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-10T22:37:54.961 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.961 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-10T22:37:54.961 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "True", 2024-09-10T22:37:54.961 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.961 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.961 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.962 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2024-09-10T22:37:54.962 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.962 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.962 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.962 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.962 INFO:teuthology.orchestra.run.smithi019.stdout: "container_image_alertmanager": { 2024-09-10T22:37:54.962 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "container_image_alertmanager", 2024-09-10T22:37:54.962 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-10T22:37:54.962 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.962 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-10T22:37:54.962 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.27.0", 2024-09-10T22:37:54.962 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.962 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.962 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.963 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "Prometheus container image", 2024-09-10T22:37:54.963 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.963 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.963 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.963 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.963 INFO:teuthology.orchestra.run.smithi019.stdout: "container_image_base": { 2024-09-10T22:37:54.963 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "container_image_base", 2024-09-10T22:37:54.963 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-10T22:37:54.963 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.963 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:54.963 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "quay.io/ceph/ceph", 2024-09-10T22:37:54.963 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.963 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.964 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.964 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "Container image name, without the tag", 2024-09-10T22:37:54.964 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.964 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.964 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.964 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.964 INFO:teuthology.orchestra.run.smithi019.stdout: "container_image_elasticsearch": { 2024-09-10T22:37:54.964 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "container_image_elasticsearch", 2024-09-10T22:37:54.964 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-10T22:37:54.964 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.964 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-10T22:37:54.964 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2024-09-10T22:37:54.964 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.964 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.965 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.965 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "elasticsearch container image", 2024-09-10T22:37:54.965 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.965 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.965 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.965 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.965 INFO:teuthology.orchestra.run.smithi019.stdout: "container_image_grafana": { 2024-09-10T22:37:54.965 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "container_image_grafana", 2024-09-10T22:37:54.965 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-10T22:37:54.965 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.965 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-10T22:37:54.965 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "quay.io/ceph/grafana:10.4.0", 2024-09-10T22:37:54.965 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.966 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.966 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.966 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "Prometheus container image", 2024-09-10T22:37:54.966 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.966 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.966 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.966 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.966 INFO:teuthology.orchestra.run.smithi019.stdout: "container_image_haproxy": { 2024-09-10T22:37:54.966 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "container_image_haproxy", 2024-09-10T22:37:54.966 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-10T22:37:54.966 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.966 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-10T22:37:54.966 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2024-09-10T22:37:54.967 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.967 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.967 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.967 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "HAproxy container image", 2024-09-10T22:37:54.967 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.967 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.967 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.967 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.967 INFO:teuthology.orchestra.run.smithi019.stdout: "container_image_jaeger_agent": { 2024-09-10T22:37:54.967 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "container_image_jaeger_agent", 2024-09-10T22:37:54.967 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-10T22:37:54.967 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.967 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-10T22:37:54.968 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2024-09-10T22:37:54.968 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.968 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.968 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.968 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "Jaeger agent container image", 2024-09-10T22:37:54.968 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.968 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.968 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.968 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.968 INFO:teuthology.orchestra.run.smithi019.stdout: "container_image_jaeger_collector": { 2024-09-10T22:37:54.968 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "container_image_jaeger_collector", 2024-09-10T22:37:54.968 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-10T22:37:54.969 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.969 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-10T22:37:54.969 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2024-09-10T22:37:54.969 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.969 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.969 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.969 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "Jaeger collector container image", 2024-09-10T22:37:54.969 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.969 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.969 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.969 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.969 INFO:teuthology.orchestra.run.smithi019.stdout: "container_image_jaeger_query": { 2024-09-10T22:37:54.969 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "container_image_jaeger_query", 2024-09-10T22:37:54.969 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-10T22:37:54.970 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.970 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-10T22:37:54.970 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2024-09-10T22:37:54.970 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.970 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.970 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.970 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "Jaeger query container image", 2024-09-10T22:37:54.970 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.970 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.970 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.970 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.970 INFO:teuthology.orchestra.run.smithi019.stdout: "container_image_keepalived": { 2024-09-10T22:37:54.970 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "container_image_keepalived", 2024-09-10T22:37:54.971 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-10T22:37:54.971 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.971 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-10T22:37:54.971 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2024-09-10T22:37:54.971 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.971 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.971 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.971 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "Keepalived container image", 2024-09-10T22:37:54.971 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.971 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.971 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.971 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.971 INFO:teuthology.orchestra.run.smithi019.stdout: "container_image_loki": { 2024-09-10T22:37:54.972 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "container_image_loki", 2024-09-10T22:37:54.972 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-10T22:37:54.972 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.972 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-10T22:37:54.972 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "docker.io/grafana/loki:3.0.0", 2024-09-10T22:37:54.972 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.972 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.972 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.972 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "Loki container image", 2024-09-10T22:37:54.972 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.972 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.972 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.972 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.973 INFO:teuthology.orchestra.run.smithi019.stdout: "container_image_nginx": { 2024-09-10T22:37:54.973 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "container_image_nginx", 2024-09-10T22:37:54.973 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-10T22:37:54.973 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.973 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-10T22:37:54.973 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "quay.io/ceph/nginx:1.26.1", 2024-09-10T22:37:54.973 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.973 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.973 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.973 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "Nginx container image", 2024-09-10T22:37:54.973 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.973 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.973 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.974 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.974 INFO:teuthology.orchestra.run.smithi019.stdout: "container_image_node_exporter": { 2024-09-10T22:37:54.974 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "container_image_node_exporter", 2024-09-10T22:37:54.974 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-10T22:37:54.974 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.974 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-10T22:37:54.974 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.7.0", 2024-09-10T22:37:54.974 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.974 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.974 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.974 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "Prometheus container image", 2024-09-10T22:37:54.974 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.974 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.974 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.975 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.975 INFO:teuthology.orchestra.run.smithi019.stdout: "container_image_nvmeof": { 2024-09-10T22:37:54.975 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "container_image_nvmeof", 2024-09-10T22:37:54.975 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-10T22:37:54.975 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.975 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-10T22:37:54.975 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "quay.io/ceph/nvmeof:1.2.17", 2024-09-10T22:37:54.975 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.975 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.975 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.975 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "Nvme-of container image", 2024-09-10T22:37:54.975 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.975 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.976 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.976 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.976 INFO:teuthology.orchestra.run.smithi019.stdout: "container_image_oauth2_proxy": { 2024-09-10T22:37:54.976 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "container_image_oauth2_proxy", 2024-09-10T22:37:54.976 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-10T22:37:54.976 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.976 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-10T22:37:54.976 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "quay.io/oauth2-proxy/oauth2-proxy:v7.6.0", 2024-09-10T22:37:54.976 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.976 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.976 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.976 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "oauth2-proxy container image", 2024-09-10T22:37:54.976 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.976 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.977 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.977 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.977 INFO:teuthology.orchestra.run.smithi019.stdout: "container_image_prometheus": { 2024-09-10T22:37:54.977 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "container_image_prometheus", 2024-09-10T22:37:54.977 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-10T22:37:54.977 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.977 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-10T22:37:54.977 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "quay.io/prometheus/prometheus:v2.51.0", 2024-09-10T22:37:54.977 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.977 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.977 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.977 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "Prometheus container image", 2024-09-10T22:37:54.977 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.978 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.978 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.978 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.978 INFO:teuthology.orchestra.run.smithi019.stdout: "container_image_promtail": { 2024-09-10T22:37:54.978 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "container_image_promtail", 2024-09-10T22:37:54.978 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-10T22:37:54.978 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.978 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-10T22:37:54.978 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "docker.io/grafana/promtail:3.0.0", 2024-09-10T22:37:54.978 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.978 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.978 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.978 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "Promtail container image", 2024-09-10T22:37:54.978 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.979 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.979 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.979 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.979 INFO:teuthology.orchestra.run.smithi019.stdout: "container_image_samba": { 2024-09-10T22:37:54.979 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "container_image_samba", 2024-09-10T22:37:54.979 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-10T22:37:54.979 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.979 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-10T22:37:54.979 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "quay.io/samba.org/samba-server:devbuilds-centos-amd64", 2024-09-10T22:37:54.979 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.979 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.979 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.979 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "Samba/SMB container image", 2024-09-10T22:37:54.980 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.980 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.980 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.980 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.980 INFO:teuthology.orchestra.run.smithi019.stdout: "container_image_samba_metrics": { 2024-09-10T22:37:54.980 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "container_image_samba_metrics", 2024-09-10T22:37:54.980 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-10T22:37:54.980 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.980 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-10T22:37:54.980 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "quay.io/samba.org/samba-metrics:latest", 2024-09-10T22:37:54.980 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.980 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.980 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.981 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "Samba/SMB metrics exporter container image", 2024-09-10T22:37:54.981 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.981 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.981 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.981 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.981 INFO:teuthology.orchestra.run.smithi019.stdout: "container_image_snmp_gateway": { 2024-09-10T22:37:54.981 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "container_image_snmp_gateway", 2024-09-10T22:37:54.981 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-10T22:37:54.981 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.981 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-10T22:37:54.981 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2024-09-10T22:37:54.981 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.981 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.981 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.982 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "SNMP Gateway container image", 2024-09-10T22:37:54.982 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.982 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.982 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.982 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.982 INFO:teuthology.orchestra.run.smithi019.stdout: "container_init": { 2024-09-10T22:37:54.982 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "container_init", 2024-09-10T22:37:54.982 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-10T22:37:54.982 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.982 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-10T22:37:54.982 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "True", 2024-09-10T22:37:54.982 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.982 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.983 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.983 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "Run podman/docker with `--init`", 2024-09-10T22:37:54.983 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.983 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.983 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.983 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.983 INFO:teuthology.orchestra.run.smithi019.stdout: "daemon_cache_timeout": { 2024-09-10T22:37:54.983 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "daemon_cache_timeout", 2024-09-10T22:37:54.983 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "secs", 2024-09-10T22:37:54.983 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.984 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-10T22:37:54.984 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "600", 2024-09-10T22:37:54.984 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.984 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.984 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.984 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "seconds to cache service (daemon) inventory", 2024-09-10T22:37:54.984 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.984 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.984 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.984 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.984 INFO:teuthology.orchestra.run.smithi019.stdout: "default_cephadm_command_timeout": { 2024-09-10T22:37:54.984 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "default_cephadm_command_timeout", 2024-09-10T22:37:54.984 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "int", 2024-09-10T22:37:54.985 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.985 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-10T22:37:54.985 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "900", 2024-09-10T22:37:54.985 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.985 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.985 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.985 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2024-09-10T22:37:54.985 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.985 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.985 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.985 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.985 INFO:teuthology.orchestra.run.smithi019.stdout: "default_registry": { 2024-09-10T22:37:54.985 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "default_registry", 2024-09-10T22:37:54.986 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-10T22:37:54.986 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.986 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-10T22:37:54.986 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "docker.io", 2024-09-10T22:37:54.986 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.986 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.986 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.986 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2024-09-10T22:37:54.986 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.986 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.986 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.986 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.987 INFO:teuthology.orchestra.run.smithi019.stdout: "device_cache_timeout": { 2024-09-10T22:37:54.987 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "device_cache_timeout", 2024-09-10T22:37:54.987 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "secs", 2024-09-10T22:37:54.987 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.987 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-10T22:37:54.987 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "1800", 2024-09-10T22:37:54.987 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.987 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.987 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.987 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "seconds to cache device inventory", 2024-09-10T22:37:54.987 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.987 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.987 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.988 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.988 INFO:teuthology.orchestra.run.smithi019.stdout: "device_enhanced_scan": { 2024-09-10T22:37:54.988 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "device_enhanced_scan", 2024-09-10T22:37:54.988 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-10T22:37:54.988 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.988 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-10T22:37:54.988 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-10T22:37:54.988 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.988 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.988 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.988 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "Use libstoragemgmt during device scans", 2024-09-10T22:37:54.988 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.988 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.989 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.989 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.989 INFO:teuthology.orchestra.run.smithi019.stdout: "facts_cache_timeout": { 2024-09-10T22:37:54.989 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "facts_cache_timeout", 2024-09-10T22:37:54.989 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "secs", 2024-09-10T22:37:54.989 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.989 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-10T22:37:54.989 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "60", 2024-09-10T22:37:54.989 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.989 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.989 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.989 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "seconds to cache host facts data", 2024-09-10T22:37:54.989 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.990 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.990 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.990 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.990 INFO:teuthology.orchestra.run.smithi019.stdout: "grafana_dashboards_path": { 2024-09-10T22:37:54.990 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "grafana_dashboards_path", 2024-09-10T22:37:54.990 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-10T22:37:54.990 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.990 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-10T22:37:54.990 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "/etc/grafana/dashboards/ceph-dashboard/", 2024-09-10T22:37:54.990 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.990 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.990 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.990 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "location of dashboards to include in grafana deployments", 2024-09-10T22:37:54.991 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.991 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.991 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.991 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.991 INFO:teuthology.orchestra.run.smithi019.stdout: "host_check_interval": { 2024-09-10T22:37:54.991 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "host_check_interval", 2024-09-10T22:37:54.991 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "secs", 2024-09-10T22:37:54.991 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.991 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-10T22:37:54.991 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "600", 2024-09-10T22:37:54.991 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.991 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.991 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.992 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "how frequently to perform a host check", 2024-09-10T22:37:54.992 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.992 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.992 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.992 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.992 INFO:teuthology.orchestra.run.smithi019.stdout: "hw_monitoring": { 2024-09-10T22:37:54.992 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "hw_monitoring", 2024-09-10T22:37:54.992 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-10T22:37:54.992 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.992 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-10T22:37:54.992 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-10T22:37:54.992 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.992 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.993 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.993 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "Deploy hw monitoring daemon on every host.", 2024-09-10T22:37:54.993 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.993 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.993 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.993 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.993 INFO:teuthology.orchestra.run.smithi019.stdout: "inventory_list_all": { 2024-09-10T22:37:54.993 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "inventory_list_all", 2024-09-10T22:37:54.993 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-10T22:37:54.993 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.993 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-10T22:37:54.993 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-10T22:37:54.993 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.994 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.994 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.994 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2024-09-10T22:37:54.994 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.994 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.994 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.994 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.994 INFO:teuthology.orchestra.run.smithi019.stdout: "log_level": { 2024-09-10T22:37:54.994 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_level", 2024-09-10T22:37:54.994 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-10T22:37:54.994 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.994 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:54.994 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-10T22:37:54.995 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.995 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.995 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-10T22:37:54.995 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-10T22:37:54.995 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-10T22:37:54.995 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-10T22:37:54.995 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-10T22:37:54.995 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-10T22:37:54.995 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-10T22:37:54.995 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-10T22:37:54.995 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:54.995 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.995 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.996 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.996 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.996 INFO:teuthology.orchestra.run.smithi019.stdout: "log_refresh_metadata": { 2024-09-10T22:37:54.996 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_refresh_metadata", 2024-09-10T22:37:54.996 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-10T22:37:54.996 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.996 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-10T22:37:54.996 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-10T22:37:54.996 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.996 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.996 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.996 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2024-09-10T22:37:54.996 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.996 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.997 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.997 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.997 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster": { 2024-09-10T22:37:54.997 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster", 2024-09-10T22:37:54.997 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-10T22:37:54.997 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.997 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-10T22:37:54.997 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "True", 2024-09-10T22:37:54.997 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.997 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.997 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:54.997 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2024-09-10T22:37:54.997 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.998 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.998 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.998 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.998 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster_level": { 2024-09-10T22:37:54.998 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster_level", 2024-09-10T22:37:54.998 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-10T22:37:54.998 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:54.998 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:54.998 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "info", 2024-09-10T22:37:54.998 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:54.998 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:54.998 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-10T22:37:54.998 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-10T22:37:54.999 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-10T22:37:54.999 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-10T22:37:54.999 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-10T22:37:54.999 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-10T22:37:54.999 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-10T22:37:54.999 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-10T22:37:54.999 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:54.999 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:54.999 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:54.999 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:54.999 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:54.999 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_file": { 2024-09-10T22:37:54.999 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_file", 2024-09-10T22:37:55.000 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-10T22:37:55.000 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:55.000 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:55.000 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-10T22:37:55.000 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:55.000 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:55.000 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:55.000 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:55.000 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:55.000 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:55.000 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:55.000 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:55.000 INFO:teuthology.orchestra.run.smithi019.stdout: "manage_etc_ceph_ceph_conf": { 2024-09-10T22:37:55.001 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "manage_etc_ceph_ceph_conf", 2024-09-10T22:37:55.001 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-10T22:37:55.001 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:55.001 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-10T22:37:55.001 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-10T22:37:55.001 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:55.001 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:55.001 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:55.001 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2024-09-10T22:37:55.001 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:55.001 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:55.001 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:55.001 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:55.002 INFO:teuthology.orchestra.run.smithi019.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2024-09-10T22:37:55.002 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2024-09-10T22:37:55.002 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-10T22:37:55.002 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:55.002 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-10T22:37:55.002 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "*", 2024-09-10T22:37:55.002 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:55.002 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:55.002 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:55.002 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2024-09-10T22:37:55.002 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:55.002 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:55.002 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:55.003 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:55.003 INFO:teuthology.orchestra.run.smithi019.stdout: "max_count_per_host": { 2024-09-10T22:37:55.003 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "max_count_per_host", 2024-09-10T22:37:55.003 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "int", 2024-09-10T22:37:55.003 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:55.003 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-10T22:37:55.003 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "10", 2024-09-10T22:37:55.003 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:55.003 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:55.003 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:55.003 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "max number of daemons per service per host", 2024-09-10T22:37:55.003 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:55.003 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:55.003 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:55.004 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:55.004 INFO:teuthology.orchestra.run.smithi019.stdout: "max_osd_draining_count": { 2024-09-10T22:37:55.004 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "max_osd_draining_count", 2024-09-10T22:37:55.004 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "int", 2024-09-10T22:37:55.004 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:55.004 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-10T22:37:55.004 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "10", 2024-09-10T22:37:55.004 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:55.004 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:55.004 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:55.004 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2024-09-10T22:37:55.004 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:55.004 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:55.005 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:55.005 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:55.005 INFO:teuthology.orchestra.run.smithi019.stdout: "migration_current": { 2024-09-10T22:37:55.005 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "migration_current", 2024-09-10T22:37:55.005 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "int", 2024-09-10T22:37:55.005 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:55.005 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-10T22:37:55.005 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-10T22:37:55.005 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:55.005 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:55.005 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:55.005 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "internal - do not modify", 2024-09-10T22:37:55.005 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:55.006 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:55.006 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:55.006 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:55.006 INFO:teuthology.orchestra.run.smithi019.stdout: "mode": { 2024-09-10T22:37:55.006 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "mode", 2024-09-10T22:37:55.006 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-10T22:37:55.006 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:55.006 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-10T22:37:55.006 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "root", 2024-09-10T22:37:55.006 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:55.006 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:55.006 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-10T22:37:55.007 INFO:teuthology.orchestra.run.smithi019.stdout: "cephadm-package", 2024-09-10T22:37:55.007 INFO:teuthology.orchestra.run.smithi019.stdout: "root" 2024-09-10T22:37:55.007 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-10T22:37:55.007 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "mode for remote execution of cephadm", 2024-09-10T22:37:55.007 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:55.007 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:55.007 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:55.007 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:55.007 INFO:teuthology.orchestra.run.smithi019.stdout: "oob_default_addr": { 2024-09-10T22:37:55.007 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "oob_default_addr", 2024-09-10T22:37:55.007 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-10T22:37:55.007 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:55.008 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-10T22:37:55.008 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "169.254.1.1", 2024-09-10T22:37:55.008 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:55.008 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:55.008 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:55.008 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "Default address for RedFish API (oob management).", 2024-09-10T22:37:55.008 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:55.008 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:55.008 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:55.008 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:55.008 INFO:teuthology.orchestra.run.smithi019.stdout: "prometheus_alerts_path": { 2024-09-10T22:37:55.008 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "prometheus_alerts_path", 2024-09-10T22:37:55.008 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-10T22:37:55.009 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:55.009 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-10T22:37:55.009 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2024-09-10T22:37:55.009 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:55.009 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:55.009 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:55.009 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "location of alerts to include in prometheus deployments", 2024-09-10T22:37:55.009 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:55.009 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:55.009 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:55.009 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:55.009 INFO:teuthology.orchestra.run.smithi019.stdout: "registry_insecure": { 2024-09-10T22:37:55.009 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "registry_insecure", 2024-09-10T22:37:55.009 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-10T22:37:55.010 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:55.010 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-10T22:37:55.010 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-10T22:37:55.010 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:55.010 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:55.010 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:55.010 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2024-09-10T22:37:55.010 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:55.010 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:55.010 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:55.010 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:55.010 INFO:teuthology.orchestra.run.smithi019.stdout: "registry_password": { 2024-09-10T22:37:55.010 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "registry_password", 2024-09-10T22:37:55.011 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-10T22:37:55.011 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:55.011 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-10T22:37:55.011 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-10T22:37:55.011 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:55.011 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:55.011 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:55.011 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2024-09-10T22:37:55.011 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:55.011 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:55.011 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:55.011 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:55.011 INFO:teuthology.orchestra.run.smithi019.stdout: "registry_url": { 2024-09-10T22:37:55.011 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "registry_url", 2024-09-10T22:37:55.012 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-10T22:37:55.012 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:55.012 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-10T22:37:55.012 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-10T22:37:55.012 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:55.012 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:55.012 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:55.012 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2024-09-10T22:37:55.012 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:55.012 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:55.012 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:55.012 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:55.012 INFO:teuthology.orchestra.run.smithi019.stdout: "registry_username": { 2024-09-10T22:37:55.013 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "registry_username", 2024-09-10T22:37:55.013 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-10T22:37:55.013 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:55.013 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-10T22:37:55.013 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-10T22:37:55.013 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:55.013 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:55.013 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:55.013 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2024-09-10T22:37:55.013 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:55.013 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:55.013 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:55.013 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:55.014 INFO:teuthology.orchestra.run.smithi019.stdout: "secure_monitoring_stack": { 2024-09-10T22:37:55.014 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "secure_monitoring_stack", 2024-09-10T22:37:55.014 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-10T22:37:55.014 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:55.014 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-10T22:37:55.014 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-10T22:37:55.014 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:55.014 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:55.014 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:55.014 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2024-09-10T22:37:55.014 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:55.014 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:55.014 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:55.015 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:55.015 INFO:teuthology.orchestra.run.smithi019.stdout: "service_discovery_port": { 2024-09-10T22:37:55.015 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "service_discovery_port", 2024-09-10T22:37:55.015 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "int", 2024-09-10T22:37:55.015 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:55.015 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-10T22:37:55.015 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "8765", 2024-09-10T22:37:55.015 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:55.015 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:55.015 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:55.015 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "cephadm service discovery port", 2024-09-10T22:37:55.015 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:55.015 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:55.016 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:55.016 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:55.016 INFO:teuthology.orchestra.run.smithi019.stdout: "sqlite3_killpoint": { 2024-09-10T22:37:55.016 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "sqlite3_killpoint", 2024-09-10T22:37:55.016 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "int", 2024-09-10T22:37:55.016 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "dev", 2024-09-10T22:37:55.016 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:55.016 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "0", 2024-09-10T22:37:55.016 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:55.016 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:55.016 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:55.016 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:55.016 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:55.017 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:55.017 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:55.017 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:55.017 INFO:teuthology.orchestra.run.smithi019.stdout: "ssh_config_file": { 2024-09-10T22:37:55.017 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "ssh_config_file", 2024-09-10T22:37:55.017 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-10T22:37:55.017 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:55.017 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-10T22:37:55.017 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-10T22:37:55.017 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:55.017 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:55.017 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:55.017 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "customized SSH config file to connect to managed hosts", 2024-09-10T22:37:55.017 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:55.018 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:55.018 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:55.018 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:55.018 INFO:teuthology.orchestra.run.smithi019.stdout: "use_agent": { 2024-09-10T22:37:55.018 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "use_agent", 2024-09-10T22:37:55.018 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-10T22:37:55.018 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:55.018 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-10T22:37:55.018 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-10T22:37:55.018 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:55.018 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:55.018 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:55.018 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2024-09-10T22:37:55.019 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:55.019 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:55.019 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:55.019 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:55.019 INFO:teuthology.orchestra.run.smithi019.stdout: "use_repo_digest": { 2024-09-10T22:37:55.019 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "use_repo_digest", 2024-09-10T22:37:55.019 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-10T22:37:55.019 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:55.019 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-10T22:37:55.019 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "True", 2024-09-10T22:37:55.019 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:55.019 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:55.019 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:55.019 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2024-09-10T22:37:55.020 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:55.020 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:55.020 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:55.020 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:55.020 INFO:teuthology.orchestra.run.smithi019.stdout: "warn_on_failed_host_check": { 2024-09-10T22:37:55.020 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "warn_on_failed_host_check", 2024-09-10T22:37:55.020 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-10T22:37:55.020 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:55.020 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-10T22:37:55.020 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "True", 2024-09-10T22:37:55.020 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:55.020 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:55.020 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:55.021 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "raise a health warning if the host check fails", 2024-09-10T22:37:55.021 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:55.021 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:55.021 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:55.021 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:55.021 INFO:teuthology.orchestra.run.smithi019.stdout: "warn_on_stray_daemons": { 2024-09-10T22:37:55.021 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "warn_on_stray_daemons", 2024-09-10T22:37:55.021 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-10T22:37:55.021 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:55.021 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-10T22:37:55.021 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "True", 2024-09-10T22:37:55.021 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:55.021 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:55.022 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:55.022 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2024-09-10T22:37:55.022 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:55.022 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:55.022 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:55.022 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:55.022 INFO:teuthology.orchestra.run.smithi019.stdout: "warn_on_stray_hosts": { 2024-09-10T22:37:55.022 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "warn_on_stray_hosts", 2024-09-10T22:37:55.022 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-10T22:37:55.022 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:55.022 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-10T22:37:55.022 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "True", 2024-09-10T22:37:55.022 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:55.023 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:55.023 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:55.023 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2024-09-10T22:37:55.023 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:55.023 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:55.023 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:55.023 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-10T22:37:55.023 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-10T22:37:55.023 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:55.023 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-10T22:37:55.023 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "crash", 2024-09-10T22:37:55.023 INFO:teuthology.orchestra.run.smithi019.stdout: "can_run": true, 2024-09-10T22:37:55.023 INFO:teuthology.orchestra.run.smithi019.stdout: "error_string": "", 2024-09-10T22:37:55.023 INFO:teuthology.orchestra.run.smithi019.stdout: "module_options": { 2024-09-10T22:37:55.024 INFO:teuthology.orchestra.run.smithi019.stdout: "log_level": { 2024-09-10T22:37:55.024 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_level", 2024-09-10T22:37:55.024 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-10T22:37:55.024 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:55.024 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:55.024 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-10T22:37:55.024 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:55.024 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:55.024 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-10T22:37:55.024 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-10T22:37:55.024 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-10T22:37:55.024 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-10T22:37:55.025 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-10T22:37:55.025 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-10T22:37:55.025 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-10T22:37:55.025 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-10T22:37:55.025 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:55.025 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:55.025 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:55.025 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:55.025 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:55.025 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster": { 2024-09-10T22:37:55.025 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster", 2024-09-10T22:37:55.025 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-10T22:37:55.025 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:55.025 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:55.026 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-10T22:37:55.026 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:55.026 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:55.026 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:55.026 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:55.026 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:55.026 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:55.026 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:55.026 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:55.026 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster_level": { 2024-09-10T22:37:55.026 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster_level", 2024-09-10T22:37:55.026 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-10T22:37:55.026 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:55.027 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:55.027 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "info", 2024-09-10T22:37:55.027 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:55.027 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:55.027 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-10T22:37:55.027 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-10T22:37:55.027 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-10T22:37:55.027 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-10T22:37:55.027 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-10T22:37:55.027 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-10T22:37:55.027 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-10T22:37:55.027 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-10T22:37:55.027 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:55.027 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:55.028 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:55.028 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:55.028 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:55.028 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_file": { 2024-09-10T22:37:55.028 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_file", 2024-09-10T22:37:55.028 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-10T22:37:55.028 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:55.028 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:55.028 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-10T22:37:55.028 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:55.028 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:55.028 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:55.028 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:55.029 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:55.029 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:55.029 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:55.029 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:55.029 INFO:teuthology.orchestra.run.smithi019.stdout: "retain_interval": { 2024-09-10T22:37:55.029 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "retain_interval", 2024-09-10T22:37:55.029 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "secs", 2024-09-10T22:37:55.029 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:55.029 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:55.029 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "31536000", 2024-09-10T22:37:55.029 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:55.029 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:55.029 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:55.030 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "how long to retain crashes before pruning them", 2024-09-10T22:37:55.030 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:55.030 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:55.030 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:55.030 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:55.030 INFO:teuthology.orchestra.run.smithi019.stdout: "sqlite3_killpoint": { 2024-09-10T22:37:55.030 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "sqlite3_killpoint", 2024-09-10T22:37:55.030 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "int", 2024-09-10T22:37:55.030 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "dev", 2024-09-10T22:37:55.030 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:55.030 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "0", 2024-09-10T22:37:55.030 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:55.030 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:55.030 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:55.031 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:55.031 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:55.031 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:55.031 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:55.031 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:55.031 INFO:teuthology.orchestra.run.smithi019.stdout: "warn_recent_interval": { 2024-09-10T22:37:55.031 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "warn_recent_interval", 2024-09-10T22:37:55.031 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "secs", 2024-09-10T22:37:55.031 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:55.031 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:55.031 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "1209600", 2024-09-10T22:37:55.031 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:55.031 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:55.032 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:55.032 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "time interval in which to warn about recent crashes", 2024-09-10T22:37:55.032 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:55.032 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:55.032 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:55.032 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-10T22:37:55.032 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-10T22:37:55.032 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:55.032 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-10T22:37:55.032 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "dashboard", 2024-09-10T22:37:55.032 INFO:teuthology.orchestra.run.smithi019.stdout: "can_run": true, 2024-09-10T22:37:55.032 INFO:teuthology.orchestra.run.smithi019.stdout: "error_string": "", 2024-09-10T22:37:55.032 INFO:teuthology.orchestra.run.smithi019.stdout: "module_options": { 2024-09-10T22:37:55.033 INFO:teuthology.orchestra.run.smithi019.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2024-09-10T22:37:55.033 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2024-09-10T22:37:55.033 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "int", 2024-09-10T22:37:55.033 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:55.033 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-10T22:37:55.033 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "10", 2024-09-10T22:37:55.033 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:55.033 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:55.033 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:55.033 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:55.033 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:55.033 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:55.033 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:55.034 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:55.034 INFO:teuthology.orchestra.run.smithi019.stdout: "ALERTMANAGER_API_HOST": { 2024-09-10T22:37:55.034 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "ALERTMANAGER_API_HOST", 2024-09-10T22:37:55.034 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-10T22:37:55.034 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:55.034 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-10T22:37:55.034 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-10T22:37:55.034 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:55.034 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:55.034 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:55.034 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:55.034 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:55.035 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:55.035 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:55.035 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:55.035 INFO:teuthology.orchestra.run.smithi019.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2024-09-10T22:37:55.035 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2024-09-10T22:37:55.035 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-10T22:37:55.035 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:55.035 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-10T22:37:55.035 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "True", 2024-09-10T22:37:55.035 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:55.035 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:55.035 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:55.035 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:55.036 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:55.036 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:55.036 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:55.036 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:55.036 INFO:teuthology.orchestra.run.smithi019.stdout: "AUDIT_API_ENABLED": { 2024-09-10T22:37:55.036 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "AUDIT_API_ENABLED", 2024-09-10T22:37:55.036 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-10T22:37:55.036 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:55.036 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-10T22:37:55.036 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-10T22:37:55.036 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:55.036 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:55.036 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:55.037 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:55.037 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:55.037 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:55.037 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:55.037 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:55.037 INFO:teuthology.orchestra.run.smithi019.stdout: "AUDIT_API_LOG_PAYLOAD": { 2024-09-10T22:37:55.037 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2024-09-10T22:37:55.037 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-10T22:37:55.037 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:55.037 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-10T22:37:55.037 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "True", 2024-09-10T22:37:55.037 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:55.037 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:55.038 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:55.038 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:55.038 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:55.038 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:55.038 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:55.038 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:55.038 INFO:teuthology.orchestra.run.smithi019.stdout: "ENABLE_BROWSABLE_API": { 2024-09-10T22:37:55.038 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "ENABLE_BROWSABLE_API", 2024-09-10T22:37:55.038 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-10T22:37:55.038 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:55.038 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-10T22:37:55.038 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "True", 2024-09-10T22:37:55.038 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:55.039 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:55.039 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:55.039 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:55.039 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:55.039 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:55.039 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:55.039 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:55.039 INFO:teuthology.orchestra.run.smithi019.stdout: "FEATURE_TOGGLE_CEPHFS": { 2024-09-10T22:37:55.039 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2024-09-10T22:37:55.039 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-10T22:37:55.039 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:55.039 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-10T22:37:55.039 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "True", 2024-09-10T22:37:55.040 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:55.040 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:55.040 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:55.040 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:55.040 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:55.040 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:55.040 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:55.040 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:55.040 INFO:teuthology.orchestra.run.smithi019.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2024-09-10T22:37:55.040 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2024-09-10T22:37:55.040 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-10T22:37:55.040 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:55.040 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-10T22:37:55.041 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "True", 2024-09-10T22:37:55.041 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:55.041 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:55.041 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:55.041 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:55.041 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:55.041 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:55.041 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:55.041 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:55.041 INFO:teuthology.orchestra.run.smithi019.stdout: "FEATURE_TOGGLE_ISCSI": { 2024-09-10T22:37:55.041 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2024-09-10T22:37:55.041 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-10T22:37:55.041 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:55.042 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-10T22:37:55.042 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "True", 2024-09-10T22:37:55.042 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:55.042 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:55.042 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:55.042 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:55.042 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:55.042 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:55.042 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:55.042 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:55.042 INFO:teuthology.orchestra.run.smithi019.stdout: "FEATURE_TOGGLE_MIRRORING": { 2024-09-10T22:37:55.042 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2024-09-10T22:37:55.042 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-10T22:37:55.043 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:55.043 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-10T22:37:55.043 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "True", 2024-09-10T22:37:55.043 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:55.043 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:55.043 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:55.043 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:55.043 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:55.043 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:55.043 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:55.043 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:55.043 INFO:teuthology.orchestra.run.smithi019.stdout: "FEATURE_TOGGLE_NFS": { 2024-09-10T22:37:55.043 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "FEATURE_TOGGLE_NFS", 2024-09-10T22:37:55.043 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-10T22:37:55.044 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:55.044 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-10T22:37:55.044 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "True", 2024-09-10T22:37:55.044 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:55.044 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:55.044 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:55.044 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:55.044 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:55.044 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:55.044 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:55.044 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:55.044 INFO:teuthology.orchestra.run.smithi019.stdout: "FEATURE_TOGGLE_RBD": { 2024-09-10T22:37:55.044 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "FEATURE_TOGGLE_RBD", 2024-09-10T22:37:55.045 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-10T22:37:55.045 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:55.045 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-10T22:37:55.045 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "True", 2024-09-10T22:37:55.045 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:55.045 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:55.045 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:55.045 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:55.045 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:55.045 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:55.045 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:55.045 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:55.046 INFO:teuthology.orchestra.run.smithi019.stdout: "FEATURE_TOGGLE_RGW": { 2024-09-10T22:37:55.046 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "FEATURE_TOGGLE_RGW", 2024-09-10T22:37:55.046 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-10T22:37:55.046 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:55.046 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-10T22:37:55.046 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "True", 2024-09-10T22:37:55.046 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:55.046 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:55.046 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:55.046 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:55.046 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:55.046 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:55.046 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:55.046 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:55.047 INFO:teuthology.orchestra.run.smithi019.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2024-09-10T22:37:55.047 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2024-09-10T22:37:55.047 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-10T22:37:55.047 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:55.047 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-10T22:37:55.047 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-10T22:37:55.047 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:55.047 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:55.047 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:55.047 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:55.047 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:55.047 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:55.047 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:55.048 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:55.048 INFO:teuthology.orchestra.run.smithi019.stdout: "GRAFANA_API_PASSWORD": { 2024-09-10T22:37:55.048 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "GRAFANA_API_PASSWORD", 2024-09-10T22:37:55.048 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-10T22:37:55.048 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:55.048 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-10T22:37:55.048 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "admin", 2024-09-10T22:37:55.048 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:55.048 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:55.048 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:55.048 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:55.048 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:55.049 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:55.049 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:55.049 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:55.049 INFO:teuthology.orchestra.run.smithi019.stdout: "GRAFANA_API_SSL_VERIFY": { 2024-09-10T22:37:55.049 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2024-09-10T22:37:55.049 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-10T22:37:55.049 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:55.049 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-10T22:37:55.049 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "True", 2024-09-10T22:37:55.049 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:55.049 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:55.049 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:55.049 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:55.049 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:55.050 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:55.050 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:55.050 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:55.050 INFO:teuthology.orchestra.run.smithi019.stdout: "GRAFANA_API_URL": { 2024-09-10T22:37:55.050 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "GRAFANA_API_URL", 2024-09-10T22:37:55.050 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-10T22:37:55.050 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:55.050 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-10T22:37:55.050 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-10T22:37:55.050 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:55.050 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:55.050 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:55.051 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:55.051 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:55.051 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:55.051 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:55.051 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:55.051 INFO:teuthology.orchestra.run.smithi019.stdout: "GRAFANA_API_USERNAME": { 2024-09-10T22:37:55.051 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "GRAFANA_API_USERNAME", 2024-09-10T22:37:55.051 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-10T22:37:55.051 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:55.051 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-10T22:37:55.051 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "admin", 2024-09-10T22:37:55.051 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:55.051 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:55.052 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:55.052 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:55.052 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:55.052 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:55.052 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:55.052 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:55.052 INFO:teuthology.orchestra.run.smithi019.stdout: "GRAFANA_FRONTEND_API_URL": { 2024-09-10T22:37:55.052 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2024-09-10T22:37:55.052 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-10T22:37:55.052 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:55.052 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-10T22:37:55.052 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-10T22:37:55.052 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:55.053 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:55.053 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:55.053 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:55.053 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:55.053 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:55.053 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:55.053 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:55.053 INFO:teuthology.orchestra.run.smithi019.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2024-09-10T22:37:55.053 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2024-09-10T22:37:55.053 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-10T22:37:55.053 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:55.053 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-10T22:37:55.053 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-10T22:37:55.054 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:55.054 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:55.054 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:55.054 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:55.054 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:55.054 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:55.054 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:55.054 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:55.054 INFO:teuthology.orchestra.run.smithi019.stdout: "ISCSI_API_SSL_VERIFICATION": { 2024-09-10T22:37:55.054 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2024-09-10T22:37:55.054 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-10T22:37:55.054 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:55.054 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-10T22:37:55.054 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "True", 2024-09-10T22:37:55.055 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:55.055 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:55.055 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:55.055 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:55.055 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:55.055 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:55.055 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:55.055 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:55.055 INFO:teuthology.orchestra.run.smithi019.stdout: "ISSUE_TRACKER_API_KEY": { 2024-09-10T22:37:55.055 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "ISSUE_TRACKER_API_KEY", 2024-09-10T22:37:55.055 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-10T22:37:55.055 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:55.055 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-10T22:37:55.056 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-10T22:37:55.056 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:55.056 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:55.056 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:55.056 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:55.056 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:55.056 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:55.056 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:55.056 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:55.056 INFO:teuthology.orchestra.run.smithi019.stdout: "MANAGED_BY_CLUSTERS": { 2024-09-10T22:37:55.056 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "MANAGED_BY_CLUSTERS", 2024-09-10T22:37:55.056 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-10T22:37:55.056 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:55.057 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-10T22:37:55.057 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "[]", 2024-09-10T22:37:55.057 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:55.057 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:55.057 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:55.057 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:55.057 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:55.057 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:55.057 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:55.057 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:55.057 INFO:teuthology.orchestra.run.smithi019.stdout: "MULTICLUSTER_CONFIG": { 2024-09-10T22:37:55.057 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "MULTICLUSTER_CONFIG", 2024-09-10T22:37:55.057 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-10T22:37:55.058 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:55.058 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-10T22:37:55.058 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "{}", 2024-09-10T22:37:55.058 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:55.058 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:55.058 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:55.058 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:55.058 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:55.058 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:55.058 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:55.058 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:55.058 INFO:teuthology.orchestra.run.smithi019.stdout: "PROMETHEUS_API_HOST": { 2024-09-10T22:37:55.058 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "PROMETHEUS_API_HOST", 2024-09-10T22:37:55.059 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-10T22:37:55.059 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:55.059 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-10T22:37:55.059 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-10T22:37:55.059 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:55.059 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:55.059 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:55.059 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:55.059 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:55.059 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:55.059 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:55.059 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:55.059 INFO:teuthology.orchestra.run.smithi019.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2024-09-10T22:37:55.059 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2024-09-10T22:37:55.060 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-10T22:37:55.060 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:55.060 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-10T22:37:55.060 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "True", 2024-09-10T22:37:55.060 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:55.060 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:55.060 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:55.060 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:55.060 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:55.060 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:55.060 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:55.060 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:55.061 INFO:teuthology.orchestra.run.smithi019.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2024-09-10T22:37:55.061 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2024-09-10T22:37:55.061 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-10T22:37:55.061 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:55.061 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-10T22:37:55.061 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-10T22:37:55.061 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:55.061 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:55.061 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:55.061 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:55.061 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:55.061 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:55.061 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:55.061 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:55.062 INFO:teuthology.orchestra.run.smithi019.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2024-09-10T22:37:55.062 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2024-09-10T22:37:55.062 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-10T22:37:55.062 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:55.062 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-10T22:37:55.062 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-10T22:37:55.062 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:55.062 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:55.062 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:55.062 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:55.062 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:55.062 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:55.062 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:55.062 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:55.063 INFO:teuthology.orchestra.run.smithi019.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2024-09-10T22:37:55.063 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2024-09-10T22:37:55.063 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-10T22:37:55.063 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:55.063 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-10T22:37:55.063 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "True", 2024-09-10T22:37:55.063 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:55.063 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:55.063 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:55.063 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:55.063 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:55.063 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:55.063 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:55.064 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:55.064 INFO:teuthology.orchestra.run.smithi019.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2024-09-10T22:37:55.064 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2024-09-10T22:37:55.064 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-10T22:37:55.064 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:55.064 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-10T22:37:55.064 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "True", 2024-09-10T22:37:55.064 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:55.064 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:55.064 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:55.064 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:55.064 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:55.064 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:55.065 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:55.065 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:55.065 INFO:teuthology.orchestra.run.smithi019.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2024-09-10T22:37:55.065 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2024-09-10T22:37:55.065 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-10T22:37:55.065 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:55.065 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-10T22:37:55.065 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-10T22:37:55.065 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:55.065 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:55.065 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:55.065 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:55.065 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:55.065 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:55.066 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:55.066 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:55.066 INFO:teuthology.orchestra.run.smithi019.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2024-09-10T22:37:55.066 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2024-09-10T22:37:55.066 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-10T22:37:55.066 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:55.066 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-10T22:37:55.066 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-10T22:37:55.066 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:55.066 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:55.066 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:55.066 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:55.066 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:55.067 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:55.067 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:55.067 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:55.067 INFO:teuthology.orchestra.run.smithi019.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2024-09-10T22:37:55.067 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2024-09-10T22:37:55.067 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-10T22:37:55.067 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:55.067 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-10T22:37:55.067 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-10T22:37:55.067 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:55.067 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:55.067 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:55.067 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:55.068 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:55.068 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:55.068 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:55.068 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:55.068 INFO:teuthology.orchestra.run.smithi019.stdout: "PWD_POLICY_ENABLED": { 2024-09-10T22:37:55.068 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "PWD_POLICY_ENABLED", 2024-09-10T22:37:55.068 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-10T22:37:55.068 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:55.068 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-10T22:37:55.068 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "True", 2024-09-10T22:37:55.068 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:55.068 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:55.069 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:55.069 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:55.069 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:55.069 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:55.069 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:55.069 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:55.069 INFO:teuthology.orchestra.run.smithi019.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2024-09-10T22:37:55.069 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2024-09-10T22:37:55.069 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-10T22:37:55.069 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:55.069 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-10T22:37:55.069 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2024-09-10T22:37:55.069 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:55.069 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:55.070 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:55.070 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:55.070 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:55.070 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:55.070 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:55.070 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:55.070 INFO:teuthology.orchestra.run.smithi019.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2024-09-10T22:37:55.070 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2024-09-10T22:37:55.070 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "int", 2024-09-10T22:37:55.070 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:55.070 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-10T22:37:55.070 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "10", 2024-09-10T22:37:55.070 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:55.071 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:55.071 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:55.071 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:55.071 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:55.071 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:55.071 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:55.071 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:55.071 INFO:teuthology.orchestra.run.smithi019.stdout: "PWD_POLICY_MIN_LENGTH": { 2024-09-10T22:37:55.071 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2024-09-10T22:37:55.071 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "int", 2024-09-10T22:37:55.071 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:55.071 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-10T22:37:55.071 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "8", 2024-09-10T22:37:55.072 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:55.072 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:55.072 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:55.072 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:55.072 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:55.072 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:55.072 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:55.072 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:55.072 INFO:teuthology.orchestra.run.smithi019.stdout: "REST_REQUESTS_TIMEOUT": { 2024-09-10T22:37:55.072 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "REST_REQUESTS_TIMEOUT", 2024-09-10T22:37:55.072 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "int", 2024-09-10T22:37:55.072 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:55.072 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-10T22:37:55.073 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "45", 2024-09-10T22:37:55.073 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:55.073 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:55.073 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:55.073 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:55.073 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:55.073 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:55.073 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:55.073 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:55.073 INFO:teuthology.orchestra.run.smithi019.stdout: "RGW_API_ACCESS_KEY": { 2024-09-10T22:37:55.073 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "RGW_API_ACCESS_KEY", 2024-09-10T22:37:55.073 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-10T22:37:55.073 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:55.074 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-10T22:37:55.074 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-10T22:37:55.074 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:55.074 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:55.074 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:55.074 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:55.074 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:55.074 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:55.074 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:55.074 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:55.074 INFO:teuthology.orchestra.run.smithi019.stdout: "RGW_API_ADMIN_RESOURCE": { 2024-09-10T22:37:55.074 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2024-09-10T22:37:55.074 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-10T22:37:55.075 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:55.075 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-10T22:37:55.075 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "admin", 2024-09-10T22:37:55.075 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:55.075 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:55.075 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:55.075 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:55.075 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:55.075 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:55.075 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:55.075 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:55.075 INFO:teuthology.orchestra.run.smithi019.stdout: "RGW_API_SECRET_KEY": { 2024-09-10T22:37:55.075 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "RGW_API_SECRET_KEY", 2024-09-10T22:37:55.076 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-10T22:37:55.076 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:55.076 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-10T22:37:55.076 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-10T22:37:55.076 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:55.076 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:55.076 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:55.076 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:55.076 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:55.076 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:55.076 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:55.076 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:55.076 INFO:teuthology.orchestra.run.smithi019.stdout: "RGW_API_SSL_VERIFY": { 2024-09-10T22:37:55.077 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "RGW_API_SSL_VERIFY", 2024-09-10T22:37:55.077 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-10T22:37:55.077 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:55.077 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-10T22:37:55.077 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "True", 2024-09-10T22:37:55.077 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:55.077 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:55.077 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:55.077 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:55.077 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:55.077 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:55.077 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:55.077 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:55.077 INFO:teuthology.orchestra.run.smithi019.stdout: "UNSAFE_TLS_v1_2": { 2024-09-10T22:37:55.078 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "UNSAFE_TLS_v1_2", 2024-09-10T22:37:55.078 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-10T22:37:55.078 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:55.078 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-10T22:37:55.078 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-10T22:37:55.078 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:55.078 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:55.078 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:55.078 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:55.078 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:55.078 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:55.078 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:55.078 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:55.079 INFO:teuthology.orchestra.run.smithi019.stdout: "USER_PWD_EXPIRATION_SPAN": { 2024-09-10T22:37:55.079 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2024-09-10T22:37:55.079 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "int", 2024-09-10T22:37:55.079 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:55.079 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-10T22:37:55.079 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "0", 2024-09-10T22:37:55.079 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:55.079 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:55.079 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:55.079 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:55.079 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:55.079 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:55.079 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:55.080 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:55.080 INFO:teuthology.orchestra.run.smithi019.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2024-09-10T22:37:55.080 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2024-09-10T22:37:55.080 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "int", 2024-09-10T22:37:55.080 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:55.080 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-10T22:37:55.080 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "10", 2024-09-10T22:37:55.080 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:55.080 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:55.080 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:55.080 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:55.080 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:55.080 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:55.081 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:55.081 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:55.081 INFO:teuthology.orchestra.run.smithi019.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2024-09-10T22:37:55.081 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2024-09-10T22:37:55.081 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "int", 2024-09-10T22:37:55.081 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:55.081 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-10T22:37:55.081 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "5", 2024-09-10T22:37:55.081 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:55.081 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:55.081 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:55.081 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:55.081 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:55.082 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:55.082 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:55.082 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:55.082 INFO:teuthology.orchestra.run.smithi019.stdout: "cross_origin_url": { 2024-09-10T22:37:55.082 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "cross_origin_url", 2024-09-10T22:37:55.082 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-10T22:37:55.082 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:55.082 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-10T22:37:55.082 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-10T22:37:55.082 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:55.082 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:55.082 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:55.082 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:55.083 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:55.083 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:55.083 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:55.083 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:55.083 INFO:teuthology.orchestra.run.smithi019.stdout: "crt_file": { 2024-09-10T22:37:55.083 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "crt_file", 2024-09-10T22:37:55.083 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-10T22:37:55.083 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:55.083 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-10T22:37:55.083 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-10T22:37:55.083 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:55.083 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:55.083 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:55.083 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:55.084 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:55.084 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:55.084 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:55.084 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:55.084 INFO:teuthology.orchestra.run.smithi019.stdout: "debug": { 2024-09-10T22:37:55.084 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "debug", 2024-09-10T22:37:55.084 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-10T22:37:55.084 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:55.084 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-10T22:37:55.084 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-10T22:37:55.084 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:55.084 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:55.084 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:55.085 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "Enable/disable debug options", 2024-09-10T22:37:55.085 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:55.085 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:55.085 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:55.085 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:55.085 INFO:teuthology.orchestra.run.smithi019.stdout: "jwt_token_ttl": { 2024-09-10T22:37:55.085 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "jwt_token_ttl", 2024-09-10T22:37:55.085 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "int", 2024-09-10T22:37:55.085 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:55.085 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-10T22:37:55.085 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "28800", 2024-09-10T22:37:55.085 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:55.086 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:55.086 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:55.086 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:55.086 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:55.086 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:55.086 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:55.086 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:55.086 INFO:teuthology.orchestra.run.smithi019.stdout: "key_file": { 2024-09-10T22:37:55.086 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "key_file", 2024-09-10T22:37:55.086 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-10T22:37:55.086 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:55.086 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-10T22:37:55.086 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-10T22:37:55.087 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:55.087 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:55.087 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:55.087 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:55.087 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:55.087 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:55.087 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:55.087 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:55.087 INFO:teuthology.orchestra.run.smithi019.stdout: "log_level": { 2024-09-10T22:37:55.087 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_level", 2024-09-10T22:37:55.087 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-10T22:37:55.087 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:55.087 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:55.088 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-10T22:37:55.088 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:55.088 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:55.088 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-10T22:37:55.088 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-10T22:37:55.088 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-10T22:37:55.088 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-10T22:37:55.088 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-10T22:37:55.088 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-10T22:37:55.088 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-10T22:37:55.088 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-10T22:37:55.088 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:55.088 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:55.089 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:55.089 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:55.089 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:55.089 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster": { 2024-09-10T22:37:55.089 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster", 2024-09-10T22:37:55.089 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-10T22:37:55.089 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:55.089 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:55.089 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-10T22:37:55.089 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:55.089 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:55.089 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:55.089 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:55.089 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:55.090 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:55.090 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:55.090 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:55.090 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster_level": { 2024-09-10T22:37:55.090 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster_level", 2024-09-10T22:37:55.090 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-10T22:37:55.090 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:55.090 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:55.090 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "info", 2024-09-10T22:37:55.090 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:55.090 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:55.090 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-10T22:37:55.091 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-10T22:37:55.091 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-10T22:37:55.091 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-10T22:37:55.091 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-10T22:37:55.091 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-10T22:37:55.091 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-10T22:37:55.091 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-10T22:37:55.091 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:55.091 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:55.091 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:55.091 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:55.091 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:55.091 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_file": { 2024-09-10T22:37:55.092 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_file", 2024-09-10T22:37:55.092 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-10T22:37:55.092 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:55.092 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:55.092 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-10T22:37:55.092 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:55.092 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:55.092 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:55.092 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:55.092 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:55.092 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:55.092 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:55.092 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:55.093 INFO:teuthology.orchestra.run.smithi019.stdout: "motd": { 2024-09-10T22:37:55.093 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "motd", 2024-09-10T22:37:55.093 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-10T22:37:55.093 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:55.093 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-10T22:37:55.093 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-10T22:37:55.093 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:55.093 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:55.093 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:55.093 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "The message of the day", 2024-09-10T22:37:55.093 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:55.093 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:55.093 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:55.093 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:55.094 INFO:teuthology.orchestra.run.smithi019.stdout: "redirect_resolve_ip_addr": { 2024-09-10T22:37:55.094 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "redirect_resolve_ip_addr", 2024-09-10T22:37:55.094 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-10T22:37:55.094 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:55.094 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-10T22:37:55.094 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-10T22:37:55.094 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:55.094 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:55.094 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:55.094 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:55.094 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:55.094 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:55.094 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:55.095 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:55.095 INFO:teuthology.orchestra.run.smithi019.stdout: "server_addr": { 2024-09-10T22:37:55.095 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "server_addr", 2024-09-10T22:37:55.095 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-10T22:37:55.095 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:55.095 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-10T22:37:55.095 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "::", 2024-09-10T22:37:55.095 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:55.095 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:55.095 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:55.095 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:55.095 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:55.095 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:55.096 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:55.096 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:55.096 INFO:teuthology.orchestra.run.smithi019.stdout: "server_port": { 2024-09-10T22:37:55.096 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "server_port", 2024-09-10T22:37:55.096 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "int", 2024-09-10T22:37:55.096 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:55.096 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-10T22:37:55.096 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "8080", 2024-09-10T22:37:55.096 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:55.096 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:55.096 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:55.096 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:55.096 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:55.097 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:55.097 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:55.097 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:55.097 INFO:teuthology.orchestra.run.smithi019.stdout: "sqlite3_killpoint": { 2024-09-10T22:37:55.097 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "sqlite3_killpoint", 2024-09-10T22:37:55.097 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "int", 2024-09-10T22:37:55.097 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "dev", 2024-09-10T22:37:55.097 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:55.097 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "0", 2024-09-10T22:37:55.097 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:55.097 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:55.097 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:55.097 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:55.097 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:55.098 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:55.098 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:55.098 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:55.098 INFO:teuthology.orchestra.run.smithi019.stdout: "ssl": { 2024-09-10T22:37:55.098 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "ssl", 2024-09-10T22:37:55.098 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-10T22:37:55.098 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:55.098 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-10T22:37:55.098 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "True", 2024-09-10T22:37:55.098 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:55.098 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:55.098 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:55.098 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:55.099 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:55.099 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:55.099 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:55.099 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:55.099 INFO:teuthology.orchestra.run.smithi019.stdout: "ssl_server_port": { 2024-09-10T22:37:55.099 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "ssl_server_port", 2024-09-10T22:37:55.099 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "int", 2024-09-10T22:37:55.099 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:55.099 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-10T22:37:55.099 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "8443", 2024-09-10T22:37:55.099 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:55.099 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:55.099 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:55.100 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:55.100 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:55.100 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:55.100 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:55.100 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:55.100 INFO:teuthology.orchestra.run.smithi019.stdout: "standby_behaviour": { 2024-09-10T22:37:55.100 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "standby_behaviour", 2024-09-10T22:37:55.100 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-10T22:37:55.100 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:55.100 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-10T22:37:55.100 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "redirect", 2024-09-10T22:37:55.100 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:55.100 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:55.100 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-10T22:37:55.101 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-10T22:37:55.101 INFO:teuthology.orchestra.run.smithi019.stdout: "redirect" 2024-09-10T22:37:55.101 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-10T22:37:55.101 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:55.101 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:55.101 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:55.101 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:55.101 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:55.101 INFO:teuthology.orchestra.run.smithi019.stdout: "standby_error_status_code": { 2024-09-10T22:37:55.101 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "standby_error_status_code", 2024-09-10T22:37:55.101 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "int", 2024-09-10T22:37:55.101 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:55.101 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-10T22:37:55.102 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "500", 2024-09-10T22:37:55.102 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "400", 2024-09-10T22:37:55.102 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "599", 2024-09-10T22:37:55.102 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:55.102 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:55.102 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:55.102 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:55.102 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:55.102 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:55.102 INFO:teuthology.orchestra.run.smithi019.stdout: "url_prefix": { 2024-09-10T22:37:55.102 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "url_prefix", 2024-09-10T22:37:55.102 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-10T22:37:55.102 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:55.103 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-10T22:37:55.103 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-10T22:37:55.103 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:55.103 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:55.103 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:55.103 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:55.103 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:55.103 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:55.103 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:55.103 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-10T22:37:55.103 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-10T22:37:55.103 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:55.103 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-10T22:37:55.104 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "devicehealth", 2024-09-10T22:37:55.104 INFO:teuthology.orchestra.run.smithi019.stdout: "can_run": true, 2024-09-10T22:37:55.104 INFO:teuthology.orchestra.run.smithi019.stdout: "error_string": "", 2024-09-10T22:37:55.104 INFO:teuthology.orchestra.run.smithi019.stdout: "module_options": { 2024-09-10T22:37:55.104 INFO:teuthology.orchestra.run.smithi019.stdout: "enable_monitoring": { 2024-09-10T22:37:55.104 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "enable_monitoring", 2024-09-10T22:37:55.104 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-10T22:37:55.104 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:55.104 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:55.104 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "True", 2024-09-10T22:37:55.104 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:55.104 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:55.104 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:55.105 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "monitor device health metrics", 2024-09-10T22:37:55.105 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:55.105 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:55.105 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:55.105 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:55.105 INFO:teuthology.orchestra.run.smithi019.stdout: "log_level": { 2024-09-10T22:37:55.105 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_level", 2024-09-10T22:37:55.105 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-10T22:37:55.105 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:55.105 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:55.105 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-10T22:37:55.105 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:55.105 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:55.106 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-10T22:37:55.106 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-10T22:37:55.106 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-10T22:37:55.106 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-10T22:37:55.106 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-10T22:37:55.106 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-10T22:37:55.106 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-10T22:37:55.106 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-10T22:37:55.106 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:55.106 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:55.106 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:55.106 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:55.106 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:55.107 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster": { 2024-09-10T22:37:55.107 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster", 2024-09-10T22:37:55.107 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-10T22:37:55.107 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:55.107 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:55.107 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-10T22:37:55.107 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:55.107 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:55.107 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:55.107 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:55.107 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:55.107 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:55.107 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:55.108 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:55.108 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster_level": { 2024-09-10T22:37:55.108 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster_level", 2024-09-10T22:37:55.108 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-10T22:37:55.108 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:55.108 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:55.108 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "info", 2024-09-10T22:37:55.108 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:55.108 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:55.108 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-10T22:37:55.108 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-10T22:37:55.108 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-10T22:37:55.109 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-10T22:37:55.109 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-10T22:37:55.109 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-10T22:37:55.109 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-10T22:37:55.109 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-10T22:37:55.109 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:55.109 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:55.109 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:55.109 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:55.109 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:55.109 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_file": { 2024-09-10T22:37:55.109 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_file", 2024-09-10T22:37:55.110 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-10T22:37:55.110 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:55.110 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:55.110 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-10T22:37:55.110 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:55.110 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:55.110 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:55.110 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:55.110 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:55.110 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:55.110 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:55.110 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:55.110 INFO:teuthology.orchestra.run.smithi019.stdout: "mark_out_threshold": { 2024-09-10T22:37:55.110 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "mark_out_threshold", 2024-09-10T22:37:55.111 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "secs", 2024-09-10T22:37:55.111 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:55.111 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:55.111 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "2419200", 2024-09-10T22:37:55.111 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:55.111 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:55.111 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:55.111 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "automatically mark OSD if it may fail before this long", 2024-09-10T22:37:55.111 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:55.111 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:55.111 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:55.111 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:55.111 INFO:teuthology.orchestra.run.smithi019.stdout: "pool_name": { 2024-09-10T22:37:55.112 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "pool_name", 2024-09-10T22:37:55.112 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-10T22:37:55.112 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:55.112 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:55.112 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "device_health_metrics", 2024-09-10T22:37:55.112 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:55.112 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:55.112 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:55.112 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "name of pool in which to store device health metrics", 2024-09-10T22:37:55.112 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:55.112 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:55.112 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:55.112 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:55.113 INFO:teuthology.orchestra.run.smithi019.stdout: "retention_period": { 2024-09-10T22:37:55.113 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "retention_period", 2024-09-10T22:37:55.113 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "secs", 2024-09-10T22:37:55.113 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:55.113 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:55.113 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "15552000", 2024-09-10T22:37:55.113 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:55.113 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:55.113 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:55.113 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "how long to retain device health metrics", 2024-09-10T22:37:55.113 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:55.113 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:55.113 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:55.114 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:55.114 INFO:teuthology.orchestra.run.smithi019.stdout: "scrape_frequency": { 2024-09-10T22:37:55.114 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "scrape_frequency", 2024-09-10T22:37:55.114 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "secs", 2024-09-10T22:37:55.114 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:55.114 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:55.114 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "86400", 2024-09-10T22:37:55.114 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:55.114 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:55.114 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:55.114 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "how frequently to scrape device health metrics", 2024-09-10T22:37:55.114 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:55.114 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:55.115 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:55.115 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:55.115 INFO:teuthology.orchestra.run.smithi019.stdout: "self_heal": { 2024-09-10T22:37:55.115 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "self_heal", 2024-09-10T22:37:55.115 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-10T22:37:55.115 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:55.115 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:55.115 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "True", 2024-09-10T22:37:55.115 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:55.115 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:55.115 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:55.115 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "preemptively heal cluster around devices that may fail", 2024-09-10T22:37:55.115 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:55.115 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:55.116 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:55.116 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:55.116 INFO:teuthology.orchestra.run.smithi019.stdout: "sleep_interval": { 2024-09-10T22:37:55.116 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "sleep_interval", 2024-09-10T22:37:55.116 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "secs", 2024-09-10T22:37:55.116 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:55.116 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:55.116 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "600", 2024-09-10T22:37:55.116 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:55.116 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:55.116 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:55.116 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "how frequently to wake up and check device health", 2024-09-10T22:37:55.116 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:55.117 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:55.117 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:55.117 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:55.117 INFO:teuthology.orchestra.run.smithi019.stdout: "sqlite3_killpoint": { 2024-09-10T22:37:55.117 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "sqlite3_killpoint", 2024-09-10T22:37:55.117 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "int", 2024-09-10T22:37:55.117 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "dev", 2024-09-10T22:37:55.117 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:55.117 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "0", 2024-09-10T22:37:55.117 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:55.117 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:55.117 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:55.117 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:55.118 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:55.118 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:55.118 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:55.118 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:55.118 INFO:teuthology.orchestra.run.smithi019.stdout: "warn_threshold": { 2024-09-10T22:37:55.118 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "warn_threshold", 2024-09-10T22:37:55.118 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "secs", 2024-09-10T22:37:55.118 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:55.118 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:55.118 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "7257600", 2024-09-10T22:37:55.118 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:55.118 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:55.118 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:55.118 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "raise health warning if OSD may fail before this long", 2024-09-10T22:37:55.119 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:55.119 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:55.119 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:55.119 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-10T22:37:55.119 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-10T22:37:55.119 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:55.119 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-10T22:37:55.119 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "diskprediction_local", 2024-09-10T22:37:55.119 INFO:teuthology.orchestra.run.smithi019.stdout: "can_run": true, 2024-09-10T22:37:55.119 INFO:teuthology.orchestra.run.smithi019.stdout: "error_string": "", 2024-09-10T22:37:55.119 INFO:teuthology.orchestra.run.smithi019.stdout: "module_options": { 2024-09-10T22:37:55.119 INFO:teuthology.orchestra.run.smithi019.stdout: "log_level": { 2024-09-10T22:37:55.119 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_level", 2024-09-10T22:37:55.120 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-10T22:37:55.120 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:55.120 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:55.120 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-10T22:37:55.120 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:55.120 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:55.120 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-10T22:37:55.120 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-10T22:37:55.120 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-10T22:37:55.120 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-10T22:37:55.120 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-10T22:37:55.120 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-10T22:37:55.120 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-10T22:37:55.121 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-10T22:37:55.121 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:55.121 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:55.121 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:55.121 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:55.121 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:55.121 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster": { 2024-09-10T22:37:55.121 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster", 2024-09-10T22:37:55.121 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-10T22:37:55.121 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:55.121 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:55.121 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-10T22:37:55.121 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:55.122 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:55.122 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:55.122 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:55.122 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:55.122 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:55.122 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:55.122 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:55.122 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster_level": { 2024-09-10T22:37:55.122 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster_level", 2024-09-10T22:37:55.122 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-10T22:37:55.122 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:55.122 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:55.122 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "info", 2024-09-10T22:37:55.123 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:55.123 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:55.123 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-10T22:37:55.123 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-10T22:37:55.123 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-10T22:37:55.123 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-10T22:37:55.123 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-10T22:37:55.123 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-10T22:37:55.123 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-10T22:37:55.123 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-10T22:37:55.123 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:55.123 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:55.123 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:55.124 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:55.124 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:55.124 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_file": { 2024-09-10T22:37:55.124 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_file", 2024-09-10T22:37:55.124 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-10T22:37:55.124 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:55.124 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:55.124 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-10T22:37:55.124 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:55.124 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:55.124 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:55.124 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:55.124 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:55.125 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:55.125 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:55.125 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:55.125 INFO:teuthology.orchestra.run.smithi019.stdout: "predict_interval": { 2024-09-10T22:37:55.125 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "predict_interval", 2024-09-10T22:37:55.125 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-10T22:37:55.125 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:55.125 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-10T22:37:55.125 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "86400", 2024-09-10T22:37:55.125 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:55.125 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:55.125 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:55.125 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:55.126 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:55.126 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:55.126 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:55.126 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:55.126 INFO:teuthology.orchestra.run.smithi019.stdout: "predictor_model": { 2024-09-10T22:37:55.126 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "predictor_model", 2024-09-10T22:37:55.126 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-10T22:37:55.126 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:55.126 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-10T22:37:55.126 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "prophetstor", 2024-09-10T22:37:55.126 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:55.126 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:55.126 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:55.127 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:55.127 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:55.127 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:55.127 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:55.127 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:55.127 INFO:teuthology.orchestra.run.smithi019.stdout: "sleep_interval": { 2024-09-10T22:37:55.127 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "sleep_interval", 2024-09-10T22:37:55.127 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-10T22:37:55.127 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:55.127 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-10T22:37:55.127 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "600", 2024-09-10T22:37:55.127 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:55.127 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:55.127 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:55.128 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:55.128 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:55.128 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:55.128 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:55.128 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:55.128 INFO:teuthology.orchestra.run.smithi019.stdout: "sqlite3_killpoint": { 2024-09-10T22:37:55.128 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "sqlite3_killpoint", 2024-09-10T22:37:55.128 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "int", 2024-09-10T22:37:55.128 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "dev", 2024-09-10T22:37:55.128 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:55.128 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "0", 2024-09-10T22:37:55.128 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:55.128 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:55.129 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:55.129 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:55.129 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:55.129 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:55.129 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:55.129 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-10T22:37:55.129 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-10T22:37:55.129 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:55.129 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-10T22:37:55.129 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "influx", 2024-09-10T22:37:55.129 INFO:teuthology.orchestra.run.smithi019.stdout: "can_run": false, 2024-09-10T22:37:55.129 INFO:teuthology.orchestra.run.smithi019.stdout: "error_string": "influxdb python module not found", 2024-09-10T22:37:55.130 INFO:teuthology.orchestra.run.smithi019.stdout: "module_options": { 2024-09-10T22:37:55.130 INFO:teuthology.orchestra.run.smithi019.stdout: "batch_size": { 2024-09-10T22:37:55.130 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "batch_size", 2024-09-10T22:37:55.130 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "int", 2024-09-10T22:37:55.130 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:55.130 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-10T22:37:55.130 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "5000", 2024-09-10T22:37:55.130 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:55.130 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:55.130 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:55.130 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2024-09-10T22:37:55.130 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:55.130 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:55.131 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:55.131 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:55.131 INFO:teuthology.orchestra.run.smithi019.stdout: "database": { 2024-09-10T22:37:55.131 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "database", 2024-09-10T22:37:55.131 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-10T22:37:55.131 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:55.131 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-10T22:37:55.131 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "ceph", 2024-09-10T22:37:55.131 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:55.131 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:55.131 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:55.131 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2024-09-10T22:37:55.131 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:55.132 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:55.132 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:55.132 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:55.132 INFO:teuthology.orchestra.run.smithi019.stdout: "hostname": { 2024-09-10T22:37:55.132 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "hostname", 2024-09-10T22:37:55.132 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-10T22:37:55.132 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:55.132 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-10T22:37:55.132 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-10T22:37:55.132 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:55.132 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:55.132 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:55.132 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "InfluxDB server hostname", 2024-09-10T22:37:55.133 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:55.133 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:55.133 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:55.133 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:55.133 INFO:teuthology.orchestra.run.smithi019.stdout: "interval": { 2024-09-10T22:37:55.133 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "interval", 2024-09-10T22:37:55.133 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "secs", 2024-09-10T22:37:55.133 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:55.133 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-10T22:37:55.133 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "30", 2024-09-10T22:37:55.133 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "5", 2024-09-10T22:37:55.133 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:55.133 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:55.134 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2024-09-10T22:37:55.134 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:55.134 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:55.134 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:55.134 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:55.134 INFO:teuthology.orchestra.run.smithi019.stdout: "log_level": { 2024-09-10T22:37:55.134 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_level", 2024-09-10T22:37:55.134 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-10T22:37:55.134 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:55.134 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:55.134 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-10T22:37:55.134 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:55.134 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:55.135 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-10T22:37:55.135 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-10T22:37:55.135 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-10T22:37:55.135 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-10T22:37:55.135 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-10T22:37:55.135 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-10T22:37:55.135 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-10T22:37:55.135 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-10T22:37:55.135 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:55.135 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:55.135 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:55.135 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:55.135 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:55.135 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster": { 2024-09-10T22:37:55.136 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster", 2024-09-10T22:37:55.136 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-10T22:37:55.136 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:55.136 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:55.136 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-10T22:37:55.136 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:55.136 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:55.136 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:55.136 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:55.136 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:55.136 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:55.136 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:55.137 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:55.137 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster_level": { 2024-09-10T22:37:55.137 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster_level", 2024-09-10T22:37:55.137 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-10T22:37:55.137 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:55.137 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:55.137 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "info", 2024-09-10T22:37:55.137 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:55.137 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:55.137 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-10T22:37:55.137 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-10T22:37:55.137 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-10T22:37:55.137 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-10T22:37:55.138 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-10T22:37:55.138 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-10T22:37:55.138 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-10T22:37:55.138 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-10T22:37:55.138 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:55.138 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:55.138 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:55.138 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:55.138 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:55.138 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_file": { 2024-09-10T22:37:55.138 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_file", 2024-09-10T22:37:55.138 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-10T22:37:55.138 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:55.139 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:55.139 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-10T22:37:55.139 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:55.139 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:55.139 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:55.139 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:55.139 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:55.139 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:55.139 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:55.139 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:55.139 INFO:teuthology.orchestra.run.smithi019.stdout: "password": { 2024-09-10T22:37:55.139 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "password", 2024-09-10T22:37:55.139 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-10T22:37:55.139 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:55.140 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-10T22:37:55.140 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-10T22:37:55.140 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:55.140 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:55.140 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:55.140 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "password of InfluxDB server user", 2024-09-10T22:37:55.140 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:55.140 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:55.140 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:55.140 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:55.140 INFO:teuthology.orchestra.run.smithi019.stdout: "port": { 2024-09-10T22:37:55.140 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "port", 2024-09-10T22:37:55.141 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "int", 2024-09-10T22:37:55.141 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:55.141 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-10T22:37:55.141 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "8086", 2024-09-10T22:37:55.141 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:55.141 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:55.141 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:55.141 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "InfluxDB server port", 2024-09-10T22:37:55.141 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:55.141 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:55.141 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:55.141 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:55.141 INFO:teuthology.orchestra.run.smithi019.stdout: "sqlite3_killpoint": { 2024-09-10T22:37:55.142 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "sqlite3_killpoint", 2024-09-10T22:37:55.142 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "int", 2024-09-10T22:37:55.142 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "dev", 2024-09-10T22:37:55.142 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:55.142 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "0", 2024-09-10T22:37:55.142 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:55.142 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:55.142 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:55.142 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:55.142 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:55.142 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:55.142 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:55.142 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:55.142 INFO:teuthology.orchestra.run.smithi019.stdout: "ssl": { 2024-09-10T22:37:55.143 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "ssl", 2024-09-10T22:37:55.143 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-10T22:37:55.143 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:55.143 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-10T22:37:55.143 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "false", 2024-09-10T22:37:55.143 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:55.143 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:55.143 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:55.143 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2024-09-10T22:37:55.143 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:55.143 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:55.143 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:55.143 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:55.144 INFO:teuthology.orchestra.run.smithi019.stdout: "threads": { 2024-09-10T22:37:55.144 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "threads", 2024-09-10T22:37:55.144 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "int", 2024-09-10T22:37:55.144 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:55.144 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-10T22:37:55.144 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "5", 2024-09-10T22:37:55.144 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "1", 2024-09-10T22:37:55.144 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "32", 2024-09-10T22:37:55.144 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:55.144 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2024-09-10T22:37:55.144 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:55.144 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:55.144 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:55.145 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:55.145 INFO:teuthology.orchestra.run.smithi019.stdout: "username": { 2024-09-10T22:37:55.145 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "username", 2024-09-10T22:37:55.145 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-10T22:37:55.145 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:55.145 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-10T22:37:55.145 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-10T22:37:55.145 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:55.145 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:55.145 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:55.145 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "username of InfluxDB server user", 2024-09-10T22:37:55.145 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:55.145 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:55.146 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:55.146 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:55.146 INFO:teuthology.orchestra.run.smithi019.stdout: "verify_ssl": { 2024-09-10T22:37:55.146 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "verify_ssl", 2024-09-10T22:37:55.146 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-10T22:37:55.146 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:55.146 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-10T22:37:55.146 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "true", 2024-09-10T22:37:55.146 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:55.146 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:55.146 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:55.146 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2024-09-10T22:37:55.146 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:55.147 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:55.147 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:55.147 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-10T22:37:55.147 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-10T22:37:55.147 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:55.147 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-10T22:37:55.147 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "insights", 2024-09-10T22:37:55.147 INFO:teuthology.orchestra.run.smithi019.stdout: "can_run": true, 2024-09-10T22:37:55.147 INFO:teuthology.orchestra.run.smithi019.stdout: "error_string": "", 2024-09-10T22:37:55.147 INFO:teuthology.orchestra.run.smithi019.stdout: "module_options": { 2024-09-10T22:37:55.147 INFO:teuthology.orchestra.run.smithi019.stdout: "log_level": { 2024-09-10T22:37:55.147 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_level", 2024-09-10T22:37:55.147 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-10T22:37:55.147 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:55.148 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:55.148 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-10T22:37:55.148 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:55.148 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:55.148 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-10T22:37:55.148 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-10T22:37:55.148 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-10T22:37:55.148 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-10T22:37:55.148 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-10T22:37:55.148 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-10T22:37:55.148 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-10T22:37:55.148 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-10T22:37:55.148 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:55.149 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:55.149 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:55.149 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:55.149 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:55.149 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster": { 2024-09-10T22:37:55.149 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster", 2024-09-10T22:37:55.149 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-10T22:37:55.149 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:55.149 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:55.149 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-10T22:37:55.149 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:55.149 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:55.149 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:55.150 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:55.150 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:55.150 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:55.150 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:55.150 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:55.150 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster_level": { 2024-09-10T22:37:55.150 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster_level", 2024-09-10T22:37:55.150 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-10T22:37:55.150 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:55.150 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:55.150 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "info", 2024-09-10T22:37:55.150 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:55.150 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:55.150 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-10T22:37:55.151 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-10T22:37:55.151 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-10T22:37:55.151 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-10T22:37:55.151 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-10T22:37:55.151 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-10T22:37:55.151 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-10T22:37:55.151 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-10T22:37:55.151 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:55.151 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:55.151 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:55.151 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:55.151 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:55.151 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_file": { 2024-09-10T22:37:55.152 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_file", 2024-09-10T22:37:55.152 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-10T22:37:55.152 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:55.152 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:55.152 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-10T22:37:55.152 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:55.152 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:55.152 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:55.152 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:55.152 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:55.152 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:55.152 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:55.152 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:55.153 INFO:teuthology.orchestra.run.smithi019.stdout: "sqlite3_killpoint": { 2024-09-10T22:37:55.153 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "sqlite3_killpoint", 2024-09-10T22:37:55.153 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "int", 2024-09-10T22:37:55.153 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "dev", 2024-09-10T22:37:55.153 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:55.153 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "0", 2024-09-10T22:37:55.153 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:55.153 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:55.153 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:55.153 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:55.153 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:55.153 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:55.153 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:55.153 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-10T22:37:55.154 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-10T22:37:55.154 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:55.154 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-10T22:37:55.154 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "iostat", 2024-09-10T22:37:55.154 INFO:teuthology.orchestra.run.smithi019.stdout: "can_run": true, 2024-09-10T22:37:55.154 INFO:teuthology.orchestra.run.smithi019.stdout: "error_string": "", 2024-09-10T22:37:55.154 INFO:teuthology.orchestra.run.smithi019.stdout: "module_options": { 2024-09-10T22:37:55.154 INFO:teuthology.orchestra.run.smithi019.stdout: "log_level": { 2024-09-10T22:37:55.154 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_level", 2024-09-10T22:37:55.154 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-10T22:37:55.154 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:55.154 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:55.154 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-10T22:37:55.155 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:55.155 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:55.155 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-10T22:37:55.155 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-10T22:37:55.155 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-10T22:37:55.155 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-10T22:37:55.155 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-10T22:37:55.155 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-10T22:37:55.155 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-10T22:37:55.155 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-10T22:37:55.155 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:55.155 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:55.155 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:55.155 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:55.156 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:55.156 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster": { 2024-09-10T22:37:55.156 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster", 2024-09-10T22:37:55.156 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-10T22:37:55.156 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:55.156 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:55.156 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-10T22:37:55.156 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:55.156 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:55.156 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:55.156 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:55.156 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:55.156 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:55.157 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:55.157 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:55.157 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster_level": { 2024-09-10T22:37:55.157 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster_level", 2024-09-10T22:37:55.157 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-10T22:37:55.157 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:55.157 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:55.157 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "info", 2024-09-10T22:37:55.157 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:55.157 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:55.157 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-10T22:37:55.157 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-10T22:37:55.157 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-10T22:37:55.158 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-10T22:37:55.158 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-10T22:37:55.158 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-10T22:37:55.158 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-10T22:37:55.158 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-10T22:37:55.158 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:55.158 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:55.158 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:55.158 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:55.158 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:55.158 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_file": { 2024-09-10T22:37:55.158 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_file", 2024-09-10T22:37:55.158 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-10T22:37:55.159 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:55.159 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:55.159 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-10T22:37:55.159 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:55.159 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:55.159 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:55.159 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:55.159 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:55.159 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:55.159 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:55.159 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:55.159 INFO:teuthology.orchestra.run.smithi019.stdout: "sqlite3_killpoint": { 2024-09-10T22:37:55.159 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "sqlite3_killpoint", 2024-09-10T22:37:55.160 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "int", 2024-09-10T22:37:55.160 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "dev", 2024-09-10T22:37:55.160 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:55.160 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "0", 2024-09-10T22:37:55.160 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:55.160 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:55.160 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:55.160 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:55.160 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:55.160 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:55.160 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:55.160 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-10T22:37:55.160 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-10T22:37:55.160 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:55.161 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-10T22:37:55.161 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "k8sevents", 2024-09-10T22:37:55.161 INFO:teuthology.orchestra.run.smithi019.stdout: "can_run": true, 2024-09-10T22:37:55.161 INFO:teuthology.orchestra.run.smithi019.stdout: "error_string": "", 2024-09-10T22:37:55.161 INFO:teuthology.orchestra.run.smithi019.stdout: "module_options": { 2024-09-10T22:37:55.161 INFO:teuthology.orchestra.run.smithi019.stdout: "ceph_event_retention_days": { 2024-09-10T22:37:55.161 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "ceph_event_retention_days", 2024-09-10T22:37:55.161 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "int", 2024-09-10T22:37:55.161 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:55.161 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-10T22:37:55.161 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "7", 2024-09-10T22:37:55.161 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:55.161 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:55.162 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:55.162 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "Days to hold ceph event information within local cache", 2024-09-10T22:37:55.162 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:55.162 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:55.162 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:55.162 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:55.162 INFO:teuthology.orchestra.run.smithi019.stdout: "config_check_secs": { 2024-09-10T22:37:55.162 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "config_check_secs", 2024-09-10T22:37:55.162 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "int", 2024-09-10T22:37:55.162 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:55.162 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-10T22:37:55.162 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "10", 2024-09-10T22:37:55.162 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "10", 2024-09-10T22:37:55.163 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:55.163 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:55.163 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2024-09-10T22:37:55.163 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:55.163 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:55.163 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:55.163 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:55.163 INFO:teuthology.orchestra.run.smithi019.stdout: "log_level": { 2024-09-10T22:37:55.163 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_level", 2024-09-10T22:37:55.163 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-10T22:37:55.163 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:55.163 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:55.163 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-10T22:37:55.163 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:55.164 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:55.164 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-10T22:37:55.164 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-10T22:37:55.164 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-10T22:37:55.164 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-10T22:37:55.164 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-10T22:37:55.164 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-10T22:37:55.164 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-10T22:37:55.164 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-10T22:37:55.164 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:55.164 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:55.164 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:55.164 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:55.165 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:55.165 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster": { 2024-09-10T22:37:55.165 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster", 2024-09-10T22:37:55.165 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-10T22:37:55.165 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:55.165 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:55.165 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-10T22:37:55.165 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:55.165 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:55.165 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:55.165 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:55.165 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:55.165 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:55.166 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:55.166 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:55.166 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster_level": { 2024-09-10T22:37:55.166 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster_level", 2024-09-10T22:37:55.166 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-10T22:37:55.166 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:55.166 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:55.166 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "info", 2024-09-10T22:37:55.166 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:55.166 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:55.166 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-10T22:37:55.166 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-10T22:37:55.166 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-10T22:37:55.167 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-10T22:37:55.167 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-10T22:37:55.167 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-10T22:37:55.167 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-10T22:37:55.167 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-10T22:37:55.167 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:55.167 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:55.167 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:55.167 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:55.167 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:55.167 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_file": { 2024-09-10T22:37:55.167 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_file", 2024-09-10T22:37:55.167 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-10T22:37:55.167 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:55.168 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:55.168 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-10T22:37:55.168 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:55.168 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:55.168 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:55.168 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:55.168 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:55.168 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:55.168 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:55.168 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:55.168 INFO:teuthology.orchestra.run.smithi019.stdout: "sqlite3_killpoint": { 2024-09-10T22:37:55.168 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "sqlite3_killpoint", 2024-09-10T22:37:55.168 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "int", 2024-09-10T22:37:55.169 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "dev", 2024-09-10T22:37:55.169 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:55.169 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "0", 2024-09-10T22:37:55.169 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:55.169 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:55.169 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:55.169 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:55.169 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:55.169 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:55.169 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:55.169 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-10T22:37:55.169 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-10T22:37:55.169 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:55.170 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-10T22:37:55.170 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "localpool", 2024-09-10T22:37:55.170 INFO:teuthology.orchestra.run.smithi019.stdout: "can_run": true, 2024-09-10T22:37:55.170 INFO:teuthology.orchestra.run.smithi019.stdout: "error_string": "", 2024-09-10T22:37:55.170 INFO:teuthology.orchestra.run.smithi019.stdout: "module_options": { 2024-09-10T22:37:55.170 INFO:teuthology.orchestra.run.smithi019.stdout: "failure_domain": { 2024-09-10T22:37:55.170 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "failure_domain", 2024-09-10T22:37:55.170 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-10T22:37:55.170 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:55.170 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:55.170 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "host", 2024-09-10T22:37:55.170 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:55.170 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:55.170 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:55.171 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "failure domain for any created local pool", 2024-09-10T22:37:55.171 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2024-09-10T22:37:55.171 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:55.171 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:55.171 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:55.171 INFO:teuthology.orchestra.run.smithi019.stdout: "log_level": { 2024-09-10T22:37:55.171 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_level", 2024-09-10T22:37:55.171 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-10T22:37:55.171 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:55.171 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:55.171 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-10T22:37:55.171 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:55.171 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:55.171 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-10T22:37:55.172 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-10T22:37:55.172 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-10T22:37:55.172 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-10T22:37:55.172 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-10T22:37:55.172 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-10T22:37:55.172 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-10T22:37:55.172 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-10T22:37:55.172 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:55.172 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:55.172 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:55.172 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:55.172 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:55.172 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster": { 2024-09-10T22:37:55.173 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster", 2024-09-10T22:37:55.173 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-10T22:37:55.173 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:55.173 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:55.173 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-10T22:37:55.173 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:55.173 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:55.173 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:55.173 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:55.173 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:55.173 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:55.173 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:55.173 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:55.174 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster_level": { 2024-09-10T22:37:55.174 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster_level", 2024-09-10T22:37:55.174 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-10T22:37:55.174 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:55.174 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:55.174 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "info", 2024-09-10T22:37:55.174 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:55.174 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:55.174 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-10T22:37:55.174 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-10T22:37:55.174 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-10T22:37:55.174 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-10T22:37:55.174 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-10T22:37:55.175 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-10T22:37:55.175 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-10T22:37:55.175 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-10T22:37:55.175 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:55.175 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:55.175 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:55.175 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:55.175 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:55.175 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_file": { 2024-09-10T22:37:55.175 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_file", 2024-09-10T22:37:55.175 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-10T22:37:55.175 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:55.175 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:55.175 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-10T22:37:55.176 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:55.176 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:55.176 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:55.176 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:55.176 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:55.176 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:55.176 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:55.176 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:55.176 INFO:teuthology.orchestra.run.smithi019.stdout: "min_size": { 2024-09-10T22:37:55.176 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "min_size", 2024-09-10T22:37:55.176 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "int", 2024-09-10T22:37:55.176 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:55.176 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:55.177 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-10T22:37:55.177 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:55.177 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:55.177 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:55.177 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "default min_size for any created local pool", 2024-09-10T22:37:55.177 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2024-09-10T22:37:55.177 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:55.177 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:55.177 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:55.177 INFO:teuthology.orchestra.run.smithi019.stdout: "num_rep": { 2024-09-10T22:37:55.177 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "num_rep", 2024-09-10T22:37:55.177 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "int", 2024-09-10T22:37:55.177 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:55.177 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:55.178 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "3", 2024-09-10T22:37:55.178 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:55.178 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:55.178 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:55.178 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "default replica count for any created local pool", 2024-09-10T22:37:55.178 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:55.178 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:55.178 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:55.178 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:55.178 INFO:teuthology.orchestra.run.smithi019.stdout: "pg_num": { 2024-09-10T22:37:55.178 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "pg_num", 2024-09-10T22:37:55.178 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "int", 2024-09-10T22:37:55.178 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:55.179 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:55.179 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "128", 2024-09-10T22:37:55.179 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:55.179 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:55.179 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:55.179 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "default pg_num for any created local pool", 2024-09-10T22:37:55.179 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:55.179 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:55.179 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:55.179 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:55.179 INFO:teuthology.orchestra.run.smithi019.stdout: "prefix": { 2024-09-10T22:37:55.179 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "prefix", 2024-09-10T22:37:55.179 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-10T22:37:55.180 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:55.180 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:55.180 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-10T22:37:55.180 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:55.180 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:55.180 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:55.180 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "name prefix for any created local pool", 2024-09-10T22:37:55.180 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:55.180 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:55.180 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:55.180 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:55.180 INFO:teuthology.orchestra.run.smithi019.stdout: "sqlite3_killpoint": { 2024-09-10T22:37:55.180 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "sqlite3_killpoint", 2024-09-10T22:37:55.181 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "int", 2024-09-10T22:37:55.181 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "dev", 2024-09-10T22:37:55.181 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:55.181 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "0", 2024-09-10T22:37:55.181 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:55.181 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:55.181 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:55.181 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:55.181 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:55.181 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:55.181 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:55.181 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:55.181 INFO:teuthology.orchestra.run.smithi019.stdout: "subtree": { 2024-09-10T22:37:55.182 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "subtree", 2024-09-10T22:37:55.182 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-10T22:37:55.182 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:55.182 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:55.182 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "rack", 2024-09-10T22:37:55.182 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:55.182 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:55.182 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:55.182 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "CRUSH level for which to create a local pool", 2024-09-10T22:37:55.182 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2024-09-10T22:37:55.182 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:55.182 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:55.182 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-10T22:37:55.182 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-10T22:37:55.183 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:55.183 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-10T22:37:55.183 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "mds_autoscaler", 2024-09-10T22:37:55.183 INFO:teuthology.orchestra.run.smithi019.stdout: "can_run": true, 2024-09-10T22:37:55.183 INFO:teuthology.orchestra.run.smithi019.stdout: "error_string": "", 2024-09-10T22:37:55.183 INFO:teuthology.orchestra.run.smithi019.stdout: "module_options": { 2024-09-10T22:37:55.183 INFO:teuthology.orchestra.run.smithi019.stdout: "log_level": { 2024-09-10T22:37:55.183 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_level", 2024-09-10T22:37:55.183 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-10T22:37:55.183 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:55.183 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:55.183 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-10T22:37:55.184 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:55.184 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:55.184 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-10T22:37:55.184 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-10T22:37:55.184 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-10T22:37:55.184 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-10T22:37:55.184 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-10T22:37:55.184 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-10T22:37:55.184 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-10T22:37:55.184 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-10T22:37:55.184 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:55.184 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:55.184 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:55.184 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:55.185 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:55.185 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster": { 2024-09-10T22:37:55.185 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster", 2024-09-10T22:37:55.185 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-10T22:37:55.185 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:55.185 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:55.185 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-10T22:37:55.185 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:55.185 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:55.185 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:55.185 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:55.185 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:55.185 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:55.186 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:55.186 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:55.186 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster_level": { 2024-09-10T22:37:55.186 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster_level", 2024-09-10T22:37:55.186 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-10T22:37:55.186 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:55.186 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:55.186 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "info", 2024-09-10T22:37:55.186 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:55.186 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:55.186 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-10T22:37:55.186 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-10T22:37:55.186 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-10T22:37:55.187 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-10T22:37:55.187 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-10T22:37:55.187 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-10T22:37:55.187 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-10T22:37:55.187 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-10T22:37:55.187 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:55.187 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:55.187 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:55.187 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:55.187 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:55.187 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_file": { 2024-09-10T22:37:55.187 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_file", 2024-09-10T22:37:55.187 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-10T22:37:55.188 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:55.188 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:55.188 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-10T22:37:55.188 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:55.188 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:55.188 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:55.188 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:55.188 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:55.188 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:55.188 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:55.188 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:55.188 INFO:teuthology.orchestra.run.smithi019.stdout: "sqlite3_killpoint": { 2024-09-10T22:37:55.188 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "sqlite3_killpoint", 2024-09-10T22:37:55.189 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "int", 2024-09-10T22:37:55.189 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "dev", 2024-09-10T22:37:55.189 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:55.189 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "0", 2024-09-10T22:37:55.189 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:55.189 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:55.189 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:55.189 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:55.189 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:55.189 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:55.189 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:55.189 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-10T22:37:55.189 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-10T22:37:55.189 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:55.190 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-10T22:37:55.190 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "mirroring", 2024-09-10T22:37:55.190 INFO:teuthology.orchestra.run.smithi019.stdout: "can_run": true, 2024-09-10T22:37:55.190 INFO:teuthology.orchestra.run.smithi019.stdout: "error_string": "", 2024-09-10T22:37:55.190 INFO:teuthology.orchestra.run.smithi019.stdout: "module_options": { 2024-09-10T22:37:55.190 INFO:teuthology.orchestra.run.smithi019.stdout: "log_level": { 2024-09-10T22:37:55.190 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_level", 2024-09-10T22:37:55.190 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-10T22:37:55.190 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:55.190 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:55.190 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-10T22:37:55.190 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:55.191 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:55.191 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-10T22:37:55.191 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-10T22:37:55.191 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-10T22:37:55.191 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-10T22:37:55.191 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-10T22:37:55.191 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-10T22:37:55.191 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-10T22:37:55.191 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-10T22:37:55.191 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:55.191 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:55.191 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:55.191 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:55.191 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:55.192 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster": { 2024-09-10T22:37:55.192 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster", 2024-09-10T22:37:55.192 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-10T22:37:55.192 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:55.192 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:55.192 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-10T22:37:55.192 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:55.192 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:55.192 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:55.192 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:55.192 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:55.192 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:55.192 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:55.193 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:55.193 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster_level": { 2024-09-10T22:37:55.193 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster_level", 2024-09-10T22:37:55.193 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-10T22:37:55.193 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:55.193 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:55.193 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "info", 2024-09-10T22:37:55.193 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:55.193 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:55.193 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-10T22:37:55.193 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-10T22:37:55.193 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-10T22:37:55.194 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-10T22:37:55.194 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-10T22:37:55.194 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-10T22:37:55.194 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-10T22:37:55.194 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-10T22:37:55.194 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:55.194 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:55.194 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:55.194 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:55.194 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:55.194 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_file": { 2024-09-10T22:37:55.194 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_file", 2024-09-10T22:37:55.194 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-10T22:37:55.195 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:55.195 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:55.195 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-10T22:37:55.195 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:55.195 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:55.195 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:55.195 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:55.195 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:55.195 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:55.195 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:55.195 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:55.195 INFO:teuthology.orchestra.run.smithi019.stdout: "sqlite3_killpoint": { 2024-09-10T22:37:55.195 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "sqlite3_killpoint", 2024-09-10T22:37:55.196 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "int", 2024-09-10T22:37:55.196 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "dev", 2024-09-10T22:37:55.196 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:55.196 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "0", 2024-09-10T22:37:55.196 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:55.196 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:55.196 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:55.196 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:55.196 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:55.196 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:55.196 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:55.196 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-10T22:37:55.196 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-10T22:37:55.197 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:55.197 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-10T22:37:55.197 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "nfs", 2024-09-10T22:37:55.197 INFO:teuthology.orchestra.run.smithi019.stdout: "can_run": true, 2024-09-10T22:37:55.197 INFO:teuthology.orchestra.run.smithi019.stdout: "error_string": "", 2024-09-10T22:37:55.197 INFO:teuthology.orchestra.run.smithi019.stdout: "module_options": { 2024-09-10T22:37:55.197 INFO:teuthology.orchestra.run.smithi019.stdout: "log_level": { 2024-09-10T22:37:55.197 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_level", 2024-09-10T22:37:55.197 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-10T22:37:55.197 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:55.197 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:55.197 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-10T22:37:55.198 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:55.198 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:55.198 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-10T22:37:55.198 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-10T22:37:55.198 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-10T22:37:55.198 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-10T22:37:55.198 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-10T22:37:55.198 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-10T22:37:55.198 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-10T22:37:55.198 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-10T22:37:55.198 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:55.198 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:55.198 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:55.198 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:55.199 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:55.199 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster": { 2024-09-10T22:37:55.199 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster", 2024-09-10T22:37:55.199 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-10T22:37:55.199 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:55.199 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:55.199 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-10T22:37:55.199 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:55.199 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:55.199 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:55.199 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:55.199 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:55.199 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:55.200 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:55.200 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:55.200 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster_level": { 2024-09-10T22:37:55.200 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster_level", 2024-09-10T22:37:55.200 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-10T22:37:55.200 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:55.200 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:55.200 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "info", 2024-09-10T22:37:55.200 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:55.200 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:55.200 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-10T22:37:55.200 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-10T22:37:55.200 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-10T22:37:55.201 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-10T22:37:55.201 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-10T22:37:55.201 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-10T22:37:55.201 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-10T22:37:55.201 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-10T22:37:55.201 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:55.201 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:55.201 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:55.201 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:55.201 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:55.201 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_file": { 2024-09-10T22:37:55.201 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_file", 2024-09-10T22:37:55.201 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-10T22:37:55.202 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:55.202 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:55.202 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-10T22:37:55.202 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:55.202 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:55.202 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:55.202 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:55.202 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:55.202 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:55.202 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:55.202 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:55.202 INFO:teuthology.orchestra.run.smithi019.stdout: "sqlite3_killpoint": { 2024-09-10T22:37:55.202 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "sqlite3_killpoint", 2024-09-10T22:37:55.202 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "int", 2024-09-10T22:37:55.203 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "dev", 2024-09-10T22:37:55.203 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:55.203 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "0", 2024-09-10T22:37:55.203 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:55.203 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:55.203 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:55.203 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:55.203 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:55.203 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:55.203 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:55.203 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-10T22:37:55.203 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-10T22:37:55.203 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:55.203 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-10T22:37:55.204 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "orchestrator", 2024-09-10T22:37:55.204 INFO:teuthology.orchestra.run.smithi019.stdout: "can_run": true, 2024-09-10T22:37:55.204 INFO:teuthology.orchestra.run.smithi019.stdout: "error_string": "", 2024-09-10T22:37:55.204 INFO:teuthology.orchestra.run.smithi019.stdout: "module_options": { 2024-09-10T22:37:55.204 INFO:teuthology.orchestra.run.smithi019.stdout: "fail_fs": { 2024-09-10T22:37:55.204 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "fail_fs", 2024-09-10T22:37:55.204 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-10T22:37:55.204 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:55.204 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-10T22:37:55.204 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-10T22:37:55.204 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:55.204 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:55.204 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:55.204 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2024-09-10T22:37:55.205 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:55.205 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:55.205 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:55.205 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:55.205 INFO:teuthology.orchestra.run.smithi019.stdout: "log_level": { 2024-09-10T22:37:55.205 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_level", 2024-09-10T22:37:55.205 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-10T22:37:55.205 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:55.205 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:55.205 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-10T22:37:55.205 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:55.205 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:55.205 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-10T22:37:55.206 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-10T22:37:55.206 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-10T22:37:55.206 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-10T22:37:55.206 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-10T22:37:55.206 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-10T22:37:55.206 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-10T22:37:55.206 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-10T22:37:55.206 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:55.206 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:55.206 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:55.206 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:55.206 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:55.206 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster": { 2024-09-10T22:37:55.206 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster", 2024-09-10T22:37:55.207 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-10T22:37:55.207 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:55.207 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:55.207 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-10T22:37:55.207 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:55.207 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:55.207 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:55.207 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:55.207 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:55.207 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:55.207 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:55.207 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:55.207 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster_level": { 2024-09-10T22:37:55.208 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster_level", 2024-09-10T22:37:55.208 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-10T22:37:55.208 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:55.208 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:55.208 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "info", 2024-09-10T22:37:55.208 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:55.208 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:55.208 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-10T22:37:55.208 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-10T22:37:55.208 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-10T22:37:55.208 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-10T22:37:55.208 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-10T22:37:55.208 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-10T22:37:55.209 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-10T22:37:55.209 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-10T22:37:55.209 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:55.209 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:55.209 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:55.209 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:55.209 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:55.209 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_file": { 2024-09-10T22:37:55.209 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_file", 2024-09-10T22:37:55.209 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-10T22:37:55.209 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:55.209 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:55.209 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-10T22:37:55.210 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:55.210 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:55.210 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:55.210 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:55.210 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:55.210 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:55.210 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:55.210 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:55.210 INFO:teuthology.orchestra.run.smithi019.stdout: "orchestrator": { 2024-09-10T22:37:55.210 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "orchestrator", 2024-09-10T22:37:55.210 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-10T22:37:55.210 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:55.210 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:55.211 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-10T22:37:55.211 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:55.211 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:55.211 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-10T22:37:55.211 INFO:teuthology.orchestra.run.smithi019.stdout: "cephadm", 2024-09-10T22:37:55.211 INFO:teuthology.orchestra.run.smithi019.stdout: "rook", 2024-09-10T22:37:55.211 INFO:teuthology.orchestra.run.smithi019.stdout: "test_orchestrator" 2024-09-10T22:37:55.211 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-10T22:37:55.211 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "Orchestrator backend", 2024-09-10T22:37:55.211 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:55.211 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:55.211 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:55.211 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:55.212 INFO:teuthology.orchestra.run.smithi019.stdout: "sqlite3_killpoint": { 2024-09-10T22:37:55.212 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "sqlite3_killpoint", 2024-09-10T22:37:55.212 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "int", 2024-09-10T22:37:55.212 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "dev", 2024-09-10T22:37:55.212 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:55.212 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "0", 2024-09-10T22:37:55.212 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:55.212 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:55.212 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:55.212 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:55.212 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:55.212 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:55.213 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:55.213 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-10T22:37:55.213 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-10T22:37:55.213 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:55.213 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-10T22:37:55.213 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "osd_perf_query", 2024-09-10T22:37:55.213 INFO:teuthology.orchestra.run.smithi019.stdout: "can_run": true, 2024-09-10T22:37:55.213 INFO:teuthology.orchestra.run.smithi019.stdout: "error_string": "", 2024-09-10T22:37:55.213 INFO:teuthology.orchestra.run.smithi019.stdout: "module_options": { 2024-09-10T22:37:55.213 INFO:teuthology.orchestra.run.smithi019.stdout: "log_level": { 2024-09-10T22:37:55.213 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_level", 2024-09-10T22:37:55.213 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-10T22:37:55.213 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:55.214 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:55.214 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-10T22:37:55.214 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:55.214 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:55.214 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-10T22:37:55.214 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-10T22:37:55.214 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-10T22:37:55.214 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-10T22:37:55.214 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-10T22:37:55.214 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-10T22:37:55.214 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-10T22:37:55.214 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-10T22:37:55.214 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:55.215 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:55.215 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:55.215 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:55.215 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:55.215 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster": { 2024-09-10T22:37:55.215 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster", 2024-09-10T22:37:55.215 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-10T22:37:55.215 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:55.215 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:55.215 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-10T22:37:55.215 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:55.215 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:55.215 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:55.215 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:55.216 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:55.216 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:55.216 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:55.216 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:55.216 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster_level": { 2024-09-10T22:37:55.216 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster_level", 2024-09-10T22:37:55.216 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-10T22:37:55.216 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:55.216 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:55.216 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "info", 2024-09-10T22:37:55.216 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:55.216 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:55.216 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-10T22:37:55.217 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-10T22:37:55.217 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-10T22:37:55.217 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-10T22:37:55.217 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-10T22:37:55.217 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-10T22:37:55.217 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-10T22:37:55.217 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-10T22:37:55.217 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:55.217 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:55.217 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:55.217 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:55.217 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:55.218 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_file": { 2024-09-10T22:37:55.218 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_file", 2024-09-10T22:37:55.218 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-10T22:37:55.218 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:55.218 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:55.218 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-10T22:37:55.218 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:55.218 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:55.218 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:55.218 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:55.218 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:55.218 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:55.218 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:55.218 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:55.218 INFO:teuthology.orchestra.run.smithi019.stdout: "sqlite3_killpoint": { 2024-09-10T22:37:55.219 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "sqlite3_killpoint", 2024-09-10T22:37:55.219 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "int", 2024-09-10T22:37:55.219 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "dev", 2024-09-10T22:37:55.219 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:55.219 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "0", 2024-09-10T22:37:55.219 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:55.219 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:55.219 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:55.219 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:55.219 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:55.219 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:55.219 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:55.219 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-10T22:37:55.220 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-10T22:37:55.220 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:55.220 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-10T22:37:55.220 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "osd_support", 2024-09-10T22:37:55.220 INFO:teuthology.orchestra.run.smithi019.stdout: "can_run": true, 2024-09-10T22:37:55.220 INFO:teuthology.orchestra.run.smithi019.stdout: "error_string": "", 2024-09-10T22:37:55.220 INFO:teuthology.orchestra.run.smithi019.stdout: "module_options": { 2024-09-10T22:37:55.220 INFO:teuthology.orchestra.run.smithi019.stdout: "log_level": { 2024-09-10T22:37:55.220 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_level", 2024-09-10T22:37:55.220 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-10T22:37:55.220 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:55.220 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:55.220 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-10T22:37:55.221 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:55.221 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:55.221 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-10T22:37:55.221 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-10T22:37:55.221 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-10T22:37:55.221 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-10T22:37:55.221 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-10T22:37:55.221 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-10T22:37:55.221 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-10T22:37:55.221 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-10T22:37:55.221 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:55.221 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:55.221 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:55.221 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:55.222 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:55.222 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster": { 2024-09-10T22:37:55.222 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster", 2024-09-10T22:37:55.222 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-10T22:37:55.222 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:55.222 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:55.222 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-10T22:37:55.222 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:55.222 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:55.222 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:55.222 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:55.222 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:55.222 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:55.223 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:55.223 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:55.223 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster_level": { 2024-09-10T22:37:55.223 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster_level", 2024-09-10T22:37:55.223 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-10T22:37:55.223 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:55.223 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:55.223 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "info", 2024-09-10T22:37:55.223 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:55.223 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:55.223 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-10T22:37:55.223 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-10T22:37:55.223 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-10T22:37:55.223 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-10T22:37:55.224 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-10T22:37:55.224 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-10T22:37:55.224 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-10T22:37:55.224 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-10T22:37:55.224 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:55.224 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:55.224 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:55.224 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:55.224 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:55.224 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_file": { 2024-09-10T22:37:55.224 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_file", 2024-09-10T22:37:55.224 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-10T22:37:55.224 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:55.225 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:55.225 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-10T22:37:55.225 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:55.225 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:55.225 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:55.225 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:55.225 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:55.225 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:55.225 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:55.225 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:55.225 INFO:teuthology.orchestra.run.smithi019.stdout: "sqlite3_killpoint": { 2024-09-10T22:37:55.225 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "sqlite3_killpoint", 2024-09-10T22:37:55.225 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "int", 2024-09-10T22:37:55.225 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "dev", 2024-09-10T22:37:55.226 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:55.226 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "0", 2024-09-10T22:37:55.226 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:55.226 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:55.226 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:55.226 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:55.226 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:55.226 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:55.226 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:55.226 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-10T22:37:55.226 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-10T22:37:55.226 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:55.226 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-10T22:37:55.227 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "pg_autoscaler", 2024-09-10T22:37:55.227 INFO:teuthology.orchestra.run.smithi019.stdout: "can_run": true, 2024-09-10T22:37:55.227 INFO:teuthology.orchestra.run.smithi019.stdout: "error_string": "", 2024-09-10T22:37:55.227 INFO:teuthology.orchestra.run.smithi019.stdout: "module_options": { 2024-09-10T22:37:55.227 INFO:teuthology.orchestra.run.smithi019.stdout: "log_level": { 2024-09-10T22:37:55.227 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_level", 2024-09-10T22:37:55.227 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-10T22:37:55.227 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:55.227 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:55.227 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-10T22:37:55.227 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:55.227 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:55.227 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-10T22:37:55.227 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-10T22:37:55.228 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-10T22:37:55.228 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-10T22:37:55.228 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-10T22:37:55.228 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-10T22:37:55.228 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-10T22:37:55.228 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-10T22:37:55.228 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:55.228 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:55.228 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:55.228 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:55.228 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:55.228 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster": { 2024-09-10T22:37:55.229 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster", 2024-09-10T22:37:55.229 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-10T22:37:55.229 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:55.229 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:55.229 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-10T22:37:55.229 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:55.229 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:55.229 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:55.229 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:55.229 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:55.229 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:55.229 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:55.229 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:55.230 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster_level": { 2024-09-10T22:37:55.230 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster_level", 2024-09-10T22:37:55.230 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-10T22:37:55.230 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:55.230 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:55.230 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "info", 2024-09-10T22:37:55.230 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:55.230 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:55.230 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-10T22:37:55.230 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-10T22:37:55.230 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-10T22:37:55.230 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-10T22:37:55.230 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-10T22:37:55.230 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-10T22:37:55.231 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-10T22:37:55.231 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-10T22:37:55.231 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:55.231 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:55.231 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:55.231 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:55.231 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:55.231 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_file": { 2024-09-10T22:37:55.231 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_file", 2024-09-10T22:37:55.231 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-10T22:37:55.231 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:55.231 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:55.231 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-10T22:37:55.232 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:55.232 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:55.232 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:55.232 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:55.232 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:55.232 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:55.232 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:55.232 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:55.232 INFO:teuthology.orchestra.run.smithi019.stdout: "sleep_interval": { 2024-09-10T22:37:55.232 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "sleep_interval", 2024-09-10T22:37:55.232 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "secs", 2024-09-10T22:37:55.232 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:55.233 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-10T22:37:55.233 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "60", 2024-09-10T22:37:55.233 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:55.233 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:55.233 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:55.233 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:55.233 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:55.233 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:55.233 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:55.233 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:55.233 INFO:teuthology.orchestra.run.smithi019.stdout: "sqlite3_killpoint": { 2024-09-10T22:37:55.233 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "sqlite3_killpoint", 2024-09-10T22:37:55.233 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "int", 2024-09-10T22:37:55.233 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "dev", 2024-09-10T22:37:55.234 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:55.234 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "0", 2024-09-10T22:37:55.234 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:55.234 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:55.234 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:55.234 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:55.234 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:55.234 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:55.234 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:55.234 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:55.234 INFO:teuthology.orchestra.run.smithi019.stdout: "threshold": { 2024-09-10T22:37:55.234 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "threshold", 2024-09-10T22:37:55.234 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "float", 2024-09-10T22:37:55.235 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:55.235 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-10T22:37:55.235 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "3.0", 2024-09-10T22:37:55.235 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "1.0", 2024-09-10T22:37:55.235 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:55.235 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:55.235 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "scaling threshold", 2024-09-10T22:37:55.235 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2024-09-10T22:37:55.235 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:55.235 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:55.235 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-10T22:37:55.235 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-10T22:37:55.235 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:55.235 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-10T22:37:55.236 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "progress", 2024-09-10T22:37:55.236 INFO:teuthology.orchestra.run.smithi019.stdout: "can_run": true, 2024-09-10T22:37:55.236 INFO:teuthology.orchestra.run.smithi019.stdout: "error_string": "", 2024-09-10T22:37:55.236 INFO:teuthology.orchestra.run.smithi019.stdout: "module_options": { 2024-09-10T22:37:55.236 INFO:teuthology.orchestra.run.smithi019.stdout: "allow_pg_recovery_event": { 2024-09-10T22:37:55.236 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "allow_pg_recovery_event", 2024-09-10T22:37:55.236 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-10T22:37:55.236 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:55.236 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:55.236 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-10T22:37:55.236 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:55.236 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:55.236 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:55.236 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "allow the module to show pg recovery progress", 2024-09-10T22:37:55.237 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:55.237 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:55.237 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:55.237 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:55.237 INFO:teuthology.orchestra.run.smithi019.stdout: "enabled": { 2024-09-10T22:37:55.237 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "enabled", 2024-09-10T22:37:55.237 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-10T22:37:55.237 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:55.237 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-10T22:37:55.237 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "True", 2024-09-10T22:37:55.237 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:55.237 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:55.237 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:55.238 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:55.238 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:55.238 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:55.238 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:55.238 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:55.238 INFO:teuthology.orchestra.run.smithi019.stdout: "log_level": { 2024-09-10T22:37:55.238 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_level", 2024-09-10T22:37:55.238 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-10T22:37:55.238 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:55.238 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:55.238 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-10T22:37:55.238 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:55.238 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:55.239 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-10T22:37:55.239 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-10T22:37:55.239 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-10T22:37:55.239 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-10T22:37:55.239 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-10T22:37:55.239 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-10T22:37:55.239 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-10T22:37:55.239 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-10T22:37:55.239 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:55.239 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:55.239 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:55.239 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:55.239 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:55.239 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster": { 2024-09-10T22:37:55.240 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster", 2024-09-10T22:37:55.240 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-10T22:37:55.240 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:55.240 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:55.240 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-10T22:37:55.240 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:55.240 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:55.240 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:55.240 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:55.240 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:55.240 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:55.240 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:55.240 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:55.241 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster_level": { 2024-09-10T22:37:55.241 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster_level", 2024-09-10T22:37:55.241 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-10T22:37:55.241 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:55.241 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:55.241 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "info", 2024-09-10T22:37:55.241 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:55.241 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:55.241 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-10T22:37:55.241 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-10T22:37:55.241 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-10T22:37:55.241 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-10T22:37:55.241 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-10T22:37:55.241 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-10T22:37:55.242 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-10T22:37:55.242 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-10T22:37:55.242 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:55.242 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:55.242 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:55.242 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:55.242 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:55.242 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_file": { 2024-09-10T22:37:55.242 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_file", 2024-09-10T22:37:55.242 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-10T22:37:55.242 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:55.242 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:55.242 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-10T22:37:55.242 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:55.243 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:55.243 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:55.243 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:55.243 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:55.243 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:55.243 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:55.243 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:55.243 INFO:teuthology.orchestra.run.smithi019.stdout: "max_completed_events": { 2024-09-10T22:37:55.243 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "max_completed_events", 2024-09-10T22:37:55.243 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "int", 2024-09-10T22:37:55.243 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:55.243 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:55.243 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "50", 2024-09-10T22:37:55.243 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:55.244 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:55.244 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:55.244 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "number of past completed events to remember", 2024-09-10T22:37:55.244 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:55.244 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:55.244 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:55.244 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:55.244 INFO:teuthology.orchestra.run.smithi019.stdout: "sleep_interval": { 2024-09-10T22:37:55.244 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "sleep_interval", 2024-09-10T22:37:55.244 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "secs", 2024-09-10T22:37:55.244 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:55.244 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:55.244 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "5", 2024-09-10T22:37:55.245 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:55.245 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:55.245 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:55.245 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "how long the module is going to sleep", 2024-09-10T22:37:55.245 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:55.245 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:55.245 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:55.245 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:55.245 INFO:teuthology.orchestra.run.smithi019.stdout: "sqlite3_killpoint": { 2024-09-10T22:37:55.245 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "sqlite3_killpoint", 2024-09-10T22:37:55.245 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "int", 2024-09-10T22:37:55.245 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "dev", 2024-09-10T22:37:55.245 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:55.246 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "0", 2024-09-10T22:37:55.246 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:55.246 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:55.246 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:55.246 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:55.246 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:55.246 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:55.246 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:55.246 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-10T22:37:55.246 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-10T22:37:55.246 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:55.246 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-10T22:37:55.246 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "prometheus", 2024-09-10T22:37:55.247 INFO:teuthology.orchestra.run.smithi019.stdout: "can_run": true, 2024-09-10T22:37:55.247 INFO:teuthology.orchestra.run.smithi019.stdout: "error_string": "", 2024-09-10T22:37:55.247 INFO:teuthology.orchestra.run.smithi019.stdout: "module_options": { 2024-09-10T22:37:55.247 INFO:teuthology.orchestra.run.smithi019.stdout: "cache": { 2024-09-10T22:37:55.247 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "cache", 2024-09-10T22:37:55.247 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-10T22:37:55.247 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:55.247 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-10T22:37:55.247 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "True", 2024-09-10T22:37:55.247 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:55.247 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:55.247 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:55.247 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:55.248 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:55.248 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:55.248 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:55.248 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:55.248 INFO:teuthology.orchestra.run.smithi019.stdout: "exclude_perf_counters": { 2024-09-10T22:37:55.248 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "exclude_perf_counters", 2024-09-10T22:37:55.248 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-10T22:37:55.248 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:55.248 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:55.248 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "True", 2024-09-10T22:37:55.248 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:55.248 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:55.248 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:55.249 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "Do not include perf-counters in the metrics output", 2024-09-10T22:37:55.249 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2024-09-10T22:37:55.249 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:55.249 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:55.249 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:55.249 INFO:teuthology.orchestra.run.smithi019.stdout: "log_level": { 2024-09-10T22:37:55.249 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_level", 2024-09-10T22:37:55.249 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-10T22:37:55.249 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:55.249 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:55.249 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-10T22:37:55.249 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:55.249 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:55.250 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-10T22:37:55.250 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-10T22:37:55.250 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-10T22:37:55.250 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-10T22:37:55.250 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-10T22:37:55.250 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-10T22:37:55.250 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-10T22:37:55.250 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-10T22:37:55.250 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:55.250 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:55.250 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:55.250 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:55.250 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:55.250 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster": { 2024-09-10T22:37:55.251 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster", 2024-09-10T22:37:55.251 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-10T22:37:55.251 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:55.251 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:55.251 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-10T22:37:55.251 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:55.251 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:55.251 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:55.251 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:55.251 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:55.251 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:55.251 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:55.251 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:55.252 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster_level": { 2024-09-10T22:37:55.252 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster_level", 2024-09-10T22:37:55.252 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-10T22:37:55.252 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:55.252 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:55.252 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "info", 2024-09-10T22:37:55.252 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:55.252 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:55.252 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-10T22:37:55.252 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-10T22:37:55.252 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-10T22:37:55.252 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-10T22:37:55.253 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-10T22:37:55.253 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-10T22:37:55.253 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-10T22:37:55.253 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-10T22:37:55.253 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:55.253 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:55.253 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:55.253 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:55.253 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:55.253 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_file": { 2024-09-10T22:37:55.253 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_file", 2024-09-10T22:37:55.253 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-10T22:37:55.253 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:55.253 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:55.254 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-10T22:37:55.254 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:55.254 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:55.254 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:55.254 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:55.254 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:55.254 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:55.254 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:55.254 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:55.254 INFO:teuthology.orchestra.run.smithi019.stdout: "rbd_stats_pools": { 2024-09-10T22:37:55.254 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "rbd_stats_pools", 2024-09-10T22:37:55.254 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-10T22:37:55.254 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:55.254 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-10T22:37:55.255 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-10T22:37:55.255 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:55.255 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:55.255 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:55.255 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:55.255 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:55.255 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:55.255 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:55.255 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:55.255 INFO:teuthology.orchestra.run.smithi019.stdout: "rbd_stats_pools_refresh_interval": { 2024-09-10T22:37:55.255 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "rbd_stats_pools_refresh_interval", 2024-09-10T22:37:55.255 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "int", 2024-09-10T22:37:55.255 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:55.256 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-10T22:37:55.256 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "300", 2024-09-10T22:37:55.256 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:55.256 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:55.256 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:55.256 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:55.256 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:55.256 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:55.256 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:55.256 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:55.256 INFO:teuthology.orchestra.run.smithi019.stdout: "scrape_interval": { 2024-09-10T22:37:55.256 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "scrape_interval", 2024-09-10T22:37:55.256 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "float", 2024-09-10T22:37:55.256 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:55.257 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-10T22:37:55.257 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "15.0", 2024-09-10T22:37:55.257 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:55.257 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:55.257 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:55.257 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:55.257 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:55.257 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:55.257 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:55.257 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:55.257 INFO:teuthology.orchestra.run.smithi019.stdout: "server_addr": { 2024-09-10T22:37:55.257 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "server_addr", 2024-09-10T22:37:55.257 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-10T22:37:55.257 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:55.258 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-10T22:37:55.258 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "::", 2024-09-10T22:37:55.258 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:55.258 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:55.258 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:55.258 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2024-09-10T22:37:55.258 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:55.258 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:55.258 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:55.258 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:55.258 INFO:teuthology.orchestra.run.smithi019.stdout: "server_port": { 2024-09-10T22:37:55.258 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "server_port", 2024-09-10T22:37:55.258 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "int", 2024-09-10T22:37:55.259 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:55.259 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:55.259 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "9283", 2024-09-10T22:37:55.259 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:55.259 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:55.259 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:55.259 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "the port on which the module listens for HTTP requests", 2024-09-10T22:37:55.259 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:55.259 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:55.259 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:55.259 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:55.259 INFO:teuthology.orchestra.run.smithi019.stdout: "sqlite3_killpoint": { 2024-09-10T22:37:55.259 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "sqlite3_killpoint", 2024-09-10T22:37:55.260 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "int", 2024-09-10T22:37:55.260 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "dev", 2024-09-10T22:37:55.260 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:55.260 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "0", 2024-09-10T22:37:55.260 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:55.260 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:55.260 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:55.260 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:55.260 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:55.260 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:55.260 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:55.260 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:55.260 INFO:teuthology.orchestra.run.smithi019.stdout: "stale_cache_strategy": { 2024-09-10T22:37:55.261 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "stale_cache_strategy", 2024-09-10T22:37:55.261 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-10T22:37:55.261 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:55.261 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-10T22:37:55.261 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "log", 2024-09-10T22:37:55.261 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:55.261 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:55.261 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:55.261 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:55.261 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:55.261 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:55.261 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:55.261 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:55.262 INFO:teuthology.orchestra.run.smithi019.stdout: "standby_behaviour": { 2024-09-10T22:37:55.262 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "standby_behaviour", 2024-09-10T22:37:55.262 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-10T22:37:55.262 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:55.262 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:55.262 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "default", 2024-09-10T22:37:55.262 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:55.262 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:55.262 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-10T22:37:55.262 INFO:teuthology.orchestra.run.smithi019.stdout: "default", 2024-09-10T22:37:55.262 INFO:teuthology.orchestra.run.smithi019.stdout: "error" 2024-09-10T22:37:55.262 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-10T22:37:55.262 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:55.263 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:55.263 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:55.263 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:55.263 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:55.263 INFO:teuthology.orchestra.run.smithi019.stdout: "standby_error_status_code": { 2024-09-10T22:37:55.263 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "standby_error_status_code", 2024-09-10T22:37:55.263 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "int", 2024-09-10T22:37:55.263 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:55.263 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:55.263 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "500", 2024-09-10T22:37:55.263 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "400", 2024-09-10T22:37:55.263 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "599", 2024-09-10T22:37:55.263 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:55.264 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:55.264 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:55.264 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:55.264 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:55.264 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-10T22:37:55.264 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-10T22:37:55.264 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:55.264 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-10T22:37:55.264 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "rbd_support", 2024-09-10T22:37:55.264 INFO:teuthology.orchestra.run.smithi019.stdout: "can_run": true, 2024-09-10T22:37:55.264 INFO:teuthology.orchestra.run.smithi019.stdout: "error_string": "", 2024-09-10T22:37:55.264 INFO:teuthology.orchestra.run.smithi019.stdout: "module_options": { 2024-09-10T22:37:55.264 INFO:teuthology.orchestra.run.smithi019.stdout: "log_level": { 2024-09-10T22:37:55.265 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_level", 2024-09-10T22:37:55.265 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-10T22:37:55.265 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:55.265 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:55.265 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-10T22:37:55.265 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:55.265 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:55.265 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-10T22:37:55.265 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-10T22:37:55.265 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-10T22:37:55.265 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-10T22:37:55.265 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-10T22:37:55.265 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-10T22:37:55.265 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-10T22:37:55.266 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-10T22:37:55.266 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:55.266 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:55.266 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:55.266 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:55.266 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:55.266 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster": { 2024-09-10T22:37:55.266 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster", 2024-09-10T22:37:55.266 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-10T22:37:55.266 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:55.266 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:55.266 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-10T22:37:55.266 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:55.267 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:55.267 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:55.267 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:55.267 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:55.267 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:55.267 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:55.267 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:55.267 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster_level": { 2024-09-10T22:37:55.267 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster_level", 2024-09-10T22:37:55.267 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-10T22:37:55.267 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:55.267 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:55.267 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "info", 2024-09-10T22:37:55.268 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:55.268 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:55.268 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-10T22:37:55.268 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-10T22:37:55.268 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-10T22:37:55.268 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-10T22:37:55.268 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-10T22:37:55.268 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-10T22:37:55.268 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-10T22:37:55.268 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-10T22:37:55.268 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:55.268 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:55.268 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:55.269 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:55.269 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:55.269 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_file": { 2024-09-10T22:37:55.269 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_file", 2024-09-10T22:37:55.269 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-10T22:37:55.269 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:55.269 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:55.269 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-10T22:37:55.269 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:55.269 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:55.269 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:55.269 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:55.269 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:55.270 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:55.270 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:55.270 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:55.270 INFO:teuthology.orchestra.run.smithi019.stdout: "max_concurrent_snap_create": { 2024-09-10T22:37:55.270 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "max_concurrent_snap_create", 2024-09-10T22:37:55.270 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "int", 2024-09-10T22:37:55.270 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:55.270 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-10T22:37:55.270 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "10", 2024-09-10T22:37:55.270 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:55.270 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:55.270 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:55.270 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:55.271 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:55.271 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:55.271 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:55.271 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:55.271 INFO:teuthology.orchestra.run.smithi019.stdout: "mirror_snapshot_schedule": { 2024-09-10T22:37:55.271 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "mirror_snapshot_schedule", 2024-09-10T22:37:55.271 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-10T22:37:55.271 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:55.271 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-10T22:37:55.271 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-10T22:37:55.271 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:55.271 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:55.271 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:55.271 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:55.272 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:55.272 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:55.272 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:55.272 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:55.272 INFO:teuthology.orchestra.run.smithi019.stdout: "sqlite3_killpoint": { 2024-09-10T22:37:55.272 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "sqlite3_killpoint", 2024-09-10T22:37:55.272 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "int", 2024-09-10T22:37:55.272 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "dev", 2024-09-10T22:37:55.272 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:55.272 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "0", 2024-09-10T22:37:55.272 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:55.272 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:55.272 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:55.273 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:55.273 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:55.273 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:55.273 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:55.273 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:55.273 INFO:teuthology.orchestra.run.smithi019.stdout: "trash_purge_schedule": { 2024-09-10T22:37:55.273 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "trash_purge_schedule", 2024-09-10T22:37:55.273 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-10T22:37:55.273 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:55.273 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-10T22:37:55.273 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-10T22:37:55.273 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:55.273 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:55.274 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:55.274 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:55.274 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:55.274 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:55.274 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:55.274 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-10T22:37:55.274 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-10T22:37:55.274 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:55.274 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-10T22:37:55.274 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "restful", 2024-09-10T22:37:55.274 INFO:teuthology.orchestra.run.smithi019.stdout: "can_run": true, 2024-09-10T22:37:55.274 INFO:teuthology.orchestra.run.smithi019.stdout: "error_string": "", 2024-09-10T22:37:55.274 INFO:teuthology.orchestra.run.smithi019.stdout: "module_options": { 2024-09-10T22:37:55.274 INFO:teuthology.orchestra.run.smithi019.stdout: "enable_auth": { 2024-09-10T22:37:55.275 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "enable_auth", 2024-09-10T22:37:55.275 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-10T22:37:55.275 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:55.275 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-10T22:37:55.275 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "True", 2024-09-10T22:37:55.275 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:55.275 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:55.275 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:55.275 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:55.275 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:55.275 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:55.275 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:55.275 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:55.276 INFO:teuthology.orchestra.run.smithi019.stdout: "key_file": { 2024-09-10T22:37:55.276 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "key_file", 2024-09-10T22:37:55.276 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-10T22:37:55.276 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:55.276 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-10T22:37:55.276 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-10T22:37:55.276 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:55.276 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:55.276 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:55.276 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:55.276 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:55.276 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:55.276 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:55.277 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:55.277 INFO:teuthology.orchestra.run.smithi019.stdout: "log_level": { 2024-09-10T22:37:55.277 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_level", 2024-09-10T22:37:55.277 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-10T22:37:55.277 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:55.277 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:55.277 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-10T22:37:55.277 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:55.277 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:55.277 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-10T22:37:55.277 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-10T22:37:55.277 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-10T22:37:55.277 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-10T22:37:55.277 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-10T22:37:55.278 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-10T22:37:55.278 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-10T22:37:55.278 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-10T22:37:55.278 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:55.278 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:55.278 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:55.278 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:55.278 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:55.278 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster": { 2024-09-10T22:37:55.278 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster", 2024-09-10T22:37:55.278 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-10T22:37:55.278 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:55.278 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:55.279 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-10T22:37:55.279 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:55.279 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:55.279 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:55.279 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:55.279 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:55.279 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:55.279 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:55.279 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:55.279 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster_level": { 2024-09-10T22:37:55.279 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster_level", 2024-09-10T22:37:55.279 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-10T22:37:55.279 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:55.280 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:55.280 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "info", 2024-09-10T22:37:55.280 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:55.280 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:55.280 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-10T22:37:55.280 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-10T22:37:55.280 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-10T22:37:55.280 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-10T22:37:55.280 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-10T22:37:55.280 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-10T22:37:55.280 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-10T22:37:55.280 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-10T22:37:55.280 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:55.280 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:55.281 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:55.281 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:55.281 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:55.281 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_file": { 2024-09-10T22:37:55.281 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_file", 2024-09-10T22:37:55.281 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-10T22:37:55.281 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:55.281 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:55.281 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-10T22:37:55.281 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:55.281 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:55.281 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:55.281 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:55.282 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:55.282 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:55.282 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:55.282 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:55.282 INFO:teuthology.orchestra.run.smithi019.stdout: "max_requests": { 2024-09-10T22:37:55.282 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "max_requests", 2024-09-10T22:37:55.282 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "int", 2024-09-10T22:37:55.282 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:55.282 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-10T22:37:55.282 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "500", 2024-09-10T22:37:55.282 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:55.282 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:55.283 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:55.283 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number.if un-finished request is removed, error message will be logged in the ceph-mgr log.", 2024-09-10T22:37:55.283 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:55.283 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:55.283 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:55.283 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:55.283 INFO:teuthology.orchestra.run.smithi019.stdout: "server_addr": { 2024-09-10T22:37:55.283 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "server_addr", 2024-09-10T22:37:55.283 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-10T22:37:55.283 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:55.283 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-10T22:37:55.283 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-10T22:37:55.283 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:55.283 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:55.284 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:55.284 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:55.284 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:55.284 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:55.284 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:55.284 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:55.284 INFO:teuthology.orchestra.run.smithi019.stdout: "server_port": { 2024-09-10T22:37:55.284 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "server_port", 2024-09-10T22:37:55.284 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-10T22:37:55.284 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:55.284 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-10T22:37:55.284 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-10T22:37:55.285 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:55.285 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:55.285 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:55.285 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:55.285 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:55.285 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:55.285 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:55.285 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:55.285 INFO:teuthology.orchestra.run.smithi019.stdout: "sqlite3_killpoint": { 2024-09-10T22:37:55.285 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "sqlite3_killpoint", 2024-09-10T22:37:55.285 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "int", 2024-09-10T22:37:55.285 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "dev", 2024-09-10T22:37:55.285 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:55.285 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "0", 2024-09-10T22:37:55.286 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:55.286 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:55.286 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:55.286 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:55.286 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:55.286 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:55.286 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:55.286 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-10T22:37:55.286 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-10T22:37:55.286 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:55.286 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-10T22:37:55.286 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "rgw", 2024-09-10T22:37:55.286 INFO:teuthology.orchestra.run.smithi019.stdout: "can_run": true, 2024-09-10T22:37:55.287 INFO:teuthology.orchestra.run.smithi019.stdout: "error_string": "", 2024-09-10T22:37:55.287 INFO:teuthology.orchestra.run.smithi019.stdout: "module_options": { 2024-09-10T22:37:55.287 INFO:teuthology.orchestra.run.smithi019.stdout: "log_level": { 2024-09-10T22:37:55.287 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_level", 2024-09-10T22:37:55.287 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-10T22:37:55.287 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:55.287 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:55.287 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-10T22:37:55.287 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:55.287 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:55.287 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-10T22:37:55.287 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-10T22:37:55.287 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-10T22:37:55.288 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-10T22:37:55.288 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-10T22:37:55.288 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-10T22:37:55.288 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-10T22:37:55.288 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-10T22:37:55.288 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:55.288 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:55.288 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:55.288 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:55.288 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:55.288 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster": { 2024-09-10T22:37:55.288 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster", 2024-09-10T22:37:55.288 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-10T22:37:55.289 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:55.289 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:55.289 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-10T22:37:55.289 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:55.289 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:55.289 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:55.289 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:55.289 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:55.289 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:55.289 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:55.289 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:55.289 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster_level": { 2024-09-10T22:37:55.289 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster_level", 2024-09-10T22:37:55.289 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-10T22:37:55.290 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:55.290 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:55.290 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "info", 2024-09-10T22:37:55.290 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:55.290 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:55.290 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-10T22:37:55.290 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-10T22:37:55.290 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-10T22:37:55.290 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-10T22:37:55.290 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-10T22:37:55.290 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-10T22:37:55.290 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-10T22:37:55.290 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-10T22:37:55.291 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:55.291 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:55.291 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:55.291 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:55.291 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:55.291 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_file": { 2024-09-10T22:37:55.291 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_file", 2024-09-10T22:37:55.291 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-10T22:37:55.291 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:55.291 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:55.291 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-10T22:37:55.291 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:55.291 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:55.292 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:55.292 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:55.292 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:55.292 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:55.292 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:55.292 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:55.292 INFO:teuthology.orchestra.run.smithi019.stdout: "secondary_zone_period_retry_limit": { 2024-09-10T22:37:55.292 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "secondary_zone_period_retry_limit", 2024-09-10T22:37:55.292 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "int", 2024-09-10T22:37:55.292 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:55.292 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-10T22:37:55.292 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "5", 2024-09-10T22:37:55.292 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:55.293 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:55.293 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:55.293 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "RGW module period update retry limit for secondary site", 2024-09-10T22:37:55.293 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:55.293 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:55.293 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:55.293 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:55.293 INFO:teuthology.orchestra.run.smithi019.stdout: "sqlite3_killpoint": { 2024-09-10T22:37:55.293 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "sqlite3_killpoint", 2024-09-10T22:37:55.293 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "int", 2024-09-10T22:37:55.293 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "dev", 2024-09-10T22:37:55.293 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:55.293 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "0", 2024-09-10T22:37:55.294 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:55.294 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:55.294 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:55.294 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:55.294 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:55.294 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:55.294 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:55.294 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-10T22:37:55.294 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-10T22:37:55.294 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:55.294 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-10T22:37:55.294 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "rook", 2024-09-10T22:37:55.294 INFO:teuthology.orchestra.run.smithi019.stdout: "can_run": true, 2024-09-10T22:37:55.294 INFO:teuthology.orchestra.run.smithi019.stdout: "error_string": "", 2024-09-10T22:37:55.295 INFO:teuthology.orchestra.run.smithi019.stdout: "module_options": { 2024-09-10T22:37:55.295 INFO:teuthology.orchestra.run.smithi019.stdout: "log_level": { 2024-09-10T22:37:55.295 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_level", 2024-09-10T22:37:55.295 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-10T22:37:55.295 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:55.295 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:55.295 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-10T22:37:55.295 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:55.295 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:55.295 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-10T22:37:55.295 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-10T22:37:55.295 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-10T22:37:55.295 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-10T22:37:55.296 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-10T22:37:55.296 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-10T22:37:55.296 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-10T22:37:55.296 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-10T22:37:55.296 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:55.296 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:55.296 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:55.296 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:55.296 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:55.296 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster": { 2024-09-10T22:37:55.296 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster", 2024-09-10T22:37:55.296 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-10T22:37:55.296 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:55.297 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:55.297 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-10T22:37:55.297 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:55.297 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:55.297 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:55.297 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:55.297 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:55.297 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:55.297 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:55.297 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:55.297 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster_level": { 2024-09-10T22:37:55.297 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster_level", 2024-09-10T22:37:55.297 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-10T22:37:55.298 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:55.298 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:55.298 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "info", 2024-09-10T22:37:55.298 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:55.298 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:55.298 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-10T22:37:55.298 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-10T22:37:55.298 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-10T22:37:55.298 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-10T22:37:55.298 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-10T22:37:55.298 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-10T22:37:55.298 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-10T22:37:55.298 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-10T22:37:55.298 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:55.299 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:55.299 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:55.299 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:55.299 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:55.299 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_file": { 2024-09-10T22:37:55.299 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_file", 2024-09-10T22:37:55.299 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-10T22:37:55.299 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:55.299 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:55.299 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-10T22:37:55.299 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:55.299 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:55.299 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:55.300 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:55.300 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:55.300 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:55.300 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:55.300 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:55.300 INFO:teuthology.orchestra.run.smithi019.stdout: "sqlite3_killpoint": { 2024-09-10T22:37:55.300 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "sqlite3_killpoint", 2024-09-10T22:37:55.300 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "int", 2024-09-10T22:37:55.300 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "dev", 2024-09-10T22:37:55.300 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:55.300 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "0", 2024-09-10T22:37:55.300 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:55.300 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:55.301 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:55.301 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:55.301 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:55.301 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:55.301 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:55.301 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:55.301 INFO:teuthology.orchestra.run.smithi019.stdout: "storage_class": { 2024-09-10T22:37:55.301 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "storage_class", 2024-09-10T22:37:55.301 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-10T22:37:55.301 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:55.301 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-10T22:37:55.301 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "local", 2024-09-10T22:37:55.301 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:55.302 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:55.302 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:55.302 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "storage class name for LSO-discovered PVs", 2024-09-10T22:37:55.302 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:55.302 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:55.302 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:55.302 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-10T22:37:55.302 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-10T22:37:55.302 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:55.302 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-10T22:37:55.302 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "selftest", 2024-09-10T22:37:55.302 INFO:teuthology.orchestra.run.smithi019.stdout: "can_run": true, 2024-09-10T22:37:55.302 INFO:teuthology.orchestra.run.smithi019.stdout: "error_string": "", 2024-09-10T22:37:55.303 INFO:teuthology.orchestra.run.smithi019.stdout: "module_options": { 2024-09-10T22:37:55.303 INFO:teuthology.orchestra.run.smithi019.stdout: "log_level": { 2024-09-10T22:37:55.303 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_level", 2024-09-10T22:37:55.303 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-10T22:37:55.303 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:55.303 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:55.303 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-10T22:37:55.303 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:55.303 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:55.303 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-10T22:37:55.303 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-10T22:37:55.303 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-10T22:37:55.303 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-10T22:37:55.303 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-10T22:37:55.304 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-10T22:37:55.304 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-10T22:37:55.304 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-10T22:37:55.304 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:55.304 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:55.304 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:55.304 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:55.304 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:55.304 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster": { 2024-09-10T22:37:55.304 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster", 2024-09-10T22:37:55.304 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-10T22:37:55.304 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:55.304 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:55.305 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-10T22:37:55.305 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:55.305 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:55.305 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:55.305 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:55.305 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:55.305 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:55.305 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:55.305 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:55.305 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster_level": { 2024-09-10T22:37:55.305 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster_level", 2024-09-10T22:37:55.305 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-10T22:37:55.305 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:55.306 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:55.306 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "info", 2024-09-10T22:37:55.306 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:55.306 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:55.306 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-10T22:37:55.306 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-10T22:37:55.306 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-10T22:37:55.306 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-10T22:37:55.306 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-10T22:37:55.306 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-10T22:37:55.306 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-10T22:37:55.306 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-10T22:37:55.306 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:55.306 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:55.307 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:55.307 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:55.307 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:55.307 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_file": { 2024-09-10T22:37:55.307 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_file", 2024-09-10T22:37:55.307 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-10T22:37:55.307 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:55.307 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:55.307 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-10T22:37:55.307 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:55.307 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:55.307 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:55.307 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:55.308 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:55.308 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:55.308 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:55.308 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:55.308 INFO:teuthology.orchestra.run.smithi019.stdout: "roption1": { 2024-09-10T22:37:55.308 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "roption1", 2024-09-10T22:37:55.308 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-10T22:37:55.308 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:55.308 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-10T22:37:55.308 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-10T22:37:55.308 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:55.308 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:55.308 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:55.308 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:55.309 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:55.309 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:55.309 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:55.309 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:55.309 INFO:teuthology.orchestra.run.smithi019.stdout: "roption2": { 2024-09-10T22:37:55.309 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "roption2", 2024-09-10T22:37:55.309 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-10T22:37:55.309 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:55.309 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-10T22:37:55.309 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "xyz", 2024-09-10T22:37:55.309 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:55.309 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:55.309 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:55.310 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:55.310 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:55.310 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:55.310 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:55.310 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:55.310 INFO:teuthology.orchestra.run.smithi019.stdout: "rwoption1": { 2024-09-10T22:37:55.310 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "rwoption1", 2024-09-10T22:37:55.310 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-10T22:37:55.310 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:55.310 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-10T22:37:55.310 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-10T22:37:55.310 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:55.310 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:55.310 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:55.311 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:55.311 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:55.311 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:55.311 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:55.311 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:55.311 INFO:teuthology.orchestra.run.smithi019.stdout: "rwoption2": { 2024-09-10T22:37:55.311 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "rwoption2", 2024-09-10T22:37:55.311 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "int", 2024-09-10T22:37:55.311 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:55.311 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-10T22:37:55.311 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-10T22:37:55.311 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:55.311 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:55.312 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:55.312 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:55.312 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:55.312 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:55.312 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:55.312 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:55.312 INFO:teuthology.orchestra.run.smithi019.stdout: "rwoption3": { 2024-09-10T22:37:55.312 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "rwoption3", 2024-09-10T22:37:55.312 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "float", 2024-09-10T22:37:55.312 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:55.312 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-10T22:37:55.312 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-10T22:37:55.312 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:55.313 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:55.313 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:55.313 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:55.313 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:55.313 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:55.313 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:55.313 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:55.313 INFO:teuthology.orchestra.run.smithi019.stdout: "rwoption4": { 2024-09-10T22:37:55.313 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "rwoption4", 2024-09-10T22:37:55.313 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-10T22:37:55.313 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:55.313 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-10T22:37:55.313 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-10T22:37:55.313 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:55.314 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:55.314 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:55.314 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:55.314 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:55.314 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:55.314 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:55.314 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:55.314 INFO:teuthology.orchestra.run.smithi019.stdout: "rwoption5": { 2024-09-10T22:37:55.314 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "rwoption5", 2024-09-10T22:37:55.314 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-10T22:37:55.314 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:55.314 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-10T22:37:55.314 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-10T22:37:55.315 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:55.315 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:55.315 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:55.315 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:55.315 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:55.315 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:55.315 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:55.315 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:55.315 INFO:teuthology.orchestra.run.smithi019.stdout: "rwoption6": { 2024-09-10T22:37:55.315 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "rwoption6", 2024-09-10T22:37:55.315 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-10T22:37:55.315 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:55.315 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-10T22:37:55.315 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "True", 2024-09-10T22:37:55.316 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:55.316 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:55.316 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:55.316 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:55.316 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:55.316 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:55.316 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:55.316 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:55.316 INFO:teuthology.orchestra.run.smithi019.stdout: "rwoption7": { 2024-09-10T22:37:55.316 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "rwoption7", 2024-09-10T22:37:55.316 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "int", 2024-09-10T22:37:55.316 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:55.317 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-10T22:37:55.317 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-10T22:37:55.317 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "1", 2024-09-10T22:37:55.317 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "42", 2024-09-10T22:37:55.317 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:55.317 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:55.317 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:55.317 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:55.317 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:55.317 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:55.317 INFO:teuthology.orchestra.run.smithi019.stdout: "sqlite3_killpoint": { 2024-09-10T22:37:55.317 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "sqlite3_killpoint", 2024-09-10T22:37:55.317 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "int", 2024-09-10T22:37:55.317 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "dev", 2024-09-10T22:37:55.318 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:55.318 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "0", 2024-09-10T22:37:55.318 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:55.318 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:55.318 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:55.318 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:55.318 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:55.318 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:55.318 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:55.318 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:55.318 INFO:teuthology.orchestra.run.smithi019.stdout: "testkey": { 2024-09-10T22:37:55.318 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "testkey", 2024-09-10T22:37:55.318 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-10T22:37:55.319 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:55.319 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-10T22:37:55.319 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-10T22:37:55.319 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:55.319 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:55.319 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:55.319 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:55.319 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:55.319 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:55.319 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:55.319 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:55.319 INFO:teuthology.orchestra.run.smithi019.stdout: "testlkey": { 2024-09-10T22:37:55.319 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "testlkey", 2024-09-10T22:37:55.320 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-10T22:37:55.320 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:55.320 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-10T22:37:55.320 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-10T22:37:55.320 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:55.320 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:55.320 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:55.320 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:55.320 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:55.320 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:55.320 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:55.320 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:55.320 INFO:teuthology.orchestra.run.smithi019.stdout: "testnewline": { 2024-09-10T22:37:55.321 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "testnewline", 2024-09-10T22:37:55.321 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-10T22:37:55.321 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:55.321 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-10T22:37:55.321 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-10T22:37:55.321 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:55.321 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:55.321 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:55.321 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:55.321 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:55.321 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:55.321 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:55.321 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-10T22:37:55.322 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-10T22:37:55.322 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:55.322 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-10T22:37:55.322 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "smb", 2024-09-10T22:37:55.322 INFO:teuthology.orchestra.run.smithi019.stdout: "can_run": true, 2024-09-10T22:37:55.322 INFO:teuthology.orchestra.run.smithi019.stdout: "error_string": "", 2024-09-10T22:37:55.322 INFO:teuthology.orchestra.run.smithi019.stdout: "module_options": { 2024-09-10T22:37:55.322 INFO:teuthology.orchestra.run.smithi019.stdout: "internal_store_backend": { 2024-09-10T22:37:55.322 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "internal_store_backend", 2024-09-10T22:37:55.322 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-10T22:37:55.322 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "dev", 2024-09-10T22:37:55.322 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-10T22:37:55.322 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-10T22:37:55.323 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:55.323 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:55.323 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:55.323 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "set internal store backend. for develoment and testing only", 2024-09-10T22:37:55.323 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:55.323 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:55.323 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:55.323 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:55.323 INFO:teuthology.orchestra.run.smithi019.stdout: "log_level": { 2024-09-10T22:37:55.323 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_level", 2024-09-10T22:37:55.323 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-10T22:37:55.323 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:55.323 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:55.324 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-10T22:37:55.324 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:55.324 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:55.324 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-10T22:37:55.324 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-10T22:37:55.324 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-10T22:37:55.324 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-10T22:37:55.324 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-10T22:37:55.324 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-10T22:37:55.324 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-10T22:37:55.324 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-10T22:37:55.324 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:55.324 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:55.325 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:55.325 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:55.325 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:55.325 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster": { 2024-09-10T22:37:55.325 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster", 2024-09-10T22:37:55.325 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-10T22:37:55.325 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:55.325 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:55.325 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-10T22:37:55.325 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:55.325 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:55.325 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:55.325 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:55.326 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:55.326 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:55.326 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:55.326 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:55.326 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster_level": { 2024-09-10T22:37:55.326 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster_level", 2024-09-10T22:37:55.326 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-10T22:37:55.326 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:55.326 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:55.326 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "info", 2024-09-10T22:37:55.326 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:55.326 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:55.326 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-10T22:37:55.327 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-10T22:37:55.327 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-10T22:37:55.327 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-10T22:37:55.327 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-10T22:37:55.327 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-10T22:37:55.327 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-10T22:37:55.327 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-10T22:37:55.327 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:55.327 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:55.327 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:55.327 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:55.327 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:55.327 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_file": { 2024-09-10T22:37:55.327 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_file", 2024-09-10T22:37:55.328 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-10T22:37:55.328 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:55.328 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:55.328 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-10T22:37:55.328 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:55.328 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:55.328 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:55.328 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:55.328 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:55.328 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:55.328 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:55.328 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:55.328 INFO:teuthology.orchestra.run.smithi019.stdout: "sqlite3_killpoint": { 2024-09-10T22:37:55.329 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "sqlite3_killpoint", 2024-09-10T22:37:55.329 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "int", 2024-09-10T22:37:55.329 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "dev", 2024-09-10T22:37:55.329 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:55.329 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "0", 2024-09-10T22:37:55.329 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:55.329 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:55.329 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:55.329 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:55.329 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:55.329 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:55.329 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:55.329 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:55.330 INFO:teuthology.orchestra.run.smithi019.stdout: "update_orchestration": { 2024-09-10T22:37:55.330 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "update_orchestration", 2024-09-10T22:37:55.330 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-10T22:37:55.330 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:55.330 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-10T22:37:55.330 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "True", 2024-09-10T22:37:55.330 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:55.330 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:55.330 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:55.330 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "automatically update orchestration when smb resources are changed", 2024-09-10T22:37:55.330 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:55.330 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:55.330 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:55.330 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-10T22:37:55.331 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-10T22:37:55.331 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:55.331 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-10T22:37:55.331 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "snap_schedule", 2024-09-10T22:37:55.331 INFO:teuthology.orchestra.run.smithi019.stdout: "can_run": true, 2024-09-10T22:37:55.331 INFO:teuthology.orchestra.run.smithi019.stdout: "error_string": "", 2024-09-10T22:37:55.331 INFO:teuthology.orchestra.run.smithi019.stdout: "module_options": { 2024-09-10T22:37:55.331 INFO:teuthology.orchestra.run.smithi019.stdout: "allow_m_granularity": { 2024-09-10T22:37:55.331 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "allow_m_granularity", 2024-09-10T22:37:55.331 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-10T22:37:55.331 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:55.331 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:55.331 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-10T22:37:55.332 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:55.332 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:55.332 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:55.332 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "allow minute scheduled snapshots", 2024-09-10T22:37:55.332 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:55.332 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:55.332 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:55.332 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:55.332 INFO:teuthology.orchestra.run.smithi019.stdout: "dump_on_update": { 2024-09-10T22:37:55.332 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "dump_on_update", 2024-09-10T22:37:55.332 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-10T22:37:55.332 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:55.332 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:55.333 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-10T22:37:55.333 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:55.333 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:55.333 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:55.333 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "dump database to debug log on update", 2024-09-10T22:37:55.333 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:55.333 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:55.333 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:55.333 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:55.333 INFO:teuthology.orchestra.run.smithi019.stdout: "log_level": { 2024-09-10T22:37:55.333 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_level", 2024-09-10T22:37:55.333 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-10T22:37:55.334 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:55.334 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:55.334 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-10T22:37:55.334 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:55.334 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:55.334 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-10T22:37:55.334 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-10T22:37:55.334 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-10T22:37:55.334 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-10T22:37:55.334 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-10T22:37:55.334 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-10T22:37:55.334 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-10T22:37:55.334 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-10T22:37:55.334 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:55.335 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:55.335 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:55.335 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:55.335 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:55.335 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster": { 2024-09-10T22:37:55.335 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster", 2024-09-10T22:37:55.335 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-10T22:37:55.335 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:55.335 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:55.335 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-10T22:37:55.335 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:55.335 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:55.335 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:55.336 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:55.336 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:55.336 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:55.336 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:55.336 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:55.336 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster_level": { 2024-09-10T22:37:55.336 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster_level", 2024-09-10T22:37:55.336 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-10T22:37:55.336 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:55.336 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:55.336 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "info", 2024-09-10T22:37:55.336 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:55.337 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:55.337 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-10T22:37:55.337 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-10T22:37:55.337 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-10T22:37:55.337 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-10T22:37:55.337 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-10T22:37:55.337 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-10T22:37:55.337 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-10T22:37:55.337 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-10T22:37:55.337 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:55.337 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:55.337 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:55.337 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:55.338 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:55.338 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_file": { 2024-09-10T22:37:55.338 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_file", 2024-09-10T22:37:55.338 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-10T22:37:55.338 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:55.338 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:55.338 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-10T22:37:55.338 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:55.338 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:55.338 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:55.338 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:55.338 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:55.338 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:55.339 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:55.339 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:55.339 INFO:teuthology.orchestra.run.smithi019.stdout: "sqlite3_killpoint": { 2024-09-10T22:37:55.339 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "sqlite3_killpoint", 2024-09-10T22:37:55.339 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "int", 2024-09-10T22:37:55.339 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "dev", 2024-09-10T22:37:55.339 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:55.339 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "0", 2024-09-10T22:37:55.339 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:55.339 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:55.339 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:55.339 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:55.339 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:55.339 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:55.340 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:55.340 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-10T22:37:55.340 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-10T22:37:55.340 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:55.340 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-10T22:37:55.340 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "stats", 2024-09-10T22:37:55.340 INFO:teuthology.orchestra.run.smithi019.stdout: "can_run": true, 2024-09-10T22:37:55.340 INFO:teuthology.orchestra.run.smithi019.stdout: "error_string": "", 2024-09-10T22:37:55.340 INFO:teuthology.orchestra.run.smithi019.stdout: "module_options": { 2024-09-10T22:37:55.340 INFO:teuthology.orchestra.run.smithi019.stdout: "log_level": { 2024-09-10T22:37:55.340 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_level", 2024-09-10T22:37:55.340 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-10T22:37:55.340 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:55.341 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:55.341 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-10T22:37:55.341 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:55.341 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:55.341 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-10T22:37:55.341 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-10T22:37:55.341 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-10T22:37:55.341 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-10T22:37:55.341 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-10T22:37:55.341 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-10T22:37:55.341 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-10T22:37:55.341 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-10T22:37:55.341 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:55.342 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:55.342 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:55.342 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:55.342 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:55.342 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster": { 2024-09-10T22:37:55.342 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster", 2024-09-10T22:37:55.342 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-10T22:37:55.342 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:55.342 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:55.342 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-10T22:37:55.342 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:55.342 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:55.342 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:55.343 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:55.343 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:55.343 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:55.343 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:55.343 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:55.343 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster_level": { 2024-09-10T22:37:55.343 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster_level", 2024-09-10T22:37:55.343 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-10T22:37:55.343 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:55.343 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:55.343 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "info", 2024-09-10T22:37:55.343 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:55.343 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:55.344 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-10T22:37:55.344 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-10T22:37:55.344 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-10T22:37:55.344 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-10T22:37:55.344 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-10T22:37:55.344 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-10T22:37:55.344 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-10T22:37:55.344 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-10T22:37:55.344 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:55.344 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:55.344 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:55.344 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:55.344 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:55.345 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_file": { 2024-09-10T22:37:55.345 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_file", 2024-09-10T22:37:55.345 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-10T22:37:55.345 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:55.345 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:55.345 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-10T22:37:55.345 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:55.345 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:55.345 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:55.345 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:55.345 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:55.345 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:55.345 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:55.345 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:55.346 INFO:teuthology.orchestra.run.smithi019.stdout: "sqlite3_killpoint": { 2024-09-10T22:37:55.346 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "sqlite3_killpoint", 2024-09-10T22:37:55.346 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "int", 2024-09-10T22:37:55.346 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "dev", 2024-09-10T22:37:55.346 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:55.346 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "0", 2024-09-10T22:37:55.346 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:55.346 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:55.346 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:55.346 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:55.346 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:55.346 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:55.346 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:55.347 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-10T22:37:55.347 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-10T22:37:55.347 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:55.347 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-10T22:37:55.347 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "status", 2024-09-10T22:37:55.347 INFO:teuthology.orchestra.run.smithi019.stdout: "can_run": true, 2024-09-10T22:37:55.347 INFO:teuthology.orchestra.run.smithi019.stdout: "error_string": "", 2024-09-10T22:37:55.347 INFO:teuthology.orchestra.run.smithi019.stdout: "module_options": { 2024-09-10T22:37:55.347 INFO:teuthology.orchestra.run.smithi019.stdout: "log_level": { 2024-09-10T22:37:55.347 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_level", 2024-09-10T22:37:55.347 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-10T22:37:55.347 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:55.347 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:55.348 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-10T22:37:55.348 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:55.348 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:55.348 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-10T22:37:55.348 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-10T22:37:55.348 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-10T22:37:55.348 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-10T22:37:55.348 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-10T22:37:55.348 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-10T22:37:55.348 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-10T22:37:55.348 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-10T22:37:55.348 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:55.348 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:55.348 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:55.349 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:55.349 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:55.349 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster": { 2024-09-10T22:37:55.349 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster", 2024-09-10T22:37:55.349 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-10T22:37:55.349 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:55.349 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:55.349 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-10T22:37:55.349 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:55.349 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:55.349 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:55.349 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:55.349 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:55.350 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:55.350 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:55.350 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:55.350 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster_level": { 2024-09-10T22:37:55.350 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster_level", 2024-09-10T22:37:55.350 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-10T22:37:55.350 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:55.350 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:55.350 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "info", 2024-09-10T22:37:55.350 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:55.350 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:55.350 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-10T22:37:55.350 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-10T22:37:55.351 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-10T22:37:55.351 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-10T22:37:55.351 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-10T22:37:55.351 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-10T22:37:55.351 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-10T22:37:55.351 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-10T22:37:55.351 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:55.351 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:55.351 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:55.351 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:55.351 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:55.351 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_file": { 2024-09-10T22:37:55.351 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_file", 2024-09-10T22:37:55.352 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-10T22:37:55.352 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:55.352 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:55.352 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-10T22:37:55.352 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:55.352 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:55.352 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:55.352 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:55.352 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:55.352 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:55.352 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:55.352 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:55.353 INFO:teuthology.orchestra.run.smithi019.stdout: "sqlite3_killpoint": { 2024-09-10T22:37:55.353 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "sqlite3_killpoint", 2024-09-10T22:37:55.353 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "int", 2024-09-10T22:37:55.353 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "dev", 2024-09-10T22:37:55.353 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:55.353 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "0", 2024-09-10T22:37:55.353 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:55.353 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:55.353 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:55.353 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:55.353 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:55.353 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:55.353 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:55.353 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-10T22:37:55.354 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-10T22:37:55.354 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:55.354 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-10T22:37:55.354 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "telegraf", 2024-09-10T22:37:55.354 INFO:teuthology.orchestra.run.smithi019.stdout: "can_run": true, 2024-09-10T22:37:55.354 INFO:teuthology.orchestra.run.smithi019.stdout: "error_string": "", 2024-09-10T22:37:55.354 INFO:teuthology.orchestra.run.smithi019.stdout: "module_options": { 2024-09-10T22:37:55.354 INFO:teuthology.orchestra.run.smithi019.stdout: "address": { 2024-09-10T22:37:55.354 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "address", 2024-09-10T22:37:55.354 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-10T22:37:55.354 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:55.354 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-10T22:37:55.354 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2024-09-10T22:37:55.355 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:55.355 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:55.355 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:55.355 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:55.355 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:55.355 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:55.355 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:55.355 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:55.355 INFO:teuthology.orchestra.run.smithi019.stdout: "interval": { 2024-09-10T22:37:55.355 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "interval", 2024-09-10T22:37:55.355 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "secs", 2024-09-10T22:37:55.355 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:55.355 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-10T22:37:55.356 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "15", 2024-09-10T22:37:55.356 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:55.356 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:55.356 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:55.356 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:55.356 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:55.356 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:55.356 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:55.356 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:55.356 INFO:teuthology.orchestra.run.smithi019.stdout: "log_level": { 2024-09-10T22:37:55.356 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_level", 2024-09-10T22:37:55.356 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-10T22:37:55.356 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:55.357 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:55.357 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-10T22:37:55.357 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:55.357 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:55.357 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-10T22:37:55.357 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-10T22:37:55.357 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-10T22:37:55.357 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-10T22:37:55.357 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-10T22:37:55.357 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-10T22:37:55.357 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-10T22:37:55.357 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-10T22:37:55.357 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:55.357 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:55.358 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:55.358 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:55.358 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:55.358 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster": { 2024-09-10T22:37:55.358 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster", 2024-09-10T22:37:55.358 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-10T22:37:55.358 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:55.358 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:55.358 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-10T22:37:55.358 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:55.358 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:55.358 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:55.359 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:55.359 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:55.359 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:55.359 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:55.359 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:55.359 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster_level": { 2024-09-10T22:37:55.359 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster_level", 2024-09-10T22:37:55.359 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-10T22:37:55.359 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:55.359 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:55.359 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "info", 2024-09-10T22:37:55.359 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:55.359 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:55.360 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-10T22:37:55.360 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-10T22:37:55.360 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-10T22:37:55.360 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-10T22:37:55.360 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-10T22:37:55.360 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-10T22:37:55.360 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-10T22:37:55.360 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-10T22:37:55.360 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:55.360 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:55.360 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:55.360 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:55.360 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:55.361 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_file": { 2024-09-10T22:37:55.361 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_file", 2024-09-10T22:37:55.361 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-10T22:37:55.361 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:55.361 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:55.361 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-10T22:37:55.361 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:55.361 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:55.361 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:55.361 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:55.361 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:55.361 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:55.361 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:55.362 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:55.362 INFO:teuthology.orchestra.run.smithi019.stdout: "sqlite3_killpoint": { 2024-09-10T22:37:55.362 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "sqlite3_killpoint", 2024-09-10T22:37:55.362 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "int", 2024-09-10T22:37:55.362 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "dev", 2024-09-10T22:37:55.362 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:55.362 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "0", 2024-09-10T22:37:55.362 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:55.362 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:55.362 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:55.362 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:55.362 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:55.362 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:55.363 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:55.363 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-10T22:37:55.363 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-10T22:37:55.363 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:55.363 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-10T22:37:55.363 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "telemetry", 2024-09-10T22:37:55.363 INFO:teuthology.orchestra.run.smithi019.stdout: "can_run": true, 2024-09-10T22:37:55.363 INFO:teuthology.orchestra.run.smithi019.stdout: "error_string": "", 2024-09-10T22:37:55.363 INFO:teuthology.orchestra.run.smithi019.stdout: "module_options": { 2024-09-10T22:37:55.363 INFO:teuthology.orchestra.run.smithi019.stdout: "channel_basic": { 2024-09-10T22:37:55.363 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "channel_basic", 2024-09-10T22:37:55.363 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-10T22:37:55.363 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:55.363 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-10T22:37:55.364 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "True", 2024-09-10T22:37:55.364 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:55.364 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:55.364 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:55.364 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "Share basic cluster information (size, version)", 2024-09-10T22:37:55.364 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:55.364 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:55.364 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:55.364 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:55.364 INFO:teuthology.orchestra.run.smithi019.stdout: "channel_crash": { 2024-09-10T22:37:55.364 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "channel_crash", 2024-09-10T22:37:55.364 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-10T22:37:55.364 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:55.365 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-10T22:37:55.365 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "True", 2024-09-10T22:37:55.365 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:55.365 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:55.365 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:55.365 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2024-09-10T22:37:55.365 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:55.365 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:55.365 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:55.365 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:55.365 INFO:teuthology.orchestra.run.smithi019.stdout: "channel_device": { 2024-09-10T22:37:55.365 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "channel_device", 2024-09-10T22:37:55.365 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-10T22:37:55.366 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:55.366 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-10T22:37:55.366 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "True", 2024-09-10T22:37:55.366 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:55.366 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:55.366 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:55.366 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2024-09-10T22:37:55.366 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:55.366 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:55.366 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:55.366 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:55.366 INFO:teuthology.orchestra.run.smithi019.stdout: "channel_ident": { 2024-09-10T22:37:55.366 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "channel_ident", 2024-09-10T22:37:55.367 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-10T22:37:55.367 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:55.367 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-10T22:37:55.367 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-10T22:37:55.367 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:55.367 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:55.367 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:55.367 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2024-09-10T22:37:55.367 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:55.367 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:55.367 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:55.367 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:55.368 INFO:teuthology.orchestra.run.smithi019.stdout: "channel_perf": { 2024-09-10T22:37:55.368 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "channel_perf", 2024-09-10T22:37:55.368 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-10T22:37:55.368 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:55.368 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-10T22:37:55.368 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-10T22:37:55.368 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:55.368 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:55.368 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:55.368 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "Share various performance metrics of a cluster", 2024-09-10T22:37:55.368 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:55.368 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:55.368 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:55.369 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:55.369 INFO:teuthology.orchestra.run.smithi019.stdout: "contact": { 2024-09-10T22:37:55.369 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "contact", 2024-09-10T22:37:55.369 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-10T22:37:55.369 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:55.369 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-10T22:37:55.369 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-10T22:37:55.369 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:55.369 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:55.369 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:55.369 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:55.369 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:55.369 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:55.370 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:55.370 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:55.370 INFO:teuthology.orchestra.run.smithi019.stdout: "description": { 2024-09-10T22:37:55.370 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "description", 2024-09-10T22:37:55.370 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-10T22:37:55.370 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:55.370 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-10T22:37:55.370 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-10T22:37:55.370 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:55.370 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:55.370 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:55.370 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:55.370 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:55.371 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:55.371 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:55.371 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:55.371 INFO:teuthology.orchestra.run.smithi019.stdout: "device_url": { 2024-09-10T22:37:55.371 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "device_url", 2024-09-10T22:37:55.371 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-10T22:37:55.371 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:55.371 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-10T22:37:55.371 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "https://telemetry.ceph.com/device", 2024-09-10T22:37:55.371 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:55.371 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:55.371 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:55.371 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:55.371 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:55.372 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:55.372 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:55.372 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:55.372 INFO:teuthology.orchestra.run.smithi019.stdout: "enabled": { 2024-09-10T22:37:55.372 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "enabled", 2024-09-10T22:37:55.372 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-10T22:37:55.372 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:55.372 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-10T22:37:55.372 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-10T22:37:55.372 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:55.372 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:55.372 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:55.372 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:55.373 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:55.373 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:55.373 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:55.373 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:55.373 INFO:teuthology.orchestra.run.smithi019.stdout: "interval": { 2024-09-10T22:37:55.373 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "interval", 2024-09-10T22:37:55.373 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "int", 2024-09-10T22:37:55.373 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:55.373 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-10T22:37:55.373 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "24", 2024-09-10T22:37:55.373 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "8", 2024-09-10T22:37:55.373 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:55.373 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:55.374 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:55.374 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:55.374 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:55.374 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:55.374 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:55.374 INFO:teuthology.orchestra.run.smithi019.stdout: "last_opt_revision": { 2024-09-10T22:37:55.374 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "last_opt_revision", 2024-09-10T22:37:55.374 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "int", 2024-09-10T22:37:55.374 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:55.374 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-10T22:37:55.374 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "1", 2024-09-10T22:37:55.374 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:55.374 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:55.374 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:55.375 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:55.375 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:55.375 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:55.375 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:55.375 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:55.375 INFO:teuthology.orchestra.run.smithi019.stdout: "leaderboard": { 2024-09-10T22:37:55.375 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "leaderboard", 2024-09-10T22:37:55.375 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-10T22:37:55.375 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:55.375 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-10T22:37:55.375 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-10T22:37:55.375 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:55.375 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:55.376 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:55.376 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:55.376 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:55.376 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:55.376 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:55.376 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:55.376 INFO:teuthology.orchestra.run.smithi019.stdout: "leaderboard_description": { 2024-09-10T22:37:55.376 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "leaderboard_description", 2024-09-10T22:37:55.376 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-10T22:37:55.376 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:55.376 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-10T22:37:55.376 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-10T22:37:55.376 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:55.377 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:55.377 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:55.377 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:55.377 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:55.377 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:55.377 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:55.377 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:55.377 INFO:teuthology.orchestra.run.smithi019.stdout: "log_level": { 2024-09-10T22:37:55.377 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_level", 2024-09-10T22:37:55.377 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-10T22:37:55.377 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:55.377 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:55.377 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-10T22:37:55.378 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:55.378 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:55.378 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-10T22:37:55.378 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-10T22:37:55.378 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-10T22:37:55.378 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-10T22:37:55.378 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-10T22:37:55.378 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-10T22:37:55.378 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-10T22:37:55.378 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-10T22:37:55.378 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:55.378 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:55.378 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:55.378 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:55.379 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:55.379 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster": { 2024-09-10T22:37:55.379 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster", 2024-09-10T22:37:55.379 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-10T22:37:55.379 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:55.379 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:55.379 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-10T22:37:55.379 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:55.379 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:55.379 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:55.379 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:55.379 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:55.379 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:55.379 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:55.380 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:55.380 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster_level": { 2024-09-10T22:37:55.380 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster_level", 2024-09-10T22:37:55.380 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-10T22:37:55.380 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:55.380 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:55.380 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "info", 2024-09-10T22:37:55.380 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:55.380 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:55.380 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-10T22:37:55.380 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-10T22:37:55.380 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-10T22:37:55.380 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-10T22:37:55.381 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-10T22:37:55.381 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-10T22:37:55.381 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-10T22:37:55.381 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-10T22:37:55.381 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:55.381 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:55.381 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:55.381 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:55.381 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:55.381 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_file": { 2024-09-10T22:37:55.381 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_file", 2024-09-10T22:37:55.381 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-10T22:37:55.381 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:55.382 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:55.382 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-10T22:37:55.382 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:55.382 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:55.382 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:55.382 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:55.382 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:55.382 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:55.382 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:55.382 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:55.382 INFO:teuthology.orchestra.run.smithi019.stdout: "organization": { 2024-09-10T22:37:55.382 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "organization", 2024-09-10T22:37:55.382 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-10T22:37:55.383 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:55.383 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-10T22:37:55.383 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-10T22:37:55.383 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:55.383 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:55.383 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:55.383 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:55.383 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:55.383 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:55.383 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:55.383 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:55.383 INFO:teuthology.orchestra.run.smithi019.stdout: "proxy": { 2024-09-10T22:37:55.383 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "proxy", 2024-09-10T22:37:55.383 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-10T22:37:55.384 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:55.384 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-10T22:37:55.384 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-10T22:37:55.384 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:55.384 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:55.384 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:55.384 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:55.384 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:55.384 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:55.384 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:55.384 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:55.384 INFO:teuthology.orchestra.run.smithi019.stdout: "sqlite3_killpoint": { 2024-09-10T22:37:55.384 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "sqlite3_killpoint", 2024-09-10T22:37:55.385 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "int", 2024-09-10T22:37:55.385 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "dev", 2024-09-10T22:37:55.385 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:55.385 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "0", 2024-09-10T22:37:55.385 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:55.385 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:55.385 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:55.385 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:55.385 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:55.385 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:55.385 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:55.385 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:55.385 INFO:teuthology.orchestra.run.smithi019.stdout: "url": { 2024-09-10T22:37:55.385 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "url", 2024-09-10T22:37:55.385 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-10T22:37:55.386 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:55.386 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-10T22:37:55.386 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "https://telemetry.ceph.com/report", 2024-09-10T22:37:55.386 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:55.386 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:55.386 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:55.386 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:55.386 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:55.386 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:55.386 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:55.386 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-10T22:37:55.386 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-10T22:37:55.386 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:55.387 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-10T22:37:55.387 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "test_orchestrator", 2024-09-10T22:37:55.387 INFO:teuthology.orchestra.run.smithi019.stdout: "can_run": true, 2024-09-10T22:37:55.387 INFO:teuthology.orchestra.run.smithi019.stdout: "error_string": "", 2024-09-10T22:37:55.387 INFO:teuthology.orchestra.run.smithi019.stdout: "module_options": { 2024-09-10T22:37:55.387 INFO:teuthology.orchestra.run.smithi019.stdout: "log_level": { 2024-09-10T22:37:55.387 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_level", 2024-09-10T22:37:55.387 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-10T22:37:55.387 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:55.387 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:55.387 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-10T22:37:55.387 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:55.387 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:55.387 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-10T22:37:55.388 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-10T22:37:55.388 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-10T22:37:55.388 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-10T22:37:55.388 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-10T22:37:55.388 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-10T22:37:55.388 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-10T22:37:55.388 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-10T22:37:55.388 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:55.388 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:55.388 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:55.388 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:55.388 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:55.388 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster": { 2024-09-10T22:37:55.389 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster", 2024-09-10T22:37:55.389 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-10T22:37:55.389 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:55.389 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:55.389 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-10T22:37:55.389 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:55.389 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:55.389 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:55.389 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:55.389 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:55.389 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:55.389 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:55.389 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:55.390 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster_level": { 2024-09-10T22:37:55.390 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster_level", 2024-09-10T22:37:55.390 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-10T22:37:55.390 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:55.390 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:55.390 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "info", 2024-09-10T22:37:55.390 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:55.390 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:55.390 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-10T22:37:55.390 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-10T22:37:55.390 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-10T22:37:55.390 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-10T22:37:55.390 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-10T22:37:55.390 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-10T22:37:55.391 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-10T22:37:55.391 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-10T22:37:55.391 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:55.391 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:55.391 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:55.391 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:55.391 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:55.391 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_file": { 2024-09-10T22:37:55.391 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_file", 2024-09-10T22:37:55.391 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-10T22:37:55.391 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:55.391 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:55.391 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-10T22:37:55.391 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:55.392 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:55.392 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:55.392 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:55.392 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:55.392 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:55.392 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:55.392 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:55.392 INFO:teuthology.orchestra.run.smithi019.stdout: "sqlite3_killpoint": { 2024-09-10T22:37:55.392 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "sqlite3_killpoint", 2024-09-10T22:37:55.392 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "int", 2024-09-10T22:37:55.392 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "dev", 2024-09-10T22:37:55.392 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:55.392 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "0", 2024-09-10T22:37:55.393 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:55.393 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:55.393 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:55.393 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:55.393 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:55.393 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:55.393 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:55.393 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-10T22:37:55.393 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-10T22:37:55.393 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:55.393 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-10T22:37:55.393 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "volumes", 2024-09-10T22:37:55.393 INFO:teuthology.orchestra.run.smithi019.stdout: "can_run": true, 2024-09-10T22:37:55.394 INFO:teuthology.orchestra.run.smithi019.stdout: "error_string": "", 2024-09-10T22:37:55.394 INFO:teuthology.orchestra.run.smithi019.stdout: "module_options": { 2024-09-10T22:37:55.394 INFO:teuthology.orchestra.run.smithi019.stdout: "log_level": { 2024-09-10T22:37:55.394 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_level", 2024-09-10T22:37:55.394 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-10T22:37:55.394 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:55.394 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:55.394 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-10T22:37:55.394 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:55.394 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:55.394 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-10T22:37:55.394 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-10T22:37:55.394 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-10T22:37:55.395 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-10T22:37:55.395 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-10T22:37:55.395 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-10T22:37:55.395 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-10T22:37:55.395 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-10T22:37:55.395 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:55.395 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:55.395 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:55.395 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:55.395 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:55.395 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster": { 2024-09-10T22:37:55.395 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster", 2024-09-10T22:37:55.395 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-10T22:37:55.395 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:55.396 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:55.396 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-10T22:37:55.396 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:55.396 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:55.396 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:55.396 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:55.396 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:55.396 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:55.396 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:55.396 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:55.396 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster_level": { 2024-09-10T22:37:55.396 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster_level", 2024-09-10T22:37:55.396 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-10T22:37:55.397 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:55.397 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:55.397 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "info", 2024-09-10T22:37:55.397 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:55.397 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:55.397 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-10T22:37:55.397 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-10T22:37:55.397 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-10T22:37:55.397 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-10T22:37:55.397 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-10T22:37:55.397 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-10T22:37:55.397 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-10T22:37:55.397 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-10T22:37:55.398 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:55.398 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:55.398 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:55.398 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:55.398 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:55.398 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_file": { 2024-09-10T22:37:55.398 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_file", 2024-09-10T22:37:55.398 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-10T22:37:55.398 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:55.398 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:55.398 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-10T22:37:55.398 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:55.398 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:55.398 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:55.399 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:55.399 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:55.399 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:55.399 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:55.399 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:55.399 INFO:teuthology.orchestra.run.smithi019.stdout: "max_concurrent_clones": { 2024-09-10T22:37:55.399 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "max_concurrent_clones", 2024-09-10T22:37:55.399 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "int", 2024-09-10T22:37:55.399 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:55.399 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-10T22:37:55.399 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "4", 2024-09-10T22:37:55.399 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:55.399 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:55.399 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:55.400 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "Number of asynchronous cloner threads", 2024-09-10T22:37:55.400 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:55.400 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:55.400 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:55.400 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:55.400 INFO:teuthology.orchestra.run.smithi019.stdout: "periodic_async_work": { 2024-09-10T22:37:55.400 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "periodic_async_work", 2024-09-10T22:37:55.400 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-10T22:37:55.400 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:55.400 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-10T22:37:55.400 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-10T22:37:55.400 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:55.400 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:55.401 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:55.401 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "Periodically check for async work", 2024-09-10T22:37:55.401 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:55.401 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:55.401 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:55.401 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:55.401 INFO:teuthology.orchestra.run.smithi019.stdout: "snapshot_clone_delay": { 2024-09-10T22:37:55.401 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "snapshot_clone_delay", 2024-09-10T22:37:55.401 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "int", 2024-09-10T22:37:55.401 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:55.401 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-10T22:37:55.401 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "0", 2024-09-10T22:37:55.401 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:55.401 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:55.402 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:55.402 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2024-09-10T22:37:55.402 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:55.402 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:55.402 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:55.402 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:55.402 INFO:teuthology.orchestra.run.smithi019.stdout: "snapshot_clone_no_wait": { 2024-09-10T22:37:55.402 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "snapshot_clone_no_wait", 2024-09-10T22:37:55.402 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-10T22:37:55.402 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:55.402 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-10T22:37:55.402 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "True", 2024-09-10T22:37:55.402 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:55.403 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:55.403 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:55.403 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "Reject subvolume clone request when cloner threads are busy", 2024-09-10T22:37:55.403 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:55.403 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:55.403 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:55.403 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:55.403 INFO:teuthology.orchestra.run.smithi019.stdout: "sqlite3_killpoint": { 2024-09-10T22:37:55.403 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "sqlite3_killpoint", 2024-09-10T22:37:55.403 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "int", 2024-09-10T22:37:55.403 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "dev", 2024-09-10T22:37:55.403 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:55.403 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "0", 2024-09-10T22:37:55.403 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:55.404 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:55.404 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:55.404 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:55.404 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:55.404 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:55.404 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:55.404 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-10T22:37:55.404 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-10T22:37:55.404 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:55.404 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-10T22:37:55.404 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "zabbix", 2024-09-10T22:37:55.404 INFO:teuthology.orchestra.run.smithi019.stdout: "can_run": true, 2024-09-10T22:37:55.404 INFO:teuthology.orchestra.run.smithi019.stdout: "error_string": "", 2024-09-10T22:37:55.405 INFO:teuthology.orchestra.run.smithi019.stdout: "module_options": { 2024-09-10T22:37:55.405 INFO:teuthology.orchestra.run.smithi019.stdout: "discovery_interval": { 2024-09-10T22:37:55.405 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "discovery_interval", 2024-09-10T22:37:55.405 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "uint", 2024-09-10T22:37:55.405 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:55.405 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-10T22:37:55.405 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "100", 2024-09-10T22:37:55.405 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:55.405 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:55.405 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:55.405 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:55.405 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:55.405 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:55.406 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:55.406 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:55.406 INFO:teuthology.orchestra.run.smithi019.stdout: "identifier": { 2024-09-10T22:37:55.406 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "identifier", 2024-09-10T22:37:55.406 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-10T22:37:55.406 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:55.406 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-10T22:37:55.406 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-10T22:37:55.406 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:55.406 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:55.406 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:55.406 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:55.406 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:55.406 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:55.407 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:55.407 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:55.407 INFO:teuthology.orchestra.run.smithi019.stdout: "interval": { 2024-09-10T22:37:55.407 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "interval", 2024-09-10T22:37:55.407 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "secs", 2024-09-10T22:37:55.407 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:55.407 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-10T22:37:55.407 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "60", 2024-09-10T22:37:55.407 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:55.407 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:55.407 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:55.407 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:55.407 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:55.408 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:55.408 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:55.408 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:55.408 INFO:teuthology.orchestra.run.smithi019.stdout: "log_level": { 2024-09-10T22:37:55.408 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_level", 2024-09-10T22:37:55.408 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-10T22:37:55.408 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:55.408 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:55.408 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-10T22:37:55.408 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:55.408 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:55.408 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-10T22:37:55.409 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-10T22:37:55.409 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-10T22:37:55.409 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-10T22:37:55.409 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-10T22:37:55.409 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-10T22:37:55.409 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-10T22:37:55.409 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-10T22:37:55.409 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:55.409 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:55.409 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:55.409 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:55.409 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:55.409 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster": { 2024-09-10T22:37:55.409 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster", 2024-09-10T22:37:55.410 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-10T22:37:55.410 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:55.410 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:55.410 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-10T22:37:55.410 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:55.410 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:55.410 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:55.410 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:55.410 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:55.410 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:55.410 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:55.410 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:55.410 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster_level": { 2024-09-10T22:37:55.411 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster_level", 2024-09-10T22:37:55.411 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-10T22:37:55.411 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:55.411 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:55.411 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "info", 2024-09-10T22:37:55.411 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:55.411 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:55.411 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-10T22:37:55.411 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-10T22:37:55.411 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-10T22:37:55.411 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-10T22:37:55.411 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-10T22:37:55.411 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-10T22:37:55.411 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-10T22:37:55.412 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-10T22:37:55.412 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:55.412 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:55.412 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:55.412 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:55.412 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:55.412 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_file": { 2024-09-10T22:37:55.412 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_file", 2024-09-10T22:37:55.412 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-10T22:37:55.412 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:55.412 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:55.412 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-10T22:37:55.412 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:55.413 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:55.413 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:55.413 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:55.413 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:55.413 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:55.413 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:55.413 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:55.413 INFO:teuthology.orchestra.run.smithi019.stdout: "sqlite3_killpoint": { 2024-09-10T22:37:55.413 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "sqlite3_killpoint", 2024-09-10T22:37:55.413 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "int", 2024-09-10T22:37:55.413 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "dev", 2024-09-10T22:37:55.413 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-10T22:37:55.413 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "0", 2024-09-10T22:37:55.414 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:55.414 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:55.414 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:55.414 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:55.414 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:55.414 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:55.414 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:55.414 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:55.414 INFO:teuthology.orchestra.run.smithi019.stdout: "zabbix_host": { 2024-09-10T22:37:55.414 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "zabbix_host", 2024-09-10T22:37:55.414 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-10T22:37:55.414 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:55.414 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-10T22:37:55.414 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-10T22:37:55.415 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:55.415 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:55.415 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:55.415 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:55.415 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:55.415 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:55.415 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:55.415 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:55.415 INFO:teuthology.orchestra.run.smithi019.stdout: "zabbix_port": { 2024-09-10T22:37:55.415 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "zabbix_port", 2024-09-10T22:37:55.415 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "int", 2024-09-10T22:37:55.415 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:55.415 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-10T22:37:55.415 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "10051", 2024-09-10T22:37:55.416 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:55.416 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:55.416 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:55.416 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:55.416 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:55.416 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:55.416 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:55.416 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:55.416 INFO:teuthology.orchestra.run.smithi019.stdout: "zabbix_sender": { 2024-09-10T22:37:55.416 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "zabbix_sender", 2024-09-10T22:37:55.416 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-10T22:37:55.416 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-10T22:37:55.417 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-10T22:37:55.417 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "/usr/bin/zabbix_sender", 2024-09-10T22:37:55.417 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-10T22:37:55.417 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-10T22:37:55.417 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-10T22:37:55.417 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-10T22:37:55.417 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-10T22:37:55.417 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-10T22:37:55.417 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-10T22:37:55.417 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-10T22:37:55.417 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-10T22:37:55.417 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-10T22:37:55.417 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-10T22:37:55.418 INFO:teuthology.orchestra.run.smithi019.stdout: "services": { 2024-09-10T22:37:55.418 INFO:teuthology.orchestra.run.smithi019.stdout: "dashboard": "https://172.21.15.19:8443/" 2024-09-10T22:37:55.418 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:55.418 INFO:teuthology.orchestra.run.smithi019.stdout: "always_on_modules": { 2024-09-10T22:37:55.418 INFO:teuthology.orchestra.run.smithi019.stdout: "octopus": [ 2024-09-10T22:37:55.418 INFO:teuthology.orchestra.run.smithi019.stdout: "balancer", 2024-09-10T22:37:55.418 INFO:teuthology.orchestra.run.smithi019.stdout: "crash", 2024-09-10T22:37:55.418 INFO:teuthology.orchestra.run.smithi019.stdout: "devicehealth", 2024-09-10T22:37:55.418 INFO:teuthology.orchestra.run.smithi019.stdout: "orchestrator", 2024-09-10T22:37:55.418 INFO:teuthology.orchestra.run.smithi019.stdout: "pg_autoscaler", 2024-09-10T22:37:55.418 INFO:teuthology.orchestra.run.smithi019.stdout: "progress", 2024-09-10T22:37:55.418 INFO:teuthology.orchestra.run.smithi019.stdout: "rbd_support", 2024-09-10T22:37:55.418 INFO:teuthology.orchestra.run.smithi019.stdout: "status", 2024-09-10T22:37:55.418 INFO:teuthology.orchestra.run.smithi019.stdout: "telemetry", 2024-09-10T22:37:55.419 INFO:teuthology.orchestra.run.smithi019.stdout: "volumes" 2024-09-10T22:37:55.419 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-10T22:37:55.419 INFO:teuthology.orchestra.run.smithi019.stdout: "pacific": [ 2024-09-10T22:37:55.419 INFO:teuthology.orchestra.run.smithi019.stdout: "balancer", 2024-09-10T22:37:55.419 INFO:teuthology.orchestra.run.smithi019.stdout: "crash", 2024-09-10T22:37:55.419 INFO:teuthology.orchestra.run.smithi019.stdout: "devicehealth", 2024-09-10T22:37:55.419 INFO:teuthology.orchestra.run.smithi019.stdout: "orchestrator", 2024-09-10T22:37:55.419 INFO:teuthology.orchestra.run.smithi019.stdout: "pg_autoscaler", 2024-09-10T22:37:55.419 INFO:teuthology.orchestra.run.smithi019.stdout: "progress", 2024-09-10T22:37:55.419 INFO:teuthology.orchestra.run.smithi019.stdout: "rbd_support", 2024-09-10T22:37:55.419 INFO:teuthology.orchestra.run.smithi019.stdout: "status", 2024-09-10T22:37:55.419 INFO:teuthology.orchestra.run.smithi019.stdout: "telemetry", 2024-09-10T22:37:55.419 INFO:teuthology.orchestra.run.smithi019.stdout: "volumes" 2024-09-10T22:37:55.420 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-10T22:37:55.420 INFO:teuthology.orchestra.run.smithi019.stdout: "quincy": [ 2024-09-10T22:37:55.420 INFO:teuthology.orchestra.run.smithi019.stdout: "balancer", 2024-09-10T22:37:55.420 INFO:teuthology.orchestra.run.smithi019.stdout: "crash", 2024-09-10T22:37:55.420 INFO:teuthology.orchestra.run.smithi019.stdout: "devicehealth", 2024-09-10T22:37:55.420 INFO:teuthology.orchestra.run.smithi019.stdout: "orchestrator", 2024-09-10T22:37:55.420 INFO:teuthology.orchestra.run.smithi019.stdout: "pg_autoscaler", 2024-09-10T22:37:55.420 INFO:teuthology.orchestra.run.smithi019.stdout: "progress", 2024-09-10T22:37:55.420 INFO:teuthology.orchestra.run.smithi019.stdout: "rbd_support", 2024-09-10T22:37:55.420 INFO:teuthology.orchestra.run.smithi019.stdout: "status", 2024-09-10T22:37:55.420 INFO:teuthology.orchestra.run.smithi019.stdout: "telemetry", 2024-09-10T22:37:55.420 INFO:teuthology.orchestra.run.smithi019.stdout: "volumes" 2024-09-10T22:37:55.420 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-10T22:37:55.421 INFO:teuthology.orchestra.run.smithi019.stdout: "reef": [ 2024-09-10T22:37:55.421 INFO:teuthology.orchestra.run.smithi019.stdout: "balancer", 2024-09-10T22:37:55.421 INFO:teuthology.orchestra.run.smithi019.stdout: "crash", 2024-09-10T22:37:55.421 INFO:teuthology.orchestra.run.smithi019.stdout: "devicehealth", 2024-09-10T22:37:55.421 INFO:teuthology.orchestra.run.smithi019.stdout: "orchestrator", 2024-09-10T22:37:55.421 INFO:teuthology.orchestra.run.smithi019.stdout: "pg_autoscaler", 2024-09-10T22:37:55.421 INFO:teuthology.orchestra.run.smithi019.stdout: "progress", 2024-09-10T22:37:55.421 INFO:teuthology.orchestra.run.smithi019.stdout: "rbd_support", 2024-09-10T22:37:55.421 INFO:teuthology.orchestra.run.smithi019.stdout: "status", 2024-09-10T22:37:55.421 INFO:teuthology.orchestra.run.smithi019.stdout: "telemetry", 2024-09-10T22:37:55.421 INFO:teuthology.orchestra.run.smithi019.stdout: "volumes" 2024-09-10T22:37:55.421 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-10T22:37:55.421 INFO:teuthology.orchestra.run.smithi019.stdout: "squid": [ 2024-09-10T22:37:55.422 INFO:teuthology.orchestra.run.smithi019.stdout: "balancer", 2024-09-10T22:37:55.422 INFO:teuthology.orchestra.run.smithi019.stdout: "crash", 2024-09-10T22:37:55.422 INFO:teuthology.orchestra.run.smithi019.stdout: "devicehealth", 2024-09-10T22:37:55.422 INFO:teuthology.orchestra.run.smithi019.stdout: "orchestrator", 2024-09-10T22:37:55.422 INFO:teuthology.orchestra.run.smithi019.stdout: "pg_autoscaler", 2024-09-10T22:37:55.422 INFO:teuthology.orchestra.run.smithi019.stdout: "progress", 2024-09-10T22:37:55.422 INFO:teuthology.orchestra.run.smithi019.stdout: "rbd_support", 2024-09-10T22:37:55.422 INFO:teuthology.orchestra.run.smithi019.stdout: "status", 2024-09-10T22:37:55.422 INFO:teuthology.orchestra.run.smithi019.stdout: "telemetry", 2024-09-10T22:37:55.422 INFO:teuthology.orchestra.run.smithi019.stdout: "volumes" 2024-09-10T22:37:55.422 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-10T22:37:55.422 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:55.422 INFO:teuthology.orchestra.run.smithi019.stdout: "force_disabled_modules": {}, 2024-09-10T22:37:55.422 INFO:teuthology.orchestra.run.smithi019.stdout: "last_failure_osd_epoch": 3, 2024-09-10T22:37:55.423 INFO:teuthology.orchestra.run.smithi019.stdout: "active_clients": [ 2024-09-10T22:37:55.423 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-10T22:37:55.423 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "devicehealth", 2024-09-10T22:37:55.423 INFO:teuthology.orchestra.run.smithi019.stdout: "addrvec": [ 2024-09-10T22:37:55.423 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-10T22:37:55.423 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "v2", 2024-09-10T22:37:55.423 INFO:teuthology.orchestra.run.smithi019.stdout: "addr": "172.21.15.19:0", 2024-09-10T22:37:55.423 INFO:teuthology.orchestra.run.smithi019.stdout: "nonce": 1451695278 2024-09-10T22:37:55.423 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-10T22:37:55.423 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-10T22:37:55.423 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:55.423 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-10T22:37:55.423 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "libcephsqlite", 2024-09-10T22:37:55.424 INFO:teuthology.orchestra.run.smithi019.stdout: "addrvec": [ 2024-09-10T22:37:55.424 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-10T22:37:55.424 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "v2", 2024-09-10T22:37:55.424 INFO:teuthology.orchestra.run.smithi019.stdout: "addr": "172.21.15.19:0", 2024-09-10T22:37:55.424 INFO:teuthology.orchestra.run.smithi019.stdout: "nonce": 1827569890 2024-09-10T22:37:55.424 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-10T22:37:55.424 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-10T22:37:55.424 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:55.424 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-10T22:37:55.424 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "rbd_support", 2024-09-10T22:37:55.424 INFO:teuthology.orchestra.run.smithi019.stdout: "addrvec": [ 2024-09-10T22:37:55.424 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-10T22:37:55.424 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "v2", 2024-09-10T22:37:55.425 INFO:teuthology.orchestra.run.smithi019.stdout: "addr": "172.21.15.19:0", 2024-09-10T22:37:55.425 INFO:teuthology.orchestra.run.smithi019.stdout: "nonce": 2750748567 2024-09-10T22:37:55.425 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-10T22:37:55.425 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-10T22:37:55.425 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:55.425 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-10T22:37:55.425 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "volumes", 2024-09-10T22:37:55.425 INFO:teuthology.orchestra.run.smithi019.stdout: "addrvec": [ 2024-09-10T22:37:55.425 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-10T22:37:55.425 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "v2", 2024-09-10T22:37:55.425 INFO:teuthology.orchestra.run.smithi019.stdout: "addr": "172.21.15.19:0", 2024-09-10T22:37:55.425 INFO:teuthology.orchestra.run.smithi019.stdout: "nonce": 3734673187 2024-09-10T22:37:55.425 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-10T22:37:55.426 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-10T22:37:55.426 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-10T22:37:55.426 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-10T22:37:55.426 INFO:teuthology.orchestra.run.smithi019.stdout:} 2024-09-10T22:37:55.427 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:53.881+0000 7fee5dff3640 1 -- 172.21.15.19:0/2086064970 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7fee400b52e0 msgr2=0x7fee400b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:37:55.427 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:53.881+0000 7fee5dff3640 1 --2- 172.21.15.19:0/2086064970 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7fee400b52e0 0x7fee400b77a0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7fee480058c0 tx=0x7fee48005850 comp rx=0 tx=0).stop 2024-09-10T22:37:55.427 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:53.881+0000 7fee5dff3640 1 -- 172.21.15.19:0/2086064970 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fee58105b20 msgr2=0x7fee581993d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:37:55.427 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:53.881+0000 7fee5dff3640 1 --2- 172.21.15.19:0/2086064970 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fee58105b20 0x7fee581993d0 secure :-1 s=READY pgs=879 cs=0 l=1 rev1=1 crypto rx=0x7fee4c006010 tx=0x7fee4c0042f0 comp rx=0 tx=0).stop 2024-09-10T22:37:55.428 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:53.881+0000 7fee5dff3640 1 -- 172.21.15.19:0/2086064970 shutdown_connections 2024-09-10T22:37:55.428 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:53.881+0000 7fee5dff3640 1 --2- 172.21.15.19:0/2086064970 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7fee400b52e0 0x7fee400b77a0 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:37:55.428 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:53.881+0000 7fee5dff3640 1 --2- 172.21.15.19:0/2086064970 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fee581086d0 0x7fee5819a000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:37:55.428 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:53.881+0000 7fee5dff3640 1 --2- 172.21.15.19:0/2086064970 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fee58105b20 0x7fee581993d0 unknown :-1 s=CLOSED pgs=879 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:37:55.428 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:53.881+0000 7fee5dff3640 1 --2- 172.21.15.19:0/2086064970 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fee5806be60 0x7fee58198d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:37:55.428 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:53.881+0000 7fee5dff3640 1 -- 172.21.15.19:0/2086064970 >> 172.21.15.19:0/2086064970 conn(0x7fee580fd190 msgr2=0x7fee58103df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:37:55.428 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:53.881+0000 7fee5dff3640 1 -- 172.21.15.19:0/2086064970 shutdown_connections 2024-09-10T22:37:55.428 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:37:53.882+0000 7fee5dff3640 1 -- 172.21.15.19:0/2086064970 wait complete. 2024-09-10T22:37:55.435 DEBUG:tasks.check_counter:Getting stats from a 2024-09-10T22:37:55.436 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 22997a4c-6fc2-11ef-bcea-c7b262605968 -- ceph daemon mds.a perf dump 2024-09-10T22:37:55.436 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:37:54 smithi019 ceph-mon[31375]: pgmap v691: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 38 MiB/s wr, 43 op/s 2024-09-10T22:37:55.436 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:37:54 smithi019 ceph-mon[31375]: from='client.? 172.21.15.19:0/539153365' entity='client.admin' cmd={"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} : dispatch 2024-09-10T22:37:55.436 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:37:54 smithi019 ceph-mon[31375]: from='client.? 172.21.15.19:0/3275384586' entity='client.admin' cmd={"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} : dispatch 2024-09-10T22:37:55.436 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:37:54 smithi019 ceph-mon[31375]: from='client.? 172.21.15.19:0/2086064970' entity='client.admin' cmd={"prefix": "mgr dump", "format": "json-pretty"} : dispatch 2024-09-10T22:37:55.437 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:37:54 smithi138 ceph-mon[35236]: pgmap v691: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 38 MiB/s wr, 43 op/s 2024-09-10T22:37:55.437 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:37:54 smithi138 ceph-mon[35236]: from='client.? 172.21.15.19:0/539153365' entity='client.admin' cmd={"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} : dispatch 2024-09-10T22:37:55.437 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:37:54 smithi138 ceph-mon[35236]: from='client.? 172.21.15.19:0/3275384586' entity='client.admin' cmd={"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} : dispatch 2024-09-10T22:37:55.437 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:37:54 smithi138 ceph-mon[35236]: from='client.? 172.21.15.19:0/2086064970' entity='client.admin' cmd={"prefix": "mgr dump", "format": "json-pretty"} : dispatch 2024-09-10T22:37:55.438 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:37:54 smithi135 ceph-mon[34789]: pgmap v691: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 38 MiB/s wr, 43 op/s 2024-09-10T22:37:55.438 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:37:54 smithi135 ceph-mon[34789]: from='client.? 172.21.15.19:0/539153365' entity='client.admin' cmd={"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} : dispatch 2024-09-10T22:37:55.438 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:37:54 smithi135 ceph-mon[34789]: from='client.? 172.21.15.19:0/3275384586' entity='client.admin' cmd={"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} : dispatch 2024-09-10T22:37:55.438 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:37:54 smithi135 ceph-mon[34789]: from='client.? 172.21.15.19:0/2086064970' entity='client.admin' cmd={"prefix": "mgr dump", "format": "json-pretty"} : dispatch 2024-09-10T22:37:55.709 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/22997a4c-6fc2-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T22:37:56.094 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:37:56 smithi019 ceph-mon[31375]: pgmap v692: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 41 MiB/s wr, 85 op/s 2024-09-10T22:37:56.360 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:37:56 smithi135 ceph-mon[34789]: pgmap v692: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 41 MiB/s wr, 85 op/s 2024-09-10T22:37:56.363 INFO:teuthology.orchestra.run.smithi019.stdout:{ 2024-09-10T22:37:56.363 INFO:teuthology.orchestra.run.smithi019.stdout: "AsyncMessenger::Worker-0": { 2024-09-10T22:37:56.363 INFO:teuthology.orchestra.run.smithi019.stdout: "msgr_recv_messages": 0, 2024-09-10T22:37:56.363 INFO:teuthology.orchestra.run.smithi019.stdout: "msgr_send_messages": 2, 2024-09-10T22:37:56.363 INFO:teuthology.orchestra.run.smithi019.stdout: "msgr_recv_bytes": 0, 2024-09-10T22:37:56.363 INFO:teuthology.orchestra.run.smithi019.stdout: "msgr_send_bytes": 0, 2024-09-10T22:37:56.363 INFO:teuthology.orchestra.run.smithi019.stdout: "msgr_created_connections": 4, 2024-09-10T22:37:56.363 INFO:teuthology.orchestra.run.smithi019.stdout: "msgr_active_connections": 0, 2024-09-10T22:37:56.363 INFO:teuthology.orchestra.run.smithi019.stdout: "msgr_running_total_time": 0.001622696, 2024-09-10T22:37:56.363 INFO:teuthology.orchestra.run.smithi019.stdout: "msgr_running_send_time": 0.000000000, 2024-09-10T22:37:56.364 INFO:teuthology.orchestra.run.smithi019.stdout: "msgr_running_recv_time": 0.000192255, 2024-09-10T22:37:56.364 INFO:teuthology.orchestra.run.smithi019.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-10T22:37:56.364 INFO:teuthology.orchestra.run.smithi019.stdout: "msgr_send_messages_queue_lat": { 2024-09-10T22:37:56.364 INFO:teuthology.orchestra.run.smithi019.stdout: "avgcount": 0, 2024-09-10T22:37:56.364 INFO:teuthology.orchestra.run.smithi019.stdout: "sum": 0.000000000, 2024-09-10T22:37:56.364 INFO:teuthology.orchestra.run.smithi019.stdout: "avgtime": 0.000000000 2024-09-10T22:37:56.364 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:56.364 INFO:teuthology.orchestra.run.smithi019.stdout: "msgr_handle_ack_lat": { 2024-09-10T22:37:56.364 INFO:teuthology.orchestra.run.smithi019.stdout: "avgcount": 0, 2024-09-10T22:37:56.364 INFO:teuthology.orchestra.run.smithi019.stdout: "sum": 0.000000000, 2024-09-10T22:37:56.364 INFO:teuthology.orchestra.run.smithi019.stdout: "avgtime": 0.000000000 2024-09-10T22:37:56.364 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:56.364 INFO:teuthology.orchestra.run.smithi019.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-10T22:37:56.365 INFO:teuthology.orchestra.run.smithi019.stdout: "msgr_send_encrypted_bytes": 0 2024-09-10T22:37:56.365 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:56.365 INFO:teuthology.orchestra.run.smithi019.stdout: "AsyncMessenger::Worker-1": { 2024-09-10T22:37:56.365 INFO:teuthology.orchestra.run.smithi019.stdout: "msgr_recv_messages": 229, 2024-09-10T22:37:56.365 INFO:teuthology.orchestra.run.smithi019.stdout: "msgr_send_messages": 224, 2024-09-10T22:37:56.365 INFO:teuthology.orchestra.run.smithi019.stdout: "msgr_recv_bytes": 529136, 2024-09-10T22:37:56.365 INFO:teuthology.orchestra.run.smithi019.stdout: "msgr_send_bytes": 136832, 2024-09-10T22:37:56.365 INFO:teuthology.orchestra.run.smithi019.stdout: "msgr_created_connections": 2, 2024-09-10T22:37:56.365 INFO:teuthology.orchestra.run.smithi019.stdout: "msgr_active_connections": 1, 2024-09-10T22:37:56.365 INFO:teuthology.orchestra.run.smithi019.stdout: "msgr_running_total_time": 0.038763568, 2024-09-10T22:37:56.365 INFO:teuthology.orchestra.run.smithi019.stdout: "msgr_running_send_time": 0.019461235, 2024-09-10T22:37:56.365 INFO:teuthology.orchestra.run.smithi019.stdout: "msgr_running_recv_time": 0.022427885, 2024-09-10T22:37:56.365 INFO:teuthology.orchestra.run.smithi019.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-10T22:37:56.365 INFO:teuthology.orchestra.run.smithi019.stdout: "msgr_send_messages_queue_lat": { 2024-09-10T22:37:56.366 INFO:teuthology.orchestra.run.smithi019.stdout: "avgcount": 224, 2024-09-10T22:37:56.366 INFO:teuthology.orchestra.run.smithi019.stdout: "sum": 0.022422463, 2024-09-10T22:37:56.366 INFO:teuthology.orchestra.run.smithi019.stdout: "avgtime": 0.000100100 2024-09-10T22:37:56.366 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:56.366 INFO:teuthology.orchestra.run.smithi019.stdout: "msgr_handle_ack_lat": { 2024-09-10T22:37:56.366 INFO:teuthology.orchestra.run.smithi019.stdout: "avgcount": 0, 2024-09-10T22:37:56.366 INFO:teuthology.orchestra.run.smithi019.stdout: "sum": 0.000000000, 2024-09-10T22:37:56.366 INFO:teuthology.orchestra.run.smithi019.stdout: "avgtime": 0.000000000 2024-09-10T22:37:56.366 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:56.366 INFO:teuthology.orchestra.run.smithi019.stdout: "msgr_recv_encrypted_bytes": 529136, 2024-09-10T22:37:56.366 INFO:teuthology.orchestra.run.smithi019.stdout: "msgr_send_encrypted_bytes": 136832 2024-09-10T22:37:56.366 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:56.366 INFO:teuthology.orchestra.run.smithi019.stdout: "AsyncMessenger::Worker-2": { 2024-09-10T22:37:56.367 INFO:teuthology.orchestra.run.smithi019.stdout: "msgr_recv_messages": 1, 2024-09-10T22:37:56.367 INFO:teuthology.orchestra.run.smithi019.stdout: "msgr_send_messages": 169, 2024-09-10T22:37:56.367 INFO:teuthology.orchestra.run.smithi019.stdout: "msgr_recv_bytes": 160, 2024-09-10T22:37:56.367 INFO:teuthology.orchestra.run.smithi019.stdout: "msgr_send_bytes": 109984, 2024-09-10T22:37:56.367 INFO:teuthology.orchestra.run.smithi019.stdout: "msgr_created_connections": 3, 2024-09-10T22:37:56.367 INFO:teuthology.orchestra.run.smithi019.stdout: "msgr_active_connections": 2, 2024-09-10T22:37:56.367 INFO:teuthology.orchestra.run.smithi019.stdout: "msgr_running_total_time": 0.014986850, 2024-09-10T22:37:56.367 INFO:teuthology.orchestra.run.smithi019.stdout: "msgr_running_send_time": 0.012336656, 2024-09-10T22:37:56.367 INFO:teuthology.orchestra.run.smithi019.stdout: "msgr_running_recv_time": 0.001104311, 2024-09-10T22:37:56.367 INFO:teuthology.orchestra.run.smithi019.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-10T22:37:56.367 INFO:teuthology.orchestra.run.smithi019.stdout: "msgr_send_messages_queue_lat": { 2024-09-10T22:37:56.367 INFO:teuthology.orchestra.run.smithi019.stdout: "avgcount": 167, 2024-09-10T22:37:56.367 INFO:teuthology.orchestra.run.smithi019.stdout: "sum": 0.011139686, 2024-09-10T22:37:56.367 INFO:teuthology.orchestra.run.smithi019.stdout: "avgtime": 0.000066704 2024-09-10T22:37:56.367 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:56.367 INFO:teuthology.orchestra.run.smithi019.stdout: "msgr_handle_ack_lat": { 2024-09-10T22:37:56.368 INFO:teuthology.orchestra.run.smithi019.stdout: "avgcount": 0, 2024-09-10T22:37:56.368 INFO:teuthology.orchestra.run.smithi019.stdout: "sum": 0.000000000, 2024-09-10T22:37:56.368 INFO:teuthology.orchestra.run.smithi019.stdout: "avgtime": 0.000000000 2024-09-10T22:37:56.368 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:56.368 INFO:teuthology.orchestra.run.smithi019.stdout: "msgr_recv_encrypted_bytes": 160, 2024-09-10T22:37:56.368 INFO:teuthology.orchestra.run.smithi019.stdout: "msgr_send_encrypted_bytes": 109984 2024-09-10T22:37:56.368 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:56.368 INFO:teuthology.orchestra.run.smithi019.stdout: "cct": { 2024-09-10T22:37:56.368 INFO:teuthology.orchestra.run.smithi019.stdout: "total_workers": 0, 2024-09-10T22:37:56.368 INFO:teuthology.orchestra.run.smithi019.stdout: "unhealthy_workers": 0 2024-09-10T22:37:56.368 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:56.368 INFO:teuthology.orchestra.run.smithi019.stdout: "mempool": { 2024-09-10T22:37:56.369 INFO:teuthology.orchestra.run.smithi019.stdout: "bloom_filter_bytes": 0, 2024-09-10T22:37:56.369 INFO:teuthology.orchestra.run.smithi019.stdout: "bloom_filter_items": 0, 2024-09-10T22:37:56.369 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_alloc_bytes": 0, 2024-09-10T22:37:56.369 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_alloc_items": 0, 2024-09-10T22:37:56.369 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_cache_data_bytes": 0, 2024-09-10T22:37:56.369 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_cache_data_items": 0, 2024-09-10T22:37:56.369 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-10T22:37:56.369 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_cache_onode_items": 0, 2024-09-10T22:37:56.369 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-10T22:37:56.369 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_cache_meta_items": 0, 2024-09-10T22:37:56.369 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_cache_other_bytes": 0, 2024-09-10T22:37:56.369 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_cache_other_items": 0, 2024-09-10T22:37:56.369 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-10T22:37:56.369 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_cache_buffer_items": 0, 2024-09-10T22:37:56.370 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_extent_bytes": 0, 2024-09-10T22:37:56.370 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_extent_items": 0, 2024-09-10T22:37:56.370 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_blob_bytes": 0, 2024-09-10T22:37:56.370 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_blob_items": 0, 2024-09-10T22:37:56.370 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-10T22:37:56.370 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_shared_blob_items": 0, 2024-09-10T22:37:56.370 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-10T22:37:56.370 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_inline_bl_items": 0, 2024-09-10T22:37:56.370 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_fsck_bytes": 0, 2024-09-10T22:37:56.370 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_fsck_items": 0, 2024-09-10T22:37:56.370 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_txc_bytes": 0, 2024-09-10T22:37:56.370 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_txc_items": 0, 2024-09-10T22:37:56.371 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-10T22:37:56.371 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_writing_deferred_items": 0, 2024-09-10T22:37:56.371 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_writing_bytes": 0, 2024-09-10T22:37:56.371 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_writing_items": 0, 2024-09-10T22:37:56.371 INFO:teuthology.orchestra.run.smithi019.stdout: "bluefs_bytes": 0, 2024-09-10T22:37:56.371 INFO:teuthology.orchestra.run.smithi019.stdout: "bluefs_items": 0, 2024-09-10T22:37:56.371 INFO:teuthology.orchestra.run.smithi019.stdout: "bluefs_file_reader_bytes": 0, 2024-09-10T22:37:56.371 INFO:teuthology.orchestra.run.smithi019.stdout: "bluefs_file_reader_items": 0, 2024-09-10T22:37:56.371 INFO:teuthology.orchestra.run.smithi019.stdout: "bluefs_file_writer_bytes": 0, 2024-09-10T22:37:56.371 INFO:teuthology.orchestra.run.smithi019.stdout: "bluefs_file_writer_items": 0, 2024-09-10T22:37:56.371 INFO:teuthology.orchestra.run.smithi019.stdout: "buffer_anon_bytes": 148923, 2024-09-10T22:37:56.371 INFO:teuthology.orchestra.run.smithi019.stdout: "buffer_anon_items": 29, 2024-09-10T22:37:56.371 INFO:teuthology.orchestra.run.smithi019.stdout: "buffer_meta_bytes": 0, 2024-09-10T22:37:56.371 INFO:teuthology.orchestra.run.smithi019.stdout: "buffer_meta_items": 0, 2024-09-10T22:37:56.371 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_bytes": 0, 2024-09-10T22:37:56.372 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_items": 0, 2024-09-10T22:37:56.372 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_mapbl_bytes": 0, 2024-09-10T22:37:56.372 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_mapbl_items": 0, 2024-09-10T22:37:56.372 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_pglog_bytes": 0, 2024-09-10T22:37:56.372 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_pglog_items": 0, 2024-09-10T22:37:56.372 INFO:teuthology.orchestra.run.smithi019.stdout: "osdmap_bytes": 0, 2024-09-10T22:37:56.372 INFO:teuthology.orchestra.run.smithi019.stdout: "osdmap_items": 0, 2024-09-10T22:37:56.372 INFO:teuthology.orchestra.run.smithi019.stdout: "osdmap_mapping_bytes": 0, 2024-09-10T22:37:56.372 INFO:teuthology.orchestra.run.smithi019.stdout: "osdmap_mapping_items": 0, 2024-09-10T22:37:56.372 INFO:teuthology.orchestra.run.smithi019.stdout: "pgmap_bytes": 0, 2024-09-10T22:37:56.372 INFO:teuthology.orchestra.run.smithi019.stdout: "pgmap_items": 0, 2024-09-10T22:37:56.372 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_co_bytes": 968, 2024-09-10T22:37:56.372 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_co_items": 2, 2024-09-10T22:37:56.372 INFO:teuthology.orchestra.run.smithi019.stdout: "unittest_1_bytes": 0, 2024-09-10T22:37:56.373 INFO:teuthology.orchestra.run.smithi019.stdout: "unittest_1_items": 0, 2024-09-10T22:37:56.373 INFO:teuthology.orchestra.run.smithi019.stdout: "unittest_2_bytes": 0, 2024-09-10T22:37:56.373 INFO:teuthology.orchestra.run.smithi019.stdout: "unittest_2_items": 0 2024-09-10T22:37:56.373 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:56.373 INFO:teuthology.orchestra.run.smithi019.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-10T22:37:56.373 INFO:teuthology.orchestra.run.smithi019.stdout: "val": 0, 2024-09-10T22:37:56.373 INFO:teuthology.orchestra.run.smithi019.stdout: "max": 104857600, 2024-09-10T22:37:56.373 INFO:teuthology.orchestra.run.smithi019.stdout: "get_started": 0, 2024-09-10T22:37:56.373 INFO:teuthology.orchestra.run.smithi019.stdout: "get": 226, 2024-09-10T22:37:56.373 INFO:teuthology.orchestra.run.smithi019.stdout: "get_sum": 494323, 2024-09-10T22:37:56.373 INFO:teuthology.orchestra.run.smithi019.stdout: "get_or_fail_fail": 0, 2024-09-10T22:37:56.373 INFO:teuthology.orchestra.run.smithi019.stdout: "get_or_fail_success": 226, 2024-09-10T22:37:56.373 INFO:teuthology.orchestra.run.smithi019.stdout: "take": 0, 2024-09-10T22:37:56.373 INFO:teuthology.orchestra.run.smithi019.stdout: "take_sum": 0, 2024-09-10T22:37:56.373 INFO:teuthology.orchestra.run.smithi019.stdout: "put": 226, 2024-09-10T22:37:56.374 INFO:teuthology.orchestra.run.smithi019.stdout: "put_sum": 494323, 2024-09-10T22:37:56.374 INFO:teuthology.orchestra.run.smithi019.stdout: "wait": { 2024-09-10T22:37:56.374 INFO:teuthology.orchestra.run.smithi019.stdout: "avgcount": 0, 2024-09-10T22:37:56.374 INFO:teuthology.orchestra.run.smithi019.stdout: "sum": 0.000000000, 2024-09-10T22:37:56.374 INFO:teuthology.orchestra.run.smithi019.stdout: "avgtime": 0.000000000 2024-09-10T22:37:56.374 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-10T22:37:56.374 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-10T22:37:56.374 INFO:teuthology.orchestra.run.smithi019.stdout:} 2024-09-10T22:37:56.375 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:37:56 smithi138 ceph-mon[35236]: pgmap v692: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 41 MiB/s wr, 85 op/s 2024-09-10T22:37:57.165 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.a 2024-09-10T22:37:57.165 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.a 2024-09-10T22:37:57.165 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update' not found on daemon mds.a 2024-09-10T22:37:57.165 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update_receipt' not found on daemon mds.a 2024-09-10T22:37:57.165 DEBUG:tasks.check_counter:Getting stats from d 2024-09-10T22:37:57.166 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 22997a4c-6fc2-11ef-bcea-c7b262605968 -- ceph daemon mds.d perf dump 2024-09-10T22:37:57.432 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/22997a4c-6fc2-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T22:37:58.002 INFO:teuthology.orchestra.run.smithi019.stdout:{ 2024-09-10T22:37:58.002 INFO:teuthology.orchestra.run.smithi019.stdout: "AsyncMessenger::Worker-0": { 2024-09-10T22:37:58.002 INFO:teuthology.orchestra.run.smithi019.stdout: "msgr_recv_messages": 0, 2024-09-10T22:37:58.002 INFO:teuthology.orchestra.run.smithi019.stdout: "msgr_send_messages": 2, 2024-09-10T22:37:58.002 INFO:teuthology.orchestra.run.smithi019.stdout: "msgr_recv_bytes": 0, 2024-09-10T22:37:58.002 INFO:teuthology.orchestra.run.smithi019.stdout: "msgr_send_bytes": 0, 2024-09-10T22:37:58.002 INFO:teuthology.orchestra.run.smithi019.stdout: "msgr_created_connections": 4, 2024-09-10T22:37:58.003 INFO:teuthology.orchestra.run.smithi019.stdout: "msgr_active_connections": 0, 2024-09-10T22:37:58.003 INFO:teuthology.orchestra.run.smithi019.stdout: "msgr_running_total_time": 0.001245300, 2024-09-10T22:37:58.003 INFO:teuthology.orchestra.run.smithi019.stdout: "msgr_running_send_time": 0.000000000, 2024-09-10T22:37:58.003 INFO:teuthology.orchestra.run.smithi019.stdout: "msgr_running_recv_time": 0.000214330, 2024-09-10T22:37:58.003 INFO:teuthology.orchestra.run.smithi019.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-10T22:37:58.003 INFO:teuthology.orchestra.run.smithi019.stdout: "msgr_send_messages_queue_lat": { 2024-09-10T22:37:58.003 INFO:teuthology.orchestra.run.smithi019.stdout: "avgcount": 0, 2024-09-10T22:37:58.003 INFO:teuthology.orchestra.run.smithi019.stdout: "sum": 0.000000000, 2024-09-10T22:37:58.003 INFO:teuthology.orchestra.run.smithi019.stdout: "avgtime": 0.000000000 2024-09-10T22:37:58.003 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:58.003 INFO:teuthology.orchestra.run.smithi019.stdout: "msgr_handle_ack_lat": { 2024-09-10T22:37:58.003 INFO:teuthology.orchestra.run.smithi019.stdout: "avgcount": 0, 2024-09-10T22:37:58.003 INFO:teuthology.orchestra.run.smithi019.stdout: "sum": 0.000000000, 2024-09-10T22:37:58.003 INFO:teuthology.orchestra.run.smithi019.stdout: "avgtime": 0.000000000 2024-09-10T22:37:58.004 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:58.004 INFO:teuthology.orchestra.run.smithi019.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-10T22:37:58.004 INFO:teuthology.orchestra.run.smithi019.stdout: "msgr_send_encrypted_bytes": 0 2024-09-10T22:37:58.004 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:58.004 INFO:teuthology.orchestra.run.smithi019.stdout: "AsyncMessenger::Worker-1": { 2024-09-10T22:37:58.004 INFO:teuthology.orchestra.run.smithi019.stdout: "msgr_recv_messages": 5, 2024-09-10T22:37:58.004 INFO:teuthology.orchestra.run.smithi019.stdout: "msgr_send_messages": 175, 2024-09-10T22:37:58.004 INFO:teuthology.orchestra.run.smithi019.stdout: "msgr_recv_bytes": 3152, 2024-09-10T22:37:58.004 INFO:teuthology.orchestra.run.smithi019.stdout: "msgr_send_bytes": 111136, 2024-09-10T22:37:58.004 INFO:teuthology.orchestra.run.smithi019.stdout: "msgr_created_connections": 3, 2024-09-10T22:37:58.004 INFO:teuthology.orchestra.run.smithi019.stdout: "msgr_active_connections": 2, 2024-09-10T22:37:58.004 INFO:teuthology.orchestra.run.smithi019.stdout: "msgr_running_total_time": 0.018937775, 2024-09-10T22:37:58.004 INFO:teuthology.orchestra.run.smithi019.stdout: "msgr_running_send_time": 0.013391853, 2024-09-10T22:37:58.004 INFO:teuthology.orchestra.run.smithi019.stdout: "msgr_running_recv_time": 0.004072464, 2024-09-10T22:37:58.004 INFO:teuthology.orchestra.run.smithi019.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-10T22:37:58.005 INFO:teuthology.orchestra.run.smithi019.stdout: "msgr_send_messages_queue_lat": { 2024-09-10T22:37:58.005 INFO:teuthology.orchestra.run.smithi019.stdout: "avgcount": 174, 2024-09-10T22:37:58.005 INFO:teuthology.orchestra.run.smithi019.stdout: "sum": 0.015864102, 2024-09-10T22:37:58.005 INFO:teuthology.orchestra.run.smithi019.stdout: "avgtime": 0.000091173 2024-09-10T22:37:58.005 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:58.005 INFO:teuthology.orchestra.run.smithi019.stdout: "msgr_handle_ack_lat": { 2024-09-10T22:37:58.005 INFO:teuthology.orchestra.run.smithi019.stdout: "avgcount": 0, 2024-09-10T22:37:58.005 INFO:teuthology.orchestra.run.smithi019.stdout: "sum": 0.000000000, 2024-09-10T22:37:58.005 INFO:teuthology.orchestra.run.smithi019.stdout: "avgtime": 0.000000000 2024-09-10T22:37:58.005 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:58.005 INFO:teuthology.orchestra.run.smithi019.stdout: "msgr_recv_encrypted_bytes": 3152, 2024-09-10T22:37:58.005 INFO:teuthology.orchestra.run.smithi019.stdout: "msgr_send_encrypted_bytes": 111136 2024-09-10T22:37:58.005 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:58.005 INFO:teuthology.orchestra.run.smithi019.stdout: "AsyncMessenger::Worker-2": { 2024-09-10T22:37:58.006 INFO:teuthology.orchestra.run.smithi019.stdout: "msgr_recv_messages": 230, 2024-09-10T22:37:58.006 INFO:teuthology.orchestra.run.smithi019.stdout: "msgr_send_messages": 227, 2024-09-10T22:37:58.006 INFO:teuthology.orchestra.run.smithi019.stdout: "msgr_recv_bytes": 527504, 2024-09-10T22:37:58.006 INFO:teuthology.orchestra.run.smithi019.stdout: "msgr_send_bytes": 139584, 2024-09-10T22:37:58.006 INFO:teuthology.orchestra.run.smithi019.stdout: "msgr_created_connections": 2, 2024-09-10T22:37:58.006 INFO:teuthology.orchestra.run.smithi019.stdout: "msgr_active_connections": 1, 2024-09-10T22:37:58.006 INFO:teuthology.orchestra.run.smithi019.stdout: "msgr_running_total_time": 0.038449347, 2024-09-10T22:37:58.006 INFO:teuthology.orchestra.run.smithi019.stdout: "msgr_running_send_time": 0.019517407, 2024-09-10T22:37:58.006 INFO:teuthology.orchestra.run.smithi019.stdout: "msgr_running_recv_time": 0.022186748, 2024-09-10T22:37:58.006 INFO:teuthology.orchestra.run.smithi019.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-10T22:37:58.006 INFO:teuthology.orchestra.run.smithi019.stdout: "msgr_send_messages_queue_lat": { 2024-09-10T22:37:58.006 INFO:teuthology.orchestra.run.smithi019.stdout: "avgcount": 226, 2024-09-10T22:37:58.006 INFO:teuthology.orchestra.run.smithi019.stdout: "sum": 0.012027420, 2024-09-10T22:37:58.006 INFO:teuthology.orchestra.run.smithi019.stdout: "avgtime": 0.000053218 2024-09-10T22:37:58.006 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:58.006 INFO:teuthology.orchestra.run.smithi019.stdout: "msgr_handle_ack_lat": { 2024-09-10T22:37:58.007 INFO:teuthology.orchestra.run.smithi019.stdout: "avgcount": 0, 2024-09-10T22:37:58.007 INFO:teuthology.orchestra.run.smithi019.stdout: "sum": 0.000000000, 2024-09-10T22:37:58.007 INFO:teuthology.orchestra.run.smithi019.stdout: "avgtime": 0.000000000 2024-09-10T22:37:58.007 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:58.007 INFO:teuthology.orchestra.run.smithi019.stdout: "msgr_recv_encrypted_bytes": 527504, 2024-09-10T22:37:58.007 INFO:teuthology.orchestra.run.smithi019.stdout: "msgr_send_encrypted_bytes": 139584 2024-09-10T22:37:58.007 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:58.007 INFO:teuthology.orchestra.run.smithi019.stdout: "cct": { 2024-09-10T22:37:58.007 INFO:teuthology.orchestra.run.smithi019.stdout: "total_workers": 0, 2024-09-10T22:37:58.007 INFO:teuthology.orchestra.run.smithi019.stdout: "unhealthy_workers": 0 2024-09-10T22:37:58.007 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:58.007 INFO:teuthology.orchestra.run.smithi019.stdout: "mempool": { 2024-09-10T22:37:58.007 INFO:teuthology.orchestra.run.smithi019.stdout: "bloom_filter_bytes": 0, 2024-09-10T22:37:58.007 INFO:teuthology.orchestra.run.smithi019.stdout: "bloom_filter_items": 0, 2024-09-10T22:37:58.008 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_alloc_bytes": 0, 2024-09-10T22:37:58.008 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_alloc_items": 0, 2024-09-10T22:37:58.008 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_cache_data_bytes": 0, 2024-09-10T22:37:58.008 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_cache_data_items": 0, 2024-09-10T22:37:58.008 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-10T22:37:58.008 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_cache_onode_items": 0, 2024-09-10T22:37:58.008 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-10T22:37:58.008 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_cache_meta_items": 0, 2024-09-10T22:37:58.008 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_cache_other_bytes": 0, 2024-09-10T22:37:58.008 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_cache_other_items": 0, 2024-09-10T22:37:58.008 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-10T22:37:58.008 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_cache_buffer_items": 0, 2024-09-10T22:37:58.009 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_extent_bytes": 0, 2024-09-10T22:37:58.009 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_extent_items": 0, 2024-09-10T22:37:58.009 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_blob_bytes": 0, 2024-09-10T22:37:58.009 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_blob_items": 0, 2024-09-10T22:37:58.009 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-10T22:37:58.009 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_shared_blob_items": 0, 2024-09-10T22:37:58.009 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-10T22:37:58.009 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_inline_bl_items": 0, 2024-09-10T22:37:58.009 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_fsck_bytes": 0, 2024-09-10T22:37:58.009 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_fsck_items": 0, 2024-09-10T22:37:58.009 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_txc_bytes": 0, 2024-09-10T22:37:58.009 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_txc_items": 0, 2024-09-10T22:37:58.009 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-10T22:37:58.009 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_writing_deferred_items": 0, 2024-09-10T22:37:58.010 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_writing_bytes": 0, 2024-09-10T22:37:58.010 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_writing_items": 0, 2024-09-10T22:37:58.010 INFO:teuthology.orchestra.run.smithi019.stdout: "bluefs_bytes": 0, 2024-09-10T22:37:58.010 INFO:teuthology.orchestra.run.smithi019.stdout: "bluefs_items": 0, 2024-09-10T22:37:58.010 INFO:teuthology.orchestra.run.smithi019.stdout: "bluefs_file_reader_bytes": 0, 2024-09-10T22:37:58.010 INFO:teuthology.orchestra.run.smithi019.stdout: "bluefs_file_reader_items": 0, 2024-09-10T22:37:58.010 INFO:teuthology.orchestra.run.smithi019.stdout: "bluefs_file_writer_bytes": 0, 2024-09-10T22:37:58.010 INFO:teuthology.orchestra.run.smithi019.stdout: "bluefs_file_writer_items": 0, 2024-09-10T22:37:58.010 INFO:teuthology.orchestra.run.smithi019.stdout: "buffer_anon_bytes": 148967, 2024-09-10T22:37:58.010 INFO:teuthology.orchestra.run.smithi019.stdout: "buffer_anon_items": 29, 2024-09-10T22:37:58.010 INFO:teuthology.orchestra.run.smithi019.stdout: "buffer_meta_bytes": 0, 2024-09-10T22:37:58.010 INFO:teuthology.orchestra.run.smithi019.stdout: "buffer_meta_items": 0, 2024-09-10T22:37:58.010 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_bytes": 0, 2024-09-10T22:37:58.010 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_items": 0, 2024-09-10T22:37:58.011 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_mapbl_bytes": 0, 2024-09-10T22:37:58.011 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_mapbl_items": 0, 2024-09-10T22:37:58.011 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_pglog_bytes": 0, 2024-09-10T22:37:58.011 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_pglog_items": 0, 2024-09-10T22:37:58.011 INFO:teuthology.orchestra.run.smithi019.stdout: "osdmap_bytes": 0, 2024-09-10T22:37:58.011 INFO:teuthology.orchestra.run.smithi019.stdout: "osdmap_items": 0, 2024-09-10T22:37:58.011 INFO:teuthology.orchestra.run.smithi019.stdout: "osdmap_mapping_bytes": 0, 2024-09-10T22:37:58.011 INFO:teuthology.orchestra.run.smithi019.stdout: "osdmap_mapping_items": 0, 2024-09-10T22:37:58.011 INFO:teuthology.orchestra.run.smithi019.stdout: "pgmap_bytes": 0, 2024-09-10T22:37:58.011 INFO:teuthology.orchestra.run.smithi019.stdout: "pgmap_items": 0, 2024-09-10T22:37:58.011 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_co_bytes": 968, 2024-09-10T22:37:58.011 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_co_items": 2, 2024-09-10T22:37:58.011 INFO:teuthology.orchestra.run.smithi019.stdout: "unittest_1_bytes": 0, 2024-09-10T22:37:58.011 INFO:teuthology.orchestra.run.smithi019.stdout: "unittest_1_items": 0, 2024-09-10T22:37:58.011 INFO:teuthology.orchestra.run.smithi019.stdout: "unittest_2_bytes": 0, 2024-09-10T22:37:58.012 INFO:teuthology.orchestra.run.smithi019.stdout: "unittest_2_items": 0 2024-09-10T22:37:58.012 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:58.012 INFO:teuthology.orchestra.run.smithi019.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-10T22:37:58.012 INFO:teuthology.orchestra.run.smithi019.stdout: "val": 0, 2024-09-10T22:37:58.012 INFO:teuthology.orchestra.run.smithi019.stdout: "max": 104857600, 2024-09-10T22:37:58.012 INFO:teuthology.orchestra.run.smithi019.stdout: "get_started": 0, 2024-09-10T22:37:58.012 INFO:teuthology.orchestra.run.smithi019.stdout: "get": 231, 2024-09-10T22:37:58.012 INFO:teuthology.orchestra.run.smithi019.stdout: "get_sum": 494973, 2024-09-10T22:37:58.012 INFO:teuthology.orchestra.run.smithi019.stdout: "get_or_fail_fail": 0, 2024-09-10T22:37:58.012 INFO:teuthology.orchestra.run.smithi019.stdout: "get_or_fail_success": 231, 2024-09-10T22:37:58.012 INFO:teuthology.orchestra.run.smithi019.stdout: "take": 0, 2024-09-10T22:37:58.012 INFO:teuthology.orchestra.run.smithi019.stdout: "take_sum": 0, 2024-09-10T22:37:58.012 INFO:teuthology.orchestra.run.smithi019.stdout: "put": 231, 2024-09-10T22:37:58.012 INFO:teuthology.orchestra.run.smithi019.stdout: "put_sum": 494973, 2024-09-10T22:37:58.012 INFO:teuthology.orchestra.run.smithi019.stdout: "wait": { 2024-09-10T22:37:58.013 INFO:teuthology.orchestra.run.smithi019.stdout: "avgcount": 0, 2024-09-10T22:37:58.013 INFO:teuthology.orchestra.run.smithi019.stdout: "sum": 0.000000000, 2024-09-10T22:37:58.013 INFO:teuthology.orchestra.run.smithi019.stdout: "avgtime": 0.000000000 2024-09-10T22:37:58.013 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-10T22:37:58.013 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-10T22:37:58.013 INFO:teuthology.orchestra.run.smithi019.stdout:} 2024-09-10T22:37:58.208 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:37:58 smithi019 ceph-mon[31375]: pgmap v693: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 44 MiB/s wr, 169 op/s 2024-09-10T22:37:58.360 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:37:58 smithi135 ceph-mon[34789]: pgmap v693: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 44 MiB/s wr, 169 op/s 2024-09-10T22:37:58.375 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:37:58 smithi138 ceph-mon[35236]: pgmap v693: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 44 MiB/s wr, 169 op/s 2024-09-10T22:37:58.659 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.d 2024-09-10T22:37:58.659 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.d 2024-09-10T22:37:58.659 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update' not found on daemon mds.d 2024-09-10T22:37:58.659 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update_receipt' not found on daemon mds.d 2024-09-10T22:37:58.659 DEBUG:tasks.check_counter:Getting stats from g 2024-09-10T22:37:58.659 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 22997a4c-6fc2-11ef-bcea-c7b262605968 -- ceph daemon mds.g perf dump 2024-09-10T22:37:58.921 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/22997a4c-6fc2-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T22:37:59.511 INFO:teuthology.orchestra.run.smithi019.stdout:{ 2024-09-10T22:37:59.511 INFO:teuthology.orchestra.run.smithi019.stdout: "AsyncMessenger::Worker-0": { 2024-09-10T22:37:59.512 INFO:teuthology.orchestra.run.smithi019.stdout: "msgr_recv_messages": 0, 2024-09-10T22:37:59.512 INFO:teuthology.orchestra.run.smithi019.stdout: "msgr_send_messages": 2, 2024-09-10T22:37:59.512 INFO:teuthology.orchestra.run.smithi019.stdout: "msgr_recv_bytes": 0, 2024-09-10T22:37:59.512 INFO:teuthology.orchestra.run.smithi019.stdout: "msgr_send_bytes": 0, 2024-09-10T22:37:59.512 INFO:teuthology.orchestra.run.smithi019.stdout: "msgr_created_connections": 4, 2024-09-10T22:37:59.512 INFO:teuthology.orchestra.run.smithi019.stdout: "msgr_active_connections": 0, 2024-09-10T22:37:59.512 INFO:teuthology.orchestra.run.smithi019.stdout: "msgr_running_total_time": 0.001375213, 2024-09-10T22:37:59.512 INFO:teuthology.orchestra.run.smithi019.stdout: "msgr_running_send_time": 0.000000000, 2024-09-10T22:37:59.512 INFO:teuthology.orchestra.run.smithi019.stdout: "msgr_running_recv_time": 0.000263445, 2024-09-10T22:37:59.512 INFO:teuthology.orchestra.run.smithi019.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-10T22:37:59.512 INFO:teuthology.orchestra.run.smithi019.stdout: "msgr_send_messages_queue_lat": { 2024-09-10T22:37:59.512 INFO:teuthology.orchestra.run.smithi019.stdout: "avgcount": 0, 2024-09-10T22:37:59.512 INFO:teuthology.orchestra.run.smithi019.stdout: "sum": 0.000000000, 2024-09-10T22:37:59.513 INFO:teuthology.orchestra.run.smithi019.stdout: "avgtime": 0.000000000 2024-09-10T22:37:59.513 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:59.513 INFO:teuthology.orchestra.run.smithi019.stdout: "msgr_handle_ack_lat": { 2024-09-10T22:37:59.513 INFO:teuthology.orchestra.run.smithi019.stdout: "avgcount": 0, 2024-09-10T22:37:59.513 INFO:teuthology.orchestra.run.smithi019.stdout: "sum": 0.000000000, 2024-09-10T22:37:59.513 INFO:teuthology.orchestra.run.smithi019.stdout: "avgtime": 0.000000000 2024-09-10T22:37:59.513 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:59.513 INFO:teuthology.orchestra.run.smithi019.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-10T22:37:59.513 INFO:teuthology.orchestra.run.smithi019.stdout: "msgr_send_encrypted_bytes": 0 2024-09-10T22:37:59.513 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:59.513 INFO:teuthology.orchestra.run.smithi019.stdout: "AsyncMessenger::Worker-1": { 2024-09-10T22:37:59.513 INFO:teuthology.orchestra.run.smithi019.stdout: "msgr_recv_messages": 231, 2024-09-10T22:37:59.513 INFO:teuthology.orchestra.run.smithi019.stdout: "msgr_send_messages": 226, 2024-09-10T22:37:59.514 INFO:teuthology.orchestra.run.smithi019.stdout: "msgr_recv_bytes": 529680, 2024-09-10T22:37:59.514 INFO:teuthology.orchestra.run.smithi019.stdout: "msgr_send_bytes": 138112, 2024-09-10T22:37:59.514 INFO:teuthology.orchestra.run.smithi019.stdout: "msgr_created_connections": 2, 2024-09-10T22:37:59.514 INFO:teuthology.orchestra.run.smithi019.stdout: "msgr_active_connections": 1, 2024-09-10T22:37:59.514 INFO:teuthology.orchestra.run.smithi019.stdout: "msgr_running_total_time": 0.039795264, 2024-09-10T22:37:59.514 INFO:teuthology.orchestra.run.smithi019.stdout: "msgr_running_send_time": 0.019413527, 2024-09-10T22:37:59.514 INFO:teuthology.orchestra.run.smithi019.stdout: "msgr_running_recv_time": 0.024904682, 2024-09-10T22:37:59.514 INFO:teuthology.orchestra.run.smithi019.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-10T22:37:59.514 INFO:teuthology.orchestra.run.smithi019.stdout: "msgr_send_messages_queue_lat": { 2024-09-10T22:37:59.514 INFO:teuthology.orchestra.run.smithi019.stdout: "avgcount": 226, 2024-09-10T22:37:59.514 INFO:teuthology.orchestra.run.smithi019.stdout: "sum": 0.016189617, 2024-09-10T22:37:59.514 INFO:teuthology.orchestra.run.smithi019.stdout: "avgtime": 0.000071635 2024-09-10T22:37:59.514 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:59.514 INFO:teuthology.orchestra.run.smithi019.stdout: "msgr_handle_ack_lat": { 2024-09-10T22:37:59.514 INFO:teuthology.orchestra.run.smithi019.stdout: "avgcount": 0, 2024-09-10T22:37:59.515 INFO:teuthology.orchestra.run.smithi019.stdout: "sum": 0.000000000, 2024-09-10T22:37:59.515 INFO:teuthology.orchestra.run.smithi019.stdout: "avgtime": 0.000000000 2024-09-10T22:37:59.515 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:59.515 INFO:teuthology.orchestra.run.smithi019.stdout: "msgr_recv_encrypted_bytes": 529680, 2024-09-10T22:37:59.515 INFO:teuthology.orchestra.run.smithi019.stdout: "msgr_send_encrypted_bytes": 138112 2024-09-10T22:37:59.515 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:59.515 INFO:teuthology.orchestra.run.smithi019.stdout: "AsyncMessenger::Worker-2": { 2024-09-10T22:37:59.515 INFO:teuthology.orchestra.run.smithi019.stdout: "msgr_recv_messages": 1, 2024-09-10T22:37:59.515 INFO:teuthology.orchestra.run.smithi019.stdout: "msgr_send_messages": 170, 2024-09-10T22:37:59.515 INFO:teuthology.orchestra.run.smithi019.stdout: "msgr_recv_bytes": 160, 2024-09-10T22:37:59.515 INFO:teuthology.orchestra.run.smithi019.stdout: "msgr_send_bytes": 110160, 2024-09-10T22:37:59.515 INFO:teuthology.orchestra.run.smithi019.stdout: "msgr_created_connections": 3, 2024-09-10T22:37:59.515 INFO:teuthology.orchestra.run.smithi019.stdout: "msgr_active_connections": 2, 2024-09-10T22:37:59.515 INFO:teuthology.orchestra.run.smithi019.stdout: "msgr_running_total_time": 0.016331515, 2024-09-10T22:37:59.516 INFO:teuthology.orchestra.run.smithi019.stdout: "msgr_running_send_time": 0.013324882, 2024-09-10T22:37:59.516 INFO:teuthology.orchestra.run.smithi019.stdout: "msgr_running_recv_time": 0.001397135, 2024-09-10T22:37:59.516 INFO:teuthology.orchestra.run.smithi019.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-10T22:37:59.516 INFO:teuthology.orchestra.run.smithi019.stdout: "msgr_send_messages_queue_lat": { 2024-09-10T22:37:59.516 INFO:teuthology.orchestra.run.smithi019.stdout: "avgcount": 168, 2024-09-10T22:37:59.516 INFO:teuthology.orchestra.run.smithi019.stdout: "sum": 0.007381876, 2024-09-10T22:37:59.516 INFO:teuthology.orchestra.run.smithi019.stdout: "avgtime": 0.000043939 2024-09-10T22:37:59.516 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:59.516 INFO:teuthology.orchestra.run.smithi019.stdout: "msgr_handle_ack_lat": { 2024-09-10T22:37:59.516 INFO:teuthology.orchestra.run.smithi019.stdout: "avgcount": 0, 2024-09-10T22:37:59.516 INFO:teuthology.orchestra.run.smithi019.stdout: "sum": 0.000000000, 2024-09-10T22:37:59.516 INFO:teuthology.orchestra.run.smithi019.stdout: "avgtime": 0.000000000 2024-09-10T22:37:59.516 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:59.516 INFO:teuthology.orchestra.run.smithi019.stdout: "msgr_recv_encrypted_bytes": 160, 2024-09-10T22:37:59.516 INFO:teuthology.orchestra.run.smithi019.stdout: "msgr_send_encrypted_bytes": 110160 2024-09-10T22:37:59.517 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:59.517 INFO:teuthology.orchestra.run.smithi019.stdout: "cct": { 2024-09-10T22:37:59.517 INFO:teuthology.orchestra.run.smithi019.stdout: "total_workers": 0, 2024-09-10T22:37:59.517 INFO:teuthology.orchestra.run.smithi019.stdout: "unhealthy_workers": 0 2024-09-10T22:37:59.517 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:59.517 INFO:teuthology.orchestra.run.smithi019.stdout: "mempool": { 2024-09-10T22:37:59.517 INFO:teuthology.orchestra.run.smithi019.stdout: "bloom_filter_bytes": 0, 2024-09-10T22:37:59.517 INFO:teuthology.orchestra.run.smithi019.stdout: "bloom_filter_items": 0, 2024-09-10T22:37:59.517 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_alloc_bytes": 0, 2024-09-10T22:37:59.517 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_alloc_items": 0, 2024-09-10T22:37:59.517 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_cache_data_bytes": 0, 2024-09-10T22:37:59.517 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_cache_data_items": 0, 2024-09-10T22:37:59.517 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-10T22:37:59.518 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_cache_onode_items": 0, 2024-09-10T22:37:59.518 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-10T22:37:59.518 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_cache_meta_items": 0, 2024-09-10T22:37:59.518 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_cache_other_bytes": 0, 2024-09-10T22:37:59.518 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_cache_other_items": 0, 2024-09-10T22:37:59.518 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-10T22:37:59.518 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_cache_buffer_items": 0, 2024-09-10T22:37:59.518 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_extent_bytes": 0, 2024-09-10T22:37:59.518 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_extent_items": 0, 2024-09-10T22:37:59.518 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_blob_bytes": 0, 2024-09-10T22:37:59.518 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_blob_items": 0, 2024-09-10T22:37:59.518 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-10T22:37:59.518 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_shared_blob_items": 0, 2024-09-10T22:37:59.518 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-10T22:37:59.519 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_inline_bl_items": 0, 2024-09-10T22:37:59.519 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_fsck_bytes": 0, 2024-09-10T22:37:59.519 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_fsck_items": 0, 2024-09-10T22:37:59.519 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_txc_bytes": 0, 2024-09-10T22:37:59.519 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_txc_items": 0, 2024-09-10T22:37:59.519 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-10T22:37:59.519 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_writing_deferred_items": 0, 2024-09-10T22:37:59.519 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_writing_bytes": 0, 2024-09-10T22:37:59.519 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_writing_items": 0, 2024-09-10T22:37:59.519 INFO:teuthology.orchestra.run.smithi019.stdout: "bluefs_bytes": 0, 2024-09-10T22:37:59.519 INFO:teuthology.orchestra.run.smithi019.stdout: "bluefs_items": 0, 2024-09-10T22:37:59.519 INFO:teuthology.orchestra.run.smithi019.stdout: "bluefs_file_reader_bytes": 0, 2024-09-10T22:37:59.519 INFO:teuthology.orchestra.run.smithi019.stdout: "bluefs_file_reader_items": 0, 2024-09-10T22:37:59.519 INFO:teuthology.orchestra.run.smithi019.stdout: "bluefs_file_writer_bytes": 0, 2024-09-10T22:37:59.519 INFO:teuthology.orchestra.run.smithi019.stdout: "bluefs_file_writer_items": 0, 2024-09-10T22:37:59.520 INFO:teuthology.orchestra.run.smithi019.stdout: "buffer_anon_bytes": 148945, 2024-09-10T22:37:59.520 INFO:teuthology.orchestra.run.smithi019.stdout: "buffer_anon_items": 29, 2024-09-10T22:37:59.520 INFO:teuthology.orchestra.run.smithi019.stdout: "buffer_meta_bytes": 0, 2024-09-10T22:37:59.520 INFO:teuthology.orchestra.run.smithi019.stdout: "buffer_meta_items": 0, 2024-09-10T22:37:59.520 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_bytes": 0, 2024-09-10T22:37:59.520 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_items": 0, 2024-09-10T22:37:59.520 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_mapbl_bytes": 0, 2024-09-10T22:37:59.520 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_mapbl_items": 0, 2024-09-10T22:37:59.520 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_pglog_bytes": 0, 2024-09-10T22:37:59.520 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_pglog_items": 0, 2024-09-10T22:37:59.520 INFO:teuthology.orchestra.run.smithi019.stdout: "osdmap_bytes": 0, 2024-09-10T22:37:59.520 INFO:teuthology.orchestra.run.smithi019.stdout: "osdmap_items": 0, 2024-09-10T22:37:59.520 INFO:teuthology.orchestra.run.smithi019.stdout: "osdmap_mapping_bytes": 0, 2024-09-10T22:37:59.520 INFO:teuthology.orchestra.run.smithi019.stdout: "osdmap_mapping_items": 0, 2024-09-10T22:37:59.520 INFO:teuthology.orchestra.run.smithi019.stdout: "pgmap_bytes": 0, 2024-09-10T22:37:59.521 INFO:teuthology.orchestra.run.smithi019.stdout: "pgmap_items": 0, 2024-09-10T22:37:59.521 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_co_bytes": 968, 2024-09-10T22:37:59.521 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_co_items": 2, 2024-09-10T22:37:59.521 INFO:teuthology.orchestra.run.smithi019.stdout: "unittest_1_bytes": 0, 2024-09-10T22:37:59.521 INFO:teuthology.orchestra.run.smithi019.stdout: "unittest_1_items": 0, 2024-09-10T22:37:59.521 INFO:teuthology.orchestra.run.smithi019.stdout: "unittest_2_bytes": 0, 2024-09-10T22:37:59.521 INFO:teuthology.orchestra.run.smithi019.stdout: "unittest_2_items": 0 2024-09-10T22:37:59.521 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:37:59.521 INFO:teuthology.orchestra.run.smithi019.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-10T22:37:59.521 INFO:teuthology.orchestra.run.smithi019.stdout: "val": 0, 2024-09-10T22:37:59.521 INFO:teuthology.orchestra.run.smithi019.stdout: "max": 104857600, 2024-09-10T22:37:59.521 INFO:teuthology.orchestra.run.smithi019.stdout: "get_started": 0, 2024-09-10T22:37:59.521 INFO:teuthology.orchestra.run.smithi019.stdout: "get": 228, 2024-09-10T22:37:59.521 INFO:teuthology.orchestra.run.smithi019.stdout: "get_sum": 494583, 2024-09-10T22:37:59.522 INFO:teuthology.orchestra.run.smithi019.stdout: "get_or_fail_fail": 0, 2024-09-10T22:37:59.522 INFO:teuthology.orchestra.run.smithi019.stdout: "get_or_fail_success": 228, 2024-09-10T22:37:59.522 INFO:teuthology.orchestra.run.smithi019.stdout: "take": 0, 2024-09-10T22:37:59.522 INFO:teuthology.orchestra.run.smithi019.stdout: "take_sum": 0, 2024-09-10T22:37:59.522 INFO:teuthology.orchestra.run.smithi019.stdout: "put": 228, 2024-09-10T22:37:59.522 INFO:teuthology.orchestra.run.smithi019.stdout: "put_sum": 494583, 2024-09-10T22:37:59.522 INFO:teuthology.orchestra.run.smithi019.stdout: "wait": { 2024-09-10T22:37:59.522 INFO:teuthology.orchestra.run.smithi019.stdout: "avgcount": 0, 2024-09-10T22:37:59.522 INFO:teuthology.orchestra.run.smithi019.stdout: "sum": 0.000000000, 2024-09-10T22:37:59.522 INFO:teuthology.orchestra.run.smithi019.stdout: "avgtime": 0.000000000 2024-09-10T22:37:59.522 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-10T22:37:59.522 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-10T22:37:59.523 INFO:teuthology.orchestra.run.smithi019.stdout:} 2024-09-10T22:38:00.193 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:38:00 smithi019 ceph-mon[31375]: pgmap v694: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 35 MiB/s wr, 181 op/s 2024-09-10T22:38:00.224 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.g 2024-09-10T22:38:00.224 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.g 2024-09-10T22:38:00.224 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update' not found on daemon mds.g 2024-09-10T22:38:00.224 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update_receipt' not found on daemon mds.g 2024-09-10T22:38:00.224 DEBUG:tasks.check_counter:Getting stats from j 2024-09-10T22:38:00.224 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 22997a4c-6fc2-11ef-bcea-c7b262605968 -- ceph daemon mds.j perf dump 2024-09-10T22:38:00.360 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:38:00 smithi135 ceph-mon[34789]: pgmap v694: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 35 MiB/s wr, 181 op/s 2024-09-10T22:38:00.375 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:38:00 smithi138 ceph-mon[35236]: pgmap v694: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 35 MiB/s wr, 181 op/s 2024-09-10T22:38:00.484 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/22997a4c-6fc2-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T22:38:01.011 INFO:teuthology.orchestra.run.smithi019.stdout:{ 2024-09-10T22:38:01.012 INFO:teuthology.orchestra.run.smithi019.stdout: "AsyncMessenger::Worker-0": { 2024-09-10T22:38:01.012 INFO:teuthology.orchestra.run.smithi019.stdout: "msgr_recv_messages": 0, 2024-09-10T22:38:01.012 INFO:teuthology.orchestra.run.smithi019.stdout: "msgr_send_messages": 2, 2024-09-10T22:38:01.012 INFO:teuthology.orchestra.run.smithi019.stdout: "msgr_recv_bytes": 0, 2024-09-10T22:38:01.012 INFO:teuthology.orchestra.run.smithi019.stdout: "msgr_send_bytes": 0, 2024-09-10T22:38:01.012 INFO:teuthology.orchestra.run.smithi019.stdout: "msgr_created_connections": 4, 2024-09-10T22:38:01.012 INFO:teuthology.orchestra.run.smithi019.stdout: "msgr_active_connections": 0, 2024-09-10T22:38:01.012 INFO:teuthology.orchestra.run.smithi019.stdout: "msgr_running_total_time": 0.001263498, 2024-09-10T22:38:01.012 INFO:teuthology.orchestra.run.smithi019.stdout: "msgr_running_send_time": 0.000000000, 2024-09-10T22:38:01.012 INFO:teuthology.orchestra.run.smithi019.stdout: "msgr_running_recv_time": 0.000238105, 2024-09-10T22:38:01.012 INFO:teuthology.orchestra.run.smithi019.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-10T22:38:01.012 INFO:teuthology.orchestra.run.smithi019.stdout: "msgr_send_messages_queue_lat": { 2024-09-10T22:38:01.012 INFO:teuthology.orchestra.run.smithi019.stdout: "avgcount": 0, 2024-09-10T22:38:01.012 INFO:teuthology.orchestra.run.smithi019.stdout: "sum": 0.000000000, 2024-09-10T22:38:01.013 INFO:teuthology.orchestra.run.smithi019.stdout: "avgtime": 0.000000000 2024-09-10T22:38:01.013 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:38:01.013 INFO:teuthology.orchestra.run.smithi019.stdout: "msgr_handle_ack_lat": { 2024-09-10T22:38:01.013 INFO:teuthology.orchestra.run.smithi019.stdout: "avgcount": 0, 2024-09-10T22:38:01.013 INFO:teuthology.orchestra.run.smithi019.stdout: "sum": 0.000000000, 2024-09-10T22:38:01.013 INFO:teuthology.orchestra.run.smithi019.stdout: "avgtime": 0.000000000 2024-09-10T22:38:01.013 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:38:01.013 INFO:teuthology.orchestra.run.smithi019.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-10T22:38:01.013 INFO:teuthology.orchestra.run.smithi019.stdout: "msgr_send_encrypted_bytes": 0 2024-09-10T22:38:01.013 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:38:01.013 INFO:teuthology.orchestra.run.smithi019.stdout: "AsyncMessenger::Worker-1": { 2024-09-10T22:38:01.013 INFO:teuthology.orchestra.run.smithi019.stdout: "msgr_recv_messages": 1, 2024-09-10T22:38:01.013 INFO:teuthology.orchestra.run.smithi019.stdout: "msgr_send_messages": 174, 2024-09-10T22:38:01.014 INFO:teuthology.orchestra.run.smithi019.stdout: "msgr_recv_bytes": 160, 2024-09-10T22:38:01.014 INFO:teuthology.orchestra.run.smithi019.stdout: "msgr_send_bytes": 110864, 2024-09-10T22:38:01.014 INFO:teuthology.orchestra.run.smithi019.stdout: "msgr_created_connections": 3, 2024-09-10T22:38:01.014 INFO:teuthology.orchestra.run.smithi019.stdout: "msgr_active_connections": 2, 2024-09-10T22:38:01.014 INFO:teuthology.orchestra.run.smithi019.stdout: "msgr_running_total_time": 0.016790633, 2024-09-10T22:38:01.014 INFO:teuthology.orchestra.run.smithi019.stdout: "msgr_running_send_time": 0.013679431, 2024-09-10T22:38:01.014 INFO:teuthology.orchestra.run.smithi019.stdout: "msgr_running_recv_time": 0.001261003, 2024-09-10T22:38:01.014 INFO:teuthology.orchestra.run.smithi019.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-10T22:38:01.014 INFO:teuthology.orchestra.run.smithi019.stdout: "msgr_send_messages_queue_lat": { 2024-09-10T22:38:01.014 INFO:teuthology.orchestra.run.smithi019.stdout: "avgcount": 172, 2024-09-10T22:38:01.014 INFO:teuthology.orchestra.run.smithi019.stdout: "sum": 0.007905444, 2024-09-10T22:38:01.014 INFO:teuthology.orchestra.run.smithi019.stdout: "avgtime": 0.000045961 2024-09-10T22:38:01.014 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:38:01.014 INFO:teuthology.orchestra.run.smithi019.stdout: "msgr_handle_ack_lat": { 2024-09-10T22:38:01.014 INFO:teuthology.orchestra.run.smithi019.stdout: "avgcount": 0, 2024-09-10T22:38:01.015 INFO:teuthology.orchestra.run.smithi019.stdout: "sum": 0.000000000, 2024-09-10T22:38:01.015 INFO:teuthology.orchestra.run.smithi019.stdout: "avgtime": 0.000000000 2024-09-10T22:38:01.015 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:38:01.015 INFO:teuthology.orchestra.run.smithi019.stdout: "msgr_recv_encrypted_bytes": 160, 2024-09-10T22:38:01.015 INFO:teuthology.orchestra.run.smithi019.stdout: "msgr_send_encrypted_bytes": 110864 2024-09-10T22:38:01.015 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:38:01.015 INFO:teuthology.orchestra.run.smithi019.stdout: "AsyncMessenger::Worker-2": { 2024-09-10T22:38:01.015 INFO:teuthology.orchestra.run.smithi019.stdout: "msgr_recv_messages": 236, 2024-09-10T22:38:01.015 INFO:teuthology.orchestra.run.smithi019.stdout: "msgr_send_messages": 231, 2024-09-10T22:38:01.015 INFO:teuthology.orchestra.run.smithi019.stdout: "msgr_recv_bytes": 531040, 2024-09-10T22:38:01.015 INFO:teuthology.orchestra.run.smithi019.stdout: "msgr_send_bytes": 141312, 2024-09-10T22:38:01.015 INFO:teuthology.orchestra.run.smithi019.stdout: "msgr_created_connections": 2, 2024-09-10T22:38:01.015 INFO:teuthology.orchestra.run.smithi019.stdout: "msgr_active_connections": 1, 2024-09-10T22:38:01.016 INFO:teuthology.orchestra.run.smithi019.stdout: "msgr_running_total_time": 0.039858700, 2024-09-10T22:38:01.016 INFO:teuthology.orchestra.run.smithi019.stdout: "msgr_running_send_time": 0.019651063, 2024-09-10T22:38:01.016 INFO:teuthology.orchestra.run.smithi019.stdout: "msgr_running_recv_time": 0.024105222, 2024-09-10T22:38:01.016 INFO:teuthology.orchestra.run.smithi019.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-10T22:38:01.016 INFO:teuthology.orchestra.run.smithi019.stdout: "msgr_send_messages_queue_lat": { 2024-09-10T22:38:01.016 INFO:teuthology.orchestra.run.smithi019.stdout: "avgcount": 231, 2024-09-10T22:38:01.016 INFO:teuthology.orchestra.run.smithi019.stdout: "sum": 0.016185959, 2024-09-10T22:38:01.016 INFO:teuthology.orchestra.run.smithi019.stdout: "avgtime": 0.000070069 2024-09-10T22:38:01.016 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:38:01.016 INFO:teuthology.orchestra.run.smithi019.stdout: "msgr_handle_ack_lat": { 2024-09-10T22:38:01.016 INFO:teuthology.orchestra.run.smithi019.stdout: "avgcount": 0, 2024-09-10T22:38:01.016 INFO:teuthology.orchestra.run.smithi019.stdout: "sum": 0.000000000, 2024-09-10T22:38:01.016 INFO:teuthology.orchestra.run.smithi019.stdout: "avgtime": 0.000000000 2024-09-10T22:38:01.016 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:38:01.016 INFO:teuthology.orchestra.run.smithi019.stdout: "msgr_recv_encrypted_bytes": 531040, 2024-09-10T22:38:01.017 INFO:teuthology.orchestra.run.smithi019.stdout: "msgr_send_encrypted_bytes": 141312 2024-09-10T22:38:01.017 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:38:01.017 INFO:teuthology.orchestra.run.smithi019.stdout: "cct": { 2024-09-10T22:38:01.017 INFO:teuthology.orchestra.run.smithi019.stdout: "total_workers": 0, 2024-09-10T22:38:01.017 INFO:teuthology.orchestra.run.smithi019.stdout: "unhealthy_workers": 0 2024-09-10T22:38:01.017 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:38:01.017 INFO:teuthology.orchestra.run.smithi019.stdout: "mempool": { 2024-09-10T22:38:01.017 INFO:teuthology.orchestra.run.smithi019.stdout: "bloom_filter_bytes": 0, 2024-09-10T22:38:01.017 INFO:teuthology.orchestra.run.smithi019.stdout: "bloom_filter_items": 0, 2024-09-10T22:38:01.017 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_alloc_bytes": 0, 2024-09-10T22:38:01.017 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_alloc_items": 0, 2024-09-10T22:38:01.017 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_cache_data_bytes": 0, 2024-09-10T22:38:01.017 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_cache_data_items": 0, 2024-09-10T22:38:01.018 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-10T22:38:01.018 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_cache_onode_items": 0, 2024-09-10T22:38:01.018 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-10T22:38:01.018 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_cache_meta_items": 0, 2024-09-10T22:38:01.018 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_cache_other_bytes": 0, 2024-09-10T22:38:01.018 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_cache_other_items": 0, 2024-09-10T22:38:01.018 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-10T22:38:01.018 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_cache_buffer_items": 0, 2024-09-10T22:38:01.018 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_extent_bytes": 0, 2024-09-10T22:38:01.018 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_extent_items": 0, 2024-09-10T22:38:01.018 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_blob_bytes": 0, 2024-09-10T22:38:01.018 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_blob_items": 0, 2024-09-10T22:38:01.018 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-10T22:38:01.018 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_shared_blob_items": 0, 2024-09-10T22:38:01.018 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-10T22:38:01.019 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_inline_bl_items": 0, 2024-09-10T22:38:01.019 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_fsck_bytes": 0, 2024-09-10T22:38:01.019 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_fsck_items": 0, 2024-09-10T22:38:01.019 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_txc_bytes": 0, 2024-09-10T22:38:01.019 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_txc_items": 0, 2024-09-10T22:38:01.019 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-10T22:38:01.019 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_writing_deferred_items": 0, 2024-09-10T22:38:01.019 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_writing_bytes": 0, 2024-09-10T22:38:01.019 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_writing_items": 0, 2024-09-10T22:38:01.019 INFO:teuthology.orchestra.run.smithi019.stdout: "bluefs_bytes": 0, 2024-09-10T22:38:01.019 INFO:teuthology.orchestra.run.smithi019.stdout: "bluefs_items": 0, 2024-09-10T22:38:01.019 INFO:teuthology.orchestra.run.smithi019.stdout: "bluefs_file_reader_bytes": 0, 2024-09-10T22:38:01.020 INFO:teuthology.orchestra.run.smithi019.stdout: "bluefs_file_reader_items": 0, 2024-09-10T22:38:01.020 INFO:teuthology.orchestra.run.smithi019.stdout: "bluefs_file_writer_bytes": 0, 2024-09-10T22:38:01.020 INFO:teuthology.orchestra.run.smithi019.stdout: "bluefs_file_writer_items": 0, 2024-09-10T22:38:01.020 INFO:teuthology.orchestra.run.smithi019.stdout: "buffer_anon_bytes": 148967, 2024-09-10T22:38:01.020 INFO:teuthology.orchestra.run.smithi019.stdout: "buffer_anon_items": 29, 2024-09-10T22:38:01.020 INFO:teuthology.orchestra.run.smithi019.stdout: "buffer_meta_bytes": 0, 2024-09-10T22:38:01.020 INFO:teuthology.orchestra.run.smithi019.stdout: "buffer_meta_items": 0, 2024-09-10T22:38:01.020 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_bytes": 0, 2024-09-10T22:38:01.020 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_items": 0, 2024-09-10T22:38:01.020 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_mapbl_bytes": 0, 2024-09-10T22:38:01.020 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_mapbl_items": 0, 2024-09-10T22:38:01.020 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_pglog_bytes": 0, 2024-09-10T22:38:01.020 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_pglog_items": 0, 2024-09-10T22:38:01.021 INFO:teuthology.orchestra.run.smithi019.stdout: "osdmap_bytes": 0, 2024-09-10T22:38:01.021 INFO:teuthology.orchestra.run.smithi019.stdout: "osdmap_items": 0, 2024-09-10T22:38:01.021 INFO:teuthology.orchestra.run.smithi019.stdout: "osdmap_mapping_bytes": 0, 2024-09-10T22:38:01.021 INFO:teuthology.orchestra.run.smithi019.stdout: "osdmap_mapping_items": 0, 2024-09-10T22:38:01.021 INFO:teuthology.orchestra.run.smithi019.stdout: "pgmap_bytes": 0, 2024-09-10T22:38:01.021 INFO:teuthology.orchestra.run.smithi019.stdout: "pgmap_items": 0, 2024-09-10T22:38:01.021 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_co_bytes": 968, 2024-09-10T22:38:01.021 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_co_items": 2, 2024-09-10T22:38:01.021 INFO:teuthology.orchestra.run.smithi019.stdout: "unittest_1_bytes": 0, 2024-09-10T22:38:01.021 INFO:teuthology.orchestra.run.smithi019.stdout: "unittest_1_items": 0, 2024-09-10T22:38:01.021 INFO:teuthology.orchestra.run.smithi019.stdout: "unittest_2_bytes": 0, 2024-09-10T22:38:01.021 INFO:teuthology.orchestra.run.smithi019.stdout: "unittest_2_items": 0 2024-09-10T22:38:01.021 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-10T22:38:01.021 INFO:teuthology.orchestra.run.smithi019.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-10T22:38:01.022 INFO:teuthology.orchestra.run.smithi019.stdout: "val": 0, 2024-09-10T22:38:01.022 INFO:teuthology.orchestra.run.smithi019.stdout: "max": 104857600, 2024-09-10T22:38:01.022 INFO:teuthology.orchestra.run.smithi019.stdout: "get_started": 0, 2024-09-10T22:38:01.022 INFO:teuthology.orchestra.run.smithi019.stdout: "get": 233, 2024-09-10T22:38:01.022 INFO:teuthology.orchestra.run.smithi019.stdout: "get_sum": 495233, 2024-09-10T22:38:01.022 INFO:teuthology.orchestra.run.smithi019.stdout: "get_or_fail_fail": 0, 2024-09-10T22:38:01.022 INFO:teuthology.orchestra.run.smithi019.stdout: "get_or_fail_success": 233, 2024-09-10T22:38:01.022 INFO:teuthology.orchestra.run.smithi019.stdout: "take": 0, 2024-09-10T22:38:01.022 INFO:teuthology.orchestra.run.smithi019.stdout: "take_sum": 0, 2024-09-10T22:38:01.022 INFO:teuthology.orchestra.run.smithi019.stdout: "put": 233, 2024-09-10T22:38:01.022 INFO:teuthology.orchestra.run.smithi019.stdout: "put_sum": 495233, 2024-09-10T22:38:01.022 INFO:teuthology.orchestra.run.smithi019.stdout: "wait": { 2024-09-10T22:38:01.022 INFO:teuthology.orchestra.run.smithi019.stdout: "avgcount": 0, 2024-09-10T22:38:01.023 INFO:teuthology.orchestra.run.smithi019.stdout: "sum": 0.000000000, 2024-09-10T22:38:01.023 INFO:teuthology.orchestra.run.smithi019.stdout: "avgtime": 0.000000000 2024-09-10T22:38:01.023 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-10T22:38:01.023 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-10T22:38:01.023 INFO:teuthology.orchestra.run.smithi019.stdout:} 2024-09-10T22:38:01.939 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.j 2024-09-10T22:38:01.939 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.j 2024-09-10T22:38:01.939 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update' not found on daemon mds.j 2024-09-10T22:38:01.939 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update_receipt' not found on daemon mds.j 2024-09-10T22:38:01.939 DEBUG:tasks.check_counter:Getting stats from b 2024-09-10T22:38:01.939 DEBUG:teuthology.orchestra.run.smithi135:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 22997a4c-6fc2-11ef-bcea-c7b262605968 -- ceph daemon mds.b perf dump 2024-09-10T22:38:02.208 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:38:02 smithi019 ceph-mon[31375]: pgmap v695: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 46 MiB/s wr, 281 op/s 2024-09-10T22:38:02.223 INFO:teuthology.orchestra.run.smithi135.stderr:Inferring config /var/lib/ceph/22997a4c-6fc2-11ef-bcea-c7b262605968/mon.b/config 2024-09-10T22:38:02.344 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:38:02 smithi135 ceph-mon[34789]: pgmap v695: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 46 MiB/s wr, 281 op/s 2024-09-10T22:38:02.375 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:38:02 smithi138 ceph-mon[35236]: pgmap v695: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 46 MiB/s wr, 281 op/s 2024-09-10T22:38:02.800 INFO:teuthology.orchestra.run.smithi135.stdout:{ 2024-09-10T22:38:02.801 INFO:teuthology.orchestra.run.smithi135.stdout: "AsyncMessenger::Worker-0": { 2024-09-10T22:38:02.801 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_recv_messages": 209779, 2024-09-10T22:38:02.801 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_send_messages": 212021, 2024-09-10T22:38:02.801 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_recv_bytes": 84108038, 2024-09-10T22:38:02.801 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_send_bytes": 213701955, 2024-09-10T22:38:02.801 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_created_connections": 180, 2024-09-10T22:38:02.801 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_active_connections": 8, 2024-09-10T22:38:02.801 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_running_total_time": 16.291238519, 2024-09-10T22:38:02.801 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_running_send_time": 7.984495900, 2024-09-10T22:38:02.801 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_running_recv_time": 19.519331947, 2024-09-10T22:38:02.801 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_running_fast_dispatch_time": 0.201479582, 2024-09-10T22:38:02.802 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_send_messages_queue_lat": { 2024-09-10T22:38:02.802 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 212017, 2024-09-10T22:38:02.802 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 28.081635309, 2024-09-10T22:38:02.802 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000132449 2024-09-10T22:38:02.802 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-10T22:38:02.802 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_handle_ack_lat": { 2024-09-10T22:38:02.802 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 358765, 2024-09-10T22:38:02.802 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.071110143, 2024-09-10T22:38:02.802 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000198 2024-09-10T22:38:02.802 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-10T22:38:02.802 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_recv_encrypted_bytes": 83598240, 2024-09-10T22:38:02.802 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_send_encrypted_bytes": 84085928 2024-09-10T22:38:02.802 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-10T22:38:02.802 INFO:teuthology.orchestra.run.smithi135.stdout: "AsyncMessenger::Worker-1": { 2024-09-10T22:38:02.803 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_recv_messages": 2597, 2024-09-10T22:38:02.803 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_send_messages": 3365, 2024-09-10T22:38:02.803 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_recv_bytes": 663678, 2024-09-10T22:38:02.803 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_send_bytes": 147407172, 2024-09-10T22:38:02.803 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_created_connections": 33, 2024-09-10T22:38:02.803 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_active_connections": 5, 2024-09-10T22:38:02.803 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_running_total_time": 0.917750501, 2024-09-10T22:38:02.803 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_running_send_time": 0.672114765, 2024-09-10T22:38:02.803 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_running_recv_time": 0.098514213, 2024-09-10T22:38:02.803 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_running_fast_dispatch_time": 0.140923201, 2024-09-10T22:38:02.803 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_send_messages_queue_lat": { 2024-09-10T22:38:02.803 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 3367, 2024-09-10T22:38:02.803 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 1.518440620, 2024-09-10T22:38:02.803 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000450977 2024-09-10T22:38:02.804 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-10T22:38:02.804 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_handle_ack_lat": { 2024-09-10T22:38:02.804 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 2294, 2024-09-10T22:38:02.804 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000492817, 2024-09-10T22:38:02.804 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000214 2024-09-10T22:38:02.804 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-10T22:38:02.804 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_recv_encrypted_bytes": 3152, 2024-09-10T22:38:02.804 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_send_encrypted_bytes": 392752 2024-09-10T22:38:02.804 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-10T22:38:02.804 INFO:teuthology.orchestra.run.smithi135.stdout: "AsyncMessenger::Worker-2": { 2024-09-10T22:38:02.804 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_recv_messages": 3071, 2024-09-10T22:38:02.804 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_send_messages": 3697, 2024-09-10T22:38:02.804 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_recv_bytes": 897002, 2024-09-10T22:38:02.805 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_send_bytes": 127712317, 2024-09-10T22:38:02.805 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_created_connections": 12, 2024-09-10T22:38:02.805 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_active_connections": 6, 2024-09-10T22:38:02.805 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_running_total_time": 0.802054468, 2024-09-10T22:38:02.805 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_running_send_time": 0.545910066, 2024-09-10T22:38:02.805 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_running_recv_time": 0.116512667, 2024-09-10T22:38:02.805 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_running_fast_dispatch_time": 0.139337917, 2024-09-10T22:38:02.805 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_send_messages_queue_lat": { 2024-09-10T22:38:02.805 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 3695, 2024-09-10T22:38:02.805 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 1.529048248, 2024-09-10T22:38:02.805 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000413815 2024-09-10T22:38:02.805 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-10T22:38:02.806 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_handle_ack_lat": { 2024-09-10T22:38:02.806 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 2435, 2024-09-10T22:38:02.806 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.004065438, 2024-09-10T22:38:02.806 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000001669 2024-09-10T22:38:02.806 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-10T22:38:02.806 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-10T22:38:02.806 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_send_encrypted_bytes": 0 2024-09-10T22:38:02.806 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-10T22:38:02.806 INFO:teuthology.orchestra.run.smithi135.stdout: "cct": { 2024-09-10T22:38:02.806 INFO:teuthology.orchestra.run.smithi135.stdout: "total_workers": 1, 2024-09-10T22:38:02.806 INFO:teuthology.orchestra.run.smithi135.stdout: "unhealthy_workers": 0 2024-09-10T22:38:02.806 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-10T22:38:02.806 INFO:teuthology.orchestra.run.smithi135.stdout: "finisher-MDSRank": { 2024-09-10T22:38:02.806 INFO:teuthology.orchestra.run.smithi135.stdout: "queue_len": 0, 2024-09-10T22:38:02.807 INFO:teuthology.orchestra.run.smithi135.stdout: "complete_latency": { 2024-09-10T22:38:02.807 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 3166, 2024-09-10T22:38:02.807 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 51.156426134, 2024-09-10T22:38:02.807 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.016158062 2024-09-10T22:38:02.807 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-10T22:38:02.807 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-10T22:38:02.807 INFO:teuthology.orchestra.run.smithi135.stdout: "finisher-PurgeQueue": { 2024-09-10T22:38:02.807 INFO:teuthology.orchestra.run.smithi135.stdout: "queue_len": 0, 2024-09-10T22:38:02.807 INFO:teuthology.orchestra.run.smithi135.stdout: "complete_latency": { 2024-09-10T22:38:02.807 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 47, 2024-09-10T22:38:02.807 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.001619792, 2024-09-10T22:38:02.807 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000034463 2024-09-10T22:38:02.807 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-10T22:38:02.808 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-10T22:38:02.808 INFO:teuthology.orchestra.run.smithi135.stdout: "mds": { 2024-09-10T22:38:02.808 INFO:teuthology.orchestra.run.smithi135.stdout: "request": 168, 2024-09-10T22:38:02.808 INFO:teuthology.orchestra.run.smithi135.stdout: "reply": 167, 2024-09-10T22:38:02.808 INFO:teuthology.orchestra.run.smithi135.stdout: "reply_latency": { 2024-09-10T22:38:02.808 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 167, 2024-09-10T22:38:02.808 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 29.747305395, 2024-09-10T22:38:02.808 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.178127577 2024-09-10T22:38:02.808 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-10T22:38:02.808 INFO:teuthology.orchestra.run.smithi135.stdout: "slow_reply": 0, 2024-09-10T22:38:02.808 INFO:teuthology.orchestra.run.smithi135.stdout: "forward": 1, 2024-09-10T22:38:02.808 INFO:teuthology.orchestra.run.smithi135.stdout: "dir_fetch_complete": 0, 2024-09-10T22:38:02.808 INFO:teuthology.orchestra.run.smithi135.stdout: "dir_fetch_keys": 0, 2024-09-10T22:38:02.808 INFO:teuthology.orchestra.run.smithi135.stdout: "dir_commit": 76, 2024-09-10T22:38:02.809 INFO:teuthology.orchestra.run.smithi135.stdout: "dir_split": 0, 2024-09-10T22:38:02.809 INFO:teuthology.orchestra.run.smithi135.stdout: "dir_merge": 0, 2024-09-10T22:38:02.809 INFO:teuthology.orchestra.run.smithi135.stdout: "inodes": 31, 2024-09-10T22:38:02.809 INFO:teuthology.orchestra.run.smithi135.stdout: "inodes_top": 6, 2024-09-10T22:38:02.809 INFO:teuthology.orchestra.run.smithi135.stdout: "inodes_bottom": 25, 2024-09-10T22:38:02.809 INFO:teuthology.orchestra.run.smithi135.stdout: "inodes_pin_tail": 0, 2024-09-10T22:38:02.809 INFO:teuthology.orchestra.run.smithi135.stdout: "inodes_pinned": 22, 2024-09-10T22:38:02.809 INFO:teuthology.orchestra.run.smithi135.stdout: "inodes_expired": 2, 2024-09-10T22:38:02.809 INFO:teuthology.orchestra.run.smithi135.stdout: "inodes_with_caps": 8, 2024-09-10T22:38:02.809 INFO:teuthology.orchestra.run.smithi135.stdout: "caps": 8, 2024-09-10T22:38:02.809 INFO:teuthology.orchestra.run.smithi135.stdout: "subtrees": 2, 2024-09-10T22:38:02.809 INFO:teuthology.orchestra.run.smithi135.stdout: "traverse": 553, 2024-09-10T22:38:02.809 INFO:teuthology.orchestra.run.smithi135.stdout: "traverse_hit": 540, 2024-09-10T22:38:02.810 INFO:teuthology.orchestra.run.smithi135.stdout: "traverse_forward": 0, 2024-09-10T22:38:02.810 INFO:teuthology.orchestra.run.smithi135.stdout: "traverse_discover": 0, 2024-09-10T22:38:02.810 INFO:teuthology.orchestra.run.smithi135.stdout: "traverse_dir_fetch": 0, 2024-09-10T22:38:02.810 INFO:teuthology.orchestra.run.smithi135.stdout: "traverse_remote_ino": 0, 2024-09-10T22:38:02.810 INFO:teuthology.orchestra.run.smithi135.stdout: "traverse_lock": 0, 2024-09-10T22:38:02.810 INFO:teuthology.orchestra.run.smithi135.stdout: "load_cent": 0, 2024-09-10T22:38:02.810 INFO:teuthology.orchestra.run.smithi135.stdout: "q": 0, 2024-09-10T22:38:02.810 INFO:teuthology.orchestra.run.smithi135.stdout: "exported": 1, 2024-09-10T22:38:02.810 INFO:teuthology.orchestra.run.smithi135.stdout: "exported_inodes": 2, 2024-09-10T22:38:02.810 INFO:teuthology.orchestra.run.smithi135.stdout: "imported": 1, 2024-09-10T22:38:02.810 INFO:teuthology.orchestra.run.smithi135.stdout: "imported_inodes": 0, 2024-09-10T22:38:02.810 INFO:teuthology.orchestra.run.smithi135.stdout: "openino_dir_fetch": 0, 2024-09-10T22:38:02.810 INFO:teuthology.orchestra.run.smithi135.stdout: "openino_backtrace_fetch": 427, 2024-09-10T22:38:02.810 INFO:teuthology.orchestra.run.smithi135.stdout: "openino_peer_discover": 0, 2024-09-10T22:38:02.811 INFO:teuthology.orchestra.run.smithi135.stdout: "root_rfiles": 4, 2024-09-10T22:38:02.811 INFO:teuthology.orchestra.run.smithi135.stdout: "root_rbytes": 234, 2024-09-10T22:38:02.811 INFO:teuthology.orchestra.run.smithi135.stdout: "root_rsnaps": 0, 2024-09-10T22:38:02.811 INFO:teuthology.orchestra.run.smithi135.stdout: "scrub_backtrace_fetch": 427, 2024-09-10T22:38:02.811 INFO:teuthology.orchestra.run.smithi135.stdout: "scrub_set_tag": 0, 2024-09-10T22:38:02.811 INFO:teuthology.orchestra.run.smithi135.stdout: "scrub_backtrace_repaired": 0, 2024-09-10T22:38:02.811 INFO:teuthology.orchestra.run.smithi135.stdout: "scrub_inotable_repaired": 0, 2024-09-10T22:38:02.811 INFO:teuthology.orchestra.run.smithi135.stdout: "scrub_dir_inodes": 159, 2024-09-10T22:38:02.811 INFO:teuthology.orchestra.run.smithi135.stdout: "scrub_dir_base_inodes": 15, 2024-09-10T22:38:02.811 INFO:teuthology.orchestra.run.smithi135.stdout: "scrub_dirfrag_rstats": 144, 2024-09-10T22:38:02.811 INFO:teuthology.orchestra.run.smithi135.stdout: "scrub_file_inodes": 268, 2024-09-10T22:38:02.811 INFO:teuthology.orchestra.run.smithi135.stdout: "handle_inode_file_caps": 2, 2024-09-10T22:38:02.811 INFO:teuthology.orchestra.run.smithi135.stdout: "ceph_cap_op_revoke": 357, 2024-09-10T22:38:02.811 INFO:teuthology.orchestra.run.smithi135.stdout: "ceph_cap_op_grant": 2948, 2024-09-10T22:38:02.811 INFO:teuthology.orchestra.run.smithi135.stdout: "ceph_cap_op_trunc": 0, 2024-09-10T22:38:02.812 INFO:teuthology.orchestra.run.smithi135.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-10T22:38:02.812 INFO:teuthology.orchestra.run.smithi135.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-10T22:38:02.812 INFO:teuthology.orchestra.run.smithi135.stdout: "handle_client_caps": 206442, 2024-09-10T22:38:02.812 INFO:teuthology.orchestra.run.smithi135.stdout: "handle_client_caps_dirty": 206141, 2024-09-10T22:38:02.812 INFO:teuthology.orchestra.run.smithi135.stdout: "handle_client_cap_release": 3, 2024-09-10T22:38:02.812 INFO:teuthology.orchestra.run.smithi135.stdout: "process_request_cap_release": 46 2024-09-10T22:38:02.812 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-10T22:38:02.812 INFO:teuthology.orchestra.run.smithi135.stdout: "mds_cache": { 2024-09-10T22:38:02.812 INFO:teuthology.orchestra.run.smithi135.stdout: "dir_update": 7, 2024-09-10T22:38:02.812 INFO:teuthology.orchestra.run.smithi135.stdout: "dir_update_receipt": 0, 2024-09-10T22:38:02.812 INFO:teuthology.orchestra.run.smithi135.stdout: "dir_try_discover": 0, 2024-09-10T22:38:02.812 INFO:teuthology.orchestra.run.smithi135.stdout: "dir_send_discover": 0, 2024-09-10T22:38:02.812 INFO:teuthology.orchestra.run.smithi135.stdout: "dir_handle_discover": 19, 2024-09-10T22:38:02.812 INFO:teuthology.orchestra.run.smithi135.stdout: "num_strays": 6, 2024-09-10T22:38:02.813 INFO:teuthology.orchestra.run.smithi135.stdout: "num_strays_delayed": 0, 2024-09-10T22:38:02.813 INFO:teuthology.orchestra.run.smithi135.stdout: "num_strays_enqueuing": 0, 2024-09-10T22:38:02.813 INFO:teuthology.orchestra.run.smithi135.stdout: "strays_created": 20, 2024-09-10T22:38:02.813 INFO:teuthology.orchestra.run.smithi135.stdout: "strays_enqueued": 14, 2024-09-10T22:38:02.813 INFO:teuthology.orchestra.run.smithi135.stdout: "strays_reintegrated": 0, 2024-09-10T22:38:02.813 INFO:teuthology.orchestra.run.smithi135.stdout: "strays_migrated": 0, 2024-09-10T22:38:02.813 INFO:teuthology.orchestra.run.smithi135.stdout: "num_recovering_processing": 0, 2024-09-10T22:38:02.813 INFO:teuthology.orchestra.run.smithi135.stdout: "num_recovering_enqueued": 0, 2024-09-10T22:38:02.813 INFO:teuthology.orchestra.run.smithi135.stdout: "num_recovering_prioritized": 0, 2024-09-10T22:38:02.813 INFO:teuthology.orchestra.run.smithi135.stdout: "recovery_started": 0, 2024-09-10T22:38:02.813 INFO:teuthology.orchestra.run.smithi135.stdout: "recovery_completed": 0, 2024-09-10T22:38:02.813 INFO:teuthology.orchestra.run.smithi135.stdout: "ireq_quiesce_path": 0, 2024-09-10T22:38:02.813 INFO:teuthology.orchestra.run.smithi135.stdout: "ireq_quiesce_inode": 0, 2024-09-10T22:38:02.814 INFO:teuthology.orchestra.run.smithi135.stdout: "ireq_enqueue_scrub": 15, 2024-09-10T22:38:02.814 INFO:teuthology.orchestra.run.smithi135.stdout: "ireq_exportdir": 1, 2024-09-10T22:38:02.814 INFO:teuthology.orchestra.run.smithi135.stdout: "ireq_flush": 0, 2024-09-10T22:38:02.814 INFO:teuthology.orchestra.run.smithi135.stdout: "ireq_fragmentdir": 0, 2024-09-10T22:38:02.814 INFO:teuthology.orchestra.run.smithi135.stdout: "ireq_fragstats": 0, 2024-09-10T22:38:02.814 INFO:teuthology.orchestra.run.smithi135.stdout: "ireq_inodestats": 0, 2024-09-10T22:38:02.814 INFO:teuthology.orchestra.run.smithi135.stdout: "uninline_started": 0, 2024-09-10T22:38:02.814 INFO:teuthology.orchestra.run.smithi135.stdout: "uninline_succeeded": 0, 2024-09-10T22:38:02.814 INFO:teuthology.orchestra.run.smithi135.stdout: "uninline_write_failed": 0 2024-09-10T22:38:02.814 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-10T22:38:02.814 INFO:teuthology.orchestra.run.smithi135.stdout: "mds_log": { 2024-09-10T22:38:02.814 INFO:teuthology.orchestra.run.smithi135.stdout: "evlrg": 0, 2024-09-10T22:38:02.814 INFO:teuthology.orchestra.run.smithi135.stdout: "evadd": 206894, 2024-09-10T22:38:02.814 INFO:teuthology.orchestra.run.smithi135.stdout: "evex": 204815, 2024-09-10T22:38:02.815 INFO:teuthology.orchestra.run.smithi135.stdout: "evtrm": 204815, 2024-09-10T22:38:02.815 INFO:teuthology.orchestra.run.smithi135.stdout: "ev": 2079, 2024-09-10T22:38:02.815 INFO:teuthology.orchestra.run.smithi135.stdout: "evexg": 0, 2024-09-10T22:38:02.815 INFO:teuthology.orchestra.run.smithi135.stdout: "evexd": 4659, 2024-09-10T22:38:02.815 INFO:teuthology.orchestra.run.smithi135.stdout: "segadd": 258, 2024-09-10T22:38:02.815 INFO:teuthology.orchestra.run.smithi135.stdout: "segex": 255, 2024-09-10T22:38:02.815 INFO:teuthology.orchestra.run.smithi135.stdout: "segtrm": 255, 2024-09-10T22:38:02.815 INFO:teuthology.orchestra.run.smithi135.stdout: "seg": 3, 2024-09-10T22:38:02.815 INFO:teuthology.orchestra.run.smithi135.stdout: "segmjr": 1, 2024-09-10T22:38:02.815 INFO:teuthology.orchestra.run.smithi135.stdout: "segexg": 0, 2024-09-10T22:38:02.815 INFO:teuthology.orchestra.run.smithi135.stdout: "segexd": 6, 2024-09-10T22:38:02.815 INFO:teuthology.orchestra.run.smithi135.stdout: "expos": 429272612, 2024-09-10T22:38:02.815 INFO:teuthology.orchestra.run.smithi135.stdout: "wrpos": 433684520, 2024-09-10T22:38:02.816 INFO:teuthology.orchestra.run.smithi135.stdout: "rdpos": 0, 2024-09-10T22:38:02.816 INFO:teuthology.orchestra.run.smithi135.stdout: "jlat": { 2024-09-10T22:38:02.816 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 3748, 2024-09-10T22:38:02.816 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 683.959369877, 2024-09-10T22:38:02.816 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.182486491 2024-09-10T22:38:02.816 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-10T22:38:02.816 INFO:teuthology.orchestra.run.smithi135.stdout: "replayed": 0 2024-09-10T22:38:02.816 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-10T22:38:02.816 INFO:teuthology.orchestra.run.smithi135.stdout: "mds_mem": { 2024-09-10T22:38:02.816 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 29, 2024-09-10T22:38:02.816 INFO:teuthology.orchestra.run.smithi135.stdout: "ino+": 60, 2024-09-10T22:38:02.816 INFO:teuthology.orchestra.run.smithi135.stdout: "ino-": 31, 2024-09-10T22:38:02.816 INFO:teuthology.orchestra.run.smithi135.stdout: "dir": 19, 2024-09-10T22:38:02.816 INFO:teuthology.orchestra.run.smithi135.stdout: "dir+": 22, 2024-09-10T22:38:02.817 INFO:teuthology.orchestra.run.smithi135.stdout: "dir-": 3, 2024-09-10T22:38:02.817 INFO:teuthology.orchestra.run.smithi135.stdout: "dn": 31, 2024-09-10T22:38:02.817 INFO:teuthology.orchestra.run.smithi135.stdout: "dn+": 65, 2024-09-10T22:38:02.817 INFO:teuthology.orchestra.run.smithi135.stdout: "dn-": 34, 2024-09-10T22:38:02.817 INFO:teuthology.orchestra.run.smithi135.stdout: "cap": 8, 2024-09-10T22:38:02.817 INFO:teuthology.orchestra.run.smithi135.stdout: "cap+": 36, 2024-09-10T22:38:02.817 INFO:teuthology.orchestra.run.smithi135.stdout: "cap-": 28, 2024-09-10T22:38:02.817 INFO:teuthology.orchestra.run.smithi135.stdout: "rss": 81320, 2024-09-10T22:38:02.817 INFO:teuthology.orchestra.run.smithi135.stdout: "heap": 319676416 2024-09-10T22:38:02.817 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-10T22:38:02.817 INFO:teuthology.orchestra.run.smithi135.stdout: "mds_server": { 2024-09-10T22:38:02.817 INFO:teuthology.orchestra.run.smithi135.stdout: "dispatch_client_request": 403, 2024-09-10T22:38:02.817 INFO:teuthology.orchestra.run.smithi135.stdout: "dispatch_server_request": 2, 2024-09-10T22:38:02.818 INFO:teuthology.orchestra.run.smithi135.stdout: "handle_client_request": 168, 2024-09-10T22:38:02.818 INFO:teuthology.orchestra.run.smithi135.stdout: "handle_client_session": 17, 2024-09-10T22:38:02.818 INFO:teuthology.orchestra.run.smithi135.stdout: "handle_peer_request": 8, 2024-09-10T22:38:02.818 INFO:teuthology.orchestra.run.smithi135.stdout: "req_create_latency": { 2024-09-10T22:38:02.818 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 22, 2024-09-10T22:38:02.818 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.024325612, 2024-09-10T22:38:02.818 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.001105709 2024-09-10T22:38:02.818 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-10T22:38:02.818 INFO:teuthology.orchestra.run.smithi135.stdout: "req_getattr_latency": { 2024-09-10T22:38:02.818 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 82, 2024-09-10T22:38:02.818 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 29.513072747, 2024-09-10T22:38:02.818 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.359915521 2024-09-10T22:38:02.818 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-10T22:38:02.818 INFO:teuthology.orchestra.run.smithi135.stdout: "req_getfilelock_latency": { 2024-09-10T22:38:02.819 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-09-10T22:38:02.819 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-09-10T22:38:02.819 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-09-10T22:38:02.819 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-10T22:38:02.819 INFO:teuthology.orchestra.run.smithi135.stdout: "req_link_latency": { 2024-09-10T22:38:02.819 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-09-10T22:38:02.819 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-09-10T22:38:02.819 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-09-10T22:38:02.819 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-10T22:38:02.819 INFO:teuthology.orchestra.run.smithi135.stdout: "req_lookup_latency": { 2024-09-10T22:38:02.819 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 16, 2024-09-10T22:38:02.819 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.003446813, 2024-09-10T22:38:02.819 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000215425 2024-09-10T22:38:02.819 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-10T22:38:02.819 INFO:teuthology.orchestra.run.smithi135.stdout: "req_lookuphash_latency": { 2024-09-10T22:38:02.819 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-09-10T22:38:02.820 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-09-10T22:38:02.820 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-09-10T22:38:02.820 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-10T22:38:02.820 INFO:teuthology.orchestra.run.smithi135.stdout: "req_lookupino_latency": { 2024-09-10T22:38:02.820 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 2, 2024-09-10T22:38:02.820 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000295297, 2024-09-10T22:38:02.820 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000147648 2024-09-10T22:38:02.820 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-10T22:38:02.820 INFO:teuthology.orchestra.run.smithi135.stdout: "req_lookupname_latency": { 2024-09-10T22:38:02.820 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-09-10T22:38:02.820 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-09-10T22:38:02.820 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-09-10T22:38:02.820 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-10T22:38:02.820 INFO:teuthology.orchestra.run.smithi135.stdout: "req_lookupparent_latency": { 2024-09-10T22:38:02.821 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-09-10T22:38:02.821 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-09-10T22:38:02.821 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-09-10T22:38:02.821 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-10T22:38:02.821 INFO:teuthology.orchestra.run.smithi135.stdout: "req_lookupsnap_latency": { 2024-09-10T22:38:02.821 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-09-10T22:38:02.821 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-09-10T22:38:02.822 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-09-10T22:38:02.822 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-10T22:38:02.822 INFO:teuthology.orchestra.run.smithi135.stdout: "req_lssnap_latency": { 2024-09-10T22:38:02.822 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-09-10T22:38:02.822 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-09-10T22:38:02.822 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-09-10T22:38:02.822 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-10T22:38:02.822 INFO:teuthology.orchestra.run.smithi135.stdout: "req_mkdir_latency": { 2024-09-10T22:38:02.822 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 10, 2024-09-10T22:38:02.822 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.014648260, 2024-09-10T22:38:02.822 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.001464826 2024-09-10T22:38:02.823 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-10T22:38:02.823 INFO:teuthology.orchestra.run.smithi135.stdout: "req_mknod_latency": { 2024-09-10T22:38:02.823 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-09-10T22:38:02.823 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-09-10T22:38:02.823 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-09-10T22:38:02.823 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-10T22:38:02.823 INFO:teuthology.orchestra.run.smithi135.stdout: "req_mksnap_latency": { 2024-09-10T22:38:02.823 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-09-10T22:38:02.823 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-09-10T22:38:02.823 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-09-10T22:38:02.823 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-10T22:38:02.823 INFO:teuthology.orchestra.run.smithi135.stdout: "req_open_latency": { 2024-09-10T22:38:02.824 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 1, 2024-09-10T22:38:02.824 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000199604, 2024-09-10T22:38:02.824 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000199604 2024-09-10T22:38:02.824 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-10T22:38:02.824 INFO:teuthology.orchestra.run.smithi135.stdout: "req_readdir_latency": { 2024-09-10T22:38:02.824 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 4, 2024-09-10T22:38:02.824 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.009141262, 2024-09-10T22:38:02.824 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.002285315 2024-09-10T22:38:02.824 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-10T22:38:02.824 INFO:teuthology.orchestra.run.smithi135.stdout: "req_rename_latency": { 2024-09-10T22:38:02.824 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 2, 2024-09-10T22:38:02.824 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.001982311, 2024-09-10T22:38:02.824 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000991155 2024-09-10T22:38:02.824 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-10T22:38:02.825 INFO:teuthology.orchestra.run.smithi135.stdout: "req_renamesnap_latency": { 2024-09-10T22:38:02.825 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-09-10T22:38:02.825 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-09-10T22:38:02.825 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-09-10T22:38:02.825 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-10T22:38:02.825 INFO:teuthology.orchestra.run.smithi135.stdout: "req_snapdiff_latency": { 2024-09-10T22:38:02.825 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-09-10T22:38:02.825 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-09-10T22:38:02.825 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-09-10T22:38:02.825 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-10T22:38:02.825 INFO:teuthology.orchestra.run.smithi135.stdout: "req_rmdir_latency": { 2024-09-10T22:38:02.825 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 4, 2024-09-10T22:38:02.825 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.140093169, 2024-09-10T22:38:02.825 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.035023292 2024-09-10T22:38:02.826 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-10T22:38:02.826 INFO:teuthology.orchestra.run.smithi135.stdout: "req_rmsnap_latency": { 2024-09-10T22:38:02.826 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-09-10T22:38:02.826 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-09-10T22:38:02.826 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-09-10T22:38:02.826 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-10T22:38:02.826 INFO:teuthology.orchestra.run.smithi135.stdout: "req_rmxattr_latency": { 2024-09-10T22:38:02.826 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-09-10T22:38:02.826 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-09-10T22:38:02.826 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-09-10T22:38:02.826 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-10T22:38:02.826 INFO:teuthology.orchestra.run.smithi135.stdout: "req_setattr_latency": { 2024-09-10T22:38:02.826 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 1, 2024-09-10T22:38:02.826 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000822900, 2024-09-10T22:38:02.826 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000822900 2024-09-10T22:38:02.827 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-10T22:38:02.827 INFO:teuthology.orchestra.run.smithi135.stdout: "req_setdirlayout_latency": { 2024-09-10T22:38:02.827 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-09-10T22:38:02.827 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-09-10T22:38:02.827 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-09-10T22:38:02.827 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-10T22:38:02.827 INFO:teuthology.orchestra.run.smithi135.stdout: "req_setfilelock_latency": { 2024-09-10T22:38:02.827 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-09-10T22:38:02.827 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-09-10T22:38:02.827 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-09-10T22:38:02.827 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-10T22:38:02.827 INFO:teuthology.orchestra.run.smithi135.stdout: "req_setlayout_latency": { 2024-09-10T22:38:02.827 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-09-10T22:38:02.827 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-09-10T22:38:02.827 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-09-10T22:38:02.828 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-10T22:38:02.828 INFO:teuthology.orchestra.run.smithi135.stdout: "req_setxattr_latency": { 2024-09-10T22:38:02.828 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 7, 2024-09-10T22:38:02.828 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.019699174, 2024-09-10T22:38:02.828 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.002814167 2024-09-10T22:38:02.828 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-10T22:38:02.828 INFO:teuthology.orchestra.run.smithi135.stdout: "req_symlink_latency": { 2024-09-10T22:38:02.828 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-09-10T22:38:02.828 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-09-10T22:38:02.828 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-09-10T22:38:02.828 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-10T22:38:02.828 INFO:teuthology.orchestra.run.smithi135.stdout: "req_unlink_latency": { 2024-09-10T22:38:02.828 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 16, 2024-09-10T22:38:02.829 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.019578246, 2024-09-10T22:38:02.829 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.001223640 2024-09-10T22:38:02.829 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-10T22:38:02.829 INFO:teuthology.orchestra.run.smithi135.stdout: "cap_revoke_eviction": 0, 2024-09-10T22:38:02.829 INFO:teuthology.orchestra.run.smithi135.stdout: "cap_acquisition_throttle": 0, 2024-09-10T22:38:02.829 INFO:teuthology.orchestra.run.smithi135.stdout: "req_getvxattr_latency": { 2024-09-10T22:38:02.829 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-09-10T22:38:02.829 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-09-10T22:38:02.829 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-09-10T22:38:02.829 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-10T22:38:02.829 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-10T22:38:02.829 INFO:teuthology.orchestra.run.smithi135.stdout: "mds_sessions": { 2024-09-10T22:38:02.829 INFO:teuthology.orchestra.run.smithi135.stdout: "session_count": 1, 2024-09-10T22:38:02.830 INFO:teuthology.orchestra.run.smithi135.stdout: "session_add": 2, 2024-09-10T22:38:02.830 INFO:teuthology.orchestra.run.smithi135.stdout: "session_remove": 1, 2024-09-10T22:38:02.830 INFO:teuthology.orchestra.run.smithi135.stdout: "sessions_open": 1, 2024-09-10T22:38:02.830 INFO:teuthology.orchestra.run.smithi135.stdout: "sessions_stale": 0, 2024-09-10T22:38:02.830 INFO:teuthology.orchestra.run.smithi135.stdout: "total_load": 51, 2024-09-10T22:38:02.830 INFO:teuthology.orchestra.run.smithi135.stdout: "average_load": 51, 2024-09-10T22:38:02.830 INFO:teuthology.orchestra.run.smithi135.stdout: "avg_session_uptime": 714, 2024-09-10T22:38:02.830 INFO:teuthology.orchestra.run.smithi135.stdout: "mdthresh_evicted": 0 2024-09-10T22:38:02.830 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-10T22:38:02.830 INFO:teuthology.orchestra.run.smithi135.stdout: "mempool": { 2024-09-10T22:38:02.830 INFO:teuthology.orchestra.run.smithi135.stdout: "bloom_filter_bytes": 0, 2024-09-10T22:38:02.830 INFO:teuthology.orchestra.run.smithi135.stdout: "bloom_filter_items": 0, 2024-09-10T22:38:02.830 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_alloc_bytes": 0, 2024-09-10T22:38:02.830 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_alloc_items": 0, 2024-09-10T22:38:02.831 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_cache_data_bytes": 0, 2024-09-10T22:38:02.831 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_cache_data_items": 0, 2024-09-10T22:38:02.831 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-10T22:38:02.831 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_cache_onode_items": 0, 2024-09-10T22:38:02.831 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-10T22:38:02.831 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_cache_meta_items": 0, 2024-09-10T22:38:02.831 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_cache_other_bytes": 0, 2024-09-10T22:38:02.831 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_cache_other_items": 0, 2024-09-10T22:38:02.831 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-10T22:38:02.831 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_cache_buffer_items": 0, 2024-09-10T22:38:02.831 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_extent_bytes": 0, 2024-09-10T22:38:02.831 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_extent_items": 0, 2024-09-10T22:38:02.831 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_blob_bytes": 0, 2024-09-10T22:38:02.831 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_blob_items": 0, 2024-09-10T22:38:02.831 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-10T22:38:02.832 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_shared_blob_items": 0, 2024-09-10T22:38:02.832 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-10T22:38:02.832 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_inline_bl_items": 0, 2024-09-10T22:38:02.832 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_fsck_bytes": 0, 2024-09-10T22:38:02.832 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_fsck_items": 0, 2024-09-10T22:38:02.832 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_txc_bytes": 0, 2024-09-10T22:38:02.832 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_txc_items": 0, 2024-09-10T22:38:02.832 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-10T22:38:02.832 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_writing_deferred_items": 0, 2024-09-10T22:38:02.832 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_writing_bytes": 0, 2024-09-10T22:38:02.832 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_writing_items": 0, 2024-09-10T22:38:02.832 INFO:teuthology.orchestra.run.smithi135.stdout: "bluefs_bytes": 0, 2024-09-10T22:38:02.832 INFO:teuthology.orchestra.run.smithi135.stdout: "bluefs_items": 0, 2024-09-10T22:38:02.833 INFO:teuthology.orchestra.run.smithi135.stdout: "bluefs_file_reader_bytes": 0, 2024-09-10T22:38:02.833 INFO:teuthology.orchestra.run.smithi135.stdout: "bluefs_file_reader_items": 0, 2024-09-10T22:38:02.833 INFO:teuthology.orchestra.run.smithi135.stdout: "bluefs_file_writer_bytes": 0, 2024-09-10T22:38:02.833 INFO:teuthology.orchestra.run.smithi135.stdout: "bluefs_file_writer_items": 0, 2024-09-10T22:38:02.833 INFO:teuthology.orchestra.run.smithi135.stdout: "buffer_anon_bytes": 296133, 2024-09-10T22:38:02.833 INFO:teuthology.orchestra.run.smithi135.stdout: "buffer_anon_items": 113, 2024-09-10T22:38:02.833 INFO:teuthology.orchestra.run.smithi135.stdout: "buffer_meta_bytes": 0, 2024-09-10T22:38:02.833 INFO:teuthology.orchestra.run.smithi135.stdout: "buffer_meta_items": 0, 2024-09-10T22:38:02.833 INFO:teuthology.orchestra.run.smithi135.stdout: "osd_bytes": 0, 2024-09-10T22:38:02.833 INFO:teuthology.orchestra.run.smithi135.stdout: "osd_items": 0, 2024-09-10T22:38:02.833 INFO:teuthology.orchestra.run.smithi135.stdout: "osd_mapbl_bytes": 0, 2024-09-10T22:38:02.833 INFO:teuthology.orchestra.run.smithi135.stdout: "osd_mapbl_items": 0, 2024-09-10T22:38:02.833 INFO:teuthology.orchestra.run.smithi135.stdout: "osd_pglog_bytes": 0, 2024-09-10T22:38:02.834 INFO:teuthology.orchestra.run.smithi135.stdout: "osd_pglog_items": 0, 2024-09-10T22:38:02.834 INFO:teuthology.orchestra.run.smithi135.stdout: "osdmap_bytes": 7880, 2024-09-10T22:38:02.834 INFO:teuthology.orchestra.run.smithi135.stdout: "osdmap_items": 162, 2024-09-10T22:38:02.834 INFO:teuthology.orchestra.run.smithi135.stdout: "osdmap_mapping_bytes": 0, 2024-09-10T22:38:02.834 INFO:teuthology.orchestra.run.smithi135.stdout: "osdmap_mapping_items": 0, 2024-09-10T22:38:02.834 INFO:teuthology.orchestra.run.smithi135.stdout: "pgmap_bytes": 0, 2024-09-10T22:38:02.834 INFO:teuthology.orchestra.run.smithi135.stdout: "pgmap_items": 0, 2024-09-10T22:38:02.834 INFO:teuthology.orchestra.run.smithi135.stdout: "mds_co_bytes": 119697, 2024-09-10T22:38:02.834 INFO:teuthology.orchestra.run.smithi135.stdout: "mds_co_items": 1489, 2024-09-10T22:38:02.834 INFO:teuthology.orchestra.run.smithi135.stdout: "unittest_1_bytes": 0, 2024-09-10T22:38:02.834 INFO:teuthology.orchestra.run.smithi135.stdout: "unittest_1_items": 0, 2024-09-10T22:38:02.834 INFO:teuthology.orchestra.run.smithi135.stdout: "unittest_2_bytes": 0, 2024-09-10T22:38:02.835 INFO:teuthology.orchestra.run.smithi135.stdout: "unittest_2_items": 0 2024-09-10T22:38:02.835 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-10T22:38:02.835 INFO:teuthology.orchestra.run.smithi135.stdout: "objecter": { 2024-09-10T22:38:02.835 INFO:teuthology.orchestra.run.smithi135.stdout: "op_active": 0, 2024-09-10T22:38:02.835 INFO:teuthology.orchestra.run.smithi135.stdout: "op_laggy": 0, 2024-09-10T22:38:02.835 INFO:teuthology.orchestra.run.smithi135.stdout: "op_send": 5489, 2024-09-10T22:38:02.835 INFO:teuthology.orchestra.run.smithi135.stdout: "op_send_bytes": 429714530, 2024-09-10T22:38:02.835 INFO:teuthology.orchestra.run.smithi135.stdout: "op_resend": 32, 2024-09-10T22:38:02.835 INFO:teuthology.orchestra.run.smithi135.stdout: "op_reply": 5489, 2024-09-10T22:38:02.835 INFO:teuthology.orchestra.run.smithi135.stdout: "op_latency": { 2024-09-10T22:38:02.835 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 5489, 2024-09-10T22:38:02.835 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 954.140179821, 2024-09-10T22:38:02.836 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.173827688 2024-09-10T22:38:02.836 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-10T22:38:02.836 INFO:teuthology.orchestra.run.smithi135.stdout: "op_inflight": 0, 2024-09-10T22:38:02.836 INFO:teuthology.orchestra.run.smithi135.stdout: "oplen_avg": { 2024-09-10T22:38:02.836 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 5489, 2024-09-10T22:38:02.836 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 5720 2024-09-10T22:38:02.836 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-10T22:38:02.836 INFO:teuthology.orchestra.run.smithi135.stdout: "op": 5489, 2024-09-10T22:38:02.836 INFO:teuthology.orchestra.run.smithi135.stdout: "op_r": 461, 2024-09-10T22:38:02.836 INFO:teuthology.orchestra.run.smithi135.stdout: "op_w": 5028, 2024-09-10T22:38:02.836 INFO:teuthology.orchestra.run.smithi135.stdout: "op_rmw": 0, 2024-09-10T22:38:02.836 INFO:teuthology.orchestra.run.smithi135.stdout: "op_pg": 0, 2024-09-10T22:38:02.836 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_stat": 54, 2024-09-10T22:38:02.837 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_create": 44, 2024-09-10T22:38:02.837 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_read": 19, 2024-09-10T22:38:02.837 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_write": 3752, 2024-09-10T22:38:02.837 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_writefull": 136, 2024-09-10T22:38:02.837 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_writesame": 0, 2024-09-10T22:38:02.837 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_append": 0, 2024-09-10T22:38:02.837 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_zero": 0, 2024-09-10T22:38:02.837 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_truncate": 0, 2024-09-10T22:38:02.837 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_delete": 729, 2024-09-10T22:38:02.837 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_mapext": 0, 2024-09-10T22:38:02.837 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_sparse_read": 0, 2024-09-10T22:38:02.837 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_clonerange": 0, 2024-09-10T22:38:02.837 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_getxattr": 442, 2024-09-10T22:38:02.837 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_setxattr": 88, 2024-09-10T22:38:02.838 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_cmpxattr": 0, 2024-09-10T22:38:02.838 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_rmxattr": 0, 2024-09-10T22:38:02.838 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_resetxattrs": 0, 2024-09-10T22:38:02.838 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_call": 0, 2024-09-10T22:38:02.838 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_watch": 0, 2024-09-10T22:38:02.838 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_notify": 0, 2024-09-10T22:38:02.838 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_src_cmpxattr": 0, 2024-09-10T22:38:02.838 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_pgls": 0, 2024-09-10T22:38:02.838 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_pgls_filter": 0, 2024-09-10T22:38:02.838 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_other": 0, 2024-09-10T22:38:02.838 INFO:teuthology.orchestra.run.smithi135.stdout: "linger_active": 0, 2024-09-10T22:38:02.838 INFO:teuthology.orchestra.run.smithi135.stdout: "linger_send": 0, 2024-09-10T22:38:02.838 INFO:teuthology.orchestra.run.smithi135.stdout: "linger_resend": 0, 2024-09-10T22:38:02.839 INFO:teuthology.orchestra.run.smithi135.stdout: "linger_ping": 0, 2024-09-10T22:38:02.839 INFO:teuthology.orchestra.run.smithi135.stdout: "poolop_active": 0, 2024-09-10T22:38:02.839 INFO:teuthology.orchestra.run.smithi135.stdout: "poolop_send": 0, 2024-09-10T22:38:02.839 INFO:teuthology.orchestra.run.smithi135.stdout: "poolop_resend": 0, 2024-09-10T22:38:02.839 INFO:teuthology.orchestra.run.smithi135.stdout: "poolstat_active": 0, 2024-09-10T22:38:02.839 INFO:teuthology.orchestra.run.smithi135.stdout: "poolstat_send": 0, 2024-09-10T22:38:02.839 INFO:teuthology.orchestra.run.smithi135.stdout: "poolstat_resend": 0, 2024-09-10T22:38:02.839 INFO:teuthology.orchestra.run.smithi135.stdout: "statfs_active": 0, 2024-09-10T22:38:02.839 INFO:teuthology.orchestra.run.smithi135.stdout: "statfs_send": 0, 2024-09-10T22:38:02.839 INFO:teuthology.orchestra.run.smithi135.stdout: "statfs_resend": 0, 2024-09-10T22:38:02.839 INFO:teuthology.orchestra.run.smithi135.stdout: "command_active": 0, 2024-09-10T22:38:02.839 INFO:teuthology.orchestra.run.smithi135.stdout: "command_send": 0, 2024-09-10T22:38:02.839 INFO:teuthology.orchestra.run.smithi135.stdout: "command_resend": 0, 2024-09-10T22:38:02.840 INFO:teuthology.orchestra.run.smithi135.stdout: "map_epoch": 77, 2024-09-10T22:38:02.840 INFO:teuthology.orchestra.run.smithi135.stdout: "map_full": 0, 2024-09-10T22:38:02.840 INFO:teuthology.orchestra.run.smithi135.stdout: "map_inc": 4, 2024-09-10T22:38:02.840 INFO:teuthology.orchestra.run.smithi135.stdout: "osd_sessions": 12, 2024-09-10T22:38:02.840 INFO:teuthology.orchestra.run.smithi135.stdout: "osd_session_open": 12, 2024-09-10T22:38:02.840 INFO:teuthology.orchestra.run.smithi135.stdout: "osd_session_close": 0, 2024-09-10T22:38:02.840 INFO:teuthology.orchestra.run.smithi135.stdout: "osd_laggy": 0, 2024-09-10T22:38:02.840 INFO:teuthology.orchestra.run.smithi135.stdout: "omap_wr": 441, 2024-09-10T22:38:02.840 INFO:teuthology.orchestra.run.smithi135.stdout: "omap_rd": 0, 2024-09-10T22:38:02.840 INFO:teuthology.orchestra.run.smithi135.stdout: "omap_del": 15 2024-09-10T22:38:02.840 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-10T22:38:02.840 INFO:teuthology.orchestra.run.smithi135.stdout: "oft": { 2024-09-10T22:38:02.840 INFO:teuthology.orchestra.run.smithi135.stdout: "omap_total_objs": 1, 2024-09-10T22:38:02.841 INFO:teuthology.orchestra.run.smithi135.stdout: "omap_total_kv_pairs": 0, 2024-09-10T22:38:02.841 INFO:teuthology.orchestra.run.smithi135.stdout: "omap_total_updates": 0, 2024-09-10T22:38:02.841 INFO:teuthology.orchestra.run.smithi135.stdout: "omap_total_removes": 0 2024-09-10T22:38:02.841 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-10T22:38:02.841 INFO:teuthology.orchestra.run.smithi135.stdout: "purge_queue": { 2024-09-10T22:38:02.841 INFO:teuthology.orchestra.run.smithi135.stdout: "pq_executing_ops": 0, 2024-09-10T22:38:02.841 INFO:teuthology.orchestra.run.smithi135.stdout: "pq_executing_ops_high_water": 10, 2024-09-10T22:38:02.841 INFO:teuthology.orchestra.run.smithi135.stdout: "pq_executing": 0, 2024-09-10T22:38:02.841 INFO:teuthology.orchestra.run.smithi135.stdout: "pq_executing_high_water": 10, 2024-09-10T22:38:02.841 INFO:teuthology.orchestra.run.smithi135.stdout: "pq_executed_ops": 14, 2024-09-10T22:38:02.841 INFO:teuthology.orchestra.run.smithi135.stdout: "pq_executed": 14, 2024-09-10T22:38:02.841 INFO:teuthology.orchestra.run.smithi135.stdout: "pq_item_in_journal": 0 2024-09-10T22:38:02.842 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-10T22:38:02.842 INFO:teuthology.orchestra.run.smithi135.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-10T22:38:02.842 INFO:teuthology.orchestra.run.smithi135.stdout: "val": 0, 2024-09-10T22:38:02.842 INFO:teuthology.orchestra.run.smithi135.stdout: "max": 104857600, 2024-09-10T22:38:02.842 INFO:teuthology.orchestra.run.smithi135.stdout: "get_started": 0, 2024-09-10T22:38:02.842 INFO:teuthology.orchestra.run.smithi135.stdout: "get": 215443, 2024-09-10T22:38:02.842 INFO:teuthology.orchestra.run.smithi135.stdout: "get_sum": 55892021, 2024-09-10T22:38:02.842 INFO:teuthology.orchestra.run.smithi135.stdout: "get_or_fail_fail": 0, 2024-09-10T22:38:02.842 INFO:teuthology.orchestra.run.smithi135.stdout: "get_or_fail_success": 215443, 2024-09-10T22:38:02.842 INFO:teuthology.orchestra.run.smithi135.stdout: "take": 0, 2024-09-10T22:38:02.842 INFO:teuthology.orchestra.run.smithi135.stdout: "take_sum": 0, 2024-09-10T22:38:02.842 INFO:teuthology.orchestra.run.smithi135.stdout: "put": 215443, 2024-09-10T22:38:02.842 INFO:teuthology.orchestra.run.smithi135.stdout: "put_sum": 55892021, 2024-09-10T22:38:02.842 INFO:teuthology.orchestra.run.smithi135.stdout: "wait": { 2024-09-10T22:38:02.843 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-09-10T22:38:02.843 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-09-10T22:38:02.843 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-09-10T22:38:02.843 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-10T22:38:02.843 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-10T22:38:02.843 INFO:teuthology.orchestra.run.smithi135.stdout: "throttle-objecter_bytes": { 2024-09-10T22:38:02.843 INFO:teuthology.orchestra.run.smithi135.stdout: "val": 0, 2024-09-10T22:38:02.843 INFO:teuthology.orchestra.run.smithi135.stdout: "max": 104857600, 2024-09-10T22:38:02.843 INFO:teuthology.orchestra.run.smithi135.stdout: "get_started": 0, 2024-09-10T22:38:02.843 INFO:teuthology.orchestra.run.smithi135.stdout: "get": 0, 2024-09-10T22:38:02.843 INFO:teuthology.orchestra.run.smithi135.stdout: "get_sum": 0, 2024-09-10T22:38:02.843 INFO:teuthology.orchestra.run.smithi135.stdout: "get_or_fail_fail": 0, 2024-09-10T22:38:02.844 INFO:teuthology.orchestra.run.smithi135.stdout: "get_or_fail_success": 0, 2024-09-10T22:38:02.844 INFO:teuthology.orchestra.run.smithi135.stdout: "take": 5489, 2024-09-10T22:38:02.844 INFO:teuthology.orchestra.run.smithi135.stdout: "take_sum": 429715944, 2024-09-10T22:38:02.844 INFO:teuthology.orchestra.run.smithi135.stdout: "put": 5489, 2024-09-10T22:38:02.844 INFO:teuthology.orchestra.run.smithi135.stdout: "put_sum": 429715944, 2024-09-10T22:38:02.844 INFO:teuthology.orchestra.run.smithi135.stdout: "wait": { 2024-09-10T22:38:02.844 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-09-10T22:38:02.844 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-09-10T22:38:02.844 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-09-10T22:38:02.844 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-10T22:38:02.844 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-10T22:38:02.844 INFO:teuthology.orchestra.run.smithi135.stdout: "throttle-objecter_ops": { 2024-09-10T22:38:02.844 INFO:teuthology.orchestra.run.smithi135.stdout: "val": 0, 2024-09-10T22:38:02.845 INFO:teuthology.orchestra.run.smithi135.stdout: "max": 1024, 2024-09-10T22:38:02.845 INFO:teuthology.orchestra.run.smithi135.stdout: "get_started": 0, 2024-09-10T22:38:02.845 INFO:teuthology.orchestra.run.smithi135.stdout: "get": 0, 2024-09-10T22:38:02.845 INFO:teuthology.orchestra.run.smithi135.stdout: "get_sum": 0, 2024-09-10T22:38:02.845 INFO:teuthology.orchestra.run.smithi135.stdout: "get_or_fail_fail": 0, 2024-09-10T22:38:02.845 INFO:teuthology.orchestra.run.smithi135.stdout: "get_or_fail_success": 0, 2024-09-10T22:38:02.845 INFO:teuthology.orchestra.run.smithi135.stdout: "take": 5489, 2024-09-10T22:38:02.845 INFO:teuthology.orchestra.run.smithi135.stdout: "take_sum": 5489, 2024-09-10T22:38:02.845 INFO:teuthology.orchestra.run.smithi135.stdout: "put": 5489, 2024-09-10T22:38:02.845 INFO:teuthology.orchestra.run.smithi135.stdout: "put_sum": 5489, 2024-09-10T22:38:02.845 INFO:teuthology.orchestra.run.smithi135.stdout: "wait": { 2024-09-10T22:38:02.845 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-09-10T22:38:02.846 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-09-10T22:38:02.846 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-09-10T22:38:02.846 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-10T22:38:02.846 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-10T22:38:02.846 INFO:teuthology.orchestra.run.smithi135.stdout: "throttle-write_buf_throttle": { 2024-09-10T22:38:02.846 INFO:teuthology.orchestra.run.smithi135.stdout: "val": 0, 2024-09-10T22:38:02.846 INFO:teuthology.orchestra.run.smithi135.stdout: "max": 3758096384, 2024-09-10T22:38:02.846 INFO:teuthology.orchestra.run.smithi135.stdout: "get_started": 0, 2024-09-10T22:38:02.846 INFO:teuthology.orchestra.run.smithi135.stdout: "get": 14, 2024-09-10T22:38:02.846 INFO:teuthology.orchestra.run.smithi135.stdout: "get_sum": 1414, 2024-09-10T22:38:02.846 INFO:teuthology.orchestra.run.smithi135.stdout: "get_or_fail_fail": 0, 2024-09-10T22:38:02.846 INFO:teuthology.orchestra.run.smithi135.stdout: "get_or_fail_success": 14, 2024-09-10T22:38:02.846 INFO:teuthology.orchestra.run.smithi135.stdout: "take": 0, 2024-09-10T22:38:02.846 INFO:teuthology.orchestra.run.smithi135.stdout: "take_sum": 0, 2024-09-10T22:38:02.847 INFO:teuthology.orchestra.run.smithi135.stdout: "put": 4, 2024-09-10T22:38:02.847 INFO:teuthology.orchestra.run.smithi135.stdout: "put_sum": 1414, 2024-09-10T22:38:02.847 INFO:teuthology.orchestra.run.smithi135.stdout: "wait": { 2024-09-10T22:38:02.847 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-09-10T22:38:02.847 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-09-10T22:38:02.847 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-09-10T22:38:02.847 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-10T22:38:02.847 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-10T22:38:02.847 INFO:teuthology.orchestra.run.smithi135.stdout: "throttle-write_buf_throttle-0x55952bf2edc0": { 2024-09-10T22:38:02.847 INFO:teuthology.orchestra.run.smithi135.stdout: "val": 0, 2024-09-10T22:38:02.847 INFO:teuthology.orchestra.run.smithi135.stdout: "max": 3758096384, 2024-09-10T22:38:02.847 INFO:teuthology.orchestra.run.smithi135.stdout: "get_started": 0, 2024-09-10T22:38:02.847 INFO:teuthology.orchestra.run.smithi135.stdout: "get": 206894, 2024-09-10T22:38:02.847 INFO:teuthology.orchestra.run.smithi135.stdout: "get_sum": 429490216, 2024-09-10T22:38:02.848 INFO:teuthology.orchestra.run.smithi135.stdout: "get_or_fail_fail": 0, 2024-09-10T22:38:02.848 INFO:teuthology.orchestra.run.smithi135.stdout: "get_or_fail_success": 206894, 2024-09-10T22:38:02.848 INFO:teuthology.orchestra.run.smithi135.stdout: "take": 0, 2024-09-10T22:38:02.848 INFO:teuthology.orchestra.run.smithi135.stdout: "take_sum": 0, 2024-09-10T22:38:02.848 INFO:teuthology.orchestra.run.smithi135.stdout: "put": 3748, 2024-09-10T22:38:02.848 INFO:teuthology.orchestra.run.smithi135.stdout: "put_sum": 429490216, 2024-09-10T22:38:02.848 INFO:teuthology.orchestra.run.smithi135.stdout: "wait": { 2024-09-10T22:38:02.848 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-09-10T22:38:02.848 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-09-10T22:38:02.848 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-09-10T22:38:02.848 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-10T22:38:02.848 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-10T22:38:02.849 INFO:teuthology.orchestra.run.smithi135.stdout: "trackedop": { 2024-09-10T22:38:02.849 INFO:teuthology.orchestra.run.smithi135.stdout: "slow_ops_count": 0 2024-09-10T22:38:02.849 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-10T22:38:02.849 INFO:teuthology.orchestra.run.smithi135.stdout:} 2024-09-10T22:38:03.768 INFO:tasks.check_counter:Daemon mds.b mds.exported=1 2024-09-10T22:38:03.768 INFO:tasks.check_counter:Daemon mds.b mds.imported=1 2024-09-10T22:38:03.768 INFO:tasks.check_counter:Daemon mds.b mds_cache.dir_update=7 2024-09-10T22:38:03.768 INFO:tasks.check_counter:Daemon mds.b mds_cache.dir_update_receipt=0 2024-09-10T22:38:03.769 DEBUG:tasks.check_counter:Getting stats from e 2024-09-10T22:38:03.769 DEBUG:teuthology.orchestra.run.smithi135:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 22997a4c-6fc2-11ef-bcea-c7b262605968 -- ceph daemon mds.e perf dump 2024-09-10T22:38:04.018 INFO:teuthology.orchestra.run.smithi135.stderr:Inferring config /var/lib/ceph/22997a4c-6fc2-11ef-bcea-c7b262605968/mon.b/config 2024-09-10T22:38:04.277 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:38:04 smithi135 ceph-mon[34789]: pgmap v696: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 36 MiB/s wr, 298 op/s 2024-09-10T22:38:04.375 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:38:04 smithi138 ceph-mon[35236]: pgmap v696: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 36 MiB/s wr, 298 op/s 2024-09-10T22:38:04.458 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:38:04 smithi019 ceph-mon[31375]: pgmap v696: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 36 MiB/s wr, 298 op/s 2024-09-10T22:38:04.552 INFO:teuthology.orchestra.run.smithi135.stdout:{ 2024-09-10T22:38:04.552 INFO:teuthology.orchestra.run.smithi135.stdout: "AsyncMessenger::Worker-0": { 2024-09-10T22:38:04.552 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_recv_messages": 821, 2024-09-10T22:38:04.553 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_send_messages": 821, 2024-09-10T22:38:04.553 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_recv_bytes": 218757, 2024-09-10T22:38:04.553 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_send_bytes": 260318, 2024-09-10T22:38:04.553 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_created_connections": 6, 2024-09-10T22:38:04.553 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_active_connections": 2, 2024-09-10T22:38:04.553 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_running_total_time": 0.090793429, 2024-09-10T22:38:04.553 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_running_send_time": 0.044053573, 2024-09-10T22:38:04.553 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_running_recv_time": 0.018792525, 2024-09-10T22:38:04.553 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_running_fast_dispatch_time": 0.019913610, 2024-09-10T22:38:04.553 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_send_messages_queue_lat": { 2024-09-10T22:38:04.553 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 820, 2024-09-10T22:38:04.553 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.035674075, 2024-09-10T22:38:04.554 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000043504 2024-09-10T22:38:04.554 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-10T22:38:04.554 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_handle_ack_lat": { 2024-09-10T22:38:04.554 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-09-10T22:38:04.554 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-09-10T22:38:04.554 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-09-10T22:38:04.554 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-10T22:38:04.554 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_recv_encrypted_bytes": 2992, 2024-09-10T22:38:04.554 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_send_encrypted_bytes": 448 2024-09-10T22:38:04.554 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-10T22:38:04.554 INFO:teuthology.orchestra.run.smithi135.stdout: "AsyncMessenger::Worker-1": { 2024-09-10T22:38:04.554 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_recv_messages": 965, 2024-09-10T22:38:04.554 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_send_messages": 957, 2024-09-10T22:38:04.555 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_recv_bytes": 741718, 2024-09-10T22:38:04.555 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_send_bytes": 370725, 2024-09-10T22:38:04.555 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_created_connections": 4, 2024-09-10T22:38:04.555 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_active_connections": 3, 2024-09-10T22:38:04.555 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_running_total_time": 0.114282633, 2024-09-10T22:38:04.555 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_running_send_time": 0.047907475, 2024-09-10T22:38:04.555 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_running_recv_time": 0.039735013, 2024-09-10T22:38:04.555 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_running_fast_dispatch_time": 0.027280557, 2024-09-10T22:38:04.555 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_send_messages_queue_lat": { 2024-09-10T22:38:04.555 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 956, 2024-09-10T22:38:04.555 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.058557168, 2024-09-10T22:38:04.555 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000061252 2024-09-10T22:38:04.555 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-10T22:38:04.556 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_handle_ack_lat": { 2024-09-10T22:38:04.556 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-09-10T22:38:04.556 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-09-10T22:38:04.556 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-09-10T22:38:04.556 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-10T22:38:04.556 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_recv_encrypted_bytes": 564576, 2024-09-10T22:38:04.556 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_send_encrypted_bytes": 141760 2024-09-10T22:38:04.556 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-10T22:38:04.556 INFO:teuthology.orchestra.run.smithi135.stdout: "AsyncMessenger::Worker-2": { 2024-09-10T22:38:04.556 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_recv_messages": 812, 2024-09-10T22:38:04.556 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_send_messages": 985, 2024-09-10T22:38:04.556 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_recv_bytes": 272656, 2024-09-10T22:38:04.557 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_send_bytes": 647018, 2024-09-10T22:38:04.557 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_created_connections": 4, 2024-09-10T22:38:04.557 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_active_connections": 3, 2024-09-10T22:38:04.557 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_running_total_time": 0.124214748, 2024-09-10T22:38:04.557 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_running_send_time": 0.057189851, 2024-09-10T22:38:04.557 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_running_recv_time": 0.026082906, 2024-09-10T22:38:04.557 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_running_fast_dispatch_time": 0.030619672, 2024-09-10T22:38:04.557 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_send_messages_queue_lat": { 2024-09-10T22:38:04.557 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 983, 2024-09-10T22:38:04.557 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.054952350, 2024-09-10T22:38:04.557 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000055902 2024-09-10T22:38:04.557 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-10T22:38:04.557 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_handle_ack_lat": { 2024-09-10T22:38:04.558 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-09-10T22:38:04.558 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-09-10T22:38:04.558 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-09-10T22:38:04.558 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-10T22:38:04.558 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_recv_encrypted_bytes": 160, 2024-09-10T22:38:04.558 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_send_encrypted_bytes": 389120 2024-09-10T22:38:04.558 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-10T22:38:04.558 INFO:teuthology.orchestra.run.smithi135.stdout: "cct": { 2024-09-10T22:38:04.558 INFO:teuthology.orchestra.run.smithi135.stdout: "total_workers": 1, 2024-09-10T22:38:04.558 INFO:teuthology.orchestra.run.smithi135.stdout: "unhealthy_workers": 0 2024-09-10T22:38:04.558 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-10T22:38:04.558 INFO:teuthology.orchestra.run.smithi135.stdout: "finisher-MDSRank": { 2024-09-10T22:38:04.558 INFO:teuthology.orchestra.run.smithi135.stdout: "queue_len": 0, 2024-09-10T22:38:04.558 INFO:teuthology.orchestra.run.smithi135.stdout: "complete_latency": { 2024-09-10T22:38:04.559 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 3934, 2024-09-10T22:38:04.559 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.123715267, 2024-09-10T22:38:04.559 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000031447 2024-09-10T22:38:04.559 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-10T22:38:04.559 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-10T22:38:04.559 INFO:teuthology.orchestra.run.smithi135.stdout: "finisher-PurgeQueue": { 2024-09-10T22:38:04.559 INFO:teuthology.orchestra.run.smithi135.stdout: "queue_len": 0, 2024-09-10T22:38:04.559 INFO:teuthology.orchestra.run.smithi135.stdout: "complete_latency": { 2024-09-10T22:38:04.559 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-09-10T22:38:04.559 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-09-10T22:38:04.559 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-09-10T22:38:04.559 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-10T22:38:04.559 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-10T22:38:04.559 INFO:teuthology.orchestra.run.smithi135.stdout: "mds": { 2024-09-10T22:38:04.560 INFO:teuthology.orchestra.run.smithi135.stdout: "request": 0, 2024-09-10T22:38:04.560 INFO:teuthology.orchestra.run.smithi135.stdout: "reply": 0, 2024-09-10T22:38:04.560 INFO:teuthology.orchestra.run.smithi135.stdout: "reply_latency": { 2024-09-10T22:38:04.560 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-09-10T22:38:04.560 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-09-10T22:38:04.560 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-09-10T22:38:04.560 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-10T22:38:04.560 INFO:teuthology.orchestra.run.smithi135.stdout: "slow_reply": 0, 2024-09-10T22:38:04.560 INFO:teuthology.orchestra.run.smithi135.stdout: "forward": 0, 2024-09-10T22:38:04.560 INFO:teuthology.orchestra.run.smithi135.stdout: "dir_fetch_complete": 0, 2024-09-10T22:38:04.560 INFO:teuthology.orchestra.run.smithi135.stdout: "dir_fetch_keys": 0, 2024-09-10T22:38:04.560 INFO:teuthology.orchestra.run.smithi135.stdout: "dir_commit": 0, 2024-09-10T22:38:04.560 INFO:teuthology.orchestra.run.smithi135.stdout: "dir_split": 0, 2024-09-10T22:38:04.560 INFO:teuthology.orchestra.run.smithi135.stdout: "dir_merge": 0, 2024-09-10T22:38:04.561 INFO:teuthology.orchestra.run.smithi135.stdout: "inodes": 0, 2024-09-10T22:38:04.561 INFO:teuthology.orchestra.run.smithi135.stdout: "inodes_top": 0, 2024-09-10T22:38:04.561 INFO:teuthology.orchestra.run.smithi135.stdout: "inodes_bottom": 0, 2024-09-10T22:38:04.561 INFO:teuthology.orchestra.run.smithi135.stdout: "inodes_pin_tail": 0, 2024-09-10T22:38:04.561 INFO:teuthology.orchestra.run.smithi135.stdout: "inodes_pinned": 0, 2024-09-10T22:38:04.561 INFO:teuthology.orchestra.run.smithi135.stdout: "inodes_expired": 0, 2024-09-10T22:38:04.561 INFO:teuthology.orchestra.run.smithi135.stdout: "inodes_with_caps": 0, 2024-09-10T22:38:04.561 INFO:teuthology.orchestra.run.smithi135.stdout: "caps": 0, 2024-09-10T22:38:04.561 INFO:teuthology.orchestra.run.smithi135.stdout: "subtrees": 1, 2024-09-10T22:38:04.561 INFO:teuthology.orchestra.run.smithi135.stdout: "traverse": 0, 2024-09-10T22:38:04.561 INFO:teuthology.orchestra.run.smithi135.stdout: "traverse_hit": 0, 2024-09-10T22:38:04.561 INFO:teuthology.orchestra.run.smithi135.stdout: "traverse_forward": 0, 2024-09-10T22:38:04.561 INFO:teuthology.orchestra.run.smithi135.stdout: "traverse_discover": 0, 2024-09-10T22:38:04.562 INFO:teuthology.orchestra.run.smithi135.stdout: "traverse_dir_fetch": 0, 2024-09-10T22:38:04.562 INFO:teuthology.orchestra.run.smithi135.stdout: "traverse_remote_ino": 0, 2024-09-10T22:38:04.562 INFO:teuthology.orchestra.run.smithi135.stdout: "traverse_lock": 0, 2024-09-10T22:38:04.562 INFO:teuthology.orchestra.run.smithi135.stdout: "load_cent": 0, 2024-09-10T22:38:04.562 INFO:teuthology.orchestra.run.smithi135.stdout: "q": 0, 2024-09-10T22:38:04.562 INFO:teuthology.orchestra.run.smithi135.stdout: "exported": 0, 2024-09-10T22:38:04.562 INFO:teuthology.orchestra.run.smithi135.stdout: "exported_inodes": 0, 2024-09-10T22:38:04.562 INFO:teuthology.orchestra.run.smithi135.stdout: "imported": 0, 2024-09-10T22:38:04.562 INFO:teuthology.orchestra.run.smithi135.stdout: "imported_inodes": 0, 2024-09-10T22:38:04.562 INFO:teuthology.orchestra.run.smithi135.stdout: "openino_dir_fetch": 0, 2024-09-10T22:38:04.562 INFO:teuthology.orchestra.run.smithi135.stdout: "openino_backtrace_fetch": 0, 2024-09-10T22:38:04.562 INFO:teuthology.orchestra.run.smithi135.stdout: "openino_peer_discover": 0, 2024-09-10T22:38:04.563 INFO:teuthology.orchestra.run.smithi135.stdout: "root_rfiles": 0, 2024-09-10T22:38:04.563 INFO:teuthology.orchestra.run.smithi135.stdout: "root_rbytes": 0, 2024-09-10T22:38:04.563 INFO:teuthology.orchestra.run.smithi135.stdout: "root_rsnaps": 0, 2024-09-10T22:38:04.563 INFO:teuthology.orchestra.run.smithi135.stdout: "scrub_backtrace_fetch": 0, 2024-09-10T22:38:04.563 INFO:teuthology.orchestra.run.smithi135.stdout: "scrub_set_tag": 0, 2024-09-10T22:38:04.563 INFO:teuthology.orchestra.run.smithi135.stdout: "scrub_backtrace_repaired": 0, 2024-09-10T22:38:04.563 INFO:teuthology.orchestra.run.smithi135.stdout: "scrub_inotable_repaired": 0, 2024-09-10T22:38:04.563 INFO:teuthology.orchestra.run.smithi135.stdout: "scrub_dir_inodes": 0, 2024-09-10T22:38:04.563 INFO:teuthology.orchestra.run.smithi135.stdout: "scrub_dir_base_inodes": 0, 2024-09-10T22:38:04.563 INFO:teuthology.orchestra.run.smithi135.stdout: "scrub_dirfrag_rstats": 0, 2024-09-10T22:38:04.563 INFO:teuthology.orchestra.run.smithi135.stdout: "scrub_file_inodes": 0, 2024-09-10T22:38:04.563 INFO:teuthology.orchestra.run.smithi135.stdout: "handle_inode_file_caps": 0, 2024-09-10T22:38:04.563 INFO:teuthology.orchestra.run.smithi135.stdout: "ceph_cap_op_revoke": 0, 2024-09-10T22:38:04.564 INFO:teuthology.orchestra.run.smithi135.stdout: "ceph_cap_op_grant": 0, 2024-09-10T22:38:04.564 INFO:teuthology.orchestra.run.smithi135.stdout: "ceph_cap_op_trunc": 0, 2024-09-10T22:38:04.564 INFO:teuthology.orchestra.run.smithi135.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-10T22:38:04.564 INFO:teuthology.orchestra.run.smithi135.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-10T22:38:04.564 INFO:teuthology.orchestra.run.smithi135.stdout: "handle_client_caps": 0, 2024-09-10T22:38:04.564 INFO:teuthology.orchestra.run.smithi135.stdout: "handle_client_caps_dirty": 0, 2024-09-10T22:38:04.564 INFO:teuthology.orchestra.run.smithi135.stdout: "handle_client_cap_release": 0, 2024-09-10T22:38:04.564 INFO:teuthology.orchestra.run.smithi135.stdout: "process_request_cap_release": 0 2024-09-10T22:38:04.564 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-10T22:38:04.564 INFO:teuthology.orchestra.run.smithi135.stdout: "mds_cache": { 2024-09-10T22:38:04.564 INFO:teuthology.orchestra.run.smithi135.stdout: "dir_update": 0, 2024-09-10T22:38:04.564 INFO:teuthology.orchestra.run.smithi135.stdout: "dir_update_receipt": 0, 2024-09-10T22:38:04.564 INFO:teuthology.orchestra.run.smithi135.stdout: "dir_try_discover": 0, 2024-09-10T22:38:04.565 INFO:teuthology.orchestra.run.smithi135.stdout: "dir_send_discover": 0, 2024-09-10T22:38:04.565 INFO:teuthology.orchestra.run.smithi135.stdout: "dir_handle_discover": 0, 2024-09-10T22:38:04.565 INFO:teuthology.orchestra.run.smithi135.stdout: "num_strays": 0, 2024-09-10T22:38:04.565 INFO:teuthology.orchestra.run.smithi135.stdout: "num_strays_delayed": 0, 2024-09-10T22:38:04.565 INFO:teuthology.orchestra.run.smithi135.stdout: "num_strays_enqueuing": 0, 2024-09-10T22:38:04.565 INFO:teuthology.orchestra.run.smithi135.stdout: "strays_created": 0, 2024-09-10T22:38:04.565 INFO:teuthology.orchestra.run.smithi135.stdout: "strays_enqueued": 0, 2024-09-10T22:38:04.565 INFO:teuthology.orchestra.run.smithi135.stdout: "strays_reintegrated": 0, 2024-09-10T22:38:04.565 INFO:teuthology.orchestra.run.smithi135.stdout: "strays_migrated": 0, 2024-09-10T22:38:04.565 INFO:teuthology.orchestra.run.smithi135.stdout: "num_recovering_processing": 0, 2024-09-10T22:38:04.565 INFO:teuthology.orchestra.run.smithi135.stdout: "num_recovering_enqueued": 0, 2024-09-10T22:38:04.565 INFO:teuthology.orchestra.run.smithi135.stdout: "num_recovering_prioritized": 0, 2024-09-10T22:38:04.566 INFO:teuthology.orchestra.run.smithi135.stdout: "recovery_started": 0, 2024-09-10T22:38:04.566 INFO:teuthology.orchestra.run.smithi135.stdout: "recovery_completed": 0, 2024-09-10T22:38:04.566 INFO:teuthology.orchestra.run.smithi135.stdout: "ireq_quiesce_path": 0, 2024-09-10T22:38:04.566 INFO:teuthology.orchestra.run.smithi135.stdout: "ireq_quiesce_inode": 0, 2024-09-10T22:38:04.566 INFO:teuthology.orchestra.run.smithi135.stdout: "ireq_enqueue_scrub": 0, 2024-09-10T22:38:04.566 INFO:teuthology.orchestra.run.smithi135.stdout: "ireq_exportdir": 0, 2024-09-10T22:38:04.566 INFO:teuthology.orchestra.run.smithi135.stdout: "ireq_flush": 0, 2024-09-10T22:38:04.566 INFO:teuthology.orchestra.run.smithi135.stdout: "ireq_fragmentdir": 0, 2024-09-10T22:38:04.566 INFO:teuthology.orchestra.run.smithi135.stdout: "ireq_fragstats": 0, 2024-09-10T22:38:04.566 INFO:teuthology.orchestra.run.smithi135.stdout: "ireq_inodestats": 0, 2024-09-10T22:38:04.566 INFO:teuthology.orchestra.run.smithi135.stdout: "uninline_started": 0, 2024-09-10T22:38:04.566 INFO:teuthology.orchestra.run.smithi135.stdout: "uninline_succeeded": 0, 2024-09-10T22:38:04.566 INFO:teuthology.orchestra.run.smithi135.stdout: "uninline_write_failed": 0 2024-09-10T22:38:04.567 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-10T22:38:04.567 INFO:teuthology.orchestra.run.smithi135.stdout: "mds_log": { 2024-09-10T22:38:04.567 INFO:teuthology.orchestra.run.smithi135.stdout: "evlrg": 0, 2024-09-10T22:38:04.567 INFO:teuthology.orchestra.run.smithi135.stdout: "evadd": 0, 2024-09-10T22:38:04.567 INFO:teuthology.orchestra.run.smithi135.stdout: "evex": 0, 2024-09-10T22:38:04.567 INFO:teuthology.orchestra.run.smithi135.stdout: "evtrm": 0, 2024-09-10T22:38:04.567 INFO:teuthology.orchestra.run.smithi135.stdout: "ev": 4, 2024-09-10T22:38:04.567 INFO:teuthology.orchestra.run.smithi135.stdout: "evexg": 0, 2024-09-10T22:38:04.567 INFO:teuthology.orchestra.run.smithi135.stdout: "evexd": 0, 2024-09-10T22:38:04.567 INFO:teuthology.orchestra.run.smithi135.stdout: "segadd": 0, 2024-09-10T22:38:04.567 INFO:teuthology.orchestra.run.smithi135.stdout: "segex": 0, 2024-09-10T22:38:04.567 INFO:teuthology.orchestra.run.smithi135.stdout: "segtrm": 0, 2024-09-10T22:38:04.567 INFO:teuthology.orchestra.run.smithi135.stdout: "seg": 2, 2024-09-10T22:38:04.567 INFO:teuthology.orchestra.run.smithi135.stdout: "segmjr": 2, 2024-09-10T22:38:04.568 INFO:teuthology.orchestra.run.smithi135.stdout: "segexg": 0, 2024-09-10T22:38:04.568 INFO:teuthology.orchestra.run.smithi135.stdout: "segexd": 0, 2024-09-10T22:38:04.568 INFO:teuthology.orchestra.run.smithi135.stdout: "expos": 4194304, 2024-09-10T22:38:04.568 INFO:teuthology.orchestra.run.smithi135.stdout: "wrpos": 4195424, 2024-09-10T22:38:04.568 INFO:teuthology.orchestra.run.smithi135.stdout: "rdpos": 4195283, 2024-09-10T22:38:04.568 INFO:teuthology.orchestra.run.smithi135.stdout: "jlat": { 2024-09-10T22:38:04.568 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-09-10T22:38:04.568 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-09-10T22:38:04.568 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-09-10T22:38:04.568 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-10T22:38:04.568 INFO:teuthology.orchestra.run.smithi135.stdout: "replayed": 4 2024-09-10T22:38:04.568 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-10T22:38:04.568 INFO:teuthology.orchestra.run.smithi135.stdout: "mds_mem": { 2024-09-10T22:38:04.569 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 3, 2024-09-10T22:38:04.569 INFO:teuthology.orchestra.run.smithi135.stdout: "ino+": 3, 2024-09-10T22:38:04.569 INFO:teuthology.orchestra.run.smithi135.stdout: "ino-": 0, 2024-09-10T22:38:04.569 INFO:teuthology.orchestra.run.smithi135.stdout: "dir": 1, 2024-09-10T22:38:04.569 INFO:teuthology.orchestra.run.smithi135.stdout: "dir+": 1, 2024-09-10T22:38:04.569 INFO:teuthology.orchestra.run.smithi135.stdout: "dir-": 0, 2024-09-10T22:38:04.569 INFO:teuthology.orchestra.run.smithi135.stdout: "dn": 0, 2024-09-10T22:38:04.569 INFO:teuthology.orchestra.run.smithi135.stdout: "dn+": 0, 2024-09-10T22:38:04.569 INFO:teuthology.orchestra.run.smithi135.stdout: "dn-": 0, 2024-09-10T22:38:04.569 INFO:teuthology.orchestra.run.smithi135.stdout: "cap": 0, 2024-09-10T22:38:04.569 INFO:teuthology.orchestra.run.smithi135.stdout: "cap+": 0, 2024-09-10T22:38:04.569 INFO:teuthology.orchestra.run.smithi135.stdout: "cap-": 0, 2024-09-10T22:38:04.569 INFO:teuthology.orchestra.run.smithi135.stdout: "rss": 49096, 2024-09-10T22:38:04.570 INFO:teuthology.orchestra.run.smithi135.stdout: "heap": 248242176 2024-09-10T22:38:04.570 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-10T22:38:04.570 INFO:teuthology.orchestra.run.smithi135.stdout: "mds_server": { 2024-09-10T22:38:04.570 INFO:teuthology.orchestra.run.smithi135.stdout: "dispatch_client_request": 0, 2024-09-10T22:38:04.570 INFO:teuthology.orchestra.run.smithi135.stdout: "dispatch_server_request": 0, 2024-09-10T22:38:04.570 INFO:teuthology.orchestra.run.smithi135.stdout: "handle_client_request": 0, 2024-09-10T22:38:04.570 INFO:teuthology.orchestra.run.smithi135.stdout: "handle_client_session": 0, 2024-09-10T22:38:04.570 INFO:teuthology.orchestra.run.smithi135.stdout: "handle_peer_request": 0, 2024-09-10T22:38:04.570 INFO:teuthology.orchestra.run.smithi135.stdout: "req_create_latency": { 2024-09-10T22:38:04.570 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-09-10T22:38:04.570 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-09-10T22:38:04.570 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-09-10T22:38:04.570 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-10T22:38:04.570 INFO:teuthology.orchestra.run.smithi135.stdout: "req_getattr_latency": { 2024-09-10T22:38:04.570 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-09-10T22:38:04.571 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-09-10T22:38:04.571 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-09-10T22:38:04.571 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-10T22:38:04.571 INFO:teuthology.orchestra.run.smithi135.stdout: "req_getfilelock_latency": { 2024-09-10T22:38:04.571 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-09-10T22:38:04.571 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-09-10T22:38:04.571 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-09-10T22:38:04.571 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-10T22:38:04.571 INFO:teuthology.orchestra.run.smithi135.stdout: "req_link_latency": { 2024-09-10T22:38:04.571 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-09-10T22:38:04.571 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-09-10T22:38:04.571 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-09-10T22:38:04.571 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-10T22:38:04.571 INFO:teuthology.orchestra.run.smithi135.stdout: "req_lookup_latency": { 2024-09-10T22:38:04.572 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-09-10T22:38:04.572 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-09-10T22:38:04.572 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-09-10T22:38:04.572 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-10T22:38:04.572 INFO:teuthology.orchestra.run.smithi135.stdout: "req_lookuphash_latency": { 2024-09-10T22:38:04.572 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-09-10T22:38:04.572 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-09-10T22:38:04.572 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-09-10T22:38:04.572 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-10T22:38:04.572 INFO:teuthology.orchestra.run.smithi135.stdout: "req_lookupino_latency": { 2024-09-10T22:38:04.572 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-09-10T22:38:04.572 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-09-10T22:38:04.572 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-09-10T22:38:04.572 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-10T22:38:04.572 INFO:teuthology.orchestra.run.smithi135.stdout: "req_lookupname_latency": { 2024-09-10T22:38:04.573 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-09-10T22:38:04.573 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-09-10T22:38:04.573 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-09-10T22:38:04.573 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-10T22:38:04.573 INFO:teuthology.orchestra.run.smithi135.stdout: "req_lookupparent_latency": { 2024-09-10T22:38:04.573 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-09-10T22:38:04.573 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-09-10T22:38:04.573 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-09-10T22:38:04.573 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-10T22:38:04.573 INFO:teuthology.orchestra.run.smithi135.stdout: "req_lookupsnap_latency": { 2024-09-10T22:38:04.573 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-09-10T22:38:04.573 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-09-10T22:38:04.574 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-09-10T22:38:04.574 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-10T22:38:04.574 INFO:teuthology.orchestra.run.smithi135.stdout: "req_lssnap_latency": { 2024-09-10T22:38:04.574 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-09-10T22:38:04.574 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-09-10T22:38:04.574 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-09-10T22:38:04.574 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-10T22:38:04.574 INFO:teuthology.orchestra.run.smithi135.stdout: "req_mkdir_latency": { 2024-09-10T22:38:04.574 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-09-10T22:38:04.574 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-09-10T22:38:04.574 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-09-10T22:38:04.574 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-10T22:38:04.574 INFO:teuthology.orchestra.run.smithi135.stdout: "req_mknod_latency": { 2024-09-10T22:38:04.574 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-09-10T22:38:04.575 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-09-10T22:38:04.575 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-09-10T22:38:04.575 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-10T22:38:04.575 INFO:teuthology.orchestra.run.smithi135.stdout: "req_mksnap_latency": { 2024-09-10T22:38:04.575 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-09-10T22:38:04.575 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-09-10T22:38:04.575 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-09-10T22:38:04.575 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-10T22:38:04.575 INFO:teuthology.orchestra.run.smithi135.stdout: "req_open_latency": { 2024-09-10T22:38:04.575 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-09-10T22:38:04.575 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-09-10T22:38:04.575 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-09-10T22:38:04.575 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-10T22:38:04.576 INFO:teuthology.orchestra.run.smithi135.stdout: "req_readdir_latency": { 2024-09-10T22:38:04.576 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-09-10T22:38:04.576 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-09-10T22:38:04.576 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-09-10T22:38:04.576 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-10T22:38:04.576 INFO:teuthology.orchestra.run.smithi135.stdout: "req_rename_latency": { 2024-09-10T22:38:04.576 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-09-10T22:38:04.576 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-09-10T22:38:04.576 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-09-10T22:38:04.576 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-10T22:38:04.576 INFO:teuthology.orchestra.run.smithi135.stdout: "req_renamesnap_latency": { 2024-09-10T22:38:04.576 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-09-10T22:38:04.576 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-09-10T22:38:04.577 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-09-10T22:38:04.577 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-10T22:38:04.577 INFO:teuthology.orchestra.run.smithi135.stdout: "req_snapdiff_latency": { 2024-09-10T22:38:04.577 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-09-10T22:38:04.577 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-09-10T22:38:04.577 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-09-10T22:38:04.577 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-10T22:38:04.577 INFO:teuthology.orchestra.run.smithi135.stdout: "req_rmdir_latency": { 2024-09-10T22:38:04.577 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-09-10T22:38:04.577 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-09-10T22:38:04.577 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-09-10T22:38:04.577 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-10T22:38:04.578 INFO:teuthology.orchestra.run.smithi135.stdout: "req_rmsnap_latency": { 2024-09-10T22:38:04.578 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-09-10T22:38:04.578 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-09-10T22:38:04.578 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-09-10T22:38:04.578 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-10T22:38:04.578 INFO:teuthology.orchestra.run.smithi135.stdout: "req_rmxattr_latency": { 2024-09-10T22:38:04.578 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-09-10T22:38:04.578 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-09-10T22:38:04.578 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-09-10T22:38:04.578 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-10T22:38:04.578 INFO:teuthology.orchestra.run.smithi135.stdout: "req_setattr_latency": { 2024-09-10T22:38:04.578 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-09-10T22:38:04.578 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-09-10T22:38:04.578 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-09-10T22:38:04.579 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-10T22:38:04.579 INFO:teuthology.orchestra.run.smithi135.stdout: "req_setdirlayout_latency": { 2024-09-10T22:38:04.579 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-09-10T22:38:04.579 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-09-10T22:38:04.579 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-09-10T22:38:04.579 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-10T22:38:04.579 INFO:teuthology.orchestra.run.smithi135.stdout: "req_setfilelock_latency": { 2024-09-10T22:38:04.579 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-09-10T22:38:04.579 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-09-10T22:38:04.579 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-09-10T22:38:04.579 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-10T22:38:04.579 INFO:teuthology.orchestra.run.smithi135.stdout: "req_setlayout_latency": { 2024-09-10T22:38:04.579 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-09-10T22:38:04.579 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-09-10T22:38:04.579 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-09-10T22:38:04.580 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-10T22:38:04.580 INFO:teuthology.orchestra.run.smithi135.stdout: "req_setxattr_latency": { 2024-09-10T22:38:04.580 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-09-10T22:38:04.580 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-09-10T22:38:04.580 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-09-10T22:38:04.580 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-10T22:38:04.580 INFO:teuthology.orchestra.run.smithi135.stdout: "req_symlink_latency": { 2024-09-10T22:38:04.580 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-09-10T22:38:04.580 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-09-10T22:38:04.580 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-09-10T22:38:04.580 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-10T22:38:04.580 INFO:teuthology.orchestra.run.smithi135.stdout: "req_unlink_latency": { 2024-09-10T22:38:04.580 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-09-10T22:38:04.580 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-09-10T22:38:04.581 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-09-10T22:38:04.581 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-10T22:38:04.581 INFO:teuthology.orchestra.run.smithi135.stdout: "cap_revoke_eviction": 0, 2024-09-10T22:38:04.581 INFO:teuthology.orchestra.run.smithi135.stdout: "cap_acquisition_throttle": 0, 2024-09-10T22:38:04.581 INFO:teuthology.orchestra.run.smithi135.stdout: "req_getvxattr_latency": { 2024-09-10T22:38:04.581 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-09-10T22:38:04.581 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-09-10T22:38:04.581 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-09-10T22:38:04.581 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-10T22:38:04.581 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-10T22:38:04.581 INFO:teuthology.orchestra.run.smithi135.stdout: "mds_sessions": { 2024-09-10T22:38:04.581 INFO:teuthology.orchestra.run.smithi135.stdout: "session_count": 0, 2024-09-10T22:38:04.581 INFO:teuthology.orchestra.run.smithi135.stdout: "session_add": 1, 2024-09-10T22:38:04.582 INFO:teuthology.orchestra.run.smithi135.stdout: "session_remove": 1, 2024-09-10T22:38:04.582 INFO:teuthology.orchestra.run.smithi135.stdout: "sessions_open": 1, 2024-09-10T22:38:04.582 INFO:teuthology.orchestra.run.smithi135.stdout: "sessions_stale": 0, 2024-09-10T22:38:04.582 INFO:teuthology.orchestra.run.smithi135.stdout: "total_load": 0, 2024-09-10T22:38:04.582 INFO:teuthology.orchestra.run.smithi135.stdout: "average_load": 0, 2024-09-10T22:38:04.582 INFO:teuthology.orchestra.run.smithi135.stdout: "avg_session_uptime": 1340, 2024-09-10T22:38:04.582 INFO:teuthology.orchestra.run.smithi135.stdout: "mdthresh_evicted": 0 2024-09-10T22:38:04.582 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-10T22:38:04.582 INFO:teuthology.orchestra.run.smithi135.stdout: "mempool": { 2024-09-10T22:38:04.582 INFO:teuthology.orchestra.run.smithi135.stdout: "bloom_filter_bytes": 0, 2024-09-10T22:38:04.582 INFO:teuthology.orchestra.run.smithi135.stdout: "bloom_filter_items": 0, 2024-09-10T22:38:04.582 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_alloc_bytes": 0, 2024-09-10T22:38:04.582 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_alloc_items": 0, 2024-09-10T22:38:04.582 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_cache_data_bytes": 0, 2024-09-10T22:38:04.582 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_cache_data_items": 0, 2024-09-10T22:38:04.583 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-10T22:38:04.583 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_cache_onode_items": 0, 2024-09-10T22:38:04.583 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-10T22:38:04.583 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_cache_meta_items": 0, 2024-09-10T22:38:04.583 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_cache_other_bytes": 0, 2024-09-10T22:38:04.583 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_cache_other_items": 0, 2024-09-10T22:38:04.583 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-10T22:38:04.583 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_cache_buffer_items": 0, 2024-09-10T22:38:04.583 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_extent_bytes": 0, 2024-09-10T22:38:04.583 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_extent_items": 0, 2024-09-10T22:38:04.583 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_blob_bytes": 0, 2024-09-10T22:38:04.583 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_blob_items": 0, 2024-09-10T22:38:04.583 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-10T22:38:04.583 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_shared_blob_items": 0, 2024-09-10T22:38:04.584 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-10T22:38:04.584 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_inline_bl_items": 0, 2024-09-10T22:38:04.584 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_fsck_bytes": 0, 2024-09-10T22:38:04.584 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_fsck_items": 0, 2024-09-10T22:38:04.584 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_txc_bytes": 0, 2024-09-10T22:38:04.584 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_txc_items": 0, 2024-09-10T22:38:04.584 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-10T22:38:04.584 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_writing_deferred_items": 0, 2024-09-10T22:38:04.584 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_writing_bytes": 0, 2024-09-10T22:38:04.584 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_writing_items": 0, 2024-09-10T22:38:04.584 INFO:teuthology.orchestra.run.smithi135.stdout: "bluefs_bytes": 0, 2024-09-10T22:38:04.584 INFO:teuthology.orchestra.run.smithi135.stdout: "bluefs_items": 0, 2024-09-10T22:38:04.584 INFO:teuthology.orchestra.run.smithi135.stdout: "bluefs_file_reader_bytes": 0, 2024-09-10T22:38:04.585 INFO:teuthology.orchestra.run.smithi135.stdout: "bluefs_file_reader_items": 0, 2024-09-10T22:38:04.585 INFO:teuthology.orchestra.run.smithi135.stdout: "bluefs_file_writer_bytes": 0, 2024-09-10T22:38:04.585 INFO:teuthology.orchestra.run.smithi135.stdout: "bluefs_file_writer_items": 0, 2024-09-10T22:38:04.585 INFO:teuthology.orchestra.run.smithi135.stdout: "buffer_anon_bytes": 189423, 2024-09-10T22:38:04.585 INFO:teuthology.orchestra.run.smithi135.stdout: "buffer_anon_items": 51, 2024-09-10T22:38:04.585 INFO:teuthology.orchestra.run.smithi135.stdout: "buffer_meta_bytes": 0, 2024-09-10T22:38:04.585 INFO:teuthology.orchestra.run.smithi135.stdout: "buffer_meta_items": 0, 2024-09-10T22:38:04.585 INFO:teuthology.orchestra.run.smithi135.stdout: "osd_bytes": 0, 2024-09-10T22:38:04.585 INFO:teuthology.orchestra.run.smithi135.stdout: "osd_items": 0, 2024-09-10T22:38:04.585 INFO:teuthology.orchestra.run.smithi135.stdout: "osd_mapbl_bytes": 0, 2024-09-10T22:38:04.585 INFO:teuthology.orchestra.run.smithi135.stdout: "osd_mapbl_items": 0, 2024-09-10T22:38:04.585 INFO:teuthology.orchestra.run.smithi135.stdout: "osd_pglog_bytes": 0, 2024-09-10T22:38:04.585 INFO:teuthology.orchestra.run.smithi135.stdout: "osd_pglog_items": 0, 2024-09-10T22:38:04.586 INFO:teuthology.orchestra.run.smithi135.stdout: "osdmap_bytes": 7880, 2024-09-10T22:38:04.586 INFO:teuthology.orchestra.run.smithi135.stdout: "osdmap_items": 162, 2024-09-10T22:38:04.586 INFO:teuthology.orchestra.run.smithi135.stdout: "osdmap_mapping_bytes": 0, 2024-09-10T22:38:04.586 INFO:teuthology.orchestra.run.smithi135.stdout: "osdmap_mapping_items": 0, 2024-09-10T22:38:04.586 INFO:teuthology.orchestra.run.smithi135.stdout: "pgmap_bytes": 0, 2024-09-10T22:38:04.586 INFO:teuthology.orchestra.run.smithi135.stdout: "pgmap_items": 0, 2024-09-10T22:38:04.586 INFO:teuthology.orchestra.run.smithi135.stdout: "mds_co_bytes": 8672, 2024-09-10T22:38:04.586 INFO:teuthology.orchestra.run.smithi135.stdout: "mds_co_items": 13, 2024-09-10T22:38:04.586 INFO:teuthology.orchestra.run.smithi135.stdout: "unittest_1_bytes": 0, 2024-09-10T22:38:04.586 INFO:teuthology.orchestra.run.smithi135.stdout: "unittest_1_items": 0, 2024-09-10T22:38:04.586 INFO:teuthology.orchestra.run.smithi135.stdout: "unittest_2_bytes": 0, 2024-09-10T22:38:04.586 INFO:teuthology.orchestra.run.smithi135.stdout: "unittest_2_items": 0 2024-09-10T22:38:04.586 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-10T22:38:04.586 INFO:teuthology.orchestra.run.smithi135.stdout: "objecter": { 2024-09-10T22:38:04.587 INFO:teuthology.orchestra.run.smithi135.stdout: "op_active": 0, 2024-09-10T22:38:04.587 INFO:teuthology.orchestra.run.smithi135.stdout: "op_laggy": 0, 2024-09-10T22:38:04.587 INFO:teuthology.orchestra.run.smithi135.stdout: "op_send": 2348, 2024-09-10T22:38:04.587 INFO:teuthology.orchestra.run.smithi135.stdout: "op_send_bytes": 21, 2024-09-10T22:38:04.587 INFO:teuthology.orchestra.run.smithi135.stdout: "op_resend": 3, 2024-09-10T22:38:04.587 INFO:teuthology.orchestra.run.smithi135.stdout: "op_reply": 2348, 2024-09-10T22:38:04.587 INFO:teuthology.orchestra.run.smithi135.stdout: "op_latency": { 2024-09-10T22:38:04.587 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 2348, 2024-09-10T22:38:04.587 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 2.323954032, 2024-09-10T22:38:04.587 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000989758 2024-09-10T22:38:04.587 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-10T22:38:04.587 INFO:teuthology.orchestra.run.smithi135.stdout: "op_inflight": 0, 2024-09-10T22:38:04.587 INFO:teuthology.orchestra.run.smithi135.stdout: "oplen_avg": { 2024-09-10T22:38:04.587 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 2348, 2024-09-10T22:38:04.588 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 2349 2024-09-10T22:38:04.588 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-10T22:38:04.588 INFO:teuthology.orchestra.run.smithi135.stdout: "op": 2348, 2024-09-10T22:38:04.588 INFO:teuthology.orchestra.run.smithi135.stdout: "op_r": 2348, 2024-09-10T22:38:04.588 INFO:teuthology.orchestra.run.smithi135.stdout: "op_w": 0, 2024-09-10T22:38:04.588 INFO:teuthology.orchestra.run.smithi135.stdout: "op_rmw": 0, 2024-09-10T22:38:04.588 INFO:teuthology.orchestra.run.smithi135.stdout: "op_pg": 0, 2024-09-10T22:38:04.588 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_stat": 1529, 2024-09-10T22:38:04.588 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_create": 0, 2024-09-10T22:38:04.588 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_read": 817, 2024-09-10T22:38:04.588 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_write": 0, 2024-09-10T22:38:04.588 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_writefull": 0, 2024-09-10T22:38:04.588 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_writesame": 0, 2024-09-10T22:38:04.589 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_append": 0, 2024-09-10T22:38:04.589 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_zero": 0, 2024-09-10T22:38:04.589 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_truncate": 0, 2024-09-10T22:38:04.589 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_delete": 0, 2024-09-10T22:38:04.589 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_mapext": 0, 2024-09-10T22:38:04.589 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_sparse_read": 0, 2024-09-10T22:38:04.589 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_clonerange": 0, 2024-09-10T22:38:04.589 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_getxattr": 1, 2024-09-10T22:38:04.589 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_setxattr": 0, 2024-09-10T22:38:04.589 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_cmpxattr": 0, 2024-09-10T22:38:04.589 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_rmxattr": 0, 2024-09-10T22:38:04.589 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_resetxattrs": 0, 2024-09-10T22:38:04.589 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_call": 0, 2024-09-10T22:38:04.590 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_watch": 0, 2024-09-10T22:38:04.590 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_notify": 0, 2024-09-10T22:38:04.590 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_src_cmpxattr": 0, 2024-09-10T22:38:04.590 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_pgls": 0, 2024-09-10T22:38:04.590 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_pgls_filter": 0, 2024-09-10T22:38:04.590 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_other": 0, 2024-09-10T22:38:04.590 INFO:teuthology.orchestra.run.smithi135.stdout: "linger_active": 0, 2024-09-10T22:38:04.590 INFO:teuthology.orchestra.run.smithi135.stdout: "linger_send": 0, 2024-09-10T22:38:04.590 INFO:teuthology.orchestra.run.smithi135.stdout: "linger_resend": 0, 2024-09-10T22:38:04.590 INFO:teuthology.orchestra.run.smithi135.stdout: "linger_ping": 0, 2024-09-10T22:38:04.590 INFO:teuthology.orchestra.run.smithi135.stdout: "poolop_active": 0, 2024-09-10T22:38:04.590 INFO:teuthology.orchestra.run.smithi135.stdout: "poolop_send": 0, 2024-09-10T22:38:04.590 INFO:teuthology.orchestra.run.smithi135.stdout: "poolop_resend": 0, 2024-09-10T22:38:04.590 INFO:teuthology.orchestra.run.smithi135.stdout: "poolstat_active": 0, 2024-09-10T22:38:04.591 INFO:teuthology.orchestra.run.smithi135.stdout: "poolstat_send": 0, 2024-09-10T22:38:04.591 INFO:teuthology.orchestra.run.smithi135.stdout: "poolstat_resend": 0, 2024-09-10T22:38:04.591 INFO:teuthology.orchestra.run.smithi135.stdout: "statfs_active": 0, 2024-09-10T22:38:04.591 INFO:teuthology.orchestra.run.smithi135.stdout: "statfs_send": 0, 2024-09-10T22:38:04.591 INFO:teuthology.orchestra.run.smithi135.stdout: "statfs_resend": 0, 2024-09-10T22:38:04.591 INFO:teuthology.orchestra.run.smithi135.stdout: "command_active": 0, 2024-09-10T22:38:04.591 INFO:teuthology.orchestra.run.smithi135.stdout: "command_send": 0, 2024-09-10T22:38:04.591 INFO:teuthology.orchestra.run.smithi135.stdout: "command_resend": 0, 2024-09-10T22:38:04.591 INFO:teuthology.orchestra.run.smithi135.stdout: "map_epoch": 77, 2024-09-10T22:38:04.591 INFO:teuthology.orchestra.run.smithi135.stdout: "map_full": 0, 2024-09-10T22:38:04.591 INFO:teuthology.orchestra.run.smithi135.stdout: "map_inc": 4, 2024-09-10T22:38:04.591 INFO:teuthology.orchestra.run.smithi135.stdout: "osd_sessions": 5, 2024-09-10T22:38:04.591 INFO:teuthology.orchestra.run.smithi135.stdout: "osd_session_open": 5, 2024-09-10T22:38:04.591 INFO:teuthology.orchestra.run.smithi135.stdout: "osd_session_close": 0, 2024-09-10T22:38:04.592 INFO:teuthology.orchestra.run.smithi135.stdout: "osd_laggy": 0, 2024-09-10T22:38:04.592 INFO:teuthology.orchestra.run.smithi135.stdout: "omap_wr": 0, 2024-09-10T22:38:04.592 INFO:teuthology.orchestra.run.smithi135.stdout: "omap_rd": 2, 2024-09-10T22:38:04.592 INFO:teuthology.orchestra.run.smithi135.stdout: "omap_del": 0 2024-09-10T22:38:04.592 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-10T22:38:04.592 INFO:teuthology.orchestra.run.smithi135.stdout: "oft": { 2024-09-10T22:38:04.592 INFO:teuthology.orchestra.run.smithi135.stdout: "omap_total_objs": 0, 2024-09-10T22:38:04.592 INFO:teuthology.orchestra.run.smithi135.stdout: "omap_total_kv_pairs": 0, 2024-09-10T22:38:04.592 INFO:teuthology.orchestra.run.smithi135.stdout: "omap_total_updates": 0, 2024-09-10T22:38:04.592 INFO:teuthology.orchestra.run.smithi135.stdout: "omap_total_removes": 0 2024-09-10T22:38:04.592 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-10T22:38:04.592 INFO:teuthology.orchestra.run.smithi135.stdout: "purge_queue": { 2024-09-10T22:38:04.592 INFO:teuthology.orchestra.run.smithi135.stdout: "pq_executing_ops": 0, 2024-09-10T22:38:04.593 INFO:teuthology.orchestra.run.smithi135.stdout: "pq_executing_ops_high_water": 0, 2024-09-10T22:38:04.593 INFO:teuthology.orchestra.run.smithi135.stdout: "pq_executing": 0, 2024-09-10T22:38:04.593 INFO:teuthology.orchestra.run.smithi135.stdout: "pq_executing_high_water": 0, 2024-09-10T22:38:04.593 INFO:teuthology.orchestra.run.smithi135.stdout: "pq_executed_ops": 0, 2024-09-10T22:38:04.593 INFO:teuthology.orchestra.run.smithi135.stdout: "pq_executed": 0, 2024-09-10T22:38:04.593 INFO:teuthology.orchestra.run.smithi135.stdout: "pq_item_in_journal": 0 2024-09-10T22:38:04.593 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-10T22:38:04.593 INFO:teuthology.orchestra.run.smithi135.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-10T22:38:04.593 INFO:teuthology.orchestra.run.smithi135.stdout: "val": 0, 2024-09-10T22:38:04.593 INFO:teuthology.orchestra.run.smithi135.stdout: "max": 104857600, 2024-09-10T22:38:04.593 INFO:teuthology.orchestra.run.smithi135.stdout: "get_started": 0, 2024-09-10T22:38:04.593 INFO:teuthology.orchestra.run.smithi135.stdout: "get": 2594, 2024-09-10T22:38:04.593 INFO:teuthology.orchestra.run.smithi135.stdout: "get_sum": 984063, 2024-09-10T22:38:04.593 INFO:teuthology.orchestra.run.smithi135.stdout: "get_or_fail_fail": 0, 2024-09-10T22:38:04.594 INFO:teuthology.orchestra.run.smithi135.stdout: "get_or_fail_success": 2594, 2024-09-10T22:38:04.594 INFO:teuthology.orchestra.run.smithi135.stdout: "take": 0, 2024-09-10T22:38:04.594 INFO:teuthology.orchestra.run.smithi135.stdout: "take_sum": 0, 2024-09-10T22:38:04.594 INFO:teuthology.orchestra.run.smithi135.stdout: "put": 2594, 2024-09-10T22:38:04.594 INFO:teuthology.orchestra.run.smithi135.stdout: "put_sum": 984063, 2024-09-10T22:38:04.594 INFO:teuthology.orchestra.run.smithi135.stdout: "wait": { 2024-09-10T22:38:04.594 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-09-10T22:38:04.594 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-09-10T22:38:04.594 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-09-10T22:38:04.594 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-10T22:38:04.594 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-10T22:38:04.594 INFO:teuthology.orchestra.run.smithi135.stdout: "throttle-objecter_bytes": { 2024-09-10T22:38:04.594 INFO:teuthology.orchestra.run.smithi135.stdout: "val": 0, 2024-09-10T22:38:04.595 INFO:teuthology.orchestra.run.smithi135.stdout: "max": 104857600, 2024-09-10T22:38:04.595 INFO:teuthology.orchestra.run.smithi135.stdout: "get_started": 0, 2024-09-10T22:38:04.595 INFO:teuthology.orchestra.run.smithi135.stdout: "get": 0, 2024-09-10T22:38:04.595 INFO:teuthology.orchestra.run.smithi135.stdout: "get_sum": 0, 2024-09-10T22:38:04.595 INFO:teuthology.orchestra.run.smithi135.stdout: "get_or_fail_fail": 0, 2024-09-10T22:38:04.595 INFO:teuthology.orchestra.run.smithi135.stdout: "get_or_fail_success": 0, 2024-09-10T22:38:04.595 INFO:teuthology.orchestra.run.smithi135.stdout: "take": 2348, 2024-09-10T22:38:04.595 INFO:teuthology.orchestra.run.smithi135.stdout: "take_sum": 1125, 2024-09-10T22:38:04.595 INFO:teuthology.orchestra.run.smithi135.stdout: "put": 2348, 2024-09-10T22:38:04.595 INFO:teuthology.orchestra.run.smithi135.stdout: "put_sum": 1125, 2024-09-10T22:38:04.595 INFO:teuthology.orchestra.run.smithi135.stdout: "wait": { 2024-09-10T22:38:04.595 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-09-10T22:38:04.595 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-09-10T22:38:04.595 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-09-10T22:38:04.596 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-10T22:38:04.596 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-10T22:38:04.596 INFO:teuthology.orchestra.run.smithi135.stdout: "throttle-objecter_ops": { 2024-09-10T22:38:04.596 INFO:teuthology.orchestra.run.smithi135.stdout: "val": 0, 2024-09-10T22:38:04.596 INFO:teuthology.orchestra.run.smithi135.stdout: "max": 1024, 2024-09-10T22:38:04.596 INFO:teuthology.orchestra.run.smithi135.stdout: "get_started": 0, 2024-09-10T22:38:04.596 INFO:teuthology.orchestra.run.smithi135.stdout: "get": 0, 2024-09-10T22:38:04.596 INFO:teuthology.orchestra.run.smithi135.stdout: "get_sum": 0, 2024-09-10T22:38:04.596 INFO:teuthology.orchestra.run.smithi135.stdout: "get_or_fail_fail": 0, 2024-09-10T22:38:04.596 INFO:teuthology.orchestra.run.smithi135.stdout: "get_or_fail_success": 0, 2024-09-10T22:38:04.596 INFO:teuthology.orchestra.run.smithi135.stdout: "take": 2348, 2024-09-10T22:38:04.596 INFO:teuthology.orchestra.run.smithi135.stdout: "take_sum": 2348, 2024-09-10T22:38:04.596 INFO:teuthology.orchestra.run.smithi135.stdout: "put": 2348, 2024-09-10T22:38:04.597 INFO:teuthology.orchestra.run.smithi135.stdout: "put_sum": 2348, 2024-09-10T22:38:04.597 INFO:teuthology.orchestra.run.smithi135.stdout: "wait": { 2024-09-10T22:38:04.597 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-09-10T22:38:04.597 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-09-10T22:38:04.597 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-09-10T22:38:04.597 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-10T22:38:04.597 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-10T22:38:04.597 INFO:teuthology.orchestra.run.smithi135.stdout: "throttle-write_buf_throttle": { 2024-09-10T22:38:04.597 INFO:teuthology.orchestra.run.smithi135.stdout: "val": 0, 2024-09-10T22:38:04.597 INFO:teuthology.orchestra.run.smithi135.stdout: "max": 3758096384, 2024-09-10T22:38:04.597 INFO:teuthology.orchestra.run.smithi135.stdout: "get_started": 0, 2024-09-10T22:38:04.597 INFO:teuthology.orchestra.run.smithi135.stdout: "get": 0, 2024-09-10T22:38:04.597 INFO:teuthology.orchestra.run.smithi135.stdout: "get_sum": 0, 2024-09-10T22:38:04.598 INFO:teuthology.orchestra.run.smithi135.stdout: "get_or_fail_fail": 0, 2024-09-10T22:38:04.598 INFO:teuthology.orchestra.run.smithi135.stdout: "get_or_fail_success": 0, 2024-09-10T22:38:04.598 INFO:teuthology.orchestra.run.smithi135.stdout: "take": 0, 2024-09-10T22:38:04.598 INFO:teuthology.orchestra.run.smithi135.stdout: "take_sum": 0, 2024-09-10T22:38:04.598 INFO:teuthology.orchestra.run.smithi135.stdout: "put": 0, 2024-09-10T22:38:04.598 INFO:teuthology.orchestra.run.smithi135.stdout: "put_sum": 0, 2024-09-10T22:38:04.598 INFO:teuthology.orchestra.run.smithi135.stdout: "wait": { 2024-09-10T22:38:04.598 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-09-10T22:38:04.598 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-09-10T22:38:04.598 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-09-10T22:38:04.598 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-10T22:38:04.598 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-10T22:38:04.598 INFO:teuthology.orchestra.run.smithi135.stdout: "throttle-write_buf_throttle-0x5581e8779040": { 2024-09-10T22:38:04.599 INFO:teuthology.orchestra.run.smithi135.stdout: "val": 0, 2024-09-10T22:38:04.599 INFO:teuthology.orchestra.run.smithi135.stdout: "max": 3758096384, 2024-09-10T22:38:04.599 INFO:teuthology.orchestra.run.smithi135.stdout: "get_started": 0, 2024-09-10T22:38:04.599 INFO:teuthology.orchestra.run.smithi135.stdout: "get": 0, 2024-09-10T22:38:04.599 INFO:teuthology.orchestra.run.smithi135.stdout: "get_sum": 0, 2024-09-10T22:38:04.599 INFO:teuthology.orchestra.run.smithi135.stdout: "get_or_fail_fail": 0, 2024-09-10T22:38:04.599 INFO:teuthology.orchestra.run.smithi135.stdout: "get_or_fail_success": 0, 2024-09-10T22:38:04.599 INFO:teuthology.orchestra.run.smithi135.stdout: "take": 0, 2024-09-10T22:38:04.599 INFO:teuthology.orchestra.run.smithi135.stdout: "take_sum": 0, 2024-09-10T22:38:04.599 INFO:teuthology.orchestra.run.smithi135.stdout: "put": 0, 2024-09-10T22:38:04.599 INFO:teuthology.orchestra.run.smithi135.stdout: "put_sum": 0, 2024-09-10T22:38:04.599 INFO:teuthology.orchestra.run.smithi135.stdout: "wait": { 2024-09-10T22:38:04.599 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-09-10T22:38:04.599 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-09-10T22:38:04.600 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-09-10T22:38:04.600 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-10T22:38:04.600 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-10T22:38:04.600 INFO:teuthology.orchestra.run.smithi135.stdout: "trackedop": { 2024-09-10T22:38:04.600 INFO:teuthology.orchestra.run.smithi135.stdout: "slow_ops_count": 0 2024-09-10T22:38:04.600 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-10T22:38:04.600 INFO:teuthology.orchestra.run.smithi135.stdout:} 2024-09-10T22:38:05.320 INFO:tasks.check_counter:Daemon mds.e mds.exported=0 2024-09-10T22:38:05.320 INFO:tasks.check_counter:Daemon mds.e mds.imported=0 2024-09-10T22:38:05.320 INFO:tasks.check_counter:Daemon mds.e mds_cache.dir_update=0 2024-09-10T22:38:05.320 INFO:tasks.check_counter:Daemon mds.e mds_cache.dir_update_receipt=0 2024-09-10T22:38:05.320 DEBUG:tasks.check_counter:Getting stats from h 2024-09-10T22:38:05.321 DEBUG:teuthology.orchestra.run.smithi135:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 22997a4c-6fc2-11ef-bcea-c7b262605968 -- ceph daemon mds.h perf dump 2024-09-10T22:38:05.569 INFO:teuthology.orchestra.run.smithi135.stderr:Inferring config /var/lib/ceph/22997a4c-6fc2-11ef-bcea-c7b262605968/mon.b/config 2024-09-10T22:38:06.083 INFO:teuthology.orchestra.run.smithi135.stdout:{ 2024-09-10T22:38:06.083 INFO:teuthology.orchestra.run.smithi135.stdout: "AsyncMessenger::Worker-0": { 2024-09-10T22:38:06.083 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_recv_messages": 1780, 2024-09-10T22:38:06.083 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_send_messages": 1772, 2024-09-10T22:38:06.083 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_recv_bytes": 147865373, 2024-09-10T22:38:06.083 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_send_bytes": 629414, 2024-09-10T22:38:06.083 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_created_connections": 7, 2024-09-10T22:38:06.083 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_active_connections": 3, 2024-09-10T22:38:06.084 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_running_total_time": 0.310430402, 2024-09-10T22:38:06.084 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_running_send_time": 0.098435765, 2024-09-10T22:38:06.084 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_running_recv_time": 0.157381573, 2024-09-10T22:38:06.084 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_running_fast_dispatch_time": 0.045964644, 2024-09-10T22:38:06.084 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_send_messages_queue_lat": { 2024-09-10T22:38:06.084 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 1771, 2024-09-10T22:38:06.084 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.068923552, 2024-09-10T22:38:06.084 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000038917 2024-09-10T22:38:06.084 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-10T22:38:06.084 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_handle_ack_lat": { 2024-09-10T22:38:06.084 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-09-10T22:38:06.084 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-09-10T22:38:06.084 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-09-10T22:38:06.085 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-10T22:38:06.085 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_recv_encrypted_bytes": 564464, 2024-09-10T22:38:06.085 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_send_encrypted_bytes": 141280 2024-09-10T22:38:06.085 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-10T22:38:06.085 INFO:teuthology.orchestra.run.smithi135.stdout: "AsyncMessenger::Worker-1": { 2024-09-10T22:38:06.085 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_recv_messages": 651, 2024-09-10T22:38:06.085 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_send_messages": 822, 2024-09-10T22:38:06.085 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_recv_bytes": 136120986, 2024-09-10T22:38:06.085 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_send_bytes": 593902, 2024-09-10T22:38:06.085 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_created_connections": 7, 2024-09-10T22:38:06.085 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_active_connections": 6, 2024-09-10T22:38:06.085 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_running_total_time": 0.176127222, 2024-09-10T22:38:06.085 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_running_send_time": 0.034526448, 2024-09-10T22:38:06.085 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_running_recv_time": 0.116419888, 2024-09-10T22:38:06.086 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_running_fast_dispatch_time": 0.018567962, 2024-09-10T22:38:06.086 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_send_messages_queue_lat": { 2024-09-10T22:38:06.086 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 820, 2024-09-10T22:38:06.086 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.035280828, 2024-09-10T22:38:06.086 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000043025 2024-09-10T22:38:06.086 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-10T22:38:06.086 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_handle_ack_lat": { 2024-09-10T22:38:06.086 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-09-10T22:38:06.086 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-09-10T22:38:06.086 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-09-10T22:38:06.086 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-10T22:38:06.086 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_recv_encrypted_bytes": 160, 2024-09-10T22:38:06.086 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_send_encrypted_bytes": 387136 2024-09-10T22:38:06.087 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-10T22:38:06.087 INFO:teuthology.orchestra.run.smithi135.stdout: "AsyncMessenger::Worker-2": { 2024-09-10T22:38:06.087 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_recv_messages": 757, 2024-09-10T22:38:06.087 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_send_messages": 757, 2024-09-10T22:38:06.087 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_recv_bytes": 147047803, 2024-09-10T22:38:06.087 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_send_bytes": 239909, 2024-09-10T22:38:06.087 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_created_connections": 6, 2024-09-10T22:38:06.087 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_active_connections": 5, 2024-09-10T22:38:06.087 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_running_total_time": 0.192537620, 2024-09-10T22:38:06.087 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_running_send_time": 0.027252733, 2024-09-10T22:38:06.087 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_running_recv_time": 0.136362017, 2024-09-10T22:38:06.087 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_running_fast_dispatch_time": 0.022793645, 2024-09-10T22:38:06.087 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_send_messages_queue_lat": { 2024-09-10T22:38:06.087 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 756, 2024-09-10T22:38:06.088 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.028317890, 2024-09-10T22:38:06.088 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000037457 2024-09-10T22:38:06.088 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-10T22:38:06.088 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_handle_ack_lat": { 2024-09-10T22:38:06.088 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-09-10T22:38:06.088 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-09-10T22:38:06.088 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-09-10T22:38:06.088 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-10T22:38:06.088 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_recv_encrypted_bytes": 2992, 2024-09-10T22:38:06.088 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_send_encrypted_bytes": 448 2024-09-10T22:38:06.088 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-10T22:38:06.088 INFO:teuthology.orchestra.run.smithi135.stdout: "cct": { 2024-09-10T22:38:06.088 INFO:teuthology.orchestra.run.smithi135.stdout: "total_workers": 1, 2024-09-10T22:38:06.088 INFO:teuthology.orchestra.run.smithi135.stdout: "unhealthy_workers": 0 2024-09-10T22:38:06.089 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-10T22:38:06.089 INFO:teuthology.orchestra.run.smithi135.stdout: "finisher-MDSRank": { 2024-09-10T22:38:06.089 INFO:teuthology.orchestra.run.smithi135.stdout: "queue_len": 0, 2024-09-10T22:38:06.089 INFO:teuthology.orchestra.run.smithi135.stdout: "complete_latency": { 2024-09-10T22:38:06.089 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 4696, 2024-09-10T22:38:06.089 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.129719666, 2024-09-10T22:38:06.089 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000027623 2024-09-10T22:38:06.089 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-10T22:38:06.089 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-10T22:38:06.089 INFO:teuthology.orchestra.run.smithi135.stdout: "finisher-PurgeQueue": { 2024-09-10T22:38:06.089 INFO:teuthology.orchestra.run.smithi135.stdout: "queue_len": 0, 2024-09-10T22:38:06.089 INFO:teuthology.orchestra.run.smithi135.stdout: "complete_latency": { 2024-09-10T22:38:06.089 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-09-10T22:38:06.089 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-09-10T22:38:06.090 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-09-10T22:38:06.090 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-10T22:38:06.090 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-10T22:38:06.090 INFO:teuthology.orchestra.run.smithi135.stdout: "mds": { 2024-09-10T22:38:06.090 INFO:teuthology.orchestra.run.smithi135.stdout: "request": 0, 2024-09-10T22:38:06.090 INFO:teuthology.orchestra.run.smithi135.stdout: "reply": 0, 2024-09-10T22:38:06.090 INFO:teuthology.orchestra.run.smithi135.stdout: "reply_latency": { 2024-09-10T22:38:06.090 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-09-10T22:38:06.090 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-09-10T22:38:06.090 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-09-10T22:38:06.090 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-10T22:38:06.090 INFO:teuthology.orchestra.run.smithi135.stdout: "slow_reply": 0, 2024-09-10T22:38:06.091 INFO:teuthology.orchestra.run.smithi135.stdout: "forward": 0, 2024-09-10T22:38:06.091 INFO:teuthology.orchestra.run.smithi135.stdout: "dir_fetch_complete": 0, 2024-09-10T22:38:06.091 INFO:teuthology.orchestra.run.smithi135.stdout: "dir_fetch_keys": 0, 2024-09-10T22:38:06.091 INFO:teuthology.orchestra.run.smithi135.stdout: "dir_commit": 0, 2024-09-10T22:38:06.091 INFO:teuthology.orchestra.run.smithi135.stdout: "dir_split": 0, 2024-09-10T22:38:06.091 INFO:teuthology.orchestra.run.smithi135.stdout: "dir_merge": 0, 2024-09-10T22:38:06.091 INFO:teuthology.orchestra.run.smithi135.stdout: "inodes": 36, 2024-09-10T22:38:06.091 INFO:teuthology.orchestra.run.smithi135.stdout: "inodes_top": 4, 2024-09-10T22:38:06.091 INFO:teuthology.orchestra.run.smithi135.stdout: "inodes_bottom": 32, 2024-09-10T22:38:06.091 INFO:teuthology.orchestra.run.smithi135.stdout: "inodes_pin_tail": 0, 2024-09-10T22:38:06.091 INFO:teuthology.orchestra.run.smithi135.stdout: "inodes_pinned": 29, 2024-09-10T22:38:06.091 INFO:teuthology.orchestra.run.smithi135.stdout: "inodes_expired": 0, 2024-09-10T22:38:06.091 INFO:teuthology.orchestra.run.smithi135.stdout: "inodes_with_caps": 0, 2024-09-10T22:38:06.091 INFO:teuthology.orchestra.run.smithi135.stdout: "caps": 0, 2024-09-10T22:38:06.092 INFO:teuthology.orchestra.run.smithi135.stdout: "subtrees": 2, 2024-09-10T22:38:06.092 INFO:teuthology.orchestra.run.smithi135.stdout: "traverse": 0, 2024-09-10T22:38:06.092 INFO:teuthology.orchestra.run.smithi135.stdout: "traverse_hit": 0, 2024-09-10T22:38:06.092 INFO:teuthology.orchestra.run.smithi135.stdout: "traverse_forward": 0, 2024-09-10T22:38:06.092 INFO:teuthology.orchestra.run.smithi135.stdout: "traverse_discover": 0, 2024-09-10T22:38:06.092 INFO:teuthology.orchestra.run.smithi135.stdout: "traverse_dir_fetch": 0, 2024-09-10T22:38:06.092 INFO:teuthology.orchestra.run.smithi135.stdout: "traverse_remote_ino": 0, 2024-09-10T22:38:06.092 INFO:teuthology.orchestra.run.smithi135.stdout: "traverse_lock": 0, 2024-09-10T22:38:06.092 INFO:teuthology.orchestra.run.smithi135.stdout: "load_cent": 0, 2024-09-10T22:38:06.092 INFO:teuthology.orchestra.run.smithi135.stdout: "q": 0, 2024-09-10T22:38:06.092 INFO:teuthology.orchestra.run.smithi135.stdout: "exported": 0, 2024-09-10T22:38:06.092 INFO:teuthology.orchestra.run.smithi135.stdout: "exported_inodes": 0, 2024-09-10T22:38:06.092 INFO:teuthology.orchestra.run.smithi135.stdout: "imported": 0, 2024-09-10T22:38:06.093 INFO:teuthology.orchestra.run.smithi135.stdout: "imported_inodes": 0, 2024-09-10T22:38:06.093 INFO:teuthology.orchestra.run.smithi135.stdout: "openino_dir_fetch": 0, 2024-09-10T22:38:06.093 INFO:teuthology.orchestra.run.smithi135.stdout: "openino_backtrace_fetch": 0, 2024-09-10T22:38:06.093 INFO:teuthology.orchestra.run.smithi135.stdout: "openino_peer_discover": 0, 2024-09-10T22:38:06.093 INFO:teuthology.orchestra.run.smithi135.stdout: "root_rfiles": 4, 2024-09-10T22:38:06.093 INFO:teuthology.orchestra.run.smithi135.stdout: "root_rbytes": 234, 2024-09-10T22:38:06.093 INFO:teuthology.orchestra.run.smithi135.stdout: "root_rsnaps": 0, 2024-09-10T22:38:06.093 INFO:teuthology.orchestra.run.smithi135.stdout: "scrub_backtrace_fetch": 0, 2024-09-10T22:38:06.093 INFO:teuthology.orchestra.run.smithi135.stdout: "scrub_set_tag": 0, 2024-09-10T22:38:06.093 INFO:teuthology.orchestra.run.smithi135.stdout: "scrub_backtrace_repaired": 0, 2024-09-10T22:38:06.093 INFO:teuthology.orchestra.run.smithi135.stdout: "scrub_inotable_repaired": 0, 2024-09-10T22:38:06.093 INFO:teuthology.orchestra.run.smithi135.stdout: "scrub_dir_inodes": 0, 2024-09-10T22:38:06.093 INFO:teuthology.orchestra.run.smithi135.stdout: "scrub_dir_base_inodes": 0, 2024-09-10T22:38:06.094 INFO:teuthology.orchestra.run.smithi135.stdout: "scrub_dirfrag_rstats": 0, 2024-09-10T22:38:06.094 INFO:teuthology.orchestra.run.smithi135.stdout: "scrub_file_inodes": 0, 2024-09-10T22:38:06.094 INFO:teuthology.orchestra.run.smithi135.stdout: "handle_inode_file_caps": 0, 2024-09-10T22:38:06.094 INFO:teuthology.orchestra.run.smithi135.stdout: "ceph_cap_op_revoke": 0, 2024-09-10T22:38:06.094 INFO:teuthology.orchestra.run.smithi135.stdout: "ceph_cap_op_grant": 0, 2024-09-10T22:38:06.094 INFO:teuthology.orchestra.run.smithi135.stdout: "ceph_cap_op_trunc": 0, 2024-09-10T22:38:06.094 INFO:teuthology.orchestra.run.smithi135.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-10T22:38:06.094 INFO:teuthology.orchestra.run.smithi135.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-10T22:38:06.094 INFO:teuthology.orchestra.run.smithi135.stdout: "handle_client_caps": 0, 2024-09-10T22:38:06.094 INFO:teuthology.orchestra.run.smithi135.stdout: "handle_client_caps_dirty": 0, 2024-09-10T22:38:06.094 INFO:teuthology.orchestra.run.smithi135.stdout: "handle_client_cap_release": 0, 2024-09-10T22:38:06.094 INFO:teuthology.orchestra.run.smithi135.stdout: "process_request_cap_release": 0 2024-09-10T22:38:06.094 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-10T22:38:06.094 INFO:teuthology.orchestra.run.smithi135.stdout: "mds_cache": { 2024-09-10T22:38:06.095 INFO:teuthology.orchestra.run.smithi135.stdout: "dir_update": 0, 2024-09-10T22:38:06.095 INFO:teuthology.orchestra.run.smithi135.stdout: "dir_update_receipt": 0, 2024-09-10T22:38:06.095 INFO:teuthology.orchestra.run.smithi135.stdout: "dir_try_discover": 0, 2024-09-10T22:38:06.095 INFO:teuthology.orchestra.run.smithi135.stdout: "dir_send_discover": 0, 2024-09-10T22:38:06.095 INFO:teuthology.orchestra.run.smithi135.stdout: "dir_handle_discover": 0, 2024-09-10T22:38:06.095 INFO:teuthology.orchestra.run.smithi135.stdout: "num_strays": 0, 2024-09-10T22:38:06.095 INFO:teuthology.orchestra.run.smithi135.stdout: "num_strays_delayed": 0, 2024-09-10T22:38:06.095 INFO:teuthology.orchestra.run.smithi135.stdout: "num_strays_enqueuing": 0, 2024-09-10T22:38:06.095 INFO:teuthology.orchestra.run.smithi135.stdout: "strays_created": 0, 2024-09-10T22:38:06.095 INFO:teuthology.orchestra.run.smithi135.stdout: "strays_enqueued": 0, 2024-09-10T22:38:06.095 INFO:teuthology.orchestra.run.smithi135.stdout: "strays_reintegrated": 0, 2024-09-10T22:38:06.095 INFO:teuthology.orchestra.run.smithi135.stdout: "strays_migrated": 0, 2024-09-10T22:38:06.095 INFO:teuthology.orchestra.run.smithi135.stdout: "num_recovering_processing": 0, 2024-09-10T22:38:06.095 INFO:teuthology.orchestra.run.smithi135.stdout: "num_recovering_enqueued": 0, 2024-09-10T22:38:06.095 INFO:teuthology.orchestra.run.smithi135.stdout: "num_recovering_prioritized": 0, 2024-09-10T22:38:06.096 INFO:teuthology.orchestra.run.smithi135.stdout: "recovery_started": 0, 2024-09-10T22:38:06.096 INFO:teuthology.orchestra.run.smithi135.stdout: "recovery_completed": 0, 2024-09-10T22:38:06.096 INFO:teuthology.orchestra.run.smithi135.stdout: "ireq_quiesce_path": 0, 2024-09-10T22:38:06.096 INFO:teuthology.orchestra.run.smithi135.stdout: "ireq_quiesce_inode": 0, 2024-09-10T22:38:06.096 INFO:teuthology.orchestra.run.smithi135.stdout: "ireq_enqueue_scrub": 0, 2024-09-10T22:38:06.096 INFO:teuthology.orchestra.run.smithi135.stdout: "ireq_exportdir": 0, 2024-09-10T22:38:06.096 INFO:teuthology.orchestra.run.smithi135.stdout: "ireq_flush": 0, 2024-09-10T22:38:06.096 INFO:teuthology.orchestra.run.smithi135.stdout: "ireq_fragmentdir": 0, 2024-09-10T22:38:06.096 INFO:teuthology.orchestra.run.smithi135.stdout: "ireq_fragstats": 0, 2024-09-10T22:38:06.096 INFO:teuthology.orchestra.run.smithi135.stdout: "ireq_inodestats": 0, 2024-09-10T22:38:06.096 INFO:teuthology.orchestra.run.smithi135.stdout: "uninline_started": 0, 2024-09-10T22:38:06.096 INFO:teuthology.orchestra.run.smithi135.stdout: "uninline_succeeded": 0, 2024-09-10T22:38:06.096 INFO:teuthology.orchestra.run.smithi135.stdout: "uninline_write_failed": 0 2024-09-10T22:38:06.097 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-10T22:38:06.097 INFO:teuthology.orchestra.run.smithi135.stdout: "mds_log": { 2024-09-10T22:38:06.097 INFO:teuthology.orchestra.run.smithi135.stdout: "evlrg": 0, 2024-09-10T22:38:06.097 INFO:teuthology.orchestra.run.smithi135.stdout: "evadd": 0, 2024-09-10T22:38:06.097 INFO:teuthology.orchestra.run.smithi135.stdout: "evex": 0, 2024-09-10T22:38:06.097 INFO:teuthology.orchestra.run.smithi135.stdout: "evtrm": 0, 2024-09-10T22:38:06.097 INFO:teuthology.orchestra.run.smithi135.stdout: "ev": 206894, 2024-09-10T22:38:06.097 INFO:teuthology.orchestra.run.smithi135.stdout: "evexg": 0, 2024-09-10T22:38:06.097 INFO:teuthology.orchestra.run.smithi135.stdout: "evexd": 0, 2024-09-10T22:38:06.097 INFO:teuthology.orchestra.run.smithi135.stdout: "segadd": 0, 2024-09-10T22:38:06.097 INFO:teuthology.orchestra.run.smithi135.stdout: "segex": 0, 2024-09-10T22:38:06.097 INFO:teuthology.orchestra.run.smithi135.stdout: "segtrm": 0, 2024-09-10T22:38:06.097 INFO:teuthology.orchestra.run.smithi135.stdout: "seg": 3, 2024-09-10T22:38:06.097 INFO:teuthology.orchestra.run.smithi135.stdout: "segmjr": 39, 2024-09-10T22:38:06.097 INFO:teuthology.orchestra.run.smithi135.stdout: "segexg": 0, 2024-09-10T22:38:06.098 INFO:teuthology.orchestra.run.smithi135.stdout: "segexd": 0, 2024-09-10T22:38:06.098 INFO:teuthology.orchestra.run.smithi135.stdout: "expos": 429272612, 2024-09-10T22:38:06.098 INFO:teuthology.orchestra.run.smithi135.stdout: "wrpos": 433684520, 2024-09-10T22:38:06.098 INFO:teuthology.orchestra.run.smithi135.stdout: "rdpos": 433683382, 2024-09-10T22:38:06.098 INFO:teuthology.orchestra.run.smithi135.stdout: "jlat": { 2024-09-10T22:38:06.098 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-09-10T22:38:06.098 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-09-10T22:38:06.098 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-09-10T22:38:06.098 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-10T22:38:06.098 INFO:teuthology.orchestra.run.smithi135.stdout: "replayed": 206894 2024-09-10T22:38:06.098 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-10T22:38:06.098 INFO:teuthology.orchestra.run.smithi135.stdout: "mds_mem": { 2024-09-10T22:38:06.098 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 20, 2024-09-10T22:38:06.098 INFO:teuthology.orchestra.run.smithi135.stdout: "ino+": 36, 2024-09-10T22:38:06.098 INFO:teuthology.orchestra.run.smithi135.stdout: "ino-": 16, 2024-09-10T22:38:06.099 INFO:teuthology.orchestra.run.smithi135.stdout: "dir": 10, 2024-09-10T22:38:06.099 INFO:teuthology.orchestra.run.smithi135.stdout: "dir+": 13, 2024-09-10T22:38:06.099 INFO:teuthology.orchestra.run.smithi135.stdout: "dir-": 3, 2024-09-10T22:38:06.099 INFO:teuthology.orchestra.run.smithi135.stdout: "dn": 36, 2024-09-10T22:38:06.099 INFO:teuthology.orchestra.run.smithi135.stdout: "dn+": 55, 2024-09-10T22:38:06.099 INFO:teuthology.orchestra.run.smithi135.stdout: "dn-": 19, 2024-09-10T22:38:06.099 INFO:teuthology.orchestra.run.smithi135.stdout: "cap": 0, 2024-09-10T22:38:06.099 INFO:teuthology.orchestra.run.smithi135.stdout: "cap+": 0, 2024-09-10T22:38:06.099 INFO:teuthology.orchestra.run.smithi135.stdout: "cap-": 0, 2024-09-10T22:38:06.099 INFO:teuthology.orchestra.run.smithi135.stdout: "rss": 52296, 2024-09-10T22:38:06.099 INFO:teuthology.orchestra.run.smithi135.stdout: "heap": 266231808 2024-09-10T22:38:06.099 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-10T22:38:06.099 INFO:teuthology.orchestra.run.smithi135.stdout: "mds_server": { 2024-09-10T22:38:06.099 INFO:teuthology.orchestra.run.smithi135.stdout: "dispatch_client_request": 0, 2024-09-10T22:38:06.100 INFO:teuthology.orchestra.run.smithi135.stdout: "dispatch_server_request": 0, 2024-09-10T22:38:06.100 INFO:teuthology.orchestra.run.smithi135.stdout: "handle_client_request": 0, 2024-09-10T22:38:06.100 INFO:teuthology.orchestra.run.smithi135.stdout: "handle_client_session": 0, 2024-09-10T22:38:06.100 INFO:teuthology.orchestra.run.smithi135.stdout: "handle_peer_request": 0, 2024-09-10T22:38:06.100 INFO:teuthology.orchestra.run.smithi135.stdout: "req_create_latency": { 2024-09-10T22:38:06.100 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-09-10T22:38:06.100 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-09-10T22:38:06.100 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-09-10T22:38:06.100 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-10T22:38:06.100 INFO:teuthology.orchestra.run.smithi135.stdout: "req_getattr_latency": { 2024-09-10T22:38:06.100 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-09-10T22:38:06.100 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-09-10T22:38:06.100 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-09-10T22:38:06.101 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-10T22:38:06.101 INFO:teuthology.orchestra.run.smithi135.stdout: "req_getfilelock_latency": { 2024-09-10T22:38:06.101 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-09-10T22:38:06.101 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-09-10T22:38:06.101 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-09-10T22:38:06.101 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-10T22:38:06.101 INFO:teuthology.orchestra.run.smithi135.stdout: "req_link_latency": { 2024-09-10T22:38:06.101 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-09-10T22:38:06.101 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-09-10T22:38:06.101 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-09-10T22:38:06.101 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-10T22:38:06.101 INFO:teuthology.orchestra.run.smithi135.stdout: "req_lookup_latency": { 2024-09-10T22:38:06.101 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-09-10T22:38:06.101 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-09-10T22:38:06.102 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-09-10T22:38:06.102 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-10T22:38:06.102 INFO:teuthology.orchestra.run.smithi135.stdout: "req_lookuphash_latency": { 2024-09-10T22:38:06.102 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-09-10T22:38:06.102 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-09-10T22:38:06.102 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-09-10T22:38:06.102 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-10T22:38:06.102 INFO:teuthology.orchestra.run.smithi135.stdout: "req_lookupino_latency": { 2024-09-10T22:38:06.102 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-09-10T22:38:06.102 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-09-10T22:38:06.102 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-09-10T22:38:06.102 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-10T22:38:06.102 INFO:teuthology.orchestra.run.smithi135.stdout: "req_lookupname_latency": { 2024-09-10T22:38:06.102 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-09-10T22:38:06.103 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-09-10T22:38:06.103 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-09-10T22:38:06.103 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-10T22:38:06.103 INFO:teuthology.orchestra.run.smithi135.stdout: "req_lookupparent_latency": { 2024-09-10T22:38:06.103 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-09-10T22:38:06.103 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-09-10T22:38:06.103 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-09-10T22:38:06.103 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-10T22:38:06.103 INFO:teuthology.orchestra.run.smithi135.stdout: "req_lookupsnap_latency": { 2024-09-10T22:38:06.103 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-09-10T22:38:06.103 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-09-10T22:38:06.103 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-09-10T22:38:06.103 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-10T22:38:06.103 INFO:teuthology.orchestra.run.smithi135.stdout: "req_lssnap_latency": { 2024-09-10T22:38:06.103 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-09-10T22:38:06.104 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-09-10T22:38:06.104 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-09-10T22:38:06.104 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-10T22:38:06.104 INFO:teuthology.orchestra.run.smithi135.stdout: "req_mkdir_latency": { 2024-09-10T22:38:06.104 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-09-10T22:38:06.104 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-09-10T22:38:06.105 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-09-10T22:38:06.105 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-10T22:38:06.105 INFO:teuthology.orchestra.run.smithi135.stdout: "req_mknod_latency": { 2024-09-10T22:38:06.105 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-09-10T22:38:06.105 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-09-10T22:38:06.105 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-09-10T22:38:06.105 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-10T22:38:06.105 INFO:teuthology.orchestra.run.smithi135.stdout: "req_mksnap_latency": { 2024-09-10T22:38:06.105 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-09-10T22:38:06.105 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-09-10T22:38:06.105 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-09-10T22:38:06.105 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-10T22:38:06.105 INFO:teuthology.orchestra.run.smithi135.stdout: "req_open_latency": { 2024-09-10T22:38:06.105 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-09-10T22:38:06.106 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-09-10T22:38:06.106 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-09-10T22:38:06.106 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-10T22:38:06.106 INFO:teuthology.orchestra.run.smithi135.stdout: "req_readdir_latency": { 2024-09-10T22:38:06.106 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-09-10T22:38:06.106 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-09-10T22:38:06.106 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-09-10T22:38:06.106 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-10T22:38:06.106 INFO:teuthology.orchestra.run.smithi135.stdout: "req_rename_latency": { 2024-09-10T22:38:06.106 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-09-10T22:38:06.106 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-09-10T22:38:06.106 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-09-10T22:38:06.106 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-10T22:38:06.106 INFO:teuthology.orchestra.run.smithi135.stdout: "req_renamesnap_latency": { 2024-09-10T22:38:06.106 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-09-10T22:38:06.107 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-09-10T22:38:06.107 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-09-10T22:38:06.107 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-10T22:38:06.107 INFO:teuthology.orchestra.run.smithi135.stdout: "req_snapdiff_latency": { 2024-09-10T22:38:06.107 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-09-10T22:38:06.107 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-09-10T22:38:06.107 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-09-10T22:38:06.107 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-10T22:38:06.107 INFO:teuthology.orchestra.run.smithi135.stdout: "req_rmdir_latency": { 2024-09-10T22:38:06.107 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-09-10T22:38:06.107 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-09-10T22:38:06.107 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-09-10T22:38:06.107 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-10T22:38:06.107 INFO:teuthology.orchestra.run.smithi135.stdout: "req_rmsnap_latency": { 2024-09-10T22:38:06.107 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-09-10T22:38:06.108 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-09-10T22:38:06.108 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-09-10T22:38:06.108 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-10T22:38:06.108 INFO:teuthology.orchestra.run.smithi135.stdout: "req_rmxattr_latency": { 2024-09-10T22:38:06.108 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-09-10T22:38:06.108 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-09-10T22:38:06.108 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-09-10T22:38:06.108 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-10T22:38:06.108 INFO:teuthology.orchestra.run.smithi135.stdout: "req_setattr_latency": { 2024-09-10T22:38:06.108 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-09-10T22:38:06.108 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-09-10T22:38:06.108 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-09-10T22:38:06.108 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-10T22:38:06.109 INFO:teuthology.orchestra.run.smithi135.stdout: "req_setdirlayout_latency": { 2024-09-10T22:38:06.109 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-09-10T22:38:06.109 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-09-10T22:38:06.109 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-09-10T22:38:06.109 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-10T22:38:06.109 INFO:teuthology.orchestra.run.smithi135.stdout: "req_setfilelock_latency": { 2024-09-10T22:38:06.109 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-09-10T22:38:06.109 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-09-10T22:38:06.109 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-09-10T22:38:06.109 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-10T22:38:06.109 INFO:teuthology.orchestra.run.smithi135.stdout: "req_setlayout_latency": { 2024-09-10T22:38:06.109 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-09-10T22:38:06.109 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-09-10T22:38:06.110 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-09-10T22:38:06.110 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-10T22:38:06.110 INFO:teuthology.orchestra.run.smithi135.stdout: "req_setxattr_latency": { 2024-09-10T22:38:06.110 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-09-10T22:38:06.110 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-09-10T22:38:06.110 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-09-10T22:38:06.110 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-10T22:38:06.110 INFO:teuthology.orchestra.run.smithi135.stdout: "req_symlink_latency": { 2024-09-10T22:38:06.110 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-09-10T22:38:06.110 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-09-10T22:38:06.110 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-09-10T22:38:06.110 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-10T22:38:06.110 INFO:teuthology.orchestra.run.smithi135.stdout: "req_unlink_latency": { 2024-09-10T22:38:06.110 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-09-10T22:38:06.111 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-09-10T22:38:06.111 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-09-10T22:38:06.111 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-10T22:38:06.111 INFO:teuthology.orchestra.run.smithi135.stdout: "cap_revoke_eviction": 0, 2024-09-10T22:38:06.111 INFO:teuthology.orchestra.run.smithi135.stdout: "cap_acquisition_throttle": 0, 2024-09-10T22:38:06.111 INFO:teuthology.orchestra.run.smithi135.stdout: "req_getvxattr_latency": { 2024-09-10T22:38:06.111 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-09-10T22:38:06.111 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-09-10T22:38:06.111 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-09-10T22:38:06.111 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-10T22:38:06.111 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-10T22:38:06.111 INFO:teuthology.orchestra.run.smithi135.stdout: "mds_sessions": { 2024-09-10T22:38:06.111 INFO:teuthology.orchestra.run.smithi135.stdout: "session_count": 1, 2024-09-10T22:38:06.111 INFO:teuthology.orchestra.run.smithi135.stdout: "session_add": 2, 2024-09-10T22:38:06.111 INFO:teuthology.orchestra.run.smithi135.stdout: "session_remove": 1, 2024-09-10T22:38:06.112 INFO:teuthology.orchestra.run.smithi135.stdout: "sessions_open": 1, 2024-09-10T22:38:06.112 INFO:teuthology.orchestra.run.smithi135.stdout: "sessions_stale": 0, 2024-09-10T22:38:06.112 INFO:teuthology.orchestra.run.smithi135.stdout: "total_load": 0, 2024-09-10T22:38:06.112 INFO:teuthology.orchestra.run.smithi135.stdout: "average_load": 0, 2024-09-10T22:38:06.112 INFO:teuthology.orchestra.run.smithi135.stdout: "avg_session_uptime": 2063, 2024-09-10T22:38:06.112 INFO:teuthology.orchestra.run.smithi135.stdout: "mdthresh_evicted": 0 2024-09-10T22:38:06.112 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-10T22:38:06.112 INFO:teuthology.orchestra.run.smithi135.stdout: "mempool": { 2024-09-10T22:38:06.112 INFO:teuthology.orchestra.run.smithi135.stdout: "bloom_filter_bytes": 0, 2024-09-10T22:38:06.112 INFO:teuthology.orchestra.run.smithi135.stdout: "bloom_filter_items": 0, 2024-09-10T22:38:06.112 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_alloc_bytes": 0, 2024-09-10T22:38:06.112 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_alloc_items": 0, 2024-09-10T22:38:06.112 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_cache_data_bytes": 0, 2024-09-10T22:38:06.112 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_cache_data_items": 0, 2024-09-10T22:38:06.113 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-10T22:38:06.113 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_cache_onode_items": 0, 2024-09-10T22:38:06.113 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-10T22:38:06.113 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_cache_meta_items": 0, 2024-09-10T22:38:06.113 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_cache_other_bytes": 0, 2024-09-10T22:38:06.113 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_cache_other_items": 0, 2024-09-10T22:38:06.113 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-10T22:38:06.113 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_cache_buffer_items": 0, 2024-09-10T22:38:06.113 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_extent_bytes": 0, 2024-09-10T22:38:06.113 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_extent_items": 0, 2024-09-10T22:38:06.113 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_blob_bytes": 0, 2024-09-10T22:38:06.113 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_blob_items": 0, 2024-09-10T22:38:06.113 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-10T22:38:06.113 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_shared_blob_items": 0, 2024-09-10T22:38:06.114 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-10T22:38:06.114 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_inline_bl_items": 0, 2024-09-10T22:38:06.114 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_fsck_bytes": 0, 2024-09-10T22:38:06.114 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_fsck_items": 0, 2024-09-10T22:38:06.114 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_txc_bytes": 0, 2024-09-10T22:38:06.114 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_txc_items": 0, 2024-09-10T22:38:06.114 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-10T22:38:06.114 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_writing_deferred_items": 0, 2024-09-10T22:38:06.114 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_writing_bytes": 0, 2024-09-10T22:38:06.114 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_writing_items": 0, 2024-09-10T22:38:06.114 INFO:teuthology.orchestra.run.smithi135.stdout: "bluefs_bytes": 0, 2024-09-10T22:38:06.114 INFO:teuthology.orchestra.run.smithi135.stdout: "bluefs_items": 0, 2024-09-10T22:38:06.114 INFO:teuthology.orchestra.run.smithi135.stdout: "bluefs_file_reader_bytes": 0, 2024-09-10T22:38:06.115 INFO:teuthology.orchestra.run.smithi135.stdout: "bluefs_file_reader_items": 0, 2024-09-10T22:38:06.115 INFO:teuthology.orchestra.run.smithi135.stdout: "bluefs_file_writer_bytes": 0, 2024-09-10T22:38:06.115 INFO:teuthology.orchestra.run.smithi135.stdout: "bluefs_file_writer_items": 0, 2024-09-10T22:38:06.115 INFO:teuthology.orchestra.run.smithi135.stdout: "buffer_anon_bytes": 239900, 2024-09-10T22:38:06.115 INFO:teuthology.orchestra.run.smithi135.stdout: "buffer_anon_items": 83, 2024-09-10T22:38:06.115 INFO:teuthology.orchestra.run.smithi135.stdout: "buffer_meta_bytes": 0, 2024-09-10T22:38:06.115 INFO:teuthology.orchestra.run.smithi135.stdout: "buffer_meta_items": 0, 2024-09-10T22:38:06.115 INFO:teuthology.orchestra.run.smithi135.stdout: "osd_bytes": 0, 2024-09-10T22:38:06.115 INFO:teuthology.orchestra.run.smithi135.stdout: "osd_items": 0, 2024-09-10T22:38:06.115 INFO:teuthology.orchestra.run.smithi135.stdout: "osd_mapbl_bytes": 0, 2024-09-10T22:38:06.115 INFO:teuthology.orchestra.run.smithi135.stdout: "osd_mapbl_items": 0, 2024-09-10T22:38:06.115 INFO:teuthology.orchestra.run.smithi135.stdout: "osd_pglog_bytes": 0, 2024-09-10T22:38:06.115 INFO:teuthology.orchestra.run.smithi135.stdout: "osd_pglog_items": 0, 2024-09-10T22:38:06.115 INFO:teuthology.orchestra.run.smithi135.stdout: "osdmap_bytes": 7880, 2024-09-10T22:38:06.115 INFO:teuthology.orchestra.run.smithi135.stdout: "osdmap_items": 162, 2024-09-10T22:38:06.116 INFO:teuthology.orchestra.run.smithi135.stdout: "osdmap_mapping_bytes": 0, 2024-09-10T22:38:06.116 INFO:teuthology.orchestra.run.smithi135.stdout: "osdmap_mapping_items": 0, 2024-09-10T22:38:06.116 INFO:teuthology.orchestra.run.smithi135.stdout: "pgmap_bytes": 0, 2024-09-10T22:38:06.116 INFO:teuthology.orchestra.run.smithi135.stdout: "pgmap_items": 0, 2024-09-10T22:38:06.116 INFO:teuthology.orchestra.run.smithi135.stdout: "mds_co_bytes": 84145, 2024-09-10T22:38:06.116 INFO:teuthology.orchestra.run.smithi135.stdout: "mds_co_items": 1020, 2024-09-10T22:38:06.116 INFO:teuthology.orchestra.run.smithi135.stdout: "unittest_1_bytes": 0, 2024-09-10T22:38:06.116 INFO:teuthology.orchestra.run.smithi135.stdout: "unittest_1_items": 0, 2024-09-10T22:38:06.116 INFO:teuthology.orchestra.run.smithi135.stdout: "unittest_2_bytes": 0, 2024-09-10T22:38:06.116 INFO:teuthology.orchestra.run.smithi135.stdout: "unittest_2_items": 0 2024-09-10T22:38:06.116 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-10T22:38:06.116 INFO:teuthology.orchestra.run.smithi135.stdout: "objecter": { 2024-09-10T22:38:06.116 INFO:teuthology.orchestra.run.smithi135.stdout: "op_active": 0, 2024-09-10T22:38:06.116 INFO:teuthology.orchestra.run.smithi135.stdout: "op_laggy": 0, 2024-09-10T22:38:06.117 INFO:teuthology.orchestra.run.smithi135.stdout: "op_send": 2938, 2024-09-10T22:38:06.117 INFO:teuthology.orchestra.run.smithi135.stdout: "op_send_bytes": 26, 2024-09-10T22:38:06.117 INFO:teuthology.orchestra.run.smithi135.stdout: "op_resend": 4, 2024-09-10T22:38:06.117 INFO:teuthology.orchestra.run.smithi135.stdout: "op_reply": 2938, 2024-09-10T22:38:06.117 INFO:teuthology.orchestra.run.smithi135.stdout: "op_latency": { 2024-09-10T22:38:06.117 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 2938, 2024-09-10T22:38:06.117 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 86.051313784, 2024-09-10T22:38:06.117 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.029289078 2024-09-10T22:38:06.117 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-10T22:38:06.117 INFO:teuthology.orchestra.run.smithi135.stdout: "op_inflight": 0, 2024-09-10T22:38:06.117 INFO:teuthology.orchestra.run.smithi135.stdout: "oplen_avg": { 2024-09-10T22:38:06.117 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 2938, 2024-09-10T22:38:06.117 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 2939 2024-09-10T22:38:06.117 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-10T22:38:06.118 INFO:teuthology.orchestra.run.smithi135.stdout: "op": 2938, 2024-09-10T22:38:06.118 INFO:teuthology.orchestra.run.smithi135.stdout: "op_r": 2938, 2024-09-10T22:38:06.118 INFO:teuthology.orchestra.run.smithi135.stdout: "op_w": 0, 2024-09-10T22:38:06.118 INFO:teuthology.orchestra.run.smithi135.stdout: "op_rmw": 0, 2024-09-10T22:38:06.118 INFO:teuthology.orchestra.run.smithi135.stdout: "op_pg": 0, 2024-09-10T22:38:06.118 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_stat": 1748, 2024-09-10T22:38:06.118 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_create": 0, 2024-09-10T22:38:06.118 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_read": 1187, 2024-09-10T22:38:06.118 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_write": 0, 2024-09-10T22:38:06.118 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_writefull": 0, 2024-09-10T22:38:06.118 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_writesame": 0, 2024-09-10T22:38:06.118 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_append": 0, 2024-09-10T22:38:06.118 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_zero": 0, 2024-09-10T22:38:06.118 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_truncate": 0, 2024-09-10T22:38:06.118 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_delete": 0, 2024-09-10T22:38:06.119 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_mapext": 0, 2024-09-10T22:38:06.119 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_sparse_read": 0, 2024-09-10T22:38:06.119 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_clonerange": 0, 2024-09-10T22:38:06.119 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_getxattr": 2, 2024-09-10T22:38:06.119 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_setxattr": 0, 2024-09-10T22:38:06.119 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_cmpxattr": 0, 2024-09-10T22:38:06.119 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_rmxattr": 0, 2024-09-10T22:38:06.119 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_resetxattrs": 0, 2024-09-10T22:38:06.119 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_call": 0, 2024-09-10T22:38:06.119 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_watch": 0, 2024-09-10T22:38:06.119 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_notify": 0, 2024-09-10T22:38:06.119 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_src_cmpxattr": 0, 2024-09-10T22:38:06.119 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_pgls": 0, 2024-09-10T22:38:06.119 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_pgls_filter": 0, 2024-09-10T22:38:06.119 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_other": 0, 2024-09-10T22:38:06.120 INFO:teuthology.orchestra.run.smithi135.stdout: "linger_active": 0, 2024-09-10T22:38:06.120 INFO:teuthology.orchestra.run.smithi135.stdout: "linger_send": 0, 2024-09-10T22:38:06.120 INFO:teuthology.orchestra.run.smithi135.stdout: "linger_resend": 0, 2024-09-10T22:38:06.120 INFO:teuthology.orchestra.run.smithi135.stdout: "linger_ping": 0, 2024-09-10T22:38:06.120 INFO:teuthology.orchestra.run.smithi135.stdout: "poolop_active": 0, 2024-09-10T22:38:06.120 INFO:teuthology.orchestra.run.smithi135.stdout: "poolop_send": 0, 2024-09-10T22:38:06.120 INFO:teuthology.orchestra.run.smithi135.stdout: "poolop_resend": 0, 2024-09-10T22:38:06.120 INFO:teuthology.orchestra.run.smithi135.stdout: "poolstat_active": 0, 2024-09-10T22:38:06.120 INFO:teuthology.orchestra.run.smithi135.stdout: "poolstat_send": 0, 2024-09-10T22:38:06.120 INFO:teuthology.orchestra.run.smithi135.stdout: "poolstat_resend": 0, 2024-09-10T22:38:06.120 INFO:teuthology.orchestra.run.smithi135.stdout: "statfs_active": 0, 2024-09-10T22:38:06.120 INFO:teuthology.orchestra.run.smithi135.stdout: "statfs_send": 0, 2024-09-10T22:38:06.120 INFO:teuthology.orchestra.run.smithi135.stdout: "statfs_resend": 0, 2024-09-10T22:38:06.120 INFO:teuthology.orchestra.run.smithi135.stdout: "command_active": 0, 2024-09-10T22:38:06.120 INFO:teuthology.orchestra.run.smithi135.stdout: "command_send": 0, 2024-09-10T22:38:06.121 INFO:teuthology.orchestra.run.smithi135.stdout: "command_resend": 0, 2024-09-10T22:38:06.121 INFO:teuthology.orchestra.run.smithi135.stdout: "map_epoch": 77, 2024-09-10T22:38:06.121 INFO:teuthology.orchestra.run.smithi135.stdout: "map_full": 0, 2024-09-10T22:38:06.121 INFO:teuthology.orchestra.run.smithi135.stdout: "map_inc": 4, 2024-09-10T22:38:06.121 INFO:teuthology.orchestra.run.smithi135.stdout: "osd_sessions": 11, 2024-09-10T22:38:06.121 INFO:teuthology.orchestra.run.smithi135.stdout: "osd_session_open": 11, 2024-09-10T22:38:06.121 INFO:teuthology.orchestra.run.smithi135.stdout: "osd_session_close": 0, 2024-09-10T22:38:06.121 INFO:teuthology.orchestra.run.smithi135.stdout: "osd_laggy": 0, 2024-09-10T22:38:06.121 INFO:teuthology.orchestra.run.smithi135.stdout: "omap_wr": 0, 2024-09-10T22:38:06.121 INFO:teuthology.orchestra.run.smithi135.stdout: "omap_rd": 2, 2024-09-10T22:38:06.121 INFO:teuthology.orchestra.run.smithi135.stdout: "omap_del": 0 2024-09-10T22:38:06.121 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-10T22:38:06.121 INFO:teuthology.orchestra.run.smithi135.stdout: "oft": { 2024-09-10T22:38:06.121 INFO:teuthology.orchestra.run.smithi135.stdout: "omap_total_objs": 0, 2024-09-10T22:38:06.122 INFO:teuthology.orchestra.run.smithi135.stdout: "omap_total_kv_pairs": 0, 2024-09-10T22:38:06.122 INFO:teuthology.orchestra.run.smithi135.stdout: "omap_total_updates": 0, 2024-09-10T22:38:06.122 INFO:teuthology.orchestra.run.smithi135.stdout: "omap_total_removes": 0 2024-09-10T22:38:06.122 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-10T22:38:06.122 INFO:teuthology.orchestra.run.smithi135.stdout: "purge_queue": { 2024-09-10T22:38:06.122 INFO:teuthology.orchestra.run.smithi135.stdout: "pq_executing_ops": 0, 2024-09-10T22:38:06.122 INFO:teuthology.orchestra.run.smithi135.stdout: "pq_executing_ops_high_water": 0, 2024-09-10T22:38:06.122 INFO:teuthology.orchestra.run.smithi135.stdout: "pq_executing": 0, 2024-09-10T22:38:06.122 INFO:teuthology.orchestra.run.smithi135.stdout: "pq_executing_high_water": 0, 2024-09-10T22:38:06.122 INFO:teuthology.orchestra.run.smithi135.stdout: "pq_executed_ops": 0, 2024-09-10T22:38:06.122 INFO:teuthology.orchestra.run.smithi135.stdout: "pq_executed": 0, 2024-09-10T22:38:06.122 INFO:teuthology.orchestra.run.smithi135.stdout: "pq_item_in_journal": 0 2024-09-10T22:38:06.122 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-10T22:38:06.122 INFO:teuthology.orchestra.run.smithi135.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-10T22:38:06.123 INFO:teuthology.orchestra.run.smithi135.stdout: "val": 0, 2024-09-10T22:38:06.123 INFO:teuthology.orchestra.run.smithi135.stdout: "max": 104857600, 2024-09-10T22:38:06.123 INFO:teuthology.orchestra.run.smithi135.stdout: "get_started": 0, 2024-09-10T22:38:06.123 INFO:teuthology.orchestra.run.smithi135.stdout: "get": 3184, 2024-09-10T22:38:06.123 INFO:teuthology.orchestra.run.smithi135.stdout: "get_sum": 430732000, 2024-09-10T22:38:06.123 INFO:teuthology.orchestra.run.smithi135.stdout: "get_or_fail_fail": 0, 2024-09-10T22:38:06.123 INFO:teuthology.orchestra.run.smithi135.stdout: "get_or_fail_success": 3184, 2024-09-10T22:38:06.123 INFO:teuthology.orchestra.run.smithi135.stdout: "take": 0, 2024-09-10T22:38:06.123 INFO:teuthology.orchestra.run.smithi135.stdout: "take_sum": 0, 2024-09-10T22:38:06.123 INFO:teuthology.orchestra.run.smithi135.stdout: "put": 3184, 2024-09-10T22:38:06.123 INFO:teuthology.orchestra.run.smithi135.stdout: "put_sum": 430732000, 2024-09-10T22:38:06.123 INFO:teuthology.orchestra.run.smithi135.stdout: "wait": { 2024-09-10T22:38:06.123 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-09-10T22:38:06.123 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-09-10T22:38:06.123 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-09-10T22:38:06.123 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-10T22:38:06.124 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-10T22:38:06.124 INFO:teuthology.orchestra.run.smithi135.stdout: "throttle-objecter_bytes": { 2024-09-10T22:38:06.124 INFO:teuthology.orchestra.run.smithi135.stdout: "val": 0, 2024-09-10T22:38:06.124 INFO:teuthology.orchestra.run.smithi135.stdout: "max": 104857600, 2024-09-10T22:38:06.124 INFO:teuthology.orchestra.run.smithi135.stdout: "get_started": 0, 2024-09-10T22:38:06.124 INFO:teuthology.orchestra.run.smithi135.stdout: "get": 0, 2024-09-10T22:38:06.124 INFO:teuthology.orchestra.run.smithi135.stdout: "get_sum": 0, 2024-09-10T22:38:06.124 INFO:teuthology.orchestra.run.smithi135.stdout: "get_or_fail_fail": 0, 2024-09-10T22:38:06.124 INFO:teuthology.orchestra.run.smithi135.stdout: "get_or_fail_success": 0, 2024-09-10T22:38:06.124 INFO:teuthology.orchestra.run.smithi135.stdout: "take": 2938, 2024-09-10T22:38:06.124 INFO:teuthology.orchestra.run.smithi135.stdout: "take_sum": 429656936, 2024-09-10T22:38:06.124 INFO:teuthology.orchestra.run.smithi135.stdout: "put": 2938, 2024-09-10T22:38:06.124 INFO:teuthology.orchestra.run.smithi135.stdout: "put_sum": 429656936, 2024-09-10T22:38:06.124 INFO:teuthology.orchestra.run.smithi135.stdout: "wait": { 2024-09-10T22:38:06.124 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-09-10T22:38:06.125 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-09-10T22:38:06.125 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-09-10T22:38:06.125 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-10T22:38:06.125 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-10T22:38:06.125 INFO:teuthology.orchestra.run.smithi135.stdout: "throttle-objecter_ops": { 2024-09-10T22:38:06.125 INFO:teuthology.orchestra.run.smithi135.stdout: "val": 0, 2024-09-10T22:38:06.125 INFO:teuthology.orchestra.run.smithi135.stdout: "max": 1024, 2024-09-10T22:38:06.125 INFO:teuthology.orchestra.run.smithi135.stdout: "get_started": 0, 2024-09-10T22:38:06.125 INFO:teuthology.orchestra.run.smithi135.stdout: "get": 0, 2024-09-10T22:38:06.125 INFO:teuthology.orchestra.run.smithi135.stdout: "get_sum": 0, 2024-09-10T22:38:06.125 INFO:teuthology.orchestra.run.smithi135.stdout: "get_or_fail_fail": 0, 2024-09-10T22:38:06.125 INFO:teuthology.orchestra.run.smithi135.stdout: "get_or_fail_success": 0, 2024-09-10T22:38:06.125 INFO:teuthology.orchestra.run.smithi135.stdout: "take": 2938, 2024-09-10T22:38:06.126 INFO:teuthology.orchestra.run.smithi135.stdout: "take_sum": 2938, 2024-09-10T22:38:06.126 INFO:teuthology.orchestra.run.smithi135.stdout: "put": 2938, 2024-09-10T22:38:06.126 INFO:teuthology.orchestra.run.smithi135.stdout: "put_sum": 2938, 2024-09-10T22:38:06.126 INFO:teuthology.orchestra.run.smithi135.stdout: "wait": { 2024-09-10T22:38:06.126 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-09-10T22:38:06.126 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-09-10T22:38:06.126 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-09-10T22:38:06.126 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-10T22:38:06.126 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-10T22:38:06.126 INFO:teuthology.orchestra.run.smithi135.stdout: "throttle-write_buf_throttle": { 2024-09-10T22:38:06.126 INFO:teuthology.orchestra.run.smithi135.stdout: "val": 0, 2024-09-10T22:38:06.126 INFO:teuthology.orchestra.run.smithi135.stdout: "max": 3758096384, 2024-09-10T22:38:06.126 INFO:teuthology.orchestra.run.smithi135.stdout: "get_started": 0, 2024-09-10T22:38:06.126 INFO:teuthology.orchestra.run.smithi135.stdout: "get": 0, 2024-09-10T22:38:06.126 INFO:teuthology.orchestra.run.smithi135.stdout: "get_sum": 0, 2024-09-10T22:38:06.126 INFO:teuthology.orchestra.run.smithi135.stdout: "get_or_fail_fail": 0, 2024-09-10T22:38:06.127 INFO:teuthology.orchestra.run.smithi135.stdout: "get_or_fail_success": 0, 2024-09-10T22:38:06.127 INFO:teuthology.orchestra.run.smithi135.stdout: "take": 0, 2024-09-10T22:38:06.127 INFO:teuthology.orchestra.run.smithi135.stdout: "take_sum": 0, 2024-09-10T22:38:06.127 INFO:teuthology.orchestra.run.smithi135.stdout: "put": 0, 2024-09-10T22:38:06.127 INFO:teuthology.orchestra.run.smithi135.stdout: "put_sum": 0, 2024-09-10T22:38:06.127 INFO:teuthology.orchestra.run.smithi135.stdout: "wait": { 2024-09-10T22:38:06.127 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-09-10T22:38:06.127 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-09-10T22:38:06.127 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-09-10T22:38:06.127 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-10T22:38:06.127 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-10T22:38:06.127 INFO:teuthology.orchestra.run.smithi135.stdout: "throttle-write_buf_throttle-0x55ce1a79d040": { 2024-09-10T22:38:06.127 INFO:teuthology.orchestra.run.smithi135.stdout: "val": 0, 2024-09-10T22:38:06.127 INFO:teuthology.orchestra.run.smithi135.stdout: "max": 3758096384, 2024-09-10T22:38:06.128 INFO:teuthology.orchestra.run.smithi135.stdout: "get_started": 0, 2024-09-10T22:38:06.128 INFO:teuthology.orchestra.run.smithi135.stdout: "get": 0, 2024-09-10T22:38:06.128 INFO:teuthology.orchestra.run.smithi135.stdout: "get_sum": 0, 2024-09-10T22:38:06.128 INFO:teuthology.orchestra.run.smithi135.stdout: "get_or_fail_fail": 0, 2024-09-10T22:38:06.128 INFO:teuthology.orchestra.run.smithi135.stdout: "get_or_fail_success": 0, 2024-09-10T22:38:06.128 INFO:teuthology.orchestra.run.smithi135.stdout: "take": 0, 2024-09-10T22:38:06.128 INFO:teuthology.orchestra.run.smithi135.stdout: "take_sum": 0, 2024-09-10T22:38:06.128 INFO:teuthology.orchestra.run.smithi135.stdout: "put": 0, 2024-09-10T22:38:06.128 INFO:teuthology.orchestra.run.smithi135.stdout: "put_sum": 0, 2024-09-10T22:38:06.128 INFO:teuthology.orchestra.run.smithi135.stdout: "wait": { 2024-09-10T22:38:06.128 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-09-10T22:38:06.128 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-09-10T22:38:06.128 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-09-10T22:38:06.128 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-10T22:38:06.128 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-10T22:38:06.129 INFO:teuthology.orchestra.run.smithi135.stdout: "trackedop": { 2024-09-10T22:38:06.129 INFO:teuthology.orchestra.run.smithi135.stdout: "slow_ops_count": 0 2024-09-10T22:38:06.129 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-10T22:38:06.129 INFO:teuthology.orchestra.run.smithi135.stdout:} 2024-09-10T22:38:06.360 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:38:06 smithi135 ceph-mon[34789]: pgmap v697: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 37 MiB/s wr, 324 op/s 2024-09-10T22:38:06.375 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:38:06 smithi138 ceph-mon[35236]: pgmap v697: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 37 MiB/s wr, 324 op/s 2024-09-10T22:38:06.458 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:38:06 smithi019 ceph-mon[31375]: pgmap v697: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 37 MiB/s wr, 324 op/s 2024-09-10T22:38:07.029 INFO:tasks.check_counter:Daemon mds.h mds.exported=0 2024-09-10T22:38:07.029 INFO:tasks.check_counter:Daemon mds.h mds.imported=0 2024-09-10T22:38:07.029 INFO:tasks.check_counter:Daemon mds.h mds_cache.dir_update=0 2024-09-10T22:38:07.029 INFO:tasks.check_counter:Daemon mds.h mds_cache.dir_update_receipt=0 2024-09-10T22:38:07.029 DEBUG:tasks.check_counter:Getting stats from k 2024-09-10T22:38:07.029 DEBUG:teuthology.orchestra.run.smithi135:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 22997a4c-6fc2-11ef-bcea-c7b262605968 -- ceph daemon mds.k perf dump 2024-09-10T22:38:07.287 INFO:teuthology.orchestra.run.smithi135.stderr:Inferring config /var/lib/ceph/22997a4c-6fc2-11ef-bcea-c7b262605968/mon.b/config 2024-09-10T22:38:07.814 INFO:teuthology.orchestra.run.smithi135.stdout:{ 2024-09-10T22:38:07.815 INFO:teuthology.orchestra.run.smithi135.stdout: "AsyncMessenger::Worker-0": { 2024-09-10T22:38:07.815 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_recv_messages": 234, 2024-09-10T22:38:07.815 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_send_messages": 231, 2024-09-10T22:38:07.815 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_recv_bytes": 528592, 2024-09-10T22:38:07.815 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_send_bytes": 142144, 2024-09-10T22:38:07.815 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_created_connections": 4, 2024-09-10T22:38:07.815 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_active_connections": 0, 2024-09-10T22:38:07.815 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_running_total_time": 0.039866706, 2024-09-10T22:38:07.815 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_running_send_time": 0.020163801, 2024-09-10T22:38:07.815 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_running_recv_time": 0.023907652, 2024-09-10T22:38:07.815 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-10T22:38:07.816 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_send_messages_queue_lat": { 2024-09-10T22:38:07.816 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 230, 2024-09-10T22:38:07.816 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.014354113, 2024-09-10T22:38:07.816 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000062409 2024-09-10T22:38:07.816 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-10T22:38:07.816 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_handle_ack_lat": { 2024-09-10T22:38:07.816 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-09-10T22:38:07.816 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-09-10T22:38:07.816 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-09-10T22:38:07.816 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-10T22:38:07.816 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_recv_encrypted_bytes": 528592, 2024-09-10T22:38:07.816 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_send_encrypted_bytes": 142144 2024-09-10T22:38:07.817 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-10T22:38:07.817 INFO:teuthology.orchestra.run.smithi135.stdout: "AsyncMessenger::Worker-1": { 2024-09-10T22:38:07.817 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_recv_messages": 5, 2024-09-10T22:38:07.817 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_send_messages": 178, 2024-09-10T22:38:07.817 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_recv_bytes": 3152, 2024-09-10T22:38:07.817 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_send_bytes": 111664, 2024-09-10T22:38:07.817 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_created_connections": 3, 2024-09-10T22:38:07.817 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_active_connections": 2, 2024-09-10T22:38:07.817 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_running_total_time": 0.015277195, 2024-09-10T22:38:07.817 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_running_send_time": 0.010754750, 2024-09-10T22:38:07.817 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_running_recv_time": 0.002821752, 2024-09-10T22:38:07.817 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-10T22:38:07.817 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_send_messages_queue_lat": { 2024-09-10T22:38:07.818 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 177, 2024-09-10T22:38:07.818 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.016686193, 2024-09-10T22:38:07.818 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000094272 2024-09-10T22:38:07.818 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-10T22:38:07.818 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_handle_ack_lat": { 2024-09-10T22:38:07.818 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-09-10T22:38:07.818 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-09-10T22:38:07.818 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-09-10T22:38:07.818 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-10T22:38:07.818 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_recv_encrypted_bytes": 3152, 2024-09-10T22:38:07.818 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_send_encrypted_bytes": 111664 2024-09-10T22:38:07.818 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-10T22:38:07.818 INFO:teuthology.orchestra.run.smithi135.stdout: "AsyncMessenger::Worker-2": { 2024-09-10T22:38:07.819 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_recv_messages": 0, 2024-09-10T22:38:07.819 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_send_messages": 2, 2024-09-10T22:38:07.819 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_recv_bytes": 0, 2024-09-10T22:38:07.819 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_send_bytes": 0, 2024-09-10T22:38:07.819 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_created_connections": 2, 2024-09-10T22:38:07.819 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_active_connections": 1, 2024-09-10T22:38:07.819 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_running_total_time": 0.000338441, 2024-09-10T22:38:07.819 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_running_send_time": 0.000000000, 2024-09-10T22:38:07.819 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_running_recv_time": 0.000267994, 2024-09-10T22:38:07.819 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-10T22:38:07.819 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_send_messages_queue_lat": { 2024-09-10T22:38:07.819 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-09-10T22:38:07.819 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-09-10T22:38:07.820 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-09-10T22:38:07.820 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-10T22:38:07.820 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_handle_ack_lat": { 2024-09-10T22:38:07.820 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-09-10T22:38:07.820 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-09-10T22:38:07.820 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-09-10T22:38:07.820 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-10T22:38:07.820 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-10T22:38:07.820 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_send_encrypted_bytes": 0 2024-09-10T22:38:07.820 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-10T22:38:07.820 INFO:teuthology.orchestra.run.smithi135.stdout: "cct": { 2024-09-10T22:38:07.820 INFO:teuthology.orchestra.run.smithi135.stdout: "total_workers": 0, 2024-09-10T22:38:07.820 INFO:teuthology.orchestra.run.smithi135.stdout: "unhealthy_workers": 0 2024-09-10T22:38:07.820 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-10T22:38:07.821 INFO:teuthology.orchestra.run.smithi135.stdout: "mempool": { 2024-09-10T22:38:07.821 INFO:teuthology.orchestra.run.smithi135.stdout: "bloom_filter_bytes": 0, 2024-09-10T22:38:07.821 INFO:teuthology.orchestra.run.smithi135.stdout: "bloom_filter_items": 0, 2024-09-10T22:38:07.821 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_alloc_bytes": 0, 2024-09-10T22:38:07.821 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_alloc_items": 0, 2024-09-10T22:38:07.821 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_cache_data_bytes": 0, 2024-09-10T22:38:07.821 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_cache_data_items": 0, 2024-09-10T22:38:07.821 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-10T22:38:07.821 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_cache_onode_items": 0, 2024-09-10T22:38:07.821 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-10T22:38:07.821 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_cache_meta_items": 0, 2024-09-10T22:38:07.821 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_cache_other_bytes": 0, 2024-09-10T22:38:07.821 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_cache_other_items": 0, 2024-09-10T22:38:07.821 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-10T22:38:07.822 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_cache_buffer_items": 0, 2024-09-10T22:38:07.822 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_extent_bytes": 0, 2024-09-10T22:38:07.822 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_extent_items": 0, 2024-09-10T22:38:07.822 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_blob_bytes": 0, 2024-09-10T22:38:07.822 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_blob_items": 0, 2024-09-10T22:38:07.822 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-10T22:38:07.822 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_shared_blob_items": 0, 2024-09-10T22:38:07.822 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-10T22:38:07.822 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_inline_bl_items": 0, 2024-09-10T22:38:07.822 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_fsck_bytes": 0, 2024-09-10T22:38:07.822 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_fsck_items": 0, 2024-09-10T22:38:07.822 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_txc_bytes": 0, 2024-09-10T22:38:07.822 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_txc_items": 0, 2024-09-10T22:38:07.823 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-10T22:38:07.823 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_writing_deferred_items": 0, 2024-09-10T22:38:07.823 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_writing_bytes": 0, 2024-09-10T22:38:07.823 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_writing_items": 0, 2024-09-10T22:38:07.823 INFO:teuthology.orchestra.run.smithi135.stdout: "bluefs_bytes": 0, 2024-09-10T22:38:07.823 INFO:teuthology.orchestra.run.smithi135.stdout: "bluefs_items": 0, 2024-09-10T22:38:07.823 INFO:teuthology.orchestra.run.smithi135.stdout: "bluefs_file_reader_bytes": 0, 2024-09-10T22:38:07.823 INFO:teuthology.orchestra.run.smithi135.stdout: "bluefs_file_reader_items": 0, 2024-09-10T22:38:07.823 INFO:teuthology.orchestra.run.smithi135.stdout: "bluefs_file_writer_bytes": 0, 2024-09-10T22:38:07.823 INFO:teuthology.orchestra.run.smithi135.stdout: "bluefs_file_writer_items": 0, 2024-09-10T22:38:07.823 INFO:teuthology.orchestra.run.smithi135.stdout: "buffer_anon_bytes": 149998, 2024-09-10T22:38:07.823 INFO:teuthology.orchestra.run.smithi135.stdout: "buffer_anon_items": 30, 2024-09-10T22:38:07.823 INFO:teuthology.orchestra.run.smithi135.stdout: "buffer_meta_bytes": 0, 2024-09-10T22:38:07.823 INFO:teuthology.orchestra.run.smithi135.stdout: "buffer_meta_items": 0, 2024-09-10T22:38:07.824 INFO:teuthology.orchestra.run.smithi135.stdout: "osd_bytes": 0, 2024-09-10T22:38:07.824 INFO:teuthology.orchestra.run.smithi135.stdout: "osd_items": 0, 2024-09-10T22:38:07.824 INFO:teuthology.orchestra.run.smithi135.stdout: "osd_mapbl_bytes": 0, 2024-09-10T22:38:07.824 INFO:teuthology.orchestra.run.smithi135.stdout: "osd_mapbl_items": 0, 2024-09-10T22:38:07.824 INFO:teuthology.orchestra.run.smithi135.stdout: "osd_pglog_bytes": 0, 2024-09-10T22:38:07.824 INFO:teuthology.orchestra.run.smithi135.stdout: "osd_pglog_items": 0, 2024-09-10T22:38:07.824 INFO:teuthology.orchestra.run.smithi135.stdout: "osdmap_bytes": 0, 2024-09-10T22:38:07.824 INFO:teuthology.orchestra.run.smithi135.stdout: "osdmap_items": 0, 2024-09-10T22:38:07.824 INFO:teuthology.orchestra.run.smithi135.stdout: "osdmap_mapping_bytes": 0, 2024-09-10T22:38:07.824 INFO:teuthology.orchestra.run.smithi135.stdout: "osdmap_mapping_items": 0, 2024-09-10T22:38:07.824 INFO:teuthology.orchestra.run.smithi135.stdout: "pgmap_bytes": 0, 2024-09-10T22:38:07.824 INFO:teuthology.orchestra.run.smithi135.stdout: "pgmap_items": 0, 2024-09-10T22:38:07.824 INFO:teuthology.orchestra.run.smithi135.stdout: "mds_co_bytes": 968, 2024-09-10T22:38:07.825 INFO:teuthology.orchestra.run.smithi135.stdout: "mds_co_items": 2, 2024-09-10T22:38:07.825 INFO:teuthology.orchestra.run.smithi135.stdout: "unittest_1_bytes": 0, 2024-09-10T22:38:07.825 INFO:teuthology.orchestra.run.smithi135.stdout: "unittest_1_items": 0, 2024-09-10T22:38:07.825 INFO:teuthology.orchestra.run.smithi135.stdout: "unittest_2_bytes": 0, 2024-09-10T22:38:07.825 INFO:teuthology.orchestra.run.smithi135.stdout: "unittest_2_items": 0 2024-09-10T22:38:07.825 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-09-10T22:38:07.825 INFO:teuthology.orchestra.run.smithi135.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-10T22:38:07.825 INFO:teuthology.orchestra.run.smithi135.stdout: "val": 0, 2024-09-10T22:38:07.825 INFO:teuthology.orchestra.run.smithi135.stdout: "max": 104857600, 2024-09-10T22:38:07.825 INFO:teuthology.orchestra.run.smithi135.stdout: "get_started": 0, 2024-09-10T22:38:07.825 INFO:teuthology.orchestra.run.smithi135.stdout: "get": 235, 2024-09-10T22:38:07.825 INFO:teuthology.orchestra.run.smithi135.stdout: "get_sum": 495493, 2024-09-10T22:38:07.825 INFO:teuthology.orchestra.run.smithi135.stdout: "get_or_fail_fail": 0, 2024-09-10T22:38:07.825 INFO:teuthology.orchestra.run.smithi135.stdout: "get_or_fail_success": 235, 2024-09-10T22:38:07.826 INFO:teuthology.orchestra.run.smithi135.stdout: "take": 0, 2024-09-10T22:38:07.826 INFO:teuthology.orchestra.run.smithi135.stdout: "take_sum": 0, 2024-09-10T22:38:07.826 INFO:teuthology.orchestra.run.smithi135.stdout: "put": 235, 2024-09-10T22:38:07.826 INFO:teuthology.orchestra.run.smithi135.stdout: "put_sum": 495493, 2024-09-10T22:38:07.826 INFO:teuthology.orchestra.run.smithi135.stdout: "wait": { 2024-09-10T22:38:07.826 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-09-10T22:38:07.826 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-09-10T22:38:07.826 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-09-10T22:38:07.826 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-10T22:38:07.826 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-09-10T22:38:07.826 INFO:teuthology.orchestra.run.smithi135.stdout:} 2024-09-10T22:38:08.360 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:38:08 smithi135 ceph-mon[34789]: pgmap v698: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 44 MiB/s wr, 411 op/s 2024-09-10T22:38:08.375 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:38:08 smithi138 ceph-mon[35236]: pgmap v698: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 44 MiB/s wr, 411 op/s 2024-09-10T22:38:08.458 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:38:08 smithi019 ceph-mon[31375]: pgmap v698: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 44 MiB/s wr, 411 op/s 2024-09-10T22:38:08.501 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.k 2024-09-10T22:38:08.501 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.k 2024-09-10T22:38:08.501 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update' not found on daemon mds.k 2024-09-10T22:38:08.501 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update_receipt' not found on daemon mds.k 2024-09-10T22:38:08.501 DEBUG:tasks.check_counter:Getting stats from c 2024-09-10T22:38:08.501 DEBUG:teuthology.orchestra.run.smithi138:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 22997a4c-6fc2-11ef-bcea-c7b262605968 -- ceph daemon mds.c perf dump 2024-09-10T22:38:08.763 INFO:teuthology.orchestra.run.smithi138.stderr:Inferring config /var/lib/ceph/22997a4c-6fc2-11ef-bcea-c7b262605968/mon.c/config 2024-09-10T22:38:09.321 INFO:teuthology.orchestra.run.smithi138.stdout:{ 2024-09-10T22:38:09.321 INFO:teuthology.orchestra.run.smithi138.stdout: "AsyncMessenger::Worker-0": { 2024-09-10T22:38:09.321 INFO:teuthology.orchestra.run.smithi138.stdout: "msgr_recv_messages": 88, 2024-09-10T22:38:09.321 INFO:teuthology.orchestra.run.smithi138.stdout: "msgr_send_messages": 90, 2024-09-10T22:38:09.321 INFO:teuthology.orchestra.run.smithi138.stdout: "msgr_recv_bytes": 41328, 2024-09-10T22:38:09.321 INFO:teuthology.orchestra.run.smithi138.stdout: "msgr_send_bytes": 44987, 2024-09-10T22:38:09.321 INFO:teuthology.orchestra.run.smithi138.stdout: "msgr_created_connections": 10, 2024-09-10T22:38:09.321 INFO:teuthology.orchestra.run.smithi138.stdout: "msgr_active_connections": 3, 2024-09-10T22:38:09.321 INFO:teuthology.orchestra.run.smithi138.stdout: "msgr_running_total_time": 0.012730300, 2024-09-10T22:38:09.322 INFO:teuthology.orchestra.run.smithi138.stdout: "msgr_running_send_time": 0.003772462, 2024-09-10T22:38:09.322 INFO:teuthology.orchestra.run.smithi138.stdout: "msgr_running_recv_time": 0.005864510, 2024-09-10T22:38:09.322 INFO:teuthology.orchestra.run.smithi138.stdout: "msgr_running_fast_dispatch_time": 0.000484033, 2024-09-10T22:38:09.322 INFO:teuthology.orchestra.run.smithi138.stdout: "msgr_send_messages_queue_lat": { 2024-09-10T22:38:09.322 INFO:teuthology.orchestra.run.smithi138.stdout: "avgcount": 88, 2024-09-10T22:38:09.322 INFO:teuthology.orchestra.run.smithi138.stdout: "sum": 0.015286069, 2024-09-10T22:38:09.322 INFO:teuthology.orchestra.run.smithi138.stdout: "avgtime": 0.000173705 2024-09-10T22:38:09.322 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-09-10T22:38:09.322 INFO:teuthology.orchestra.run.smithi138.stdout: "msgr_handle_ack_lat": { 2024-09-10T22:38:09.322 INFO:teuthology.orchestra.run.smithi138.stdout: "avgcount": 131, 2024-09-10T22:38:09.322 INFO:teuthology.orchestra.run.smithi138.stdout: "sum": 0.000022425, 2024-09-10T22:38:09.322 INFO:teuthology.orchestra.run.smithi138.stdout: "avgtime": 0.000000171 2024-09-10T22:38:09.322 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-09-10T22:38:09.323 INFO:teuthology.orchestra.run.smithi138.stdout: "msgr_recv_encrypted_bytes": 1584, 2024-09-10T22:38:09.323 INFO:teuthology.orchestra.run.smithi138.stdout: "msgr_send_encrypted_bytes": 1440 2024-09-10T22:38:09.323 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-09-10T22:38:09.323 INFO:teuthology.orchestra.run.smithi138.stdout: "AsyncMessenger::Worker-1": { 2024-09-10T22:38:09.323 INFO:teuthology.orchestra.run.smithi138.stdout: "msgr_recv_messages": 325, 2024-09-10T22:38:09.323 INFO:teuthology.orchestra.run.smithi138.stdout: "msgr_send_messages": 315, 2024-09-10T22:38:09.323 INFO:teuthology.orchestra.run.smithi138.stdout: "msgr_recv_bytes": 583385, 2024-09-10T22:38:09.323 INFO:teuthology.orchestra.run.smithi138.stdout: "msgr_send_bytes": 578723, 2024-09-10T22:38:09.323 INFO:teuthology.orchestra.run.smithi138.stdout: "msgr_created_connections": 40, 2024-09-10T22:38:09.323 INFO:teuthology.orchestra.run.smithi138.stdout: "msgr_active_connections": 8, 2024-09-10T22:38:09.323 INFO:teuthology.orchestra.run.smithi138.stdout: "msgr_running_total_time": 0.049336260, 2024-09-10T22:38:09.323 INFO:teuthology.orchestra.run.smithi138.stdout: "msgr_running_send_time": 0.019458201, 2024-09-10T22:38:09.323 INFO:teuthology.orchestra.run.smithi138.stdout: "msgr_running_recv_time": 0.033294737, 2024-09-10T22:38:09.323 INFO:teuthology.orchestra.run.smithi138.stdout: "msgr_running_fast_dispatch_time": 0.000651021, 2024-09-10T22:38:09.323 INFO:teuthology.orchestra.run.smithi138.stdout: "msgr_send_messages_queue_lat": { 2024-09-10T22:38:09.324 INFO:teuthology.orchestra.run.smithi138.stdout: "avgcount": 314, 2024-09-10T22:38:09.324 INFO:teuthology.orchestra.run.smithi138.stdout: "sum": 0.023707584, 2024-09-10T22:38:09.324 INFO:teuthology.orchestra.run.smithi138.stdout: "avgtime": 0.000075501 2024-09-10T22:38:09.324 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-09-10T22:38:09.324 INFO:teuthology.orchestra.run.smithi138.stdout: "msgr_handle_ack_lat": { 2024-09-10T22:38:09.324 INFO:teuthology.orchestra.run.smithi138.stdout: "avgcount": 34, 2024-09-10T22:38:09.324 INFO:teuthology.orchestra.run.smithi138.stdout: "sum": 0.000003856, 2024-09-10T22:38:09.324 INFO:teuthology.orchestra.run.smithi138.stdout: "avgtime": 0.000000113 2024-09-10T22:38:09.324 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-09-10T22:38:09.324 INFO:teuthology.orchestra.run.smithi138.stdout: "msgr_recv_encrypted_bytes": 574688, 2024-09-10T22:38:09.324 INFO:teuthology.orchestra.run.smithi138.stdout: "msgr_send_encrypted_bytes": 147040 2024-09-10T22:38:09.324 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-09-10T22:38:09.324 INFO:teuthology.orchestra.run.smithi138.stdout: "AsyncMessenger::Worker-2": { 2024-09-10T22:38:09.325 INFO:teuthology.orchestra.run.smithi138.stdout: "msgr_recv_messages": 1591, 2024-09-10T22:38:09.325 INFO:teuthology.orchestra.run.smithi138.stdout: "msgr_send_messages": 1158, 2024-09-10T22:38:09.325 INFO:teuthology.orchestra.run.smithi138.stdout: "msgr_recv_bytes": 401626, 2024-09-10T22:38:09.325 INFO:teuthology.orchestra.run.smithi138.stdout: "msgr_send_bytes": 615622, 2024-09-10T22:38:09.325 INFO:teuthology.orchestra.run.smithi138.stdout: "msgr_created_connections": 6, 2024-09-10T22:38:09.325 INFO:teuthology.orchestra.run.smithi138.stdout: "msgr_active_connections": 4, 2024-09-10T22:38:09.325 INFO:teuthology.orchestra.run.smithi138.stdout: "msgr_running_total_time": 0.116266316, 2024-09-10T22:38:09.325 INFO:teuthology.orchestra.run.smithi138.stdout: "msgr_running_send_time": 0.055607430, 2024-09-10T22:38:09.325 INFO:teuthology.orchestra.run.smithi138.stdout: "msgr_running_recv_time": 0.073846372, 2024-09-10T22:38:09.325 INFO:teuthology.orchestra.run.smithi138.stdout: "msgr_running_fast_dispatch_time": 0.004644442, 2024-09-10T22:38:09.325 INFO:teuthology.orchestra.run.smithi138.stdout: "msgr_send_messages_queue_lat": { 2024-09-10T22:38:09.325 INFO:teuthology.orchestra.run.smithi138.stdout: "avgcount": 1157, 2024-09-10T22:38:09.325 INFO:teuthology.orchestra.run.smithi138.stdout: "sum": 0.048861525, 2024-09-10T22:38:09.326 INFO:teuthology.orchestra.run.smithi138.stdout: "avgtime": 0.000042231 2024-09-10T22:38:09.326 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-09-10T22:38:09.326 INFO:teuthology.orchestra.run.smithi138.stdout: "msgr_handle_ack_lat": { 2024-09-10T22:38:09.326 INFO:teuthology.orchestra.run.smithi138.stdout: "avgcount": 2474, 2024-09-10T22:38:09.326 INFO:teuthology.orchestra.run.smithi138.stdout: "sum": 0.000537387, 2024-09-10T22:38:09.326 INFO:teuthology.orchestra.run.smithi138.stdout: "avgtime": 0.000000217 2024-09-10T22:38:09.326 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-09-10T22:38:09.326 INFO:teuthology.orchestra.run.smithi138.stdout: "msgr_recv_encrypted_bytes": 3152, 2024-09-10T22:38:09.326 INFO:teuthology.orchestra.run.smithi138.stdout: "msgr_send_encrypted_bytes": 391232 2024-09-10T22:38:09.326 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-09-10T22:38:09.326 INFO:teuthology.orchestra.run.smithi138.stdout: "cct": { 2024-09-10T22:38:09.326 INFO:teuthology.orchestra.run.smithi138.stdout: "total_workers": 1, 2024-09-10T22:38:09.326 INFO:teuthology.orchestra.run.smithi138.stdout: "unhealthy_workers": 0 2024-09-10T22:38:09.326 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-09-10T22:38:09.327 INFO:teuthology.orchestra.run.smithi138.stdout: "finisher-MDSRank": { 2024-09-10T22:38:09.327 INFO:teuthology.orchestra.run.smithi138.stdout: "queue_len": 0, 2024-09-10T22:38:09.327 INFO:teuthology.orchestra.run.smithi138.stdout: "complete_latency": { 2024-09-10T22:38:09.327 INFO:teuthology.orchestra.run.smithi138.stdout: "avgcount": 46, 2024-09-10T22:38:09.327 INFO:teuthology.orchestra.run.smithi138.stdout: "sum": 0.001452043, 2024-09-10T22:38:09.327 INFO:teuthology.orchestra.run.smithi138.stdout: "avgtime": 0.000031566 2024-09-10T22:38:09.327 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-09-10T22:38:09.327 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-09-10T22:38:09.327 INFO:teuthology.orchestra.run.smithi138.stdout: "finisher-PurgeQueue": { 2024-09-10T22:38:09.327 INFO:teuthology.orchestra.run.smithi138.stdout: "queue_len": 0, 2024-09-10T22:38:09.327 INFO:teuthology.orchestra.run.smithi138.stdout: "complete_latency": { 2024-09-10T22:38:09.327 INFO:teuthology.orchestra.run.smithi138.stdout: "avgcount": 2, 2024-09-10T22:38:09.327 INFO:teuthology.orchestra.run.smithi138.stdout: "sum": 0.000017496, 2024-09-10T22:38:09.328 INFO:teuthology.orchestra.run.smithi138.stdout: "avgtime": 0.000008748 2024-09-10T22:38:09.328 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-09-10T22:38:09.328 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-09-10T22:38:09.328 INFO:teuthology.orchestra.run.smithi138.stdout: "mds": { 2024-09-10T22:38:09.328 INFO:teuthology.orchestra.run.smithi138.stdout: "request": 2, 2024-09-10T22:38:09.328 INFO:teuthology.orchestra.run.smithi138.stdout: "reply": 1, 2024-09-10T22:38:09.328 INFO:teuthology.orchestra.run.smithi138.stdout: "reply_latency": { 2024-09-10T22:38:09.328 INFO:teuthology.orchestra.run.smithi138.stdout: "avgcount": 1, 2024-09-10T22:38:09.328 INFO:teuthology.orchestra.run.smithi138.stdout: "sum": 0.000196815, 2024-09-10T22:38:09.328 INFO:teuthology.orchestra.run.smithi138.stdout: "avgtime": 0.000196815 2024-09-10T22:38:09.328 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-09-10T22:38:09.328 INFO:teuthology.orchestra.run.smithi138.stdout: "slow_reply": 0, 2024-09-10T22:38:09.328 INFO:teuthology.orchestra.run.smithi138.stdout: "forward": 1, 2024-09-10T22:38:09.329 INFO:teuthology.orchestra.run.smithi138.stdout: "dir_fetch_complete": 0, 2024-09-10T22:38:09.329 INFO:teuthology.orchestra.run.smithi138.stdout: "dir_fetch_keys": 0, 2024-09-10T22:38:09.329 INFO:teuthology.orchestra.run.smithi138.stdout: "dir_commit": 11, 2024-09-10T22:38:09.329 INFO:teuthology.orchestra.run.smithi138.stdout: "dir_split": 0, 2024-09-10T22:38:09.329 INFO:teuthology.orchestra.run.smithi138.stdout: "dir_merge": 0, 2024-09-10T22:38:09.329 INFO:teuthology.orchestra.run.smithi138.stdout: "inodes": 16, 2024-09-10T22:38:09.329 INFO:teuthology.orchestra.run.smithi138.stdout: "inodes_top": 0, 2024-09-10T22:38:09.329 INFO:teuthology.orchestra.run.smithi138.stdout: "inodes_bottom": 16, 2024-09-10T22:38:09.329 INFO:teuthology.orchestra.run.smithi138.stdout: "inodes_pin_tail": 0, 2024-09-10T22:38:09.329 INFO:teuthology.orchestra.run.smithi138.stdout: "inodes_pinned": 13, 2024-09-10T22:38:09.329 INFO:teuthology.orchestra.run.smithi138.stdout: "inodes_expired": 8, 2024-09-10T22:38:09.329 INFO:teuthology.orchestra.run.smithi138.stdout: "inodes_with_caps": 0, 2024-09-10T22:38:09.329 INFO:teuthology.orchestra.run.smithi138.stdout: "caps": 0, 2024-09-10T22:38:09.330 INFO:teuthology.orchestra.run.smithi138.stdout: "subtrees": 3, 2024-09-10T22:38:09.330 INFO:teuthology.orchestra.run.smithi138.stdout: "traverse": 13, 2024-09-10T22:38:09.330 INFO:teuthology.orchestra.run.smithi138.stdout: "traverse_hit": 7, 2024-09-10T22:38:09.330 INFO:teuthology.orchestra.run.smithi138.stdout: "traverse_forward": 0, 2024-09-10T22:38:09.330 INFO:teuthology.orchestra.run.smithi138.stdout: "traverse_discover": 5, 2024-09-10T22:38:09.330 INFO:teuthology.orchestra.run.smithi138.stdout: "traverse_dir_fetch": 0, 2024-09-10T22:38:09.330 INFO:teuthology.orchestra.run.smithi138.stdout: "traverse_remote_ino": 0, 2024-09-10T22:38:09.330 INFO:teuthology.orchestra.run.smithi138.stdout: "traverse_lock": 0, 2024-09-10T22:38:09.330 INFO:teuthology.orchestra.run.smithi138.stdout: "load_cent": 0, 2024-09-10T22:38:09.330 INFO:teuthology.orchestra.run.smithi138.stdout: "q": 0, 2024-09-10T22:38:09.330 INFO:teuthology.orchestra.run.smithi138.stdout: "exported": 0, 2024-09-10T22:38:09.330 INFO:teuthology.orchestra.run.smithi138.stdout: "exported_inodes": 0, 2024-09-10T22:38:09.330 INFO:teuthology.orchestra.run.smithi138.stdout: "imported": 0, 2024-09-10T22:38:09.330 INFO:teuthology.orchestra.run.smithi138.stdout: "imported_inodes": 0, 2024-09-10T22:38:09.331 INFO:teuthology.orchestra.run.smithi138.stdout: "openino_dir_fetch": 0, 2024-09-10T22:38:09.331 INFO:teuthology.orchestra.run.smithi138.stdout: "openino_backtrace_fetch": 0, 2024-09-10T22:38:09.331 INFO:teuthology.orchestra.run.smithi138.stdout: "openino_peer_discover": 0, 2024-09-10T22:38:09.331 INFO:teuthology.orchestra.run.smithi138.stdout: "root_rfiles": 22, 2024-09-10T22:38:09.331 INFO:teuthology.orchestra.run.smithi138.stdout: "root_rbytes": 10738144011, 2024-09-10T22:38:09.331 INFO:teuthology.orchestra.run.smithi138.stdout: "root_rsnaps": 0, 2024-09-10T22:38:09.331 INFO:teuthology.orchestra.run.smithi138.stdout: "scrub_backtrace_fetch": 0, 2024-09-10T22:38:09.331 INFO:teuthology.orchestra.run.smithi138.stdout: "scrub_set_tag": 0, 2024-09-10T22:38:09.331 INFO:teuthology.orchestra.run.smithi138.stdout: "scrub_backtrace_repaired": 0, 2024-09-10T22:38:09.331 INFO:teuthology.orchestra.run.smithi138.stdout: "scrub_inotable_repaired": 0, 2024-09-10T22:38:09.331 INFO:teuthology.orchestra.run.smithi138.stdout: "scrub_dir_inodes": 0, 2024-09-10T22:38:09.331 INFO:teuthology.orchestra.run.smithi138.stdout: "scrub_dir_base_inodes": 0, 2024-09-10T22:38:09.331 INFO:teuthology.orchestra.run.smithi138.stdout: "scrub_dirfrag_rstats": 0, 2024-09-10T22:38:09.332 INFO:teuthology.orchestra.run.smithi138.stdout: "scrub_file_inodes": 0, 2024-09-10T22:38:09.332 INFO:teuthology.orchestra.run.smithi138.stdout: "handle_inode_file_caps": 0, 2024-09-10T22:38:09.332 INFO:teuthology.orchestra.run.smithi138.stdout: "ceph_cap_op_revoke": 0, 2024-09-10T22:38:09.332 INFO:teuthology.orchestra.run.smithi138.stdout: "ceph_cap_op_grant": 0, 2024-09-10T22:38:09.332 INFO:teuthology.orchestra.run.smithi138.stdout: "ceph_cap_op_trunc": 0, 2024-09-10T22:38:09.332 INFO:teuthology.orchestra.run.smithi138.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-10T22:38:09.332 INFO:teuthology.orchestra.run.smithi138.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-10T22:38:09.332 INFO:teuthology.orchestra.run.smithi138.stdout: "handle_client_caps": 0, 2024-09-10T22:38:09.332 INFO:teuthology.orchestra.run.smithi138.stdout: "handle_client_caps_dirty": 0, 2024-09-10T22:38:09.332 INFO:teuthology.orchestra.run.smithi138.stdout: "handle_client_cap_release": 0, 2024-09-10T22:38:09.332 INFO:teuthology.orchestra.run.smithi138.stdout: "process_request_cap_release": 1 2024-09-10T22:38:09.332 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-09-10T22:38:09.332 INFO:teuthology.orchestra.run.smithi138.stdout: "mds_cache": { 2024-09-10T22:38:09.333 INFO:teuthology.orchestra.run.smithi138.stdout: "dir_update": 0, 2024-09-10T22:38:09.333 INFO:teuthology.orchestra.run.smithi138.stdout: "dir_update_receipt": 12, 2024-09-10T22:38:09.333 INFO:teuthology.orchestra.run.smithi138.stdout: "dir_try_discover": 8, 2024-09-10T22:38:09.333 INFO:teuthology.orchestra.run.smithi138.stdout: "dir_send_discover": 11, 2024-09-10T22:38:09.333 INFO:teuthology.orchestra.run.smithi138.stdout: "dir_handle_discover": 0, 2024-09-10T22:38:09.333 INFO:teuthology.orchestra.run.smithi138.stdout: "num_strays": 0, 2024-09-10T22:38:09.333 INFO:teuthology.orchestra.run.smithi138.stdout: "num_strays_delayed": 0, 2024-09-10T22:38:09.333 INFO:teuthology.orchestra.run.smithi138.stdout: "num_strays_enqueuing": 0, 2024-09-10T22:38:09.333 INFO:teuthology.orchestra.run.smithi138.stdout: "strays_created": 0, 2024-09-10T22:38:09.333 INFO:teuthology.orchestra.run.smithi138.stdout: "strays_enqueued": 0, 2024-09-10T22:38:09.333 INFO:teuthology.orchestra.run.smithi138.stdout: "strays_reintegrated": 0, 2024-09-10T22:38:09.333 INFO:teuthology.orchestra.run.smithi138.stdout: "strays_migrated": 0, 2024-09-10T22:38:09.333 INFO:teuthology.orchestra.run.smithi138.stdout: "num_recovering_processing": 0, 2024-09-10T22:38:09.334 INFO:teuthology.orchestra.run.smithi138.stdout: "num_recovering_enqueued": 0, 2024-09-10T22:38:09.334 INFO:teuthology.orchestra.run.smithi138.stdout: "num_recovering_prioritized": 0, 2024-09-10T22:38:09.334 INFO:teuthology.orchestra.run.smithi138.stdout: "recovery_started": 0, 2024-09-10T22:38:09.334 INFO:teuthology.orchestra.run.smithi138.stdout: "recovery_completed": 0, 2024-09-10T22:38:09.334 INFO:teuthology.orchestra.run.smithi138.stdout: "ireq_quiesce_path": 0, 2024-09-10T22:38:09.334 INFO:teuthology.orchestra.run.smithi138.stdout: "ireq_quiesce_inode": 0, 2024-09-10T22:38:09.334 INFO:teuthology.orchestra.run.smithi138.stdout: "ireq_enqueue_scrub": 0, 2024-09-10T22:38:09.334 INFO:teuthology.orchestra.run.smithi138.stdout: "ireq_exportdir": 0, 2024-09-10T22:38:09.334 INFO:teuthology.orchestra.run.smithi138.stdout: "ireq_flush": 0, 2024-09-10T22:38:09.334 INFO:teuthology.orchestra.run.smithi138.stdout: "ireq_fragmentdir": 0, 2024-09-10T22:38:09.334 INFO:teuthology.orchestra.run.smithi138.stdout: "ireq_fragstats": 0, 2024-09-10T22:38:09.334 INFO:teuthology.orchestra.run.smithi138.stdout: "ireq_inodestats": 0, 2024-09-10T22:38:09.334 INFO:teuthology.orchestra.run.smithi138.stdout: "uninline_started": 0, 2024-09-10T22:38:09.334 INFO:teuthology.orchestra.run.smithi138.stdout: "uninline_succeeded": 0, 2024-09-10T22:38:09.335 INFO:teuthology.orchestra.run.smithi138.stdout: "uninline_write_failed": 0 2024-09-10T22:38:09.335 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-09-10T22:38:09.335 INFO:teuthology.orchestra.run.smithi138.stdout: "mds_log": { 2024-09-10T22:38:09.335 INFO:teuthology.orchestra.run.smithi138.stdout: "evlrg": 0, 2024-09-10T22:38:09.335 INFO:teuthology.orchestra.run.smithi138.stdout: "evadd": 4, 2024-09-10T22:38:09.335 INFO:teuthology.orchestra.run.smithi138.stdout: "evex": 0, 2024-09-10T22:38:09.335 INFO:teuthology.orchestra.run.smithi138.stdout: "evtrm": 0, 2024-09-10T22:38:09.335 INFO:teuthology.orchestra.run.smithi138.stdout: "ev": 4, 2024-09-10T22:38:09.335 INFO:teuthology.orchestra.run.smithi138.stdout: "evexg": 0, 2024-09-10T22:38:09.335 INFO:teuthology.orchestra.run.smithi138.stdout: "evexd": 0, 2024-09-10T22:38:09.335 INFO:teuthology.orchestra.run.smithi138.stdout: "segadd": 2, 2024-09-10T22:38:09.335 INFO:teuthology.orchestra.run.smithi138.stdout: "segex": 0, 2024-09-10T22:38:09.335 INFO:teuthology.orchestra.run.smithi138.stdout: "segtrm": 0, 2024-09-10T22:38:09.335 INFO:teuthology.orchestra.run.smithi138.stdout: "seg": 2, 2024-09-10T22:38:09.335 INFO:teuthology.orchestra.run.smithi138.stdout: "segmjr": 2, 2024-09-10T22:38:09.336 INFO:teuthology.orchestra.run.smithi138.stdout: "segexg": 0, 2024-09-10T22:38:09.336 INFO:teuthology.orchestra.run.smithi138.stdout: "segexd": 0, 2024-09-10T22:38:09.336 INFO:teuthology.orchestra.run.smithi138.stdout: "expos": 4194304, 2024-09-10T22:38:09.336 INFO:teuthology.orchestra.run.smithi138.stdout: "wrpos": 4195424, 2024-09-10T22:38:09.336 INFO:teuthology.orchestra.run.smithi138.stdout: "rdpos": 0, 2024-09-10T22:38:09.336 INFO:teuthology.orchestra.run.smithi138.stdout: "jlat": { 2024-09-10T22:38:09.336 INFO:teuthology.orchestra.run.smithi138.stdout: "avgcount": 3, 2024-09-10T22:38:09.336 INFO:teuthology.orchestra.run.smithi138.stdout: "sum": 0.005682723, 2024-09-10T22:38:09.336 INFO:teuthology.orchestra.run.smithi138.stdout: "avgtime": 0.001894241 2024-09-10T22:38:09.336 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-09-10T22:38:09.336 INFO:teuthology.orchestra.run.smithi138.stdout: "replayed": 0 2024-09-10T22:38:09.336 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-09-10T22:38:09.336 INFO:teuthology.orchestra.run.smithi138.stdout: "mds_mem": { 2024-09-10T22:38:09.337 INFO:teuthology.orchestra.run.smithi138.stdout: "ino": 20, 2024-09-10T22:38:09.337 INFO:teuthology.orchestra.run.smithi138.stdout: "ino+": 24, 2024-09-10T22:38:09.337 INFO:teuthology.orchestra.run.smithi138.stdout: "ino-": 4, 2024-09-10T22:38:09.337 INFO:teuthology.orchestra.run.smithi138.stdout: "dir": 19, 2024-09-10T22:38:09.337 INFO:teuthology.orchestra.run.smithi138.stdout: "dir+": 24, 2024-09-10T22:38:09.337 INFO:teuthology.orchestra.run.smithi138.stdout: "dir-": 5, 2024-09-10T22:38:09.337 INFO:teuthology.orchestra.run.smithi138.stdout: "dn": 16, 2024-09-10T22:38:09.337 INFO:teuthology.orchestra.run.smithi138.stdout: "dn+": 24, 2024-09-10T22:38:09.337 INFO:teuthology.orchestra.run.smithi138.stdout: "dn-": 8, 2024-09-10T22:38:09.337 INFO:teuthology.orchestra.run.smithi138.stdout: "cap": 0, 2024-09-10T22:38:09.337 INFO:teuthology.orchestra.run.smithi138.stdout: "cap+": 1, 2024-09-10T22:38:09.337 INFO:teuthology.orchestra.run.smithi138.stdout: "cap-": 1, 2024-09-10T22:38:09.337 INFO:teuthology.orchestra.run.smithi138.stdout: "rss": 52940, 2024-09-10T22:38:09.337 INFO:teuthology.orchestra.run.smithi138.stdout: "heap": 257683456 2024-09-10T22:38:09.338 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-09-10T22:38:09.338 INFO:teuthology.orchestra.run.smithi138.stdout: "mds_server": { 2024-09-10T22:38:09.338 INFO:teuthology.orchestra.run.smithi138.stdout: "dispatch_client_request": 3, 2024-09-10T22:38:09.338 INFO:teuthology.orchestra.run.smithi138.stdout: "dispatch_server_request": 1, 2024-09-10T22:38:09.338 INFO:teuthology.orchestra.run.smithi138.stdout: "handle_client_request": 2, 2024-09-10T22:38:09.338 INFO:teuthology.orchestra.run.smithi138.stdout: "handle_client_session": 4, 2024-09-10T22:38:09.338 INFO:teuthology.orchestra.run.smithi138.stdout: "handle_peer_request": 2, 2024-09-10T22:38:09.338 INFO:teuthology.orchestra.run.smithi138.stdout: "req_create_latency": { 2024-09-10T22:38:09.338 INFO:teuthology.orchestra.run.smithi138.stdout: "avgcount": 0, 2024-09-10T22:38:09.338 INFO:teuthology.orchestra.run.smithi138.stdout: "sum": 0.000000000, 2024-09-10T22:38:09.338 INFO:teuthology.orchestra.run.smithi138.stdout: "avgtime": 0.000000000 2024-09-10T22:38:09.338 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-09-10T22:38:09.338 INFO:teuthology.orchestra.run.smithi138.stdout: "req_getattr_latency": { 2024-09-10T22:38:09.339 INFO:teuthology.orchestra.run.smithi138.stdout: "avgcount": 1, 2024-09-10T22:38:09.339 INFO:teuthology.orchestra.run.smithi138.stdout: "sum": 0.000196815, 2024-09-10T22:38:09.339 INFO:teuthology.orchestra.run.smithi138.stdout: "avgtime": 0.000196815 2024-09-10T22:38:09.339 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-09-10T22:38:09.339 INFO:teuthology.orchestra.run.smithi138.stdout: "req_getfilelock_latency": { 2024-09-10T22:38:09.339 INFO:teuthology.orchestra.run.smithi138.stdout: "avgcount": 0, 2024-09-10T22:38:09.339 INFO:teuthology.orchestra.run.smithi138.stdout: "sum": 0.000000000, 2024-09-10T22:38:09.339 INFO:teuthology.orchestra.run.smithi138.stdout: "avgtime": 0.000000000 2024-09-10T22:38:09.339 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-09-10T22:38:09.339 INFO:teuthology.orchestra.run.smithi138.stdout: "req_link_latency": { 2024-09-10T22:38:09.339 INFO:teuthology.orchestra.run.smithi138.stdout: "avgcount": 0, 2024-09-10T22:38:09.339 INFO:teuthology.orchestra.run.smithi138.stdout: "sum": 0.000000000, 2024-09-10T22:38:09.339 INFO:teuthology.orchestra.run.smithi138.stdout: "avgtime": 0.000000000 2024-09-10T22:38:09.339 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-09-10T22:38:09.340 INFO:teuthology.orchestra.run.smithi138.stdout: "req_lookup_latency": { 2024-09-10T22:38:09.340 INFO:teuthology.orchestra.run.smithi138.stdout: "avgcount": 0, 2024-09-10T22:38:09.340 INFO:teuthology.orchestra.run.smithi138.stdout: "sum": 0.000000000, 2024-09-10T22:38:09.340 INFO:teuthology.orchestra.run.smithi138.stdout: "avgtime": 0.000000000 2024-09-10T22:38:09.340 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-09-10T22:38:09.340 INFO:teuthology.orchestra.run.smithi138.stdout: "req_lookuphash_latency": { 2024-09-10T22:38:09.340 INFO:teuthology.orchestra.run.smithi138.stdout: "avgcount": 0, 2024-09-10T22:38:09.340 INFO:teuthology.orchestra.run.smithi138.stdout: "sum": 0.000000000, 2024-09-10T22:38:09.340 INFO:teuthology.orchestra.run.smithi138.stdout: "avgtime": 0.000000000 2024-09-10T22:38:09.340 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-09-10T22:38:09.340 INFO:teuthology.orchestra.run.smithi138.stdout: "req_lookupino_latency": { 2024-09-10T22:38:09.340 INFO:teuthology.orchestra.run.smithi138.stdout: "avgcount": 0, 2024-09-10T22:38:09.340 INFO:teuthology.orchestra.run.smithi138.stdout: "sum": 0.000000000, 2024-09-10T22:38:09.341 INFO:teuthology.orchestra.run.smithi138.stdout: "avgtime": 0.000000000 2024-09-10T22:38:09.341 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-09-10T22:38:09.341 INFO:teuthology.orchestra.run.smithi138.stdout: "req_lookupname_latency": { 2024-09-10T22:38:09.341 INFO:teuthology.orchestra.run.smithi138.stdout: "avgcount": 0, 2024-09-10T22:38:09.341 INFO:teuthology.orchestra.run.smithi138.stdout: "sum": 0.000000000, 2024-09-10T22:38:09.341 INFO:teuthology.orchestra.run.smithi138.stdout: "avgtime": 0.000000000 2024-09-10T22:38:09.341 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-09-10T22:38:09.341 INFO:teuthology.orchestra.run.smithi138.stdout: "req_lookupparent_latency": { 2024-09-10T22:38:09.341 INFO:teuthology.orchestra.run.smithi138.stdout: "avgcount": 0, 2024-09-10T22:38:09.341 INFO:teuthology.orchestra.run.smithi138.stdout: "sum": 0.000000000, 2024-09-10T22:38:09.341 INFO:teuthology.orchestra.run.smithi138.stdout: "avgtime": 0.000000000 2024-09-10T22:38:09.341 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-09-10T22:38:09.341 INFO:teuthology.orchestra.run.smithi138.stdout: "req_lookupsnap_latency": { 2024-09-10T22:38:09.341 INFO:teuthology.orchestra.run.smithi138.stdout: "avgcount": 0, 2024-09-10T22:38:09.342 INFO:teuthology.orchestra.run.smithi138.stdout: "sum": 0.000000000, 2024-09-10T22:38:09.342 INFO:teuthology.orchestra.run.smithi138.stdout: "avgtime": 0.000000000 2024-09-10T22:38:09.342 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-09-10T22:38:09.342 INFO:teuthology.orchestra.run.smithi138.stdout: "req_lssnap_latency": { 2024-09-10T22:38:09.342 INFO:teuthology.orchestra.run.smithi138.stdout: "avgcount": 0, 2024-09-10T22:38:09.342 INFO:teuthology.orchestra.run.smithi138.stdout: "sum": 0.000000000, 2024-09-10T22:38:09.343 INFO:teuthology.orchestra.run.smithi138.stdout: "avgtime": 0.000000000 2024-09-10T22:38:09.343 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-09-10T22:38:09.343 INFO:teuthology.orchestra.run.smithi138.stdout: "req_mkdir_latency": { 2024-09-10T22:38:09.343 INFO:teuthology.orchestra.run.smithi138.stdout: "avgcount": 0, 2024-09-10T22:38:09.343 INFO:teuthology.orchestra.run.smithi138.stdout: "sum": 0.000000000, 2024-09-10T22:38:09.343 INFO:teuthology.orchestra.run.smithi138.stdout: "avgtime": 0.000000000 2024-09-10T22:38:09.343 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-09-10T22:38:09.343 INFO:teuthology.orchestra.run.smithi138.stdout: "req_mknod_latency": { 2024-09-10T22:38:09.343 INFO:teuthology.orchestra.run.smithi138.stdout: "avgcount": 0, 2024-09-10T22:38:09.343 INFO:teuthology.orchestra.run.smithi138.stdout: "sum": 0.000000000, 2024-09-10T22:38:09.343 INFO:teuthology.orchestra.run.smithi138.stdout: "avgtime": 0.000000000 2024-09-10T22:38:09.343 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-09-10T22:38:09.343 INFO:teuthology.orchestra.run.smithi138.stdout: "req_mksnap_latency": { 2024-09-10T22:38:09.344 INFO:teuthology.orchestra.run.smithi138.stdout: "avgcount": 0, 2024-09-10T22:38:09.344 INFO:teuthology.orchestra.run.smithi138.stdout: "sum": 0.000000000, 2024-09-10T22:38:09.344 INFO:teuthology.orchestra.run.smithi138.stdout: "avgtime": 0.000000000 2024-09-10T22:38:09.344 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-09-10T22:38:09.344 INFO:teuthology.orchestra.run.smithi138.stdout: "req_open_latency": { 2024-09-10T22:38:09.344 INFO:teuthology.orchestra.run.smithi138.stdout: "avgcount": 0, 2024-09-10T22:38:09.344 INFO:teuthology.orchestra.run.smithi138.stdout: "sum": 0.000000000, 2024-09-10T22:38:09.344 INFO:teuthology.orchestra.run.smithi138.stdout: "avgtime": 0.000000000 2024-09-10T22:38:09.344 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-09-10T22:38:09.344 INFO:teuthology.orchestra.run.smithi138.stdout: "req_readdir_latency": { 2024-09-10T22:38:09.344 INFO:teuthology.orchestra.run.smithi138.stdout: "avgcount": 0, 2024-09-10T22:38:09.344 INFO:teuthology.orchestra.run.smithi138.stdout: "sum": 0.000000000, 2024-09-10T22:38:09.344 INFO:teuthology.orchestra.run.smithi138.stdout: "avgtime": 0.000000000 2024-09-10T22:38:09.345 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-09-10T22:38:09.345 INFO:teuthology.orchestra.run.smithi138.stdout: "req_rename_latency": { 2024-09-10T22:38:09.345 INFO:teuthology.orchestra.run.smithi138.stdout: "avgcount": 0, 2024-09-10T22:38:09.345 INFO:teuthology.orchestra.run.smithi138.stdout: "sum": 0.000000000, 2024-09-10T22:38:09.345 INFO:teuthology.orchestra.run.smithi138.stdout: "avgtime": 0.000000000 2024-09-10T22:38:09.345 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-09-10T22:38:09.345 INFO:teuthology.orchestra.run.smithi138.stdout: "req_renamesnap_latency": { 2024-09-10T22:38:09.345 INFO:teuthology.orchestra.run.smithi138.stdout: "avgcount": 0, 2024-09-10T22:38:09.345 INFO:teuthology.orchestra.run.smithi138.stdout: "sum": 0.000000000, 2024-09-10T22:38:09.345 INFO:teuthology.orchestra.run.smithi138.stdout: "avgtime": 0.000000000 2024-09-10T22:38:09.345 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-09-10T22:38:09.345 INFO:teuthology.orchestra.run.smithi138.stdout: "req_snapdiff_latency": { 2024-09-10T22:38:09.345 INFO:teuthology.orchestra.run.smithi138.stdout: "avgcount": 0, 2024-09-10T22:38:09.346 INFO:teuthology.orchestra.run.smithi138.stdout: "sum": 0.000000000, 2024-09-10T22:38:09.346 INFO:teuthology.orchestra.run.smithi138.stdout: "avgtime": 0.000000000 2024-09-10T22:38:09.346 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-09-10T22:38:09.346 INFO:teuthology.orchestra.run.smithi138.stdout: "req_rmdir_latency": { 2024-09-10T22:38:09.346 INFO:teuthology.orchestra.run.smithi138.stdout: "avgcount": 0, 2024-09-10T22:38:09.346 INFO:teuthology.orchestra.run.smithi138.stdout: "sum": 0.000000000, 2024-09-10T22:38:09.346 INFO:teuthology.orchestra.run.smithi138.stdout: "avgtime": 0.000000000 2024-09-10T22:38:09.346 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-09-10T22:38:09.346 INFO:teuthology.orchestra.run.smithi138.stdout: "req_rmsnap_latency": { 2024-09-10T22:38:09.346 INFO:teuthology.orchestra.run.smithi138.stdout: "avgcount": 0, 2024-09-10T22:38:09.346 INFO:teuthology.orchestra.run.smithi138.stdout: "sum": 0.000000000, 2024-09-10T22:38:09.346 INFO:teuthology.orchestra.run.smithi138.stdout: "avgtime": 0.000000000 2024-09-10T22:38:09.346 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-09-10T22:38:09.346 INFO:teuthology.orchestra.run.smithi138.stdout: "req_rmxattr_latency": { 2024-09-10T22:38:09.346 INFO:teuthology.orchestra.run.smithi138.stdout: "avgcount": 0, 2024-09-10T22:38:09.347 INFO:teuthology.orchestra.run.smithi138.stdout: "sum": 0.000000000, 2024-09-10T22:38:09.347 INFO:teuthology.orchestra.run.smithi138.stdout: "avgtime": 0.000000000 2024-09-10T22:38:09.347 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-09-10T22:38:09.347 INFO:teuthology.orchestra.run.smithi138.stdout: "req_setattr_latency": { 2024-09-10T22:38:09.347 INFO:teuthology.orchestra.run.smithi138.stdout: "avgcount": 0, 2024-09-10T22:38:09.347 INFO:teuthology.orchestra.run.smithi138.stdout: "sum": 0.000000000, 2024-09-10T22:38:09.347 INFO:teuthology.orchestra.run.smithi138.stdout: "avgtime": 0.000000000 2024-09-10T22:38:09.347 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-09-10T22:38:09.347 INFO:teuthology.orchestra.run.smithi138.stdout: "req_setdirlayout_latency": { 2024-09-10T22:38:09.347 INFO:teuthology.orchestra.run.smithi138.stdout: "avgcount": 0, 2024-09-10T22:38:09.347 INFO:teuthology.orchestra.run.smithi138.stdout: "sum": 0.000000000, 2024-09-10T22:38:09.347 INFO:teuthology.orchestra.run.smithi138.stdout: "avgtime": 0.000000000 2024-09-10T22:38:09.347 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-09-10T22:38:09.348 INFO:teuthology.orchestra.run.smithi138.stdout: "req_setfilelock_latency": { 2024-09-10T22:38:09.348 INFO:teuthology.orchestra.run.smithi138.stdout: "avgcount": 0, 2024-09-10T22:38:09.348 INFO:teuthology.orchestra.run.smithi138.stdout: "sum": 0.000000000, 2024-09-10T22:38:09.348 INFO:teuthology.orchestra.run.smithi138.stdout: "avgtime": 0.000000000 2024-09-10T22:38:09.348 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-09-10T22:38:09.348 INFO:teuthology.orchestra.run.smithi138.stdout: "req_setlayout_latency": { 2024-09-10T22:38:09.348 INFO:teuthology.orchestra.run.smithi138.stdout: "avgcount": 0, 2024-09-10T22:38:09.348 INFO:teuthology.orchestra.run.smithi138.stdout: "sum": 0.000000000, 2024-09-10T22:38:09.348 INFO:teuthology.orchestra.run.smithi138.stdout: "avgtime": 0.000000000 2024-09-10T22:38:09.348 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-09-10T22:38:09.348 INFO:teuthology.orchestra.run.smithi138.stdout: "req_setxattr_latency": { 2024-09-10T22:38:09.348 INFO:teuthology.orchestra.run.smithi138.stdout: "avgcount": 0, 2024-09-10T22:38:09.348 INFO:teuthology.orchestra.run.smithi138.stdout: "sum": 0.000000000, 2024-09-10T22:38:09.349 INFO:teuthology.orchestra.run.smithi138.stdout: "avgtime": 0.000000000 2024-09-10T22:38:09.349 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-09-10T22:38:09.349 INFO:teuthology.orchestra.run.smithi138.stdout: "req_symlink_latency": { 2024-09-10T22:38:09.349 INFO:teuthology.orchestra.run.smithi138.stdout: "avgcount": 0, 2024-09-10T22:38:09.349 INFO:teuthology.orchestra.run.smithi138.stdout: "sum": 0.000000000, 2024-09-10T22:38:09.349 INFO:teuthology.orchestra.run.smithi138.stdout: "avgtime": 0.000000000 2024-09-10T22:38:09.349 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-09-10T22:38:09.349 INFO:teuthology.orchestra.run.smithi138.stdout: "req_unlink_latency": { 2024-09-10T22:38:09.349 INFO:teuthology.orchestra.run.smithi138.stdout: "avgcount": 0, 2024-09-10T22:38:09.349 INFO:teuthology.orchestra.run.smithi138.stdout: "sum": 0.000000000, 2024-09-10T22:38:09.349 INFO:teuthology.orchestra.run.smithi138.stdout: "avgtime": 0.000000000 2024-09-10T22:38:09.349 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-09-10T22:38:09.349 INFO:teuthology.orchestra.run.smithi138.stdout: "cap_revoke_eviction": 0, 2024-09-10T22:38:09.350 INFO:teuthology.orchestra.run.smithi138.stdout: "cap_acquisition_throttle": 0, 2024-09-10T22:38:09.350 INFO:teuthology.orchestra.run.smithi138.stdout: "req_getvxattr_latency": { 2024-09-10T22:38:09.350 INFO:teuthology.orchestra.run.smithi138.stdout: "avgcount": 0, 2024-09-10T22:38:09.350 INFO:teuthology.orchestra.run.smithi138.stdout: "sum": 0.000000000, 2024-09-10T22:38:09.350 INFO:teuthology.orchestra.run.smithi138.stdout: "avgtime": 0.000000000 2024-09-10T22:38:09.350 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-09-10T22:38:09.350 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-09-10T22:38:09.350 INFO:teuthology.orchestra.run.smithi138.stdout: "mds_sessions": { 2024-09-10T22:38:09.350 INFO:teuthology.orchestra.run.smithi138.stdout: "session_count": 0, 2024-09-10T22:38:09.350 INFO:teuthology.orchestra.run.smithi138.stdout: "session_add": 1, 2024-09-10T22:38:09.350 INFO:teuthology.orchestra.run.smithi138.stdout: "session_remove": 1, 2024-09-10T22:38:09.350 INFO:teuthology.orchestra.run.smithi138.stdout: "sessions_open": 0, 2024-09-10T22:38:09.350 INFO:teuthology.orchestra.run.smithi138.stdout: "sessions_stale": 0, 2024-09-10T22:38:09.351 INFO:teuthology.orchestra.run.smithi138.stdout: "total_load": 1, 2024-09-10T22:38:09.351 INFO:teuthology.orchestra.run.smithi138.stdout: "average_load": 1, 2024-09-10T22:38:09.351 INFO:teuthology.orchestra.run.smithi138.stdout: "avg_session_uptime": 87, 2024-09-10T22:38:09.351 INFO:teuthology.orchestra.run.smithi138.stdout: "mdthresh_evicted": 0 2024-09-10T22:38:09.351 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-09-10T22:38:09.351 INFO:teuthology.orchestra.run.smithi138.stdout: "mempool": { 2024-09-10T22:38:09.351 INFO:teuthology.orchestra.run.smithi138.stdout: "bloom_filter_bytes": 0, 2024-09-10T22:38:09.351 INFO:teuthology.orchestra.run.smithi138.stdout: "bloom_filter_items": 0, 2024-09-10T22:38:09.351 INFO:teuthology.orchestra.run.smithi138.stdout: "bluestore_alloc_bytes": 0, 2024-09-10T22:38:09.351 INFO:teuthology.orchestra.run.smithi138.stdout: "bluestore_alloc_items": 0, 2024-09-10T22:38:09.351 INFO:teuthology.orchestra.run.smithi138.stdout: "bluestore_cache_data_bytes": 0, 2024-09-10T22:38:09.351 INFO:teuthology.orchestra.run.smithi138.stdout: "bluestore_cache_data_items": 0, 2024-09-10T22:38:09.351 INFO:teuthology.orchestra.run.smithi138.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-10T22:38:09.351 INFO:teuthology.orchestra.run.smithi138.stdout: "bluestore_cache_onode_items": 0, 2024-09-10T22:38:09.351 INFO:teuthology.orchestra.run.smithi138.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-10T22:38:09.352 INFO:teuthology.orchestra.run.smithi138.stdout: "bluestore_cache_meta_items": 0, 2024-09-10T22:38:09.352 INFO:teuthology.orchestra.run.smithi138.stdout: "bluestore_cache_other_bytes": 0, 2024-09-10T22:38:09.352 INFO:teuthology.orchestra.run.smithi138.stdout: "bluestore_cache_other_items": 0, 2024-09-10T22:38:09.352 INFO:teuthology.orchestra.run.smithi138.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-10T22:38:09.352 INFO:teuthology.orchestra.run.smithi138.stdout: "bluestore_cache_buffer_items": 0, 2024-09-10T22:38:09.352 INFO:teuthology.orchestra.run.smithi138.stdout: "bluestore_extent_bytes": 0, 2024-09-10T22:38:09.352 INFO:teuthology.orchestra.run.smithi138.stdout: "bluestore_extent_items": 0, 2024-09-10T22:38:09.352 INFO:teuthology.orchestra.run.smithi138.stdout: "bluestore_blob_bytes": 0, 2024-09-10T22:38:09.352 INFO:teuthology.orchestra.run.smithi138.stdout: "bluestore_blob_items": 0, 2024-09-10T22:38:09.352 INFO:teuthology.orchestra.run.smithi138.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-10T22:38:09.352 INFO:teuthology.orchestra.run.smithi138.stdout: "bluestore_shared_blob_items": 0, 2024-09-10T22:38:09.352 INFO:teuthology.orchestra.run.smithi138.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-10T22:38:09.352 INFO:teuthology.orchestra.run.smithi138.stdout: "bluestore_inline_bl_items": 0, 2024-09-10T22:38:09.352 INFO:teuthology.orchestra.run.smithi138.stdout: "bluestore_fsck_bytes": 0, 2024-09-10T22:38:09.353 INFO:teuthology.orchestra.run.smithi138.stdout: "bluestore_fsck_items": 0, 2024-09-10T22:38:09.353 INFO:teuthology.orchestra.run.smithi138.stdout: "bluestore_txc_bytes": 0, 2024-09-10T22:38:09.353 INFO:teuthology.orchestra.run.smithi138.stdout: "bluestore_txc_items": 0, 2024-09-10T22:38:09.353 INFO:teuthology.orchestra.run.smithi138.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-10T22:38:09.353 INFO:teuthology.orchestra.run.smithi138.stdout: "bluestore_writing_deferred_items": 0, 2024-09-10T22:38:09.353 INFO:teuthology.orchestra.run.smithi138.stdout: "bluestore_writing_bytes": 0, 2024-09-10T22:38:09.353 INFO:teuthology.orchestra.run.smithi138.stdout: "bluestore_writing_items": 0, 2024-09-10T22:38:09.353 INFO:teuthology.orchestra.run.smithi138.stdout: "bluefs_bytes": 0, 2024-09-10T22:38:09.353 INFO:teuthology.orchestra.run.smithi138.stdout: "bluefs_items": 0, 2024-09-10T22:38:09.353 INFO:teuthology.orchestra.run.smithi138.stdout: "bluefs_file_reader_bytes": 0, 2024-09-10T22:38:09.353 INFO:teuthology.orchestra.run.smithi138.stdout: "bluefs_file_reader_items": 0, 2024-09-10T22:38:09.353 INFO:teuthology.orchestra.run.smithi138.stdout: "bluefs_file_writer_bytes": 0, 2024-09-10T22:38:09.353 INFO:teuthology.orchestra.run.smithi138.stdout: "bluefs_file_writer_items": 0, 2024-09-10T22:38:09.353 INFO:teuthology.orchestra.run.smithi138.stdout: "buffer_anon_bytes": 250351, 2024-09-10T22:38:09.354 INFO:teuthology.orchestra.run.smithi138.stdout: "buffer_anon_items": 82, 2024-09-10T22:38:09.354 INFO:teuthology.orchestra.run.smithi138.stdout: "buffer_meta_bytes": 0, 2024-09-10T22:38:09.354 INFO:teuthology.orchestra.run.smithi138.stdout: "buffer_meta_items": 0, 2024-09-10T22:38:09.354 INFO:teuthology.orchestra.run.smithi138.stdout: "osd_bytes": 0, 2024-09-10T22:38:09.354 INFO:teuthology.orchestra.run.smithi138.stdout: "osd_items": 0, 2024-09-10T22:38:09.354 INFO:teuthology.orchestra.run.smithi138.stdout: "osd_mapbl_bytes": 0, 2024-09-10T22:38:09.354 INFO:teuthology.orchestra.run.smithi138.stdout: "osd_mapbl_items": 0, 2024-09-10T22:38:09.354 INFO:teuthology.orchestra.run.smithi138.stdout: "osd_pglog_bytes": 0, 2024-09-10T22:38:09.354 INFO:teuthology.orchestra.run.smithi138.stdout: "osd_pglog_items": 0, 2024-09-10T22:38:09.354 INFO:teuthology.orchestra.run.smithi138.stdout: "osdmap_bytes": 7880, 2024-09-10T22:38:09.354 INFO:teuthology.orchestra.run.smithi138.stdout: "osdmap_items": 162, 2024-09-10T22:38:09.354 INFO:teuthology.orchestra.run.smithi138.stdout: "osdmap_mapping_bytes": 0, 2024-09-10T22:38:09.354 INFO:teuthology.orchestra.run.smithi138.stdout: "osdmap_mapping_items": 0, 2024-09-10T22:38:09.355 INFO:teuthology.orchestra.run.smithi138.stdout: "pgmap_bytes": 0, 2024-09-10T22:38:09.355 INFO:teuthology.orchestra.run.smithi138.stdout: "pgmap_items": 0, 2024-09-10T22:38:09.355 INFO:teuthology.orchestra.run.smithi138.stdout: "mds_co_bytes": 81397, 2024-09-10T22:38:09.355 INFO:teuthology.orchestra.run.smithi138.stdout: "mds_co_items": 324, 2024-09-10T22:38:09.355 INFO:teuthology.orchestra.run.smithi138.stdout: "unittest_1_bytes": 0, 2024-09-10T22:38:09.355 INFO:teuthology.orchestra.run.smithi138.stdout: "unittest_1_items": 0, 2024-09-10T22:38:09.355 INFO:teuthology.orchestra.run.smithi138.stdout: "unittest_2_bytes": 0, 2024-09-10T22:38:09.355 INFO:teuthology.orchestra.run.smithi138.stdout: "unittest_2_items": 0 2024-09-10T22:38:09.355 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-09-10T22:38:09.355 INFO:teuthology.orchestra.run.smithi138.stdout: "objecter": { 2024-09-10T22:38:09.355 INFO:teuthology.orchestra.run.smithi138.stdout: "op_active": 0, 2024-09-10T22:38:09.355 INFO:teuthology.orchestra.run.smithi138.stdout: "op_laggy": 0, 2024-09-10T22:38:09.355 INFO:teuthology.orchestra.run.smithi138.stdout: "op_send": 38, 2024-09-10T22:38:09.355 INFO:teuthology.orchestra.run.smithi138.stdout: "op_send_bytes": 11332, 2024-09-10T22:38:09.356 INFO:teuthology.orchestra.run.smithi138.stdout: "op_resend": 32, 2024-09-10T22:38:09.356 INFO:teuthology.orchestra.run.smithi138.stdout: "op_reply": 38, 2024-09-10T22:38:09.356 INFO:teuthology.orchestra.run.smithi138.stdout: "op_latency": { 2024-09-10T22:38:09.356 INFO:teuthology.orchestra.run.smithi138.stdout: "avgcount": 38, 2024-09-10T22:38:09.356 INFO:teuthology.orchestra.run.smithi138.stdout: "sum": 0.198995907, 2024-09-10T22:38:09.356 INFO:teuthology.orchestra.run.smithi138.stdout: "avgtime": 0.005236734 2024-09-10T22:38:09.356 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-09-10T22:38:09.356 INFO:teuthology.orchestra.run.smithi138.stdout: "op_inflight": 0, 2024-09-10T22:38:09.356 INFO:teuthology.orchestra.run.smithi138.stdout: "oplen_avg": { 2024-09-10T22:38:09.356 INFO:teuthology.orchestra.run.smithi138.stdout: "avgcount": 38, 2024-09-10T22:38:09.356 INFO:teuthology.orchestra.run.smithi138.stdout: "sum": 60 2024-09-10T22:38:09.356 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-09-10T22:38:09.357 INFO:teuthology.orchestra.run.smithi138.stdout: "op": 38, 2024-09-10T22:38:09.357 INFO:teuthology.orchestra.run.smithi138.stdout: "op_r": 0, 2024-09-10T22:38:09.357 INFO:teuthology.orchestra.run.smithi138.stdout: "op_w": 38, 2024-09-10T22:38:09.357 INFO:teuthology.orchestra.run.smithi138.stdout: "op_rmw": 0, 2024-09-10T22:38:09.357 INFO:teuthology.orchestra.run.smithi138.stdout: "op_pg": 0, 2024-09-10T22:38:09.357 INFO:teuthology.orchestra.run.smithi138.stdout: "osdop_stat": 0, 2024-09-10T22:38:09.357 INFO:teuthology.orchestra.run.smithi138.stdout: "osdop_create": 10, 2024-09-10T22:38:09.357 INFO:teuthology.orchestra.run.smithi138.stdout: "osdop_read": 0, 2024-09-10T22:38:09.357 INFO:teuthology.orchestra.run.smithi138.stdout: "osdop_write": 3, 2024-09-10T22:38:09.357 INFO:teuthology.orchestra.run.smithi138.stdout: "osdop_writefull": 6, 2024-09-10T22:38:09.357 INFO:teuthology.orchestra.run.smithi138.stdout: "osdop_writesame": 0, 2024-09-10T22:38:09.357 INFO:teuthology.orchestra.run.smithi138.stdout: "osdop_append": 0, 2024-09-10T22:38:09.357 INFO:teuthology.orchestra.run.smithi138.stdout: "osdop_zero": 0, 2024-09-10T22:38:09.358 INFO:teuthology.orchestra.run.smithi138.stdout: "osdop_truncate": 0, 2024-09-10T22:38:09.358 INFO:teuthology.orchestra.run.smithi138.stdout: "osdop_delete": 6, 2024-09-10T22:38:09.358 INFO:teuthology.orchestra.run.smithi138.stdout: "osdop_mapext": 0, 2024-09-10T22:38:09.358 INFO:teuthology.orchestra.run.smithi138.stdout: "osdop_sparse_read": 0, 2024-09-10T22:38:09.358 INFO:teuthology.orchestra.run.smithi138.stdout: "osdop_clonerange": 0, 2024-09-10T22:38:09.358 INFO:teuthology.orchestra.run.smithi138.stdout: "osdop_getxattr": 0, 2024-09-10T22:38:09.358 INFO:teuthology.orchestra.run.smithi138.stdout: "osdop_setxattr": 20, 2024-09-10T22:38:09.358 INFO:teuthology.orchestra.run.smithi138.stdout: "osdop_cmpxattr": 0, 2024-09-10T22:38:09.358 INFO:teuthology.orchestra.run.smithi138.stdout: "osdop_rmxattr": 0, 2024-09-10T22:38:09.358 INFO:teuthology.orchestra.run.smithi138.stdout: "osdop_resetxattrs": 0, 2024-09-10T22:38:09.358 INFO:teuthology.orchestra.run.smithi138.stdout: "osdop_call": 0, 2024-09-10T22:38:09.358 INFO:teuthology.orchestra.run.smithi138.stdout: "osdop_watch": 0, 2024-09-10T22:38:09.358 INFO:teuthology.orchestra.run.smithi138.stdout: "osdop_notify": 0, 2024-09-10T22:38:09.358 INFO:teuthology.orchestra.run.smithi138.stdout: "osdop_src_cmpxattr": 0, 2024-09-10T22:38:09.359 INFO:teuthology.orchestra.run.smithi138.stdout: "osdop_pgls": 0, 2024-09-10T22:38:09.359 INFO:teuthology.orchestra.run.smithi138.stdout: "osdop_pgls_filter": 0, 2024-09-10T22:38:09.359 INFO:teuthology.orchestra.run.smithi138.stdout: "osdop_other": 0, 2024-09-10T22:38:09.359 INFO:teuthology.orchestra.run.smithi138.stdout: "linger_active": 0, 2024-09-10T22:38:09.359 INFO:teuthology.orchestra.run.smithi138.stdout: "linger_send": 0, 2024-09-10T22:38:09.359 INFO:teuthology.orchestra.run.smithi138.stdout: "linger_resend": 0, 2024-09-10T22:38:09.359 INFO:teuthology.orchestra.run.smithi138.stdout: "linger_ping": 0, 2024-09-10T22:38:09.359 INFO:teuthology.orchestra.run.smithi138.stdout: "poolop_active": 0, 2024-09-10T22:38:09.359 INFO:teuthology.orchestra.run.smithi138.stdout: "poolop_send": 0, 2024-09-10T22:38:09.359 INFO:teuthology.orchestra.run.smithi138.stdout: "poolop_resend": 0, 2024-09-10T22:38:09.359 INFO:teuthology.orchestra.run.smithi138.stdout: "poolstat_active": 0, 2024-09-10T22:38:09.359 INFO:teuthology.orchestra.run.smithi138.stdout: "poolstat_send": 0, 2024-09-10T22:38:09.359 INFO:teuthology.orchestra.run.smithi138.stdout: "poolstat_resend": 0, 2024-09-10T22:38:09.360 INFO:teuthology.orchestra.run.smithi138.stdout: "statfs_active": 0, 2024-09-10T22:38:09.360 INFO:teuthology.orchestra.run.smithi138.stdout: "statfs_send": 0, 2024-09-10T22:38:09.360 INFO:teuthology.orchestra.run.smithi138.stdout: "statfs_resend": 0, 2024-09-10T22:38:09.360 INFO:teuthology.orchestra.run.smithi138.stdout: "command_active": 0, 2024-09-10T22:38:09.360 INFO:teuthology.orchestra.run.smithi138.stdout: "command_send": 0, 2024-09-10T22:38:09.360 INFO:teuthology.orchestra.run.smithi138.stdout: "command_resend": 0, 2024-09-10T22:38:09.360 INFO:teuthology.orchestra.run.smithi138.stdout: "map_epoch": 77, 2024-09-10T22:38:09.360 INFO:teuthology.orchestra.run.smithi138.stdout: "map_full": 0, 2024-09-10T22:38:09.360 INFO:teuthology.orchestra.run.smithi138.stdout: "map_inc": 4, 2024-09-10T22:38:09.360 INFO:teuthology.orchestra.run.smithi138.stdout: "osd_sessions": 8, 2024-09-10T22:38:09.360 INFO:teuthology.orchestra.run.smithi138.stdout: "osd_session_open": 8, 2024-09-10T22:38:09.360 INFO:teuthology.orchestra.run.smithi138.stdout: "osd_session_close": 0, 2024-09-10T22:38:09.360 INFO:teuthology.orchestra.run.smithi138.stdout: "osd_laggy": 0, 2024-09-10T22:38:09.361 INFO:teuthology.orchestra.run.smithi138.stdout: "omap_wr": 14, 2024-09-10T22:38:09.361 INFO:teuthology.orchestra.run.smithi138.stdout: "omap_rd": 0, 2024-09-10T22:38:09.361 INFO:teuthology.orchestra.run.smithi138.stdout: "omap_del": 1 2024-09-10T22:38:09.361 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-09-10T22:38:09.361 INFO:teuthology.orchestra.run.smithi138.stdout: "oft": { 2024-09-10T22:38:09.361 INFO:teuthology.orchestra.run.smithi138.stdout: "omap_total_objs": 1, 2024-09-10T22:38:09.361 INFO:teuthology.orchestra.run.smithi138.stdout: "omap_total_kv_pairs": 0, 2024-09-10T22:38:09.361 INFO:teuthology.orchestra.run.smithi138.stdout: "omap_total_updates": 0, 2024-09-10T22:38:09.361 INFO:teuthology.orchestra.run.smithi138.stdout: "omap_total_removes": 0 2024-09-10T22:38:09.361 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-09-10T22:38:09.361 INFO:teuthology.orchestra.run.smithi138.stdout: "purge_queue": { 2024-09-10T22:38:09.361 INFO:teuthology.orchestra.run.smithi138.stdout: "pq_executing_ops": 0, 2024-09-10T22:38:09.361 INFO:teuthology.orchestra.run.smithi138.stdout: "pq_executing_ops_high_water": 0, 2024-09-10T22:38:09.362 INFO:teuthology.orchestra.run.smithi138.stdout: "pq_executing": 0, 2024-09-10T22:38:09.362 INFO:teuthology.orchestra.run.smithi138.stdout: "pq_executing_high_water": 0, 2024-09-10T22:38:09.362 INFO:teuthology.orchestra.run.smithi138.stdout: "pq_executed_ops": 0, 2024-09-10T22:38:09.362 INFO:teuthology.orchestra.run.smithi138.stdout: "pq_executed": 0, 2024-09-10T22:38:09.362 INFO:teuthology.orchestra.run.smithi138.stdout: "pq_item_in_journal": 0 2024-09-10T22:38:09.362 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-09-10T22:38:09.362 INFO:teuthology.orchestra.run.smithi138.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-10T22:38:09.362 INFO:teuthology.orchestra.run.smithi138.stdout: "val": 0, 2024-09-10T22:38:09.362 INFO:teuthology.orchestra.run.smithi138.stdout: "max": 104857600, 2024-09-10T22:38:09.362 INFO:teuthology.orchestra.run.smithi138.stdout: "get_started": 0, 2024-09-10T22:38:09.362 INFO:teuthology.orchestra.run.smithi138.stdout: "get": 2000, 2024-09-10T22:38:09.362 INFO:teuthology.orchestra.run.smithi138.stdout: "get_sum": 828988, 2024-09-10T22:38:09.362 INFO:teuthology.orchestra.run.smithi138.stdout: "get_or_fail_fail": 0, 2024-09-10T22:38:09.362 INFO:teuthology.orchestra.run.smithi138.stdout: "get_or_fail_success": 2000, 2024-09-10T22:38:09.363 INFO:teuthology.orchestra.run.smithi138.stdout: "take": 0, 2024-09-10T22:38:09.363 INFO:teuthology.orchestra.run.smithi138.stdout: "take_sum": 0, 2024-09-10T22:38:09.363 INFO:teuthology.orchestra.run.smithi138.stdout: "put": 2000, 2024-09-10T22:38:09.363 INFO:teuthology.orchestra.run.smithi138.stdout: "put_sum": 828988, 2024-09-10T22:38:09.363 INFO:teuthology.orchestra.run.smithi138.stdout: "wait": { 2024-09-10T22:38:09.363 INFO:teuthology.orchestra.run.smithi138.stdout: "avgcount": 0, 2024-09-10T22:38:09.363 INFO:teuthology.orchestra.run.smithi138.stdout: "sum": 0.000000000, 2024-09-10T22:38:09.363 INFO:teuthology.orchestra.run.smithi138.stdout: "avgtime": 0.000000000 2024-09-10T22:38:09.363 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-09-10T22:38:09.363 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-09-10T22:38:09.363 INFO:teuthology.orchestra.run.smithi138.stdout: "throttle-objecter_bytes": { 2024-09-10T22:38:09.363 INFO:teuthology.orchestra.run.smithi138.stdout: "val": 0, 2024-09-10T22:38:09.363 INFO:teuthology.orchestra.run.smithi138.stdout: "max": 104857600, 2024-09-10T22:38:09.364 INFO:teuthology.orchestra.run.smithi138.stdout: "get_started": 0, 2024-09-10T22:38:09.364 INFO:teuthology.orchestra.run.smithi138.stdout: "get": 0, 2024-09-10T22:38:09.364 INFO:teuthology.orchestra.run.smithi138.stdout: "get_sum": 0, 2024-09-10T22:38:09.364 INFO:teuthology.orchestra.run.smithi138.stdout: "get_or_fail_fail": 0, 2024-09-10T22:38:09.364 INFO:teuthology.orchestra.run.smithi138.stdout: "get_or_fail_success": 0, 2024-09-10T22:38:09.364 INFO:teuthology.orchestra.run.smithi138.stdout: "take": 38, 2024-09-10T22:38:09.364 INFO:teuthology.orchestra.run.smithi138.stdout: "take_sum": 11332, 2024-09-10T22:38:09.364 INFO:teuthology.orchestra.run.smithi138.stdout: "put": 38, 2024-09-10T22:38:09.364 INFO:teuthology.orchestra.run.smithi138.stdout: "put_sum": 11332, 2024-09-10T22:38:09.364 INFO:teuthology.orchestra.run.smithi138.stdout: "wait": { 2024-09-10T22:38:09.364 INFO:teuthology.orchestra.run.smithi138.stdout: "avgcount": 0, 2024-09-10T22:38:09.364 INFO:teuthology.orchestra.run.smithi138.stdout: "sum": 0.000000000, 2024-09-10T22:38:09.364 INFO:teuthology.orchestra.run.smithi138.stdout: "avgtime": 0.000000000 2024-09-10T22:38:09.365 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-09-10T22:38:09.365 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-09-10T22:38:09.365 INFO:teuthology.orchestra.run.smithi138.stdout: "throttle-objecter_ops": { 2024-09-10T22:38:09.365 INFO:teuthology.orchestra.run.smithi138.stdout: "val": 0, 2024-09-10T22:38:09.365 INFO:teuthology.orchestra.run.smithi138.stdout: "max": 1024, 2024-09-10T22:38:09.365 INFO:teuthology.orchestra.run.smithi138.stdout: "get_started": 0, 2024-09-10T22:38:09.365 INFO:teuthology.orchestra.run.smithi138.stdout: "get": 0, 2024-09-10T22:38:09.365 INFO:teuthology.orchestra.run.smithi138.stdout: "get_sum": 0, 2024-09-10T22:38:09.365 INFO:teuthology.orchestra.run.smithi138.stdout: "get_or_fail_fail": 0, 2024-09-10T22:38:09.365 INFO:teuthology.orchestra.run.smithi138.stdout: "get_or_fail_success": 0, 2024-09-10T22:38:09.365 INFO:teuthology.orchestra.run.smithi138.stdout: "take": 38, 2024-09-10T22:38:09.365 INFO:teuthology.orchestra.run.smithi138.stdout: "take_sum": 38, 2024-09-10T22:38:09.365 INFO:teuthology.orchestra.run.smithi138.stdout: "put": 38, 2024-09-10T22:38:09.366 INFO:teuthology.orchestra.run.smithi138.stdout: "put_sum": 38, 2024-09-10T22:38:09.366 INFO:teuthology.orchestra.run.smithi138.stdout: "wait": { 2024-09-10T22:38:09.366 INFO:teuthology.orchestra.run.smithi138.stdout: "avgcount": 0, 2024-09-10T22:38:09.366 INFO:teuthology.orchestra.run.smithi138.stdout: "sum": 0.000000000, 2024-09-10T22:38:09.366 INFO:teuthology.orchestra.run.smithi138.stdout: "avgtime": 0.000000000 2024-09-10T22:38:09.366 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-09-10T22:38:09.366 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-09-10T22:38:09.366 INFO:teuthology.orchestra.run.smithi138.stdout: "throttle-write_buf_throttle": { 2024-09-10T22:38:09.366 INFO:teuthology.orchestra.run.smithi138.stdout: "val": 0, 2024-09-10T22:38:09.366 INFO:teuthology.orchestra.run.smithi138.stdout: "max": 3758096384, 2024-09-10T22:38:09.366 INFO:teuthology.orchestra.run.smithi138.stdout: "get_started": 0, 2024-09-10T22:38:09.366 INFO:teuthology.orchestra.run.smithi138.stdout: "get": 0, 2024-09-10T22:38:09.366 INFO:teuthology.orchestra.run.smithi138.stdout: "get_sum": 0, 2024-09-10T22:38:09.367 INFO:teuthology.orchestra.run.smithi138.stdout: "get_or_fail_fail": 0, 2024-09-10T22:38:09.367 INFO:teuthology.orchestra.run.smithi138.stdout: "get_or_fail_success": 0, 2024-09-10T22:38:09.367 INFO:teuthology.orchestra.run.smithi138.stdout: "take": 0, 2024-09-10T22:38:09.367 INFO:teuthology.orchestra.run.smithi138.stdout: "take_sum": 0, 2024-09-10T22:38:09.367 INFO:teuthology.orchestra.run.smithi138.stdout: "put": 0, 2024-09-10T22:38:09.367 INFO:teuthology.orchestra.run.smithi138.stdout: "put_sum": 0, 2024-09-10T22:38:09.367 INFO:teuthology.orchestra.run.smithi138.stdout: "wait": { 2024-09-10T22:38:09.367 INFO:teuthology.orchestra.run.smithi138.stdout: "avgcount": 0, 2024-09-10T22:38:09.367 INFO:teuthology.orchestra.run.smithi138.stdout: "sum": 0.000000000, 2024-09-10T22:38:09.367 INFO:teuthology.orchestra.run.smithi138.stdout: "avgtime": 0.000000000 2024-09-10T22:38:09.367 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-09-10T22:38:09.367 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-09-10T22:38:09.367 INFO:teuthology.orchestra.run.smithi138.stdout: "throttle-write_buf_throttle-0x556af81c2dc0": { 2024-09-10T22:38:09.368 INFO:teuthology.orchestra.run.smithi138.stdout: "val": 0, 2024-09-10T22:38:09.368 INFO:teuthology.orchestra.run.smithi138.stdout: "max": 3758096384, 2024-09-10T22:38:09.368 INFO:teuthology.orchestra.run.smithi138.stdout: "get_started": 0, 2024-09-10T22:38:09.368 INFO:teuthology.orchestra.run.smithi138.stdout: "get": 4, 2024-09-10T22:38:09.368 INFO:teuthology.orchestra.run.smithi138.stdout: "get_sum": 1120, 2024-09-10T22:38:09.368 INFO:teuthology.orchestra.run.smithi138.stdout: "get_or_fail_fail": 0, 2024-09-10T22:38:09.368 INFO:teuthology.orchestra.run.smithi138.stdout: "get_or_fail_success": 4, 2024-09-10T22:38:09.368 INFO:teuthology.orchestra.run.smithi138.stdout: "take": 0, 2024-09-10T22:38:09.368 INFO:teuthology.orchestra.run.smithi138.stdout: "take_sum": 0, 2024-09-10T22:38:09.368 INFO:teuthology.orchestra.run.smithi138.stdout: "put": 3, 2024-09-10T22:38:09.368 INFO:teuthology.orchestra.run.smithi138.stdout: "put_sum": 1120, 2024-09-10T22:38:09.368 INFO:teuthology.orchestra.run.smithi138.stdout: "wait": { 2024-09-10T22:38:09.368 INFO:teuthology.orchestra.run.smithi138.stdout: "avgcount": 0, 2024-09-10T22:38:09.369 INFO:teuthology.orchestra.run.smithi138.stdout: "sum": 0.000000000, 2024-09-10T22:38:09.369 INFO:teuthology.orchestra.run.smithi138.stdout: "avgtime": 0.000000000 2024-09-10T22:38:09.369 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-09-10T22:38:09.369 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-09-10T22:38:09.369 INFO:teuthology.orchestra.run.smithi138.stdout: "trackedop": { 2024-09-10T22:38:09.369 INFO:teuthology.orchestra.run.smithi138.stdout: "slow_ops_count": 0 2024-09-10T22:38:09.369 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-09-10T22:38:09.369 INFO:teuthology.orchestra.run.smithi138.stdout:} 2024-09-10T22:38:10.097 INFO:tasks.check_counter:Daemon mds.c mds.exported=0 2024-09-10T22:38:10.098 INFO:tasks.check_counter:Daemon mds.c mds.imported=0 2024-09-10T22:38:10.098 INFO:tasks.check_counter:Daemon mds.c mds_cache.dir_update=0 2024-09-10T22:38:10.098 INFO:tasks.check_counter:Daemon mds.c mds_cache.dir_update_receipt=12 2024-09-10T22:38:10.098 DEBUG:tasks.check_counter:Getting stats from f 2024-09-10T22:38:10.098 DEBUG:teuthology.orchestra.run.smithi138:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 22997a4c-6fc2-11ef-bcea-c7b262605968 -- ceph daemon mds.f perf dump 2024-09-10T22:38:10.351 INFO:teuthology.orchestra.run.smithi138.stderr:Inferring config /var/lib/ceph/22997a4c-6fc2-11ef-bcea-c7b262605968/mon.c/config 2024-09-10T22:38:10.360 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:38:10 smithi135 ceph-mon[34789]: pgmap v699: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 35 MiB/s wr, 341 op/s 2024-09-10T22:38:10.375 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:38:10 smithi138 ceph-mon[35236]: pgmap v699: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 35 MiB/s wr, 341 op/s 2024-09-10T22:38:10.458 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:38:10 smithi019 ceph-mon[31375]: pgmap v699: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 35 MiB/s wr, 341 op/s 2024-09-10T22:38:10.881 INFO:teuthology.orchestra.run.smithi138.stdout:{ 2024-09-10T22:38:10.881 INFO:teuthology.orchestra.run.smithi138.stdout: "AsyncMessenger::Worker-0": { 2024-09-10T22:38:10.881 INFO:teuthology.orchestra.run.smithi138.stdout: "msgr_recv_messages": 2370, 2024-09-10T22:38:10.881 INFO:teuthology.orchestra.run.smithi138.stdout: "msgr_send_messages": 2371, 2024-09-10T22:38:10.882 INFO:teuthology.orchestra.run.smithi138.stdout: "msgr_recv_bytes": 696328, 2024-09-10T22:38:10.882 INFO:teuthology.orchestra.run.smithi138.stdout: "msgr_send_bytes": 753349, 2024-09-10T22:38:10.882 INFO:teuthology.orchestra.run.smithi138.stdout: "msgr_created_connections": 6, 2024-09-10T22:38:10.882 INFO:teuthology.orchestra.run.smithi138.stdout: "msgr_active_connections": 2, 2024-09-10T22:38:10.882 INFO:teuthology.orchestra.run.smithi138.stdout: "msgr_running_total_time": 0.213544330, 2024-09-10T22:38:10.882 INFO:teuthology.orchestra.run.smithi138.stdout: "msgr_running_send_time": 0.092159412, 2024-09-10T22:38:10.882 INFO:teuthology.orchestra.run.smithi138.stdout: "msgr_running_recv_time": 0.048180120, 2024-09-10T22:38:10.882 INFO:teuthology.orchestra.run.smithi138.stdout: "msgr_running_fast_dispatch_time": 0.059779048, 2024-09-10T22:38:10.882 INFO:teuthology.orchestra.run.smithi138.stdout: "msgr_send_messages_queue_lat": { 2024-09-10T22:38:10.882 INFO:teuthology.orchestra.run.smithi138.stdout: "avgcount": 2369, 2024-09-10T22:38:10.882 INFO:teuthology.orchestra.run.smithi138.stdout: "sum": 0.078887353, 2024-09-10T22:38:10.882 INFO:teuthology.orchestra.run.smithi138.stdout: "avgtime": 0.000033299 2024-09-10T22:38:10.882 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-09-10T22:38:10.883 INFO:teuthology.orchestra.run.smithi138.stdout: "msgr_handle_ack_lat": { 2024-09-10T22:38:10.883 INFO:teuthology.orchestra.run.smithi138.stdout: "avgcount": 0, 2024-09-10T22:38:10.883 INFO:teuthology.orchestra.run.smithi138.stdout: "sum": 0.000000000, 2024-09-10T22:38:10.883 INFO:teuthology.orchestra.run.smithi138.stdout: "avgtime": 0.000000000 2024-09-10T22:38:10.883 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-09-10T22:38:10.883 INFO:teuthology.orchestra.run.smithi138.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-10T22:38:10.883 INFO:teuthology.orchestra.run.smithi138.stdout: "msgr_send_encrypted_bytes": 0 2024-09-10T22:38:10.883 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-09-10T22:38:10.883 INFO:teuthology.orchestra.run.smithi138.stdout: "AsyncMessenger::Worker-1": { 2024-09-10T22:38:10.883 INFO:teuthology.orchestra.run.smithi138.stdout: "msgr_recv_messages": 3, 2024-09-10T22:38:10.883 INFO:teuthology.orchestra.run.smithi138.stdout: "msgr_send_messages": 176, 2024-09-10T22:38:10.883 INFO:teuthology.orchestra.run.smithi138.stdout: "msgr_recv_bytes": 716, 2024-09-10T22:38:10.883 INFO:teuthology.orchestra.run.smithi138.stdout: "msgr_send_bytes": 389834, 2024-09-10T22:38:10.883 INFO:teuthology.orchestra.run.smithi138.stdout: "msgr_created_connections": 4, 2024-09-10T22:38:10.883 INFO:teuthology.orchestra.run.smithi138.stdout: "msgr_active_connections": 3, 2024-09-10T22:38:10.884 INFO:teuthology.orchestra.run.smithi138.stdout: "msgr_running_total_time": 0.012057154, 2024-09-10T22:38:10.884 INFO:teuthology.orchestra.run.smithi138.stdout: "msgr_running_send_time": 0.009545643, 2024-09-10T22:38:10.884 INFO:teuthology.orchestra.run.smithi138.stdout: "msgr_running_recv_time": 0.000956775, 2024-09-10T22:38:10.884 INFO:teuthology.orchestra.run.smithi138.stdout: "msgr_running_fast_dispatch_time": 0.000057754, 2024-09-10T22:38:10.884 INFO:teuthology.orchestra.run.smithi138.stdout: "msgr_send_messages_queue_lat": { 2024-09-10T22:38:10.884 INFO:teuthology.orchestra.run.smithi138.stdout: "avgcount": 174, 2024-09-10T22:38:10.884 INFO:teuthology.orchestra.run.smithi138.stdout: "sum": 0.008476260, 2024-09-10T22:38:10.884 INFO:teuthology.orchestra.run.smithi138.stdout: "avgtime": 0.000048714 2024-09-10T22:38:10.884 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-09-10T22:38:10.884 INFO:teuthology.orchestra.run.smithi138.stdout: "msgr_handle_ack_lat": { 2024-09-10T22:38:10.885 INFO:teuthology.orchestra.run.smithi138.stdout: "avgcount": 0, 2024-09-10T22:38:10.885 INFO:teuthology.orchestra.run.smithi138.stdout: "sum": 0.000000000, 2024-09-10T22:38:10.885 INFO:teuthology.orchestra.run.smithi138.stdout: "avgtime": 0.000000000 2024-09-10T22:38:10.885 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-09-10T22:38:10.885 INFO:teuthology.orchestra.run.smithi138.stdout: "msgr_recv_encrypted_bytes": 160, 2024-09-10T22:38:10.885 INFO:teuthology.orchestra.run.smithi138.stdout: "msgr_send_encrypted_bytes": 389136 2024-09-10T22:38:10.885 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-09-10T22:38:10.885 INFO:teuthology.orchestra.run.smithi138.stdout: "AsyncMessenger::Worker-2": { 2024-09-10T22:38:10.885 INFO:teuthology.orchestra.run.smithi138.stdout: "msgr_recv_messages": 251, 2024-09-10T22:38:10.885 INFO:teuthology.orchestra.run.smithi138.stdout: "msgr_send_messages": 241, 2024-09-10T22:38:10.885 INFO:teuthology.orchestra.run.smithi138.stdout: "msgr_recv_bytes": 568108, 2024-09-10T22:38:10.885 INFO:teuthology.orchestra.run.smithi138.stdout: "msgr_send_bytes": 143166, 2024-09-10T22:38:10.885 INFO:teuthology.orchestra.run.smithi138.stdout: "msgr_created_connections": 3, 2024-09-10T22:38:10.885 INFO:teuthology.orchestra.run.smithi138.stdout: "msgr_active_connections": 2, 2024-09-10T22:38:10.886 INFO:teuthology.orchestra.run.smithi138.stdout: "msgr_running_total_time": 0.037708116, 2024-09-10T22:38:10.886 INFO:teuthology.orchestra.run.smithi138.stdout: "msgr_running_send_time": 0.018352336, 2024-09-10T22:38:10.886 INFO:teuthology.orchestra.run.smithi138.stdout: "msgr_running_recv_time": 0.025186705, 2024-09-10T22:38:10.886 INFO:teuthology.orchestra.run.smithi138.stdout: "msgr_running_fast_dispatch_time": 0.000031610, 2024-09-10T22:38:10.886 INFO:teuthology.orchestra.run.smithi138.stdout: "msgr_send_messages_queue_lat": { 2024-09-10T22:38:10.886 INFO:teuthology.orchestra.run.smithi138.stdout: "avgcount": 241, 2024-09-10T22:38:10.886 INFO:teuthology.orchestra.run.smithi138.stdout: "sum": 0.015022661, 2024-09-10T22:38:10.886 INFO:teuthology.orchestra.run.smithi138.stdout: "avgtime": 0.000062334 2024-09-10T22:38:10.886 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-09-10T22:38:10.886 INFO:teuthology.orchestra.run.smithi138.stdout: "msgr_handle_ack_lat": { 2024-09-10T22:38:10.887 INFO:teuthology.orchestra.run.smithi138.stdout: "avgcount": 0, 2024-09-10T22:38:10.887 INFO:teuthology.orchestra.run.smithi138.stdout: "sum": 0.000000000, 2024-09-10T22:38:10.887 INFO:teuthology.orchestra.run.smithi138.stdout: "avgtime": 0.000000000 2024-09-10T22:38:10.887 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-09-10T22:38:10.887 INFO:teuthology.orchestra.run.smithi138.stdout: "msgr_recv_encrypted_bytes": 567840, 2024-09-10T22:38:10.887 INFO:teuthology.orchestra.run.smithi138.stdout: "msgr_send_encrypted_bytes": 142848 2024-09-10T22:38:10.887 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-09-10T22:38:10.887 INFO:teuthology.orchestra.run.smithi138.stdout: "cct": { 2024-09-10T22:38:10.887 INFO:teuthology.orchestra.run.smithi138.stdout: "total_workers": 1, 2024-09-10T22:38:10.887 INFO:teuthology.orchestra.run.smithi138.stdout: "unhealthy_workers": 0 2024-09-10T22:38:10.887 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-09-10T22:38:10.887 INFO:teuthology.orchestra.run.smithi138.stdout: "finisher-MDSRank": { 2024-09-10T22:38:10.887 INFO:teuthology.orchestra.run.smithi138.stdout: "queue_len": 0, 2024-09-10T22:38:10.888 INFO:teuthology.orchestra.run.smithi138.stdout: "complete_latency": { 2024-09-10T22:38:10.888 INFO:teuthology.orchestra.run.smithi138.stdout: "avgcount": 4006, 2024-09-10T22:38:10.888 INFO:teuthology.orchestra.run.smithi138.stdout: "sum": 0.098535068, 2024-09-10T22:38:10.888 INFO:teuthology.orchestra.run.smithi138.stdout: "avgtime": 0.000024596 2024-09-10T22:38:10.888 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-09-10T22:38:10.888 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-09-10T22:38:10.888 INFO:teuthology.orchestra.run.smithi138.stdout: "finisher-PurgeQueue": { 2024-09-10T22:38:10.888 INFO:teuthology.orchestra.run.smithi138.stdout: "queue_len": 0, 2024-09-10T22:38:10.888 INFO:teuthology.orchestra.run.smithi138.stdout: "complete_latency": { 2024-09-10T22:38:10.888 INFO:teuthology.orchestra.run.smithi138.stdout: "avgcount": 0, 2024-09-10T22:38:10.888 INFO:teuthology.orchestra.run.smithi138.stdout: "sum": 0.000000000, 2024-09-10T22:38:10.888 INFO:teuthology.orchestra.run.smithi138.stdout: "avgtime": 0.000000000 2024-09-10T22:38:10.888 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-09-10T22:38:10.889 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-09-10T22:38:10.889 INFO:teuthology.orchestra.run.smithi138.stdout: "mds": { 2024-09-10T22:38:10.889 INFO:teuthology.orchestra.run.smithi138.stdout: "request": 0, 2024-09-10T22:38:10.889 INFO:teuthology.orchestra.run.smithi138.stdout: "reply": 0, 2024-09-10T22:38:10.889 INFO:teuthology.orchestra.run.smithi138.stdout: "reply_latency": { 2024-09-10T22:38:10.889 INFO:teuthology.orchestra.run.smithi138.stdout: "avgcount": 0, 2024-09-10T22:38:10.889 INFO:teuthology.orchestra.run.smithi138.stdout: "sum": 0.000000000, 2024-09-10T22:38:10.889 INFO:teuthology.orchestra.run.smithi138.stdout: "avgtime": 0.000000000 2024-09-10T22:38:10.889 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-09-10T22:38:10.889 INFO:teuthology.orchestra.run.smithi138.stdout: "slow_reply": 0, 2024-09-10T22:38:10.890 INFO:teuthology.orchestra.run.smithi138.stdout: "forward": 0, 2024-09-10T22:38:10.890 INFO:teuthology.orchestra.run.smithi138.stdout: "dir_fetch_complete": 0, 2024-09-10T22:38:10.890 INFO:teuthology.orchestra.run.smithi138.stdout: "dir_fetch_keys": 0, 2024-09-10T22:38:10.890 INFO:teuthology.orchestra.run.smithi138.stdout: "dir_commit": 0, 2024-09-10T22:38:10.890 INFO:teuthology.orchestra.run.smithi138.stdout: "dir_split": 0, 2024-09-10T22:38:10.890 INFO:teuthology.orchestra.run.smithi138.stdout: "dir_merge": 0, 2024-09-10T22:38:10.890 INFO:teuthology.orchestra.run.smithi138.stdout: "inodes": 3, 2024-09-10T22:38:10.890 INFO:teuthology.orchestra.run.smithi138.stdout: "inodes_top": 0, 2024-09-10T22:38:10.890 INFO:teuthology.orchestra.run.smithi138.stdout: "inodes_bottom": 3, 2024-09-10T22:38:10.890 INFO:teuthology.orchestra.run.smithi138.stdout: "inodes_pin_tail": 0, 2024-09-10T22:38:10.890 INFO:teuthology.orchestra.run.smithi138.stdout: "inodes_pinned": 3, 2024-09-10T22:38:10.891 INFO:teuthology.orchestra.run.smithi138.stdout: "inodes_expired": 0, 2024-09-10T22:38:10.891 INFO:teuthology.orchestra.run.smithi138.stdout: "inodes_with_caps": 0, 2024-09-10T22:38:10.891 INFO:teuthology.orchestra.run.smithi138.stdout: "caps": 0, 2024-09-10T22:38:10.891 INFO:teuthology.orchestra.run.smithi138.stdout: "subtrees": 1, 2024-09-10T22:38:10.891 INFO:teuthology.orchestra.run.smithi138.stdout: "traverse": 0, 2024-09-10T22:38:10.891 INFO:teuthology.orchestra.run.smithi138.stdout: "traverse_hit": 0, 2024-09-10T22:38:10.891 INFO:teuthology.orchestra.run.smithi138.stdout: "traverse_forward": 0, 2024-09-10T22:38:10.891 INFO:teuthology.orchestra.run.smithi138.stdout: "traverse_discover": 0, 2024-09-10T22:38:10.891 INFO:teuthology.orchestra.run.smithi138.stdout: "traverse_dir_fetch": 0, 2024-09-10T22:38:10.891 INFO:teuthology.orchestra.run.smithi138.stdout: "traverse_remote_ino": 0, 2024-09-10T22:38:10.891 INFO:teuthology.orchestra.run.smithi138.stdout: "traverse_lock": 0, 2024-09-10T22:38:10.891 INFO:teuthology.orchestra.run.smithi138.stdout: "load_cent": 0, 2024-09-10T22:38:10.891 INFO:teuthology.orchestra.run.smithi138.stdout: "q": 0, 2024-09-10T22:38:10.892 INFO:teuthology.orchestra.run.smithi138.stdout: "exported": 0, 2024-09-10T22:38:10.892 INFO:teuthology.orchestra.run.smithi138.stdout: "exported_inodes": 0, 2024-09-10T22:38:10.892 INFO:teuthology.orchestra.run.smithi138.stdout: "imported": 0, 2024-09-10T22:38:10.892 INFO:teuthology.orchestra.run.smithi138.stdout: "imported_inodes": 0, 2024-09-10T22:38:10.892 INFO:teuthology.orchestra.run.smithi138.stdout: "openino_dir_fetch": 0, 2024-09-10T22:38:10.892 INFO:teuthology.orchestra.run.smithi138.stdout: "openino_backtrace_fetch": 0, 2024-09-10T22:38:10.892 INFO:teuthology.orchestra.run.smithi138.stdout: "openino_peer_discover": 0, 2024-09-10T22:38:10.892 INFO:teuthology.orchestra.run.smithi138.stdout: "root_rfiles": 0, 2024-09-10T22:38:10.892 INFO:teuthology.orchestra.run.smithi138.stdout: "root_rbytes": 0, 2024-09-10T22:38:10.892 INFO:teuthology.orchestra.run.smithi138.stdout: "root_rsnaps": 0, 2024-09-10T22:38:10.893 INFO:teuthology.orchestra.run.smithi138.stdout: "scrub_backtrace_fetch": 0, 2024-09-10T22:38:10.893 INFO:teuthology.orchestra.run.smithi138.stdout: "scrub_set_tag": 0, 2024-09-10T22:38:10.893 INFO:teuthology.orchestra.run.smithi138.stdout: "scrub_backtrace_repaired": 0, 2024-09-10T22:38:10.893 INFO:teuthology.orchestra.run.smithi138.stdout: "scrub_inotable_repaired": 0, 2024-09-10T22:38:10.893 INFO:teuthology.orchestra.run.smithi138.stdout: "scrub_dir_inodes": 0, 2024-09-10T22:38:10.893 INFO:teuthology.orchestra.run.smithi138.stdout: "scrub_dir_base_inodes": 0, 2024-09-10T22:38:10.893 INFO:teuthology.orchestra.run.smithi138.stdout: "scrub_dirfrag_rstats": 0, 2024-09-10T22:38:10.893 INFO:teuthology.orchestra.run.smithi138.stdout: "scrub_file_inodes": 0, 2024-09-10T22:38:10.893 INFO:teuthology.orchestra.run.smithi138.stdout: "handle_inode_file_caps": 0, 2024-09-10T22:38:10.893 INFO:teuthology.orchestra.run.smithi138.stdout: "ceph_cap_op_revoke": 0, 2024-09-10T22:38:10.893 INFO:teuthology.orchestra.run.smithi138.stdout: "ceph_cap_op_grant": 0, 2024-09-10T22:38:10.893 INFO:teuthology.orchestra.run.smithi138.stdout: "ceph_cap_op_trunc": 0, 2024-09-10T22:38:10.893 INFO:teuthology.orchestra.run.smithi138.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-10T22:38:10.893 INFO:teuthology.orchestra.run.smithi138.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-10T22:38:10.893 INFO:teuthology.orchestra.run.smithi138.stdout: "handle_client_caps": 0, 2024-09-10T22:38:10.894 INFO:teuthology.orchestra.run.smithi138.stdout: "handle_client_caps_dirty": 0, 2024-09-10T22:38:10.894 INFO:teuthology.orchestra.run.smithi138.stdout: "handle_client_cap_release": 0, 2024-09-10T22:38:10.894 INFO:teuthology.orchestra.run.smithi138.stdout: "process_request_cap_release": 0 2024-09-10T22:38:10.894 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-09-10T22:38:10.894 INFO:teuthology.orchestra.run.smithi138.stdout: "mds_cache": { 2024-09-10T22:38:10.894 INFO:teuthology.orchestra.run.smithi138.stdout: "dir_update": 0, 2024-09-10T22:38:10.894 INFO:teuthology.orchestra.run.smithi138.stdout: "dir_update_receipt": 0, 2024-09-10T22:38:10.894 INFO:teuthology.orchestra.run.smithi138.stdout: "dir_try_discover": 0, 2024-09-10T22:38:10.894 INFO:teuthology.orchestra.run.smithi138.stdout: "dir_send_discover": 0, 2024-09-10T22:38:10.894 INFO:teuthology.orchestra.run.smithi138.stdout: "dir_handle_discover": 0, 2024-09-10T22:38:10.894 INFO:teuthology.orchestra.run.smithi138.stdout: "num_strays": 0, 2024-09-10T22:38:10.894 INFO:teuthology.orchestra.run.smithi138.stdout: "num_strays_delayed": 0, 2024-09-10T22:38:10.894 INFO:teuthology.orchestra.run.smithi138.stdout: "num_strays_enqueuing": 0, 2024-09-10T22:38:10.895 INFO:teuthology.orchestra.run.smithi138.stdout: "strays_created": 0, 2024-09-10T22:38:10.895 INFO:teuthology.orchestra.run.smithi138.stdout: "strays_enqueued": 0, 2024-09-10T22:38:10.895 INFO:teuthology.orchestra.run.smithi138.stdout: "strays_reintegrated": 0, 2024-09-10T22:38:10.895 INFO:teuthology.orchestra.run.smithi138.stdout: "strays_migrated": 0, 2024-09-10T22:38:10.895 INFO:teuthology.orchestra.run.smithi138.stdout: "num_recovering_processing": 0, 2024-09-10T22:38:10.895 INFO:teuthology.orchestra.run.smithi138.stdout: "num_recovering_enqueued": 0, 2024-09-10T22:38:10.895 INFO:teuthology.orchestra.run.smithi138.stdout: "num_recovering_prioritized": 0, 2024-09-10T22:38:10.895 INFO:teuthology.orchestra.run.smithi138.stdout: "recovery_started": 0, 2024-09-10T22:38:10.895 INFO:teuthology.orchestra.run.smithi138.stdout: "recovery_completed": 0, 2024-09-10T22:38:10.895 INFO:teuthology.orchestra.run.smithi138.stdout: "ireq_quiesce_path": 0, 2024-09-10T22:38:10.895 INFO:teuthology.orchestra.run.smithi138.stdout: "ireq_quiesce_inode": 0, 2024-09-10T22:38:10.895 INFO:teuthology.orchestra.run.smithi138.stdout: "ireq_enqueue_scrub": 0, 2024-09-10T22:38:10.895 INFO:teuthology.orchestra.run.smithi138.stdout: "ireq_exportdir": 0, 2024-09-10T22:38:10.895 INFO:teuthology.orchestra.run.smithi138.stdout: "ireq_flush": 0, 2024-09-10T22:38:10.896 INFO:teuthology.orchestra.run.smithi138.stdout: "ireq_fragmentdir": 0, 2024-09-10T22:38:10.896 INFO:teuthology.orchestra.run.smithi138.stdout: "ireq_fragstats": 0, 2024-09-10T22:38:10.896 INFO:teuthology.orchestra.run.smithi138.stdout: "ireq_inodestats": 0, 2024-09-10T22:38:10.896 INFO:teuthology.orchestra.run.smithi138.stdout: "uninline_started": 0, 2024-09-10T22:38:10.896 INFO:teuthology.orchestra.run.smithi138.stdout: "uninline_succeeded": 0, 2024-09-10T22:38:10.896 INFO:teuthology.orchestra.run.smithi138.stdout: "uninline_write_failed": 0 2024-09-10T22:38:10.896 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-09-10T22:38:10.896 INFO:teuthology.orchestra.run.smithi138.stdout: "mds_log": { 2024-09-10T22:38:10.896 INFO:teuthology.orchestra.run.smithi138.stdout: "evlrg": 0, 2024-09-10T22:38:10.896 INFO:teuthology.orchestra.run.smithi138.stdout: "evadd": 0, 2024-09-10T22:38:10.896 INFO:teuthology.orchestra.run.smithi138.stdout: "evex": 0, 2024-09-10T22:38:10.896 INFO:teuthology.orchestra.run.smithi138.stdout: "evtrm": 0, 2024-09-10T22:38:10.896 INFO:teuthology.orchestra.run.smithi138.stdout: "ev": 17, 2024-09-10T22:38:10.896 INFO:teuthology.orchestra.run.smithi138.stdout: "evexg": 0, 2024-09-10T22:38:10.896 INFO:teuthology.orchestra.run.smithi138.stdout: "evexd": 0, 2024-09-10T22:38:10.897 INFO:teuthology.orchestra.run.smithi138.stdout: "segadd": 0, 2024-09-10T22:38:10.897 INFO:teuthology.orchestra.run.smithi138.stdout: "segex": 0, 2024-09-10T22:38:10.897 INFO:teuthology.orchestra.run.smithi138.stdout: "segtrm": 0, 2024-09-10T22:38:10.897 INFO:teuthology.orchestra.run.smithi138.stdout: "seg": 2, 2024-09-10T22:38:10.897 INFO:teuthology.orchestra.run.smithi138.stdout: "segmjr": 2, 2024-09-10T22:38:10.897 INFO:teuthology.orchestra.run.smithi138.stdout: "segexg": 0, 2024-09-10T22:38:10.897 INFO:teuthology.orchestra.run.smithi138.stdout: "segexd": 0, 2024-09-10T22:38:10.897 INFO:teuthology.orchestra.run.smithi138.stdout: "expos": 4194304, 2024-09-10T22:38:10.897 INFO:teuthology.orchestra.run.smithi138.stdout: "wrpos": 4220101, 2024-09-10T22:38:10.897 INFO:teuthology.orchestra.run.smithi138.stdout: "rdpos": 4218450, 2024-09-10T22:38:10.897 INFO:teuthology.orchestra.run.smithi138.stdout: "jlat": { 2024-09-10T22:38:10.897 INFO:teuthology.orchestra.run.smithi138.stdout: "avgcount": 0, 2024-09-10T22:38:10.897 INFO:teuthology.orchestra.run.smithi138.stdout: "sum": 0.000000000, 2024-09-10T22:38:10.898 INFO:teuthology.orchestra.run.smithi138.stdout: "avgtime": 0.000000000 2024-09-10T22:38:10.898 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-09-10T22:38:10.898 INFO:teuthology.orchestra.run.smithi138.stdout: "replayed": 17 2024-09-10T22:38:10.898 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-09-10T22:38:10.898 INFO:teuthology.orchestra.run.smithi138.stdout: "mds_mem": { 2024-09-10T22:38:10.898 INFO:teuthology.orchestra.run.smithi138.stdout: "ino": 4, 2024-09-10T22:38:10.898 INFO:teuthology.orchestra.run.smithi138.stdout: "ino+": 16, 2024-09-10T22:38:10.898 INFO:teuthology.orchestra.run.smithi138.stdout: "ino-": 12, 2024-09-10T22:38:10.898 INFO:teuthology.orchestra.run.smithi138.stdout: "dir": 2, 2024-09-10T22:38:10.898 INFO:teuthology.orchestra.run.smithi138.stdout: "dir+": 13, 2024-09-10T22:38:10.898 INFO:teuthology.orchestra.run.smithi138.stdout: "dir-": 11, 2024-09-10T22:38:10.898 INFO:teuthology.orchestra.run.smithi138.stdout: "dn": 3, 2024-09-10T22:38:10.898 INFO:teuthology.orchestra.run.smithi138.stdout: "dn+": 15, 2024-09-10T22:38:10.899 INFO:teuthology.orchestra.run.smithi138.stdout: "dn-": 12, 2024-09-10T22:38:10.899 INFO:teuthology.orchestra.run.smithi138.stdout: "cap": 0, 2024-09-10T22:38:10.899 INFO:teuthology.orchestra.run.smithi138.stdout: "cap+": 0, 2024-09-10T22:38:10.899 INFO:teuthology.orchestra.run.smithi138.stdout: "cap-": 0, 2024-09-10T22:38:10.899 INFO:teuthology.orchestra.run.smithi138.stdout: "rss": 51776, 2024-09-10T22:38:10.899 INFO:teuthology.orchestra.run.smithi138.stdout: "heap": 249290752 2024-09-10T22:38:10.899 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-09-10T22:38:10.899 INFO:teuthology.orchestra.run.smithi138.stdout: "mds_server": { 2024-09-10T22:38:10.899 INFO:teuthology.orchestra.run.smithi138.stdout: "dispatch_client_request": 0, 2024-09-10T22:38:10.899 INFO:teuthology.orchestra.run.smithi138.stdout: "dispatch_server_request": 0, 2024-09-10T22:38:10.899 INFO:teuthology.orchestra.run.smithi138.stdout: "handle_client_request": 0, 2024-09-10T22:38:10.899 INFO:teuthology.orchestra.run.smithi138.stdout: "handle_client_session": 0, 2024-09-10T22:38:10.899 INFO:teuthology.orchestra.run.smithi138.stdout: "handle_peer_request": 0, 2024-09-10T22:38:10.899 INFO:teuthology.orchestra.run.smithi138.stdout: "req_create_latency": { 2024-09-10T22:38:10.900 INFO:teuthology.orchestra.run.smithi138.stdout: "avgcount": 0, 2024-09-10T22:38:10.900 INFO:teuthology.orchestra.run.smithi138.stdout: "sum": 0.000000000, 2024-09-10T22:38:10.900 INFO:teuthology.orchestra.run.smithi138.stdout: "avgtime": 0.000000000 2024-09-10T22:38:10.900 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-09-10T22:38:10.900 INFO:teuthology.orchestra.run.smithi138.stdout: "req_getattr_latency": { 2024-09-10T22:38:10.900 INFO:teuthology.orchestra.run.smithi138.stdout: "avgcount": 0, 2024-09-10T22:38:10.900 INFO:teuthology.orchestra.run.smithi138.stdout: "sum": 0.000000000, 2024-09-10T22:38:10.900 INFO:teuthology.orchestra.run.smithi138.stdout: "avgtime": 0.000000000 2024-09-10T22:38:10.900 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-09-10T22:38:10.900 INFO:teuthology.orchestra.run.smithi138.stdout: "req_getfilelock_latency": { 2024-09-10T22:38:10.900 INFO:teuthology.orchestra.run.smithi138.stdout: "avgcount": 0, 2024-09-10T22:38:10.900 INFO:teuthology.orchestra.run.smithi138.stdout: "sum": 0.000000000, 2024-09-10T22:38:10.901 INFO:teuthology.orchestra.run.smithi138.stdout: "avgtime": 0.000000000 2024-09-10T22:38:10.901 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-09-10T22:38:10.901 INFO:teuthology.orchestra.run.smithi138.stdout: "req_link_latency": { 2024-09-10T22:38:10.901 INFO:teuthology.orchestra.run.smithi138.stdout: "avgcount": 0, 2024-09-10T22:38:10.901 INFO:teuthology.orchestra.run.smithi138.stdout: "sum": 0.000000000, 2024-09-10T22:38:10.901 INFO:teuthology.orchestra.run.smithi138.stdout: "avgtime": 0.000000000 2024-09-10T22:38:10.901 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-09-10T22:38:10.901 INFO:teuthology.orchestra.run.smithi138.stdout: "req_lookup_latency": { 2024-09-10T22:38:10.901 INFO:teuthology.orchestra.run.smithi138.stdout: "avgcount": 0, 2024-09-10T22:38:10.901 INFO:teuthology.orchestra.run.smithi138.stdout: "sum": 0.000000000, 2024-09-10T22:38:10.901 INFO:teuthology.orchestra.run.smithi138.stdout: "avgtime": 0.000000000 2024-09-10T22:38:10.901 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-09-10T22:38:10.902 INFO:teuthology.orchestra.run.smithi138.stdout: "req_lookuphash_latency": { 2024-09-10T22:38:10.902 INFO:teuthology.orchestra.run.smithi138.stdout: "avgcount": 0, 2024-09-10T22:38:10.902 INFO:teuthology.orchestra.run.smithi138.stdout: "sum": 0.000000000, 2024-09-10T22:38:10.902 INFO:teuthology.orchestra.run.smithi138.stdout: "avgtime": 0.000000000 2024-09-10T22:38:10.902 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-09-10T22:38:10.902 INFO:teuthology.orchestra.run.smithi138.stdout: "req_lookupino_latency": { 2024-09-10T22:38:10.902 INFO:teuthology.orchestra.run.smithi138.stdout: "avgcount": 0, 2024-09-10T22:38:10.902 INFO:teuthology.orchestra.run.smithi138.stdout: "sum": 0.000000000, 2024-09-10T22:38:10.902 INFO:teuthology.orchestra.run.smithi138.stdout: "avgtime": 0.000000000 2024-09-10T22:38:10.902 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-09-10T22:38:10.902 INFO:teuthology.orchestra.run.smithi138.stdout: "req_lookupname_latency": { 2024-09-10T22:38:10.902 INFO:teuthology.orchestra.run.smithi138.stdout: "avgcount": 0, 2024-09-10T22:38:10.902 INFO:teuthology.orchestra.run.smithi138.stdout: "sum": 0.000000000, 2024-09-10T22:38:10.902 INFO:teuthology.orchestra.run.smithi138.stdout: "avgtime": 0.000000000 2024-09-10T22:38:10.902 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-09-10T22:38:10.903 INFO:teuthology.orchestra.run.smithi138.stdout: "req_lookupparent_latency": { 2024-09-10T22:38:10.903 INFO:teuthology.orchestra.run.smithi138.stdout: "avgcount": 0, 2024-09-10T22:38:10.903 INFO:teuthology.orchestra.run.smithi138.stdout: "sum": 0.000000000, 2024-09-10T22:38:10.903 INFO:teuthology.orchestra.run.smithi138.stdout: "avgtime": 0.000000000 2024-09-10T22:38:10.903 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-09-10T22:38:10.903 INFO:teuthology.orchestra.run.smithi138.stdout: "req_lookupsnap_latency": { 2024-09-10T22:38:10.903 INFO:teuthology.orchestra.run.smithi138.stdout: "avgcount": 0, 2024-09-10T22:38:10.903 INFO:teuthology.orchestra.run.smithi138.stdout: "sum": 0.000000000, 2024-09-10T22:38:10.903 INFO:teuthology.orchestra.run.smithi138.stdout: "avgtime": 0.000000000 2024-09-10T22:38:10.903 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-09-10T22:38:10.903 INFO:teuthology.orchestra.run.smithi138.stdout: "req_lssnap_latency": { 2024-09-10T22:38:10.903 INFO:teuthology.orchestra.run.smithi138.stdout: "avgcount": 0, 2024-09-10T22:38:10.903 INFO:teuthology.orchestra.run.smithi138.stdout: "sum": 0.000000000, 2024-09-10T22:38:10.904 INFO:teuthology.orchestra.run.smithi138.stdout: "avgtime": 0.000000000 2024-09-10T22:38:10.904 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-09-10T22:38:10.904 INFO:teuthology.orchestra.run.smithi138.stdout: "req_mkdir_latency": { 2024-09-10T22:38:10.904 INFO:teuthology.orchestra.run.smithi138.stdout: "avgcount": 0, 2024-09-10T22:38:10.904 INFO:teuthology.orchestra.run.smithi138.stdout: "sum": 0.000000000, 2024-09-10T22:38:10.904 INFO:teuthology.orchestra.run.smithi138.stdout: "avgtime": 0.000000000 2024-09-10T22:38:10.904 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-09-10T22:38:10.904 INFO:teuthology.orchestra.run.smithi138.stdout: "req_mknod_latency": { 2024-09-10T22:38:10.904 INFO:teuthology.orchestra.run.smithi138.stdout: "avgcount": 0, 2024-09-10T22:38:10.904 INFO:teuthology.orchestra.run.smithi138.stdout: "sum": 0.000000000, 2024-09-10T22:38:10.905 INFO:teuthology.orchestra.run.smithi138.stdout: "avgtime": 0.000000000 2024-09-10T22:38:10.905 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-09-10T22:38:10.905 INFO:teuthology.orchestra.run.smithi138.stdout: "req_mksnap_latency": { 2024-09-10T22:38:10.905 INFO:teuthology.orchestra.run.smithi138.stdout: "avgcount": 0, 2024-09-10T22:38:10.905 INFO:teuthology.orchestra.run.smithi138.stdout: "sum": 0.000000000, 2024-09-10T22:38:10.905 INFO:teuthology.orchestra.run.smithi138.stdout: "avgtime": 0.000000000 2024-09-10T22:38:10.905 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-09-10T22:38:10.905 INFO:teuthology.orchestra.run.smithi138.stdout: "req_open_latency": { 2024-09-10T22:38:10.905 INFO:teuthology.orchestra.run.smithi138.stdout: "avgcount": 0, 2024-09-10T22:38:10.905 INFO:teuthology.orchestra.run.smithi138.stdout: "sum": 0.000000000, 2024-09-10T22:38:10.906 INFO:teuthology.orchestra.run.smithi138.stdout: "avgtime": 0.000000000 2024-09-10T22:38:10.906 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-09-10T22:38:10.906 INFO:teuthology.orchestra.run.smithi138.stdout: "req_readdir_latency": { 2024-09-10T22:38:10.906 INFO:teuthology.orchestra.run.smithi138.stdout: "avgcount": 0, 2024-09-10T22:38:10.906 INFO:teuthology.orchestra.run.smithi138.stdout: "sum": 0.000000000, 2024-09-10T22:38:10.906 INFO:teuthology.orchestra.run.smithi138.stdout: "avgtime": 0.000000000 2024-09-10T22:38:10.906 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-09-10T22:38:10.906 INFO:teuthology.orchestra.run.smithi138.stdout: "req_rename_latency": { 2024-09-10T22:38:10.906 INFO:teuthology.orchestra.run.smithi138.stdout: "avgcount": 0, 2024-09-10T22:38:10.906 INFO:teuthology.orchestra.run.smithi138.stdout: "sum": 0.000000000, 2024-09-10T22:38:10.906 INFO:teuthology.orchestra.run.smithi138.stdout: "avgtime": 0.000000000 2024-09-10T22:38:10.906 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-09-10T22:38:10.906 INFO:teuthology.orchestra.run.smithi138.stdout: "req_renamesnap_latency": { 2024-09-10T22:38:10.906 INFO:teuthology.orchestra.run.smithi138.stdout: "avgcount": 0, 2024-09-10T22:38:10.907 INFO:teuthology.orchestra.run.smithi138.stdout: "sum": 0.000000000, 2024-09-10T22:38:10.907 INFO:teuthology.orchestra.run.smithi138.stdout: "avgtime": 0.000000000 2024-09-10T22:38:10.907 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-09-10T22:38:10.907 INFO:teuthology.orchestra.run.smithi138.stdout: "req_snapdiff_latency": { 2024-09-10T22:38:10.907 INFO:teuthology.orchestra.run.smithi138.stdout: "avgcount": 0, 2024-09-10T22:38:10.907 INFO:teuthology.orchestra.run.smithi138.stdout: "sum": 0.000000000, 2024-09-10T22:38:10.907 INFO:teuthology.orchestra.run.smithi138.stdout: "avgtime": 0.000000000 2024-09-10T22:38:10.907 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-09-10T22:38:10.907 INFO:teuthology.orchestra.run.smithi138.stdout: "req_rmdir_latency": { 2024-09-10T22:38:10.907 INFO:teuthology.orchestra.run.smithi138.stdout: "avgcount": 0, 2024-09-10T22:38:10.907 INFO:teuthology.orchestra.run.smithi138.stdout: "sum": 0.000000000, 2024-09-10T22:38:10.907 INFO:teuthology.orchestra.run.smithi138.stdout: "avgtime": 0.000000000 2024-09-10T22:38:10.907 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-09-10T22:38:10.907 INFO:teuthology.orchestra.run.smithi138.stdout: "req_rmsnap_latency": { 2024-09-10T22:38:10.908 INFO:teuthology.orchestra.run.smithi138.stdout: "avgcount": 0, 2024-09-10T22:38:10.908 INFO:teuthology.orchestra.run.smithi138.stdout: "sum": 0.000000000, 2024-09-10T22:38:10.908 INFO:teuthology.orchestra.run.smithi138.stdout: "avgtime": 0.000000000 2024-09-10T22:38:10.908 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-09-10T22:38:10.908 INFO:teuthology.orchestra.run.smithi138.stdout: "req_rmxattr_latency": { 2024-09-10T22:38:10.908 INFO:teuthology.orchestra.run.smithi138.stdout: "avgcount": 0, 2024-09-10T22:38:10.908 INFO:teuthology.orchestra.run.smithi138.stdout: "sum": 0.000000000, 2024-09-10T22:38:10.908 INFO:teuthology.orchestra.run.smithi138.stdout: "avgtime": 0.000000000 2024-09-10T22:38:10.908 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-09-10T22:38:10.908 INFO:teuthology.orchestra.run.smithi138.stdout: "req_setattr_latency": { 2024-09-10T22:38:10.908 INFO:teuthology.orchestra.run.smithi138.stdout: "avgcount": 0, 2024-09-10T22:38:10.908 INFO:teuthology.orchestra.run.smithi138.stdout: "sum": 0.000000000, 2024-09-10T22:38:10.908 INFO:teuthology.orchestra.run.smithi138.stdout: "avgtime": 0.000000000 2024-09-10T22:38:10.908 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-09-10T22:38:10.909 INFO:teuthology.orchestra.run.smithi138.stdout: "req_setdirlayout_latency": { 2024-09-10T22:38:10.909 INFO:teuthology.orchestra.run.smithi138.stdout: "avgcount": 0, 2024-09-10T22:38:10.909 INFO:teuthology.orchestra.run.smithi138.stdout: "sum": 0.000000000, 2024-09-10T22:38:10.909 INFO:teuthology.orchestra.run.smithi138.stdout: "avgtime": 0.000000000 2024-09-10T22:38:10.909 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-09-10T22:38:10.909 INFO:teuthology.orchestra.run.smithi138.stdout: "req_setfilelock_latency": { 2024-09-10T22:38:10.909 INFO:teuthology.orchestra.run.smithi138.stdout: "avgcount": 0, 2024-09-10T22:38:10.909 INFO:teuthology.orchestra.run.smithi138.stdout: "sum": 0.000000000, 2024-09-10T22:38:10.909 INFO:teuthology.orchestra.run.smithi138.stdout: "avgtime": 0.000000000 2024-09-10T22:38:10.910 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-09-10T22:38:10.910 INFO:teuthology.orchestra.run.smithi138.stdout: "req_setlayout_latency": { 2024-09-10T22:38:10.910 INFO:teuthology.orchestra.run.smithi138.stdout: "avgcount": 0, 2024-09-10T22:38:10.910 INFO:teuthology.orchestra.run.smithi138.stdout: "sum": 0.000000000, 2024-09-10T22:38:10.910 INFO:teuthology.orchestra.run.smithi138.stdout: "avgtime": 0.000000000 2024-09-10T22:38:10.910 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-09-10T22:38:10.910 INFO:teuthology.orchestra.run.smithi138.stdout: "req_setxattr_latency": { 2024-09-10T22:38:10.910 INFO:teuthology.orchestra.run.smithi138.stdout: "avgcount": 0, 2024-09-10T22:38:10.910 INFO:teuthology.orchestra.run.smithi138.stdout: "sum": 0.000000000, 2024-09-10T22:38:10.910 INFO:teuthology.orchestra.run.smithi138.stdout: "avgtime": 0.000000000 2024-09-10T22:38:10.911 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-09-10T22:38:10.911 INFO:teuthology.orchestra.run.smithi138.stdout: "req_symlink_latency": { 2024-09-10T22:38:10.911 INFO:teuthology.orchestra.run.smithi138.stdout: "avgcount": 0, 2024-09-10T22:38:10.911 INFO:teuthology.orchestra.run.smithi138.stdout: "sum": 0.000000000, 2024-09-10T22:38:10.911 INFO:teuthology.orchestra.run.smithi138.stdout: "avgtime": 0.000000000 2024-09-10T22:38:10.911 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-09-10T22:38:10.911 INFO:teuthology.orchestra.run.smithi138.stdout: "req_unlink_latency": { 2024-09-10T22:38:10.911 INFO:teuthology.orchestra.run.smithi138.stdout: "avgcount": 0, 2024-09-10T22:38:10.911 INFO:teuthology.orchestra.run.smithi138.stdout: "sum": 0.000000000, 2024-09-10T22:38:10.911 INFO:teuthology.orchestra.run.smithi138.stdout: "avgtime": 0.000000000 2024-09-10T22:38:10.911 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-09-10T22:38:10.911 INFO:teuthology.orchestra.run.smithi138.stdout: "cap_revoke_eviction": 0, 2024-09-10T22:38:10.911 INFO:teuthology.orchestra.run.smithi138.stdout: "cap_acquisition_throttle": 0, 2024-09-10T22:38:10.912 INFO:teuthology.orchestra.run.smithi138.stdout: "req_getvxattr_latency": { 2024-09-10T22:38:10.912 INFO:teuthology.orchestra.run.smithi138.stdout: "avgcount": 0, 2024-09-10T22:38:10.912 INFO:teuthology.orchestra.run.smithi138.stdout: "sum": 0.000000000, 2024-09-10T22:38:10.912 INFO:teuthology.orchestra.run.smithi138.stdout: "avgtime": 0.000000000 2024-09-10T22:38:10.912 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-09-10T22:38:10.912 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-09-10T22:38:10.912 INFO:teuthology.orchestra.run.smithi138.stdout: "mds_sessions": { 2024-09-10T22:38:10.912 INFO:teuthology.orchestra.run.smithi138.stdout: "session_count": 1, 2024-09-10T22:38:10.912 INFO:teuthology.orchestra.run.smithi138.stdout: "session_add": 1, 2024-09-10T22:38:10.912 INFO:teuthology.orchestra.run.smithi138.stdout: "session_remove": 0, 2024-09-10T22:38:10.912 INFO:teuthology.orchestra.run.smithi138.stdout: "sessions_open": 1, 2024-09-10T22:38:10.912 INFO:teuthology.orchestra.run.smithi138.stdout: "sessions_stale": 0, 2024-09-10T22:38:10.912 INFO:teuthology.orchestra.run.smithi138.stdout: "total_load": 0, 2024-09-10T22:38:10.912 INFO:teuthology.orchestra.run.smithi138.stdout: "average_load": 0, 2024-09-10T22:38:10.913 INFO:teuthology.orchestra.run.smithi138.stdout: "avg_session_uptime": 2062, 2024-09-10T22:38:10.913 INFO:teuthology.orchestra.run.smithi138.stdout: "mdthresh_evicted": 0 2024-09-10T22:38:10.913 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-09-10T22:38:10.913 INFO:teuthology.orchestra.run.smithi138.stdout: "mempool": { 2024-09-10T22:38:10.913 INFO:teuthology.orchestra.run.smithi138.stdout: "bloom_filter_bytes": 0, 2024-09-10T22:38:10.913 INFO:teuthology.orchestra.run.smithi138.stdout: "bloom_filter_items": 0, 2024-09-10T22:38:10.913 INFO:teuthology.orchestra.run.smithi138.stdout: "bluestore_alloc_bytes": 0, 2024-09-10T22:38:10.913 INFO:teuthology.orchestra.run.smithi138.stdout: "bluestore_alloc_items": 0, 2024-09-10T22:38:10.913 INFO:teuthology.orchestra.run.smithi138.stdout: "bluestore_cache_data_bytes": 0, 2024-09-10T22:38:10.913 INFO:teuthology.orchestra.run.smithi138.stdout: "bluestore_cache_data_items": 0, 2024-09-10T22:38:10.913 INFO:teuthology.orchestra.run.smithi138.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-10T22:38:10.913 INFO:teuthology.orchestra.run.smithi138.stdout: "bluestore_cache_onode_items": 0, 2024-09-10T22:38:10.913 INFO:teuthology.orchestra.run.smithi138.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-10T22:38:10.913 INFO:teuthology.orchestra.run.smithi138.stdout: "bluestore_cache_meta_items": 0, 2024-09-10T22:38:10.914 INFO:teuthology.orchestra.run.smithi138.stdout: "bluestore_cache_other_bytes": 0, 2024-09-10T22:38:10.914 INFO:teuthology.orchestra.run.smithi138.stdout: "bluestore_cache_other_items": 0, 2024-09-10T22:38:10.914 INFO:teuthology.orchestra.run.smithi138.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-10T22:38:10.914 INFO:teuthology.orchestra.run.smithi138.stdout: "bluestore_cache_buffer_items": 0, 2024-09-10T22:38:10.914 INFO:teuthology.orchestra.run.smithi138.stdout: "bluestore_extent_bytes": 0, 2024-09-10T22:38:10.914 INFO:teuthology.orchestra.run.smithi138.stdout: "bluestore_extent_items": 0, 2024-09-10T22:38:10.914 INFO:teuthology.orchestra.run.smithi138.stdout: "bluestore_blob_bytes": 0, 2024-09-10T22:38:10.914 INFO:teuthology.orchestra.run.smithi138.stdout: "bluestore_blob_items": 0, 2024-09-10T22:38:10.914 INFO:teuthology.orchestra.run.smithi138.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-10T22:38:10.914 INFO:teuthology.orchestra.run.smithi138.stdout: "bluestore_shared_blob_items": 0, 2024-09-10T22:38:10.914 INFO:teuthology.orchestra.run.smithi138.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-10T22:38:10.914 INFO:teuthology.orchestra.run.smithi138.stdout: "bluestore_inline_bl_items": 0, 2024-09-10T22:38:10.915 INFO:teuthology.orchestra.run.smithi138.stdout: "bluestore_fsck_bytes": 0, 2024-09-10T22:38:10.915 INFO:teuthology.orchestra.run.smithi138.stdout: "bluestore_fsck_items": 0, 2024-09-10T22:38:10.915 INFO:teuthology.orchestra.run.smithi138.stdout: "bluestore_txc_bytes": 0, 2024-09-10T22:38:10.915 INFO:teuthology.orchestra.run.smithi138.stdout: "bluestore_txc_items": 0, 2024-09-10T22:38:10.915 INFO:teuthology.orchestra.run.smithi138.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-10T22:38:10.915 INFO:teuthology.orchestra.run.smithi138.stdout: "bluestore_writing_deferred_items": 0, 2024-09-10T22:38:10.915 INFO:teuthology.orchestra.run.smithi138.stdout: "bluestore_writing_bytes": 0, 2024-09-10T22:38:10.915 INFO:teuthology.orchestra.run.smithi138.stdout: "bluestore_writing_items": 0, 2024-09-10T22:38:10.915 INFO:teuthology.orchestra.run.smithi138.stdout: "bluefs_bytes": 0, 2024-09-10T22:38:10.915 INFO:teuthology.orchestra.run.smithi138.stdout: "bluefs_items": 0, 2024-09-10T22:38:10.915 INFO:teuthology.orchestra.run.smithi138.stdout: "bluefs_file_reader_bytes": 0, 2024-09-10T22:38:10.915 INFO:teuthology.orchestra.run.smithi138.stdout: "bluefs_file_reader_items": 0, 2024-09-10T22:38:10.915 INFO:teuthology.orchestra.run.smithi138.stdout: "bluefs_file_writer_bytes": 0, 2024-09-10T22:38:10.915 INFO:teuthology.orchestra.run.smithi138.stdout: "bluefs_file_writer_items": 0, 2024-09-10T22:38:10.915 INFO:teuthology.orchestra.run.smithi138.stdout: "buffer_anon_bytes": 181303, 2024-09-10T22:38:10.916 INFO:teuthology.orchestra.run.smithi138.stdout: "buffer_anon_items": 46, 2024-09-10T22:38:10.916 INFO:teuthology.orchestra.run.smithi138.stdout: "buffer_meta_bytes": 0, 2024-09-10T22:38:10.916 INFO:teuthology.orchestra.run.smithi138.stdout: "buffer_meta_items": 0, 2024-09-10T22:38:10.916 INFO:teuthology.orchestra.run.smithi138.stdout: "osd_bytes": 0, 2024-09-10T22:38:10.916 INFO:teuthology.orchestra.run.smithi138.stdout: "osd_items": 0, 2024-09-10T22:38:10.916 INFO:teuthology.orchestra.run.smithi138.stdout: "osd_mapbl_bytes": 0, 2024-09-10T22:38:10.916 INFO:teuthology.orchestra.run.smithi138.stdout: "osd_mapbl_items": 0, 2024-09-10T22:38:10.916 INFO:teuthology.orchestra.run.smithi138.stdout: "osd_pglog_bytes": 0, 2024-09-10T22:38:10.916 INFO:teuthology.orchestra.run.smithi138.stdout: "osd_pglog_items": 0, 2024-09-10T22:38:10.916 INFO:teuthology.orchestra.run.smithi138.stdout: "osdmap_bytes": 7880, 2024-09-10T22:38:10.916 INFO:teuthology.orchestra.run.smithi138.stdout: "osdmap_items": 162, 2024-09-10T22:38:10.916 INFO:teuthology.orchestra.run.smithi138.stdout: "osdmap_mapping_bytes": 0, 2024-09-10T22:38:10.916 INFO:teuthology.orchestra.run.smithi138.stdout: "osdmap_mapping_items": 0, 2024-09-10T22:38:10.916 INFO:teuthology.orchestra.run.smithi138.stdout: "pgmap_bytes": 0, 2024-09-10T22:38:10.916 INFO:teuthology.orchestra.run.smithi138.stdout: "pgmap_items": 0, 2024-09-10T22:38:10.917 INFO:teuthology.orchestra.run.smithi138.stdout: "mds_co_bytes": 14288, 2024-09-10T22:38:10.917 INFO:teuthology.orchestra.run.smithi138.stdout: "mds_co_items": 40, 2024-09-10T22:38:10.917 INFO:teuthology.orchestra.run.smithi138.stdout: "unittest_1_bytes": 0, 2024-09-10T22:38:10.917 INFO:teuthology.orchestra.run.smithi138.stdout: "unittest_1_items": 0, 2024-09-10T22:38:10.917 INFO:teuthology.orchestra.run.smithi138.stdout: "unittest_2_bytes": 0, 2024-09-10T22:38:10.917 INFO:teuthology.orchestra.run.smithi138.stdout: "unittest_2_items": 0 2024-09-10T22:38:10.917 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-09-10T22:38:10.917 INFO:teuthology.orchestra.run.smithi138.stdout: "objecter": { 2024-09-10T22:38:10.917 INFO:teuthology.orchestra.run.smithi138.stdout: "op_active": 0, 2024-09-10T22:38:10.917 INFO:teuthology.orchestra.run.smithi138.stdout: "op_laggy": 0, 2024-09-10T22:38:10.917 INFO:teuthology.orchestra.run.smithi138.stdout: "op_send": 2372, 2024-09-10T22:38:10.917 INFO:teuthology.orchestra.run.smithi138.stdout: "op_send_bytes": 21, 2024-09-10T22:38:10.918 INFO:teuthology.orchestra.run.smithi138.stdout: "op_resend": 3, 2024-09-10T22:38:10.918 INFO:teuthology.orchestra.run.smithi138.stdout: "op_reply": 2372, 2024-09-10T22:38:10.918 INFO:teuthology.orchestra.run.smithi138.stdout: "op_latency": { 2024-09-10T22:38:10.918 INFO:teuthology.orchestra.run.smithi138.stdout: "avgcount": 2372, 2024-09-10T22:38:10.918 INFO:teuthology.orchestra.run.smithi138.stdout: "sum": 1.682965318, 2024-09-10T22:38:10.918 INFO:teuthology.orchestra.run.smithi138.stdout: "avgtime": 0.000709513 2024-09-10T22:38:10.918 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-09-10T22:38:10.918 INFO:teuthology.orchestra.run.smithi138.stdout: "op_inflight": 0, 2024-09-10T22:38:10.918 INFO:teuthology.orchestra.run.smithi138.stdout: "oplen_avg": { 2024-09-10T22:38:10.918 INFO:teuthology.orchestra.run.smithi138.stdout: "avgcount": 2372, 2024-09-10T22:38:10.918 INFO:teuthology.orchestra.run.smithi138.stdout: "sum": 2373 2024-09-10T22:38:10.918 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-09-10T22:38:10.918 INFO:teuthology.orchestra.run.smithi138.stdout: "op": 2372, 2024-09-10T22:38:10.918 INFO:teuthology.orchestra.run.smithi138.stdout: "op_r": 2372, 2024-09-10T22:38:10.919 INFO:teuthology.orchestra.run.smithi138.stdout: "op_w": 0, 2024-09-10T22:38:10.919 INFO:teuthology.orchestra.run.smithi138.stdout: "op_rmw": 0, 2024-09-10T22:38:10.919 INFO:teuthology.orchestra.run.smithi138.stdout: "op_pg": 0, 2024-09-10T22:38:10.919 INFO:teuthology.orchestra.run.smithi138.stdout: "osdop_stat": 1540, 2024-09-10T22:38:10.919 INFO:teuthology.orchestra.run.smithi138.stdout: "osdop_create": 0, 2024-09-10T22:38:10.919 INFO:teuthology.orchestra.run.smithi138.stdout: "osdop_read": 830, 2024-09-10T22:38:10.919 INFO:teuthology.orchestra.run.smithi138.stdout: "osdop_write": 0, 2024-09-10T22:38:10.919 INFO:teuthology.orchestra.run.smithi138.stdout: "osdop_writefull": 0, 2024-09-10T22:38:10.919 INFO:teuthology.orchestra.run.smithi138.stdout: "osdop_writesame": 0, 2024-09-10T22:38:10.919 INFO:teuthology.orchestra.run.smithi138.stdout: "osdop_append": 0, 2024-09-10T22:38:10.919 INFO:teuthology.orchestra.run.smithi138.stdout: "osdop_zero": 0, 2024-09-10T22:38:10.919 INFO:teuthology.orchestra.run.smithi138.stdout: "osdop_truncate": 0, 2024-09-10T22:38:10.919 INFO:teuthology.orchestra.run.smithi138.stdout: "osdop_delete": 0, 2024-09-10T22:38:10.919 INFO:teuthology.orchestra.run.smithi138.stdout: "osdop_mapext": 0, 2024-09-10T22:38:10.920 INFO:teuthology.orchestra.run.smithi138.stdout: "osdop_sparse_read": 0, 2024-09-10T22:38:10.920 INFO:teuthology.orchestra.run.smithi138.stdout: "osdop_clonerange": 0, 2024-09-10T22:38:10.920 INFO:teuthology.orchestra.run.smithi138.stdout: "osdop_getxattr": 1, 2024-09-10T22:38:10.920 INFO:teuthology.orchestra.run.smithi138.stdout: "osdop_setxattr": 0, 2024-09-10T22:38:10.920 INFO:teuthology.orchestra.run.smithi138.stdout: "osdop_cmpxattr": 0, 2024-09-10T22:38:10.920 INFO:teuthology.orchestra.run.smithi138.stdout: "osdop_rmxattr": 0, 2024-09-10T22:38:10.920 INFO:teuthology.orchestra.run.smithi138.stdout: "osdop_resetxattrs": 0, 2024-09-10T22:38:10.920 INFO:teuthology.orchestra.run.smithi138.stdout: "osdop_call": 0, 2024-09-10T22:38:10.920 INFO:teuthology.orchestra.run.smithi138.stdout: "osdop_watch": 0, 2024-09-10T22:38:10.920 INFO:teuthology.orchestra.run.smithi138.stdout: "osdop_notify": 0, 2024-09-10T22:38:10.920 INFO:teuthology.orchestra.run.smithi138.stdout: "osdop_src_cmpxattr": 0, 2024-09-10T22:38:10.920 INFO:teuthology.orchestra.run.smithi138.stdout: "osdop_pgls": 0, 2024-09-10T22:38:10.920 INFO:teuthology.orchestra.run.smithi138.stdout: "osdop_pgls_filter": 0, 2024-09-10T22:38:10.921 INFO:teuthology.orchestra.run.smithi138.stdout: "osdop_other": 0, 2024-09-10T22:38:10.921 INFO:teuthology.orchestra.run.smithi138.stdout: "linger_active": 0, 2024-09-10T22:38:10.921 INFO:teuthology.orchestra.run.smithi138.stdout: "linger_send": 0, 2024-09-10T22:38:10.921 INFO:teuthology.orchestra.run.smithi138.stdout: "linger_resend": 0, 2024-09-10T22:38:10.921 INFO:teuthology.orchestra.run.smithi138.stdout: "linger_ping": 0, 2024-09-10T22:38:10.921 INFO:teuthology.orchestra.run.smithi138.stdout: "poolop_active": 0, 2024-09-10T22:38:10.921 INFO:teuthology.orchestra.run.smithi138.stdout: "poolop_send": 0, 2024-09-10T22:38:10.921 INFO:teuthology.orchestra.run.smithi138.stdout: "poolop_resend": 0, 2024-09-10T22:38:10.921 INFO:teuthology.orchestra.run.smithi138.stdout: "poolstat_active": 0, 2024-09-10T22:38:10.921 INFO:teuthology.orchestra.run.smithi138.stdout: "poolstat_send": 0, 2024-09-10T22:38:10.922 INFO:teuthology.orchestra.run.smithi138.stdout: "poolstat_resend": 0, 2024-09-10T22:38:10.922 INFO:teuthology.orchestra.run.smithi138.stdout: "statfs_active": 0, 2024-09-10T22:38:10.922 INFO:teuthology.orchestra.run.smithi138.stdout: "statfs_send": 0, 2024-09-10T22:38:10.922 INFO:teuthology.orchestra.run.smithi138.stdout: "statfs_resend": 0, 2024-09-10T22:38:10.922 INFO:teuthology.orchestra.run.smithi138.stdout: "command_active": 0, 2024-09-10T22:38:10.922 INFO:teuthology.orchestra.run.smithi138.stdout: "command_send": 0, 2024-09-10T22:38:10.922 INFO:teuthology.orchestra.run.smithi138.stdout: "command_resend": 0, 2024-09-10T22:38:10.922 INFO:teuthology.orchestra.run.smithi138.stdout: "map_epoch": 77, 2024-09-10T22:38:10.922 INFO:teuthology.orchestra.run.smithi138.stdout: "map_full": 0, 2024-09-10T22:38:10.922 INFO:teuthology.orchestra.run.smithi138.stdout: "map_inc": 4, 2024-09-10T22:38:10.922 INFO:teuthology.orchestra.run.smithi138.stdout: "osd_sessions": 4, 2024-09-10T22:38:10.922 INFO:teuthology.orchestra.run.smithi138.stdout: "osd_session_open": 4, 2024-09-10T22:38:10.923 INFO:teuthology.orchestra.run.smithi138.stdout: "osd_session_close": 0, 2024-09-10T22:38:10.923 INFO:teuthology.orchestra.run.smithi138.stdout: "osd_laggy": 0, 2024-09-10T22:38:10.923 INFO:teuthology.orchestra.run.smithi138.stdout: "omap_wr": 0, 2024-09-10T22:38:10.923 INFO:teuthology.orchestra.run.smithi138.stdout: "omap_rd": 2, 2024-09-10T22:38:10.923 INFO:teuthology.orchestra.run.smithi138.stdout: "omap_del": 0 2024-09-10T22:38:10.923 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-09-10T22:38:10.923 INFO:teuthology.orchestra.run.smithi138.stdout: "oft": { 2024-09-10T22:38:10.923 INFO:teuthology.orchestra.run.smithi138.stdout: "omap_total_objs": 0, 2024-09-10T22:38:10.924 INFO:teuthology.orchestra.run.smithi138.stdout: "omap_total_kv_pairs": 0, 2024-09-10T22:38:10.924 INFO:teuthology.orchestra.run.smithi138.stdout: "omap_total_updates": 0, 2024-09-10T22:38:10.924 INFO:teuthology.orchestra.run.smithi138.stdout: "omap_total_removes": 0 2024-09-10T22:38:10.924 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-09-10T22:38:10.924 INFO:teuthology.orchestra.run.smithi138.stdout: "purge_queue": { 2024-09-10T22:38:10.924 INFO:teuthology.orchestra.run.smithi138.stdout: "pq_executing_ops": 0, 2024-09-10T22:38:10.924 INFO:teuthology.orchestra.run.smithi138.stdout: "pq_executing_ops_high_water": 0, 2024-09-10T22:38:10.924 INFO:teuthology.orchestra.run.smithi138.stdout: "pq_executing": 0, 2024-09-10T22:38:10.924 INFO:teuthology.orchestra.run.smithi138.stdout: "pq_executing_high_water": 0, 2024-09-10T22:38:10.924 INFO:teuthology.orchestra.run.smithi138.stdout: "pq_executed_ops": 0, 2024-09-10T22:38:10.924 INFO:teuthology.orchestra.run.smithi138.stdout: "pq_executed": 0, 2024-09-10T22:38:10.924 INFO:teuthology.orchestra.run.smithi138.stdout: "pq_item_in_journal": 0 2024-09-10T22:38:10.924 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-09-10T22:38:10.925 INFO:teuthology.orchestra.run.smithi138.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-10T22:38:10.925 INFO:teuthology.orchestra.run.smithi138.stdout: "val": 0, 2024-09-10T22:38:10.925 INFO:teuthology.orchestra.run.smithi138.stdout: "max": 104857600, 2024-09-10T22:38:10.925 INFO:teuthology.orchestra.run.smithi138.stdout: "get_started": 0, 2024-09-10T22:38:10.925 INFO:teuthology.orchestra.run.smithi138.stdout: "get": 2620, 2024-09-10T22:38:10.925 INFO:teuthology.orchestra.run.smithi138.stdout: "get_sum": 1013692, 2024-09-10T22:38:10.925 INFO:teuthology.orchestra.run.smithi138.stdout: "get_or_fail_fail": 0, 2024-09-10T22:38:10.925 INFO:teuthology.orchestra.run.smithi138.stdout: "get_or_fail_success": 2620, 2024-09-10T22:38:10.925 INFO:teuthology.orchestra.run.smithi138.stdout: "take": 0, 2024-09-10T22:38:10.925 INFO:teuthology.orchestra.run.smithi138.stdout: "take_sum": 0, 2024-09-10T22:38:10.925 INFO:teuthology.orchestra.run.smithi138.stdout: "put": 2620, 2024-09-10T22:38:10.925 INFO:teuthology.orchestra.run.smithi138.stdout: "put_sum": 1013692, 2024-09-10T22:38:10.925 INFO:teuthology.orchestra.run.smithi138.stdout: "wait": { 2024-09-10T22:38:10.925 INFO:teuthology.orchestra.run.smithi138.stdout: "avgcount": 0, 2024-09-10T22:38:10.926 INFO:teuthology.orchestra.run.smithi138.stdout: "sum": 0.000000000, 2024-09-10T22:38:10.926 INFO:teuthology.orchestra.run.smithi138.stdout: "avgtime": 0.000000000 2024-09-10T22:38:10.926 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-09-10T22:38:10.926 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-09-10T22:38:10.926 INFO:teuthology.orchestra.run.smithi138.stdout: "throttle-objecter_bytes": { 2024-09-10T22:38:10.926 INFO:teuthology.orchestra.run.smithi138.stdout: "val": 0, 2024-09-10T22:38:10.926 INFO:teuthology.orchestra.run.smithi138.stdout: "max": 104857600, 2024-09-10T22:38:10.926 INFO:teuthology.orchestra.run.smithi138.stdout: "get_started": 0, 2024-09-10T22:38:10.926 INFO:teuthology.orchestra.run.smithi138.stdout: "get": 0, 2024-09-10T22:38:10.926 INFO:teuthology.orchestra.run.smithi138.stdout: "get_sum": 0, 2024-09-10T22:38:10.926 INFO:teuthology.orchestra.run.smithi138.stdout: "get_or_fail_fail": 0, 2024-09-10T22:38:10.926 INFO:teuthology.orchestra.run.smithi138.stdout: "get_or_fail_success": 0, 2024-09-10T22:38:10.926 INFO:teuthology.orchestra.run.smithi138.stdout: "take": 2372, 2024-09-10T22:38:10.926 INFO:teuthology.orchestra.run.smithi138.stdout: "take_sum": 25802, 2024-09-10T22:38:10.926 INFO:teuthology.orchestra.run.smithi138.stdout: "put": 2372, 2024-09-10T22:38:10.927 INFO:teuthology.orchestra.run.smithi138.stdout: "put_sum": 25802, 2024-09-10T22:38:10.927 INFO:teuthology.orchestra.run.smithi138.stdout: "wait": { 2024-09-10T22:38:10.927 INFO:teuthology.orchestra.run.smithi138.stdout: "avgcount": 0, 2024-09-10T22:38:10.927 INFO:teuthology.orchestra.run.smithi138.stdout: "sum": 0.000000000, 2024-09-10T22:38:10.927 INFO:teuthology.orchestra.run.smithi138.stdout: "avgtime": 0.000000000 2024-09-10T22:38:10.927 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-09-10T22:38:10.927 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-09-10T22:38:10.927 INFO:teuthology.orchestra.run.smithi138.stdout: "throttle-objecter_ops": { 2024-09-10T22:38:10.927 INFO:teuthology.orchestra.run.smithi138.stdout: "val": 0, 2024-09-10T22:38:10.927 INFO:teuthology.orchestra.run.smithi138.stdout: "max": 1024, 2024-09-10T22:38:10.927 INFO:teuthology.orchestra.run.smithi138.stdout: "get_started": 0, 2024-09-10T22:38:10.927 INFO:teuthology.orchestra.run.smithi138.stdout: "get": 0, 2024-09-10T22:38:10.928 INFO:teuthology.orchestra.run.smithi138.stdout: "get_sum": 0, 2024-09-10T22:38:10.928 INFO:teuthology.orchestra.run.smithi138.stdout: "get_or_fail_fail": 0, 2024-09-10T22:38:10.928 INFO:teuthology.orchestra.run.smithi138.stdout: "get_or_fail_success": 0, 2024-09-10T22:38:10.928 INFO:teuthology.orchestra.run.smithi138.stdout: "take": 2372, 2024-09-10T22:38:10.928 INFO:teuthology.orchestra.run.smithi138.stdout: "take_sum": 2372, 2024-09-10T22:38:10.928 INFO:teuthology.orchestra.run.smithi138.stdout: "put": 2372, 2024-09-10T22:38:10.928 INFO:teuthology.orchestra.run.smithi138.stdout: "put_sum": 2372, 2024-09-10T22:38:10.928 INFO:teuthology.orchestra.run.smithi138.stdout: "wait": { 2024-09-10T22:38:10.928 INFO:teuthology.orchestra.run.smithi138.stdout: "avgcount": 0, 2024-09-10T22:38:10.928 INFO:teuthology.orchestra.run.smithi138.stdout: "sum": 0.000000000, 2024-09-10T22:38:10.928 INFO:teuthology.orchestra.run.smithi138.stdout: "avgtime": 0.000000000 2024-09-10T22:38:10.929 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-09-10T22:38:10.929 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-09-10T22:38:10.929 INFO:teuthology.orchestra.run.smithi138.stdout: "throttle-write_buf_throttle": { 2024-09-10T22:38:10.929 INFO:teuthology.orchestra.run.smithi138.stdout: "val": 0, 2024-09-10T22:38:10.929 INFO:teuthology.orchestra.run.smithi138.stdout: "max": 3758096384, 2024-09-10T22:38:10.929 INFO:teuthology.orchestra.run.smithi138.stdout: "get_started": 0, 2024-09-10T22:38:10.929 INFO:teuthology.orchestra.run.smithi138.stdout: "get": 0, 2024-09-10T22:38:10.929 INFO:teuthology.orchestra.run.smithi138.stdout: "get_sum": 0, 2024-09-10T22:38:10.929 INFO:teuthology.orchestra.run.smithi138.stdout: "get_or_fail_fail": 0, 2024-09-10T22:38:10.929 INFO:teuthology.orchestra.run.smithi138.stdout: "get_or_fail_success": 0, 2024-09-10T22:38:10.929 INFO:teuthology.orchestra.run.smithi138.stdout: "take": 0, 2024-09-10T22:38:10.929 INFO:teuthology.orchestra.run.smithi138.stdout: "take_sum": 0, 2024-09-10T22:38:10.929 INFO:teuthology.orchestra.run.smithi138.stdout: "put": 0, 2024-09-10T22:38:10.929 INFO:teuthology.orchestra.run.smithi138.stdout: "put_sum": 0, 2024-09-10T22:38:10.930 INFO:teuthology.orchestra.run.smithi138.stdout: "wait": { 2024-09-10T22:38:10.930 INFO:teuthology.orchestra.run.smithi138.stdout: "avgcount": 0, 2024-09-10T22:38:10.930 INFO:teuthology.orchestra.run.smithi138.stdout: "sum": 0.000000000, 2024-09-10T22:38:10.930 INFO:teuthology.orchestra.run.smithi138.stdout: "avgtime": 0.000000000 2024-09-10T22:38:10.930 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-09-10T22:38:10.930 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-09-10T22:38:10.930 INFO:teuthology.orchestra.run.smithi138.stdout: "throttle-write_buf_throttle-0x55bf14179040": { 2024-09-10T22:38:10.930 INFO:teuthology.orchestra.run.smithi138.stdout: "val": 0, 2024-09-10T22:38:10.930 INFO:teuthology.orchestra.run.smithi138.stdout: "max": 3758096384, 2024-09-10T22:38:10.930 INFO:teuthology.orchestra.run.smithi138.stdout: "get_started": 0, 2024-09-10T22:38:10.930 INFO:teuthology.orchestra.run.smithi138.stdout: "get": 0, 2024-09-10T22:38:10.930 INFO:teuthology.orchestra.run.smithi138.stdout: "get_sum": 0, 2024-09-10T22:38:10.930 INFO:teuthology.orchestra.run.smithi138.stdout: "get_or_fail_fail": 0, 2024-09-10T22:38:10.930 INFO:teuthology.orchestra.run.smithi138.stdout: "get_or_fail_success": 0, 2024-09-10T22:38:10.931 INFO:teuthology.orchestra.run.smithi138.stdout: "take": 0, 2024-09-10T22:38:10.931 INFO:teuthology.orchestra.run.smithi138.stdout: "take_sum": 0, 2024-09-10T22:38:10.931 INFO:teuthology.orchestra.run.smithi138.stdout: "put": 0, 2024-09-10T22:38:10.931 INFO:teuthology.orchestra.run.smithi138.stdout: "put_sum": 0, 2024-09-10T22:38:10.931 INFO:teuthology.orchestra.run.smithi138.stdout: "wait": { 2024-09-10T22:38:10.931 INFO:teuthology.orchestra.run.smithi138.stdout: "avgcount": 0, 2024-09-10T22:38:10.931 INFO:teuthology.orchestra.run.smithi138.stdout: "sum": 0.000000000, 2024-09-10T22:38:10.931 INFO:teuthology.orchestra.run.smithi138.stdout: "avgtime": 0.000000000 2024-09-10T22:38:10.931 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-09-10T22:38:10.931 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-09-10T22:38:10.931 INFO:teuthology.orchestra.run.smithi138.stdout: "trackedop": { 2024-09-10T22:38:10.932 INFO:teuthology.orchestra.run.smithi138.stdout: "slow_ops_count": 0 2024-09-10T22:38:10.932 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-09-10T22:38:10.932 INFO:teuthology.orchestra.run.smithi138.stdout:} 2024-09-10T22:38:11.762 INFO:tasks.check_counter:Daemon mds.f mds.exported=0 2024-09-10T22:38:11.762 INFO:tasks.check_counter:Daemon mds.f mds.imported=0 2024-09-10T22:38:11.762 INFO:tasks.check_counter:Daemon mds.f mds_cache.dir_update=0 2024-09-10T22:38:11.762 INFO:tasks.check_counter:Daemon mds.f mds_cache.dir_update_receipt=0 2024-09-10T22:38:11.762 DEBUG:tasks.check_counter:Getting stats from i 2024-09-10T22:38:11.763 DEBUG:teuthology.orchestra.run.smithi138:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 22997a4c-6fc2-11ef-bcea-c7b262605968 -- ceph daemon mds.i perf dump 2024-09-10T22:38:12.120 INFO:teuthology.orchestra.run.smithi138.stderr:Inferring config /var/lib/ceph/22997a4c-6fc2-11ef-bcea-c7b262605968/mon.c/config 2024-09-10T22:38:12.360 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:38:12 smithi135 ceph-mon[34789]: pgmap v700: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 38 MiB/s wr, 383 op/s 2024-09-10T22:38:12.375 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:38:12 smithi138 ceph-mon[35236]: pgmap v700: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 38 MiB/s wr, 383 op/s 2024-09-10T22:38:12.458 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:38:12 smithi019 ceph-mon[31375]: pgmap v700: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 38 MiB/s wr, 383 op/s 2024-09-10T22:38:12.651 INFO:teuthology.orchestra.run.smithi138.stdout:{ 2024-09-10T22:38:12.652 INFO:teuthology.orchestra.run.smithi138.stdout: "AsyncMessenger::Worker-0": { 2024-09-10T22:38:12.652 INFO:teuthology.orchestra.run.smithi138.stdout: "msgr_recv_messages": 143, 2024-09-10T22:38:12.652 INFO:teuthology.orchestra.run.smithi138.stdout: "msgr_send_messages": 148, 2024-09-10T22:38:12.652 INFO:teuthology.orchestra.run.smithi138.stdout: "msgr_recv_bytes": 60591, 2024-09-10T22:38:12.652 INFO:teuthology.orchestra.run.smithi138.stdout: "msgr_send_bytes": 140505, 2024-09-10T22:38:12.652 INFO:teuthology.orchestra.run.smithi138.stdout: "msgr_created_connections": 14, 2024-09-10T22:38:12.652 INFO:teuthology.orchestra.run.smithi138.stdout: "msgr_active_connections": 4, 2024-09-10T22:38:12.652 INFO:teuthology.orchestra.run.smithi138.stdout: "msgr_running_total_time": 0.028896778, 2024-09-10T22:38:12.652 INFO:teuthology.orchestra.run.smithi138.stdout: "msgr_running_send_time": 0.007911546, 2024-09-10T22:38:12.653 INFO:teuthology.orchestra.run.smithi138.stdout: "msgr_running_recv_time": 0.016389999, 2024-09-10T22:38:12.653 INFO:teuthology.orchestra.run.smithi138.stdout: "msgr_running_fast_dispatch_time": 0.001370805, 2024-09-10T22:38:12.653 INFO:teuthology.orchestra.run.smithi138.stdout: "msgr_send_messages_queue_lat": { 2024-09-10T22:38:12.653 INFO:teuthology.orchestra.run.smithi138.stdout: "avgcount": 147, 2024-09-10T22:38:12.653 INFO:teuthology.orchestra.run.smithi138.stdout: "sum": 0.027214673, 2024-09-10T22:38:12.653 INFO:teuthology.orchestra.run.smithi138.stdout: "avgtime": 0.000185133 2024-09-10T22:38:12.653 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-09-10T22:38:12.653 INFO:teuthology.orchestra.run.smithi138.stdout: "msgr_handle_ack_lat": { 2024-09-10T22:38:12.653 INFO:teuthology.orchestra.run.smithi138.stdout: "avgcount": 165, 2024-09-10T22:38:12.653 INFO:teuthology.orchestra.run.smithi138.stdout: "sum": 0.000037813, 2024-09-10T22:38:12.653 INFO:teuthology.orchestra.run.smithi138.stdout: "avgtime": 0.000000229 2024-09-10T22:38:12.653 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-09-10T22:38:12.654 INFO:teuthology.orchestra.run.smithi138.stdout: "msgr_recv_encrypted_bytes": 8896, 2024-09-10T22:38:12.654 INFO:teuthology.orchestra.run.smithi138.stdout: "msgr_send_encrypted_bytes": 10880 2024-09-10T22:38:12.654 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-09-10T22:38:12.654 INFO:teuthology.orchestra.run.smithi138.stdout: "AsyncMessenger::Worker-1": { 2024-09-10T22:38:12.654 INFO:teuthology.orchestra.run.smithi138.stdout: "msgr_recv_messages": 1674, 2024-09-10T22:38:12.654 INFO:teuthology.orchestra.run.smithi138.stdout: "msgr_send_messages": 1223, 2024-09-10T22:38:12.654 INFO:teuthology.orchestra.run.smithi138.stdout: "msgr_recv_bytes": 418837, 2024-09-10T22:38:12.654 INFO:teuthology.orchestra.run.smithi138.stdout: "msgr_send_bytes": 737225, 2024-09-10T22:38:12.654 INFO:teuthology.orchestra.run.smithi138.stdout: "msgr_created_connections": 7, 2024-09-10T22:38:12.654 INFO:teuthology.orchestra.run.smithi138.stdout: "msgr_active_connections": 4, 2024-09-10T22:38:12.654 INFO:teuthology.orchestra.run.smithi138.stdout: "msgr_running_total_time": 0.122992603, 2024-09-10T22:38:12.654 INFO:teuthology.orchestra.run.smithi138.stdout: "msgr_running_send_time": 0.058510169, 2024-09-10T22:38:12.654 INFO:teuthology.orchestra.run.smithi138.stdout: "msgr_running_recv_time": 0.076573544, 2024-09-10T22:38:12.655 INFO:teuthology.orchestra.run.smithi138.stdout: "msgr_running_fast_dispatch_time": 0.005136366, 2024-09-10T22:38:12.655 INFO:teuthology.orchestra.run.smithi138.stdout: "msgr_send_messages_queue_lat": { 2024-09-10T22:38:12.655 INFO:teuthology.orchestra.run.smithi138.stdout: "avgcount": 1223, 2024-09-10T22:38:12.655 INFO:teuthology.orchestra.run.smithi138.stdout: "sum": 0.051577580, 2024-09-10T22:38:12.655 INFO:teuthology.orchestra.run.smithi138.stdout: "avgtime": 0.000042173 2024-09-10T22:38:12.655 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-09-10T22:38:12.655 INFO:teuthology.orchestra.run.smithi138.stdout: "msgr_handle_ack_lat": { 2024-09-10T22:38:12.655 INFO:teuthology.orchestra.run.smithi138.stdout: "avgcount": 2617, 2024-09-10T22:38:12.655 INFO:teuthology.orchestra.run.smithi138.stdout: "sum": 0.000567321, 2024-09-10T22:38:12.655 INFO:teuthology.orchestra.run.smithi138.stdout: "avgtime": 0.000000216 2024-09-10T22:38:12.655 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-09-10T22:38:12.655 INFO:teuthology.orchestra.run.smithi138.stdout: "msgr_recv_encrypted_bytes": 160, 2024-09-10T22:38:12.655 INFO:teuthology.orchestra.run.smithi138.stdout: "msgr_send_encrypted_bytes": 391216 2024-09-10T22:38:12.655 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-09-10T22:38:12.656 INFO:teuthology.orchestra.run.smithi138.stdout: "AsyncMessenger::Worker-2": { 2024-09-10T22:38:12.656 INFO:teuthology.orchestra.run.smithi138.stdout: "msgr_recv_messages": 363, 2024-09-10T22:38:12.656 INFO:teuthology.orchestra.run.smithi138.stdout: "msgr_send_messages": 354, 2024-09-10T22:38:12.656 INFO:teuthology.orchestra.run.smithi138.stdout: "msgr_recv_bytes": 599559, 2024-09-10T22:38:12.656 INFO:teuthology.orchestra.run.smithi138.stdout: "msgr_send_bytes": 545223, 2024-09-10T22:38:12.656 INFO:teuthology.orchestra.run.smithi138.stdout: "msgr_created_connections": 36, 2024-09-10T22:38:12.656 INFO:teuthology.orchestra.run.smithi138.stdout: "msgr_active_connections": 8, 2024-09-10T22:38:12.656 INFO:teuthology.orchestra.run.smithi138.stdout: "msgr_running_total_time": 0.052474511, 2024-09-10T22:38:12.656 INFO:teuthology.orchestra.run.smithi138.stdout: "msgr_running_send_time": 0.022722710, 2024-09-10T22:38:12.656 INFO:teuthology.orchestra.run.smithi138.stdout: "msgr_running_recv_time": 0.033750891, 2024-09-10T22:38:12.656 INFO:teuthology.orchestra.run.smithi138.stdout: "msgr_running_fast_dispatch_time": 0.000820265, 2024-09-10T22:38:12.656 INFO:teuthology.orchestra.run.smithi138.stdout: "msgr_send_messages_queue_lat": { 2024-09-10T22:38:12.657 INFO:teuthology.orchestra.run.smithi138.stdout: "avgcount": 351, 2024-09-10T22:38:12.657 INFO:teuthology.orchestra.run.smithi138.stdout: "sum": 0.026369526, 2024-09-10T22:38:12.657 INFO:teuthology.orchestra.run.smithi138.stdout: "avgtime": 0.000075126 2024-09-10T22:38:12.657 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-09-10T22:38:12.657 INFO:teuthology.orchestra.run.smithi138.stdout: "msgr_handle_ack_lat": { 2024-09-10T22:38:12.657 INFO:teuthology.orchestra.run.smithi138.stdout: "avgcount": 30, 2024-09-10T22:38:12.657 INFO:teuthology.orchestra.run.smithi138.stdout: "sum": 0.000004449, 2024-09-10T22:38:12.657 INFO:teuthology.orchestra.run.smithi138.stdout: "avgtime": 0.000000148 2024-09-10T22:38:12.657 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-09-10T22:38:12.657 INFO:teuthology.orchestra.run.smithi138.stdout: "msgr_recv_encrypted_bytes": 582064, 2024-09-10T22:38:12.658 INFO:teuthology.orchestra.run.smithi138.stdout: "msgr_send_encrypted_bytes": 156912 2024-09-10T22:38:12.658 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-09-10T22:38:12.658 INFO:teuthology.orchestra.run.smithi138.stdout: "cct": { 2024-09-10T22:38:12.658 INFO:teuthology.orchestra.run.smithi138.stdout: "total_workers": 1, 2024-09-10T22:38:12.658 INFO:teuthology.orchestra.run.smithi138.stdout: "unhealthy_workers": 0 2024-09-10T22:38:12.658 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-09-10T22:38:12.658 INFO:teuthology.orchestra.run.smithi138.stdout: "finisher-MDSRank": { 2024-09-10T22:38:12.658 INFO:teuthology.orchestra.run.smithi138.stdout: "queue_len": 0, 2024-09-10T22:38:12.658 INFO:teuthology.orchestra.run.smithi138.stdout: "complete_latency": { 2024-09-10T22:38:12.658 INFO:teuthology.orchestra.run.smithi138.stdout: "avgcount": 91, 2024-09-10T22:38:12.659 INFO:teuthology.orchestra.run.smithi138.stdout: "sum": 0.008059717, 2024-09-10T22:38:12.659 INFO:teuthology.orchestra.run.smithi138.stdout: "avgtime": 0.000088568 2024-09-10T22:38:12.659 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-09-10T22:38:12.659 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-09-10T22:38:12.659 INFO:teuthology.orchestra.run.smithi138.stdout: "finisher-PurgeQueue": { 2024-09-10T22:38:12.659 INFO:teuthology.orchestra.run.smithi138.stdout: "queue_len": 0, 2024-09-10T22:38:12.659 INFO:teuthology.orchestra.run.smithi138.stdout: "complete_latency": { 2024-09-10T22:38:12.659 INFO:teuthology.orchestra.run.smithi138.stdout: "avgcount": 17, 2024-09-10T22:38:12.660 INFO:teuthology.orchestra.run.smithi138.stdout: "sum": 0.000415676, 2024-09-10T22:38:12.660 INFO:teuthology.orchestra.run.smithi138.stdout: "avgtime": 0.000024451 2024-09-10T22:38:12.660 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-09-10T22:38:12.660 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-09-10T22:38:12.660 INFO:teuthology.orchestra.run.smithi138.stdout: "mds": { 2024-09-10T22:38:12.660 INFO:teuthology.orchestra.run.smithi138.stdout: "request": 5, 2024-09-10T22:38:12.660 INFO:teuthology.orchestra.run.smithi138.stdout: "reply": 4, 2024-09-10T22:38:12.661 INFO:teuthology.orchestra.run.smithi138.stdout: "reply_latency": { 2024-09-10T22:38:12.661 INFO:teuthology.orchestra.run.smithi138.stdout: "avgcount": 4, 2024-09-10T22:38:12.661 INFO:teuthology.orchestra.run.smithi138.stdout: "sum": 0.003354389, 2024-09-10T22:38:12.661 INFO:teuthology.orchestra.run.smithi138.stdout: "avgtime": 0.000838597 2024-09-10T22:38:12.661 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-09-10T22:38:12.661 INFO:teuthology.orchestra.run.smithi138.stdout: "slow_reply": 0, 2024-09-10T22:38:12.662 INFO:teuthology.orchestra.run.smithi138.stdout: "forward": 1, 2024-09-10T22:38:12.662 INFO:teuthology.orchestra.run.smithi138.stdout: "dir_fetch_complete": 0, 2024-09-10T22:38:12.662 INFO:teuthology.orchestra.run.smithi138.stdout: "dir_fetch_keys": 0, 2024-09-10T22:38:12.662 INFO:teuthology.orchestra.run.smithi138.stdout: "dir_commit": 11, 2024-09-10T22:38:12.662 INFO:teuthology.orchestra.run.smithi138.stdout: "dir_split": 0, 2024-09-10T22:38:12.662 INFO:teuthology.orchestra.run.smithi138.stdout: "dir_merge": 0, 2024-09-10T22:38:12.662 INFO:teuthology.orchestra.run.smithi138.stdout: "inodes": 16, 2024-09-10T22:38:12.662 INFO:teuthology.orchestra.run.smithi138.stdout: "inodes_top": 1, 2024-09-10T22:38:12.663 INFO:teuthology.orchestra.run.smithi138.stdout: "inodes_bottom": 15, 2024-09-10T22:38:12.663 INFO:teuthology.orchestra.run.smithi138.stdout: "inodes_pin_tail": 0, 2024-09-10T22:38:12.663 INFO:teuthology.orchestra.run.smithi138.stdout: "inodes_pinned": 13, 2024-09-10T22:38:12.663 INFO:teuthology.orchestra.run.smithi138.stdout: "inodes_expired": 8, 2024-09-10T22:38:12.663 INFO:teuthology.orchestra.run.smithi138.stdout: "inodes_with_caps": 0, 2024-09-10T22:38:12.663 INFO:teuthology.orchestra.run.smithi138.stdout: "caps": 0, 2024-09-10T22:38:12.663 INFO:teuthology.orchestra.run.smithi138.stdout: "subtrees": 3, 2024-09-10T22:38:12.663 INFO:teuthology.orchestra.run.smithi138.stdout: "traverse": 44, 2024-09-10T22:38:12.663 INFO:teuthology.orchestra.run.smithi138.stdout: "traverse_hit": 36, 2024-09-10T22:38:12.663 INFO:teuthology.orchestra.run.smithi138.stdout: "traverse_forward": 1, 2024-09-10T22:38:12.663 INFO:teuthology.orchestra.run.smithi138.stdout: "traverse_discover": 4, 2024-09-10T22:38:12.663 INFO:teuthology.orchestra.run.smithi138.stdout: "traverse_dir_fetch": 0, 2024-09-10T22:38:12.664 INFO:teuthology.orchestra.run.smithi138.stdout: "traverse_remote_ino": 0, 2024-09-10T22:38:12.664 INFO:teuthology.orchestra.run.smithi138.stdout: "traverse_lock": 0, 2024-09-10T22:38:12.664 INFO:teuthology.orchestra.run.smithi138.stdout: "load_cent": 0, 2024-09-10T22:38:12.664 INFO:teuthology.orchestra.run.smithi138.stdout: "q": 0, 2024-09-10T22:38:12.664 INFO:teuthology.orchestra.run.smithi138.stdout: "exported": 1, 2024-09-10T22:38:12.664 INFO:teuthology.orchestra.run.smithi138.stdout: "exported_inodes": 0, 2024-09-10T22:38:12.664 INFO:teuthology.orchestra.run.smithi138.stdout: "imported": 1, 2024-09-10T22:38:12.664 INFO:teuthology.orchestra.run.smithi138.stdout: "imported_inodes": 2, 2024-09-10T22:38:12.664 INFO:teuthology.orchestra.run.smithi138.stdout: "openino_dir_fetch": 0, 2024-09-10T22:38:12.664 INFO:teuthology.orchestra.run.smithi138.stdout: "openino_backtrace_fetch": 26, 2024-09-10T22:38:12.664 INFO:teuthology.orchestra.run.smithi138.stdout: "openino_peer_discover": 0, 2024-09-10T22:38:12.664 INFO:teuthology.orchestra.run.smithi138.stdout: "root_rfiles": 22, 2024-09-10T22:38:12.664 INFO:teuthology.orchestra.run.smithi138.stdout: "root_rbytes": 10738144011, 2024-09-10T22:38:12.665 INFO:teuthology.orchestra.run.smithi138.stdout: "root_rsnaps": 0, 2024-09-10T22:38:12.665 INFO:teuthology.orchestra.run.smithi138.stdout: "scrub_backtrace_fetch": 26, 2024-09-10T22:38:12.665 INFO:teuthology.orchestra.run.smithi138.stdout: "scrub_set_tag": 0, 2024-09-10T22:38:12.665 INFO:teuthology.orchestra.run.smithi138.stdout: "scrub_backtrace_repaired": 0, 2024-09-10T22:38:12.665 INFO:teuthology.orchestra.run.smithi138.stdout: "scrub_inotable_repaired": 0, 2024-09-10T22:38:12.665 INFO:teuthology.orchestra.run.smithi138.stdout: "scrub_dir_inodes": 0, 2024-09-10T22:38:12.665 INFO:teuthology.orchestra.run.smithi138.stdout: "scrub_dir_base_inodes": 0, 2024-09-10T22:38:12.665 INFO:teuthology.orchestra.run.smithi138.stdout: "scrub_dirfrag_rstats": 0, 2024-09-10T22:38:12.665 INFO:teuthology.orchestra.run.smithi138.stdout: "scrub_file_inodes": 26, 2024-09-10T22:38:12.665 INFO:teuthology.orchestra.run.smithi138.stdout: "handle_inode_file_caps": 0, 2024-09-10T22:38:12.665 INFO:teuthology.orchestra.run.smithi138.stdout: "ceph_cap_op_revoke": 5, 2024-09-10T22:38:12.665 INFO:teuthology.orchestra.run.smithi138.stdout: "ceph_cap_op_grant": 3, 2024-09-10T22:38:12.665 INFO:teuthology.orchestra.run.smithi138.stdout: "ceph_cap_op_trunc": 0, 2024-09-10T22:38:12.666 INFO:teuthology.orchestra.run.smithi138.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-10T22:38:12.666 INFO:teuthology.orchestra.run.smithi138.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-10T22:38:12.666 INFO:teuthology.orchestra.run.smithi138.stdout: "handle_client_caps": 5, 2024-09-10T22:38:12.666 INFO:teuthology.orchestra.run.smithi138.stdout: "handle_client_caps_dirty": 0, 2024-09-10T22:38:12.666 INFO:teuthology.orchestra.run.smithi138.stdout: "handle_client_cap_release": 2, 2024-09-10T22:38:12.666 INFO:teuthology.orchestra.run.smithi138.stdout: "process_request_cap_release": 4 2024-09-10T22:38:12.666 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-09-10T22:38:12.666 INFO:teuthology.orchestra.run.smithi138.stdout: "mds_cache": { 2024-09-10T22:38:12.666 INFO:teuthology.orchestra.run.smithi138.stdout: "dir_update": 1, 2024-09-10T22:38:12.666 INFO:teuthology.orchestra.run.smithi138.stdout: "dir_update_receipt": 11, 2024-09-10T22:38:12.666 INFO:teuthology.orchestra.run.smithi138.stdout: "dir_try_discover": 7, 2024-09-10T22:38:12.666 INFO:teuthology.orchestra.run.smithi138.stdout: "dir_send_discover": 9, 2024-09-10T22:38:12.666 INFO:teuthology.orchestra.run.smithi138.stdout: "dir_handle_discover": 1, 2024-09-10T22:38:12.666 INFO:teuthology.orchestra.run.smithi138.stdout: "num_strays": 0, 2024-09-10T22:38:12.667 INFO:teuthology.orchestra.run.smithi138.stdout: "num_strays_delayed": 0, 2024-09-10T22:38:12.667 INFO:teuthology.orchestra.run.smithi138.stdout: "num_strays_enqueuing": 0, 2024-09-10T22:38:12.667 INFO:teuthology.orchestra.run.smithi138.stdout: "strays_created": 2, 2024-09-10T22:38:12.667 INFO:teuthology.orchestra.run.smithi138.stdout: "strays_enqueued": 2, 2024-09-10T22:38:12.667 INFO:teuthology.orchestra.run.smithi138.stdout: "strays_reintegrated": 0, 2024-09-10T22:38:12.667 INFO:teuthology.orchestra.run.smithi138.stdout: "strays_migrated": 0, 2024-09-10T22:38:12.667 INFO:teuthology.orchestra.run.smithi138.stdout: "num_recovering_processing": 0, 2024-09-10T22:38:12.667 INFO:teuthology.orchestra.run.smithi138.stdout: "num_recovering_enqueued": 0, 2024-09-10T22:38:12.667 INFO:teuthology.orchestra.run.smithi138.stdout: "num_recovering_prioritized": 0, 2024-09-10T22:38:12.667 INFO:teuthology.orchestra.run.smithi138.stdout: "recovery_started": 0, 2024-09-10T22:38:12.667 INFO:teuthology.orchestra.run.smithi138.stdout: "recovery_completed": 0, 2024-09-10T22:38:12.667 INFO:teuthology.orchestra.run.smithi138.stdout: "ireq_quiesce_path": 0, 2024-09-10T22:38:12.667 INFO:teuthology.orchestra.run.smithi138.stdout: "ireq_quiesce_inode": 0, 2024-09-10T22:38:12.667 INFO:teuthology.orchestra.run.smithi138.stdout: "ireq_enqueue_scrub": 0, 2024-09-10T22:38:12.668 INFO:teuthology.orchestra.run.smithi138.stdout: "ireq_exportdir": 1, 2024-09-10T22:38:12.668 INFO:teuthology.orchestra.run.smithi138.stdout: "ireq_flush": 0, 2024-09-10T22:38:12.668 INFO:teuthology.orchestra.run.smithi138.stdout: "ireq_fragmentdir": 0, 2024-09-10T22:38:12.668 INFO:teuthology.orchestra.run.smithi138.stdout: "ireq_fragstats": 0, 2024-09-10T22:38:12.668 INFO:teuthology.orchestra.run.smithi138.stdout: "ireq_inodestats": 0, 2024-09-10T22:38:12.668 INFO:teuthology.orchestra.run.smithi138.stdout: "uninline_started": 0, 2024-09-10T22:38:12.668 INFO:teuthology.orchestra.run.smithi138.stdout: "uninline_succeeded": 0, 2024-09-10T22:38:12.668 INFO:teuthology.orchestra.run.smithi138.stdout: "uninline_write_failed": 0 2024-09-10T22:38:12.668 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-09-10T22:38:12.668 INFO:teuthology.orchestra.run.smithi138.stdout: "mds_log": { 2024-09-10T22:38:12.668 INFO:teuthology.orchestra.run.smithi138.stdout: "evlrg": 0, 2024-09-10T22:38:12.668 INFO:teuthology.orchestra.run.smithi138.stdout: "evadd": 17, 2024-09-10T22:38:12.668 INFO:teuthology.orchestra.run.smithi138.stdout: "evex": 0, 2024-09-10T22:38:12.669 INFO:teuthology.orchestra.run.smithi138.stdout: "evtrm": 0, 2024-09-10T22:38:12.669 INFO:teuthology.orchestra.run.smithi138.stdout: "ev": 17, 2024-09-10T22:38:12.669 INFO:teuthology.orchestra.run.smithi138.stdout: "evexg": 0, 2024-09-10T22:38:12.669 INFO:teuthology.orchestra.run.smithi138.stdout: "evexd": 0, 2024-09-10T22:38:12.669 INFO:teuthology.orchestra.run.smithi138.stdout: "segadd": 2, 2024-09-10T22:38:12.669 INFO:teuthology.orchestra.run.smithi138.stdout: "segex": 0, 2024-09-10T22:38:12.669 INFO:teuthology.orchestra.run.smithi138.stdout: "segtrm": 0, 2024-09-10T22:38:12.669 INFO:teuthology.orchestra.run.smithi138.stdout: "seg": 2, 2024-09-10T22:38:12.669 INFO:teuthology.orchestra.run.smithi138.stdout: "segmjr": 2, 2024-09-10T22:38:12.669 INFO:teuthology.orchestra.run.smithi138.stdout: "segexg": 0, 2024-09-10T22:38:12.669 INFO:teuthology.orchestra.run.smithi138.stdout: "segexd": 0, 2024-09-10T22:38:12.669 INFO:teuthology.orchestra.run.smithi138.stdout: "expos": 4194304, 2024-09-10T22:38:12.669 INFO:teuthology.orchestra.run.smithi138.stdout: "wrpos": 4220101, 2024-09-10T22:38:12.670 INFO:teuthology.orchestra.run.smithi138.stdout: "rdpos": 0, 2024-09-10T22:38:12.670 INFO:teuthology.orchestra.run.smithi138.stdout: "jlat": { 2024-09-10T22:38:12.670 INFO:teuthology.orchestra.run.smithi138.stdout: "avgcount": 13, 2024-09-10T22:38:12.670 INFO:teuthology.orchestra.run.smithi138.stdout: "sum": 1.025153157, 2024-09-10T22:38:12.670 INFO:teuthology.orchestra.run.smithi138.stdout: "avgtime": 0.078857935 2024-09-10T22:38:12.670 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-09-10T22:38:12.670 INFO:teuthology.orchestra.run.smithi138.stdout: "replayed": 0 2024-09-10T22:38:12.670 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-09-10T22:38:12.670 INFO:teuthology.orchestra.run.smithi138.stdout: "mds_mem": { 2024-09-10T22:38:12.670 INFO:teuthology.orchestra.run.smithi138.stdout: "ino": 20, 2024-09-10T22:38:12.670 INFO:teuthology.orchestra.run.smithi138.stdout: "ino+": 26, 2024-09-10T22:38:12.671 INFO:teuthology.orchestra.run.smithi138.stdout: "ino-": 6, 2024-09-10T22:38:12.671 INFO:teuthology.orchestra.run.smithi138.stdout: "dir": 19, 2024-09-10T22:38:12.671 INFO:teuthology.orchestra.run.smithi138.stdout: "dir+": 25, 2024-09-10T22:38:12.671 INFO:teuthology.orchestra.run.smithi138.stdout: "dir-": 6, 2024-09-10T22:38:12.671 INFO:teuthology.orchestra.run.smithi138.stdout: "dn": 16, 2024-09-10T22:38:12.671 INFO:teuthology.orchestra.run.smithi138.stdout: "dn+": 28, 2024-09-10T22:38:12.671 INFO:teuthology.orchestra.run.smithi138.stdout: "dn-": 12, 2024-09-10T22:38:12.671 INFO:teuthology.orchestra.run.smithi138.stdout: "cap": 0, 2024-09-10T22:38:12.671 INFO:teuthology.orchestra.run.smithi138.stdout: "cap+": 5, 2024-09-10T22:38:12.671 INFO:teuthology.orchestra.run.smithi138.stdout: "cap-": 5, 2024-09-10T22:38:12.671 INFO:teuthology.orchestra.run.smithi138.stdout: "rss": 51476, 2024-09-10T22:38:12.671 INFO:teuthology.orchestra.run.smithi138.stdout: "heap": 258732032 2024-09-10T22:38:12.671 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-09-10T22:38:12.671 INFO:teuthology.orchestra.run.smithi138.stdout: "mds_server": { 2024-09-10T22:38:12.672 INFO:teuthology.orchestra.run.smithi138.stdout: "dispatch_client_request": 8, 2024-09-10T22:38:12.672 INFO:teuthology.orchestra.run.smithi138.stdout: "dispatch_server_request": 1, 2024-09-10T22:38:12.672 INFO:teuthology.orchestra.run.smithi138.stdout: "handle_client_request": 5, 2024-09-10T22:38:12.672 INFO:teuthology.orchestra.run.smithi138.stdout: "handle_client_session": 10, 2024-09-10T22:38:12.672 INFO:teuthology.orchestra.run.smithi138.stdout: "handle_peer_request": 4, 2024-09-10T22:38:12.672 INFO:teuthology.orchestra.run.smithi138.stdout: "req_create_latency": { 2024-09-10T22:38:12.672 INFO:teuthology.orchestra.run.smithi138.stdout: "avgcount": 0, 2024-09-10T22:38:12.672 INFO:teuthology.orchestra.run.smithi138.stdout: "sum": 0.000000000, 2024-09-10T22:38:12.672 INFO:teuthology.orchestra.run.smithi138.stdout: "avgtime": 0.000000000 2024-09-10T22:38:12.672 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-09-10T22:38:12.672 INFO:teuthology.orchestra.run.smithi138.stdout: "req_getattr_latency": { 2024-09-10T22:38:12.672 INFO:teuthology.orchestra.run.smithi138.stdout: "avgcount": 0, 2024-09-10T22:38:12.673 INFO:teuthology.orchestra.run.smithi138.stdout: "sum": 0.000000000, 2024-09-10T22:38:12.673 INFO:teuthology.orchestra.run.smithi138.stdout: "avgtime": 0.000000000 2024-09-10T22:38:12.673 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-09-10T22:38:12.673 INFO:teuthology.orchestra.run.smithi138.stdout: "req_getfilelock_latency": { 2024-09-10T22:38:12.673 INFO:teuthology.orchestra.run.smithi138.stdout: "avgcount": 0, 2024-09-10T22:38:12.673 INFO:teuthology.orchestra.run.smithi138.stdout: "sum": 0.000000000, 2024-09-10T22:38:12.673 INFO:teuthology.orchestra.run.smithi138.stdout: "avgtime": 0.000000000 2024-09-10T22:38:12.673 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-09-10T22:38:12.673 INFO:teuthology.orchestra.run.smithi138.stdout: "req_link_latency": { 2024-09-10T22:38:12.673 INFO:teuthology.orchestra.run.smithi138.stdout: "avgcount": 0, 2024-09-10T22:38:12.673 INFO:teuthology.orchestra.run.smithi138.stdout: "sum": 0.000000000, 2024-09-10T22:38:12.674 INFO:teuthology.orchestra.run.smithi138.stdout: "avgtime": 0.000000000 2024-09-10T22:38:12.674 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-09-10T22:38:12.674 INFO:teuthology.orchestra.run.smithi138.stdout: "req_lookup_latency": { 2024-09-10T22:38:12.674 INFO:teuthology.orchestra.run.smithi138.stdout: "avgcount": 1, 2024-09-10T22:38:12.674 INFO:teuthology.orchestra.run.smithi138.stdout: "sum": 0.000243701, 2024-09-10T22:38:12.674 INFO:teuthology.orchestra.run.smithi138.stdout: "avgtime": 0.000243701 2024-09-10T22:38:12.674 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-09-10T22:38:12.674 INFO:teuthology.orchestra.run.smithi138.stdout: "req_lookuphash_latency": { 2024-09-10T22:38:12.674 INFO:teuthology.orchestra.run.smithi138.stdout: "avgcount": 0, 2024-09-10T22:38:12.674 INFO:teuthology.orchestra.run.smithi138.stdout: "sum": 0.000000000, 2024-09-10T22:38:12.674 INFO:teuthology.orchestra.run.smithi138.stdout: "avgtime": 0.000000000 2024-09-10T22:38:12.674 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-09-10T22:38:12.674 INFO:teuthology.orchestra.run.smithi138.stdout: "req_lookupino_latency": { 2024-09-10T22:38:12.675 INFO:teuthology.orchestra.run.smithi138.stdout: "avgcount": 0, 2024-09-10T22:38:12.675 INFO:teuthology.orchestra.run.smithi138.stdout: "sum": 0.000000000, 2024-09-10T22:38:12.675 INFO:teuthology.orchestra.run.smithi138.stdout: "avgtime": 0.000000000 2024-09-10T22:38:12.675 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-09-10T22:38:12.675 INFO:teuthology.orchestra.run.smithi138.stdout: "req_lookupname_latency": { 2024-09-10T22:38:12.675 INFO:teuthology.orchestra.run.smithi138.stdout: "avgcount": 0, 2024-09-10T22:38:12.675 INFO:teuthology.orchestra.run.smithi138.stdout: "sum": 0.000000000, 2024-09-10T22:38:12.675 INFO:teuthology.orchestra.run.smithi138.stdout: "avgtime": 0.000000000 2024-09-10T22:38:12.675 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-09-10T22:38:12.675 INFO:teuthology.orchestra.run.smithi138.stdout: "req_lookupparent_latency": { 2024-09-10T22:38:12.675 INFO:teuthology.orchestra.run.smithi138.stdout: "avgcount": 0, 2024-09-10T22:38:12.675 INFO:teuthology.orchestra.run.smithi138.stdout: "sum": 0.000000000, 2024-09-10T22:38:12.676 INFO:teuthology.orchestra.run.smithi138.stdout: "avgtime": 0.000000000 2024-09-10T22:38:12.676 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-09-10T22:38:12.676 INFO:teuthology.orchestra.run.smithi138.stdout: "req_lookupsnap_latency": { 2024-09-10T22:38:12.676 INFO:teuthology.orchestra.run.smithi138.stdout: "avgcount": 0, 2024-09-10T22:38:12.676 INFO:teuthology.orchestra.run.smithi138.stdout: "sum": 0.000000000, 2024-09-10T22:38:12.676 INFO:teuthology.orchestra.run.smithi138.stdout: "avgtime": 0.000000000 2024-09-10T22:38:12.676 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-09-10T22:38:12.676 INFO:teuthology.orchestra.run.smithi138.stdout: "req_lssnap_latency": { 2024-09-10T22:38:12.677 INFO:teuthology.orchestra.run.smithi138.stdout: "avgcount": 0, 2024-09-10T22:38:12.678 INFO:teuthology.orchestra.run.smithi138.stdout: "sum": 0.000000000, 2024-09-10T22:38:12.678 INFO:teuthology.orchestra.run.smithi138.stdout: "avgtime": 0.000000000 2024-09-10T22:38:12.678 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-09-10T22:38:12.678 INFO:teuthology.orchestra.run.smithi138.stdout: "req_mkdir_latency": { 2024-09-10T22:38:12.678 INFO:teuthology.orchestra.run.smithi138.stdout: "avgcount": 0, 2024-09-10T22:38:12.678 INFO:teuthology.orchestra.run.smithi138.stdout: "sum": 0.000000000, 2024-09-10T22:38:12.678 INFO:teuthology.orchestra.run.smithi138.stdout: "avgtime": 0.000000000 2024-09-10T22:38:12.678 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-09-10T22:38:12.678 INFO:teuthology.orchestra.run.smithi138.stdout: "req_mknod_latency": { 2024-09-10T22:38:12.678 INFO:teuthology.orchestra.run.smithi138.stdout: "avgcount": 0, 2024-09-10T22:38:12.678 INFO:teuthology.orchestra.run.smithi138.stdout: "sum": 0.000000000, 2024-09-10T22:38:12.678 INFO:teuthology.orchestra.run.smithi138.stdout: "avgtime": 0.000000000 2024-09-10T22:38:12.679 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-09-10T22:38:12.679 INFO:teuthology.orchestra.run.smithi138.stdout: "req_mksnap_latency": { 2024-09-10T22:38:12.679 INFO:teuthology.orchestra.run.smithi138.stdout: "avgcount": 0, 2024-09-10T22:38:12.679 INFO:teuthology.orchestra.run.smithi138.stdout: "sum": 0.000000000, 2024-09-10T22:38:12.679 INFO:teuthology.orchestra.run.smithi138.stdout: "avgtime": 0.000000000 2024-09-10T22:38:12.679 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-09-10T22:38:12.679 INFO:teuthology.orchestra.run.smithi138.stdout: "req_open_latency": { 2024-09-10T22:38:12.679 INFO:teuthology.orchestra.run.smithi138.stdout: "avgcount": 0, 2024-09-10T22:38:12.679 INFO:teuthology.orchestra.run.smithi138.stdout: "sum": 0.000000000, 2024-09-10T22:38:12.679 INFO:teuthology.orchestra.run.smithi138.stdout: "avgtime": 0.000000000 2024-09-10T22:38:12.679 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-09-10T22:38:12.679 INFO:teuthology.orchestra.run.smithi138.stdout: "req_readdir_latency": { 2024-09-10T22:38:12.679 INFO:teuthology.orchestra.run.smithi138.stdout: "avgcount": 1, 2024-09-10T22:38:12.680 INFO:teuthology.orchestra.run.smithi138.stdout: "sum": 0.000483361, 2024-09-10T22:38:12.680 INFO:teuthology.orchestra.run.smithi138.stdout: "avgtime": 0.000483361 2024-09-10T22:38:12.680 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-09-10T22:38:12.680 INFO:teuthology.orchestra.run.smithi138.stdout: "req_rename_latency": { 2024-09-10T22:38:12.680 INFO:teuthology.orchestra.run.smithi138.stdout: "avgcount": 0, 2024-09-10T22:38:12.680 INFO:teuthology.orchestra.run.smithi138.stdout: "sum": 0.000000000, 2024-09-10T22:38:12.680 INFO:teuthology.orchestra.run.smithi138.stdout: "avgtime": 0.000000000 2024-09-10T22:38:12.680 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-09-10T22:38:12.680 INFO:teuthology.orchestra.run.smithi138.stdout: "req_renamesnap_latency": { 2024-09-10T22:38:12.680 INFO:teuthology.orchestra.run.smithi138.stdout: "avgcount": 0, 2024-09-10T22:38:12.680 INFO:teuthology.orchestra.run.smithi138.stdout: "sum": 0.000000000, 2024-09-10T22:38:12.680 INFO:teuthology.orchestra.run.smithi138.stdout: "avgtime": 0.000000000 2024-09-10T22:38:12.680 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-09-10T22:38:12.681 INFO:teuthology.orchestra.run.smithi138.stdout: "req_snapdiff_latency": { 2024-09-10T22:38:12.681 INFO:teuthology.orchestra.run.smithi138.stdout: "avgcount": 0, 2024-09-10T22:38:12.681 INFO:teuthology.orchestra.run.smithi138.stdout: "sum": 0.000000000, 2024-09-10T22:38:12.681 INFO:teuthology.orchestra.run.smithi138.stdout: "avgtime": 0.000000000 2024-09-10T22:38:12.681 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-09-10T22:38:12.681 INFO:teuthology.orchestra.run.smithi138.stdout: "req_rmdir_latency": { 2024-09-10T22:38:12.681 INFO:teuthology.orchestra.run.smithi138.stdout: "avgcount": 0, 2024-09-10T22:38:12.681 INFO:teuthology.orchestra.run.smithi138.stdout: "sum": 0.000000000, 2024-09-10T22:38:12.681 INFO:teuthology.orchestra.run.smithi138.stdout: "avgtime": 0.000000000 2024-09-10T22:38:12.681 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-09-10T22:38:12.681 INFO:teuthology.orchestra.run.smithi138.stdout: "req_rmsnap_latency": { 2024-09-10T22:38:12.681 INFO:teuthology.orchestra.run.smithi138.stdout: "avgcount": 0, 2024-09-10T22:38:12.681 INFO:teuthology.orchestra.run.smithi138.stdout: "sum": 0.000000000, 2024-09-10T22:38:12.682 INFO:teuthology.orchestra.run.smithi138.stdout: "avgtime": 0.000000000 2024-09-10T22:38:12.682 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-09-10T22:38:12.682 INFO:teuthology.orchestra.run.smithi138.stdout: "req_rmxattr_latency": { 2024-09-10T22:38:12.682 INFO:teuthology.orchestra.run.smithi138.stdout: "avgcount": 0, 2024-09-10T22:38:12.682 INFO:teuthology.orchestra.run.smithi138.stdout: "sum": 0.000000000, 2024-09-10T22:38:12.682 INFO:teuthology.orchestra.run.smithi138.stdout: "avgtime": 0.000000000 2024-09-10T22:38:12.682 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-09-10T22:38:12.682 INFO:teuthology.orchestra.run.smithi138.stdout: "req_setattr_latency": { 2024-09-10T22:38:12.682 INFO:teuthology.orchestra.run.smithi138.stdout: "avgcount": 0, 2024-09-10T22:38:12.682 INFO:teuthology.orchestra.run.smithi138.stdout: "sum": 0.000000000, 2024-09-10T22:38:12.682 INFO:teuthology.orchestra.run.smithi138.stdout: "avgtime": 0.000000000 2024-09-10T22:38:12.682 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-09-10T22:38:12.682 INFO:teuthology.orchestra.run.smithi138.stdout: "req_setdirlayout_latency": { 2024-09-10T22:38:12.682 INFO:teuthology.orchestra.run.smithi138.stdout: "avgcount": 0, 2024-09-10T22:38:12.682 INFO:teuthology.orchestra.run.smithi138.stdout: "sum": 0.000000000, 2024-09-10T22:38:12.683 INFO:teuthology.orchestra.run.smithi138.stdout: "avgtime": 0.000000000 2024-09-10T22:38:12.683 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-09-10T22:38:12.683 INFO:teuthology.orchestra.run.smithi138.stdout: "req_setfilelock_latency": { 2024-09-10T22:38:12.683 INFO:teuthology.orchestra.run.smithi138.stdout: "avgcount": 0, 2024-09-10T22:38:12.683 INFO:teuthology.orchestra.run.smithi138.stdout: "sum": 0.000000000, 2024-09-10T22:38:12.683 INFO:teuthology.orchestra.run.smithi138.stdout: "avgtime": 0.000000000 2024-09-10T22:38:12.683 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-09-10T22:38:12.683 INFO:teuthology.orchestra.run.smithi138.stdout: "req_setlayout_latency": { 2024-09-10T22:38:12.683 INFO:teuthology.orchestra.run.smithi138.stdout: "avgcount": 0, 2024-09-10T22:38:12.683 INFO:teuthology.orchestra.run.smithi138.stdout: "sum": 0.000000000, 2024-09-10T22:38:12.683 INFO:teuthology.orchestra.run.smithi138.stdout: "avgtime": 0.000000000 2024-09-10T22:38:12.683 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-09-10T22:38:12.683 INFO:teuthology.orchestra.run.smithi138.stdout: "req_setxattr_latency": { 2024-09-10T22:38:12.684 INFO:teuthology.orchestra.run.smithi138.stdout: "avgcount": 0, 2024-09-10T22:38:12.684 INFO:teuthology.orchestra.run.smithi138.stdout: "sum": 0.000000000, 2024-09-10T22:38:12.684 INFO:teuthology.orchestra.run.smithi138.stdout: "avgtime": 0.000000000 2024-09-10T22:38:12.684 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-09-10T22:38:12.684 INFO:teuthology.orchestra.run.smithi138.stdout: "req_symlink_latency": { 2024-09-10T22:38:12.684 INFO:teuthology.orchestra.run.smithi138.stdout: "avgcount": 0, 2024-09-10T22:38:12.684 INFO:teuthology.orchestra.run.smithi138.stdout: "sum": 0.000000000, 2024-09-10T22:38:12.684 INFO:teuthology.orchestra.run.smithi138.stdout: "avgtime": 0.000000000 2024-09-10T22:38:12.684 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-09-10T22:38:12.684 INFO:teuthology.orchestra.run.smithi138.stdout: "req_unlink_latency": { 2024-09-10T22:38:12.684 INFO:teuthology.orchestra.run.smithi138.stdout: "avgcount": 2, 2024-09-10T22:38:12.684 INFO:teuthology.orchestra.run.smithi138.stdout: "sum": 0.002627327, 2024-09-10T22:38:12.684 INFO:teuthology.orchestra.run.smithi138.stdout: "avgtime": 0.001313663 2024-09-10T22:38:12.685 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-09-10T22:38:12.685 INFO:teuthology.orchestra.run.smithi138.stdout: "cap_revoke_eviction": 0, 2024-09-10T22:38:12.685 INFO:teuthology.orchestra.run.smithi138.stdout: "cap_acquisition_throttle": 0, 2024-09-10T22:38:12.685 INFO:teuthology.orchestra.run.smithi138.stdout: "req_getvxattr_latency": { 2024-09-10T22:38:12.685 INFO:teuthology.orchestra.run.smithi138.stdout: "avgcount": 0, 2024-09-10T22:38:12.685 INFO:teuthology.orchestra.run.smithi138.stdout: "sum": 0.000000000, 2024-09-10T22:38:12.685 INFO:teuthology.orchestra.run.smithi138.stdout: "avgtime": 0.000000000 2024-09-10T22:38:12.685 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-09-10T22:38:12.685 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-09-10T22:38:12.685 INFO:teuthology.orchestra.run.smithi138.stdout: "mds_sessions": { 2024-09-10T22:38:12.686 INFO:teuthology.orchestra.run.smithi138.stdout: "session_count": 1, 2024-09-10T22:38:12.686 INFO:teuthology.orchestra.run.smithi138.stdout: "session_add": 1, 2024-09-10T22:38:12.686 INFO:teuthology.orchestra.run.smithi138.stdout: "session_remove": 0, 2024-09-10T22:38:12.686 INFO:teuthology.orchestra.run.smithi138.stdout: "sessions_open": 1, 2024-09-10T22:38:12.686 INFO:teuthology.orchestra.run.smithi138.stdout: "sessions_stale": 0, 2024-09-10T22:38:12.686 INFO:teuthology.orchestra.run.smithi138.stdout: "total_load": 3, 2024-09-10T22:38:12.687 INFO:teuthology.orchestra.run.smithi138.stdout: "average_load": 3, 2024-09-10T22:38:12.687 INFO:teuthology.orchestra.run.smithi138.stdout: "avg_session_uptime": 720, 2024-09-10T22:38:12.687 INFO:teuthology.orchestra.run.smithi138.stdout: "mdthresh_evicted": 0 2024-09-10T22:38:12.687 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-09-10T22:38:12.687 INFO:teuthology.orchestra.run.smithi138.stdout: "mempool": { 2024-09-10T22:38:12.688 INFO:teuthology.orchestra.run.smithi138.stdout: "bloom_filter_bytes": 0, 2024-09-10T22:38:12.688 INFO:teuthology.orchestra.run.smithi138.stdout: "bloom_filter_items": 0, 2024-09-10T22:38:12.688 INFO:teuthology.orchestra.run.smithi138.stdout: "bluestore_alloc_bytes": 0, 2024-09-10T22:38:12.688 INFO:teuthology.orchestra.run.smithi138.stdout: "bluestore_alloc_items": 0, 2024-09-10T22:38:12.688 INFO:teuthology.orchestra.run.smithi138.stdout: "bluestore_cache_data_bytes": 0, 2024-09-10T22:38:12.689 INFO:teuthology.orchestra.run.smithi138.stdout: "bluestore_cache_data_items": 0, 2024-09-10T22:38:12.689 INFO:teuthology.orchestra.run.smithi138.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-10T22:38:12.689 INFO:teuthology.orchestra.run.smithi138.stdout: "bluestore_cache_onode_items": 0, 2024-09-10T22:38:12.689 INFO:teuthology.orchestra.run.smithi138.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-10T22:38:12.689 INFO:teuthology.orchestra.run.smithi138.stdout: "bluestore_cache_meta_items": 0, 2024-09-10T22:38:12.689 INFO:teuthology.orchestra.run.smithi138.stdout: "bluestore_cache_other_bytes": 0, 2024-09-10T22:38:12.690 INFO:teuthology.orchestra.run.smithi138.stdout: "bluestore_cache_other_items": 0, 2024-09-10T22:38:12.690 INFO:teuthology.orchestra.run.smithi138.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-10T22:38:12.690 INFO:teuthology.orchestra.run.smithi138.stdout: "bluestore_cache_buffer_items": 0, 2024-09-10T22:38:12.690 INFO:teuthology.orchestra.run.smithi138.stdout: "bluestore_extent_bytes": 0, 2024-09-10T22:38:12.690 INFO:teuthology.orchestra.run.smithi138.stdout: "bluestore_extent_items": 0, 2024-09-10T22:38:12.691 INFO:teuthology.orchestra.run.smithi138.stdout: "bluestore_blob_bytes": 0, 2024-09-10T22:38:12.691 INFO:teuthology.orchestra.run.smithi138.stdout: "bluestore_blob_items": 0, 2024-09-10T22:38:12.691 INFO:teuthology.orchestra.run.smithi138.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-10T22:38:12.691 INFO:teuthology.orchestra.run.smithi138.stdout: "bluestore_shared_blob_items": 0, 2024-09-10T22:38:12.691 INFO:teuthology.orchestra.run.smithi138.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-10T22:38:12.691 INFO:teuthology.orchestra.run.smithi138.stdout: "bluestore_inline_bl_items": 0, 2024-09-10T22:38:12.692 INFO:teuthology.orchestra.run.smithi138.stdout: "bluestore_fsck_bytes": 0, 2024-09-10T22:38:12.692 INFO:teuthology.orchestra.run.smithi138.stdout: "bluestore_fsck_items": 0, 2024-09-10T22:38:12.692 INFO:teuthology.orchestra.run.smithi138.stdout: "bluestore_txc_bytes": 0, 2024-09-10T22:38:12.692 INFO:teuthology.orchestra.run.smithi138.stdout: "bluestore_txc_items": 0, 2024-09-10T22:38:12.692 INFO:teuthology.orchestra.run.smithi138.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-10T22:38:12.693 INFO:teuthology.orchestra.run.smithi138.stdout: "bluestore_writing_deferred_items": 0, 2024-09-10T22:38:12.693 INFO:teuthology.orchestra.run.smithi138.stdout: "bluestore_writing_bytes": 0, 2024-09-10T22:38:12.693 INFO:teuthology.orchestra.run.smithi138.stdout: "bluestore_writing_items": 0, 2024-09-10T22:38:12.693 INFO:teuthology.orchestra.run.smithi138.stdout: "bluefs_bytes": 0, 2024-09-10T22:38:12.694 INFO:teuthology.orchestra.run.smithi138.stdout: "bluefs_items": 0, 2024-09-10T22:38:12.694 INFO:teuthology.orchestra.run.smithi138.stdout: "bluefs_file_reader_bytes": 0, 2024-09-10T22:38:12.694 INFO:teuthology.orchestra.run.smithi138.stdout: "bluefs_file_reader_items": 0, 2024-09-10T22:38:12.694 INFO:teuthology.orchestra.run.smithi138.stdout: "bluefs_file_writer_bytes": 0, 2024-09-10T22:38:12.694 INFO:teuthology.orchestra.run.smithi138.stdout: "bluefs_file_writer_items": 0, 2024-09-10T22:38:12.694 INFO:teuthology.orchestra.run.smithi138.stdout: "buffer_anon_bytes": 259119, 2024-09-10T22:38:12.695 INFO:teuthology.orchestra.run.smithi138.stdout: "buffer_anon_items": 87, 2024-09-10T22:38:12.695 INFO:teuthology.orchestra.run.smithi138.stdout: "buffer_meta_bytes": 0, 2024-09-10T22:38:12.695 INFO:teuthology.orchestra.run.smithi138.stdout: "buffer_meta_items": 0, 2024-09-10T22:38:12.695 INFO:teuthology.orchestra.run.smithi138.stdout: "osd_bytes": 0, 2024-09-10T22:38:12.695 INFO:teuthology.orchestra.run.smithi138.stdout: "osd_items": 0, 2024-09-10T22:38:12.695 INFO:teuthology.orchestra.run.smithi138.stdout: "osd_mapbl_bytes": 0, 2024-09-10T22:38:12.696 INFO:teuthology.orchestra.run.smithi138.stdout: "osd_mapbl_items": 0, 2024-09-10T22:38:12.696 INFO:teuthology.orchestra.run.smithi138.stdout: "osd_pglog_bytes": 0, 2024-09-10T22:38:12.696 INFO:teuthology.orchestra.run.smithi138.stdout: "osd_pglog_items": 0, 2024-09-10T22:38:12.696 INFO:teuthology.orchestra.run.smithi138.stdout: "osdmap_bytes": 7880, 2024-09-10T22:38:12.696 INFO:teuthology.orchestra.run.smithi138.stdout: "osdmap_items": 162, 2024-09-10T22:38:12.697 INFO:teuthology.orchestra.run.smithi138.stdout: "osdmap_mapping_bytes": 0, 2024-09-10T22:38:12.697 INFO:teuthology.orchestra.run.smithi138.stdout: "osdmap_mapping_items": 0, 2024-09-10T22:38:12.697 INFO:teuthology.orchestra.run.smithi138.stdout: "pgmap_bytes": 0, 2024-09-10T22:38:12.697 INFO:teuthology.orchestra.run.smithi138.stdout: "pgmap_items": 0, 2024-09-10T22:38:12.697 INFO:teuthology.orchestra.run.smithi138.stdout: "mds_co_bytes": 81477, 2024-09-10T22:38:12.698 INFO:teuthology.orchestra.run.smithi138.stdout: "mds_co_items": 334, 2024-09-10T22:38:12.698 INFO:teuthology.orchestra.run.smithi138.stdout: "unittest_1_bytes": 0, 2024-09-10T22:38:12.698 INFO:teuthology.orchestra.run.smithi138.stdout: "unittest_1_items": 0, 2024-09-10T22:38:12.698 INFO:teuthology.orchestra.run.smithi138.stdout: "unittest_2_bytes": 0, 2024-09-10T22:38:12.698 INFO:teuthology.orchestra.run.smithi138.stdout: "unittest_2_items": 0 2024-09-10T22:38:12.698 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-09-10T22:38:12.699 INFO:teuthology.orchestra.run.smithi138.stdout: "objecter": { 2024-09-10T22:38:12.699 INFO:teuthology.orchestra.run.smithi138.stdout: "op_active": 0, 2024-09-10T22:38:12.699 INFO:teuthology.orchestra.run.smithi138.stdout: "op_laggy": 0, 2024-09-10T22:38:12.699 INFO:teuthology.orchestra.run.smithi138.stdout: "op_send": 94, 2024-09-10T22:38:12.699 INFO:teuthology.orchestra.run.smithi138.stdout: "op_send_bytes": 38190, 2024-09-10T22:38:12.700 INFO:teuthology.orchestra.run.smithi138.stdout: "op_resend": 29, 2024-09-10T22:38:12.700 INFO:teuthology.orchestra.run.smithi138.stdout: "op_reply": 94, 2024-09-10T22:38:12.700 INFO:teuthology.orchestra.run.smithi138.stdout: "op_latency": { 2024-09-10T22:38:12.700 INFO:teuthology.orchestra.run.smithi138.stdout: "avgcount": 94, 2024-09-10T22:38:12.700 INFO:teuthology.orchestra.run.smithi138.stdout: "sum": 2.414949663, 2024-09-10T22:38:12.700 INFO:teuthology.orchestra.run.smithi138.stdout: "avgtime": 0.025690953 2024-09-10T22:38:12.700 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-09-10T22:38:12.700 INFO:teuthology.orchestra.run.smithi138.stdout: "op_inflight": 0, 2024-09-10T22:38:12.700 INFO:teuthology.orchestra.run.smithi138.stdout: "oplen_avg": { 2024-09-10T22:38:12.701 INFO:teuthology.orchestra.run.smithi138.stdout: "avgcount": 94, 2024-09-10T22:38:12.701 INFO:teuthology.orchestra.run.smithi138.stdout: "sum": 121 2024-09-10T22:38:12.701 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-09-10T22:38:12.701 INFO:teuthology.orchestra.run.smithi138.stdout: "op": 94, 2024-09-10T22:38:12.701 INFO:teuthology.orchestra.run.smithi138.stdout: "op_r": 27, 2024-09-10T22:38:12.701 INFO:teuthology.orchestra.run.smithi138.stdout: "op_w": 67, 2024-09-10T22:38:12.701 INFO:teuthology.orchestra.run.smithi138.stdout: "op_rmw": 0, 2024-09-10T22:38:12.701 INFO:teuthology.orchestra.run.smithi138.stdout: "op_pg": 0, 2024-09-10T22:38:12.701 INFO:teuthology.orchestra.run.smithi138.stdout: "osdop_stat": 0, 2024-09-10T22:38:12.701 INFO:teuthology.orchestra.run.smithi138.stdout: "osdop_create": 10, 2024-09-10T22:38:12.701 INFO:teuthology.orchestra.run.smithi138.stdout: "osdop_read": 1, 2024-09-10T22:38:12.701 INFO:teuthology.orchestra.run.smithi138.stdout: "osdop_write": 14, 2024-09-10T22:38:12.701 INFO:teuthology.orchestra.run.smithi138.stdout: "osdop_writefull": 11, 2024-09-10T22:38:12.701 INFO:teuthology.orchestra.run.smithi138.stdout: "osdop_writesame": 0, 2024-09-10T22:38:12.702 INFO:teuthology.orchestra.run.smithi138.stdout: "osdop_append": 0, 2024-09-10T22:38:12.702 INFO:teuthology.orchestra.run.smithi138.stdout: "osdop_zero": 0, 2024-09-10T22:38:12.702 INFO:teuthology.orchestra.run.smithi138.stdout: "osdop_truncate": 0, 2024-09-10T22:38:12.702 INFO:teuthology.orchestra.run.smithi138.stdout: "osdop_delete": 14, 2024-09-10T22:38:12.702 INFO:teuthology.orchestra.run.smithi138.stdout: "osdop_mapext": 0, 2024-09-10T22:38:12.702 INFO:teuthology.orchestra.run.smithi138.stdout: "osdop_sparse_read": 0, 2024-09-10T22:38:12.702 INFO:teuthology.orchestra.run.smithi138.stdout: "osdop_clonerange": 0, 2024-09-10T22:38:12.702 INFO:teuthology.orchestra.run.smithi138.stdout: "osdop_getxattr": 26, 2024-09-10T22:38:12.702 INFO:teuthology.orchestra.run.smithi138.stdout: "osdop_setxattr": 20, 2024-09-10T22:38:12.702 INFO:teuthology.orchestra.run.smithi138.stdout: "osdop_cmpxattr": 0, 2024-09-10T22:38:12.702 INFO:teuthology.orchestra.run.smithi138.stdout: "osdop_rmxattr": 0, 2024-09-10T22:38:12.702 INFO:teuthology.orchestra.run.smithi138.stdout: "osdop_resetxattrs": 0, 2024-09-10T22:38:12.703 INFO:teuthology.orchestra.run.smithi138.stdout: "osdop_call": 0, 2024-09-10T22:38:12.703 INFO:teuthology.orchestra.run.smithi138.stdout: "osdop_watch": 0, 2024-09-10T22:38:12.703 INFO:teuthology.orchestra.run.smithi138.stdout: "osdop_notify": 0, 2024-09-10T22:38:12.703 INFO:teuthology.orchestra.run.smithi138.stdout: "osdop_src_cmpxattr": 0, 2024-09-10T22:38:12.703 INFO:teuthology.orchestra.run.smithi138.stdout: "osdop_pgls": 0, 2024-09-10T22:38:12.703 INFO:teuthology.orchestra.run.smithi138.stdout: "osdop_pgls_filter": 0, 2024-09-10T22:38:12.703 INFO:teuthology.orchestra.run.smithi138.stdout: "osdop_other": 0, 2024-09-10T22:38:12.703 INFO:teuthology.orchestra.run.smithi138.stdout: "linger_active": 0, 2024-09-10T22:38:12.703 INFO:teuthology.orchestra.run.smithi138.stdout: "linger_send": 0, 2024-09-10T22:38:12.703 INFO:teuthology.orchestra.run.smithi138.stdout: "linger_resend": 0, 2024-09-10T22:38:12.703 INFO:teuthology.orchestra.run.smithi138.stdout: "linger_ping": 0, 2024-09-10T22:38:12.703 INFO:teuthology.orchestra.run.smithi138.stdout: "poolop_active": 0, 2024-09-10T22:38:12.703 INFO:teuthology.orchestra.run.smithi138.stdout: "poolop_send": 0, 2024-09-10T22:38:12.703 INFO:teuthology.orchestra.run.smithi138.stdout: "poolop_resend": 0, 2024-09-10T22:38:12.704 INFO:teuthology.orchestra.run.smithi138.stdout: "poolstat_active": 0, 2024-09-10T22:38:12.704 INFO:teuthology.orchestra.run.smithi138.stdout: "poolstat_send": 0, 2024-09-10T22:38:12.704 INFO:teuthology.orchestra.run.smithi138.stdout: "poolstat_resend": 0, 2024-09-10T22:38:12.704 INFO:teuthology.orchestra.run.smithi138.stdout: "statfs_active": 0, 2024-09-10T22:38:12.704 INFO:teuthology.orchestra.run.smithi138.stdout: "statfs_send": 0, 2024-09-10T22:38:12.704 INFO:teuthology.orchestra.run.smithi138.stdout: "statfs_resend": 0, 2024-09-10T22:38:12.704 INFO:teuthology.orchestra.run.smithi138.stdout: "command_active": 0, 2024-09-10T22:38:12.704 INFO:teuthology.orchestra.run.smithi138.stdout: "command_send": 0, 2024-09-10T22:38:12.704 INFO:teuthology.orchestra.run.smithi138.stdout: "command_resend": 0, 2024-09-10T22:38:12.704 INFO:teuthology.orchestra.run.smithi138.stdout: "map_epoch": 77, 2024-09-10T22:38:12.704 INFO:teuthology.orchestra.run.smithi138.stdout: "map_full": 0, 2024-09-10T22:38:12.704 INFO:teuthology.orchestra.run.smithi138.stdout: "map_inc": 4, 2024-09-10T22:38:12.704 INFO:teuthology.orchestra.run.smithi138.stdout: "osd_sessions": 9, 2024-09-10T22:38:12.705 INFO:teuthology.orchestra.run.smithi138.stdout: "osd_session_open": 9, 2024-09-10T22:38:12.705 INFO:teuthology.orchestra.run.smithi138.stdout: "osd_session_close": 0, 2024-09-10T22:38:12.705 INFO:teuthology.orchestra.run.smithi138.stdout: "osd_laggy": 0, 2024-09-10T22:38:12.705 INFO:teuthology.orchestra.run.smithi138.stdout: "omap_wr": 21, 2024-09-10T22:38:12.705 INFO:teuthology.orchestra.run.smithi138.stdout: "omap_rd": 0, 2024-09-10T22:38:12.705 INFO:teuthology.orchestra.run.smithi138.stdout: "omap_del": 4 2024-09-10T22:38:12.705 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-09-10T22:38:12.705 INFO:teuthology.orchestra.run.smithi138.stdout: "oft": { 2024-09-10T22:38:12.705 INFO:teuthology.orchestra.run.smithi138.stdout: "omap_total_objs": 1, 2024-09-10T22:38:12.705 INFO:teuthology.orchestra.run.smithi138.stdout: "omap_total_kv_pairs": 0, 2024-09-10T22:38:12.705 INFO:teuthology.orchestra.run.smithi138.stdout: "omap_total_updates": 0, 2024-09-10T22:38:12.705 INFO:teuthology.orchestra.run.smithi138.stdout: "omap_total_removes": 0 2024-09-10T22:38:12.705 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-09-10T22:38:12.705 INFO:teuthology.orchestra.run.smithi138.stdout: "purge_queue": { 2024-09-10T22:38:12.706 INFO:teuthology.orchestra.run.smithi138.stdout: "pq_executing_ops": 0, 2024-09-10T22:38:12.706 INFO:teuthology.orchestra.run.smithi138.stdout: "pq_executing_ops_high_water": 2, 2024-09-10T22:38:12.706 INFO:teuthology.orchestra.run.smithi138.stdout: "pq_executing": 0, 2024-09-10T22:38:12.706 INFO:teuthology.orchestra.run.smithi138.stdout: "pq_executing_high_water": 2, 2024-09-10T22:38:12.706 INFO:teuthology.orchestra.run.smithi138.stdout: "pq_executed_ops": 2, 2024-09-10T22:38:12.706 INFO:teuthology.orchestra.run.smithi138.stdout: "pq_executed": 2, 2024-09-10T22:38:12.706 INFO:teuthology.orchestra.run.smithi138.stdout: "pq_item_in_journal": 0 2024-09-10T22:38:12.706 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-09-10T22:38:12.706 INFO:teuthology.orchestra.run.smithi138.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-10T22:38:12.706 INFO:teuthology.orchestra.run.smithi138.stdout: "val": 0, 2024-09-10T22:38:12.706 INFO:teuthology.orchestra.run.smithi138.stdout: "max": 104857600, 2024-09-10T22:38:12.706 INFO:teuthology.orchestra.run.smithi138.stdout: "get_started": 0, 2024-09-10T22:38:12.706 INFO:teuthology.orchestra.run.smithi138.stdout: "get": 2176, 2024-09-10T22:38:12.706 INFO:teuthology.orchestra.run.smithi138.stdout: "get_sum": 864078, 2024-09-10T22:38:12.707 INFO:teuthology.orchestra.run.smithi138.stdout: "get_or_fail_fail": 0, 2024-09-10T22:38:12.707 INFO:teuthology.orchestra.run.smithi138.stdout: "get_or_fail_success": 2176, 2024-09-10T22:38:12.707 INFO:teuthology.orchestra.run.smithi138.stdout: "take": 0, 2024-09-10T22:38:12.707 INFO:teuthology.orchestra.run.smithi138.stdout: "take_sum": 0, 2024-09-10T22:38:12.707 INFO:teuthology.orchestra.run.smithi138.stdout: "put": 2176, 2024-09-10T22:38:12.707 INFO:teuthology.orchestra.run.smithi138.stdout: "put_sum": 864078, 2024-09-10T22:38:12.707 INFO:teuthology.orchestra.run.smithi138.stdout: "wait": { 2024-09-10T22:38:12.707 INFO:teuthology.orchestra.run.smithi138.stdout: "avgcount": 0, 2024-09-10T22:38:12.707 INFO:teuthology.orchestra.run.smithi138.stdout: "sum": 0.000000000, 2024-09-10T22:38:12.707 INFO:teuthology.orchestra.run.smithi138.stdout: "avgtime": 0.000000000 2024-09-10T22:38:12.707 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-09-10T22:38:12.707 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-09-10T22:38:12.707 INFO:teuthology.orchestra.run.smithi138.stdout: "throttle-objecter_bytes": { 2024-09-10T22:38:12.707 INFO:teuthology.orchestra.run.smithi138.stdout: "val": 0, 2024-09-10T22:38:12.708 INFO:teuthology.orchestra.run.smithi138.stdout: "max": 104857600, 2024-09-10T22:38:12.708 INFO:teuthology.orchestra.run.smithi138.stdout: "get_started": 0, 2024-09-10T22:38:12.708 INFO:teuthology.orchestra.run.smithi138.stdout: "get": 0, 2024-09-10T22:38:12.708 INFO:teuthology.orchestra.run.smithi138.stdout: "get_sum": 0, 2024-09-10T22:38:12.708 INFO:teuthology.orchestra.run.smithi138.stdout: "get_or_fail_fail": 0, 2024-09-10T22:38:12.708 INFO:teuthology.orchestra.run.smithi138.stdout: "get_or_fail_success": 0, 2024-09-10T22:38:12.708 INFO:teuthology.orchestra.run.smithi138.stdout: "take": 94, 2024-09-10T22:38:12.708 INFO:teuthology.orchestra.run.smithi138.stdout: "take_sum": 38392, 2024-09-10T22:38:12.708 INFO:teuthology.orchestra.run.smithi138.stdout: "put": 94, 2024-09-10T22:38:12.708 INFO:teuthology.orchestra.run.smithi138.stdout: "put_sum": 38392, 2024-09-10T22:38:12.708 INFO:teuthology.orchestra.run.smithi138.stdout: "wait": { 2024-09-10T22:38:12.708 INFO:teuthology.orchestra.run.smithi138.stdout: "avgcount": 0, 2024-09-10T22:38:12.708 INFO:teuthology.orchestra.run.smithi138.stdout: "sum": 0.000000000, 2024-09-10T22:38:12.709 INFO:teuthology.orchestra.run.smithi138.stdout: "avgtime": 0.000000000 2024-09-10T22:38:12.709 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-09-10T22:38:12.709 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-09-10T22:38:12.709 INFO:teuthology.orchestra.run.smithi138.stdout: "throttle-objecter_ops": { 2024-09-10T22:38:12.709 INFO:teuthology.orchestra.run.smithi138.stdout: "val": 0, 2024-09-10T22:38:12.709 INFO:teuthology.orchestra.run.smithi138.stdout: "max": 1024, 2024-09-10T22:38:12.709 INFO:teuthology.orchestra.run.smithi138.stdout: "get_started": 0, 2024-09-10T22:38:12.709 INFO:teuthology.orchestra.run.smithi138.stdout: "get": 0, 2024-09-10T22:38:12.709 INFO:teuthology.orchestra.run.smithi138.stdout: "get_sum": 0, 2024-09-10T22:38:12.709 INFO:teuthology.orchestra.run.smithi138.stdout: "get_or_fail_fail": 0, 2024-09-10T22:38:12.709 INFO:teuthology.orchestra.run.smithi138.stdout: "get_or_fail_success": 0, 2024-09-10T22:38:12.709 INFO:teuthology.orchestra.run.smithi138.stdout: "take": 94, 2024-09-10T22:38:12.709 INFO:teuthology.orchestra.run.smithi138.stdout: "take_sum": 94, 2024-09-10T22:38:12.710 INFO:teuthology.orchestra.run.smithi138.stdout: "put": 94, 2024-09-10T22:38:12.710 INFO:teuthology.orchestra.run.smithi138.stdout: "put_sum": 94, 2024-09-10T22:38:12.710 INFO:teuthology.orchestra.run.smithi138.stdout: "wait": { 2024-09-10T22:38:12.710 INFO:teuthology.orchestra.run.smithi138.stdout: "avgcount": 0, 2024-09-10T22:38:12.710 INFO:teuthology.orchestra.run.smithi138.stdout: "sum": 0.000000000, 2024-09-10T22:38:12.710 INFO:teuthology.orchestra.run.smithi138.stdout: "avgtime": 0.000000000 2024-09-10T22:38:12.710 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-09-10T22:38:12.710 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-09-10T22:38:12.710 INFO:teuthology.orchestra.run.smithi138.stdout: "throttle-write_buf_throttle": { 2024-09-10T22:38:12.710 INFO:teuthology.orchestra.run.smithi138.stdout: "val": 0, 2024-09-10T22:38:12.710 INFO:teuthology.orchestra.run.smithi138.stdout: "max": 3758096384, 2024-09-10T22:38:12.710 INFO:teuthology.orchestra.run.smithi138.stdout: "get_started": 0, 2024-09-10T22:38:12.710 INFO:teuthology.orchestra.run.smithi138.stdout: "get": 2, 2024-09-10T22:38:12.710 INFO:teuthology.orchestra.run.smithi138.stdout: "get_sum": 202, 2024-09-10T22:38:12.711 INFO:teuthology.orchestra.run.smithi138.stdout: "get_or_fail_fail": 0, 2024-09-10T22:38:12.711 INFO:teuthology.orchestra.run.smithi138.stdout: "get_or_fail_success": 2, 2024-09-10T22:38:12.711 INFO:teuthology.orchestra.run.smithi138.stdout: "take": 0, 2024-09-10T22:38:12.711 INFO:teuthology.orchestra.run.smithi138.stdout: "take_sum": 0, 2024-09-10T22:38:12.711 INFO:teuthology.orchestra.run.smithi138.stdout: "put": 1, 2024-09-10T22:38:12.711 INFO:teuthology.orchestra.run.smithi138.stdout: "put_sum": 202, 2024-09-10T22:38:12.711 INFO:teuthology.orchestra.run.smithi138.stdout: "wait": { 2024-09-10T22:38:12.711 INFO:teuthology.orchestra.run.smithi138.stdout: "avgcount": 0, 2024-09-10T22:38:12.711 INFO:teuthology.orchestra.run.smithi138.stdout: "sum": 0.000000000, 2024-09-10T22:38:12.711 INFO:teuthology.orchestra.run.smithi138.stdout: "avgtime": 0.000000000 2024-09-10T22:38:12.711 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-09-10T22:38:12.712 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-09-10T22:38:12.712 INFO:teuthology.orchestra.run.smithi138.stdout: "throttle-write_buf_throttle-0x5560c0f10dc0": { 2024-09-10T22:38:12.712 INFO:teuthology.orchestra.run.smithi138.stdout: "val": 0, 2024-09-10T22:38:12.712 INFO:teuthology.orchestra.run.smithi138.stdout: "max": 3758096384, 2024-09-10T22:38:12.712 INFO:teuthology.orchestra.run.smithi138.stdout: "get_started": 0, 2024-09-10T22:38:12.712 INFO:teuthology.orchestra.run.smithi138.stdout: "get": 17, 2024-09-10T22:38:12.712 INFO:teuthology.orchestra.run.smithi138.stdout: "get_sum": 25797, 2024-09-10T22:38:12.712 INFO:teuthology.orchestra.run.smithi138.stdout: "get_or_fail_fail": 0, 2024-09-10T22:38:12.712 INFO:teuthology.orchestra.run.smithi138.stdout: "get_or_fail_success": 17, 2024-09-10T22:38:12.712 INFO:teuthology.orchestra.run.smithi138.stdout: "take": 0, 2024-09-10T22:38:12.712 INFO:teuthology.orchestra.run.smithi138.stdout: "take_sum": 0, 2024-09-10T22:38:12.713 INFO:teuthology.orchestra.run.smithi138.stdout: "put": 13, 2024-09-10T22:38:12.713 INFO:teuthology.orchestra.run.smithi138.stdout: "put_sum": 25797, 2024-09-10T22:38:12.713 INFO:teuthology.orchestra.run.smithi138.stdout: "wait": { 2024-09-10T22:38:12.713 INFO:teuthology.orchestra.run.smithi138.stdout: "avgcount": 0, 2024-09-10T22:38:12.713 INFO:teuthology.orchestra.run.smithi138.stdout: "sum": 0.000000000, 2024-09-10T22:38:12.713 INFO:teuthology.orchestra.run.smithi138.stdout: "avgtime": 0.000000000 2024-09-10T22:38:12.713 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-09-10T22:38:12.713 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-09-10T22:38:12.713 INFO:teuthology.orchestra.run.smithi138.stdout: "trackedop": { 2024-09-10T22:38:12.713 INFO:teuthology.orchestra.run.smithi138.stdout: "slow_ops_count": 0 2024-09-10T22:38:12.713 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-09-10T22:38:12.713 INFO:teuthology.orchestra.run.smithi138.stdout:} 2024-09-10T22:38:13.355 INFO:tasks.check_counter:Daemon mds.i mds.exported=1 2024-09-10T22:38:13.355 INFO:tasks.check_counter:Daemon mds.i mds.imported=1 2024-09-10T22:38:13.356 INFO:tasks.check_counter:Daemon mds.i mds_cache.dir_update=1 2024-09-10T22:38:13.356 INFO:tasks.check_counter:Daemon mds.i mds_cache.dir_update_receipt=11 2024-09-10T22:38:13.356 DEBUG:tasks.check_counter:Getting stats from l 2024-09-10T22:38:13.356 DEBUG:teuthology.orchestra.run.smithi138:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 22997a4c-6fc2-11ef-bcea-c7b262605968 -- ceph daemon mds.l perf dump 2024-09-10T22:38:13.602 INFO:teuthology.orchestra.run.smithi138.stderr:Inferring config /var/lib/ceph/22997a4c-6fc2-11ef-bcea-c7b262605968/mon.c/config 2024-09-10T22:38:14.065 INFO:teuthology.orchestra.run.smithi138.stdout:{ 2024-09-10T22:38:14.066 INFO:teuthology.orchestra.run.smithi138.stdout: "AsyncMessenger::Worker-0": { 2024-09-10T22:38:14.066 INFO:teuthology.orchestra.run.smithi138.stdout: "msgr_recv_messages": 241, 2024-09-10T22:38:14.066 INFO:teuthology.orchestra.run.smithi138.stdout: "msgr_send_messages": 236, 2024-09-10T22:38:14.066 INFO:teuthology.orchestra.run.smithi138.stdout: "msgr_recv_bytes": 532400, 2024-09-10T22:38:14.066 INFO:teuthology.orchestra.run.smithi138.stdout: "msgr_send_bytes": 144512, 2024-09-10T22:38:14.067 INFO:teuthology.orchestra.run.smithi138.stdout: "msgr_created_connections": 4, 2024-09-10T22:38:14.067 INFO:teuthology.orchestra.run.smithi138.stdout: "msgr_active_connections": 0, 2024-09-10T22:38:14.067 INFO:teuthology.orchestra.run.smithi138.stdout: "msgr_running_total_time": 0.037729300, 2024-09-10T22:38:14.067 INFO:teuthology.orchestra.run.smithi138.stdout: "msgr_running_send_time": 0.018562740, 2024-09-10T22:38:14.067 INFO:teuthology.orchestra.run.smithi138.stdout: "msgr_running_recv_time": 0.023371354, 2024-09-10T22:38:14.068 INFO:teuthology.orchestra.run.smithi138.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-10T22:38:14.068 INFO:teuthology.orchestra.run.smithi138.stdout: "msgr_send_messages_queue_lat": { 2024-09-10T22:38:14.068 INFO:teuthology.orchestra.run.smithi138.stdout: "avgcount": 236, 2024-09-10T22:38:14.068 INFO:teuthology.orchestra.run.smithi138.stdout: "sum": 0.015557728, 2024-09-10T22:38:14.068 INFO:teuthology.orchestra.run.smithi138.stdout: "avgtime": 0.000065922 2024-09-10T22:38:14.069 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-09-10T22:38:14.069 INFO:teuthology.orchestra.run.smithi138.stdout: "msgr_handle_ack_lat": { 2024-09-10T22:38:14.069 INFO:teuthology.orchestra.run.smithi138.stdout: "avgcount": 0, 2024-09-10T22:38:14.069 INFO:teuthology.orchestra.run.smithi138.stdout: "sum": 0.000000000, 2024-09-10T22:38:14.069 INFO:teuthology.orchestra.run.smithi138.stdout: "avgtime": 0.000000000 2024-09-10T22:38:14.070 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-09-10T22:38:14.070 INFO:teuthology.orchestra.run.smithi138.stdout: "msgr_recv_encrypted_bytes": 532400, 2024-09-10T22:38:14.070 INFO:teuthology.orchestra.run.smithi138.stdout: "msgr_send_encrypted_bytes": 144512 2024-09-10T22:38:14.070 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-09-10T22:38:14.070 INFO:teuthology.orchestra.run.smithi138.stdout: "AsyncMessenger::Worker-1": { 2024-09-10T22:38:14.070 INFO:teuthology.orchestra.run.smithi138.stdout: "msgr_recv_messages": 1, 2024-09-10T22:38:14.071 INFO:teuthology.orchestra.run.smithi138.stdout: "msgr_send_messages": 178, 2024-09-10T22:38:14.071 INFO:teuthology.orchestra.run.smithi138.stdout: "msgr_recv_bytes": 160, 2024-09-10T22:38:14.071 INFO:teuthology.orchestra.run.smithi138.stdout: "msgr_send_bytes": 111568, 2024-09-10T22:38:14.071 INFO:teuthology.orchestra.run.smithi138.stdout: "msgr_created_connections": 3, 2024-09-10T22:38:14.071 INFO:teuthology.orchestra.run.smithi138.stdout: "msgr_active_connections": 2, 2024-09-10T22:38:14.071 INFO:teuthology.orchestra.run.smithi138.stdout: "msgr_running_total_time": 0.013479263, 2024-09-10T22:38:14.072 INFO:teuthology.orchestra.run.smithi138.stdout: "msgr_running_send_time": 0.010696716, 2024-09-10T22:38:14.072 INFO:teuthology.orchestra.run.smithi138.stdout: "msgr_running_recv_time": 0.000942239, 2024-09-10T22:38:14.072 INFO:teuthology.orchestra.run.smithi138.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-10T22:38:14.072 INFO:teuthology.orchestra.run.smithi138.stdout: "msgr_send_messages_queue_lat": { 2024-09-10T22:38:14.072 INFO:teuthology.orchestra.run.smithi138.stdout: "avgcount": 176, 2024-09-10T22:38:14.072 INFO:teuthology.orchestra.run.smithi138.stdout: "sum": 0.008400157, 2024-09-10T22:38:14.072 INFO:teuthology.orchestra.run.smithi138.stdout: "avgtime": 0.000047728 2024-09-10T22:38:14.072 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-09-10T22:38:14.072 INFO:teuthology.orchestra.run.smithi138.stdout: "msgr_handle_ack_lat": { 2024-09-10T22:38:14.073 INFO:teuthology.orchestra.run.smithi138.stdout: "avgcount": 0, 2024-09-10T22:38:14.073 INFO:teuthology.orchestra.run.smithi138.stdout: "sum": 0.000000000, 2024-09-10T22:38:14.073 INFO:teuthology.orchestra.run.smithi138.stdout: "avgtime": 0.000000000 2024-09-10T22:38:14.073 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-09-10T22:38:14.073 INFO:teuthology.orchestra.run.smithi138.stdout: "msgr_recv_encrypted_bytes": 160, 2024-09-10T22:38:14.073 INFO:teuthology.orchestra.run.smithi138.stdout: "msgr_send_encrypted_bytes": 111568 2024-09-10T22:38:14.073 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-09-10T22:38:14.073 INFO:teuthology.orchestra.run.smithi138.stdout: "AsyncMessenger::Worker-2": { 2024-09-10T22:38:14.073 INFO:teuthology.orchestra.run.smithi138.stdout: "msgr_recv_messages": 0, 2024-09-10T22:38:14.073 INFO:teuthology.orchestra.run.smithi138.stdout: "msgr_send_messages": 2, 2024-09-10T22:38:14.073 INFO:teuthology.orchestra.run.smithi138.stdout: "msgr_recv_bytes": 0, 2024-09-10T22:38:14.073 INFO:teuthology.orchestra.run.smithi138.stdout: "msgr_send_bytes": 0, 2024-09-10T22:38:14.073 INFO:teuthology.orchestra.run.smithi138.stdout: "msgr_created_connections": 2, 2024-09-10T22:38:14.074 INFO:teuthology.orchestra.run.smithi138.stdout: "msgr_active_connections": 1, 2024-09-10T22:38:14.074 INFO:teuthology.orchestra.run.smithi138.stdout: "msgr_running_total_time": 0.000265945, 2024-09-10T22:38:14.074 INFO:teuthology.orchestra.run.smithi138.stdout: "msgr_running_send_time": 0.000000000, 2024-09-10T22:38:14.074 INFO:teuthology.orchestra.run.smithi138.stdout: "msgr_running_recv_time": 0.000190895, 2024-09-10T22:38:14.074 INFO:teuthology.orchestra.run.smithi138.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-10T22:38:14.074 INFO:teuthology.orchestra.run.smithi138.stdout: "msgr_send_messages_queue_lat": { 2024-09-10T22:38:14.074 INFO:teuthology.orchestra.run.smithi138.stdout: "avgcount": 0, 2024-09-10T22:38:14.074 INFO:teuthology.orchestra.run.smithi138.stdout: "sum": 0.000000000, 2024-09-10T22:38:14.074 INFO:teuthology.orchestra.run.smithi138.stdout: "avgtime": 0.000000000 2024-09-10T22:38:14.074 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-09-10T22:38:14.074 INFO:teuthology.orchestra.run.smithi138.stdout: "msgr_handle_ack_lat": { 2024-09-10T22:38:14.074 INFO:teuthology.orchestra.run.smithi138.stdout: "avgcount": 0, 2024-09-10T22:38:14.074 INFO:teuthology.orchestra.run.smithi138.stdout: "sum": 0.000000000, 2024-09-10T22:38:14.074 INFO:teuthology.orchestra.run.smithi138.stdout: "avgtime": 0.000000000 2024-09-10T22:38:14.075 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-09-10T22:38:14.075 INFO:teuthology.orchestra.run.smithi138.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-10T22:38:14.075 INFO:teuthology.orchestra.run.smithi138.stdout: "msgr_send_encrypted_bytes": 0 2024-09-10T22:38:14.075 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-09-10T22:38:14.075 INFO:teuthology.orchestra.run.smithi138.stdout: "cct": { 2024-09-10T22:38:14.075 INFO:teuthology.orchestra.run.smithi138.stdout: "total_workers": 0, 2024-09-10T22:38:14.075 INFO:teuthology.orchestra.run.smithi138.stdout: "unhealthy_workers": 0 2024-09-10T22:38:14.075 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-09-10T22:38:14.075 INFO:teuthology.orchestra.run.smithi138.stdout: "mempool": { 2024-09-10T22:38:14.075 INFO:teuthology.orchestra.run.smithi138.stdout: "bloom_filter_bytes": 0, 2024-09-10T22:38:14.075 INFO:teuthology.orchestra.run.smithi138.stdout: "bloom_filter_items": 0, 2024-09-10T22:38:14.075 INFO:teuthology.orchestra.run.smithi138.stdout: "bluestore_alloc_bytes": 0, 2024-09-10T22:38:14.075 INFO:teuthology.orchestra.run.smithi138.stdout: "bluestore_alloc_items": 0, 2024-09-10T22:38:14.075 INFO:teuthology.orchestra.run.smithi138.stdout: "bluestore_cache_data_bytes": 0, 2024-09-10T22:38:14.076 INFO:teuthology.orchestra.run.smithi138.stdout: "bluestore_cache_data_items": 0, 2024-09-10T22:38:14.076 INFO:teuthology.orchestra.run.smithi138.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-10T22:38:14.076 INFO:teuthology.orchestra.run.smithi138.stdout: "bluestore_cache_onode_items": 0, 2024-09-10T22:38:14.076 INFO:teuthology.orchestra.run.smithi138.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-10T22:38:14.076 INFO:teuthology.orchestra.run.smithi138.stdout: "bluestore_cache_meta_items": 0, 2024-09-10T22:38:14.076 INFO:teuthology.orchestra.run.smithi138.stdout: "bluestore_cache_other_bytes": 0, 2024-09-10T22:38:14.076 INFO:teuthology.orchestra.run.smithi138.stdout: "bluestore_cache_other_items": 0, 2024-09-10T22:38:14.076 INFO:teuthology.orchestra.run.smithi138.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-10T22:38:14.076 INFO:teuthology.orchestra.run.smithi138.stdout: "bluestore_cache_buffer_items": 0, 2024-09-10T22:38:14.076 INFO:teuthology.orchestra.run.smithi138.stdout: "bluestore_extent_bytes": 0, 2024-09-10T22:38:14.076 INFO:teuthology.orchestra.run.smithi138.stdout: "bluestore_extent_items": 0, 2024-09-10T22:38:14.076 INFO:teuthology.orchestra.run.smithi138.stdout: "bluestore_blob_bytes": 0, 2024-09-10T22:38:14.076 INFO:teuthology.orchestra.run.smithi138.stdout: "bluestore_blob_items": 0, 2024-09-10T22:38:14.077 INFO:teuthology.orchestra.run.smithi138.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-10T22:38:14.077 INFO:teuthology.orchestra.run.smithi138.stdout: "bluestore_shared_blob_items": 0, 2024-09-10T22:38:14.077 INFO:teuthology.orchestra.run.smithi138.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-10T22:38:14.077 INFO:teuthology.orchestra.run.smithi138.stdout: "bluestore_inline_bl_items": 0, 2024-09-10T22:38:14.077 INFO:teuthology.orchestra.run.smithi138.stdout: "bluestore_fsck_bytes": 0, 2024-09-10T22:38:14.077 INFO:teuthology.orchestra.run.smithi138.stdout: "bluestore_fsck_items": 0, 2024-09-10T22:38:14.077 INFO:teuthology.orchestra.run.smithi138.stdout: "bluestore_txc_bytes": 0, 2024-09-10T22:38:14.077 INFO:teuthology.orchestra.run.smithi138.stdout: "bluestore_txc_items": 0, 2024-09-10T22:38:14.077 INFO:teuthology.orchestra.run.smithi138.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-10T22:38:14.077 INFO:teuthology.orchestra.run.smithi138.stdout: "bluestore_writing_deferred_items": 0, 2024-09-10T22:38:14.077 INFO:teuthology.orchestra.run.smithi138.stdout: "bluestore_writing_bytes": 0, 2024-09-10T22:38:14.077 INFO:teuthology.orchestra.run.smithi138.stdout: "bluestore_writing_items": 0, 2024-09-10T22:38:14.077 INFO:teuthology.orchestra.run.smithi138.stdout: "bluefs_bytes": 0, 2024-09-10T22:38:14.078 INFO:teuthology.orchestra.run.smithi138.stdout: "bluefs_items": 0, 2024-09-10T22:38:14.078 INFO:teuthology.orchestra.run.smithi138.stdout: "bluefs_file_reader_bytes": 0, 2024-09-10T22:38:14.078 INFO:teuthology.orchestra.run.smithi138.stdout: "bluefs_file_reader_items": 0, 2024-09-10T22:38:14.078 INFO:teuthology.orchestra.run.smithi138.stdout: "bluefs_file_writer_bytes": 0, 2024-09-10T22:38:14.078 INFO:teuthology.orchestra.run.smithi138.stdout: "bluefs_file_writer_items": 0, 2024-09-10T22:38:14.078 INFO:teuthology.orchestra.run.smithi138.stdout: "buffer_anon_bytes": 148984, 2024-09-10T22:38:14.078 INFO:teuthology.orchestra.run.smithi138.stdout: "buffer_anon_items": 30, 2024-09-10T22:38:14.078 INFO:teuthology.orchestra.run.smithi138.stdout: "buffer_meta_bytes": 0, 2024-09-10T22:38:14.078 INFO:teuthology.orchestra.run.smithi138.stdout: "buffer_meta_items": 0, 2024-09-10T22:38:14.078 INFO:teuthology.orchestra.run.smithi138.stdout: "osd_bytes": 0, 2024-09-10T22:38:14.078 INFO:teuthology.orchestra.run.smithi138.stdout: "osd_items": 0, 2024-09-10T22:38:14.078 INFO:teuthology.orchestra.run.smithi138.stdout: "osd_mapbl_bytes": 0, 2024-09-10T22:38:14.078 INFO:teuthology.orchestra.run.smithi138.stdout: "osd_mapbl_items": 0, 2024-09-10T22:38:14.078 INFO:teuthology.orchestra.run.smithi138.stdout: "osd_pglog_bytes": 0, 2024-09-10T22:38:14.078 INFO:teuthology.orchestra.run.smithi138.stdout: "osd_pglog_items": 0, 2024-09-10T22:38:14.079 INFO:teuthology.orchestra.run.smithi138.stdout: "osdmap_bytes": 0, 2024-09-10T22:38:14.079 INFO:teuthology.orchestra.run.smithi138.stdout: "osdmap_items": 0, 2024-09-10T22:38:14.079 INFO:teuthology.orchestra.run.smithi138.stdout: "osdmap_mapping_bytes": 0, 2024-09-10T22:38:14.079 INFO:teuthology.orchestra.run.smithi138.stdout: "osdmap_mapping_items": 0, 2024-09-10T22:38:14.079 INFO:teuthology.orchestra.run.smithi138.stdout: "pgmap_bytes": 0, 2024-09-10T22:38:14.079 INFO:teuthology.orchestra.run.smithi138.stdout: "pgmap_items": 0, 2024-09-10T22:38:14.079 INFO:teuthology.orchestra.run.smithi138.stdout: "mds_co_bytes": 968, 2024-09-10T22:38:14.079 INFO:teuthology.orchestra.run.smithi138.stdout: "mds_co_items": 2, 2024-09-10T22:38:14.079 INFO:teuthology.orchestra.run.smithi138.stdout: "unittest_1_bytes": 0, 2024-09-10T22:38:14.079 INFO:teuthology.orchestra.run.smithi138.stdout: "unittest_1_items": 0, 2024-09-10T22:38:14.079 INFO:teuthology.orchestra.run.smithi138.stdout: "unittest_2_bytes": 0, 2024-09-10T22:38:14.079 INFO:teuthology.orchestra.run.smithi138.stdout: "unittest_2_items": 0 2024-09-10T22:38:14.079 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-09-10T22:38:14.079 INFO:teuthology.orchestra.run.smithi138.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-10T22:38:14.080 INFO:teuthology.orchestra.run.smithi138.stdout: "val": 0, 2024-09-10T22:38:14.080 INFO:teuthology.orchestra.run.smithi138.stdout: "max": 104857600, 2024-09-10T22:38:14.080 INFO:teuthology.orchestra.run.smithi138.stdout: "get_started": 0, 2024-09-10T22:38:14.080 INFO:teuthology.orchestra.run.smithi138.stdout: "get": 238, 2024-09-10T22:38:14.080 INFO:teuthology.orchestra.run.smithi138.stdout: "get_sum": 495883, 2024-09-10T22:38:14.080 INFO:teuthology.orchestra.run.smithi138.stdout: "get_or_fail_fail": 0, 2024-09-10T22:38:14.080 INFO:teuthology.orchestra.run.smithi138.stdout: "get_or_fail_success": 238, 2024-09-10T22:38:14.080 INFO:teuthology.orchestra.run.smithi138.stdout: "take": 0, 2024-09-10T22:38:14.080 INFO:teuthology.orchestra.run.smithi138.stdout: "take_sum": 0, 2024-09-10T22:38:14.080 INFO:teuthology.orchestra.run.smithi138.stdout: "put": 238, 2024-09-10T22:38:14.080 INFO:teuthology.orchestra.run.smithi138.stdout: "put_sum": 495883, 2024-09-10T22:38:14.080 INFO:teuthology.orchestra.run.smithi138.stdout: "wait": { 2024-09-10T22:38:14.080 INFO:teuthology.orchestra.run.smithi138.stdout: "avgcount": 0, 2024-09-10T22:38:14.080 INFO:teuthology.orchestra.run.smithi138.stdout: "sum": 0.000000000, 2024-09-10T22:38:14.081 INFO:teuthology.orchestra.run.smithi138.stdout: "avgtime": 0.000000000 2024-09-10T22:38:14.081 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-09-10T22:38:14.081 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-09-10T22:38:14.081 INFO:teuthology.orchestra.run.smithi138.stdout:} 2024-09-10T22:38:14.375 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:38:14 smithi138 ceph-mon[35236]: pgmap v701: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 29 MiB/s wr, 309 op/s 2024-09-10T22:38:14.458 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:38:14 smithi019 ceph-mon[31375]: pgmap v701: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 29 MiB/s wr, 309 op/s 2024-09-10T22:38:14.610 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:38:14 smithi135 ceph-mon[34789]: pgmap v701: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 29 MiB/s wr, 309 op/s 2024-09-10T22:38:14.761 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.l 2024-09-10T22:38:14.761 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.l 2024-09-10T22:38:14.761 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update' not found on daemon mds.l 2024-09-10T22:38:14.761 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update_receipt' not found on daemon mds.l 2024-09-10T22:38:14.761 DEBUG:teuthology.run_tasks:Unwinding manager kclient 2024-09-10T22:38:14.772 INFO:tasks.kclient:Unmounting kernel clients... 2024-09-10T22:38:14.772 DEBUG:teuthology.orchestra.run.smithi019:> set -ex 2024-09-10T22:38:14.772 DEBUG:teuthology.orchestra.run.smithi019:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T22:38:14.794 DEBUG:teuthology.orchestra.run.smithi019:> set -ex 2024-09-10T22:38:14.794 DEBUG:teuthology.orchestra.run.smithi019:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T22:38:14.854 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 22997a4c-6fc2-11ef-bcea-c7b262605968 -- ceph osd blocklist ls 2024-09-10T22:38:15.164 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/22997a4c-6fc2-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T22:38:15.688 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:38:15.646+0000 7f9a7c115640 1 -- 172.21.15.19:0/1585569784 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9a74101870 msgr2=0x7f9a74101c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:38:15.689 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:38:15.646+0000 7f9a7c115640 1 --2- 172.21.15.19:0/1585569784 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9a74101870 0x7f9a74101c50 secure :-1 s=READY pgs=880 cs=0 l=1 rev1=1 crypto rx=0x7f9a70009900 tx=0x7f9a7002a410 comp rx=0 tx=0).stop 2024-09-10T22:38:15.689 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:38:15.646+0000 7f9a7c115640 1 -- 172.21.15.19:0/1585569784 shutdown_connections 2024-09-10T22:38:15.689 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:38:15.646+0000 7f9a7c115640 1 --2- 172.21.15.19:0/1585569784 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f9a7410f420 0x7f9a74111810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:38:15.689 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:38:15.646+0000 7f9a7c115640 1 --2- 172.21.15.19:0/1585569784 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9a74102190 0x7f9a7410eee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:38:15.689 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:38:15.646+0000 7f9a7c115640 1 --2- 172.21.15.19:0/1585569784 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9a74101870 0x7f9a74101c50 unknown :-1 s=CLOSED pgs=880 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:38:15.689 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:38:15.646+0000 7f9a7c115640 1 -- 172.21.15.19:0/1585569784 >> 172.21.15.19:0/1585569784 conn(0x7f9a740fd700 msgr2=0x7f9a740ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:38:15.689 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:38:15.646+0000 7f9a7c115640 1 -- 172.21.15.19:0/1585569784 shutdown_connections 2024-09-10T22:38:15.689 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:38:15.646+0000 7f9a7c115640 1 -- 172.21.15.19:0/1585569784 wait complete. 2024-09-10T22:38:15.689 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:38:15.646+0000 7f9a7c115640 1 Processor -- start 2024-09-10T22:38:15.689 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:38:15.646+0000 7f9a7c115640 1 -- start start 2024-09-10T22:38:15.689 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:38:15.647+0000 7f9a7c115640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f9a74101870 0x7f9a7419b4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:38:15.689 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:38:15.647+0000 7f9a7c115640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9a74102190 0x7f9a7419ba20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:38:15.689 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:38:15.647+0000 7f9a7c115640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9a7410f420 0x7f9a741a0dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:38:15.690 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:38:15.647+0000 7f9a7c115640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f9a74114f90 con 0x7f9a74102190 2024-09-10T22:38:15.690 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:38:15.647+0000 7f9a7c115640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f9a74114e10 con 0x7f9a7410f420 2024-09-10T22:38:15.690 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:38:15.647+0000 7f9a7c115640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f9a74115110 con 0x7f9a74101870 2024-09-10T22:38:15.690 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:38:15.647+0000 7f9a796b0640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9a74102190 0x7f9a7419ba20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:38:15.690 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:38:15.647+0000 7f9a796b0640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9a74102190 0x7f9a7419ba20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:38164/0 (socket says 172.21.15.19:38164) 2024-09-10T22:38:15.690 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:38:15.647+0000 7f9a796b0640 1 -- 172.21.15.19:0/1983318680 learned_addr learned my addr 172.21.15.19:0/1983318680 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:38:15.690 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:38:15.647+0000 7f9a79eb1640 1 --2- 172.21.15.19:0/1983318680 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f9a74101870 0x7f9a7419b4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:38:15.690 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:38:15.647+0000 7f9a7a6b2640 1 --2- 172.21.15.19:0/1983318680 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9a7410f420 0x7f9a741a0dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:38:15.690 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:38:15.647+0000 7f9a796b0640 1 -- 172.21.15.19:0/1983318680 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f9a74101870 msgr2=0x7f9a7419b4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:38:15.690 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:38:15.647+0000 7f9a796b0640 1 --2- 172.21.15.19:0/1983318680 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f9a74101870 0x7f9a7419b4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:38:15.690 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:38:15.647+0000 7f9a796b0640 1 -- 172.21.15.19:0/1983318680 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9a7410f420 msgr2=0x7f9a741a0dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:38:15.690 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:38:15.647+0000 7f9a796b0640 1 --2- 172.21.15.19:0/1983318680 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9a7410f420 0x7f9a741a0dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:38:15.690 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:38:15.647+0000 7f9a796b0640 1 -- 172.21.15.19:0/1983318680 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9a741a1590 con 0x7f9a74102190 2024-09-10T22:38:15.691 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:38:15.647+0000 7f9a796b0640 1 --2- 172.21.15.19:0/1983318680 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9a74102190 0x7f9a7419ba20 secure :-1 s=READY pgs=881 cs=0 l=1 rev1=1 crypto rx=0x7f9a6400c920 tx=0x7f9a6400cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:38:15.691 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:38:15.647+0000 7f9a6affd640 1 -- 172.21.15.19:0/1983318680 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a64007c70 con 0x7f9a74102190 2024-09-10T22:38:15.691 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:38:15.648+0000 7f9a6affd640 1 -- 172.21.15.19:0/1983318680 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9a64007e10 con 0x7f9a74102190 2024-09-10T22:38:15.691 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:38:15.648+0000 7f9a7c115640 1 -- 172.21.15.19:0/1983318680 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9a741a1880 con 0x7f9a74102190 2024-09-10T22:38:15.691 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:38:15.648+0000 7f9a6affd640 1 -- 172.21.15.19:0/1983318680 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a64018820 con 0x7f9a74102190 2024-09-10T22:38:15.691 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:38:15.648+0000 7f9a7c115640 1 -- 172.21.15.19:0/1983318680 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9a741a7f40 con 0x7f9a74102190 2024-09-10T22:38:15.691 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:38:15.649+0000 7f9a7c115640 1 -- 172.21.15.19:0/1983318680 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9a74101c50 con 0x7f9a74102190 2024-09-10T22:38:15.691 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:38:15.650+0000 7f9a6affd640 1 -- 172.21.15.19:0/1983318680 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 18) ==== 153250+0+0 (secure 0 0 0) 0x7f9a6400f450 con 0x7f9a74102190 2024-09-10T22:38:15.691 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:38:15.651+0000 7f9a6affd640 1 --2- 172.21.15.19:0/1983318680 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f9a600b5360 0x7f9a600b7820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:38:15.691 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:38:15.651+0000 7f9a79eb1640 1 --2- 172.21.15.19:0/1983318680 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f9a600b5360 0x7f9a600b7820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:38:15.691 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:38:15.651+0000 7f9a6affd640 1 -- 172.21.15.19:0/1983318680 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8327+0+0 (secure 0 0 0) 0x7f9a640e6080 con 0x7f9a74102190 2024-09-10T22:38:15.692 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:38:15.652+0000 7f9a79eb1640 1 --2- 172.21.15.19:0/1983318680 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f9a600b5360 0x7f9a600b7820 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f9a70031440 tx=0x7f9a700095f0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:38:15.692 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:38:15.654+0000 7f9a6affd640 1 -- 172.21.15.19:0/1983318680 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f9a64014030 con 0x7f9a74102190 2024-09-10T22:38:15.855 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:38:15.853+0000 7f9a7c115640 1 -- 172.21.15.19:0/1983318680 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f9a7419c610 con 0x7f9a74102190 2024-09-10T22:38:15.855 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:38:15.853+0000 7f9a6affd640 1 -- 172.21.15.19:0/1983318680 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 10 entries v77) ==== 81+0+588 (secure 0 0 0) 0x7f9a7419c610 con 0x7f9a74102190 2024-09-10T22:38:15.855 INFO:teuthology.orchestra.run.smithi019.stdout:172.21.15.19:0/2099468127 2024-09-11T22:17:04.260826+0000 2024-09-10T22:38:15.855 INFO:teuthology.orchestra.run.smithi019.stdout:172.21.15.19:0/538724915 2024-09-11T22:17:04.260826+0000 2024-09-10T22:38:15.855 INFO:teuthology.orchestra.run.smithi019.stdout:172.21.15.19:0/3504695777 2024-09-11T22:17:04.260826+0000 2024-09-10T22:38:15.855 INFO:teuthology.orchestra.run.smithi019.stdout:172.21.15.19:0/1401613792 2024-09-11T22:16:39.069638+0000 2024-09-10T22:38:15.855 INFO:teuthology.orchestra.run.smithi019.stdout:172.21.15.19:6801/3005924425 2024-09-11T22:17:04.260826+0000 2024-09-10T22:38:15.855 INFO:teuthology.orchestra.run.smithi019.stdout:172.21.15.19:6800/3005924425 2024-09-11T22:17:04.260826+0000 2024-09-10T22:38:15.856 INFO:teuthology.orchestra.run.smithi019.stdout:172.21.15.19:0/104917892 2024-09-11T22:16:39.069638+0000 2024-09-10T22:38:15.856 INFO:teuthology.orchestra.run.smithi019.stdout:172.21.15.19:0/1778305990 2024-09-11T22:16:39.069638+0000 2024-09-10T22:38:15.856 INFO:teuthology.orchestra.run.smithi019.stdout:172.21.15.19:6801/535670059 2024-09-11T22:16:39.069638+0000 2024-09-10T22:38:15.856 INFO:teuthology.orchestra.run.smithi019.stdout:172.21.15.19:6800/535670059 2024-09-11T22:16:39.069638+0000 2024-09-10T22:38:15.856 INFO:teuthology.orchestra.run.smithi019.stderr:listed 10 entries 2024-09-10T22:38:15.858 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:38:15.856+0000 7f9a7c115640 1 -- 172.21.15.19:0/1983318680 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f9a600b5360 msgr2=0x7f9a600b7820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:38:15.858 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:38:15.856+0000 7f9a7c115640 1 --2- 172.21.15.19:0/1983318680 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f9a600b5360 0x7f9a600b7820 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f9a70031440 tx=0x7f9a700095f0 comp rx=0 tx=0).stop 2024-09-10T22:38:15.858 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:38:15.856+0000 7f9a7c115640 1 -- 172.21.15.19:0/1983318680 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9a74102190 msgr2=0x7f9a7419ba20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:38:15.858 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:38:15.856+0000 7f9a7c115640 1 --2- 172.21.15.19:0/1983318680 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9a74102190 0x7f9a7419ba20 secure :-1 s=READY pgs=881 cs=0 l=1 rev1=1 crypto rx=0x7f9a6400c920 tx=0x7f9a6400cde0 comp rx=0 tx=0).stop 2024-09-10T22:38:15.859 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:38:15.856+0000 7f9a7c115640 1 -- 172.21.15.19:0/1983318680 shutdown_connections 2024-09-10T22:38:15.859 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:38:15.856+0000 7f9a7c115640 1 --2- 172.21.15.19:0/1983318680 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f9a600b5360 0x7f9a600b7820 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:38:15.859 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:38:15.856+0000 7f9a7c115640 1 --2- 172.21.15.19:0/1983318680 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9a7410f420 0x7f9a741a0dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:38:15.859 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:38:15.856+0000 7f9a7c115640 1 --2- 172.21.15.19:0/1983318680 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9a74102190 0x7f9a7419ba20 unknown :-1 s=CLOSED pgs=881 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:38:15.859 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:38:15.856+0000 7f9a7c115640 1 --2- 172.21.15.19:0/1983318680 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f9a74101870 0x7f9a7419b4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:38:15.859 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:38:15.856+0000 7f9a7c115640 1 -- 172.21.15.19:0/1983318680 >> 172.21.15.19:0/1983318680 conn(0x7f9a740fd700 msgr2=0x7f9a741106d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:38:15.859 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:38:15.856+0000 7f9a7c115640 1 -- 172.21.15.19:0/1983318680 shutdown_connections 2024-09-10T22:38:15.859 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:38:15.857+0000 7f9a7c115640 1 -- 172.21.15.19:0/1983318680 wait complete. 2024-09-10T22:38:16.375 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:38:16 smithi138 ceph-mon[35236]: pgmap v702: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 30 MiB/s wr, 282 op/s 2024-09-10T22:38:16.375 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:38:16 smithi138 ceph-mon[35236]: from='client.? 172.21.15.19:0/1983318680' entity='client.admin' cmd={"prefix": "osd blocklist ls"} : dispatch 2024-09-10T22:38:16.458 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:38:16 smithi019 ceph-mon[31375]: pgmap v702: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 30 MiB/s wr, 282 op/s 2024-09-10T22:38:16.458 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:38:16 smithi019 ceph-mon[31375]: from='client.? 172.21.15.19:0/1983318680' entity='client.admin' cmd={"prefix": "osd blocklist ls"} : dispatch 2024-09-10T22:38:16.610 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:38:16 smithi135 ceph-mon[34789]: pgmap v702: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 30 MiB/s wr, 282 op/s 2024-09-10T22:38:16.610 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:38:16 smithi135 ceph-mon[34789]: from='client.? 172.21.15.19:0/1983318680' entity='client.admin' cmd={"prefix": "osd blocklist ls"} : dispatch 2024-09-10T22:38:16.611 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-09-10T22:38:16.611 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T22:38:16.612 DEBUG:teuthology.orchestra.run.smithi019:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-09-10T22:38:18.709 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:38:18 smithi019 ceph-mon[31375]: pgmap v703: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 37 MiB/s wr, 238 op/s 2024-09-10T22:38:18.873 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:38:18 smithi135 ceph-mon[34789]: pgmap v703: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 37 MiB/s wr, 238 op/s 2024-09-10T22:38:18.875 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:38:18 smithi138 ceph-mon[35236]: pgmap v703: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 37 MiB/s wr, 238 op/s 2024-09-10T22:38:19.708 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:38:19 smithi019 ceph-mon[31375]: pgmap v704: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 28 MiB/s wr, 111 op/s 2024-09-10T22:38:19.860 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:38:19 smithi135 ceph-mon[34789]: pgmap v704: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 28 MiB/s wr, 111 op/s 2024-09-10T22:38:19.875 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:38:19 smithi138 ceph-mon[35236]: pgmap v704: 97 pgs: 97 active+clean; 10 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 28 MiB/s wr, 111 op/s 2024-09-10T22:38:21.958 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:38:21 smithi019 ceph-mon[31375]: pgmap v705: 97 pgs: 97 active+clean; 10 GiB data, 36 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 73 MiB/s wr, 317 op/s 2024-09-10T22:38:22.110 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:38:21 smithi135 ceph-mon[34789]: pgmap v705: 97 pgs: 97 active+clean; 10 GiB data, 36 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 73 MiB/s wr, 317 op/s 2024-09-10T22:38:22.125 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:38:21 smithi138 ceph-mon[35236]: pgmap v705: 97 pgs: 97 active+clean; 10 GiB data, 36 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 73 MiB/s wr, 317 op/s 2024-09-10T22:38:23.958 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:38:23 smithi019 ceph-mon[31375]: pgmap v706: 97 pgs: 97 active+clean; 10 GiB data, 37 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 111 MiB/s wr, 474 op/s 2024-09-10T22:38:24.110 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:38:23 smithi135 ceph-mon[34789]: pgmap v706: 97 pgs: 97 active+clean; 10 GiB data, 37 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 111 MiB/s wr, 474 op/s 2024-09-10T22:38:24.125 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:38:23 smithi138 ceph-mon[35236]: pgmap v706: 97 pgs: 97 active+clean; 10 GiB data, 37 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 111 MiB/s wr, 474 op/s 2024-09-10T22:38:25.109 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:38:24 smithi135 ceph-mon[34789]: Health check failed: 1 OSD(s) experiencing slow operations in BlueStore (BLUESTORE_SLOW_OP_ALERT) 2024-09-10T22:38:25.125 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:38:24 smithi138 ceph-mon[35236]: Health check failed: 1 OSD(s) experiencing slow operations in BlueStore (BLUESTORE_SLOW_OP_ALERT) 2024-09-10T22:38:25.208 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:38:24 smithi019 ceph-mon[31375]: Health check failed: 1 OSD(s) experiencing slow operations in BlueStore (BLUESTORE_SLOW_OP_ALERT) 2024-09-10T22:38:26.025 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:38:25 smithi138 ceph-mon[35236]: pgmap v707: 97 pgs: 97 active+clean; 10 GiB data, 37 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 145 MiB/s wr, 635 op/s 2024-09-10T22:38:26.110 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:38:25 smithi135 ceph-mon[34789]: pgmap v707: 97 pgs: 97 active+clean; 10 GiB data, 37 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 145 MiB/s wr, 635 op/s 2024-09-10T22:38:26.208 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:38:25 smithi019 ceph-mon[31375]: pgmap v707: 97 pgs: 97 active+clean; 10 GiB data, 37 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 145 MiB/s wr, 635 op/s 2024-09-10T22:38:28.110 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:38:27 smithi135 ceph-mon[34789]: pgmap v708: 97 pgs: 97 active+clean; 10 GiB data, 35 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 202 MiB/s wr, 996 op/s 2024-09-10T22:38:28.125 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:38:27 smithi138 ceph-mon[35236]: pgmap v708: 97 pgs: 97 active+clean; 10 GiB data, 35 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 202 MiB/s wr, 996 op/s 2024-09-10T22:38:28.208 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:38:27 smithi019 ceph-mon[31375]: pgmap v708: 97 pgs: 97 active+clean; 10 GiB data, 35 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 202 MiB/s wr, 996 op/s 2024-09-10T22:38:28.886 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi019.front.sepia.ceph.com 2024-09-10T22:38:28.886 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T22:38:28.886 DEBUG:teuthology.orchestra.run.smithi019:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-10T22:38:28.951 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T22:38:28.951 DEBUG:teuthology.orchestra.run.smithi019:> ip netns list 2024-09-10T22:38:28.967 INFO:teuthology.orchestra.run.smithi019.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-10T22:38:28.967 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T22:38:28.967 DEBUG:teuthology.orchestra.run.smithi019:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-10T22:38:29.034 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T22:38:29.034 DEBUG:teuthology.orchestra.run.smithi019:> sudo ip link delete ceph-brx 2024-09-10T22:38:29.132 DEBUG:teuthology.run_tasks:Unwinding manager cephadm 2024-09-10T22:38:29.141 INFO:tasks.cephadm:Teardown begin 2024-09-10T22:38:29.142 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-10T22:38:29.142 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 22997a4c-6fc2-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-10T22:38:29.403 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/22997a4c-6fc2-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T22:38:29.831 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:38:29 smithi019 ceph-mon[31375]: pgmap v709: 97 pgs: 97 active+clean; 10 GiB data, 35 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 199 MiB/s wr, 1.03k op/s 2024-09-10T22:38:29.931 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:38:29.918+0000 7f643512b640 1 -- 172.21.15.19:0/3724972932 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f64301021d0 msgr2=0x7f643010ef20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:38:29.931 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:38:29.918+0000 7f643512b640 1 --2- 172.21.15.19:0/3724972932 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f64301021d0 0x7f643010ef20 secure :-1 s=READY pgs=882 cs=0 l=1 rev1=1 crypto rx=0x7f6424009900 tx=0x7f642402a480 comp rx=0 tx=0).stop 2024-09-10T22:38:29.932 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:38:29.918+0000 7f643512b640 1 -- 172.21.15.19:0/3724972932 shutdown_connections 2024-09-10T22:38:29.932 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:38:29.918+0000 7f643512b640 1 --2- 172.21.15.19:0/3724972932 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f643010f460 0x7f6430111850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:38:29.932 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:38:29.918+0000 7f643512b640 1 --2- 172.21.15.19:0/3724972932 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f64301021d0 0x7f643010ef20 unknown :-1 s=CLOSED pgs=882 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:38:29.932 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:38:29.918+0000 7f643512b640 1 --2- 172.21.15.19:0/3724972932 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f64301018b0 0x7f6430101c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:38:29.932 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:38:29.918+0000 7f643512b640 1 -- 172.21.15.19:0/3724972932 >> 172.21.15.19:0/3724972932 conn(0x7f64300fd700 msgr2=0x7f64300ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:38:29.932 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:38:29.918+0000 7f643512b640 1 -- 172.21.15.19:0/3724972932 shutdown_connections 2024-09-10T22:38:29.932 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:38:29.918+0000 7f643512b640 1 -- 172.21.15.19:0/3724972932 wait complete. 2024-09-10T22:38:29.932 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:38:29.919+0000 7f643512b640 1 Processor -- start 2024-09-10T22:38:29.932 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:38:29.919+0000 7f643512b640 1 -- start start 2024-09-10T22:38:29.932 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:38:29.919+0000 7f643512b640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f64301018b0 0x7f643019b4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:38:29.932 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:38:29.919+0000 7f643512b640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f64301021d0 0x7f643019ba30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:38:29.933 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:38:29.919+0000 7f643512b640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f643010f460 0x7f64301a0dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:38:29.933 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:38:29.919+0000 7f643512b640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f6430114f80 con 0x7f64301018b0 2024-09-10T22:38:29.933 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:38:29.919+0000 7f643512b640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f6430114e00 con 0x7f64301021d0 2024-09-10T22:38:29.933 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:38:29.919+0000 7f643512b640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f6430115100 con 0x7f643010f460 2024-09-10T22:38:29.933 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:38:29.919+0000 7f642ed9d640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f64301018b0 0x7f643019b4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:38:29.933 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:38:29.920+0000 7f642ed9d640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f64301018b0 0x7f643019b4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:49646/0 (socket says 172.21.15.19:49646) 2024-09-10T22:38:29.933 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:38:29.920+0000 7f642ed9d640 1 -- 172.21.15.19:0/3021069300 learned_addr learned my addr 172.21.15.19:0/3021069300 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:38:29.933 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:38:29.920+0000 7f642e59c640 1 --2- 172.21.15.19:0/3021069300 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f64301021d0 0x7f643019ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:38:29.933 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:38:29.920+0000 7f642f59e640 1 --2- 172.21.15.19:0/3021069300 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f643010f460 0x7f64301a0dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:38:29.933 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:38:29.920+0000 7f642ed9d640 1 -- 172.21.15.19:0/3021069300 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f643010f460 msgr2=0x7f64301a0dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:38:29.933 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:38:29.920+0000 7f642ed9d640 1 --2- 172.21.15.19:0/3021069300 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f643010f460 0x7f64301a0dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:38:29.933 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:38:29.920+0000 7f642ed9d640 1 -- 172.21.15.19:0/3021069300 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f64301021d0 msgr2=0x7f643019ba30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:38:29.934 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:38:29.920+0000 7f642ed9d640 1 --2- 172.21.15.19:0/3021069300 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f64301021d0 0x7f643019ba30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:38:29.934 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:38:29.920+0000 7f642ed9d640 1 -- 172.21.15.19:0/3021069300 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f64301a15a0 con 0x7f64301018b0 2024-09-10T22:38:29.934 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:38:29.920+0000 7f642ed9d640 1 --2- 172.21.15.19:0/3021069300 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f64301018b0 0x7f643019b4f0 secure :-1 s=READY pgs=883 cs=0 l=1 rev1=1 crypto rx=0x7f642000e9f0 tx=0x7f642000edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:38:29.934 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:38:29.920+0000 7f6417fff640 1 -- 172.21.15.19:0/3021069300 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f642000cd80 con 0x7f64301018b0 2024-09-10T22:38:29.934 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:38:29.920+0000 7f643512b640 1 -- 172.21.15.19:0/3021069300 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f64301a1890 con 0x7f64301018b0 2024-09-10T22:38:29.934 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:38:29.920+0000 7f6417fff640 1 -- 172.21.15.19:0/3021069300 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f64200054d0 con 0x7f64301018b0 2024-09-10T22:38:29.934 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:38:29.920+0000 7f6417fff640 1 -- 172.21.15.19:0/3021069300 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6420010690 con 0x7f64301018b0 2024-09-10T22:38:29.934 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:38:29.920+0000 7f643512b640 1 -- 172.21.15.19:0/3021069300 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f64301a7f50 con 0x7f64301018b0 2024-09-10T22:38:29.934 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:38:29.921+0000 7f643512b640 1 -- 172.21.15.19:0/3021069300 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6430101c90 con 0x7f64301018b0 2024-09-10T22:38:29.934 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:38:29.923+0000 7f6417fff640 1 -- 172.21.15.19:0/3021069300 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 18) ==== 153250+0+0 (secure 0 0 0) 0x7f6420004e30 con 0x7f64301018b0 2024-09-10T22:38:29.934 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:38:29.924+0000 7f6417fff640 1 --2- 172.21.15.19:0/3021069300 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f64180b52e0 0x7f64180b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:38:29.934 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:38:29.924+0000 7f642e59c640 1 --2- 172.21.15.19:0/3021069300 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f64180b52e0 0x7f64180b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:38:29.934 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:38:29.924+0000 7f6417fff640 1 -- 172.21.15.19:0/3021069300 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8327+0+0 (secure 0 0 0) 0x7f64200e61f0 con 0x7f64301018b0 2024-09-10T22:38:29.935 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:38:29.925+0000 7f642e59c640 1 --2- 172.21.15.19:0/3021069300 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f64180b52e0 0x7f64180b77a0 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f6424031440 tx=0x7f6424005b50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:38:29.935 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:38:29.928+0000 7f6417fff640 1 -- 172.21.15.19:0/3021069300 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f64200ad050 con 0x7f64301018b0 2024-09-10T22:38:30.110 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:38:29 smithi135 ceph-mon[34789]: pgmap v709: 97 pgs: 97 active+clean; 10 GiB data, 35 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 199 MiB/s wr, 1.03k op/s 2024-09-10T22:38:30.125 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:38:29 smithi138 ceph-mon[35236]: pgmap v709: 97 pgs: 97 active+clean; 10 GiB data, 35 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 199 MiB/s wr, 1.03k op/s 2024-09-10T22:38:30.167 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:38:30.165+0000 7f643512b640 1 -- 172.21.15.19:0/3021069300 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f64301a8250 con 0x7f64301018b0 2024-09-10T22:38:30.167 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:38:30.166+0000 7f6417fff640 1 -- 172.21.15.19:0/3021069300 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+11922 (secure 0 0 0) 0x7f64200ac950 con 0x7f64301018b0 2024-09-10T22:38:30.168 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-10T22:38:30.168 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":28,"btime":"2024-09-10T22:37:18:681285+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14673,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6835/1835804747","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6834","nonce":1835804747},{"type":"v1","addr":"172.21.15.19:6835","nonce":1835804747}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14685,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6837/1750470490","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6836","nonce":1750470490},{"type":"v1","addr":"172.21.15.19:6837","nonce":1750470490}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14733,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6839/2642941149","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6838","nonce":2642941149},{"type":"v1","addr":"172.21.15.19:6839","nonce":2642941149}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14745,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6841/2449948682","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6840","nonce":2449948682},{"type":"v1","addr":"172.21.15.19:6841","nonce":2449948682}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24511,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.138:6833/2524811494","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6832","nonce":2524811494},{"type":"v1","addr":"172.21.15.138:6833","nonce":2524811494}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24512,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6833/3014993624","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6832","nonce":3014993624},{"type":"v1","addr":"172.21.15.135:6833","nonce":3014993624}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":28,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-10T22:24:22.733925+0000","modified":"2024-09-10T22:37:18.535834+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24581,"mds_1":24568,"mds_2":24553},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24527":{"gid":24527,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.135:6835/3715773348","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6834","nonce":3715773348},{"type":"v1","addr":"172.21.15.135:6835","nonce":3715773348}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24541":{"gid":24541,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.138:6835/933547028","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6834","nonce":933547028},{"type":"v1","addr":"172.21.15.138:6835","nonce":933547028}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24551":{"gid":24551,"name":"h","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.135:6837/3495029135","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6836","nonce":3495029135},{"type":"v1","addr":"172.21.15.135:6837","nonce":3495029135}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24553":{"gid":24553,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":10,"addr":"172.21.15.138:6837/3353290042","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6836","nonce":3353290042},{"type":"v1","addr":"172.21.15.138:6837","nonce":3353290042}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24568":{"gid":24568,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.138:6839/383637208","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6838","nonce":383637208},{"type":"v1","addr":"172.21.15.138:6839","nonce":383637208}]},"join_fscid":-1,"export_targets":[0],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24581":{"gid":24581,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.135:6839/1254769802","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6838","nonce":1254769802},{"type":"v1","addr":"172.21.15.135:6839","nonce":1254769802}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24581,"qdb_cluster":[24553,24568,24581]},"id":1}]} 2024-09-10T22:38:30.168 INFO:teuthology.orchestra.run.smithi019.stderr:dumped fsmap epoch 28 2024-09-10T22:38:30.170 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:38:30.168+0000 7f643512b640 1 -- 172.21.15.19:0/3021069300 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f64180b52e0 msgr2=0x7f64180b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:38:30.170 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:38:30.168+0000 7f643512b640 1 --2- 172.21.15.19:0/3021069300 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f64180b52e0 0x7f64180b77a0 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f6424031440 tx=0x7f6424005b50 comp rx=0 tx=0).stop 2024-09-10T22:38:30.170 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:38:30.168+0000 7f643512b640 1 -- 172.21.15.19:0/3021069300 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f64301018b0 msgr2=0x7f643019b4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:38:30.170 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:38:30.168+0000 7f643512b640 1 --2- 172.21.15.19:0/3021069300 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f64301018b0 0x7f643019b4f0 secure :-1 s=READY pgs=883 cs=0 l=1 rev1=1 crypto rx=0x7f642000e9f0 tx=0x7f642000edf0 comp rx=0 tx=0).stop 2024-09-10T22:38:30.170 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:38:30.169+0000 7f643512b640 1 -- 172.21.15.19:0/3021069300 shutdown_connections 2024-09-10T22:38:30.170 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:38:30.169+0000 7f643512b640 1 --2- 172.21.15.19:0/3021069300 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f64180b52e0 0x7f64180b77a0 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:38:30.170 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:38:30.169+0000 7f643512b640 1 --2- 172.21.15.19:0/3021069300 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f643010f460 0x7f64301a0dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:38:30.171 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:38:30.169+0000 7f643512b640 1 --2- 172.21.15.19:0/3021069300 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f64301021d0 0x7f643019ba30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:38:30.171 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:38:30.169+0000 7f643512b640 1 --2- 172.21.15.19:0/3021069300 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f64301018b0 0x7f643019b4f0 unknown :-1 s=CLOSED pgs=883 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:38:30.171 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:38:30.169+0000 7f643512b640 1 -- 172.21.15.19:0/3021069300 >> 172.21.15.19:0/3021069300 conn(0x7f64300fd700 msgr2=0x7f64300ffaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:38:30.171 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:38:30.169+0000 7f643512b640 1 -- 172.21.15.19:0/3021069300 shutdown_connections 2024-09-10T22:38:30.171 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:38:30.169+0000 7f643512b640 1 -- 172.21.15.19:0/3021069300 wait complete. 2024-09-10T22:38:30.958 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 22997a4c-6fc2-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-10T22:38:31.110 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:38:30 smithi135 ceph-mon[34789]: from='client.? 172.21.15.19:0/3021069300' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T22:38:31.125 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:38:30 smithi138 ceph-mon[35236]: from='client.? 172.21.15.19:0/3021069300' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T22:38:31.208 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:38:30 smithi019 ceph-mon[31375]: from='client.? 172.21.15.19:0/3021069300' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T22:38:31.226 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/22997a4c-6fc2-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T22:38:31.758 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:38:31.741+0000 7fadcde97640 1 -- 172.21.15.19:0/2181866426 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fadc8101c90 msgr2=0x7fadc8102070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:38:31.758 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:38:31.741+0000 7fadcde97640 1 --2- 172.21.15.19:0/2181866426 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fadc8101c90 0x7fadc8102070 secure :-1 s=READY pgs=884 cs=0 l=1 rev1=1 crypto rx=0x7fadb8009ca0 tx=0x7fadb802a8c0 comp rx=0 tx=0).stop 2024-09-10T22:38:31.758 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:38:31.742+0000 7fadcde97640 1 -- 172.21.15.19:0/2181866426 shutdown_connections 2024-09-10T22:38:31.758 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:38:31.742+0000 7fadcde97640 1 --2- 172.21.15.19:0/2181866426 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fadc8108020 0x7fadc810e820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:38:31.758 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:38:31.742+0000 7fadcde97640 1 --2- 172.21.15.19:0/2181866426 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fadc81076a0 0x7fadc8107ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:38:31.758 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:38:31.742+0000 7fadcde97640 1 --2- 172.21.15.19:0/2181866426 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fadc8101c90 0x7fadc8102070 unknown :-1 s=CLOSED pgs=884 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:38:31.758 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:38:31.742+0000 7fadcde97640 1 -- 172.21.15.19:0/2181866426 >> 172.21.15.19:0/2181866426 conn(0x7fadc80fd6e0 msgr2=0x7fadc80ffb00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:38:31.758 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:38:31.742+0000 7fadcde97640 1 -- 172.21.15.19:0/2181866426 shutdown_connections 2024-09-10T22:38:31.759 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:38:31.742+0000 7fadcde97640 1 -- 172.21.15.19:0/2181866426 wait complete. 2024-09-10T22:38:31.759 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:38:31.742+0000 7fadcde97640 1 Processor -- start 2024-09-10T22:38:31.759 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:38:31.742+0000 7fadcde97640 1 -- start start 2024-09-10T22:38:31.759 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:38:31.743+0000 7fadcde97640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fadc8101c90 0x7fadc819a0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:38:31.759 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:38:31.743+0000 7fadcde97640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fadc81076a0 0x7fadc819a5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:38:31.759 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:38:31.743+0000 7fadcde97640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fadc8108020 0x7fadc819ab50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:38:31.759 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:38:31.743+0000 7fadcde97640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fadc8111ce0 con 0x7fadc81076a0 2024-09-10T22:38:31.759 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:38:31.743+0000 7fadcde97640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fadc8111b60 con 0x7fadc8101c90 2024-09-10T22:38:31.759 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:38:31.743+0000 7fadcde97640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7fadc8111e60 con 0x7fadc8108020 2024-09-10T22:38:31.759 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:38:31.743+0000 7fadc6ffd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fadc81076a0 0x7fadc819a5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:38:31.759 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:38:31.743+0000 7fadc6ffd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fadc81076a0 0x7fadc819a5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:49654/0 (socket says 172.21.15.19:49654) 2024-09-10T22:38:31.759 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:38:31.743+0000 7fadc6ffd640 1 -- 172.21.15.19:0/1154142874 learned_addr learned my addr 172.21.15.19:0/1154142874 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:38:31.759 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:38:31.743+0000 7fadc77fe640 1 --2- 172.21.15.19:0/1154142874 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fadc8101c90 0x7fadc819a0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:38:31.760 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:38:31.743+0000 7fadc7fff640 1 --2- 172.21.15.19:0/1154142874 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fadc8108020 0x7fadc819ab50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:38:31.760 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:38:31.743+0000 7fadc6ffd640 1 -- 172.21.15.19:0/1154142874 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fadc8108020 msgr2=0x7fadc819ab50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:38:31.760 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:38:31.743+0000 7fadc6ffd640 1 --2- 172.21.15.19:0/1154142874 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fadc8108020 0x7fadc819ab50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:38:31.760 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:38:31.743+0000 7fadc6ffd640 1 -- 172.21.15.19:0/1154142874 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fadc8101c90 msgr2=0x7fadc819a0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:38:31.760 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:38:31.743+0000 7fadc6ffd640 1 --2- 172.21.15.19:0/1154142874 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fadc8101c90 0x7fadc819a0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:38:31.760 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:38:31.743+0000 7fadc6ffd640 1 -- 172.21.15.19:0/1154142874 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fadc81a5490 con 0x7fadc81076a0 2024-09-10T22:38:31.760 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:38:31.743+0000 7fadc77fe640 1 --2- 172.21.15.19:0/1154142874 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fadc8101c90 0x7fadc819a0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T22:38:31.760 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:38:31.743+0000 7fadc6ffd640 1 --2- 172.21.15.19:0/1154142874 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fadc81076a0 0x7fadc819a5f0 secure :-1 s=READY pgs=885 cs=0 l=1 rev1=1 crypto rx=0x7fadbc00d770 tx=0x7fadbc00dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:38:31.760 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:38:31.744+0000 7fadc4ff9640 1 -- 172.21.15.19:0/1154142874 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fadbc017070 con 0x7fadc81076a0 2024-09-10T22:38:31.760 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:38:31.744+0000 7fadcde97640 1 -- 172.21.15.19:0/1154142874 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fadc81a5780 con 0x7fadc81076a0 2024-09-10T22:38:31.760 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:38:31.744+0000 7fadc4ff9640 1 -- 172.21.15.19:0/1154142874 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fadbc0054d0 con 0x7fadc81076a0 2024-09-10T22:38:31.761 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:38:31.744+0000 7fadc4ff9640 1 -- 172.21.15.19:0/1154142874 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fadbc004c30 con 0x7fadc81076a0 2024-09-10T22:38:31.761 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:38:31.744+0000 7fadcde97640 1 -- 172.21.15.19:0/1154142874 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fadc81a5c70 con 0x7fadc81076a0 2024-09-10T22:38:31.761 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:38:31.745+0000 7fadcde97640 1 -- 172.21.15.19:0/1154142874 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fadc8102070 con 0x7fadc81076a0 2024-09-10T22:38:31.761 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:38:31.747+0000 7fadc4ff9640 1 -- 172.21.15.19:0/1154142874 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 18) ==== 153250+0+0 (secure 0 0 0) 0x7fadbc004dd0 con 0x7fadc81076a0 2024-09-10T22:38:31.761 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:38:31.748+0000 7fadc4ff9640 1 --2- 172.21.15.19:0/1154142874 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7fadb00b52e0 0x7fadb00b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:38:31.761 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:38:31.748+0000 7fadc77fe640 1 --2- 172.21.15.19:0/1154142874 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7fadb00b52e0 0x7fadb00b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:38:31.761 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:38:31.748+0000 7fadc4ff9640 1 -- 172.21.15.19:0/1154142874 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8327+0+0 (secure 0 0 0) 0x7fadbc0e5bc0 con 0x7fadc81076a0 2024-09-10T22:38:31.761 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:38:31.748+0000 7fadc77fe640 1 --2- 172.21.15.19:0/1154142874 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7fadb00b52e0 0x7fadb00b77a0 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7fadb8000f80 tx=0x7fadb8009360 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:38:31.761 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:38:31.751+0000 7fadc4ff9640 1 -- 172.21.15.19:0/1154142874 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7fadbc0aca20 con 0x7fadc81076a0 2024-09-10T22:38:31.960 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:38:31 smithi019 ceph-mon[31375]: pgmap v710: 97 pgs: 97 active+clean; 10 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 199 MiB/s wr, 1.05k op/s 2024-09-10T22:38:31.960 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:38:31 smithi019 ceph-mon[31375]: Health check update: 12 OSD(s) experiencing slow operations in BlueStore (BLUESTORE_SLOW_OP_ALERT) 2024-09-10T22:38:31.992 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:38:31.990+0000 7fadcde97640 1 -- 172.21.15.19:0/1154142874 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fadc802e5c0 con 0x7fadc81076a0 2024-09-10T22:38:31.992 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:38:31.991+0000 7fadc4ff9640 1 -- 172.21.15.19:0/1154142874 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+11922 (secure 0 0 0) 0x7fadbc0ac320 con 0x7fadc81076a0 2024-09-10T22:38:31.993 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-10T22:38:31.993 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":28,"btime":"2024-09-10T22:37:18:681285+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14673,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6835/1835804747","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6834","nonce":1835804747},{"type":"v1","addr":"172.21.15.19:6835","nonce":1835804747}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14685,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6837/1750470490","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6836","nonce":1750470490},{"type":"v1","addr":"172.21.15.19:6837","nonce":1750470490}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14733,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6839/2642941149","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6838","nonce":2642941149},{"type":"v1","addr":"172.21.15.19:6839","nonce":2642941149}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14745,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6841/2449948682","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6840","nonce":2449948682},{"type":"v1","addr":"172.21.15.19:6841","nonce":2449948682}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24511,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.138:6833/2524811494","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6832","nonce":2524811494},{"type":"v1","addr":"172.21.15.138:6833","nonce":2524811494}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24512,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6833/3014993624","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6832","nonce":3014993624},{"type":"v1","addr":"172.21.15.135:6833","nonce":3014993624}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":28,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-10T22:24:22.733925+0000","modified":"2024-09-10T22:37:18.535834+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24581,"mds_1":24568,"mds_2":24553},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24527":{"gid":24527,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.135:6835/3715773348","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6834","nonce":3715773348},{"type":"v1","addr":"172.21.15.135:6835","nonce":3715773348}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24541":{"gid":24541,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.138:6835/933547028","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6834","nonce":933547028},{"type":"v1","addr":"172.21.15.138:6835","nonce":933547028}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24551":{"gid":24551,"name":"h","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.135:6837/3495029135","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6836","nonce":3495029135},{"type":"v1","addr":"172.21.15.135:6837","nonce":3495029135}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24553":{"gid":24553,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":10,"addr":"172.21.15.138:6837/3353290042","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6836","nonce":3353290042},{"type":"v1","addr":"172.21.15.138:6837","nonce":3353290042}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24568":{"gid":24568,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.138:6839/383637208","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6838","nonce":383637208},{"type":"v1","addr":"172.21.15.138:6839","nonce":383637208}]},"join_fscid":-1,"export_targets":[0],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24581":{"gid":24581,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.135:6839/1254769802","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6838","nonce":1254769802},{"type":"v1","addr":"172.21.15.135:6839","nonce":1254769802}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24581,"qdb_cluster":[24553,24568,24581]},"id":1}]} 2024-09-10T22:38:31.993 INFO:teuthology.orchestra.run.smithi019.stderr:dumped fsmap epoch 28 2024-09-10T22:38:31.995 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:38:31.993+0000 7fadcde97640 1 -- 172.21.15.19:0/1154142874 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7fadb00b52e0 msgr2=0x7fadb00b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:38:31.995 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:38:31.993+0000 7fadcde97640 1 --2- 172.21.15.19:0/1154142874 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7fadb00b52e0 0x7fadb00b77a0 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7fadb8000f80 tx=0x7fadb8009360 comp rx=0 tx=0).stop 2024-09-10T22:38:31.995 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:38:31.993+0000 7fadcde97640 1 -- 172.21.15.19:0/1154142874 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fadc81076a0 msgr2=0x7fadc819a5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:38:31.995 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:38:31.993+0000 7fadcde97640 1 --2- 172.21.15.19:0/1154142874 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fadc81076a0 0x7fadc819a5f0 secure :-1 s=READY pgs=885 cs=0 l=1 rev1=1 crypto rx=0x7fadbc00d770 tx=0x7fadbc00dc30 comp rx=0 tx=0).stop 2024-09-10T22:38:31.995 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:38:31.993+0000 7fadcde97640 1 -- 172.21.15.19:0/1154142874 shutdown_connections 2024-09-10T22:38:31.996 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:38:31.993+0000 7fadcde97640 1 --2- 172.21.15.19:0/1154142874 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7fadb00b52e0 0x7fadb00b77a0 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:38:31.996 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:38:31.993+0000 7fadcde97640 1 --2- 172.21.15.19:0/1154142874 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fadc8108020 0x7fadc819ab50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:38:31.996 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:38:31.993+0000 7fadcde97640 1 --2- 172.21.15.19:0/1154142874 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fadc81076a0 0x7fadc819a5f0 unknown :-1 s=CLOSED pgs=885 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:38:31.996 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:38:31.993+0000 7fadcde97640 1 --2- 172.21.15.19:0/1154142874 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fadc8101c90 0x7fadc819a0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:38:31.996 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:38:31.993+0000 7fadcde97640 1 -- 172.21.15.19:0/1154142874 >> 172.21.15.19:0/1154142874 conn(0x7fadc80fd6e0 msgr2=0x7fadc80ffad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:38:31.996 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:38:31.994+0000 7fadcde97640 1 -- 172.21.15.19:0/1154142874 shutdown_connections 2024-09-10T22:38:31.996 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:38:31.994+0000 7fadcde97640 1 -- 172.21.15.19:0/1154142874 wait complete. 2024-09-10T22:38:32.110 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:38:31 smithi135 ceph-mon[34789]: pgmap v710: 97 pgs: 97 active+clean; 10 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 199 MiB/s wr, 1.05k op/s 2024-09-10T22:38:32.110 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:38:31 smithi135 ceph-mon[34789]: Health check update: 12 OSD(s) experiencing slow operations in BlueStore (BLUESTORE_SLOW_OP_ALERT) 2024-09-10T22:38:32.125 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:38:31 smithi138 ceph-mon[35236]: pgmap v710: 97 pgs: 97 active+clean; 10 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 199 MiB/s wr, 1.05k op/s 2024-09-10T22:38:32.125 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:38:31 smithi138 ceph-mon[35236]: Health check update: 12 OSD(s) experiencing slow operations in BlueStore (BLUESTORE_SLOW_OP_ALERT) 2024-09-10T22:38:32.725 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 22997a4c-6fc2-11ef-bcea-c7b262605968 -- ceph osd dump --format=json 2024-09-10T22:38:32.958 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:38:32 smithi019 ceph-mon[31375]: from='client.? 172.21.15.19:0/1154142874' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T22:38:32.995 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/22997a4c-6fc2-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T22:38:33.110 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:38:32 smithi135 ceph-mon[34789]: from='client.? 172.21.15.19:0/1154142874' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T22:38:33.125 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:38:32 smithi138 ceph-mon[35236]: from='client.? 172.21.15.19:0/1154142874' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T22:38:33.516 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:38:33.489+0000 7ff472b7c640 1 -- 172.21.15.19:0/178989287 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff46c104570 msgr2=0x7ff46c10cb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:38:33.516 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:38:33.489+0000 7ff472b7c640 1 --2- 172.21.15.19:0/178989287 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff46c104570 0x7ff46c10cb50 secure :-1 s=READY pgs=886 cs=0 l=1 rev1=1 crypto rx=0x7ff458009900 tx=0x7ff45802a410 comp rx=0 tx=0).stop 2024-09-10T22:38:33.517 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:38:33.489+0000 7ff472b7c640 1 -- 172.21.15.19:0/178989287 shutdown_connections 2024-09-10T22:38:33.517 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:38:33.489+0000 7ff472b7c640 1 --2- 172.21.15.19:0/178989287 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff46c10d120 0x7ff46c10f590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:38:33.517 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:38:33.489+0000 7ff472b7c640 1 --2- 172.21.15.19:0/178989287 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff46c104570 0x7ff46c10cb50 unknown :-1 s=CLOSED pgs=886 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:38:33.517 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:38:33.489+0000 7ff472b7c640 1 --2- 172.21.15.19:0/178989287 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff46c103b70 0x7ff46c103f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:38:33.517 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:38:33.489+0000 7ff472b7c640 1 -- 172.21.15.19:0/178989287 >> 172.21.15.19:0/178989287 conn(0x7ff46c0fd700 msgr2=0x7ff46c0ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:38:33.517 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:38:33.489+0000 7ff472b7c640 1 -- 172.21.15.19:0/178989287 shutdown_connections 2024-09-10T22:38:33.517 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:38:33.489+0000 7ff472b7c640 1 -- 172.21.15.19:0/178989287 wait complete. 2024-09-10T22:38:33.517 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:38:33.490+0000 7ff472b7c640 1 Processor -- start 2024-09-10T22:38:33.517 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:38:33.490+0000 7ff472b7c640 1 -- start start 2024-09-10T22:38:33.517 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:38:33.490+0000 7ff472b7c640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff46c103b70 0x7ff46c19b490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:38:33.517 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:38:33.490+0000 7ff472b7c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff46c104570 0x7ff46c19b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:38:33.517 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:38:33.490+0000 7ff472b7c640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff46c10d120 0x7ff46c1a0d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:38:33.518 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:38:33.490+0000 7ff472b7c640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7ff46c102bd0 con 0x7ff46c104570 2024-09-10T22:38:33.518 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:38:33.490+0000 7ff472b7c640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7ff46c102a50 con 0x7ff46c103b70 2024-09-10T22:38:33.518 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:38:33.490+0000 7ff472b7c640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7ff46c102d50 con 0x7ff46c10d120 2024-09-10T22:38:33.518 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:38:33.490+0000 7ff46bfff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff46c104570 0x7ff46c19b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:38:33.518 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:38:33.490+0000 7ff46bfff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff46c104570 0x7ff46c19b9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:48116/0 (socket says 172.21.15.19:48116) 2024-09-10T22:38:33.518 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:38:33.490+0000 7ff46bfff640 1 -- 172.21.15.19:0/204156257 learned_addr learned my addr 172.21.15.19:0/204156257 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:38:33.518 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:38:33.490+0000 7ff470918640 1 --2- 172.21.15.19:0/204156257 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff46c103b70 0x7ff46c19b490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:38:33.518 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:38:33.490+0000 7ff471119640 1 --2- 172.21.15.19:0/204156257 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff46c10d120 0x7ff46c1a0d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:38:33.518 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:38:33.490+0000 7ff46bfff640 1 -- 172.21.15.19:0/204156257 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff46c10d120 msgr2=0x7ff46c1a0d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:38:33.518 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:38:33.490+0000 7ff46bfff640 1 --2- 172.21.15.19:0/204156257 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff46c10d120 0x7ff46c1a0d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:38:33.518 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:38:33.490+0000 7ff46bfff640 1 -- 172.21.15.19:0/204156257 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff46c103b70 msgr2=0x7ff46c19b490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:38:33.518 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:38:33.490+0000 7ff46bfff640 1 --2- 172.21.15.19:0/204156257 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff46c103b70 0x7ff46c19b490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:38:33.518 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:38:33.491+0000 7ff46bfff640 1 -- 172.21.15.19:0/204156257 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff46c1a1540 con 0x7ff46c104570 2024-09-10T22:38:33.518 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:38:33.491+0000 7ff46bfff640 1 --2- 172.21.15.19:0/204156257 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff46c104570 0x7ff46c19b9d0 secure :-1 s=READY pgs=887 cs=0 l=1 rev1=1 crypto rx=0x7ff458005940 tx=0x7ff458004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:38:33.519 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:38:33.491+0000 7ff469ffb640 1 -- 172.21.15.19:0/204156257 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff45803f030 con 0x7ff46c104570 2024-09-10T22:38:33.519 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:38:33.491+0000 7ff469ffb640 1 -- 172.21.15.19:0/204156257 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff458003aa0 con 0x7ff46c104570 2024-09-10T22:38:33.519 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:38:33.491+0000 7ff472b7c640 1 -- 172.21.15.19:0/204156257 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff46c1a17d0 con 0x7ff46c104570 2024-09-10T22:38:33.519 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:38:33.491+0000 7ff469ffb640 1 -- 172.21.15.19:0/204156257 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff458035070 con 0x7ff46c104570 2024-09-10T22:38:33.519 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:38:33.491+0000 7ff472b7c640 1 -- 172.21.15.19:0/204156257 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff46c1a7ef0 con 0x7ff46c104570 2024-09-10T22:38:33.519 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:38:33.492+0000 7ff472b7c640 1 -- 172.21.15.19:0/204156257 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff46c103f50 con 0x7ff46c104570 2024-09-10T22:38:33.519 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:38:33.494+0000 7ff469ffb640 1 -- 172.21.15.19:0/204156257 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 18) ==== 153250+0+0 (secure 0 0 0) 0x7ff45803bcc0 con 0x7ff46c104570 2024-09-10T22:38:33.519 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:38:33.495+0000 7ff469ffb640 1 --2- 172.21.15.19:0/204156257 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7ff45c0b5360 0x7ff45c0b7820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:38:33.519 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:38:33.495+0000 7ff470918640 1 --2- 172.21.15.19:0/204156257 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7ff45c0b5360 0x7ff45c0b7820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:38:33.519 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:38:33.495+0000 7ff469ffb640 1 -- 172.21.15.19:0/204156257 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8327+0+0 (secure 0 0 0) 0x7ff4581067e0 con 0x7ff46c104570 2024-09-10T22:38:33.519 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:38:33.496+0000 7ff470918640 1 --2- 172.21.15.19:0/204156257 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7ff45c0b5360 0x7ff45c0b7820 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7ff460009bd0 tx=0x7ff460005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:38:33.519 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:38:33.499+0000 7ff469ffb640 1 -- 172.21.15.19:0/204156257 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7ff4580ccff0 con 0x7ff46c104570 2024-09-10T22:38:33.694 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:38:33.693+0000 7ff472b7c640 1 -- 172.21.15.19:0/204156257 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7ff46c02e5c0 con 0x7ff46c104570 2024-09-10T22:38:33.695 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:38:33.694+0000 7ff469ffb640 1 -- 172.21.15.19:0/204156257 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v77) ==== 74+0+22854 (secure 0 0 0) 0x7ff4580d1a20 con 0x7ff46c104570 2024-09-10T22:38:33.696 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-10T22:38:33.696 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":77,"fsid":"22997a4c-6fc2-11ef-bcea-c7b262605968","created":"2024-09-10T22:16:16.754696+0000","modified":"2024-09-10T22:26:05.946930+0000","last_up_change":"2024-09-10T22:23:32.417392+0000","last_in_change":"2024-09-10T22:23:09.614371+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T22:19:50.731662+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-10T22:24:18.740121+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"73","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-10T22:24:20.795178+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"73","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"783d96cb-0a8a-47f3-8eab-77cd731a64bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6802","nonce":234761879},{"type":"v1","addr":"172.21.15.19:6803","nonce":234761879}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6804","nonce":234761879},{"type":"v1","addr":"172.21.15.19:6805","nonce":234761879}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6808","nonce":234761879},{"type":"v1","addr":"172.21.15.19:6809","nonce":234761879}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6806","nonce":234761879},{"type":"v1","addr":"172.21.15.19:6807","nonce":234761879}]},"public_addr":"172.21.15.19:6803/234761879","cluster_addr":"172.21.15.19:6805/234761879","heartbeat_back_addr":"172.21.15.19:6809/234761879","heartbeat_front_addr":"172.21.15.19:6807/234761879","state":["exists","up"]},{"osd":1,"uuid":"41043581-e0cf-43b5-bae0-0d95e2ef8156","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6800","nonce":1803526886},{"type":"v1","addr":"172.21.15.135:6801","nonce":1803526886}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6802","nonce":1803526886},{"type":"v1","addr":"172.21.15.135:6803","nonce":1803526886}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6806","nonce":1803526886},{"type":"v1","addr":"172.21.15.135:6807","nonce":1803526886}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6804","nonce":1803526886},{"type":"v1","addr":"172.21.15.135:6805","nonce":1803526886}]},"public_addr":"172.21.15.135:6801/1803526886","cluster_addr":"172.21.15.135:6803/1803526886","heartbeat_back_addr":"172.21.15.135:6807/1803526886","heartbeat_front_addr":"172.21.15.135:6805/1803526886","state":["exists","up"]},{"osd":2,"uuid":"a9b14a06-bbdc-4501-96e2-fb5f7127ca16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6800","nonce":2747418770},{"type":"v1","addr":"172.21.15.138:6801","nonce":2747418770}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6802","nonce":2747418770},{"type":"v1","addr":"172.21.15.138:6803","nonce":2747418770}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6806","nonce":2747418770},{"type":"v1","addr":"172.21.15.138:6807","nonce":2747418770}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6804","nonce":2747418770},{"type":"v1","addr":"172.21.15.138:6805","nonce":2747418770}]},"public_addr":"172.21.15.138:6801/2747418770","cluster_addr":"172.21.15.138:6803/2747418770","heartbeat_back_addr":"172.21.15.138:6807/2747418770","heartbeat_front_addr":"172.21.15.138:6805/2747418770","state":["exists","up"]},{"osd":3,"uuid":"a46268da-8666-4cfa-b11a-30eb12e271be","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":23,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6810","nonce":1889857224},{"type":"v1","addr":"172.21.15.19:6811","nonce":1889857224}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6812","nonce":1889857224},{"type":"v1","addr":"172.21.15.19:6813","nonce":1889857224}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6816","nonce":1889857224},{"type":"v1","addr":"172.21.15.19:6817","nonce":1889857224}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6814","nonce":1889857224},{"type":"v1","addr":"172.21.15.19:6815","nonce":1889857224}]},"public_addr":"172.21.15.19:6811/1889857224","cluster_addr":"172.21.15.19:6813/1889857224","heartbeat_back_addr":"172.21.15.19:6817/1889857224","heartbeat_front_addr":"172.21.15.19:6815/1889857224","state":["exists","up"]},{"osd":4,"uuid":"c58df06f-2de2-4655-88e7-ac6a3531839a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":29,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6808","nonce":436311825},{"type":"v1","addr":"172.21.15.135:6809","nonce":436311825}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6810","nonce":436311825},{"type":"v1","addr":"172.21.15.135:6811","nonce":436311825}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6814","nonce":436311825},{"type":"v1","addr":"172.21.15.135:6815","nonce":436311825}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6812","nonce":436311825},{"type":"v1","addr":"172.21.15.135:6813","nonce":436311825}]},"public_addr":"172.21.15.135:6809/436311825","cluster_addr":"172.21.15.135:6811/436311825","heartbeat_back_addr":"172.21.15.135:6815/436311825","heartbeat_front_addr":"172.21.15.135:6813/436311825","state":["exists","up"]},{"osd":5,"uuid":"c0900b0c-aef4-498d-a01b-a891bdb51122","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6808","nonce":1086764290},{"type":"v1","addr":"172.21.15.138:6809","nonce":1086764290}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6810","nonce":1086764290},{"type":"v1","addr":"172.21.15.138:6811","nonce":1086764290}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6814","nonce":1086764290},{"type":"v1","addr":"172.21.15.138:6815","nonce":1086764290}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6812","nonce":1086764290},{"type":"v1","addr":"172.21.15.138:6813","nonce":1086764290}]},"public_addr":"172.21.15.138:6809/1086764290","cluster_addr":"172.21.15.138:6811/1086764290","heartbeat_back_addr":"172.21.15.138:6815/1086764290","heartbeat_front_addr":"172.21.15.138:6813/1086764290","state":["exists","up"]},{"osd":6,"uuid":"f79cb310-8073-4ee5-80a6-87a290600321","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":40,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6818","nonce":406328354},{"type":"v1","addr":"172.21.15.19:6819","nonce":406328354}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6820","nonce":406328354},{"type":"v1","addr":"172.21.15.19:6821","nonce":406328354}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6824","nonce":406328354},{"type":"v1","addr":"172.21.15.19:6825","nonce":406328354}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6822","nonce":406328354},{"type":"v1","addr":"172.21.15.19:6823","nonce":406328354}]},"public_addr":"172.21.15.19:6819/406328354","cluster_addr":"172.21.15.19:6821/406328354","heartbeat_back_addr":"172.21.15.19:6825/406328354","heartbeat_front_addr":"172.21.15.19:6823/406328354","state":["exists","up"]},{"osd":7,"uuid":"cc76476a-92f3-489c-be9e-29cbbf39539e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6816","nonce":1096613674},{"type":"v1","addr":"172.21.15.135:6817","nonce":1096613674}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6818","nonce":1096613674},{"type":"v1","addr":"172.21.15.135:6819","nonce":1096613674}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6822","nonce":1096613674},{"type":"v1","addr":"172.21.15.135:6823","nonce":1096613674}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6820","nonce":1096613674},{"type":"v1","addr":"172.21.15.135:6821","nonce":1096613674}]},"public_addr":"172.21.15.135:6817/1096613674","cluster_addr":"172.21.15.135:6819/1096613674","heartbeat_back_addr":"172.21.15.135:6823/1096613674","heartbeat_front_addr":"172.21.15.135:6821/1096613674","state":["exists","up"]},{"osd":8,"uuid":"5323a006-a6e8-4403-9c51-65f46298d5c4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6816","nonce":3020394729},{"type":"v1","addr":"172.21.15.138:6817","nonce":3020394729}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6818","nonce":3020394729},{"type":"v1","addr":"172.21.15.138:6819","nonce":3020394729}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6822","nonce":3020394729},{"type":"v1","addr":"172.21.15.138:6823","nonce":3020394729}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6820","nonce":3020394729},{"type":"v1","addr":"172.21.15.138:6821","nonce":3020394729}]},"public_addr":"172.21.15.138:6817/3020394729","cluster_addr":"172.21.15.138:6819/3020394729","heartbeat_back_addr":"172.21.15.138:6823/3020394729","heartbeat_front_addr":"172.21.15.138:6821/3020394729","state":["exists","up"]},{"osd":9,"uuid":"b869ac42-c46e-442c-8b5b-f81c018e663c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":57,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6826","nonce":1488680899},{"type":"v1","addr":"172.21.15.19:6827","nonce":1488680899}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6828","nonce":1488680899},{"type":"v1","addr":"172.21.15.19:6829","nonce":1488680899}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6832","nonce":1488680899},{"type":"v1","addr":"172.21.15.19:6833","nonce":1488680899}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6830","nonce":1488680899},{"type":"v1","addr":"172.21.15.19:6831","nonce":1488680899}]},"public_addr":"172.21.15.19:6827/1488680899","cluster_addr":"172.21.15.19:6829/1488680899","heartbeat_back_addr":"172.21.15.19:6833/1488680899","heartbeat_front_addr":"172.21.15.19:6831/1488680899","state":["exists","up"]},{"osd":10,"uuid":"b8a2d69a-6821-4c69-b7eb-c0cfc8164614","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":62,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6824","nonce":3812626754},{"type":"v1","addr":"172.21.15.135:6825","nonce":3812626754}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6826","nonce":3812626754},{"type":"v1","addr":"172.21.15.135:6827","nonce":3812626754}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6830","nonce":3812626754},{"type":"v1","addr":"172.21.15.135:6831","nonce":3812626754}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6828","nonce":3812626754},{"type":"v1","addr":"172.21.15.135:6829","nonce":3812626754}]},"public_addr":"172.21.15.135:6825/3812626754","cluster_addr":"172.21.15.135:6827/3812626754","heartbeat_back_addr":"172.21.15.135:6831/3812626754","heartbeat_front_addr":"172.21.15.135:6829/3812626754","state":["exists","up"]},{"osd":11,"uuid":"a9264ab2-5843-44d2-aba8-1e12708e99d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6824","nonce":1098434807},{"type":"v1","addr":"172.21.15.138:6825","nonce":1098434807}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6826","nonce":1098434807},{"type":"v1","addr":"172.21.15.138:6827","nonce":1098434807}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6830","nonce":1098434807},{"type":"v1","addr":"172.21.15.138:6831","nonce":1098434807}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6828","nonce":1098434807},{"type":"v1","addr":"172.21.15.138:6829","nonce":1098434807}]},"public_addr":"172.21.15.138:6825/1098434807","cluster_addr":"172.21.15.138:6827/1098434807","heartbeat_back_addr":"172.21.15.138:6831/1098434807","heartbeat_front_addr":"172.21.15.138:6829/1098434807","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:18:58.008025+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:19:22.475890+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:19:47.124147+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:20:12.438853+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:20:37.195177+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:21:02.474248+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:21:27.087207+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:21:52.119211+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:22:16.569989+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:22:41.680986+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:23:06.391885+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:23:30.695460+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.0","mappings":[{"from":8,"to":4}]},{"pgid":"2.c","mappings":[{"from":2,"to":4}]},{"pgid":"2.d","mappings":[{"from":5,"to":11}]},{"pgid":"2.16","mappings":[{"from":2,"to":6}]},{"pgid":"2.17","mappings":[{"from":5,"to":1}]},{"pgid":"2.1a","mappings":[{"from":8,"to":1}]},{"pgid":"2.1d","mappings":[{"from":2,"to":4}]},{"pgid":"2.1f","mappings":[{"from":7,"to":11}]},{"pgid":"3.13","mappings":[{"from":4,"to":9}]},{"pgid":"3.1b","mappings":[{"from":4,"to":8}]},{"pgid":"3.21","mappings":[{"from":5,"to":9}]},{"pgid":"3.38","mappings":[{"from":3,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.19:0/2099468127":"2024-09-11T22:17:04.260826+0000","172.21.15.19:0/538724915":"2024-09-11T22:17:04.260826+0000","172.21.15.19:0/3504695777":"2024-09-11T22:17:04.260826+0000","172.21.15.19:0/1401613792":"2024-09-11T22:16:39.069638+0000","172.21.15.19:6801/3005924425":"2024-09-11T22:17:04.260826+0000","172.21.15.19:6800/3005924425":"2024-09-11T22:17:04.260826+0000","172.21.15.19:0/104917892":"2024-09-11T22:16:39.069638+0000","172.21.15.19:0/1778305990":"2024-09-11T22:16:39.069638+0000","172.21.15.19:6801/535670059":"2024-09-11T22:16:39.069638+0000","172.21.15.19:6800/535670059":"2024-09-11T22:16:39.069638+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T22:38:33.699 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:38:33.697+0000 7ff472b7c640 1 -- 172.21.15.19:0/204156257 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7ff45c0b5360 msgr2=0x7ff45c0b7820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:38:33.699 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:38:33.697+0000 7ff472b7c640 1 --2- 172.21.15.19:0/204156257 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7ff45c0b5360 0x7ff45c0b7820 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7ff460009bd0 tx=0x7ff460005f90 comp rx=0 tx=0).stop 2024-09-10T22:38:33.699 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:38:33.697+0000 7ff472b7c640 1 -- 172.21.15.19:0/204156257 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff46c104570 msgr2=0x7ff46c19b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:38:33.699 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:38:33.697+0000 7ff472b7c640 1 --2- 172.21.15.19:0/204156257 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff46c104570 0x7ff46c19b9d0 secure :-1 s=READY pgs=887 cs=0 l=1 rev1=1 crypto rx=0x7ff458005940 tx=0x7ff458004270 comp rx=0 tx=0).stop 2024-09-10T22:38:33.699 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:38:33.697+0000 7ff472b7c640 1 -- 172.21.15.19:0/204156257 shutdown_connections 2024-09-10T22:38:33.699 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:38:33.697+0000 7ff472b7c640 1 --2- 172.21.15.19:0/204156257 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7ff45c0b5360 0x7ff45c0b7820 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:38:33.699 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:38:33.697+0000 7ff472b7c640 1 --2- 172.21.15.19:0/204156257 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff46c10d120 0x7ff46c1a0d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:38:33.699 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:38:33.697+0000 7ff472b7c640 1 --2- 172.21.15.19:0/204156257 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff46c104570 0x7ff46c19b9d0 unknown :-1 s=CLOSED pgs=887 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:38:33.699 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:38:33.697+0000 7ff472b7c640 1 --2- 172.21.15.19:0/204156257 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff46c103b70 0x7ff46c19b490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:38:33.700 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:38:33.697+0000 7ff472b7c640 1 -- 172.21.15.19:0/204156257 >> 172.21.15.19:0/204156257 conn(0x7ff46c0fd700 msgr2=0x7ff46c104a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:38:33.700 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:38:33.697+0000 7ff472b7c640 1 -- 172.21.15.19:0/204156257 shutdown_connections 2024-09-10T22:38:33.700 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:38:33.698+0000 7ff472b7c640 1 -- 172.21.15.19:0/204156257 wait complete. 2024-09-10T22:38:33.958 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:38:33 smithi019 ceph-mon[31375]: pgmap v711: 97 pgs: 97 active+clean; 9.8 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 153 MiB/s wr, 833 op/s 2024-09-10T22:38:33.958 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:38:33 smithi019 ceph-mon[31375]: from='client.? 172.21.15.19:0/204156257' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-10T22:38:34.110 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:38:33 smithi135 ceph-mon[34789]: pgmap v711: 97 pgs: 97 active+clean; 9.8 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 153 MiB/s wr, 833 op/s 2024-09-10T22:38:34.110 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:38:33 smithi135 ceph-mon[34789]: from='client.? 172.21.15.19:0/204156257' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-10T22:38:34.125 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:38:33 smithi138 ceph-mon[35236]: pgmap v711: 97 pgs: 97 active+clean; 9.8 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 153 MiB/s wr, 833 op/s 2024-09-10T22:38:34.125 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:38:33 smithi138 ceph-mon[35236]: from='client.? 172.21.15.19:0/204156257' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-10T22:38:34.367 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 22997a4c-6fc2-11ef-bcea-c7b262605968 -- ceph fs fail cephfs 2024-09-10T22:38:34.641 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/22997a4c-6fc2-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T22:38:35.193 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:38:35.177+0000 7f11d893f640 1 -- 172.21.15.19:0/3326630171 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f11d41076a0 msgr2=0x7f11d4107ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:38:35.194 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:38:35.177+0000 7f11d893f640 1 --2- 172.21.15.19:0/3326630171 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f11d41076a0 0x7f11d4107ae0 secure :-1 s=READY pgs=888 cs=0 l=1 rev1=1 crypto rx=0x7f11c8009900 tx=0x7f11c802a410 comp rx=0 tx=0).stop 2024-09-10T22:38:35.194 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:38:35.177+0000 7f11d893f640 1 -- 172.21.15.19:0/3326630171 shutdown_connections 2024-09-10T22:38:35.194 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:38:35.177+0000 7f11d893f640 1 --2- 172.21.15.19:0/3326630171 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f11d4108020 0x7f11d410e820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:38:35.194 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:38:35.177+0000 7f11d893f640 1 --2- 172.21.15.19:0/3326630171 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f11d41076a0 0x7f11d4107ae0 unknown :-1 s=CLOSED pgs=888 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:38:35.194 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:38:35.177+0000 7f11d893f640 1 --2- 172.21.15.19:0/3326630171 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f11d4101c90 0x7f11d4102070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:38:35.194 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:38:35.177+0000 7f11d893f640 1 -- 172.21.15.19:0/3326630171 >> 172.21.15.19:0/3326630171 conn(0x7f11d40fd700 msgr2=0x7f11d40ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:38:35.194 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:38:35.177+0000 7f11d893f640 1 -- 172.21.15.19:0/3326630171 shutdown_connections 2024-09-10T22:38:35.194 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:38:35.177+0000 7f11d893f640 1 -- 172.21.15.19:0/3326630171 wait complete. 2024-09-10T22:38:35.194 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:38:35.178+0000 7f11d893f640 1 Processor -- start 2024-09-10T22:38:35.194 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:38:35.178+0000 7f11d893f640 1 -- start start 2024-09-10T22:38:35.194 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:38:35.178+0000 7f11d893f640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f11d4101c90 0x7f11d4199270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:38:35.194 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:38:35.178+0000 7f11d893f640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f11d41076a0 0x7f11d41997b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:38:35.195 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:38:35.178+0000 7f11d893f640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f11d4108020 0x7f11d419eb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:38:35.195 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:38:35.178+0000 7f11d893f640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f11d4111ce0 con 0x7f11d41076a0 2024-09-10T22:38:35.195 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:38:35.178+0000 7f11d893f640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f11d4111b60 con 0x7f11d4101c90 2024-09-10T22:38:35.195 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:38:35.178+0000 7f11d893f640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f11d4111e60 con 0x7f11d4108020 2024-09-10T22:38:35.195 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:38:35.178+0000 7f11d1d9b640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f11d41076a0 0x7f11d41997b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:38:35.195 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:38:35.178+0000 7f11d1d9b640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f11d41076a0 0x7f11d41997b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:48130/0 (socket says 172.21.15.19:48130) 2024-09-10T22:38:35.195 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:38:35.178+0000 7f11d1d9b640 1 -- 172.21.15.19:0/2934045559 learned_addr learned my addr 172.21.15.19:0/2934045559 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:38:35.195 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:38:35.178+0000 7f11d259c640 1 --2- 172.21.15.19:0/2934045559 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f11d4101c90 0x7f11d4199270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:38:35.195 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:38:35.178+0000 7f11d2d9d640 1 --2- 172.21.15.19:0/2934045559 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f11d4108020 0x7f11d419eb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:38:35.195 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:38:35.179+0000 7f11d1d9b640 1 -- 172.21.15.19:0/2934045559 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f11d4108020 msgr2=0x7f11d419eb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:38:35.195 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:38:35.179+0000 7f11d1d9b640 1 --2- 172.21.15.19:0/2934045559 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f11d4108020 0x7f11d419eb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:38:35.195 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:38:35.179+0000 7f11d1d9b640 1 -- 172.21.15.19:0/2934045559 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f11d4101c90 msgr2=0x7f11d4199270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:38:35.195 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:38:35.179+0000 7f11d1d9b640 1 --2- 172.21.15.19:0/2934045559 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f11d4101c90 0x7f11d4199270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:38:35.196 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:38:35.179+0000 7f11d1d9b640 1 -- 172.21.15.19:0/2934045559 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f11d419f320 con 0x7f11d41076a0 2024-09-10T22:38:35.196 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:38:35.179+0000 7f11d259c640 1 --2- 172.21.15.19:0/2934045559 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f11d4101c90 0x7f11d4199270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T22:38:35.196 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:38:35.179+0000 7f11d1d9b640 1 --2- 172.21.15.19:0/2934045559 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f11d41076a0 0x7f11d41997b0 secure :-1 s=READY pgs=889 cs=0 l=1 rev1=1 crypto rx=0x7f11c8005940 tx=0x7f11c80040c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:38:35.196 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:38:35.179+0000 7f11c37fe640 1 -- 172.21.15.19:0/2934045559 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11c803f030 con 0x7f11d41076a0 2024-09-10T22:38:35.196 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:38:35.179+0000 7f11d893f640 1 -- 172.21.15.19:0/2934045559 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f11d419f5b0 con 0x7f11d41076a0 2024-09-10T22:38:35.196 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:38:35.179+0000 7f11c37fe640 1 -- 172.21.15.19:0/2934045559 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f11c80044c0 con 0x7f11d41076a0 2024-09-10T22:38:35.196 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:38:35.179+0000 7f11c37fe640 1 -- 172.21.15.19:0/2934045559 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11c8035070 con 0x7f11d41076a0 2024-09-10T22:38:35.196 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:38:35.179+0000 7f11d893f640 1 -- 172.21.15.19:0/2934045559 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f11d41a5cd0 con 0x7f11d41076a0 2024-09-10T22:38:35.196 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:38:35.181+0000 7f11d893f640 1 -- 172.21.15.19:0/2934045559 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f11d4102070 con 0x7f11d41076a0 2024-09-10T22:38:35.196 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:38:35.182+0000 7f11c37fe640 1 -- 172.21.15.19:0/2934045559 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 18) ==== 153250+0+0 (secure 0 0 0) 0x7f11c803ba20 con 0x7f11d41076a0 2024-09-10T22:38:35.196 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:38:35.183+0000 7f11c37fe640 1 --2- 172.21.15.19:0/2934045559 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f11bc0b52e0 0x7f11bc0b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:38:35.196 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:38:35.183+0000 7f11c37fe640 1 -- 172.21.15.19:0/2934045559 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8327+0+0 (secure 0 0 0) 0x7f11c8105ec0 con 0x7f11d41076a0 2024-09-10T22:38:35.197 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:38:35.183+0000 7f11d259c640 1 --2- 172.21.15.19:0/2934045559 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f11bc0b52e0 0x7f11bc0b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:38:35.197 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:38:35.184+0000 7f11d259c640 1 --2- 172.21.15.19:0/2934045559 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f11bc0b52e0 0x7f11bc0b77a0 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f11c4009fc0 tx=0x7f11c4005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:38:35.197 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:38:35.188+0000 7f11c37fe640 1 -- 172.21.15.19:0/2934045559 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f11c80cc6d0 con 0x7f11d41076a0 2024-09-10T22:38:35.424 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:38:35.422+0000 7f11d893f640 1 -- 172.21.15.19:0/2934045559 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f11d410ae10 con 0x7f11d41076a0 2024-09-10T22:38:35.427 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:38:35.426+0000 7f11c37fe640 1 -- 172.21.15.19:0/2934045559 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v29) ==== 161+0+0 (secure 0 0 0) 0x7f11c80d1100 con 0x7f11d41076a0 2024-09-10T22:38:35.427 INFO:teuthology.orchestra.run.smithi019.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-10T22:38:35.430 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:38:35.428+0000 7f11d893f640 1 -- 172.21.15.19:0/2934045559 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f11bc0b52e0 msgr2=0x7f11bc0b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:38:35.430 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:38:35.428+0000 7f11d893f640 1 --2- 172.21.15.19:0/2934045559 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f11bc0b52e0 0x7f11bc0b77a0 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f11c4009fc0 tx=0x7f11c4005f90 comp rx=0 tx=0).stop 2024-09-10T22:38:35.431 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:38:35.428+0000 7f11d893f640 1 -- 172.21.15.19:0/2934045559 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f11d41076a0 msgr2=0x7f11d41997b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:38:35.431 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:38:35.428+0000 7f11d893f640 1 --2- 172.21.15.19:0/2934045559 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f11d41076a0 0x7f11d41997b0 secure :-1 s=READY pgs=889 cs=0 l=1 rev1=1 crypto rx=0x7f11c8005940 tx=0x7f11c80040c0 comp rx=0 tx=0).stop 2024-09-10T22:38:35.431 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:38:35.428+0000 7f11d893f640 1 -- 172.21.15.19:0/2934045559 shutdown_connections 2024-09-10T22:38:35.431 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:38:35.428+0000 7f11d893f640 1 --2- 172.21.15.19:0/2934045559 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f11bc0b52e0 0x7f11bc0b77a0 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:38:35.431 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:38:35.428+0000 7f11d893f640 1 --2- 172.21.15.19:0/2934045559 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f11d4108020 0x7f11d419eb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:38:35.431 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:38:35.428+0000 7f11d893f640 1 --2- 172.21.15.19:0/2934045559 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f11d41076a0 0x7f11d41997b0 unknown :-1 s=CLOSED pgs=889 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:38:35.431 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:38:35.428+0000 7f11d893f640 1 --2- 172.21.15.19:0/2934045559 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f11d4101c90 0x7f11d4199270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:38:35.431 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:38:35.429+0000 7f11d893f640 1 -- 172.21.15.19:0/2934045559 >> 172.21.15.19:0/2934045559 conn(0x7f11d40fd700 msgr2=0x7f11d406acf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:38:35.431 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:38:35.429+0000 7f11d893f640 1 -- 172.21.15.19:0/2934045559 shutdown_connections 2024-09-10T22:38:35.431 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:38:35.429+0000 7f11d893f640 1 -- 172.21.15.19:0/2934045559 wait complete. 2024-09-10T22:38:35.610 INFO:journalctl@ceph.mds.b.smithi135.stdout:Sep 10 22:38:35 smithi135 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-mds-b[65179]: ignoring --setuser ceph since I am not root 2024-09-10T22:38:35.610 INFO:journalctl@ceph.mds.b.smithi135.stdout:Sep 10 22:38:35 smithi135 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-mds-b[65179]: ignoring --setgroup ceph since I am not root 2024-09-10T22:38:35.610 INFO:journalctl@ceph.mds.b.smithi135.stdout:Sep 10 22:38:35 smithi135 ceph-mds[65183]: -- 172.21.15.135:0/2643240142 <== mon.2 v2:172.21.15.135:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55b6ce1f9860 con 0x55b6ce1d6800 2024-09-10T22:38:35.610 INFO:journalctl@ceph.mds.b.smithi135.stdout:Sep 10 22:38:35 smithi135 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-mds-b[65179]: starting mds.b at 2024-09-10T22:38:35.611 INFO:journalctl@ceph.mds.e.smithi135.stdout:Sep 10 22:38:35 smithi135 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-mds-e[64580]: ignoring --setuser ceph since I am not root 2024-09-10T22:38:35.611 INFO:journalctl@ceph.mds.e.smithi135.stdout:Sep 10 22:38:35 smithi135 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-mds-e[64580]: ignoring --setgroup ceph since I am not root 2024-09-10T22:38:35.611 INFO:journalctl@ceph.mds.e.smithi135.stdout:Sep 10 22:38:35 smithi135 ceph-mds[64584]: -- 172.21.15.135:0/1743360993 <== mon.2 v2:172.21.15.135:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55ce47cd9860 con 0x55ce47cb6800 2024-09-10T22:38:35.611 INFO:journalctl@ceph.mds.e.smithi135.stdout:Sep 10 22:38:35 smithi135 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-mds-e[64580]: starting mds.e at 2024-09-10T22:38:35.611 INFO:journalctl@ceph.mds.h.smithi135.stdout:Sep 10 22:38:35 smithi135 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-mds-h[64881]: ignoring --setuser ceph since I am not root 2024-09-10T22:38:35.611 INFO:journalctl@ceph.mds.h.smithi135.stdout:Sep 10 22:38:35 smithi135 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-mds-h[64881]: ignoring --setgroup ceph since I am not root 2024-09-10T22:38:35.611 INFO:journalctl@ceph.mds.h.smithi135.stdout:Sep 10 22:38:35 smithi135 ceph-mds[64885]: -- 172.21.15.135:0/1776220281 <== mon.2 v2:172.21.15.135:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55638a6a7860 con 0x55638a685400 2024-09-10T22:38:35.611 INFO:journalctl@ceph.mds.h.smithi135.stdout:Sep 10 22:38:35 smithi135 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-mds-h[64881]: starting mds.h at 2024-09-10T22:38:35.708 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:38:35 smithi019 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-mon-a[31371]: 2024-09-10T22:38:35.423+0000 7f5b660b1640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-10T22:38:35.798 INFO:journalctl@ceph.mds.c.smithi138.stdout:Sep 10 22:38:35 smithi138 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-mds-c[66160]: ignoring --setuser ceph since I am not root 2024-09-10T22:38:35.798 INFO:journalctl@ceph.mds.c.smithi138.stdout:Sep 10 22:38:35 smithi138 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-mds-c[66160]: ignoring --setgroup ceph since I am not root 2024-09-10T22:38:35.798 INFO:journalctl@ceph.mds.c.smithi138.stdout:Sep 10 22:38:35 smithi138 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-mds-c[66160]: starting mds.c at 2024-09-10T22:38:35.799 INFO:journalctl@ceph.mds.f.smithi138.stdout:Sep 10 22:38:35 smithi138 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-mds-f[65862]: ignoring --setuser ceph since I am not root 2024-09-10T22:38:35.799 INFO:journalctl@ceph.mds.f.smithi138.stdout:Sep 10 22:38:35 smithi138 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-mds-f[65862]: ignoring --setgroup ceph since I am not root 2024-09-10T22:38:35.799 INFO:journalctl@ceph.mds.f.smithi138.stdout:Sep 10 22:38:35 smithi138 ceph-mds[65866]: -- 172.21.15.138:0/4202396098 <== mon.2 v2:172.21.15.135:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55a1637e7c20 con 0x55a1637c5400 2024-09-10T22:38:35.799 INFO:journalctl@ceph.mds.f.smithi138.stdout:Sep 10 22:38:35 smithi138 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-mds-f[65862]: starting mds.f at 2024-09-10T22:38:35.799 INFO:journalctl@ceph.mds.i.smithi138.stdout:Sep 10 22:38:35 smithi138 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-mds-i[66461]: ignoring --setuser ceph since I am not root 2024-09-10T22:38:35.799 INFO:journalctl@ceph.mds.i.smithi138.stdout:Sep 10 22:38:35 smithi138 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-mds-i[66461]: ignoring --setgroup ceph since I am not root 2024-09-10T22:38:35.799 INFO:journalctl@ceph.mds.i.smithi138.stdout:Sep 10 22:38:35 smithi138 ceph-mds[66465]: -- 172.21.15.138:0/3420178364 <== mon.1 v2:172.21.15.138:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5559b36e9860 con 0x5559b36c7000 2024-09-10T22:38:35.799 INFO:journalctl@ceph.mds.i.smithi138.stdout:Sep 10 22:38:35 smithi138 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-mds-i[66461]: starting mds.i at 2024-09-10T22:38:36.046 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 22997a4c-6fc2-11ef-bcea-c7b262605968 -- ceph fs rm cephfs --yes-i-really-mean-it 2024-09-10T22:38:36.070 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:38:35 smithi019 ceph-mon[31375]: pgmap v712: 97 pgs: 97 active+clean; 9.5 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 109 MiB/s wr, 622 op/s 2024-09-10T22:38:36.070 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:38:35 smithi019 ceph-mon[31375]: from='client.? 172.21.15.19:0/2934045559' entity='client.admin' cmd={"prefix": "fs fail", "fs_name": "cephfs"} : dispatch 2024-09-10T22:38:36.070 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:38:35 smithi019 ceph-mon[31375]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-09-10T22:38:36.070 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:38:35 smithi019 ceph-mon[31375]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-10T22:38:36.070 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:38:35 smithi019 ceph-mon[31375]: from='client.? 172.21.15.19:0/2934045559' entity='client.admin' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2024-09-10T22:38:36.070 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:38:35 smithi019 ceph-mon[31375]: osdmap e78: 12 total, 12 up, 12 in 2024-09-10T22:38:36.070 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:38:35 smithi019 ceph-mon[31375]: fsmap cephfs:0/3 6 up:standby, 3 failed 2024-09-10T22:38:36.110 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:38:35 smithi135 ceph-mon[34789]: pgmap v712: 97 pgs: 97 active+clean; 9.5 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 109 MiB/s wr, 622 op/s 2024-09-10T22:38:36.110 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:38:35 smithi135 ceph-mon[34789]: from='client.? 172.21.15.19:0/2934045559' entity='client.admin' cmd={"prefix": "fs fail", "fs_name": "cephfs"} : dispatch 2024-09-10T22:38:36.110 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:38:35 smithi135 ceph-mon[34789]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-09-10T22:38:36.110 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:38:35 smithi135 ceph-mon[34789]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-10T22:38:36.110 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:38:35 smithi135 ceph-mon[34789]: from='client.? 172.21.15.19:0/2934045559' entity='client.admin' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2024-09-10T22:38:36.110 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:38:35 smithi135 ceph-mon[34789]: osdmap e78: 12 total, 12 up, 12 in 2024-09-10T22:38:36.110 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:38:35 smithi135 ceph-mon[34789]: fsmap cephfs:0/3 6 up:standby, 3 failed 2024-09-10T22:38:36.125 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:38:35 smithi138 ceph-mon[35236]: pgmap v712: 97 pgs: 97 active+clean; 9.5 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 109 MiB/s wr, 622 op/s 2024-09-10T22:38:36.125 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:38:35 smithi138 ceph-mon[35236]: from='client.? 172.21.15.19:0/2934045559' entity='client.admin' cmd={"prefix": "fs fail", "fs_name": "cephfs"} : dispatch 2024-09-10T22:38:36.125 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:38:35 smithi138 ceph-mon[35236]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-09-10T22:38:36.125 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:38:35 smithi138 ceph-mon[35236]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-10T22:38:36.125 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:38:35 smithi138 ceph-mon[35236]: from='client.? 172.21.15.19:0/2934045559' entity='client.admin' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2024-09-10T22:38:36.125 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:38:35 smithi138 ceph-mon[35236]: osdmap e78: 12 total, 12 up, 12 in 2024-09-10T22:38:36.125 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:38:35 smithi138 ceph-mon[35236]: fsmap cephfs:0/3 6 up:standby, 3 failed 2024-09-10T22:38:36.307 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/22997a4c-6fc2-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T22:38:36.842 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:38:36.821+0000 7fd2be6ca640 1 -- 172.21.15.19:0/1822185274 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd2b81045d0 msgr2=0x7fd2b810cbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:38:36.843 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:38:36.821+0000 7fd2be6ca640 1 --2- 172.21.15.19:0/1822185274 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd2b81045d0 0x7fd2b810cbb0 secure :-1 s=READY pgs=892 cs=0 l=1 rev1=1 crypto rx=0x7fd2a0009900 tx=0x7fd2a002a410 comp rx=0 tx=0).stop 2024-09-10T22:38:36.843 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:38:36.821+0000 7fd2be6ca640 1 -- 172.21.15.19:0/1822185274 shutdown_connections 2024-09-10T22:38:36.843 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:38:36.821+0000 7fd2be6ca640 1 --2- 172.21.15.19:0/1822185274 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd2b810d180 0x7fd2b810f590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:38:36.843 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:38:36.821+0000 7fd2be6ca640 1 --2- 172.21.15.19:0/1822185274 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd2b81045d0 0x7fd2b810cbb0 unknown :-1 s=CLOSED pgs=892 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:38:36.843 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:38:36.821+0000 7fd2be6ca640 1 --2- 172.21.15.19:0/1822185274 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd2b8103bd0 0x7fd2b8103fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:38:36.843 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:38:36.821+0000 7fd2be6ca640 1 -- 172.21.15.19:0/1822185274 >> 172.21.15.19:0/1822185274 conn(0x7fd2b80fd700 msgr2=0x7fd2b80ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:38:36.843 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:38:36.821+0000 7fd2be6ca640 1 -- 172.21.15.19:0/1822185274 shutdown_connections 2024-09-10T22:38:36.843 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:38:36.821+0000 7fd2be6ca640 1 -- 172.21.15.19:0/1822185274 wait complete. 2024-09-10T22:38:36.843 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:38:36.821+0000 7fd2be6ca640 1 Processor -- start 2024-09-10T22:38:36.843 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:38:36.822+0000 7fd2be6ca640 1 -- start start 2024-09-10T22:38:36.843 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:38:36.822+0000 7fd2be6ca640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd2b8103bd0 0x7fd2b8199290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:38:36.843 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:38:36.822+0000 7fd2be6ca640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd2b81045d0 0x7fd2b81997d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:38:36.844 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:38:36.822+0000 7fd2be6ca640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd2b810d180 0x7fd2b819eb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:38:36.844 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:38:36.822+0000 7fd2be6ca640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fd2b8112da0 con 0x7fd2b81045d0 2024-09-10T22:38:36.844 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:38:36.822+0000 7fd2be6ca640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fd2b8112c20 con 0x7fd2b8103bd0 2024-09-10T22:38:36.844 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:38:36.822+0000 7fd2be6ca640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7fd2b8112f20 con 0x7fd2b810d180 2024-09-10T22:38:36.844 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:38:36.822+0000 7fd2affff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd2b81045d0 0x7fd2b81997d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:38:36.844 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:38:36.822+0000 7fd2affff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd2b81045d0 0x7fd2b81997d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:48160/0 (socket says 172.21.15.19:48160) 2024-09-10T22:38:36.844 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:38:36.822+0000 7fd2affff640 1 -- 172.21.15.19:0/331666503 learned_addr learned my addr 172.21.15.19:0/331666503 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:38:36.844 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:38:36.822+0000 7fd2b7fff640 1 --2- 172.21.15.19:0/331666503 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd2b8103bd0 0x7fd2b8199290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:38:36.844 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:38:36.822+0000 7fd2bcc67640 1 --2- 172.21.15.19:0/331666503 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd2b810d180 0x7fd2b819eb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:38:36.844 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:38:36.822+0000 7fd2affff640 1 -- 172.21.15.19:0/331666503 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd2b810d180 msgr2=0x7fd2b819eb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:38:36.844 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:38:36.822+0000 7fd2affff640 1 --2- 172.21.15.19:0/331666503 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd2b810d180 0x7fd2b819eb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:38:36.844 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:38:36.822+0000 7fd2affff640 1 -- 172.21.15.19:0/331666503 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd2b8103bd0 msgr2=0x7fd2b8199290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:38:36.845 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:38:36.822+0000 7fd2affff640 1 --2- 172.21.15.19:0/331666503 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd2b8103bd0 0x7fd2b8199290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:38:36.845 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:38:36.822+0000 7fd2affff640 1 -- 172.21.15.19:0/331666503 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd2b819f340 con 0x7fd2b81045d0 2024-09-10T22:38:36.845 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:38:36.822+0000 7fd2bcc67640 1 --2- 172.21.15.19:0/331666503 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd2b810d180 0x7fd2b819eb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T22:38:36.845 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:38:36.823+0000 7fd2affff640 1 --2- 172.21.15.19:0/331666503 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd2b81045d0 0x7fd2b81997d0 secure :-1 s=READY pgs=893 cs=0 l=1 rev1=1 crypto rx=0x7fd2a0005940 tx=0x7fd2a00042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:38:36.845 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:38:36.823+0000 7fd2b5ffb640 1 -- 172.21.15.19:0/331666503 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2a003f030 con 0x7fd2b81045d0 2024-09-10T22:38:36.845 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:38:36.823+0000 7fd2b5ffb640 1 -- 172.21.15.19:0/331666503 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd2a0003cb0 con 0x7fd2b81045d0 2024-09-10T22:38:36.845 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:38:36.823+0000 7fd2b5ffb640 1 -- 172.21.15.19:0/331666503 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2a0035070 con 0x7fd2b81045d0 2024-09-10T22:38:36.845 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:38:36.823+0000 7fd2be6ca640 1 -- 172.21.15.19:0/331666503 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd2b819f5d0 con 0x7fd2b81045d0 2024-09-10T22:38:36.845 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:38:36.823+0000 7fd2be6ca640 1 -- 172.21.15.19:0/331666503 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd2b81a5cf0 con 0x7fd2b81045d0 2024-09-10T22:38:36.845 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:38:36.824+0000 7fd2be6ca640 1 -- 172.21.15.19:0/331666503 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd2b8103fb0 con 0x7fd2b81045d0 2024-09-10T22:38:36.845 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:38:36.825+0000 7fd2b5ffb640 1 -- 172.21.15.19:0/331666503 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 18) ==== 153250+0+0 (secure 0 0 0) 0x7fd2a003bbf0 con 0x7fd2b81045d0 2024-09-10T22:38:36.845 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:38:36.826+0000 7fd2b5ffb640 1 --2- 172.21.15.19:0/331666503 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7fd2a40b52e0 0x7fd2a40b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:38:36.846 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:38:36.826+0000 7fd2b7fff640 1 --2- 172.21.15.19:0/331666503 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7fd2a40b52e0 0x7fd2a40b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:38:36.846 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:38:36.826+0000 7fd2b5ffb640 1 -- 172.21.15.19:0/331666503 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8585+0+0 (secure 0 0 0) 0x7fd2a0106b30 con 0x7fd2b81045d0 2024-09-10T22:38:36.846 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:38:36.826+0000 7fd2b7fff640 1 --2- 172.21.15.19:0/331666503 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7fd2a40b52e0 0x7fd2a40b77a0 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7fd2a8005d00 tx=0x7fd2a800b410 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:38:36.846 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:38:36.829+0000 7fd2b5ffb640 1 -- 172.21.15.19:0/331666503 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7fd2a00cd890 con 0x7fd2b81045d0 2024-09-10T22:38:37.054 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:38:37.052+0000 7fd2be6ca640 1 -- 172.21.15.19:0/331666503 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7fd2b8107c60 con 0x7fd2b81045d0 2024-09-10T22:38:37.437 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:38:37.435+0000 7fd2b5ffb640 1 -- 172.21.15.19:0/331666503 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v31) ==== 104+0+0 (secure 0 0 0) 0x7fd2a00d6040 con 0x7fd2b81045d0 2024-09-10T22:38:37.439 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:38:37 smithi138 ceph-mon[35236]: mds.? [v2:172.21.15.138:6834/614954712,v1:172.21.15.138:6835/614954712] up:boot 2024-09-10T22:38:37.440 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:38:37.439+0000 7fd2be6ca640 1 -- 172.21.15.19:0/331666503 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7fd2a40b52e0 msgr2=0x7fd2a40b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:38:37.440 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:38:37.439+0000 7fd2be6ca640 1 --2- 172.21.15.19:0/331666503 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7fd2a40b52e0 0x7fd2a40b77a0 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7fd2a8005d00 tx=0x7fd2a800b410 comp rx=0 tx=0).stop 2024-09-10T22:38:37.441 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:38:37.439+0000 7fd2be6ca640 1 -- 172.21.15.19:0/331666503 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd2b81045d0 msgr2=0x7fd2b81997d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:38:37.441 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:38:37.439+0000 7fd2be6ca640 1 --2- 172.21.15.19:0/331666503 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd2b81045d0 0x7fd2b81997d0 secure :-1 s=READY pgs=893 cs=0 l=1 rev1=1 crypto rx=0x7fd2a0005940 tx=0x7fd2a00042f0 comp rx=0 tx=0).stop 2024-09-10T22:38:37.441 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:38:37.439+0000 7fd2be6ca640 1 -- 172.21.15.19:0/331666503 shutdown_connections 2024-09-10T22:38:37.441 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:38:37.439+0000 7fd2be6ca640 1 --2- 172.21.15.19:0/331666503 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7fd2a40b52e0 0x7fd2a40b77a0 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:38:37.441 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:38:37.439+0000 7fd2be6ca640 1 --2- 172.21.15.19:0/331666503 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd2b810d180 0x7fd2b819eb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:38:37.441 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:38:37.439+0000 7fd2be6ca640 1 --2- 172.21.15.19:0/331666503 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd2b81045d0 0x7fd2b81997d0 unknown :-1 s=CLOSED pgs=893 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:38:37.441 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:38:37.439+0000 7fd2be6ca640 1 --2- 172.21.15.19:0/331666503 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd2b8103bd0 0x7fd2b8199290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:38:37.441 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:38:37.439+0000 7fd2be6ca640 1 -- 172.21.15.19:0/331666503 >> 172.21.15.19:0/331666503 conn(0x7fd2b80fd700 msgr2=0x7fd2b80fe3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:38:37.441 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:38:37.439+0000 7fd2be6ca640 1 -- 172.21.15.19:0/331666503 shutdown_connections 2024-09-10T22:38:37.441 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:38:37.439+0000 7fd2be6ca640 1 -- 172.21.15.19:0/331666503 wait complete. 2024-09-10T22:38:37.709 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:38:37 smithi019 ceph-mon[31375]: mds.? [v2:172.21.15.138:6834/614954712,v1:172.21.15.138:6835/614954712] up:boot 2024-09-10T22:38:37.709 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:38:37 smithi019 ceph-mon[31375]: mds.? [v2:172.21.15.135:6834/3390237077,v1:172.21.15.135:6835/3390237077] up:boot 2024-09-10T22:38:37.709 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:38:37 smithi019 ceph-mon[31375]: mds.? [v2:172.21.15.135:6837/2661899528,v1:172.21.15.135:6839/2661899528] up:boot 2024-09-10T22:38:37.709 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:38:37 smithi019 ceph-mon[31375]: mds.? [v2:172.21.15.135:6836/3060422340,v1:172.21.15.135:6838/3060422340] up:boot 2024-09-10T22:38:37.709 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:38:37 smithi019 ceph-mon[31375]: mds.? [v2:172.21.15.138:6836/3590054934,v1:172.21.15.138:6838/3590054934] up:boot 2024-09-10T22:38:37.709 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:38:37 smithi019 ceph-mon[31375]: mds.? [v2:172.21.15.138:6837/2445228842,v1:172.21.15.138:6839/2445228842] up:boot 2024-09-10T22:38:37.709 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:38:37 smithi019 ceph-mon[31375]: fsmap cephfs:0/3 12 up:standby, 3 failed 2024-09-10T22:38:37.709 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:38:37 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "e"} : dispatch 2024-09-10T22:38:37.709 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:38:37 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "h"} : dispatch 2024-09-10T22:38:37.709 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:38:37 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "f"} : dispatch 2024-09-10T22:38:37.710 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:38:37 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "b"} : dispatch 2024-09-10T22:38:37.710 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:38:37 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "i"} : dispatch 2024-09-10T22:38:37.710 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:38:37 smithi019 ceph-mon[31375]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "c"} : dispatch 2024-09-10T22:38:37.710 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:38:37 smithi019 ceph-mon[31375]: pgmap v714: 97 pgs: 97 active+clean; 8.2 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 14 MiB/s wr, 122 op/s 2024-09-10T22:38:37.710 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:38:37 smithi019 ceph-mon[31375]: from='client.? 172.21.15.19:0/331666503' entity='client.admin' cmd={"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} : dispatch 2024-09-10T22:38:37.791 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:38:37 smithi138 ceph-mon[35236]: mds.? [v2:172.21.15.135:6834/3390237077,v1:172.21.15.135:6835/3390237077] up:boot 2024-09-10T22:38:37.791 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:38:37 smithi138 ceph-mon[35236]: mds.? [v2:172.21.15.135:6837/2661899528,v1:172.21.15.135:6839/2661899528] up:boot 2024-09-10T22:38:37.791 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:38:37 smithi138 ceph-mon[35236]: mds.? [v2:172.21.15.135:6836/3060422340,v1:172.21.15.135:6838/3060422340] up:boot 2024-09-10T22:38:37.791 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:38:37 smithi138 ceph-mon[35236]: mds.? [v2:172.21.15.138:6836/3590054934,v1:172.21.15.138:6838/3590054934] up:boot 2024-09-10T22:38:37.792 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:38:37 smithi138 ceph-mon[35236]: mds.? [v2:172.21.15.138:6837/2445228842,v1:172.21.15.138:6839/2445228842] up:boot 2024-09-10T22:38:37.792 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:38:37 smithi138 ceph-mon[35236]: fsmap cephfs:0/3 12 up:standby, 3 failed 2024-09-10T22:38:37.792 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:38:37 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "e"} : dispatch 2024-09-10T22:38:37.792 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:38:37 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "h"} : dispatch 2024-09-10T22:38:37.792 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:38:37 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "f"} : dispatch 2024-09-10T22:38:37.792 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:38:37 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "b"} : dispatch 2024-09-10T22:38:37.792 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:38:37 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "i"} : dispatch 2024-09-10T22:38:37.792 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:38:37 smithi138 ceph-mon[35236]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "c"} : dispatch 2024-09-10T22:38:37.792 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:38:37 smithi138 ceph-mon[35236]: pgmap v714: 97 pgs: 97 active+clean; 8.2 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 14 MiB/s wr, 122 op/s 2024-09-10T22:38:37.792 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:38:37 smithi138 ceph-mon[35236]: from='client.? 172.21.15.19:0/331666503' entity='client.admin' cmd={"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} : dispatch 2024-09-10T22:38:37.860 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:38:37 smithi135 ceph-mon[34789]: mds.? [v2:172.21.15.138:6834/614954712,v1:172.21.15.138:6835/614954712] up:boot 2024-09-10T22:38:37.860 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:38:37 smithi135 ceph-mon[34789]: mds.? [v2:172.21.15.135:6834/3390237077,v1:172.21.15.135:6835/3390237077] up:boot 2024-09-10T22:38:37.860 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:38:37 smithi135 ceph-mon[34789]: mds.? [v2:172.21.15.135:6837/2661899528,v1:172.21.15.135:6839/2661899528] up:boot 2024-09-10T22:38:37.860 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:38:37 smithi135 ceph-mon[34789]: mds.? [v2:172.21.15.135:6836/3060422340,v1:172.21.15.135:6838/3060422340] up:boot 2024-09-10T22:38:37.860 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:38:37 smithi135 ceph-mon[34789]: mds.? [v2:172.21.15.138:6836/3590054934,v1:172.21.15.138:6838/3590054934] up:boot 2024-09-10T22:38:37.860 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:38:37 smithi135 ceph-mon[34789]: mds.? [v2:172.21.15.138:6837/2445228842,v1:172.21.15.138:6839/2445228842] up:boot 2024-09-10T22:38:37.860 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:38:37 smithi135 ceph-mon[34789]: fsmap cephfs:0/3 12 up:standby, 3 failed 2024-09-10T22:38:37.861 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:38:37 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "e"} : dispatch 2024-09-10T22:38:37.861 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:38:37 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "h"} : dispatch 2024-09-10T22:38:37.861 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:38:37 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "f"} : dispatch 2024-09-10T22:38:37.861 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:38:37 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "b"} : dispatch 2024-09-10T22:38:37.861 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:38:37 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "i"} : dispatch 2024-09-10T22:38:37.861 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:38:37 smithi135 ceph-mon[34789]: from='mgr.14150 172.21.15.19:0/3838264420' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "c"} : dispatch 2024-09-10T22:38:37.861 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:38:37 smithi135 ceph-mon[34789]: pgmap v714: 97 pgs: 97 active+clean; 8.2 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 14 MiB/s wr, 122 op/s 2024-09-10T22:38:37.861 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:38:37 smithi135 ceph-mon[34789]: from='client.? 172.21.15.19:0/331666503' entity='client.admin' cmd={"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} : dispatch 2024-09-10T22:38:38.033 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 22997a4c-6fc2-11ef-bcea-c7b262605968 -- ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-10T22:38:38.343 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/22997a4c-6fc2-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T22:38:38.708 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:38:38 smithi019 ceph-mon[31375]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-09-10T22:38:38.708 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:38:38 smithi019 ceph-mon[31375]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-09-10T22:38:38.709 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:38:38 smithi019 ceph-mon[31375]: from='client.? 172.21.15.19:0/331666503' entity='client.admin' cmd='[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]': finished 2024-09-10T22:38:38.709 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:38:38 smithi019 ceph-mon[31375]: fsmap 12 up:standby 2024-09-10T22:38:38.860 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:38:38 smithi135 ceph-mon[34789]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-09-10T22:38:38.860 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:38:38 smithi135 ceph-mon[34789]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-09-10T22:38:38.860 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:38:38 smithi135 ceph-mon[34789]: from='client.? 172.21.15.19:0/331666503' entity='client.admin' cmd='[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]': finished 2024-09-10T22:38:38.860 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:38:38 smithi135 ceph-mon[34789]: fsmap 12 up:standby 2024-09-10T22:38:38.875 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:38:38.860+0000 7f6f0d0b0640 1 -- 172.21.15.19:0/712018680 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6f081087d0 msgr2=0x7f6f08108c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:38:38.875 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:38:38.860+0000 7f6f0d0b0640 1 --2- 172.21.15.19:0/712018680 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6f081087d0 0x7f6f08108c10 secure :-1 s=READY pgs=894 cs=0 l=1 rev1=1 crypto rx=0x7f6ef0009900 tx=0x7f6ef002a410 comp rx=0 tx=0).stop 2024-09-10T22:38:38.875 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:38:38.860+0000 7f6f0d0b0640 1 -- 172.21.15.19:0/712018680 shutdown_connections 2024-09-10T22:38:38.875 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:38:38.860+0000 7f6f0d0b0640 1 --2- 172.21.15.19:0/712018680 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f6f08109150 0x7f6f0810f950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:38:38.875 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:38:38.860+0000 7f6f0d0b0640 1 --2- 172.21.15.19:0/712018680 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6f081087d0 0x7f6f08108c10 unknown :-1 s=CLOSED pgs=894 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:38:38.875 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:38:38.860+0000 7f6f0d0b0640 1 --2- 172.21.15.19:0/712018680 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6f08102dc0 0x7f6f081031a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:38:38.875 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:38:38.860+0000 7f6f0d0b0640 1 -- 172.21.15.19:0/712018680 >> 172.21.15.19:0/712018680 conn(0x7f6f080fe830 msgr2=0x7f6f08100c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:38:38.875 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:38:38.860+0000 7f6f0d0b0640 1 -- 172.21.15.19:0/712018680 shutdown_connections 2024-09-10T22:38:38.876 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:38:38.860+0000 7f6f0d0b0640 1 -- 172.21.15.19:0/712018680 wait complete. 2024-09-10T22:38:38.876 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:38:38.861+0000 7f6f0d0b0640 1 Processor -- start 2024-09-10T22:38:38.876 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:38:38.861+0000 7f6f0d0b0640 1 -- start start 2024-09-10T22:38:38.876 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:38:38.861+0000 7f6f0d0b0640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6f08102dc0 0x7f6f08199240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:38:38.876 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:38:38.861+0000 7f6f0d0b0640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6f081087d0 0x7f6f08199780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:38:38.876 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:38:38.861+0000 7f6f0d0b0640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f6f08109150 0x7f6f0819eb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:38:38.876 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:38:38.861+0000 7f6f0d0b0640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f6f08112e10 con 0x7f6f08102dc0 2024-09-10T22:38:38.876 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:38:38.861+0000 7f6f0d0b0640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f6f08112c90 con 0x7f6f081087d0 2024-09-10T22:38:38.876 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:38:38.861+0000 7f6f0d0b0640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f6f08112f90 con 0x7f6f08109150 2024-09-10T22:38:38.876 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:38:38.861+0000 7f6f06d9d640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6f08102dc0 0x7f6f08199240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:38:38.876 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:38:38.861+0000 7f6f06d9d640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6f08102dc0 0x7f6f08199240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:48176/0 (socket says 172.21.15.19:48176) 2024-09-10T22:38:38.876 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:38:38.861+0000 7f6f06d9d640 1 -- 172.21.15.19:0/1238347159 learned_addr learned my addr 172.21.15.19:0/1238347159 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:38:38.877 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:38:38.861+0000 7f6f0759e640 1 --2- 172.21.15.19:0/1238347159 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f6f08109150 0x7f6f0819eb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:38:38.877 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:38:38.861+0000 7f6efffff640 1 --2- 172.21.15.19:0/1238347159 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6f081087d0 0x7f6f08199780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:38:38.877 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:38:38.862+0000 7f6f06d9d640 1 -- 172.21.15.19:0/1238347159 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f6f08109150 msgr2=0x7f6f0819eb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:38:38.877 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:38:38.862+0000 7f6f06d9d640 1 --2- 172.21.15.19:0/1238347159 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f6f08109150 0x7f6f0819eb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:38:38.877 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:38:38.862+0000 7f6f06d9d640 1 -- 172.21.15.19:0/1238347159 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6f081087d0 msgr2=0x7f6f08199780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:38:38.877 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:38:38.862+0000 7f6f06d9d640 1 --2- 172.21.15.19:0/1238347159 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6f081087d0 0x7f6f08199780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:38:38.877 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:38:38.862+0000 7f6f06d9d640 1 -- 172.21.15.19:0/1238347159 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6f0819f2f0 con 0x7f6f08102dc0 2024-09-10T22:38:38.877 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:38:38.862+0000 7f6efffff640 1 --2- 172.21.15.19:0/1238347159 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6f081087d0 0x7f6f08199780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T22:38:38.877 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:38:38.862+0000 7f6f06d9d640 1 --2- 172.21.15.19:0/1238347159 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6f08102dc0 0x7f6f08199240 secure :-1 s=READY pgs=895 cs=0 l=1 rev1=1 crypto rx=0x7f6ef800d950 tx=0x7f6ef800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:38:38.877 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:38:38.862+0000 7f6f04d99640 1 -- 172.21.15.19:0/1238347159 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ef8017070 con 0x7f6f08102dc0 2024-09-10T22:38:38.877 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:38:38.862+0000 7f6f04d99640 1 -- 172.21.15.19:0/1238347159 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6ef8009c30 con 0x7f6f08102dc0 2024-09-10T22:38:38.877 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:38:38.862+0000 7f6f04d99640 1 -- 172.21.15.19:0/1238347159 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ef800f620 con 0x7f6f08102dc0 2024-09-10T22:38:38.877 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:38:38.862+0000 7f6f0d0b0640 1 -- 172.21.15.19:0/1238347159 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6f0819f5e0 con 0x7f6f08102dc0 2024-09-10T22:38:38.878 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:38:38.862+0000 7f6f0d0b0640 1 -- 172.21.15.19:0/1238347159 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6f081a5ca0 con 0x7f6f08102dc0 2024-09-10T22:38:38.878 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:38:38.863+0000 7f6f0d0b0640 1 -- 172.21.15.19:0/1238347159 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6f081031a0 con 0x7f6f08102dc0 2024-09-10T22:38:38.878 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:38:38.865+0000 7f6f04d99640 1 -- 172.21.15.19:0/1238347159 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 18) ==== 153250+0+0 (secure 0 0 0) 0x7f6ef8005030 con 0x7f6f08102dc0 2024-09-10T22:38:38.878 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:38:38.865+0000 7f6f04d99640 1 --2- 172.21.15.19:0/1238347159 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f6ef40b52e0 0x7f6ef40b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:38:38.878 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:38:38.866+0000 7f6efffff640 1 --2- 172.21.15.19:0/1238347159 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f6ef40b52e0 0x7f6ef40b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:38:38.878 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:38:38.866+0000 7f6f04d99640 1 -- 172.21.15.19:0/1238347159 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8585+0+0 (secure 0 0 0) 0x7f6ef80e5a00 con 0x7f6f08102dc0 2024-09-10T22:38:38.878 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:38:38.866+0000 7f6efffff640 1 --2- 172.21.15.19:0/1238347159 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f6ef40b52e0 0x7f6ef40b77a0 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f6ef0031440 tx=0x7f6ef0005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:38:38.878 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:38:38.868+0000 7f6f04d99640 1 -- 172.21.15.19:0/1238347159 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f6ef80ac760 con 0x7f6f08102dc0 2024-09-10T22:38:38.878 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:38:38 smithi138 ceph-mon[35236]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-09-10T22:38:38.878 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:38:38 smithi138 ceph-mon[35236]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-09-10T22:38:38.879 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:38:38 smithi138 ceph-mon[35236]: from='client.? 172.21.15.19:0/331666503' entity='client.admin' cmd='[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]': finished 2024-09-10T22:38:38.879 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:38:38 smithi138 ceph-mon[35236]: fsmap 12 up:standby 2024-09-10T22:38:39.055 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:38:39.053+0000 7f6f0d0b0640 1 -- 172.21.15.19:0/1238347159 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7f6f081a5fe0 con 0x7f6f08102dc0 2024-09-10T22:38:39.448 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:38:39.447+0000 7f6f04d99640 1 -- 172.21.15.19:0/1238347159 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v79) ==== 181+0+0 (secure 0 0 0) 0x7f6ef8009de0 con 0x7f6f08102dc0 2024-09-10T22:38:39.449 INFO:teuthology.orchestra.run.smithi019.stderr:pool 'cephfs_metadata' removed 2024-09-10T22:38:39.451 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:38:39.449+0000 7f6f0d0b0640 1 -- 172.21.15.19:0/1238347159 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f6ef40b52e0 msgr2=0x7f6ef40b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:38:39.451 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:38:39.449+0000 7f6f0d0b0640 1 --2- 172.21.15.19:0/1238347159 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f6ef40b52e0 0x7f6ef40b77a0 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f6ef0031440 tx=0x7f6ef0005a20 comp rx=0 tx=0).stop 2024-09-10T22:38:39.451 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:38:39.449+0000 7f6f0d0b0640 1 -- 172.21.15.19:0/1238347159 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6f08102dc0 msgr2=0x7f6f08199240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:38:39.451 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:38:39.449+0000 7f6f0d0b0640 1 --2- 172.21.15.19:0/1238347159 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6f08102dc0 0x7f6f08199240 secure :-1 s=READY pgs=895 cs=0 l=1 rev1=1 crypto rx=0x7f6ef800d950 tx=0x7f6ef800de10 comp rx=0 tx=0).stop 2024-09-10T22:38:39.451 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:38:39.449+0000 7f6f0d0b0640 1 -- 172.21.15.19:0/1238347159 shutdown_connections 2024-09-10T22:38:39.451 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:38:39.449+0000 7f6f0d0b0640 1 --2- 172.21.15.19:0/1238347159 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f6ef40b52e0 0x7f6ef40b77a0 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:38:39.451 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:38:39.449+0000 7f6f0d0b0640 1 --2- 172.21.15.19:0/1238347159 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f6f08109150 0x7f6f0819eb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:38:39.451 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:38:39.449+0000 7f6f0d0b0640 1 --2- 172.21.15.19:0/1238347159 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6f081087d0 0x7f6f08199780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:38:39.452 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:38:39.449+0000 7f6f0d0b0640 1 --2- 172.21.15.19:0/1238347159 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6f08102dc0 0x7f6f08199240 unknown :-1 s=CLOSED pgs=895 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:38:39.452 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:38:39.449+0000 7f6f0d0b0640 1 -- 172.21.15.19:0/1238347159 >> 172.21.15.19:0/1238347159 conn(0x7f6f080fe830 msgr2=0x7f6f08100c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:38:39.452 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:38:39.449+0000 7f6f0d0b0640 1 -- 172.21.15.19:0/1238347159 shutdown_connections 2024-09-10T22:38:39.452 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:38:39.450+0000 7f6f0d0b0640 1 -- 172.21.15.19:0/1238347159 wait complete. 2024-09-10T22:38:39.708 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:38:39 smithi019 ceph-mon[31375]: pgmap v715: 97 pgs: 97 active+clean; 8.0 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 3.8 MiB/s wr, 78 op/s 2024-09-10T22:38:39.709 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:38:39 smithi019 ceph-mon[31375]: from='client.? 172.21.15.19:0/1238347159' entity='client.admin' cmd={"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} : dispatch 2024-09-10T22:38:39.860 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:38:39 smithi135 ceph-mon[34789]: pgmap v715: 97 pgs: 97 active+clean; 8.0 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 3.8 MiB/s wr, 78 op/s 2024-09-10T22:38:39.860 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:38:39 smithi135 ceph-mon[34789]: from='client.? 172.21.15.19:0/1238347159' entity='client.admin' cmd={"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} : dispatch 2024-09-10T22:38:39.875 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:38:39 smithi138 ceph-mon[35236]: pgmap v715: 97 pgs: 97 active+clean; 8.0 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 3.8 MiB/s wr, 78 op/s 2024-09-10T22:38:39.875 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:38:39 smithi138 ceph-mon[35236]: from='client.? 172.21.15.19:0/1238347159' entity='client.admin' cmd={"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} : dispatch 2024-09-10T22:38:40.132 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 22997a4c-6fc2-11ef-bcea-c7b262605968 -- ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-10T22:38:40.399 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/22997a4c-6fc2-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T22:38:40.708 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:38:40 smithi019 ceph-mon[31375]: from='client.? 172.21.15.19:0/1238347159' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]': finished 2024-09-10T22:38:40.709 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:38:40 smithi019 ceph-mon[31375]: osdmap e79: 12 total, 12 up, 12 in 2024-09-10T22:38:40.860 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:38:40 smithi135 ceph-mon[34789]: from='client.? 172.21.15.19:0/1238347159' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]': finished 2024-09-10T22:38:40.860 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:38:40 smithi135 ceph-mon[34789]: osdmap e79: 12 total, 12 up, 12 in 2024-09-10T22:38:40.875 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:38:40 smithi138 ceph-mon[35236]: from='client.? 172.21.15.19:0/1238347159' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]': finished 2024-09-10T22:38:40.875 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:38:40 smithi138 ceph-mon[35236]: osdmap e79: 12 total, 12 up, 12 in 2024-09-10T22:38:40.940 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:38:40.926+0000 7f9ce5b47640 1 -- 172.21.15.19:0/2400932538 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9ce0104600 msgr2=0x7f9ce010caf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:38:40.941 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:38:40.926+0000 7f9ce5b47640 1 --2- 172.21.15.19:0/2400932538 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9ce0104600 0x7f9ce010caf0 secure :-1 s=READY pgs=896 cs=0 l=1 rev1=1 crypto rx=0x7f9cd4009900 tx=0x7f9cd402a410 comp rx=0 tx=0).stop 2024-09-10T22:38:40.941 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:38:40.926+0000 7f9ce5b47640 1 -- 172.21.15.19:0/2400932538 shutdown_connections 2024-09-10T22:38:40.941 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:38:40.926+0000 7f9ce5b47640 1 --2- 172.21.15.19:0/2400932538 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f9ce010d140 0x7f9ce010f5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:38:40.941 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:38:40.926+0000 7f9ce5b47640 1 --2- 172.21.15.19:0/2400932538 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9ce0104600 0x7f9ce010caf0 unknown :-1 s=CLOSED pgs=896 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:38:40.941 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:38:40.926+0000 7f9ce5b47640 1 --2- 172.21.15.19:0/2400932538 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9ce0103ce0 0x7f9ce01040c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:38:40.941 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:38:40.926+0000 7f9ce5b47640 1 -- 172.21.15.19:0/2400932538 >> 172.21.15.19:0/2400932538 conn(0x7f9ce00fd720 msgr2=0x7f9ce00ffb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:38:40.941 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:38:40.926+0000 7f9ce5b47640 1 -- 172.21.15.19:0/2400932538 shutdown_connections 2024-09-10T22:38:40.941 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:38:40.926+0000 7f9ce5b47640 1 -- 172.21.15.19:0/2400932538 wait complete. 2024-09-10T22:38:40.941 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:38:40.926+0000 7f9ce5b47640 1 Processor -- start 2024-09-10T22:38:40.941 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:38:40.927+0000 7f9ce5b47640 1 -- start start 2024-09-10T22:38:40.942 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:38:40.927+0000 7f9ce5b47640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f9ce0103ce0 0x7f9ce01992a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:38:40.942 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:38:40.927+0000 7f9ce5b47640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9ce0104600 0x7f9ce01997e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:38:40.942 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:38:40.927+0000 7f9ce5b47640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9ce010d140 0x7f9ce019eb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:38:40.942 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:38:40.927+0000 7f9ce5b47640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f9ce0112db0 con 0x7f9ce010d140 2024-09-10T22:38:40.942 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:38:40.927+0000 7f9ce5b47640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f9ce0112c30 con 0x7f9ce0104600 2024-09-10T22:38:40.942 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:38:40.927+0000 7f9ce5b47640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 -- 0x7f9ce0112f30 con 0x7f9ce0103ce0 2024-09-10T22:38:40.942 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:38:40.927+0000 7f9cdffff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9ce010d140 0x7f9ce019eb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:38:40.942 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:38:40.927+0000 7f9cdffff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9ce010d140 0x7f9ce019eb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:48194/0 (socket says 172.21.15.19:48194) 2024-09-10T22:38:40.942 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:38:40.927+0000 7f9cdffff640 1 -- 172.21.15.19:0/3601787270 learned_addr learned my addr 172.21.15.19:0/3601787270 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-10T22:38:40.942 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:38:40.927+0000 7f9cdf7fe640 1 --2- 172.21.15.19:0/3601787270 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f9ce0103ce0 0x7f9ce01992a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:38:40.942 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:38:40.927+0000 7f9cdeffd640 1 --2- 172.21.15.19:0/3601787270 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9ce0104600 0x7f9ce01997e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:38:40.942 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:38:40.927+0000 7f9cdffff640 1 -- 172.21.15.19:0/3601787270 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f9ce0103ce0 msgr2=0x7f9ce01992a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:38:40.943 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:38:40.927+0000 7f9cdffff640 1 --2- 172.21.15.19:0/3601787270 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f9ce0103ce0 0x7f9ce01992a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:38:40.943 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:38:40.927+0000 7f9cdffff640 1 -- 172.21.15.19:0/3601787270 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9ce0104600 msgr2=0x7f9ce01997e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:38:40.943 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:38:40.927+0000 7f9cdffff640 1 --2- 172.21.15.19:0/3601787270 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9ce0104600 0x7f9ce01997e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:38:40.943 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:38:40.927+0000 7f9cdffff640 1 -- 172.21.15.19:0/3601787270 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9ce019f350 con 0x7f9ce010d140 2024-09-10T22:38:40.943 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:38:40.927+0000 7f9cdffff640 1 --2- 172.21.15.19:0/3601787270 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9ce010d140 0x7f9ce019eb80 secure :-1 s=READY pgs=897 cs=0 l=1 rev1=1 crypto rx=0x7f9cd800eb10 tx=0x7f9cd800c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:38:40.943 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:38:40.928+0000 7f9cdcff9640 1 -- 172.21.15.19:0/3601787270 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9cd8004b20 con 0x7f9ce010d140 2024-09-10T22:38:40.943 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:38:40.928+0000 7f9cdcff9640 1 -- 172.21.15.19:0/3601787270 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9cd8004cc0 con 0x7f9ce010d140 2024-09-10T22:38:40.943 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:38:40.928+0000 7f9ce5b47640 1 -- 172.21.15.19:0/3601787270 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9ce019f640 con 0x7f9ce010d140 2024-09-10T22:38:40.943 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:38:40.928+0000 7f9cdcff9640 1 -- 172.21.15.19:0/3601787270 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9cd8010670 con 0x7f9ce010d140 2024-09-10T22:38:40.943 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:38:40.928+0000 7f9ce5b47640 1 -- 172.21.15.19:0/3601787270 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9ce01a5ed0 con 0x7f9ce010d140 2024-09-10T22:38:40.943 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:38:40.929+0000 7f9ce5b47640 1 -- 172.21.15.19:0/3601787270 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9ce01040c0 con 0x7f9ce010d140 2024-09-10T22:38:40.943 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:38:40.930+0000 7f9cdcff9640 1 -- 172.21.15.19:0/3601787270 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 18) ==== 153250+0+0 (secure 0 0 0) 0x7f9cd8005000 con 0x7f9ce010d140 2024-09-10T22:38:40.943 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:38:40.931+0000 7f9cdcff9640 1 --2- 172.21.15.19:0/3601787270 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f9cc80b5360 0x7f9cc80b7820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:38:40.943 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:38:40.931+0000 7f9cdf7fe640 1 --2- 172.21.15.19:0/3601787270 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f9cc80b5360 0x7f9cc80b7820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:38:40.944 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:38:40.931+0000 7f9cdcff9640 1 -- 172.21.15.19:0/3601787270 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 7915+0+0 (secure 0 0 0) 0x7f9cd80e6100 con 0x7f9ce010d140 2024-09-10T22:38:40.944 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:38:40.932+0000 7f9cdf7fe640 1 --2- 172.21.15.19:0/3601787270 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f9cc80b5360 0x7f9cc80b7820 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f9cd000bbe0 tx=0x7f9cd000b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:38:40.944 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:38:40.934+0000 7f9cdcff9640 1 -- 172.21.15.19:0/3601787270 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f9cd8056220 con 0x7f9ce010d140 2024-09-10T22:38:41.122 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:38:41.121+0000 7f9ce5b47640 1 -- 172.21.15.19:0/3601787270 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7f9ce019a3d0 con 0x7f9ce010d140 2024-09-10T22:38:41.459 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:38:41.457+0000 7f9cdcff9640 1 -- 172.21.15.19:0/3601787270 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v80) ==== 169+0+0 (secure 0 0 0) 0x7f9ce019a3d0 con 0x7f9ce010d140 2024-09-10T22:38:41.459 INFO:teuthology.orchestra.run.smithi019.stderr:pool 'cephfs_data' removed 2024-09-10T22:38:41.461 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:38:41.460+0000 7f9ce5b47640 1 -- 172.21.15.19:0/3601787270 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f9cc80b5360 msgr2=0x7f9cc80b7820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:38:41.461 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:38:41.460+0000 7f9ce5b47640 1 --2- 172.21.15.19:0/3601787270 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f9cc80b5360 0x7f9cc80b7820 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f9cd000bbe0 tx=0x7f9cd000b390 comp rx=0 tx=0).stop 2024-09-10T22:38:41.461 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:38:41.460+0000 7f9ce5b47640 1 -- 172.21.15.19:0/3601787270 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9ce010d140 msgr2=0x7f9ce019eb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:38:41.461 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:38:41.460+0000 7f9ce5b47640 1 --2- 172.21.15.19:0/3601787270 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9ce010d140 0x7f9ce019eb80 secure :-1 s=READY pgs=897 cs=0 l=1 rev1=1 crypto rx=0x7f9cd800eb10 tx=0x7f9cd800c2d0 comp rx=0 tx=0).stop 2024-09-10T22:38:41.462 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:38:41.460+0000 7f9ce5b47640 1 -- 172.21.15.19:0/3601787270 shutdown_connections 2024-09-10T22:38:41.462 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:38:41.460+0000 7f9ce5b47640 1 --2- 172.21.15.19:0/3601787270 >> [v2:172.21.15.19:6800/2119495487,v1:172.21.15.19:6801/2119495487] conn(0x7f9cc80b5360 0x7f9cc80b7820 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:38:41.462 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:38:41.460+0000 7f9ce5b47640 1 --2- 172.21.15.19:0/3601787270 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9ce010d140 0x7f9ce019eb80 unknown :-1 s=CLOSED pgs=897 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:38:41.462 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:38:41.460+0000 7f9ce5b47640 1 --2- 172.21.15.19:0/3601787270 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9ce0104600 0x7f9ce01997e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:38:41.462 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:38:41.460+0000 7f9ce5b47640 1 --2- 172.21.15.19:0/3601787270 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f9ce0103ce0 0x7f9ce01992a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:38:41.462 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:38:41.460+0000 7f9ce5b47640 1 -- 172.21.15.19:0/3601787270 >> 172.21.15.19:0/3601787270 conn(0x7f9ce00fd720 msgr2=0x7f9ce00fe420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:38:41.462 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:38:41.460+0000 7f9ce5b47640 1 -- 172.21.15.19:0/3601787270 shutdown_connections 2024-09-10T22:38:41.462 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-10T22:38:41.460+0000 7f9ce5b47640 1 -- 172.21.15.19:0/3601787270 wait complete. 2024-09-10T22:38:41.706 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:38:41 smithi019 ceph-mon[31375]: pgmap v717: 65 pgs: 65 active+clean; 7.8 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T22:38:41.707 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:38:41 smithi019 ceph-mon[31375]: from='client.? 172.21.15.19:0/3601787270' entity='client.admin' cmd={"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} : dispatch 2024-09-10T22:38:41.860 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:38:41 smithi135 ceph-mon[34789]: pgmap v717: 65 pgs: 65 active+clean; 7.8 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T22:38:41.860 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:38:41 smithi135 ceph-mon[34789]: from='client.? 172.21.15.19:0/3601787270' entity='client.admin' cmd={"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} : dispatch 2024-09-10T22:38:41.875 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:38:41 smithi138 ceph-mon[35236]: pgmap v717: 65 pgs: 65 active+clean; 7.8 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T22:38:41.875 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:38:41 smithi138 ceph-mon[35236]: from='client.? 172.21.15.19:0/3601787270' entity='client.admin' cmd={"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} : dispatch 2024-09-10T22:38:42.165 DEBUG:teuthology.orchestra.run.smithi019:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-10T22:38:42.192 DEBUG:teuthology.orchestra.run.smithi135:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-10T22:38:42.221 DEBUG:teuthology.orchestra.run.smithi138:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-10T22:38:42.248 INFO:tasks.cephadm:Cleaning up testdir ceph.* files... 2024-09-10T22:38:42.248 DEBUG:teuthology.orchestra.run.smithi019:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-09-10T22:38:42.264 DEBUG:teuthology.orchestra.run.smithi135:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-09-10T22:38:42.279 DEBUG:teuthology.orchestra.run.smithi138:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-09-10T22:38:42.304 INFO:tasks.cephadm:Stopping all daemons... 2024-09-10T22:38:42.304 INFO:tasks.cephadm.mon.a:Stopping mon.a... 2024-09-10T22:38:42.304 DEBUG:teuthology.orchestra.run.smithi019:> sudo systemctl stop ceph-22997a4c-6fc2-11ef-bcea-c7b262605968@mon.a 2024-09-10T22:38:42.459 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:38:42 smithi019 systemd[1]: Stopping Ceph mon.a for 22997a4c-6fc2-11ef-bcea-c7b262605968... 2024-09-10T22:38:42.610 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:38:42 smithi135 ceph-mon[34789]: from='client.? 172.21.15.19:0/3601787270' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]': finished 2024-09-10T22:38:42.610 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:38:42 smithi135 ceph-mon[34789]: osdmap e80: 12 total, 12 up, 12 in 2024-09-10T22:38:42.625 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:38:42 smithi138 ceph-mon[35236]: from='client.? 172.21.15.19:0/3601787270' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]': finished 2024-09-10T22:38:42.625 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:38:42 smithi138 ceph-mon[35236]: osdmap e80: 12 total, 12 up, 12 in 2024-09-10T22:38:42.714 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:38:42 smithi019 ceph-mon[31375]: from='client.? 172.21.15.19:0/3601787270' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]': finished 2024-09-10T22:38:42.714 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:38:42 smithi019 ceph-mon[31375]: osdmap e80: 12 total, 12 up, 12 in 2024-09-10T22:38:42.714 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:38:42 smithi019 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-mon-a[31371]: 2024-09-10T22:38:42.681+0000 7f5b6b8bc640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-10T22:38:42.714 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:38:42 smithi019 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-mon-a[31371]: 2024-09-10T22:38:42.681+0000 7f5b6b8bc640 -1 mon.a@0(leader) e3 *** Got Signal Terminated *** 2024-09-10T22:38:43.017 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:38:42 smithi019 podman[106083]: 2024-09-10 22:38:42.712823942 +0000 UTC m=+0.209122258 container died 9dcddfe60fd2ae97d906c75a6684f6eda330616bd158b47b7bb428d7d7a7afcc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30, name=ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-mon-a, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.license=GPLv2, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, io.buildah.version=1.37.2) 2024-09-10T22:38:43.367 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:38:43 smithi019 podman[106083]: 2024-09-10 22:38:43.148024085 +0000 UTC m=+0.644322383 container cleanup 9dcddfe60fd2ae97d906c75a6684f6eda330616bd158b47b7bb428d7d7a7afcc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30, name=ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-mon-a, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-10T22:38:43.367 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:38:43 smithi019 bash[106083]: ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-mon-a 2024-09-10T22:38:43.620 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 10 22:38:43 smithi019 podman[106096]: 2024-09-10 22:38:43.366063364 +0000 UTC m=+0.652678365 container remove 9dcddfe60fd2ae97d906c75a6684f6eda330616bd158b47b7bb428d7d7a7afcc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30, name=ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-mon-a, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, ceph=True, io.buildah.version=1.37.2, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-10T22:38:43.625 DEBUG:teuthology.orchestra.run.smithi019:> sudo pkill -f 'journalctl -f -n 0 -u ceph-22997a4c-6fc2-11ef-bcea-c7b262605968@mon.a.service' 2024-09-10T22:38:43.665 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-10T22:38:43.665 INFO:tasks.cephadm.mon.a:Stopped mon.a 2024-09-10T22:38:43.665 INFO:tasks.cephadm.mon.c:Stopping mon.b... 2024-09-10T22:38:43.666 DEBUG:teuthology.orchestra.run.smithi135:> sudo systemctl stop ceph-22997a4c-6fc2-11ef-bcea-c7b262605968@mon.b 2024-09-10T22:38:43.995 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:38:43 smithi135 systemd[1]: Stopping Ceph mon.b for 22997a4c-6fc2-11ef-bcea-c7b262605968... 2024-09-10T22:38:44.304 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:38:43 smithi135 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-mon-b[34785]: 2024-09-10T22:38:43.993+0000 7f9d7ac58640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.b -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-10T22:38:44.305 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:38:43 smithi135 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-mon-b[34785]: 2024-09-10T22:38:43.993+0000 7f9d7ac58640 -1 mon.b@2(peon) e3 *** Got Signal Terminated *** 2024-09-10T22:38:44.305 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:38:44 smithi135 podman[69822]: 2024-09-10 22:38:44.045424919 +0000 UTC m=+0.148344306 container died b8f7a223e8ed8c8196684e732e2178476905cf697d319725b981304214965ade (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-mon-b, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, ceph=True, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2) 2024-09-10T22:38:44.610 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:38:44 smithi135 podman[69822]: 2024-09-10 22:38:44.393837233 +0000 UTC m=+0.496756620 container cleanup b8f7a223e8ed8c8196684e732e2178476905cf697d319725b981304214965ade (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-mon-b, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.vendor=CentOS, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-10T22:38:44.610 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:38:44 smithi135 bash[69822]: ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-mon-b 2024-09-10T22:38:44.856 DEBUG:teuthology.orchestra.run.smithi135:> sudo pkill -f 'journalctl -f -n 0 -u ceph-22997a4c-6fc2-11ef-bcea-c7b262605968@mon.b.service' 2024-09-10T22:38:44.878 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:38:44 smithi135 podman[69837]: 2024-09-10 22:38:44.728548046 +0000 UTC m=+0.679793103 container remove b8f7a223e8ed8c8196684e732e2178476905cf697d319725b981304214965ade (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-mon-b, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, ceph=True, GIT_CLEAN=True, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD) 2024-09-10T22:38:44.878 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:38:44 smithi135 systemd[1]: ceph-22997a4c-6fc2-11ef-bcea-c7b262605968@mon.b.service: Deactivated successfully. 2024-09-10T22:38:44.878 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:38:44 smithi135 systemd[1]: Stopped Ceph mon.b for 22997a4c-6fc2-11ef-bcea-c7b262605968. 2024-09-10T22:38:44.878 INFO:journalctl@ceph.mon.b.smithi135.stdout:Sep 10 22:38:44 smithi135 systemd[1]: ceph-22997a4c-6fc2-11ef-bcea-c7b262605968@mon.b.service: Consumed 12.542s CPU time. 2024-09-10T22:38:44.907 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-10T22:38:44.907 INFO:tasks.cephadm.mon.c:Stopped mon.b 2024-09-10T22:38:44.907 INFO:tasks.cephadm.mon.c:Stopping mon.c... 2024-09-10T22:38:44.907 DEBUG:teuthology.orchestra.run.smithi138:> sudo systemctl stop ceph-22997a4c-6fc2-11ef-bcea-c7b262605968@mon.c 2024-09-10T22:38:45.237 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:38:44 smithi138 systemd[1]: Stopping Ceph mon.c for 22997a4c-6fc2-11ef-bcea-c7b262605968... 2024-09-10T22:38:45.489 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:38:45 smithi138 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-mon-c[35232]: 2024-09-10T22:38:45.234+0000 7f0e43715640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.c -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-10T22:38:45.489 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:38:45 smithi138 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-mon-c[35232]: 2024-09-10T22:38:45.234+0000 7f0e43715640 -1 mon.c@1(peon) e3 *** Got Signal Terminated *** 2024-09-10T22:38:45.745 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:38:45 smithi138 podman[70744]: 2024-09-10 22:38:45.488737025 +0000 UTC m=+0.385202048 container died 79446bdec6a90b8868648193835cae55ae7bb238b695f6f28725e75e7e0278ed (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-mon-c, ceph=True, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux ) 2024-09-10T22:38:46.054 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:38:45 smithi138 podman[70744]: 2024-09-10 22:38:45.80156052 +0000 UTC m=+0.698025542 container cleanup 79446bdec6a90b8868648193835cae55ae7bb238b695f6f28725e75e7e0278ed (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-mon-c, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.vendor=CentOS, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, CEPH_POINT_RELEASE=) 2024-09-10T22:38:46.054 INFO:journalctl@ceph.mon.c.smithi138.stdout:Sep 10 22:38:45 smithi138 bash[70744]: ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-mon-c 2024-09-10T22:38:46.235 DEBUG:teuthology.orchestra.run.smithi138:> sudo pkill -f 'journalctl -f -n 0 -u ceph-22997a4c-6fc2-11ef-bcea-c7b262605968@mon.c.service' 2024-09-10T22:38:46.279 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-10T22:38:46.279 INFO:tasks.cephadm.mon.c:Stopped mon.c 2024-09-10T22:38:46.279 INFO:tasks.cephadm.mgr.x:Stopping mgr.x... 2024-09-10T22:38:46.279 DEBUG:teuthology.orchestra.run.smithi019:> sudo systemctl stop ceph-22997a4c-6fc2-11ef-bcea-c7b262605968@mgr.x 2024-09-10T22:38:46.607 INFO:journalctl@ceph.mgr.x.smithi019.stdout:Sep 10 22:38:46 smithi019 systemd[1]: Stopping Ceph mgr.x for 22997a4c-6fc2-11ef-bcea-c7b262605968... 2024-09-10T22:38:46.896 INFO:journalctl@ceph.mgr.x.smithi019.stdout:Sep 10 22:38:46 smithi019 podman[106202]: 2024-09-10 22:38:46.60891426 +0000 UTC m=+0.135810736 container died abb4423f855be20dd77bddf004023fce22ddbc300d018aba55323646f389334c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30, name=ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-mgr-x, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, ceph=True) 2024-09-10T22:38:47.208 INFO:journalctl@ceph.mgr.x.smithi019.stdout:Sep 10 22:38:47 smithi019 podman[106202]: 2024-09-10 22:38:47.002198118 +0000 UTC m=+0.529094580 container cleanup abb4423f855be20dd77bddf004023fce22ddbc300d018aba55323646f389334c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30, name=ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-mgr-x, io.buildah.version=1.37.2, ceph=True, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2) 2024-09-10T22:38:47.208 INFO:journalctl@ceph.mgr.x.smithi019.stdout:Sep 10 22:38:47 smithi019 bash[106202]: ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-mgr-x 2024-09-10T22:38:47.551 DEBUG:teuthology.orchestra.run.smithi019:> sudo pkill -f 'journalctl -f -n 0 -u ceph-22997a4c-6fc2-11ef-bcea-c7b262605968@mgr.x.service' 2024-09-10T22:38:47.587 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-10T22:38:47.588 INFO:tasks.cephadm.mgr.x:Stopped mgr.x 2024-09-10T22:38:47.588 INFO:tasks.cephadm.mgr.y:Stopping mgr.y... 2024-09-10T22:38:47.588 DEBUG:teuthology.orchestra.run.smithi135:> sudo systemctl stop ceph-22997a4c-6fc2-11ef-bcea-c7b262605968@mgr.y 2024-09-10T22:38:47.887 INFO:journalctl@ceph.mgr.y.smithi135.stdout:Sep 10 22:38:47 smithi135 systemd[1]: Stopping Ceph mgr.y for 22997a4c-6fc2-11ef-bcea-c7b262605968... 2024-09-10T22:38:48.141 INFO:journalctl@ceph.mgr.y.smithi135.stdout:Sep 10 22:38:47 smithi135 podman[69945]: 2024-09-10 22:38:47.886563833 +0000 UTC m=+0.114217510 container died 8155995dafc3bcc1e30e6fccc43c323869ac2534e1b1a00bf57e90d504fa3eb3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-mgr-y, ceph=True, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731) 2024-09-10T22:38:48.417 INFO:journalctl@ceph.mgr.y.smithi135.stdout:Sep 10 22:38:48 smithi135 podman[69945]: 2024-09-10 22:38:48.215208391 +0000 UTC m=+0.442862065 container cleanup 8155995dafc3bcc1e30e6fccc43c323869ac2534e1b1a00bf57e90d504fa3eb3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-mgr-y, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-10T22:38:48.417 INFO:journalctl@ceph.mgr.y.smithi135.stdout:Sep 10 22:38:48 smithi135 bash[69945]: ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-mgr-y 2024-09-10T22:38:48.649 DEBUG:teuthology.orchestra.run.smithi135:> sudo pkill -f 'journalctl -f -n 0 -u ceph-22997a4c-6fc2-11ef-bcea-c7b262605968@mgr.y.service' 2024-09-10T22:38:48.671 INFO:journalctl@ceph.mgr.y.smithi135.stdout:Sep 10 22:38:48 smithi135 podman[69957]: 2024-09-10 22:38:48.416419316 +0000 UTC m=+0.524625278 container remove 8155995dafc3bcc1e30e6fccc43c323869ac2534e1b1a00bf57e90d504fa3eb3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-mgr-y, ceph=True, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731) 2024-09-10T22:38:48.671 INFO:journalctl@ceph.mgr.y.smithi135.stdout:Sep 10 22:38:48 smithi135 systemd[1]: ceph-22997a4c-6fc2-11ef-bcea-c7b262605968@mgr.y.service: Main process exited, code=exited, status=143/n/a 2024-09-10T22:38:48.671 INFO:journalctl@ceph.mgr.y.smithi135.stdout:Sep 10 22:38:48 smithi135 systemd[1]: ceph-22997a4c-6fc2-11ef-bcea-c7b262605968@mgr.y.service: Failed with result 'exit-code'. 2024-09-10T22:38:48.671 INFO:journalctl@ceph.mgr.y.smithi135.stdout:Sep 10 22:38:48 smithi135 systemd[1]: Stopped Ceph mgr.y for 22997a4c-6fc2-11ef-bcea-c7b262605968. 2024-09-10T22:38:48.671 INFO:journalctl@ceph.mgr.y.smithi135.stdout:Sep 10 22:38:48 smithi135 systemd[1]: ceph-22997a4c-6fc2-11ef-bcea-c7b262605968@mgr.y.service: Consumed 7.163s CPU time. 2024-09-10T22:38:48.684 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-10T22:38:48.684 INFO:tasks.cephadm.mgr.y:Stopped mgr.y 2024-09-10T22:38:48.684 INFO:tasks.cephadm.mgr.z:Stopping mgr.z... 2024-09-10T22:38:48.684 DEBUG:teuthology.orchestra.run.smithi138:> sudo systemctl stop ceph-22997a4c-6fc2-11ef-bcea-c7b262605968@mgr.z 2024-09-10T22:38:49.003 INFO:journalctl@ceph.mgr.z.smithi138.stdout:Sep 10 22:38:48 smithi138 systemd[1]: Stopping Ceph mgr.z for 22997a4c-6fc2-11ef-bcea-c7b262605968... 2024-09-10T22:38:49.274 INFO:journalctl@ceph.mgr.z.smithi138.stdout:Sep 10 22:38:49 smithi138 podman[70866]: 2024-09-10 22:38:49.00214058 +0000 UTC m=+0.136940955 container died ecaaea115c2f2e3fe11342b12f5b022e493281ddbbb8da45d48cee5dec81c4db (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-mgr-z, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, ceph=True, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.build-date=20240731, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-10T22:38:49.525 INFO:journalctl@ceph.mgr.z.smithi138.stdout:Sep 10 22:38:49 smithi138 podman[70866]: 2024-09-10 22:38:49.347853254 +0000 UTC m=+0.482653628 container cleanup ecaaea115c2f2e3fe11342b12f5b022e493281ddbbb8da45d48cee5dec81c4db (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-mgr-z, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, ceph=True, GIT_BRANCH=HEAD, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2) 2024-09-10T22:38:49.525 INFO:journalctl@ceph.mgr.z.smithi138.stdout:Sep 10 22:38:49 smithi138 bash[70866]: ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-mgr-z 2024-09-10T22:38:49.763 DEBUG:teuthology.orchestra.run.smithi138:> sudo pkill -f 'journalctl -f -n 0 -u ceph-22997a4c-6fc2-11ef-bcea-c7b262605968@mgr.z.service' 2024-09-10T22:38:49.785 INFO:journalctl@ceph.mgr.z.smithi138.stdout:Sep 10 22:38:49 smithi138 podman[70879]: 2024-09-10 22:38:49.524243733 +0000 UTC m=+0.512504378 container remove ecaaea115c2f2e3fe11342b12f5b022e493281ddbbb8da45d48cee5dec81c4db (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-mgr-z, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-10T22:38:49.785 INFO:journalctl@ceph.mgr.z.smithi138.stdout:Sep 10 22:38:49 smithi138 systemd[1]: ceph-22997a4c-6fc2-11ef-bcea-c7b262605968@mgr.z.service: Main process exited, code=exited, status=143/n/a 2024-09-10T22:38:49.785 INFO:journalctl@ceph.mgr.z.smithi138.stdout:Sep 10 22:38:49 smithi138 systemd[1]: ceph-22997a4c-6fc2-11ef-bcea-c7b262605968@mgr.z.service: Failed with result 'exit-code'. 2024-09-10T22:38:49.785 INFO:journalctl@ceph.mgr.z.smithi138.stdout:Sep 10 22:38:49 smithi138 systemd[1]: Stopped Ceph mgr.z for 22997a4c-6fc2-11ef-bcea-c7b262605968. 2024-09-10T22:38:49.785 INFO:journalctl@ceph.mgr.z.smithi138.stdout:Sep 10 22:38:49 smithi138 systemd[1]: ceph-22997a4c-6fc2-11ef-bcea-c7b262605968@mgr.z.service: Consumed 7.014s CPU time. 2024-09-10T22:38:49.798 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-10T22:38:49.798 INFO:tasks.cephadm.mgr.z:Stopped mgr.z 2024-09-10T22:38:49.798 INFO:tasks.cephadm.osd.0:Stopping osd.0... 2024-09-10T22:38:49.798 DEBUG:teuthology.orchestra.run.smithi019:> sudo systemctl stop ceph-22997a4c-6fc2-11ef-bcea-c7b262605968@osd.0 2024-09-10T22:38:50.208 INFO:journalctl@ceph.osd.0.smithi019.stdout:Sep 10 22:38:49 smithi019 systemd[1]: Stopping Ceph osd.0 for 22997a4c-6fc2-11ef-bcea-c7b262605968... 2024-09-10T22:38:50.709 INFO:journalctl@ceph.osd.0.smithi019.stdout:Sep 10 22:38:50 smithi019 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-0[48194]: 2024-09-10T22:38:50.214+0000 7f6c50c34640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.0 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-10T22:38:50.799 INFO:journalctl@ceph.osd.0.smithi019.stdout:Sep 10 22:38:50 smithi019 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-0[48194]: 2024-09-10T22:38:50.214+0000 7f6c50c34640 -1 osd.0 80 *** Got signal Terminated *** 2024-09-10T22:38:50.799 INFO:journalctl@ceph.osd.0.smithi019.stdout:Sep 10 22:38:50 smithi019 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-0[48194]: 2024-09-10T22:38:50.214+0000 7f6c50c34640 -1 osd.0 80 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-10T22:39:05.842 INFO:journalctl@ceph.osd.0.smithi019.stdout:Sep 10 22:39:05 smithi019 podman[106321]: 2024-09-10 22:39:05.565808421 +0000 UTC m=+15.584694657 container died 8bef7f5ab25585ca93859ebdc9523b62e6ae489e580cb9b32dafd322f3730ef5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, ceph=True, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD) 2024-09-10T22:39:06.208 INFO:journalctl@ceph.osd.0.smithi019.stdout:Sep 10 22:39:06 smithi019 podman[106321]: 2024-09-10 22:39:06.065367316 +0000 UTC m=+16.084253554 container cleanup 8bef7f5ab25585ca93859ebdc9523b62e6ae489e580cb9b32dafd322f3730ef5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-0, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, ceph=True) 2024-09-10T22:39:06.209 INFO:journalctl@ceph.osd.0.smithi019.stdout:Sep 10 22:39:06 smithi019 bash[106321]: ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-0 2024-09-10T22:39:06.709 INFO:journalctl@ceph.osd.0.smithi019.stdout:Sep 10 22:39:06 smithi019 podman[106337]: 2024-09-10 22:39:06.40073068 +0000 UTC m=+0.832829977 container remove 8bef7f5ab25585ca93859ebdc9523b62e6ae489e580cb9b32dafd322f3730ef5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-0, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_CLEAN=True, io.buildah.version=1.37.2, ceph=True, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-10T22:39:07.072 INFO:journalctl@ceph.osd.0.smithi019.stdout:Sep 10 22:39:06 smithi019 podman[106426]: 2024-09-10 22:39:06.640746066 +0000 UTC m=+0.016315274 image pull 589dd18248e494ba411dc838aa4ae0e5e569213f08fcd7a2cf22cd3ef7e3c480 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e 2024-09-10T22:39:07.072 INFO:journalctl@ceph.osd.0.smithi019.stdout:Sep 10 22:39:06 smithi019 podman[106426]: 2024-09-10 22:39:06.75154128 +0000 UTC m=+0.127110480 container create a349574429006645d2e4c9a0d4c7637ca11b2a78843628132a0b90313efd4b01 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-0-deactivate, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_CLEAN=True, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4) 2024-09-10T22:39:07.072 INFO:journalctl@ceph.osd.0.smithi019.stdout:Sep 10 22:39:06 smithi019 podman[106426]: 2024-09-10 22:39:06.970739629 +0000 UTC m=+0.346308841 container init a349574429006645d2e4c9a0d4c7637ca11b2a78843628132a0b90313efd4b01 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-0-deactivate, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, maintainer=Guillaume Abrioux , RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.vendor=CentOS, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2) 2024-09-10T22:39:07.072 INFO:journalctl@ceph.osd.0.smithi019.stdout:Sep 10 22:39:06 smithi019 podman[106426]: 2024-09-10 22:39:06.974070509 +0000 UTC m=+0.349639711 container start a349574429006645d2e4c9a0d4c7637ca11b2a78843628132a0b90313efd4b01 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-0-deactivate, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-10T22:39:07.459 INFO:journalctl@ceph.osd.0.smithi019.stdout:Sep 10 22:39:07 smithi019 podman[106426]: 2024-09-10 22:39:07.070854828 +0000 UTC m=+0.446424048 container attach a349574429006645d2e4c9a0d4c7637ca11b2a78843628132a0b90313efd4b01 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-0-deactivate, io.buildah.version=1.37.2, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-10T22:39:07.459 INFO:journalctl@ceph.osd.0.smithi019.stdout:Sep 10 22:39:07 smithi019 podman[106426]: 2024-09-10 22:39:07.166058302 +0000 UTC m=+0.541627502 container died a349574429006645d2e4c9a0d4c7637ca11b2a78843628132a0b90313efd4b01 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-0-deactivate, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, ceph=True) 2024-09-10T22:39:07.802 DEBUG:teuthology.orchestra.run.smithi019:> sudo pkill -f 'journalctl -f -n 0 -u ceph-22997a4c-6fc2-11ef-bcea-c7b262605968@osd.0.service' 2024-09-10T22:39:07.846 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-10T22:39:07.846 INFO:tasks.cephadm.osd.0:Stopped osd.0 2024-09-10T22:39:07.847 INFO:tasks.cephadm.osd.1:Stopping osd.1... 2024-09-10T22:39:07.847 DEBUG:teuthology.orchestra.run.smithi135:> sudo systemctl stop ceph-22997a4c-6fc2-11ef-bcea-c7b262605968@osd.1 2024-09-10T22:39:08.170 INFO:journalctl@ceph.osd.1.smithi135.stdout:Sep 10 22:39:07 smithi135 systemd[1]: Stopping Ceph osd.1 for 22997a4c-6fc2-11ef-bcea-c7b262605968... 2024-09-10T22:39:08.445 INFO:journalctl@ceph.osd.1.smithi135.stdout:Sep 10 22:39:08 smithi135 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-1[39276]: 2024-09-10T22:39:08.309+0000 7f84f6bbe640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.1 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-10T22:39:08.445 INFO:journalctl@ceph.osd.1.smithi135.stdout:Sep 10 22:39:08 smithi135 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-1[39276]: 2024-09-10T22:39:08.309+0000 7f84f6bbe640 -1 osd.1 80 *** Got signal Terminated *** 2024-09-10T22:39:08.445 INFO:journalctl@ceph.osd.1.smithi135.stdout:Sep 10 22:39:08 smithi135 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-1[39276]: 2024-09-10T22:39:08.309+0000 7f84f6bbe640 -1 osd.1 80 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-10T22:39:14.112 INFO:journalctl@ceph.osd.1.smithi135.stdout:Sep 10 22:39:13 smithi135 podman[70072]: 2024-09-10 22:39:13.843731771 +0000 UTC m=+5.802103561 container died 9ec6f408f2dcc4c354238c3c55fc5d9bba3e6382b96e050351baed536fa964b8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-1, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, ceph=True, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux ) 2024-09-10T22:39:14.370 INFO:journalctl@ceph.osd.1.smithi135.stdout:Sep 10 22:39:14 smithi135 podman[70072]: 2024-09-10 22:39:14.185355199 +0000 UTC m=+6.143726990 container cleanup 9ec6f408f2dcc4c354238c3c55fc5d9bba3e6382b96e050351baed536fa964b8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-1, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2) 2024-09-10T22:39:14.370 INFO:journalctl@ceph.osd.1.smithi135.stdout:Sep 10 22:39:14 smithi135 bash[70072]: ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-1 2024-09-10T22:39:14.798 INFO:journalctl@ceph.osd.1.smithi135.stdout:Sep 10 22:39:14 smithi135 podman[70100]: 2024-09-10 22:39:14.369600889 +0000 UTC m=+0.516204677 container remove 9ec6f408f2dcc4c354238c3c55fc5d9bba3e6382b96e050351baed536fa964b8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-1, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-10T22:39:15.090 INFO:journalctl@ceph.osd.1.smithi135.stdout:Sep 10 22:39:14 smithi135 podman[70191]: 2024-09-10 22:39:14.700695945 +0000 UTC m=+0.015642462 image pull 589dd18248e494ba411dc838aa4ae0e5e569213f08fcd7a2cf22cd3ef7e3c480 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e 2024-09-10T22:39:15.090 INFO:journalctl@ceph.osd.1.smithi135.stdout:Sep 10 22:39:14 smithi135 podman[70191]: 2024-09-10 22:39:14.820361096 +0000 UTC m=+0.135307600 container create ccc901a796eec57396b1a6e05842415781015905edb2fcb418ac08181f1bf887 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-1-deactivate, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_CLEAN=True, ceph=True, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-10T22:39:15.090 INFO:journalctl@ceph.osd.1.smithi135.stdout:Sep 10 22:39:15 smithi135 podman[70191]: 2024-09-10 22:39:15.089524774 +0000 UTC m=+0.404471279 container init ccc901a796eec57396b1a6e05842415781015905edb2fcb418ac08181f1bf887 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-1-deactivate, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.license=GPLv2) 2024-09-10T22:39:15.343 INFO:journalctl@ceph.osd.1.smithi135.stdout:Sep 10 22:39:15 smithi135 podman[70191]: 2024-09-10 22:39:15.093161274 +0000 UTC m=+0.408107782 container start ccc901a796eec57396b1a6e05842415781015905edb2fcb418ac08181f1bf887 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-1-deactivate, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, ceph=True, GIT_CLEAN=True) 2024-09-10T22:39:15.343 INFO:journalctl@ceph.osd.1.smithi135.stdout:Sep 10 22:39:15 smithi135 podman[70191]: 2024-09-10 22:39:15.181170444 +0000 UTC m=+0.496116952 container attach ccc901a796eec57396b1a6e05842415781015905edb2fcb418ac08181f1bf887 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-1-deactivate, CEPH_POINT_RELEASE=, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-10T22:39:15.610 INFO:journalctl@ceph.osd.1.smithi135.stdout:Sep 10 22:39:15 smithi135 podman[70191]: 2024-09-10 22:39:15.342029635 +0000 UTC m=+0.656976162 container died ccc901a796eec57396b1a6e05842415781015905edb2fcb418ac08181f1bf887 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-1-deactivate, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_CLEAN=True, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2) 2024-09-10T22:39:15.935 DEBUG:teuthology.orchestra.run.smithi135:> sudo pkill -f 'journalctl -f -n 0 -u ceph-22997a4c-6fc2-11ef-bcea-c7b262605968@osd.1.service' 2024-09-10T22:39:15.977 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-10T22:39:15.977 INFO:tasks.cephadm.osd.1:Stopped osd.1 2024-09-10T22:39:15.977 INFO:tasks.cephadm.osd.2:Stopping osd.2... 2024-09-10T22:39:15.977 DEBUG:teuthology.orchestra.run.smithi138:> sudo systemctl stop ceph-22997a4c-6fc2-11ef-bcea-c7b262605968@osd.2 2024-09-10T22:39:16.270 INFO:journalctl@ceph.osd.2.smithi138.stdout:Sep 10 22:39:16 smithi138 systemd[1]: Stopping Ceph osd.2 for 22997a4c-6fc2-11ef-bcea-c7b262605968... 2024-09-10T22:39:16.625 INFO:journalctl@ceph.osd.2.smithi138.stdout:Sep 10 22:39:16 smithi138 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-2[40248]: 2024-09-10T22:39:16.267+0000 7f03afa02640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.2 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-10T22:39:16.625 INFO:journalctl@ceph.osd.2.smithi138.stdout:Sep 10 22:39:16 smithi138 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-2[40248]: 2024-09-10T22:39:16.267+0000 7f03afa02640 -1 osd.2 80 *** Got signal Terminated *** 2024-09-10T22:39:16.625 INFO:journalctl@ceph.osd.2.smithi138.stdout:Sep 10 22:39:16 smithi138 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-2[40248]: 2024-09-10T22:39:16.267+0000 7f03afa02640 -1 osd.2 80 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-10T22:39:22.036 INFO:journalctl@ceph.osd.2.smithi138.stdout:Sep 10 22:39:21 smithi138 podman[71001]: 2024-09-10 22:39:21.755526019 +0000 UTC m=+5.584004413 container died 2b2baac2436cdab4959105e90e9e1e1be5901bd1003ba2705ca94264f73ce254 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-2, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, io.buildah.version=1.37.2) 2024-09-10T22:39:22.375 INFO:journalctl@ceph.osd.2.smithi138.stdout:Sep 10 22:39:22 smithi138 podman[71001]: 2024-09-10 22:39:22.109044295 +0000 UTC m=+5.937522688 container cleanup 2b2baac2436cdab4959105e90e9e1e1be5901bd1003ba2705ca94264f73ce254 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-2, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=) 2024-09-10T22:39:22.375 INFO:journalctl@ceph.osd.2.smithi138.stdout:Sep 10 22:39:22 smithi138 bash[71001]: ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-2 2024-09-10T22:39:22.728 INFO:journalctl@ceph.osd.2.smithi138.stdout:Sep 10 22:39:22 smithi138 podman[71016]: 2024-09-10 22:39:22.401993509 +0000 UTC m=+0.639776893 container remove 2b2baac2436cdab4959105e90e9e1e1be5901bd1003ba2705ca94264f73ce254 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-2, io.buildah.version=1.37.2, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_BRANCH=HEAD, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731) 2024-09-10T22:39:23.056 INFO:journalctl@ceph.osd.2.smithi138.stdout:Sep 10 22:39:22 smithi138 podman[71102]: 2024-09-10 22:39:22.629903403 +0000 UTC m=+0.016454868 image pull 589dd18248e494ba411dc838aa4ae0e5e569213f08fcd7a2cf22cd3ef7e3c480 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e 2024-09-10T22:39:23.057 INFO:journalctl@ceph.osd.2.smithi138.stdout:Sep 10 22:39:22 smithi138 podman[71102]: 2024-09-10 22:39:22.736148203 +0000 UTC m=+0.122699701 container create d1c535239da3585a6a8ef5368aec6ff98b61457f67395f7d7c3fa80dc2357a02 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-2-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_CLEAN=True, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux ) 2024-09-10T22:39:23.057 INFO:journalctl@ceph.osd.2.smithi138.stdout:Sep 10 22:39:22 smithi138 podman[71102]: 2024-09-10 22:39:22.955850638 +0000 UTC m=+0.342402098 container init d1c535239da3585a6a8ef5368aec6ff98b61457f67395f7d7c3fa80dc2357a02 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-2-deactivate, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, ceph=True, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.build-date=20240731) 2024-09-10T22:39:23.057 INFO:journalctl@ceph.osd.2.smithi138.stdout:Sep 10 22:39:22 smithi138 podman[71102]: 2024-09-10 22:39:22.959205913 +0000 UTC m=+0.345757372 container start d1c535239da3585a6a8ef5368aec6ff98b61457f67395f7d7c3fa80dc2357a02 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-2-deactivate, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, ceph=True, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD) 2024-09-10T22:39:23.057 INFO:journalctl@ceph.osd.2.smithi138.stdout:Sep 10 22:39:23 smithi138 podman[71102]: 2024-09-10 22:39:23.055266506 +0000 UTC m=+0.441817963 container attach d1c535239da3585a6a8ef5368aec6ff98b61457f67395f7d7c3fa80dc2357a02 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-2-deactivate, CEPH_POINT_RELEASE=, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_CLEAN=True, io.buildah.version=1.37.2) 2024-09-10T22:39:23.329 INFO:journalctl@ceph.osd.2.smithi138.stdout:Sep 10 22:39:23 smithi138 podman[71102]: 2024-09-10 22:39:23.162454005 +0000 UTC m=+0.549005463 container died d1c535239da3585a6a8ef5368aec6ff98b61457f67395f7d7c3fa80dc2357a02 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-2-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, ceph=True, GIT_BRANCH=HEAD) 2024-09-10T22:39:23.755 DEBUG:teuthology.orchestra.run.smithi138:> sudo pkill -f 'journalctl -f -n 0 -u ceph-22997a4c-6fc2-11ef-bcea-c7b262605968@osd.2.service' 2024-09-10T22:39:23.794 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-10T22:39:23.794 INFO:tasks.cephadm.osd.2:Stopped osd.2 2024-09-10T22:39:23.794 INFO:tasks.cephadm.osd.3:Stopping osd.3... 2024-09-10T22:39:23.794 DEBUG:teuthology.orchestra.run.smithi019:> sudo systemctl stop ceph-22997a4c-6fc2-11ef-bcea-c7b262605968@osd.3 2024-09-10T22:39:24.130 INFO:journalctl@ceph.osd.3.smithi019.stdout:Sep 10 22:39:23 smithi019 systemd[1]: Stopping Ceph osd.3 for 22997a4c-6fc2-11ef-bcea-c7b262605968... 2024-09-10T22:39:24.397 INFO:journalctl@ceph.osd.3.smithi019.stdout:Sep 10 22:39:24 smithi019 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-3[55077]: 2024-09-10T22:39:24.126+0000 7f09f47aa640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.3 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-10T22:39:24.397 INFO:journalctl@ceph.osd.3.smithi019.stdout:Sep 10 22:39:24 smithi019 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-3[55077]: 2024-09-10T22:39:24.126+0000 7f09f47aa640 -1 osd.3 80 *** Got signal Terminated *** 2024-09-10T22:39:24.397 INFO:journalctl@ceph.osd.3.smithi019.stdout:Sep 10 22:39:24 smithi019 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-3[55077]: 2024-09-10T22:39:24.126+0000 7f09f47aa640 -1 osd.3 80 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-10T22:39:26.375 INFO:journalctl@ceph.osd.11.smithi138.stdout:Sep 10 22:39:25 smithi138 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-11[60796]: 2024-09-10T22:39:25.997+0000 7ffb00998640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-10T22:38:51.541208+0000 front 2024-09-10T22:38:51.541072+0000 (oldest deadline 2024-09-10T22:39:25.843622+0000) 2024-09-10T22:39:27.110 INFO:journalctl@ceph.osd.4.smithi135.stdout:Sep 10 22:39:26 smithi135 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-4[46199]: 2024-09-10T22:39:26.742+0000 7fdc241ed640 -1 osd.4 80 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-10T22:38:54.693661+0000 front 2024-09-10T22:38:54.693591+0000 (oldest deadline 2024-09-10T22:39:26.394521+0000) 2024-09-10T22:39:27.110 INFO:journalctl@ceph.osd.10.smithi135.stdout:Sep 10 22:39:26 smithi135 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-10[59985]: 2024-09-10T22:39:26.901+0000 7f3bf1a69640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-10T22:38:54.201226+0000 front 2024-09-10T22:38:54.201244+0000 (oldest deadline 2024-09-10T22:39:26.502183+0000) 2024-09-10T22:39:27.276 INFO:journalctl@ceph.osd.11.smithi138.stdout:Sep 10 22:39:26 smithi138 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-11[60796]: 2024-09-10T22:39:26.980+0000 7ffb00998640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-10T22:38:51.541208+0000 front 2024-09-10T22:38:51.541072+0000 (oldest deadline 2024-09-10T22:39:25.843622+0000) 2024-09-10T22:39:27.277 INFO:journalctl@ceph.osd.5.smithi138.stdout:Sep 10 22:39:26 smithi138 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-5[46984]: 2024-09-10T22:39:26.966+0000 7fa875fd8640 -1 osd.5 80 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-10T22:38:55.013982+0000 front 2024-09-10T22:38:55.013953+0000 (oldest deadline 2024-09-10T22:39:26.214626+0000) 2024-09-10T22:39:27.952 INFO:journalctl@ceph.osd.4.smithi135.stdout:Sep 10 22:39:27 smithi135 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-4[46199]: 2024-09-10T22:39:27.698+0000 7fdc241ed640 -1 osd.4 80 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-10T22:38:54.693661+0000 front 2024-09-10T22:38:54.693591+0000 (oldest deadline 2024-09-10T22:39:26.394521+0000) 2024-09-10T22:39:28.209 INFO:journalctl@ceph.osd.6.smithi019.stdout:Sep 10 22:39:28 smithi019 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-6[61536]: 2024-09-10T22:39:28.035+0000 7fbecfbb3640 -1 osd.6 80 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-10T22:38:50.981820+0000 front 2024-09-10T22:38:50.981842+0000 (oldest deadline 2024-09-10T22:39:27.183928+0000) 2024-09-10T22:39:28.209 INFO:journalctl@ceph.osd.9.smithi019.stdout:Sep 10 22:39:27 smithi019 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-9[68022]: 2024-09-10T22:39:27.843+0000 7fa3f61d4640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-10T22:38:54.917764+0000 front 2024-09-10T22:38:54.917786+0000 (oldest deadline 2024-09-10T22:39:27.019686+0000) 2024-09-10T22:39:28.359 INFO:journalctl@ceph.osd.10.smithi135.stdout:Sep 10 22:39:27 smithi135 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-10[59985]: 2024-09-10T22:39:27.951+0000 7f3bf1a69640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-10T22:38:54.201226+0000 front 2024-09-10T22:38:54.201244+0000 (oldest deadline 2024-09-10T22:39:26.502183+0000) 2024-09-10T22:39:28.375 INFO:journalctl@ceph.osd.5.smithi138.stdout:Sep 10 22:39:27 smithi138 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-5[46984]: 2024-09-10T22:39:27.920+0000 7fa875fd8640 -1 osd.5 80 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-10T22:38:55.013982+0000 front 2024-09-10T22:38:55.013953+0000 (oldest deadline 2024-09-10T22:39:26.214626+0000) 2024-09-10T22:39:28.375 INFO:journalctl@ceph.osd.11.smithi138.stdout:Sep 10 22:39:27 smithi138 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-11[60796]: 2024-09-10T22:39:27.982+0000 7ffb00998640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-10T22:38:51.541208+0000 front 2024-09-10T22:38:51.541072+0000 (oldest deadline 2024-09-10T22:39:25.843622+0000) 2024-09-10T22:39:29.109 INFO:journalctl@ceph.osd.4.smithi135.stdout:Sep 10 22:39:28 smithi135 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-4[46199]: 2024-09-10T22:39:28.729+0000 7fdc241ed640 -1 osd.4 80 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-10T22:38:54.693661+0000 front 2024-09-10T22:38:54.693591+0000 (oldest deadline 2024-09-10T22:39:26.394521+0000) 2024-09-10T22:39:29.110 INFO:journalctl@ceph.osd.10.smithi135.stdout:Sep 10 22:39:28 smithi135 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-10[59985]: 2024-09-10T22:39:28.952+0000 7f3bf1a69640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-10T22:38:54.201226+0000 front 2024-09-10T22:38:54.201244+0000 (oldest deadline 2024-09-10T22:39:26.502183+0000) 2024-09-10T22:39:29.208 INFO:journalctl@ceph.osd.6.smithi019.stdout:Sep 10 22:39:29 smithi019 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-6[61536]: 2024-09-10T22:39:29.055+0000 7fbecfbb3640 -1 osd.6 80 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-10T22:38:50.981820+0000 front 2024-09-10T22:38:50.981842+0000 (oldest deadline 2024-09-10T22:39:27.183928+0000) 2024-09-10T22:39:29.209 INFO:journalctl@ceph.osd.9.smithi019.stdout:Sep 10 22:39:28 smithi019 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-9[68022]: 2024-09-10T22:39:28.822+0000 7fa3f61d4640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-10T22:38:54.917764+0000 front 2024-09-10T22:38:54.917786+0000 (oldest deadline 2024-09-10T22:39:27.019686+0000) 2024-09-10T22:39:29.375 INFO:journalctl@ceph.osd.5.smithi138.stdout:Sep 10 22:39:28 smithi138 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-5[46984]: 2024-09-10T22:39:28.906+0000 7fa875fd8640 -1 osd.5 80 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-10T22:38:55.013982+0000 front 2024-09-10T22:38:55.013953+0000 (oldest deadline 2024-09-10T22:39:26.214626+0000) 2024-09-10T22:39:29.375 INFO:journalctl@ceph.osd.11.smithi138.stdout:Sep 10 22:39:29 smithi138 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-11[60796]: 2024-09-10T22:39:29.029+0000 7ffb00998640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-10T22:38:51.541208+0000 front 2024-09-10T22:38:51.541072+0000 (oldest deadline 2024-09-10T22:39:25.843622+0000) 2024-09-10T22:39:29.959 INFO:journalctl@ceph.osd.3.smithi019.stdout:Sep 10 22:39:29 smithi019 podman[106527]: 2024-09-10 22:39:29.611265856 +0000 UTC m=+5.615905547 container died 983ff26efd84888aa46c68fbe9120696cc637ce607a95c76cd38bfc3be4de31c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-3, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, ceph=True, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0) 2024-09-10T22:39:29.959 INFO:journalctl@ceph.osd.9.smithi019.stdout:Sep 10 22:39:29 smithi019 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-9[68022]: 2024-09-10T22:39:29.790+0000 7fa3f61d4640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-10T22:38:54.917764+0000 front 2024-09-10T22:38:54.917786+0000 (oldest deadline 2024-09-10T22:39:27.019686+0000) 2024-09-10T22:39:30.110 INFO:journalctl@ceph.osd.4.smithi135.stdout:Sep 10 22:39:29 smithi135 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-4[46199]: 2024-09-10T22:39:29.732+0000 7fdc241ed640 -1 osd.4 80 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-10T22:38:54.693661+0000 front 2024-09-10T22:38:54.693591+0000 (oldest deadline 2024-09-10T22:39:26.394521+0000) 2024-09-10T22:39:30.110 INFO:journalctl@ceph.osd.10.smithi135.stdout:Sep 10 22:39:29 smithi135 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-10[59985]: 2024-09-10T22:39:29.910+0000 7f3bf1a69640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-10T22:38:54.201226+0000 front 2024-09-10T22:38:54.201244+0000 (oldest deadline 2024-09-10T22:39:26.502183+0000) 2024-09-10T22:39:30.125 INFO:journalctl@ceph.osd.5.smithi138.stdout:Sep 10 22:39:29 smithi138 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-5[46984]: 2024-09-10T22:39:29.857+0000 7fa875fd8640 -1 osd.5 80 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-10T22:38:55.013982+0000 front 2024-09-10T22:38:55.013953+0000 (oldest deadline 2024-09-10T22:39:26.214626+0000) 2024-09-10T22:39:30.125 INFO:journalctl@ceph.osd.11.smithi138.stdout:Sep 10 22:39:29 smithi138 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-11[60796]: 2024-09-10T22:39:29.993+0000 7ffb00998640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-10T22:38:51.541208+0000 front 2024-09-10T22:38:51.541072+0000 (oldest deadline 2024-09-10T22:39:25.843622+0000) 2024-09-10T22:39:30.458 INFO:journalctl@ceph.osd.6.smithi019.stdout:Sep 10 22:39:30 smithi019 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-6[61536]: 2024-09-10T22:39:30.052+0000 7fbecfbb3640 -1 osd.6 80 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-10T22:38:50.981820+0000 front 2024-09-10T22:38:50.981842+0000 (oldest deadline 2024-09-10T22:39:27.183928+0000) 2024-09-10T22:39:30.459 INFO:journalctl@ceph.osd.3.smithi019.stdout:Sep 10 22:39:30 smithi019 podman[106527]: 2024-09-10 22:39:30.210088962 +0000 UTC m=+6.214728652 container cleanup 983ff26efd84888aa46c68fbe9120696cc637ce607a95c76cd38bfc3be4de31c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-3, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.schema-version=1.0, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2) 2024-09-10T22:39:30.459 INFO:journalctl@ceph.osd.3.smithi019.stdout:Sep 10 22:39:30 smithi019 bash[106527]: ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-3 2024-09-10T22:39:30.749 INFO:journalctl@ceph.osd.3.smithi019.stdout:Sep 10 22:39:30 smithi019 podman[106558]: 2024-09-10 22:39:30.486656561 +0000 UTC m=+0.870376662 container remove 983ff26efd84888aa46c68fbe9120696cc637ce607a95c76cd38bfc3be4de31c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-3, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4) 2024-09-10T22:39:31.101 INFO:journalctl@ceph.osd.9.smithi019.stdout:Sep 10 22:39:30 smithi019 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-9[68022]: 2024-09-10T22:39:30.747+0000 7fa3f61d4640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-10T22:38:54.917764+0000 front 2024-09-10T22:38:54.917786+0000 (oldest deadline 2024-09-10T22:39:27.019686+0000) 2024-09-10T22:39:31.101 INFO:journalctl@ceph.osd.3.smithi019.stdout:Sep 10 22:39:30 smithi019 podman[106645]: 2024-09-10 22:39:30.748113527 +0000 UTC m=+0.017282761 image pull 589dd18248e494ba411dc838aa4ae0e5e569213f08fcd7a2cf22cd3ef7e3c480 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e 2024-09-10T22:39:31.101 INFO:journalctl@ceph.osd.3.smithi019.stdout:Sep 10 22:39:30 smithi019 podman[106645]: 2024-09-10 22:39:30.845843965 +0000 UTC m=+0.115013187 container create 6852b0ff33f72212441f9a1fbcd9a738c26029c488d326fdbe24aa694610a741 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-3-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.license=GPLv2, ceph=True, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True) 2024-09-10T22:39:31.110 INFO:journalctl@ceph.osd.10.smithi135.stdout:Sep 10 22:39:30 smithi135 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-10[59985]: 2024-09-10T22:39:30.923+0000 7f3bf1a69640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-10T22:38:54.201226+0000 front 2024-09-10T22:38:54.201244+0000 (oldest deadline 2024-09-10T22:39:26.502183+0000) 2024-09-10T22:39:31.110 INFO:journalctl@ceph.osd.4.smithi135.stdout:Sep 10 22:39:30 smithi135 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-4[46199]: 2024-09-10T22:39:30.691+0000 7fdc241ed640 -1 osd.4 80 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-10T22:38:54.693661+0000 front 2024-09-10T22:38:54.693591+0000 (oldest deadline 2024-09-10T22:39:26.394521+0000) 2024-09-10T22:39:31.375 INFO:journalctl@ceph.osd.5.smithi138.stdout:Sep 10 22:39:30 smithi138 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-5[46984]: 2024-09-10T22:39:30.906+0000 7fa875fd8640 -1 osd.5 80 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-10T22:38:55.013982+0000 front 2024-09-10T22:38:55.013953+0000 (oldest deadline 2024-09-10T22:39:26.214626+0000) 2024-09-10T22:39:31.375 INFO:journalctl@ceph.osd.11.smithi138.stdout:Sep 10 22:39:31 smithi138 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-11[60796]: 2024-09-10T22:39:31.040+0000 7ffb00998640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-10T22:38:51.541208+0000 front 2024-09-10T22:38:51.541072+0000 (oldest deadline 2024-09-10T22:39:25.843622+0000) 2024-09-10T22:39:31.459 INFO:journalctl@ceph.osd.6.smithi019.stdout:Sep 10 22:39:31 smithi019 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-6[61536]: 2024-09-10T22:39:31.099+0000 7fbecfbb3640 -1 osd.6 80 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-10T22:38:50.981820+0000 front 2024-09-10T22:38:50.981842+0000 (oldest deadline 2024-09-10T22:39:27.183928+0000) 2024-09-10T22:39:31.459 INFO:journalctl@ceph.osd.3.smithi019.stdout:Sep 10 22:39:31 smithi019 podman[106645]: 2024-09-10 22:39:31.114787319 +0000 UTC m=+0.383956556 container init 6852b0ff33f72212441f9a1fbcd9a738c26029c488d326fdbe24aa694610a741 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-3-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, ceph=True, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-10T22:39:31.459 INFO:journalctl@ceph.osd.3.smithi019.stdout:Sep 10 22:39:31 smithi019 podman[106645]: 2024-09-10 22:39:31.118932335 +0000 UTC m=+0.388101564 container start 6852b0ff33f72212441f9a1fbcd9a738c26029c488d326fdbe24aa694610a741 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-3-deactivate, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, ceph=True, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-10T22:39:31.459 INFO:journalctl@ceph.osd.3.smithi019.stdout:Sep 10 22:39:31 smithi019 podman[106645]: 2024-09-10 22:39:31.231962659 +0000 UTC m=+0.501131883 container attach 6852b0ff33f72212441f9a1fbcd9a738c26029c488d326fdbe24aa694610a741 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-3-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, GIT_CLEAN=True, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2) 2024-09-10T22:39:31.459 INFO:journalctl@ceph.osd.3.smithi019.stdout:Sep 10 22:39:31 smithi019 podman[106645]: 2024-09-10 22:39:31.316280671 +0000 UTC m=+0.585449898 container died 6852b0ff33f72212441f9a1fbcd9a738c26029c488d326fdbe24aa694610a741 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-3-deactivate, io.buildah.version=1.37.2, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_CLEAN=True) 2024-09-10T22:39:32.053 INFO:journalctl@ceph.osd.9.smithi019.stdout:Sep 10 22:39:31 smithi019 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-9[68022]: 2024-09-10T22:39:31.759+0000 7fa3f61d4640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-10T22:38:54.917764+0000 front 2024-09-10T22:38:54.917786+0000 (oldest deadline 2024-09-10T22:39:27.019686+0000) 2024-09-10T22:39:32.073 DEBUG:teuthology.orchestra.run.smithi019:> sudo pkill -f 'journalctl -f -n 0 -u ceph-22997a4c-6fc2-11ef-bcea-c7b262605968@osd.3.service' 2024-09-10T22:39:32.110 INFO:journalctl@ceph.osd.10.smithi135.stdout:Sep 10 22:39:31 smithi135 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-10[59985]: 2024-09-10T22:39:31.909+0000 7f3bf1a69640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-10T22:38:54.201226+0000 front 2024-09-10T22:38:54.201244+0000 (oldest deadline 2024-09-10T22:39:26.502183+0000) 2024-09-10T22:39:32.110 INFO:journalctl@ceph.osd.4.smithi135.stdout:Sep 10 22:39:31 smithi135 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-4[46199]: 2024-09-10T22:39:31.687+0000 7fdc241ed640 -1 osd.4 80 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-10T22:38:54.693661+0000 front 2024-09-10T22:38:54.693591+0000 (oldest deadline 2024-09-10T22:39:26.394521+0000) 2024-09-10T22:39:32.120 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-10T22:39:32.120 INFO:tasks.cephadm.osd.3:Stopped osd.3 2024-09-10T22:39:32.120 INFO:tasks.cephadm.osd.4:Stopping osd.4... 2024-09-10T22:39:32.121 DEBUG:teuthology.orchestra.run.smithi135:> sudo systemctl stop ceph-22997a4c-6fc2-11ef-bcea-c7b262605968@osd.4 2024-09-10T22:39:32.125 INFO:journalctl@ceph.osd.5.smithi138.stdout:Sep 10 22:39:31 smithi138 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-5[46984]: 2024-09-10T22:39:31.864+0000 7fa875fd8640 -1 osd.5 80 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-10T22:38:55.013982+0000 front 2024-09-10T22:38:55.013953+0000 (oldest deadline 2024-09-10T22:39:26.214626+0000) 2024-09-10T22:39:32.125 INFO:journalctl@ceph.osd.11.smithi138.stdout:Sep 10 22:39:32 smithi138 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-11[60796]: 2024-09-10T22:39:32.081+0000 7ffb00998640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-10T22:38:51.541208+0000 front 2024-09-10T22:38:51.541072+0000 (oldest deadline 2024-09-10T22:39:25.843622+0000) 2024-09-10T22:39:32.414 INFO:journalctl@ceph.osd.4.smithi135.stdout:Sep 10 22:39:32 smithi135 systemd[1]: Stopping Ceph osd.4 for 22997a4c-6fc2-11ef-bcea-c7b262605968... 2024-09-10T22:39:32.414 INFO:journalctl@ceph.osd.4.smithi135.stdout:Sep 10 22:39:32 smithi135 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-4[46199]: 2024-09-10T22:39:32.412+0000 7fdc27bd8640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.4 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-10T22:39:32.458 INFO:journalctl@ceph.osd.6.smithi019.stdout:Sep 10 22:39:32 smithi019 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-6[61536]: 2024-09-10T22:39:32.084+0000 7fbecfbb3640 -1 osd.6 80 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-10T22:38:50.981820+0000 front 2024-09-10T22:38:50.981842+0000 (oldest deadline 2024-09-10T22:39:27.183928+0000) 2024-09-10T22:39:32.735 INFO:journalctl@ceph.osd.4.smithi135.stdout:Sep 10 22:39:32 smithi135 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-4[46199]: 2024-09-10T22:39:32.412+0000 7fdc27bd8640 -1 osd.4 80 *** Got signal Terminated *** 2024-09-10T22:39:32.735 INFO:journalctl@ceph.osd.4.smithi135.stdout:Sep 10 22:39:32 smithi135 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-4[46199]: 2024-09-10T22:39:32.412+0000 7fdc27bd8640 -1 osd.4 80 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-10T22:39:33.040 INFO:journalctl@ceph.osd.9.smithi019.stdout:Sep 10 22:39:32 smithi019 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-9[68022]: 2024-09-10T22:39:32.736+0000 7fa3f61d4640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-10T22:38:54.917764+0000 front 2024-09-10T22:38:54.917786+0000 (oldest deadline 2024-09-10T22:39:27.019686+0000) 2024-09-10T22:39:33.110 INFO:journalctl@ceph.osd.10.smithi135.stdout:Sep 10 22:39:32 smithi135 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-10[59985]: 2024-09-10T22:39:32.932+0000 7f3bf1a69640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-10T22:38:54.201226+0000 front 2024-09-10T22:38:54.201244+0000 (oldest deadline 2024-09-10T22:39:26.502183+0000) 2024-09-10T22:39:33.110 INFO:journalctl@ceph.osd.4.smithi135.stdout:Sep 10 22:39:32 smithi135 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-4[46199]: 2024-09-10T22:39:32.733+0000 7fdc241ed640 -1 osd.4 80 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-10T22:38:54.693661+0000 front 2024-09-10T22:38:54.693591+0000 (oldest deadline 2024-09-10T22:39:26.394521+0000) 2024-09-10T22:39:33.375 INFO:journalctl@ceph.osd.5.smithi138.stdout:Sep 10 22:39:32 smithi138 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-5[46984]: 2024-09-10T22:39:32.913+0000 7fa875fd8640 -1 osd.5 80 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-10T22:38:55.013982+0000 front 2024-09-10T22:38:55.013953+0000 (oldest deadline 2024-09-10T22:39:26.214626+0000) 2024-09-10T22:39:33.375 INFO:journalctl@ceph.osd.11.smithi138.stdout:Sep 10 22:39:33 smithi138 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-11[60796]: 2024-09-10T22:39:33.078+0000 7ffb00998640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-10T22:38:51.541208+0000 front 2024-09-10T22:38:51.541072+0000 (oldest deadline 2024-09-10T22:39:25.843622+0000) 2024-09-10T22:39:33.458 INFO:journalctl@ceph.osd.6.smithi019.stdout:Sep 10 22:39:33 smithi019 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-6[61536]: 2024-09-10T22:39:33.039+0000 7fbecfbb3640 -1 osd.6 80 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-10T22:38:50.981820+0000 front 2024-09-10T22:38:50.981842+0000 (oldest deadline 2024-09-10T22:39:27.183928+0000) 2024-09-10T22:39:34.066 INFO:journalctl@ceph.osd.9.smithi019.stdout:Sep 10 22:39:33 smithi019 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-9[68022]: 2024-09-10T22:39:33.750+0000 7fa3f61d4640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-10T22:38:54.917764+0000 front 2024-09-10T22:38:54.917786+0000 (oldest deadline 2024-09-10T22:39:27.019686+0000) 2024-09-10T22:39:34.110 INFO:journalctl@ceph.osd.10.smithi135.stdout:Sep 10 22:39:33 smithi135 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-10[59985]: 2024-09-10T22:39:33.935+0000 7f3bf1a69640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-10T22:38:54.201226+0000 front 2024-09-10T22:38:54.201244+0000 (oldest deadline 2024-09-10T22:39:26.502183+0000) 2024-09-10T22:39:34.110 INFO:journalctl@ceph.osd.4.smithi135.stdout:Sep 10 22:39:33 smithi135 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-4[46199]: 2024-09-10T22:39:33.712+0000 7fdc241ed640 -1 osd.4 80 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-10T22:38:54.693661+0000 front 2024-09-10T22:38:54.693591+0000 (oldest deadline 2024-09-10T22:39:26.394521+0000) 2024-09-10T22:39:34.125 INFO:journalctl@ceph.osd.5.smithi138.stdout:Sep 10 22:39:33 smithi138 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-5[46984]: 2024-09-10T22:39:33.864+0000 7fa875fd8640 -1 osd.5 80 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-10T22:38:55.013982+0000 front 2024-09-10T22:38:55.013953+0000 (oldest deadline 2024-09-10T22:39:26.214626+0000) 2024-09-10T22:39:34.125 INFO:journalctl@ceph.osd.11.smithi138.stdout:Sep 10 22:39:34 smithi138 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-11[60796]: 2024-09-10T22:39:34.047+0000 7ffb00998640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-10T22:38:51.541208+0000 front 2024-09-10T22:38:51.541072+0000 (oldest deadline 2024-09-10T22:39:25.843622+0000) 2024-09-10T22:39:34.458 INFO:journalctl@ceph.osd.6.smithi019.stdout:Sep 10 22:39:34 smithi019 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-6[61536]: 2024-09-10T22:39:34.065+0000 7fbecfbb3640 -1 osd.6 80 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-10T22:38:50.981820+0000 front 2024-09-10T22:38:50.981842+0000 (oldest deadline 2024-09-10T22:39:27.183928+0000) 2024-09-10T22:39:34.459 INFO:journalctl@ceph.osd.6.smithi019.stdout:Sep 10 22:39:34 smithi019 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-6[61536]: 2024-09-10T22:39:34.065+0000 7fbecfbb3640 -1 osd.6 80 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2024-09-10T22:39:10.486176+0000 front 2024-09-10T22:39:10.486246+0000 (oldest deadline 2024-09-10T22:39:33.886409+0000) 2024-09-10T22:39:35.049 INFO:journalctl@ceph.osd.9.smithi019.stdout:Sep 10 22:39:34 smithi019 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-9[68022]: 2024-09-10T22:39:34.733+0000 7fa3f61d4640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-10T22:38:54.917764+0000 front 2024-09-10T22:38:54.917786+0000 (oldest deadline 2024-09-10T22:39:27.019686+0000) 2024-09-10T22:39:35.110 INFO:journalctl@ceph.osd.10.smithi135.stdout:Sep 10 22:39:34 smithi135 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-10[59985]: 2024-09-10T22:39:34.974+0000 7f3bf1a69640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-10T22:38:54.201226+0000 front 2024-09-10T22:38:54.201244+0000 (oldest deadline 2024-09-10T22:39:26.502183+0000) 2024-09-10T22:39:35.110 INFO:journalctl@ceph.osd.4.smithi135.stdout:Sep 10 22:39:34 smithi135 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-4[46199]: 2024-09-10T22:39:34.739+0000 7fdc241ed640 -1 osd.4 80 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-10T22:38:54.693661+0000 front 2024-09-10T22:38:54.693591+0000 (oldest deadline 2024-09-10T22:39:26.394521+0000) 2024-09-10T22:39:35.125 INFO:journalctl@ceph.osd.11.smithi138.stdout:Sep 10 22:39:35 smithi138 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-11[60796]: 2024-09-10T22:39:35.040+0000 7ffb00998640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-10T22:38:51.541208+0000 front 2024-09-10T22:38:51.541072+0000 (oldest deadline 2024-09-10T22:39:25.843622+0000) 2024-09-10T22:39:35.125 INFO:journalctl@ceph.osd.5.smithi138.stdout:Sep 10 22:39:34 smithi138 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-5[46984]: 2024-09-10T22:39:34.844+0000 7fa875fd8640 -1 osd.5 80 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-10T22:38:55.013982+0000 front 2024-09-10T22:38:55.013953+0000 (oldest deadline 2024-09-10T22:39:26.214626+0000) 2024-09-10T22:39:35.458 INFO:journalctl@ceph.osd.6.smithi019.stdout:Sep 10 22:39:35 smithi019 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-6[61536]: 2024-09-10T22:39:35.048+0000 7fbecfbb3640 -1 osd.6 80 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-10T22:38:50.981820+0000 front 2024-09-10T22:38:50.981842+0000 (oldest deadline 2024-09-10T22:39:27.183928+0000) 2024-09-10T22:39:35.458 INFO:journalctl@ceph.osd.6.smithi019.stdout:Sep 10 22:39:35 smithi019 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-6[61536]: 2024-09-10T22:39:35.048+0000 7fbecfbb3640 -1 osd.6 80 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2024-09-10T22:39:10.486176+0000 front 2024-09-10T22:39:10.486246+0000 (oldest deadline 2024-09-10T22:39:33.886409+0000) 2024-09-10T22:39:36.110 INFO:journalctl@ceph.osd.10.smithi135.stdout:Sep 10 22:39:35 smithi135 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-10[59985]: 2024-09-10T22:39:35.987+0000 7f3bf1a69640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-10T22:38:54.201226+0000 front 2024-09-10T22:38:54.201244+0000 (oldest deadline 2024-09-10T22:39:26.502183+0000) 2024-09-10T22:39:36.110 INFO:journalctl@ceph.osd.4.smithi135.stdout:Sep 10 22:39:35 smithi135 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-4[46199]: 2024-09-10T22:39:35.768+0000 7fdc241ed640 -1 osd.4 80 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-10T22:38:54.693661+0000 front 2024-09-10T22:38:54.693591+0000 (oldest deadline 2024-09-10T22:39:26.394521+0000) 2024-09-10T22:39:36.125 INFO:journalctl@ceph.osd.11.smithi138.stdout:Sep 10 22:39:36 smithi138 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-11[60796]: 2024-09-10T22:39:36.006+0000 7ffb00998640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-10T22:38:51.541208+0000 front 2024-09-10T22:38:51.541072+0000 (oldest deadline 2024-09-10T22:39:25.843622+0000) 2024-09-10T22:39:36.125 INFO:journalctl@ceph.osd.11.smithi138.stdout:Sep 10 22:39:36 smithi138 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-11[60796]: 2024-09-10T22:39:36.006+0000 7ffb00998640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2024-09-10T22:39:09.245148+0000 front 2024-09-10T22:39:09.245118+0000 (oldest deadline 2024-09-10T22:39:35.046015+0000) 2024-09-10T22:39:36.125 INFO:journalctl@ceph.osd.5.smithi138.stdout:Sep 10 22:39:35 smithi138 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-5[46984]: 2024-09-10T22:39:35.863+0000 7fa875fd8640 -1 osd.5 80 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-10T22:38:55.013982+0000 front 2024-09-10T22:38:55.013953+0000 (oldest deadline 2024-09-10T22:39:26.214626+0000) 2024-09-10T22:39:36.126 INFO:journalctl@ceph.osd.5.smithi138.stdout:Sep 10 22:39:35 smithi138 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-5[46984]: 2024-09-10T22:39:35.863+0000 7fa875fd8640 -1 osd.5 80 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2024-09-10T22:39:10.315703+0000 front 2024-09-10T22:39:10.315574+0000 (oldest deadline 2024-09-10T22:39:35.615567+0000) 2024-09-10T22:39:36.208 INFO:journalctl@ceph.osd.9.smithi019.stdout:Sep 10 22:39:35 smithi019 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-9[68022]: 2024-09-10T22:39:35.773+0000 7fa3f61d4640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-10T22:38:54.917764+0000 front 2024-09-10T22:38:54.917786+0000 (oldest deadline 2024-09-10T22:39:27.019686+0000) 2024-09-10T22:39:36.209 INFO:journalctl@ceph.osd.6.smithi019.stdout:Sep 10 22:39:36 smithi019 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-6[61536]: 2024-09-10T22:39:36.003+0000 7fbecfbb3640 -1 osd.6 80 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-10T22:38:50.981820+0000 front 2024-09-10T22:38:50.981842+0000 (oldest deadline 2024-09-10T22:39:27.183928+0000) 2024-09-10T22:39:36.209 INFO:journalctl@ceph.osd.6.smithi019.stdout:Sep 10 22:39:36 smithi019 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-6[61536]: 2024-09-10T22:39:36.003+0000 7fbecfbb3640 -1 osd.6 80 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2024-09-10T22:39:10.486176+0000 front 2024-09-10T22:39:10.486246+0000 (oldest deadline 2024-09-10T22:39:33.886409+0000) 2024-09-10T22:39:36.610 INFO:journalctl@ceph.osd.7.smithi135.stdout:Sep 10 22:39:36 smithi135 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-7[53144]: 2024-09-10T22:39:36.339+0000 7ff6310c8640 -1 osd.7 80 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2024-09-10T22:39:11.910076+0000 front 2024-09-10T22:39:11.910097+0000 (oldest deadline 2024-09-10T22:39:36.010229+0000) 2024-09-10T22:39:37.110 INFO:journalctl@ceph.osd.4.smithi135.stdout:Sep 10 22:39:36 smithi135 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-4[46199]: 2024-09-10T22:39:36.789+0000 7fdc241ed640 -1 osd.4 80 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-10T22:38:54.693661+0000 front 2024-09-10T22:38:54.693591+0000 (oldest deadline 2024-09-10T22:39:26.394521+0000) 2024-09-10T22:39:37.110 INFO:journalctl@ceph.osd.10.smithi135.stdout:Sep 10 22:39:37 smithi135 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-10[59985]: 2024-09-10T22:39:37.018+0000 7f3bf1a69640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-10T22:38:54.201226+0000 front 2024-09-10T22:38:54.201244+0000 (oldest deadline 2024-09-10T22:39:26.502183+0000) 2024-09-10T22:39:37.110 INFO:journalctl@ceph.osd.10.smithi135.stdout:Sep 10 22:39:37 smithi135 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-10[59985]: 2024-09-10T22:39:37.018+0000 7f3bf1a69640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2024-09-10T22:39:12.303632+0000 front 2024-09-10T22:39:12.303699+0000 (oldest deadline 2024-09-10T22:39:37.003674+0000) 2024-09-10T22:39:37.125 INFO:journalctl@ceph.osd.11.smithi138.stdout:Sep 10 22:39:36 smithi138 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-11[60796]: 2024-09-10T22:39:36.996+0000 7ffb00998640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-10T22:38:51.541208+0000 front 2024-09-10T22:38:51.541072+0000 (oldest deadline 2024-09-10T22:39:25.843622+0000) 2024-09-10T22:39:37.125 INFO:journalctl@ceph.osd.11.smithi138.stdout:Sep 10 22:39:36 smithi138 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-11[60796]: 2024-09-10T22:39:36.996+0000 7ffb00998640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2024-09-10T22:39:09.245148+0000 front 2024-09-10T22:39:09.245118+0000 (oldest deadline 2024-09-10T22:39:35.046015+0000) 2024-09-10T22:39:37.125 INFO:journalctl@ceph.osd.5.smithi138.stdout:Sep 10 22:39:36 smithi138 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-5[46984]: 2024-09-10T22:39:36.815+0000 7fa875fd8640 -1 osd.5 80 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-10T22:38:55.013982+0000 front 2024-09-10T22:38:55.013953+0000 (oldest deadline 2024-09-10T22:39:26.214626+0000) 2024-09-10T22:39:37.125 INFO:journalctl@ceph.osd.5.smithi138.stdout:Sep 10 22:39:36 smithi138 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-5[46984]: 2024-09-10T22:39:36.815+0000 7fa875fd8640 -1 osd.5 80 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2024-09-10T22:39:10.315703+0000 front 2024-09-10T22:39:10.315574+0000 (oldest deadline 2024-09-10T22:39:35.615567+0000) 2024-09-10T22:39:37.208 INFO:journalctl@ceph.osd.9.smithi019.stdout:Sep 10 22:39:36 smithi019 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-9[68022]: 2024-09-10T22:39:36.783+0000 7fa3f61d4640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-10T22:38:54.917764+0000 front 2024-09-10T22:38:54.917786+0000 (oldest deadline 2024-09-10T22:39:27.019686+0000) 2024-09-10T22:39:37.209 INFO:journalctl@ceph.osd.6.smithi019.stdout:Sep 10 22:39:36 smithi019 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-6[61536]: 2024-09-10T22:39:36.957+0000 7fbecfbb3640 -1 osd.6 80 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-10T22:38:50.981820+0000 front 2024-09-10T22:38:50.981842+0000 (oldest deadline 2024-09-10T22:39:27.183928+0000) 2024-09-10T22:39:37.209 INFO:journalctl@ceph.osd.6.smithi019.stdout:Sep 10 22:39:36 smithi019 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-6[61536]: 2024-09-10T22:39:36.957+0000 7fbecfbb3640 -1 osd.6 80 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2024-09-10T22:39:10.486176+0000 front 2024-09-10T22:39:10.486246+0000 (oldest deadline 2024-09-10T22:39:33.886409+0000) 2024-09-10T22:39:37.860 INFO:journalctl@ceph.osd.7.smithi135.stdout:Sep 10 22:39:37 smithi135 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-7[53144]: 2024-09-10T22:39:37.380+0000 7ff6310c8640 -1 osd.7 80 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2024-09-10T22:39:11.910076+0000 front 2024-09-10T22:39:11.910097+0000 (oldest deadline 2024-09-10T22:39:36.010229+0000) 2024-09-10T22:39:38.125 INFO:journalctl@ceph.osd.11.smithi138.stdout:Sep 10 22:39:37 smithi138 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-11[60796]: 2024-09-10T22:39:37.989+0000 7ffb00998640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-10T22:38:51.541208+0000 front 2024-09-10T22:38:51.541072+0000 (oldest deadline 2024-09-10T22:39:25.843622+0000) 2024-09-10T22:39:38.125 INFO:journalctl@ceph.osd.11.smithi138.stdout:Sep 10 22:39:37 smithi138 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-11[60796]: 2024-09-10T22:39:37.989+0000 7ffb00998640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2024-09-10T22:39:09.245148+0000 front 2024-09-10T22:39:09.245118+0000 (oldest deadline 2024-09-10T22:39:35.046015+0000) 2024-09-10T22:39:38.126 INFO:journalctl@ceph.osd.5.smithi138.stdout:Sep 10 22:39:37 smithi138 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-5[46984]: 2024-09-10T22:39:37.804+0000 7fa875fd8640 -1 osd.5 80 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-10T22:38:55.013982+0000 front 2024-09-10T22:38:55.013953+0000 (oldest deadline 2024-09-10T22:39:26.214626+0000) 2024-09-10T22:39:38.126 INFO:journalctl@ceph.osd.5.smithi138.stdout:Sep 10 22:39:37 smithi138 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-5[46984]: 2024-09-10T22:39:37.804+0000 7fa875fd8640 -1 osd.5 80 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2024-09-10T22:39:10.315703+0000 front 2024-09-10T22:39:10.315574+0000 (oldest deadline 2024-09-10T22:39:35.615567+0000) 2024-09-10T22:39:38.180 INFO:journalctl@ceph.osd.4.smithi135.stdout:Sep 10 22:39:37 smithi135 podman[70293]: 2024-09-10 22:39:37.917835423 +0000 UTC m=+5.605606347 container died 808fafdf68fc182306771d0a4169f7572dd4dcc944ce6840a30efc8b601b31b4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-4, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_CLEAN=True, ceph=True, org.label-schema.build-date=20240731, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD) 2024-09-10T22:39:38.181 INFO:journalctl@ceph.osd.10.smithi135.stdout:Sep 10 22:39:38 smithi135 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-10[59985]: 2024-09-10T22:39:38.053+0000 7f3bf1a69640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-10T22:38:54.201226+0000 front 2024-09-10T22:38:54.201244+0000 (oldest deadline 2024-09-10T22:39:26.502183+0000) 2024-09-10T22:39:38.181 INFO:journalctl@ceph.osd.10.smithi135.stdout:Sep 10 22:39:38 smithi135 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-10[59985]: 2024-09-10T22:39:38.053+0000 7f3bf1a69640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2024-09-10T22:39:12.303632+0000 front 2024-09-10T22:39:12.303699+0000 (oldest deadline 2024-09-10T22:39:37.003674+0000) 2024-09-10T22:39:38.208 INFO:journalctl@ceph.osd.6.smithi019.stdout:Sep 10 22:39:37 smithi019 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-6[61536]: 2024-09-10T22:39:37.909+0000 7fbecfbb3640 -1 osd.6 80 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-10T22:38:50.981820+0000 front 2024-09-10T22:38:50.981842+0000 (oldest deadline 2024-09-10T22:39:27.183928+0000) 2024-09-10T22:39:38.208 INFO:journalctl@ceph.osd.6.smithi019.stdout:Sep 10 22:39:37 smithi019 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-6[61536]: 2024-09-10T22:39:37.909+0000 7fbecfbb3640 -1 osd.6 80 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2024-09-10T22:39:10.486176+0000 front 2024-09-10T22:39:10.486246+0000 (oldest deadline 2024-09-10T22:39:33.886409+0000) 2024-09-10T22:39:38.209 INFO:journalctl@ceph.osd.9.smithi019.stdout:Sep 10 22:39:37 smithi019 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-9[68022]: 2024-09-10T22:39:37.810+0000 7fa3f61d4640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-10T22:38:54.917764+0000 front 2024-09-10T22:38:54.917786+0000 (oldest deadline 2024-09-10T22:39:27.019686+0000) 2024-09-10T22:39:38.546 INFO:journalctl@ceph.osd.7.smithi135.stdout:Sep 10 22:39:38 smithi135 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-7[53144]: 2024-09-10T22:39:38.339+0000 7ff6310c8640 -1 osd.7 80 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2024-09-10T22:39:11.910076+0000 front 2024-09-10T22:39:11.910097+0000 (oldest deadline 2024-09-10T22:39:36.010229+0000) 2024-09-10T22:39:38.547 INFO:journalctl@ceph.osd.4.smithi135.stdout:Sep 10 22:39:38 smithi135 podman[70293]: 2024-09-10 22:39:38.278374674 +0000 UTC m=+5.966145597 container cleanup 808fafdf68fc182306771d0a4169f7572dd4dcc944ce6840a30efc8b601b31b4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-4, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, io.buildah.version=1.37.2) 2024-09-10T22:39:38.547 INFO:journalctl@ceph.osd.4.smithi135.stdout:Sep 10 22:39:38 smithi135 bash[70293]: ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-4 2024-09-10T22:39:38.860 INFO:journalctl@ceph.osd.4.smithi135.stdout:Sep 10 22:39:38 smithi135 podman[70308]: 2024-09-10 22:39:38.5459717 +0000 UTC m=+0.625117953 container remove 808fafdf68fc182306771d0a4169f7572dd4dcc944ce6840a30efc8b601b31b4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-4, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, ceph=True, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0) 2024-09-10T22:39:39.125 INFO:journalctl@ceph.osd.11.smithi138.stdout:Sep 10 22:39:39 smithi138 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-11[60796]: 2024-09-10T22:39:39.026+0000 7ffb00998640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-10T22:38:51.541208+0000 front 2024-09-10T22:38:51.541072+0000 (oldest deadline 2024-09-10T22:39:25.843622+0000) 2024-09-10T22:39:39.125 INFO:journalctl@ceph.osd.11.smithi138.stdout:Sep 10 22:39:39 smithi138 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-11[60796]: 2024-09-10T22:39:39.026+0000 7ffb00998640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2024-09-10T22:39:09.245148+0000 front 2024-09-10T22:39:09.245118+0000 (oldest deadline 2024-09-10T22:39:35.046015+0000) 2024-09-10T22:39:39.126 INFO:journalctl@ceph.osd.5.smithi138.stdout:Sep 10 22:39:38 smithi138 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-5[46984]: 2024-09-10T22:39:38.839+0000 7fa875fd8640 -1 osd.5 80 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-10T22:38:55.013982+0000 front 2024-09-10T22:38:55.013953+0000 (oldest deadline 2024-09-10T22:39:26.214626+0000) 2024-09-10T22:39:39.126 INFO:journalctl@ceph.osd.5.smithi138.stdout:Sep 10 22:39:38 smithi138 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-5[46984]: 2024-09-10T22:39:38.839+0000 7fa875fd8640 -1 osd.5 80 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2024-09-10T22:39:10.315703+0000 front 2024-09-10T22:39:10.315574+0000 (oldest deadline 2024-09-10T22:39:35.615567+0000) 2024-09-10T22:39:39.126 INFO:journalctl@ceph.osd.8.smithi138.stdout:Sep 10 22:39:39 smithi138 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-8[53775]: 2024-09-10T22:39:39.040+0000 7f87faf53640 -1 osd.8 80 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2024-09-10T22:39:12.989835+0000 front 2024-09-10T22:39:12.989666+0000 (oldest deadline 2024-09-10T22:39:38.889906+0000) 2024-09-10T22:39:39.183 INFO:journalctl@ceph.osd.10.smithi135.stdout:Sep 10 22:39:39 smithi135 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-10[59985]: 2024-09-10T22:39:39.089+0000 7f3bf1a69640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-10T22:38:54.201226+0000 front 2024-09-10T22:38:54.201244+0000 (oldest deadline 2024-09-10T22:39:26.502183+0000) 2024-09-10T22:39:39.183 INFO:journalctl@ceph.osd.10.smithi135.stdout:Sep 10 22:39:39 smithi135 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-10[59985]: 2024-09-10T22:39:39.089+0000 7f3bf1a69640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2024-09-10T22:39:12.303632+0000 front 2024-09-10T22:39:12.303699+0000 (oldest deadline 2024-09-10T22:39:37.003674+0000) 2024-09-10T22:39:39.183 INFO:journalctl@ceph.osd.4.smithi135.stdout:Sep 10 22:39:38 smithi135 podman[70397]: 2024-09-10 22:39:38.789509503 +0000 UTC m=+0.016331855 image pull 589dd18248e494ba411dc838aa4ae0e5e569213f08fcd7a2cf22cd3ef7e3c480 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e 2024-09-10T22:39:39.184 INFO:journalctl@ceph.osd.4.smithi135.stdout:Sep 10 22:39:38 smithi135 podman[70397]: 2024-09-10 22:39:38.896766196 +0000 UTC m=+0.123588538 container create 5932924d6edb8334029ec51beff2b92885409c309e5945b9ea45b3725e16869f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-4-deactivate, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_CLEAN=True) 2024-09-10T22:39:39.184 INFO:journalctl@ceph.osd.4.smithi135.stdout:Sep 10 22:39:39 smithi135 podman[70397]: 2024-09-10 22:39:39.182744354 +0000 UTC m=+0.409566700 container init 5932924d6edb8334029ec51beff2b92885409c309e5945b9ea45b3725e16869f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-4-deactivate, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, ceph=True, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-10T22:39:39.208 INFO:journalctl@ceph.osd.6.smithi019.stdout:Sep 10 22:39:38 smithi019 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-6[61536]: 2024-09-10T22:39:38.912+0000 7fbecfbb3640 -1 osd.6 80 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-10T22:38:50.981820+0000 front 2024-09-10T22:38:50.981842+0000 (oldest deadline 2024-09-10T22:39:27.183928+0000) 2024-09-10T22:39:39.208 INFO:journalctl@ceph.osd.6.smithi019.stdout:Sep 10 22:39:38 smithi019 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-6[61536]: 2024-09-10T22:39:38.912+0000 7fbecfbb3640 -1 osd.6 80 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2024-09-10T22:39:10.486176+0000 front 2024-09-10T22:39:10.486246+0000 (oldest deadline 2024-09-10T22:39:33.886409+0000) 2024-09-10T22:39:39.208 INFO:journalctl@ceph.osd.9.smithi019.stdout:Sep 10 22:39:38 smithi019 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-9[68022]: 2024-09-10T22:39:38.859+0000 7fa3f61d4640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-10T22:38:54.917764+0000 front 2024-09-10T22:38:54.917786+0000 (oldest deadline 2024-09-10T22:39:27.019686+0000) 2024-09-10T22:39:39.209 INFO:journalctl@ceph.osd.9.smithi019.stdout:Sep 10 22:39:38 smithi019 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-9[68022]: 2024-09-10T22:39:38.859+0000 7fa3f61d4640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2024-09-10T22:39:12.821560+0000 front 2024-09-10T22:39:12.821482+0000 (oldest deadline 2024-09-10T22:39:38.121512+0000) 2024-09-10T22:39:39.610 INFO:journalctl@ceph.osd.4.smithi135.stdout:Sep 10 22:39:39 smithi135 podman[70397]: 2024-09-10 22:39:39.186118202 +0000 UTC m=+0.412940553 container start 5932924d6edb8334029ec51beff2b92885409c309e5945b9ea45b3725e16869f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-4-deactivate, ceph=True, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-10T22:39:39.610 INFO:journalctl@ceph.osd.4.smithi135.stdout:Sep 10 22:39:39 smithi135 podman[70397]: 2024-09-10 22:39:39.257657043 +0000 UTC m=+0.484479397 container attach 5932924d6edb8334029ec51beff2b92885409c309e5945b9ea45b3725e16869f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-4-deactivate, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, ceph=True, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_CLEAN=True) 2024-09-10T22:39:39.610 INFO:journalctl@ceph.osd.4.smithi135.stdout:Sep 10 22:39:39 smithi135 podman[70397]: 2024-09-10 22:39:39.383720506 +0000 UTC m=+0.610542851 container died 5932924d6edb8334029ec51beff2b92885409c309e5945b9ea45b3725e16869f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-4-deactivate, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, GIT_BRANCH=HEAD) 2024-09-10T22:39:39.611 INFO:journalctl@ceph.osd.7.smithi135.stdout:Sep 10 22:39:39 smithi135 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-7[53144]: 2024-09-10T22:39:39.307+0000 7ff6310c8640 -1 osd.7 80 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2024-09-10T22:39:11.910076+0000 front 2024-09-10T22:39:11.910097+0000 (oldest deadline 2024-09-10T22:39:36.010229+0000) 2024-09-10T22:39:39.969 DEBUG:teuthology.orchestra.run.smithi135:> sudo pkill -f 'journalctl -f -n 0 -u ceph-22997a4c-6fc2-11ef-bcea-c7b262605968@osd.4.service' 2024-09-10T22:39:40.008 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-10T22:39:40.009 INFO:tasks.cephadm.osd.4:Stopped osd.4 2024-09-10T22:39:40.009 INFO:tasks.cephadm.osd.5:Stopping osd.5... 2024-09-10T22:39:40.009 DEBUG:teuthology.orchestra.run.smithi138:> sudo systemctl stop ceph-22997a4c-6fc2-11ef-bcea-c7b262605968@osd.5 2024-09-10T22:39:40.125 INFO:journalctl@ceph.osd.5.smithi138.stdout:Sep 10 22:39:39 smithi138 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-5[46984]: 2024-09-10T22:39:39.823+0000 7fa875fd8640 -1 osd.5 80 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-10T22:38:55.013982+0000 front 2024-09-10T22:38:55.013953+0000 (oldest deadline 2024-09-10T22:39:26.214626+0000) 2024-09-10T22:39:40.125 INFO:journalctl@ceph.osd.5.smithi138.stdout:Sep 10 22:39:39 smithi138 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-5[46984]: 2024-09-10T22:39:39.823+0000 7fa875fd8640 -1 osd.5 80 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2024-09-10T22:39:10.315703+0000 front 2024-09-10T22:39:10.315574+0000 (oldest deadline 2024-09-10T22:39:35.615567+0000) 2024-09-10T22:39:40.126 INFO:journalctl@ceph.osd.5.smithi138.stdout:Sep 10 22:39:40 smithi138 systemd[1]: Stopping Ceph osd.5 for 22997a4c-6fc2-11ef-bcea-c7b262605968... 2024-09-10T22:39:40.126 INFO:journalctl@ceph.osd.8.smithi138.stdout:Sep 10 22:39:40 smithi138 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-8[53775]: 2024-09-10T22:39:40.035+0000 7f87faf53640 -1 osd.8 80 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2024-09-10T22:39:12.989835+0000 front 2024-09-10T22:39:12.989666+0000 (oldest deadline 2024-09-10T22:39:38.889906+0000) 2024-09-10T22:39:40.126 INFO:journalctl@ceph.osd.11.smithi138.stdout:Sep 10 22:39:40 smithi138 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-11[60796]: 2024-09-10T22:39:40.052+0000 7ffb00998640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-10T22:38:51.541208+0000 front 2024-09-10T22:38:51.541072+0000 (oldest deadline 2024-09-10T22:39:25.843622+0000) 2024-09-10T22:39:40.126 INFO:journalctl@ceph.osd.11.smithi138.stdout:Sep 10 22:39:40 smithi138 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-11[60796]: 2024-09-10T22:39:40.052+0000 7ffb00998640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2024-09-10T22:39:09.245148+0000 front 2024-09-10T22:39:09.245118+0000 (oldest deadline 2024-09-10T22:39:35.046015+0000) 2024-09-10T22:39:40.208 INFO:journalctl@ceph.osd.6.smithi019.stdout:Sep 10 22:39:39 smithi019 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-6[61536]: 2024-09-10T22:39:39.913+0000 7fbecfbb3640 -1 osd.6 80 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-10T22:38:50.981820+0000 front 2024-09-10T22:38:50.981842+0000 (oldest deadline 2024-09-10T22:39:27.183928+0000) 2024-09-10T22:39:40.208 INFO:journalctl@ceph.osd.6.smithi019.stdout:Sep 10 22:39:39 smithi019 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-6[61536]: 2024-09-10T22:39:39.913+0000 7fbecfbb3640 -1 osd.6 80 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2024-09-10T22:39:10.486176+0000 front 2024-09-10T22:39:10.486246+0000 (oldest deadline 2024-09-10T22:39:33.886409+0000) 2024-09-10T22:39:40.209 INFO:journalctl@ceph.osd.9.smithi019.stdout:Sep 10 22:39:39 smithi019 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-9[68022]: 2024-09-10T22:39:39.856+0000 7fa3f61d4640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-10T22:38:54.917764+0000 front 2024-09-10T22:38:54.917786+0000 (oldest deadline 2024-09-10T22:39:27.019686+0000) 2024-09-10T22:39:40.209 INFO:journalctl@ceph.osd.9.smithi019.stdout:Sep 10 22:39:39 smithi019 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-9[68022]: 2024-09-10T22:39:39.856+0000 7fa3f61d4640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2024-09-10T22:39:12.821560+0000 front 2024-09-10T22:39:12.821482+0000 (oldest deadline 2024-09-10T22:39:38.121512+0000) 2024-09-10T22:39:40.276 INFO:journalctl@ceph.osd.10.smithi135.stdout:Sep 10 22:39:40 smithi135 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-10[59985]: 2024-09-10T22:39:40.050+0000 7f3bf1a69640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-10T22:38:54.201226+0000 front 2024-09-10T22:38:54.201244+0000 (oldest deadline 2024-09-10T22:39:26.502183+0000) 2024-09-10T22:39:40.276 INFO:journalctl@ceph.osd.10.smithi135.stdout:Sep 10 22:39:40 smithi135 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-10[59985]: 2024-09-10T22:39:40.050+0000 7f3bf1a69640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2024-09-10T22:39:12.303632+0000 front 2024-09-10T22:39:12.303699+0000 (oldest deadline 2024-09-10T22:39:37.003674+0000) 2024-09-10T22:39:40.610 INFO:journalctl@ceph.osd.7.smithi135.stdout:Sep 10 22:39:40 smithi135 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-7[53144]: 2024-09-10T22:39:40.275+0000 7ff6310c8640 -1 osd.7 80 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2024-09-10T22:39:11.910076+0000 front 2024-09-10T22:39:11.910097+0000 (oldest deadline 2024-09-10T22:39:36.010229+0000) 2024-09-10T22:39:40.625 INFO:journalctl@ceph.osd.5.smithi138.stdout:Sep 10 22:39:40 smithi138 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-5[46984]: 2024-09-10T22:39:40.310+0000 7fa8799c3640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.5 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-10T22:39:40.625 INFO:journalctl@ceph.osd.5.smithi138.stdout:Sep 10 22:39:40 smithi138 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-5[46984]: 2024-09-10T22:39:40.310+0000 7fa8799c3640 -1 osd.5 80 *** Got signal Terminated *** 2024-09-10T22:39:40.625 INFO:journalctl@ceph.osd.5.smithi138.stdout:Sep 10 22:39:40 smithi138 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-5[46984]: 2024-09-10T22:39:40.310+0000 7fa8799c3640 -1 osd.5 80 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-10T22:39:41.084 INFO:journalctl@ceph.osd.5.smithi138.stdout:Sep 10 22:39:40 smithi138 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-5[46984]: 2024-09-10T22:39:40.797+0000 7fa875fd8640 -1 osd.5 80 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-10T22:38:55.013982+0000 front 2024-09-10T22:38:55.013953+0000 (oldest deadline 2024-09-10T22:39:26.214626+0000) 2024-09-10T22:39:41.084 INFO:journalctl@ceph.osd.5.smithi138.stdout:Sep 10 22:39:40 smithi138 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-5[46984]: 2024-09-10T22:39:40.797+0000 7fa875fd8640 -1 osd.5 80 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2024-09-10T22:39:10.315703+0000 front 2024-09-10T22:39:10.315574+0000 (oldest deadline 2024-09-10T22:39:35.615567+0000) 2024-09-10T22:39:41.085 INFO:journalctl@ceph.osd.11.smithi138.stdout:Sep 10 22:39:41 smithi138 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-11[60796]: 2024-09-10T22:39:41.032+0000 7ffb00998640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-10T22:38:51.541208+0000 front 2024-09-10T22:38:51.541072+0000 (oldest deadline 2024-09-10T22:39:25.843622+0000) 2024-09-10T22:39:41.085 INFO:journalctl@ceph.osd.11.smithi138.stdout:Sep 10 22:39:41 smithi138 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-11[60796]: 2024-09-10T22:39:41.032+0000 7ffb00998640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2024-09-10T22:39:09.245148+0000 front 2024-09-10T22:39:09.245118+0000 (oldest deadline 2024-09-10T22:39:35.046015+0000) 2024-09-10T22:39:41.155 INFO:journalctl@ceph.osd.6.smithi019.stdout:Sep 10 22:39:40 smithi019 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-6[61536]: 2024-09-10T22:39:40.926+0000 7fbecfbb3640 -1 osd.6 80 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-10T22:38:50.981820+0000 front 2024-09-10T22:38:50.981842+0000 (oldest deadline 2024-09-10T22:39:27.183928+0000) 2024-09-10T22:39:41.155 INFO:journalctl@ceph.osd.6.smithi019.stdout:Sep 10 22:39:40 smithi019 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-6[61536]: 2024-09-10T22:39:40.926+0000 7fbecfbb3640 -1 osd.6 80 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2024-09-10T22:39:10.486176+0000 front 2024-09-10T22:39:10.486246+0000 (oldest deadline 2024-09-10T22:39:33.886409+0000) 2024-09-10T22:39:41.156 INFO:journalctl@ceph.osd.9.smithi019.stdout:Sep 10 22:39:40 smithi019 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-9[68022]: 2024-09-10T22:39:40.879+0000 7fa3f61d4640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-10T22:38:54.917764+0000 front 2024-09-10T22:38:54.917786+0000 (oldest deadline 2024-09-10T22:39:27.019686+0000) 2024-09-10T22:39:41.156 INFO:journalctl@ceph.osd.9.smithi019.stdout:Sep 10 22:39:40 smithi019 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-9[68022]: 2024-09-10T22:39:40.879+0000 7fa3f61d4640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2024-09-10T22:39:12.821560+0000 front 2024-09-10T22:39:12.821482+0000 (oldest deadline 2024-09-10T22:39:38.121512+0000) 2024-09-10T22:39:41.360 INFO:journalctl@ceph.osd.7.smithi135.stdout:Sep 10 22:39:41 smithi135 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-7[53144]: 2024-09-10T22:39:41.237+0000 7ff6310c8640 -1 osd.7 80 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2024-09-10T22:39:11.910076+0000 front 2024-09-10T22:39:11.910097+0000 (oldest deadline 2024-09-10T22:39:36.010229+0000) 2024-09-10T22:39:41.360 INFO:journalctl@ceph.osd.10.smithi135.stdout:Sep 10 22:39:41 smithi135 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-10[59985]: 2024-09-10T22:39:41.081+0000 7f3bf1a69640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-10T22:38:54.201226+0000 front 2024-09-10T22:38:54.201244+0000 (oldest deadline 2024-09-10T22:39:26.502183+0000) 2024-09-10T22:39:41.360 INFO:journalctl@ceph.osd.10.smithi135.stdout:Sep 10 22:39:41 smithi135 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-10[59985]: 2024-09-10T22:39:41.081+0000 7f3bf1a69640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2024-09-10T22:39:12.303632+0000 front 2024-09-10T22:39:12.303699+0000 (oldest deadline 2024-09-10T22:39:37.003674+0000) 2024-09-10T22:39:41.375 INFO:journalctl@ceph.osd.8.smithi138.stdout:Sep 10 22:39:41 smithi138 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-8[53775]: 2024-09-10T22:39:41.082+0000 7f87faf53640 -1 osd.8 80 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2024-09-10T22:39:12.989835+0000 front 2024-09-10T22:39:12.989666+0000 (oldest deadline 2024-09-10T22:39:38.889906+0000) 2024-09-10T22:39:42.069 INFO:journalctl@ceph.osd.11.smithi138.stdout:Sep 10 22:39:42 smithi138 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-11[60796]: 2024-09-10T22:39:42.012+0000 7ffb00998640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-10T22:38:51.541208+0000 front 2024-09-10T22:38:51.541072+0000 (oldest deadline 2024-09-10T22:39:25.843622+0000) 2024-09-10T22:39:42.069 INFO:journalctl@ceph.osd.11.smithi138.stdout:Sep 10 22:39:42 smithi138 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-11[60796]: 2024-09-10T22:39:42.012+0000 7ffb00998640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2024-09-10T22:39:09.245148+0000 front 2024-09-10T22:39:09.245118+0000 (oldest deadline 2024-09-10T22:39:35.046015+0000) 2024-09-10T22:39:42.069 INFO:journalctl@ceph.osd.5.smithi138.stdout:Sep 10 22:39:41 smithi138 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-5[46984]: 2024-09-10T22:39:41.807+0000 7fa875fd8640 -1 osd.5 80 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-10T22:38:55.013982+0000 front 2024-09-10T22:38:55.013953+0000 (oldest deadline 2024-09-10T22:39:26.214626+0000) 2024-09-10T22:39:42.070 INFO:journalctl@ceph.osd.5.smithi138.stdout:Sep 10 22:39:41 smithi138 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-5[46984]: 2024-09-10T22:39:41.807+0000 7fa875fd8640 -1 osd.5 80 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2024-09-10T22:39:10.315703+0000 front 2024-09-10T22:39:10.315574+0000 (oldest deadline 2024-09-10T22:39:35.615567+0000) 2024-09-10T22:39:42.209 INFO:journalctl@ceph.osd.6.smithi019.stdout:Sep 10 22:39:41 smithi019 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-6[61536]: 2024-09-10T22:39:41.912+0000 7fbecfbb3640 -1 osd.6 80 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-10T22:38:50.981820+0000 front 2024-09-10T22:38:50.981842+0000 (oldest deadline 2024-09-10T22:39:27.183928+0000) 2024-09-10T22:39:42.209 INFO:journalctl@ceph.osd.6.smithi019.stdout:Sep 10 22:39:41 smithi019 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-6[61536]: 2024-09-10T22:39:41.912+0000 7fbecfbb3640 -1 osd.6 80 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2024-09-10T22:39:10.486176+0000 front 2024-09-10T22:39:10.486246+0000 (oldest deadline 2024-09-10T22:39:33.886409+0000) 2024-09-10T22:39:42.209 INFO:journalctl@ceph.osd.9.smithi019.stdout:Sep 10 22:39:41 smithi019 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-9[68022]: 2024-09-10T22:39:41.887+0000 7fa3f61d4640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-10T22:38:54.917764+0000 front 2024-09-10T22:38:54.917786+0000 (oldest deadline 2024-09-10T22:39:27.019686+0000) 2024-09-10T22:39:42.210 INFO:journalctl@ceph.osd.9.smithi019.stdout:Sep 10 22:39:41 smithi019 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-9[68022]: 2024-09-10T22:39:41.887+0000 7fa3f61d4640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2024-09-10T22:39:12.821560+0000 front 2024-09-10T22:39:12.821482+0000 (oldest deadline 2024-09-10T22:39:38.121512+0000) 2024-09-10T22:39:42.360 INFO:journalctl@ceph.osd.7.smithi135.stdout:Sep 10 22:39:42 smithi135 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-7[53144]: 2024-09-10T22:39:42.218+0000 7ff6310c8640 -1 osd.7 80 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2024-09-10T22:39:11.910076+0000 front 2024-09-10T22:39:11.910097+0000 (oldest deadline 2024-09-10T22:39:36.010229+0000) 2024-09-10T22:39:42.360 INFO:journalctl@ceph.osd.10.smithi135.stdout:Sep 10 22:39:42 smithi135 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-10[59985]: 2024-09-10T22:39:42.082+0000 7f3bf1a69640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-10T22:38:54.201226+0000 front 2024-09-10T22:38:54.201244+0000 (oldest deadline 2024-09-10T22:39:26.502183+0000) 2024-09-10T22:39:42.361 INFO:journalctl@ceph.osd.10.smithi135.stdout:Sep 10 22:39:42 smithi135 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-10[59985]: 2024-09-10T22:39:42.082+0000 7f3bf1a69640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2024-09-10T22:39:12.303632+0000 front 2024-09-10T22:39:12.303699+0000 (oldest deadline 2024-09-10T22:39:37.003674+0000) 2024-09-10T22:39:42.375 INFO:journalctl@ceph.osd.8.smithi138.stdout:Sep 10 22:39:42 smithi138 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-8[53775]: 2024-09-10T22:39:42.067+0000 7f87faf53640 -1 osd.8 80 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2024-09-10T22:39:12.989835+0000 front 2024-09-10T22:39:12.989666+0000 (oldest deadline 2024-09-10T22:39:38.889906+0000) 2024-09-10T22:39:43.125 INFO:journalctl@ceph.osd.11.smithi138.stdout:Sep 10 22:39:43 smithi138 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-11[60796]: 2024-09-10T22:39:43.024+0000 7ffb00998640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-10T22:38:51.541208+0000 front 2024-09-10T22:38:51.541072+0000 (oldest deadline 2024-09-10T22:39:25.843622+0000) 2024-09-10T22:39:43.125 INFO:journalctl@ceph.osd.11.smithi138.stdout:Sep 10 22:39:43 smithi138 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-11[60796]: 2024-09-10T22:39:43.024+0000 7ffb00998640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2024-09-10T22:39:09.245148+0000 front 2024-09-10T22:39:09.245118+0000 (oldest deadline 2024-09-10T22:39:35.046015+0000) 2024-09-10T22:39:43.128 INFO:journalctl@ceph.osd.5.smithi138.stdout:Sep 10 22:39:42 smithi138 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-5[46984]: 2024-09-10T22:39:42.832+0000 7fa875fd8640 -1 osd.5 80 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-10T22:38:55.013982+0000 front 2024-09-10T22:38:55.013953+0000 (oldest deadline 2024-09-10T22:39:26.214626+0000) 2024-09-10T22:39:43.128 INFO:journalctl@ceph.osd.5.smithi138.stdout:Sep 10 22:39:42 smithi138 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-5[46984]: 2024-09-10T22:39:42.832+0000 7fa875fd8640 -1 osd.5 80 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2024-09-10T22:39:10.315703+0000 front 2024-09-10T22:39:10.315574+0000 (oldest deadline 2024-09-10T22:39:35.615567+0000) 2024-09-10T22:39:43.128 INFO:journalctl@ceph.osd.8.smithi138.stdout:Sep 10 22:39:43 smithi138 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-8[53775]: 2024-09-10T22:39:43.031+0000 7f87faf53640 -1 osd.8 80 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2024-09-10T22:39:12.989835+0000 front 2024-09-10T22:39:12.989666+0000 (oldest deadline 2024-09-10T22:39:38.889906+0000) 2024-09-10T22:39:43.128 INFO:journalctl@ceph.osd.8.smithi138.stdout:Sep 10 22:39:43 smithi138 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-8[53775]: 2024-09-10T22:39:43.031+0000 7f87faf53640 -1 osd.8 80 heartbeat_check: no reply from 172.21.15.138:6804 osd.2 since back 2024-09-10T22:39:18.890233+0000 front 2024-09-10T22:39:18.890263+0000 (oldest deadline 2024-09-10T22:39:42.990418+0000) 2024-09-10T22:39:43.208 INFO:journalctl@ceph.osd.6.smithi019.stdout:Sep 10 22:39:42 smithi019 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-6[61536]: 2024-09-10T22:39:42.919+0000 7fbecfbb3640 -1 osd.6 80 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-10T22:38:50.981820+0000 front 2024-09-10T22:38:50.981842+0000 (oldest deadline 2024-09-10T22:39:27.183928+0000) 2024-09-10T22:39:43.209 INFO:journalctl@ceph.osd.6.smithi019.stdout:Sep 10 22:39:42 smithi019 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-6[61536]: 2024-09-10T22:39:42.919+0000 7fbecfbb3640 -1 osd.6 80 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2024-09-10T22:39:10.486176+0000 front 2024-09-10T22:39:10.486246+0000 (oldest deadline 2024-09-10T22:39:33.886409+0000) 2024-09-10T22:39:43.209 INFO:journalctl@ceph.osd.6.smithi019.stdout:Sep 10 22:39:42 smithi019 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-6[61536]: 2024-09-10T22:39:42.919+0000 7fbecfbb3640 -1 osd.6 80 heartbeat_check: no reply from 172.21.15.138:6804 osd.2 since back 2024-09-10T22:39:18.587269+0000 front 2024-09-10T22:39:18.587220+0000 (oldest deadline 2024-09-10T22:39:42.087256+0000) 2024-09-10T22:39:43.209 INFO:journalctl@ceph.osd.9.smithi019.stdout:Sep 10 22:39:42 smithi019 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-9[68022]: 2024-09-10T22:39:42.930+0000 7fa3f61d4640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-10T22:38:54.917764+0000 front 2024-09-10T22:38:54.917786+0000 (oldest deadline 2024-09-10T22:39:27.019686+0000) 2024-09-10T22:39:43.210 INFO:journalctl@ceph.osd.9.smithi019.stdout:Sep 10 22:39:42 smithi019 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-9[68022]: 2024-09-10T22:39:42.930+0000 7fa3f61d4640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2024-09-10T22:39:12.821560+0000 front 2024-09-10T22:39:12.821482+0000 (oldest deadline 2024-09-10T22:39:38.121512+0000) 2024-09-10T22:39:43.360 INFO:journalctl@ceph.osd.7.smithi135.stdout:Sep 10 22:39:43 smithi135 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-7[53144]: 2024-09-10T22:39:43.225+0000 7ff6310c8640 -1 osd.7 80 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2024-09-10T22:39:11.910076+0000 front 2024-09-10T22:39:11.910097+0000 (oldest deadline 2024-09-10T22:39:36.010229+0000) 2024-09-10T22:39:43.360 INFO:journalctl@ceph.osd.7.smithi135.stdout:Sep 10 22:39:43 smithi135 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-7[53144]: 2024-09-10T22:39:43.225+0000 7ff6310c8640 -1 osd.7 80 heartbeat_check: no reply from 172.21.15.138:6804 osd.2 since back 2024-09-10T22:39:20.111330+0000 front 2024-09-10T22:39:20.111291+0000 (oldest deadline 2024-09-10T22:39:43.011420+0000) 2024-09-10T22:39:43.360 INFO:journalctl@ceph.osd.10.smithi135.stdout:Sep 10 22:39:43 smithi135 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-10[59985]: 2024-09-10T22:39:43.065+0000 7f3bf1a69640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-10T22:38:54.201226+0000 front 2024-09-10T22:38:54.201244+0000 (oldest deadline 2024-09-10T22:39:26.502183+0000) 2024-09-10T22:39:43.360 INFO:journalctl@ceph.osd.10.smithi135.stdout:Sep 10 22:39:43 smithi135 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-10[59985]: 2024-09-10T22:39:43.065+0000 7f3bf1a69640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2024-09-10T22:39:12.303632+0000 front 2024-09-10T22:39:12.303699+0000 (oldest deadline 2024-09-10T22:39:37.003674+0000) 2024-09-10T22:39:43.360 INFO:journalctl@ceph.osd.10.smithi135.stdout:Sep 10 22:39:43 smithi135 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-10[59985]: 2024-09-10T22:39:43.065+0000 7f3bf1a69640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.138:6804 osd.2 since back 2024-09-10T22:39:20.504425+0000 front 2024-09-10T22:39:20.504380+0000 (oldest deadline 2024-09-10T22:39:42.105008+0000) 2024-09-10T22:39:44.125 INFO:journalctl@ceph.osd.5.smithi138.stdout:Sep 10 22:39:43 smithi138 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-5[46984]: 2024-09-10T22:39:43.868+0000 7fa875fd8640 -1 osd.5 80 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-10T22:38:55.013982+0000 front 2024-09-10T22:38:55.013953+0000 (oldest deadline 2024-09-10T22:39:26.214626+0000) 2024-09-10T22:39:44.125 INFO:journalctl@ceph.osd.5.smithi138.stdout:Sep 10 22:39:43 smithi138 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-5[46984]: 2024-09-10T22:39:43.868+0000 7fa875fd8640 -1 osd.5 80 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2024-09-10T22:39:10.315703+0000 front 2024-09-10T22:39:10.315574+0000 (oldest deadline 2024-09-10T22:39:35.615567+0000) 2024-09-10T22:39:44.126 INFO:journalctl@ceph.osd.11.smithi138.stdout:Sep 10 22:39:44 smithi138 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-11[60796]: 2024-09-10T22:39:44.015+0000 7ffb00998640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-10T22:38:51.541208+0000 front 2024-09-10T22:38:51.541072+0000 (oldest deadline 2024-09-10T22:39:25.843622+0000) 2024-09-10T22:39:44.126 INFO:journalctl@ceph.osd.11.smithi138.stdout:Sep 10 22:39:44 smithi138 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-11[60796]: 2024-09-10T22:39:44.015+0000 7ffb00998640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2024-09-10T22:39:09.245148+0000 front 2024-09-10T22:39:09.245118+0000 (oldest deadline 2024-09-10T22:39:35.046015+0000) 2024-09-10T22:39:44.126 INFO:journalctl@ceph.osd.8.smithi138.stdout:Sep 10 22:39:44 smithi138 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-8[53775]: 2024-09-10T22:39:44.031+0000 7f87faf53640 -1 osd.8 80 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2024-09-10T22:39:12.989835+0000 front 2024-09-10T22:39:12.989666+0000 (oldest deadline 2024-09-10T22:39:38.889906+0000) 2024-09-10T22:39:44.126 INFO:journalctl@ceph.osd.8.smithi138.stdout:Sep 10 22:39:44 smithi138 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-8[53775]: 2024-09-10T22:39:44.031+0000 7f87faf53640 -1 osd.8 80 heartbeat_check: no reply from 172.21.15.138:6804 osd.2 since back 2024-09-10T22:39:18.890233+0000 front 2024-09-10T22:39:18.890263+0000 (oldest deadline 2024-09-10T22:39:42.990418+0000) 2024-09-10T22:39:44.208 INFO:journalctl@ceph.osd.6.smithi019.stdout:Sep 10 22:39:43 smithi019 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-6[61536]: 2024-09-10T22:39:43.893+0000 7fbecfbb3640 -1 osd.6 80 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-10T22:38:50.981820+0000 front 2024-09-10T22:38:50.981842+0000 (oldest deadline 2024-09-10T22:39:27.183928+0000) 2024-09-10T22:39:44.208 INFO:journalctl@ceph.osd.6.smithi019.stdout:Sep 10 22:39:43 smithi019 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-6[61536]: 2024-09-10T22:39:43.893+0000 7fbecfbb3640 -1 osd.6 80 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2024-09-10T22:39:10.486176+0000 front 2024-09-10T22:39:10.486246+0000 (oldest deadline 2024-09-10T22:39:33.886409+0000) 2024-09-10T22:39:44.209 INFO:journalctl@ceph.osd.6.smithi019.stdout:Sep 10 22:39:43 smithi019 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-6[61536]: 2024-09-10T22:39:43.893+0000 7fbecfbb3640 -1 osd.6 80 heartbeat_check: no reply from 172.21.15.138:6804 osd.2 since back 2024-09-10T22:39:18.587269+0000 front 2024-09-10T22:39:18.587220+0000 (oldest deadline 2024-09-10T22:39:42.087256+0000) 2024-09-10T22:39:44.209 INFO:journalctl@ceph.osd.9.smithi019.stdout:Sep 10 22:39:43 smithi019 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-9[68022]: 2024-09-10T22:39:43.918+0000 7fa3f61d4640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-10T22:38:54.917764+0000 front 2024-09-10T22:38:54.917786+0000 (oldest deadline 2024-09-10T22:39:27.019686+0000) 2024-09-10T22:39:44.209 INFO:journalctl@ceph.osd.9.smithi019.stdout:Sep 10 22:39:43 smithi019 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-9[68022]: 2024-09-10T22:39:43.918+0000 7fa3f61d4640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2024-09-10T22:39:12.821560+0000 front 2024-09-10T22:39:12.821482+0000 (oldest deadline 2024-09-10T22:39:38.121512+0000) 2024-09-10T22:39:44.360 INFO:journalctl@ceph.osd.7.smithi135.stdout:Sep 10 22:39:44 smithi135 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-7[53144]: 2024-09-10T22:39:44.233+0000 7ff6310c8640 -1 osd.7 80 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2024-09-10T22:39:11.910076+0000 front 2024-09-10T22:39:11.910097+0000 (oldest deadline 2024-09-10T22:39:36.010229+0000) 2024-09-10T22:39:44.360 INFO:journalctl@ceph.osd.7.smithi135.stdout:Sep 10 22:39:44 smithi135 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-7[53144]: 2024-09-10T22:39:44.233+0000 7ff6310c8640 -1 osd.7 80 heartbeat_check: no reply from 172.21.15.138:6804 osd.2 since back 2024-09-10T22:39:20.111330+0000 front 2024-09-10T22:39:20.111291+0000 (oldest deadline 2024-09-10T22:39:43.011420+0000) 2024-09-10T22:39:44.360 INFO:journalctl@ceph.osd.10.smithi135.stdout:Sep 10 22:39:44 smithi135 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-10[59985]: 2024-09-10T22:39:44.046+0000 7f3bf1a69640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-10T22:38:54.201226+0000 front 2024-09-10T22:38:54.201244+0000 (oldest deadline 2024-09-10T22:39:26.502183+0000) 2024-09-10T22:39:44.360 INFO:journalctl@ceph.osd.10.smithi135.stdout:Sep 10 22:39:44 smithi135 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-10[59985]: 2024-09-10T22:39:44.046+0000 7f3bf1a69640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2024-09-10T22:39:12.303632+0000 front 2024-09-10T22:39:12.303699+0000 (oldest deadline 2024-09-10T22:39:37.003674+0000) 2024-09-10T22:39:44.360 INFO:journalctl@ceph.osd.10.smithi135.stdout:Sep 10 22:39:44 smithi135 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-10[59985]: 2024-09-10T22:39:44.046+0000 7f3bf1a69640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.138:6804 osd.2 since back 2024-09-10T22:39:20.504425+0000 front 2024-09-10T22:39:20.504380+0000 (oldest deadline 2024-09-10T22:39:42.105008+0000) 2024-09-10T22:39:45.208 INFO:journalctl@ceph.osd.6.smithi019.stdout:Sep 10 22:39:44 smithi019 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-6[61536]: 2024-09-10T22:39:44.884+0000 7fbecfbb3640 -1 osd.6 80 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-10T22:38:50.981820+0000 front 2024-09-10T22:38:50.981842+0000 (oldest deadline 2024-09-10T22:39:27.183928+0000) 2024-09-10T22:39:45.209 INFO:journalctl@ceph.osd.6.smithi019.stdout:Sep 10 22:39:44 smithi019 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-6[61536]: 2024-09-10T22:39:44.884+0000 7fbecfbb3640 -1 osd.6 80 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2024-09-10T22:39:10.486176+0000 front 2024-09-10T22:39:10.486246+0000 (oldest deadline 2024-09-10T22:39:33.886409+0000) 2024-09-10T22:39:45.209 INFO:journalctl@ceph.osd.6.smithi019.stdout:Sep 10 22:39:44 smithi019 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-6[61536]: 2024-09-10T22:39:44.884+0000 7fbecfbb3640 -1 osd.6 80 heartbeat_check: no reply from 172.21.15.138:6804 osd.2 since back 2024-09-10T22:39:18.587269+0000 front 2024-09-10T22:39:18.587220+0000 (oldest deadline 2024-09-10T22:39:42.087256+0000) 2024-09-10T22:39:45.209 INFO:journalctl@ceph.osd.9.smithi019.stdout:Sep 10 22:39:44 smithi019 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-9[68022]: 2024-09-10T22:39:44.887+0000 7fa3f61d4640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-10T22:38:54.917764+0000 front 2024-09-10T22:38:54.917786+0000 (oldest deadline 2024-09-10T22:39:27.019686+0000) 2024-09-10T22:39:45.209 INFO:journalctl@ceph.osd.9.smithi019.stdout:Sep 10 22:39:44 smithi019 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-9[68022]: 2024-09-10T22:39:44.887+0000 7fa3f61d4640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2024-09-10T22:39:12.821560+0000 front 2024-09-10T22:39:12.821482+0000 (oldest deadline 2024-09-10T22:39:38.121512+0000) 2024-09-10T22:39:45.209 INFO:journalctl@ceph.osd.9.smithi019.stdout:Sep 10 22:39:44 smithi019 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-9[68022]: 2024-09-10T22:39:44.887+0000 7fa3f61d4640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.138:6804 osd.2 since back 2024-09-10T22:39:18.122242+0000 front 2024-09-10T22:39:18.122082+0000 (oldest deadline 2024-09-10T22:39:44.022038+0000) 2024-09-10T22:39:45.360 INFO:journalctl@ceph.osd.7.smithi135.stdout:Sep 10 22:39:45 smithi135 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-7[53144]: 2024-09-10T22:39:45.278+0000 7ff6310c8640 -1 osd.7 80 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2024-09-10T22:39:11.910076+0000 front 2024-09-10T22:39:11.910097+0000 (oldest deadline 2024-09-10T22:39:36.010229+0000) 2024-09-10T22:39:45.360 INFO:journalctl@ceph.osd.7.smithi135.stdout:Sep 10 22:39:45 smithi135 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-7[53144]: 2024-09-10T22:39:45.278+0000 7ff6310c8640 -1 osd.7 80 heartbeat_check: no reply from 172.21.15.138:6804 osd.2 since back 2024-09-10T22:39:20.111330+0000 front 2024-09-10T22:39:20.111291+0000 (oldest deadline 2024-09-10T22:39:43.011420+0000) 2024-09-10T22:39:45.360 INFO:journalctl@ceph.osd.10.smithi135.stdout:Sep 10 22:39:45 smithi135 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-10[59985]: 2024-09-10T22:39:45.095+0000 7f3bf1a69640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-10T22:38:54.201226+0000 front 2024-09-10T22:38:54.201244+0000 (oldest deadline 2024-09-10T22:39:26.502183+0000) 2024-09-10T22:39:45.360 INFO:journalctl@ceph.osd.10.smithi135.stdout:Sep 10 22:39:45 smithi135 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-10[59985]: 2024-09-10T22:39:45.095+0000 7f3bf1a69640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2024-09-10T22:39:12.303632+0000 front 2024-09-10T22:39:12.303699+0000 (oldest deadline 2024-09-10T22:39:37.003674+0000) 2024-09-10T22:39:45.360 INFO:journalctl@ceph.osd.10.smithi135.stdout:Sep 10 22:39:45 smithi135 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-10[59985]: 2024-09-10T22:39:45.095+0000 7f3bf1a69640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.138:6804 osd.2 since back 2024-09-10T22:39:20.504425+0000 front 2024-09-10T22:39:20.504380+0000 (oldest deadline 2024-09-10T22:39:42.105008+0000) 2024-09-10T22:39:45.375 INFO:journalctl@ceph.osd.5.smithi138.stdout:Sep 10 22:39:44 smithi138 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-5[46984]: 2024-09-10T22:39:44.914+0000 7fa875fd8640 -1 osd.5 80 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-10T22:38:55.013982+0000 front 2024-09-10T22:38:55.013953+0000 (oldest deadline 2024-09-10T22:39:26.214626+0000) 2024-09-10T22:39:45.375 INFO:journalctl@ceph.osd.5.smithi138.stdout:Sep 10 22:39:44 smithi138 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-5[46984]: 2024-09-10T22:39:44.914+0000 7fa875fd8640 -1 osd.5 80 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2024-09-10T22:39:10.315703+0000 front 2024-09-10T22:39:10.315574+0000 (oldest deadline 2024-09-10T22:39:35.615567+0000) 2024-09-10T22:39:45.375 INFO:journalctl@ceph.osd.5.smithi138.stdout:Sep 10 22:39:44 smithi138 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-5[46984]: 2024-09-10T22:39:44.914+0000 7fa875fd8640 -1 osd.5 80 heartbeat_check: no reply from 172.21.15.138:6804 osd.2 since back 2024-09-10T22:39:21.218087+0000 front 2024-09-10T22:39:21.218106+0000 (oldest deadline 2024-09-10T22:39:44.118247+0000) 2024-09-10T22:39:45.376 INFO:journalctl@ceph.osd.8.smithi138.stdout:Sep 10 22:39:45 smithi138 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-8[53775]: 2024-09-10T22:39:45.071+0000 7f87faf53640 -1 osd.8 80 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2024-09-10T22:39:12.989835+0000 front 2024-09-10T22:39:12.989666+0000 (oldest deadline 2024-09-10T22:39:38.889906+0000) 2024-09-10T22:39:45.376 INFO:journalctl@ceph.osd.8.smithi138.stdout:Sep 10 22:39:45 smithi138 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-8[53775]: 2024-09-10T22:39:45.071+0000 7f87faf53640 -1 osd.8 80 heartbeat_check: no reply from 172.21.15.138:6804 osd.2 since back 2024-09-10T22:39:18.890233+0000 front 2024-09-10T22:39:18.890263+0000 (oldest deadline 2024-09-10T22:39:42.990418+0000) 2024-09-10T22:39:45.376 INFO:journalctl@ceph.osd.11.smithi138.stdout:Sep 10 22:39:45 smithi138 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-11[60796]: 2024-09-10T22:39:45.051+0000 7ffb00998640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-10T22:38:51.541208+0000 front 2024-09-10T22:38:51.541072+0000 (oldest deadline 2024-09-10T22:39:25.843622+0000) 2024-09-10T22:39:45.376 INFO:journalctl@ceph.osd.11.smithi138.stdout:Sep 10 22:39:45 smithi138 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-11[60796]: 2024-09-10T22:39:45.051+0000 7ffb00998640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2024-09-10T22:39:09.245148+0000 front 2024-09-10T22:39:09.245118+0000 (oldest deadline 2024-09-10T22:39:35.046015+0000) 2024-09-10T22:39:45.376 INFO:journalctl@ceph.osd.11.smithi138.stdout:Sep 10 22:39:45 smithi138 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-11[60796]: 2024-09-10T22:39:45.051+0000 7ffb00998640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.138:6804 osd.2 since back 2024-09-10T22:39:19.647426+0000 front 2024-09-10T22:39:19.647531+0000 (oldest deadline 2024-09-10T22:39:44.947487+0000) 2024-09-10T22:39:46.208 INFO:journalctl@ceph.osd.6.smithi019.stdout:Sep 10 22:39:45 smithi019 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-6[61536]: 2024-09-10T22:39:45.861+0000 7fbecfbb3640 -1 osd.6 80 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-10T22:38:50.981820+0000 front 2024-09-10T22:38:50.981842+0000 (oldest deadline 2024-09-10T22:39:27.183928+0000) 2024-09-10T22:39:46.209 INFO:journalctl@ceph.osd.6.smithi019.stdout:Sep 10 22:39:45 smithi019 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-6[61536]: 2024-09-10T22:39:45.861+0000 7fbecfbb3640 -1 osd.6 80 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2024-09-10T22:39:10.486176+0000 front 2024-09-10T22:39:10.486246+0000 (oldest deadline 2024-09-10T22:39:33.886409+0000) 2024-09-10T22:39:46.209 INFO:journalctl@ceph.osd.6.smithi019.stdout:Sep 10 22:39:45 smithi019 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-6[61536]: 2024-09-10T22:39:45.861+0000 7fbecfbb3640 -1 osd.6 80 heartbeat_check: no reply from 172.21.15.138:6804 osd.2 since back 2024-09-10T22:39:18.587269+0000 front 2024-09-10T22:39:18.587220+0000 (oldest deadline 2024-09-10T22:39:42.087256+0000) 2024-09-10T22:39:46.209 INFO:journalctl@ceph.osd.9.smithi019.stdout:Sep 10 22:39:45 smithi019 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-9[68022]: 2024-09-10T22:39:45.859+0000 7fa3f61d4640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-10T22:38:54.917764+0000 front 2024-09-10T22:38:54.917786+0000 (oldest deadline 2024-09-10T22:39:27.019686+0000) 2024-09-10T22:39:46.209 INFO:journalctl@ceph.osd.9.smithi019.stdout:Sep 10 22:39:45 smithi019 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-9[68022]: 2024-09-10T22:39:45.859+0000 7fa3f61d4640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2024-09-10T22:39:12.821560+0000 front 2024-09-10T22:39:12.821482+0000 (oldest deadline 2024-09-10T22:39:38.121512+0000) 2024-09-10T22:39:46.209 INFO:journalctl@ceph.osd.9.smithi019.stdout:Sep 10 22:39:45 smithi019 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-9[68022]: 2024-09-10T22:39:45.859+0000 7fa3f61d4640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.138:6804 osd.2 since back 2024-09-10T22:39:18.122242+0000 front 2024-09-10T22:39:18.122082+0000 (oldest deadline 2024-09-10T22:39:44.022038+0000) 2024-09-10T22:39:46.247 INFO:journalctl@ceph.osd.8.smithi138.stdout:Sep 10 22:39:46 smithi138 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-8[53775]: 2024-09-10T22:39:46.092+0000 7f87faf53640 -1 osd.8 80 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2024-09-10T22:39:12.989835+0000 front 2024-09-10T22:39:12.989666+0000 (oldest deadline 2024-09-10T22:39:38.889906+0000) 2024-09-10T22:39:46.247 INFO:journalctl@ceph.osd.8.smithi138.stdout:Sep 10 22:39:46 smithi138 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-8[53775]: 2024-09-10T22:39:46.092+0000 7f87faf53640 -1 osd.8 80 heartbeat_check: no reply from 172.21.15.138:6804 osd.2 since back 2024-09-10T22:39:18.890233+0000 front 2024-09-10T22:39:18.890263+0000 (oldest deadline 2024-09-10T22:39:42.990418+0000) 2024-09-10T22:39:46.247 INFO:journalctl@ceph.osd.5.smithi138.stdout:Sep 10 22:39:45 smithi138 podman[71218]: 2024-09-10 22:39:45.946509602 +0000 UTC m=+5.742854511 container died a103b41acd1f82a6ef69ed7e475e5eb14deafe923433c37cf1f3e6e51f2f4f15 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-5, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, ceph=True, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS) 2024-09-10T22:39:46.248 INFO:journalctl@ceph.osd.11.smithi138.stdout:Sep 10 22:39:46 smithi138 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-11[60796]: 2024-09-10T22:39:46.001+0000 7ffb00998640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-10T22:38:51.541208+0000 front 2024-09-10T22:38:51.541072+0000 (oldest deadline 2024-09-10T22:39:25.843622+0000) 2024-09-10T22:39:46.248 INFO:journalctl@ceph.osd.11.smithi138.stdout:Sep 10 22:39:46 smithi138 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-11[60796]: 2024-09-10T22:39:46.001+0000 7ffb00998640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2024-09-10T22:39:09.245148+0000 front 2024-09-10T22:39:09.245118+0000 (oldest deadline 2024-09-10T22:39:35.046015+0000) 2024-09-10T22:39:46.248 INFO:journalctl@ceph.osd.11.smithi138.stdout:Sep 10 22:39:46 smithi138 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-11[60796]: 2024-09-10T22:39:46.001+0000 7ffb00998640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.138:6804 osd.2 since back 2024-09-10T22:39:19.647426+0000 front 2024-09-10T22:39:19.647531+0000 (oldest deadline 2024-09-10T22:39:44.947487+0000) 2024-09-10T22:39:46.555 INFO:journalctl@ceph.osd.5.smithi138.stdout:Sep 10 22:39:46 smithi138 podman[71218]: 2024-09-10 22:39:46.344476605 +0000 UTC m=+6.140821513 container cleanup a103b41acd1f82a6ef69ed7e475e5eb14deafe923433c37cf1f3e6e51f2f4f15 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-5, org.label-schema.schema-version=1.0, ceph=True, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD) 2024-09-10T22:39:46.555 INFO:journalctl@ceph.osd.5.smithi138.stdout:Sep 10 22:39:46 smithi138 bash[71218]: ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-5 2024-09-10T22:39:46.610 INFO:journalctl@ceph.osd.7.smithi135.stdout:Sep 10 22:39:46 smithi135 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-7[53144]: 2024-09-10T22:39:46.301+0000 7ff6310c8640 -1 osd.7 80 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2024-09-10T22:39:11.910076+0000 front 2024-09-10T22:39:11.910097+0000 (oldest deadline 2024-09-10T22:39:36.010229+0000) 2024-09-10T22:39:46.610 INFO:journalctl@ceph.osd.7.smithi135.stdout:Sep 10 22:39:46 smithi135 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-7[53144]: 2024-09-10T22:39:46.301+0000 7ff6310c8640 -1 osd.7 80 heartbeat_check: no reply from 172.21.15.138:6804 osd.2 since back 2024-09-10T22:39:20.111330+0000 front 2024-09-10T22:39:20.111291+0000 (oldest deadline 2024-09-10T22:39:43.011420+0000) 2024-09-10T22:39:46.610 INFO:journalctl@ceph.osd.10.smithi135.stdout:Sep 10 22:39:46 smithi135 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-10[59985]: 2024-09-10T22:39:46.121+0000 7f3bf1a69640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-10T22:38:54.201226+0000 front 2024-09-10T22:38:54.201244+0000 (oldest deadline 2024-09-10T22:39:26.502183+0000) 2024-09-10T22:39:46.610 INFO:journalctl@ceph.osd.10.smithi135.stdout:Sep 10 22:39:46 smithi135 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-10[59985]: 2024-09-10T22:39:46.121+0000 7f3bf1a69640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2024-09-10T22:39:12.303632+0000 front 2024-09-10T22:39:12.303699+0000 (oldest deadline 2024-09-10T22:39:37.003674+0000) 2024-09-10T22:39:46.610 INFO:journalctl@ceph.osd.10.smithi135.stdout:Sep 10 22:39:46 smithi135 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-10[59985]: 2024-09-10T22:39:46.121+0000 7f3bf1a69640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.138:6804 osd.2 since back 2024-09-10T22:39:20.504425+0000 front 2024-09-10T22:39:20.504380+0000 (oldest deadline 2024-09-10T22:39:42.105008+0000) 2024-09-10T22:39:46.875 INFO:journalctl@ceph.osd.5.smithi138.stdout:Sep 10 22:39:46 smithi138 podman[71233]: 2024-09-10 22:39:46.553930333 +0000 UTC m=+0.605099813 container remove a103b41acd1f82a6ef69ed7e475e5eb14deafe923433c37cf1f3e6e51f2f4f15 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-5, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, ceph=True, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-10T22:39:47.199 INFO:journalctl@ceph.osd.8.smithi138.stdout:Sep 10 22:39:47 smithi138 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-8[53775]: 2024-09-10T22:39:47.050+0000 7f87faf53640 -1 osd.8 80 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2024-09-10T22:39:12.989835+0000 front 2024-09-10T22:39:12.989666+0000 (oldest deadline 2024-09-10T22:39:38.889906+0000) 2024-09-10T22:39:47.199 INFO:journalctl@ceph.osd.8.smithi138.stdout:Sep 10 22:39:47 smithi138 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-8[53775]: 2024-09-10T22:39:47.050+0000 7f87faf53640 -1 osd.8 80 heartbeat_check: no reply from 172.21.15.138:6804 osd.2 since back 2024-09-10T22:39:18.890233+0000 front 2024-09-10T22:39:18.890263+0000 (oldest deadline 2024-09-10T22:39:42.990418+0000) 2024-09-10T22:39:47.200 INFO:journalctl@ceph.osd.11.smithi138.stdout:Sep 10 22:39:46 smithi138 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-11[60796]: 2024-09-10T22:39:46.953+0000 7ffb00998640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-10T22:38:51.541208+0000 front 2024-09-10T22:38:51.541072+0000 (oldest deadline 2024-09-10T22:39:25.843622+0000) 2024-09-10T22:39:47.200 INFO:journalctl@ceph.osd.11.smithi138.stdout:Sep 10 22:39:46 smithi138 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-11[60796]: 2024-09-10T22:39:46.953+0000 7ffb00998640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2024-09-10T22:39:09.245148+0000 front 2024-09-10T22:39:09.245118+0000 (oldest deadline 2024-09-10T22:39:35.046015+0000) 2024-09-10T22:39:47.200 INFO:journalctl@ceph.osd.11.smithi138.stdout:Sep 10 22:39:46 smithi138 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-11[60796]: 2024-09-10T22:39:46.953+0000 7ffb00998640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.138:6804 osd.2 since back 2024-09-10T22:39:19.647426+0000 front 2024-09-10T22:39:19.647531+0000 (oldest deadline 2024-09-10T22:39:44.947487+0000) 2024-09-10T22:39:47.200 INFO:journalctl@ceph.osd.5.smithi138.stdout:Sep 10 22:39:46 smithi138 podman[71323]: 2024-09-10 22:39:46.879676898 +0000 UTC m=+0.111694784 container create 6c167fa193ce70d25fd82447f2f2c10cb431ff8cf3405753c0af13898bff0164 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-5-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_CLEAN=True, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux ) 2024-09-10T22:39:47.200 INFO:journalctl@ceph.osd.5.smithi138.stdout:Sep 10 22:39:46 smithi138 podman[71323]: 2024-09-10 22:39:46.784176361 +0000 UTC m=+0.016194211 image pull 589dd18248e494ba411dc838aa4ae0e5e569213f08fcd7a2cf22cd3ef7e3c480 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e 2024-09-10T22:39:47.200 INFO:journalctl@ceph.osd.5.smithi138.stdout:Sep 10 22:39:47 smithi138 podman[71323]: 2024-09-10 22:39:47.099030149 +0000 UTC m=+0.331047998 container init 6c167fa193ce70d25fd82447f2f2c10cb431ff8cf3405753c0af13898bff0164 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-5-deactivate, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, maintainer=Guillaume Abrioux , GIT_CLEAN=True) 2024-09-10T22:39:47.200 INFO:journalctl@ceph.osd.5.smithi138.stdout:Sep 10 22:39:47 smithi138 podman[71323]: 2024-09-10 22:39:47.102513957 +0000 UTC m=+0.334531808 container start 6c167fa193ce70d25fd82447f2f2c10cb431ff8cf3405753c0af13898bff0164 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-5-deactivate, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True) 2024-09-10T22:39:47.201 INFO:journalctl@ceph.osd.5.smithi138.stdout:Sep 10 22:39:47 smithi138 podman[71323]: 2024-09-10 22:39:47.19848829 +0000 UTC m=+0.430506132 container attach 6c167fa193ce70d25fd82447f2f2c10cb431ff8cf3405753c0af13898bff0164 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-5-deactivate, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , ceph=True) 2024-09-10T22:39:47.208 INFO:journalctl@ceph.osd.6.smithi019.stdout:Sep 10 22:39:46 smithi019 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-6[61536]: 2024-09-10T22:39:46.884+0000 7fbecfbb3640 -1 osd.6 80 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-10T22:38:50.981820+0000 front 2024-09-10T22:38:50.981842+0000 (oldest deadline 2024-09-10T22:39:27.183928+0000) 2024-09-10T22:39:47.208 INFO:journalctl@ceph.osd.6.smithi019.stdout:Sep 10 22:39:46 smithi019 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-6[61536]: 2024-09-10T22:39:46.884+0000 7fbecfbb3640 -1 osd.6 80 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2024-09-10T22:39:10.486176+0000 front 2024-09-10T22:39:10.486246+0000 (oldest deadline 2024-09-10T22:39:33.886409+0000) 2024-09-10T22:39:47.208 INFO:journalctl@ceph.osd.6.smithi019.stdout:Sep 10 22:39:46 smithi019 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-6[61536]: 2024-09-10T22:39:46.884+0000 7fbecfbb3640 -1 osd.6 80 heartbeat_check: no reply from 172.21.15.138:6804 osd.2 since back 2024-09-10T22:39:18.587269+0000 front 2024-09-10T22:39:18.587220+0000 (oldest deadline 2024-09-10T22:39:42.087256+0000) 2024-09-10T22:39:47.209 INFO:journalctl@ceph.osd.9.smithi019.stdout:Sep 10 22:39:46 smithi019 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-9[68022]: 2024-09-10T22:39:46.877+0000 7fa3f61d4640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-10T22:38:54.917764+0000 front 2024-09-10T22:38:54.917786+0000 (oldest deadline 2024-09-10T22:39:27.019686+0000) 2024-09-10T22:39:47.209 INFO:journalctl@ceph.osd.9.smithi019.stdout:Sep 10 22:39:46 smithi019 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-9[68022]: 2024-09-10T22:39:46.877+0000 7fa3f61d4640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2024-09-10T22:39:12.821560+0000 front 2024-09-10T22:39:12.821482+0000 (oldest deadline 2024-09-10T22:39:38.121512+0000) 2024-09-10T22:39:47.209 INFO:journalctl@ceph.osd.9.smithi019.stdout:Sep 10 22:39:46 smithi019 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-9[68022]: 2024-09-10T22:39:46.877+0000 7fa3f61d4640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.138:6804 osd.2 since back 2024-09-10T22:39:18.122242+0000 front 2024-09-10T22:39:18.122082+0000 (oldest deadline 2024-09-10T22:39:44.022038+0000) 2024-09-10T22:39:47.602 INFO:journalctl@ceph.osd.5.smithi138.stdout:Sep 10 22:39:47 smithi138 podman[71323]: 2024-09-10 22:39:47.293533673 +0000 UTC m=+0.525551528 container died 6c167fa193ce70d25fd82447f2f2c10cb431ff8cf3405753c0af13898bff0164 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-5-deactivate, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.build-date=20240731, GIT_CLEAN=True, GIT_BRANCH=HEAD) 2024-09-10T22:39:47.610 INFO:journalctl@ceph.osd.7.smithi135.stdout:Sep 10 22:39:47 smithi135 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-7[53144]: 2024-09-10T22:39:47.253+0000 7ff6310c8640 -1 osd.7 80 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2024-09-10T22:39:11.910076+0000 front 2024-09-10T22:39:11.910097+0000 (oldest deadline 2024-09-10T22:39:36.010229+0000) 2024-09-10T22:39:47.610 INFO:journalctl@ceph.osd.7.smithi135.stdout:Sep 10 22:39:47 smithi135 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-7[53144]: 2024-09-10T22:39:47.253+0000 7ff6310c8640 -1 osd.7 80 heartbeat_check: no reply from 172.21.15.138:6804 osd.2 since back 2024-09-10T22:39:20.111330+0000 front 2024-09-10T22:39:20.111291+0000 (oldest deadline 2024-09-10T22:39:43.011420+0000) 2024-09-10T22:39:47.610 INFO:journalctl@ceph.osd.10.smithi135.stdout:Sep 10 22:39:47 smithi135 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-10[59985]: 2024-09-10T22:39:47.119+0000 7f3bf1a69640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-10T22:38:54.201226+0000 front 2024-09-10T22:38:54.201244+0000 (oldest deadline 2024-09-10T22:39:26.502183+0000) 2024-09-10T22:39:47.610 INFO:journalctl@ceph.osd.10.smithi135.stdout:Sep 10 22:39:47 smithi135 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-10[59985]: 2024-09-10T22:39:47.119+0000 7f3bf1a69640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2024-09-10T22:39:12.303632+0000 front 2024-09-10T22:39:12.303699+0000 (oldest deadline 2024-09-10T22:39:37.003674+0000) 2024-09-10T22:39:47.610 INFO:journalctl@ceph.osd.10.smithi135.stdout:Sep 10 22:39:47 smithi135 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-10[59985]: 2024-09-10T22:39:47.119+0000 7f3bf1a69640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.138:6804 osd.2 since back 2024-09-10T22:39:20.504425+0000 front 2024-09-10T22:39:20.504380+0000 (oldest deadline 2024-09-10T22:39:42.105008+0000) 2024-09-10T22:39:47.898 DEBUG:teuthology.orchestra.run.smithi138:> sudo pkill -f 'journalctl -f -n 0 -u ceph-22997a4c-6fc2-11ef-bcea-c7b262605968@osd.5.service' 2024-09-10T22:39:47.937 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-10T22:39:47.937 INFO:tasks.cephadm.osd.5:Stopped osd.5 2024-09-10T22:39:47.937 INFO:tasks.cephadm.osd.6:Stopping osd.6... 2024-09-10T22:39:47.937 DEBUG:teuthology.orchestra.run.smithi019:> sudo systemctl stop ceph-22997a4c-6fc2-11ef-bcea-c7b262605968@osd.6 2024-09-10T22:39:48.125 INFO:journalctl@ceph.osd.8.smithi138.stdout:Sep 10 22:39:48 smithi138 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-8[53775]: 2024-09-10T22:39:48.017+0000 7f87faf53640 -1 osd.8 80 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2024-09-10T22:39:12.989835+0000 front 2024-09-10T22:39:12.989666+0000 (oldest deadline 2024-09-10T22:39:38.889906+0000) 2024-09-10T22:39:48.125 INFO:journalctl@ceph.osd.8.smithi138.stdout:Sep 10 22:39:48 smithi138 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-8[53775]: 2024-09-10T22:39:48.017+0000 7f87faf53640 -1 osd.8 80 heartbeat_check: no reply from 172.21.15.138:6804 osd.2 since back 2024-09-10T22:39:18.890233+0000 front 2024-09-10T22:39:18.890263+0000 (oldest deadline 2024-09-10T22:39:42.990418+0000) 2024-09-10T22:39:48.126 INFO:journalctl@ceph.osd.11.smithi138.stdout:Sep 10 22:39:47 smithi138 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-11[60796]: 2024-09-10T22:39:47.966+0000 7ffb00998640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-10T22:38:51.541208+0000 front 2024-09-10T22:38:51.541072+0000 (oldest deadline 2024-09-10T22:39:25.843622+0000) 2024-09-10T22:39:48.126 INFO:journalctl@ceph.osd.11.smithi138.stdout:Sep 10 22:39:47 smithi138 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-11[60796]: 2024-09-10T22:39:47.966+0000 7ffb00998640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2024-09-10T22:39:09.245148+0000 front 2024-09-10T22:39:09.245118+0000 (oldest deadline 2024-09-10T22:39:35.046015+0000) 2024-09-10T22:39:48.126 INFO:journalctl@ceph.osd.11.smithi138.stdout:Sep 10 22:39:47 smithi138 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-11[60796]: 2024-09-10T22:39:47.966+0000 7ffb00998640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.138:6804 osd.2 since back 2024-09-10T22:39:19.647426+0000 front 2024-09-10T22:39:19.647531+0000 (oldest deadline 2024-09-10T22:39:44.947487+0000) 2024-09-10T22:39:48.209 INFO:journalctl@ceph.osd.6.smithi019.stdout:Sep 10 22:39:47 smithi019 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-6[61536]: 2024-09-10T22:39:47.909+0000 7fbecfbb3640 -1 osd.6 80 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-10T22:38:50.981820+0000 front 2024-09-10T22:38:50.981842+0000 (oldest deadline 2024-09-10T22:39:27.183928+0000) 2024-09-10T22:39:48.209 INFO:journalctl@ceph.osd.6.smithi019.stdout:Sep 10 22:39:47 smithi019 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-6[61536]: 2024-09-10T22:39:47.909+0000 7fbecfbb3640 -1 osd.6 80 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2024-09-10T22:39:10.486176+0000 front 2024-09-10T22:39:10.486246+0000 (oldest deadline 2024-09-10T22:39:33.886409+0000) 2024-09-10T22:39:48.209 INFO:journalctl@ceph.osd.6.smithi019.stdout:Sep 10 22:39:47 smithi019 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-6[61536]: 2024-09-10T22:39:47.909+0000 7fbecfbb3640 -1 osd.6 80 heartbeat_check: no reply from 172.21.15.138:6804 osd.2 since back 2024-09-10T22:39:18.587269+0000 front 2024-09-10T22:39:18.587220+0000 (oldest deadline 2024-09-10T22:39:42.087256+0000) 2024-09-10T22:39:48.209 INFO:journalctl@ceph.osd.6.smithi019.stdout:Sep 10 22:39:47 smithi019 systemd[1]: Stopping Ceph osd.6 for 22997a4c-6fc2-11ef-bcea-c7b262605968... 2024-09-10T22:39:48.209 INFO:journalctl@ceph.osd.9.smithi019.stdout:Sep 10 22:39:47 smithi019 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-9[68022]: 2024-09-10T22:39:47.854+0000 7fa3f61d4640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-10T22:38:54.917764+0000 front 2024-09-10T22:38:54.917786+0000 (oldest deadline 2024-09-10T22:39:27.019686+0000) 2024-09-10T22:39:48.209 INFO:journalctl@ceph.osd.9.smithi019.stdout:Sep 10 22:39:47 smithi019 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-9[68022]: 2024-09-10T22:39:47.854+0000 7fa3f61d4640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2024-09-10T22:39:12.821560+0000 front 2024-09-10T22:39:12.821482+0000 (oldest deadline 2024-09-10T22:39:38.121512+0000) 2024-09-10T22:39:48.209 INFO:journalctl@ceph.osd.9.smithi019.stdout:Sep 10 22:39:47 smithi019 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-9[68022]: 2024-09-10T22:39:47.854+0000 7fa3f61d4640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.138:6804 osd.2 since back 2024-09-10T22:39:18.122242+0000 front 2024-09-10T22:39:18.122082+0000 (oldest deadline 2024-09-10T22:39:44.022038+0000) 2024-09-10T22:39:48.610 INFO:journalctl@ceph.osd.7.smithi135.stdout:Sep 10 22:39:48 smithi135 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-7[53144]: 2024-09-10T22:39:48.212+0000 7ff6310c8640 -1 osd.7 80 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2024-09-10T22:39:11.910076+0000 front 2024-09-10T22:39:11.910097+0000 (oldest deadline 2024-09-10T22:39:36.010229+0000) 2024-09-10T22:39:48.610 INFO:journalctl@ceph.osd.7.smithi135.stdout:Sep 10 22:39:48 smithi135 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-7[53144]: 2024-09-10T22:39:48.212+0000 7ff6310c8640 -1 osd.7 80 heartbeat_check: no reply from 172.21.15.138:6804 osd.2 since back 2024-09-10T22:39:20.111330+0000 front 2024-09-10T22:39:20.111291+0000 (oldest deadline 2024-09-10T22:39:43.011420+0000) 2024-09-10T22:39:48.610 INFO:journalctl@ceph.osd.10.smithi135.stdout:Sep 10 22:39:48 smithi135 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-10[59985]: 2024-09-10T22:39:48.121+0000 7f3bf1a69640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-10T22:38:54.201226+0000 front 2024-09-10T22:38:54.201244+0000 (oldest deadline 2024-09-10T22:39:26.502183+0000) 2024-09-10T22:39:48.610 INFO:journalctl@ceph.osd.10.smithi135.stdout:Sep 10 22:39:48 smithi135 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-10[59985]: 2024-09-10T22:39:48.121+0000 7f3bf1a69640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2024-09-10T22:39:12.303632+0000 front 2024-09-10T22:39:12.303699+0000 (oldest deadline 2024-09-10T22:39:37.003674+0000) 2024-09-10T22:39:48.610 INFO:journalctl@ceph.osd.10.smithi135.stdout:Sep 10 22:39:48 smithi135 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-10[59985]: 2024-09-10T22:39:48.121+0000 7f3bf1a69640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.138:6804 osd.2 since back 2024-09-10T22:39:20.504425+0000 front 2024-09-10T22:39:20.504380+0000 (oldest deadline 2024-09-10T22:39:42.105008+0000) 2024-09-10T22:39:48.708 INFO:journalctl@ceph.osd.6.smithi019.stdout:Sep 10 22:39:48 smithi019 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-6[61536]: 2024-09-10T22:39:48.245+0000 7fbed359e640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.6 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-10T22:39:48.708 INFO:journalctl@ceph.osd.6.smithi019.stdout:Sep 10 22:39:48 smithi019 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-6[61536]: 2024-09-10T22:39:48.245+0000 7fbed359e640 -1 osd.6 80 *** Got signal Terminated *** 2024-09-10T22:39:48.709 INFO:journalctl@ceph.osd.6.smithi019.stdout:Sep 10 22:39:48 smithi019 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-6[61536]: 2024-09-10T22:39:48.245+0000 7fbed359e640 -1 osd.6 80 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-10T22:39:49.208 INFO:journalctl@ceph.osd.6.smithi019.stdout:Sep 10 22:39:48 smithi019 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-6[61536]: 2024-09-10T22:39:48.944+0000 7fbecfbb3640 -1 osd.6 80 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-10T22:38:50.981820+0000 front 2024-09-10T22:38:50.981842+0000 (oldest deadline 2024-09-10T22:39:27.183928+0000) 2024-09-10T22:39:49.209 INFO:journalctl@ceph.osd.6.smithi019.stdout:Sep 10 22:39:48 smithi019 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-6[61536]: 2024-09-10T22:39:48.944+0000 7fbecfbb3640 -1 osd.6 80 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2024-09-10T22:39:10.486176+0000 front 2024-09-10T22:39:10.486246+0000 (oldest deadline 2024-09-10T22:39:33.886409+0000) 2024-09-10T22:39:49.209 INFO:journalctl@ceph.osd.6.smithi019.stdout:Sep 10 22:39:48 smithi019 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-6[61536]: 2024-09-10T22:39:48.944+0000 7fbecfbb3640 -1 osd.6 80 heartbeat_check: no reply from 172.21.15.138:6804 osd.2 since back 2024-09-10T22:39:18.587269+0000 front 2024-09-10T22:39:18.587220+0000 (oldest deadline 2024-09-10T22:39:42.087256+0000) 2024-09-10T22:39:49.209 INFO:journalctl@ceph.osd.9.smithi019.stdout:Sep 10 22:39:48 smithi019 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-9[68022]: 2024-09-10T22:39:48.827+0000 7fa3f61d4640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-10T22:38:54.917764+0000 front 2024-09-10T22:38:54.917786+0000 (oldest deadline 2024-09-10T22:39:27.019686+0000) 2024-09-10T22:39:49.209 INFO:journalctl@ceph.osd.9.smithi019.stdout:Sep 10 22:39:48 smithi019 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-9[68022]: 2024-09-10T22:39:48.827+0000 7fa3f61d4640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2024-09-10T22:39:12.821560+0000 front 2024-09-10T22:39:12.821482+0000 (oldest deadline 2024-09-10T22:39:38.121512+0000) 2024-09-10T22:39:49.209 INFO:journalctl@ceph.osd.9.smithi019.stdout:Sep 10 22:39:48 smithi019 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-9[68022]: 2024-09-10T22:39:48.827+0000 7fa3f61d4640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.138:6804 osd.2 since back 2024-09-10T22:39:18.122242+0000 front 2024-09-10T22:39:18.122082+0000 (oldest deadline 2024-09-10T22:39:44.022038+0000) 2024-09-10T22:39:49.360 INFO:journalctl@ceph.osd.7.smithi135.stdout:Sep 10 22:39:49 smithi135 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-7[53144]: 2024-09-10T22:39:49.187+0000 7ff6310c8640 -1 osd.7 80 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2024-09-10T22:39:11.910076+0000 front 2024-09-10T22:39:11.910097+0000 (oldest deadline 2024-09-10T22:39:36.010229+0000) 2024-09-10T22:39:49.360 INFO:journalctl@ceph.osd.7.smithi135.stdout:Sep 10 22:39:49 smithi135 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-7[53144]: 2024-09-10T22:39:49.187+0000 7ff6310c8640 -1 osd.7 80 heartbeat_check: no reply from 172.21.15.138:6804 osd.2 since back 2024-09-10T22:39:20.111330+0000 front 2024-09-10T22:39:20.111291+0000 (oldest deadline 2024-09-10T22:39:43.011420+0000) 2024-09-10T22:39:49.361 INFO:journalctl@ceph.osd.10.smithi135.stdout:Sep 10 22:39:49 smithi135 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-10[59985]: 2024-09-10T22:39:49.073+0000 7f3bf1a69640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-10T22:38:54.201226+0000 front 2024-09-10T22:38:54.201244+0000 (oldest deadline 2024-09-10T22:39:26.502183+0000) 2024-09-10T22:39:49.361 INFO:journalctl@ceph.osd.10.smithi135.stdout:Sep 10 22:39:49 smithi135 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-10[59985]: 2024-09-10T22:39:49.073+0000 7f3bf1a69640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2024-09-10T22:39:12.303632+0000 front 2024-09-10T22:39:12.303699+0000 (oldest deadline 2024-09-10T22:39:37.003674+0000) 2024-09-10T22:39:49.361 INFO:journalctl@ceph.osd.10.smithi135.stdout:Sep 10 22:39:49 smithi135 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-10[59985]: 2024-09-10T22:39:49.073+0000 7f3bf1a69640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.138:6804 osd.2 since back 2024-09-10T22:39:20.504425+0000 front 2024-09-10T22:39:20.504380+0000 (oldest deadline 2024-09-10T22:39:42.105008+0000) 2024-09-10T22:39:49.375 INFO:journalctl@ceph.osd.8.smithi138.stdout:Sep 10 22:39:49 smithi138 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-8[53775]: 2024-09-10T22:39:49.046+0000 7f87faf53640 -1 osd.8 80 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2024-09-10T22:39:12.989835+0000 front 2024-09-10T22:39:12.989666+0000 (oldest deadline 2024-09-10T22:39:38.889906+0000) 2024-09-10T22:39:49.375 INFO:journalctl@ceph.osd.8.smithi138.stdout:Sep 10 22:39:49 smithi138 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-8[53775]: 2024-09-10T22:39:49.046+0000 7f87faf53640 -1 osd.8 80 heartbeat_check: no reply from 172.21.15.138:6804 osd.2 since back 2024-09-10T22:39:18.890233+0000 front 2024-09-10T22:39:18.890263+0000 (oldest deadline 2024-09-10T22:39:42.990418+0000) 2024-09-10T22:39:49.375 INFO:journalctl@ceph.osd.11.smithi138.stdout:Sep 10 22:39:48 smithi138 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-11[60796]: 2024-09-10T22:39:48.936+0000 7ffb00998640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-10T22:38:51.541208+0000 front 2024-09-10T22:38:51.541072+0000 (oldest deadline 2024-09-10T22:39:25.843622+0000) 2024-09-10T22:39:49.375 INFO:journalctl@ceph.osd.11.smithi138.stdout:Sep 10 22:39:48 smithi138 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-11[60796]: 2024-09-10T22:39:48.936+0000 7ffb00998640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2024-09-10T22:39:09.245148+0000 front 2024-09-10T22:39:09.245118+0000 (oldest deadline 2024-09-10T22:39:35.046015+0000) 2024-09-10T22:39:49.376 INFO:journalctl@ceph.osd.11.smithi138.stdout:Sep 10 22:39:48 smithi138 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-11[60796]: 2024-09-10T22:39:48.936+0000 7ffb00998640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.138:6804 osd.2 since back 2024-09-10T22:39:19.647426+0000 front 2024-09-10T22:39:19.647531+0000 (oldest deadline 2024-09-10T22:39:44.947487+0000) 2024-09-10T22:39:50.209 INFO:journalctl@ceph.osd.6.smithi019.stdout:Sep 10 22:39:49 smithi019 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-6[61536]: 2024-09-10T22:39:49.924+0000 7fbecfbb3640 -1 osd.6 80 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-10T22:38:50.981820+0000 front 2024-09-10T22:38:50.981842+0000 (oldest deadline 2024-09-10T22:39:27.183928+0000) 2024-09-10T22:39:50.209 INFO:journalctl@ceph.osd.6.smithi019.stdout:Sep 10 22:39:49 smithi019 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-6[61536]: 2024-09-10T22:39:49.924+0000 7fbecfbb3640 -1 osd.6 80 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2024-09-10T22:39:10.486176+0000 front 2024-09-10T22:39:10.486246+0000 (oldest deadline 2024-09-10T22:39:33.886409+0000) 2024-09-10T22:39:50.209 INFO:journalctl@ceph.osd.6.smithi019.stdout:Sep 10 22:39:49 smithi019 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-6[61536]: 2024-09-10T22:39:49.924+0000 7fbecfbb3640 -1 osd.6 80 heartbeat_check: no reply from 172.21.15.138:6804 osd.2 since back 2024-09-10T22:39:18.587269+0000 front 2024-09-10T22:39:18.587220+0000 (oldest deadline 2024-09-10T22:39:42.087256+0000) 2024-09-10T22:39:50.209 INFO:journalctl@ceph.osd.9.smithi019.stdout:Sep 10 22:39:49 smithi019 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-9[68022]: 2024-09-10T22:39:49.806+0000 7fa3f61d4640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-10T22:38:54.917764+0000 front 2024-09-10T22:38:54.917786+0000 (oldest deadline 2024-09-10T22:39:27.019686+0000) 2024-09-10T22:39:50.209 INFO:journalctl@ceph.osd.9.smithi019.stdout:Sep 10 22:39:49 smithi019 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-9[68022]: 2024-09-10T22:39:49.806+0000 7fa3f61d4640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2024-09-10T22:39:12.821560+0000 front 2024-09-10T22:39:12.821482+0000 (oldest deadline 2024-09-10T22:39:38.121512+0000) 2024-09-10T22:39:50.209 INFO:journalctl@ceph.osd.9.smithi019.stdout:Sep 10 22:39:49 smithi019 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-9[68022]: 2024-09-10T22:39:49.806+0000 7fa3f61d4640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.138:6804 osd.2 since back 2024-09-10T22:39:18.122242+0000 front 2024-09-10T22:39:18.122082+0000 (oldest deadline 2024-09-10T22:39:44.022038+0000) 2024-09-10T22:39:50.360 INFO:journalctl@ceph.osd.7.smithi135.stdout:Sep 10 22:39:50 smithi135 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-7[53144]: 2024-09-10T22:39:50.155+0000 7ff6310c8640 -1 osd.7 80 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2024-09-10T22:39:11.910076+0000 front 2024-09-10T22:39:11.910097+0000 (oldest deadline 2024-09-10T22:39:36.010229+0000) 2024-09-10T22:39:50.360 INFO:journalctl@ceph.osd.7.smithi135.stdout:Sep 10 22:39:50 smithi135 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-7[53144]: 2024-09-10T22:39:50.155+0000 7ff6310c8640 -1 osd.7 80 heartbeat_check: no reply from 172.21.15.138:6804 osd.2 since back 2024-09-10T22:39:20.111330+0000 front 2024-09-10T22:39:20.111291+0000 (oldest deadline 2024-09-10T22:39:43.011420+0000) 2024-09-10T22:39:50.360 INFO:journalctl@ceph.osd.7.smithi135.stdout:Sep 10 22:39:50 smithi135 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-7[53144]: 2024-09-10T22:39:50.155+0000 7ff6310c8640 -1 osd.7 80 heartbeat_check: no reply from 172.21.15.19:6814 osd.3 since back 2024-09-10T22:39:28.312521+0000 front 2024-09-10T22:39:28.312461+0000 (oldest deadline 2024-09-10T22:39:50.012508+0000) 2024-09-10T22:39:50.360 INFO:journalctl@ceph.osd.10.smithi135.stdout:Sep 10 22:39:50 smithi135 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-10[59985]: 2024-09-10T22:39:50.105+0000 7f3bf1a69640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-10T22:38:54.201226+0000 front 2024-09-10T22:38:54.201244+0000 (oldest deadline 2024-09-10T22:39:26.502183+0000) 2024-09-10T22:39:50.360 INFO:journalctl@ceph.osd.10.smithi135.stdout:Sep 10 22:39:50 smithi135 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-10[59985]: 2024-09-10T22:39:50.105+0000 7f3bf1a69640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2024-09-10T22:39:12.303632+0000 front 2024-09-10T22:39:12.303699+0000 (oldest deadline 2024-09-10T22:39:37.003674+0000) 2024-09-10T22:39:50.361 INFO:journalctl@ceph.osd.10.smithi135.stdout:Sep 10 22:39:50 smithi135 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-10[59985]: 2024-09-10T22:39:50.105+0000 7f3bf1a69640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.138:6804 osd.2 since back 2024-09-10T22:39:20.504425+0000 front 2024-09-10T22:39:20.504380+0000 (oldest deadline 2024-09-10T22:39:42.105008+0000) 2024-09-10T22:39:50.375 INFO:journalctl@ceph.osd.8.smithi138.stdout:Sep 10 22:39:50 smithi138 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-8[53775]: 2024-09-10T22:39:50.042+0000 7f87faf53640 -1 osd.8 80 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2024-09-10T22:39:12.989835+0000 front 2024-09-10T22:39:12.989666+0000 (oldest deadline 2024-09-10T22:39:38.889906+0000) 2024-09-10T22:39:50.375 INFO:journalctl@ceph.osd.8.smithi138.stdout:Sep 10 22:39:50 smithi138 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-8[53775]: 2024-09-10T22:39:50.042+0000 7f87faf53640 -1 osd.8 80 heartbeat_check: no reply from 172.21.15.138:6804 osd.2 since back 2024-09-10T22:39:18.890233+0000 front 2024-09-10T22:39:18.890263+0000 (oldest deadline 2024-09-10T22:39:42.990418+0000) 2024-09-10T22:39:50.375 INFO:journalctl@ceph.osd.11.smithi138.stdout:Sep 10 22:39:49 smithi138 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-11[60796]: 2024-09-10T22:39:49.895+0000 7ffb00998640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-10T22:38:51.541208+0000 front 2024-09-10T22:38:51.541072+0000 (oldest deadline 2024-09-10T22:39:25.843622+0000) 2024-09-10T22:39:50.376 INFO:journalctl@ceph.osd.11.smithi138.stdout:Sep 10 22:39:49 smithi138 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-11[60796]: 2024-09-10T22:39:49.895+0000 7ffb00998640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2024-09-10T22:39:09.245148+0000 front 2024-09-10T22:39:09.245118+0000 (oldest deadline 2024-09-10T22:39:35.046015+0000) 2024-09-10T22:39:50.376 INFO:journalctl@ceph.osd.11.smithi138.stdout:Sep 10 22:39:49 smithi138 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-11[60796]: 2024-09-10T22:39:49.895+0000 7ffb00998640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.138:6804 osd.2 since back 2024-09-10T22:39:19.647426+0000 front 2024-09-10T22:39:19.647531+0000 (oldest deadline 2024-09-10T22:39:44.947487+0000) 2024-09-10T22:39:51.208 INFO:journalctl@ceph.osd.6.smithi019.stdout:Sep 10 22:39:50 smithi019 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-6[61536]: 2024-09-10T22:39:50.943+0000 7fbecfbb3640 -1 osd.6 80 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-10T22:38:50.981820+0000 front 2024-09-10T22:38:50.981842+0000 (oldest deadline 2024-09-10T22:39:27.183928+0000) 2024-09-10T22:39:51.209 INFO:journalctl@ceph.osd.6.smithi019.stdout:Sep 10 22:39:50 smithi019 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-6[61536]: 2024-09-10T22:39:50.943+0000 7fbecfbb3640 -1 osd.6 80 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2024-09-10T22:39:10.486176+0000 front 2024-09-10T22:39:10.486246+0000 (oldest deadline 2024-09-10T22:39:33.886409+0000) 2024-09-10T22:39:51.209 INFO:journalctl@ceph.osd.6.smithi019.stdout:Sep 10 22:39:50 smithi019 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-6[61536]: 2024-09-10T22:39:50.943+0000 7fbecfbb3640 -1 osd.6 80 heartbeat_check: no reply from 172.21.15.138:6804 osd.2 since back 2024-09-10T22:39:18.587269+0000 front 2024-09-10T22:39:18.587220+0000 (oldest deadline 2024-09-10T22:39:42.087256+0000) 2024-09-10T22:39:51.209 INFO:journalctl@ceph.osd.9.smithi019.stdout:Sep 10 22:39:50 smithi019 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-9[68022]: 2024-09-10T22:39:50.781+0000 7fa3f61d4640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-10T22:38:54.917764+0000 front 2024-09-10T22:38:54.917786+0000 (oldest deadline 2024-09-10T22:39:27.019686+0000) 2024-09-10T22:39:51.209 INFO:journalctl@ceph.osd.9.smithi019.stdout:Sep 10 22:39:50 smithi019 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-9[68022]: 2024-09-10T22:39:50.781+0000 7fa3f61d4640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2024-09-10T22:39:12.821560+0000 front 2024-09-10T22:39:12.821482+0000 (oldest deadline 2024-09-10T22:39:38.121512+0000) 2024-09-10T22:39:51.209 INFO:journalctl@ceph.osd.9.smithi019.stdout:Sep 10 22:39:50 smithi019 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-9[68022]: 2024-09-10T22:39:50.781+0000 7fa3f61d4640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.138:6804 osd.2 since back 2024-09-10T22:39:18.122242+0000 front 2024-09-10T22:39:18.122082+0000 (oldest deadline 2024-09-10T22:39:44.022038+0000) 2024-09-10T22:39:51.360 INFO:journalctl@ceph.osd.10.smithi135.stdout:Sep 10 22:39:51 smithi135 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-10[59985]: 2024-09-10T22:39:51.074+0000 7f3bf1a69640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-10T22:38:54.201226+0000 front 2024-09-10T22:38:54.201244+0000 (oldest deadline 2024-09-10T22:39:26.502183+0000) 2024-09-10T22:39:51.360 INFO:journalctl@ceph.osd.10.smithi135.stdout:Sep 10 22:39:51 smithi135 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-10[59985]: 2024-09-10T22:39:51.074+0000 7f3bf1a69640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2024-09-10T22:39:12.303632+0000 front 2024-09-10T22:39:12.303699+0000 (oldest deadline 2024-09-10T22:39:37.003674+0000) 2024-09-10T22:39:51.360 INFO:journalctl@ceph.osd.10.smithi135.stdout:Sep 10 22:39:51 smithi135 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-10[59985]: 2024-09-10T22:39:51.074+0000 7f3bf1a69640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.138:6804 osd.2 since back 2024-09-10T22:39:20.504425+0000 front 2024-09-10T22:39:20.504380+0000 (oldest deadline 2024-09-10T22:39:42.105008+0000) 2024-09-10T22:39:51.360 INFO:journalctl@ceph.osd.7.smithi135.stdout:Sep 10 22:39:51 smithi135 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-7[53144]: 2024-09-10T22:39:51.145+0000 7ff6310c8640 -1 osd.7 80 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2024-09-10T22:39:11.910076+0000 front 2024-09-10T22:39:11.910097+0000 (oldest deadline 2024-09-10T22:39:36.010229+0000) 2024-09-10T22:39:51.360 INFO:journalctl@ceph.osd.7.smithi135.stdout:Sep 10 22:39:51 smithi135 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-7[53144]: 2024-09-10T22:39:51.145+0000 7ff6310c8640 -1 osd.7 80 heartbeat_check: no reply from 172.21.15.138:6804 osd.2 since back 2024-09-10T22:39:20.111330+0000 front 2024-09-10T22:39:20.111291+0000 (oldest deadline 2024-09-10T22:39:43.011420+0000) 2024-09-10T22:39:51.360 INFO:journalctl@ceph.osd.7.smithi135.stdout:Sep 10 22:39:51 smithi135 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-7[53144]: 2024-09-10T22:39:51.145+0000 7ff6310c8640 -1 osd.7 80 heartbeat_check: no reply from 172.21.15.19:6814 osd.3 since back 2024-09-10T22:39:28.312521+0000 front 2024-09-10T22:39:28.312461+0000 (oldest deadline 2024-09-10T22:39:50.012508+0000) 2024-09-10T22:39:51.375 INFO:journalctl@ceph.osd.8.smithi138.stdout:Sep 10 22:39:51 smithi138 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-8[53775]: 2024-09-10T22:39:51.024+0000 7f87faf53640 -1 osd.8 80 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2024-09-10T22:39:12.989835+0000 front 2024-09-10T22:39:12.989666+0000 (oldest deadline 2024-09-10T22:39:38.889906+0000) 2024-09-10T22:39:51.375 INFO:journalctl@ceph.osd.8.smithi138.stdout:Sep 10 22:39:51 smithi138 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-8[53775]: 2024-09-10T22:39:51.024+0000 7f87faf53640 -1 osd.8 80 heartbeat_check: no reply from 172.21.15.138:6804 osd.2 since back 2024-09-10T22:39:18.890233+0000 front 2024-09-10T22:39:18.890263+0000 (oldest deadline 2024-09-10T22:39:42.990418+0000) 2024-09-10T22:39:51.375 INFO:journalctl@ceph.osd.11.smithi138.stdout:Sep 10 22:39:50 smithi138 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-11[60796]: 2024-09-10T22:39:50.878+0000 7ffb00998640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-10T22:38:51.541208+0000 front 2024-09-10T22:38:51.541072+0000 (oldest deadline 2024-09-10T22:39:25.843622+0000) 2024-09-10T22:39:51.375 INFO:journalctl@ceph.osd.11.smithi138.stdout:Sep 10 22:39:50 smithi138 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-11[60796]: 2024-09-10T22:39:50.878+0000 7ffb00998640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2024-09-10T22:39:09.245148+0000 front 2024-09-10T22:39:09.245118+0000 (oldest deadline 2024-09-10T22:39:35.046015+0000) 2024-09-10T22:39:51.376 INFO:journalctl@ceph.osd.11.smithi138.stdout:Sep 10 22:39:50 smithi138 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-11[60796]: 2024-09-10T22:39:50.878+0000 7ffb00998640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.138:6804 osd.2 since back 2024-09-10T22:39:19.647426+0000 front 2024-09-10T22:39:19.647531+0000 (oldest deadline 2024-09-10T22:39:44.947487+0000) 2024-09-10T22:39:52.125 INFO:journalctl@ceph.osd.8.smithi138.stdout:Sep 10 22:39:52 smithi138 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-8[53775]: 2024-09-10T22:39:52.021+0000 7f87faf53640 -1 osd.8 80 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2024-09-10T22:39:12.989835+0000 front 2024-09-10T22:39:12.989666+0000 (oldest deadline 2024-09-10T22:39:38.889906+0000) 2024-09-10T22:39:52.125 INFO:journalctl@ceph.osd.8.smithi138.stdout:Sep 10 22:39:52 smithi138 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-8[53775]: 2024-09-10T22:39:52.021+0000 7f87faf53640 -1 osd.8 80 heartbeat_check: no reply from 172.21.15.138:6804 osd.2 since back 2024-09-10T22:39:18.890233+0000 front 2024-09-10T22:39:18.890263+0000 (oldest deadline 2024-09-10T22:39:42.990418+0000) 2024-09-10T22:39:52.125 INFO:journalctl@ceph.osd.11.smithi138.stdout:Sep 10 22:39:51 smithi138 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-11[60796]: 2024-09-10T22:39:51.834+0000 7ffb00998640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-10T22:38:51.541208+0000 front 2024-09-10T22:38:51.541072+0000 (oldest deadline 2024-09-10T22:39:25.843622+0000) 2024-09-10T22:39:52.126 INFO:journalctl@ceph.osd.11.smithi138.stdout:Sep 10 22:39:51 smithi138 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-11[60796]: 2024-09-10T22:39:51.834+0000 7ffb00998640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2024-09-10T22:39:09.245148+0000 front 2024-09-10T22:39:09.245118+0000 (oldest deadline 2024-09-10T22:39:35.046015+0000) 2024-09-10T22:39:52.126 INFO:journalctl@ceph.osd.11.smithi138.stdout:Sep 10 22:39:51 smithi138 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-11[60796]: 2024-09-10T22:39:51.834+0000 7ffb00998640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.138:6804 osd.2 since back 2024-09-10T22:39:19.647426+0000 front 2024-09-10T22:39:19.647531+0000 (oldest deadline 2024-09-10T22:39:44.947487+0000) 2024-09-10T22:39:52.208 INFO:journalctl@ceph.osd.6.smithi019.stdout:Sep 10 22:39:51 smithi019 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-6[61536]: 2024-09-10T22:39:51.907+0000 7fbecfbb3640 -1 osd.6 80 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-10T22:38:50.981820+0000 front 2024-09-10T22:38:50.981842+0000 (oldest deadline 2024-09-10T22:39:27.183928+0000) 2024-09-10T22:39:52.209 INFO:journalctl@ceph.osd.6.smithi019.stdout:Sep 10 22:39:51 smithi019 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-6[61536]: 2024-09-10T22:39:51.907+0000 7fbecfbb3640 -1 osd.6 80 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2024-09-10T22:39:10.486176+0000 front 2024-09-10T22:39:10.486246+0000 (oldest deadline 2024-09-10T22:39:33.886409+0000) 2024-09-10T22:39:52.209 INFO:journalctl@ceph.osd.6.smithi019.stdout:Sep 10 22:39:51 smithi019 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-6[61536]: 2024-09-10T22:39:51.907+0000 7fbecfbb3640 -1 osd.6 80 heartbeat_check: no reply from 172.21.15.138:6804 osd.2 since back 2024-09-10T22:39:18.587269+0000 front 2024-09-10T22:39:18.587220+0000 (oldest deadline 2024-09-10T22:39:42.087256+0000) 2024-09-10T22:39:52.209 INFO:journalctl@ceph.osd.9.smithi019.stdout:Sep 10 22:39:51 smithi019 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-9[68022]: 2024-09-10T22:39:51.815+0000 7fa3f61d4640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-10T22:38:54.917764+0000 front 2024-09-10T22:38:54.917786+0000 (oldest deadline 2024-09-10T22:39:27.019686+0000) 2024-09-10T22:39:52.209 INFO:journalctl@ceph.osd.9.smithi019.stdout:Sep 10 22:39:51 smithi019 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-9[68022]: 2024-09-10T22:39:51.815+0000 7fa3f61d4640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2024-09-10T22:39:12.821560+0000 front 2024-09-10T22:39:12.821482+0000 (oldest deadline 2024-09-10T22:39:38.121512+0000) 2024-09-10T22:39:52.209 INFO:journalctl@ceph.osd.9.smithi019.stdout:Sep 10 22:39:51 smithi019 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-9[68022]: 2024-09-10T22:39:51.815+0000 7fa3f61d4640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.138:6804 osd.2 since back 2024-09-10T22:39:18.122242+0000 front 2024-09-10T22:39:18.122082+0000 (oldest deadline 2024-09-10T22:39:44.022038+0000) 2024-09-10T22:39:52.360 INFO:journalctl@ceph.osd.7.smithi135.stdout:Sep 10 22:39:52 smithi135 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-7[53144]: 2024-09-10T22:39:52.147+0000 7ff6310c8640 -1 osd.7 80 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2024-09-10T22:39:11.910076+0000 front 2024-09-10T22:39:11.910097+0000 (oldest deadline 2024-09-10T22:39:36.010229+0000) 2024-09-10T22:39:52.360 INFO:journalctl@ceph.osd.7.smithi135.stdout:Sep 10 22:39:52 smithi135 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-7[53144]: 2024-09-10T22:39:52.147+0000 7ff6310c8640 -1 osd.7 80 heartbeat_check: no reply from 172.21.15.138:6804 osd.2 since back 2024-09-10T22:39:20.111330+0000 front 2024-09-10T22:39:20.111291+0000 (oldest deadline 2024-09-10T22:39:43.011420+0000) 2024-09-10T22:39:52.360 INFO:journalctl@ceph.osd.7.smithi135.stdout:Sep 10 22:39:52 smithi135 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-7[53144]: 2024-09-10T22:39:52.147+0000 7ff6310c8640 -1 osd.7 80 heartbeat_check: no reply from 172.21.15.19:6814 osd.3 since back 2024-09-10T22:39:28.312521+0000 front 2024-09-10T22:39:28.312461+0000 (oldest deadline 2024-09-10T22:39:50.012508+0000) 2024-09-10T22:39:52.360 INFO:journalctl@ceph.osd.10.smithi135.stdout:Sep 10 22:39:52 smithi135 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-10[59985]: 2024-09-10T22:39:52.055+0000 7f3bf1a69640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-10T22:38:54.201226+0000 front 2024-09-10T22:38:54.201244+0000 (oldest deadline 2024-09-10T22:39:26.502183+0000) 2024-09-10T22:39:52.360 INFO:journalctl@ceph.osd.10.smithi135.stdout:Sep 10 22:39:52 smithi135 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-10[59985]: 2024-09-10T22:39:52.055+0000 7f3bf1a69640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2024-09-10T22:39:12.303632+0000 front 2024-09-10T22:39:12.303699+0000 (oldest deadline 2024-09-10T22:39:37.003674+0000) 2024-09-10T22:39:52.361 INFO:journalctl@ceph.osd.10.smithi135.stdout:Sep 10 22:39:52 smithi135 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-10[59985]: 2024-09-10T22:39:52.055+0000 7f3bf1a69640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.138:6804 osd.2 since back 2024-09-10T22:39:20.504425+0000 front 2024-09-10T22:39:20.504380+0000 (oldest deadline 2024-09-10T22:39:42.105008+0000) 2024-09-10T22:39:53.125 INFO:journalctl@ceph.osd.8.smithi138.stdout:Sep 10 22:39:53 smithi138 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-8[53775]: 2024-09-10T22:39:53.036+0000 7f87faf53640 -1 osd.8 80 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2024-09-10T22:39:12.989835+0000 front 2024-09-10T22:39:12.989666+0000 (oldest deadline 2024-09-10T22:39:38.889906+0000) 2024-09-10T22:39:53.125 INFO:journalctl@ceph.osd.8.smithi138.stdout:Sep 10 22:39:53 smithi138 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-8[53775]: 2024-09-10T22:39:53.036+0000 7f87faf53640 -1 osd.8 80 heartbeat_check: no reply from 172.21.15.138:6804 osd.2 since back 2024-09-10T22:39:18.890233+0000 front 2024-09-10T22:39:18.890263+0000 (oldest deadline 2024-09-10T22:39:42.990418+0000) 2024-09-10T22:39:53.126 INFO:journalctl@ceph.osd.8.smithi138.stdout:Sep 10 22:39:53 smithi138 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-8[53775]: 2024-09-10T22:39:53.036+0000 7f87faf53640 -1 osd.8 80 heartbeat_check: no reply from 172.21.15.19:6814 osd.3 since back 2024-09-10T22:39:28.891445+0000 front 2024-09-10T22:39:28.891431+0000 (oldest deadline 2024-09-10T22:39:52.991311+0000) 2024-09-10T22:39:53.126 INFO:journalctl@ceph.osd.11.smithi138.stdout:Sep 10 22:39:52 smithi138 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-11[60796]: 2024-09-10T22:39:52.844+0000 7ffb00998640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-10T22:38:51.541208+0000 front 2024-09-10T22:38:51.541072+0000 (oldest deadline 2024-09-10T22:39:25.843622+0000) 2024-09-10T22:39:53.126 INFO:journalctl@ceph.osd.11.smithi138.stdout:Sep 10 22:39:52 smithi138 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-11[60796]: 2024-09-10T22:39:52.844+0000 7ffb00998640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2024-09-10T22:39:09.245148+0000 front 2024-09-10T22:39:09.245118+0000 (oldest deadline 2024-09-10T22:39:35.046015+0000) 2024-09-10T22:39:53.126 INFO:journalctl@ceph.osd.11.smithi138.stdout:Sep 10 22:39:52 smithi138 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-11[60796]: 2024-09-10T22:39:52.844+0000 7ffb00998640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.138:6804 osd.2 since back 2024-09-10T22:39:19.647426+0000 front 2024-09-10T22:39:19.647531+0000 (oldest deadline 2024-09-10T22:39:44.947487+0000) 2024-09-10T22:39:53.126 INFO:journalctl@ceph.osd.11.smithi138.stdout:Sep 10 22:39:52 smithi138 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-11[60796]: 2024-09-10T22:39:52.844+0000 7ffb00998640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.19:6814 osd.3 since back 2024-09-10T22:39:29.048508+0000 front 2024-09-10T22:39:29.048441+0000 (oldest deadline 2024-09-10T22:39:52.548620+0000) 2024-09-10T22:39:53.208 INFO:journalctl@ceph.osd.6.smithi019.stdout:Sep 10 22:39:52 smithi019 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-6[61536]: 2024-09-10T22:39:52.869+0000 7fbecfbb3640 -1 osd.6 80 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-10T22:38:50.981820+0000 front 2024-09-10T22:38:50.981842+0000 (oldest deadline 2024-09-10T22:39:27.183928+0000) 2024-09-10T22:39:53.208 INFO:journalctl@ceph.osd.6.smithi019.stdout:Sep 10 22:39:52 smithi019 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-6[61536]: 2024-09-10T22:39:52.869+0000 7fbecfbb3640 -1 osd.6 80 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2024-09-10T22:39:10.486176+0000 front 2024-09-10T22:39:10.486246+0000 (oldest deadline 2024-09-10T22:39:33.886409+0000) 2024-09-10T22:39:53.209 INFO:journalctl@ceph.osd.6.smithi019.stdout:Sep 10 22:39:52 smithi019 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-6[61536]: 2024-09-10T22:39:52.869+0000 7fbecfbb3640 -1 osd.6 80 heartbeat_check: no reply from 172.21.15.138:6804 osd.2 since back 2024-09-10T22:39:18.587269+0000 front 2024-09-10T22:39:18.587220+0000 (oldest deadline 2024-09-10T22:39:42.087256+0000) 2024-09-10T22:39:53.209 INFO:journalctl@ceph.osd.9.smithi019.stdout:Sep 10 22:39:52 smithi019 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-9[68022]: 2024-09-10T22:39:52.836+0000 7fa3f61d4640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-10T22:38:54.917764+0000 front 2024-09-10T22:38:54.917786+0000 (oldest deadline 2024-09-10T22:39:27.019686+0000) 2024-09-10T22:39:53.209 INFO:journalctl@ceph.osd.9.smithi019.stdout:Sep 10 22:39:52 smithi019 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-9[68022]: 2024-09-10T22:39:52.836+0000 7fa3f61d4640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2024-09-10T22:39:12.821560+0000 front 2024-09-10T22:39:12.821482+0000 (oldest deadline 2024-09-10T22:39:38.121512+0000) 2024-09-10T22:39:53.209 INFO:journalctl@ceph.osd.9.smithi019.stdout:Sep 10 22:39:52 smithi019 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-9[68022]: 2024-09-10T22:39:52.836+0000 7fa3f61d4640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.138:6804 osd.2 since back 2024-09-10T22:39:18.122242+0000 front 2024-09-10T22:39:18.122082+0000 (oldest deadline 2024-09-10T22:39:44.022038+0000) 2024-09-10T22:39:53.209 INFO:journalctl@ceph.osd.9.smithi019.stdout:Sep 10 22:39:52 smithi019 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-9[68022]: 2024-09-10T22:39:52.836+0000 7fa3f61d4640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.19:6814 osd.3 since back 2024-09-10T22:39:28.623376+0000 front 2024-09-10T22:39:28.623431+0000 (oldest deadline 2024-09-10T22:39:52.723588+0000) 2024-09-10T22:39:53.360 INFO:journalctl@ceph.osd.7.smithi135.stdout:Sep 10 22:39:53 smithi135 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-7[53144]: 2024-09-10T22:39:53.174+0000 7ff6310c8640 -1 osd.7 80 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2024-09-10T22:39:11.910076+0000 front 2024-09-10T22:39:11.910097+0000 (oldest deadline 2024-09-10T22:39:36.010229+0000) 2024-09-10T22:39:53.360 INFO:journalctl@ceph.osd.7.smithi135.stdout:Sep 10 22:39:53 smithi135 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-7[53144]: 2024-09-10T22:39:53.174+0000 7ff6310c8640 -1 osd.7 80 heartbeat_check: no reply from 172.21.15.138:6804 osd.2 since back 2024-09-10T22:39:20.111330+0000 front 2024-09-10T22:39:20.111291+0000 (oldest deadline 2024-09-10T22:39:43.011420+0000) 2024-09-10T22:39:53.360 INFO:journalctl@ceph.osd.7.smithi135.stdout:Sep 10 22:39:53 smithi135 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-7[53144]: 2024-09-10T22:39:53.174+0000 7ff6310c8640 -1 osd.7 80 heartbeat_check: no reply from 172.21.15.19:6814 osd.3 since back 2024-09-10T22:39:28.312521+0000 front 2024-09-10T22:39:28.312461+0000 (oldest deadline 2024-09-10T22:39:50.012508+0000) 2024-09-10T22:39:53.360 INFO:journalctl@ceph.osd.10.smithi135.stdout:Sep 10 22:39:53 smithi135 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-10[59985]: 2024-09-10T22:39:53.073+0000 7f3bf1a69640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-10T22:38:54.201226+0000 front 2024-09-10T22:38:54.201244+0000 (oldest deadline 2024-09-10T22:39:26.502183+0000) 2024-09-10T22:39:53.360 INFO:journalctl@ceph.osd.10.smithi135.stdout:Sep 10 22:39:53 smithi135 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-10[59985]: 2024-09-10T22:39:53.073+0000 7f3bf1a69640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2024-09-10T22:39:12.303632+0000 front 2024-09-10T22:39:12.303699+0000 (oldest deadline 2024-09-10T22:39:37.003674+0000) 2024-09-10T22:39:53.361 INFO:journalctl@ceph.osd.10.smithi135.stdout:Sep 10 22:39:53 smithi135 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-10[59985]: 2024-09-10T22:39:53.073+0000 7f3bf1a69640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.138:6804 osd.2 since back 2024-09-10T22:39:20.504425+0000 front 2024-09-10T22:39:20.504380+0000 (oldest deadline 2024-09-10T22:39:42.105008+0000) 2024-09-10T22:39:53.998 INFO:journalctl@ceph.osd.6.smithi019.stdout:Sep 10 22:39:53 smithi019 podman[106747]: 2024-09-10 22:39:53.719527691 +0000 UTC m=+5.570857502 container died 5fbd5f28bef83a05af34e60611e341516180f98e99bd68f3a1fd4f6554679790 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-6, GIT_BRANCH=HEAD, GIT_CLEAN=True, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.license=GPLv2) 2024-09-10T22:39:53.999 INFO:journalctl@ceph.osd.9.smithi019.stdout:Sep 10 22:39:53 smithi019 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-9[68022]: 2024-09-10T22:39:53.803+0000 7fa3f61d4640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-10T22:38:54.917764+0000 front 2024-09-10T22:38:54.917786+0000 (oldest deadline 2024-09-10T22:39:27.019686+0000) 2024-09-10T22:39:53.999 INFO:journalctl@ceph.osd.9.smithi019.stdout:Sep 10 22:39:53 smithi019 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-9[68022]: 2024-09-10T22:39:53.803+0000 7fa3f61d4640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2024-09-10T22:39:12.821560+0000 front 2024-09-10T22:39:12.821482+0000 (oldest deadline 2024-09-10T22:39:38.121512+0000) 2024-09-10T22:39:53.999 INFO:journalctl@ceph.osd.9.smithi019.stdout:Sep 10 22:39:53 smithi019 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-9[68022]: 2024-09-10T22:39:53.803+0000 7fa3f61d4640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.138:6804 osd.2 since back 2024-09-10T22:39:18.122242+0000 front 2024-09-10T22:39:18.122082+0000 (oldest deadline 2024-09-10T22:39:44.022038+0000) 2024-09-10T22:39:53.999 INFO:journalctl@ceph.osd.9.smithi019.stdout:Sep 10 22:39:53 smithi019 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-9[68022]: 2024-09-10T22:39:53.803+0000 7fa3f61d4640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.19:6814 osd.3 since back 2024-09-10T22:39:28.623376+0000 front 2024-09-10T22:39:28.623431+0000 (oldest deadline 2024-09-10T22:39:52.723588+0000) 2024-09-10T22:39:54.125 INFO:journalctl@ceph.osd.8.smithi138.stdout:Sep 10 22:39:54 smithi138 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-8[53775]: 2024-09-10T22:39:54.032+0000 7f87faf53640 -1 osd.8 80 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2024-09-10T22:39:12.989835+0000 front 2024-09-10T22:39:12.989666+0000 (oldest deadline 2024-09-10T22:39:38.889906+0000) 2024-09-10T22:39:54.125 INFO:journalctl@ceph.osd.8.smithi138.stdout:Sep 10 22:39:54 smithi138 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-8[53775]: 2024-09-10T22:39:54.032+0000 7f87faf53640 -1 osd.8 80 heartbeat_check: no reply from 172.21.15.138:6804 osd.2 since back 2024-09-10T22:39:18.890233+0000 front 2024-09-10T22:39:18.890263+0000 (oldest deadline 2024-09-10T22:39:42.990418+0000) 2024-09-10T22:39:54.125 INFO:journalctl@ceph.osd.8.smithi138.stdout:Sep 10 22:39:54 smithi138 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-8[53775]: 2024-09-10T22:39:54.032+0000 7f87faf53640 -1 osd.8 80 heartbeat_check: no reply from 172.21.15.19:6814 osd.3 since back 2024-09-10T22:39:28.891445+0000 front 2024-09-10T22:39:28.891431+0000 (oldest deadline 2024-09-10T22:39:52.991311+0000) 2024-09-10T22:39:54.126 INFO:journalctl@ceph.osd.11.smithi138.stdout:Sep 10 22:39:53 smithi138 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-11[60796]: 2024-09-10T22:39:53.872+0000 7ffb00998640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-10T22:38:51.541208+0000 front 2024-09-10T22:38:51.541072+0000 (oldest deadline 2024-09-10T22:39:25.843622+0000) 2024-09-10T22:39:54.126 INFO:journalctl@ceph.osd.11.smithi138.stdout:Sep 10 22:39:53 smithi138 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-11[60796]: 2024-09-10T22:39:53.872+0000 7ffb00998640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2024-09-10T22:39:09.245148+0000 front 2024-09-10T22:39:09.245118+0000 (oldest deadline 2024-09-10T22:39:35.046015+0000) 2024-09-10T22:39:54.126 INFO:journalctl@ceph.osd.11.smithi138.stdout:Sep 10 22:39:53 smithi138 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-11[60796]: 2024-09-10T22:39:53.872+0000 7ffb00998640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.138:6804 osd.2 since back 2024-09-10T22:39:19.647426+0000 front 2024-09-10T22:39:19.647531+0000 (oldest deadline 2024-09-10T22:39:44.947487+0000) 2024-09-10T22:39:54.126 INFO:journalctl@ceph.osd.11.smithi138.stdout:Sep 10 22:39:53 smithi138 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-11[60796]: 2024-09-10T22:39:53.872+0000 7ffb00998640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.19:6814 osd.3 since back 2024-09-10T22:39:29.048508+0000 front 2024-09-10T22:39:29.048441+0000 (oldest deadline 2024-09-10T22:39:52.548620+0000) 2024-09-10T22:39:54.360 INFO:journalctl@ceph.osd.7.smithi135.stdout:Sep 10 22:39:54 smithi135 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-7[53144]: 2024-09-10T22:39:54.138+0000 7ff6310c8640 -1 osd.7 80 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2024-09-10T22:39:11.910076+0000 front 2024-09-10T22:39:11.910097+0000 (oldest deadline 2024-09-10T22:39:36.010229+0000) 2024-09-10T22:39:54.360 INFO:journalctl@ceph.osd.7.smithi135.stdout:Sep 10 22:39:54 smithi135 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-7[53144]: 2024-09-10T22:39:54.138+0000 7ff6310c8640 -1 osd.7 80 heartbeat_check: no reply from 172.21.15.138:6804 osd.2 since back 2024-09-10T22:39:20.111330+0000 front 2024-09-10T22:39:20.111291+0000 (oldest deadline 2024-09-10T22:39:43.011420+0000) 2024-09-10T22:39:54.360 INFO:journalctl@ceph.osd.7.smithi135.stdout:Sep 10 22:39:54 smithi135 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-7[53144]: 2024-09-10T22:39:54.138+0000 7ff6310c8640 -1 osd.7 80 heartbeat_check: no reply from 172.21.15.19:6814 osd.3 since back 2024-09-10T22:39:28.312521+0000 front 2024-09-10T22:39:28.312461+0000 (oldest deadline 2024-09-10T22:39:50.012508+0000) 2024-09-10T22:39:54.361 INFO:journalctl@ceph.osd.10.smithi135.stdout:Sep 10 22:39:54 smithi135 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-10[59985]: 2024-09-10T22:39:54.070+0000 7f3bf1a69640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-10T22:38:54.201226+0000 front 2024-09-10T22:38:54.201244+0000 (oldest deadline 2024-09-10T22:39:26.502183+0000) 2024-09-10T22:39:54.361 INFO:journalctl@ceph.osd.10.smithi135.stdout:Sep 10 22:39:54 smithi135 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-10[59985]: 2024-09-10T22:39:54.070+0000 7f3bf1a69640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2024-09-10T22:39:12.303632+0000 front 2024-09-10T22:39:12.303699+0000 (oldest deadline 2024-09-10T22:39:37.003674+0000) 2024-09-10T22:39:54.361 INFO:journalctl@ceph.osd.10.smithi135.stdout:Sep 10 22:39:54 smithi135 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-10[59985]: 2024-09-10T22:39:54.070+0000 7f3bf1a69640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.138:6804 osd.2 since back 2024-09-10T22:39:20.504425+0000 front 2024-09-10T22:39:20.504380+0000 (oldest deadline 2024-09-10T22:39:42.105008+0000) 2024-09-10T22:39:54.457 INFO:journalctl@ceph.osd.6.smithi019.stdout:Sep 10 22:39:54 smithi019 podman[106747]: 2024-09-10 22:39:54.187830274 +0000 UTC m=+6.039160084 container cleanup 5fbd5f28bef83a05af34e60611e341516180f98e99bd68f3a1fd4f6554679790 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-6, GIT_BRANCH=HEAD, ceph=True, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-10T22:39:54.457 INFO:journalctl@ceph.osd.6.smithi019.stdout:Sep 10 22:39:54 smithi019 bash[106747]: ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-6 2024-09-10T22:39:54.708 INFO:journalctl@ceph.osd.6.smithi019.stdout:Sep 10 22:39:54 smithi019 podman[106763]: 2024-09-10 22:39:54.456216816 +0000 UTC m=+0.735015640 container remove 5fbd5f28bef83a05af34e60611e341516180f98e99bd68f3a1fd4f6554679790 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-6, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_CLEAN=True, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, ceph=True, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2) 2024-09-10T22:39:55.072 INFO:journalctl@ceph.osd.9.smithi019.stdout:Sep 10 22:39:54 smithi019 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-9[68022]: 2024-09-10T22:39:54.825+0000 7fa3f61d4640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-10T22:38:54.917764+0000 front 2024-09-10T22:38:54.917786+0000 (oldest deadline 2024-09-10T22:39:27.019686+0000) 2024-09-10T22:39:55.072 INFO:journalctl@ceph.osd.9.smithi019.stdout:Sep 10 22:39:54 smithi019 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-9[68022]: 2024-09-10T22:39:54.825+0000 7fa3f61d4640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2024-09-10T22:39:12.821560+0000 front 2024-09-10T22:39:12.821482+0000 (oldest deadline 2024-09-10T22:39:38.121512+0000) 2024-09-10T22:39:55.072 INFO:journalctl@ceph.osd.9.smithi019.stdout:Sep 10 22:39:54 smithi019 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-9[68022]: 2024-09-10T22:39:54.825+0000 7fa3f61d4640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.138:6804 osd.2 since back 2024-09-10T22:39:18.122242+0000 front 2024-09-10T22:39:18.122082+0000 (oldest deadline 2024-09-10T22:39:44.022038+0000) 2024-09-10T22:39:55.072 INFO:journalctl@ceph.osd.9.smithi019.stdout:Sep 10 22:39:54 smithi019 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-9[68022]: 2024-09-10T22:39:54.825+0000 7fa3f61d4640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.19:6814 osd.3 since back 2024-09-10T22:39:28.623376+0000 front 2024-09-10T22:39:28.623431+0000 (oldest deadline 2024-09-10T22:39:52.723588+0000) 2024-09-10T22:39:55.072 INFO:journalctl@ceph.osd.6.smithi019.stdout:Sep 10 22:39:54 smithi019 podman[106855]: 2024-09-10 22:39:54.722571156 +0000 UTC m=+0.016897838 image pull 589dd18248e494ba411dc838aa4ae0e5e569213f08fcd7a2cf22cd3ef7e3c480 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e 2024-09-10T22:39:55.072 INFO:journalctl@ceph.osd.6.smithi019.stdout:Sep 10 22:39:54 smithi019 podman[106855]: 2024-09-10 22:39:54.857249688 +0000 UTC m=+0.151576401 container create aa1c3ccff65c2b82437c2daa762c378f3ff09d25f4eb0d802288ab4f63b12fe7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-6-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2) 2024-09-10T22:39:55.073 INFO:journalctl@ceph.osd.6.smithi019.stdout:Sep 10 22:39:55 smithi019 podman[106855]: 2024-09-10 22:39:55.067652032 +0000 UTC m=+0.361978715 container init aa1c3ccff65c2b82437c2daa762c378f3ff09d25f4eb0d802288ab4f63b12fe7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-6-deactivate, ceph=True, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux ) 2024-09-10T22:39:55.073 INFO:journalctl@ceph.osd.6.smithi019.stdout:Sep 10 22:39:55 smithi019 podman[106855]: 2024-09-10 22:39:55.071132337 +0000 UTC m=+0.365459008 container start aa1c3ccff65c2b82437c2daa762c378f3ff09d25f4eb0d802288ab4f63b12fe7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-6-deactivate, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_CLEAN=True, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, ceph=True, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-10T22:39:55.360 INFO:journalctl@ceph.osd.7.smithi135.stdout:Sep 10 22:39:55 smithi135 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-7[53144]: 2024-09-10T22:39:55.160+0000 7ff6310c8640 -1 osd.7 80 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2024-09-10T22:39:11.910076+0000 front 2024-09-10T22:39:11.910097+0000 (oldest deadline 2024-09-10T22:39:36.010229+0000) 2024-09-10T22:39:55.360 INFO:journalctl@ceph.osd.7.smithi135.stdout:Sep 10 22:39:55 smithi135 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-7[53144]: 2024-09-10T22:39:55.160+0000 7ff6310c8640 -1 osd.7 80 heartbeat_check: no reply from 172.21.15.138:6804 osd.2 since back 2024-09-10T22:39:20.111330+0000 front 2024-09-10T22:39:20.111291+0000 (oldest deadline 2024-09-10T22:39:43.011420+0000) 2024-09-10T22:39:55.360 INFO:journalctl@ceph.osd.7.smithi135.stdout:Sep 10 22:39:55 smithi135 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-7[53144]: 2024-09-10T22:39:55.160+0000 7ff6310c8640 -1 osd.7 80 heartbeat_check: no reply from 172.21.15.19:6814 osd.3 since back 2024-09-10T22:39:28.312521+0000 front 2024-09-10T22:39:28.312461+0000 (oldest deadline 2024-09-10T22:39:50.012508+0000) 2024-09-10T22:39:55.360 INFO:journalctl@ceph.osd.10.smithi135.stdout:Sep 10 22:39:55 smithi135 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-10[59985]: 2024-09-10T22:39:55.049+0000 7f3bf1a69640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-10T22:38:54.201226+0000 front 2024-09-10T22:38:54.201244+0000 (oldest deadline 2024-09-10T22:39:26.502183+0000) 2024-09-10T22:39:55.360 INFO:journalctl@ceph.osd.10.smithi135.stdout:Sep 10 22:39:55 smithi135 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-10[59985]: 2024-09-10T22:39:55.049+0000 7f3bf1a69640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2024-09-10T22:39:12.303632+0000 front 2024-09-10T22:39:12.303699+0000 (oldest deadline 2024-09-10T22:39:37.003674+0000) 2024-09-10T22:39:55.360 INFO:journalctl@ceph.osd.10.smithi135.stdout:Sep 10 22:39:55 smithi135 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-10[59985]: 2024-09-10T22:39:55.049+0000 7f3bf1a69640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.138:6804 osd.2 since back 2024-09-10T22:39:20.504425+0000 front 2024-09-10T22:39:20.504380+0000 (oldest deadline 2024-09-10T22:39:42.105008+0000) 2024-09-10T22:39:55.360 INFO:journalctl@ceph.osd.10.smithi135.stdout:Sep 10 22:39:55 smithi135 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-10[59985]: 2024-09-10T22:39:55.049+0000 7f3bf1a69640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.19:6814 osd.3 since back 2024-09-10T22:39:29.106408+0000 front 2024-09-10T22:39:29.106333+0000 (oldest deadline 2024-09-10T22:39:54.406308+0000) 2024-09-10T22:39:55.375 INFO:journalctl@ceph.osd.8.smithi138.stdout:Sep 10 22:39:55 smithi138 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-8[53775]: 2024-09-10T22:39:55.014+0000 7f87faf53640 -1 osd.8 80 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2024-09-10T22:39:12.989835+0000 front 2024-09-10T22:39:12.989666+0000 (oldest deadline 2024-09-10T22:39:38.889906+0000) 2024-09-10T22:39:55.375 INFO:journalctl@ceph.osd.8.smithi138.stdout:Sep 10 22:39:55 smithi138 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-8[53775]: 2024-09-10T22:39:55.014+0000 7f87faf53640 -1 osd.8 80 heartbeat_check: no reply from 172.21.15.138:6804 osd.2 since back 2024-09-10T22:39:18.890233+0000 front 2024-09-10T22:39:18.890263+0000 (oldest deadline 2024-09-10T22:39:42.990418+0000) 2024-09-10T22:39:55.375 INFO:journalctl@ceph.osd.8.smithi138.stdout:Sep 10 22:39:55 smithi138 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-8[53775]: 2024-09-10T22:39:55.014+0000 7f87faf53640 -1 osd.8 80 heartbeat_check: no reply from 172.21.15.19:6814 osd.3 since back 2024-09-10T22:39:28.891445+0000 front 2024-09-10T22:39:28.891431+0000 (oldest deadline 2024-09-10T22:39:52.991311+0000) 2024-09-10T22:39:55.375 INFO:journalctl@ceph.osd.11.smithi138.stdout:Sep 10 22:39:54 smithi138 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-11[60796]: 2024-09-10T22:39:54.900+0000 7ffb00998640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-10T22:38:51.541208+0000 front 2024-09-10T22:38:51.541072+0000 (oldest deadline 2024-09-10T22:39:25.843622+0000) 2024-09-10T22:39:55.375 INFO:journalctl@ceph.osd.11.smithi138.stdout:Sep 10 22:39:54 smithi138 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-11[60796]: 2024-09-10T22:39:54.900+0000 7ffb00998640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2024-09-10T22:39:09.245148+0000 front 2024-09-10T22:39:09.245118+0000 (oldest deadline 2024-09-10T22:39:35.046015+0000) 2024-09-10T22:39:55.376 INFO:journalctl@ceph.osd.11.smithi138.stdout:Sep 10 22:39:54 smithi138 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-11[60796]: 2024-09-10T22:39:54.900+0000 7ffb00998640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.138:6804 osd.2 since back 2024-09-10T22:39:19.647426+0000 front 2024-09-10T22:39:19.647531+0000 (oldest deadline 2024-09-10T22:39:44.947487+0000) 2024-09-10T22:39:55.376 INFO:journalctl@ceph.osd.11.smithi138.stdout:Sep 10 22:39:54 smithi138 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-11[60796]: 2024-09-10T22:39:54.900+0000 7ffb00998640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.19:6814 osd.3 since back 2024-09-10T22:39:29.048508+0000 front 2024-09-10T22:39:29.048441+0000 (oldest deadline 2024-09-10T22:39:52.548620+0000) 2024-09-10T22:39:55.459 INFO:journalctl@ceph.osd.6.smithi019.stdout:Sep 10 22:39:55 smithi019 podman[106855]: 2024-09-10 22:39:55.176242115 +0000 UTC m=+0.470568797 container attach aa1c3ccff65c2b82437c2daa762c378f3ff09d25f4eb0d802288ab4f63b12fe7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-6-deactivate, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, ceph=True, GIT_BRANCH=HEAD, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-10T22:39:55.459 INFO:journalctl@ceph.osd.6.smithi019.stdout:Sep 10 22:39:55 smithi019 podman[106855]: 2024-09-10 22:39:55.266069013 +0000 UTC m=+0.560395691 container died aa1c3ccff65c2b82437c2daa762c378f3ff09d25f4eb0d802288ab4f63b12fe7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-6-deactivate, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD) 2024-09-10T22:39:55.833 INFO:journalctl@ceph.osd.6.smithi019.stdout:Sep 10 22:39:55 smithi019 podman[106879]: 2024-09-10 22:39:55.812650443 +0000 UTC m=+0.539969599 container remove aa1c3ccff65c2b82437c2daa762c378f3ff09d25f4eb0d802288ab4f63b12fe7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-6-deactivate, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , ceph=True, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0) 2024-09-10T22:39:55.839 DEBUG:teuthology.orchestra.run.smithi019:> sudo pkill -f 'journalctl -f -n 0 -u ceph-22997a4c-6fc2-11ef-bcea-c7b262605968@osd.6.service' 2024-09-10T22:39:55.880 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-10T22:39:55.881 INFO:tasks.cephadm.osd.6:Stopped osd.6 2024-09-10T22:39:55.881 INFO:tasks.cephadm.osd.7:Stopping osd.7... 2024-09-10T22:39:55.881 DEBUG:teuthology.orchestra.run.smithi135:> sudo systemctl stop ceph-22997a4c-6fc2-11ef-bcea-c7b262605968@osd.7 2024-09-10T22:39:56.164 INFO:journalctl@ceph.osd.7.smithi135.stdout:Sep 10 22:39:55 smithi135 systemd[1]: Stopping Ceph osd.7 for 22997a4c-6fc2-11ef-bcea-c7b262605968... 2024-09-10T22:39:56.164 INFO:journalctl@ceph.osd.10.smithi135.stdout:Sep 10 22:39:56 smithi135 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-10[59985]: 2024-09-10T22:39:56.066+0000 7f3bf1a69640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-10T22:38:54.201226+0000 front 2024-09-10T22:38:54.201244+0000 (oldest deadline 2024-09-10T22:39:26.502183+0000) 2024-09-10T22:39:56.164 INFO:journalctl@ceph.osd.10.smithi135.stdout:Sep 10 22:39:56 smithi135 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-10[59985]: 2024-09-10T22:39:56.066+0000 7f3bf1a69640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2024-09-10T22:39:12.303632+0000 front 2024-09-10T22:39:12.303699+0000 (oldest deadline 2024-09-10T22:39:37.003674+0000) 2024-09-10T22:39:56.164 INFO:journalctl@ceph.osd.10.smithi135.stdout:Sep 10 22:39:56 smithi135 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-10[59985]: 2024-09-10T22:39:56.066+0000 7f3bf1a69640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.138:6804 osd.2 since back 2024-09-10T22:39:20.504425+0000 front 2024-09-10T22:39:20.504380+0000 (oldest deadline 2024-09-10T22:39:42.105008+0000) 2024-09-10T22:39:56.164 INFO:journalctl@ceph.osd.10.smithi135.stdout:Sep 10 22:39:56 smithi135 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-10[59985]: 2024-09-10T22:39:56.066+0000 7f3bf1a69640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.19:6814 osd.3 since back 2024-09-10T22:39:29.106408+0000 front 2024-09-10T22:39:29.106333+0000 (oldest deadline 2024-09-10T22:39:54.406308+0000) 2024-09-10T22:39:56.208 INFO:journalctl@ceph.osd.9.smithi019.stdout:Sep 10 22:39:55 smithi019 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-9[68022]: 2024-09-10T22:39:55.875+0000 7fa3f61d4640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-10T22:38:54.917764+0000 front 2024-09-10T22:38:54.917786+0000 (oldest deadline 2024-09-10T22:39:27.019686+0000) 2024-09-10T22:39:56.209 INFO:journalctl@ceph.osd.9.smithi019.stdout:Sep 10 22:39:55 smithi019 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-9[68022]: 2024-09-10T22:39:55.875+0000 7fa3f61d4640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2024-09-10T22:39:12.821560+0000 front 2024-09-10T22:39:12.821482+0000 (oldest deadline 2024-09-10T22:39:38.121512+0000) 2024-09-10T22:39:56.209 INFO:journalctl@ceph.osd.9.smithi019.stdout:Sep 10 22:39:55 smithi019 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-9[68022]: 2024-09-10T22:39:55.875+0000 7fa3f61d4640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.138:6804 osd.2 since back 2024-09-10T22:39:18.122242+0000 front 2024-09-10T22:39:18.122082+0000 (oldest deadline 2024-09-10T22:39:44.022038+0000) 2024-09-10T22:39:56.209 INFO:journalctl@ceph.osd.9.smithi019.stdout:Sep 10 22:39:55 smithi019 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-9[68022]: 2024-09-10T22:39:55.875+0000 7fa3f61d4640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.19:6814 osd.3 since back 2024-09-10T22:39:28.623376+0000 front 2024-09-10T22:39:28.623431+0000 (oldest deadline 2024-09-10T22:39:52.723588+0000) 2024-09-10T22:39:56.375 INFO:journalctl@ceph.osd.8.smithi138.stdout:Sep 10 22:39:56 smithi138 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-8[53775]: 2024-09-10T22:39:56.019+0000 7f87faf53640 -1 osd.8 80 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2024-09-10T22:39:12.989835+0000 front 2024-09-10T22:39:12.989666+0000 (oldest deadline 2024-09-10T22:39:38.889906+0000) 2024-09-10T22:39:56.376 INFO:journalctl@ceph.osd.8.smithi138.stdout:Sep 10 22:39:56 smithi138 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-8[53775]: 2024-09-10T22:39:56.019+0000 7f87faf53640 -1 osd.8 80 heartbeat_check: no reply from 172.21.15.138:6804 osd.2 since back 2024-09-10T22:39:18.890233+0000 front 2024-09-10T22:39:18.890263+0000 (oldest deadline 2024-09-10T22:39:42.990418+0000) 2024-09-10T22:39:56.376 INFO:journalctl@ceph.osd.8.smithi138.stdout:Sep 10 22:39:56 smithi138 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-8[53775]: 2024-09-10T22:39:56.019+0000 7f87faf53640 -1 osd.8 80 heartbeat_check: no reply from 172.21.15.19:6814 osd.3 since back 2024-09-10T22:39:28.891445+0000 front 2024-09-10T22:39:28.891431+0000 (oldest deadline 2024-09-10T22:39:52.991311+0000) 2024-09-10T22:39:56.376 INFO:journalctl@ceph.osd.11.smithi138.stdout:Sep 10 22:39:55 smithi138 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-11[60796]: 2024-09-10T22:39:55.882+0000 7ffb00998640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-10T22:38:51.541208+0000 front 2024-09-10T22:38:51.541072+0000 (oldest deadline 2024-09-10T22:39:25.843622+0000) 2024-09-10T22:39:56.376 INFO:journalctl@ceph.osd.11.smithi138.stdout:Sep 10 22:39:55 smithi138 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-11[60796]: 2024-09-10T22:39:55.882+0000 7ffb00998640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2024-09-10T22:39:09.245148+0000 front 2024-09-10T22:39:09.245118+0000 (oldest deadline 2024-09-10T22:39:35.046015+0000) 2024-09-10T22:39:56.376 INFO:journalctl@ceph.osd.11.smithi138.stdout:Sep 10 22:39:55 smithi138 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-11[60796]: 2024-09-10T22:39:55.882+0000 7ffb00998640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.138:6804 osd.2 since back 2024-09-10T22:39:19.647426+0000 front 2024-09-10T22:39:19.647531+0000 (oldest deadline 2024-09-10T22:39:44.947487+0000) 2024-09-10T22:39:56.376 INFO:journalctl@ceph.osd.11.smithi138.stdout:Sep 10 22:39:55 smithi138 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-11[60796]: 2024-09-10T22:39:55.882+0000 7ffb00998640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.19:6814 osd.3 since back 2024-09-10T22:39:29.048508+0000 front 2024-09-10T22:39:29.048441+0000 (oldest deadline 2024-09-10T22:39:52.548620+0000) 2024-09-10T22:39:56.610 INFO:journalctl@ceph.osd.7.smithi135.stdout:Sep 10 22:39:56 smithi135 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-7[53144]: 2024-09-10T22:39:56.162+0000 7ff6310c8640 -1 osd.7 80 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2024-09-10T22:39:11.910076+0000 front 2024-09-10T22:39:11.910097+0000 (oldest deadline 2024-09-10T22:39:36.010229+0000) 2024-09-10T22:39:56.610 INFO:journalctl@ceph.osd.7.smithi135.stdout:Sep 10 22:39:56 smithi135 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-7[53144]: 2024-09-10T22:39:56.162+0000 7ff6310c8640 -1 osd.7 80 heartbeat_check: no reply from 172.21.15.138:6804 osd.2 since back 2024-09-10T22:39:20.111330+0000 front 2024-09-10T22:39:20.111291+0000 (oldest deadline 2024-09-10T22:39:43.011420+0000) 2024-09-10T22:39:56.610 INFO:journalctl@ceph.osd.7.smithi135.stdout:Sep 10 22:39:56 smithi135 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-7[53144]: 2024-09-10T22:39:56.162+0000 7ff6310c8640 -1 osd.7 80 heartbeat_check: no reply from 172.21.15.19:6814 osd.3 since back 2024-09-10T22:39:28.312521+0000 front 2024-09-10T22:39:28.312461+0000 (oldest deadline 2024-09-10T22:39:50.012508+0000) 2024-09-10T22:39:56.610 INFO:journalctl@ceph.osd.7.smithi135.stdout:Sep 10 22:39:56 smithi135 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-7[53144]: 2024-09-10T22:39:56.188+0000 7ff638abb640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.7 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-10T22:39:56.610 INFO:journalctl@ceph.osd.7.smithi135.stdout:Sep 10 22:39:56 smithi135 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-7[53144]: 2024-09-10T22:39:56.188+0000 7ff638abb640 -1 osd.7 80 *** Got signal Terminated *** 2024-09-10T22:39:56.610 INFO:journalctl@ceph.osd.7.smithi135.stdout:Sep 10 22:39:56 smithi135 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-7[53144]: 2024-09-10T22:39:56.188+0000 7ff638abb640 -1 osd.7 80 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-10T22:39:57.125 INFO:journalctl@ceph.osd.8.smithi138.stdout:Sep 10 22:39:57 smithi138 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-8[53775]: 2024-09-10T22:39:57.031+0000 7f87faf53640 -1 osd.8 80 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2024-09-10T22:39:12.989835+0000 front 2024-09-10T22:39:12.989666+0000 (oldest deadline 2024-09-10T22:39:38.889906+0000) 2024-09-10T22:39:57.125 INFO:journalctl@ceph.osd.8.smithi138.stdout:Sep 10 22:39:57 smithi138 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-8[53775]: 2024-09-10T22:39:57.031+0000 7f87faf53640 -1 osd.8 80 heartbeat_check: no reply from 172.21.15.138:6804 osd.2 since back 2024-09-10T22:39:18.890233+0000 front 2024-09-10T22:39:18.890263+0000 (oldest deadline 2024-09-10T22:39:42.990418+0000) 2024-09-10T22:39:57.125 INFO:journalctl@ceph.osd.8.smithi138.stdout:Sep 10 22:39:57 smithi138 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-8[53775]: 2024-09-10T22:39:57.031+0000 7f87faf53640 -1 osd.8 80 heartbeat_check: no reply from 172.21.15.19:6814 osd.3 since back 2024-09-10T22:39:28.891445+0000 front 2024-09-10T22:39:28.891431+0000 (oldest deadline 2024-09-10T22:39:52.991311+0000) 2024-09-10T22:39:57.126 INFO:journalctl@ceph.osd.11.smithi138.stdout:Sep 10 22:39:56 smithi138 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-11[60796]: 2024-09-10T22:39:56.835+0000 7ffb00998640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-10T22:38:51.541208+0000 front 2024-09-10T22:38:51.541072+0000 (oldest deadline 2024-09-10T22:39:25.843622+0000) 2024-09-10T22:39:57.126 INFO:journalctl@ceph.osd.11.smithi138.stdout:Sep 10 22:39:56 smithi138 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-11[60796]: 2024-09-10T22:39:56.835+0000 7ffb00998640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2024-09-10T22:39:09.245148+0000 front 2024-09-10T22:39:09.245118+0000 (oldest deadline 2024-09-10T22:39:35.046015+0000) 2024-09-10T22:39:57.126 INFO:journalctl@ceph.osd.11.smithi138.stdout:Sep 10 22:39:56 smithi138 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-11[60796]: 2024-09-10T22:39:56.835+0000 7ffb00998640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.138:6804 osd.2 since back 2024-09-10T22:39:19.647426+0000 front 2024-09-10T22:39:19.647531+0000 (oldest deadline 2024-09-10T22:39:44.947487+0000) 2024-09-10T22:39:57.126 INFO:journalctl@ceph.osd.11.smithi138.stdout:Sep 10 22:39:56 smithi138 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-11[60796]: 2024-09-10T22:39:56.835+0000 7ffb00998640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.19:6814 osd.3 since back 2024-09-10T22:39:29.048508+0000 front 2024-09-10T22:39:29.048441+0000 (oldest deadline 2024-09-10T22:39:52.548620+0000) 2024-09-10T22:39:57.208 INFO:journalctl@ceph.osd.9.smithi019.stdout:Sep 10 22:39:56 smithi019 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-9[68022]: 2024-09-10T22:39:56.852+0000 7fa3f61d4640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-10T22:38:54.917764+0000 front 2024-09-10T22:38:54.917786+0000 (oldest deadline 2024-09-10T22:39:27.019686+0000) 2024-09-10T22:39:57.209 INFO:journalctl@ceph.osd.9.smithi019.stdout:Sep 10 22:39:56 smithi019 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-9[68022]: 2024-09-10T22:39:56.852+0000 7fa3f61d4640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2024-09-10T22:39:12.821560+0000 front 2024-09-10T22:39:12.821482+0000 (oldest deadline 2024-09-10T22:39:38.121512+0000) 2024-09-10T22:39:57.209 INFO:journalctl@ceph.osd.9.smithi019.stdout:Sep 10 22:39:56 smithi019 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-9[68022]: 2024-09-10T22:39:56.852+0000 7fa3f61d4640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.138:6804 osd.2 since back 2024-09-10T22:39:18.122242+0000 front 2024-09-10T22:39:18.122082+0000 (oldest deadline 2024-09-10T22:39:44.022038+0000) 2024-09-10T22:39:57.209 INFO:journalctl@ceph.osd.9.smithi019.stdout:Sep 10 22:39:56 smithi019 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-9[68022]: 2024-09-10T22:39:56.852+0000 7fa3f61d4640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.19:6814 osd.3 since back 2024-09-10T22:39:28.623376+0000 front 2024-09-10T22:39:28.623431+0000 (oldest deadline 2024-09-10T22:39:52.723588+0000) 2024-09-10T22:39:57.360 INFO:journalctl@ceph.osd.10.smithi135.stdout:Sep 10 22:39:57 smithi135 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-10[59985]: 2024-09-10T22:39:57.066+0000 7f3bf1a69640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-10T22:38:54.201226+0000 front 2024-09-10T22:38:54.201244+0000 (oldest deadline 2024-09-10T22:39:26.502183+0000) 2024-09-10T22:39:57.360 INFO:journalctl@ceph.osd.10.smithi135.stdout:Sep 10 22:39:57 smithi135 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-10[59985]: 2024-09-10T22:39:57.066+0000 7f3bf1a69640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2024-09-10T22:39:12.303632+0000 front 2024-09-10T22:39:12.303699+0000 (oldest deadline 2024-09-10T22:39:37.003674+0000) 2024-09-10T22:39:57.360 INFO:journalctl@ceph.osd.10.smithi135.stdout:Sep 10 22:39:57 smithi135 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-10[59985]: 2024-09-10T22:39:57.066+0000 7f3bf1a69640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.138:6804 osd.2 since back 2024-09-10T22:39:20.504425+0000 front 2024-09-10T22:39:20.504380+0000 (oldest deadline 2024-09-10T22:39:42.105008+0000) 2024-09-10T22:39:57.360 INFO:journalctl@ceph.osd.10.smithi135.stdout:Sep 10 22:39:57 smithi135 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-10[59985]: 2024-09-10T22:39:57.066+0000 7f3bf1a69640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.19:6814 osd.3 since back 2024-09-10T22:39:29.106408+0000 front 2024-09-10T22:39:29.106333+0000 (oldest deadline 2024-09-10T22:39:54.406308+0000) 2024-09-10T22:39:57.360 INFO:journalctl@ceph.osd.7.smithi135.stdout:Sep 10 22:39:57 smithi135 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-7[53144]: 2024-09-10T22:39:57.163+0000 7ff6310c8640 -1 osd.7 80 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2024-09-10T22:39:11.910076+0000 front 2024-09-10T22:39:11.910097+0000 (oldest deadline 2024-09-10T22:39:36.010229+0000) 2024-09-10T22:39:57.360 INFO:journalctl@ceph.osd.7.smithi135.stdout:Sep 10 22:39:57 smithi135 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-7[53144]: 2024-09-10T22:39:57.163+0000 7ff6310c8640 -1 osd.7 80 heartbeat_check: no reply from 172.21.15.138:6804 osd.2 since back 2024-09-10T22:39:20.111330+0000 front 2024-09-10T22:39:20.111291+0000 (oldest deadline 2024-09-10T22:39:43.011420+0000) 2024-09-10T22:39:57.361 INFO:journalctl@ceph.osd.7.smithi135.stdout:Sep 10 22:39:57 smithi135 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-7[53144]: 2024-09-10T22:39:57.163+0000 7ff6310c8640 -1 osd.7 80 heartbeat_check: no reply from 172.21.15.19:6814 osd.3 since back 2024-09-10T22:39:28.312521+0000 front 2024-09-10T22:39:28.312461+0000 (oldest deadline 2024-09-10T22:39:50.012508+0000) 2024-09-10T22:39:58.125 INFO:journalctl@ceph.osd.8.smithi138.stdout:Sep 10 22:39:58 smithi138 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-8[53775]: 2024-09-10T22:39:58.002+0000 7f87faf53640 -1 osd.8 80 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2024-09-10T22:39:12.989835+0000 front 2024-09-10T22:39:12.989666+0000 (oldest deadline 2024-09-10T22:39:38.889906+0000) 2024-09-10T22:39:58.125 INFO:journalctl@ceph.osd.8.smithi138.stdout:Sep 10 22:39:58 smithi138 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-8[53775]: 2024-09-10T22:39:58.002+0000 7f87faf53640 -1 osd.8 80 heartbeat_check: no reply from 172.21.15.138:6804 osd.2 since back 2024-09-10T22:39:18.890233+0000 front 2024-09-10T22:39:18.890263+0000 (oldest deadline 2024-09-10T22:39:42.990418+0000) 2024-09-10T22:39:58.126 INFO:journalctl@ceph.osd.8.smithi138.stdout:Sep 10 22:39:58 smithi138 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-8[53775]: 2024-09-10T22:39:58.002+0000 7f87faf53640 -1 osd.8 80 heartbeat_check: no reply from 172.21.15.19:6814 osd.3 since back 2024-09-10T22:39:28.891445+0000 front 2024-09-10T22:39:28.891431+0000 (oldest deadline 2024-09-10T22:39:52.991311+0000) 2024-09-10T22:39:58.126 INFO:journalctl@ceph.osd.11.smithi138.stdout:Sep 10 22:39:57 smithi138 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-11[60796]: 2024-09-10T22:39:57.804+0000 7ffb00998640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-10T22:38:51.541208+0000 front 2024-09-10T22:38:51.541072+0000 (oldest deadline 2024-09-10T22:39:25.843622+0000) 2024-09-10T22:39:58.126 INFO:journalctl@ceph.osd.11.smithi138.stdout:Sep 10 22:39:57 smithi138 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-11[60796]: 2024-09-10T22:39:57.804+0000 7ffb00998640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2024-09-10T22:39:09.245148+0000 front 2024-09-10T22:39:09.245118+0000 (oldest deadline 2024-09-10T22:39:35.046015+0000) 2024-09-10T22:39:58.126 INFO:journalctl@ceph.osd.11.smithi138.stdout:Sep 10 22:39:57 smithi138 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-11[60796]: 2024-09-10T22:39:57.804+0000 7ffb00998640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.138:6804 osd.2 since back 2024-09-10T22:39:19.647426+0000 front 2024-09-10T22:39:19.647531+0000 (oldest deadline 2024-09-10T22:39:44.947487+0000) 2024-09-10T22:39:58.126 INFO:journalctl@ceph.osd.11.smithi138.stdout:Sep 10 22:39:57 smithi138 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-11[60796]: 2024-09-10T22:39:57.804+0000 7ffb00998640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.19:6814 osd.3 since back 2024-09-10T22:39:29.048508+0000 front 2024-09-10T22:39:29.048441+0000 (oldest deadline 2024-09-10T22:39:52.548620+0000) 2024-09-10T22:39:58.208 INFO:journalctl@ceph.osd.9.smithi019.stdout:Sep 10 22:39:57 smithi019 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-9[68022]: 2024-09-10T22:39:57.881+0000 7fa3f61d4640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-10T22:38:54.917764+0000 front 2024-09-10T22:38:54.917786+0000 (oldest deadline 2024-09-10T22:39:27.019686+0000) 2024-09-10T22:39:58.209 INFO:journalctl@ceph.osd.9.smithi019.stdout:Sep 10 22:39:57 smithi019 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-9[68022]: 2024-09-10T22:39:57.881+0000 7fa3f61d4640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2024-09-10T22:39:12.821560+0000 front 2024-09-10T22:39:12.821482+0000 (oldest deadline 2024-09-10T22:39:38.121512+0000) 2024-09-10T22:39:58.209 INFO:journalctl@ceph.osd.9.smithi019.stdout:Sep 10 22:39:57 smithi019 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-9[68022]: 2024-09-10T22:39:57.881+0000 7fa3f61d4640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.138:6804 osd.2 since back 2024-09-10T22:39:18.122242+0000 front 2024-09-10T22:39:18.122082+0000 (oldest deadline 2024-09-10T22:39:44.022038+0000) 2024-09-10T22:39:58.209 INFO:journalctl@ceph.osd.9.smithi019.stdout:Sep 10 22:39:57 smithi019 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-9[68022]: 2024-09-10T22:39:57.881+0000 7fa3f61d4640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.19:6814 osd.3 since back 2024-09-10T22:39:28.623376+0000 front 2024-09-10T22:39:28.623431+0000 (oldest deadline 2024-09-10T22:39:52.723588+0000) 2024-09-10T22:39:58.360 INFO:journalctl@ceph.osd.7.smithi135.stdout:Sep 10 22:39:58 smithi135 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-7[53144]: 2024-09-10T22:39:58.147+0000 7ff6310c8640 -1 osd.7 80 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2024-09-10T22:39:11.910076+0000 front 2024-09-10T22:39:11.910097+0000 (oldest deadline 2024-09-10T22:39:36.010229+0000) 2024-09-10T22:39:58.360 INFO:journalctl@ceph.osd.7.smithi135.stdout:Sep 10 22:39:58 smithi135 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-7[53144]: 2024-09-10T22:39:58.147+0000 7ff6310c8640 -1 osd.7 80 heartbeat_check: no reply from 172.21.15.138:6804 osd.2 since back 2024-09-10T22:39:20.111330+0000 front 2024-09-10T22:39:20.111291+0000 (oldest deadline 2024-09-10T22:39:43.011420+0000) 2024-09-10T22:39:58.360 INFO:journalctl@ceph.osd.7.smithi135.stdout:Sep 10 22:39:58 smithi135 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-7[53144]: 2024-09-10T22:39:58.147+0000 7ff6310c8640 -1 osd.7 80 heartbeat_check: no reply from 172.21.15.19:6814 osd.3 since back 2024-09-10T22:39:28.312521+0000 front 2024-09-10T22:39:28.312461+0000 (oldest deadline 2024-09-10T22:39:50.012508+0000) 2024-09-10T22:39:58.360 INFO:journalctl@ceph.osd.10.smithi135.stdout:Sep 10 22:39:58 smithi135 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-10[59985]: 2024-09-10T22:39:58.046+0000 7f3bf1a69640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-10T22:38:54.201226+0000 front 2024-09-10T22:38:54.201244+0000 (oldest deadline 2024-09-10T22:39:26.502183+0000) 2024-09-10T22:39:58.360 INFO:journalctl@ceph.osd.10.smithi135.stdout:Sep 10 22:39:58 smithi135 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-10[59985]: 2024-09-10T22:39:58.046+0000 7f3bf1a69640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2024-09-10T22:39:12.303632+0000 front 2024-09-10T22:39:12.303699+0000 (oldest deadline 2024-09-10T22:39:37.003674+0000) 2024-09-10T22:39:58.360 INFO:journalctl@ceph.osd.10.smithi135.stdout:Sep 10 22:39:58 smithi135 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-10[59985]: 2024-09-10T22:39:58.046+0000 7f3bf1a69640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.138:6804 osd.2 since back 2024-09-10T22:39:20.504425+0000 front 2024-09-10T22:39:20.504380+0000 (oldest deadline 2024-09-10T22:39:42.105008+0000) 2024-09-10T22:39:58.361 INFO:journalctl@ceph.osd.10.smithi135.stdout:Sep 10 22:39:58 smithi135 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-10[59985]: 2024-09-10T22:39:58.046+0000 7f3bf1a69640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.19:6814 osd.3 since back 2024-09-10T22:39:29.106408+0000 front 2024-09-10T22:39:29.106333+0000 (oldest deadline 2024-09-10T22:39:54.406308+0000) 2024-09-10T22:39:59.125 INFO:journalctl@ceph.osd.8.smithi138.stdout:Sep 10 22:39:58 smithi138 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-8[53775]: 2024-09-10T22:39:58.956+0000 7f87faf53640 -1 osd.8 80 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2024-09-10T22:39:12.989835+0000 front 2024-09-10T22:39:12.989666+0000 (oldest deadline 2024-09-10T22:39:38.889906+0000) 2024-09-10T22:39:59.125 INFO:journalctl@ceph.osd.8.smithi138.stdout:Sep 10 22:39:58 smithi138 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-8[53775]: 2024-09-10T22:39:58.956+0000 7f87faf53640 -1 osd.8 80 heartbeat_check: no reply from 172.21.15.138:6804 osd.2 since back 2024-09-10T22:39:18.890233+0000 front 2024-09-10T22:39:18.890263+0000 (oldest deadline 2024-09-10T22:39:42.990418+0000) 2024-09-10T22:39:59.125 INFO:journalctl@ceph.osd.8.smithi138.stdout:Sep 10 22:39:58 smithi138 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-8[53775]: 2024-09-10T22:39:58.956+0000 7f87faf53640 -1 osd.8 80 heartbeat_check: no reply from 172.21.15.19:6814 osd.3 since back 2024-09-10T22:39:28.891445+0000 front 2024-09-10T22:39:28.891431+0000 (oldest deadline 2024-09-10T22:39:52.991311+0000) 2024-09-10T22:39:59.126 INFO:journalctl@ceph.osd.11.smithi138.stdout:Sep 10 22:39:58 smithi138 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-11[60796]: 2024-09-10T22:39:58.778+0000 7ffb00998640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-10T22:38:51.541208+0000 front 2024-09-10T22:38:51.541072+0000 (oldest deadline 2024-09-10T22:39:25.843622+0000) 2024-09-10T22:39:59.126 INFO:journalctl@ceph.osd.11.smithi138.stdout:Sep 10 22:39:58 smithi138 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-11[60796]: 2024-09-10T22:39:58.778+0000 7ffb00998640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2024-09-10T22:39:09.245148+0000 front 2024-09-10T22:39:09.245118+0000 (oldest deadline 2024-09-10T22:39:35.046015+0000) 2024-09-10T22:39:59.126 INFO:journalctl@ceph.osd.11.smithi138.stdout:Sep 10 22:39:58 smithi138 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-11[60796]: 2024-09-10T22:39:58.778+0000 7ffb00998640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.138:6804 osd.2 since back 2024-09-10T22:39:19.647426+0000 front 2024-09-10T22:39:19.647531+0000 (oldest deadline 2024-09-10T22:39:44.947487+0000) 2024-09-10T22:39:59.126 INFO:journalctl@ceph.osd.11.smithi138.stdout:Sep 10 22:39:58 smithi138 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-11[60796]: 2024-09-10T22:39:58.778+0000 7ffb00998640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.19:6814 osd.3 since back 2024-09-10T22:39:29.048508+0000 front 2024-09-10T22:39:29.048441+0000 (oldest deadline 2024-09-10T22:39:52.548620+0000) 2024-09-10T22:39:59.209 INFO:journalctl@ceph.osd.9.smithi019.stdout:Sep 10 22:39:58 smithi019 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-9[68022]: 2024-09-10T22:39:58.869+0000 7fa3f61d4640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-10T22:38:54.917764+0000 front 2024-09-10T22:38:54.917786+0000 (oldest deadline 2024-09-10T22:39:27.019686+0000) 2024-09-10T22:39:59.209 INFO:journalctl@ceph.osd.9.smithi019.stdout:Sep 10 22:39:58 smithi019 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-9[68022]: 2024-09-10T22:39:58.869+0000 7fa3f61d4640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2024-09-10T22:39:12.821560+0000 front 2024-09-10T22:39:12.821482+0000 (oldest deadline 2024-09-10T22:39:38.121512+0000) 2024-09-10T22:39:59.209 INFO:journalctl@ceph.osd.9.smithi019.stdout:Sep 10 22:39:58 smithi019 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-9[68022]: 2024-09-10T22:39:58.869+0000 7fa3f61d4640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.138:6804 osd.2 since back 2024-09-10T22:39:18.122242+0000 front 2024-09-10T22:39:18.122082+0000 (oldest deadline 2024-09-10T22:39:44.022038+0000) 2024-09-10T22:39:59.209 INFO:journalctl@ceph.osd.9.smithi019.stdout:Sep 10 22:39:58 smithi019 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-9[68022]: 2024-09-10T22:39:58.869+0000 7fa3f61d4640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.19:6814 osd.3 since back 2024-09-10T22:39:28.623376+0000 front 2024-09-10T22:39:28.623431+0000 (oldest deadline 2024-09-10T22:39:52.723588+0000) 2024-09-10T22:39:59.360 INFO:journalctl@ceph.osd.7.smithi135.stdout:Sep 10 22:39:59 smithi135 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-7[53144]: 2024-09-10T22:39:59.170+0000 7ff6310c8640 -1 osd.7 80 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2024-09-10T22:39:11.910076+0000 front 2024-09-10T22:39:11.910097+0000 (oldest deadline 2024-09-10T22:39:36.010229+0000) 2024-09-10T22:39:59.360 INFO:journalctl@ceph.osd.7.smithi135.stdout:Sep 10 22:39:59 smithi135 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-7[53144]: 2024-09-10T22:39:59.170+0000 7ff6310c8640 -1 osd.7 80 heartbeat_check: no reply from 172.21.15.138:6804 osd.2 since back 2024-09-10T22:39:20.111330+0000 front 2024-09-10T22:39:20.111291+0000 (oldest deadline 2024-09-10T22:39:43.011420+0000) 2024-09-10T22:39:59.360 INFO:journalctl@ceph.osd.7.smithi135.stdout:Sep 10 22:39:59 smithi135 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-7[53144]: 2024-09-10T22:39:59.170+0000 7ff6310c8640 -1 osd.7 80 heartbeat_check: no reply from 172.21.15.19:6814 osd.3 since back 2024-09-10T22:39:28.312521+0000 front 2024-09-10T22:39:28.312461+0000 (oldest deadline 2024-09-10T22:39:50.012508+0000) 2024-09-10T22:39:59.360 INFO:journalctl@ceph.osd.10.smithi135.stdout:Sep 10 22:39:59 smithi135 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-10[59985]: 2024-09-10T22:39:59.069+0000 7f3bf1a69640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-10T22:38:54.201226+0000 front 2024-09-10T22:38:54.201244+0000 (oldest deadline 2024-09-10T22:39:26.502183+0000) 2024-09-10T22:39:59.360 INFO:journalctl@ceph.osd.10.smithi135.stdout:Sep 10 22:39:59 smithi135 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-10[59985]: 2024-09-10T22:39:59.069+0000 7f3bf1a69640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2024-09-10T22:39:12.303632+0000 front 2024-09-10T22:39:12.303699+0000 (oldest deadline 2024-09-10T22:39:37.003674+0000) 2024-09-10T22:39:59.360 INFO:journalctl@ceph.osd.10.smithi135.stdout:Sep 10 22:39:59 smithi135 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-10[59985]: 2024-09-10T22:39:59.069+0000 7f3bf1a69640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.138:6804 osd.2 since back 2024-09-10T22:39:20.504425+0000 front 2024-09-10T22:39:20.504380+0000 (oldest deadline 2024-09-10T22:39:42.105008+0000) 2024-09-10T22:39:59.360 INFO:journalctl@ceph.osd.10.smithi135.stdout:Sep 10 22:39:59 smithi135 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-10[59985]: 2024-09-10T22:39:59.069+0000 7f3bf1a69640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.19:6814 osd.3 since back 2024-09-10T22:39:29.106408+0000 front 2024-09-10T22:39:29.106333+0000 (oldest deadline 2024-09-10T22:39:54.406308+0000) 2024-09-10T22:40:00.126 INFO:journalctl@ceph.osd.8.smithi138.stdout:Sep 10 22:39:59 smithi138 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-8[53775]: 2024-09-10T22:39:59.944+0000 7f87faf53640 -1 osd.8 80 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2024-09-10T22:39:12.989835+0000 front 2024-09-10T22:39:12.989666+0000 (oldest deadline 2024-09-10T22:39:38.889906+0000) 2024-09-10T22:40:00.126 INFO:journalctl@ceph.osd.8.smithi138.stdout:Sep 10 22:39:59 smithi138 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-8[53775]: 2024-09-10T22:39:59.944+0000 7f87faf53640 -1 osd.8 80 heartbeat_check: no reply from 172.21.15.138:6804 osd.2 since back 2024-09-10T22:39:18.890233+0000 front 2024-09-10T22:39:18.890263+0000 (oldest deadline 2024-09-10T22:39:42.990418+0000) 2024-09-10T22:40:00.126 INFO:journalctl@ceph.osd.8.smithi138.stdout:Sep 10 22:39:59 smithi138 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-8[53775]: 2024-09-10T22:39:59.944+0000 7f87faf53640 -1 osd.8 80 heartbeat_check: no reply from 172.21.15.19:6814 osd.3 since back 2024-09-10T22:39:28.891445+0000 front 2024-09-10T22:39:28.891431+0000 (oldest deadline 2024-09-10T22:39:52.991311+0000) 2024-09-10T22:40:00.126 INFO:journalctl@ceph.osd.8.smithi138.stdout:Sep 10 22:39:59 smithi138 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-8[53775]: 2024-09-10T22:39:59.944+0000 7f87faf53640 -1 osd.8 80 heartbeat_check: no reply from 172.21.15.135:6812 osd.4 since back 2024-09-10T22:39:36.992851+0000 front 2024-09-10T22:39:36.992837+0000 (oldest deadline 2024-09-10T22:39:59.292785+0000) 2024-09-10T22:40:00.127 INFO:journalctl@ceph.osd.11.smithi138.stdout:Sep 10 22:39:59 smithi138 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-11[60796]: 2024-09-10T22:39:59.759+0000 7ffb00998640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-10T22:38:51.541208+0000 front 2024-09-10T22:38:51.541072+0000 (oldest deadline 2024-09-10T22:39:25.843622+0000) 2024-09-10T22:40:00.127 INFO:journalctl@ceph.osd.11.smithi138.stdout:Sep 10 22:39:59 smithi138 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-11[60796]: 2024-09-10T22:39:59.759+0000 7ffb00998640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2024-09-10T22:39:09.245148+0000 front 2024-09-10T22:39:09.245118+0000 (oldest deadline 2024-09-10T22:39:35.046015+0000) 2024-09-10T22:40:00.127 INFO:journalctl@ceph.osd.11.smithi138.stdout:Sep 10 22:39:59 smithi138 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-11[60796]: 2024-09-10T22:39:59.759+0000 7ffb00998640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.138:6804 osd.2 since back 2024-09-10T22:39:19.647426+0000 front 2024-09-10T22:39:19.647531+0000 (oldest deadline 2024-09-10T22:39:44.947487+0000) 2024-09-10T22:40:00.127 INFO:journalctl@ceph.osd.11.smithi138.stdout:Sep 10 22:39:59 smithi138 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-11[60796]: 2024-09-10T22:39:59.759+0000 7ffb00998640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.19:6814 osd.3 since back 2024-09-10T22:39:29.048508+0000 front 2024-09-10T22:39:29.048441+0000 (oldest deadline 2024-09-10T22:39:52.548620+0000) 2024-09-10T22:40:00.127 INFO:journalctl@ceph.osd.11.smithi138.stdout:Sep 10 22:39:59 smithi138 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-11[60796]: 2024-09-10T22:39:59.759+0000 7ffb00998640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.135:6812 osd.4 since back 2024-09-10T22:39:34.249759+0000 front 2024-09-10T22:39:34.249711+0000 (oldest deadline 2024-09-10T22:39:59.450249+0000) 2024-09-10T22:40:00.208 INFO:journalctl@ceph.osd.9.smithi019.stdout:Sep 10 22:39:59 smithi019 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-9[68022]: 2024-09-10T22:39:59.841+0000 7fa3f61d4640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-10T22:38:54.917764+0000 front 2024-09-10T22:38:54.917786+0000 (oldest deadline 2024-09-10T22:39:27.019686+0000) 2024-09-10T22:40:00.208 INFO:journalctl@ceph.osd.9.smithi019.stdout:Sep 10 22:39:59 smithi019 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-9[68022]: 2024-09-10T22:39:59.841+0000 7fa3f61d4640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2024-09-10T22:39:12.821560+0000 front 2024-09-10T22:39:12.821482+0000 (oldest deadline 2024-09-10T22:39:38.121512+0000) 2024-09-10T22:40:00.209 INFO:journalctl@ceph.osd.9.smithi019.stdout:Sep 10 22:39:59 smithi019 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-9[68022]: 2024-09-10T22:39:59.841+0000 7fa3f61d4640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.138:6804 osd.2 since back 2024-09-10T22:39:18.122242+0000 front 2024-09-10T22:39:18.122082+0000 (oldest deadline 2024-09-10T22:39:44.022038+0000) 2024-09-10T22:40:00.209 INFO:journalctl@ceph.osd.9.smithi019.stdout:Sep 10 22:39:59 smithi019 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-9[68022]: 2024-09-10T22:39:59.841+0000 7fa3f61d4640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.19:6814 osd.3 since back 2024-09-10T22:39:28.623376+0000 front 2024-09-10T22:39:28.623431+0000 (oldest deadline 2024-09-10T22:39:52.723588+0000) 2024-09-10T22:40:00.360 INFO:journalctl@ceph.osd.7.smithi135.stdout:Sep 10 22:40:00 smithi135 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-7[53144]: 2024-09-10T22:40:00.143+0000 7ff6310c8640 -1 osd.7 80 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2024-09-10T22:39:11.910076+0000 front 2024-09-10T22:39:11.910097+0000 (oldest deadline 2024-09-10T22:39:36.010229+0000) 2024-09-10T22:40:00.360 INFO:journalctl@ceph.osd.7.smithi135.stdout:Sep 10 22:40:00 smithi135 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-7[53144]: 2024-09-10T22:40:00.143+0000 7ff6310c8640 -1 osd.7 80 heartbeat_check: no reply from 172.21.15.138:6804 osd.2 since back 2024-09-10T22:39:20.111330+0000 front 2024-09-10T22:39:20.111291+0000 (oldest deadline 2024-09-10T22:39:43.011420+0000) 2024-09-10T22:40:00.360 INFO:journalctl@ceph.osd.7.smithi135.stdout:Sep 10 22:40:00 smithi135 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-7[53144]: 2024-09-10T22:40:00.143+0000 7ff6310c8640 -1 osd.7 80 heartbeat_check: no reply from 172.21.15.19:6814 osd.3 since back 2024-09-10T22:39:28.312521+0000 front 2024-09-10T22:39:28.312461+0000 (oldest deadline 2024-09-10T22:39:50.012508+0000) 2024-09-10T22:40:00.360 INFO:journalctl@ceph.osd.10.smithi135.stdout:Sep 10 22:40:00 smithi135 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-10[59985]: 2024-09-10T22:40:00.021+0000 7f3bf1a69640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-10T22:38:54.201226+0000 front 2024-09-10T22:38:54.201244+0000 (oldest deadline 2024-09-10T22:39:26.502183+0000) 2024-09-10T22:40:00.360 INFO:journalctl@ceph.osd.10.smithi135.stdout:Sep 10 22:40:00 smithi135 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-10[59985]: 2024-09-10T22:40:00.021+0000 7f3bf1a69640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2024-09-10T22:39:12.303632+0000 front 2024-09-10T22:39:12.303699+0000 (oldest deadline 2024-09-10T22:39:37.003674+0000) 2024-09-10T22:40:00.360 INFO:journalctl@ceph.osd.10.smithi135.stdout:Sep 10 22:40:00 smithi135 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-10[59985]: 2024-09-10T22:40:00.021+0000 7f3bf1a69640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.138:6804 osd.2 since back 2024-09-10T22:39:20.504425+0000 front 2024-09-10T22:39:20.504380+0000 (oldest deadline 2024-09-10T22:39:42.105008+0000) 2024-09-10T22:40:00.361 INFO:journalctl@ceph.osd.10.smithi135.stdout:Sep 10 22:40:00 smithi135 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-10[59985]: 2024-09-10T22:40:00.021+0000 7f3bf1a69640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.19:6814 osd.3 since back 2024-09-10T22:39:29.106408+0000 front 2024-09-10T22:39:29.106333+0000 (oldest deadline 2024-09-10T22:39:54.406308+0000) 2024-09-10T22:40:01.125 INFO:journalctl@ceph.osd.8.smithi138.stdout:Sep 10 22:40:00 smithi138 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-8[53775]: 2024-09-10T22:40:00.947+0000 7f87faf53640 -1 osd.8 80 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2024-09-10T22:39:12.989835+0000 front 2024-09-10T22:39:12.989666+0000 (oldest deadline 2024-09-10T22:39:38.889906+0000) 2024-09-10T22:40:01.126 INFO:journalctl@ceph.osd.8.smithi138.stdout:Sep 10 22:40:00 smithi138 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-8[53775]: 2024-09-10T22:40:00.947+0000 7f87faf53640 -1 osd.8 80 heartbeat_check: no reply from 172.21.15.138:6804 osd.2 since back 2024-09-10T22:39:18.890233+0000 front 2024-09-10T22:39:18.890263+0000 (oldest deadline 2024-09-10T22:39:42.990418+0000) 2024-09-10T22:40:01.126 INFO:journalctl@ceph.osd.8.smithi138.stdout:Sep 10 22:40:00 smithi138 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-8[53775]: 2024-09-10T22:40:00.947+0000 7f87faf53640 -1 osd.8 80 heartbeat_check: no reply from 172.21.15.19:6814 osd.3 since back 2024-09-10T22:39:28.891445+0000 front 2024-09-10T22:39:28.891431+0000 (oldest deadline 2024-09-10T22:39:52.991311+0000) 2024-09-10T22:40:01.126 INFO:journalctl@ceph.osd.8.smithi138.stdout:Sep 10 22:40:00 smithi138 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-8[53775]: 2024-09-10T22:40:00.947+0000 7f87faf53640 -1 osd.8 80 heartbeat_check: no reply from 172.21.15.135:6812 osd.4 since back 2024-09-10T22:39:36.992851+0000 front 2024-09-10T22:39:36.992837+0000 (oldest deadline 2024-09-10T22:39:59.292785+0000) 2024-09-10T22:40:01.127 INFO:journalctl@ceph.osd.11.smithi138.stdout:Sep 10 22:40:00 smithi138 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-11[60796]: 2024-09-10T22:40:00.750+0000 7ffb00998640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-10T22:38:51.541208+0000 front 2024-09-10T22:38:51.541072+0000 (oldest deadline 2024-09-10T22:39:25.843622+0000) 2024-09-10T22:40:01.127 INFO:journalctl@ceph.osd.11.smithi138.stdout:Sep 10 22:40:00 smithi138 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-11[60796]: 2024-09-10T22:40:00.750+0000 7ffb00998640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2024-09-10T22:39:09.245148+0000 front 2024-09-10T22:39:09.245118+0000 (oldest deadline 2024-09-10T22:39:35.046015+0000) 2024-09-10T22:40:01.127 INFO:journalctl@ceph.osd.11.smithi138.stdout:Sep 10 22:40:00 smithi138 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-11[60796]: 2024-09-10T22:40:00.750+0000 7ffb00998640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.138:6804 osd.2 since back 2024-09-10T22:39:19.647426+0000 front 2024-09-10T22:39:19.647531+0000 (oldest deadline 2024-09-10T22:39:44.947487+0000) 2024-09-10T22:40:01.127 INFO:journalctl@ceph.osd.11.smithi138.stdout:Sep 10 22:40:00 smithi138 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-11[60796]: 2024-09-10T22:40:00.750+0000 7ffb00998640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.19:6814 osd.3 since back 2024-09-10T22:39:29.048508+0000 front 2024-09-10T22:39:29.048441+0000 (oldest deadline 2024-09-10T22:39:52.548620+0000) 2024-09-10T22:40:01.127 INFO:journalctl@ceph.osd.11.smithi138.stdout:Sep 10 22:40:00 smithi138 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-11[60796]: 2024-09-10T22:40:00.750+0000 7ffb00998640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.135:6812 osd.4 since back 2024-09-10T22:39:34.249759+0000 front 2024-09-10T22:39:34.249711+0000 (oldest deadline 2024-09-10T22:39:59.450249+0000) 2024-09-10T22:40:01.208 INFO:journalctl@ceph.osd.9.smithi019.stdout:Sep 10 22:40:00 smithi019 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-9[68022]: 2024-09-10T22:40:00.861+0000 7fa3f61d4640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-10T22:38:54.917764+0000 front 2024-09-10T22:38:54.917786+0000 (oldest deadline 2024-09-10T22:39:27.019686+0000) 2024-09-10T22:40:01.209 INFO:journalctl@ceph.osd.9.smithi019.stdout:Sep 10 22:40:00 smithi019 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-9[68022]: 2024-09-10T22:40:00.861+0000 7fa3f61d4640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2024-09-10T22:39:12.821560+0000 front 2024-09-10T22:39:12.821482+0000 (oldest deadline 2024-09-10T22:39:38.121512+0000) 2024-09-10T22:40:01.209 INFO:journalctl@ceph.osd.9.smithi019.stdout:Sep 10 22:40:00 smithi019 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-9[68022]: 2024-09-10T22:40:00.861+0000 7fa3f61d4640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.138:6804 osd.2 since back 2024-09-10T22:39:18.122242+0000 front 2024-09-10T22:39:18.122082+0000 (oldest deadline 2024-09-10T22:39:44.022038+0000) 2024-09-10T22:40:01.209 INFO:journalctl@ceph.osd.9.smithi019.stdout:Sep 10 22:40:00 smithi019 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-9[68022]: 2024-09-10T22:40:00.861+0000 7fa3f61d4640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.19:6814 osd.3 since back 2024-09-10T22:39:28.623376+0000 front 2024-09-10T22:39:28.623431+0000 (oldest deadline 2024-09-10T22:39:52.723588+0000) 2024-09-10T22:40:01.360 INFO:journalctl@ceph.osd.7.smithi135.stdout:Sep 10 22:40:01 smithi135 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-7[53144]: 2024-09-10T22:40:01.145+0000 7ff6310c8640 -1 osd.7 80 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2024-09-10T22:39:11.910076+0000 front 2024-09-10T22:39:11.910097+0000 (oldest deadline 2024-09-10T22:39:36.010229+0000) 2024-09-10T22:40:01.360 INFO:journalctl@ceph.osd.7.smithi135.stdout:Sep 10 22:40:01 smithi135 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-7[53144]: 2024-09-10T22:40:01.145+0000 7ff6310c8640 -1 osd.7 80 heartbeat_check: no reply from 172.21.15.138:6804 osd.2 since back 2024-09-10T22:39:20.111330+0000 front 2024-09-10T22:39:20.111291+0000 (oldest deadline 2024-09-10T22:39:43.011420+0000) 2024-09-10T22:40:01.360 INFO:journalctl@ceph.osd.7.smithi135.stdout:Sep 10 22:40:01 smithi135 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-7[53144]: 2024-09-10T22:40:01.145+0000 7ff6310c8640 -1 osd.7 80 heartbeat_check: no reply from 172.21.15.19:6814 osd.3 since back 2024-09-10T22:39:28.312521+0000 front 2024-09-10T22:39:28.312461+0000 (oldest deadline 2024-09-10T22:39:50.012508+0000) 2024-09-10T22:40:01.360 INFO:journalctl@ceph.osd.7.smithi135.stdout:Sep 10 22:40:01 smithi135 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-7[53144]: 2024-09-10T22:40:01.145+0000 7ff6310c8640 -1 osd.7 80 heartbeat_check: no reply from 172.21.15.135:6812 osd.4 since back 2024-09-10T22:39:35.913468+0000 front 2024-09-10T22:39:35.913415+0000 (oldest deadline 2024-09-10T22:40:00.613681+0000) 2024-09-10T22:40:01.360 INFO:journalctl@ceph.osd.10.smithi135.stdout:Sep 10 22:40:00 smithi135 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-10[59985]: 2024-09-10T22:40:00.977+0000 7f3bf1a69640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-10T22:38:54.201226+0000 front 2024-09-10T22:38:54.201244+0000 (oldest deadline 2024-09-10T22:39:26.502183+0000) 2024-09-10T22:40:01.360 INFO:journalctl@ceph.osd.10.smithi135.stdout:Sep 10 22:40:00 smithi135 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-10[59985]: 2024-09-10T22:40:00.977+0000 7f3bf1a69640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2024-09-10T22:39:12.303632+0000 front 2024-09-10T22:39:12.303699+0000 (oldest deadline 2024-09-10T22:39:37.003674+0000) 2024-09-10T22:40:01.361 INFO:journalctl@ceph.osd.10.smithi135.stdout:Sep 10 22:40:00 smithi135 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-10[59985]: 2024-09-10T22:40:00.977+0000 7f3bf1a69640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.138:6804 osd.2 since back 2024-09-10T22:39:20.504425+0000 front 2024-09-10T22:39:20.504380+0000 (oldest deadline 2024-09-10T22:39:42.105008+0000) 2024-09-10T22:40:01.361 INFO:journalctl@ceph.osd.10.smithi135.stdout:Sep 10 22:40:00 smithi135 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-10[59985]: 2024-09-10T22:40:00.977+0000 7f3bf1a69640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.19:6814 osd.3 since back 2024-09-10T22:39:29.106408+0000 front 2024-09-10T22:39:29.106333+0000 (oldest deadline 2024-09-10T22:39:54.406308+0000) 2024-09-10T22:40:01.985 INFO:journalctl@ceph.osd.7.smithi135.stdout:Sep 10 22:40:01 smithi135 podman[70498]: 2024-09-10 22:40:01.695109423 +0000 UTC m=+5.625881876 container died fffdc7b78edbb4f1f33adbe3f6130a8aeeb13a971723252b150fca24e6d1fab5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-7, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, ceph=True, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.vendor=CentOS) 2024-09-10T22:40:02.125 INFO:journalctl@ceph.osd.8.smithi138.stdout:Sep 10 22:40:01 smithi138 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-8[53775]: 2024-09-10T22:40:01.933+0000 7f87faf53640 -1 osd.8 80 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2024-09-10T22:39:12.989835+0000 front 2024-09-10T22:39:12.989666+0000 (oldest deadline 2024-09-10T22:39:38.889906+0000) 2024-09-10T22:40:02.125 INFO:journalctl@ceph.osd.8.smithi138.stdout:Sep 10 22:40:01 smithi138 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-8[53775]: 2024-09-10T22:40:01.933+0000 7f87faf53640 -1 osd.8 80 heartbeat_check: no reply from 172.21.15.138:6804 osd.2 since back 2024-09-10T22:39:18.890233+0000 front 2024-09-10T22:39:18.890263+0000 (oldest deadline 2024-09-10T22:39:42.990418+0000) 2024-09-10T22:40:02.125 INFO:journalctl@ceph.osd.8.smithi138.stdout:Sep 10 22:40:01 smithi138 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-8[53775]: 2024-09-10T22:40:01.933+0000 7f87faf53640 -1 osd.8 80 heartbeat_check: no reply from 172.21.15.19:6814 osd.3 since back 2024-09-10T22:39:28.891445+0000 front 2024-09-10T22:39:28.891431+0000 (oldest deadline 2024-09-10T22:39:52.991311+0000) 2024-09-10T22:40:02.126 INFO:journalctl@ceph.osd.8.smithi138.stdout:Sep 10 22:40:01 smithi138 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-8[53775]: 2024-09-10T22:40:01.933+0000 7f87faf53640 -1 osd.8 80 heartbeat_check: no reply from 172.21.15.135:6812 osd.4 since back 2024-09-10T22:39:36.992851+0000 front 2024-09-10T22:39:36.992837+0000 (oldest deadline 2024-09-10T22:39:59.292785+0000) 2024-09-10T22:40:02.126 INFO:journalctl@ceph.osd.11.smithi138.stdout:Sep 10 22:40:01 smithi138 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-11[60796]: 2024-09-10T22:40:01.748+0000 7ffb00998640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-10T22:38:51.541208+0000 front 2024-09-10T22:38:51.541072+0000 (oldest deadline 2024-09-10T22:39:25.843622+0000) 2024-09-10T22:40:02.126 INFO:journalctl@ceph.osd.11.smithi138.stdout:Sep 10 22:40:01 smithi138 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-11[60796]: 2024-09-10T22:40:01.748+0000 7ffb00998640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2024-09-10T22:39:09.245148+0000 front 2024-09-10T22:39:09.245118+0000 (oldest deadline 2024-09-10T22:39:35.046015+0000) 2024-09-10T22:40:02.126 INFO:journalctl@ceph.osd.11.smithi138.stdout:Sep 10 22:40:01 smithi138 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-11[60796]: 2024-09-10T22:40:01.748+0000 7ffb00998640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.138:6804 osd.2 since back 2024-09-10T22:39:19.647426+0000 front 2024-09-10T22:39:19.647531+0000 (oldest deadline 2024-09-10T22:39:44.947487+0000) 2024-09-10T22:40:02.126 INFO:journalctl@ceph.osd.11.smithi138.stdout:Sep 10 22:40:01 smithi138 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-11[60796]: 2024-09-10T22:40:01.748+0000 7ffb00998640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.19:6814 osd.3 since back 2024-09-10T22:39:29.048508+0000 front 2024-09-10T22:39:29.048441+0000 (oldest deadline 2024-09-10T22:39:52.548620+0000) 2024-09-10T22:40:02.126 INFO:journalctl@ceph.osd.11.smithi138.stdout:Sep 10 22:40:01 smithi138 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-11[60796]: 2024-09-10T22:40:01.748+0000 7ffb00998640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.135:6812 osd.4 since back 2024-09-10T22:39:34.249759+0000 front 2024-09-10T22:39:34.249711+0000 (oldest deadline 2024-09-10T22:39:59.450249+0000) 2024-09-10T22:40:02.208 INFO:journalctl@ceph.osd.9.smithi019.stdout:Sep 10 22:40:01 smithi019 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-9[68022]: 2024-09-10T22:40:01.858+0000 7fa3f61d4640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-10T22:38:54.917764+0000 front 2024-09-10T22:38:54.917786+0000 (oldest deadline 2024-09-10T22:39:27.019686+0000) 2024-09-10T22:40:02.209 INFO:journalctl@ceph.osd.9.smithi019.stdout:Sep 10 22:40:01 smithi019 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-9[68022]: 2024-09-10T22:40:01.858+0000 7fa3f61d4640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2024-09-10T22:39:12.821560+0000 front 2024-09-10T22:39:12.821482+0000 (oldest deadline 2024-09-10T22:39:38.121512+0000) 2024-09-10T22:40:02.209 INFO:journalctl@ceph.osd.9.smithi019.stdout:Sep 10 22:40:01 smithi019 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-9[68022]: 2024-09-10T22:40:01.858+0000 7fa3f61d4640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.138:6804 osd.2 since back 2024-09-10T22:39:18.122242+0000 front 2024-09-10T22:39:18.122082+0000 (oldest deadline 2024-09-10T22:39:44.022038+0000) 2024-09-10T22:40:02.209 INFO:journalctl@ceph.osd.9.smithi019.stdout:Sep 10 22:40:01 smithi019 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-9[68022]: 2024-09-10T22:40:01.858+0000 7fa3f61d4640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.19:6814 osd.3 since back 2024-09-10T22:39:28.623376+0000 front 2024-09-10T22:39:28.623431+0000 (oldest deadline 2024-09-10T22:39:52.723588+0000) 2024-09-10T22:40:02.331 INFO:journalctl@ceph.osd.7.smithi135.stdout:Sep 10 22:40:02 smithi135 podman[70498]: 2024-09-10 22:40:02.079285239 +0000 UTC m=+6.010057688 container cleanup fffdc7b78edbb4f1f33adbe3f6130a8aeeb13a971723252b150fca24e6d1fab5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-7, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_CLEAN=True, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-10T22:40:02.331 INFO:journalctl@ceph.osd.7.smithi135.stdout:Sep 10 22:40:02 smithi135 bash[70498]: ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-7 2024-09-10T22:40:02.331 INFO:journalctl@ceph.osd.10.smithi135.stdout:Sep 10 22:40:02 smithi135 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-10[59985]: 2024-09-10T22:40:02.011+0000 7f3bf1a69640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-10T22:38:54.201226+0000 front 2024-09-10T22:38:54.201244+0000 (oldest deadline 2024-09-10T22:39:26.502183+0000) 2024-09-10T22:40:02.331 INFO:journalctl@ceph.osd.10.smithi135.stdout:Sep 10 22:40:02 smithi135 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-10[59985]: 2024-09-10T22:40:02.011+0000 7f3bf1a69640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2024-09-10T22:39:12.303632+0000 front 2024-09-10T22:39:12.303699+0000 (oldest deadline 2024-09-10T22:39:37.003674+0000) 2024-09-10T22:40:02.331 INFO:journalctl@ceph.osd.10.smithi135.stdout:Sep 10 22:40:02 smithi135 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-10[59985]: 2024-09-10T22:40:02.011+0000 7f3bf1a69640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.138:6804 osd.2 since back 2024-09-10T22:39:20.504425+0000 front 2024-09-10T22:39:20.504380+0000 (oldest deadline 2024-09-10T22:39:42.105008+0000) 2024-09-10T22:40:02.331 INFO:journalctl@ceph.osd.10.smithi135.stdout:Sep 10 22:40:02 smithi135 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-10[59985]: 2024-09-10T22:40:02.011+0000 7f3bf1a69640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.19:6814 osd.3 since back 2024-09-10T22:39:29.106408+0000 front 2024-09-10T22:39:29.106333+0000 (oldest deadline 2024-09-10T22:39:54.406308+0000) 2024-09-10T22:40:02.331 INFO:journalctl@ceph.osd.10.smithi135.stdout:Sep 10 22:40:02 smithi135 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-10[59985]: 2024-09-10T22:40:02.011+0000 7f3bf1a69640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.135:6812 osd.4 since back 2024-09-10T22:39:36.607732+0000 front 2024-09-10T22:39:36.607691+0000 (oldest deadline 2024-09-10T22:40:01.808227+0000) 2024-09-10T22:40:02.610 INFO:journalctl@ceph.osd.7.smithi135.stdout:Sep 10 22:40:02 smithi135 podman[70517]: 2024-09-10 22:40:02.330219156 +0000 UTC m=+0.631098412 container remove fffdc7b78edbb4f1f33adbe3f6130a8aeeb13a971723252b150fca24e6d1fab5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-7, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731) 2024-09-10T22:40:03.001 INFO:journalctl@ceph.osd.7.smithi135.stdout:Sep 10 22:40:02 smithi135 podman[70607]: 2024-09-10 22:40:02.591257008 +0000 UTC m=+0.015661618 image pull 589dd18248e494ba411dc838aa4ae0e5e569213f08fcd7a2cf22cd3ef7e3c480 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e 2024-09-10T22:40:03.001 INFO:journalctl@ceph.osd.7.smithi135.stdout:Sep 10 22:40:02 smithi135 podman[70607]: 2024-09-10 22:40:02.697723449 +0000 UTC m=+0.122128104 container create 46f4362af3d6af7d5cde64e74f74ecffc1381b2d8ad738d86e271fa195f81833 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-7-deactivate, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, ceph=True) 2024-09-10T22:40:03.001 INFO:journalctl@ceph.osd.7.smithi135.stdout:Sep 10 22:40:02 smithi135 podman[70607]: 2024-09-10 22:40:02.9168086 +0000 UTC m=+0.341213219 container init 46f4362af3d6af7d5cde64e74f74ecffc1381b2d8ad738d86e271fa195f81833 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-7-deactivate, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_BRANCH=HEAD) 2024-09-10T22:40:03.001 INFO:journalctl@ceph.osd.7.smithi135.stdout:Sep 10 22:40:02 smithi135 podman[70607]: 2024-09-10 22:40:02.920482929 +0000 UTC m=+0.344887541 container start 46f4362af3d6af7d5cde64e74f74ecffc1381b2d8ad738d86e271fa195f81833 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-7-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, ceph=True) 2024-09-10T22:40:03.001 INFO:journalctl@ceph.osd.7.smithi135.stdout:Sep 10 22:40:02 smithi135 podman[70607]: 2024-09-10 22:40:02.999794851 +0000 UTC m=+0.424199474 container attach 46f4362af3d6af7d5cde64e74f74ecffc1381b2d8ad738d86e271fa195f81833 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-7-deactivate, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_CLEAN=True, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-10T22:40:03.125 INFO:journalctl@ceph.osd.8.smithi138.stdout:Sep 10 22:40:02 smithi138 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-8[53775]: 2024-09-10T22:40:02.910+0000 7f87faf53640 -1 osd.8 80 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2024-09-10T22:39:12.989835+0000 front 2024-09-10T22:39:12.989666+0000 (oldest deadline 2024-09-10T22:39:38.889906+0000) 2024-09-10T22:40:03.125 INFO:journalctl@ceph.osd.8.smithi138.stdout:Sep 10 22:40:02 smithi138 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-8[53775]: 2024-09-10T22:40:02.910+0000 7f87faf53640 -1 osd.8 80 heartbeat_check: no reply from 172.21.15.138:6804 osd.2 since back 2024-09-10T22:39:18.890233+0000 front 2024-09-10T22:39:18.890263+0000 (oldest deadline 2024-09-10T22:39:42.990418+0000) 2024-09-10T22:40:03.125 INFO:journalctl@ceph.osd.8.smithi138.stdout:Sep 10 22:40:02 smithi138 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-8[53775]: 2024-09-10T22:40:02.910+0000 7f87faf53640 -1 osd.8 80 heartbeat_check: no reply from 172.21.15.19:6814 osd.3 since back 2024-09-10T22:39:28.891445+0000 front 2024-09-10T22:39:28.891431+0000 (oldest deadline 2024-09-10T22:39:52.991311+0000) 2024-09-10T22:40:03.125 INFO:journalctl@ceph.osd.8.smithi138.stdout:Sep 10 22:40:02 smithi138 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-8[53775]: 2024-09-10T22:40:02.910+0000 7f87faf53640 -1 osd.8 80 heartbeat_check: no reply from 172.21.15.135:6812 osd.4 since back 2024-09-10T22:39:36.992851+0000 front 2024-09-10T22:39:36.992837+0000 (oldest deadline 2024-09-10T22:39:59.292785+0000) 2024-09-10T22:40:03.126 INFO:journalctl@ceph.osd.11.smithi138.stdout:Sep 10 22:40:02 smithi138 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-11[60796]: 2024-09-10T22:40:02.739+0000 7ffb00998640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-10T22:38:51.541208+0000 front 2024-09-10T22:38:51.541072+0000 (oldest deadline 2024-09-10T22:39:25.843622+0000) 2024-09-10T22:40:03.126 INFO:journalctl@ceph.osd.11.smithi138.stdout:Sep 10 22:40:02 smithi138 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-11[60796]: 2024-09-10T22:40:02.739+0000 7ffb00998640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2024-09-10T22:39:09.245148+0000 front 2024-09-10T22:39:09.245118+0000 (oldest deadline 2024-09-10T22:39:35.046015+0000) 2024-09-10T22:40:03.126 INFO:journalctl@ceph.osd.11.smithi138.stdout:Sep 10 22:40:02 smithi138 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-11[60796]: 2024-09-10T22:40:02.739+0000 7ffb00998640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.138:6804 osd.2 since back 2024-09-10T22:39:19.647426+0000 front 2024-09-10T22:39:19.647531+0000 (oldest deadline 2024-09-10T22:39:44.947487+0000) 2024-09-10T22:40:03.126 INFO:journalctl@ceph.osd.11.smithi138.stdout:Sep 10 22:40:02 smithi138 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-11[60796]: 2024-09-10T22:40:02.739+0000 7ffb00998640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.19:6814 osd.3 since back 2024-09-10T22:39:29.048508+0000 front 2024-09-10T22:39:29.048441+0000 (oldest deadline 2024-09-10T22:39:52.548620+0000) 2024-09-10T22:40:03.126 INFO:journalctl@ceph.osd.11.smithi138.stdout:Sep 10 22:40:02 smithi138 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-11[60796]: 2024-09-10T22:40:02.739+0000 7ffb00998640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.135:6812 osd.4 since back 2024-09-10T22:39:34.249759+0000 front 2024-09-10T22:39:34.249711+0000 (oldest deadline 2024-09-10T22:39:59.450249+0000) 2024-09-10T22:40:03.208 INFO:journalctl@ceph.osd.9.smithi019.stdout:Sep 10 22:40:02 smithi019 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-9[68022]: 2024-09-10T22:40:02.866+0000 7fa3f61d4640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-10T22:38:54.917764+0000 front 2024-09-10T22:38:54.917786+0000 (oldest deadline 2024-09-10T22:39:27.019686+0000) 2024-09-10T22:40:03.209 INFO:journalctl@ceph.osd.9.smithi019.stdout:Sep 10 22:40:02 smithi019 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-9[68022]: 2024-09-10T22:40:02.866+0000 7fa3f61d4640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2024-09-10T22:39:12.821560+0000 front 2024-09-10T22:39:12.821482+0000 (oldest deadline 2024-09-10T22:39:38.121512+0000) 2024-09-10T22:40:03.209 INFO:journalctl@ceph.osd.9.smithi019.stdout:Sep 10 22:40:02 smithi019 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-9[68022]: 2024-09-10T22:40:02.866+0000 7fa3f61d4640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.138:6804 osd.2 since back 2024-09-10T22:39:18.122242+0000 front 2024-09-10T22:39:18.122082+0000 (oldest deadline 2024-09-10T22:39:44.022038+0000) 2024-09-10T22:40:03.209 INFO:journalctl@ceph.osd.9.smithi019.stdout:Sep 10 22:40:02 smithi019 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-9[68022]: 2024-09-10T22:40:02.866+0000 7fa3f61d4640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.19:6814 osd.3 since back 2024-09-10T22:39:28.623376+0000 front 2024-09-10T22:39:28.623431+0000 (oldest deadline 2024-09-10T22:39:52.723588+0000) 2024-09-10T22:40:03.360 INFO:journalctl@ceph.osd.7.smithi135.stdout:Sep 10 22:40:03 smithi135 podman[70607]: 2024-09-10 22:40:03.121024543 +0000 UTC m=+0.545429156 container died 46f4362af3d6af7d5cde64e74f74ecffc1381b2d8ad738d86e271fa195f81833 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-7-deactivate, io.buildah.version=1.37.2, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4) 2024-09-10T22:40:03.361 INFO:journalctl@ceph.osd.10.smithi135.stdout:Sep 10 22:40:03 smithi135 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-10[59985]: 2024-09-10T22:40:03.020+0000 7f3bf1a69640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-10T22:38:54.201226+0000 front 2024-09-10T22:38:54.201244+0000 (oldest deadline 2024-09-10T22:39:26.502183+0000) 2024-09-10T22:40:03.361 INFO:journalctl@ceph.osd.10.smithi135.stdout:Sep 10 22:40:03 smithi135 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-10[59985]: 2024-09-10T22:40:03.020+0000 7f3bf1a69640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2024-09-10T22:39:12.303632+0000 front 2024-09-10T22:39:12.303699+0000 (oldest deadline 2024-09-10T22:39:37.003674+0000) 2024-09-10T22:40:03.361 INFO:journalctl@ceph.osd.10.smithi135.stdout:Sep 10 22:40:03 smithi135 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-10[59985]: 2024-09-10T22:40:03.020+0000 7f3bf1a69640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.138:6804 osd.2 since back 2024-09-10T22:39:20.504425+0000 front 2024-09-10T22:39:20.504380+0000 (oldest deadline 2024-09-10T22:39:42.105008+0000) 2024-09-10T22:40:03.361 INFO:journalctl@ceph.osd.10.smithi135.stdout:Sep 10 22:40:03 smithi135 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-10[59985]: 2024-09-10T22:40:03.020+0000 7f3bf1a69640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.19:6814 osd.3 since back 2024-09-10T22:39:29.106408+0000 front 2024-09-10T22:39:29.106333+0000 (oldest deadline 2024-09-10T22:39:54.406308+0000) 2024-09-10T22:40:03.361 INFO:journalctl@ceph.osd.10.smithi135.stdout:Sep 10 22:40:03 smithi135 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-10[59985]: 2024-09-10T22:40:03.020+0000 7f3bf1a69640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.135:6812 osd.4 since back 2024-09-10T22:39:36.607732+0000 front 2024-09-10T22:39:36.607691+0000 (oldest deadline 2024-09-10T22:40:01.808227+0000) 2024-09-10T22:40:03.720 DEBUG:teuthology.orchestra.run.smithi135:> sudo pkill -f 'journalctl -f -n 0 -u ceph-22997a4c-6fc2-11ef-bcea-c7b262605968@osd.7.service' 2024-09-10T22:40:03.759 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-10T22:40:03.759 INFO:tasks.cephadm.osd.7:Stopped osd.7 2024-09-10T22:40:03.760 INFO:tasks.cephadm.osd.8:Stopping osd.8... 2024-09-10T22:40:03.760 DEBUG:teuthology.orchestra.run.smithi138:> sudo systemctl stop ceph-22997a4c-6fc2-11ef-bcea-c7b262605968@osd.8 2024-09-10T22:40:04.030 INFO:journalctl@ceph.osd.8.smithi138.stdout:Sep 10 22:40:03 smithi138 systemd[1]: Stopping Ceph osd.8 for 22997a4c-6fc2-11ef-bcea-c7b262605968... 2024-09-10T22:40:04.030 INFO:journalctl@ceph.osd.8.smithi138.stdout:Sep 10 22:40:03 smithi138 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-8[53775]: 2024-09-10T22:40:03.897+0000 7f87faf53640 -1 osd.8 80 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2024-09-10T22:39:12.989835+0000 front 2024-09-10T22:39:12.989666+0000 (oldest deadline 2024-09-10T22:39:38.889906+0000) 2024-09-10T22:40:04.030 INFO:journalctl@ceph.osd.8.smithi138.stdout:Sep 10 22:40:03 smithi138 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-8[53775]: 2024-09-10T22:40:03.897+0000 7f87faf53640 -1 osd.8 80 heartbeat_check: no reply from 172.21.15.138:6804 osd.2 since back 2024-09-10T22:39:18.890233+0000 front 2024-09-10T22:39:18.890263+0000 (oldest deadline 2024-09-10T22:39:42.990418+0000) 2024-09-10T22:40:04.031 INFO:journalctl@ceph.osd.8.smithi138.stdout:Sep 10 22:40:03 smithi138 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-8[53775]: 2024-09-10T22:40:03.897+0000 7f87faf53640 -1 osd.8 80 heartbeat_check: no reply from 172.21.15.19:6814 osd.3 since back 2024-09-10T22:39:28.891445+0000 front 2024-09-10T22:39:28.891431+0000 (oldest deadline 2024-09-10T22:39:52.991311+0000) 2024-09-10T22:40:04.031 INFO:journalctl@ceph.osd.8.smithi138.stdout:Sep 10 22:40:03 smithi138 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-8[53775]: 2024-09-10T22:40:03.897+0000 7f87faf53640 -1 osd.8 80 heartbeat_check: no reply from 172.21.15.135:6812 osd.4 since back 2024-09-10T22:39:36.992851+0000 front 2024-09-10T22:39:36.992837+0000 (oldest deadline 2024-09-10T22:39:59.292785+0000) 2024-09-10T22:40:04.031 INFO:journalctl@ceph.osd.11.smithi138.stdout:Sep 10 22:40:03 smithi138 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-11[60796]: 2024-09-10T22:40:03.762+0000 7ffb00998640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-10T22:38:51.541208+0000 front 2024-09-10T22:38:51.541072+0000 (oldest deadline 2024-09-10T22:39:25.843622+0000) 2024-09-10T22:40:04.031 INFO:journalctl@ceph.osd.11.smithi138.stdout:Sep 10 22:40:03 smithi138 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-11[60796]: 2024-09-10T22:40:03.762+0000 7ffb00998640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2024-09-10T22:39:09.245148+0000 front 2024-09-10T22:39:09.245118+0000 (oldest deadline 2024-09-10T22:39:35.046015+0000) 2024-09-10T22:40:04.031 INFO:journalctl@ceph.osd.11.smithi138.stdout:Sep 10 22:40:03 smithi138 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-11[60796]: 2024-09-10T22:40:03.762+0000 7ffb00998640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.138:6804 osd.2 since back 2024-09-10T22:39:19.647426+0000 front 2024-09-10T22:39:19.647531+0000 (oldest deadline 2024-09-10T22:39:44.947487+0000) 2024-09-10T22:40:04.031 INFO:journalctl@ceph.osd.11.smithi138.stdout:Sep 10 22:40:03 smithi138 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-11[60796]: 2024-09-10T22:40:03.762+0000 7ffb00998640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.19:6814 osd.3 since back 2024-09-10T22:39:29.048508+0000 front 2024-09-10T22:39:29.048441+0000 (oldest deadline 2024-09-10T22:39:52.548620+0000) 2024-09-10T22:40:04.031 INFO:journalctl@ceph.osd.11.smithi138.stdout:Sep 10 22:40:03 smithi138 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-11[60796]: 2024-09-10T22:40:03.762+0000 7ffb00998640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.135:6812 osd.4 since back 2024-09-10T22:39:34.249759+0000 front 2024-09-10T22:39:34.249711+0000 (oldest deadline 2024-09-10T22:39:59.450249+0000) 2024-09-10T22:40:04.209 INFO:journalctl@ceph.osd.9.smithi019.stdout:Sep 10 22:40:03 smithi019 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-9[68022]: 2024-09-10T22:40:03.890+0000 7fa3f61d4640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-10T22:38:54.917764+0000 front 2024-09-10T22:38:54.917786+0000 (oldest deadline 2024-09-10T22:39:27.019686+0000) 2024-09-10T22:40:04.209 INFO:journalctl@ceph.osd.9.smithi019.stdout:Sep 10 22:40:03 smithi019 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-9[68022]: 2024-09-10T22:40:03.890+0000 7fa3f61d4640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2024-09-10T22:39:12.821560+0000 front 2024-09-10T22:39:12.821482+0000 (oldest deadline 2024-09-10T22:39:38.121512+0000) 2024-09-10T22:40:04.209 INFO:journalctl@ceph.osd.9.smithi019.stdout:Sep 10 22:40:03 smithi019 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-9[68022]: 2024-09-10T22:40:03.890+0000 7fa3f61d4640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.138:6804 osd.2 since back 2024-09-10T22:39:18.122242+0000 front 2024-09-10T22:39:18.122082+0000 (oldest deadline 2024-09-10T22:39:44.022038+0000) 2024-09-10T22:40:04.209 INFO:journalctl@ceph.osd.9.smithi019.stdout:Sep 10 22:40:03 smithi019 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-9[68022]: 2024-09-10T22:40:03.890+0000 7fa3f61d4640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.19:6814 osd.3 since back 2024-09-10T22:39:28.623376+0000 front 2024-09-10T22:39:28.623431+0000 (oldest deadline 2024-09-10T22:39:52.723588+0000) 2024-09-10T22:40:04.343 INFO:journalctl@ceph.osd.10.smithi135.stdout:Sep 10 22:40:03 smithi135 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-10[59985]: 2024-09-10T22:40:03.983+0000 7f3bf1a69640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-10T22:38:54.201226+0000 front 2024-09-10T22:38:54.201244+0000 (oldest deadline 2024-09-10T22:39:26.502183+0000) 2024-09-10T22:40:04.343 INFO:journalctl@ceph.osd.10.smithi135.stdout:Sep 10 22:40:03 smithi135 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-10[59985]: 2024-09-10T22:40:03.983+0000 7f3bf1a69640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2024-09-10T22:39:12.303632+0000 front 2024-09-10T22:39:12.303699+0000 (oldest deadline 2024-09-10T22:39:37.003674+0000) 2024-09-10T22:40:04.344 INFO:journalctl@ceph.osd.10.smithi135.stdout:Sep 10 22:40:03 smithi135 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-10[59985]: 2024-09-10T22:40:03.983+0000 7f3bf1a69640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.138:6804 osd.2 since back 2024-09-10T22:39:20.504425+0000 front 2024-09-10T22:39:20.504380+0000 (oldest deadline 2024-09-10T22:39:42.105008+0000) 2024-09-10T22:40:04.344 INFO:journalctl@ceph.osd.10.smithi135.stdout:Sep 10 22:40:03 smithi135 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-10[59985]: 2024-09-10T22:40:03.983+0000 7f3bf1a69640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.19:6814 osd.3 since back 2024-09-10T22:39:29.106408+0000 front 2024-09-10T22:39:29.106333+0000 (oldest deadline 2024-09-10T22:39:54.406308+0000) 2024-09-10T22:40:04.344 INFO:journalctl@ceph.osd.10.smithi135.stdout:Sep 10 22:40:03 smithi135 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-10[59985]: 2024-09-10T22:40:03.983+0000 7f3bf1a69640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.135:6812 osd.4 since back 2024-09-10T22:39:36.607732+0000 front 2024-09-10T22:39:36.607691+0000 (oldest deadline 2024-09-10T22:40:01.808227+0000) 2024-09-10T22:40:04.375 INFO:journalctl@ceph.osd.8.smithi138.stdout:Sep 10 22:40:04 smithi138 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-8[53775]: 2024-09-10T22:40:04.028+0000 7f87fe93e640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.8 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-10T22:40:04.375 INFO:journalctl@ceph.osd.8.smithi138.stdout:Sep 10 22:40:04 smithi138 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-8[53775]: 2024-09-10T22:40:04.028+0000 7f87fe93e640 -1 osd.8 80 *** Got signal Terminated *** 2024-09-10T22:40:04.375 INFO:journalctl@ceph.osd.8.smithi138.stdout:Sep 10 22:40:04 smithi138 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-8[53775]: 2024-09-10T22:40:04.028+0000 7f87fe93e640 -1 osd.8 80 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-10T22:40:05.125 INFO:journalctl@ceph.osd.8.smithi138.stdout:Sep 10 22:40:04 smithi138 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-8[53775]: 2024-09-10T22:40:04.936+0000 7f87faf53640 -1 osd.8 80 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2024-09-10T22:39:12.989835+0000 front 2024-09-10T22:39:12.989666+0000 (oldest deadline 2024-09-10T22:39:38.889906+0000) 2024-09-10T22:40:05.125 INFO:journalctl@ceph.osd.8.smithi138.stdout:Sep 10 22:40:04 smithi138 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-8[53775]: 2024-09-10T22:40:04.936+0000 7f87faf53640 -1 osd.8 80 heartbeat_check: no reply from 172.21.15.138:6804 osd.2 since back 2024-09-10T22:39:18.890233+0000 front 2024-09-10T22:39:18.890263+0000 (oldest deadline 2024-09-10T22:39:42.990418+0000) 2024-09-10T22:40:05.125 INFO:journalctl@ceph.osd.8.smithi138.stdout:Sep 10 22:40:04 smithi138 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-8[53775]: 2024-09-10T22:40:04.936+0000 7f87faf53640 -1 osd.8 80 heartbeat_check: no reply from 172.21.15.19:6814 osd.3 since back 2024-09-10T22:39:28.891445+0000 front 2024-09-10T22:39:28.891431+0000 (oldest deadline 2024-09-10T22:39:52.991311+0000) 2024-09-10T22:40:05.126 INFO:journalctl@ceph.osd.8.smithi138.stdout:Sep 10 22:40:04 smithi138 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-8[53775]: 2024-09-10T22:40:04.936+0000 7f87faf53640 -1 osd.8 80 heartbeat_check: no reply from 172.21.15.135:6812 osd.4 since back 2024-09-10T22:39:36.992851+0000 front 2024-09-10T22:39:36.992837+0000 (oldest deadline 2024-09-10T22:39:59.292785+0000) 2024-09-10T22:40:05.126 INFO:journalctl@ceph.osd.11.smithi138.stdout:Sep 10 22:40:04 smithi138 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-11[60796]: 2024-09-10T22:40:04.756+0000 7ffb00998640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-10T22:38:51.541208+0000 front 2024-09-10T22:38:51.541072+0000 (oldest deadline 2024-09-10T22:39:25.843622+0000) 2024-09-10T22:40:05.126 INFO:journalctl@ceph.osd.11.smithi138.stdout:Sep 10 22:40:04 smithi138 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-11[60796]: 2024-09-10T22:40:04.756+0000 7ffb00998640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2024-09-10T22:39:09.245148+0000 front 2024-09-10T22:39:09.245118+0000 (oldest deadline 2024-09-10T22:39:35.046015+0000) 2024-09-10T22:40:05.126 INFO:journalctl@ceph.osd.11.smithi138.stdout:Sep 10 22:40:04 smithi138 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-11[60796]: 2024-09-10T22:40:04.756+0000 7ffb00998640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.138:6804 osd.2 since back 2024-09-10T22:39:19.647426+0000 front 2024-09-10T22:39:19.647531+0000 (oldest deadline 2024-09-10T22:39:44.947487+0000) 2024-09-10T22:40:05.126 INFO:journalctl@ceph.osd.11.smithi138.stdout:Sep 10 22:40:04 smithi138 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-11[60796]: 2024-09-10T22:40:04.756+0000 7ffb00998640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.19:6814 osd.3 since back 2024-09-10T22:39:29.048508+0000 front 2024-09-10T22:39:29.048441+0000 (oldest deadline 2024-09-10T22:39:52.548620+0000) 2024-09-10T22:40:05.126 INFO:journalctl@ceph.osd.11.smithi138.stdout:Sep 10 22:40:04 smithi138 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-11[60796]: 2024-09-10T22:40:04.756+0000 7ffb00998640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.135:6812 osd.4 since back 2024-09-10T22:39:34.249759+0000 front 2024-09-10T22:39:34.249711+0000 (oldest deadline 2024-09-10T22:39:59.450249+0000) 2024-09-10T22:40:05.208 INFO:journalctl@ceph.osd.9.smithi019.stdout:Sep 10 22:40:04 smithi019 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-9[68022]: 2024-09-10T22:40:04.900+0000 7fa3f61d4640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-10T22:38:54.917764+0000 front 2024-09-10T22:38:54.917786+0000 (oldest deadline 2024-09-10T22:39:27.019686+0000) 2024-09-10T22:40:05.209 INFO:journalctl@ceph.osd.9.smithi019.stdout:Sep 10 22:40:04 smithi019 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-9[68022]: 2024-09-10T22:40:04.900+0000 7fa3f61d4640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2024-09-10T22:39:12.821560+0000 front 2024-09-10T22:39:12.821482+0000 (oldest deadline 2024-09-10T22:39:38.121512+0000) 2024-09-10T22:40:05.209 INFO:journalctl@ceph.osd.9.smithi019.stdout:Sep 10 22:40:04 smithi019 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-9[68022]: 2024-09-10T22:40:04.900+0000 7fa3f61d4640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.138:6804 osd.2 since back 2024-09-10T22:39:18.122242+0000 front 2024-09-10T22:39:18.122082+0000 (oldest deadline 2024-09-10T22:39:44.022038+0000) 2024-09-10T22:40:05.209 INFO:journalctl@ceph.osd.9.smithi019.stdout:Sep 10 22:40:04 smithi019 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-9[68022]: 2024-09-10T22:40:04.900+0000 7fa3f61d4640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.19:6814 osd.3 since back 2024-09-10T22:39:28.623376+0000 front 2024-09-10T22:39:28.623431+0000 (oldest deadline 2024-09-10T22:39:52.723588+0000) 2024-09-10T22:40:05.360 INFO:journalctl@ceph.osd.10.smithi135.stdout:Sep 10 22:40:04 smithi135 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-10[59985]: 2024-09-10T22:40:04.975+0000 7f3bf1a69640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-10T22:38:54.201226+0000 front 2024-09-10T22:38:54.201244+0000 (oldest deadline 2024-09-10T22:39:26.502183+0000) 2024-09-10T22:40:05.360 INFO:journalctl@ceph.osd.10.smithi135.stdout:Sep 10 22:40:04 smithi135 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-10[59985]: 2024-09-10T22:40:04.975+0000 7f3bf1a69640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2024-09-10T22:39:12.303632+0000 front 2024-09-10T22:39:12.303699+0000 (oldest deadline 2024-09-10T22:39:37.003674+0000) 2024-09-10T22:40:05.360 INFO:journalctl@ceph.osd.10.smithi135.stdout:Sep 10 22:40:04 smithi135 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-10[59985]: 2024-09-10T22:40:04.975+0000 7f3bf1a69640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.138:6804 osd.2 since back 2024-09-10T22:39:20.504425+0000 front 2024-09-10T22:39:20.504380+0000 (oldest deadline 2024-09-10T22:39:42.105008+0000) 2024-09-10T22:40:05.360 INFO:journalctl@ceph.osd.10.smithi135.stdout:Sep 10 22:40:04 smithi135 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-10[59985]: 2024-09-10T22:40:04.975+0000 7f3bf1a69640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.19:6814 osd.3 since back 2024-09-10T22:39:29.106408+0000 front 2024-09-10T22:39:29.106333+0000 (oldest deadline 2024-09-10T22:39:54.406308+0000) 2024-09-10T22:40:05.360 INFO:journalctl@ceph.osd.10.smithi135.stdout:Sep 10 22:40:04 smithi135 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-10[59985]: 2024-09-10T22:40:04.975+0000 7f3bf1a69640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.135:6812 osd.4 since back 2024-09-10T22:39:36.607732+0000 front 2024-09-10T22:39:36.607691+0000 (oldest deadline 2024-09-10T22:40:01.808227+0000) 2024-09-10T22:40:06.125 INFO:journalctl@ceph.osd.11.smithi138.stdout:Sep 10 22:40:05 smithi138 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-11[60796]: 2024-09-10T22:40:05.763+0000 7ffb00998640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-10T22:38:51.541208+0000 front 2024-09-10T22:38:51.541072+0000 (oldest deadline 2024-09-10T22:39:25.843622+0000) 2024-09-10T22:40:06.125 INFO:journalctl@ceph.osd.11.smithi138.stdout:Sep 10 22:40:05 smithi138 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-11[60796]: 2024-09-10T22:40:05.763+0000 7ffb00998640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2024-09-10T22:39:09.245148+0000 front 2024-09-10T22:39:09.245118+0000 (oldest deadline 2024-09-10T22:39:35.046015+0000) 2024-09-10T22:40:06.125 INFO:journalctl@ceph.osd.11.smithi138.stdout:Sep 10 22:40:05 smithi138 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-11[60796]: 2024-09-10T22:40:05.763+0000 7ffb00998640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.138:6804 osd.2 since back 2024-09-10T22:39:19.647426+0000 front 2024-09-10T22:39:19.647531+0000 (oldest deadline 2024-09-10T22:39:44.947487+0000) 2024-09-10T22:40:06.125 INFO:journalctl@ceph.osd.11.smithi138.stdout:Sep 10 22:40:05 smithi138 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-11[60796]: 2024-09-10T22:40:05.763+0000 7ffb00998640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.19:6814 osd.3 since back 2024-09-10T22:39:29.048508+0000 front 2024-09-10T22:39:29.048441+0000 (oldest deadline 2024-09-10T22:39:52.548620+0000) 2024-09-10T22:40:06.125 INFO:journalctl@ceph.osd.11.smithi138.stdout:Sep 10 22:40:05 smithi138 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-11[60796]: 2024-09-10T22:40:05.763+0000 7ffb00998640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.135:6812 osd.4 since back 2024-09-10T22:39:34.249759+0000 front 2024-09-10T22:39:34.249711+0000 (oldest deadline 2024-09-10T22:39:59.450249+0000) 2024-09-10T22:40:06.126 INFO:journalctl@ceph.osd.8.smithi138.stdout:Sep 10 22:40:05 smithi138 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-8[53775]: 2024-09-10T22:40:05.912+0000 7f87faf53640 -1 osd.8 80 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2024-09-10T22:39:12.989835+0000 front 2024-09-10T22:39:12.989666+0000 (oldest deadline 2024-09-10T22:39:38.889906+0000) 2024-09-10T22:40:06.126 INFO:journalctl@ceph.osd.8.smithi138.stdout:Sep 10 22:40:05 smithi138 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-8[53775]: 2024-09-10T22:40:05.912+0000 7f87faf53640 -1 osd.8 80 heartbeat_check: no reply from 172.21.15.138:6804 osd.2 since back 2024-09-10T22:39:18.890233+0000 front 2024-09-10T22:39:18.890263+0000 (oldest deadline 2024-09-10T22:39:42.990418+0000) 2024-09-10T22:40:06.126 INFO:journalctl@ceph.osd.8.smithi138.stdout:Sep 10 22:40:05 smithi138 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-8[53775]: 2024-09-10T22:40:05.912+0000 7f87faf53640 -1 osd.8 80 heartbeat_check: no reply from 172.21.15.19:6814 osd.3 since back 2024-09-10T22:39:28.891445+0000 front 2024-09-10T22:39:28.891431+0000 (oldest deadline 2024-09-10T22:39:52.991311+0000) 2024-09-10T22:40:06.126 INFO:journalctl@ceph.osd.8.smithi138.stdout:Sep 10 22:40:05 smithi138 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-8[53775]: 2024-09-10T22:40:05.912+0000 7f87faf53640 -1 osd.8 80 heartbeat_check: no reply from 172.21.15.135:6812 osd.4 since back 2024-09-10T22:39:36.992851+0000 front 2024-09-10T22:39:36.992837+0000 (oldest deadline 2024-09-10T22:39:59.292785+0000) 2024-09-10T22:40:06.208 INFO:journalctl@ceph.osd.9.smithi019.stdout:Sep 10 22:40:05 smithi019 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-9[68022]: 2024-09-10T22:40:05.885+0000 7fa3f61d4640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-10T22:38:54.917764+0000 front 2024-09-10T22:38:54.917786+0000 (oldest deadline 2024-09-10T22:39:27.019686+0000) 2024-09-10T22:40:06.208 INFO:journalctl@ceph.osd.9.smithi019.stdout:Sep 10 22:40:05 smithi019 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-9[68022]: 2024-09-10T22:40:05.885+0000 7fa3f61d4640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2024-09-10T22:39:12.821560+0000 front 2024-09-10T22:39:12.821482+0000 (oldest deadline 2024-09-10T22:39:38.121512+0000) 2024-09-10T22:40:06.209 INFO:journalctl@ceph.osd.9.smithi019.stdout:Sep 10 22:40:05 smithi019 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-9[68022]: 2024-09-10T22:40:05.885+0000 7fa3f61d4640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.138:6804 osd.2 since back 2024-09-10T22:39:18.122242+0000 front 2024-09-10T22:39:18.122082+0000 (oldest deadline 2024-09-10T22:39:44.022038+0000) 2024-09-10T22:40:06.209 INFO:journalctl@ceph.osd.9.smithi019.stdout:Sep 10 22:40:05 smithi019 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-9[68022]: 2024-09-10T22:40:05.885+0000 7fa3f61d4640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.19:6814 osd.3 since back 2024-09-10T22:39:28.623376+0000 front 2024-09-10T22:39:28.623431+0000 (oldest deadline 2024-09-10T22:39:52.723588+0000) 2024-09-10T22:40:06.360 INFO:journalctl@ceph.osd.10.smithi135.stdout:Sep 10 22:40:05 smithi135 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-10[59985]: 2024-09-10T22:40:05.998+0000 7f3bf1a69640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-10T22:38:54.201226+0000 front 2024-09-10T22:38:54.201244+0000 (oldest deadline 2024-09-10T22:39:26.502183+0000) 2024-09-10T22:40:06.360 INFO:journalctl@ceph.osd.10.smithi135.stdout:Sep 10 22:40:05 smithi135 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-10[59985]: 2024-09-10T22:40:05.998+0000 7f3bf1a69640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2024-09-10T22:39:12.303632+0000 front 2024-09-10T22:39:12.303699+0000 (oldest deadline 2024-09-10T22:39:37.003674+0000) 2024-09-10T22:40:06.360 INFO:journalctl@ceph.osd.10.smithi135.stdout:Sep 10 22:40:05 smithi135 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-10[59985]: 2024-09-10T22:40:05.998+0000 7f3bf1a69640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.138:6804 osd.2 since back 2024-09-10T22:39:20.504425+0000 front 2024-09-10T22:39:20.504380+0000 (oldest deadline 2024-09-10T22:39:42.105008+0000) 2024-09-10T22:40:06.361 INFO:journalctl@ceph.osd.10.smithi135.stdout:Sep 10 22:40:05 smithi135 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-10[59985]: 2024-09-10T22:40:05.998+0000 7f3bf1a69640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.19:6814 osd.3 since back 2024-09-10T22:39:29.106408+0000 front 2024-09-10T22:39:29.106333+0000 (oldest deadline 2024-09-10T22:39:54.406308+0000) 2024-09-10T22:40:06.361 INFO:journalctl@ceph.osd.10.smithi135.stdout:Sep 10 22:40:05 smithi135 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-10[59985]: 2024-09-10T22:40:05.998+0000 7f3bf1a69640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.135:6812 osd.4 since back 2024-09-10T22:39:36.607732+0000 front 2024-09-10T22:39:36.607691+0000 (oldest deadline 2024-09-10T22:40:01.808227+0000) 2024-09-10T22:40:07.125 INFO:journalctl@ceph.osd.8.smithi138.stdout:Sep 10 22:40:06 smithi138 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-8[53775]: 2024-09-10T22:40:06.931+0000 7f87faf53640 -1 osd.8 80 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2024-09-10T22:39:12.989835+0000 front 2024-09-10T22:39:12.989666+0000 (oldest deadline 2024-09-10T22:39:38.889906+0000) 2024-09-10T22:40:07.125 INFO:journalctl@ceph.osd.8.smithi138.stdout:Sep 10 22:40:06 smithi138 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-8[53775]: 2024-09-10T22:40:06.931+0000 7f87faf53640 -1 osd.8 80 heartbeat_check: no reply from 172.21.15.138:6804 osd.2 since back 2024-09-10T22:39:18.890233+0000 front 2024-09-10T22:39:18.890263+0000 (oldest deadline 2024-09-10T22:39:42.990418+0000) 2024-09-10T22:40:07.125 INFO:journalctl@ceph.osd.8.smithi138.stdout:Sep 10 22:40:06 smithi138 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-8[53775]: 2024-09-10T22:40:06.931+0000 7f87faf53640 -1 osd.8 80 heartbeat_check: no reply from 172.21.15.19:6814 osd.3 since back 2024-09-10T22:39:28.891445+0000 front 2024-09-10T22:39:28.891431+0000 (oldest deadline 2024-09-10T22:39:52.991311+0000) 2024-09-10T22:40:07.125 INFO:journalctl@ceph.osd.8.smithi138.stdout:Sep 10 22:40:06 smithi138 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-8[53775]: 2024-09-10T22:40:06.931+0000 7f87faf53640 -1 osd.8 80 heartbeat_check: no reply from 172.21.15.135:6812 osd.4 since back 2024-09-10T22:39:36.992851+0000 front 2024-09-10T22:39:36.992837+0000 (oldest deadline 2024-09-10T22:39:59.292785+0000) 2024-09-10T22:40:07.126 INFO:journalctl@ceph.osd.11.smithi138.stdout:Sep 10 22:40:06 smithi138 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-11[60796]: 2024-09-10T22:40:06.759+0000 7ffb00998640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-10T22:38:51.541208+0000 front 2024-09-10T22:38:51.541072+0000 (oldest deadline 2024-09-10T22:39:25.843622+0000) 2024-09-10T22:40:07.126 INFO:journalctl@ceph.osd.11.smithi138.stdout:Sep 10 22:40:06 smithi138 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-11[60796]: 2024-09-10T22:40:06.759+0000 7ffb00998640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2024-09-10T22:39:09.245148+0000 front 2024-09-10T22:39:09.245118+0000 (oldest deadline 2024-09-10T22:39:35.046015+0000) 2024-09-10T22:40:07.126 INFO:journalctl@ceph.osd.11.smithi138.stdout:Sep 10 22:40:06 smithi138 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-11[60796]: 2024-09-10T22:40:06.759+0000 7ffb00998640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.138:6804 osd.2 since back 2024-09-10T22:39:19.647426+0000 front 2024-09-10T22:39:19.647531+0000 (oldest deadline 2024-09-10T22:39:44.947487+0000) 2024-09-10T22:40:07.126 INFO:journalctl@ceph.osd.11.smithi138.stdout:Sep 10 22:40:06 smithi138 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-11[60796]: 2024-09-10T22:40:06.759+0000 7ffb00998640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.19:6814 osd.3 since back 2024-09-10T22:39:29.048508+0000 front 2024-09-10T22:39:29.048441+0000 (oldest deadline 2024-09-10T22:39:52.548620+0000) 2024-09-10T22:40:07.126 INFO:journalctl@ceph.osd.11.smithi138.stdout:Sep 10 22:40:06 smithi138 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-11[60796]: 2024-09-10T22:40:06.759+0000 7ffb00998640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.135:6812 osd.4 since back 2024-09-10T22:39:34.249759+0000 front 2024-09-10T22:39:34.249711+0000 (oldest deadline 2024-09-10T22:39:59.450249+0000) 2024-09-10T22:40:07.208 INFO:journalctl@ceph.osd.9.smithi019.stdout:Sep 10 22:40:06 smithi019 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-9[68022]: 2024-09-10T22:40:06.895+0000 7fa3f61d4640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-10T22:38:54.917764+0000 front 2024-09-10T22:38:54.917786+0000 (oldest deadline 2024-09-10T22:39:27.019686+0000) 2024-09-10T22:40:07.209 INFO:journalctl@ceph.osd.9.smithi019.stdout:Sep 10 22:40:06 smithi019 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-9[68022]: 2024-09-10T22:40:06.895+0000 7fa3f61d4640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2024-09-10T22:39:12.821560+0000 front 2024-09-10T22:39:12.821482+0000 (oldest deadline 2024-09-10T22:39:38.121512+0000) 2024-09-10T22:40:07.209 INFO:journalctl@ceph.osd.9.smithi019.stdout:Sep 10 22:40:06 smithi019 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-9[68022]: 2024-09-10T22:40:06.895+0000 7fa3f61d4640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.138:6804 osd.2 since back 2024-09-10T22:39:18.122242+0000 front 2024-09-10T22:39:18.122082+0000 (oldest deadline 2024-09-10T22:39:44.022038+0000) 2024-09-10T22:40:07.209 INFO:journalctl@ceph.osd.9.smithi019.stdout:Sep 10 22:40:06 smithi019 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-9[68022]: 2024-09-10T22:40:06.895+0000 7fa3f61d4640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.19:6814 osd.3 since back 2024-09-10T22:39:28.623376+0000 front 2024-09-10T22:39:28.623431+0000 (oldest deadline 2024-09-10T22:39:52.723588+0000) 2024-09-10T22:40:07.360 INFO:journalctl@ceph.osd.10.smithi135.stdout:Sep 10 22:40:07 smithi135 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-10[59985]: 2024-09-10T22:40:07.003+0000 7f3bf1a69640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-10T22:38:54.201226+0000 front 2024-09-10T22:38:54.201244+0000 (oldest deadline 2024-09-10T22:39:26.502183+0000) 2024-09-10T22:40:07.360 INFO:journalctl@ceph.osd.10.smithi135.stdout:Sep 10 22:40:07 smithi135 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-10[59985]: 2024-09-10T22:40:07.003+0000 7f3bf1a69640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2024-09-10T22:39:12.303632+0000 front 2024-09-10T22:39:12.303699+0000 (oldest deadline 2024-09-10T22:39:37.003674+0000) 2024-09-10T22:40:07.360 INFO:journalctl@ceph.osd.10.smithi135.stdout:Sep 10 22:40:07 smithi135 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-10[59985]: 2024-09-10T22:40:07.003+0000 7f3bf1a69640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.138:6804 osd.2 since back 2024-09-10T22:39:20.504425+0000 front 2024-09-10T22:39:20.504380+0000 (oldest deadline 2024-09-10T22:39:42.105008+0000) 2024-09-10T22:40:07.360 INFO:journalctl@ceph.osd.10.smithi135.stdout:Sep 10 22:40:07 smithi135 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-10[59985]: 2024-09-10T22:40:07.003+0000 7f3bf1a69640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.19:6814 osd.3 since back 2024-09-10T22:39:29.106408+0000 front 2024-09-10T22:39:29.106333+0000 (oldest deadline 2024-09-10T22:39:54.406308+0000) 2024-09-10T22:40:07.360 INFO:journalctl@ceph.osd.10.smithi135.stdout:Sep 10 22:40:07 smithi135 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-10[59985]: 2024-09-10T22:40:07.003+0000 7f3bf1a69640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.135:6812 osd.4 since back 2024-09-10T22:39:36.607732+0000 front 2024-09-10T22:39:36.607691+0000 (oldest deadline 2024-09-10T22:40:01.808227+0000) 2024-09-10T22:40:08.125 INFO:journalctl@ceph.osd.8.smithi138.stdout:Sep 10 22:40:07 smithi138 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-8[53775]: 2024-09-10T22:40:07.887+0000 7f87faf53640 -1 osd.8 80 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2024-09-10T22:39:12.989835+0000 front 2024-09-10T22:39:12.989666+0000 (oldest deadline 2024-09-10T22:39:38.889906+0000) 2024-09-10T22:40:08.126 INFO:journalctl@ceph.osd.8.smithi138.stdout:Sep 10 22:40:07 smithi138 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-8[53775]: 2024-09-10T22:40:07.887+0000 7f87faf53640 -1 osd.8 80 heartbeat_check: no reply from 172.21.15.138:6804 osd.2 since back 2024-09-10T22:39:18.890233+0000 front 2024-09-10T22:39:18.890263+0000 (oldest deadline 2024-09-10T22:39:42.990418+0000) 2024-09-10T22:40:08.126 INFO:journalctl@ceph.osd.8.smithi138.stdout:Sep 10 22:40:07 smithi138 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-8[53775]: 2024-09-10T22:40:07.887+0000 7f87faf53640 -1 osd.8 80 heartbeat_check: no reply from 172.21.15.19:6814 osd.3 since back 2024-09-10T22:39:28.891445+0000 front 2024-09-10T22:39:28.891431+0000 (oldest deadline 2024-09-10T22:39:52.991311+0000) 2024-09-10T22:40:08.126 INFO:journalctl@ceph.osd.8.smithi138.stdout:Sep 10 22:40:07 smithi138 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-8[53775]: 2024-09-10T22:40:07.887+0000 7f87faf53640 -1 osd.8 80 heartbeat_check: no reply from 172.21.15.135:6812 osd.4 since back 2024-09-10T22:39:36.992851+0000 front 2024-09-10T22:39:36.992837+0000 (oldest deadline 2024-09-10T22:39:59.292785+0000) 2024-09-10T22:40:08.126 INFO:journalctl@ceph.osd.11.smithi138.stdout:Sep 10 22:40:07 smithi138 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-11[60796]: 2024-09-10T22:40:07.732+0000 7ffb00998640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-10T22:38:51.541208+0000 front 2024-09-10T22:38:51.541072+0000 (oldest deadline 2024-09-10T22:39:25.843622+0000) 2024-09-10T22:40:08.126 INFO:journalctl@ceph.osd.11.smithi138.stdout:Sep 10 22:40:07 smithi138 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-11[60796]: 2024-09-10T22:40:07.732+0000 7ffb00998640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2024-09-10T22:39:09.245148+0000 front 2024-09-10T22:39:09.245118+0000 (oldest deadline 2024-09-10T22:39:35.046015+0000) 2024-09-10T22:40:08.126 INFO:journalctl@ceph.osd.11.smithi138.stdout:Sep 10 22:40:07 smithi138 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-11[60796]: 2024-09-10T22:40:07.732+0000 7ffb00998640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.138:6804 osd.2 since back 2024-09-10T22:39:19.647426+0000 front 2024-09-10T22:39:19.647531+0000 (oldest deadline 2024-09-10T22:39:44.947487+0000) 2024-09-10T22:40:08.126 INFO:journalctl@ceph.osd.11.smithi138.stdout:Sep 10 22:40:07 smithi138 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-11[60796]: 2024-09-10T22:40:07.732+0000 7ffb00998640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.19:6814 osd.3 since back 2024-09-10T22:39:29.048508+0000 front 2024-09-10T22:39:29.048441+0000 (oldest deadline 2024-09-10T22:39:52.548620+0000) 2024-09-10T22:40:08.126 INFO:journalctl@ceph.osd.11.smithi138.stdout:Sep 10 22:40:07 smithi138 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-11[60796]: 2024-09-10T22:40:07.732+0000 7ffb00998640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.135:6812 osd.4 since back 2024-09-10T22:39:34.249759+0000 front 2024-09-10T22:39:34.249711+0000 (oldest deadline 2024-09-10T22:39:59.450249+0000) 2024-09-10T22:40:08.126 INFO:journalctl@ceph.osd.11.smithi138.stdout:Sep 10 22:40:07 smithi138 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-11[60796]: 2024-09-10T22:40:07.732+0000 7ffb00998640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.138:6812 osd.5 since back 2024-09-10T22:39:42.951295+0000 front 2024-09-10T22:39:42.951215+0000 (oldest deadline 2024-09-10T22:40:07.651229+0000) 2024-09-10T22:40:08.208 INFO:journalctl@ceph.osd.9.smithi019.stdout:Sep 10 22:40:07 smithi019 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-9[68022]: 2024-09-10T22:40:07.849+0000 7fa3f61d4640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-10T22:38:54.917764+0000 front 2024-09-10T22:38:54.917786+0000 (oldest deadline 2024-09-10T22:39:27.019686+0000) 2024-09-10T22:40:08.208 INFO:journalctl@ceph.osd.9.smithi019.stdout:Sep 10 22:40:07 smithi019 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-9[68022]: 2024-09-10T22:40:07.849+0000 7fa3f61d4640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2024-09-10T22:39:12.821560+0000 front 2024-09-10T22:39:12.821482+0000 (oldest deadline 2024-09-10T22:39:38.121512+0000) 2024-09-10T22:40:08.209 INFO:journalctl@ceph.osd.9.smithi019.stdout:Sep 10 22:40:07 smithi019 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-9[68022]: 2024-09-10T22:40:07.849+0000 7fa3f61d4640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.138:6804 osd.2 since back 2024-09-10T22:39:18.122242+0000 front 2024-09-10T22:39:18.122082+0000 (oldest deadline 2024-09-10T22:39:44.022038+0000) 2024-09-10T22:40:08.209 INFO:journalctl@ceph.osd.9.smithi019.stdout:Sep 10 22:40:07 smithi019 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-9[68022]: 2024-09-10T22:40:07.849+0000 7fa3f61d4640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.19:6814 osd.3 since back 2024-09-10T22:39:28.623376+0000 front 2024-09-10T22:39:28.623431+0000 (oldest deadline 2024-09-10T22:39:52.723588+0000) 2024-09-10T22:40:08.261 INFO:journalctl@ceph.osd.10.smithi135.stdout:Sep 10 22:40:07 smithi135 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-10[59985]: 2024-09-10T22:40:07.975+0000 7f3bf1a69640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-10T22:38:54.201226+0000 front 2024-09-10T22:38:54.201244+0000 (oldest deadline 2024-09-10T22:39:26.502183+0000) 2024-09-10T22:40:08.261 INFO:journalctl@ceph.osd.10.smithi135.stdout:Sep 10 22:40:07 smithi135 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-10[59985]: 2024-09-10T22:40:07.975+0000 7f3bf1a69640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2024-09-10T22:39:12.303632+0000 front 2024-09-10T22:39:12.303699+0000 (oldest deadline 2024-09-10T22:39:37.003674+0000) 2024-09-10T22:40:08.261 INFO:journalctl@ceph.osd.10.smithi135.stdout:Sep 10 22:40:07 smithi135 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-10[59985]: 2024-09-10T22:40:07.975+0000 7f3bf1a69640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.138:6804 osd.2 since back 2024-09-10T22:39:20.504425+0000 front 2024-09-10T22:39:20.504380+0000 (oldest deadline 2024-09-10T22:39:42.105008+0000) 2024-09-10T22:40:08.262 INFO:journalctl@ceph.osd.10.smithi135.stdout:Sep 10 22:40:07 smithi135 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-10[59985]: 2024-09-10T22:40:07.975+0000 7f3bf1a69640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.19:6814 osd.3 since back 2024-09-10T22:39:29.106408+0000 front 2024-09-10T22:39:29.106333+0000 (oldest deadline 2024-09-10T22:39:54.406308+0000) 2024-09-10T22:40:08.262 INFO:journalctl@ceph.osd.10.smithi135.stdout:Sep 10 22:40:07 smithi135 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-10[59985]: 2024-09-10T22:40:07.975+0000 7f3bf1a69640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.135:6812 osd.4 since back 2024-09-10T22:39:36.607732+0000 front 2024-09-10T22:39:36.607691+0000 (oldest deadline 2024-09-10T22:40:01.808227+0000) 2024-09-10T22:40:08.262 INFO:journalctl@ceph.osd.10.smithi135.stdout:Sep 10 22:40:07 smithi135 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-10[59985]: 2024-09-10T22:40:07.975+0000 7f3bf1a69640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.138:6812 osd.5 since back 2024-09-10T22:39:41.808681+0000 front 2024-09-10T22:39:41.808720+0000 (oldest deadline 2024-09-10T22:40:07.708751+0000) 2024-09-10T22:40:09.125 INFO:journalctl@ceph.osd.8.smithi138.stdout:Sep 10 22:40:08 smithi138 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-8[53775]: 2024-09-10T22:40:08.871+0000 7f87faf53640 -1 osd.8 80 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2024-09-10T22:39:12.989835+0000 front 2024-09-10T22:39:12.989666+0000 (oldest deadline 2024-09-10T22:39:38.889906+0000) 2024-09-10T22:40:09.125 INFO:journalctl@ceph.osd.8.smithi138.stdout:Sep 10 22:40:08 smithi138 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-8[53775]: 2024-09-10T22:40:08.871+0000 7f87faf53640 -1 osd.8 80 heartbeat_check: no reply from 172.21.15.138:6804 osd.2 since back 2024-09-10T22:39:18.890233+0000 front 2024-09-10T22:39:18.890263+0000 (oldest deadline 2024-09-10T22:39:42.990418+0000) 2024-09-10T22:40:09.126 INFO:journalctl@ceph.osd.8.smithi138.stdout:Sep 10 22:40:08 smithi138 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-8[53775]: 2024-09-10T22:40:08.871+0000 7f87faf53640 -1 osd.8 80 heartbeat_check: no reply from 172.21.15.19:6814 osd.3 since back 2024-09-10T22:39:28.891445+0000 front 2024-09-10T22:39:28.891431+0000 (oldest deadline 2024-09-10T22:39:52.991311+0000) 2024-09-10T22:40:09.126 INFO:journalctl@ceph.osd.8.smithi138.stdout:Sep 10 22:40:08 smithi138 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-8[53775]: 2024-09-10T22:40:08.871+0000 7f87faf53640 -1 osd.8 80 heartbeat_check: no reply from 172.21.15.135:6812 osd.4 since back 2024-09-10T22:39:36.992851+0000 front 2024-09-10T22:39:36.992837+0000 (oldest deadline 2024-09-10T22:39:59.292785+0000) 2024-09-10T22:40:09.126 INFO:journalctl@ceph.osd.11.smithi138.stdout:Sep 10 22:40:08 smithi138 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-11[60796]: 2024-09-10T22:40:08.686+0000 7ffb00998640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-10T22:38:51.541208+0000 front 2024-09-10T22:38:51.541072+0000 (oldest deadline 2024-09-10T22:39:25.843622+0000) 2024-09-10T22:40:09.126 INFO:journalctl@ceph.osd.11.smithi138.stdout:Sep 10 22:40:08 smithi138 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-11[60796]: 2024-09-10T22:40:08.686+0000 7ffb00998640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2024-09-10T22:39:09.245148+0000 front 2024-09-10T22:39:09.245118+0000 (oldest deadline 2024-09-10T22:39:35.046015+0000) 2024-09-10T22:40:09.126 INFO:journalctl@ceph.osd.11.smithi138.stdout:Sep 10 22:40:08 smithi138 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-11[60796]: 2024-09-10T22:40:08.686+0000 7ffb00998640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.138:6804 osd.2 since back 2024-09-10T22:39:19.647426+0000 front 2024-09-10T22:39:19.647531+0000 (oldest deadline 2024-09-10T22:39:44.947487+0000) 2024-09-10T22:40:09.126 INFO:journalctl@ceph.osd.11.smithi138.stdout:Sep 10 22:40:08 smithi138 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-11[60796]: 2024-09-10T22:40:08.686+0000 7ffb00998640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.19:6814 osd.3 since back 2024-09-10T22:39:29.048508+0000 front 2024-09-10T22:39:29.048441+0000 (oldest deadline 2024-09-10T22:39:52.548620+0000) 2024-09-10T22:40:09.126 INFO:journalctl@ceph.osd.11.smithi138.stdout:Sep 10 22:40:08 smithi138 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-11[60796]: 2024-09-10T22:40:08.686+0000 7ffb00998640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.135:6812 osd.4 since back 2024-09-10T22:39:34.249759+0000 front 2024-09-10T22:39:34.249711+0000 (oldest deadline 2024-09-10T22:39:59.450249+0000) 2024-09-10T22:40:09.126 INFO:journalctl@ceph.osd.11.smithi138.stdout:Sep 10 22:40:08 smithi138 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-11[60796]: 2024-09-10T22:40:08.686+0000 7ffb00998640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.138:6812 osd.5 since back 2024-09-10T22:39:42.951295+0000 front 2024-09-10T22:39:42.951215+0000 (oldest deadline 2024-09-10T22:40:07.651229+0000) 2024-09-10T22:40:09.208 INFO:journalctl@ceph.osd.9.smithi019.stdout:Sep 10 22:40:08 smithi019 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-9[68022]: 2024-09-10T22:40:08.826+0000 7fa3f61d4640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-10T22:38:54.917764+0000 front 2024-09-10T22:38:54.917786+0000 (oldest deadline 2024-09-10T22:39:27.019686+0000) 2024-09-10T22:40:09.209 INFO:journalctl@ceph.osd.9.smithi019.stdout:Sep 10 22:40:08 smithi019 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-9[68022]: 2024-09-10T22:40:08.826+0000 7fa3f61d4640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2024-09-10T22:39:12.821560+0000 front 2024-09-10T22:39:12.821482+0000 (oldest deadline 2024-09-10T22:39:38.121512+0000) 2024-09-10T22:40:09.209 INFO:journalctl@ceph.osd.9.smithi019.stdout:Sep 10 22:40:08 smithi019 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-9[68022]: 2024-09-10T22:40:08.826+0000 7fa3f61d4640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.138:6804 osd.2 since back 2024-09-10T22:39:18.122242+0000 front 2024-09-10T22:39:18.122082+0000 (oldest deadline 2024-09-10T22:39:44.022038+0000) 2024-09-10T22:40:09.209 INFO:journalctl@ceph.osd.9.smithi019.stdout:Sep 10 22:40:08 smithi019 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-9[68022]: 2024-09-10T22:40:08.826+0000 7fa3f61d4640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.19:6814 osd.3 since back 2024-09-10T22:39:28.623376+0000 front 2024-09-10T22:39:28.623431+0000 (oldest deadline 2024-09-10T22:39:52.723588+0000) 2024-09-10T22:40:09.209 INFO:journalctl@ceph.osd.9.smithi019.stdout:Sep 10 22:40:08 smithi019 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-9[68022]: 2024-09-10T22:40:08.826+0000 7fa3f61d4640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.138:6812 osd.5 since back 2024-09-10T22:39:43.225676+0000 front 2024-09-10T22:39:43.225724+0000 (oldest deadline 2024-09-10T22:40:08.525428+0000) 2024-09-10T22:40:09.360 INFO:journalctl@ceph.osd.10.smithi135.stdout:Sep 10 22:40:08 smithi135 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-10[59985]: 2024-09-10T22:40:08.985+0000 7f3bf1a69640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-10T22:38:54.201226+0000 front 2024-09-10T22:38:54.201244+0000 (oldest deadline 2024-09-10T22:39:26.502183+0000) 2024-09-10T22:40:09.360 INFO:journalctl@ceph.osd.10.smithi135.stdout:Sep 10 22:40:08 smithi135 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-10[59985]: 2024-09-10T22:40:08.985+0000 7f3bf1a69640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2024-09-10T22:39:12.303632+0000 front 2024-09-10T22:39:12.303699+0000 (oldest deadline 2024-09-10T22:39:37.003674+0000) 2024-09-10T22:40:09.360 INFO:journalctl@ceph.osd.10.smithi135.stdout:Sep 10 22:40:08 smithi135 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-10[59985]: 2024-09-10T22:40:08.985+0000 7f3bf1a69640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.138:6804 osd.2 since back 2024-09-10T22:39:20.504425+0000 front 2024-09-10T22:39:20.504380+0000 (oldest deadline 2024-09-10T22:39:42.105008+0000) 2024-09-10T22:40:09.360 INFO:journalctl@ceph.osd.10.smithi135.stdout:Sep 10 22:40:08 smithi135 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-10[59985]: 2024-09-10T22:40:08.985+0000 7f3bf1a69640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.19:6814 osd.3 since back 2024-09-10T22:39:29.106408+0000 front 2024-09-10T22:39:29.106333+0000 (oldest deadline 2024-09-10T22:39:54.406308+0000) 2024-09-10T22:40:09.360 INFO:journalctl@ceph.osd.10.smithi135.stdout:Sep 10 22:40:08 smithi135 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-10[59985]: 2024-09-10T22:40:08.985+0000 7f3bf1a69640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.135:6812 osd.4 since back 2024-09-10T22:39:36.607732+0000 front 2024-09-10T22:39:36.607691+0000 (oldest deadline 2024-09-10T22:40:01.808227+0000) 2024-09-10T22:40:09.360 INFO:journalctl@ceph.osd.10.smithi135.stdout:Sep 10 22:40:08 smithi135 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-10[59985]: 2024-09-10T22:40:08.985+0000 7f3bf1a69640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.138:6812 osd.5 since back 2024-09-10T22:39:41.808681+0000 front 2024-09-10T22:39:41.808720+0000 (oldest deadline 2024-09-10T22:40:07.708751+0000) 2024-09-10T22:40:09.697 INFO:journalctl@ceph.osd.8.smithi138.stdout:Sep 10 22:40:09 smithi138 podman[71438]: 2024-09-10 22:40:09.422234669 +0000 UTC m=+5.470389338 container died b2b1c3afcc3a1819ea3f0f0d1a1604cf65f5127af6c867e735bd5b65d7838003 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-8, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_CLEAN=True, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-10T22:40:09.697 INFO:journalctl@ceph.osd.11.smithi138.stdout:Sep 10 22:40:09 smithi138 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-11[60796]: 2024-09-10T22:40:09.644+0000 7ffb00998640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-10T22:38:51.541208+0000 front 2024-09-10T22:38:51.541072+0000 (oldest deadline 2024-09-10T22:39:25.843622+0000) 2024-09-10T22:40:09.697 INFO:journalctl@ceph.osd.11.smithi138.stdout:Sep 10 22:40:09 smithi138 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-11[60796]: 2024-09-10T22:40:09.644+0000 7ffb00998640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2024-09-10T22:39:09.245148+0000 front 2024-09-10T22:39:09.245118+0000 (oldest deadline 2024-09-10T22:39:35.046015+0000) 2024-09-10T22:40:09.697 INFO:journalctl@ceph.osd.11.smithi138.stdout:Sep 10 22:40:09 smithi138 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-11[60796]: 2024-09-10T22:40:09.644+0000 7ffb00998640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.138:6804 osd.2 since back 2024-09-10T22:39:19.647426+0000 front 2024-09-10T22:39:19.647531+0000 (oldest deadline 2024-09-10T22:39:44.947487+0000) 2024-09-10T22:40:09.697 INFO:journalctl@ceph.osd.11.smithi138.stdout:Sep 10 22:40:09 smithi138 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-11[60796]: 2024-09-10T22:40:09.644+0000 7ffb00998640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.19:6814 osd.3 since back 2024-09-10T22:39:29.048508+0000 front 2024-09-10T22:39:29.048441+0000 (oldest deadline 2024-09-10T22:39:52.548620+0000) 2024-09-10T22:40:09.697 INFO:journalctl@ceph.osd.11.smithi138.stdout:Sep 10 22:40:09 smithi138 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-11[60796]: 2024-09-10T22:40:09.644+0000 7ffb00998640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.135:6812 osd.4 since back 2024-09-10T22:39:34.249759+0000 front 2024-09-10T22:39:34.249711+0000 (oldest deadline 2024-09-10T22:39:59.450249+0000) 2024-09-10T22:40:09.698 INFO:journalctl@ceph.osd.11.smithi138.stdout:Sep 10 22:40:09 smithi138 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-11[60796]: 2024-09-10T22:40:09.644+0000 7ffb00998640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.138:6812 osd.5 since back 2024-09-10T22:39:42.951295+0000 front 2024-09-10T22:39:42.951215+0000 (oldest deadline 2024-09-10T22:40:07.651229+0000) 2024-09-10T22:40:10.047 INFO:journalctl@ceph.osd.8.smithi138.stdout:Sep 10 22:40:09 smithi138 podman[71438]: 2024-09-10 22:40:09.803677254 +0000 UTC m=+5.851831911 container cleanup b2b1c3afcc3a1819ea3f0f0d1a1604cf65f5127af6c867e735bd5b65d7838003 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-8, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_BRANCH=HEAD, GIT_CLEAN=True, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=) 2024-09-10T22:40:10.047 INFO:journalctl@ceph.osd.8.smithi138.stdout:Sep 10 22:40:09 smithi138 bash[71438]: ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-8 2024-09-10T22:40:10.209 INFO:journalctl@ceph.osd.9.smithi019.stdout:Sep 10 22:40:09 smithi019 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-9[68022]: 2024-09-10T22:40:09.830+0000 7fa3f61d4640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-10T22:38:54.917764+0000 front 2024-09-10T22:38:54.917786+0000 (oldest deadline 2024-09-10T22:39:27.019686+0000) 2024-09-10T22:40:10.209 INFO:journalctl@ceph.osd.9.smithi019.stdout:Sep 10 22:40:09 smithi019 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-9[68022]: 2024-09-10T22:40:09.830+0000 7fa3f61d4640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2024-09-10T22:39:12.821560+0000 front 2024-09-10T22:39:12.821482+0000 (oldest deadline 2024-09-10T22:39:38.121512+0000) 2024-09-10T22:40:10.209 INFO:journalctl@ceph.osd.9.smithi019.stdout:Sep 10 22:40:09 smithi019 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-9[68022]: 2024-09-10T22:40:09.830+0000 7fa3f61d4640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.138:6804 osd.2 since back 2024-09-10T22:39:18.122242+0000 front 2024-09-10T22:39:18.122082+0000 (oldest deadline 2024-09-10T22:39:44.022038+0000) 2024-09-10T22:40:10.209 INFO:journalctl@ceph.osd.9.smithi019.stdout:Sep 10 22:40:09 smithi019 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-9[68022]: 2024-09-10T22:40:09.830+0000 7fa3f61d4640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.19:6814 osd.3 since back 2024-09-10T22:39:28.623376+0000 front 2024-09-10T22:39:28.623431+0000 (oldest deadline 2024-09-10T22:39:52.723588+0000) 2024-09-10T22:40:10.209 INFO:journalctl@ceph.osd.9.smithi019.stdout:Sep 10 22:40:09 smithi019 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-9[68022]: 2024-09-10T22:40:09.830+0000 7fa3f61d4640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.138:6812 osd.5 since back 2024-09-10T22:39:43.225676+0000 front 2024-09-10T22:39:43.225724+0000 (oldest deadline 2024-09-10T22:40:08.525428+0000) 2024-09-10T22:40:10.360 INFO:journalctl@ceph.osd.10.smithi135.stdout:Sep 10 22:40:09 smithi135 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-10[59985]: 2024-09-10T22:40:09.990+0000 7f3bf1a69640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-10T22:38:54.201226+0000 front 2024-09-10T22:38:54.201244+0000 (oldest deadline 2024-09-10T22:39:26.502183+0000) 2024-09-10T22:40:10.360 INFO:journalctl@ceph.osd.10.smithi135.stdout:Sep 10 22:40:09 smithi135 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-10[59985]: 2024-09-10T22:40:09.990+0000 7f3bf1a69640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2024-09-10T22:39:12.303632+0000 front 2024-09-10T22:39:12.303699+0000 (oldest deadline 2024-09-10T22:39:37.003674+0000) 2024-09-10T22:40:10.360 INFO:journalctl@ceph.osd.10.smithi135.stdout:Sep 10 22:40:09 smithi135 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-10[59985]: 2024-09-10T22:40:09.990+0000 7f3bf1a69640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.138:6804 osd.2 since back 2024-09-10T22:39:20.504425+0000 front 2024-09-10T22:39:20.504380+0000 (oldest deadline 2024-09-10T22:39:42.105008+0000) 2024-09-10T22:40:10.360 INFO:journalctl@ceph.osd.10.smithi135.stdout:Sep 10 22:40:09 smithi135 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-10[59985]: 2024-09-10T22:40:09.990+0000 7f3bf1a69640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.19:6814 osd.3 since back 2024-09-10T22:39:29.106408+0000 front 2024-09-10T22:39:29.106333+0000 (oldest deadline 2024-09-10T22:39:54.406308+0000) 2024-09-10T22:40:10.360 INFO:journalctl@ceph.osd.10.smithi135.stdout:Sep 10 22:40:09 smithi135 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-10[59985]: 2024-09-10T22:40:09.990+0000 7f3bf1a69640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.135:6812 osd.4 since back 2024-09-10T22:39:36.607732+0000 front 2024-09-10T22:39:36.607691+0000 (oldest deadline 2024-09-10T22:40:01.808227+0000) 2024-09-10T22:40:10.360 INFO:journalctl@ceph.osd.10.smithi135.stdout:Sep 10 22:40:09 smithi135 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-10[59985]: 2024-09-10T22:40:09.990+0000 7f3bf1a69640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.138:6812 osd.5 since back 2024-09-10T22:39:41.808681+0000 front 2024-09-10T22:39:41.808720+0000 (oldest deadline 2024-09-10T22:40:07.708751+0000) 2024-09-10T22:40:10.363 INFO:journalctl@ceph.osd.8.smithi138.stdout:Sep 10 22:40:10 smithi138 podman[71452]: 2024-09-10 22:40:10.046323093 +0000 UTC m=+0.625226929 container remove b2b1c3afcc3a1819ea3f0f0d1a1604cf65f5127af6c867e735bd5b65d7838003 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-8, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, ceph=True, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.vendor=CentOS) 2024-09-10T22:40:10.619 INFO:journalctl@ceph.osd.8.smithi138.stdout:Sep 10 22:40:10 smithi138 podman[71542]: 2024-09-10 22:40:10.265301808 +0000 UTC m=+0.015865177 image pull 589dd18248e494ba411dc838aa4ae0e5e569213f08fcd7a2cf22cd3ef7e3c480 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e 2024-09-10T22:40:10.619 INFO:journalctl@ceph.osd.8.smithi138.stdout:Sep 10 22:40:10 smithi138 podman[71542]: 2024-09-10 22:40:10.363783943 +0000 UTC m=+0.114347350 container create 104daa72dde72abd4ccd046b5133641a16b8719751868ce82652a2191b0ffa8e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-8-deactivate, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_CLEAN=True, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4) 2024-09-10T22:40:10.619 INFO:journalctl@ceph.osd.8.smithi138.stdout:Sep 10 22:40:10 smithi138 podman[71542]: 2024-09-10 22:40:10.600028058 +0000 UTC m=+0.350591422 container init 104daa72dde72abd4ccd046b5133641a16b8719751868ce82652a2191b0ffa8e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-8-deactivate, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_CLEAN=True, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2) 2024-09-10T22:40:10.619 INFO:journalctl@ceph.osd.8.smithi138.stdout:Sep 10 22:40:10 smithi138 podman[71542]: 2024-09-10 22:40:10.603324128 +0000 UTC m=+0.353887490 container start 104daa72dde72abd4ccd046b5133641a16b8719751868ce82652a2191b0ffa8e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-8-deactivate, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, io.buildah.version=1.37.2) 2024-09-10T22:40:10.876 INFO:journalctl@ceph.osd.8.smithi138.stdout:Sep 10 22:40:10 smithi138 podman[71542]: 2024-09-10 22:40:10.691752487 +0000 UTC m=+0.442315849 container attach 104daa72dde72abd4ccd046b5133641a16b8719751868ce82652a2191b0ffa8e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-8-deactivate, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, CEPH_POINT_RELEASE=, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-10T22:40:10.876 INFO:journalctl@ceph.osd.8.smithi138.stdout:Sep 10 22:40:10 smithi138 podman[71542]: 2024-09-10 22:40:10.799537541 +0000 UTC m=+0.550100924 container died 104daa72dde72abd4ccd046b5133641a16b8719751868ce82652a2191b0ffa8e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-8-deactivate, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD) 2024-09-10T22:40:10.876 INFO:journalctl@ceph.osd.11.smithi138.stdout:Sep 10 22:40:10 smithi138 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-11[60796]: 2024-09-10T22:40:10.617+0000 7ffb00998640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-10T22:38:51.541208+0000 front 2024-09-10T22:38:51.541072+0000 (oldest deadline 2024-09-10T22:39:25.843622+0000) 2024-09-10T22:40:10.876 INFO:journalctl@ceph.osd.11.smithi138.stdout:Sep 10 22:40:10 smithi138 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-11[60796]: 2024-09-10T22:40:10.617+0000 7ffb00998640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2024-09-10T22:39:09.245148+0000 front 2024-09-10T22:39:09.245118+0000 (oldest deadline 2024-09-10T22:39:35.046015+0000) 2024-09-10T22:40:10.876 INFO:journalctl@ceph.osd.11.smithi138.stdout:Sep 10 22:40:10 smithi138 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-11[60796]: 2024-09-10T22:40:10.617+0000 7ffb00998640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.138:6804 osd.2 since back 2024-09-10T22:39:19.647426+0000 front 2024-09-10T22:39:19.647531+0000 (oldest deadline 2024-09-10T22:39:44.947487+0000) 2024-09-10T22:40:10.876 INFO:journalctl@ceph.osd.11.smithi138.stdout:Sep 10 22:40:10 smithi138 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-11[60796]: 2024-09-10T22:40:10.617+0000 7ffb00998640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.19:6814 osd.3 since back 2024-09-10T22:39:29.048508+0000 front 2024-09-10T22:39:29.048441+0000 (oldest deadline 2024-09-10T22:39:52.548620+0000) 2024-09-10T22:40:10.876 INFO:journalctl@ceph.osd.11.smithi138.stdout:Sep 10 22:40:10 smithi138 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-11[60796]: 2024-09-10T22:40:10.617+0000 7ffb00998640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.135:6812 osd.4 since back 2024-09-10T22:39:34.249759+0000 front 2024-09-10T22:39:34.249711+0000 (oldest deadline 2024-09-10T22:39:59.450249+0000) 2024-09-10T22:40:10.877 INFO:journalctl@ceph.osd.11.smithi138.stdout:Sep 10 22:40:10 smithi138 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-11[60796]: 2024-09-10T22:40:10.617+0000 7ffb00998640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.138:6812 osd.5 since back 2024-09-10T22:39:42.951295+0000 front 2024-09-10T22:39:42.951215+0000 (oldest deadline 2024-09-10T22:40:07.651229+0000) 2024-09-10T22:40:11.208 INFO:journalctl@ceph.osd.9.smithi019.stdout:Sep 10 22:40:10 smithi019 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-9[68022]: 2024-09-10T22:40:10.853+0000 7fa3f61d4640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-10T22:38:54.917764+0000 front 2024-09-10T22:38:54.917786+0000 (oldest deadline 2024-09-10T22:39:27.019686+0000) 2024-09-10T22:40:11.209 INFO:journalctl@ceph.osd.9.smithi019.stdout:Sep 10 22:40:10 smithi019 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-9[68022]: 2024-09-10T22:40:10.853+0000 7fa3f61d4640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2024-09-10T22:39:12.821560+0000 front 2024-09-10T22:39:12.821482+0000 (oldest deadline 2024-09-10T22:39:38.121512+0000) 2024-09-10T22:40:11.209 INFO:journalctl@ceph.osd.9.smithi019.stdout:Sep 10 22:40:10 smithi019 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-9[68022]: 2024-09-10T22:40:10.853+0000 7fa3f61d4640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.138:6804 osd.2 since back 2024-09-10T22:39:18.122242+0000 front 2024-09-10T22:39:18.122082+0000 (oldest deadline 2024-09-10T22:39:44.022038+0000) 2024-09-10T22:40:11.209 INFO:journalctl@ceph.osd.9.smithi019.stdout:Sep 10 22:40:10 smithi019 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-9[68022]: 2024-09-10T22:40:10.853+0000 7fa3f61d4640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.19:6814 osd.3 since back 2024-09-10T22:39:28.623376+0000 front 2024-09-10T22:39:28.623431+0000 (oldest deadline 2024-09-10T22:39:52.723588+0000) 2024-09-10T22:40:11.209 INFO:journalctl@ceph.osd.9.smithi019.stdout:Sep 10 22:40:10 smithi019 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-9[68022]: 2024-09-10T22:40:10.853+0000 7fa3f61d4640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.138:6812 osd.5 since back 2024-09-10T22:39:43.225676+0000 front 2024-09-10T22:39:43.225724+0000 (oldest deadline 2024-09-10T22:40:08.525428+0000) 2024-09-10T22:40:11.360 INFO:journalctl@ceph.osd.10.smithi135.stdout:Sep 10 22:40:11 smithi135 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-10[59985]: 2024-09-10T22:40:11.014+0000 7f3bf1a69640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-10T22:38:54.201226+0000 front 2024-09-10T22:38:54.201244+0000 (oldest deadline 2024-09-10T22:39:26.502183+0000) 2024-09-10T22:40:11.360 INFO:journalctl@ceph.osd.10.smithi135.stdout:Sep 10 22:40:11 smithi135 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-10[59985]: 2024-09-10T22:40:11.014+0000 7f3bf1a69640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2024-09-10T22:39:12.303632+0000 front 2024-09-10T22:39:12.303699+0000 (oldest deadline 2024-09-10T22:39:37.003674+0000) 2024-09-10T22:40:11.360 INFO:journalctl@ceph.osd.10.smithi135.stdout:Sep 10 22:40:11 smithi135 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-10[59985]: 2024-09-10T22:40:11.014+0000 7f3bf1a69640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.138:6804 osd.2 since back 2024-09-10T22:39:20.504425+0000 front 2024-09-10T22:39:20.504380+0000 (oldest deadline 2024-09-10T22:39:42.105008+0000) 2024-09-10T22:40:11.360 INFO:journalctl@ceph.osd.10.smithi135.stdout:Sep 10 22:40:11 smithi135 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-10[59985]: 2024-09-10T22:40:11.014+0000 7f3bf1a69640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.19:6814 osd.3 since back 2024-09-10T22:39:29.106408+0000 front 2024-09-10T22:39:29.106333+0000 (oldest deadline 2024-09-10T22:39:54.406308+0000) 2024-09-10T22:40:11.360 INFO:journalctl@ceph.osd.10.smithi135.stdout:Sep 10 22:40:11 smithi135 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-10[59985]: 2024-09-10T22:40:11.014+0000 7f3bf1a69640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.135:6812 osd.4 since back 2024-09-10T22:39:36.607732+0000 front 2024-09-10T22:39:36.607691+0000 (oldest deadline 2024-09-10T22:40:01.808227+0000) 2024-09-10T22:40:11.360 INFO:journalctl@ceph.osd.10.smithi135.stdout:Sep 10 22:40:11 smithi135 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-10[59985]: 2024-09-10T22:40:11.014+0000 7f3bf1a69640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.138:6812 osd.5 since back 2024-09-10T22:39:41.808681+0000 front 2024-09-10T22:39:41.808720+0000 (oldest deadline 2024-09-10T22:40:07.708751+0000) 2024-09-10T22:40:11.417 DEBUG:teuthology.orchestra.run.smithi138:> sudo pkill -f 'journalctl -f -n 0 -u ceph-22997a4c-6fc2-11ef-bcea-c7b262605968@osd.8.service' 2024-09-10T22:40:11.457 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-10T22:40:11.458 INFO:tasks.cephadm.osd.8:Stopped osd.8 2024-09-10T22:40:11.458 INFO:tasks.cephadm.osd.9:Stopping osd.9... 2024-09-10T22:40:11.458 DEBUG:teuthology.orchestra.run.smithi019:> sudo systemctl stop ceph-22997a4c-6fc2-11ef-bcea-c7b262605968@osd.9 2024-09-10T22:40:11.668 INFO:journalctl@ceph.osd.11.smithi138.stdout:Sep 10 22:40:11 smithi138 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-11[60796]: 2024-09-10T22:40:11.587+0000 7ffb00998640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-10T22:38:51.541208+0000 front 2024-09-10T22:38:51.541072+0000 (oldest deadline 2024-09-10T22:39:25.843622+0000) 2024-09-10T22:40:11.668 INFO:journalctl@ceph.osd.11.smithi138.stdout:Sep 10 22:40:11 smithi138 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-11[60796]: 2024-09-10T22:40:11.587+0000 7ffb00998640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2024-09-10T22:39:09.245148+0000 front 2024-09-10T22:39:09.245118+0000 (oldest deadline 2024-09-10T22:39:35.046015+0000) 2024-09-10T22:40:11.668 INFO:journalctl@ceph.osd.11.smithi138.stdout:Sep 10 22:40:11 smithi138 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-11[60796]: 2024-09-10T22:40:11.587+0000 7ffb00998640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.138:6804 osd.2 since back 2024-09-10T22:39:19.647426+0000 front 2024-09-10T22:39:19.647531+0000 (oldest deadline 2024-09-10T22:39:44.947487+0000) 2024-09-10T22:40:11.668 INFO:journalctl@ceph.osd.11.smithi138.stdout:Sep 10 22:40:11 smithi138 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-11[60796]: 2024-09-10T22:40:11.587+0000 7ffb00998640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.19:6814 osd.3 since back 2024-09-10T22:39:29.048508+0000 front 2024-09-10T22:39:29.048441+0000 (oldest deadline 2024-09-10T22:39:52.548620+0000) 2024-09-10T22:40:11.668 INFO:journalctl@ceph.osd.11.smithi138.stdout:Sep 10 22:40:11 smithi138 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-11[60796]: 2024-09-10T22:40:11.587+0000 7ffb00998640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.135:6812 osd.4 since back 2024-09-10T22:39:34.249759+0000 front 2024-09-10T22:39:34.249711+0000 (oldest deadline 2024-09-10T22:39:59.450249+0000) 2024-09-10T22:40:11.668 INFO:journalctl@ceph.osd.11.smithi138.stdout:Sep 10 22:40:11 smithi138 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-11[60796]: 2024-09-10T22:40:11.587+0000 7ffb00998640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.138:6812 osd.5 since back 2024-09-10T22:39:42.951295+0000 front 2024-09-10T22:39:42.951215+0000 (oldest deadline 2024-09-10T22:40:07.651229+0000) 2024-09-10T22:40:11.767 INFO:journalctl@ceph.osd.9.smithi019.stdout:Sep 10 22:40:11 smithi019 systemd[1]: Stopping Ceph osd.9 for 22997a4c-6fc2-11ef-bcea-c7b262605968... 2024-09-10T22:40:11.767 INFO:journalctl@ceph.osd.9.smithi019.stdout:Sep 10 22:40:11 smithi019 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-9[68022]: 2024-09-10T22:40:11.765+0000 7fa3f9bbf640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.9 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-10T22:40:11.767 INFO:journalctl@ceph.osd.9.smithi019.stdout:Sep 10 22:40:11 smithi019 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-9[68022]: 2024-09-10T22:40:11.765+0000 7fa3f9bbf640 -1 osd.9 80 *** Got signal Terminated *** 2024-09-10T22:40:11.767 INFO:journalctl@ceph.osd.9.smithi019.stdout:Sep 10 22:40:11 smithi019 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-9[68022]: 2024-09-10T22:40:11.765+0000 7fa3f9bbf640 -1 osd.9 80 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-10T22:40:12.208 INFO:journalctl@ceph.osd.9.smithi019.stdout:Sep 10 22:40:11 smithi019 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-9[68022]: 2024-09-10T22:40:11.865+0000 7fa3f61d4640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-10T22:38:54.917764+0000 front 2024-09-10T22:38:54.917786+0000 (oldest deadline 2024-09-10T22:39:27.019686+0000) 2024-09-10T22:40:12.209 INFO:journalctl@ceph.osd.9.smithi019.stdout:Sep 10 22:40:11 smithi019 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-9[68022]: 2024-09-10T22:40:11.865+0000 7fa3f61d4640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2024-09-10T22:39:12.821560+0000 front 2024-09-10T22:39:12.821482+0000 (oldest deadline 2024-09-10T22:39:38.121512+0000) 2024-09-10T22:40:12.209 INFO:journalctl@ceph.osd.9.smithi019.stdout:Sep 10 22:40:11 smithi019 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-9[68022]: 2024-09-10T22:40:11.865+0000 7fa3f61d4640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.138:6804 osd.2 since back 2024-09-10T22:39:18.122242+0000 front 2024-09-10T22:39:18.122082+0000 (oldest deadline 2024-09-10T22:39:44.022038+0000) 2024-09-10T22:40:12.209 INFO:journalctl@ceph.osd.9.smithi019.stdout:Sep 10 22:40:11 smithi019 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-9[68022]: 2024-09-10T22:40:11.865+0000 7fa3f61d4640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.19:6814 osd.3 since back 2024-09-10T22:39:28.623376+0000 front 2024-09-10T22:39:28.623431+0000 (oldest deadline 2024-09-10T22:39:52.723588+0000) 2024-09-10T22:40:12.209 INFO:journalctl@ceph.osd.9.smithi019.stdout:Sep 10 22:40:11 smithi019 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-9[68022]: 2024-09-10T22:40:11.865+0000 7fa3f61d4640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.138:6812 osd.5 since back 2024-09-10T22:39:43.225676+0000 front 2024-09-10T22:39:43.225724+0000 (oldest deadline 2024-09-10T22:40:08.525428+0000) 2024-09-10T22:40:12.360 INFO:journalctl@ceph.osd.10.smithi135.stdout:Sep 10 22:40:12 smithi135 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-10[59985]: 2024-09-10T22:40:12.004+0000 7f3bf1a69640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-10T22:38:54.201226+0000 front 2024-09-10T22:38:54.201244+0000 (oldest deadline 2024-09-10T22:39:26.502183+0000) 2024-09-10T22:40:12.360 INFO:journalctl@ceph.osd.10.smithi135.stdout:Sep 10 22:40:12 smithi135 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-10[59985]: 2024-09-10T22:40:12.004+0000 7f3bf1a69640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2024-09-10T22:39:12.303632+0000 front 2024-09-10T22:39:12.303699+0000 (oldest deadline 2024-09-10T22:39:37.003674+0000) 2024-09-10T22:40:12.360 INFO:journalctl@ceph.osd.10.smithi135.stdout:Sep 10 22:40:12 smithi135 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-10[59985]: 2024-09-10T22:40:12.004+0000 7f3bf1a69640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.138:6804 osd.2 since back 2024-09-10T22:39:20.504425+0000 front 2024-09-10T22:39:20.504380+0000 (oldest deadline 2024-09-10T22:39:42.105008+0000) 2024-09-10T22:40:12.360 INFO:journalctl@ceph.osd.10.smithi135.stdout:Sep 10 22:40:12 smithi135 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-10[59985]: 2024-09-10T22:40:12.004+0000 7f3bf1a69640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.19:6814 osd.3 since back 2024-09-10T22:39:29.106408+0000 front 2024-09-10T22:39:29.106333+0000 (oldest deadline 2024-09-10T22:39:54.406308+0000) 2024-09-10T22:40:12.360 INFO:journalctl@ceph.osd.10.smithi135.stdout:Sep 10 22:40:12 smithi135 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-10[59985]: 2024-09-10T22:40:12.004+0000 7f3bf1a69640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.135:6812 osd.4 since back 2024-09-10T22:39:36.607732+0000 front 2024-09-10T22:39:36.607691+0000 (oldest deadline 2024-09-10T22:40:01.808227+0000) 2024-09-10T22:40:12.360 INFO:journalctl@ceph.osd.10.smithi135.stdout:Sep 10 22:40:12 smithi135 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-10[59985]: 2024-09-10T22:40:12.004+0000 7f3bf1a69640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.138:6812 osd.5 since back 2024-09-10T22:39:41.808681+0000 front 2024-09-10T22:39:41.808720+0000 (oldest deadline 2024-09-10T22:40:07.708751+0000) 2024-09-10T22:40:12.875 INFO:journalctl@ceph.osd.11.smithi138.stdout:Sep 10 22:40:12 smithi138 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-11[60796]: 2024-09-10T22:40:12.557+0000 7ffb00998640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-10T22:38:51.541208+0000 front 2024-09-10T22:38:51.541072+0000 (oldest deadline 2024-09-10T22:39:25.843622+0000) 2024-09-10T22:40:12.876 INFO:journalctl@ceph.osd.11.smithi138.stdout:Sep 10 22:40:12 smithi138 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-11[60796]: 2024-09-10T22:40:12.557+0000 7ffb00998640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2024-09-10T22:39:09.245148+0000 front 2024-09-10T22:39:09.245118+0000 (oldest deadline 2024-09-10T22:39:35.046015+0000) 2024-09-10T22:40:12.876 INFO:journalctl@ceph.osd.11.smithi138.stdout:Sep 10 22:40:12 smithi138 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-11[60796]: 2024-09-10T22:40:12.557+0000 7ffb00998640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.138:6804 osd.2 since back 2024-09-10T22:39:19.647426+0000 front 2024-09-10T22:39:19.647531+0000 (oldest deadline 2024-09-10T22:39:44.947487+0000) 2024-09-10T22:40:12.876 INFO:journalctl@ceph.osd.11.smithi138.stdout:Sep 10 22:40:12 smithi138 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-11[60796]: 2024-09-10T22:40:12.557+0000 7ffb00998640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.19:6814 osd.3 since back 2024-09-10T22:39:29.048508+0000 front 2024-09-10T22:39:29.048441+0000 (oldest deadline 2024-09-10T22:39:52.548620+0000) 2024-09-10T22:40:12.876 INFO:journalctl@ceph.osd.11.smithi138.stdout:Sep 10 22:40:12 smithi138 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-11[60796]: 2024-09-10T22:40:12.557+0000 7ffb00998640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.135:6812 osd.4 since back 2024-09-10T22:39:34.249759+0000 front 2024-09-10T22:39:34.249711+0000 (oldest deadline 2024-09-10T22:39:59.450249+0000) 2024-09-10T22:40:12.876 INFO:journalctl@ceph.osd.11.smithi138.stdout:Sep 10 22:40:12 smithi138 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-11[60796]: 2024-09-10T22:40:12.557+0000 7ffb00998640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.138:6812 osd.5 since back 2024-09-10T22:39:42.951295+0000 front 2024-09-10T22:39:42.951215+0000 (oldest deadline 2024-09-10T22:40:07.651229+0000) 2024-09-10T22:40:13.208 INFO:journalctl@ceph.osd.9.smithi019.stdout:Sep 10 22:40:12 smithi019 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-9[68022]: 2024-09-10T22:40:12.820+0000 7fa3f61d4640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-10T22:38:54.917764+0000 front 2024-09-10T22:38:54.917786+0000 (oldest deadline 2024-09-10T22:39:27.019686+0000) 2024-09-10T22:40:13.209 INFO:journalctl@ceph.osd.9.smithi019.stdout:Sep 10 22:40:12 smithi019 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-9[68022]: 2024-09-10T22:40:12.820+0000 7fa3f61d4640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2024-09-10T22:39:12.821560+0000 front 2024-09-10T22:39:12.821482+0000 (oldest deadline 2024-09-10T22:39:38.121512+0000) 2024-09-10T22:40:13.209 INFO:journalctl@ceph.osd.9.smithi019.stdout:Sep 10 22:40:12 smithi019 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-9[68022]: 2024-09-10T22:40:12.820+0000 7fa3f61d4640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.138:6804 osd.2 since back 2024-09-10T22:39:18.122242+0000 front 2024-09-10T22:39:18.122082+0000 (oldest deadline 2024-09-10T22:39:44.022038+0000) 2024-09-10T22:40:13.209 INFO:journalctl@ceph.osd.9.smithi019.stdout:Sep 10 22:40:12 smithi019 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-9[68022]: 2024-09-10T22:40:12.820+0000 7fa3f61d4640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.19:6814 osd.3 since back 2024-09-10T22:39:28.623376+0000 front 2024-09-10T22:39:28.623431+0000 (oldest deadline 2024-09-10T22:39:52.723588+0000) 2024-09-10T22:40:13.209 INFO:journalctl@ceph.osd.9.smithi019.stdout:Sep 10 22:40:12 smithi019 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-9[68022]: 2024-09-10T22:40:12.820+0000 7fa3f61d4640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.138:6812 osd.5 since back 2024-09-10T22:39:43.225676+0000 front 2024-09-10T22:39:43.225724+0000 (oldest deadline 2024-09-10T22:40:08.525428+0000) 2024-09-10T22:40:13.360 INFO:journalctl@ceph.osd.10.smithi135.stdout:Sep 10 22:40:13 smithi135 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-10[59985]: 2024-09-10T22:40:13.023+0000 7f3bf1a69640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-10T22:38:54.201226+0000 front 2024-09-10T22:38:54.201244+0000 (oldest deadline 2024-09-10T22:39:26.502183+0000) 2024-09-10T22:40:13.360 INFO:journalctl@ceph.osd.10.smithi135.stdout:Sep 10 22:40:13 smithi135 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-10[59985]: 2024-09-10T22:40:13.023+0000 7f3bf1a69640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2024-09-10T22:39:12.303632+0000 front 2024-09-10T22:39:12.303699+0000 (oldest deadline 2024-09-10T22:39:37.003674+0000) 2024-09-10T22:40:13.360 INFO:journalctl@ceph.osd.10.smithi135.stdout:Sep 10 22:40:13 smithi135 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-10[59985]: 2024-09-10T22:40:13.023+0000 7f3bf1a69640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.138:6804 osd.2 since back 2024-09-10T22:39:20.504425+0000 front 2024-09-10T22:39:20.504380+0000 (oldest deadline 2024-09-10T22:39:42.105008+0000) 2024-09-10T22:40:13.360 INFO:journalctl@ceph.osd.10.smithi135.stdout:Sep 10 22:40:13 smithi135 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-10[59985]: 2024-09-10T22:40:13.023+0000 7f3bf1a69640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.19:6814 osd.3 since back 2024-09-10T22:39:29.106408+0000 front 2024-09-10T22:39:29.106333+0000 (oldest deadline 2024-09-10T22:39:54.406308+0000) 2024-09-10T22:40:13.360 INFO:journalctl@ceph.osd.10.smithi135.stdout:Sep 10 22:40:13 smithi135 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-10[59985]: 2024-09-10T22:40:13.023+0000 7f3bf1a69640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.135:6812 osd.4 since back 2024-09-10T22:39:36.607732+0000 front 2024-09-10T22:39:36.607691+0000 (oldest deadline 2024-09-10T22:40:01.808227+0000) 2024-09-10T22:40:13.360 INFO:journalctl@ceph.osd.10.smithi135.stdout:Sep 10 22:40:13 smithi135 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-10[59985]: 2024-09-10T22:40:13.023+0000 7f3bf1a69640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.138:6812 osd.5 since back 2024-09-10T22:39:41.808681+0000 front 2024-09-10T22:39:41.808720+0000 (oldest deadline 2024-09-10T22:40:07.708751+0000) 2024-09-10T22:40:13.875 INFO:journalctl@ceph.osd.11.smithi138.stdout:Sep 10 22:40:13 smithi138 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-11[60796]: 2024-09-10T22:40:13.599+0000 7ffb00998640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-10T22:38:51.541208+0000 front 2024-09-10T22:38:51.541072+0000 (oldest deadline 2024-09-10T22:39:25.843622+0000) 2024-09-10T22:40:13.875 INFO:journalctl@ceph.osd.11.smithi138.stdout:Sep 10 22:40:13 smithi138 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-11[60796]: 2024-09-10T22:40:13.599+0000 7ffb00998640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2024-09-10T22:39:09.245148+0000 front 2024-09-10T22:39:09.245118+0000 (oldest deadline 2024-09-10T22:39:35.046015+0000) 2024-09-10T22:40:13.876 INFO:journalctl@ceph.osd.11.smithi138.stdout:Sep 10 22:40:13 smithi138 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-11[60796]: 2024-09-10T22:40:13.599+0000 7ffb00998640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.138:6804 osd.2 since back 2024-09-10T22:39:19.647426+0000 front 2024-09-10T22:39:19.647531+0000 (oldest deadline 2024-09-10T22:39:44.947487+0000) 2024-09-10T22:40:13.876 INFO:journalctl@ceph.osd.11.smithi138.stdout:Sep 10 22:40:13 smithi138 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-11[60796]: 2024-09-10T22:40:13.599+0000 7ffb00998640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.19:6814 osd.3 since back 2024-09-10T22:39:29.048508+0000 front 2024-09-10T22:39:29.048441+0000 (oldest deadline 2024-09-10T22:39:52.548620+0000) 2024-09-10T22:40:13.876 INFO:journalctl@ceph.osd.11.smithi138.stdout:Sep 10 22:40:13 smithi138 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-11[60796]: 2024-09-10T22:40:13.599+0000 7ffb00998640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.135:6812 osd.4 since back 2024-09-10T22:39:34.249759+0000 front 2024-09-10T22:39:34.249711+0000 (oldest deadline 2024-09-10T22:39:59.450249+0000) 2024-09-10T22:40:13.876 INFO:journalctl@ceph.osd.11.smithi138.stdout:Sep 10 22:40:13 smithi138 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-11[60796]: 2024-09-10T22:40:13.599+0000 7ffb00998640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.138:6812 osd.5 since back 2024-09-10T22:39:42.951295+0000 front 2024-09-10T22:39:42.951215+0000 (oldest deadline 2024-09-10T22:40:07.651229+0000) 2024-09-10T22:40:14.110 INFO:journalctl@ceph.osd.10.smithi135.stdout:Sep 10 22:40:13 smithi135 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-10[59985]: 2024-09-10T22:40:13.985+0000 7f3bf1a69640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-10T22:38:54.201226+0000 front 2024-09-10T22:38:54.201244+0000 (oldest deadline 2024-09-10T22:39:26.502183+0000) 2024-09-10T22:40:14.110 INFO:journalctl@ceph.osd.10.smithi135.stdout:Sep 10 22:40:13 smithi135 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-10[59985]: 2024-09-10T22:40:13.985+0000 7f3bf1a69640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2024-09-10T22:39:12.303632+0000 front 2024-09-10T22:39:12.303699+0000 (oldest deadline 2024-09-10T22:39:37.003674+0000) 2024-09-10T22:40:14.110 INFO:journalctl@ceph.osd.10.smithi135.stdout:Sep 10 22:40:13 smithi135 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-10[59985]: 2024-09-10T22:40:13.985+0000 7f3bf1a69640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.138:6804 osd.2 since back 2024-09-10T22:39:20.504425+0000 front 2024-09-10T22:39:20.504380+0000 (oldest deadline 2024-09-10T22:39:42.105008+0000) 2024-09-10T22:40:14.110 INFO:journalctl@ceph.osd.10.smithi135.stdout:Sep 10 22:40:13 smithi135 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-10[59985]: 2024-09-10T22:40:13.985+0000 7f3bf1a69640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.19:6814 osd.3 since back 2024-09-10T22:39:29.106408+0000 front 2024-09-10T22:39:29.106333+0000 (oldest deadline 2024-09-10T22:39:54.406308+0000) 2024-09-10T22:40:14.110 INFO:journalctl@ceph.osd.10.smithi135.stdout:Sep 10 22:40:13 smithi135 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-10[59985]: 2024-09-10T22:40:13.985+0000 7f3bf1a69640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.135:6812 osd.4 since back 2024-09-10T22:39:36.607732+0000 front 2024-09-10T22:39:36.607691+0000 (oldest deadline 2024-09-10T22:40:01.808227+0000) 2024-09-10T22:40:14.110 INFO:journalctl@ceph.osd.10.smithi135.stdout:Sep 10 22:40:13 smithi135 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-10[59985]: 2024-09-10T22:40:13.985+0000 7f3bf1a69640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.138:6812 osd.5 since back 2024-09-10T22:39:41.808681+0000 front 2024-09-10T22:39:41.808720+0000 (oldest deadline 2024-09-10T22:40:07.708751+0000) 2024-09-10T22:40:14.208 INFO:journalctl@ceph.osd.9.smithi019.stdout:Sep 10 22:40:13 smithi019 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-9[68022]: 2024-09-10T22:40:13.816+0000 7fa3f61d4640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-10T22:38:54.917764+0000 front 2024-09-10T22:38:54.917786+0000 (oldest deadline 2024-09-10T22:39:27.019686+0000) 2024-09-10T22:40:14.208 INFO:journalctl@ceph.osd.9.smithi019.stdout:Sep 10 22:40:13 smithi019 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-9[68022]: 2024-09-10T22:40:13.816+0000 7fa3f61d4640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2024-09-10T22:39:12.821560+0000 front 2024-09-10T22:39:12.821482+0000 (oldest deadline 2024-09-10T22:39:38.121512+0000) 2024-09-10T22:40:14.209 INFO:journalctl@ceph.osd.9.smithi019.stdout:Sep 10 22:40:13 smithi019 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-9[68022]: 2024-09-10T22:40:13.816+0000 7fa3f61d4640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.138:6804 osd.2 since back 2024-09-10T22:39:18.122242+0000 front 2024-09-10T22:39:18.122082+0000 (oldest deadline 2024-09-10T22:39:44.022038+0000) 2024-09-10T22:40:14.209 INFO:journalctl@ceph.osd.9.smithi019.stdout:Sep 10 22:40:13 smithi019 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-9[68022]: 2024-09-10T22:40:13.817+0000 7fa3f61d4640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.19:6814 osd.3 since back 2024-09-10T22:39:28.623376+0000 front 2024-09-10T22:39:28.623431+0000 (oldest deadline 2024-09-10T22:39:52.723588+0000) 2024-09-10T22:40:14.209 INFO:journalctl@ceph.osd.9.smithi019.stdout:Sep 10 22:40:13 smithi019 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-9[68022]: 2024-09-10T22:40:13.817+0000 7fa3f61d4640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.138:6812 osd.5 since back 2024-09-10T22:39:43.225676+0000 front 2024-09-10T22:39:43.225724+0000 (oldest deadline 2024-09-10T22:40:08.525428+0000) 2024-09-10T22:40:15.125 INFO:journalctl@ceph.osd.11.smithi138.stdout:Sep 10 22:40:14 smithi138 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-11[60796]: 2024-09-10T22:40:14.646+0000 7ffb00998640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-10T22:38:51.541208+0000 front 2024-09-10T22:38:51.541072+0000 (oldest deadline 2024-09-10T22:39:25.843622+0000) 2024-09-10T22:40:15.125 INFO:journalctl@ceph.osd.11.smithi138.stdout:Sep 10 22:40:14 smithi138 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-11[60796]: 2024-09-10T22:40:14.646+0000 7ffb00998640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2024-09-10T22:39:09.245148+0000 front 2024-09-10T22:39:09.245118+0000 (oldest deadline 2024-09-10T22:39:35.046015+0000) 2024-09-10T22:40:15.125 INFO:journalctl@ceph.osd.11.smithi138.stdout:Sep 10 22:40:14 smithi138 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-11[60796]: 2024-09-10T22:40:14.646+0000 7ffb00998640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.138:6804 osd.2 since back 2024-09-10T22:39:19.647426+0000 front 2024-09-10T22:39:19.647531+0000 (oldest deadline 2024-09-10T22:39:44.947487+0000) 2024-09-10T22:40:15.125 INFO:journalctl@ceph.osd.11.smithi138.stdout:Sep 10 22:40:14 smithi138 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-11[60796]: 2024-09-10T22:40:14.646+0000 7ffb00998640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.19:6814 osd.3 since back 2024-09-10T22:39:29.048508+0000 front 2024-09-10T22:39:29.048441+0000 (oldest deadline 2024-09-10T22:39:52.548620+0000) 2024-09-10T22:40:15.126 INFO:journalctl@ceph.osd.11.smithi138.stdout:Sep 10 22:40:14 smithi138 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-11[60796]: 2024-09-10T22:40:14.646+0000 7ffb00998640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.135:6812 osd.4 since back 2024-09-10T22:39:34.249759+0000 front 2024-09-10T22:39:34.249711+0000 (oldest deadline 2024-09-10T22:39:59.450249+0000) 2024-09-10T22:40:15.126 INFO:journalctl@ceph.osd.11.smithi138.stdout:Sep 10 22:40:14 smithi138 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-11[60796]: 2024-09-10T22:40:14.646+0000 7ffb00998640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.138:6812 osd.5 since back 2024-09-10T22:39:42.951295+0000 front 2024-09-10T22:39:42.951215+0000 (oldest deadline 2024-09-10T22:40:07.651229+0000) 2024-09-10T22:40:15.208 INFO:journalctl@ceph.osd.9.smithi019.stdout:Sep 10 22:40:14 smithi019 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-9[68022]: 2024-09-10T22:40:14.821+0000 7fa3f61d4640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-10T22:38:54.917764+0000 front 2024-09-10T22:38:54.917786+0000 (oldest deadline 2024-09-10T22:39:27.019686+0000) 2024-09-10T22:40:15.208 INFO:journalctl@ceph.osd.9.smithi019.stdout:Sep 10 22:40:14 smithi019 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-9[68022]: 2024-09-10T22:40:14.821+0000 7fa3f61d4640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2024-09-10T22:39:12.821560+0000 front 2024-09-10T22:39:12.821482+0000 (oldest deadline 2024-09-10T22:39:38.121512+0000) 2024-09-10T22:40:15.209 INFO:journalctl@ceph.osd.9.smithi019.stdout:Sep 10 22:40:14 smithi019 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-9[68022]: 2024-09-10T22:40:14.821+0000 7fa3f61d4640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.138:6804 osd.2 since back 2024-09-10T22:39:18.122242+0000 front 2024-09-10T22:39:18.122082+0000 (oldest deadline 2024-09-10T22:39:44.022038+0000) 2024-09-10T22:40:15.209 INFO:journalctl@ceph.osd.9.smithi019.stdout:Sep 10 22:40:14 smithi019 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-9[68022]: 2024-09-10T22:40:14.821+0000 7fa3f61d4640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.19:6814 osd.3 since back 2024-09-10T22:39:28.623376+0000 front 2024-09-10T22:39:28.623431+0000 (oldest deadline 2024-09-10T22:39:52.723588+0000) 2024-09-10T22:40:15.209 INFO:journalctl@ceph.osd.9.smithi019.stdout:Sep 10 22:40:14 smithi019 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-9[68022]: 2024-09-10T22:40:14.821+0000 7fa3f61d4640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.138:6812 osd.5 since back 2024-09-10T22:39:43.225676+0000 front 2024-09-10T22:39:43.225724+0000 (oldest deadline 2024-09-10T22:40:08.525428+0000) 2024-09-10T22:40:15.209 INFO:journalctl@ceph.osd.9.smithi019.stdout:Sep 10 22:40:14 smithi019 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-9[68022]: 2024-09-10T22:40:14.821+0000 7fa3f61d4640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.19:6822 osd.6 since back 2024-09-10T22:39:48.525748+0000 front 2024-09-10T22:39:48.525728+0000 (oldest deadline 2024-09-10T22:40:13.825909+0000) 2024-09-10T22:40:15.360 INFO:journalctl@ceph.osd.10.smithi135.stdout:Sep 10 22:40:15 smithi135 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-10[59985]: 2024-09-10T22:40:15.005+0000 7f3bf1a69640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-10T22:38:54.201226+0000 front 2024-09-10T22:38:54.201244+0000 (oldest deadline 2024-09-10T22:39:26.502183+0000) 2024-09-10T22:40:15.360 INFO:journalctl@ceph.osd.10.smithi135.stdout:Sep 10 22:40:15 smithi135 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-10[59985]: 2024-09-10T22:40:15.005+0000 7f3bf1a69640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2024-09-10T22:39:12.303632+0000 front 2024-09-10T22:39:12.303699+0000 (oldest deadline 2024-09-10T22:39:37.003674+0000) 2024-09-10T22:40:15.360 INFO:journalctl@ceph.osd.10.smithi135.stdout:Sep 10 22:40:15 smithi135 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-10[59985]: 2024-09-10T22:40:15.005+0000 7f3bf1a69640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.138:6804 osd.2 since back 2024-09-10T22:39:20.504425+0000 front 2024-09-10T22:39:20.504380+0000 (oldest deadline 2024-09-10T22:39:42.105008+0000) 2024-09-10T22:40:15.360 INFO:journalctl@ceph.osd.10.smithi135.stdout:Sep 10 22:40:15 smithi135 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-10[59985]: 2024-09-10T22:40:15.005+0000 7f3bf1a69640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.19:6814 osd.3 since back 2024-09-10T22:39:29.106408+0000 front 2024-09-10T22:39:29.106333+0000 (oldest deadline 2024-09-10T22:39:54.406308+0000) 2024-09-10T22:40:15.360 INFO:journalctl@ceph.osd.10.smithi135.stdout:Sep 10 22:40:15 smithi135 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-10[59985]: 2024-09-10T22:40:15.005+0000 7f3bf1a69640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.135:6812 osd.4 since back 2024-09-10T22:39:36.607732+0000 front 2024-09-10T22:39:36.607691+0000 (oldest deadline 2024-09-10T22:40:01.808227+0000) 2024-09-10T22:40:15.361 INFO:journalctl@ceph.osd.10.smithi135.stdout:Sep 10 22:40:15 smithi135 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-10[59985]: 2024-09-10T22:40:15.005+0000 7f3bf1a69640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.138:6812 osd.5 since back 2024-09-10T22:39:41.808681+0000 front 2024-09-10T22:39:41.808720+0000 (oldest deadline 2024-09-10T22:40:07.708751+0000) 2024-09-10T22:40:16.125 INFO:journalctl@ceph.osd.11.smithi138.stdout:Sep 10 22:40:15 smithi138 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-11[60796]: 2024-09-10T22:40:15.692+0000 7ffb00998640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-10T22:38:51.541208+0000 front 2024-09-10T22:38:51.541072+0000 (oldest deadline 2024-09-10T22:39:25.843622+0000) 2024-09-10T22:40:16.125 INFO:journalctl@ceph.osd.11.smithi138.stdout:Sep 10 22:40:15 smithi138 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-11[60796]: 2024-09-10T22:40:15.692+0000 7ffb00998640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2024-09-10T22:39:09.245148+0000 front 2024-09-10T22:39:09.245118+0000 (oldest deadline 2024-09-10T22:39:35.046015+0000) 2024-09-10T22:40:16.125 INFO:journalctl@ceph.osd.11.smithi138.stdout:Sep 10 22:40:15 smithi138 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-11[60796]: 2024-09-10T22:40:15.692+0000 7ffb00998640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.138:6804 osd.2 since back 2024-09-10T22:39:19.647426+0000 front 2024-09-10T22:39:19.647531+0000 (oldest deadline 2024-09-10T22:39:44.947487+0000) 2024-09-10T22:40:16.126 INFO:journalctl@ceph.osd.11.smithi138.stdout:Sep 10 22:40:15 smithi138 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-11[60796]: 2024-09-10T22:40:15.692+0000 7ffb00998640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.19:6814 osd.3 since back 2024-09-10T22:39:29.048508+0000 front 2024-09-10T22:39:29.048441+0000 (oldest deadline 2024-09-10T22:39:52.548620+0000) 2024-09-10T22:40:16.126 INFO:journalctl@ceph.osd.11.smithi138.stdout:Sep 10 22:40:15 smithi138 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-11[60796]: 2024-09-10T22:40:15.692+0000 7ffb00998640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.135:6812 osd.4 since back 2024-09-10T22:39:34.249759+0000 front 2024-09-10T22:39:34.249711+0000 (oldest deadline 2024-09-10T22:39:59.450249+0000) 2024-09-10T22:40:16.126 INFO:journalctl@ceph.osd.11.smithi138.stdout:Sep 10 22:40:15 smithi138 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-11[60796]: 2024-09-10T22:40:15.692+0000 7ffb00998640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.138:6812 osd.5 since back 2024-09-10T22:39:42.951295+0000 front 2024-09-10T22:39:42.951215+0000 (oldest deadline 2024-09-10T22:40:07.651229+0000) 2024-09-10T22:40:16.208 INFO:journalctl@ceph.osd.9.smithi019.stdout:Sep 10 22:40:15 smithi019 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-9[68022]: 2024-09-10T22:40:15.801+0000 7fa3f61d4640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-10T22:38:54.917764+0000 front 2024-09-10T22:38:54.917786+0000 (oldest deadline 2024-09-10T22:39:27.019686+0000) 2024-09-10T22:40:16.209 INFO:journalctl@ceph.osd.9.smithi019.stdout:Sep 10 22:40:15 smithi019 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-9[68022]: 2024-09-10T22:40:15.801+0000 7fa3f61d4640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2024-09-10T22:39:12.821560+0000 front 2024-09-10T22:39:12.821482+0000 (oldest deadline 2024-09-10T22:39:38.121512+0000) 2024-09-10T22:40:16.209 INFO:journalctl@ceph.osd.9.smithi019.stdout:Sep 10 22:40:15 smithi019 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-9[68022]: 2024-09-10T22:40:15.801+0000 7fa3f61d4640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.138:6804 osd.2 since back 2024-09-10T22:39:18.122242+0000 front 2024-09-10T22:39:18.122082+0000 (oldest deadline 2024-09-10T22:39:44.022038+0000) 2024-09-10T22:40:16.209 INFO:journalctl@ceph.osd.9.smithi019.stdout:Sep 10 22:40:15 smithi019 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-9[68022]: 2024-09-10T22:40:15.801+0000 7fa3f61d4640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.19:6814 osd.3 since back 2024-09-10T22:39:28.623376+0000 front 2024-09-10T22:39:28.623431+0000 (oldest deadline 2024-09-10T22:39:52.723588+0000) 2024-09-10T22:40:16.209 INFO:journalctl@ceph.osd.9.smithi019.stdout:Sep 10 22:40:15 smithi019 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-9[68022]: 2024-09-10T22:40:15.801+0000 7fa3f61d4640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.138:6812 osd.5 since back 2024-09-10T22:39:43.225676+0000 front 2024-09-10T22:39:43.225724+0000 (oldest deadline 2024-09-10T22:40:08.525428+0000) 2024-09-10T22:40:16.209 INFO:journalctl@ceph.osd.9.smithi019.stdout:Sep 10 22:40:15 smithi019 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-9[68022]: 2024-09-10T22:40:15.801+0000 7fa3f61d4640 -1 osd.9 80 heartbeat_check: no reply from 172.21.15.19:6822 osd.6 since back 2024-09-10T22:39:48.525748+0000 front 2024-09-10T22:39:48.525728+0000 (oldest deadline 2024-09-10T22:40:13.825909+0000) 2024-09-10T22:40:16.360 INFO:journalctl@ceph.osd.10.smithi135.stdout:Sep 10 22:40:16 smithi135 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-10[59985]: 2024-09-10T22:40:16.043+0000 7f3bf1a69640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-10T22:38:54.201226+0000 front 2024-09-10T22:38:54.201244+0000 (oldest deadline 2024-09-10T22:39:26.502183+0000) 2024-09-10T22:40:16.360 INFO:journalctl@ceph.osd.10.smithi135.stdout:Sep 10 22:40:16 smithi135 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-10[59985]: 2024-09-10T22:40:16.043+0000 7f3bf1a69640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2024-09-10T22:39:12.303632+0000 front 2024-09-10T22:39:12.303699+0000 (oldest deadline 2024-09-10T22:39:37.003674+0000) 2024-09-10T22:40:16.360 INFO:journalctl@ceph.osd.10.smithi135.stdout:Sep 10 22:40:16 smithi135 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-10[59985]: 2024-09-10T22:40:16.043+0000 7f3bf1a69640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.138:6804 osd.2 since back 2024-09-10T22:39:20.504425+0000 front 2024-09-10T22:39:20.504380+0000 (oldest deadline 2024-09-10T22:39:42.105008+0000) 2024-09-10T22:40:16.360 INFO:journalctl@ceph.osd.10.smithi135.stdout:Sep 10 22:40:16 smithi135 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-10[59985]: 2024-09-10T22:40:16.043+0000 7f3bf1a69640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.19:6814 osd.3 since back 2024-09-10T22:39:29.106408+0000 front 2024-09-10T22:39:29.106333+0000 (oldest deadline 2024-09-10T22:39:54.406308+0000) 2024-09-10T22:40:16.360 INFO:journalctl@ceph.osd.10.smithi135.stdout:Sep 10 22:40:16 smithi135 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-10[59985]: 2024-09-10T22:40:16.043+0000 7f3bf1a69640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.135:6812 osd.4 since back 2024-09-10T22:39:36.607732+0000 front 2024-09-10T22:39:36.607691+0000 (oldest deadline 2024-09-10T22:40:01.808227+0000) 2024-09-10T22:40:16.360 INFO:journalctl@ceph.osd.10.smithi135.stdout:Sep 10 22:40:16 smithi135 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-10[59985]: 2024-09-10T22:40:16.043+0000 7f3bf1a69640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.138:6812 osd.5 since back 2024-09-10T22:39:41.808681+0000 front 2024-09-10T22:39:41.808720+0000 (oldest deadline 2024-09-10T22:40:07.708751+0000) 2024-09-10T22:40:16.361 INFO:journalctl@ceph.osd.10.smithi135.stdout:Sep 10 22:40:16 smithi135 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-10[59985]: 2024-09-10T22:40:16.043+0000 7f3bf1a69640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.19:6822 osd.6 since back 2024-09-10T22:39:52.810518+0000 front 2024-09-10T22:39:52.810604+0000 (oldest deadline 2024-09-10T22:40:15.110514+0000) 2024-09-10T22:40:17.125 INFO:journalctl@ceph.osd.11.smithi138.stdout:Sep 10 22:40:16 smithi138 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-11[60796]: 2024-09-10T22:40:16.729+0000 7ffb00998640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-10T22:38:51.541208+0000 front 2024-09-10T22:38:51.541072+0000 (oldest deadline 2024-09-10T22:39:25.843622+0000) 2024-09-10T22:40:17.125 INFO:journalctl@ceph.osd.11.smithi138.stdout:Sep 10 22:40:16 smithi138 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-11[60796]: 2024-09-10T22:40:16.729+0000 7ffb00998640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2024-09-10T22:39:09.245148+0000 front 2024-09-10T22:39:09.245118+0000 (oldest deadline 2024-09-10T22:39:35.046015+0000) 2024-09-10T22:40:17.125 INFO:journalctl@ceph.osd.11.smithi138.stdout:Sep 10 22:40:16 smithi138 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-11[60796]: 2024-09-10T22:40:16.729+0000 7ffb00998640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.138:6804 osd.2 since back 2024-09-10T22:39:19.647426+0000 front 2024-09-10T22:39:19.647531+0000 (oldest deadline 2024-09-10T22:39:44.947487+0000) 2024-09-10T22:40:17.125 INFO:journalctl@ceph.osd.11.smithi138.stdout:Sep 10 22:40:16 smithi138 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-11[60796]: 2024-09-10T22:40:16.729+0000 7ffb00998640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.19:6814 osd.3 since back 2024-09-10T22:39:29.048508+0000 front 2024-09-10T22:39:29.048441+0000 (oldest deadline 2024-09-10T22:39:52.548620+0000) 2024-09-10T22:40:17.126 INFO:journalctl@ceph.osd.11.smithi138.stdout:Sep 10 22:40:16 smithi138 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-11[60796]: 2024-09-10T22:40:16.729+0000 7ffb00998640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.135:6812 osd.4 since back 2024-09-10T22:39:34.249759+0000 front 2024-09-10T22:39:34.249711+0000 (oldest deadline 2024-09-10T22:39:59.450249+0000) 2024-09-10T22:40:17.126 INFO:journalctl@ceph.osd.11.smithi138.stdout:Sep 10 22:40:16 smithi138 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-11[60796]: 2024-09-10T22:40:16.729+0000 7ffb00998640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.138:6812 osd.5 since back 2024-09-10T22:39:42.951295+0000 front 2024-09-10T22:39:42.951215+0000 (oldest deadline 2024-09-10T22:40:07.651229+0000) 2024-09-10T22:40:17.360 INFO:journalctl@ceph.osd.10.smithi135.stdout:Sep 10 22:40:17 smithi135 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-10[59985]: 2024-09-10T22:40:17.036+0000 7f3bf1a69640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-10T22:38:54.201226+0000 front 2024-09-10T22:38:54.201244+0000 (oldest deadline 2024-09-10T22:39:26.502183+0000) 2024-09-10T22:40:17.360 INFO:journalctl@ceph.osd.10.smithi135.stdout:Sep 10 22:40:17 smithi135 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-10[59985]: 2024-09-10T22:40:17.036+0000 7f3bf1a69640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2024-09-10T22:39:12.303632+0000 front 2024-09-10T22:39:12.303699+0000 (oldest deadline 2024-09-10T22:39:37.003674+0000) 2024-09-10T22:40:17.360 INFO:journalctl@ceph.osd.10.smithi135.stdout:Sep 10 22:40:17 smithi135 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-10[59985]: 2024-09-10T22:40:17.036+0000 7f3bf1a69640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.138:6804 osd.2 since back 2024-09-10T22:39:20.504425+0000 front 2024-09-10T22:39:20.504380+0000 (oldest deadline 2024-09-10T22:39:42.105008+0000) 2024-09-10T22:40:17.360 INFO:journalctl@ceph.osd.10.smithi135.stdout:Sep 10 22:40:17 smithi135 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-10[59985]: 2024-09-10T22:40:17.036+0000 7f3bf1a69640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.19:6814 osd.3 since back 2024-09-10T22:39:29.106408+0000 front 2024-09-10T22:39:29.106333+0000 (oldest deadline 2024-09-10T22:39:54.406308+0000) 2024-09-10T22:40:17.360 INFO:journalctl@ceph.osd.10.smithi135.stdout:Sep 10 22:40:17 smithi135 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-10[59985]: 2024-09-10T22:40:17.036+0000 7f3bf1a69640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.135:6812 osd.4 since back 2024-09-10T22:39:36.607732+0000 front 2024-09-10T22:39:36.607691+0000 (oldest deadline 2024-09-10T22:40:01.808227+0000) 2024-09-10T22:40:17.360 INFO:journalctl@ceph.osd.10.smithi135.stdout:Sep 10 22:40:17 smithi135 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-10[59985]: 2024-09-10T22:40:17.036+0000 7f3bf1a69640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.138:6812 osd.5 since back 2024-09-10T22:39:41.808681+0000 front 2024-09-10T22:39:41.808720+0000 (oldest deadline 2024-09-10T22:40:07.708751+0000) 2024-09-10T22:40:17.360 INFO:journalctl@ceph.osd.10.smithi135.stdout:Sep 10 22:40:17 smithi135 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-10[59985]: 2024-09-10T22:40:17.036+0000 7f3bf1a69640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.19:6822 osd.6 since back 2024-09-10T22:39:52.810518+0000 front 2024-09-10T22:39:52.810604+0000 (oldest deadline 2024-09-10T22:40:15.110514+0000) 2024-09-10T22:40:17.458 INFO:journalctl@ceph.osd.9.smithi019.stdout:Sep 10 22:40:17 smithi019 podman[106960]: 2024-09-10 22:40:17.201119745 +0000 UTC m=+5.543092408 container died 5edb06d2d43cdb2060df493409eb8d3b16ac371fccef614bdbb9fa947f797fb1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-9, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, ceph=True, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux ) 2024-09-10T22:40:17.958 INFO:journalctl@ceph.osd.9.smithi019.stdout:Sep 10 22:40:17 smithi019 podman[106960]: 2024-09-10 22:40:17.64013891 +0000 UTC m=+5.982111572 container cleanup 5edb06d2d43cdb2060df493409eb8d3b16ac371fccef614bdbb9fa947f797fb1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-9, org.label-schema.build-date=20240731, ceph=True, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS) 2024-09-10T22:40:17.959 INFO:journalctl@ceph.osd.9.smithi019.stdout:Sep 10 22:40:17 smithi019 bash[106960]: ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-9 2024-09-10T22:40:18.125 INFO:journalctl@ceph.osd.11.smithi138.stdout:Sep 10 22:40:17 smithi138 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-11[60796]: 2024-09-10T22:40:17.716+0000 7ffb00998640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-10T22:38:51.541208+0000 front 2024-09-10T22:38:51.541072+0000 (oldest deadline 2024-09-10T22:39:25.843622+0000) 2024-09-10T22:40:18.125 INFO:journalctl@ceph.osd.11.smithi138.stdout:Sep 10 22:40:17 smithi138 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-11[60796]: 2024-09-10T22:40:17.716+0000 7ffb00998640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2024-09-10T22:39:09.245148+0000 front 2024-09-10T22:39:09.245118+0000 (oldest deadline 2024-09-10T22:39:35.046015+0000) 2024-09-10T22:40:18.126 INFO:journalctl@ceph.osd.11.smithi138.stdout:Sep 10 22:40:17 smithi138 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-11[60796]: 2024-09-10T22:40:17.716+0000 7ffb00998640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.138:6804 osd.2 since back 2024-09-10T22:39:19.647426+0000 front 2024-09-10T22:39:19.647531+0000 (oldest deadline 2024-09-10T22:39:44.947487+0000) 2024-09-10T22:40:18.126 INFO:journalctl@ceph.osd.11.smithi138.stdout:Sep 10 22:40:17 smithi138 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-11[60796]: 2024-09-10T22:40:17.716+0000 7ffb00998640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.19:6814 osd.3 since back 2024-09-10T22:39:29.048508+0000 front 2024-09-10T22:39:29.048441+0000 (oldest deadline 2024-09-10T22:39:52.548620+0000) 2024-09-10T22:40:18.126 INFO:journalctl@ceph.osd.11.smithi138.stdout:Sep 10 22:40:17 smithi138 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-11[60796]: 2024-09-10T22:40:17.716+0000 7ffb00998640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.135:6812 osd.4 since back 2024-09-10T22:39:34.249759+0000 front 2024-09-10T22:39:34.249711+0000 (oldest deadline 2024-09-10T22:39:59.450249+0000) 2024-09-10T22:40:18.126 INFO:journalctl@ceph.osd.11.smithi138.stdout:Sep 10 22:40:17 smithi138 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-11[60796]: 2024-09-10T22:40:17.716+0000 7ffb00998640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.138:6812 osd.5 since back 2024-09-10T22:39:42.951295+0000 front 2024-09-10T22:39:42.951215+0000 (oldest deadline 2024-09-10T22:40:07.651229+0000) 2024-09-10T22:40:18.360 INFO:journalctl@ceph.osd.10.smithi135.stdout:Sep 10 22:40:17 smithi135 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-10[59985]: 2024-09-10T22:40:17.993+0000 7f3bf1a69640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-10T22:38:54.201226+0000 front 2024-09-10T22:38:54.201244+0000 (oldest deadline 2024-09-10T22:39:26.502183+0000) 2024-09-10T22:40:18.360 INFO:journalctl@ceph.osd.10.smithi135.stdout:Sep 10 22:40:17 smithi135 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-10[59985]: 2024-09-10T22:40:17.993+0000 7f3bf1a69640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2024-09-10T22:39:12.303632+0000 front 2024-09-10T22:39:12.303699+0000 (oldest deadline 2024-09-10T22:39:37.003674+0000) 2024-09-10T22:40:18.360 INFO:journalctl@ceph.osd.10.smithi135.stdout:Sep 10 22:40:17 smithi135 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-10[59985]: 2024-09-10T22:40:17.993+0000 7f3bf1a69640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.138:6804 osd.2 since back 2024-09-10T22:39:20.504425+0000 front 2024-09-10T22:39:20.504380+0000 (oldest deadline 2024-09-10T22:39:42.105008+0000) 2024-09-10T22:40:18.360 INFO:journalctl@ceph.osd.10.smithi135.stdout:Sep 10 22:40:17 smithi135 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-10[59985]: 2024-09-10T22:40:17.993+0000 7f3bf1a69640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.19:6814 osd.3 since back 2024-09-10T22:39:29.106408+0000 front 2024-09-10T22:39:29.106333+0000 (oldest deadline 2024-09-10T22:39:54.406308+0000) 2024-09-10T22:40:18.360 INFO:journalctl@ceph.osd.10.smithi135.stdout:Sep 10 22:40:17 smithi135 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-10[59985]: 2024-09-10T22:40:17.993+0000 7f3bf1a69640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.135:6812 osd.4 since back 2024-09-10T22:39:36.607732+0000 front 2024-09-10T22:39:36.607691+0000 (oldest deadline 2024-09-10T22:40:01.808227+0000) 2024-09-10T22:40:18.360 INFO:journalctl@ceph.osd.10.smithi135.stdout:Sep 10 22:40:17 smithi135 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-10[59985]: 2024-09-10T22:40:17.993+0000 7f3bf1a69640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.138:6812 osd.5 since back 2024-09-10T22:39:41.808681+0000 front 2024-09-10T22:39:41.808720+0000 (oldest deadline 2024-09-10T22:40:07.708751+0000) 2024-09-10T22:40:18.360 INFO:journalctl@ceph.osd.10.smithi135.stdout:Sep 10 22:40:17 smithi135 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-10[59985]: 2024-09-10T22:40:17.993+0000 7f3bf1a69640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.19:6822 osd.6 since back 2024-09-10T22:39:52.810518+0000 front 2024-09-10T22:39:52.810604+0000 (oldest deadline 2024-09-10T22:40:15.110514+0000) 2024-09-10T22:40:18.458 INFO:journalctl@ceph.osd.9.smithi019.stdout:Sep 10 22:40:18 smithi019 podman[106976]: 2024-09-10 22:40:18.008312894 +0000 UTC m=+0.805625720 container remove 5edb06d2d43cdb2060df493409eb8d3b16ac371fccef614bdbb9fa947f797fb1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-9, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.build-date=20240731) 2024-09-10T22:40:18.837 INFO:journalctl@ceph.osd.9.smithi019.stdout:Sep 10 22:40:18 smithi019 podman[107061]: 2024-09-10 22:40:18.416962493 +0000 UTC m=+0.016674108 image pull 589dd18248e494ba411dc838aa4ae0e5e569213f08fcd7a2cf22cd3ef7e3c480 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e 2024-09-10T22:40:18.837 INFO:journalctl@ceph.osd.9.smithi019.stdout:Sep 10 22:40:18 smithi019 podman[107061]: 2024-09-10 22:40:18.584143701 +0000 UTC m=+0.183855314 container create 949dfbe4c1d98434302c9ede6448ad3e3a770a4eb74c568a8b093d80dda154c7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-9-deactivate, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, ceph=True, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-10T22:40:18.837 INFO:journalctl@ceph.osd.9.smithi019.stdout:Sep 10 22:40:18 smithi019 podman[107061]: 2024-09-10 22:40:18.836286752 +0000 UTC m=+0.435998365 container init 949dfbe4c1d98434302c9ede6448ad3e3a770a4eb74c568a8b093d80dda154c7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-9-deactivate, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, ceph=True, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731) 2024-09-10T22:40:19.125 INFO:journalctl@ceph.osd.11.smithi138.stdout:Sep 10 22:40:18 smithi138 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-11[60796]: 2024-09-10T22:40:18.738+0000 7ffb00998640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-10T22:38:51.541208+0000 front 2024-09-10T22:38:51.541072+0000 (oldest deadline 2024-09-10T22:39:25.843622+0000) 2024-09-10T22:40:19.125 INFO:journalctl@ceph.osd.11.smithi138.stdout:Sep 10 22:40:18 smithi138 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-11[60796]: 2024-09-10T22:40:18.738+0000 7ffb00998640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2024-09-10T22:39:09.245148+0000 front 2024-09-10T22:39:09.245118+0000 (oldest deadline 2024-09-10T22:39:35.046015+0000) 2024-09-10T22:40:19.125 INFO:journalctl@ceph.osd.11.smithi138.stdout:Sep 10 22:40:18 smithi138 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-11[60796]: 2024-09-10T22:40:18.738+0000 7ffb00998640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.138:6804 osd.2 since back 2024-09-10T22:39:19.647426+0000 front 2024-09-10T22:39:19.647531+0000 (oldest deadline 2024-09-10T22:39:44.947487+0000) 2024-09-10T22:40:19.125 INFO:journalctl@ceph.osd.11.smithi138.stdout:Sep 10 22:40:18 smithi138 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-11[60796]: 2024-09-10T22:40:18.738+0000 7ffb00998640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.19:6814 osd.3 since back 2024-09-10T22:39:29.048508+0000 front 2024-09-10T22:39:29.048441+0000 (oldest deadline 2024-09-10T22:39:52.548620+0000) 2024-09-10T22:40:19.126 INFO:journalctl@ceph.osd.11.smithi138.stdout:Sep 10 22:40:18 smithi138 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-11[60796]: 2024-09-10T22:40:18.738+0000 7ffb00998640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.135:6812 osd.4 since back 2024-09-10T22:39:34.249759+0000 front 2024-09-10T22:39:34.249711+0000 (oldest deadline 2024-09-10T22:39:59.450249+0000) 2024-09-10T22:40:19.126 INFO:journalctl@ceph.osd.11.smithi138.stdout:Sep 10 22:40:18 smithi138 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-11[60796]: 2024-09-10T22:40:18.738+0000 7ffb00998640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.138:6812 osd.5 since back 2024-09-10T22:39:42.951295+0000 front 2024-09-10T22:39:42.951215+0000 (oldest deadline 2024-09-10T22:40:07.651229+0000) 2024-09-10T22:40:19.209 INFO:journalctl@ceph.osd.9.smithi019.stdout:Sep 10 22:40:18 smithi019 podman[107061]: 2024-09-10 22:40:18.839740753 +0000 UTC m=+0.439452374 container start 949dfbe4c1d98434302c9ede6448ad3e3a770a4eb74c568a8b093d80dda154c7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-9-deactivate, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, org.label-schema.build-date=20240731, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-10T22:40:19.209 INFO:journalctl@ceph.osd.9.smithi019.stdout:Sep 10 22:40:18 smithi019 podman[107061]: 2024-09-10 22:40:18.911270824 +0000 UTC m=+0.510982459 container attach 949dfbe4c1d98434302c9ede6448ad3e3a770a4eb74c568a8b093d80dda154c7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-9-deactivate, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_CLEAN=True, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, ceph=True, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-10T22:40:19.209 INFO:journalctl@ceph.osd.9.smithi019.stdout:Sep 10 22:40:19 smithi019 podman[107061]: 2024-09-10 22:40:19.032352218 +0000 UTC m=+0.632063831 container died 949dfbe4c1d98434302c9ede6448ad3e3a770a4eb74c568a8b093d80dda154c7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-9-deactivate, ceph=True, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_CLEAN=True) 2024-09-10T22:40:19.360 INFO:journalctl@ceph.osd.10.smithi135.stdout:Sep 10 22:40:18 smithi135 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-10[59985]: 2024-09-10T22:40:18.957+0000 7f3bf1a69640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-10T22:38:54.201226+0000 front 2024-09-10T22:38:54.201244+0000 (oldest deadline 2024-09-10T22:39:26.502183+0000) 2024-09-10T22:40:19.360 INFO:journalctl@ceph.osd.10.smithi135.stdout:Sep 10 22:40:18 smithi135 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-10[59985]: 2024-09-10T22:40:18.957+0000 7f3bf1a69640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2024-09-10T22:39:12.303632+0000 front 2024-09-10T22:39:12.303699+0000 (oldest deadline 2024-09-10T22:39:37.003674+0000) 2024-09-10T22:40:19.360 INFO:journalctl@ceph.osd.10.smithi135.stdout:Sep 10 22:40:18 smithi135 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-10[59985]: 2024-09-10T22:40:18.957+0000 7f3bf1a69640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.138:6804 osd.2 since back 2024-09-10T22:39:20.504425+0000 front 2024-09-10T22:39:20.504380+0000 (oldest deadline 2024-09-10T22:39:42.105008+0000) 2024-09-10T22:40:19.361 INFO:journalctl@ceph.osd.10.smithi135.stdout:Sep 10 22:40:18 smithi135 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-10[59985]: 2024-09-10T22:40:18.957+0000 7f3bf1a69640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.19:6814 osd.3 since back 2024-09-10T22:39:29.106408+0000 front 2024-09-10T22:39:29.106333+0000 (oldest deadline 2024-09-10T22:39:54.406308+0000) 2024-09-10T22:40:19.361 INFO:journalctl@ceph.osd.10.smithi135.stdout:Sep 10 22:40:18 smithi135 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-10[59985]: 2024-09-10T22:40:18.957+0000 7f3bf1a69640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.135:6812 osd.4 since back 2024-09-10T22:39:36.607732+0000 front 2024-09-10T22:39:36.607691+0000 (oldest deadline 2024-09-10T22:40:01.808227+0000) 2024-09-10T22:40:19.361 INFO:journalctl@ceph.osd.10.smithi135.stdout:Sep 10 22:40:18 smithi135 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-10[59985]: 2024-09-10T22:40:18.957+0000 7f3bf1a69640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.138:6812 osd.5 since back 2024-09-10T22:39:41.808681+0000 front 2024-09-10T22:39:41.808720+0000 (oldest deadline 2024-09-10T22:40:07.708751+0000) 2024-09-10T22:40:19.361 INFO:journalctl@ceph.osd.10.smithi135.stdout:Sep 10 22:40:18 smithi135 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-10[59985]: 2024-09-10T22:40:18.957+0000 7f3bf1a69640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.19:6822 osd.6 since back 2024-09-10T22:39:52.810518+0000 front 2024-09-10T22:39:52.810604+0000 (oldest deadline 2024-09-10T22:40:15.110514+0000) 2024-09-10T22:40:19.663 DEBUG:teuthology.orchestra.run.smithi019:> sudo pkill -f 'journalctl -f -n 0 -u ceph-22997a4c-6fc2-11ef-bcea-c7b262605968@osd.9.service' 2024-09-10T22:40:19.703 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-10T22:40:19.703 INFO:tasks.cephadm.osd.9:Stopped osd.9 2024-09-10T22:40:19.703 INFO:tasks.cephadm.osd.10:Stopping osd.10... 2024-09-10T22:40:19.703 DEBUG:teuthology.orchestra.run.smithi135:> sudo systemctl stop ceph-22997a4c-6fc2-11ef-bcea-c7b262605968@osd.10 2024-09-10T22:40:19.996 INFO:journalctl@ceph.osd.10.smithi135.stdout:Sep 10 22:40:19 smithi135 systemd[1]: Stopping Ceph osd.10 for 22997a4c-6fc2-11ef-bcea-c7b262605968... 2024-09-10T22:40:20.125 INFO:journalctl@ceph.osd.11.smithi138.stdout:Sep 10 22:40:19 smithi138 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-11[60796]: 2024-09-10T22:40:19.746+0000 7ffb00998640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-10T22:38:51.541208+0000 front 2024-09-10T22:38:51.541072+0000 (oldest deadline 2024-09-10T22:39:25.843622+0000) 2024-09-10T22:40:20.125 INFO:journalctl@ceph.osd.11.smithi138.stdout:Sep 10 22:40:19 smithi138 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-11[60796]: 2024-09-10T22:40:19.746+0000 7ffb00998640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2024-09-10T22:39:09.245148+0000 front 2024-09-10T22:39:09.245118+0000 (oldest deadline 2024-09-10T22:39:35.046015+0000) 2024-09-10T22:40:20.126 INFO:journalctl@ceph.osd.11.smithi138.stdout:Sep 10 22:40:19 smithi138 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-11[60796]: 2024-09-10T22:40:19.746+0000 7ffb00998640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.138:6804 osd.2 since back 2024-09-10T22:39:19.647426+0000 front 2024-09-10T22:39:19.647531+0000 (oldest deadline 2024-09-10T22:39:44.947487+0000) 2024-09-10T22:40:20.126 INFO:journalctl@ceph.osd.11.smithi138.stdout:Sep 10 22:40:19 smithi138 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-11[60796]: 2024-09-10T22:40:19.746+0000 7ffb00998640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.19:6814 osd.3 since back 2024-09-10T22:39:29.048508+0000 front 2024-09-10T22:39:29.048441+0000 (oldest deadline 2024-09-10T22:39:52.548620+0000) 2024-09-10T22:40:20.126 INFO:journalctl@ceph.osd.11.smithi138.stdout:Sep 10 22:40:19 smithi138 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-11[60796]: 2024-09-10T22:40:19.746+0000 7ffb00998640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.135:6812 osd.4 since back 2024-09-10T22:39:34.249759+0000 front 2024-09-10T22:39:34.249711+0000 (oldest deadline 2024-09-10T22:39:59.450249+0000) 2024-09-10T22:40:20.126 INFO:journalctl@ceph.osd.11.smithi138.stdout:Sep 10 22:40:19 smithi138 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-11[60796]: 2024-09-10T22:40:19.746+0000 7ffb00998640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.138:6812 osd.5 since back 2024-09-10T22:39:42.951295+0000 front 2024-09-10T22:39:42.951215+0000 (oldest deadline 2024-09-10T22:40:07.651229+0000) 2024-09-10T22:40:20.360 INFO:journalctl@ceph.osd.10.smithi135.stdout:Sep 10 22:40:19 smithi135 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-10[59985]: 2024-09-10T22:40:19.995+0000 7f3bf1a69640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-10T22:38:54.201226+0000 front 2024-09-10T22:38:54.201244+0000 (oldest deadline 2024-09-10T22:39:26.502183+0000) 2024-09-10T22:40:20.360 INFO:journalctl@ceph.osd.10.smithi135.stdout:Sep 10 22:40:19 smithi135 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-10[59985]: 2024-09-10T22:40:19.995+0000 7f3bf1a69640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2024-09-10T22:39:12.303632+0000 front 2024-09-10T22:39:12.303699+0000 (oldest deadline 2024-09-10T22:39:37.003674+0000) 2024-09-10T22:40:20.360 INFO:journalctl@ceph.osd.10.smithi135.stdout:Sep 10 22:40:19 smithi135 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-10[59985]: 2024-09-10T22:40:19.995+0000 7f3bf1a69640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.138:6804 osd.2 since back 2024-09-10T22:39:20.504425+0000 front 2024-09-10T22:39:20.504380+0000 (oldest deadline 2024-09-10T22:39:42.105008+0000) 2024-09-10T22:40:20.360 INFO:journalctl@ceph.osd.10.smithi135.stdout:Sep 10 22:40:19 smithi135 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-10[59985]: 2024-09-10T22:40:19.995+0000 7f3bf1a69640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.19:6814 osd.3 since back 2024-09-10T22:39:29.106408+0000 front 2024-09-10T22:39:29.106333+0000 (oldest deadline 2024-09-10T22:39:54.406308+0000) 2024-09-10T22:40:20.360 INFO:journalctl@ceph.osd.10.smithi135.stdout:Sep 10 22:40:19 smithi135 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-10[59985]: 2024-09-10T22:40:19.995+0000 7f3bf1a69640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.135:6812 osd.4 since back 2024-09-10T22:39:36.607732+0000 front 2024-09-10T22:39:36.607691+0000 (oldest deadline 2024-09-10T22:40:01.808227+0000) 2024-09-10T22:40:20.361 INFO:journalctl@ceph.osd.10.smithi135.stdout:Sep 10 22:40:19 smithi135 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-10[59985]: 2024-09-10T22:40:19.995+0000 7f3bf1a69640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.138:6812 osd.5 since back 2024-09-10T22:39:41.808681+0000 front 2024-09-10T22:39:41.808720+0000 (oldest deadline 2024-09-10T22:40:07.708751+0000) 2024-09-10T22:40:20.361 INFO:journalctl@ceph.osd.10.smithi135.stdout:Sep 10 22:40:19 smithi135 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-10[59985]: 2024-09-10T22:40:19.995+0000 7f3bf1a69640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.19:6822 osd.6 since back 2024-09-10T22:39:52.810518+0000 front 2024-09-10T22:39:52.810604+0000 (oldest deadline 2024-09-10T22:40:15.110514+0000) 2024-09-10T22:40:20.361 INFO:journalctl@ceph.osd.10.smithi135.stdout:Sep 10 22:40:19 smithi135 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-10[59985]: 2024-09-10T22:40:19.996+0000 7f3bf945c640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.10 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-10T22:40:20.361 INFO:journalctl@ceph.osd.10.smithi135.stdout:Sep 10 22:40:19 smithi135 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-10[59985]: 2024-09-10T22:40:19.996+0000 7f3bf945c640 -1 osd.10 80 *** Got signal Terminated *** 2024-09-10T22:40:20.361 INFO:journalctl@ceph.osd.10.smithi135.stdout:Sep 10 22:40:19 smithi135 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-10[59985]: 2024-09-10T22:40:19.996+0000 7f3bf945c640 -1 osd.10 80 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-10T22:40:21.125 INFO:journalctl@ceph.osd.11.smithi138.stdout:Sep 10 22:40:20 smithi138 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-11[60796]: 2024-09-10T22:40:20.733+0000 7ffb00998640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-10T22:38:51.541208+0000 front 2024-09-10T22:38:51.541072+0000 (oldest deadline 2024-09-10T22:39:25.843622+0000) 2024-09-10T22:40:21.125 INFO:journalctl@ceph.osd.11.smithi138.stdout:Sep 10 22:40:20 smithi138 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-11[60796]: 2024-09-10T22:40:20.733+0000 7ffb00998640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2024-09-10T22:39:09.245148+0000 front 2024-09-10T22:39:09.245118+0000 (oldest deadline 2024-09-10T22:39:35.046015+0000) 2024-09-10T22:40:21.125 INFO:journalctl@ceph.osd.11.smithi138.stdout:Sep 10 22:40:20 smithi138 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-11[60796]: 2024-09-10T22:40:20.733+0000 7ffb00998640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.138:6804 osd.2 since back 2024-09-10T22:39:19.647426+0000 front 2024-09-10T22:39:19.647531+0000 (oldest deadline 2024-09-10T22:39:44.947487+0000) 2024-09-10T22:40:21.125 INFO:journalctl@ceph.osd.11.smithi138.stdout:Sep 10 22:40:20 smithi138 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-11[60796]: 2024-09-10T22:40:20.733+0000 7ffb00998640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.19:6814 osd.3 since back 2024-09-10T22:39:29.048508+0000 front 2024-09-10T22:39:29.048441+0000 (oldest deadline 2024-09-10T22:39:52.548620+0000) 2024-09-10T22:40:21.126 INFO:journalctl@ceph.osd.11.smithi138.stdout:Sep 10 22:40:20 smithi138 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-11[60796]: 2024-09-10T22:40:20.733+0000 7ffb00998640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.135:6812 osd.4 since back 2024-09-10T22:39:34.249759+0000 front 2024-09-10T22:39:34.249711+0000 (oldest deadline 2024-09-10T22:39:59.450249+0000) 2024-09-10T22:40:21.126 INFO:journalctl@ceph.osd.11.smithi138.stdout:Sep 10 22:40:20 smithi138 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-11[60796]: 2024-09-10T22:40:20.733+0000 7ffb00998640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.138:6812 osd.5 since back 2024-09-10T22:39:42.951295+0000 front 2024-09-10T22:39:42.951215+0000 (oldest deadline 2024-09-10T22:40:07.651229+0000) 2024-09-10T22:40:21.360 INFO:journalctl@ceph.osd.10.smithi135.stdout:Sep 10 22:40:20 smithi135 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-10[59985]: 2024-09-10T22:40:20.948+0000 7f3bf1a69640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-10T22:38:54.201226+0000 front 2024-09-10T22:38:54.201244+0000 (oldest deadline 2024-09-10T22:39:26.502183+0000) 2024-09-10T22:40:21.360 INFO:journalctl@ceph.osd.10.smithi135.stdout:Sep 10 22:40:20 smithi135 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-10[59985]: 2024-09-10T22:40:20.948+0000 7f3bf1a69640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2024-09-10T22:39:12.303632+0000 front 2024-09-10T22:39:12.303699+0000 (oldest deadline 2024-09-10T22:39:37.003674+0000) 2024-09-10T22:40:21.360 INFO:journalctl@ceph.osd.10.smithi135.stdout:Sep 10 22:40:20 smithi135 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-10[59985]: 2024-09-10T22:40:20.948+0000 7f3bf1a69640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.138:6804 osd.2 since back 2024-09-10T22:39:20.504425+0000 front 2024-09-10T22:39:20.504380+0000 (oldest deadline 2024-09-10T22:39:42.105008+0000) 2024-09-10T22:40:21.360 INFO:journalctl@ceph.osd.10.smithi135.stdout:Sep 10 22:40:20 smithi135 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-10[59985]: 2024-09-10T22:40:20.948+0000 7f3bf1a69640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.19:6814 osd.3 since back 2024-09-10T22:39:29.106408+0000 front 2024-09-10T22:39:29.106333+0000 (oldest deadline 2024-09-10T22:39:54.406308+0000) 2024-09-10T22:40:21.360 INFO:journalctl@ceph.osd.10.smithi135.stdout:Sep 10 22:40:20 smithi135 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-10[59985]: 2024-09-10T22:40:20.948+0000 7f3bf1a69640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.135:6812 osd.4 since back 2024-09-10T22:39:36.607732+0000 front 2024-09-10T22:39:36.607691+0000 (oldest deadline 2024-09-10T22:40:01.808227+0000) 2024-09-10T22:40:21.360 INFO:journalctl@ceph.osd.10.smithi135.stdout:Sep 10 22:40:20 smithi135 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-10[59985]: 2024-09-10T22:40:20.948+0000 7f3bf1a69640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.138:6812 osd.5 since back 2024-09-10T22:39:41.808681+0000 front 2024-09-10T22:39:41.808720+0000 (oldest deadline 2024-09-10T22:40:07.708751+0000) 2024-09-10T22:40:21.361 INFO:journalctl@ceph.osd.10.smithi135.stdout:Sep 10 22:40:20 smithi135 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-10[59985]: 2024-09-10T22:40:20.948+0000 7f3bf1a69640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.19:6822 osd.6 since back 2024-09-10T22:39:52.810518+0000 front 2024-09-10T22:39:52.810604+0000 (oldest deadline 2024-09-10T22:40:15.110514+0000) 2024-09-10T22:40:22.125 INFO:journalctl@ceph.osd.11.smithi138.stdout:Sep 10 22:40:21 smithi138 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-11[60796]: 2024-09-10T22:40:21.685+0000 7ffb00998640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-10T22:38:51.541208+0000 front 2024-09-10T22:38:51.541072+0000 (oldest deadline 2024-09-10T22:39:25.843622+0000) 2024-09-10T22:40:22.125 INFO:journalctl@ceph.osd.11.smithi138.stdout:Sep 10 22:40:21 smithi138 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-11[60796]: 2024-09-10T22:40:21.685+0000 7ffb00998640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2024-09-10T22:39:09.245148+0000 front 2024-09-10T22:39:09.245118+0000 (oldest deadline 2024-09-10T22:39:35.046015+0000) 2024-09-10T22:40:22.125 INFO:journalctl@ceph.osd.11.smithi138.stdout:Sep 10 22:40:21 smithi138 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-11[60796]: 2024-09-10T22:40:21.685+0000 7ffb00998640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.138:6804 osd.2 since back 2024-09-10T22:39:19.647426+0000 front 2024-09-10T22:39:19.647531+0000 (oldest deadline 2024-09-10T22:39:44.947487+0000) 2024-09-10T22:40:22.125 INFO:journalctl@ceph.osd.11.smithi138.stdout:Sep 10 22:40:21 smithi138 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-11[60796]: 2024-09-10T22:40:21.685+0000 7ffb00998640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.19:6814 osd.3 since back 2024-09-10T22:39:29.048508+0000 front 2024-09-10T22:39:29.048441+0000 (oldest deadline 2024-09-10T22:39:52.548620+0000) 2024-09-10T22:40:22.125 INFO:journalctl@ceph.osd.11.smithi138.stdout:Sep 10 22:40:21 smithi138 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-11[60796]: 2024-09-10T22:40:21.685+0000 7ffb00998640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.135:6812 osd.4 since back 2024-09-10T22:39:34.249759+0000 front 2024-09-10T22:39:34.249711+0000 (oldest deadline 2024-09-10T22:39:59.450249+0000) 2024-09-10T22:40:22.126 INFO:journalctl@ceph.osd.11.smithi138.stdout:Sep 10 22:40:21 smithi138 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-11[60796]: 2024-09-10T22:40:21.685+0000 7ffb00998640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.138:6812 osd.5 since back 2024-09-10T22:39:42.951295+0000 front 2024-09-10T22:39:42.951215+0000 (oldest deadline 2024-09-10T22:40:07.651229+0000) 2024-09-10T22:40:22.360 INFO:journalctl@ceph.osd.10.smithi135.stdout:Sep 10 22:40:21 smithi135 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-10[59985]: 2024-09-10T22:40:21.975+0000 7f3bf1a69640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-10T22:38:54.201226+0000 front 2024-09-10T22:38:54.201244+0000 (oldest deadline 2024-09-10T22:39:26.502183+0000) 2024-09-10T22:40:22.360 INFO:journalctl@ceph.osd.10.smithi135.stdout:Sep 10 22:40:21 smithi135 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-10[59985]: 2024-09-10T22:40:21.975+0000 7f3bf1a69640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2024-09-10T22:39:12.303632+0000 front 2024-09-10T22:39:12.303699+0000 (oldest deadline 2024-09-10T22:39:37.003674+0000) 2024-09-10T22:40:22.360 INFO:journalctl@ceph.osd.10.smithi135.stdout:Sep 10 22:40:21 smithi135 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-10[59985]: 2024-09-10T22:40:21.975+0000 7f3bf1a69640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.138:6804 osd.2 since back 2024-09-10T22:39:20.504425+0000 front 2024-09-10T22:39:20.504380+0000 (oldest deadline 2024-09-10T22:39:42.105008+0000) 2024-09-10T22:40:22.360 INFO:journalctl@ceph.osd.10.smithi135.stdout:Sep 10 22:40:21 smithi135 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-10[59985]: 2024-09-10T22:40:21.975+0000 7f3bf1a69640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.19:6814 osd.3 since back 2024-09-10T22:39:29.106408+0000 front 2024-09-10T22:39:29.106333+0000 (oldest deadline 2024-09-10T22:39:54.406308+0000) 2024-09-10T22:40:22.360 INFO:journalctl@ceph.osd.10.smithi135.stdout:Sep 10 22:40:21 smithi135 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-10[59985]: 2024-09-10T22:40:21.975+0000 7f3bf1a69640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.135:6812 osd.4 since back 2024-09-10T22:39:36.607732+0000 front 2024-09-10T22:39:36.607691+0000 (oldest deadline 2024-09-10T22:40:01.808227+0000) 2024-09-10T22:40:22.360 INFO:journalctl@ceph.osd.10.smithi135.stdout:Sep 10 22:40:21 smithi135 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-10[59985]: 2024-09-10T22:40:21.975+0000 7f3bf1a69640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.138:6812 osd.5 since back 2024-09-10T22:39:41.808681+0000 front 2024-09-10T22:39:41.808720+0000 (oldest deadline 2024-09-10T22:40:07.708751+0000) 2024-09-10T22:40:22.360 INFO:journalctl@ceph.osd.10.smithi135.stdout:Sep 10 22:40:21 smithi135 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-10[59985]: 2024-09-10T22:40:21.975+0000 7f3bf1a69640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.19:6822 osd.6 since back 2024-09-10T22:39:52.810518+0000 front 2024-09-10T22:39:52.810604+0000 (oldest deadline 2024-09-10T22:40:15.110514+0000) 2024-09-10T22:40:23.125 INFO:journalctl@ceph.osd.11.smithi138.stdout:Sep 10 22:40:22 smithi138 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-11[60796]: 2024-09-10T22:40:22.654+0000 7ffb00998640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-10T22:38:51.541208+0000 front 2024-09-10T22:38:51.541072+0000 (oldest deadline 2024-09-10T22:39:25.843622+0000) 2024-09-10T22:40:23.126 INFO:journalctl@ceph.osd.11.smithi138.stdout:Sep 10 22:40:22 smithi138 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-11[60796]: 2024-09-10T22:40:22.654+0000 7ffb00998640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2024-09-10T22:39:09.245148+0000 front 2024-09-10T22:39:09.245118+0000 (oldest deadline 2024-09-10T22:39:35.046015+0000) 2024-09-10T22:40:23.126 INFO:journalctl@ceph.osd.11.smithi138.stdout:Sep 10 22:40:22 smithi138 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-11[60796]: 2024-09-10T22:40:22.654+0000 7ffb00998640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.138:6804 osd.2 since back 2024-09-10T22:39:19.647426+0000 front 2024-09-10T22:39:19.647531+0000 (oldest deadline 2024-09-10T22:39:44.947487+0000) 2024-09-10T22:40:23.126 INFO:journalctl@ceph.osd.11.smithi138.stdout:Sep 10 22:40:22 smithi138 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-11[60796]: 2024-09-10T22:40:22.654+0000 7ffb00998640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.19:6814 osd.3 since back 2024-09-10T22:39:29.048508+0000 front 2024-09-10T22:39:29.048441+0000 (oldest deadline 2024-09-10T22:39:52.548620+0000) 2024-09-10T22:40:23.126 INFO:journalctl@ceph.osd.11.smithi138.stdout:Sep 10 22:40:22 smithi138 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-11[60796]: 2024-09-10T22:40:22.654+0000 7ffb00998640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.135:6812 osd.4 since back 2024-09-10T22:39:34.249759+0000 front 2024-09-10T22:39:34.249711+0000 (oldest deadline 2024-09-10T22:39:59.450249+0000) 2024-09-10T22:40:23.126 INFO:journalctl@ceph.osd.11.smithi138.stdout:Sep 10 22:40:22 smithi138 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-11[60796]: 2024-09-10T22:40:22.654+0000 7ffb00998640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.138:6812 osd.5 since back 2024-09-10T22:39:42.951295+0000 front 2024-09-10T22:39:42.951215+0000 (oldest deadline 2024-09-10T22:40:07.651229+0000) 2024-09-10T22:40:23.126 INFO:journalctl@ceph.osd.11.smithi138.stdout:Sep 10 22:40:22 smithi138 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-11[60796]: 2024-09-10T22:40:22.654+0000 7ffb00998640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.135:6820 osd.7 since back 2024-09-10T22:39:57.453740+0000 front 2024-09-10T22:39:57.453786+0000 (oldest deadline 2024-09-10T22:40:22.153604+0000) 2024-09-10T22:40:23.360 INFO:journalctl@ceph.osd.10.smithi135.stdout:Sep 10 22:40:22 smithi135 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-10[59985]: 2024-09-10T22:40:22.943+0000 7f3bf1a69640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-10T22:38:54.201226+0000 front 2024-09-10T22:38:54.201244+0000 (oldest deadline 2024-09-10T22:39:26.502183+0000) 2024-09-10T22:40:23.360 INFO:journalctl@ceph.osd.10.smithi135.stdout:Sep 10 22:40:22 smithi135 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-10[59985]: 2024-09-10T22:40:22.943+0000 7f3bf1a69640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2024-09-10T22:39:12.303632+0000 front 2024-09-10T22:39:12.303699+0000 (oldest deadline 2024-09-10T22:39:37.003674+0000) 2024-09-10T22:40:23.360 INFO:journalctl@ceph.osd.10.smithi135.stdout:Sep 10 22:40:22 smithi135 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-10[59985]: 2024-09-10T22:40:22.943+0000 7f3bf1a69640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.138:6804 osd.2 since back 2024-09-10T22:39:20.504425+0000 front 2024-09-10T22:39:20.504380+0000 (oldest deadline 2024-09-10T22:39:42.105008+0000) 2024-09-10T22:40:23.360 INFO:journalctl@ceph.osd.10.smithi135.stdout:Sep 10 22:40:22 smithi135 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-10[59985]: 2024-09-10T22:40:22.943+0000 7f3bf1a69640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.19:6814 osd.3 since back 2024-09-10T22:39:29.106408+0000 front 2024-09-10T22:39:29.106333+0000 (oldest deadline 2024-09-10T22:39:54.406308+0000) 2024-09-10T22:40:23.360 INFO:journalctl@ceph.osd.10.smithi135.stdout:Sep 10 22:40:22 smithi135 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-10[59985]: 2024-09-10T22:40:22.943+0000 7f3bf1a69640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.135:6812 osd.4 since back 2024-09-10T22:39:36.607732+0000 front 2024-09-10T22:39:36.607691+0000 (oldest deadline 2024-09-10T22:40:01.808227+0000) 2024-09-10T22:40:23.360 INFO:journalctl@ceph.osd.10.smithi135.stdout:Sep 10 22:40:22 smithi135 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-10[59985]: 2024-09-10T22:40:22.943+0000 7f3bf1a69640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.138:6812 osd.5 since back 2024-09-10T22:39:41.808681+0000 front 2024-09-10T22:39:41.808720+0000 (oldest deadline 2024-09-10T22:40:07.708751+0000) 2024-09-10T22:40:23.360 INFO:journalctl@ceph.osd.10.smithi135.stdout:Sep 10 22:40:22 smithi135 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-10[59985]: 2024-09-10T22:40:22.943+0000 7f3bf1a69640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.19:6822 osd.6 since back 2024-09-10T22:39:52.810518+0000 front 2024-09-10T22:39:52.810604+0000 (oldest deadline 2024-09-10T22:40:15.110514+0000) 2024-09-10T22:40:24.125 INFO:journalctl@ceph.osd.11.smithi138.stdout:Sep 10 22:40:23 smithi138 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-11[60796]: 2024-09-10T22:40:23.669+0000 7ffb00998640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-10T22:38:51.541208+0000 front 2024-09-10T22:38:51.541072+0000 (oldest deadline 2024-09-10T22:39:25.843622+0000) 2024-09-10T22:40:24.125 INFO:journalctl@ceph.osd.11.smithi138.stdout:Sep 10 22:40:23 smithi138 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-11[60796]: 2024-09-10T22:40:23.669+0000 7ffb00998640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2024-09-10T22:39:09.245148+0000 front 2024-09-10T22:39:09.245118+0000 (oldest deadline 2024-09-10T22:39:35.046015+0000) 2024-09-10T22:40:24.125 INFO:journalctl@ceph.osd.11.smithi138.stdout:Sep 10 22:40:23 smithi138 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-11[60796]: 2024-09-10T22:40:23.670+0000 7ffb00998640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.138:6804 osd.2 since back 2024-09-10T22:39:19.647426+0000 front 2024-09-10T22:39:19.647531+0000 (oldest deadline 2024-09-10T22:39:44.947487+0000) 2024-09-10T22:40:24.125 INFO:journalctl@ceph.osd.11.smithi138.stdout:Sep 10 22:40:23 smithi138 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-11[60796]: 2024-09-10T22:40:23.670+0000 7ffb00998640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.19:6814 osd.3 since back 2024-09-10T22:39:29.048508+0000 front 2024-09-10T22:39:29.048441+0000 (oldest deadline 2024-09-10T22:39:52.548620+0000) 2024-09-10T22:40:24.126 INFO:journalctl@ceph.osd.11.smithi138.stdout:Sep 10 22:40:23 smithi138 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-11[60796]: 2024-09-10T22:40:23.670+0000 7ffb00998640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.135:6812 osd.4 since back 2024-09-10T22:39:34.249759+0000 front 2024-09-10T22:39:34.249711+0000 (oldest deadline 2024-09-10T22:39:59.450249+0000) 2024-09-10T22:40:24.126 INFO:journalctl@ceph.osd.11.smithi138.stdout:Sep 10 22:40:23 smithi138 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-11[60796]: 2024-09-10T22:40:23.670+0000 7ffb00998640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.138:6812 osd.5 since back 2024-09-10T22:39:42.951295+0000 front 2024-09-10T22:39:42.951215+0000 (oldest deadline 2024-09-10T22:40:07.651229+0000) 2024-09-10T22:40:24.126 INFO:journalctl@ceph.osd.11.smithi138.stdout:Sep 10 22:40:23 smithi138 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-11[60796]: 2024-09-10T22:40:23.670+0000 7ffb00998640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.135:6820 osd.7 since back 2024-09-10T22:39:57.453740+0000 front 2024-09-10T22:39:57.453786+0000 (oldest deadline 2024-09-10T22:40:22.153604+0000) 2024-09-10T22:40:24.360 INFO:journalctl@ceph.osd.10.smithi135.stdout:Sep 10 22:40:23 smithi135 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-10[59985]: 2024-09-10T22:40:23.912+0000 7f3bf1a69640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-10T22:38:54.201226+0000 front 2024-09-10T22:38:54.201244+0000 (oldest deadline 2024-09-10T22:39:26.502183+0000) 2024-09-10T22:40:24.360 INFO:journalctl@ceph.osd.10.smithi135.stdout:Sep 10 22:40:23 smithi135 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-10[59985]: 2024-09-10T22:40:23.912+0000 7f3bf1a69640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2024-09-10T22:39:12.303632+0000 front 2024-09-10T22:39:12.303699+0000 (oldest deadline 2024-09-10T22:39:37.003674+0000) 2024-09-10T22:40:24.360 INFO:journalctl@ceph.osd.10.smithi135.stdout:Sep 10 22:40:23 smithi135 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-10[59985]: 2024-09-10T22:40:23.912+0000 7f3bf1a69640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.138:6804 osd.2 since back 2024-09-10T22:39:20.504425+0000 front 2024-09-10T22:39:20.504380+0000 (oldest deadline 2024-09-10T22:39:42.105008+0000) 2024-09-10T22:40:24.360 INFO:journalctl@ceph.osd.10.smithi135.stdout:Sep 10 22:40:23 smithi135 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-10[59985]: 2024-09-10T22:40:23.912+0000 7f3bf1a69640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.19:6814 osd.3 since back 2024-09-10T22:39:29.106408+0000 front 2024-09-10T22:39:29.106333+0000 (oldest deadline 2024-09-10T22:39:54.406308+0000) 2024-09-10T22:40:24.360 INFO:journalctl@ceph.osd.10.smithi135.stdout:Sep 10 22:40:23 smithi135 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-10[59985]: 2024-09-10T22:40:23.912+0000 7f3bf1a69640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.135:6812 osd.4 since back 2024-09-10T22:39:36.607732+0000 front 2024-09-10T22:39:36.607691+0000 (oldest deadline 2024-09-10T22:40:01.808227+0000) 2024-09-10T22:40:24.360 INFO:journalctl@ceph.osd.10.smithi135.stdout:Sep 10 22:40:23 smithi135 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-10[59985]: 2024-09-10T22:40:23.912+0000 7f3bf1a69640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.138:6812 osd.5 since back 2024-09-10T22:39:41.808681+0000 front 2024-09-10T22:39:41.808720+0000 (oldest deadline 2024-09-10T22:40:07.708751+0000) 2024-09-10T22:40:24.361 INFO:journalctl@ceph.osd.10.smithi135.stdout:Sep 10 22:40:23 smithi135 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-10[59985]: 2024-09-10T22:40:23.912+0000 7f3bf1a69640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.19:6822 osd.6 since back 2024-09-10T22:39:52.810518+0000 front 2024-09-10T22:39:52.810604+0000 (oldest deadline 2024-09-10T22:40:15.110514+0000) 2024-09-10T22:40:25.125 INFO:journalctl@ceph.osd.11.smithi138.stdout:Sep 10 22:40:24 smithi138 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-11[60796]: 2024-09-10T22:40:24.690+0000 7ffb00998640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-10T22:38:51.541208+0000 front 2024-09-10T22:38:51.541072+0000 (oldest deadline 2024-09-10T22:39:25.843622+0000) 2024-09-10T22:40:25.125 INFO:journalctl@ceph.osd.11.smithi138.stdout:Sep 10 22:40:24 smithi138 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-11[60796]: 2024-09-10T22:40:24.690+0000 7ffb00998640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2024-09-10T22:39:09.245148+0000 front 2024-09-10T22:39:09.245118+0000 (oldest deadline 2024-09-10T22:39:35.046015+0000) 2024-09-10T22:40:25.126 INFO:journalctl@ceph.osd.11.smithi138.stdout:Sep 10 22:40:24 smithi138 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-11[60796]: 2024-09-10T22:40:24.690+0000 7ffb00998640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.138:6804 osd.2 since back 2024-09-10T22:39:19.647426+0000 front 2024-09-10T22:39:19.647531+0000 (oldest deadline 2024-09-10T22:39:44.947487+0000) 2024-09-10T22:40:25.126 INFO:journalctl@ceph.osd.11.smithi138.stdout:Sep 10 22:40:24 smithi138 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-11[60796]: 2024-09-10T22:40:24.690+0000 7ffb00998640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.19:6814 osd.3 since back 2024-09-10T22:39:29.048508+0000 front 2024-09-10T22:39:29.048441+0000 (oldest deadline 2024-09-10T22:39:52.548620+0000) 2024-09-10T22:40:25.126 INFO:journalctl@ceph.osd.11.smithi138.stdout:Sep 10 22:40:24 smithi138 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-11[60796]: 2024-09-10T22:40:24.690+0000 7ffb00998640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.135:6812 osd.4 since back 2024-09-10T22:39:34.249759+0000 front 2024-09-10T22:39:34.249711+0000 (oldest deadline 2024-09-10T22:39:59.450249+0000) 2024-09-10T22:40:25.126 INFO:journalctl@ceph.osd.11.smithi138.stdout:Sep 10 22:40:24 smithi138 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-11[60796]: 2024-09-10T22:40:24.690+0000 7ffb00998640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.138:6812 osd.5 since back 2024-09-10T22:39:42.951295+0000 front 2024-09-10T22:39:42.951215+0000 (oldest deadline 2024-09-10T22:40:07.651229+0000) 2024-09-10T22:40:25.126 INFO:journalctl@ceph.osd.11.smithi138.stdout:Sep 10 22:40:24 smithi138 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-11[60796]: 2024-09-10T22:40:24.690+0000 7ffb00998640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.135:6820 osd.7 since back 2024-09-10T22:39:57.453740+0000 front 2024-09-10T22:39:57.453786+0000 (oldest deadline 2024-09-10T22:40:22.153604+0000) 2024-09-10T22:40:25.360 INFO:journalctl@ceph.osd.10.smithi135.stdout:Sep 10 22:40:24 smithi135 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-10[59985]: 2024-09-10T22:40:24.948+0000 7f3bf1a69640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-10T22:38:54.201226+0000 front 2024-09-10T22:38:54.201244+0000 (oldest deadline 2024-09-10T22:39:26.502183+0000) 2024-09-10T22:40:25.360 INFO:journalctl@ceph.osd.10.smithi135.stdout:Sep 10 22:40:24 smithi135 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-10[59985]: 2024-09-10T22:40:24.948+0000 7f3bf1a69640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2024-09-10T22:39:12.303632+0000 front 2024-09-10T22:39:12.303699+0000 (oldest deadline 2024-09-10T22:39:37.003674+0000) 2024-09-10T22:40:25.360 INFO:journalctl@ceph.osd.10.smithi135.stdout:Sep 10 22:40:24 smithi135 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-10[59985]: 2024-09-10T22:40:24.948+0000 7f3bf1a69640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.138:6804 osd.2 since back 2024-09-10T22:39:20.504425+0000 front 2024-09-10T22:39:20.504380+0000 (oldest deadline 2024-09-10T22:39:42.105008+0000) 2024-09-10T22:40:25.360 INFO:journalctl@ceph.osd.10.smithi135.stdout:Sep 10 22:40:24 smithi135 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-10[59985]: 2024-09-10T22:40:24.948+0000 7f3bf1a69640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.19:6814 osd.3 since back 2024-09-10T22:39:29.106408+0000 front 2024-09-10T22:39:29.106333+0000 (oldest deadline 2024-09-10T22:39:54.406308+0000) 2024-09-10T22:40:25.360 INFO:journalctl@ceph.osd.10.smithi135.stdout:Sep 10 22:40:24 smithi135 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-10[59985]: 2024-09-10T22:40:24.948+0000 7f3bf1a69640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.135:6812 osd.4 since back 2024-09-10T22:39:36.607732+0000 front 2024-09-10T22:39:36.607691+0000 (oldest deadline 2024-09-10T22:40:01.808227+0000) 2024-09-10T22:40:25.360 INFO:journalctl@ceph.osd.10.smithi135.stdout:Sep 10 22:40:24 smithi135 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-10[59985]: 2024-09-10T22:40:24.948+0000 7f3bf1a69640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.138:6812 osd.5 since back 2024-09-10T22:39:41.808681+0000 front 2024-09-10T22:39:41.808720+0000 (oldest deadline 2024-09-10T22:40:07.708751+0000) 2024-09-10T22:40:25.360 INFO:journalctl@ceph.osd.10.smithi135.stdout:Sep 10 22:40:24 smithi135 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-10[59985]: 2024-09-10T22:40:24.948+0000 7f3bf1a69640 -1 osd.10 80 heartbeat_check: no reply from 172.21.15.19:6822 osd.6 since back 2024-09-10T22:39:52.810518+0000 front 2024-09-10T22:39:52.810604+0000 (oldest deadline 2024-09-10T22:40:15.110514+0000) 2024-09-10T22:40:25.690 INFO:journalctl@ceph.osd.10.smithi135.stdout:Sep 10 22:40:25 smithi135 podman[70722]: 2024-09-10 22:40:25.423164116 +0000 UTC m=+5.526000037 container died c1d646343c5c0378c21d2f5871ab4431102c53c1aedaffb8bdc0d9f61b101d4f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-10, GIT_CLEAN=True, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, CEPH_POINT_RELEASE=, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-10T22:40:26.049 INFO:journalctl@ceph.osd.10.smithi135.stdout:Sep 10 22:40:25 smithi135 podman[70722]: 2024-09-10 22:40:25.79693391 +0000 UTC m=+5.899769830 container cleanup c1d646343c5c0378c21d2f5871ab4431102c53c1aedaffb8bdc0d9f61b101d4f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-10, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS) 2024-09-10T22:40:26.049 INFO:journalctl@ceph.osd.10.smithi135.stdout:Sep 10 22:40:25 smithi135 bash[70722]: ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-10 2024-09-10T22:40:26.125 INFO:journalctl@ceph.osd.11.smithi138.stdout:Sep 10 22:40:25 smithi138 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-11[60796]: 2024-09-10T22:40:25.664+0000 7ffb00998640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-10T22:38:51.541208+0000 front 2024-09-10T22:38:51.541072+0000 (oldest deadline 2024-09-10T22:39:25.843622+0000) 2024-09-10T22:40:26.125 INFO:journalctl@ceph.osd.11.smithi138.stdout:Sep 10 22:40:25 smithi138 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-11[60796]: 2024-09-10T22:40:25.664+0000 7ffb00998640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2024-09-10T22:39:09.245148+0000 front 2024-09-10T22:39:09.245118+0000 (oldest deadline 2024-09-10T22:39:35.046015+0000) 2024-09-10T22:40:26.125 INFO:journalctl@ceph.osd.11.smithi138.stdout:Sep 10 22:40:25 smithi138 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-11[60796]: 2024-09-10T22:40:25.664+0000 7ffb00998640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.138:6804 osd.2 since back 2024-09-10T22:39:19.647426+0000 front 2024-09-10T22:39:19.647531+0000 (oldest deadline 2024-09-10T22:39:44.947487+0000) 2024-09-10T22:40:26.126 INFO:journalctl@ceph.osd.11.smithi138.stdout:Sep 10 22:40:25 smithi138 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-11[60796]: 2024-09-10T22:40:25.664+0000 7ffb00998640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.19:6814 osd.3 since back 2024-09-10T22:39:29.048508+0000 front 2024-09-10T22:39:29.048441+0000 (oldest deadline 2024-09-10T22:39:52.548620+0000) 2024-09-10T22:40:26.126 INFO:journalctl@ceph.osd.11.smithi138.stdout:Sep 10 22:40:25 smithi138 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-11[60796]: 2024-09-10T22:40:25.664+0000 7ffb00998640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.135:6812 osd.4 since back 2024-09-10T22:39:34.249759+0000 front 2024-09-10T22:39:34.249711+0000 (oldest deadline 2024-09-10T22:39:59.450249+0000) 2024-09-10T22:40:26.126 INFO:journalctl@ceph.osd.11.smithi138.stdout:Sep 10 22:40:25 smithi138 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-11[60796]: 2024-09-10T22:40:25.664+0000 7ffb00998640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.138:6812 osd.5 since back 2024-09-10T22:39:42.951295+0000 front 2024-09-10T22:39:42.951215+0000 (oldest deadline 2024-09-10T22:40:07.651229+0000) 2024-09-10T22:40:26.126 INFO:journalctl@ceph.osd.11.smithi138.stdout:Sep 10 22:40:25 smithi138 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-11[60796]: 2024-09-10T22:40:25.664+0000 7ffb00998640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.135:6820 osd.7 since back 2024-09-10T22:39:57.453740+0000 front 2024-09-10T22:39:57.453786+0000 (oldest deadline 2024-09-10T22:40:22.153604+0000) 2024-09-10T22:40:26.360 INFO:journalctl@ceph.osd.10.smithi135.stdout:Sep 10 22:40:26 smithi135 podman[70737]: 2024-09-10 22:40:26.048030607 +0000 UTC m=+0.616410473 container remove c1d646343c5c0378c21d2f5871ab4431102c53c1aedaffb8bdc0d9f61b101d4f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-10, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0) 2024-09-10T22:40:26.685 INFO:journalctl@ceph.osd.10.smithi135.stdout:Sep 10 22:40:26 smithi135 podman[70824]: 2024-09-10 22:40:26.272215223 +0000 UTC m=+0.016208127 image pull 589dd18248e494ba411dc838aa4ae0e5e569213f08fcd7a2cf22cd3ef7e3c480 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e 2024-09-10T22:40:26.685 INFO:journalctl@ceph.osd.10.smithi135.stdout:Sep 10 22:40:26 smithi135 podman[70824]: 2024-09-10 22:40:26.381999793 +0000 UTC m=+0.125992696 container create a6b1710db4104588cfd430bd561f28482866d02c7bf96a88de26db3feaabafe9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-10-deactivate, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_CLEAN=True, maintainer=Guillaume Abrioux , ceph=True, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2) 2024-09-10T22:40:26.685 INFO:journalctl@ceph.osd.10.smithi135.stdout:Sep 10 22:40:26 smithi135 podman[70824]: 2024-09-10 22:40:26.601281476 +0000 UTC m=+0.345274379 container init a6b1710db4104588cfd430bd561f28482866d02c7bf96a88de26db3feaabafe9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-10-deactivate, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4) 2024-09-10T22:40:26.686 INFO:journalctl@ceph.osd.10.smithi135.stdout:Sep 10 22:40:26 smithi135 podman[70824]: 2024-09-10 22:40:26.604553597 +0000 UTC m=+0.348546506 container start a6b1710db4104588cfd430bd561f28482866d02c7bf96a88de26db3feaabafe9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-10-deactivate, io.buildah.version=1.37.2, ceph=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True) 2024-09-10T22:40:26.686 INFO:journalctl@ceph.osd.10.smithi135.stdout:Sep 10 22:40:26 smithi135 podman[70824]: 2024-09-10 22:40:26.684328642 +0000 UTC m=+0.428321573 container attach a6b1710db4104588cfd430bd561f28482866d02c7bf96a88de26db3feaabafe9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-10-deactivate, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, ceph=True, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux ) 2024-09-10T22:40:27.027 INFO:journalctl@ceph.osd.11.smithi138.stdout:Sep 10 22:40:26 smithi138 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-11[60796]: 2024-09-10T22:40:26.672+0000 7ffb00998640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-10T22:38:51.541208+0000 front 2024-09-10T22:38:51.541072+0000 (oldest deadline 2024-09-10T22:39:25.843622+0000) 2024-09-10T22:40:27.027 INFO:journalctl@ceph.osd.11.smithi138.stdout:Sep 10 22:40:26 smithi138 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-11[60796]: 2024-09-10T22:40:26.672+0000 7ffb00998640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2024-09-10T22:39:09.245148+0000 front 2024-09-10T22:39:09.245118+0000 (oldest deadline 2024-09-10T22:39:35.046015+0000) 2024-09-10T22:40:27.027 INFO:journalctl@ceph.osd.11.smithi138.stdout:Sep 10 22:40:26 smithi138 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-11[60796]: 2024-09-10T22:40:26.672+0000 7ffb00998640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.138:6804 osd.2 since back 2024-09-10T22:39:19.647426+0000 front 2024-09-10T22:39:19.647531+0000 (oldest deadline 2024-09-10T22:39:44.947487+0000) 2024-09-10T22:40:27.027 INFO:journalctl@ceph.osd.11.smithi138.stdout:Sep 10 22:40:26 smithi138 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-11[60796]: 2024-09-10T22:40:26.672+0000 7ffb00998640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.19:6814 osd.3 since back 2024-09-10T22:39:29.048508+0000 front 2024-09-10T22:39:29.048441+0000 (oldest deadline 2024-09-10T22:39:52.548620+0000) 2024-09-10T22:40:27.027 INFO:journalctl@ceph.osd.11.smithi138.stdout:Sep 10 22:40:26 smithi138 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-11[60796]: 2024-09-10T22:40:26.672+0000 7ffb00998640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.135:6812 osd.4 since back 2024-09-10T22:39:34.249759+0000 front 2024-09-10T22:39:34.249711+0000 (oldest deadline 2024-09-10T22:39:59.450249+0000) 2024-09-10T22:40:27.027 INFO:journalctl@ceph.osd.11.smithi138.stdout:Sep 10 22:40:26 smithi138 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-11[60796]: 2024-09-10T22:40:26.672+0000 7ffb00998640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.138:6812 osd.5 since back 2024-09-10T22:39:42.951295+0000 front 2024-09-10T22:39:42.951215+0000 (oldest deadline 2024-09-10T22:40:07.651229+0000) 2024-09-10T22:40:27.027 INFO:journalctl@ceph.osd.11.smithi138.stdout:Sep 10 22:40:26 smithi138 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-11[60796]: 2024-09-10T22:40:26.672+0000 7ffb00998640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.135:6820 osd.7 since back 2024-09-10T22:39:57.453740+0000 front 2024-09-10T22:39:57.453786+0000 (oldest deadline 2024-09-10T22:40:22.153604+0000) 2024-09-10T22:40:27.079 INFO:journalctl@ceph.osd.10.smithi135.stdout:Sep 10 22:40:26 smithi135 podman[70824]: 2024-09-10 22:40:26.792504395 +0000 UTC m=+0.536497307 container died a6b1710db4104588cfd430bd561f28482866d02c7bf96a88de26db3feaabafe9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-10-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, ceph=True) 2024-09-10T22:40:27.369 DEBUG:teuthology.orchestra.run.smithi135:> sudo pkill -f 'journalctl -f -n 0 -u ceph-22997a4c-6fc2-11ef-bcea-c7b262605968@osd.10.service' 2024-09-10T22:40:27.407 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-10T22:40:27.407 INFO:tasks.cephadm.osd.10:Stopped osd.10 2024-09-10T22:40:27.407 INFO:tasks.cephadm.osd.11:Stopping osd.11... 2024-09-10T22:40:27.408 DEBUG:teuthology.orchestra.run.smithi138:> sudo systemctl stop ceph-22997a4c-6fc2-11ef-bcea-c7b262605968@osd.11 2024-09-10T22:40:27.724 INFO:journalctl@ceph.osd.11.smithi138.stdout:Sep 10 22:40:27 smithi138 systemd[1]: Stopping Ceph osd.11 for 22997a4c-6fc2-11ef-bcea-c7b262605968... 2024-09-10T22:40:27.724 INFO:journalctl@ceph.osd.11.smithi138.stdout:Sep 10 22:40:27 smithi138 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-11[60796]: 2024-09-10T22:40:27.634+0000 7ffb00998640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-10T22:38:51.541208+0000 front 2024-09-10T22:38:51.541072+0000 (oldest deadline 2024-09-10T22:39:25.843622+0000) 2024-09-10T22:40:27.724 INFO:journalctl@ceph.osd.11.smithi138.stdout:Sep 10 22:40:27 smithi138 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-11[60796]: 2024-09-10T22:40:27.634+0000 7ffb00998640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2024-09-10T22:39:09.245148+0000 front 2024-09-10T22:39:09.245118+0000 (oldest deadline 2024-09-10T22:39:35.046015+0000) 2024-09-10T22:40:27.724 INFO:journalctl@ceph.osd.11.smithi138.stdout:Sep 10 22:40:27 smithi138 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-11[60796]: 2024-09-10T22:40:27.634+0000 7ffb00998640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.138:6804 osd.2 since back 2024-09-10T22:39:19.647426+0000 front 2024-09-10T22:39:19.647531+0000 (oldest deadline 2024-09-10T22:39:44.947487+0000) 2024-09-10T22:40:27.724 INFO:journalctl@ceph.osd.11.smithi138.stdout:Sep 10 22:40:27 smithi138 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-11[60796]: 2024-09-10T22:40:27.634+0000 7ffb00998640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.19:6814 osd.3 since back 2024-09-10T22:39:29.048508+0000 front 2024-09-10T22:39:29.048441+0000 (oldest deadline 2024-09-10T22:39:52.548620+0000) 2024-09-10T22:40:27.724 INFO:journalctl@ceph.osd.11.smithi138.stdout:Sep 10 22:40:27 smithi138 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-11[60796]: 2024-09-10T22:40:27.634+0000 7ffb00998640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.135:6812 osd.4 since back 2024-09-10T22:39:34.249759+0000 front 2024-09-10T22:39:34.249711+0000 (oldest deadline 2024-09-10T22:39:59.450249+0000) 2024-09-10T22:40:27.724 INFO:journalctl@ceph.osd.11.smithi138.stdout:Sep 10 22:40:27 smithi138 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-11[60796]: 2024-09-10T22:40:27.634+0000 7ffb00998640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.138:6812 osd.5 since back 2024-09-10T22:39:42.951295+0000 front 2024-09-10T22:39:42.951215+0000 (oldest deadline 2024-09-10T22:40:07.651229+0000) 2024-09-10T22:40:27.725 INFO:journalctl@ceph.osd.11.smithi138.stdout:Sep 10 22:40:27 smithi138 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-11[60796]: 2024-09-10T22:40:27.634+0000 7ffb00998640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.135:6820 osd.7 since back 2024-09-10T22:39:57.453740+0000 front 2024-09-10T22:39:57.453786+0000 (oldest deadline 2024-09-10T22:40:22.153604+0000) 2024-09-10T22:40:27.725 INFO:journalctl@ceph.osd.11.smithi138.stdout:Sep 10 22:40:27 smithi138 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-11[60796]: 2024-09-10T22:40:27.722+0000 7ffb04383640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.11 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-10T22:40:28.125 INFO:journalctl@ceph.osd.11.smithi138.stdout:Sep 10 22:40:27 smithi138 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-11[60796]: 2024-09-10T22:40:27.722+0000 7ffb04383640 -1 osd.11 80 *** Got signal Terminated *** 2024-09-10T22:40:28.125 INFO:journalctl@ceph.osd.11.smithi138.stdout:Sep 10 22:40:27 smithi138 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-11[60796]: 2024-09-10T22:40:27.722+0000 7ffb04383640 -1 osd.11 80 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-10T22:40:29.125 INFO:journalctl@ceph.osd.11.smithi138.stdout:Sep 10 22:40:28 smithi138 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-11[60796]: 2024-09-10T22:40:28.665+0000 7ffb00998640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-10T22:38:51.541208+0000 front 2024-09-10T22:38:51.541072+0000 (oldest deadline 2024-09-10T22:39:25.843622+0000) 2024-09-10T22:40:29.125 INFO:journalctl@ceph.osd.11.smithi138.stdout:Sep 10 22:40:28 smithi138 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-11[60796]: 2024-09-10T22:40:28.665+0000 7ffb00998640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2024-09-10T22:39:09.245148+0000 front 2024-09-10T22:39:09.245118+0000 (oldest deadline 2024-09-10T22:39:35.046015+0000) 2024-09-10T22:40:29.126 INFO:journalctl@ceph.osd.11.smithi138.stdout:Sep 10 22:40:28 smithi138 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-11[60796]: 2024-09-10T22:40:28.665+0000 7ffb00998640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.138:6804 osd.2 since back 2024-09-10T22:39:19.647426+0000 front 2024-09-10T22:39:19.647531+0000 (oldest deadline 2024-09-10T22:39:44.947487+0000) 2024-09-10T22:40:29.126 INFO:journalctl@ceph.osd.11.smithi138.stdout:Sep 10 22:40:28 smithi138 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-11[60796]: 2024-09-10T22:40:28.665+0000 7ffb00998640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.19:6814 osd.3 since back 2024-09-10T22:39:29.048508+0000 front 2024-09-10T22:39:29.048441+0000 (oldest deadline 2024-09-10T22:39:52.548620+0000) 2024-09-10T22:40:29.126 INFO:journalctl@ceph.osd.11.smithi138.stdout:Sep 10 22:40:28 smithi138 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-11[60796]: 2024-09-10T22:40:28.665+0000 7ffb00998640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.135:6812 osd.4 since back 2024-09-10T22:39:34.249759+0000 front 2024-09-10T22:39:34.249711+0000 (oldest deadline 2024-09-10T22:39:59.450249+0000) 2024-09-10T22:40:29.126 INFO:journalctl@ceph.osd.11.smithi138.stdout:Sep 10 22:40:28 smithi138 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-11[60796]: 2024-09-10T22:40:28.665+0000 7ffb00998640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.138:6812 osd.5 since back 2024-09-10T22:39:42.951295+0000 front 2024-09-10T22:39:42.951215+0000 (oldest deadline 2024-09-10T22:40:07.651229+0000) 2024-09-10T22:40:29.126 INFO:journalctl@ceph.osd.11.smithi138.stdout:Sep 10 22:40:28 smithi138 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-11[60796]: 2024-09-10T22:40:28.665+0000 7ffb00998640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.135:6820 osd.7 since back 2024-09-10T22:39:57.453740+0000 front 2024-09-10T22:39:57.453786+0000 (oldest deadline 2024-09-10T22:40:22.153604+0000) 2024-09-10T22:40:30.125 INFO:journalctl@ceph.osd.11.smithi138.stdout:Sep 10 22:40:29 smithi138 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-11[60796]: 2024-09-10T22:40:29.712+0000 7ffb00998640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-10T22:38:51.541208+0000 front 2024-09-10T22:38:51.541072+0000 (oldest deadline 2024-09-10T22:39:25.843622+0000) 2024-09-10T22:40:30.125 INFO:journalctl@ceph.osd.11.smithi138.stdout:Sep 10 22:40:29 smithi138 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-11[60796]: 2024-09-10T22:40:29.712+0000 7ffb00998640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2024-09-10T22:39:09.245148+0000 front 2024-09-10T22:39:09.245118+0000 (oldest deadline 2024-09-10T22:39:35.046015+0000) 2024-09-10T22:40:30.126 INFO:journalctl@ceph.osd.11.smithi138.stdout:Sep 10 22:40:29 smithi138 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-11[60796]: 2024-09-10T22:40:29.712+0000 7ffb00998640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.138:6804 osd.2 since back 2024-09-10T22:39:19.647426+0000 front 2024-09-10T22:39:19.647531+0000 (oldest deadline 2024-09-10T22:39:44.947487+0000) 2024-09-10T22:40:30.126 INFO:journalctl@ceph.osd.11.smithi138.stdout:Sep 10 22:40:29 smithi138 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-11[60796]: 2024-09-10T22:40:29.712+0000 7ffb00998640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.19:6814 osd.3 since back 2024-09-10T22:39:29.048508+0000 front 2024-09-10T22:39:29.048441+0000 (oldest deadline 2024-09-10T22:39:52.548620+0000) 2024-09-10T22:40:30.126 INFO:journalctl@ceph.osd.11.smithi138.stdout:Sep 10 22:40:29 smithi138 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-11[60796]: 2024-09-10T22:40:29.712+0000 7ffb00998640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.135:6812 osd.4 since back 2024-09-10T22:39:34.249759+0000 front 2024-09-10T22:39:34.249711+0000 (oldest deadline 2024-09-10T22:39:59.450249+0000) 2024-09-10T22:40:30.126 INFO:journalctl@ceph.osd.11.smithi138.stdout:Sep 10 22:40:29 smithi138 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-11[60796]: 2024-09-10T22:40:29.712+0000 7ffb00998640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.138:6812 osd.5 since back 2024-09-10T22:39:42.951295+0000 front 2024-09-10T22:39:42.951215+0000 (oldest deadline 2024-09-10T22:40:07.651229+0000) 2024-09-10T22:40:30.126 INFO:journalctl@ceph.osd.11.smithi138.stdout:Sep 10 22:40:29 smithi138 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-11[60796]: 2024-09-10T22:40:29.712+0000 7ffb00998640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.135:6820 osd.7 since back 2024-09-10T22:39:57.453740+0000 front 2024-09-10T22:39:57.453786+0000 (oldest deadline 2024-09-10T22:40:22.153604+0000) 2024-09-10T22:40:31.125 INFO:journalctl@ceph.osd.11.smithi138.stdout:Sep 10 22:40:30 smithi138 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-11[60796]: 2024-09-10T22:40:30.721+0000 7ffb00998640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-10T22:38:51.541208+0000 front 2024-09-10T22:38:51.541072+0000 (oldest deadline 2024-09-10T22:39:25.843622+0000) 2024-09-10T22:40:31.125 INFO:journalctl@ceph.osd.11.smithi138.stdout:Sep 10 22:40:30 smithi138 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-11[60796]: 2024-09-10T22:40:30.721+0000 7ffb00998640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2024-09-10T22:39:09.245148+0000 front 2024-09-10T22:39:09.245118+0000 (oldest deadline 2024-09-10T22:39:35.046015+0000) 2024-09-10T22:40:31.125 INFO:journalctl@ceph.osd.11.smithi138.stdout:Sep 10 22:40:30 smithi138 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-11[60796]: 2024-09-10T22:40:30.721+0000 7ffb00998640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.138:6804 osd.2 since back 2024-09-10T22:39:19.647426+0000 front 2024-09-10T22:39:19.647531+0000 (oldest deadline 2024-09-10T22:39:44.947487+0000) 2024-09-10T22:40:31.125 INFO:journalctl@ceph.osd.11.smithi138.stdout:Sep 10 22:40:30 smithi138 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-11[60796]: 2024-09-10T22:40:30.721+0000 7ffb00998640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.19:6814 osd.3 since back 2024-09-10T22:39:29.048508+0000 front 2024-09-10T22:39:29.048441+0000 (oldest deadline 2024-09-10T22:39:52.548620+0000) 2024-09-10T22:40:31.126 INFO:journalctl@ceph.osd.11.smithi138.stdout:Sep 10 22:40:30 smithi138 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-11[60796]: 2024-09-10T22:40:30.721+0000 7ffb00998640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.135:6812 osd.4 since back 2024-09-10T22:39:34.249759+0000 front 2024-09-10T22:39:34.249711+0000 (oldest deadline 2024-09-10T22:39:59.450249+0000) 2024-09-10T22:40:31.126 INFO:journalctl@ceph.osd.11.smithi138.stdout:Sep 10 22:40:30 smithi138 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-11[60796]: 2024-09-10T22:40:30.721+0000 7ffb00998640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.138:6812 osd.5 since back 2024-09-10T22:39:42.951295+0000 front 2024-09-10T22:39:42.951215+0000 (oldest deadline 2024-09-10T22:40:07.651229+0000) 2024-09-10T22:40:31.126 INFO:journalctl@ceph.osd.11.smithi138.stdout:Sep 10 22:40:30 smithi138 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-11[60796]: 2024-09-10T22:40:30.721+0000 7ffb00998640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.135:6820 osd.7 since back 2024-09-10T22:39:57.453740+0000 front 2024-09-10T22:39:57.453786+0000 (oldest deadline 2024-09-10T22:40:22.153604+0000) 2024-09-10T22:40:32.125 INFO:journalctl@ceph.osd.11.smithi138.stdout:Sep 10 22:40:31 smithi138 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-11[60796]: 2024-09-10T22:40:31.681+0000 7ffb00998640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-10T22:38:51.541208+0000 front 2024-09-10T22:38:51.541072+0000 (oldest deadline 2024-09-10T22:39:25.843622+0000) 2024-09-10T22:40:32.125 INFO:journalctl@ceph.osd.11.smithi138.stdout:Sep 10 22:40:31 smithi138 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-11[60796]: 2024-09-10T22:40:31.681+0000 7ffb00998640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2024-09-10T22:39:09.245148+0000 front 2024-09-10T22:39:09.245118+0000 (oldest deadline 2024-09-10T22:39:35.046015+0000) 2024-09-10T22:40:32.125 INFO:journalctl@ceph.osd.11.smithi138.stdout:Sep 10 22:40:31 smithi138 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-11[60796]: 2024-09-10T22:40:31.681+0000 7ffb00998640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.138:6804 osd.2 since back 2024-09-10T22:39:19.647426+0000 front 2024-09-10T22:39:19.647531+0000 (oldest deadline 2024-09-10T22:39:44.947487+0000) 2024-09-10T22:40:32.125 INFO:journalctl@ceph.osd.11.smithi138.stdout:Sep 10 22:40:31 smithi138 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-11[60796]: 2024-09-10T22:40:31.681+0000 7ffb00998640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.19:6814 osd.3 since back 2024-09-10T22:39:29.048508+0000 front 2024-09-10T22:39:29.048441+0000 (oldest deadline 2024-09-10T22:39:52.548620+0000) 2024-09-10T22:40:32.126 INFO:journalctl@ceph.osd.11.smithi138.stdout:Sep 10 22:40:31 smithi138 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-11[60796]: 2024-09-10T22:40:31.681+0000 7ffb00998640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.135:6812 osd.4 since back 2024-09-10T22:39:34.249759+0000 front 2024-09-10T22:39:34.249711+0000 (oldest deadline 2024-09-10T22:39:59.450249+0000) 2024-09-10T22:40:32.126 INFO:journalctl@ceph.osd.11.smithi138.stdout:Sep 10 22:40:31 smithi138 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-11[60796]: 2024-09-10T22:40:31.681+0000 7ffb00998640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.138:6812 osd.5 since back 2024-09-10T22:39:42.951295+0000 front 2024-09-10T22:39:42.951215+0000 (oldest deadline 2024-09-10T22:40:07.651229+0000) 2024-09-10T22:40:32.126 INFO:journalctl@ceph.osd.11.smithi138.stdout:Sep 10 22:40:31 smithi138 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-11[60796]: 2024-09-10T22:40:31.681+0000 7ffb00998640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.135:6820 osd.7 since back 2024-09-10T22:39:57.453740+0000 front 2024-09-10T22:39:57.453786+0000 (oldest deadline 2024-09-10T22:40:22.153604+0000) 2024-09-10T22:40:32.126 INFO:journalctl@ceph.osd.11.smithi138.stdout:Sep 10 22:40:31 smithi138 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-11[60796]: 2024-09-10T22:40:31.681+0000 7ffb00998640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.138:6820 osd.8 since back 2024-09-10T22:40:06.854292+0000 front 2024-09-10T22:40:06.854338+0000 (oldest deadline 2024-09-10T22:40:31.554388+0000) 2024-09-10T22:40:33.125 INFO:journalctl@ceph.osd.11.smithi138.stdout:Sep 10 22:40:32 smithi138 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-11[60796]: 2024-09-10T22:40:32.663+0000 7ffb00998640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-10T22:38:51.541208+0000 front 2024-09-10T22:38:51.541072+0000 (oldest deadline 2024-09-10T22:39:25.843622+0000) 2024-09-10T22:40:33.125 INFO:journalctl@ceph.osd.11.smithi138.stdout:Sep 10 22:40:32 smithi138 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-11[60796]: 2024-09-10T22:40:32.663+0000 7ffb00998640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.135:6804 osd.1 since back 2024-09-10T22:39:09.245148+0000 front 2024-09-10T22:39:09.245118+0000 (oldest deadline 2024-09-10T22:39:35.046015+0000) 2024-09-10T22:40:33.126 INFO:journalctl@ceph.osd.11.smithi138.stdout:Sep 10 22:40:32 smithi138 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-11[60796]: 2024-09-10T22:40:32.663+0000 7ffb00998640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.138:6804 osd.2 since back 2024-09-10T22:39:19.647426+0000 front 2024-09-10T22:39:19.647531+0000 (oldest deadline 2024-09-10T22:39:44.947487+0000) 2024-09-10T22:40:33.126 INFO:journalctl@ceph.osd.11.smithi138.stdout:Sep 10 22:40:32 smithi138 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-11[60796]: 2024-09-10T22:40:32.663+0000 7ffb00998640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.19:6814 osd.3 since back 2024-09-10T22:39:29.048508+0000 front 2024-09-10T22:39:29.048441+0000 (oldest deadline 2024-09-10T22:39:52.548620+0000) 2024-09-10T22:40:33.126 INFO:journalctl@ceph.osd.11.smithi138.stdout:Sep 10 22:40:32 smithi138 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-11[60796]: 2024-09-10T22:40:32.663+0000 7ffb00998640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.135:6812 osd.4 since back 2024-09-10T22:39:34.249759+0000 front 2024-09-10T22:39:34.249711+0000 (oldest deadline 2024-09-10T22:39:59.450249+0000) 2024-09-10T22:40:33.126 INFO:journalctl@ceph.osd.11.smithi138.stdout:Sep 10 22:40:32 smithi138 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-11[60796]: 2024-09-10T22:40:32.663+0000 7ffb00998640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.138:6812 osd.5 since back 2024-09-10T22:39:42.951295+0000 front 2024-09-10T22:39:42.951215+0000 (oldest deadline 2024-09-10T22:40:07.651229+0000) 2024-09-10T22:40:33.126 INFO:journalctl@ceph.osd.11.smithi138.stdout:Sep 10 22:40:32 smithi138 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-11[60796]: 2024-09-10T22:40:32.663+0000 7ffb00998640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.135:6820 osd.7 since back 2024-09-10T22:39:57.453740+0000 front 2024-09-10T22:39:57.453786+0000 (oldest deadline 2024-09-10T22:40:22.153604+0000) 2024-09-10T22:40:33.126 INFO:journalctl@ceph.osd.11.smithi138.stdout:Sep 10 22:40:32 smithi138 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-11[60796]: 2024-09-10T22:40:32.663+0000 7ffb00998640 -1 osd.11 80 heartbeat_check: no reply from 172.21.15.138:6820 osd.8 since back 2024-09-10T22:40:06.854292+0000 front 2024-09-10T22:40:06.854338+0000 (oldest deadline 2024-09-10T22:40:31.554388+0000) 2024-09-10T22:40:33.582 INFO:journalctl@ceph.osd.11.smithi138.stdout:Sep 10 22:40:33 smithi138 podman[71658]: 2024-09-10 22:40:33.313391856 +0000 UTC m=+5.714851114 container died e8513dea88113bbba45c7ec5e97a9168d9988ef5e3f74b70bbe4f7a94884cf28 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-11, org.label-schema.license=GPLv2, ceph=True, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-10T22:40:33.875 INFO:journalctl@ceph.osd.11.smithi138.stdout:Sep 10 22:40:33 smithi138 podman[71658]: 2024-09-10 22:40:33.655520704 +0000 UTC m=+6.056980003 container cleanup e8513dea88113bbba45c7ec5e97a9168d9988ef5e3f74b70bbe4f7a94884cf28 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-11, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, io.buildah.version=1.37.2, ceph=True, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_CLEAN=True) 2024-09-10T22:40:33.875 INFO:journalctl@ceph.osd.11.smithi138.stdout:Sep 10 22:40:33 smithi138 bash[71658]: ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-11 2024-09-10T22:40:33.875 INFO:journalctl@ceph.osd.11.smithi138.stdout:Sep 10 22:40:33 smithi138 podman[71673]: 2024-09-10 22:40:33.814849917 +0000 UTC m=+0.495479144 container remove e8513dea88113bbba45c7ec5e97a9168d9988ef5e3f74b70bbe4f7a94884cf28 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-11, org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-10T22:40:34.471 INFO:journalctl@ceph.osd.11.smithi138.stdout:Sep 10 22:40:34 smithi138 podman[71762]: 2024-09-10 22:40:34.123352579 +0000 UTC m=+0.015979485 image pull 589dd18248e494ba411dc838aa4ae0e5e569213f08fcd7a2cf22cd3ef7e3c480 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e 2024-09-10T22:40:34.472 INFO:journalctl@ceph.osd.11.smithi138.stdout:Sep 10 22:40:34 smithi138 podman[71762]: 2024-09-10 22:40:34.232266362 +0000 UTC m=+0.124893261 container create b1ed061d53fcf43d8d1d9048e4c2c616b02610329bdbe076655a7138bc14e3e4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-11-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2) 2024-09-10T22:40:34.472 INFO:journalctl@ceph.osd.11.smithi138.stdout:Sep 10 22:40:34 smithi138 podman[71762]: 2024-09-10 22:40:34.467690247 +0000 UTC m=+0.360317147 container init b1ed061d53fcf43d8d1d9048e4c2c616b02610329bdbe076655a7138bc14e3e4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-11-deactivate, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, maintainer=Guillaume Abrioux ) 2024-09-10T22:40:34.472 INFO:journalctl@ceph.osd.11.smithi138.stdout:Sep 10 22:40:34 smithi138 podman[71762]: 2024-09-10 22:40:34.470954804 +0000 UTC m=+0.363581703 container start b1ed061d53fcf43d8d1d9048e4c2c616b02610329bdbe076655a7138bc14e3e4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-11-deactivate, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-10T22:40:34.875 INFO:journalctl@ceph.osd.11.smithi138.stdout:Sep 10 22:40:34 smithi138 podman[71762]: 2024-09-10 22:40:34.534314912 +0000 UTC m=+0.426941829 container attach b1ed061d53fcf43d8d1d9048e4c2c616b02610329bdbe076655a7138bc14e3e4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-11-deactivate, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-10T22:40:34.875 INFO:journalctl@ceph.osd.11.smithi138.stdout:Sep 10 22:40:34 smithi138 podman[71762]: 2024-09-10 22:40:34.660191752 +0000 UTC m=+0.552818651 container died b1ed061d53fcf43d8d1d9048e4c2c616b02610329bdbe076655a7138bc14e3e4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-osd-11-deactivate, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, ceph=True, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_CLEAN=True) 2024-09-10T22:40:35.265 DEBUG:teuthology.orchestra.run.smithi138:> sudo pkill -f 'journalctl -f -n 0 -u ceph-22997a4c-6fc2-11ef-bcea-c7b262605968@osd.11.service' 2024-09-10T22:40:35.302 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-10T22:40:35.303 INFO:tasks.cephadm.osd.11:Stopped osd.11 2024-09-10T22:40:35.303 INFO:tasks.cephadm.mds.a:Stopping mds.a... 2024-09-10T22:40:35.303 DEBUG:teuthology.orchestra.run.smithi019:> sudo systemctl stop ceph-22997a4c-6fc2-11ef-bcea-c7b262605968@mds.a 2024-09-10T22:40:35.626 INFO:journalctl@ceph.mds.a.smithi019.stdout:Sep 10 22:40:35 smithi019 systemd[1]: Stopping Ceph mds.a for 22997a4c-6fc2-11ef-bcea-c7b262605968... 2024-09-10T22:40:35.958 INFO:journalctl@ceph.mds.a.smithi019.stdout:Sep 10 22:40:35 smithi019 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-mds-a[74765]: 2024-09-10T22:40:35.624+0000 7f9d89d94640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-10T22:40:35.959 INFO:journalctl@ceph.mds.a.smithi019.stdout:Sep 10 22:40:35 smithi019 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-mds-a[74765]: 2024-09-10T22:40:35.624+0000 7f9d89d94640 -1 mds.a *** got signal Terminated *** 2024-09-10T22:40:38.093 INFO:journalctl@ceph.mds.a.smithi019.stdout:Sep 10 22:40:37 smithi019 podman[107174]: 2024-09-10 22:40:37.793906765 +0000 UTC m=+2.287137551 container died 16d7ea2bbef2bcdaee4f5156f3ca55de12c41c631fc2ee8754c4bdd81ac1b42b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-mds-a, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, ceph=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0) 2024-09-10T22:40:38.458 INFO:journalctl@ceph.mds.a.smithi019.stdout:Sep 10 22:40:38 smithi019 podman[107174]: 2024-09-10 22:40:38.286158789 +0000 UTC m=+2.779389498 container cleanup 16d7ea2bbef2bcdaee4f5156f3ca55de12c41c631fc2ee8754c4bdd81ac1b42b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-mds-a, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, ceph=True, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0) 2024-09-10T22:40:38.458 INFO:journalctl@ceph.mds.a.smithi019.stdout:Sep 10 22:40:38 smithi019 bash[107174]: ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-mds-a 2024-09-10T22:40:38.732 DEBUG:teuthology.orchestra.run.smithi019:> sudo pkill -f 'journalctl -f -n 0 -u ceph-22997a4c-6fc2-11ef-bcea-c7b262605968@mds.a.service' 2024-09-10T22:40:38.767 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-10T22:40:38.767 INFO:tasks.cephadm.mds.a:Stopped mds.a 2024-09-10T22:40:38.767 INFO:tasks.cephadm.mds.d:Stopping mds.d... 2024-09-10T22:40:38.768 DEBUG:teuthology.orchestra.run.smithi019:> sudo systemctl stop ceph-22997a4c-6fc2-11ef-bcea-c7b262605968@mds.d 2024-09-10T22:40:39.098 INFO:journalctl@ceph.mds.d.smithi019.stdout:Sep 10 22:40:38 smithi019 systemd[1]: Stopping Ceph mds.d for 22997a4c-6fc2-11ef-bcea-c7b262605968... 2024-09-10T22:40:39.458 INFO:journalctl@ceph.mds.d.smithi019.stdout:Sep 10 22:40:39 smithi019 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-mds-d[73574]: 2024-09-10T22:40:39.096+0000 7fa3ab462640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.d -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-10T22:40:39.459 INFO:journalctl@ceph.mds.d.smithi019.stdout:Sep 10 22:40:39 smithi019 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-mds-d[73574]: 2024-09-10T22:40:39.096+0000 7fa3ab462640 -1 mds.d *** got signal Terminated *** 2024-09-10T22:40:43.208 INFO:journalctl@ceph.mds.d.smithi019.stdout:Sep 10 22:40:42 smithi019 podman[107296]: 2024-09-10 22:40:42.935864045 +0000 UTC m=+3.945819075 container died 9c8759d92dcf04bc47d495f4980bc609dc584f7d9c3046971f57961ac6347ce3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-mds-d, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4) 2024-09-10T22:40:43.563 INFO:journalctl@ceph.mds.d.smithi019.stdout:Sep 10 22:40:43 smithi019 podman[107296]: 2024-09-10 22:40:43.37824718 +0000 UTC m=+4.388202210 container cleanup 9c8759d92dcf04bc47d495f4980bc609dc584f7d9c3046971f57961ac6347ce3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-mds-d, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.license=GPLv2, ceph=True, org.label-schema.vendor=CentOS) 2024-09-10T22:40:43.564 INFO:journalctl@ceph.mds.d.smithi019.stdout:Sep 10 22:40:43 smithi019 bash[107296]: ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-mds-d 2024-09-10T22:40:43.799 DEBUG:teuthology.orchestra.run.smithi019:> sudo pkill -f 'journalctl -f -n 0 -u ceph-22997a4c-6fc2-11ef-bcea-c7b262605968@mds.d.service' 2024-09-10T22:40:43.821 INFO:journalctl@ceph.mds.d.smithi019.stdout:Sep 10 22:40:43 smithi019 podman[107309]: 2024-09-10 22:40:43.563026252 +0000 UTC m=+0.624107539 container remove 9c8759d92dcf04bc47d495f4980bc609dc584f7d9c3046971f57961ac6347ce3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-mds-d, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, io.buildah.version=1.37.2, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux ) 2024-09-10T22:40:43.821 INFO:journalctl@ceph.mds.d.smithi019.stdout:Sep 10 22:40:43 smithi019 systemd[1]: ceph-22997a4c-6fc2-11ef-bcea-c7b262605968@mds.d.service: Deactivated successfully. 2024-09-10T22:40:43.821 INFO:journalctl@ceph.mds.d.smithi019.stdout:Sep 10 22:40:43 smithi019 systemd[1]: Stopped Ceph mds.d for 22997a4c-6fc2-11ef-bcea-c7b262605968. 2024-09-10T22:40:43.821 INFO:journalctl@ceph.mds.d.smithi019.stdout:Sep 10 22:40:43 smithi019 systemd[1]: ceph-22997a4c-6fc2-11ef-bcea-c7b262605968@mds.d.service: Consumed 1.091s CPU time. 2024-09-10T22:40:43.832 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-10T22:40:43.832 INFO:tasks.cephadm.mds.d:Stopped mds.d 2024-09-10T22:40:43.832 INFO:tasks.cephadm.mds.g:Stopping mds.g... 2024-09-10T22:40:43.833 DEBUG:teuthology.orchestra.run.smithi019:> sudo systemctl stop ceph-22997a4c-6fc2-11ef-bcea-c7b262605968@mds.g 2024-09-10T22:40:44.175 INFO:journalctl@ceph.mds.g.smithi019.stdout:Sep 10 22:40:43 smithi019 systemd[1]: Stopping Ceph mds.g for 22997a4c-6fc2-11ef-bcea-c7b262605968... 2024-09-10T22:40:44.458 INFO:journalctl@ceph.mds.g.smithi019.stdout:Sep 10 22:40:44 smithi019 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-mds-g[74349]: 2024-09-10T22:40:44.173+0000 7fa229823640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.g -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-10T22:40:44.458 INFO:journalctl@ceph.mds.g.smithi019.stdout:Sep 10 22:40:44 smithi019 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-mds-g[74349]: 2024-09-10T22:40:44.173+0000 7fa229823640 -1 mds.g *** got signal Terminated *** 2024-09-10T22:40:46.783 INFO:journalctl@ceph.mds.g.smithi019.stdout:Sep 10 22:40:46 smithi019 podman[107417]: 2024-09-10 22:40:46.487280221 +0000 UTC m=+2.425235603 container died d78254ae03bc4af18c1d218b78558069cec3abf229bcddfa25115058bd5dfba7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-mds-g, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, maintainer=Guillaume Abrioux , ceph=True, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-10T22:40:47.134 INFO:journalctl@ceph.mds.g.smithi019.stdout:Sep 10 22:40:46 smithi019 podman[107417]: 2024-09-10 22:40:46.882069233 +0000 UTC m=+2.820024613 container cleanup d78254ae03bc4af18c1d218b78558069cec3abf229bcddfa25115058bd5dfba7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-mds-g, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_CLEAN=True) 2024-09-10T22:40:47.134 INFO:journalctl@ceph.mds.g.smithi019.stdout:Sep 10 22:40:46 smithi019 bash[107417]: ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-mds-g 2024-09-10T22:40:47.273 DEBUG:teuthology.orchestra.run.smithi019:> sudo pkill -f 'journalctl -f -n 0 -u ceph-22997a4c-6fc2-11ef-bcea-c7b262605968@mds.g.service' 2024-09-10T22:40:47.306 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-10T22:40:47.306 INFO:tasks.cephadm.mds.g:Stopped mds.g 2024-09-10T22:40:47.307 INFO:tasks.cephadm.mds.j:Stopping mds.j... 2024-09-10T22:40:47.307 DEBUG:teuthology.orchestra.run.smithi019:> sudo systemctl stop ceph-22997a4c-6fc2-11ef-bcea-c7b262605968@mds.j 2024-09-10T22:40:47.645 INFO:journalctl@ceph.mds.j.smithi019.stdout:Sep 10 22:40:47 smithi019 systemd[1]: Stopping Ceph mds.j for 22997a4c-6fc2-11ef-bcea-c7b262605968... 2024-09-10T22:40:47.958 INFO:journalctl@ceph.mds.j.smithi019.stdout:Sep 10 22:40:47 smithi019 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-mds-j[73175]: 2024-09-10T22:40:47.644+0000 7f48dd06c640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.j -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-10T22:40:47.958 INFO:journalctl@ceph.mds.j.smithi019.stdout:Sep 10 22:40:47 smithi019 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-mds-j[73175]: 2024-09-10T22:40:47.644+0000 7f48dd06c640 -1 mds.j *** got signal Terminated *** 2024-09-10T22:40:51.937 INFO:journalctl@ceph.mds.j.smithi019.stdout:Sep 10 22:40:51 smithi019 podman[107538]: 2024-09-10 22:40:51.618119185 +0000 UTC m=+4.086553934 container died 297f16ebdbc69c7a928584b855364d0269365ed719b4902bc9311f14fdf11004 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-mds-j, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, io.buildah.version=1.37.2, ceph=True) 2024-09-10T22:40:51.937 INFO:journalctl@ceph.mds.j.smithi019.stdout:Sep 10 22:40:51 smithi019 podman[107538]: 2024-09-10 22:40:51.935870844 +0000 UTC m=+4.404305579 container cleanup 297f16ebdbc69c7a928584b855364d0269365ed719b4902bc9311f14fdf11004 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-mds-j, org.label-schema.build-date=20240731, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_CLEAN=True, ceph=True, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2) 2024-09-10T22:40:52.208 INFO:journalctl@ceph.mds.j.smithi019.stdout:Sep 10 22:40:51 smithi019 bash[107538]: ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-mds-j 2024-09-10T22:40:52.208 INFO:journalctl@ceph.mds.j.smithi019.stdout:Sep 10 22:40:52 smithi019 podman[107550]: 2024-09-10 22:40:52.145282733 +0000 UTC m=+0.520622047 container remove 297f16ebdbc69c7a928584b855364d0269365ed719b4902bc9311f14fdf11004 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-mds-j, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, ceph=True, GIT_BRANCH=HEAD, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731) 2024-09-10T22:40:52.375 DEBUG:teuthology.orchestra.run.smithi019:> sudo pkill -f 'journalctl -f -n 0 -u ceph-22997a4c-6fc2-11ef-bcea-c7b262605968@mds.j.service' 2024-09-10T22:40:52.409 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-10T22:40:52.409 INFO:tasks.cephadm.mds.j:Stopped mds.j 2024-09-10T22:40:52.409 INFO:tasks.cephadm.mds.b:Stopping mds.b... 2024-09-10T22:40:52.409 DEBUG:teuthology.orchestra.run.smithi135:> sudo systemctl stop ceph-22997a4c-6fc2-11ef-bcea-c7b262605968@mds.b 2024-09-10T22:40:52.697 INFO:journalctl@ceph.mds.b.smithi135.stdout:Sep 10 22:40:52 smithi135 systemd[1]: Stopping Ceph mds.b for 22997a4c-6fc2-11ef-bcea-c7b262605968... 2024-09-10T22:40:52.955 INFO:journalctl@ceph.mds.b.smithi135.stdout:Sep 10 22:40:52 smithi135 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-mds-b[65179]: 2024-09-10T22:40:52.694+0000 7f3722865640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.b -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-10T22:40:52.955 INFO:journalctl@ceph.mds.b.smithi135.stdout:Sep 10 22:40:52 smithi135 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-mds-b[65179]: 2024-09-10T22:40:52.694+0000 7f3722865640 -1 mds.b *** got signal Terminated *** 2024-09-10T22:40:55.841 INFO:journalctl@ceph.mds.b.smithi135.stdout:Sep 10 22:40:55 smithi135 podman[70927]: 2024-09-10 22:40:55.497546018 +0000 UTC m=+2.899118066 container died 6fb2e6fcd715f519b8092a026d9591e37a7e6e3153a402fc52d06b1e98c36ba3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-mds-b, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, maintainer=Guillaume Abrioux , RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.license=GPLv2, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.build-date=20240731) 2024-09-10T22:40:56.110 INFO:journalctl@ceph.mds.b.smithi135.stdout:Sep 10 22:40:55 smithi135 podman[70927]: 2024-09-10 22:40:55.929074144 +0000 UTC m=+3.330646193 container cleanup 6fb2e6fcd715f519b8092a026d9591e37a7e6e3153a402fc52d06b1e98c36ba3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-mds-b, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, ceph=True) 2024-09-10T22:40:56.110 INFO:journalctl@ceph.mds.b.smithi135.stdout:Sep 10 22:40:55 smithi135 bash[70927]: ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-mds-b 2024-09-10T22:40:56.406 DEBUG:teuthology.orchestra.run.smithi135:> sudo pkill -f 'journalctl -f -n 0 -u ceph-22997a4c-6fc2-11ef-bcea-c7b262605968@mds.b.service' 2024-09-10T22:40:56.429 INFO:journalctl@ceph.mds.b.smithi135.stdout:Sep 10 22:40:56 smithi135 podman[70951]: 2024-09-10 22:40:56.163642467 +0000 UTC m=+0.662774774 container remove 6fb2e6fcd715f519b8092a026d9591e37a7e6e3153a402fc52d06b1e98c36ba3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-mds-b, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_CLEAN=True, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux ) 2024-09-10T22:40:56.429 INFO:journalctl@ceph.mds.b.smithi135.stdout:Sep 10 22:40:56 smithi135 systemd[1]: ceph-22997a4c-6fc2-11ef-bcea-c7b262605968@mds.b.service: Deactivated successfully. 2024-09-10T22:40:56.429 INFO:journalctl@ceph.mds.b.smithi135.stdout:Sep 10 22:40:56 smithi135 systemd[1]: Stopped Ceph mds.b for 22997a4c-6fc2-11ef-bcea-c7b262605968. 2024-09-10T22:40:56.429 INFO:journalctl@ceph.mds.b.smithi135.stdout:Sep 10 22:40:56 smithi135 systemd[1]: ceph-22997a4c-6fc2-11ef-bcea-c7b262605968@mds.b.service: Consumed 4min 15.523s CPU time. 2024-09-10T22:40:56.442 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-10T22:40:56.442 INFO:tasks.cephadm.mds.b:Stopped mds.b 2024-09-10T22:40:56.442 INFO:tasks.cephadm.mds.e:Stopping mds.e... 2024-09-10T22:40:56.443 DEBUG:teuthology.orchestra.run.smithi135:> sudo systemctl stop ceph-22997a4c-6fc2-11ef-bcea-c7b262605968@mds.e 2024-09-10T22:40:56.759 INFO:journalctl@ceph.mds.e.smithi135.stdout:Sep 10 22:40:56 smithi135 systemd[1]: Stopping Ceph mds.e for 22997a4c-6fc2-11ef-bcea-c7b262605968... 2024-09-10T22:40:57.110 INFO:journalctl@ceph.mds.e.smithi135.stdout:Sep 10 22:40:56 smithi135 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-mds-e[64580]: 2024-09-10T22:40:56.757+0000 7f8e8892f640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.e -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-10T22:40:57.110 INFO:journalctl@ceph.mds.e.smithi135.stdout:Sep 10 22:40:56 smithi135 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-mds-e[64580]: 2024-09-10T22:40:56.757+0000 7f8e8892f640 -1 mds.e *** got signal Terminated *** 2024-09-10T22:40:59.770 INFO:journalctl@ceph.mds.e.smithi135.stdout:Sep 10 22:40:59 smithi135 podman[71059]: 2024-09-10 22:40:59.503695512 +0000 UTC m=+2.835077399 container died 2fa618a33836e72a3c849e36dd849a14ca74d5ca573b90288f95cdcf4bf09251 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-mds-e, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD) 2024-09-10T22:41:00.110 INFO:journalctl@ceph.mds.e.smithi135.stdout:Sep 10 22:40:59 smithi135 podman[71059]: 2024-09-10 22:40:59.865703849 +0000 UTC m=+3.197085736 container cleanup 2fa618a33836e72a3c849e36dd849a14ca74d5ca573b90288f95cdcf4bf09251 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-mds-e, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.license=GPLv2, GIT_CLEAN=True, maintainer=Guillaume Abrioux ) 2024-09-10T22:41:00.110 INFO:journalctl@ceph.mds.e.smithi135.stdout:Sep 10 22:40:59 smithi135 bash[71059]: ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-mds-e 2024-09-10T22:41:00.276 DEBUG:teuthology.orchestra.run.smithi135:> sudo pkill -f 'journalctl -f -n 0 -u ceph-22997a4c-6fc2-11ef-bcea-c7b262605968@mds.e.service' 2024-09-10T22:41:00.310 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-10T22:41:00.311 INFO:tasks.cephadm.mds.e:Stopped mds.e 2024-09-10T22:41:00.311 INFO:tasks.cephadm.mds.h:Stopping mds.h... 2024-09-10T22:41:00.311 DEBUG:teuthology.orchestra.run.smithi135:> sudo systemctl stop ceph-22997a4c-6fc2-11ef-bcea-c7b262605968@mds.h 2024-09-10T22:41:00.860 INFO:journalctl@ceph.mds.h.smithi135.stdout:Sep 10 22:41:00 smithi135 systemd[1]: Stopping Ceph mds.h for 22997a4c-6fc2-11ef-bcea-c7b262605968... 2024-09-10T22:41:00.860 INFO:journalctl@ceph.mds.h.smithi135.stdout:Sep 10 22:41:00 smithi135 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-mds-h[64881]: 2024-09-10T22:41:00.619+0000 7f17ae74d640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.h -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-10T22:41:00.860 INFO:journalctl@ceph.mds.h.smithi135.stdout:Sep 10 22:41:00 smithi135 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-mds-h[64881]: 2024-09-10T22:41:00.619+0000 7f17ae74d640 -1 mds.h *** got signal Terminated *** 2024-09-10T22:41:03.762 INFO:journalctl@ceph.mds.h.smithi135.stdout:Sep 10 22:41:03 smithi135 podman[71180]: 2024-09-10 22:41:03.496249804 +0000 UTC m=+2.968183168 container died ce1d853e4315b4cece522a3010a9ff3c6ff0036f53741feb724a8e4d2d0de7c6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-mds-h, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, ceph=True, maintainer=Guillaume Abrioux , GIT_CLEAN=True, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=) 2024-09-10T22:41:04.104 INFO:journalctl@ceph.mds.h.smithi135.stdout:Sep 10 22:41:03 smithi135 podman[71180]: 2024-09-10 22:41:03.894479962 +0000 UTC m=+3.366413324 container cleanup ce1d853e4315b4cece522a3010a9ff3c6ff0036f53741feb724a8e4d2d0de7c6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-mds-h, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2) 2024-09-10T22:41:04.104 INFO:journalctl@ceph.mds.h.smithi135.stdout:Sep 10 22:41:03 smithi135 bash[71180]: ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-mds-h 2024-09-10T22:41:04.230 DEBUG:teuthology.orchestra.run.smithi135:> sudo pkill -f 'journalctl -f -n 0 -u ceph-22997a4c-6fc2-11ef-bcea-c7b262605968@mds.h.service' 2024-09-10T22:41:04.263 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-10T22:41:04.263 INFO:tasks.cephadm.mds.h:Stopped mds.h 2024-09-10T22:41:04.264 INFO:tasks.cephadm.mds.k:Stopping mds.k... 2024-09-10T22:41:04.264 DEBUG:teuthology.orchestra.run.smithi135:> sudo systemctl stop ceph-22997a4c-6fc2-11ef-bcea-c7b262605968@mds.k 2024-09-10T22:41:04.359 INFO:journalctl@ceph.mds.k.smithi135.stdout:Sep 10 22:41:04 smithi135 systemd[1]: Stopping Ceph mds.k for 22997a4c-6fc2-11ef-bcea-c7b262605968... 2024-09-10T22:41:04.859 INFO:journalctl@ceph.mds.k.smithi135.stdout:Sep 10 22:41:04 smithi135 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-mds-k[64266]: 2024-09-10T22:41:04.580+0000 7f0fea80d640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.k -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-10T22:41:04.860 INFO:journalctl@ceph.mds.k.smithi135.stdout:Sep 10 22:41:04 smithi135 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-mds-k[64266]: 2024-09-10T22:41:04.580+0000 7f0fea80d640 -1 mds.k *** got signal Terminated *** 2024-09-10T22:41:08.775 INFO:journalctl@ceph.mds.k.smithi135.stdout:Sep 10 22:41:08 smithi135 podman[71300]: 2024-09-10 22:41:08.487840133 +0000 UTC m=+4.005486515 container died 3acd4fb17fd4a2d2fddb22ed7ba5a866c4ba3a3650e4d4249eeb67537582b17e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-mds-k, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_CLEAN=True, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True) 2024-09-10T22:41:09.099 INFO:journalctl@ceph.mds.k.smithi135.stdout:Sep 10 22:41:08 smithi135 podman[71300]: 2024-09-10 22:41:08.847606215 +0000 UTC m=+4.365252591 container cleanup 3acd4fb17fd4a2d2fddb22ed7ba5a866c4ba3a3650e4d4249eeb67537582b17e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-mds-k, ceph=True, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-10T22:41:09.099 INFO:journalctl@ceph.mds.k.smithi135.stdout:Sep 10 22:41:08 smithi135 bash[71300]: ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-mds-k 2024-09-10T22:41:09.228 DEBUG:teuthology.orchestra.run.smithi135:> sudo pkill -f 'journalctl -f -n 0 -u ceph-22997a4c-6fc2-11ef-bcea-c7b262605968@mds.k.service' 2024-09-10T22:41:09.261 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-10T22:41:09.261 INFO:tasks.cephadm.mds.k:Stopped mds.k 2024-09-10T22:41:09.261 INFO:tasks.cephadm.mds.c:Stopping mds.c... 2024-09-10T22:41:09.261 DEBUG:teuthology.orchestra.run.smithi138:> sudo systemctl stop ceph-22997a4c-6fc2-11ef-bcea-c7b262605968@mds.c 2024-09-10T22:41:09.604 INFO:journalctl@ceph.mds.c.smithi138.stdout:Sep 10 22:41:09 smithi138 systemd[1]: Stopping Ceph mds.c for 22997a4c-6fc2-11ef-bcea-c7b262605968... 2024-09-10T22:41:09.875 INFO:journalctl@ceph.mds.c.smithi138.stdout:Sep 10 22:41:09 smithi138 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-mds-c[66160]: 2024-09-10T22:41:09.601+0000 7fab052cb640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.c -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-10T22:41:09.875 INFO:journalctl@ceph.mds.c.smithi138.stdout:Sep 10 22:41:09 smithi138 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-mds-c[66160]: 2024-09-10T22:41:09.601+0000 7fab052cb640 -1 mds.c *** got signal Terminated *** 2024-09-10T22:41:11.780 INFO:journalctl@ceph.mds.c.smithi138.stdout:Sep 10 22:41:11 smithi138 podman[71865]: 2024-09-10 22:41:11.501291092 +0000 UTC m=+2.045002580 container died 74c18554cfd29bead63d158d7bf711e1f0c46ff5655db0fed3b5dee4583c553e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-mds-c, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2) 2024-09-10T22:41:12.125 INFO:journalctl@ceph.mds.c.smithi138.stdout:Sep 10 22:41:11 smithi138 podman[71865]: 2024-09-10 22:41:11.886883085 +0000 UTC m=+2.430594573 container cleanup 74c18554cfd29bead63d158d7bf711e1f0c46ff5655db0fed3b5dee4583c553e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-mds-c, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, ceph=True, GIT_CLEAN=True, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS) 2024-09-10T22:41:12.125 INFO:journalctl@ceph.mds.c.smithi138.stdout:Sep 10 22:41:11 smithi138 bash[71865]: ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-mds-c 2024-09-10T22:41:12.308 DEBUG:teuthology.orchestra.run.smithi138:> sudo pkill -f 'journalctl -f -n 0 -u ceph-22997a4c-6fc2-11ef-bcea-c7b262605968@mds.c.service' 2024-09-10T22:41:12.343 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-10T22:41:12.344 INFO:tasks.cephadm.mds.c:Stopped mds.c 2024-09-10T22:41:12.344 INFO:tasks.cephadm.mds.f:Stopping mds.f... 2024-09-10T22:41:12.344 DEBUG:teuthology.orchestra.run.smithi138:> sudo systemctl stop ceph-22997a4c-6fc2-11ef-bcea-c7b262605968@mds.f 2024-09-10T22:41:12.659 INFO:journalctl@ceph.mds.f.smithi138.stdout:Sep 10 22:41:12 smithi138 systemd[1]: Stopping Ceph mds.f for 22997a4c-6fc2-11ef-bcea-c7b262605968... 2024-09-10T22:41:13.125 INFO:journalctl@ceph.mds.f.smithi138.stdout:Sep 10 22:41:12 smithi138 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-mds-f[65862]: 2024-09-10T22:41:12.657+0000 7f702a2d5640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.f -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-10T22:41:13.125 INFO:journalctl@ceph.mds.f.smithi138.stdout:Sep 10 22:41:12 smithi138 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-mds-f[65862]: 2024-09-10T22:41:12.657+0000 7f702a2d5640 -1 mds.f *** got signal Terminated *** 2024-09-10T22:41:15.784 INFO:journalctl@ceph.mds.f.smithi138.stdout:Sep 10 22:41:15 smithi138 podman[71997]: 2024-09-10 22:41:15.485960205 +0000 UTC m=+2.919141314 container died e5b74373683a3c9ada1d04982e032c1c57024e5bd13be727a5676ea26ee29fe6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-mds-f, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.build-date=20240731, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4) 2024-09-10T22:41:16.125 INFO:journalctl@ceph.mds.f.smithi138.stdout:Sep 10 22:41:15 smithi138 podman[71997]: 2024-09-10 22:41:15.857291022 +0000 UTC m=+3.290472135 container cleanup e5b74373683a3c9ada1d04982e032c1c57024e5bd13be727a5676ea26ee29fe6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-mds-f, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, io.buildah.version=1.37.2) 2024-09-10T22:41:16.125 INFO:journalctl@ceph.mds.f.smithi138.stdout:Sep 10 22:41:15 smithi138 bash[71997]: ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-mds-f 2024-09-10T22:41:16.280 DEBUG:teuthology.orchestra.run.smithi138:> sudo pkill -f 'journalctl -f -n 0 -u ceph-22997a4c-6fc2-11ef-bcea-c7b262605968@mds.f.service' 2024-09-10T22:41:16.314 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-10T22:41:16.315 INFO:tasks.cephadm.mds.f:Stopped mds.f 2024-09-10T22:41:16.315 INFO:tasks.cephadm.mds.i:Stopping mds.i... 2024-09-10T22:41:16.315 DEBUG:teuthology.orchestra.run.smithi138:> sudo systemctl stop ceph-22997a4c-6fc2-11ef-bcea-c7b262605968@mds.i 2024-09-10T22:41:16.653 INFO:journalctl@ceph.mds.i.smithi138.stdout:Sep 10 22:41:16 smithi138 systemd[1]: Stopping Ceph mds.i for 22997a4c-6fc2-11ef-bcea-c7b262605968... 2024-09-10T22:41:17.125 INFO:journalctl@ceph.mds.i.smithi138.stdout:Sep 10 22:41:16 smithi138 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-mds-i[66461]: 2024-09-10T22:41:16.652+0000 7fcd036fd640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.i -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-10T22:41:17.125 INFO:journalctl@ceph.mds.i.smithi138.stdout:Sep 10 22:41:16 smithi138 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-mds-i[66461]: 2024-09-10T22:41:16.652+0000 7fcd036fd640 -1 mds.i *** got signal Terminated *** 2024-09-10T22:41:19.875 INFO:journalctl@ceph.mds.i.smithi138.stdout:Sep 10 22:41:19 smithi138 podman[72119]: 2024-09-10 22:41:19.498027059 +0000 UTC m=+2.968942684 container died 5bf363fdcbbad4ecb90c5732349d78d8ebb391ec054eedc7c5ab0791df8af65d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-mds-i, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.schema-version=1.0, ceph=True, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS) 2024-09-10T22:41:20.171 INFO:journalctl@ceph.mds.i.smithi138.stdout:Sep 10 22:41:19 smithi138 podman[72119]: 2024-09-10 22:41:19.969097096 +0000 UTC m=+3.440012710 container cleanup 5bf363fdcbbad4ecb90c5732349d78d8ebb391ec054eedc7c5ab0791df8af65d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-mds-i, org.label-schema.build-date=20240731, ceph=True, org.label-schema.license=GPLv2, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.schema-version=1.0) 2024-09-10T22:41:20.171 INFO:journalctl@ceph.mds.i.smithi138.stdout:Sep 10 22:41:19 smithi138 bash[72119]: ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-mds-i 2024-09-10T22:41:20.404 DEBUG:teuthology.orchestra.run.smithi138:> sudo pkill -f 'journalctl -f -n 0 -u ceph-22997a4c-6fc2-11ef-bcea-c7b262605968@mds.i.service' 2024-09-10T22:41:20.426 INFO:journalctl@ceph.mds.i.smithi138.stdout:Sep 10 22:41:20 smithi138 podman[72132]: 2024-09-10 22:41:20.170167832 +0000 UTC m=+0.627350485 container remove 5bf363fdcbbad4ecb90c5732349d78d8ebb391ec054eedc7c5ab0791df8af65d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-mds-i, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, GIT_CLEAN=True, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=) 2024-09-10T22:41:20.426 INFO:journalctl@ceph.mds.i.smithi138.stdout:Sep 10 22:41:20 smithi138 systemd[1]: ceph-22997a4c-6fc2-11ef-bcea-c7b262605968@mds.i.service: Deactivated successfully. 2024-09-10T22:41:20.427 INFO:journalctl@ceph.mds.i.smithi138.stdout:Sep 10 22:41:20 smithi138 systemd[1]: Stopped Ceph mds.i for 22997a4c-6fc2-11ef-bcea-c7b262605968. 2024-09-10T22:41:20.427 INFO:journalctl@ceph.mds.i.smithi138.stdout:Sep 10 22:41:20 smithi138 systemd[1]: ceph-22997a4c-6fc2-11ef-bcea-c7b262605968@mds.i.service: Consumed 2.080s CPU time. 2024-09-10T22:41:20.438 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-10T22:41:20.438 INFO:tasks.cephadm.mds.i:Stopped mds.i 2024-09-10T22:41:20.438 INFO:tasks.cephadm.mds.l:Stopping mds.l... 2024-09-10T22:41:20.438 DEBUG:teuthology.orchestra.run.smithi138:> sudo systemctl stop ceph-22997a4c-6fc2-11ef-bcea-c7b262605968@mds.l 2024-09-10T22:41:20.765 INFO:journalctl@ceph.mds.l.smithi138.stdout:Sep 10 22:41:20 smithi138 systemd[1]: Stopping Ceph mds.l for 22997a4c-6fc2-11ef-bcea-c7b262605968... 2024-09-10T22:41:21.125 INFO:journalctl@ceph.mds.l.smithi138.stdout:Sep 10 22:41:20 smithi138 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-mds-l[65557]: 2024-09-10T22:41:20.764+0000 7fbf50146640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.l -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-10T22:41:21.125 INFO:journalctl@ceph.mds.l.smithi138.stdout:Sep 10 22:41:20 smithi138 ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-mds-l[65557]: 2024-09-10T22:41:20.764+0000 7fbf50146640 -1 mds.l *** got signal Terminated *** 2024-09-10T22:41:22.241 INFO:journalctl@ceph.mds.l.smithi138.stdout:Sep 10 22:41:21 smithi138 podman[72242]: 2024-09-10 22:41:21.959272357 +0000 UTC m=+1.303887370 container died 1308ae046e9e42e9fc9101c8915a368b8430c402ef194509cd58599522daa23d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-mds-l, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0) 2024-09-10T22:41:22.541 INFO:journalctl@ceph.mds.l.smithi138.stdout:Sep 10 22:41:22 smithi138 podman[72242]: 2024-09-10 22:41:22.339889343 +0000 UTC m=+1.684504343 container cleanup 1308ae046e9e42e9fc9101c8915a368b8430c402ef194509cd58599522daa23d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-mds-l, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, CEPH_POINT_RELEASE=) 2024-09-10T22:41:22.542 INFO:journalctl@ceph.mds.l.smithi138.stdout:Sep 10 22:41:22 smithi138 bash[72242]: ceph-22997a4c-6fc2-11ef-bcea-c7b262605968-mds-l 2024-09-10T22:41:22.663 DEBUG:teuthology.orchestra.run.smithi138:> sudo pkill -f 'journalctl -f -n 0 -u ceph-22997a4c-6fc2-11ef-bcea-c7b262605968@mds.l.service' 2024-09-10T22:41:22.695 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-10T22:41:22.695 INFO:tasks.cephadm.mds.l:Stopped mds.l 2024-09-10T22:41:22.695 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 22997a4c-6fc2-11ef-bcea-c7b262605968 --force --keep-logs 2024-09-10T22:41:22.908 INFO:teuthology.orchestra.run.smithi019.stdout:Deleting cluster with fsid: 22997a4c-6fc2-11ef-bcea-c7b262605968 2024-09-10T22:41:25.468 DEBUG:teuthology.orchestra.run.smithi135:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 22997a4c-6fc2-11ef-bcea-c7b262605968 --force --keep-logs 2024-09-10T22:41:25.670 INFO:teuthology.orchestra.run.smithi135.stdout:Deleting cluster with fsid: 22997a4c-6fc2-11ef-bcea-c7b262605968 2024-09-10T22:41:28.179 DEBUG:teuthology.orchestra.run.smithi138:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 22997a4c-6fc2-11ef-bcea-c7b262605968 --force --keep-logs 2024-09-10T22:41:28.381 INFO:teuthology.orchestra.run.smithi138.stdout:Deleting cluster with fsid: 22997a4c-6fc2-11ef-bcea-c7b262605968 2024-09-10T22:41:30.734 DEBUG:teuthology.orchestra.run.smithi019:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-10T22:41:30.769 DEBUG:teuthology.orchestra.run.smithi135:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-10T22:41:30.801 DEBUG:teuthology.orchestra.run.smithi138:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-10T22:41:30.828 INFO:tasks.cephadm:Archiving crash dumps... 2024-09-10T22:41:30.829 DEBUG:teuthology.misc:Transferring archived files from smithi019:/var/lib/ceph/22997a4c-6fc2-11ef-bcea-c7b262605968/crash to /home/teuthworker/archive/hyelloji-2024-09-10_16:59:47-fs-wip-hemanth-testing-2024-09-10-0723-testing-default-smithi/7899721/remote/smithi019/crash 2024-09-10T22:41:30.830 DEBUG:teuthology.orchestra.run.smithi019:> sudo tar c -f - -C /var/lib/ceph/22997a4c-6fc2-11ef-bcea-c7b262605968/crash -- . 2024-09-10T22:41:30.860 INFO:teuthology.orchestra.run.smithi019.stderr:tar: /var/lib/ceph/22997a4c-6fc2-11ef-bcea-c7b262605968/crash: Cannot open: No such file or directory 2024-09-10T22:41:30.860 INFO:teuthology.orchestra.run.smithi019.stderr:tar: Error is not recoverable: exiting now 2024-09-10T22:41:30.862 DEBUG:teuthology.misc:Transferring archived files from smithi135:/var/lib/ceph/22997a4c-6fc2-11ef-bcea-c7b262605968/crash to /home/teuthworker/archive/hyelloji-2024-09-10_16:59:47-fs-wip-hemanth-testing-2024-09-10-0723-testing-default-smithi/7899721/remote/smithi135/crash 2024-09-10T22:41:30.863 DEBUG:teuthology.orchestra.run.smithi135:> sudo tar c -f - -C /var/lib/ceph/22997a4c-6fc2-11ef-bcea-c7b262605968/crash -- . 2024-09-10T22:41:30.907 INFO:teuthology.orchestra.run.smithi135.stderr:tar: /var/lib/ceph/22997a4c-6fc2-11ef-bcea-c7b262605968/crash: Cannot open: No such file or directory 2024-09-10T22:41:30.907 INFO:teuthology.orchestra.run.smithi135.stderr:tar: Error is not recoverable: exiting now 2024-09-10T22:41:30.909 DEBUG:teuthology.misc:Transferring archived files from smithi138:/var/lib/ceph/22997a4c-6fc2-11ef-bcea-c7b262605968/crash to /home/teuthworker/archive/hyelloji-2024-09-10_16:59:47-fs-wip-hemanth-testing-2024-09-10-0723-testing-default-smithi/7899721/remote/smithi138/crash 2024-09-10T22:41:30.910 DEBUG:teuthology.orchestra.run.smithi138:> sudo tar c -f - -C /var/lib/ceph/22997a4c-6fc2-11ef-bcea-c7b262605968/crash -- . 2024-09-10T22:41:30.944 INFO:teuthology.orchestra.run.smithi138.stderr:tar: /var/lib/ceph/22997a4c-6fc2-11ef-bcea-c7b262605968/crash: Cannot open: No such file or directory 2024-09-10T22:41:30.944 INFO:teuthology.orchestra.run.smithi138.stderr:tar: Error is not recoverable: exiting now 2024-09-10T22:41:30.945 INFO:tasks.cephadm:Checking cluster log for badness... 2024-09-10T22:41:30.946 DEBUG:teuthology.orchestra.run.smithi019:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/22997a4c-6fc2-11ef-bcea-c7b262605968/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v FS_DEGRADED | egrep -v 'fs.*is degraded' | egrep -v 'filesystem is degraded' | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v 'filesystem is offline' | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v 'insufficient standby MDS daemons available' | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v 'online, but wants' | egrep -v 'filesystem is online with fewer MDS than max_mds' | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'do not have an application enabled' | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'deprecated feature inline_data' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v PG_AVAILABILITY | egrep -v PG_DEGRADED | egrep -v 'Reduced data availability' | egrep -v 'Degraded data redundancy' | egrep -v 'slow metadata IO' | egrep -v SLOW_OPS | egrep -v 'slow request' | head -n 1 2024-09-10T22:41:30.993 INFO:teuthology.orchestra.run.smithi019.stdout:2024-09-10T22:38:24.706668+0000 mon.a (mon.0) 1236 : cluster [WRN] Health check failed: 1 OSD(s) experiencing slow operations in BlueStore (BLUESTORE_SLOW_OP_ALERT) 2024-09-10T22:41:30.993 WARNING:tasks.cephadm:Found errors (ERR|WRN|SEC) in cluster log 2024-09-10T22:41:30.993 DEBUG:teuthology.orchestra.run.smithi019:> sudo egrep '\[SEC\]' /var/log/ceph/22997a4c-6fc2-11ef-bcea-c7b262605968/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v FS_DEGRADED | egrep -v 'fs.*is degraded' | egrep -v 'filesystem is degraded' | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v 'filesystem is offline' | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v 'insufficient standby MDS daemons available' | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v 'online, but wants' | egrep -v 'filesystem is online with fewer MDS than max_mds' | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'do not have an application enabled' | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'deprecated feature inline_data' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v PG_AVAILABILITY | egrep -v PG_DEGRADED | egrep -v 'Reduced data availability' | egrep -v 'Degraded data redundancy' | egrep -v 'slow metadata IO' | egrep -v SLOW_OPS | egrep -v 'slow request' | head -n 1 2024-09-10T22:41:31.033 DEBUG:teuthology.orchestra.run.smithi019:> sudo egrep '\[ERR\]' /var/log/ceph/22997a4c-6fc2-11ef-bcea-c7b262605968/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v FS_DEGRADED | egrep -v 'fs.*is degraded' | egrep -v 'filesystem is degraded' | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v 'filesystem is offline' | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v 'insufficient standby MDS daemons available' | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v 'online, but wants' | egrep -v 'filesystem is online with fewer MDS than max_mds' | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'do not have an application enabled' | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'deprecated feature inline_data' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v PG_AVAILABILITY | egrep -v PG_DEGRADED | egrep -v 'Reduced data availability' | egrep -v 'Degraded data redundancy' | egrep -v 'slow metadata IO' | egrep -v SLOW_OPS | egrep -v 'slow request' | head -n 1 2024-09-10T22:41:31.113 DEBUG:teuthology.orchestra.run.smithi019:> sudo egrep '\[WRN\]' /var/log/ceph/22997a4c-6fc2-11ef-bcea-c7b262605968/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v FS_DEGRADED | egrep -v 'fs.*is degraded' | egrep -v 'filesystem is degraded' | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v 'filesystem is offline' | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v 'insufficient standby MDS daemons available' | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v 'online, but wants' | egrep -v 'filesystem is online with fewer MDS than max_mds' | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'do not have an application enabled' | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'deprecated feature inline_data' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v PG_AVAILABILITY | egrep -v PG_DEGRADED | egrep -v 'Reduced data availability' | egrep -v 'Degraded data redundancy' | egrep -v 'slow metadata IO' | egrep -v SLOW_OPS | egrep -v 'slow request' | head -n 1 2024-09-10T22:41:31.190 INFO:teuthology.orchestra.run.smithi019.stdout:2024-09-10T22:38:24.706668+0000 mon.a (mon.0) 1236 : cluster [WRN] Health check failed: 1 OSD(s) experiencing slow operations in BlueStore (BLUESTORE_SLOW_OP_ALERT) 2024-09-10T22:41:31.191 INFO:tasks.cephadm:Compressing logs... 2024-09-10T22:41:31.191 DEBUG:teuthology.orchestra.run.smithi019:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-10T22:41:31.234 DEBUG:teuthology.orchestra.run.smithi135:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-10T22:41:31.238 DEBUG:teuthology.orchestra.run.smithi138:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-10T22:41:31.258 INFO:teuthology.orchestra.run.smithi019.stderr:find: ‘/var/log/rbd-target-api’gzip -5 --verbose -- /var/log/ceph/22997a4c-6fc2-11ef-bcea-c7b262605968/ceph-osd.0.log 2024-09-10T22:41:31.258 INFO:teuthology.orchestra.run.smithi019.stderr:: No such file or directory 2024-09-10T22:41:31.258 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/22997a4c-6fc2-11ef-bcea-c7b262605968/ceph-osd.9.log 2024-09-10T22:41:31.258 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/22997a4c-6fc2-11ef-bcea-c7b262605968/ceph-volume.log 2024-09-10T22:41:31.259 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/22997a4c-6fc2-11ef-bcea-c7b262605968/ceph-osd.0.log: /var/log/ceph/22997a4c-6fc2-11ef-bcea-c7b262605968/ceph-osd.9.log: gzip -5 --verbose -- /var/log/ceph/22997a4c-6fc2-11ef-bcea-c7b262605968/ceph.audit.log 2024-09-10T22:41:31.259 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/22997a4c-6fc2-11ef-bcea-c7b262605968/ceph-volume.log: gzip -5 --verbose -- /var/log/ceph/22997a4c-6fc2-11ef-bcea-c7b262605968/ceph-mds.a.log 2024-09-10T22:41:31.259 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/22997a4c-6fc2-11ef-bcea-c7b262605968/ceph.cephadm.log 2024-09-10T22:41:31.259 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/22997a4c-6fc2-11ef-bcea-c7b262605968/ceph.audit.log: /var/log/ceph/22997a4c-6fc2-11ef-bcea-c7b262605968/ceph-mds.a.log: gzip -5 --verbose -- /var/log/ceph/22997a4c-6fc2-11ef-bcea-c7b262605968/ceph-mon.a.log 2024-09-10T22:41:31.261 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/22997a4c-6fc2-11ef-bcea-c7b262605968/ceph.cephadm.log: gzip -5 --verbose -- /var/log/ceph/22997a4c-6fc2-11ef-bcea-c7b262605968/ceph-mds.g.log 2024-09-10T22:41:31.261 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/22997a4c-6fc2-11ef-bcea-c7b262605968/ceph-mon.a.log: 82.3% -- replaced with /var/log/ceph/22997a4c-6fc2-11ef-bcea-c7b262605968/ceph.cephadm.log.gz 2024-09-10T22:41:31.261 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/22997a4c-6fc2-11ef-bcea-c7b262605968/ceph-osd.6.log 2024-09-10T22:41:31.262 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/22997a4c-6fc2-11ef-bcea-c7b262605968/ceph.log 2024-09-10T22:41:31.262 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/22997a4c-6fc2-11ef-bcea-c7b262605968/ceph-mds.g.log: /var/log/ceph/22997a4c-6fc2-11ef-bcea-c7b262605968/ceph-osd.6.log: 90.2% -- replaced with /var/log/ceph/22997a4c-6fc2-11ef-bcea-c7b262605968/ceph.audit.log.gz 2024-09-10T22:41:31.263 INFO:teuthology.orchestra.run.smithi138.stderr:find: ‘/var/log/rbd-target-api’gzip -5 --verbose -- /var/log/ceph/22997a4c-6fc2-11ef-bcea-c7b262605968/ceph-volume.log 2024-09-10T22:41:31.263 INFO:teuthology.orchestra.run.smithi138.stderr:: No such file or directory 2024-09-10T22:41:31.263 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/22997a4c-6fc2-11ef-bcea-c7b262605968/ceph.audit.log 2024-09-10T22:41:31.264 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/22997a4c-6fc2-11ef-bcea-c7b262605968/ceph-mds.i.log 2024-09-10T22:41:31.264 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/22997a4c-6fc2-11ef-bcea-c7b262605968/ceph-volume.log: /var/log/ceph/22997a4c-6fc2-11ef-bcea-c7b262605968/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/22997a4c-6fc2-11ef-bcea-c7b262605968/ceph-mon.c.log 2024-09-10T22:41:31.264 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/22997a4c-6fc2-11ef-bcea-c7b262605968/ceph-mds.i.log: gzip -5 --verbose -- /var/log/ceph/22997a4c-6fc2-11ef-bcea-c7b262605968/ceph.cephadm.log 2024-09-10T22:41:31.265 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/22997a4c-6fc2-11ef-bcea-c7b262605968/ceph-osd.11.log 2024-09-10T22:41:31.268 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/22997a4c-6fc2-11ef-bcea-c7b262605968/ceph-mon.c.log: /var/log/ceph/22997a4c-6fc2-11ef-bcea-c7b262605968/ceph.cephadm.log: gzip -5 --verbose -- /var/log/ceph/22997a4c-6fc2-11ef-bcea-c7b262605968/ceph-osd.2.log 2024-09-10T22:41:31.268 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/22997a4c-6fc2-11ef-bcea-c7b262605968/ceph-osd.11.log: 81.9% -- replaced with /var/log/ceph/22997a4c-6fc2-11ef-bcea-c7b262605968/ceph.cephadm.log.gz 2024-09-10T22:41:31.268 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/22997a4c-6fc2-11ef-bcea-c7b262605968/ceph-osd.5.log 2024-09-10T22:41:31.268 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/22997a4c-6fc2-11ef-bcea-c7b262605968/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/22997a4c-6fc2-11ef-bcea-c7b262605968/ceph.log 2024-09-10T22:41:31.273 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/22997a4c-6fc2-11ef-bcea-c7b262605968/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/22997a4c-6fc2-11ef-bcea-c7b262605968/ceph-mds.l.log 2024-09-10T22:41:31.273 INFO:teuthology.orchestra.run.smithi138.stderr: 90.4% -- replaced with /var/log/ceph/22997a4c-6fc2-11ef-bcea-c7b262605968/ceph.audit.log.gz 2024-09-10T22:41:31.273 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/22997a4c-6fc2-11ef-bcea-c7b262605968/ceph.log: 86.8% -- replaced with /var/log/ceph/22997a4c-6fc2-11ef-bcea-c7b262605968/ceph.log.gz 2024-09-10T22:41:31.273 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/22997a4c-6fc2-11ef-bcea-c7b262605968/ceph-osd.8.log 2024-09-10T22:41:31.273 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/22997a4c-6fc2-11ef-bcea-c7b262605968/ceph-mgr.z.log 2024-09-10T22:41:31.276 INFO:teuthology.orchestra.run.smithi135.stderr:find: ‘/var/log/rbd-target-api’gzip -5 --verbose -- /var/log/ceph/22997a4c-6fc2-11ef-bcea-c7b262605968/ceph-osd.10.log 2024-09-10T22:41:31.276 INFO:teuthology.orchestra.run.smithi135.stderr:: No such file or directory 2024-09-10T22:41:31.277 INFO:teuthology.orchestra.run.smithi135.stderr:gzip -5 --verbose -- /var/log/ceph/22997a4c-6fc2-11ef-bcea-c7b262605968/ceph-osd.1.log 2024-09-10T22:41:31.277 INFO:teuthology.orchestra.run.smithi135.stderr:gzip -5 --verbose -- /var/log/ceph/22997a4c-6fc2-11ef-bcea-c7b262605968/ceph-osd.7.log 2024-09-10T22:41:31.277 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/22997a4c-6fc2-11ef-bcea-c7b262605968/ceph-osd.10.log: /var/log/ceph/22997a4c-6fc2-11ef-bcea-c7b262605968/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/22997a4c-6fc2-11ef-bcea-c7b262605968/ceph-volume.log 2024-09-10T22:41:31.277 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/22997a4c-6fc2-11ef-bcea-c7b262605968/ceph-osd.7.log: gzip -5 --verbose -- /var/log/ceph/22997a4c-6fc2-11ef-bcea-c7b262605968/ceph-mds.b.log 2024-09-10T22:41:31.277 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/22997a4c-6fc2-11ef-bcea-c7b262605968/ceph-volume.log: gzip -5 --verbose -- /var/log/ceph/22997a4c-6fc2-11ef-bcea-c7b262605968/ceph-mds.k.log 2024-09-10T22:41:31.277 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/22997a4c-6fc2-11ef-bcea-c7b262605968/ceph-mds.b.log: gzip -5 --verbose -- /var/log/ceph/22997a4c-6fc2-11ef-bcea-c7b262605968/ceph-osd.4.log 2024-09-10T22:41:31.277 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/22997a4c-6fc2-11ef-bcea-c7b262605968/ceph-mds.k.log: gzip -5 --verbose -- /var/log/ceph/22997a4c-6fc2-11ef-bcea-c7b262605968/ceph.audit.log 2024-09-10T22:41:31.277 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/22997a4c-6fc2-11ef-bcea-c7b262605968/ceph-osd.4.log: gzip -5 --verbose -- /var/log/ceph/22997a4c-6fc2-11ef-bcea-c7b262605968/ceph.cephadm.log 2024-09-10T22:41:31.277 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/22997a4c-6fc2-11ef-bcea-c7b262605968/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/22997a4c-6fc2-11ef-bcea-c7b262605968/ceph-mgr.y.log 2024-09-10T22:41:31.278 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/22997a4c-6fc2-11ef-bcea-c7b262605968/ceph.cephadm.log: gzip -5 --verbose -- /var/log/ceph/22997a4c-6fc2-11ef-bcea-c7b262605968/ceph.log 2024-09-10T22:41:31.278 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/22997a4c-6fc2-11ef-bcea-c7b262605968/ceph-mgr.y.log: gzip -5 --verbose -- /var/log/ceph/22997a4c-6fc2-11ef-bcea-c7b262605968/ceph-mds.h.log 2024-09-10T22:41:31.278 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/22997a4c-6fc2-11ef-bcea-c7b262605968/ceph.log: gzip -5 --verbose -- /var/log/ceph/22997a4c-6fc2-11ef-bcea-c7b262605968/ceph-mon.b.log 2024-09-10T22:41:31.278 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/22997a4c-6fc2-11ef-bcea-c7b262605968/ceph-mds.h.log: gzip -5 --verbose -- /var/log/ceph/22997a4c-6fc2-11ef-bcea-c7b262605968/ceph-mds.e.log 2024-09-10T22:41:31.278 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/22997a4c-6fc2-11ef-bcea-c7b262605968/ceph-mon.b.log: gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-09-10T22:41:31.280 INFO:teuthology.orchestra.run.smithi019.stderr: 95.0% -- replaced with /var/log/ceph/22997a4c-6fc2-11ef-bcea-c7b262605968/ceph-mds.a.log.gz 2024-09-10T22:41:31.281 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/22997a4c-6fc2-11ef-bcea-c7b262605968/ceph-mds.d.log 2024-09-10T22:41:31.281 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/22997a4c-6fc2-11ef-bcea-c7b262605968/ceph.log: gzip -5 --verbose -- /var/log/ceph/22997a4c-6fc2-11ef-bcea-c7b262605968/ceph-mgr.x.log 2024-09-10T22:41:31.281 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/22997a4c-6fc2-11ef-bcea-c7b262605968/ceph-mds.d.log: 95.1% -- replaced with /var/log/ceph/22997a4c-6fc2-11ef-bcea-c7b262605968/ceph-mds.g.log.gz 2024-09-10T22:41:31.281 INFO:teuthology.orchestra.run.smithi019.stderr: 86.8% -- replaced with /var/log/ceph/22997a4c-6fc2-11ef-bcea-c7b262605968/ceph.log.gz 2024-09-10T22:41:31.281 INFO:teuthology.orchestra.run.smithi019.stderr: 91.1% -- replaced with /var/log/ceph/22997a4c-6fc2-11ef-bcea-c7b262605968/ceph-volume.log.gz 2024-09-10T22:41:31.281 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/22997a4c-6fc2-11ef-bcea-c7b262605968/ceph-mds.j.log 2024-09-10T22:41:31.281 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/22997a4c-6fc2-11ef-bcea-c7b262605968/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/22997a4c-6fc2-11ef-bcea-c7b262605968/ceph-osd.3.log 2024-09-10T22:41:31.282 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/22997a4c-6fc2-11ef-bcea-c7b262605968/ceph-mds.j.log: gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-09-10T22:41:31.282 INFO:teuthology.orchestra.run.smithi019.stderr: 95.1% -- replaced with /var/log/ceph/22997a4c-6fc2-11ef-bcea-c7b262605968/ceph-mds.d.log.gz 2024-09-10T22:41:31.282 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/22997a4c-6fc2-11ef-bcea-c7b262605968/ceph-mds.l.log: /var/log/ceph/22997a4c-6fc2-11ef-bcea-c7b262605968/ceph-osd.8.log: 91.0% -- replaced with /var/log/ceph/22997a4c-6fc2-11ef-bcea-c7b262605968/ceph-volume.log.gz 2024-09-10T22:41:31.282 INFO:teuthology.orchestra.run.smithi138.stderr: 95.1% -- replaced with /var/log/ceph/22997a4c-6fc2-11ef-bcea-c7b262605968/ceph-mds.l.log.gz 2024-09-10T22:41:31.283 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/22997a4c-6fc2-11ef-bcea-c7b262605968/ceph-mds.c.log 2024-09-10T22:41:31.283 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/22997a4c-6fc2-11ef-bcea-c7b262605968/ceph-mgr.z.log: gzip -5 --verbose -- /var/log/ceph/22997a4c-6fc2-11ef-bcea-c7b262605968/ceph-mds.f.log 2024-09-10T22:41:31.283 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/22997a4c-6fc2-11ef-bcea-c7b262605968/ceph-osd.3.log: /var/log/ceph/cephadm.log: 95.2% -- replaced with /var/log/ceph/22997a4c-6fc2-11ef-bcea-c7b262605968/ceph-mds.j.log.gz 2024-09-10T22:41:31.283 INFO:teuthology.orchestra.run.smithi019.stderr: 93.9% -- replaced with /var/log/ceph/cephadm.log.gz 2024-09-10T22:41:31.285 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/22997a4c-6fc2-11ef-bcea-c7b262605968/ceph-mds.c.log: 92.7% -- replaced with /var/log/ceph/22997a4c-6fc2-11ef-bcea-c7b262605968/ceph-mgr.z.log.gz 2024-09-10T22:41:31.293 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-09-10T22:41:31.310 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/22997a4c-6fc2-11ef-bcea-c7b262605968/ceph-mds.f.log: /var/log/ceph/cephadm.log: 92.2% -- replaced with /var/log/ceph/cephadm.log.gz 2024-09-10T22:41:31.336 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/22997a4c-6fc2-11ef-bcea-c7b262605968/ceph-mds.e.log: /var/log/ceph/cephadm.log: 82.0% -- replaced with /var/log/ceph/22997a4c-6fc2-11ef-bcea-c7b262605968/ceph.cephadm.log.gz 2024-09-10T22:41:31.384 INFO:teuthology.orchestra.run.smithi135.stderr: 92.5% -- replaced with /var/log/ceph/22997a4c-6fc2-11ef-bcea-c7b262605968/ceph-mgr.y.log.gz 2024-09-10T22:41:31.386 INFO:teuthology.orchestra.run.smithi138.stderr: 94.3% -- replaced with /var/log/ceph/22997a4c-6fc2-11ef-bcea-c7b262605968/ceph-mds.f.log.gz 2024-09-10T22:41:31.387 INFO:teuthology.orchestra.run.smithi138.stderr: 92.8% -- replaced with /var/log/ceph/22997a4c-6fc2-11ef-bcea-c7b262605968/ceph-mds.c.log.gz 2024-09-10T22:41:31.396 INFO:teuthology.orchestra.run.smithi138.stderr: 92.6% -- replaced with /var/log/ceph/22997a4c-6fc2-11ef-bcea-c7b262605968/ceph-mds.i.log.gz 2024-09-10T22:41:31.412 INFO:teuthology.orchestra.run.smithi135.stderr: 95.0% -- replaced with /var/log/ceph/22997a4c-6fc2-11ef-bcea-c7b262605968/ceph-mds.k.log.gz 2024-09-10T22:41:31.441 INFO:teuthology.orchestra.run.smithi135.stderr: 91.0% -- replaced with /var/log/ceph/22997a4c-6fc2-11ef-bcea-c7b262605968/ceph-volume.log.gz 2024-09-10T22:41:31.570 INFO:teuthology.orchestra.run.smithi019.stderr: 90.4% -- replaced with /var/log/ceph/22997a4c-6fc2-11ef-bcea-c7b262605968/ceph-mgr.x.log.gz 2024-09-10T22:41:31.602 INFO:teuthology.orchestra.run.smithi138.stderr: 91.6% -- replaced with /var/log/ceph/22997a4c-6fc2-11ef-bcea-c7b262605968/ceph-mon.c.log.gz 2024-09-10T22:41:31.660 INFO:teuthology.orchestra.run.smithi135.stderr: 86.8% -- replaced with /var/log/ceph/22997a4c-6fc2-11ef-bcea-c7b262605968/ceph.log.gz 2024-09-10T22:41:31.660 INFO:teuthology.orchestra.run.smithi135.stderr: 91.9% 90.4% -- replaced with /var/log/ceph/cephadm.log.gz 2024-09-10T22:41:31.660 INFO:teuthology.orchestra.run.smithi135.stderr: -- replaced with /var/log/ceph/22997a4c-6fc2-11ef-bcea-c7b262605968/ceph.audit.log.gz 2024-09-10T22:41:32.234 INFO:teuthology.orchestra.run.smithi019.stderr: 90.3% -- replaced with /var/log/ceph/22997a4c-6fc2-11ef-bcea-c7b262605968/ceph-mon.a.log.gz 2024-09-10T22:41:32.608 INFO:teuthology.orchestra.run.smithi135.stderr: 91.6% -- replaced with /var/log/ceph/22997a4c-6fc2-11ef-bcea-c7b262605968/ceph-mon.b.log.gz 2024-09-10T22:41:32.670 INFO:teuthology.orchestra.run.smithi135.stderr: 94.4% -- replaced with /var/log/ceph/22997a4c-6fc2-11ef-bcea-c7b262605968/ceph-mds.e.log.gz 2024-09-10T22:41:33.228 INFO:teuthology.orchestra.run.smithi019.stderr: 92.9% -- replaced with /var/log/ceph/22997a4c-6fc2-11ef-bcea-c7b262605968/ceph-osd.9.log.gz 2024-09-10T22:41:33.871 INFO:teuthology.orchestra.run.smithi138.stderr: 93.2% -- replaced with /var/log/ceph/22997a4c-6fc2-11ef-bcea-c7b262605968/ceph-osd.8.log.gz 2024-09-10T22:41:33.936 INFO:teuthology.orchestra.run.smithi138.stderr: 93.1% -- replaced with /var/log/ceph/22997a4c-6fc2-11ef-bcea-c7b262605968/ceph-osd.2.log.gz 2024-09-10T22:41:34.550 INFO:teuthology.orchestra.run.smithi019.stderr: 93.2% -- replaced with /var/log/ceph/22997a4c-6fc2-11ef-bcea-c7b262605968/ceph-osd.6.log.gz 2024-09-10T22:41:34.594 INFO:teuthology.orchestra.run.smithi138.stderr: 93.2% -- replaced with /var/log/ceph/22997a4c-6fc2-11ef-bcea-c7b262605968/ceph-osd.5.log.gz 2024-09-10T22:41:34.626 INFO:teuthology.orchestra.run.smithi019.stderr: 93.3% -- replaced with /var/log/ceph/22997a4c-6fc2-11ef-bcea-c7b262605968/ceph-osd.0.log.gz 2024-09-10T22:41:34.704 INFO:teuthology.orchestra.run.smithi138.stderr: 93.4% -- replaced with /var/log/ceph/22997a4c-6fc2-11ef-bcea-c7b262605968/ceph-osd.11.log.gz 2024-09-10T22:41:34.707 INFO:teuthology.orchestra.run.smithi138.stderr: 2024-09-10T22:41:34.707 INFO:teuthology.orchestra.run.smithi138.stderr:real 0m3.453s 2024-09-10T22:41:34.707 INFO:teuthology.orchestra.run.smithi138.stderr:user 0m12.263s 2024-09-10T22:41:34.707 INFO:teuthology.orchestra.run.smithi138.stderr:sys 0m0.486s 2024-09-10T22:41:35.072 INFO:teuthology.orchestra.run.smithi019.stderr: 93.2% -- replaced with /var/log/ceph/22997a4c-6fc2-11ef-bcea-c7b262605968/ceph-osd.3.log.gz 2024-09-10T22:41:35.075 INFO:teuthology.orchestra.run.smithi019.stderr: 2024-09-10T22:41:35.075 INFO:teuthology.orchestra.run.smithi019.stderr:real 0m3.827s 2024-09-10T22:41:35.075 INFO:teuthology.orchestra.run.smithi019.stderr:user 0m13.276s 2024-09-10T22:41:35.075 INFO:teuthology.orchestra.run.smithi019.stderr:sys 0m0.482s 2024-09-10T22:41:39.180 INFO:teuthology.orchestra.run.smithi135.stderr: 93.2% -- replaced with /var/log/ceph/22997a4c-6fc2-11ef-bcea-c7b262605968/ceph-osd.1.log.gz 2024-09-10T22:41:39.412 INFO:teuthology.orchestra.run.smithi135.stderr: 92.8% -- replaced with /var/log/ceph/22997a4c-6fc2-11ef-bcea-c7b262605968/ceph-osd.4.log.gz 2024-09-10T22:41:42.681 INFO:teuthology.orchestra.run.smithi135.stderr: 93.4% -- replaced with /var/log/ceph/22997a4c-6fc2-11ef-bcea-c7b262605968/ceph-osd.7.log.gz 2024-09-10T22:41:43.587 INFO:teuthology.orchestra.run.smithi135.stderr: 93.1% -- replaced with /var/log/ceph/22997a4c-6fc2-11ef-bcea-c7b262605968/ceph-osd.10.log.gz 2024-09-10T22:42:00.724 INFO:teuthology.orchestra.run.smithi135.stderr: 97.3% -- replaced with /var/log/ceph/22997a4c-6fc2-11ef-bcea-c7b262605968/ceph-mds.h.log.gz 2024-09-10T22:43:07.312 INFO:teuthology.orchestra.run.smithi135.stderr: 94.9% -- replaced with /var/log/ceph/22997a4c-6fc2-11ef-bcea-c7b262605968/ceph-mds.b.log.gz 2024-09-10T22:43:07.314 INFO:teuthology.orchestra.run.smithi135.stderr: 2024-09-10T22:43:07.314 INFO:teuthology.orchestra.run.smithi135.stderr:real 1m36.060s 2024-09-10T22:43:07.314 INFO:teuthology.orchestra.run.smithi135.stderr:user 1m26.553s 2024-09-10T22:43:07.314 INFO:teuthology.orchestra.run.smithi135.stderr:sys 0m3.881s 2024-09-10T22:43:07.314 INFO:tasks.cephadm:Archiving logs... 2024-09-10T22:43:07.315 DEBUG:teuthology.misc:Transferring archived files from smithi019:/var/log/ceph to /home/teuthworker/archive/hyelloji-2024-09-10_16:59:47-fs-wip-hemanth-testing-2024-09-10-0723-testing-default-smithi/7899721/remote/smithi019/log 2024-09-10T22:43:07.316 DEBUG:teuthology.orchestra.run.smithi019:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-10T22:43:09.906 DEBUG:teuthology.misc:Transferring archived files from smithi135:/var/log/ceph to /home/teuthworker/archive/hyelloji-2024-09-10_16:59:47-fs-wip-hemanth-testing-2024-09-10-0723-testing-default-smithi/7899721/remote/smithi135/log 2024-09-10T22:43:09.940 DEBUG:teuthology.orchestra.run.smithi135:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-10T22:43:21.372 DEBUG:teuthology.misc:Transferring archived files from smithi138:/var/log/ceph to /home/teuthworker/archive/hyelloji-2024-09-10_16:59:47-fs-wip-hemanth-testing-2024-09-10-0723-testing-default-smithi/7899721/remote/smithi138/log 2024-09-10T22:43:21.373 DEBUG:teuthology.orchestra.run.smithi138:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-10T22:43:23.330 INFO:tasks.cephadm:Removing cluster... 2024-09-10T22:43:23.330 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 22997a4c-6fc2-11ef-bcea-c7b262605968 --force 2024-09-10T22:43:23.546 INFO:teuthology.orchestra.run.smithi019.stdout:Deleting cluster with fsid: 22997a4c-6fc2-11ef-bcea-c7b262605968 2024-09-10T22:43:23.831 DEBUG:teuthology.orchestra.run.smithi135:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 22997a4c-6fc2-11ef-bcea-c7b262605968 --force 2024-09-10T22:43:24.035 INFO:teuthology.orchestra.run.smithi135.stdout:Deleting cluster with fsid: 22997a4c-6fc2-11ef-bcea-c7b262605968 2024-09-10T22:43:24.374 DEBUG:teuthology.orchestra.run.smithi138:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 22997a4c-6fc2-11ef-bcea-c7b262605968 --force 2024-09-10T22:43:24.579 INFO:teuthology.orchestra.run.smithi138.stdout:Deleting cluster with fsid: 22997a4c-6fc2-11ef-bcea-c7b262605968 2024-09-10T22:43:24.914 INFO:tasks.cephadm:Removing cephadm ... 2024-09-10T22:43:24.914 DEBUG:teuthology.orchestra.run.smithi019:> rm -rf /home/ubuntu/cephtest/cephadm 2024-09-10T22:43:24.935 DEBUG:teuthology.orchestra.run.smithi135:> rm -rf /home/ubuntu/cephtest/cephadm 2024-09-10T22:43:24.952 DEBUG:teuthology.orchestra.run.smithi138:> rm -rf /home/ubuntu/cephtest/cephadm 2024-09-10T22:43:24.968 INFO:tasks.cephadm:Teardown complete 2024-09-10T22:43:24.968 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-09-10T22:43:24.979 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-09-10T22:43:24.979 DEBUG:teuthology.orchestra.run.smithi019:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-10T22:43:24.981 DEBUG:teuthology.orchestra.run.smithi135:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-10T22:43:24.994 DEBUG:teuthology.orchestra.run.smithi138:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-10T22:43:25.118 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-09-10T22:43:25.128 INFO:teuthology.task.clock:Checking final clock skew... 2024-09-10T22:43:25.128 DEBUG:teuthology.orchestra.run.smithi019:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-10T22:43:25.131 DEBUG:teuthology.orchestra.run.smithi135:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-10T22:43:25.133 DEBUG:teuthology.orchestra.run.smithi138:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-10T22:43:25.146 INFO:teuthology.orchestra.run.smithi019.stderr:bash: line 1: ntpq: command not found 2024-09-10T22:43:25.146 INFO:teuthology.orchestra.run.smithi135.stderr:bash: line 1: ntpq: command not found 2024-09-10T22:43:25.147 INFO:teuthology.orchestra.run.smithi138.stderr:bash: line 1: ntpq: command not found 2024-09-10T22:43:25.151 INFO:teuthology.orchestra.run.smithi019.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-10T22:43:25.151 INFO:teuthology.orchestra.run.smithi019.stdout:=============================================================================== 2024-09-10T22:43:25.152 INFO:teuthology.orchestra.run.smithi019.stdout:^* hv01.front.sepia.ceph.com 3 6 377 56 -119us[ -94us] +/- 58ms 2024-09-10T22:43:25.152 INFO:teuthology.orchestra.run.smithi019.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 60 +681us[ +706us] +/- 57ms 2024-09-10T22:43:25.152 INFO:teuthology.orchestra.run.smithi019.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 61 -772us[ -747us] +/- 86ms 2024-09-10T22:43:25.152 INFO:teuthology.orchestra.run.smithi019.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-09-10T22:43:25.153 INFO:teuthology.orchestra.run.smithi138.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-10T22:43:25.153 INFO:teuthology.orchestra.run.smithi138.stdout:=============================================================================== 2024-09-10T22:43:25.153 INFO:teuthology.orchestra.run.smithi138.stdout:^* hv01.front.sepia.ceph.com 3 6 377 58 -110us[ -73us] +/- 58ms 2024-09-10T22:43:25.153 INFO:teuthology.orchestra.run.smithi138.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 58 +703us[ +703us] +/- 57ms 2024-09-10T22:43:25.154 INFO:teuthology.orchestra.run.smithi138.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 58 -748us[ -711us] +/- 86ms 2024-09-10T22:43:25.154 INFO:teuthology.orchestra.run.smithi138.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-09-10T22:43:25.168 INFO:teuthology.orchestra.run.smithi135.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-10T22:43:25.168 INFO:teuthology.orchestra.run.smithi135.stdout:=============================================================================== 2024-09-10T22:43:25.168 INFO:teuthology.orchestra.run.smithi135.stdout:^* hv01.front.sepia.ceph.com 3 6 377 58 -119us[ -107us] +/- 58ms 2024-09-10T22:43:25.168 INFO:teuthology.orchestra.run.smithi135.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 57 +710us[ +710us] +/- 57ms 2024-09-10T22:43:25.168 INFO:teuthology.orchestra.run.smithi135.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 61 -756us[ -744us] +/- 86ms 2024-09-10T22:43:25.168 INFO:teuthology.orchestra.run.smithi135.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-09-10T22:43:25.169 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-09-10T22:43:25.178 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-09-10T22:43:25.178 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-09-10T22:43:25.187 DEBUG:teuthology.orchestra.run.smithi019:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-10T22:43:25.282 DEBUG:teuthology.orchestra.run.smithi135:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-10T22:43:25.366 DEBUG:teuthology.orchestra.run.smithi138:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-10T22:43:25.433 DEBUG:teuthology.orchestra.run.smithi019:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 2024-09-10T22:43:25.464 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-10T22:43:25.465 DEBUG:teuthology.orchestra.run.smithi135:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 2024-09-10T22:43:25.493 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-10T22:43:25.493 DEBUG:teuthology.orchestra.run.smithi138:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 2024-09-10T22:43:25.521 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-10T22:43:25.522 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-09-10T22:43:25.532 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-09-10T22:43:25.542 INFO:teuthology.task.internal:Duration was 2058.868731 seconds 2024-09-10T22:43:25.543 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-09-10T22:43:25.558 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-09-10T22:43:25.558 DEBUG:teuthology.orchestra.run.smithi019:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-10T22:43:25.561 DEBUG:teuthology.orchestra.run.smithi135:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-10T22:43:25.564 DEBUG:teuthology.orchestra.run.smithi138:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-10T22:43:25.601 INFO:teuthology.orchestra.run.smithi019.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-10T22:43:25.602 INFO:teuthology.orchestra.run.smithi138.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-10T22:43:25.614 INFO:teuthology.orchestra.run.smithi135.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-10T22:43:25.918 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-09-10T22:43:25.918 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi019.front.sepia.ceph.com 2024-09-10T22:43:25.919 DEBUG:teuthology.orchestra.run.smithi019:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-10T22:43:25.942 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi135.front.sepia.ceph.com 2024-09-10T22:43:25.942 DEBUG:teuthology.orchestra.run.smithi135:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-10T22:43:25.971 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi138.front.sepia.ceph.com 2024-09-10T22:43:25.971 DEBUG:teuthology.orchestra.run.smithi138:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-10T22:43:25.994 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-09-10T22:43:25.994 DEBUG:teuthology.orchestra.run.smithi019:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-10T22:43:25.997 DEBUG:teuthology.orchestra.run.smithi135:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-10T22:43:26.014 DEBUG:teuthology.orchestra.run.smithi138:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-10T22:43:26.060 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-09-10T22:43:26.060 DEBUG:teuthology.orchestra.run.smithi019:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-10T22:43:26.066 DEBUG:teuthology.orchestra.run.smithi135:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-10T22:43:26.080 DEBUG:teuthology.orchestra.run.smithi138:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-10T22:43:27.084 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-09-10T22:43:27.094 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-09-10T22:43:27.094 DEBUG:teuthology.orchestra.run.smithi019:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-10T22:43:27.120 DEBUG:teuthology.orchestra.run.smithi135:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-10T22:43:27.164 DEBUG:teuthology.orchestra.run.smithi138:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-10T22:43:27.194 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-09-10T22:43:27.206 DEBUG:teuthology.orchestra.run.smithi019:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-10T22:43:27.208 DEBUG:teuthology.orchestra.run.smithi135:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-10T22:43:27.210 DEBUG:teuthology.orchestra.run.smithi138:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-10T22:43:27.229 INFO:teuthology.orchestra.run.smithi019.stdout:kernel.core_pattern = core 2024-09-10T22:43:27.244 INFO:teuthology.orchestra.run.smithi135.stdout:kernel.core_pattern = core 2024-09-10T22:43:27.261 INFO:teuthology.orchestra.run.smithi138.stdout:kernel.core_pattern = core 2024-09-10T22:43:27.292 DEBUG:teuthology.orchestra.run.smithi019:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-10T22:43:27.308 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-10T22:43:27.308 DEBUG:teuthology.orchestra.run.smithi135:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-10T22:43:27.323 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-10T22:43:27.323 DEBUG:teuthology.orchestra.run.smithi138:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-10T22:43:27.347 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-10T22:43:27.348 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-09-10T22:43:27.359 INFO:teuthology.task.internal:Transferring archived files... 2024-09-10T22:43:27.360 DEBUG:teuthology.misc:Transferring archived files from smithi019:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/hyelloji-2024-09-10_16:59:47-fs-wip-hemanth-testing-2024-09-10-0723-testing-default-smithi/7899721/remote/smithi019 2024-09-10T22:43:27.360 DEBUG:teuthology.orchestra.run.smithi019:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-10T22:43:27.417 DEBUG:teuthology.misc:Transferring archived files from smithi135:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/hyelloji-2024-09-10_16:59:47-fs-wip-hemanth-testing-2024-09-10-0723-testing-default-smithi/7899721/remote/smithi135 2024-09-10T22:43:27.417 DEBUG:teuthology.orchestra.run.smithi135:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-10T22:43:27.455 DEBUG:teuthology.misc:Transferring archived files from smithi138:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/hyelloji-2024-09-10_16:59:47-fs-wip-hemanth-testing-2024-09-10-0723-testing-default-smithi/7899721/remote/smithi138 2024-09-10T22:43:27.455 DEBUG:teuthology.orchestra.run.smithi138:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-10T22:43:27.493 INFO:teuthology.task.internal:Removing archive directory... 2024-09-10T22:43:27.493 DEBUG:teuthology.orchestra.run.smithi019:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-10T22:43:27.496 DEBUG:teuthology.orchestra.run.smithi135:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-10T22:43:27.498 DEBUG:teuthology.orchestra.run.smithi138:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-10T22:43:27.544 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-09-10T22:43:27.558 INFO:teuthology.task.internal:Not uploading archives. 2024-09-10T22:43:27.558 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-09-10T22:43:27.568 INFO:teuthology.task.internal:Tidying up after the test... 2024-09-10T22:43:27.569 DEBUG:teuthology.orchestra.run.smithi019:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-10T22:43:27.571 DEBUG:teuthology.orchestra.run.smithi135:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-10T22:43:27.573 DEBUG:teuthology.orchestra.run.smithi138:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-10T22:43:27.584 INFO:teuthology.orchestra.run.smithi019.stdout: 262169 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 10 22:43 /home/ubuntu/cephtest 2024-09-10T22:43:27.587 INFO:teuthology.orchestra.run.smithi135.stdout: 262165 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 10 22:43 /home/ubuntu/cephtest 2024-09-10T22:43:27.600 INFO:teuthology.orchestra.run.smithi138.stdout: 262165 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 10 22:43 /home/ubuntu/cephtest 2024-09-10T22:43:27.601 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-09-10T22:43:27.613 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-09-10T22:43:27.640 INFO:teuthology.run:Summary data: description: fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mgr mon osd} mount/kclient/{base/{mount-syntax/{v2} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} ms_mode/secure wsync/yes} objectstore-ec/bluestore-bitmap omap_limit/10 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts pg_health session_timeout} ranks/multi/{balancer/automatic export-check n/3 replication/always} standby-replay tasks/{0-subvolume/{with-quota} 1-check-counter 2-scrub/yes 3-snaps/no 4-flush/yes 5-quiesce/no 6-workunit/suites/iogen}} duration: 2058.868731021881 failure_reason: '"2024-09-10T22:38:24.706668+0000 mon.a (mon.0) 1236 : cluster [WRN] Health check failed: 1 OSD(s) experiencing slow operations in BlueStore (BLUESTORE_SLOW_OP_ALERT)" in cluster log' flavor: default owner: scheduled_hyelloji@teuthology success: false 2024-09-10T22:43:27.640 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-10T22:43:27.730 INFO:teuthology.run:FAIL